-- Logs begin at Thu 2022-10-27 02:28:17 UTC, end at Thu 2022-10-27 05:13:48 UTC. -- Oct 27 03:10:07.331831 n-d-862769-1 systemd[1]: Starting Devstack devstack@n-api.service... Oct 27 03:10:07.340640 n-d-862769-1 devstack@n-api.service[105140]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 27 03:10:07.342625 n-d-862769-1 devstack@n-api.service[105140]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Oct 27 03:10:07 2022] *** Oct 27 03:10:07.342625 n-d-862769-1 devstack@n-api.service[105140]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 27 03:10:07.342625 n-d-862769-1 devstack@n-api.service[105140]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 27 03:10:07.342625 n-d-862769-1 devstack@n-api.service[105140]: nodename: n-d-862769-1 Oct 27 03:10:07.342625 n-d-862769-1 devstack@n-api.service[105140]: machine: x86_64 Oct 27 03:10:07.342625 n-d-862769-1 devstack@n-api.service[105140]: clock source: unix Oct 27 03:10:07.342625 n-d-862769-1 devstack@n-api.service[105140]: pcre jit disabled Oct 27 03:10:07.342625 n-d-862769-1 devstack@n-api.service[105140]: detected number of CPU cores: 4 Oct 27 03:10:07.342625 n-d-862769-1 devstack@n-api.service[105140]: current working directory: / Oct 27 03:10:07.342625 n-d-862769-1 devstack@n-api.service[105140]: detected binary path: /usr/bin/uwsgi-core Oct 27 03:10:07.343339 n-d-862769-1 devstack@n-api.service[105140]: your processes number limit is 47680 Oct 27 03:10:07.343339 n-d-862769-1 devstack@n-api.service[105140]: your memory page size is 4096 bytes Oct 27 03:10:07.343339 n-d-862769-1 devstack@n-api.service[105140]: detected max file descriptor number: 2048 Oct 27 03:10:07.343339 n-d-862769-1 devstack@n-api.service[105140]: lock engine: pthread robust mutexes Oct 27 03:10:07.343339 n-d-862769-1 devstack@n-api.service[105140]: thunder lock: enabled Oct 27 03:10:07.343339 n-d-862769-1 devstack@n-api.service[105140]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 27 03:10:07.343339 n-d-862769-1 devstack@n-api.service[105140]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 27 03:10:07.382269 n-d-862769-1 devstack@n-api.service[105140]: Python main interpreter initialized at 0x56335931c9c0 Oct 27 03:10:07.382269 n-d-862769-1 devstack@n-api.service[105140]: python threads support enabled Oct 27 03:10:07.382269 n-d-862769-1 devstack@n-api.service[105140]: your server socket listen backlog is limited to 100 connections Oct 27 03:10:07.382269 n-d-862769-1 devstack@n-api.service[105140]: your mercy for graceful operations on workers is 90 seconds Oct 27 03:10:07.382692 n-d-862769-1 devstack@n-api.service[105140]: mapped 403077 bytes (393 KB) for 2 cores Oct 27 03:10:07.382692 n-d-862769-1 devstack@n-api.service[105140]: *** Operational MODE: preforking *** Oct 27 03:10:07.382933 n-d-862769-1 devstack@n-api.service[105140]: *** uWSGI is running in multiple interpreter mode *** Oct 27 03:10:07.382933 n-d-862769-1 devstack@n-api.service[105140]: spawned uWSGI master process (pid: 105140) Oct 27 03:10:07.383122 n-d-862769-1 systemd[1]: Started Devstack devstack@n-api.service. Oct 27 03:10:07.383695 n-d-862769-1 devstack@n-api.service[105140]: spawned uWSGI worker 1 (pid: 105141, cores: 1) Oct 27 03:10:07.384661 n-d-862769-1 devstack@n-api.service[105140]: spawned uWSGI worker 2 (pid: 105142, cores: 1) Oct 27 03:10:07.384661 n-d-862769-1 devstack@n-api.service[105140]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 27 03:10:08.041682 n-d-862769-1 devstack@n-api.service[105141]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 27 03:10:08.043015 n-d-862769-1 devstack@n-api.service[105142]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 27 03:10:09.128876 n-d-862769-1 devstack@n-api.service[105141]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 03:10:09.128876 n-d-862769-1 devstack@n-api.service[105141]: from cryptography.utils import int_from_bytes Oct 27 03:10:09.129477 n-d-862769-1 devstack@n-api.service[105141]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 03:10:09.129477 n-d-862769-1 devstack@n-api.service[105141]: from cryptography.utils import int_from_bytes Oct 27 03:10:09.130163 n-d-862769-1 devstack@n-api.service[105142]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 03:10:09.130163 n-d-862769-1 devstack@n-api.service[105142]: from cryptography.utils import int_from_bytes Oct 27 03:10:09.131114 n-d-862769-1 devstack@n-api.service[105142]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 03:10:09.131114 n-d-862769-1 devstack@n-api.service[105142]: from cryptography.utils import int_from_bytes Oct 27 03:10:11.616543 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 27 03:10:11.617130 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 27 03:10:11.617305 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 27 03:10:11.617542 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 27 03:10:11.617923 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 27 03:10:11.618012 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 27 03:10:11.618121 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 27 03:10:11.618287 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 27 03:10:11.618392 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.618600 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.618688 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 27 03:10:11.618888 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 27 03:10:11.618975 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.619210 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.619305 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.619530 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.619617 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.619833 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.619929 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.620146 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.620234 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.620455 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.620548 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.620771 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.620858 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.621023 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.621108 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.621331 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.621416 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.621650 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-862769-1 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.621749 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.621944 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.622067 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.622272 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.622357 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.622574 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.622662 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-862769-1 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.622881 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.622973 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.623178 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.623272 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.623486 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.623570 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.623781 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.623865 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.624089 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.624266 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.624407 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.624697 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.624805 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.624995 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.625192 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.625301 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.625494 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.625599 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.625796 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.625914 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.626130 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.626222 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.626464 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.626561 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.626774 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.626860 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.627088 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.627215 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.627390 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.627478 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.627694 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.627781 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-862769-1 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.628011 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.628142 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.628327 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.628434 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.628642 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.628725 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-862769-1 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.628998 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.629089 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.629305 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.629389 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.629611 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.629755 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.629919 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.630005 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.630292 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.630381 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.630595 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.630698 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.630913 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.630999 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.631222 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.631308 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.631531 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.631644 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.631841 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.631931 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.632136 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.632228 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.632434 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.632527 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.632733 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.632830 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.633040 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.633129 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.633336 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.633427 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.633630 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.633716 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.633874 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.633961 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.634252 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.634339 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.634554 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.634651 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.634803 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.634900 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.635108 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.635201 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.635409 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.635495 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.635654 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.635760 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.635962 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.636048 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.636259 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.636343 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.636505 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.636599 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.636819 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.636905 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.637131 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.637259 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.637430 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.637516 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.637728 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.637824 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.638024 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.638143 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.638342 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.638731 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.638894 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.638983 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.639196 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.639359 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.639498 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.639583 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.639803 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.639888 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.640102 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.640202 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.640412 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.640498 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.640727 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.640819 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.641034 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.641127 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.641331 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.641415 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.641663 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.641749 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.641961 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.642076 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.642285 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.642381 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.642597 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.642683 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.642910 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.643003 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.643212 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.643299 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.643511 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.643602 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.643808 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.643895 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.644115 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.644199 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.644419 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.644503 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.644720 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.644806 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.644962 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.645047 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.645260 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.645345 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.645557 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.645644 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.646409 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.646516 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.646709 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.646810 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.647004 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.647090 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.647302 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.647391 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.647593 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.647687 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.647891 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.647976 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.648189 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.648275 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.648483 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.648580 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.648778 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.648875 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.649074 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.649167 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.649371 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.649465 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.649666 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.649752 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.649963 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.650110 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.650285 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.650383 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.650583 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.650675 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.650886 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.650971 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.651187 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.651272 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.651483 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.651567 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.651780 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.651878 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.652076 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.652165 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.652375 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.652461 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.652673 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.652770 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.652969 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.653062 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.653267 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.653404 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.653574 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.653710 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.653866 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.654003 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.654182 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.654313 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.654490 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.654622 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.654772 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.654906 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.655073 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.655208 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.655381 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.655516 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.655660 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.655805 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.655948 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.656080 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.656266 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.656402 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.656565 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.656716 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.656860 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.656993 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.657162 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.657259 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.657464 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.657610 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.657758 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.657893 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.658055 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.658201 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.658361 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.658499 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.658644 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.658776 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.658948 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.659087 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.659250 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.659382 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.659549 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.659689 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.659826 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.659970 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.660138 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.660268 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.660438 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.660573 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.660743 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.660892 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.661029 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.661166 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.661331 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.661595 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.662306 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:10:11.662445 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.662581 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.662714 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.662855 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.662992 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.663192 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.663345 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.663501 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.663630 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.663806 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.663944 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.664100 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.664234 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.664416 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.664552 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.664720 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.664864 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.665025 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.665161 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.665330 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.665466 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.665637 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.665780 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.665945 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.666106 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.666346 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.666493 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.666637 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.666789 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.666924 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.667065 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.667210 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.667358 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.667447 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.667581 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.667755 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.667898 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.668073 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.668212 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.668378 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.668517 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.668680 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.668824 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.668999 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.669135 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.669323 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.669462 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.669628 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.669758 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.669944 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.670102 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.670284 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.670416 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.670588 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.670718 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.670890 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.671020 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.671192 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.671333 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.671520 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.671654 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.671821 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.671964 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.672108 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.672243 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.672421 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.672552 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.672724 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.672854 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.673033 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.673162 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.673335 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.673474 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.673638 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.673792 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.673942 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.674109 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.674268 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.674398 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.674570 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.674717 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.674877 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.675013 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.675183 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.675319 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.675491 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.675637 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.675788 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.675922 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.676095 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.676232 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.676405 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.676545 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.676710 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.676846 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.677013 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.677155 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.677355 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.677457 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.677655 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.677799 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.677937 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.678101 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.678243 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.678381 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.678552 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.678691 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.678836 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.678922 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.679145 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.679241 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.679460 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.679546 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.679759 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.679846 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.680073 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.680159 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.680369 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.680455 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.680675 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.680768 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.680979 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.681067 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.681282 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.681378 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.681579 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.681678 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.681882 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.681968 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.682207 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.682295 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.682506 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.682609 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.682814 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.682900 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.683116 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.683208 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.683414 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.683552 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.683725 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.683819 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.684025 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.684111 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.684324 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.684418 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.684629 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.684714 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.684932 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.685017 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.685234 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.685323 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.685539 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.685645 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.685845 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.685930 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.686175 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.686267 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.686480 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.686566 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.686784 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.686870 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.687102 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.687196 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.687410 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.687497 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.687705 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.687794 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.688021 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.688109 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.688337 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.688423 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.688635 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.688793 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.688932 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.689018 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.689266 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.689351 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.689578 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.689678 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.689880 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.689966 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.690204 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.690292 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.690504 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.690602 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.690802 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.690886 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.691101 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.691187 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.691397 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.691492 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.691695 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.691782 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.691993 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.692078 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.692293 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.692382 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.692593 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.692688 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.692915 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.693009 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.693235 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.693323 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.693528 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.693659 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.693829 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.693914 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.694153 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.694243 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.694454 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.694540 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.694792 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.694877 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.695093 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.695181 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.695407 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.695493 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.695718 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.695814 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.696027 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.696113 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.696331 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.696418 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.696635 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.696730 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.696938 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.697024 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.697243 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.697328 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.697550 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.697643 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.697850 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.697935 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.698182 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.698269 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.698485 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.698581 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.698793 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.698878 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.699094 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.699185 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.699405 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.699492 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.699703 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.699792 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.700010 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.700096 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.700322 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.700408 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.700623 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.700709 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.700935 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.701020 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.701247 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.701333 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.701551 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.701637 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.701857 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.701943 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.702182 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.702282 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.702486 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.702609 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.702791 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.702877 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.703093 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.703187 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.703403 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.703489 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.703705 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.703800 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.704016 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.704114 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.704318 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.704403 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.704632 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.704726 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.704933 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.705020 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.705237 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.705321 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.705533 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.705630 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.705845 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.705931 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.706184 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.706272 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.706488 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.706587 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.706798 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.706890 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.707099 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.707184 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.707414 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.707502 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.707717 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.707848 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.708021 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.708109 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.708831 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.708925 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.709134 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.709231 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.709433 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.709520 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.709734 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.709828 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.710069 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.710158 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.710362 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.710456 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.710666 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.710753 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.710965 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.711050 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.711271 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.711364 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.711570 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.711655 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.711869 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.711955 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.712166 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.712261 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.712469 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.712555 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.712771 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.712910 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.713070 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.713167 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.713376 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.713463 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.713686 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.713807 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.713983 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.714100 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.714307 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.714394 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.714621 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.714706 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.714920 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.715014 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.715217 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.715303 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.715514 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.715602 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.715809 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.715897 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.716111 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.716196 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.716413 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.716499 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.716713 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.716801 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.717019 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.717105 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.717332 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.717426 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.717632 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.717721 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.717936 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.718126 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.718266 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.718370 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.718570 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.718657 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.718877 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.718963 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.719220 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.719318 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.719476 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.719597 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.719779 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.719866 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.720080 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.720176 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.720381 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.720467 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.720683 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.720775 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.720988 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.721082 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.721287 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.721372 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.721589 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.721676 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.721893 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.721988 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.722214 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.722302 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.722519 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.722603 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.722825 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.722920 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.723124 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.723375 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.723462 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.723699 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.723796 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.724543 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.724864 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.724951 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.725195 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.725280 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.725505 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.725606 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.725820 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.725912 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.726165 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.726265 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.726473 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.726568 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.726771 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.726858 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.727072 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.727159 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.727370 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.727456 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.727669 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.727756 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.727975 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.728062 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.728273 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.728362 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.728572 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.728660 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.728870 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.728957 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.729171 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.729255 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.729465 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.729551 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.729763 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.729849 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.730078 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.730185 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.730380 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.730475 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.730687 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.730774 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.730985 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.731081 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.731290 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.731377 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.731588 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.731674 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.731900 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.731995 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.732202 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.732288 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.732500 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.732588 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.732797 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.732932 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.733096 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.733183 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.733401 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.733494 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.733705 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.733800 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.734009 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.734153 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.734372 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.734546 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.734675 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.734999 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.735158 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.736238 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.736342 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.736425 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.736513 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.736593 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.736672 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.736757 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.736837 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.736923 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.737003 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.737081 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.737159 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.737245 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.737379 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.737476 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.737690 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.737830 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.737982 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.738121 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.738329 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.738474 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.738612 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.738748 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.738895 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.739091 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.739233 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.739377 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.739515 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.739673 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.739820 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.739963 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.740110 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.740246 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.740381 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.740514 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.740682 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.740818 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.740983 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.741120 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.741283 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.741417 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.741585 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.741732 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.741939 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.742091 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.742224 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.742360 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.742495 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.742639 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.742785 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.742917 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.743078 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.743167 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.743377 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.743477 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.743677 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.743771 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.743976 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.744061 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.744279 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.744378 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.744581 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.744673 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.744879 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.744966 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.745177 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.745271 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.745487 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.745573 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.745786 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.745872 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.746110 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.746218 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.746411 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.746497 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.746708 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.746801 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.747005 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.747105 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.747303 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.747388 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.747609 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.747741 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.747916 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.748003 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.748215 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.748302 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.748514 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.748601 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.748809 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.748896 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.749107 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.749193 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.749408 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.749544 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.749689 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.749825 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.749993 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.750143 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.750316 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.750458 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.750596 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.750740 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.750897 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.751029 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.751192 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.751343 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.751480 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.751609 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.751796 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.751929 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.752092 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.752230 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.752389 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.752522 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.752686 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.752818 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.752983 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.753125 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.753305 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.753436 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.753608 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.753741 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.753943 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.754110 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.754269 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.754414 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.754580 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.754716 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.754883 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.755020 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.755203 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.755358 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.755495 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.755629 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.755797 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.755940 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.756098 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.756235 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.756399 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.756535 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.756706 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.756842 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.757000 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.757136 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.757282 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.757419 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.757595 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.757731 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.757899 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.758056 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.758228 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.758391 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.758532 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.758664 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.758839 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.758977 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.759152 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.759298 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.759444 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.759530 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.759740 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.759828 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.760042 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.760141 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.760343 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.760430 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.760644 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.760730 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.760945 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.761041 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.761246 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.761342 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.761550 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.761637 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.761849 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.761942 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.762177 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.762268 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.762487 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.762585 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.762794 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.762889 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.763095 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.763182 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.763398 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.763736 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.763950 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.764045 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.764249 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.764387 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.764557 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.764651 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.764856 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.764944 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.765156 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.765241 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.765453 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.765551 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.765754 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.765845 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.766067 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.766156 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.766375 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.766473 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.766783 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.766869 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.767087 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.767174 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.767385 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.767481 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.767686 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.767773 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.767987 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.768074 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.768292 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.768386 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.768596 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.768682 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.768894 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.768981 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.769195 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.769301 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.769604 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.769697 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.769908 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.769995 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.770238 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.770336 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.770533 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.770620 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.771357 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.771461 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.771662 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.771750 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.771979 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.772073 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.772278 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.772373 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.772575 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.772667 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.772871 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.772957 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.773169 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.773267 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.773470 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.773562 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.773776 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.773868 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.774113 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.774216 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.774492 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.774577 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.774790 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.774876 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.775109 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.775204 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.775486 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.775572 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.775789 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.775875 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.776105 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.776201 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.776418 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.776517 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.776733 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.776825 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.777030 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.777117 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.777336 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.777435 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.777638 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.777733 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.777944 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.778052 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.778283 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.778373 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.778588 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.778714 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.778893 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.778979 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.779188 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.779274 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.779491 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.779576 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.779802 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.779887 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.780110 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.780198 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.780427 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.780512 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.780745 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.780833 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.781131 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.781220 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.781434 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.781521 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.781747 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.781842 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.782080 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.782170 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.782381 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.782468 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.782679 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.782782 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.782983 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.783070 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.783281 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.783367 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.783582 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.783679 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.783886 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.783972 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.784183 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.784268 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.784487 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.784582 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.784787 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.784874 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.785088 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.785175 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.785385 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.785472 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.785680 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.785766 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.785977 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.786091 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.786301 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.786395 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.787145 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.787235 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.787467 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.787554 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.787781 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.787868 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.788094 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.788181 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.788391 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.788490 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.788698 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.788854 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.788988 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.789132 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.789268 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.789413 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.789555 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.789688 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.789845 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.789991 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.790189 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.790330 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.790532 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.790663 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.790832 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.790964 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.791147 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.791295 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.791473 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.791609 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.791774 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.791909 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.792093 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.792237 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.792409 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.792545 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.792721 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.792858 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.793023 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.793161 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.793329 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.793464 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.793642 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.793784 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.793927 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.794119 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.794253 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.794397 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.794533 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.794665 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.794821 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.794910 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.795119 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.795206 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.795415 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.795501 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.795717 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.795805 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.796013 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.796101 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.796308 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.796403 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.796602 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.796689 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.796914 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.797001 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.797217 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.797312 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.797514 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.797599 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.797817 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.797903 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.798137 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.798236 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.798437 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.798523 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.798730 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.798815 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.799027 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.799125 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.799347 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.799444 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.799652 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.799744 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.799953 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.800040 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.800267 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.800362 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.800574 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.800661 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.800879 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.800968 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.801184 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.801275 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.801490 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.801577 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.801794 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.801882 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.802151 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.802243 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.802461 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.802547 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.802762 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.802858 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.803064 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.803150 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.803375 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.803513 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.803683 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.803830 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.803994 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.804341 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.804506 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.804661 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.804830 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.804968 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.805141 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.805273 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.805451 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.805576 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.805759 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.805880 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.806088 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.806209 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.806401 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.806500 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.806710 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.806804 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.807018 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.807104 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.807324 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.807413 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.807631 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.807719 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.807954 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.808040 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.808270 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.808359 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.808590 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.808677 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.808906 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.809039 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.809215 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.809302 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.809523 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.809609 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.809830 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.809997 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.810171 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.810259 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.810498 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.810584 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.810800 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.810899 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.811109 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.811196 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.811416 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.811504 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.811724 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.811819 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.812027 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.812114 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.812332 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.812418 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.812637 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.812724 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.812944 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.813032 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.813248 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.813344 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.813550 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.813637 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.813854 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.813947 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.814181 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.814283 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.814492 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.814578 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.814811 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.814899 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.815121 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.815219 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.815427 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.815514 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.815732 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.815826 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.816040 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.816136 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.816352 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.816550 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.816862 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.816949 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.817193 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.817295 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.817500 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.817595 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.817843 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.817935 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.818178 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.818281 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.818492 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.818636 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.818807 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.818911 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.819091 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.819224 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.819394 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.819539 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.819700 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.819876 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.820006 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.820138 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.820290 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.820422 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.820597 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.820740 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.820899 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.821030 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.821198 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.821343 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.821504 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.821644 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.821805 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.821936 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.822140 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.822353 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.822667 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.822811 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.822984 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.823127 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.823303 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.823441 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.823620 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.823765 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.823929 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.824063 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.824228 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.824364 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.824534 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.824670 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.824830 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.824965 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.825130 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.825217 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.825439 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.825528 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.825740 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.825834 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.826115 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.826206 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.826358 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.826447 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.826658 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.826752 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.826958 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.827052 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.827258 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.827346 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.827557 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.827643 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.827852 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.827954 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.828155 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.828248 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.828451 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.828583 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.828748 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.828850 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.829042 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.829130 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.829343 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.829433 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.829641 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.829738 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.829939 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.830058 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.830269 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.830357 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.830562 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.830649 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.830862 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.830948 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.831156 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.831241 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.831459 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.831554 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.831758 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.831845 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.832057 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.832150 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.832366 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.832454 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.832683 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.832776 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.832980 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.833068 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.833795 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.833892 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.834137 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.834230 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.834439 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.834539 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.834745 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.834831 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.835046 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.835131 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.835356 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.835452 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.835659 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.835746 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.835961 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.836048 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.836267 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.836362 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.836599 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.836685 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.836910 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.837121 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.837437 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.837536 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.837754 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.837840 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.838091 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.838178 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.838417 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.838512 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.838718 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.838808 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.839015 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.839171 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.839336 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.839420 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.839606 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.839693 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.839906 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.840042 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.840211 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.840301 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.840515 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.840602 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.840819 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.840914 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.841120 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.841214 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.841423 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.841509 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.841724 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.841822 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.842027 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.842136 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.842351 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.842437 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.842655 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.842757 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.842955 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.843051 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.843258 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.843345 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.843559 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.843648 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.843860 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.843947 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.844161 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.844247 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.844472 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.844563 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.844786 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.844873 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.845097 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.845185 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.845406 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.845497 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.845714 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.845803 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.846018 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.846128 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.846341 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.846430 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.846642 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.846729 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.846946 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.847044 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.847252 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.847338 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.847562 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.847648 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.847870 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.847965 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.848168 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.848256 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.848472 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.848807 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.849652 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.849762 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.849966 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.850162 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.850309 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.850396 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.850617 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.850707 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.850925 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.851011 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.851240 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.851334 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.851547 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.851636 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.851855 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.851949 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.852158 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.852243 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.852467 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.852555 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.852792 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.852879 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.853111 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.853209 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.853429 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.853523 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.853729 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.853817 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.854028 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.854153 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.854347 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.854449 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.854650 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.854749 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.854955 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.855052 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.855256 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.855342 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.855553 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.855641 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.855852 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.855940 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.856152 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.856240 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.856446 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.856532 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.856745 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.856832 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.857040 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.857133 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.857336 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.857422 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.857635 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.857723 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.857930 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.858073 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.858250 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.858350 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.858545 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.858633 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.858842 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.858929 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.859136 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.859232 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.859431 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.859517 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.859731 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.859818 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.860025 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.860125 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.860324 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.860411 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.860620 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.860714 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.860917 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.861016 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.861209 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.861295 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.861505 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.861590 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.861828 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.861928 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.862160 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.862250 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.862475 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.862563 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.862778 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.862874 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.863083 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.863169 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.863383 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.863468 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.863691 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.863777 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.863999 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.864086 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.864308 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.864395 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.864649 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.864787 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.864940 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.865026 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.865244 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.865374 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.865547 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.865636 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.865848 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.865936 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.866172 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.866275 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.866477 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.866612 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.866779 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.866867 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.867083 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.867178 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.867401 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.867488 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.867705 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.867792 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.868011 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.868169 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.868316 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.868402 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.868627 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.868721 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.868933 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.869022 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.869235 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.869329 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.869541 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.869627 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.869844 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.869938 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.870169 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.870262 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.870474 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.870562 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.870777 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.870866 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.871081 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.871174 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.871387 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.871483 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.871688 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.871774 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.871992 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.872078 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.872297 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.872395 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.872603 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.872692 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.872911 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.872996 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.873228 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.873323 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.873531 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.873620 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.873842 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.873927 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.874181 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.874271 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.874503 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.874589 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.874814 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.874899 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.875142 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.875230 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.875463 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.875548 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.875772 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.875860 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.876078 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.876173 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.876376 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.876463 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.876612 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 27 03:10:11.876700 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:10:11.876904 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 27 03:10:12.029698 n-d-862769-1 devstack@n-api.service[105141]: INFO dbcounter [None req-61ce6d30-394e-4736-9447-419044896734 None None] Registered counter for database nova_api Oct 27 03:10:12.029897 n-d-862769-1 devstack@n-api.service[105142]: INFO dbcounter [None req-e6355aaa-82cf-4068-97aa-a66cc3a6dbc0 None None] Registered counter for database nova_api Oct 27 03:10:12.050859 n-d-862769-1 devstack@n-api.service[105142]: DEBUG oslo_db.sqlalchemy.engines [None req-e6355aaa-82cf-4068-97aa-a66cc3a6dbc0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105142) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 03:10:12.054529 n-d-862769-1 devstack@n-api.service[105141]: DEBUG oslo_db.sqlalchemy.engines [None req-61ce6d30-394e-4736-9447-419044896734 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105141) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 03:10:12.057567 n-d-862769-1 devstack@n-api.service[105142]: DEBUG dbcounter [-] [105142] Writer thread running {{(pid=105142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 03:10:12.061116 n-d-862769-1 devstack@n-api.service[105141]: DEBUG dbcounter [-] [105141] Writer thread running {{(pid=105141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 03:10:12.114518 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.context [None req-e6355aaa-82cf-4068-97aa-a66cc3a6dbc0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d4405804-b3fd-4c57-a074-5c4e2aef7c93(cell1) {{(pid=105142) load_cells /opt/stack/nova/nova/context.py:464}} Oct 27 03:10:12.117429 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.context [None req-61ce6d30-394e-4736-9447-419044896734 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d4405804-b3fd-4c57-a074-5c4e2aef7c93(cell1) {{(pid=105141) load_cells /opt/stack/nova/nova/context.py:464}} Oct 27 03:10:12.118405 n-d-862769-1 devstack@n-api.service[105142]: DEBUG oslo_concurrency.lockutils [None req-e6355aaa-82cf-4068-97aa-a66cc3a6dbc0 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:10:12.118877 n-d-862769-1 devstack@n-api.service[105142]: DEBUG oslo_concurrency.lockutils [None req-e6355aaa-82cf-4068-97aa-a66cc3a6dbc0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:10:12.120475 n-d-862769-1 devstack@n-api.service[105142]: DEBUG oslo_concurrency.lockutils [None req-e6355aaa-82cf-4068-97aa-a66cc3a6dbc0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:10:12.121168 n-d-862769-1 devstack@n-api.service[105141]: DEBUG oslo_concurrency.lockutils [None req-61ce6d30-394e-4736-9447-419044896734 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:10:12.121268 n-d-862769-1 devstack@n-api.service[105142]: DEBUG oslo_concurrency.lockutils [None req-e6355aaa-82cf-4068-97aa-a66cc3a6dbc0 None None] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:10:12.121620 n-d-862769-1 devstack@n-api.service[105142]: DEBUG oslo_concurrency.lockutils [None req-e6355aaa-82cf-4068-97aa-a66cc3a6dbc0 None None] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:10:12.121722 n-d-862769-1 devstack@n-api.service[105141]: DEBUG oslo_concurrency.lockutils [None req-61ce6d30-394e-4736-9447-419044896734 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:10:12.123298 n-d-862769-1 devstack@n-api.service[105141]: DEBUG oslo_concurrency.lockutils [None req-61ce6d30-394e-4736-9447-419044896734 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:10:12.123639 n-d-862769-1 devstack@n-api.service[105142]: DEBUG oslo_concurrency.lockutils [None req-e6355aaa-82cf-4068-97aa-a66cc3a6dbc0 None None] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:10:12.124007 n-d-862769-1 devstack@n-api.service[105141]: DEBUG oslo_concurrency.lockutils [None req-61ce6d30-394e-4736-9447-419044896734 None None] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:10:12.124649 n-d-862769-1 devstack@n-api.service[105141]: DEBUG oslo_concurrency.lockutils [None req-61ce6d30-394e-4736-9447-419044896734 None None] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:10:12.125635 n-d-862769-1 devstack@n-api.service[105142]: INFO dbcounter [None req-e6355aaa-82cf-4068-97aa-a66cc3a6dbc0 None None] Registered counter for database nova_cell0 Oct 27 03:10:12.126664 n-d-862769-1 devstack@n-api.service[105141]: DEBUG oslo_concurrency.lockutils [None req-61ce6d30-394e-4736-9447-419044896734 None None] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:10:12.128648 n-d-862769-1 devstack@n-api.service[105141]: INFO dbcounter [None req-61ce6d30-394e-4736-9447-419044896734 None None] Registered counter for database nova_cell0 Oct 27 03:10:12.129759 n-d-862769-1 devstack@n-api.service[105142]: INFO dbcounter [None req-e6355aaa-82cf-4068-97aa-a66cc3a6dbc0 None None] Registered counter for database nova_cell1 Oct 27 03:10:12.133227 n-d-862769-1 devstack@n-api.service[105141]: INFO dbcounter [None req-61ce6d30-394e-4736-9447-419044896734 None None] Registered counter for database nova_cell1 Oct 27 03:10:12.137718 n-d-862769-1 devstack@n-api.service[105142]: DEBUG oslo_db.sqlalchemy.engines [None req-e6355aaa-82cf-4068-97aa-a66cc3a6dbc0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105142) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 03:10:12.139744 n-d-862769-1 devstack@n-api.service[105142]: DEBUG oslo_db.sqlalchemy.engines [None req-e6355aaa-82cf-4068-97aa-a66cc3a6dbc0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105142) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 03:10:12.142348 n-d-862769-1 devstack@n-api.service[105141]: DEBUG oslo_db.sqlalchemy.engines [None req-61ce6d30-394e-4736-9447-419044896734 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105141) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 03:10:12.144468 n-d-862769-1 devstack@n-api.service[105141]: DEBUG oslo_db.sqlalchemy.engines [None req-61ce6d30-394e-4736-9447-419044896734 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105141) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 03:10:12.147492 n-d-862769-1 devstack@n-api.service[105142]: DEBUG dbcounter [-] [105142] Writer thread running {{(pid=105142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 03:10:12.150318 n-d-862769-1 devstack@n-api.service[105142]: DEBUG dbcounter [-] [105142] Writer thread running {{(pid=105142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 03:10:12.150429 n-d-862769-1 devstack@n-api.service[105141]: DEBUG dbcounter [-] [105141] Writer thread running {{(pid=105141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 03:10:12.152587 n-d-862769-1 devstack@n-api.service[105141]: DEBUG dbcounter [-] [105141] Writer thread running {{(pid=105141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 03:10:12.294163 n-d-862769-1 devstack@n-api.service[105142]: INFO dbcounter [None req-e6355aaa-82cf-4068-97aa-a66cc3a6dbc0 None None] Registered counter for database nova_cell0 Oct 27 03:10:12.295464 n-d-862769-1 devstack@n-api.service[105141]: INFO dbcounter [None req-61ce6d30-394e-4736-9447-419044896734 None None] Registered counter for database nova_cell0 Oct 27 03:10:12.303040 n-d-862769-1 devstack@n-api.service[105142]: DEBUG oslo_db.sqlalchemy.engines [None req-e6355aaa-82cf-4068-97aa-a66cc3a6dbc0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105142) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 03:10:12.306553 n-d-862769-1 devstack@n-api.service[105141]: DEBUG oslo_db.sqlalchemy.engines [None req-61ce6d30-394e-4736-9447-419044896734 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105141) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 03:10:12.307792 n-d-862769-1 devstack@n-api.service[105142]: DEBUG dbcounter [-] [105142] Writer thread running {{(pid=105142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 03:10:12.311306 n-d-862769-1 devstack@n-api.service[105141]: DEBUG dbcounter [-] [105141] Writer thread running {{(pid=105141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 03:10:12.709395 n-d-862769-1 devstack@n-api.service[105142]: WARNING keystonemiddleware.auth_token [None req-e6355aaa-82cf-4068-97aa-a66cc3a6dbc0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 27 03:10:12.716636 n-d-862769-1 devstack@n-api.service[105142]: WARNING keystonemiddleware.auth_token [None req-e6355aaa-82cf-4068-97aa-a66cc3a6dbc0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 27 03:10:12.722118 n-d-862769-1 devstack@n-api.service[105141]: WARNING keystonemiddleware.auth_token [None req-61ce6d30-394e-4736-9447-419044896734 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 27 03:10:12.729245 n-d-862769-1 devstack@n-api.service[105141]: WARNING keystonemiddleware.auth_token [None req-61ce6d30-394e-4736-9447-419044896734 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 27 03:10:13.058310 n-d-862769-1 devstack@n-api.service[105142]: WARNING keystonemiddleware.auth_token [None req-e6355aaa-82cf-4068-97aa-a66cc3a6dbc0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 27 03:10:13.064235 n-d-862769-1 devstack@n-api.service[105142]: WARNING keystonemiddleware.auth_token [None req-e6355aaa-82cf-4068-97aa-a66cc3a6dbc0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 27 03:10:13.067470 n-d-862769-1 devstack@n-api.service[105141]: WARNING keystonemiddleware.auth_token [None req-61ce6d30-394e-4736-9447-419044896734 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 27 03:10:13.069508 n-d-862769-1 devstack@n-api.service[105142]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56335931c9c0 pid: 105142 (default app) Oct 27 03:10:13.071590 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi [None req-e6355aaa-82cf-4068-97aa-a66cc3a6dbc0 None None] Calling method '>' {{(pid=105142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:10:13.072768 n-d-862769-1 devstack@n-api.service[105142]: INFO nova.api.openstack.requestlog [None req-e6355aaa-82cf-4068-97aa-a66cc3a6dbc0 None None] 10.222.0.20 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001711 Oct 27 03:10:13.073182 n-d-862769-1 devstack@n-api.service[105142]: [pid: 105142|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 788 bytes} [Thu Oct 27 03:10:13 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:10:13.073371 n-d-862769-1 devstack@n-api.service[105141]: WARNING keystonemiddleware.auth_token [None req-61ce6d30-394e-4736-9447-419044896734 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 27 03:10:13.078620 n-d-862769-1 devstack@n-api.service[105141]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56335931c9c0 pid: 105141 (default app) Oct 27 03:11:36.588186 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi [None req-e6355aaa-82cf-4068-97aa-a66cc3a6dbc0 None None] Calling method '>' {{(pid=105142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:11:36.589699 n-d-862769-1 devstack@n-api.service[105142]: INFO nova.api.openstack.requestlog [None req-e6355aaa-82cf-4068-97aa-a66cc3a6dbc0 None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001956 Oct 27 03:11:36.593066 n-d-862769-1 devstack@n-api.service[105142]: [pid: 105142|app: 0|req: 2/2] 10.222.0.20 () {54 vars in 931 bytes} [Thu Oct 27 03:11:36 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:11:36.602132 n-d-862769-1 devstack@n-api.service[105141]: DEBUG dbcounter [-] [105141] Writing DB stats nova_api:SELECT=3 {{(pid=105141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:11:36.605474 n-d-862769-1 devstack@n-api.service[105141]: DEBUG dbcounter [-] [105141] Writing DB stats nova_cell0:SELECT=3 {{(pid=105141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:11:36.605474 n-d-862769-1 devstack@n-api.service[105141]: DEBUG dbcounter [-] [105141] Writing DB stats nova_cell1:SELECT=3 {{(pid=105141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:11:36.605853 n-d-862769-1 devstack@n-api.service[105141]: DEBUG dbcounter [-] [105141] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:11:37.482972 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi [None req-c0f4d708-eaec-4dc4-90e5-f86a776315a2 admin admin] Calling method '>' {{(pid=105141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:11:37.517229 n-d-862769-1 devstack@n-api.service[105141]: INFO nova.api.openstack.requestlog [None req-c0f4d708-eaec-4dc4-90e5-f86a776315a2 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.920293 Oct 27 03:11:37.517967 n-d-862769-1 devstack@n-api.service[105141]: [pid: 105141|app: 0|req: 1/3] 10.222.0.20 () {60 vars in 1292 bytes} [Thu Oct 27 03:11:36 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:11:40.128949 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi [None req-e6355aaa-82cf-4068-97aa-a66cc3a6dbc0 None None] Calling method '>' {{(pid=105142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:11:40.129942 n-d-862769-1 devstack@n-api.service[105142]: INFO nova.api.openstack.requestlog [None req-e6355aaa-82cf-4068-97aa-a66cc3a6dbc0 None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Oct 27 03:11:40.130375 n-d-862769-1 devstack@n-api.service[105142]: [pid: 105142|app: 0|req: 3/4] 10.222.0.20 () {54 vars in 931 bytes} [Thu Oct 27 03:11:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:11:40.597442 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi [None req-3d510f45-bc83-46fe-aeaa-c3be45590f76 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "os-flavor-access:is_public": true, "name": "cirros256", "swap": 0, "disk": 1, "rxtx_factor": 1.0}} {{(pid=105141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:11:40.694484 n-d-862769-1 devstack@n-api.service[105141]: INFO nova.api.openstack.requestlog [None req-3d510f45-bc83-46fe-aeaa-c3be45590f76 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.558135 Oct 27 03:11:40.695050 n-d-862769-1 devstack@n-api.service[105141]: [pid: 105141|app: 0|req: 2/5] 10.222.0.20 () {64 vars in 1283 bytes} [Thu Oct 27 03:11:40 2022] POST /compute/v2.1/flavors => generated 407 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 03:11:40.709576 n-d-862769-1 devstack@n-api.service[105142]: DEBUG dbcounter [-] [105142] Writing DB stats nova_api:SELECT=3 {{(pid=105142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:11:40.710456 n-d-862769-1 devstack@n-api.service[105142]: DEBUG dbcounter [-] [105142] Writing DB stats nova_cell0:SELECT=3 {{(pid=105142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:11:40.712448 n-d-862769-1 devstack@n-api.service[105142]: DEBUG dbcounter [-] [105142] Writing DB stats nova_cell1:SELECT=3 {{(pid=105142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:11:40.715084 n-d-862769-1 devstack@n-api.service[105142]: DEBUG dbcounter [-] [105142] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:11:40.926272 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi [None req-a8222c19-4b81-42a6-88b7-6d7ef45b805a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:11:41.110949 n-d-862769-1 devstack@n-api.service[105142]: INFO nova.api.openstack.requestlog [None req-a8222c19-4b81-42a6-88b7-6d7ef45b805a admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.407423 Oct 27 03:11:41.111741 n-d-862769-1 devstack@n-api.service[105142]: [pid: 105142|app: 0|req: 4/6] 10.222.0.20 () {64 vars in 1336 bytes} [Thu Oct 27 03:11:40 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:11:43.815492 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi [None req-3d510f45-bc83-46fe-aeaa-c3be45590f76 admin admin] Calling method '>' {{(pid=105141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:11:43.817220 n-d-862769-1 devstack@n-api.service[105141]: INFO nova.api.openstack.requestlog [None req-3d510f45-bc83-46fe-aeaa-c3be45590f76 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002241 Oct 27 03:11:43.823504 n-d-862769-1 devstack@n-api.service[105141]: [pid: 105141|app: 0|req: 3/7] 10.222.0.20 () {54 vars in 931 bytes} [Thu Oct 27 03:11:43 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:11:44.677037 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi [None req-5ae8c90f-eddf-454f-9c3c-4973fda9df28 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "ram": 512, "disk": 5, "id": "d1", "os-flavor-access:is_public": true, "name": "ds512M"}} {{(pid=105142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:11:44.838124 n-d-862769-1 devstack@n-api.service[105142]: INFO nova.api.openstack.requestlog [None req-5ae8c90f-eddf-454f-9c3c-4973fda9df28 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 1.012370 Oct 27 03:11:44.839227 n-d-862769-1 devstack@n-api.service[105142]: [pid: 105142|app: 0|req: 5/8] 10.222.0.20 () {64 vars in 1283 bytes} [Thu Oct 27 03:11:43 2022] POST /compute/v2.1/flavors => generated 404 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 03:11:44.851698 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi [None req-2a56d78a-c0d2-4e81-bcbd-f1e65c7d3010 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:11:44.960448 n-d-862769-1 devstack@n-api.service[105141]: INFO nova.api.openstack.requestlog [None req-2a56d78a-c0d2-4e81-bcbd-f1e65c7d3010 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.112979 Oct 27 03:11:44.961786 n-d-862769-1 devstack@n-api.service[105141]: [pid: 105141|app: 0|req: 4/9] 10.222.0.20 () {64 vars in 1336 bytes} [Thu Oct 27 03:11:44 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:11:47.993104 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi [None req-5ae8c90f-eddf-454f-9c3c-4973fda9df28 admin admin] Calling method '>' {{(pid=105142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:11:47.994051 n-d-862769-1 devstack@n-api.service[105142]: INFO nova.api.openstack.requestlog [None req-5ae8c90f-eddf-454f-9c3c-4973fda9df28 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Oct 27 03:11:47.994449 n-d-862769-1 devstack@n-api.service[105142]: [pid: 105142|app: 0|req: 6/10] 10.222.0.20 () {54 vars in 931 bytes} [Thu Oct 27 03:11:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:11:48.449713 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi [None req-3d8615f7-5571-48b7-b986-a43cda04cb33 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "swap": 0, "id": "d2", "vcpus": 1, "os-flavor-access:is_public": true, "name": "ds1G", "rxtx_factor": 1.0, "ram": 1024}} {{(pid=105141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:11:48.513605 n-d-862769-1 devstack@n-api.service[105141]: INFO nova.api.openstack.requestlog [None req-3d8615f7-5571-48b7-b986-a43cda04cb33 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.513006 Oct 27 03:11:48.514545 n-d-862769-1 devstack@n-api.service[105141]: [pid: 105141|app: 0|req: 5/11] 10.222.0.20 () {64 vars in 1283 bytes} [Thu Oct 27 03:11:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 03:11:48.526638 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi [None req-c0400f6f-7d1b-49e5-b60a-1d4fb7975d4e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:11:48.592950 n-d-862769-1 devstack@n-api.service[105142]: INFO nova.api.openstack.requestlog [None req-c0400f6f-7d1b-49e5-b60a-1d4fb7975d4e admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.069983 Oct 27 03:11:48.593753 n-d-862769-1 devstack@n-api.service[105142]: [pid: 105142|app: 0|req: 7/12] 10.222.0.20 () {64 vars in 1336 bytes} [Thu Oct 27 03:11:48 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:11:51.338848 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi [None req-3d8615f7-5571-48b7-b986-a43cda04cb33 admin admin] Calling method '>' {{(pid=105141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:11:51.338848 n-d-862769-1 devstack@n-api.service[105141]: INFO nova.api.openstack.requestlog [None req-3d8615f7-5571-48b7-b986-a43cda04cb33 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Oct 27 03:11:51.338848 n-d-862769-1 devstack@n-api.service[105141]: [pid: 105141|app: 0|req: 6/13] 10.222.0.20 () {54 vars in 931 bytes} [Thu Oct 27 03:11:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:11:51.676735 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi [None req-02a56798-cd2f-4aef-b1cc-03770471571d admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 2, "name": "ds2G", "ram": 2048, "id": "d3", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 10}} {{(pid=105142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:11:51.748561 n-d-862769-1 devstack@n-api.service[105142]: INFO nova.api.openstack.requestlog [None req-02a56798-cd2f-4aef-b1cc-03770471571d admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.523380 Oct 27 03:11:51.755177 n-d-862769-1 devstack@n-api.service[105142]: [pid: 105142|app: 0|req: 8/14] 10.222.0.20 () {64 vars in 1283 bytes} [Thu Oct 27 03:11:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 03:11:51.762569 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi [None req-47d5cad2-ea9c-425d-8d1c-bedf1a7f2cae admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:11:51.849499 n-d-862769-1 devstack@n-api.service[105141]: INFO nova.api.openstack.requestlog [None req-47d5cad2-ea9c-425d-8d1c-bedf1a7f2cae admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091199 Oct 27 03:11:51.850154 n-d-862769-1 devstack@n-api.service[105141]: [pid: 105141|app: 0|req: 7/15] 10.222.0.20 () {64 vars in 1336 bytes} [Thu Oct 27 03:11:51 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:11:54.592178 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi [None req-02a56798-cd2f-4aef-b1cc-03770471571d admin admin] Calling method '>' {{(pid=105142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:11:54.593802 n-d-862769-1 devstack@n-api.service[105142]: INFO nova.api.openstack.requestlog [None req-02a56798-cd2f-4aef-b1cc-03770471571d admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002060 Oct 27 03:11:54.605066 n-d-862769-1 devstack@n-api.service[105142]: [pid: 105142|app: 0|req: 9/16] 10.222.0.20 () {54 vars in 931 bytes} [Thu Oct 27 03:11:54 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:11:55.033312 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi [None req-3118aa25-4029-42da-afa7-07f695e8e099 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 20, "ram": 4096, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 4, "id": "d4"}} {{(pid=105141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:11:55.107789 n-d-862769-1 devstack@n-api.service[105141]: INFO nova.api.openstack.requestlog [None req-3118aa25-4029-42da-afa7-07f695e8e099 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.506394 Oct 27 03:11:55.109165 n-d-862769-1 devstack@n-api.service[105141]: [pid: 105141|app: 0|req: 8/17] 10.222.0.20 () {64 vars in 1283 bytes} [Thu Oct 27 03:11:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 03:11:55.122843 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi [None req-c850b292-dd88-4605-8046-bda544dfe662 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:11:55.213915 n-d-862769-1 devstack@n-api.service[105142]: INFO nova.api.openstack.requestlog [None req-c850b292-dd88-4605-8046-bda544dfe662 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.095620 Oct 27 03:11:55.214698 n-d-862769-1 devstack@n-api.service[105142]: [pid: 105142|app: 0|req: 10/18] 10.222.0.20 () {64 vars in 1336 bytes} [Thu Oct 27 03:11:55 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:11:57.859780 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi [None req-3118aa25-4029-42da-afa7-07f695e8e099 admin admin] Calling method '>' {{(pid=105141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:11:57.861601 n-d-862769-1 devstack@n-api.service[105141]: INFO nova.api.openstack.requestlog [None req-3118aa25-4029-42da-afa7-07f695e8e099 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002444 Oct 27 03:11:57.862428 n-d-862769-1 devstack@n-api.service[105141]: [pid: 105141|app: 0|req: 9/19] 10.222.0.20 () {54 vars in 931 bytes} [Thu Oct 27 03:11:57 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:11:58.304655 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi [None req-a6357384-d3b5-45c9-969c-b0bfd9f1a430 admin admin] Calling method '>' {{(pid=105142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:11:58.329249 n-d-862769-1 devstack@n-api.service[105142]: INFO nova.api.openstack.requestlog [None req-a6357384-d3b5-45c9-969c-b0bfd9f1a430 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.460848 Oct 27 03:11:58.329995 n-d-862769-1 devstack@n-api.service[105142]: [pid: 105142|app: 0|req: 11/20] 10.222.0.20 () {60 vars in 1292 bytes} [Thu Oct 27 03:11:57 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:12:00.923132 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi [None req-3118aa25-4029-42da-afa7-07f695e8e099 admin admin] Calling method '>' {{(pid=105141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:12:00.924149 n-d-862769-1 devstack@n-api.service[105141]: INFO nova.api.openstack.requestlog [None req-3118aa25-4029-42da-afa7-07f695e8e099 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Oct 27 03:12:00.924556 n-d-862769-1 devstack@n-api.service[105141]: [pid: 105141|app: 0|req: 10/21] 10.222.0.20 () {54 vars in 931 bytes} [Thu Oct 27 03:12:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:12:01.380501 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi [None req-84df5c32-8a2a-4de0-88d9-8b2583d7aaa2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "os-flavor-access:is_public": true, "vcpus": 1, "rxtx_factor": 1.0, "disk": 1, "id": "1"}} {{(pid=105142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:12:01.453286 n-d-862769-1 devstack@n-api.service[105142]: INFO nova.api.openstack.requestlog [None req-84df5c32-8a2a-4de0-88d9-8b2583d7aaa2 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.522056 Oct 27 03:12:01.454089 n-d-862769-1 devstack@n-api.service[105142]: [pid: 105142|app: 0|req: 12/22] 10.222.0.20 () {64 vars in 1283 bytes} [Thu Oct 27 03:12:00 2022] POST /compute/v2.1/flavors => generated 402 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 03:12:01.466319 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi [None req-e275dc8a-39d4-4e23-a8e6-610900cd4725 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:12:01.552114 n-d-862769-1 devstack@n-api.service[105141]: INFO nova.api.openstack.requestlog [None req-e275dc8a-39d4-4e23-a8e6-610900cd4725 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.089516 Oct 27 03:12:01.553045 n-d-862769-1 devstack@n-api.service[105141]: [pid: 105141|app: 0|req: 11/23] 10.222.0.20 () {64 vars in 1333 bytes} [Thu Oct 27 03:12:01 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:12:04.240418 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi [None req-84df5c32-8a2a-4de0-88d9-8b2583d7aaa2 admin admin] Calling method '>' {{(pid=105142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:12:04.241461 n-d-862769-1 devstack@n-api.service[105142]: INFO nova.api.openstack.requestlog [None req-84df5c32-8a2a-4de0-88d9-8b2583d7aaa2 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Oct 27 03:12:04.241861 n-d-862769-1 devstack@n-api.service[105142]: [pid: 105142|app: 0|req: 13/24] 10.222.0.20 () {54 vars in 931 bytes} [Thu Oct 27 03:12:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:12:04.641060 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi [None req-04a10643-16ce-41dc-8b89-81eeb4a75182 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "os-flavor-access:is_public": true, "swap": 0, "disk": 20, "vcpus": 1, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "2"}} {{(pid=105141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:12:04.707106 n-d-862769-1 devstack@n-api.service[105141]: INFO nova.api.openstack.requestlog [None req-04a10643-16ce-41dc-8b89-81eeb4a75182 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.458488 Oct 27 03:12:04.707569 n-d-862769-1 devstack@n-api.service[105141]: [pid: 105141|app: 0|req: 12/25] 10.222.0.20 () {64 vars in 1283 bytes} [Thu Oct 27 03:12:04 2022] POST /compute/v2.1/flavors => generated 405 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 03:12:04.719638 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi [None req-1b9b9b81-d18e-4595-aac1-015bb9409e5a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:12:04.778806 n-d-862769-1 devstack@n-api.service[105142]: INFO nova.api.openstack.requestlog [None req-1b9b9b81-d18e-4595-aac1-015bb9409e5a admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.062792 Oct 27 03:12:04.779411 n-d-862769-1 devstack@n-api.service[105142]: [pid: 105142|app: 0|req: 14/26] 10.222.0.20 () {64 vars in 1333 bytes} [Thu Oct 27 03:12:04 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:12:07.375237 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi [None req-04a10643-16ce-41dc-8b89-81eeb4a75182 admin admin] Calling method '>' {{(pid=105141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:12:07.376234 n-d-862769-1 devstack@n-api.service[105141]: INFO nova.api.openstack.requestlog [None req-04a10643-16ce-41dc-8b89-81eeb4a75182 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Oct 27 03:12:07.376729 n-d-862769-1 devstack@n-api.service[105141]: [pid: 105141|app: 0|req: 13/27] 10.222.0.20 () {54 vars in 931 bytes} [Thu Oct 27 03:12:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:12:07.729454 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi [None req-6bee9b49-e2f1-4898-a089-df0e8b10b5eb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "disk": 40, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "vcpus": 2, "id": "3", "rxtx_factor": 1.0, "swap": 0}} {{(pid=105142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:12:07.826463 n-d-862769-1 devstack@n-api.service[105142]: INFO nova.api.openstack.requestlog [None req-6bee9b49-e2f1-4898-a089-df0e8b10b5eb admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.443463 Oct 27 03:12:07.826946 n-d-862769-1 devstack@n-api.service[105142]: [pid: 105142|app: 0|req: 15/28] 10.222.0.20 () {64 vars in 1283 bytes} [Thu Oct 27 03:12:07 2022] POST /compute/v2.1/flavors => generated 406 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 03:12:07.839473 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi [None req-294096d5-9545-4a0f-9d33-121715501cc9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:12:07.844276 n-d-862769-1 devstack@n-api.service[105141]: DEBUG dbcounter [-] [105141] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=105141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:12:07.985056 n-d-862769-1 devstack@n-api.service[105141]: INFO nova.api.openstack.requestlog [None req-294096d5-9545-4a0f-9d33-121715501cc9 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.149220 Oct 27 03:12:07.988792 n-d-862769-1 devstack@n-api.service[105141]: [pid: 105141|app: 0|req: 14/29] 10.222.0.20 () {64 vars in 1333 bytes} [Thu Oct 27 03:12:07 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:12:10.648273 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi [None req-6bee9b49-e2f1-4898-a089-df0e8b10b5eb admin admin] Calling method '>' {{(pid=105142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:12:10.649380 n-d-862769-1 devstack@n-api.service[105142]: INFO nova.api.openstack.requestlog [None req-6bee9b49-e2f1-4898-a089-df0e8b10b5eb admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Oct 27 03:12:10.649811 n-d-862769-1 devstack@n-api.service[105142]: [pid: 105142|app: 0|req: 16/30] 10.222.0.20 () {54 vars in 931 bytes} [Thu Oct 27 03:12:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:12:11.092731 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi [None req-c48d35e1-6016-4b78-a5a8-188ac1ac8fc8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 80, "vcpus": 4, "os-flavor-access:is_public": true, "id": "4", "rxtx_factor": 1.0, "ram": 8192, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:12:11.155208 n-d-862769-1 devstack@n-api.service[105141]: INFO nova.api.openstack.requestlog [None req-c48d35e1-6016-4b78-a5a8-188ac1ac8fc8 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.498447 Oct 27 03:12:11.156292 n-d-862769-1 devstack@n-api.service[105141]: [pid: 105141|app: 0|req: 15/31] 10.222.0.20 () {64 vars in 1283 bytes} [Thu Oct 27 03:12:10 2022] POST /compute/v2.1/flavors => generated 405 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 03:12:11.168790 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi [None req-f4ffc50e-bbeb-4917-a579-32df44461100 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:12:11.259698 n-d-862769-1 devstack@n-api.service[105142]: INFO nova.api.openstack.requestlog [None req-f4ffc50e-bbeb-4917-a579-32df44461100 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.094368 Oct 27 03:12:11.260579 n-d-862769-1 devstack@n-api.service[105142]: [pid: 105142|app: 0|req: 17/32] 10.222.0.20 () {64 vars in 1333 bytes} [Thu Oct 27 03:12:11 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:12:13.873466 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi [None req-c48d35e1-6016-4b78-a5a8-188ac1ac8fc8 admin admin] Calling method '>' {{(pid=105141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:12:13.874518 n-d-862769-1 devstack@n-api.service[105141]: INFO nova.api.openstack.requestlog [None req-c48d35e1-6016-4b78-a5a8-188ac1ac8fc8 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Oct 27 03:12:13.874953 n-d-862769-1 devstack@n-api.service[105141]: [pid: 105141|app: 0|req: 16/33] 10.222.0.20 () {54 vars in 931 bytes} [Thu Oct 27 03:12:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:12:14.318757 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi [None req-8f6e3745-9971-4a67-8368-c6d23d254fea admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "ram": 16384, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "5", "rxtx_factor": 1.0, "disk": 160, "swap": 0}} {{(pid=105142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:12:14.328838 n-d-862769-1 devstack@n-api.service[105142]: DEBUG dbcounter [-] [105142] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:12:14.379438 n-d-862769-1 devstack@n-api.service[105142]: INFO nova.api.openstack.requestlog [None req-8f6e3745-9971-4a67-8368-c6d23d254fea admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.496212 Oct 27 03:12:14.382183 n-d-862769-1 devstack@n-api.service[105142]: [pid: 105142|app: 0|req: 18/34] 10.222.0.20 () {64 vars in 1283 bytes} [Thu Oct 27 03:12:13 2022] POST /compute/v2.1/flavors => generated 408 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 03:12:14.391605 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi [None req-f2dfbb27-9028-4a72-8ccd-5715598a813a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:12:14.452801 n-d-862769-1 devstack@n-api.service[105141]: INFO nova.api.openstack.requestlog [None req-f2dfbb27-9028-4a72-8ccd-5715598a813a admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.065139 Oct 27 03:12:14.453326 n-d-862769-1 devstack@n-api.service[105141]: [pid: 105141|app: 0|req: 17/35] 10.222.0.20 () {64 vars in 1333 bytes} [Thu Oct 27 03:12:14 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:12:35.242433 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi [None req-8f6e3745-9971-4a67-8368-c6d23d254fea admin admin] Calling method '>' {{(pid=105142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:12:35.243422 n-d-862769-1 devstack@n-api.service[105142]: INFO nova.api.openstack.requestlog [None req-8f6e3745-9971-4a67-8368-c6d23d254fea admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 Oct 27 03:12:35.243824 n-d-862769-1 devstack@n-api.service[105142]: [pid: 105142|app: 0|req: 19/36] 10.222.0.20 () {54 vars in 931 bytes} [Thu Oct 27 03:12:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:12:35.254708 n-d-862769-1 devstack@n-api.service[105141]: DEBUG dbcounter [-] [105141] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=105141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:12:35.630694 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi [None req-6e79d2d4-ba93-4622-8cf1-c84d927bd8ab admin admin] Calling method '>' {{(pid=105141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:12:35.648431 n-d-862769-1 devstack@n-api.service[105141]: INFO nova.api.openstack.requestlog [None req-6e79d2d4-ba93-4622-8cf1-c84d927bd8ab admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.398747 Oct 27 03:12:35.648956 n-d-862769-1 devstack@n-api.service[105141]: [pid: 105141|app: 0|req: 18/37] 10.222.0.20 () {60 vars in 1292 bytes} [Thu Oct 27 03:12:35 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:12:36.941802 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi [None req-8f6e3745-9971-4a67-8368-c6d23d254fea admin admin] Calling method '>' {{(pid=105142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:12:36.942863 n-d-862769-1 devstack@n-api.service[105142]: INFO nova.api.openstack.requestlog [None req-8f6e3745-9971-4a67-8368-c6d23d254fea admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001550 Oct 27 03:12:36.943259 n-d-862769-1 devstack@n-api.service[105142]: [pid: 105142|app: 0|req: 20/38] 10.222.0.20 () {56 vars in 1074 bytes} [Thu Oct 27 03:12:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:12:37.474197 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi [None req-c01dc467-241f-4709-a8a6-338dc440c289 admin admin] Calling method '>' {{(pid=105141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:12:37.479528 n-d-862769-1 devstack@n-api.service[105141]: INFO nova.api.openstack.wsgi [None req-c01dc467-241f-4709-a8a6-338dc440c289 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 27 03:12:37.482721 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi [None req-c01dc467-241f-4709-a8a6-338dc440c289 admin admin] Request method failure captured: Oct 27 03:12:37.482721 n-d-862769-1 devstack@n-api.service[105141]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 27 03:12:37.482721 n-d-862769-1 devstack@n-api.service[105141]: Accept: application/json Oct 27 03:12:37.482721 n-d-862769-1 devstack@n-api.service[105141]: Accept-Encoding: gzip, deflate Oct 27 03:12:37.482721 n-d-862769-1 devstack@n-api.service[105141]: Connection: keep-alive Oct 27 03:12:37.482721 n-d-862769-1 devstack@n-api.service[105141]: Content-Length: 0 Oct 27 03:12:37.482721 n-d-862769-1 devstack@n-api.service[105141]: Host: 10.222.0.20 Oct 27 03:12:37.482721 n-d-862769-1 devstack@n-api.service[105141]: Openstack-Api-Version: compute 2.92 Oct 27 03:12:37.482721 n-d-862769-1 devstack@n-api.service[105141]: Openstack-System-Scope: None Oct 27 03:12:37.482721 n-d-862769-1 devstack@n-api.service[105141]: User-Agent: python-novaclient Oct 27 03:12:37.482721 n-d-862769-1 devstack@n-api.service[105141]: X-Auth-Token: gAAAAABjWfck624vldMvVeP3KTJirzBaiLcIqvISS7q80ro9edBHj986Q4lS0HRVT3-bfcMjTT3nHVm14yAy3aERFC9XazBMWn3NbAuHFygRZ6U0nmYa4VOPEam84_oALmfK8Z4RFJHKZIOCsd_t2QE_6Zzxd6-P0mIYmgsS_dz8rb_dISGBsVw Oct 27 03:12:37.482721 n-d-862769-1 devstack@n-api.service[105141]: X-Domain-Id: None Oct 27 03:12:37.482721 n-d-862769-1 devstack@n-api.service[105141]: X-Domain-Name: None Oct 27 03:12:37.482721 n-d-862769-1 devstack@n-api.service[105141]: X-Identity-Status: Confirmed Oct 27 03:12:37.482721 n-d-862769-1 devstack@n-api.service[105141]: X-Is-Admin-Project: True Oct 27 03:12:37.482721 n-d-862769-1 devstack@n-api.service[105141]: X-Openstack-Nova-Api-Version: 2.92 Oct 27 03:12:37.482721 n-d-862769-1 devstack@n-api.service[105141]: X-Project-Domain-Id: default Oct 27 03:12:37.482721 n-d-862769-1 devstack@n-api.service[105141]: X-Project-Domain-Name: Default Oct 27 03:12:37.482721 n-d-862769-1 devstack@n-api.service[105141]: X-Project-Id: 5e8ac2ac85cf42df9e4584993def5b4a Oct 27 03:12:37.482721 n-d-862769-1 devstack@n-api.service[105141]: X-Project-Name: admin Oct 27 03:12:37.482721 n-d-862769-1 devstack@n-api.service[105141]: X-Role: admin,member,reader Oct 27 03:12:37.482721 n-d-862769-1 devstack@n-api.service[105141]: X-Roles: admin,member,reader Oct 27 03:12:37.484395 n-d-862769-1 devstack@n-api.service[105141]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5e8ac2ac85cf42df9e4584993def5b4a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5e8ac2ac85cf42df9e4584993def5b4a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5e8ac2ac85cf42df9e4584993def5b4a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5e8ac2ac85cf42df9e4584993def5b4a"}]}] Oct 27 03:12:37.484395 n-d-862769-1 devstack@n-api.service[105141]: X-Tenant: admin Oct 27 03:12:37.484395 n-d-862769-1 devstack@n-api.service[105141]: X-Tenant-Id: 5e8ac2ac85cf42df9e4584993def5b4a Oct 27 03:12:37.484395 n-d-862769-1 devstack@n-api.service[105141]: X-Tenant-Name: admin Oct 27 03:12:37.484395 n-d-862769-1 devstack@n-api.service[105141]: X-User: admin Oct 27 03:12:37.484395 n-d-862769-1 devstack@n-api.service[105141]: X-User-Domain-Id: default Oct 27 03:12:37.484395 n-d-862769-1 devstack@n-api.service[105141]: X-User-Domain-Name: Default Oct 27 03:12:37.484395 n-d-862769-1 devstack@n-api.service[105141]: X-User-Id: 7c4a354216e64f78803accba54466d59 Oct 27 03:12:37.484395 n-d-862769-1 devstack@n-api.service[105141]: X-User-Name: admin Oct 27 03:12:37.484395 n-d-862769-1 devstack@n-api.service[105141]: method: > Oct 27 03:12:37.484395 n-d-862769-1 devstack@n-api.service[105141]: exception: Flavor 42 could not be found. Oct 27 03:12:37.484395 n-d-862769-1 devstack@n-api.service[105141]: action_args: {'id': '42'} Oct 27 03:12:37.484395 n-d-862769-1 devstack@n-api.service[105141]: {{(pid=105141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:12:37.484395 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:12:37.485395 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 27 03:12:37.485395 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 27 03:12:37.485395 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 27 03:12:37.485395 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 27 03:12:37.485395 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 03:12:37.485395 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 03:12:37.485395 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 27 03:12:37.485395 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 27 03:12:37.485395 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 27 03:12:37.485395 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:12:37.485395 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 27 03:12:37.485395 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 27 03:12:37.485395 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 27 03:12:37.485395 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi Oct 27 03:12:37.485395 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:12:37.485395 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi Oct 27 03:12:37.485395 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:12:37.485395 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:12:37.485395 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:12:37.486827 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:12:37.486827 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:12:37.486827 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:12:37.486827 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:12:37.486827 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 27 03:12:37.486827 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:12:37.486827 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 27 03:12:37.486827 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi Oct 27 03:12:37.486827 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:12:37.486827 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi Oct 27 03:12:37.486827 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:12:37.486827 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:12:37.486827 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:12:37.486827 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:12:37.486827 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:12:37.486827 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 27 03:12:37.486827 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi Oct 27 03:12:37.486827 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi [None req-c01dc467-241f-4709-a8a6-338dc440c289 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105141) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:12:37.488075 n-d-862769-1 devstack@n-api.service[105141]: INFO nova.api.openstack.requestlog [None req-c01dc467-241f-4709-a8a6-338dc440c289 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.390059 Oct 27 03:12:37.488075 n-d-862769-1 devstack@n-api.service[105141]: [pid: 105141|app: 0|req: 19/39] 10.222.0.20 () {60 vars in 1190 bytes} [Thu Oct 27 03:12:37 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 27 03:12:37.494307 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi [None req-6c680d6e-a308-4593-a58f-9cd4dc3fadde admin admin] Calling method '>' {{(pid=105142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:12:37.517044 n-d-862769-1 devstack@n-api.service[105142]: INFO nova.api.openstack.requestlog [None req-6c680d6e-a308-4593-a58f-9cd4dc3fadde admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026873 Oct 27 03:12:37.517606 n-d-862769-1 devstack@n-api.service[105142]: [pid: 105142|app: 0|req: 21/40] 10.222.0.20 () {60 vars in 1210 bytes} [Thu Oct 27 03:12:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:12:37.529170 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi [None req-908fc2e6-f573-4bb1-855c-871c58e736c3 admin admin] Calling method '>' {{(pid=105141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:12:37.550899 n-d-862769-1 devstack@n-api.service[105141]: INFO nova.api.openstack.requestlog [None req-908fc2e6-f573-4bb1-855c-871c58e736c3 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026265 Oct 27 03:12:37.551436 n-d-862769-1 devstack@n-api.service[105141]: [pid: 105141|app: 0|req: 20/41] 10.222.0.20 () {60 vars in 1210 bytes} [Thu Oct 27 03:12:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:12:37.561075 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi [None req-747f59ba-cb81-4415-aa38-3e710b45a47c admin admin] Calling method '>' {{(pid=105142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:12:37.566747 n-d-862769-1 devstack@n-api.service[105142]: INFO nova.api.openstack.wsgi [None req-747f59ba-cb81-4415-aa38-3e710b45a47c admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 27 03:12:37.569979 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi [None req-747f59ba-cb81-4415-aa38-3e710b45a47c admin admin] Request method failure captured: Oct 27 03:12:37.569979 n-d-862769-1 devstack@n-api.service[105142]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 27 03:12:37.569979 n-d-862769-1 devstack@n-api.service[105142]: Accept: application/json Oct 27 03:12:37.569979 n-d-862769-1 devstack@n-api.service[105142]: Accept-Encoding: gzip, deflate Oct 27 03:12:37.569979 n-d-862769-1 devstack@n-api.service[105142]: Connection: keep-alive Oct 27 03:12:37.569979 n-d-862769-1 devstack@n-api.service[105142]: Content-Length: 0 Oct 27 03:12:37.569979 n-d-862769-1 devstack@n-api.service[105142]: Host: 10.222.0.20 Oct 27 03:12:37.569979 n-d-862769-1 devstack@n-api.service[105142]: Openstack-Api-Version: compute 2.92 Oct 27 03:12:37.569979 n-d-862769-1 devstack@n-api.service[105142]: Openstack-System-Scope: None Oct 27 03:12:37.569979 n-d-862769-1 devstack@n-api.service[105142]: User-Agent: python-novaclient Oct 27 03:12:37.569979 n-d-862769-1 devstack@n-api.service[105142]: X-Auth-Token: gAAAAABjWfck624vldMvVeP3KTJirzBaiLcIqvISS7q80ro9edBHj986Q4lS0HRVT3-bfcMjTT3nHVm14yAy3aERFC9XazBMWn3NbAuHFygRZ6U0nmYa4VOPEam84_oALmfK8Z4RFJHKZIOCsd_t2QE_6Zzxd6-P0mIYmgsS_dz8rb_dISGBsVw Oct 27 03:12:37.569979 n-d-862769-1 devstack@n-api.service[105142]: X-Domain-Id: None Oct 27 03:12:37.569979 n-d-862769-1 devstack@n-api.service[105142]: X-Domain-Name: None Oct 27 03:12:37.569979 n-d-862769-1 devstack@n-api.service[105142]: X-Identity-Status: Confirmed Oct 27 03:12:37.569979 n-d-862769-1 devstack@n-api.service[105142]: X-Is-Admin-Project: True Oct 27 03:12:37.569979 n-d-862769-1 devstack@n-api.service[105142]: X-Openstack-Nova-Api-Version: 2.92 Oct 27 03:12:37.569979 n-d-862769-1 devstack@n-api.service[105142]: X-Project-Domain-Id: default Oct 27 03:12:37.569979 n-d-862769-1 devstack@n-api.service[105142]: X-Project-Domain-Name: Default Oct 27 03:12:37.569979 n-d-862769-1 devstack@n-api.service[105142]: X-Project-Id: 5e8ac2ac85cf42df9e4584993def5b4a Oct 27 03:12:37.569979 n-d-862769-1 devstack@n-api.service[105142]: X-Project-Name: admin Oct 27 03:12:37.569979 n-d-862769-1 devstack@n-api.service[105142]: X-Role: admin,member,reader Oct 27 03:12:37.569979 n-d-862769-1 devstack@n-api.service[105142]: X-Roles: admin,member,reader Oct 27 03:12:37.571515 n-d-862769-1 devstack@n-api.service[105142]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5e8ac2ac85cf42df9e4584993def5b4a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5e8ac2ac85cf42df9e4584993def5b4a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5e8ac2ac85cf42df9e4584993def5b4a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5e8ac2ac85cf42df9e4584993def5b4a"}]}] Oct 27 03:12:37.571515 n-d-862769-1 devstack@n-api.service[105142]: X-Tenant: admin Oct 27 03:12:37.571515 n-d-862769-1 devstack@n-api.service[105142]: X-Tenant-Id: 5e8ac2ac85cf42df9e4584993def5b4a Oct 27 03:12:37.571515 n-d-862769-1 devstack@n-api.service[105142]: X-Tenant-Name: admin Oct 27 03:12:37.571515 n-d-862769-1 devstack@n-api.service[105142]: X-User: admin Oct 27 03:12:37.571515 n-d-862769-1 devstack@n-api.service[105142]: X-User-Domain-Id: default Oct 27 03:12:37.571515 n-d-862769-1 devstack@n-api.service[105142]: X-User-Domain-Name: Default Oct 27 03:12:37.571515 n-d-862769-1 devstack@n-api.service[105142]: X-User-Id: 7c4a354216e64f78803accba54466d59 Oct 27 03:12:37.571515 n-d-862769-1 devstack@n-api.service[105142]: X-User-Name: admin Oct 27 03:12:37.571515 n-d-862769-1 devstack@n-api.service[105142]: method: > Oct 27 03:12:37.571515 n-d-862769-1 devstack@n-api.service[105142]: exception: Flavor 42 could not be found. Oct 27 03:12:37.571515 n-d-862769-1 devstack@n-api.service[105142]: action_args: {'id': '42'} Oct 27 03:12:37.571515 n-d-862769-1 devstack@n-api.service[105142]: {{(pid=105142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:12:37.571515 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:12:37.572606 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 27 03:12:37.572606 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 27 03:12:37.572606 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 27 03:12:37.572606 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 27 03:12:37.572606 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 03:12:37.572606 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 03:12:37.572606 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 27 03:12:37.572606 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 27 03:12:37.572606 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 27 03:12:37.572606 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:12:37.572606 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 27 03:12:37.572606 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 27 03:12:37.572606 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 27 03:12:37.572606 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi Oct 27 03:12:37.572606 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:12:37.572606 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi Oct 27 03:12:37.572606 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:12:37.572606 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:12:37.572606 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:12:37.573901 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:12:37.573901 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:12:37.573901 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:12:37.573901 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:12:37.573901 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 27 03:12:37.573901 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:12:37.573901 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 27 03:12:37.573901 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi Oct 27 03:12:37.573901 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:12:37.573901 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi Oct 27 03:12:37.573901 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:12:37.573901 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:12:37.573901 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:12:37.573901 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:12:37.573901 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:12:37.573901 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 27 03:12:37.573901 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi Oct 27 03:12:37.573901 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi [None req-747f59ba-cb81-4415-aa38-3e710b45a47c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:12:37.575152 n-d-862769-1 devstack@n-api.service[105142]: INFO nova.api.openstack.requestlog [None req-747f59ba-cb81-4415-aa38-3e710b45a47c admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014348 Oct 27 03:12:37.575152 n-d-862769-1 devstack@n-api.service[105142]: [pid: 105142|app: 0|req: 22/42] 10.222.0.20 () {60 vars in 1190 bytes} [Thu Oct 27 03:12:37 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 27 03:12:38.778870 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi [None req-908fc2e6-f573-4bb1-855c-871c58e736c3 admin admin] Calling method '>' {{(pid=105141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:12:38.779870 n-d-862769-1 devstack@n-api.service[105141]: INFO nova.api.openstack.requestlog [None req-908fc2e6-f573-4bb1-855c-871c58e736c3 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Oct 27 03:12:38.780267 n-d-862769-1 devstack@n-api.service[105141]: [pid: 105141|app: 0|req: 21/43] 10.222.0.20 () {56 vars in 1074 bytes} [Thu Oct 27 03:12:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:12:39.294293 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi [None req-ca6ec412-69af-41ed-beb1-c0b899d7fcba admin admin] Calling method '>' {{(pid=105142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:12:39.299245 n-d-862769-1 devstack@n-api.service[105142]: INFO nova.api.openstack.wsgi [None req-ca6ec412-69af-41ed-beb1-c0b899d7fcba admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 27 03:12:39.300728 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi [None req-ca6ec412-69af-41ed-beb1-c0b899d7fcba admin admin] Request method failure captured: Oct 27 03:12:39.300728 n-d-862769-1 devstack@n-api.service[105142]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 27 03:12:39.300728 n-d-862769-1 devstack@n-api.service[105142]: Accept: application/json Oct 27 03:12:39.300728 n-d-862769-1 devstack@n-api.service[105142]: Accept-Encoding: gzip, deflate Oct 27 03:12:39.300728 n-d-862769-1 devstack@n-api.service[105142]: Connection: keep-alive Oct 27 03:12:39.300728 n-d-862769-1 devstack@n-api.service[105142]: Content-Length: 0 Oct 27 03:12:39.300728 n-d-862769-1 devstack@n-api.service[105142]: Host: 10.222.0.20 Oct 27 03:12:39.300728 n-d-862769-1 devstack@n-api.service[105142]: Openstack-Api-Version: compute 2.92 Oct 27 03:12:39.300728 n-d-862769-1 devstack@n-api.service[105142]: Openstack-System-Scope: None Oct 27 03:12:39.300728 n-d-862769-1 devstack@n-api.service[105142]: User-Agent: python-novaclient Oct 27 03:12:39.300728 n-d-862769-1 devstack@n-api.service[105142]: X-Auth-Token: gAAAAABjWfcmg2On3WKyHdU-RkkN2VIjlCS2tssTRXaA7V6ZSUWhM1mOOglrFtO0X97tNDwuvTuwm9qHLXC6Px9j-UFIsKIbA5UQ71JDTVtFHQjDFiMwrEqrGIpM4Nmk5QsMaPCLzPKQ5vB4Xqeyu-VunL2unmkQiWbGoWtaRySxZYtU71tY6kE Oct 27 03:12:39.300728 n-d-862769-1 devstack@n-api.service[105142]: X-Domain-Id: None Oct 27 03:12:39.300728 n-d-862769-1 devstack@n-api.service[105142]: X-Domain-Name: None Oct 27 03:12:39.300728 n-d-862769-1 devstack@n-api.service[105142]: X-Identity-Status: Confirmed Oct 27 03:12:39.300728 n-d-862769-1 devstack@n-api.service[105142]: X-Is-Admin-Project: True Oct 27 03:12:39.300728 n-d-862769-1 devstack@n-api.service[105142]: X-Openstack-Nova-Api-Version: 2.92 Oct 27 03:12:39.300728 n-d-862769-1 devstack@n-api.service[105142]: X-Project-Domain-Id: default Oct 27 03:12:39.300728 n-d-862769-1 devstack@n-api.service[105142]: X-Project-Domain-Name: Default Oct 27 03:12:39.300728 n-d-862769-1 devstack@n-api.service[105142]: X-Project-Id: 5e8ac2ac85cf42df9e4584993def5b4a Oct 27 03:12:39.300728 n-d-862769-1 devstack@n-api.service[105142]: X-Project-Name: admin Oct 27 03:12:39.300728 n-d-862769-1 devstack@n-api.service[105142]: X-Role: admin,member,reader Oct 27 03:12:39.300728 n-d-862769-1 devstack@n-api.service[105142]: X-Roles: admin,member,reader Oct 27 03:12:39.302301 n-d-862769-1 devstack@n-api.service[105142]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5e8ac2ac85cf42df9e4584993def5b4a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5e8ac2ac85cf42df9e4584993def5b4a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5e8ac2ac85cf42df9e4584993def5b4a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5e8ac2ac85cf42df9e4584993def5b4a"}]}] Oct 27 03:12:39.302301 n-d-862769-1 devstack@n-api.service[105142]: X-Tenant: admin Oct 27 03:12:39.302301 n-d-862769-1 devstack@n-api.service[105142]: X-Tenant-Id: 5e8ac2ac85cf42df9e4584993def5b4a Oct 27 03:12:39.302301 n-d-862769-1 devstack@n-api.service[105142]: X-Tenant-Name: admin Oct 27 03:12:39.302301 n-d-862769-1 devstack@n-api.service[105142]: X-User: admin Oct 27 03:12:39.302301 n-d-862769-1 devstack@n-api.service[105142]: X-User-Domain-Id: default Oct 27 03:12:39.302301 n-d-862769-1 devstack@n-api.service[105142]: X-User-Domain-Name: Default Oct 27 03:12:39.302301 n-d-862769-1 devstack@n-api.service[105142]: X-User-Id: 7c4a354216e64f78803accba54466d59 Oct 27 03:12:39.302301 n-d-862769-1 devstack@n-api.service[105142]: X-User-Name: admin Oct 27 03:12:39.302301 n-d-862769-1 devstack@n-api.service[105142]: method: > Oct 27 03:12:39.302301 n-d-862769-1 devstack@n-api.service[105142]: exception: Flavor 84 could not be found. Oct 27 03:12:39.302301 n-d-862769-1 devstack@n-api.service[105142]: action_args: {'id': '84'} Oct 27 03:12:39.302301 n-d-862769-1 devstack@n-api.service[105142]: {{(pid=105142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:12:39.302301 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:12:39.303194 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 27 03:12:39.303194 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 27 03:12:39.303194 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 27 03:12:39.303194 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 27 03:12:39.303194 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 03:12:39.303194 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 03:12:39.303194 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 27 03:12:39.303194 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 27 03:12:39.303194 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 27 03:12:39.303194 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:12:39.303194 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 27 03:12:39.303194 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 27 03:12:39.303194 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 27 03:12:39.303194 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi Oct 27 03:12:39.303194 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:12:39.303194 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi Oct 27 03:12:39.303194 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:12:39.303194 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:12:39.303194 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:12:39.304455 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:12:39.304455 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:12:39.304455 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:12:39.304455 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:12:39.304455 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 27 03:12:39.304455 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:12:39.304455 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 27 03:12:39.304455 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi Oct 27 03:12:39.304455 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:12:39.304455 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi Oct 27 03:12:39.304455 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:12:39.304455 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:12:39.304455 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:12:39.304455 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:12:39.304455 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:12:39.304455 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 27 03:12:39.304455 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi Oct 27 03:12:39.304455 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi [None req-ca6ec412-69af-41ed-beb1-c0b899d7fcba admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:12:39.305657 n-d-862769-1 devstack@n-api.service[105142]: INFO nova.api.openstack.requestlog [None req-ca6ec412-69af-41ed-beb1-c0b899d7fcba admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.384876 Oct 27 03:12:39.305657 n-d-862769-1 devstack@n-api.service[105142]: [pid: 105142|app: 0|req: 23/44] 10.222.0.20 () {60 vars in 1190 bytes} [Thu Oct 27 03:12:38 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 386 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 27 03:12:39.311708 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi [None req-12df6573-e8cd-462b-a716-f5e4a45466f1 admin admin] Calling method '>' {{(pid=105141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:12:39.326834 n-d-862769-1 devstack@n-api.service[105141]: INFO nova.api.openstack.requestlog [None req-12df6573-e8cd-462b-a716-f5e4a45466f1 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018716 Oct 27 03:12:39.327336 n-d-862769-1 devstack@n-api.service[105141]: [pid: 105141|app: 0|req: 22/45] 10.222.0.20 () {60 vars in 1210 bytes} [Thu Oct 27 03:12:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:12:39.337053 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi [None req-d4860a66-bda6-4193-8f25-bd255f79ec75 admin admin] Calling method '>' {{(pid=105142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:12:39.352150 n-d-862769-1 devstack@n-api.service[105142]: INFO nova.api.openstack.requestlog [None req-d4860a66-bda6-4193-8f25-bd255f79ec75 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018568 Oct 27 03:12:39.352663 n-d-862769-1 devstack@n-api.service[105142]: [pid: 105142|app: 0|req: 24/46] 10.222.0.20 () {60 vars in 1210 bytes} [Thu Oct 27 03:12:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:12:39.361372 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi [None req-4e0c88ad-5d1d-4190-8eae-bcd3c7643f20 admin admin] Calling method '>' {{(pid=105141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:12:39.366700 n-d-862769-1 devstack@n-api.service[105141]: INFO nova.api.openstack.wsgi [None req-4e0c88ad-5d1d-4190-8eae-bcd3c7643f20 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 27 03:12:39.368169 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi [None req-4e0c88ad-5d1d-4190-8eae-bcd3c7643f20 admin admin] Request method failure captured: Oct 27 03:12:39.368169 n-d-862769-1 devstack@n-api.service[105141]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 27 03:12:39.368169 n-d-862769-1 devstack@n-api.service[105141]: Accept: application/json Oct 27 03:12:39.368169 n-d-862769-1 devstack@n-api.service[105141]: Accept-Encoding: gzip, deflate Oct 27 03:12:39.368169 n-d-862769-1 devstack@n-api.service[105141]: Connection: keep-alive Oct 27 03:12:39.368169 n-d-862769-1 devstack@n-api.service[105141]: Content-Length: 0 Oct 27 03:12:39.368169 n-d-862769-1 devstack@n-api.service[105141]: Host: 10.222.0.20 Oct 27 03:12:39.368169 n-d-862769-1 devstack@n-api.service[105141]: Openstack-Api-Version: compute 2.92 Oct 27 03:12:39.368169 n-d-862769-1 devstack@n-api.service[105141]: Openstack-System-Scope: None Oct 27 03:12:39.368169 n-d-862769-1 devstack@n-api.service[105141]: User-Agent: python-novaclient Oct 27 03:12:39.368169 n-d-862769-1 devstack@n-api.service[105141]: X-Auth-Token: gAAAAABjWfcmg2On3WKyHdU-RkkN2VIjlCS2tssTRXaA7V6ZSUWhM1mOOglrFtO0X97tNDwuvTuwm9qHLXC6Px9j-UFIsKIbA5UQ71JDTVtFHQjDFiMwrEqrGIpM4Nmk5QsMaPCLzPKQ5vB4Xqeyu-VunL2unmkQiWbGoWtaRySxZYtU71tY6kE Oct 27 03:12:39.368169 n-d-862769-1 devstack@n-api.service[105141]: X-Domain-Id: None Oct 27 03:12:39.368169 n-d-862769-1 devstack@n-api.service[105141]: X-Domain-Name: None Oct 27 03:12:39.368169 n-d-862769-1 devstack@n-api.service[105141]: X-Identity-Status: Confirmed Oct 27 03:12:39.368169 n-d-862769-1 devstack@n-api.service[105141]: X-Is-Admin-Project: True Oct 27 03:12:39.368169 n-d-862769-1 devstack@n-api.service[105141]: X-Openstack-Nova-Api-Version: 2.92 Oct 27 03:12:39.368169 n-d-862769-1 devstack@n-api.service[105141]: X-Project-Domain-Id: default Oct 27 03:12:39.368169 n-d-862769-1 devstack@n-api.service[105141]: X-Project-Domain-Name: Default Oct 27 03:12:39.368169 n-d-862769-1 devstack@n-api.service[105141]: X-Project-Id: 5e8ac2ac85cf42df9e4584993def5b4a Oct 27 03:12:39.368169 n-d-862769-1 devstack@n-api.service[105141]: X-Project-Name: admin Oct 27 03:12:39.368169 n-d-862769-1 devstack@n-api.service[105141]: X-Role: admin,member,reader Oct 27 03:12:39.368169 n-d-862769-1 devstack@n-api.service[105141]: X-Roles: admin,member,reader Oct 27 03:12:39.369682 n-d-862769-1 devstack@n-api.service[105141]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5e8ac2ac85cf42df9e4584993def5b4a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5e8ac2ac85cf42df9e4584993def5b4a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5e8ac2ac85cf42df9e4584993def5b4a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5e8ac2ac85cf42df9e4584993def5b4a"}]}] Oct 27 03:12:39.369682 n-d-862769-1 devstack@n-api.service[105141]: X-Tenant: admin Oct 27 03:12:39.369682 n-d-862769-1 devstack@n-api.service[105141]: X-Tenant-Id: 5e8ac2ac85cf42df9e4584993def5b4a Oct 27 03:12:39.369682 n-d-862769-1 devstack@n-api.service[105141]: X-Tenant-Name: admin Oct 27 03:12:39.369682 n-d-862769-1 devstack@n-api.service[105141]: X-User: admin Oct 27 03:12:39.369682 n-d-862769-1 devstack@n-api.service[105141]: X-User-Domain-Id: default Oct 27 03:12:39.369682 n-d-862769-1 devstack@n-api.service[105141]: X-User-Domain-Name: Default Oct 27 03:12:39.369682 n-d-862769-1 devstack@n-api.service[105141]: X-User-Id: 7c4a354216e64f78803accba54466d59 Oct 27 03:12:39.369682 n-d-862769-1 devstack@n-api.service[105141]: X-User-Name: admin Oct 27 03:12:39.369682 n-d-862769-1 devstack@n-api.service[105141]: method: > Oct 27 03:12:39.369682 n-d-862769-1 devstack@n-api.service[105141]: exception: Flavor 84 could not be found. Oct 27 03:12:39.369682 n-d-862769-1 devstack@n-api.service[105141]: action_args: {'id': '84'} Oct 27 03:12:39.369682 n-d-862769-1 devstack@n-api.service[105141]: {{(pid=105141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:12:39.369682 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:12:39.370670 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 27 03:12:39.370670 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 27 03:12:39.370670 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 27 03:12:39.370670 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 27 03:12:39.370670 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 03:12:39.370670 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 03:12:39.370670 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 27 03:12:39.370670 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 27 03:12:39.370670 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 27 03:12:39.370670 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:12:39.370670 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 27 03:12:39.370670 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 27 03:12:39.370670 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 27 03:12:39.370670 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi Oct 27 03:12:39.370670 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:12:39.370670 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi Oct 27 03:12:39.370670 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:12:39.370670 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:12:39.370670 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:12:39.371750 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:12:39.371750 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:12:39.371750 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:12:39.371750 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:12:39.371750 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 27 03:12:39.371750 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:12:39.371750 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 27 03:12:39.371750 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi Oct 27 03:12:39.371750 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:12:39.371750 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi Oct 27 03:12:39.371750 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:12:39.371750 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:12:39.371750 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:12:39.371750 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:12:39.371750 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:12:39.371750 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 27 03:12:39.371750 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi Oct 27 03:12:39.371750 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi [None req-4e0c88ad-5d1d-4190-8eae-bcd3c7643f20 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105141) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:12:39.372722 n-d-862769-1 devstack@n-api.service[105141]: INFO nova.api.openstack.requestlog [None req-4e0c88ad-5d1d-4190-8eae-bcd3c7643f20 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011565 Oct 27 03:12:39.372722 n-d-862769-1 devstack@n-api.service[105141]: [pid: 105141|app: 0|req: 23/47] 10.222.0.20 () {60 vars in 1190 bytes} [Thu Oct 27 03:12:39 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 27 03:12:40.555920 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi [None req-d4860a66-bda6-4193-8f25-bd255f79ec75 admin admin] Calling method '>' {{(pid=105142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:12:40.556941 n-d-862769-1 devstack@n-api.service[105142]: INFO nova.api.openstack.requestlog [None req-d4860a66-bda6-4193-8f25-bd255f79ec75 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Oct 27 03:12:40.557358 n-d-862769-1 devstack@n-api.service[105142]: [pid: 105142|app: 0|req: 25/48] 10.222.0.20 () {56 vars in 1074 bytes} [Thu Oct 27 03:12:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:12:41.122283 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi [None req-b5a5fd1c-d174-4836-b8fa-56209d37fdf6 admin admin] Calling method '>' {{(pid=105141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:12:41.128721 n-d-862769-1 devstack@n-api.service[105141]: INFO nova.api.openstack.wsgi [None req-b5a5fd1c-d174-4836-b8fa-56209d37fdf6 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 27 03:12:41.131447 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi [None req-b5a5fd1c-d174-4836-b8fa-56209d37fdf6 admin admin] Request method failure captured: Oct 27 03:12:41.131447 n-d-862769-1 devstack@n-api.service[105141]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 27 03:12:41.131447 n-d-862769-1 devstack@n-api.service[105141]: Accept: application/json Oct 27 03:12:41.131447 n-d-862769-1 devstack@n-api.service[105141]: Accept-Encoding: gzip, deflate Oct 27 03:12:41.131447 n-d-862769-1 devstack@n-api.service[105141]: Connection: keep-alive Oct 27 03:12:41.131447 n-d-862769-1 devstack@n-api.service[105141]: Content-Length: 0 Oct 27 03:12:41.131447 n-d-862769-1 devstack@n-api.service[105141]: Host: 10.222.0.20 Oct 27 03:12:41.131447 n-d-862769-1 devstack@n-api.service[105141]: Openstack-Api-Version: compute 2.92 Oct 27 03:12:41.131447 n-d-862769-1 devstack@n-api.service[105141]: Openstack-System-Scope: None Oct 27 03:12:41.131447 n-d-862769-1 devstack@n-api.service[105141]: User-Agent: python-novaclient Oct 27 03:12:41.131447 n-d-862769-1 devstack@n-api.service[105141]: X-Auth-Token: gAAAAABjWfcouctTntok4X_g401k6a88sQseQdmF9gJNEjYFcoFboCDgaqyTi5TyXWCLfiUJRRlxtGB_7JII637cMgXoVTIvLdZtfzOL77_rMd0Gm56BVmx9_5nXTGPa1jtqv1cDTRFnpB-e63P95OZqOiZcKYOXPPrzH5knyBD_JoDaqYj1yRk Oct 27 03:12:41.131447 n-d-862769-1 devstack@n-api.service[105141]: X-Domain-Id: None Oct 27 03:12:41.131447 n-d-862769-1 devstack@n-api.service[105141]: X-Domain-Name: None Oct 27 03:12:41.131447 n-d-862769-1 devstack@n-api.service[105141]: X-Identity-Status: Confirmed Oct 27 03:12:41.131447 n-d-862769-1 devstack@n-api.service[105141]: X-Is-Admin-Project: True Oct 27 03:12:41.131447 n-d-862769-1 devstack@n-api.service[105141]: X-Openstack-Nova-Api-Version: 2.92 Oct 27 03:12:41.131447 n-d-862769-1 devstack@n-api.service[105141]: X-Project-Domain-Id: default Oct 27 03:12:41.131447 n-d-862769-1 devstack@n-api.service[105141]: X-Project-Domain-Name: Default Oct 27 03:12:41.131447 n-d-862769-1 devstack@n-api.service[105141]: X-Project-Id: 5e8ac2ac85cf42df9e4584993def5b4a Oct 27 03:12:41.131447 n-d-862769-1 devstack@n-api.service[105141]: X-Project-Name: admin Oct 27 03:12:41.131447 n-d-862769-1 devstack@n-api.service[105141]: X-Role: admin,member,reader Oct 27 03:12:41.131447 n-d-862769-1 devstack@n-api.service[105141]: X-Roles: admin,member,reader Oct 27 03:12:41.132924 n-d-862769-1 devstack@n-api.service[105141]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5e8ac2ac85cf42df9e4584993def5b4a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5e8ac2ac85cf42df9e4584993def5b4a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5e8ac2ac85cf42df9e4584993def5b4a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5e8ac2ac85cf42df9e4584993def5b4a"}]}] Oct 27 03:12:41.132924 n-d-862769-1 devstack@n-api.service[105141]: X-Tenant: admin Oct 27 03:12:41.132924 n-d-862769-1 devstack@n-api.service[105141]: X-Tenant-Id: 5e8ac2ac85cf42df9e4584993def5b4a Oct 27 03:12:41.132924 n-d-862769-1 devstack@n-api.service[105141]: X-Tenant-Name: admin Oct 27 03:12:41.132924 n-d-862769-1 devstack@n-api.service[105141]: X-User: admin Oct 27 03:12:41.132924 n-d-862769-1 devstack@n-api.service[105141]: X-User-Domain-Id: default Oct 27 03:12:41.132924 n-d-862769-1 devstack@n-api.service[105141]: X-User-Domain-Name: Default Oct 27 03:12:41.132924 n-d-862769-1 devstack@n-api.service[105141]: X-User-Id: 7c4a354216e64f78803accba54466d59 Oct 27 03:12:41.132924 n-d-862769-1 devstack@n-api.service[105141]: X-User-Name: admin Oct 27 03:12:41.132924 n-d-862769-1 devstack@n-api.service[105141]: method: > Oct 27 03:12:41.132924 n-d-862769-1 devstack@n-api.service[105141]: exception: Flavor 451 could not be found. Oct 27 03:12:41.132924 n-d-862769-1 devstack@n-api.service[105141]: action_args: {'id': '451'} Oct 27 03:12:41.132924 n-d-862769-1 devstack@n-api.service[105141]: {{(pid=105141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:12:41.132924 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:12:41.133865 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 27 03:12:41.133865 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 27 03:12:41.133865 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 27 03:12:41.133865 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 27 03:12:41.133865 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 03:12:41.133865 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 03:12:41.133865 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 27 03:12:41.133865 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 27 03:12:41.133865 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 27 03:12:41.133865 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:12:41.133865 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 27 03:12:41.133865 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 27 03:12:41.133865 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 27 03:12:41.133865 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi Oct 27 03:12:41.133865 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:12:41.133865 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi Oct 27 03:12:41.133865 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:12:41.133865 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:12:41.133865 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:12:41.135191 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:12:41.135191 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:12:41.135191 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:12:41.135191 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:12:41.135191 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 27 03:12:41.135191 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:12:41.135191 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 27 03:12:41.135191 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi Oct 27 03:12:41.135191 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:12:41.135191 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi Oct 27 03:12:41.135191 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:12:41.135191 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:12:41.135191 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:12:41.135191 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:12:41.135191 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:12:41.135191 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 27 03:12:41.135191 n-d-862769-1 devstack@n-api.service[105141]: ERROR nova.api.openstack.wsgi Oct 27 03:12:41.135191 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi [None req-b5a5fd1c-d174-4836-b8fa-56209d37fdf6 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105141) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:12:41.136444 n-d-862769-1 devstack@n-api.service[105141]: INFO nova.api.openstack.requestlog [None req-b5a5fd1c-d174-4836-b8fa-56209d37fdf6 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.440536 Oct 27 03:12:41.136444 n-d-862769-1 devstack@n-api.service[105141]: [pid: 105141|app: 0|req: 24/49] 10.222.0.20 () {60 vars in 1193 bytes} [Thu Oct 27 03:12:40 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 442 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 27 03:12:41.143846 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi [None req-bee188ac-b4b7-4870-8042-5893393d1765 admin admin] Calling method '>' {{(pid=105142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:12:41.162277 n-d-862769-1 devstack@n-api.service[105142]: INFO nova.api.openstack.requestlog [None req-bee188ac-b4b7-4870-8042-5893393d1765 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.022406 Oct 27 03:12:41.162829 n-d-862769-1 devstack@n-api.service[105142]: [pid: 105142|app: 0|req: 26/50] 10.222.0.20 () {60 vars in 1210 bytes} [Thu Oct 27 03:12:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:12:41.172367 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi [None req-fa43b683-45ef-4937-b939-7ebce2163aba admin admin] Calling method '>' {{(pid=105141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:12:41.188007 n-d-862769-1 devstack@n-api.service[105141]: INFO nova.api.openstack.requestlog [None req-fa43b683-45ef-4937-b939-7ebce2163aba admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019083 Oct 27 03:12:41.188573 n-d-862769-1 devstack@n-api.service[105141]: [pid: 105141|app: 0|req: 25/51] 10.222.0.20 () {60 vars in 1210 bytes} [Thu Oct 27 03:12:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:12:41.198768 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi [None req-4442d3a3-1191-4dbe-b15e-42277b8c7900 admin admin] Calling method '>' {{(pid=105142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:12:41.204063 n-d-862769-1 devstack@n-api.service[105142]: INFO nova.api.openstack.wsgi [None req-4442d3a3-1191-4dbe-b15e-42277b8c7900 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 27 03:12:41.205615 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi [None req-4442d3a3-1191-4dbe-b15e-42277b8c7900 admin admin] Request method failure captured: Oct 27 03:12:41.205615 n-d-862769-1 devstack@n-api.service[105142]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 27 03:12:41.205615 n-d-862769-1 devstack@n-api.service[105142]: Accept: application/json Oct 27 03:12:41.205615 n-d-862769-1 devstack@n-api.service[105142]: Accept-Encoding: gzip, deflate Oct 27 03:12:41.205615 n-d-862769-1 devstack@n-api.service[105142]: Connection: keep-alive Oct 27 03:12:41.205615 n-d-862769-1 devstack@n-api.service[105142]: Content-Length: 0 Oct 27 03:12:41.205615 n-d-862769-1 devstack@n-api.service[105142]: Host: 10.222.0.20 Oct 27 03:12:41.205615 n-d-862769-1 devstack@n-api.service[105142]: Openstack-Api-Version: compute 2.92 Oct 27 03:12:41.205615 n-d-862769-1 devstack@n-api.service[105142]: Openstack-System-Scope: None Oct 27 03:12:41.205615 n-d-862769-1 devstack@n-api.service[105142]: User-Agent: python-novaclient Oct 27 03:12:41.205615 n-d-862769-1 devstack@n-api.service[105142]: X-Auth-Token: gAAAAABjWfcouctTntok4X_g401k6a88sQseQdmF9gJNEjYFcoFboCDgaqyTi5TyXWCLfiUJRRlxtGB_7JII637cMgXoVTIvLdZtfzOL77_rMd0Gm56BVmx9_5nXTGPa1jtqv1cDTRFnpB-e63P95OZqOiZcKYOXPPrzH5knyBD_JoDaqYj1yRk Oct 27 03:12:41.205615 n-d-862769-1 devstack@n-api.service[105142]: X-Domain-Id: None Oct 27 03:12:41.205615 n-d-862769-1 devstack@n-api.service[105142]: X-Domain-Name: None Oct 27 03:12:41.205615 n-d-862769-1 devstack@n-api.service[105142]: X-Identity-Status: Confirmed Oct 27 03:12:41.205615 n-d-862769-1 devstack@n-api.service[105142]: X-Is-Admin-Project: True Oct 27 03:12:41.205615 n-d-862769-1 devstack@n-api.service[105142]: X-Openstack-Nova-Api-Version: 2.92 Oct 27 03:12:41.205615 n-d-862769-1 devstack@n-api.service[105142]: X-Project-Domain-Id: default Oct 27 03:12:41.205615 n-d-862769-1 devstack@n-api.service[105142]: X-Project-Domain-Name: Default Oct 27 03:12:41.205615 n-d-862769-1 devstack@n-api.service[105142]: X-Project-Id: 5e8ac2ac85cf42df9e4584993def5b4a Oct 27 03:12:41.205615 n-d-862769-1 devstack@n-api.service[105142]: X-Project-Name: admin Oct 27 03:12:41.205615 n-d-862769-1 devstack@n-api.service[105142]: X-Role: admin,member,reader Oct 27 03:12:41.205615 n-d-862769-1 devstack@n-api.service[105142]: X-Roles: admin,member,reader Oct 27 03:12:41.207255 n-d-862769-1 devstack@n-api.service[105142]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5e8ac2ac85cf42df9e4584993def5b4a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5e8ac2ac85cf42df9e4584993def5b4a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5e8ac2ac85cf42df9e4584993def5b4a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5e8ac2ac85cf42df9e4584993def5b4a"}]}] Oct 27 03:12:41.207255 n-d-862769-1 devstack@n-api.service[105142]: X-Tenant: admin Oct 27 03:12:41.207255 n-d-862769-1 devstack@n-api.service[105142]: X-Tenant-Id: 5e8ac2ac85cf42df9e4584993def5b4a Oct 27 03:12:41.207255 n-d-862769-1 devstack@n-api.service[105142]: X-Tenant-Name: admin Oct 27 03:12:41.207255 n-d-862769-1 devstack@n-api.service[105142]: X-User: admin Oct 27 03:12:41.207255 n-d-862769-1 devstack@n-api.service[105142]: X-User-Domain-Id: default Oct 27 03:12:41.207255 n-d-862769-1 devstack@n-api.service[105142]: X-User-Domain-Name: Default Oct 27 03:12:41.207255 n-d-862769-1 devstack@n-api.service[105142]: X-User-Id: 7c4a354216e64f78803accba54466d59 Oct 27 03:12:41.207255 n-d-862769-1 devstack@n-api.service[105142]: X-User-Name: admin Oct 27 03:12:41.207255 n-d-862769-1 devstack@n-api.service[105142]: method: > Oct 27 03:12:41.207255 n-d-862769-1 devstack@n-api.service[105142]: exception: Flavor 451 could not be found. Oct 27 03:12:41.207255 n-d-862769-1 devstack@n-api.service[105142]: action_args: {'id': '451'} Oct 27 03:12:41.207255 n-d-862769-1 devstack@n-api.service[105142]: {{(pid=105142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:12:41.207255 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:12:41.208258 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 27 03:12:41.208258 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 27 03:12:41.208258 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 27 03:12:41.208258 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 27 03:12:41.208258 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 03:12:41.208258 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 03:12:41.208258 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 27 03:12:41.208258 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 27 03:12:41.208258 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 27 03:12:41.208258 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:12:41.208258 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 27 03:12:41.208258 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 27 03:12:41.208258 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 27 03:12:41.208258 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi Oct 27 03:12:41.208258 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:12:41.208258 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi Oct 27 03:12:41.208258 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:12:41.208258 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:12:41.208258 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:12:41.209378 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:12:41.209378 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:12:41.209378 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:12:41.209378 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:12:41.209378 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 27 03:12:41.209378 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:12:41.209378 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 27 03:12:41.209378 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi Oct 27 03:12:41.209378 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:12:41.209378 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi Oct 27 03:12:41.209378 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:12:41.209378 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:12:41.209378 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:12:41.209378 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:12:41.209378 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:12:41.209378 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 27 03:12:41.209378 n-d-862769-1 devstack@n-api.service[105142]: ERROR nova.api.openstack.wsgi Oct 27 03:12:41.209378 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi [None req-4442d3a3-1191-4dbe-b15e-42277b8c7900 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:12:41.210391 n-d-862769-1 devstack@n-api.service[105142]: INFO nova.api.openstack.requestlog [None req-4442d3a3-1191-4dbe-b15e-42277b8c7900 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.012451 Oct 27 03:12:41.210391 n-d-862769-1 devstack@n-api.service[105142]: [pid: 105142|app: 0|req: 27/52] 10.222.0.20 () {60 vars in 1193 bytes} [Thu Oct 27 03:12:41 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 27 03:12:42.430599 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi [None req-fa43b683-45ef-4937-b939-7ebce2163aba admin admin] Calling method '>' {{(pid=105141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:12:42.431637 n-d-862769-1 devstack@n-api.service[105141]: INFO nova.api.openstack.requestlog [None req-fa43b683-45ef-4937-b939-7ebce2163aba admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Oct 27 03:12:42.432025 n-d-862769-1 devstack@n-api.service[105141]: [pid: 105141|app: 0|req: 26/53] 10.222.0.20 () {56 vars in 1074 bytes} [Thu Oct 27 03:12:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:12:42.945201 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi [None req-5dfe6c00-1521-4a50-9c13-c78c15495267 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:12:43.002900 n-d-862769-1 devstack@n-api.service[105142]: INFO nova.api.openstack.requestlog [None req-5dfe6c00-1521-4a50-9c13-c78c15495267 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.434347 Oct 27 03:12:43.003375 n-d-862769-1 devstack@n-api.service[105142]: [pid: 105142|app: 0|req: 28/54] 10.222.0.20 () {64 vars in 1235 bytes} [Thu Oct 27 03:12:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 03:12:44.197365 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi [None req-fa43b683-45ef-4937-b939-7ebce2163aba admin admin] Calling method '>' {{(pid=105141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:12:44.198416 n-d-862769-1 devstack@n-api.service[105141]: INFO nova.api.openstack.requestlog [None req-fa43b683-45ef-4937-b939-7ebce2163aba admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Oct 27 03:12:44.198807 n-d-862769-1 devstack@n-api.service[105141]: [pid: 105141|app: 0|req: 27/55] 10.222.0.20 () {56 vars in 1074 bytes} [Thu Oct 27 03:12:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:12:44.709827 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi [None req-95c479fe-4f36-4097-87bd-30cc08ee7678 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:12:44.773221 n-d-862769-1 devstack@n-api.service[105142]: INFO nova.api.openstack.requestlog [None req-95c479fe-4f36-4097-87bd-30cc08ee7678 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.436666 Oct 27 03:12:44.773757 n-d-862769-1 devstack@n-api.service[105142]: [pid: 105142|app: 0|req: 29/56] 10.222.0.20 () {64 vars in 1235 bytes} [Thu Oct 27 03:12:44 2022] POST /compute/v2.1/flavors => generated 405 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 03:12:45.969227 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi [None req-fa43b683-45ef-4937-b939-7ebce2163aba admin admin] Calling method '>' {{(pid=105141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:12:45.970296 n-d-862769-1 devstack@n-api.service[105141]: INFO nova.api.openstack.requestlog [None req-fa43b683-45ef-4937-b939-7ebce2163aba admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Oct 27 03:12:45.970708 n-d-862769-1 devstack@n-api.service[105141]: [pid: 105141|app: 0|req: 28/57] 10.222.0.20 () {56 vars in 1074 bytes} [Thu Oct 27 03:12:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:12:46.480715 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi [None req-cf445c40-4a6b-4441-af57-07c0c872ca6a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:12:46.557427 n-d-862769-1 devstack@n-api.service[105142]: INFO nova.api.openstack.requestlog [None req-cf445c40-4a6b-4441-af57-07c0c872ca6a admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.449341 Oct 27 03:12:46.558026 n-d-862769-1 devstack@n-api.service[105142]: [pid: 105142|app: 0|req: 30/58] 10.222.0.20 () {64 vars in 1235 bytes} [Thu Oct 27 03:12:46 2022] POST /compute/v2.1/flavors => generated 407 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 03:12:47.760558 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi [None req-fa43b683-45ef-4937-b939-7ebce2163aba admin admin] Calling method '>' {{(pid=105141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:12:47.761545 n-d-862769-1 devstack@n-api.service[105141]: INFO nova.api.openstack.requestlog [None req-fa43b683-45ef-4937-b939-7ebce2163aba admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Oct 27 03:12:47.761930 n-d-862769-1 devstack@n-api.service[105141]: [pid: 105141|app: 0|req: 29/59] 10.222.0.20 () {56 vars in 1074 bytes} [Thu Oct 27 03:12:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:12:48.275682 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi [None req-fcebc80a-e74e-4cfe-a61d-6c03c79b6ca6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:12:48.350954 n-d-862769-1 devstack@n-api.service[105142]: INFO nova.api.openstack.requestlog [None req-fcebc80a-e74e-4cfe-a61d-6c03c79b6ca6 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.451821 Oct 27 03:12:48.351492 n-d-862769-1 devstack@n-api.service[105142]: [pid: 105142|app: 0|req: 31/60] 10.222.0.20 () {64 vars in 1235 bytes} [Thu Oct 27 03:12:47 2022] POST /compute/v2.1/flavors => generated 409 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 03:12:49.549291 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi [None req-fa43b683-45ef-4937-b939-7ebce2163aba admin admin] Calling method '>' {{(pid=105141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:12:49.550360 n-d-862769-1 devstack@n-api.service[105141]: INFO nova.api.openstack.requestlog [None req-fa43b683-45ef-4937-b939-7ebce2163aba admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Oct 27 03:12:49.550753 n-d-862769-1 devstack@n-api.service[105141]: [pid: 105141|app: 0|req: 30/61] 10.222.0.20 () {56 vars in 1074 bytes} [Thu Oct 27 03:12:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:12:50.069166 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi [None req-8877c2ea-a56d-49f2-b48c-2e177198851d admin admin] Calling method '>' {{(pid=105142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:12:50.089210 n-d-862769-1 devstack@n-api.service[105142]: INFO nova.api.openstack.requestlog [None req-8877c2ea-a56d-49f2-b48c-2e177198851d admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.402400 Oct 27 03:12:50.089687 n-d-862769-1 devstack@n-api.service[105142]: [pid: 105142|app: 0|req: 32/62] 10.222.0.20 () {60 vars in 1202 bytes} [Thu Oct 27 03:12:49 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:13:46.732648 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi [None req-fa43b683-45ef-4937-b939-7ebce2163aba admin admin] Calling method '>' {{(pid=105141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:13:46.733671 n-d-862769-1 devstack@n-api.service[105141]: INFO nova.api.openstack.requestlog [None req-fa43b683-45ef-4937-b939-7ebce2163aba admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Oct 27 03:13:46.734080 n-d-862769-1 devstack@n-api.service[105141]: [pid: 105141|app: 0|req: 31/63] 10.222.0.20 () {54 vars in 931 bytes} [Thu Oct 27 03:13:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:13:46.745470 n-d-862769-1 devstack@n-api.service[105142]: DEBUG dbcounter [-] [105142] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=105142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:13:47.122454 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi [None req-6cddaabe-0155-4f9b-8918-849066dc095e admin admin] Calling method '>' {{(pid=105142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:13:47.143278 n-d-862769-1 devstack@n-api.service[105142]: INFO nova.api.openstack.requestlog [None req-6cddaabe-0155-4f9b-8918-849066dc095e admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.402287 Oct 27 03:13:47.143808 n-d-862769-1 devstack@n-api.service[105142]: [pid: 105142|app: 0|req: 33/64] 10.222.0.20 () {60 vars in 1292 bytes} [Thu Oct 27 03:13:46 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:13:47.165533 n-d-862769-1 devstack@n-api.service[105141]: DEBUG dbcounter [-] [105141] Writing DB stats nova_api:SELECT=14 {{(pid=105141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:13:47.169236 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi [None req-9d888862-04c8-4664-a731-d9d036fdc0c6 admin admin] Calling method '>' {{(pid=105141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:13:47.176276 n-d-862769-1 devstack@n-api.service[105141]: INFO nova.api.openstack.requestlog [None req-9d888862-04c8-4664-a731-d9d036fdc0c6 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012265 Oct 27 03:13:47.176780 n-d-862769-1 devstack@n-api.service[105141]: [pid: 105141|app: 0|req: 32/65] 10.222.0.20 () {60 vars in 1283 bytes} [Thu Oct 27 03:13:47 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:13:47.188524 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi [None req-897c28c8-b44c-419e-a534-10635b590860 admin admin] Calling method '>' {{(pid=105142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:13:47.195778 n-d-862769-1 devstack@n-api.service[105142]: INFO nova.api.openstack.requestlog [None req-897c28c8-b44c-419e-a534-10635b590860 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010978 Oct 27 03:13:47.196313 n-d-862769-1 devstack@n-api.service[105142]: [pid: 105142|app: 0|req: 34/66] 10.222.0.20 () {60 vars in 1286 bytes} [Thu Oct 27 03:13:47 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:13:47.208644 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi [None req-51ace68c-dcf4-4e3a-a5c0-6e2ffeab72e1 admin admin] Calling method '>' {{(pid=105141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:13:47.216021 n-d-862769-1 devstack@n-api.service[105141]: INFO nova.api.openstack.requestlog [None req-51ace68c-dcf4-4e3a-a5c0-6e2ffeab72e1 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011792 Oct 27 03:13:47.216530 n-d-862769-1 devstack@n-api.service[105141]: [pid: 105141|app: 0|req: 33/67] 10.222.0.20 () {60 vars in 1286 bytes} [Thu Oct 27 03:13:47 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:13:47.228117 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi [None req-259501f1-6cbc-441f-b7d0-2085e4ec2766 admin admin] Calling method '>' {{(pid=105142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:13:47.235103 n-d-862769-1 devstack@n-api.service[105142]: INFO nova.api.openstack.requestlog [None req-259501f1-6cbc-441f-b7d0-2085e4ec2766 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010440 Oct 27 03:13:47.235612 n-d-862769-1 devstack@n-api.service[105142]: [pid: 105142|app: 0|req: 35/68] 10.222.0.20 () {60 vars in 1283 bytes} [Thu Oct 27 03:13:47 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:19:15.858239 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi [None req-51ace68c-dcf4-4e3a-a5c0-6e2ffeab72e1 admin admin] Calling method '>' {{(pid=105141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:19:15.859236 n-d-862769-1 devstack@n-api.service[105141]: INFO nova.api.openstack.requestlog [None req-51ace68c-dcf4-4e3a-a5c0-6e2ffeab72e1 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Oct 27 03:19:15.859623 n-d-862769-1 devstack@n-api.service[105141]: [pid: 105141|app: 0|req: 34/69] 10.222.0.20 () {56 vars in 1074 bytes} [Thu Oct 27 03:19:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:19:15.999156 n-d-862769-1 devstack@n-api.service[105142]: DEBUG dbcounter [-] [105142] Writing DB stats nova_api:SELECT=6 {{(pid=105142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:19:16.141122 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi [None req-942731b5-2683-4ef5-8c24-9b44e2a8942a admin admin] Calling method '>' {{(pid=105142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:19:16.146595 n-d-862769-1 devstack@n-api.service[105142]: DEBUG oslo_concurrency.lockutils [None req-942731b5-2683-4ef5-8c24-9b44e2a8942a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:19:16.147069 n-d-862769-1 devstack@n-api.service[105142]: DEBUG oslo_concurrency.lockutils [None req-942731b5-2683-4ef5-8c24-9b44e2a8942a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:19:16.148539 n-d-862769-1 devstack@n-api.service[105142]: DEBUG oslo_concurrency.lockutils [None req-942731b5-2683-4ef5-8c24-9b44e2a8942a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:19:16.148539 n-d-862769-1 devstack@n-api.service[105142]: DEBUG oslo_concurrency.lockutils [None req-942731b5-2683-4ef5-8c24-9b44e2a8942a admin admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:19:16.148725 n-d-862769-1 devstack@n-api.service[105142]: DEBUG oslo_concurrency.lockutils [None req-942731b5-2683-4ef5-8c24-9b44e2a8942a admin admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:19:16.149030 n-d-862769-1 devstack@n-api.service[105142]: DEBUG oslo_concurrency.lockutils [None req-942731b5-2683-4ef5-8c24-9b44e2a8942a admin admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:19:16.186659 n-d-862769-1 devstack@n-api.service[105142]: INFO nova.api.openstack.requestlog [None req-942731b5-2683-4ef5-8c24-9b44e2a8942a admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.188665 Oct 27 03:19:16.187223 n-d-862769-1 devstack@n-api.service[105142]: [pid: 105142|app: 0|req: 36/70] 10.222.0.20 () {60 vars in 1193 bytes} [Thu Oct 27 03:19:15 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:19:17.247221 n-d-862769-1 devstack@n-api.service[105141]: DEBUG nova.api.openstack.wsgi [None req-51ace68c-dcf4-4e3a-a5c0-6e2ffeab72e1 admin admin] Calling method '>' {{(pid=105141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:19:17.248252 n-d-862769-1 devstack@n-api.service[105141]: INFO nova.api.openstack.requestlog [None req-51ace68c-dcf4-4e3a-a5c0-6e2ffeab72e1 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Oct 27 03:19:17.248643 n-d-862769-1 devstack@n-api.service[105141]: [pid: 105141|app: 0|req: 35/71] 10.222.0.20 () {56 vars in 1074 bytes} [Thu Oct 27 03:19:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:19:17.437715 n-d-862769-1 devstack@n-api.service[105142]: DEBUG nova.api.openstack.wsgi [None req-c06b22c2-48fc-4c2d-89de-9659cde1473d admin admin] Calling method '>' {{(pid=105142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:19:17.441107 n-d-862769-1 devstack@n-api.service[105142]: DEBUG oslo_concurrency.lockutils [None req-c06b22c2-48fc-4c2d-89de-9659cde1473d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:19:17.441587 n-d-862769-1 devstack@n-api.service[105142]: DEBUG oslo_concurrency.lockutils [None req-c06b22c2-48fc-4c2d-89de-9659cde1473d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:19:17.442016 n-d-862769-1 devstack@n-api.service[105142]: DEBUG oslo_concurrency.lockutils [None req-c06b22c2-48fc-4c2d-89de-9659cde1473d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:19:17.442754 n-d-862769-1 devstack@n-api.service[105142]: DEBUG oslo_concurrency.lockutils [None req-c06b22c2-48fc-4c2d-89de-9659cde1473d admin admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:19:17.443208 n-d-862769-1 devstack@n-api.service[105142]: DEBUG oslo_concurrency.lockutils [None req-c06b22c2-48fc-4c2d-89de-9659cde1473d admin admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:19:17.443624 n-d-862769-1 devstack@n-api.service[105142]: DEBUG oslo_concurrency.lockutils [None req-c06b22c2-48fc-4c2d-89de-9659cde1473d admin admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:19:17.466752 n-d-862769-1 devstack@n-api.service[105142]: INFO nova.api.openstack.requestlog [None req-c06b22c2-48fc-4c2d-89de-9659cde1473d admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.080179 Oct 27 03:19:17.467304 n-d-862769-1 devstack@n-api.service[105142]: [pid: 105142|app: 0|req: 37/72] 10.222.0.20 () {60 vars in 1193 bytes} [Thu Oct 27 03:19:17 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:20:02.870907 n-d-862769-1 devstack@n-api.service[105140]: Thu Oct 27 03:20:02 2022 - graceful shutdown triggered... Oct 27 03:20:02.871447 n-d-862769-1 devstack@n-api.service[105141]: Gracefully killing worker 1 (pid: 105141)... Oct 27 03:20:02.872821 n-d-862769-1 devstack@n-api.service[105142]: Gracefully killing worker 2 (pid: 105142)... Oct 27 03:20:02.873068 n-d-862769-1 systemd[1]: Stopping Devstack devstack@n-api.service... Oct 27 03:20:02.997225 n-d-862769-1 devstack@n-api.service[105141]: DEBUG dbcounter [-] [105141] Writing DB stats nova_api:SELECT=4 {{(pid=105141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:20:03.872026 n-d-862769-1 devstack@n-api.service[105140]: worker 1 buried after 1 seconds Oct 27 03:20:03.872445 n-d-862769-1 devstack@n-api.service[105140]: worker 2 buried after 1 seconds Oct 27 03:20:03.872445 n-d-862769-1 devstack@n-api.service[105140]: goodbye to uWSGI. Oct 27 03:20:03.873611 n-d-862769-1 systemd[1]: devstack@n-api.service: Succeeded. Oct 27 03:20:03.874229 n-d-862769-1 systemd[1]: Stopped Devstack devstack@n-api.service. Oct 27 03:20:03.876990 n-d-862769-1 systemd[1]: Starting Devstack devstack@n-api.service... Oct 27 03:20:03.893832 n-d-862769-1 devstack@n-api.service[120989]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 27 03:20:03.913503 n-d-862769-1 devstack@n-api.service[120989]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Oct 27 03:20:03 2022] *** Oct 27 03:20:03.913503 n-d-862769-1 devstack@n-api.service[120989]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 27 03:20:03.913503 n-d-862769-1 devstack@n-api.service[120989]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 27 03:20:03.913503 n-d-862769-1 devstack@n-api.service[120989]: nodename: n-d-862769-1 Oct 27 03:20:03.913503 n-d-862769-1 devstack@n-api.service[120989]: machine: x86_64 Oct 27 03:20:03.913503 n-d-862769-1 devstack@n-api.service[120989]: clock source: unix Oct 27 03:20:03.913503 n-d-862769-1 devstack@n-api.service[120989]: pcre jit disabled Oct 27 03:20:03.913503 n-d-862769-1 devstack@n-api.service[120989]: detected number of CPU cores: 4 Oct 27 03:20:03.913503 n-d-862769-1 devstack@n-api.service[120989]: current working directory: / Oct 27 03:20:03.913503 n-d-862769-1 devstack@n-api.service[120989]: detected binary path: /usr/bin/uwsgi-core Oct 27 03:20:03.913503 n-d-862769-1 devstack@n-api.service[120989]: your processes number limit is 47680 Oct 27 03:20:03.914436 n-d-862769-1 devstack@n-api.service[120989]: your memory page size is 4096 bytes Oct 27 03:20:03.914436 n-d-862769-1 devstack@n-api.service[120989]: detected max file descriptor number: 2048 Oct 27 03:20:03.914436 n-d-862769-1 devstack@n-api.service[120989]: lock engine: pthread robust mutexes Oct 27 03:20:03.914436 n-d-862769-1 devstack@n-api.service[120989]: thunder lock: enabled Oct 27 03:20:03.914436 n-d-862769-1 devstack@n-api.service[120989]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 27 03:20:03.914436 n-d-862769-1 devstack@n-api.service[120989]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 27 03:20:03.956221 n-d-862769-1 devstack@n-api.service[120989]: Python main interpreter initialized at 0x55f6478559c0 Oct 27 03:20:03.956221 n-d-862769-1 devstack@n-api.service[120989]: python threads support enabled Oct 27 03:20:03.956221 n-d-862769-1 devstack@n-api.service[120989]: your server socket listen backlog is limited to 100 connections Oct 27 03:20:03.956221 n-d-862769-1 devstack@n-api.service[120989]: your mercy for graceful operations on workers is 90 seconds Oct 27 03:20:03.956639 n-d-862769-1 devstack@n-api.service[120989]: mapped 403077 bytes (393 KB) for 2 cores Oct 27 03:20:03.956721 n-d-862769-1 devstack@n-api.service[120989]: *** Operational MODE: preforking *** Oct 27 03:20:03.956931 n-d-862769-1 devstack@n-api.service[120989]: *** uWSGI is running in multiple interpreter mode *** Oct 27 03:20:03.956931 n-d-862769-1 devstack@n-api.service[120989]: spawned uWSGI master process (pid: 120989) Oct 27 03:20:03.957132 n-d-862769-1 systemd[1]: Started Devstack devstack@n-api.service. Oct 27 03:20:03.957735 n-d-862769-1 devstack@n-api.service[120989]: spawned uWSGI worker 1 (pid: 121000, cores: 1) Oct 27 03:20:03.958774 n-d-862769-1 devstack@n-api.service[120989]: spawned uWSGI worker 2 (pid: 121001, cores: 1) Oct 27 03:20:03.959001 n-d-862769-1 devstack@n-api.service[120989]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 27 03:20:04.623049 n-d-862769-1 devstack@n-api.service[121000]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 27 03:20:04.623677 n-d-862769-1 devstack@n-api.service[121001]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 27 03:20:05.910983 n-d-862769-1 devstack@n-api.service[121000]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 03:20:05.910983 n-d-862769-1 devstack@n-api.service[121000]: from cryptography.utils import int_from_bytes Oct 27 03:20:05.911534 n-d-862769-1 devstack@n-api.service[121001]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 03:20:05.911534 n-d-862769-1 devstack@n-api.service[121001]: from cryptography.utils import int_from_bytes Oct 27 03:20:05.911968 n-d-862769-1 devstack@n-api.service[121000]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 03:20:05.911968 n-d-862769-1 devstack@n-api.service[121000]: from cryptography.utils import int_from_bytes Oct 27 03:20:05.912104 n-d-862769-1 devstack@n-api.service[121001]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 03:20:05.912104 n-d-862769-1 devstack@n-api.service[121001]: from cryptography.utils import int_from_bytes Oct 27 03:20:08.366429 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 27 03:20:08.366963 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 27 03:20:08.367143 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 27 03:20:08.367515 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 27 03:20:08.367781 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 27 03:20:08.368177 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.368510 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.368840 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.369167 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.369506 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.369823 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.370179 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.370510 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.370844 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.371110 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.371442 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.371766 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-862769-1 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.372099 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.372424 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.372600 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 27 03:20:08.372999 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.373085 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 27 03:20:08.373157 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.373353 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.373458 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 27 03:20:08.373684 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.373785 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 27 03:20:08.374001 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 27 03:20:08.374136 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.374435 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.374551 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.374775 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.374983 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.375142 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.375306 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.375430 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.375610 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.375767 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.375957 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.376069 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.376279 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.376383 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.376596 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.376710 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.376926 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.377040 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.377810 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.377932 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.378163 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.378289 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.378529 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.378656 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-862769-1 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.378830 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.379000 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-862769-1 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.379150 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.379296 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.379448 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.379604 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.379765 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.379924 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.380072 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.380215 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.380386 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.380542 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.380687 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.380813 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.381124 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.381219 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.381454 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.381625 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.381756 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.381845 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.382120 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.382219 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.382467 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.382619 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.382778 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.382869 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.383098 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.383208 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.383406 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.383513 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.383723 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.383822 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.384041 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.384141 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.384355 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.384460 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.384667 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.384766 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-862769-1 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.384981 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.385085 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.385238 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.385375 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.385552 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.385695 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.385881 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.386148 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.386259 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.386477 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.386579 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.386799 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.386893 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.387052 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.387192 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.387378 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.387480 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.387707 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.387815 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.388023 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.388394 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.388596 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.388700 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.388910 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.389061 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.389228 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.389328 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.389542 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.389634 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.389857 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.389964 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.390196 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.390302 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.390510 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.390648 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.390836 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.390937 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.391154 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.391257 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.391415 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.391507 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.392000 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.392117 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.392204 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.392288 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.392381 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.392475 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.392692 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.392796 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.392979 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.393083 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.393240 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.393377 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.393573 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.393705 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.393906 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.394022 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.394256 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.394366 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.394577 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.394670 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.394895 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.394988 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.395215 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.395321 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.395535 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.395628 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.395852 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.395951 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.396170 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.396271 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.396488 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.396589 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.396826 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.396916 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.397042 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.397144 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.397355 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.397450 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.397684 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.397783 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.397998 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.398140 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.398337 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.398485 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.398652 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.398743 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.398962 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.399067 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.399275 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.399378 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.399591 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.399691 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.399905 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.399999 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.400223 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.400316 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.400538 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.400642 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.400860 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.401006 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.401158 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.401297 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.401436 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.401535 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.401743 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.401880 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.402161 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.402259 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.402501 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.402608 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.402762 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.402854 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.403074 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.403166 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.403389 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.403495 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.403721 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.403814 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.404028 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.404128 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.404343 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.404434 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.404655 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.404747 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.404964 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.405055 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.405282 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.405382 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.405591 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.405683 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.405901 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.406001 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.406245 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.406354 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.406556 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.406662 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.406871 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.406969 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.407185 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.407279 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.407490 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.407640 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.407805 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.407905 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.408115 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.408206 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.408455 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.408556 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.408771 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.408869 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.409084 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.409175 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.409396 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.409499 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.409701 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.409834 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.410013 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.410133 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.410344 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.410444 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.410656 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.410762 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.410966 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.411103 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.411291 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.411391 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.411603 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.411706 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.411917 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.412009 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.412231 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.412363 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.412544 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.412652 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.412855 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.412953 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.413187 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.413287 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.413501 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.413604 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.413821 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.413921 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.414175 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.414284 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.414496 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.414596 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.414813 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.414913 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.415126 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.415219 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.415442 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.415542 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.415756 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.415848 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.416071 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.416163 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.416384 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.416481 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.416698 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.416798 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.417008 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.417122 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.417330 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.417442 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.417656 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.417757 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.417980 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.418105 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.418331 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.418422 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.418645 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.418743 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.418966 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.419072 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 03:20:08.419285 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.419432 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.419612 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.419712 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.419948 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.420052 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.420277 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.420370 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.420597 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.420700 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.420943 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.421038 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.421270 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.421361 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.421595 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.421737 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.421920 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.422021 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.422275 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.422379 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.422595 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.422722 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.422911 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.423059 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.423230 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.423330 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.423560 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.423659 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.423875 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.424470 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.424725 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.424829 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.425054 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.425158 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.425379 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.425480 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.425709 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.425800 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.426028 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.426150 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.426369 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.426476 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.426691 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.426784 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.427013 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.427107 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.427332 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.427436 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.427668 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.427760 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.427989 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.428093 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.428320 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.428427 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.428643 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.428736 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.428963 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.429100 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.429283 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.429383 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.429597 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.429691 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.429915 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.430009 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.430259 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.430357 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.430572 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.430667 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.430887 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.430981 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.431201 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.431329 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.431518 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.431612 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.431831 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.431938 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.432160 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.432296 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.432478 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.432577 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.432797 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.432896 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.433117 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.433217 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.433435 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.433535 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.433755 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.433862 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.434121 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.434241 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.434443 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.434585 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.434760 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.434862 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.435077 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.435169 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.435391 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.435483 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.435708 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.435802 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.436028 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.436138 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.436346 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.436437 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.436658 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.436757 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.436974 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.437068 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.437285 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.437376 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.437600 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.437701 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.437918 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.438011 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.438260 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.438352 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.438582 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.438686 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.438910 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.439004 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.439235 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.439342 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.439556 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.439682 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.440433 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.440530 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.440753 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.440855 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.441072 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.441209 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.441391 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.441491 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.441715 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.441821 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.442058 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.442170 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.442382 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.442484 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.442711 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.442813 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.443025 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.443130 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.443339 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.443440 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.443648 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.443740 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.443962 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.444090 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.444275 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.444404 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.444592 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.444737 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.444906 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.445007 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.445219 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.445314 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.445531 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.445633 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.445842 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.445936 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.446194 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.446301 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.446518 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.446611 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.446828 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.446928 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.447140 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.447242 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.447453 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.447558 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.447763 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.447863 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.448113 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.448215 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.448429 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.448523 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.448769 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.448861 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.449087 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.449193 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.449410 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.449512 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.449729 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.449832 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.450072 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.450181 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.450383 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.450520 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.450697 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.450789 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.451008 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.451099 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.451322 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.451422 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.451631 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.451738 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.451947 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.452075 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.452261 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.452359 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.452590 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.452684 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.452907 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.453007 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.453223 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.453371 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.453537 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.453672 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.453849 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.453943 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.454182 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.454277 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.454507 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.454615 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.454856 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.454956 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.455195 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.455318 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.455543 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.455646 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.455873 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.455971 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.456188 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.456280 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.456511 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.456616 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.456826 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.456926 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.457143 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.457234 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.457456 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.457628 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.457772 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.457871 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.458123 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.458219 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.458442 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.458545 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.458767 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.458861 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.459086 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.459178 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.459414 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.459506 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.459731 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.459865 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.460056 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.460173 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.460366 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.460462 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.460688 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.460790 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.461019 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.461118 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.461362 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.461470 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.461685 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.461776 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.462003 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.462151 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.462354 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.462449 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.462676 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.462770 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.462991 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.463092 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.463309 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.463446 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.463617 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.463708 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.463928 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.464029 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.464245 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.464345 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.464561 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.464660 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.464875 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.464979 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.465194 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.465294 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.465507 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.465600 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.465829 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.465929 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.466171 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.466267 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.466490 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.466584 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.466802 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.466896 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.467120 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.467212 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.467450 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.467546 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.467767 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.467867 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.468085 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.468184 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.468410 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.468558 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.468722 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.468817 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.469032 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.469125 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.469349 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.469447 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.469663 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.469758 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.469973 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.470080 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.470306 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.470407 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.470615 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.470718 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.470962 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.471057 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.471284 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.471386 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.471590 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.471682 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.471912 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.472043 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.472233 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.472340 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.472548 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.472675 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.472859 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.472950 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.473179 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.473290 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.473491 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.473584 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.473818 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.473952 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.474160 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.474266 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.474480 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.474581 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.474799 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.474891 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.475114 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.475240 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.475434 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.475529 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.475749 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.475839 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.476063 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.476156 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.476379 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.476472 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.476693 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.476794 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.477006 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.477098 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.477320 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.477420 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.477639 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.477738 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.477959 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.478077 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.478324 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.478560 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.478659 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.478905 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.478999 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.479232 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.479326 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.479562 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.479701 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.479893 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.479985 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.480218 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.480319 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.480540 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.480661 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.480865 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.480967 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.481181 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.481286 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.481495 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.481588 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.481812 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.481963 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.482155 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.482284 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.482446 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.482568 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.482773 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.482910 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.483089 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.483193 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.483400 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.483500 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.483708 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.483810 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.484027 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.484129 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.484342 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.484599 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.484700 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.484943 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.485045 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.485253 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.485355 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.485576 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.485669 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.485891 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.486009 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.486237 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.486351 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.487076 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.487177 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.487413 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.487506 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.487735 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.487828 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.488051 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.488147 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.488366 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.488461 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.488680 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.488781 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.488995 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.489088 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.489317 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.489420 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.489635 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.489774 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.489957 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.490072 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.490301 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.490396 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.490621 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.490729 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.490937 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.491040 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.491254 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.491354 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.491570 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.491677 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.491880 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.491980 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.492195 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.492295 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.492507 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.492657 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.492818 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.492919 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.493135 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.493230 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.493459 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.493568 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.493774 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.493867 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.494110 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.494209 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.494426 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.494519 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.494734 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.494833 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.495055 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.495188 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.495353 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.495433 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.495680 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.495779 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.495996 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.496099 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.496309 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.496411 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.496623 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.496769 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.496941 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.497038 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.497256 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.497358 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.497566 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.497659 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.497882 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.497991 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.498218 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.498320 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.498541 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.498659 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.498854 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.498956 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.499166 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.499267 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.499480 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.499573 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.499798 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.499900 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.500115 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.500209 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.500426 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.500528 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.500740 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.500842 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.501063 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.501164 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.501373 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.501464 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.501686 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.501826 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.502002 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.502190 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.502884 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.502966 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.503197 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.503291 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.503512 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.503612 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.503827 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.503925 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.504143 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.504245 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.504450 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.504542 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.504761 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.504859 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.505068 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.505162 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.505379 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.505481 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.505690 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.505790 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.506001 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.506114 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.506334 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.506428 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.506645 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.506753 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.506955 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.507056 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.507266 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.507359 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.507582 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.507685 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.507898 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.507990 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.508215 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.508307 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.508528 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.508635 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.508840 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.508933 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.509148 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.509240 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.509468 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.509569 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.509788 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.509881 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.510137 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.510247 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.510457 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.510561 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.510779 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.510880 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.511095 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.511234 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.511410 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.511504 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.511724 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.511830 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.512038 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.512129 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.512346 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.512448 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.512656 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.512755 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.512969 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.513360 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.513537 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.513658 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.513845 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.513965 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.514199 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.514339 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.514514 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.514634 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.514831 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.514961 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.515147 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.515250 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.515461 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.515555 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.515791 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.515882 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.516114 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.516214 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.516427 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.516519 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.516747 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.516839 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.517069 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.517213 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.517394 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.517561 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.517710 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.517808 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.518076 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.518174 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.518377 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.518471 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.518700 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.518804 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.519017 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.519120 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.519334 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.519434 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.519650 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.519752 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.519961 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.520098 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.520276 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.520378 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.520589 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.520697 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.520901 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.520995 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.521226 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.521361 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.521542 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.521644 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.521856 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.521951 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.522209 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.522305 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.522525 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.522635 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.522845 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.522941 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.523159 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.523279 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.523476 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.524831 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.524986 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.525106 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.525220 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.525332 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.525527 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.525652 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.525765 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.525884 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.525998 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.526175 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.526304 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.526419 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.526538 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.526652 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.526771 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.526894 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.527015 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.527128 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.527239 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.527358 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.527470 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.527596 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.527709 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.527828 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.527940 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.528050 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.528171 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.528298 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.528419 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.528531 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.528642 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.528752 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.528871 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.529041 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.529186 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.529501 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.529724 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.529853 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.530142 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.530275 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.530395 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.530511 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.530709 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.530829 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.531037 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.531168 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.531365 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.531486 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.531697 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.531819 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.532027 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.532192 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.532347 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.532517 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.532781 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.532913 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.533110 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.533240 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.533475 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.533633 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.533806 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.533953 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.534153 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.534290 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.534474 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.534610 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.534791 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.534935 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.535124 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.535268 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.535439 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.535574 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.535760 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.535908 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.536079 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.536229 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.536389 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.536533 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.536717 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.536858 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.537047 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.537187 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.537372 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.537516 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.537704 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.537847 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.538110 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.538248 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.538474 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.538624 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.538797 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.538891 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.539128 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.539267 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.539465 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.539560 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.539782 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.539884 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.540101 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.540217 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.540425 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.540539 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.540736 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.540831 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.541050 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.541143 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.541380 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.541528 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.541692 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.541797 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.542010 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.542163 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.542352 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.542448 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.542670 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.542764 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.542982 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.543086 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.543298 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.543400 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.543629 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.543721 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.543938 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.544049 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.544272 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.544379 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.544593 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.544686 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.544923 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.545028 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.545253 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.545360 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.545567 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.545669 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.545901 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.546011 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.546245 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.546339 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.546559 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.546665 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.546873 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.546975 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.547187 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.547279 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.547524 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.547617 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.547834 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.547929 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.548152 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.548245 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.548477 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.548571 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.548806 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.548911 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.549649 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.549752 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.549960 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.550074 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.550337 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.550459 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.550651 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.550746 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.550969 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.551072 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.551295 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.551389 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.551625 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.551725 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.551935 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.552037 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.552248 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.552357 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.552567 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.552669 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.552879 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.552983 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.553192 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.553293 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.553502 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.553602 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.553812 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.553921 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.554145 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.554254 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.554460 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.554566 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.554767 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.554864 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.555098 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.555192 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.555413 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.555516 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.555743 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.555894 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.556063 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.556167 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.556377 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.556472 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.556689 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.556786 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.556999 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.557092 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.557349 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.557441 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.557657 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.557759 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.557989 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.558097 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.558336 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.558448 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.558658 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.558760 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.558973 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.559076 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.559292 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.559394 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.559605 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.559705 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.559928 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.560032 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.560244 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.560353 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.560558 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.560705 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.560874 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.560977 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.561185 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.561288 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.561508 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.561601 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.561828 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.561922 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.562175 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.562283 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.562494 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.562727 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.562822 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.563067 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.563175 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.563392 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.563486 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.563718 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.563857 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.564048 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.564179 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.564368 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.564461 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.565223 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.565340 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.565549 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.565654 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.565872 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.566021 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.566225 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.566328 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.566546 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.566640 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.566871 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.566972 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.567200 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.567302 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.567520 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.567622 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.567861 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.567958 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.568171 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.568266 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.568490 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.568590 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.568815 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.568910 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.569140 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.569371 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.569504 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.569717 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.569818 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.570057 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.570168 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.570405 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.570507 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.570733 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.570835 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.571060 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.571167 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.571381 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.571483 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.571701 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.571840 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.572022 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.572131 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.572337 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.572430 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.572657 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.572761 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.572974 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.573083 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.573294 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.573399 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.573617 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.573712 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.573955 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.574086 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.574311 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.574404 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.574637 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.574753 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.574959 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.575074 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.575278 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.575381 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.575602 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.575696 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.575953 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.576131 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.576268 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.576456 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.576586 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.576798 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.576917 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.577131 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.577247 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.577467 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.577568 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.577793 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.577888 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.578147 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.578244 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.578484 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.578589 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.578801 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.578897 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.579116 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.579218 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.579433 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.579543 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.579750 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.579847 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.580063 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.580156 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.580420 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.580531 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.580740 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.580878 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.581051 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.581146 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.581372 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.581474 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.581684 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.581778 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.582245 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.582340 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.582579 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.582692 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.582918 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.583012 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.583254 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.583354 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.583589 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.583684 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.583916 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.584053 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.584230 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.584323 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.584566 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.584661 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.584882 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.584990 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.585195 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.585308 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.585511 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.585613 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.585826 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.585928 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.586164 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.586262 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.586481 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.586577 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.586805 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.586905 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.587120 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.587226 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.587436 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.587530 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.587752 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.587852 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.588062 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.588298 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.588400 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.588657 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.588750 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.588984 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.589087 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.589297 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.589390 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.589619 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.589713 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.589935 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.590050 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.590277 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.590383 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.590590 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.590692 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.590904 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.591008 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.591224 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.591325 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.591539 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.591634 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.591857 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.591959 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.592167 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.592270 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.592479 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.592579 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.592804 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.592911 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.593125 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.593227 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.593442 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.593543 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.593765 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.593868 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.594106 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.594217 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.594447 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.594549 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.594767 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.594862 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.595085 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.595205 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.595402 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.595506 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.595724 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.596343 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.596567 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.596664 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.596886 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.597023 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.597203 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.597311 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.597520 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.597758 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.597861 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.598127 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.598236 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.598460 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.598555 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.598787 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.598886 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.599109 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.599204 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.599429 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.599522 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.599746 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.599847 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.600060 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.600162 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.600395 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.600493 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.600709 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.600801 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.601026 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.601121 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.601341 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.601433 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.601659 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.601751 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.601973 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.602158 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.602319 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.602417 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.602637 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.602745 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.602951 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.603051 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.603272 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.603369 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.603588 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.603843 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.603938 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.604192 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.604293 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.604513 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.604613 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.604831 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.604927 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.605153 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.605249 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.605489 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.605592 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.605811 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.605912 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.606155 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.606251 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.606481 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.606587 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.606801 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.606894 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.607116 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.607210 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.607435 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.607548 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.607753 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.607849 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.608069 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.608172 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.608391 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.608493 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.608708 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.608802 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.609031 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.609124 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.609341 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.609441 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.609657 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.609749 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.609982 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.610116 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.610331 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.610479 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.610652 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.610754 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.610973 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.611078 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.611298 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.611395 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.612197 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.612301 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.612515 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.612617 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.612845 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.612944 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.613159 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.613259 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.613482 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.613584 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.613804 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.613898 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.614149 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.614260 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.614474 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.614585 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.614796 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.614898 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.615107 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.615209 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.615420 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.615523 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.615739 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.615841 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.616064 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.616163 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.616379 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.616525 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.616680 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.616804 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.616986 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.617132 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.617304 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.617454 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.617617 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.617780 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.617930 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.618140 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.618272 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.618479 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.618576 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.618804 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.618906 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.619140 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.619236 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.619465 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.619568 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.619772 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.619865 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.620084 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.620179 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.620395 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.620490 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.620707 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.620817 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.621022 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.621124 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.621332 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.621428 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.621645 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.621750 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.621953 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.622100 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.622287 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.622381 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.622596 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.622709 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.622935 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.623037 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.623244 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.623337 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.623567 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.623672 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.623885 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.623998 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.624202 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.624305 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.624519 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.624624 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.624834 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.624936 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.626206 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.626305 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.626402 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.626480 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.626561 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.626652 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.626728 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.626799 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.626879 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.626951 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.627021 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.627090 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.627189 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.627262 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.627342 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.627414 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.627621 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.627735 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.627938 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.628042 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.628399 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.628482 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.628572 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.628658 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.628847 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.628953 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.629190 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.629284 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.629537 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.629632 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.629868 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.629976 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.630228 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.630326 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.630554 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.630700 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.630876 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.630972 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.631195 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.631287 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.631519 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.631611 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.631839 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.631946 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.632160 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.632260 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.632476 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.632574 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.632798 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.632894 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.633121 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.633220 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.633437 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.633538 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.633756 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.633850 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.634096 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.634206 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.634421 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.634526 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.634744 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.634838 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.635076 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.635177 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.635397 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.635506 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.635710 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.635811 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.636047 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.636141 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.636377 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.636486 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.636703 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.636804 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.637029 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.637122 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.637353 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.637448 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.637684 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.637785 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.638002 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.638363 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.638600 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.638696 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.638851 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 27 03:20:08.638945 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.639225 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.639551 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.639884 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.640207 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.640530 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.640857 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.641184 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.641524 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.641864 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.642217 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.642559 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.642926 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.643284 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.643640 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.644003 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.644349 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.644680 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.645007 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.645327 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 03:20:08.645581 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 27 03:20:08.703290 n-d-862769-1 devstack@n-api.service[121000]: INFO dbcounter [None req-76573b62-6f97-4583-a883-85cdaf0d017c None None] Registered counter for database nova_api Oct 27 03:20:08.709207 n-d-862769-1 devstack@n-api.service[121001]: INFO dbcounter [None req-2f8a83fd-39f1-43b5-ac1c-63e6eb6cc3ee None None] Registered counter for database nova_api Oct 27 03:20:08.723997 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_db.sqlalchemy.engines [None req-76573b62-6f97-4583-a883-85cdaf0d017c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121000) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 03:20:08.729550 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_db.sqlalchemy.engines [None req-2f8a83fd-39f1-43b5-ac1c-63e6eb6cc3ee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121001) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 03:20:08.730835 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writer thread running {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 03:20:08.736193 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writer thread running {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 03:20:08.788270 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.context [None req-76573b62-6f97-4583-a883-85cdaf0d017c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d4405804-b3fd-4c57-a074-5c4e2aef7c93(cell1) {{(pid=121000) load_cells /opt/stack/nova/nova/context.py:464}} Oct 27 03:20:08.792329 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-76573b62-6f97-4583-a883-85cdaf0d017c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:20:08.792809 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-76573b62-6f97-4583-a883-85cdaf0d017c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:20:08.793937 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.context [None req-2f8a83fd-39f1-43b5-ac1c-63e6eb6cc3ee None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d4405804-b3fd-4c57-a074-5c4e2aef7c93(cell1) {{(pid=121001) load_cells /opt/stack/nova/nova/context.py:464}} Oct 27 03:20:08.794459 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-76573b62-6f97-4583-a883-85cdaf0d017c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:20:08.795180 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-76573b62-6f97-4583-a883-85cdaf0d017c None None] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:20:08.795640 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-76573b62-6f97-4583-a883-85cdaf0d017c None None] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:20:08.797647 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-76573b62-6f97-4583-a883-85cdaf0d017c None None] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:20:08.798019 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2f8a83fd-39f1-43b5-ac1c-63e6eb6cc3ee None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:20:08.798530 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2f8a83fd-39f1-43b5-ac1c-63e6eb6cc3ee None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:20:08.800266 n-d-862769-1 devstack@n-api.service[121000]: INFO dbcounter [None req-76573b62-6f97-4583-a883-85cdaf0d017c None None] Registered counter for database nova_cell0 Oct 27 03:20:08.800741 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2f8a83fd-39f1-43b5-ac1c-63e6eb6cc3ee None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:20:08.801480 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2f8a83fd-39f1-43b5-ac1c-63e6eb6cc3ee None None] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:20:08.801948 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2f8a83fd-39f1-43b5-ac1c-63e6eb6cc3ee None None] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:20:08.804111 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2f8a83fd-39f1-43b5-ac1c-63e6eb6cc3ee None None] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:20:08.804641 n-d-862769-1 devstack@n-api.service[121000]: INFO dbcounter [None req-76573b62-6f97-4583-a883-85cdaf0d017c None None] Registered counter for database nova_cell1 Oct 27 03:20:08.806212 n-d-862769-1 devstack@n-api.service[121001]: INFO dbcounter [None req-2f8a83fd-39f1-43b5-ac1c-63e6eb6cc3ee None None] Registered counter for database nova_cell0 Oct 27 03:20:08.810696 n-d-862769-1 devstack@n-api.service[121001]: INFO dbcounter [None req-2f8a83fd-39f1-43b5-ac1c-63e6eb6cc3ee None None] Registered counter for database nova_cell1 Oct 27 03:20:08.813866 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_db.sqlalchemy.engines [None req-76573b62-6f97-4583-a883-85cdaf0d017c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121000) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 03:20:08.814969 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_db.sqlalchemy.engines [None req-76573b62-6f97-4583-a883-85cdaf0d017c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121000) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 03:20:08.818998 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_db.sqlalchemy.engines [None req-2f8a83fd-39f1-43b5-ac1c-63e6eb6cc3ee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121001) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 03:20:08.820006 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_db.sqlalchemy.engines [None req-2f8a83fd-39f1-43b5-ac1c-63e6eb6cc3ee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121001) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 03:20:08.826128 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writer thread running {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 03:20:08.827181 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writer thread running {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 03:20:08.827469 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writer thread running {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 03:20:08.828531 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writer thread running {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 03:20:08.976491 n-d-862769-1 devstack@n-api.service[121000]: INFO dbcounter [None req-76573b62-6f97-4583-a883-85cdaf0d017c None None] Registered counter for database nova_cell0 Oct 27 03:20:08.980125 n-d-862769-1 devstack@n-api.service[121001]: INFO dbcounter [None req-2f8a83fd-39f1-43b5-ac1c-63e6eb6cc3ee None None] Registered counter for database nova_cell0 Oct 27 03:20:08.984329 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_db.sqlalchemy.engines [None req-76573b62-6f97-4583-a883-85cdaf0d017c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121000) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 03:20:08.988541 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_db.sqlalchemy.engines [None req-2f8a83fd-39f1-43b5-ac1c-63e6eb6cc3ee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121001) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 03:20:08.992259 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writer thread running {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 03:20:08.993185 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writer thread running {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 03:20:09.317594 n-d-862769-1 devstack@n-api.service[121000]: WARNING keystonemiddleware.auth_token [None req-76573b62-6f97-4583-a883-85cdaf0d017c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 27 03:20:09.319454 n-d-862769-1 devstack@n-api.service[121001]: WARNING keystonemiddleware.auth_token [None req-2f8a83fd-39f1-43b5-ac1c-63e6eb6cc3ee None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 27 03:20:09.325027 n-d-862769-1 devstack@n-api.service[121000]: WARNING keystonemiddleware.auth_token [None req-76573b62-6f97-4583-a883-85cdaf0d017c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 27 03:20:09.326833 n-d-862769-1 devstack@n-api.service[121001]: WARNING keystonemiddleware.auth_token [None req-2f8a83fd-39f1-43b5-ac1c-63e6eb6cc3ee None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 27 03:20:09.669992 n-d-862769-1 devstack@n-api.service[121001]: WARNING keystonemiddleware.auth_token [None req-2f8a83fd-39f1-43b5-ac1c-63e6eb6cc3ee None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 27 03:20:09.670659 n-d-862769-1 devstack@n-api.service[121000]: WARNING keystonemiddleware.auth_token [None req-76573b62-6f97-4583-a883-85cdaf0d017c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 27 03:20:09.675994 n-d-862769-1 devstack@n-api.service[121001]: WARNING keystonemiddleware.auth_token [None req-2f8a83fd-39f1-43b5-ac1c-63e6eb6cc3ee None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 27 03:20:09.676632 n-d-862769-1 devstack@n-api.service[121000]: WARNING keystonemiddleware.auth_token [None req-76573b62-6f97-4583-a883-85cdaf0d017c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 27 03:20:09.681296 n-d-862769-1 devstack@n-api.service[121001]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f6478559c0 pid: 121001 (default app) Oct 27 03:20:09.681868 n-d-862769-1 devstack@n-api.service[121000]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f6478559c0 pid: 121000 (default app) Oct 27 03:20:50.194380 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=3 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:20:50.195472 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=3 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:20:50.196357 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=3 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:20:50.197310 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=3 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:20:52.192528 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4094cc0a-1f1f-4e4c-8516-71cb6d6cc88a tempest-FlavorsAdminTestJSON-1932224061 tempest-FlavorsAdminTestJSON-1932224061-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1348545799", "id": 900446818, "os-flavor-access:is_public": "True"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:20:52.301042 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4094cc0a-1f1f-4e4c-8516-71cb6d6cc88a tempest-FlavorsAdminTestJSON-1932224061 tempest-FlavorsAdminTestJSON-1932224061-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 2.114547 Oct 27 03:20:52.301775 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1/1] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:20:50 2022] POST /compute/v2.1/flavors => generated 427 bytes in 2117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:20:52.326513 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4094cc0a-1f1f-4e4c-8516-71cb6d6cc88a tempest-FlavorsAdminTestJSON-1932224061 tempest-FlavorsAdminTestJSON-1932224061-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:20:52.327727 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4094cc0a-1f1f-4e4c-8516-71cb6d6cc88a tempest-FlavorsAdminTestJSON-1932224061 tempest-FlavorsAdminTestJSON-1932224061-project-admin] 10.222.0.20 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001670 Oct 27 03:20:52.328446 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2/2] 10.222.0.20 () {56 vars in 886 bytes} [Thu Oct 27 03:20:52 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 27 03:20:52.537022 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6f838a6d-4b97-4d68-abf8-3104dc4fcede tempest-FlavorsAdminTestJSON-1932224061 tempest-FlavorsAdminTestJSON-1932224061-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:20:52.540210 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=3 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:20:52.541045 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=3 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:20:52.541731 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=3 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:20:52.542451 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=3 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:20:52.643119 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6f838a6d-4b97-4d68-abf8-3104dc4fcede tempest-FlavorsAdminTestJSON-1932224061 tempest-FlavorsAdminTestJSON-1932224061-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/900446818" status: 202 len: 0 microversion: 2.1 time: 0.327788 Oct 27 03:20:52.644981 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1/3] 10.222.0.20 () {58 vars in 1158 bytes} [Thu Oct 27 03:20:52 2022] DELETE /compute/v2.1/flavors/900446818 => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:20:52.652954 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-15379d6c-4cc4-4d8c-bcb2-8b0bc7f349f9 tempest-FlavorsAdminTestJSON-1932224061 tempest-FlavorsAdminTestJSON-1932224061-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:20:52.686960 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-15379d6c-4cc4-4d8c-bcb2-8b0bc7f349f9 tempest-FlavorsAdminTestJSON-1932224061 tempest-FlavorsAdminTestJSON-1932224061-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.038355 Oct 27 03:20:52.687901 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2/4] 10.222.0.20 () {58 vars in 1146 bytes} [Thu Oct 27 03:20:52 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:20:52.707963 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9db8ce18-dc7c-4475-89db-26d74e32fb31 tempest-FlavorsAdminTestJSON-1932224061 tempest-FlavorsAdminTestJSON-1932224061-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-539731644", "id": 1818321016, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:20:52.849046 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9db8ce18-dc7c-4475-89db-26d74e32fb31 tempest-FlavorsAdminTestJSON-1932224061 tempest-FlavorsAdminTestJSON-1932224061-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.145294 Oct 27 03:20:52.849633 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3/5] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:20:52 2022] POST /compute/v2.1/flavors => generated 416 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:20:53.197584 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-adbace30-6232-47ca-98c6-bc1b85f0d5dd tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:20:53.201146 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-adbace30-6232-47ca-98c6-bc1b85f0d5dd tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:20:53.201623 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-adbace30-6232-47ca-98c6-bc1b85f0d5dd tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:20:53.202092 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-adbace30-6232-47ca-98c6-bc1b85f0d5dd tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:20:53.202802 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-adbace30-6232-47ca-98c6-bc1b85f0d5dd tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:20:53.203282 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-adbace30-6232-47ca-98c6-bc1b85f0d5dd tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:20:53.204242 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-adbace30-6232-47ca-98c6-bc1b85f0d5dd tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:20:53.245447 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-adbace30-6232-47ca-98c6-bc1b85f0d5dd tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.676211 Oct 27 03:20:53.246213 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3/6] 10.222.0.20 () {58 vars in 1176 bytes} [Thu Oct 27 03:20:52 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:20:53.251234 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f3f1c546-b641-4cae-a617-c358938a3f8d tempest-FlavorsAdminTestJSON-1932224061 tempest-FlavorsAdminTestJSON-1932224061-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:20:53.287731 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f3f1c546-b641-4cae-a617-c358938a3f8d tempest-FlavorsAdminTestJSON-1932224061 tempest-FlavorsAdminTestJSON-1932224061-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5397 microversion: 2.1 time: 0.040465 Oct 27 03:20:53.288864 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4/7] 10.222.0.20 () {58 vars in 1146 bytes} [Thu Oct 27 03:20:53 2022] GET /compute/v2.1/flavors/detail => generated 5397 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:20:53.530985 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-cf4277b8-38a5-48a3-83a0-5522ee341201 tempest-AggregatesAdminTestV241-1154059494 tempest-AggregatesAdminTestV241-1154059494-project-admin] Calling method '.version_select at 0x7f7ddc381ca0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:20:53.540383 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-cf4277b8-38a5-48a3-83a0-5522ee341201 tempest-AggregatesAdminTestV241-1154059494 tempest-AggregatesAdminTestV241-1154059494-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d4405804-b3fd-4c57-a074-5c4e2aef7c93(cell1) {{(pid=121001) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 27 03:20:53.541438 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cf4277b8-38a5-48a3-83a0-5522ee341201 tempest-AggregatesAdminTestV241-1154059494 tempest-AggregatesAdminTestV241-1154059494-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:20:53.543949 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cf4277b8-38a5-48a3-83a0-5522ee341201 tempest-AggregatesAdminTestV241-1154059494 tempest-AggregatesAdminTestV241-1154059494-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:20:53.544607 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cf4277b8-38a5-48a3-83a0-5522ee341201 tempest-AggregatesAdminTestV241-1154059494 tempest-AggregatesAdminTestV241-1154059494-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:20:53.576226 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cf4277b8-38a5-48a3-83a0-5522ee341201 tempest-AggregatesAdminTestV241-1154059494 tempest-AggregatesAdminTestV241-1154059494-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:20:53.576936 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cf4277b8-38a5-48a3-83a0-5522ee341201 tempest-AggregatesAdminTestV241-1154059494 tempest-AggregatesAdminTestV241-1154059494-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:20:53.577370 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cf4277b8-38a5-48a3-83a0-5522ee341201 tempest-AggregatesAdminTestV241-1154059494 tempest-AggregatesAdminTestV241-1154059494-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:20:53.590079 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cf4277b8-38a5-48a3-83a0-5522ee341201 tempest-AggregatesAdminTestV241-1154059494 tempest-AggregatesAdminTestV241-1154059494-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:20:53.590600 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cf4277b8-38a5-48a3-83a0-5522ee341201 tempest-AggregatesAdminTestV241-1154059494 tempest-AggregatesAdminTestV241-1154059494-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:20:53.591047 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cf4277b8-38a5-48a3-83a0-5522ee341201 tempest-AggregatesAdminTestV241-1154059494 tempest-AggregatesAdminTestV241-1154059494-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:20:53.597806 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-cf4277b8-38a5-48a3-83a0-5522ee341201 tempest-AggregatesAdminTestV241-1154059494 tempest-AggregatesAdminTestV241-1154059494-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 0.306942 Oct 27 03:20:53.598430 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 5/8] 10.222.0.20 () {60 vars in 1208 bytes} [Thu Oct 27 03:20:53 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:20:53.602673 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e711df7f-f8fe-4e60-920e-8504ac2418bf tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1890940939"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:20:53.606177 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.aggregate [None req-e711df7f-f8fe-4e60-920e-8504ac2418bf tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] Generated uuid 22b8f859-ad03-419a-ba7c-346c537c2147 for aggregate {{(pid=121001) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 27 03:20:53.647161 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c675bdb8-0642-4b9c-9ed4-b5bfac1ad333 tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Calling method '.version_select at 0x7f7ddcd57430>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:20:53.653634 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c675bdb8-0642-4b9c-9ed4-b5bfac1ad333 tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d4405804-b3fd-4c57-a074-5c4e2aef7c93(cell1) {{(pid=121000) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 27 03:20:53.654397 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c675bdb8-0642-4b9c-9ed4-b5bfac1ad333 tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:20:53.654873 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c675bdb8-0642-4b9c-9ed4-b5bfac1ad333 tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:20:53.655355 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c675bdb8-0642-4b9c-9ed4-b5bfac1ad333 tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:20:53.688818 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c675bdb8-0642-4b9c-9ed4-b5bfac1ad333 tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:20:53.689312 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c675bdb8-0642-4b9c-9ed4-b5bfac1ad333 tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:20:53.689752 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c675bdb8-0642-4b9c-9ed4-b5bfac1ad333 tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:20:53.703967 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c675bdb8-0642-4b9c-9ed4-b5bfac1ad333 tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:20:53.704680 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c675bdb8-0642-4b9c-9ed4-b5bfac1ad333 tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:20:53.705901 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c675bdb8-0642-4b9c-9ed4-b5bfac1ad333 tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:20:53.720102 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c675bdb8-0642-4b9c-9ed4-b5bfac1ad333 tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.868460 Oct 27 03:20:53.720729 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 4/9] 10.222.0.20 () {58 vars in 1167 bytes} [Thu Oct 27 03:20:52 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:20:53.739784 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e711df7f-f8fe-4e60-920e-8504ac2418bf tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.140170 Oct 27 03:20:53.740874 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 6/10] 10.222.0.20 () {60 vars in 1164 bytes} [Thu Oct 27 03:20:53 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:20:53.745850 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7b565b1a-82f3-4323-bb1c-e44ca82e0559 tempest-FlavorsAdminTestJSON-1932224061 tempest-FlavorsAdminTestJSON-1932224061-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:20:53.818523 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7b565b1a-82f3-4323-bb1c-e44ca82e0559 tempest-FlavorsAdminTestJSON-1932224061 tempest-FlavorsAdminTestJSON-1932224061-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1818321016" status: 202 len: 0 microversion: 2.1 time: 0.076355 Oct 27 03:20:53.819591 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 7/11] 10.222.0.20 () {58 vars in 1161 bytes} [Thu Oct 27 03:20:53 2022] DELETE /compute/v2.1/flavors/1818321016 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:20:53.926444 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5a15f6de-50cb-4826-8f7a-e14fde1d95c0 tempest-FlavorsAccessTestJSON-869807247 tempest-FlavorsAccessTestJSON-869807247-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-898007471", "id": 1682554486, "os-flavor-access:is_public": "False"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:20:53.964409 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ccd9f967-dc00-451f-afbc-e6623d37c10b tempest-FlavorsV255TestJSON-978651288 tempest-FlavorsV255TestJSON-978651288-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1928482085", "id": 404942551, "os-flavor-access:is_public": "True"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:20:54.015192 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5a15f6de-50cb-4826-8f7a-e14fde1d95c0 tempest-FlavorsAccessTestJSON-869807247 tempest-FlavorsAccessTestJSON-869807247-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.292572 Oct 27 03:20:54.015815 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 5/12] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:20:53 2022] POST /compute/v2.1/flavors => generated 430 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:20:54.021259 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-31ad0687-f301-4568-a32d-682b81dff60c tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-862769-1"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:20:54.040507 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ccd9f967-dc00-451f-afbc-e6623d37c10b tempest-FlavorsV255TestJSON-978651288 tempest-FlavorsV255TestJSON-978651288-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 446 microversion: 2.55 time: 0.219694 Oct 27 03:20:54.042887 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 8/13] 10.222.0.20 () {62 vars in 1188 bytes} [Thu Oct 27 03:20:53 2022] POST /compute/v2.1/flavors => generated 446 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 03:20:54.045552 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f3db3cd0-e75b-4793-9b94-1720a128c3b5 tempest-FlavorsAdminTestJSON-1932224061 tempest-FlavorsAdminTestJSON-1932224061-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:20:54.053468 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-31ad0687-f301-4568-a32d-682b81dff60c tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:20:54.053961 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-31ad0687-f301-4568-a32d-682b81dff60c tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:20:54.054552 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-31ad0687-f301-4568-a32d-682b81dff60c tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:20:54.065197 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f3db3cd0-e75b-4793-9b94-1720a128c3b5 tempest-FlavorsAdminTestJSON-1932224061 tempest-FlavorsAdminTestJSON-1932224061-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5406 microversion: 2.1 time: 0.023023 Oct 27 03:20:54.065746 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 9/14] 10.222.0.20 () {58 vars in 1146 bytes} [Thu Oct 27 03:20:54 2022] GET /compute/v2.1/flavors/detail => generated 5406 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:20:54.070254 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-94f6ce4e-939d-42f5-9fe4-d89025d7dd2b tempest-FlavorsAccessTestJSON-869807247 tempest-FlavorsAccessTestJSON-869807247-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "3c57cd10266e45f78f55210ba1bbb288"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:20:54.480203 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-94f6ce4e-939d-42f5-9fe4-d89025d7dd2b tempest-FlavorsAccessTestJSON-869807247 tempest-FlavorsAccessTestJSON-869807247-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/1682554486/action" status: 200 len: 97 microversion: 2.1 time: 0.413317 Oct 27 03:20:54.480813 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 10/15] 10.222.0.20 () {60 vars in 1200 bytes} [Thu Oct 27 03:20:54 2022] POST /compute/v2.1/flavors/1682554486/action => generated 97 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 03:20:54.917896 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6cf1c355-eeaa-44d8-8d6d-b86e63a11f35 tempest-FlavorsV255TestJSON-15004229 tempest-FlavorsV255TestJSON-15004229-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:20:54.934286 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6cf1c355-eeaa-44d8-8d6d-b86e63a11f35 tempest-FlavorsV255TestJSON-15004229 tempest-FlavorsV255TestJSON-15004229-project] 10.222.0.20 "GET /compute/v2.1/flavors/404942551" status: 200 len: 446 microversion: 2.55 time: 0.452395 Oct 27 03:20:54.935554 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 11/16] 10.222.0.20 () {60 vars in 1196 bytes} [Thu Oct 27 03:20:54 2022] GET /compute/v2.1/flavors/404942551 => generated 446 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 03:20:54.954614 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-370b661c-4b0c-423b-b2e5-541fc80bf062 tempest-FlavorsAdminTestJSON-1932224061 tempest-FlavorsAdminTestJSON-1932224061-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-276651533", "id": 972607914, "os-flavor-access:is_public": "True"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:20:55.014890 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-370b661c-4b0c-423b-b2e5-541fc80bf062 tempest-FlavorsAdminTestJSON-1932224061 tempest-FlavorsAdminTestJSON-1932224061-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.077914 Oct 27 03:20:55.015952 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 12/17] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:20:54 2022] POST /compute/v2.1/flavors => generated 425 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:20:55.110252 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-31ad0687-f301-4568-a32d-682b81dff60c tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 242 microversion: 2.1 time: 1.091932 Oct 27 03:20:55.118161 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 6/18] 10.222.0.20 () {60 vars in 1191 bytes} [Thu Oct 27 03:20:54 2022] POST /compute/v2.1/os-aggregates/1/action => generated 242 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:20:55.118161 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-82bbde63-224d-44e5-b537-edd6fdd1c959 tempest-FlavorsV255TestJSON-978651288 tempest-FlavorsV255TestJSON-978651288-project-admin] Action: 'update', calling method: .version_select at 0x7f7ddc8bdb80>, body: {"flavor": {"description": "new"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:20:55.231767 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7b520bbd-96b8-4038-a356-5e5f62d12702 tempest-FlavorsAccessTestJSON-1027789606 tempest-FlavorsAccessTestJSON-1027789606-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:20:55.263479 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7b520bbd-96b8-4038-a356-5e5f62d12702 tempest-FlavorsAccessTestJSON-1027789606 tempest-FlavorsAccessTestJSON-1027789606-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 6241 microversion: 2.1 time: 0.245821 Oct 27 03:20:55.264229 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 13/19] 10.222.0.20 () {58 vars in 1146 bytes} [Thu Oct 27 03:20:55 2022] GET /compute/v2.1/flavors/detail => generated 6241 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:20:55.268909 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-06857acf-20e7-47dc-89be-e6b41058fef2 tempest-FlavorsAdminTestJSON-1932224061 tempest-FlavorsAdminTestJSON-1932224061-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:20:55.276766 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-82bbde63-224d-44e5-b537-edd6fdd1c959 tempest-FlavorsV255TestJSON-978651288 tempest-FlavorsV255TestJSON-978651288-project-admin] 10.222.0.20 "PUT /compute/v2.1/flavors/404942551" status: 200 len: 447 microversion: 2.55 time: 0.164604 Oct 27 03:20:55.277596 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 7/20] 10.222.0.20 () {62 vars in 1216 bytes} [Thu Oct 27 03:20:55 2022] PUT /compute/v2.1/flavors/404942551 => generated 447 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 03:20:55.283217 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-00820e37-2925-4f2c-8b6e-e7d64729bc3b tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-862769-1"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:20:55.294999 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-00820e37-2925-4f2c-8b6e-e7d64729bc3b tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:20:55.295556 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-00820e37-2925-4f2c-8b6e-e7d64729bc3b tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:20:55.296105 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-00820e37-2925-4f2c-8b6e-e7d64729bc3b tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:20:55.378571 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-00820e37-2925-4f2c-8b6e-e7d64729bc3b tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] HTTP exception thrown: Aggregate 1 already has host n-h2-862769-1. Oct 27 03:20:55.393695 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-00820e37-2925-4f2c-8b6e-e7d64729bc3b tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] Request method failure captured: Oct 27 03:20:55.393695 n-d-862769-1 devstack@n-api.service[121000]: request: POST /compute/v2.1/os-aggregates/1/action HTTP/1.1 Oct 27 03:20:55.393695 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:20:55.393695 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:20:55.393695 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:20:55.393695 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 39 Oct 27 03:20:55.393695 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:20:55.393695 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:20:55.393695 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:20:55.393695 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:20:55.393695 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfkUPNyHvG53Iz2jDxQ105aaFZTzTDDp3MI39q4PIqaZkicxPfZhVy3H6_7mDmIDIExdcPYhXBlN1v4Beb0N2H6ozvZizLFmZbN-oxgVTvWJ32yYegOOG46IUg1BMPU_du_KhLWkhPcTY10RB2M4MFGbcgYscU9M-CSa95eCdZfqZE4 Oct 27 03:20:55.393695 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:20:55.393695 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:20:55.393695 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:20:55.393695 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:20:55.393695 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:20:55.393695 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:20:55.393695 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 80aae888f8984fab9d12c5304427c794 Oct 27 03:20:55.393695 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1608777148 Oct 27 03:20:55.393695 n-d-862769-1 devstack@n-api.service[121000]: X-Role: admin,member,reader Oct 27 03:20:55.393695 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: admin,member,reader Oct 27 03:20:55.394819 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/80aae888f8984fab9d12c5304427c794"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/80aae888f8984fab9d12c5304427c794"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/80aae888f8984fab9d12c5304427c794"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_80aae888f8984fab9d12c5304427c794"}]}] Oct 27 03:20:55.394819 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1608777148 Oct 27 03:20:55.394819 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 80aae888f8984fab9d12c5304427c794 Oct 27 03:20:55.394819 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1608777148 Oct 27 03:20:55.394819 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin Oct 27 03:20:55.394819 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:20:55.394819 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:20:55.394819 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: fb130d3fbf88475ab63f87ce203d563f Oct 27 03:20:55.394819 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin Oct 27 03:20:55.394819 n-d-862769-1 devstack@n-api.service[121000]: Oct 27 03:20:55.394819 n-d-862769-1 devstack@n-api.service[121000]: {"add_host": {"host": "n-h2-862769-1"}} Oct 27 03:20:55.394819 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:20:55.394819 n-d-862769-1 devstack@n-api.service[121000]: exception: Aggregate 1 already has host n-h2-862769-1. Oct 27 03:20:55.395576 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '1', 'body': {'add_host': {'host': 'n-h2-862769-1'}}} Oct 27 03:20:55.395576 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:20:55.395576 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:20:55.395576 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 27 03:20:55.395576 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 27 03:20:55.395576 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 27 03:20:55.395576 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 27 03:20:55.395576 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 27 03:20:55.395576 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 27 03:20:55.395576 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 27 03:20:55.395576 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 27 03:20:55.395576 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 27 03:20:55.395576 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 27 03:20:55.395576 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 27 03:20:55.395576 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi result.read() Oct 27 03:20:55.395576 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 27 03:20:55.395576 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 27 03:20:55.395576 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 27 03:20:55.395576 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 27 03:20:55.396440 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 27 03:20:55.396440 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 27 03:20:55.396440 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 27 03:20:55.396440 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 27 03:20:55.396440 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h2-862769-1-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 27 03:20:55.396440 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:20:55.396440 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 27 03:20:55.396440 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:20:55.396440 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:20:55.396440 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Oct 27 03:20:55.396440 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Oct 27 03:20:55.396440 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 27 03:20:55.396440 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi session.flush() Oct 27 03:20:55.396440 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 27 03:20:55.396440 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 27 03:20:55.396440 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 27 03:20:55.396440 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 27 03:20:55.396440 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 27 03:20:55.396440 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 27 03:20:55.397306 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 27 03:20:55.397306 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception Oct 27 03:20:55.397306 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 27 03:20:55.397306 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 27 03:20:55.397306 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 27 03:20:55.397306 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 27 03:20:55.397306 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 27 03:20:55.397306 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 27 03:20:55.397306 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 27 03:20:55.397306 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 27 03:20:55.397306 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 27 03:20:55.397306 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 27 03:20:55.397306 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 27 03:20:55.397306 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 27 03:20:55.397306 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 27 03:20:55.397306 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 27 03:20:55.397306 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 27 03:20:55.397306 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 27 03:20:55.398947 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 27 03:20:55.398947 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 27 03:20:55.398947 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 27 03:20:55.398947 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 27 03:20:55.398947 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 27 03:20:55.398947 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception Oct 27 03:20:55.398947 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 27 03:20:55.398947 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 27 03:20:55.398947 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 27 03:20:55.398947 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 27 03:20:55.398947 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 27 03:20:55.398947 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 27 03:20:55.398947 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 27 03:20:55.398947 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 27 03:20:55.398947 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 27 03:20:55.398947 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 27 03:20:55.398947 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 27 03:20:55.398947 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi result.read() Oct 27 03:20:55.400918 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 27 03:20:55.400918 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 27 03:20:55.400918 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 27 03:20:55.400918 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 27 03:20:55.400918 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 27 03:20:55.400918 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 27 03:20:55.400918 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 27 03:20:55.400918 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 27 03:20:55.400918 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h2-862769-1-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 27 03:20:55.400918 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Oct 27 03:20:55.400918 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 27, 3, 20, 55, 311677), 'updated_at': None, 'host': 'n-h2-862769-1', 'aggregate_id': 1}] Oct 27 03:20:55.400918 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 27 03:20:55.400918 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:20:55.400918 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:20:55.400918 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:20:55.400918 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:20:55.400918 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 27 03:20:55.402567 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 27 03:20:55.402567 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 27 03:20:55.402567 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 27 03:20:55.402567 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 03:20:55.402567 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 03:20:55.402567 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 03:20:55.402567 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 03:20:55.402567 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 27 03:20:55.402567 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 27 03:20:55.402567 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in add_host_to_aggregate Oct 27 03:20:55.402567 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Oct 27 03:20:55.402567 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 27 03:20:55.402567 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 27 03:20:55.402567 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Oct 27 03:20:55.402567 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Oct 27 03:20:55.402567 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Oct 27 03:20:55.402567 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Oct 27 03:20:55.402567 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 1 already has host n-h2-862769-1. Oct 27 03:20:55.402567 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:20:55.402567 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:20:55.403706 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:20:55.403706 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:20:55.403706 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:20:55.403706 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:20:55.403706 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:20:55.403706 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:20:55.403706 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:20:55.403706 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:20:55.403706 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:20:55.403706 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:20:55.403706 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Oct 27 03:20:55.403706 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 27 03:20:55.403706 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 1 already has host n-h2-862769-1. Oct 27 03:20:55.403706 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:20:55.403706 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:20:55.403706 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:20:55.403706 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:20:55.403706 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:20:55.403706 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:20:55.403706 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:20:55.403706 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:20:55.404867 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 1 already has host n-h2-862769-1. Oct 27 03:20:55.404867 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:20:55.404867 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-00820e37-2925-4f2c-8b6e-e7d64729bc3b tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] Returning 409 to user: Aggregate 1 already has host n-h2-862769-1. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:20:55.404867 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-00820e37-2925-4f2c-8b6e-e7d64729bc3b tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/1/action" status: 409 len: 95 microversion: 2.1 time: 0.116578 Oct 27 03:20:55.404867 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 8/21] 10.222.0.20 () {60 vars in 1191 bytes} [Thu Oct 27 03:20:55 2022] POST /compute/v2.1/os-aggregates/1/action => generated 95 bytes in 118 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Oct 27 03:20:55.404867 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-cf960604-f580-464b-b835-ab970826c92a tempest-FlavorsAccessTestJSON-869807247 tempest-FlavorsAccessTestJSON-869807247-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "3c57cd10266e45f78f55210ba1bbb288"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:20:55.412336 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-06857acf-20e7-47dc-89be-e6b41058fef2 tempest-FlavorsAdminTestJSON-1932224061 tempest-FlavorsAdminTestJSON-1932224061-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/972607914" status: 202 len: 0 microversion: 2.1 time: 0.146883 Oct 27 03:20:55.416380 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 14/22] 10.222.0.20 () {58 vars in 1158 bytes} [Thu Oct 27 03:20:55 2022] DELETE /compute/v2.1/flavors/972607914 => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:20:55.417632 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4a2add72-9583-4ec3-b7a7-c641c116ae63 tempest-FlavorsV255TestJSON-15004229 tempest-FlavorsV255TestJSON-15004229-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:20:55.446463 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4a2add72-9583-4ec3-b7a7-c641c116ae63 tempest-FlavorsV255TestJSON-15004229 tempest-FlavorsV255TestJSON-15004229-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5722 microversion: 2.55 time: 0.032325 Oct 27 03:20:55.447356 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 15/23] 10.222.0.20 () {60 vars in 1187 bytes} [Thu Oct 27 03:20:55 2022] GET /compute/v2.1/flavors/detail => generated 5722 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:20:55.584542 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-19255863-705f-4e76-a466-2bc270c0f70e tempest-AZAdminV2TestJSON-1147766562 tempest-AZAdminV2TestJSON-1147766562-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:20:55.586170 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-19255863-705f-4e76-a466-2bc270c0f70e tempest-AZAdminV2TestJSON-1147766562 tempest-AZAdminV2TestJSON-1147766562-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:20:55.586748 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-19255863-705f-4e76-a466-2bc270c0f70e tempest-AZAdminV2TestJSON-1147766562 tempest-AZAdminV2TestJSON-1147766562-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:20:55.587079 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-19255863-705f-4e76-a466-2bc270c0f70e tempest-AZAdminV2TestJSON-1147766562 tempest-AZAdminV2TestJSON-1147766562-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:20:55.588258 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-19255863-705f-4e76-a466-2bc270c0f70e tempest-AZAdminV2TestJSON-1147766562 tempest-AZAdminV2TestJSON-1147766562-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:20:55.588975 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-19255863-705f-4e76-a466-2bc270c0f70e tempest-AZAdminV2TestJSON-1147766562 tempest-AZAdminV2TestJSON-1147766562-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:20:55.589406 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-19255863-705f-4e76-a466-2bc270c0f70e tempest-AZAdminV2TestJSON-1147766562 tempest-AZAdminV2TestJSON-1147766562-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:20:55.614121 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-19255863-705f-4e76-a466-2bc270c0f70e tempest-AZAdminV2TestJSON-1147766562 tempest-AZAdminV2TestJSON-1147766562-project-admin] 10.222.0.20 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.165559 Oct 27 03:20:55.614699 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 16/24] 10.222.0.20 () {58 vars in 1164 bytes} [Thu Oct 27 03:20:55 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 03:20:55.619206 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-938345af-faa9-4f39-bbd6-33cf202fb1bd tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-862769-1"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:20:55.630526 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-938345af-faa9-4f39-bbd6-33cf202fb1bd tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:20:55.631021 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-938345af-faa9-4f39-bbd6-33cf202fb1bd tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:20:55.631467 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-938345af-faa9-4f39-bbd6-33cf202fb1bd tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:20:55.664062 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-cf960604-f580-464b-b835-ab970826c92a tempest-FlavorsAccessTestJSON-869807247 tempest-FlavorsAccessTestJSON-869807247-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/1682554486/action" status: 200 len: 21 microversion: 2.1 time: 0.267130 Oct 27 03:20:55.670124 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 9/25] 10.222.0.20 () {60 vars in 1200 bytes} [Thu Oct 27 03:20:55 2022] POST /compute/v2.1/flavors/1682554486/action => generated 21 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 03:20:55.675512 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c974fa37-4c88-428b-a3a4-957f01084a1e tempest-FlavorsAdminTestJSON-1932224061 tempest-FlavorsAdminTestJSON-1932224061-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:20:55.697050 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c974fa37-4c88-428b-a3a4-957f01084a1e tempest-FlavorsAdminTestJSON-1932224061 tempest-FlavorsAdminTestJSON-1932224061-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5406 microversion: 2.1 time: 0.029571 Oct 27 03:20:55.697809 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 10/26] 10.222.0.20 () {58 vars in 1146 bytes} [Thu Oct 27 03:20:55 2022] GET /compute/v2.1/flavors/detail => generated 5406 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:20:55.702421 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-82aa5fb4-2933-41f4-ae58-208a93357116 tempest-FlavorsV255TestJSON-15004229 tempest-FlavorsV255TestJSON-15004229-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:20:55.733432 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-82aa5fb4-2933-41f4-ae58-208a93357116 tempest-FlavorsV255TestJSON-15004229 tempest-FlavorsV255TestJSON-15004229-project] 10.222.0.20 "GET /compute/v2.1/flavors" status: 200 len: 3154 microversion: 2.55 time: 0.034386 Oct 27 03:20:55.734007 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 11/27] 10.222.0.20 () {60 vars in 1166 bytes} [Thu Oct 27 03:20:55 2022] GET /compute/v2.1/flavors => generated 3154 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:20:55.738629 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8e4b8bc8-09a7-4faa-be3e-1cdecca59348 tempest-AZAdminV2TestJSON-1147766562 tempest-AZAdminV2TestJSON-1147766562-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:20:55.740487 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8e4b8bc8-09a7-4faa-be3e-1cdecca59348 tempest-AZAdminV2TestJSON-1147766562 tempest-AZAdminV2TestJSON-1147766562-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:20:55.741117 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8e4b8bc8-09a7-4faa-be3e-1cdecca59348 tempest-AZAdminV2TestJSON-1147766562 tempest-AZAdminV2TestJSON-1147766562-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:20:55.741705 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8e4b8bc8-09a7-4faa-be3e-1cdecca59348 tempest-AZAdminV2TestJSON-1147766562 tempest-AZAdminV2TestJSON-1147766562-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:20:55.743072 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8e4b8bc8-09a7-4faa-be3e-1cdecca59348 tempest-AZAdminV2TestJSON-1147766562 tempest-AZAdminV2TestJSON-1147766562-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:20:55.743826 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8e4b8bc8-09a7-4faa-be3e-1cdecca59348 tempest-AZAdminV2TestJSON-1147766562 tempest-AZAdminV2TestJSON-1147766562-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:20:55.744615 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8e4b8bc8-09a7-4faa-be3e-1cdecca59348 tempest-AZAdminV2TestJSON-1147766562 tempest-AZAdminV2TestJSON-1147766562-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:20:55.785289 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8e4b8bc8-09a7-4faa-be3e-1cdecca59348 tempest-AZAdminV2TestJSON-1147766562 tempest-AZAdminV2TestJSON-1147766562-project-admin] 10.222.0.20 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.050097 Oct 27 03:20:55.794409 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 12/28] 10.222.0.20 () {58 vars in 1185 bytes} [Thu Oct 27 03:20:55 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:20:55.799197 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-33a6857e-ab50-433d-a345-3b608679f74e tempest-FlavorsAccessTestJSON-1027789606 tempest-FlavorsAccessTestJSON-1027789606-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:20:55.830409 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-33a6857e-ab50-433d-a345-3b608679f74e tempest-FlavorsAccessTestJSON-1027789606 tempest-FlavorsAccessTestJSON-1027789606-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5406 microversion: 2.1 time: 0.024823 Oct 27 03:20:55.830409 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 13/29] 10.222.0.20 () {58 vars in 1146 bytes} [Thu Oct 27 03:20:55 2022] GET /compute/v2.1/flavors/detail => generated 5406 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:20:55.830409 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9de8cc92-17e3-477b-abb1-e17a6aa4847c tempest-FlavorsAdminTestJSON-1932224061 tempest-FlavorsAdminTestJSON-1932224061-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-280662563", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:20:55.910234 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9de8cc92-17e3-477b-abb1-e17a6aa4847c tempest-FlavorsAdminTestJSON-1932224061 tempest-FlavorsAdminTestJSON-1932224061-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.088241 Oct 27 03:20:55.910836 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 14/30] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:20:55 2022] POST /compute/v2.1/flavors => generated 506 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:20:55.915167 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c7dfcc4c-c88b-44a0-bca7-3298c20b812d tempest-FlavorsV255TestJSON-978651288 tempest-FlavorsV255TestJSON-978651288-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:20:55.989949 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c7dfcc4c-c88b-44a0-bca7-3298c20b812d tempest-FlavorsV255TestJSON-978651288 tempest-FlavorsV255TestJSON-978651288-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/404942551" status: 202 len: 0 microversion: 2.55 time: 0.078035 Oct 27 03:20:55.993756 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 15/31] 10.222.0.20 () {60 vars in 1199 bytes} [Thu Oct 27 03:20:55 2022] DELETE /compute/v2.1/flavors/404942551 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:20:55.995310 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6eee7916-248d-412f-bd16-c6374d081b68 tempest-FlavorsAccessTestJSON-869807247 tempest-FlavorsAccessTestJSON-869807247-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:20:56.109970 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6eee7916-248d-412f-bd16-c6374d081b68 tempest-FlavorsAccessTestJSON-869807247 tempest-FlavorsAccessTestJSON-869807247-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1682554486" status: 202 len: 0 microversion: 2.1 time: 0.118119 Oct 27 03:20:56.110617 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 16/32] 10.222.0.20 () {58 vars in 1161 bytes} [Thu Oct 27 03:20:55 2022] DELETE /compute/v2.1/flavors/1682554486 => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:20:56.115272 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-716b1118-1942-48a2-859f-6f01cd84a933 tempest-FlavorsAdminTestJSON-1932224061 tempest-FlavorsAdminTestJSON-1932224061-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:20:56.230124 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-716b1118-1942-48a2-859f-6f01cd84a933 tempest-FlavorsAdminTestJSON-1932224061 tempest-FlavorsAdminTestJSON-1932224061-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/a4b683b2-72a4-4247-8a49-97ca3071c6eb" status: 202 len: 0 microversion: 2.1 time: 0.118354 Oct 27 03:20:56.238215 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 17/33] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:20:56 2022] DELETE /compute/v2.1/flavors/a4b683b2-72a4-4247-8a49-97ca3071c6eb => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:20:56.239609 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-938345af-faa9-4f39-bbd6-33cf202fb1bd tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 227 microversion: 2.1 time: 0.622907 Oct 27 03:20:56.240607 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 17/34] 10.222.0.20 () {60 vars in 1191 bytes} [Thu Oct 27 03:20:55 2022] POST /compute/v2.1/os-aggregates/1/action => generated 227 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:20:56.247794 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-15cac0c8-f6de-4855-b863-b8b2af2a8cbf tempest-FlavorsAccessTestJSON-869807247 tempest-FlavorsAccessTestJSON-869807247-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:20:56.253802 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e407d3f8-88b7-4516-a54f-4831ecf0b9ec tempest-FlavorsV255TestJSON-978651288 tempest-FlavorsV255TestJSON-978651288-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:20:56.272436 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-15cac0c8-f6de-4855-b863-b8b2af2a8cbf tempest-FlavorsAccessTestJSON-869807247 tempest-FlavorsAccessTestJSON-869807247-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.030112 Oct 27 03:20:56.273640 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 18/35] 10.222.0.20 () {58 vars in 1146 bytes} [Thu Oct 27 03:20:56 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:20:56.278472 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-600a8c52-87b7-471d-bf61-e80765bbb71d tempest-FlavorsAdminTestJSON-1932224061 tempest-FlavorsAdminTestJSON-1932224061-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:20:56.279620 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e407d3f8-88b7-4516-a54f-4831ecf0b9ec tempest-FlavorsV255TestJSON-978651288 tempest-FlavorsV255TestJSON-978651288-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.038299 Oct 27 03:20:56.292076 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 18/36] 10.222.0.20 () {60 vars in 1187 bytes} [Thu Oct 27 03:20:56 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:20:56.296832 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-343d038f-d29f-4264-a0ae-ebd3af6f2297 tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:20:56.318593 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-600a8c52-87b7-471d-bf61-e80765bbb71d tempest-FlavorsAdminTestJSON-1932224061 tempest-FlavorsAdminTestJSON-1932224061-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.043512 Oct 27 03:20:56.319476 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 19/37] 10.222.0.20 () {58 vars in 1146 bytes} [Thu Oct 27 03:20:56 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:20:56.324136 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d5384cf0-809d-422f-9361-9b3eaf7b2a87 tempest-FlavorsAccessTestJSON-869807247 tempest-FlavorsAccessTestJSON-869807247-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-652939272", "id": 1990626246, "os-flavor-access:is_public": "False"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:20:56.370439 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-343d038f-d29f-4264-a0ae-ebd3af6f2297 tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.077079 Oct 27 03:20:56.371350 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 19/38] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Oct 27 03:20:56 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 27 03:20:56.378094 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-50b7ce84-7b83-43d0-b71f-82238f2bd4e7 tempest-FlavorsAdminTestJSON-1932224061 tempest-FlavorsAdminTestJSON-1932224061-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-359758197", "id": "616f198c-5fbd-4635-8446-69ab9c1e8421", "os-flavor-access:is_public": "True"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:20:56.400993 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d5384cf0-809d-422f-9361-9b3eaf7b2a87 tempest-FlavorsAccessTestJSON-869807247 tempest-FlavorsAccessTestJSON-869807247-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.080161 Oct 27 03:20:56.401593 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 20/39] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:20:56 2022] POST /compute/v2.1/flavors => generated 430 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:20:56.406131 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6fa1c043-beb6-45a3-99a3-817068d6cca1 tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-142047244"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:20:56.409477 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.aggregate [None req-6fa1c043-beb6-45a3-99a3-817068d6cca1 tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] Generated uuid 67292b5c-9c65-4ffe-b5fb-4527ba68d4d3 for aggregate {{(pid=121001) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 27 03:20:56.511984 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-50b7ce84-7b83-43d0-b71f-82238f2bd4e7 tempest-FlavorsAdminTestJSON-1932224061 tempest-FlavorsAdminTestJSON-1932224061-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.126706 Oct 27 03:20:56.512077 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6fa1c043-beb6-45a3-99a3-817068d6cca1 tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.096719 Oct 27 03:20:56.512155 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 20/40] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:20:56 2022] POST /compute/v2.1/flavors => generated 506 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:20:56.512228 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 21/41] 10.222.0.20 () {60 vars in 1164 bytes} [Thu Oct 27 03:20:56 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:20:56.512323 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-245efb88-f2ca-49b4-b21f-d7386a91a61f tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1581762686", "name": "tempest-test_aggregate-574679980"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:20:56.512411 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-224b22ab-1588-4435-83fb-d3e2727e15ff tempest-FlavorsAccessTestJSON-869807247 tempest-FlavorsAccessTestJSON-869807247-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:20:56.524467 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-224b22ab-1588-4435-83fb-d3e2727e15ff tempest-FlavorsAccessTestJSON-869807247 tempest-FlavorsAccessTestJSON-869807247-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/1990626246/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.021837 Oct 27 03:20:56.525029 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 22/42] 10.222.0.20 () {58 vars in 1209 bytes} [Thu Oct 27 03:20:56 2022] GET /compute/v2.1/flavors/1990626246/os-flavor-access => generated 21 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 03:20:56.527136 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.aggregate [None req-245efb88-f2ca-49b4-b21f-d7386a91a61f tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Generated uuid 00bafe3a-d0be-4765-9b22-cebbc72b3a7d for aggregate {{(pid=121000) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 27 03:20:56.534259 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5c698f6f-bee9-412b-9d1d-9175ac09b643 tempest-FlavorsAdminTestJSON-1932224061 tempest-FlavorsAdminTestJSON-1932224061-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:20:56.539865 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=77,nova_api:DELETE=15,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:20:56.658541 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5c698f6f-bee9-412b-9d1d-9175ac09b643 tempest-FlavorsAdminTestJSON-1932224061 tempest-FlavorsAdminTestJSON-1932224061-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/616f198c-5fbd-4635-8446-69ab9c1e8421" status: 202 len: 0 microversion: 2.1 time: 0.132087 Oct 27 03:20:56.659663 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 23/43] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:20:56 2022] DELETE /compute/v2.1/flavors/616f198c-5fbd-4635-8446-69ab9c1e8421 => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:20:56.694746 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-245efb88-f2ca-49b4-b21f-d7386a91a61f tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.193068 Oct 27 03:20:56.696193 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 21/44] 10.222.0.20 () {60 vars in 1165 bytes} [Thu Oct 27 03:20:56 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:20:56.702734 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8a6d8a1f-c8f2-42d2-9bd0-3f1afdc85b88 tempest-FlavorsAccessTestJSON-869807247 tempest-FlavorsAccessTestJSON-869807247-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:20:56.789763 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8a6d8a1f-c8f2-42d2-9bd0-3f1afdc85b88 tempest-FlavorsAccessTestJSON-869807247 tempest-FlavorsAccessTestJSON-869807247-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1990626246" status: 202 len: 0 microversion: 2.1 time: 0.092201 Oct 27 03:20:56.790393 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 22/45] 10.222.0.20 () {58 vars in 1161 bytes} [Thu Oct 27 03:20:56 2022] DELETE /compute/v2.1/flavors/1990626246 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:20:56.794764 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-84543a93-c5f3-4459-a8f2-1d219d4245f4 tempest-FlavorsAdminTestJSON-1932224061 tempest-FlavorsAdminTestJSON-1932224061-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:20:56.814266 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-84543a93-c5f3-4459-a8f2-1d219d4245f4 tempest-FlavorsAdminTestJSON-1932224061 tempest-FlavorsAdminTestJSON-1932224061-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.022748 Oct 27 03:20:56.814854 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 23/46] 10.222.0.20 () {58 vars in 1146 bytes} [Thu Oct 27 03:20:56 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:20:56.819103 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-15c909ce-dfdd-4ac1-bd32-f2c1a25efdd0 tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:20:56.830883 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-15c909ce-dfdd-4ac1-bd32-f2c1a25efdd0 tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates" status: 200 len: 515 microversion: 2.1 time: 0.015033 Oct 27 03:20:56.831444 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 24/47] 10.222.0.20 () {58 vars in 1143 bytes} [Thu Oct 27 03:20:56 2022] GET /compute/v2.1/os-aggregates => generated 515 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:20:56.836114 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5d86336a-4d49-450a-9527-364ddacd73c8 tempest-FlavorsAccessTestJSON-869807247 tempest-FlavorsAccessTestJSON-869807247-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:20:56.856697 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5d86336a-4d49-450a-9527-364ddacd73c8 tempest-FlavorsAccessTestJSON-869807247 tempest-FlavorsAccessTestJSON-869807247-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024076 Oct 27 03:20:56.857286 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 25/48] 10.222.0.20 () {58 vars in 1146 bytes} [Thu Oct 27 03:20:56 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:20:56.862218 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c08c9710-80dc-454a-8d68-e15b45896a69 tempest-FlavorsAdminTestJSON-1932224061 tempest-FlavorsAdminTestJSON-1932224061-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1642584159", "id": 1075226112, "os-flavor-access:is_public": "True"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:20:56.898102 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-75e4828f-4b00-4287-8a97-bbcec07e4d76 tempest-AggregatesAdminNegativeTestJSON-390850425 tempest-AggregatesAdminNegativeTestJSON-390850425-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-862769-1"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:20:56.915014 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-75e4828f-4b00-4287-8a97-bbcec07e4d76 tempest-AggregatesAdminNegativeTestJSON-390850425 tempest-AggregatesAdminNegativeTestJSON-390850425-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '747002f449e641f0a7d2c0f38cf541a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873ceb34cf6548fdb54bdd7c39c9318b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:20:56.937052 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-75e4828f-4b00-4287-8a97-bbcec07e4d76 tempest-AggregatesAdminNegativeTestJSON-390850425 tempest-AggregatesAdminNegativeTestJSON-390850425-project] Request method failure captured: Oct 27 03:20:56.937052 n-d-862769-1 devstack@n-api.service[121001]: request: POST /compute/v2.1/os-aggregates/2/action HTTP/1.1 Oct 27 03:20:56.937052 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:20:56.937052 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:20:56.937052 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:20:56.937052 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 39 Oct 27 03:20:56.937052 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:20:56.937052 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:20:56.937052 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:20:56.937052 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:20:56.937052 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfkR6RrqRjTzB6Sywu_WxoyDAr4cYOxqYR1D8Ag31CrSn9lbqjp5txWGOjhQpamUvPH6aGlc5Ah7hQPxBhK9L8hlYJtA6Nkf3F-iblfpzgSg3WrTMmiADZHi1XyOT-ieTIvMXXO_ltZSB_QUy0QU8rHXk67od6_pY6Vgt2D0frE4r1s Oct 27 03:20:56.937052 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:20:56.937052 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:20:56.937052 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:20:56.937052 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:20:56.937052 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:20:56.937052 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:20:56.937052 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 873ceb34cf6548fdb54bdd7c39c9318b Oct 27 03:20:56.937052 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-390850425 Oct 27 03:20:56.937052 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:20:56.937052 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:20:56.938421 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/873ceb34cf6548fdb54bdd7c39c9318b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/873ceb34cf6548fdb54bdd7c39c9318b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/873ceb34cf6548fdb54bdd7c39c9318b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_873ceb34cf6548fdb54bdd7c39c9318b"}]}] Oct 27 03:20:56.938421 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-390850425 Oct 27 03:20:56.938421 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 873ceb34cf6548fdb54bdd7c39c9318b Oct 27 03:20:56.938421 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-390850425 Oct 27 03:20:56.938421 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-AggregatesAdminNegativeTestJSON-390850425-project Oct 27 03:20:56.938421 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:20:56.938421 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:20:56.938421 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 747002f449e641f0a7d2c0f38cf541a0 Oct 27 03:20:56.938421 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-390850425-project Oct 27 03:20:56.938421 n-d-862769-1 devstack@n-api.service[121001]: Oct 27 03:20:56.938421 n-d-862769-1 devstack@n-api.service[121001]: {"add_host": {"host": "n-h2-862769-1"}} Oct 27 03:20:56.938421 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:20:56.938421 n-d-862769-1 devstack@n-api.service[121001]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 27 03:20:56.939196 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '2', 'body': {'add_host': {'host': 'n-h2-862769-1'}}} Oct 27 03:20:56.939196 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:20:56.939196 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:20:56.939196 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:20:56.939196 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:20:56.939196 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:20:56.939196 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:20:56.939196 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:20:56.939196 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:20:56.939196 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:20:56.939196 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:20:56.939196 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Oct 27 03:20:56.939196 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Oct 27 03:20:56.939196 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 03:20:56.939196 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 03:20:56.939196 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 03:20:56.939196 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 03:20:56.939196 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 03:20:56.939196 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 03:20:56.940273 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 03:20:56.940273 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 03:20:56.940273 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 03:20:56.940273 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 03:20:56.940273 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 03:20:56.940273 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 03:20:56.940273 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 03:20:56.940273 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 03:20:56.940273 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 27 03:20:56.940273 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:20:56.940273 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:20:56.940273 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:20:56.940273 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:20:56.940273 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:20:56.940273 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:20:56.940273 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 03:20:56.940273 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 03:20:56.940273 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 27 03:20:56.940273 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:20:56.941382 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-75e4828f-4b00-4287-8a97-bbcec07e4d76 tempest-AggregatesAdminNegativeTestJSON-390850425 tempest-AggregatesAdminNegativeTestJSON-390850425-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:20:56.941382 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-75e4828f-4b00-4287-8a97-bbcec07e4d76 tempest-AggregatesAdminNegativeTestJSON-390850425 tempest-AggregatesAdminNegativeTestJSON-390850425-project] 10.222.0.20 "POST /compute/v2.1/os-aggregates/2/action" status: 403 len: 118 microversion: 2.1 time: 0.265475 Oct 27 03:20:56.941382 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 24/49] 10.222.0.20 () {60 vars in 1191 bytes} [Thu Oct 27 03:20:56 2022] POST /compute/v2.1/os-aggregates/2/action => generated 118 bytes in 267 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:20:56.941382 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8fee23ac-3d78-4791-9b3f-ef4fc43f057c tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-862769-1"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:20:56.946336 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8fee23ac-3d78-4791-9b3f-ef4fc43f057c tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:20:56.946831 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8fee23ac-3d78-4791-9b3f-ef4fc43f057c tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:20:56.947273 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8fee23ac-3d78-4791-9b3f-ef4fc43f057c tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:20:56.968676 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=7,nova_api:DELETE=10 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:20:57.001233 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c08c9710-80dc-454a-8d68-e15b45896a69 tempest-FlavorsAdminTestJSON-1932224061 tempest-FlavorsAdminTestJSON-1932224061-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.142882 Oct 27 03:20:57.001838 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 26/50] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:20:56 2022] POST /compute/v2.1/flavors => generated 414 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:20:57.006407 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c3f9bcb1-e3e8-4cfc-8e29-41d7510f3adc tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:20:57.104916 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c3f9bcb1-e3e8-4cfc-8e29-41d7510f3adc tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.101877 Oct 27 03:20:57.105605 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 27/51] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Oct 27 03:20:57 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 27 03:20:57.110367 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-60b846ad-94f0-4c99-9a56-057e453a040a tempest-FlavorsAdminTestJSON-1932224061 tempest-FlavorsAdminTestJSON-1932224061-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:20:57.117874 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-60b846ad-94f0-4c99-9a56-057e453a040a tempest-FlavorsAdminTestJSON-1932224061 tempest-FlavorsAdminTestJSON-1932224061-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/1075226112" status: 200 len: 414 microversion: 2.1 time: 0.011142 Oct 27 03:20:57.123309 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 28/52] 10.222.0.20 () {58 vars in 1158 bytes} [Thu Oct 27 03:20:57 2022] GET /compute/v2.1/flavors/1075226112 => generated 414 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:20:57.123309 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b5fc4693-bdec-4094-9bbd-f050555e6748 tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-13437406"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:20:57.126714 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.aggregate [None req-b5fc4693-bdec-4094-9bbd-f050555e6748 tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] Generated uuid 38644fa9-62e3-4519-b383-972b2af030b6 for aggregate {{(pid=121000) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 27 03:20:57.216579 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b5fc4693-bdec-4094-9bbd-f050555e6748 tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 196 microversion: 2.1 time: 0.096782 Oct 27 03:20:57.218803 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 29/53] 10.222.0.20 () {60 vars in 1164 bytes} [Thu Oct 27 03:20:57 2022] POST /compute/v2.1/os-aggregates => generated 196 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:20:57.274958 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8fee23ac-3d78-4791-9b3f-ef4fc43f057c tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 314 microversion: 2.1 time: 0.346639 Oct 27 03:20:57.275527 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 25/54] 10.222.0.20 () {60 vars in 1191 bytes} [Thu Oct 27 03:20:56 2022] POST /compute/v2.1/os-aggregates/3/action => generated 314 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:20:57.279875 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d43cfe07-cc25-442c-91b3-5a0ad7436142 tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-846372113"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:20:57.290367 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d43cfe07-cc25-442c-91b3-5a0ad7436142 tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:20:57.290832 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d43cfe07-cc25-442c-91b3-5a0ad7436142 tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:20:57.291274 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d43cfe07-cc25-442c-91b3-5a0ad7436142 tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:20:57.298998 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d43cfe07-cc25-442c-91b3-5a0ad7436142 tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:20:57.299478 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d43cfe07-cc25-442c-91b3-5a0ad7436142 tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:20:57.299919 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d43cfe07-cc25-442c-91b3-5a0ad7436142 tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:20:57.310840 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-d43cfe07-cc25-442c-91b3-5a0ad7436142 tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-846372113 could not be found. Oct 27 03:20:57.316424 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d43cfe07-cc25-442c-91b3-5a0ad7436142 tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] Request method failure captured: Oct 27 03:20:57.316424 n-d-862769-1 devstack@n-api.service[121001]: request: POST /compute/v2.1/os-aggregates/4/action HTTP/1.1 Oct 27 03:20:57.316424 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:20:57.316424 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:20:57.316424 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:20:57.316424 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 57 Oct 27 03:20:57.316424 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:20:57.316424 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:20:57.316424 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:20:57.316424 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:20:57.316424 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfkUPNyHvG53Iz2jDxQ105aaFZTzTDDp3MI39q4PIqaZkicxPfZhVy3H6_7mDmIDIExdcPYhXBlN1v4Beb0N2H6ozvZizLFmZbN-oxgVTvWJ32yYegOOG46IUg1BMPU_du_KhLWkhPcTY10RB2M4MFGbcgYscU9M-CSa95eCdZfqZE4 Oct 27 03:20:57.316424 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:20:57.316424 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:20:57.316424 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:20:57.316424 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:20:57.316424 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:20:57.316424 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:20:57.316424 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 80aae888f8984fab9d12c5304427c794 Oct 27 03:20:57.316424 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1608777148 Oct 27 03:20:57.316424 n-d-862769-1 devstack@n-api.service[121001]: X-Role: admin,member,reader Oct 27 03:20:57.316424 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: admin,member,reader Oct 27 03:20:57.319098 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/80aae888f8984fab9d12c5304427c794"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/80aae888f8984fab9d12c5304427c794"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/80aae888f8984fab9d12c5304427c794"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_80aae888f8984fab9d12c5304427c794"}]}] Oct 27 03:20:57.319098 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1608777148 Oct 27 03:20:57.319098 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 80aae888f8984fab9d12c5304427c794 Oct 27 03:20:57.319098 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1608777148 Oct 27 03:20:57.319098 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin Oct 27 03:20:57.319098 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:20:57.319098 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:20:57.319098 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: fb130d3fbf88475ab63f87ce203d563f Oct 27 03:20:57.319098 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin Oct 27 03:20:57.319098 n-d-862769-1 devstack@n-api.service[121001]: Oct 27 03:20:57.319098 n-d-862769-1 devstack@n-api.service[121001]: {"add_host": {"host": "tempest-nonexist_host-846372113"}} Oct 27 03:20:57.319098 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:20:57.320013 n-d-862769-1 devstack@n-api.service[121001]: exception: Compute host tempest-nonexist_host-846372113 could not be found. Oct 27 03:20:57.320013 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '4', 'body': {'add_host': {'host': 'tempest-nonexist_host-846372113'}}} Oct 27 03:20:57.320013 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:20:57.320013 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:20:57.320013 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 27 03:20:57.320013 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 27 03:20:57.320013 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 03:20:57.320013 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 03:20:57.320013 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 27 03:20:57.320013 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 27 03:20:57.320013 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 03:20:57.320013 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 03:20:57.320013 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 27 03:20:57.320013 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 27 03:20:57.320013 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-846372113' is not mapped to any cell Oct 27 03:20:57.320013 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:20:57.320013 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:20:57.320013 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:20:57.320013 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:20:57.320013 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 27 03:20:57.321176 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 27 03:20:57.321176 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 27 03:20:57.321176 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 27 03:20:57.321176 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 27 03:20:57.321176 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:20:57.321176 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:20:57.321176 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:20:57.321176 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:20:57.321176 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 27 03:20:57.321176 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 27 03:20:57.321176 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 27 03:20:57.321176 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 27 03:20:57.321176 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 03:20:57.321176 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 03:20:57.321176 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 03:20:57.321176 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 03:20:57.321176 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 27 03:20:57.321176 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 27 03:20:57.321176 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6621, in add_host_to_aggregate Oct 27 03:20:57.321176 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Oct 27 03:20:57.322363 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 27 03:20:57.322363 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 27 03:20:57.322363 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-846372113 could not be found. Oct 27 03:20:57.322363 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:20:57.322363 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:20:57.322363 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:20:57.322363 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:20:57.322363 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:20:57.322363 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:20:57.322363 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:20:57.322363 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:20:57.322363 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:20:57.322363 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:20:57.322363 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:20:57.322363 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:20:57.322363 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Oct 27 03:20:57.322363 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:20:57.322363 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-846372113 could not be found. Oct 27 03:20:57.322363 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:20:57.322363 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:20:57.322363 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:20:57.323667 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:20:57.323667 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:20:57.323667 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:20:57.323667 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:20:57.323667 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:20:57.323667 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-846372113 could not be found. Oct 27 03:20:57.323667 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:20:57.323667 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d43cfe07-cc25-442c-91b3-5a0ad7436142 tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-846372113 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:20:57.323667 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d43cfe07-cc25-442c-91b3-5a0ad7436142 tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/4/action" status: 404 len: 110 microversion: 2.1 time: 0.041436 Oct 27 03:20:57.323667 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 26/55] 10.222.0.20 () {60 vars in 1191 bytes} [Thu Oct 27 03:20:57 2022] POST /compute/v2.1/os-aggregates/4/action => generated 110 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:20:57.326353 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1a2f6bd8-2c5d-4bfb-a973-4741310d356b tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:20:57.417070 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1a2f6bd8-2c5d-4bfb-a973-4741310d356b tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.093830 Oct 27 03:20:57.417983 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 27/56] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Oct 27 03:20:57 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 27 03:20:57.426877 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-44431616-0594-40e6-bb35-37262b2db429 tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:20:57.431788 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-44431616-0594-40e6-bb35-37262b2db429 tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] Request method failure captured: Oct 27 03:20:57.431788 n-d-862769-1 devstack@n-api.service[121001]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 27 03:20:57.431788 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:20:57.431788 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:20:57.431788 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:20:57.431788 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 283 Oct 27 03:20:57.431788 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:20:57.431788 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:20:57.431788 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:20:57.431788 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:20:57.431788 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfkUPNyHvG53Iz2jDxQ105aaFZTzTDDp3MI39q4PIqaZkicxPfZhVy3H6_7mDmIDIExdcPYhXBlN1v4Beb0N2H6ozvZizLFmZbN-oxgVTvWJ32yYegOOG46IUg1BMPU_du_KhLWkhPcTY10RB2M4MFGbcgYscU9M-CSa95eCdZfqZE4 Oct 27 03:20:57.431788 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:20:57.431788 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:20:57.431788 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:20:57.431788 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:20:57.431788 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:20:57.431788 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:20:57.431788 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 80aae888f8984fab9d12c5304427c794 Oct 27 03:20:57.431788 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1608777148 Oct 27 03:20:57.431788 n-d-862769-1 devstack@n-api.service[121001]: X-Role: admin,member,reader Oct 27 03:20:57.431788 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: admin,member,reader Oct 27 03:20:57.434328 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/80aae888f8984fab9d12c5304427c794"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/80aae888f8984fab9d12c5304427c794"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/80aae888f8984fab9d12c5304427c794"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_80aae888f8984fab9d12c5304427c794"}]}] Oct 27 03:20:57.434328 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1608777148 Oct 27 03:20:57.434328 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 80aae888f8984fab9d12c5304427c794 Oct 27 03:20:57.434328 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1608777148 Oct 27 03:20:57.434328 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin Oct 27 03:20:57.434328 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:20:57.434328 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:20:57.434328 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: fb130d3fbf88475ab63f87ce203d563f Oct 27 03:20:57.434328 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin Oct 27 03:20:57.434328 n-d-862769-1 devstack@n-api.service[121001]: Oct 27 03:20:57.434815 n-d-862769-1 devstack@n-api.service[121001]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 27 03:20:57.434815 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:20:57.434815 n-d-862769-1 devstack@n-api.service[121001]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 27 03:20:57.434815 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 27 03:20:57.434815 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:20:57.434815 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:20:57.434815 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 03:20:57.434815 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 03:20:57.434815 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 03:20:57.434815 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise error Oct 27 03:20:57.435393 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 27 03:20:57.435393 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:20:57.435393 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Oct 27 03:20:57.435393 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 27 03:20:57.435393 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:20:57.435393 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 27 03:20:57.435393 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 27 03:20:57.435393 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:20:57.435393 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:20:57.435393 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:20:57.435393 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:20:57.435393 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:20:57.435393 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:20:57.435393 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:20:57.435393 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:20:57.435393 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:20:57.435393 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:20:57.436186 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:20:57.436186 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:20:57.436186 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 03:20:57.436186 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 03:20:57.436186 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 03:20:57.436186 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 03:20:57.436186 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 03:20:57.436186 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 03:20:57.436186 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 27 03:20:57.436186 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:20:57.436186 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:20:57.436186 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:20:57.436186 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:20:57.436186 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:20:57.436186 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:20:57.436891 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 03:20:57.436891 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 03:20:57.436891 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 27 03:20:57.436891 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:20:57.436891 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-44431616-0594-40e6-bb35-37262b2db429 tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:20:57.437173 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-44431616-0594-40e6-bb35-37262b2db429 tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.010419 Oct 27 03:20:57.437173 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 28/57] 10.222.0.20 () {60 vars in 1165 bytes} [Thu Oct 27 03:20:57 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 03:20:57.447025 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7ba897af-17af-49b5-b8a3-64beb5d0808e tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:20:57.451328 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7ba897af-17af-49b5-b8a3-64beb5d0808e tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] Request method failure captured: Oct 27 03:20:57.451328 n-d-862769-1 devstack@n-api.service[121001]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 27 03:20:57.451328 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:20:57.451328 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:20:57.451328 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:20:57.451328 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 27 Oct 27 03:20:57.451328 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:20:57.451328 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:20:57.451328 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:20:57.451328 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:20:57.451328 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfkUPNyHvG53Iz2jDxQ105aaFZTzTDDp3MI39q4PIqaZkicxPfZhVy3H6_7mDmIDIExdcPYhXBlN1v4Beb0N2H6ozvZizLFmZbN-oxgVTvWJ32yYegOOG46IUg1BMPU_du_KhLWkhPcTY10RB2M4MFGbcgYscU9M-CSa95eCdZfqZE4 Oct 27 03:20:57.451328 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:20:57.451328 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:20:57.451328 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:20:57.451328 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:20:57.451328 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:20:57.451328 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:20:57.451328 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 80aae888f8984fab9d12c5304427c794 Oct 27 03:20:57.451328 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1608777148 Oct 27 03:20:57.451328 n-d-862769-1 devstack@n-api.service[121001]: X-Role: admin,member,reader Oct 27 03:20:57.451328 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: admin,member,reader Oct 27 03:20:57.452385 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/80aae888f8984fab9d12c5304427c794"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/80aae888f8984fab9d12c5304427c794"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/80aae888f8984fab9d12c5304427c794"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_80aae888f8984fab9d12c5304427c794"}]}] Oct 27 03:20:57.452385 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1608777148 Oct 27 03:20:57.452385 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 80aae888f8984fab9d12c5304427c794 Oct 27 03:20:57.452385 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1608777148 Oct 27 03:20:57.452385 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin Oct 27 03:20:57.452385 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:20:57.452385 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:20:57.452385 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: fb130d3fbf88475ab63f87ce203d563f Oct 27 03:20:57.452385 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin Oct 27 03:20:57.452385 n-d-862769-1 devstack@n-api.service[121001]: Oct 27 03:20:57.452385 n-d-862769-1 devstack@n-api.service[121001]: {"aggregate": {"name": ""}} Oct 27 03:20:57.452385 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:20:57.452385 n-d-862769-1 devstack@n-api.service[121001]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 27 03:20:57.453138 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'body': {'aggregate': {'name': ''}}} Oct 27 03:20:57.453138 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:20:57.453138 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:20:57.453138 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 03:20:57.453138 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 03:20:57.453138 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 03:20:57.453138 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise error Oct 27 03:20:57.453138 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 27 03:20:57.453138 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:20:57.453138 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Oct 27 03:20:57.453138 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 27 03:20:57.453138 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:20:57.453138 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 27 03:20:57.453138 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi '' Oct 27 03:20:57.453138 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:20:57.453138 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:20:57.453138 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:20:57.453138 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:20:57.453138 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:20:57.453138 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:20:57.453138 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:20:57.453138 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:20:57.453138 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:20:57.456774 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:20:57.456774 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:20:57.456774 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:20:57.456774 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 03:20:57.456774 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 03:20:57.456774 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 03:20:57.456774 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 03:20:57.456774 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 03:20:57.456774 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 03:20:57.456774 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 27 03:20:57.456774 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:20:57.456774 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:20:57.456774 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:20:57.456774 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:20:57.456774 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:20:57.456774 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:20:57.456774 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 03:20:57.456774 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 03:20:57.456774 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 27 03:20:57.456774 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:20:57.460076 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7ba897af-17af-49b5-b8a3-64beb5d0808e tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:20:57.460076 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7ba897af-17af-49b5-b8a3-64beb5d0808e tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.010907 Oct 27 03:20:57.460076 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 29/58] 10.222.0.20 () {60 vars in 1164 bytes} [Thu Oct 27 03:20:57 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 27 03:20:57.465808 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-053d027a-0bcf-4a3e-b9bc-b4405b142eed tempest-AggregatesAdminNegativeTestJSON-390850425 tempest-AggregatesAdminNegativeTestJSON-390850425-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-767255346"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:20:57.469210 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-053d027a-0bcf-4a3e-b9bc-b4405b142eed tempest-AggregatesAdminNegativeTestJSON-390850425 tempest-AggregatesAdminNegativeTestJSON-390850425-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '747002f449e641f0a7d2c0f38cf541a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873ceb34cf6548fdb54bdd7c39c9318b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:20:57.471032 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-053d027a-0bcf-4a3e-b9bc-b4405b142eed tempest-AggregatesAdminNegativeTestJSON-390850425 tempest-AggregatesAdminNegativeTestJSON-390850425-project] Request method failure captured: Oct 27 03:20:57.471032 n-d-862769-1 devstack@n-api.service[121001]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 27 03:20:57.471032 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:20:57.471032 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:20:57.471032 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:20:57.471032 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 59 Oct 27 03:20:57.471032 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:20:57.471032 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:20:57.471032 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:20:57.471032 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:20:57.471032 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfkR6RrqRjTzB6Sywu_WxoyDAr4cYOxqYR1D8Ag31CrSn9lbqjp5txWGOjhQpamUvPH6aGlc5Ah7hQPxBhK9L8hlYJtA6Nkf3F-iblfpzgSg3WrTMmiADZHi1XyOT-ieTIvMXXO_ltZSB_QUy0QU8rHXk67od6_pY6Vgt2D0frE4r1s Oct 27 03:20:57.471032 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:20:57.471032 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:20:57.471032 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:20:57.471032 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:20:57.471032 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:20:57.471032 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:20:57.471032 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 873ceb34cf6548fdb54bdd7c39c9318b Oct 27 03:20:57.471032 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-390850425 Oct 27 03:20:57.471032 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:20:57.471032 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:20:57.472118 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/873ceb34cf6548fdb54bdd7c39c9318b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/873ceb34cf6548fdb54bdd7c39c9318b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/873ceb34cf6548fdb54bdd7c39c9318b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_873ceb34cf6548fdb54bdd7c39c9318b"}]}] Oct 27 03:20:57.472118 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-390850425 Oct 27 03:20:57.472118 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 873ceb34cf6548fdb54bdd7c39c9318b Oct 27 03:20:57.472118 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-390850425 Oct 27 03:20:57.472118 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-AggregatesAdminNegativeTestJSON-390850425-project Oct 27 03:20:57.472118 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:20:57.472118 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:20:57.472118 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 747002f449e641f0a7d2c0f38cf541a0 Oct 27 03:20:57.472118 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-390850425-project Oct 27 03:20:57.472118 n-d-862769-1 devstack@n-api.service[121001]: Oct 27 03:20:57.472118 n-d-862769-1 devstack@n-api.service[121001]: {"aggregate": {"name": "tempest-test_aggregate-767255346"}} Oct 27 03:20:57.472118 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:20:57.472118 n-d-862769-1 devstack@n-api.service[121001]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 27 03:20:57.472769 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-767255346'}}} Oct 27 03:20:57.472769 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:20:57.472769 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:20:57.472769 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:20:57.472769 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:20:57.472769 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:20:57.472769 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:20:57.472769 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:20:57.472769 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:20:57.472769 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:20:57.472769 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:20:57.472769 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:20:57.472769 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:20:57.472769 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Oct 27 03:20:57.472769 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Oct 27 03:20:57.472769 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 03:20:57.472769 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 03:20:57.472769 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 03:20:57.472769 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 03:20:57.474350 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 03:20:57.474350 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 03:20:57.474350 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 03:20:57.474350 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 03:20:57.474350 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 03:20:57.474350 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 03:20:57.474350 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 03:20:57.474350 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 03:20:57.474350 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 03:20:57.474350 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 03:20:57.474350 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 27 03:20:57.474350 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:20:57.474350 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:20:57.474350 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:20:57.474350 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:20:57.474350 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:20:57.474350 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:20:57.474350 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 03:20:57.474350 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 03:20:57.474350 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 27 03:20:57.480139 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:20:57.480139 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-053d027a-0bcf-4a3e-b9bc-b4405b142eed tempest-AggregatesAdminNegativeTestJSON-390850425 tempest-AggregatesAdminNegativeTestJSON-390850425-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:20:57.480139 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-053d027a-0bcf-4a3e-b9bc-b4405b142eed tempest-AggregatesAdminNegativeTestJSON-390850425 tempest-AggregatesAdminNegativeTestJSON-390850425-project] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.010509 Oct 27 03:20:57.480139 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 30/59] 10.222.0.20 () {60 vars in 1164 bytes} [Thu Oct 27 03:20:57 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:20:57.486496 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d85914c6-afae-4eb0-848f-112797daa308 tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-581099220"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:20:57.489902 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.aggregate [None req-d85914c6-afae-4eb0-848f-112797daa308 tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] Generated uuid d12747cb-58c9-47e5-b9aa-24dd880e2e18 for aggregate {{(pid=121001) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 27 03:20:57.621152 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d85914c6-afae-4eb0-848f-112797daa308 tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.138099 Oct 27 03:20:57.622494 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 31/60] 10.222.0.20 () {60 vars in 1164 bytes} [Thu Oct 27 03:20:57 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:20:57.635514 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4e9779d8-5b32-424c-940b-e23b70fcafa7 tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-581099220"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:20:57.639927 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.aggregate [None req-4e9779d8-5b32-424c-940b-e23b70fcafa7 tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] Generated uuid 85ba0ab4-61b0-4a7d-8701-cc238713bbcd for aggregate {{(pid=121001) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 27 03:20:57.652523 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-4e9779d8-5b32-424c-940b-e23b70fcafa7 tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-581099220 already exists. Oct 27 03:20:57.654886 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4e9779d8-5b32-424c-940b-e23b70fcafa7 tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] Request method failure captured: Oct 27 03:20:57.654886 n-d-862769-1 devstack@n-api.service[121001]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 27 03:20:57.654886 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:20:57.654886 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:20:57.654886 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:20:57.654886 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 59 Oct 27 03:20:57.654886 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:20:57.654886 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:20:57.654886 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:20:57.654886 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:20:57.654886 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfkUPNyHvG53Iz2jDxQ105aaFZTzTDDp3MI39q4PIqaZkicxPfZhVy3H6_7mDmIDIExdcPYhXBlN1v4Beb0N2H6ozvZizLFmZbN-oxgVTvWJ32yYegOOG46IUg1BMPU_du_KhLWkhPcTY10RB2M4MFGbcgYscU9M-CSa95eCdZfqZE4 Oct 27 03:20:57.654886 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:20:57.654886 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:20:57.654886 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:20:57.654886 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:20:57.654886 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:20:57.654886 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:20:57.654886 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 80aae888f8984fab9d12c5304427c794 Oct 27 03:20:57.654886 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1608777148 Oct 27 03:20:57.654886 n-d-862769-1 devstack@n-api.service[121001]: X-Role: admin,member,reader Oct 27 03:20:57.654886 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: admin,member,reader Oct 27 03:20:57.656112 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/80aae888f8984fab9d12c5304427c794"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/80aae888f8984fab9d12c5304427c794"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/80aae888f8984fab9d12c5304427c794"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_80aae888f8984fab9d12c5304427c794"}]}] Oct 27 03:20:57.656112 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1608777148 Oct 27 03:20:57.656112 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 80aae888f8984fab9d12c5304427c794 Oct 27 03:20:57.656112 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1608777148 Oct 27 03:20:57.656112 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin Oct 27 03:20:57.656112 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:20:57.656112 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:20:57.656112 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: fb130d3fbf88475ab63f87ce203d563f Oct 27 03:20:57.656112 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin Oct 27 03:20:57.656112 n-d-862769-1 devstack@n-api.service[121001]: Oct 27 03:20:57.656112 n-d-862769-1 devstack@n-api.service[121001]: {"aggregate": {"name": "tempest-test_aggregate-581099220"}} Oct 27 03:20:57.656112 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:20:57.656112 n-d-862769-1 devstack@n-api.service[121001]: exception: Aggregate tempest-test_aggregate-581099220 already exists. Oct 27 03:20:57.656819 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-581099220'}}} Oct 27 03:20:57.656819 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:20:57.656819 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:20:57.656819 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Oct 27 03:20:57.656819 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Oct 27 03:20:57.656819 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 27 03:20:57.656819 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 27 03:20:57.656819 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 03:20:57.656819 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 03:20:57.656819 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 03:20:57.656819 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 03:20:57.656819 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 27 03:20:57.656819 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 27 03:20:57.656819 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6458, in create_aggregate Oct 27 03:20:57.656819 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi aggregate.create() Oct 27 03:20:57.656819 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 27 03:20:57.656819 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 27 03:20:57.656819 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Oct 27 03:20:57.656819 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Oct 27 03:20:57.661874 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 03:20:57.661874 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 03:20:57.661874 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Oct 27 03:20:57.661874 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Oct 27 03:20:57.661874 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-581099220 already exists. Oct 27 03:20:57.661874 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:20:57.661874 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:20:57.661874 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:20:57.661874 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:20:57.661874 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:20:57.661874 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:20:57.661874 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:20:57.661874 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:20:57.661874 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:20:57.661874 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:20:57.661874 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:20:57.661874 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:20:57.661874 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:20:57.661874 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:20:57.661874 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Oct 27 03:20:57.663086 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 27 03:20:57.663086 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-581099220 already exists. Oct 27 03:20:57.663086 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:20:57.663086 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:20:57.663086 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:20:57.663086 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:20:57.663086 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:20:57.663086 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:20:57.663086 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:20:57.663086 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:20:57.663086 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-581099220 already exists. Oct 27 03:20:57.663086 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:20:57.663086 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4e9779d8-5b32-424c-940b-e23b70fcafa7 tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-581099220 already exists. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:20:57.663086 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4e9779d8-5b32-424c-940b-e23b70fcafa7 tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 409 len: 110 microversion: 2.1 time: 0.026026 Oct 27 03:20:57.663834 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 32/61] 10.222.0.20 () {60 vars in 1164 bytes} [Thu Oct 27 03:20:57 2022] POST /compute/v2.1/os-aggregates => generated 110 bytes in 27 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 27 03:20:57.668663 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-bc194e0e-befd-479c-9ded-210294461301 tempest-FlavorsAdminTestJSON-417559943 tempest-FlavorsAdminTestJSON-417559943-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:20:57.700597 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-bc194e0e-befd-479c-9ded-210294461301 tempest-FlavorsAdminTestJSON-417559943 tempest-FlavorsAdminTestJSON-417559943-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.482107 Oct 27 03:20:57.702447 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 30/62] 10.222.0.20 () {58 vars in 1146 bytes} [Thu Oct 27 03:20:57 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:20:57.709599 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5ae8bfa5-84f8-428d-86cc-79c84a2a48c2 tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:20:57.810048 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ef96d9b4-73c7-411b-b91e-65dfca284bdc tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-1216926884", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "availability_zone": "tempest-test_az-1581762686"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:20:57.819418 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5ae8bfa5-84f8-428d-86cc-79c84a2a48c2 tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.113374 Oct 27 03:20:57.820146 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 31/63] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Oct 27 03:20:57 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 27 03:20:57.829603 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9d45d00e-cb16-43f2-9472-3243083fb939 tempest-FlavorsAdminTestJSON-1932224061 tempest-FlavorsAdminTestJSON-1932224061-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:20:57.830846 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ef96d9b4-73c7-411b-b91e-65dfca284bdc tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:20:57.831654 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ef96d9b4-73c7-411b-b91e-65dfca284bdc tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:20:57.832243 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ef96d9b4-73c7-411b-b91e-65dfca284bdc tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:20:57.833131 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ef96d9b4-73c7-411b-b91e-65dfca284bdc tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:20:57.833734 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ef96d9b4-73c7-411b-b91e-65dfca284bdc tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:20:57.834355 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ef96d9b4-73c7-411b-b91e-65dfca284bdc tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:20:57.944134 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9d45d00e-cb16-43f2-9472-3243083fb939 tempest-FlavorsAdminTestJSON-1932224061 tempest-FlavorsAdminTestJSON-1932224061-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1075226112" status: 202 len: 0 microversion: 2.1 time: 0.122636 Oct 27 03:20:57.944726 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 32/64] 10.222.0.20 () {58 vars in 1161 bytes} [Thu Oct 27 03:20:57 2022] DELETE /compute/v2.1/flavors/1075226112 => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:20:57.949615 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-39dcef19-d2ad-436f-8e64-d8b1475cafef tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1891849203"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:20:57.952995 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.aggregate [None req-39dcef19-d2ad-436f-8e64-d8b1475cafef tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] Generated uuid 15ed6cb4-75ac-4f20-a952-425b5a030a1c for aggregate {{(pid=121000) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 27 03:20:58.062007 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-39dcef19-d2ad-436f-8e64-d8b1475cafef tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.116140 Oct 27 03:20:58.063619 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 33/65] 10.222.0.20 () {60 vars in 1164 bytes} [Thu Oct 27 03:20:57 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:20:58.070156 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-11ecfb81-74fa-4f0c-ad69-17ba553a1520 tempest-FlavorsAdminTestJSON-1932224061 tempest-FlavorsAdminTestJSON-1932224061-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:20:58.089259 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-11ecfb81-74fa-4f0c-ad69-17ba553a1520 tempest-FlavorsAdminTestJSON-1932224061 tempest-FlavorsAdminTestJSON-1932224061-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024522 Oct 27 03:20:58.089935 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 34/66] 10.222.0.20 () {58 vars in 1146 bytes} [Thu Oct 27 03:20:58 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:20:58.095276 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7fe19305-0f8e-4e24-86bf-9c6c4e00ec55 tempest-AggregatesAdminNegativeTestJSON-390850425 tempest-AggregatesAdminNegativeTestJSON-390850425-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:20:58.097131 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7fe19305-0f8e-4e24-86bf-9c6c4e00ec55 tempest-AggregatesAdminNegativeTestJSON-390850425 tempest-AggregatesAdminNegativeTestJSON-390850425-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '747002f449e641f0a7d2c0f38cf541a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873ceb34cf6548fdb54bdd7c39c9318b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:20:58.099781 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7fe19305-0f8e-4e24-86bf-9c6c4e00ec55 tempest-AggregatesAdminNegativeTestJSON-390850425 tempest-AggregatesAdminNegativeTestJSON-390850425-project] Request method failure captured: Oct 27 03:20:58.099781 n-d-862769-1 devstack@n-api.service[121000]: request: DELETE /compute/v2.1/os-aggregates/6 HTTP/1.1 Oct 27 03:20:58.099781 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:20:58.099781 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:20:58.099781 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:20:58.099781 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:20:58.099781 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:20:58.099781 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:20:58.099781 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:20:58.099781 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:20:58.099781 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfkR6RrqRjTzB6Sywu_WxoyDAr4cYOxqYR1D8Ag31CrSn9lbqjp5txWGOjhQpamUvPH6aGlc5Ah7hQPxBhK9L8hlYJtA6Nkf3F-iblfpzgSg3WrTMmiADZHi1XyOT-ieTIvMXXO_ltZSB_QUy0QU8rHXk67od6_pY6Vgt2D0frE4r1s Oct 27 03:20:58.099781 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:20:58.099781 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:20:58.099781 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:20:58.099781 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:20:58.099781 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:20:58.099781 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:20:58.099781 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 873ceb34cf6548fdb54bdd7c39c9318b Oct 27 03:20:58.099781 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-390850425 Oct 27 03:20:58.099781 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:20:58.099781 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:20:58.107366 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/873ceb34cf6548fdb54bdd7c39c9318b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/873ceb34cf6548fdb54bdd7c39c9318b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/873ceb34cf6548fdb54bdd7c39c9318b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_873ceb34cf6548fdb54bdd7c39c9318b"}]}] Oct 27 03:20:58.107366 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-390850425 Oct 27 03:20:58.107366 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 873ceb34cf6548fdb54bdd7c39c9318b Oct 27 03:20:58.107366 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-390850425 Oct 27 03:20:58.107366 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-AggregatesAdminNegativeTestJSON-390850425-project Oct 27 03:20:58.107366 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:20:58.107366 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:20:58.107366 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 747002f449e641f0a7d2c0f38cf541a0 Oct 27 03:20:58.107366 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-390850425-project Oct 27 03:20:58.107366 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:20:58.107366 n-d-862769-1 devstack@n-api.service[121000]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 27 03:20:58.107366 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '6'} Oct 27 03:20:58.108462 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:20:58.108462 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:20:58.108462 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:20:58.108462 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:20:58.108462 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:20:58.108462 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:20:58.108462 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:20:58.108462 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:20:58.108462 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Oct 27 03:20:58.108462 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Oct 27 03:20:58.108462 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 03:20:58.108462 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 03:20:58.108462 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 03:20:58.108462 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 03:20:58.108462 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 03:20:58.108462 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 03:20:58.108462 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 03:20:58.108462 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 03:20:58.108462 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 03:20:58.110229 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 03:20:58.110229 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 03:20:58.110229 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 03:20:58.110229 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 03:20:58.110229 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 03:20:58.110229 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 27 03:20:58.110229 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:20:58.110229 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:20:58.110229 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:20:58.110229 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:20:58.110229 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:20:58.110229 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:20:58.110229 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 03:20:58.110229 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 03:20:58.110229 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 27 03:20:58.110229 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:20:58.110229 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7fe19305-0f8e-4e24-86bf-9c6c4e00ec55 tempest-AggregatesAdminNegativeTestJSON-390850425 tempest-AggregatesAdminNegativeTestJSON-390850425-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:20:58.111513 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7fe19305-0f8e-4e24-86bf-9c6c4e00ec55 tempest-AggregatesAdminNegativeTestJSON-390850425 tempest-AggregatesAdminNegativeTestJSON-390850425-project] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/6" status: 403 len: 116 microversion: 2.1 time: 0.009936 Oct 27 03:20:58.111513 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 35/67] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Oct 27 03:20:58 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 116 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:20:58.111513 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-fee877f6-04d3-4030-8e19-107d042c453e tempest-FlavorsAdminTestJSON-1932224061 tempest-FlavorsAdminTestJSON-1932224061-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-333381545", "id": 407688939, "os-flavor-access:is_public": "False"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:20:58.191961 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-fee877f6-04d3-4030-8e19-107d042c453e tempest-FlavorsAdminTestJSON-1932224061 tempest-FlavorsAdminTestJSON-1932224061-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.086474 Oct 27 03:20:58.192884 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 36/68] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:20:58 2022] POST /compute/v2.1/flavors => generated 426 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:20:58.205316 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4d13bc98-8330-4cfa-96e8-27978088460a tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:20:58.299260 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4d13bc98-8330-4cfa-96e8-27978088460a tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.100822 Oct 27 03:20:58.300408 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 37/69] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Oct 27 03:20:58 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 27 03:20:58.306013 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-326b651f-000e-418e-b836-07ebae42947e tempest-FlavorsAdminTestJSON-417559943 tempest-FlavorsAdminTestJSON-417559943-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "407688939"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:20:58.338340 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-326b651f-000e-418e-b836-07ebae42947e tempest-FlavorsAdminTestJSON-417559943 tempest-FlavorsAdminTestJSON-417559943-project] HTTP exception thrown: Flavor 407688939 could not be found. Oct 27 03:20:58.342916 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-326b651f-000e-418e-b836-07ebae42947e tempest-FlavorsAdminTestJSON-417559943 tempest-FlavorsAdminTestJSON-417559943-project] Request method failure captured: Oct 27 03:20:58.342916 n-d-862769-1 devstack@n-api.service[121000]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 03:20:58.342916 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:20:58.342916 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:20:58.342916 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:20:58.342916 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 106 Oct 27 03:20:58.342916 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:20:58.342916 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:20:58.342916 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:20:58.342916 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:20:58.342916 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfkPxx0PC5mjf22VUOxBOr-_PQMciWuFh8idc_05I8SJT1eyWy_3XgMdmpbI6LR1uY_6AgnKnitQdTaMlSolZ3gKQC4Lzeqq9mmzDSikmkehnIrfn76rVb5u2HcDC-Xg3VZtk6zwuJZuCd9RfE3_7-e-WzLdQcDrHGvh84e5YEV2oiE Oct 27 03:20:58.342916 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:20:58.342916 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:20:58.342916 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:20:58.342916 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:20:58.342916 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:20:58.342916 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:20:58.342916 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 9f71e54f5a0f4a97bed3c89cda637a1e Oct 27 03:20:58.342916 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-FlavorsAdminTestJSON-417559943 Oct 27 03:20:58.342916 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:20:58.342916 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:20:58.344571 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9f71e54f5a0f4a97bed3c89cda637a1e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9f71e54f5a0f4a97bed3c89cda637a1e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9f71e54f5a0f4a97bed3c89cda637a1e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9f71e54f5a0f4a97bed3c89cda637a1e"}]}] Oct 27 03:20:58.344571 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-FlavorsAdminTestJSON-417559943 Oct 27 03:20:58.344571 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 9f71e54f5a0f4a97bed3c89cda637a1e Oct 27 03:20:58.344571 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-417559943 Oct 27 03:20:58.344571 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-FlavorsAdminTestJSON-417559943-project Oct 27 03:20:58.344571 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:20:58.344571 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:20:58.344571 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 5fe38379160246da8a176b544646ce6d Oct 27 03:20:58.344571 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-FlavorsAdminTestJSON-417559943-project Oct 27 03:20:58.344571 n-d-862769-1 devstack@n-api.service[121000]: Oct 27 03:20:58.344571 n-d-862769-1 devstack@n-api.service[121000]: {"server": {"name": "test", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "407688939"}} Oct 27 03:20:58.344571 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:20:58.344571 n-d-862769-1 devstack@n-api.service[121000]: exception: Flavor 407688939 could not be found. Oct 27 03:20:58.345228 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'body': {'server': {'name': 'test', 'imageRef': 'c40fb871-5877-4b59-ab69-d9fd23b7a917', 'flavorRef': '407688939'}}} Oct 27 03:20:58.345228 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:20:58.345228 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:20:58.345228 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 27 03:20:58.345228 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 27 03:20:58.345228 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 27 03:20:58.345228 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 27 03:20:58.345228 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 03:20:58.345228 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 03:20:58.345228 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 27 03:20:58.345228 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 27 03:20:58.345228 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 27 03:20:58.345228 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:20:58.345228 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 27 03:20:58.345228 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 27 03:20:58.345228 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 407688939 could not be found. Oct 27 03:20:58.345228 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:20:58.345228 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:20:58.345228 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:20:58.345228 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:20:58.346197 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:20:58.346197 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:20:58.346197 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:20:58.346197 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:20:58.346197 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:20:58.346197 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:20:58.346197 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:20:58.346197 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:20:58.346197 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:20:58.346197 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:20:58.346197 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:20:58.346197 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:20:58.346197 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 27 03:20:58.346197 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 27 03:20:58.346197 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 27 03:20:58.346197 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 407688939 could not be found. Oct 27 03:20:58.346197 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:20:58.346197 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:20:58.346197 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:20:58.346197 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:20:58.346197 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:20:58.351846 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:20:58.351846 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:20:58.351846 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:20:58.351846 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 407688939 could not be found. Oct 27 03:20:58.351846 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:20:58.351846 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-326b651f-000e-418e-b836-07ebae42947e tempest-FlavorsAdminTestJSON-417559943 tempest-FlavorsAdminTestJSON-417559943-project] Returning 400 to user: Flavor 407688939 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:20:58.351846 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-326b651f-000e-418e-b836-07ebae42947e tempest-FlavorsAdminTestJSON-417559943 tempest-FlavorsAdminTestJSON-417559943-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 80 microversion: 2.1 time: 0.041306 Oct 27 03:20:58.351846 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 38/70] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:20:58 2022] POST /compute/v2.1/servers => generated 80 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 27 03:20:58.351846 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1c958fbf-7bb4-44f3-b9c2-b7c5cf71cc3b tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:20:58.365022 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-1c958fbf-7bb4-44f3-b9c2-b7c5cf71cc3b tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 27 03:20:58.367493 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1c958fbf-7bb4-44f3-b9c2-b7c5cf71cc3b tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] Request method failure captured: Oct 27 03:20:58.367493 n-d-862769-1 devstack@n-api.service[121000]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 27 03:20:58.367493 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:20:58.367493 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:20:58.367493 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:20:58.367493 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:20:58.367493 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:20:58.367493 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:20:58.367493 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:20:58.367493 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:20:58.367493 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfkUPNyHvG53Iz2jDxQ105aaFZTzTDDp3MI39q4PIqaZkicxPfZhVy3H6_7mDmIDIExdcPYhXBlN1v4Beb0N2H6ozvZizLFmZbN-oxgVTvWJ32yYegOOG46IUg1BMPU_du_KhLWkhPcTY10RB2M4MFGbcgYscU9M-CSa95eCdZfqZE4 Oct 27 03:20:58.367493 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:20:58.367493 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:20:58.367493 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:20:58.367493 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:20:58.367493 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:20:58.367493 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:20:58.367493 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 80aae888f8984fab9d12c5304427c794 Oct 27 03:20:58.367493 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1608777148 Oct 27 03:20:58.367493 n-d-862769-1 devstack@n-api.service[121000]: X-Role: admin,member,reader Oct 27 03:20:58.367493 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: admin,member,reader Oct 27 03:20:58.373366 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/80aae888f8984fab9d12c5304427c794"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/80aae888f8984fab9d12c5304427c794"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/80aae888f8984fab9d12c5304427c794"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_80aae888f8984fab9d12c5304427c794"}]}] Oct 27 03:20:58.373366 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1608777148 Oct 27 03:20:58.373366 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 80aae888f8984fab9d12c5304427c794 Oct 27 03:20:58.373366 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1608777148 Oct 27 03:20:58.373366 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin Oct 27 03:20:58.373366 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:20:58.373366 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:20:58.373366 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: fb130d3fbf88475ab63f87ce203d563f Oct 27 03:20:58.373366 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin Oct 27 03:20:58.373366 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:20:58.373366 n-d-862769-1 devstack@n-api.service[121000]: exception: Aggregate -1 could not be found. Oct 27 03:20:58.373366 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '-1'} Oct 27 03:20:58.373981 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:20:58.373981 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:20:58.373981 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 27 03:20:58.373981 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 27 03:20:58.373981 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 27 03:20:58.373981 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 27 03:20:58.373981 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 03:20:58.373981 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 03:20:58.373981 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 03:20:58.373981 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 03:20:58.373981 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 27 03:20:58.373981 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 27 03:20:58.373981 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 27 03:20:58.373981 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 27 03:20:58.373981 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 03:20:58.373981 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 03:20:58.373981 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 27 03:20:58.373981 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 27 03:20:58.373981 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 03:20:58.374939 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 03:20:58.374939 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 27 03:20:58.374939 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 27 03:20:58.374939 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 27 03:20:58.374939 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:20:58.374939 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:20:58.374939 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:20:58.374939 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:20:58.374939 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:20:58.374939 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:20:58.374939 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:20:58.374939 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:20:58.374939 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:20:58.374939 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:20:58.374939 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 27 03:20:58.374939 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:20:58.374939 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 27 03:20:58.374939 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:20:58.374939 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:20:58.374939 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:20:58.374939 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:20:58.376025 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:20:58.376025 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:20:58.376025 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:20:58.376025 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:20:58.376025 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 27 03:20:58.376025 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:20:58.376025 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1c958fbf-7bb4-44f3-b9c2-b7c5cf71cc3b tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:20:58.376025 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1c958fbf-7bb4-44f3-b9c2-b7c5cf71cc3b tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.023615 Oct 27 03:20:58.376025 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 39/71] 10.222.0.20 () {58 vars in 1155 bytes} [Thu Oct 27 03:20:58 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 03:20:58.376025 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ab260e30-726c-4ec2-84d3-d9d1c1420a8c tempest-FlavorsAdminTestJSON-1932224061 tempest-FlavorsAdminTestJSON-1932224061-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:20:58.504195 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ab260e30-726c-4ec2-84d3-d9d1c1420a8c tempest-FlavorsAdminTestJSON-1932224061 tempest-FlavorsAdminTestJSON-1932224061-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/407688939" status: 202 len: 0 microversion: 2.1 time: 0.133723 Oct 27 03:20:58.509022 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 40/72] 10.222.0.20 () {58 vars in 1158 bytes} [Thu Oct 27 03:20:58 2022] DELETE /compute/v2.1/flavors/407688939 => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:20:58.509574 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0a59424e-64ea-46c3-b1c4-096aff9269c6 tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-572713417"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:20:58.518071 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.aggregate [None req-0a59424e-64ea-46c3-b1c4-096aff9269c6 tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] Generated uuid 23004183-a72d-42aa-8a14-bb1f7b5558e0 for aggregate {{(pid=121000) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 27 03:20:58.657711 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0a59424e-64ea-46c3-b1c4-096aff9269c6 tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.151016 Oct 27 03:20:58.658958 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 41/73] 10.222.0.20 () {60 vars in 1164 bytes} [Thu Oct 27 03:20:58 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:20:58.663638 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1bf7278b-2c89-488c-8187-2449f164c2a6 tempest-FlavorsAdminTestJSON-1932224061 tempest-FlavorsAdminTestJSON-1932224061-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:20:58.684202 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1bf7278b-2c89-488c-8187-2449f164c2a6 tempest-FlavorsAdminTestJSON-1932224061 tempest-FlavorsAdminTestJSON-1932224061-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023904 Oct 27 03:20:58.684953 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 42/74] 10.222.0.20 () {58 vars in 1146 bytes} [Thu Oct 27 03:20:58 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:20:58.689772 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6f537ff2-4d5e-4f94-a4ef-e275e4e5a3a6 tempest-AggregatesAdminNegativeTestJSON-390850425 tempest-AggregatesAdminNegativeTestJSON-390850425-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:20:58.691539 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-6f537ff2-4d5e-4f94-a4ef-e275e4e5a3a6 tempest-AggregatesAdminNegativeTestJSON-390850425 tempest-AggregatesAdminNegativeTestJSON-390850425-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '747002f449e641f0a7d2c0f38cf541a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873ceb34cf6548fdb54bdd7c39c9318b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:20:58.693212 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6f537ff2-4d5e-4f94-a4ef-e275e4e5a3a6 tempest-AggregatesAdminNegativeTestJSON-390850425 tempest-AggregatesAdminNegativeTestJSON-390850425-project] Request method failure captured: Oct 27 03:20:58.693212 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Oct 27 03:20:58.693212 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:20:58.693212 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:20:58.693212 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:20:58.693212 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:20:58.693212 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:20:58.693212 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:20:58.693212 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:20:58.693212 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:20:58.693212 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfkR6RrqRjTzB6Sywu_WxoyDAr4cYOxqYR1D8Ag31CrSn9lbqjp5txWGOjhQpamUvPH6aGlc5Ah7hQPxBhK9L8hlYJtA6Nkf3F-iblfpzgSg3WrTMmiADZHi1XyOT-ieTIvMXXO_ltZSB_QUy0QU8rHXk67od6_pY6Vgt2D0frE4r1s Oct 27 03:20:58.693212 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:20:58.693212 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:20:58.693212 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:20:58.693212 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:20:58.693212 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:20:58.693212 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:20:58.693212 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 873ceb34cf6548fdb54bdd7c39c9318b Oct 27 03:20:58.693212 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-390850425 Oct 27 03:20:58.693212 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:20:58.693212 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:20:58.694467 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/873ceb34cf6548fdb54bdd7c39c9318b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/873ceb34cf6548fdb54bdd7c39c9318b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/873ceb34cf6548fdb54bdd7c39c9318b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_873ceb34cf6548fdb54bdd7c39c9318b"}]}] Oct 27 03:20:58.694467 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-390850425 Oct 27 03:20:58.694467 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 873ceb34cf6548fdb54bdd7c39c9318b Oct 27 03:20:58.694467 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-390850425 Oct 27 03:20:58.694467 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-AggregatesAdminNegativeTestJSON-390850425-project Oct 27 03:20:58.694467 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:20:58.694467 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:20:58.694467 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 747002f449e641f0a7d2c0f38cf541a0 Oct 27 03:20:58.694467 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-390850425-project Oct 27 03:20:58.694467 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:20:58.694467 n-d-862769-1 devstack@n-api.service[121000]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 27 03:20:58.694467 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '7'} Oct 27 03:20:58.695053 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:20:58.695053 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:20:58.695053 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:20:58.695053 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:20:58.695053 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:20:58.695053 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:20:58.695053 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:20:58.695053 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:20:58.695053 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Oct 27 03:20:58.695053 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Oct 27 03:20:58.695053 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 03:20:58.695053 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 03:20:58.695053 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 03:20:58.695053 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 03:20:58.695053 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 03:20:58.695053 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 03:20:58.695053 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 03:20:58.695053 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 03:20:58.695053 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 03:20:58.696090 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 03:20:58.696090 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 03:20:58.696090 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 03:20:58.696090 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 03:20:58.696090 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 03:20:58.696090 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 27 03:20:58.696090 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:20:58.696090 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:20:58.696090 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:20:58.696090 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:20:58.696090 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:20:58.696090 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:20:58.696090 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 03:20:58.696090 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 03:20:58.696090 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 27 03:20:58.696090 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:20:58.698076 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6f537ff2-4d5e-4f94-a4ef-e275e4e5a3a6 tempest-AggregatesAdminNegativeTestJSON-390850425 tempest-AggregatesAdminNegativeTestJSON-390850425-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:20:58.699154 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6f537ff2-4d5e-4f94-a4ef-e275e4e5a3a6 tempest-AggregatesAdminNegativeTestJSON-390850425 tempest-AggregatesAdminNegativeTestJSON-390850425-project] 10.222.0.20 "GET /compute/v2.1/os-aggregates/7" status: 403 len: 114 microversion: 2.1 time: 0.013103 Oct 27 03:20:58.709964 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 43/75] 10.222.0.20 () {58 vars in 1149 bytes} [Thu Oct 27 03:20:58 2022] GET /compute/v2.1/os-aggregates/7 => generated 114 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:20:58.709964 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-bea5f1b9-d9fa-4f20-a6eb-035e4060a6b6 tempest-FlavorsAdminTestJSON-1932224061 tempest-FlavorsAdminTestJSON-1932224061-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-714437078", "id": 520747742, "os-flavor-access:is_public": "False"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:20:58.767591 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-bea5f1b9-d9fa-4f20-a6eb-035e4060a6b6 tempest-FlavorsAdminTestJSON-1932224061 tempest-FlavorsAdminTestJSON-1932224061-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.064555 Oct 27 03:20:58.768185 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 44/76] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:20:58 2022] POST /compute/v2.1/flavors => generated 411 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:20:58.772628 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-13c0e9c8-f750-4bf9-bafb-1eeeb660e782 tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:20:58.838697 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-13c0e9c8-f750-4bf9-bafb-1eeeb660e782 tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.069401 Oct 27 03:20:58.843971 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 45/77] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Oct 27 03:20:58 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 27 03:20:58.849459 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-03956477-3ed5-4eb1-8c30-e90c86102410 tempest-FlavorsAdminTestJSON-1932224061 tempest-FlavorsAdminTestJSON-1932224061-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-834880239", "id": 48294251, "os-flavor-access:is_public": "True"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:20:58.911069 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-03956477-3ed5-4eb1-8c30-e90c86102410 tempest-FlavorsAdminTestJSON-1932224061 tempest-FlavorsAdminTestJSON-1932224061-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.1 time: 0.065209 Oct 27 03:20:58.920153 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 46/78] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:20:58 2022] POST /compute/v2.1/flavors => generated 407 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:20:58.925434 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-934a257e-d717-4352-8337-8b1339dc74a3 tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:20:58.932173 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-934a257e-d717-4352-8337-8b1339dc74a3 tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 27 03:20:58.933839 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-934a257e-d717-4352-8337-8b1339dc74a3 tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] Request method failure captured: Oct 27 03:20:58.933839 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 27 03:20:58.933839 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:20:58.933839 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:20:58.933839 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:20:58.933839 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:20:58.933839 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:20:58.933839 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:20:58.933839 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:20:58.933839 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:20:58.933839 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfkUPNyHvG53Iz2jDxQ105aaFZTzTDDp3MI39q4PIqaZkicxPfZhVy3H6_7mDmIDIExdcPYhXBlN1v4Beb0N2H6ozvZizLFmZbN-oxgVTvWJ32yYegOOG46IUg1BMPU_du_KhLWkhPcTY10RB2M4MFGbcgYscU9M-CSa95eCdZfqZE4 Oct 27 03:20:58.933839 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:20:58.933839 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:20:58.933839 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:20:58.933839 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:20:58.933839 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:20:58.933839 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:20:58.933839 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 80aae888f8984fab9d12c5304427c794 Oct 27 03:20:58.933839 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1608777148 Oct 27 03:20:58.933839 n-d-862769-1 devstack@n-api.service[121000]: X-Role: admin,member,reader Oct 27 03:20:58.933839 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: admin,member,reader Oct 27 03:20:58.934903 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/80aae888f8984fab9d12c5304427c794"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/80aae888f8984fab9d12c5304427c794"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/80aae888f8984fab9d12c5304427c794"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_80aae888f8984fab9d12c5304427c794"}]}] Oct 27 03:20:58.934903 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1608777148 Oct 27 03:20:58.934903 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 80aae888f8984fab9d12c5304427c794 Oct 27 03:20:58.934903 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1608777148 Oct 27 03:20:58.934903 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin Oct 27 03:20:58.934903 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:20:58.934903 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:20:58.934903 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: fb130d3fbf88475ab63f87ce203d563f Oct 27 03:20:58.934903 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin Oct 27 03:20:58.934903 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:20:58.934903 n-d-862769-1 devstack@n-api.service[121000]: exception: Aggregate -1 could not be found. Oct 27 03:20:58.934903 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '-1'} Oct 27 03:20:58.935481 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:20:58.935481 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:20:58.935481 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 27 03:20:58.935481 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 27 03:20:58.935481 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 27 03:20:58.935481 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 27 03:20:58.935481 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 03:20:58.935481 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 03:20:58.935481 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 27 03:20:58.935481 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 27 03:20:58.935481 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 03:20:58.935481 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 03:20:58.935481 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 27 03:20:58.935481 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 27 03:20:58.935481 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 27 03:20:58.935481 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:20:58.935481 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:20:58.935481 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:20:58.935481 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:20:58.935481 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:20:58.936538 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:20:58.936538 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:20:58.936538 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:20:58.936538 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:20:58.936538 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:20:58.936538 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 27 03:20:58.936538 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:20:58.936538 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 27 03:20:58.936538 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:20:58.936538 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:20:58.936538 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:20:58.936538 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:20:58.936538 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:20:58.936538 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:20:58.936538 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:20:58.936538 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:20:58.936538 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 27 03:20:58.936538 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:20:58.937571 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-934a257e-d717-4352-8337-8b1339dc74a3 tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:20:58.937571 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-934a257e-d717-4352-8337-8b1339dc74a3 tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.013865 Oct 27 03:20:58.937571 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 47/79] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Oct 27 03:20:58 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 03:20:58.941329 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7bb13741-cf6b-4f75-8e1a-ae5d23c7abec tempest-FlavorsAdminTestJSON-1932224061 tempest-FlavorsAdminTestJSON-1932224061-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:20:58.960459 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7bb13741-cf6b-4f75-8e1a-ae5d23c7abec tempest-FlavorsAdminTestJSON-1932224061 tempest-FlavorsAdminTestJSON-1932224061-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 414 microversion: 2.1 time: 0.023064 Oct 27 03:20:58.962550 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 48/80] 10.222.0.20 () {58 vars in 1169 bytes} [Thu Oct 27 03:20:58 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 414 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:20:58.974220 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-42dabc0c-356f-40e2-9e25-d656be10a397 tempest-AggregatesAdminNegativeTestJSON-390850425 tempest-AggregatesAdminNegativeTestJSON-390850425-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:20:58.975822 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-42dabc0c-356f-40e2-9e25-d656be10a397 tempest-AggregatesAdminNegativeTestJSON-390850425 tempest-AggregatesAdminNegativeTestJSON-390850425-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '747002f449e641f0a7d2c0f38cf541a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873ceb34cf6548fdb54bdd7c39c9318b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:20:58.977383 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-42dabc0c-356f-40e2-9e25-d656be10a397 tempest-AggregatesAdminNegativeTestJSON-390850425 tempest-AggregatesAdminNegativeTestJSON-390850425-project] Request method failure captured: Oct 27 03:20:58.977383 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Oct 27 03:20:58.977383 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:20:58.977383 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:20:58.977383 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:20:58.977383 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:20:58.977383 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:20:58.977383 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:20:58.977383 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:20:58.977383 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:20:58.977383 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfkR6RrqRjTzB6Sywu_WxoyDAr4cYOxqYR1D8Ag31CrSn9lbqjp5txWGOjhQpamUvPH6aGlc5Ah7hQPxBhK9L8hlYJtA6Nkf3F-iblfpzgSg3WrTMmiADZHi1XyOT-ieTIvMXXO_ltZSB_QUy0QU8rHXk67od6_pY6Vgt2D0frE4r1s Oct 27 03:20:58.977383 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:20:58.977383 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:20:58.977383 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:20:58.977383 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:20:58.977383 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:20:58.977383 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:20:58.977383 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 873ceb34cf6548fdb54bdd7c39c9318b Oct 27 03:20:58.977383 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-390850425 Oct 27 03:20:58.977383 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:20:58.977383 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:20:58.979290 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/873ceb34cf6548fdb54bdd7c39c9318b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/873ceb34cf6548fdb54bdd7c39c9318b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/873ceb34cf6548fdb54bdd7c39c9318b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_873ceb34cf6548fdb54bdd7c39c9318b"}]}] Oct 27 03:20:58.979290 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-390850425 Oct 27 03:20:58.979290 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 873ceb34cf6548fdb54bdd7c39c9318b Oct 27 03:20:58.979290 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-390850425 Oct 27 03:20:58.979290 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-AggregatesAdminNegativeTestJSON-390850425-project Oct 27 03:20:58.979290 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:20:58.979290 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:20:58.979290 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 747002f449e641f0a7d2c0f38cf541a0 Oct 27 03:20:58.979290 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-390850425-project Oct 27 03:20:58.979290 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:20:58.979290 n-d-862769-1 devstack@n-api.service[121000]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 27 03:20:58.979290 n-d-862769-1 devstack@n-api.service[121000]: action_args: {} Oct 27 03:20:58.989270 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:20:58.989270 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:20:58.989270 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:20:58.989270 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:20:58.989270 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:20:58.989270 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:20:58.989270 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:20:58.989270 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:20:58.989270 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Oct 27 03:20:58.989270 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Oct 27 03:20:58.989270 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 03:20:58.989270 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 03:20:58.989270 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 03:20:58.989270 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 03:20:58.989270 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 03:20:58.989270 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 03:20:58.989270 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 03:20:58.989270 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 03:20:58.989270 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 03:20:58.990276 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 03:20:58.990276 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 03:20:58.990276 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 03:20:58.990276 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 03:20:58.990276 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 03:20:58.990276 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 27 03:20:58.990276 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:20:58.990276 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:20:58.990276 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:20:58.990276 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:20:58.990276 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:20:58.990276 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:20:58.990276 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 03:20:58.990276 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 03:20:58.990276 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 27 03:20:58.990276 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:20:58.990276 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-42dabc0c-356f-40e2-9e25-d656be10a397 tempest-AggregatesAdminNegativeTestJSON-390850425 tempest-AggregatesAdminNegativeTestJSON-390850425-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:20:58.991274 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-42dabc0c-356f-40e2-9e25-d656be10a397 tempest-AggregatesAdminNegativeTestJSON-390850425 tempest-AggregatesAdminNegativeTestJSON-390850425-project] 10.222.0.20 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.015170 Oct 27 03:20:58.991274 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 49/81] 10.222.0.20 () {58 vars in 1143 bytes} [Thu Oct 27 03:20:58 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:20:59.146934 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.network.neutron [None req-ef96d9b4-73c7-411b-b91e-65dfca284bdc tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] validate_networks() for None {{(pid=121001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:20:59.380103 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-ef96d9b4-73c7-411b-b91e-65dfca284bdc tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Flavor limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:20:59.380538 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-ef96d9b4-73c7-411b-b91e-65dfca284bdc tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Image limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:20:59.381030 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-ef96d9b4-73c7-411b-b91e-65dfca284bdc tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Flavor pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:20:59.381460 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-ef96d9b4-73c7-411b-b91e-65dfca284bdc tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Image pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:20:59.381886 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-ef96d9b4-73c7-411b-b91e-65dfca284bdc tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:20:59.395351 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ef96d9b4-73c7-411b-b91e-65dfca284bdc tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:20:59.395935 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ef96d9b4-73c7-411b-b91e-65dfca284bdc tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:20:59.396453 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ef96d9b4-73c7-411b-b91e-65dfca284bdc tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:20:59.397185 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ef96d9b4-73c7-411b-b91e-65dfca284bdc tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:20:59.397650 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ef96d9b4-73c7-411b-b91e-65dfca284bdc tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:20:59.402127 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ef96d9b4-73c7-411b-b91e-65dfca284bdc tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:20:59.429797 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-ef96d9b4-73c7-411b-b91e-65dfca284bdc tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Getting quotas for project 2cee0e3469fc42a49004f9b5d1f5b6d0. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:20:59.437152 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-ef96d9b4-73c7-411b-b91e-65dfca284bdc tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Getting quotas for user 015a9fcd508e4d20ad51dcb71053c28f and project 2cee0e3469fc42a49004f9b5d1f5b6d0. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:20:59.450384 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ef96d9b4-73c7-411b-b91e-65dfca284bdc tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Going to run 1 instances... {{(pid=121001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:20:59.453268 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ef96d9b4-73c7-411b-b91e-65dfca284bdc tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] [instance: 820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:20:59.511875 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-cca34691-c821-43f4-a560-2e1cce4b233c tempest-HostsAdminTestJSON-1283394147 tempest-HostsAdminTestJSON-1283394147-project-admin] Calling method '.version_select at 0x7f7ddb755e50>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:20:59.517139 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cca34691-c821-43f4-a560-2e1cce4b233c tempest-HostsAdminTestJSON-1283394147 tempest-HostsAdminTestJSON-1283394147-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:20:59.518297 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cca34691-c821-43f4-a560-2e1cce4b233c tempest-HostsAdminTestJSON-1283394147 tempest-HostsAdminTestJSON-1283394147-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:20:59.519083 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cca34691-c821-43f4-a560-2e1cce4b233c tempest-HostsAdminTestJSON-1283394147 tempest-HostsAdminTestJSON-1283394147-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:20:59.520725 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cca34691-c821-43f4-a560-2e1cce4b233c tempest-HostsAdminTestJSON-1283394147 tempest-HostsAdminTestJSON-1283394147-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:20:59.521392 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cca34691-c821-43f4-a560-2e1cce4b233c tempest-HostsAdminTestJSON-1283394147 tempest-HostsAdminTestJSON-1283394147-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:20:59.522262 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cca34691-c821-43f4-a560-2e1cce4b233c tempest-HostsAdminTestJSON-1283394147 tempest-HostsAdminTestJSON-1283394147-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:20:59.541440 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=8,nova_api:DELETE=17 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:20:59.553819 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-cca34691-c821-43f4-a560-2e1cce4b233c tempest-HostsAdminTestJSON-1283394147 tempest-HostsAdminTestJSON-1283394147-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts" status: 200 len: 398 microversion: 2.1 time: 0.573146 Oct 27 03:20:59.554831 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 50/82] 10.222.0.20 () {58 vars in 1128 bytes} [Thu Oct 27 03:20:58 2022] GET /compute/v2.1/os-hosts => generated 398 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:20:59.559731 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-52259757-db72-4c0b-a729-f485f0ba5881 tempest-FlavorsAdminTestJSON-1932224061 tempest-FlavorsAdminTestJSON-1932224061-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:20:59.573242 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-52259757-db72-4c0b-a729-f485f0ba5881 tempest-FlavorsAdminTestJSON-1932224061 tempest-FlavorsAdminTestJSON-1932224061-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 414 microversion: 2.1 time: 0.016830 Oct 27 03:20:59.574250 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 51/83] 10.222.0.20 () {58 vars in 1177 bytes} [Thu Oct 27 03:20:59 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 414 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:20:59.579487 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7f1100b3-cc2a-467a-852c-564d024f09ac tempest-HostsAdminTestJSON-1283394147 tempest-HostsAdminTestJSON-1283394147-project-admin] Calling method '.version_select at 0x7f7ddb76f9d0>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:20:59.589111 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7f1100b3-cc2a-467a-852c-564d024f09ac tempest-HostsAdminTestJSON-1283394147 tempest-HostsAdminTestJSON-1283394147-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:20:59.589787 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7f1100b3-cc2a-467a-852c-564d024f09ac tempest-HostsAdminTestJSON-1283394147 tempest-HostsAdminTestJSON-1283394147-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:20:59.590752 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7f1100b3-cc2a-467a-852c-564d024f09ac tempest-HostsAdminTestJSON-1283394147 tempest-HostsAdminTestJSON-1283394147-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:20:59.591573 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7f1100b3-cc2a-467a-852c-564d024f09ac tempest-HostsAdminTestJSON-1283394147 tempest-HostsAdminTestJSON-1283394147-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:20:59.592110 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7f1100b3-cc2a-467a-852c-564d024f09ac tempest-HostsAdminTestJSON-1283394147 tempest-HostsAdminTestJSON-1283394147-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:20:59.593448 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7f1100b3-cc2a-467a-852c-564d024f09ac tempest-HostsAdminTestJSON-1283394147 tempest-HostsAdminTestJSON-1283394147-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:20:59.604098 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ef96d9b4-73c7-411b-b91e-65dfca284bdc tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.945777 Oct 27 03:20:59.612070 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 33/84] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:20:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1954 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 03:20:59.618522 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-68508a3a-7551-4265-8c2f-0b870c8cf33b tempest-FlavorsAdminTestJSON-1932224061 tempest-FlavorsAdminTestJSON-1932224061-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:20:59.633446 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7f1100b3-cc2a-467a-852c-564d024f09ac tempest-HostsAdminTestJSON-1283394147 tempest-HostsAdminTestJSON-1283394147-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 398 microversion: 2.1 time: 0.057759 Oct 27 03:20:59.635413 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 52/85] 10.222.0.20 () {58 vars in 1139 bytes} [Thu Oct 27 03:20:59 2022] GET /compute/v2.1/os-hosts?zone= => generated 398 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:20:59.640830 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-68508a3a-7551-4265-8c2f-0b870c8cf33b tempest-FlavorsAdminTestJSON-1932224061 tempest-FlavorsAdminTestJSON-1932224061-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 414 microversion: 2.1 time: 0.027200 Oct 27 03:20:59.642111 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 34/86] 10.222.0.20 () {58 vars in 1171 bytes} [Thu Oct 27 03:20:59 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 414 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:20:59.647622 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b2aa222e-ad8d-427e-b506-b327605628ef tempest-HostsAdminTestJSON-1283394147 tempest-HostsAdminTestJSON-1283394147-project-admin] Calling method '.version_select at 0x7f7ddb8c7280>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:20:59.647850 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5b0424de-1fec-4daa-9da2-23a896475919 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:20:59.648606 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5b0424de-1fec-4daa-9da2-23a896475919 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] [instance: 820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:20:59.653141 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b2aa222e-ad8d-427e-b506-b327605628ef tempest-HostsAdminTestJSON-1283394147 tempest-HostsAdminTestJSON-1283394147-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:20:59.654122 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b2aa222e-ad8d-427e-b506-b327605628ef tempest-HostsAdminTestJSON-1283394147 tempest-HostsAdminTestJSON-1283394147-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:20:59.654787 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b2aa222e-ad8d-427e-b506-b327605628ef tempest-HostsAdminTestJSON-1283394147 tempest-HostsAdminTestJSON-1283394147-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:20:59.656286 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b2aa222e-ad8d-427e-b506-b327605628ef tempest-HostsAdminTestJSON-1283394147 tempest-HostsAdminTestJSON-1283394147-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:20:59.657734 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b2aa222e-ad8d-427e-b506-b327605628ef tempest-HostsAdminTestJSON-1283394147 tempest-HostsAdminTestJSON-1283394147-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:20:59.658603 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b2aa222e-ad8d-427e-b506-b327605628ef tempest-HostsAdminTestJSON-1283394147 tempest-HostsAdminTestJSON-1283394147-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:20:59.697410 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b2aa222e-ad8d-427e-b506-b327605628ef tempest-HostsAdminTestJSON-1283394147 tempest-HostsAdminTestJSON-1283394147-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.053894 Oct 27 03:20:59.698582 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 35/87] 10.222.0.20 () {58 vars in 1145 bytes} [Thu Oct 27 03:20:59 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 03:20:59.703956 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c728d852-b5f2-4d99-aefc-533b7fcb8275 tempest-FlavorsAdminTestJSON-1932224061 tempest-FlavorsAdminTestJSON-1932224061-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:20:59.716754 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c728d852-b5f2-4d99-aefc-533b7fcb8275 tempest-FlavorsAdminTestJSON-1932224061 tempest-FlavorsAdminTestJSON-1932224061-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 414 microversion: 2.1 time: 0.016725 Oct 27 03:20:59.717975 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 36/88] 10.222.0.20 () {58 vars in 1169 bytes} [Thu Oct 27 03:20:59 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 414 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:20:59.736302 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b6bfc8ad-70c1-450e-a40c-255479a70daf tempest-FlavorsAdminTestJSON-1932224061 tempest-FlavorsAdminTestJSON-1932224061-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:20:59.761289 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b6bfc8ad-70c1-450e-a40c-255479a70daf tempest-FlavorsAdminTestJSON-1932224061 tempest-FlavorsAdminTestJSON-1932224061-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5388 microversion: 2.1 time: 0.033341 Oct 27 03:20:59.761873 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 37/89] 10.222.0.20 () {58 vars in 1169 bytes} [Thu Oct 27 03:20:59 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5388 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:20:59.780966 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-02f86e3b-9de0-4a71-a5ab-e9b498b2078e tempest-FlavorsAdminTestJSON-1932224061 tempest-FlavorsAdminTestJSON-1932224061-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:20:59.803852 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-02f86e3b-9de0-4a71-a5ab-e9b498b2078e tempest-FlavorsAdminTestJSON-1932224061 tempest-FlavorsAdminTestJSON-1932224061-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5388 microversion: 2.1 time: 0.026877 Oct 27 03:20:59.804401 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 38/90] 10.222.0.20 () {58 vars in 1175 bytes} [Thu Oct 27 03:20:59 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5388 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:20:59.823169 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3c309ff7-551b-4f70-8fe7-aabafb80770f tempest-FlavorsAdminTestJSON-1932224061 tempest-FlavorsAdminTestJSON-1932224061-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:20:59.846627 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3c309ff7-551b-4f70-8fe7-aabafb80770f tempest-FlavorsAdminTestJSON-1932224061 tempest-FlavorsAdminTestJSON-1932224061-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5388 microversion: 2.1 time: 0.027122 Oct 27 03:20:59.858081 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 39/91] 10.222.0.20 () {58 vars in 1173 bytes} [Thu Oct 27 03:20:59 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5388 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:20:59.869718 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b135745d-d219-46a4-9af0-1791019c888c tempest-FlavorsAdminTestJSON-1932224061 tempest-FlavorsAdminTestJSON-1932224061-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:20:59.898072 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b135745d-d219-46a4-9af0-1791019c888c tempest-FlavorsAdminTestJSON-1932224061 tempest-FlavorsAdminTestJSON-1932224061-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5388 microversion: 2.1 time: 0.034012 Oct 27 03:20:59.899068 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 40/92] 10.222.0.20 () {58 vars in 1169 bytes} [Thu Oct 27 03:20:59 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5388 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:20:59.918262 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-def9e554-b613-4878-b3cf-725c643ea2b4 tempest-FlavorsAdminTestJSON-1932224061 tempest-FlavorsAdminTestJSON-1932224061-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:20:59.984619 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-def9e554-b613-4878-b3cf-725c643ea2b4 tempest-FlavorsAdminTestJSON-1932224061 tempest-FlavorsAdminTestJSON-1932224061-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/48294251" status: 202 len: 0 microversion: 2.1 time: 0.070065 Oct 27 03:20:59.986249 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 41/93] 10.222.0.20 () {58 vars in 1155 bytes} [Thu Oct 27 03:20:59 2022] DELETE /compute/v2.1/flavors/48294251 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:20:59.995297 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-74684511-fbb9-49ff-8d88-2cca3eb8cafc tempest-FlavorsAdminTestJSON-1932224061 tempest-FlavorsAdminTestJSON-1932224061-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:00.020169 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-74684511-fbb9-49ff-8d88-2cca3eb8cafc tempest-FlavorsAdminTestJSON-1932224061 tempest-FlavorsAdminTestJSON-1932224061-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.029476 Oct 27 03:21:00.020931 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 42/94] 10.222.0.20 () {58 vars in 1146 bytes} [Thu Oct 27 03:20:59 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:00.039668 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6b5d9b05-3fc5-4747-b74f-f32e73667c27 tempest-FlavorsAdminTestJSON-1932224061 tempest-FlavorsAdminTestJSON-1932224061-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:00.127221 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6b5d9b05-3fc5-4747-b74f-f32e73667c27 tempest-FlavorsAdminTestJSON-1932224061 tempest-FlavorsAdminTestJSON-1932224061-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/520747742" status: 202 len: 0 microversion: 2.1 time: 0.091247 Oct 27 03:21:00.127806 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 43/95] 10.222.0.20 () {58 vars in 1158 bytes} [Thu Oct 27 03:21:00 2022] DELETE /compute/v2.1/flavors/520747742 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:21:00.137575 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e0816327-7b12-45d0-9d12-d2517e7c0e10 tempest-FlavorsAdminTestJSON-1932224061 tempest-FlavorsAdminTestJSON-1932224061-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:00.168435 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e0816327-7b12-45d0-9d12-d2517e7c0e10 tempest-FlavorsAdminTestJSON-1932224061 tempest-FlavorsAdminTestJSON-1932224061-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.034854 Oct 27 03:21:00.182506 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 44/96] 10.222.0.20 () {58 vars in 1146 bytes} [Thu Oct 27 03:21:00 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:00.199344 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-aa6d84b7-7b6f-48a3-8188-76b4b5c77eb1 tempest-FlavorsAdminTestJSON-1932224061 tempest-FlavorsAdminTestJSON-1932224061-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1804887874", "id": 1359453126, "os-flavor-access:is_public": "False"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:21:00.276381 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-aa6d84b7-7b6f-48a3-8188-76b4b5c77eb1 tempest-FlavorsAdminTestJSON-1932224061 tempest-FlavorsAdminTestJSON-1932224061-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.081353 Oct 27 03:21:00.276986 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 45/97] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:21:00 2022] POST /compute/v2.1/flavors => generated 415 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:21:00.291275 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-11d34675-e594-4d16-985b-06bdde5b95c7 tempest-FlavorsAdminTestJSON-1932224061 tempest-FlavorsAdminTestJSON-1932224061-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:00.311670 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-11d34675-e594-4d16-985b-06bdde5b95c7 tempest-FlavorsAdminTestJSON-1932224061 tempest-FlavorsAdminTestJSON-1932224061-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024463 Oct 27 03:21:00.314073 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 46/98] 10.222.0.20 () {58 vars in 1146 bytes} [Thu Oct 27 03:21:00 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:00.332420 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5a890690-7507-47d0-94a9-e484dc1e6ff9 tempest-FlavorsAdminTestJSON-417559943 tempest-FlavorsAdminTestJSON-417559943-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:00.364275 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5a890690-7507-47d0-94a9-e484dc1e6ff9 tempest-FlavorsAdminTestJSON-417559943 tempest-FlavorsAdminTestJSON-417559943-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.036889 Oct 27 03:21:00.367644 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 47/99] 10.222.0.20 () {58 vars in 1146 bytes} [Thu Oct 27 03:21:00 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:00.386918 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5b0424de-1fec-4daa-9da2-23a896475919 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015a9fcd508e4d20ad51dcb71053c28f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cee0e3469fc42a49004f9b5d1f5b6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:00.390798 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-eacc34fc-8b4f-44aa-b474-5a292faaa0c7 tempest-FlavorsAdminTestJSON-1932224061 tempest-FlavorsAdminTestJSON-1932224061-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:00.405549 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5b0424de-1fec-4daa-9da2-23a896475919 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] 10.222.0.20 "GET /compute/v2.1/servers/820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5" status: 200 len: 1243 microversion: 2.1 time: 0.768908 Oct 27 03:21:00.406215 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 53/100] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:20:59 2022] GET /compute/v2.1/servers/820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5 => generated 1243 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:00.468905 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-eacc34fc-8b4f-44aa-b474-5a292faaa0c7 tempest-FlavorsAdminTestJSON-1932224061 tempest-FlavorsAdminTestJSON-1932224061-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1359453126" status: 202 len: 0 microversion: 2.1 time: 0.085492 Oct 27 03:21:00.469491 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 48/101] 10.222.0.20 () {58 vars in 1161 bytes} [Thu Oct 27 03:21:00 2022] DELETE /compute/v2.1/flavors/1359453126 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:21:00.477902 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-42da32bf-f665-4b83-b757-deaca7437831 tempest-FlavorsAdminTestJSON-1932224061 tempest-FlavorsAdminTestJSON-1932224061-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:00.497453 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-42da32bf-f665-4b83-b757-deaca7437831 tempest-FlavorsAdminTestJSON-1932224061 tempest-FlavorsAdminTestJSON-1932224061-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023331 Oct 27 03:21:00.498051 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 54/102] 10.222.0.20 () {58 vars in 1146 bytes} [Thu Oct 27 03:21:00 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:00.523447 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4a7e05ce-327c-4a20-a9aa-7b0d90f45ae9 tempest-FlavorsAdminTestJSON-1932224061 tempest-FlavorsAdminTestJSON-1932224061-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1778914130", "id": 622815252, "os-flavor-access:is_public": "True"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:21:00.612050 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4a7e05ce-327c-4a20-a9aa-7b0d90f45ae9 tempest-FlavorsAdminTestJSON-1932224061 tempest-FlavorsAdminTestJSON-1932224061-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.092214 Oct 27 03:21:00.612658 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 49/103] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:21:00 2022] POST /compute/v2.1/flavors => generated 411 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:21:00.624937 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-90eaa2e1-f771-4d68-8da8-a6b704937c3b tempest-FlavorsAdminTestJSON-417559943 tempest-FlavorsAdminTestJSON-417559943-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:00.647151 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-90eaa2e1-f771-4d68-8da8-a6b704937c3b tempest-FlavorsAdminTestJSON-417559943 tempest-FlavorsAdminTestJSON-417559943-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5392 microversion: 2.1 time: 0.025920 Oct 27 03:21:00.647745 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 55/104] 10.222.0.20 () {58 vars in 1146 bytes} [Thu Oct 27 03:21:00 2022] GET /compute/v2.1/flavors/detail => generated 5392 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:00.666342 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5326c460-a594-4dcc-a129-1b7e81fa28dc tempest-FlavorsAdminTestJSON-1932224061 tempest-FlavorsAdminTestJSON-1932224061-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:00.769207 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5326c460-a594-4dcc-a129-1b7e81fa28dc tempest-FlavorsAdminTestJSON-1932224061 tempest-FlavorsAdminTestJSON-1932224061-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/622815252" status: 202 len: 0 microversion: 2.1 time: 0.105680 Oct 27 03:21:00.769746 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 50/105] 10.222.0.20 () {58 vars in 1158 bytes} [Thu Oct 27 03:21:00 2022] DELETE /compute/v2.1/flavors/622815252 => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:21:00.782113 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b5711747-b47c-483e-bade-f59b51b69c18 tempest-FlavorsAdminTestJSON-1932224061 tempest-FlavorsAdminTestJSON-1932224061-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:00.803598 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b5711747-b47c-483e-bade-f59b51b69c18 tempest-FlavorsAdminTestJSON-1932224061 tempest-FlavorsAdminTestJSON-1932224061-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028466 Oct 27 03:21:00.807556 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 56/106] 10.222.0.20 () {58 vars in 1146 bytes} [Thu Oct 27 03:21:00 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:01.430764 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-07048c9d-e7d1-465c-a2ed-39d2f082e030 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:01.431399 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-07048c9d-e7d1-465c-a2ed-39d2f082e030 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] [instance: 820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:01.446545 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:INSERT=7,nova_api:SELECT=79,nova_api:DELETE=14 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:01.524481 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-07048c9d-e7d1-465c-a2ed-39d2f082e030 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015a9fcd508e4d20ad51dcb71053c28f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cee0e3469fc42a49004f9b5d1f5b6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:01.539481 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-07048c9d-e7d1-465c-a2ed-39d2f082e030 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] 10.222.0.20 "GET /compute/v2.1/servers/820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5" status: 200 len: 1243 microversion: 2.1 time: 0.114458 Oct 27 03:21:01.540073 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 51/107] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:01 2022] GET /compute/v2.1/servers/820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5 => generated 1243 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:02.562319 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c4a2cfda-aa82-4084-9a2d-fab94ba130da tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:02.563692 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c4a2cfda-aa82-4084-9a2d-fab94ba130da tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] [instance: 820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:02.570121 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c4a2cfda-aa82-4084-9a2d-fab94ba130da tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:02.570737 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c4a2cfda-aa82-4084-9a2d-fab94ba130da tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:02.571346 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c4a2cfda-aa82-4084-9a2d-fab94ba130da tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:02.572066 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c4a2cfda-aa82-4084-9a2d-fab94ba130da tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:02.572684 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c4a2cfda-aa82-4084-9a2d-fab94ba130da tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:02.573119 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c4a2cfda-aa82-4084-9a2d-fab94ba130da tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:02.715778 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c4a2cfda-aa82-4084-9a2d-fab94ba130da tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015a9fcd508e4d20ad51dcb71053c28f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cee0e3469fc42a49004f9b5d1f5b6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:02.728476 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c4a2cfda-aa82-4084-9a2d-fab94ba130da tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] 10.222.0.20 "GET /compute/v2.1/servers/820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5" status: 200 len: 1291 microversion: 2.1 time: 0.170203 Oct 27 03:21:02.729064 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 57/108] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:02 2022] GET /compute/v2.1/servers/820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5 => generated 1291 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:03.032410 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7545540d-c5fd-4d58-a0a7-caa4b5ead9a3 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1436268605", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:21:03.111904 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.network.neutron [None req-7545540d-c5fd-4d58-a0a7-caa4b5ead9a3 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] validate_networks() for None {{(pid=121001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:21:03.525994 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-7545540d-c5fd-4d58-a0a7-caa4b5ead9a3 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Flavor limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:21:03.526134 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-7545540d-c5fd-4d58-a0a7-caa4b5ead9a3 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Image limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:21:03.526605 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-7545540d-c5fd-4d58-a0a7-caa4b5ead9a3 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Flavor pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:21:03.527176 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-7545540d-c5fd-4d58-a0a7-caa4b5ead9a3 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Image pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:21:03.527748 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-7545540d-c5fd-4d58-a0a7-caa4b5ead9a3 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:21:03.536889 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7545540d-c5fd-4d58-a0a7-caa4b5ead9a3 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:03.537536 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7545540d-c5fd-4d58-a0a7-caa4b5ead9a3 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:03.538242 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7545540d-c5fd-4d58-a0a7-caa4b5ead9a3 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:03.539175 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7545540d-c5fd-4d58-a0a7-caa4b5ead9a3 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:03.539777 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7545540d-c5fd-4d58-a0a7-caa4b5ead9a3 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:03.540400 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7545540d-c5fd-4d58-a0a7-caa4b5ead9a3 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:03.565591 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-7545540d-c5fd-4d58-a0a7-caa4b5ead9a3 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Getting quotas for project ac1da8ce26ab49ddae972233777c4c55. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:21:03.569596 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-7545540d-c5fd-4d58-a0a7-caa4b5ead9a3 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Getting quotas for user ff070c0383324e1da5c49e3d9c652516 and project ac1da8ce26ab49ddae972233777c4c55. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:21:03.583223 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7545540d-c5fd-4d58-a0a7-caa4b5ead9a3 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Going to run 1 instances... {{(pid=121001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:21:03.585539 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7545540d-c5fd-4d58-a0a7-caa4b5ead9a3 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] [instance: 238948a5-b12d-49a4-a73f-ed65a9f19182] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:21:03.715033 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0c44bad1-41ed-4e0e-a06e-8f9250bff0e7 tempest-HypervisorAdminUnderV252Test-1193436543 tempest-HypervisorAdminUnderV252Test-1193436543-project-admin] Calling method '.version_select at 0x7f7ddb59d790>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:03.717655 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0c44bad1-41ed-4e0e-a06e-8f9250bff0e7 tempest-HypervisorAdminUnderV252Test-1193436543 tempest-HypervisorAdminUnderV252Test-1193436543-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:03.718315 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0c44bad1-41ed-4e0e-a06e-8f9250bff0e7 tempest-HypervisorAdminUnderV252Test-1193436543 tempest-HypervisorAdminUnderV252Test-1193436543-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:03.718941 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0c44bad1-41ed-4e0e-a06e-8f9250bff0e7 tempest-HypervisorAdminUnderV252Test-1193436543 tempest-HypervisorAdminUnderV252Test-1193436543-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:03.720002 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7545540d-c5fd-4d58-a0a7-caa4b5ead9a3 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.079483 Oct 27 03:21:03.731228 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 52/109] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:21:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1092 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 03:21:03.748562 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0c44bad1-41ed-4e0e-a06e-8f9250bff0e7 tempest-HypervisorAdminUnderV252Test-1193436543 tempest-HypervisorAdminUnderV252Test-1193436543-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:03.749152 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0c44bad1-41ed-4e0e-a06e-8f9250bff0e7 tempest-HypervisorAdminUnderV252Test-1193436543 tempest-HypervisorAdminUnderV252Test-1193436543-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:03.749823 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0c44bad1-41ed-4e0e-a06e-8f9250bff0e7 tempest-HypervisorAdminUnderV252Test-1193436543 tempest-HypervisorAdminUnderV252Test-1193436543-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:03.764180 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0c44bad1-41ed-4e0e-a06e-8f9250bff0e7 tempest-HypervisorAdminUnderV252Test-1193436543 tempest-HypervisorAdminUnderV252Test-1193436543-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:03.764721 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0c44bad1-41ed-4e0e-a06e-8f9250bff0e7 tempest-HypervisorAdminUnderV252Test-1193436543 tempest-HypervisorAdminUnderV252Test-1193436543-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:03.765612 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0c44bad1-41ed-4e0e-a06e-8f9250bff0e7 tempest-HypervisorAdminUnderV252Test-1193436543 tempest-HypervisorAdminUnderV252Test-1193436543-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:03.772904 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0c44bad1-41ed-4e0e-a06e-8f9250bff0e7 tempest-HypervisorAdminUnderV252Test-1193436543 tempest-HypervisorAdminUnderV252Test-1193436543-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.428826 Oct 27 03:21:03.780100 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 58/110] 10.222.0.20 () {58 vars in 1146 bytes} [Thu Oct 27 03:21:03 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:21:03.794262 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5e6ca24d-1628-4cc2-8018-97ba6e951ff9 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:03.794262 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5e6ca24d-1628-4cc2-8018-97ba6e951ff9 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] [instance: 238948a5-b12d-49a4-a73f-ed65a9f19182] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:03.859910 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5e6ca24d-1628-4cc2-8018-97ba6e951ff9 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff070c0383324e1da5c49e3d9c652516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1da8ce26ab49ddae972233777c4c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:03.868216 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5e6ca24d-1628-4cc2-8018-97ba6e951ff9 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] 10.222.0.20 "GET /compute/v2.1/servers/238948a5-b12d-49a4-a73f-ed65a9f19182" status: 200 len: 1220 microversion: 2.1 time: 0.087039 Oct 27 03:21:03.868867 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 59/111] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:03 2022] GET /compute/v2.1/servers/238948a5-b12d-49a4-a73f-ed65a9f19182 => generated 1220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:03.873101 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6e966069-65ba-4820-82da-44e133a3e28d tempest-HypervisorAdminTestJSON-276469515 tempest-HypervisorAdminTestJSON-276469515-project-admin] Calling method '.version_select at 0x7f7ddb7efee0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:03.875731 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-fd593c3f-4ce2-4cd6-b9af-5b773d59836c tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:03.875731 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-fd593c3f-4ce2-4cd6-b9af-5b773d59836c tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] [instance: 820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:03.875880 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6e966069-65ba-4820-82da-44e133a3e28d tempest-HypervisorAdminTestJSON-276469515 tempest-HypervisorAdminTestJSON-276469515-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:03.876353 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6e966069-65ba-4820-82da-44e133a3e28d tempest-HypervisorAdminTestJSON-276469515 tempest-HypervisorAdminTestJSON-276469515-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:03.876791 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6e966069-65ba-4820-82da-44e133a3e28d tempest-HypervisorAdminTestJSON-276469515 tempest-HypervisorAdminTestJSON-276469515-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:03.882378 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fd593c3f-4ce2-4cd6-b9af-5b773d59836c tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:03.883068 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fd593c3f-4ce2-4cd6-b9af-5b773d59836c tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:03.883654 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fd593c3f-4ce2-4cd6-b9af-5b773d59836c tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:03.884514 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fd593c3f-4ce2-4cd6-b9af-5b773d59836c tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:03.885116 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fd593c3f-4ce2-4cd6-b9af-5b773d59836c tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:03.885699 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fd593c3f-4ce2-4cd6-b9af-5b773d59836c tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:03.915117 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6e966069-65ba-4820-82da-44e133a3e28d tempest-HypervisorAdminTestJSON-276469515 tempest-HypervisorAdminTestJSON-276469515-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:03.915836 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6e966069-65ba-4820-82da-44e133a3e28d tempest-HypervisorAdminTestJSON-276469515 tempest-HypervisorAdminTestJSON-276469515-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:03.916803 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6e966069-65ba-4820-82da-44e133a3e28d tempest-HypervisorAdminTestJSON-276469515 tempest-HypervisorAdminTestJSON-276469515-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:03.929375 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6e966069-65ba-4820-82da-44e133a3e28d tempest-HypervisorAdminTestJSON-276469515 tempest-HypervisorAdminTestJSON-276469515-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:03.930368 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6e966069-65ba-4820-82da-44e133a3e28d tempest-HypervisorAdminTestJSON-276469515 tempest-HypervisorAdminTestJSON-276469515-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:03.931043 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6e966069-65ba-4820-82da-44e133a3e28d tempest-HypervisorAdminTestJSON-276469515 tempest-HypervisorAdminTestJSON-276469515-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:03.938930 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6e966069-65ba-4820-82da-44e133a3e28d tempest-HypervisorAdminTestJSON-276469515 tempest-HypervisorAdminTestJSON-276469515-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.206611 Oct 27 03:21:03.940559 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 53/112] 10.222.0.20 () {58 vars in 1146 bytes} [Thu Oct 27 03:21:03 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:21:03.947581 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4f90662a-2f4f-4e60-8b5d-ff1ba245bde0 tempest-HypervisorAdminUnderV252Test-1193436543 tempest-HypervisorAdminUnderV252Test-1193436543-project-admin] Calling method '.version_select at 0x7f7ddb817280>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:03.956471 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4f90662a-2f4f-4e60-8b5d-ff1ba245bde0 tempest-HypervisorAdminUnderV252Test-1193436543 tempest-HypervisorAdminUnderV252Test-1193436543-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:03.957040 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4f90662a-2f4f-4e60-8b5d-ff1ba245bde0 tempest-HypervisorAdminUnderV252Test-1193436543 tempest-HypervisorAdminUnderV252Test-1193436543-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:03.957570 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4f90662a-2f4f-4e60-8b5d-ff1ba245bde0 tempest-HypervisorAdminUnderV252Test-1193436543 tempest-HypervisorAdminUnderV252Test-1193436543-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:03.983105 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-fd593c3f-4ce2-4cd6-b9af-5b773d59836c tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015a9fcd508e4d20ad51dcb71053c28f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cee0e3469fc42a49004f9b5d1f5b6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:03.995063 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4f90662a-2f4f-4e60-8b5d-ff1ba245bde0 tempest-HypervisorAdminUnderV252Test-1193436543 tempest-HypervisorAdminUnderV252Test-1193436543-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:03.996197 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4f90662a-2f4f-4e60-8b5d-ff1ba245bde0 tempest-HypervisorAdminUnderV252Test-1193436543 tempest-HypervisorAdminUnderV252Test-1193436543-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:03.996892 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4f90662a-2f4f-4e60-8b5d-ff1ba245bde0 tempest-HypervisorAdminUnderV252Test-1193436543 tempest-HypervisorAdminUnderV252Test-1193436543-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:04.001606 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-fd593c3f-4ce2-4cd6-b9af-5b773d59836c tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] 10.222.0.20 "GET /compute/v2.1/servers/820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5" status: 200 len: 1297 microversion: 2.1 time: 0.130339 Oct 27 03:21:04.014344 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 60/113] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:03 2022] GET /compute/v2.1/servers/820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5 => generated 1297 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:04.019205 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1757ed97-c53f-4f22-bf93-d700eb53b5d9 tempest-HypervisorAdminTestJSON-276469515 tempest-HypervisorAdminTestJSON-276469515-project-admin] Calling method '.version_select at 0x7f7ddb59d820>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:04.021488 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1757ed97-c53f-4f22-bf93-d700eb53b5d9 tempest-HypervisorAdminTestJSON-276469515 tempest-HypervisorAdminTestJSON-276469515-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:04.022215 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1757ed97-c53f-4f22-bf93-d700eb53b5d9 tempest-HypervisorAdminTestJSON-276469515 tempest-HypervisorAdminTestJSON-276469515-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:04.022853 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1757ed97-c53f-4f22-bf93-d700eb53b5d9 tempest-HypervisorAdminTestJSON-276469515 tempest-HypervisorAdminTestJSON-276469515-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:04.042100 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1757ed97-c53f-4f22-bf93-d700eb53b5d9 tempest-HypervisorAdminTestJSON-276469515 tempest-HypervisorAdminTestJSON-276469515-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:04.042597 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1757ed97-c53f-4f22-bf93-d700eb53b5d9 tempest-HypervisorAdminTestJSON-276469515 tempest-HypervisorAdminTestJSON-276469515-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:04.043094 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1757ed97-c53f-4f22-bf93-d700eb53b5d9 tempest-HypervisorAdminTestJSON-276469515 tempest-HypervisorAdminTestJSON-276469515-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:04.055324 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1757ed97-c53f-4f22-bf93-d700eb53b5d9 tempest-HypervisorAdminTestJSON-276469515 tempest-HypervisorAdminTestJSON-276469515-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:04.056312 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1757ed97-c53f-4f22-bf93-d700eb53b5d9 tempest-HypervisorAdminTestJSON-276469515 tempest-HypervisorAdminTestJSON-276469515-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:04.057107 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1757ed97-c53f-4f22-bf93-d700eb53b5d9 tempest-HypervisorAdminTestJSON-276469515 tempest-HypervisorAdminTestJSON-276469515-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:04.065462 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4f90662a-2f4f-4e60-8b5d-ff1ba245bde0 tempest-HypervisorAdminUnderV252Test-1193436543 tempest-HypervisorAdminUnderV252Test-1193436543-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:04.066181 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4f90662a-2f4f-4e60-8b5d-ff1ba245bde0 tempest-HypervisorAdminUnderV252Test-1193436543 tempest-HypervisorAdminUnderV252Test-1193436543-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:04.066525 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1757ed97-c53f-4f22-bf93-d700eb53b5d9 tempest-HypervisorAdminTestJSON-276469515 tempest-HypervisorAdminTestJSON-276469515-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1504 microversion: 2.1 time: 0.055684 Oct 27 03:21:04.067642 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4f90662a-2f4f-4e60-8b5d-ff1ba245bde0 tempest-HypervisorAdminUnderV252Test-1193436543 tempest-HypervisorAdminUnderV252Test-1193436543-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:04.068055 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 61/114] 10.222.0.20 () {58 vars in 1167 bytes} [Thu Oct 27 03:21:04 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1504 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:04.073395 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4f90662a-2f4f-4e60-8b5d-ff1ba245bde0 tempest-HypervisorAdminUnderV252Test-1193436543 tempest-HypervisorAdminUnderV252Test-1193436543-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/n-h2-862769-1/servers" status: 200 len: 196 microversion: 2.1 time: 0.131653 Oct 27 03:21:04.073956 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 54/115] 10.222.0.20 () {58 vars in 1212 bytes} [Thu Oct 27 03:21:03 2022] GET /compute/v2.1/os-hypervisors/n-h2-862769-1/servers => generated 196 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:21:04.090562 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d82aa1d1-789e-49a6-80ea-b20420f89b57 tempest-HypervisorAdminTestJSON-276469515 tempest-HypervisorAdminTestJSON-276469515-project-admin] Calling method '.version_select at 0x7f7ddb68f940>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:04.093029 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d82aa1d1-789e-49a6-80ea-b20420f89b57 tempest-HypervisorAdminTestJSON-276469515 tempest-HypervisorAdminTestJSON-276469515-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:04.094294 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d82aa1d1-789e-49a6-80ea-b20420f89b57 tempest-HypervisorAdminTestJSON-276469515 tempest-HypervisorAdminTestJSON-276469515-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:04.094915 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d82aa1d1-789e-49a6-80ea-b20420f89b57 tempest-HypervisorAdminTestJSON-276469515 tempest-HypervisorAdminTestJSON-276469515-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:04.105681 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4d0f59f2-ad06-4401-b07c-d72e69eb105b tempest-HypervisorAdminUnderV252Test-1193436543 tempest-HypervisorAdminUnderV252Test-1193436543-project-admin] Calling method '.version_select at 0x7f7ddb9b2700>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:04.111494 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4d0f59f2-ad06-4401-b07c-d72e69eb105b tempest-HypervisorAdminUnderV252Test-1193436543 tempest-HypervisorAdminUnderV252Test-1193436543-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:04.114533 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4d0f59f2-ad06-4401-b07c-d72e69eb105b tempest-HypervisorAdminUnderV252Test-1193436543 tempest-HypervisorAdminUnderV252Test-1193436543-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:04.115110 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4d0f59f2-ad06-4401-b07c-d72e69eb105b tempest-HypervisorAdminUnderV252Test-1193436543 tempest-HypervisorAdminUnderV252Test-1193436543-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:04.115456 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d82aa1d1-789e-49a6-80ea-b20420f89b57 tempest-HypervisorAdminTestJSON-276469515 tempest-HypervisorAdminTestJSON-276469515-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:04.116482 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d82aa1d1-789e-49a6-80ea-b20420f89b57 tempest-HypervisorAdminTestJSON-276469515 tempest-HypervisorAdminTestJSON-276469515-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:04.117056 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d82aa1d1-789e-49a6-80ea-b20420f89b57 tempest-HypervisorAdminTestJSON-276469515 tempest-HypervisorAdminTestJSON-276469515-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:04.130120 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d82aa1d1-789e-49a6-80ea-b20420f89b57 tempest-HypervisorAdminTestJSON-276469515 tempest-HypervisorAdminTestJSON-276469515-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:04.131010 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d82aa1d1-789e-49a6-80ea-b20420f89b57 tempest-HypervisorAdminTestJSON-276469515 tempest-HypervisorAdminTestJSON-276469515-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:04.131792 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d82aa1d1-789e-49a6-80ea-b20420f89b57 tempest-HypervisorAdminTestJSON-276469515 tempest-HypervisorAdminTestJSON-276469515-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:04.137016 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4d0f59f2-ad06-4401-b07c-d72e69eb105b tempest-HypervisorAdminUnderV252Test-1193436543 tempest-HypervisorAdminUnderV252Test-1193436543-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:04.138069 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4d0f59f2-ad06-4401-b07c-d72e69eb105b tempest-HypervisorAdminUnderV252Test-1193436543 tempest-HypervisorAdminUnderV252Test-1193436543-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:04.138858 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4d0f59f2-ad06-4401-b07c-d72e69eb105b tempest-HypervisorAdminUnderV252Test-1193436543 tempest-HypervisorAdminUnderV252Test-1193436543-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:04.143922 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d82aa1d1-789e-49a6-80ea-b20420f89b57 tempest-HypervisorAdminTestJSON-276469515 tempest-HypervisorAdminTestJSON-276469515-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.053905 Oct 27 03:21:04.143922 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 62/116] 10.222.0.20 () {58 vars in 1146 bytes} [Thu Oct 27 03:21:04 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:21:04.156654 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c9184051-7b9a-41c3-9cc0-323c96d3425b tempest-HypervisorAdminTestJSON-276469515 tempest-HypervisorAdminTestJSON-276469515-project-admin] Calling method '.version_select at 0x7f7ddb68fb80>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:04.161135 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c9184051-7b9a-41c3-9cc0-323c96d3425b tempest-HypervisorAdminTestJSON-276469515 tempest-HypervisorAdminTestJSON-276469515-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:04.161135 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c9184051-7b9a-41c3-9cc0-323c96d3425b tempest-HypervisorAdminTestJSON-276469515 tempest-HypervisorAdminTestJSON-276469515-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:04.161135 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c9184051-7b9a-41c3-9cc0-323c96d3425b tempest-HypervisorAdminTestJSON-276469515 tempest-HypervisorAdminTestJSON-276469515-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:04.163766 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4d0f59f2-ad06-4401-b07c-d72e69eb105b tempest-HypervisorAdminUnderV252Test-1193436543 tempest-HypervisorAdminUnderV252Test-1193436543-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:04.164379 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4d0f59f2-ad06-4401-b07c-d72e69eb105b tempest-HypervisorAdminUnderV252Test-1193436543 tempest-HypervisorAdminUnderV252Test-1193436543-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:04.164912 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4d0f59f2-ad06-4401-b07c-d72e69eb105b tempest-HypervisorAdminUnderV252Test-1193436543 tempest-HypervisorAdminUnderV252Test-1193436543-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:04.192290 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4d0f59f2-ad06-4401-b07c-d72e69eb105b tempest-HypervisorAdminUnderV252Test-1193436543 tempest-HypervisorAdminUnderV252Test-1193436543-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.094948 Oct 27 03:21:04.197160 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 55/117] 10.222.0.20 () {58 vars in 1146 bytes} [Thu Oct 27 03:21:04 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:21:04.216172 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-71ebb637-e70e-409e-ab36-54ce1831ae09 tempest-HypervisorAdminUnderV252Test-1193436543 tempest-HypervisorAdminUnderV252Test-1193436543-project-admin] Calling method '.version_select at 0x7f7ddb720940>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:04.221913 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-71ebb637-e70e-409e-ab36-54ce1831ae09 tempest-HypervisorAdminUnderV252Test-1193436543 tempest-HypervisorAdminUnderV252Test-1193436543-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:04.227751 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-71ebb637-e70e-409e-ab36-54ce1831ae09 tempest-HypervisorAdminUnderV252Test-1193436543 tempest-HypervisorAdminUnderV252Test-1193436543-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:04.227751 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-71ebb637-e70e-409e-ab36-54ce1831ae09 tempest-HypervisorAdminUnderV252Test-1193436543 tempest-HypervisorAdminUnderV252Test-1193436543-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:04.228041 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c9184051-7b9a-41c3-9cc0-323c96d3425b tempest-HypervisorAdminTestJSON-276469515 tempest-HypervisorAdminTestJSON-276469515-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:04.228350 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c9184051-7b9a-41c3-9cc0-323c96d3425b tempest-HypervisorAdminTestJSON-276469515 tempest-HypervisorAdminTestJSON-276469515-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:04.229503 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c9184051-7b9a-41c3-9cc0-323c96d3425b tempest-HypervisorAdminTestJSON-276469515 tempest-HypervisorAdminTestJSON-276469515-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:04.247105 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c9184051-7b9a-41c3-9cc0-323c96d3425b tempest-HypervisorAdminTestJSON-276469515 tempest-HypervisorAdminTestJSON-276469515-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.094482 Oct 27 03:21:04.248590 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 63/118] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Oct 27 03:21:04 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:21:04.251096 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-71ebb637-e70e-409e-ab36-54ce1831ae09 tempest-HypervisorAdminUnderV252Test-1193436543 tempest-HypervisorAdminUnderV252Test-1193436543-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:04.252339 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-71ebb637-e70e-409e-ab36-54ce1831ae09 tempest-HypervisorAdminUnderV252Test-1193436543 tempest-HypervisorAdminUnderV252Test-1193436543-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:04.253489 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-71ebb637-e70e-409e-ab36-54ce1831ae09 tempest-HypervisorAdminUnderV252Test-1193436543 tempest-HypervisorAdminUnderV252Test-1193436543-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:04.266992 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-71ebb637-e70e-409e-ab36-54ce1831ae09 tempest-HypervisorAdminUnderV252Test-1193436543 tempest-HypervisorAdminUnderV252Test-1193436543-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/n-h2-862769-1/search" status: 200 len: 104 microversion: 2.1 time: 0.058297 Oct 27 03:21:04.278563 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 56/119] 10.222.0.20 () {58 vars in 1209 bytes} [Thu Oct 27 03:21:04 2022] GET /compute/v2.1/os-hypervisors/n-h2-862769-1/search => generated 104 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:21:04.279077 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2c7355fc-fc54-4733-a8c9-5b95752180eb tempest-HypervisorAdminTestJSON-276469515 tempest-HypervisorAdminTestJSON-276469515-project-admin] Calling method '.version_select at 0x7f7ddb59d5e0>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:04.279397 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2c7355fc-fc54-4733-a8c9-5b95752180eb tempest-HypervisorAdminTestJSON-276469515 tempest-HypervisorAdminTestJSON-276469515-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:04.279787 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2c7355fc-fc54-4733-a8c9-5b95752180eb tempest-HypervisorAdminTestJSON-276469515 tempest-HypervisorAdminTestJSON-276469515-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:04.280116 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2c7355fc-fc54-4733-a8c9-5b95752180eb tempest-HypervisorAdminTestJSON-276469515 tempest-HypervisorAdminTestJSON-276469515-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:04.325789 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2c7355fc-fc54-4733-a8c9-5b95752180eb tempest-HypervisorAdminTestJSON-276469515 tempest-HypervisorAdminTestJSON-276469515-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.055130 Oct 27 03:21:04.338089 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 64/120] 10.222.0.20 () {58 vars in 1179 bytes} [Thu Oct 27 03:21:04 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:21:04.366798 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-afb4bebd-4d8e-4467-96b1-abc15c838401 tempest-HypervisorAdminTestJSON-276469515 tempest-HypervisorAdminTestJSON-276469515-project-admin] Calling method '.version_select at 0x7f7ddb740b80>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:04.371715 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-afb4bebd-4d8e-4467-96b1-abc15c838401 tempest-HypervisorAdminTestJSON-276469515 tempest-HypervisorAdminTestJSON-276469515-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:04.379015 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-afb4bebd-4d8e-4467-96b1-abc15c838401 tempest-HypervisorAdminTestJSON-276469515 tempest-HypervisorAdminTestJSON-276469515-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:04.379015 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-afb4bebd-4d8e-4467-96b1-abc15c838401 tempest-HypervisorAdminTestJSON-276469515 tempest-HypervisorAdminTestJSON-276469515-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:04.400423 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-afb4bebd-4d8e-4467-96b1-abc15c838401 tempest-HypervisorAdminTestJSON-276469515 tempest-HypervisorAdminTestJSON-276469515-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:04.401766 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-afb4bebd-4d8e-4467-96b1-abc15c838401 tempest-HypervisorAdminTestJSON-276469515 tempest-HypervisorAdminTestJSON-276469515-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:04.407797 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-afb4bebd-4d8e-4467-96b1-abc15c838401 tempest-HypervisorAdminTestJSON-276469515 tempest-HypervisorAdminTestJSON-276469515-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:04.420343 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-afb4bebd-4d8e-4467-96b1-abc15c838401 tempest-HypervisorAdminTestJSON-276469515 tempest-HypervisorAdminTestJSON-276469515-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:04.421521 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-afb4bebd-4d8e-4467-96b1-abc15c838401 tempest-HypervisorAdminTestJSON-276469515 tempest-HypervisorAdminTestJSON-276469515-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:04.423284 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-afb4bebd-4d8e-4467-96b1-abc15c838401 tempest-HypervisorAdminTestJSON-276469515 tempest-HypervisorAdminTestJSON-276469515-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:04.435451 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-afb4bebd-4d8e-4467-96b1-abc15c838401 tempest-HypervisorAdminTestJSON-276469515 tempest-HypervisorAdminTestJSON-276469515-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.075881 Oct 27 03:21:04.436792 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 57/121] 10.222.0.20 () {58 vars in 1146 bytes} [Thu Oct 27 03:21:04 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:21:04.450519 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b856be73-168a-4764-b73f-2ff86f09262e tempest-HypervisorAdminTestJSON-276469515 tempest-HypervisorAdminTestJSON-276469515-project-admin] Calling method '.version_select at 0x7f7ddb59ddc0>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:04.454652 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b856be73-168a-4764-b73f-2ff86f09262e tempest-HypervisorAdminTestJSON-276469515 tempest-HypervisorAdminTestJSON-276469515-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:04.455792 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b856be73-168a-4764-b73f-2ff86f09262e tempest-HypervisorAdminTestJSON-276469515 tempest-HypervisorAdminTestJSON-276469515-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:04.456611 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b856be73-168a-4764-b73f-2ff86f09262e tempest-HypervisorAdminTestJSON-276469515 tempest-HypervisorAdminTestJSON-276469515-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:04.482570 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b856be73-168a-4764-b73f-2ff86f09262e tempest-HypervisorAdminTestJSON-276469515 tempest-HypervisorAdminTestJSON-276469515-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:04.483392 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b856be73-168a-4764-b73f-2ff86f09262e tempest-HypervisorAdminTestJSON-276469515 tempest-HypervisorAdminTestJSON-276469515-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:04.484131 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b856be73-168a-4764-b73f-2ff86f09262e tempest-HypervisorAdminTestJSON-276469515 tempest-HypervisorAdminTestJSON-276469515-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:04.494177 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b856be73-168a-4764-b73f-2ff86f09262e tempest-HypervisorAdminTestJSON-276469515 tempest-HypervisorAdminTestJSON-276469515-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.049893 Oct 27 03:21:04.498330 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 65/122] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Oct 27 03:21:04 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:21:04.516460 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4fba924e-7df7-43de-a1e1-ea47f4ae7f57 tempest-HypervisorAdminTestJSON-276469515 tempest-HypervisorAdminTestJSON-276469515-project-admin] Calling method '.version_select at 0x7f7ddb740940>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:04.532045 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4fba924e-7df7-43de-a1e1-ea47f4ae7f57 tempest-HypervisorAdminTestJSON-276469515 tempest-HypervisorAdminTestJSON-276469515-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:04.532045 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4fba924e-7df7-43de-a1e1-ea47f4ae7f57 tempest-HypervisorAdminTestJSON-276469515 tempest-HypervisorAdminTestJSON-276469515-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:04.533447 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4fba924e-7df7-43de-a1e1-ea47f4ae7f57 tempest-HypervisorAdminTestJSON-276469515 tempest-HypervisorAdminTestJSON-276469515-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:04.553488 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4fba924e-7df7-43de-a1e1-ea47f4ae7f57 tempest-HypervisorAdminTestJSON-276469515 tempest-HypervisorAdminTestJSON-276469515-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:04.554208 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4fba924e-7df7-43de-a1e1-ea47f4ae7f57 tempest-HypervisorAdminTestJSON-276469515 tempest-HypervisorAdminTestJSON-276469515-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:04.554794 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4fba924e-7df7-43de-a1e1-ea47f4ae7f57 tempest-HypervisorAdminTestJSON-276469515 tempest-HypervisorAdminTestJSON-276469515-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:04.562511 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4fba924e-7df7-43de-a1e1-ea47f4ae7f57 tempest-HypervisorAdminTestJSON-276469515 tempest-HypervisorAdminTestJSON-276469515-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 757 microversion: 2.1 time: 0.055933 Oct 27 03:21:04.563247 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 58/123] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Oct 27 03:21:04 2022] GET /compute/v2.1/os-hypervisors/2 => generated 757 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:21:04.579929 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c619a71d-eebd-4f6e-b984-a14027f01d4c tempest-HypervisorAdminTestJSON-276469515 tempest-HypervisorAdminTestJSON-276469515-project-admin] Calling method '.version_select at 0x7f7ddb59d790>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:04.582319 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c619a71d-eebd-4f6e-b984-a14027f01d4c tempest-HypervisorAdminTestJSON-276469515 tempest-HypervisorAdminTestJSON-276469515-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:04.582810 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c619a71d-eebd-4f6e-b984-a14027f01d4c tempest-HypervisorAdminTestJSON-276469515 tempest-HypervisorAdminTestJSON-276469515-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:04.583257 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c619a71d-eebd-4f6e-b984-a14027f01d4c tempest-HypervisorAdminTestJSON-276469515 tempest-HypervisorAdminTestJSON-276469515-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:04.620405 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c619a71d-eebd-4f6e-b984-a14027f01d4c tempest-HypervisorAdminTestJSON-276469515 tempest-HypervisorAdminTestJSON-276469515-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:04.621501 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c619a71d-eebd-4f6e-b984-a14027f01d4c tempest-HypervisorAdminTestJSON-276469515 tempest-HypervisorAdminTestJSON-276469515-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:04.622743 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c619a71d-eebd-4f6e-b984-a14027f01d4c tempest-HypervisorAdminTestJSON-276469515 tempest-HypervisorAdminTestJSON-276469515-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:04.660960 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c619a71d-eebd-4f6e-b984-a14027f01d4c tempest-HypervisorAdminTestJSON-276469515 tempest-HypervisorAdminTestJSON-276469515-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:04.663378 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c619a71d-eebd-4f6e-b984-a14027f01d4c tempest-HypervisorAdminTestJSON-276469515 tempest-HypervisorAdminTestJSON-276469515-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:04.664053 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c619a71d-eebd-4f6e-b984-a14027f01d4c tempest-HypervisorAdminTestJSON-276469515 tempest-HypervisorAdminTestJSON-276469515-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:04.677625 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c619a71d-eebd-4f6e-b984-a14027f01d4c tempest-HypervisorAdminTestJSON-276469515 tempest-HypervisorAdminTestJSON-276469515-project-admin] Acquiring lock "compute-rpcapi-router" {{(pid=121000) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 27 03:21:04.678643 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c619a71d-eebd-4f6e-b984-a14027f01d4c tempest-HypervisorAdminTestJSON-276469515 tempest-HypervisorAdminTestJSON-276469515-project-admin] Acquired lock "compute-rpcapi-router" {{(pid=121000) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 27 03:21:04.682742 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e60ad7ce-feb3-4351-a56c-a1e341a4deeb None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:04.683765 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e60ad7ce-feb3-4351-a56c-a1e341a4deeb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:04.688141 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e60ad7ce-feb3-4351-a56c-a1e341a4deeb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:04.689226 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e60ad7ce-feb3-4351-a56c-a1e341a4deeb None None] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:04.692104 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e60ad7ce-feb3-4351-a56c-a1e341a4deeb None None] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:04.692977 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e60ad7ce-feb3-4351-a56c-a1e341a4deeb None None] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:04.706921 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.compute.rpcapi [None req-e60ad7ce-feb3-4351-a56c-a1e341a4deeb None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 27 03:21:04.708244 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e60ad7ce-feb3-4351-a56c-a1e341a4deeb None None] Releasing lock "compute-rpcapi-router" {{(pid=121000) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 27 03:21:04.760589 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e60ad7ce-feb3-4351-a56c-a1e341a4deeb None None] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.185885 Oct 27 03:21:04.762067 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 66/124] 10.222.0.20 () {58 vars in 1173 bytes} [Thu Oct 27 03:21:04 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:21:04.895026 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9308f14e-0556-4ab8-97de-4cbc8ad4caa9 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:04.896386 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-9308f14e-0556-4ab8-97de-4cbc8ad4caa9 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] [instance: 238948a5-b12d-49a4-a73f-ed65a9f19182] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:05.047592 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-198f5408-4567-4e3f-8ae4-0c2690723faa tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:05.048610 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-198f5408-4567-4e3f-8ae4-0c2690723faa tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] [instance: 820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:05.060996 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9308f14e-0556-4ab8-97de-4cbc8ad4caa9 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff070c0383324e1da5c49e3d9c652516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1da8ce26ab49ddae972233777c4c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:05.070153 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9308f14e-0556-4ab8-97de-4cbc8ad4caa9 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] 10.222.0.20 "GET /compute/v2.1/servers/238948a5-b12d-49a4-a73f-ed65a9f19182" status: 200 len: 1220 microversion: 2.1 time: 0.180779 Oct 27 03:21:05.075103 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 59/125] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:04 2022] GET /compute/v2.1/servers/238948a5-b12d-49a4-a73f-ed65a9f19182 => generated 1220 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:05.076850 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-198f5408-4567-4e3f-8ae4-0c2690723faa tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:05.077741 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-198f5408-4567-4e3f-8ae4-0c2690723faa tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:05.078953 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-198f5408-4567-4e3f-8ae4-0c2690723faa tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:05.079880 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-198f5408-4567-4e3f-8ae4-0c2690723faa tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:05.080546 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-198f5408-4567-4e3f-8ae4-0c2690723faa tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:05.081176 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-198f5408-4567-4e3f-8ae4-0c2690723faa tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:05.434875 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-198f5408-4567-4e3f-8ae4-0c2690723faa tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015a9fcd508e4d20ad51dcb71053c28f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cee0e3469fc42a49004f9b5d1f5b6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:05.442856 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-198f5408-4567-4e3f-8ae4-0c2690723faa tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] 10.222.0.20 "GET /compute/v2.1/servers/820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5" status: 200 len: 1339 microversion: 2.1 time: 0.399572 Oct 27 03:21:05.443680 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 67/126] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:05 2022] GET /compute/v2.1/servers/820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5 => generated 1339 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:06.098766 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1f3cfb86-0c3d-477c-99bb-ced478bf07ea tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:06.099419 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1f3cfb86-0c3d-477c-99bb-ced478bf07ea tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] [instance: 238948a5-b12d-49a4-a73f-ed65a9f19182] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:06.344924 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1f3cfb86-0c3d-477c-99bb-ced478bf07ea tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff070c0383324e1da5c49e3d9c652516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1da8ce26ab49ddae972233777c4c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:06.356868 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1f3cfb86-0c3d-477c-99bb-ced478bf07ea tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] 10.222.0.20 "GET /compute/v2.1/servers/238948a5-b12d-49a4-a73f-ed65a9f19182" status: 200 len: 1220 microversion: 2.1 time: 0.261011 Oct 27 03:21:06.376047 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 60/127] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:06 2022] GET /compute/v2.1/servers/238948a5-b12d-49a4-a73f-ed65a9f19182 => generated 1220 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:21:06.481662 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1d81112b-57f8-417a-ae95-f775558709c2 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:06.483375 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1d81112b-57f8-417a-ae95-f775558709c2 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] [instance: 820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:06.501061 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1d81112b-57f8-417a-ae95-f775558709c2 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:06.507253 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1d81112b-57f8-417a-ae95-f775558709c2 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:06.507253 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1d81112b-57f8-417a-ae95-f775558709c2 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:06.507253 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1d81112b-57f8-417a-ae95-f775558709c2 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:06.507253 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1d81112b-57f8-417a-ae95-f775558709c2 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:06.507552 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1d81112b-57f8-417a-ae95-f775558709c2 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:06.740401 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1d81112b-57f8-417a-ae95-f775558709c2 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015a9fcd508e4d20ad51dcb71053c28f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cee0e3469fc42a49004f9b5d1f5b6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:06.755766 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1d81112b-57f8-417a-ae95-f775558709c2 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] 10.222.0.20 "GET /compute/v2.1/servers/820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5" status: 200 len: 1339 microversion: 2.1 time: 0.281405 Oct 27 03:21:06.767629 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 68/128] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:06 2022] GET /compute/v2.1/servers/820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5 => generated 1339 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:21:07.384689 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-aecad48f-e9f9-4c3b-af5c-944ade640fb5 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:07.385392 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-aecad48f-e9f9-4c3b-af5c-944ade640fb5 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] [instance: 238948a5-b12d-49a4-a73f-ed65a9f19182] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:07.396353 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aecad48f-e9f9-4c3b-af5c-944ade640fb5 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:07.404805 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aecad48f-e9f9-4c3b-af5c-944ade640fb5 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:07.405267 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aecad48f-e9f9-4c3b-af5c-944ade640fb5 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:07.406564 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aecad48f-e9f9-4c3b-af5c-944ade640fb5 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:07.407038 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aecad48f-e9f9-4c3b-af5c-944ade640fb5 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:07.407470 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aecad48f-e9f9-4c3b-af5c-944ade640fb5 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:07.623772 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-aecad48f-e9f9-4c3b-af5c-944ade640fb5 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff070c0383324e1da5c49e3d9c652516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1da8ce26ab49ddae972233777c4c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:07.644728 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-aecad48f-e9f9-4c3b-af5c-944ade640fb5 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] 10.222.0.20 "GET /compute/v2.1/servers/238948a5-b12d-49a4-a73f-ed65a9f19182" status: 200 len: 1272 microversion: 2.1 time: 0.263779 Oct 27 03:21:07.645946 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 61/129] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:07 2022] GET /compute/v2.1/servers/238948a5-b12d-49a4-a73f-ed65a9f19182 => generated 1272 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:07.785161 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d2527a93-e026-4699-b4ff-00fc31bcf701 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:07.785790 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d2527a93-e026-4699-b4ff-00fc31bcf701 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] [instance: 820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:07.801254 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d2527a93-e026-4699-b4ff-00fc31bcf701 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:07.802002 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d2527a93-e026-4699-b4ff-00fc31bcf701 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:07.802543 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d2527a93-e026-4699-b4ff-00fc31bcf701 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:07.803266 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d2527a93-e026-4699-b4ff-00fc31bcf701 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:07.804814 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d2527a93-e026-4699-b4ff-00fc31bcf701 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:07.805476 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d2527a93-e026-4699-b4ff-00fc31bcf701 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:08.025560 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d2527a93-e026-4699-b4ff-00fc31bcf701 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015a9fcd508e4d20ad51dcb71053c28f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cee0e3469fc42a49004f9b5d1f5b6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:08.037487 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d2527a93-e026-4699-b4ff-00fc31bcf701 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] 10.222.0.20 "GET /compute/v2.1/servers/820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5" status: 200 len: 1339 microversion: 2.1 time: 0.256322 Oct 27 03:21:08.039784 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 69/130] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:07 2022] GET /compute/v2.1/servers/820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5 => generated 1339 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:08.528840 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-c0fe75ea-d163-4154-a026-765395c72bbf req-cc56cfee-f2b8-4712-9acc-ce21c4ff32fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5", "tag": "7281d005-1139-42c9-b8d2-f7f602562c0c"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:21:08.548627 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-c0fe75ea-d163-4154-a026-765395c72bbf req-cc56cfee-f2b8-4712-9acc-ce21c4ff32fd service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:08.549538 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-c0fe75ea-d163-4154-a026-765395c72bbf req-cc56cfee-f2b8-4712-9acc-ce21c4ff32fd service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:08.550255 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-c0fe75ea-d163-4154-a026-765395c72bbf req-cc56cfee-f2b8-4712-9acc-ce21c4ff32fd service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:08.590937 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-c0fe75ea-d163-4154-a026-765395c72bbf req-cc56cfee-f2b8-4712-9acc-ce21c4ff32fd service nova] Creating event network-changed:7281d005-1139-42c9-b8d2-f7f602562c0c for instance 820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5 on n-h2-862769-1 Oct 27 03:21:08.592381 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-c0fe75ea-d163-4154-a026-765395c72bbf req-cc56cfee-f2b8-4712-9acc-ce21c4ff32fd service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121001) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 27 03:21:08.592983 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-c0fe75ea-d163-4154-a026-765395c72bbf req-cc56cfee-f2b8-4712-9acc-ce21c4ff32fd service nova] Acquired lock "compute-rpcapi-router" {{(pid=121001) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 27 03:21:08.595794 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e9df79e1-5329-4c42-8c6a-3663d34942f3 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:08.608634 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e9df79e1-5329-4c42-8c6a-3663d34942f3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:08.610574 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e9df79e1-5329-4c42-8c6a-3663d34942f3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:08.612457 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e9df79e1-5329-4c42-8c6a-3663d34942f3 None None] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:08.616462 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e9df79e1-5329-4c42-8c6a-3663d34942f3 None None] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:08.616462 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e9df79e1-5329-4c42-8c6a-3663d34942f3 None None] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:08.661762 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.compute.rpcapi [None req-e9df79e1-5329-4c42-8c6a-3663d34942f3 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 27 03:21:08.663507 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e9df79e1-5329-4c42-8c6a-3663d34942f3 None None] Releasing lock "compute-rpcapi-router" {{(pid=121001) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 27 03:21:08.670934 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2a9003e0-ddb5-4a45-b66f-40139d35b849 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:08.673731 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-2a9003e0-ddb5-4a45-b66f-40139d35b849 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] [instance: 238948a5-b12d-49a4-a73f-ed65a9f19182] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:08.698704 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2a9003e0-ddb5-4a45-b66f-40139d35b849 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:08.705544 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2a9003e0-ddb5-4a45-b66f-40139d35b849 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:08.705544 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2a9003e0-ddb5-4a45-b66f-40139d35b849 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:08.707754 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e9df79e1-5329-4c42-8c6a-3663d34942f3 None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.414608 Oct 27 03:21:08.708372 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 62/131] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:21:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:21:08.711794 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2a9003e0-ddb5-4a45-b66f-40139d35b849 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:08.712512 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2a9003e0-ddb5-4a45-b66f-40139d35b849 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:08.713616 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2a9003e0-ddb5-4a45-b66f-40139d35b849 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:09.105447 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2a9003e0-ddb5-4a45-b66f-40139d35b849 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff070c0383324e1da5c49e3d9c652516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1da8ce26ab49ddae972233777c4c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:09.114571 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2a9003e0-ddb5-4a45-b66f-40139d35b849 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] 10.222.0.20 "GET /compute/v2.1/servers/238948a5-b12d-49a4-a73f-ed65a9f19182" status: 200 len: 1278 microversion: 2.1 time: 0.449339 Oct 27 03:21:09.115160 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 70/132] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:08 2022] GET /compute/v2.1/servers/238948a5-b12d-49a4-a73f-ed65a9f19182 => generated 1278 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:21:09.136329 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0b262fc2-ba67-4a6f-bac4-f5b4f99314ac tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:09.137187 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0b262fc2-ba67-4a6f-bac4-f5b4f99314ac tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] [instance: 820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:09.144371 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0b262fc2-ba67-4a6f-bac4-f5b4f99314ac tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:09.145293 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0b262fc2-ba67-4a6f-bac4-f5b4f99314ac tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:09.145925 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0b262fc2-ba67-4a6f-bac4-f5b4f99314ac tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:09.146887 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0b262fc2-ba67-4a6f-bac4-f5b4f99314ac tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:09.147530 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0b262fc2-ba67-4a6f-bac4-f5b4f99314ac tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:09.148145 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0b262fc2-ba67-4a6f-bac4-f5b4f99314ac tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:09.170972 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9eca0d8b-dab6-400c-85f4-25aa08559e48 tempest-QuotaClassesAdmin257Test-1711732145 tempest-QuotaClassesAdmin257Test-1711732145-project-admin] Calling method '.version_select at 0x7f7ddb749160>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:09.225516 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9eca0d8b-dab6-400c-85f4-25aa08559e48 tempest-QuotaClassesAdmin257Test-1711732145 tempest-QuotaClassesAdmin257Test-1711732145-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.350883 Oct 27 03:21:09.226644 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 63/133] 10.222.0.20 () {60 vars in 1226 bytes} [Thu Oct 27 03:21:08 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 03:21:09.255598 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f24b7ff2-41bb-44fa-949a-649c14cedf67 tempest-QuotaClassesAdmin257Test-1711732145 tempest-QuotaClassesAdmin257Test-1711732145-project-admin] Action: 'update', calling method: .version_select at 0x7f7ddb7494c0>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:21:09.635939 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0b262fc2-ba67-4a6f-bac4-f5b4f99314ac tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015a9fcd508e4d20ad51dcb71053c28f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cee0e3469fc42a49004f9b5d1f5b6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:09.646014 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0b262fc2-ba67-4a6f-bac4-f5b4f99314ac tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] 10.222.0.20 "GET /compute/v2.1/servers/820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5" status: 200 len: 1339 microversion: 2.1 time: 0.513707 Oct 27 03:21:09.650235 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 71/134] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:09 2022] GET /compute/v2.1/servers/820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5 => generated 1339 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:10.146265 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9730fa5c-9b39-4407-ad52-d390e2f30eae tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:10.147668 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9730fa5c-9b39-4407-ad52-d390e2f30eae tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] [instance: 238948a5-b12d-49a4-a73f-ed65a9f19182] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:10.165009 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9730fa5c-9b39-4407-ad52-d390e2f30eae tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:10.173367 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9730fa5c-9b39-4407-ad52-d390e2f30eae tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:10.174486 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9730fa5c-9b39-4407-ad52-d390e2f30eae tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:10.176469 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9730fa5c-9b39-4407-ad52-d390e2f30eae tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:10.177540 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9730fa5c-9b39-4407-ad52-d390e2f30eae tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:10.179457 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9730fa5c-9b39-4407-ad52-d390e2f30eae tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:10.221583 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=100 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:10.312947 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f24b7ff2-41bb-44fa-949a-649c14cedf67 tempest-QuotaClassesAdmin257Test-1711732145 tempest-QuotaClassesAdmin257Test-1711732145-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 1.070864 Oct 27 03:21:10.314024 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 64/135] 10.222.0.20 () {62 vars in 1247 bytes} [Thu Oct 27 03:21:09 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 03:21:10.340429 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9730fa5c-9b39-4407-ad52-d390e2f30eae tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff070c0383324e1da5c49e3d9c652516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1da8ce26ab49ddae972233777c4c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:10.348132 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-63c556ac-78ea-44b5-a017-6408bf3155a7 tempest-QuotaClassesAdmin257Test-1711732145 tempest-QuotaClassesAdmin257Test-1711732145-project-admin] Calling method '.version_select at 0x7f7ddb6d1430>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:10.351729 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9730fa5c-9b39-4407-ad52-d390e2f30eae tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] 10.222.0.20 "GET /compute/v2.1/servers/238948a5-b12d-49a4-a73f-ed65a9f19182" status: 200 len: 1278 microversion: 2.1 time: 0.209990 Oct 27 03:21:10.354745 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 72/136] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:10 2022] GET /compute/v2.1/servers/238948a5-b12d-49a4-a73f-ed65a9f19182 => generated 1278 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:10.414079 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-63c556ac-78ea-44b5-a017-6408bf3155a7 tempest-QuotaClassesAdmin257Test-1711732145 tempest-QuotaClassesAdmin257Test-1711732145-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.085660 Oct 27 03:21:10.427643 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 65/137] 10.222.0.20 () {60 vars in 1226 bytes} [Thu Oct 27 03:21:10 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 03:21:10.452537 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d47e068a-e3dd-44e9-afd7-703f627d5c0c tempest-QuotaClassesAdmin257Test-1711732145 tempest-QuotaClassesAdmin257Test-1711732145-project-admin] Action: 'update', calling method: .version_select at 0x7f7ddb4e00d0>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:21:10.685198 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b175bd01-0528-4bed-9395-f7b3eaa92ad0 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:10.686060 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b175bd01-0528-4bed-9395-f7b3eaa92ad0 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] [instance: 820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:10.716506 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b175bd01-0528-4bed-9395-f7b3eaa92ad0 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:10.723497 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b175bd01-0528-4bed-9395-f7b3eaa92ad0 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:10.728033 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b175bd01-0528-4bed-9395-f7b3eaa92ad0 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:10.738286 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b175bd01-0528-4bed-9395-f7b3eaa92ad0 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:10.739229 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b175bd01-0528-4bed-9395-f7b3eaa92ad0 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:10.741225 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b175bd01-0528-4bed-9395-f7b3eaa92ad0 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:11.164856 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d47e068a-e3dd-44e9-afd7-703f627d5c0c tempest-QuotaClassesAdmin257Test-1711732145 tempest-QuotaClassesAdmin257Test-1711732145-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.728929 Oct 27 03:21:11.169079 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 73/138] 10.222.0.20 () {62 vars in 1247 bytes} [Thu Oct 27 03:21:10 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 03:21:11.227905 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b175bd01-0528-4bed-9395-f7b3eaa92ad0 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015a9fcd508e4d20ad51dcb71053c28f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cee0e3469fc42a49004f9b5d1f5b6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:11.252881 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b175bd01-0528-4bed-9395-f7b3eaa92ad0 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] 10.222.0.20 "GET /compute/v2.1/servers/820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5" status: 200 len: 1339 microversion: 2.1 time: 0.572851 Oct 27 03:21:11.257936 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 66/139] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:10 2022] GET /compute/v2.1/servers/820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5 => generated 1339 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:11.381132 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-99e414e7-34ea-434f-a9b0-720078bcfaa9 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:11.382812 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-99e414e7-34ea-434f-a9b0-720078bcfaa9 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] [instance: 238948a5-b12d-49a4-a73f-ed65a9f19182] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:11.403527 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-99e414e7-34ea-434f-a9b0-720078bcfaa9 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:11.409500 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-99e414e7-34ea-434f-a9b0-720078bcfaa9 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:11.410943 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-99e414e7-34ea-434f-a9b0-720078bcfaa9 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:11.411931 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-99e414e7-34ea-434f-a9b0-720078bcfaa9 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:11.413467 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-99e414e7-34ea-434f-a9b0-720078bcfaa9 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:11.418743 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-99e414e7-34ea-434f-a9b0-720078bcfaa9 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:11.679938 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-99e414e7-34ea-434f-a9b0-720078bcfaa9 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff070c0383324e1da5c49e3d9c652516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1da8ce26ab49ddae972233777c4c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:11.692716 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-99e414e7-34ea-434f-a9b0-720078bcfaa9 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] 10.222.0.20 "GET /compute/v2.1/servers/238948a5-b12d-49a4-a73f-ed65a9f19182" status: 200 len: 1320 microversion: 2.1 time: 0.315623 Oct 27 03:21:11.709500 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 74/140] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:11 2022] GET /compute/v2.1/servers/238948a5-b12d-49a4-a73f-ed65a9f19182 => generated 1320 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:12.293768 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4c4a3b63-761f-4014-9d51-5172e14f2c8f tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:12.294557 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4c4a3b63-761f-4014-9d51-5172e14f2c8f tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] [instance: 820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:12.322653 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4c4a3b63-761f-4014-9d51-5172e14f2c8f tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:12.324409 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4c4a3b63-761f-4014-9d51-5172e14f2c8f tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:12.325024 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4c4a3b63-761f-4014-9d51-5172e14f2c8f tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:12.328380 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4c4a3b63-761f-4014-9d51-5172e14f2c8f tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:12.329058 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4c4a3b63-761f-4014-9d51-5172e14f2c8f tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:12.329638 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4c4a3b63-761f-4014-9d51-5172e14f2c8f tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:12.537675 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4c4a3b63-761f-4014-9d51-5172e14f2c8f tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015a9fcd508e4d20ad51dcb71053c28f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cee0e3469fc42a49004f9b5d1f5b6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:12.549699 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4c4a3b63-761f-4014-9d51-5172e14f2c8f tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] 10.222.0.20 "GET /compute/v2.1/servers/820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5" status: 200 len: 1339 microversion: 2.1 time: 0.260967 Oct 27 03:21:12.553248 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 67/141] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:12 2022] GET /compute/v2.1/servers/820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5 => generated 1339 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:12.727499 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e1d86701-f6b8-4abb-839f-bd26baf0db69 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:12.732427 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e1d86701-f6b8-4abb-839f-bd26baf0db69 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] [instance: 238948a5-b12d-49a4-a73f-ed65a9f19182] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:12.756997 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e1d86701-f6b8-4abb-839f-bd26baf0db69 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:12.757879 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e1d86701-f6b8-4abb-839f-bd26baf0db69 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:12.759065 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e1d86701-f6b8-4abb-839f-bd26baf0db69 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:12.766352 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e1d86701-f6b8-4abb-839f-bd26baf0db69 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:12.768806 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e1d86701-f6b8-4abb-839f-bd26baf0db69 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:12.771412 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e1d86701-f6b8-4abb-839f-bd26baf0db69 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:13.340046 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e1d86701-f6b8-4abb-839f-bd26baf0db69 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff070c0383324e1da5c49e3d9c652516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1da8ce26ab49ddae972233777c4c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:13.352315 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e1d86701-f6b8-4abb-839f-bd26baf0db69 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] 10.222.0.20 "GET /compute/v2.1/servers/238948a5-b12d-49a4-a73f-ed65a9f19182" status: 200 len: 1320 microversion: 2.1 time: 0.637890 Oct 27 03:21:13.355055 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 75/142] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:12 2022] GET /compute/v2.1/servers/238948a5-b12d-49a4-a73f-ed65a9f19182 => generated 1320 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:13.591071 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9934e8f7-5dcd-4a56-be35-7cfad656c1fa tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:13.592782 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-9934e8f7-5dcd-4a56-be35-7cfad656c1fa tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] [instance: 820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:13.608017 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9934e8f7-5dcd-4a56-be35-7cfad656c1fa tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:13.615484 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9934e8f7-5dcd-4a56-be35-7cfad656c1fa tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:13.615484 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9934e8f7-5dcd-4a56-be35-7cfad656c1fa tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:13.632991 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9934e8f7-5dcd-4a56-be35-7cfad656c1fa tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:13.633851 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9934e8f7-5dcd-4a56-be35-7cfad656c1fa tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:13.635694 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9934e8f7-5dcd-4a56-be35-7cfad656c1fa tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:14.083999 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9934e8f7-5dcd-4a56-be35-7cfad656c1fa tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015a9fcd508e4d20ad51dcb71053c28f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cee0e3469fc42a49004f9b5d1f5b6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:14.092396 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9934e8f7-5dcd-4a56-be35-7cfad656c1fa tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] 10.222.0.20 "GET /compute/v2.1/servers/820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5" status: 200 len: 1339 microversion: 2.1 time: 0.505571 Oct 27 03:21:14.112136 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 68/143] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:13 2022] GET /compute/v2.1/servers/820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5 => generated 1339 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:14.398318 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7a6792b7-d00e-4438-9961-1df93cb1f811 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:14.398318 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7a6792b7-d00e-4438-9961-1df93cb1f811 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] [instance: 238948a5-b12d-49a4-a73f-ed65a9f19182] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:14.403704 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7a6792b7-d00e-4438-9961-1df93cb1f811 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:14.410785 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7a6792b7-d00e-4438-9961-1df93cb1f811 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:14.415057 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7a6792b7-d00e-4438-9961-1df93cb1f811 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:14.416065 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7a6792b7-d00e-4438-9961-1df93cb1f811 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:14.416686 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7a6792b7-d00e-4438-9961-1df93cb1f811 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:14.418585 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7a6792b7-d00e-4438-9961-1df93cb1f811 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:14.704030 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=8 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:14.798010 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7a6792b7-d00e-4438-9961-1df93cb1f811 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff070c0383324e1da5c49e3d9c652516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1da8ce26ab49ddae972233777c4c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:14.840042 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7a6792b7-d00e-4438-9961-1df93cb1f811 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] 10.222.0.20 "GET /compute/v2.1/servers/238948a5-b12d-49a4-a73f-ed65a9f19182" status: 200 len: 1320 microversion: 2.1 time: 0.448779 Oct 27 03:21:14.870479 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 76/144] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:14 2022] GET /compute/v2.1/servers/238948a5-b12d-49a4-a73f-ed65a9f19182 => generated 1320 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:15.119074 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5821b943-c3a8-4dd2-b912-d0495255c24c tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:15.119928 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5821b943-c3a8-4dd2-b912-d0495255c24c tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] [instance: 820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:15.142238 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5821b943-c3a8-4dd2-b912-d0495255c24c tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:15.143171 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5821b943-c3a8-4dd2-b912-d0495255c24c tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:15.147479 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5821b943-c3a8-4dd2-b912-d0495255c24c tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:15.148912 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5821b943-c3a8-4dd2-b912-d0495255c24c tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:15.150793 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5821b943-c3a8-4dd2-b912-d0495255c24c tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:15.152653 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5821b943-c3a8-4dd2-b912-d0495255c24c tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:15.478701 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b997cac9-cc99-49d2-9458-c57e891adec0 tempest-HypervisorAdminNegativeTestJSON-1523476350 tempest-HypervisorAdminNegativeTestJSON-1523476350-project] Calling method '.version_select at 0x7f7ddb817940>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:15.480515 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b997cac9-cc99-49d2-9458-c57e891adec0 tempest-HypervisorAdminNegativeTestJSON-1523476350 tempest-HypervisorAdminNegativeTestJSON-1523476350-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': 'cced1d7bdec74ae69545e09602491712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1f4a66977f45ba8cc988db0eef4ce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:15.482589 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b997cac9-cc99-49d2-9458-c57e891adec0 tempest-HypervisorAdminNegativeTestJSON-1523476350 tempest-HypervisorAdminNegativeTestJSON-1523476350-project] Request method failure captured: Oct 27 03:21:15.482589 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Oct 27 03:21:15.482589 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:21:15.482589 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:21:15.482589 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:21:15.482589 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:21:15.482589 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:21:15.482589 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:21:15.482589 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:21:15.482589 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:21:15.482589 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfko63cBgneLtRFtxGYko1y-7FDvz-GqQS7eXnfrGHCSiHwuNmnBZBWN4rfxoQRIvgIiasKQjzjxyas3xJRovHOqC2eyK7x5_e_XmrHRFBrsv2BYMyG2RxLczhRS6gz6ikau7RYphER-tSUGU3c1YSijoEZnkkbjgljRZ-Q8NAsFvzM Oct 27 03:21:15.482589 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:21:15.482589 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:21:15.482589 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:21:15.482589 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:21:15.482589 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:21:15.482589 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:21:15.482589 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 4a1f4a66977f45ba8cc988db0eef4ce9 Oct 27 03:21:15.482589 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1523476350 Oct 27 03:21:15.482589 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:21:15.482589 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:21:15.483844 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4a1f4a66977f45ba8cc988db0eef4ce9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4a1f4a66977f45ba8cc988db0eef4ce9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4a1f4a66977f45ba8cc988db0eef4ce9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4a1f4a66977f45ba8cc988db0eef4ce9"}]}] Oct 27 03:21:15.483844 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1523476350 Oct 27 03:21:15.483844 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 4a1f4a66977f45ba8cc988db0eef4ce9 Oct 27 03:21:15.483844 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1523476350 Oct 27 03:21:15.483844 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-HypervisorAdminNegativeTestJSON-1523476350-project Oct 27 03:21:15.483844 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:21:15.483844 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:21:15.483844 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: cced1d7bdec74ae69545e09602491712 Oct 27 03:21:15.483844 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1523476350-project Oct 27 03:21:15.483844 n-d-862769-1 devstack@n-api.service[121001]: method: Oct 27 03:21:15.483844 n-d-862769-1 devstack@n-api.service[121001]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 27 03:21:15.483844 n-d-862769-1 devstack@n-api.service[121001]: action_args: {} Oct 27 03:21:15.483844 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:21:15.484564 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:21:15.484564 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:21:15.484564 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:21:15.484564 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:21:15.484564 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:21:15.484564 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:21:15.484564 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:21:15.484564 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:21:15.484564 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:21:15.484564 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Oct 27 03:21:15.484564 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self._detail(req) Oct 27 03:21:15.484564 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Oct 27 03:21:15.484564 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Oct 27 03:21:15.484564 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 03:21:15.484564 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 03:21:15.484564 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 03:21:15.484564 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 03:21:15.484564 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 03:21:15.484564 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 03:21:15.485653 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 03:21:15.485653 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 03:21:15.485653 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 03:21:15.485653 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 03:21:15.485653 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 03:21:15.485653 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 03:21:15.485653 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 03:21:15.485653 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 03:21:15.485653 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 27 03:21:15.485653 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:21:15.485653 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:21:15.485653 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:21:15.485653 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:21:15.485653 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:21:15.485653 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:21:15.485653 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 03:21:15.485653 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 03:21:15.485653 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 27 03:21:15.485653 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:21:15.486692 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b997cac9-cc99-49d2-9458-c57e891adec0 tempest-HypervisorAdminNegativeTestJSON-1523476350 tempest-HypervisorAdminNegativeTestJSON-1523476350-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:21:15.486692 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b997cac9-cc99-49d2-9458-c57e891adec0 tempest-HypervisorAdminNegativeTestJSON-1523476350 tempest-HypervisorAdminNegativeTestJSON-1523476350-project] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.719368 Oct 27 03:21:15.489086 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 69/145] 10.222.0.20 () {58 vars in 1167 bytes} [Thu Oct 27 03:21:14 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 725 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 27 03:21:15.503904 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3ba64849-e3a4-4fd6-9895-9ac57eca3cb0 tempest-HypervisorAdminNegativeTestJSON-1523476350 tempest-HypervisorAdminNegativeTestJSON-1523476350-project] Calling method '.version_select at 0x7f7ddb5db4c0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:15.506196 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3ba64849-e3a4-4fd6-9895-9ac57eca3cb0 tempest-HypervisorAdminNegativeTestJSON-1523476350 tempest-HypervisorAdminNegativeTestJSON-1523476350-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': 'cced1d7bdec74ae69545e09602491712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1f4a66977f45ba8cc988db0eef4ce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:15.511203 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3ba64849-e3a4-4fd6-9895-9ac57eca3cb0 tempest-HypervisorAdminNegativeTestJSON-1523476350 tempest-HypervisorAdminNegativeTestJSON-1523476350-project] Request method failure captured: Oct 27 03:21:15.511203 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Oct 27 03:21:15.511203 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:21:15.511203 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:21:15.511203 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:21:15.511203 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:21:15.511203 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:21:15.511203 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:21:15.511203 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:21:15.511203 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:21:15.511203 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfko63cBgneLtRFtxGYko1y-7FDvz-GqQS7eXnfrGHCSiHwuNmnBZBWN4rfxoQRIvgIiasKQjzjxyas3xJRovHOqC2eyK7x5_e_XmrHRFBrsv2BYMyG2RxLczhRS6gz6ikau7RYphER-tSUGU3c1YSijoEZnkkbjgljRZ-Q8NAsFvzM Oct 27 03:21:15.511203 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:21:15.511203 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:21:15.511203 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:21:15.511203 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:21:15.511203 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:21:15.511203 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:21:15.511203 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 4a1f4a66977f45ba8cc988db0eef4ce9 Oct 27 03:21:15.511203 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1523476350 Oct 27 03:21:15.511203 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:21:15.511203 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:21:15.512838 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4a1f4a66977f45ba8cc988db0eef4ce9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4a1f4a66977f45ba8cc988db0eef4ce9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4a1f4a66977f45ba8cc988db0eef4ce9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4a1f4a66977f45ba8cc988db0eef4ce9"}]}] Oct 27 03:21:15.512838 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1523476350 Oct 27 03:21:15.512838 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 4a1f4a66977f45ba8cc988db0eef4ce9 Oct 27 03:21:15.512838 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1523476350 Oct 27 03:21:15.512838 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-HypervisorAdminNegativeTestJSON-1523476350-project Oct 27 03:21:15.512838 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:21:15.512838 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:21:15.512838 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: cced1d7bdec74ae69545e09602491712 Oct 27 03:21:15.512838 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1523476350-project Oct 27 03:21:15.512838 n-d-862769-1 devstack@n-api.service[121001]: method: Oct 27 03:21:15.512838 n-d-862769-1 devstack@n-api.service[121001]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 27 03:21:15.512838 n-d-862769-1 devstack@n-api.service[121001]: action_args: {} Oct 27 03:21:15.512838 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:21:15.513620 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:21:15.513620 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:21:15.513620 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:21:15.513620 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:21:15.513620 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:21:15.513620 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:21:15.513620 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:21:15.513620 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:21:15.513620 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:21:15.513620 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Oct 27 03:21:15.513620 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 27 03:21:15.513620 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Oct 27 03:21:15.513620 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Oct 27 03:21:15.513620 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 03:21:15.513620 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 03:21:15.513620 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 03:21:15.513620 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 03:21:15.513620 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 03:21:15.513620 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 03:21:15.514714 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 03:21:15.514714 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 03:21:15.514714 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 03:21:15.514714 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 03:21:15.514714 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 03:21:15.514714 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 03:21:15.514714 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 03:21:15.514714 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 03:21:15.514714 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 27 03:21:15.514714 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:21:15.514714 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:21:15.514714 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:21:15.514714 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:21:15.514714 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:21:15.514714 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:21:15.514714 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 03:21:15.514714 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 03:21:15.514714 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 27 03:21:15.514714 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:21:15.519101 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3ba64849-e3a4-4fd6-9895-9ac57eca3cb0 tempest-HypervisorAdminNegativeTestJSON-1523476350 tempest-HypervisorAdminNegativeTestJSON-1523476350-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:21:15.520446 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3ba64849-e3a4-4fd6-9895-9ac57eca3cb0 tempest-HypervisorAdminNegativeTestJSON-1523476350 tempest-HypervisorAdminNegativeTestJSON-1523476350-project] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.030173 Oct 27 03:21:15.523221 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 70/146] 10.222.0.20 () {58 vars in 1146 bytes} [Thu Oct 27 03:21:15 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 33 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:21:15.537806 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f5cc8b6a-ea83-41ea-b3b1-9da39b475d34 tempest-HypervisorAdminNegativeTestJSON-1523476350 tempest-HypervisorAdminNegativeTestJSON-1523476350-project] Calling method '.version_select at 0x7f7ddba7cf70>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:15.548360 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f5cc8b6a-ea83-41ea-b3b1-9da39b475d34 tempest-HypervisorAdminNegativeTestJSON-1523476350 tempest-HypervisorAdminNegativeTestJSON-1523476350-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': 'cced1d7bdec74ae69545e09602491712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1f4a66977f45ba8cc988db0eef4ce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:15.556597 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f5cc8b6a-ea83-41ea-b3b1-9da39b475d34 tempest-HypervisorAdminNegativeTestJSON-1523476350 tempest-HypervisorAdminNegativeTestJSON-1523476350-project] Request method failure captured: Oct 27 03:21:15.556597 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Oct 27 03:21:15.556597 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:21:15.556597 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:21:15.556597 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:21:15.556597 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:21:15.556597 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:21:15.556597 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:21:15.556597 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:21:15.556597 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:21:15.556597 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfko63cBgneLtRFtxGYko1y-7FDvz-GqQS7eXnfrGHCSiHwuNmnBZBWN4rfxoQRIvgIiasKQjzjxyas3xJRovHOqC2eyK7x5_e_XmrHRFBrsv2BYMyG2RxLczhRS6gz6ikau7RYphER-tSUGU3c1YSijoEZnkkbjgljRZ-Q8NAsFvzM Oct 27 03:21:15.556597 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:21:15.556597 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:21:15.556597 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:21:15.556597 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:21:15.556597 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:21:15.556597 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:21:15.556597 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 4a1f4a66977f45ba8cc988db0eef4ce9 Oct 27 03:21:15.556597 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1523476350 Oct 27 03:21:15.556597 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:21:15.556597 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:21:15.557758 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4a1f4a66977f45ba8cc988db0eef4ce9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4a1f4a66977f45ba8cc988db0eef4ce9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4a1f4a66977f45ba8cc988db0eef4ce9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4a1f4a66977f45ba8cc988db0eef4ce9"}]}] Oct 27 03:21:15.557758 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1523476350 Oct 27 03:21:15.557758 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 4a1f4a66977f45ba8cc988db0eef4ce9 Oct 27 03:21:15.557758 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1523476350 Oct 27 03:21:15.557758 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-HypervisorAdminNegativeTestJSON-1523476350-project Oct 27 03:21:15.557758 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:21:15.557758 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:21:15.557758 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: cced1d7bdec74ae69545e09602491712 Oct 27 03:21:15.557758 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1523476350-project Oct 27 03:21:15.557758 n-d-862769-1 devstack@n-api.service[121001]: method: Oct 27 03:21:15.557758 n-d-862769-1 devstack@n-api.service[121001]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 27 03:21:15.557758 n-d-862769-1 devstack@n-api.service[121001]: action_args: {} Oct 27 03:21:15.557758 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:21:15.558495 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:21:15.558495 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:21:15.558495 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:21:15.558495 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:21:15.558495 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:21:15.558495 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:21:15.558495 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:21:15.558495 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:21:15.558495 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:21:15.558495 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Oct 27 03:21:15.558495 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Oct 27 03:21:15.558495 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 03:21:15.558495 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 03:21:15.558495 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 03:21:15.558495 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 03:21:15.558495 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 03:21:15.558495 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 03:21:15.558495 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 03:21:15.558495 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 03:21:15.559454 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 03:21:15.559454 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 03:21:15.559454 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 03:21:15.559454 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 03:21:15.559454 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 03:21:15.559454 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 03:21:15.559454 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 27 03:21:15.559454 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:21:15.559454 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:21:15.559454 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:21:15.559454 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:21:15.559454 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:21:15.559454 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:21:15.559454 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 03:21:15.559454 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 03:21:15.559454 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 27 03:21:15.559454 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:21:15.560293 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f5cc8b6a-ea83-41ea-b3b1-9da39b475d34 tempest-HypervisorAdminNegativeTestJSON-1523476350 tempest-HypervisorAdminNegativeTestJSON-1523476350-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:21:15.563756 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f5cc8b6a-ea83-41ea-b3b1-9da39b475d34 tempest-HypervisorAdminNegativeTestJSON-1523476350 tempest-HypervisorAdminNegativeTestJSON-1523476350-project] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.026597 Oct 27 03:21:15.564916 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 71/147] 10.222.0.20 () {58 vars in 1179 bytes} [Thu Oct 27 03:21:15 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:21:15.680528 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5821b943-c3a8-4dd2-b912-d0495255c24c tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015a9fcd508e4d20ad51dcb71053c28f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cee0e3469fc42a49004f9b5d1f5b6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:15.693466 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5821b943-c3a8-4dd2-b912-d0495255c24c tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] 10.222.0.20 "GET /compute/v2.1/servers/820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5" status: 200 len: 1339 microversion: 2.1 time: 0.579927 Oct 27 03:21:15.695148 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 77/148] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:15 2022] GET /compute/v2.1/servers/820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5 => generated 1339 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:15.880397 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a2c0824c-2cb6-44fc-b938-f99da081632f tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:15.881729 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a2c0824c-2cb6-44fc-b938-f99da081632f tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] [instance: 238948a5-b12d-49a4-a73f-ed65a9f19182] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:15.896635 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a2c0824c-2cb6-44fc-b938-f99da081632f tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:15.897182 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a2c0824c-2cb6-44fc-b938-f99da081632f tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:15.897632 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a2c0824c-2cb6-44fc-b938-f99da081632f tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:15.898406 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a2c0824c-2cb6-44fc-b938-f99da081632f tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:15.898867 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a2c0824c-2cb6-44fc-b938-f99da081632f tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:15.899299 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a2c0824c-2cb6-44fc-b938-f99da081632f tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:16.148859 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-df8c7105-e3d0-4ffb-a030-1512ac8790e9 tempest-HypervisorAdminNegativeTestJSON-139620865 tempest-HypervisorAdminNegativeTestJSON-139620865-project-admin] Calling method '.version_select at 0x7f7ddb64a5e0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:16.151291 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-df8c7105-e3d0-4ffb-a030-1512ac8790e9 tempest-HypervisorAdminNegativeTestJSON-139620865 tempest-HypervisorAdminNegativeTestJSON-139620865-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:16.153099 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-df8c7105-e3d0-4ffb-a030-1512ac8790e9 tempest-HypervisorAdminNegativeTestJSON-139620865 tempest-HypervisorAdminNegativeTestJSON-139620865-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:16.153703 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-df8c7105-e3d0-4ffb-a030-1512ac8790e9 tempest-HypervisorAdminNegativeTestJSON-139620865 tempest-HypervisorAdminNegativeTestJSON-139620865-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:16.193857 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-df8c7105-e3d0-4ffb-a030-1512ac8790e9 tempest-HypervisorAdminNegativeTestJSON-139620865 tempest-HypervisorAdminNegativeTestJSON-139620865-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:16.194627 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-df8c7105-e3d0-4ffb-a030-1512ac8790e9 tempest-HypervisorAdminNegativeTestJSON-139620865 tempest-HypervisorAdminNegativeTestJSON-139620865-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:16.195226 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-df8c7105-e3d0-4ffb-a030-1512ac8790e9 tempest-HypervisorAdminNegativeTestJSON-139620865 tempest-HypervisorAdminNegativeTestJSON-139620865-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:16.219931 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=10,nova_api:UPDATE=7 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:16.229504 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-df8c7105-e3d0-4ffb-a030-1512ac8790e9 tempest-HypervisorAdminNegativeTestJSON-139620865 tempest-HypervisorAdminNegativeTestJSON-139620865-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:16.230291 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-df8c7105-e3d0-4ffb-a030-1512ac8790e9 tempest-HypervisorAdminNegativeTestJSON-139620865 tempest-HypervisorAdminNegativeTestJSON-139620865-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:16.233283 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-df8c7105-e3d0-4ffb-a030-1512ac8790e9 tempest-HypervisorAdminNegativeTestJSON-139620865 tempest-HypervisorAdminNegativeTestJSON-139620865-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:16.240495 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-df8c7105-e3d0-4ffb-a030-1512ac8790e9 tempest-HypervisorAdminNegativeTestJSON-139620865 tempest-HypervisorAdminNegativeTestJSON-139620865-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.668126 Oct 27 03:21:16.241676 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 72/149] 10.222.0.20 () {58 vars in 1146 bytes} [Thu Oct 27 03:21:15 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:21:16.256117 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-aed274bf-0da5-4350-afcb-e77924ad7b07 tempest-HypervisorAdminNegativeTestJSON-1523476350 tempest-HypervisorAdminNegativeTestJSON-1523476350-project] Calling method '.version_select at 0x7f7ddb64a1f0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:16.259740 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-aed274bf-0da5-4350-afcb-e77924ad7b07 tempest-HypervisorAdminNegativeTestJSON-1523476350 tempest-HypervisorAdminNegativeTestJSON-1523476350-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': 'cced1d7bdec74ae69545e09602491712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1f4a66977f45ba8cc988db0eef4ce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:16.263658 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-aed274bf-0da5-4350-afcb-e77924ad7b07 tempest-HypervisorAdminNegativeTestJSON-1523476350 tempest-HypervisorAdminNegativeTestJSON-1523476350-project] Request method failure captured: Oct 27 03:21:16.263658 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Oct 27 03:21:16.263658 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:21:16.263658 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:21:16.263658 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:21:16.263658 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:21:16.263658 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:21:16.263658 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:21:16.263658 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:21:16.263658 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:21:16.263658 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfko63cBgneLtRFtxGYko1y-7FDvz-GqQS7eXnfrGHCSiHwuNmnBZBWN4rfxoQRIvgIiasKQjzjxyas3xJRovHOqC2eyK7x5_e_XmrHRFBrsv2BYMyG2RxLczhRS6gz6ikau7RYphER-tSUGU3c1YSijoEZnkkbjgljRZ-Q8NAsFvzM Oct 27 03:21:16.263658 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:21:16.263658 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:21:16.263658 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:21:16.263658 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:21:16.263658 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:21:16.263658 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:21:16.263658 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 4a1f4a66977f45ba8cc988db0eef4ce9 Oct 27 03:21:16.263658 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1523476350 Oct 27 03:21:16.263658 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:21:16.263658 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:21:16.264767 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4a1f4a66977f45ba8cc988db0eef4ce9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4a1f4a66977f45ba8cc988db0eef4ce9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4a1f4a66977f45ba8cc988db0eef4ce9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4a1f4a66977f45ba8cc988db0eef4ce9"}]}] Oct 27 03:21:16.264767 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1523476350 Oct 27 03:21:16.264767 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 4a1f4a66977f45ba8cc988db0eef4ce9 Oct 27 03:21:16.264767 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1523476350 Oct 27 03:21:16.264767 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-HypervisorAdminNegativeTestJSON-1523476350-project Oct 27 03:21:16.264767 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:21:16.264767 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:21:16.264767 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: cced1d7bdec74ae69545e09602491712 Oct 27 03:21:16.264767 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1523476350-project Oct 27 03:21:16.264767 n-d-862769-1 devstack@n-api.service[121001]: method: Oct 27 03:21:16.264767 n-d-862769-1 devstack@n-api.service[121001]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 27 03:21:16.264767 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '1'} Oct 27 03:21:16.264767 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:21:16.266279 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:21:16.266279 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:21:16.266279 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:21:16.266279 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:21:16.266279 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:21:16.266279 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:21:16.266279 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:21:16.266279 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:21:16.266279 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:21:16.266279 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Oct 27 03:21:16.266279 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Oct 27 03:21:16.266279 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 03:21:16.266279 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 03:21:16.266279 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 03:21:16.266279 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 03:21:16.266279 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 03:21:16.266279 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 03:21:16.266279 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 03:21:16.266279 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 03:21:16.267506 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 03:21:16.267506 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 03:21:16.267506 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 03:21:16.267506 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 03:21:16.267506 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 03:21:16.267506 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 03:21:16.267506 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 27 03:21:16.267506 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:21:16.267506 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:21:16.267506 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:21:16.267506 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:21:16.267506 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:21:16.267506 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:21:16.267506 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 03:21:16.267506 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 03:21:16.267506 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 27 03:21:16.267506 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:21:16.272874 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-aed274bf-0da5-4350-afcb-e77924ad7b07 tempest-HypervisorAdminNegativeTestJSON-1523476350 tempest-HypervisorAdminNegativeTestJSON-1523476350-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:21:16.287168 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-aed274bf-0da5-4350-afcb-e77924ad7b07 tempest-HypervisorAdminNegativeTestJSON-1523476350 tempest-HypervisorAdminNegativeTestJSON-1523476350-project] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.037519 Oct 27 03:21:16.300331 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 73/150] 10.222.0.20 () {58 vars in 1173 bytes} [Thu Oct 27 03:21:16 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 49 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:21:16.437985 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-a5e761ea-c94d-4106-9809-a2de99e56552 req-12005932-d1a2-4c4b-80f6-32e9962c6c47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "238948a5-b12d-49a4-a73f-ed65a9f19182", "tag": "4fcd2849-4183-4f5a-b7c1-595d6364a17c"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:21:16.480397 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a2c0824c-2cb6-44fc-b938-f99da081632f tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff070c0383324e1da5c49e3d9c652516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1da8ce26ab49ddae972233777c4c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:16.493985 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-a5e761ea-c94d-4106-9809-a2de99e56552 req-12005932-d1a2-4c4b-80f6-32e9962c6c47 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:16.494510 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-a5e761ea-c94d-4106-9809-a2de99e56552 req-12005932-d1a2-4c4b-80f6-32e9962c6c47 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:16.495443 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-a5e761ea-c94d-4106-9809-a2de99e56552 req-12005932-d1a2-4c4b-80f6-32e9962c6c47 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:16.503153 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a2c0824c-2cb6-44fc-b938-f99da081632f tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] 10.222.0.20 "GET /compute/v2.1/servers/238948a5-b12d-49a4-a73f-ed65a9f19182" status: 200 len: 1320 microversion: 2.1 time: 0.627926 Oct 27 03:21:16.503861 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 78/151] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:15 2022] GET /compute/v2.1/servers/238948a5-b12d-49a4-a73f-ed65a9f19182 => generated 1320 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:21:16.515337 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1bf6a391-24c3-4c9b-a377-bd70a41cf88a tempest-HypervisorAdminNegativeTestJSON-139620865 tempest-HypervisorAdminNegativeTestJSON-139620865-project-admin] Calling method '.version_select at 0x7f7ddb4d2d30>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:16.519233 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-1bf6a391-24c3-4c9b-a377-bd70a41cf88a tempest-HypervisorAdminNegativeTestJSON-139620865 tempest-HypervisorAdminNegativeTestJSON-139620865-project-admin] HTTP exception thrown: Hypervisor with ID '47f437b0-1a94-4808-b1e5-9cfb5b6d6749' could not be found. Oct 27 03:21:16.536802 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1bf6a391-24c3-4c9b-a377-bd70a41cf88a tempest-HypervisorAdminNegativeTestJSON-139620865 tempest-HypervisorAdminNegativeTestJSON-139620865-project-admin] Request method failure captured: Oct 27 03:21:16.536802 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/os-hypervisors/47f437b0-1a94-4808-b1e5-9cfb5b6d6749/uptime HTTP/1.1 Oct 27 03:21:16.536802 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:21:16.536802 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:21:16.536802 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:21:16.536802 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:21:16.536802 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:21:16.536802 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:21:16.536802 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:21:16.536802 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:21:16.536802 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfkqDqFQc4gvrNTc4-wdAXBOXdYJe1s1T3xg0s-__e01azkl3DZABNhgwrMXazUq2YLn-lCqkvRL8hW4O2QIdLFaWAm5RaH-bQehEQPSwYX3kj-wrdqdTR0_88yBFx1L7aGg2vg5KbNbVQZAkucWRvKcioJb3zvpOTAP55ZrHYHE29Y Oct 27 03:21:16.536802 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:21:16.536802 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:21:16.536802 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:21:16.536802 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:21:16.536802 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:21:16.536802 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:21:16.536802 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 124903834b6745c899d644b7fa6c36f2 Oct 27 03:21:16.536802 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-139620865 Oct 27 03:21:16.536802 n-d-862769-1 devstack@n-api.service[121000]: X-Role: admin,member,reader Oct 27 03:21:16.536802 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: admin,member,reader Oct 27 03:21:16.538585 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/124903834b6745c899d644b7fa6c36f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/124903834b6745c899d644b7fa6c36f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/124903834b6745c899d644b7fa6c36f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_124903834b6745c899d644b7fa6c36f2"}]}] Oct 27 03:21:16.538585 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-139620865 Oct 27 03:21:16.538585 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 124903834b6745c899d644b7fa6c36f2 Oct 27 03:21:16.538585 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-139620865 Oct 27 03:21:16.538585 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-HypervisorAdminNegativeTestJSON-139620865-project-admin Oct 27 03:21:16.538585 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:21:16.538585 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:21:16.538585 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: a5dd1f3cbb394266a14f25c332bbbcc9 Oct 27 03:21:16.538585 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-139620865-project-admin Oct 27 03:21:16.538585 n-d-862769-1 devstack@n-api.service[121000]: method: Oct 27 03:21:16.538585 n-d-862769-1 devstack@n-api.service[121000]: exception: Hypervisor with ID '47f437b0-1a94-4808-b1e5-9cfb5b6d6749' could not be found. Oct 27 03:21:16.538585 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '47f437b0-1a94-4808-b1e5-9cfb5b6d6749'} Oct 27 03:21:16.539684 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:21:16.539684 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:21:16.539684 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 27 03:21:16.539684 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 27 03:21:16.539684 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '47f437b0-1a94-4808-b1e5-9cfb5b6d6749' Oct 27 03:21:16.539684 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:21:16.539684 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:21:16.539684 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:21:16.539684 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:21:16.539684 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 27 03:21:16.539684 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 27 03:21:16.539684 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 27 03:21:16.539684 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 27 03:21:16.539684 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 27 03:21:16.539684 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:21:16.539684 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:21:16.539684 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:21:16.539684 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:21:16.539684 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 27 03:21:16.539684 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 27 03:21:16.539684 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 27 03:21:16.539684 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 27 03:21:16.541392 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 27 03:21:16.541392 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:21:16.541392 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:21:16.541392 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:21:16.541392 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:21:16.541392 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:21:16.541392 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:21:16.541392 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:21:16.541392 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:21:16.541392 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:21:16.541392 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:21:16.541392 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:21:16.541392 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:21:16.541392 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Oct 27 03:21:16.541392 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 27 03:21:16.541392 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 27 03:21:16.541392 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 27 03:21:16.541392 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '47f437b0-1a94-4808-b1e5-9cfb5b6d6749' could not be found. Oct 27 03:21:16.541392 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:21:16.541392 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:21:16.541392 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:21:16.544171 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:21:16.544171 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:21:16.544171 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:21:16.544171 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:21:16.544171 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:21:16.544171 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '47f437b0-1a94-4808-b1e5-9cfb5b6d6749' could not be found. Oct 27 03:21:16.544171 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:21:16.544171 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1bf6a391-24c3-4c9b-a377-bd70a41cf88a tempest-HypervisorAdminNegativeTestJSON-139620865 tempest-HypervisorAdminNegativeTestJSON-139620865-project-admin] Returning 404 to user: Hypervisor with ID '47f437b0-1a94-4808-b1e5-9cfb5b6d6749' could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:21:16.544171 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1bf6a391-24c3-4c9b-a377-bd70a41cf88a tempest-HypervisorAdminNegativeTestJSON-139620865 tempest-HypervisorAdminNegativeTestJSON-139620865-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/47f437b0-1a94-4808-b1e5-9cfb5b6d6749/uptime" status: 404 len: 123 microversion: 2.1 time: 0.033537 Oct 27 03:21:16.544171 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 79/152] 10.222.0.20 () {58 vars in 1278 bytes} [Thu Oct 27 03:21:16 2022] GET /compute/v2.1/os-hypervisors/47f437b0-1a94-4808-b1e5-9cfb5b6d6749/uptime => generated 123 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:21:16.563467 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-a5e761ea-c94d-4106-9809-a2de99e56552 req-12005932-d1a2-4c4b-80f6-32e9962c6c47 service nova] Creating event network-changed:4fcd2849-4183-4f5a-b7c1-595d6364a17c for instance 238948a5-b12d-49a4-a73f-ed65a9f19182 on n-h1-862769-1 Oct 27 03:21:16.578516 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-82b30e7b-7d33-4c71-a485-27a37f73a0a5 tempest-HypervisorAdminNegativeTestJSON-139620865 tempest-HypervisorAdminNegativeTestJSON-139620865-project-admin] Calling method '.version_select at 0x7f7ddb4b90d0>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:16.578841 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-82b30e7b-7d33-4c71-a485-27a37f73a0a5 tempest-HypervisorAdminNegativeTestJSON-139620865 tempest-HypervisorAdminNegativeTestJSON-139620865-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:16.579461 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-82b30e7b-7d33-4c71-a485-27a37f73a0a5 tempest-HypervisorAdminNegativeTestJSON-139620865 tempest-HypervisorAdminNegativeTestJSON-139620865-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:16.581478 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-a5e761ea-c94d-4106-9809-a2de99e56552 req-12005932-d1a2-4c4b-80f6-32e9962c6c47 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.281799 Oct 27 03:21:16.583773 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 74/153] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:21:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:21:16.587369 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-82b30e7b-7d33-4c71-a485-27a37f73a0a5 tempest-HypervisorAdminNegativeTestJSON-139620865 tempest-HypervisorAdminNegativeTestJSON-139620865-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:16.667622 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-82b30e7b-7d33-4c71-a485-27a37f73a0a5 tempest-HypervisorAdminNegativeTestJSON-139620865 tempest-HypervisorAdminNegativeTestJSON-139620865-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:16.671047 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-82b30e7b-7d33-4c71-a485-27a37f73a0a5 tempest-HypervisorAdminNegativeTestJSON-139620865 tempest-HypervisorAdminNegativeTestJSON-139620865-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:16.673371 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-82b30e7b-7d33-4c71-a485-27a37f73a0a5 tempest-HypervisorAdminNegativeTestJSON-139620865 tempest-HypervisorAdminNegativeTestJSON-139620865-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:16.730271 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-575b3904-b6f7-4b38-8672-5dc6d8623ed5 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:16.736016 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-575b3904-b6f7-4b38-8672-5dc6d8623ed5 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] [instance: 820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:16.742323 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-82b30e7b-7d33-4c71-a485-27a37f73a0a5 tempest-HypervisorAdminNegativeTestJSON-139620865 tempest-HypervisorAdminNegativeTestJSON-139620865-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:16.742323 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-82b30e7b-7d33-4c71-a485-27a37f73a0a5 tempest-HypervisorAdminNegativeTestJSON-139620865 tempest-HypervisorAdminNegativeTestJSON-139620865-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:16.742323 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-82b30e7b-7d33-4c71-a485-27a37f73a0a5 tempest-HypervisorAdminNegativeTestJSON-139620865 tempest-HypervisorAdminNegativeTestJSON-139620865-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:16.764660 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-575b3904-b6f7-4b38-8672-5dc6d8623ed5 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:16.766153 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-575b3904-b6f7-4b38-8672-5dc6d8623ed5 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:16.770851 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-82b30e7b-7d33-4c71-a485-27a37f73a0a5 tempest-HypervisorAdminNegativeTestJSON-139620865 tempest-HypervisorAdminNegativeTestJSON-139620865-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.219174 Oct 27 03:21:16.773245 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-575b3904-b6f7-4b38-8672-5dc6d8623ed5 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:16.774695 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-575b3904-b6f7-4b38-8672-5dc6d8623ed5 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:16.789187 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-575b3904-b6f7-4b38-8672-5dc6d8623ed5 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:16.790675 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-575b3904-b6f7-4b38-8672-5dc6d8623ed5 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:16.793971 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 80/154] 10.222.0.20 () {58 vars in 1146 bytes} [Thu Oct 27 03:21:16 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:21:16.807728 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-762c30b4-f919-4f92-bd01-f0f54a76e35b tempest-HypervisorAdminNegativeTestJSON-1523476350 tempest-HypervisorAdminNegativeTestJSON-1523476350-project] Calling method '.version_select at 0x7f7ddb4d2f70>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:16.812212 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-762c30b4-f919-4f92-bd01-f0f54a76e35b tempest-HypervisorAdminNegativeTestJSON-1523476350 tempest-HypervisorAdminNegativeTestJSON-1523476350-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': 'cced1d7bdec74ae69545e09602491712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1f4a66977f45ba8cc988db0eef4ce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:16.815099 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-762c30b4-f919-4f92-bd01-f0f54a76e35b tempest-HypervisorAdminNegativeTestJSON-1523476350 tempest-HypervisorAdminNegativeTestJSON-1523476350-project] Request method failure captured: Oct 27 03:21:16.815099 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Oct 27 03:21:16.815099 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:21:16.815099 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:21:16.815099 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:21:16.815099 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:21:16.815099 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:21:16.815099 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:21:16.815099 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:21:16.815099 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:21:16.815099 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfko63cBgneLtRFtxGYko1y-7FDvz-GqQS7eXnfrGHCSiHwuNmnBZBWN4rfxoQRIvgIiasKQjzjxyas3xJRovHOqC2eyK7x5_e_XmrHRFBrsv2BYMyG2RxLczhRS6gz6ikau7RYphER-tSUGU3c1YSijoEZnkkbjgljRZ-Q8NAsFvzM Oct 27 03:21:16.815099 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:21:16.815099 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:21:16.815099 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:21:16.815099 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:21:16.815099 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:21:16.815099 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:21:16.815099 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 4a1f4a66977f45ba8cc988db0eef4ce9 Oct 27 03:21:16.815099 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1523476350 Oct 27 03:21:16.815099 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:21:16.815099 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:21:16.816344 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4a1f4a66977f45ba8cc988db0eef4ce9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4a1f4a66977f45ba8cc988db0eef4ce9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4a1f4a66977f45ba8cc988db0eef4ce9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4a1f4a66977f45ba8cc988db0eef4ce9"}]}] Oct 27 03:21:16.816344 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1523476350 Oct 27 03:21:16.816344 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 4a1f4a66977f45ba8cc988db0eef4ce9 Oct 27 03:21:16.816344 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1523476350 Oct 27 03:21:16.816344 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-HypervisorAdminNegativeTestJSON-1523476350-project Oct 27 03:21:16.816344 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:21:16.816344 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:21:16.816344 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: cced1d7bdec74ae69545e09602491712 Oct 27 03:21:16.816344 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1523476350-project Oct 27 03:21:16.816344 n-d-862769-1 devstack@n-api.service[121000]: method: Oct 27 03:21:16.816344 n-d-862769-1 devstack@n-api.service[121000]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 27 03:21:16.816344 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '1'} Oct 27 03:21:16.816344 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:21:16.817440 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:21:16.817440 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:21:16.817440 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:21:16.817440 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:21:16.817440 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:21:16.817440 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:21:16.817440 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:21:16.817440 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:21:16.817440 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:21:16.817440 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 27 03:21:16.817440 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 27 03:21:16.817440 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Oct 27 03:21:16.817440 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Oct 27 03:21:16.817440 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 03:21:16.817440 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 03:21:16.817440 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 03:21:16.817440 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 03:21:16.817440 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 03:21:16.817440 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 03:21:16.819049 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 03:21:16.819049 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 03:21:16.819049 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 03:21:16.819049 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 03:21:16.819049 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 03:21:16.819049 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 03:21:16.819049 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 03:21:16.819049 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 03:21:16.819049 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 27 03:21:16.819049 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:21:16.819049 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:21:16.819049 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:21:16.819049 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:21:16.819049 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:21:16.819049 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:21:16.819049 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 03:21:16.819049 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 03:21:16.819049 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 27 03:21:16.819049 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:21:16.820268 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=100 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:16.822663 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-762c30b4-f919-4f92-bd01-f0f54a76e35b tempest-HypervisorAdminNegativeTestJSON-1523476350 tempest-HypervisorAdminNegativeTestJSON-1523476350-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:21:16.824058 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-762c30b4-f919-4f92-bd01-f0f54a76e35b tempest-HypervisorAdminNegativeTestJSON-1523476350 tempest-HypervisorAdminNegativeTestJSON-1523476350-project] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.022497 Oct 27 03:21:16.833852 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 81/155] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Oct 27 03:21:16 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 33 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:21:16.842711 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-486f528b-1b6a-49c8-81b0-cf1891da1278 tempest-HypervisorAdminNegativeTestJSON-139620865 tempest-HypervisorAdminNegativeTestJSON-139620865-project-admin] Calling method '.version_select at 0x7f7ddb4dd3a0>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:16.845643 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-486f528b-1b6a-49c8-81b0-cf1891da1278 tempest-HypervisorAdminNegativeTestJSON-139620865 tempest-HypervisorAdminNegativeTestJSON-139620865-project-admin] HTTP exception thrown: Hypervisor with ID '78fd4822-f433-41f5-b5b7-37c302a40e58' could not be found. Oct 27 03:21:16.848222 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-486f528b-1b6a-49c8-81b0-cf1891da1278 tempest-HypervisorAdminNegativeTestJSON-139620865 tempest-HypervisorAdminNegativeTestJSON-139620865-project-admin] Request method failure captured: Oct 27 03:21:16.848222 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/os-hypervisors/78fd4822-f433-41f5-b5b7-37c302a40e58 HTTP/1.1 Oct 27 03:21:16.848222 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:21:16.848222 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:21:16.848222 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:21:16.848222 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:21:16.848222 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:21:16.848222 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:21:16.848222 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:21:16.848222 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:21:16.848222 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfkqDqFQc4gvrNTc4-wdAXBOXdYJe1s1T3xg0s-__e01azkl3DZABNhgwrMXazUq2YLn-lCqkvRL8hW4O2QIdLFaWAm5RaH-bQehEQPSwYX3kj-wrdqdTR0_88yBFx1L7aGg2vg5KbNbVQZAkucWRvKcioJb3zvpOTAP55ZrHYHE29Y Oct 27 03:21:16.848222 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:21:16.848222 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:21:16.848222 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:21:16.848222 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:21:16.848222 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:21:16.848222 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:21:16.848222 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 124903834b6745c899d644b7fa6c36f2 Oct 27 03:21:16.848222 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-139620865 Oct 27 03:21:16.848222 n-d-862769-1 devstack@n-api.service[121000]: X-Role: admin,member,reader Oct 27 03:21:16.848222 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: admin,member,reader Oct 27 03:21:16.849794 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/124903834b6745c899d644b7fa6c36f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/124903834b6745c899d644b7fa6c36f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/124903834b6745c899d644b7fa6c36f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_124903834b6745c899d644b7fa6c36f2"}]}] Oct 27 03:21:16.849794 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-139620865 Oct 27 03:21:16.849794 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 124903834b6745c899d644b7fa6c36f2 Oct 27 03:21:16.849794 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-139620865 Oct 27 03:21:16.849794 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-HypervisorAdminNegativeTestJSON-139620865-project-admin Oct 27 03:21:16.849794 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:21:16.849794 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:21:16.849794 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: a5dd1f3cbb394266a14f25c332bbbcc9 Oct 27 03:21:16.849794 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-139620865-project-admin Oct 27 03:21:16.849794 n-d-862769-1 devstack@n-api.service[121000]: method: Oct 27 03:21:16.849794 n-d-862769-1 devstack@n-api.service[121000]: exception: Hypervisor with ID '78fd4822-f433-41f5-b5b7-37c302a40e58' could not be found. Oct 27 03:21:16.849794 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '78fd4822-f433-41f5-b5b7-37c302a40e58'} Oct 27 03:21:16.850485 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:21:16.850485 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:21:16.850485 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 27 03:21:16.850485 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 27 03:21:16.850485 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '78fd4822-f433-41f5-b5b7-37c302a40e58' Oct 27 03:21:16.850485 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:21:16.850485 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:21:16.850485 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:21:16.850485 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:21:16.850485 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 27 03:21:16.850485 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 27 03:21:16.850485 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 27 03:21:16.850485 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 27 03:21:16.850485 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 27 03:21:16.850485 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:21:16.850485 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:21:16.850485 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:21:16.850485 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:21:16.850485 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 27 03:21:16.850485 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 27 03:21:16.850485 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 27 03:21:16.850485 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 27 03:21:16.851849 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 27 03:21:16.851849 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:21:16.851849 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:21:16.851849 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:21:16.851849 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:21:16.851849 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:21:16.851849 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:21:16.851849 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:21:16.851849 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:21:16.851849 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:21:16.851849 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:21:16.851849 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:21:16.851849 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:21:16.851849 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 27 03:21:16.851849 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 27 03:21:16.851849 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Oct 27 03:21:16.851849 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 27 03:21:16.851849 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 27 03:21:16.851849 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 27 03:21:16.851849 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '78fd4822-f433-41f5-b5b7-37c302a40e58' could not be found. Oct 27 03:21:16.853060 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:21:16.853060 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:21:16.853060 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:21:16.853060 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:21:16.853060 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:21:16.853060 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:21:16.853060 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:21:16.853060 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:21:16.853060 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '78fd4822-f433-41f5-b5b7-37c302a40e58' could not be found. Oct 27 03:21:16.853060 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:21:16.856736 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-486f528b-1b6a-49c8-81b0-cf1891da1278 tempest-HypervisorAdminNegativeTestJSON-139620865 tempest-HypervisorAdminNegativeTestJSON-139620865-project-admin] Returning 404 to user: Hypervisor with ID '78fd4822-f433-41f5-b5b7-37c302a40e58' could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:21:16.857637 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-486f528b-1b6a-49c8-81b0-cf1891da1278 tempest-HypervisorAdminNegativeTestJSON-139620865 tempest-HypervisorAdminNegativeTestJSON-139620865-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/78fd4822-f433-41f5-b5b7-37c302a40e58" status: 404 len: 123 microversion: 2.1 time: 0.021986 Oct 27 03:21:16.871144 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 82/156] 10.222.0.20 () {58 vars in 1257 bytes} [Thu Oct 27 03:21:16 2022] GET /compute/v2.1/os-hypervisors/78fd4822-f433-41f5-b5b7-37c302a40e58 => generated 123 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:21:17.224068 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-575b3904-b6f7-4b38-8672-5dc6d8623ed5 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015a9fcd508e4d20ad51dcb71053c28f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cee0e3469fc42a49004f9b5d1f5b6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:17.241089 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-575b3904-b6f7-4b38-8672-5dc6d8623ed5 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] 10.222.0.20 "GET /compute/v2.1/servers/820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5" status: 200 len: 1339 microversion: 2.1 time: 0.520043 Oct 27 03:21:17.255885 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 75/157] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:16 2022] GET /compute/v2.1/servers/820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5 => generated 1339 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:17.541439 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-60df903c-9c76-440b-b6e2-8aa07a250679 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:17.542144 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-60df903c-9c76-440b-b6e2-8aa07a250679 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] [instance: 238948a5-b12d-49a4-a73f-ed65a9f19182] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:17.558285 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-60df903c-9c76-440b-b6e2-8aa07a250679 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:17.561720 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-60df903c-9c76-440b-b6e2-8aa07a250679 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:17.561720 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-60df903c-9c76-440b-b6e2-8aa07a250679 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:17.562465 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-60df903c-9c76-440b-b6e2-8aa07a250679 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:17.563633 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-60df903c-9c76-440b-b6e2-8aa07a250679 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:17.564435 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-60df903c-9c76-440b-b6e2-8aa07a250679 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:17.705002 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ef459a84-408c-4775-a8d3-12a55d448b82 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1164557128", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:21:17.852050 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-ef459a84-408c-4775-a8d3-12a55d448b82 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] validate_networks() for None {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:21:17.958459 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-60df903c-9c76-440b-b6e2-8aa07a250679 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff070c0383324e1da5c49e3d9c652516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1da8ce26ab49ddae972233777c4c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:17.970790 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-60df903c-9c76-440b-b6e2-8aa07a250679 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] 10.222.0.20 "GET /compute/v2.1/servers/238948a5-b12d-49a4-a73f-ed65a9f19182" status: 200 len: 1320 microversion: 2.1 time: 0.435439 Oct 27 03:21:17.986362 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 76/158] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:17 2022] GET /compute/v2.1/servers/238948a5-b12d-49a4-a73f-ed65a9f19182 => generated 1320 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:18.280813 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-fcf3584d-1d6f-4f2f-8747-8123609fac07 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:18.281441 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-fcf3584d-1d6f-4f2f-8747-8123609fac07 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] [instance: 820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:18.288072 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fcf3584d-1d6f-4f2f-8747-8123609fac07 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:18.295636 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fcf3584d-1d6f-4f2f-8747-8123609fac07 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:18.297233 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fcf3584d-1d6f-4f2f-8747-8123609fac07 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:18.301864 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fcf3584d-1d6f-4f2f-8747-8123609fac07 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:18.302457 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fcf3584d-1d6f-4f2f-8747-8123609fac07 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:18.302906 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fcf3584d-1d6f-4f2f-8747-8123609fac07 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:18.401482 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-ef459a84-408c-4775-a8d3-12a55d448b82 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:21:18.402282 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-ef459a84-408c-4775-a8d3-12a55d448b82 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:21:18.405166 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-ef459a84-408c-4775-a8d3-12a55d448b82 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:21:18.408956 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-ef459a84-408c-4775-a8d3-12a55d448b82 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:21:18.415684 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-ef459a84-408c-4775-a8d3-12a55d448b82 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:21:18.437279 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ef459a84-408c-4775-a8d3-12a55d448b82 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:18.437826 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ef459a84-408c-4775-a8d3-12a55d448b82 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:18.438337 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ef459a84-408c-4775-a8d3-12a55d448b82 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:18.439076 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ef459a84-408c-4775-a8d3-12a55d448b82 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:18.439528 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ef459a84-408c-4775-a8d3-12a55d448b82 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:18.440012 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ef459a84-408c-4775-a8d3-12a55d448b82 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:18.505057 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-ef459a84-408c-4775-a8d3-12a55d448b82 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Getting quotas for project 48e708fb3bdd45bc976db7bd92af09c8. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:21:18.513059 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-ef459a84-408c-4775-a8d3-12a55d448b82 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Getting quotas for user d3f1177e2cbd4ba6b659f8a714be86ac and project 48e708fb3bdd45bc976db7bd92af09c8. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:21:18.542583 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=7 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:18.544922 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ef459a84-408c-4775-a8d3-12a55d448b82 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:21:18.548699 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ef459a84-408c-4775-a8d3-12a55d448b82 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 5910c783-6877-4a41-8650-0973a11f3578] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:21:18.654772 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=16 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:18.685583 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-fcf3584d-1d6f-4f2f-8747-8123609fac07 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015a9fcd508e4d20ad51dcb71053c28f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cee0e3469fc42a49004f9b5d1f5b6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:18.693854 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-fcf3584d-1d6f-4f2f-8747-8123609fac07 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] 10.222.0.20 "GET /compute/v2.1/servers/820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5" status: 200 len: 1339 microversion: 2.1 time: 0.417647 Oct 27 03:21:18.694521 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 77/159] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:18 2022] GET /compute/v2.1/servers/820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5 => generated 1339 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:18.742510 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ef459a84-408c-4775-a8d3-12a55d448b82 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.359370 Oct 27 03:21:18.743437 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 83/160] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:21:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1361 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 03:21:18.755494 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-cd570402-b4ce-4a1e-9bce-1c08707b0106 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:18.756042 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-cd570402-b4ce-4a1e-9bce-1c08707b0106 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 5910c783-6877-4a41-8650-0973a11f3578] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:18.890620 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-cd570402-b4ce-4a1e-9bce-1c08707b0106 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:18.899279 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-cd570402-b4ce-4a1e-9bce-1c08707b0106 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578" status: 200 len: 1213 microversion: 2.1 time: 0.148265 Oct 27 03:21:18.931155 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 78/161] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:18 2022] GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578 => generated 1213 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:18.997500 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7f8b2d7a-9f0f-4d20-96b7-0e796e14b64b tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:18.998185 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7f8b2d7a-9f0f-4d20-96b7-0e796e14b64b tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] [instance: 238948a5-b12d-49a4-a73f-ed65a9f19182] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:19.012536 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7f8b2d7a-9f0f-4d20-96b7-0e796e14b64b tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:19.013402 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7f8b2d7a-9f0f-4d20-96b7-0e796e14b64b tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:19.014404 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7f8b2d7a-9f0f-4d20-96b7-0e796e14b64b tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:19.017389 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7f8b2d7a-9f0f-4d20-96b7-0e796e14b64b tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:19.018505 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7f8b2d7a-9f0f-4d20-96b7-0e796e14b64b tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:19.022056 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7f8b2d7a-9f0f-4d20-96b7-0e796e14b64b tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:19.200584 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7f8b2d7a-9f0f-4d20-96b7-0e796e14b64b tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff070c0383324e1da5c49e3d9c652516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1da8ce26ab49ddae972233777c4c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:19.208917 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7f8b2d7a-9f0f-4d20-96b7-0e796e14b64b tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] 10.222.0.20 "GET /compute/v2.1/servers/238948a5-b12d-49a4-a73f-ed65a9f19182" status: 200 len: 1320 microversion: 2.1 time: 0.216099 Oct 27 03:21:19.209516 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 84/162] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:18 2022] GET /compute/v2.1/servers/238948a5-b12d-49a4-a73f-ed65a9f19182 => generated 1320 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:19.727440 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-61dab8c4-8a15-483a-b7ca-b5ae687d2063 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:19.728075 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-61dab8c4-8a15-483a-b7ca-b5ae687d2063 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] [instance: 820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:19.735745 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-61dab8c4-8a15-483a-b7ca-b5ae687d2063 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:19.736596 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-61dab8c4-8a15-483a-b7ca-b5ae687d2063 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:19.739890 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-61dab8c4-8a15-483a-b7ca-b5ae687d2063 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:19.739890 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-61dab8c4-8a15-483a-b7ca-b5ae687d2063 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:19.739890 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-61dab8c4-8a15-483a-b7ca-b5ae687d2063 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:19.739890 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-61dab8c4-8a15-483a-b7ca-b5ae687d2063 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:19.944785 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-cdf64006-8507-4992-952b-554776822df4 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:19.945737 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-cdf64006-8507-4992-952b-554776822df4 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 5910c783-6877-4a41-8650-0973a11f3578] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:19.951279 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-61dab8c4-8a15-483a-b7ca-b5ae687d2063 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015a9fcd508e4d20ad51dcb71053c28f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cee0e3469fc42a49004f9b5d1f5b6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:19.961355 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-61dab8c4-8a15-483a-b7ca-b5ae687d2063 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] 10.222.0.20 "GET /compute/v2.1/servers/820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5" status: 200 len: 1339 microversion: 2.1 time: 0.247304 Oct 27 03:21:19.963207 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 79/163] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:19 2022] GET /compute/v2.1/servers/820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5 => generated 1339 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:20.055194 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-cdf64006-8507-4992-952b-554776822df4 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:20.055194 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-cdf64006-8507-4992-952b-554776822df4 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578" status: 200 len: 1213 microversion: 2.1 time: 0.114620 Oct 27 03:21:20.055194 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 85/164] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:19 2022] GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578 => generated 1213 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:21:20.237697 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-760ce946-97b8-4392-9b15-4bfa23a6c762 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:20.238412 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-760ce946-97b8-4392-9b15-4bfa23a6c762 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] [instance: 238948a5-b12d-49a4-a73f-ed65a9f19182] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:20.244878 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-760ce946-97b8-4392-9b15-4bfa23a6c762 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:20.245365 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-760ce946-97b8-4392-9b15-4bfa23a6c762 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:20.245800 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-760ce946-97b8-4392-9b15-4bfa23a6c762 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:20.246644 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-760ce946-97b8-4392-9b15-4bfa23a6c762 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:20.247101 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-760ce946-97b8-4392-9b15-4bfa23a6c762 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:20.247529 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-760ce946-97b8-4392-9b15-4bfa23a6c762 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:20.274779 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-16ac1df7-8b82-4515-aab3-97303f56a2d4 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-1534096162", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": "none"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:21:20.342710 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-16ac1df7-8b82-4515-aab3-97303f56a2d4 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Flavor limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:21:20.343703 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-16ac1df7-8b82-4515-aab3-97303f56a2d4 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Image limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:21:20.344384 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-16ac1df7-8b82-4515-aab3-97303f56a2d4 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Flavor pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:21:20.345976 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-16ac1df7-8b82-4515-aab3-97303f56a2d4 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Image pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:21:20.345976 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-16ac1df7-8b82-4515-aab3-97303f56a2d4 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:21:20.360565 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=48,nova_cell0:UPDATE=7 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:20.363841 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-16ac1df7-8b82-4515-aab3-97303f56a2d4 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:20.364337 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-16ac1df7-8b82-4515-aab3-97303f56a2d4 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:20.364774 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-16ac1df7-8b82-4515-aab3-97303f56a2d4 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:20.366454 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-16ac1df7-8b82-4515-aab3-97303f56a2d4 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:20.366917 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-16ac1df7-8b82-4515-aab3-97303f56a2d4 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:20.367471 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-16ac1df7-8b82-4515-aab3-97303f56a2d4 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:20.386140 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-16ac1df7-8b82-4515-aab3-97303f56a2d4 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Getting quotas for project 11fb9090ce414b1d9ab195faec4cc45e. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:21:20.391817 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-16ac1df7-8b82-4515-aab3-97303f56a2d4 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Getting quotas for user 3756b0d73d634269bec89f1be45cdc5d and project 11fb9090ce414b1d9ab195faec4cc45e. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:21:20.403336 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-760ce946-97b8-4392-9b15-4bfa23a6c762 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff070c0383324e1da5c49e3d9c652516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1da8ce26ab49ddae972233777c4c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:20.406799 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-16ac1df7-8b82-4515-aab3-97303f56a2d4 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Going to run 1 instances... {{(pid=121001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:21:20.409209 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-16ac1df7-8b82-4515-aab3-97303f56a2d4 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:21:20.412650 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-760ce946-97b8-4392-9b15-4bfa23a6c762 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] 10.222.0.20 "GET /compute/v2.1/servers/238948a5-b12d-49a4-a73f-ed65a9f19182" status: 200 len: 1320 microversion: 2.1 time: 0.179293 Oct 27 03:21:20.414677 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 86/165] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:20 2022] GET /compute/v2.1/servers/238948a5-b12d-49a4-a73f-ed65a9f19182 => generated 1320 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:21:20.539074 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-16ac1df7-8b82-4515-aab3-97303f56a2d4 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 0.432799 Oct 27 03:21:20.539754 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 80/166] 10.222.0.20 () {62 vars in 1188 bytes} [Thu Oct 27 03:21:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 434 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 27 03:21:20.551251 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ec0984d7-7192-4b0e-a4c1-5ebcc7c71a40 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:20.551942 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ec0984d7-7192-4b0e-a4c1-5ebcc7c71a40 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:20.610330 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ec0984d7-7192-4b0e-a4c1-5ebcc7c71a40 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:20.618717 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ec0984d7-7192-4b0e-a4c1-5ebcc7c71a40 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:20.620195 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ec0984d7-7192-4b0e-a4c1-5ebcc7c71a40 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:20.627998 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ec0984d7-7192-4b0e-a4c1-5ebcc7c71a40 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1454 microversion: 2.91 time: 0.080725 Oct 27 03:21:20.628579 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 87/167] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:21:20 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1454 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:21:20.984938 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-43711d52-2813-44ce-9638-6656cc7ddef9 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:20.985572 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-43711d52-2813-44ce-9638-6656cc7ddef9 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] [instance: 820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:20.992698 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-43711d52-2813-44ce-9638-6656cc7ddef9 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:20.993194 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-43711d52-2813-44ce-9638-6656cc7ddef9 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:20.993644 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-43711d52-2813-44ce-9638-6656cc7ddef9 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:20.994381 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-43711d52-2813-44ce-9638-6656cc7ddef9 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:20.994846 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-43711d52-2813-44ce-9638-6656cc7ddef9 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:20.995281 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-43711d52-2813-44ce-9638-6656cc7ddef9 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:21.077109 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6cf9375a-3a4d-440d-a6b4-38ce91d0f6da tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:21.077777 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6cf9375a-3a4d-440d-a6b4-38ce91d0f6da tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 5910c783-6877-4a41-8650-0973a11f3578] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:21.087251 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6cf9375a-3a4d-440d-a6b4-38ce91d0f6da tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:21.087750 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6cf9375a-3a4d-440d-a6b4-38ce91d0f6da tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:21.088194 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6cf9375a-3a4d-440d-a6b4-38ce91d0f6da tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:21.088974 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6cf9375a-3a4d-440d-a6b4-38ce91d0f6da tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:21.089427 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6cf9375a-3a4d-440d-a6b4-38ce91d0f6da tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:21.089861 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6cf9375a-3a4d-440d-a6b4-38ce91d0f6da tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:21.131835 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-43711d52-2813-44ce-9638-6656cc7ddef9 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015a9fcd508e4d20ad51dcb71053c28f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cee0e3469fc42a49004f9b5d1f5b6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:21.146269 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-43711d52-2813-44ce-9638-6656cc7ddef9 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] 10.222.0.20 "GET /compute/v2.1/servers/820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5" status: 200 len: 1339 microversion: 2.1 time: 0.165518 Oct 27 03:21:21.147343 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 81/168] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:20 2022] GET /compute/v2.1/servers/820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5 => generated 1339 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:21.306249 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-6cf9375a-3a4d-440d-a6b4-38ce91d0f6da tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:21.314435 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6cf9375a-3a4d-440d-a6b4-38ce91d0f6da tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578" status: 200 len: 1217 microversion: 2.1 time: 0.241380 Oct 27 03:21:21.315000 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 88/169] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:21 2022] GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578 => generated 1217 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:21:21.436003 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3a9a99cc-c8fe-4290-9c86-985d5f54d03b tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:21.436643 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3a9a99cc-c8fe-4290-9c86-985d5f54d03b tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] [instance: 238948a5-b12d-49a4-a73f-ed65a9f19182] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:21.443581 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3a9a99cc-c8fe-4290-9c86-985d5f54d03b tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:21.444322 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3a9a99cc-c8fe-4290-9c86-985d5f54d03b tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:21.444918 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3a9a99cc-c8fe-4290-9c86-985d5f54d03b tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:21.445798 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3a9a99cc-c8fe-4290-9c86-985d5f54d03b tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:21.446443 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3a9a99cc-c8fe-4290-9c86-985d5f54d03b tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:21.447050 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3a9a99cc-c8fe-4290-9c86-985d5f54d03b tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:21.594200 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3a9a99cc-c8fe-4290-9c86-985d5f54d03b tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff070c0383324e1da5c49e3d9c652516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1da8ce26ab49ddae972233777c4c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:21.602226 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3a9a99cc-c8fe-4290-9c86-985d5f54d03b tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] 10.222.0.20 "GET /compute/v2.1/servers/238948a5-b12d-49a4-a73f-ed65a9f19182" status: 200 len: 1320 microversion: 2.1 time: 0.170099 Oct 27 03:21:21.602843 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 82/170] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:21 2022] GET /compute/v2.1/servers/238948a5-b12d-49a4-a73f-ed65a9f19182 => generated 1320 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:21.657509 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-dd7c731a-b3c0-4467-a480-eefecc1634a1 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:21.658161 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-dd7c731a-b3c0-4467-a480-eefecc1634a1 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:21.719578 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-dd7c731a-b3c0-4467-a480-eefecc1634a1 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:21.728665 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-dd7c731a-b3c0-4467-a480-eefecc1634a1 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:21.729805 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-dd7c731a-b3c0-4467-a480-eefecc1634a1 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:21.736463 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-dd7c731a-b3c0-4467-a480-eefecc1634a1 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1454 microversion: 2.91 time: 0.084155 Oct 27 03:21:21.737130 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 89/171] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:21:21 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1454 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:21:22.168765 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e8c7d4e7-dcaa-4173-9612-a149da1de376 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:22.169409 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e8c7d4e7-dcaa-4173-9612-a149da1de376 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] [instance: 820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:22.192137 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e8c7d4e7-dcaa-4173-9612-a149da1de376 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:22.192137 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e8c7d4e7-dcaa-4173-9612-a149da1de376 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:22.192137 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e8c7d4e7-dcaa-4173-9612-a149da1de376 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:22.197689 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e8c7d4e7-dcaa-4173-9612-a149da1de376 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:22.198225 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e8c7d4e7-dcaa-4173-9612-a149da1de376 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:22.198895 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e8c7d4e7-dcaa-4173-9612-a149da1de376 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:22.336761 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-02c84e68-7741-4df1-aa56-7fd6fdcd0a8f tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:22.338215 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-02c84e68-7741-4df1-aa56-7fd6fdcd0a8f tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 5910c783-6877-4a41-8650-0973a11f3578] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:22.348043 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-02c84e68-7741-4df1-aa56-7fd6fdcd0a8f tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:22.349689 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-02c84e68-7741-4df1-aa56-7fd6fdcd0a8f tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:22.349689 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-02c84e68-7741-4df1-aa56-7fd6fdcd0a8f tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:22.352177 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-02c84e68-7741-4df1-aa56-7fd6fdcd0a8f tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:22.352674 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-02c84e68-7741-4df1-aa56-7fd6fdcd0a8f tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:22.353121 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-02c84e68-7741-4df1-aa56-7fd6fdcd0a8f tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:22.353222 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e8c7d4e7-dcaa-4173-9612-a149da1de376 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015a9fcd508e4d20ad51dcb71053c28f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cee0e3469fc42a49004f9b5d1f5b6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:22.362026 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e8c7d4e7-dcaa-4173-9612-a149da1de376 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] 10.222.0.20 "GET /compute/v2.1/servers/820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5" status: 200 len: 1339 microversion: 2.1 time: 0.197180 Oct 27 03:21:22.364562 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 83/172] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:22 2022] GET /compute/v2.1/servers/820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5 => generated 1339 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:22.421090 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-02c84e68-7741-4df1-aa56-7fd6fdcd0a8f tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:22.430226 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-02c84e68-7741-4df1-aa56-7fd6fdcd0a8f tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578" status: 200 len: 1265 microversion: 2.1 time: 0.097081 Oct 27 03:21:22.431368 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 90/173] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:22 2022] GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578 => generated 1265 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:22.548833 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b4f04238-83ca-4f4c-bfc1-3b49a69d95f8 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1079988990", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:21:22.601073 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.network.neutron [None req-b4f04238-83ca-4f4c-bfc1-3b49a69d95f8 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] validate_networks() for None {{(pid=121001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:21:22.628361 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0d5e42aa-d084-41a5-844c-60ee0cb9c6d4 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:22.629219 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0d5e42aa-d084-41a5-844c-60ee0cb9c6d4 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] [instance: 238948a5-b12d-49a4-a73f-ed65a9f19182] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:22.635435 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0d5e42aa-d084-41a5-844c-60ee0cb9c6d4 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:22.635945 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0d5e42aa-d084-41a5-844c-60ee0cb9c6d4 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:22.636385 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0d5e42aa-d084-41a5-844c-60ee0cb9c6d4 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:22.637095 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0d5e42aa-d084-41a5-844c-60ee0cb9c6d4 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:22.637816 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0d5e42aa-d084-41a5-844c-60ee0cb9c6d4 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:22.638262 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0d5e42aa-d084-41a5-844c-60ee0cb9c6d4 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:22.773931 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0d5e42aa-d084-41a5-844c-60ee0cb9c6d4 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff070c0383324e1da5c49e3d9c652516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1da8ce26ab49ddae972233777c4c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:22.782818 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0d5e42aa-d084-41a5-844c-60ee0cb9c6d4 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] 10.222.0.20 "GET /compute/v2.1/servers/238948a5-b12d-49a4-a73f-ed65a9f19182" status: 200 len: 1320 microversion: 2.1 time: 0.158915 Oct 27 03:21:22.794984 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 91/174] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:22 2022] GET /compute/v2.1/servers/238948a5-b12d-49a4-a73f-ed65a9f19182 => generated 1320 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:22.801094 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5fb9fac1-f633-4032-b7e1-c8fbd00ce777 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:22.801603 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-b4f04238-83ca-4f4c-bfc1-3b49a69d95f8 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Flavor limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:21:22.801721 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5fb9fac1-f633-4032-b7e1-c8fbd00ce777 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:22.802152 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-b4f04238-83ca-4f4c-bfc1-3b49a69d95f8 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Image limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:21:22.802669 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-b4f04238-83ca-4f4c-bfc1-3b49a69d95f8 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Flavor pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:21:22.803082 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-b4f04238-83ca-4f4c-bfc1-3b49a69d95f8 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Image pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:21:22.803498 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-b4f04238-83ca-4f4c-bfc1-3b49a69d95f8 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:21:22.808226 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5fb9fac1-f633-4032-b7e1-c8fbd00ce777 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:22.808724 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5fb9fac1-f633-4032-b7e1-c8fbd00ce777 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:22.809169 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5fb9fac1-f633-4032-b7e1-c8fbd00ce777 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:22.809882 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5fb9fac1-f633-4032-b7e1-c8fbd00ce777 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:22.810373 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5fb9fac1-f633-4032-b7e1-c8fbd00ce777 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:22.810814 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5fb9fac1-f633-4032-b7e1-c8fbd00ce777 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:22.813679 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b4f04238-83ca-4f4c-bfc1-3b49a69d95f8 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:22.814271 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b4f04238-83ca-4f4c-bfc1-3b49a69d95f8 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:22.814777 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b4f04238-83ca-4f4c-bfc1-3b49a69d95f8 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:22.815580 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b4f04238-83ca-4f4c-bfc1-3b49a69d95f8 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:22.816139 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b4f04238-83ca-4f4c-bfc1-3b49a69d95f8 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:22.816647 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b4f04238-83ca-4f4c-bfc1-3b49a69d95f8 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:22.832774 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-b4f04238-83ca-4f4c-bfc1-3b49a69d95f8 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Getting quotas for project 44b2b8b909c54f36b61d934d09607b5a. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:21:22.837227 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-b4f04238-83ca-4f4c-bfc1-3b49a69d95f8 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Getting quotas for user ae3d2208faeb4421af21da56d455be92 and project 44b2b8b909c54f36b61d934d09607b5a. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:21:22.854582 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b4f04238-83ca-4f4c-bfc1-3b49a69d95f8 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Going to run 1 instances... {{(pid=121001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:21:22.856915 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b4f04238-83ca-4f4c-bfc1-3b49a69d95f8 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] [instance: a3b87dc4-af75-42ba-81af-7ad2ac59510c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:21:22.939630 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5fb9fac1-f633-4032-b7e1-c8fbd00ce777 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:22.948293 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5fb9fac1-f633-4032-b7e1-c8fbd00ce777 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:22.949727 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5fb9fac1-f633-4032-b7e1-c8fbd00ce777 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:22.954944 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5fb9fac1-f633-4032-b7e1-c8fbd00ce777 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1450 microversion: 2.91 time: 0.165369 Oct 27 03:21:22.955531 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 92/175] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:21:22 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1450 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:21:23.270368 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b4f04238-83ca-4f4c-bfc1-3b49a69d95f8 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.839884 Oct 27 03:21:23.271066 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 84/176] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:21:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 841 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 03:21:23.282760 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3f6261fb-d357-4600-9f3b-f0a33721b8e8 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:23.283393 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-3f6261fb-d357-4600-9f3b-f0a33721b8e8 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] [instance: a3b87dc4-af75-42ba-81af-7ad2ac59510c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:23.363967 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-3f6261fb-d357-4600-9f3b-f0a33721b8e8 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3d2208faeb4421af21da56d455be92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b2b8b909c54f36b61d934d09607b5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:23.366289 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=19 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:23.374571 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3f6261fb-d357-4600-9f3b-f0a33721b8e8 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] 10.222.0.20 "GET /compute/v2.1/servers/a3b87dc4-af75-42ba-81af-7ad2ac59510c" status: 200 len: 1219 microversion: 2.1 time: 0.096140 Oct 27 03:21:23.375155 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 93/177] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:23 2022] GET /compute/v2.1/servers/a3b87dc4-af75-42ba-81af-7ad2ac59510c => generated 1219 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:23.391949 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-85eb7f4c-b9fe-4583-814e-183412e90b44 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:23.394961 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-85eb7f4c-b9fe-4583-814e-183412e90b44 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] [instance: 820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:23.408996 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-85eb7f4c-b9fe-4583-814e-183412e90b44 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:23.418679 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-85eb7f4c-b9fe-4583-814e-183412e90b44 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:23.419483 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-85eb7f4c-b9fe-4583-814e-183412e90b44 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:23.422263 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-85eb7f4c-b9fe-4583-814e-183412e90b44 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:23.422772 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-85eb7f4c-b9fe-4583-814e-183412e90b44 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:23.423173 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-85eb7f4c-b9fe-4583-814e-183412e90b44 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:23.456364 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1068405b-19ce-4fdb-9576-45f7a1221d4b tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:23.457399 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1068405b-19ce-4fdb-9576-45f7a1221d4b tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 5910c783-6877-4a41-8650-0973a11f3578] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:23.473993 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1068405b-19ce-4fdb-9576-45f7a1221d4b tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:23.476172 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1068405b-19ce-4fdb-9576-45f7a1221d4b tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:23.476172 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1068405b-19ce-4fdb-9576-45f7a1221d4b tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:23.476172 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1068405b-19ce-4fdb-9576-45f7a1221d4b tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:23.476362 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1068405b-19ce-4fdb-9576-45f7a1221d4b tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:23.476693 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1068405b-19ce-4fdb-9576-45f7a1221d4b tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:23.642975 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1068405b-19ce-4fdb-9576-45f7a1221d4b tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:23.650693 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1068405b-19ce-4fdb-9576-45f7a1221d4b tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578" status: 200 len: 1273 microversion: 2.1 time: 0.199601 Oct 27 03:21:23.657645 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-85eb7f4c-b9fe-4583-814e-183412e90b44 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015a9fcd508e4d20ad51dcb71053c28f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cee0e3469fc42a49004f9b5d1f5b6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:23.666158 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 94/178] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:23 2022] GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578 => generated 1273 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:21:23.667930 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-85eb7f4c-b9fe-4583-814e-183412e90b44 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] 10.222.0.20 "GET /compute/v2.1/servers/820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5" status: 200 len: 1339 microversion: 2.1 time: 0.282175 Oct 27 03:21:23.668903 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 85/179] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:23 2022] GET /compute/v2.1/servers/820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5 => generated 1339 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:23.810071 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7087240f-3701-4063-a342-103775038ed9 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:23.812482 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7087240f-3701-4063-a342-103775038ed9 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] [instance: 238948a5-b12d-49a4-a73f-ed65a9f19182] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:23.818927 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7087240f-3701-4063-a342-103775038ed9 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:23.819423 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7087240f-3701-4063-a342-103775038ed9 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:23.822244 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7087240f-3701-4063-a342-103775038ed9 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:23.822244 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7087240f-3701-4063-a342-103775038ed9 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:23.822244 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7087240f-3701-4063-a342-103775038ed9 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:23.822244 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7087240f-3701-4063-a342-103775038ed9 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:23.963046 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-f3b21f2d-88c0-4e0e-b45c-13423d92510f req-d2c4728d-e877-4e6b-8dbf-8624ee8418bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5", "name": "network-vif-plugged", "status": "completed", "tag": "7281d005-1139-42c9-b8d2-f7f602562c0c"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:21:23.980648 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-f3b21f2d-88c0-4e0e-b45c-13423d92510f req-d2c4728d-e877-4e6b-8dbf-8624ee8418bb service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:23.986267 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-f3b21f2d-88c0-4e0e-b45c-13423d92510f req-d2c4728d-e877-4e6b-8dbf-8624ee8418bb service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:23.986801 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-f3b21f2d-88c0-4e0e-b45c-13423d92510f req-d2c4728d-e877-4e6b-8dbf-8624ee8418bb service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:23.996203 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7087240f-3701-4063-a342-103775038ed9 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff070c0383324e1da5c49e3d9c652516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1da8ce26ab49ddae972233777c4c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:24.005296 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7087240f-3701-4063-a342-103775038ed9 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] 10.222.0.20 "GET /compute/v2.1/servers/238948a5-b12d-49a4-a73f-ed65a9f19182" status: 200 len: 1320 microversion: 2.1 time: 0.199143 Oct 27 03:21:24.005913 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 95/180] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:23 2022] GET /compute/v2.1/servers/238948a5-b12d-49a4-a73f-ed65a9f19182 => generated 1320 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:21:24.010027 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-f3b21f2d-88c0-4e0e-b45c-13423d92510f req-d2c4728d-e877-4e6b-8dbf-8624ee8418bb service nova] Creating event network-vif-plugged:7281d005-1139-42c9-b8d2-f7f602562c0c for instance 820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5 on n-h2-862769-1 Oct 27 03:21:24.015990 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-f3b21f2d-88c0-4e0e-b45c-13423d92510f req-d2c4728d-e877-4e6b-8dbf-8624ee8418bb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116580 Oct 27 03:21:24.017362 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 86/181] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:21:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:21:24.029384 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5354ec1a-1d23-414d-9620-0df05d6e2d45 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:24.030266 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5354ec1a-1d23-414d-9620-0df05d6e2d45 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:24.037477 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5354ec1a-1d23-414d-9620-0df05d6e2d45 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:24.038739 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5354ec1a-1d23-414d-9620-0df05d6e2d45 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:24.039487 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5354ec1a-1d23-414d-9620-0df05d6e2d45 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:24.042771 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5354ec1a-1d23-414d-9620-0df05d6e2d45 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:24.042771 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5354ec1a-1d23-414d-9620-0df05d6e2d45 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:24.042771 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5354ec1a-1d23-414d-9620-0df05d6e2d45 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:24.126412 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5354ec1a-1d23-414d-9620-0df05d6e2d45 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:24.136850 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5354ec1a-1d23-414d-9620-0df05d6e2d45 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:24.138602 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5354ec1a-1d23-414d-9620-0df05d6e2d45 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:24.145639 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5354ec1a-1d23-414d-9620-0df05d6e2d45 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1506 microversion: 2.91 time: 0.124491 Oct 27 03:21:24.146458 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 96/182] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:21:24 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1506 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:21:24.397287 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-661e9632-5035-4236-814b-b6c7d814c699 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:24.398001 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-661e9632-5035-4236-814b-b6c7d814c699 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] [instance: a3b87dc4-af75-42ba-81af-7ad2ac59510c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:24.472169 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-661e9632-5035-4236-814b-b6c7d814c699 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3d2208faeb4421af21da56d455be92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b2b8b909c54f36b61d934d09607b5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:24.480140 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-661e9632-5035-4236-814b-b6c7d814c699 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] 10.222.0.20 "GET /compute/v2.1/servers/a3b87dc4-af75-42ba-81af-7ad2ac59510c" status: 200 len: 1219 microversion: 2.1 time: 0.086958 Oct 27 03:21:24.481155 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 87/183] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:24 2022] GET /compute/v2.1/servers/a3b87dc4-af75-42ba-81af-7ad2ac59510c => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:24.673616 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-97d473e7-095b-4812-b845-2370a26db238 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:24.674453 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-97d473e7-095b-4812-b845-2370a26db238 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 5910c783-6877-4a41-8650-0973a11f3578] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:24.680913 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-97d473e7-095b-4812-b845-2370a26db238 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:24.681410 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-97d473e7-095b-4812-b845-2370a26db238 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:24.682053 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-97d473e7-095b-4812-b845-2370a26db238 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:24.682775 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-97d473e7-095b-4812-b845-2370a26db238 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:24.683241 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-97d473e7-095b-4812-b845-2370a26db238 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:24.684097 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-97d473e7-095b-4812-b845-2370a26db238 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:24.692546 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2a9e2234-1870-4ee6-9b4c-2229931c1194 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:24.693175 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2a9e2234-1870-4ee6-9b4c-2229931c1194 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] [instance: 820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:24.707822 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2a9e2234-1870-4ee6-9b4c-2229931c1194 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:24.707822 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2a9e2234-1870-4ee6-9b4c-2229931c1194 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:24.707822 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2a9e2234-1870-4ee6-9b4c-2229931c1194 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:24.707822 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2a9e2234-1870-4ee6-9b4c-2229931c1194 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:24.708264 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2a9e2234-1870-4ee6-9b4c-2229931c1194 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:24.708264 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2a9e2234-1870-4ee6-9b4c-2229931c1194 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:24.859087 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2a9e2234-1870-4ee6-9b4c-2229931c1194 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015a9fcd508e4d20ad51dcb71053c28f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cee0e3469fc42a49004f9b5d1f5b6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:24.867297 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2a9e2234-1870-4ee6-9b4c-2229931c1194 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] 10.222.0.20 "GET /compute/v2.1/servers/820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5" status: 200 len: 1339 microversion: 2.1 time: 0.178468 Oct 27 03:21:24.868497 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 88/184] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:24 2022] GET /compute/v2.1/servers/820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5 => generated 1339 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:21:24.933677 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-97d473e7-095b-4812-b845-2370a26db238 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:24.939780 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=100 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:24.941926 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-97d473e7-095b-4812-b845-2370a26db238 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578" status: 200 len: 1313 microversion: 2.1 time: 0.272892 Oct 27 03:21:24.942752 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 97/185] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:24 2022] GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578 => generated 1313 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:25.033542 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c599fbb0-4a84-4e01-a4b7-be788bcb3f03 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:25.034310 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c599fbb0-4a84-4e01-a4b7-be788bcb3f03 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] [instance: 238948a5-b12d-49a4-a73f-ed65a9f19182] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:25.040540 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c599fbb0-4a84-4e01-a4b7-be788bcb3f03 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:25.041042 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c599fbb0-4a84-4e01-a4b7-be788bcb3f03 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:25.041503 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c599fbb0-4a84-4e01-a4b7-be788bcb3f03 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:25.042247 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c599fbb0-4a84-4e01-a4b7-be788bcb3f03 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:25.042695 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c599fbb0-4a84-4e01-a4b7-be788bcb3f03 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:25.043127 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c599fbb0-4a84-4e01-a4b7-be788bcb3f03 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:25.173366 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-77a49831-4a2d-44dc-97c7-ed7094da2238 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:25.173988 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-77a49831-4a2d-44dc-97c7-ed7094da2238 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:25.182770 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c599fbb0-4a84-4e01-a4b7-be788bcb3f03 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff070c0383324e1da5c49e3d9c652516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1da8ce26ab49ddae972233777c4c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:25.188709 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-77a49831-4a2d-44dc-97c7-ed7094da2238 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:25.188709 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-77a49831-4a2d-44dc-97c7-ed7094da2238 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:25.188709 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-77a49831-4a2d-44dc-97c7-ed7094da2238 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:25.189141 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-77a49831-4a2d-44dc-97c7-ed7094da2238 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:25.189606 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-77a49831-4a2d-44dc-97c7-ed7094da2238 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:25.190085 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-77a49831-4a2d-44dc-97c7-ed7094da2238 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:25.199075 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c599fbb0-4a84-4e01-a4b7-be788bcb3f03 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] 10.222.0.20 "GET /compute/v2.1/servers/238948a5-b12d-49a4-a73f-ed65a9f19182" status: 200 len: 1320 microversion: 2.1 time: 0.170075 Oct 27 03:21:25.201042 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 89/186] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:25 2022] GET /compute/v2.1/servers/238948a5-b12d-49a4-a73f-ed65a9f19182 => generated 1320 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:25.359242 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-77a49831-4a2d-44dc-97c7-ed7094da2238 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:25.368172 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-77a49831-4a2d-44dc-97c7-ed7094da2238 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:25.369622 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-77a49831-4a2d-44dc-97c7-ed7094da2238 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:25.375842 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-77a49831-4a2d-44dc-97c7-ed7094da2238 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1512 microversion: 2.91 time: 0.206504 Oct 27 03:21:25.390348 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 98/187] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:21:25 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1512 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:21:25.505488 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-399a3ec4-b6bd-4478-b25c-6ebbe779f31e tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:25.507829 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-399a3ec4-b6bd-4478-b25c-6ebbe779f31e tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] [instance: a3b87dc4-af75-42ba-81af-7ad2ac59510c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:25.513023 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-399a3ec4-b6bd-4478-b25c-6ebbe779f31e tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:25.513530 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-399a3ec4-b6bd-4478-b25c-6ebbe779f31e tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:25.513976 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-399a3ec4-b6bd-4478-b25c-6ebbe779f31e tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:25.514794 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-399a3ec4-b6bd-4478-b25c-6ebbe779f31e tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:25.515259 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-399a3ec4-b6bd-4478-b25c-6ebbe779f31e tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:25.515694 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-399a3ec4-b6bd-4478-b25c-6ebbe779f31e tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:25.585301 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-399a3ec4-b6bd-4478-b25c-6ebbe779f31e tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3d2208faeb4421af21da56d455be92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b2b8b909c54f36b61d934d09607b5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:25.593305 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-399a3ec4-b6bd-4478-b25c-6ebbe779f31e tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] 10.222.0.20 "GET /compute/v2.1/servers/a3b87dc4-af75-42ba-81af-7ad2ac59510c" status: 200 len: 1293 microversion: 2.1 time: 0.091593 Oct 27 03:21:25.594516 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 90/188] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:25 2022] GET /compute/v2.1/servers/a3b87dc4-af75-42ba-81af-7ad2ac59510c => generated 1293 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:25.765027 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-b5eb49cb-74e2-49dd-8fc9-a004edacf0ed req-1badff83-302e-420a-8d62-911056173f1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5910c783-6877-4a41-8650-0973a11f3578", "tag": "30830547-1d6a-4cee-9341-539819ef5a04"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:21:25.777562 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-b5eb49cb-74e2-49dd-8fc9-a004edacf0ed req-1badff83-302e-420a-8d62-911056173f1b service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:25.778094 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-b5eb49cb-74e2-49dd-8fc9-a004edacf0ed req-1badff83-302e-420a-8d62-911056173f1b service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:25.778511 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-b5eb49cb-74e2-49dd-8fc9-a004edacf0ed req-1badff83-302e-420a-8d62-911056173f1b service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:25.800376 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-b5eb49cb-74e2-49dd-8fc9-a004edacf0ed req-1badff83-302e-420a-8d62-911056173f1b service nova] Creating event network-changed:30830547-1d6a-4cee-9341-539819ef5a04 for instance 5910c783-6877-4a41-8650-0973a11f3578 on n-h1-862769-1 Oct 27 03:21:25.805435 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-b5eb49cb-74e2-49dd-8fc9-a004edacf0ed req-1badff83-302e-420a-8d62-911056173f1b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044336 Oct 27 03:21:25.806141 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 99/189] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:21:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:21:25.894765 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-fa9c1524-0827-4187-b40a-b1d5290a72dd tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:25.895402 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-fa9c1524-0827-4187-b40a-b1d5290a72dd tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] [instance: 820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:25.901273 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fa9c1524-0827-4187-b40a-b1d5290a72dd tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:25.901760 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fa9c1524-0827-4187-b40a-b1d5290a72dd tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:25.902246 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fa9c1524-0827-4187-b40a-b1d5290a72dd tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:25.908499 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fa9c1524-0827-4187-b40a-b1d5290a72dd tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:25.908499 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fa9c1524-0827-4187-b40a-b1d5290a72dd tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:25.908499 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fa9c1524-0827-4187-b40a-b1d5290a72dd tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:25.967588 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e333a8bd-03a8-4d18-b863-7895c54fc155 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:25.968813 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e333a8bd-03a8-4d18-b863-7895c54fc155 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 5910c783-6877-4a41-8650-0973a11f3578] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:25.974958 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e333a8bd-03a8-4d18-b863-7895c54fc155 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:25.975459 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e333a8bd-03a8-4d18-b863-7895c54fc155 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:25.975907 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e333a8bd-03a8-4d18-b863-7895c54fc155 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:25.976612 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e333a8bd-03a8-4d18-b863-7895c54fc155 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:25.977076 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e333a8bd-03a8-4d18-b863-7895c54fc155 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:25.977509 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e333a8bd-03a8-4d18-b863-7895c54fc155 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:26.035476 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-fa9c1524-0827-4187-b40a-b1d5290a72dd tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015a9fcd508e4d20ad51dcb71053c28f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cee0e3469fc42a49004f9b5d1f5b6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:26.043164 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-fa9c1524-0827-4187-b40a-b1d5290a72dd tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] 10.222.0.20 "GET /compute/v2.1/servers/820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5" status: 200 len: 1339 microversion: 2.1 time: 0.152367 Oct 27 03:21:26.043737 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 91/190] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:25 2022] GET /compute/v2.1/servers/820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5 => generated 1339 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:26.048687 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-f792b1f4-c9bf-44f1-9475-91f50d1c36af req-c81bdf93-4e6a-4ecb-8abb-e844ea468269 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "238948a5-b12d-49a4-a73f-ed65a9f19182", "name": "network-vif-plugged", "status": "completed", "tag": "4fcd2849-4183-4f5a-b7c1-595d6364a17c"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:21:26.057735 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-f792b1f4-c9bf-44f1-9475-91f50d1c36af req-c81bdf93-4e6a-4ecb-8abb-e844ea468269 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:26.058258 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-f792b1f4-c9bf-44f1-9475-91f50d1c36af req-c81bdf93-4e6a-4ecb-8abb-e844ea468269 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:26.058695 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-f792b1f4-c9bf-44f1-9475-91f50d1c36af req-c81bdf93-4e6a-4ecb-8abb-e844ea468269 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:26.070310 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-f792b1f4-c9bf-44f1-9475-91f50d1c36af req-c81bdf93-4e6a-4ecb-8abb-e844ea468269 service nova] Creating event network-vif-plugged:4fcd2849-4183-4f5a-b7c1-595d6364a17c for instance 238948a5-b12d-49a4-a73f-ed65a9f19182 on n-h1-862769-1 Oct 27 03:21:26.075217 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-f792b1f4-c9bf-44f1-9475-91f50d1c36af req-c81bdf93-4e6a-4ecb-8abb-e844ea468269 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030371 Oct 27 03:21:26.076002 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 92/191] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:21:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:21:26.193326 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e333a8bd-03a8-4d18-b863-7895c54fc155 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:26.201461 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e333a8bd-03a8-4d18-b863-7895c54fc155 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578" status: 200 len: 1313 microversion: 2.1 time: 0.237954 Oct 27 03:21:26.202813 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 100/192] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:25 2022] GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578 => generated 1313 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:21:26.224937 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-80573ec1-3bfe-48da-b28a-be655dede658 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:26.226273 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-80573ec1-3bfe-48da-b28a-be655dede658 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] [instance: 238948a5-b12d-49a4-a73f-ed65a9f19182] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:26.232707 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-80573ec1-3bfe-48da-b28a-be655dede658 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:26.236504 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-80573ec1-3bfe-48da-b28a-be655dede658 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:26.236504 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-80573ec1-3bfe-48da-b28a-be655dede658 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:26.236504 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-80573ec1-3bfe-48da-b28a-be655dede658 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:26.236504 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-80573ec1-3bfe-48da-b28a-be655dede658 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:26.236840 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-80573ec1-3bfe-48da-b28a-be655dede658 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:26.381492 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-80573ec1-3bfe-48da-b28a-be655dede658 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff070c0383324e1da5c49e3d9c652516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1da8ce26ab49ddae972233777c4c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:26.392331 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-80573ec1-3bfe-48da-b28a-be655dede658 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] 10.222.0.20 "GET /compute/v2.1/servers/238948a5-b12d-49a4-a73f-ed65a9f19182" status: 200 len: 1320 microversion: 2.1 time: 0.171679 Oct 27 03:21:26.392907 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 93/193] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:26 2022] GET /compute/v2.1/servers/238948a5-b12d-49a4-a73f-ed65a9f19182 => generated 1320 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:21:26.406991 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a8ca2d91-c230-4369-a93c-a914c8166ef2 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:26.407861 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a8ca2d91-c230-4369-a93c-a914c8166ef2 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:26.414146 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a8ca2d91-c230-4369-a93c-a914c8166ef2 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:26.414862 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a8ca2d91-c230-4369-a93c-a914c8166ef2 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:26.415305 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a8ca2d91-c230-4369-a93c-a914c8166ef2 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:26.416008 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a8ca2d91-c230-4369-a93c-a914c8166ef2 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:26.416471 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a8ca2d91-c230-4369-a93c-a914c8166ef2 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:26.416903 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a8ca2d91-c230-4369-a93c-a914c8166ef2 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:26.484636 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a8ca2d91-c230-4369-a93c-a914c8166ef2 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:26.493871 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a8ca2d91-c230-4369-a93c-a914c8166ef2 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:26.495461 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a8ca2d91-c230-4369-a93c-a914c8166ef2 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:26.500710 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a8ca2d91-c230-4369-a93c-a914c8166ef2 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1512 microversion: 2.91 time: 0.098676 Oct 27 03:21:26.501472 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 101/194] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:21:26 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1512 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:21:26.619087 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4f874e5f-b46b-4c53-a51e-74ae60bdb1f3 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:26.620767 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4f874e5f-b46b-4c53-a51e-74ae60bdb1f3 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] [instance: a3b87dc4-af75-42ba-81af-7ad2ac59510c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:26.627641 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4f874e5f-b46b-4c53-a51e-74ae60bdb1f3 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:26.628127 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4f874e5f-b46b-4c53-a51e-74ae60bdb1f3 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:26.628562 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4f874e5f-b46b-4c53-a51e-74ae60bdb1f3 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:26.629257 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4f874e5f-b46b-4c53-a51e-74ae60bdb1f3 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:26.629745 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4f874e5f-b46b-4c53-a51e-74ae60bdb1f3 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:26.630195 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4f874e5f-b46b-4c53-a51e-74ae60bdb1f3 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:26.695396 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4f874e5f-b46b-4c53-a51e-74ae60bdb1f3 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3d2208faeb4421af21da56d455be92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b2b8b909c54f36b61d934d09607b5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:26.703558 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4f874e5f-b46b-4c53-a51e-74ae60bdb1f3 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] 10.222.0.20 "GET /compute/v2.1/servers/a3b87dc4-af75-42ba-81af-7ad2ac59510c" status: 200 len: 1311 microversion: 2.1 time: 0.089135 Oct 27 03:21:26.704128 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 94/195] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:26 2022] GET /compute/v2.1/servers/a3b87dc4-af75-42ba-81af-7ad2ac59510c => generated 1311 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:27.068400 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-49d6a22a-c7ab-4bd6-a983-67bd0c16022e tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:27.069146 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-49d6a22a-c7ab-4bd6-a983-67bd0c16022e tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] [instance: 820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:27.075662 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-49d6a22a-c7ab-4bd6-a983-67bd0c16022e tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:27.076154 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-49d6a22a-c7ab-4bd6-a983-67bd0c16022e tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:27.076593 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-49d6a22a-c7ab-4bd6-a983-67bd0c16022e tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:27.077344 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-49d6a22a-c7ab-4bd6-a983-67bd0c16022e tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:27.077917 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-49d6a22a-c7ab-4bd6-a983-67bd0c16022e tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:27.078362 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-49d6a22a-c7ab-4bd6-a983-67bd0c16022e tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:27.225069 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7b8e4478-0e04-40e6-9ff2-dee27ae11e29 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:27.225772 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7b8e4478-0e04-40e6-9ff2-dee27ae11e29 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 5910c783-6877-4a41-8650-0973a11f3578] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:27.231831 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7b8e4478-0e04-40e6-9ff2-dee27ae11e29 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:27.232371 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7b8e4478-0e04-40e6-9ff2-dee27ae11e29 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:27.232820 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7b8e4478-0e04-40e6-9ff2-dee27ae11e29 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:27.234049 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7b8e4478-0e04-40e6-9ff2-dee27ae11e29 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:27.234517 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7b8e4478-0e04-40e6-9ff2-dee27ae11e29 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:27.234950 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7b8e4478-0e04-40e6-9ff2-dee27ae11e29 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:27.261537 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-49d6a22a-c7ab-4bd6-a983-67bd0c16022e tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015a9fcd508e4d20ad51dcb71053c28f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cee0e3469fc42a49004f9b5d1f5b6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:27.270530 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-49d6a22a-c7ab-4bd6-a983-67bd0c16022e tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] 10.222.0.20 "GET /compute/v2.1/servers/820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5" status: 200 len: 1489 microversion: 2.1 time: 0.205968 Oct 27 03:21:27.271114 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 102/196] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:27 2022] GET /compute/v2.1/servers/820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5 => generated 1489 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:27.293507 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3e16755c-8ed6-4793-b342-7d2f5cfdbbc2 tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:27.294144 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-3e16755c-8ed6-4793-b342-7d2f5cfdbbc2 tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] [instance: 820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:27.300542 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3e16755c-8ed6-4793-b342-7d2f5cfdbbc2 tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:27.301199 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3e16755c-8ed6-4793-b342-7d2f5cfdbbc2 tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:27.301442 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3e16755c-8ed6-4793-b342-7d2f5cfdbbc2 tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:27.302324 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3e16755c-8ed6-4793-b342-7d2f5cfdbbc2 tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:27.302777 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3e16755c-8ed6-4793-b342-7d2f5cfdbbc2 tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:27.303204 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3e16755c-8ed6-4793-b342-7d2f5cfdbbc2 tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:27.446072 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7b8e4478-0e04-40e6-9ff2-dee27ae11e29 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:27.451375 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7b8e4478-0e04-40e6-9ff2-dee27ae11e29 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578" status: 200 len: 1313 microversion: 2.1 time: 0.230221 Oct 27 03:21:27.467184 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 95/197] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:27 2022] GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578 => generated 1313 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:21:27.474434 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9527858a-1c56-4682-8d34-c6d0d1db4caf tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:27.475087 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-9527858a-1c56-4682-8d34-c6d0d1db4caf tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] [instance: 238948a5-b12d-49a4-a73f-ed65a9f19182] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:27.484635 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9527858a-1c56-4682-8d34-c6d0d1db4caf tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:27.485122 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9527858a-1c56-4682-8d34-c6d0d1db4caf tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:27.485750 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9527858a-1c56-4682-8d34-c6d0d1db4caf tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:27.486515 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9527858a-1c56-4682-8d34-c6d0d1db4caf tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:27.487155 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9527858a-1c56-4682-8d34-c6d0d1db4caf tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:27.487584 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9527858a-1c56-4682-8d34-c6d0d1db4caf tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:27.511841 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=100 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:27.669387 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9527858a-1c56-4682-8d34-c6d0d1db4caf tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff070c0383324e1da5c49e3d9c652516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1da8ce26ab49ddae972233777c4c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:27.685015 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9527858a-1c56-4682-8d34-c6d0d1db4caf tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] 10.222.0.20 "GET /compute/v2.1/servers/238948a5-b12d-49a4-a73f-ed65a9f19182" status: 200 len: 1320 microversion: 2.1 time: 0.214672 Oct 27 03:21:27.687572 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3e16755c-8ed6-4793-b342-7d2f5cfdbbc2 tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5" status: 200 len: 1640 microversion: 2.1 time: 0.397509 Oct 27 03:21:27.691478 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 96/198] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:27 2022] GET /compute/v2.1/servers/238948a5-b12d-49a4-a73f-ed65a9f19182 => generated 1320 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:27.697450 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ebf5cfba-dd08-47b6-9451-b37f62fbb67a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:27.698104 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ebf5cfba-dd08-47b6-9451-b37f62fbb67a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:27.698558 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 103/199] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:27 2022] GET /compute/v2.1/servers/820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5 => generated 1640 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:21:27.708836 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ebf5cfba-dd08-47b6-9451-b37f62fbb67a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:27.709350 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ebf5cfba-dd08-47b6-9451-b37f62fbb67a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:27.709787 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ebf5cfba-dd08-47b6-9451-b37f62fbb67a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:27.710749 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ebf5cfba-dd08-47b6-9451-b37f62fbb67a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:27.711450 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ebf5cfba-dd08-47b6-9451-b37f62fbb67a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:27.711889 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ebf5cfba-dd08-47b6-9451-b37f62fbb67a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:27.715872 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-47c61a55-b4cc-4269-8b5c-d3363a5ecfdd tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:27.716563 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-47c61a55-b4cc-4269-8b5c-d3363a5ecfdd tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] [instance: 820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:27.723467 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-47c61a55-b4cc-4269-8b5c-d3363a5ecfdd tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:27.723945 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-47c61a55-b4cc-4269-8b5c-d3363a5ecfdd tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:27.724376 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-47c61a55-b4cc-4269-8b5c-d3363a5ecfdd tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:27.727304 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-47c61a55-b4cc-4269-8b5c-d3363a5ecfdd tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:27.727304 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-47c61a55-b4cc-4269-8b5c-d3363a5ecfdd tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:27.727304 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-47c61a55-b4cc-4269-8b5c-d3363a5ecfdd tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:27.753223 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-47c61a55-b4cc-4269-8b5c-d3363a5ecfdd tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] [instance: 820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5] Going to try to terminate instance {{(pid=121000) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:21:27.861912 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ebf5cfba-dd08-47b6-9451-b37f62fbb67a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:27.870421 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ebf5cfba-dd08-47b6-9451-b37f62fbb67a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:27.872478 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ebf5cfba-dd08-47b6-9451-b37f62fbb67a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:27.879986 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ebf5cfba-dd08-47b6-9451-b37f62fbb67a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1512 microversion: 2.91 time: 0.187526 Oct 27 03:21:27.880564 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 97/200] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:21:27 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1512 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:21:27.902115 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-693b69f8-df89-4451-8ea7-47a942994eaf tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:27.902927 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-693b69f8-df89-4451-8ea7-47a942994eaf tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] [instance: a3b87dc4-af75-42ba-81af-7ad2ac59510c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:27.909532 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-693b69f8-df89-4451-8ea7-47a942994eaf tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:27.910021 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-693b69f8-df89-4451-8ea7-47a942994eaf tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:27.910493 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-693b69f8-df89-4451-8ea7-47a942994eaf tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:27.911186 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-693b69f8-df89-4451-8ea7-47a942994eaf tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:27.911638 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-693b69f8-df89-4451-8ea7-47a942994eaf tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:27.912060 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-693b69f8-df89-4451-8ea7-47a942994eaf tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:28.063603 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-693b69f8-df89-4451-8ea7-47a942994eaf tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3d2208faeb4421af21da56d455be92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b2b8b909c54f36b61d934d09607b5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:28.071406 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-693b69f8-df89-4451-8ea7-47a942994eaf tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] 10.222.0.20 "GET /compute/v2.1/servers/a3b87dc4-af75-42ba-81af-7ad2ac59510c" status: 200 len: 1341 microversion: 2.1 time: 0.173174 Oct 27 03:21:28.072027 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 98/201] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:27 2022] GET /compute/v2.1/servers/a3b87dc4-af75-42ba-81af-7ad2ac59510c => generated 1341 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:28.115107 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-47c61a55-b4cc-4269-8b5c-d3363a5ecfdd tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] 10.222.0.20 "DELETE /compute/v2.1/servers/820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5" status: 204 len: 0 microversion: 2.1 time: 0.402552 Oct 27 03:21:28.115750 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 104/202] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:21:27 2022] DELETE /compute/v2.1/servers/820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 03:21:28.123864 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-552cf5f8-e76b-403a-a4a5-9a8f3faece0d tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:28.125232 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-552cf5f8-e76b-403a-a4a5-9a8f3faece0d tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] [instance: 820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:28.131567 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-552cf5f8-e76b-403a-a4a5-9a8f3faece0d tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:28.132064 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-552cf5f8-e76b-403a-a4a5-9a8f3faece0d tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:28.132516 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-552cf5f8-e76b-403a-a4a5-9a8f3faece0d tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:28.133233 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-552cf5f8-e76b-403a-a4a5-9a8f3faece0d tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:28.133690 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-552cf5f8-e76b-403a-a4a5-9a8f3faece0d tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:28.134157 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-552cf5f8-e76b-403a-a4a5-9a8f3faece0d tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:28.472161 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-552cf5f8-e76b-403a-a4a5-9a8f3faece0d tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015a9fcd508e4d20ad51dcb71053c28f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cee0e3469fc42a49004f9b5d1f5b6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:28.474951 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1c41d370-0eae-4a62-b12a-da6045ced3e8 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:28.475766 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1c41d370-0eae-4a62-b12a-da6045ced3e8 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 5910c783-6877-4a41-8650-0973a11f3578] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:28.478596 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:28.482197 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-552cf5f8-e76b-403a-a4a5-9a8f3faece0d tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] 10.222.0.20 "GET /compute/v2.1/servers/820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5" status: 200 len: 1495 microversion: 2.1 time: 0.362193 Oct 27 03:21:28.482880 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 99/203] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:28 2022] GET /compute/v2.1/servers/820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5 => generated 1495 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:21:28.483911 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1c41d370-0eae-4a62-b12a-da6045ced3e8 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:28.484573 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1c41d370-0eae-4a62-b12a-da6045ced3e8 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:28.485014 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1c41d370-0eae-4a62-b12a-da6045ced3e8 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:28.485721 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1c41d370-0eae-4a62-b12a-da6045ced3e8 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:28.486202 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1c41d370-0eae-4a62-b12a-da6045ced3e8 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:28.486627 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1c41d370-0eae-4a62-b12a-da6045ced3e8 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:28.622118 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1c41d370-0eae-4a62-b12a-da6045ced3e8 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:28.629513 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-eee59062-3c29-44ef-9165-48ba27de0e7c req-ff37ed29-d032-4e17-bb43-a445a65cc16c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3b87dc4-af75-42ba-81af-7ad2ac59510c", "tag": "c4a8dff3-34b2-4172-8d3b-ee64c1364a2c"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:21:28.630919 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1c41d370-0eae-4a62-b12a-da6045ced3e8 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578" status: 200 len: 1313 microversion: 2.1 time: 0.160380 Oct 27 03:21:28.645311 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 105/204] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:28 2022] GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:21:28.645485 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-eee59062-3c29-44ef-9165-48ba27de0e7c req-ff37ed29-d032-4e17-bb43-a445a65cc16c service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:28.645485 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-eee59062-3c29-44ef-9165-48ba27de0e7c req-ff37ed29-d032-4e17-bb43-a445a65cc16c service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:28.645485 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-eee59062-3c29-44ef-9165-48ba27de0e7c req-ff37ed29-d032-4e17-bb43-a445a65cc16c service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:28.651962 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-eee59062-3c29-44ef-9165-48ba27de0e7c req-ff37ed29-d032-4e17-bb43-a445a65cc16c service nova] Creating event network-changed:c4a8dff3-34b2-4172-8d3b-ee64c1364a2c for instance a3b87dc4-af75-42ba-81af-7ad2ac59510c on n-h2-862769-1 Oct 27 03:21:28.656791 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-eee59062-3c29-44ef-9165-48ba27de0e7c req-ff37ed29-d032-4e17-bb43-a445a65cc16c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031077 Oct 27 03:21:28.657361 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 100/205] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:21:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:21:28.715084 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a748c240-cd1d-4195-8450-f2bc76630cff tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:28.719347 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a748c240-cd1d-4195-8450-f2bc76630cff tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] [instance: 238948a5-b12d-49a4-a73f-ed65a9f19182] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:28.726788 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a748c240-cd1d-4195-8450-f2bc76630cff tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:28.727307 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a748c240-cd1d-4195-8450-f2bc76630cff tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:28.727740 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a748c240-cd1d-4195-8450-f2bc76630cff tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:28.728464 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a748c240-cd1d-4195-8450-f2bc76630cff tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:28.728988 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a748c240-cd1d-4195-8450-f2bc76630cff tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:28.729413 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a748c240-cd1d-4195-8450-f2bc76630cff tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:28.864056 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a748c240-cd1d-4195-8450-f2bc76630cff tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff070c0383324e1da5c49e3d9c652516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1da8ce26ab49ddae972233777c4c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:28.871841 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a748c240-cd1d-4195-8450-f2bc76630cff tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] 10.222.0.20 "GET /compute/v2.1/servers/238948a5-b12d-49a4-a73f-ed65a9f19182" status: 200 len: 1320 microversion: 2.1 time: 0.166710 Oct 27 03:21:28.872410 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 106/206] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:28 2022] GET /compute/v2.1/servers/238948a5-b12d-49a4-a73f-ed65a9f19182 => generated 1320 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:28.909519 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-426b1555-71c3-4fd8-b527-d40a571f2ac6 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:28.910557 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-426b1555-71c3-4fd8-b527-d40a571f2ac6 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:28.917084 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-426b1555-71c3-4fd8-b527-d40a571f2ac6 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:28.917748 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-426b1555-71c3-4fd8-b527-d40a571f2ac6 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:28.918387 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-426b1555-71c3-4fd8-b527-d40a571f2ac6 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:28.919228 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-426b1555-71c3-4fd8-b527-d40a571f2ac6 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:28.919946 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-426b1555-71c3-4fd8-b527-d40a571f2ac6 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:28.920650 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-426b1555-71c3-4fd8-b527-d40a571f2ac6 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:28.989893 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-426b1555-71c3-4fd8-b527-d40a571f2ac6 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:28.998266 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-426b1555-71c3-4fd8-b527-d40a571f2ac6 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:28.999741 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-426b1555-71c3-4fd8-b527-d40a571f2ac6 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:29.004734 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-426b1555-71c3-4fd8-b527-d40a571f2ac6 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1533 microversion: 2.91 time: 0.100141 Oct 27 03:21:29.005308 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 101/207] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:21:28 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1533 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:21:29.100772 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-69ce3240-7359-44a7-afb2-c86405060638 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:29.105719 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-69ce3240-7359-44a7-afb2-c86405060638 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] [instance: a3b87dc4-af75-42ba-81af-7ad2ac59510c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:29.107584 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-69ce3240-7359-44a7-afb2-c86405060638 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:29.108071 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-69ce3240-7359-44a7-afb2-c86405060638 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:29.109072 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-69ce3240-7359-44a7-afb2-c86405060638 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:29.109942 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-69ce3240-7359-44a7-afb2-c86405060638 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:29.110564 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-69ce3240-7359-44a7-afb2-c86405060638 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:29.110988 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-69ce3240-7359-44a7-afb2-c86405060638 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:29.155820 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-eb787377-0000-4129-a11f-2cc7ee913220 tempest-UnshelveToHostMultiNodesTest-20786752 tempest-UnshelveToHostMultiNodesTest-20786752-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:29.156467 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-eb787377-0000-4129-a11f-2cc7ee913220 tempest-UnshelveToHostMultiNodesTest-20786752 tempest-UnshelveToHostMultiNodesTest-20786752-project-admin] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:29.162892 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eb787377-0000-4129-a11f-2cc7ee913220 tempest-UnshelveToHostMultiNodesTest-20786752 tempest-UnshelveToHostMultiNodesTest-20786752-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:29.163658 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eb787377-0000-4129-a11f-2cc7ee913220 tempest-UnshelveToHostMultiNodesTest-20786752 tempest-UnshelveToHostMultiNodesTest-20786752-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:29.164260 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eb787377-0000-4129-a11f-2cc7ee913220 tempest-UnshelveToHostMultiNodesTest-20786752 tempest-UnshelveToHostMultiNodesTest-20786752-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:29.164980 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eb787377-0000-4129-a11f-2cc7ee913220 tempest-UnshelveToHostMultiNodesTest-20786752 tempest-UnshelveToHostMultiNodesTest-20786752-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:29.165470 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eb787377-0000-4129-a11f-2cc7ee913220 tempest-UnshelveToHostMultiNodesTest-20786752 tempest-UnshelveToHostMultiNodesTest-20786752-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:29.165979 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eb787377-0000-4129-a11f-2cc7ee913220 tempest-UnshelveToHostMultiNodesTest-20786752 tempest-UnshelveToHostMultiNodesTest-20786752-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:29.303028 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-eb787377-0000-4129-a11f-2cc7ee913220 tempest-UnshelveToHostMultiNodesTest-20786752 tempest-UnshelveToHostMultiNodesTest-20786752-project-admin] Lazy-loading 'services' on Instance uuid c3536a26-29e6-4208-a03b-9609511fb53b {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:21:29.322501 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-69ce3240-7359-44a7-afb2-c86405060638 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3d2208faeb4421af21da56d455be92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b2b8b909c54f36b61d934d09607b5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:29.332569 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-69ce3240-7359-44a7-afb2-c86405060638 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] 10.222.0.20 "GET /compute/v2.1/servers/a3b87dc4-af75-42ba-81af-7ad2ac59510c" status: 200 len: 1341 microversion: 2.1 time: 0.235541 Oct 27 03:21:29.342121 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 102/208] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:29 2022] GET /compute/v2.1/servers/a3b87dc4-af75-42ba-81af-7ad2ac59510c => generated 1341 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:21:29.361204 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-eb787377-0000-4129-a11f-2cc7ee913220 tempest-UnshelveToHostMultiNodesTest-20786752 tempest-UnshelveToHostMultiNodesTest-20786752-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1938 microversion: 2.91 time: 0.331257 Oct 27 03:21:29.361808 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 107/209] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:21:29 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1938 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:21:29.390181 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-bf287a4f-3494-443f-8a39-8a2ee5aae24e tempest-UnshelveToHostMultiNodesTest-20786752 tempest-UnshelveToHostMultiNodesTest-20786752-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:29.390792 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-bf287a4f-3494-443f-8a39-8a2ee5aae24e tempest-UnshelveToHostMultiNodesTest-20786752 tempest-UnshelveToHostMultiNodesTest-20786752-project-admin] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:29.396928 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bf287a4f-3494-443f-8a39-8a2ee5aae24e tempest-UnshelveToHostMultiNodesTest-20786752 tempest-UnshelveToHostMultiNodesTest-20786752-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:29.397637 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bf287a4f-3494-443f-8a39-8a2ee5aae24e tempest-UnshelveToHostMultiNodesTest-20786752 tempest-UnshelveToHostMultiNodesTest-20786752-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:29.398100 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bf287a4f-3494-443f-8a39-8a2ee5aae24e tempest-UnshelveToHostMultiNodesTest-20786752 tempest-UnshelveToHostMultiNodesTest-20786752-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:29.399343 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bf287a4f-3494-443f-8a39-8a2ee5aae24e tempest-UnshelveToHostMultiNodesTest-20786752 tempest-UnshelveToHostMultiNodesTest-20786752-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:29.399890 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bf287a4f-3494-443f-8a39-8a2ee5aae24e tempest-UnshelveToHostMultiNodesTest-20786752 tempest-UnshelveToHostMultiNodesTest-20786752-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:29.400421 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bf287a4f-3494-443f-8a39-8a2ee5aae24e tempest-UnshelveToHostMultiNodesTest-20786752 tempest-UnshelveToHostMultiNodesTest-20786752-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:29.507064 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-bb3378bb-4710-4c22-a282-8a280809c00b tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:29.508321 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-bb3378bb-4710-4c22-a282-8a280809c00b tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] [instance: 820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:29.518508 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bb3378bb-4710-4c22-a282-8a280809c00b tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:29.518997 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bb3378bb-4710-4c22-a282-8a280809c00b tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:29.519431 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bb3378bb-4710-4c22-a282-8a280809c00b tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:29.520132 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bb3378bb-4710-4c22-a282-8a280809c00b tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:29.520582 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bb3378bb-4710-4c22-a282-8a280809c00b tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:29.521003 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bb3378bb-4710-4c22-a282-8a280809c00b tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:29.538917 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-bf287a4f-3494-443f-8a39-8a2ee5aae24e tempest-UnshelveToHostMultiNodesTest-20786752 tempest-UnshelveToHostMultiNodesTest-20786752-project-admin] Lazy-loading 'services' on Instance uuid c3536a26-29e6-4208-a03b-9609511fb53b {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:21:29.599340 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-bf287a4f-3494-443f-8a39-8a2ee5aae24e tempest-UnshelveToHostMultiNodesTest-20786752 tempest-UnshelveToHostMultiNodesTest-20786752-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1938 microversion: 2.91 time: 0.214720 Oct 27 03:21:29.600167 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 103/210] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:21:29 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1938 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:21:29.626693 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-03ad17bf-a108-439c-9550-0b9c8127aa4a tempest-UnshelveToHostMultiNodesTest-20786752 tempest-UnshelveToHostMultiNodesTest-20786752-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:29.630374 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-03ad17bf-a108-439c-9550-0b9c8127aa4a tempest-UnshelveToHostMultiNodesTest-20786752 tempest-UnshelveToHostMultiNodesTest-20786752-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:29.630862 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-03ad17bf-a108-439c-9550-0b9c8127aa4a tempest-UnshelveToHostMultiNodesTest-20786752 tempest-UnshelveToHostMultiNodesTest-20786752-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:29.631298 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-03ad17bf-a108-439c-9550-0b9c8127aa4a tempest-UnshelveToHostMultiNodesTest-20786752 tempest-UnshelveToHostMultiNodesTest-20786752-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:29.632030 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-03ad17bf-a108-439c-9550-0b9c8127aa4a tempest-UnshelveToHostMultiNodesTest-20786752 tempest-UnshelveToHostMultiNodesTest-20786752-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:29.632486 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-03ad17bf-a108-439c-9550-0b9c8127aa4a tempest-UnshelveToHostMultiNodesTest-20786752 tempest-UnshelveToHostMultiNodesTest-20786752-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:29.632909 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-03ad17bf-a108-439c-9550-0b9c8127aa4a tempest-UnshelveToHostMultiNodesTest-20786752 tempest-UnshelveToHostMultiNodesTest-20786752-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:29.648989 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:29.659772 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-03ad17bf-a108-439c-9550-0b9c8127aa4a tempest-UnshelveToHostMultiNodesTest-20786752 tempest-UnshelveToHostMultiNodesTest-20786752-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 520 microversion: 2.91 time: 0.037572 Oct 27 03:21:29.660389 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 104/211] 10.222.0.20 () {60 vars in 1217 bytes} [Thu Oct 27 03:21:29 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 520 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 03:21:29.666320 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-dc924a9b-4623-40cb-b1f5-b94c6a621464 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:29.666937 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-dc924a9b-4623-40cb-b1f5-b94c6a621464 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 5910c783-6877-4a41-8650-0973a11f3578] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:29.672851 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dc924a9b-4623-40cb-b1f5-b94c6a621464 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:29.673532 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dc924a9b-4623-40cb-b1f5-b94c6a621464 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:29.673977 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dc924a9b-4623-40cb-b1f5-b94c6a621464 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:29.674709 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dc924a9b-4623-40cb-b1f5-b94c6a621464 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:29.675163 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dc924a9b-4623-40cb-b1f5-b94c6a621464 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:29.675590 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dc924a9b-4623-40cb-b1f5-b94c6a621464 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:29.691254 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-bb3378bb-4710-4c22-a282-8a280809c00b tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015a9fcd508e4d20ad51dcb71053c28f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cee0e3469fc42a49004f9b5d1f5b6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:29.709966 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-bb3378bb-4710-4c22-a282-8a280809c00b tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] 10.222.0.20 "GET /compute/v2.1/servers/820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5" status: 200 len: 1495 microversion: 2.1 time: 0.205655 Oct 27 03:21:29.710820 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 108/212] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:29 2022] GET /compute/v2.1/servers/820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5 => generated 1495 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:21:29.716790 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5fbd9ccc-92e6-4485-80b0-5388c479311c tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:21:29.717989 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5fbd9ccc-92e6-4485-80b0-5388c479311c tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:29.726185 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5fbd9ccc-92e6-4485-80b0-5388c479311c tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:29.726683 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5fbd9ccc-92e6-4485-80b0-5388c479311c tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:29.727126 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5fbd9ccc-92e6-4485-80b0-5388c479311c tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:29.727865 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5fbd9ccc-92e6-4485-80b0-5388c479311c tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:29.728531 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5fbd9ccc-92e6-4485-80b0-5388c479311c tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:29.728970 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5fbd9ccc-92e6-4485-80b0-5388c479311c tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:29.755557 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-5fbd9ccc-92e6-4485-80b0-5388c479311c tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lazy-loading 'flavor' on Instance uuid c3536a26-29e6-4208-a03b-9609511fb53b {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:21:29.937487 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-dc924a9b-4623-40cb-b1f5-b94c6a621464 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:29.947538 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-dc924a9b-4623-40cb-b1f5-b94c6a621464 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578" status: 200 len: 1313 microversion: 2.1 time: 0.284879 Oct 27 03:21:29.953132 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 105/213] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:29 2022] GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578 => generated 1313 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:29.959882 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1583055d-6d63-4f41-8033-d3bd19cab0e2 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:29.960541 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1583055d-6d63-4f41-8033-d3bd19cab0e2 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] [instance: 238948a5-b12d-49a4-a73f-ed65a9f19182] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:29.967903 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1583055d-6d63-4f41-8033-d3bd19cab0e2 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:29.968608 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1583055d-6d63-4f41-8033-d3bd19cab0e2 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:29.969199 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1583055d-6d63-4f41-8033-d3bd19cab0e2 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:29.970109 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1583055d-6d63-4f41-8033-d3bd19cab0e2 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:29.970717 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1583055d-6d63-4f41-8033-d3bd19cab0e2 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:29.974352 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1583055d-6d63-4f41-8033-d3bd19cab0e2 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:30.242721 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1583055d-6d63-4f41-8033-d3bd19cab0e2 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff070c0383324e1da5c49e3d9c652516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1da8ce26ab49ddae972233777c4c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:30.251908 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1583055d-6d63-4f41-8033-d3bd19cab0e2 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] 10.222.0.20 "GET /compute/v2.1/servers/238948a5-b12d-49a4-a73f-ed65a9f19182" status: 200 len: 1470 microversion: 2.1 time: 0.297505 Oct 27 03:21:30.258842 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 106/214] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:29 2022] GET /compute/v2.1/servers/238948a5-b12d-49a4-a73f-ed65a9f19182 => generated 1470 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:30.367361 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5fbd9ccc-92e6-4485-80b0-5388c479311c tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "POST /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b/action" status: 202 len: 0 microversion: 2.91 time: 0.655279 Oct 27 03:21:30.372178 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 109/215] 10.222.0.20 () {62 vars in 1319 bytes} [Thu Oct 27 03:21:29 2022] POST /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b/action => generated 0 bytes in 661 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:21:30.389969 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a9e75396-7104-4af9-a130-1b4724fc26b8 tempest-DeleteServersAdminTestJSON-1504400761 tempest-DeleteServersAdminTestJSON-1504400761-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:30.392764 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a9e75396-7104-4af9-a130-1b4724fc26b8 tempest-DeleteServersAdminTestJSON-1504400761 tempest-DeleteServersAdminTestJSON-1504400761-project-admin] [instance: 238948a5-b12d-49a4-a73f-ed65a9f19182] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:30.392881 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7674ab75-7397-41f6-90cf-2dc0dacab9f8 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:30.392881 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7674ab75-7397-41f6-90cf-2dc0dacab9f8 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] [instance: a3b87dc4-af75-42ba-81af-7ad2ac59510c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:30.405756 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7674ab75-7397-41f6-90cf-2dc0dacab9f8 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:30.406282 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7674ab75-7397-41f6-90cf-2dc0dacab9f8 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:30.406717 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7674ab75-7397-41f6-90cf-2dc0dacab9f8 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:30.407421 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7674ab75-7397-41f6-90cf-2dc0dacab9f8 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:30.407869 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7674ab75-7397-41f6-90cf-2dc0dacab9f8 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:30.408296 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7674ab75-7397-41f6-90cf-2dc0dacab9f8 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:30.413944 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a9e75396-7104-4af9-a130-1b4724fc26b8 tempest-DeleteServersAdminTestJSON-1504400761 tempest-DeleteServersAdminTestJSON-1504400761-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:30.414762 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a9e75396-7104-4af9-a130-1b4724fc26b8 tempest-DeleteServersAdminTestJSON-1504400761 tempest-DeleteServersAdminTestJSON-1504400761-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:30.415219 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a9e75396-7104-4af9-a130-1b4724fc26b8 tempest-DeleteServersAdminTestJSON-1504400761 tempest-DeleteServersAdminTestJSON-1504400761-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:30.417141 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a9e75396-7104-4af9-a130-1b4724fc26b8 tempest-DeleteServersAdminTestJSON-1504400761 tempest-DeleteServersAdminTestJSON-1504400761-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:30.419904 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a9e75396-7104-4af9-a130-1b4724fc26b8 tempest-DeleteServersAdminTestJSON-1504400761 tempest-DeleteServersAdminTestJSON-1504400761-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:30.419904 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a9e75396-7104-4af9-a130-1b4724fc26b8 tempest-DeleteServersAdminTestJSON-1504400761 tempest-DeleteServersAdminTestJSON-1504400761-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:30.506316 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a9e75396-7104-4af9-a130-1b4724fc26b8 tempest-DeleteServersAdminTestJSON-1504400761 tempest-DeleteServersAdminTestJSON-1504400761-project-admin] [instance: 238948a5-b12d-49a4-a73f-ed65a9f19182] Going to try to terminate instance {{(pid=121001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:21:30.591708 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7674ab75-7397-41f6-90cf-2dc0dacab9f8 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3d2208faeb4421af21da56d455be92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b2b8b909c54f36b61d934d09607b5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:30.600682 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7674ab75-7397-41f6-90cf-2dc0dacab9f8 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] 10.222.0.20 "GET /compute/v2.1/servers/a3b87dc4-af75-42ba-81af-7ad2ac59510c" status: 200 len: 1341 microversion: 2.1 time: 0.227082 Oct 27 03:21:30.601490 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 110/216] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:30 2022] GET /compute/v2.1/servers/a3b87dc4-af75-42ba-81af-7ad2ac59510c => generated 1341 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:30.606165 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c1d79fca-74a7-4200-8dec-ef9c2b1d48e2 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:30.606839 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c1d79fca-74a7-4200-8dec-ef9c2b1d48e2 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:30.613164 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c1d79fca-74a7-4200-8dec-ef9c2b1d48e2 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:30.613838 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c1d79fca-74a7-4200-8dec-ef9c2b1d48e2 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:30.614373 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c1d79fca-74a7-4200-8dec-ef9c2b1d48e2 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:30.615128 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c1d79fca-74a7-4200-8dec-ef9c2b1d48e2 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:30.615653 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c1d79fca-74a7-4200-8dec-ef9c2b1d48e2 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:30.616145 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c1d79fca-74a7-4200-8dec-ef9c2b1d48e2 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:30.620443 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:30.681986 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c1d79fca-74a7-4200-8dec-ef9c2b1d48e2 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:30.689990 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c1d79fca-74a7-4200-8dec-ef9c2b1d48e2 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:30.691405 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c1d79fca-74a7-4200-8dec-ef9c2b1d48e2 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:30.696066 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c1d79fca-74a7-4200-8dec-ef9c2b1d48e2 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1539 microversion: 2.91 time: 0.093693 Oct 27 03:21:30.696638 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 111/217] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:21:30 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1539 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:21:30.700930 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-434a785f-af70-40a4-962c-599064ff154a req-afe4dab5-477d-4ab4-8450-3360be19c564 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5", "name": "network-vif-deleted", "tag": "7281d005-1139-42c9-b8d2-f7f602562c0c"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:21:30.710099 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-434a785f-af70-40a4-962c-599064ff154a req-afe4dab5-477d-4ab4-8450-3360be19c564 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:30.710578 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-434a785f-af70-40a4-962c-599064ff154a req-afe4dab5-477d-4ab4-8450-3360be19c564 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:30.711003 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-434a785f-af70-40a4-962c-599064ff154a req-afe4dab5-477d-4ab4-8450-3360be19c564 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:30.722010 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-434a785f-af70-40a4-962c-599064ff154a req-afe4dab5-477d-4ab4-8450-3360be19c564 service nova] Creating event network-vif-deleted:7281d005-1139-42c9-b8d2-f7f602562c0c for instance 820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5 on n-h2-862769-1 Oct 27 03:21:30.726899 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-434a785f-af70-40a4-962c-599064ff154a req-afe4dab5-477d-4ab4-8450-3360be19c564 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029176 Oct 27 03:21:30.727677 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 112/218] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:21:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:21:30.734641 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5058b1b9-c2e9-4a95-b6d1-18dde7defd86 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:30.735405 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5058b1b9-c2e9-4a95-b6d1-18dde7defd86 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] [instance: 820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:30.742381 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5058b1b9-c2e9-4a95-b6d1-18dde7defd86 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:30.742867 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5058b1b9-c2e9-4a95-b6d1-18dde7defd86 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:30.743810 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5058b1b9-c2e9-4a95-b6d1-18dde7defd86 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:30.744008 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5058b1b9-c2e9-4a95-b6d1-18dde7defd86 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:30.744466 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5058b1b9-c2e9-4a95-b6d1-18dde7defd86 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:30.744893 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5058b1b9-c2e9-4a95-b6d1-18dde7defd86 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:30.806907 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5058b1b9-c2e9-4a95-b6d1-18dde7defd86 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015a9fcd508e4d20ad51dcb71053c28f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cee0e3469fc42a49004f9b5d1f5b6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:30.813201 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a9e75396-7104-4af9-a130-1b4724fc26b8 tempest-DeleteServersAdminTestJSON-1504400761 tempest-DeleteServersAdminTestJSON-1504400761-project-admin] 10.222.0.20 "DELETE /compute/v2.1/servers/238948a5-b12d-49a4-a73f-ed65a9f19182" status: 204 len: 0 microversion: 2.1 time: 0.538922 Oct 27 03:21:30.813820 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 107/219] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:21:30 2022] DELETE /compute/v2.1/servers/238948a5-b12d-49a4-a73f-ed65a9f19182 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 03:21:30.814886 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5058b1b9-c2e9-4a95-b6d1-18dde7defd86 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] 10.222.0.20 "GET /compute/v2.1/servers/820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5" status: 200 len: 1453 microversion: 2.1 time: 0.084622 Oct 27 03:21:30.815636 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 113/220] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:30 2022] GET /compute/v2.1/servers/820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5 => generated 1453 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:30.822154 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-23ac10eb-9e5b-4380-8571-678d1d8935b3 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:30.822937 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-23ac10eb-9e5b-4380-8571-678d1d8935b3 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] [instance: 238948a5-b12d-49a4-a73f-ed65a9f19182] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:30.829401 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-23ac10eb-9e5b-4380-8571-678d1d8935b3 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:30.829993 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-23ac10eb-9e5b-4380-8571-678d1d8935b3 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:30.830456 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-23ac10eb-9e5b-4380-8571-678d1d8935b3 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:30.831144 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-23ac10eb-9e5b-4380-8571-678d1d8935b3 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:30.831609 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-23ac10eb-9e5b-4380-8571-678d1d8935b3 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:30.834260 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-23ac10eb-9e5b-4380-8571-678d1d8935b3 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:30.961746 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-23ac10eb-9e5b-4380-8571-678d1d8935b3 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff070c0383324e1da5c49e3d9c652516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1da8ce26ab49ddae972233777c4c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:30.970429 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-23ac10eb-9e5b-4380-8571-678d1d8935b3 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] 10.222.0.20 "GET /compute/v2.1/servers/238948a5-b12d-49a4-a73f-ed65a9f19182" status: 200 len: 1476 microversion: 2.1 time: 0.152202 Oct 27 03:21:30.971001 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 108/221] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:30 2022] GET /compute/v2.1/servers/238948a5-b12d-49a4-a73f-ed65a9f19182 => generated 1476 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:30.973290 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c306fbd2-d943-400d-8833-62bcabe6ec3a tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:30.973902 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c306fbd2-d943-400d-8833-62bcabe6ec3a tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 5910c783-6877-4a41-8650-0973a11f3578] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:30.980237 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c306fbd2-d943-400d-8833-62bcabe6ec3a tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:30.980719 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c306fbd2-d943-400d-8833-62bcabe6ec3a tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:30.981145 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c306fbd2-d943-400d-8833-62bcabe6ec3a tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:30.981833 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c306fbd2-d943-400d-8833-62bcabe6ec3a tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:30.982328 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c306fbd2-d943-400d-8833-62bcabe6ec3a tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:30.982752 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c306fbd2-d943-400d-8833-62bcabe6ec3a tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:31.108798 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c306fbd2-d943-400d-8833-62bcabe6ec3a tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:31.116393 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c306fbd2-d943-400d-8833-62bcabe6ec3a tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578" status: 200 len: 1313 microversion: 2.1 time: 0.146991 Oct 27 03:21:31.116959 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 114/222] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:30 2022] GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:21:31.624451 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4ea05cdc-cf51-4f8b-99c3-eee6ae31fd3d tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:31.625059 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4ea05cdc-cf51-4f8b-99c3-eee6ae31fd3d tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] [instance: a3b87dc4-af75-42ba-81af-7ad2ac59510c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:31.631638 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4ea05cdc-cf51-4f8b-99c3-eee6ae31fd3d tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:31.631744 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4ea05cdc-cf51-4f8b-99c3-eee6ae31fd3d tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:31.632093 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4ea05cdc-cf51-4f8b-99c3-eee6ae31fd3d tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:31.632783 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4ea05cdc-cf51-4f8b-99c3-eee6ae31fd3d tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:31.633246 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4ea05cdc-cf51-4f8b-99c3-eee6ae31fd3d tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:31.633652 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4ea05cdc-cf51-4f8b-99c3-eee6ae31fd3d tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:31.723806 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4f8066b1-5bd1-44f9-9a1a-93e834c8a94e tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:31.724527 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4f8066b1-5bd1-44f9-9a1a-93e834c8a94e tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:31.731663 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4f8066b1-5bd1-44f9-9a1a-93e834c8a94e tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:31.733005 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4f8066b1-5bd1-44f9-9a1a-93e834c8a94e tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:31.735181 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4f8066b1-5bd1-44f9-9a1a-93e834c8a94e tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:31.735181 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4f8066b1-5bd1-44f9-9a1a-93e834c8a94e tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:31.736002 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4f8066b1-5bd1-44f9-9a1a-93e834c8a94e tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:31.736002 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4f8066b1-5bd1-44f9-9a1a-93e834c8a94e tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:31.760005 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4ea05cdc-cf51-4f8b-99c3-eee6ae31fd3d tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3d2208faeb4421af21da56d455be92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b2b8b909c54f36b61d934d09607b5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:31.768256 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4ea05cdc-cf51-4f8b-99c3-eee6ae31fd3d tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] 10.222.0.20 "GET /compute/v2.1/servers/a3b87dc4-af75-42ba-81af-7ad2ac59510c" status: 200 len: 1341 microversion: 2.1 time: 0.148250 Oct 27 03:21:31.769078 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 109/223] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:31 2022] GET /compute/v2.1/servers/a3b87dc4-af75-42ba-81af-7ad2ac59510c => generated 1341 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:31.809586 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4f8066b1-5bd1-44f9-9a1a-93e834c8a94e tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:31.818342 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4f8066b1-5bd1-44f9-9a1a-93e834c8a94e tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:31.819795 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4f8066b1-5bd1-44f9-9a1a-93e834c8a94e tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:31.822462 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:31.825236 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4f8066b1-5bd1-44f9-9a1a-93e834c8a94e tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1539 microversion: 2.91 time: 0.105262 Oct 27 03:21:31.825741 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 115/224] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:21:31 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1539 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:21:31.838282 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a17ed8ca-a8ab-47b3-9e8f-06d39d2aa255 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:31.839193 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a17ed8ca-a8ab-47b3-9e8f-06d39d2aa255 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] [instance: 820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:31.846448 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a17ed8ca-a8ab-47b3-9e8f-06d39d2aa255 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:31.846940 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a17ed8ca-a8ab-47b3-9e8f-06d39d2aa255 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:31.847416 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a17ed8ca-a8ab-47b3-9e8f-06d39d2aa255 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:31.848115 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a17ed8ca-a8ab-47b3-9e8f-06d39d2aa255 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:31.848569 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a17ed8ca-a8ab-47b3-9e8f-06d39d2aa255 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:31.849199 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a17ed8ca-a8ab-47b3-9e8f-06d39d2aa255 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:31.886157 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a17ed8ca-a8ab-47b3-9e8f-06d39d2aa255 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:31.886157 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a17ed8ca-a8ab-47b3-9e8f-06d39d2aa255 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:31.886157 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a17ed8ca-a8ab-47b3-9e8f-06d39d2aa255 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:31.886157 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-a17ed8ca-a8ab-47b3-9e8f-06d39d2aa255 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lazy-loading 'fault' on Instance uuid 820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5 {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:21:31.933300 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a17ed8ca-a8ab-47b3-9e8f-06d39d2aa255 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015a9fcd508e4d20ad51dcb71053c28f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cee0e3469fc42a49004f9b5d1f5b6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:31.942867 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a17ed8ca-a8ab-47b3-9e8f-06d39d2aa255 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] 10.222.0.20 "GET /compute/v2.1/servers/820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5" status: 200 len: 1329 microversion: 2.1 time: 0.108402 Oct 27 03:21:31.949377 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 110/225] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:31 2022] GET /compute/v2.1/servers/820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5 => generated 1329 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:31.993271 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6964d213-88f6-4cb2-9ec2-4de21720af3f tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:31.993993 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6964d213-88f6-4cb2-9ec2-4de21720af3f tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] [instance: 238948a5-b12d-49a4-a73f-ed65a9f19182] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:32.000205 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6964d213-88f6-4cb2-9ec2-4de21720af3f tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:32.000692 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6964d213-88f6-4cb2-9ec2-4de21720af3f tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:32.003428 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6964d213-88f6-4cb2-9ec2-4de21720af3f tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:32.003428 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6964d213-88f6-4cb2-9ec2-4de21720af3f tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:32.003428 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6964d213-88f6-4cb2-9ec2-4de21720af3f tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:32.003428 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6964d213-88f6-4cb2-9ec2-4de21720af3f tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:32.133535 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-6964d213-88f6-4cb2-9ec2-4de21720af3f tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff070c0383324e1da5c49e3d9c652516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1da8ce26ab49ddae972233777c4c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:32.139114 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-503f57a0-63f4-444d-abdb-ce57cbd857dd tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:32.139741 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-503f57a0-63f4-444d-abdb-ce57cbd857dd tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 5910c783-6877-4a41-8650-0973a11f3578] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:32.141554 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6964d213-88f6-4cb2-9ec2-4de21720af3f tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] 10.222.0.20 "GET /compute/v2.1/servers/238948a5-b12d-49a4-a73f-ed65a9f19182" status: 200 len: 1476 microversion: 2.1 time: 0.152653 Oct 27 03:21:32.142148 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 116/226] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:31 2022] GET /compute/v2.1/servers/238948a5-b12d-49a4-a73f-ed65a9f19182 => generated 1476 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:32.145899 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-503f57a0-63f4-444d-abdb-ce57cbd857dd tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:32.146397 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-503f57a0-63f4-444d-abdb-ce57cbd857dd tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:32.146837 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-503f57a0-63f4-444d-abdb-ce57cbd857dd tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:32.150773 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-503f57a0-63f4-444d-abdb-ce57cbd857dd tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:32.150773 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-503f57a0-63f4-444d-abdb-ce57cbd857dd tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:32.150773 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-503f57a0-63f4-444d-abdb-ce57cbd857dd tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:32.288775 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-503f57a0-63f4-444d-abdb-ce57cbd857dd tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:32.296576 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-503f57a0-63f4-444d-abdb-ce57cbd857dd tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578" status: 200 len: 1313 microversion: 2.1 time: 0.161544 Oct 27 03:21:32.297148 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 111/227] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:32 2022] GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:21:32.791832 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-59876372-4f5c-4428-b270-ad2eb4135a60 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:32.792410 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-59876372-4f5c-4428-b270-ad2eb4135a60 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] [instance: a3b87dc4-af75-42ba-81af-7ad2ac59510c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:32.798693 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-59876372-4f5c-4428-b270-ad2eb4135a60 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:32.799179 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-59876372-4f5c-4428-b270-ad2eb4135a60 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:32.799619 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-59876372-4f5c-4428-b270-ad2eb4135a60 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:32.800319 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-59876372-4f5c-4428-b270-ad2eb4135a60 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:32.800777 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-59876372-4f5c-4428-b270-ad2eb4135a60 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:32.801207 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-59876372-4f5c-4428-b270-ad2eb4135a60 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:32.852804 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ebb7de7e-f572-4d05-b5a3-1d73d919b7e8 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:32.853602 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ebb7de7e-f572-4d05-b5a3-1d73d919b7e8 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:32.860875 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ebb7de7e-f572-4d05-b5a3-1d73d919b7e8 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:32.861546 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ebb7de7e-f572-4d05-b5a3-1d73d919b7e8 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:32.862378 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ebb7de7e-f572-4d05-b5a3-1d73d919b7e8 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:32.863094 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ebb7de7e-f572-4d05-b5a3-1d73d919b7e8 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:32.863554 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ebb7de7e-f572-4d05-b5a3-1d73d919b7e8 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:32.863977 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ebb7de7e-f572-4d05-b5a3-1d73d919b7e8 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:32.869404 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:32.940303 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ebb7de7e-f572-4d05-b5a3-1d73d919b7e8 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:32.950081 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ebb7de7e-f572-4d05-b5a3-1d73d919b7e8 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:32.951654 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ebb7de7e-f572-4d05-b5a3-1d73d919b7e8 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:32.957960 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ebb7de7e-f572-4d05-b5a3-1d73d919b7e8 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1539 microversion: 2.91 time: 0.109031 Oct 27 03:21:32.969260 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 112/228] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:21:32 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1539 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:21:32.977723 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-60e39ea9-e62d-473d-a64e-f619c71f1972 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:32.979131 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-60e39ea9-e62d-473d-a64e-f619c71f1972 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] [instance: 820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:32.988674 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-60e39ea9-e62d-473d-a64e-f619c71f1972 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:32.989229 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-60e39ea9-e62d-473d-a64e-f619c71f1972 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:32.990065 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-60e39ea9-e62d-473d-a64e-f619c71f1972 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:32.991664 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-60e39ea9-e62d-473d-a64e-f619c71f1972 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:32.992158 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-60e39ea9-e62d-473d-a64e-f619c71f1972 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:32.992669 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-60e39ea9-e62d-473d-a64e-f619c71f1972 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:33.010937 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-59876372-4f5c-4428-b270-ad2eb4135a60 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3d2208faeb4421af21da56d455be92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b2b8b909c54f36b61d934d09607b5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:33.013292 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-60e39ea9-e62d-473d-a64e-f619c71f1972 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] HTTP exception thrown: Instance 820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5 could not be found. Oct 27 03:21:33.016174 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-60e39ea9-e62d-473d-a64e-f619c71f1972 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Request method failure captured: Oct 27 03:21:33.016174 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5 HTTP/1.1 Oct 27 03:21:33.016174 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:21:33.016174 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:21:33.016174 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:21:33.016174 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:21:33.016174 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:21:33.016174 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:21:33.016174 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:21:33.016174 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:21:33.016174 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfkRJml_iLq0bPoVNCNOzl2BZ0X4mlVRZd7USSWstOq-QoDkRe0oYTKAgGbdAJd29FDuQH3u6Mt2qulaa6_mqVC1-7U-VzSOMj_tZIRixB4AAlvI8nW3w0bM0apG6WdM3xRudeb53nO_BhGxxcd5luPeO1rSc60IxdPD55dGqfNUdbY Oct 27 03:21:33.016174 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:21:33.016174 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:21:33.016174 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:21:33.016174 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:21:33.016174 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:21:33.016174 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:21:33.016174 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 2cee0e3469fc42a49004f9b5d1f5b6d0 Oct 27 03:21:33.016174 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-AggregatesAdminTestJSON-234008319 Oct 27 03:21:33.016174 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:21:33.016174 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:21:33.022951 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2cee0e3469fc42a49004f9b5d1f5b6d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2cee0e3469fc42a49004f9b5d1f5b6d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2cee0e3469fc42a49004f9b5d1f5b6d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2cee0e3469fc42a49004f9b5d1f5b6d0"}]}] Oct 27 03:21:33.022951 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-AggregatesAdminTestJSON-234008319 Oct 27 03:21:33.022951 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 2cee0e3469fc42a49004f9b5d1f5b6d0 Oct 27 03:21:33.022951 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-234008319 Oct 27 03:21:33.022951 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-AggregatesAdminTestJSON-234008319-project Oct 27 03:21:33.022951 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:21:33.022951 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:21:33.022951 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 015a9fcd508e4d20ad51dcb71053c28f Oct 27 03:21:33.022951 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-AggregatesAdminTestJSON-234008319-project Oct 27 03:21:33.022951 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:21:33.022951 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5 could not be found. Oct 27 03:21:33.022951 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5'} Oct 27 03:21:33.023640 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:21:33.023640 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:21:33.023640 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:21:33.023640 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:21:33.023640 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:21:33.023640 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:21:33.023640 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:21:33.023640 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:21:33.023640 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:21:33.023640 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:21:33.023640 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5 could not be found. Oct 27 03:21:33.023640 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:21:33.023640 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:21:33.023640 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:21:33.023640 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:21:33.023640 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:21:33.023640 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:21:33.023640 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:21:33.023640 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:21:33.023640 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:21:33.024730 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:21:33.024730 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:21:33.024730 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:21:33.024730 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:21:33.024730 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:21:33.024730 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:21:33.024730 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:21:33.024730 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5 could not be found. Oct 27 03:21:33.024730 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:21:33.024730 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:21:33.024730 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:21:33.024730 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:21:33.024730 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:21:33.024730 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:21:33.024730 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:21:33.024730 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:21:33.024730 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5 could not be found. Oct 27 03:21:33.024730 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:21:33.025663 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-60e39ea9-e62d-473d-a64e-f619c71f1972 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Returning 404 to user: Instance 820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:21:33.025663 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-60e39ea9-e62d-473d-a64e-f619c71f1972 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] 10.222.0.20 "GET /compute/v2.1/servers/820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5" status: 404 len: 111 microversion: 2.1 time: 0.046893 Oct 27 03:21:33.025663 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 113/229] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:32 2022] GET /compute/v2.1/servers/820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:21:33.025849 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-59876372-4f5c-4428-b270-ad2eb4135a60 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] 10.222.0.20 "GET /compute/v2.1/servers/a3b87dc4-af75-42ba-81af-7ad2ac59510c" status: 200 len: 1341 microversion: 2.1 time: 0.231407 Oct 27 03:21:33.025849 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 117/230] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:32 2022] GET /compute/v2.1/servers/a3b87dc4-af75-42ba-81af-7ad2ac59510c => generated 1341 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:33.030294 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-294290f3-d163-407a-b216-11b2aebf86aa req-8a2a6624-6bc0-4155-8a44-775b5a5bf34c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "238948a5-b12d-49a4-a73f-ed65a9f19182", "name": "network-vif-deleted", "tag": "4fcd2849-4183-4f5a-b7c1-595d6364a17c"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:21:33.030875 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-071b4ae5-d34b-4ff4-aa36-9a5b150375d6 tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-862769-1"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:21:33.043001 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-071b4ae5-d34b-4ff4-aa36-9a5b150375d6 tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:33.043719 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-071b4ae5-d34b-4ff4-aa36-9a5b150375d6 tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:33.043957 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-294290f3-d163-407a-b216-11b2aebf86aa req-8a2a6624-6bc0-4155-8a44-775b5a5bf34c service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:33.044169 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-071b4ae5-d34b-4ff4-aa36-9a5b150375d6 tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:33.044589 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-294290f3-d163-407a-b216-11b2aebf86aa req-8a2a6624-6bc0-4155-8a44-775b5a5bf34c service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:33.045071 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-294290f3-d163-407a-b216-11b2aebf86aa req-8a2a6624-6bc0-4155-8a44-775b5a5bf34c service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:33.058148 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-294290f3-d163-407a-b216-11b2aebf86aa req-8a2a6624-6bc0-4155-8a44-775b5a5bf34c service nova] Creating event network-vif-deleted:4fcd2849-4183-4f5a-b7c1-595d6364a17c for instance 238948a5-b12d-49a4-a73f-ed65a9f19182 on n-h1-862769-1 Oct 27 03:21:33.063802 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-294290f3-d163-407a-b216-11b2aebf86aa req-8a2a6624-6bc0-4155-8a44-775b5a5bf34c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044027 Oct 27 03:21:33.064980 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 114/231] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:21:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:21:33.165330 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-80be49ec-c597-43b3-8f7c-b10c89d19a7d tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:33.166076 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-80be49ec-c597-43b3-8f7c-b10c89d19a7d tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] [instance: 238948a5-b12d-49a4-a73f-ed65a9f19182] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:33.172783 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-80be49ec-c597-43b3-8f7c-b10c89d19a7d tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:33.173262 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-80be49ec-c597-43b3-8f7c-b10c89d19a7d tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:33.173768 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-80be49ec-c597-43b3-8f7c-b10c89d19a7d tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:33.176252 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-80be49ec-c597-43b3-8f7c-b10c89d19a7d tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:33.176252 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-80be49ec-c597-43b3-8f7c-b10c89d19a7d tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:33.176252 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-80be49ec-c597-43b3-8f7c-b10c89d19a7d tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:33.237579 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-80be49ec-c597-43b3-8f7c-b10c89d19a7d tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff070c0383324e1da5c49e3d9c652516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1da8ce26ab49ddae972233777c4c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:33.245644 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-80be49ec-c597-43b3-8f7c-b10c89d19a7d tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] 10.222.0.20 "GET /compute/v2.1/servers/238948a5-b12d-49a4-a73f-ed65a9f19182" status: 200 len: 1434 microversion: 2.1 time: 0.084391 Oct 27 03:21:33.246237 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 115/232] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:33 2022] GET /compute/v2.1/servers/238948a5-b12d-49a4-a73f-ed65a9f19182 => generated 1434 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:21:33.289032 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-071b4ae5-d34b-4ff4-aa36-9a5b150375d6 tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 299 microversion: 2.1 time: 0.265985 Oct 27 03:21:33.289721 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 118/233] 10.222.0.20 () {60 vars in 1191 bytes} [Thu Oct 27 03:21:33 2022] POST /compute/v2.1/os-aggregates/3/action => generated 299 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:21:33.301609 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-72f8c551-f4cf-4ad3-8022-d68a42699b00 tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:33.320418 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5b291624-f165-478a-8216-6b9d4fc194df tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:33.321063 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5b291624-f165-478a-8216-6b9d4fc194df tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 5910c783-6877-4a41-8650-0973a11f3578] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:33.327968 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5b291624-f165-478a-8216-6b9d4fc194df tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:33.328459 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5b291624-f165-478a-8216-6b9d4fc194df tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:33.329002 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5b291624-f165-478a-8216-6b9d4fc194df tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:33.329695 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5b291624-f165-478a-8216-6b9d4fc194df tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:33.330209 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5b291624-f165-478a-8216-6b9d4fc194df tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:33.330640 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5b291624-f165-478a-8216-6b9d4fc194df tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:33.420472 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-72f8c551-f4cf-4ad3-8022-d68a42699b00 tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.122450 Oct 27 03:21:33.421882 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 116/234] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Oct 27 03:21:33 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 27 03:21:33.436608 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0c9f9dd2-da1c-4d6a-94f1-2726ae93ede1 tempest-HostsAdminTestJSON-1283394147 tempest-HostsAdminTestJSON-1283394147-project-admin] Calling method '.version_select at 0x7f7ddb419a60>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:33.440098 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0c9f9dd2-da1c-4d6a-94f1-2726ae93ede1 tempest-HostsAdminTestJSON-1283394147 tempest-HostsAdminTestJSON-1283394147-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:33.440913 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0c9f9dd2-da1c-4d6a-94f1-2726ae93ede1 tempest-HostsAdminTestJSON-1283394147 tempest-HostsAdminTestJSON-1283394147-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:33.441228 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0c9f9dd2-da1c-4d6a-94f1-2726ae93ede1 tempest-HostsAdminTestJSON-1283394147 tempest-HostsAdminTestJSON-1283394147-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:33.442206 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0c9f9dd2-da1c-4d6a-94f1-2726ae93ede1 tempest-HostsAdminTestJSON-1283394147 tempest-HostsAdminTestJSON-1283394147-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:33.442756 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0c9f9dd2-da1c-4d6a-94f1-2726ae93ede1 tempest-HostsAdminTestJSON-1283394147 tempest-HostsAdminTestJSON-1283394147-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:33.443239 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0c9f9dd2-da1c-4d6a-94f1-2726ae93ede1 tempest-HostsAdminTestJSON-1283394147 tempest-HostsAdminTestJSON-1283394147-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:33.472756 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:33.475103 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0c9f9dd2-da1c-4d6a-94f1-2726ae93ede1 tempest-HostsAdminTestJSON-1283394147 tempest-HostsAdminTestJSON-1283394147-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.042176 Oct 27 03:21:33.476275 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 117/235] 10.222.0.20 () {58 vars in 1128 bytes} [Thu Oct 27 03:21:33 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:21:33.477366 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5b291624-f165-478a-8216-6b9d4fc194df tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:33.487266 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5b291624-f165-478a-8216-6b9d4fc194df tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578" status: 200 len: 1313 microversion: 2.1 time: 0.170769 Oct 27 03:21:33.492200 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9a666715-93dc-4b98-afb0-825d76f430e5 tempest-HostsAdminTestJSON-1283394147 tempest-HostsAdminTestJSON-1283394147-project-admin] Calling method '.version_select at 0x7f7ddb7409d0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:33.492437 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 119/236] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:33 2022] GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578 => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:21:33.492536 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9a666715-93dc-4b98-afb0-825d76f430e5 tempest-HostsAdminTestJSON-1283394147 tempest-HostsAdminTestJSON-1283394147-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:33.492536 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9a666715-93dc-4b98-afb0-825d76f430e5 tempest-HostsAdminTestJSON-1283394147 tempest-HostsAdminTestJSON-1283394147-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:33.492536 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9a666715-93dc-4b98-afb0-825d76f430e5 tempest-HostsAdminTestJSON-1283394147 tempest-HostsAdminTestJSON-1283394147-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:33.493329 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9a666715-93dc-4b98-afb0-825d76f430e5 tempest-HostsAdminTestJSON-1283394147 tempest-HostsAdminTestJSON-1283394147-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:33.494519 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9a666715-93dc-4b98-afb0-825d76f430e5 tempest-HostsAdminTestJSON-1283394147 tempest-HostsAdminTestJSON-1283394147-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:33.494519 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9a666715-93dc-4b98-afb0-825d76f430e5 tempest-HostsAdminTestJSON-1283394147 tempest-HostsAdminTestJSON-1283394147-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:33.519316 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9a666715-93dc-4b98-afb0-825d76f430e5 tempest-HostsAdminTestJSON-1283394147 tempest-HostsAdminTestJSON-1283394147-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.036363 Oct 27 03:21:33.520004 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 118/237] 10.222.0.20 () {58 vars in 1155 bytes} [Thu Oct 27 03:21:33 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:21:33.532054 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5ed8c40e-76ba-4adb-93d8-618e1d181ce6 tempest-HostsAdminTestJSON-1283394147 tempest-HostsAdminTestJSON-1283394147-project-admin] Calling method '.version_select at 0x7f7ddb4d2e50>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:33.537436 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5ed8c40e-76ba-4adb-93d8-618e1d181ce6 tempest-HostsAdminTestJSON-1283394147 tempest-HostsAdminTestJSON-1283394147-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:33.537436 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5ed8c40e-76ba-4adb-93d8-618e1d181ce6 tempest-HostsAdminTestJSON-1283394147 tempest-HostsAdminTestJSON-1283394147-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:33.537436 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5ed8c40e-76ba-4adb-93d8-618e1d181ce6 tempest-HostsAdminTestJSON-1283394147 tempest-HostsAdminTestJSON-1283394147-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:33.540394 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5ed8c40e-76ba-4adb-93d8-618e1d181ce6 tempest-HostsAdminTestJSON-1283394147 tempest-HostsAdminTestJSON-1283394147-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:33.540394 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5ed8c40e-76ba-4adb-93d8-618e1d181ce6 tempest-HostsAdminTestJSON-1283394147 tempest-HostsAdminTestJSON-1283394147-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:33.540394 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5ed8c40e-76ba-4adb-93d8-618e1d181ce6 tempest-HostsAdminTestJSON-1283394147 tempest-HostsAdminTestJSON-1283394147-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:33.546716 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0092ec31-5ed2-4bce-9278-748940c44300 tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-652462057"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:21:33.551675 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.aggregate [None req-0092ec31-5ed2-4bce-9278-748940c44300 tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Generated uuid 1d0c61e5-5a45-4c4b-83ba-055ca191bdb3 for aggregate {{(pid=121001) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 27 03:21:33.571771 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5ed8c40e-76ba-4adb-93d8-618e1d181ce6 tempest-HostsAdminTestJSON-1283394147 tempest-HostsAdminTestJSON-1283394147-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.043859 Oct 27 03:21:33.572718 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 120/238] 10.222.0.20 () {58 vars in 1128 bytes} [Thu Oct 27 03:21:33 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:21:33.582398 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f6cd7317-8f52-47f4-a525-6cc83a1be227 tempest-HostsAdminTestJSON-1283394147 tempest-HostsAdminTestJSON-1283394147-project-admin] Calling method '.version_select at 0x7f7ddb4ddee0>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:33.589758 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f6cd7317-8f52-47f4-a525-6cc83a1be227 tempest-HostsAdminTestJSON-1283394147 tempest-HostsAdminTestJSON-1283394147-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:33.590502 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f6cd7317-8f52-47f4-a525-6cc83a1be227 tempest-HostsAdminTestJSON-1283394147 tempest-HostsAdminTestJSON-1283394147-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:33.591091 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f6cd7317-8f52-47f4-a525-6cc83a1be227 tempest-HostsAdminTestJSON-1283394147 tempest-HostsAdminTestJSON-1283394147-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:33.606989 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f6cd7317-8f52-47f4-a525-6cc83a1be227 tempest-HostsAdminTestJSON-1283394147 tempest-HostsAdminTestJSON-1283394147-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:33.607827 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f6cd7317-8f52-47f4-a525-6cc83a1be227 tempest-HostsAdminTestJSON-1283394147 tempest-HostsAdminTestJSON-1283394147-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:33.608066 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f6cd7317-8f52-47f4-a525-6cc83a1be227 tempest-HostsAdminTestJSON-1283394147 tempest-HostsAdminTestJSON-1283394147-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:33.638361 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f6cd7317-8f52-47f4-a525-6cc83a1be227 tempest-HostsAdminTestJSON-1283394147 tempest-HostsAdminTestJSON-1283394147-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts/n-h2-862769-1" status: 200 len: 467 microversion: 2.1 time: 0.059336 Oct 27 03:21:33.639123 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 121/239] 10.222.0.20 () {58 vars in 1170 bytes} [Thu Oct 27 03:21:33 2022] GET /compute/v2.1/os-hosts/n-h2-862769-1 => generated 467 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:21:33.648327 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-bacfc252-8aa6-43a2-9287-21d10068da41 tempest-HostsAdminTestJSON-1283394147 tempest-HostsAdminTestJSON-1283394147-project-admin] Calling method '.version_select at 0x7f7ddb178820>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:33.656342 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bacfc252-8aa6-43a2-9287-21d10068da41 tempest-HostsAdminTestJSON-1283394147 tempest-HostsAdminTestJSON-1283394147-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:33.657035 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bacfc252-8aa6-43a2-9287-21d10068da41 tempest-HostsAdminTestJSON-1283394147 tempest-HostsAdminTestJSON-1283394147-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:33.657553 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bacfc252-8aa6-43a2-9287-21d10068da41 tempest-HostsAdminTestJSON-1283394147 tempest-HostsAdminTestJSON-1283394147-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:33.666167 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0092ec31-5ed2-4bce-9278-748940c44300 tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.123207 Oct 27 03:21:33.666981 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 119/240] 10.222.0.20 () {60 vars in 1164 bytes} [Thu Oct 27 03:21:33 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:21:33.672358 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bacfc252-8aa6-43a2-9287-21d10068da41 tempest-HostsAdminTestJSON-1283394147 tempest-HostsAdminTestJSON-1283394147-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:33.672930 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bacfc252-8aa6-43a2-9287-21d10068da41 tempest-HostsAdminTestJSON-1283394147 tempest-HostsAdminTestJSON-1283394147-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:33.673378 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bacfc252-8aa6-43a2-9287-21d10068da41 tempest-HostsAdminTestJSON-1283394147 tempest-HostsAdminTestJSON-1283394147-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:33.681003 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0d444cc6-be3a-4557-b9f1-e9deeb5456f9 tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-862769-1"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:21:33.694455 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-bacfc252-8aa6-43a2-9287-21d10068da41 tempest-HostsAdminTestJSON-1283394147 tempest-HostsAdminTestJSON-1283394147-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts/n-h1-862769-1" status: 200 len: 729 microversion: 2.1 time: 0.049563 Oct 27 03:21:33.695290 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 122/241] 10.222.0.20 () {58 vars in 1170 bytes} [Thu Oct 27 03:21:33 2022] GET /compute/v2.1/os-hosts/n-h1-862769-1 => generated 729 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:21:33.697736 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0d444cc6-be3a-4557-b9f1-e9deeb5456f9 tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:33.699135 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0d444cc6-be3a-4557-b9f1-e9deeb5456f9 tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:33.699754 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0d444cc6-be3a-4557-b9f1-e9deeb5456f9 tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:33.766915 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-a8063959-2cba-4ba4-9895-6fa9ffbb96fa req-3655eec1-0edb-4eaa-9ac7-3a6a8f3d9fde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5910c783-6877-4a41-8650-0973a11f3578", "name": "network-vif-plugged", "status": "completed", "tag": "30830547-1d6a-4cee-9341-539819ef5a04"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:21:33.776357 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-a8063959-2cba-4ba4-9895-6fa9ffbb96fa req-3655eec1-0edb-4eaa-9ac7-3a6a8f3d9fde service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:33.776841 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-a8063959-2cba-4ba4-9895-6fa9ffbb96fa req-3655eec1-0edb-4eaa-9ac7-3a6a8f3d9fde service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:33.777674 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-a8063959-2cba-4ba4-9895-6fa9ffbb96fa req-3655eec1-0edb-4eaa-9ac7-3a6a8f3d9fde service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:33.789919 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-a8063959-2cba-4ba4-9895-6fa9ffbb96fa req-3655eec1-0edb-4eaa-9ac7-3a6a8f3d9fde service nova] Creating event network-vif-plugged:30830547-1d6a-4cee-9341-539819ef5a04 for instance 5910c783-6877-4a41-8650-0973a11f3578 on n-h1-862769-1 Oct 27 03:21:33.795301 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-a8063959-2cba-4ba4-9895-6fa9ffbb96fa req-3655eec1-0edb-4eaa-9ac7-3a6a8f3d9fde service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032691 Oct 27 03:21:33.796225 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 123/242] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:21:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:21:33.963875 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0d444cc6-be3a-4557-b9f1-e9deeb5456f9 tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 241 microversion: 2.1 time: 0.288585 Oct 27 03:21:33.964697 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 120/243] 10.222.0.20 () {60 vars in 1191 bytes} [Thu Oct 27 03:21:33 2022] POST /compute/v2.1/os-aggregates/8/action => generated 241 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:21:33.977250 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-02ce941b-7176-4dd4-8dd8-1e63ba8d0047 tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:33.985095 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-02ce941b-7176-4dd4-8dd8-1e63ba8d0047 tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 241 microversion: 2.1 time: 0.011918 Oct 27 03:21:33.985456 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-58f028f7-97d0-4338-9ea6-867a19bcaab6 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:33.985846 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 124/244] 10.222.0.20 () {58 vars in 1149 bytes} [Thu Oct 27 03:21:33 2022] GET /compute/v2.1/os-aggregates/8 => generated 241 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:21:33.986203 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-58f028f7-97d0-4338-9ea6-867a19bcaab6 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:33.997051 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-58f028f7-97d0-4338-9ea6-867a19bcaab6 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:33.997235 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ed4fb443-b07b-4d16-95d5-8f62af50ec4f tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-862769-1"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:21:33.997594 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-58f028f7-97d0-4338-9ea6-867a19bcaab6 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:34.000252 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-58f028f7-97d0-4338-9ea6-867a19bcaab6 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:34.000252 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-58f028f7-97d0-4338-9ea6-867a19bcaab6 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:34.000252 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-58f028f7-97d0-4338-9ea6-867a19bcaab6 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:34.000252 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-58f028f7-97d0-4338-9ea6-867a19bcaab6 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:34.007959 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ed4fb443-b07b-4d16-95d5-8f62af50ec4f tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:34.008455 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ed4fb443-b07b-4d16-95d5-8f62af50ec4f tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:34.008894 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ed4fb443-b07b-4d16-95d5-8f62af50ec4f tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:34.076588 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-58f028f7-97d0-4338-9ea6-867a19bcaab6 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:34.091003 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-58f028f7-97d0-4338-9ea6-867a19bcaab6 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:34.093317 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-58f028f7-97d0-4338-9ea6-867a19bcaab6 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:34.102088 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-58f028f7-97d0-4338-9ea6-867a19bcaab6 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1539 microversion: 2.91 time: 0.120532 Oct 27 03:21:34.103233 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 121/245] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:21:33 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1539 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:21:34.128224 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b9c0dfb5-d2e5-427b-a82d-c2d46e43b021 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:34.132764 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b9c0dfb5-d2e5-427b-a82d-c2d46e43b021 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] [instance: a3b87dc4-af75-42ba-81af-7ad2ac59510c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:34.141256 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b9c0dfb5-d2e5-427b-a82d-c2d46e43b021 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:34.149338 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b9c0dfb5-d2e5-427b-a82d-c2d46e43b021 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:34.149338 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b9c0dfb5-d2e5-427b-a82d-c2d46e43b021 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:34.149338 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b9c0dfb5-d2e5-427b-a82d-c2d46e43b021 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:34.149338 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b9c0dfb5-d2e5-427b-a82d-c2d46e43b021 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:34.149799 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b9c0dfb5-d2e5-427b-a82d-c2d46e43b021 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:34.326446 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b9c0dfb5-d2e5-427b-a82d-c2d46e43b021 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3d2208faeb4421af21da56d455be92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b2b8b909c54f36b61d934d09607b5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:34.335459 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b9c0dfb5-d2e5-427b-a82d-c2d46e43b021 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] 10.222.0.20 "GET /compute/v2.1/servers/a3b87dc4-af75-42ba-81af-7ad2ac59510c" status: 200 len: 1319 microversion: 2.1 time: 0.230877 Oct 27 03:21:34.335979 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 122/246] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:34 2022] GET /compute/v2.1/servers/a3b87dc4-af75-42ba-81af-7ad2ac59510c => generated 1319 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:34.354916 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f4829094-b444-49c6-a5a3-b3e5f2d4a8d2 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:34.355540 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f4829094-b444-49c6-a5a3-b3e5f2d4a8d2 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] [instance: 238948a5-b12d-49a4-a73f-ed65a9f19182] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:34.361531 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f4829094-b444-49c6-a5a3-b3e5f2d4a8d2 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:34.362028 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f4829094-b444-49c6-a5a3-b3e5f2d4a8d2 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:34.362849 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f4829094-b444-49c6-a5a3-b3e5f2d4a8d2 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:34.363784 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f4829094-b444-49c6-a5a3-b3e5f2d4a8d2 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:34.364402 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f4829094-b444-49c6-a5a3-b3e5f2d4a8d2 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:34.364839 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f4829094-b444-49c6-a5a3-b3e5f2d4a8d2 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:34.378972 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-f4829094-b444-49c6-a5a3-b3e5f2d4a8d2 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] HTTP exception thrown: Instance 238948a5-b12d-49a4-a73f-ed65a9f19182 could not be found. Oct 27 03:21:34.386011 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f4829094-b444-49c6-a5a3-b3e5f2d4a8d2 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Request method failure captured: Oct 27 03:21:34.386011 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/238948a5-b12d-49a4-a73f-ed65a9f19182 HTTP/1.1 Oct 27 03:21:34.386011 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:21:34.386011 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:21:34.386011 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:21:34.386011 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:21:34.386011 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:21:34.386011 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:21:34.386011 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:21:34.386011 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:21:34.386011 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfkchMQHvdK7cIQNBhisWxT9inndNR7wogzO6_ui2mdezHvdhj9t8UKoro2RWJXh4pZMglkN7DN3f_oTP4lypXLaAnbXZqDNfcSijqaegrY3lX6ZT1IKK4-7SCDsBlJQjrx46920l7Ge6m_aMYea3rd83mwZDnLyuk0CQ9fFdQjA9yk Oct 27 03:21:34.386011 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:21:34.386011 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:21:34.386011 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:21:34.386011 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:21:34.386011 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:21:34.386011 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:21:34.386011 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: ac1da8ce26ab49ddae972233777c4c55 Oct 27 03:21:34.386011 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-DeleteServersAdminTestJSON-345610032 Oct 27 03:21:34.386011 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:21:34.386011 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:21:34.388028 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ac1da8ce26ab49ddae972233777c4c55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ac1da8ce26ab49ddae972233777c4c55"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ac1da8ce26ab49ddae972233777c4c55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ac1da8ce26ab49ddae972233777c4c55"}]}] Oct 27 03:21:34.388028 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-DeleteServersAdminTestJSON-345610032 Oct 27 03:21:34.388028 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: ac1da8ce26ab49ddae972233777c4c55 Oct 27 03:21:34.388028 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-345610032 Oct 27 03:21:34.388028 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-DeleteServersAdminTestJSON-345610032-project Oct 27 03:21:34.388028 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:21:34.388028 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:21:34.388028 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: ff070c0383324e1da5c49e3d9c652516 Oct 27 03:21:34.388028 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-DeleteServersAdminTestJSON-345610032-project Oct 27 03:21:34.388028 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:21:34.388028 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 238948a5-b12d-49a4-a73f-ed65a9f19182 could not be found. Oct 27 03:21:34.388028 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '238948a5-b12d-49a4-a73f-ed65a9f19182'} Oct 27 03:21:34.388807 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:21:34.388807 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:21:34.388807 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:21:34.388807 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:21:34.388807 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:21:34.388807 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:21:34.388807 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:21:34.388807 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:21:34.388807 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:21:34.388807 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:21:34.388807 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 238948a5-b12d-49a4-a73f-ed65a9f19182 could not be found. Oct 27 03:21:34.388807 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:21:34.388807 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:21:34.388807 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:21:34.388807 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:21:34.388807 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:21:34.388807 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:21:34.388807 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:21:34.388807 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:21:34.388807 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:21:34.390614 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:21:34.390614 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:21:34.390614 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:21:34.390614 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:21:34.390614 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:21:34.390614 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:21:34.390614 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:21:34.390614 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 238948a5-b12d-49a4-a73f-ed65a9f19182 could not be found. Oct 27 03:21:34.390614 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:21:34.390614 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:21:34.390614 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:21:34.390614 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:21:34.390614 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:21:34.390614 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:21:34.390614 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:21:34.390614 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:21:34.390614 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 238948a5-b12d-49a4-a73f-ed65a9f19182 could not be found. Oct 27 03:21:34.390614 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:21:34.391723 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f4829094-b444-49c6-a5a3-b3e5f2d4a8d2 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Returning 404 to user: Instance 238948a5-b12d-49a4-a73f-ed65a9f19182 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:21:34.391723 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f4829094-b444-49c6-a5a3-b3e5f2d4a8d2 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] 10.222.0.20 "GET /compute/v2.1/servers/238948a5-b12d-49a4-a73f-ed65a9f19182" status: 404 len: 111 microversion: 2.1 time: 0.030854 Oct 27 03:21:34.391723 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 123/247] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:34 2022] GET /compute/v2.1/servers/238948a5-b12d-49a4-a73f-ed65a9f19182 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:21:34.450367 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ed4fb443-b07b-4d16-95d5-8f62af50ec4f tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 226 microversion: 2.1 time: 0.456915 Oct 27 03:21:34.451794 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 125/248] 10.222.0.20 () {60 vars in 1191 bytes} [Thu Oct 27 03:21:33 2022] POST /compute/v2.1/os-aggregates/8/action => generated 226 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:21:34.463743 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7e5460b7-df86-4787-8988-3ea080984b77 tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:34.476551 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=13 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:34.497387 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-224ab286-875d-4eb4-9493-8d5691f00d13 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-525940916", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:21:34.552614 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-224ab286-875d-4eb4-9493-8d5691f00d13 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] validate_networks() for None {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:21:34.552885 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7e5460b7-df86-4787-8988-3ea080984b77 tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.092925 Oct 27 03:21:34.553463 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 124/249] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Oct 27 03:21:34 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 27 03:21:34.558254 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-dde06594-5f23-4dda-bd19-0297b9984e61 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:34.559186 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-dde06594-5f23-4dda-bd19-0297b9984e61 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 5910c783-6877-4a41-8650-0973a11f3578] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:34.566712 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dde06594-5f23-4dda-bd19-0297b9984e61 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:34.567233 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dde06594-5f23-4dda-bd19-0297b9984e61 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:34.567675 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dde06594-5f23-4dda-bd19-0297b9984e61 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:34.568380 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dde06594-5f23-4dda-bd19-0297b9984e61 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:34.568831 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dde06594-5f23-4dda-bd19-0297b9984e61 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:34.569255 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dde06594-5f23-4dda-bd19-0297b9984e61 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:34.699658 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-dde06594-5f23-4dda-bd19-0297b9984e61 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:34.707396 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-dde06594-5f23-4dda-bd19-0297b9984e61 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578" status: 200 len: 1313 microversion: 2.1 time: 0.152982 Oct 27 03:21:34.707966 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 125/250] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:34 2022] GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:34.713937 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-09fca4c7-fd37-4a35-9f46-4b44e1ce0c2c tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-814829048"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:21:34.718636 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.aggregate [None req-09fca4c7-fd37-4a35-9f46-4b44e1ce0c2c tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Generated uuid 4d223709-45ec-49f7-a433-88de928e265b for aggregate {{(pid=121001) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 27 03:21:34.792343 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-09fca4c7-fd37-4a35-9f46-4b44e1ce0c2c tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.083354 Oct 27 03:21:34.799811 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 126/251] 10.222.0.20 () {60 vars in 1164 bytes} [Thu Oct 27 03:21:34 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:21:34.805801 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c2ab12bf-d05e-4866-a839-6f8f52ad18b6 tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-862769-1"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:21:34.817829 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c2ab12bf-d05e-4866-a839-6f8f52ad18b6 tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:34.818346 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c2ab12bf-d05e-4866-a839-6f8f52ad18b6 tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:34.818784 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c2ab12bf-d05e-4866-a839-6f8f52ad18b6 tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:34.834009 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-224ab286-875d-4eb4-9493-8d5691f00d13 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:21:34.834537 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-224ab286-875d-4eb4-9493-8d5691f00d13 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:21:34.834869 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-224ab286-875d-4eb4-9493-8d5691f00d13 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:21:34.835287 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-224ab286-875d-4eb4-9493-8d5691f00d13 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:21:34.835709 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-224ab286-875d-4eb4-9493-8d5691f00d13 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:21:34.845958 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-224ab286-875d-4eb4-9493-8d5691f00d13 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:34.846663 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-224ab286-875d-4eb4-9493-8d5691f00d13 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:34.847299 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-224ab286-875d-4eb4-9493-8d5691f00d13 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:34.848032 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-224ab286-875d-4eb4-9493-8d5691f00d13 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:34.848742 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-224ab286-875d-4eb4-9493-8d5691f00d13 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:34.849175 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-224ab286-875d-4eb4-9493-8d5691f00d13 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:34.867342 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-224ab286-875d-4eb4-9493-8d5691f00d13 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Getting quotas for project ac1da8ce26ab49ddae972233777c4c55. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:21:34.872090 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-224ab286-875d-4eb4-9493-8d5691f00d13 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Getting quotas for user ff070c0383324e1da5c49e3d9c652516 and project ac1da8ce26ab49ddae972233777c4c55. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:21:34.884271 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-224ab286-875d-4eb4-9493-8d5691f00d13 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:21:34.886724 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-224ab286-875d-4eb4-9493-8d5691f00d13 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] [instance: 4e4efa06-0a3c-4c11-849d-22bb8d9dccf8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:21:35.024849 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-224ab286-875d-4eb4-9493-8d5691f00d13 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.531426 Oct 27 03:21:35.026107 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 126/252] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:21:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 533 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 03:21:35.042851 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-576c5b24-7636-4702-a9d8-e727a9828288 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:35.042851 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-576c5b24-7636-4702-a9d8-e727a9828288 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] [instance: 4e4efa06-0a3c-4c11-849d-22bb8d9dccf8] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:35.043508 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c2ab12bf-d05e-4866-a839-6f8f52ad18b6 tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 241 microversion: 2.1 time: 0.241540 Oct 27 03:21:35.044270 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 127/253] 10.222.0.20 () {60 vars in 1191 bytes} [Thu Oct 27 03:21:34 2022] POST /compute/v2.1/os-aggregates/9/action => generated 241 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:21:35.056272 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1d297f14-e75e-4b08-8b8e-986a00cb0baa tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:35.069537 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1d297f14-e75e-4b08-8b8e-986a00cb0baa tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates" status: 200 len: 244 microversion: 2.1 time: 0.016815 Oct 27 03:21:35.070369 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 128/254] 10.222.0.20 () {58 vars in 1143 bytes} [Thu Oct 27 03:21:35 2022] GET /compute/v2.1/os-aggregates => generated 244 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:21:35.084556 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-efd20d63-7e7e-4c79-8b0e-8a1070b04fd3 tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-862769-1"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:21:35.096423 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-efd20d63-7e7e-4c79-8b0e-8a1070b04fd3 tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:35.096986 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-efd20d63-7e7e-4c79-8b0e-8a1070b04fd3 tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:35.097563 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-efd20d63-7e7e-4c79-8b0e-8a1070b04fd3 tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:35.111253 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-576c5b24-7636-4702-a9d8-e727a9828288 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff070c0383324e1da5c49e3d9c652516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1da8ce26ab49ddae972233777c4c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:35.120477 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-576c5b24-7636-4702-a9d8-e727a9828288 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] 10.222.0.20 "GET /compute/v2.1/servers/4e4efa06-0a3c-4c11-849d-22bb8d9dccf8" status: 200 len: 1219 microversion: 2.1 time: 0.086065 Oct 27 03:21:35.121064 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 127/255] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:35 2022] GET /compute/v2.1/servers/4e4efa06-0a3c-4c11-849d-22bb8d9dccf8 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:35.143525 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a1d71e96-451c-4f2b-9161-3489679a3b0d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:35.146899 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a1d71e96-451c-4f2b-9161-3489679a3b0d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:35.151341 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a1d71e96-451c-4f2b-9161-3489679a3b0d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:35.152090 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a1d71e96-451c-4f2b-9161-3489679a3b0d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:35.152723 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a1d71e96-451c-4f2b-9161-3489679a3b0d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:35.153443 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a1d71e96-451c-4f2b-9161-3489679a3b0d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:35.154208 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a1d71e96-451c-4f2b-9161-3489679a3b0d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:35.155507 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a1d71e96-451c-4f2b-9161-3489679a3b0d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:35.231260 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a1d71e96-451c-4f2b-9161-3489679a3b0d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:35.236532 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a1d71e96-451c-4f2b-9161-3489679a3b0d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:35.239713 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a1d71e96-451c-4f2b-9161-3489679a3b0d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:35.245128 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a1d71e96-451c-4f2b-9161-3489679a3b0d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1539 microversion: 2.91 time: 0.105733 Oct 27 03:21:35.245717 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 128/256] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:21:35 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1539 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:21:35.356811 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6ceecd68-2c22-418e-8e69-70e6a4935aee tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:35.357707 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6ceecd68-2c22-418e-8e69-70e6a4935aee tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] [instance: a3b87dc4-af75-42ba-81af-7ad2ac59510c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:35.365998 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6ceecd68-2c22-418e-8e69-70e6a4935aee tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:35.366523 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6ceecd68-2c22-418e-8e69-70e6a4935aee tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:35.367185 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6ceecd68-2c22-418e-8e69-70e6a4935aee tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:35.369274 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6ceecd68-2c22-418e-8e69-70e6a4935aee tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:35.369274 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6ceecd68-2c22-418e-8e69-70e6a4935aee tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:35.369274 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6ceecd68-2c22-418e-8e69-70e6a4935aee tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:35.479780 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-efd20d63-7e7e-4c79-8b0e-8a1070b04fd3 tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 226 microversion: 2.1 time: 0.400719 Oct 27 03:21:35.480503 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 129/257] 10.222.0.20 () {60 vars in 1191 bytes} [Thu Oct 27 03:21:35 2022] POST /compute/v2.1/os-aggregates/9/action => generated 226 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:21:35.493334 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1e236e90-52c6-4384-b1be-8834a4c401a2 tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:35.517704 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-6ceecd68-2c22-418e-8e69-70e6a4935aee tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3d2208faeb4421af21da56d455be92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b2b8b909c54f36b61d934d09607b5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:35.526217 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:DELETE=5,nova_api:INSERT=4 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:35.526377 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6ceecd68-2c22-418e-8e69-70e6a4935aee tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] 10.222.0.20 "GET /compute/v2.1/servers/a3b87dc4-af75-42ba-81af-7ad2ac59510c" status: 200 len: 1319 microversion: 2.1 time: 0.173282 Oct 27 03:21:35.526865 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 129/258] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:35 2022] GET /compute/v2.1/servers/a3b87dc4-af75-42ba-81af-7ad2ac59510c => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:21:35.599083 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1e236e90-52c6-4384-b1be-8834a4c401a2 tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.110602 Oct 27 03:21:35.599713 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 130/259] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Oct 27 03:21:35 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 27 03:21:35.611201 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c56a290c-1247-4191-b088-4abbc74dec4f tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1470230268"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:21:35.615034 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.aggregate [None req-c56a290c-1247-4191-b088-4abbc74dec4f tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Generated uuid 929318b1-4a33-420f-9665-0abe3b2e3ab8 for aggregate {{(pid=121000) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 27 03:21:35.715472 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c56a290c-1247-4191-b088-4abbc74dec4f tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.109234 Oct 27 03:21:35.716639 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 130/260] 10.222.0.20 () {60 vars in 1164 bytes} [Thu Oct 27 03:21:35 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:21:35.728335 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d885445f-e5e4-45fc-8f0e-a2ff8f4ff74f tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-862769-1"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:21:35.736855 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c68c797e-2b0e-451a-8f9d-6b56c35a26c9 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:35.737473 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c68c797e-2b0e-451a-8f9d-6b56c35a26c9 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 5910c783-6877-4a41-8650-0973a11f3578] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:35.749147 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d885445f-e5e4-45fc-8f0e-a2ff8f4ff74f tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:35.749669 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d885445f-e5e4-45fc-8f0e-a2ff8f4ff74f tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:35.750132 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d885445f-e5e4-45fc-8f0e-a2ff8f4ff74f tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:35.755588 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c68c797e-2b0e-451a-8f9d-6b56c35a26c9 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:35.755588 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c68c797e-2b0e-451a-8f9d-6b56c35a26c9 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:35.755588 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c68c797e-2b0e-451a-8f9d-6b56c35a26c9 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:35.755923 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c68c797e-2b0e-451a-8f9d-6b56c35a26c9 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:35.759835 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c68c797e-2b0e-451a-8f9d-6b56c35a26c9 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:35.765728 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c68c797e-2b0e-451a-8f9d-6b56c35a26c9 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:35.954077 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c68c797e-2b0e-451a-8f9d-6b56c35a26c9 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:35.962444 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c68c797e-2b0e-451a-8f9d-6b56c35a26c9 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578" status: 200 len: 1463 microversion: 2.1 time: 0.229835 Oct 27 03:21:35.966119 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 131/261] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:35 2022] GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578 => generated 1463 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:35.968547 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-02ff3dcb-7913-4fd6-8fbc-986cd5b1bddd req-aa390ffe-22cc-4111-b926-b2f7cf95f8cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3b87dc4-af75-42ba-81af-7ad2ac59510c", "name": "network-vif-plugged", "status": "completed", "tag": "c4a8dff3-34b2-4172-8d3b-ee64c1364a2c"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:21:35.979368 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-02ff3dcb-7913-4fd6-8fbc-986cd5b1bddd req-aa390ffe-22cc-4111-b926-b2f7cf95f8cc service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:35.979796 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-02ff3dcb-7913-4fd6-8fbc-986cd5b1bddd req-aa390ffe-22cc-4111-b926-b2f7cf95f8cc service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:35.980329 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-02ff3dcb-7913-4fd6-8fbc-986cd5b1bddd req-aa390ffe-22cc-4111-b926-b2f7cf95f8cc service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:35.992635 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-02ff3dcb-7913-4fd6-8fbc-986cd5b1bddd req-aa390ffe-22cc-4111-b926-b2f7cf95f8cc service nova] Creating event network-vif-plugged:c4a8dff3-34b2-4172-8d3b-ee64c1364a2c for instance a3b87dc4-af75-42ba-81af-7ad2ac59510c on n-h2-862769-1 Oct 27 03:21:35.997913 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-02ff3dcb-7913-4fd6-8fbc-986cd5b1bddd req-aa390ffe-22cc-4111-b926-b2f7cf95f8cc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033014 Oct 27 03:21:35.999314 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 132/262] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:21:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:21:36.130140 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d885445f-e5e4-45fc-8f0e-a2ff8f4ff74f tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 243 microversion: 2.1 time: 0.404491 Oct 27 03:21:36.130350 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 131/263] 10.222.0.20 () {60 vars in 1194 bytes} [Thu Oct 27 03:21:35 2022] POST /compute/v2.1/os-aggregates/10/action => generated 243 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:21:36.142281 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4e4ec669-446f-445a-bf92-d5dc54092a7d tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-862769-1"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:21:36.172676 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4e4ec669-446f-445a-bf92-d5dc54092a7d tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:36.173369 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4e4ec669-446f-445a-bf92-d5dc54092a7d tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:36.174562 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4e4ec669-446f-445a-bf92-d5dc54092a7d tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:36.267769 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8ae25a75-1c9b-4daf-a503-cfe45655cfc6 tempest-MigrationsAdminTest-707106630 tempest-MigrationsAdminTest-707106630-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:36.268191 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8ae25a75-1c9b-4daf-a503-cfe45655cfc6 tempest-MigrationsAdminTest-707106630 tempest-MigrationsAdminTest-707106630-project-admin] [instance: 5910c783-6877-4a41-8650-0973a11f3578] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:36.274732 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8ae25a75-1c9b-4daf-a503-cfe45655cfc6 tempest-MigrationsAdminTest-707106630 tempest-MigrationsAdminTest-707106630-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:36.275233 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8ae25a75-1c9b-4daf-a503-cfe45655cfc6 tempest-MigrationsAdminTest-707106630 tempest-MigrationsAdminTest-707106630-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:36.275674 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8ae25a75-1c9b-4daf-a503-cfe45655cfc6 tempest-MigrationsAdminTest-707106630 tempest-MigrationsAdminTest-707106630-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:36.276379 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8ae25a75-1c9b-4daf-a503-cfe45655cfc6 tempest-MigrationsAdminTest-707106630 tempest-MigrationsAdminTest-707106630-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:36.276841 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8ae25a75-1c9b-4daf-a503-cfe45655cfc6 tempest-MigrationsAdminTest-707106630 tempest-MigrationsAdminTest-707106630-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:36.277406 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8ae25a75-1c9b-4daf-a503-cfe45655cfc6 tempest-MigrationsAdminTest-707106630 tempest-MigrationsAdminTest-707106630-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:36.555909 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4e4ec669-446f-445a-bf92-d5dc54092a7d tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 228 microversion: 2.1 time: 0.417869 Oct 27 03:21:36.556804 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 132/264] 10.222.0.20 () {60 vars in 1194 bytes} [Thu Oct 27 03:21:36 2022] POST /compute/v2.1/os-aggregates/10/action => generated 228 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:21:36.565781 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a9cc06b3-fad2-49b2-8b97-662f46450d69 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:36.566740 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a9cc06b3-fad2-49b2-8b97-662f46450d69 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] [instance: 4e4efa06-0a3c-4c11-849d-22bb8d9dccf8] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:36.573827 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a9cc06b3-fad2-49b2-8b97-662f46450d69 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:36.574553 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a9cc06b3-fad2-49b2-8b97-662f46450d69 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:36.575142 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a9cc06b3-fad2-49b2-8b97-662f46450d69 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:36.576001 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a9cc06b3-fad2-49b2-8b97-662f46450d69 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:36.576697 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a9cc06b3-fad2-49b2-8b97-662f46450d69 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:36.577272 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a9cc06b3-fad2-49b2-8b97-662f46450d69 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:36.607511 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8ae25a75-1c9b-4daf-a503-cfe45655cfc6 tempest-MigrationsAdminTest-707106630 tempest-MigrationsAdminTest-707106630-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578" status: 200 len: 1614 microversion: 2.1 time: 0.607077 Oct 27 03:21:36.624288 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 133/265] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:35 2022] GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578 => generated 1614 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:36.633232 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ed9b96cd-7b45-4532-b98e-412aef510e70 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:36.634051 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ed9b96cd-7b45-4532-b98e-412aef510e70 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:36.641684 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ed9b96cd-7b45-4532-b98e-412aef510e70 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:36.642480 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ed9b96cd-7b45-4532-b98e-412aef510e70 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:36.643071 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ed9b96cd-7b45-4532-b98e-412aef510e70 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:36.643937 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ed9b96cd-7b45-4532-b98e-412aef510e70 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:36.644524 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ed9b96cd-7b45-4532-b98e-412aef510e70 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:36.645090 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ed9b96cd-7b45-4532-b98e-412aef510e70 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:36.654492 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a9cc06b3-fad2-49b2-8b97-662f46450d69 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff070c0383324e1da5c49e3d9c652516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1da8ce26ab49ddae972233777c4c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:36.663593 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a9cc06b3-fad2-49b2-8b97-662f46450d69 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] 10.222.0.20 "GET /compute/v2.1/servers/4e4efa06-0a3c-4c11-849d-22bb8d9dccf8" status: 200 len: 1215 microversion: 2.1 time: 0.105872 Oct 27 03:21:36.664166 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 133/266] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:36 2022] GET /compute/v2.1/servers/4e4efa06-0a3c-4c11-849d-22bb8d9dccf8 => generated 1215 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:36.669059 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7c8d1042-00cf-4ac8-b97e-489ab5789927 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:36.670266 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7c8d1042-00cf-4ac8-b97e-489ab5789927 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] [instance: a3b87dc4-af75-42ba-81af-7ad2ac59510c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:36.676725 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7c8d1042-00cf-4ac8-b97e-489ab5789927 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:36.677428 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7c8d1042-00cf-4ac8-b97e-489ab5789927 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:36.677904 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7c8d1042-00cf-4ac8-b97e-489ab5789927 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:36.678626 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7c8d1042-00cf-4ac8-b97e-489ab5789927 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:36.679081 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7c8d1042-00cf-4ac8-b97e-489ab5789927 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:36.679769 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7c8d1042-00cf-4ac8-b97e-489ab5789927 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:36.738025 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ed9b96cd-7b45-4532-b98e-412aef510e70 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:36.741724 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=100 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:36.749435 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ed9b96cd-7b45-4532-b98e-412aef510e70 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:36.751619 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ed9b96cd-7b45-4532-b98e-412aef510e70 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:36.757007 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ed9b96cd-7b45-4532-b98e-412aef510e70 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1539 microversion: 2.91 time: 0.146427 Oct 27 03:21:36.757987 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 134/267] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:21:36 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1539 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:21:36.770451 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-54abd30d-6e9f-4b00-9ea2-7ca7846c4ed1 tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:36.830367 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7c8d1042-00cf-4ac8-b97e-489ab5789927 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3d2208faeb4421af21da56d455be92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b2b8b909c54f36b61d934d09607b5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:36.838286 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7c8d1042-00cf-4ac8-b97e-489ab5789927 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] 10.222.0.20 "GET /compute/v2.1/servers/a3b87dc4-af75-42ba-81af-7ad2ac59510c" status: 200 len: 1319 microversion: 2.1 time: 0.172834 Oct 27 03:21:36.838864 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 134/268] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:36 2022] GET /compute/v2.1/servers/a3b87dc4-af75-42ba-81af-7ad2ac59510c => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:36.843937 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-42a54b17-f985-46dd-be01-95efefd2eb2e tempest-MigrationsAdminTest-707106630 tempest-MigrationsAdminTest-707106630-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:21:36.844502 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-42a54b17-f985-46dd-be01-95efefd2eb2e tempest-MigrationsAdminTest-707106630 tempest-MigrationsAdminTest-707106630-project-admin] [instance: 5910c783-6877-4a41-8650-0973a11f3578] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:36.849968 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-42a54b17-f985-46dd-be01-95efefd2eb2e tempest-MigrationsAdminTest-707106630 tempest-MigrationsAdminTest-707106630-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:36.851496 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-42a54b17-f985-46dd-be01-95efefd2eb2e tempest-MigrationsAdminTest-707106630 tempest-MigrationsAdminTest-707106630-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:36.851943 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-42a54b17-f985-46dd-be01-95efefd2eb2e tempest-MigrationsAdminTest-707106630 tempest-MigrationsAdminTest-707106630-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:36.852642 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-42a54b17-f985-46dd-be01-95efefd2eb2e tempest-MigrationsAdminTest-707106630 tempest-MigrationsAdminTest-707106630-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:36.853090 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-42a54b17-f985-46dd-be01-95efefd2eb2e tempest-MigrationsAdminTest-707106630 tempest-MigrationsAdminTest-707106630-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:36.854221 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-42a54b17-f985-46dd-be01-95efefd2eb2e tempest-MigrationsAdminTest-707106630 tempest-MigrationsAdminTest-707106630-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:36.861090 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-54abd30d-6e9f-4b00-9ea2-7ca7846c4ed1 tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.102053 Oct 27 03:21:36.861675 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 135/269] 10.222.0.20 () {58 vars in 1155 bytes} [Thu Oct 27 03:21:36 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 27 03:21:36.871998 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f6dd1236-25e5-454e-9d49-d6d117e6551f tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1363378517"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:21:36.875773 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.aggregate [None req-f6dd1236-25e5-454e-9d49-d6d117e6551f tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Generated uuid c5e97903-555f-4b37-8204-6d2f81b54559 for aggregate {{(pid=121000) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 27 03:21:36.974510 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f6dd1236-25e5-454e-9d49-d6d117e6551f tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.105839 Oct 27 03:21:36.981387 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 136/270] 10.222.0.20 () {60 vars in 1164 bytes} [Thu Oct 27 03:21:36 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:21:36.986595 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-752526d5-e641-4581-b800-4f708cc8b914 tempest-AggregatesAdminTestV241-1154059494 tempest-AggregatesAdminTestV241-1154059494-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-586753242"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:21:36.990467 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.aggregate [None req-752526d5-e641-4581-b800-4f708cc8b914 tempest-AggregatesAdminTestV241-1154059494 tempest-AggregatesAdminTestV241-1154059494-project-admin] Generated uuid 3fba6fe3-91f7-4a26-8fd6-8314987bf344 for aggregate {{(pid=121000) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 27 03:21:37.095794 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-42a54b17-f985-46dd-be01-95efefd2eb2e tempest-MigrationsAdminTest-707106630 tempest-MigrationsAdminTest-707106630-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '4e8002bf6ca34327b2d4faa37f93c6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333b6e5cda4e482ab1ce3f241ec6cfe9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:37.096367 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-42a54b17-f985-46dd-be01-95efefd2eb2e tempest-MigrationsAdminTest-707106630 tempest-MigrationsAdminTest-707106630-project-admin] [instance: 5910c783-6877-4a41-8650-0973a11f3578] flavor_id is None. Assuming migration. {{(pid=121001) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 27 03:21:37.096809 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-42a54b17-f985-46dd-be01-95efefd2eb2e tempest-MigrationsAdminTest-707106630 tempest-MigrationsAdminTest-707106630-project-admin] [instance: 5910c783-6877-4a41-8650-0973a11f3578] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=121001) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 27 03:21:37.106826 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-752526d5-e641-4581-b800-4f708cc8b914 tempest-AggregatesAdminTestV241-1154059494 tempest-AggregatesAdminTestV241-1154059494-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.123850 Oct 27 03:21:37.110889 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 137/271] 10.222.0.20 () {62 vars in 1205 bytes} [Thu Oct 27 03:21:36 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 03:21:37.113328 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4a15c21a-9d84-4589-8f7d-5752c2562d94 tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:37.128298 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=5,nova_api:INSERT=6 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:37.298465 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4a15c21a-9d84-4589-8f7d-5752c2562d94 tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.189179 Oct 27 03:21:37.298971 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 138/272] 10.222.0.20 () {58 vars in 1155 bytes} [Thu Oct 27 03:21:37 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 27 03:21:37.303587 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4c7d1370-9a5a-49a8-9b81-8665f8936d68 tempest-AggregatesAdminTestV241-1154059494 tempest-AggregatesAdminTestV241-1154059494-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1564767906"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:21:37.467069 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-42a54b17-f985-46dd-be01-95efefd2eb2e tempest-MigrationsAdminTest-707106630 tempest-MigrationsAdminTest-707106630-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578/action" status: 202 len: 0 microversion: 2.1 time: 0.626791 Oct 27 03:21:37.468700 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 135/273] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:21:36 2022] POST /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578/action => generated 0 bytes in 629 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:21:37.473520 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d85d97d7-8bd0-4d6f-bfd3-51dd8dd93193 tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:37.480551 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-d85d97d7-8bd0-4d6f-bfd3-51dd8dd93193 tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] HTTP exception thrown: Aggregate 11 could not be found. Oct 27 03:21:37.482438 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d85d97d7-8bd0-4d6f-bfd3-51dd8dd93193 tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Request method failure captured: Oct 27 03:21:37.482438 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/os-aggregates/11 HTTP/1.1 Oct 27 03:21:37.482438 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:21:37.482438 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:21:37.482438 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:21:37.482438 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:21:37.482438 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:21:37.482438 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:21:37.482438 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:21:37.482438 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:21:37.482438 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfkUs2PpS8pKztSGhVZj1V0S_umlVIPsdEHSBwov0DZoZU6SkGaKqQgDx6iGS10Uyi5Rdf3mK-fV92UxiO9KR65KPhr9GgSriC6CgUQs1n2fWVBO-2RPfbJxq3AiPUGE_SjZuFYmBfm8w8jAqSkIK7V9z2JE2M-vv88UW-OxyfGvx5k Oct 27 03:21:37.482438 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:21:37.482438 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:21:37.482438 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:21:37.482438 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:21:37.482438 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:21:37.482438 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:21:37.482438 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 94e3ce3876734a51b1857a6e6f40be07 Oct 27 03:21:37.482438 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-AggregatesAdminTestJSON-214700401 Oct 27 03:21:37.482438 n-d-862769-1 devstack@n-api.service[121001]: X-Role: admin,member,reader Oct 27 03:21:37.482438 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: admin,member,reader Oct 27 03:21:37.483817 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/94e3ce3876734a51b1857a6e6f40be07"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/94e3ce3876734a51b1857a6e6f40be07"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/94e3ce3876734a51b1857a6e6f40be07"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_94e3ce3876734a51b1857a6e6f40be07"}]}] Oct 27 03:21:37.483817 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-AggregatesAdminTestJSON-214700401 Oct 27 03:21:37.483817 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 94e3ce3876734a51b1857a6e6f40be07 Oct 27 03:21:37.483817 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-214700401 Oct 27 03:21:37.483817 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-AggregatesAdminTestJSON-214700401-project-admin Oct 27 03:21:37.483817 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:21:37.483817 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:21:37.483817 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: f019f47a03c74f59aaae11ba363180e1 Oct 27 03:21:37.483817 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-AggregatesAdminTestJSON-214700401-project-admin Oct 27 03:21:37.483817 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:21:37.483817 n-d-862769-1 devstack@n-api.service[121001]: exception: Aggregate 11 could not be found. Oct 27 03:21:37.483817 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '11'} Oct 27 03:21:37.483817 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:21:37.486127 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:21:37.486127 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 27 03:21:37.486127 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 27 03:21:37.486127 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 27 03:21:37.486127 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 27 03:21:37.486127 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 03:21:37.486127 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 03:21:37.486127 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 27 03:21:37.486127 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 27 03:21:37.486127 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 03:21:37.486127 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 03:21:37.486127 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 27 03:21:37.486127 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 27 03:21:37.486127 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 11 could not be found. Oct 27 03:21:37.486127 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:21:37.486127 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:21:37.486127 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:21:37.486127 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:21:37.486127 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:21:37.487350 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:21:37.487350 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:21:37.487350 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:21:37.487350 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:21:37.487350 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:21:37.487350 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 27 03:21:37.487350 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:21:37.487350 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 11 could not be found. Oct 27 03:21:37.487350 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:21:37.487350 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:21:37.487350 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:21:37.487350 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:21:37.487350 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:21:37.487350 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:21:37.487350 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:21:37.487350 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:21:37.487350 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 11 could not be found. Oct 27 03:21:37.487350 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:21:37.488417 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d85d97d7-8bd0-4d6f-bfd3-51dd8dd93193 tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Returning 404 to user: Aggregate 11 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:21:37.488417 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d85d97d7-8bd0-4d6f-bfd3-51dd8dd93193 tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates/11" status: 404 len: 78 microversion: 2.1 time: 0.014140 Oct 27 03:21:37.488417 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 136/274] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Oct 27 03:21:37 2022] GET /compute/v2.1/os-aggregates/11 => generated 78 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 03:21:37.492986 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4c7d1370-9a5a-49a8-9b81-8665f8936d68 tempest-AggregatesAdminTestV241-1154059494 tempest-AggregatesAdminTestV241-1154059494-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-aggregates/12" status: 200 len: 300 microversion: 2.41 time: 0.192938 Oct 27 03:21:37.493736 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 139/275] 10.222.0.20 () {62 vars in 1213 bytes} [Thu Oct 27 03:21:37 2022] PUT /compute/v2.1/os-aggregates/12 => generated 300 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 03:21:37.497109 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9996a683-8a9b-4928-9598-933c3e0756f2 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:37.499276 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-9996a683-8a9b-4928-9598-933c3e0756f2 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 5910c783-6877-4a41-8650-0973a11f3578] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:37.499412 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c802d6ac-511b-4184-ae9c-285b6f778e6c tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:37.509858 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9996a683-8a9b-4928-9598-933c3e0756f2 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:37.510494 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9996a683-8a9b-4928-9598-933c3e0756f2 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:37.511153 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9996a683-8a9b-4928-9598-933c3e0756f2 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:37.512196 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9996a683-8a9b-4928-9598-933c3e0756f2 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:37.513203 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9996a683-8a9b-4928-9598-933c3e0756f2 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:37.513833 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9996a683-8a9b-4928-9598-933c3e0756f2 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:37.516989 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-c802d6ac-511b-4184-ae9c-285b6f778e6c tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] HTTP exception thrown: Aggregate 11 could not be found. Oct 27 03:21:37.519585 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c802d6ac-511b-4184-ae9c-285b6f778e6c tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Request method failure captured: Oct 27 03:21:37.519585 n-d-862769-1 devstack@n-api.service[121000]: request: DELETE /compute/v2.1/os-aggregates/11 HTTP/1.1 Oct 27 03:21:37.519585 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:21:37.519585 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:21:37.519585 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:21:37.519585 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:21:37.519585 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:21:37.519585 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:21:37.519585 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:21:37.519585 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:21:37.519585 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfkUs2PpS8pKztSGhVZj1V0S_umlVIPsdEHSBwov0DZoZU6SkGaKqQgDx6iGS10Uyi5Rdf3mK-fV92UxiO9KR65KPhr9GgSriC6CgUQs1n2fWVBO-2RPfbJxq3AiPUGE_SjZuFYmBfm8w8jAqSkIK7V9z2JE2M-vv88UW-OxyfGvx5k Oct 27 03:21:37.519585 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:21:37.519585 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:21:37.519585 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:21:37.519585 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:21:37.519585 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:21:37.519585 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:21:37.519585 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 94e3ce3876734a51b1857a6e6f40be07 Oct 27 03:21:37.519585 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-AggregatesAdminTestJSON-214700401 Oct 27 03:21:37.519585 n-d-862769-1 devstack@n-api.service[121000]: X-Role: admin,member,reader Oct 27 03:21:37.519585 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: admin,member,reader Oct 27 03:21:37.520710 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/94e3ce3876734a51b1857a6e6f40be07"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/94e3ce3876734a51b1857a6e6f40be07"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/94e3ce3876734a51b1857a6e6f40be07"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_94e3ce3876734a51b1857a6e6f40be07"}]}] Oct 27 03:21:37.520710 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-AggregatesAdminTestJSON-214700401 Oct 27 03:21:37.520710 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 94e3ce3876734a51b1857a6e6f40be07 Oct 27 03:21:37.520710 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-214700401 Oct 27 03:21:37.520710 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-AggregatesAdminTestJSON-214700401-project-admin Oct 27 03:21:37.520710 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:21:37.520710 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:21:37.520710 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: f019f47a03c74f59aaae11ba363180e1 Oct 27 03:21:37.520710 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-AggregatesAdminTestJSON-214700401-project-admin Oct 27 03:21:37.520710 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:21:37.520710 n-d-862769-1 devstack@n-api.service[121000]: exception: Aggregate 11 could not be found. Oct 27 03:21:37.520710 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '11'} Oct 27 03:21:37.520710 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:21:37.521425 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:21:37.521425 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 27 03:21:37.521425 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 27 03:21:37.521425 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 27 03:21:37.521425 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 27 03:21:37.521425 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 03:21:37.521425 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 03:21:37.521425 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 03:21:37.521425 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 03:21:37.521425 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 27 03:21:37.521425 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 27 03:21:37.521425 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 27 03:21:37.521425 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 27 03:21:37.521425 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 03:21:37.521425 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 03:21:37.521425 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 27 03:21:37.521425 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 27 03:21:37.521425 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 03:21:37.521425 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 03:21:37.522505 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 27 03:21:37.522505 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 27 03:21:37.522505 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 11 could not be found. Oct 27 03:21:37.522505 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:21:37.522505 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:21:37.522505 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:21:37.522505 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:21:37.522505 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:21:37.522505 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:21:37.522505 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:21:37.522505 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:21:37.522505 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:21:37.522505 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:21:37.522505 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 27 03:21:37.522505 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:21:37.522505 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 11 could not be found. Oct 27 03:21:37.522505 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:21:37.522505 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:21:37.522505 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:21:37.522505 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:21:37.522505 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:21:37.523624 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:21:37.523624 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:21:37.523624 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:21:37.523624 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 11 could not be found. Oct 27 03:21:37.523624 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:21:37.523624 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c802d6ac-511b-4184-ae9c-285b6f778e6c tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Returning 404 to user: Aggregate 11 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:21:37.523624 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c802d6ac-511b-4184-ae9c-285b6f778e6c tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/11" status: 404 len: 78 microversion: 2.1 time: 0.026653 Oct 27 03:21:37.523624 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 140/276] 10.222.0.20 () {58 vars in 1155 bytes} [Thu Oct 27 03:21:37 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 78 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 03:21:37.531981 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-aadcf793-051b-4f75-a7cc-92d6c6a4f77a tempest-AggregatesAdminTestV241-1154059494 tempest-AggregatesAdminTestV241-1154059494-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:37.545285 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-aadcf793-051b-4f75-a7cc-92d6c6a4f77a tempest-AggregatesAdminTestV241-1154059494 tempest-AggregatesAdminTestV241-1154059494-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates/12" status: 200 len: 300 microversion: 2.41 time: 0.021584 Oct 27 03:21:37.546282 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 141/277] 10.222.0.20 () {60 vars in 1193 bytes} [Thu Oct 27 03:21:37 2022] GET /compute/v2.1/os-aggregates/12 => generated 300 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 03:21:37.550909 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-44b870c7-a601-414f-a139-baf7a1f3c71d tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-546607744", "name": "tempest-test_aggregate-871652144"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:21:37.556721 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.aggregate [None req-44b870c7-a601-414f-a139-baf7a1f3c71d tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Generated uuid b37df453-02a0-4af5-82d0-8c6151e4a2e9 for aggregate {{(pid=121000) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 27 03:21:37.667969 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-44b870c7-a601-414f-a139-baf7a1f3c71d tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.120505 Oct 27 03:21:37.668939 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 142/278] 10.222.0.20 () {60 vars in 1165 bytes} [Thu Oct 27 03:21:37 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:21:37.678352 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f8113706-9d4c-493b-869a-23183a8c2741 tempest-AggregatesAdminTestV241-1154059494 tempest-AggregatesAdminTestV241-1154059494-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-862769-1"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:21:37.690798 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9996a683-8a9b-4928-9598-933c3e0756f2 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:37.691290 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f8113706-9d4c-493b-869a-23183a8c2741 tempest-AggregatesAdminTestV241-1154059494 tempest-AggregatesAdminTestV241-1154059494-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:37.691649 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f8113706-9d4c-493b-869a-23183a8c2741 tempest-AggregatesAdminTestV241-1154059494 tempest-AggregatesAdminTestV241-1154059494-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:37.692328 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f8113706-9d4c-493b-869a-23183a8c2741 tempest-AggregatesAdminTestV241-1154059494 tempest-AggregatesAdminTestV241-1154059494-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:37.704317 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9996a683-8a9b-4928-9598-933c3e0756f2 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578" status: 200 len: 1472 microversion: 2.1 time: 0.216007 Oct 27 03:21:37.704317 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 137/279] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:37 2022] GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578 => generated 1472 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:37.729388 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8c19ae1b-e0d3-48be-9fb4-ed48f7e90988 tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:37.828592 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8c19ae1b-e0d3-48be-9fb4-ed48f7e90988 tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.124836 Oct 27 03:21:37.834711 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 138/280] 10.222.0.20 () {58 vars in 1155 bytes} [Thu Oct 27 03:21:37 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 27 03:21:37.841449 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-165ebc3a-6e30-4455-9498-a99fb3e9040c tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:37.850662 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-165ebc3a-6e30-4455-9498-a99fb3e9040c tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] [instance: 4e4efa06-0a3c-4c11-849d-22bb8d9dccf8] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:37.856883 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-165ebc3a-6e30-4455-9498-a99fb3e9040c tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:37.857621 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-165ebc3a-6e30-4455-9498-a99fb3e9040c tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:37.858441 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-165ebc3a-6e30-4455-9498-a99fb3e9040c tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:37.858991 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-165ebc3a-6e30-4455-9498-a99fb3e9040c tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:37.859575 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-165ebc3a-6e30-4455-9498-a99fb3e9040c tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:37.860005 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-165ebc3a-6e30-4455-9498-a99fb3e9040c tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:37.964603 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-165ebc3a-6e30-4455-9498-a99fb3e9040c tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff070c0383324e1da5c49e3d9c652516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1da8ce26ab49ddae972233777c4c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:37.972713 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-165ebc3a-6e30-4455-9498-a99fb3e9040c tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] 10.222.0.20 "GET /compute/v2.1/servers/4e4efa06-0a3c-4c11-849d-22bb8d9dccf8" status: 200 len: 1279 microversion: 2.1 time: 0.136556 Oct 27 03:21:37.973683 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 139/281] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:37 2022] GET /compute/v2.1/servers/4e4efa06-0a3c-4c11-849d-22bb8d9dccf8 => generated 1279 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:37.978214 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-efc8ac83-82d5-491c-bdf4-0a8500d9cf06 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:37.978828 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-efc8ac83-82d5-491c-bdf4-0a8500d9cf06 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:37.984777 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-efc8ac83-82d5-491c-bdf4-0a8500d9cf06 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:37.985277 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-efc8ac83-82d5-491c-bdf4-0a8500d9cf06 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:37.985725 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-efc8ac83-82d5-491c-bdf4-0a8500d9cf06 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:37.986488 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-efc8ac83-82d5-491c-bdf4-0a8500d9cf06 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:37.986932 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-efc8ac83-82d5-491c-bdf4-0a8500d9cf06 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:37.987364 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-efc8ac83-82d5-491c-bdf4-0a8500d9cf06 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:37.993184 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:38.038940 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f8113706-9d4c-493b-869a-23183a8c2741 tempest-AggregatesAdminTestV241-1154059494 tempest-AggregatesAdminTestV241-1154059494-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/12/action" status: 200 len: 315 microversion: 2.41 time: 0.368709 Oct 27 03:21:38.040406 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 143/282] 10.222.0.20 () {62 vars in 1235 bytes} [Thu Oct 27 03:21:37 2022] POST /compute/v2.1/os-aggregates/12/action => generated 315 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 03:21:38.049228 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-75dfd175-f85f-4cf4-be98-63eee87a438f tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:38.060441 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-75dfd175-f85f-4cf4-be98-63eee87a438f tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] HTTP exception thrown: Aggregate 13 could not be found. Oct 27 03:21:38.062772 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-75dfd175-f85f-4cf4-be98-63eee87a438f tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Request method failure captured: Oct 27 03:21:38.062772 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/os-aggregates/13 HTTP/1.1 Oct 27 03:21:38.062772 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:21:38.062772 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:21:38.062772 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:21:38.062772 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:21:38.062772 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:21:38.062772 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:21:38.062772 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:21:38.062772 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:21:38.062772 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfkUs2PpS8pKztSGhVZj1V0S_umlVIPsdEHSBwov0DZoZU6SkGaKqQgDx6iGS10Uyi5Rdf3mK-fV92UxiO9KR65KPhr9GgSriC6CgUQs1n2fWVBO-2RPfbJxq3AiPUGE_SjZuFYmBfm8w8jAqSkIK7V9z2JE2M-vv88UW-OxyfGvx5k Oct 27 03:21:38.062772 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:21:38.062772 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:21:38.062772 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:21:38.062772 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:21:38.062772 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:21:38.062772 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:21:38.062772 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 94e3ce3876734a51b1857a6e6f40be07 Oct 27 03:21:38.062772 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-AggregatesAdminTestJSON-214700401 Oct 27 03:21:38.062772 n-d-862769-1 devstack@n-api.service[121000]: X-Role: admin,member,reader Oct 27 03:21:38.062772 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: admin,member,reader Oct 27 03:21:38.070007 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/94e3ce3876734a51b1857a6e6f40be07"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/94e3ce3876734a51b1857a6e6f40be07"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/94e3ce3876734a51b1857a6e6f40be07"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_94e3ce3876734a51b1857a6e6f40be07"}]}] Oct 27 03:21:38.070007 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-AggregatesAdminTestJSON-214700401 Oct 27 03:21:38.070007 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 94e3ce3876734a51b1857a6e6f40be07 Oct 27 03:21:38.070007 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-214700401 Oct 27 03:21:38.070007 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-AggregatesAdminTestJSON-214700401-project-admin Oct 27 03:21:38.070007 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:21:38.070007 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:21:38.070007 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: f019f47a03c74f59aaae11ba363180e1 Oct 27 03:21:38.070007 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-AggregatesAdminTestJSON-214700401-project-admin Oct 27 03:21:38.070007 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:21:38.070007 n-d-862769-1 devstack@n-api.service[121000]: exception: Aggregate 13 could not be found. Oct 27 03:21:38.070007 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '13'} Oct 27 03:21:38.070007 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:21:38.071101 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:21:38.071101 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 27 03:21:38.071101 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 27 03:21:38.071101 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 27 03:21:38.071101 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 27 03:21:38.071101 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 03:21:38.071101 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 03:21:38.071101 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 27 03:21:38.071101 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 27 03:21:38.071101 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 03:21:38.071101 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 03:21:38.071101 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 27 03:21:38.071101 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 27 03:21:38.071101 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 13 could not be found. Oct 27 03:21:38.071101 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:21:38.071101 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:21:38.071101 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:21:38.071101 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:21:38.071101 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:21:38.072064 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:21:38.072064 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:21:38.072064 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:21:38.072064 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:21:38.072064 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:21:38.072064 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 27 03:21:38.072064 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:21:38.072064 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 13 could not be found. Oct 27 03:21:38.072064 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:21:38.072064 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:21:38.072064 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:21:38.072064 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:21:38.072064 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:21:38.072064 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:21:38.072064 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:21:38.072064 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:21:38.072064 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 13 could not be found. Oct 27 03:21:38.072064 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:21:38.073016 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-75dfd175-f85f-4cf4-be98-63eee87a438f tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Returning 404 to user: Aggregate 13 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:21:38.073016 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-75dfd175-f85f-4cf4-be98-63eee87a438f tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates/13" status: 404 len: 78 microversion: 2.1 time: 0.021169 Oct 27 03:21:38.073016 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 144/283] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Oct 27 03:21:38 2022] GET /compute/v2.1/os-aggregates/13 => generated 78 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 03:21:38.073016 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3e4396f9-e745-4dfa-8e76-e274c00c0819 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:38.073016 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-3e4396f9-e745-4dfa-8e76-e274c00c0819 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] [instance: a3b87dc4-af75-42ba-81af-7ad2ac59510c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:38.073309 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-efc8ac83-82d5-491c-bdf4-0a8500d9cf06 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:38.078054 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3e4396f9-e745-4dfa-8e76-e274c00c0819 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:38.078633 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3e4396f9-e745-4dfa-8e76-e274c00c0819 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:38.079214 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3e4396f9-e745-4dfa-8e76-e274c00c0819 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:38.079940 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3e4396f9-e745-4dfa-8e76-e274c00c0819 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:38.080486 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3e4396f9-e745-4dfa-8e76-e274c00c0819 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:38.080922 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3e4396f9-e745-4dfa-8e76-e274c00c0819 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:38.083185 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-efc8ac83-82d5-491c-bdf4-0a8500d9cf06 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:38.085078 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-efc8ac83-82d5-491c-bdf4-0a8500d9cf06 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:38.090731 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-efc8ac83-82d5-491c-bdf4-0a8500d9cf06 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1539 microversion: 2.91 time: 0.116028 Oct 27 03:21:38.091525 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 140/284] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:21:37 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1539 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:21:38.096181 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-12c0d6ae-7db2-4246-803e-65f9f88c85b9 tempest-AggregatesAdminTestV241-1154059494 tempest-AggregatesAdminTestV241-1154059494-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-862769-1"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:21:38.107313 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-12c0d6ae-7db2-4246-803e-65f9f88c85b9 tempest-AggregatesAdminTestV241-1154059494 tempest-AggregatesAdminTestV241-1154059494-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:38.108046 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-12c0d6ae-7db2-4246-803e-65f9f88c85b9 tempest-AggregatesAdminTestV241-1154059494 tempest-AggregatesAdminTestV241-1154059494-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:38.108555 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-12c0d6ae-7db2-4246-803e-65f9f88c85b9 tempest-AggregatesAdminTestV241-1154059494 tempest-AggregatesAdminTestV241-1154059494-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:38.316296 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-3e4396f9-e745-4dfa-8e76-e274c00c0819 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3d2208faeb4421af21da56d455be92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b2b8b909c54f36b61d934d09607b5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:38.330204 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3e4396f9-e745-4dfa-8e76-e274c00c0819 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] 10.222.0.20 "GET /compute/v2.1/servers/a3b87dc4-af75-42ba-81af-7ad2ac59510c" status: 200 len: 1467 microversion: 2.1 time: 0.263907 Oct 27 03:21:38.330950 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 145/285] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:38 2022] GET /compute/v2.1/servers/a3b87dc4-af75-42ba-81af-7ad2ac59510c => generated 1467 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:38.352099 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-13912976-86fb-4ae3-8cf2-a35ffdc68acc tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:38.365351 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-13912976-86fb-4ae3-8cf2-a35ffdc68acc tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] HTTP exception thrown: Aggregate 13 could not be found. Oct 27 03:21:38.369156 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-13912976-86fb-4ae3-8cf2-a35ffdc68acc tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Request method failure captured: Oct 27 03:21:38.369156 n-d-862769-1 devstack@n-api.service[121000]: request: DELETE /compute/v2.1/os-aggregates/13 HTTP/1.1 Oct 27 03:21:38.369156 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:21:38.369156 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:21:38.369156 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:21:38.369156 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:21:38.369156 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:21:38.369156 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:21:38.369156 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:21:38.369156 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:21:38.369156 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfkUs2PpS8pKztSGhVZj1V0S_umlVIPsdEHSBwov0DZoZU6SkGaKqQgDx6iGS10Uyi5Rdf3mK-fV92UxiO9KR65KPhr9GgSriC6CgUQs1n2fWVBO-2RPfbJxq3AiPUGE_SjZuFYmBfm8w8jAqSkIK7V9z2JE2M-vv88UW-OxyfGvx5k Oct 27 03:21:38.369156 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:21:38.369156 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:21:38.369156 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:21:38.369156 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:21:38.369156 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:21:38.369156 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:21:38.369156 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 94e3ce3876734a51b1857a6e6f40be07 Oct 27 03:21:38.369156 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-AggregatesAdminTestJSON-214700401 Oct 27 03:21:38.369156 n-d-862769-1 devstack@n-api.service[121000]: X-Role: admin,member,reader Oct 27 03:21:38.369156 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: admin,member,reader Oct 27 03:21:38.370489 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/94e3ce3876734a51b1857a6e6f40be07"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/94e3ce3876734a51b1857a6e6f40be07"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/94e3ce3876734a51b1857a6e6f40be07"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_94e3ce3876734a51b1857a6e6f40be07"}]}] Oct 27 03:21:38.370489 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-AggregatesAdminTestJSON-214700401 Oct 27 03:21:38.370489 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 94e3ce3876734a51b1857a6e6f40be07 Oct 27 03:21:38.370489 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-214700401 Oct 27 03:21:38.370489 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-AggregatesAdminTestJSON-214700401-project-admin Oct 27 03:21:38.370489 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:21:38.370489 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:21:38.370489 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: f019f47a03c74f59aaae11ba363180e1 Oct 27 03:21:38.370489 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-AggregatesAdminTestJSON-214700401-project-admin Oct 27 03:21:38.370489 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:21:38.370489 n-d-862769-1 devstack@n-api.service[121000]: exception: Aggregate 13 could not be found. Oct 27 03:21:38.370489 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '13'} Oct 27 03:21:38.370489 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:21:38.371244 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:21:38.371244 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 27 03:21:38.371244 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 27 03:21:38.371244 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 27 03:21:38.371244 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 27 03:21:38.371244 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 03:21:38.371244 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 03:21:38.371244 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 03:21:38.371244 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 03:21:38.371244 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 27 03:21:38.371244 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 27 03:21:38.371244 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 27 03:21:38.371244 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 27 03:21:38.371244 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 03:21:38.371244 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 03:21:38.371244 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 27 03:21:38.371244 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 27 03:21:38.371244 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 03:21:38.371244 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 03:21:38.372428 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 27 03:21:38.372428 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 27 03:21:38.372428 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 13 could not be found. Oct 27 03:21:38.372428 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:21:38.372428 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:21:38.372428 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:21:38.372428 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:21:38.372428 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:21:38.372428 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:21:38.372428 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:21:38.372428 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:21:38.372428 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:21:38.372428 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:21:38.372428 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 27 03:21:38.372428 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:21:38.372428 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 13 could not be found. Oct 27 03:21:38.372428 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:21:38.372428 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:21:38.372428 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:21:38.372428 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:21:38.372428 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:21:38.373653 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:21:38.373653 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:21:38.373653 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:21:38.373653 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 13 could not be found. Oct 27 03:21:38.373653 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:21:38.373653 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-13912976-86fb-4ae3-8cf2-a35ffdc68acc tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Returning 404 to user: Aggregate 13 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:21:38.373653 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-13912976-86fb-4ae3-8cf2-a35ffdc68acc tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/13" status: 404 len: 78 microversion: 2.1 time: 0.028377 Oct 27 03:21:38.376152 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 146/286] 10.222.0.20 () {58 vars in 1155 bytes} [Thu Oct 27 03:21:38 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 78 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 03:21:38.396311 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-12c0d6ae-7db2-4246-803e-65f9f88c85b9 tempest-AggregatesAdminTestV241-1154059494 tempest-AggregatesAdminTestV241-1154059494-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/12/action" status: 200 len: 300 microversion: 2.41 time: 0.303675 Oct 27 03:21:38.397187 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 141/287] 10.222.0.20 () {62 vars in 1235 bytes} [Thu Oct 27 03:21:38 2022] POST /compute/v2.1/os-aggregates/12/action => generated 300 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 03:21:38.401888 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-855bb024-7976-438b-87fe-73f352b2307d tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-281960863"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:21:38.405790 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.aggregate [None req-855bb024-7976-438b-87fe-73f352b2307d tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Generated uuid 6d953bb2-a53e-4a6e-b082-0417eaf3ec82 for aggregate {{(pid=121001) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 27 03:21:38.500196 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-855bb024-7976-438b-87fe-73f352b2307d tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.101681 Oct 27 03:21:38.500815 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 142/288] 10.222.0.20 () {60 vars in 1164 bytes} [Thu Oct 27 03:21:38 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:21:38.514381 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-194988a1-6dc3-41f2-b082-99e7acc6fed7 tempest-AggregatesAdminTestV241-1154059494 tempest-AggregatesAdminTestV241-1154059494-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:38.624791 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-532374ef-5b82-4578-94cd-6b73dca9e0c5 tempest-LiveMigrationNegativeTest-1769348670 tempest-LiveMigrationNegativeTest-1769348670-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-1503931017", "block_migration": true, "disk_over_commit": false}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:21:38.627462 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-532374ef-5b82-4578-94cd-6b73dca9e0c5 tempest-LiveMigrationNegativeTest-1769348670 tempest-LiveMigrationNegativeTest-1769348670-project-admin] [instance: a3b87dc4-af75-42ba-81af-7ad2ac59510c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:38.633009 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-194988a1-6dc3-41f2-b082-99e7acc6fed7 tempest-AggregatesAdminTestV241-1154059494 tempest-AggregatesAdminTestV241-1154059494-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.41 time: 0.123648 Oct 27 03:21:38.633649 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 143/289] 10.222.0.20 () {60 vars in 1196 bytes} [Thu Oct 27 03:21:38 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:21:38.639506 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-cdd9b7a2-2fc9-428f-80b2-fddc5aa03180 tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:38.639982 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-532374ef-5b82-4578-94cd-6b73dca9e0c5 tempest-LiveMigrationNegativeTest-1769348670 tempest-LiveMigrationNegativeTest-1769348670-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:38.640490 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-532374ef-5b82-4578-94cd-6b73dca9e0c5 tempest-LiveMigrationNegativeTest-1769348670 tempest-LiveMigrationNegativeTest-1769348670-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:38.640929 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-532374ef-5b82-4578-94cd-6b73dca9e0c5 tempest-LiveMigrationNegativeTest-1769348670 tempest-LiveMigrationNegativeTest-1769348670-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:38.641654 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-532374ef-5b82-4578-94cd-6b73dca9e0c5 tempest-LiveMigrationNegativeTest-1769348670 tempest-LiveMigrationNegativeTest-1769348670-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:38.642169 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-532374ef-5b82-4578-94cd-6b73dca9e0c5 tempest-LiveMigrationNegativeTest-1769348670 tempest-LiveMigrationNegativeTest-1769348670-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:38.642607 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-532374ef-5b82-4578-94cd-6b73dca9e0c5 tempest-LiveMigrationNegativeTest-1769348670 tempest-LiveMigrationNegativeTest-1769348670-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:38.649524 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-cdd9b7a2-2fc9-428f-80b2-fddc5aa03180 tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates/14" status: 200 len: 227 microversion: 2.1 time: 0.014795 Oct 27 03:21:38.650098 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 144/290] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Oct 27 03:21:38 2022] GET /compute/v2.1/os-aggregates/14 => generated 227 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:21:38.732819 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a28c998c-e107-4936-898d-35923cadaa8d tempest-HypervisorAdminV228Test-61883424 tempest-HypervisorAdminV228Test-61883424-project-admin] Calling method '.version_select at 0x7f7ddb509b80>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:38.735706 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a28c998c-e107-4936-898d-35923cadaa8d tempest-HypervisorAdminV228Test-61883424 tempest-HypervisorAdminV228Test-61883424-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:38.736221 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a28c998c-e107-4936-898d-35923cadaa8d tempest-HypervisorAdminV228Test-61883424 tempest-HypervisorAdminV228Test-61883424-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:38.736723 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a28c998c-e107-4936-898d-35923cadaa8d tempest-HypervisorAdminV228Test-61883424 tempest-HypervisorAdminV228Test-61883424-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:38.751541 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a28c998c-e107-4936-898d-35923cadaa8d tempest-HypervisorAdminV228Test-61883424 tempest-HypervisorAdminV228Test-61883424-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:38.752044 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a28c998c-e107-4936-898d-35923cadaa8d tempest-HypervisorAdminV228Test-61883424 tempest-HypervisorAdminV228Test-61883424-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:38.752647 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a28c998c-e107-4936-898d-35923cadaa8d tempest-HypervisorAdminV228Test-61883424 tempest-HypervisorAdminV228Test-61883424-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:38.762905 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a28c998c-e107-4936-898d-35923cadaa8d tempest-HypervisorAdminV228Test-61883424 tempest-HypervisorAdminV228Test-61883424-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:38.763567 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a28c998c-e107-4936-898d-35923cadaa8d tempest-HypervisorAdminV228Test-61883424 tempest-HypervisorAdminV228Test-61883424-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:38.764173 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a28c998c-e107-4936-898d-35923cadaa8d tempest-HypervisorAdminV228Test-61883424 tempest-HypervisorAdminV228Test-61883424-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:38.770870 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a28c998c-e107-4936-898d-35923cadaa8d tempest-HypervisorAdminV228Test-61883424 tempest-HypervisorAdminV228Test-61883424-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.104285 Oct 27 03:21:38.778389 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 145/291] 10.222.0.20 () {60 vars in 1187 bytes} [Thu Oct 27 03:21:38 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 03:21:38.783827 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c3704b43-39b9-439d-81b0-dcf270fe0c9c tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:21:38.907248 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c3704b43-39b9-439d-81b0-dcf270fe0c9c tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/14/action" status: 200 len: 265 microversion: 2.1 time: 0.127348 Oct 27 03:21:38.914242 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 146/292] 10.222.0.20 () {60 vars in 1194 bytes} [Thu Oct 27 03:21:38 2022] POST /compute/v2.1/os-aggregates/14/action => generated 265 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:21:38.923762 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ca6427b1-8ab1-435f-bf25-8759b2ca86cf tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:38.924523 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ca6427b1-8ab1-435f-bf25-8759b2ca86cf tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 5910c783-6877-4a41-8650-0973a11f3578] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:38.925232 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-532374ef-5b82-4578-94cd-6b73dca9e0c5 tempest-LiveMigrationNegativeTest-1769348670 tempest-LiveMigrationNegativeTest-1769348670-project-admin] Lazy-loading 'flavor' on Instance uuid a3b87dc4-af75-42ba-81af-7ad2ac59510c {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:21:38.932748 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ca6427b1-8ab1-435f-bf25-8759b2ca86cf tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:38.933547 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ca6427b1-8ab1-435f-bf25-8759b2ca86cf tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:38.934182 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ca6427b1-8ab1-435f-bf25-8759b2ca86cf tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:38.934923 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ca6427b1-8ab1-435f-bf25-8759b2ca86cf tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:38.935517 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ca6427b1-8ab1-435f-bf25-8759b2ca86cf tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:38.936028 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ca6427b1-8ab1-435f-bf25-8759b2ca86cf tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:39.005911 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-532374ef-5b82-4578-94cd-6b73dca9e0c5 tempest-LiveMigrationNegativeTest-1769348670 tempest-LiveMigrationNegativeTest-1769348670-project-admin] [instance: a3b87dc4-af75-42ba-81af-7ad2ac59510c] Going to try to live migrate instance to tempest-host-1503931017 {{(pid=121000) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 27 03:21:39.018482 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-532374ef-5b82-4578-94cd-6b73dca9e0c5 tempest-LiveMigrationNegativeTest-1769348670 tempest-LiveMigrationNegativeTest-1769348670-project-admin] HTTP exception thrown: Compute host tempest-host-1503931017 could not be found. Oct 27 03:21:39.027506 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-532374ef-5b82-4578-94cd-6b73dca9e0c5 tempest-LiveMigrationNegativeTest-1769348670 tempest-LiveMigrationNegativeTest-1769348670-project-admin] Request method failure captured: Oct 27 03:21:39.027506 n-d-862769-1 devstack@n-api.service[121000]: request: POST /compute/v2.1/servers/a3b87dc4-af75-42ba-81af-7ad2ac59510c/action HTTP/1.1 Oct 27 03:21:39.027506 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:21:39.027506 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:21:39.027506 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:21:39.027506 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 107 Oct 27 03:21:39.027506 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:21:39.027506 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:21:39.027506 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:21:39.027506 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:21:39.027506 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfkygAILkV6cT4ntu99n_bhkPTkiu6BUY2lcaFyJVFPBCFnP7E5DnUCupPePjU9jHgzwEb6Ky9iGSbRMdpSiML9P8WQfJ0Ei0KVjYbSkRixdPoKGgSV0Jf6Hp27yL1gd8r7mJwOecPpp3pEuKqITFz81qt49Hzx-5CQ_8R3DyGNsmcw Oct 27 03:21:39.027506 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:21:39.027506 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:21:39.027506 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:21:39.027506 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:21:39.027506 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:21:39.027506 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:21:39.027506 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 9472aa97aca64edda6b0e0ffd956af70 Oct 27 03:21:39.027506 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-LiveMigrationNegativeTest-1769348670 Oct 27 03:21:39.027506 n-d-862769-1 devstack@n-api.service[121000]: X-Role: admin,member,reader Oct 27 03:21:39.027506 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: admin,member,reader Oct 27 03:21:39.029057 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9472aa97aca64edda6b0e0ffd956af70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9472aa97aca64edda6b0e0ffd956af70"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9472aa97aca64edda6b0e0ffd956af70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9472aa97aca64edda6b0e0ffd956af70"}]}] Oct 27 03:21:39.029057 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-LiveMigrationNegativeTest-1769348670 Oct 27 03:21:39.029057 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 9472aa97aca64edda6b0e0ffd956af70 Oct 27 03:21:39.029057 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1769348670 Oct 27 03:21:39.029057 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-LiveMigrationNegativeTest-1769348670-project-admin Oct 27 03:21:39.029057 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:21:39.029057 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:21:39.029057 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 8c5e02ab3926413c82a1f53cb7a2b9f3 Oct 27 03:21:39.029057 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-LiveMigrationNegativeTest-1769348670-project-admin Oct 27 03:21:39.029057 n-d-862769-1 devstack@n-api.service[121000]: Oct 27 03:21:39.029057 n-d-862769-1 devstack@n-api.service[121000]: {"os-migrateLive": {"host": "tempest-host-1503931017", "block_migration": true, "disk_over_commit": false}} Oct 27 03:21:39.029057 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:21:39.029868 n-d-862769-1 devstack@n-api.service[121000]: exception: Compute host tempest-host-1503931017 could not be found. Oct 27 03:21:39.029868 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': 'a3b87dc4-af75-42ba-81af-7ad2ac59510c', 'body': {'os-migrateLive': {'host': 'tempest-host-1503931017', 'block_migration': True, 'disk_over_commit': False}}} Oct 27 03:21:39.029868 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:21:39.029868 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:21:39.029868 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 27 03:21:39.029868 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 27 03:21:39.029868 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 27 03:21:39.029868 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 03:21:39.029868 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 27 03:21:39.029868 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 27 03:21:39.029868 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 27 03:21:39.029868 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 27 03:21:39.029868 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 27 03:21:39.029868 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 27 03:21:39.029868 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 27 03:21:39.029868 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 27 03:21:39.029868 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 27 03:21:39.029868 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 27 03:21:39.029868 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 03:21:39.032173 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 03:21:39.032173 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 27 03:21:39.032173 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 27 03:21:39.032173 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5488, in live_migrate Oct 27 03:21:39.032173 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Oct 27 03:21:39.032173 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 03:21:39.032173 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 03:21:39.032173 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Oct 27 03:21:39.032173 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Oct 27 03:21:39.032173 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Oct 27 03:21:39.032173 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:21:39.032173 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Oct 27 03:21:39.032173 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Oct 27 03:21:39.032173 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Oct 27 03:21:39.032173 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Oct 27 03:21:39.032173 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Oct 27 03:21:39.032173 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Oct 27 03:21:39.032173 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-1503931017 could not be found. Oct 27 03:21:39.032173 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:21:39.034823 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:21:39.034823 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:21:39.034823 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:21:39.034823 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:21:39.034823 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:21:39.034823 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:21:39.034823 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:21:39.034823 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:21:39.034823 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:21:39.034823 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:21:39.034823 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:21:39.034823 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:21:39.034823 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:21:39.034823 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:21:39.034823 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:21:39.034823 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 27 03:21:39.034823 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Oct 27 03:21:39.034823 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 27 03:21:39.034823 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-1503931017 could not be found. Oct 27 03:21:39.034823 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:21:39.037952 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:21:39.037952 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:21:39.037952 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:21:39.037952 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:21:39.037952 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:21:39.037952 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:21:39.037952 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:21:39.037952 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-1503931017 could not be found. Oct 27 03:21:39.037952 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:21:39.037952 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-532374ef-5b82-4578-94cd-6b73dca9e0c5 tempest-LiveMigrationNegativeTest-1769348670 tempest-LiveMigrationNegativeTest-1769348670-project-admin] Returning 400 to user: Compute host tempest-host-1503931017 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:21:39.037952 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-532374ef-5b82-4578-94cd-6b73dca9e0c5 tempest-LiveMigrationNegativeTest-1769348670 tempest-LiveMigrationNegativeTest-1769348670-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/a3b87dc4-af75-42ba-81af-7ad2ac59510c/action" status: 400 len: 100 microversion: 2.1 time: 0.652027 Oct 27 03:21:39.037952 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 147/293] 10.222.0.20 () {60 vars in 1279 bytes} [Thu Oct 27 03:21:38 2022] POST /compute/v2.1/servers/a3b87dc4-af75-42ba-81af-7ad2ac59510c/action => generated 100 bytes in 653 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 03:21:39.048342 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4aa820fb-6517-4750-ae83-a5b672be12fb tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-75312429"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:21:39.066672 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.aggregate [None req-4aa820fb-6517-4750-ae83-a5b672be12fb tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] Generated uuid 20d79037-a72d-467c-83df-81a836acc88a for aggregate {{(pid=121000) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 27 03:21:39.123069 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ca6427b1-8ab1-435f-bf25-8759b2ca86cf tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:39.132325 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ca6427b1-8ab1-435f-bf25-8759b2ca86cf tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578" status: 200 len: 1472 microversion: 2.1 time: 0.223532 Oct 27 03:21:39.133121 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 147/294] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:38 2022] GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578 => generated 1472 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:39.138009 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f7a36844-235f-4f92-b789-45fee453ed1d tempest-HypervisorAdminV228Test-61883424 tempest-HypervisorAdminV228Test-61883424-project-admin] Calling method '.version_select at 0x7f7ddb29f1f0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:39.140765 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f7a36844-235f-4f92-b789-45fee453ed1d tempest-HypervisorAdminV228Test-61883424 tempest-HypervisorAdminV228Test-61883424-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:39.140907 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f7a36844-235f-4f92-b789-45fee453ed1d tempest-HypervisorAdminV228Test-61883424 tempest-HypervisorAdminV228Test-61883424-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:39.141323 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f7a36844-235f-4f92-b789-45fee453ed1d tempest-HypervisorAdminV228Test-61883424 tempest-HypervisorAdminV228Test-61883424-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:39.155730 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f7a36844-235f-4f92-b789-45fee453ed1d tempest-HypervisorAdminV228Test-61883424 tempest-HypervisorAdminV228Test-61883424-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:39.156212 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f7a36844-235f-4f92-b789-45fee453ed1d tempest-HypervisorAdminV228Test-61883424 tempest-HypervisorAdminV228Test-61883424-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:39.156653 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f7a36844-235f-4f92-b789-45fee453ed1d tempest-HypervisorAdminV228Test-61883424 tempest-HypervisorAdminV228Test-61883424-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:39.163457 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f7a36844-235f-4f92-b789-45fee453ed1d tempest-HypervisorAdminV228Test-61883424 tempest-HypervisorAdminV228Test-61883424-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.029440 Oct 27 03:21:39.171537 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4aa820fb-6517-4750-ae83-a5b672be12fb tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.136400 Oct 27 03:21:39.175505 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 148/295] 10.222.0.20 () {60 vars in 1193 bytes} [Thu Oct 27 03:21:39 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 03:21:39.175841 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 148/296] 10.222.0.20 () {60 vars in 1164 bytes} [Thu Oct 27 03:21:39 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:21:39.183237 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a787b51f-0884-4243-83b7-b7e08cd34e04 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:39.184345 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a787b51f-0884-4243-83b7-b7e08cd34e04 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] [instance: 4e4efa06-0a3c-4c11-849d-22bb8d9dccf8] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:39.189073 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-093bdcde-4d3a-4d0c-8718-a64fbb2b8e0a tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:39.193139 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a787b51f-0884-4243-83b7-b7e08cd34e04 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:39.193853 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a787b51f-0884-4243-83b7-b7e08cd34e04 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:39.194494 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a787b51f-0884-4243-83b7-b7e08cd34e04 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:39.195638 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a787b51f-0884-4243-83b7-b7e08cd34e04 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:39.196288 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a787b51f-0884-4243-83b7-b7e08cd34e04 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:39.196863 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a787b51f-0884-4243-83b7-b7e08cd34e04 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:39.201277 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-093bdcde-4d3a-4d0c-8718-a64fbb2b8e0a tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates/14" status: 200 len: 241 microversion: 2.1 time: 0.024632 Oct 27 03:21:39.203245 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 149/297] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Oct 27 03:21:39 2022] GET /compute/v2.1/os-aggregates/14 => generated 241 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:21:39.209487 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f0382006-922d-47bf-a814-f124be925353 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:39.210403 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f0382006-922d-47bf-a814-f124be925353 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] [instance: a3b87dc4-af75-42ba-81af-7ad2ac59510c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:39.217013 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f0382006-922d-47bf-a814-f124be925353 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:39.221539 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f0382006-922d-47bf-a814-f124be925353 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:39.222286 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f0382006-922d-47bf-a814-f124be925353 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:39.223834 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f0382006-922d-47bf-a814-f124be925353 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:39.224568 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f0382006-922d-47bf-a814-f124be925353 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:39.225186 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f0382006-922d-47bf-a814-f124be925353 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:39.423802 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f0382006-922d-47bf-a814-f124be925353 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3d2208faeb4421af21da56d455be92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b2b8b909c54f36b61d934d09607b5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:39.431993 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f0382006-922d-47bf-a814-f124be925353 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] 10.222.0.20 "GET /compute/v2.1/servers/a3b87dc4-af75-42ba-81af-7ad2ac59510c" status: 200 len: 1467 microversion: 2.1 time: 0.227367 Oct 27 03:21:39.432561 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 150/298] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:39 2022] GET /compute/v2.1/servers/a3b87dc4-af75-42ba-81af-7ad2ac59510c => generated 1467 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:39.438186 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-838de48d-607d-4b07-999c-019272d746d2 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:39.438986 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-838de48d-607d-4b07-999c-019272d746d2 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:39.445196 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-838de48d-607d-4b07-999c-019272d746d2 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:39.445877 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-838de48d-607d-4b07-999c-019272d746d2 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:39.446536 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-838de48d-607d-4b07-999c-019272d746d2 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:39.452539 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-838de48d-607d-4b07-999c-019272d746d2 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:39.453042 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-838de48d-607d-4b07-999c-019272d746d2 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:39.453490 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-838de48d-607d-4b07-999c-019272d746d2 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:39.485759 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a787b51f-0884-4243-83b7-b7e08cd34e04 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff070c0383324e1da5c49e3d9c652516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1da8ce26ab49ddae972233777c4c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:39.496144 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a787b51f-0884-4243-83b7-b7e08cd34e04 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] 10.222.0.20 "GET /compute/v2.1/servers/4e4efa06-0a3c-4c11-849d-22bb8d9dccf8" status: 200 len: 1319 microversion: 2.1 time: 0.318628 Oct 27 03:21:39.496734 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 149/299] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:39 2022] GET /compute/v2.1/servers/4e4efa06-0a3c-4c11-849d-22bb8d9dccf8 => generated 1319 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:39.502559 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-03cbd1aa-75dc-4dc5-b686-317ee20824dc tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-862769-1"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:21:39.513570 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-03cbd1aa-75dc-4dc5-b686-317ee20824dc tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:39.515097 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-03cbd1aa-75dc-4dc5-b686-317ee20824dc tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:39.515702 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-03cbd1aa-75dc-4dc5-b686-317ee20824dc tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:39.544761 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-838de48d-607d-4b07-999c-019272d746d2 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:39.554309 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-838de48d-607d-4b07-999c-019272d746d2 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:39.556796 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-838de48d-607d-4b07-999c-019272d746d2 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:39.564648 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-838de48d-607d-4b07-999c-019272d746d2 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1539 microversion: 2.91 time: 0.130804 Oct 27 03:21:39.575049 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 151/300] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:21:39 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1539 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:21:39.589525 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-de2c0650-d183-42df-b586-913a04fac41b tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:39.717942 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-de2c0650-d183-42df-b586-913a04fac41b tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.138829 Oct 27 03:21:39.719195 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 152/301] 10.222.0.20 () {58 vars in 1155 bytes} [Thu Oct 27 03:21:39 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 27 03:21:39.726052 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a8dbc73f-c130-4f13-bb47-85bc15137950 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1765242899", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:21:39.769135 n-d-862769-1 devstack@n-api.service[121000]: WARNING nova.scheduler.client.report [None req-03cbd1aa-75dc-4dc5-b686-317ee20824dc tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] [req-1d3ab03e-a883-4c7a-a370-7b701e42829c] Failed to update aggregates to [20d79037-a72d-467c-83df-81a836acc88a] for resource provider with UUID 936bca09-a1b9-4e2d-be60-afa2a799790d. Got 409: {"errors": [{"status": 409, "title": "Conflict", "detail": "There was a conflict when trying to complete your request.\n\n Update conflict: Another thread concurrently updated the resource provider data. Please retry your update ", "request_id": "req-1d3ab03e-a883-4c7a-a370-7b701e42829c"}]} Oct 27 03:21:39.799552 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.network.neutron [None req-a8dbc73f-c130-4f13-bb47-85bc15137950 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] validate_networks() for None {{(pid=121001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:21:40.078269 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-03cbd1aa-75dc-4dc5-b686-317ee20824dc tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/15/action" status: 200 len: 241 microversion: 2.1 time: 0.577207 Oct 27 03:21:40.079496 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 150/302] 10.222.0.20 () {60 vars in 1194 bytes} [Thu Oct 27 03:21:39 2022] POST /compute/v2.1/os-aggregates/15/action => generated 241 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:21:40.098396 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-293aecd7-9659-48e1-8d39-626abcb33322 tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1528823521", "availability_zone": "tempest-test_az-412841322"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:21:40.110456 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.aggregate [None req-293aecd7-9659-48e1-8d39-626abcb33322 tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Generated uuid 1f84890c-1c2b-4c54-9f79-2604564cba9c for aggregate {{(pid=121000) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 27 03:21:40.112186 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-a8dbc73f-c130-4f13-bb47-85bc15137950 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Flavor limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:21:40.113675 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-a8dbc73f-c130-4f13-bb47-85bc15137950 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Image limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:21:40.114249 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-a8dbc73f-c130-4f13-bb47-85bc15137950 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Flavor pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:21:40.114825 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-a8dbc73f-c130-4f13-bb47-85bc15137950 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Image pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:21:40.115254 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-a8dbc73f-c130-4f13-bb47-85bc15137950 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:21:40.124855 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a8dbc73f-c130-4f13-bb47-85bc15137950 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:40.125575 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a8dbc73f-c130-4f13-bb47-85bc15137950 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:40.126261 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a8dbc73f-c130-4f13-bb47-85bc15137950 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:40.127548 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a8dbc73f-c130-4f13-bb47-85bc15137950 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:40.128390 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a8dbc73f-c130-4f13-bb47-85bc15137950 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:40.129335 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a8dbc73f-c130-4f13-bb47-85bc15137950 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:40.147384 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-a8dbc73f-c130-4f13-bb47-85bc15137950 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Getting quotas for project 44b2b8b909c54f36b61d934d09607b5a. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:21:40.153931 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-a8dbc73f-c130-4f13-bb47-85bc15137950 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Getting quotas for user ae3d2208faeb4421af21da56d455be92 and project 44b2b8b909c54f36b61d934d09607b5a. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:21:40.163862 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:DELETE=10,nova_api:SELECT=87,nova_api:INSERT=3 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:40.167075 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a8dbc73f-c130-4f13-bb47-85bc15137950 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Going to run 1 instances... {{(pid=121001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:21:40.169380 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a8dbc73f-c130-4f13-bb47-85bc15137950 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] [instance: 936d578f-607c-4650-aac3-f06ef6fa7017] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:21:40.309333 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-293aecd7-9659-48e1-8d39-626abcb33322 tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.210950 Oct 27 03:21:40.309333 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 151/303] 10.222.0.20 () {60 vars in 1165 bytes} [Thu Oct 27 03:21:40 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:21:40.324667 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-243ef151-8cb1-4c16-b984-ef4ce8088824 tempest-AggregatesAdminNegativeTestJSON-390850425 tempest-AggregatesAdminNegativeTestJSON-390850425-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-862769-1"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:21:40.329091 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-243ef151-8cb1-4c16-b984-ef4ce8088824 tempest-AggregatesAdminNegativeTestJSON-390850425 tempest-AggregatesAdminNegativeTestJSON-390850425-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '747002f449e641f0a7d2c0f38cf541a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873ceb34cf6548fdb54bdd7c39c9318b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:40.331241 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-243ef151-8cb1-4c16-b984-ef4ce8088824 tempest-AggregatesAdminNegativeTestJSON-390850425 tempest-AggregatesAdminNegativeTestJSON-390850425-project] Request method failure captured: Oct 27 03:21:40.331241 n-d-862769-1 devstack@n-api.service[121000]: request: POST /compute/v2.1/os-aggregates/15/action HTTP/1.1 Oct 27 03:21:40.331241 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:21:40.331241 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:21:40.331241 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:21:40.331241 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 42 Oct 27 03:21:40.331241 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:21:40.331241 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:21:40.331241 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:21:40.331241 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:21:40.331241 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfkR6RrqRjTzB6Sywu_WxoyDAr4cYOxqYR1D8Ag31CrSn9lbqjp5txWGOjhQpamUvPH6aGlc5Ah7hQPxBhK9L8hlYJtA6Nkf3F-iblfpzgSg3WrTMmiADZHi1XyOT-ieTIvMXXO_ltZSB_QUy0QU8rHXk67od6_pY6Vgt2D0frE4r1s Oct 27 03:21:40.331241 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:21:40.331241 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:21:40.331241 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:21:40.331241 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:21:40.331241 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:21:40.331241 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:21:40.331241 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 873ceb34cf6548fdb54bdd7c39c9318b Oct 27 03:21:40.331241 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-390850425 Oct 27 03:21:40.331241 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:21:40.331241 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:21:40.332638 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/873ceb34cf6548fdb54bdd7c39c9318b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/873ceb34cf6548fdb54bdd7c39c9318b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/873ceb34cf6548fdb54bdd7c39c9318b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_873ceb34cf6548fdb54bdd7c39c9318b"}]}] Oct 27 03:21:40.332638 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-390850425 Oct 27 03:21:40.332638 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 873ceb34cf6548fdb54bdd7c39c9318b Oct 27 03:21:40.332638 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-390850425 Oct 27 03:21:40.332638 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-AggregatesAdminNegativeTestJSON-390850425-project Oct 27 03:21:40.332638 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:21:40.332638 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:21:40.332638 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 747002f449e641f0a7d2c0f38cf541a0 Oct 27 03:21:40.332638 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-390850425-project Oct 27 03:21:40.332638 n-d-862769-1 devstack@n-api.service[121000]: Oct 27 03:21:40.332638 n-d-862769-1 devstack@n-api.service[121000]: {"remove_host": {"host": "n-h2-862769-1"}} Oct 27 03:21:40.332638 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:21:40.332638 n-d-862769-1 devstack@n-api.service[121000]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 27 03:21:40.333486 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '15', 'body': {'remove_host': {'host': 'n-h2-862769-1'}}} Oct 27 03:21:40.333486 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:21:40.333486 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:21:40.333486 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:21:40.333486 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:21:40.333486 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:21:40.333486 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:21:40.333486 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:21:40.333486 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:21:40.333486 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:21:40.333486 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:21:40.333486 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Oct 27 03:21:40.333486 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Oct 27 03:21:40.333486 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 03:21:40.333486 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 03:21:40.333486 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 03:21:40.333486 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 03:21:40.333486 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 03:21:40.333486 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 03:21:40.334521 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 03:21:40.334521 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 03:21:40.334521 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 03:21:40.334521 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 03:21:40.334521 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 03:21:40.334521 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 03:21:40.334521 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 03:21:40.334521 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 03:21:40.334521 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 27 03:21:40.334521 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:21:40.334521 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:21:40.334521 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:21:40.334521 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:21:40.334521 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:21:40.334521 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:21:40.334521 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 03:21:40.334521 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 03:21:40.334521 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 27 03:21:40.334521 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:21:40.337026 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-243ef151-8cb1-4c16-b984-ef4ce8088824 tempest-AggregatesAdminNegativeTestJSON-390850425 tempest-AggregatesAdminNegativeTestJSON-390850425-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:21:40.338881 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-243ef151-8cb1-4c16-b984-ef4ce8088824 tempest-AggregatesAdminNegativeTestJSON-390850425 tempest-AggregatesAdminNegativeTestJSON-390850425-project] 10.222.0.20 "POST /compute/v2.1/os-aggregates/15/action" status: 403 len: 121 microversion: 2.1 time: 0.022888 Oct 27 03:21:40.339936 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 152/304] 10.222.0.20 () {60 vars in 1194 bytes} [Thu Oct 27 03:21:40 2022] POST /compute/v2.1/os-aggregates/15/action => generated 121 bytes in 33 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:21:40.347244 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-be98fbd6-5578-4153-a2e9-7cf3fdb03489 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:40.348245 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-be98fbd6-5578-4153-a2e9-7cf3fdb03489 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 5910c783-6877-4a41-8650-0973a11f3578] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:40.357786 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-be98fbd6-5578-4153-a2e9-7cf3fdb03489 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:40.359359 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-be98fbd6-5578-4153-a2e9-7cf3fdb03489 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:40.360131 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-be98fbd6-5578-4153-a2e9-7cf3fdb03489 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:40.361051 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-be98fbd6-5578-4153-a2e9-7cf3fdb03489 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:40.361695 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-be98fbd6-5578-4153-a2e9-7cf3fdb03489 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:40.362301 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-be98fbd6-5578-4153-a2e9-7cf3fdb03489 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:40.385923 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a8dbc73f-c130-4f13-bb47-85bc15137950 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.665513 Oct 27 03:21:40.387331 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 153/305] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:21:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 667 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 03:21:40.408332 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-cf01ec73-e7f0-48b1-ba2b-465ba29dd7fe tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1528823521_new", "availability_zone": "tempest-test_az-412841322_new"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:21:40.619002 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-be98fbd6-5578-4153-a2e9-7cf3fdb03489 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:40.626570 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cf01ec73-e7f0-48b1-ba2b-465ba29dd7fe tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:40.627066 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cf01ec73-e7f0-48b1-ba2b-465ba29dd7fe tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:40.627510 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cf01ec73-e7f0-48b1-ba2b-465ba29dd7fe tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:40.628584 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-be98fbd6-5578-4153-a2e9-7cf3fdb03489 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578" status: 200 len: 1472 microversion: 2.1 time: 0.287471 Oct 27 03:21:40.632055 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 153/306] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:40 2022] GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578 => generated 1472 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:40.637187 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-42904621-7d16-4a67-ab78-546b15314e04 req-6e80296c-0633-4b23-8274-5b8f2a339c1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e4efa06-0a3c-4c11-849d-22bb8d9dccf8", "tag": "2b593717-90ce-43e6-8ad3-7143ce5f9a4e"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:21:40.652613 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-42904621-7d16-4a67-ab78-546b15314e04 req-6e80296c-0633-4b23-8274-5b8f2a339c1c service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:40.653699 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-42904621-7d16-4a67-ab78-546b15314e04 req-6e80296c-0633-4b23-8274-5b8f2a339c1c service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:40.654547 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-42904621-7d16-4a67-ab78-546b15314e04 req-6e80296c-0633-4b23-8274-5b8f2a339c1c service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:40.670812 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-42904621-7d16-4a67-ab78-546b15314e04 req-6e80296c-0633-4b23-8274-5b8f2a339c1c service nova] Creating event network-changed:2b593717-90ce-43e6-8ad3-7143ce5f9a4e for instance 4e4efa06-0a3c-4c11-849d-22bb8d9dccf8 on n-h2-862769-1 Oct 27 03:21:40.677986 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-42904621-7d16-4a67-ab78-546b15314e04 req-6e80296c-0633-4b23-8274-5b8f2a339c1c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044236 Oct 27 03:21:40.678996 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 154/307] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:21:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:21:40.686348 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-12a38e0e-61b2-40ea-8336-c06dc5d71212 tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-862769-1"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:21:40.698836 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-12a38e0e-61b2-40ea-8336-c06dc5d71212 tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:40.699620 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-12a38e0e-61b2-40ea-8336-c06dc5d71212 tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:40.700288 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-12a38e0e-61b2-40ea-8336-c06dc5d71212 tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:40.769587 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-cf01ec73-e7f0-48b1-ba2b-465ba29dd7fe tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-aggregates/16" status: 200 len: 335 microversion: 2.1 time: 0.380215 Oct 27 03:21:40.777595 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 154/308] 10.222.0.20 () {60 vars in 1173 bytes} [Thu Oct 27 03:21:40 2022] PUT /compute/v2.1/os-aggregates/16 => generated 335 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:21:40.785936 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2a48b751-1c89-47bf-ae89-b7494c587504 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:40.787144 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2a48b751-1c89-47bf-ae89-b7494c587504 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] [instance: 936d578f-607c-4650-aac3-f06ef6fa7017] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:40.871409 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2a48b751-1c89-47bf-ae89-b7494c587504 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3d2208faeb4421af21da56d455be92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b2b8b909c54f36b61d934d09607b5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:40.882697 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2a48b751-1c89-47bf-ae89-b7494c587504 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] 10.222.0.20 "GET /compute/v2.1/servers/936d578f-607c-4650-aac3-f06ef6fa7017" status: 200 len: 1219 microversion: 2.1 time: 0.103310 Oct 27 03:21:40.883273 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 155/309] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:40 2022] GET /compute/v2.1/servers/936d578f-607c-4650-aac3-f06ef6fa7017 => generated 1219 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:40.895470 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-78fd531d-400c-4c21-993e-482e9cf318e8 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:40.896302 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-78fd531d-400c-4c21-993e-482e9cf318e8 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] [instance: 4e4efa06-0a3c-4c11-849d-22bb8d9dccf8] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:40.915779 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-78fd531d-400c-4c21-993e-482e9cf318e8 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:40.916333 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-78fd531d-400c-4c21-993e-482e9cf318e8 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:40.916849 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-78fd531d-400c-4c21-993e-482e9cf318e8 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:40.917548 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-78fd531d-400c-4c21-993e-482e9cf318e8 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:40.918146 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-78fd531d-400c-4c21-993e-482e9cf318e8 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:40.918524 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-78fd531d-400c-4c21-993e-482e9cf318e8 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:41.038490 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-12a38e0e-61b2-40ea-8336-c06dc5d71212 tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/15/action" status: 200 len: 226 microversion: 2.1 time: 0.358172 Oct 27 03:21:41.040248 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 155/310] 10.222.0.20 () {60 vars in 1194 bytes} [Thu Oct 27 03:21:40 2022] POST /compute/v2.1/os-aggregates/15/action => generated 226 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:21:41.065439 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-54683231-206f-4119-9308-76f0fc73035c tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:41.069592 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-54683231-206f-4119-9308-76f0fc73035c tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:41.086777 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-54683231-206f-4119-9308-76f0fc73035c tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:41.087391 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-54683231-206f-4119-9308-76f0fc73035c tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:41.087707 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-54683231-206f-4119-9308-76f0fc73035c tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:41.089669 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-78fd531d-400c-4c21-993e-482e9cf318e8 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff070c0383324e1da5c49e3d9c652516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1da8ce26ab49ddae972233777c4c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:41.093156 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-54683231-206f-4119-9308-76f0fc73035c tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:41.093156 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-54683231-206f-4119-9308-76f0fc73035c tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:41.093156 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-54683231-206f-4119-9308-76f0fc73035c tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:41.098299 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-78fd531d-400c-4c21-993e-482e9cf318e8 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] 10.222.0.20 "GET /compute/v2.1/servers/4e4efa06-0a3c-4c11-849d-22bb8d9dccf8" status: 200 len: 1319 microversion: 2.1 time: 0.207057 Oct 27 03:21:41.098990 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 156/311] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:40 2022] GET /compute/v2.1/servers/4e4efa06-0a3c-4c11-849d-22bb8d9dccf8 => generated 1319 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:41.116095 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6ede6690-78d1-4d73-81d7-5c49e35a0634 tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:41.128281 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6ede6690-78d1-4d73-81d7-5c49e35a0634 tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates" status: 200 len: 551 microversion: 2.1 time: 0.027926 Oct 27 03:21:41.129014 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 157/312] 10.222.0.20 () {58 vars in 1143 bytes} [Thu Oct 27 03:21:41 2022] GET /compute/v2.1/os-aggregates => generated 551 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:21:41.134071 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-520f2bb6-8bcc-4ee3-8169-5af12c58f7b4 tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:41.174463 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-54683231-206f-4119-9308-76f0fc73035c tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:41.182601 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-54683231-206f-4119-9308-76f0fc73035c tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:41.184052 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-54683231-206f-4119-9308-76f0fc73035c tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:41.190631 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-54683231-206f-4119-9308-76f0fc73035c tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1539 microversion: 2.91 time: 0.148515 Oct 27 03:21:41.191198 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 156/313] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:21:41 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1539 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:21:41.195615 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-cd89ee0d-11ec-4497-bf05-236ddf2565b1 tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:41.231738 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-520f2bb6-8bcc-4ee3-8169-5af12c58f7b4 tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.101234 Oct 27 03:21:41.233338 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 158/314] 10.222.0.20 () {58 vars in 1155 bytes} [Thu Oct 27 03:21:41 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 27 03:21:41.244928 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3a0f86a6-d406-4406-953b-08b0dd55bb23 tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-389618779"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:21:41.249561 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.aggregate [None req-3a0f86a6-d406-4406-953b-08b0dd55bb23 tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] Generated uuid ba3a84eb-6f29-4004-b905-b3b8a49da8f8 for aggregate {{(pid=121001) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 27 03:21:41.314830 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-cd89ee0d-11ec-4497-bf05-236ddf2565b1 tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.122331 Oct 27 03:21:41.316617 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 157/315] 10.222.0.20 () {58 vars in 1155 bytes} [Thu Oct 27 03:21:41 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 27 03:21:41.325562 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-79e57620-1696-401e-be3a-f8d94e3ca8c8 tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-944906047"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:21:41.329089 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.aggregate [None req-79e57620-1696-401e-be3a-f8d94e3ca8c8 tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Generated uuid 33bc6b2d-e87a-47a5-812b-0f655dba31ea for aggregate {{(pid=121000) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 27 03:21:41.358583 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3a0f86a6-d406-4406-953b-08b0dd55bb23 tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.116655 Oct 27 03:21:41.359197 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 159/316] 10.222.0.20 () {60 vars in 1164 bytes} [Thu Oct 27 03:21:41 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:21:41.370732 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ed5466a4-570c-4374-b333-4e55d86af0bd tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:21:41.382888 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ed5466a4-570c-4374-b333-4e55d86af0bd tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:41.383623 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ed5466a4-570c-4374-b333-4e55d86af0bd tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:41.384315 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ed5466a4-570c-4374-b333-4e55d86af0bd tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:41.391324 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ed5466a4-570c-4374-b333-4e55d86af0bd tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:41.392358 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ed5466a4-570c-4374-b333-4e55d86af0bd tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:41.393158 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ed5466a4-570c-4374-b333-4e55d86af0bd tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:41.402362 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.compute.aggregates [None req-ed5466a4-570c-4374-b333-4e55d86af0bd tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] Failed to remove host nonexist_host from aggregate 17. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 27 03:21:41.403140 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-ed5466a4-570c-4374-b333-4e55d86af0bd tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 17 Oct 27 03:21:41.405303 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ed5466a4-570c-4374-b333-4e55d86af0bd tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] Request method failure captured: Oct 27 03:21:41.405303 n-d-862769-1 devstack@n-api.service[121001]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Oct 27 03:21:41.405303 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:21:41.405303 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:21:41.405303 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:21:41.405303 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 42 Oct 27 03:21:41.405303 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:21:41.405303 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:21:41.405303 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:21:41.405303 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:21:41.405303 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfkUPNyHvG53Iz2jDxQ105aaFZTzTDDp3MI39q4PIqaZkicxPfZhVy3H6_7mDmIDIExdcPYhXBlN1v4Beb0N2H6ozvZizLFmZbN-oxgVTvWJ32yYegOOG46IUg1BMPU_du_KhLWkhPcTY10RB2M4MFGbcgYscU9M-CSa95eCdZfqZE4 Oct 27 03:21:41.405303 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:21:41.405303 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:21:41.405303 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:21:41.405303 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:21:41.405303 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:21:41.405303 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:21:41.405303 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 80aae888f8984fab9d12c5304427c794 Oct 27 03:21:41.405303 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1608777148 Oct 27 03:21:41.405303 n-d-862769-1 devstack@n-api.service[121001]: X-Role: admin,member,reader Oct 27 03:21:41.405303 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: admin,member,reader Oct 27 03:21:41.410630 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/80aae888f8984fab9d12c5304427c794"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/80aae888f8984fab9d12c5304427c794"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/80aae888f8984fab9d12c5304427c794"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_80aae888f8984fab9d12c5304427c794"}]}] Oct 27 03:21:41.410630 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1608777148 Oct 27 03:21:41.410630 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 80aae888f8984fab9d12c5304427c794 Oct 27 03:21:41.410630 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1608777148 Oct 27 03:21:41.410630 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin Oct 27 03:21:41.410630 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:21:41.410630 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:21:41.410630 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: fb130d3fbf88475ab63f87ce203d563f Oct 27 03:21:41.410630 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin Oct 27 03:21:41.410630 n-d-862769-1 devstack@n-api.service[121001]: Oct 27 03:21:41.410630 n-d-862769-1 devstack@n-api.service[121001]: {"remove_host": {"host": "nonexist_host"}} Oct 27 03:21:41.410630 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:21:41.410630 n-d-862769-1 devstack@n-api.service[121001]: exception: Cannot remove host nonexist_host in aggregate 17 Oct 27 03:21:41.411418 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'nonexist_host'}}} Oct 27 03:21:41.411418 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:21:41.411418 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:21:41.411418 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 27 03:21:41.411418 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 27 03:21:41.411418 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 03:21:41.411418 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 03:21:41.411418 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 27 03:21:41.411418 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 27 03:21:41.411418 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 03:21:41.411418 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 03:21:41.411418 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 27 03:21:41.411418 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 27 03:21:41.411418 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Oct 27 03:21:41.411418 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:21:41.411418 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:21:41.411418 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:21:41.411418 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:21:41.411418 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 27 03:21:41.411418 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 27 03:21:41.412478 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 27 03:21:41.412478 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 27 03:21:41.412478 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 27 03:21:41.412478 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:21:41.412478 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:21:41.412478 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:21:41.412478 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:21:41.412478 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Oct 27 03:21:41.412478 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Oct 27 03:21:41.412478 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 27 03:21:41.412478 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 27 03:21:41.412478 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 03:21:41.412478 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 03:21:41.412478 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 03:21:41.412478 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 03:21:41.412478 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 27 03:21:41.412478 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 27 03:21:41.412478 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6683, in remove_host_from_aggregate Oct 27 03:21:41.412478 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Oct 27 03:21:41.412478 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 27 03:21:41.413548 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 27 03:21:41.413548 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 27 03:21:41.413548 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:21:41.413548 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:21:41.413548 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:21:41.413548 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:21:41.413548 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:21:41.413548 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:21:41.413548 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:21:41.413548 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:21:41.413548 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:21:41.413548 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:21:41.413548 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:21:41.413548 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:21:41.413548 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Oct 27 03:21:41.413548 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 27 03:21:41.413548 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 17 Oct 27 03:21:41.413548 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:21:41.413548 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:21:41.413548 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:21:41.413548 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:21:41.414742 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:21:41.414742 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:21:41.414742 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:21:41.414742 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:21:41.414742 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 17 Oct 27 03:21:41.414742 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:21:41.414742 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ed5466a4-570c-4374-b333-4e55d86af0bd tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 17 {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:21:41.414742 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ed5466a4-570c-4374-b333-4e55d86af0bd tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/17/action" status: 404 len: 94 microversion: 2.1 time: 0.039998 Oct 27 03:21:41.414742 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 160/317] 10.222.0.20 () {60 vars in 1194 bytes} [Thu Oct 27 03:21:41 2022] POST /compute/v2.1/os-aggregates/17/action => generated 94 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 27 03:21:41.419248 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7d04d375-8780-4096-a4d1-4b23219d775b tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:41.432810 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-79e57620-1696-401e-be3a-f8d94e3ca8c8 tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.110999 Oct 27 03:21:41.433610 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 158/318] 10.222.0.20 () {60 vars in 1164 bytes} [Thu Oct 27 03:21:41 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:21:41.451663 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3f2ea021-5ed9-4046-886b-63ae6a01c158 tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:41.459970 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3f2ea021-5ed9-4046-886b-63ae6a01c158 tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates" status: 200 len: 444 microversion: 2.1 time: 0.018709 Oct 27 03:21:41.460541 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 159/319] 10.222.0.20 () {58 vars in 1143 bytes} [Thu Oct 27 03:21:41 2022] GET /compute/v2.1/os-aggregates => generated 444 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:21:41.472562 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6fc81082-39d8-431a-b80a-a3c1cbcd6d5c tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:41.531188 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7d04d375-8780-4096-a4d1-4b23219d775b tempest-AggregatesAdminNegativeTestJSON-1608777148 tempest-AggregatesAdminNegativeTestJSON-1608777148-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.119240 Oct 27 03:21:41.531768 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 161/320] 10.222.0.20 () {58 vars in 1155 bytes} [Thu Oct 27 03:21:41 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 27 03:21:41.577389 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6fc81082-39d8-431a-b80a-a3c1cbcd6d5c tempest-AggregatesAdminTestJSON-214700401 tempest-AggregatesAdminTestJSON-214700401-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.108237 Oct 27 03:21:41.577996 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 160/321] 10.222.0.20 () {58 vars in 1155 bytes} [Thu Oct 27 03:21:41 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 27 03:21:41.587399 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8b7ecaf1-a221-405f-9f0e-e178abaa887e tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:41.588089 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8b7ecaf1-a221-405f-9f0e-e178abaa887e tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] [instance: 820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:41.607565 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8b7ecaf1-a221-405f-9f0e-e178abaa887e tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:41.611972 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8b7ecaf1-a221-405f-9f0e-e178abaa887e tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:41.612540 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8b7ecaf1-a221-405f-9f0e-e178abaa887e tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:41.613399 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8b7ecaf1-a221-405f-9f0e-e178abaa887e tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:41.615372 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8b7ecaf1-a221-405f-9f0e-e178abaa887e tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:41.616791 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8b7ecaf1-a221-405f-9f0e-e178abaa887e tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:41.637048 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-8b7ecaf1-a221-405f-9f0e-e178abaa887e tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] HTTP exception thrown: Instance 820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5 could not be found. Oct 27 03:21:41.641302 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8b7ecaf1-a221-405f-9f0e-e178abaa887e tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Request method failure captured: Oct 27 03:21:41.641302 n-d-862769-1 devstack@n-api.service[121001]: request: DELETE /compute/v2.1/servers/820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5 HTTP/1.1 Oct 27 03:21:41.641302 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:21:41.641302 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:21:41.641302 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:21:41.641302 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:21:41.641302 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:21:41.641302 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:21:41.641302 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:21:41.641302 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:21:41.641302 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfkRJml_iLq0bPoVNCNOzl2BZ0X4mlVRZd7USSWstOq-QoDkRe0oYTKAgGbdAJd29FDuQH3u6Mt2qulaa6_mqVC1-7U-VzSOMj_tZIRixB4AAlvI8nW3w0bM0apG6WdM3xRudeb53nO_BhGxxcd5luPeO1rSc60IxdPD55dGqfNUdbY Oct 27 03:21:41.641302 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:21:41.641302 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:21:41.641302 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:21:41.641302 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:21:41.641302 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:21:41.641302 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:21:41.641302 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 2cee0e3469fc42a49004f9b5d1f5b6d0 Oct 27 03:21:41.641302 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-AggregatesAdminTestJSON-234008319 Oct 27 03:21:41.641302 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:21:41.641302 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:21:41.642836 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2cee0e3469fc42a49004f9b5d1f5b6d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2cee0e3469fc42a49004f9b5d1f5b6d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2cee0e3469fc42a49004f9b5d1f5b6d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2cee0e3469fc42a49004f9b5d1f5b6d0"}]}] Oct 27 03:21:41.642836 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-AggregatesAdminTestJSON-234008319 Oct 27 03:21:41.642836 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 2cee0e3469fc42a49004f9b5d1f5b6d0 Oct 27 03:21:41.642836 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-234008319 Oct 27 03:21:41.642836 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-AggregatesAdminTestJSON-234008319-project Oct 27 03:21:41.642836 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:21:41.642836 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:21:41.642836 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 015a9fcd508e4d20ad51dcb71053c28f Oct 27 03:21:41.642836 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-AggregatesAdminTestJSON-234008319-project Oct 27 03:21:41.642836 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:21:41.642836 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5 could not be found. Oct 27 03:21:41.642836 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5'} Oct 27 03:21:41.643581 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:21:41.643581 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:21:41.643581 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:21:41.643581 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:21:41.643581 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:21:41.643581 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:21:41.643581 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:21:41.643581 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:21:41.643581 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:21:41.643581 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:21:41.643581 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5 could not be found. Oct 27 03:21:41.643581 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:21:41.643581 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:21:41.643581 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:21:41.643581 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:21:41.643581 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:21:41.643581 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:21:41.643581 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:21:41.643581 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:21:41.643581 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:21:41.645446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:21:41.645446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 03:21:41.645446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 03:21:41.645446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 03:21:41.645446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 03:21:41.645446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:21:41.645446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:21:41.645446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:21:41.645446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:21:41.645446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5 could not be found. Oct 27 03:21:41.645446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:21:41.645446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:21:41.645446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:21:41.645446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:21:41.645446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:21:41.645446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:21:41.645446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:21:41.645446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:21:41.645446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5 could not be found. Oct 27 03:21:41.645446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:21:41.649617 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8b7ecaf1-a221-405f-9f0e-e178abaa887e tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Returning 404 to user: Instance 820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:21:41.649617 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8b7ecaf1-a221-405f-9f0e-e178abaa887e tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] 10.222.0.20 "DELETE /compute/v2.1/servers/820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5" status: 404 len: 111 microversion: 2.1 time: 0.060183 Oct 27 03:21:41.649617 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 162/322] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:21:41 2022] DELETE /compute/v2.1/servers/820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 03:21:41.655619 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e1d5d7c1-9fe0-4826-a611-e6a784055e0a tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:41.660134 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e1d5d7c1-9fe0-4826-a611-e6a784055e0a tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 5910c783-6877-4a41-8650-0973a11f3578] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:41.660742 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9c91d803-a88d-4f7b-a1ff-0e808a7afb49 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:41.660742 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-9c91d803-a88d-4f7b-a1ff-0e808a7afb49 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] [instance: 820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:41.665143 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9c91d803-a88d-4f7b-a1ff-0e808a7afb49 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:41.665646 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9c91d803-a88d-4f7b-a1ff-0e808a7afb49 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:41.666121 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9c91d803-a88d-4f7b-a1ff-0e808a7afb49 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:41.666836 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9c91d803-a88d-4f7b-a1ff-0e808a7afb49 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:41.667282 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e1d5d7c1-9fe0-4826-a611-e6a784055e0a tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:41.667410 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9c91d803-a88d-4f7b-a1ff-0e808a7afb49 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:41.667717 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9c91d803-a88d-4f7b-a1ff-0e808a7afb49 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:41.668315 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e1d5d7c1-9fe0-4826-a611-e6a784055e0a tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:41.668941 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e1d5d7c1-9fe0-4826-a611-e6a784055e0a tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:41.669895 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e1d5d7c1-9fe0-4826-a611-e6a784055e0a tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:41.671243 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e1d5d7c1-9fe0-4826-a611-e6a784055e0a tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:41.671996 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e1d5d7c1-9fe0-4826-a611-e6a784055e0a tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:41.683174 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-9c91d803-a88d-4f7b-a1ff-0e808a7afb49 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] HTTP exception thrown: Instance 820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5 could not be found. Oct 27 03:21:41.684776 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9c91d803-a88d-4f7b-a1ff-0e808a7afb49 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Request method failure captured: Oct 27 03:21:41.684776 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5 HTTP/1.1 Oct 27 03:21:41.684776 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:21:41.684776 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:21:41.684776 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:21:41.684776 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:21:41.684776 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:21:41.684776 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:21:41.684776 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:21:41.684776 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:21:41.684776 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfkRJml_iLq0bPoVNCNOzl2BZ0X4mlVRZd7USSWstOq-QoDkRe0oYTKAgGbdAJd29FDuQH3u6Mt2qulaa6_mqVC1-7U-VzSOMj_tZIRixB4AAlvI8nW3w0bM0apG6WdM3xRudeb53nO_BhGxxcd5luPeO1rSc60IxdPD55dGqfNUdbY Oct 27 03:21:41.684776 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:21:41.684776 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:21:41.684776 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:21:41.684776 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:21:41.684776 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:21:41.684776 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:21:41.684776 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 2cee0e3469fc42a49004f9b5d1f5b6d0 Oct 27 03:21:41.684776 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-AggregatesAdminTestJSON-234008319 Oct 27 03:21:41.684776 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:21:41.684776 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:21:41.694116 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2cee0e3469fc42a49004f9b5d1f5b6d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2cee0e3469fc42a49004f9b5d1f5b6d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2cee0e3469fc42a49004f9b5d1f5b6d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2cee0e3469fc42a49004f9b5d1f5b6d0"}]}] Oct 27 03:21:41.694116 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-AggregatesAdminTestJSON-234008319 Oct 27 03:21:41.694116 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 2cee0e3469fc42a49004f9b5d1f5b6d0 Oct 27 03:21:41.694116 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-234008319 Oct 27 03:21:41.694116 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-AggregatesAdminTestJSON-234008319-project Oct 27 03:21:41.694116 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:21:41.694116 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:21:41.694116 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 015a9fcd508e4d20ad51dcb71053c28f Oct 27 03:21:41.694116 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-AggregatesAdminTestJSON-234008319-project Oct 27 03:21:41.694116 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:21:41.694116 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5 could not be found. Oct 27 03:21:41.694116 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5'} Oct 27 03:21:41.694993 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:21:41.694993 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:21:41.694993 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:21:41.694993 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:21:41.694993 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:21:41.694993 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:21:41.694993 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:21:41.694993 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:21:41.694993 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:21:41.694993 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:21:41.694993 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5 could not be found. Oct 27 03:21:41.694993 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:21:41.694993 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:21:41.694993 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:21:41.694993 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:21:41.694993 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:21:41.694993 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:21:41.694993 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:21:41.694993 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:21:41.694993 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:21:41.696340 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:21:41.696340 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:21:41.696340 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:21:41.696340 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:21:41.696340 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:21:41.696340 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:21:41.696340 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:21:41.696340 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5 could not be found. Oct 27 03:21:41.696340 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:21:41.696340 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:21:41.696340 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:21:41.696340 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:21:41.696340 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:21:41.696340 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:21:41.696340 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:21:41.696340 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:21:41.696340 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5 could not be found. Oct 27 03:21:41.696340 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:21:41.697393 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9c91d803-a88d-4f7b-a1ff-0e808a7afb49 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] Returning 404 to user: Instance 820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:21:41.697393 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9c91d803-a88d-4f7b-a1ff-0e808a7afb49 tempest-AggregatesAdminTestJSON-234008319 tempest-AggregatesAdminTestJSON-234008319-project] 10.222.0.20 "GET /compute/v2.1/servers/820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5" status: 404 len: 111 microversion: 2.1 time: 0.034234 Oct 27 03:21:41.697393 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 163/323] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:41 2022] GET /compute/v2.1/servers/820ac454-6a4c-4dd8-a8d9-5d0fd28f38f5 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:21:41.907712 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f3a1adc0-8fd8-4b5e-a91c-5bce2fe215e6 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:41.912691 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e1d5d7c1-9fe0-4826-a611-e6a784055e0a tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:41.912969 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f3a1adc0-8fd8-4b5e-a91c-5bce2fe215e6 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] [instance: 936d578f-607c-4650-aac3-f06ef6fa7017] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:41.921785 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f3a1adc0-8fd8-4b5e-a91c-5bce2fe215e6 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:41.922528 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f3a1adc0-8fd8-4b5e-a91c-5bce2fe215e6 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:41.923342 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f3a1adc0-8fd8-4b5e-a91c-5bce2fe215e6 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:41.924712 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f3a1adc0-8fd8-4b5e-a91c-5bce2fe215e6 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:41.925399 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f3a1adc0-8fd8-4b5e-a91c-5bce2fe215e6 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:41.926106 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f3a1adc0-8fd8-4b5e-a91c-5bce2fe215e6 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:41.926289 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e1d5d7c1-9fe0-4826-a611-e6a784055e0a tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578" status: 200 len: 1472 microversion: 2.1 time: 0.275958 Oct 27 03:21:41.927677 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 161/324] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:41 2022] GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578 => generated 1472 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:42.036501 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f3a1adc0-8fd8-4b5e-a91c-5bce2fe215e6 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3d2208faeb4421af21da56d455be92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b2b8b909c54f36b61d934d09607b5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:42.044381 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f3a1adc0-8fd8-4b5e-a91c-5bce2fe215e6 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] 10.222.0.20 "GET /compute/v2.1/servers/936d578f-607c-4650-aac3-f06ef6fa7017" status: 200 len: 1223 microversion: 2.1 time: 0.142073 Oct 27 03:21:42.044955 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 164/325] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:41 2022] GET /compute/v2.1/servers/936d578f-607c-4650-aac3-f06ef6fa7017 => generated 1223 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:42.120794 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-042a5afb-5242-4cc2-b0e8-41502ef67872 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:42.121967 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-042a5afb-5242-4cc2-b0e8-41502ef67872 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] [instance: 4e4efa06-0a3c-4c11-849d-22bb8d9dccf8] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:42.130354 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-042a5afb-5242-4cc2-b0e8-41502ef67872 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:42.130354 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-042a5afb-5242-4cc2-b0e8-41502ef67872 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:42.130528 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-042a5afb-5242-4cc2-b0e8-41502ef67872 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:42.131106 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-042a5afb-5242-4cc2-b0e8-41502ef67872 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:42.131540 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-042a5afb-5242-4cc2-b0e8-41502ef67872 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:42.131974 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-042a5afb-5242-4cc2-b0e8-41502ef67872 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:42.219866 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f7acdf91-128f-4ee7-9271-25481f70df78 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:42.220716 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f7acdf91-128f-4ee7-9271-25481f70df78 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:42.227840 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f7acdf91-128f-4ee7-9271-25481f70df78 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:42.228998 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f7acdf91-128f-4ee7-9271-25481f70df78 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:42.229467 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f7acdf91-128f-4ee7-9271-25481f70df78 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:42.234934 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f7acdf91-128f-4ee7-9271-25481f70df78 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:42.234934 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f7acdf91-128f-4ee7-9271-25481f70df78 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:42.234934 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f7acdf91-128f-4ee7-9271-25481f70df78 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:42.305425 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f7acdf91-128f-4ee7-9271-25481f70df78 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:42.317565 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f7acdf91-128f-4ee7-9271-25481f70df78 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:42.319382 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f7acdf91-128f-4ee7-9271-25481f70df78 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:42.326267 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f7acdf91-128f-4ee7-9271-25481f70df78 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1539 microversion: 2.91 time: 0.111356 Oct 27 03:21:42.328033 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 165/326] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:21:42 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1539 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:21:42.558339 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-042a5afb-5242-4cc2-b0e8-41502ef67872 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff070c0383324e1da5c49e3d9c652516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1da8ce26ab49ddae972233777c4c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:42.575908 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-042a5afb-5242-4cc2-b0e8-41502ef67872 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] 10.222.0.20 "GET /compute/v2.1/servers/4e4efa06-0a3c-4c11-849d-22bb8d9dccf8" status: 200 len: 1319 microversion: 2.1 time: 0.454100 Oct 27 03:21:42.592857 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 162/327] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:42 2022] GET /compute/v2.1/servers/4e4efa06-0a3c-4c11-849d-22bb8d9dccf8 => generated 1319 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:42.952007 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-566e3990-a0a2-453b-a3b4-89718c95f810 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:42.953593 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-566e3990-a0a2-453b-a3b4-89718c95f810 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 5910c783-6877-4a41-8650-0973a11f3578] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:42.971465 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-566e3990-a0a2-453b-a3b4-89718c95f810 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:42.972215 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-566e3990-a0a2-453b-a3b4-89718c95f810 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:42.974633 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-566e3990-a0a2-453b-a3b4-89718c95f810 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:42.976900 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-566e3990-a0a2-453b-a3b4-89718c95f810 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:42.978520 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-566e3990-a0a2-453b-a3b4-89718c95f810 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:42.979687 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-566e3990-a0a2-453b-a3b4-89718c95f810 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:43.071013 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3278da94-b5d4-4029-922d-adb0f0763065 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:43.071862 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-3278da94-b5d4-4029-922d-adb0f0763065 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] [instance: 936d578f-607c-4650-aac3-f06ef6fa7017] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:43.079692 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3278da94-b5d4-4029-922d-adb0f0763065 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:43.080423 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3278da94-b5d4-4029-922d-adb0f0763065 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:43.081095 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3278da94-b5d4-4029-922d-adb0f0763065 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:43.082090 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3278da94-b5d4-4029-922d-adb0f0763065 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:43.082771 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3278da94-b5d4-4029-922d-adb0f0763065 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:43.083431 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3278da94-b5d4-4029-922d-adb0f0763065 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:43.165276 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-3278da94-b5d4-4029-922d-adb0f0763065 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3d2208faeb4421af21da56d455be92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b2b8b909c54f36b61d934d09607b5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:43.199457 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-566e3990-a0a2-453b-a3b4-89718c95f810 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:43.218462 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-566e3990-a0a2-453b-a3b4-89718c95f810 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578" status: 200 len: 1477 microversion: 2.1 time: 0.265399 Oct 27 03:21:43.218758 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3278da94-b5d4-4029-922d-adb0f0763065 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] 10.222.0.20 "GET /compute/v2.1/servers/936d578f-607c-4650-aac3-f06ef6fa7017" status: 200 len: 1271 microversion: 2.1 time: 0.144199 Oct 27 03:21:43.218758 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 163/328] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:43 2022] GET /compute/v2.1/servers/936d578f-607c-4650-aac3-f06ef6fa7017 => generated 1271 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:43.219719 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 166/329] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:42 2022] GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578 => generated 1477 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:43.356683 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-51c05a8e-c6bf-4846-9b86-dee2d5601012 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:43.358937 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-51c05a8e-c6bf-4846-9b86-dee2d5601012 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:43.365910 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-51c05a8e-c6bf-4846-9b86-dee2d5601012 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:43.366455 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-51c05a8e-c6bf-4846-9b86-dee2d5601012 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:43.369879 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-51c05a8e-c6bf-4846-9b86-dee2d5601012 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:43.369879 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-51c05a8e-c6bf-4846-9b86-dee2d5601012 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:43.369879 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-51c05a8e-c6bf-4846-9b86-dee2d5601012 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:43.369879 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-51c05a8e-c6bf-4846-9b86-dee2d5601012 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:43.444441 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-51c05a8e-c6bf-4846-9b86-dee2d5601012 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:43.454319 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-51c05a8e-c6bf-4846-9b86-dee2d5601012 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:43.456018 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-51c05a8e-c6bf-4846-9b86-dee2d5601012 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:43.461306 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:DELETE=6,nova_api:SELECT=85,nova_api:UPDATE=1,nova_api:INSERT=8 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:43.463620 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-51c05a8e-c6bf-4846-9b86-dee2d5601012 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1539 microversion: 2.91 time: 0.110755 Oct 27 03:21:43.475513 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 164/330] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:21:43 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1539 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:21:43.614886 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ca2beeeb-c660-47e4-8d5d-d555218ead2c tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:43.615765 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ca2beeeb-c660-47e4-8d5d-d555218ead2c tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] [instance: 4e4efa06-0a3c-4c11-849d-22bb8d9dccf8] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:43.622128 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ca2beeeb-c660-47e4-8d5d-d555218ead2c tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:43.622912 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ca2beeeb-c660-47e4-8d5d-d555218ead2c tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:43.623497 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ca2beeeb-c660-47e4-8d5d-d555218ead2c tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:43.624284 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ca2beeeb-c660-47e4-8d5d-d555218ead2c tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:43.624757 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ca2beeeb-c660-47e4-8d5d-d555218ead2c tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:43.625189 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ca2beeeb-c660-47e4-8d5d-d555218ead2c tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:43.778666 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ca2beeeb-c660-47e4-8d5d-d555218ead2c tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff070c0383324e1da5c49e3d9c652516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1da8ce26ab49ddae972233777c4c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:43.788153 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ca2beeeb-c660-47e4-8d5d-d555218ead2c tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] 10.222.0.20 "GET /compute/v2.1/servers/4e4efa06-0a3c-4c11-849d-22bb8d9dccf8" status: 200 len: 1319 microversion: 2.1 time: 0.177998 Oct 27 03:21:43.790740 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 167/331] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:43 2022] GET /compute/v2.1/servers/4e4efa06-0a3c-4c11-849d-22bb8d9dccf8 => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:44.238112 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-02be23cd-00be-4116-8e01-eee7e8ffef4d tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:44.239620 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-02be23cd-00be-4116-8e01-eee7e8ffef4d tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] [instance: 936d578f-607c-4650-aac3-f06ef6fa7017] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:44.239911 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-dc34ab4f-754f-4faf-8ea3-6e113e005491 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:44.241503 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-dc34ab4f-754f-4faf-8ea3-6e113e005491 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 5910c783-6877-4a41-8650-0973a11f3578] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:44.249992 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-02be23cd-00be-4116-8e01-eee7e8ffef4d tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:44.251095 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-02be23cd-00be-4116-8e01-eee7e8ffef4d tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:44.252177 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-02be23cd-00be-4116-8e01-eee7e8ffef4d tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:44.252630 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dc34ab4f-754f-4faf-8ea3-6e113e005491 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:44.253202 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dc34ab4f-754f-4faf-8ea3-6e113e005491 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:44.253532 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-02be23cd-00be-4116-8e01-eee7e8ffef4d tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:44.253939 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dc34ab4f-754f-4faf-8ea3-6e113e005491 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:44.254241 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-02be23cd-00be-4116-8e01-eee7e8ffef4d tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:44.255166 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dc34ab4f-754f-4faf-8ea3-6e113e005491 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:44.255659 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dc34ab4f-754f-4faf-8ea3-6e113e005491 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:44.257925 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dc34ab4f-754f-4faf-8ea3-6e113e005491 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:44.274742 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-02be23cd-00be-4116-8e01-eee7e8ffef4d tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:44.530346 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-02be23cd-00be-4116-8e01-eee7e8ffef4d tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3d2208faeb4421af21da56d455be92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b2b8b909c54f36b61d934d09607b5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:44.541570 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-02be23cd-00be-4116-8e01-eee7e8ffef4d tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] 10.222.0.20 "GET /compute/v2.1/servers/936d578f-607c-4650-aac3-f06ef6fa7017" status: 200 len: 1319 microversion: 2.1 time: 0.308760 Oct 27 03:21:44.544912 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 168/332] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:44 2022] GET /compute/v2.1/servers/936d578f-607c-4650-aac3-f06ef6fa7017 => generated 1319 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:21:44.566119 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-625b4564-6891-4f40-8fe9-02f223bf04d8 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:44.566782 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-625b4564-6891-4f40-8fe9-02f223bf04d8 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:44.568232 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-dc34ab4f-754f-4faf-8ea3-6e113e005491 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:44.575418 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-625b4564-6891-4f40-8fe9-02f223bf04d8 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:44.576126 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-625b4564-6891-4f40-8fe9-02f223bf04d8 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:44.576701 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-625b4564-6891-4f40-8fe9-02f223bf04d8 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:44.577505 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-625b4564-6891-4f40-8fe9-02f223bf04d8 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:44.578214 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-dc34ab4f-754f-4faf-8ea3-6e113e005491 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578" status: 200 len: 1477 microversion: 2.1 time: 0.345865 Oct 27 03:21:44.578443 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-625b4564-6891-4f40-8fe9-02f223bf04d8 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:44.579070 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-625b4564-6891-4f40-8fe9-02f223bf04d8 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:44.580946 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 165/333] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:44 2022] GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578 => generated 1477 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:44.681064 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-625b4564-6891-4f40-8fe9-02f223bf04d8 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:44.689938 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-625b4564-6891-4f40-8fe9-02f223bf04d8 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:44.692318 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-625b4564-6891-4f40-8fe9-02f223bf04d8 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:44.698070 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-625b4564-6891-4f40-8fe9-02f223bf04d8 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1539 microversion: 2.91 time: 0.144818 Oct 27 03:21:44.710057 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 169/334] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:21:44 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1539 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:21:44.811894 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-19f8e9e1-96ac-4013-9dd2-bd586a2e8ca3 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:44.812516 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-19f8e9e1-96ac-4013-9dd2-bd586a2e8ca3 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] [instance: 4e4efa06-0a3c-4c11-849d-22bb8d9dccf8] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:44.818657 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-19f8e9e1-96ac-4013-9dd2-bd586a2e8ca3 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:44.819051 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-19f8e9e1-96ac-4013-9dd2-bd586a2e8ca3 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:44.819538 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-19f8e9e1-96ac-4013-9dd2-bd586a2e8ca3 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:44.820245 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-19f8e9e1-96ac-4013-9dd2-bd586a2e8ca3 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:44.827096 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-19f8e9e1-96ac-4013-9dd2-bd586a2e8ca3 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:44.827096 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-19f8e9e1-96ac-4013-9dd2-bd586a2e8ca3 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:44.858453 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=4 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:45.074931 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-19f8e9e1-96ac-4013-9dd2-bd586a2e8ca3 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff070c0383324e1da5c49e3d9c652516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1da8ce26ab49ddae972233777c4c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:45.085617 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-19f8e9e1-96ac-4013-9dd2-bd586a2e8ca3 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] 10.222.0.20 "GET /compute/v2.1/servers/4e4efa06-0a3c-4c11-849d-22bb8d9dccf8" status: 200 len: 1319 microversion: 2.1 time: 0.277442 Oct 27 03:21:45.090350 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 166/335] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:44 2022] GET /compute/v2.1/servers/4e4efa06-0a3c-4c11-849d-22bb8d9dccf8 => generated 1319 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:21:45.420323 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-8f972fa4-c308-4289-b5f7-b48e95ffb2a5 req-39231331-55c5-4171-b4e4-95562df88a9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "936d578f-607c-4650-aac3-f06ef6fa7017", "tag": "95ac5197-dd73-4b11-ab34-6be4bf7c6fa6"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:21:45.436294 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-8f972fa4-c308-4289-b5f7-b48e95ffb2a5 req-39231331-55c5-4171-b4e4-95562df88a9e service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:45.437106 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-8f972fa4-c308-4289-b5f7-b48e95ffb2a5 req-39231331-55c5-4171-b4e4-95562df88a9e service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:45.438164 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-8f972fa4-c308-4289-b5f7-b48e95ffb2a5 req-39231331-55c5-4171-b4e4-95562df88a9e service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:45.458597 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-8f972fa4-c308-4289-b5f7-b48e95ffb2a5 req-39231331-55c5-4171-b4e4-95562df88a9e service nova] Creating event network-changed:95ac5197-dd73-4b11-ab34-6be4bf7c6fa6 for instance 936d578f-607c-4650-aac3-f06ef6fa7017 on n-h1-862769-1 Oct 27 03:21:45.467838 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-8f972fa4-c308-4289-b5f7-b48e95ffb2a5 req-39231331-55c5-4171-b4e4-95562df88a9e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051054 Oct 27 03:21:45.481567 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 170/336] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:21:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:21:45.570362 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8940a2bb-a4b4-4c84-af94-0d0fd013c8ab tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:45.572165 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8940a2bb-a4b4-4c84-af94-0d0fd013c8ab tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] [instance: 936d578f-607c-4650-aac3-f06ef6fa7017] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:45.574295 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=8 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:45.580624 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8940a2bb-a4b4-4c84-af94-0d0fd013c8ab tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:45.581947 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8940a2bb-a4b4-4c84-af94-0d0fd013c8ab tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:45.582571 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8940a2bb-a4b4-4c84-af94-0d0fd013c8ab tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:45.583439 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8940a2bb-a4b4-4c84-af94-0d0fd013c8ab tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:45.584047 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8940a2bb-a4b4-4c84-af94-0d0fd013c8ab tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:45.584624 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8940a2bb-a4b4-4c84-af94-0d0fd013c8ab tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:45.603938 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3142ddd4-04d9-4a44-9bfd-d6cc588b7da4 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:45.604647 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3142ddd4-04d9-4a44-9bfd-d6cc588b7da4 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 5910c783-6877-4a41-8650-0973a11f3578] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:45.616604 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3142ddd4-04d9-4a44-9bfd-d6cc588b7da4 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:45.617846 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3142ddd4-04d9-4a44-9bfd-d6cc588b7da4 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:45.620213 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3142ddd4-04d9-4a44-9bfd-d6cc588b7da4 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:45.623967 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3142ddd4-04d9-4a44-9bfd-d6cc588b7da4 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:45.623967 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3142ddd4-04d9-4a44-9bfd-d6cc588b7da4 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:45.623967 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3142ddd4-04d9-4a44-9bfd-d6cc588b7da4 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:45.820243 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3142ddd4-04d9-4a44-9bfd-d6cc588b7da4 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:45.830624 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3142ddd4-04d9-4a44-9bfd-d6cc588b7da4 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578" status: 200 len: 1477 microversion: 2.1 time: 0.230562 Oct 27 03:21:45.834078 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 171/337] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:45 2022] GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578 => generated 1477 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:21:45.841404 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-df9551c7-679f-4833-9e3a-418dfed2c3a7 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:45.853008 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-df9551c7-679f-4833-9e3a-418dfed2c3a7 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:45.867934 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-df9551c7-679f-4833-9e3a-418dfed2c3a7 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:45.871902 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-df9551c7-679f-4833-9e3a-418dfed2c3a7 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:45.874094 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-df9551c7-679f-4833-9e3a-418dfed2c3a7 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:45.875248 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-df9551c7-679f-4833-9e3a-418dfed2c3a7 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:45.877199 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-df9551c7-679f-4833-9e3a-418dfed2c3a7 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:45.879330 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-df9551c7-679f-4833-9e3a-418dfed2c3a7 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:45.917359 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=100 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:45.981600 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-df9551c7-679f-4833-9e3a-418dfed2c3a7 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:45.991458 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-df9551c7-679f-4833-9e3a-418dfed2c3a7 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:45.993091 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-df9551c7-679f-4833-9e3a-418dfed2c3a7 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:45.998207 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8940a2bb-a4b4-4c84-af94-0d0fd013c8ab tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3d2208faeb4421af21da56d455be92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b2b8b909c54f36b61d934d09607b5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:45.999900 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-df9551c7-679f-4833-9e3a-418dfed2c3a7 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1539 microversion: 2.91 time: 0.163106 Oct 27 03:21:46.000693 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 172/338] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:21:45 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1539 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:21:46.009582 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8940a2bb-a4b4-4c84-af94-0d0fd013c8ab tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] 10.222.0.20 "GET /compute/v2.1/servers/936d578f-607c-4650-aac3-f06ef6fa7017" status: 200 len: 1319 microversion: 2.1 time: 0.443959 Oct 27 03:21:46.018125 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 167/339] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:45 2022] GET /compute/v2.1/servers/936d578f-607c-4650-aac3-f06ef6fa7017 => generated 1319 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:46.117248 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b5455fda-9791-4b65-b396-3489a9423c44 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:46.118069 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b5455fda-9791-4b65-b396-3489a9423c44 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] [instance: 4e4efa06-0a3c-4c11-849d-22bb8d9dccf8] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:46.127767 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b5455fda-9791-4b65-b396-3489a9423c44 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:46.128967 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b5455fda-9791-4b65-b396-3489a9423c44 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:46.130507 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b5455fda-9791-4b65-b396-3489a9423c44 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:46.132140 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b5455fda-9791-4b65-b396-3489a9423c44 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:46.132809 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b5455fda-9791-4b65-b396-3489a9423c44 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:46.133501 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b5455fda-9791-4b65-b396-3489a9423c44 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:46.298301 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b5455fda-9791-4b65-b396-3489a9423c44 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff070c0383324e1da5c49e3d9c652516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1da8ce26ab49ddae972233777c4c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:46.308226 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b5455fda-9791-4b65-b396-3489a9423c44 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] 10.222.0.20 "GET /compute/v2.1/servers/4e4efa06-0a3c-4c11-849d-22bb8d9dccf8" status: 200 len: 1319 microversion: 2.1 time: 0.198163 Oct 27 03:21:46.318123 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 168/340] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:46 2022] GET /compute/v2.1/servers/4e4efa06-0a3c-4c11-849d-22bb8d9dccf8 => generated 1319 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:46.431326 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a2e02758-756c-407b-8355-0faa435d1d0f tempest-AZAdminNegativeTestJSON-631683991 tempest-AZAdminNegativeTestJSON-631683991-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:46.433578 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a2e02758-756c-407b-8355-0faa435d1d0f tempest-AZAdminNegativeTestJSON-631683991 tempest-AZAdminNegativeTestJSON-631683991-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '6b578dba0ba146d9a8e48d57814932eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3556f61432de40308762eef473ea4ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:46.438897 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a2e02758-756c-407b-8355-0faa435d1d0f tempest-AZAdminNegativeTestJSON-631683991 tempest-AZAdminNegativeTestJSON-631683991-project] Request method failure captured: Oct 27 03:21:46.438897 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Oct 27 03:21:46.438897 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:21:46.438897 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:21:46.438897 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:21:46.438897 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:21:46.438897 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:21:46.438897 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:21:46.438897 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:21:46.438897 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:21:46.438897 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWflHcgDS9BuC2NlH0bUOolfM7n9QW85KO50xg160ZEphbYxc-d926rMQDH7u-boL6zhaJhieITbFGsUbfFu9FkEbxYAiZZcMLrSpmoqx5mcwCVaAVADDqS5t2AIqSMQn1N43s5B5-ZdWyU7oY_x4eigZVVw6Gtz8AbYhBCwkXSTvSIk Oct 27 03:21:46.438897 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:21:46.438897 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:21:46.438897 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:21:46.438897 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:21:46.438897 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:21:46.438897 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:21:46.438897 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 3556f61432de40308762eef473ea4ce8 Oct 27 03:21:46.438897 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-AZAdminNegativeTestJSON-631683991 Oct 27 03:21:46.438897 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:21:46.438897 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:21:46.440115 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3556f61432de40308762eef473ea4ce8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3556f61432de40308762eef473ea4ce8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3556f61432de40308762eef473ea4ce8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3556f61432de40308762eef473ea4ce8"}]}] Oct 27 03:21:46.440115 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-AZAdminNegativeTestJSON-631683991 Oct 27 03:21:46.440115 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 3556f61432de40308762eef473ea4ce8 Oct 27 03:21:46.440115 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-631683991 Oct 27 03:21:46.440115 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-AZAdminNegativeTestJSON-631683991-project Oct 27 03:21:46.440115 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:21:46.440115 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:21:46.440115 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 6b578dba0ba146d9a8e48d57814932eb Oct 27 03:21:46.440115 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-AZAdminNegativeTestJSON-631683991-project Oct 27 03:21:46.440115 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:21:46.440115 n-d-862769-1 devstack@n-api.service[121001]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 27 03:21:46.440115 n-d-862769-1 devstack@n-api.service[121001]: action_args: {} Oct 27 03:21:46.440829 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:21:46.440829 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:21:46.440829 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:21:46.440829 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:21:46.440829 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:21:46.440829 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:21:46.440829 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:21:46.440829 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:21:46.440829 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Oct 27 03:21:46.440829 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Oct 27 03:21:46.440829 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 03:21:46.440829 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 03:21:46.440829 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 03:21:46.440829 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 03:21:46.440829 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 03:21:46.440829 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 03:21:46.440829 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 03:21:46.440829 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 03:21:46.440829 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 03:21:46.441845 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 03:21:46.441845 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 03:21:46.441845 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 03:21:46.441845 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 03:21:46.441845 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 03:21:46.441845 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 27 03:21:46.441845 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:21:46.441845 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:21:46.441845 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:21:46.441845 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:21:46.441845 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:21:46.441845 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:21:46.441845 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 03:21:46.441845 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 03:21:46.441845 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 27 03:21:46.441845 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:21:46.444080 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a2e02758-756c-407b-8355-0faa435d1d0f tempest-AZAdminNegativeTestJSON-631683991 tempest-AZAdminNegativeTestJSON-631683991-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:21:46.445467 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a2e02758-756c-407b-8355-0faa435d1d0f tempest-AZAdminNegativeTestJSON-631683991 tempest-AZAdminNegativeTestJSON-631683991-project] 10.222.0.20 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.433871 Oct 27 03:21:46.446441 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 173/341] 10.222.0.20 () {58 vars in 1185 bytes} [Thu Oct 27 03:21:46 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 445 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:21:46.872045 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ba1a619f-d860-44ad-8465-9a021c7581a4 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:46.872045 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ba1a619f-d860-44ad-8465-9a021c7581a4 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 5910c783-6877-4a41-8650-0973a11f3578] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:46.872045 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ba1a619f-d860-44ad-8465-9a021c7581a4 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:46.872957 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ba1a619f-d860-44ad-8465-9a021c7581a4 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:46.872957 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ba1a619f-d860-44ad-8465-9a021c7581a4 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:46.873978 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ba1a619f-d860-44ad-8465-9a021c7581a4 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:46.874465 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ba1a619f-d860-44ad-8465-9a021c7581a4 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:46.874896 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ba1a619f-d860-44ad-8465-9a021c7581a4 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:47.027177 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ba1a619f-d860-44ad-8465-9a021c7581a4 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:47.031177 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=100 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:47.035852 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ba1a619f-d860-44ad-8465-9a021c7581a4 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578" status: 200 len: 1477 microversion: 2.1 time: 0.177323 Oct 27 03:21:47.036474 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 169/342] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:46 2022] GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578 => generated 1477 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:47.045337 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1382d458-dcb7-44af-a77f-4bafb6bce492 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:47.046065 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1382d458-dcb7-44af-a77f-4bafb6bce492 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:47.056236 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1382d458-dcb7-44af-a77f-4bafb6bce492 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:47.056740 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1382d458-dcb7-44af-a77f-4bafb6bce492 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:47.057404 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1382d458-dcb7-44af-a77f-4bafb6bce492 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:47.061445 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1382d458-dcb7-44af-a77f-4bafb6bce492 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:47.061445 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1382d458-dcb7-44af-a77f-4bafb6bce492 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:47.061445 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1382d458-dcb7-44af-a77f-4bafb6bce492 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:47.134728 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1382d458-dcb7-44af-a77f-4bafb6bce492 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:47.155930 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1382d458-dcb7-44af-a77f-4bafb6bce492 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:47.158614 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1382d458-dcb7-44af-a77f-4bafb6bce492 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:47.167255 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1382d458-dcb7-44af-a77f-4bafb6bce492 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1539 microversion: 2.91 time: 0.129540 Oct 27 03:21:47.167933 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 170/343] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:21:47 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1539 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:21:47.177217 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b5a330c9-deec-4c6f-a21b-784beadc452b tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:47.177903 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b5a330c9-deec-4c6f-a21b-784beadc452b tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] [instance: 936d578f-607c-4650-aac3-f06ef6fa7017] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:47.184514 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b5a330c9-deec-4c6f-a21b-784beadc452b tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:47.185088 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b5a330c9-deec-4c6f-a21b-784beadc452b tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:47.186319 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b5a330c9-deec-4c6f-a21b-784beadc452b tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:47.187190 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b5a330c9-deec-4c6f-a21b-784beadc452b tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:47.187808 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b5a330c9-deec-4c6f-a21b-784beadc452b tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:47.188397 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b5a330c9-deec-4c6f-a21b-784beadc452b tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:47.440662 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b5a330c9-deec-4c6f-a21b-784beadc452b tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3d2208faeb4421af21da56d455be92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b2b8b909c54f36b61d934d09607b5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:47.453592 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b5a330c9-deec-4c6f-a21b-784beadc452b tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] 10.222.0.20 "GET /compute/v2.1/servers/936d578f-607c-4650-aac3-f06ef6fa7017" status: 200 len: 1319 microversion: 2.1 time: 0.284349 Oct 27 03:21:47.454965 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 171/344] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:47 2022] GET /compute/v2.1/servers/936d578f-607c-4650-aac3-f06ef6fa7017 => generated 1319 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:47.460317 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-93d8a908-fd05-456a-ad16-58867df710d5 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:47.460934 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-93d8a908-fd05-456a-ad16-58867df710d5 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] [instance: 4e4efa06-0a3c-4c11-849d-22bb8d9dccf8] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:47.465535 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-336013cb-c809-4a21-9755-b2c8612134c4 tempest-NetworksTest-1763262239 tempest-NetworksTest-1763262239-project-admin] Calling method '.version_select at 0x7f7ddb339310>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:47.468416 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-93d8a908-fd05-456a-ad16-58867df710d5 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:47.469136 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-93d8a908-fd05-456a-ad16-58867df710d5 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:47.469870 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-93d8a908-fd05-456a-ad16-58867df710d5 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:47.470765 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-93d8a908-fd05-456a-ad16-58867df710d5 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:47.471370 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-93d8a908-fd05-456a-ad16-58867df710d5 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:47.472024 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-93d8a908-fd05-456a-ad16-58867df710d5 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:47.746066 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-336013cb-c809-4a21-9755-b2c8612134c4 tempest-NetworksTest-1763262239 tempest-NetworksTest-1763262239-project-admin] 10.222.0.20 "GET /compute/v2.1/os-networks" status: 200 len: 1938 microversion: 2.1 time: 0.735166 Oct 27 03:21:47.747166 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 174/345] 10.222.0.20 () {58 vars in 1137 bytes} [Thu Oct 27 03:21:47 2022] GET /compute/v2.1/os-networks => generated 1938 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:21:47.755266 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a94423a6-4290-4cfb-8137-6ae11d9a08f2 tempest-NetworksTest-1763262239 tempest-NetworksTest-1763262239-project-admin] Calling method '.version_select at 0x7f7ddb1da700>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:47.888650 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a94423a6-4290-4cfb-8137-6ae11d9a08f2 tempest-NetworksTest-1763262239 tempest-NetworksTest-1763262239-project-admin] 10.222.0.20 "GET /compute/v2.1/os-networks/dd6710e4-668a-450b-b911-5422d980e3de" status: 200 len: 652 microversion: 2.1 time: 0.137201 Oct 27 03:21:47.889804 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 175/346] 10.222.0.20 () {58 vars in 1248 bytes} [Thu Oct 27 03:21:47 2022] GET /compute/v2.1/os-networks/dd6710e4-668a-450b-b911-5422d980e3de => generated 652 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:21:47.901271 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-45c63baa-c31e-4e89-9039-6fb033461e23 tempest-NetworksTest-1763262239 tempest-NetworksTest-1763262239-project-admin] Calling method '.version_select at 0x7f7ddb1daf70>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:47.938936 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-93d8a908-fd05-456a-ad16-58867df710d5 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff070c0383324e1da5c49e3d9c652516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1da8ce26ab49ddae972233777c4c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:47.952253 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-93d8a908-fd05-456a-ad16-58867df710d5 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] 10.222.0.20 "GET /compute/v2.1/servers/4e4efa06-0a3c-4c11-849d-22bb8d9dccf8" status: 200 len: 1319 microversion: 2.1 time: 0.494427 Oct 27 03:21:47.952419 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 172/347] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:47 2022] GET /compute/v2.1/servers/4e4efa06-0a3c-4c11-849d-22bb8d9dccf8 => generated 1319 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:47.978927 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-d87008af-045a-4115-8241-38a45ed4a3e0 req-7ca8f2ac-8d6c-4f35-93d7-0f2b2c681558 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e4efa06-0a3c-4c11-849d-22bb8d9dccf8", "name": "network-vif-plugged", "status": "completed", "tag": "2b593717-90ce-43e6-8ad3-7143ce5f9a4e"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:21:47.991010 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-d87008af-045a-4115-8241-38a45ed4a3e0 req-7ca8f2ac-8d6c-4f35-93d7-0f2b2c681558 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:47.997938 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-d87008af-045a-4115-8241-38a45ed4a3e0 req-7ca8f2ac-8d6c-4f35-93d7-0f2b2c681558 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:47.997938 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-d87008af-045a-4115-8241-38a45ed4a3e0 req-7ca8f2ac-8d6c-4f35-93d7-0f2b2c681558 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:48.010155 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-d87008af-045a-4115-8241-38a45ed4a3e0 req-7ca8f2ac-8d6c-4f35-93d7-0f2b2c681558 service nova] Creating event network-vif-plugged:2b593717-90ce-43e6-8ad3-7143ce5f9a4e for instance 4e4efa06-0a3c-4c11-849d-22bb8d9dccf8 on n-h2-862769-1 Oct 27 03:21:48.016996 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-d87008af-045a-4115-8241-38a45ed4a3e0 req-7ca8f2ac-8d6c-4f35-93d7-0f2b2c681558 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047743 Oct 27 03:21:48.018432 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 173/348] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:21:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:21:48.064093 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-fb868897-3e8a-4fd2-a9eb-29199ae840f1 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:48.064887 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-fb868897-3e8a-4fd2-a9eb-29199ae840f1 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 5910c783-6877-4a41-8650-0973a11f3578] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:48.077199 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fb868897-3e8a-4fd2-a9eb-29199ae840f1 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:48.077706 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fb868897-3e8a-4fd2-a9eb-29199ae840f1 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:48.078240 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fb868897-3e8a-4fd2-a9eb-29199ae840f1 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:48.078975 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fb868897-3e8a-4fd2-a9eb-29199ae840f1 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:48.079559 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fb868897-3e8a-4fd2-a9eb-29199ae840f1 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:48.080752 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fb868897-3e8a-4fd2-a9eb-29199ae840f1 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:48.289002 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-45c63baa-c31e-4e89-9039-6fb033461e23 tempest-NetworksTest-1763262239 tempest-NetworksTest-1763262239-project-admin] 10.222.0.20 "GET /compute/v2.1/os-networks" status: 200 len: 1938 microversion: 2.1 time: 0.392843 Oct 27 03:21:48.289872 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 176/349] 10.222.0.20 () {58 vars in 1137 bytes} [Thu Oct 27 03:21:47 2022] GET /compute/v2.1/os-networks => generated 1938 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:21:48.295496 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b543062b-aa47-4130-948e-9172c2cd76cd tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:48.296205 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b543062b-aa47-4130-948e-9172c2cd76cd tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:48.304379 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b543062b-aa47-4130-948e-9172c2cd76cd tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:48.304870 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b543062b-aa47-4130-948e-9172c2cd76cd tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:48.305312 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b543062b-aa47-4130-948e-9172c2cd76cd tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:48.306100 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b543062b-aa47-4130-948e-9172c2cd76cd tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:48.306722 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b543062b-aa47-4130-948e-9172c2cd76cd tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:48.307401 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b543062b-aa47-4130-948e-9172c2cd76cd tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:48.351497 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-fb868897-3e8a-4fd2-a9eb-29199ae840f1 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:48.368018 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-fb868897-3e8a-4fd2-a9eb-29199ae840f1 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578" status: 200 len: 1477 microversion: 2.1 time: 0.309473 Oct 27 03:21:48.369483 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 174/350] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:48 2022] GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578 => generated 1477 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:48.387190 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b543062b-aa47-4130-948e-9172c2cd76cd tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:48.398654 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b543062b-aa47-4130-948e-9172c2cd76cd tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:48.400323 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b543062b-aa47-4130-948e-9172c2cd76cd tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:48.405939 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b543062b-aa47-4130-948e-9172c2cd76cd tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1539 microversion: 2.91 time: 0.114894 Oct 27 03:21:48.406552 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 177/351] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:21:48 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1539 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:21:48.476359 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f2a11bdf-96b9-4e2e-b27d-d61ce3cde059 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:48.477092 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f2a11bdf-96b9-4e2e-b27d-d61ce3cde059 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] [instance: 936d578f-607c-4650-aac3-f06ef6fa7017] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:48.487493 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f2a11bdf-96b9-4e2e-b27d-d61ce3cde059 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:48.487493 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f2a11bdf-96b9-4e2e-b27d-d61ce3cde059 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:48.487493 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f2a11bdf-96b9-4e2e-b27d-d61ce3cde059 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:48.487493 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f2a11bdf-96b9-4e2e-b27d-d61ce3cde059 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:48.487967 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f2a11bdf-96b9-4e2e-b27d-d61ce3cde059 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:48.487967 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f2a11bdf-96b9-4e2e-b27d-d61ce3cde059 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:48.717510 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f2a11bdf-96b9-4e2e-b27d-d61ce3cde059 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3d2208faeb4421af21da56d455be92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b2b8b909c54f36b61d934d09607b5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:48.717510 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f2a11bdf-96b9-4e2e-b27d-d61ce3cde059 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] 10.222.0.20 "GET /compute/v2.1/servers/936d578f-607c-4650-aac3-f06ef6fa7017" status: 200 len: 1319 microversion: 2.1 time: 0.156658 Oct 27 03:21:48.717510 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 175/352] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:48 2022] GET /compute/v2.1/servers/936d578f-607c-4650-aac3-f06ef6fa7017 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:48.994102 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a124cd61-d494-4b82-b037-0cd653f6860e tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:48.994102 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a124cd61-d494-4b82-b037-0cd653f6860e tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] [instance: 4e4efa06-0a3c-4c11-849d-22bb8d9dccf8] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:48.994102 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a124cd61-d494-4b82-b037-0cd653f6860e tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:48.994102 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a124cd61-d494-4b82-b037-0cd653f6860e tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:48.995119 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a124cd61-d494-4b82-b037-0cd653f6860e tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:48.995119 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a124cd61-d494-4b82-b037-0cd653f6860e tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:48.995119 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a124cd61-d494-4b82-b037-0cd653f6860e tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:48.995119 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a124cd61-d494-4b82-b037-0cd653f6860e tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:49.129864 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a124cd61-d494-4b82-b037-0cd653f6860e tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff070c0383324e1da5c49e3d9c652516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1da8ce26ab49ddae972233777c4c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:49.140052 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a124cd61-d494-4b82-b037-0cd653f6860e tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] 10.222.0.20 "GET /compute/v2.1/servers/4e4efa06-0a3c-4c11-849d-22bb8d9dccf8" status: 200 len: 1319 microversion: 2.1 time: 0.163778 Oct 27 03:21:49.140620 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 178/353] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:48 2022] GET /compute/v2.1/servers/4e4efa06-0a3c-4c11-849d-22bb8d9dccf8 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:49.392543 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d1ca1a97-9dca-470c-8afe-5dbd11972054 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:49.393423 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d1ca1a97-9dca-470c-8afe-5dbd11972054 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 5910c783-6877-4a41-8650-0973a11f3578] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:49.401634 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d1ca1a97-9dca-470c-8afe-5dbd11972054 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:49.401634 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d1ca1a97-9dca-470c-8afe-5dbd11972054 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:49.402321 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d1ca1a97-9dca-470c-8afe-5dbd11972054 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:49.403682 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d1ca1a97-9dca-470c-8afe-5dbd11972054 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:49.404182 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d1ca1a97-9dca-470c-8afe-5dbd11972054 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:49.405822 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d1ca1a97-9dca-470c-8afe-5dbd11972054 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:49.461811 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0f7c2a05-ffc1-41db-aa1c-45ce48288f3e tempest-FlavorsExtraSpecsTestJSON-2072253636 tempest-FlavorsExtraSpecsTestJSON-2072253636-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-388904955", "ram": 512, "vcpus": 1, "disk": 10, "id": 1440859707, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:21:49.549948 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0f7c2a05-ffc1-41db-aa1c-45ce48288f3e tempest-FlavorsExtraSpecsTestJSON-2072253636 tempest-FlavorsExtraSpecsTestJSON-2072253636-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.280093 Oct 27 03:21:49.551508 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 176/354] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:21:49 2022] POST /compute/v2.1/flavors => generated 415 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:21:49.556666 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-eb1c78e9-319b-4673-b9e0-e009083edda9 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:49.557756 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-eb1c78e9-319b-4673-b9e0-e009083edda9 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:49.578976 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eb1c78e9-319b-4673-b9e0-e009083edda9 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:49.581017 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eb1c78e9-319b-4673-b9e0-e009083edda9 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:49.581880 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eb1c78e9-319b-4673-b9e0-e009083edda9 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:49.584163 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eb1c78e9-319b-4673-b9e0-e009083edda9 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:49.586304 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eb1c78e9-319b-4673-b9e0-e009083edda9 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:49.587798 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eb1c78e9-319b-4673-b9e0-e009083edda9 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:49.672529 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d1ca1a97-9dca-470c-8afe-5dbd11972054 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:49.682111 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d1ca1a97-9dca-470c-8afe-5dbd11972054 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578" status: 200 len: 1477 microversion: 2.1 time: 0.293576 Oct 27 03:21:49.708800 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 179/355] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:49 2022] GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578 => generated 1477 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:49.713585 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-eb1c78e9-319b-4673-b9e0-e009083edda9 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:49.714974 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-eeb62fe3-9a0d-4bc6-9355-eedd45e578fc tempest-FlavorsExtraSpecsTestJSON-2072253636 tempest-FlavorsExtraSpecsTestJSON-2072253636-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:21:49.726562 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-eb1c78e9-319b-4673-b9e0-e009083edda9 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:49.728022 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-eb1c78e9-319b-4673-b9e0-e009083edda9 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:49.745064 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-eb1c78e9-319b-4673-b9e0-e009083edda9 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1539 microversion: 2.91 time: 0.190914 Oct 27 03:21:49.746315 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 177/356] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:21:49 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1539 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:21:49.757994 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-542e42f4-1f6a-424a-8da0-1db0ccfb709d tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:49.759809 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-542e42f4-1f6a-424a-8da0-1db0ccfb709d tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] [instance: 936d578f-607c-4650-aac3-f06ef6fa7017] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:49.770733 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-542e42f4-1f6a-424a-8da0-1db0ccfb709d tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:49.771380 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-542e42f4-1f6a-424a-8da0-1db0ccfb709d tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:49.772016 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-542e42f4-1f6a-424a-8da0-1db0ccfb709d tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:49.772871 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-542e42f4-1f6a-424a-8da0-1db0ccfb709d tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:49.773641 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-542e42f4-1f6a-424a-8da0-1db0ccfb709d tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:49.774245 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-542e42f4-1f6a-424a-8da0-1db0ccfb709d tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:49.835290 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-eeb62fe3-9a0d-4bc6-9355-eedd45e578fc tempest-FlavorsExtraSpecsTestJSON-2072253636 tempest-FlavorsExtraSpecsTestJSON-2072253636-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/1440859707/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.125041 Oct 27 03:21:49.835915 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 180/357] 10.222.0.20 () {60 vars in 1224 bytes} [Thu Oct 27 03:21:49 2022] POST /compute/v2.1/flavors/1440859707/os-extra_specs => generated 66 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 03:21:50.102315 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-34d17bd9-7516-4f21-a954-cffd1e353369 tempest-FlavorsExtraSpecsTestJSON-1027000755 tempest-FlavorsExtraSpecsTestJSON-1027000755-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:50.112405 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-34d17bd9-7516-4f21-a954-cffd1e353369 tempest-FlavorsExtraSpecsTestJSON-1027000755 tempest-FlavorsExtraSpecsTestJSON-1027000755-project] 10.222.0.20 "GET /compute/v2.1/flavors/1440859707/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.267276 Oct 27 03:21:50.112981 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 181/358] 10.222.0.20 () {58 vars in 1203 bytes} [Thu Oct 27 03:21:49 2022] GET /compute/v2.1/flavors/1440859707/os-extra_specs => generated 66 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 03:21:50.129457 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c6b813ef-e1b5-4af9-a7ce-bfca194f3613 tempest-FlavorsExtraSpecsTestJSON-2072253636 tempest-FlavorsExtraSpecsTestJSON-2072253636-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:21:50.151374 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=6,nova_api:UPDATE=2,nova_api:DELETE=4,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:50.155725 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c6b813ef-e1b5-4af9-a7ce-bfca194f3613 tempest-FlavorsExtraSpecsTestJSON-2072253636 tempest-FlavorsExtraSpecsTestJSON-2072253636-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/1440859707/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.034401 Oct 27 03:21:50.156527 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 182/359] 10.222.0.20 () {60 vars in 1224 bytes} [Thu Oct 27 03:21:50 2022] POST /compute/v2.1/flavors/1440859707/os-extra_specs => generated 66 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 27 03:21:50.165634 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-dc9def5e-e2d4-44d5-8537-fb6590850157 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:50.166306 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-dc9def5e-e2d4-44d5-8537-fb6590850157 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] [instance: 4e4efa06-0a3c-4c11-849d-22bb8d9dccf8] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:50.172380 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dc9def5e-e2d4-44d5-8537-fb6590850157 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:50.172875 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dc9def5e-e2d4-44d5-8537-fb6590850157 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:50.173316 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dc9def5e-e2d4-44d5-8537-fb6590850157 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:50.174306 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dc9def5e-e2d4-44d5-8537-fb6590850157 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:50.174912 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dc9def5e-e2d4-44d5-8537-fb6590850157 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:50.175523 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dc9def5e-e2d4-44d5-8537-fb6590850157 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:50.211451 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-542e42f4-1f6a-424a-8da0-1db0ccfb709d tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3d2208faeb4421af21da56d455be92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b2b8b909c54f36b61d934d09607b5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:50.220298 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-542e42f4-1f6a-424a-8da0-1db0ccfb709d tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] 10.222.0.20 "GET /compute/v2.1/servers/936d578f-607c-4650-aac3-f06ef6fa7017" status: 200 len: 1319 microversion: 2.1 time: 0.472746 Oct 27 03:21:50.222747 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 178/360] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:49 2022] GET /compute/v2.1/servers/936d578f-607c-4650-aac3-f06ef6fa7017 => generated 1319 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:50.228608 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6354f531-2a88-48c7-8dff-d98a039dfc80 tempest-FlavorsExtraSpecsTestJSON-1027000755 tempest-FlavorsExtraSpecsTestJSON-1027000755-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:50.243360 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6354f531-2a88-48c7-8dff-d98a039dfc80 tempest-FlavorsExtraSpecsTestJSON-1027000755 tempest-FlavorsExtraSpecsTestJSON-1027000755-project] 10.222.0.20 "GET /compute/v2.1/flavors/1440859707/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.019184 Oct 27 03:21:50.244211 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 179/361] 10.222.0.20 () {58 vars in 1245 bytes} [Thu Oct 27 03:21:50 2022] GET /compute/v2.1/flavors/1440859707/os-extra_specs/hw:numa_nodes => generated 22 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 03:21:50.258060 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-43c15f34-019d-4071-bd90-bd4cad370e2c tempest-FlavorsExtraSpecsTestJSON-2072253636 tempest-FlavorsExtraSpecsTestJSON-2072253636-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:21:50.321383 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-43c15f34-019d-4071-bd90-bd4cad370e2c tempest-FlavorsExtraSpecsTestJSON-2072253636 tempest-FlavorsExtraSpecsTestJSON-2072253636-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/1440859707/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.068775 Oct 27 03:21:50.326270 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 180/362] 10.222.0.20 () {60 vars in 1224 bytes} [Thu Oct 27 03:21:50 2022] POST /compute/v2.1/flavors/1440859707/os-extra_specs => generated 66 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 03:21:50.336949 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7a6099c7-d07f-473e-864d-159a8f67c8f6 tempest-FlavorsExtraSpecsTestJSON-2072253636 tempest-FlavorsExtraSpecsTestJSON-2072253636-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:50.353705 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7a6099c7-d07f-473e-864d-159a8f67c8f6 tempest-FlavorsExtraSpecsTestJSON-2072253636 tempest-FlavorsExtraSpecsTestJSON-2072253636-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/1440859707/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.020997 Oct 27 03:21:50.361262 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 181/363] 10.222.0.20 () {58 vars in 1203 bytes} [Thu Oct 27 03:21:50 2022] GET /compute/v2.1/flavors/1440859707/os-extra_specs => generated 66 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 27 03:21:50.370727 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-33e9bec5-70a1-41cc-9646-e67dd265ca58 tempest-FlavorsExtraSpecsTestJSON-2072253636 tempest-FlavorsExtraSpecsTestJSON-2072253636-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:21:50.428144 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-dc9def5e-e2d4-44d5-8537-fb6590850157 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff070c0383324e1da5c49e3d9c652516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1da8ce26ab49ddae972233777c4c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:50.438792 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-dc9def5e-e2d4-44d5-8537-fb6590850157 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] 10.222.0.20 "GET /compute/v2.1/servers/4e4efa06-0a3c-4c11-849d-22bb8d9dccf8" status: 200 len: 1469 microversion: 2.1 time: 0.276756 Oct 27 03:21:50.440150 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 183/364] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:50 2022] GET /compute/v2.1/servers/4e4efa06-0a3c-4c11-849d-22bb8d9dccf8 => generated 1469 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:50.463558 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-eef73485-13e8-447e-b994-520681d782f4 tempest-DeleteServersAdminTestJSON-1504400761 tempest-DeleteServersAdminTestJSON-1504400761-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:21:50.468239 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-eef73485-13e8-447e-b994-520681d782f4 tempest-DeleteServersAdminTestJSON-1504400761 tempest-DeleteServersAdminTestJSON-1504400761-project-admin] [instance: 4e4efa06-0a3c-4c11-849d-22bb8d9dccf8] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:50.483321 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eef73485-13e8-447e-b994-520681d782f4 tempest-DeleteServersAdminTestJSON-1504400761 tempest-DeleteServersAdminTestJSON-1504400761-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:50.483321 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eef73485-13e8-447e-b994-520681d782f4 tempest-DeleteServersAdminTestJSON-1504400761 tempest-DeleteServersAdminTestJSON-1504400761-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:50.483321 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eef73485-13e8-447e-b994-520681d782f4 tempest-DeleteServersAdminTestJSON-1504400761 tempest-DeleteServersAdminTestJSON-1504400761-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:50.483321 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eef73485-13e8-447e-b994-520681d782f4 tempest-DeleteServersAdminTestJSON-1504400761 tempest-DeleteServersAdminTestJSON-1504400761-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:50.483642 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eef73485-13e8-447e-b994-520681d782f4 tempest-DeleteServersAdminTestJSON-1504400761 tempest-DeleteServersAdminTestJSON-1504400761-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:50.483642 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eef73485-13e8-447e-b994-520681d782f4 tempest-DeleteServersAdminTestJSON-1504400761 tempest-DeleteServersAdminTestJSON-1504400761-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:50.506809 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-33e9bec5-70a1-41cc-9646-e67dd265ca58 tempest-FlavorsExtraSpecsTestJSON-2072253636 tempest-FlavorsExtraSpecsTestJSON-2072253636-project-admin] 10.222.0.20 "PUT /compute/v2.1/flavors/1440859707/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.143155 Oct 27 03:21:50.512218 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 182/365] 10.222.0.20 () {60 vars in 1265 bytes} [Thu Oct 27 03:21:50 2022] PUT /compute/v2.1/flavors/1440859707/os-extra_specs/hw:numa_nodes => generated 22 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 03:21:50.518094 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-44e4016d-1f69-486a-a9a5-12458223dd5e tempest-FlavorsExtraSpecsTestJSON-2072253636 tempest-FlavorsExtraSpecsTestJSON-2072253636-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:50.528887 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-44e4016d-1f69-486a-a9a5-12458223dd5e tempest-FlavorsExtraSpecsTestJSON-2072253636 tempest-FlavorsExtraSpecsTestJSON-2072253636-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/1440859707/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.014854 Oct 27 03:21:50.529961 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 183/366] 10.222.0.20 () {58 vars in 1203 bytes} [Thu Oct 27 03:21:50 2022] GET /compute/v2.1/flavors/1440859707/os-extra_specs => generated 66 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 03:21:50.551149 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-89152b63-954c-4ac9-a1d3-bc1520246d76 tempest-FlavorsExtraSpecsTestJSON-2072253636 tempest-FlavorsExtraSpecsTestJSON-2072253636-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:50.723936 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-89152b63-954c-4ac9-a1d3-bc1520246d76 tempest-FlavorsExtraSpecsTestJSON-2072253636 tempest-FlavorsExtraSpecsTestJSON-2072253636-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1440859707/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.179879 Oct 27 03:21:50.724587 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 184/367] 10.222.0.20 () {58 vars in 1248 bytes} [Thu Oct 27 03:21:50 2022] DELETE /compute/v2.1/flavors/1440859707/os-extra_specs/hw:numa_nodes => generated 0 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 27 03:21:50.730218 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3c9f6704-d7b7-4882-9f17-667ee2930fae tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:50.730839 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-3c9f6704-d7b7-4882-9f17-667ee2930fae tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 5910c783-6877-4a41-8650-0973a11f3578] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:50.738424 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3c9f6704-d7b7-4882-9f17-667ee2930fae tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:50.739156 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3c9f6704-d7b7-4882-9f17-667ee2930fae tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:50.739852 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3c9f6704-d7b7-4882-9f17-667ee2930fae tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:50.740857 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3c9f6704-d7b7-4882-9f17-667ee2930fae tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:50.741479 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3c9f6704-d7b7-4882-9f17-667ee2930fae tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:50.742168 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3c9f6704-d7b7-4882-9f17-667ee2930fae tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:50.876024 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=8 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:50.878716 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-eef73485-13e8-447e-b994-520681d782f4 tempest-DeleteServersAdminTestJSON-1504400761 tempest-DeleteServersAdminTestJSON-1504400761-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/4e4efa06-0a3c-4c11-849d-22bb8d9dccf8/action" status: 202 len: 0 microversion: 2.1 time: 0.420078 Oct 27 03:21:50.879562 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 184/368] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:21:50 2022] POST /compute/v2.1/servers/4e4efa06-0a3c-4c11-849d-22bb8d9dccf8/action => generated 0 bytes in 422 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:21:50.884338 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f9d78972-b5a4-49e0-ae07-5eddaebc1634 tempest-FlavorsExtraSpecsTestJSON-2072253636 tempest-FlavorsExtraSpecsTestJSON-2072253636-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:50.974644 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f9d78972-b5a4-49e0-ae07-5eddaebc1634 tempest-FlavorsExtraSpecsTestJSON-2072253636 tempest-FlavorsExtraSpecsTestJSON-2072253636-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1440859707/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.093616 Oct 27 03:21:50.979516 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 185/369] 10.222.0.20 () {58 vars in 1248 bytes} [Thu Oct 27 03:21:50 2022] DELETE /compute/v2.1/flavors/1440859707/os-extra_specs/hw:cpu_policy => generated 0 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 27 03:21:50.986140 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-872424f7-6b79-4840-a3a5-bc68046d39c8 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:50.987552 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-872424f7-6b79-4840-a3a5-bc68046d39c8 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:50.998573 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-872424f7-6b79-4840-a3a5-bc68046d39c8 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:51.000398 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-872424f7-6b79-4840-a3a5-bc68046d39c8 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:51.000398 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-872424f7-6b79-4840-a3a5-bc68046d39c8 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:51.001216 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-872424f7-6b79-4840-a3a5-bc68046d39c8 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:51.002492 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-872424f7-6b79-4840-a3a5-bc68046d39c8 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:51.003894 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-872424f7-6b79-4840-a3a5-bc68046d39c8 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:51.060714 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-3c9f6704-d7b7-4882-9f17-667ee2930fae tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:51.068807 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3c9f6704-d7b7-4882-9f17-667ee2930fae tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578" status: 200 len: 1477 microversion: 2.1 time: 0.343037 Oct 27 03:21:51.069622 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 185/370] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:50 2022] GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578 => generated 1477 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:51.080739 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c79a961f-7a3f-4195-94f9-de1ea289c943 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:51.083090 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c79a961f-7a3f-4195-94f9-de1ea289c943 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] [instance: 4e4efa06-0a3c-4c11-849d-22bb8d9dccf8] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:51.095087 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-872424f7-6b79-4840-a3a5-bc68046d39c8 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:51.095245 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c79a961f-7a3f-4195-94f9-de1ea289c943 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:51.095245 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c79a961f-7a3f-4195-94f9-de1ea289c943 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:51.095245 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c79a961f-7a3f-4195-94f9-de1ea289c943 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:51.095490 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c79a961f-7a3f-4195-94f9-de1ea289c943 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:51.095875 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c79a961f-7a3f-4195-94f9-de1ea289c943 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:51.096317 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c79a961f-7a3f-4195-94f9-de1ea289c943 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:51.099532 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-872424f7-6b79-4840-a3a5-bc68046d39c8 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:51.101496 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-872424f7-6b79-4840-a3a5-bc68046d39c8 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:51.117200 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-872424f7-6b79-4840-a3a5-bc68046d39c8 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1539 microversion: 2.91 time: 0.135724 Oct 27 03:21:51.135842 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 186/371] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:21:50 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1539 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:21:51.147786 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-cc920636-2636-4dab-ac2b-f17ecdff96db tempest-FlavorsExtraSpecsTestJSON-2072253636 tempest-FlavorsExtraSpecsTestJSON-2072253636-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:51.158324 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-cc920636-2636-4dab-ac2b-f17ecdff96db tempest-FlavorsExtraSpecsTestJSON-2072253636 tempest-FlavorsExtraSpecsTestJSON-2072253636-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/1440859707/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.037530 Oct 27 03:21:51.159450 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 187/372] 10.222.0.20 () {58 vars in 1203 bytes} [Thu Oct 27 03:21:51 2022] GET /compute/v2.1/flavors/1440859707/os-extra_specs => generated 19 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 03:21:51.171902 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b1b869fe-fc32-41af-8029-c74963914327 tempest-FlavorsExtraSpecsTestJSON-2072253636 tempest-FlavorsExtraSpecsTestJSON-2072253636-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:51.186727 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c79a961f-7a3f-4195-94f9-de1ea289c943 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:51.187234 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c79a961f-7a3f-4195-94f9-de1ea289c943 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:51.187982 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c79a961f-7a3f-4195-94f9-de1ea289c943 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:51.188148 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-c79a961f-7a3f-4195-94f9-de1ea289c943 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lazy-loading 'fault' on Instance uuid 4e4efa06-0a3c-4c11-849d-22bb8d9dccf8 {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:21:51.313948 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b1b869fe-fc32-41af-8029-c74963914327 tempest-FlavorsExtraSpecsTestJSON-2072253636 tempest-FlavorsExtraSpecsTestJSON-2072253636-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1440859707" status: 202 len: 0 microversion: 2.1 time: 0.147711 Oct 27 03:21:51.314626 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 188/373] 10.222.0.20 () {58 vars in 1161 bytes} [Thu Oct 27 03:21:51 2022] DELETE /compute/v2.1/flavors/1440859707 => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 03:21:51.321213 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-688e9e02-15f7-4620-b5ce-40b7c4d575b5 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:51.322018 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-688e9e02-15f7-4620-b5ce-40b7c4d575b5 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] [instance: 936d578f-607c-4650-aac3-f06ef6fa7017] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:51.342500 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-688e9e02-15f7-4620-b5ce-40b7c4d575b5 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:51.343044 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-688e9e02-15f7-4620-b5ce-40b7c4d575b5 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:51.343497 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-688e9e02-15f7-4620-b5ce-40b7c4d575b5 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:51.344283 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-688e9e02-15f7-4620-b5ce-40b7c4d575b5 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:51.344750 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-688e9e02-15f7-4620-b5ce-40b7c4d575b5 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:51.345185 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-688e9e02-15f7-4620-b5ce-40b7c4d575b5 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:51.393728 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=14 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:51.482101 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c79a961f-7a3f-4195-94f9-de1ea289c943 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff070c0383324e1da5c49e3d9c652516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1da8ce26ab49ddae972233777c4c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:51.498520 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c79a961f-7a3f-4195-94f9-de1ea289c943 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] 10.222.0.20 "GET /compute/v2.1/servers/4e4efa06-0a3c-4c11-849d-22bb8d9dccf8" status: 200 len: 1452 microversion: 2.1 time: 0.415699 Oct 27 03:21:51.499584 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 186/374] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:51 2022] GET /compute/v2.1/servers/4e4efa06-0a3c-4c11-849d-22bb8d9dccf8 => generated 1452 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:51.507817 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0b32ae1e-2d5a-4801-b43e-c58e2612d515 tempest-FlavorsExtraSpecsTestJSON-2072253636 tempest-FlavorsExtraSpecsTestJSON-2072253636-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:51.552761 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0b32ae1e-2d5a-4801-b43e-c58e2612d515 tempest-FlavorsExtraSpecsTestJSON-2072253636 tempest-FlavorsExtraSpecsTestJSON-2072253636-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.051647 Oct 27 03:21:51.553870 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 187/375] 10.222.0.20 () {58 vars in 1146 bytes} [Thu Oct 27 03:21:51 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:51.559252 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-966c9fcc-551c-456a-bac5-88a00bafeae3 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:51.559958 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-966c9fcc-551c-456a-bac5-88a00bafeae3 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] [instance: 4e4efa06-0a3c-4c11-849d-22bb8d9dccf8] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:51.584069 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-966c9fcc-551c-456a-bac5-88a00bafeae3 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:51.584625 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-966c9fcc-551c-456a-bac5-88a00bafeae3 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:51.585069 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-966c9fcc-551c-456a-bac5-88a00bafeae3 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:51.585792 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-966c9fcc-551c-456a-bac5-88a00bafeae3 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:51.587158 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-966c9fcc-551c-456a-bac5-88a00bafeae3 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:51.587599 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-966c9fcc-551c-456a-bac5-88a00bafeae3 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:51.658301 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-966c9fcc-551c-456a-bac5-88a00bafeae3 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] [instance: 4e4efa06-0a3c-4c11-849d-22bb8d9dccf8] Going to try to terminate instance {{(pid=121000) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:21:51.764550 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-688e9e02-15f7-4620-b5ce-40b7c4d575b5 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3d2208faeb4421af21da56d455be92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b2b8b909c54f36b61d934d09607b5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:51.774859 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-688e9e02-15f7-4620-b5ce-40b7c4d575b5 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] 10.222.0.20 "GET /compute/v2.1/servers/936d578f-607c-4650-aac3-f06ef6fa7017" status: 200 len: 1319 microversion: 2.1 time: 0.458979 Oct 27 03:21:51.775766 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 189/376] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:51 2022] GET /compute/v2.1/servers/936d578f-607c-4650-aac3-f06ef6fa7017 => generated 1319 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:51.822623 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-84f30a3a-148b-4cf3-8874-c5bd6a66812a req-df2379b8-0d6b-49a5-b1ff-d98f5fb99c1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "936d578f-607c-4650-aac3-f06ef6fa7017", "name": "network-vif-plugged", "status": "completed", "tag": "95ac5197-dd73-4b11-ab34-6be4bf7c6fa6"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:21:51.834442 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-84f30a3a-148b-4cf3-8874-c5bd6a66812a req-df2379b8-0d6b-49a5-b1ff-d98f5fb99c1c service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:51.835626 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-84f30a3a-148b-4cf3-8874-c5bd6a66812a req-df2379b8-0d6b-49a5-b1ff-d98f5fb99c1c service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:51.836145 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-84f30a3a-148b-4cf3-8874-c5bd6a66812a req-df2379b8-0d6b-49a5-b1ff-d98f5fb99c1c service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:51.848589 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-84f30a3a-148b-4cf3-8874-c5bd6a66812a req-df2379b8-0d6b-49a5-b1ff-d98f5fb99c1c service nova] Creating event network-vif-plugged:95ac5197-dd73-4b11-ab34-6be4bf7c6fa6 for instance 936d578f-607c-4650-aac3-f06ef6fa7017 on n-h1-862769-1 Oct 27 03:21:51.855403 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-84f30a3a-148b-4cf3-8874-c5bd6a66812a req-df2379b8-0d6b-49a5-b1ff-d98f5fb99c1c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037407 Oct 27 03:21:51.856464 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 190/377] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:21:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:21:52.083295 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-966c9fcc-551c-456a-bac5-88a00bafeae3 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4e4efa06-0a3c-4c11-849d-22bb8d9dccf8" status: 204 len: 0 microversion: 2.1 time: 0.527974 Oct 27 03:21:52.085267 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 188/378] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:21:51 2022] DELETE /compute/v2.1/servers/4e4efa06-0a3c-4c11-849d-22bb8d9dccf8 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:21:52.105016 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8962823c-12f4-45fe-8449-ea72f8cf8d91 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:52.106508 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8962823c-12f4-45fe-8449-ea72f8cf8d91 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] [instance: 4e4efa06-0a3c-4c11-849d-22bb8d9dccf8] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:52.112082 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e82907b6-05bb-4c22-8263-227e0f23ad60 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:52.112798 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e82907b6-05bb-4c22-8263-227e0f23ad60 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 5910c783-6877-4a41-8650-0973a11f3578] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:52.126068 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e82907b6-05bb-4c22-8263-227e0f23ad60 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:52.137727 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8962823c-12f4-45fe-8449-ea72f8cf8d91 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:52.139364 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e82907b6-05bb-4c22-8263-227e0f23ad60 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:52.139816 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e82907b6-05bb-4c22-8263-227e0f23ad60 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:52.140574 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e82907b6-05bb-4c22-8263-227e0f23ad60 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:52.143261 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8962823c-12f4-45fe-8449-ea72f8cf8d91 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:52.144059 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8962823c-12f4-45fe-8449-ea72f8cf8d91 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:52.145342 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8962823c-12f4-45fe-8449-ea72f8cf8d91 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:52.145737 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e82907b6-05bb-4c22-8263-227e0f23ad60 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:52.146346 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e82907b6-05bb-4c22-8263-227e0f23ad60 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:52.148223 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8962823c-12f4-45fe-8449-ea72f8cf8d91 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:52.152251 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8962823c-12f4-45fe-8449-ea72f8cf8d91 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:52.204950 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8962823c-12f4-45fe-8449-ea72f8cf8d91 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:52.205721 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8962823c-12f4-45fe-8449-ea72f8cf8d91 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:52.206449 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8962823c-12f4-45fe-8449-ea72f8cf8d91 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:52.207310 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-8962823c-12f4-45fe-8449-ea72f8cf8d91 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lazy-loading 'fault' on Instance uuid 4e4efa06-0a3c-4c11-849d-22bb8d9dccf8 {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:21:52.394695 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e82907b6-05bb-4c22-8263-227e0f23ad60 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:52.405486 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e82907b6-05bb-4c22-8263-227e0f23ad60 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578" status: 200 len: 1477 microversion: 2.1 time: 0.309450 Oct 27 03:21:52.406572 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 189/379] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:52 2022] GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578 => generated 1477 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:52.411813 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-89bcbc63-c69c-473c-8b56-a1ab056d243a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:52.412680 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-89bcbc63-c69c-473c-8b56-a1ab056d243a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:52.422474 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-89bcbc63-c69c-473c-8b56-a1ab056d243a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:52.423129 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-89bcbc63-c69c-473c-8b56-a1ab056d243a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:52.423735 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-89bcbc63-c69c-473c-8b56-a1ab056d243a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:52.432459 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-89bcbc63-c69c-473c-8b56-a1ab056d243a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:52.432966 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-89bcbc63-c69c-473c-8b56-a1ab056d243a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:52.433411 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-89bcbc63-c69c-473c-8b56-a1ab056d243a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:52.534807 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-89bcbc63-c69c-473c-8b56-a1ab056d243a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:52.542968 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-89bcbc63-c69c-473c-8b56-a1ab056d243a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:52.544454 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-89bcbc63-c69c-473c-8b56-a1ab056d243a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:52.549561 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-89bcbc63-c69c-473c-8b56-a1ab056d243a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1539 microversion: 2.91 time: 0.141425 Oct 27 03:21:52.550516 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 190/380] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:21:52 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1539 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:21:52.562600 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8962823c-12f4-45fe-8449-ea72f8cf8d91 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff070c0383324e1da5c49e3d9c652516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1da8ce26ab49ddae972233777c4c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:52.570409 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8962823c-12f4-45fe-8449-ea72f8cf8d91 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] 10.222.0.20 "GET /compute/v2.1/servers/4e4efa06-0a3c-4c11-849d-22bb8d9dccf8" status: 200 len: 1458 microversion: 2.1 time: 0.480561 Oct 27 03:21:52.571361 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 191/381] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:52 2022] GET /compute/v2.1/servers/4e4efa06-0a3c-4c11-849d-22bb8d9dccf8 => generated 1458 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:52.802593 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8aea428a-d6f8-4d05-bb7c-cf8317d89497 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:52.805981 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8aea428a-d6f8-4d05-bb7c-cf8317d89497 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] [instance: 936d578f-607c-4650-aac3-f06ef6fa7017] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:52.814801 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8aea428a-d6f8-4d05-bb7c-cf8317d89497 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:52.815613 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8aea428a-d6f8-4d05-bb7c-cf8317d89497 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:52.816551 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8aea428a-d6f8-4d05-bb7c-cf8317d89497 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:52.817566 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8aea428a-d6f8-4d05-bb7c-cf8317d89497 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:52.818212 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8aea428a-d6f8-4d05-bb7c-cf8317d89497 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:52.818814 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8aea428a-d6f8-4d05-bb7c-cf8317d89497 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:53.022167 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8aea428a-d6f8-4d05-bb7c-cf8317d89497 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3d2208faeb4421af21da56d455be92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b2b8b909c54f36b61d934d09607b5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:53.034425 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8aea428a-d6f8-4d05-bb7c-cf8317d89497 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] 10.222.0.20 "GET /compute/v2.1/servers/936d578f-607c-4650-aac3-f06ef6fa7017" status: 200 len: 1319 microversion: 2.1 time: 0.237539 Oct 27 03:21:53.050778 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 191/382] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:52 2022] GET /compute/v2.1/servers/936d578f-607c-4650-aac3-f06ef6fa7017 => generated 1319 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:53.436827 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-82bcf322-941b-42d3-a9ca-5266821b7806 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:53.436827 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-82bcf322-941b-42d3-a9ca-5266821b7806 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 5910c783-6877-4a41-8650-0973a11f3578] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:53.451263 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-82bcf322-941b-42d3-a9ca-5266821b7806 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:53.451915 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-82bcf322-941b-42d3-a9ca-5266821b7806 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:53.452516 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-82bcf322-941b-42d3-a9ca-5266821b7806 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:53.454673 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-82bcf322-941b-42d3-a9ca-5266821b7806 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:53.456260 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-82bcf322-941b-42d3-a9ca-5266821b7806 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:53.458520 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-82bcf322-941b-42d3-a9ca-5266821b7806 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:53.577064 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f053c8a0-268c-41cf-8ae1-bd9cd4d8e66a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:53.577838 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f053c8a0-268c-41cf-8ae1-bd9cd4d8e66a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:53.589918 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f053c8a0-268c-41cf-8ae1-bd9cd4d8e66a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:53.590789 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f053c8a0-268c-41cf-8ae1-bd9cd4d8e66a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:53.591453 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f053c8a0-268c-41cf-8ae1-bd9cd4d8e66a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:53.594593 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f053c8a0-268c-41cf-8ae1-bd9cd4d8e66a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:53.595248 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f053c8a0-268c-41cf-8ae1-bd9cd4d8e66a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:53.597271 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f053c8a0-268c-41cf-8ae1-bd9cd4d8e66a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:53.683556 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-82bcf322-941b-42d3-a9ca-5266821b7806 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:53.696994 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-82bcf322-941b-42d3-a9ca-5266821b7806 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578" status: 200 len: 1477 microversion: 2.1 time: 0.265925 Oct 27 03:21:53.698206 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 192/383] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:53 2022] GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578 => generated 1477 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:53.716474 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-181b35ba-edba-49c1-82c1-67294dde2e3b tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:53.717946 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-181b35ba-edba-49c1-82c1-67294dde2e3b tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] [instance: 4e4efa06-0a3c-4c11-849d-22bb8d9dccf8] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:53.725705 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-181b35ba-edba-49c1-82c1-67294dde2e3b tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:53.726494 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-181b35ba-edba-49c1-82c1-67294dde2e3b tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:53.730944 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-181b35ba-edba-49c1-82c1-67294dde2e3b tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:53.730944 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-181b35ba-edba-49c1-82c1-67294dde2e3b tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:53.730944 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-181b35ba-edba-49c1-82c1-67294dde2e3b tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:53.730944 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-181b35ba-edba-49c1-82c1-67294dde2e3b tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:53.771312 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-181b35ba-edba-49c1-82c1-67294dde2e3b tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:53.772192 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-181b35ba-edba-49c1-82c1-67294dde2e3b tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:53.772763 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-181b35ba-edba-49c1-82c1-67294dde2e3b tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:53.773438 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-181b35ba-edba-49c1-82c1-67294dde2e3b tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lazy-loading 'fault' on Instance uuid 4e4efa06-0a3c-4c11-849d-22bb8d9dccf8 {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:21:53.935251 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-181b35ba-edba-49c1-82c1-67294dde2e3b tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff070c0383324e1da5c49e3d9c652516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1da8ce26ab49ddae972233777c4c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:53.946519 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-181b35ba-edba-49c1-82c1-67294dde2e3b tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] 10.222.0.20 "GET /compute/v2.1/servers/4e4efa06-0a3c-4c11-849d-22bb8d9dccf8" status: 200 len: 1458 microversion: 2.1 time: 0.245735 Oct 27 03:21:53.947420 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 193/384] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:53 2022] GET /compute/v2.1/servers/4e4efa06-0a3c-4c11-849d-22bb8d9dccf8 => generated 1458 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:54.014214 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f053c8a0-268c-41cf-8ae1-bd9cd4d8e66a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:54.023523 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f053c8a0-268c-41cf-8ae1-bd9cd4d8e66a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:54.027400 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f053c8a0-268c-41cf-8ae1-bd9cd4d8e66a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:54.031543 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f053c8a0-268c-41cf-8ae1-bd9cd4d8e66a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1539 microversion: 2.91 time: 0.458579 Oct 27 03:21:54.032724 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 192/385] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:21:53 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1539 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:21:54.060512 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2f44e5ef-6f4a-4dbc-be21-b621eea362d6 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:54.060512 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2f44e5ef-6f4a-4dbc-be21-b621eea362d6 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] [instance: 936d578f-607c-4650-aac3-f06ef6fa7017] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:54.071442 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2f44e5ef-6f4a-4dbc-be21-b621eea362d6 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:54.072073 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2f44e5ef-6f4a-4dbc-be21-b621eea362d6 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:54.072516 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2f44e5ef-6f4a-4dbc-be21-b621eea362d6 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:54.073219 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2f44e5ef-6f4a-4dbc-be21-b621eea362d6 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:54.075942 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2f44e5ef-6f4a-4dbc-be21-b621eea362d6 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:54.077118 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2f44e5ef-6f4a-4dbc-be21-b621eea362d6 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:54.309257 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2f44e5ef-6f4a-4dbc-be21-b621eea362d6 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3d2208faeb4421af21da56d455be92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b2b8b909c54f36b61d934d09607b5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:54.317267 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2f44e5ef-6f4a-4dbc-be21-b621eea362d6 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] 10.222.0.20 "GET /compute/v2.1/servers/936d578f-607c-4650-aac3-f06ef6fa7017" status: 200 len: 1469 microversion: 2.1 time: 0.261377 Oct 27 03:21:54.317841 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 194/386] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:54 2022] GET /compute/v2.1/servers/936d578f-607c-4650-aac3-f06ef6fa7017 => generated 1469 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:54.341176 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1976f1e5-1478-443f-8681-3abbccd69569 tempest-LiveMigrationNegativeTest-1769348670 tempest-LiveMigrationNegativeTest-1769348670-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:21:54.342873 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1976f1e5-1478-443f-8681-3abbccd69569 tempest-LiveMigrationNegativeTest-1769348670 tempest-LiveMigrationNegativeTest-1769348670-project-admin] [instance: 936d578f-607c-4650-aac3-f06ef6fa7017] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:54.350912 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=1,nova_api:SAVEPOINT=5,nova_api:RELEASE=5,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:54.353198 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1976f1e5-1478-443f-8681-3abbccd69569 tempest-LiveMigrationNegativeTest-1769348670 tempest-LiveMigrationNegativeTest-1769348670-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:54.353933 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1976f1e5-1478-443f-8681-3abbccd69569 tempest-LiveMigrationNegativeTest-1769348670 tempest-LiveMigrationNegativeTest-1769348670-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:54.354863 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1976f1e5-1478-443f-8681-3abbccd69569 tempest-LiveMigrationNegativeTest-1769348670 tempest-LiveMigrationNegativeTest-1769348670-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:54.356036 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1976f1e5-1478-443f-8681-3abbccd69569 tempest-LiveMigrationNegativeTest-1769348670 tempest-LiveMigrationNegativeTest-1769348670-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:54.356699 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1976f1e5-1478-443f-8681-3abbccd69569 tempest-LiveMigrationNegativeTest-1769348670 tempest-LiveMigrationNegativeTest-1769348670-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:54.358592 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1976f1e5-1478-443f-8681-3abbccd69569 tempest-LiveMigrationNegativeTest-1769348670 tempest-LiveMigrationNegativeTest-1769348670-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:54.392570 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:54.453486 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-1976f1e5-1478-443f-8681-3abbccd69569 tempest-LiveMigrationNegativeTest-1769348670 tempest-LiveMigrationNegativeTest-1769348670-project-admin] Lazy-loading 'flavor' on Instance uuid 936d578f-607c-4650-aac3-f06ef6fa7017 {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:21:54.724029 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1976f1e5-1478-443f-8681-3abbccd69569 tempest-LiveMigrationNegativeTest-1769348670 tempest-LiveMigrationNegativeTest-1769348670-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/936d578f-607c-4650-aac3-f06ef6fa7017/action" status: 202 len: 0 microversion: 2.1 time: 0.375372 Oct 27 03:21:54.724029 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 193/387] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:21:54 2022] POST /compute/v2.1/servers/936d578f-607c-4650-aac3-f06ef6fa7017/action => generated 0 bytes in 377 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:21:54.729725 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-90cb193e-4943-4d93-9d07-29152a3c824c tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:54.730510 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-90cb193e-4943-4d93-9d07-29152a3c824c tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] [instance: 936d578f-607c-4650-aac3-f06ef6fa7017] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:54.733862 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6d20bd60-9b81-49d4-97f6-73166ed2d787 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:54.735322 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-6d20bd60-9b81-49d4-97f6-73166ed2d787 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 5910c783-6877-4a41-8650-0973a11f3578] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:54.740848 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-90cb193e-4943-4d93-9d07-29152a3c824c tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:54.741349 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-90cb193e-4943-4d93-9d07-29152a3c824c tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:54.741783 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-90cb193e-4943-4d93-9d07-29152a3c824c tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:54.743234 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-90cb193e-4943-4d93-9d07-29152a3c824c tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:54.744360 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-90cb193e-4943-4d93-9d07-29152a3c824c tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:54.745644 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-90cb193e-4943-4d93-9d07-29152a3c824c tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:54.751551 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6d20bd60-9b81-49d4-97f6-73166ed2d787 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:54.752233 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6d20bd60-9b81-49d4-97f6-73166ed2d787 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:54.753702 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6d20bd60-9b81-49d4-97f6-73166ed2d787 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:54.759176 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6d20bd60-9b81-49d4-97f6-73166ed2d787 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:54.759176 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6d20bd60-9b81-49d4-97f6-73166ed2d787 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:54.759687 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6d20bd60-9b81-49d4-97f6-73166ed2d787 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:54.952402 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6d20bd60-9b81-49d4-97f6-73166ed2d787 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:54.961878 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6d20bd60-9b81-49d4-97f6-73166ed2d787 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578" status: 200 len: 1477 microversion: 2.1 time: 0.241061 Oct 27 03:21:54.962853 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 195/388] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:54 2022] GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578 => generated 1477 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:54.981696 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f6ab9d42-5a0f-49ff-a71f-3bde359a4630 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:54.983172 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f6ab9d42-5a0f-49ff-a71f-3bde359a4630 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] [instance: 4e4efa06-0a3c-4c11-849d-22bb8d9dccf8] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:54.992544 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f6ab9d42-5a0f-49ff-a71f-3bde359a4630 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:54.995853 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f6ab9d42-5a0f-49ff-a71f-3bde359a4630 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:54.995853 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f6ab9d42-5a0f-49ff-a71f-3bde359a4630 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:54.995853 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f6ab9d42-5a0f-49ff-a71f-3bde359a4630 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:54.995853 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f6ab9d42-5a0f-49ff-a71f-3bde359a4630 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:54.996235 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f6ab9d42-5a0f-49ff-a71f-3bde359a4630 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:55.034351 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f6ab9d42-5a0f-49ff-a71f-3bde359a4630 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:55.034922 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f6ab9d42-5a0f-49ff-a71f-3bde359a4630 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:55.035544 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f6ab9d42-5a0f-49ff-a71f-3bde359a4630 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:55.036121 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-f6ab9d42-5a0f-49ff-a71f-3bde359a4630 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lazy-loading 'fault' on Instance uuid 4e4efa06-0a3c-4c11-849d-22bb8d9dccf8 {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:21:55.199350 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f6ab9d42-5a0f-49ff-a71f-3bde359a4630 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff070c0383324e1da5c49e3d9c652516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1da8ce26ab49ddae972233777c4c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:55.208567 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f6ab9d42-5a0f-49ff-a71f-3bde359a4630 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] 10.222.0.20 "GET /compute/v2.1/servers/4e4efa06-0a3c-4c11-849d-22bb8d9dccf8" status: 200 len: 1458 microversion: 2.1 time: 0.232083 Oct 27 03:21:55.209145 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 196/389] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:54 2022] GET /compute/v2.1/servers/4e4efa06-0a3c-4c11-849d-22bb8d9dccf8 => generated 1458 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:21:55.214547 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-98b31c3c-bca7-4a9a-882a-341b35abfce9 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:55.217573 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-98b31c3c-bca7-4a9a-882a-341b35abfce9 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:55.224615 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-98b31c3c-bca7-4a9a-882a-341b35abfce9 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:55.225124 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-98b31c3c-bca7-4a9a-882a-341b35abfce9 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:55.225562 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-98b31c3c-bca7-4a9a-882a-341b35abfce9 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:55.226296 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-98b31c3c-bca7-4a9a-882a-341b35abfce9 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:55.226899 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-98b31c3c-bca7-4a9a-882a-341b35abfce9 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:55.227563 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-98b31c3c-bca7-4a9a-882a-341b35abfce9 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:55.250527 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:55.313815 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-98b31c3c-bca7-4a9a-882a-341b35abfce9 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:55.327179 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-98b31c3c-bca7-4a9a-882a-341b35abfce9 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:55.328910 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-98b31c3c-bca7-4a9a-882a-341b35abfce9 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:55.334380 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-98b31c3c-bca7-4a9a-882a-341b35abfce9 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1539 microversion: 2.91 time: 0.124035 Oct 27 03:21:55.338288 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 197/390] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:21:55 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1539 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:21:55.350687 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-90cb193e-4943-4d93-9d07-29152a3c824c tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3d2208faeb4421af21da56d455be92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b2b8b909c54f36b61d934d09607b5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:55.368697 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-90cb193e-4943-4d93-9d07-29152a3c824c tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] 10.222.0.20 "GET /compute/v2.1/servers/936d578f-607c-4650-aac3-f06ef6fa7017" status: 200 len: 1477 microversion: 2.1 time: 0.643214 Oct 27 03:21:55.370665 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 194/391] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:54 2022] GET /compute/v2.1/servers/936d578f-607c-4650-aac3-f06ef6fa7017 => generated 1477 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:21:55.544194 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-ac347395-7272-4671-ad70-722f79de401c req-9ebd8b7a-8474-45e8-b529-4f63c3b24fdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e4efa06-0a3c-4c11-849d-22bb8d9dccf8", "name": "network-vif-deleted", "tag": "2b593717-90ce-43e6-8ad3-7143ce5f9a4e"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:21:55.572333 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-ac347395-7272-4671-ad70-722f79de401c req-9ebd8b7a-8474-45e8-b529-4f63c3b24fdc service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:55.577460 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-ac347395-7272-4671-ad70-722f79de401c req-9ebd8b7a-8474-45e8-b529-4f63c3b24fdc service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:55.578490 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-ac347395-7272-4671-ad70-722f79de401c req-9ebd8b7a-8474-45e8-b529-4f63c3b24fdc service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:55.606412 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-ac347395-7272-4671-ad70-722f79de401c req-9ebd8b7a-8474-45e8-b529-4f63c3b24fdc service nova] Creating event network-vif-deleted:2b593717-90ce-43e6-8ad3-7143ce5f9a4e for instance 4e4efa06-0a3c-4c11-849d-22bb8d9dccf8 on n-h2-862769-1 Oct 27 03:21:55.616052 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-ac347395-7272-4671-ad70-722f79de401c req-9ebd8b7a-8474-45e8-b529-4f63c3b24fdc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091904 Oct 27 03:21:55.617476 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 198/392] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:21:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:21:55.988964 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1561e735-6bc4-4949-be47-01918bccaab2 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:55.990192 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1561e735-6bc4-4949-be47-01918bccaab2 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 5910c783-6877-4a41-8650-0973a11f3578] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:56.001162 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1561e735-6bc4-4949-be47-01918bccaab2 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:56.001916 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1561e735-6bc4-4949-be47-01918bccaab2 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:56.002577 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1561e735-6bc4-4949-be47-01918bccaab2 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:56.003456 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1561e735-6bc4-4949-be47-01918bccaab2 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:56.005400 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1561e735-6bc4-4949-be47-01918bccaab2 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:56.005995 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1561e735-6bc4-4949-be47-01918bccaab2 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:56.382660 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1561e735-6bc4-4949-be47-01918bccaab2 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:56.395942 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1561e735-6bc4-4949-be47-01918bccaab2 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578" status: 200 len: 1477 microversion: 2.1 time: 0.407727 Oct 27 03:21:56.396649 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 195/393] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:55 2022] GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578 => generated 1477 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:56.410261 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-da171aa2-890b-4dc0-80f1-6f2e8c4c9397 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:56.410261 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-da171aa2-890b-4dc0-80f1-6f2e8c4c9397 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] [instance: 4e4efa06-0a3c-4c11-849d-22bb8d9dccf8] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:56.427042 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-da171aa2-890b-4dc0-80f1-6f2e8c4c9397 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:56.428744 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-da171aa2-890b-4dc0-80f1-6f2e8c4c9397 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:56.429199 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-da171aa2-890b-4dc0-80f1-6f2e8c4c9397 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:56.429926 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-da171aa2-890b-4dc0-80f1-6f2e8c4c9397 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:56.430456 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-da171aa2-890b-4dc0-80f1-6f2e8c4c9397 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:56.431966 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-da171aa2-890b-4dc0-80f1-6f2e8c4c9397 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:56.515068 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-da171aa2-890b-4dc0-80f1-6f2e8c4c9397 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:56.515752 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-da171aa2-890b-4dc0-80f1-6f2e8c4c9397 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:56.516332 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-da171aa2-890b-4dc0-80f1-6f2e8c4c9397 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:56.516930 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-da171aa2-890b-4dc0-80f1-6f2e8c4c9397 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lazy-loading 'fault' on Instance uuid 4e4efa06-0a3c-4c11-849d-22bb8d9dccf8 {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:21:56.587161 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-90d6ee5d-a5c6-4d41-9e1c-4eb00cf61e3f tempest-FlavorsAccessNegativeTestJSON-125708785 tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-956508229", "id": 1622454872, "os-flavor-access:is_public": "False"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:21:56.676351 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-90d6ee5d-a5c6-4d41-9e1c-4eb00cf61e3f tempest-FlavorsAccessNegativeTestJSON-125708785 tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.524104 Oct 27 03:21:56.683572 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 199/394] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:21:56 2022] POST /compute/v2.1/flavors => generated 438 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:21:56.683572 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-176530b7-02c0-4df1-bccf-0a994397a61d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:56.683572 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-176530b7-02c0-4df1-bccf-0a994397a61d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:56.689653 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-176530b7-02c0-4df1-bccf-0a994397a61d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:56.690189 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-176530b7-02c0-4df1-bccf-0a994397a61d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:56.690639 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-176530b7-02c0-4df1-bccf-0a994397a61d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:56.691563 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-176530b7-02c0-4df1-bccf-0a994397a61d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:56.692020 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-176530b7-02c0-4df1-bccf-0a994397a61d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:56.692486 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-176530b7-02c0-4df1-bccf-0a994397a61d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:56.763471 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-176530b7-02c0-4df1-bccf-0a994397a61d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:56.771887 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-176530b7-02c0-4df1-bccf-0a994397a61d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:56.773335 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-176530b7-02c0-4df1-bccf-0a994397a61d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:56.780025 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-176530b7-02c0-4df1-bccf-0a994397a61d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1539 microversion: 2.91 time: 0.101180 Oct 27 03:21:56.780798 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 200/395] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:21:56 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1539 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:21:56.786402 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-da171aa2-890b-4dc0-80f1-6f2e8c4c9397 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff070c0383324e1da5c49e3d9c652516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1da8ce26ab49ddae972233777c4c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:56.790559 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-aaf208d1-a821-4e0d-828e-a346231e54a3 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:56.791528 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-aaf208d1-a821-4e0d-828e-a346231e54a3 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] [instance: 936d578f-607c-4650-aac3-f06ef6fa7017] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:56.803151 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aaf208d1-a821-4e0d-828e-a346231e54a3 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:56.803748 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aaf208d1-a821-4e0d-828e-a346231e54a3 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:56.808849 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aaf208d1-a821-4e0d-828e-a346231e54a3 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:56.808849 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aaf208d1-a821-4e0d-828e-a346231e54a3 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:56.808849 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aaf208d1-a821-4e0d-828e-a346231e54a3 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:56.808849 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aaf208d1-a821-4e0d-828e-a346231e54a3 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:56.809150 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-da171aa2-890b-4dc0-80f1-6f2e8c4c9397 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] 10.222.0.20 "GET /compute/v2.1/servers/4e4efa06-0a3c-4c11-849d-22bb8d9dccf8" status: 200 len: 1309 microversion: 2.1 time: 0.408589 Oct 27 03:21:56.809150 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 196/396] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:56 2022] GET /compute/v2.1/servers/4e4efa06-0a3c-4c11-849d-22bb8d9dccf8 => generated 1309 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:56.964415 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-aaf208d1-a821-4e0d-828e-a346231e54a3 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3d2208faeb4421af21da56d455be92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b2b8b909c54f36b61d934d09607b5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:56.973617 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-aaf208d1-a821-4e0d-828e-a346231e54a3 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] 10.222.0.20 "GET /compute/v2.1/servers/936d578f-607c-4650-aac3-f06ef6fa7017" status: 200 len: 1460 microversion: 2.1 time: 0.191640 Oct 27 03:21:56.974582 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 201/397] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:56 2022] GET /compute/v2.1/servers/936d578f-607c-4650-aac3-f06ef6fa7017 => generated 1460 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:56.980102 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-18998b9b-34b8-44dc-9fd1-d19c8c9b4087 tempest-FlavorsAccessNegativeTestJSON-125708785 tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "7460b59c19294e8090ba35ceecdb8686"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:21:57.047864 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6734ad1e-424e-47de-9432-479e8e2f3010 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-821361826", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:21:57.142903 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-6734ad1e-424e-47de-9432-479e8e2f3010 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] validate_networks() for None {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:21:57.268893 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-18998b9b-34b8-44dc-9fd1-d19c8c9b4087 tempest-FlavorsAccessNegativeTestJSON-125708785 tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/1622454872/action" status: 200 len: 97 microversion: 2.1 time: 0.292742 Oct 27 03:21:57.276385 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 202/398] 10.222.0.20 () {60 vars in 1200 bytes} [Thu Oct 27 03:21:56 2022] POST /compute/v2.1/flavors/1622454872/action => generated 97 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 03:21:57.283628 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-fe772f79-92ef-4017-9b09-e354225004a3 tempest-LiveMigrationNegativeTest-1769348670 tempest-LiveMigrationNegativeTest-1769348670-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:57.284519 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-fe772f79-92ef-4017-9b09-e354225004a3 tempest-LiveMigrationNegativeTest-1769348670 tempest-LiveMigrationNegativeTest-1769348670-project-admin] [instance: 936d578f-607c-4650-aac3-f06ef6fa7017] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:57.295426 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fe772f79-92ef-4017-9b09-e354225004a3 tempest-LiveMigrationNegativeTest-1769348670 tempest-LiveMigrationNegativeTest-1769348670-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:57.299534 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fe772f79-92ef-4017-9b09-e354225004a3 tempest-LiveMigrationNegativeTest-1769348670 tempest-LiveMigrationNegativeTest-1769348670-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:57.300299 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fe772f79-92ef-4017-9b09-e354225004a3 tempest-LiveMigrationNegativeTest-1769348670 tempest-LiveMigrationNegativeTest-1769348670-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:57.301351 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fe772f79-92ef-4017-9b09-e354225004a3 tempest-LiveMigrationNegativeTest-1769348670 tempest-LiveMigrationNegativeTest-1769348670-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:57.302197 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fe772f79-92ef-4017-9b09-e354225004a3 tempest-LiveMigrationNegativeTest-1769348670 tempest-LiveMigrationNegativeTest-1769348670-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:57.302817 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fe772f79-92ef-4017-9b09-e354225004a3 tempest-LiveMigrationNegativeTest-1769348670 tempest-LiveMigrationNegativeTest-1769348670-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:57.533146 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-6734ad1e-424e-47de-9432-479e8e2f3010 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:21:57.534916 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-6734ad1e-424e-47de-9432-479e8e2f3010 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:21:57.535601 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-6734ad1e-424e-47de-9432-479e8e2f3010 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:21:57.536769 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-6734ad1e-424e-47de-9432-479e8e2f3010 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:21:57.539808 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-6734ad1e-424e-47de-9432-479e8e2f3010 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:21:57.551359 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6734ad1e-424e-47de-9432-479e8e2f3010 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:57.552076 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6734ad1e-424e-47de-9432-479e8e2f3010 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:57.555936 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6734ad1e-424e-47de-9432-479e8e2f3010 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:57.557214 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6734ad1e-424e-47de-9432-479e8e2f3010 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:57.557902 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6734ad1e-424e-47de-9432-479e8e2f3010 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:57.558821 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6734ad1e-424e-47de-9432-479e8e2f3010 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:57.591393 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-6734ad1e-424e-47de-9432-479e8e2f3010 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Getting quotas for project b95729a8c8a14361b7cbf8b2b13900b2. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:21:57.607351 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-6734ad1e-424e-47de-9432-479e8e2f3010 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Getting quotas for user 91d1351fcb6b4cd08f176e6d0cc5bb11 and project b95729a8c8a14361b7cbf8b2b13900b2. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:21:57.610331 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6734ad1e-424e-47de-9432-479e8e2f3010 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:21:57.612835 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6734ad1e-424e-47de-9432-479e8e2f3010 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: d0a79872-c316-4bb2-914c-a118831bc023] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:21:57.742225 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-fe772f79-92ef-4017-9b09-e354225004a3 tempest-LiveMigrationNegativeTest-1769348670 tempest-LiveMigrationNegativeTest-1769348670-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/936d578f-607c-4650-aac3-f06ef6fa7017" status: 200 len: 1611 microversion: 2.1 time: 0.462556 Oct 27 03:21:57.744138 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 203/399] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:57 2022] GET /compute/v2.1/servers/936d578f-607c-4650-aac3-f06ef6fa7017 => generated 1611 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:57.752161 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8c7d3396-146e-4041-bbd5-2512ac4116b1 tempest-FlavorsAccessNegativeTestJSON-125708785 tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "7460b59c19294e8090ba35ceecdb8686"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:21:57.873738 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6734ad1e-424e-47de-9432-479e8e2f3010 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.050110 Oct 27 03:21:57.880634 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 197/400] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:21:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1073 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 03:21:57.885751 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-999cea77-e8d9-4792-8882-a400a1ce8144 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:57.886399 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-999cea77-e8d9-4792-8882-a400a1ce8144 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 5910c783-6877-4a41-8650-0973a11f3578] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:57.895618 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-999cea77-e8d9-4792-8882-a400a1ce8144 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:57.907529 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-999cea77-e8d9-4792-8882-a400a1ce8144 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:57.910486 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-999cea77-e8d9-4792-8882-a400a1ce8144 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:57.911411 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-999cea77-e8d9-4792-8882-a400a1ce8144 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:57.912032 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-999cea77-e8d9-4792-8882-a400a1ce8144 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:57.913357 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-999cea77-e8d9-4792-8882-a400a1ce8144 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:58.136955 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-8c7d3396-146e-4041-bbd5-2512ac4116b1 tempest-FlavorsAccessNegativeTestJSON-125708785 tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin] HTTP exception thrown: Flavor access already exists for flavor 30 and project 7460b59c19294e8090ba35ceecdb8686 combination. Oct 27 03:21:58.166687 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8c7d3396-146e-4041-bbd5-2512ac4116b1 tempest-FlavorsAccessNegativeTestJSON-125708785 tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin] Request method failure captured: Oct 27 03:21:58.166687 n-d-862769-1 devstack@n-api.service[121001]: request: POST /compute/v2.1/flavors/1622454872/action HTTP/1.1 Oct 27 03:21:58.166687 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:21:58.166687 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:21:58.166687 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:21:58.166687 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 67 Oct 27 03:21:58.166687 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:21:58.166687 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:21:58.166687 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:21:58.166687 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:21:58.166687 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWflSOlj_k_Ll9R8dKOtz8H5nsrworDt1PViHB9BgcTHGcTNOjoJ017F67_-boLM6ysYSAO1LjYQnFiMWeJTBKLvnZYwt1692snbPdVrCA9OLBCyANr6mciEicYr0-p_nAZN3aTZ8BjAxtgnXbePmBHSxRgc9GWRwiRQgOFcQtambqEQ Oct 27 03:21:58.166687 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:21:58.166687 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:21:58.166687 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:21:58.166687 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:21:58.166687 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:21:58.166687 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:21:58.166687 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 3d4dd82f48e04315abb577f300e0c4db Oct 27 03:21:58.166687 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-125708785 Oct 27 03:21:58.166687 n-d-862769-1 devstack@n-api.service[121001]: X-Role: admin,member,reader Oct 27 03:21:58.166687 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: admin,member,reader Oct 27 03:21:58.167944 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3d4dd82f48e04315abb577f300e0c4db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3d4dd82f48e04315abb577f300e0c4db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3d4dd82f48e04315abb577f300e0c4db"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3d4dd82f48e04315abb577f300e0c4db"}]}] Oct 27 03:21:58.167944 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-125708785 Oct 27 03:21:58.167944 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 3d4dd82f48e04315abb577f300e0c4db Oct 27 03:21:58.167944 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-125708785 Oct 27 03:21:58.167944 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin Oct 27 03:21:58.167944 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:21:58.167944 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:21:58.167944 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 91732d221c874b1085b59ecc1e1a60ee Oct 27 03:21:58.167944 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin Oct 27 03:21:58.167944 n-d-862769-1 devstack@n-api.service[121001]: Oct 27 03:21:58.167944 n-d-862769-1 devstack@n-api.service[121001]: {"addTenantAccess": {"tenant": "7460b59c19294e8090ba35ceecdb8686"}} Oct 27 03:21:58.167944 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:21:58.168741 n-d-862769-1 devstack@n-api.service[121001]: exception: Flavor access already exists for flavor 30 and project 7460b59c19294e8090ba35ceecdb8686 combination. Oct 27 03:21:58.168741 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '1622454872', 'body': {'addTenantAccess': {'tenant': '7460b59c19294e8090ba35ceecdb8686'}}} Oct 27 03:21:58.168741 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:21:58.168741 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:21:58.168741 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 27 03:21:58.168741 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 27 03:21:58.168741 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 27 03:21:58.168741 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 27 03:21:58.168741 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 27 03:21:58.168741 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 27 03:21:58.168741 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 27 03:21:58.168741 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 27 03:21:58.168741 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 27 03:21:58.168741 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 27 03:21:58.168741 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 27 03:21:58.168741 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi result.read() Oct 27 03:21:58.168741 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 27 03:21:58.168741 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 27 03:21:58.170323 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 27 03:21:58.170323 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 27 03:21:58.170323 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 27 03:21:58.170323 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 27 03:21:58.170323 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 27 03:21:58.170323 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 27 03:21:58.170323 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '30-7460b59c19294e8090ba35ceecdb8686' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 27 03:21:58.170323 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:21:58.170323 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 27 03:21:58.170323 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:21:58.170323 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:21:58.170323 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Oct 27 03:21:58.170323 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi project.save(context.session) Oct 27 03:21:58.170323 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 27 03:21:58.170323 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi session.flush() Oct 27 03:21:58.170323 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 27 03:21:58.170323 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 27 03:21:58.170323 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 27 03:21:58.170323 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 27 03:21:58.175831 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 27 03:21:58.175831 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 27 03:21:58.175831 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 27 03:21:58.175831 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception Oct 27 03:21:58.175831 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 27 03:21:58.175831 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 27 03:21:58.175831 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 27 03:21:58.175831 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 27 03:21:58.175831 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 27 03:21:58.175831 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 27 03:21:58.175831 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 27 03:21:58.175831 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 27 03:21:58.175831 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 27 03:21:58.175831 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 27 03:21:58.175831 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 27 03:21:58.175831 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 27 03:21:58.175831 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 27 03:21:58.175831 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 27 03:21:58.176867 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 27 03:21:58.176867 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 27 03:21:58.176867 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 27 03:21:58.176867 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 27 03:21:58.176867 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 27 03:21:58.176867 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 27 03:21:58.176867 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 27 03:21:58.176867 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception Oct 27 03:21:58.176867 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 27 03:21:58.176867 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 27 03:21:58.176867 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 27 03:21:58.176867 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 27 03:21:58.176867 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 27 03:21:58.176867 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 27 03:21:58.176867 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 27 03:21:58.176867 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 27 03:21:58.176867 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 27 03:21:58.176867 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 27 03:21:58.177885 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 27 03:21:58.177885 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi result.read() Oct 27 03:21:58.177885 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 27 03:21:58.177885 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 27 03:21:58.177885 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 27 03:21:58.177885 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 27 03:21:58.177885 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 27 03:21:58.177885 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 27 03:21:58.177885 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 27 03:21:58.177885 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 27 03:21:58.177885 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '30-7460b59c19294e8090ba35ceecdb8686' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 27 03:21:58.177885 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Oct 27 03:21:58.177885 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 27, 3, 21, 58, 98844), 'updated_at': None, 'flavor_id': 30, 'project_id': '7460b59c19294e8090ba35ceecdb8686'}] Oct 27 03:21:58.177885 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 27 03:21:58.177885 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:21:58.177885 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:21:58.177885 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:21:58.178852 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:21:58.178852 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Oct 27 03:21:58.178852 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Oct 27 03:21:58.178852 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 27 03:21:58.178852 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 27 03:21:58.178852 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Oct 27 03:21:58.178852 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Oct 27 03:21:58.178852 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Oct 27 03:21:58.178852 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Oct 27 03:21:58.178852 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Oct 27 03:21:58.178852 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Oct 27 03:21:58.178852 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 03:21:58.178852 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 03:21:58.178852 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Oct 27 03:21:58.178852 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Oct 27 03:21:58.178852 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 30 and project 7460b59c19294e8090ba35ceecdb8686 combination. Oct 27 03:21:58.178852 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:21:58.178852 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:21:58.178852 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:21:58.180831 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:21:58.180831 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:21:58.180831 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:21:58.180831 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:21:58.180831 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:21:58.180831 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:21:58.180831 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:21:58.180831 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:21:58.180831 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:21:58.180831 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Oct 27 03:21:58.180831 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Oct 27 03:21:58.180831 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 30 and project 7460b59c19294e8090ba35ceecdb8686 combination. Oct 27 03:21:58.180831 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:21:58.180831 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:21:58.180831 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:21:58.180831 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:21:58.180831 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:21:58.180831 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:21:58.180831 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:21:58.180831 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:21:58.184423 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 30 and project 7460b59c19294e8090ba35ceecdb8686 combination. Oct 27 03:21:58.184423 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:21:58.184423 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8c7d3396-146e-4041-bbd5-2512ac4116b1 tempest-FlavorsAccessNegativeTestJSON-125708785 tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin] Returning 409 to user: Flavor access already exists for flavor 30 and project 7460b59c19294e8090ba35ceecdb8686 combination. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:21:58.184423 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8c7d3396-146e-4041-bbd5-2512ac4116b1 tempest-FlavorsAccessNegativeTestJSON-125708785 tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/1622454872/action" status: 409 len: 152 microversion: 2.1 time: 0.423336 Oct 27 03:21:58.184423 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 204/401] 10.222.0.20 () {60 vars in 1200 bytes} [Thu Oct 27 03:21:57 2022] POST /compute/v2.1/flavors/1622454872/action => generated 152 bytes in 425 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 27 03:21:58.196191 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2385831a-fd65-4605-aa51-5fe0fd077c20 tempest-LiveMigrationNegativeTest-1769348670 tempest-LiveMigrationNegativeTest-1769348670-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:58.202506 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-999cea77-e8d9-4792-8882-a400a1ce8144 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:58.204242 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2385831a-fd65-4605-aa51-5fe0fd077c20 tempest-LiveMigrationNegativeTest-1769348670 tempest-LiveMigrationNegativeTest-1769348670-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:58.205677 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2385831a-fd65-4605-aa51-5fe0fd077c20 tempest-LiveMigrationNegativeTest-1769348670 tempest-LiveMigrationNegativeTest-1769348670-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:58.207340 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2385831a-fd65-4605-aa51-5fe0fd077c20 tempest-LiveMigrationNegativeTest-1769348670 tempest-LiveMigrationNegativeTest-1769348670-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:58.209591 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2385831a-fd65-4605-aa51-5fe0fd077c20 tempest-LiveMigrationNegativeTest-1769348670 tempest-LiveMigrationNegativeTest-1769348670-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:58.214361 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-999cea77-e8d9-4792-8882-a400a1ce8144 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578" status: 200 len: 1477 microversion: 2.1 time: 0.331394 Oct 27 03:21:58.215128 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2385831a-fd65-4605-aa51-5fe0fd077c20 tempest-LiveMigrationNegativeTest-1769348670 tempest-LiveMigrationNegativeTest-1769348670-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:58.217681 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2385831a-fd65-4605-aa51-5fe0fd077c20 tempest-LiveMigrationNegativeTest-1769348670 tempest-LiveMigrationNegativeTest-1769348670-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:58.233770 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 198/402] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:57 2022] GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578 => generated 1477 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:58.239521 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a3bcd8a3-4ca0-46e2-b002-14394a6a626c tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:58.259034 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a3bcd8a3-4ca0-46e2-b002-14394a6a626c tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:58.276452 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a3bcd8a3-4ca0-46e2-b002-14394a6a626c tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:58.278653 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a3bcd8a3-4ca0-46e2-b002-14394a6a626c tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:58.279862 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a3bcd8a3-4ca0-46e2-b002-14394a6a626c tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:58.282017 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a3bcd8a3-4ca0-46e2-b002-14394a6a626c tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:58.283571 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a3bcd8a3-4ca0-46e2-b002-14394a6a626c tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:58.284085 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a3bcd8a3-4ca0-46e2-b002-14394a6a626c tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:58.302181 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2385831a-fd65-4605-aa51-5fe0fd077c20 tempest-LiveMigrationNegativeTest-1769348670 tempest-LiveMigrationNegativeTest-1769348670-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.130973 Oct 27 03:21:58.302931 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 205/403] 10.222.0.20 () {58 vars in 1176 bytes} [Thu Oct 27 03:21:58 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:21:58.313043 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-acf3e7c0-851e-4600-b7b7-d02327030ca0 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:58.315214 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-acf3e7c0-851e-4600-b7b7-d02327030ca0 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] [instance: 4e4efa06-0a3c-4c11-849d-22bb8d9dccf8] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:58.323525 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-acf3e7c0-851e-4600-b7b7-d02327030ca0 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:58.324482 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-acf3e7c0-851e-4600-b7b7-d02327030ca0 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:58.325376 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-acf3e7c0-851e-4600-b7b7-d02327030ca0 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:58.326448 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-acf3e7c0-851e-4600-b7b7-d02327030ca0 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:58.327136 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-acf3e7c0-851e-4600-b7b7-d02327030ca0 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:58.327575 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-acf3e7c0-851e-4600-b7b7-d02327030ca0 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:58.357885 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-acf3e7c0-851e-4600-b7b7-d02327030ca0 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] HTTP exception thrown: Instance 4e4efa06-0a3c-4c11-849d-22bb8d9dccf8 could not be found. Oct 27 03:21:58.359549 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-acf3e7c0-851e-4600-b7b7-d02327030ca0 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Request method failure captured: Oct 27 03:21:58.359549 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/4e4efa06-0a3c-4c11-849d-22bb8d9dccf8 HTTP/1.1 Oct 27 03:21:58.359549 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:21:58.359549 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:21:58.359549 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:21:58.359549 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:21:58.359549 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:21:58.359549 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:21:58.359549 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:21:58.359549 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:21:58.359549 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfkchMQHvdK7cIQNBhisWxT9inndNR7wogzO6_ui2mdezHvdhj9t8UKoro2RWJXh4pZMglkN7DN3f_oTP4lypXLaAnbXZqDNfcSijqaegrY3lX6ZT1IKK4-7SCDsBlJQjrx46920l7Ge6m_aMYea3rd83mwZDnLyuk0CQ9fFdQjA9yk Oct 27 03:21:58.359549 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:21:58.359549 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:21:58.359549 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:21:58.359549 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:21:58.359549 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:21:58.359549 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:21:58.359549 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: ac1da8ce26ab49ddae972233777c4c55 Oct 27 03:21:58.359549 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-DeleteServersAdminTestJSON-345610032 Oct 27 03:21:58.359549 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:21:58.359549 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:21:58.361077 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ac1da8ce26ab49ddae972233777c4c55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ac1da8ce26ab49ddae972233777c4c55"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ac1da8ce26ab49ddae972233777c4c55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ac1da8ce26ab49ddae972233777c4c55"}]}] Oct 27 03:21:58.361077 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-DeleteServersAdminTestJSON-345610032 Oct 27 03:21:58.361077 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: ac1da8ce26ab49ddae972233777c4c55 Oct 27 03:21:58.361077 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-345610032 Oct 27 03:21:58.361077 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-DeleteServersAdminTestJSON-345610032-project Oct 27 03:21:58.361077 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:21:58.361077 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:21:58.361077 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: ff070c0383324e1da5c49e3d9c652516 Oct 27 03:21:58.361077 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-DeleteServersAdminTestJSON-345610032-project Oct 27 03:21:58.361077 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:21:58.361077 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 4e4efa06-0a3c-4c11-849d-22bb8d9dccf8 could not be found. Oct 27 03:21:58.361077 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '4e4efa06-0a3c-4c11-849d-22bb8d9dccf8'} Oct 27 03:21:58.361852 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:21:58.361852 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:21:58.361852 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:21:58.361852 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:21:58.361852 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:21:58.361852 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:21:58.361852 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:21:58.361852 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:21:58.361852 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:21:58.361852 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:21:58.361852 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e4efa06-0a3c-4c11-849d-22bb8d9dccf8 could not be found. Oct 27 03:21:58.361852 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:21:58.361852 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:21:58.361852 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:21:58.361852 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:21:58.361852 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:21:58.361852 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:21:58.361852 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:21:58.361852 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:21:58.361852 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:21:58.363183 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:21:58.363183 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:21:58.363183 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:21:58.363183 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:21:58.363183 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:21:58.363183 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:21:58.363183 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:21:58.363183 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e4efa06-0a3c-4c11-849d-22bb8d9dccf8 could not be found. Oct 27 03:21:58.363183 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:21:58.363183 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:21:58.363183 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:21:58.363183 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:21:58.363183 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:21:58.363183 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:21:58.363183 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:21:58.363183 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:21:58.363183 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e4efa06-0a3c-4c11-849d-22bb8d9dccf8 could not be found. Oct 27 03:21:58.363183 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:21:58.364499 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-acf3e7c0-851e-4600-b7b7-d02327030ca0 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Returning 404 to user: Instance 4e4efa06-0a3c-4c11-849d-22bb8d9dccf8 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:21:58.365734 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-acf3e7c0-851e-4600-b7b7-d02327030ca0 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] 10.222.0.20 "GET /compute/v2.1/servers/4e4efa06-0a3c-4c11-849d-22bb8d9dccf8" status: 404 len: 111 microversion: 2.1 time: 0.060818 Oct 27 03:21:58.366701 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 206/404] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:58 2022] GET /compute/v2.1/servers/4e4efa06-0a3c-4c11-849d-22bb8d9dccf8 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:21:58.378763 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-792144f1-712d-4b1a-8552-31c48a1a5b27 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:58.379848 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-792144f1-712d-4b1a-8552-31c48a1a5b27 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: d0a79872-c316-4bb2-914c-a118831bc023] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:58.391453 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a3bcd8a3-4ca0-46e2-b002-14394a6a626c tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:58.407162 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a3bcd8a3-4ca0-46e2-b002-14394a6a626c tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:58.417384 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a3bcd8a3-4ca0-46e2-b002-14394a6a626c tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:58.428874 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a3bcd8a3-4ca0-46e2-b002-14394a6a626c tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1539 microversion: 2.91 time: 0.193629 Oct 27 03:21:58.429478 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 199/405] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:21:58 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1539 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:21:58.440323 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2a86ff35-d23b-4c99-950c-bc0f652e2210 tempest-FlavorsAccessNegativeTestJSON-125708785 tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "7460b59c19294e8090ba35ceecdb8686"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:21:58.461923 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-792144f1-712d-4b1a-8552-31c48a1a5b27 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:58.474084 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-792144f1-712d-4b1a-8552-31c48a1a5b27 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/d0a79872-c316-4bb2-914c-a118831bc023" status: 200 len: 1216 microversion: 2.1 time: 0.106112 Oct 27 03:21:58.474996 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 207/406] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:58 2022] GET /compute/v2.1/servers/d0a79872-c316-4bb2-914c-a118831bc023 => generated 1216 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:58.479671 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-16f09f40-57ea-4f46-8a4c-5519affa2115 tempest-LiveMigrationNegativeTest-1769348670 tempest-LiveMigrationNegativeTest-1769348670-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-862769-1", "block_migration": true, "disk_over_commit": false}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:21:58.483119 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-16f09f40-57ea-4f46-8a4c-5519affa2115 tempest-LiveMigrationNegativeTest-1769348670 tempest-LiveMigrationNegativeTest-1769348670-project-admin] [instance: 936d578f-607c-4650-aac3-f06ef6fa7017] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:58.490726 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-16f09f40-57ea-4f46-8a4c-5519affa2115 tempest-LiveMigrationNegativeTest-1769348670 tempest-LiveMigrationNegativeTest-1769348670-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:58.497235 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-16f09f40-57ea-4f46-8a4c-5519affa2115 tempest-LiveMigrationNegativeTest-1769348670 tempest-LiveMigrationNegativeTest-1769348670-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:58.497235 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-16f09f40-57ea-4f46-8a4c-5519affa2115 tempest-LiveMigrationNegativeTest-1769348670 tempest-LiveMigrationNegativeTest-1769348670-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:58.497235 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-16f09f40-57ea-4f46-8a4c-5519affa2115 tempest-LiveMigrationNegativeTest-1769348670 tempest-LiveMigrationNegativeTest-1769348670-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:58.497235 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-16f09f40-57ea-4f46-8a4c-5519affa2115 tempest-LiveMigrationNegativeTest-1769348670 tempest-LiveMigrationNegativeTest-1769348670-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:58.497620 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-16f09f40-57ea-4f46-8a4c-5519affa2115 tempest-LiveMigrationNegativeTest-1769348670 tempest-LiveMigrationNegativeTest-1769348670-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:58.597564 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-16f09f40-57ea-4f46-8a4c-5519affa2115 tempest-LiveMigrationNegativeTest-1769348670 tempest-LiveMigrationNegativeTest-1769348670-project-admin] Lazy-loading 'flavor' on Instance uuid 936d578f-607c-4650-aac3-f06ef6fa7017 {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:21:58.666519 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-16f09f40-57ea-4f46-8a4c-5519affa2115 tempest-LiveMigrationNegativeTest-1769348670 tempest-LiveMigrationNegativeTest-1769348670-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 936d578f-607c-4650-aac3-f06ef6fa7017 while it is in vm_state suspended Oct 27 03:21:58.668791 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-16f09f40-57ea-4f46-8a4c-5519affa2115 tempest-LiveMigrationNegativeTest-1769348670 tempest-LiveMigrationNegativeTest-1769348670-project-admin] Request method failure captured: Oct 27 03:21:58.668791 n-d-862769-1 devstack@n-api.service[121001]: request: POST /compute/v2.1/servers/936d578f-607c-4650-aac3-f06ef6fa7017/action HTTP/1.1 Oct 27 03:21:58.668791 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:21:58.668791 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:21:58.668791 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:21:58.668791 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 97 Oct 27 03:21:58.668791 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:21:58.668791 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:21:58.668791 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:21:58.668791 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:21:58.668791 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfkygAILkV6cT4ntu99n_bhkPTkiu6BUY2lcaFyJVFPBCFnP7E5DnUCupPePjU9jHgzwEb6Ky9iGSbRMdpSiML9P8WQfJ0Ei0KVjYbSkRixdPoKGgSV0Jf6Hp27yL1gd8r7mJwOecPpp3pEuKqITFz81qt49Hzx-5CQ_8R3DyGNsmcw Oct 27 03:21:58.668791 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:21:58.668791 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:21:58.668791 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:21:58.668791 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:21:58.668791 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:21:58.668791 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:21:58.668791 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 9472aa97aca64edda6b0e0ffd956af70 Oct 27 03:21:58.668791 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-LiveMigrationNegativeTest-1769348670 Oct 27 03:21:58.668791 n-d-862769-1 devstack@n-api.service[121001]: X-Role: admin,member,reader Oct 27 03:21:58.668791 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: admin,member,reader Oct 27 03:21:58.670307 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9472aa97aca64edda6b0e0ffd956af70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9472aa97aca64edda6b0e0ffd956af70"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9472aa97aca64edda6b0e0ffd956af70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9472aa97aca64edda6b0e0ffd956af70"}]}] Oct 27 03:21:58.670307 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-LiveMigrationNegativeTest-1769348670 Oct 27 03:21:58.670307 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 9472aa97aca64edda6b0e0ffd956af70 Oct 27 03:21:58.670307 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1769348670 Oct 27 03:21:58.670307 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-LiveMigrationNegativeTest-1769348670-project-admin Oct 27 03:21:58.670307 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:21:58.670307 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:21:58.670307 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 8c5e02ab3926413c82a1f53cb7a2b9f3 Oct 27 03:21:58.670307 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-LiveMigrationNegativeTest-1769348670-project-admin Oct 27 03:21:58.670307 n-d-862769-1 devstack@n-api.service[121001]: Oct 27 03:21:58.670307 n-d-862769-1 devstack@n-api.service[121001]: {"os-migrateLive": {"host": "n-h2-862769-1", "block_migration": true, "disk_over_commit": false}} Oct 27 03:21:58.670307 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:21:58.670998 n-d-862769-1 devstack@n-api.service[121001]: exception: Cannot 'os-migrateLive' instance 936d578f-607c-4650-aac3-f06ef6fa7017 while it is in vm_state suspended Oct 27 03:21:58.670998 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '936d578f-607c-4650-aac3-f06ef6fa7017', 'body': {'os-migrateLive': {'host': 'n-h2-862769-1', 'block_migration': True, 'disk_over_commit': False}}} Oct 27 03:21:58.670998 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:21:58.670998 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:21:58.670998 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 27 03:21:58.670998 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 27 03:21:58.670998 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 27 03:21:58.670998 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 03:21:58.670998 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 27 03:21:58.670998 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 27 03:21:58.670998 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 27 03:21:58.670998 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 27 03:21:58.670998 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 27 03:21:58.670998 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 27 03:21:58.670998 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 27 03:21:58.670998 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 27 03:21:58.670998 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 27 03:21:58.670998 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 27 03:21:58.672255 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 03:21:58.672255 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 03:21:58.672255 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 27 03:21:58.672255 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 27 03:21:58.672255 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 936d578f-607c-4650-aac3-f06ef6fa7017 in vm_state suspended. Cannot live_migrate while the instance is in this state. Oct 27 03:21:58.672255 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:21:58.672255 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:21:58.672255 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:21:58.672255 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:21:58.672255 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:21:58.672255 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:21:58.672255 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:21:58.672255 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:21:58.672255 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:21:58.672255 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:21:58.672255 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:21:58.672255 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:21:58.672255 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:21:58.672255 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:21:58.672255 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:21:58.677611 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:21:58.677611 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 27 03:21:58.677611 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Oct 27 03:21:58.677611 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 27 03:21:58.677611 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 27 03:21:58.677611 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 27 03:21:58.677611 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 936d578f-607c-4650-aac3-f06ef6fa7017 while it is in vm_state suspended Oct 27 03:21:58.677611 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:21:58.677611 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:21:58.677611 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:21:58.677611 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:21:58.677611 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:21:58.677611 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:21:58.677611 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:21:58.677611 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:21:58.677611 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 936d578f-607c-4650-aac3-f06ef6fa7017 while it is in vm_state suspended Oct 27 03:21:58.677611 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:21:58.678815 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-16f09f40-57ea-4f46-8a4c-5519affa2115 tempest-LiveMigrationNegativeTest-1769348670 tempest-LiveMigrationNegativeTest-1769348670-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 936d578f-607c-4650-aac3-f06ef6fa7017 while it is in vm_state suspended {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:21:58.678815 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-16f09f40-57ea-4f46-8a4c-5519affa2115 tempest-LiveMigrationNegativeTest-1769348670 tempest-LiveMigrationNegativeTest-1769348670-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/936d578f-607c-4650-aac3-f06ef6fa7017/action" status: 409 len: 155 microversion: 2.1 time: 0.194304 Oct 27 03:21:58.678815 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 208/407] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:21:58 2022] POST /compute/v2.1/servers/936d578f-607c-4650-aac3-f06ef6fa7017/action => generated 155 bytes in 199 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 27 03:21:58.685828 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2ee9526b-711c-47ec-8914-7b87cc910f76 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:58.686441 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2ee9526b-711c-47ec-8914-7b87cc910f76 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] [instance: 4e4efa06-0a3c-4c11-849d-22bb8d9dccf8] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:58.695736 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2ee9526b-711c-47ec-8914-7b87cc910f76 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:58.696295 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2ee9526b-711c-47ec-8914-7b87cc910f76 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:58.696899 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2ee9526b-711c-47ec-8914-7b87cc910f76 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:58.697808 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2ee9526b-711c-47ec-8914-7b87cc910f76 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:58.698300 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2ee9526b-711c-47ec-8914-7b87cc910f76 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:58.699041 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2ee9526b-711c-47ec-8914-7b87cc910f76 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:58.715312 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-2ee9526b-711c-47ec-8914-7b87cc910f76 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] HTTP exception thrown: Instance 4e4efa06-0a3c-4c11-849d-22bb8d9dccf8 could not be found. Oct 27 03:21:58.729120 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2ee9526b-711c-47ec-8914-7b87cc910f76 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Request method failure captured: Oct 27 03:21:58.729120 n-d-862769-1 devstack@n-api.service[121001]: request: DELETE /compute/v2.1/servers/4e4efa06-0a3c-4c11-849d-22bb8d9dccf8 HTTP/1.1 Oct 27 03:21:58.729120 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:21:58.729120 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:21:58.729120 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:21:58.729120 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:21:58.729120 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:21:58.729120 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:21:58.729120 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:21:58.729120 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:21:58.729120 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfkchMQHvdK7cIQNBhisWxT9inndNR7wogzO6_ui2mdezHvdhj9t8UKoro2RWJXh4pZMglkN7DN3f_oTP4lypXLaAnbXZqDNfcSijqaegrY3lX6ZT1IKK4-7SCDsBlJQjrx46920l7Ge6m_aMYea3rd83mwZDnLyuk0CQ9fFdQjA9yk Oct 27 03:21:58.729120 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:21:58.729120 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:21:58.729120 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:21:58.729120 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:21:58.729120 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:21:58.729120 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:21:58.729120 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: ac1da8ce26ab49ddae972233777c4c55 Oct 27 03:21:58.729120 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-DeleteServersAdminTestJSON-345610032 Oct 27 03:21:58.729120 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:21:58.729120 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:21:58.730650 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ac1da8ce26ab49ddae972233777c4c55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ac1da8ce26ab49ddae972233777c4c55"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ac1da8ce26ab49ddae972233777c4c55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ac1da8ce26ab49ddae972233777c4c55"}]}] Oct 27 03:21:58.730650 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-DeleteServersAdminTestJSON-345610032 Oct 27 03:21:58.730650 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: ac1da8ce26ab49ddae972233777c4c55 Oct 27 03:21:58.730650 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-345610032 Oct 27 03:21:58.730650 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-DeleteServersAdminTestJSON-345610032-project Oct 27 03:21:58.730650 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:21:58.730650 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:21:58.730650 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: ff070c0383324e1da5c49e3d9c652516 Oct 27 03:21:58.730650 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-DeleteServersAdminTestJSON-345610032-project Oct 27 03:21:58.730650 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:21:58.730650 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 4e4efa06-0a3c-4c11-849d-22bb8d9dccf8 could not be found. Oct 27 03:21:58.730650 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '4e4efa06-0a3c-4c11-849d-22bb8d9dccf8'} Oct 27 03:21:58.731441 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:21:58.731441 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:21:58.731441 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:21:58.731441 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:21:58.731441 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:21:58.731441 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:21:58.731441 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:21:58.731441 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:21:58.731441 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:21:58.731441 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:21:58.731441 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e4efa06-0a3c-4c11-849d-22bb8d9dccf8 could not be found. Oct 27 03:21:58.731441 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:21:58.731441 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:21:58.731441 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:21:58.731441 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:21:58.731441 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:21:58.731441 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:21:58.731441 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:21:58.731441 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:21:58.731441 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:21:58.732743 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:21:58.732743 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 03:21:58.732743 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 03:21:58.732743 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 03:21:58.732743 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 03:21:58.732743 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:21:58.732743 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:21:58.732743 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:21:58.732743 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:21:58.732743 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e4efa06-0a3c-4c11-849d-22bb8d9dccf8 could not be found. Oct 27 03:21:58.732743 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:21:58.732743 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:21:58.732743 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:21:58.732743 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:21:58.732743 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:21:58.732743 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:21:58.732743 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:21:58.732743 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:21:58.732743 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e4efa06-0a3c-4c11-849d-22bb8d9dccf8 could not be found. Oct 27 03:21:58.732743 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:21:58.737018 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2ee9526b-711c-47ec-8914-7b87cc910f76 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Returning 404 to user: Instance 4e4efa06-0a3c-4c11-849d-22bb8d9dccf8 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:21:58.737018 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2ee9526b-711c-47ec-8914-7b87cc910f76 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4e4efa06-0a3c-4c11-849d-22bb8d9dccf8" status: 404 len: 111 microversion: 2.1 time: 0.055532 Oct 27 03:21:58.746593 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 209/408] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:21:58 2022] DELETE /compute/v2.1/servers/4e4efa06-0a3c-4c11-849d-22bb8d9dccf8 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:21:58.756610 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9692c3aa-e2aa-476d-b217-5b2f5e66bd84 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:58.757125 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-9692c3aa-e2aa-476d-b217-5b2f5e66bd84 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] [instance: 936d578f-607c-4650-aac3-f06ef6fa7017] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:58.782211 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9692c3aa-e2aa-476d-b217-5b2f5e66bd84 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:58.783319 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9692c3aa-e2aa-476d-b217-5b2f5e66bd84 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:58.785303 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9692c3aa-e2aa-476d-b217-5b2f5e66bd84 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:58.786227 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9692c3aa-e2aa-476d-b217-5b2f5e66bd84 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:58.787677 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9692c3aa-e2aa-476d-b217-5b2f5e66bd84 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:58.789388 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9692c3aa-e2aa-476d-b217-5b2f5e66bd84 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:58.829039 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-9692c3aa-e2aa-476d-b217-5b2f5e66bd84 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] [instance: 936d578f-607c-4650-aac3-f06ef6fa7017] Going to try to terminate instance {{(pid=121001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:21:58.896612 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2a86ff35-d23b-4c99-950c-bc0f652e2210 tempest-FlavorsAccessNegativeTestJSON-125708785 tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/1622454872/action" status: 200 len: 21 microversion: 2.1 time: 0.466016 Oct 27 03:21:58.902639 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 200/409] 10.222.0.20 () {60 vars in 1200 bytes} [Thu Oct 27 03:21:58 2022] POST /compute/v2.1/flavors/1622454872/action => generated 21 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 03:21:58.902639 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-529f8b06-3eac-42c7-9bf8-738952e0ffca tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:58.902639 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-529f8b06-3eac-42c7-9bf8-738952e0ffca tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] [instance: 4e4efa06-0a3c-4c11-849d-22bb8d9dccf8] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:58.909972 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-529f8b06-3eac-42c7-9bf8-738952e0ffca tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:58.910810 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-529f8b06-3eac-42c7-9bf8-738952e0ffca tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:58.911624 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-529f8b06-3eac-42c7-9bf8-738952e0ffca tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:58.912681 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-529f8b06-3eac-42c7-9bf8-738952e0ffca tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:58.913474 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-529f8b06-3eac-42c7-9bf8-738952e0ffca tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:58.914204 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-529f8b06-3eac-42c7-9bf8-738952e0ffca tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:58.930450 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-529f8b06-3eac-42c7-9bf8-738952e0ffca tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] HTTP exception thrown: Instance 4e4efa06-0a3c-4c11-849d-22bb8d9dccf8 could not be found. Oct 27 03:21:58.932995 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-529f8b06-3eac-42c7-9bf8-738952e0ffca tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Request method failure captured: Oct 27 03:21:58.932995 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/4e4efa06-0a3c-4c11-849d-22bb8d9dccf8 HTTP/1.1 Oct 27 03:21:58.932995 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:21:58.932995 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:21:58.932995 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:21:58.932995 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:21:58.932995 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:21:58.932995 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:21:58.932995 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:21:58.932995 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:21:58.932995 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfkchMQHvdK7cIQNBhisWxT9inndNR7wogzO6_ui2mdezHvdhj9t8UKoro2RWJXh4pZMglkN7DN3f_oTP4lypXLaAnbXZqDNfcSijqaegrY3lX6ZT1IKK4-7SCDsBlJQjrx46920l7Ge6m_aMYea3rd83mwZDnLyuk0CQ9fFdQjA9yk Oct 27 03:21:58.932995 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:21:58.932995 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:21:58.932995 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:21:58.932995 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:21:58.932995 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:21:58.932995 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:21:58.932995 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: ac1da8ce26ab49ddae972233777c4c55 Oct 27 03:21:58.932995 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-DeleteServersAdminTestJSON-345610032 Oct 27 03:21:58.932995 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:21:58.932995 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:21:58.934452 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ac1da8ce26ab49ddae972233777c4c55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ac1da8ce26ab49ddae972233777c4c55"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ac1da8ce26ab49ddae972233777c4c55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ac1da8ce26ab49ddae972233777c4c55"}]}] Oct 27 03:21:58.934452 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-DeleteServersAdminTestJSON-345610032 Oct 27 03:21:58.934452 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: ac1da8ce26ab49ddae972233777c4c55 Oct 27 03:21:58.934452 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-345610032 Oct 27 03:21:58.934452 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-DeleteServersAdminTestJSON-345610032-project Oct 27 03:21:58.934452 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:21:58.934452 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:21:58.934452 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: ff070c0383324e1da5c49e3d9c652516 Oct 27 03:21:58.934452 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-DeleteServersAdminTestJSON-345610032-project Oct 27 03:21:58.934452 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:21:58.934452 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 4e4efa06-0a3c-4c11-849d-22bb8d9dccf8 could not be found. Oct 27 03:21:58.934452 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '4e4efa06-0a3c-4c11-849d-22bb8d9dccf8'} Oct 27 03:21:58.935135 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:21:58.935135 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:21:58.935135 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:21:58.935135 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:21:58.935135 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:21:58.935135 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:21:58.935135 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:21:58.935135 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:21:58.935135 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:21:58.935135 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:21:58.935135 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e4efa06-0a3c-4c11-849d-22bb8d9dccf8 could not be found. Oct 27 03:21:58.935135 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:21:58.935135 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:21:58.935135 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:21:58.935135 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:21:58.935135 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:21:58.935135 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:21:58.935135 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:21:58.935135 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:21:58.935135 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:21:58.936761 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:21:58.936761 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:21:58.936761 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:21:58.936761 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:21:58.936761 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:21:58.936761 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:21:58.936761 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:21:58.936761 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e4efa06-0a3c-4c11-849d-22bb8d9dccf8 could not be found. Oct 27 03:21:58.936761 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:21:58.936761 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:21:58.936761 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:21:58.936761 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:21:58.936761 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:21:58.936761 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:21:58.936761 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:21:58.936761 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:21:58.936761 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e4efa06-0a3c-4c11-849d-22bb8d9dccf8 could not be found. Oct 27 03:21:58.936761 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:21:58.941642 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-529f8b06-3eac-42c7-9bf8-738952e0ffca tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Returning 404 to user: Instance 4e4efa06-0a3c-4c11-849d-22bb8d9dccf8 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:21:58.941642 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-529f8b06-3eac-42c7-9bf8-738952e0ffca tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] 10.222.0.20 "GET /compute/v2.1/servers/4e4efa06-0a3c-4c11-849d-22bb8d9dccf8" status: 404 len: 111 microversion: 2.1 time: 0.038394 Oct 27 03:21:58.941642 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 201/410] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:58 2022] GET /compute/v2.1/servers/4e4efa06-0a3c-4c11-849d-22bb8d9dccf8 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:21:58.944595 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-87a80825-ea24-4a44-af4b-40cb8b3c3146 tempest-FlavorsAccessNegativeTestJSON-125708785 tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:59.028449 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-87a80825-ea24-4a44-af4b-40cb8b3c3146 tempest-FlavorsAccessNegativeTestJSON-125708785 tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1622454872" status: 202 len: 0 microversion: 2.1 time: 0.089546 Oct 27 03:21:59.029132 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 202/411] 10.222.0.20 () {58 vars in 1161 bytes} [Thu Oct 27 03:21:58 2022] DELETE /compute/v2.1/flavors/1622454872 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:21:59.033967 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2374d937-7563-48b4-9245-813c2ec2756b tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:59.037222 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-2374d937-7563-48b4-9245-813c2ec2756b tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] [instance: 238948a5-b12d-49a4-a73f-ed65a9f19182] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:59.046639 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2374d937-7563-48b4-9245-813c2ec2756b tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:59.047404 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2374d937-7563-48b4-9245-813c2ec2756b tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:59.048046 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2374d937-7563-48b4-9245-813c2ec2756b tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:59.049135 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2374d937-7563-48b4-9245-813c2ec2756b tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:59.050101 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2374d937-7563-48b4-9245-813c2ec2756b tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:59.050781 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2374d937-7563-48b4-9245-813c2ec2756b tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:59.069927 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-2374d937-7563-48b4-9245-813c2ec2756b tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] HTTP exception thrown: Instance 238948a5-b12d-49a4-a73f-ed65a9f19182 could not be found. Oct 27 03:21:59.072854 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2374d937-7563-48b4-9245-813c2ec2756b tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Request method failure captured: Oct 27 03:21:59.072854 n-d-862769-1 devstack@n-api.service[121000]: request: DELETE /compute/v2.1/servers/238948a5-b12d-49a4-a73f-ed65a9f19182 HTTP/1.1 Oct 27 03:21:59.072854 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:21:59.072854 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:21:59.072854 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:21:59.072854 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:21:59.072854 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:21:59.072854 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:21:59.072854 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:21:59.072854 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:21:59.072854 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfkchMQHvdK7cIQNBhisWxT9inndNR7wogzO6_ui2mdezHvdhj9t8UKoro2RWJXh4pZMglkN7DN3f_oTP4lypXLaAnbXZqDNfcSijqaegrY3lX6ZT1IKK4-7SCDsBlJQjrx46920l7Ge6m_aMYea3rd83mwZDnLyuk0CQ9fFdQjA9yk Oct 27 03:21:59.072854 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:21:59.072854 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:21:59.072854 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:21:59.072854 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:21:59.072854 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:21:59.072854 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:21:59.072854 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: ac1da8ce26ab49ddae972233777c4c55 Oct 27 03:21:59.072854 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-DeleteServersAdminTestJSON-345610032 Oct 27 03:21:59.072854 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:21:59.072854 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:21:59.074069 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ac1da8ce26ab49ddae972233777c4c55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ac1da8ce26ab49ddae972233777c4c55"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ac1da8ce26ab49ddae972233777c4c55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ac1da8ce26ab49ddae972233777c4c55"}]}] Oct 27 03:21:59.074069 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-DeleteServersAdminTestJSON-345610032 Oct 27 03:21:59.074069 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: ac1da8ce26ab49ddae972233777c4c55 Oct 27 03:21:59.074069 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-345610032 Oct 27 03:21:59.074069 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-DeleteServersAdminTestJSON-345610032-project Oct 27 03:21:59.074069 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:21:59.074069 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:21:59.074069 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: ff070c0383324e1da5c49e3d9c652516 Oct 27 03:21:59.074069 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-DeleteServersAdminTestJSON-345610032-project Oct 27 03:21:59.074069 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:21:59.074069 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 238948a5-b12d-49a4-a73f-ed65a9f19182 could not be found. Oct 27 03:21:59.074069 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '238948a5-b12d-49a4-a73f-ed65a9f19182'} Oct 27 03:21:59.074718 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:21:59.074718 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:21:59.074718 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:21:59.074718 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:21:59.074718 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:21:59.074718 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:21:59.074718 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:21:59.074718 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:21:59.074718 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:21:59.074718 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:21:59.074718 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 238948a5-b12d-49a4-a73f-ed65a9f19182 could not be found. Oct 27 03:21:59.074718 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:21:59.074718 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:21:59.074718 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:21:59.074718 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:21:59.074718 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:21:59.074718 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:21:59.074718 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:21:59.074718 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:21:59.074718 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:21:59.075769 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:21:59.075769 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 03:21:59.075769 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 03:21:59.075769 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 03:21:59.075769 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 03:21:59.075769 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:21:59.075769 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:21:59.075769 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:21:59.075769 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:21:59.075769 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 238948a5-b12d-49a4-a73f-ed65a9f19182 could not be found. Oct 27 03:21:59.075769 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:21:59.075769 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:21:59.075769 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:21:59.075769 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:21:59.075769 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:21:59.075769 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:21:59.075769 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:21:59.075769 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:21:59.075769 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 238948a5-b12d-49a4-a73f-ed65a9f19182 could not be found. Oct 27 03:21:59.075769 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:21:59.078955 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2374d937-7563-48b4-9245-813c2ec2756b tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Returning 404 to user: Instance 238948a5-b12d-49a4-a73f-ed65a9f19182 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:21:59.078955 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2374d937-7563-48b4-9245-813c2ec2756b tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] 10.222.0.20 "DELETE /compute/v2.1/servers/238948a5-b12d-49a4-a73f-ed65a9f19182" status: 404 len: 111 microversion: 2.1 time: 0.044622 Oct 27 03:21:59.078955 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 203/412] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:21:59 2022] DELETE /compute/v2.1/servers/238948a5-b12d-49a4-a73f-ed65a9f19182 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:21:59.082085 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e9648199-d8a9-41da-a9d1-55b95e2c0688 tempest-FlavorsAccessNegativeTestJSON-125708785 tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:59.104538 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e9648199-d8a9-41da-a9d1-55b95e2c0688 tempest-FlavorsAccessNegativeTestJSON-125708785 tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028213 Oct 27 03:21:59.114090 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 204/413] 10.222.0.20 () {58 vars in 1146 bytes} [Thu Oct 27 03:21:59 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:59.114090 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ba35222a-6125-4fd6-bdb8-a9273ebb0ff9 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:59.114090 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ba35222a-6125-4fd6-bdb8-a9273ebb0ff9 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] [instance: 238948a5-b12d-49a4-a73f-ed65a9f19182] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:59.127241 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ba35222a-6125-4fd6-bdb8-a9273ebb0ff9 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:59.127885 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ba35222a-6125-4fd6-bdb8-a9273ebb0ff9 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:59.128406 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ba35222a-6125-4fd6-bdb8-a9273ebb0ff9 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:59.129204 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ba35222a-6125-4fd6-bdb8-a9273ebb0ff9 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:59.129760 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ba35222a-6125-4fd6-bdb8-a9273ebb0ff9 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:59.130558 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ba35222a-6125-4fd6-bdb8-a9273ebb0ff9 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:59.146926 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-ba35222a-6125-4fd6-bdb8-a9273ebb0ff9 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] HTTP exception thrown: Instance 238948a5-b12d-49a4-a73f-ed65a9f19182 could not be found. Oct 27 03:21:59.148580 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ba35222a-6125-4fd6-bdb8-a9273ebb0ff9 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Request method failure captured: Oct 27 03:21:59.148580 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/238948a5-b12d-49a4-a73f-ed65a9f19182 HTTP/1.1 Oct 27 03:21:59.148580 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:21:59.148580 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:21:59.148580 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:21:59.148580 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:21:59.148580 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:21:59.148580 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:21:59.148580 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:21:59.148580 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:21:59.148580 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfkchMQHvdK7cIQNBhisWxT9inndNR7wogzO6_ui2mdezHvdhj9t8UKoro2RWJXh4pZMglkN7DN3f_oTP4lypXLaAnbXZqDNfcSijqaegrY3lX6ZT1IKK4-7SCDsBlJQjrx46920l7Ge6m_aMYea3rd83mwZDnLyuk0CQ9fFdQjA9yk Oct 27 03:21:59.148580 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:21:59.148580 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:21:59.148580 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:21:59.148580 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:21:59.148580 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:21:59.148580 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:21:59.148580 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: ac1da8ce26ab49ddae972233777c4c55 Oct 27 03:21:59.148580 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-DeleteServersAdminTestJSON-345610032 Oct 27 03:21:59.148580 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:21:59.148580 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:21:59.149904 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ac1da8ce26ab49ddae972233777c4c55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ac1da8ce26ab49ddae972233777c4c55"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ac1da8ce26ab49ddae972233777c4c55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ac1da8ce26ab49ddae972233777c4c55"}]}] Oct 27 03:21:59.149904 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-DeleteServersAdminTestJSON-345610032 Oct 27 03:21:59.149904 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: ac1da8ce26ab49ddae972233777c4c55 Oct 27 03:21:59.149904 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-345610032 Oct 27 03:21:59.149904 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-DeleteServersAdminTestJSON-345610032-project Oct 27 03:21:59.149904 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:21:59.149904 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:21:59.149904 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: ff070c0383324e1da5c49e3d9c652516 Oct 27 03:21:59.149904 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-DeleteServersAdminTestJSON-345610032-project Oct 27 03:21:59.149904 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:21:59.149904 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 238948a5-b12d-49a4-a73f-ed65a9f19182 could not be found. Oct 27 03:21:59.149904 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '238948a5-b12d-49a4-a73f-ed65a9f19182'} Oct 27 03:21:59.150641 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:21:59.150641 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:21:59.150641 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:21:59.150641 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:21:59.150641 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:21:59.150641 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:21:59.150641 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:21:59.150641 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:21:59.150641 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:21:59.150641 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:21:59.150641 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 238948a5-b12d-49a4-a73f-ed65a9f19182 could not be found. Oct 27 03:21:59.150641 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:21:59.150641 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:21:59.150641 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:21:59.150641 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:21:59.150641 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:21:59.150641 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:21:59.150641 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:21:59.150641 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:21:59.150641 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:21:59.151913 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:21:59.151913 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:21:59.151913 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:21:59.151913 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:21:59.151913 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:21:59.151913 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:21:59.151913 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:21:59.151913 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 238948a5-b12d-49a4-a73f-ed65a9f19182 could not be found. Oct 27 03:21:59.151913 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:21:59.151913 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:21:59.151913 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:21:59.151913 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:21:59.151913 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:21:59.151913 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:21:59.151913 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:21:59.151913 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:21:59.151913 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 238948a5-b12d-49a4-a73f-ed65a9f19182 could not be found. Oct 27 03:21:59.151913 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:21:59.153678 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ba35222a-6125-4fd6-bdb8-a9273ebb0ff9 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] Returning 404 to user: Instance 238948a5-b12d-49a4-a73f-ed65a9f19182 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:21:59.154817 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ba35222a-6125-4fd6-bdb8-a9273ebb0ff9 tempest-DeleteServersAdminTestJSON-345610032 tempest-DeleteServersAdminTestJSON-345610032-project] 10.222.0.20 "GET /compute/v2.1/servers/238948a5-b12d-49a4-a73f-ed65a9f19182" status: 404 len: 111 microversion: 2.1 time: 0.046571 Oct 27 03:21:59.155391 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 205/414] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:59 2022] GET /compute/v2.1/servers/238948a5-b12d-49a4-a73f-ed65a9f19182 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:21:59.159821 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2610c787-20ef-4bd0-9ef3-c96ad2252cb7 tempest-FlavorsAccessNegativeTestJSON-125708785 tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-71577602", "id": 1816787307, "os-flavor-access:is_public": "True"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:21:59.280117 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9692c3aa-e2aa-476d-b217-5b2f5e66bd84 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] 10.222.0.20 "DELETE /compute/v2.1/servers/936d578f-607c-4650-aac3-f06ef6fa7017" status: 204 len: 0 microversion: 2.1 time: 0.527074 Oct 27 03:21:59.281113 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 210/415] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:21:58 2022] DELETE /compute/v2.1/servers/936d578f-607c-4650-aac3-f06ef6fa7017 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:21:59.281682 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2610c787-20ef-4bd0-9ef3-c96ad2252cb7 tempest-FlavorsAccessNegativeTestJSON-125708785 tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.124605 Oct 27 03:21:59.282663 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 206/416] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:21:59 2022] POST /compute/v2.1/flavors => generated 436 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:21:59.292672 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a17083b3-e28e-4fed-8643-b7c6db1d3d3c tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:59.294458 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a17083b3-e28e-4fed-8643-b7c6db1d3d3c tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 5910c783-6877-4a41-8650-0973a11f3578] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:59.295298 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e3e2bfdb-7d9e-4f95-8ee4-fb8a24685ec2 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:59.303428 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e3e2bfdb-7d9e-4f95-8ee4-fb8a24685ec2 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] [instance: 936d578f-607c-4650-aac3-f06ef6fa7017] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:59.303565 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a17083b3-e28e-4fed-8643-b7c6db1d3d3c tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:59.303565 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a17083b3-e28e-4fed-8643-b7c6db1d3d3c tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:59.303565 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a17083b3-e28e-4fed-8643-b7c6db1d3d3c tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:59.304914 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a17083b3-e28e-4fed-8643-b7c6db1d3d3c tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:59.305469 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a17083b3-e28e-4fed-8643-b7c6db1d3d3c tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:59.306181 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a17083b3-e28e-4fed-8643-b7c6db1d3d3c tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:59.308059 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e3e2bfdb-7d9e-4f95-8ee4-fb8a24685ec2 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:59.308566 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e3e2bfdb-7d9e-4f95-8ee4-fb8a24685ec2 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:59.309055 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e3e2bfdb-7d9e-4f95-8ee4-fb8a24685ec2 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:59.309777 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e3e2bfdb-7d9e-4f95-8ee4-fb8a24685ec2 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:59.311238 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e3e2bfdb-7d9e-4f95-8ee4-fb8a24685ec2 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:59.314486 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e3e2bfdb-7d9e-4f95-8ee4-fb8a24685ec2 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:59.498399 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a17083b3-e28e-4fed-8643-b7c6db1d3d3c tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:59.507708 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a17083b3-e28e-4fed-8643-b7c6db1d3d3c tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578" status: 200 len: 1477 microversion: 2.1 time: 0.223541 Oct 27 03:21:59.509296 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 211/417] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:59 2022] GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578 => generated 1477 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:59.515395 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-bfebd686-1008-4fd3-bb74-5f3fdc76b47f tempest-FlavorsAccessNegativeTestJSON-125708785 tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:59.523173 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-bfebd686-1008-4fd3-bb74-5f3fdc76b47f tempest-FlavorsAccessNegativeTestJSON-125708785 tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin] HTTP exception thrown: Access list not available for public flavors. Oct 27 03:21:59.525415 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-bfebd686-1008-4fd3-bb74-5f3fdc76b47f tempest-FlavorsAccessNegativeTestJSON-125708785 tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin] Request method failure captured: Oct 27 03:21:59.525415 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/flavors/1816787307/os-flavor-access HTTP/1.1 Oct 27 03:21:59.525415 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:21:59.525415 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:21:59.525415 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:21:59.525415 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:21:59.525415 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:21:59.525415 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:21:59.525415 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:21:59.525415 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:21:59.525415 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWflSOlj_k_Ll9R8dKOtz8H5nsrworDt1PViHB9BgcTHGcTNOjoJ017F67_-boLM6ysYSAO1LjYQnFiMWeJTBKLvnZYwt1692snbPdVrCA9OLBCyANr6mciEicYr0-p_nAZN3aTZ8BjAxtgnXbePmBHSxRgc9GWRwiRQgOFcQtambqEQ Oct 27 03:21:59.525415 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:21:59.525415 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:21:59.525415 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:21:59.525415 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:21:59.525415 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:21:59.525415 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:21:59.525415 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 3d4dd82f48e04315abb577f300e0c4db Oct 27 03:21:59.525415 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-125708785 Oct 27 03:21:59.525415 n-d-862769-1 devstack@n-api.service[121001]: X-Role: admin,member,reader Oct 27 03:21:59.525415 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: admin,member,reader Oct 27 03:21:59.526681 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3d4dd82f48e04315abb577f300e0c4db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3d4dd82f48e04315abb577f300e0c4db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3d4dd82f48e04315abb577f300e0c4db"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3d4dd82f48e04315abb577f300e0c4db"}]}] Oct 27 03:21:59.526681 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-125708785 Oct 27 03:21:59.526681 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 3d4dd82f48e04315abb577f300e0c4db Oct 27 03:21:59.526681 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-125708785 Oct 27 03:21:59.526681 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin Oct 27 03:21:59.526681 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:21:59.526681 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:21:59.526681 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 91732d221c874b1085b59ecc1e1a60ee Oct 27 03:21:59.526681 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin Oct 27 03:21:59.526681 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:21:59.526681 n-d-862769-1 devstack@n-api.service[121001]: exception: Access list not available for public flavors. Oct 27 03:21:59.526681 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'flavor_id': '1816787307'} Oct 27 03:21:59.527349 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:21:59.527349 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:21:59.527349 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:21:59.527349 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:21:59.527349 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:21:59.527349 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:21:59.527349 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:21:59.527349 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:21:59.527349 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Oct 27 03:21:59.527349 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 27 03:21:59.527349 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Oct 27 03:21:59.527349 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:21:59.527349 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:21:59.527349 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:21:59.527349 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:21:59.527349 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:21:59.527349 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:21:59.527349 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:21:59.527349 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:21:59.527349 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Oct 27 03:21:59.527349 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:21:59.530528 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-bfebd686-1008-4fd3-bb74-5f3fdc76b47f tempest-FlavorsAccessNegativeTestJSON-125708785 tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:21:59.532149 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-bfebd686-1008-4fd3-bb74-5f3fdc76b47f tempest-FlavorsAccessNegativeTestJSON-125708785 tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/1816787307/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.021850 Oct 27 03:21:59.533452 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 212/418] 10.222.0.20 () {58 vars in 1209 bytes} [Thu Oct 27 03:21:59 2022] GET /compute/v2.1/flavors/1816787307/os-flavor-access => generated 91 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 03:21:59.542134 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e070c3cc-6fc1-4069-b8de-09cd1af2db5c tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:59.543046 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e070c3cc-6fc1-4069-b8de-09cd1af2db5c tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:59.546802 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=4,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:21:59.553815 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e070c3cc-6fc1-4069-b8de-09cd1af2db5c tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:59.554575 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e070c3cc-6fc1-4069-b8de-09cd1af2db5c tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:59.555234 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e070c3cc-6fc1-4069-b8de-09cd1af2db5c tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:59.556184 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e070c3cc-6fc1-4069-b8de-09cd1af2db5c tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:59.556845 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e070c3cc-6fc1-4069-b8de-09cd1af2db5c tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:59.557352 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e070c3cc-6fc1-4069-b8de-09cd1af2db5c tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:59.625168 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e3e2bfdb-7d9e-4f95-8ee4-fb8a24685ec2 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3d2208faeb4421af21da56d455be92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b2b8b909c54f36b61d934d09607b5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:59.629566 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e3e2bfdb-7d9e-4f95-8ee4-fb8a24685ec2 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] 10.222.0.20 "GET /compute/v2.1/servers/936d578f-607c-4650-aac3-f06ef6fa7017" status: 200 len: 1466 microversion: 2.1 time: 0.339107 Oct 27 03:21:59.630861 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 207/419] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:59 2022] GET /compute/v2.1/servers/936d578f-607c-4650-aac3-f06ef6fa7017 => generated 1466 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:59.635702 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-397bb27b-79b9-45da-bf0c-fb80063c39e3 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:59.639312 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e070c3cc-6fc1-4069-b8de-09cd1af2db5c tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:59.650789 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-397bb27b-79b9-45da-bf0c-fb80063c39e3 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: d0a79872-c316-4bb2-914c-a118831bc023] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:21:59.656107 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e070c3cc-6fc1-4069-b8de-09cd1af2db5c tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:59.657962 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-397bb27b-79b9-45da-bf0c-fb80063c39e3 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:59.658495 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-397bb27b-79b9-45da-bf0c-fb80063c39e3 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:59.658626 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e070c3cc-6fc1-4069-b8de-09cd1af2db5c tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:59.658946 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-397bb27b-79b9-45da-bf0c-fb80063c39e3 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:59.659721 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-397bb27b-79b9-45da-bf0c-fb80063c39e3 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:21:59.660181 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-397bb27b-79b9-45da-bf0c-fb80063c39e3 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:21:59.660621 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-397bb27b-79b9-45da-bf0c-fb80063c39e3 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:21:59.664926 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e070c3cc-6fc1-4069-b8de-09cd1af2db5c tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1539 microversion: 2.91 time: 0.128276 Oct 27 03:21:59.665854 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 213/420] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:21:59 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1539 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:21:59.683373 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-79d68fb0-863f-45a8-80df-07b64ae4edf0 tempest-FlavorsAccessNegativeTestJSON-125708785 tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:59.767823 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-79d68fb0-863f-45a8-80df-07b64ae4edf0 tempest-FlavorsAccessNegativeTestJSON-125708785 tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1816787307" status: 202 len: 0 microversion: 2.1 time: 0.100706 Oct 27 03:21:59.770251 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 214/421] 10.222.0.20 () {58 vars in 1161 bytes} [Thu Oct 27 03:21:59 2022] DELETE /compute/v2.1/flavors/1816787307 => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:21:59.781650 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-397bb27b-79b9-45da-bf0c-fb80063c39e3 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:21:59.783438 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-60223b19-850b-4379-bb41-b8c03989f5a3 tempest-FlavorsAccessNegativeTestJSON-125708785 tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:21:59.791524 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-397bb27b-79b9-45da-bf0c-fb80063c39e3 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/d0a79872-c316-4bb2-914c-a118831bc023" status: 200 len: 1220 microversion: 2.1 time: 0.159211 Oct 27 03:21:59.792834 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 208/422] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:21:59 2022] GET /compute/v2.1/servers/d0a79872-c316-4bb2-914c-a118831bc023 => generated 1220 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:59.828318 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-60223b19-850b-4379-bb41-b8c03989f5a3 tempest-FlavorsAccessNegativeTestJSON-125708785 tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.049810 Oct 27 03:21:59.829562 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 215/423] 10.222.0.20 () {58 vars in 1146 bytes} [Thu Oct 27 03:21:59 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:21:59.855174 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-76344b6d-dae7-4277-b94a-ef5bc573699a tempest-FlavorsAccessNegativeTestJSON-125708785 tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1709263301", "id": 765656406, "os-flavor-access:is_public": "False"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:21:59.965450 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-76344b6d-dae7-4277-b94a-ef5bc573699a tempest-FlavorsAccessNegativeTestJSON-125708785 tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.113957 Oct 27 03:21:59.966072 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 209/424] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:21:59 2022] POST /compute/v2.1/flavors => generated 436 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:22:00.309932 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-658a6068-d61b-4203-948a-805c2718887a tempest-FlavorsAccessNegativeTestJSON-800989973 tempest-FlavorsAccessNegativeTestJSON-800989973-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "7460b59c19294e8090ba35ceecdb8686"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:22:00.314400 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-658a6068-d61b-4203-948a-805c2718887a tempest-FlavorsAccessNegativeTestJSON-800989973 tempest-FlavorsAccessNegativeTestJSON-800989973-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '2a3bb4b6469145d6951f8e2c8df97f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7460b59c19294e8090ba35ceecdb8686', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:00.317793 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-658a6068-d61b-4203-948a-805c2718887a tempest-FlavorsAccessNegativeTestJSON-800989973 tempest-FlavorsAccessNegativeTestJSON-800989973-project] Request method failure captured: Oct 27 03:22:00.317793 n-d-862769-1 devstack@n-api.service[121001]: request: POST /compute/v2.1/flavors/765656406/action HTTP/1.1 Oct 27 03:22:00.317793 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:22:00.317793 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:22:00.317793 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:22:00.317793 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 67 Oct 27 03:22:00.317793 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:22:00.317793 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:22:00.317793 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:22:00.317793 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:22:00.317793 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWflQmxEbQt97jH_SFpXolA9haSvd7VXzuo65hu5S4BMuLX3iI8AEL7rwDxFDh967581cYFeD-dbxTyhJp8vQc38ZgMShavGT42Mkq2NotNVutp3JwvikkaqblNuh4CTnHwCLv9YyrMXZSex4hxu0HjdLst2vInTp8Qa5lqR91F-LYfs Oct 27 03:22:00.317793 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:22:00.317793 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:22:00.317793 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:22:00.317793 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:22:00.317793 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:22:00.317793 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:22:00.317793 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 7460b59c19294e8090ba35ceecdb8686 Oct 27 03:22:00.317793 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-800989973 Oct 27 03:22:00.317793 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:22:00.317793 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:22:00.323403 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7460b59c19294e8090ba35ceecdb8686"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7460b59c19294e8090ba35ceecdb8686"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7460b59c19294e8090ba35ceecdb8686"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7460b59c19294e8090ba35ceecdb8686"}]}] Oct 27 03:22:00.323403 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-800989973 Oct 27 03:22:00.323403 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 7460b59c19294e8090ba35ceecdb8686 Oct 27 03:22:00.323403 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-800989973 Oct 27 03:22:00.323403 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-FlavorsAccessNegativeTestJSON-800989973-project Oct 27 03:22:00.323403 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:22:00.323403 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:22:00.323403 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 2a3bb4b6469145d6951f8e2c8df97f75 Oct 27 03:22:00.323403 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-800989973-project Oct 27 03:22:00.323403 n-d-862769-1 devstack@n-api.service[121001]: Oct 27 03:22:00.323403 n-d-862769-1 devstack@n-api.service[121001]: {"addTenantAccess": {"tenant": "7460b59c19294e8090ba35ceecdb8686"}} Oct 27 03:22:00.323403 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:22:00.324145 n-d-862769-1 devstack@n-api.service[121001]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 27 03:22:00.324145 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '765656406', 'body': {'addTenantAccess': {'tenant': '7460b59c19294e8090ba35ceecdb8686'}}} Oct 27 03:22:00.324145 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:22:00.324145 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:22:00.324145 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:22:00.324145 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:22:00.324145 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:22:00.324145 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:22:00.324145 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:22:00.324145 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:22:00.324145 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:22:00.324145 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:22:00.324145 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Oct 27 03:22:00.324145 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Oct 27 03:22:00.324145 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 03:22:00.324145 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 03:22:00.324145 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 03:22:00.324145 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 03:22:00.324145 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 03:22:00.325172 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 03:22:00.325172 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 03:22:00.325172 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 03:22:00.325172 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 03:22:00.325172 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 03:22:00.325172 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 03:22:00.325172 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 03:22:00.325172 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 03:22:00.325172 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 03:22:00.325172 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 27 03:22:00.325172 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:22:00.325172 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:22:00.325172 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:22:00.325172 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:22:00.325172 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:22:00.325172 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:22:00.325172 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 03:22:00.325172 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 03:22:00.325172 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 27 03:22:00.325172 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:22:00.326858 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-658a6068-d61b-4203-948a-805c2718887a tempest-FlavorsAccessNegativeTestJSON-800989973 tempest-FlavorsAccessNegativeTestJSON-800989973-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:22:00.326858 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-658a6068-d61b-4203-948a-805c2718887a tempest-FlavorsAccessNegativeTestJSON-800989973 tempest-FlavorsAccessNegativeTestJSON-800989973-project] 10.222.0.20 "POST /compute/v2.1/flavors/765656406/action" status: 403 len: 130 microversion: 2.1 time: 0.344916 Oct 27 03:22:00.326858 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 216/425] 10.222.0.20 () {60 vars in 1197 bytes} [Thu Oct 27 03:21:59 2022] POST /compute/v2.1/flavors/765656406/action => generated 130 bytes in 346 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 27 03:22:00.331412 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d2952d4e-a9ba-4050-a900-6e0a0e2b7e4d tempest-FlavorsAccessNegativeTestJSON-125708785 tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:00.472047 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d2952d4e-a9ba-4050-a900-6e0a0e2b7e4d tempest-FlavorsAccessNegativeTestJSON-125708785 tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/765656406" status: 202 len: 0 microversion: 2.1 time: 0.146264 Oct 27 03:22:00.477367 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 210/426] 10.222.0.20 () {58 vars in 1158 bytes} [Thu Oct 27 03:22:00 2022] DELETE /compute/v2.1/flavors/765656406 => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:22:00.481032 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-fcf242ed-4fde-43d8-b29d-b378e62d0a3b tempest-FlavorsAccessNegativeTestJSON-125708785 tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:00.501003 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-fcf242ed-4fde-43d8-b29d-b378e62d0a3b tempest-FlavorsAccessNegativeTestJSON-125708785 tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023410 Oct 27 03:22:00.506179 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 217/427] 10.222.0.20 () {58 vars in 1146 bytes} [Thu Oct 27 03:22:00 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:22:00.528388 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-35c2a756-d3f8-4a4a-99c1-f53f50e1b9de tempest-FlavorsAccessNegativeTestJSON-125708785 tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1929986622", "id": 415624673, "os-flavor-access:is_public": "False"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:22:00.544971 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-552d01de-9f8f-421f-9a27-a0aa3de94f12 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:00.547254 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-552d01de-9f8f-421f-9a27-a0aa3de94f12 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 5910c783-6877-4a41-8650-0973a11f3578] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:00.556155 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-552d01de-9f8f-421f-9a27-a0aa3de94f12 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:00.556823 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-552d01de-9f8f-421f-9a27-a0aa3de94f12 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:00.557436 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-552d01de-9f8f-421f-9a27-a0aa3de94f12 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:00.558371 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-552d01de-9f8f-421f-9a27-a0aa3de94f12 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:00.558980 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-552d01de-9f8f-421f-9a27-a0aa3de94f12 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:00.559731 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-552d01de-9f8f-421f-9a27-a0aa3de94f12 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:00.637987 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-35c2a756-d3f8-4a4a-99c1-f53f50e1b9de tempest-FlavorsAccessNegativeTestJSON-125708785 tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.114283 Oct 27 03:22:00.638777 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 211/428] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:22:00 2022] POST /compute/v2.1/flavors => generated 436 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:22:00.655719 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ab7b11fd-c1af-442f-9875-2372dc3ebcbe tempest-FlavorsAccessNegativeTestJSON-125708785 tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "7460b59c19294e8090ba35ceecdb8686"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:22:00.738298 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-552d01de-9f8f-421f-9a27-a0aa3de94f12 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:00.749676 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-552d01de-9f8f-421f-9a27-a0aa3de94f12 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578" status: 200 len: 1477 microversion: 2.1 time: 0.222323 Oct 27 03:22:00.762564 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 218/429] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:00 2022] GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578 => generated 1477 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:22:00.762564 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9f2edd52-0235-44d5-a624-bb502f79d3f4 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:00.762564 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-9f2edd52-0235-44d5-a624-bb502f79d3f4 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] [instance: 936d578f-607c-4650-aac3-f06ef6fa7017] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:00.777803 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9f2edd52-0235-44d5-a624-bb502f79d3f4 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:00.778465 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9f2edd52-0235-44d5-a624-bb502f79d3f4 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:00.778769 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9f2edd52-0235-44d5-a624-bb502f79d3f4 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:00.780162 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9f2edd52-0235-44d5-a624-bb502f79d3f4 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:00.780628 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9f2edd52-0235-44d5-a624-bb502f79d3f4 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:00.781062 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9f2edd52-0235-44d5-a624-bb502f79d3f4 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:01.150492 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ab7b11fd-c1af-442f-9875-2372dc3ebcbe tempest-FlavorsAccessNegativeTestJSON-125708785 tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/415624673/action" status: 200 len: 96 microversion: 2.1 time: 0.501811 Oct 27 03:22:01.153885 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 212/430] 10.222.0.20 () {60 vars in 1197 bytes} [Thu Oct 27 03:22:00 2022] POST /compute/v2.1/flavors/415624673/action => generated 96 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 27 03:22:01.174410 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9f2edd52-0235-44d5-a624-bb502f79d3f4 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3d2208faeb4421af21da56d455be92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b2b8b909c54f36b61d934d09607b5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:01.176495 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4624755f-8dae-4446-b947-c4c0b2fe4374 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:01.179850 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4624755f-8dae-4446-b947-c4c0b2fe4374 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:01.186691 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9f2edd52-0235-44d5-a624-bb502f79d3f4 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] 10.222.0.20 "GET /compute/v2.1/servers/936d578f-607c-4650-aac3-f06ef6fa7017" status: 200 len: 1466 microversion: 2.1 time: 0.431116 Oct 27 03:22:01.198245 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4624755f-8dae-4446-b947-c4c0b2fe4374 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:01.199037 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 219/431] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:00 2022] GET /compute/v2.1/servers/936d578f-607c-4650-aac3-f06ef6fa7017 => generated 1466 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:22:01.200525 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4624755f-8dae-4446-b947-c4c0b2fe4374 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:01.202650 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4624755f-8dae-4446-b947-c4c0b2fe4374 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:01.211895 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4624755f-8dae-4446-b947-c4c0b2fe4374 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:01.211895 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4624755f-8dae-4446-b947-c4c0b2fe4374 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:01.211895 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4624755f-8dae-4446-b947-c4c0b2fe4374 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:01.217528 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-42c5f035-4a22-4d45-a933-ae4707fa833d tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:01.218272 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-42c5f035-4a22-4d45-a933-ae4707fa833d tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: d0a79872-c316-4bb2-914c-a118831bc023] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:01.229168 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-42c5f035-4a22-4d45-a933-ae4707fa833d tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:01.231524 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-42c5f035-4a22-4d45-a933-ae4707fa833d tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:01.232041 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-42c5f035-4a22-4d45-a933-ae4707fa833d tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:01.232822 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-42c5f035-4a22-4d45-a933-ae4707fa833d tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:01.233269 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-42c5f035-4a22-4d45-a933-ae4707fa833d tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:01.237952 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-42c5f035-4a22-4d45-a933-ae4707fa833d tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:01.376770 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4624755f-8dae-4446-b947-c4c0b2fe4374 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:01.377394 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-42c5f035-4a22-4d45-a933-ae4707fa833d tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:01.393377 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4624755f-8dae-4446-b947-c4c0b2fe4374 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:01.397988 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4624755f-8dae-4446-b947-c4c0b2fe4374 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:01.398162 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-42c5f035-4a22-4d45-a933-ae4707fa833d tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/d0a79872-c316-4bb2-914c-a118831bc023" status: 200 len: 1276 microversion: 2.1 time: 0.197037 Oct 27 03:22:01.418173 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 220/432] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:01 2022] GET /compute/v2.1/servers/d0a79872-c316-4bb2-914c-a118831bc023 => generated 1276 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:22:01.419083 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4624755f-8dae-4446-b947-c4c0b2fe4374 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1539 microversion: 2.91 time: 0.263649 Oct 27 03:22:01.430647 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ac41ea4b-80a7-4b8d-b5de-020e47d8231d tempest-FlavorsAccessNegativeTestJSON-800989973 tempest-FlavorsAccessNegativeTestJSON-800989973-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "7460b59c19294e8090ba35ceecdb8686"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:22:01.437177 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 213/433] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:22:01 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1539 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:22:01.437965 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ac41ea4b-80a7-4b8d-b5de-020e47d8231d tempest-FlavorsAccessNegativeTestJSON-800989973 tempest-FlavorsAccessNegativeTestJSON-800989973-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '2a3bb4b6469145d6951f8e2c8df97f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7460b59c19294e8090ba35ceecdb8686', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:01.440949 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ac41ea4b-80a7-4b8d-b5de-020e47d8231d tempest-FlavorsAccessNegativeTestJSON-800989973 tempest-FlavorsAccessNegativeTestJSON-800989973-project] Request method failure captured: Oct 27 03:22:01.440949 n-d-862769-1 devstack@n-api.service[121001]: request: POST /compute/v2.1/flavors/415624673/action HTTP/1.1 Oct 27 03:22:01.440949 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:22:01.440949 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:22:01.440949 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:22:01.440949 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 70 Oct 27 03:22:01.440949 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:22:01.440949 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:22:01.440949 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:22:01.440949 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:22:01.440949 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWflQmxEbQt97jH_SFpXolA9haSvd7VXzuo65hu5S4BMuLX3iI8AEL7rwDxFDh967581cYFeD-dbxTyhJp8vQc38ZgMShavGT42Mkq2NotNVutp3JwvikkaqblNuh4CTnHwCLv9YyrMXZSex4hxu0HjdLst2vInTp8Qa5lqR91F-LYfs Oct 27 03:22:01.440949 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:22:01.440949 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:22:01.440949 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:22:01.440949 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:22:01.440949 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:22:01.440949 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:22:01.440949 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 7460b59c19294e8090ba35ceecdb8686 Oct 27 03:22:01.440949 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-800989973 Oct 27 03:22:01.440949 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:22:01.440949 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:22:01.442307 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7460b59c19294e8090ba35ceecdb8686"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7460b59c19294e8090ba35ceecdb8686"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7460b59c19294e8090ba35ceecdb8686"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7460b59c19294e8090ba35ceecdb8686"}]}] Oct 27 03:22:01.442307 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-800989973 Oct 27 03:22:01.442307 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 7460b59c19294e8090ba35ceecdb8686 Oct 27 03:22:01.442307 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-800989973 Oct 27 03:22:01.442307 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-FlavorsAccessNegativeTestJSON-800989973-project Oct 27 03:22:01.442307 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:22:01.442307 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:22:01.442307 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 2a3bb4b6469145d6951f8e2c8df97f75 Oct 27 03:22:01.442307 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-800989973-project Oct 27 03:22:01.442307 n-d-862769-1 devstack@n-api.service[121001]: Oct 27 03:22:01.442307 n-d-862769-1 devstack@n-api.service[121001]: {"removeTenantAccess": {"tenant": "7460b59c19294e8090ba35ceecdb8686"}} Oct 27 03:22:01.442307 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:22:01.442958 n-d-862769-1 devstack@n-api.service[121001]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 27 03:22:01.442958 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '415624673', 'body': {'removeTenantAccess': {'tenant': '7460b59c19294e8090ba35ceecdb8686'}}} Oct 27 03:22:01.442958 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:22:01.442958 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:22:01.442958 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:22:01.442958 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:22:01.442958 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:22:01.442958 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:22:01.442958 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:22:01.442958 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:22:01.442958 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:22:01.442958 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:22:01.442958 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Oct 27 03:22:01.442958 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi context.can( Oct 27 03:22:01.442958 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 03:22:01.442958 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 03:22:01.442958 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 03:22:01.442958 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 03:22:01.442958 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 03:22:01.442958 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 03:22:01.444019 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 03:22:01.444019 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 03:22:01.444019 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 03:22:01.444019 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 03:22:01.444019 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 03:22:01.444019 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 03:22:01.444019 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 03:22:01.444019 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 03:22:01.444019 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 27 03:22:01.444019 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:22:01.444019 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:22:01.444019 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:22:01.444019 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:22:01.444019 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:22:01.444019 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:22:01.444019 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 03:22:01.444019 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 03:22:01.444019 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 27 03:22:01.444019 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:22:01.446824 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ac41ea4b-80a7-4b8d-b5de-020e47d8231d tempest-FlavorsAccessNegativeTestJSON-800989973 tempest-FlavorsAccessNegativeTestJSON-800989973-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:22:01.448787 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ac41ea4b-80a7-4b8d-b5de-020e47d8231d tempest-FlavorsAccessNegativeTestJSON-800989973 tempest-FlavorsAccessNegativeTestJSON-800989973-project] 10.222.0.20 "POST /compute/v2.1/flavors/415624673/action" status: 403 len: 133 microversion: 2.1 time: 0.028428 Oct 27 03:22:01.452047 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 221/434] 10.222.0.20 () {60 vars in 1197 bytes} [Thu Oct 27 03:22:01 2022] POST /compute/v2.1/flavors/415624673/action => generated 133 bytes in 33 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:22:01.463106 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5c8fd1a2-5fc1-4b48-b198-50db99005f1f tempest-FlavorsAccessNegativeTestJSON-125708785 tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "7460b59c19294e8090ba35ceecdb8686"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:22:01.775223 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-69f01301-16d4-4552-b4b6-21de1cc600c1 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:01.776033 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-69f01301-16d4-4552-b4b6-21de1cc600c1 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 5910c783-6877-4a41-8650-0973a11f3578] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:01.791540 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-69f01301-16d4-4552-b4b6-21de1cc600c1 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:01.792787 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-69f01301-16d4-4552-b4b6-21de1cc600c1 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:01.793583 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-69f01301-16d4-4552-b4b6-21de1cc600c1 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:01.795378 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-69f01301-16d4-4552-b4b6-21de1cc600c1 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:01.795928 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-69f01301-16d4-4552-b4b6-21de1cc600c1 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:01.797817 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-69f01301-16d4-4552-b4b6-21de1cc600c1 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:01.863061 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5c8fd1a2-5fc1-4b48-b198-50db99005f1f tempest-FlavorsAccessNegativeTestJSON-125708785 tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/415624673/action" status: 200 len: 21 microversion: 2.1 time: 0.406632 Oct 27 03:22:01.863678 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 214/435] 10.222.0.20 () {60 vars in 1197 bytes} [Thu Oct 27 03:22:01 2022] POST /compute/v2.1/flavors/415624673/action => generated 21 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 03:22:01.880135 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-223345de-59a2-4d6d-ac5b-20d26ce38cb7 tempest-FlavorsAccessNegativeTestJSON-125708785 tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:02.068690 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-223345de-59a2-4d6d-ac5b-20d26ce38cb7 tempest-FlavorsAccessNegativeTestJSON-125708785 tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/415624673" status: 202 len: 0 microversion: 2.1 time: 0.198878 Oct 27 03:22:02.069519 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 215/436] 10.222.0.20 () {58 vars in 1158 bytes} [Thu Oct 27 03:22:01 2022] DELETE /compute/v2.1/flavors/415624673 => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 03:22:02.078660 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-eba4eda2-25d0-40c1-b8f3-a83bdc55a957 tempest-FlavorsAccessNegativeTestJSON-125708785 tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:02.110430 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=7,nova_api:DELETE=11 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:02.140724 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-eba4eda2-25d0-40c1-b8f3-a83bdc55a957 tempest-FlavorsAccessNegativeTestJSON-125708785 tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.066635 Oct 27 03:22:02.144592 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 216/437] 10.222.0.20 () {58 vars in 1146 bytes} [Thu Oct 27 03:22:02 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:22:02.170540 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0ef32d57-d246-40eb-acb2-04cc4708c6f8 tempest-FlavorsAccessNegativeTestJSON-125708785 tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-173125082", "id": 1543394406, "os-flavor-access:is_public": "False"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:22:02.274723 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-69f01301-16d4-4552-b4b6-21de1cc600c1 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:02.288106 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0ef32d57-d246-40eb-acb2-04cc4708c6f8 tempest-FlavorsAccessNegativeTestJSON-125708785 tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.127441 Oct 27 03:22:02.289085 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 217/438] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:22:02 2022] POST /compute/v2.1/flavors => generated 438 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:22:02.293404 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-69f01301-16d4-4552-b4b6-21de1cc600c1 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578" status: 200 len: 1477 microversion: 2.1 time: 0.523813 Oct 27 03:22:02.298275 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 222/439] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:01 2022] GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578 => generated 1477 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:22:02.300874 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b6753851-7c1a-4683-a3df-824ad0ae26bb tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:02.301647 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b6753851-7c1a-4683-a3df-824ad0ae26bb tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] [instance: 936d578f-607c-4650-aac3-f06ef6fa7017] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:02.309080 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b6753851-7c1a-4683-a3df-824ad0ae26bb tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:02.309747 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b6753851-7c1a-4683-a3df-824ad0ae26bb tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:02.316072 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-23ef2668-86ae-46ac-a6cc-73be33ab7ef8 tempest-FlavorsAccessNegativeTestJSON-125708785 tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "66e9e7e2054d49ca88a72c1f0e14b9f8"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:22:02.321352 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b6753851-7c1a-4683-a3df-824ad0ae26bb tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:02.322853 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b6753851-7c1a-4683-a3df-824ad0ae26bb tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:02.326257 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b6753851-7c1a-4683-a3df-824ad0ae26bb tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:02.326907 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b6753851-7c1a-4683-a3df-824ad0ae26bb tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:02.441878 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-23ef2668-86ae-46ac-a6cc-73be33ab7ef8 tempest-FlavorsAccessNegativeTestJSON-125708785 tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin] HTTP exception thrown: Flavor access not found for 34 / 66e9e7e2054d49ca88a72c1f0e14b9f8 combination. Oct 27 03:22:02.443717 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-23ef2668-86ae-46ac-a6cc-73be33ab7ef8 tempest-FlavorsAccessNegativeTestJSON-125708785 tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin] Request method failure captured: Oct 27 03:22:02.443717 n-d-862769-1 devstack@n-api.service[121001]: request: POST /compute/v2.1/flavors/1543394406/action HTTP/1.1 Oct 27 03:22:02.443717 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:22:02.443717 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:22:02.443717 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:22:02.443717 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 70 Oct 27 03:22:02.443717 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:22:02.443717 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:22:02.443717 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:22:02.443717 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:22:02.443717 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWflSOlj_k_Ll9R8dKOtz8H5nsrworDt1PViHB9BgcTHGcTNOjoJ017F67_-boLM6ysYSAO1LjYQnFiMWeJTBKLvnZYwt1692snbPdVrCA9OLBCyANr6mciEicYr0-p_nAZN3aTZ8BjAxtgnXbePmBHSxRgc9GWRwiRQgOFcQtambqEQ Oct 27 03:22:02.443717 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:22:02.443717 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:22:02.443717 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:22:02.443717 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:22:02.443717 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:22:02.443717 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:22:02.443717 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 3d4dd82f48e04315abb577f300e0c4db Oct 27 03:22:02.443717 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-125708785 Oct 27 03:22:02.443717 n-d-862769-1 devstack@n-api.service[121001]: X-Role: admin,member,reader Oct 27 03:22:02.443717 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: admin,member,reader Oct 27 03:22:02.445179 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3d4dd82f48e04315abb577f300e0c4db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3d4dd82f48e04315abb577f300e0c4db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3d4dd82f48e04315abb577f300e0c4db"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3d4dd82f48e04315abb577f300e0c4db"}]}] Oct 27 03:22:02.445179 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-125708785 Oct 27 03:22:02.445179 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 3d4dd82f48e04315abb577f300e0c4db Oct 27 03:22:02.445179 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-125708785 Oct 27 03:22:02.445179 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin Oct 27 03:22:02.445179 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:22:02.445179 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:22:02.445179 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 91732d221c874b1085b59ecc1e1a60ee Oct 27 03:22:02.445179 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin Oct 27 03:22:02.445179 n-d-862769-1 devstack@n-api.service[121001]: Oct 27 03:22:02.445179 n-d-862769-1 devstack@n-api.service[121001]: {"removeTenantAccess": {"tenant": "66e9e7e2054d49ca88a72c1f0e14b9f8"}} Oct 27 03:22:02.445179 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:22:02.445920 n-d-862769-1 devstack@n-api.service[121001]: exception: Flavor access not found for 34 / 66e9e7e2054d49ca88a72c1f0e14b9f8 combination. Oct 27 03:22:02.445920 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '1543394406', 'body': {'removeTenantAccess': {'tenant': '66e9e7e2054d49ca88a72c1f0e14b9f8'}}} Oct 27 03:22:02.445920 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:22:02.445920 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:22:02.445920 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Oct 27 03:22:02.445920 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Oct 27 03:22:02.445920 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 27 03:22:02.445920 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 27 03:22:02.445920 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Oct 27 03:22:02.445920 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Oct 27 03:22:02.445920 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Oct 27 03:22:02.445920 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Oct 27 03:22:02.445920 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Oct 27 03:22:02.445920 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Oct 27 03:22:02.445920 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 03:22:02.445920 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 03:22:02.445920 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Oct 27 03:22:02.445920 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Oct 27 03:22:02.448342 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 34 / 66e9e7e2054d49ca88a72c1f0e14b9f8 combination. Oct 27 03:22:02.448342 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:22:02.448342 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:22:02.448342 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:22:02.448342 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:22:02.448342 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:22:02.448342 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:22:02.448342 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:22:02.448342 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:22:02.448342 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:22:02.448342 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:22:02.448342 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:22:02.448342 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:22:02.448342 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Oct 27 03:22:02.448342 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:22:02.448342 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 34 / 66e9e7e2054d49ca88a72c1f0e14b9f8 combination. Oct 27 03:22:02.448342 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:22:02.448342 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:22:02.448342 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:22:02.448342 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:22:02.450294 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:22:02.450294 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:22:02.450294 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:22:02.450294 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:22:02.450294 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 34 / 66e9e7e2054d49ca88a72c1f0e14b9f8 combination. Oct 27 03:22:02.450294 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:22:02.450294 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-23ef2668-86ae-46ac-a6cc-73be33ab7ef8 tempest-FlavorsAccessNegativeTestJSON-125708785 tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin] Returning 404 to user: Flavor access not found for 34 / 66e9e7e2054d49ca88a72c1f0e14b9f8 combination. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:22:02.450294 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-23ef2668-86ae-46ac-a6cc-73be33ab7ef8 tempest-FlavorsAccessNegativeTestJSON-125708785 tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/1543394406/action" status: 404 len: 124 microversion: 2.1 time: 0.145710 Oct 27 03:22:02.450294 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 223/440] 10.222.0.20 () {60 vars in 1200 bytes} [Thu Oct 27 03:22:02 2022] POST /compute/v2.1/flavors/1543394406/action => generated 124 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:22:02.458477 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-edb7f230-ef3f-4af0-8b31-b6274b1c4283 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:02.462186 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-edb7f230-ef3f-4af0-8b31-b6274b1c4283 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: d0a79872-c316-4bb2-914c-a118831bc023] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:02.469929 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-edb7f230-ef3f-4af0-8b31-b6274b1c4283 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:02.469929 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-edb7f230-ef3f-4af0-8b31-b6274b1c4283 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:02.469929 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-edb7f230-ef3f-4af0-8b31-b6274b1c4283 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:02.479584 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-edb7f230-ef3f-4af0-8b31-b6274b1c4283 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:02.481432 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-edb7f230-ef3f-4af0-8b31-b6274b1c4283 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:02.483553 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-edb7f230-ef3f-4af0-8b31-b6274b1c4283 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:02.729288 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-edb7f230-ef3f-4af0-8b31-b6274b1c4283 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:02.745664 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-edb7f230-ef3f-4af0-8b31-b6274b1c4283 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/d0a79872-c316-4bb2-914c-a118831bc023" status: 200 len: 1274 microversion: 2.1 time: 0.298120 Oct 27 03:22:02.766920 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 224/441] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:02 2022] GET /compute/v2.1/servers/d0a79872-c316-4bb2-914c-a118831bc023 => generated 1274 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:22:02.774163 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-24ae6d9f-a599-4403-b35b-97c69c0fea9f tempest-FlavorsAccessNegativeTestJSON-125708785 tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:02.903622 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-24ae6d9f-a599-4403-b35b-97c69c0fea9f tempest-FlavorsAccessNegativeTestJSON-125708785 tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1543394406" status: 202 len: 0 microversion: 2.1 time: 0.132258 Oct 27 03:22:02.903622 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 225/442] 10.222.0.20 () {58 vars in 1161 bytes} [Thu Oct 27 03:22:02 2022] DELETE /compute/v2.1/flavors/1543394406 => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:22:02.909167 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-fa424398-4598-490d-9629-7718a2c43d4d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:02.910647 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-fa424398-4598-490d-9629-7718a2c43d4d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:02.921432 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fa424398-4598-490d-9629-7718a2c43d4d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:02.921973 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fa424398-4598-490d-9629-7718a2c43d4d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:02.922494 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fa424398-4598-490d-9629-7718a2c43d4d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:02.923467 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fa424398-4598-490d-9629-7718a2c43d4d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:02.924111 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fa424398-4598-490d-9629-7718a2c43d4d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:02.924814 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fa424398-4598-490d-9629-7718a2c43d4d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:03.063012 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b6753851-7c1a-4683-a3df-824ad0ae26bb tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3d2208faeb4421af21da56d455be92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b2b8b909c54f36b61d934d09607b5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:03.073318 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b6753851-7c1a-4683-a3df-824ad0ae26bb tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] 10.222.0.20 "GET /compute/v2.1/servers/936d578f-607c-4650-aac3-f06ef6fa7017" status: 200 len: 1466 microversion: 2.1 time: 0.782942 Oct 27 03:22:03.074691 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 218/443] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:02 2022] GET /compute/v2.1/servers/936d578f-607c-4650-aac3-f06ef6fa7017 => generated 1466 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:22:03.079120 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-fa424398-4598-490d-9629-7718a2c43d4d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:03.088267 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-589703cd-ced3-42e2-8c52-ed879bba18a7 tempest-FlavorsAccessNegativeTestJSON-125708785 tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:03.104531 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-fa424398-4598-490d-9629-7718a2c43d4d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:03.112903 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-fa424398-4598-490d-9629-7718a2c43d4d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:03.136533 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-589703cd-ced3-42e2-8c52-ed879bba18a7 tempest-FlavorsAccessNegativeTestJSON-125708785 tempest-FlavorsAccessNegativeTestJSON-125708785-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.056349 Oct 27 03:22:03.141957 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 219/444] 10.222.0.20 () {58 vars in 1146 bytes} [Thu Oct 27 03:22:03 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:22:03.146716 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-fa424398-4598-490d-9629-7718a2c43d4d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1555 microversion: 2.91 time: 0.242610 Oct 27 03:22:03.148592 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 226/445] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:22:02 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1555 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:22:03.328998 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-77020437-45ce-4ed7-a497-d6bc7a9e0300 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:03.330172 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-77020437-45ce-4ed7-a497-d6bc7a9e0300 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 5910c783-6877-4a41-8650-0973a11f3578] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:03.349300 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-77020437-45ce-4ed7-a497-d6bc7a9e0300 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:03.354949 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-77020437-45ce-4ed7-a497-d6bc7a9e0300 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:03.355552 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-77020437-45ce-4ed7-a497-d6bc7a9e0300 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:03.356482 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-77020437-45ce-4ed7-a497-d6bc7a9e0300 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:03.357087 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-77020437-45ce-4ed7-a497-d6bc7a9e0300 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:03.357528 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-77020437-45ce-4ed7-a497-d6bc7a9e0300 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:03.772741 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-afc8f383-7be1-43aa-bdb8-452d14258771 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:03.773376 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-afc8f383-7be1-43aa-bdb8-452d14258771 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: d0a79872-c316-4bb2-914c-a118831bc023] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:03.784262 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-afc8f383-7be1-43aa-bdb8-452d14258771 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:03.785793 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-afc8f383-7be1-43aa-bdb8-452d14258771 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:03.787464 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-afc8f383-7be1-43aa-bdb8-452d14258771 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:03.788596 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-afc8f383-7be1-43aa-bdb8-452d14258771 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:03.792669 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-afc8f383-7be1-43aa-bdb8-452d14258771 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:03.795874 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-afc8f383-7be1-43aa-bdb8-452d14258771 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:03.810140 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:04.061666 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-afc8f383-7be1-43aa-bdb8-452d14258771 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:04.072322 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-afc8f383-7be1-43aa-bdb8-452d14258771 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/d0a79872-c316-4bb2-914c-a118831bc023" status: 200 len: 1274 microversion: 2.1 time: 0.301627 Oct 27 03:22:04.082247 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 227/446] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:03 2022] GET /compute/v2.1/servers/d0a79872-c316-4bb2-914c-a118831bc023 => generated 1274 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:22:04.101755 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-669ba6df-54cc-4e37-b104-7d2da89e7cb9 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:04.102544 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-669ba6df-54cc-4e37-b104-7d2da89e7cb9 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] [instance: 936d578f-607c-4650-aac3-f06ef6fa7017] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:04.114565 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-669ba6df-54cc-4e37-b104-7d2da89e7cb9 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:04.118011 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-669ba6df-54cc-4e37-b104-7d2da89e7cb9 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:04.122763 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-669ba6df-54cc-4e37-b104-7d2da89e7cb9 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:04.122763 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-669ba6df-54cc-4e37-b104-7d2da89e7cb9 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:04.122763 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-669ba6df-54cc-4e37-b104-7d2da89e7cb9 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:04.122763 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-669ba6df-54cc-4e37-b104-7d2da89e7cb9 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:04.327961 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-669ba6df-54cc-4e37-b104-7d2da89e7cb9 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3d2208faeb4421af21da56d455be92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b2b8b909c54f36b61d934d09607b5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:04.336435 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-669ba6df-54cc-4e37-b104-7d2da89e7cb9 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] 10.222.0.20 "GET /compute/v2.1/servers/936d578f-607c-4650-aac3-f06ef6fa7017" status: 200 len: 1424 microversion: 2.1 time: 0.238253 Oct 27 03:22:04.336861 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 228/447] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:04 2022] GET /compute/v2.1/servers/936d578f-607c-4650-aac3-f06ef6fa7017 => generated 1424 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:22:04.365155 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a032bdb3-eb5f-4d18-a720-8bc83b94c254 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:04.365155 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a032bdb3-eb5f-4d18-a720-8bc83b94c254 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:04.380960 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a032bdb3-eb5f-4d18-a720-8bc83b94c254 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:04.381463 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a032bdb3-eb5f-4d18-a720-8bc83b94c254 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:04.386469 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a032bdb3-eb5f-4d18-a720-8bc83b94c254 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:04.389424 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a032bdb3-eb5f-4d18-a720-8bc83b94c254 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:04.389932 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a032bdb3-eb5f-4d18-a720-8bc83b94c254 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:04.390408 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a032bdb3-eb5f-4d18-a720-8bc83b94c254 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:04.567718 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a032bdb3-eb5f-4d18-a720-8bc83b94c254 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:04.578279 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a032bdb3-eb5f-4d18-a720-8bc83b94c254 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:04.580154 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a032bdb3-eb5f-4d18-a720-8bc83b94c254 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:04.587282 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a032bdb3-eb5f-4d18-a720-8bc83b94c254 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1555 microversion: 2.91 time: 0.242700 Oct 27 03:22:04.588024 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 229/448] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:22:04 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1555 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:22:04.657648 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-ab65c8a2-3104-4a4b-88c4-b931ac24b86d req-e8c82e74-030e-462d-8b5e-a0fe7e6c0f1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "936d578f-607c-4650-aac3-f06ef6fa7017", "name": "network-vif-deleted", "tag": "95ac5197-dd73-4b11-ab34-6be4bf7c6fa6"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:22:04.709929 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-ab65c8a2-3104-4a4b-88c4-b931ac24b86d req-e8c82e74-030e-462d-8b5e-a0fe7e6c0f1e service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:04.710567 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-ab65c8a2-3104-4a4b-88c4-b931ac24b86d req-e8c82e74-030e-462d-8b5e-a0fe7e6c0f1e service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:04.711829 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-ab65c8a2-3104-4a4b-88c4-b931ac24b86d req-e8c82e74-030e-462d-8b5e-a0fe7e6c0f1e service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:04.750079 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-ab65c8a2-3104-4a4b-88c4-b931ac24b86d req-e8c82e74-030e-462d-8b5e-a0fe7e6c0f1e service nova] Creating event network-vif-deleted:95ac5197-dd73-4b11-ab34-6be4bf7c6fa6 for instance 936d578f-607c-4650-aac3-f06ef6fa7017 on n-h1-862769-1 Oct 27 03:22:04.764251 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-ab65c8a2-3104-4a4b-88c4-b931ac24b86d req-e8c82e74-030e-462d-8b5e-a0fe7e6c0f1e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121680 Oct 27 03:22:04.768418 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 230/449] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:22:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:22:05.102192 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c128ded8-5bc0-49ae-92e3-ed0e8d1aadc1 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:05.109340 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c128ded8-5bc0-49ae-92e3-ed0e8d1aadc1 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: d0a79872-c316-4bb2-914c-a118831bc023] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:05.124119 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c128ded8-5bc0-49ae-92e3-ed0e8d1aadc1 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:05.124631 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c128ded8-5bc0-49ae-92e3-ed0e8d1aadc1 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:05.125084 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c128ded8-5bc0-49ae-92e3-ed0e8d1aadc1 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:05.129763 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c128ded8-5bc0-49ae-92e3-ed0e8d1aadc1 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:05.130302 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c128ded8-5bc0-49ae-92e3-ed0e8d1aadc1 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:05.135623 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c128ded8-5bc0-49ae-92e3-ed0e8d1aadc1 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:05.235219 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-77020437-45ce-4ed7-a497-d6bc7a9e0300 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:05.245501 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-77020437-45ce-4ed7-a497-d6bc7a9e0300 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578" status: 200 len: 1477 microversion: 2.1 time: 1.922056 Oct 27 03:22:05.250816 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 220/450] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:03 2022] GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578 => generated 1477 bytes in 1928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:22:05.367041 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0943e502-bd99-4631-aeca-6f292175ddba tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:05.367672 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0943e502-bd99-4631-aeca-6f292175ddba tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] [instance: 936d578f-607c-4650-aac3-f06ef6fa7017] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:05.391819 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0943e502-bd99-4631-aeca-6f292175ddba tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:05.392408 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0943e502-bd99-4631-aeca-6f292175ddba tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:05.392841 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0943e502-bd99-4631-aeca-6f292175ddba tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:05.393443 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0943e502-bd99-4631-aeca-6f292175ddba tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:05.393898 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0943e502-bd99-4631-aeca-6f292175ddba tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:05.394355 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0943e502-bd99-4631-aeca-6f292175ddba tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:05.477718 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0943e502-bd99-4631-aeca-6f292175ddba tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:05.480705 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0943e502-bd99-4631-aeca-6f292175ddba tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:05.481366 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0943e502-bd99-4631-aeca-6f292175ddba tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:05.486379 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-0943e502-bd99-4631-aeca-6f292175ddba tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lazy-loading 'fault' on Instance uuid 936d578f-607c-4650-aac3-f06ef6fa7017 {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:22:05.618408 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0943e502-bd99-4631-aeca-6f292175ddba tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3d2208faeb4421af21da56d455be92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b2b8b909c54f36b61d934d09607b5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:05.627050 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0943e502-bd99-4631-aeca-6f292175ddba tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] 10.222.0.20 "GET /compute/v2.1/servers/936d578f-607c-4650-aac3-f06ef6fa7017" status: 200 len: 1309 microversion: 2.1 time: 0.271356 Oct 27 03:22:05.635247 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 221/451] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:05 2022] GET /compute/v2.1/servers/936d578f-607c-4650-aac3-f06ef6fa7017 => generated 1309 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:22:05.642360 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-26d53326-7d0f-4ca0-bb09-01dc7e4ea33d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:05.649705 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-26d53326-7d0f-4ca0-bb09-01dc7e4ea33d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:05.674006 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-26d53326-7d0f-4ca0-bb09-01dc7e4ea33d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:05.674958 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-26d53326-7d0f-4ca0-bb09-01dc7e4ea33d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:05.675630 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-26d53326-7d0f-4ca0-bb09-01dc7e4ea33d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:05.676626 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-26d53326-7d0f-4ca0-bb09-01dc7e4ea33d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:05.677886 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-26d53326-7d0f-4ca0-bb09-01dc7e4ea33d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:05.678565 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-26d53326-7d0f-4ca0-bb09-01dc7e4ea33d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:05.871063 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-26d53326-7d0f-4ca0-bb09-01dc7e4ea33d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:05.884440 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-26d53326-7d0f-4ca0-bb09-01dc7e4ea33d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:05.886969 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-26d53326-7d0f-4ca0-bb09-01dc7e4ea33d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:05.910826 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-26d53326-7d0f-4ca0-bb09-01dc7e4ea33d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1555 microversion: 2.91 time: 0.272238 Oct 27 03:22:05.931504 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 222/452] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:22:05 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1555 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:22:06.276463 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5c2e7780-3974-4cc0-ac9e-2ccb8a85c077 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:06.276463 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5c2e7780-3974-4cc0-ac9e-2ccb8a85c077 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 5910c783-6877-4a41-8650-0973a11f3578] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:06.288805 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5c2e7780-3974-4cc0-ac9e-2ccb8a85c077 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:06.289316 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5c2e7780-3974-4cc0-ac9e-2ccb8a85c077 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:06.293813 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5c2e7780-3974-4cc0-ac9e-2ccb8a85c077 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:06.295756 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5c2e7780-3974-4cc0-ac9e-2ccb8a85c077 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:06.296523 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5c2e7780-3974-4cc0-ac9e-2ccb8a85c077 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:06.298805 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5c2e7780-3974-4cc0-ac9e-2ccb8a85c077 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:06.338923 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:06.482322 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c128ded8-5bc0-49ae-92e3-ed0e8d1aadc1 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:06.493631 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c128ded8-5bc0-49ae-92e3-ed0e8d1aadc1 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/d0a79872-c316-4bb2-914c-a118831bc023" status: 200 len: 1316 microversion: 2.1 time: 1.398605 Oct 27 03:22:06.505581 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 231/453] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:05 2022] GET /compute/v2.1/servers/d0a79872-c316-4bb2-914c-a118831bc023 => generated 1316 bytes in 1404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:22:07.018042 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0de362a4-2b4c-484f-ae04-5c3f9327142a tempest-FlavorsV261TestJSON-2063139847 tempest-FlavorsV261TestJSON-2063139847-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-225324433", "id": 1639049229, "os-flavor-access:is_public": "True"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:22:07.139453 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0de362a4-2b4c-484f-ae04-5c3f9327142a tempest-FlavorsV261TestJSON-2063139847 tempest-FlavorsV261TestJSON-2063139847-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 467 microversion: 2.61 time: 0.639851 Oct 27 03:22:07.140481 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 232/454] 10.222.0.20 () {62 vars in 1188 bytes} [Thu Oct 27 03:22:06 2022] POST /compute/v2.1/flavors => generated 467 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 03:22:07.154658 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-add65719-79fd-43c3-a3ae-c6aa4df93cf5 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:07.158421 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-add65719-79fd-43c3-a3ae-c6aa4df93cf5 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] [instance: 936d578f-607c-4650-aac3-f06ef6fa7017] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:07.179489 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-add65719-79fd-43c3-a3ae-c6aa4df93cf5 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:07.180324 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-add65719-79fd-43c3-a3ae-c6aa4df93cf5 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:07.180946 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-add65719-79fd-43c3-a3ae-c6aa4df93cf5 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:07.181860 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-add65719-79fd-43c3-a3ae-c6aa4df93cf5 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:07.182512 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-add65719-79fd-43c3-a3ae-c6aa4df93cf5 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:07.183109 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-add65719-79fd-43c3-a3ae-c6aa4df93cf5 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:07.204501 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5c2e7780-3974-4cc0-ac9e-2ccb8a85c077 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:07.214649 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-add65719-79fd-43c3-a3ae-c6aa4df93cf5 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] HTTP exception thrown: Instance 936d578f-607c-4650-aac3-f06ef6fa7017 could not be found. Oct 27 03:22:07.215144 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5c2e7780-3974-4cc0-ac9e-2ccb8a85c077 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578" status: 200 len: 1476 microversion: 2.1 time: 0.945720 Oct 27 03:22:07.215870 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 223/455] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:06 2022] GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578 => generated 1476 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:22:07.218745 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-add65719-79fd-43c3-a3ae-c6aa4df93cf5 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Request method failure captured: Oct 27 03:22:07.218745 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/936d578f-607c-4650-aac3-f06ef6fa7017 HTTP/1.1 Oct 27 03:22:07.218745 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:22:07.218745 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:22:07.218745 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:22:07.218745 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:22:07.218745 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:22:07.218745 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:22:07.218745 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:22:07.218745 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:22:07.218745 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfkxhhfyKpMiEQriL6uaiORkD_tt8n6rTsQ0rINJiUu4yyIdGWOiFYxvw-kIwUmdhfX_z6Sn6SCeV9Cs4stuJjxYkHcaeIDAruvPsyN1_x23HycTXRL1WvIa14nGh_refvx8NUa3Y8oq2LBJYmTj_cNWuZqSfjyQeXvMjIkK3CtjBEo Oct 27 03:22:07.218745 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:22:07.218745 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:22:07.218745 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:22:07.218745 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:22:07.218745 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:22:07.218745 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:22:07.218745 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 44b2b8b909c54f36b61d934d09607b5a Oct 27 03:22:07.218745 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-LiveMigrationNegativeTest-2096899096 Oct 27 03:22:07.218745 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:22:07.218745 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:22:07.220293 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/44b2b8b909c54f36b61d934d09607b5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/44b2b8b909c54f36b61d934d09607b5a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/44b2b8b909c54f36b61d934d09607b5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_44b2b8b909c54f36b61d934d09607b5a"}]}] Oct 27 03:22:07.220293 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-LiveMigrationNegativeTest-2096899096 Oct 27 03:22:07.220293 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 44b2b8b909c54f36b61d934d09607b5a Oct 27 03:22:07.220293 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-2096899096 Oct 27 03:22:07.220293 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-LiveMigrationNegativeTest-2096899096-project Oct 27 03:22:07.220293 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:22:07.220293 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:22:07.220293 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: ae3d2208faeb4421af21da56d455be92 Oct 27 03:22:07.220293 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-LiveMigrationNegativeTest-2096899096-project Oct 27 03:22:07.220293 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:22:07.220293 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 936d578f-607c-4650-aac3-f06ef6fa7017 could not be found. Oct 27 03:22:07.220293 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '936d578f-607c-4650-aac3-f06ef6fa7017'} Oct 27 03:22:07.221169 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:22:07.221169 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:22:07.221169 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:22:07.221169 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:22:07.221169 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:22:07.221169 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:22:07.221169 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:22:07.221169 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:22:07.221169 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:22:07.221169 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:22:07.221169 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 936d578f-607c-4650-aac3-f06ef6fa7017 could not be found. Oct 27 03:22:07.221169 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:22:07.221169 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:22:07.221169 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:22:07.221169 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:22:07.221169 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:22:07.221169 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:22:07.221169 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:22:07.221169 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:22:07.221169 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:22:07.222565 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:22:07.222565 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:22:07.222565 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:22:07.222565 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:22:07.222565 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:22:07.222565 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:22:07.222565 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:22:07.222565 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 936d578f-607c-4650-aac3-f06ef6fa7017 could not be found. Oct 27 03:22:07.222565 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:22:07.222565 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:22:07.222565 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:22:07.222565 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:22:07.222565 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:22:07.222565 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:22:07.222565 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:22:07.222565 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:22:07.222565 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 936d578f-607c-4650-aac3-f06ef6fa7017 could not be found. Oct 27 03:22:07.222565 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:22:07.230818 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-add65719-79fd-43c3-a3ae-c6aa4df93cf5 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Returning 404 to user: Instance 936d578f-607c-4650-aac3-f06ef6fa7017 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:22:07.232472 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-add65719-79fd-43c3-a3ae-c6aa4df93cf5 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] 10.222.0.20 "GET /compute/v2.1/servers/936d578f-607c-4650-aac3-f06ef6fa7017" status: 404 len: 111 microversion: 2.1 time: 0.090945 Oct 27 03:22:07.233222 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 233/456] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:07 2022] GET /compute/v2.1/servers/936d578f-607c-4650-aac3-f06ef6fa7017 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:22:07.244002 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c2044c34-afd8-4e6d-b68f-0d7e071048ee tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:07.257952 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c2044c34-afd8-4e6d-b68f-0d7e071048ee tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:07.279337 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c2044c34-afd8-4e6d-b68f-0d7e071048ee tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:07.280041 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c2044c34-afd8-4e6d-b68f-0d7e071048ee tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:07.290405 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c2044c34-afd8-4e6d-b68f-0d7e071048ee tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:07.290405 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c2044c34-afd8-4e6d-b68f-0d7e071048ee tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:07.290405 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c2044c34-afd8-4e6d-b68f-0d7e071048ee tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:07.290405 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c2044c34-afd8-4e6d-b68f-0d7e071048ee tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:07.453096 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c2044c34-afd8-4e6d-b68f-0d7e071048ee tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:07.474437 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c2044c34-afd8-4e6d-b68f-0d7e071048ee tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:07.480643 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c2044c34-afd8-4e6d-b68f-0d7e071048ee tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:07.501383 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c2044c34-afd8-4e6d-b68f-0d7e071048ee tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1555 microversion: 2.91 time: 0.265984 Oct 27 03:22:07.507655 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 224/457] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:22:07 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1555 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:22:07.518873 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ec998b90-2f38-442a-a2ab-a427d52d78c3 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:07.521011 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ec998b90-2f38-442a-a2ab-a427d52d78c3 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] [instance: a3b87dc4-af75-42ba-81af-7ad2ac59510c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:07.539505 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ec998b90-2f38-442a-a2ab-a427d52d78c3 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:07.539789 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ec998b90-2f38-442a-a2ab-a427d52d78c3 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:07.541605 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ec998b90-2f38-442a-a2ab-a427d52d78c3 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:07.552691 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ec998b90-2f38-442a-a2ab-a427d52d78c3 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:07.552691 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ec998b90-2f38-442a-a2ab-a427d52d78c3 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:07.552691 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ec998b90-2f38-442a-a2ab-a427d52d78c3 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:07.605307 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:07.607997 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=6 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:07.628508 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e4729168-e349-4e39-aabb-1c6a46bf9110 tempest-FlavorsV261TestJSON-1540090969 tempest-FlavorsV261TestJSON-1540090969-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:07.631248 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ec998b90-2f38-442a-a2ab-a427d52d78c3 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] [instance: a3b87dc4-af75-42ba-81af-7ad2ac59510c] Going to try to terminate instance {{(pid=121000) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:22:07.653087 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e4729168-e349-4e39-aabb-1c6a46bf9110 tempest-FlavorsV261TestJSON-1540090969 tempest-FlavorsV261TestJSON-1540090969-project] 10.222.0.20 "GET /compute/v2.1/flavors/1639049229" status: 200 len: 467 microversion: 2.61 time: 0.417883 Oct 27 03:22:07.667591 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 234/458] 10.222.0.20 () {60 vars in 1199 bytes} [Thu Oct 27 03:22:07 2022] GET /compute/v2.1/flavors/1639049229 => generated 467 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 03:22:07.688217 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0a330175-b5a8-40ff-b846-fb15cad5a33e tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:07.691626 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0a330175-b5a8-40ff-b846-fb15cad5a33e tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: d0a79872-c316-4bb2-914c-a118831bc023] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:07.710576 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0a330175-b5a8-40ff-b846-fb15cad5a33e tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:07.715594 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0a330175-b5a8-40ff-b846-fb15cad5a33e tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:07.716127 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0a330175-b5a8-40ff-b846-fb15cad5a33e tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:07.716910 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0a330175-b5a8-40ff-b846-fb15cad5a33e tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:07.717563 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0a330175-b5a8-40ff-b846-fb15cad5a33e tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:07.723532 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0a330175-b5a8-40ff-b846-fb15cad5a33e tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:08.034411 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ec998b90-2f38-442a-a2ab-a427d52d78c3 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a3b87dc4-af75-42ba-81af-7ad2ac59510c" status: 204 len: 0 microversion: 2.1 time: 0.529199 Oct 27 03:22:08.041400 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 225/459] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:22:07 2022] DELETE /compute/v2.1/servers/a3b87dc4-af75-42ba-81af-7ad2ac59510c => generated 0 bytes in 531 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:22:08.043803 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-dac72ef1-8a2b-422a-9d21-4c02904f784f tempest-FlavorsV261TestJSON-2063139847 tempest-FlavorsV261TestJSON-2063139847-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:22:08.218672 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-dac72ef1-8a2b-422a-9d21-4c02904f784f tempest-FlavorsV261TestJSON-2063139847 tempest-FlavorsV261TestJSON-2063139847-project-admin] 10.222.0.20 "PUT /compute/v2.1/flavors/1639049229" status: 200 len: 468 microversion: 2.61 time: 0.179447 Oct 27 03:22:08.223800 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:08.225716 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 226/460] 10.222.0.20 () {62 vars in 1219 bytes} [Thu Oct 27 03:22:08 2022] PUT /compute/v2.1/flavors/1639049229 => generated 468 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 03:22:08.230614 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-d397b84a-26c5-4c51-b39d-6ab0d670e9ff req-3592f733-af92-4539-b8af-046a33e2e1cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0a79872-c316-4bb2-914c-a118831bc023", "tag": "d6726828-5fd6-412a-bd4f-f5918742c962"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:22:08.253813 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-d397b84a-26c5-4c51-b39d-6ab0d670e9ff req-3592f733-af92-4539-b8af-046a33e2e1cf service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:08.254597 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-d397b84a-26c5-4c51-b39d-6ab0d670e9ff req-3592f733-af92-4539-b8af-046a33e2e1cf service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:08.255279 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-d397b84a-26c5-4c51-b39d-6ab0d670e9ff req-3592f733-af92-4539-b8af-046a33e2e1cf service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:08.286093 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-d397b84a-26c5-4c51-b39d-6ab0d670e9ff req-3592f733-af92-4539-b8af-046a33e2e1cf service nova] Creating event network-changed:d6726828-5fd6-412a-bd4f-f5918742c962 for instance d0a79872-c316-4bb2-914c-a118831bc023 on n-h2-862769-1 Oct 27 03:22:08.299578 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-d397b84a-26c5-4c51-b39d-6ab0d670e9ff req-3592f733-af92-4539-b8af-046a33e2e1cf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072199 Oct 27 03:22:08.300778 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 227/461] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:22:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:22:08.307277 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b56e45e0-0350-4f10-bfb1-55dea888d079 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:08.311016 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b56e45e0-0350-4f10-bfb1-55dea888d079 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] [instance: a3b87dc4-af75-42ba-81af-7ad2ac59510c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:08.324975 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b56e45e0-0350-4f10-bfb1-55dea888d079 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:08.326344 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b56e45e0-0350-4f10-bfb1-55dea888d079 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:08.326988 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b56e45e0-0350-4f10-bfb1-55dea888d079 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:08.328853 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b56e45e0-0350-4f10-bfb1-55dea888d079 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:08.336515 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b56e45e0-0350-4f10-bfb1-55dea888d079 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:08.341102 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b56e45e0-0350-4f10-bfb1-55dea888d079 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:08.472135 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:08.595858 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0a330175-b5a8-40ff-b846-fb15cad5a33e tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:08.604489 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0a330175-b5a8-40ff-b846-fb15cad5a33e tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/d0a79872-c316-4bb2-914c-a118831bc023" status: 200 len: 1316 microversion: 2.1 time: 0.935737 Oct 27 03:22:08.608222 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 235/462] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:07 2022] GET /compute/v2.1/servers/d0a79872-c316-4bb2-914c-a118831bc023 => generated 1316 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:22:08.615267 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b0b7287b-0ef6-48a9-b908-869897e23427 tempest-FlavorsV261TestJSON-1540090969 tempest-FlavorsV261TestJSON-1540090969-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:08.683054 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b0b7287b-0ef6-48a9-b908-869897e23427 tempest-FlavorsV261TestJSON-1540090969 tempest-FlavorsV261TestJSON-1540090969-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 6249 microversion: 2.61 time: 0.052492 Oct 27 03:22:08.685385 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 236/463] 10.222.0.20 () {60 vars in 1187 bytes} [Thu Oct 27 03:22:08 2022] GET /compute/v2.1/flavors/detail => generated 6249 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:22:08.697588 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c7e5a028-acfe-42a9-b566-9c4d1744d1c8 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:08.700012 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c7e5a028-acfe-42a9-b566-9c4d1744d1c8 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 5910c783-6877-4a41-8650-0973a11f3578] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:08.726661 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c7e5a028-acfe-42a9-b566-9c4d1744d1c8 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:08.726661 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c7e5a028-acfe-42a9-b566-9c4d1744d1c8 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:08.726661 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c7e5a028-acfe-42a9-b566-9c4d1744d1c8 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:08.729753 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c7e5a028-acfe-42a9-b566-9c4d1744d1c8 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:08.731725 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c7e5a028-acfe-42a9-b566-9c4d1744d1c8 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:08.732478 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c7e5a028-acfe-42a9-b566-9c4d1744d1c8 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:08.887134 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b56e45e0-0350-4f10-bfb1-55dea888d079 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3d2208faeb4421af21da56d455be92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b2b8b909c54f36b61d934d09607b5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:08.903786 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b56e45e0-0350-4f10-bfb1-55dea888d079 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] 10.222.0.20 "GET /compute/v2.1/servers/a3b87dc4-af75-42ba-81af-7ad2ac59510c" status: 200 len: 1473 microversion: 2.1 time: 0.601407 Oct 27 03:22:08.906487 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 228/464] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:08 2022] GET /compute/v2.1/servers/a3b87dc4-af75-42ba-81af-7ad2ac59510c => generated 1473 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:22:08.911531 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9acc1121-3cd9-48a9-b3d7-bcb26d1d7ec7 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:08.930719 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9acc1121-3cd9-48a9-b3d7-bcb26d1d7ec7 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:08.953966 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9acc1121-3cd9-48a9-b3d7-bcb26d1d7ec7 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:08.954545 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9acc1121-3cd9-48a9-b3d7-bcb26d1d7ec7 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:08.954986 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9acc1121-3cd9-48a9-b3d7-bcb26d1d7ec7 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:08.955725 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9acc1121-3cd9-48a9-b3d7-bcb26d1d7ec7 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:08.956188 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9acc1121-3cd9-48a9-b3d7-bcb26d1d7ec7 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:08.956618 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9acc1121-3cd9-48a9-b3d7-bcb26d1d7ec7 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:09.177525 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9acc1121-3cd9-48a9-b3d7-bcb26d1d7ec7 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:09.188611 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9acc1121-3cd9-48a9-b3d7-bcb26d1d7ec7 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:09.194779 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9acc1121-3cd9-48a9-b3d7-bcb26d1d7ec7 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:09.212722 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9acc1121-3cd9-48a9-b3d7-bcb26d1d7ec7 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1555 microversion: 2.91 time: 0.304171 Oct 27 03:22:09.217778 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 229/465] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:22:08 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1555 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:22:09.235347 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-c0fe02ca-c708-4266-9697-55b7ffe7f774 req-e2f47e12-1fd3-48cf-b249-112efb82a40a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5910c783-6877-4a41-8650-0973a11f3578", "name": "network-vif-unplugged", "status": "completed", "tag": "30830547-1d6a-4cee-9341-539819ef5a04"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:22:09.280960 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-c0fe02ca-c708-4266-9697-55b7ffe7f774 req-e2f47e12-1fd3-48cf-b249-112efb82a40a service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:09.281501 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-c0fe02ca-c708-4266-9697-55b7ffe7f774 req-e2f47e12-1fd3-48cf-b249-112efb82a40a service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:09.282024 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-c0fe02ca-c708-4266-9697-55b7ffe7f774 req-e2f47e12-1fd3-48cf-b249-112efb82a40a service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:09.305770 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-c0fe02ca-c708-4266-9697-55b7ffe7f774 req-e2f47e12-1fd3-48cf-b249-112efb82a40a service nova] Creating event network-vif-unplugged:30830547-1d6a-4cee-9341-539819ef5a04 for instance 5910c783-6877-4a41-8650-0973a11f3578 on n-h2-862769-1 Oct 27 03:22:09.322238 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [req-c0fe02ca-c708-4266-9697-55b7ffe7f774 req-e2f47e12-1fd3-48cf-b249-112efb82a40a service nova] Instance 5910c783-6877-4a41-8650-0973a11f3578 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862769-1', 'n-h1-862769-1'} {{(pid=121000) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 03:22:09.341001 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-c0fe02ca-c708-4266-9697-55b7ffe7f774 req-e2f47e12-1fd3-48cf-b249-112efb82a40a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.120823 Oct 27 03:22:09.342581 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 230/466] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:22:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:22:09.349113 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0af26de8-a3b1-44f1-81b6-3191b4b250cb tempest-FlavorsV261TestJSON-1540090969 tempest-FlavorsV261TestJSON-1540090969-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:09.393780 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0af26de8-a3b1-44f1-81b6-3191b4b250cb tempest-FlavorsV261TestJSON-1540090969 tempest-FlavorsV261TestJSON-1540090969-project] 10.222.0.20 "GET /compute/v2.1/flavors" status: 200 len: 3156 microversion: 2.61 time: 0.049487 Oct 27 03:22:09.400684 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 231/467] 10.222.0.20 () {60 vars in 1166 bytes} [Thu Oct 27 03:22:09 2022] GET /compute/v2.1/flavors => generated 3156 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:22:09.417863 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d39d1ae2-3617-490c-aa47-dc0ca98225a9 tempest-FlavorsV261TestJSON-2063139847 tempest-FlavorsV261TestJSON-2063139847-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:09.574694 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d39d1ae2-3617-490c-aa47-dc0ca98225a9 tempest-FlavorsV261TestJSON-2063139847 tempest-FlavorsV261TestJSON-2063139847-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1639049229" status: 202 len: 0 microversion: 2.61 time: 0.160659 Oct 27 03:22:09.575639 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 232/468] 10.222.0.20 () {60 vars in 1202 bytes} [Thu Oct 27 03:22:09 2022] DELETE /compute/v2.1/flavors/1639049229 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 27 03:22:09.584084 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3feb6b0c-162c-4117-a777-454d6d5a2cf1 tempest-FlavorsV261TestJSON-2063139847 tempest-FlavorsV261TestJSON-2063139847-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:09.639779 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3feb6b0c-162c-4117-a777-454d6d5a2cf1 tempest-FlavorsV261TestJSON-2063139847 tempest-FlavorsV261TestJSON-2063139847-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.059576 Oct 27 03:22:09.675156 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 233/469] 10.222.0.20 () {60 vars in 1187 bytes} [Thu Oct 27 03:22:09 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:22:09.680213 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-fae4a078-dc23-4ea4-a186-e74ddb72c57f tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:09.680975 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-fae4a078-dc23-4ea4-a186-e74ddb72c57f tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: d0a79872-c316-4bb2-914c-a118831bc023] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:09.709232 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fae4a078-dc23-4ea4-a186-e74ddb72c57f tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:09.709991 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fae4a078-dc23-4ea4-a186-e74ddb72c57f tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:09.710693 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fae4a078-dc23-4ea4-a186-e74ddb72c57f tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:09.711574 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fae4a078-dc23-4ea4-a186-e74ddb72c57f tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:09.712183 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fae4a078-dc23-4ea4-a186-e74ddb72c57f tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:09.723584 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fae4a078-dc23-4ea4-a186-e74ddb72c57f tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:09.977559 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c7e5a028-acfe-42a9-b566-9c4d1744d1c8 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:09.996942 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c7e5a028-acfe-42a9-b566-9c4d1744d1c8 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578" status: 200 len: 1476 microversion: 2.1 time: 1.310070 Oct 27 03:22:09.997575 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 237/470] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:08 2022] GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578 => generated 1476 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:22:10.011199 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d6fd287d-4b91-4ec9-9827-64a88699068f tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:10.015080 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d6fd287d-4b91-4ec9-9827-64a88699068f tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] [instance: a3b87dc4-af75-42ba-81af-7ad2ac59510c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:10.038332 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d6fd287d-4b91-4ec9-9827-64a88699068f tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:10.041571 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d6fd287d-4b91-4ec9-9827-64a88699068f tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:10.043361 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d6fd287d-4b91-4ec9-9827-64a88699068f tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:10.046850 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d6fd287d-4b91-4ec9-9827-64a88699068f tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:10.047632 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d6fd287d-4b91-4ec9-9827-64a88699068f tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:10.050137 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d6fd287d-4b91-4ec9-9827-64a88699068f tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:10.633029 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-fae4a078-dc23-4ea4-a186-e74ddb72c57f tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:10.648265 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-fae4a078-dc23-4ea4-a186-e74ddb72c57f tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/d0a79872-c316-4bb2-914c-a118831bc023" status: 200 len: 1316 microversion: 2.1 time: 0.971905 Oct 27 03:22:10.649466 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 234/471] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:09 2022] GET /compute/v2.1/servers/d0a79872-c316-4bb2-914c-a118831bc023 => generated 1316 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:22:10.657485 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e32a35d3-211b-465d-9100-4454f3a78738 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:10.663334 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e32a35d3-211b-465d-9100-4454f3a78738 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:10.683927 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e32a35d3-211b-465d-9100-4454f3a78738 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:10.685611 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e32a35d3-211b-465d-9100-4454f3a78738 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:10.687382 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e32a35d3-211b-465d-9100-4454f3a78738 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:10.690976 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e32a35d3-211b-465d-9100-4454f3a78738 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:10.691744 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e32a35d3-211b-465d-9100-4454f3a78738 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:10.692494 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e32a35d3-211b-465d-9100-4454f3a78738 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:10.754020 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d6fd287d-4b91-4ec9-9827-64a88699068f tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3d2208faeb4421af21da56d455be92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b2b8b909c54f36b61d934d09607b5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:10.769619 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d6fd287d-4b91-4ec9-9827-64a88699068f tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] 10.222.0.20 "GET /compute/v2.1/servers/a3b87dc4-af75-42ba-81af-7ad2ac59510c" status: 200 len: 1473 microversion: 2.1 time: 0.769536 Oct 27 03:22:10.790952 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 238/472] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:09 2022] GET /compute/v2.1/servers/a3b87dc4-af75-42ba-81af-7ad2ac59510c => generated 1473 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:22:10.889470 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e32a35d3-211b-465d-9100-4454f3a78738 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:10.894425 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e32a35d3-211b-465d-9100-4454f3a78738 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:10.899782 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e32a35d3-211b-465d-9100-4454f3a78738 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:10.921822 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e32a35d3-211b-465d-9100-4454f3a78738 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1555 microversion: 2.91 time: 0.262105 Oct 27 03:22:10.950287 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 235/473] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:22:10 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1555 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:22:11.032883 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-042e17f2-72e1-4ab3-98ce-12a48bbaa8d4 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:11.034016 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-042e17f2-72e1-4ab3-98ce-12a48bbaa8d4 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 5910c783-6877-4a41-8650-0973a11f3578] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:11.049940 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-042e17f2-72e1-4ab3-98ce-12a48bbaa8d4 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:11.050498 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-042e17f2-72e1-4ab3-98ce-12a48bbaa8d4 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:11.061611 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-042e17f2-72e1-4ab3-98ce-12a48bbaa8d4 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:11.061611 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-042e17f2-72e1-4ab3-98ce-12a48bbaa8d4 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:11.061611 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-042e17f2-72e1-4ab3-98ce-12a48bbaa8d4 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:11.061611 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-042e17f2-72e1-4ab3-98ce-12a48bbaa8d4 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:11.673413 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-44964e3a-1366-4a2a-999f-00fea9a8b753 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:11.676565 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-44964e3a-1366-4a2a-999f-00fea9a8b753 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: d0a79872-c316-4bb2-914c-a118831bc023] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:11.694072 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-44964e3a-1366-4a2a-999f-00fea9a8b753 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:11.697949 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-44964e3a-1366-4a2a-999f-00fea9a8b753 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:11.703866 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-44964e3a-1366-4a2a-999f-00fea9a8b753 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:11.704398 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-44964e3a-1366-4a2a-999f-00fea9a8b753 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:11.705002 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-44964e3a-1366-4a2a-999f-00fea9a8b753 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:11.705452 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-44964e3a-1366-4a2a-999f-00fea9a8b753 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:12.180295 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-042e17f2-72e1-4ab3-98ce-12a48bbaa8d4 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:12.209018 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-042e17f2-72e1-4ab3-98ce-12a48bbaa8d4 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578" status: 200 len: 1476 microversion: 2.1 time: 1.183512 Oct 27 03:22:12.224749 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 239/474] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:11 2022] GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578 => generated 1476 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:22:12.253625 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1e843621-28b1-4015-9210-7be69444ca82 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:12.255663 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1e843621-28b1-4015-9210-7be69444ca82 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] [instance: a3b87dc4-af75-42ba-81af-7ad2ac59510c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:12.283301 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1e843621-28b1-4015-9210-7be69444ca82 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:12.283301 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1e843621-28b1-4015-9210-7be69444ca82 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:12.283819 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1e843621-28b1-4015-9210-7be69444ca82 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:12.285874 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1e843621-28b1-4015-9210-7be69444ca82 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:12.288447 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1e843621-28b1-4015-9210-7be69444ca82 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:12.288912 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1e843621-28b1-4015-9210-7be69444ca82 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:12.581810 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-44964e3a-1366-4a2a-999f-00fea9a8b753 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:12.584782 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-44964e3a-1366-4a2a-999f-00fea9a8b753 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/d0a79872-c316-4bb2-914c-a118831bc023" status: 200 len: 1316 microversion: 2.1 time: 0.910860 Oct 27 03:22:12.590502 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 236/475] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:11 2022] GET /compute/v2.1/servers/d0a79872-c316-4bb2-914c-a118831bc023 => generated 1316 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:22:12.610275 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-bf56ef38-3136-483b-bd9c-1bd42ff431d9 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:12.611840 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-bf56ef38-3136-483b-bd9c-1bd42ff431d9 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:12.633066 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bf56ef38-3136-483b-bd9c-1bd42ff431d9 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:12.633574 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bf56ef38-3136-483b-bd9c-1bd42ff431d9 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:12.634027 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bf56ef38-3136-483b-bd9c-1bd42ff431d9 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:12.634778 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bf56ef38-3136-483b-bd9c-1bd42ff431d9 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:12.635240 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bf56ef38-3136-483b-bd9c-1bd42ff431d9 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:12.635670 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bf56ef38-3136-483b-bd9c-1bd42ff431d9 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:12.947666 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-bf56ef38-3136-483b-bd9c-1bd42ff431d9 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:12.965799 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-bf56ef38-3136-483b-bd9c-1bd42ff431d9 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:12.977289 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-bf56ef38-3136-483b-bd9c-1bd42ff431d9 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:12.986180 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1e843621-28b1-4015-9210-7be69444ca82 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3d2208faeb4421af21da56d455be92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b2b8b909c54f36b61d934d09607b5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:12.994853 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-bf56ef38-3136-483b-bd9c-1bd42ff431d9 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1555 microversion: 2.91 time: 0.401432 Oct 27 03:22:12.995472 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 237/476] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:22:12 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1555 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:22:13.003424 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1e843621-28b1-4015-9210-7be69444ca82 tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] 10.222.0.20 "GET /compute/v2.1/servers/a3b87dc4-af75-42ba-81af-7ad2ac59510c" status: 200 len: 1431 microversion: 2.1 time: 0.776886 Oct 27 03:22:13.005160 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 240/477] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:12 2022] GET /compute/v2.1/servers/a3b87dc4-af75-42ba-81af-7ad2ac59510c => generated 1431 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:22:13.013624 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-5ae563b6-d3a8-464d-ba6d-0424b02e72c0 req-f5103347-8925-4ab6-9a03-63456dba1e38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3b87dc4-af75-42ba-81af-7ad2ac59510c", "name": "network-vif-deleted", "tag": "c4a8dff3-34b2-4172-8d3b-ee64c1364a2c"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:22:13.027412 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-5ae563b6-d3a8-464d-ba6d-0424b02e72c0 req-f5103347-8925-4ab6-9a03-63456dba1e38 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:13.028255 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-5ae563b6-d3a8-464d-ba6d-0424b02e72c0 req-f5103347-8925-4ab6-9a03-63456dba1e38 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:13.029678 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-5ae563b6-d3a8-464d-ba6d-0424b02e72c0 req-f5103347-8925-4ab6-9a03-63456dba1e38 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:13.049038 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-8e9b1234-34d1-4526-a5c9-8f06540d87d1 req-0dd0c8f5-6f25-4ba2-a50c-0e0189227b88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5910c783-6877-4a41-8650-0973a11f3578", "tag": "30830547-1d6a-4cee-9341-539819ef5a04"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:22:13.049157 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-5ae563b6-d3a8-464d-ba6d-0424b02e72c0 req-f5103347-8925-4ab6-9a03-63456dba1e38 service nova] Creating event network-vif-deleted:c4a8dff3-34b2-4172-8d3b-ee64c1364a2c for instance a3b87dc4-af75-42ba-81af-7ad2ac59510c on n-h2-862769-1 Oct 27 03:22:13.062160 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-5ae563b6-d3a8-464d-ba6d-0424b02e72c0 req-f5103347-8925-4ab6-9a03-63456dba1e38 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055550 Oct 27 03:22:13.076406 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-8e9b1234-34d1-4526-a5c9-8f06540d87d1 req-0dd0c8f5-6f25-4ba2-a50c-0e0189227b88 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:13.080664 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 241/478] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:22:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:22:13.084041 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-8e9b1234-34d1-4526-a5c9-8f06540d87d1 req-0dd0c8f5-6f25-4ba2-a50c-0e0189227b88 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:13.084555 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-8e9b1234-34d1-4526-a5c9-8f06540d87d1 req-0dd0c8f5-6f25-4ba2-a50c-0e0189227b88 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:13.121010 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-8e9b1234-34d1-4526-a5c9-8f06540d87d1 req-0dd0c8f5-6f25-4ba2-a50c-0e0189227b88 service nova] Creating event network-changed:30830547-1d6a-4cee-9341-539819ef5a04 for instance 5910c783-6877-4a41-8650-0973a11f3578 on n-h2-862769-1 Oct 27 03:22:13.130100 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [req-8e9b1234-34d1-4526-a5c9-8f06540d87d1 req-0dd0c8f5-6f25-4ba2-a50c-0e0189227b88 service nova] Instance 5910c783-6877-4a41-8650-0973a11f3578 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862769-1', 'n-h1-862769-1'} {{(pid=121000) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 03:22:13.148558 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-8e9b1234-34d1-4526-a5c9-8f06540d87d1 req-0dd0c8f5-6f25-4ba2-a50c-0e0189227b88 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129318 Oct 27 03:22:13.150252 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 238/479] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:22:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:22:13.238132 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-17a14511-efd7-4400-9ea9-2811f0b14f2c tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:13.239512 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-17a14511-efd7-4400-9ea9-2811f0b14f2c tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 5910c783-6877-4a41-8650-0973a11f3578] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:13.272239 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-17a14511-efd7-4400-9ea9-2811f0b14f2c tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:13.273065 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-17a14511-efd7-4400-9ea9-2811f0b14f2c tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:13.276357 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-17a14511-efd7-4400-9ea9-2811f0b14f2c tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:13.277495 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-17a14511-efd7-4400-9ea9-2811f0b14f2c tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:13.282235 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-17a14511-efd7-4400-9ea9-2811f0b14f2c tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:13.286106 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-17a14511-efd7-4400-9ea9-2811f0b14f2c tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:13.615506 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d174e452-88a2-49a6-97ac-1d3bdcac77e1 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:13.616216 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d174e452-88a2-49a6-97ac-1d3bdcac77e1 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: d0a79872-c316-4bb2-914c-a118831bc023] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:13.639615 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d174e452-88a2-49a6-97ac-1d3bdcac77e1 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:13.640269 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d174e452-88a2-49a6-97ac-1d3bdcac77e1 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:13.644597 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d174e452-88a2-49a6-97ac-1d3bdcac77e1 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:13.650238 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d174e452-88a2-49a6-97ac-1d3bdcac77e1 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:13.652272 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d174e452-88a2-49a6-97ac-1d3bdcac77e1 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:13.653705 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d174e452-88a2-49a6-97ac-1d3bdcac77e1 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:14.627868 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-17a14511-efd7-4400-9ea9-2811f0b14f2c tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:14.640235 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-17a14511-efd7-4400-9ea9-2811f0b14f2c tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578" status: 200 len: 1476 microversion: 2.1 time: 1.406672 Oct 27 03:22:14.641180 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 242/480] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:13 2022] GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578 => generated 1476 bytes in 1409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:22:14.653491 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5d711495-627f-4aeb-8c18-eb83adc821a1 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:14.706012 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5d711495-627f-4aeb-8c18-eb83adc821a1 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:14.738984 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5d711495-627f-4aeb-8c18-eb83adc821a1 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:14.740122 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5d711495-627f-4aeb-8c18-eb83adc821a1 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:14.741753 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5d711495-627f-4aeb-8c18-eb83adc821a1 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:14.742797 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5d711495-627f-4aeb-8c18-eb83adc821a1 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:14.747883 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5d711495-627f-4aeb-8c18-eb83adc821a1 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:14.749732 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5d711495-627f-4aeb-8c18-eb83adc821a1 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:15.050421 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d174e452-88a2-49a6-97ac-1d3bdcac77e1 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:15.061026 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d174e452-88a2-49a6-97ac-1d3bdcac77e1 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/d0a79872-c316-4bb2-914c-a118831bc023" status: 200 len: 1316 microversion: 2.1 time: 1.450335 Oct 27 03:22:15.061275 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5d711495-627f-4aeb-8c18-eb83adc821a1 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:15.062026 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 239/481] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:13 2022] GET /compute/v2.1/servers/d0a79872-c316-4bb2-914c-a118831bc023 => generated 1316 bytes in 1452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:22:15.069597 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-cf5b8728-89a5-4cbc-8106-c806c9e78f4a tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:15.070511 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-cf5b8728-89a5-4cbc-8106-c806c9e78f4a tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] [instance: a3b87dc4-af75-42ba-81af-7ad2ac59510c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:15.077326 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cf5b8728-89a5-4cbc-8106-c806c9e78f4a tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:15.078246 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cf5b8728-89a5-4cbc-8106-c806c9e78f4a tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:15.078875 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cf5b8728-89a5-4cbc-8106-c806c9e78f4a tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:15.079805 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cf5b8728-89a5-4cbc-8106-c806c9e78f4a tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:15.080214 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5d711495-627f-4aeb-8c18-eb83adc821a1 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:15.080665 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cf5b8728-89a5-4cbc-8106-c806c9e78f4a tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:15.081296 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cf5b8728-89a5-4cbc-8106-c806c9e78f4a tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:15.083021 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5d711495-627f-4aeb-8c18-eb83adc821a1 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:15.093613 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5d711495-627f-4aeb-8c18-eb83adc821a1 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1555 microversion: 2.91 time: 0.450602 Oct 27 03:22:15.094510 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 243/482] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:22:14 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1555 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:22:15.116086 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-cf5b8728-89a5-4cbc-8106-c806c9e78f4a tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] HTTP exception thrown: Instance a3b87dc4-af75-42ba-81af-7ad2ac59510c could not be found. Oct 27 03:22:15.120959 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-cf5b8728-89a5-4cbc-8106-c806c9e78f4a tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Request method failure captured: Oct 27 03:22:15.120959 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/a3b87dc4-af75-42ba-81af-7ad2ac59510c HTTP/1.1 Oct 27 03:22:15.120959 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:22:15.120959 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:22:15.120959 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:22:15.120959 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:22:15.120959 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:22:15.120959 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:22:15.120959 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:22:15.120959 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:22:15.120959 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfkxhhfyKpMiEQriL6uaiORkD_tt8n6rTsQ0rINJiUu4yyIdGWOiFYxvw-kIwUmdhfX_z6Sn6SCeV9Cs4stuJjxYkHcaeIDAruvPsyN1_x23HycTXRL1WvIa14nGh_refvx8NUa3Y8oq2LBJYmTj_cNWuZqSfjyQeXvMjIkK3CtjBEo Oct 27 03:22:15.120959 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:22:15.120959 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:22:15.120959 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:22:15.120959 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:22:15.120959 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:22:15.120959 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:22:15.120959 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 44b2b8b909c54f36b61d934d09607b5a Oct 27 03:22:15.120959 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-LiveMigrationNegativeTest-2096899096 Oct 27 03:22:15.120959 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:22:15.120959 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:22:15.123096 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/44b2b8b909c54f36b61d934d09607b5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/44b2b8b909c54f36b61d934d09607b5a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/44b2b8b909c54f36b61d934d09607b5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_44b2b8b909c54f36b61d934d09607b5a"}]}] Oct 27 03:22:15.123096 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-LiveMigrationNegativeTest-2096899096 Oct 27 03:22:15.123096 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 44b2b8b909c54f36b61d934d09607b5a Oct 27 03:22:15.123096 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-2096899096 Oct 27 03:22:15.123096 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-LiveMigrationNegativeTest-2096899096-project Oct 27 03:22:15.123096 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:22:15.123096 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:22:15.123096 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: ae3d2208faeb4421af21da56d455be92 Oct 27 03:22:15.123096 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-LiveMigrationNegativeTest-2096899096-project Oct 27 03:22:15.123096 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:22:15.123096 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance a3b87dc4-af75-42ba-81af-7ad2ac59510c could not be found. Oct 27 03:22:15.123096 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': 'a3b87dc4-af75-42ba-81af-7ad2ac59510c'} Oct 27 03:22:15.123761 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:22:15.123761 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:22:15.123761 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:22:15.123761 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:22:15.123761 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:22:15.123761 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:22:15.123761 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:22:15.123761 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:22:15.123761 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:22:15.123761 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:22:15.123761 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3b87dc4-af75-42ba-81af-7ad2ac59510c could not be found. Oct 27 03:22:15.123761 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:22:15.123761 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:22:15.123761 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:22:15.123761 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:22:15.123761 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:22:15.123761 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:22:15.123761 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:22:15.123761 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:22:15.123761 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:22:15.124814 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:22:15.124814 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:22:15.124814 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:22:15.124814 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:22:15.124814 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:22:15.124814 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:22:15.124814 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:22:15.124814 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3b87dc4-af75-42ba-81af-7ad2ac59510c could not be found. Oct 27 03:22:15.124814 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:22:15.124814 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:22:15.124814 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:22:15.124814 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:22:15.124814 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:22:15.124814 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:22:15.124814 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:22:15.124814 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:22:15.124814 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3b87dc4-af75-42ba-81af-7ad2ac59510c could not be found. Oct 27 03:22:15.124814 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:22:15.128548 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-cf5b8728-89a5-4cbc-8106-c806c9e78f4a tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] Returning 404 to user: Instance a3b87dc4-af75-42ba-81af-7ad2ac59510c could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:22:15.129488 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-cf5b8728-89a5-4cbc-8106-c806c9e78f4a tempest-LiveMigrationNegativeTest-2096899096 tempest-LiveMigrationNegativeTest-2096899096-project] 10.222.0.20 "GET /compute/v2.1/servers/a3b87dc4-af75-42ba-81af-7ad2ac59510c" status: 404 len: 111 microversion: 2.1 time: 0.066333 Oct 27 03:22:15.130356 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 240/483] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:15 2022] GET /compute/v2.1/servers/a3b87dc4-af75-42ba-81af-7ad2ac59510c => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:22:15.674260 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8cd176fc-749a-436d-a863-dba432a4bb53 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:15.675000 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8cd176fc-749a-436d-a863-dba432a4bb53 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 5910c783-6877-4a41-8650-0973a11f3578] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:15.694335 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8cd176fc-749a-436d-a863-dba432a4bb53 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:15.698710 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8cd176fc-749a-436d-a863-dba432a4bb53 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:15.700976 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8cd176fc-749a-436d-a863-dba432a4bb53 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:15.704372 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8cd176fc-749a-436d-a863-dba432a4bb53 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:15.712025 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8cd176fc-749a-436d-a863-dba432a4bb53 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:15.714669 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8cd176fc-749a-436d-a863-dba432a4bb53 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:16.087265 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-41093001-9d31-490e-bb73-79a64f3f3144 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:16.088067 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-41093001-9d31-490e-bb73-79a64f3f3144 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: d0a79872-c316-4bb2-914c-a118831bc023] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:16.096761 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-41093001-9d31-490e-bb73-79a64f3f3144 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:16.099286 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-41093001-9d31-490e-bb73-79a64f3f3144 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:16.100113 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-41093001-9d31-490e-bb73-79a64f3f3144 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:16.101071 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-41093001-9d31-490e-bb73-79a64f3f3144 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:16.101691 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-41093001-9d31-490e-bb73-79a64f3f3144 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:16.102925 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-41093001-9d31-490e-bb73-79a64f3f3144 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:16.583181 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-41093001-9d31-490e-bb73-79a64f3f3144 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:16.604113 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-41093001-9d31-490e-bb73-79a64f3f3144 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/d0a79872-c316-4bb2-914c-a118831bc023" status: 200 len: 1316 microversion: 2.1 time: 0.520637 Oct 27 03:22:16.605503 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 241/484] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:16 2022] GET /compute/v2.1/servers/d0a79872-c316-4bb2-914c-a118831bc023 => generated 1316 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:22:16.610912 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0c7bdc5d-a0c9-4262-a878-3b62dd2c622a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:16.618692 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0c7bdc5d-a0c9-4262-a878-3b62dd2c622a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:16.632817 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0c7bdc5d-a0c9-4262-a878-3b62dd2c622a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:16.633656 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0c7bdc5d-a0c9-4262-a878-3b62dd2c622a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:16.635002 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0c7bdc5d-a0c9-4262-a878-3b62dd2c622a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:16.638754 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0c7bdc5d-a0c9-4262-a878-3b62dd2c622a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:16.639424 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0c7bdc5d-a0c9-4262-a878-3b62dd2c622a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:16.640386 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0c7bdc5d-a0c9-4262-a878-3b62dd2c622a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:16.895831 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0c7bdc5d-a0c9-4262-a878-3b62dd2c622a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:16.910186 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0c7bdc5d-a0c9-4262-a878-3b62dd2c622a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:16.912918 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0c7bdc5d-a0c9-4262-a878-3b62dd2c622a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:16.941583 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0c7bdc5d-a0c9-4262-a878-3b62dd2c622a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1555 microversion: 2.91 time: 0.315405 Oct 27 03:22:16.942362 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 242/485] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:22:16 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1555 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:22:16.978489 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8cd176fc-749a-436d-a863-dba432a4bb53 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:16.990097 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8cd176fc-749a-436d-a863-dba432a4bb53 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578" status: 200 len: 1476 microversion: 2.1 time: 1.321883 Oct 27 03:22:16.990659 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 244/486] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:15 2022] GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578 => generated 1476 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:22:17.187194 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-abd44912-5579-47d2-80bd-39c481aa11d2 tempest-FlavorMetadataValidation-1231573390 tempest-FlavorMetadataValidation-1231573390-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-1356506216", "id": 896573558, "os-flavor-access:is_public": "True"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:22:17.315684 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-abd44912-5579-47d2-80bd-39c481aa11d2 tempest-FlavorMetadataValidation-1231573390 tempest-FlavorMetadataValidation-1231573390-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 468 microversion: 2.86 time: 0.358154 Oct 27 03:22:17.326492 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 243/487] 10.222.0.20 () {62 vars in 1188 bytes} [Thu Oct 27 03:22:16 2022] POST /compute/v2.1/flavors => generated 468 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 03:22:17.334099 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-45ce73f9-bebf-4f85-9976-60c74b3ca46a tempest-FlavorMetadataValidation-1231573390 tempest-FlavorMetadataValidation-1231573390-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:22:17.394467 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f245362c-59f2-48ff-af0e-ee75f6558154 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:17.402683 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f245362c-59f2-48ff-af0e-ee75f6558154 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.405785 Oct 27 03:22:17.415346 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 245/488] 10.222.0.20 () {58 vars in 1137 bytes} [Thu Oct 27 03:22:16 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:22:17.728083 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=4,nova_api:UPDATE=2,nova_api:DELETE=3,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:17.800848 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-45ce73f9-bebf-4f85-9976-60c74b3ca46a tempest-FlavorMetadataValidation-1231573390 tempest-FlavorMetadataValidation-1231573390-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/896573558/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.470433 Oct 27 03:22:17.801706 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 244/489] 10.222.0.20 () {62 vars in 1262 bytes} [Thu Oct 27 03:22:17 2022] POST /compute/v2.1/flavors/896573558/os-extra_specs => generated 62 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:22:17.818849 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4f7aed36-f0de-4783-91c6-67673cc91399 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:17.819939 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4f7aed36-f0de-4783-91c6-67673cc91399 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: d0a79872-c316-4bb2-914c-a118831bc023] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:17.835414 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4f7aed36-f0de-4783-91c6-67673cc91399 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:17.835564 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-cb58dc7e-d592-4fc6-9807-c1e7e9859383 tempest-ServersWithSpecificFlavorTestJSON-879588589 tempest-ServersWithSpecificFlavorTestJSON-879588589-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-2059141719", "id": 719476185, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:22:17.837141 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4f7aed36-f0de-4783-91c6-67673cc91399 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:17.839503 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4f7aed36-f0de-4783-91c6-67673cc91399 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:17.840504 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4f7aed36-f0de-4783-91c6-67673cc91399 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:17.847372 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4f7aed36-f0de-4783-91c6-67673cc91399 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:17.848391 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4f7aed36-f0de-4783-91c6-67673cc91399 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:18.007207 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-cb58dc7e-d592-4fc6-9807-c1e7e9859383 tempest-ServersWithSpecificFlavorTestJSON-879588589 tempest-ServersWithSpecificFlavorTestJSON-879588589-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 422 microversion: 2.1 time: 0.583939 Oct 27 03:22:18.018560 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 246/490] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:22:17 2022] POST /compute/v2.1/flavors => generated 422 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:22:18.026362 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8db0d224-3c7b-457c-9325-70cbcd751acb tempest-FlavorMetadataValidation-1231573390 tempest-FlavorMetadataValidation-1231573390-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:18.099762 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4f7aed36-f0de-4783-91c6-67673cc91399 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:18.110705 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4f7aed36-f0de-4783-91c6-67673cc91399 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/d0a79872-c316-4bb2-914c-a118831bc023" status: 200 len: 1316 microversion: 2.1 time: 0.306475 Oct 27 03:22:18.111931 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 245/491] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:17 2022] GET /compute/v2.1/servers/d0a79872-c316-4bb2-914c-a118831bc023 => generated 1316 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:22:18.116604 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f9455f47-c640-4dee-b696-b7ba11c8ed9d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:18.117411 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f9455f47-c640-4dee-b696-b7ba11c8ed9d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:18.123978 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f9455f47-c640-4dee-b696-b7ba11c8ed9d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:18.124676 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f9455f47-c640-4dee-b696-b7ba11c8ed9d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:18.125268 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f9455f47-c640-4dee-b696-b7ba11c8ed9d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:18.126177 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f9455f47-c640-4dee-b696-b7ba11c8ed9d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:18.126792 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f9455f47-c640-4dee-b696-b7ba11c8ed9d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:18.127382 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f9455f47-c640-4dee-b696-b7ba11c8ed9d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:18.132547 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:18.175479 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8db0d224-3c7b-457c-9325-70cbcd751acb tempest-FlavorMetadataValidation-1231573390 tempest-FlavorMetadataValidation-1231573390-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/896573558" status: 202 len: 0 microversion: 2.86 time: 0.154577 Oct 27 03:22:18.176055 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 247/492] 10.222.0.20 () {60 vars in 1199 bytes} [Thu Oct 27 03:22:18 2022] DELETE /compute/v2.1/flavors/896573558 => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:22:18.195068 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-137f6c59-7c8f-4679-909b-9cde849f853e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:18.197059 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-137f6c59-7c8f-4679-909b-9cde849f853e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 5910c783-6877-4a41-8650-0973a11f3578] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:18.203876 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=10,nova_api:INSERT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:18.230218 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-137f6c59-7c8f-4679-909b-9cde849f853e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:18.233635 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-137f6c59-7c8f-4679-909b-9cde849f853e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:18.234815 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-137f6c59-7c8f-4679-909b-9cde849f853e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:18.236374 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-137f6c59-7c8f-4679-909b-9cde849f853e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:18.240630 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-137f6c59-7c8f-4679-909b-9cde849f853e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:18.241194 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-137f6c59-7c8f-4679-909b-9cde849f853e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:18.244713 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f9455f47-c640-4dee-b696-b7ba11c8ed9d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:18.259223 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f9455f47-c640-4dee-b696-b7ba11c8ed9d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:18.261075 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f9455f47-c640-4dee-b696-b7ba11c8ed9d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:18.273561 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f9455f47-c640-4dee-b696-b7ba11c8ed9d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1555 microversion: 2.91 time: 0.155452 Oct 27 03:22:18.273561 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 246/493] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:22:18 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1555 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:22:18.278486 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8570c9c0-6a7d-461d-9f1c-e140ecde0737 tempest-ServersWithSpecificFlavorTestJSON-879588589 tempest-ServersWithSpecificFlavorTestJSON-879588589-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:18.302178 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8570c9c0-6a7d-461d-9f1c-e140ecde0737 tempest-ServersWithSpecificFlavorTestJSON-879588589 tempest-ServersWithSpecificFlavorTestJSON-879588589-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.026269 Oct 27 03:22:18.305875 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 247/494] 10.222.0.20 () {58 vars in 1182 bytes} [Thu Oct 27 03:22:18 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 03:22:18.317598 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ea6b741a-c5d3-40de-bdb4-056ef1b18834 tempest-FlavorMetadataValidation-1231573390 tempest-FlavorMetadataValidation-1231573390-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:18.365764 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ea6b741a-c5d3-40de-bdb4-056ef1b18834 tempest-FlavorMetadataValidation-1231573390 tempest-FlavorMetadataValidation-1231573390-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 6228 microversion: 2.86 time: 0.058726 Oct 27 03:22:18.374140 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 248/495] 10.222.0.20 () {60 vars in 1187 bytes} [Thu Oct 27 03:22:18 2022] GET /compute/v2.1/flavors/detail => generated 6228 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:22:18.384613 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-13461185-63a0-4d71-9d75-502b0685fffa tempest-ServersWithSpecificFlavorTestJSON-879588589 tempest-ServersWithSpecificFlavorTestJSON-879588589-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-281973721", "id": 651676802, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:22:18.505820 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-137f6c59-7c8f-4679-909b-9cde849f853e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:18.530697 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-137f6c59-7c8f-4679-909b-9cde849f853e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578" status: 200 len: 1474 microversion: 2.1 time: 0.353286 Oct 27 03:22:18.534357 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 248/496] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:18 2022] GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578 => generated 1474 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:22:18.575002 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-13461185-63a0-4d71-9d75-502b0685fffa tempest-ServersWithSpecificFlavorTestJSON-879588589 tempest-ServersWithSpecificFlavorTestJSON-879588589-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 421 microversion: 2.1 time: 0.199674 Oct 27 03:22:18.575661 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 249/497] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:22:18 2022] POST /compute/v2.1/flavors => generated 421 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:22:18.595552 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-29142619-3275-44d0-ac5e-d9f73f1ed6d8 tempest-ServersWithSpecificFlavorTestJSON-879588589 tempest-ServersWithSpecificFlavorTestJSON-879588589-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:18.605410 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-29142619-3275-44d0-ac5e-d9f73f1ed6d8 tempest-ServersWithSpecificFlavorTestJSON-879588589 tempest-ServersWithSpecificFlavorTestJSON-879588589-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.021150 Oct 27 03:22:18.608538 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 249/498] 10.222.0.20 () {58 vars in 1182 bytes} [Thu Oct 27 03:22:18 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 03:22:18.620217 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-81576858-c3af-41e7-996e-f60bdc04697c tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Action: 'create', calling method: .version_select at 0x7f7ddaeefca0>, body: {"keypair": {"name": "tempest-keypair-831517697", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKIAsSPXgcS8DUtCl2u7Vw2crDwJcCr8v9trHQd5Ys3hCZYVxf+YhVUIc2h40KYjxs4cApv02srTrqjDvmFG+GduWsHPWMXuXflxWF1EnIif43Y5Hb65nNiviO0TZdIYCw=="}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:22:18.690061 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-81576858-c3af-41e7-996e-f60bdc04697c tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Getting quotas for project 39f033d34ad44397bfda5cba4c041071. Resources: {'key_pairs'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:22:18.699276 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-81576858-c3af-41e7-996e-f60bdc04697c tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Getting quotas for user 2e23378ed283426cbff623265d9bbc96 and project 39f033d34ad44397bfda5cba4c041071. Resources: {'key_pairs'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:22:18.843232 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-81576858-c3af-41e7-996e-f60bdc04697c tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.221132 Oct 27 03:22:18.847182 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 250/499] 10.222.0.20 () {60 vars in 1159 bytes} [Thu Oct 27 03:22:18 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:22:18.867534 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-694824a7-80f3-48a5-8c6b-338b42c52ff7 req-ab7c720c-c75c-4524-8e6f-9782a309e082 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0a79872-c316-4bb2-914c-a118831bc023", "name": "network-vif-plugged", "status": "completed", "tag": "d6726828-5fd6-412a-bd4f-f5918742c962"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:22:18.899362 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-694824a7-80f3-48a5-8c6b-338b42c52ff7 req-ab7c720c-c75c-4524-8e6f-9782a309e082 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:18.900274 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-694824a7-80f3-48a5-8c6b-338b42c52ff7 req-ab7c720c-c75c-4524-8e6f-9782a309e082 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:18.900932 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-694824a7-80f3-48a5-8c6b-338b42c52ff7 req-ab7c720c-c75c-4524-8e6f-9782a309e082 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:18.954307 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-694824a7-80f3-48a5-8c6b-338b42c52ff7 req-ab7c720c-c75c-4524-8e6f-9782a309e082 service nova] Creating event network-vif-plugged:d6726828-5fd6-412a-bd4f-f5918742c962 for instance d0a79872-c316-4bb2-914c-a118831bc023 on n-h2-862769-1 Oct 27 03:22:18.978343 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-694824a7-80f3-48a5-8c6b-338b42c52ff7 req-ab7c720c-c75c-4524-8e6f-9782a309e082 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111781 Oct 27 03:22:18.980780 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 250/500] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:22:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:22:19.135495 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-71367a95-9d1a-42f3-856f-005c5b9f340e tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:19.136135 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-71367a95-9d1a-42f3-856f-005c5b9f340e tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: d0a79872-c316-4bb2-914c-a118831bc023] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:19.150761 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-71367a95-9d1a-42f3-856f-005c5b9f340e tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:19.151798 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-71367a95-9d1a-42f3-856f-005c5b9f340e tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:19.152625 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-71367a95-9d1a-42f3-856f-005c5b9f340e tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:19.155130 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-71367a95-9d1a-42f3-856f-005c5b9f340e tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:19.155837 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-71367a95-9d1a-42f3-856f-005c5b9f340e tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:19.158610 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-71367a95-9d1a-42f3-856f-005c5b9f340e tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:19.299011 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-555b151c-da8b-4cc2-92f5-178b274d8597 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:19.300371 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-555b151c-da8b-4cc2-92f5-178b274d8597 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:19.318880 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-555b151c-da8b-4cc2-92f5-178b274d8597 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:19.321924 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-555b151c-da8b-4cc2-92f5-178b274d8597 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:19.322644 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-555b151c-da8b-4cc2-92f5-178b274d8597 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:19.323623 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-555b151c-da8b-4cc2-92f5-178b274d8597 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:19.332095 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-555b151c-da8b-4cc2-92f5-178b274d8597 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:19.332095 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-555b151c-da8b-4cc2-92f5-178b274d8597 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:19.489593 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-555b151c-da8b-4cc2-92f5-178b274d8597 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:19.501077 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-555b151c-da8b-4cc2-92f5-178b274d8597 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:19.507315 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-555b151c-da8b-4cc2-92f5-178b274d8597 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:19.515321 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-555b151c-da8b-4cc2-92f5-178b274d8597 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1555 microversion: 2.91 time: 0.222210 Oct 27 03:22:19.518715 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 251/501] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:22:19 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1555 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:22:19.557647 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-fc278e59-1a7a-46e0-b1f6-740762cb3884 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:19.558568 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-fc278e59-1a7a-46e0-b1f6-740762cb3884 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 5910c783-6877-4a41-8650-0973a11f3578] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:19.570747 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fc278e59-1a7a-46e0-b1f6-740762cb3884 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:19.571414 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fc278e59-1a7a-46e0-b1f6-740762cb3884 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:19.571875 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fc278e59-1a7a-46e0-b1f6-740762cb3884 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:19.573671 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fc278e59-1a7a-46e0-b1f6-740762cb3884 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:19.574172 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fc278e59-1a7a-46e0-b1f6-740762cb3884 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:19.574695 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fc278e59-1a7a-46e0-b1f6-740762cb3884 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:19.826524 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-71367a95-9d1a-42f3-856f-005c5b9f340e tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:19.835196 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-71367a95-9d1a-42f3-856f-005c5b9f340e tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/d0a79872-c316-4bb2-914c-a118831bc023" status: 200 len: 1316 microversion: 2.1 time: 0.704409 Oct 27 03:22:19.842148 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 251/502] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:19 2022] GET /compute/v2.1/servers/d0a79872-c316-4bb2-914c-a118831bc023 => generated 1316 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:22:19.943066 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-fc278e59-1a7a-46e0-b1f6-740762cb3884 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:19.961346 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-fc278e59-1a7a-46e0-b1f6-740762cb3884 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578" status: 200 len: 1471 microversion: 2.1 time: 0.407315 Oct 27 03:22:19.983250 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 252/503] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:19 2022] GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578 => generated 1471 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:22:19.998946 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-981fb31f-60c5-4d1c-a6ff-31dae060bcf4 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:22:19.999501 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-981fb31f-60c5-4d1c-a6ff-31dae060bcf4 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 5910c783-6877-4a41-8650-0973a11f3578] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:20.020605 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-981fb31f-60c5-4d1c-a6ff-31dae060bcf4 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:20.034582 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-981fb31f-60c5-4d1c-a6ff-31dae060bcf4 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:20.038289 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-981fb31f-60c5-4d1c-a6ff-31dae060bcf4 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:20.039328 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-981fb31f-60c5-4d1c-a6ff-31dae060bcf4 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:20.039964 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-981fb31f-60c5-4d1c-a6ff-31dae060bcf4 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:20.040563 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-981fb31f-60c5-4d1c-a6ff-31dae060bcf4 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:20.443287 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-981fb31f-60c5-4d1c-a6ff-31dae060bcf4 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "POST /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578/action" status: 204 len: 0 microversion: 2.1 time: 0.448905 Oct 27 03:22:20.445549 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 252/504] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:22:19 2022] POST /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578/action => generated 0 bytes in 452 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:22:20.469876 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-918f83af-e877-48da-87b3-fd450d9024f9 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:20.471034 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-918f83af-e877-48da-87b3-fd450d9024f9 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 5910c783-6877-4a41-8650-0973a11f3578] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:20.482163 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-918f83af-e877-48da-87b3-fd450d9024f9 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:20.484211 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-918f83af-e877-48da-87b3-fd450d9024f9 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:20.484861 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-918f83af-e877-48da-87b3-fd450d9024f9 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:20.486935 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-918f83af-e877-48da-87b3-fd450d9024f9 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:20.488930 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-918f83af-e877-48da-87b3-fd450d9024f9 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:20.491873 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-918f83af-e877-48da-87b3-fd450d9024f9 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:20.542706 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=100 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:20.548642 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7bf3160d-9eff-4e61-aa43-cc256577fc5a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:20.555794 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7bf3160d-9eff-4e61-aa43-cc256577fc5a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:20.577403 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7bf3160d-9eff-4e61-aa43-cc256577fc5a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:20.584553 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7bf3160d-9eff-4e61-aa43-cc256577fc5a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:20.588417 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7bf3160d-9eff-4e61-aa43-cc256577fc5a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:20.594920 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7bf3160d-9eff-4e61-aa43-cc256577fc5a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:20.598063 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7bf3160d-9eff-4e61-aa43-cc256577fc5a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:20.598639 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7bf3160d-9eff-4e61-aa43-cc256577fc5a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:21.159076 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-918f83af-e877-48da-87b3-fd450d9024f9 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:21.174249 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-918f83af-e877-48da-87b3-fd450d9024f9 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578" status: 200 len: 1471 microversion: 2.1 time: 0.723607 Oct 27 03:22:21.175262 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 253/505] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:20 2022] GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578 => generated 1471 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:22:21.190709 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-144d23fe-5973-4c70-b51a-364e7b829a95 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:21.199838 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-144d23fe-5973-4c70-b51a-364e7b829a95 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: d0a79872-c316-4bb2-914c-a118831bc023] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:21.221033 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-144d23fe-5973-4c70-b51a-364e7b829a95 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:21.222191 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-144d23fe-5973-4c70-b51a-364e7b829a95 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:21.225576 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-144d23fe-5973-4c70-b51a-364e7b829a95 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:21.238306 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-144d23fe-5973-4c70-b51a-364e7b829a95 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:21.239731 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-144d23fe-5973-4c70-b51a-364e7b829a95 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:21.241559 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-144d23fe-5973-4c70-b51a-364e7b829a95 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:21.389037 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7bf3160d-9eff-4e61-aa43-cc256577fc5a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:21.410368 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7bf3160d-9eff-4e61-aa43-cc256577fc5a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:21.414736 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7bf3160d-9eff-4e61-aa43-cc256577fc5a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:21.421973 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7bf3160d-9eff-4e61-aa43-cc256577fc5a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1555 microversion: 2.91 time: 0.878687 Oct 27 03:22:21.423403 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 253/506] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:22:20 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1555 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:22:21.744533 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-144d23fe-5973-4c70-b51a-364e7b829a95 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:21.761292 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-144d23fe-5973-4c70-b51a-364e7b829a95 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/d0a79872-c316-4bb2-914c-a118831bc023" status: 200 len: 1465 microversion: 2.1 time: 0.578346 Oct 27 03:22:21.763887 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 254/507] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:21 2022] GET /compute/v2.1/servers/d0a79872-c316-4bb2-914c-a118831bc023 => generated 1465 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:22:22.204971 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d63dea0c-afc4-4eed-9326-b35e3cb8f2e3 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:22.205603 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d63dea0c-afc4-4eed-9326-b35e3cb8f2e3 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 5910c783-6877-4a41-8650-0973a11f3578] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:22.223153 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d63dea0c-afc4-4eed-9326-b35e3cb8f2e3 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:22.234306 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d63dea0c-afc4-4eed-9326-b35e3cb8f2e3 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:22.235004 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d63dea0c-afc4-4eed-9326-b35e3cb8f2e3 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:22.235929 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d63dea0c-afc4-4eed-9326-b35e3cb8f2e3 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:22.236857 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d63dea0c-afc4-4eed-9326-b35e3cb8f2e3 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:22.241185 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d63dea0c-afc4-4eed-9326-b35e3cb8f2e3 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:22.333387 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b3ff9bb5-94bf-4e4e-8c1a-0cdebe9ee057 tempest-ServersOnMultiNodesTest-1789564933 tempest-ServersOnMultiNodesTest-1789564933-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:22.334011 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b3ff9bb5-94bf-4e4e-8c1a-0cdebe9ee057 tempest-ServersOnMultiNodesTest-1789564933 tempest-ServersOnMultiNodesTest-1789564933-project-admin] [instance: d0a79872-c316-4bb2-914c-a118831bc023] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:22.350656 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b3ff9bb5-94bf-4e4e-8c1a-0cdebe9ee057 tempest-ServersOnMultiNodesTest-1789564933 tempest-ServersOnMultiNodesTest-1789564933-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:22.354648 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b3ff9bb5-94bf-4e4e-8c1a-0cdebe9ee057 tempest-ServersOnMultiNodesTest-1789564933 tempest-ServersOnMultiNodesTest-1789564933-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:22.355503 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b3ff9bb5-94bf-4e4e-8c1a-0cdebe9ee057 tempest-ServersOnMultiNodesTest-1789564933 tempest-ServersOnMultiNodesTest-1789564933-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:22.359630 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b3ff9bb5-94bf-4e4e-8c1a-0cdebe9ee057 tempest-ServersOnMultiNodesTest-1789564933 tempest-ServersOnMultiNodesTest-1789564933-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:22.360182 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b3ff9bb5-94bf-4e4e-8c1a-0cdebe9ee057 tempest-ServersOnMultiNodesTest-1789564933 tempest-ServersOnMultiNodesTest-1789564933-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:22.360635 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b3ff9bb5-94bf-4e4e-8c1a-0cdebe9ee057 tempest-ServersOnMultiNodesTest-1789564933 tempest-ServersOnMultiNodesTest-1789564933-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:22.601358 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d63dea0c-afc4-4eed-9326-b35e3cb8f2e3 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:22.612873 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d63dea0c-afc4-4eed-9326-b35e3cb8f2e3 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578" status: 200 len: 1471 microversion: 2.1 time: 0.413136 Oct 27 03:22:22.625124 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 255/508] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:22 2022] GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578 => generated 1471 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:22:22.637359 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5bfdf003-f830-4039-8336-6cf1be527b2d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:22.653564 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5bfdf003-f830-4039-8336-6cf1be527b2d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:22.671379 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5bfdf003-f830-4039-8336-6cf1be527b2d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:22.671838 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5bfdf003-f830-4039-8336-6cf1be527b2d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:22.672300 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5bfdf003-f830-4039-8336-6cf1be527b2d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:22.673044 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5bfdf003-f830-4039-8336-6cf1be527b2d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:22.673513 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5bfdf003-f830-4039-8336-6cf1be527b2d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:22.673950 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5bfdf003-f830-4039-8336-6cf1be527b2d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:22.910075 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5bfdf003-f830-4039-8336-6cf1be527b2d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:22.926001 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5bfdf003-f830-4039-8336-6cf1be527b2d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:22.939715 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5bfdf003-f830-4039-8336-6cf1be527b2d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:22.954242 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5bfdf003-f830-4039-8336-6cf1be527b2d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1555 microversion: 2.91 time: 0.326216 Oct 27 03:22:22.955086 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 256/509] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:22:22 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1555 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:22:23.600379 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ddc94984-ca3b-438e-b96a-63f28eaf153b tempest-HostsAdminNegativeTestJSON-1207522275 tempest-HostsAdminNegativeTestJSON-1207522275-project-admin] Calling method '.version_select at 0x7f7ddaf1d790>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:23.605658 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ddc94984-ca3b-438e-b96a-63f28eaf153b tempest-HostsAdminNegativeTestJSON-1207522275 tempest-HostsAdminNegativeTestJSON-1207522275-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:23.607247 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ddc94984-ca3b-438e-b96a-63f28eaf153b tempest-HostsAdminNegativeTestJSON-1207522275 tempest-HostsAdminNegativeTestJSON-1207522275-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:23.607624 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ddc94984-ca3b-438e-b96a-63f28eaf153b tempest-HostsAdminNegativeTestJSON-1207522275 tempest-HostsAdminNegativeTestJSON-1207522275-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:23.614685 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ddc94984-ca3b-438e-b96a-63f28eaf153b tempest-HostsAdminNegativeTestJSON-1207522275 tempest-HostsAdminNegativeTestJSON-1207522275-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:23.615496 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ddc94984-ca3b-438e-b96a-63f28eaf153b tempest-HostsAdminNegativeTestJSON-1207522275 tempest-HostsAdminNegativeTestJSON-1207522275-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:23.616178 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ddc94984-ca3b-438e-b96a-63f28eaf153b tempest-HostsAdminNegativeTestJSON-1207522275 tempest-HostsAdminNegativeTestJSON-1207522275-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:23.668093 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ddc94984-ca3b-438e-b96a-63f28eaf153b tempest-HostsAdminNegativeTestJSON-1207522275 tempest-HostsAdminNegativeTestJSON-1207522275-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.348805 Oct 27 03:22:23.679527 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 257/510] 10.222.0.20 () {58 vars in 1128 bytes} [Thu Oct 27 03:22:23 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:22:23.682714 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b2fe77c3-b18f-4afe-9a97-ccdedbae9526 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:23.683563 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b2fe77c3-b18f-4afe-9a97-ccdedbae9526 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 5910c783-6877-4a41-8650-0973a11f3578] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:23.699821 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b2fe77c3-b18f-4afe-9a97-ccdedbae9526 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:23.700364 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b2fe77c3-b18f-4afe-9a97-ccdedbae9526 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:23.701575 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b2fe77c3-b18f-4afe-9a97-ccdedbae9526 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:23.703163 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b2fe77c3-b18f-4afe-9a97-ccdedbae9526 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:23.703988 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b2fe77c3-b18f-4afe-9a97-ccdedbae9526 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:23.704636 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b2fe77c3-b18f-4afe-9a97-ccdedbae9526 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:23.835616 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b3ff9bb5-94bf-4e4e-8c1a-0cdebe9ee057 tempest-ServersOnMultiNodesTest-1789564933 tempest-ServersOnMultiNodesTest-1789564933-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/d0a79872-c316-4bb2-914c-a118831bc023" status: 200 len: 1616 microversion: 2.1 time: 2.028721 Oct 27 03:22:23.837553 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 254/511] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:21 2022] GET /compute/v2.1/servers/d0a79872-c316-4bb2-914c-a118831bc023 => generated 1616 bytes in 2051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:22:24.224590 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-15b7dbfd-a615-40d4-a382-a320a4917de8 tempest-HostsAdminNegativeTestJSON-1608547038 tempest-HostsAdminNegativeTestJSON-1608547038-project] Calling method '.version_select at 0x7f7ddae580d0>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:24.230392 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-15b7dbfd-a615-40d4-a382-a320a4917de8 tempest-HostsAdminNegativeTestJSON-1608547038 tempest-HostsAdminNegativeTestJSON-1608547038-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '774c19162a9148bebc234e6295929fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22917d924b1c4258a190781b34e6c81d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:24.236458 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-15b7dbfd-a615-40d4-a382-a320a4917de8 tempest-HostsAdminNegativeTestJSON-1608547038 tempest-HostsAdminNegativeTestJSON-1608547038-project] Request method failure captured: Oct 27 03:22:24.236458 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Oct 27 03:22:24.236458 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:22:24.236458 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:22:24.236458 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:22:24.236458 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:22:24.236458 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:22:24.236458 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:22:24.236458 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:22:24.236458 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:22:24.236458 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWflsxb1SMSK_WeZWOt6cJKTgTiGqo91PwIAlhto7wLpGUUuC7D-reLurZAz9IdR2mY8Hr06VvWDT4tkDGA6f_1nl__GXLnnJzkicSm0Ikg9E-vgz2wm3g9oNFYlZfdMnrfIiWMto9CQXedUivuszKQ1tWK7JRA-z5KLins7s0h0mZik Oct 27 03:22:24.236458 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:22:24.236458 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:22:24.236458 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:22:24.236458 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:22:24.236458 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:22:24.236458 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:22:24.236458 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 22917d924b1c4258a190781b34e6c81d Oct 27 03:22:24.236458 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1608547038 Oct 27 03:22:24.236458 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:22:24.236458 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:22:24.237749 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/22917d924b1c4258a190781b34e6c81d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/22917d924b1c4258a190781b34e6c81d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/22917d924b1c4258a190781b34e6c81d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_22917d924b1c4258a190781b34e6c81d"}]}] Oct 27 03:22:24.237749 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1608547038 Oct 27 03:22:24.237749 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 22917d924b1c4258a190781b34e6c81d Oct 27 03:22:24.237749 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1608547038 Oct 27 03:22:24.237749 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-HostsAdminNegativeTestJSON-1608547038-project Oct 27 03:22:24.237749 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:22:24.237749 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:22:24.237749 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 774c19162a9148bebc234e6295929fa3 Oct 27 03:22:24.237749 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1608547038-project Oct 27 03:22:24.237749 n-d-862769-1 devstack@n-api.service[121000]: method: Oct 27 03:22:24.237749 n-d-862769-1 devstack@n-api.service[121000]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 27 03:22:24.237749 n-d-862769-1 devstack@n-api.service[121000]: action_args: {} Oct 27 03:22:24.237749 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:22:24.238612 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:22:24.238612 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:22:24.238612 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:22:24.238612 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:22:24.238612 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:22:24.238612 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:22:24.238612 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:22:24.238612 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 03:22:24.238612 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:22:24.238612 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:22:24.238612 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:22:24.238612 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Oct 27 03:22:24.238612 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Oct 27 03:22:24.238612 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 03:22:24.238612 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 03:22:24.238612 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 03:22:24.238612 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 03:22:24.238612 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 03:22:24.238612 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 03:22:24.239844 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 03:22:24.239844 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 03:22:24.239844 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 03:22:24.239844 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 03:22:24.239844 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 03:22:24.239844 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 03:22:24.239844 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 03:22:24.239844 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 03:22:24.239844 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 27 03:22:24.239844 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:22:24.239844 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:22:24.239844 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:22:24.239844 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:22:24.239844 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:22:24.239844 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:22:24.239844 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 03:22:24.239844 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 03:22:24.239844 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 27 03:22:24.239844 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:22:24.252990 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-15b7dbfd-a615-40d4-a382-a320a4917de8 tempest-HostsAdminNegativeTestJSON-1608547038 tempest-HostsAdminNegativeTestJSON-1608547038-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:22:24.257116 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-15b7dbfd-a615-40d4-a382-a320a4917de8 tempest-HostsAdminNegativeTestJSON-1608547038 tempest-HostsAdminNegativeTestJSON-1608547038-project] 10.222.0.20 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.416761 Oct 27 03:22:24.259399 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 255/512] 10.222.0.20 () {58 vars in 1128 bytes} [Thu Oct 27 03:22:23 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 420 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:22:24.275745 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-fd3da87a-6c35-4443-bfa9-941af1a4ed62 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Action: 'create', calling method: .version_select at 0x7f7ddade8d30>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-277201358", "policies": ["affinity"]}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:22:24.343083 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-fd3da87a-6c35-4443-bfa9-941af1a4ed62 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Getting quotas for project b95729a8c8a14361b7cbf8b2b13900b2. Resources: {'server_groups'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:22:24.352741 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-fd3da87a-6c35-4443-bfa9-941af1a4ed62 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Getting quotas for user 91d1351fcb6b4cd08f176e6d0cc5bb11 and project b95729a8c8a14361b7cbf8b2b13900b2. Resources: {'server_groups'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:22:24.467526 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b2fe77c3-b18f-4afe-9a97-ccdedbae9526 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:24.483339 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b2fe77c3-b18f-4afe-9a97-ccdedbae9526 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578" status: 200 len: 1471 microversion: 2.1 time: 0.806263 Oct 27 03:22:24.483935 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 258/513] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:23 2022] GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578 => generated 1471 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:22:24.505911 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-25d12b75-7236-4584-b8bf-90cc9efdd852 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:24.511207 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-25d12b75-7236-4584-b8bf-90cc9efdd852 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:24.524944 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-25d12b75-7236-4584-b8bf-90cc9efdd852 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:24.530851 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-25d12b75-7236-4584-b8bf-90cc9efdd852 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:24.534456 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-fd3da87a-6c35-4443-bfa9-941af1a4ed62 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Getting quotas for project b95729a8c8a14361b7cbf8b2b13900b2. Resources: {'server_groups'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:22:24.535746 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-25d12b75-7236-4584-b8bf-90cc9efdd852 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:24.536516 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-25d12b75-7236-4584-b8bf-90cc9efdd852 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:24.536993 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-25d12b75-7236-4584-b8bf-90cc9efdd852 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:24.537422 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-25d12b75-7236-4584-b8bf-90cc9efdd852 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:24.546785 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-fd3da87a-6c35-4443-bfa9-941af1a4ed62 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Getting quotas for user 91d1351fcb6b4cd08f176e6d0cc5bb11 and project b95729a8c8a14361b7cbf8b2b13900b2. Resources: {'server_groups'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:22:24.564929 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-fd3da87a-6c35-4443-bfa9-941af1a4ed62 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.302615 Oct 27 03:22:24.599893 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 256/514] 10.222.0.20 () {60 vars in 1174 bytes} [Thu Oct 27 03:22:24 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:22:24.641952 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a2ab6a51-7822-4a9d-baad-0c91cb0a7b18 tempest-HostsAdminNegativeTestJSON-1608547038 tempest-HostsAdminNegativeTestJSON-1608547038-project] Calling method '.version_select at 0x7f7ddaf6b040>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:24.647406 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a2ab6a51-7822-4a9d-baad-0c91cb0a7b18 tempest-HostsAdminNegativeTestJSON-1608547038 tempest-HostsAdminNegativeTestJSON-1608547038-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '774c19162a9148bebc234e6295929fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22917d924b1c4258a190781b34e6c81d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:24.650161 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a2ab6a51-7822-4a9d-baad-0c91cb0a7b18 tempest-HostsAdminNegativeTestJSON-1608547038 tempest-HostsAdminNegativeTestJSON-1608547038-project] Request method failure captured: Oct 27 03:22:24.650161 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/os-hosts/n-d-862769-1/reboot HTTP/1.1 Oct 27 03:22:24.650161 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:22:24.650161 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:22:24.650161 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:22:24.650161 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:22:24.650161 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:22:24.650161 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:22:24.650161 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:22:24.650161 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:22:24.650161 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWflsxb1SMSK_WeZWOt6cJKTgTiGqo91PwIAlhto7wLpGUUuC7D-reLurZAz9IdR2mY8Hr06VvWDT4tkDGA6f_1nl__GXLnnJzkicSm0Ikg9E-vgz2wm3g9oNFYlZfdMnrfIiWMto9CQXedUivuszKQ1tWK7JRA-z5KLins7s0h0mZik Oct 27 03:22:24.650161 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:22:24.650161 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:22:24.650161 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:22:24.650161 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:22:24.650161 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:22:24.650161 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:22:24.650161 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 22917d924b1c4258a190781b34e6c81d Oct 27 03:22:24.650161 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1608547038 Oct 27 03:22:24.650161 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:22:24.650161 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:22:24.651648 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/22917d924b1c4258a190781b34e6c81d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/22917d924b1c4258a190781b34e6c81d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/22917d924b1c4258a190781b34e6c81d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_22917d924b1c4258a190781b34e6c81d"}]}] Oct 27 03:22:24.651648 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1608547038 Oct 27 03:22:24.651648 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 22917d924b1c4258a190781b34e6c81d Oct 27 03:22:24.651648 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1608547038 Oct 27 03:22:24.651648 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-HostsAdminNegativeTestJSON-1608547038-project Oct 27 03:22:24.651648 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:22:24.651648 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:22:24.651648 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 774c19162a9148bebc234e6295929fa3 Oct 27 03:22:24.651648 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1608547038-project Oct 27 03:22:24.651648 n-d-862769-1 devstack@n-api.service[121000]: method: Oct 27 03:22:24.651648 n-d-862769-1 devstack@n-api.service[121000]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 27 03:22:24.651648 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': 'n-d-862769-1'} Oct 27 03:22:24.651648 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:22:24.652547 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:22:24.652547 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:22:24.652547 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:22:24.652547 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:22:24.652547 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:22:24.652547 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:22:24.652547 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:22:24.652547 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:22:24.652547 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:22:24.652547 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Oct 27 03:22:24.652547 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Oct 27 03:22:24.652547 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 03:22:24.652547 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 03:22:24.652547 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 03:22:24.652547 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 03:22:24.652547 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 03:22:24.652547 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 03:22:24.652547 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 03:22:24.652547 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 03:22:24.654761 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 03:22:24.654761 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 03:22:24.654761 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 03:22:24.654761 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 03:22:24.654761 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 03:22:24.654761 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 03:22:24.654761 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 27 03:22:24.654761 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:22:24.654761 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:22:24.654761 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:22:24.654761 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:22:24.654761 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:22:24.654761 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:22:24.654761 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 03:22:24.654761 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 03:22:24.654761 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 27 03:22:24.654761 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:22:24.657503 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a2ab6a51-7822-4a9d-baad-0c91cb0a7b18 tempest-HostsAdminNegativeTestJSON-1608547038 tempest-HostsAdminNegativeTestJSON-1608547038-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:22:24.658604 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a2ab6a51-7822-4a9d-baad-0c91cb0a7b18 tempest-HostsAdminNegativeTestJSON-1608547038 tempest-HostsAdminNegativeTestJSON-1608547038-project] 10.222.0.20 "GET /compute/v2.1/os-hosts/n-d-862769-1/reboot" status: 403 len: 111 microversion: 2.1 time: 0.057664 Oct 27 03:22:24.659731 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 257/515] 10.222.0.20 () {58 vars in 1188 bytes} [Thu Oct 27 03:22:24 2022] GET /compute/v2.1/os-hosts/n-d-862769-1/reboot => generated 111 bytes in 59 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:22:24.665011 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-5e7d2972-c410-4a9d-930e-81b6feb94849 req-741fe8ba-66c6-40b6-94ca-695fdb59c130 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5910c783-6877-4a41-8650-0973a11f3578", "name": "network-vif-plugged", "status": "completed", "tag": "30830547-1d6a-4cee-9341-539819ef5a04"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:22:24.727910 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-5e7d2972-c410-4a9d-930e-81b6feb94849 req-741fe8ba-66c6-40b6-94ca-695fdb59c130 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:24.731426 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-5e7d2972-c410-4a9d-930e-81b6feb94849 req-741fe8ba-66c6-40b6-94ca-695fdb59c130 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:24.732042 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-5e7d2972-c410-4a9d-930e-81b6feb94849 req-741fe8ba-66c6-40b6-94ca-695fdb59c130 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:24.744345 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-25d12b75-7236-4584-b8bf-90cc9efdd852 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:24.764784 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-25d12b75-7236-4584-b8bf-90cc9efdd852 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:24.773169 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-25d12b75-7236-4584-b8bf-90cc9efdd852 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:24.775473 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-5e7d2972-c410-4a9d-930e-81b6feb94849 req-741fe8ba-66c6-40b6-94ca-695fdb59c130 service nova] Creating event network-vif-plugged:30830547-1d6a-4cee-9341-539819ef5a04 for instance 5910c783-6877-4a41-8650-0973a11f3578 on n-h2-862769-1 Oct 27 03:22:24.784970 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-25d12b75-7236-4584-b8bf-90cc9efdd852 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1555 microversion: 2.91 time: 0.291902 Oct 27 03:22:24.799073 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [req-5e7d2972-c410-4a9d-930e-81b6feb94849 req-741fe8ba-66c6-40b6-94ca-695fdb59c130 service nova] Instance 5910c783-6877-4a41-8650-0973a11f3578 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862769-1', 'n-h1-862769-1'} {{(pid=121000) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 03:22:24.809010 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 259/516] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:22:24 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1555 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:22:24.834328 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0cb40e22-a274-470e-86f6-71ce4f98eaa1 tempest-HostsAdminNegativeTestJSON-1207522275 tempest-HostsAdminNegativeTestJSON-1207522275-project-admin] Calling method '.version_select at 0x7f7ddaf830d0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:24.860013 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-5e7d2972-c410-4a9d-930e-81b6feb94849 req-741fe8ba-66c6-40b6-94ca-695fdb59c130 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.193171 Oct 27 03:22:24.861705 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 258/517] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:22:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:22:24.882908 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-0cb40e22-a274-470e-86f6-71ce4f98eaa1 tempest-HostsAdminNegativeTestJSON-1207522275 tempest-HostsAdminNegativeTestJSON-1207522275-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 03:22:24.885049 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0cb40e22-a274-470e-86f6-71ce4f98eaa1 tempest-HostsAdminNegativeTestJSON-1207522275 tempest-HostsAdminNegativeTestJSON-1207522275-project-admin] Request method failure captured: Oct 27 03:22:24.885049 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Oct 27 03:22:24.885049 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:22:24.885049 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:22:24.885049 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:22:24.885049 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:22:24.885049 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:22:24.885049 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:22:24.885049 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:22:24.885049 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:22:24.885049 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWflvuHqOpbBlUT-8uLW_EakkPSOsjyKW2s48fG6NITqI-ocP9qkzg_7-JpwmmmRpvdgDCep2fAL_caNlbEU1u38_0fVzK1lnRJJdhg-mTzr0YYhndBwtpiQ8ZP6FKgNgaA6iShIXAqxMJOrDr5LSZFd3hpPfXC_wNeW1zg-GUgJl3JU Oct 27 03:22:24.885049 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:22:24.885049 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:22:24.885049 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:22:24.885049 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:22:24.885049 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:22:24.885049 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:22:24.885049 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 4b48298a698c4a6baa293ddb287b1b6c Oct 27 03:22:24.885049 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1207522275 Oct 27 03:22:24.885049 n-d-862769-1 devstack@n-api.service[121001]: X-Role: admin,member,reader Oct 27 03:22:24.885049 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: admin,member,reader Oct 27 03:22:24.886542 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4b48298a698c4a6baa293ddb287b1b6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4b48298a698c4a6baa293ddb287b1b6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4b48298a698c4a6baa293ddb287b1b6c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4b48298a698c4a6baa293ddb287b1b6c"}]}] Oct 27 03:22:24.886542 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1207522275 Oct 27 03:22:24.886542 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 4b48298a698c4a6baa293ddb287b1b6c Oct 27 03:22:24.886542 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1207522275 Oct 27 03:22:24.886542 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-HostsAdminNegativeTestJSON-1207522275-project-admin Oct 27 03:22:24.886542 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:22:24.886542 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:22:24.886542 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 2cef7271f7ef4a9a91f23002fc10ea75 Oct 27 03:22:24.886542 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1207522275-project-admin Oct 27 03:22:24.886542 n-d-862769-1 devstack@n-api.service[121001]: method: Oct 27 03:22:24.886542 n-d-862769-1 devstack@n-api.service[121001]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 03:22:24.886542 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': 'nonexistent_hostname'} Oct 27 03:22:24.886542 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:22:24.887493 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:22:24.887493 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 27 03:22:24.887493 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 27 03:22:24.887493 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 27 03:22:24.887493 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 27 03:22:24.887493 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 03:22:24.887493 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 03:22:24.887493 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 03:22:24.887493 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 03:22:24.887493 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 27 03:22:24.887493 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 27 03:22:24.887493 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 27 03:22:24.887493 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 27 03:22:24.887493 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 03:22:24.887493 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 03:22:24.887493 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 27 03:22:24.887493 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 27 03:22:24.887493 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 03:22:24.887493 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 03:22:24.889863 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 27 03:22:24.889863 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 27 03:22:24.889863 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 03:22:24.889863 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:22:24.889863 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:22:24.889863 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:22:24.889863 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:22:24.889863 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:22:24.889863 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:22:24.889863 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:22:24.889863 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:22:24.889863 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:22:24.889863 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:22:24.889863 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:22:24.889863 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:22:24.889863 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Oct 27 03:22:24.889863 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Oct 27 03:22:24.889863 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 27 03:22:24.889863 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:22:24.891531 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 03:22:24.891531 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:22:24.891531 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:22:24.891531 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:22:24.891531 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:22:24.891531 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:22:24.891531 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:22:24.891531 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:22:24.891531 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:22:24.891531 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 03:22:24.891531 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:22:24.891531 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0cb40e22-a274-470e-86f6-71ce4f98eaa1 tempest-HostsAdminNegativeTestJSON-1207522275 tempest-HostsAdminNegativeTestJSON-1207522275-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:22:24.891531 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0cb40e22-a274-470e-86f6-71ce4f98eaa1 tempest-HostsAdminNegativeTestJSON-1207522275 tempest-HostsAdminNegativeTestJSON-1207522275-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.080846 Oct 27 03:22:24.891531 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 260/518] 10.222.0.20 () {58 vars in 1212 bytes} [Thu Oct 27 03:22:24 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 03:22:24.904856 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-df9ddff5-9f43-496d-97cf-7f703970d0ec tempest-HostsAdminNegativeTestJSON-1608547038 tempest-HostsAdminNegativeTestJSON-1608547038-project] Calling method '.version_select at 0x7f7ddaf0a790>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:24.908066 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-df9ddff5-9f43-496d-97cf-7f703970d0ec tempest-HostsAdminNegativeTestJSON-1608547038 tempest-HostsAdminNegativeTestJSON-1608547038-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '774c19162a9148bebc234e6295929fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22917d924b1c4258a190781b34e6c81d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:24.913109 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-df9ddff5-9f43-496d-97cf-7f703970d0ec tempest-HostsAdminNegativeTestJSON-1608547038 tempest-HostsAdminNegativeTestJSON-1608547038-project] Request method failure captured: Oct 27 03:22:24.913109 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/os-hosts/n-d-862769-1 HTTP/1.1 Oct 27 03:22:24.913109 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:22:24.913109 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:22:24.913109 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:22:24.913109 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:22:24.913109 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:22:24.913109 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:22:24.913109 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:22:24.913109 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:22:24.913109 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWflsxb1SMSK_WeZWOt6cJKTgTiGqo91PwIAlhto7wLpGUUuC7D-reLurZAz9IdR2mY8Hr06VvWDT4tkDGA6f_1nl__GXLnnJzkicSm0Ikg9E-vgz2wm3g9oNFYlZfdMnrfIiWMto9CQXedUivuszKQ1tWK7JRA-z5KLins7s0h0mZik Oct 27 03:22:24.913109 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:22:24.913109 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:22:24.913109 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:22:24.913109 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:22:24.913109 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:22:24.913109 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:22:24.913109 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 22917d924b1c4258a190781b34e6c81d Oct 27 03:22:24.913109 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1608547038 Oct 27 03:22:24.913109 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:22:24.913109 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:22:24.914440 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/22917d924b1c4258a190781b34e6c81d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/22917d924b1c4258a190781b34e6c81d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/22917d924b1c4258a190781b34e6c81d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_22917d924b1c4258a190781b34e6c81d"}]}] Oct 27 03:22:24.914440 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1608547038 Oct 27 03:22:24.914440 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 22917d924b1c4258a190781b34e6c81d Oct 27 03:22:24.914440 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1608547038 Oct 27 03:22:24.914440 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-HostsAdminNegativeTestJSON-1608547038-project Oct 27 03:22:24.914440 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:22:24.914440 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:22:24.914440 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 774c19162a9148bebc234e6295929fa3 Oct 27 03:22:24.914440 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1608547038-project Oct 27 03:22:24.914440 n-d-862769-1 devstack@n-api.service[121000]: method: Oct 27 03:22:24.914440 n-d-862769-1 devstack@n-api.service[121000]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 27 03:22:24.914440 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': 'n-d-862769-1'} Oct 27 03:22:24.914440 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:22:24.915445 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:22:24.915445 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:22:24.915445 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:22:24.915445 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:22:24.915445 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:22:24.915445 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:22:24.915445 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:22:24.915445 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:22:24.915445 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:22:24.915445 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Oct 27 03:22:24.915445 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Oct 27 03:22:24.915445 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 03:22:24.915445 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 03:22:24.915445 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 03:22:24.915445 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 03:22:24.915445 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 03:22:24.915445 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 03:22:24.915445 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 03:22:24.915445 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 03:22:24.916618 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 03:22:24.916618 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 03:22:24.916618 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 03:22:24.916618 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 03:22:24.916618 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 03:22:24.916618 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 03:22:24.916618 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 27 03:22:24.916618 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:22:24.916618 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:22:24.916618 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:22:24.916618 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:22:24.916618 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:22:24.916618 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:22:24.916618 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 03:22:24.916618 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 03:22:24.916618 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 27 03:22:24.916618 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:22:24.919551 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-df9ddff5-9f43-496d-97cf-7f703970d0ec tempest-HostsAdminNegativeTestJSON-1608547038 tempest-HostsAdminNegativeTestJSON-1608547038-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:22:24.921381 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-df9ddff5-9f43-496d-97cf-7f703970d0ec tempest-HostsAdminNegativeTestJSON-1608547038 tempest-HostsAdminNegativeTestJSON-1608547038-project] 10.222.0.20 "GET /compute/v2.1/os-hosts/n-d-862769-1" status: 403 len: 109 microversion: 2.1 time: 0.026035 Oct 27 03:22:24.925731 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 259/519] 10.222.0.20 () {58 vars in 1167 bytes} [Thu Oct 27 03:22:24 2022] GET /compute/v2.1/os-hosts/n-d-862769-1 => generated 109 bytes in 31 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:22:24.935617 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-14c9335d-5d3f-47ce-9cc0-888af4e963ab tempest-HostsAdminNegativeTestJSON-1207522275 tempest-HostsAdminNegativeTestJSON-1207522275-project-admin] Calling method '.version_select at 0x7f7ddaf1d700>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:24.944841 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-14c9335d-5d3f-47ce-9cc0-888af4e963ab tempest-HostsAdminNegativeTestJSON-1207522275 tempest-HostsAdminNegativeTestJSON-1207522275-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 03:22:24.946508 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-14c9335d-5d3f-47ce-9cc0-888af4e963ab tempest-HostsAdminNegativeTestJSON-1207522275 tempest-HostsAdminNegativeTestJSON-1207522275-project-admin] Request method failure captured: Oct 27 03:22:24.946508 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 27 03:22:24.946508 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:22:24.946508 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:22:24.946508 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:22:24.946508 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:22:24.946508 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:22:24.946508 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:22:24.946508 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:22:24.946508 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:22:24.946508 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWflvuHqOpbBlUT-8uLW_EakkPSOsjyKW2s48fG6NITqI-ocP9qkzg_7-JpwmmmRpvdgDCep2fAL_caNlbEU1u38_0fVzK1lnRJJdhg-mTzr0YYhndBwtpiQ8ZP6FKgNgaA6iShIXAqxMJOrDr5LSZFd3hpPfXC_wNeW1zg-GUgJl3JU Oct 27 03:22:24.946508 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:22:24.946508 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:22:24.946508 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:22:24.946508 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:22:24.946508 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:22:24.946508 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:22:24.946508 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 4b48298a698c4a6baa293ddb287b1b6c Oct 27 03:22:24.946508 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1207522275 Oct 27 03:22:24.946508 n-d-862769-1 devstack@n-api.service[121001]: X-Role: admin,member,reader Oct 27 03:22:24.946508 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: admin,member,reader Oct 27 03:22:24.947908 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4b48298a698c4a6baa293ddb287b1b6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4b48298a698c4a6baa293ddb287b1b6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4b48298a698c4a6baa293ddb287b1b6c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4b48298a698c4a6baa293ddb287b1b6c"}]}] Oct 27 03:22:24.947908 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1207522275 Oct 27 03:22:24.947908 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 4b48298a698c4a6baa293ddb287b1b6c Oct 27 03:22:24.947908 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1207522275 Oct 27 03:22:24.947908 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-HostsAdminNegativeTestJSON-1207522275-project-admin Oct 27 03:22:24.947908 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:22:24.947908 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:22:24.947908 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 2cef7271f7ef4a9a91f23002fc10ea75 Oct 27 03:22:24.947908 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1207522275-project-admin Oct 27 03:22:24.947908 n-d-862769-1 devstack@n-api.service[121001]: method: Oct 27 03:22:24.947908 n-d-862769-1 devstack@n-api.service[121001]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 03:22:24.947908 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': 'nonexistent_hostname'} Oct 27 03:22:24.947908 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:22:24.948772 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:22:24.948772 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Oct 27 03:22:24.948772 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 27 03:22:24.948772 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 03:22:24.948772 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 03:22:24.948772 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 27 03:22:24.948772 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 27 03:22:24.948772 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 03:22:24.948772 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 03:22:24.948772 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 27 03:22:24.948772 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 27 03:22:24.948772 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 03:22:24.948772 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:22:24.948772 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:22:24.948772 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:22:24.948772 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:22:24.948772 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:22:24.948772 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:22:24.948772 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:22:24.949928 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:22:24.949928 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:22:24.949928 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:22:24.949928 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:22:24.949928 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:22:24.949928 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Oct 27 03:22:24.949928 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:22:24.949928 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 03:22:24.949928 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:22:24.949928 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:22:24.949928 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:22:24.949928 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:22:24.949928 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:22:24.949928 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:22:24.949928 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:22:24.949928 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:22:24.949928 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 03:22:24.949928 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:22:24.951622 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-14c9335d-5d3f-47ce-9cc0-888af4e963ab tempest-HostsAdminNegativeTestJSON-1207522275 tempest-HostsAdminNegativeTestJSON-1207522275-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:22:24.951622 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-14c9335d-5d3f-47ce-9cc0-888af4e963ab tempest-HostsAdminNegativeTestJSON-1207522275 tempest-HostsAdminNegativeTestJSON-1207522275-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.016294 Oct 27 03:22:24.959887 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2f12ccb1-b638-4cbf-a75d-55c31510b9e9 tempest-HostsAdminNegativeTestJSON-1608547038 tempest-HostsAdminNegativeTestJSON-1608547038-project] Calling method '.version_select at 0x7f7ddadf5430>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:24.961906 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2f12ccb1-b638-4cbf-a75d-55c31510b9e9 tempest-HostsAdminNegativeTestJSON-1608547038 tempest-HostsAdminNegativeTestJSON-1608547038-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '774c19162a9148bebc234e6295929fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22917d924b1c4258a190781b34e6c81d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:24.963856 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2f12ccb1-b638-4cbf-a75d-55c31510b9e9 tempest-HostsAdminNegativeTestJSON-1608547038 tempest-HostsAdminNegativeTestJSON-1608547038-project] Request method failure captured: Oct 27 03:22:24.963856 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/os-hosts/n-d-862769-1/shutdown HTTP/1.1 Oct 27 03:22:24.963856 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:22:24.963856 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:22:24.963856 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:22:24.963856 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:22:24.963856 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:22:24.963856 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:22:24.963856 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:22:24.963856 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:22:24.963856 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWflsxb1SMSK_WeZWOt6cJKTgTiGqo91PwIAlhto7wLpGUUuC7D-reLurZAz9IdR2mY8Hr06VvWDT4tkDGA6f_1nl__GXLnnJzkicSm0Ikg9E-vgz2wm3g9oNFYlZfdMnrfIiWMto9CQXedUivuszKQ1tWK7JRA-z5KLins7s0h0mZik Oct 27 03:22:24.963856 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:22:24.963856 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:22:24.963856 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:22:24.963856 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:22:24.963856 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:22:24.963856 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:22:24.963856 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 22917d924b1c4258a190781b34e6c81d Oct 27 03:22:24.963856 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1608547038 Oct 27 03:22:24.963856 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:22:24.963856 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:22:24.965420 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/22917d924b1c4258a190781b34e6c81d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/22917d924b1c4258a190781b34e6c81d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/22917d924b1c4258a190781b34e6c81d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_22917d924b1c4258a190781b34e6c81d"}]}] Oct 27 03:22:24.965420 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1608547038 Oct 27 03:22:24.965420 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 22917d924b1c4258a190781b34e6c81d Oct 27 03:22:24.965420 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1608547038 Oct 27 03:22:24.965420 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-HostsAdminNegativeTestJSON-1608547038-project Oct 27 03:22:24.965420 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:22:24.965420 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:22:24.965420 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 774c19162a9148bebc234e6295929fa3 Oct 27 03:22:24.965420 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1608547038-project Oct 27 03:22:24.965420 n-d-862769-1 devstack@n-api.service[121000]: method: Oct 27 03:22:24.965420 n-d-862769-1 devstack@n-api.service[121000]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 27 03:22:24.965420 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': 'n-d-862769-1'} Oct 27 03:22:24.965420 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:22:24.966874 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:22:24.966874 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:22:24.966874 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:22:24.966874 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:22:24.966874 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:22:24.966874 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:22:24.966874 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:22:24.966874 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:22:24.966874 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:22:24.966874 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Oct 27 03:22:24.966874 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Oct 27 03:22:24.966874 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 03:22:24.966874 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 03:22:24.966874 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 03:22:24.966874 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 03:22:24.966874 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 03:22:24.966874 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 03:22:24.966874 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 03:22:24.966874 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 03:22:24.968300 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 03:22:24.968300 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 03:22:24.968300 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 03:22:24.968300 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 03:22:24.968300 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 03:22:24.968300 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 03:22:24.968300 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 27 03:22:24.968300 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:22:24.968300 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:22:24.968300 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:22:24.968300 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:22:24.968300 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:22:24.968300 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:22:24.968300 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 03:22:24.968300 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 03:22:24.968300 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 27 03:22:24.968300 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:22:24.970510 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2f12ccb1-b638-4cbf-a75d-55c31510b9e9 tempest-HostsAdminNegativeTestJSON-1608547038 tempest-HostsAdminNegativeTestJSON-1608547038-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:22:25.055889 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 261/520] 10.222.0.20 () {58 vars in 1191 bytes} [Thu Oct 27 03:22:24 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 03:22:25.056502 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2f12ccb1-b638-4cbf-a75d-55c31510b9e9 tempest-HostsAdminNegativeTestJSON-1608547038 tempest-HostsAdminNegativeTestJSON-1608547038-project] 10.222.0.20 "GET /compute/v2.1/os-hosts/n-d-862769-1/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.017967 Oct 27 03:22:25.056502 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 260/521] 10.222.0.20 () {58 vars in 1194 bytes} [Thu Oct 27 03:22:24 2022] GET /compute/v2.1/os-hosts/n-d-862769-1/shutdown => generated 113 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:22:25.056669 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9ef9f01a-3d4f-4a26-b5f7-8cb86623dbdf tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1881142955", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "42ad9f2d-227d-4b2a-b208-60d85ad55118"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:22:25.056772 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ec9eae98-be22-4e9d-adf0-b92f0f8f5ab3 tempest-HostsAdminNegativeTestJSON-1207522275 tempest-HostsAdminNegativeTestJSON-1207522275-project-admin] Calling method '.version_select at 0x7f7ddafc0790>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:25.056772 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-ec9eae98-be22-4e9d-adf0-b92f0f8f5ab3 tempest-HostsAdminNegativeTestJSON-1207522275 tempest-HostsAdminNegativeTestJSON-1207522275-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 03:22:25.056772 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ec9eae98-be22-4e9d-adf0-b92f0f8f5ab3 tempest-HostsAdminNegativeTestJSON-1207522275 tempest-HostsAdminNegativeTestJSON-1207522275-project-admin] Request method failure captured: Oct 27 03:22:25.056772 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Oct 27 03:22:25.056772 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:22:25.056772 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:22:25.056772 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:22:25.056772 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:22:25.056772 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:22:25.056772 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:22:25.056772 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:22:25.056772 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:22:25.056772 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWflvuHqOpbBlUT-8uLW_EakkPSOsjyKW2s48fG6NITqI-ocP9qkzg_7-JpwmmmRpvdgDCep2fAL_caNlbEU1u38_0fVzK1lnRJJdhg-mTzr0YYhndBwtpiQ8ZP6FKgNgaA6iShIXAqxMJOrDr5LSZFd3hpPfXC_wNeW1zg-GUgJl3JU Oct 27 03:22:25.056772 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:22:25.056772 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:22:25.056772 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:22:25.056772 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:22:25.056772 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:22:25.056772 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:22:25.056772 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 4b48298a698c4a6baa293ddb287b1b6c Oct 27 03:22:25.056772 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1207522275 Oct 27 03:22:25.056772 n-d-862769-1 devstack@n-api.service[121000]: X-Role: admin,member,reader Oct 27 03:22:25.056772 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: admin,member,reader Oct 27 03:22:25.058270 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4b48298a698c4a6baa293ddb287b1b6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4b48298a698c4a6baa293ddb287b1b6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4b48298a698c4a6baa293ddb287b1b6c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4b48298a698c4a6baa293ddb287b1b6c"}]}] Oct 27 03:22:25.058270 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1207522275 Oct 27 03:22:25.058270 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 4b48298a698c4a6baa293ddb287b1b6c Oct 27 03:22:25.058270 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1207522275 Oct 27 03:22:25.058270 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-HostsAdminNegativeTestJSON-1207522275-project-admin Oct 27 03:22:25.058270 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:22:25.058270 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:22:25.058270 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 2cef7271f7ef4a9a91f23002fc10ea75 Oct 27 03:22:25.058270 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1207522275-project-admin Oct 27 03:22:25.058270 n-d-862769-1 devstack@n-api.service[121000]: method: Oct 27 03:22:25.058270 n-d-862769-1 devstack@n-api.service[121000]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 03:22:25.058270 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': 'nonexistent_hostname'} Oct 27 03:22:25.058270 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:22:25.059129 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:22:25.059129 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 27 03:22:25.059129 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 27 03:22:25.059129 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 27 03:22:25.059129 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 27 03:22:25.059129 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 03:22:25.059129 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 03:22:25.059129 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 03:22:25.059129 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 03:22:25.059129 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 27 03:22:25.059129 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 27 03:22:25.059129 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 27 03:22:25.059129 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 27 03:22:25.059129 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 03:22:25.059129 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 03:22:25.059129 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 27 03:22:25.059129 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 27 03:22:25.059129 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 03:22:25.059129 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 03:22:25.060380 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 27 03:22:25.060380 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 27 03:22:25.060380 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 03:22:25.060380 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:22:25.060380 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:22:25.060380 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:22:25.060380 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:22:25.060380 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:22:25.060380 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:22:25.060380 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:22:25.060380 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:22:25.060380 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:22:25.060380 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:22:25.060380 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:22:25.060380 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:22:25.060380 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Oct 27 03:22:25.060380 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Oct 27 03:22:25.060380 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 27 03:22:25.060380 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:22:25.061694 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 03:22:25.061694 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:22:25.061694 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:22:25.061694 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:22:25.061694 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:22:25.061694 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:22:25.061694 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:22:25.061694 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:22:25.061694 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:22:25.061694 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 03:22:25.061694 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:22:25.061694 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ec9eae98-be22-4e9d-adf0-b92f0f8f5ab3 tempest-HostsAdminNegativeTestJSON-1207522275 tempest-HostsAdminNegativeTestJSON-1207522275-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:22:25.061694 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ec9eae98-be22-4e9d-adf0-b92f0f8f5ab3 tempest-HostsAdminNegativeTestJSON-1207522275 tempest-HostsAdminNegativeTestJSON-1207522275-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.024891 Oct 27 03:22:25.061694 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 261/522] 10.222.0.20 () {58 vars in 1218 bytes} [Thu Oct 27 03:22:25 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 03:22:25.062672 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7d58dd3f-156a-4792-8580-77f74659ed26 tempest-HostsAdminNegativeTestJSON-1608547038 tempest-HostsAdminNegativeTestJSON-1608547038-project] Calling method '.version_select at 0x7f7ddaf0a820>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:25.070344 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7d58dd3f-156a-4792-8580-77f74659ed26 tempest-HostsAdminNegativeTestJSON-1608547038 tempest-HostsAdminNegativeTestJSON-1608547038-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '774c19162a9148bebc234e6295929fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22917d924b1c4258a190781b34e6c81d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:25.071242 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7d58dd3f-156a-4792-8580-77f74659ed26 tempest-HostsAdminNegativeTestJSON-1608547038 tempest-HostsAdminNegativeTestJSON-1608547038-project] Request method failure captured: Oct 27 03:22:25.071242 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/os-hosts/n-d-862769-1/startup HTTP/1.1 Oct 27 03:22:25.071242 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:22:25.071242 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:22:25.071242 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:22:25.071242 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:22:25.071242 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:22:25.071242 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:22:25.071242 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:22:25.071242 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:22:25.071242 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWflsxb1SMSK_WeZWOt6cJKTgTiGqo91PwIAlhto7wLpGUUuC7D-reLurZAz9IdR2mY8Hr06VvWDT4tkDGA6f_1nl__GXLnnJzkicSm0Ikg9E-vgz2wm3g9oNFYlZfdMnrfIiWMto9CQXedUivuszKQ1tWK7JRA-z5KLins7s0h0mZik Oct 27 03:22:25.071242 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:22:25.071242 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:22:25.071242 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:22:25.071242 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:22:25.071242 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:22:25.071242 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:22:25.071242 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 22917d924b1c4258a190781b34e6c81d Oct 27 03:22:25.071242 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1608547038 Oct 27 03:22:25.071242 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:22:25.071242 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:22:25.072359 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/22917d924b1c4258a190781b34e6c81d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/22917d924b1c4258a190781b34e6c81d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/22917d924b1c4258a190781b34e6c81d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_22917d924b1c4258a190781b34e6c81d"}]}] Oct 27 03:22:25.072359 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1608547038 Oct 27 03:22:25.072359 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 22917d924b1c4258a190781b34e6c81d Oct 27 03:22:25.072359 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1608547038 Oct 27 03:22:25.072359 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-HostsAdminNegativeTestJSON-1608547038-project Oct 27 03:22:25.072359 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:22:25.072359 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:22:25.072359 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 774c19162a9148bebc234e6295929fa3 Oct 27 03:22:25.072359 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1608547038-project Oct 27 03:22:25.072359 n-d-862769-1 devstack@n-api.service[121000]: method: Oct 27 03:22:25.072359 n-d-862769-1 devstack@n-api.service[121000]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 27 03:22:25.072359 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': 'n-d-862769-1'} Oct 27 03:22:25.072359 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:22:25.073189 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:22:25.073189 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:22:25.073189 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:22:25.073189 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:22:25.073189 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:22:25.073189 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:22:25.073189 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:22:25.073189 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:22:25.073189 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:22:25.073189 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Oct 27 03:22:25.073189 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Oct 27 03:22:25.073189 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 03:22:25.073189 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 03:22:25.073189 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 03:22:25.073189 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 03:22:25.073189 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 03:22:25.073189 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 03:22:25.073189 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 03:22:25.073189 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 03:22:25.074242 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 03:22:25.074242 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 03:22:25.074242 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 03:22:25.074242 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 03:22:25.074242 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 03:22:25.074242 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 03:22:25.074242 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 27 03:22:25.074242 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:22:25.074242 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:22:25.074242 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:22:25.074242 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:22:25.074242 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:22:25.074242 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:22:25.074242 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 03:22:25.074242 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 03:22:25.074242 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 27 03:22:25.074242 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:22:25.075169 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7d58dd3f-156a-4792-8580-77f74659ed26 tempest-HostsAdminNegativeTestJSON-1608547038 tempest-HostsAdminNegativeTestJSON-1608547038-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:22:25.075169 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7d58dd3f-156a-4792-8580-77f74659ed26 tempest-HostsAdminNegativeTestJSON-1608547038 tempest-HostsAdminNegativeTestJSON-1608547038-project] 10.222.0.20 "GET /compute/v2.1/os-hosts/n-d-862769-1/startup" status: 403 len: 110 microversion: 2.1 time: 0.018757 Oct 27 03:22:25.082740 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 262/523] 10.222.0.20 () {58 vars in 1191 bytes} [Thu Oct 27 03:22:25 2022] GET /compute/v2.1/os-hosts/n-d-862769-1/startup => generated 110 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:22:25.090314 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-02e78e55-46ad-44de-baad-6f459a246d49 tempest-HostsAdminNegativeTestJSON-1207522275 tempest-HostsAdminNegativeTestJSON-1207522275-project-admin] Calling method '.version_select at 0x7f7ddae6b3a0>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:25.101668 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-02e78e55-46ad-44de-baad-6f459a246d49 tempest-HostsAdminNegativeTestJSON-1207522275 tempest-HostsAdminNegativeTestJSON-1207522275-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 03:22:25.103497 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-02e78e55-46ad-44de-baad-6f459a246d49 tempest-HostsAdminNegativeTestJSON-1207522275 tempest-HostsAdminNegativeTestJSON-1207522275-project-admin] Request method failure captured: Oct 27 03:22:25.103497 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Oct 27 03:22:25.103497 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:22:25.103497 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:22:25.103497 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:22:25.103497 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:22:25.103497 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:22:25.103497 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:22:25.103497 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:22:25.103497 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:22:25.103497 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWflvuHqOpbBlUT-8uLW_EakkPSOsjyKW2s48fG6NITqI-ocP9qkzg_7-JpwmmmRpvdgDCep2fAL_caNlbEU1u38_0fVzK1lnRJJdhg-mTzr0YYhndBwtpiQ8ZP6FKgNgaA6iShIXAqxMJOrDr5LSZFd3hpPfXC_wNeW1zg-GUgJl3JU Oct 27 03:22:25.103497 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:22:25.103497 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:22:25.103497 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:22:25.103497 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:22:25.103497 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:22:25.103497 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:22:25.103497 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 4b48298a698c4a6baa293ddb287b1b6c Oct 27 03:22:25.103497 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1207522275 Oct 27 03:22:25.103497 n-d-862769-1 devstack@n-api.service[121000]: X-Role: admin,member,reader Oct 27 03:22:25.103497 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: admin,member,reader Oct 27 03:22:25.104696 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4b48298a698c4a6baa293ddb287b1b6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4b48298a698c4a6baa293ddb287b1b6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4b48298a698c4a6baa293ddb287b1b6c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4b48298a698c4a6baa293ddb287b1b6c"}]}] Oct 27 03:22:25.104696 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1207522275 Oct 27 03:22:25.104696 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 4b48298a698c4a6baa293ddb287b1b6c Oct 27 03:22:25.104696 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1207522275 Oct 27 03:22:25.104696 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-HostsAdminNegativeTestJSON-1207522275-project-admin Oct 27 03:22:25.104696 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:22:25.104696 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:22:25.104696 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 2cef7271f7ef4a9a91f23002fc10ea75 Oct 27 03:22:25.104696 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1207522275-project-admin Oct 27 03:22:25.104696 n-d-862769-1 devstack@n-api.service[121000]: method: Oct 27 03:22:25.104696 n-d-862769-1 devstack@n-api.service[121000]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 03:22:25.104696 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': 'nonexistent_hostname'} Oct 27 03:22:25.104696 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:22:25.105414 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:22:25.105414 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 27 03:22:25.105414 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 27 03:22:25.105414 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 27 03:22:25.105414 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 27 03:22:25.105414 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 03:22:25.105414 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 03:22:25.105414 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 03:22:25.105414 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 03:22:25.105414 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 27 03:22:25.105414 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 27 03:22:25.105414 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 27 03:22:25.105414 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 27 03:22:25.105414 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 03:22:25.105414 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 03:22:25.105414 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 27 03:22:25.105414 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 27 03:22:25.105414 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 03:22:25.105414 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 03:22:25.106486 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 27 03:22:25.106486 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 27 03:22:25.106486 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 03:22:25.106486 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:22:25.106486 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:22:25.106486 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:22:25.106486 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:22:25.106486 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:22:25.106486 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:22:25.106486 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:22:25.106486 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:22:25.106486 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:22:25.106486 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:22:25.106486 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:22:25.106486 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:22:25.106486 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Oct 27 03:22:25.106486 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Oct 27 03:22:25.106486 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 27 03:22:25.106486 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:22:25.107762 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 03:22:25.107762 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:22:25.107762 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:22:25.107762 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:22:25.107762 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:22:25.107762 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:22:25.107762 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:22:25.107762 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:22:25.107762 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:22:25.107762 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 03:22:25.107762 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:22:25.107762 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-02e78e55-46ad-44de-baad-6f459a246d49 tempest-HostsAdminNegativeTestJSON-1207522275 tempest-HostsAdminNegativeTestJSON-1207522275-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:22:25.107762 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-02e78e55-46ad-44de-baad-6f459a246d49 tempest-HostsAdminNegativeTestJSON-1207522275 tempest-HostsAdminNegativeTestJSON-1207522275-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.019871 Oct 27 03:22:25.111733 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 263/524] 10.222.0.20 () {58 vars in 1215 bytes} [Thu Oct 27 03:22:25 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 03:22:25.116391 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-698391c7-dfdb-4318-bb7a-bcc41f271617 tempest-HostsAdminNegativeTestJSON-1207522275 tempest-HostsAdminNegativeTestJSON-1207522275-project-admin] Action: 'update', calling method: .version_select at 0x7f7ddae6b1f0>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:22:25.124931 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.network.neutron [None req-9ef9f01a-3d4f-4a26-b5f7-8cb86623dbdf tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] validate_networks() for None {{(pid=121001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:22:25.133499 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-698391c7-dfdb-4318-bb7a-bcc41f271617 tempest-HostsAdminNegativeTestJSON-1207522275 tempest-HostsAdminNegativeTestJSON-1207522275-project-admin] Request method failure captured: Oct 27 03:22:25.133499 n-d-862769-1 devstack@n-api.service[121000]: request: PUT /compute/v2.1/os-hosts/n-d-862769-1 HTTP/1.1 Oct 27 03:22:25.133499 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:22:25.133499 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:22:25.133499 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:22:25.133499 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 51 Oct 27 03:22:25.133499 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:22:25.133499 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:22:25.133499 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:22:25.133499 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:22:25.133499 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWflvuHqOpbBlUT-8uLW_EakkPSOsjyKW2s48fG6NITqI-ocP9qkzg_7-JpwmmmRpvdgDCep2fAL_caNlbEU1u38_0fVzK1lnRJJdhg-mTzr0YYhndBwtpiQ8ZP6FKgNgaA6iShIXAqxMJOrDr5LSZFd3hpPfXC_wNeW1zg-GUgJl3JU Oct 27 03:22:25.133499 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:22:25.133499 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:22:25.133499 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:22:25.133499 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:22:25.133499 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:22:25.133499 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:22:25.133499 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 4b48298a698c4a6baa293ddb287b1b6c Oct 27 03:22:25.133499 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1207522275 Oct 27 03:22:25.133499 n-d-862769-1 devstack@n-api.service[121000]: X-Role: admin,member,reader Oct 27 03:22:25.133499 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: admin,member,reader Oct 27 03:22:25.134784 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4b48298a698c4a6baa293ddb287b1b6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4b48298a698c4a6baa293ddb287b1b6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4b48298a698c4a6baa293ddb287b1b6c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4b48298a698c4a6baa293ddb287b1b6c"}]}] Oct 27 03:22:25.134784 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1207522275 Oct 27 03:22:25.134784 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 4b48298a698c4a6baa293ddb287b1b6c Oct 27 03:22:25.134784 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1207522275 Oct 27 03:22:25.134784 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-HostsAdminNegativeTestJSON-1207522275-project-admin Oct 27 03:22:25.134784 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:22:25.134784 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:22:25.134784 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 2cef7271f7ef4a9a91f23002fc10ea75 Oct 27 03:22:25.134784 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1207522275-project-admin Oct 27 03:22:25.134784 n-d-862769-1 devstack@n-api.service[121000]: Oct 27 03:22:25.134784 n-d-862769-1 devstack@n-api.service[121000]: {"status": "enable", "maintenance_mode": "invalid"} Oct 27 03:22:25.134784 n-d-862769-1 devstack@n-api.service[121000]: method: Oct 27 03:22:25.134784 n-d-862769-1 devstack@n-api.service[121000]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 27 03:22:25.135497 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': 'n-d-862769-1', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Oct 27 03:22:25.135497 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:22:25.135497 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:22:25.135497 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 03:22:25.135497 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 03:22:25.135497 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 03:22:25.135497 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise error Oct 27 03:22:25.135497 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 27 03:22:25.135497 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:22:25.135497 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Oct 27 03:22:25.135497 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 27 03:22:25.135497 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi 'disable', Oct 27 03:22:25.135497 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi 'Enable', Oct 27 03:22:25.135497 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi 'Disable', Oct 27 03:22:25.135497 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 27 03:22:25.135497 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 27 03:22:25.135497 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 27 03:22:25.135497 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:22:25.135497 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi On instance: Oct 27 03:22:25.135497 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi 'invalid' Oct 27 03:22:25.135497 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:22:25.135497 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:22:25.135497 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:22:25.135497 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:22:25.135497 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:22:25.136803 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:22:25.136803 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:22:25.136803 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:22:25.136803 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:22:25.136803 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:22:25.136803 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:22:25.136803 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:22:25.136803 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 03:22:25.136803 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 03:22:25.136803 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 03:22:25.136803 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 03:22:25.136803 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 03:22:25.136803 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 03:22:25.136803 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 27 03:22:25.136803 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:22:25.136803 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:22:25.136803 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:22:25.136803 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:22:25.136803 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:22:25.140241 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:22:25.140241 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 03:22:25.140241 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 03:22:25.140241 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 27 03:22:25.140241 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:22:25.140241 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-698391c7-dfdb-4318-bb7a-bcc41f271617 tempest-HostsAdminNegativeTestJSON-1207522275 tempest-HostsAdminNegativeTestJSON-1207522275-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:22:25.140241 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-698391c7-dfdb-4318-bb7a-bcc41f271617 tempest-HostsAdminNegativeTestJSON-1207522275 tempest-HostsAdminNegativeTestJSON-1207522275-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-hosts/n-d-862769-1" status: 400 len: 199 microversion: 2.1 time: 0.022929 Oct 27 03:22:25.140241 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 264/525] 10.222.0.20 () {60 vars in 1187 bytes} [Thu Oct 27 03:22:25 2022] PUT /compute/v2.1/os-hosts/n-d-862769-1 => generated 199 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 03:22:25.154346 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-481f053a-3afd-40dc-8d48-aa8b7e09ac16 tempest-HostsAdminNegativeTestJSON-1207522275 tempest-HostsAdminNegativeTestJSON-1207522275-project-admin] Action: 'update', calling method: .version_select at 0x7f7ddadf55e0>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:22:25.160904 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-481f053a-3afd-40dc-8d48-aa8b7e09ac16 tempest-HostsAdminNegativeTestJSON-1207522275 tempest-HostsAdminNegativeTestJSON-1207522275-project-admin] Request method failure captured: Oct 27 03:22:25.160904 n-d-862769-1 devstack@n-api.service[121000]: request: PUT /compute/v2.1/os-hosts/n-d-862769-1 HTTP/1.1 Oct 27 03:22:25.160904 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:22:25.160904 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:22:25.160904 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:22:25.160904 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 51 Oct 27 03:22:25.160904 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:22:25.160904 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:22:25.160904 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:22:25.160904 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:22:25.160904 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWflvuHqOpbBlUT-8uLW_EakkPSOsjyKW2s48fG6NITqI-ocP9qkzg_7-JpwmmmRpvdgDCep2fAL_caNlbEU1u38_0fVzK1lnRJJdhg-mTzr0YYhndBwtpiQ8ZP6FKgNgaA6iShIXAqxMJOrDr5LSZFd3hpPfXC_wNeW1zg-GUgJl3JU Oct 27 03:22:25.160904 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:22:25.160904 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:22:25.160904 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:22:25.160904 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:22:25.160904 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:22:25.160904 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:22:25.160904 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 4b48298a698c4a6baa293ddb287b1b6c Oct 27 03:22:25.160904 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1207522275 Oct 27 03:22:25.160904 n-d-862769-1 devstack@n-api.service[121000]: X-Role: admin,member,reader Oct 27 03:22:25.160904 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: admin,member,reader Oct 27 03:22:25.162163 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4b48298a698c4a6baa293ddb287b1b6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4b48298a698c4a6baa293ddb287b1b6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4b48298a698c4a6baa293ddb287b1b6c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4b48298a698c4a6baa293ddb287b1b6c"}]}] Oct 27 03:22:25.162163 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1207522275 Oct 27 03:22:25.162163 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 4b48298a698c4a6baa293ddb287b1b6c Oct 27 03:22:25.162163 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1207522275 Oct 27 03:22:25.162163 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-HostsAdminNegativeTestJSON-1207522275-project-admin Oct 27 03:22:25.162163 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:22:25.162163 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:22:25.162163 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 2cef7271f7ef4a9a91f23002fc10ea75 Oct 27 03:22:25.162163 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1207522275-project-admin Oct 27 03:22:25.162163 n-d-862769-1 devstack@n-api.service[121000]: Oct 27 03:22:25.162163 n-d-862769-1 devstack@n-api.service[121000]: {"status": "invalid", "maintenance_mode": "enable"} Oct 27 03:22:25.162163 n-d-862769-1 devstack@n-api.service[121000]: method: Oct 27 03:22:25.162163 n-d-862769-1 devstack@n-api.service[121000]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 27 03:22:25.163363 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': 'n-d-862769-1', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Oct 27 03:22:25.163363 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:22:25.163363 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:22:25.163363 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 03:22:25.163363 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 03:22:25.163363 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 03:22:25.163363 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise error Oct 27 03:22:25.163363 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 27 03:22:25.163363 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:22:25.163363 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Oct 27 03:22:25.163363 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 27 03:22:25.163363 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi 'disable', Oct 27 03:22:25.163363 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi 'Enable', Oct 27 03:22:25.163363 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi 'Disable', Oct 27 03:22:25.163363 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 27 03:22:25.163363 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 27 03:22:25.163363 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 27 03:22:25.163363 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:22:25.163363 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi On instance: Oct 27 03:22:25.163363 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi 'invalid' Oct 27 03:22:25.163363 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:22:25.163363 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:22:25.163363 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:22:25.163363 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:22:25.163363 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:22:25.164698 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:22:25.164698 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:22:25.164698 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:22:25.164698 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:22:25.164698 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:22:25.164698 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:22:25.164698 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:22:25.164698 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 03:22:25.164698 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 03:22:25.164698 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 03:22:25.164698 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 03:22:25.164698 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 03:22:25.164698 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 03:22:25.164698 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 27 03:22:25.164698 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:22:25.164698 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:22:25.164698 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:22:25.164698 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:22:25.164698 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:22:25.165678 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:22:25.165678 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 03:22:25.165678 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 03:22:25.165678 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 27 03:22:25.165678 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:22:25.165678 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-481f053a-3afd-40dc-8d48-aa8b7e09ac16 tempest-HostsAdminNegativeTestJSON-1207522275 tempest-HostsAdminNegativeTestJSON-1207522275-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:22:25.165678 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-481f053a-3afd-40dc-8d48-aa8b7e09ac16 tempest-HostsAdminNegativeTestJSON-1207522275 tempest-HostsAdminNegativeTestJSON-1207522275-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-hosts/n-d-862769-1" status: 400 len: 189 microversion: 2.1 time: 0.013629 Oct 27 03:22:25.168576 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 265/526] 10.222.0.20 () {60 vars in 1187 bytes} [Thu Oct 27 03:22:25 2022] PUT /compute/v2.1/os-hosts/n-d-862769-1 => generated 189 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 03:22:25.174945 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-57e21adb-6cf6-4116-ab99-27884b84e8ef tempest-HostsAdminNegativeTestJSON-1608547038 tempest-HostsAdminNegativeTestJSON-1608547038-project] Action: 'update', calling method: .version_select at 0x7f7ddade8310>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:22:25.179804 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-57e21adb-6cf6-4116-ab99-27884b84e8ef tempest-HostsAdminNegativeTestJSON-1608547038 tempest-HostsAdminNegativeTestJSON-1608547038-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '774c19162a9148bebc234e6295929fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22917d924b1c4258a190781b34e6c81d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:25.181619 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-57e21adb-6cf6-4116-ab99-27884b84e8ef tempest-HostsAdminNegativeTestJSON-1608547038 tempest-HostsAdminNegativeTestJSON-1608547038-project] Request method failure captured: Oct 27 03:22:25.181619 n-d-862769-1 devstack@n-api.service[121000]: request: PUT /compute/v2.1/os-hosts/n-d-862769-1 HTTP/1.1 Oct 27 03:22:25.181619 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:22:25.181619 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:22:25.181619 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:22:25.181619 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 50 Oct 27 03:22:25.181619 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:22:25.181619 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:22:25.181619 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:22:25.181619 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:22:25.181619 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWflsxb1SMSK_WeZWOt6cJKTgTiGqo91PwIAlhto7wLpGUUuC7D-reLurZAz9IdR2mY8Hr06VvWDT4tkDGA6f_1nl__GXLnnJzkicSm0Ikg9E-vgz2wm3g9oNFYlZfdMnrfIiWMto9CQXedUivuszKQ1tWK7JRA-z5KLins7s0h0mZik Oct 27 03:22:25.181619 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:22:25.181619 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:22:25.181619 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:22:25.181619 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:22:25.181619 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:22:25.181619 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:22:25.181619 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 22917d924b1c4258a190781b34e6c81d Oct 27 03:22:25.181619 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1608547038 Oct 27 03:22:25.181619 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:22:25.181619 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:22:25.182827 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/22917d924b1c4258a190781b34e6c81d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/22917d924b1c4258a190781b34e6c81d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/22917d924b1c4258a190781b34e6c81d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_22917d924b1c4258a190781b34e6c81d"}]}] Oct 27 03:22:25.182827 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1608547038 Oct 27 03:22:25.182827 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 22917d924b1c4258a190781b34e6c81d Oct 27 03:22:25.182827 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1608547038 Oct 27 03:22:25.182827 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-HostsAdminNegativeTestJSON-1608547038-project Oct 27 03:22:25.182827 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:22:25.182827 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:22:25.182827 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 774c19162a9148bebc234e6295929fa3 Oct 27 03:22:25.182827 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1608547038-project Oct 27 03:22:25.182827 n-d-862769-1 devstack@n-api.service[121000]: Oct 27 03:22:25.182827 n-d-862769-1 devstack@n-api.service[121000]: {"status": "enable", "maintenance_mode": "enable"} Oct 27 03:22:25.182827 n-d-862769-1 devstack@n-api.service[121000]: method: Oct 27 03:22:25.182827 n-d-862769-1 devstack@n-api.service[121000]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 27 03:22:25.182827 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': 'n-d-862769-1', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 27 03:22:25.183778 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:22:25.183778 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:22:25.183778 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:22:25.183778 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:22:25.183778 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:22:25.183778 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:22:25.183778 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:22:25.183778 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:22:25.183778 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:22:25.183778 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:22:25.183778 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:22:25.183778 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:22:25.183778 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Oct 27 03:22:25.183778 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Oct 27 03:22:25.183778 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 03:22:25.183778 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 03:22:25.183778 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 03:22:25.183778 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 03:22:25.183778 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 03:22:25.183778 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 03:22:25.184822 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 03:22:25.184822 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 03:22:25.184822 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 03:22:25.184822 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 03:22:25.184822 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 03:22:25.184822 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 03:22:25.184822 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 03:22:25.184822 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 03:22:25.184822 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 27 03:22:25.184822 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:22:25.184822 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:22:25.184822 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:22:25.184822 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:22:25.184822 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:22:25.184822 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:22:25.184822 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 03:22:25.184822 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 03:22:25.184822 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 27 03:22:25.184822 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:22:25.187210 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-57e21adb-6cf6-4116-ab99-27884b84e8ef tempest-HostsAdminNegativeTestJSON-1608547038 tempest-HostsAdminNegativeTestJSON-1608547038-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:22:25.187210 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-57e21adb-6cf6-4116-ab99-27884b84e8ef tempest-HostsAdminNegativeTestJSON-1608547038 tempest-HostsAdminNegativeTestJSON-1608547038-project] 10.222.0.20 "PUT /compute/v2.1/os-hosts/n-d-862769-1" status: 403 len: 111 microversion: 2.1 time: 0.013425 Oct 27 03:22:25.188753 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 266/527] 10.222.0.20 () {60 vars in 1187 bytes} [Thu Oct 27 03:22:25 2022] PUT /compute/v2.1/os-hosts/n-d-862769-1 => generated 111 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:22:25.200573 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0f597c5e-90ab-4daf-a944-2d3266edc046 tempest-HostsAdminNegativeTestJSON-1207522275 tempest-HostsAdminNegativeTestJSON-1207522275-project-admin] Action: 'update', calling method: .version_select at 0x7f7ddae184c0>, body: {"status": null, "maintenance_mode": null} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:22:25.205729 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0f597c5e-90ab-4daf-a944-2d3266edc046 tempest-HostsAdminNegativeTestJSON-1207522275 tempest-HostsAdminNegativeTestJSON-1207522275-project-admin] Request method failure captured: Oct 27 03:22:25.205729 n-d-862769-1 devstack@n-api.service[121000]: request: PUT /compute/v2.1/os-hosts/n-d-862769-1 HTTP/1.1 Oct 27 03:22:25.205729 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:22:25.205729 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:22:25.205729 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:22:25.205729 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 42 Oct 27 03:22:25.205729 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:22:25.205729 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:22:25.205729 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:22:25.205729 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:22:25.205729 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWflvuHqOpbBlUT-8uLW_EakkPSOsjyKW2s48fG6NITqI-ocP9qkzg_7-JpwmmmRpvdgDCep2fAL_caNlbEU1u38_0fVzK1lnRJJdhg-mTzr0YYhndBwtpiQ8ZP6FKgNgaA6iShIXAqxMJOrDr5LSZFd3hpPfXC_wNeW1zg-GUgJl3JU Oct 27 03:22:25.205729 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:22:25.205729 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:22:25.205729 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:22:25.205729 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:22:25.205729 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:22:25.205729 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:22:25.205729 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 4b48298a698c4a6baa293ddb287b1b6c Oct 27 03:22:25.205729 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1207522275 Oct 27 03:22:25.205729 n-d-862769-1 devstack@n-api.service[121000]: X-Role: admin,member,reader Oct 27 03:22:25.205729 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: admin,member,reader Oct 27 03:22:25.207148 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4b48298a698c4a6baa293ddb287b1b6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4b48298a698c4a6baa293ddb287b1b6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4b48298a698c4a6baa293ddb287b1b6c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4b48298a698c4a6baa293ddb287b1b6c"}]}] Oct 27 03:22:25.207148 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1207522275 Oct 27 03:22:25.207148 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 4b48298a698c4a6baa293ddb287b1b6c Oct 27 03:22:25.207148 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1207522275 Oct 27 03:22:25.207148 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-HostsAdminNegativeTestJSON-1207522275-project-admin Oct 27 03:22:25.207148 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:22:25.207148 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:22:25.207148 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 2cef7271f7ef4a9a91f23002fc10ea75 Oct 27 03:22:25.207148 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1207522275-project-admin Oct 27 03:22:25.207148 n-d-862769-1 devstack@n-api.service[121000]: Oct 27 03:22:25.207148 n-d-862769-1 devstack@n-api.service[121000]: {"status": null, "maintenance_mode": null} Oct 27 03:22:25.207148 n-d-862769-1 devstack@n-api.service[121000]: method: Oct 27 03:22:25.207148 n-d-862769-1 devstack@n-api.service[121000]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 27 03:22:25.207148 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': 'n-d-862769-1', 'body': {'status': None, 'maintenance_mode': None}} Oct 27 03:22:25.207892 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:22:25.207892 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:22:25.207892 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 03:22:25.207892 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 03:22:25.207892 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 03:22:25.207892 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise error Oct 27 03:22:25.207892 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Oct 27 03:22:25.207892 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:22:25.207892 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Oct 27 03:22:25.207892 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 27 03:22:25.207892 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi 'disable', Oct 27 03:22:25.207892 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi 'Enable', Oct 27 03:22:25.207892 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi 'Disable', Oct 27 03:22:25.207892 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 27 03:22:25.207892 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 27 03:22:25.207892 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 27 03:22:25.207892 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:22:25.207892 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi On instance: Oct 27 03:22:25.207892 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi None Oct 27 03:22:25.207892 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:22:25.207892 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:22:25.207892 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:22:25.207892 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:22:25.207892 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:22:25.207892 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:22:25.209211 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:22:25.209211 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:22:25.209211 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:22:25.209211 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:22:25.209211 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:22:25.209211 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:22:25.209211 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 03:22:25.209211 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 03:22:25.209211 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 03:22:25.209211 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 03:22:25.209211 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 03:22:25.209211 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 03:22:25.209211 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 27 03:22:25.209211 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:22:25.209211 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:22:25.209211 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:22:25.209211 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:22:25.209211 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:22:25.209211 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:22:25.210223 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 03:22:25.210223 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 03:22:25.210223 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 27 03:22:25.210223 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:22:25.210223 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0f597c5e-90ab-4daf-a944-2d3266edc046 tempest-HostsAdminNegativeTestJSON-1207522275 tempest-HostsAdminNegativeTestJSON-1207522275-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:22:25.210223 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0f597c5e-90ab-4daf-a944-2d3266edc046 tempest-HostsAdminNegativeTestJSON-1207522275 tempest-HostsAdminNegativeTestJSON-1207522275-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-hosts/n-d-862769-1" status: 400 len: 127 microversion: 2.1 time: 0.017394 Oct 27 03:22:25.210223 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 267/528] 10.222.0.20 () {60 vars in 1187 bytes} [Thu Oct 27 03:22:25 2022] PUT /compute/v2.1/os-hosts/n-d-862769-1 => generated 127 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 03:22:25.226580 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b14fe782-a2e3-46cd-a566-eba9ddb5e637 tempest-HostsAdminNegativeTestJSON-1207522275 tempest-HostsAdminNegativeTestJSON-1207522275-project-admin] Action: 'update', calling method: .version_select at 0x7f7ddadf5ee0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:22:25.230174 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.hosts [None req-b14fe782-a2e3-46cd-a566-eba9ddb5e637 tempest-HostsAdminNegativeTestJSON-1207522275 tempest-HostsAdminNegativeTestJSON-1207522275-project-admin] Enabling host nonexistent_hostname. Oct 27 03:22:25.238592 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-b14fe782-a2e3-46cd-a566-eba9ddb5e637 tempest-HostsAdminNegativeTestJSON-1207522275 tempest-HostsAdminNegativeTestJSON-1207522275-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 03:22:25.240343 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b14fe782-a2e3-46cd-a566-eba9ddb5e637 tempest-HostsAdminNegativeTestJSON-1207522275 tempest-HostsAdminNegativeTestJSON-1207522275-project-admin] Request method failure captured: Oct 27 03:22:25.240343 n-d-862769-1 devstack@n-api.service[121000]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 27 03:22:25.240343 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:22:25.240343 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:22:25.240343 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:22:25.240343 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 50 Oct 27 03:22:25.240343 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:22:25.240343 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:22:25.240343 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:22:25.240343 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:22:25.240343 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWflvuHqOpbBlUT-8uLW_EakkPSOsjyKW2s48fG6NITqI-ocP9qkzg_7-JpwmmmRpvdgDCep2fAL_caNlbEU1u38_0fVzK1lnRJJdhg-mTzr0YYhndBwtpiQ8ZP6FKgNgaA6iShIXAqxMJOrDr5LSZFd3hpPfXC_wNeW1zg-GUgJl3JU Oct 27 03:22:25.240343 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:22:25.240343 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:22:25.240343 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:22:25.240343 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:22:25.240343 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:22:25.240343 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:22:25.240343 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 4b48298a698c4a6baa293ddb287b1b6c Oct 27 03:22:25.240343 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1207522275 Oct 27 03:22:25.240343 n-d-862769-1 devstack@n-api.service[121000]: X-Role: admin,member,reader Oct 27 03:22:25.240343 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: admin,member,reader Oct 27 03:22:25.241484 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4b48298a698c4a6baa293ddb287b1b6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4b48298a698c4a6baa293ddb287b1b6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4b48298a698c4a6baa293ddb287b1b6c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4b48298a698c4a6baa293ddb287b1b6c"}]}] Oct 27 03:22:25.241484 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1207522275 Oct 27 03:22:25.241484 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 4b48298a698c4a6baa293ddb287b1b6c Oct 27 03:22:25.241484 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1207522275 Oct 27 03:22:25.241484 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-HostsAdminNegativeTestJSON-1207522275-project-admin Oct 27 03:22:25.241484 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:22:25.241484 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:22:25.241484 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 2cef7271f7ef4a9a91f23002fc10ea75 Oct 27 03:22:25.241484 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1207522275-project-admin Oct 27 03:22:25.241484 n-d-862769-1 devstack@n-api.service[121000]: Oct 27 03:22:25.241484 n-d-862769-1 devstack@n-api.service[121000]: {"status": "enable", "maintenance_mode": "enable"} Oct 27 03:22:25.241484 n-d-862769-1 devstack@n-api.service[121000]: method: Oct 27 03:22:25.241484 n-d-862769-1 devstack@n-api.service[121000]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 03:22:25.241484 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 27 03:22:25.242275 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:22:25.242275 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:22:25.242275 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Oct 27 03:22:25.242275 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Oct 27 03:22:25.242275 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 27 03:22:25.242275 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 27 03:22:25.242275 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 03:22:25.242275 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 03:22:25.242275 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 03:22:25.242275 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 03:22:25.242275 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 27 03:22:25.242275 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 27 03:22:25.242275 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 27 03:22:25.242275 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 27 03:22:25.242275 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 03:22:25.242275 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 03:22:25.242275 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 27 03:22:25.242275 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 27 03:22:25.246828 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 03:22:25.246828 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 03:22:25.246828 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 27 03:22:25.246828 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 27 03:22:25.246828 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 03:22:25.246828 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:22:25.246828 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:22:25.246828 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:22:25.246828 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:22:25.246828 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:22:25.246828 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:22:25.246828 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:22:25.246828 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:22:25.246828 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:22:25.246828 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:22:25.246828 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:22:25.246828 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:22:25.246828 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:22:25.246828 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:22:25.246828 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Oct 27 03:22:25.247958 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Oct 27 03:22:25.247958 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Oct 27 03:22:25.247958 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:22:25.247958 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 03:22:25.247958 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:22:25.247958 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:22:25.247958 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:22:25.247958 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:22:25.247958 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:22:25.247958 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:22:25.247958 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:22:25.247958 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:22:25.247958 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 03:22:25.247958 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:22:25.247958 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b14fe782-a2e3-46cd-a566-eba9ddb5e637 tempest-HostsAdminNegativeTestJSON-1207522275 tempest-HostsAdminNegativeTestJSON-1207522275-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:22:25.249228 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b14fe782-a2e3-46cd-a566-eba9ddb5e637 tempest-HostsAdminNegativeTestJSON-1207522275 tempest-HostsAdminNegativeTestJSON-1207522275-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.023053 Oct 27 03:22:25.249228 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 268/529] 10.222.0.20 () {60 vars in 1211 bytes} [Thu Oct 27 03:22:25 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 03:22:25.517097 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f28dc109-cd93-4ec4-a24d-02788e41a98b tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:25.520082 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f28dc109-cd93-4ec4-a24d-02788e41a98b tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 5910c783-6877-4a41-8650-0973a11f3578] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:25.537317 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f28dc109-cd93-4ec4-a24d-02788e41a98b tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:25.538221 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f28dc109-cd93-4ec4-a24d-02788e41a98b tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:25.539524 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f28dc109-cd93-4ec4-a24d-02788e41a98b tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:25.540749 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f28dc109-cd93-4ec4-a24d-02788e41a98b tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:25.542688 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-9ef9f01a-3d4f-4a26-b5f7-8cb86623dbdf tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Flavor limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:22:25.543574 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f28dc109-cd93-4ec4-a24d-02788e41a98b tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:25.543828 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-9ef9f01a-3d4f-4a26-b5f7-8cb86623dbdf tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Image limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:22:25.544040 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f28dc109-cd93-4ec4-a24d-02788e41a98b tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:25.544641 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-9ef9f01a-3d4f-4a26-b5f7-8cb86623dbdf tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Flavor pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:22:25.551950 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-9ef9f01a-3d4f-4a26-b5f7-8cb86623dbdf tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Image pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:22:25.553649 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-9ef9f01a-3d4f-4a26-b5f7-8cb86623dbdf tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:22:25.631535 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9ef9f01a-3d4f-4a26-b5f7-8cb86623dbdf tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:25.633217 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9ef9f01a-3d4f-4a26-b5f7-8cb86623dbdf tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:25.634785 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9ef9f01a-3d4f-4a26-b5f7-8cb86623dbdf tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:25.643127 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9ef9f01a-3d4f-4a26-b5f7-8cb86623dbdf tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:25.644905 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9ef9f01a-3d4f-4a26-b5f7-8cb86623dbdf tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:25.645508 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9ef9f01a-3d4f-4a26-b5f7-8cb86623dbdf tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:25.693082 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-9ef9f01a-3d4f-4a26-b5f7-8cb86623dbdf tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Getting quotas for project b95729a8c8a14361b7cbf8b2b13900b2. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:22:25.704258 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-9ef9f01a-3d4f-4a26-b5f7-8cb86623dbdf tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Getting quotas for user 91d1351fcb6b4cd08f176e6d0cc5bb11 and project b95729a8c8a14361b7cbf8b2b13900b2. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:22:25.729664 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-9ef9f01a-3d4f-4a26-b5f7-8cb86623dbdf tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Going to run 2 instances... {{(pid=121001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:22:25.732668 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-9ef9f01a-3d4f-4a26-b5f7-8cb86623dbdf tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: 37b3577c-f561-4d8e-957d-cdf1819ef5c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:22:25.936825 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-9ef9f01a-3d4f-4a26-b5f7-8cb86623dbdf tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=121001) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 27 03:22:26.000843 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-9ef9f01a-3d4f-4a26-b5f7-8cb86623dbdf tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Getting quotas for project b95729a8c8a14361b7cbf8b2b13900b2. Resources: {'server_group_members'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:22:26.019037 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-9ef9f01a-3d4f-4a26-b5f7-8cb86623dbdf tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Getting quotas for user 91d1351fcb6b4cd08f176e6d0cc5bb11 and project b95729a8c8a14361b7cbf8b2b13900b2. Resources: {'server_group_members'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:22:26.163173 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f28dc109-cd93-4ec4-a24d-02788e41a98b tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:26.171626 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f28dc109-cd93-4ec4-a24d-02788e41a98b tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578" status: 200 len: 1463 microversion: 2.1 time: 0.664183 Oct 27 03:22:26.192781 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 269/530] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:25 2022] GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578 => generated 1463 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:22:26.213577 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-04f017c1-68b9-488f-99a8-cab6e32813da tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:26.214375 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-04f017c1-68b9-488f-99a8-cab6e32813da tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:26.220929 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-9ef9f01a-3d4f-4a26-b5f7-8cb86623dbdf tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Getting quotas for project b95729a8c8a14361b7cbf8b2b13900b2. Resources: {'server_group_members'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:22:26.232342 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-04f017c1-68b9-488f-99a8-cab6e32813da tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:26.234896 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-04f017c1-68b9-488f-99a8-cab6e32813da tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:26.240752 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-04f017c1-68b9-488f-99a8-cab6e32813da tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:26.240752 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-04f017c1-68b9-488f-99a8-cab6e32813da tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:26.241782 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-04f017c1-68b9-488f-99a8-cab6e32813da tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:26.242416 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-04f017c1-68b9-488f-99a8-cab6e32813da tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:26.251083 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-9ef9f01a-3d4f-4a26-b5f7-8cb86623dbdf tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Getting quotas for user 91d1351fcb6b4cd08f176e6d0cc5bb11 and project b95729a8c8a14361b7cbf8b2b13900b2. Resources: {'server_group_members'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:22:26.294015 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-9ef9f01a-3d4f-4a26-b5f7-8cb86623dbdf tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: 1a733f7d-4f8d-4190-9795-937510f1a516] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=37b3577c-f561-4d8e-957d-cdf1819ef5c1,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:22:26.353539 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-04f017c1-68b9-488f-99a8-cab6e32813da tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:26.367120 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-04f017c1-68b9-488f-99a8-cab6e32813da tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:26.368594 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-04f017c1-68b9-488f-99a8-cab6e32813da tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:26.385838 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-04f017c1-68b9-488f-99a8-cab6e32813da tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1555 microversion: 2.91 time: 0.191872 Oct 27 03:22:26.396822 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 270/531] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:22:26 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1555 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:22:26.396822 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-054b17ce-1bc2-4d9b-8449-1575d4abfc6e tempest-MigrationsAdminTest-707106630 tempest-MigrationsAdminTest-707106630-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:26.396822 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-054b17ce-1bc2-4d9b-8449-1575d4abfc6e tempest-MigrationsAdminTest-707106630 tempest-MigrationsAdminTest-707106630-project-admin] [instance: 5910c783-6877-4a41-8650-0973a11f3578] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:26.413204 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-054b17ce-1bc2-4d9b-8449-1575d4abfc6e tempest-MigrationsAdminTest-707106630 tempest-MigrationsAdminTest-707106630-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:26.413704 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-054b17ce-1bc2-4d9b-8449-1575d4abfc6e tempest-MigrationsAdminTest-707106630 tempest-MigrationsAdminTest-707106630-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:26.419195 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-054b17ce-1bc2-4d9b-8449-1575d4abfc6e tempest-MigrationsAdminTest-707106630 tempest-MigrationsAdminTest-707106630-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:26.420784 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-054b17ce-1bc2-4d9b-8449-1575d4abfc6e tempest-MigrationsAdminTest-707106630 tempest-MigrationsAdminTest-707106630-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:26.423631 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-054b17ce-1bc2-4d9b-8449-1575d4abfc6e tempest-MigrationsAdminTest-707106630 tempest-MigrationsAdminTest-707106630-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:26.424094 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-054b17ce-1bc2-4d9b-8449-1575d4abfc6e tempest-MigrationsAdminTest-707106630 tempest-MigrationsAdminTest-707106630-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:26.460072 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-9ef9f01a-3d4f-4a26-b5f7-8cb86623dbdf tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Getting quotas for project b95729a8c8a14361b7cbf8b2b13900b2. Resources: {'server_group_members'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:22:26.467569 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-9ef9f01a-3d4f-4a26-b5f7-8cb86623dbdf tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Getting quotas for user 91d1351fcb6b4cd08f176e6d0cc5bb11 and project b95729a8c8a14361b7cbf8b2b13900b2. Resources: {'server_group_members'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:22:26.605968 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:26.621448 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-9ef9f01a-3d4f-4a26-b5f7-8cb86623dbdf tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Getting quotas for project b95729a8c8a14361b7cbf8b2b13900b2. Resources: {'server_group_members'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:22:26.641543 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-9ef9f01a-3d4f-4a26-b5f7-8cb86623dbdf tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Getting quotas for user 91d1351fcb6b4cd08f176e6d0cc5bb11 and project b95729a8c8a14361b7cbf8b2b13900b2. Resources: {'server_group_members'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:22:26.802658 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9ef9f01a-3d4f-4a26-b5f7-8cb86623dbdf tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.781672 Oct 27 03:22:26.802658 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 262/532] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:22:25 2022] POST /compute/v2.1/servers => generated 32 bytes in 1783 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 27 03:22:26.806493 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d2eb19d9-4608-461c-8d41-c151e4b9abeb tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-658741253", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "651676802", "adminPass": "***", "networks": [{"uuid": "752da8de-f675-4935-b6b0-82279e0cd445"}], "security_groups": [{"name": "tempest-securitygroup--1058824952"}], "key_name": "tempest-keypair-831517697", "user_data": "}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:22:27.186689 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.network.neutron [None req-d2eb19d9-4608-461c-8d41-c151e4b9abeb tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] validate_networks() for [('752da8de-f675-4935-b6b0-82279e0cd445', None, None, None, None, None)] {{(pid=121001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:22:27.714564 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-054b17ce-1bc2-4d9b-8449-1575d4abfc6e tempest-MigrationsAdminTest-707106630 tempest-MigrationsAdminTest-707106630-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578" status: 200 len: 1614 microversion: 2.1 time: 1.326983 Oct 27 03:22:27.715788 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 271/533] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:26 2022] GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578 => generated 1614 bytes in 1329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:22:27.722750 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-bef2290d-0672-451c-9c46-959b7c319952 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:27.736549 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-bef2290d-0672-451c-9c46-959b7c319952 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:27.736549 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-bef2290d-0672-451c-9c46-959b7c319952 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Searching by: {'deleted': False, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2'} {{(pid=121000) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 03:22:27.811712 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bef2290d-0672-451c-9c46-959b7c319952 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:27.812216 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bef2290d-0672-451c-9c46-959b7c319952 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:27.812673 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bef2290d-0672-451c-9c46-959b7c319952 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:27.813416 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bef2290d-0672-451c-9c46-959b7c319952 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:27.813879 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bef2290d-0672-451c-9c46-959b7c319952 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:27.835661 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bef2290d-0672-451c-9c46-959b7c319952 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:28.101224 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.multi_cell_list [None req-bef2290d-0672-451c-9c46-959b7c319952 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=121000) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 03:22:28.244417 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-bef2290d-0672-451c-9c46-959b7c319952 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 1003 microversion: 2.1 time: 0.526145 Oct 27 03:22:28.247299 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 272/534] 10.222.0.20 () {58 vars in 1125 bytes} [Thu Oct 27 03:22:27 2022] GET /compute/v2.1/servers => generated 1003 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:22:28.253731 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f1c44d43-21be-412a-a1f1-8e4ae89965c7 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:28.254779 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f1c44d43-21be-412a-a1f1-8e4ae89965c7 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:28.262381 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f1c44d43-21be-412a-a1f1-8e4ae89965c7 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:28.264158 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f1c44d43-21be-412a-a1f1-8e4ae89965c7 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:28.264848 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f1c44d43-21be-412a-a1f1-8e4ae89965c7 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:28.265886 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f1c44d43-21be-412a-a1f1-8e4ae89965c7 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:28.266836 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f1c44d43-21be-412a-a1f1-8e4ae89965c7 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:28.267591 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f1c44d43-21be-412a-a1f1-8e4ae89965c7 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:28.313435 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-d2eb19d9-4608-461c-8d41-c151e4b9abeb tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Flavor limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:22:28.313938 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-d2eb19d9-4608-461c-8d41-c151e4b9abeb tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Image limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:22:28.314776 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-d2eb19d9-4608-461c-8d41-c151e4b9abeb tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Flavor pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:22:28.315559 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-d2eb19d9-4608-461c-8d41-c151e4b9abeb tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Image pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:22:28.316178 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-d2eb19d9-4608-461c-8d41-c151e4b9abeb tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:22:28.329578 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d2eb19d9-4608-461c-8d41-c151e4b9abeb tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:28.330307 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d2eb19d9-4608-461c-8d41-c151e4b9abeb tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:28.330805 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d2eb19d9-4608-461c-8d41-c151e4b9abeb tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:28.331906 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d2eb19d9-4608-461c-8d41-c151e4b9abeb tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:28.332560 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d2eb19d9-4608-461c-8d41-c151e4b9abeb tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:28.333250 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d2eb19d9-4608-461c-8d41-c151e4b9abeb tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:28.355806 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-d2eb19d9-4608-461c-8d41-c151e4b9abeb tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Getting quotas for project 39f033d34ad44397bfda5cba4c041071. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:22:28.379217 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-d2eb19d9-4608-461c-8d41-c151e4b9abeb tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Getting quotas for user 2e23378ed283426cbff623265d9bbc96 and project 39f033d34ad44397bfda5cba4c041071. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:22:28.438383 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d2eb19d9-4608-461c-8d41-c151e4b9abeb tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Going to run 1 instances... {{(pid=121001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:22:28.443667 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d2eb19d9-4608-461c-8d41-c151e4b9abeb tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] [instance: 2d4fe59a-b31c-4fc0-8994-eb21e313d18a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:22:28.457064 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f1c44d43-21be-412a-a1f1-8e4ae89965c7 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:28.474518 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f1c44d43-21be-412a-a1f1-8e4ae89965c7 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:28.484205 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f1c44d43-21be-412a-a1f1-8e4ae89965c7 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:28.504194 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f1c44d43-21be-412a-a1f1-8e4ae89965c7 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1555 microversion: 2.91 time: 0.254622 Oct 27 03:22:28.505981 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 273/535] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:22:28 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1555 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:22:28.512842 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5d120371-9c2a-4745-a3ef-f7ed0aec10a3 tempest-MigrationsAdminTest-707106630 tempest-MigrationsAdminTest-707106630-project-admin] Calling method '.version_select at 0x7f7ddade88b0>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:28.524492 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5d120371-9c2a-4745-a3ef-f7ed0aec10a3 tempest-MigrationsAdminTest-707106630 tempest-MigrationsAdminTest-707106630-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:28.527481 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5d120371-9c2a-4745-a3ef-f7ed0aec10a3 tempest-MigrationsAdminTest-707106630 tempest-MigrationsAdminTest-707106630-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:28.528321 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5d120371-9c2a-4745-a3ef-f7ed0aec10a3 tempest-MigrationsAdminTest-707106630 tempest-MigrationsAdminTest-707106630-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:28.756820 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d2eb19d9-4608-461c-8d41-c151e4b9abeb tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.951726 Oct 27 03:22:28.759545 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 263/536] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:22:26 2022] POST /compute/v2.1/servers => generated 402 bytes in 1960 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 03:22:28.786885 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9d77c898-c233-4a40-81c7-d7c8e20e365f tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:28.789293 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-9d77c898-c233-4a40-81c7-d7c8e20e365f tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: 1a733f7d-4f8d-4190-9795-937510f1a516] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:29.014995 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9d77c898-c233-4a40-81c7-d7c8e20e365f tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:29.052655 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5d120371-9c2a-4745-a3ef-f7ed0aec10a3 tempest-MigrationsAdminTest-707106630 tempest-MigrationsAdminTest-707106630-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 409 microversion: 2.1 time: 0.544458 Oct 27 03:22:29.065166 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 274/537] 10.222.0.20 () {58 vars in 1143 bytes} [Thu Oct 27 03:22:28 2022] GET /compute/v2.1/os-migrations => generated 409 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:22:29.088792 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-75aed47e-f332-4619-b80d-fbb5d09799e5 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:29.089672 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-75aed47e-f332-4619-b80d-fbb5d09799e5 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] [instance: 2d4fe59a-b31c-4fc0-8994-eb21e313d18a] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:29.104018 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9d77c898-c233-4a40-81c7-d7c8e20e365f tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/1a733f7d-4f8d-4190-9795-937510f1a516" status: 200 len: 1219 microversion: 2.1 time: 0.342569 Oct 27 03:22:29.115377 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 264/538] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:28 2022] GET /compute/v2.1/servers/1a733f7d-4f8d-4190-9795-937510f1a516 => generated 1219 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:22:29.291481 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-75aed47e-f332-4619-b80d-fbb5d09799e5 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e23378ed283426cbff623265d9bbc96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f033d34ad44397bfda5cba4c041071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:29.304554 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-75aed47e-f332-4619-b80d-fbb5d09799e5 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] 10.222.0.20 "GET /compute/v2.1/servers/2d4fe59a-b31c-4fc0-8994-eb21e313d18a" status: 200 len: 1261 microversion: 2.1 time: 0.237641 Oct 27 03:22:29.307004 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 275/539] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:29 2022] GET /compute/v2.1/servers/2d4fe59a-b31c-4fc0-8994-eb21e313d18a => generated 1261 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:22:29.486672 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f1a8451a-a78d-4de3-90e8-66c99e88157f tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1940874262", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:22:29.542695 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-262f5c35-52ec-4c85-8a79-d38aba0c99e0 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:29.543523 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-262f5c35-52ec-4c85-8a79-d38aba0c99e0 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:29.563466 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-262f5c35-52ec-4c85-8a79-d38aba0c99e0 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:29.563986 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-262f5c35-52ec-4c85-8a79-d38aba0c99e0 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:29.564431 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-262f5c35-52ec-4c85-8a79-d38aba0c99e0 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:29.565160 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-262f5c35-52ec-4c85-8a79-d38aba0c99e0 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:29.566165 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-262f5c35-52ec-4c85-8a79-d38aba0c99e0 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:29.566551 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-262f5c35-52ec-4c85-8a79-d38aba0c99e0 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:29.607516 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.network.neutron [None req-f1a8451a-a78d-4de3-90e8-66c99e88157f tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] validate_networks() for None {{(pid=121001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:22:29.883215 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-262f5c35-52ec-4c85-8a79-d38aba0c99e0 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:29.901122 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-262f5c35-52ec-4c85-8a79-d38aba0c99e0 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:29.903099 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-262f5c35-52ec-4c85-8a79-d38aba0c99e0 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:29.918311 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-262f5c35-52ec-4c85-8a79-d38aba0c99e0 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1555 microversion: 2.91 time: 0.380293 Oct 27 03:22:29.932598 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 276/540] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:22:29 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1555 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:22:30.239182 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b2f38e36-e24f-4c4d-b3c1-81cdc8803e8e tempest-QuotaClassesAdminTestJSON-1521392372 tempest-QuotaClassesAdminTestJSON-1521392372-project-admin] Calling method '.version_select at 0x7f7ddadf5ee0>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:30.269539 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b2f38e36-e24f-4c4d-b3c1-81cdc8803e8e tempest-QuotaClassesAdminTestJSON-1521392372 tempest-QuotaClassesAdminTestJSON-1521392372-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.330756 Oct 27 03:22:30.279657 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 277/541] 10.222.0.20 () {58 vars in 1185 bytes} [Thu Oct 27 03:22:29 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:22:30.284902 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6f1a8055-a40f-4897-a6a3-95f51bdf993a tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:30.285753 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6f1a8055-a40f-4897-a6a3-95f51bdf993a tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: 1a733f7d-4f8d-4190-9795-937510f1a516] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:30.292256 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6f1a8055-a40f-4897-a6a3-95f51bdf993a tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:30.292998 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6f1a8055-a40f-4897-a6a3-95f51bdf993a tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:30.293672 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6f1a8055-a40f-4897-a6a3-95f51bdf993a tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:30.294843 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6f1a8055-a40f-4897-a6a3-95f51bdf993a tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:30.297582 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6f1a8055-a40f-4897-a6a3-95f51bdf993a tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:30.310094 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6f1a8055-a40f-4897-a6a3-95f51bdf993a tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:30.382948 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-f1a8451a-a78d-4de3-90e8-66c99e88157f tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Flavor limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:22:30.383595 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-f1a8451a-a78d-4de3-90e8-66c99e88157f tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Image limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:22:30.384371 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-f1a8451a-a78d-4de3-90e8-66c99e88157f tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Flavor pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:22:30.385003 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-f1a8451a-a78d-4de3-90e8-66c99e88157f tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Image pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:22:30.385735 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-f1a8451a-a78d-4de3-90e8-66c99e88157f tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:22:30.407755 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f1a8451a-a78d-4de3-90e8-66c99e88157f tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:30.408955 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f1a8451a-a78d-4de3-90e8-66c99e88157f tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:30.410092 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f1a8451a-a78d-4de3-90e8-66c99e88157f tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:30.411175 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f1a8451a-a78d-4de3-90e8-66c99e88157f tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:30.411872 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f1a8451a-a78d-4de3-90e8-66c99e88157f tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:30.413133 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f1a8451a-a78d-4de3-90e8-66c99e88157f tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:30.437752 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-f1a8451a-a78d-4de3-90e8-66c99e88157f tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Getting quotas for project 48e708fb3bdd45bc976db7bd92af09c8. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:22:30.442905 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-f1a8451a-a78d-4de3-90e8-66c99e88157f tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Getting quotas for user d3f1177e2cbd4ba6b659f8a714be86ac and project 48e708fb3bdd45bc976db7bd92af09c8. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:22:30.459621 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f1a8451a-a78d-4de3-90e8-66c99e88157f tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Going to run 1 instances... {{(pid=121001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:22:30.463009 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f1a8451a-a78d-4de3-90e8-66c99e88157f tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: b2ef080f-30ca-4dc5-ba03-9cf1899346a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:22:30.668860 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-6f1a8055-a40f-4897-a6a3-95f51bdf993a tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:30.677916 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6f1a8055-a40f-4897-a6a3-95f51bdf993a tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/1a733f7d-4f8d-4190-9795-937510f1a516" status: 200 len: 1215 microversion: 2.1 time: 0.396788 Oct 27 03:22:30.686517 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 278/542] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:30 2022] GET /compute/v2.1/servers/1a733f7d-4f8d-4190-9795-937510f1a516 => generated 1215 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:22:30.699297 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-13748c31-f8dc-458c-a86e-e158944907a4 tempest-QuotaClassesAdminTestJSON-1521392372 tempest-QuotaClassesAdminTestJSON-1521392372-project-admin] Action: 'update', calling method: .version_select at 0x7f7ddae9ddc0>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:22:30.727388 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:30.773267 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f1a8451a-a78d-4de3-90e8-66c99e88157f tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.292505 Oct 27 03:22:30.783000 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 265/543] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:22:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1303 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 03:22:30.788162 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-47ca3ec4-c3e7-43fa-b9c7-ac2a742b4141 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:30.789068 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-47ca3ec4-c3e7-43fa-b9c7-ac2a742b4141 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] [instance: 2d4fe59a-b31c-4fc0-8994-eb21e313d18a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:30.799682 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-47ca3ec4-c3e7-43fa-b9c7-ac2a742b4141 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:30.800530 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-47ca3ec4-c3e7-43fa-b9c7-ac2a742b4141 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:30.801560 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-47ca3ec4-c3e7-43fa-b9c7-ac2a742b4141 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:30.802798 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-47ca3ec4-c3e7-43fa-b9c7-ac2a742b4141 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:30.803504 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-47ca3ec4-c3e7-43fa-b9c7-ac2a742b4141 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:30.804145 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-47ca3ec4-c3e7-43fa-b9c7-ac2a742b4141 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:30.894716 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-47ca3ec4-c3e7-43fa-b9c7-ac2a742b4141 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e23378ed283426cbff623265d9bbc96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f033d34ad44397bfda5cba4c041071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:30.906571 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-47ca3ec4-c3e7-43fa-b9c7-ac2a742b4141 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] 10.222.0.20 "GET /compute/v2.1/servers/2d4fe59a-b31c-4fc0-8994-eb21e313d18a" status: 200 len: 1265 microversion: 2.1 time: 0.121602 Oct 27 03:22:30.911889 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 266/544] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:30 2022] GET /compute/v2.1/servers/2d4fe59a-b31c-4fc0-8994-eb21e313d18a => generated 1265 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:22:30.929506 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-48ab6679-0f3d-4582-962e-37386959db8d tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:30.930487 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-48ab6679-0f3d-4582-962e-37386959db8d tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: b2ef080f-30ca-4dc5-ba03-9cf1899346a4] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:31.110627 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-48ab6679-0f3d-4582-962e-37386959db8d tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:31.130742 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-48ab6679-0f3d-4582-962e-37386959db8d tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4" status: 200 len: 1213 microversion: 2.1 time: 0.218895 Oct 27 03:22:31.152945 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 267/545] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:30 2022] GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4 => generated 1213 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:22:31.167871 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-aea6af3c-b8ea-4838-943a-dbc366e425d2 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:31.169137 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-aea6af3c-b8ea-4838-943a-dbc366e425d2 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:31.185322 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aea6af3c-b8ea-4838-943a-dbc366e425d2 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:31.191673 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aea6af3c-b8ea-4838-943a-dbc366e425d2 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:31.194421 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aea6af3c-b8ea-4838-943a-dbc366e425d2 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:31.195159 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aea6af3c-b8ea-4838-943a-dbc366e425d2 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:31.196779 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aea6af3c-b8ea-4838-943a-dbc366e425d2 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:31.199994 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aea6af3c-b8ea-4838-943a-dbc366e425d2 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:31.518442 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-aea6af3c-b8ea-4838-943a-dbc366e425d2 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:31.537978 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-aea6af3c-b8ea-4838-943a-dbc366e425d2 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:31.539551 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-aea6af3c-b8ea-4838-943a-dbc366e425d2 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:31.557702 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-aea6af3c-b8ea-4838-943a-dbc366e425d2 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1555 microversion: 2.91 time: 0.401202 Oct 27 03:22:31.559166 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 268/546] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:22:31 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1555 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:22:31.702432 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-50868897-69a2-4540-9f22-2dcd29a6a8c4 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:31.703419 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-50868897-69a2-4540-9f22-2dcd29a6a8c4 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: 1a733f7d-4f8d-4190-9795-937510f1a516] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:31.721869 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-50868897-69a2-4540-9f22-2dcd29a6a8c4 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:31.727525 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-50868897-69a2-4540-9f22-2dcd29a6a8c4 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:31.727993 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-50868897-69a2-4540-9f22-2dcd29a6a8c4 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:31.743438 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-50868897-69a2-4540-9f22-2dcd29a6a8c4 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:31.743438 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-50868897-69a2-4540-9f22-2dcd29a6a8c4 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:31.743438 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-50868897-69a2-4540-9f22-2dcd29a6a8c4 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:32.291518 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-13748c31-f8dc-458c-a86e-e158944907a4 tempest-QuotaClassesAdminTestJSON-1521392372 tempest-QuotaClassesAdminTestJSON-1521392372-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 1.603107 Oct 27 03:22:32.296306 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 279/547] 10.222.0.20 () {60 vars in 1206 bytes} [Thu Oct 27 03:22:30 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 1609 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:22:32.307331 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-46c13758-121d-4361-acc4-a3951ffa05ad tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:32.309023 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-46c13758-121d-4361-acc4-a3951ffa05ad tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] [instance: 2d4fe59a-b31c-4fc0-8994-eb21e313d18a] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:32.329425 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-46c13758-121d-4361-acc4-a3951ffa05ad tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:32.337382 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-46c13758-121d-4361-acc4-a3951ffa05ad tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:32.337382 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-46c13758-121d-4361-acc4-a3951ffa05ad tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:32.337382 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-46c13758-121d-4361-acc4-a3951ffa05ad tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:32.337998 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-46c13758-121d-4361-acc4-a3951ffa05ad tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:32.337998 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-46c13758-121d-4361-acc4-a3951ffa05ad tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:32.344515 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-50868897-69a2-4540-9f22-2dcd29a6a8c4 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:32.360469 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-50868897-69a2-4540-9f22-2dcd29a6a8c4 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/1a733f7d-4f8d-4190-9795-937510f1a516" status: 200 len: 1271 microversion: 2.1 time: 0.663110 Oct 27 03:22:32.362440 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 269/548] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:31 2022] GET /compute/v2.1/servers/1a733f7d-4f8d-4190-9795-937510f1a516 => generated 1271 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:22:32.368015 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e6cea371-d76f-41fc-8ac1-4850fdb0bb60 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:32.368985 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e6cea371-d76f-41fc-8ac1-4850fdb0bb60 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: b2ef080f-30ca-4dc5-ba03-9cf1899346a4] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:32.376959 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e6cea371-d76f-41fc-8ac1-4850fdb0bb60 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:32.377865 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e6cea371-d76f-41fc-8ac1-4850fdb0bb60 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:32.378947 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e6cea371-d76f-41fc-8ac1-4850fdb0bb60 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:32.380168 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e6cea371-d76f-41fc-8ac1-4850fdb0bb60 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:32.381027 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e6cea371-d76f-41fc-8ac1-4850fdb0bb60 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:32.382052 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e6cea371-d76f-41fc-8ac1-4850fdb0bb60 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:32.534956 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e6cea371-d76f-41fc-8ac1-4850fdb0bb60 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:32.543097 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e6cea371-d76f-41fc-8ac1-4850fdb0bb60 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4" status: 200 len: 1217 microversion: 2.1 time: 0.179376 Oct 27 03:22:32.547996 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-46c13758-121d-4361-acc4-a3951ffa05ad tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e23378ed283426cbff623265d9bbc96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f033d34ad44397bfda5cba4c041071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:32.548171 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 270/549] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:32 2022] GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4 => generated 1217 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:22:32.560056 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-46c13758-121d-4361-acc4-a3951ffa05ad tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] 10.222.0.20 "GET /compute/v2.1/servers/2d4fe59a-b31c-4fc0-8994-eb21e313d18a" status: 200 len: 1257 microversion: 2.1 time: 0.262381 Oct 27 03:22:32.561989 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 280/550] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:32 2022] GET /compute/v2.1/servers/2d4fe59a-b31c-4fc0-8994-eb21e313d18a => generated 1257 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:22:32.565147 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-604d1b32-27f7-482e-a48d-0a1c96c97308 tempest-QuotaClassesAdminTestJSON-1521392372 tempest-QuotaClassesAdminTestJSON-1521392372-project-admin] Calling method '.version_select at 0x7f7ddaf838b0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:32.591212 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1b733950-523f-48a4-a305-7fc1708f2bef tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:32.592556 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1b733950-523f-48a4-a305-7fc1708f2bef tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:32.603847 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1b733950-523f-48a4-a305-7fc1708f2bef tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:32.608065 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1b733950-523f-48a4-a305-7fc1708f2bef tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:32.609225 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1b733950-523f-48a4-a305-7fc1708f2bef tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:32.610369 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1b733950-523f-48a4-a305-7fc1708f2bef tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:32.611258 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1b733950-523f-48a4-a305-7fc1708f2bef tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:32.611847 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1b733950-523f-48a4-a305-7fc1708f2bef tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:32.612677 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-604d1b32-27f7-482e-a48d-0a1c96c97308 tempest-QuotaClassesAdminTestJSON-1521392372 tempest-QuotaClassesAdminTestJSON-1521392372-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.063393 Oct 27 03:22:32.638760 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 271/551] 10.222.0.20 () {58 vars in 1185 bytes} [Thu Oct 27 03:22:32 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:22:32.681433 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-132423e0-2a55-4701-8508-718c3e3525ed tempest-QuotaClassesAdminTestJSON-1521392372 tempest-QuotaClassesAdminTestJSON-1521392372-project-admin] Action: 'update', calling method: .version_select at 0x7f7ddae2d430>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:22:32.988035 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1b733950-523f-48a4-a305-7fc1708f2bef tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:32.999330 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1b733950-523f-48a4-a305-7fc1708f2bef tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:33.001507 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1b733950-523f-48a4-a305-7fc1708f2bef tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:33.040503 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1b733950-523f-48a4-a305-7fc1708f2bef tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1555 microversion: 2.91 time: 0.453680 Oct 27 03:22:33.056284 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 281/552] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:22:32 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1555 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:22:33.387483 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c4371bcc-56a1-42b3-b18b-36e689052096 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:33.389737 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c4371bcc-56a1-42b3-b18b-36e689052096 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: 1a733f7d-4f8d-4190-9795-937510f1a516] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:33.405930 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c4371bcc-56a1-42b3-b18b-36e689052096 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:33.406667 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c4371bcc-56a1-42b3-b18b-36e689052096 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:33.407709 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c4371bcc-56a1-42b3-b18b-36e689052096 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:33.415050 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c4371bcc-56a1-42b3-b18b-36e689052096 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:33.419240 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c4371bcc-56a1-42b3-b18b-36e689052096 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:33.420706 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c4371bcc-56a1-42b3-b18b-36e689052096 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:33.480792 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:33.780137 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c4371bcc-56a1-42b3-b18b-36e689052096 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:33.791590 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c4371bcc-56a1-42b3-b18b-36e689052096 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/1a733f7d-4f8d-4190-9795-937510f1a516" status: 200 len: 1289 microversion: 2.1 time: 0.408671 Oct 27 03:22:33.793701 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 282/553] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:33 2022] GET /compute/v2.1/servers/1a733f7d-4f8d-4190-9795-937510f1a516 => generated 1289 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:22:33.811574 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-144a699c-6d74-4a24-9771-8afe3cb944bb tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:33.812206 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-144a699c-6d74-4a24-9771-8afe3cb944bb tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: b2ef080f-30ca-4dc5-ba03-9cf1899346a4] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:33.819223 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-144a699c-6d74-4a24-9771-8afe3cb944bb tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:33.819987 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-144a699c-6d74-4a24-9771-8afe3cb944bb tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:33.821088 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-144a699c-6d74-4a24-9771-8afe3cb944bb tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:33.822743 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-144a699c-6d74-4a24-9771-8afe3cb944bb tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:33.823368 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-144a699c-6d74-4a24-9771-8afe3cb944bb tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:33.823948 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-144a699c-6d74-4a24-9771-8afe3cb944bb tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:33.916195 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-144a699c-6d74-4a24-9771-8afe3cb944bb tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:33.926453 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-144a699c-6d74-4a24-9771-8afe3cb944bb tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4" status: 200 len: 1265 microversion: 2.1 time: 0.129679 Oct 27 03:22:33.927173 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 283/554] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:33 2022] GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4 => generated 1265 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:22:33.940647 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-cd390826-eabb-483d-acd2-9464a42b5a1d tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:33.941517 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-cd390826-eabb-483d-acd2-9464a42b5a1d tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] [instance: 2d4fe59a-b31c-4fc0-8994-eb21e313d18a] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:33.948065 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cd390826-eabb-483d-acd2-9464a42b5a1d tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:33.948572 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cd390826-eabb-483d-acd2-9464a42b5a1d tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:33.949021 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cd390826-eabb-483d-acd2-9464a42b5a1d tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:33.949749 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cd390826-eabb-483d-acd2-9464a42b5a1d tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:33.950253 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cd390826-eabb-483d-acd2-9464a42b5a1d tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:33.950692 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cd390826-eabb-483d-acd2-9464a42b5a1d tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:34.028218 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-cd390826-eabb-483d-acd2-9464a42b5a1d tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e23378ed283426cbff623265d9bbc96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f033d34ad44397bfda5cba4c041071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:34.037608 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-cd390826-eabb-483d-acd2-9464a42b5a1d tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] 10.222.0.20 "GET /compute/v2.1/servers/2d4fe59a-b31c-4fc0-8994-eb21e313d18a" status: 200 len: 1313 microversion: 2.1 time: 0.100787 Oct 27 03:22:34.038291 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 284/555] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:33 2022] GET /compute/v2.1/servers/2d4fe59a-b31c-4fc0-8994-eb21e313d18a => generated 1313 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:22:34.082707 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d313ee69-c351-441d-b29d-51481fa5515f tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:34.083366 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d313ee69-c351-441d-b29d-51481fa5515f tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:34.089981 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d313ee69-c351-441d-b29d-51481fa5515f tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:34.090908 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d313ee69-c351-441d-b29d-51481fa5515f tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:34.092279 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d313ee69-c351-441d-b29d-51481fa5515f tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:34.093183 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d313ee69-c351-441d-b29d-51481fa5515f tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:34.093804 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d313ee69-c351-441d-b29d-51481fa5515f tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:34.094422 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d313ee69-c351-441d-b29d-51481fa5515f tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:34.174876 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d313ee69-c351-441d-b29d-51481fa5515f tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:34.188520 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d313ee69-c351-441d-b29d-51481fa5515f tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:34.190307 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d313ee69-c351-441d-b29d-51481fa5515f tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:34.198896 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d313ee69-c351-441d-b29d-51481fa5515f tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1555 microversion: 2.91 time: 0.129779 Oct 27 03:22:34.199485 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 285/556] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:22:34 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1555 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:22:34.823372 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7d11cb39-cb94-4663-854f-8fd1c64de345 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:34.825427 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7d11cb39-cb94-4663-854f-8fd1c64de345 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: 1a733f7d-4f8d-4190-9795-937510f1a516] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:34.868551 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7d11cb39-cb94-4663-854f-8fd1c64de345 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:34.869521 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7d11cb39-cb94-4663-854f-8fd1c64de345 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:34.872063 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7d11cb39-cb94-4663-854f-8fd1c64de345 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:34.875045 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7d11cb39-cb94-4663-854f-8fd1c64de345 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:34.881132 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7d11cb39-cb94-4663-854f-8fd1c64de345 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:34.881963 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7d11cb39-cb94-4663-854f-8fd1c64de345 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:35.251802 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-132423e0-2a55-4701-8508-718c3e3525ed tempest-QuotaClassesAdminTestJSON-1521392372 tempest-QuotaClassesAdminTestJSON-1521392372-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 2.611831 Oct 27 03:22:35.252646 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 272/557] 10.222.0.20 () {60 vars in 1206 bytes} [Thu Oct 27 03:22:32 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 2613 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:22:35.273611 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b6b4bf0f-303e-4f24-95f7-fb5920c3002c tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:35.290293 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b6b4bf0f-303e-4f24-95f7-fb5920c3002c tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: b2ef080f-30ca-4dc5-ba03-9cf1899346a4] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:35.326987 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b6b4bf0f-303e-4f24-95f7-fb5920c3002c tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:35.329667 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b6b4bf0f-303e-4f24-95f7-fb5920c3002c tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:35.330184 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b6b4bf0f-303e-4f24-95f7-fb5920c3002c tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:35.332581 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b6b4bf0f-303e-4f24-95f7-fb5920c3002c tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:35.333087 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b6b4bf0f-303e-4f24-95f7-fb5920c3002c tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:35.334969 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b6b4bf0f-303e-4f24-95f7-fb5920c3002c tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:35.851483 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7d11cb39-cb94-4663-854f-8fd1c64de345 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:35.863519 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7d11cb39-cb94-4663-854f-8fd1c64de345 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/1a733f7d-4f8d-4190-9795-937510f1a516" status: 200 len: 1277 microversion: 2.1 time: 1.047546 Oct 27 03:22:35.865505 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 286/558] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:34 2022] GET /compute/v2.1/servers/1a733f7d-4f8d-4190-9795-937510f1a516 => generated 1277 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:22:35.883770 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-40ef7c86-4fac-4333-8330-8e52722f045b tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:35.887015 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-40ef7c86-4fac-4333-8330-8e52722f045b tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] [instance: 2d4fe59a-b31c-4fc0-8994-eb21e313d18a] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:35.897272 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b6b4bf0f-303e-4f24-95f7-fb5920c3002c tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:35.897432 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-40ef7c86-4fac-4333-8330-8e52722f045b tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:35.897432 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-40ef7c86-4fac-4333-8330-8e52722f045b tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:35.901365 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-40ef7c86-4fac-4333-8330-8e52722f045b tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:35.902439 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-40ef7c86-4fac-4333-8330-8e52722f045b tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:35.905166 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-40ef7c86-4fac-4333-8330-8e52722f045b tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:35.906115 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-40ef7c86-4fac-4333-8330-8e52722f045b tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:35.913019 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b6b4bf0f-303e-4f24-95f7-fb5920c3002c tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4" status: 200 len: 1283 microversion: 2.1 time: 0.659432 Oct 27 03:22:35.915835 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 273/559] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:35 2022] GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4 => generated 1283 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:22:35.929774 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c68f574c-a27f-4dd3-b51e-773e642e3db5 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:35.930436 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c68f574c-a27f-4dd3-b51e-773e642e3db5 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:35.955554 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c68f574c-a27f-4dd3-b51e-773e642e3db5 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:35.958919 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c68f574c-a27f-4dd3-b51e-773e642e3db5 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:35.960272 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c68f574c-a27f-4dd3-b51e-773e642e3db5 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:35.961485 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c68f574c-a27f-4dd3-b51e-773e642e3db5 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:35.964035 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c68f574c-a27f-4dd3-b51e-773e642e3db5 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:35.965373 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c68f574c-a27f-4dd3-b51e-773e642e3db5 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:36.108925 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c68f574c-a27f-4dd3-b51e-773e642e3db5 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:36.128859 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-40ef7c86-4fac-4333-8330-8e52722f045b tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e23378ed283426cbff623265d9bbc96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f033d34ad44397bfda5cba4c041071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:36.152118 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c68f574c-a27f-4dd3-b51e-773e642e3db5 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:36.155900 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c68f574c-a27f-4dd3-b51e-773e642e3db5 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:36.164346 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-40ef7c86-4fac-4333-8330-8e52722f045b tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] 10.222.0.20 "GET /compute/v2.1/servers/2d4fe59a-b31c-4fc0-8994-eb21e313d18a" status: 200 len: 1319 microversion: 2.1 time: 0.292744 Oct 27 03:22:36.166504 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 287/560] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:35 2022] GET /compute/v2.1/servers/2d4fe59a-b31c-4fc0-8994-eb21e313d18a => generated 1319 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:22:36.193693 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c68f574c-a27f-4dd3-b51e-773e642e3db5 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1555 microversion: 2.91 time: 0.273154 Oct 27 03:22:36.207679 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 274/561] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:22:35 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1555 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:22:36.870967 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-33a9f6fb-0106-476a-beba-d7b77d388671 tempest-HypervisorAdminV253TestBase-1984523078 tempest-HypervisorAdminV253TestBase-1984523078-project-admin] Calling method '.version_select at 0x7f7ddb002040>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:36.875693 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-33a9f6fb-0106-476a-beba-d7b77d388671 tempest-HypervisorAdminV253TestBase-1984523078 tempest-HypervisorAdminV253TestBase-1984523078-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:36.880413 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-33a9f6fb-0106-476a-beba-d7b77d388671 tempest-HypervisorAdminV253TestBase-1984523078 tempest-HypervisorAdminV253TestBase-1984523078-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:36.880867 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-33a9f6fb-0106-476a-beba-d7b77d388671 tempest-HypervisorAdminV253TestBase-1984523078 tempest-HypervisorAdminV253TestBase-1984523078-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:36.889154 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-368270c6-ee2f-43dd-babb-dc33afb0f02d tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:36.889909 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-368270c6-ee2f-43dd-babb-dc33afb0f02d tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: 1a733f7d-4f8d-4190-9795-937510f1a516] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:36.902563 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-368270c6-ee2f-43dd-babb-dc33afb0f02d tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:36.906306 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-368270c6-ee2f-43dd-babb-dc33afb0f02d tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:36.907004 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-368270c6-ee2f-43dd-babb-dc33afb0f02d tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:36.909516 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-368270c6-ee2f-43dd-babb-dc33afb0f02d tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:36.911202 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-368270c6-ee2f-43dd-babb-dc33afb0f02d tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:36.913001 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-368270c6-ee2f-43dd-babb-dc33afb0f02d tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:36.945007 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-33a9f6fb-0106-476a-beba-d7b77d388671 tempest-HypervisorAdminV253TestBase-1984523078 tempest-HypervisorAdminV253TestBase-1984523078-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:36.945516 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-33a9f6fb-0106-476a-beba-d7b77d388671 tempest-HypervisorAdminV253TestBase-1984523078 tempest-HypervisorAdminV253TestBase-1984523078-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:36.945975 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-33a9f6fb-0106-476a-beba-d7b77d388671 tempest-HypervisorAdminV253TestBase-1984523078 tempest-HypervisorAdminV253TestBase-1984523078-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:37.012996 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-33a9f6fb-0106-476a-beba-d7b77d388671 tempest-HypervisorAdminV253TestBase-1984523078 tempest-HypervisorAdminV253TestBase-1984523078-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:37.013780 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-33a9f6fb-0106-476a-beba-d7b77d388671 tempest-HypervisorAdminV253TestBase-1984523078 tempest-HypervisorAdminV253TestBase-1984523078-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:37.020797 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-33a9f6fb-0106-476a-beba-d7b77d388671 tempest-HypervisorAdminV253TestBase-1984523078 tempest-HypervisorAdminV253TestBase-1984523078-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:37.051489 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-33a9f6fb-0106-476a-beba-d7b77d388671 tempest-HypervisorAdminV253TestBase-1984523078 tempest-HypervisorAdminV253TestBase-1984523078-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:37.058976 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-33a9f6fb-0106-476a-beba-d7b77d388671 tempest-HypervisorAdminV253TestBase-1984523078 tempest-HypervisorAdminV253TestBase-1984523078-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:37.059740 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-33a9f6fb-0106-476a-beba-d7b77d388671 tempest-HypervisorAdminV253TestBase-1984523078 tempest-HypervisorAdminV253TestBase-1984523078-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:37.148970 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-33a9f6fb-0106-476a-beba-d7b77d388671 tempest-HypervisorAdminV253TestBase-1984523078 tempest-HypervisorAdminV253TestBase-1984523078-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:37.149751 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-33a9f6fb-0106-476a-beba-d7b77d388671 tempest-HypervisorAdminV253TestBase-1984523078 tempest-HypervisorAdminV253TestBase-1984523078-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:37.150482 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-33a9f6fb-0106-476a-beba-d7b77d388671 tempest-HypervisorAdminV253TestBase-1984523078 tempest-HypervisorAdminV253TestBase-1984523078-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:37.158519 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-33a9f6fb-0106-476a-beba-d7b77d388671 tempest-HypervisorAdminV253TestBase-1984523078 tempest-HypervisorAdminV253TestBase-1984523078-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 2152 microversion: 2.53 time: 0.990644 Oct 27 03:22:37.163099 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 288/562] 10.222.0.20 () {60 vars in 1243 bytes} [Thu Oct 27 03:22:36 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 2152 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:22:37.165177 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7ebb0031-64dc-4537-95c8-a4c28b990b09 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:37.166069 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7ebb0031-64dc-4537-95c8-a4c28b990b09 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: b2ef080f-30ca-4dc5-ba03-9cf1899346a4] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:37.173353 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7ebb0031-64dc-4537-95c8-a4c28b990b09 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:37.174285 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7ebb0031-64dc-4537-95c8-a4c28b990b09 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:37.175065 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7ebb0031-64dc-4537-95c8-a4c28b990b09 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:37.176032 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7ebb0031-64dc-4537-95c8-a4c28b990b09 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:37.176709 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7ebb0031-64dc-4537-95c8-a4c28b990b09 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:37.177356 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7ebb0031-64dc-4537-95c8-a4c28b990b09 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:37.291519 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7ebb0031-64dc-4537-95c8-a4c28b990b09 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:37.304054 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7ebb0031-64dc-4537-95c8-a4c28b990b09 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4" status: 200 len: 1271 microversion: 2.1 time: 0.142721 Oct 27 03:22:37.304150 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 289/563] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:37 2022] GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4 => generated 1271 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:22:37.318082 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c22198f6-d29d-48bb-80cc-1d071716e8ec tempest-HypervisorAdminV253TestBase-1984523078 tempest-HypervisorAdminV253TestBase-1984523078-project-admin] Calling method '.version_select at 0x7f7ddaf0ad30>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:37.327055 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c22198f6-d29d-48bb-80cc-1d071716e8ec tempest-HypervisorAdminV253TestBase-1984523078 tempest-HypervisorAdminV253TestBase-1984523078-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:37.327055 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c22198f6-d29d-48bb-80cc-1d071716e8ec tempest-HypervisorAdminV253TestBase-1984523078 tempest-HypervisorAdminV253TestBase-1984523078-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:37.327055 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c22198f6-d29d-48bb-80cc-1d071716e8ec tempest-HypervisorAdminV253TestBase-1984523078 tempest-HypervisorAdminV253TestBase-1984523078-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:37.339332 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c22198f6-d29d-48bb-80cc-1d071716e8ec tempest-HypervisorAdminV253TestBase-1984523078 tempest-HypervisorAdminV253TestBase-1984523078-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:37.340048 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c22198f6-d29d-48bb-80cc-1d071716e8ec tempest-HypervisorAdminV253TestBase-1984523078 tempest-HypervisorAdminV253TestBase-1984523078-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:37.341131 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c22198f6-d29d-48bb-80cc-1d071716e8ec tempest-HypervisorAdminV253TestBase-1984523078 tempest-HypervisorAdminV253TestBase-1984523078-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:37.369841 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c22198f6-d29d-48bb-80cc-1d071716e8ec tempest-HypervisorAdminV253TestBase-1984523078 tempest-HypervisorAdminV253TestBase-1984523078-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:37.370406 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c22198f6-d29d-48bb-80cc-1d071716e8ec tempest-HypervisorAdminV253TestBase-1984523078 tempest-HypervisorAdminV253TestBase-1984523078-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:37.370859 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c22198f6-d29d-48bb-80cc-1d071716e8ec tempest-HypervisorAdminV253TestBase-1984523078 tempest-HypervisorAdminV253TestBase-1984523078-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:37.384708 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c22198f6-d29d-48bb-80cc-1d071716e8ec tempest-HypervisorAdminV253TestBase-1984523078 tempest-HypervisorAdminV253TestBase-1984523078-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:37.384708 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c22198f6-d29d-48bb-80cc-1d071716e8ec tempest-HypervisorAdminV253TestBase-1984523078 tempest-HypervisorAdminV253TestBase-1984523078-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:37.384708 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c22198f6-d29d-48bb-80cc-1d071716e8ec tempest-HypervisorAdminV253TestBase-1984523078 tempest-HypervisorAdminV253TestBase-1984523078-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:37.414362 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c22198f6-d29d-48bb-80cc-1d071716e8ec tempest-HypervisorAdminV253TestBase-1984523078 tempest-HypervisorAdminV253TestBase-1984523078-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:37.415049 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c22198f6-d29d-48bb-80cc-1d071716e8ec tempest-HypervisorAdminV253TestBase-1984523078 tempest-HypervisorAdminV253TestBase-1984523078-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:37.415663 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c22198f6-d29d-48bb-80cc-1d071716e8ec tempest-HypervisorAdminV253TestBase-1984523078 tempest-HypervisorAdminV253TestBase-1984523078-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:37.422732 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c22198f6-d29d-48bb-80cc-1d071716e8ec tempest-HypervisorAdminV253TestBase-1984523078 tempest-HypervisorAdminV253TestBase-1984523078-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 844 microversion: 2.53 time: 0.113419 Oct 27 03:22:37.423843 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 290/564] 10.222.0.20 () {60 vars in 1222 bytes} [Thu Oct 27 03:22:37 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 844 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 03:22:37.436283 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-79e2e061-282c-4d4a-bfe0-1400801b05c8 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:37.436939 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-79e2e061-282c-4d4a-bfe0-1400801b05c8 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] [instance: 2d4fe59a-b31c-4fc0-8994-eb21e313d18a] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:37.454772 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-79e2e061-282c-4d4a-bfe0-1400801b05c8 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:37.455997 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-79e2e061-282c-4d4a-bfe0-1400801b05c8 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:37.456458 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-79e2e061-282c-4d4a-bfe0-1400801b05c8 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:37.457195 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-79e2e061-282c-4d4a-bfe0-1400801b05c8 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:37.457672 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-79e2e061-282c-4d4a-bfe0-1400801b05c8 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:37.458119 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-79e2e061-282c-4d4a-bfe0-1400801b05c8 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:37.649416 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-368270c6-ee2f-43dd-babb-dc33afb0f02d tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:37.658513 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-368270c6-ee2f-43dd-babb-dc33afb0f02d tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/1a733f7d-4f8d-4190-9795-937510f1a516" status: 200 len: 1319 microversion: 2.1 time: 0.774524 Oct 27 03:22:37.659182 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 275/565] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:36 2022] GET /compute/v2.1/servers/1a733f7d-4f8d-4190-9795-937510f1a516 => generated 1319 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:22:37.664472 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1d24e41b-f114-44a5-8a3a-b30b1a48a98f tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:37.665158 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1d24e41b-f114-44a5-8a3a-b30b1a48a98f tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:37.675608 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1d24e41b-f114-44a5-8a3a-b30b1a48a98f tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:37.677031 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1d24e41b-f114-44a5-8a3a-b30b1a48a98f tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:37.677257 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1d24e41b-f114-44a5-8a3a-b30b1a48a98f tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:37.678393 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1d24e41b-f114-44a5-8a3a-b30b1a48a98f tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:37.679044 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1d24e41b-f114-44a5-8a3a-b30b1a48a98f tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:37.680291 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1d24e41b-f114-44a5-8a3a-b30b1a48a98f tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:37.897102 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-79e2e061-282c-4d4a-bfe0-1400801b05c8 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e23378ed283426cbff623265d9bbc96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f033d34ad44397bfda5cba4c041071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:37.900982 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1d24e41b-f114-44a5-8a3a-b30b1a48a98f tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:37.915253 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-79e2e061-282c-4d4a-bfe0-1400801b05c8 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] 10.222.0.20 "GET /compute/v2.1/servers/2d4fe59a-b31c-4fc0-8994-eb21e313d18a" status: 200 len: 1387 microversion: 2.1 time: 0.487883 Oct 27 03:22:37.915422 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1d24e41b-f114-44a5-8a3a-b30b1a48a98f tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:37.921460 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1d24e41b-f114-44a5-8a3a-b30b1a48a98f tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:37.935830 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1d24e41b-f114-44a5-8a3a-b30b1a48a98f tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1537 microversion: 2.91 time: 0.274884 Oct 27 03:22:37.936304 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 291/566] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:37 2022] GET /compute/v2.1/servers/2d4fe59a-b31c-4fc0-8994-eb21e313d18a => generated 1387 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:22:37.938373 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 276/567] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:22:37 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1537 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:22:37.945212 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a0c1ac6f-ff4d-47ba-b430-b09f9c3eb0fd tempest-HypervisorAdminV253TestBase-1984523078 tempest-HypervisorAdminV253TestBase-1984523078-project-admin] Calling method '.version_select at 0x7f7ddb0024c0>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:37.950164 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a0c1ac6f-ff4d-47ba-b430-b09f9c3eb0fd tempest-HypervisorAdminV253TestBase-1984523078 tempest-HypervisorAdminV253TestBase-1984523078-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:37.950848 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a0c1ac6f-ff4d-47ba-b430-b09f9c3eb0fd tempest-HypervisorAdminV253TestBase-1984523078 tempest-HypervisorAdminV253TestBase-1984523078-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:37.951510 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a0c1ac6f-ff4d-47ba-b430-b09f9c3eb0fd tempest-HypervisorAdminV253TestBase-1984523078 tempest-HypervisorAdminV253TestBase-1984523078-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:37.964893 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:37.980219 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a0c1ac6f-ff4d-47ba-b430-b09f9c3eb0fd tempest-HypervisorAdminV253TestBase-1984523078 tempest-HypervisorAdminV253TestBase-1984523078-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:37.981018 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a0c1ac6f-ff4d-47ba-b430-b09f9c3eb0fd tempest-HypervisorAdminV253TestBase-1984523078 tempest-HypervisorAdminV253TestBase-1984523078-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:37.981911 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a0c1ac6f-ff4d-47ba-b430-b09f9c3eb0fd tempest-HypervisorAdminV253TestBase-1984523078 tempest-HypervisorAdminV253TestBase-1984523078-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:37.990523 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a0c1ac6f-ff4d-47ba-b430-b09f9c3eb0fd tempest-HypervisorAdminV253TestBase-1984523078 tempest-HypervisorAdminV253TestBase-1984523078-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/936bca09-a1b9-4e2d-be60-afa2a799790d" status: 200 len: 792 microversion: 2.53 time: 0.052793 Oct 27 03:22:38.005348 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 292/568] 10.222.0.20 () {60 vars in 1298 bytes} [Thu Oct 27 03:22:37 2022] GET /compute/v2.1/os-hypervisors/936bca09-a1b9-4e2d-be60-afa2a799790d => generated 792 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 03:22:38.272908 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-affa2a07-35d0-462e-ba55-240b70c5f31d tempest-SecurityGroupsTestAdminJSON-364027375 tempest-SecurityGroupsTestAdminJSON-364027375-project] Action: 'create', calling method: .version_select at 0x7f7ddadba160>, body: {"security_group": {"name": "tempest-securitygroup-121895934", "description": "tempest-description-455295938"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:22:38.365141 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b4a681ca-2949-45bb-94fe-e267b2c00309 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-589787813", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": [{"uuid": "bccdb388-9120-416e-ba10-d9831d24a110"}]}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:22:38.450485 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-b4a681ca-2949-45bb-94fe-e267b2c00309 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] validate_networks() for [('bccdb388-9120-416e-ba10-d9831d24a110', None, None, None, None, None)] {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:22:39.254890 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-affa2a07-35d0-462e-ba55-240b70c5f31d tempest-SecurityGroupsTestAdminJSON-364027375 tempest-SecurityGroupsTestAdminJSON-364027375-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 1.314092 Oct 27 03:22:39.262298 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 277/569] 10.222.0.20 () {60 vars in 1180 bytes} [Thu Oct 27 03:22:37 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:22:39.267668 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c78dcbf0-550e-4510-a567-79ef1cc5035e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:39.268478 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c78dcbf0-550e-4510-a567-79ef1cc5035e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: b2ef080f-30ca-4dc5-ba03-9cf1899346a4] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:39.271715 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=6,nova_api:UPDATE=12 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:39.275344 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c78dcbf0-550e-4510-a567-79ef1cc5035e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:39.275843 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c78dcbf0-550e-4510-a567-79ef1cc5035e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:39.276290 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c78dcbf0-550e-4510-a567-79ef1cc5035e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:39.277172 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c78dcbf0-550e-4510-a567-79ef1cc5035e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:39.277798 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c78dcbf0-550e-4510-a567-79ef1cc5035e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:39.278409 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c78dcbf0-550e-4510-a567-79ef1cc5035e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:39.477918 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c78dcbf0-550e-4510-a567-79ef1cc5035e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:39.489258 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c78dcbf0-550e-4510-a567-79ef1cc5035e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4" status: 200 len: 1313 microversion: 2.1 time: 0.225619 Oct 27 03:22:39.490504 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 278/570] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:39 2022] GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4 => generated 1313 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:22:39.495792 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-19a64524-32ba-438a-8955-db4ece2358b6 req-78156cbc-38dc-4a3d-9ac2-c9921030adc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37b3577c-f561-4d8e-957d-cdf1819ef5c1", "tag": "fea19390-7267-4a02-8335-c138eabc8d80"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:22:39.506430 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-19a64524-32ba-438a-8955-db4ece2358b6 req-78156cbc-38dc-4a3d-9ac2-c9921030adc7 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:39.511974 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-19a64524-32ba-438a-8955-db4ece2358b6 req-78156cbc-38dc-4a3d-9ac2-c9921030adc7 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:39.511974 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-19a64524-32ba-438a-8955-db4ece2358b6 req-78156cbc-38dc-4a3d-9ac2-c9921030adc7 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:39.522142 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-19a64524-32ba-438a-8955-db4ece2358b6 req-78156cbc-38dc-4a3d-9ac2-c9921030adc7 service nova] Creating event network-changed:fea19390-7267-4a02-8335-c138eabc8d80 for instance 37b3577c-f561-4d8e-957d-cdf1819ef5c1 on n-h1-862769-1 Oct 27 03:22:39.528105 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-19a64524-32ba-438a-8955-db4ece2358b6 req-78156cbc-38dc-4a3d-9ac2-c9921030adc7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036030 Oct 27 03:22:39.530363 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 279/571] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:22:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:22:39.537145 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ad2c202b-8f25-485a-8588-56262354a7e0 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:39.540347 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ad2c202b-8f25-485a-8588-56262354a7e0 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: 1a733f7d-4f8d-4190-9795-937510f1a516] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:39.547048 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ad2c202b-8f25-485a-8588-56262354a7e0 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:39.547980 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ad2c202b-8f25-485a-8588-56262354a7e0 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:39.548834 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ad2c202b-8f25-485a-8588-56262354a7e0 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:39.550280 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ad2c202b-8f25-485a-8588-56262354a7e0 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:39.551666 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ad2c202b-8f25-485a-8588-56262354a7e0 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:39.552458 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ad2c202b-8f25-485a-8588-56262354a7e0 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:39.575118 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=100 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:40.038676 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-b4a681ca-2949-45bb-94fe-e267b2c00309 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:22:40.041119 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-b4a681ca-2949-45bb-94fe-e267b2c00309 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:22:40.041119 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-b4a681ca-2949-45bb-94fe-e267b2c00309 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:22:40.041119 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-b4a681ca-2949-45bb-94fe-e267b2c00309 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:22:40.041813 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-b4a681ca-2949-45bb-94fe-e267b2c00309 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:22:40.052361 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b4a681ca-2949-45bb-94fe-e267b2c00309 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:40.052976 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b4a681ca-2949-45bb-94fe-e267b2c00309 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:40.053565 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b4a681ca-2949-45bb-94fe-e267b2c00309 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:40.054606 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b4a681ca-2949-45bb-94fe-e267b2c00309 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:40.055140 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b4a681ca-2949-45bb-94fe-e267b2c00309 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:40.055822 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b4a681ca-2949-45bb-94fe-e267b2c00309 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:40.094389 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-b4a681ca-2949-45bb-94fe-e267b2c00309 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Getting quotas for project aaee7e66f16e4ed5b49394311bd2803a. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:22:40.101292 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-b4a681ca-2949-45bb-94fe-e267b2c00309 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Getting quotas for user 8c93886c5818439690564c2299a4f3ee and project aaee7e66f16e4ed5b49394311bd2803a. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:22:40.115657 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:UPDATE=12,nova_api:SELECT=81,nova_api:INSERT=7 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:40.121529 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b4a681ca-2949-45bb-94fe-e267b2c00309 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:22:40.133000 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b4a681ca-2949-45bb-94fe-e267b2c00309 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: da3360d3-ca0b-4077-af3e-92731700dada] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:22:40.235289 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ad2c202b-8f25-485a-8588-56262354a7e0 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:40.251418 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ad2c202b-8f25-485a-8588-56262354a7e0 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/1a733f7d-4f8d-4190-9795-937510f1a516" status: 200 len: 1319 microversion: 2.1 time: 0.717566 Oct 27 03:22:40.259883 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 280/572] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:39 2022] GET /compute/v2.1/servers/1a733f7d-4f8d-4190-9795-937510f1a516 => generated 1319 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:22:40.287475 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-9642084b-5f06-4bdd-976b-c6d2e20963a9 req-a0590f90-8e19-4492-86f2-b3e03a84b747 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d4fe59a-b31c-4fc0-8994-eb21e313d18a", "tag": "4fbcc2f0-a04c-48c8-a4da-059f29a4e11f"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:22:40.308019 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b4a681ca-2949-45bb-94fe-e267b2c00309 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.164606 Oct 27 03:22:40.311301 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-9642084b-5f06-4bdd-976b-c6d2e20963a9 req-a0590f90-8e19-4492-86f2-b3e03a84b747 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:40.315127 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 293/573] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:22:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 2170 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 03:22:40.315254 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-9642084b-5f06-4bdd-976b-c6d2e20963a9 req-a0590f90-8e19-4492-86f2-b3e03a84b747 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:40.316147 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-9642084b-5f06-4bdd-976b-c6d2e20963a9 req-a0590f90-8e19-4492-86f2-b3e03a84b747 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:40.326692 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-96f6721c-9994-4c0b-bea3-79e3b7530ecf tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:40.327558 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-96f6721c-9994-4c0b-bea3-79e3b7530ecf tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] [instance: 2d4fe59a-b31c-4fc0-8994-eb21e313d18a] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:40.335975 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-9642084b-5f06-4bdd-976b-c6d2e20963a9 req-a0590f90-8e19-4492-86f2-b3e03a84b747 service nova] Creating event network-changed:4fbcc2f0-a04c-48c8-a4da-059f29a4e11f for instance 2d4fe59a-b31c-4fc0-8994-eb21e313d18a on n-h1-862769-1 Oct 27 03:22:40.340174 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-96f6721c-9994-4c0b-bea3-79e3b7530ecf tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:40.343299 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-96f6721c-9994-4c0b-bea3-79e3b7530ecf tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:40.343299 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-96f6721c-9994-4c0b-bea3-79e3b7530ecf tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:40.343932 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-96f6721c-9994-4c0b-bea3-79e3b7530ecf tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:40.344405 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-96f6721c-9994-4c0b-bea3-79e3b7530ecf tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:40.347189 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-96f6721c-9994-4c0b-bea3-79e3b7530ecf tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:40.347830 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-9642084b-5f06-4bdd-976b-c6d2e20963a9 req-a0590f90-8e19-4492-86f2-b3e03a84b747 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083211 Oct 27 03:22:40.351316 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 281/574] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:22:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:22:40.353735 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1d891cb0-e60d-4373-84cb-5474826ab3f8 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:40.354393 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1d891cb0-e60d-4373-84cb-5474826ab3f8 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:40.372487 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1d891cb0-e60d-4373-84cb-5474826ab3f8 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:40.373527 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1d891cb0-e60d-4373-84cb-5474826ab3f8 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:40.373979 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1d891cb0-e60d-4373-84cb-5474826ab3f8 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:40.374724 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1d891cb0-e60d-4373-84cb-5474826ab3f8 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:40.375186 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1d891cb0-e60d-4373-84cb-5474826ab3f8 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:40.375623 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1d891cb0-e60d-4373-84cb-5474826ab3f8 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:40.449192 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=8 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:40.568413 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1d891cb0-e60d-4373-84cb-5474826ab3f8 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:40.578737 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1d891cb0-e60d-4373-84cb-5474826ab3f8 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:40.586358 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1d891cb0-e60d-4373-84cb-5474826ab3f8 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:40.617274 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1d891cb0-e60d-4373-84cb-5474826ab3f8 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1540 microversion: 2.91 time: 0.267565 Oct 27 03:22:40.635743 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 282/575] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:22:40 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1540 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:22:40.658157 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-02a4a5a7-222e-4085-8b65-0bba8aef7a4a tempest-SecurityGroupsTestAdminJSON-364027375 tempest-SecurityGroupsTestAdminJSON-364027375-project] Action: 'create', calling method: .version_select at 0x7f7ddae2d940>, body: {"security_group": {"name": "tempest-securitygroup-824686934", "description": "tempest-description-975883051"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:22:41.410805 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-96f6721c-9994-4c0b-bea3-79e3b7530ecf tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e23378ed283426cbff623265d9bbc96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f033d34ad44397bfda5cba4c041071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:41.420181 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-96f6721c-9994-4c0b-bea3-79e3b7530ecf tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] 10.222.0.20 "GET /compute/v2.1/servers/2d4fe59a-b31c-4fc0-8994-eb21e313d18a" status: 200 len: 1387 microversion: 2.1 time: 1.106945 Oct 27 03:22:41.424029 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 294/576] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:40 2022] GET /compute/v2.1/servers/2d4fe59a-b31c-4fc0-8994-eb21e313d18a => generated 1387 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:22:41.445611 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0cd87daf-b582-4453-95a6-1caef760fc4c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:41.446609 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0cd87daf-b582-4453-95a6-1caef760fc4c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: da3360d3-ca0b-4077-af3e-92731700dada] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:41.495146 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-02a4a5a7-222e-4085-8b65-0bba8aef7a4a tempest-SecurityGroupsTestAdminJSON-364027375 tempest-SecurityGroupsTestAdminJSON-364027375-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.858201 Oct 27 03:22:41.496076 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 283/577] 10.222.0.20 () {60 vars in 1180 bytes} [Thu Oct 27 03:22:40 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:22:41.501982 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c88f1adf-45e2-43fd-8d79-b585e095c9dd tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:41.503292 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c88f1adf-45e2-43fd-8d79-b585e095c9dd tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: b2ef080f-30ca-4dc5-ba03-9cf1899346a4] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:41.527087 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c88f1adf-45e2-43fd-8d79-b585e095c9dd tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:41.527596 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c88f1adf-45e2-43fd-8d79-b585e095c9dd tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:41.528099 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c88f1adf-45e2-43fd-8d79-b585e095c9dd tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:41.528886 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c88f1adf-45e2-43fd-8d79-b585e095c9dd tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:41.530178 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c88f1adf-45e2-43fd-8d79-b585e095c9dd tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:41.530633 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c88f1adf-45e2-43fd-8d79-b585e095c9dd tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:41.704044 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0cd87daf-b582-4453-95a6-1caef760fc4c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:41.709714 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c88f1adf-45e2-43fd-8d79-b585e095c9dd tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:41.725828 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0cd87daf-b582-4453-95a6-1caef760fc4c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/da3360d3-ca0b-4077-af3e-92731700dada" status: 200 len: 1210 microversion: 2.1 time: 0.298792 Oct 27 03:22:41.728803 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c88f1adf-45e2-43fd-8d79-b585e095c9dd tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4" status: 200 len: 1313 microversion: 2.1 time: 0.230978 Oct 27 03:22:41.730026 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 284/578] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:41 2022] GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4 => generated 1313 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:22:41.738028 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-117ba37a-e640-4c28-bfef-0eb7d0c41e47 tempest-UnshelveToHostMultiNodesTest-20786752 tempest-UnshelveToHostMultiNodesTest-20786752-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h1-862769-1"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:22:41.740719 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-117ba37a-e640-4c28-bfef-0eb7d0c41e47 tempest-UnshelveToHostMultiNodesTest-20786752 tempest-UnshelveToHostMultiNodesTest-20786752-project-admin] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:41.744693 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 295/579] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:41 2022] GET /compute/v2.1/servers/da3360d3-ca0b-4077-af3e-92731700dada => generated 1210 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:22:41.761911 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-48f384d2-502d-4d6b-88da-c7c11c873670 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:41.764507 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-48f384d2-502d-4d6b-88da-c7c11c873670 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: 1a733f7d-4f8d-4190-9795-937510f1a516] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:41.764705 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-117ba37a-e640-4c28-bfef-0eb7d0c41e47 tempest-UnshelveToHostMultiNodesTest-20786752 tempest-UnshelveToHostMultiNodesTest-20786752-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:41.765205 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-117ba37a-e640-4c28-bfef-0eb7d0c41e47 tempest-UnshelveToHostMultiNodesTest-20786752 tempest-UnshelveToHostMultiNodesTest-20786752-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:41.769770 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-117ba37a-e640-4c28-bfef-0eb7d0c41e47 tempest-UnshelveToHostMultiNodesTest-20786752 tempest-UnshelveToHostMultiNodesTest-20786752-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:41.771543 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-48f384d2-502d-4d6b-88da-c7c11c873670 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:41.772259 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-48f384d2-502d-4d6b-88da-c7c11c873670 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:41.772975 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-48f384d2-502d-4d6b-88da-c7c11c873670 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:41.774194 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-48f384d2-502d-4d6b-88da-c7c11c873670 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:41.775013 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-117ba37a-e640-4c28-bfef-0eb7d0c41e47 tempest-UnshelveToHostMultiNodesTest-20786752 tempest-UnshelveToHostMultiNodesTest-20786752-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:41.775407 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-48f384d2-502d-4d6b-88da-c7c11c873670 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:41.775704 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-117ba37a-e640-4c28-bfef-0eb7d0c41e47 tempest-UnshelveToHostMultiNodesTest-20786752 tempest-UnshelveToHostMultiNodesTest-20786752-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:41.775981 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-48f384d2-502d-4d6b-88da-c7c11c873670 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:41.776199 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-117ba37a-e640-4c28-bfef-0eb7d0c41e47 tempest-UnshelveToHostMultiNodesTest-20786752 tempest-UnshelveToHostMultiNodesTest-20786752-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:41.883743 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-117ba37a-e640-4c28-bfef-0eb7d0c41e47 tempest-UnshelveToHostMultiNodesTest-20786752 tempest-UnshelveToHostMultiNodesTest-20786752-project-admin] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h1-862769-1". {{(pid=121001) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 27 03:22:41.991858 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-48f384d2-502d-4d6b-88da-c7c11c873670 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:42.001033 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-48f384d2-502d-4d6b-88da-c7c11c873670 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/1a733f7d-4f8d-4190-9795-937510f1a516" status: 200 len: 1319 microversion: 2.1 time: 0.255204 Oct 27 03:22:42.001623 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 296/580] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:41 2022] GET /compute/v2.1/servers/1a733f7d-4f8d-4190-9795-937510f1a516 => generated 1319 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:22:42.232835 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-117ba37a-e640-4c28-bfef-0eb7d0c41e47 tempest-UnshelveToHostMultiNodesTest-20786752 tempest-UnshelveToHostMultiNodesTest-20786752-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b/action" status: 202 len: 0 microversion: 2.91 time: 0.501119 Oct 27 03:22:42.234077 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 285/581] 10.222.0.20 () {62 vars in 1319 bytes} [Thu Oct 27 03:22:41 2022] POST /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b/action => generated 0 bytes in 503 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:22:42.239959 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-41dbf32c-8d33-4825-882b-46af43e81aa4 req-8727d53d-8363-43c5-b679-7fe79548e08c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a733f7d-4f8d-4190-9795-937510f1a516", "tag": "969d061b-4cd2-41dd-8d2b-52277a30b8ea"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:22:42.255492 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-41dbf32c-8d33-4825-882b-46af43e81aa4 req-8727d53d-8363-43c5-b679-7fe79548e08c service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:42.256744 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-41dbf32c-8d33-4825-882b-46af43e81aa4 req-8727d53d-8363-43c5-b679-7fe79548e08c service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:42.258838 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-41dbf32c-8d33-4825-882b-46af43e81aa4 req-8727d53d-8363-43c5-b679-7fe79548e08c service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:42.265372 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-539389fa-2509-4794-940c-e52c0e806be2 tempest-SecurityGroupsTestAdminJSON-551050314 tempest-SecurityGroupsTestAdminJSON-551050314-project-admin] Action: 'create', calling method: .version_select at 0x7f7ddb56eb80>, body: {"security_group": {"name": "tempest-securitygroup-948781103", "description": "tempest-description-672720564"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:22:42.275299 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-41dbf32c-8d33-4825-882b-46af43e81aa4 req-8727d53d-8363-43c5-b679-7fe79548e08c service nova] Creating event network-changed:969d061b-4cd2-41dd-8d2b-52277a30b8ea for instance 1a733f7d-4f8d-4190-9795-937510f1a516 on n-h1-862769-1 Oct 27 03:22:42.281672 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-41dbf32c-8d33-4825-882b-46af43e81aa4 req-8727d53d-8363-43c5-b679-7fe79548e08c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046055 Oct 27 03:22:42.282593 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 286/582] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:22:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:22:42.289448 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-429042f6-ab7b-4997-a240-a3e35d165866 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:42.290433 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-429042f6-ab7b-4997-a240-a3e35d165866 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:42.298667 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-429042f6-ab7b-4997-a240-a3e35d165866 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:42.298667 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-429042f6-ab7b-4997-a240-a3e35d165866 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:42.298909 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-429042f6-ab7b-4997-a240-a3e35d165866 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:42.299627 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-429042f6-ab7b-4997-a240-a3e35d165866 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:42.300205 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-429042f6-ab7b-4997-a240-a3e35d165866 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:42.300527 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-429042f6-ab7b-4997-a240-a3e35d165866 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:42.371500 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-429042f6-ab7b-4997-a240-a3e35d165866 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:42.381436 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-429042f6-ab7b-4997-a240-a3e35d165866 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:42.382930 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-429042f6-ab7b-4997-a240-a3e35d165866 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:42.389656 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-429042f6-ab7b-4997-a240-a3e35d165866 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1488 microversion: 2.91 time: 0.105692 Oct 27 03:22:42.390272 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 287/583] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:22:42 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1488 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:22:42.446311 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ba4bde8a-ed57-4588-94db-a463ce7892ec tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:42.447508 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ba4bde8a-ed57-4588-94db-a463ce7892ec tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] [instance: 2d4fe59a-b31c-4fc0-8994-eb21e313d18a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:42.456259 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ba4bde8a-ed57-4588-94db-a463ce7892ec tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:42.456958 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ba4bde8a-ed57-4588-94db-a463ce7892ec tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:42.457681 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ba4bde8a-ed57-4588-94db-a463ce7892ec tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:42.458721 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ba4bde8a-ed57-4588-94db-a463ce7892ec tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:42.459447 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ba4bde8a-ed57-4588-94db-a463ce7892ec tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:42.460141 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ba4bde8a-ed57-4588-94db-a463ce7892ec tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:42.676557 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ba4bde8a-ed57-4588-94db-a463ce7892ec tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e23378ed283426cbff623265d9bbc96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f033d34ad44397bfda5cba4c041071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:42.685341 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ba4bde8a-ed57-4588-94db-a463ce7892ec tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] 10.222.0.20 "GET /compute/v2.1/servers/2d4fe59a-b31c-4fc0-8994-eb21e313d18a" status: 200 len: 1387 microversion: 2.1 time: 0.244061 Oct 27 03:22:42.686616 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 288/584] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:42 2022] GET /compute/v2.1/servers/2d4fe59a-b31c-4fc0-8994-eb21e313d18a => generated 1387 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:22:42.757412 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-827a87f8-bdae-4e9b-9e42-b8748314b16d tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:42.758065 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-827a87f8-bdae-4e9b-9e42-b8748314b16d tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: b2ef080f-30ca-4dc5-ba03-9cf1899346a4] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:42.766445 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-827a87f8-bdae-4e9b-9e42-b8748314b16d tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:42.767011 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-827a87f8-bdae-4e9b-9e42-b8748314b16d tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:42.767609 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-827a87f8-bdae-4e9b-9e42-b8748314b16d tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:42.769331 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-827a87f8-bdae-4e9b-9e42-b8748314b16d tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:42.769804 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-827a87f8-bdae-4e9b-9e42-b8748314b16d tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:42.770867 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-827a87f8-bdae-4e9b-9e42-b8748314b16d tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:42.979484 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-827a87f8-bdae-4e9b-9e42-b8748314b16d tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:42.997830 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-827a87f8-bdae-4e9b-9e42-b8748314b16d tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4" status: 200 len: 1313 microversion: 2.1 time: 0.244613 Oct 27 03:22:43.000931 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 289/585] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:42 2022] GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4 => generated 1313 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:22:43.006741 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0f6e2383-4e3a-44cb-955c-fa75460a678e tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:43.007356 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0f6e2383-4e3a-44cb-955c-fa75460a678e tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: da3360d3-ca0b-4077-af3e-92731700dada] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:43.013351 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0f6e2383-4e3a-44cb-955c-fa75460a678e tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:43.014194 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0f6e2383-4e3a-44cb-955c-fa75460a678e tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:43.014645 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0f6e2383-4e3a-44cb-955c-fa75460a678e tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:43.015354 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0f6e2383-4e3a-44cb-955c-fa75460a678e tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:43.015810 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0f6e2383-4e3a-44cb-955c-fa75460a678e tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:43.016313 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0f6e2383-4e3a-44cb-955c-fa75460a678e tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:43.128420 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0f6e2383-4e3a-44cb-955c-fa75460a678e tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:43.140649 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0f6e2383-4e3a-44cb-955c-fa75460a678e tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/da3360d3-ca0b-4077-af3e-92731700dada" status: 200 len: 1262 microversion: 2.1 time: 0.137568 Oct 27 03:22:43.146101 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 290/586] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:43 2022] GET /compute/v2.1/servers/da3360d3-ca0b-4077-af3e-92731700dada => generated 1262 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:22:43.147086 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-396f2822-84ca-4461-aa37-b45fc868c93c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:43.147704 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-396f2822-84ca-4461-aa37-b45fc868c93c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: 1a733f7d-4f8d-4190-9795-937510f1a516] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:43.153990 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-396f2822-84ca-4461-aa37-b45fc868c93c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:43.155433 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-396f2822-84ca-4461-aa37-b45fc868c93c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:43.156038 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-396f2822-84ca-4461-aa37-b45fc868c93c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:43.156887 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-396f2822-84ca-4461-aa37-b45fc868c93c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:43.157533 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-396f2822-84ca-4461-aa37-b45fc868c93c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:43.158139 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-396f2822-84ca-4461-aa37-b45fc868c93c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:43.235170 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-539389fa-2509-4794-940c-e52c0e806be2 tempest-SecurityGroupsTestAdminJSON-551050314 tempest-SecurityGroupsTestAdminJSON-551050314-project-admin] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 1.231756 Oct 27 03:22:43.235784 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 297/587] 10.222.0.20 () {60 vars in 1180 bytes} [Thu Oct 27 03:22:42 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:22:43.249432 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-70c74c25-bd7f-42c0-bc24-5638b112ea88 tempest-SecurityGroupsTestAdminJSON-551050314 tempest-SecurityGroupsTestAdminJSON-551050314-project-admin] Action: 'create', calling method: .version_select at 0x7f7ddaeef310>, body: {"security_group": {"name": "tempest-securitygroup-979161452", "description": "tempest-description-1961220114"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:22:43.328088 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-396f2822-84ca-4461-aa37-b45fc868c93c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:43.335933 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-396f2822-84ca-4461-aa37-b45fc868c93c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/1a733f7d-4f8d-4190-9795-937510f1a516" status: 200 len: 1319 microversion: 2.1 time: 0.193224 Oct 27 03:22:43.336502 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 291/588] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:43 2022] GET /compute/v2.1/servers/1a733f7d-4f8d-4190-9795-937510f1a516 => generated 1319 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:22:43.420798 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ad6858ca-9156-4809-9b25-7243d0799893 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:43.421588 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ad6858ca-9156-4809-9b25-7243d0799893 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:43.427886 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ad6858ca-9156-4809-9b25-7243d0799893 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:43.428374 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ad6858ca-9156-4809-9b25-7243d0799893 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:43.428808 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ad6858ca-9156-4809-9b25-7243d0799893 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:43.429587 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ad6858ca-9156-4809-9b25-7243d0799893 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:43.430441 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ad6858ca-9156-4809-9b25-7243d0799893 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:43.431506 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ad6858ca-9156-4809-9b25-7243d0799893 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:43.502442 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ad6858ca-9156-4809-9b25-7243d0799893 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:43.510933 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ad6858ca-9156-4809-9b25-7243d0799893 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:43.515501 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ad6858ca-9156-4809-9b25-7243d0799893 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:43.519043 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ad6858ca-9156-4809-9b25-7243d0799893 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1488 microversion: 2.91 time: 0.103045 Oct 27 03:22:43.519799 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 292/589] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:22:43 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1488 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:22:43.638363 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-70c74c25-bd7f-42c0-bc24-5638b112ea88 tempest-SecurityGroupsTestAdminJSON-551050314 tempest-SecurityGroupsTestAdminJSON-551050314-project-admin] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.393486 Oct 27 03:22:43.639812 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 298/590] 10.222.0.20 () {60 vars in 1180 bytes} [Thu Oct 27 03:22:43 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:22:43.661600 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c9d110ce-756d-48b6-9029-2d6037280911 tempest-SecurityGroupsTestAdminJSON-551050314 tempest-SecurityGroupsTestAdminJSON-551050314-project-admin] Calling method '.version_select at 0x7f7ddb1daa60>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:43.710523 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3ef47059-88ff-4210-8b0f-90fc29e2e91f tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:43.713257 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-3ef47059-88ff-4210-8b0f-90fc29e2e91f tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] [instance: 2d4fe59a-b31c-4fc0-8994-eb21e313d18a] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:43.755166 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3ef47059-88ff-4210-8b0f-90fc29e2e91f tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:43.755732 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3ef47059-88ff-4210-8b0f-90fc29e2e91f tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:43.756408 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3ef47059-88ff-4210-8b0f-90fc29e2e91f tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:43.757306 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3ef47059-88ff-4210-8b0f-90fc29e2e91f tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:43.759115 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3ef47059-88ff-4210-8b0f-90fc29e2e91f tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:43.759950 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3ef47059-88ff-4210-8b0f-90fc29e2e91f tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:44.130760 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-3ef47059-88ff-4210-8b0f-90fc29e2e91f tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e23378ed283426cbff623265d9bbc96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f033d34ad44397bfda5cba4c041071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:44.141965 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3ef47059-88ff-4210-8b0f-90fc29e2e91f tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] 10.222.0.20 "GET /compute/v2.1/servers/2d4fe59a-b31c-4fc0-8994-eb21e313d18a" status: 200 len: 1387 microversion: 2.1 time: 0.435204 Oct 27 03:22:44.142603 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 299/591] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:43 2022] GET /compute/v2.1/servers/2d4fe59a-b31c-4fc0-8994-eb21e313d18a => generated 1387 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:22:44.151656 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-dfa1dc27-82f3-4111-92fe-0296a6a4e3ca tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:44.152285 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-dfa1dc27-82f3-4111-92fe-0296a6a4e3ca tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: b2ef080f-30ca-4dc5-ba03-9cf1899346a4] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:44.160503 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dfa1dc27-82f3-4111-92fe-0296a6a4e3ca tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:44.161035 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dfa1dc27-82f3-4111-92fe-0296a6a4e3ca tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:44.161468 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dfa1dc27-82f3-4111-92fe-0296a6a4e3ca tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:44.162224 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dfa1dc27-82f3-4111-92fe-0296a6a4e3ca tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:44.162924 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dfa1dc27-82f3-4111-92fe-0296a6a4e3ca tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:44.163514 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dfa1dc27-82f3-4111-92fe-0296a6a4e3ca tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:44.195248 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=100 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:44.406367 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-dfa1dc27-82f3-4111-92fe-0296a6a4e3ca tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:44.415523 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-dfa1dc27-82f3-4111-92fe-0296a6a4e3ca tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4" status: 200 len: 1313 microversion: 2.1 time: 0.271692 Oct 27 03:22:44.417080 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 300/592] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:44 2022] GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4 => generated 1313 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:22:44.424445 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-792cc74a-3706-41b9-8a7c-d5bf9fd5afdd tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:44.427351 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-792cc74a-3706-41b9-8a7c-d5bf9fd5afdd tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: da3360d3-ca0b-4077-af3e-92731700dada] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:44.433132 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-792cc74a-3706-41b9-8a7c-d5bf9fd5afdd tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:44.434186 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-792cc74a-3706-41b9-8a7c-d5bf9fd5afdd tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:44.437379 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-792cc74a-3706-41b9-8a7c-d5bf9fd5afdd tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:44.437379 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-792cc74a-3706-41b9-8a7c-d5bf9fd5afdd tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:44.438364 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-792cc74a-3706-41b9-8a7c-d5bf9fd5afdd tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:44.438587 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-792cc74a-3706-41b9-8a7c-d5bf9fd5afdd tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:44.571196 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-792cc74a-3706-41b9-8a7c-d5bf9fd5afdd tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:44.579805 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-792cc74a-3706-41b9-8a7c-d5bf9fd5afdd tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/da3360d3-ca0b-4077-af3e-92731700dada" status: 200 len: 1270 microversion: 2.1 time: 0.161247 Oct 27 03:22:44.580394 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 301/593] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:44 2022] GET /compute/v2.1/servers/da3360d3-ca0b-4077-af3e-92731700dada => generated 1270 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:22:44.594802 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-83473d7f-4590-4b97-adaf-94a5036c9916 req-40116c00-5606-4e0f-b971-3a7478f3e540 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2ef080f-30ca-4dc5-ba03-9cf1899346a4", "tag": "7bd75d20-f08a-4aa0-b246-a0898c1313cc"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:22:44.609435 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-83473d7f-4590-4b97-adaf-94a5036c9916 req-40116c00-5606-4e0f-b971-3a7478f3e540 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:44.610083 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-83473d7f-4590-4b97-adaf-94a5036c9916 req-40116c00-5606-4e0f-b971-3a7478f3e540 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:44.610532 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-83473d7f-4590-4b97-adaf-94a5036c9916 req-40116c00-5606-4e0f-b971-3a7478f3e540 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:44.643683 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-83473d7f-4590-4b97-adaf-94a5036c9916 req-40116c00-5606-4e0f-b971-3a7478f3e540 service nova] Creating event network-changed:7bd75d20-f08a-4aa0-b246-a0898c1313cc for instance b2ef080f-30ca-4dc5-ba03-9cf1899346a4 on n-h2-862769-1 Oct 27 03:22:44.653941 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-83473d7f-4590-4b97-adaf-94a5036c9916 req-40116c00-5606-4e0f-b971-3a7478f3e540 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072304 Oct 27 03:22:44.658182 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 302/594] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:22:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:22:44.669566 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0c4294db-f924-43b8-9c38-bed3f7e05edb tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:44.670934 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0c4294db-f924-43b8-9c38-bed3f7e05edb tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: 1a733f7d-4f8d-4190-9795-937510f1a516] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:44.686377 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0c4294db-f924-43b8-9c38-bed3f7e05edb tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:44.686904 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0c4294db-f924-43b8-9c38-bed3f7e05edb tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:44.687340 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0c4294db-f924-43b8-9c38-bed3f7e05edb tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:44.688061 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0c4294db-f924-43b8-9c38-bed3f7e05edb tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:44.688519 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0c4294db-f924-43b8-9c38-bed3f7e05edb tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:44.692410 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0c4294db-f924-43b8-9c38-bed3f7e05edb tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:44.922445 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0c4294db-f924-43b8-9c38-bed3f7e05edb tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:44.926995 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0c4294db-f924-43b8-9c38-bed3f7e05edb tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/1a733f7d-4f8d-4190-9795-937510f1a516" status: 200 len: 1319 microversion: 2.1 time: 0.267123 Oct 27 03:22:44.927621 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 303/595] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:44 2022] GET /compute/v2.1/servers/1a733f7d-4f8d-4190-9795-937510f1a516 => generated 1319 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:22:45.157152 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-73faf166-6cfe-425b-a7c6-8e4e571f97d1 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Calling method '.version_select at 0x7f7ddb4dd550>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:45.245642 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=42 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:45.501772 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-73faf166-6cfe-425b-a7c6-8e4e571f97d1 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/2364aaa9984f4132be525de73eb77a3e" status: 200 len: 371 microversion: 2.1 time: 0.572839 Oct 27 03:22:45.502810 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 304/596] 10.222.0.20 () {58 vars in 1242 bytes} [Thu Oct 27 03:22:44 2022] GET /compute/v2.1/os-quota-sets/2364aaa9984f4132be525de73eb77a3e => generated 371 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:22:45.508273 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-caa7aed5-5adb-4e26-a119-bd0be2aa4e2e tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:45.509077 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-caa7aed5-5adb-4e26-a119-bd0be2aa4e2e tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:45.516886 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-caa7aed5-5adb-4e26-a119-bd0be2aa4e2e tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:45.517832 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-caa7aed5-5adb-4e26-a119-bd0be2aa4e2e tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:45.518404 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-caa7aed5-5adb-4e26-a119-bd0be2aa4e2e tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:45.519393 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-caa7aed5-5adb-4e26-a119-bd0be2aa4e2e tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:45.520010 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-caa7aed5-5adb-4e26-a119-bd0be2aa4e2e tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:45.520568 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-caa7aed5-5adb-4e26-a119-bd0be2aa4e2e tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:45.673116 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-caa7aed5-5adb-4e26-a119-bd0be2aa4e2e tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:45.681776 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-caa7aed5-5adb-4e26-a119-bd0be2aa4e2e tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:45.683370 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-caa7aed5-5adb-4e26-a119-bd0be2aa4e2e tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:45.689874 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-caa7aed5-5adb-4e26-a119-bd0be2aa4e2e tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1490 microversion: 2.91 time: 0.185624 Oct 27 03:22:45.693106 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 305/597] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:22:45 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1490 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:22:45.696914 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f68ac4a3-f9f5-4276-86ab-2d74160d7a9d tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:45.697561 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f68ac4a3-f9f5-4276-86ab-2d74160d7a9d tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] [instance: 2d4fe59a-b31c-4fc0-8994-eb21e313d18a] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:45.707028 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f68ac4a3-f9f5-4276-86ab-2d74160d7a9d tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:45.709023 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f68ac4a3-f9f5-4276-86ab-2d74160d7a9d tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:45.710119 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f68ac4a3-f9f5-4276-86ab-2d74160d7a9d tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:45.710803 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f68ac4a3-f9f5-4276-86ab-2d74160d7a9d tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:45.711460 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f68ac4a3-f9f5-4276-86ab-2d74160d7a9d tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:45.712069 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f68ac4a3-f9f5-4276-86ab-2d74160d7a9d tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:46.112566 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c9d110ce-756d-48b6-9029-2d6037280911 tempest-SecurityGroupsTestAdminJSON-551050314 tempest-SecurityGroupsTestAdminJSON-551050314-project-admin] 10.222.0.20 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 10366 microversion: 2.1 time: 2.454821 Oct 27 03:22:46.113950 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 293/598] 10.222.0.20 () {58 vars in 1191 bytes} [Thu Oct 27 03:22:43 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 10366 bytes in 2457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 03:22:46.129013 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-60ff49d5-6b25-4562-a94e-83be5e8c344b tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:46.129013 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-60ff49d5-6b25-4562-a94e-83be5e8c344b tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: b2ef080f-30ca-4dc5-ba03-9cf1899346a4] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:46.129013 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-60ff49d5-6b25-4562-a94e-83be5e8c344b tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:46.129013 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-60ff49d5-6b25-4562-a94e-83be5e8c344b tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:46.129929 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-60ff49d5-6b25-4562-a94e-83be5e8c344b tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:46.134936 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-60ff49d5-6b25-4562-a94e-83be5e8c344b tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:46.135611 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-60ff49d5-6b25-4562-a94e-83be5e8c344b tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:46.136332 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-60ff49d5-6b25-4562-a94e-83be5e8c344b tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:46.183075 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f68ac4a3-f9f5-4276-86ab-2d74160d7a9d tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e23378ed283426cbff623265d9bbc96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f033d34ad44397bfda5cba4c041071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:46.192867 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f68ac4a3-f9f5-4276-86ab-2d74160d7a9d tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] 10.222.0.20 "GET /compute/v2.1/servers/2d4fe59a-b31c-4fc0-8994-eb21e313d18a" status: 200 len: 1387 microversion: 2.1 time: 0.500869 Oct 27 03:22:46.194314 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 306/599] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:45 2022] GET /compute/v2.1/servers/2d4fe59a-b31c-4fc0-8994-eb21e313d18a => generated 1387 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:22:46.315853 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-60ff49d5-6b25-4562-a94e-83be5e8c344b tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:46.331320 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-60ff49d5-6b25-4562-a94e-83be5e8c344b tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4" status: 200 len: 1313 microversion: 2.1 time: 0.213401 Oct 27 03:22:46.334491 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 294/600] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:46 2022] GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4 => generated 1313 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:22:46.340727 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-19eff1ab-c1d7-4519-a7b7-db4d3a328a46 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Action: 'update', calling method: .version_select at 0x7f7ddb1baaf0>, body: {"quota_set": {"ram": "5120"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:22:46.346766 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4e65f8bb-b7e8-42b3-9ba6-c2969e84a549 tempest-KeyPairsV210TestJSON-576065568 tempest-KeyPairsV210TestJSON-576065568-project-admin] Action: 'create', calling method: .version_select at 0x7f7ddb002940>, body: {"keypair": {"name": "tempest-keypair-517481909", "type": "ssh", "user_id": "626d9f148fcd42208423d46ff1bd4488", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKAf8dq+sJIRW/MPIJog3w/oeUSGC7QUOPzbGru0VysROogmfaKGb2ox90xCWAzVIro2Ilq4lvkPfanhE05qw37f3cqKHyUN28yLNmYtrT6nP2OfvG5CGwgQsS8BN24wBg=="}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:22:46.367083 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-4e65f8bb-b7e8-42b3-9ba6-c2969e84a549 tempest-KeyPairsV210TestJSON-576065568 tempest-KeyPairsV210TestJSON-576065568-project-admin] Getting quotas for project d1de4698a8ba49e68c791ce70b7709f7. Resources: {'key_pairs'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:22:46.373878 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-4e65f8bb-b7e8-42b3-9ba6-c2969e84a549 tempest-KeyPairsV210TestJSON-576065568 tempest-KeyPairsV210TestJSON-576065568-project-admin] Getting quotas for user ea72f9aed79946e4960318361401b8cb and project d1de4698a8ba49e68c791ce70b7709f7. Resources: {'key_pairs'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:22:46.449717 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-19eff1ab-c1d7-4519-a7b7-db4d3a328a46 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:46.450592 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-19eff1ab-c1d7-4519-a7b7-db4d3a328a46 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:46.462549 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-19eff1ab-c1d7-4519-a7b7-db4d3a328a46 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:46.464175 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-19eff1ab-c1d7-4519-a7b7-db4d3a328a46 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:46.464175 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-19eff1ab-c1d7-4519-a7b7-db4d3a328a46 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:46.464480 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-19eff1ab-c1d7-4519-a7b7-db4d3a328a46 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:46.549794 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4e65f8bb-b7e8-42b3-9ba6-c2969e84a549 tempest-KeyPairsV210TestJSON-576065568 tempest-KeyPairsV210TestJSON-576065568-project-admin] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.354059 Oct 27 03:22:46.550503 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 307/601] 10.222.0.20 () {62 vars in 1200 bytes} [Thu Oct 27 03:22:46 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 355 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 27 03:22:46.560622 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-fe35a730-ced8-4e51-b024-9efa4b469ae3 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:46.563420 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-fe35a730-ced8-4e51-b024-9efa4b469ae3 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: da3360d3-ca0b-4077-af3e-92731700dada] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:46.580897 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fe35a730-ced8-4e51-b024-9efa4b469ae3 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:46.583474 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fe35a730-ced8-4e51-b024-9efa4b469ae3 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:46.585056 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fe35a730-ced8-4e51-b024-9efa4b469ae3 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:46.589440 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fe35a730-ced8-4e51-b024-9efa4b469ae3 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:46.589959 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fe35a730-ced8-4e51-b024-9efa4b469ae3 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:46.590522 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fe35a730-ced8-4e51-b024-9efa4b469ae3 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:46.651941 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-19eff1ab-c1d7-4519-a7b7-db4d3a328a46 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/2364aaa9984f4132be525de73eb77a3e" status: 200 len: 328 microversion: 2.1 time: 0.316012 Oct 27 03:22:46.653173 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 295/602] 10.222.0.20 () {60 vars in 1262 bytes} [Thu Oct 27 03:22:46 2022] PUT /compute/v2.1/os-quota-sets/2364aaa9984f4132be525de73eb77a3e => generated 328 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:22:46.658981 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7520f32a-c827-49d7-ab5b-97483d156eed tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:46.659936 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7520f32a-c827-49d7-ab5b-97483d156eed tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: 1a733f7d-4f8d-4190-9795-937510f1a516] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:46.677054 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7520f32a-c827-49d7-ab5b-97483d156eed tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:46.677864 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7520f32a-c827-49d7-ab5b-97483d156eed tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:46.678543 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7520f32a-c827-49d7-ab5b-97483d156eed tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:46.679480 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7520f32a-c827-49d7-ab5b-97483d156eed tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:46.680132 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7520f32a-c827-49d7-ab5b-97483d156eed tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:46.680757 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7520f32a-c827-49d7-ab5b-97483d156eed tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:46.890389 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7520f32a-c827-49d7-ab5b-97483d156eed tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:46.901616 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7520f32a-c827-49d7-ab5b-97483d156eed tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/1a733f7d-4f8d-4190-9795-937510f1a516" status: 200 len: 1319 microversion: 2.1 time: 0.247091 Oct 27 03:22:46.920363 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 296/603] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:46 2022] GET /compute/v2.1/servers/1a733f7d-4f8d-4190-9795-937510f1a516 => generated 1319 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:22:46.927903 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6a6f647a-4009-45b8-b81a-92a8dc680261 tempest-SecurityGroupsTestAdminJSON-364027375 tempest-SecurityGroupsTestAdminJSON-364027375-project] Calling method '.version_select at 0x7f7ddada0280>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:47.148292 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-fe35a730-ced8-4e51-b024-9efa4b469ae3 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:47.157991 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6a6f647a-4009-45b8-b81a-92a8dc680261 tempest-SecurityGroupsTestAdminJSON-364027375 tempest-SecurityGroupsTestAdminJSON-364027375-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1109 microversion: 2.1 time: 0.234865 Oct 27 03:22:47.158606 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 297/604] 10.222.0.20 () {58 vars in 1191 bytes} [Thu Oct 27 03:22:46 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1109 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:22:47.183883 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-f843ef5a-3365-439e-8d3d-5d2f8c332d92 req-4750e84d-ab40-4cf4-b6f0-88228b3ef266 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37b3577c-f561-4d8e-957d-cdf1819ef5c1", "name": "network-vif-plugged", "status": "completed", "tag": "fea19390-7267-4a02-8335-c138eabc8d80"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:22:47.184086 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-fe35a730-ced8-4e51-b024-9efa4b469ae3 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/da3360d3-ca0b-4077-af3e-92731700dada" status: 200 len: 1310 microversion: 2.1 time: 0.622371 Oct 27 03:22:47.184086 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 308/605] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:46 2022] GET /compute/v2.1/servers/da3360d3-ca0b-4077-af3e-92731700dada => generated 1310 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:22:47.184237 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-f843ef5a-3365-439e-8d3d-5d2f8c332d92 req-4750e84d-ab40-4cf4-b6f0-88228b3ef266 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:47.184517 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-f843ef5a-3365-439e-8d3d-5d2f8c332d92 req-4750e84d-ab40-4cf4-b6f0-88228b3ef266 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:47.185116 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-f843ef5a-3365-439e-8d3d-5d2f8c332d92 req-4750e84d-ab40-4cf4-b6f0-88228b3ef266 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:47.197202 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-f843ef5a-3365-439e-8d3d-5d2f8c332d92 req-4750e84d-ab40-4cf4-b6f0-88228b3ef266 service nova] Creating event network-vif-plugged:fea19390-7267-4a02-8335-c138eabc8d80 for instance 37b3577c-f561-4d8e-957d-cdf1819ef5c1 on n-h1-862769-1 Oct 27 03:22:47.200908 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ae29e2b6-3884-4c5f-ad75-fbc19e54c318 tempest-KeyPairsV210TestJSON-576065568 tempest-KeyPairsV210TestJSON-576065568-project-admin] Action: 'create', calling method: .version_select at 0x7f7ddb460790>, body: {"keypair": {"name": "tempest-keypair-1050875797", "type": "ssh", "user_id": "626d9f148fcd42208423d46ff1bd4488", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNefxYZWeq3ZrPgSGhXfYAutN3rVSa4V92MlA7ZY1otASDq5XwV9Zj6TJREjwgVAL/8H5m3+SwbDe+CDd6pX+qddPDr6JO0dqS3Ag2wHCrJeNPGdtHOeN1Y35Ad8Iw92Mg=="}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:22:47.205036 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-f843ef5a-3365-439e-8d3d-5d2f8c332d92 req-4750e84d-ab40-4cf4-b6f0-88228b3ef266 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036027 Oct 27 03:22:47.206383 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 298/606] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:22:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:22:47.222790 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-91495f40-e580-46c9-a078-5da3f28b81f9 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:47.223878 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-ae29e2b6-3884-4c5f-ad75-fbc19e54c318 tempest-KeyPairsV210TestJSON-576065568 tempest-KeyPairsV210TestJSON-576065568-project-admin] Getting quotas for project d1de4698a8ba49e68c791ce70b7709f7. Resources: {'key_pairs'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:22:47.231020 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-ae29e2b6-3884-4c5f-ad75-fbc19e54c318 tempest-KeyPairsV210TestJSON-576065568 tempest-KeyPairsV210TestJSON-576065568-project-admin] Getting quotas for user ea72f9aed79946e4960318361401b8cb and project d1de4698a8ba49e68c791ce70b7709f7. Resources: {'key_pairs'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:22:47.312789 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-91495f40-e580-46c9-a078-5da3f28b81f9 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-quota-sets/2364aaa9984f4132be525de73eb77a3e" status: 202 len: 0 microversion: 2.1 time: 0.103285 Oct 27 03:22:47.313734 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 299/607] 10.222.0.20 () {58 vars in 1245 bytes} [Thu Oct 27 03:22:47 2022] DELETE /compute/v2.1/os-quota-sets/2364aaa9984f4132be525de73eb77a3e => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:22:47.324020 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6c6ab390-eaa2-4bcb-b27d-1a657e5b5614 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:47.326523 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-6c6ab390-eaa2-4bcb-b27d-1a657e5b5614 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:47.331094 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6c6ab390-eaa2-4bcb-b27d-1a657e5b5614 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:47.331580 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6c6ab390-eaa2-4bcb-b27d-1a657e5b5614 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:47.332021 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6c6ab390-eaa2-4bcb-b27d-1a657e5b5614 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:47.332722 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6c6ab390-eaa2-4bcb-b27d-1a657e5b5614 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:47.333358 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6c6ab390-eaa2-4bcb-b27d-1a657e5b5614 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:47.333784 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6c6ab390-eaa2-4bcb-b27d-1a657e5b5614 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:47.367177 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ae29e2b6-3884-4c5f-ad75-fbc19e54c318 tempest-KeyPairsV210TestJSON-576065568 tempest-KeyPairsV210TestJSON-576065568-project-admin] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.191047 Oct 27 03:22:47.368905 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 309/608] 10.222.0.20 () {62 vars in 1200 bytes} [Thu Oct 27 03:22:47 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 194 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 27 03:22:47.381680 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-47ff4036-fe6d-4d3a-9012-4099cede7615 tempest-SecurityGroupsTestAdminJSON-551050314 tempest-SecurityGroupsTestAdminJSON-551050314-project-admin] Calling method '.version_select at 0x7f7ddb56e280>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:47.417483 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6c6ab390-eaa2-4bcb-b27d-1a657e5b5614 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:47.431956 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6c6ab390-eaa2-4bcb-b27d-1a657e5b5614 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:47.433676 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6c6ab390-eaa2-4bcb-b27d-1a657e5b5614 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:47.441758 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6c6ab390-eaa2-4bcb-b27d-1a657e5b5614 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1546 microversion: 2.91 time: 0.126436 Oct 27 03:22:47.459696 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 300/609] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:22:47 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1546 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:22:47.468994 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7d1c7057-a50b-4db2-8a1c-91c591b7460a tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:47.476471 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7d1c7057-a50b-4db2-8a1c-91c591b7460a tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] [instance: 2d4fe59a-b31c-4fc0-8994-eb21e313d18a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:47.497265 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7d1c7057-a50b-4db2-8a1c-91c591b7460a tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:47.499579 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7d1c7057-a50b-4db2-8a1c-91c591b7460a tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:47.500911 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7d1c7057-a50b-4db2-8a1c-91c591b7460a tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:47.502698 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7d1c7057-a50b-4db2-8a1c-91c591b7460a tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:47.505123 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7d1c7057-a50b-4db2-8a1c-91c591b7460a tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:47.505990 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7d1c7057-a50b-4db2-8a1c-91c591b7460a tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:47.723646 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7d1c7057-a50b-4db2-8a1c-91c591b7460a tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e23378ed283426cbff623265d9bbc96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f033d34ad44397bfda5cba4c041071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:47.740285 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7d1c7057-a50b-4db2-8a1c-91c591b7460a tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] 10.222.0.20 "GET /compute/v2.1/servers/2d4fe59a-b31c-4fc0-8994-eb21e313d18a" status: 200 len: 1387 microversion: 2.1 time: 0.279062 Oct 27 03:22:47.750291 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 301/610] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:47 2022] GET /compute/v2.1/servers/2d4fe59a-b31c-4fc0-8994-eb21e313d18a => generated 1387 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:22:47.765173 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f3d941d5-6ca7-495d-b7eb-7f58c8d8ebe5 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Calling method '.version_select at 0x7f7ddaf73b80>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:47.911954 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f3d941d5-6ca7-495d-b7eb-7f58c8d8ebe5 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/2364aaa9984f4132be525de73eb77a3e" status: 200 len: 371 microversion: 2.1 time: 0.160129 Oct 27 03:22:47.919663 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 302/611] 10.222.0.20 () {58 vars in 1242 bytes} [Thu Oct 27 03:22:47 2022] GET /compute/v2.1/os-quota-sets/2364aaa9984f4132be525de73eb77a3e => generated 371 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:22:47.926231 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ff1c16bc-2cb6-4026-9c50-eb96e5f83470 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:47.926946 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ff1c16bc-2cb6-4026-9c50-eb96e5f83470 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: b2ef080f-30ca-4dc5-ba03-9cf1899346a4] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:47.933041 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ff1c16bc-2cb6-4026-9c50-eb96e5f83470 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:47.933598 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ff1c16bc-2cb6-4026-9c50-eb96e5f83470 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:47.934060 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ff1c16bc-2cb6-4026-9c50-eb96e5f83470 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:47.934903 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ff1c16bc-2cb6-4026-9c50-eb96e5f83470 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:47.935480 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ff1c16bc-2cb6-4026-9c50-eb96e5f83470 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:47.936548 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ff1c16bc-2cb6-4026-9c50-eb96e5f83470 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:47.954369 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:47.990552 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-47ff4036-fe6d-4d3a-9012-4099cede7615 tempest-SecurityGroupsTestAdminJSON-551050314 tempest-SecurityGroupsTestAdminJSON-551050314-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/c382a069-c892-4495-ba60-d3809cf618cb" status: 202 len: 0 microversion: 2.1 time: 0.616894 Oct 27 03:22:47.992200 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 310/612] 10.222.0.20 () {58 vars in 1272 bytes} [Thu Oct 27 03:22:47 2022] DELETE /compute/v2.1/os-security-groups/c382a069-c892-4495-ba60-d3809cf618cb => generated 0 bytes in 622 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:22:47.997948 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-725be8b5-f627-48ce-8bd7-be2cdb485493 tempest-KeyPairsV210TestJSON-576065568 tempest-KeyPairsV210TestJSON-576065568-project-admin] Calling method '.version_select at 0x7f7ddb161550>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:48.058221 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-725be8b5-f627-48ce-8bd7-be2cdb485493 tempest-KeyPairsV210TestJSON-576065568 tempest-KeyPairsV210TestJSON-576065568-project-admin] 10.222.0.20 "GET /compute/v2.1/os-keypairs/tempest-keypair-517481909?user_id=626d9f148fcd42208423d46ff1bd4488" status: 200 len: 511 microversion: 2.10 time: 0.064092 Oct 27 03:22:48.058409 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 311/613] 10.222.0.20 () {60 vars in 1337 bytes} [Thu Oct 27 03:22:47 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-517481909?user_id=626d9f148fcd42208423d46ff1bd4488 => generated 511 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 03:22:48.072685 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-90289b36-54fc-4b49-9548-9358e0c5a0c6 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:48.073546 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-90289b36-54fc-4b49-9548-9358e0c5a0c6 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: 1a733f7d-4f8d-4190-9795-937510f1a516] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:48.101746 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-90289b36-54fc-4b49-9548-9358e0c5a0c6 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:48.103631 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-90289b36-54fc-4b49-9548-9358e0c5a0c6 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:48.104421 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-90289b36-54fc-4b49-9548-9358e0c5a0c6 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:48.105782 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-90289b36-54fc-4b49-9548-9358e0c5a0c6 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:48.106693 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-90289b36-54fc-4b49-9548-9358e0c5a0c6 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:48.109279 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-90289b36-54fc-4b49-9548-9358e0c5a0c6 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:48.206199 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ff1c16bc-2cb6-4026-9c50-eb96e5f83470 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:48.217371 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ff1c16bc-2cb6-4026-9c50-eb96e5f83470 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4" status: 200 len: 1313 microversion: 2.1 time: 0.294758 Oct 27 03:22:48.217371 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 303/614] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:47 2022] GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4 => generated 1313 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:22:48.244570 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-258dfddb-1607-47e0-a6bc-5dd3e10805f8 tempest-SecurityGroupsTestAdminJSON-551050314 tempest-SecurityGroupsTestAdminJSON-551050314-project-admin] Calling method '.version_select at 0x7f7ddae2db80>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:48.476120 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-90289b36-54fc-4b49-9548-9358e0c5a0c6 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:48.491331 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-90289b36-54fc-4b49-9548-9358e0c5a0c6 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/1a733f7d-4f8d-4190-9795-937510f1a516" status: 200 len: 1319 microversion: 2.1 time: 0.427369 Oct 27 03:22:48.494214 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 312/615] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:48 2022] GET /compute/v2.1/servers/1a733f7d-4f8d-4190-9795-937510f1a516 => generated 1319 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:22:48.505837 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-846da6e4-bf2a-4ea5-a54f-f9e6181d95fb tempest-KeyPairsV210TestJSON-576065568 tempest-KeyPairsV210TestJSON-576065568-project-admin] Action: 'create', calling method: .version_select at 0x7f7ddb56e310>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-85331269", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFN0fEAqfBWhCgdjLWIUD/3t30r2Sdnb5kV95GsyYUxGGsW2gBKMDe7PQdyf8u7uiIsIJvdEurYILdcro65UZlnaOJAV7gZ4ChODUbY67IUSPfAX/c8j0GIEL8zA80Q2PA=="}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:22:48.553940 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-846da6e4-bf2a-4ea5-a54f-f9e6181d95fb tempest-KeyPairsV210TestJSON-576065568 tempest-KeyPairsV210TestJSON-576065568-project-admin] Getting quotas for project d1de4698a8ba49e68c791ce70b7709f7. Resources: {'key_pairs'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:22:48.561982 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-846da6e4-bf2a-4ea5-a54f-f9e6181d95fb tempest-KeyPairsV210TestJSON-576065568 tempest-KeyPairsV210TestJSON-576065568-project-admin] Getting quotas for user ea72f9aed79946e4960318361401b8cb and project d1de4698a8ba49e68c791ce70b7709f7. Resources: {'key_pairs'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:22:48.572308 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=60,nova_cell0:UPDATE=7 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:48.664180 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-846da6e4-bf2a-4ea5-a54f-f9e6181d95fb tempest-KeyPairsV210TestJSON-576065568 tempest-KeyPairsV210TestJSON-576065568-project-admin] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.10 time: 0.168117 Oct 27 03:22:48.666153 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 313/616] 10.222.0.20 () {62 vars in 1200 bytes} [Thu Oct 27 03:22:48 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 171 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 27 03:22:48.667480 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-258dfddb-1607-47e0-a6bc-5dd3e10805f8 tempest-SecurityGroupsTestAdminJSON-551050314 tempest-SecurityGroupsTestAdminJSON-551050314-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/215d4ef2-5a8c-4eec-8fc7-18f645bc9a97" status: 202 len: 0 microversion: 2.1 time: 0.448960 Oct 27 03:22:48.668599 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 304/617] 10.222.0.20 () {58 vars in 1272 bytes} [Thu Oct 27 03:22:48 2022] DELETE /compute/v2.1/os-security-groups/215d4ef2-5a8c-4eec-8fc7-18f645bc9a97 => generated 0 bytes in 451 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:22:48.673004 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-8ef33b44-fae2-44fa-bde9-db99b367e4a1 req-547b194a-ff29-4fbf-a0eb-07b912e7e28f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da3360d3-ca0b-4077-af3e-92731700dada", "tag": "83172e3e-d564-4455-bfff-b4d4868ccf0d"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:22:48.676255 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-10f7a718-9c95-4ea8-804d-a31221aaf884 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:48.677147 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-10f7a718-9c95-4ea8-804d-a31221aaf884 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: da3360d3-ca0b-4077-af3e-92731700dada] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:48.691826 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-10f7a718-9c95-4ea8-804d-a31221aaf884 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:48.694327 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-10f7a718-9c95-4ea8-804d-a31221aaf884 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:48.698459 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-10f7a718-9c95-4ea8-804d-a31221aaf884 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:48.698459 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-10f7a718-9c95-4ea8-804d-a31221aaf884 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:48.698459 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-10f7a718-9c95-4ea8-804d-a31221aaf884 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:48.698459 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-10f7a718-9c95-4ea8-804d-a31221aaf884 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:48.703468 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-8ef33b44-fae2-44fa-bde9-db99b367e4a1 req-547b194a-ff29-4fbf-a0eb-07b912e7e28f service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:48.704233 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-8ef33b44-fae2-44fa-bde9-db99b367e4a1 req-547b194a-ff29-4fbf-a0eb-07b912e7e28f service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:48.704914 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-8ef33b44-fae2-44fa-bde9-db99b367e4a1 req-547b194a-ff29-4fbf-a0eb-07b912e7e28f service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:48.730897 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-8ef33b44-fae2-44fa-bde9-db99b367e4a1 req-547b194a-ff29-4fbf-a0eb-07b912e7e28f service nova] Creating event network-changed:83172e3e-d564-4455-bfff-b4d4868ccf0d for instance da3360d3-ca0b-4077-af3e-92731700dada on n-h2-862769-1 Oct 27 03:22:48.745604 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-8ef33b44-fae2-44fa-bde9-db99b367e4a1 req-547b194a-ff29-4fbf-a0eb-07b912e7e28f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077992 Oct 27 03:22:48.747076 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 314/618] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:22:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:22:48.754259 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-bd26a67d-13a4-4eb3-bb94-93e75151c5d4 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Calling method '.version_select at 0x7f7ddb3c01f0>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:48.913349 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-10f7a718-9c95-4ea8-804d-a31221aaf884 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:48.926749 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-10f7a718-9c95-4ea8-804d-a31221aaf884 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/da3360d3-ca0b-4077-af3e-92731700dada" status: 200 len: 1310 microversion: 2.1 time: 0.256731 Oct 27 03:22:48.927378 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 305/619] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:48 2022] GET /compute/v2.1/servers/da3360d3-ca0b-4077-af3e-92731700dada => generated 1310 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:22:48.941870 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-337ae6f3-1fff-4c1e-ae6d-6f018ff6cfbb tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:48.955794 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-337ae6f3-1fff-4c1e-ae6d-6f018ff6cfbb tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:48.968505 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-337ae6f3-1fff-4c1e-ae6d-6f018ff6cfbb tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:48.969014 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-337ae6f3-1fff-4c1e-ae6d-6f018ff6cfbb tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:48.969471 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-337ae6f3-1fff-4c1e-ae6d-6f018ff6cfbb tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:48.970474 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-337ae6f3-1fff-4c1e-ae6d-6f018ff6cfbb tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:48.971151 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-337ae6f3-1fff-4c1e-ae6d-6f018ff6cfbb tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:48.971693 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-337ae6f3-1fff-4c1e-ae6d-6f018ff6cfbb tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:49.127536 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-337ae6f3-1fff-4c1e-ae6d-6f018ff6cfbb tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:49.143640 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-337ae6f3-1fff-4c1e-ae6d-6f018ff6cfbb tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:49.145763 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-337ae6f3-1fff-4c1e-ae6d-6f018ff6cfbb tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:49.150573 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-bd26a67d-13a4-4eb3-bb94-93e75151c5d4 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/6abd257f3bfc49b99f90d15daeb01867/defaults" status: 200 len: 371 microversion: 2.1 time: 0.398954 Oct 27 03:22:49.152449 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 315/620] 10.222.0.20 () {58 vars in 1269 bytes} [Thu Oct 27 03:22:48 2022] GET /compute/v2.1/os-quota-sets/6abd257f3bfc49b99f90d15daeb01867/defaults => generated 371 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:22:49.153937 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-337ae6f3-1fff-4c1e-ae6d-6f018ff6cfbb tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1546 microversion: 2.91 time: 0.218890 Oct 27 03:22:49.155001 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 306/621] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:22:48 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1546 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:22:49.163391 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0a554ba2-917e-40b0-8f16-1611a9d0bbed tempest-SecurityGroupsTestAdminJSON-364027375 tempest-SecurityGroupsTestAdminJSON-364027375-project] Calling method '.version_select at 0x7f7ddada03a0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:49.164393 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ca110ef6-7d4a-41f1-89e7-ebbdb62c11ca tempest-KeyPairsV210TestJSON-576065568 tempest-KeyPairsV210TestJSON-576065568-project-admin] Calling method '.version_select at 0x7f7ddb3c0160>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:49.173383 n-d-862769-1 devstack@n-api.service[121000]: WARNING oslo_db.sqlalchemy.utils [None req-ca110ef6-7d4a-41f1-89e7-ebbdb62c11ca tempest-KeyPairsV210TestJSON-576065568 tempest-KeyPairsV210TestJSON-576065568-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Oct 27 03:22:49.213989 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ca110ef6-7d4a-41f1-89e7-ebbdb62c11ca tempest-KeyPairsV210TestJSON-576065568 tempest-KeyPairsV210TestJSON-576065568-project-admin] 10.222.0.20 "GET /compute/v2.1/os-keypairs?user_id=626d9f148fcd42208423d46ff1bd4488" status: 200 len: 725 microversion: 2.10 time: 0.060373 Oct 27 03:22:49.221023 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 316/622] 10.222.0.20 () {60 vars in 1259 bytes} [Thu Oct 27 03:22:49 2022] GET /compute/v2.1/os-keypairs?user_id=626d9f148fcd42208423d46ff1bd4488 => generated 725 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 03:22:49.230202 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-bac036d4-9227-449d-824d-46f04f200c47 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:49.232571 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-bac036d4-9227-449d-824d-46f04f200c47 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] [instance: 2d4fe59a-b31c-4fc0-8994-eb21e313d18a] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:49.245951 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bac036d4-9227-449d-824d-46f04f200c47 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:49.246546 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bac036d4-9227-449d-824d-46f04f200c47 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:49.247284 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bac036d4-9227-449d-824d-46f04f200c47 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:49.248021 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bac036d4-9227-449d-824d-46f04f200c47 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:49.249335 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bac036d4-9227-449d-824d-46f04f200c47 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:49.250343 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bac036d4-9227-449d-824d-46f04f200c47 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:49.465274 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-bac036d4-9227-449d-824d-46f04f200c47 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e23378ed283426cbff623265d9bbc96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f033d34ad44397bfda5cba4c041071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:49.478777 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-bac036d4-9227-449d-824d-46f04f200c47 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] 10.222.0.20 "GET /compute/v2.1/servers/2d4fe59a-b31c-4fc0-8994-eb21e313d18a" status: 200 len: 1387 microversion: 2.1 time: 0.256117 Oct 27 03:22:49.503212 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 317/623] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:49 2022] GET /compute/v2.1/servers/2d4fe59a-b31c-4fc0-8994-eb21e313d18a => generated 1387 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:22:49.509103 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-67a20e10-df90-4df3-ad39-02830de46591 tempest-KeyPairsV210TestJSON-576065568 tempest-KeyPairsV210TestJSON-576065568-project-admin] Calling method '.version_select at 0x7f7ddaeefdc0>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:49.646579 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-67a20e10-df90-4df3-ad39-02830de46591 tempest-KeyPairsV210TestJSON-576065568 tempest-KeyPairsV210TestJSON-576065568-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-85331269" status: 204 len: 0 microversion: 2.10 time: 0.142166 Oct 27 03:22:49.647175 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 318/624] 10.222.0.20 () {60 vars in 1319 bytes} [Thu Oct 27 03:22:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-85331269 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 03:22:49.652120 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0a554ba2-917e-40b0-8f16-1611a9d0bbed tempest-SecurityGroupsTestAdminJSON-364027375 tempest-SecurityGroupsTestAdminJSON-364027375-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/e8a90ba3-343b-4806-ad5b-d4bd86e4c181" status: 202 len: 0 microversion: 2.1 time: 0.495278 Oct 27 03:22:49.654425 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-bf3a12a0-59a0-43c1-88ae-efb078d25a5e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:49.655233 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-bf3a12a0-59a0-43c1-88ae-efb078d25a5e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: b2ef080f-30ca-4dc5-ba03-9cf1899346a4] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:49.657503 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 307/625] 10.222.0.20 () {58 vars in 1272 bytes} [Thu Oct 27 03:22:49 2022] DELETE /compute/v2.1/os-security-groups/e8a90ba3-343b-4806-ad5b-d4bd86e4c181 => generated 0 bytes in 502 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:22:49.663492 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bf3a12a0-59a0-43c1-88ae-efb078d25a5e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:49.664267 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bf3a12a0-59a0-43c1-88ae-efb078d25a5e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:49.664928 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bf3a12a0-59a0-43c1-88ae-efb078d25a5e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:49.665861 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bf3a12a0-59a0-43c1-88ae-efb078d25a5e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:49.666096 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-120bdfc0-4d68-4f9f-a841-9ee901db8172 req-9fa08f55-a99b-4c97-b269-06c9db3c8cf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d4fe59a-b31c-4fc0-8994-eb21e313d18a", "name": "network-vif-plugged", "status": "completed", "tag": "4fbcc2f0-a04c-48c8-a4da-059f29a4e11f"}, {"server_uuid": "b2ef080f-30ca-4dc5-ba03-9cf1899346a4", "name": "network-vif-plugged", "status": "completed", "tag": "7bd75d20-f08a-4aa0-b246-a0898c1313cc"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:22:49.666857 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bf3a12a0-59a0-43c1-88ae-efb078d25a5e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:49.667511 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bf3a12a0-59a0-43c1-88ae-efb078d25a5e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:49.692487 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-120bdfc0-4d68-4f9f-a841-9ee901db8172 req-9fa08f55-a99b-4c97-b269-06c9db3c8cf1 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:49.692487 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-120bdfc0-4d68-4f9f-a841-9ee901db8172 req-9fa08f55-a99b-4c97-b269-06c9db3c8cf1 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:49.692910 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-120bdfc0-4d68-4f9f-a841-9ee901db8172 req-9fa08f55-a99b-4c97-b269-06c9db3c8cf1 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:49.714475 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-120bdfc0-4d68-4f9f-a841-9ee901db8172 req-9fa08f55-a99b-4c97-b269-06c9db3c8cf1 service nova] Creating event network-vif-plugged:4fbcc2f0-a04c-48c8-a4da-059f29a4e11f for instance 2d4fe59a-b31c-4fc0-8994-eb21e313d18a on n-h1-862769-1 Oct 27 03:22:49.714992 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-120bdfc0-4d68-4f9f-a841-9ee901db8172 req-9fa08f55-a99b-4c97-b269-06c9db3c8cf1 service nova] Creating event network-vif-plugged:7bd75d20-f08a-4aa0-b246-a0898c1313cc for instance b2ef080f-30ca-4dc5-ba03-9cf1899346a4 on n-h2-862769-1 Oct 27 03:22:49.727217 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-120bdfc0-4d68-4f9f-a841-9ee901db8172 req-9fa08f55-a99b-4c97-b269-06c9db3c8cf1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.067393 Oct 27 03:22:49.727217 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 308/626] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:22:49 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:22:49.735909 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-940fb8e2-78a1-4040-bcdd-2a6b26fd4ac7 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:49.736823 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-940fb8e2-78a1-4040-bcdd-2a6b26fd4ac7 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: 1a733f7d-4f8d-4190-9795-937510f1a516] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:49.743763 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-940fb8e2-78a1-4040-bcdd-2a6b26fd4ac7 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:49.744266 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-940fb8e2-78a1-4040-bcdd-2a6b26fd4ac7 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:49.744688 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-940fb8e2-78a1-4040-bcdd-2a6b26fd4ac7 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:49.745391 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-940fb8e2-78a1-4040-bcdd-2a6b26fd4ac7 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:49.745840 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-940fb8e2-78a1-4040-bcdd-2a6b26fd4ac7 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:49.746504 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-940fb8e2-78a1-4040-bcdd-2a6b26fd4ac7 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:49.946876 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-bf3a12a0-59a0-43c1-88ae-efb078d25a5e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:49.970987 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-bf3a12a0-59a0-43c1-88ae-efb078d25a5e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4" status: 200 len: 1313 microversion: 2.1 time: 0.318510 Oct 27 03:22:49.971848 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 319/627] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:49 2022] GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4 => generated 1313 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:22:49.981974 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-83a9d5bd-4a52-4d42-a381-3d38a4eab573 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Action: 'update', calling method: .version_select at 0x7f7ddb43b790>, body: {"quota_set": {"ram": "5120"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:22:49.989466 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-940fb8e2-78a1-4040-bcdd-2a6b26fd4ac7 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:49.999519 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-940fb8e2-78a1-4040-bcdd-2a6b26fd4ac7 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/1a733f7d-4f8d-4190-9795-937510f1a516" status: 200 len: 1319 microversion: 2.1 time: 0.270442 Oct 27 03:22:50.000712 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 309/628] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:49 2022] GET /compute/v2.1/servers/1a733f7d-4f8d-4190-9795-937510f1a516 => generated 1319 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:22:50.006789 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-394eaaec-caaa-4ecc-bae4-eb3dca97f71b tempest-KeyPairsV210TestJSON-576065568 tempest-KeyPairsV210TestJSON-576065568-project-admin] Calling method '.version_select at 0x7f7ddb1daa60>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:50.071150 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:50.145224 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-394eaaec-caaa-4ecc-bae4-eb3dca97f71b tempest-KeyPairsV210TestJSON-576065568 tempest-KeyPairsV210TestJSON-576065568-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1050875797?user_id=626d9f148fcd42208423d46ff1bd4488" status: 204 len: 0 microversion: 2.10 time: 0.143206 Oct 27 03:22:50.149450 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 310/629] 10.222.0.20 () {60 vars in 1343 bytes} [Thu Oct 27 03:22:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1050875797?user_id=626d9f148fcd42208423d46ff1bd4488 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 03:22:50.160804 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e5a63ae9-f7d7-4fcb-a000-e5f5e55d4228 tempest-SecurityGroupsTestAdminJSON-364027375 tempest-SecurityGroupsTestAdminJSON-364027375-project] Calling method '.version_select at 0x7f7ddadba700>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:50.408723 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-83a9d5bd-4a52-4d42-a381-3d38a4eab573 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:50.408723 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-83a9d5bd-4a52-4d42-a381-3d38a4eab573 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:50.408723 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-83a9d5bd-4a52-4d42-a381-3d38a4eab573 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:50.408723 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-83a9d5bd-4a52-4d42-a381-3d38a4eab573 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:50.409861 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-83a9d5bd-4a52-4d42-a381-3d38a4eab573 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:50.409861 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-83a9d5bd-4a52-4d42-a381-3d38a4eab573 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:50.837081 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:50.855299 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-83a9d5bd-4a52-4d42-a381-3d38a4eab573 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/63736868eaed44c29dbf61eab697cbb8" status: 200 len: 328 microversion: 2.1 time: 0.882185 Oct 27 03:22:50.856437 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 320/630] 10.222.0.20 () {60 vars in 1262 bytes} [Thu Oct 27 03:22:49 2022] PUT /compute/v2.1/os-quota-sets/63736868eaed44c29dbf61eab697cbb8 => generated 328 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:22:50.862022 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-69074a94-4487-4699-92b4-d6aa8bfeb392 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:50.862756 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-69074a94-4487-4699-92b4-d6aa8bfeb392 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: da3360d3-ca0b-4077-af3e-92731700dada] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:50.872492 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-69074a94-4487-4699-92b4-d6aa8bfeb392 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:50.874092 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-69074a94-4487-4699-92b4-d6aa8bfeb392 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:50.876119 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-69074a94-4487-4699-92b4-d6aa8bfeb392 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:50.877098 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-69074a94-4487-4699-92b4-d6aa8bfeb392 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:50.877774 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-69074a94-4487-4699-92b4-d6aa8bfeb392 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:50.892077 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-69074a94-4487-4699-92b4-d6aa8bfeb392 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:51.049251 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e5a63ae9-f7d7-4fcb-a000-e5f5e55d4228 tempest-SecurityGroupsTestAdminJSON-364027375 tempest-SecurityGroupsTestAdminJSON-364027375-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/68e8d852-2adb-45bb-b644-6d72b5c24f49" status: 202 len: 0 microversion: 2.1 time: 0.898389 Oct 27 03:22:51.051316 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 311/631] 10.222.0.20 () {58 vars in 1272 bytes} [Thu Oct 27 03:22:50 2022] DELETE /compute/v2.1/os-security-groups/68e8d852-2adb-45bb-b644-6d72b5c24f49 => generated 0 bytes in 901 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:22:51.056578 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d2ae1576-c00e-4871-8757-2b65b36d3c25 tempest-KeyPairsV210TestJSON-576065568 tempest-KeyPairsV210TestJSON-576065568-project-admin] Calling method '.version_select at 0x7f7ddada0670>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:51.202181 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d2ae1576-c00e-4871-8757-2b65b36d3c25 tempest-KeyPairsV210TestJSON-576065568 tempest-KeyPairsV210TestJSON-576065568-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-517481909?user_id=626d9f148fcd42208423d46ff1bd4488" status: 204 len: 0 microversion: 2.10 time: 0.149416 Oct 27 03:22:51.204096 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-69074a94-4487-4699-92b4-d6aa8bfeb392 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:51.207751 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 312/632] 10.222.0.20 () {60 vars in 1340 bytes} [Thu Oct 27 03:22:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-517481909?user_id=626d9f148fcd42208423d46ff1bd4488 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 03:22:51.214750 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f2c9a73e-4de8-4d3d-a807-498f7b3d67f4 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:51.222420 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f2c9a73e-4de8-4d3d-a807-498f7b3d67f4 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:51.222564 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-69074a94-4487-4699-92b4-d6aa8bfeb392 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/da3360d3-ca0b-4077-af3e-92731700dada" status: 200 len: 1310 microversion: 2.1 time: 0.358440 Oct 27 03:22:51.222564 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 321/633] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:50 2022] GET /compute/v2.1/servers/da3360d3-ca0b-4077-af3e-92731700dada => generated 1310 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:22:51.224076 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b87a3b84-8bc9-4d8e-937d-9b88e53fbf14 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:51.225600 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b87a3b84-8bc9-4d8e-937d-9b88e53fbf14 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] [instance: 2d4fe59a-b31c-4fc0-8994-eb21e313d18a] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:51.229613 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f2c9a73e-4de8-4d3d-a807-498f7b3d67f4 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:51.230139 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f2c9a73e-4de8-4d3d-a807-498f7b3d67f4 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:51.231982 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f2c9a73e-4de8-4d3d-a807-498f7b3d67f4 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:51.233443 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b87a3b84-8bc9-4d8e-937d-9b88e53fbf14 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:51.234237 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b87a3b84-8bc9-4d8e-937d-9b88e53fbf14 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:51.234979 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f2c9a73e-4de8-4d3d-a807-498f7b3d67f4 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:51.235550 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b87a3b84-8bc9-4d8e-937d-9b88e53fbf14 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:51.236492 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b87a3b84-8bc9-4d8e-937d-9b88e53fbf14 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:51.236651 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f2c9a73e-4de8-4d3d-a807-498f7b3d67f4 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:51.237245 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b87a3b84-8bc9-4d8e-937d-9b88e53fbf14 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:51.237361 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f2c9a73e-4de8-4d3d-a807-498f7b3d67f4 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:51.238255 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b87a3b84-8bc9-4d8e-937d-9b88e53fbf14 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:51.334272 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f2c9a73e-4de8-4d3d-a807-498f7b3d67f4 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:51.342915 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f2c9a73e-4de8-4d3d-a807-498f7b3d67f4 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:51.344503 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f2c9a73e-4de8-4d3d-a807-498f7b3d67f4 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:51.349574 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f2c9a73e-4de8-4d3d-a807-498f7b3d67f4 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1546 microversion: 2.91 time: 0.140878 Oct 27 03:22:51.350183 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 313/634] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:22:51 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1546 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:22:51.354980 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-95d7d5ff-73f7-49f0-a85e-f4f1db58aed9 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Calling method '.version_select at 0x7f7ddb376af0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:51.396659 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b87a3b84-8bc9-4d8e-937d-9b88e53fbf14 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e23378ed283426cbff623265d9bbc96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f033d34ad44397bfda5cba4c041071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:51.405361 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b87a3b84-8bc9-4d8e-937d-9b88e53fbf14 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] 10.222.0.20 "GET /compute/v2.1/servers/2d4fe59a-b31c-4fc0-8994-eb21e313d18a" status: 200 len: 1387 microversion: 2.1 time: 0.186619 Oct 27 03:22:51.405940 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 322/635] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:51 2022] GET /compute/v2.1/servers/2d4fe59a-b31c-4fc0-8994-eb21e313d18a => generated 1387 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:22:51.410537 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-29cb8f82-9a0b-4e49-b47a-f6e2b2545703 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:51.411198 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-29cb8f82-9a0b-4e49-b47a-f6e2b2545703 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: b2ef080f-30ca-4dc5-ba03-9cf1899346a4] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:51.417088 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-29cb8f82-9a0b-4e49-b47a-f6e2b2545703 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:51.417666 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-29cb8f82-9a0b-4e49-b47a-f6e2b2545703 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:51.418158 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-29cb8f82-9a0b-4e49-b47a-f6e2b2545703 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:51.418896 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-29cb8f82-9a0b-4e49-b47a-f6e2b2545703 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:51.419485 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-29cb8f82-9a0b-4e49-b47a-f6e2b2545703 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:51.419924 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-29cb8f82-9a0b-4e49-b47a-f6e2b2545703 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:51.863236 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-29cb8f82-9a0b-4e49-b47a-f6e2b2545703 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:51.875023 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-29cb8f82-9a0b-4e49-b47a-f6e2b2545703 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4" status: 200 len: 1313 microversion: 2.1 time: 0.467575 Oct 27 03:22:51.876301 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 323/636] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:51 2022] GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4 => generated 1313 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:22:51.883518 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7d1c5162-89ae-47b0-b2fd-dbcf547515e6 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:51.883518 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7d1c5162-89ae-47b0-b2fd-dbcf547515e6 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: 1a733f7d-4f8d-4190-9795-937510f1a516] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:51.891778 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7d1c5162-89ae-47b0-b2fd-dbcf547515e6 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:51.892634 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7d1c5162-89ae-47b0-b2fd-dbcf547515e6 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:51.893505 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7d1c5162-89ae-47b0-b2fd-dbcf547515e6 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:51.894464 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7d1c5162-89ae-47b0-b2fd-dbcf547515e6 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:51.895151 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7d1c5162-89ae-47b0-b2fd-dbcf547515e6 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:51.895788 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7d1c5162-89ae-47b0-b2fd-dbcf547515e6 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:52.155485 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7d1c5162-89ae-47b0-b2fd-dbcf547515e6 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:52.166221 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-95d7d5ff-73f7-49f0-a85e-f4f1db58aed9 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:52.167168 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-95d7d5ff-73f7-49f0-a85e-f4f1db58aed9 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:52.167374 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-95d7d5ff-73f7-49f0-a85e-f4f1db58aed9 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:52.168331 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-95d7d5ff-73f7-49f0-a85e-f4f1db58aed9 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:52.168874 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-95d7d5ff-73f7-49f0-a85e-f4f1db58aed9 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:52.169314 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-95d7d5ff-73f7-49f0-a85e-f4f1db58aed9 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:52.171064 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7d1c5162-89ae-47b0-b2fd-dbcf547515e6 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/1a733f7d-4f8d-4190-9795-937510f1a516" status: 200 len: 1319 microversion: 2.1 time: 0.288028 Oct 27 03:22:52.172042 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 324/637] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:51 2022] GET /compute/v2.1/servers/1a733f7d-4f8d-4190-9795-937510f1a516 => generated 1319 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:22:52.182972 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-bb7c01e3-f17d-42f5-a23b-c1f93b42bed2 req-a1478fb7-6358-4f99-b65a-bda309ebb0d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a733f7d-4f8d-4190-9795-937510f1a516", "name": "network-vif-plugged", "status": "completed", "tag": "969d061b-4cd2-41dd-8d2b-52277a30b8ea"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:22:52.211551 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-bb7c01e3-f17d-42f5-a23b-c1f93b42bed2 req-a1478fb7-6358-4f99-b65a-bda309ebb0d2 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:52.212374 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-bb7c01e3-f17d-42f5-a23b-c1f93b42bed2 req-a1478fb7-6358-4f99-b65a-bda309ebb0d2 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:52.214565 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-bb7c01e3-f17d-42f5-a23b-c1f93b42bed2 req-a1478fb7-6358-4f99-b65a-bda309ebb0d2 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:52.232421 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=1,nova_api:DELETE=4 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:52.247847 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-95d7d5ff-73f7-49f0-a85e-f4f1db58aed9 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/63736868eaed44c29dbf61eab697cbb8/detail" status: 200 len: 916 microversion: 2.1 time: 0.893715 Oct 27 03:22:52.254097 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 314/638] 10.222.0.20 () {58 vars in 1263 bytes} [Thu Oct 27 03:22:51 2022] GET /compute/v2.1/os-quota-sets/63736868eaed44c29dbf61eab697cbb8/detail => generated 916 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:22:52.258247 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a0445f0f-6424-494a-90b4-672f66975aa7 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:52.259052 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a0445f0f-6424-494a-90b4-672f66975aa7 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: da3360d3-ca0b-4077-af3e-92731700dada] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:52.265989 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-bb7c01e3-f17d-42f5-a23b-c1f93b42bed2 req-a1478fb7-6358-4f99-b65a-bda309ebb0d2 service nova] Creating event network-vif-plugged:969d061b-4cd2-41dd-8d2b-52277a30b8ea for instance 1a733f7d-4f8d-4190-9795-937510f1a516 on n-h1-862769-1 Oct 27 03:22:52.268980 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a0445f0f-6424-494a-90b4-672f66975aa7 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:52.269487 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a0445f0f-6424-494a-90b4-672f66975aa7 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:52.269935 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a0445f0f-6424-494a-90b4-672f66975aa7 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:52.270978 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a0445f0f-6424-494a-90b4-672f66975aa7 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:52.271609 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a0445f0f-6424-494a-90b4-672f66975aa7 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:52.272204 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a0445f0f-6424-494a-90b4-672f66975aa7 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:52.292659 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-bb7c01e3-f17d-42f5-a23b-c1f93b42bed2 req-a1478fb7-6358-4f99-b65a-bda309ebb0d2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118201 Oct 27 03:22:52.297079 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 325/639] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:22:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:22:52.379995 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-00cc0ef0-e62b-48d5-adc8-808d55aa2323 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:52.381174 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-00cc0ef0-e62b-48d5-adc8-808d55aa2323 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:52.390362 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-00cc0ef0-e62b-48d5-adc8-808d55aa2323 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:52.391800 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-00cc0ef0-e62b-48d5-adc8-808d55aa2323 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:52.392439 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-00cc0ef0-e62b-48d5-adc8-808d55aa2323 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:52.394565 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-00cc0ef0-e62b-48d5-adc8-808d55aa2323 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:52.395200 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-00cc0ef0-e62b-48d5-adc8-808d55aa2323 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:52.395890 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-00cc0ef0-e62b-48d5-adc8-808d55aa2323 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:52.497890 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-00cc0ef0-e62b-48d5-adc8-808d55aa2323 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:52.510543 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-00cc0ef0-e62b-48d5-adc8-808d55aa2323 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:52.512066 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-00cc0ef0-e62b-48d5-adc8-808d55aa2323 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:52.518220 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-00cc0ef0-e62b-48d5-adc8-808d55aa2323 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1546 microversion: 2.91 time: 0.143252 Oct 27 03:22:52.519437 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 326/640] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:22:52 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1546 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:22:52.526745 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-df608705-ab6b-43e3-aceb-a4ece271a83e tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:52.527936 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-df608705-ab6b-43e3-aceb-a4ece271a83e tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] [instance: 2d4fe59a-b31c-4fc0-8994-eb21e313d18a] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:52.535451 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-df608705-ab6b-43e3-aceb-a4ece271a83e tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:52.535937 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-df608705-ab6b-43e3-aceb-a4ece271a83e tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:52.536565 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-df608705-ab6b-43e3-aceb-a4ece271a83e tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:52.537256 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-df608705-ab6b-43e3-aceb-a4ece271a83e tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:52.537714 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-df608705-ab6b-43e3-aceb-a4ece271a83e tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:52.538177 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-df608705-ab6b-43e3-aceb-a4ece271a83e tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:52.542560 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a0445f0f-6424-494a-90b4-672f66975aa7 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:52.552794 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a0445f0f-6424-494a-90b4-672f66975aa7 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/da3360d3-ca0b-4077-af3e-92731700dada" status: 200 len: 1310 microversion: 2.1 time: 0.301097 Oct 27 03:22:52.578856 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 315/641] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:52 2022] GET /compute/v2.1/servers/da3360d3-ca0b-4077-af3e-92731700dada => generated 1310 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:22:52.689348 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1b5e1e62-6388-4881-8a5d-a4b176aac23c tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Action: 'update', calling method: .version_select at 0x7f7ddaf73b80>, body: {"quota_set": {"ram": "2048"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:22:52.790902 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1b5e1e62-6388-4881-8a5d-a4b176aac23c tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:52.791408 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1b5e1e62-6388-4881-8a5d-a4b176aac23c tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:52.792672 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1b5e1e62-6388-4881-8a5d-a4b176aac23c tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:52.794481 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1b5e1e62-6388-4881-8a5d-a4b176aac23c tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:52.794962 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1b5e1e62-6388-4881-8a5d-a4b176aac23c tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:52.800828 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1b5e1e62-6388-4881-8a5d-a4b176aac23c tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:52.885325 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1b5e1e62-6388-4881-8a5d-a4b176aac23c tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:52.886701 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1b5e1e62-6388-4881-8a5d-a4b176aac23c tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:52.888064 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1b5e1e62-6388-4881-8a5d-a4b176aac23c tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:52.890900 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1b5e1e62-6388-4881-8a5d-a4b176aac23c tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:52.892565 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1b5e1e62-6388-4881-8a5d-a4b176aac23c tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:52.893664 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-df608705-ab6b-43e3-aceb-a4ece271a83e tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e23378ed283426cbff623265d9bbc96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f033d34ad44397bfda5cba4c041071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:52.894196 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1b5e1e62-6388-4881-8a5d-a4b176aac23c tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:52.913139 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-df608705-ab6b-43e3-aceb-a4ece271a83e tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] 10.222.0.20 "GET /compute/v2.1/servers/2d4fe59a-b31c-4fc0-8994-eb21e313d18a" status: 200 len: 1387 microversion: 2.1 time: 0.391272 Oct 27 03:22:52.915899 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 327/642] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:52 2022] GET /compute/v2.1/servers/2d4fe59a-b31c-4fc0-8994-eb21e313d18a => generated 1387 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:22:52.934810 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-abe2ca3b-a886-4826-81b6-801058e7e040 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:52.937564 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-abe2ca3b-a886-4826-81b6-801058e7e040 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: b2ef080f-30ca-4dc5-ba03-9cf1899346a4] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:52.947806 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-abe2ca3b-a886-4826-81b6-801058e7e040 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:52.949137 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-abe2ca3b-a886-4826-81b6-801058e7e040 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:52.950013 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-abe2ca3b-a886-4826-81b6-801058e7e040 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:52.952474 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-abe2ca3b-a886-4826-81b6-801058e7e040 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:52.952474 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-abe2ca3b-a886-4826-81b6-801058e7e040 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:52.963890 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-abe2ca3b-a886-4826-81b6-801058e7e040 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:53.106492 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1b5e1e62-6388-4881-8a5d-a4b176aac23c tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/63736868eaed44c29dbf61eab697cbb8?user_id=e6536ab1b86946e996047dc6d0ba107f" status: 200 len: 328 microversion: 2.1 time: 0.409120 Oct 27 03:22:53.106492 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 316/643] 10.222.0.20 () {60 vars in 1343 bytes} [Thu Oct 27 03:22:52 2022] PUT /compute/v2.1/os-quota-sets/63736868eaed44c29dbf61eab697cbb8?user_id=e6536ab1b86946e996047dc6d0ba107f => generated 328 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:22:53.117993 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-02a51c09-52c6-4850-af87-d617c980bbe0 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Calling method '.version_select at 0x7f7ddae87790>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:53.281217 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-02a51c09-52c6-4850-af87-d617c980bbe0 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/63736868eaed44c29dbf61eab697cbb8?user_id=e6536ab1b86946e996047dc6d0ba107f" status: 200 len: 370 microversion: 2.1 time: 0.169996 Oct 27 03:22:53.289554 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 317/644] 10.222.0.20 () {58 vars in 1323 bytes} [Thu Oct 27 03:22:53 2022] GET /compute/v2.1/os-quota-sets/63736868eaed44c29dbf61eab697cbb8?user_id=e6536ab1b86946e996047dc6d0ba107f => generated 370 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:22:53.301847 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a92ec01d-901b-445a-b950-90e4dbcc0151 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:53.302657 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a92ec01d-901b-445a-b950-90e4dbcc0151 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: 1a733f7d-4f8d-4190-9795-937510f1a516] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:53.314652 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a92ec01d-901b-445a-b950-90e4dbcc0151 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:53.318995 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a92ec01d-901b-445a-b950-90e4dbcc0151 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:53.320836 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a92ec01d-901b-445a-b950-90e4dbcc0151 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:53.322665 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a92ec01d-901b-445a-b950-90e4dbcc0151 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:53.325706 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a92ec01d-901b-445a-b950-90e4dbcc0151 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:53.326390 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a92ec01d-901b-445a-b950-90e4dbcc0151 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:53.372348 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-abe2ca3b-a886-4826-81b6-801058e7e040 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:53.375483 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=100 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:53.386736 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-abe2ca3b-a886-4826-81b6-801058e7e040 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4" status: 200 len: 1463 microversion: 2.1 time: 0.468526 Oct 27 03:22:53.398618 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 328/645] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:52 2022] GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4 => generated 1463 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:22:53.421108 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2fe3df47-ead6-4c05-be52-e0cdbf3d57f6 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:22:53.423670 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-2fe3df47-ead6-4c05-be52-e0cdbf3d57f6 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: b2ef080f-30ca-4dc5-ba03-9cf1899346a4] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:53.444341 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2fe3df47-ead6-4c05-be52-e0cdbf3d57f6 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:53.445397 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2fe3df47-ead6-4c05-be52-e0cdbf3d57f6 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:53.446271 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2fe3df47-ead6-4c05-be52-e0cdbf3d57f6 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:53.447378 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2fe3df47-ead6-4c05-be52-e0cdbf3d57f6 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:53.448083 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2fe3df47-ead6-4c05-be52-e0cdbf3d57f6 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:53.448709 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2fe3df47-ead6-4c05-be52-e0cdbf3d57f6 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:53.648501 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a92ec01d-901b-445a-b950-90e4dbcc0151 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:53.658276 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a92ec01d-901b-445a-b950-90e4dbcc0151 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/1a733f7d-4f8d-4190-9795-937510f1a516" status: 200 len: 1319 microversion: 2.1 time: 0.374575 Oct 27 03:22:53.672848 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 318/646] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:53 2022] GET /compute/v2.1/servers/1a733f7d-4f8d-4190-9795-937510f1a516 => generated 1319 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:22:53.682264 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2fe3df47-ead6-4c05-be52-e0cdbf3d57f6 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:53.682801 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a7361d2c-48e5-4e2b-8812-bf4dc91ca92b tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:53.683404 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a7361d2c-48e5-4e2b-8812-bf4dc91ca92b tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:53.690630 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a7361d2c-48e5-4e2b-8812-bf4dc91ca92b tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:53.691122 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a7361d2c-48e5-4e2b-8812-bf4dc91ca92b tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:53.691635 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a7361d2c-48e5-4e2b-8812-bf4dc91ca92b tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:53.691920 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-2fe3df47-ead6-4c05-be52-e0cdbf3d57f6 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: b2ef080f-30ca-4dc5-ba03-9cf1899346a4] Old instance type m1.heat2, new instance type m1.heat {{(pid=121000) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 27 03:22:53.692502 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a7361d2c-48e5-4e2b-8812-bf4dc91ca92b tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:53.693267 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a7361d2c-48e5-4e2b-8812-bf4dc91ca92b tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:53.693772 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a7361d2c-48e5-4e2b-8812-bf4dc91ca92b tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:53.701017 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-2fe3df47-ead6-4c05-be52-e0cdbf3d57f6 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:22:53.701557 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-2fe3df47-ead6-4c05-be52-e0cdbf3d57f6 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:22:53.702345 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-2fe3df47-ead6-4c05-be52-e0cdbf3d57f6 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:22:53.702784 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-2fe3df47-ead6-4c05-be52-e0cdbf3d57f6 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:22:53.703244 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-2fe3df47-ead6-4c05-be52-e0cdbf3d57f6 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:22:53.818144 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a7361d2c-48e5-4e2b-8812-bf4dc91ca92b tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:53.829520 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a7361d2c-48e5-4e2b-8812-bf4dc91ca92b tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:53.831444 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a7361d2c-48e5-4e2b-8812-bf4dc91ca92b tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:53.838193 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a7361d2c-48e5-4e2b-8812-bf4dc91ca92b tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1546 microversion: 2.91 time: 0.163919 Oct 27 03:22:53.839402 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 319/647] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:22:53 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1546 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:22:53.851375 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e92cfcde-30a3-4efe-b8f5-c9e68f173f43 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:53.859229 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e92cfcde-30a3-4efe-b8f5-c9e68f173f43 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: da3360d3-ca0b-4077-af3e-92731700dada] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:53.868098 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e92cfcde-30a3-4efe-b8f5-c9e68f173f43 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:53.869001 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e92cfcde-30a3-4efe-b8f5-c9e68f173f43 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:53.869879 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e92cfcde-30a3-4efe-b8f5-c9e68f173f43 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:53.871182 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e92cfcde-30a3-4efe-b8f5-c9e68f173f43 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:53.872011 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e92cfcde-30a3-4efe-b8f5-c9e68f173f43 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:53.872842 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e92cfcde-30a3-4efe-b8f5-c9e68f173f43 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:54.063829 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2fe3df47-ead6-4c05-be52-e0cdbf3d57f6 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "POST /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4/action" status: 202 len: 0 microversion: 2.1 time: 0.643989 Oct 27 03:22:54.074329 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 329/648] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:22:53 2022] POST /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4/action => generated 0 bytes in 658 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 03:22:54.086717 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e8a45dd6-eb7c-4d13-b57a-b0b99150adb9 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:54.086878 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e8a45dd6-eb7c-4d13-b57a-b0b99150adb9 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] [instance: 2d4fe59a-b31c-4fc0-8994-eb21e313d18a] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:54.100482 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e8a45dd6-eb7c-4d13-b57a-b0b99150adb9 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:54.101137 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e8a45dd6-eb7c-4d13-b57a-b0b99150adb9 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:54.102129 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e8a45dd6-eb7c-4d13-b57a-b0b99150adb9 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:54.102925 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e8a45dd6-eb7c-4d13-b57a-b0b99150adb9 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:54.103663 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e8a45dd6-eb7c-4d13-b57a-b0b99150adb9 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:54.104109 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e8a45dd6-eb7c-4d13-b57a-b0b99150adb9 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:54.108274 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e92cfcde-30a3-4efe-b8f5-c9e68f173f43 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:54.120110 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e92cfcde-30a3-4efe-b8f5-c9e68f173f43 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/da3360d3-ca0b-4077-af3e-92731700dada" status: 200 len: 1310 microversion: 2.1 time: 0.272686 Oct 27 03:22:54.123985 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 320/649] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:53 2022] GET /compute/v2.1/servers/da3360d3-ca0b-4077-af3e-92731700dada => generated 1310 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:22:54.136823 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-265a720f-a23c-4008-9b06-9d656bca2269 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:54.151906 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-265a720f-a23c-4008-9b06-9d656bca2269 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: b2ef080f-30ca-4dc5-ba03-9cf1899346a4] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:54.170553 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-265a720f-a23c-4008-9b06-9d656bca2269 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:54.176934 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-265a720f-a23c-4008-9b06-9d656bca2269 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:54.177674 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-265a720f-a23c-4008-9b06-9d656bca2269 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:54.180475 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-265a720f-a23c-4008-9b06-9d656bca2269 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:54.182461 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-265a720f-a23c-4008-9b06-9d656bca2269 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:54.183257 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-265a720f-a23c-4008-9b06-9d656bca2269 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:54.526573 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e8a45dd6-eb7c-4d13-b57a-b0b99150adb9 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e23378ed283426cbff623265d9bbc96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f033d34ad44397bfda5cba4c041071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:54.538832 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e8a45dd6-eb7c-4d13-b57a-b0b99150adb9 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] 10.222.0.20 "GET /compute/v2.1/servers/2d4fe59a-b31c-4fc0-8994-eb21e313d18a" status: 200 len: 1586 microversion: 2.1 time: 0.461460 Oct 27 03:22:54.556222 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-265a720f-a23c-4008-9b06-9d656bca2269 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:54.556222 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-265a720f-a23c-4008-9b06-9d656bca2269 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4" status: 200 len: 1472 microversion: 2.1 time: 0.422881 Oct 27 03:22:54.556222 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 321/650] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:54 2022] GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4 => generated 1472 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:22:54.567750 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 330/651] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:54 2022] GET /compute/v2.1/servers/2d4fe59a-b31c-4fc0-8994-eb21e313d18a => generated 1586 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:22:54.575449 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-d9442120-920a-4e7f-a698-edab90348fe0 req-e8effd28-2fcd-4acf-914d-ec6b45e8f317 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da3360d3-ca0b-4077-af3e-92731700dada", "name": "network-vif-plugged", "status": "completed", "tag": "83172e3e-d564-4455-bfff-b4d4868ccf0d"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:22:54.579778 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b33580d4-446d-4edc-9e6c-fa7d61b5bc81 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:54.592761 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b33580d4-446d-4edc-9e6c-fa7d61b5bc81 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] [instance: 2d4fe59a-b31c-4fc0-8994-eb21e313d18a] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:54.609427 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-d9442120-920a-4e7f-a698-edab90348fe0 req-e8effd28-2fcd-4acf-914d-ec6b45e8f317 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:54.609716 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b33580d4-446d-4edc-9e6c-fa7d61b5bc81 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:54.612160 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b33580d4-446d-4edc-9e6c-fa7d61b5bc81 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:54.612721 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b33580d4-446d-4edc-9e6c-fa7d61b5bc81 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:54.613536 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b33580d4-446d-4edc-9e6c-fa7d61b5bc81 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:54.614273 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-d9442120-920a-4e7f-a698-edab90348fe0 req-e8effd28-2fcd-4acf-914d-ec6b45e8f317 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:54.615046 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-d9442120-920a-4e7f-a698-edab90348fe0 req-e8effd28-2fcd-4acf-914d-ec6b45e8f317 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:54.616415 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b33580d4-446d-4edc-9e6c-fa7d61b5bc81 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:54.632360 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b33580d4-446d-4edc-9e6c-fa7d61b5bc81 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:54.640333 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-d9442120-920a-4e7f-a698-edab90348fe0 req-e8effd28-2fcd-4acf-914d-ec6b45e8f317 service nova] Creating event network-vif-plugged:83172e3e-d564-4455-bfff-b4d4868ccf0d for instance da3360d3-ca0b-4077-af3e-92731700dada on n-h2-862769-1 Oct 27 03:22:54.667980 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-d9442120-920a-4e7f-a698-edab90348fe0 req-e8effd28-2fcd-4acf-914d-ec6b45e8f317 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112980 Oct 27 03:22:54.671247 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 322/652] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:22:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:22:54.687702 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5122d49c-3daa-436c-b007-4793edefddc7 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:54.689988 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5122d49c-3daa-436c-b007-4793edefddc7 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: 1a733f7d-4f8d-4190-9795-937510f1a516] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:54.728098 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5122d49c-3daa-436c-b007-4793edefddc7 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:54.728867 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5122d49c-3daa-436c-b007-4793edefddc7 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:54.729497 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5122d49c-3daa-436c-b007-4793edefddc7 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:54.730472 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5122d49c-3daa-436c-b007-4793edefddc7 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:54.731209 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5122d49c-3daa-436c-b007-4793edefddc7 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:54.731814 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5122d49c-3daa-436c-b007-4793edefddc7 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:54.983360 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5122d49c-3daa-436c-b007-4793edefddc7 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:54.992719 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5122d49c-3daa-436c-b007-4793edefddc7 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/1a733f7d-4f8d-4190-9795-937510f1a516" status: 200 len: 1319 microversion: 2.1 time: 0.311405 Oct 27 03:22:55.002132 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 323/653] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:54 2022] GET /compute/v2.1/servers/1a733f7d-4f8d-4190-9795-937510f1a516 => generated 1319 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:22:55.002132 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7190baec-8908-4ded-ba77-bfe8b19414ff tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Calling method '.version_select at 0x7f7ddb5dbaf0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:55.019990 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b33580d4-446d-4edc-9e6c-fa7d61b5bc81 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] 10.222.0.20 "GET /compute/v2.1/servers/2d4fe59a-b31c-4fc0-8994-eb21e313d18a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.444298 Oct 27 03:22:55.019990 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 331/654] 10.222.0.20 () {58 vars in 1275 bytes} [Thu Oct 27 03:22:54 2022] GET /compute/v2.1/servers/2d4fe59a-b31c-4fc0-8994-eb21e313d18a/os-interface => generated 284 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:22:55.032031 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c0c1e1fc-cd8c-4b92-98ca-dbf015621d23 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:55.033067 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c0c1e1fc-cd8c-4b92-98ca-dbf015621d23 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:55.042326 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c0c1e1fc-cd8c-4b92-98ca-dbf015621d23 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:55.042996 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c0c1e1fc-cd8c-4b92-98ca-dbf015621d23 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:55.043854 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c0c1e1fc-cd8c-4b92-98ca-dbf015621d23 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:55.044974 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c0c1e1fc-cd8c-4b92-98ca-dbf015621d23 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:55.046268 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c0c1e1fc-cd8c-4b92-98ca-dbf015621d23 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:55.046854 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c0c1e1fc-cd8c-4b92-98ca-dbf015621d23 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:55.191067 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c0c1e1fc-cd8c-4b92-98ca-dbf015621d23 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:55.207411 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c0c1e1fc-cd8c-4b92-98ca-dbf015621d23 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:55.209161 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c0c1e1fc-cd8c-4b92-98ca-dbf015621d23 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:55.218730 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c0c1e1fc-cd8c-4b92-98ca-dbf015621d23 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1546 microversion: 2.91 time: 0.197205 Oct 27 03:22:55.242396 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 332/655] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:22:55 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1546 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:22:55.256453 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-57e23fd8-7c4c-454b-a2ae-6dad6f6e9ebd tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:55.257489 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-57e23fd8-7c4c-454b-a2ae-6dad6f6e9ebd tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: da3360d3-ca0b-4077-af3e-92731700dada] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:55.268657 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-57e23fd8-7c4c-454b-a2ae-6dad6f6e9ebd tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:55.269319 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-57e23fd8-7c4c-454b-a2ae-6dad6f6e9ebd tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:55.270113 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-57e23fd8-7c4c-454b-a2ae-6dad6f6e9ebd tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:55.272241 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-57e23fd8-7c4c-454b-a2ae-6dad6f6e9ebd tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:55.273291 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-57e23fd8-7c4c-454b-a2ae-6dad6f6e9ebd tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:55.274469 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-57e23fd8-7c4c-454b-a2ae-6dad6f6e9ebd tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:55.402371 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7190baec-8908-4ded-ba77-bfe8b19414ff tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/6abd257f3bfc49b99f90d15daeb01867/defaults" status: 200 len: 371 microversion: 2.1 time: 0.407394 Oct 27 03:22:55.403150 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 324/656] 10.222.0.20 () {58 vars in 1269 bytes} [Thu Oct 27 03:22:54 2022] GET /compute/v2.1/os-quota-sets/6abd257f3bfc49b99f90d15daeb01867/defaults => generated 371 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:22:55.416186 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1a894944-472a-475a-a77f-a0711d5c1526 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Action: 'update', calling method: .version_select at 0x7f7ddb641ca0>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:22:55.562189 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-57e23fd8-7c4c-454b-a2ae-6dad6f6e9ebd tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:55.572097 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-57e23fd8-7c4c-454b-a2ae-6dad6f6e9ebd tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/da3360d3-ca0b-4077-af3e-92731700dada" status: 200 len: 1310 microversion: 2.1 time: 0.327984 Oct 27 03:22:55.576005 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 333/657] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:55 2022] GET /compute/v2.1/servers/da3360d3-ca0b-4077-af3e-92731700dada => generated 1310 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:22:55.584289 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d42c16ba-f483-4b2c-9276-65d5ad081eaf tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:55.586809 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d42c16ba-f483-4b2c-9276-65d5ad081eaf tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: b2ef080f-30ca-4dc5-ba03-9cf1899346a4] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:55.608005 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d42c16ba-f483-4b2c-9276-65d5ad081eaf tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:55.609073 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d42c16ba-f483-4b2c-9276-65d5ad081eaf tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:55.609713 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d42c16ba-f483-4b2c-9276-65d5ad081eaf tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:55.610680 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d42c16ba-f483-4b2c-9276-65d5ad081eaf tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:55.611328 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d42c16ba-f483-4b2c-9276-65d5ad081eaf tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:55.613973 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d42c16ba-f483-4b2c-9276-65d5ad081eaf tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:55.647567 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1a894944-472a-475a-a77f-a0711d5c1526 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:55.651151 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1a894944-472a-475a-a77f-a0711d5c1526 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:55.652551 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1a894944-472a-475a-a77f-a0711d5c1526 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:55.654154 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1a894944-472a-475a-a77f-a0711d5c1526 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:55.656034 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1a894944-472a-475a-a77f-a0711d5c1526 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:55.657295 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1a894944-472a-475a-a77f-a0711d5c1526 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:55.927760 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d42c16ba-f483-4b2c-9276-65d5ad081eaf tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:55.941959 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d42c16ba-f483-4b2c-9276-65d5ad081eaf tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4" status: 200 len: 1472 microversion: 2.1 time: 0.363990 Oct 27 03:22:55.942901 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 334/658] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:55 2022] GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4 => generated 1472 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:22:56.038340 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5eaa6d7e-79b0-4b33-bc13-5f3610d2746e tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:56.042506 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5eaa6d7e-79b0-4b33-bc13-5f3610d2746e tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: 1a733f7d-4f8d-4190-9795-937510f1a516] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:56.049123 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5eaa6d7e-79b0-4b33-bc13-5f3610d2746e tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:56.049927 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5eaa6d7e-79b0-4b33-bc13-5f3610d2746e tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:56.050547 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5eaa6d7e-79b0-4b33-bc13-5f3610d2746e tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:56.051431 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5eaa6d7e-79b0-4b33-bc13-5f3610d2746e tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:56.052042 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5eaa6d7e-79b0-4b33-bc13-5f3610d2746e tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:56.052642 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5eaa6d7e-79b0-4b33-bc13-5f3610d2746e tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:56.389140 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5eaa6d7e-79b0-4b33-bc13-5f3610d2746e tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:56.401252 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5eaa6d7e-79b0-4b33-bc13-5f3610d2746e tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/1a733f7d-4f8d-4190-9795-937510f1a516" status: 200 len: 1319 microversion: 2.1 time: 0.366459 Oct 27 03:22:56.402427 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 335/659] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:56 2022] GET /compute/v2.1/servers/1a733f7d-4f8d-4190-9795-937510f1a516 => generated 1319 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:22:56.412632 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-36d1737d-7e7b-4d4f-9777-b17f6e87ace0 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:56.413756 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-36d1737d-7e7b-4d4f-9777-b17f6e87ace0 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:56.439007 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-36d1737d-7e7b-4d4f-9777-b17f6e87ace0 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:56.439775 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-36d1737d-7e7b-4d4f-9777-b17f6e87ace0 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:56.443438 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-36d1737d-7e7b-4d4f-9777-b17f6e87ace0 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:56.444556 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-36d1737d-7e7b-4d4f-9777-b17f6e87ace0 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:56.447110 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-36d1737d-7e7b-4d4f-9777-b17f6e87ace0 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:56.447831 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-36d1737d-7e7b-4d4f-9777-b17f6e87ace0 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:56.620820 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-36d1737d-7e7b-4d4f-9777-b17f6e87ace0 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:56.635354 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-36d1737d-7e7b-4d4f-9777-b17f6e87ace0 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:56.658189 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-36d1737d-7e7b-4d4f-9777-b17f6e87ace0 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:56.658189 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-36d1737d-7e7b-4d4f-9777-b17f6e87ace0 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1546 microversion: 2.91 time: 0.241543 Oct 27 03:22:56.658189 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 336/660] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:22:56 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1546 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:22:56.658189 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ebdfcb89-bb89-4cf7-99a7-9774490973f7 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:56.658715 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ebdfcb89-bb89-4cf7-99a7-9774490973f7 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: da3360d3-ca0b-4077-af3e-92731700dada] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:56.659310 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ebdfcb89-bb89-4cf7-99a7-9774490973f7 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:56.660214 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ebdfcb89-bb89-4cf7-99a7-9774490973f7 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:56.660916 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ebdfcb89-bb89-4cf7-99a7-9774490973f7 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:56.661909 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ebdfcb89-bb89-4cf7-99a7-9774490973f7 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:56.662631 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ebdfcb89-bb89-4cf7-99a7-9774490973f7 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:56.663446 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ebdfcb89-bb89-4cf7-99a7-9774490973f7 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:56.950801 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ebdfcb89-bb89-4cf7-99a7-9774490973f7 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:56.960481 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ebdfcb89-bb89-4cf7-99a7-9774490973f7 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/da3360d3-ca0b-4077-af3e-92731700dada" status: 200 len: 1493 microversion: 2.1 time: 0.312994 Oct 27 03:22:56.975581 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 337/661] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:56 2022] GET /compute/v2.1/servers/da3360d3-ca0b-4077-af3e-92731700dada => generated 1493 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:22:57.002956 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6cb994d2-a1e2-45c6-9952-12ebe9d564f7 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:57.007723 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6cb994d2-a1e2-45c6-9952-12ebe9d564f7 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: b2ef080f-30ca-4dc5-ba03-9cf1899346a4] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:57.010920 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6cb994d2-a1e2-45c6-9952-12ebe9d564f7 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:57.011504 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6cb994d2-a1e2-45c6-9952-12ebe9d564f7 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:57.021334 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6cb994d2-a1e2-45c6-9952-12ebe9d564f7 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:57.022394 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6cb994d2-a1e2-45c6-9952-12ebe9d564f7 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:57.023150 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6cb994d2-a1e2-45c6-9952-12ebe9d564f7 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:57.024139 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6cb994d2-a1e2-45c6-9952-12ebe9d564f7 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:57.157632 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1a894944-472a-475a-a77f-a0711d5c1526 tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/6abd257f3bfc49b99f90d15daeb01867" status: 200 len: 329 microversion: 2.1 time: 1.745390 Oct 27 03:22:57.169810 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 325/662] 10.222.0.20 () {60 vars in 1263 bytes} [Thu Oct 27 03:22:55 2022] PUT /compute/v2.1/os-quota-sets/6abd257f3bfc49b99f90d15daeb01867 => generated 329 bytes in 1756 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:22:57.314680 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-6cb994d2-a1e2-45c6-9952-12ebe9d564f7 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:57.348698 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6cb994d2-a1e2-45c6-9952-12ebe9d564f7 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4" status: 200 len: 1472 microversion: 2.1 time: 0.371677 Oct 27 03:22:57.353468 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 338/663] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:56 2022] GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4 => generated 1472 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:22:57.369222 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1c14fc51-8fde-41d1-b4a3-4a7c72b1fdbf tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Action: 'update', calling method: .version_select at 0x7f7ddae66ee0>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:22:57.769943 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2518f448-5b3e-4d92-819c-f1ebf96812de tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:57.770610 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2518f448-5b3e-4d92-819c-f1ebf96812de tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] [instance: da3360d3-ca0b-4077-af3e-92731700dada] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:57.777782 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2518f448-5b3e-4d92-819c-f1ebf96812de tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:57.779419 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2518f448-5b3e-4d92-819c-f1ebf96812de tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:57.793512 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2518f448-5b3e-4d92-819c-f1ebf96812de tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:57.798231 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2518f448-5b3e-4d92-819c-f1ebf96812de tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:57.801280 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2518f448-5b3e-4d92-819c-f1ebf96812de tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:57.804425 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2518f448-5b3e-4d92-819c-f1ebf96812de tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:58.067586 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2518f448-5b3e-4d92-819c-f1ebf96812de tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/da3360d3-ca0b-4077-af3e-92731700dada" status: 200 len: 1644 microversion: 2.1 time: 0.898821 Oct 27 03:22:58.068784 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 326/664] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:57 2022] GET /compute/v2.1/servers/da3360d3-ca0b-4077-af3e-92731700dada => generated 1644 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:22:58.073949 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-50705867-f625-4a29-b75f-9238c54601fb tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:58.076719 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-50705867-f625-4a29-b75f-9238c54601fb tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: 1a733f7d-4f8d-4190-9795-937510f1a516] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:58.081534 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-50705867-f625-4a29-b75f-9238c54601fb tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:58.083180 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-50705867-f625-4a29-b75f-9238c54601fb tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:58.083828 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-50705867-f625-4a29-b75f-9238c54601fb tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:58.084760 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-50705867-f625-4a29-b75f-9238c54601fb tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:58.085576 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-50705867-f625-4a29-b75f-9238c54601fb tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:58.086227 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-50705867-f625-4a29-b75f-9238c54601fb tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:58.177553 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1c14fc51-8fde-41d1-b4a3-4a7c72b1fdbf tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:58.179954 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1c14fc51-8fde-41d1-b4a3-4a7c72b1fdbf tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:58.180434 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1c14fc51-8fde-41d1-b4a3-4a7c72b1fdbf tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:58.182809 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1c14fc51-8fde-41d1-b4a3-4a7c72b1fdbf tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:58.196205 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1c14fc51-8fde-41d1-b4a3-4a7c72b1fdbf tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:58.196769 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1c14fc51-8fde-41d1-b4a3-4a7c72b1fdbf tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:58.619192 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-50705867-f625-4a29-b75f-9238c54601fb tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:58.634773 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-50705867-f625-4a29-b75f-9238c54601fb tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/1a733f7d-4f8d-4190-9795-937510f1a516" status: 200 len: 1468 microversion: 2.1 time: 0.564589 Oct 27 03:22:58.635861 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 327/665] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:58 2022] GET /compute/v2.1/servers/1a733f7d-4f8d-4190-9795-937510f1a516 => generated 1468 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:22:58.642284 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-05a8483e-ebb6-4b5f-8951-a4274529d920 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:58.643959 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-05a8483e-ebb6-4b5f-8951-a4274529d920 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] [instance: 2d4fe59a-b31c-4fc0-8994-eb21e313d18a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:58.653330 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-05a8483e-ebb6-4b5f-8951-a4274529d920 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:58.654487 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-05a8483e-ebb6-4b5f-8951-a4274529d920 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:58.655627 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-05a8483e-ebb6-4b5f-8951-a4274529d920 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:58.656425 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-05a8483e-ebb6-4b5f-8951-a4274529d920 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:58.656958 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-05a8483e-ebb6-4b5f-8951-a4274529d920 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:58.658254 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-05a8483e-ebb6-4b5f-8951-a4274529d920 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:58.919200 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-05a8483e-ebb6-4b5f-8951-a4274529d920 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e23378ed283426cbff623265d9bbc96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f033d34ad44397bfda5cba4c041071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:58.925028 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-05a8483e-ebb6-4b5f-8951-a4274529d920 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] 10.222.0.20 "GET /compute/v2.1/servers/2d4fe59a-b31c-4fc0-8994-eb21e313d18a" status: 200 len: 1586 microversion: 2.1 time: 0.287896 Oct 27 03:22:58.925718 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 328/666] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:58 2022] GET /compute/v2.1/servers/2d4fe59a-b31c-4fc0-8994-eb21e313d18a => generated 1586 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:22:58.935413 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-b5615188-4804-4b05-bab0-4adfb2069f59 req-56fdb869-f8b8-4f0e-b874-efa487a4b36c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d4fe59a-b31c-4fc0-8994-eb21e313d18a", "tag": "4fbcc2f0-a04c-48c8-a4da-059f29a4e11f"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:22:58.948260 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-b5615188-4804-4b05-bab0-4adfb2069f59 req-56fdb869-f8b8-4f0e-b874-efa487a4b36c service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:58.948751 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-b5615188-4804-4b05-bab0-4adfb2069f59 req-56fdb869-f8b8-4f0e-b874-efa487a4b36c service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:58.949197 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-b5615188-4804-4b05-bab0-4adfb2069f59 req-56fdb869-f8b8-4f0e-b874-efa487a4b36c service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:58.963208 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-b5615188-4804-4b05-bab0-4adfb2069f59 req-56fdb869-f8b8-4f0e-b874-efa487a4b36c service nova] Creating event network-changed:4fbcc2f0-a04c-48c8-a4da-059f29a4e11f for instance 2d4fe59a-b31c-4fc0-8994-eb21e313d18a on n-h1-862769-1 Oct 27 03:22:58.969061 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-b5615188-4804-4b05-bab0-4adfb2069f59 req-56fdb869-f8b8-4f0e-b874-efa487a4b36c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042023 Oct 27 03:22:58.970346 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 329/667] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:22:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:22:58.977669 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3b0eb97f-0f2b-4067-8dcd-654b1faeef0e tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:58.978761 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3b0eb97f-0f2b-4067-8dcd-654b1faeef0e tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:58.988602 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3b0eb97f-0f2b-4067-8dcd-654b1faeef0e tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:58.989407 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3b0eb97f-0f2b-4067-8dcd-654b1faeef0e tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:58.990106 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3b0eb97f-0f2b-4067-8dcd-654b1faeef0e tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:58.991352 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3b0eb97f-0f2b-4067-8dcd-654b1faeef0e tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:58.992165 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3b0eb97f-0f2b-4067-8dcd-654b1faeef0e tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:58.992981 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3b0eb97f-0f2b-4067-8dcd-654b1faeef0e tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:59.024233 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=100 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:59.088487 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3b0eb97f-0f2b-4067-8dcd-654b1faeef0e tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:59.098866 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3b0eb97f-0f2b-4067-8dcd-654b1faeef0e tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:59.101942 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3b0eb97f-0f2b-4067-8dcd-654b1faeef0e tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:59.117409 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3b0eb97f-0f2b-4067-8dcd-654b1faeef0e tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1546 microversion: 2.91 time: 0.145427 Oct 27 03:22:59.118343 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 330/668] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:22:58 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1546 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:22:59.122972 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0c52aad1-ef35-41ec-b027-e2ea4f23f756 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:59.125630 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0c52aad1-ef35-41ec-b027-e2ea4f23f756 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] [instance: da3360d3-ca0b-4077-af3e-92731700dada] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:59.127219 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=15 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:59.148031 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0c52aad1-ef35-41ec-b027-e2ea4f23f756 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:59.154177 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0c52aad1-ef35-41ec-b027-e2ea4f23f756 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:59.154920 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0c52aad1-ef35-41ec-b027-e2ea4f23f756 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:59.159476 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0c52aad1-ef35-41ec-b027-e2ea4f23f756 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:59.159476 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0c52aad1-ef35-41ec-b027-e2ea4f23f756 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:59.159476 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0c52aad1-ef35-41ec-b027-e2ea4f23f756 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:59.415471 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0c52aad1-ef35-41ec-b027-e2ea4f23f756 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/da3360d3-ca0b-4077-af3e-92731700dada" status: 200 len: 1644 microversion: 2.1 time: 0.295260 Oct 27 03:22:59.443958 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 331/669] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:59 2022] GET /compute/v2.1/servers/da3360d3-ca0b-4077-af3e-92731700dada => generated 1644 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:22:59.455908 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4b10e16b-881d-49c9-bfc6-1c1d88199437 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:59.458895 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4b10e16b-881d-49c9-bfc6-1c1d88199437 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: b2ef080f-30ca-4dc5-ba03-9cf1899346a4] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:59.473117 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4b10e16b-881d-49c9-bfc6-1c1d88199437 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:59.473623 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4b10e16b-881d-49c9-bfc6-1c1d88199437 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:59.477393 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4b10e16b-881d-49c9-bfc6-1c1d88199437 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:59.478538 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4b10e16b-881d-49c9-bfc6-1c1d88199437 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:59.479282 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4b10e16b-881d-49c9-bfc6-1c1d88199437 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:59.480281 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4b10e16b-881d-49c9-bfc6-1c1d88199437 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:59.669239 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4b10e16b-881d-49c9-bfc6-1c1d88199437 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:59.688900 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4b10e16b-881d-49c9-bfc6-1c1d88199437 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4" status: 200 len: 1472 microversion: 2.1 time: 0.243069 Oct 27 03:22:59.702098 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 332/670] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:59 2022] GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4 => generated 1472 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:22:59.702098 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5cd5fe7a-d2a5-469e-8352-77aba1f1ed12 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:22:59.702098 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5cd5fe7a-d2a5-469e-8352-77aba1f1ed12 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: 37b3577c-f561-4d8e-957d-cdf1819ef5c1] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:22:59.709707 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5cd5fe7a-d2a5-469e-8352-77aba1f1ed12 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:59.710629 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5cd5fe7a-d2a5-469e-8352-77aba1f1ed12 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:59.711509 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5cd5fe7a-d2a5-469e-8352-77aba1f1ed12 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:59.712577 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5cd5fe7a-d2a5-469e-8352-77aba1f1ed12 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:22:59.713408 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5cd5fe7a-d2a5-469e-8352-77aba1f1ed12 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:22:59.714118 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5cd5fe7a-d2a5-469e-8352-77aba1f1ed12 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:22:59.775624 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=11,nova_api:UPDATE=11 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:22:59.869528 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5cd5fe7a-d2a5-469e-8352-77aba1f1ed12 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:22:59.872929 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5cd5fe7a-d2a5-469e-8352-77aba1f1ed12 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/37b3577c-f561-4d8e-957d-cdf1819ef5c1" status: 200 len: 1468 microversion: 2.1 time: 0.180860 Oct 27 03:22:59.873591 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 333/671] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:22:59 2022] GET /compute/v2.1/servers/37b3577c-f561-4d8e-957d-cdf1819ef5c1 => generated 1468 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:22:59.991353 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9753b599-1af9-4f2d-980b-ae64b61ab1fe tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-239407577", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:23:00.045625 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.network.neutron [None req-9753b599-1af9-4f2d-980b-ae64b61ab1fe tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] validate_networks() for None {{(pid=121001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:23:00.301897 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-9753b599-1af9-4f2d-980b-ae64b61ab1fe tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Flavor limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:23:00.306229 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-9753b599-1af9-4f2d-980b-ae64b61ab1fe tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Image limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:23:00.306747 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-9753b599-1af9-4f2d-980b-ae64b61ab1fe tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Flavor pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:23:00.307158 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-9753b599-1af9-4f2d-980b-ae64b61ab1fe tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Image pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:23:00.307720 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-9753b599-1af9-4f2d-980b-ae64b61ab1fe tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:23:00.314721 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1c14fc51-8fde-41d1-b4a3-4a7c72b1fdbf tempest-QuotasAdminTestJSON-1121019878 tempest-QuotasAdminTestJSON-1121019878-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/6abd257f3bfc49b99f90d15daeb01867" status: 200 len: 329 microversion: 2.1 time: 2.958903 Oct 27 03:23:00.315352 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 339/672] 10.222.0.20 () {60 vars in 1263 bytes} [Thu Oct 27 03:22:57 2022] PUT /compute/v2.1/os-quota-sets/6abd257f3bfc49b99f90d15daeb01867 => generated 329 bytes in 2961 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:23:00.320856 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-be40bcdf-7d57-427a-9faf-d2bd6cfc76eb tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:00.324793 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-be40bcdf-7d57-427a-9faf-d2bd6cfc76eb tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:00.325420 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-be40bcdf-7d57-427a-9faf-d2bd6cfc76eb tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:00.325995 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-be40bcdf-7d57-427a-9faf-d2bd6cfc76eb tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:00.327447 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-be40bcdf-7d57-427a-9faf-d2bd6cfc76eb tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:00.328044 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-be40bcdf-7d57-427a-9faf-d2bd6cfc76eb tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:00.328624 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-be40bcdf-7d57-427a-9faf-d2bd6cfc76eb tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:00.337446 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9753b599-1af9-4f2d-980b-ae64b61ab1fe tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:00.337943 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9753b599-1af9-4f2d-980b-ae64b61ab1fe tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:00.338429 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9753b599-1af9-4f2d-980b-ae64b61ab1fe tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:00.339823 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9753b599-1af9-4f2d-980b-ae64b61ab1fe tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:00.340857 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9753b599-1af9-4f2d-980b-ae64b61ab1fe tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:00.341504 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9753b599-1af9-4f2d-980b-ae64b61ab1fe tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:00.384896 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-be40bcdf-7d57-427a-9faf-d2bd6cfc76eb tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.067353 Oct 27 03:23:00.387801 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-9753b599-1af9-4f2d-980b-ae64b61ab1fe tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Getting quotas for project c18fabfb19904c5ea3c5c096d9d6cad7. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:23:00.396326 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-9753b599-1af9-4f2d-980b-ae64b61ab1fe tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Getting quotas for user 7bd90bf4a2aa403cacd06bcaeb502640 and project c18fabfb19904c5ea3c5c096d9d6cad7. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:23:00.398232 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 340/673] 10.222.0.20 () {58 vars in 1176 bytes} [Thu Oct 27 03:23:00 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:23:00.405905 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7a4cad45-4e28-487f-bcf2-3536fbaa95b9 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:00.414252 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-9753b599-1af9-4f2d-980b-ae64b61ab1fe tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Going to run 1 instances... {{(pid=121001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:23:00.420878 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7a4cad45-4e28-487f-bcf2-3536fbaa95b9 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:00.420878 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7a4cad45-4e28-487f-bcf2-3536fbaa95b9 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Searching by: {'reservation_id': 'r-4veufggr', 'deleted': False, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2'} {{(pid=121000) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 03:23:00.421148 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-9753b599-1af9-4f2d-980b-ae64b61ab1fe tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] [instance: 8877a86d-6529-43e9-9667-0dba515be5cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:23:00.421809 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7a4cad45-4e28-487f-bcf2-3536fbaa95b9 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:00.422510 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7a4cad45-4e28-487f-bcf2-3536fbaa95b9 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:00.422959 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7a4cad45-4e28-487f-bcf2-3536fbaa95b9 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:00.423810 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7a4cad45-4e28-487f-bcf2-3536fbaa95b9 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:00.424283 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7a4cad45-4e28-487f-bcf2-3536fbaa95b9 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:00.424778 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7a4cad45-4e28-487f-bcf2-3536fbaa95b9 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:00.536606 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9753b599-1af9-4f2d-980b-ae64b61ab1fe tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.661929 Oct 27 03:23:00.537300 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 334/674] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:22:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 663 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 03:23:00.541898 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-18b5b990-9957-44c2-a5e5-8b0147e0f687 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:00.542541 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-18b5b990-9957-44c2-a5e5-8b0147e0f687 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:00.549077 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-18b5b990-9957-44c2-a5e5-8b0147e0f687 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:00.549698 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-18b5b990-9957-44c2-a5e5-8b0147e0f687 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:00.550245 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-18b5b990-9957-44c2-a5e5-8b0147e0f687 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:00.550921 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-18b5b990-9957-44c2-a5e5-8b0147e0f687 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:00.551394 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-18b5b990-9957-44c2-a5e5-8b0147e0f687 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:00.552011 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-18b5b990-9957-44c2-a5e5-8b0147e0f687 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:00.575406 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.multi_cell_list [None req-7a4cad45-4e28-487f-bcf2-3536fbaa95b9 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=121000) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 03:23:00.644481 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-18b5b990-9957-44c2-a5e5-8b0147e0f687 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:00.657404 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-18b5b990-9957-44c2-a5e5-8b0147e0f687 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:00.658976 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-18b5b990-9957-44c2-a5e5-8b0147e0f687 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:00.667879 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-18b5b990-9957-44c2-a5e5-8b0147e0f687 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1546 microversion: 2.91 time: 0.129558 Oct 27 03:23:00.669483 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 335/675] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:23:00 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1546 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:23:00.689818 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c048bbc3-f6b4-4fbe-b905-fa168a0f6ac0 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-862769-1", "block_migration": true, "disk_over_commit": false}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:23:00.693066 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c048bbc3-f6b4-4fbe-b905-fa168a0f6ac0 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] [instance: da3360d3-ca0b-4077-af3e-92731700dada] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:00.704078 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c048bbc3-f6b4-4fbe-b905-fa168a0f6ac0 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:00.705816 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7a4cad45-4e28-487f-bcf2-3536fbaa95b9 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:00.707456 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c048bbc3-f6b4-4fbe-b905-fa168a0f6ac0 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:00.707908 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c048bbc3-f6b4-4fbe-b905-fa168a0f6ac0 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:00.708772 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c048bbc3-f6b4-4fbe-b905-fa168a0f6ac0 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:00.709270 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c048bbc3-f6b4-4fbe-b905-fa168a0f6ac0 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:00.709650 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c048bbc3-f6b4-4fbe-b905-fa168a0f6ac0 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:00.723035 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7a4cad45-4e28-487f-bcf2-3536fbaa95b9 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:00.723500 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7a4cad45-4e28-487f-bcf2-3536fbaa95b9 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:00.723946 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7a4cad45-4e28-487f-bcf2-3536fbaa95b9 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:00.756470 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-c048bbc3-f6b4-4fbe-b905-fa168a0f6ac0 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lazy-loading 'flavor' on Instance uuid da3360d3-ca0b-4077-af3e-92731700dada {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:23:00.769246 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c048bbc3-f6b4-4fbe-b905-fa168a0f6ac0 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] [instance: da3360d3-ca0b-4077-af3e-92731700dada] Going to try to live migrate instance to n-h1-862769-1 {{(pid=121001) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 27 03:23:00.896287 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7a4cad45-4e28-487f-bcf2-3536fbaa95b9 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/detail?reservation_id=r-4veufggr" status: 200 len: 2929 microversion: 2.1 time: 0.496079 Oct 27 03:23:00.900338 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 341/676] 10.222.0.20 () {58 vars in 1197 bytes} [Thu Oct 27 03:23:00 2022] GET /compute/v2.1/servers/detail?reservation_id=r-4veufggr => generated 2929 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:00.903498 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1f4d27c8-f9f3-4ea2-9920-cc7d0cf62d7a tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:00.904276 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1f4d27c8-f9f3-4ea2-9920-cc7d0cf62d7a tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] [instance: 8877a86d-6529-43e9-9667-0dba515be5cb] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:00.962410 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1f4d27c8-f9f3-4ea2-9920-cc7d0cf62d7a tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd90bf4a2aa403cacd06bcaeb502640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c18fabfb19904c5ea3c5c096d9d6cad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:00.974210 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1f4d27c8-f9f3-4ea2-9920-cc7d0cf62d7a tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] 10.222.0.20 "GET /compute/v2.1/servers/8877a86d-6529-43e9-9667-0dba515be5cb" status: 200 len: 1222 microversion: 2.1 time: 0.075251 Oct 27 03:23:00.979354 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 342/677] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:00 2022] GET /compute/v2.1/servers/8877a86d-6529-43e9-9667-0dba515be5cb => generated 1222 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:00.986567 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1f4c0570-f25e-4da3-a111-9cfb381e8e41 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:00.987200 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1f4c0570-f25e-4da3-a111-9cfb381e8e41 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: b2ef080f-30ca-4dc5-ba03-9cf1899346a4] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:00.994492 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1f4c0570-f25e-4da3-a111-9cfb381e8e41 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:00.995290 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1f4c0570-f25e-4da3-a111-9cfb381e8e41 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:00.995957 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1f4c0570-f25e-4da3-a111-9cfb381e8e41 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:00.996889 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1f4c0570-f25e-4da3-a111-9cfb381e8e41 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:00.997495 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1f4c0570-f25e-4da3-a111-9cfb381e8e41 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:00.998109 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1f4c0570-f25e-4da3-a111-9cfb381e8e41 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:01.248419 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1f4c0570-f25e-4da3-a111-9cfb381e8e41 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:01.258213 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1f4c0570-f25e-4da3-a111-9cfb381e8e41 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4" status: 200 len: 1477 microversion: 2.1 time: 0.277508 Oct 27 03:23:01.258820 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 343/678] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:00 2022] GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4 => generated 1477 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:01.266319 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-556640f1-0565-4637-96a4-ec4550a87bbc tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:01.296602 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.compute.server_groups [None req-556640f1-0565-4637-96a4-ec4550a87bbc tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Querying cell d4405804-b3fd-4c57-a074-5c4e2aef7c93(cell1) for 2 instances {{(pid=121000) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 27 03:23:01.297636 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-556640f1-0565-4637-96a4-ec4550a87bbc tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:01.298173 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-556640f1-0565-4637-96a4-ec4550a87bbc tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:01.298809 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-556640f1-0565-4637-96a4-ec4550a87bbc tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:01.338864 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-556640f1-0565-4637-96a4-ec4550a87bbc tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups/42ad9f2d-227d-4b2a-b208-60d85ad55118" status: 200 len: 265 microversion: 2.1 time: 0.078464 Oct 27 03:23:01.345976 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 344/679] 10.222.0.20 () {58 vars in 1263 bytes} [Thu Oct 27 03:23:01 2022] GET /compute/v2.1/os-server-groups/42ad9f2d-227d-4b2a-b208-60d85ad55118 => generated 265 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:23:01.350877 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b5c15491-efd1-4dd5-8b45-fb5b5594a9f9 tempest-ServersOnMultiNodesTest-1789564933 tempest-ServersOnMultiNodesTest-1789564933-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:01.351499 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b5c15491-efd1-4dd5-8b45-fb5b5594a9f9 tempest-ServersOnMultiNodesTest-1789564933 tempest-ServersOnMultiNodesTest-1789564933-project-admin] [instance: 1a733f7d-4f8d-4190-9795-937510f1a516] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:01.358500 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b5c15491-efd1-4dd5-8b45-fb5b5594a9f9 tempest-ServersOnMultiNodesTest-1789564933 tempest-ServersOnMultiNodesTest-1789564933-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:01.359107 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b5c15491-efd1-4dd5-8b45-fb5b5594a9f9 tempest-ServersOnMultiNodesTest-1789564933 tempest-ServersOnMultiNodesTest-1789564933-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:01.359540 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b5c15491-efd1-4dd5-8b45-fb5b5594a9f9 tempest-ServersOnMultiNodesTest-1789564933 tempest-ServersOnMultiNodesTest-1789564933-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:01.360241 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b5c15491-efd1-4dd5-8b45-fb5b5594a9f9 tempest-ServersOnMultiNodesTest-1789564933 tempest-ServersOnMultiNodesTest-1789564933-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:01.360700 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b5c15491-efd1-4dd5-8b45-fb5b5594a9f9 tempest-ServersOnMultiNodesTest-1789564933 tempest-ServersOnMultiNodesTest-1789564933-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:01.361127 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b5c15491-efd1-4dd5-8b45-fb5b5594a9f9 tempest-ServersOnMultiNodesTest-1789564933 tempest-ServersOnMultiNodesTest-1789564933-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:01.752563 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b5c15491-efd1-4dd5-8b45-fb5b5594a9f9 tempest-ServersOnMultiNodesTest-1789564933 tempest-ServersOnMultiNodesTest-1789564933-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/1a733f7d-4f8d-4190-9795-937510f1a516" status: 200 len: 1619 microversion: 2.1 time: 0.405525 Oct 27 03:23:01.753153 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 345/680] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:01 2022] GET /compute/v2.1/servers/1a733f7d-4f8d-4190-9795-937510f1a516 => generated 1619 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:01.767761 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8012af92-1df1-46d7-8583-b57fab9f8653 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:01.768446 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8012af92-1df1-46d7-8583-b57fab9f8653 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:01.779476 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8012af92-1df1-46d7-8583-b57fab9f8653 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:01.782427 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8012af92-1df1-46d7-8583-b57fab9f8653 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:01.783151 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8012af92-1df1-46d7-8583-b57fab9f8653 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:01.784169 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8012af92-1df1-46d7-8583-b57fab9f8653 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:01.784852 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8012af92-1df1-46d7-8583-b57fab9f8653 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:01.785548 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8012af92-1df1-46d7-8583-b57fab9f8653 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:01.804681 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:01.877518 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8012af92-1df1-46d7-8583-b57fab9f8653 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:01.898920 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8012af92-1df1-46d7-8583-b57fab9f8653 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:01.903276 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8012af92-1df1-46d7-8583-b57fab9f8653 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:01.931824 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8012af92-1df1-46d7-8583-b57fab9f8653 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1546 microversion: 2.91 time: 0.161626 Oct 27 03:23:01.932392 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 346/681] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:23:01 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1546 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:23:01.937621 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0245a8ee-2339-47a1-96df-44d7c92ae516 tempest-ServersOnMultiNodesTest-1789564933 tempest-ServersOnMultiNodesTest-1789564933-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:01.938457 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0245a8ee-2339-47a1-96df-44d7c92ae516 tempest-ServersOnMultiNodesTest-1789564933 tempest-ServersOnMultiNodesTest-1789564933-project-admin] [instance: 37b3577c-f561-4d8e-957d-cdf1819ef5c1] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:01.946095 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0245a8ee-2339-47a1-96df-44d7c92ae516 tempest-ServersOnMultiNodesTest-1789564933 tempest-ServersOnMultiNodesTest-1789564933-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:01.946976 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0245a8ee-2339-47a1-96df-44d7c92ae516 tempest-ServersOnMultiNodesTest-1789564933 tempest-ServersOnMultiNodesTest-1789564933-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:01.948910 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0245a8ee-2339-47a1-96df-44d7c92ae516 tempest-ServersOnMultiNodesTest-1789564933 tempest-ServersOnMultiNodesTest-1789564933-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:01.950840 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0245a8ee-2339-47a1-96df-44d7c92ae516 tempest-ServersOnMultiNodesTest-1789564933 tempest-ServersOnMultiNodesTest-1789564933-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:01.952863 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0245a8ee-2339-47a1-96df-44d7c92ae516 tempest-ServersOnMultiNodesTest-1789564933 tempest-ServersOnMultiNodesTest-1789564933-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:01.953725 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0245a8ee-2339-47a1-96df-44d7c92ae516 tempest-ServersOnMultiNodesTest-1789564933 tempest-ServersOnMultiNodesTest-1789564933-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:02.116957 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0245a8ee-2339-47a1-96df-44d7c92ae516 tempest-ServersOnMultiNodesTest-1789564933 tempest-ServersOnMultiNodesTest-1789564933-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/37b3577c-f561-4d8e-957d-cdf1819ef5c1" status: 200 len: 1619 microversion: 2.1 time: 0.183282 Oct 27 03:23:02.117553 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 347/682] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:01 2022] GET /compute/v2.1/servers/37b3577c-f561-4d8e-957d-cdf1819ef5c1 => generated 1619 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:02.146145 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c8709cd8-c44b-4f42-b718-698a9a2f14fa tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:02.146699 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c8709cd8-c44b-4f42-b718-698a9a2f14fa tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] [instance: 8877a86d-6529-43e9-9667-0dba515be5cb] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:02.156902 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c8709cd8-c44b-4f42-b718-698a9a2f14fa tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:02.157440 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c8709cd8-c44b-4f42-b718-698a9a2f14fa tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:02.157930 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c8709cd8-c44b-4f42-b718-698a9a2f14fa tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:02.158586 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c8709cd8-c44b-4f42-b718-698a9a2f14fa tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:02.159241 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c8709cd8-c44b-4f42-b718-698a9a2f14fa tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:02.159658 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c8709cd8-c44b-4f42-b718-698a9a2f14fa tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:02.243260 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c8709cd8-c44b-4f42-b718-698a9a2f14fa tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd90bf4a2aa403cacd06bcaeb502640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c18fabfb19904c5ea3c5c096d9d6cad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:02.253625 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c8709cd8-c44b-4f42-b718-698a9a2f14fa tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] 10.222.0.20 "GET /compute/v2.1/servers/8877a86d-6529-43e9-9667-0dba515be5cb" status: 200 len: 1226 microversion: 2.1 time: 0.120120 Oct 27 03:23:02.258621 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 348/683] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:02 2022] GET /compute/v2.1/servers/8877a86d-6529-43e9-9667-0dba515be5cb => generated 1226 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:02.260814 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-07b8cd4c-8fe8-4646-9e5c-2cc4f765697d tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Action: 'create', calling method: .version_select at 0x7f7ddae18550>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-51082069", "policies": ["anti-affinity"]}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:23:02.287423 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-07b8cd4c-8fe8-4646-9e5c-2cc4f765697d tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Getting quotas for project b95729a8c8a14361b7cbf8b2b13900b2. Resources: {'server_groups'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:23:02.294211 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-07b8cd4c-8fe8-4646-9e5c-2cc4f765697d tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Getting quotas for user 91d1351fcb6b4cd08f176e6d0cc5bb11 and project b95729a8c8a14361b7cbf8b2b13900b2. Resources: {'server_groups'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:23:02.447629 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-07b8cd4c-8fe8-4646-9e5c-2cc4f765697d tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Getting quotas for project b95729a8c8a14361b7cbf8b2b13900b2. Resources: {'server_groups'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:23:02.453434 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-07b8cd4c-8fe8-4646-9e5c-2cc4f765697d tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Getting quotas for user 91d1351fcb6b4cd08f176e6d0cc5bb11 and project b95729a8c8a14361b7cbf8b2b13900b2. Resources: {'server_groups'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:23:02.471530 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-07b8cd4c-8fe8-4646-9e5c-2cc4f765697d tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "POST /compute/v2.1/os-server-groups" status: 200 len: 191 microversion: 2.1 time: 0.214251 Oct 27 03:23:02.472549 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 349/684] 10.222.0.20 () {60 vars in 1174 bytes} [Thu Oct 27 03:23:02 2022] POST /compute/v2.1/os-server-groups => generated 191 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:23:02.489315 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-86f03cec-1f61-4e67-992f-1a27553a245a tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:02.490779 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-86f03cec-1f61-4e67-992f-1a27553a245a tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: b2ef080f-30ca-4dc5-ba03-9cf1899346a4] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:02.498440 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-86f03cec-1f61-4e67-992f-1a27553a245a tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:02.501776 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-86f03cec-1f61-4e67-992f-1a27553a245a tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:02.501776 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-86f03cec-1f61-4e67-992f-1a27553a245a tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:02.501776 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-86f03cec-1f61-4e67-992f-1a27553a245a tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:02.501776 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-86f03cec-1f61-4e67-992f-1a27553a245a tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:02.502165 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-86f03cec-1f61-4e67-992f-1a27553a245a tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:02.701154 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-86f03cec-1f61-4e67-992f-1a27553a245a tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:02.713487 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-86f03cec-1f61-4e67-992f-1a27553a245a tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4" status: 200 len: 1477 microversion: 2.1 time: 0.228617 Oct 27 03:23:02.714108 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 350/685] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:02 2022] GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4 => generated 1477 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:02.720676 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d04aec8a-c28c-494b-8789-9aba8e8af3e2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-2057990508", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "4835bc27-4897-4969-a9df-56f3801b9332"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:23:02.802718 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-d04aec8a-c28c-494b-8789-9aba8e8af3e2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] validate_networks() for None {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:23:03.227435 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-d04aec8a-c28c-494b-8789-9aba8e8af3e2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:23:03.228073 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-d04aec8a-c28c-494b-8789-9aba8e8af3e2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:23:03.228578 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-d04aec8a-c28c-494b-8789-9aba8e8af3e2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:23:03.229084 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-d04aec8a-c28c-494b-8789-9aba8e8af3e2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:23:03.230089 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-d04aec8a-c28c-494b-8789-9aba8e8af3e2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:23:03.262600 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d04aec8a-c28c-494b-8789-9aba8e8af3e2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:03.265132 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d04aec8a-c28c-494b-8789-9aba8e8af3e2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:03.267144 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d04aec8a-c28c-494b-8789-9aba8e8af3e2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:03.267954 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d04aec8a-c28c-494b-8789-9aba8e8af3e2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:03.269305 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d04aec8a-c28c-494b-8789-9aba8e8af3e2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:03.269622 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d04aec8a-c28c-494b-8789-9aba8e8af3e2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:03.321898 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-d04aec8a-c28c-494b-8789-9aba8e8af3e2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Getting quotas for project b95729a8c8a14361b7cbf8b2b13900b2. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:23:03.337286 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-d04aec8a-c28c-494b-8789-9aba8e8af3e2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Getting quotas for user 91d1351fcb6b4cd08f176e6d0cc5bb11 and project b95729a8c8a14361b7cbf8b2b13900b2. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:23:03.376833 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d04aec8a-c28c-494b-8789-9aba8e8af3e2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Going to run 2 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:23:03.381326 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d04aec8a-c28c-494b-8789-9aba8e8af3e2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: 6f360a9c-90c7-4efd-90c2-c0d3bd15c154] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:23:03.563610 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-d04aec8a-c28c-494b-8789-9aba8e8af3e2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=121000) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 27 03:23:03.612078 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-d04aec8a-c28c-494b-8789-9aba8e8af3e2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Getting quotas for project b95729a8c8a14361b7cbf8b2b13900b2. Resources: {'server_group_members'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:23:03.616191 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=8,nova_api:UPDATE=3 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:03.633614 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-d04aec8a-c28c-494b-8789-9aba8e8af3e2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Getting quotas for user 91d1351fcb6b4cd08f176e6d0cc5bb11 and project b95729a8c8a14361b7cbf8b2b13900b2. Resources: {'server_group_members'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:23:03.818071 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-d04aec8a-c28c-494b-8789-9aba8e8af3e2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Getting quotas for project b95729a8c8a14361b7cbf8b2b13900b2. Resources: {'server_group_members'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:23:03.825293 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-d04aec8a-c28c-494b-8789-9aba8e8af3e2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Getting quotas for user 91d1351fcb6b4cd08f176e6d0cc5bb11 and project b95729a8c8a14361b7cbf8b2b13900b2. Resources: {'server_group_members'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:23:03.878589 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d04aec8a-c28c-494b-8789-9aba8e8af3e2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: ac5fc2b3-c92e-470a-9bc6-885dce75fb8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=6f360a9c-90c7-4efd-90c2-c0d3bd15c154,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:23:04.075373 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-d04aec8a-c28c-494b-8789-9aba8e8af3e2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Getting quotas for project b95729a8c8a14361b7cbf8b2b13900b2. Resources: {'server_group_members'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:23:04.088198 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-d04aec8a-c28c-494b-8789-9aba8e8af3e2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Getting quotas for user 91d1351fcb6b4cd08f176e6d0cc5bb11 and project b95729a8c8a14361b7cbf8b2b13900b2. Resources: {'server_group_members'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:23:04.262068 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-d04aec8a-c28c-494b-8789-9aba8e8af3e2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Getting quotas for project b95729a8c8a14361b7cbf8b2b13900b2. Resources: {'server_group_members'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:23:04.271108 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-d04aec8a-c28c-494b-8789-9aba8e8af3e2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Getting quotas for user 91d1351fcb6b4cd08f176e6d0cc5bb11 and project b95729a8c8a14361b7cbf8b2b13900b2. Resources: {'server_group_members'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:23:04.356322 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d04aec8a-c28c-494b-8789-9aba8e8af3e2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.632369 Oct 27 03:23:04.361607 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 351/686] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:23:02 2022] POST /compute/v2.1/servers => generated 32 bytes in 1647 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 27 03:23:04.374636 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b669f8ff-0fea-4714-811c-5db4f313ada2 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:04.377619 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b669f8ff-0fea-4714-811c-5db4f313ada2 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:04.393223 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b669f8ff-0fea-4714-811c-5db4f313ada2 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:04.394269 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b669f8ff-0fea-4714-811c-5db4f313ada2 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:04.396600 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b669f8ff-0fea-4714-811c-5db4f313ada2 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:04.398361 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b669f8ff-0fea-4714-811c-5db4f313ada2 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:04.398861 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b669f8ff-0fea-4714-811c-5db4f313ada2 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:04.399313 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b669f8ff-0fea-4714-811c-5db4f313ada2 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:04.578751 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b669f8ff-0fea-4714-811c-5db4f313ada2 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:04.596073 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b669f8ff-0fea-4714-811c-5db4f313ada2 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:04.597815 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b669f8ff-0fea-4714-811c-5db4f313ada2 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:04.615259 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b669f8ff-0fea-4714-811c-5db4f313ada2 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1546 microversion: 2.91 time: 0.246870 Oct 27 03:23:04.616243 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 352/687] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:23:04 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1546 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:23:04.634407 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5579b62e-8715-404d-a794-60d9afea34f2 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:04.634946 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5579b62e-8715-404d-a794-60d9afea34f2 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] [instance: 8877a86d-6529-43e9-9667-0dba515be5cb] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:04.656222 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5579b62e-8715-404d-a794-60d9afea34f2 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:04.656508 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5579b62e-8715-404d-a794-60d9afea34f2 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:04.656957 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5579b62e-8715-404d-a794-60d9afea34f2 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:04.673459 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5579b62e-8715-404d-a794-60d9afea34f2 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:04.682822 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5579b62e-8715-404d-a794-60d9afea34f2 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:04.684807 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5579b62e-8715-404d-a794-60d9afea34f2 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:04.794701 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5579b62e-8715-404d-a794-60d9afea34f2 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd90bf4a2aa403cacd06bcaeb502640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c18fabfb19904c5ea3c5c096d9d6cad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:04.804912 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5579b62e-8715-404d-a794-60d9afea34f2 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] 10.222.0.20 "GET /compute/v2.1/servers/8877a86d-6529-43e9-9667-0dba515be5cb" status: 200 len: 1280 microversion: 2.1 time: 0.184868 Oct 27 03:23:04.805783 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 353/688] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:04 2022] GET /compute/v2.1/servers/8877a86d-6529-43e9-9667-0dba515be5cb => generated 1280 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:04.810574 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8ad6d2d8-2779-4453-a116-25bed3d62d1a tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:04.811226 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8ad6d2d8-2779-4453-a116-25bed3d62d1a tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: b2ef080f-30ca-4dc5-ba03-9cf1899346a4] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:04.825250 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8ad6d2d8-2779-4453-a116-25bed3d62d1a tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:04.825753 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8ad6d2d8-2779-4453-a116-25bed3d62d1a tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:04.826242 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8ad6d2d8-2779-4453-a116-25bed3d62d1a tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:04.827510 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8ad6d2d8-2779-4453-a116-25bed3d62d1a tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:04.827979 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8ad6d2d8-2779-4453-a116-25bed3d62d1a tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:04.828413 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8ad6d2d8-2779-4453-a116-25bed3d62d1a tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:05.041588 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8ad6d2d8-2779-4453-a116-25bed3d62d1a tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:05.063079 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8ad6d2d8-2779-4453-a116-25bed3d62d1a tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4" status: 200 len: 1477 microversion: 2.1 time: 0.252250 Oct 27 03:23:05.063079 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 354/689] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:04 2022] GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4 => generated 1477 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:05.066228 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-04c7ab73-ed89-41ed-9b60-93cad420c736 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:05.073091 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-04c7ab73-ed89-41ed-9b60-93cad420c736 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:05.073985 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-04c7ab73-ed89-41ed-9b60-93cad420c736 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Searching by: {'deleted': False, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2'} {{(pid=121000) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 03:23:05.121004 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-04c7ab73-ed89-41ed-9b60-93cad420c736 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:05.121730 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-04c7ab73-ed89-41ed-9b60-93cad420c736 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:05.122539 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-04c7ab73-ed89-41ed-9b60-93cad420c736 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:05.123470 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-04c7ab73-ed89-41ed-9b60-93cad420c736 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:05.124707 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-04c7ab73-ed89-41ed-9b60-93cad420c736 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:05.125296 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-04c7ab73-ed89-41ed-9b60-93cad420c736 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:05.192381 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.multi_cell_list [None req-04c7ab73-ed89-41ed-9b60-93cad420c736 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=121000) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 03:23:05.264653 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-04c7ab73-ed89-41ed-9b60-93cad420c736 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 1665 microversion: 2.1 time: 0.203349 Oct 27 03:23:05.267049 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 355/690] 10.222.0.20 () {58 vars in 1125 bytes} [Thu Oct 27 03:23:05 2022] GET /compute/v2.1/servers => generated 1665 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:05.280155 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8b6dea47-e77b-4f2f-9c9d-5fb371f9d830 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:05.281094 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8b6dea47-e77b-4f2f-9c9d-5fb371f9d830 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: ac5fc2b3-c92e-470a-9bc6-885dce75fb8c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:05.376031 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8b6dea47-e77b-4f2f-9c9d-5fb371f9d830 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:05.385756 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8b6dea47-e77b-4f2f-9c9d-5fb371f9d830 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/ac5fc2b3-c92e-470a-9bc6-885dce75fb8c" status: 200 len: 1219 microversion: 2.1 time: 0.110023 Oct 27 03:23:05.386577 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 356/691] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:05 2022] GET /compute/v2.1/servers/ac5fc2b3-c92e-470a-9bc6-885dce75fb8c => generated 1219 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:23:05.529158 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c048bbc3-f6b4-4fbe-b905-fa168a0f6ac0 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/da3360d3-ca0b-4077-af3e-92731700dada/action" status: 202 len: 0 microversion: 2.1 time: 4.857294 Oct 27 03:23:05.532152 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 336/692] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:23:00 2022] POST /compute/v2.1/servers/da3360d3-ca0b-4077-af3e-92731700dada/action => generated 0 bytes in 4861 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:23:05.544759 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-63802d7d-86ba-4905-9590-86a355fe1c92 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:05.546182 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-63802d7d-86ba-4905-9590-86a355fe1c92 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: da3360d3-ca0b-4077-af3e-92731700dada] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:05.556611 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-63802d7d-86ba-4905-9590-86a355fe1c92 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:05.559831 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-63802d7d-86ba-4905-9590-86a355fe1c92 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:05.561867 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-63802d7d-86ba-4905-9590-86a355fe1c92 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:05.565243 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-63802d7d-86ba-4905-9590-86a355fe1c92 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:05.565911 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-63802d7d-86ba-4905-9590-86a355fe1c92 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:05.567135 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-63802d7d-86ba-4905-9590-86a355fe1c92 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:05.651480 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d1ee75d3-cf3d-433d-9bdf-1fd8b66cc189 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:05.652121 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d1ee75d3-cf3d-433d-9bdf-1fd8b66cc189 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:05.673239 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d1ee75d3-cf3d-433d-9bdf-1fd8b66cc189 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:05.680826 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d1ee75d3-cf3d-433d-9bdf-1fd8b66cc189 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:05.680826 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d1ee75d3-cf3d-433d-9bdf-1fd8b66cc189 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:05.680826 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d1ee75d3-cf3d-433d-9bdf-1fd8b66cc189 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:05.680826 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d1ee75d3-cf3d-433d-9bdf-1fd8b66cc189 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:05.681196 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d1ee75d3-cf3d-433d-9bdf-1fd8b66cc189 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:05.791340 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d1ee75d3-cf3d-433d-9bdf-1fd8b66cc189 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:05.806698 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d1ee75d3-cf3d-433d-9bdf-1fd8b66cc189 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:05.808787 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d1ee75d3-cf3d-433d-9bdf-1fd8b66cc189 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:05.852867 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d1ee75d3-cf3d-433d-9bdf-1fd8b66cc189 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1533 microversion: 2.91 time: 0.202332 Oct 27 03:23:05.852867 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 337/693] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:23:05 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1533 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:23:05.860964 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3de27f88-b005-459e-88ae-4b826ab4216e tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:05.862883 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3de27f88-b005-459e-88ae-4b826ab4216e tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] [instance: 8877a86d-6529-43e9-9667-0dba515be5cb] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:05.899554 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3de27f88-b005-459e-88ae-4b826ab4216e tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:05.903007 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3de27f88-b005-459e-88ae-4b826ab4216e tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:05.903782 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3de27f88-b005-459e-88ae-4b826ab4216e tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:05.904188 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3de27f88-b005-459e-88ae-4b826ab4216e tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:05.904668 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3de27f88-b005-459e-88ae-4b826ab4216e tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:05.905138 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3de27f88-b005-459e-88ae-4b826ab4216e tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:05.962151 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-63802d7d-86ba-4905-9590-86a355fe1c92 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:05.972374 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-63802d7d-86ba-4905-9590-86a355fe1c92 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/da3360d3-ca0b-4077-af3e-92731700dada" status: 200 len: 1503 microversion: 2.1 time: 0.433318 Oct 27 03:23:05.982049 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 357/694] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:05 2022] GET /compute/v2.1/servers/da3360d3-ca0b-4077-af3e-92731700dada => generated 1503 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:05.982049 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7799fe98-44d7-4eaf-bc9f-95563f1495f0 tempest-UnshelveToHostMultiNodesTest-20786752 tempest-UnshelveToHostMultiNodesTest-20786752-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:05.982049 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7799fe98-44d7-4eaf-bc9f-95563f1495f0 tempest-UnshelveToHostMultiNodesTest-20786752 tempest-UnshelveToHostMultiNodesTest-20786752-project-admin] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:06.005250 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7799fe98-44d7-4eaf-bc9f-95563f1495f0 tempest-UnshelveToHostMultiNodesTest-20786752 tempest-UnshelveToHostMultiNodesTest-20786752-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:06.005250 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7799fe98-44d7-4eaf-bc9f-95563f1495f0 tempest-UnshelveToHostMultiNodesTest-20786752 tempest-UnshelveToHostMultiNodesTest-20786752-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:06.005250 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7799fe98-44d7-4eaf-bc9f-95563f1495f0 tempest-UnshelveToHostMultiNodesTest-20786752 tempest-UnshelveToHostMultiNodesTest-20786752-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:06.006419 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7799fe98-44d7-4eaf-bc9f-95563f1495f0 tempest-UnshelveToHostMultiNodesTest-20786752 tempest-UnshelveToHostMultiNodesTest-20786752-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:06.007155 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7799fe98-44d7-4eaf-bc9f-95563f1495f0 tempest-UnshelveToHostMultiNodesTest-20786752 tempest-UnshelveToHostMultiNodesTest-20786752-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:06.007882 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7799fe98-44d7-4eaf-bc9f-95563f1495f0 tempest-UnshelveToHostMultiNodesTest-20786752 tempest-UnshelveToHostMultiNodesTest-20786752-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:06.187022 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-7799fe98-44d7-4eaf-bc9f-95563f1495f0 tempest-UnshelveToHostMultiNodesTest-20786752 tempest-UnshelveToHostMultiNodesTest-20786752-project-admin] Lazy-loading 'services' on Instance uuid c3536a26-29e6-4208-a03b-9609511fb53b {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:23:06.227583 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7799fe98-44d7-4eaf-bc9f-95563f1495f0 tempest-UnshelveToHostMultiNodesTest-20786752 tempest-UnshelveToHostMultiNodesTest-20786752-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1938 microversion: 2.91 time: 0.252702 Oct 27 03:23:06.228730 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 358/695] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:23:05 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1938 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:23:06.244371 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-857dca6b-65f7-4e9d-8317-b9f12e82aacf tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:06.245546 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-857dca6b-65f7-4e9d-8317-b9f12e82aacf tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: b2ef080f-30ca-4dc5-ba03-9cf1899346a4] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:06.270650 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-857dca6b-65f7-4e9d-8317-b9f12e82aacf tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:06.272401 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-857dca6b-65f7-4e9d-8317-b9f12e82aacf tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:06.275770 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-857dca6b-65f7-4e9d-8317-b9f12e82aacf tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:06.306594 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-857dca6b-65f7-4e9d-8317-b9f12e82aacf tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:06.308831 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-857dca6b-65f7-4e9d-8317-b9f12e82aacf tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:06.309455 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-857dca6b-65f7-4e9d-8317-b9f12e82aacf tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:06.465607 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3de27f88-b005-459e-88ae-4b826ab4216e tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd90bf4a2aa403cacd06bcaeb502640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c18fabfb19904c5ea3c5c096d9d6cad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:06.478552 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3de27f88-b005-459e-88ae-4b826ab4216e tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] 10.222.0.20 "GET /compute/v2.1/servers/8877a86d-6529-43e9-9667-0dba515be5cb" status: 200 len: 1322 microversion: 2.1 time: 0.624567 Oct 27 03:23:06.479152 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 338/696] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:05 2022] GET /compute/v2.1/servers/8877a86d-6529-43e9-9667-0dba515be5cb => generated 1322 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:06.494344 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-cde5deb1-9526-4804-8ca7-2b14df40859f tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:23:06.494899 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-cde5deb1-9526-4804-8ca7-2b14df40859f tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:06.512609 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cde5deb1-9526-4804-8ca7-2b14df40859f tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:06.513123 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cde5deb1-9526-4804-8ca7-2b14df40859f tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:06.513573 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cde5deb1-9526-4804-8ca7-2b14df40859f tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:06.514366 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cde5deb1-9526-4804-8ca7-2b14df40859f tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:06.514838 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cde5deb1-9526-4804-8ca7-2b14df40859f tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:06.515273 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cde5deb1-9526-4804-8ca7-2b14df40859f tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:06.545305 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-cde5deb1-9526-4804-8ca7-2b14df40859f tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lazy-loading 'flavor' on Instance uuid c3536a26-29e6-4208-a03b-9609511fb53b {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:23:06.653995 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-857dca6b-65f7-4e9d-8317-b9f12e82aacf tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:06.670436 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-857dca6b-65f7-4e9d-8317-b9f12e82aacf tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4" status: 200 len: 1477 microversion: 2.1 time: 0.436084 Oct 27 03:23:06.674537 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 359/697] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:06 2022] GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4 => generated 1477 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:06.689393 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f96cf3e5-fda3-41ac-ae45-dd5c74e12469 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:06.690128 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f96cf3e5-fda3-41ac-ae45-dd5c74e12469 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: ac5fc2b3-c92e-470a-9bc6-885dce75fb8c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:06.782804 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f96cf3e5-fda3-41ac-ae45-dd5c74e12469 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:06.794757 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f96cf3e5-fda3-41ac-ae45-dd5c74e12469 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/ac5fc2b3-c92e-470a-9bc6-885dce75fb8c" status: 200 len: 1219 microversion: 2.1 time: 0.118945 Oct 27 03:23:06.795347 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 360/698] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:06 2022] GET /compute/v2.1/servers/ac5fc2b3-c92e-470a-9bc6-885dce75fb8c => generated 1219 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:07.000092 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-89bcf6d7-2e17-4a3a-bcc7-e345a2bb8993 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:07.001324 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-89bcf6d7-2e17-4a3a-bcc7-e345a2bb8993 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: da3360d3-ca0b-4077-af3e-92731700dada] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:07.029642 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-89bcf6d7-2e17-4a3a-bcc7-e345a2bb8993 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:07.041281 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-89bcf6d7-2e17-4a3a-bcc7-e345a2bb8993 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:07.045377 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-89bcf6d7-2e17-4a3a-bcc7-e345a2bb8993 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:07.046218 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-89bcf6d7-2e17-4a3a-bcc7-e345a2bb8993 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:07.046704 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-89bcf6d7-2e17-4a3a-bcc7-e345a2bb8993 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:07.047164 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-89bcf6d7-2e17-4a3a-bcc7-e345a2bb8993 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:07.376778 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-89bcf6d7-2e17-4a3a-bcc7-e345a2bb8993 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:07.398595 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-89bcf6d7-2e17-4a3a-bcc7-e345a2bb8993 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/da3360d3-ca0b-4077-af3e-92731700dada" status: 200 len: 1503 microversion: 2.1 time: 0.403376 Oct 27 03:23:07.401949 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 361/699] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:06 2022] GET /compute/v2.1/servers/da3360d3-ca0b-4077-af3e-92731700dada => generated 1503 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:23:07.471603 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-cde5deb1-9526-4804-8ca7-2b14df40859f tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "POST /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b/action" status: 202 len: 0 microversion: 2.91 time: 0.991050 Oct 27 03:23:07.472693 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 339/700] 10.222.0.20 () {62 vars in 1319 bytes} [Thu Oct 27 03:23:06 2022] POST /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b/action => generated 0 bytes in 993 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:23:07.494895 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2c65fca5-4f9d-471d-a41a-bb6605379626 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:07.496016 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2c65fca5-4f9d-471d-a41a-bb6605379626 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:07.504153 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2c65fca5-4f9d-471d-a41a-bb6605379626 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:07.504646 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2c65fca5-4f9d-471d-a41a-bb6605379626 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:07.506653 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2c65fca5-4f9d-471d-a41a-bb6605379626 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:07.506653 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2c65fca5-4f9d-471d-a41a-bb6605379626 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:07.507311 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2c65fca5-4f9d-471d-a41a-bb6605379626 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:07.507992 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2c65fca5-4f9d-471d-a41a-bb6605379626 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:07.687538 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-dab048b4-c0ec-4f29-ba08-59852de2d4b8 tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] Calling method '.version_select at 0x7f7ddb06c040>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:07.813627 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-dab048b4-c0ec-4f29-ba08-59852de2d4b8 tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/f4eefc2fafef4054b6d4f7d17f645406" status: 200 len: 371 microversion: 2.1 time: 0.409091 Oct 27 03:23:07.815111 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 362/701] 10.222.0.20 () {58 vars in 1242 bytes} [Thu Oct 27 03:23:07 2022] GET /compute/v2.1/os-quota-sets/f4eefc2fafef4054b6d4f7d17f645406 => generated 371 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:23:07.817093 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2c65fca5-4f9d-471d-a41a-bb6605379626 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:07.822801 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-87a7d9ea-991e-4560-bf32-0e0360816fd4 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:07.823906 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-87a7d9ea-991e-4560-bf32-0e0360816fd4 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] [instance: 8877a86d-6529-43e9-9667-0dba515be5cb] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:07.836211 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-87a7d9ea-991e-4560-bf32-0e0360816fd4 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:07.837197 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-87a7d9ea-991e-4560-bf32-0e0360816fd4 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:07.837879 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-87a7d9ea-991e-4560-bf32-0e0360816fd4 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:07.839598 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-87a7d9ea-991e-4560-bf32-0e0360816fd4 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:07.840283 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-87a7d9ea-991e-4560-bf32-0e0360816fd4 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:07.841407 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-87a7d9ea-991e-4560-bf32-0e0360816fd4 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:07.845997 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2c65fca5-4f9d-471d-a41a-bb6605379626 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:07.855747 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2c65fca5-4f9d-471d-a41a-bb6605379626 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:07.872648 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2c65fca5-4f9d-471d-a41a-bb6605379626 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1539 microversion: 2.91 time: 0.383324 Oct 27 03:23:07.876835 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 340/702] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:23:07 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1539 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:23:07.883096 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-301e8fd9-af4a-484f-aa50-f2bee8e17d33 req-2ceccb63-fb39-4607-8a7b-d3fd2688b9ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8877a86d-6529-43e9-9667-0dba515be5cb", "tag": "bee5d28c-c6a9-4629-9830-862dba117f82"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:23:07.919176 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-301e8fd9-af4a-484f-aa50-f2bee8e17d33 req-2ceccb63-fb39-4607-8a7b-d3fd2688b9ab service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:07.922255 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-301e8fd9-af4a-484f-aa50-f2bee8e17d33 req-2ceccb63-fb39-4607-8a7b-d3fd2688b9ab service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:07.922789 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-301e8fd9-af4a-484f-aa50-f2bee8e17d33 req-2ceccb63-fb39-4607-8a7b-d3fd2688b9ab service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:07.947002 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-301e8fd9-af4a-484f-aa50-f2bee8e17d33 req-2ceccb63-fb39-4607-8a7b-d3fd2688b9ab service nova] Creating event network-changed:bee5d28c-c6a9-4629-9830-862dba117f82 for instance 8877a86d-6529-43e9-9667-0dba515be5cb on n-h1-862769-1 Oct 27 03:23:07.953532 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-301e8fd9-af4a-484f-aa50-f2bee8e17d33 req-2ceccb63-fb39-4607-8a7b-d3fd2688b9ab service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075336 Oct 27 03:23:07.954801 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 341/703] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:23:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:23:07.964919 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-94a82f37-df3b-4f9f-8435-fea4f8bbc207 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:07.965636 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-94a82f37-df3b-4f9f-8435-fea4f8bbc207 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: b2ef080f-30ca-4dc5-ba03-9cf1899346a4] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:07.977780 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-94a82f37-df3b-4f9f-8435-fea4f8bbc207 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:07.978605 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-94a82f37-df3b-4f9f-8435-fea4f8bbc207 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:07.979285 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-94a82f37-df3b-4f9f-8435-fea4f8bbc207 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:07.980425 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-94a82f37-df3b-4f9f-8435-fea4f8bbc207 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:07.981127 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-94a82f37-df3b-4f9f-8435-fea4f8bbc207 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:07.981754 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-94a82f37-df3b-4f9f-8435-fea4f8bbc207 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:08.183455 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-87a7d9ea-991e-4560-bf32-0e0360816fd4 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd90bf4a2aa403cacd06bcaeb502640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c18fabfb19904c5ea3c5c096d9d6cad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:08.208198 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-87a7d9ea-991e-4560-bf32-0e0360816fd4 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] 10.222.0.20 "GET /compute/v2.1/servers/8877a86d-6529-43e9-9667-0dba515be5cb" status: 200 len: 1322 microversion: 2.1 time: 0.391753 Oct 27 03:23:08.220347 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 363/704] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:07 2022] GET /compute/v2.1/servers/8877a86d-6529-43e9-9667-0dba515be5cb => generated 1322 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:08.228539 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ea913069-2903-492c-bef0-7cefe065e65d tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:08.229466 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ea913069-2903-492c-bef0-7cefe065e65d tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: ac5fc2b3-c92e-470a-9bc6-885dce75fb8c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:08.237451 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ea913069-2903-492c-bef0-7cefe065e65d tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:08.239805 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ea913069-2903-492c-bef0-7cefe065e65d tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:08.239805 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ea913069-2903-492c-bef0-7cefe065e65d tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:08.239805 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ea913069-2903-492c-bef0-7cefe065e65d tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:08.239805 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ea913069-2903-492c-bef0-7cefe065e65d tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:08.240447 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ea913069-2903-492c-bef0-7cefe065e65d tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:08.382287 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ea913069-2903-492c-bef0-7cefe065e65d tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:08.397359 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ea913069-2903-492c-bef0-7cefe065e65d tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/ac5fc2b3-c92e-470a-9bc6-885dce75fb8c" status: 200 len: 1271 microversion: 2.1 time: 0.173277 Oct 27 03:23:08.399159 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 364/705] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:08 2022] GET /compute/v2.1/servers/ac5fc2b3-c92e-470a-9bc6-885dce75fb8c => generated 1271 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:08.405824 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2f27b294-30ab-4c93-b927-6ba7bcaa9fe2 tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] Action: 'update', calling method: .version_select at 0x7f7ddb06c820>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:23:08.548674 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2f27b294-30ab-4c93-b927-6ba7bcaa9fe2 tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:08.550829 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2f27b294-30ab-4c93-b927-6ba7bcaa9fe2 tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:08.551716 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2f27b294-30ab-4c93-b927-6ba7bcaa9fe2 tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:08.553387 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2f27b294-30ab-4c93-b927-6ba7bcaa9fe2 tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:08.553980 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2f27b294-30ab-4c93-b927-6ba7bcaa9fe2 tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:08.554559 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2f27b294-30ab-4c93-b927-6ba7bcaa9fe2 tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:08.587135 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-94a82f37-df3b-4f9f-8435-fea4f8bbc207 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:08.595758 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-94a82f37-df3b-4f9f-8435-fea4f8bbc207 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4" status: 200 len: 1477 microversion: 2.1 time: 0.638532 Oct 27 03:23:08.609267 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 342/706] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:07 2022] GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4 => generated 1477 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:08.618403 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-10b6a17c-386f-477e-9c63-26f3b17f0afc tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:08.620452 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-10b6a17c-386f-477e-9c63-26f3b17f0afc tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: da3360d3-ca0b-4077-af3e-92731700dada] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:08.631070 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-10b6a17c-386f-477e-9c63-26f3b17f0afc tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:08.631852 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-10b6a17c-386f-477e-9c63-26f3b17f0afc tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:08.632490 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-10b6a17c-386f-477e-9c63-26f3b17f0afc tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:08.640117 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-10b6a17c-386f-477e-9c63-26f3b17f0afc tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:08.640117 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-10b6a17c-386f-477e-9c63-26f3b17f0afc tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:08.640117 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-10b6a17c-386f-477e-9c63-26f3b17f0afc tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:08.698142 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2f27b294-30ab-4c93-b927-6ba7bcaa9fe2 tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/f4eefc2fafef4054b6d4f7d17f645406" status: 200 len: 328 microversion: 2.1 time: 0.296392 Oct 27 03:23:08.701344 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 365/707] 10.222.0.20 () {60 vars in 1262 bytes} [Thu Oct 27 03:23:08 2022] PUT /compute/v2.1/os-quota-sets/f4eefc2fafef4054b6d4f7d17f645406 => generated 328 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:23:08.947203 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1f04327e-a72a-40a0-9757-67b437865cb2 tempest-QuotasAdminNegativeTest-1748205748 tempest-QuotasAdminNegativeTest-1748205748-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-817449193", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:23:08.954713 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-10b6a17c-386f-477e-9c63-26f3b17f0afc tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:08.972886 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-10b6a17c-386f-477e-9c63-26f3b17f0afc tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/da3360d3-ca0b-4077-af3e-92731700dada" status: 200 len: 1503 microversion: 2.1 time: 0.362352 Oct 27 03:23:08.973487 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 343/708] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:08 2022] GET /compute/v2.1/servers/da3360d3-ca0b-4077-af3e-92731700dada => generated 1503 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:08.981287 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0639e420-3dc5-4dc8-b0e2-0fdb161b851f tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:08.981942 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0639e420-3dc5-4dc8-b0e2-0fdb161b851f tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:09.012951 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0639e420-3dc5-4dc8-b0e2-0fdb161b851f tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:09.013839 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0639e420-3dc5-4dc8-b0e2-0fdb161b851f tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:09.015385 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0639e420-3dc5-4dc8-b0e2-0fdb161b851f tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:09.025300 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0639e420-3dc5-4dc8-b0e2-0fdb161b851f tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:09.026245 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0639e420-3dc5-4dc8-b0e2-0fdb161b851f tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:09.026907 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0639e420-3dc5-4dc8-b0e2-0fdb161b851f tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:09.051626 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-1f04327e-a72a-40a0-9757-67b437865cb2 tempest-QuotasAdminNegativeTest-1748205748 tempest-QuotasAdminNegativeTest-1748205748-project] validate_networks() for None {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:23:09.071310 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:09.148298 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0639e420-3dc5-4dc8-b0e2-0fdb161b851f tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:09.161807 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0639e420-3dc5-4dc8-b0e2-0fdb161b851f tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:09.167394 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0639e420-3dc5-4dc8-b0e2-0fdb161b851f tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:09.185003 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0639e420-3dc5-4dc8-b0e2-0fdb161b851f tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1539 microversion: 2.91 time: 0.207271 Oct 27 03:23:09.186074 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 344/709] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:23:08 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1539 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:23:09.234389 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1ebc51d0-5b12-44b4-abcd-3bd5ad564de1 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:09.235019 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1ebc51d0-5b12-44b4-abcd-3bd5ad564de1 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] [instance: 8877a86d-6529-43e9-9667-0dba515be5cb] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:09.243617 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1ebc51d0-5b12-44b4-abcd-3bd5ad564de1 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:09.245677 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1ebc51d0-5b12-44b4-abcd-3bd5ad564de1 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:09.246176 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1ebc51d0-5b12-44b4-abcd-3bd5ad564de1 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:09.246919 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1ebc51d0-5b12-44b4-abcd-3bd5ad564de1 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:09.251764 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1ebc51d0-5b12-44b4-abcd-3bd5ad564de1 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:09.253370 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1ebc51d0-5b12-44b4-abcd-3bd5ad564de1 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:09.424626 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-1f04327e-a72a-40a0-9757-67b437865cb2 tempest-QuotasAdminNegativeTest-1748205748 tempest-QuotasAdminNegativeTest-1748205748-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:23:09.428812 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-1f04327e-a72a-40a0-9757-67b437865cb2 tempest-QuotasAdminNegativeTest-1748205748 tempest-QuotasAdminNegativeTest-1748205748-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:23:09.430553 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-1f04327e-a72a-40a0-9757-67b437865cb2 tempest-QuotasAdminNegativeTest-1748205748 tempest-QuotasAdminNegativeTest-1748205748-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:23:09.431302 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-1f04327e-a72a-40a0-9757-67b437865cb2 tempest-QuotasAdminNegativeTest-1748205748 tempest-QuotasAdminNegativeTest-1748205748-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:23:09.432516 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-1f04327e-a72a-40a0-9757-67b437865cb2 tempest-QuotasAdminNegativeTest-1748205748 tempest-QuotasAdminNegativeTest-1748205748-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:23:09.447924 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1f04327e-a72a-40a0-9757-67b437865cb2 tempest-QuotasAdminNegativeTest-1748205748 tempest-QuotasAdminNegativeTest-1748205748-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:09.448770 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1f04327e-a72a-40a0-9757-67b437865cb2 tempest-QuotasAdminNegativeTest-1748205748 tempest-QuotasAdminNegativeTest-1748205748-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:09.449424 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1f04327e-a72a-40a0-9757-67b437865cb2 tempest-QuotasAdminNegativeTest-1748205748 tempest-QuotasAdminNegativeTest-1748205748-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:09.451148 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1f04327e-a72a-40a0-9757-67b437865cb2 tempest-QuotasAdminNegativeTest-1748205748 tempest-QuotasAdminNegativeTest-1748205748-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:09.453120 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1f04327e-a72a-40a0-9757-67b437865cb2 tempest-QuotasAdminNegativeTest-1748205748 tempest-QuotasAdminNegativeTest-1748205748-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:09.453889 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1f04327e-a72a-40a0-9757-67b437865cb2 tempest-QuotasAdminNegativeTest-1748205748 tempest-QuotasAdminNegativeTest-1748205748-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:09.499691 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1ebc51d0-5b12-44b4-abcd-3bd5ad564de1 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd90bf4a2aa403cacd06bcaeb502640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c18fabfb19904c5ea3c5c096d9d6cad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:09.512077 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1ebc51d0-5b12-44b4-abcd-3bd5ad564de1 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] 10.222.0.20 "GET /compute/v2.1/servers/8877a86d-6529-43e9-9667-0dba515be5cb" status: 200 len: 1322 microversion: 2.1 time: 0.281926 Oct 27 03:23:09.512933 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 345/710] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:09 2022] GET /compute/v2.1/servers/8877a86d-6529-43e9-9667-0dba515be5cb => generated 1322 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:23:09.516804 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:09.525132 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-8114d51b-b501-4d2c-808a-3568e8d0b862 req-e2c8655f-c867-4fac-95f9-3e023bffdcee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da3360d3-ca0b-4077-af3e-92731700dada", "name": "network-vif-unplugged", "status": "completed", "tag": "83172e3e-d564-4455-bfff-b4d4868ccf0d"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:23:09.532269 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-1f04327e-a72a-40a0-9757-67b437865cb2 tempest-QuotasAdminNegativeTest-1748205748 tempest-QuotasAdminNegativeTest-1748205748-project] Getting quotas for project f4eefc2fafef4054b6d4f7d17f645406. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:23:09.545867 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-8114d51b-b501-4d2c-808a-3568e8d0b862 req-e2c8655f-c867-4fac-95f9-3e023bffdcee service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:09.546393 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-8114d51b-b501-4d2c-808a-3568e8d0b862 req-e2c8655f-c867-4fac-95f9-3e023bffdcee service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:09.549483 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-8114d51b-b501-4d2c-808a-3568e8d0b862 req-e2c8655f-c867-4fac-95f9-3e023bffdcee service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:09.551716 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-1f04327e-a72a-40a0-9757-67b437865cb2 tempest-QuotasAdminNegativeTest-1748205748 tempest-QuotasAdminNegativeTest-1748205748-project] Getting quotas for user ac07e3a844b349ce9e2436a4fdf36512 and project f4eefc2fafef4054b6d4f7d17f645406. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:23:09.577911 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-8114d51b-b501-4d2c-808a-3568e8d0b862 req-e2c8655f-c867-4fac-95f9-3e023bffdcee service nova] Creating event network-vif-unplugged:83172e3e-d564-4455-bfff-b4d4868ccf0d for instance da3360d3-ca0b-4077-af3e-92731700dada on n-h2-862769-1 Oct 27 03:23:09.579309 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.utils [None req-1f04327e-a72a-40a0-9757-67b437865cb2 tempest-QuotasAdminNegativeTest-1748205748 tempest-QuotasAdminNegativeTest-1748205748-project] cores quota exceeded for f4eefc2fafef4054b6d4f7d17f645406, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=121000) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 27 03:23:09.582009 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-1f04327e-a72a-40a0-9757-67b437865cb2 tempest-QuotasAdminNegativeTest-1748205748 tempest-QuotasAdminNegativeTest-1748205748-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 27 03:23:09.586972 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1f04327e-a72a-40a0-9757-67b437865cb2 tempest-QuotasAdminNegativeTest-1748205748 tempest-QuotasAdminNegativeTest-1748205748-project] Request method failure captured: Oct 27 03:23:09.586972 n-d-862769-1 devstack@n-api.service[121000]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 03:23:09.586972 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:23:09.586972 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:23:09.586972 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:23:09.586972 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 144 Oct 27 03:23:09.586972 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:23:09.586972 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:23:09.586972 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:23:09.586972 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:23:09.586972 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfmZXoaYxUgFMR6jVGrivhSEzqm6WdmpT8yxCY4K2nEP4IIB7V4p9FP8TOsRRGZYDJhluOJMZbiD6om72VnrR6smL1dPLzFTeXTGAkOUYnFe1SpGOmF7DRGxDfhcluOIBzcxUnilEFuzpc1LAoSQxEdp7I8Je5KxaDDQeT1jKhTZQdI Oct 27 03:23:09.586972 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:23:09.586972 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:23:09.586972 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:23:09.586972 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:23:09.586972 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:23:09.586972 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:23:09.586972 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: f4eefc2fafef4054b6d4f7d17f645406 Oct 27 03:23:09.586972 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-QuotasAdminNegativeTest-1748205748 Oct 27 03:23:09.586972 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:23:09.586972 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:23:09.593446 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f4eefc2fafef4054b6d4f7d17f645406"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f4eefc2fafef4054b6d4f7d17f645406"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f4eefc2fafef4054b6d4f7d17f645406"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f4eefc2fafef4054b6d4f7d17f645406"}]}] Oct 27 03:23:09.593446 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-QuotasAdminNegativeTest-1748205748 Oct 27 03:23:09.593446 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: f4eefc2fafef4054b6d4f7d17f645406 Oct 27 03:23:09.593446 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1748205748 Oct 27 03:23:09.593446 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-QuotasAdminNegativeTest-1748205748-project Oct 27 03:23:09.593446 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:23:09.593446 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:23:09.593446 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: ac07e3a844b349ce9e2436a4fdf36512 Oct 27 03:23:09.593446 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-QuotasAdminNegativeTest-1748205748-project Oct 27 03:23:09.593446 n-d-862769-1 devstack@n-api.service[121000]: Oct 27 03:23:09.593446 n-d-862769-1 devstack@n-api.service[121000]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-817449193", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452"}} Oct 27 03:23:09.593446 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:23:09.594502 n-d-862769-1 devstack@n-api.service[121000]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 27 03:23:09.594502 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-817449193', 'imageRef': 'c40fb871-5877-4b59-ab69-d9fd23b7a917', 'flavorRef': '452'}}} Oct 27 03:23:09.594502 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:23:09.594502 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:23:09.594502 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 27 03:23:09.594502 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 27 03:23:09.594502 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 03:23:09.594502 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 03:23:09.594502 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 27 03:23:09.594502 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc Oct 27 03:23:09.594502 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 27 03:23:09.594502 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 27 03:23:09.594502 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 03:23:09.594502 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 03:23:09.594502 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 27 03:23:09.594502 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 27 03:23:09.594502 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 27 03:23:09.594502 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 27 03:23:09.595818 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 27 03:23:09.595818 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 27 03:23:09.595818 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 27 03:23:09.595818 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:23:09.595818 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:23:09.595818 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:23:09.595818 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:23:09.595818 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 27 03:23:09.595818 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 27 03:23:09.595818 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 27 03:23:09.595818 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 27 03:23:09.595818 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 27 03:23:09.595818 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 27 03:23:09.595818 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 27 03:23:09.595818 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 27 03:23:09.595818 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 27 03:23:09.595818 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 27 03:23:09.595818 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 27 03:23:09.595818 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:23:09.595818 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:23:09.595818 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:23:09.597792 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:23:09.597792 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:23:09.597792 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:23:09.597792 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:23:09.597792 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:23:09.597792 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:23:09.597792 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:23:09.597792 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:23:09.597792 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:23:09.597792 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:23:09.597792 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:23:09.597792 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:23:09.597792 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:23:09.597792 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 27 03:23:09.597792 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 27 03:23:09.597792 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 27 03:23:09.597792 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 27 03:23:09.597792 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:23:09.597792 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:23:09.597792 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:23:09.597792 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:23:09.600765 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:23:09.600765 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:23:09.600765 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:23:09.600765 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:23:09.600765 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 27 03:23:09.600765 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:23:09.600765 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1f04327e-a72a-40a0-9757-67b437865cb2 tempest-QuotasAdminNegativeTest-1748205748 tempest-QuotasAdminNegativeTest-1748205748-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:23:09.601614 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-8114d51b-b501-4d2c-808a-3568e8d0b862 req-e2c8655f-c867-4fac-95f9-3e023bffdcee service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077518 Oct 27 03:23:09.601614 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 346/711] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:23:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:23:09.601614 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9ffa3406-aa51-4e5c-95d4-6308475eb99e tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:09.602019 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1f04327e-a72a-40a0-9757-67b437865cb2 tempest-QuotasAdminNegativeTest-1748205748 tempest-QuotasAdminNegativeTest-1748205748-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.734838 Oct 27 03:23:09.602846 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-9ffa3406-aa51-4e5c-95d4-6308475eb99e tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: ac5fc2b3-c92e-470a-9bc6-885dce75fb8c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:09.603044 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 366/712] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:23:08 2022] POST /compute/v2.1/servers => generated 111 bytes in 745 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:23:09.611177 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e18967ab-8ce1-4565-b9ab-2b3090307122 tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] Action: 'update', calling method: .version_select at 0x7f7ddaa88040>, body: {"quota_set": {"cores": 20}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:23:09.620742 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9ffa3406-aa51-4e5c-95d4-6308475eb99e tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:09.628903 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9ffa3406-aa51-4e5c-95d4-6308475eb99e tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:09.629501 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9ffa3406-aa51-4e5c-95d4-6308475eb99e tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:09.630392 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9ffa3406-aa51-4e5c-95d4-6308475eb99e tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:09.630943 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9ffa3406-aa51-4e5c-95d4-6308475eb99e tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:09.631459 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9ffa3406-aa51-4e5c-95d4-6308475eb99e tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:09.720943 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9ffa3406-aa51-4e5c-95d4-6308475eb99e tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:09.732562 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9ffa3406-aa51-4e5c-95d4-6308475eb99e tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/ac5fc2b3-c92e-470a-9bc6-885dce75fb8c" status: 200 len: 1271 microversion: 2.1 time: 0.138568 Oct 27 03:23:09.734684 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 347/713] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:09 2022] GET /compute/v2.1/servers/ac5fc2b3-c92e-470a-9bc6-885dce75fb8c => generated 1271 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:09.753586 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1cf05536-d3c4-4d88-bfe8-1d6462a2e5ad tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:09.756515 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1cf05536-d3c4-4d88-bfe8-1d6462a2e5ad tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: b2ef080f-30ca-4dc5-ba03-9cf1899346a4] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:09.771342 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1cf05536-d3c4-4d88-bfe8-1d6462a2e5ad tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:09.771873 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1cf05536-d3c4-4d88-bfe8-1d6462a2e5ad tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:09.772354 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1cf05536-d3c4-4d88-bfe8-1d6462a2e5ad tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:09.773108 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1cf05536-d3c4-4d88-bfe8-1d6462a2e5ad tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:09.775746 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1cf05536-d3c4-4d88-bfe8-1d6462a2e5ad tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:09.776199 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1cf05536-d3c4-4d88-bfe8-1d6462a2e5ad tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:10.015131 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e18967ab-8ce1-4565-b9ab-2b3090307122 tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:10.015945 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e18967ab-8ce1-4565-b9ab-2b3090307122 tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:10.016425 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e18967ab-8ce1-4565-b9ab-2b3090307122 tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:10.017167 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e18967ab-8ce1-4565-b9ab-2b3090307122 tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:10.017629 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e18967ab-8ce1-4565-b9ab-2b3090307122 tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:10.018076 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e18967ab-8ce1-4565-b9ab-2b3090307122 tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:10.049172 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1cf05536-d3c4-4d88-bfe8-1d6462a2e5ad tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:10.058923 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1cf05536-d3c4-4d88-bfe8-1d6462a2e5ad tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4" status: 200 len: 1477 microversion: 2.1 time: 0.322950 Oct 27 03:23:10.064640 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 348/714] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:09 2022] GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4 => generated 1477 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:10.076089 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-592e540e-9cf8-44ff-86ac-3f650620a897 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:10.079590 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-592e540e-9cf8-44ff-86ac-3f650620a897 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: da3360d3-ca0b-4077-af3e-92731700dada] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:10.089049 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-592e540e-9cf8-44ff-86ac-3f650620a897 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:10.092052 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-592e540e-9cf8-44ff-86ac-3f650620a897 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:10.093605 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-592e540e-9cf8-44ff-86ac-3f650620a897 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:10.096037 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-592e540e-9cf8-44ff-86ac-3f650620a897 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:10.096852 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-592e540e-9cf8-44ff-86ac-3f650620a897 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:10.100586 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-592e540e-9cf8-44ff-86ac-3f650620a897 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:10.112900 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=100 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:10.291595 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-592e540e-9cf8-44ff-86ac-3f650620a897 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:10.300993 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-592e540e-9cf8-44ff-86ac-3f650620a897 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/da3360d3-ca0b-4077-af3e-92731700dada" status: 200 len: 1503 microversion: 2.1 time: 0.235102 Oct 27 03:23:10.304915 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 349/715] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:10 2022] GET /compute/v2.1/servers/da3360d3-ca0b-4077-af3e-92731700dada => generated 1503 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:10.311103 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3f0a19b6-9ba7-4382-9c4b-be90b5cc8981 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:10.318218 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3f0a19b6-9ba7-4382-9c4b-be90b5cc8981 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:10.322206 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e18967ab-8ce1-4565-b9ab-2b3090307122 tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/f4eefc2fafef4054b6d4f7d17f645406" status: 200 len: 329 microversion: 2.1 time: 0.714409 Oct 27 03:23:10.323183 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 367/716] 10.222.0.20 () {60 vars in 1262 bytes} [Thu Oct 27 03:23:09 2022] PUT /compute/v2.1/os-quota-sets/f4eefc2fafef4054b6d4f7d17f645406 => generated 329 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:23:10.338490 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3f0a19b6-9ba7-4382-9c4b-be90b5cc8981 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:10.339362 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3f0a19b6-9ba7-4382-9c4b-be90b5cc8981 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:10.340040 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3f0a19b6-9ba7-4382-9c4b-be90b5cc8981 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:10.341408 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3f0a19b6-9ba7-4382-9c4b-be90b5cc8981 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:10.342134 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3f0a19b6-9ba7-4382-9c4b-be90b5cc8981 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:10.343356 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3f0a19b6-9ba7-4382-9c4b-be90b5cc8981 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:10.355712 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4c077ab0-6758-4bac-8254-be2708f79e77 tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] Calling method '.version_select at 0x7f7ddaa61ca0>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:10.367189 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=13 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:10.403481 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=68 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:10.542588 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3f0a19b6-9ba7-4382-9c4b-be90b5cc8981 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:10.551404 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3f0a19b6-9ba7-4382-9c4b-be90b5cc8981 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:10.553028 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3f0a19b6-9ba7-4382-9c4b-be90b5cc8981 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:10.568314 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3f0a19b6-9ba7-4382-9c4b-be90b5cc8981 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1539 microversion: 2.91 time: 0.261976 Oct 27 03:23:10.583972 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 350/717] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:23:10 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1539 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:23:10.599582 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1ba94c49-c04a-4901-96a3-4a02ff7f68d5 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:10.605911 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1ba94c49-c04a-4901-96a3-4a02ff7f68d5 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] [instance: 8877a86d-6529-43e9-9667-0dba515be5cb] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:10.617139 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4c077ab0-6758-4bac-8254-be2708f79e77 tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/f4eefc2fafef4054b6d4f7d17f645406" status: 200 len: 371 microversion: 2.1 time: 0.274368 Oct 27 03:23:10.618766 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 368/718] 10.222.0.20 () {58 vars in 1242 bytes} [Thu Oct 27 03:23:10 2022] GET /compute/v2.1/os-quota-sets/f4eefc2fafef4054b6d4f7d17f645406 => generated 371 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:23:10.626431 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1ba94c49-c04a-4901-96a3-4a02ff7f68d5 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:10.627151 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1ba94c49-c04a-4901-96a3-4a02ff7f68d5 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:10.627760 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1ba94c49-c04a-4901-96a3-4a02ff7f68d5 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:10.628684 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1ba94c49-c04a-4901-96a3-4a02ff7f68d5 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:10.629299 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1ba94c49-c04a-4901-96a3-4a02ff7f68d5 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:10.629897 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1ba94c49-c04a-4901-96a3-4a02ff7f68d5 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:10.650286 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2d3cb6ae-08b9-4292-aff5-95971a89902a tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] Action: 'update', calling method: .version_select at 0x7f7ddaa61d30>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:23:10.748898 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2d3cb6ae-08b9-4292-aff5-95971a89902a tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:10.749816 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2d3cb6ae-08b9-4292-aff5-95971a89902a tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:10.751018 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2d3cb6ae-08b9-4292-aff5-95971a89902a tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:10.752762 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2d3cb6ae-08b9-4292-aff5-95971a89902a tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:10.753781 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2d3cb6ae-08b9-4292-aff5-95971a89902a tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:10.754560 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2d3cb6ae-08b9-4292-aff5-95971a89902a tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:10.927656 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1ba94c49-c04a-4901-96a3-4a02ff7f68d5 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd90bf4a2aa403cacd06bcaeb502640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c18fabfb19904c5ea3c5c096d9d6cad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:10.937178 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1ba94c49-c04a-4901-96a3-4a02ff7f68d5 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] 10.222.0.20 "GET /compute/v2.1/servers/8877a86d-6529-43e9-9667-0dba515be5cb" status: 200 len: 1322 microversion: 2.1 time: 0.351464 Oct 27 03:23:10.940899 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 351/719] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:10 2022] GET /compute/v2.1/servers/8877a86d-6529-43e9-9667-0dba515be5cb => generated 1322 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:10.949104 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-fb9d6d23-2b00-4067-b792-98f2d378c645 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:10.950659 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-fb9d6d23-2b00-4067-b792-98f2d378c645 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: ac5fc2b3-c92e-470a-9bc6-885dce75fb8c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:10.958928 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fb9d6d23-2b00-4067-b792-98f2d378c645 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:10.960218 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fb9d6d23-2b00-4067-b792-98f2d378c645 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:10.960908 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fb9d6d23-2b00-4067-b792-98f2d378c645 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:10.961898 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fb9d6d23-2b00-4067-b792-98f2d378c645 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:10.962606 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fb9d6d23-2b00-4067-b792-98f2d378c645 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:10.963264 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fb9d6d23-2b00-4067-b792-98f2d378c645 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:10.988613 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2d3cb6ae-08b9-4292-aff5-95971a89902a tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/f4eefc2fafef4054b6d4f7d17f645406" status: 200 len: 328 microversion: 2.1 time: 0.362294 Oct 27 03:23:10.990240 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 369/720] 10.222.0.20 () {60 vars in 1262 bytes} [Thu Oct 27 03:23:10 2022] PUT /compute/v2.1/os-quota-sets/f4eefc2fafef4054b6d4f7d17f645406 => generated 328 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:23:11.089357 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-fb9d6d23-2b00-4067-b792-98f2d378c645 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:11.091792 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-39d61e3d-78e3-4d7c-bbf2-db1e57b21fc7 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:11.092428 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-39d61e3d-78e3-4d7c-bbf2-db1e57b21fc7 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: b2ef080f-30ca-4dc5-ba03-9cf1899346a4] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:11.101471 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-39d61e3d-78e3-4d7c-bbf2-db1e57b21fc7 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:11.102685 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-39d61e3d-78e3-4d7c-bbf2-db1e57b21fc7 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:11.103423 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-39d61e3d-78e3-4d7c-bbf2-db1e57b21fc7 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:11.104368 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-39d61e3d-78e3-4d7c-bbf2-db1e57b21fc7 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:11.105019 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-fb9d6d23-2b00-4067-b792-98f2d378c645 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/ac5fc2b3-c92e-470a-9bc6-885dce75fb8c" status: 200 len: 1277 microversion: 2.1 time: 0.160643 Oct 27 03:23:11.105282 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-39d61e3d-78e3-4d7c-bbf2-db1e57b21fc7 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:11.105627 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 352/721] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:10 2022] GET /compute/v2.1/servers/ac5fc2b3-c92e-470a-9bc6-885dce75fb8c => generated 1277 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:11.106292 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-39d61e3d-78e3-4d7c-bbf2-db1e57b21fc7 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:11.213069 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-bbc13da3-607b-402a-bce6-007c6dd23622 tempest-QuotasAdminNegativeTest-1748205748 tempest-QuotasAdminNegativeTest-1748205748-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1163237669", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:23:11.276505 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.network.neutron [None req-bbc13da3-607b-402a-bce6-007c6dd23622 tempest-QuotasAdminNegativeTest-1748205748 tempest-QuotasAdminNegativeTest-1748205748-project] validate_networks() for None {{(pid=121001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:23:11.502836 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-39d61e3d-78e3-4d7c-bbf2-db1e57b21fc7 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:11.508490 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=100 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:11.509838 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-bbc13da3-607b-402a-bce6-007c6dd23622 tempest-QuotasAdminNegativeTest-1748205748 tempest-QuotasAdminNegativeTest-1748205748-project] Flavor limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:23:11.511423 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-bbc13da3-607b-402a-bce6-007c6dd23622 tempest-QuotasAdminNegativeTest-1748205748 tempest-QuotasAdminNegativeTest-1748205748-project] Image limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:23:11.511423 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-bbc13da3-607b-402a-bce6-007c6dd23622 tempest-QuotasAdminNegativeTest-1748205748 tempest-QuotasAdminNegativeTest-1748205748-project] Flavor pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:23:11.511872 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-bbc13da3-607b-402a-bce6-007c6dd23622 tempest-QuotasAdminNegativeTest-1748205748 tempest-QuotasAdminNegativeTest-1748205748-project] Image pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:23:11.512511 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-bbc13da3-607b-402a-bce6-007c6dd23622 tempest-QuotasAdminNegativeTest-1748205748 tempest-QuotasAdminNegativeTest-1748205748-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:23:11.522301 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-39d61e3d-78e3-4d7c-bbf2-db1e57b21fc7 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4" status: 200 len: 1477 microversion: 2.1 time: 0.434577 Oct 27 03:23:11.523699 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 370/722] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:11 2022] GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4 => generated 1477 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:11.541665 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bbc13da3-607b-402a-bce6-007c6dd23622 tempest-QuotasAdminNegativeTest-1748205748 tempest-QuotasAdminNegativeTest-1748205748-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:11.541864 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bbc13da3-607b-402a-bce6-007c6dd23622 tempest-QuotasAdminNegativeTest-1748205748 tempest-QuotasAdminNegativeTest-1748205748-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:11.542915 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bbc13da3-607b-402a-bce6-007c6dd23622 tempest-QuotasAdminNegativeTest-1748205748 tempest-QuotasAdminNegativeTest-1748205748-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:11.543887 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bbc13da3-607b-402a-bce6-007c6dd23622 tempest-QuotasAdminNegativeTest-1748205748 tempest-QuotasAdminNegativeTest-1748205748-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:11.545181 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bbc13da3-607b-402a-bce6-007c6dd23622 tempest-QuotasAdminNegativeTest-1748205748 tempest-QuotasAdminNegativeTest-1748205748-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:11.558585 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bbc13da3-607b-402a-bce6-007c6dd23622 tempest-QuotasAdminNegativeTest-1748205748 tempest-QuotasAdminNegativeTest-1748205748-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:11.558847 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-786f94e0-75cc-4477-aab2-d9d9b3431004 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:11.558847 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-786f94e0-75cc-4477-aab2-d9d9b3431004 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: da3360d3-ca0b-4077-af3e-92731700dada] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:11.566474 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-786f94e0-75cc-4477-aab2-d9d9b3431004 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:11.567279 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-786f94e0-75cc-4477-aab2-d9d9b3431004 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:11.568159 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-786f94e0-75cc-4477-aab2-d9d9b3431004 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:11.569303 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-786f94e0-75cc-4477-aab2-d9d9b3431004 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:11.570006 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-786f94e0-75cc-4477-aab2-d9d9b3431004 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:11.570715 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-786f94e0-75cc-4477-aab2-d9d9b3431004 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:11.586511 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-bbc13da3-607b-402a-bce6-007c6dd23622 tempest-QuotasAdminNegativeTest-1748205748 tempest-QuotasAdminNegativeTest-1748205748-project] Getting quotas for project f4eefc2fafef4054b6d4f7d17f645406. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:23:11.602234 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-bbc13da3-607b-402a-bce6-007c6dd23622 tempest-QuotasAdminNegativeTest-1748205748 tempest-QuotasAdminNegativeTest-1748205748-project] Getting quotas for user ac07e3a844b349ce9e2436a4fdf36512 and project f4eefc2fafef4054b6d4f7d17f645406. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:23:11.640139 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.utils [None req-bbc13da3-607b-402a-bce6-007c6dd23622 tempest-QuotasAdminNegativeTest-1748205748 tempest-QuotasAdminNegativeTest-1748205748-project] instances quota exceeded for f4eefc2fafef4054b6d4f7d17f645406, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=121001) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 27 03:23:11.641267 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-bbc13da3-607b-402a-bce6-007c6dd23622 tempest-QuotasAdminNegativeTest-1748205748 tempest-QuotasAdminNegativeTest-1748205748-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 27 03:23:11.652379 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-bbc13da3-607b-402a-bce6-007c6dd23622 tempest-QuotasAdminNegativeTest-1748205748 tempest-QuotasAdminNegativeTest-1748205748-project] Request method failure captured: Oct 27 03:23:11.652379 n-d-862769-1 devstack@n-api.service[121001]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 03:23:11.652379 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:23:11.652379 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:23:11.652379 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:23:11.652379 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 145 Oct 27 03:23:11.652379 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:23:11.652379 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:23:11.652379 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:23:11.652379 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:23:11.652379 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfmZXoaYxUgFMR6jVGrivhSEzqm6WdmpT8yxCY4K2nEP4IIB7V4p9FP8TOsRRGZYDJhluOJMZbiD6om72VnrR6smL1dPLzFTeXTGAkOUYnFe1SpGOmF7DRGxDfhcluOIBzcxUnilEFuzpc1LAoSQxEdp7I8Je5KxaDDQeT1jKhTZQdI Oct 27 03:23:11.652379 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:23:11.652379 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:23:11.652379 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:23:11.652379 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:23:11.652379 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:23:11.652379 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:23:11.652379 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: f4eefc2fafef4054b6d4f7d17f645406 Oct 27 03:23:11.652379 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-QuotasAdminNegativeTest-1748205748 Oct 27 03:23:11.652379 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:23:11.652379 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:23:11.653955 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f4eefc2fafef4054b6d4f7d17f645406"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f4eefc2fafef4054b6d4f7d17f645406"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f4eefc2fafef4054b6d4f7d17f645406"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f4eefc2fafef4054b6d4f7d17f645406"}]}] Oct 27 03:23:11.653955 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-QuotasAdminNegativeTest-1748205748 Oct 27 03:23:11.653955 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: f4eefc2fafef4054b6d4f7d17f645406 Oct 27 03:23:11.653955 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1748205748 Oct 27 03:23:11.653955 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-QuotasAdminNegativeTest-1748205748-project Oct 27 03:23:11.653955 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:23:11.653955 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:23:11.653955 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: ac07e3a844b349ce9e2436a4fdf36512 Oct 27 03:23:11.653955 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-QuotasAdminNegativeTest-1748205748-project Oct 27 03:23:11.653955 n-d-862769-1 devstack@n-api.service[121001]: Oct 27 03:23:11.653955 n-d-862769-1 devstack@n-api.service[121001]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1163237669", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452"}} Oct 27 03:23:11.653955 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:23:11.654845 n-d-862769-1 devstack@n-api.service[121001]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 27 03:23:11.654845 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1163237669', 'imageRef': 'c40fb871-5877-4b59-ab69-d9fd23b7a917', 'flavorRef': '452'}}} Oct 27 03:23:11.654845 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:23:11.654845 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:23:11.654845 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 27 03:23:11.654845 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 27 03:23:11.654845 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 03:23:11.654845 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 03:23:11.654845 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 27 03:23:11.654845 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc Oct 27 03:23:11.654845 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 27 03:23:11.654845 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 27 03:23:11.654845 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 03:23:11.654845 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 03:23:11.654845 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 27 03:23:11.654845 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 27 03:23:11.654845 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 27 03:23:11.654845 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 27 03:23:11.656618 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 27 03:23:11.656618 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 27 03:23:11.656618 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Oct 27 03:23:11.656618 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:23:11.656618 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:23:11.656618 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:23:11.656618 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:23:11.656618 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 27 03:23:11.656618 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 27 03:23:11.656618 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 27 03:23:11.656618 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 27 03:23:11.656618 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 27 03:23:11.656618 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 27 03:23:11.656618 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 27 03:23:11.656618 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 27 03:23:11.656618 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 27 03:23:11.656618 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 27 03:23:11.656618 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 27 03:23:11.656618 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:23:11.656618 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:23:11.656618 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:23:11.658139 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:23:11.658139 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:23:11.658139 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:23:11.658139 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:23:11.658139 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:23:11.658139 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:23:11.658139 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:23:11.658139 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:23:11.658139 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:23:11.658139 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:23:11.658139 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:23:11.658139 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:23:11.658139 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:23:11.658139 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 27 03:23:11.658139 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 27 03:23:11.658139 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 27 03:23:11.658139 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 27 03:23:11.658139 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:23:11.658139 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:23:11.658139 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:23:11.658139 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:23:11.659965 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:23:11.659965 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:23:11.659965 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:23:11.659965 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:23:11.659965 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 27 03:23:11.659965 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:23:11.659965 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-bbc13da3-607b-402a-bce6-007c6dd23622 tempest-QuotasAdminNegativeTest-1748205748 tempest-QuotasAdminNegativeTest-1748205748-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:23:11.659965 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-bbc13da3-607b-402a-bce6-007c6dd23622 tempest-QuotasAdminNegativeTest-1748205748 tempest-QuotasAdminNegativeTest-1748205748-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.444932 Oct 27 03:23:11.661582 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 353/723] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:23:11 2022] POST /compute/v2.1/servers => generated 119 bytes in 451 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 27 03:23:11.673140 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8d02a4b3-da60-45d0-85c1-eb4b57593ce9 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:11.673802 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8d02a4b3-da60-45d0-85c1-eb4b57593ce9 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:11.685642 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8d02a4b3-da60-45d0-85c1-eb4b57593ce9 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:11.686195 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8d02a4b3-da60-45d0-85c1-eb4b57593ce9 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:11.686748 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8d02a4b3-da60-45d0-85c1-eb4b57593ce9 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:11.687482 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8d02a4b3-da60-45d0-85c1-eb4b57593ce9 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:11.687949 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8d02a4b3-da60-45d0-85c1-eb4b57593ce9 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:11.688800 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8d02a4b3-da60-45d0-85c1-eb4b57593ce9 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:11.795434 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8d02a4b3-da60-45d0-85c1-eb4b57593ce9 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:11.809416 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8d02a4b3-da60-45d0-85c1-eb4b57593ce9 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:11.811485 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8d02a4b3-da60-45d0-85c1-eb4b57593ce9 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:11.816707 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-786f94e0-75cc-4477-aab2-d9d9b3431004 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:11.817546 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8d02a4b3-da60-45d0-85c1-eb4b57593ce9 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1539 microversion: 2.91 time: 0.152533 Oct 27 03:23:11.833942 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 354/724] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:23:11 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1539 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:23:11.833942 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-d328168f-34bc-4742-9af1-1ba014fe6936 req-0453c15a-7a1e-456c-b5c8-5028d945b825 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da3360d3-ca0b-4077-af3e-92731700dada", "tag": "83172e3e-d564-4455-bfff-b4d4868ccf0d"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:23:11.840551 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-d328168f-34bc-4742-9af1-1ba014fe6936 req-0453c15a-7a1e-456c-b5c8-5028d945b825 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:11.841154 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-d328168f-34bc-4742-9af1-1ba014fe6936 req-0453c15a-7a1e-456c-b5c8-5028d945b825 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:11.841599 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-d328168f-34bc-4742-9af1-1ba014fe6936 req-0453c15a-7a1e-456c-b5c8-5028d945b825 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:11.846067 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-786f94e0-75cc-4477-aab2-d9d9b3431004 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/da3360d3-ca0b-4077-af3e-92731700dada" status: 200 len: 1503 microversion: 2.1 time: 0.320868 Oct 27 03:23:11.848232 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 371/725] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:11 2022] GET /compute/v2.1/servers/da3360d3-ca0b-4077-af3e-92731700dada => generated 1503 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:11.857861 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c643ae15-c45f-465b-a66f-5074636d741e tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] Action: 'update', calling method: .version_select at 0x7f7ddaac3310>, body: {"quota_set": {"instances": 10}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:23:11.869019 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-d328168f-34bc-4742-9af1-1ba014fe6936 req-0453c15a-7a1e-456c-b5c8-5028d945b825 service nova] Creating event network-changed:83172e3e-d564-4455-bfff-b4d4868ccf0d for instance da3360d3-ca0b-4077-af3e-92731700dada on n-h2-862769-1 Oct 27 03:23:11.875891 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-d328168f-34bc-4742-9af1-1ba014fe6936 req-0453c15a-7a1e-456c-b5c8-5028d945b825 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054531 Oct 27 03:23:11.878222 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 355/726] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:23:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:23:11.949755 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c643ae15-c45f-465b-a66f-5074636d741e tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:11.950545 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c643ae15-c45f-465b-a66f-5074636d741e tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:11.951308 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c643ae15-c45f-465b-a66f-5074636d741e tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:11.953139 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c643ae15-c45f-465b-a66f-5074636d741e tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:11.958595 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c643ae15-c45f-465b-a66f-5074636d741e tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:11.958595 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c643ae15-c45f-465b-a66f-5074636d741e tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:11.969327 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-55ff67ba-3da6-472f-8167-483ed078e22c tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:11.970200 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-55ff67ba-3da6-472f-8167-483ed078e22c tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] [instance: 8877a86d-6529-43e9-9667-0dba515be5cb] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:11.977333 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-55ff67ba-3da6-472f-8167-483ed078e22c tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:11.977954 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-55ff67ba-3da6-472f-8167-483ed078e22c tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:11.978443 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-55ff67ba-3da6-472f-8167-483ed078e22c tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:11.980480 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-55ff67ba-3da6-472f-8167-483ed078e22c tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:11.981463 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-55ff67ba-3da6-472f-8167-483ed078e22c tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:11.981613 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-55ff67ba-3da6-472f-8167-483ed078e22c tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:12.149031 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c643ae15-c45f-465b-a66f-5074636d741e tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/f4eefc2fafef4054b6d4f7d17f645406" status: 200 len: 329 microversion: 2.1 time: 0.300784 Oct 27 03:23:12.159533 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 372/727] 10.222.0.20 () {60 vars in 1262 bytes} [Thu Oct 27 03:23:11 2022] PUT /compute/v2.1/os-quota-sets/f4eefc2fafef4054b6d4f7d17f645406 => generated 329 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:23:12.172620 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-3bea1e00-eb91-4331-8651-4063f9fd8e72 req-a3df3a5e-bf14-4b7c-8118-d52615d35288 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f360a9c-90c7-4efd-90c2-c0d3bd15c154", "tag": "d05292be-7d41-4722-906b-1b0c37b313fc"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:23:12.179336 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-3bea1e00-eb91-4331-8651-4063f9fd8e72 req-a3df3a5e-bf14-4b7c-8118-d52615d35288 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:12.191246 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-3bea1e00-eb91-4331-8651-4063f9fd8e72 req-a3df3a5e-bf14-4b7c-8118-d52615d35288 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:12.194689 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-3bea1e00-eb91-4331-8651-4063f9fd8e72 req-a3df3a5e-bf14-4b7c-8118-d52615d35288 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:12.229539 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-3bea1e00-eb91-4331-8651-4063f9fd8e72 req-a3df3a5e-bf14-4b7c-8118-d52615d35288 service nova] Creating event network-changed:d05292be-7d41-4722-906b-1b0c37b313fc for instance 6f360a9c-90c7-4efd-90c2-c0d3bd15c154 on n-h2-862769-1 Oct 27 03:23:12.236644 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-3bea1e00-eb91-4331-8651-4063f9fd8e72 req-a3df3a5e-bf14-4b7c-8118-d52615d35288 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075213 Oct 27 03:23:12.237829 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 373/728] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:23:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:23:12.243896 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b5c04d18-c215-41f8-a346-4ec44a19a47d tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:12.244802 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b5c04d18-c215-41f8-a346-4ec44a19a47d tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: ac5fc2b3-c92e-470a-9bc6-885dce75fb8c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:12.257659 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b5c04d18-c215-41f8-a346-4ec44a19a47d tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:12.260153 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b5c04d18-c215-41f8-a346-4ec44a19a47d tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:12.260923 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b5c04d18-c215-41f8-a346-4ec44a19a47d tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:12.261996 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b5c04d18-c215-41f8-a346-4ec44a19a47d tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:12.262593 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b5c04d18-c215-41f8-a346-4ec44a19a47d tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:12.263303 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b5c04d18-c215-41f8-a346-4ec44a19a47d tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:12.389071 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b5c04d18-c215-41f8-a346-4ec44a19a47d tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:12.398616 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b5c04d18-c215-41f8-a346-4ec44a19a47d tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/ac5fc2b3-c92e-470a-9bc6-885dce75fb8c" status: 200 len: 1277 microversion: 2.1 time: 0.159265 Oct 27 03:23:12.399351 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 374/729] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:12 2022] GET /compute/v2.1/servers/ac5fc2b3-c92e-470a-9bc6-885dce75fb8c => generated 1277 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:12.404599 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b5b7e736-f3e2-4770-87d4-996bc3c45d4a tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] Calling method '.version_select at 0x7f7ddaa61b80>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:12.466205 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-55ff67ba-3da6-472f-8167-483ed078e22c tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd90bf4a2aa403cacd06bcaeb502640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c18fabfb19904c5ea3c5c096d9d6cad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:12.476027 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-55ff67ba-3da6-472f-8167-483ed078e22c tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] 10.222.0.20 "GET /compute/v2.1/servers/8877a86d-6529-43e9-9667-0dba515be5cb" status: 200 len: 1322 microversion: 2.1 time: 0.512651 Oct 27 03:23:12.477471 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 356/730] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:11 2022] GET /compute/v2.1/servers/8877a86d-6529-43e9-9667-0dba515be5cb => generated 1322 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:23:12.524263 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b5b7e736-f3e2-4770-87d4-996bc3c45d4a tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/f4eefc2fafef4054b6d4f7d17f645406" status: 200 len: 371 microversion: 2.1 time: 0.123688 Oct 27 03:23:12.532220 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 375/731] 10.222.0.20 () {58 vars in 1242 bytes} [Thu Oct 27 03:23:12 2022] GET /compute/v2.1/os-quota-sets/f4eefc2fafef4054b6d4f7d17f645406 => generated 371 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:23:12.541467 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-53475c9a-7815-46bd-a29f-aab360201f61 tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] Action: 'update', calling method: .version_select at 0x7f7ddb5dbaf0>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:23:12.546594 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-227840d0-a4ae-4877-bc9f-0adfceaea0c0 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:12.547428 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-227840d0-a4ae-4877-bc9f-0adfceaea0c0 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: b2ef080f-30ca-4dc5-ba03-9cf1899346a4] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:12.557270 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-227840d0-a4ae-4877-bc9f-0adfceaea0c0 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:12.557798 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-227840d0-a4ae-4877-bc9f-0adfceaea0c0 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:12.558288 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-227840d0-a4ae-4877-bc9f-0adfceaea0c0 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:12.559251 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-227840d0-a4ae-4877-bc9f-0adfceaea0c0 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:12.559644 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-227840d0-a4ae-4877-bc9f-0adfceaea0c0 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:12.560620 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-227840d0-a4ae-4877-bc9f-0adfceaea0c0 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:12.636637 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-53475c9a-7815-46bd-a29f-aab360201f61 tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:12.642825 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-53475c9a-7815-46bd-a29f-aab360201f61 tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:12.643303 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-53475c9a-7815-46bd-a29f-aab360201f61 tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:12.644150 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-53475c9a-7815-46bd-a29f-aab360201f61 tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:12.644624 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-53475c9a-7815-46bd-a29f-aab360201f61 tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:12.645071 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-53475c9a-7815-46bd-a29f-aab360201f61 tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:12.848343 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:12.850229 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-227840d0-a4ae-4877-bc9f-0adfceaea0c0 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:12.861592 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-227840d0-a4ae-4877-bc9f-0adfceaea0c0 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4" status: 200 len: 1477 microversion: 2.1 time: 0.319730 Oct 27 03:23:12.862560 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 376/732] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:12 2022] GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4 => generated 1477 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:12.873480 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-df1bb3fd-e036-42a0-9c0f-d6a18e76ae2e tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:12.874725 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-df1bb3fd-e036-42a0-9c0f-d6a18e76ae2e tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:12.880778 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-53475c9a-7815-46bd-a29f-aab360201f61 tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/f4eefc2fafef4054b6d4f7d17f645406" status: 200 len: 325 microversion: 2.1 time: 0.347372 Oct 27 03:23:12.895657 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 357/733] 10.222.0.20 () {60 vars in 1262 bytes} [Thu Oct 27 03:23:12 2022] PUT /compute/v2.1/os-quota-sets/f4eefc2fafef4054b6d4f7d17f645406 => generated 325 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:23:12.912670 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-df1bb3fd-e036-42a0-9c0f-d6a18e76ae2e tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:12.913189 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-df1bb3fd-e036-42a0-9c0f-d6a18e76ae2e tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:12.913649 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-df1bb3fd-e036-42a0-9c0f-d6a18e76ae2e tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:12.927205 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-df1bb3fd-e036-42a0-9c0f-d6a18e76ae2e tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:12.927205 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-df1bb3fd-e036-42a0-9c0f-d6a18e76ae2e tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:12.927205 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-df1bb3fd-e036-42a0-9c0f-d6a18e76ae2e tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:12.944710 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ab330d1a-b041-404b-81db-0f0a063ef07b tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:12.945347 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ab330d1a-b041-404b-81db-0f0a063ef07b tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: da3360d3-ca0b-4077-af3e-92731700dada] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:12.968230 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ab330d1a-b041-404b-81db-0f0a063ef07b tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:12.968731 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ab330d1a-b041-404b-81db-0f0a063ef07b tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:12.969174 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ab330d1a-b041-404b-81db-0f0a063ef07b tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:12.969902 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ab330d1a-b041-404b-81db-0f0a063ef07b tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:12.980340 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ab330d1a-b041-404b-81db-0f0a063ef07b tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:12.980855 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ab330d1a-b041-404b-81db-0f0a063ef07b tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:13.129517 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-df1bb3fd-e036-42a0-9c0f-d6a18e76ae2e tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:13.137317 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-df1bb3fd-e036-42a0-9c0f-d6a18e76ae2e tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:13.139147 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-df1bb3fd-e036-42a0-9c0f-d6a18e76ae2e tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:13.153725 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-df1bb3fd-e036-42a0-9c0f-d6a18e76ae2e tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1539 microversion: 2.91 time: 0.288395 Oct 27 03:23:13.157275 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 377/734] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:23:12 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1539 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:23:13.168467 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e39bda69-52be-42ef-9014-f86293518ead tempest-QuotasAdminNegativeTest-1748205748 tempest-QuotasAdminNegativeTest-1748205748-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-657415693", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:23:13.257063 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-e39bda69-52be-42ef-9014-f86293518ead tempest-QuotasAdminNegativeTest-1748205748 tempest-QuotasAdminNegativeTest-1748205748-project] validate_networks() for None {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:23:13.528688 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-e39bda69-52be-42ef-9014-f86293518ead tempest-QuotasAdminNegativeTest-1748205748 tempest-QuotasAdminNegativeTest-1748205748-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:23:13.529351 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-e39bda69-52be-42ef-9014-f86293518ead tempest-QuotasAdminNegativeTest-1748205748 tempest-QuotasAdminNegativeTest-1748205748-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:23:13.529824 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-e39bda69-52be-42ef-9014-f86293518ead tempest-QuotasAdminNegativeTest-1748205748 tempest-QuotasAdminNegativeTest-1748205748-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:23:13.530850 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-e39bda69-52be-42ef-9014-f86293518ead tempest-QuotasAdminNegativeTest-1748205748 tempest-QuotasAdminNegativeTest-1748205748-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:23:13.531272 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-e39bda69-52be-42ef-9014-f86293518ead tempest-QuotasAdminNegativeTest-1748205748 tempest-QuotasAdminNegativeTest-1748205748-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:23:13.554284 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e39bda69-52be-42ef-9014-f86293518ead tempest-QuotasAdminNegativeTest-1748205748 tempest-QuotasAdminNegativeTest-1748205748-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:13.554998 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e39bda69-52be-42ef-9014-f86293518ead tempest-QuotasAdminNegativeTest-1748205748 tempest-QuotasAdminNegativeTest-1748205748-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:13.555603 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e39bda69-52be-42ef-9014-f86293518ead tempest-QuotasAdminNegativeTest-1748205748 tempest-QuotasAdminNegativeTest-1748205748-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:13.556542 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e39bda69-52be-42ef-9014-f86293518ead tempest-QuotasAdminNegativeTest-1748205748 tempest-QuotasAdminNegativeTest-1748205748-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:13.557159 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e39bda69-52be-42ef-9014-f86293518ead tempest-QuotasAdminNegativeTest-1748205748 tempest-QuotasAdminNegativeTest-1748205748-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:13.557746 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e39bda69-52be-42ef-9014-f86293518ead tempest-QuotasAdminNegativeTest-1748205748 tempest-QuotasAdminNegativeTest-1748205748-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:13.563372 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ab330d1a-b041-404b-81db-0f0a063ef07b tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:13.578707 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-e39bda69-52be-42ef-9014-f86293518ead tempest-QuotasAdminNegativeTest-1748205748 tempest-QuotasAdminNegativeTest-1748205748-project] Getting quotas for project f4eefc2fafef4054b6d4f7d17f645406. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:23:13.579419 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ab330d1a-b041-404b-81db-0f0a063ef07b tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/da3360d3-ca0b-4077-af3e-92731700dada" status: 200 len: 1503 microversion: 2.1 time: 0.682534 Oct 27 03:23:13.584740 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-e39bda69-52be-42ef-9014-f86293518ead tempest-QuotasAdminNegativeTest-1748205748 tempest-QuotasAdminNegativeTest-1748205748-project] Getting quotas for user ac07e3a844b349ce9e2436a4fdf36512 and project f4eefc2fafef4054b6d4f7d17f645406. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:23:13.594421 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 358/735] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:12 2022] GET /compute/v2.1/servers/da3360d3-ca0b-4077-af3e-92731700dada => generated 1503 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:13.599783 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.utils [None req-e39bda69-52be-42ef-9014-f86293518ead tempest-QuotasAdminNegativeTest-1748205748 tempest-QuotasAdminNegativeTest-1748205748-project] ram quota exceeded for f4eefc2fafef4054b6d4f7d17f645406, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=121000) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 27 03:23:13.600544 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-e39bda69-52be-42ef-9014-f86293518ead tempest-QuotasAdminNegativeTest-1748205748 tempest-QuotasAdminNegativeTest-1748205748-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 27 03:23:13.601214 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-771b2204-9186-42d9-9545-05e28fb33a6c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:13.601845 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-771b2204-9186-42d9-9545-05e28fb33a6c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: ac5fc2b3-c92e-470a-9bc6-885dce75fb8c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:13.603179 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e39bda69-52be-42ef-9014-f86293518ead tempest-QuotasAdminNegativeTest-1748205748 tempest-QuotasAdminNegativeTest-1748205748-project] Request method failure captured: Oct 27 03:23:13.603179 n-d-862769-1 devstack@n-api.service[121000]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 03:23:13.603179 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:23:13.603179 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:23:13.603179 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:23:13.603179 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 144 Oct 27 03:23:13.603179 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:23:13.603179 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:23:13.603179 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:23:13.603179 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:23:13.603179 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfmZXoaYxUgFMR6jVGrivhSEzqm6WdmpT8yxCY4K2nEP4IIB7V4p9FP8TOsRRGZYDJhluOJMZbiD6om72VnrR6smL1dPLzFTeXTGAkOUYnFe1SpGOmF7DRGxDfhcluOIBzcxUnilEFuzpc1LAoSQxEdp7I8Je5KxaDDQeT1jKhTZQdI Oct 27 03:23:13.603179 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:23:13.603179 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:23:13.603179 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:23:13.603179 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:23:13.603179 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:23:13.603179 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:23:13.603179 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: f4eefc2fafef4054b6d4f7d17f645406 Oct 27 03:23:13.603179 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-QuotasAdminNegativeTest-1748205748 Oct 27 03:23:13.603179 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:23:13.603179 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:23:13.604751 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f4eefc2fafef4054b6d4f7d17f645406"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f4eefc2fafef4054b6d4f7d17f645406"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f4eefc2fafef4054b6d4f7d17f645406"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f4eefc2fafef4054b6d4f7d17f645406"}]}] Oct 27 03:23:13.604751 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-QuotasAdminNegativeTest-1748205748 Oct 27 03:23:13.604751 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: f4eefc2fafef4054b6d4f7d17f645406 Oct 27 03:23:13.604751 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1748205748 Oct 27 03:23:13.604751 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-QuotasAdminNegativeTest-1748205748-project Oct 27 03:23:13.604751 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:23:13.604751 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:23:13.604751 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: ac07e3a844b349ce9e2436a4fdf36512 Oct 27 03:23:13.604751 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-QuotasAdminNegativeTest-1748205748-project Oct 27 03:23:13.604751 n-d-862769-1 devstack@n-api.service[121000]: Oct 27 03:23:13.604751 n-d-862769-1 devstack@n-api.service[121000]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-657415693", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452"}} Oct 27 03:23:13.604751 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:23:13.605906 n-d-862769-1 devstack@n-api.service[121000]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 27 03:23:13.605906 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-657415693', 'imageRef': 'c40fb871-5877-4b59-ab69-d9fd23b7a917', 'flavorRef': '452'}}} Oct 27 03:23:13.605906 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:23:13.605906 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:23:13.605906 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 27 03:23:13.605906 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 27 03:23:13.605906 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 03:23:13.605906 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 03:23:13.605906 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 27 03:23:13.605906 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc Oct 27 03:23:13.605906 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 27 03:23:13.605906 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 27 03:23:13.605906 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 03:23:13.605906 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 03:23:13.605906 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 27 03:23:13.605906 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 27 03:23:13.605906 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 27 03:23:13.605906 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 27 03:23:13.607015 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 27 03:23:13.607015 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 27 03:23:13.607015 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 27 03:23:13.607015 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:23:13.607015 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:23:13.607015 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:23:13.607015 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:23:13.607015 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 27 03:23:13.607015 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 27 03:23:13.607015 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 27 03:23:13.607015 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 27 03:23:13.607015 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 27 03:23:13.607015 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 27 03:23:13.607015 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 27 03:23:13.607015 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 27 03:23:13.607015 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 27 03:23:13.607015 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 27 03:23:13.607015 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 27 03:23:13.607015 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:23:13.607015 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:23:13.607015 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:23:13.608257 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:23:13.608257 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:23:13.608257 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:23:13.608257 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:23:13.608257 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:23:13.608257 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:23:13.608257 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:23:13.608257 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:23:13.608257 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:23:13.608257 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:23:13.608257 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:23:13.608257 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:23:13.608257 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:23:13.608257 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 27 03:23:13.608257 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 27 03:23:13.608257 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 27 03:23:13.608257 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 27 03:23:13.608257 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:23:13.608257 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:23:13.608257 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:23:13.608257 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:23:13.609406 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:23:13.609406 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:23:13.609406 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:23:13.609406 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:23:13.609406 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 27 03:23:13.609406 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:23:13.611402 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e39bda69-52be-42ef-9014-f86293518ead tempest-QuotasAdminNegativeTest-1748205748 tempest-QuotasAdminNegativeTest-1748205748-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:23:13.612510 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e39bda69-52be-42ef-9014-f86293518ead tempest-QuotasAdminNegativeTest-1748205748 tempest-QuotasAdminNegativeTest-1748205748-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.452105 Oct 27 03:23:13.613450 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 378/736] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:23:13 2022] POST /compute/v2.1/servers => generated 110 bytes in 454 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:23:13.617680 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-771b2204-9186-42d9-9545-05e28fb33a6c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:13.618293 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-771b2204-9186-42d9-9545-05e28fb33a6c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:13.618883 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-771b2204-9186-42d9-9545-05e28fb33a6c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:13.623963 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-771b2204-9186-42d9-9545-05e28fb33a6c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:13.623963 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-771b2204-9186-42d9-9545-05e28fb33a6c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:13.623963 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-771b2204-9186-42d9-9545-05e28fb33a6c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:13.624237 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c0283dcc-a698-4f6b-91d8-2f973339a93f tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:13.624784 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c0283dcc-a698-4f6b-91d8-2f973339a93f tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] [instance: 8877a86d-6529-43e9-9667-0dba515be5cb] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:13.631159 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c0283dcc-a698-4f6b-91d8-2f973339a93f tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:13.631834 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c0283dcc-a698-4f6b-91d8-2f973339a93f tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:13.632623 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c0283dcc-a698-4f6b-91d8-2f973339a93f tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:13.633492 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c0283dcc-a698-4f6b-91d8-2f973339a93f tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:13.635580 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c0283dcc-a698-4f6b-91d8-2f973339a93f tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:13.636389 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c0283dcc-a698-4f6b-91d8-2f973339a93f tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:13.827908 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c0283dcc-a698-4f6b-91d8-2f973339a93f tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd90bf4a2aa403cacd06bcaeb502640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c18fabfb19904c5ea3c5c096d9d6cad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:13.835897 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c0283dcc-a698-4f6b-91d8-2f973339a93f tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] 10.222.0.20 "GET /compute/v2.1/servers/8877a86d-6529-43e9-9667-0dba515be5cb" status: 200 len: 1322 microversion: 2.1 time: 0.217643 Oct 27 03:23:13.836561 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 379/737] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:13 2022] GET /compute/v2.1/servers/8877a86d-6529-43e9-9667-0dba515be5cb => generated 1322 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:13.843945 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-767e6f2f-777f-4f33-bd29-6bc16fd2817f tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] Action: 'update', calling method: .version_select at 0x7f7ddaa61430>, body: {"quota_set": {"ram": 51200}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:23:13.941564 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-767e6f2f-777f-4f33-bd29-6bc16fd2817f tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:13.942739 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-767e6f2f-777f-4f33-bd29-6bc16fd2817f tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:13.943334 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-767e6f2f-777f-4f33-bd29-6bc16fd2817f tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:13.944251 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-767e6f2f-777f-4f33-bd29-6bc16fd2817f tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:13.944881 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-767e6f2f-777f-4f33-bd29-6bc16fd2817f tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:13.945555 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-767e6f2f-777f-4f33-bd29-6bc16fd2817f tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:13.967041 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-771b2204-9186-42d9-9545-05e28fb33a6c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:13.977537 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-771b2204-9186-42d9-9545-05e28fb33a6c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/ac5fc2b3-c92e-470a-9bc6-885dce75fb8c" status: 200 len: 1319 microversion: 2.1 time: 0.381940 Oct 27 03:23:13.985600 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 359/738] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:13 2022] GET /compute/v2.1/servers/ac5fc2b3-c92e-470a-9bc6-885dce75fb8c => generated 1319 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:13.991542 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-628a3794-1337-4373-bdbe-d8c471f97485 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:13.992170 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-628a3794-1337-4373-bdbe-d8c471f97485 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: b2ef080f-30ca-4dc5-ba03-9cf1899346a4] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:14.006159 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-628a3794-1337-4373-bdbe-d8c471f97485 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:14.017940 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-628a3794-1337-4373-bdbe-d8c471f97485 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:14.018496 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-628a3794-1337-4373-bdbe-d8c471f97485 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:14.019271 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-628a3794-1337-4373-bdbe-d8c471f97485 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:14.019755 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-628a3794-1337-4373-bdbe-d8c471f97485 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:14.020371 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-628a3794-1337-4373-bdbe-d8c471f97485 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:14.036373 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:14.144039 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-767e6f2f-777f-4f33-bd29-6bc16fd2817f tempest-QuotasAdminNegativeTest-672768423 tempest-QuotasAdminNegativeTest-672768423-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/f4eefc2fafef4054b6d4f7d17f645406" status: 200 len: 329 microversion: 2.1 time: 0.304312 Oct 27 03:23:14.144561 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 380/739] 10.222.0.20 () {60 vars in 1262 bytes} [Thu Oct 27 03:23:13 2022] PUT /compute/v2.1/os-quota-sets/f4eefc2fafef4054b6d4f7d17f645406 => generated 329 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:23:14.158493 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-65e955b9-c533-4ae8-8040-bf00d0807e3f tempest-QuotasAdminNegativeTest-1748205748 tempest-QuotasAdminNegativeTest-1748205748-project] Action: 'update', calling method: .version_select at 0x7f7ddadd3af0>, body: {"quota_set": {"ram": 0}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:23:14.164735 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-65e955b9-c533-4ae8-8040-bf00d0807e3f tempest-QuotasAdminNegativeTest-1748205748 tempest-QuotasAdminNegativeTest-1748205748-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': 'ac07e3a844b349ce9e2436a4fdf36512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4eefc2fafef4054b6d4f7d17f645406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:14.167042 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-65e955b9-c533-4ae8-8040-bf00d0807e3f tempest-QuotasAdminNegativeTest-1748205748 tempest-QuotasAdminNegativeTest-1748205748-project] Request method failure captured: Oct 27 03:23:14.167042 n-d-862769-1 devstack@n-api.service[121000]: request: PUT /compute/v2.1/os-quota-sets/f4eefc2fafef4054b6d4f7d17f645406 HTTP/1.1 Oct 27 03:23:14.167042 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:23:14.167042 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:23:14.167042 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:23:14.167042 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 25 Oct 27 03:23:14.167042 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:23:14.167042 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:23:14.167042 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:23:14.167042 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:23:14.167042 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfmZXoaYxUgFMR6jVGrivhSEzqm6WdmpT8yxCY4K2nEP4IIB7V4p9FP8TOsRRGZYDJhluOJMZbiD6om72VnrR6smL1dPLzFTeXTGAkOUYnFe1SpGOmF7DRGxDfhcluOIBzcxUnilEFuzpc1LAoSQxEdp7I8Je5KxaDDQeT1jKhTZQdI Oct 27 03:23:14.167042 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:23:14.167042 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:23:14.167042 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:23:14.167042 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:23:14.167042 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:23:14.167042 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:23:14.167042 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: f4eefc2fafef4054b6d4f7d17f645406 Oct 27 03:23:14.167042 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-QuotasAdminNegativeTest-1748205748 Oct 27 03:23:14.167042 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:23:14.167042 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:23:14.175643 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f4eefc2fafef4054b6d4f7d17f645406"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f4eefc2fafef4054b6d4f7d17f645406"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f4eefc2fafef4054b6d4f7d17f645406"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f4eefc2fafef4054b6d4f7d17f645406"}]}] Oct 27 03:23:14.175643 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-QuotasAdminNegativeTest-1748205748 Oct 27 03:23:14.175643 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: f4eefc2fafef4054b6d4f7d17f645406 Oct 27 03:23:14.175643 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1748205748 Oct 27 03:23:14.175643 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-QuotasAdminNegativeTest-1748205748-project Oct 27 03:23:14.175643 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:23:14.175643 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:23:14.175643 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: ac07e3a844b349ce9e2436a4fdf36512 Oct 27 03:23:14.175643 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-QuotasAdminNegativeTest-1748205748-project Oct 27 03:23:14.175643 n-d-862769-1 devstack@n-api.service[121000]: Oct 27 03:23:14.175643 n-d-862769-1 devstack@n-api.service[121000]: {"quota_set": {"ram": 0}} Oct 27 03:23:14.175643 n-d-862769-1 devstack@n-api.service[121000]: method: Oct 27 03:23:14.175643 n-d-862769-1 devstack@n-api.service[121000]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 27 03:23:14.175643 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': 'f4eefc2fafef4054b6d4f7d17f645406', 'body': {'quota_set': {'ram': 0}}} Oct 27 03:23:14.177330 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:23:14.177330 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:23:14.177330 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:23:14.177330 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:23:14.177330 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:23:14.177330 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:23:14.177330 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:23:14.177330 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:23:14.177330 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:23:14.177330 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:23:14.177330 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:23:14.177330 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:23:14.177330 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Oct 27 03:23:14.177330 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Oct 27 03:23:14.177330 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 03:23:14.177330 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:23:14.177330 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 03:23:14.177330 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:23:14.177330 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Oct 27 03:23:14.178950 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Oct 27 03:23:14.178950 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 03:23:14.178950 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 03:23:14.178950 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 03:23:14.178950 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 03:23:14.178950 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 03:23:14.178950 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 03:23:14.178950 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 03:23:14.178950 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 03:23:14.178950 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 03:23:14.178950 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 03:23:14.178950 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 03:23:14.178950 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 03:23:14.178950 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 03:23:14.178950 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 03:23:14.178950 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 27 03:23:14.178950 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:23:14.178950 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:23:14.178950 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:23:14.178950 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:23:14.180132 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:23:14.180132 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:23:14.180132 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 03:23:14.180132 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 03:23:14.180132 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 27 03:23:14.180132 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:23:14.180132 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-65e955b9-c533-4ae8-8040-bf00d0807e3f tempest-QuotasAdminNegativeTest-1748205748 tempest-QuotasAdminNegativeTest-1748205748-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:23:14.180132 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-65e955b9-c533-4ae8-8040-bf00d0807e3f tempest-QuotasAdminNegativeTest-1748205748 tempest-QuotasAdminNegativeTest-1748205748-project] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/f4eefc2fafef4054b6d4f7d17f645406" status: 403 len: 116 microversion: 2.1 time: 0.014891 Oct 27 03:23:14.180132 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 381/740] 10.222.0.20 () {60 vars in 1262 bytes} [Thu Oct 27 03:23:14 2022] PUT /compute/v2.1/os-quota-sets/f4eefc2fafef4054b6d4f7d17f645406 => generated 116 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 27 03:23:14.187666 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d7f48500-c7fd-4a55-bc81-6be4c143d090 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:14.188277 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d7f48500-c7fd-4a55-bc81-6be4c143d090 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:14.195458 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d7f48500-c7fd-4a55-bc81-6be4c143d090 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:14.195989 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d7f48500-c7fd-4a55-bc81-6be4c143d090 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:14.196715 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d7f48500-c7fd-4a55-bc81-6be4c143d090 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:14.197439 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d7f48500-c7fd-4a55-bc81-6be4c143d090 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:14.198432 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d7f48500-c7fd-4a55-bc81-6be4c143d090 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:14.198879 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d7f48500-c7fd-4a55-bc81-6be4c143d090 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:14.276890 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d7f48500-c7fd-4a55-bc81-6be4c143d090 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:14.288202 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d7f48500-c7fd-4a55-bc81-6be4c143d090 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:14.289991 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d7f48500-c7fd-4a55-bc81-6be4c143d090 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:14.297343 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d7f48500-c7fd-4a55-bc81-6be4c143d090 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1539 microversion: 2.91 time: 0.114282 Oct 27 03:23:14.298491 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 382/741] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:23:14 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1539 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:23:14.555640 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-628a3794-1337-4373-bdbe-d8c471f97485 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:14.571067 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-628a3794-1337-4373-bdbe-d8c471f97485 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4" status: 200 len: 1477 microversion: 2.1 time: 0.585126 Oct 27 03:23:14.574083 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 360/742] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:13 2022] GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4 => generated 1477 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:14.607929 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a3b5de85-cd9f-4e60-8b95-33e9164b6243 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:14.610720 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a3b5de85-cd9f-4e60-8b95-33e9164b6243 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: da3360d3-ca0b-4077-af3e-92731700dada] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:14.627104 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a3b5de85-cd9f-4e60-8b95-33e9164b6243 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:14.627924 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a3b5de85-cd9f-4e60-8b95-33e9164b6243 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:14.628713 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a3b5de85-cd9f-4e60-8b95-33e9164b6243 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:14.632418 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a3b5de85-cd9f-4e60-8b95-33e9164b6243 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:14.632418 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a3b5de85-cd9f-4e60-8b95-33e9164b6243 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:14.632418 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a3b5de85-cd9f-4e60-8b95-33e9164b6243 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:14.848059 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a3b5de85-cd9f-4e60-8b95-33e9164b6243 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:14.868240 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a3b5de85-cd9f-4e60-8b95-33e9164b6243 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/da3360d3-ca0b-4077-af3e-92731700dada" status: 200 len: 1503 microversion: 2.1 time: 0.264643 Oct 27 03:23:14.882064 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 383/743] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:14 2022] GET /compute/v2.1/servers/da3360d3-ca0b-4077-af3e-92731700dada => generated 1503 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:14.921857 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-75139706-143a-41d5-b628-92849dfffffd tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:14.922724 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-75139706-143a-41d5-b628-92849dfffffd tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] [instance: 8877a86d-6529-43e9-9667-0dba515be5cb] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:14.933987 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-75139706-143a-41d5-b628-92849dfffffd tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:14.936860 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-75139706-143a-41d5-b628-92849dfffffd tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:14.937439 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-75139706-143a-41d5-b628-92849dfffffd tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:14.941454 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-75139706-143a-41d5-b628-92849dfffffd tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:14.942168 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-75139706-143a-41d5-b628-92849dfffffd tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:14.942770 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-75139706-143a-41d5-b628-92849dfffffd tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:15.004885 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4be1fec9-b642-49f3-8fe7-fccb2f3604ca tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:15.005506 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4be1fec9-b642-49f3-8fe7-fccb2f3604ca tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: ac5fc2b3-c92e-470a-9bc6-885dce75fb8c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:15.035049 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4be1fec9-b642-49f3-8fe7-fccb2f3604ca tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:15.036370 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4be1fec9-b642-49f3-8fe7-fccb2f3604ca tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:15.037536 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4be1fec9-b642-49f3-8fe7-fccb2f3604ca tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:15.042757 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4be1fec9-b642-49f3-8fe7-fccb2f3604ca tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:15.043244 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4be1fec9-b642-49f3-8fe7-fccb2f3604ca tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:15.043726 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4be1fec9-b642-49f3-8fe7-fccb2f3604ca tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:15.455525 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4be1fec9-b642-49f3-8fe7-fccb2f3604ca tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:15.470057 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4be1fec9-b642-49f3-8fe7-fccb2f3604ca tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/ac5fc2b3-c92e-470a-9bc6-885dce75fb8c" status: 200 len: 1319 microversion: 2.1 time: 0.469962 Oct 27 03:23:15.470955 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 384/744] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:14 2022] GET /compute/v2.1/servers/ac5fc2b3-c92e-470a-9bc6-885dce75fb8c => generated 1319 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:23:15.482475 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ce1dfb6d-7d2e-430f-9d37-34cc1f99b0c8 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:15.484559 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ce1dfb6d-7d2e-430f-9d37-34cc1f99b0c8 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:15.496660 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ce1dfb6d-7d2e-430f-9d37-34cc1f99b0c8 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:15.498690 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ce1dfb6d-7d2e-430f-9d37-34cc1f99b0c8 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:15.500116 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ce1dfb6d-7d2e-430f-9d37-34cc1f99b0c8 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:15.501056 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ce1dfb6d-7d2e-430f-9d37-34cc1f99b0c8 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:15.503476 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ce1dfb6d-7d2e-430f-9d37-34cc1f99b0c8 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:15.503476 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ce1dfb6d-7d2e-430f-9d37-34cc1f99b0c8 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:15.635692 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-75139706-143a-41d5-b628-92849dfffffd tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd90bf4a2aa403cacd06bcaeb502640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c18fabfb19904c5ea3c5c096d9d6cad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:15.645031 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-75139706-143a-41d5-b628-92849dfffffd tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] 10.222.0.20 "GET /compute/v2.1/servers/8877a86d-6529-43e9-9667-0dba515be5cb" status: 200 len: 1322 microversion: 2.1 time: 0.728733 Oct 27 03:23:15.645988 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 361/745] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:14 2022] GET /compute/v2.1/servers/8877a86d-6529-43e9-9667-0dba515be5cb => generated 1322 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:15.651313 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ce1dfb6d-7d2e-430f-9d37-34cc1f99b0c8 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:15.655707 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-87cf1b4b-fd4c-4685-a0ca-ffdc13743a58 req-29892f66-43a1-422d-ae36-fc8608fd1af5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8877a86d-6529-43e9-9667-0dba515be5cb", "name": "network-vif-plugged", "status": "completed", "tag": "bee5d28c-c6a9-4629-9830-862dba117f82"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:23:15.662422 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ce1dfb6d-7d2e-430f-9d37-34cc1f99b0c8 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:15.663866 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ce1dfb6d-7d2e-430f-9d37-34cc1f99b0c8 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:15.669358 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-87cf1b4b-fd4c-4685-a0ca-ffdc13743a58 req-29892f66-43a1-422d-ae36-fc8608fd1af5 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:15.670178 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-87cf1b4b-fd4c-4685-a0ca-ffdc13743a58 req-29892f66-43a1-422d-ae36-fc8608fd1af5 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:15.670972 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-87cf1b4b-fd4c-4685-a0ca-ffdc13743a58 req-29892f66-43a1-422d-ae36-fc8608fd1af5 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:15.681791 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ce1dfb6d-7d2e-430f-9d37-34cc1f99b0c8 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1539 microversion: 2.91 time: 0.209052 Oct 27 03:23:15.682461 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 385/746] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:23:15 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1539 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:23:15.688358 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-87cf1b4b-fd4c-4685-a0ca-ffdc13743a58 req-29892f66-43a1-422d-ae36-fc8608fd1af5 service nova] Creating event network-vif-plugged:bee5d28c-c6a9-4629-9830-862dba117f82 for instance 8877a86d-6529-43e9-9667-0dba515be5cb on n-h1-862769-1 Oct 27 03:23:15.689584 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ba26b00f-4aff-43cb-9da4-5f8824c19d0c tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:15.690314 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ba26b00f-4aff-43cb-9da4-5f8824c19d0c tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: b2ef080f-30ca-4dc5-ba03-9cf1899346a4] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:15.694194 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-87cf1b4b-fd4c-4685-a0ca-ffdc13743a58 req-29892f66-43a1-422d-ae36-fc8608fd1af5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046816 Oct 27 03:23:15.696147 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 362/747] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:23:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:23:15.706764 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ba26b00f-4aff-43cb-9da4-5f8824c19d0c tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:15.707264 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ba26b00f-4aff-43cb-9da4-5f8824c19d0c tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:15.708370 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ba26b00f-4aff-43cb-9da4-5f8824c19d0c tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:15.709361 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ba26b00f-4aff-43cb-9da4-5f8824c19d0c tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:15.710111 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ba26b00f-4aff-43cb-9da4-5f8824c19d0c tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:15.711484 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ba26b00f-4aff-43cb-9da4-5f8824c19d0c tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:15.897430 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f18d06ec-22f5-4bc2-84da-5c6f12ec74f6 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:15.898166 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f18d06ec-22f5-4bc2-84da-5c6f12ec74f6 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: da3360d3-ca0b-4077-af3e-92731700dada] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:15.918115 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f18d06ec-22f5-4bc2-84da-5c6f12ec74f6 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:15.922647 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f18d06ec-22f5-4bc2-84da-5c6f12ec74f6 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:15.922647 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f18d06ec-22f5-4bc2-84da-5c6f12ec74f6 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:15.922647 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f18d06ec-22f5-4bc2-84da-5c6f12ec74f6 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:15.922647 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f18d06ec-22f5-4bc2-84da-5c6f12ec74f6 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:15.922955 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f18d06ec-22f5-4bc2-84da-5c6f12ec74f6 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:16.011378 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ba26b00f-4aff-43cb-9da4-5f8824c19d0c tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:16.020586 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ba26b00f-4aff-43cb-9da4-5f8824c19d0c tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4" status: 200 len: 1477 microversion: 2.1 time: 0.337048 Oct 27 03:23:16.021601 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 386/748] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:15 2022] GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4 => generated 1477 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:16.079706 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-59ff1380-c745-426b-b20e-be864ba7b080 req-1c4d5b12-b4eb-4328-aa73-cbddb6dbcd8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac5fc2b3-c92e-470a-9bc6-885dce75fb8c", "tag": "46d55368-0f87-40d8-99d6-d7efc67e997a"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:23:16.092128 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-59ff1380-c745-426b-b20e-be864ba7b080 req-1c4d5b12-b4eb-4328-aa73-cbddb6dbcd8c service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:16.093404 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-59ff1380-c745-426b-b20e-be864ba7b080 req-1c4d5b12-b4eb-4328-aa73-cbddb6dbcd8c service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:16.094073 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-59ff1380-c745-426b-b20e-be864ba7b080 req-1c4d5b12-b4eb-4328-aa73-cbddb6dbcd8c service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:16.110009 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-59ff1380-c745-426b-b20e-be864ba7b080 req-1c4d5b12-b4eb-4328-aa73-cbddb6dbcd8c service nova] Creating event network-changed:46d55368-0f87-40d8-99d6-d7efc67e997a for instance ac5fc2b3-c92e-470a-9bc6-885dce75fb8c on n-h1-862769-1 Oct 27 03:23:16.124346 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-59ff1380-c745-426b-b20e-be864ba7b080 req-1c4d5b12-b4eb-4328-aa73-cbddb6dbcd8c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049934 Oct 27 03:23:16.125359 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 387/749] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:23:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:23:16.268235 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f18d06ec-22f5-4bc2-84da-5c6f12ec74f6 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:16.277503 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f18d06ec-22f5-4bc2-84da-5c6f12ec74f6 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/da3360d3-ca0b-4077-af3e-92731700dada" status: 200 len: 1503 microversion: 2.1 time: 0.387280 Oct 27 03:23:16.278192 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 363/750] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:15 2022] GET /compute/v2.1/servers/da3360d3-ca0b-4077-af3e-92731700dada => generated 1503 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:23:16.500097 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-24d3d3fa-6ea0-4f10-ad19-a9d01f0c67a9 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:16.501882 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-24d3d3fa-6ea0-4f10-ad19-a9d01f0c67a9 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: ac5fc2b3-c92e-470a-9bc6-885dce75fb8c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:16.515230 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-24d3d3fa-6ea0-4f10-ad19-a9d01f0c67a9 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:16.518855 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-24d3d3fa-6ea0-4f10-ad19-a9d01f0c67a9 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:16.519800 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-24d3d3fa-6ea0-4f10-ad19-a9d01f0c67a9 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:16.520916 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-24d3d3fa-6ea0-4f10-ad19-a9d01f0c67a9 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:16.521447 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-24d3d3fa-6ea0-4f10-ad19-a9d01f0c67a9 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:16.521889 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-24d3d3fa-6ea0-4f10-ad19-a9d01f0c67a9 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:16.670305 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-903a2e56-1bd1-4098-87af-06d78db4531f tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:16.672614 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-903a2e56-1bd1-4098-87af-06d78db4531f tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] [instance: 8877a86d-6529-43e9-9667-0dba515be5cb] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:16.684648 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-903a2e56-1bd1-4098-87af-06d78db4531f tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:16.686175 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-903a2e56-1bd1-4098-87af-06d78db4531f tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:16.687131 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-903a2e56-1bd1-4098-87af-06d78db4531f tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:16.688385 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-903a2e56-1bd1-4098-87af-06d78db4531f tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:16.689064 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-903a2e56-1bd1-4098-87af-06d78db4531f tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:16.689725 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-903a2e56-1bd1-4098-87af-06d78db4531f tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:16.722926 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=100 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:16.727719 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-24d3d3fa-6ea0-4f10-ad19-a9d01f0c67a9 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:16.743502 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-24d3d3fa-6ea0-4f10-ad19-a9d01f0c67a9 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/ac5fc2b3-c92e-470a-9bc6-885dce75fb8c" status: 200 len: 1319 microversion: 2.1 time: 0.250088 Oct 27 03:23:16.744373 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 388/751] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:16 2022] GET /compute/v2.1/servers/ac5fc2b3-c92e-470a-9bc6-885dce75fb8c => generated 1319 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:16.756504 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-813103df-3772-4e2d-835e-b8097021b419 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:16.757208 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-813103df-3772-4e2d-835e-b8097021b419 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:16.764257 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-813103df-3772-4e2d-835e-b8097021b419 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:16.765227 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-813103df-3772-4e2d-835e-b8097021b419 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:16.765863 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-813103df-3772-4e2d-835e-b8097021b419 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:16.767093 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-813103df-3772-4e2d-835e-b8097021b419 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:16.767762 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-813103df-3772-4e2d-835e-b8097021b419 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:16.768401 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-813103df-3772-4e2d-835e-b8097021b419 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:16.851203 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-813103df-3772-4e2d-835e-b8097021b419 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:16.862244 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-813103df-3772-4e2d-835e-b8097021b419 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:16.863873 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-813103df-3772-4e2d-835e-b8097021b419 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:16.869617 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-813103df-3772-4e2d-835e-b8097021b419 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1539 microversion: 2.91 time: 0.124044 Oct 27 03:23:16.870575 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 389/752] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:23:16 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1539 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:23:17.045082 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-72e72d2d-25dd-4ed1-880c-639de8d1b34b tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:17.046471 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-72e72d2d-25dd-4ed1-880c-639de8d1b34b tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: b2ef080f-30ca-4dc5-ba03-9cf1899346a4] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:17.052942 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-72e72d2d-25dd-4ed1-880c-639de8d1b34b tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:17.053549 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-72e72d2d-25dd-4ed1-880c-639de8d1b34b tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:17.054318 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-72e72d2d-25dd-4ed1-880c-639de8d1b34b tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:17.055126 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-72e72d2d-25dd-4ed1-880c-639de8d1b34b tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:17.055670 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-72e72d2d-25dd-4ed1-880c-639de8d1b34b tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:17.056200 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-72e72d2d-25dd-4ed1-880c-639de8d1b34b tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:17.222354 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-72e72d2d-25dd-4ed1-880c-639de8d1b34b tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:17.231818 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-72e72d2d-25dd-4ed1-880c-639de8d1b34b tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4" status: 200 len: 1477 microversion: 2.1 time: 0.189981 Oct 27 03:23:17.232406 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 390/753] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:17 2022] GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4 => generated 1477 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:17.316651 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-906ca29c-0c34-41b8-9597-e9e5dd5b6302 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:17.317324 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-906ca29c-0c34-41b8-9597-e9e5dd5b6302 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: da3360d3-ca0b-4077-af3e-92731700dada] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:17.323669 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-906ca29c-0c34-41b8-9597-e9e5dd5b6302 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:17.324379 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-906ca29c-0c34-41b8-9597-e9e5dd5b6302 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:17.324828 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-906ca29c-0c34-41b8-9597-e9e5dd5b6302 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:17.325716 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-906ca29c-0c34-41b8-9597-e9e5dd5b6302 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:17.326233 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-906ca29c-0c34-41b8-9597-e9e5dd5b6302 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:17.326842 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-906ca29c-0c34-41b8-9597-e9e5dd5b6302 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:17.392204 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-903a2e56-1bd1-4098-87af-06d78db4531f tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd90bf4a2aa403cacd06bcaeb502640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c18fabfb19904c5ea3c5c096d9d6cad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:17.401365 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-903a2e56-1bd1-4098-87af-06d78db4531f tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] 10.222.0.20 "GET /compute/v2.1/servers/8877a86d-6529-43e9-9667-0dba515be5cb" status: 200 len: 1322 microversion: 2.1 time: 0.735803 Oct 27 03:23:17.414878 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 364/754] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:16 2022] GET /compute/v2.1/servers/8877a86d-6529-43e9-9667-0dba515be5cb => generated 1322 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:17.469198 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-906ca29c-0c34-41b8-9597-e9e5dd5b6302 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:17.477176 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-906ca29c-0c34-41b8-9597-e9e5dd5b6302 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/da3360d3-ca0b-4077-af3e-92731700dada" status: 200 len: 1503 microversion: 2.1 time: 0.179835 Oct 27 03:23:17.479103 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 391/755] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:17 2022] GET /compute/v2.1/servers/da3360d3-ca0b-4077-af3e-92731700dada => generated 1503 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:23:17.769412 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ff93b1d8-647e-4eb4-872f-1b1907a4bbc3 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:17.770076 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ff93b1d8-647e-4eb4-872f-1b1907a4bbc3 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: ac5fc2b3-c92e-470a-9bc6-885dce75fb8c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:17.776513 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ff93b1d8-647e-4eb4-872f-1b1907a4bbc3 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:17.776998 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ff93b1d8-647e-4eb4-872f-1b1907a4bbc3 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:17.777437 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ff93b1d8-647e-4eb4-872f-1b1907a4bbc3 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:17.783036 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ff93b1d8-647e-4eb4-872f-1b1907a4bbc3 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:17.783036 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ff93b1d8-647e-4eb4-872f-1b1907a4bbc3 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:17.783036 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ff93b1d8-647e-4eb4-872f-1b1907a4bbc3 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:17.901494 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6d78056e-9757-4e82-b2ea-a6989d7bbb0d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:17.901830 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6d78056e-9757-4e82-b2ea-a6989d7bbb0d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:17.913741 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6d78056e-9757-4e82-b2ea-a6989d7bbb0d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:17.914303 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6d78056e-9757-4e82-b2ea-a6989d7bbb0d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:17.916971 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6d78056e-9757-4e82-b2ea-a6989d7bbb0d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:17.917875 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6d78056e-9757-4e82-b2ea-a6989d7bbb0d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:17.918396 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6d78056e-9757-4e82-b2ea-a6989d7bbb0d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:17.918833 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6d78056e-9757-4e82-b2ea-a6989d7bbb0d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:17.990434 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-6d78056e-9757-4e82-b2ea-a6989d7bbb0d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:17.992753 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=100 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:18.000235 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-6d78056e-9757-4e82-b2ea-a6989d7bbb0d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:18.001808 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-6d78056e-9757-4e82-b2ea-a6989d7bbb0d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:18.006746 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6d78056e-9757-4e82-b2ea-a6989d7bbb0d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1539 microversion: 2.91 time: 0.113358 Oct 27 03:23:18.014265 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 392/756] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:23:17 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1539 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:23:18.173639 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ff93b1d8-647e-4eb4-872f-1b1907a4bbc3 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:18.189825 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ff93b1d8-647e-4eb4-872f-1b1907a4bbc3 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/ac5fc2b3-c92e-470a-9bc6-885dce75fb8c" status: 200 len: 1319 microversion: 2.1 time: 0.425199 Oct 27 03:23:18.207351 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 365/757] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:17 2022] GET /compute/v2.1/servers/ac5fc2b3-c92e-470a-9bc6-885dce75fb8c => generated 1319 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:18.257021 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f5c0021a-4105-4069-ba17-7fd144e3e92f tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:18.257649 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f5c0021a-4105-4069-ba17-7fd144e3e92f tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: b2ef080f-30ca-4dc5-ba03-9cf1899346a4] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:18.265216 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f5c0021a-4105-4069-ba17-7fd144e3e92f tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:18.265722 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f5c0021a-4105-4069-ba17-7fd144e3e92f tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:18.266703 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f5c0021a-4105-4069-ba17-7fd144e3e92f tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:18.267656 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f5c0021a-4105-4069-ba17-7fd144e3e92f tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:18.268338 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f5c0021a-4105-4069-ba17-7fd144e3e92f tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:18.268923 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f5c0021a-4105-4069-ba17-7fd144e3e92f tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:18.348524 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-e0582cd7-166b-4374-9daa-5b27f2f1ddc3 req-0cf77fbe-6a5a-47b0-aaa7-af26f7552fc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f360a9c-90c7-4efd-90c2-c0d3bd15c154", "name": "network-vif-plugged", "status": "completed", "tag": "d05292be-7d41-4722-906b-1b0c37b313fc"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:23:18.363079 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-e0582cd7-166b-4374-9daa-5b27f2f1ddc3 req-0cf77fbe-6a5a-47b0-aaa7-af26f7552fc9 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:18.363581 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-e0582cd7-166b-4374-9daa-5b27f2f1ddc3 req-0cf77fbe-6a5a-47b0-aaa7-af26f7552fc9 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:18.364023 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-e0582cd7-166b-4374-9daa-5b27f2f1ddc3 req-0cf77fbe-6a5a-47b0-aaa7-af26f7552fc9 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:18.379535 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-e0582cd7-166b-4374-9daa-5b27f2f1ddc3 req-0cf77fbe-6a5a-47b0-aaa7-af26f7552fc9 service nova] Creating event network-vif-plugged:d05292be-7d41-4722-906b-1b0c37b313fc for instance 6f360a9c-90c7-4efd-90c2-c0d3bd15c154 on n-h2-862769-1 Oct 27 03:23:18.384704 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-e0582cd7-166b-4374-9daa-5b27f2f1ddc3 req-0cf77fbe-6a5a-47b0-aaa7-af26f7552fc9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043638 Oct 27 03:23:18.385896 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 366/758] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:23:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:23:18.427259 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f5c0021a-4105-4069-ba17-7fd144e3e92f tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:18.438605 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f5c0021a-4105-4069-ba17-7fd144e3e92f tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4" status: 200 len: 1477 microversion: 2.1 time: 0.186182 Oct 27 03:23:18.441509 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f7baf2a4-2186-4482-a1d9-40d9db81fa28 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:18.442275 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f7baf2a4-2186-4482-a1d9-40d9db81fa28 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] [instance: 8877a86d-6529-43e9-9667-0dba515be5cb] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:18.453893 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 393/759] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:18 2022] GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4 => generated 1477 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:18.460112 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f7baf2a4-2186-4482-a1d9-40d9db81fa28 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:18.460819 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f7baf2a4-2186-4482-a1d9-40d9db81fa28 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:18.461641 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f7baf2a4-2186-4482-a1d9-40d9db81fa28 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:18.462588 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f7baf2a4-2186-4482-a1d9-40d9db81fa28 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:18.463210 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f7baf2a4-2186-4482-a1d9-40d9db81fa28 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:18.463807 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f7baf2a4-2186-4482-a1d9-40d9db81fa28 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:18.507857 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1e4656d6-7cb6-4dbc-919a-85f465b376b6 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:18.508414 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1e4656d6-7cb6-4dbc-919a-85f465b376b6 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: da3360d3-ca0b-4077-af3e-92731700dada] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:18.521460 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1e4656d6-7cb6-4dbc-919a-85f465b376b6 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:18.521969 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1e4656d6-7cb6-4dbc-919a-85f465b376b6 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:18.522445 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1e4656d6-7cb6-4dbc-919a-85f465b376b6 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:18.525853 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1e4656d6-7cb6-4dbc-919a-85f465b376b6 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:18.526365 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1e4656d6-7cb6-4dbc-919a-85f465b376b6 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:18.529265 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1e4656d6-7cb6-4dbc-919a-85f465b376b6 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:18.718816 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1e4656d6-7cb6-4dbc-919a-85f465b376b6 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:18.728256 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1e4656d6-7cb6-4dbc-919a-85f465b376b6 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/da3360d3-ca0b-4077-af3e-92731700dada" status: 200 len: 1503 microversion: 2.1 time: 0.229791 Oct 27 03:23:18.728840 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 394/760] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:18 2022] GET /compute/v2.1/servers/da3360d3-ca0b-4077-af3e-92731700dada => generated 1503 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:23:18.791657 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f7baf2a4-2186-4482-a1d9-40d9db81fa28 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd90bf4a2aa403cacd06bcaeb502640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c18fabfb19904c5ea3c5c096d9d6cad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:18.799904 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f7baf2a4-2186-4482-a1d9-40d9db81fa28 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] 10.222.0.20 "GET /compute/v2.1/servers/8877a86d-6529-43e9-9667-0dba515be5cb" status: 200 len: 1472 microversion: 2.1 time: 0.368424 Oct 27 03:23:18.800467 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 367/761] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:18 2022] GET /compute/v2.1/servers/8877a86d-6529-43e9-9667-0dba515be5cb => generated 1472 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:18.825537 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7a375a33-7fb9-41df-a02a-bf216c01f3f8 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:18.826078 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7a375a33-7fb9-41df-a02a-bf216c01f3f8 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] [instance: 8877a86d-6529-43e9-9667-0dba515be5cb] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:18.832444 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7a375a33-7fb9-41df-a02a-bf216c01f3f8 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:18.832933 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7a375a33-7fb9-41df-a02a-bf216c01f3f8 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:18.833368 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7a375a33-7fb9-41df-a02a-bf216c01f3f8 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:18.834158 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7a375a33-7fb9-41df-a02a-bf216c01f3f8 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:18.834621 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7a375a33-7fb9-41df-a02a-bf216c01f3f8 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:18.835050 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7a375a33-7fb9-41df-a02a-bf216c01f3f8 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:18.859254 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7a375a33-7fb9-41df-a02a-bf216c01f3f8 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '7bd90bf4a2aa403cacd06bcaeb502640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c18fabfb19904c5ea3c5c096d9d6cad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:18.861149 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7a375a33-7fb9-41df-a02a-bf216c01f3f8 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Request method failure captured: Oct 27 03:23:18.861149 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/8877a86d-6529-43e9-9667-0dba515be5cb/diagnostics HTTP/1.1 Oct 27 03:23:18.861149 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:23:18.861149 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:23:18.861149 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:23:18.861149 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:23:18.861149 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:23:18.861149 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:23:18.861149 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:23:18.861149 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:23:18.861149 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfmRrSleab3n8BYMx37sPtuuqq8cjr4wJ83hHsJgBD7LsnDOMzMx9XYwsuNYAZRRajXIBeewjBVxOD8LN9AEa6phwovCA71TqhVacy_HU7xZ1sB-_y_PuuYHpONBt2-xQlPaw-ugrBnWlOp20MH-UP-4aD9VZRV2UAFhKy6tYEuOC5E Oct 27 03:23:18.861149 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:23:18.861149 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:23:18.861149 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:23:18.861149 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:23:18.861149 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:23:18.861149 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:23:18.861149 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: c18fabfb19904c5ea3c5c096d9d6cad7 Oct 27 03:23:18.861149 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1761112792 Oct 27 03:23:18.861149 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:23:18.861149 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:23:18.862895 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c18fabfb19904c5ea3c5c096d9d6cad7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c18fabfb19904c5ea3c5c096d9d6cad7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c18fabfb19904c5ea3c5c096d9d6cad7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c18fabfb19904c5ea3c5c096d9d6cad7"}]}] Oct 27 03:23:18.862895 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1761112792 Oct 27 03:23:18.862895 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: c18fabfb19904c5ea3c5c096d9d6cad7 Oct 27 03:23:18.862895 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1761112792 Oct 27 03:23:18.862895 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ServerDiagnosticsNegativeTest-1761112792-project Oct 27 03:23:18.862895 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:23:18.862895 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:23:18.862895 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 7bd90bf4a2aa403cacd06bcaeb502640 Oct 27 03:23:18.862895 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1761112792-project Oct 27 03:23:18.862895 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:23:18.862895 n-d-862769-1 devstack@n-api.service[121000]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 27 03:23:18.863660 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'server_id': '8877a86d-6529-43e9-9667-0dba515be5cb'} Oct 27 03:23:18.863660 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:23:18.863660 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:23:18.863660 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:23:18.863660 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:23:18.863660 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:23:18.863660 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:23:18.863660 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:23:18.863660 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:23:18.863660 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Oct 27 03:23:18.863660 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Oct 27 03:23:18.863660 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 03:23:18.863660 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 03:23:18.863660 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 03:23:18.863660 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 03:23:18.863660 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 03:23:18.863660 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 03:23:18.863660 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 03:23:18.863660 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 03:23:18.863660 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 03:23:18.865222 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 03:23:18.865222 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 03:23:18.865222 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 03:23:18.865222 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 03:23:18.865222 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 03:23:18.865222 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 27 03:23:18.865222 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:23:18.865222 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:23:18.865222 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:23:18.865222 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:23:18.865222 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:23:18.865222 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:23:18.865222 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 03:23:18.865222 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 03:23:18.865222 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 27 03:23:18.865222 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:23:18.865222 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7a375a33-7fb9-41df-a02a-bf216c01f3f8 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:23:18.870235 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7a375a33-7fb9-41df-a02a-bf216c01f3f8 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] 10.222.0.20 "GET /compute/v2.1/servers/8877a86d-6529-43e9-9667-0dba515be5cb/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.040951 Oct 27 03:23:18.870235 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 395/762] 10.222.0.20 () {58 vars in 1272 bytes} [Thu Oct 27 03:23:18 2022] GET /compute/v2.1/servers/8877a86d-6529-43e9-9667-0dba515be5cb/diagnostics => generated 117 bytes in 47 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:23:18.873245 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3b416b26-c449-4ce0-b283-dfc2de04f9ce tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:18.873749 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3b416b26-c449-4ce0-b283-dfc2de04f9ce tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] [instance: 8877a86d-6529-43e9-9667-0dba515be5cb] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:18.883398 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3b416b26-c449-4ce0-b283-dfc2de04f9ce tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:18.883895 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3b416b26-c449-4ce0-b283-dfc2de04f9ce tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:18.884365 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3b416b26-c449-4ce0-b283-dfc2de04f9ce tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:18.885096 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3b416b26-c449-4ce0-b283-dfc2de04f9ce tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:18.885552 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3b416b26-c449-4ce0-b283-dfc2de04f9ce tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:18.885978 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3b416b26-c449-4ce0-b283-dfc2de04f9ce tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:18.913952 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3b416b26-c449-4ce0-b283-dfc2de04f9ce tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] [instance: 8877a86d-6529-43e9-9667-0dba515be5cb] Going to try to terminate instance {{(pid=121001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:23:19.036160 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5d5fa985-3a86-4855-8a31-af332a8eb924 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:19.037097 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5d5fa985-3a86-4855-8a31-af332a8eb924 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:19.043602 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5d5fa985-3a86-4855-8a31-af332a8eb924 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:19.044097 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5d5fa985-3a86-4855-8a31-af332a8eb924 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:19.044840 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5d5fa985-3a86-4855-8a31-af332a8eb924 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:19.045955 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5d5fa985-3a86-4855-8a31-af332a8eb924 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:19.046442 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5d5fa985-3a86-4855-8a31-af332a8eb924 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:19.047102 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5d5fa985-3a86-4855-8a31-af332a8eb924 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:19.126942 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5d5fa985-3a86-4855-8a31-af332a8eb924 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:19.136215 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5d5fa985-3a86-4855-8a31-af332a8eb924 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:19.138379 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5d5fa985-3a86-4855-8a31-af332a8eb924 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:19.146332 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5d5fa985-3a86-4855-8a31-af332a8eb924 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1539 microversion: 2.91 time: 0.114035 Oct 27 03:23:19.147181 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 396/763] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:23:19 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1539 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:23:19.215159 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-efbfb641-fd02-42de-b203-7293d3d7961c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:19.215773 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-efbfb641-fd02-42de-b203-7293d3d7961c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: ac5fc2b3-c92e-470a-9bc6-885dce75fb8c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:19.222901 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-efbfb641-fd02-42de-b203-7293d3d7961c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:19.223912 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-efbfb641-fd02-42de-b203-7293d3d7961c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:19.224353 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-efbfb641-fd02-42de-b203-7293d3d7961c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:19.225058 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-efbfb641-fd02-42de-b203-7293d3d7961c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:19.225515 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-efbfb641-fd02-42de-b203-7293d3d7961c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:19.225941 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-efbfb641-fd02-42de-b203-7293d3d7961c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:19.264172 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3b416b26-c449-4ce0-b283-dfc2de04f9ce tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8877a86d-6529-43e9-9667-0dba515be5cb" status: 204 len: 0 microversion: 2.1 time: 0.394681 Oct 27 03:23:19.269175 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 368/764] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:23:18 2022] DELETE /compute/v2.1/servers/8877a86d-6529-43e9-9667-0dba515be5cb => generated 0 bytes in 397 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 03:23:19.274852 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-be2f22b9-9d9d-46bf-98d7-24b0908ca530 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:19.275833 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-be2f22b9-9d9d-46bf-98d7-24b0908ca530 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] [instance: 8877a86d-6529-43e9-9667-0dba515be5cb] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:19.282352 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-be2f22b9-9d9d-46bf-98d7-24b0908ca530 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:19.283160 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-be2f22b9-9d9d-46bf-98d7-24b0908ca530 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:19.283701 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-be2f22b9-9d9d-46bf-98d7-24b0908ca530 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:19.285131 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-be2f22b9-9d9d-46bf-98d7-24b0908ca530 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:19.285812 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-be2f22b9-9d9d-46bf-98d7-24b0908ca530 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:19.286505 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-be2f22b9-9d9d-46bf-98d7-24b0908ca530 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:19.398196 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-efbfb641-fd02-42de-b203-7293d3d7961c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:19.410011 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-efbfb641-fd02-42de-b203-7293d3d7961c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/ac5fc2b3-c92e-470a-9bc6-885dce75fb8c" status: 200 len: 1319 microversion: 2.1 time: 0.198545 Oct 27 03:23:19.411509 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 397/765] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:19 2022] GET /compute/v2.1/servers/ac5fc2b3-c92e-470a-9bc6-885dce75fb8c => generated 1319 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:23:19.466730 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-554a6f27-0367-4e70-ab82-e8c6e9c0b78b tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:19.467715 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-554a6f27-0367-4e70-ab82-e8c6e9c0b78b tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: b2ef080f-30ca-4dc5-ba03-9cf1899346a4] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:19.475337 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-554a6f27-0367-4e70-ab82-e8c6e9c0b78b tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:19.477675 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-554a6f27-0367-4e70-ab82-e8c6e9c0b78b tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:19.479092 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-554a6f27-0367-4e70-ab82-e8c6e9c0b78b tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:19.480442 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-554a6f27-0367-4e70-ab82-e8c6e9c0b78b tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:19.481960 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-554a6f27-0367-4e70-ab82-e8c6e9c0b78b tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:19.482795 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-554a6f27-0367-4e70-ab82-e8c6e9c0b78b tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:19.500340 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-be2f22b9-9d9d-46bf-98d7-24b0908ca530 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd90bf4a2aa403cacd06bcaeb502640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c18fabfb19904c5ea3c5c096d9d6cad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:19.516025 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-be2f22b9-9d9d-46bf-98d7-24b0908ca530 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] 10.222.0.20 "GET /compute/v2.1/servers/8877a86d-6529-43e9-9667-0dba515be5cb" status: 200 len: 1478 microversion: 2.1 time: 0.245053 Oct 27 03:23:19.519791 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 369/766] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:19 2022] GET /compute/v2.1/servers/8877a86d-6529-43e9-9667-0dba515be5cb => generated 1478 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:19.648644 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-554a6f27-0367-4e70-ab82-e8c6e9c0b78b tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:19.656390 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-554a6f27-0367-4e70-ab82-e8c6e9c0b78b tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4" status: 200 len: 1477 microversion: 2.1 time: 0.194620 Oct 27 03:23:19.657937 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 398/767] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:19 2022] GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4 => generated 1477 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:19.758027 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-985c7d14-9284-465b-9568-cf7ee183eded tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:19.758676 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-985c7d14-9284-465b-9568-cf7ee183eded tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: da3360d3-ca0b-4077-af3e-92731700dada] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:19.765122 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-985c7d14-9284-465b-9568-cf7ee183eded tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:19.765617 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-985c7d14-9284-465b-9568-cf7ee183eded tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:19.766411 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-985c7d14-9284-465b-9568-cf7ee183eded tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:19.767096 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-985c7d14-9284-465b-9568-cf7ee183eded tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:19.767708 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-985c7d14-9284-465b-9568-cf7ee183eded tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:19.768286 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-985c7d14-9284-465b-9568-cf7ee183eded tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:20.011078 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-985c7d14-9284-465b-9568-cf7ee183eded tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:20.062796 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-985c7d14-9284-465b-9568-cf7ee183eded tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/da3360d3-ca0b-4077-af3e-92731700dada" status: 200 len: 1503 microversion: 2.1 time: 0.310407 Oct 27 03:23:20.078061 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 370/768] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:19 2022] GET /compute/v2.1/servers/da3360d3-ca0b-4077-af3e-92731700dada => generated 1503 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:20.176797 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e532e407-dff2-4bb0-8f78-48bf2cc4b724 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:20.177651 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e532e407-dff2-4bb0-8f78-48bf2cc4b724 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:20.185275 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e532e407-dff2-4bb0-8f78-48bf2cc4b724 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:20.185992 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e532e407-dff2-4bb0-8f78-48bf2cc4b724 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:20.186666 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e532e407-dff2-4bb0-8f78-48bf2cc4b724 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:20.188226 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e532e407-dff2-4bb0-8f78-48bf2cc4b724 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:20.188701 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e532e407-dff2-4bb0-8f78-48bf2cc4b724 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:20.189145 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e532e407-dff2-4bb0-8f78-48bf2cc4b724 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:20.284228 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e532e407-dff2-4bb0-8f78-48bf2cc4b724 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:20.292053 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e532e407-dff2-4bb0-8f78-48bf2cc4b724 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:20.293857 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e532e407-dff2-4bb0-8f78-48bf2cc4b724 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:20.299808 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e532e407-dff2-4bb0-8f78-48bf2cc4b724 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1539 microversion: 2.91 time: 0.126893 Oct 27 03:23:20.301930 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 399/769] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:23:20 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1539 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:23:20.433345 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-14a74814-b4b9-4ad7-bbf4-60bbd0cad05e tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:20.433979 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-14a74814-b4b9-4ad7-bbf4-60bbd0cad05e tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: ac5fc2b3-c92e-470a-9bc6-885dce75fb8c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:20.440336 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-14a74814-b4b9-4ad7-bbf4-60bbd0cad05e tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:20.440834 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-14a74814-b4b9-4ad7-bbf4-60bbd0cad05e tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:20.441281 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-14a74814-b4b9-4ad7-bbf4-60bbd0cad05e tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:20.441999 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-14a74814-b4b9-4ad7-bbf4-60bbd0cad05e tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:20.444100 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-14a74814-b4b9-4ad7-bbf4-60bbd0cad05e tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:20.444100 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-14a74814-b4b9-4ad7-bbf4-60bbd0cad05e tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:20.665025 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ba45cee2-f66b-4929-a999-de3b4b265c49 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-322660709", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": "none"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:23:20.683550 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-14a74814-b4b9-4ad7-bbf4-60bbd0cad05e tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:20.696669 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-14a74814-b4b9-4ad7-bbf4-60bbd0cad05e tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/ac5fc2b3-c92e-470a-9bc6-885dce75fb8c" status: 200 len: 1319 microversion: 2.1 time: 0.266985 Oct 27 03:23:20.697267 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 371/770] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:20 2022] GET /compute/v2.1/servers/ac5fc2b3-c92e-470a-9bc6-885dce75fb8c => generated 1319 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:20.701942 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-48c66dec-cfce-427b-985a-b00aff4b66f8 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:20.703316 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-48c66dec-cfce-427b-985a-b00aff4b66f8 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] [instance: 8877a86d-6529-43e9-9667-0dba515be5cb] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:20.709888 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-48c66dec-cfce-427b-985a-b00aff4b66f8 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:20.710660 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-48c66dec-cfce-427b-985a-b00aff4b66f8 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:20.711284 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-48c66dec-cfce-427b-985a-b00aff4b66f8 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:20.712008 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-48c66dec-cfce-427b-985a-b00aff4b66f8 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:20.712631 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-48c66dec-cfce-427b-985a-b00aff4b66f8 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:20.713037 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-48c66dec-cfce-427b-985a-b00aff4b66f8 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:20.734100 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-ba45cee2-f66b-4929-a999-de3b4b265c49 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:23:20.734772 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-ba45cee2-f66b-4929-a999-de3b4b265c49 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:23:20.735247 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-ba45cee2-f66b-4929-a999-de3b4b265c49 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:23:20.735895 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-ba45cee2-f66b-4929-a999-de3b4b265c49 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:23:20.736484 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-ba45cee2-f66b-4929-a999-de3b4b265c49 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:23:20.759449 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ba45cee2-f66b-4929-a999-de3b4b265c49 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:20.759952 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ba45cee2-f66b-4929-a999-de3b4b265c49 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:20.760873 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ba45cee2-f66b-4929-a999-de3b4b265c49 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:20.761650 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ba45cee2-f66b-4929-a999-de3b4b265c49 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:20.762318 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ba45cee2-f66b-4929-a999-de3b4b265c49 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:20.762747 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ba45cee2-f66b-4929-a999-de3b4b265c49 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:20.786742 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-ba45cee2-f66b-4929-a999-de3b4b265c49 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Getting quotas for project 78742a1d089f4aa2985fc7060d5e7cb9. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:23:20.794463 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-ba45cee2-f66b-4929-a999-de3b4b265c49 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Getting quotas for user a50a0c4308064b25a67182b77431087b and project 78742a1d089f4aa2985fc7060d5e7cb9. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:23:20.811215 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ba45cee2-f66b-4929-a999-de3b4b265c49 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:23:20.814857 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ba45cee2-f66b-4929-a999-de3b4b265c49 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] [instance: 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:23:20.955018 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ba45cee2-f66b-4929-a999-de3b4b265c49 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.419673 Oct 27 03:23:20.962226 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 400/771] 10.222.0.20 () {62 vars in 1188 bytes} [Thu Oct 27 03:23:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 422 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 27 03:23:20.962226 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3ad2267e-5972-4c49-979b-3f8f4895dfea tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:20.962785 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-3ad2267e-5972-4c49-979b-3f8f4895dfea tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: b2ef080f-30ca-4dc5-ba03-9cf1899346a4] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:20.970737 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3ad2267e-5972-4c49-979b-3f8f4895dfea tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:20.971244 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3ad2267e-5972-4c49-979b-3f8f4895dfea tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:20.971813 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3ad2267e-5972-4c49-979b-3f8f4895dfea tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:20.973638 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3ad2267e-5972-4c49-979b-3f8f4895dfea tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:20.974165 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3ad2267e-5972-4c49-979b-3f8f4895dfea tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:20.974608 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3ad2267e-5972-4c49-979b-3f8f4895dfea tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:21.228417 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-3ad2267e-5972-4c49-979b-3f8f4895dfea tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:21.238459 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3ad2267e-5972-4c49-979b-3f8f4895dfea tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4" status: 200 len: 1477 microversion: 2.1 time: 0.280623 Oct 27 03:23:21.239490 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 401/772] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:20 2022] GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4 => generated 1477 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:21.244429 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e37fbfa9-218e-4923-83ae-211002ffb583 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:23:21.252556 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e37fbfa9-218e-4923-83ae-211002ffb583 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] [instance: 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:21.324800 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-48c66dec-cfce-427b-985a-b00aff4b66f8 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd90bf4a2aa403cacd06bcaeb502640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c18fabfb19904c5ea3c5c096d9d6cad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:21.333772 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-48c66dec-cfce-427b-985a-b00aff4b66f8 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] 10.222.0.20 "GET /compute/v2.1/servers/8877a86d-6529-43e9-9667-0dba515be5cb" status: 200 len: 1478 microversion: 2.1 time: 0.635412 Oct 27 03:23:21.334709 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 372/773] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:20 2022] GET /compute/v2.1/servers/8877a86d-6529-43e9-9667-0dba515be5cb => generated 1478 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:21.343920 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c248ddd1-0f19-4b3d-9281-9f98869a2285 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:21.344548 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c248ddd1-0f19-4b3d-9281-9f98869a2285 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: da3360d3-ca0b-4077-af3e-92731700dada] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:21.353533 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c248ddd1-0f19-4b3d-9281-9f98869a2285 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:21.354318 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c248ddd1-0f19-4b3d-9281-9f98869a2285 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:21.354917 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c248ddd1-0f19-4b3d-9281-9f98869a2285 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:21.357462 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c248ddd1-0f19-4b3d-9281-9f98869a2285 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:21.357462 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c248ddd1-0f19-4b3d-9281-9f98869a2285 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:21.357462 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c248ddd1-0f19-4b3d-9281-9f98869a2285 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:21.582594 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e37fbfa9-218e-4923-83ae-211002ffb583 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:21.591810 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c248ddd1-0f19-4b3d-9281-9f98869a2285 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:21.595343 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e37fbfa9-218e-4923-83ae-211002ffb583 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:21.597186 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e37fbfa9-218e-4923-83ae-211002ffb583 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:21.603567 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e37fbfa9-218e-4923-83ae-211002ffb583 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] 10.222.0.20 "PUT /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503" status: 200 len: 1358 microversion: 2.75 time: 0.362948 Oct 27 03:23:21.607905 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c248ddd1-0f19-4b3d-9281-9f98869a2285 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/da3360d3-ca0b-4077-af3e-92731700dada" status: 200 len: 1503 microversion: 2.1 time: 0.272019 Oct 27 03:23:21.636299 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 373/775] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:21 2022] GET /compute/v2.1/servers/da3360d3-ca0b-4077-af3e-92731700dada => generated 1503 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:21.640573 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 402/775] 10.222.0.20 () {62 vars in 1297 bytes} [Thu Oct 27 03:23:21 2022] PUT /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503 => generated 1358 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:23:21.645759 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d4423972-4325-48df-953c-c65b12cbd606 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:21.646184 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-548d1532-45fa-48fc-8b44-065dfb1f35e0 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:21.646819 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-548d1532-45fa-48fc-8b44-065dfb1f35e0 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] [instance: 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:21.649567 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d4423972-4325-48df-953c-c65b12cbd606 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:21.659774 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d4423972-4325-48df-953c-c65b12cbd606 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:21.660284 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d4423972-4325-48df-953c-c65b12cbd606 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:21.660734 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d4423972-4325-48df-953c-c65b12cbd606 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:21.661464 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d4423972-4325-48df-953c-c65b12cbd606 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:21.661934 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d4423972-4325-48df-953c-c65b12cbd606 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:21.664564 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d4423972-4325-48df-953c-c65b12cbd606 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:21.731405 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-548d1532-45fa-48fc-8b44-065dfb1f35e0 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:21.758665 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-548d1532-45fa-48fc-8b44-065dfb1f35e0 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:21.760787 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-548d1532-45fa-48fc-8b44-065dfb1f35e0 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:21.768263 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-548d1532-45fa-48fc-8b44-065dfb1f35e0 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] 10.222.0.20 "GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503" status: 200 len: 1358 microversion: 2.75 time: 0.130413 Oct 27 03:23:21.779205 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 403/776] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:23:21 2022] GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503 => generated 1358 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:23:21.787740 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d4423972-4325-48df-953c-c65b12cbd606 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:21.804478 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d4423972-4325-48df-953c-c65b12cbd606 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:21.806244 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d4423972-4325-48df-953c-c65b12cbd606 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:21.809188 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-79689316-d0fb-4292-9cd7-cf824549d421 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:21.811122 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-79689316-d0fb-4292-9cd7-cf824549d421 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: ac5fc2b3-c92e-470a-9bc6-885dce75fb8c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:21.817864 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d4423972-4325-48df-953c-c65b12cbd606 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1539 microversion: 2.91 time: 0.180207 Oct 27 03:23:21.819701 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 374/777] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:23:21 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1539 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:23:21.823885 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-79689316-d0fb-4292-9cd7-cf824549d421 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:21.826469 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-79689316-d0fb-4292-9cd7-cf824549d421 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:21.827095 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-79689316-d0fb-4292-9cd7-cf824549d421 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:21.828506 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-79689316-d0fb-4292-9cd7-cf824549d421 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:21.829536 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-79689316-d0fb-4292-9cd7-cf824549d421 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:21.830072 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-79689316-d0fb-4292-9cd7-cf824549d421 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:22.101943 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7cd124ea-a49d-4f2a-bfde-890df9c7bfac tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1859952692", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": [{"uuid": "1257014e-2ff1-4e8e-a591-63c86a5e0d4b"}]}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:23:22.112859 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-79689316-d0fb-4292-9cd7-cf824549d421 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:22.122686 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-79689316-d0fb-4292-9cd7-cf824549d421 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/ac5fc2b3-c92e-470a-9bc6-885dce75fb8c" status: 200 len: 1319 microversion: 2.1 time: 0.342011 Oct 27 03:23:22.135218 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 404/778] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:21 2022] GET /compute/v2.1/servers/ac5fc2b3-c92e-470a-9bc6-885dce75fb8c => generated 1319 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:22.200290 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.network.neutron [None req-7cd124ea-a49d-4f2a-bfde-890df9c7bfac tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] validate_networks() for [('1257014e-2ff1-4e8e-a591-63c86a5e0d4b', None, None, None, None, None)] {{(pid=121001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:23:22.273631 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e99d1d44-18a8-4ec6-aae9-cde76340f9a8 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:22.273631 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e99d1d44-18a8-4ec6-aae9-cde76340f9a8 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: b2ef080f-30ca-4dc5-ba03-9cf1899346a4] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:22.275322 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e99d1d44-18a8-4ec6-aae9-cde76340f9a8 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:22.276028 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e99d1d44-18a8-4ec6-aae9-cde76340f9a8 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:22.276672 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e99d1d44-18a8-4ec6-aae9-cde76340f9a8 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:22.277480 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e99d1d44-18a8-4ec6-aae9-cde76340f9a8 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:22.278832 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e99d1d44-18a8-4ec6-aae9-cde76340f9a8 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:22.279254 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e99d1d44-18a8-4ec6-aae9-cde76340f9a8 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:22.524032 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e99d1d44-18a8-4ec6-aae9-cde76340f9a8 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:22.537598 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e99d1d44-18a8-4ec6-aae9-cde76340f9a8 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4" status: 200 len: 1477 microversion: 2.1 time: 0.275792 Oct 27 03:23:22.538365 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 405/779] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:22 2022] GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4 => generated 1477 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:23:22.544509 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9adfb4d3-ee9e-4e33-adbc-072f08daf9f4 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:22.545383 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9adfb4d3-ee9e-4e33-adbc-072f08daf9f4 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] [instance: 8877a86d-6529-43e9-9667-0dba515be5cb] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:22.555122 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9adfb4d3-ee9e-4e33-adbc-072f08daf9f4 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:22.556389 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9adfb4d3-ee9e-4e33-adbc-072f08daf9f4 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:22.556389 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9adfb4d3-ee9e-4e33-adbc-072f08daf9f4 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:22.557374 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9adfb4d3-ee9e-4e33-adbc-072f08daf9f4 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:22.557903 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9adfb4d3-ee9e-4e33-adbc-072f08daf9f4 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:22.558365 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9adfb4d3-ee9e-4e33-adbc-072f08daf9f4 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:22.672133 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=4 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:22.741930 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9adfb4d3-ee9e-4e33-adbc-072f08daf9f4 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd90bf4a2aa403cacd06bcaeb502640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c18fabfb19904c5ea3c5c096d9d6cad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:22.761597 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9adfb4d3-ee9e-4e33-adbc-072f08daf9f4 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] 10.222.0.20 "GET /compute/v2.1/servers/8877a86d-6529-43e9-9667-0dba515be5cb" status: 200 len: 1478 microversion: 2.1 time: 0.221272 Oct 27 03:23:22.779044 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 406/780] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:22 2022] GET /compute/v2.1/servers/8877a86d-6529-43e9-9667-0dba515be5cb => generated 1478 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:22.789977 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6dd1ad94-8bcb-422e-bccd-fa27242abd9e tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:22.790924 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6dd1ad94-8bcb-422e-bccd-fa27242abd9e tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: da3360d3-ca0b-4077-af3e-92731700dada] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:22.801308 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6dd1ad94-8bcb-422e-bccd-fa27242abd9e tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:22.801809 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6dd1ad94-8bcb-422e-bccd-fa27242abd9e tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:22.802474 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6dd1ad94-8bcb-422e-bccd-fa27242abd9e tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:22.803194 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6dd1ad94-8bcb-422e-bccd-fa27242abd9e tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:22.803704 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6dd1ad94-8bcb-422e-bccd-fa27242abd9e tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:22.804798 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6dd1ad94-8bcb-422e-bccd-fa27242abd9e tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:22.855877 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=14 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:22.942809 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-7cd124ea-a49d-4f2a-bfde-890df9c7bfac tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Flavor limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:23:22.943688 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-7cd124ea-a49d-4f2a-bfde-890df9c7bfac tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Image limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:23:22.945935 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-7cd124ea-a49d-4f2a-bfde-890df9c7bfac tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Flavor pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:23:22.945935 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-7cd124ea-a49d-4f2a-bfde-890df9c7bfac tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Image pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:23:22.945935 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-7cd124ea-a49d-4f2a-bfde-890df9c7bfac tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:23:22.969753 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7cd124ea-a49d-4f2a-bfde-890df9c7bfac tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:22.969753 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7cd124ea-a49d-4f2a-bfde-890df9c7bfac tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:22.969753 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7cd124ea-a49d-4f2a-bfde-890df9c7bfac tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:22.974571 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7cd124ea-a49d-4f2a-bfde-890df9c7bfac tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:22.977392 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7cd124ea-a49d-4f2a-bfde-890df9c7bfac tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:22.977870 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7cd124ea-a49d-4f2a-bfde-890df9c7bfac tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:23.010444 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-7cd124ea-a49d-4f2a-bfde-890df9c7bfac tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Getting quotas for project 3b1cf79289db4d7883d93ec3fe908d66. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:23:23.024737 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-7cd124ea-a49d-4f2a-bfde-890df9c7bfac tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Getting quotas for user ba3ce7f040d24c33bcf9b97d1ef25268 and project 3b1cf79289db4d7883d93ec3fe908d66. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:23:23.030151 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-6dd1ad94-8bcb-422e-bccd-fa27242abd9e tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:23.043031 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6dd1ad94-8bcb-422e-bccd-fa27242abd9e tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/da3360d3-ca0b-4077-af3e-92731700dada" status: 200 len: 1503 microversion: 2.1 time: 0.262388 Oct 27 03:23:23.043857 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 407/781] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:22 2022] GET /compute/v2.1/servers/da3360d3-ca0b-4077-af3e-92731700dada => generated 1503 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:23.058876 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d9abeb6f-e922-4f48-b4c8-abfee2689af0 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:23.058876 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d9abeb6f-e922-4f48-b4c8-abfee2689af0 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] [instance: 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:23.081911 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d9abeb6f-e922-4f48-b4c8-abfee2689af0 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:23.084220 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7cd124ea-a49d-4f2a-bfde-890df9c7bfac tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Going to run 1 instances... {{(pid=121001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:23:23.084543 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d9abeb6f-e922-4f48-b4c8-abfee2689af0 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:23.085201 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d9abeb6f-e922-4f48-b4c8-abfee2689af0 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:23.086586 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d9abeb6f-e922-4f48-b4c8-abfee2689af0 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:23.087063 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d9abeb6f-e922-4f48-b4c8-abfee2689af0 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:23.087497 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d9abeb6f-e922-4f48-b4c8-abfee2689af0 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:23.091946 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7cd124ea-a49d-4f2a-bfde-890df9c7bfac tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 87ad30f8-b432-45dc-82ff-aed508afddd7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:23:23.176730 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d9abeb6f-e922-4f48-b4c8-abfee2689af0 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:23.189860 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d9abeb6f-e922-4f48-b4c8-abfee2689af0 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:23.190123 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d9abeb6f-e922-4f48-b4c8-abfee2689af0 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:23.195494 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d9abeb6f-e922-4f48-b4c8-abfee2689af0 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] 10.222.0.20 "GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503" status: 200 len: 1362 microversion: 2.75 time: 0.150856 Oct 27 03:23:23.196081 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 408/782] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:23:23 2022] GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:23:23.205084 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-766fc4c6-a1f2-4d57-9891-3b1b9b55f221 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:23.208346 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-766fc4c6-a1f2-4d57-9891-3b1b9b55f221 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:23.208346 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:UPDATE=1,nova_api:SELECT=96,nova_api:INSERT=3 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:23.222827 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-766fc4c6-a1f2-4d57-9891-3b1b9b55f221 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:23.223355 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-766fc4c6-a1f2-4d57-9891-3b1b9b55f221 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:23.223807 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-766fc4c6-a1f2-4d57-9891-3b1b9b55f221 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:23.224731 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-766fc4c6-a1f2-4d57-9891-3b1b9b55f221 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:23.225200 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-766fc4c6-a1f2-4d57-9891-3b1b9b55f221 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:23.225632 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-766fc4c6-a1f2-4d57-9891-3b1b9b55f221 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:23.228838 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7cd124ea-a49d-4f2a-bfde-890df9c7bfac tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.232859 Oct 27 03:23:23.229528 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 375/783] 10.222.0.20 () {62 vars in 1188 bytes} [Thu Oct 27 03:23:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1237 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 27 03:23:23.243445 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-14a0f592-11e3-4eed-b001-0e7a09d7835c req-b26f6f14-0d4a-48b6-96e8-c4d4c29f428d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8877a86d-6529-43e9-9667-0dba515be5cb", "name": "network-vif-deleted", "tag": "bee5d28c-c6a9-4629-9830-862dba117f82"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:23:23.290053 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-14a0f592-11e3-4eed-b001-0e7a09d7835c req-b26f6f14-0d4a-48b6-96e8-c4d4c29f428d service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:23.290553 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-14a0f592-11e3-4eed-b001-0e7a09d7835c req-b26f6f14-0d4a-48b6-96e8-c4d4c29f428d service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:23.291419 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-14a0f592-11e3-4eed-b001-0e7a09d7835c req-b26f6f14-0d4a-48b6-96e8-c4d4c29f428d service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:23.334089 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-766fc4c6-a1f2-4d57-9891-3b1b9b55f221 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:23.345256 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-14a0f592-11e3-4eed-b001-0e7a09d7835c req-b26f6f14-0d4a-48b6-96e8-c4d4c29f428d service nova] Creating event network-vif-deleted:bee5d28c-c6a9-4629-9830-862dba117f82 for instance 8877a86d-6529-43e9-9667-0dba515be5cb on n-h1-862769-1 Oct 27 03:23:23.346841 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-766fc4c6-a1f2-4d57-9891-3b1b9b55f221 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:23.350863 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-766fc4c6-a1f2-4d57-9891-3b1b9b55f221 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:23.357757 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-766fc4c6-a1f2-4d57-9891-3b1b9b55f221 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1539 microversion: 2.91 time: 0.159957 Oct 27 03:23:23.369470 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 409/784] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:23:23 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1539 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:23:23.373919 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-14a0f592-11e3-4eed-b001-0e7a09d7835c req-b26f6f14-0d4a-48b6-96e8-c4d4c29f428d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139166 Oct 27 03:23:23.373919 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 376/785] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:23:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:23:23.380203 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b8b6f71b-d065-4a8d-b12f-028254f1218d tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:23.385801 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b8b6f71b-d065-4a8d-b12f-028254f1218d tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 87ad30f8-b432-45dc-82ff-aed508afddd7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:23.397142 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9fc0d08c-14a2-44d0-b6cb-eff9ef0a8c00 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:23.397142 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9fc0d08c-14a2-44d0-b6cb-eff9ef0a8c00 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: ac5fc2b3-c92e-470a-9bc6-885dce75fb8c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:23.397142 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9fc0d08c-14a2-44d0-b6cb-eff9ef0a8c00 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:23.398234 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9fc0d08c-14a2-44d0-b6cb-eff9ef0a8c00 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:23.399131 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9fc0d08c-14a2-44d0-b6cb-eff9ef0a8c00 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:23.400019 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9fc0d08c-14a2-44d0-b6cb-eff9ef0a8c00 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:23.400996 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9fc0d08c-14a2-44d0-b6cb-eff9ef0a8c00 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:23.401584 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9fc0d08c-14a2-44d0-b6cb-eff9ef0a8c00 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:23.482456 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b8b6f71b-d065-4a8d-b12f-028254f1218d tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:23.493104 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b8b6f71b-d065-4a8d-b12f-028254f1218d tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:23.497796 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b8b6f71b-d065-4a8d-b12f-028254f1218d tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:23.497796 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b8b6f71b-d065-4a8d-b12f-028254f1218d tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/87ad30f8-b432-45dc-82ff-aed508afddd7" status: 200 len: 1262 microversion: 2.25 time: 0.124755 Oct 27 03:23:23.510508 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 377/786] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:23:23 2022] GET /compute/v2.1/servers/87ad30f8-b432-45dc-82ff-aed508afddd7 => generated 1262 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:23:23.563591 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1216bea2-3174-4436-a4a7-b35a7caccf65 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:23.564249 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1216bea2-3174-4436-a4a7-b35a7caccf65 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: b2ef080f-30ca-4dc5-ba03-9cf1899346a4] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:23.582366 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1216bea2-3174-4436-a4a7-b35a7caccf65 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:23.583932 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1216bea2-3174-4436-a4a7-b35a7caccf65 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:23.583932 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1216bea2-3174-4436-a4a7-b35a7caccf65 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:23.594814 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1216bea2-3174-4436-a4a7-b35a7caccf65 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:23.595894 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1216bea2-3174-4436-a4a7-b35a7caccf65 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:23.596744 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1216bea2-3174-4436-a4a7-b35a7caccf65 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:23.692610 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9fc0d08c-14a2-44d0-b6cb-eff9ef0a8c00 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:23.703191 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9fc0d08c-14a2-44d0-b6cb-eff9ef0a8c00 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/ac5fc2b3-c92e-470a-9bc6-885dce75fb8c" status: 200 len: 1319 microversion: 2.1 time: 0.326865 Oct 27 03:23:23.715455 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 410/787] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:23 2022] GET /compute/v2.1/servers/ac5fc2b3-c92e-470a-9bc6-885dce75fb8c => generated 1319 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:23.786311 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-fe1d4d4b-97cb-4592-b185-fa2d49a37318 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:23.789025 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-fe1d4d4b-97cb-4592-b185-fa2d49a37318 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] [instance: 8877a86d-6529-43e9-9667-0dba515be5cb] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:23.796647 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fe1d4d4b-97cb-4592-b185-fa2d49a37318 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:23.797584 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fe1d4d4b-97cb-4592-b185-fa2d49a37318 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:23.798913 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fe1d4d4b-97cb-4592-b185-fa2d49a37318 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:23.800121 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fe1d4d4b-97cb-4592-b185-fa2d49a37318 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:23.801099 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fe1d4d4b-97cb-4592-b185-fa2d49a37318 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:23.802130 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fe1d4d4b-97cb-4592-b185-fa2d49a37318 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:23.849915 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fe1d4d4b-97cb-4592-b185-fa2d49a37318 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:23.850539 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fe1d4d4b-97cb-4592-b185-fa2d49a37318 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:23.851101 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fe1d4d4b-97cb-4592-b185-fa2d49a37318 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:23.851690 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-fe1d4d4b-97cb-4592-b185-fa2d49a37318 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Lazy-loading 'fault' on Instance uuid 8877a86d-6529-43e9-9667-0dba515be5cb {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:23:23.899528 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-fe1d4d4b-97cb-4592-b185-fa2d49a37318 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd90bf4a2aa403cacd06bcaeb502640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c18fabfb19904c5ea3c5c096d9d6cad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:23.909306 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-fe1d4d4b-97cb-4592-b185-fa2d49a37318 tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] 10.222.0.20 "GET /compute/v2.1/servers/8877a86d-6529-43e9-9667-0dba515be5cb" status: 200 len: 1312 microversion: 2.1 time: 0.127135 Oct 27 03:23:23.918068 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 411/788] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:23 2022] GET /compute/v2.1/servers/8877a86d-6529-43e9-9667-0dba515be5cb => generated 1312 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:23.992178 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1216bea2-3174-4436-a4a7-b35a7caccf65 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:24.005450 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1216bea2-3174-4436-a4a7-b35a7caccf65 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4" status: 200 len: 1476 microversion: 2.1 time: 0.447367 Oct 27 03:23:24.006087 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 378/789] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:23 2022] GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4 => generated 1476 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:23:24.070437 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-546a852d-3743-4e38-bc15-0a23c00d5253 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:24.087861 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-546a852d-3743-4e38-bc15-0a23c00d5253 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: da3360d3-ca0b-4077-af3e-92731700dada] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:24.087861 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-546a852d-3743-4e38-bc15-0a23c00d5253 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:24.087861 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-546a852d-3743-4e38-bc15-0a23c00d5253 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:24.087861 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-546a852d-3743-4e38-bc15-0a23c00d5253 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:24.090523 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-546a852d-3743-4e38-bc15-0a23c00d5253 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:24.090523 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-546a852d-3743-4e38-bc15-0a23c00d5253 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:24.090523 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-546a852d-3743-4e38-bc15-0a23c00d5253 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:24.090523 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=100 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:24.225161 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ca7230df-9e6c-4300-9b6e-add06136f7c8 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:24.226174 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ca7230df-9e6c-4300-9b6e-add06136f7c8 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] [instance: 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:24.244768 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-546a852d-3743-4e38-bc15-0a23c00d5253 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:24.255328 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ca7230df-9e6c-4300-9b6e-add06136f7c8 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:24.255553 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-546a852d-3743-4e38-bc15-0a23c00d5253 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/da3360d3-ca0b-4077-af3e-92731700dada" status: 200 len: 1493 microversion: 2.1 time: 0.188739 Oct 27 03:23:24.256481 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ca7230df-9e6c-4300-9b6e-add06136f7c8 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:24.256664 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 412/790] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:24 2022] GET /compute/v2.1/servers/da3360d3-ca0b-4077-af3e-92731700dada => generated 1493 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:24.258303 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ca7230df-9e6c-4300-9b6e-add06136f7c8 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:24.261018 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ca7230df-9e6c-4300-9b6e-add06136f7c8 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:24.261018 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ca7230df-9e6c-4300-9b6e-add06136f7c8 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:24.261018 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ca7230df-9e6c-4300-9b6e-add06136f7c8 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:24.281559 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-05e287a7-84a3-43ab-8587-58c6951542db tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Calling method '.version_select at 0x7f7ddaac3550>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:24.285577 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-05e287a7-84a3-43ab-8587-58c6951542db tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:24.289787 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-05e287a7-84a3-43ab-8587-58c6951542db tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:24.289787 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-05e287a7-84a3-43ab-8587-58c6951542db tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:24.299002 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-05e287a7-84a3-43ab-8587-58c6951542db tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 1189 microversion: 2.1 time: 0.021325 Oct 27 03:23:24.299857 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 413/791] 10.222.0.20 () {58 vars in 1143 bytes} [Thu Oct 27 03:23:24 2022] GET /compute/v2.1/os-migrations => generated 1189 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:23:24.314891 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3f63dc38-2512-4020-81c0-b95027f05f23 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:24.315573 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-3f63dc38-2512-4020-81c0-b95027f05f23 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] [instance: da3360d3-ca0b-4077-af3e-92731700dada] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:24.322742 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3f63dc38-2512-4020-81c0-b95027f05f23 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:24.323446 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3f63dc38-2512-4020-81c0-b95027f05f23 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:24.323940 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3f63dc38-2512-4020-81c0-b95027f05f23 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:24.324765 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3f63dc38-2512-4020-81c0-b95027f05f23 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:24.325224 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3f63dc38-2512-4020-81c0-b95027f05f23 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:24.325646 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3f63dc38-2512-4020-81c0-b95027f05f23 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:24.359347 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ca7230df-9e6c-4300-9b6e-add06136f7c8 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:24.374277 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ca7230df-9e6c-4300-9b6e-add06136f7c8 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:24.379034 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ca7230df-9e6c-4300-9b6e-add06136f7c8 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:24.398255 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ca7230df-9e6c-4300-9b6e-add06136f7c8 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] 10.222.0.20 "GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503" status: 200 len: 1410 microversion: 2.75 time: 0.174537 Oct 27 03:23:24.398255 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 379/792] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:23:24 2022] GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503 => generated 1410 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:23:24.429520 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2fa5afb3-8cac-420d-a029-e9ecfa87ad8f tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:24.430409 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2fa5afb3-8cac-420d-a029-e9ecfa87ad8f tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:24.438768 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2fa5afb3-8cac-420d-a029-e9ecfa87ad8f tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:24.439797 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2fa5afb3-8cac-420d-a029-e9ecfa87ad8f tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:24.440627 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2fa5afb3-8cac-420d-a029-e9ecfa87ad8f tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:24.453333 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2fa5afb3-8cac-420d-a029-e9ecfa87ad8f tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:24.454558 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2fa5afb3-8cac-420d-a029-e9ecfa87ad8f tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:24.455691 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2fa5afb3-8cac-420d-a029-e9ecfa87ad8f tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:24.544420 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3f63dc38-2512-4020-81c0-b95027f05f23 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/da3360d3-ca0b-4077-af3e-92731700dada" status: 200 len: 1644 microversion: 2.1 time: 0.230186 Oct 27 03:23:24.569177 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 414/793] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:24 2022] GET /compute/v2.1/servers/da3360d3-ca0b-4077-af3e-92731700dada => generated 1644 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:23:24.583801 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-495b85e8-88c5-4e8d-a87d-abd859b4361e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:24.586263 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-495b85e8-88c5-4e8d-a87d-abd859b4361e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 87ad30f8-b432-45dc-82ff-aed508afddd7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:24.604633 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2fa5afb3-8cac-420d-a029-e9ecfa87ad8f tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:24.616340 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2fa5afb3-8cac-420d-a029-e9ecfa87ad8f tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:24.624092 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2fa5afb3-8cac-420d-a029-e9ecfa87ad8f tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:24.645081 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2fa5afb3-8cac-420d-a029-e9ecfa87ad8f tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1539 microversion: 2.91 time: 0.230268 Oct 27 03:23:24.645081 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 380/794] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:23:24 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1539 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:23:24.708286 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-495b85e8-88c5-4e8d-a87d-abd859b4361e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:24.719214 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-495b85e8-88c5-4e8d-a87d-abd859b4361e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:24.728532 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-495b85e8-88c5-4e8d-a87d-abd859b4361e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:24.729131 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c229df17-12db-4b72-9aaa-67e717be2fc9 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:24.729921 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c229df17-12db-4b72-9aaa-67e717be2fc9 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: ac5fc2b3-c92e-470a-9bc6-885dce75fb8c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:24.734143 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-495b85e8-88c5-4e8d-a87d-abd859b4361e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/87ad30f8-b432-45dc-82ff-aed508afddd7" status: 200 len: 1262 microversion: 2.25 time: 0.162278 Oct 27 03:23:24.737215 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c229df17-12db-4b72-9aaa-67e717be2fc9 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:24.737756 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c229df17-12db-4b72-9aaa-67e717be2fc9 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:24.738240 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c229df17-12db-4b72-9aaa-67e717be2fc9 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:24.739119 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c229df17-12db-4b72-9aaa-67e717be2fc9 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:24.739845 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c229df17-12db-4b72-9aaa-67e717be2fc9 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:24.740708 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c229df17-12db-4b72-9aaa-67e717be2fc9 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:24.754193 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 415/795] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:23:24 2022] GET /compute/v2.1/servers/87ad30f8-b432-45dc-82ff-aed508afddd7 => generated 1262 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:23:24.763960 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-44c71d03-183b-4714-997f-530e0f11e4d1 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1231414795", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": [{"uuid": "bccdb388-9120-416e-ba10-d9831d24a110"}]}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:23:24.832214 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-44c71d03-183b-4714-997f-530e0f11e4d1 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] validate_networks() for [('bccdb388-9120-416e-ba10-d9831d24a110', None, None, None, None, None)] {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:23:25.057477 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c229df17-12db-4b72-9aaa-67e717be2fc9 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:25.074550 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c229df17-12db-4b72-9aaa-67e717be2fc9 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/ac5fc2b3-c92e-470a-9bc6-885dce75fb8c" status: 200 len: 1319 microversion: 2.1 time: 0.345085 Oct 27 03:23:25.074550 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 381/796] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:24 2022] GET /compute/v2.1/servers/ac5fc2b3-c92e-470a-9bc6-885dce75fb8c => generated 1319 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:23:25.087861 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-fe1097e7-c602-4786-8b7e-552f242f544e tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:25.088803 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-fe1097e7-c602-4786-8b7e-552f242f544e tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] [instance: 8877a86d-6529-43e9-9667-0dba515be5cb] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:25.104367 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fe1097e7-c602-4786-8b7e-552f242f544e tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:25.104781 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fe1097e7-c602-4786-8b7e-552f242f544e tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:25.105233 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fe1097e7-c602-4786-8b7e-552f242f544e tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:25.105955 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fe1097e7-c602-4786-8b7e-552f242f544e tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:25.106536 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fe1097e7-c602-4786-8b7e-552f242f544e tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:25.106967 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fe1097e7-c602-4786-8b7e-552f242f544e tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:25.138333 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-fe1097e7-c602-4786-8b7e-552f242f544e tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] HTTP exception thrown: Instance 8877a86d-6529-43e9-9667-0dba515be5cb could not be found. Oct 27 03:23:25.141725 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-fe1097e7-c602-4786-8b7e-552f242f544e tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Request method failure captured: Oct 27 03:23:25.141725 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/8877a86d-6529-43e9-9667-0dba515be5cb HTTP/1.1 Oct 27 03:23:25.141725 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:23:25.141725 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:23:25.141725 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:23:25.141725 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:23:25.141725 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:23:25.141725 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:23:25.141725 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:23:25.141725 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:23:25.141725 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfmRrSleab3n8BYMx37sPtuuqq8cjr4wJ83hHsJgBD7LsnDOMzMx9XYwsuNYAZRRajXIBeewjBVxOD8LN9AEa6phwovCA71TqhVacy_HU7xZ1sB-_y_PuuYHpONBt2-xQlPaw-ugrBnWlOp20MH-UP-4aD9VZRV2UAFhKy6tYEuOC5E Oct 27 03:23:25.141725 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:23:25.141725 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:23:25.141725 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:23:25.141725 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:23:25.141725 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:23:25.141725 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:23:25.141725 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: c18fabfb19904c5ea3c5c096d9d6cad7 Oct 27 03:23:25.141725 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1761112792 Oct 27 03:23:25.141725 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:23:25.141725 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:23:25.143410 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c18fabfb19904c5ea3c5c096d9d6cad7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c18fabfb19904c5ea3c5c096d9d6cad7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c18fabfb19904c5ea3c5c096d9d6cad7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c18fabfb19904c5ea3c5c096d9d6cad7"}]}] Oct 27 03:23:25.143410 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1761112792 Oct 27 03:23:25.143410 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: c18fabfb19904c5ea3c5c096d9d6cad7 Oct 27 03:23:25.143410 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1761112792 Oct 27 03:23:25.143410 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServerDiagnosticsNegativeTest-1761112792-project Oct 27 03:23:25.143410 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:23:25.143410 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:23:25.143410 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 7bd90bf4a2aa403cacd06bcaeb502640 Oct 27 03:23:25.143410 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1761112792-project Oct 27 03:23:25.143410 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:23:25.143410 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 8877a86d-6529-43e9-9667-0dba515be5cb could not be found. Oct 27 03:23:25.143410 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '8877a86d-6529-43e9-9667-0dba515be5cb'} Oct 27 03:23:25.144314 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:23:25.144314 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:23:25.144314 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:23:25.144314 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:23:25.144314 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:23:25.144314 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:23:25.144314 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:23:25.144314 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:23:25.144314 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:23:25.144314 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:23:25.144314 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8877a86d-6529-43e9-9667-0dba515be5cb could not be found. Oct 27 03:23:25.144314 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:23:25.144314 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:23:25.144314 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:23:25.144314 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:23:25.144314 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:23:25.144314 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:23:25.144314 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:23:25.144314 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:23:25.144314 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:23:25.145908 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:23:25.145908 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:23:25.145908 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:23:25.145908 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:23:25.145908 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:23:25.145908 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:23:25.145908 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:23:25.145908 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8877a86d-6529-43e9-9667-0dba515be5cb could not be found. Oct 27 03:23:25.145908 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:23:25.145908 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:23:25.145908 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:23:25.145908 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:23:25.145908 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:23:25.145908 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:23:25.145908 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:23:25.145908 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:23:25.145908 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8877a86d-6529-43e9-9667-0dba515be5cb could not be found. Oct 27 03:23:25.145908 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:23:25.149670 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-fe1097e7-c602-4786-8b7e-552f242f544e tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] Returning 404 to user: Instance 8877a86d-6529-43e9-9667-0dba515be5cb could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:23:25.151557 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-fe1097e7-c602-4786-8b7e-552f242f544e tempest-ServerDiagnosticsNegativeTest-1761112792 tempest-ServerDiagnosticsNegativeTest-1761112792-project] 10.222.0.20 "GET /compute/v2.1/servers/8877a86d-6529-43e9-9667-0dba515be5cb" status: 404 len: 111 microversion: 2.1 time: 0.071513 Oct 27 03:23:25.152760 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 382/797] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:25 2022] GET /compute/v2.1/servers/8877a86d-6529-43e9-9667-0dba515be5cb => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:23:25.182269 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-67174e1b-9543-43ac-8839-f1b5918f7531 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:25.182269 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-67174e1b-9543-43ac-8839-f1b5918f7531 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: b2ef080f-30ca-4dc5-ba03-9cf1899346a4] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:25.200196 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-67174e1b-9543-43ac-8839-f1b5918f7531 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:25.200968 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-67174e1b-9543-43ac-8839-f1b5918f7531 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:25.205079 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-67174e1b-9543-43ac-8839-f1b5918f7531 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:25.205079 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-67174e1b-9543-43ac-8839-f1b5918f7531 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:25.205079 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-67174e1b-9543-43ac-8839-f1b5918f7531 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:25.208756 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-67174e1b-9543-43ac-8839-f1b5918f7531 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:25.220076 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:25.432134 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-44c71d03-183b-4714-997f-530e0f11e4d1 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:23:25.432800 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-44c71d03-183b-4714-997f-530e0f11e4d1 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:23:25.433443 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-44c71d03-183b-4714-997f-530e0f11e4d1 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:23:25.434020 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-44c71d03-183b-4714-997f-530e0f11e4d1 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:23:25.435726 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-44c71d03-183b-4714-997f-530e0f11e4d1 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:23:25.444880 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-44c71d03-183b-4714-997f-530e0f11e4d1 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:25.445544 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-44c71d03-183b-4714-997f-530e0f11e4d1 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:25.446254 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-44c71d03-183b-4714-997f-530e0f11e4d1 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:25.447350 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-44c71d03-183b-4714-997f-530e0f11e4d1 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:25.447883 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-44c71d03-183b-4714-997f-530e0f11e4d1 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:25.448377 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-44c71d03-183b-4714-997f-530e0f11e4d1 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:25.456346 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=29 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:25.469183 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-44c71d03-183b-4714-997f-530e0f11e4d1 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Getting quotas for project aaee7e66f16e4ed5b49394311bd2803a. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:23:25.475506 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-44c71d03-183b-4714-997f-530e0f11e4d1 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Getting quotas for user 8c93886c5818439690564c2299a4f3ee and project aaee7e66f16e4ed5b49394311bd2803a. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:23:25.490383 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-44c71d03-183b-4714-997f-530e0f11e4d1 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:23:25.492660 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-44c71d03-183b-4714-997f-530e0f11e4d1 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: a52fed88-50f8-4dea-b83d-6878adccb024] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:23:25.505441 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-67174e1b-9543-43ac-8839-f1b5918f7531 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:25.513940 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-67174e1b-9543-43ac-8839-f1b5918f7531 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4" status: 200 len: 1476 microversion: 2.1 time: 0.360001 Oct 27 03:23:25.516034 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 383/798] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:25 2022] GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4 => generated 1476 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:25.521036 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-fc9533a7-3245-4436-aeb4-28c96f38c7da req-76192a78-ba12-468c-be7c-63ce7837d43b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2ef080f-30ca-4dc5-ba03-9cf1899346a4", "name": "network-vif-unplugged", "status": "completed", "tag": "7bd75d20-f08a-4aa0-b246-a0898c1313cc"}, {"name": "network-changed", "server_uuid": "b2ef080f-30ca-4dc5-ba03-9cf1899346a4", "tag": "7bd75d20-f08a-4aa0-b246-a0898c1313cc"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:23:25.532857 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-fc9533a7-3245-4436-aeb4-28c96f38c7da req-76192a78-ba12-468c-be7c-63ce7837d43b service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:25.533884 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-fc9533a7-3245-4436-aeb4-28c96f38c7da req-76192a78-ba12-468c-be7c-63ce7837d43b service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:25.544909 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-fc9533a7-3245-4436-aeb4-28c96f38c7da req-76192a78-ba12-468c-be7c-63ce7837d43b service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:25.567853 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-fc9533a7-3245-4436-aeb4-28c96f38c7da req-76192a78-ba12-468c-be7c-63ce7837d43b service nova] Creating event network-vif-unplugged:7bd75d20-f08a-4aa0-b246-a0898c1313cc for instance b2ef080f-30ca-4dc5-ba03-9cf1899346a4 on n-h1-862769-1 Oct 27 03:23:25.568777 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-fc9533a7-3245-4436-aeb4-28c96f38c7da req-76192a78-ba12-468c-be7c-63ce7837d43b service nova] Creating event network-changed:7bd75d20-f08a-4aa0-b246-a0898c1313cc for instance b2ef080f-30ca-4dc5-ba03-9cf1899346a4 on n-h1-862769-1 Oct 27 03:23:25.604529 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [req-fc9533a7-3245-4436-aeb4-28c96f38c7da req-76192a78-ba12-468c-be7c-63ce7837d43b service nova] Instance b2ef080f-30ca-4dc5-ba03-9cf1899346a4 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862769-1', 'n-h1-862769-1'} {{(pid=121001) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 03:23:25.621913 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-fc9533a7-3245-4436-aeb4-28c96f38c7da req-76192a78-ba12-468c-be7c-63ce7837d43b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.104555 Oct 27 03:23:25.623489 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 384/799] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:23:25 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:23:25.630248 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-7ece9318-708d-4f4c-a85e-dc948aad4e1e req-616e4ea2-bea4-4b2a-b618-bd870362fed1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac5fc2b3-c92e-470a-9bc6-885dce75fb8c", "name": "network-vif-plugged", "status": "completed", "tag": "46d55368-0f87-40d8-99d6-d7efc67e997a"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:23:25.642326 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-7ece9318-708d-4f4c-a85e-dc948aad4e1e req-616e4ea2-bea4-4b2a-b618-bd870362fed1 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:25.643246 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-7ece9318-708d-4f4c-a85e-dc948aad4e1e req-616e4ea2-bea4-4b2a-b618-bd870362fed1 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:25.643850 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-7ece9318-708d-4f4c-a85e-dc948aad4e1e req-616e4ea2-bea4-4b2a-b618-bd870362fed1 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:25.659071 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-7ece9318-708d-4f4c-a85e-dc948aad4e1e req-616e4ea2-bea4-4b2a-b618-bd870362fed1 service nova] Creating event network-vif-plugged:46d55368-0f87-40d8-99d6-d7efc67e997a for instance ac5fc2b3-c92e-470a-9bc6-885dce75fb8c on n-h1-862769-1 Oct 27 03:23:25.665331 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-7ece9318-708d-4f4c-a85e-dc948aad4e1e req-616e4ea2-bea4-4b2a-b618-bd870362fed1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039472 Oct 27 03:23:25.666715 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 385/800] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:23:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:23:25.683879 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-44c71d03-183b-4714-997f-530e0f11e4d1 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.928280 Oct 27 03:23:25.684560 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 416/801] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:23:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 930 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 03:23:25.691250 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7f0e0fac-bff9-43e8-8b86-a186010ebd12 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:25.691250 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7f0e0fac-bff9-43e8-8b86-a186010ebd12 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] [instance: 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:25.696543 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f8819fd2-634f-4d51-b7c5-f5d6138d1bed tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:25.697172 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f8819fd2-634f-4d51-b7c5-f5d6138d1bed tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:25.723023 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7f0e0fac-bff9-43e8-8b86-a186010ebd12 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:25.725709 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7f0e0fac-bff9-43e8-8b86-a186010ebd12 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:25.726758 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7f0e0fac-bff9-43e8-8b86-a186010ebd12 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:25.729058 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7f0e0fac-bff9-43e8-8b86-a186010ebd12 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:25.736920 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7f0e0fac-bff9-43e8-8b86-a186010ebd12 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:25.737410 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7f0e0fac-bff9-43e8-8b86-a186010ebd12 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:25.749015 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f8819fd2-634f-4d51-b7c5-f5d6138d1bed tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:25.750107 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f8819fd2-634f-4d51-b7c5-f5d6138d1bed tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:25.759180 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f8819fd2-634f-4d51-b7c5-f5d6138d1bed tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:25.761945 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f8819fd2-634f-4d51-b7c5-f5d6138d1bed tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:25.762524 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f8819fd2-634f-4d51-b7c5-f5d6138d1bed tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:25.762990 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f8819fd2-634f-4d51-b7c5-f5d6138d1bed tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:25.876454 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7f0e0fac-bff9-43e8-8b86-a186010ebd12 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:25.886707 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7f0e0fac-bff9-43e8-8b86-a186010ebd12 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:25.889040 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7f0e0fac-bff9-43e8-8b86-a186010ebd12 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:25.896950 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7f0e0fac-bff9-43e8-8b86-a186010ebd12 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] 10.222.0.20 "GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503" status: 200 len: 1416 microversion: 2.75 time: 0.228704 Oct 27 03:23:25.897776 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 386/802] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:23:25 2022] GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503 => generated 1416 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:23:25.903128 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ae057e79-f9c3-4ab1-bdc1-0674f1c236e0 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:25.904017 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ae057e79-f9c3-4ab1-bdc1-0674f1c236e0 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: a52fed88-50f8-4dea-b83d-6878adccb024] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:25.922571 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f8819fd2-634f-4d51-b7c5-f5d6138d1bed tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:25.934214 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f8819fd2-634f-4d51-b7c5-f5d6138d1bed tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:25.940268 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f8819fd2-634f-4d51-b7c5-f5d6138d1bed tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:25.952445 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f8819fd2-634f-4d51-b7c5-f5d6138d1bed tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1539 microversion: 2.91 time: 0.259392 Oct 27 03:23:25.953692 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 417/803] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:23:25 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1539 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:23:25.985116 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-73df43e6-6ae7-4901-a795-daa473d44ba8 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:25.987193 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-73df43e6-6ae7-4901-a795-daa473d44ba8 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 87ad30f8-b432-45dc-82ff-aed508afddd7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:25.993204 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ae057e79-f9c3-4ab1-bdc1-0674f1c236e0 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:25.996625 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-73df43e6-6ae7-4901-a795-daa473d44ba8 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:25.997261 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-73df43e6-6ae7-4901-a795-daa473d44ba8 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:25.997703 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-73df43e6-6ae7-4901-a795-daa473d44ba8 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:25.998757 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-73df43e6-6ae7-4901-a795-daa473d44ba8 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:25.999306 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-73df43e6-6ae7-4901-a795-daa473d44ba8 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:26.000073 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-73df43e6-6ae7-4901-a795-daa473d44ba8 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:26.006480 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ae057e79-f9c3-4ab1-bdc1-0674f1c236e0 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/a52fed88-50f8-4dea-b83d-6878adccb024" status: 200 len: 1211 microversion: 2.1 time: 0.104000 Oct 27 03:23:26.006480 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 387/804] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:25 2022] GET /compute/v2.1/servers/a52fed88-50f8-4dea-b83d-6878adccb024 => generated 1211 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:26.069909 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-73df43e6-6ae7-4901-a795-daa473d44ba8 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:26.078546 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-73df43e6-6ae7-4901-a795-daa473d44ba8 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:26.080086 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-73df43e6-6ae7-4901-a795-daa473d44ba8 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:26.081211 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-73df43e6-6ae7-4901-a795-daa473d44ba8 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/87ad30f8-b432-45dc-82ff-aed508afddd7" status: 200 len: 1314 microversion: 2.25 time: 0.107511 Oct 27 03:23:26.081842 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 418/805] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:23:25 2022] GET /compute/v2.1/servers/87ad30f8-b432-45dc-82ff-aed508afddd7 => generated 1314 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:23:26.100295 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-348abc56-8c16-49ac-8b31-298f828d493c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:26.106545 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-348abc56-8c16-49ac-8b31-298f828d493c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: ac5fc2b3-c92e-470a-9bc6-885dce75fb8c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:26.113344 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-348abc56-8c16-49ac-8b31-298f828d493c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:26.115813 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-348abc56-8c16-49ac-8b31-298f828d493c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:26.115813 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-348abc56-8c16-49ac-8b31-298f828d493c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:26.115813 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-348abc56-8c16-49ac-8b31-298f828d493c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:26.115813 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-348abc56-8c16-49ac-8b31-298f828d493c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:26.116171 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-348abc56-8c16-49ac-8b31-298f828d493c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:26.288656 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-348abc56-8c16-49ac-8b31-298f828d493c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:26.297129 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-348abc56-8c16-49ac-8b31-298f828d493c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/ac5fc2b3-c92e-470a-9bc6-885dce75fb8c" status: 200 len: 1319 microversion: 2.1 time: 0.201201 Oct 27 03:23:26.306142 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 388/806] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:26 2022] GET /compute/v2.1/servers/ac5fc2b3-c92e-470a-9bc6-885dce75fb8c => generated 1319 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:26.541353 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-970fe20e-1a74-48fb-a981-617c6eb41899 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:26.542511 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-970fe20e-1a74-48fb-a981-617c6eb41899 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: b2ef080f-30ca-4dc5-ba03-9cf1899346a4] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:26.550580 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-970fe20e-1a74-48fb-a981-617c6eb41899 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:26.553923 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-970fe20e-1a74-48fb-a981-617c6eb41899 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:26.556690 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-970fe20e-1a74-48fb-a981-617c6eb41899 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:26.574951 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-970fe20e-1a74-48fb-a981-617c6eb41899 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:26.574951 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-970fe20e-1a74-48fb-a981-617c6eb41899 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:26.574951 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-970fe20e-1a74-48fb-a981-617c6eb41899 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:26.721669 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-970fe20e-1a74-48fb-a981-617c6eb41899 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:26.730486 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-970fe20e-1a74-48fb-a981-617c6eb41899 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4" status: 200 len: 1474 microversion: 2.1 time: 0.192974 Oct 27 03:23:26.733124 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 419/807] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:26 2022] GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4 => generated 1474 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:26.928918 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0506fe4e-9c19-4f24-b827-95c3b86be0fe tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:26.929579 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0506fe4e-9c19-4f24-b827-95c3b86be0fe tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] [instance: 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:26.936299 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0506fe4e-9c19-4f24-b827-95c3b86be0fe tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:26.937572 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0506fe4e-9c19-4f24-b827-95c3b86be0fe tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:26.941760 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0506fe4e-9c19-4f24-b827-95c3b86be0fe tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:26.941760 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0506fe4e-9c19-4f24-b827-95c3b86be0fe tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:26.941760 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0506fe4e-9c19-4f24-b827-95c3b86be0fe tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:26.941760 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0506fe4e-9c19-4f24-b827-95c3b86be0fe tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:26.982162 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-fe345159-ae7e-408f-a3ea-459e04eea103 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:26.983337 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-fe345159-ae7e-408f-a3ea-459e04eea103 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:26.993315 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fe345159-ae7e-408f-a3ea-459e04eea103 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:26.994229 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fe345159-ae7e-408f-a3ea-459e04eea103 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:26.995023 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fe345159-ae7e-408f-a3ea-459e04eea103 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:26.995942 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fe345159-ae7e-408f-a3ea-459e04eea103 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:26.996552 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fe345159-ae7e-408f-a3ea-459e04eea103 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:26.996991 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fe345159-ae7e-408f-a3ea-459e04eea103 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:27.024454 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0506fe4e-9c19-4f24-b827-95c3b86be0fe tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:27.033696 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0506fe4e-9c19-4f24-b827-95c3b86be0fe tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:27.035251 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0506fe4e-9c19-4f24-b827-95c3b86be0fe tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:27.037375 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:27.042268 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0506fe4e-9c19-4f24-b827-95c3b86be0fe tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] 10.222.0.20 "GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503" status: 200 len: 1416 microversion: 2.75 time: 0.118242 Oct 27 03:23:27.050503 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 389/808] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:23:26 2022] GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503 => generated 1416 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:23:27.067610 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e47a8d3f-eb9e-4d6c-910f-a6aa64d20692 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:27.068242 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e47a8d3f-eb9e-4d6c-910f-a6aa64d20692 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: a52fed88-50f8-4dea-b83d-6878adccb024] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:27.074891 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e47a8d3f-eb9e-4d6c-910f-a6aa64d20692 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:27.075394 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e47a8d3f-eb9e-4d6c-910f-a6aa64d20692 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:27.075831 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e47a8d3f-eb9e-4d6c-910f-a6aa64d20692 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:27.076719 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e47a8d3f-eb9e-4d6c-910f-a6aa64d20692 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:27.077404 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e47a8d3f-eb9e-4d6c-910f-a6aa64d20692 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:27.083993 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e47a8d3f-eb9e-4d6c-910f-a6aa64d20692 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:27.091265 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-fe345159-ae7e-408f-a3ea-459e04eea103 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:27.102878 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-fe345159-ae7e-408f-a3ea-459e04eea103 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:27.104816 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-fe345159-ae7e-408f-a3ea-459e04eea103 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:27.111918 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-fe345159-ae7e-408f-a3ea-459e04eea103 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1539 microversion: 2.91 time: 0.134832 Oct 27 03:23:27.112587 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 420/809] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:23:26 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1539 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:23:27.127653 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-331bb7d9-dc62-400c-a443-1cd87a26a2f8 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:27.128478 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-331bb7d9-dc62-400c-a443-1cd87a26a2f8 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 87ad30f8-b432-45dc-82ff-aed508afddd7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:27.137787 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-331bb7d9-dc62-400c-a443-1cd87a26a2f8 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:27.138352 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-331bb7d9-dc62-400c-a443-1cd87a26a2f8 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:27.138798 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-331bb7d9-dc62-400c-a443-1cd87a26a2f8 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:27.148659 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-331bb7d9-dc62-400c-a443-1cd87a26a2f8 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:27.149133 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-331bb7d9-dc62-400c-a443-1cd87a26a2f8 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:27.149776 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-331bb7d9-dc62-400c-a443-1cd87a26a2f8 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:27.170802 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e47a8d3f-eb9e-4d6c-910f-a6aa64d20692 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:27.198339 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e47a8d3f-eb9e-4d6c-910f-a6aa64d20692 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/a52fed88-50f8-4dea-b83d-6878adccb024" status: 200 len: 1215 microversion: 2.1 time: 0.141461 Oct 27 03:23:27.198339 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 390/810] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:27 2022] GET /compute/v2.1/servers/a52fed88-50f8-4dea-b83d-6878adccb024 => generated 1215 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:27.232647 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-331bb7d9-dc62-400c-a443-1cd87a26a2f8 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:27.254107 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-331bb7d9-dc62-400c-a443-1cd87a26a2f8 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:27.256592 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-331bb7d9-dc62-400c-a443-1cd87a26a2f8 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:27.257976 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-331bb7d9-dc62-400c-a443-1cd87a26a2f8 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/87ad30f8-b432-45dc-82ff-aed508afddd7" status: 200 len: 1314 microversion: 2.25 time: 0.144195 Oct 27 03:23:27.258572 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 421/811] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:23:27 2022] GET /compute/v2.1/servers/87ad30f8-b432-45dc-82ff-aed508afddd7 => generated 1314 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:23:27.324427 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8ef0c7d7-0081-4ff5-92ed-cd787fd869a2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:27.325685 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8ef0c7d7-0081-4ff5-92ed-cd787fd869a2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: ac5fc2b3-c92e-470a-9bc6-885dce75fb8c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:27.333071 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8ef0c7d7-0081-4ff5-92ed-cd787fd869a2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:27.333557 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8ef0c7d7-0081-4ff5-92ed-cd787fd869a2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:27.334001 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8ef0c7d7-0081-4ff5-92ed-cd787fd869a2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:27.334735 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8ef0c7d7-0081-4ff5-92ed-cd787fd869a2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:27.335220 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8ef0c7d7-0081-4ff5-92ed-cd787fd869a2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:27.335630 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8ef0c7d7-0081-4ff5-92ed-cd787fd869a2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:27.517433 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8ef0c7d7-0081-4ff5-92ed-cd787fd869a2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:27.525682 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8ef0c7d7-0081-4ff5-92ed-cd787fd869a2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/ac5fc2b3-c92e-470a-9bc6-885dce75fb8c" status: 200 len: 1319 microversion: 2.1 time: 0.205094 Oct 27 03:23:27.526910 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 391/812] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:27 2022] GET /compute/v2.1/servers/ac5fc2b3-c92e-470a-9bc6-885dce75fb8c => generated 1319 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:27.756366 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-73cf63ce-247c-497d-973f-e9133916edfc tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:27.756976 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-73cf63ce-247c-497d-973f-e9133916edfc tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: b2ef080f-30ca-4dc5-ba03-9cf1899346a4] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:27.763499 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-73cf63ce-247c-497d-973f-e9133916edfc tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:27.770854 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-73cf63ce-247c-497d-973f-e9133916edfc tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:27.770854 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-73cf63ce-247c-497d-973f-e9133916edfc tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:27.770854 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-73cf63ce-247c-497d-973f-e9133916edfc tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:27.770854 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-73cf63ce-247c-497d-973f-e9133916edfc tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:27.771216 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-73cf63ce-247c-497d-973f-e9133916edfc tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:27.931109 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-73cf63ce-247c-497d-973f-e9133916edfc tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:27.939850 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-73cf63ce-247c-497d-973f-e9133916edfc tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4" status: 200 len: 1474 microversion: 2.1 time: 0.187247 Oct 27 03:23:27.940448 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 422/813] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:27 2022] GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4 => generated 1474 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:28.071547 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b6832172-4030-463b-95cb-0ac3e6e5263b tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:28.075883 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b6832172-4030-463b-95cb-0ac3e6e5263b tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] [instance: 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:28.080023 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b6832172-4030-463b-95cb-0ac3e6e5263b tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:28.080531 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b6832172-4030-463b-95cb-0ac3e6e5263b tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:28.081148 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b6832172-4030-463b-95cb-0ac3e6e5263b tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:28.081788 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b6832172-4030-463b-95cb-0ac3e6e5263b tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:28.082286 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b6832172-4030-463b-95cb-0ac3e6e5263b tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:28.082731 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b6832172-4030-463b-95cb-0ac3e6e5263b tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:28.149052 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d1210bfd-9dba-460b-b1d6-7fdbe8686b03 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:28.150316 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d1210bfd-9dba-460b-b1d6-7fdbe8686b03 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:28.169655 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d1210bfd-9dba-460b-b1d6-7fdbe8686b03 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:28.179648 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d1210bfd-9dba-460b-b1d6-7fdbe8686b03 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:28.179648 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d1210bfd-9dba-460b-b1d6-7fdbe8686b03 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:28.179648 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d1210bfd-9dba-460b-b1d6-7fdbe8686b03 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:28.179648 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d1210bfd-9dba-460b-b1d6-7fdbe8686b03 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:28.180328 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d1210bfd-9dba-460b-b1d6-7fdbe8686b03 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:28.197917 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b6832172-4030-463b-95cb-0ac3e6e5263b tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:28.207639 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b6832172-4030-463b-95cb-0ac3e6e5263b tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:28.209114 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b6832172-4030-463b-95cb-0ac3e6e5263b tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:28.234193 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b6832172-4030-463b-95cb-0ac3e6e5263b tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] 10.222.0.20 "GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503" status: 200 len: 1437 microversion: 2.75 time: 0.166781 Oct 27 03:23:28.257476 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 392/814] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:23:28 2022] GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503 => generated 1437 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:23:28.272567 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-369bc2e7-3d84-4181-a0db-60f97fcc8317 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:28.273435 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-369bc2e7-3d84-4181-a0db-60f97fcc8317 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: a52fed88-50f8-4dea-b83d-6878adccb024] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:28.282325 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-369bc2e7-3d84-4181-a0db-60f97fcc8317 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:28.282817 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-369bc2e7-3d84-4181-a0db-60f97fcc8317 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:28.283427 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-369bc2e7-3d84-4181-a0db-60f97fcc8317 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:28.284297 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-369bc2e7-3d84-4181-a0db-60f97fcc8317 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:28.288127 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-369bc2e7-3d84-4181-a0db-60f97fcc8317 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:28.288127 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-369bc2e7-3d84-4181-a0db-60f97fcc8317 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:28.293327 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d1210bfd-9dba-460b-b1d6-7fdbe8686b03 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:28.303977 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d1210bfd-9dba-460b-b1d6-7fdbe8686b03 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:28.305519 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d1210bfd-9dba-460b-b1d6-7fdbe8686b03 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:28.315611 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d1210bfd-9dba-460b-b1d6-7fdbe8686b03 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1539 microversion: 2.91 time: 0.167810 Oct 27 03:23:28.315611 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 423/815] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:23:28 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1539 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:23:28.319108 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f8495a19-0ae1-4095-a58a-5cfebce0aa78 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:23:28.322213 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f8495a19-0ae1-4095-a58a-5cfebce0aa78 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] [instance: 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:28.328997 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f8495a19-0ae1-4095-a58a-5cfebce0aa78 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:28.329703 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f8495a19-0ae1-4095-a58a-5cfebce0aa78 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:28.330342 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f8495a19-0ae1-4095-a58a-5cfebce0aa78 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:28.331058 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f8495a19-0ae1-4095-a58a-5cfebce0aa78 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:28.331522 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f8495a19-0ae1-4095-a58a-5cfebce0aa78 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:28.332080 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f8495a19-0ae1-4095-a58a-5cfebce0aa78 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:28.398320 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-369bc2e7-3d84-4181-a0db-60f97fcc8317 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:28.408368 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-369bc2e7-3d84-4181-a0db-60f97fcc8317 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/a52fed88-50f8-4dea-b83d-6878adccb024" status: 200 len: 1263 microversion: 2.1 time: 0.147792 Oct 27 03:23:28.409043 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 393/816] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:28 2022] GET /compute/v2.1/servers/a52fed88-50f8-4dea-b83d-6878adccb024 => generated 1263 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:28.426821 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-36ef3c66-2697-491e-9b00-6b3168b93da4 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:28.427478 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-f8495a19-0ae1-4095-a58a-5cfebce0aa78 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:23:28.427903 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-f8495a19-0ae1-4095-a58a-5cfebce0aa78 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:23:28.428237 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-36ef3c66-2697-491e-9b00-6b3168b93da4 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 87ad30f8-b432-45dc-82ff-aed508afddd7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:28.428369 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-f8495a19-0ae1-4095-a58a-5cfebce0aa78 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:23:28.428776 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-f8495a19-0ae1-4095-a58a-5cfebce0aa78 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:23:28.429189 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-f8495a19-0ae1-4095-a58a-5cfebce0aa78 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:23:28.435501 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-36ef3c66-2697-491e-9b00-6b3168b93da4 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:28.436169 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-36ef3c66-2697-491e-9b00-6b3168b93da4 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:28.437583 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-36ef3c66-2697-491e-9b00-6b3168b93da4 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:28.443459 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-36ef3c66-2697-491e-9b00-6b3168b93da4 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:28.444706 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-36ef3c66-2697-491e-9b00-6b3168b93da4 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:28.449781 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-36ef3c66-2697-491e-9b00-6b3168b93da4 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:28.519363 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-36ef3c66-2697-491e-9b00-6b3168b93da4 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:28.528209 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-36ef3c66-2697-491e-9b00-6b3168b93da4 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:28.529906 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-36ef3c66-2697-491e-9b00-6b3168b93da4 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:28.531161 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-36ef3c66-2697-491e-9b00-6b3168b93da4 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/87ad30f8-b432-45dc-82ff-aed508afddd7" status: 200 len: 1320 microversion: 2.25 time: 0.121116 Oct 27 03:23:28.531731 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 394/817] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:23:28 2022] GET /compute/v2.1/servers/87ad30f8-b432-45dc-82ff-aed508afddd7 => generated 1320 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:23:28.551799 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c86ac9d7-c8c5-4ab7-8045-10994b681cc7 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:28.551799 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c86ac9d7-c8c5-4ab7-8045-10994b681cc7 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: ac5fc2b3-c92e-470a-9bc6-885dce75fb8c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:28.557419 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c86ac9d7-c8c5-4ab7-8045-10994b681cc7 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:28.558149 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c86ac9d7-c8c5-4ab7-8045-10994b681cc7 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:28.558772 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c86ac9d7-c8c5-4ab7-8045-10994b681cc7 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:28.559676 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c86ac9d7-c8c5-4ab7-8045-10994b681cc7 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:28.560142 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c86ac9d7-c8c5-4ab7-8045-10994b681cc7 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:28.560574 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c86ac9d7-c8c5-4ab7-8045-10994b681cc7 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:28.661968 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f8495a19-0ae1-4095-a58a-5cfebce0aa78 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] [instance: 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:28.670491 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f8495a19-0ae1-4095-a58a-5cfebce0aa78 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:28.671706 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f8495a19-0ae1-4095-a58a-5cfebce0aa78 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:28.672440 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f8495a19-0ae1-4095-a58a-5cfebce0aa78 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:28.673434 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f8495a19-0ae1-4095-a58a-5cfebce0aa78 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:28.674203 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f8495a19-0ae1-4095-a58a-5cfebce0aa78 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:28.674856 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f8495a19-0ae1-4095-a58a-5cfebce0aa78 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:28.747636 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f8495a19-0ae1-4095-a58a-5cfebce0aa78 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:28.758427 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f8495a19-0ae1-4095-a58a-5cfebce0aa78 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:28.759905 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f8495a19-0ae1-4095-a58a-5cfebce0aa78 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:28.768879 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f8495a19-0ae1-4095-a58a-5cfebce0aa78 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] 10.222.0.20 "POST /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503/action" status: 202 len: 1494 microversion: 2.75 time: 0.454423 Oct 27 03:23:28.769543 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 424/818] 10.222.0.20 () {62 vars in 1319 bytes} [Thu Oct 27 03:23:28 2022] POST /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503/action => generated 1494 bytes in 456 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 27 03:23:28.793957 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c86ac9d7-c8c5-4ab7-8045-10994b681cc7 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:28.803087 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6176a445-040c-406d-b5ba-e3816f78b4b9 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:28.803378 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c86ac9d7-c8c5-4ab7-8045-10994b681cc7 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/ac5fc2b3-c92e-470a-9bc6-885dce75fb8c" status: 200 len: 1319 microversion: 2.1 time: 0.258308 Oct 27 03:23:28.803713 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6176a445-040c-406d-b5ba-e3816f78b4b9 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] [instance: 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:28.804329 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 395/819] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:28 2022] GET /compute/v2.1/servers/ac5fc2b3-c92e-470a-9bc6-885dce75fb8c => generated 1319 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:28.819729 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6176a445-040c-406d-b5ba-e3816f78b4b9 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:28.820523 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6176a445-040c-406d-b5ba-e3816f78b4b9 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:28.821114 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6176a445-040c-406d-b5ba-e3816f78b4b9 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:28.822012 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6176a445-040c-406d-b5ba-e3816f78b4b9 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:28.822658 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6176a445-040c-406d-b5ba-e3816f78b4b9 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:28.823246 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6176a445-040c-406d-b5ba-e3816f78b4b9 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:28.899322 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-6176a445-040c-406d-b5ba-e3816f78b4b9 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:28.915897 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-6176a445-040c-406d-b5ba-e3816f78b4b9 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:28.917730 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-6176a445-040c-406d-b5ba-e3816f78b4b9 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:28.926317 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6176a445-040c-406d-b5ba-e3816f78b4b9 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] 10.222.0.20 "GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503" status: 200 len: 1446 microversion: 2.75 time: 0.126971 Oct 27 03:23:28.942760 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 425/820] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:23:28 2022] GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503 => generated 1446 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:23:28.963293 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-cbf8d087-1167-4daa-9209-5bb262714174 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:28.964111 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-cbf8d087-1167-4daa-9209-5bb262714174 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: b2ef080f-30ca-4dc5-ba03-9cf1899346a4] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:28.971766 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cbf8d087-1167-4daa-9209-5bb262714174 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:28.972603 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cbf8d087-1167-4daa-9209-5bb262714174 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:28.973476 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cbf8d087-1167-4daa-9209-5bb262714174 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:28.973884 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cbf8d087-1167-4daa-9209-5bb262714174 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:28.974438 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cbf8d087-1167-4daa-9209-5bb262714174 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:28.974934 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cbf8d087-1167-4daa-9209-5bb262714174 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:29.344567 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-98b5ff4c-a764-4df5-8042-e30be3f6d60f tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:29.345889 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-98b5ff4c-a764-4df5-8042-e30be3f6d60f tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:29.359975 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-98b5ff4c-a764-4df5-8042-e30be3f6d60f tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:29.360919 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-98b5ff4c-a764-4df5-8042-e30be3f6d60f tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:29.361586 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-98b5ff4c-a764-4df5-8042-e30be3f6d60f tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:29.362693 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-98b5ff4c-a764-4df5-8042-e30be3f6d60f tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:29.364189 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-98b5ff4c-a764-4df5-8042-e30be3f6d60f tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:29.364887 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-98b5ff4c-a764-4df5-8042-e30be3f6d60f tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:29.389083 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-cbf8d087-1167-4daa-9209-5bb262714174 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:29.404085 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-cbf8d087-1167-4daa-9209-5bb262714174 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4" status: 200 len: 1474 microversion: 2.1 time: 0.444703 Oct 27 03:23:29.406965 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 396/821] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:28 2022] GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4 => generated 1474 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:29.433687 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-94d24517-7d84-4592-a8e8-d8eaef853e92 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:29.435696 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-94d24517-7d84-4592-a8e8-d8eaef853e92 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: a52fed88-50f8-4dea-b83d-6878adccb024] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:29.441929 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-94d24517-7d84-4592-a8e8-d8eaef853e92 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:29.442461 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-94d24517-7d84-4592-a8e8-d8eaef853e92 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:29.442912 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-94d24517-7d84-4592-a8e8-d8eaef853e92 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:29.443699 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-94d24517-7d84-4592-a8e8-d8eaef853e92 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:29.444221 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-94d24517-7d84-4592-a8e8-d8eaef853e92 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:29.444656 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-94d24517-7d84-4592-a8e8-d8eaef853e92 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:29.535230 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-94d24517-7d84-4592-a8e8-d8eaef853e92 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:29.545840 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-94d24517-7d84-4592-a8e8-d8eaef853e92 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/a52fed88-50f8-4dea-b83d-6878adccb024" status: 200 len: 1281 microversion: 2.1 time: 0.115910 Oct 27 03:23:29.546517 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 397/822] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:29 2022] GET /compute/v2.1/servers/a52fed88-50f8-4dea-b83d-6878adccb024 => generated 1281 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:23:29.559914 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-350769d9-4776-447b-af03-0d17a8311159 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:29.563107 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-350769d9-4776-447b-af03-0d17a8311159 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 87ad30f8-b432-45dc-82ff-aed508afddd7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:29.570623 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-350769d9-4776-447b-af03-0d17a8311159 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:29.571446 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-350769d9-4776-447b-af03-0d17a8311159 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:29.572271 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-350769d9-4776-447b-af03-0d17a8311159 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:29.573908 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-350769d9-4776-447b-af03-0d17a8311159 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:29.574989 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-350769d9-4776-447b-af03-0d17a8311159 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:29.575723 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-350769d9-4776-447b-af03-0d17a8311159 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:29.666839 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-98b5ff4c-a764-4df5-8042-e30be3f6d60f tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:29.679878 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-98b5ff4c-a764-4df5-8042-e30be3f6d60f tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:29.682061 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-98b5ff4c-a764-4df5-8042-e30be3f6d60f tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:29.688631 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-98b5ff4c-a764-4df5-8042-e30be3f6d60f tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1539 microversion: 2.91 time: 0.349258 Oct 27 03:23:29.689846 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 426/823] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:23:29 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1539 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:23:29.829690 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-879f2d3d-3abc-49d5-9dff-b2436f73eb7f tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:29.830431 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-879f2d3d-3abc-49d5-9dff-b2436f73eb7f tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: ac5fc2b3-c92e-470a-9bc6-885dce75fb8c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:29.837362 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-879f2d3d-3abc-49d5-9dff-b2436f73eb7f tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:29.837966 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-879f2d3d-3abc-49d5-9dff-b2436f73eb7f tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:29.838505 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-879f2d3d-3abc-49d5-9dff-b2436f73eb7f tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:29.839407 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-879f2d3d-3abc-49d5-9dff-b2436f73eb7f tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:29.840028 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-879f2d3d-3abc-49d5-9dff-b2436f73eb7f tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:29.840617 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-879f2d3d-3abc-49d5-9dff-b2436f73eb7f tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:30.043717 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-879f2d3d-3abc-49d5-9dff-b2436f73eb7f tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:30.055006 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-879f2d3d-3abc-49d5-9dff-b2436f73eb7f tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/ac5fc2b3-c92e-470a-9bc6-885dce75fb8c" status: 200 len: 1469 microversion: 2.1 time: 0.229685 Oct 27 03:23:30.070325 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 427/824] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:29 2022] GET /compute/v2.1/servers/ac5fc2b3-c92e-470a-9bc6-885dce75fb8c => generated 1469 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:23:30.071439 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4ee0030e-444e-4872-a4dc-e2d91f504b09 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:30.075635 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4ee0030e-444e-4872-a4dc-e2d91f504b09 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] [instance: 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:30.080122 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4ee0030e-444e-4872-a4dc-e2d91f504b09 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:30.080234 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4ee0030e-444e-4872-a4dc-e2d91f504b09 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:30.080633 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4ee0030e-444e-4872-a4dc-e2d91f504b09 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:30.082240 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4ee0030e-444e-4872-a4dc-e2d91f504b09 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:30.082723 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4ee0030e-444e-4872-a4dc-e2d91f504b09 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:30.083160 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4ee0030e-444e-4872-a4dc-e2d91f504b09 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:30.096680 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-350769d9-4776-447b-af03-0d17a8311159 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:30.105264 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-350769d9-4776-447b-af03-0d17a8311159 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:30.106770 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-350769d9-4776-447b-af03-0d17a8311159 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:30.108387 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-350769d9-4776-447b-af03-0d17a8311159 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/87ad30f8-b432-45dc-82ff-aed508afddd7" status: 200 len: 1362 microversion: 2.25 time: 0.551869 Oct 27 03:23:30.122859 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 398/825] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:23:29 2022] GET /compute/v2.1/servers/87ad30f8-b432-45dc-82ff-aed508afddd7 => generated 1362 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:23:30.132536 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5ffd7162-1995-471c-bef4-6be1d104e081 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:30.133176 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5ffd7162-1995-471c-bef4-6be1d104e081 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: 6f360a9c-90c7-4efd-90c2-c0d3bd15c154] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:30.139121 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5ffd7162-1995-471c-bef4-6be1d104e081 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:30.139622 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5ffd7162-1995-471c-bef4-6be1d104e081 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:30.140103 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5ffd7162-1995-471c-bef4-6be1d104e081 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:30.140827 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5ffd7162-1995-471c-bef4-6be1d104e081 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:30.141287 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5ffd7162-1995-471c-bef4-6be1d104e081 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:30.141727 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5ffd7162-1995-471c-bef4-6be1d104e081 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:30.162946 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4ee0030e-444e-4872-a4dc-e2d91f504b09 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:30.165267 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:30.172673 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4ee0030e-444e-4872-a4dc-e2d91f504b09 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:30.174561 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4ee0030e-444e-4872-a4dc-e2d91f504b09 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:30.195351 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4ee0030e-444e-4872-a4dc-e2d91f504b09 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] 10.222.0.20 "GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503" status: 200 len: 1446 microversion: 2.75 time: 0.130259 Oct 27 03:23:30.196118 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 428/826] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:23:30 2022] GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503 => generated 1446 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:23:30.329185 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5ffd7162-1995-471c-bef4-6be1d104e081 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:30.340364 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5ffd7162-1995-471c-bef4-6be1d104e081 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/6f360a9c-90c7-4efd-90c2-c0d3bd15c154" status: 200 len: 1469 microversion: 2.1 time: 0.216325 Oct 27 03:23:30.341333 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 399/827] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:30 2022] GET /compute/v2.1/servers/6f360a9c-90c7-4efd-90c2-c0d3bd15c154 => generated 1469 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:30.366330 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4e32024e-4dca-4aee-8e03-5d07fb21971f tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:30.372946 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4e32024e-4dca-4aee-8e03-5d07fb21971f tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:30.379462 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4e32024e-4dca-4aee-8e03-5d07fb21971f tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Searching by: {'reservation_id': 'r-710275jn', 'deleted': False, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2'} {{(pid=121000) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 03:23:30.381227 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4e32024e-4dca-4aee-8e03-5d07fb21971f tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:30.381889 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4e32024e-4dca-4aee-8e03-5d07fb21971f tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:30.382529 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4e32024e-4dca-4aee-8e03-5d07fb21971f tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:30.383547 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4e32024e-4dca-4aee-8e03-5d07fb21971f tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:30.384009 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4e32024e-4dca-4aee-8e03-5d07fb21971f tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:30.384621 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4e32024e-4dca-4aee-8e03-5d07fb21971f tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:30.487929 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.multi_cell_list [None req-4e32024e-4dca-4aee-8e03-5d07fb21971f tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=121000) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 03:23:30.553846 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7c110615-3a38-488e-8168-33d0e594956c tempest-ServicesAdminNegativeV253TestJSON-354335371 tempest-ServicesAdminNegativeV253TestJSON-354335371-project-admin] Action: 'update', calling method: .version_select at 0x7f7ddad85d30>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:23:30.566722 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7c110615-3a38-488e-8168-33d0e594956c tempest-ServicesAdminNegativeV253TestJSON-354335371 tempest-ServicesAdminNegativeV253TestJSON-354335371-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:30.567008 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7c110615-3a38-488e-8168-33d0e594956c tempest-ServicesAdminNegativeV253TestJSON-354335371 tempest-ServicesAdminNegativeV253TestJSON-354335371-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:30.567443 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7c110615-3a38-488e-8168-33d0e594956c tempest-ServicesAdminNegativeV253TestJSON-354335371 tempest-ServicesAdminNegativeV253TestJSON-354335371-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:30.572876 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4e32024e-4dca-4aee-8e03-5d07fb21971f tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:30.576744 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7c110615-3a38-488e-8168-33d0e594956c tempest-ServicesAdminNegativeV253TestJSON-354335371 tempest-ServicesAdminNegativeV253TestJSON-354335371-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:30.577485 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7c110615-3a38-488e-8168-33d0e594956c tempest-ServicesAdminNegativeV253TestJSON-354335371 tempest-ServicesAdminNegativeV253TestJSON-354335371-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:30.578149 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7c110615-3a38-488e-8168-33d0e594956c tempest-ServicesAdminNegativeV253TestJSON-354335371 tempest-ServicesAdminNegativeV253TestJSON-354335371-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:30.581735 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4e32024e-4dca-4aee-8e03-5d07fb21971f tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:30.582331 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4e32024e-4dca-4aee-8e03-5d07fb21971f tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:30.586430 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4e32024e-4dca-4aee-8e03-5d07fb21971f tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:30.588838 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-7c110615-3a38-488e-8168-33d0e594956c tempest-ServicesAdminNegativeV253TestJSON-354335371 tempest-ServicesAdminNegativeV253TestJSON-354335371-project-admin] HTTP exception thrown: Service 19428da7-21d8-4a86-99f9-1e324c0c5f70 could not be found. Oct 27 03:23:30.591480 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7c110615-3a38-488e-8168-33d0e594956c tempest-ServicesAdminNegativeV253TestJSON-354335371 tempest-ServicesAdminNegativeV253TestJSON-354335371-project-admin] Request method failure captured: Oct 27 03:23:30.591480 n-d-862769-1 devstack@n-api.service[121001]: request: PUT /compute/v2.1/os-services/19428da7-21d8-4a86-99f9-1e324c0c5f70 HTTP/1.1 Oct 27 03:23:30.591480 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:23:30.591480 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:23:30.591480 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:23:30.591480 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 56 Oct 27 03:23:30.591480 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:23:30.591480 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:23:30.591480 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:23:30.591480 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:23:30.591480 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfmyChYil58Z_of0aueVU9qFv7j20XbEcbtQOXUtHDikp6THF4XBeqmcYChE1G8PBRDahaeQ2q6OHKzBtymdZv1lvchj6z7S4IcRx7KP9St6O2LD0UWCLbtJJCeiwpZZx-HqrL1-gejoI-sgXXxKE1kdiuAJ0TNv5lIERsbMkfWM3Q0 Oct 27 03:23:30.591480 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:23:30.591480 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:23:30.591480 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:23:30.591480 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:23:30.591480 n-d-862769-1 devstack@n-api.service[121001]: X-Openstack-Nova-Api-Version: 2.53 Oct 27 03:23:30.591480 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:23:30.591480 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:23:30.591480 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: fb961737d27e44cebc80febbcaa0d3f5 Oct 27 03:23:30.591480 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-354335371 Oct 27 03:23:30.591480 n-d-862769-1 devstack@n-api.service[121001]: X-Role: admin,member,reader Oct 27 03:23:30.591480 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: admin,member,reader Oct 27 03:23:30.593880 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fb961737d27e44cebc80febbcaa0d3f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fb961737d27e44cebc80febbcaa0d3f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fb961737d27e44cebc80febbcaa0d3f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fb961737d27e44cebc80febbcaa0d3f5"}]}] Oct 27 03:23:30.593880 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-354335371 Oct 27 03:23:30.593880 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: fb961737d27e44cebc80febbcaa0d3f5 Oct 27 03:23:30.593880 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-354335371 Oct 27 03:23:30.593880 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServicesAdminNegativeV253TestJSON-354335371-project-admin Oct 27 03:23:30.593880 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:23:30.593880 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:23:30.593880 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 2bb66e6a90c84e9dad155d252debf7d6 Oct 27 03:23:30.593880 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-354335371-project-admin Oct 27 03:23:30.593880 n-d-862769-1 devstack@n-api.service[121001]: Oct 27 03:23:30.593880 n-d-862769-1 devstack@n-api.service[121001]: {"status": "disabled", "disabled_reason": "maintenance"} Oct 27 03:23:30.593880 n-d-862769-1 devstack@n-api.service[121001]: method: Oct 27 03:23:30.593880 n-d-862769-1 devstack@n-api.service[121001]: exception: Service 19428da7-21d8-4a86-99f9-1e324c0c5f70 could not be found. Oct 27 03:23:30.594915 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '19428da7-21d8-4a86-99f9-1e324c0c5f70', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Oct 27 03:23:30.594915 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:23:30.594915 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:23:30.594915 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 27 03:23:30.594915 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 27 03:23:30.594915 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 27 03:23:30.594915 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 27 03:23:30.594915 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 27 03:23:30.594915 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:23:30.594915 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:23:30.594915 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:23:30.594915 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:23:30.594915 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 27 03:23:30.594915 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 27 03:23:30.594915 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 27 03:23:30.594915 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 27 03:23:30.594915 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 19428da7-21d8-4a86-99f9-1e324c0c5f70 could not be found. Oct 27 03:23:30.594915 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:23:30.594915 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:23:30.594915 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:23:30.594915 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:23:30.597492 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:23:30.597492 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:23:30.597492 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:23:30.597492 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:23:30.597492 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:23:30.597492 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:23:30.597492 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:23:30.597492 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:23:30.597492 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:23:30.597492 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:23:30.597492 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 27 03:23:30.597492 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:23:30.597492 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 19428da7-21d8-4a86-99f9-1e324c0c5f70 could not be found. Oct 27 03:23:30.597492 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:23:30.597492 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:23:30.597492 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:23:30.597492 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:23:30.597492 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:23:30.597492 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:23:30.597492 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:23:30.601305 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:23:30.601305 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 19428da7-21d8-4a86-99f9-1e324c0c5f70 could not be found. Oct 27 03:23:30.601305 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:23:30.603322 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7c110615-3a38-488e-8168-33d0e594956c tempest-ServicesAdminNegativeV253TestJSON-354335371 tempest-ServicesAdminNegativeV253TestJSON-354335371-project-admin] Returning 404 to user: Service 19428da7-21d8-4a86-99f9-1e324c0c5f70 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:23:30.604665 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7c110615-3a38-488e-8168-33d0e594956c tempest-ServicesAdminNegativeV253TestJSON-354335371 tempest-ServicesAdminNegativeV253TestJSON-354335371-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-services/19428da7-21d8-4a86-99f9-1e324c0c5f70" status: 404 len: 110 microversion: 2.53 time: 0.209545 Oct 27 03:23:30.606479 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 400/828] 10.222.0.20 () {62 vars in 1309 bytes} [Thu Oct 27 03:23:30 2022] PUT /compute/v2.1/os-services/19428da7-21d8-4a86-99f9-1e324c0c5f70 => generated 110 bytes in 212 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 27 03:23:30.615169 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f51a37f3-5404-4a73-b394-4963eb1580c5 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:30.615169 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f51a37f3-5404-4a73-b394-4963eb1580c5 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: b2ef080f-30ca-4dc5-ba03-9cf1899346a4] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:30.620918 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f51a37f3-5404-4a73-b394-4963eb1580c5 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:30.621541 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f51a37f3-5404-4a73-b394-4963eb1580c5 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:30.622151 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f51a37f3-5404-4a73-b394-4963eb1580c5 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:30.622876 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f51a37f3-5404-4a73-b394-4963eb1580c5 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:30.623334 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f51a37f3-5404-4a73-b394-4963eb1580c5 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:30.623812 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f51a37f3-5404-4a73-b394-4963eb1580c5 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:30.896307 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f51a37f3-5404-4a73-b394-4963eb1580c5 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:30.909480 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f51a37f3-5404-4a73-b394-4963eb1580c5 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4" status: 200 len: 1471 microversion: 2.1 time: 0.301889 Oct 27 03:23:30.914713 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 401/829] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:30 2022] GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4 => generated 1471 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:30.941908 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3766ba2e-695e-45fb-8e0a-48b5158031ad tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:30.943739 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3766ba2e-695e-45fb-8e0a-48b5158031ad tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: a52fed88-50f8-4dea-b83d-6878adccb024] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:30.956258 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3766ba2e-695e-45fb-8e0a-48b5158031ad tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:30.957560 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3766ba2e-695e-45fb-8e0a-48b5158031ad tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:30.958562 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3766ba2e-695e-45fb-8e0a-48b5158031ad tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:30.959693 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3766ba2e-695e-45fb-8e0a-48b5158031ad tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:30.961387 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3766ba2e-695e-45fb-8e0a-48b5158031ad tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:30.962417 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3766ba2e-695e-45fb-8e0a-48b5158031ad tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:30.989552 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=100 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:31.064647 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4e32024e-4dca-4aee-8e03-5d07fb21971f tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/detail?reservation_id=r-710275jn" status: 200 len: 2931 microversion: 2.1 time: 0.703263 Oct 27 03:23:31.075700 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 429/830] 10.222.0.20 () {58 vars in 1197 bytes} [Thu Oct 27 03:23:30 2022] GET /compute/v2.1/servers/detail?reservation_id=r-710275jn => generated 2931 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:31.075700 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4145f66f-bb2c-4680-96d5-ed5835546b5d tempest-ServicesAdminNegativeV253TestJSON-354335371 tempest-ServicesAdminNegativeV253TestJSON-354335371-project-admin] Action: 'update', calling method: .version_select at 0x7f7ddab9a5e0>, body: {"status": "disabled"} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:23:31.077086 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4145f66f-bb2c-4680-96d5-ed5835546b5d tempest-ServicesAdminNegativeV253TestJSON-354335371 tempest-ServicesAdminNegativeV253TestJSON-354335371-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:31.078441 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4145f66f-bb2c-4680-96d5-ed5835546b5d tempest-ServicesAdminNegativeV253TestJSON-354335371 tempest-ServicesAdminNegativeV253TestJSON-354335371-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:31.079515 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4145f66f-bb2c-4680-96d5-ed5835546b5d tempest-ServicesAdminNegativeV253TestJSON-354335371 tempest-ServicesAdminNegativeV253TestJSON-354335371-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:31.097318 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4145f66f-bb2c-4680-96d5-ed5835546b5d tempest-ServicesAdminNegativeV253TestJSON-354335371 tempest-ServicesAdminNegativeV253TestJSON-354335371-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:31.098190 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4145f66f-bb2c-4680-96d5-ed5835546b5d tempest-ServicesAdminNegativeV253TestJSON-354335371 tempest-ServicesAdminNegativeV253TestJSON-354335371-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:31.099455 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4145f66f-bb2c-4680-96d5-ed5835546b5d tempest-ServicesAdminNegativeV253TestJSON-354335371 tempest-ServicesAdminNegativeV253TestJSON-354335371-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:31.111929 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-4145f66f-bb2c-4680-96d5-ed5835546b5d tempest-ServicesAdminNegativeV253TestJSON-354335371 tempest-ServicesAdminNegativeV253TestJSON-354335371-project-admin] HTTP exception thrown: Service 19428da7-21d8-4a86-99f9-1e324c0c5f70 could not be found. Oct 27 03:23:31.114786 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4145f66f-bb2c-4680-96d5-ed5835546b5d tempest-ServicesAdminNegativeV253TestJSON-354335371 tempest-ServicesAdminNegativeV253TestJSON-354335371-project-admin] Request method failure captured: Oct 27 03:23:31.114786 n-d-862769-1 devstack@n-api.service[121000]: request: PUT /compute/v2.1/os-services/19428da7-21d8-4a86-99f9-1e324c0c5f70 HTTP/1.1 Oct 27 03:23:31.114786 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:23:31.114786 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:23:31.114786 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:23:31.114786 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 22 Oct 27 03:23:31.114786 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:23:31.114786 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:23:31.114786 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:23:31.114786 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:23:31.114786 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfmyChYil58Z_of0aueVU9qFv7j20XbEcbtQOXUtHDikp6THF4XBeqmcYChE1G8PBRDahaeQ2q6OHKzBtymdZv1lvchj6z7S4IcRx7KP9St6O2LD0UWCLbtJJCeiwpZZx-HqrL1-gejoI-sgXXxKE1kdiuAJ0TNv5lIERsbMkfWM3Q0 Oct 27 03:23:31.114786 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:23:31.114786 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:23:31.114786 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:23:31.114786 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:23:31.114786 n-d-862769-1 devstack@n-api.service[121000]: X-Openstack-Nova-Api-Version: 2.53 Oct 27 03:23:31.114786 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:23:31.114786 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:23:31.114786 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: fb961737d27e44cebc80febbcaa0d3f5 Oct 27 03:23:31.114786 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-354335371 Oct 27 03:23:31.114786 n-d-862769-1 devstack@n-api.service[121000]: X-Role: admin,member,reader Oct 27 03:23:31.114786 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: admin,member,reader Oct 27 03:23:31.116145 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fb961737d27e44cebc80febbcaa0d3f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fb961737d27e44cebc80febbcaa0d3f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fb961737d27e44cebc80febbcaa0d3f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fb961737d27e44cebc80febbcaa0d3f5"}]}] Oct 27 03:23:31.116145 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-354335371 Oct 27 03:23:31.116145 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: fb961737d27e44cebc80febbcaa0d3f5 Oct 27 03:23:31.116145 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-354335371 Oct 27 03:23:31.116145 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ServicesAdminNegativeV253TestJSON-354335371-project-admin Oct 27 03:23:31.116145 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:23:31.116145 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:23:31.116145 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 2bb66e6a90c84e9dad155d252debf7d6 Oct 27 03:23:31.116145 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-354335371-project-admin Oct 27 03:23:31.116145 n-d-862769-1 devstack@n-api.service[121000]: Oct 27 03:23:31.116145 n-d-862769-1 devstack@n-api.service[121000]: {"status": "disabled"} Oct 27 03:23:31.116145 n-d-862769-1 devstack@n-api.service[121000]: method: Oct 27 03:23:31.116145 n-d-862769-1 devstack@n-api.service[121000]: exception: Service 19428da7-21d8-4a86-99f9-1e324c0c5f70 could not be found. Oct 27 03:23:31.116145 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '19428da7-21d8-4a86-99f9-1e324c0c5f70', 'body': {'status': 'disabled'}} Oct 27 03:23:31.116984 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:23:31.116984 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:23:31.116984 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 27 03:23:31.116984 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 27 03:23:31.116984 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 27 03:23:31.116984 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 27 03:23:31.116984 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 27 03:23:31.116984 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:23:31.116984 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:23:31.116984 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:23:31.116984 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:23:31.116984 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 27 03:23:31.116984 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 27 03:23:31.116984 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 27 03:23:31.116984 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 27 03:23:31.116984 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 19428da7-21d8-4a86-99f9-1e324c0c5f70 could not be found. Oct 27 03:23:31.116984 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:23:31.116984 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:23:31.116984 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:23:31.116984 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:23:31.116984 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:23:31.118195 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:23:31.118195 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:23:31.118195 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:23:31.118195 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:23:31.118195 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:23:31.118195 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:23:31.118195 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:23:31.118195 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:23:31.118195 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:23:31.118195 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 27 03:23:31.118195 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:23:31.118195 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 19428da7-21d8-4a86-99f9-1e324c0c5f70 could not be found. Oct 27 03:23:31.118195 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:23:31.118195 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:23:31.118195 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:23:31.118195 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:23:31.118195 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:23:31.118195 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:23:31.118195 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:23:31.118195 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:23:31.119326 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 19428da7-21d8-4a86-99f9-1e324c0c5f70 could not be found. Oct 27 03:23:31.119326 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:23:31.121078 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4145f66f-bb2c-4680-96d5-ed5835546b5d tempest-ServicesAdminNegativeV253TestJSON-354335371 tempest-ServicesAdminNegativeV253TestJSON-354335371-project-admin] Returning 404 to user: Service 19428da7-21d8-4a86-99f9-1e324c0c5f70 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:23:31.122493 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4145f66f-bb2c-4680-96d5-ed5835546b5d tempest-ServicesAdminNegativeV253TestJSON-354335371 tempest-ServicesAdminNegativeV253TestJSON-354335371-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-services/19428da7-21d8-4a86-99f9-1e324c0c5f70" status: 404 len: 110 microversion: 2.53 time: 0.055838 Oct 27 03:23:31.123620 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 430/831] 10.222.0.20 () {62 vars in 1309 bytes} [Thu Oct 27 03:23:31 2022] PUT /compute/v2.1/os-services/19428da7-21d8-4a86-99f9-1e324c0c5f70 => generated 110 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 03:23:31.129118 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0cf58142-693a-47c1-82c8-b855bf035aaa tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:31.130096 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0cf58142-693a-47c1-82c8-b855bf035aaa tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:31.136374 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0cf58142-693a-47c1-82c8-b855bf035aaa tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:31.137391 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0cf58142-693a-47c1-82c8-b855bf035aaa tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:31.137912 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0cf58142-693a-47c1-82c8-b855bf035aaa tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:31.138732 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0cf58142-693a-47c1-82c8-b855bf035aaa tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:31.139302 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0cf58142-693a-47c1-82c8-b855bf035aaa tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:31.139796 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0cf58142-693a-47c1-82c8-b855bf035aaa tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:31.253225 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0cf58142-693a-47c1-82c8-b855bf035aaa tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:31.262265 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3766ba2e-695e-45fb-8e0a-48b5158031ad tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:31.266678 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0cf58142-693a-47c1-82c8-b855bf035aaa tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:31.276602 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0cf58142-693a-47c1-82c8-b855bf035aaa tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:31.284459 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0cf58142-693a-47c1-82c8-b855bf035aaa tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1539 microversion: 2.91 time: 0.159008 Oct 27 03:23:31.285304 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 431/832] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:23:31 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1539 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:23:31.290943 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b47633a0-c804-48d9-8ba8-46ed6d422c39 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:23:31.291484 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b47633a0-c804-48d9-8ba8-46ed6d422c39 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: b2ef080f-30ca-4dc5-ba03-9cf1899346a4] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:31.297589 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b47633a0-c804-48d9-8ba8-46ed6d422c39 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:31.298114 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b47633a0-c804-48d9-8ba8-46ed6d422c39 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:31.298553 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b47633a0-c804-48d9-8ba8-46ed6d422c39 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:31.299432 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b47633a0-c804-48d9-8ba8-46ed6d422c39 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:31.300050 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b47633a0-c804-48d9-8ba8-46ed6d422c39 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:31.300482 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b47633a0-c804-48d9-8ba8-46ed6d422c39 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:31.305688 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3766ba2e-695e-45fb-8e0a-48b5158031ad tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/a52fed88-50f8-4dea-b83d-6878adccb024" status: 200 len: 1311 microversion: 2.1 time: 0.369144 Oct 27 03:23:31.310232 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 402/833] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:30 2022] GET /compute/v2.1/servers/a52fed88-50f8-4dea-b83d-6878adccb024 => generated 1311 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:31.317465 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-a1516466-5fd7-4e5d-bd28-146db68b01d5 req-f6880c85-ef2f-4460-8c43-14b253da7f94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87ad30f8-b432-45dc-82ff-aed508afddd7", "tag": "e564d375-d22d-4aff-a377-d7085a068b58"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:23:31.326591 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-a1516466-5fd7-4e5d-bd28-146db68b01d5 req-f6880c85-ef2f-4460-8c43-14b253da7f94 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:31.327139 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-a1516466-5fd7-4e5d-bd28-146db68b01d5 req-f6880c85-ef2f-4460-8c43-14b253da7f94 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:31.328668 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-a1516466-5fd7-4e5d-bd28-146db68b01d5 req-f6880c85-ef2f-4460-8c43-14b253da7f94 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:31.343291 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-a1516466-5fd7-4e5d-bd28-146db68b01d5 req-f6880c85-ef2f-4460-8c43-14b253da7f94 service nova] Creating event network-changed:e564d375-d22d-4aff-a377-d7085a068b58 for instance 87ad30f8-b432-45dc-82ff-aed508afddd7 on n-h2-862769-1 Oct 27 03:23:31.348588 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-a1516466-5fd7-4e5d-bd28-146db68b01d5 req-f6880c85-ef2f-4460-8c43-14b253da7f94 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041066 Oct 27 03:23:31.349696 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 403/834] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:23:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:23:31.357234 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-792f86ce-a570-4a8b-ae1a-456be05f9323 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:31.370556 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.compute.server_groups [None req-792f86ce-a570-4a8b-ae1a-456be05f9323 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Querying cell d4405804-b3fd-4c57-a074-5c4e2aef7c93(cell1) for 2 instances {{(pid=121001) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 27 03:23:31.371260 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-792f86ce-a570-4a8b-ae1a-456be05f9323 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:31.371747 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-792f86ce-a570-4a8b-ae1a-456be05f9323 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:31.372189 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-792f86ce-a570-4a8b-ae1a-456be05f9323 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:31.406136 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-792f86ce-a570-4a8b-ae1a-456be05f9323 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups/4835bc27-4897-4969-a9df-56f3801b9332" status: 200 len: 269 microversion: 2.1 time: 0.055003 Oct 27 03:23:31.406741 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 404/835] 10.222.0.20 () {58 vars in 1263 bytes} [Thu Oct 27 03:23:31 2022] GET /compute/v2.1/os-server-groups/4835bc27-4897-4969-a9df-56f3801b9332 => generated 269 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:23:31.411713 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-035005a7-8756-4d61-bce4-fe7e9740f186 tempest-ServicesAdminNegativeV253TestJSON-354335371 tempest-ServicesAdminNegativeV253TestJSON-354335371-project-admin] Action: 'update', calling method: .version_select at 0x7f7ddb131550>, body: {"status": "enabled"} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:23:31.415411 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-035005a7-8756-4d61-bce4-fe7e9740f186 tempest-ServicesAdminNegativeV253TestJSON-354335371 tempest-ServicesAdminNegativeV253TestJSON-354335371-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:31.416246 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-035005a7-8756-4d61-bce4-fe7e9740f186 tempest-ServicesAdminNegativeV253TestJSON-354335371 tempest-ServicesAdminNegativeV253TestJSON-354335371-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:31.416857 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-035005a7-8756-4d61-bce4-fe7e9740f186 tempest-ServicesAdminNegativeV253TestJSON-354335371 tempest-ServicesAdminNegativeV253TestJSON-354335371-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:31.423151 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-035005a7-8756-4d61-bce4-fe7e9740f186 tempest-ServicesAdminNegativeV253TestJSON-354335371 tempest-ServicesAdminNegativeV253TestJSON-354335371-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:31.423849 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-035005a7-8756-4d61-bce4-fe7e9740f186 tempest-ServicesAdminNegativeV253TestJSON-354335371 tempest-ServicesAdminNegativeV253TestJSON-354335371-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:31.424518 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-035005a7-8756-4d61-bce4-fe7e9740f186 tempest-ServicesAdminNegativeV253TestJSON-354335371 tempest-ServicesAdminNegativeV253TestJSON-354335371-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:31.431525 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-035005a7-8756-4d61-bce4-fe7e9740f186 tempest-ServicesAdminNegativeV253TestJSON-354335371 tempest-ServicesAdminNegativeV253TestJSON-354335371-project-admin] HTTP exception thrown: Service 19428da7-21d8-4a86-99f9-1e324c0c5f70 could not be found. Oct 27 03:23:31.431525 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-035005a7-8756-4d61-bce4-fe7e9740f186 tempest-ServicesAdminNegativeV253TestJSON-354335371 tempest-ServicesAdminNegativeV253TestJSON-354335371-project-admin] Request method failure captured: Oct 27 03:23:31.431525 n-d-862769-1 devstack@n-api.service[121001]: request: PUT /compute/v2.1/os-services/19428da7-21d8-4a86-99f9-1e324c0c5f70 HTTP/1.1 Oct 27 03:23:31.431525 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:23:31.431525 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:23:31.431525 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:23:31.431525 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 21 Oct 27 03:23:31.431525 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:23:31.431525 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:23:31.431525 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:23:31.431525 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:23:31.431525 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfmyChYil58Z_of0aueVU9qFv7j20XbEcbtQOXUtHDikp6THF4XBeqmcYChE1G8PBRDahaeQ2q6OHKzBtymdZv1lvchj6z7S4IcRx7KP9St6O2LD0UWCLbtJJCeiwpZZx-HqrL1-gejoI-sgXXxKE1kdiuAJ0TNv5lIERsbMkfWM3Q0 Oct 27 03:23:31.431525 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:23:31.431525 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:23:31.431525 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:23:31.431525 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:23:31.431525 n-d-862769-1 devstack@n-api.service[121001]: X-Openstack-Nova-Api-Version: 2.53 Oct 27 03:23:31.431525 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:23:31.431525 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:23:31.431525 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: fb961737d27e44cebc80febbcaa0d3f5 Oct 27 03:23:31.431525 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-354335371 Oct 27 03:23:31.431525 n-d-862769-1 devstack@n-api.service[121001]: X-Role: admin,member,reader Oct 27 03:23:31.431525 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: admin,member,reader Oct 27 03:23:31.432987 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fb961737d27e44cebc80febbcaa0d3f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fb961737d27e44cebc80febbcaa0d3f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fb961737d27e44cebc80febbcaa0d3f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fb961737d27e44cebc80febbcaa0d3f5"}]}] Oct 27 03:23:31.432987 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-354335371 Oct 27 03:23:31.432987 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: fb961737d27e44cebc80febbcaa0d3f5 Oct 27 03:23:31.432987 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-354335371 Oct 27 03:23:31.432987 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServicesAdminNegativeV253TestJSON-354335371-project-admin Oct 27 03:23:31.432987 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:23:31.432987 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:23:31.432987 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 2bb66e6a90c84e9dad155d252debf7d6 Oct 27 03:23:31.432987 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-354335371-project-admin Oct 27 03:23:31.432987 n-d-862769-1 devstack@n-api.service[121001]: Oct 27 03:23:31.432987 n-d-862769-1 devstack@n-api.service[121001]: {"status": "enabled"} Oct 27 03:23:31.432987 n-d-862769-1 devstack@n-api.service[121001]: method: Oct 27 03:23:31.432987 n-d-862769-1 devstack@n-api.service[121001]: exception: Service 19428da7-21d8-4a86-99f9-1e324c0c5f70 could not be found. Oct 27 03:23:31.432987 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '19428da7-21d8-4a86-99f9-1e324c0c5f70', 'body': {'status': 'enabled'}} Oct 27 03:23:31.433804 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:23:31.433804 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:23:31.433804 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 27 03:23:31.433804 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 27 03:23:31.433804 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 27 03:23:31.433804 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 27 03:23:31.433804 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 27 03:23:31.433804 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:23:31.433804 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:23:31.433804 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:23:31.433804 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:23:31.433804 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 27 03:23:31.433804 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 27 03:23:31.433804 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 27 03:23:31.433804 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 27 03:23:31.433804 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 19428da7-21d8-4a86-99f9-1e324c0c5f70 could not be found. Oct 27 03:23:31.433804 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:23:31.433804 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:23:31.433804 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:23:31.433804 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:23:31.433804 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:23:31.435411 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:23:31.435411 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:23:31.435411 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:23:31.435411 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:23:31.435411 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:23:31.435411 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:23:31.435411 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:23:31.435411 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:23:31.435411 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:23:31.435411 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 27 03:23:31.435411 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:23:31.435411 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 19428da7-21d8-4a86-99f9-1e324c0c5f70 could not be found. Oct 27 03:23:31.435411 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:23:31.435411 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:23:31.435411 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:23:31.435411 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:23:31.435411 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:23:31.435411 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:23:31.435411 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:23:31.435411 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:23:31.439380 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 19428da7-21d8-4a86-99f9-1e324c0c5f70 could not be found. Oct 27 03:23:31.439380 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:23:31.439380 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-035005a7-8756-4d61-bce4-fe7e9740f186 tempest-ServicesAdminNegativeV253TestJSON-354335371 tempest-ServicesAdminNegativeV253TestJSON-354335371-project-admin] Returning 404 to user: Service 19428da7-21d8-4a86-99f9-1e324c0c5f70 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:23:31.439380 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-035005a7-8756-4d61-bce4-fe7e9740f186 tempest-ServicesAdminNegativeV253TestJSON-354335371 tempest-ServicesAdminNegativeV253TestJSON-354335371-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-services/19428da7-21d8-4a86-99f9-1e324c0c5f70" status: 404 len: 110 microversion: 2.53 time: 0.025158 Oct 27 03:23:31.439380 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 405/836] 10.222.0.20 () {62 vars in 1309 bytes} [Thu Oct 27 03:23:31 2022] PUT /compute/v2.1/os-services/19428da7-21d8-4a86-99f9-1e324c0c5f70 => generated 110 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 03:23:31.444622 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-78ac492b-ad1e-4cc1-a483-453871e88b7f tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:31.445141 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-78ac492b-ad1e-4cc1-a483-453871e88b7f tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 87ad30f8-b432-45dc-82ff-aed508afddd7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:31.453983 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-78ac492b-ad1e-4cc1-a483-453871e88b7f tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:31.454680 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-78ac492b-ad1e-4cc1-a483-453871e88b7f tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:31.455513 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-78ac492b-ad1e-4cc1-a483-453871e88b7f tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:31.456794 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-78ac492b-ad1e-4cc1-a483-453871e88b7f tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:31.457642 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-78ac492b-ad1e-4cc1-a483-453871e88b7f tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:31.458196 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-78ac492b-ad1e-4cc1-a483-453871e88b7f tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:31.542230 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b47633a0-c804-48d9-8ba8-46ed6d422c39 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "POST /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4/action" status: 204 len: 0 microversion: 2.1 time: 0.254973 Oct 27 03:23:31.543633 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 432/837] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:23:31 2022] POST /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4/action => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:23:31.550542 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9fee2c99-dc79-4936-b9a3-90001a70f2e6 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:31.551480 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9fee2c99-dc79-4936-b9a3-90001a70f2e6 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] [instance: 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:31.560168 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9fee2c99-dc79-4936-b9a3-90001a70f2e6 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:31.560995 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9fee2c99-dc79-4936-b9a3-90001a70f2e6 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:31.561589 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9fee2c99-dc79-4936-b9a3-90001a70f2e6 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:31.563102 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9fee2c99-dc79-4936-b9a3-90001a70f2e6 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:31.563788 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9fee2c99-dc79-4936-b9a3-90001a70f2e6 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:31.564411 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9fee2c99-dc79-4936-b9a3-90001a70f2e6 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:31.676062 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9fee2c99-dc79-4936-b9a3-90001a70f2e6 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:31.688300 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9fee2c99-dc79-4936-b9a3-90001a70f2e6 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:31.690088 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9fee2c99-dc79-4936-b9a3-90001a70f2e6 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:31.696663 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9fee2c99-dc79-4936-b9a3-90001a70f2e6 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] 10.222.0.20 "GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503" status: 200 len: 1446 microversion: 2.75 time: 0.151495 Oct 27 03:23:31.697636 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 433/838] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:23:31 2022] GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503 => generated 1446 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:23:31.702386 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-403704c2-9580-43a7-88fb-e1c820687ef3 tempest-ServersOnMultiNodesTest-1789564933 tempest-ServersOnMultiNodesTest-1789564933-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:31.703177 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-403704c2-9580-43a7-88fb-e1c820687ef3 tempest-ServersOnMultiNodesTest-1789564933 tempest-ServersOnMultiNodesTest-1789564933-project-admin] [instance: 6f360a9c-90c7-4efd-90c2-c0d3bd15c154] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:31.710370 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-403704c2-9580-43a7-88fb-e1c820687ef3 tempest-ServersOnMultiNodesTest-1789564933 tempest-ServersOnMultiNodesTest-1789564933-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:31.711093 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-403704c2-9580-43a7-88fb-e1c820687ef3 tempest-ServersOnMultiNodesTest-1789564933 tempest-ServersOnMultiNodesTest-1789564933-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:31.711727 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-403704c2-9580-43a7-88fb-e1c820687ef3 tempest-ServersOnMultiNodesTest-1789564933 tempest-ServersOnMultiNodesTest-1789564933-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:31.712605 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-403704c2-9580-43a7-88fb-e1c820687ef3 tempest-ServersOnMultiNodesTest-1789564933 tempest-ServersOnMultiNodesTest-1789564933-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:31.713934 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-403704c2-9580-43a7-88fb-e1c820687ef3 tempest-ServersOnMultiNodesTest-1789564933 tempest-ServersOnMultiNodesTest-1789564933-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:31.714561 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-403704c2-9580-43a7-88fb-e1c820687ef3 tempest-ServersOnMultiNodesTest-1789564933 tempest-ServersOnMultiNodesTest-1789564933-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:31.719901 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-78ac492b-ad1e-4cc1-a483-453871e88b7f tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:31.739210 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-78ac492b-ad1e-4cc1-a483-453871e88b7f tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:31.740876 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-78ac492b-ad1e-4cc1-a483-453871e88b7f tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:31.742302 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-78ac492b-ad1e-4cc1-a483-453871e88b7f tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/87ad30f8-b432-45dc-82ff-aed508afddd7" status: 200 len: 1362 microversion: 2.25 time: 0.307904 Oct 27 03:23:31.743047 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 406/839] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:23:31 2022] GET /compute/v2.1/servers/87ad30f8-b432-45dc-82ff-aed508afddd7 => generated 1362 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:23:31.749218 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-154494b4-d7a4-4060-bc07-7ad34d129496 tempest-ServicesAdminNegativeV253TestJSON-354335371 tempest-ServicesAdminNegativeV253TestJSON-354335371-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:31.755288 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-154494b4-d7a4-4060-bc07-7ad34d129496 tempest-ServicesAdminNegativeV253TestJSON-354335371 tempest-ServicesAdminNegativeV253TestJSON-354335371-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:31.756412 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-154494b4-d7a4-4060-bc07-7ad34d129496 tempest-ServicesAdminNegativeV253TestJSON-354335371 tempest-ServicesAdminNegativeV253TestJSON-354335371-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:31.757560 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-154494b4-d7a4-4060-bc07-7ad34d129496 tempest-ServicesAdminNegativeV253TestJSON-354335371 tempest-ServicesAdminNegativeV253TestJSON-354335371-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:31.758549 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-154494b4-d7a4-4060-bc07-7ad34d129496 tempest-ServicesAdminNegativeV253TestJSON-354335371 tempest-ServicesAdminNegativeV253TestJSON-354335371-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:31.759689 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-154494b4-d7a4-4060-bc07-7ad34d129496 tempest-ServicesAdminNegativeV253TestJSON-354335371 tempest-ServicesAdminNegativeV253TestJSON-354335371-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:31.760628 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-154494b4-d7a4-4060-bc07-7ad34d129496 tempest-ServicesAdminNegativeV253TestJSON-354335371 tempest-ServicesAdminNegativeV253TestJSON-354335371-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:31.795367 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-154494b4-d7a4-4060-bc07-7ad34d129496 tempest-ServicesAdminNegativeV253TestJSON-354335371 tempest-ServicesAdminNegativeV253TestJSON-354335371-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.051128 Oct 27 03:23:31.795988 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 407/840] 10.222.0.20 () {60 vars in 1178 bytes} [Thu Oct 27 03:23:31 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:23:31.801261 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-19cd1467-0fb7-4525-bc4d-2931cac7b865 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:31.802231 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-19cd1467-0fb7-4525-bc4d-2931cac7b865 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: b2ef080f-30ca-4dc5-ba03-9cf1899346a4] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:31.808736 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-19cd1467-0fb7-4525-bc4d-2931cac7b865 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:31.809306 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-19cd1467-0fb7-4525-bc4d-2931cac7b865 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:31.809849 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-19cd1467-0fb7-4525-bc4d-2931cac7b865 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:31.810660 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-19cd1467-0fb7-4525-bc4d-2931cac7b865 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:31.811208 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-19cd1467-0fb7-4525-bc4d-2931cac7b865 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:31.811757 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-19cd1467-0fb7-4525-bc4d-2931cac7b865 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:31.953340 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-19cd1467-0fb7-4525-bc4d-2931cac7b865 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:31.959611 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-403704c2-9580-43a7-88fb-e1c820687ef3 tempest-ServersOnMultiNodesTest-1789564933 tempest-ServersOnMultiNodesTest-1789564933-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/6f360a9c-90c7-4efd-90c2-c0d3bd15c154" status: 200 len: 1620 microversion: 2.1 time: 0.260513 Oct 27 03:23:31.960449 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 434/841] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:31 2022] GET /compute/v2.1/servers/6f360a9c-90c7-4efd-90c2-c0d3bd15c154 => generated 1620 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:31.972107 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-19cd1467-0fb7-4525-bc4d-2931cac7b865 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4" status: 200 len: 1471 microversion: 2.1 time: 0.163742 Oct 27 03:23:31.972107 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 408/842] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:31 2022] GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4 => generated 1471 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:31.972107 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-01438d02-f6bd-4bec-a6d9-6e2c5a0fa26a tempest-ServicesAdminNegativeV253TestJSON-354335371 tempest-ServicesAdminNegativeV253TestJSON-354335371-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:31.972107 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-01438d02-f6bd-4bec-a6d9-6e2c5a0fa26a tempest-ServicesAdminNegativeV253TestJSON-354335371 tempest-ServicesAdminNegativeV253TestJSON-354335371-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:31.972567 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-01438d02-f6bd-4bec-a6d9-6e2c5a0fa26a tempest-ServicesAdminNegativeV253TestJSON-354335371 tempest-ServicesAdminNegativeV253TestJSON-354335371-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:31.972567 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-01438d02-f6bd-4bec-a6d9-6e2c5a0fa26a tempest-ServicesAdminNegativeV253TestJSON-354335371 tempest-ServicesAdminNegativeV253TestJSON-354335371-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:31.972567 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-01438d02-f6bd-4bec-a6d9-6e2c5a0fa26a tempest-ServicesAdminNegativeV253TestJSON-354335371 tempest-ServicesAdminNegativeV253TestJSON-354335371-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:31.972793 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-01438d02-f6bd-4bec-a6d9-6e2c5a0fa26a tempest-ServicesAdminNegativeV253TestJSON-354335371 tempest-ServicesAdminNegativeV253TestJSON-354335371-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:31.972793 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-01438d02-f6bd-4bec-a6d9-6e2c5a0fa26a tempest-ServicesAdminNegativeV253TestJSON-354335371 tempest-ServicesAdminNegativeV253TestJSON-354335371-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:31.979335 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-b9e630f7-95ff-4314-ab4b-84bed7e39e79 req-1a849edc-b29a-4962-94b8-ffefe6b7e1f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a52fed88-50f8-4dea-b83d-6878adccb024", "tag": "7caf6b22-42ec-4a60-b619-9a8f7eecc633"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:23:31.989516 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-b9e630f7-95ff-4314-ab4b-84bed7e39e79 req-1a849edc-b29a-4962-94b8-ffefe6b7e1f0 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:31.989994 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-b9e630f7-95ff-4314-ab4b-84bed7e39e79 req-1a849edc-b29a-4962-94b8-ffefe6b7e1f0 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:31.990464 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-b9e630f7-95ff-4314-ab4b-84bed7e39e79 req-1a849edc-b29a-4962-94b8-ffefe6b7e1f0 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:31.997175 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-01438d02-f6bd-4bec-a6d9-6e2c5a0fa26a tempest-ServicesAdminNegativeV253TestJSON-354335371 tempest-ServicesAdminNegativeV253TestJSON-354335371-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.034363 Oct 27 03:23:32.003955 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 409/843] 10.222.0.20 () {60 vars in 1211 bytes} [Thu Oct 27 03:23:31 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:23:32.004122 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-b9e630f7-95ff-4314-ab4b-84bed7e39e79 req-1a849edc-b29a-4962-94b8-ffefe6b7e1f0 service nova] Creating event network-changed:7caf6b22-42ec-4a60-b619-9a8f7eecc633 for instance a52fed88-50f8-4dea-b83d-6878adccb024 on n-h2-862769-1 Oct 27 03:23:32.004210 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-58502770-23ed-43e9-a268-187e2408de40 tempest-ServersOnMultiNodesTest-1789564933 tempest-ServersOnMultiNodesTest-1789564933-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:32.004210 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-58502770-23ed-43e9-a268-187e2408de40 tempest-ServersOnMultiNodesTest-1789564933 tempest-ServersOnMultiNodesTest-1789564933-project-admin] [instance: ac5fc2b3-c92e-470a-9bc6-885dce75fb8c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:32.008266 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-b9e630f7-95ff-4314-ab4b-84bed7e39e79 req-1a849edc-b29a-4962-94b8-ffefe6b7e1f0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033282 Oct 27 03:23:32.008873 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 435/844] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:23:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:23:32.010178 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-58502770-23ed-43e9-a268-187e2408de40 tempest-ServersOnMultiNodesTest-1789564933 tempest-ServersOnMultiNodesTest-1789564933-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:32.014375 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-58502770-23ed-43e9-a268-187e2408de40 tempest-ServersOnMultiNodesTest-1789564933 tempest-ServersOnMultiNodesTest-1789564933-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:32.014375 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-58502770-23ed-43e9-a268-187e2408de40 tempest-ServersOnMultiNodesTest-1789564933 tempest-ServersOnMultiNodesTest-1789564933-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:32.014375 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-58502770-23ed-43e9-a268-187e2408de40 tempest-ServersOnMultiNodesTest-1789564933 tempest-ServersOnMultiNodesTest-1789564933-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:32.014375 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-58502770-23ed-43e9-a268-187e2408de40 tempest-ServersOnMultiNodesTest-1789564933 tempest-ServersOnMultiNodesTest-1789564933-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:32.015434 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-58502770-23ed-43e9-a268-187e2408de40 tempest-ServersOnMultiNodesTest-1789564933 tempest-ServersOnMultiNodesTest-1789564933-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:32.015514 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2d478caf-9a56-43a1-addf-6507e3e13b6f tempest-ServicesAdminNegativeV253TestJSON-354335371 tempest-ServicesAdminNegativeV253TestJSON-354335371-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:32.017561 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2d478caf-9a56-43a1-addf-6507e3e13b6f tempest-ServicesAdminNegativeV253TestJSON-354335371 tempest-ServicesAdminNegativeV253TestJSON-354335371-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:32.018066 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2d478caf-9a56-43a1-addf-6507e3e13b6f tempest-ServicesAdminNegativeV253TestJSON-354335371 tempest-ServicesAdminNegativeV253TestJSON-354335371-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:32.018514 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2d478caf-9a56-43a1-addf-6507e3e13b6f tempest-ServicesAdminNegativeV253TestJSON-354335371 tempest-ServicesAdminNegativeV253TestJSON-354335371-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:32.019255 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2d478caf-9a56-43a1-addf-6507e3e13b6f tempest-ServicesAdminNegativeV253TestJSON-354335371 tempest-ServicesAdminNegativeV253TestJSON-354335371-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:32.019722 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2d478caf-9a56-43a1-addf-6507e3e13b6f tempest-ServicesAdminNegativeV253TestJSON-354335371 tempest-ServicesAdminNegativeV253TestJSON-354335371-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:32.020136 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2d478caf-9a56-43a1-addf-6507e3e13b6f tempest-ServicesAdminNegativeV253TestJSON-354335371 tempest-ServicesAdminNegativeV253TestJSON-354335371-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:32.045257 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2d478caf-9a56-43a1-addf-6507e3e13b6f tempest-ServicesAdminNegativeV253TestJSON-354335371 tempest-ServicesAdminNegativeV253TestJSON-354335371-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.035123 Oct 27 03:23:32.047040 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 436/845] 10.222.0.20 () {60 vars in 1178 bytes} [Thu Oct 27 03:23:32 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:23:32.058562 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-60eade50-1d93-42a9-8857-da4a2fe66d0a tempest-ServicesAdminNegativeV253TestJSON-354335371 tempest-ServicesAdminNegativeV253TestJSON-354335371-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:32.062371 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-60eade50-1d93-42a9-8857-da4a2fe66d0a tempest-ServicesAdminNegativeV253TestJSON-354335371 tempest-ServicesAdminNegativeV253TestJSON-354335371-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:32.062860 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-60eade50-1d93-42a9-8857-da4a2fe66d0a tempest-ServicesAdminNegativeV253TestJSON-354335371 tempest-ServicesAdminNegativeV253TestJSON-354335371-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:32.063302 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-60eade50-1d93-42a9-8857-da4a2fe66d0a tempest-ServicesAdminNegativeV253TestJSON-354335371 tempest-ServicesAdminNegativeV253TestJSON-354335371-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:32.064087 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-60eade50-1d93-42a9-8857-da4a2fe66d0a tempest-ServicesAdminNegativeV253TestJSON-354335371 tempest-ServicesAdminNegativeV253TestJSON-354335371-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:32.064584 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-60eade50-1d93-42a9-8857-da4a2fe66d0a tempest-ServicesAdminNegativeV253TestJSON-354335371 tempest-ServicesAdminNegativeV253TestJSON-354335371-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:32.065063 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-60eade50-1d93-42a9-8857-da4a2fe66d0a tempest-ServicesAdminNegativeV253TestJSON-354335371 tempest-ServicesAdminNegativeV253TestJSON-354335371-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:32.081678 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:32.089603 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-60eade50-1d93-42a9-8857-da4a2fe66d0a tempest-ServicesAdminNegativeV253TestJSON-354335371 tempest-ServicesAdminNegativeV253TestJSON-354335371-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?host=n-d-862769-1&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.034543 Oct 27 03:23:32.090237 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 437/846] 10.222.0.20 () {60 vars in 1235 bytes} [Thu Oct 27 03:23:32 2022] GET /compute/v2.1/os-services?host=n-d-862769-1&binary=xxx => generated 16 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:23:32.102509 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b31f6a47-ec8b-4207-9e78-ed5f63da4d71 tempest-ServicesAdminNegativeV253TestJSON-354335371 tempest-ServicesAdminNegativeV253TestJSON-354335371-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:32.106068 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b31f6a47-ec8b-4207-9e78-ed5f63da4d71 tempest-ServicesAdminNegativeV253TestJSON-354335371 tempest-ServicesAdminNegativeV253TestJSON-354335371-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:32.106558 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b31f6a47-ec8b-4207-9e78-ed5f63da4d71 tempest-ServicesAdminNegativeV253TestJSON-354335371 tempest-ServicesAdminNegativeV253TestJSON-354335371-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:32.106998 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b31f6a47-ec8b-4207-9e78-ed5f63da4d71 tempest-ServicesAdminNegativeV253TestJSON-354335371 tempest-ServicesAdminNegativeV253TestJSON-354335371-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:32.107737 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b31f6a47-ec8b-4207-9e78-ed5f63da4d71 tempest-ServicesAdminNegativeV253TestJSON-354335371 tempest-ServicesAdminNegativeV253TestJSON-354335371-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:32.108202 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b31f6a47-ec8b-4207-9e78-ed5f63da4d71 tempest-ServicesAdminNegativeV253TestJSON-354335371 tempest-ServicesAdminNegativeV253TestJSON-354335371-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:32.108655 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b31f6a47-ec8b-4207-9e78-ed5f63da4d71 tempest-ServicesAdminNegativeV253TestJSON-354335371 tempest-ServicesAdminNegativeV253TestJSON-354335371-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:32.133044 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b31f6a47-ec8b-4207-9e78-ed5f63da4d71 tempest-ServicesAdminNegativeV253TestJSON-354335371 tempest-ServicesAdminNegativeV253TestJSON-354335371-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.034050 Oct 27 03:23:32.133643 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 438/847] 10.222.0.20 () {60 vars in 1178 bytes} [Thu Oct 27 03:23:32 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:23:32.145120 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-58502770-23ed-43e9-a268-187e2408de40 tempest-ServersOnMultiNodesTest-1789564933 tempest-ServersOnMultiNodesTest-1789564933-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/ac5fc2b3-c92e-470a-9bc6-885dce75fb8c" status: 200 len: 1620 microversion: 2.1 time: 0.145997 Oct 27 03:23:32.145822 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-868160c8-d77f-4818-8b39-2c524441a272 tempest-ServicesAdminNegativeV253TestJSON-354335371 tempest-ServicesAdminNegativeV253TestJSON-354335371-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:32.145946 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 410/848] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:31 2022] GET /compute/v2.1/servers/ac5fc2b3-c92e-470a-9bc6-885dce75fb8c => generated 1620 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:32.149375 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-868160c8-d77f-4818-8b39-2c524441a272 tempest-ServicesAdminNegativeV253TestJSON-354335371 tempest-ServicesAdminNegativeV253TestJSON-354335371-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:32.149863 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-868160c8-d77f-4818-8b39-2c524441a272 tempest-ServicesAdminNegativeV253TestJSON-354335371 tempest-ServicesAdminNegativeV253TestJSON-354335371-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:32.150328 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-868160c8-d77f-4818-8b39-2c524441a272 tempest-ServicesAdminNegativeV253TestJSON-354335371 tempest-ServicesAdminNegativeV253TestJSON-354335371-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:32.151101 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-868160c8-d77f-4818-8b39-2c524441a272 tempest-ServicesAdminNegativeV253TestJSON-354335371 tempest-ServicesAdminNegativeV253TestJSON-354335371-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:32.151557 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-868160c8-d77f-4818-8b39-2c524441a272 tempest-ServicesAdminNegativeV253TestJSON-354335371 tempest-ServicesAdminNegativeV253TestJSON-354335371-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:32.151981 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-868160c8-d77f-4818-8b39-2c524441a272 tempest-ServicesAdminNegativeV253TestJSON-354335371 tempest-ServicesAdminNegativeV253TestJSON-354335371-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:32.177345 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-868160c8-d77f-4818-8b39-2c524441a272 tempest-ServicesAdminNegativeV253TestJSON-354335371 tempest-ServicesAdminNegativeV253TestJSON-354335371-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.035257 Oct 27 03:23:32.178351 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 439/849] 10.222.0.20 () {60 vars in 1239 bytes} [Thu Oct 27 03:23:32 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:23:32.268990 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-56716d61-f578-4eda-9762-421ce22af278 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1441476300", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "d0a79872-c316-4bb2-914c-a118831bc023"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:23:32.297273 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-74f5c182-2f52-4ae9-b6b5-930bc209bb9c tempest-ServicesAdminNegativeV253TestJSON-1617918470 tempest-ServicesAdminNegativeV253TestJSON-1617918470-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:32.300874 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-74f5c182-2f52-4ae9-b6b5-930bc209bb9c tempest-ServicesAdminNegativeV253TestJSON-1617918470 tempest-ServicesAdminNegativeV253TestJSON-1617918470-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'aecbca17301a4f17931b0bc3e90fc901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dbb57ad89ad4d2488a5a2a77043dbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:32.302645 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-74f5c182-2f52-4ae9-b6b5-930bc209bb9c tempest-ServicesAdminNegativeV253TestJSON-1617918470 tempest-ServicesAdminNegativeV253TestJSON-1617918470-project] Request method failure captured: Oct 27 03:23:32.302645 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 27 03:23:32.302645 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:23:32.302645 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:23:32.302645 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:23:32.302645 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:23:32.302645 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:23:32.302645 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:23:32.302645 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:23:32.302645 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:23:32.302645 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfmx974FntVuBJdz8UxYf9_yHDpeu8J2r8n10v9VNOWm0WoXsyai5KEbCNxnC6QpDVVeiywPZqIn7Qfr0I7qWgaj7IToNVFzkchlyrGGktbx_2-ijKZDuBsnvoaoiz6ZwVtDAlr1ASvYXk_rOM7JMWfiGMPNc4ZY4whYYYLGu3J5uh0 Oct 27 03:23:32.302645 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:23:32.302645 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:23:32.302645 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:23:32.302645 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:23:32.302645 n-d-862769-1 devstack@n-api.service[121001]: X-Openstack-Nova-Api-Version: 2.53 Oct 27 03:23:32.302645 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:23:32.302645 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:23:32.302645 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 8dbb57ad89ad4d2488a5a2a77043dbe3 Oct 27 03:23:32.302645 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1617918470 Oct 27 03:23:32.302645 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:23:32.302645 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:23:32.304054 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8dbb57ad89ad4d2488a5a2a77043dbe3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8dbb57ad89ad4d2488a5a2a77043dbe3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8dbb57ad89ad4d2488a5a2a77043dbe3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8dbb57ad89ad4d2488a5a2a77043dbe3"}]}] Oct 27 03:23:32.304054 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1617918470 Oct 27 03:23:32.304054 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 8dbb57ad89ad4d2488a5a2a77043dbe3 Oct 27 03:23:32.304054 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1617918470 Oct 27 03:23:32.304054 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1617918470-project Oct 27 03:23:32.304054 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:23:32.304054 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:23:32.304054 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: aecbca17301a4f17931b0bc3e90fc901 Oct 27 03:23:32.304054 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1617918470-project Oct 27 03:23:32.304054 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:23:32.304054 n-d-862769-1 devstack@n-api.service[121001]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 27 03:23:32.304054 n-d-862769-1 devstack@n-api.service[121001]: action_args: {} Oct 27 03:23:32.304846 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:23:32.304846 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:23:32.304846 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:23:32.304846 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:23:32.304846 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:23:32.304846 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:23:32.304846 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 03:23:32.304846 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:23:32.304846 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 03:23:32.304846 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:23:32.304846 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:23:32.304846 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:23:32.304846 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 27 03:23:32.304846 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 27 03:23:32.304846 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 03:23:32.304846 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 03:23:32.304846 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 03:23:32.304846 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 03:23:32.304846 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 03:23:32.305973 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 03:23:32.305973 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 03:23:32.305973 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 03:23:32.305973 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 03:23:32.305973 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 03:23:32.305973 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 03:23:32.305973 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 03:23:32.305973 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 03:23:32.305973 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 03:23:32.305973 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 27 03:23:32.305973 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:23:32.305973 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:23:32.305973 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:23:32.305973 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:23:32.305973 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:23:32.305973 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:23:32.305973 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 03:23:32.305973 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 03:23:32.305973 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 27 03:23:32.305973 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:23:32.307813 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-74f5c182-2f52-4ae9-b6b5-930bc209bb9c tempest-ServicesAdminNegativeV253TestJSON-1617918470 tempest-ServicesAdminNegativeV253TestJSON-1617918470-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:23:32.307813 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-74f5c182-2f52-4ae9-b6b5-930bc209bb9c tempest-ServicesAdminNegativeV253TestJSON-1617918470 tempest-ServicesAdminNegativeV253TestJSON-1617918470-project] 10.222.0.20 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.117136 Oct 27 03:23:32.309063 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 411/850] 10.222.0.20 () {60 vars in 1178 bytes} [Thu Oct 27 03:23:32 2022] GET /compute/v2.1/os-services => generated 112 bytes in 123 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Oct 27 03:23:32.317027 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-01f2a33c-ced8-45f5-827b-922bbd38eb15 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:32.317750 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-01f2a33c-ced8-45f5-827b-922bbd38eb15 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:32.323375 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-56716d61-f578-4eda-9762-421ce22af278 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] validate_networks() for None {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:23:32.325641 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-01f2a33c-ced8-45f5-827b-922bbd38eb15 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:32.326287 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-01f2a33c-ced8-45f5-827b-922bbd38eb15 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:32.326744 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-01f2a33c-ced8-45f5-827b-922bbd38eb15 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:32.328021 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-01f2a33c-ced8-45f5-827b-922bbd38eb15 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:32.328519 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-01f2a33c-ced8-45f5-827b-922bbd38eb15 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:32.328962 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-01f2a33c-ced8-45f5-827b-922bbd38eb15 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:32.399566 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-01f2a33c-ced8-45f5-827b-922bbd38eb15 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:32.408366 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-01f2a33c-ced8-45f5-827b-922bbd38eb15 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:32.409813 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-01f2a33c-ced8-45f5-827b-922bbd38eb15 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:32.415885 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-01f2a33c-ced8-45f5-827b-922bbd38eb15 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1539 microversion: 2.91 time: 0.102715 Oct 27 03:23:32.416462 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 412/851] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:23:32 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1539 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:23:32.422689 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3a956d18-62ea-4ba1-8628-9acce5a171f4 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:32.423537 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3a956d18-62ea-4ba1-8628-9acce5a171f4 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: a52fed88-50f8-4dea-b83d-6878adccb024] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:32.433738 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3a956d18-62ea-4ba1-8628-9acce5a171f4 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:32.434487 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3a956d18-62ea-4ba1-8628-9acce5a171f4 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:32.434926 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3a956d18-62ea-4ba1-8628-9acce5a171f4 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:32.438158 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3a956d18-62ea-4ba1-8628-9acce5a171f4 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:32.438158 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3a956d18-62ea-4ba1-8628-9acce5a171f4 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:32.438158 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3a956d18-62ea-4ba1-8628-9acce5a171f4 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:32.564436 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-56716d61-f578-4eda-9762-421ce22af278 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:23:32.564983 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-56716d61-f578-4eda-9762-421ce22af278 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:23:32.565348 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-56716d61-f578-4eda-9762-421ce22af278 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:23:32.565744 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-56716d61-f578-4eda-9762-421ce22af278 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:23:32.566198 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-56716d61-f578-4eda-9762-421ce22af278 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:23:32.571293 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3a956d18-62ea-4ba1-8628-9acce5a171f4 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:32.575675 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-56716d61-f578-4eda-9762-421ce22af278 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:32.576168 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-56716d61-f578-4eda-9762-421ce22af278 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:32.576615 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-56716d61-f578-4eda-9762-421ce22af278 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:32.577353 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-56716d61-f578-4eda-9762-421ce22af278 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:32.578380 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-56716d61-f578-4eda-9762-421ce22af278 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:32.578855 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-56716d61-f578-4eda-9762-421ce22af278 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:32.580347 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3a956d18-62ea-4ba1-8628-9acce5a171f4 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/a52fed88-50f8-4dea-b83d-6878adccb024" status: 200 len: 1311 microversion: 2.1 time: 0.162702 Oct 27 03:23:32.581102 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 413/852] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:32 2022] GET /compute/v2.1/servers/a52fed88-50f8-4dea-b83d-6878adccb024 => generated 1311 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:32.597394 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-56716d61-f578-4eda-9762-421ce22af278 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Getting quotas for project b95729a8c8a14361b7cbf8b2b13900b2. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:23:32.602775 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-56716d61-f578-4eda-9762-421ce22af278 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Getting quotas for user 91d1351fcb6b4cd08f176e6d0cc5bb11 and project b95729a8c8a14361b7cbf8b2b13900b2. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:23:32.618538 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-56716d61-f578-4eda-9762-421ce22af278 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:23:32.618538 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-56716d61-f578-4eda-9762-421ce22af278 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: a4abccf0-a093-4148-a260-40ab363b12f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:23:32.725057 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1dfeb9c7-d1a4-4880-bef1-da406a9cbd50 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:32.725662 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1dfeb9c7-d1a4-4880-bef1-da406a9cbd50 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] [instance: 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:32.731715 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1dfeb9c7-d1a4-4880-bef1-da406a9cbd50 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:32.737933 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1dfeb9c7-d1a4-4880-bef1-da406a9cbd50 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:32.737933 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1dfeb9c7-d1a4-4880-bef1-da406a9cbd50 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:32.737933 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1dfeb9c7-d1a4-4880-bef1-da406a9cbd50 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:32.737933 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1dfeb9c7-d1a4-4880-bef1-da406a9cbd50 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:32.738438 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1dfeb9c7-d1a4-4880-bef1-da406a9cbd50 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:32.801392 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-56716d61-f578-4eda-9762-421ce22af278 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.536947 Oct 27 03:23:32.805481 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1dfeb9c7-d1a4-4880-bef1-da406a9cbd50 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:32.819440 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 440/853] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:23:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 557 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 03:23:32.824673 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1dfeb9c7-d1a4-4880-bef1-da406a9cbd50 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:32.825811 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c33959c7-e091-46f6-ba61-9654a9fb4bc7 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:32.826404 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1dfeb9c7-d1a4-4880-bef1-da406a9cbd50 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:32.826532 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c33959c7-e091-46f6-ba61-9654a9fb4bc7 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 87ad30f8-b432-45dc-82ff-aed508afddd7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:32.852338 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c33959c7-e091-46f6-ba61-9654a9fb4bc7 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:32.857331 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1dfeb9c7-d1a4-4880-bef1-da406a9cbd50 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] 10.222.0.20 "GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503" status: 200 len: 1446 microversion: 2.75 time: 0.131741 Oct 27 03:23:32.858122 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c33959c7-e091-46f6-ba61-9654a9fb4bc7 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:32.858248 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 414/854] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:23:32 2022] GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503 => generated 1446 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:23:32.858329 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c33959c7-e091-46f6-ba61-9654a9fb4bc7 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:32.858329 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c33959c7-e091-46f6-ba61-9654a9fb4bc7 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:32.858329 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c33959c7-e091-46f6-ba61-9654a9fb4bc7 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:32.858329 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c33959c7-e091-46f6-ba61-9654a9fb4bc7 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:32.862704 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-013c2998-dea6-4319-a731-48957a84beda tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:32.863405 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-013c2998-dea6-4319-a731-48957a84beda tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: a4abccf0-a093-4148-a260-40ab363b12f6] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:32.993950 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-013c2998-dea6-4319-a731-48957a84beda tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:33.004764 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-013c2998-dea6-4319-a731-48957a84beda tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/a4abccf0-a093-4148-a260-40ab363b12f6" status: 200 len: 1217 microversion: 2.1 time: 0.149798 Oct 27 03:23:33.019089 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 415/855] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:32 2022] GET /compute/v2.1/servers/a4abccf0-a093-4148-a260-40ab363b12f6 => generated 1217 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:33.019089 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0a4db59e-e199-41cc-abe4-9dac17046e79 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:33.019089 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0a4db59e-e199-41cc-abe4-9dac17046e79 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: b2ef080f-30ca-4dc5-ba03-9cf1899346a4] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:33.019089 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0a4db59e-e199-41cc-abe4-9dac17046e79 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:33.020168 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0a4db59e-e199-41cc-abe4-9dac17046e79 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:33.020818 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0a4db59e-e199-41cc-abe4-9dac17046e79 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:33.021692 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0a4db59e-e199-41cc-abe4-9dac17046e79 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:33.022411 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0a4db59e-e199-41cc-abe4-9dac17046e79 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:33.022984 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0a4db59e-e199-41cc-abe4-9dac17046e79 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:33.192692 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c33959c7-e091-46f6-ba61-9654a9fb4bc7 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:33.207003 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c33959c7-e091-46f6-ba61-9654a9fb4bc7 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:33.211325 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c33959c7-e091-46f6-ba61-9654a9fb4bc7 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:33.217387 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c33959c7-e091-46f6-ba61-9654a9fb4bc7 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/87ad30f8-b432-45dc-82ff-aed508afddd7" status: 200 len: 1362 microversion: 2.25 time: 0.392393 Oct 27 03:23:33.217387 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 441/856] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:23:32 2022] GET /compute/v2.1/servers/87ad30f8-b432-45dc-82ff-aed508afddd7 => generated 1362 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:23:33.220276 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-ff9fcfda-5c3e-4618-ae92-adf0f162c023 req-e742b84e-feb3-477f-a2bb-0343564099b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2ef080f-30ca-4dc5-ba03-9cf1899346a4", "name": "network-vif-plugged", "status": "completed", "tag": "7bd75d20-f08a-4aa0-b246-a0898c1313cc"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:23:33.230964 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-ff9fcfda-5c3e-4618-ae92-adf0f162c023 req-e742b84e-feb3-477f-a2bb-0343564099b4 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:33.231580 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-ff9fcfda-5c3e-4618-ae92-adf0f162c023 req-e742b84e-feb3-477f-a2bb-0343564099b4 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:33.232076 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-ff9fcfda-5c3e-4618-ae92-adf0f162c023 req-e742b84e-feb3-477f-a2bb-0343564099b4 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:33.245745 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-ff9fcfda-5c3e-4618-ae92-adf0f162c023 req-e742b84e-feb3-477f-a2bb-0343564099b4 service nova] Creating event network-vif-plugged:7bd75d20-f08a-4aa0-b246-a0898c1313cc for instance b2ef080f-30ca-4dc5-ba03-9cf1899346a4 on n-h1-862769-1 Oct 27 03:23:33.252341 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [req-ff9fcfda-5c3e-4618-ae92-adf0f162c023 req-e742b84e-feb3-477f-a2bb-0343564099b4 service nova] Instance b2ef080f-30ca-4dc5-ba03-9cf1899346a4 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862769-1', 'n-h1-862769-1'} {{(pid=121000) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 03:23:33.264338 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-ff9fcfda-5c3e-4618-ae92-adf0f162c023 req-e742b84e-feb3-477f-a2bb-0343564099b4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048870 Oct 27 03:23:33.265060 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 442/857] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:23:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:23:33.445224 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e62dc66f-5502-4218-b7bc-f39348ccd9e5 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:33.445918 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e62dc66f-5502-4218-b7bc-f39348ccd9e5 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:33.452454 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e62dc66f-5502-4218-b7bc-f39348ccd9e5 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:33.452947 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e62dc66f-5502-4218-b7bc-f39348ccd9e5 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:33.453384 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e62dc66f-5502-4218-b7bc-f39348ccd9e5 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:33.454113 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e62dc66f-5502-4218-b7bc-f39348ccd9e5 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:33.454583 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e62dc66f-5502-4218-b7bc-f39348ccd9e5 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:33.455001 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e62dc66f-5502-4218-b7bc-f39348ccd9e5 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:33.471790 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0a4db59e-e199-41cc-abe4-9dac17046e79 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:33.492041 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0a4db59e-e199-41cc-abe4-9dac17046e79 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4" status: 200 len: 1471 microversion: 2.1 time: 0.484710 Oct 27 03:23:33.495062 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 416/858] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:33 2022] GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4 => generated 1471 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:33.553228 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e62dc66f-5502-4218-b7bc-f39348ccd9e5 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:33.568255 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e62dc66f-5502-4218-b7bc-f39348ccd9e5 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:33.570482 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e62dc66f-5502-4218-b7bc-f39348ccd9e5 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:33.577706 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e62dc66f-5502-4218-b7bc-f39348ccd9e5 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1539 microversion: 2.91 time: 0.137148 Oct 27 03:23:33.584382 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 443/859] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:23:33 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1539 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:23:33.605708 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b3eb4f24-673f-4ac2-a624-85c7bb4e542f tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:33.606391 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b3eb4f24-673f-4ac2-a624-85c7bb4e542f tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: a52fed88-50f8-4dea-b83d-6878adccb024] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:33.613823 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b3eb4f24-673f-4ac2-a624-85c7bb4e542f tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:33.614338 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b3eb4f24-673f-4ac2-a624-85c7bb4e542f tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:33.615027 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b3eb4f24-673f-4ac2-a624-85c7bb4e542f tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:33.615732 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b3eb4f24-673f-4ac2-a624-85c7bb4e542f tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:33.616291 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b3eb4f24-673f-4ac2-a624-85c7bb4e542f tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:33.616805 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b3eb4f24-673f-4ac2-a624-85c7bb4e542f tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:33.864631 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b3eb4f24-673f-4ac2-a624-85c7bb4e542f tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:33.872938 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b3eb4f24-673f-4ac2-a624-85c7bb4e542f tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/a52fed88-50f8-4dea-b83d-6878adccb024" status: 200 len: 1311 microversion: 2.1 time: 0.272046 Oct 27 03:23:33.873855 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 417/860] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:33 2022] GET /compute/v2.1/servers/a52fed88-50f8-4dea-b83d-6878adccb024 => generated 1311 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:33.892917 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-635c77d7-6a1c-492e-898a-7c51f37c5992 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:33.894321 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-635c77d7-6a1c-492e-898a-7c51f37c5992 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] [instance: 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:33.902582 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-635c77d7-6a1c-492e-898a-7c51f37c5992 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:33.903247 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-635c77d7-6a1c-492e-898a-7c51f37c5992 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:33.904095 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-635c77d7-6a1c-492e-898a-7c51f37c5992 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:33.904885 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-635c77d7-6a1c-492e-898a-7c51f37c5992 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:33.905437 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-635c77d7-6a1c-492e-898a-7c51f37c5992 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:33.906532 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-635c77d7-6a1c-492e-898a-7c51f37c5992 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:33.999531 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-635c77d7-6a1c-492e-898a-7c51f37c5992 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:34.009442 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-635c77d7-6a1c-492e-898a-7c51f37c5992 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:34.010948 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-635c77d7-6a1c-492e-898a-7c51f37c5992 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:34.017713 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-635c77d7-6a1c-492e-898a-7c51f37c5992 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] 10.222.0.20 "GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503" status: 200 len: 1446 microversion: 2.75 time: 0.130699 Oct 27 03:23:34.018341 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 444/861] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:23:33 2022] GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503 => generated 1446 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:23:34.032882 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e27d66e0-ca23-4be7-ba58-f2672fb8afad tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:34.033519 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e27d66e0-ca23-4be7-ba58-f2672fb8afad tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: a4abccf0-a093-4148-a260-40ab363b12f6] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:34.046535 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e27d66e0-ca23-4be7-ba58-f2672fb8afad tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:34.047041 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e27d66e0-ca23-4be7-ba58-f2672fb8afad tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:34.047494 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e27d66e0-ca23-4be7-ba58-f2672fb8afad tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:34.048419 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e27d66e0-ca23-4be7-ba58-f2672fb8afad tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:34.048885 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e27d66e0-ca23-4be7-ba58-f2672fb8afad tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:34.049321 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e27d66e0-ca23-4be7-ba58-f2672fb8afad tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:34.112744 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e27d66e0-ca23-4be7-ba58-f2672fb8afad tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:34.123657 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e27d66e0-ca23-4be7-ba58-f2672fb8afad tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/a4abccf0-a093-4148-a260-40ab363b12f6" status: 200 len: 1221 microversion: 2.1 time: 0.095198 Oct 27 03:23:34.124967 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 418/862] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:34 2022] GET /compute/v2.1/servers/a4abccf0-a093-4148-a260-40ab363b12f6 => generated 1221 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:34.240677 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b0bdaf0e-825a-48bb-ad59-90cb866f3096 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:34.241412 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b0bdaf0e-825a-48bb-ad59-90cb866f3096 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 87ad30f8-b432-45dc-82ff-aed508afddd7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:34.247446 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b0bdaf0e-825a-48bb-ad59-90cb866f3096 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:34.248018 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b0bdaf0e-825a-48bb-ad59-90cb866f3096 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:34.248533 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b0bdaf0e-825a-48bb-ad59-90cb866f3096 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:34.249820 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b0bdaf0e-825a-48bb-ad59-90cb866f3096 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:34.250535 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b0bdaf0e-825a-48bb-ad59-90cb866f3096 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:34.250971 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b0bdaf0e-825a-48bb-ad59-90cb866f3096 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:34.386815 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b0bdaf0e-825a-48bb-ad59-90cb866f3096 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:34.396312 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b0bdaf0e-825a-48bb-ad59-90cb866f3096 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:34.398150 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b0bdaf0e-825a-48bb-ad59-90cb866f3096 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:34.399285 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b0bdaf0e-825a-48bb-ad59-90cb866f3096 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/87ad30f8-b432-45dc-82ff-aed508afddd7" status: 200 len: 1362 microversion: 2.25 time: 0.162980 Oct 27 03:23:34.400139 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 445/863] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:23:34 2022] GET /compute/v2.1/servers/87ad30f8-b432-45dc-82ff-aed508afddd7 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:23:34.516697 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e219d1d9-75fc-44e4-b815-d81780d01d13 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:34.517823 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e219d1d9-75fc-44e4-b815-d81780d01d13 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: b2ef080f-30ca-4dc5-ba03-9cf1899346a4] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:34.523783 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e219d1d9-75fc-44e4-b815-d81780d01d13 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:34.524271 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e219d1d9-75fc-44e4-b815-d81780d01d13 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:34.524713 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e219d1d9-75fc-44e4-b815-d81780d01d13 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:34.525415 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e219d1d9-75fc-44e4-b815-d81780d01d13 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:34.525904 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e219d1d9-75fc-44e4-b815-d81780d01d13 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:34.526369 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e219d1d9-75fc-44e4-b815-d81780d01d13 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:34.609605 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ec0023cb-eb01-485b-8970-807866495421 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:34.610444 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ec0023cb-eb01-485b-8970-807866495421 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:34.617033 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ec0023cb-eb01-485b-8970-807866495421 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:34.617563 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ec0023cb-eb01-485b-8970-807866495421 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:34.618006 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ec0023cb-eb01-485b-8970-807866495421 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:34.618751 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ec0023cb-eb01-485b-8970-807866495421 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:34.619189 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ec0023cb-eb01-485b-8970-807866495421 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:34.619671 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ec0023cb-eb01-485b-8970-807866495421 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:34.668308 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e219d1d9-75fc-44e4-b815-d81780d01d13 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:34.680549 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e219d1d9-75fc-44e4-b815-d81780d01d13 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4" status: 200 len: 1471 microversion: 2.1 time: 0.167610 Oct 27 03:23:34.681320 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 419/864] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:34 2022] GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4 => generated 1471 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:34.702838 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ec0023cb-eb01-485b-8970-807866495421 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:34.712698 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ec0023cb-eb01-485b-8970-807866495421 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:34.714173 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ec0023cb-eb01-485b-8970-807866495421 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:34.719970 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ec0023cb-eb01-485b-8970-807866495421 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1539 microversion: 2.91 time: 0.115027 Oct 27 03:23:34.720810 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 446/865] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:23:34 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1539 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:23:34.901720 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9dc37c4b-2808-42f3-bbdb-05dc14dcf46b tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:34.902418 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-9dc37c4b-2808-42f3-bbdb-05dc14dcf46b tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: a52fed88-50f8-4dea-b83d-6878adccb024] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:34.909222 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9dc37c4b-2808-42f3-bbdb-05dc14dcf46b tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:34.909720 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9dc37c4b-2808-42f3-bbdb-05dc14dcf46b tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:34.910217 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9dc37c4b-2808-42f3-bbdb-05dc14dcf46b tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:34.910935 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9dc37c4b-2808-42f3-bbdb-05dc14dcf46b tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:34.911399 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9dc37c4b-2808-42f3-bbdb-05dc14dcf46b tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:34.911830 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9dc37c4b-2808-42f3-bbdb-05dc14dcf46b tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:35.049856 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-686b23d4-6e0b-433a-bae9-c558e3c8654f tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:35.050647 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-686b23d4-6e0b-433a-bae9-c558e3c8654f tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] [instance: 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:35.056759 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-686b23d4-6e0b-433a-bae9-c558e3c8654f tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:35.057136 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-686b23d4-6e0b-433a-bae9-c558e3c8654f tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:35.057578 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-686b23d4-6e0b-433a-bae9-c558e3c8654f tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:35.058310 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-686b23d4-6e0b-433a-bae9-c558e3c8654f tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:35.058779 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-686b23d4-6e0b-433a-bae9-c558e3c8654f tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:35.059211 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-686b23d4-6e0b-433a-bae9-c558e3c8654f tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:35.087302 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9dc37c4b-2808-42f3-bbdb-05dc14dcf46b tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:35.105488 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9dc37c4b-2808-42f3-bbdb-05dc14dcf46b tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/a52fed88-50f8-4dea-b83d-6878adccb024" status: 200 len: 1311 microversion: 2.1 time: 0.208516 Oct 27 03:23:35.114985 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 420/866] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:34 2022] GET /compute/v2.1/servers/a52fed88-50f8-4dea-b83d-6878adccb024 => generated 1311 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:35.141454 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-686b23d4-6e0b-433a-bae9-c558e3c8654f tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:35.149963 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-25edf0a9-7fe7-4fd8-87fb-5cd9c1d274e4 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:35.150866 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-25edf0a9-7fe7-4fd8-87fb-5cd9c1d274e4 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: a4abccf0-a093-4148-a260-40ab363b12f6] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:35.152321 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-686b23d4-6e0b-433a-bae9-c558e3c8654f tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:35.153783 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-686b23d4-6e0b-433a-bae9-c558e3c8654f tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:35.159803 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-25edf0a9-7fe7-4fd8-87fb-5cd9c1d274e4 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:35.160355 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-25edf0a9-7fe7-4fd8-87fb-5cd9c1d274e4 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:35.160581 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-686b23d4-6e0b-433a-bae9-c558e3c8654f tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] 10.222.0.20 "GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503" status: 200 len: 1446 microversion: 2.75 time: 0.115729 Oct 27 03:23:35.161245 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-25edf0a9-7fe7-4fd8-87fb-5cd9c1d274e4 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:35.161384 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 447/867] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:23:35 2022] GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503 => generated 1446 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:23:35.161550 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-25edf0a9-7fe7-4fd8-87fb-5cd9c1d274e4 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:35.162096 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-25edf0a9-7fe7-4fd8-87fb-5cd9c1d274e4 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:35.162535 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-25edf0a9-7fe7-4fd8-87fb-5cd9c1d274e4 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:35.242312 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-25edf0a9-7fe7-4fd8-87fb-5cd9c1d274e4 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:35.254416 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-25edf0a9-7fe7-4fd8-87fb-5cd9c1d274e4 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/a4abccf0-a093-4148-a260-40ab363b12f6" status: 200 len: 1269 microversion: 2.1 time: 0.110511 Oct 27 03:23:35.255106 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 421/868] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:35 2022] GET /compute/v2.1/servers/a4abccf0-a093-4148-a260-40ab363b12f6 => generated 1269 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:23:35.425285 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-001631a8-f2ee-4ee2-8209-93ef0e8d8756 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:35.425905 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-001631a8-f2ee-4ee2-8209-93ef0e8d8756 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 87ad30f8-b432-45dc-82ff-aed508afddd7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:35.432238 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-001631a8-f2ee-4ee2-8209-93ef0e8d8756 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:35.432716 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-001631a8-f2ee-4ee2-8209-93ef0e8d8756 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:35.433155 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-001631a8-f2ee-4ee2-8209-93ef0e8d8756 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:35.433958 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-001631a8-f2ee-4ee2-8209-93ef0e8d8756 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:35.434423 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-001631a8-f2ee-4ee2-8209-93ef0e8d8756 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:35.434847 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-001631a8-f2ee-4ee2-8209-93ef0e8d8756 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:35.453976 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:35.614175 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-001631a8-f2ee-4ee2-8209-93ef0e8d8756 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:35.622531 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-001631a8-f2ee-4ee2-8209-93ef0e8d8756 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:35.623987 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-001631a8-f2ee-4ee2-8209-93ef0e8d8756 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:35.625616 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-001631a8-f2ee-4ee2-8209-93ef0e8d8756 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/87ad30f8-b432-45dc-82ff-aed508afddd7" status: 200 len: 1362 microversion: 2.25 time: 0.204779 Oct 27 03:23:35.626468 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 448/869] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:23:35 2022] GET /compute/v2.1/servers/87ad30f8-b432-45dc-82ff-aed508afddd7 => generated 1362 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:23:35.704684 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-45b1b3a4-8d84-4131-811c-3ca8a1997a72 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:35.708291 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-45b1b3a4-8d84-4131-811c-3ca8a1997a72 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: b2ef080f-30ca-4dc5-ba03-9cf1899346a4] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:35.711748 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-45b1b3a4-8d84-4131-811c-3ca8a1997a72 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:35.712300 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-45b1b3a4-8d84-4131-811c-3ca8a1997a72 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:35.712639 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-45b1b3a4-8d84-4131-811c-3ca8a1997a72 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:35.713625 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-45b1b3a4-8d84-4131-811c-3ca8a1997a72 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:35.713995 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-45b1b3a4-8d84-4131-811c-3ca8a1997a72 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:35.714730 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-45b1b3a4-8d84-4131-811c-3ca8a1997a72 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:35.748039 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-bc69b784-f135-46e9-993d-e818ee14c758 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:35.749016 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-bc69b784-f135-46e9-993d-e818ee14c758 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:35.757319 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bc69b784-f135-46e9-993d-e818ee14c758 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:35.758068 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bc69b784-f135-46e9-993d-e818ee14c758 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:35.758775 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bc69b784-f135-46e9-993d-e818ee14c758 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:35.759837 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bc69b784-f135-46e9-993d-e818ee14c758 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:35.760527 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bc69b784-f135-46e9-993d-e818ee14c758 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:35.761301 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bc69b784-f135-46e9-993d-e818ee14c758 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:35.853737 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-bc69b784-f135-46e9-993d-e818ee14c758 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:35.864201 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-bc69b784-f135-46e9-993d-e818ee14c758 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:35.865915 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-bc69b784-f135-46e9-993d-e818ee14c758 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:35.871460 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-bc69b784-f135-46e9-993d-e818ee14c758 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1539 microversion: 2.91 time: 0.127959 Oct 27 03:23:35.872508 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 449/870] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:23:35 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1539 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:23:35.904807 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-45b1b3a4-8d84-4131-811c-3ca8a1997a72 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:35.914295 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-45b1b3a4-8d84-4131-811c-3ca8a1997a72 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4" status: 200 len: 1471 microversion: 2.1 time: 0.213600 Oct 27 03:23:35.915041 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 422/871] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:35 2022] GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4 => generated 1471 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:36.129777 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-08b79d6e-16f0-4b65-a8f6-7eacf54dfea9 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:36.130380 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-08b79d6e-16f0-4b65-a8f6-7eacf54dfea9 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: a52fed88-50f8-4dea-b83d-6878adccb024] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:36.137288 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-08b79d6e-16f0-4b65-a8f6-7eacf54dfea9 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:36.138415 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-08b79d6e-16f0-4b65-a8f6-7eacf54dfea9 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:36.138884 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-08b79d6e-16f0-4b65-a8f6-7eacf54dfea9 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:36.139614 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-08b79d6e-16f0-4b65-a8f6-7eacf54dfea9 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:36.140106 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-08b79d6e-16f0-4b65-a8f6-7eacf54dfea9 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:36.140546 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-08b79d6e-16f0-4b65-a8f6-7eacf54dfea9 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:36.197974 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b9def83b-3ec1-44d1-a61b-a7dc9c279a80 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:36.198629 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b9def83b-3ec1-44d1-a61b-a7dc9c279a80 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] [instance: 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:36.206732 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b9def83b-3ec1-44d1-a61b-a7dc9c279a80 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:36.207466 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b9def83b-3ec1-44d1-a61b-a7dc9c279a80 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:36.207921 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b9def83b-3ec1-44d1-a61b-a7dc9c279a80 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:36.208642 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b9def83b-3ec1-44d1-a61b-a7dc9c279a80 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:36.209111 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b9def83b-3ec1-44d1-a61b-a7dc9c279a80 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:36.209545 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b9def83b-3ec1-44d1-a61b-a7dc9c279a80 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:36.281252 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b9def83b-3ec1-44d1-a61b-a7dc9c279a80 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:36.290415 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b9def83b-3ec1-44d1-a61b-a7dc9c279a80 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:36.291928 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b9def83b-3ec1-44d1-a61b-a7dc9c279a80 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:36.297920 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b9def83b-3ec1-44d1-a61b-a7dc9c279a80 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] 10.222.0.20 "GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503" status: 200 len: 1446 microversion: 2.75 time: 0.103840 Oct 27 03:23:36.299057 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 423/872] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:23:36 2022] GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503 => generated 1446 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:23:36.314906 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9b3f3a53-9ef8-4c5f-a37c-604704e9dafb tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:36.316012 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-9b3f3a53-9ef8-4c5f-a37c-604704e9dafb tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: a4abccf0-a093-4148-a260-40ab363b12f6] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:36.323791 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9b3f3a53-9ef8-4c5f-a37c-604704e9dafb tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:36.324377 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9b3f3a53-9ef8-4c5f-a37c-604704e9dafb tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:36.324829 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9b3f3a53-9ef8-4c5f-a37c-604704e9dafb tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:36.325743 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9b3f3a53-9ef8-4c5f-a37c-604704e9dafb tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:36.326397 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9b3f3a53-9ef8-4c5f-a37c-604704e9dafb tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:36.327008 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9b3f3a53-9ef8-4c5f-a37c-604704e9dafb tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:36.332436 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=100 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:36.344495 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-08b79d6e-16f0-4b65-a8f6-7eacf54dfea9 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:36.356675 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-08b79d6e-16f0-4b65-a8f6-7eacf54dfea9 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/a52fed88-50f8-4dea-b83d-6878adccb024" status: 200 len: 1311 microversion: 2.1 time: 0.231057 Oct 27 03:23:36.357587 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 450/873] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:36 2022] GET /compute/v2.1/servers/a52fed88-50f8-4dea-b83d-6878adccb024 => generated 1311 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:36.417712 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9b3f3a53-9ef8-4c5f-a37c-604704e9dafb tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:36.427458 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9b3f3a53-9ef8-4c5f-a37c-604704e9dafb tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/a4abccf0-a093-4148-a260-40ab363b12f6" status: 200 len: 1275 microversion: 2.1 time: 0.127174 Oct 27 03:23:36.428603 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 424/874] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:36 2022] GET /compute/v2.1/servers/a4abccf0-a093-4148-a260-40ab363b12f6 => generated 1275 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:36.448942 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-5deafce7-423a-44ca-86d4-2e02258e4755 req-568c70a2-0880-46a5-9291-8c7c0e0b6f0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87ad30f8-b432-45dc-82ff-aed508afddd7", "name": "network-vif-plugged", "status": "completed", "tag": "e564d375-d22d-4aff-a377-d7085a068b58"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:23:36.458540 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-5deafce7-423a-44ca-86d4-2e02258e4755 req-568c70a2-0880-46a5-9291-8c7c0e0b6f0f service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:36.459024 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-5deafce7-423a-44ca-86d4-2e02258e4755 req-568c70a2-0880-46a5-9291-8c7c0e0b6f0f service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:36.459460 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-5deafce7-423a-44ca-86d4-2e02258e4755 req-568c70a2-0880-46a5-9291-8c7c0e0b6f0f service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:36.470882 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-5deafce7-423a-44ca-86d4-2e02258e4755 req-568c70a2-0880-46a5-9291-8c7c0e0b6f0f service nova] Creating event network-vif-plugged:e564d375-d22d-4aff-a377-d7085a068b58 for instance 87ad30f8-b432-45dc-82ff-aed508afddd7 on n-h2-862769-1 Oct 27 03:23:36.475891 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-5deafce7-423a-44ca-86d4-2e02258e4755 req-568c70a2-0880-46a5-9291-8c7c0e0b6f0f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032338 Oct 27 03:23:36.476496 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 451/875] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:23:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:23:36.663619 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-194d38aa-aa95-44cf-bb2d-f167c65b2942 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:36.665987 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-194d38aa-aa95-44cf-bb2d-f167c65b2942 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 87ad30f8-b432-45dc-82ff-aed508afddd7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:36.680774 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-194d38aa-aa95-44cf-bb2d-f167c65b2942 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:36.682358 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-194d38aa-aa95-44cf-bb2d-f167c65b2942 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:36.683039 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-194d38aa-aa95-44cf-bb2d-f167c65b2942 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:36.684248 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-194d38aa-aa95-44cf-bb2d-f167c65b2942 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:36.685503 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-194d38aa-aa95-44cf-bb2d-f167c65b2942 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:36.686297 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-194d38aa-aa95-44cf-bb2d-f167c65b2942 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:36.883886 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-194d38aa-aa95-44cf-bb2d-f167c65b2942 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:36.898942 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-194d38aa-aa95-44cf-bb2d-f167c65b2942 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:36.902571 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-194d38aa-aa95-44cf-bb2d-f167c65b2942 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:36.904558 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-194d38aa-aa95-44cf-bb2d-f167c65b2942 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/87ad30f8-b432-45dc-82ff-aed508afddd7" status: 200 len: 1362 microversion: 2.25 time: 0.253830 Oct 27 03:23:36.908584 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 425/876] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:23:36 2022] GET /compute/v2.1/servers/87ad30f8-b432-45dc-82ff-aed508afddd7 => generated 1362 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:23:36.917785 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a545131b-3b26-4fd9-b35d-3f525eb3f8b4 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:36.920763 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a545131b-3b26-4fd9-b35d-3f525eb3f8b4 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:36.929873 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a545131b-3b26-4fd9-b35d-3f525eb3f8b4 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:36.939987 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7cf5ea80-6967-4a05-89b9-362afe8daa79 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:36.940294 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a545131b-3b26-4fd9-b35d-3f525eb3f8b4 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:36.944627 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a545131b-3b26-4fd9-b35d-3f525eb3f8b4 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:36.944627 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a545131b-3b26-4fd9-b35d-3f525eb3f8b4 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:36.944627 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a545131b-3b26-4fd9-b35d-3f525eb3f8b4 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:36.944627 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a545131b-3b26-4fd9-b35d-3f525eb3f8b4 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:36.946931 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7cf5ea80-6967-4a05-89b9-362afe8daa79 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: b2ef080f-30ca-4dc5-ba03-9cf1899346a4] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:36.960680 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7cf5ea80-6967-4a05-89b9-362afe8daa79 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:36.961760 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7cf5ea80-6967-4a05-89b9-362afe8daa79 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:36.963576 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7cf5ea80-6967-4a05-89b9-362afe8daa79 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:36.965235 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7cf5ea80-6967-4a05-89b9-362afe8daa79 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:36.973741 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7cf5ea80-6967-4a05-89b9-362afe8daa79 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:36.973741 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7cf5ea80-6967-4a05-89b9-362afe8daa79 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:37.118372 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a545131b-3b26-4fd9-b35d-3f525eb3f8b4 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:37.132156 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a545131b-3b26-4fd9-b35d-3f525eb3f8b4 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:37.136422 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a545131b-3b26-4fd9-b35d-3f525eb3f8b4 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:37.145965 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a545131b-3b26-4fd9-b35d-3f525eb3f8b4 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1539 microversion: 2.91 time: 0.247848 Oct 27 03:23:37.147361 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 452/877] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:23:36 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1539 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:23:37.224490 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7cf5ea80-6967-4a05-89b9-362afe8daa79 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:37.234068 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7cf5ea80-6967-4a05-89b9-362afe8daa79 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4" status: 200 len: 1463 microversion: 2.1 time: 0.299244 Oct 27 03:23:37.236353 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 426/878] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:36 2022] GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4 => generated 1463 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:23:37.258918 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c130325b-9d0f-4159-b1a5-2e689c6f9f77 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:37.259664 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c130325b-9d0f-4159-b1a5-2e689c6f9f77 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: b2ef080f-30ca-4dc5-ba03-9cf1899346a4] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:37.268253 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c130325b-9d0f-4159-b1a5-2e689c6f9f77 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:37.269877 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c130325b-9d0f-4159-b1a5-2e689c6f9f77 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:37.270627 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c130325b-9d0f-4159-b1a5-2e689c6f9f77 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:37.271960 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c130325b-9d0f-4159-b1a5-2e689c6f9f77 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:37.272514 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c130325b-9d0f-4159-b1a5-2e689c6f9f77 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:37.273008 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c130325b-9d0f-4159-b1a5-2e689c6f9f77 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:37.330267 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-91502ca8-995c-4e86-a345-bb4209401e1b tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:37.331005 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-91502ca8-995c-4e86-a345-bb4209401e1b tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] [instance: 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:37.336977 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-91502ca8-995c-4e86-a345-bb4209401e1b tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:37.337498 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-91502ca8-995c-4e86-a345-bb4209401e1b tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:37.337938 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-91502ca8-995c-4e86-a345-bb4209401e1b tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:37.338668 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-91502ca8-995c-4e86-a345-bb4209401e1b tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:37.339134 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-91502ca8-995c-4e86-a345-bb4209401e1b tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:37.339573 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-91502ca8-995c-4e86-a345-bb4209401e1b tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:37.446592 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-91502ca8-995c-4e86-a345-bb4209401e1b tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:37.458680 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-91502ca8-995c-4e86-a345-bb4209401e1b tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:37.474394 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-91502ca8-995c-4e86-a345-bb4209401e1b tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:37.481957 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-91502ca8-995c-4e86-a345-bb4209401e1b tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] 10.222.0.20 "GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503" status: 200 len: 1446 microversion: 2.75 time: 0.156014 Oct 27 03:23:37.483142 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 427/879] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:23:37 2022] GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503 => generated 1446 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:23:37.488789 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1af253ef-1d81-45d6-8f00-3e0aa7cd0d18 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:37.489590 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1af253ef-1d81-45d6-8f00-3e0aa7cd0d18 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: a52fed88-50f8-4dea-b83d-6878adccb024] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:37.492582 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c130325b-9d0f-4159-b1a5-2e689c6f9f77 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:37.496068 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1af253ef-1d81-45d6-8f00-3e0aa7cd0d18 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:37.496830 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1af253ef-1d81-45d6-8f00-3e0aa7cd0d18 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:37.497505 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1af253ef-1d81-45d6-8f00-3e0aa7cd0d18 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:37.499012 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1af253ef-1d81-45d6-8f00-3e0aa7cd0d18 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:37.500369 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1af253ef-1d81-45d6-8f00-3e0aa7cd0d18 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:37.501026 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1af253ef-1d81-45d6-8f00-3e0aa7cd0d18 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:37.512650 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c130325b-9d0f-4159-b1a5-2e689c6f9f77 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4" status: 200 len: 1463 microversion: 2.1 time: 0.257754 Oct 27 03:23:37.526091 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 453/880] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:37 2022] GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4 => generated 1463 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:37.526091 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-53dfa372-b4d1-406d-89d9-156a96a07db2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:37.526091 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-53dfa372-b4d1-406d-89d9-156a96a07db2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: a4abccf0-a093-4148-a260-40ab363b12f6] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:37.526091 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-53dfa372-b4d1-406d-89d9-156a96a07db2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:37.526518 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-53dfa372-b4d1-406d-89d9-156a96a07db2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:37.526596 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-53dfa372-b4d1-406d-89d9-156a96a07db2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:37.527300 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-53dfa372-b4d1-406d-89d9-156a96a07db2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:37.527765 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-53dfa372-b4d1-406d-89d9-156a96a07db2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:37.528328 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-53dfa372-b4d1-406d-89d9-156a96a07db2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:37.688428 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-53dfa372-b4d1-406d-89d9-156a96a07db2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:37.696420 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-53dfa372-b4d1-406d-89d9-156a96a07db2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/a4abccf0-a093-4148-a260-40ab363b12f6" status: 200 len: 1317 microversion: 2.1 time: 0.181900 Oct 27 03:23:37.697419 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 454/881] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:37 2022] GET /compute/v2.1/servers/a4abccf0-a093-4148-a260-40ab363b12f6 => generated 1317 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:37.702022 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ff9c0f8a-e2b7-417b-b44a-9bf1de3f02d5 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Action: 'create', calling method: .version_select at 0x7f7dda87e8b0>, body: {"keypair": {"name": "tempest-keypair-185634273", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAvK1QpV9hfB+XqKsE+POA0yKOflxrJOuUuDyuLEQnLx9XU4YRDhRpAXqqOlzdv7Qczb6pb4Okj1O7zq3QfYSQ0970ptYvgqt4D6HbGkWKFPRgRXvUMOoROUp4kkgdopaw=="}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:23:37.719012 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-ff9c0f8a-e2b7-417b-b44a-9bf1de3f02d5 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Getting quotas for project 48e708fb3bdd45bc976db7bd92af09c8. Resources: {'key_pairs'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:23:37.724709 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-ff9c0f8a-e2b7-417b-b44a-9bf1de3f02d5 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Getting quotas for user d3f1177e2cbd4ba6b659f8a714be86ac and project 48e708fb3bdd45bc976db7bd92af09c8. Resources: {'key_pairs'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:23:37.730022 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1af253ef-1d81-45d6-8f00-3e0aa7cd0d18 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:37.766323 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1af253ef-1d81-45d6-8f00-3e0aa7cd0d18 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/a52fed88-50f8-4dea-b83d-6878adccb024" status: 200 len: 1311 microversion: 2.1 time: 0.281330 Oct 27 03:23:37.766916 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 428/882] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:37 2022] GET /compute/v2.1/servers/a52fed88-50f8-4dea-b83d-6878adccb024 => generated 1311 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:37.893622 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ff9c0f8a-e2b7-417b-b44a-9bf1de3f02d5 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.195089 Oct 27 03:23:37.894328 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 455/883] 10.222.0.20 () {60 vars in 1159 bytes} [Thu Oct 27 03:23:37 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:23:37.933127 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e7dc1c23-dbb8-4d18-bbe2-8f26972fe321 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:37.934283 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e7dc1c23-dbb8-4d18-bbe2-8f26972fe321 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 87ad30f8-b432-45dc-82ff-aed508afddd7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:37.940606 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e7dc1c23-dbb8-4d18-bbe2-8f26972fe321 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:37.941320 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e7dc1c23-dbb8-4d18-bbe2-8f26972fe321 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:37.941945 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e7dc1c23-dbb8-4d18-bbe2-8f26972fe321 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:37.942824 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e7dc1c23-dbb8-4d18-bbe2-8f26972fe321 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:37.943468 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e7dc1c23-dbb8-4d18-bbe2-8f26972fe321 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:37.945762 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e7dc1c23-dbb8-4d18-bbe2-8f26972fe321 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:38.083772 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e7dc1c23-dbb8-4d18-bbe2-8f26972fe321 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:38.092269 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e7dc1c23-dbb8-4d18-bbe2-8f26972fe321 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:38.094314 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e7dc1c23-dbb8-4d18-bbe2-8f26972fe321 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:38.095431 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e7dc1c23-dbb8-4d18-bbe2-8f26972fe321 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/87ad30f8-b432-45dc-82ff-aed508afddd7" status: 200 len: 1362 microversion: 2.25 time: 0.167199 Oct 27 03:23:38.096697 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 429/884] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:23:37 2022] GET /compute/v2.1/servers/87ad30f8-b432-45dc-82ff-aed508afddd7 => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:23:38.106970 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-79737c31-7d81-4b71-9e47-8654fa528ca1 req-06a32dfd-2af4-4d64-83a5-181eb97065da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4abccf0-a093-4148-a260-40ab363b12f6", "tag": "69c8815d-cc5c-4226-a70c-449f3d54e905"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:23:38.117752 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-79737c31-7d81-4b71-9e47-8654fa528ca1 req-06a32dfd-2af4-4d64-83a5-181eb97065da service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:38.118272 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-79737c31-7d81-4b71-9e47-8654fa528ca1 req-06a32dfd-2af4-4d64-83a5-181eb97065da service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:38.118703 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-79737c31-7d81-4b71-9e47-8654fa528ca1 req-06a32dfd-2af4-4d64-83a5-181eb97065da service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:38.129782 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-79737c31-7d81-4b71-9e47-8654fa528ca1 req-06a32dfd-2af4-4d64-83a5-181eb97065da service nova] Creating event network-changed:69c8815d-cc5c-4226-a70c-449f3d54e905 for instance a4abccf0-a093-4148-a260-40ab363b12f6 on n-h1-862769-1 Oct 27 03:23:38.134786 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-79737c31-7d81-4b71-9e47-8654fa528ca1 req-06a32dfd-2af4-4d64-83a5-181eb97065da service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035528 Oct 27 03:23:38.135571 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 456/885] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:23:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:23:38.179353 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-632e559d-eee0-4fb9-af95-003f035a5d07 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:38.182222 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-632e559d-eee0-4fb9-af95-003f035a5d07 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:38.186821 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-632e559d-eee0-4fb9-af95-003f035a5d07 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:38.188426 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-632e559d-eee0-4fb9-af95-003f035a5d07 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:38.189104 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-632e559d-eee0-4fb9-af95-003f035a5d07 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:38.190095 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-632e559d-eee0-4fb9-af95-003f035a5d07 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:38.190774 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-632e559d-eee0-4fb9-af95-003f035a5d07 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:38.191424 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-632e559d-eee0-4fb9-af95-003f035a5d07 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:38.274650 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-632e559d-eee0-4fb9-af95-003f035a5d07 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:38.283967 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-632e559d-eee0-4fb9-af95-003f035a5d07 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:38.285452 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-632e559d-eee0-4fb9-af95-003f035a5d07 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:38.291541 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-632e559d-eee0-4fb9-af95-003f035a5d07 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1539 microversion: 2.91 time: 0.116501 Oct 27 03:23:38.292120 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 430/886] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:23:38 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1539 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:23:38.514490 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-55c5de21-a49f-46ac-8005-b05843f1f61e tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:38.515853 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-55c5de21-a49f-46ac-8005-b05843f1f61e tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] [instance: 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:38.522984 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-55c5de21-a49f-46ac-8005-b05843f1f61e tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:38.523813 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-55c5de21-a49f-46ac-8005-b05843f1f61e tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:38.524355 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-55c5de21-a49f-46ac-8005-b05843f1f61e tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:38.525284 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-55c5de21-a49f-46ac-8005-b05843f1f61e tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:38.526204 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-55c5de21-a49f-46ac-8005-b05843f1f61e tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:38.526982 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-55c5de21-a49f-46ac-8005-b05843f1f61e tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:38.645158 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-55c5de21-a49f-46ac-8005-b05843f1f61e tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:38.664628 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-55c5de21-a49f-46ac-8005-b05843f1f61e tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:38.666487 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-55c5de21-a49f-46ac-8005-b05843f1f61e tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:38.673284 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-55c5de21-a49f-46ac-8005-b05843f1f61e tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] 10.222.0.20 "GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503" status: 200 len: 1446 microversion: 2.75 time: 0.163660 Oct 27 03:23:38.680130 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 457/887] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:23:38 2022] GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503 => generated 1446 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:23:38.719074 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5b163e7d-38df-4718-96b9-4429ed4292c5 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:38.720532 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5b163e7d-38df-4718-96b9-4429ed4292c5 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: a4abccf0-a093-4148-a260-40ab363b12f6] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:38.727682 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5b163e7d-38df-4718-96b9-4429ed4292c5 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:38.728387 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5b163e7d-38df-4718-96b9-4429ed4292c5 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:38.728979 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5b163e7d-38df-4718-96b9-4429ed4292c5 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:38.729837 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5b163e7d-38df-4718-96b9-4429ed4292c5 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:38.730578 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5b163e7d-38df-4718-96b9-4429ed4292c5 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:38.731267 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5b163e7d-38df-4718-96b9-4429ed4292c5 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:38.790873 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b9a56e20-a1c1-48d8-b707-f27d769b6ab3 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:38.791734 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b9a56e20-a1c1-48d8-b707-f27d769b6ab3 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: a52fed88-50f8-4dea-b83d-6878adccb024] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:38.798923 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b9a56e20-a1c1-48d8-b707-f27d769b6ab3 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:38.799636 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b9a56e20-a1c1-48d8-b707-f27d769b6ab3 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:38.800270 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b9a56e20-a1c1-48d8-b707-f27d769b6ab3 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:38.801388 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b9a56e20-a1c1-48d8-b707-f27d769b6ab3 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:38.801987 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b9a56e20-a1c1-48d8-b707-f27d769b6ab3 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:38.802656 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b9a56e20-a1c1-48d8-b707-f27d769b6ab3 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:39.017635 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b9a56e20-a1c1-48d8-b707-f27d769b6ab3 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:39.026365 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b9a56e20-a1c1-48d8-b707-f27d769b6ab3 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/a52fed88-50f8-4dea-b83d-6878adccb024" status: 200 len: 1311 microversion: 2.1 time: 0.239188 Oct 27 03:23:39.027551 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 458/888] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:38 2022] GET /compute/v2.1/servers/a52fed88-50f8-4dea-b83d-6878adccb024 => generated 1311 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:23:39.105054 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5b163e7d-38df-4718-96b9-4429ed4292c5 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:39.122511 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-38a492d6-47c4-40a0-8c1a-a6ab6c9379e0 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:39.125707 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-38a492d6-47c4-40a0-8c1a-a6ab6c9379e0 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 87ad30f8-b432-45dc-82ff-aed508afddd7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:39.135964 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-38a492d6-47c4-40a0-8c1a-a6ab6c9379e0 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:39.136293 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5b163e7d-38df-4718-96b9-4429ed4292c5 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/a4abccf0-a093-4148-a260-40ab363b12f6" status: 200 len: 1317 microversion: 2.1 time: 0.416434 Oct 27 03:23:39.137152 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 431/889] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:38 2022] GET /compute/v2.1/servers/a4abccf0-a093-4148-a260-40ab363b12f6 => generated 1317 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:39.151301 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-38a492d6-47c4-40a0-8c1a-a6ab6c9379e0 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:39.151301 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-38a492d6-47c4-40a0-8c1a-a6ab6c9379e0 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:39.151301 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-38a492d6-47c4-40a0-8c1a-a6ab6c9379e0 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:39.151301 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-38a492d6-47c4-40a0-8c1a-a6ab6c9379e0 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:39.151778 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-38a492d6-47c4-40a0-8c1a-a6ab6c9379e0 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:39.320745 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0a65b568-4385-4dca-963c-a61e6b941e83 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:39.321485 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0a65b568-4385-4dca-963c-a61e6b941e83 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:39.323895 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=100 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:39.329293 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0a65b568-4385-4dca-963c-a61e6b941e83 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:39.329906 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0a65b568-4385-4dca-963c-a61e6b941e83 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:39.330643 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0a65b568-4385-4dca-963c-a61e6b941e83 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:39.331353 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0a65b568-4385-4dca-963c-a61e6b941e83 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:39.331982 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0a65b568-4385-4dca-963c-a61e6b941e83 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:39.339811 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0a65b568-4385-4dca-963c-a61e6b941e83 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:39.339917 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-38a492d6-47c4-40a0-8c1a-a6ab6c9379e0 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:39.346000 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-38a492d6-47c4-40a0-8c1a-a6ab6c9379e0 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:39.347523 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-38a492d6-47c4-40a0-8c1a-a6ab6c9379e0 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:39.348773 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-38a492d6-47c4-40a0-8c1a-a6ab6c9379e0 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/87ad30f8-b432-45dc-82ff-aed508afddd7" status: 200 len: 1559 microversion: 2.25 time: 0.230943 Oct 27 03:23:39.349529 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 459/890] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:23:39 2022] GET /compute/v2.1/servers/87ad30f8-b432-45dc-82ff-aed508afddd7 => generated 1559 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:23:39.437894 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0a65b568-4385-4dca-963c-a61e6b941e83 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:39.452141 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0a65b568-4385-4dca-963c-a61e6b941e83 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:39.454283 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0a65b568-4385-4dca-963c-a61e6b941e83 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:39.464209 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0a65b568-4385-4dca-963c-a61e6b941e83 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1539 microversion: 2.91 time: 0.147378 Oct 27 03:23:39.471761 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 432/891] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:23:39 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1539 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:23:39.633989 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8bdd90bf-8f24-4a45-9279-1bb7c7abd083 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:39.639494 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8bdd90bf-8f24-4a45-9279-1bb7c7abd083 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] [instance: 87ad30f8-b432-45dc-82ff-aed508afddd7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:39.641983 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8bdd90bf-8f24-4a45-9279-1bb7c7abd083 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:39.642906 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8bdd90bf-8f24-4a45-9279-1bb7c7abd083 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:39.643508 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8bdd90bf-8f24-4a45-9279-1bb7c7abd083 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:39.644241 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8bdd90bf-8f24-4a45-9279-1bb7c7abd083 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:39.644693 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8bdd90bf-8f24-4a45-9279-1bb7c7abd083 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:39.645122 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8bdd90bf-8f24-4a45-9279-1bb7c7abd083 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:39.704271 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5a5b9283-6933-411d-af9b-c7caf6090725 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:39.705958 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5a5b9283-6933-411d-af9b-c7caf6090725 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] [instance: 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:39.715780 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5a5b9283-6933-411d-af9b-c7caf6090725 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:39.716730 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5a5b9283-6933-411d-af9b-c7caf6090725 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:39.717557 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5a5b9283-6933-411d-af9b-c7caf6090725 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:39.718573 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5a5b9283-6933-411d-af9b-c7caf6090725 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:39.718962 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5a5b9283-6933-411d-af9b-c7caf6090725 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:39.719560 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5a5b9283-6933-411d-af9b-c7caf6090725 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:39.886409 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-8bdd90bf-8f24-4a45-9279-1bb7c7abd083 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lazy-loading 'services' on Instance uuid 87ad30f8-b432-45dc-82ff-aed508afddd7 {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:23:39.907218 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8bdd90bf-8f24-4a45-9279-1bb7c7abd083 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/87ad30f8-b432-45dc-82ff-aed508afddd7" status: 200 len: 2052 microversion: 2.25 time: 0.529798 Oct 27 03:23:39.907956 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 460/892] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:23:39 2022] GET /compute/v2.1/servers/87ad30f8-b432-45dc-82ff-aed508afddd7 => generated 2052 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:23:39.942090 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a53ca65f-b5a6-4822-b01d-e0a8557b386a tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:39.943110 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a53ca65f-b5a6-4822-b01d-e0a8557b386a tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] [instance: 87ad30f8-b432-45dc-82ff-aed508afddd7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:39.949996 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a53ca65f-b5a6-4822-b01d-e0a8557b386a tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:39.950511 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a53ca65f-b5a6-4822-b01d-e0a8557b386a tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:39.950950 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a53ca65f-b5a6-4822-b01d-e0a8557b386a tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:39.951863 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a53ca65f-b5a6-4822-b01d-e0a8557b386a tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:39.952839 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a53ca65f-b5a6-4822-b01d-e0a8557b386a tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:39.953432 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a53ca65f-b5a6-4822-b01d-e0a8557b386a tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:39.959700 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5a5b9283-6933-411d-af9b-c7caf6090725 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:39.988626 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5a5b9283-6933-411d-af9b-c7caf6090725 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:39.990847 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5a5b9283-6933-411d-af9b-c7caf6090725 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:39.997232 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5a5b9283-6933-411d-af9b-c7caf6090725 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] 10.222.0.20 "GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503" status: 200 len: 1446 microversion: 2.75 time: 0.297760 Oct 27 03:23:40.002122 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 433/893] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:23:39 2022] GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503 => generated 1446 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:23:40.051359 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d9b79ad0-c6e5-4d1b-a9dc-4a4f14d42d55 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:40.051980 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d9b79ad0-c6e5-4d1b-a9dc-4a4f14d42d55 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: a52fed88-50f8-4dea-b83d-6878adccb024] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:40.058575 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d9b79ad0-c6e5-4d1b-a9dc-4a4f14d42d55 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:40.059319 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d9b79ad0-c6e5-4d1b-a9dc-4a4f14d42d55 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:40.059764 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d9b79ad0-c6e5-4d1b-a9dc-4a4f14d42d55 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:40.060518 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d9b79ad0-c6e5-4d1b-a9dc-4a4f14d42d55 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:40.060972 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d9b79ad0-c6e5-4d1b-a9dc-4a4f14d42d55 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:40.061583 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d9b79ad0-c6e5-4d1b-a9dc-4a4f14d42d55 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:40.160334 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-a53ca65f-b5a6-4822-b01d-e0a8557b386a tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lazy-loading 'services' on Instance uuid 87ad30f8-b432-45dc-82ff-aed508afddd7 {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:23:40.192927 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a53ca65f-b5a6-4822-b01d-e0a8557b386a tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/87ad30f8-b432-45dc-82ff-aed508afddd7" status: 200 len: 2052 microversion: 2.25 time: 0.250642 Oct 27 03:23:40.197590 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 461/894] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:23:39 2022] GET /compute/v2.1/servers/87ad30f8-b432-45dc-82ff-aed508afddd7 => generated 2052 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:23:40.214159 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7780743a-29bb-4a62-a101-cdfeaff25786 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:40.214866 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7780743a-29bb-4a62-a101-cdfeaff25786 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: a4abccf0-a093-4148-a260-40ab363b12f6] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:40.224401 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7780743a-29bb-4a62-a101-cdfeaff25786 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:40.224992 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7780743a-29bb-4a62-a101-cdfeaff25786 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:40.225753 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7780743a-29bb-4a62-a101-cdfeaff25786 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:40.226553 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7780743a-29bb-4a62-a101-cdfeaff25786 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:40.227102 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7780743a-29bb-4a62-a101-cdfeaff25786 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:40.227609 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7780743a-29bb-4a62-a101-cdfeaff25786 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:40.304334 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d9b79ad0-c6e5-4d1b-a9dc-4a4f14d42d55 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:40.312959 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d9b79ad0-c6e5-4d1b-a9dc-4a4f14d42d55 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/a52fed88-50f8-4dea-b83d-6878adccb024" status: 200 len: 1311 microversion: 2.1 time: 0.267962 Oct 27 03:23:40.314086 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 434/895] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:40 2022] GET /compute/v2.1/servers/a52fed88-50f8-4dea-b83d-6878adccb024 => generated 1311 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:23:40.345186 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5195ad98-9339-425c-a59b-1c64e2bd5944 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:40.356165 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5195ad98-9339-425c-a59b-1c64e2bd5944 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:40.357916 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5195ad98-9339-425c-a59b-1c64e2bd5944 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:40.359959 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5195ad98-9339-425c-a59b-1c64e2bd5944 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:40.361001 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5195ad98-9339-425c-a59b-1c64e2bd5944 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:40.362655 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5195ad98-9339-425c-a59b-1c64e2bd5944 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:40.364293 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5195ad98-9339-425c-a59b-1c64e2bd5944 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:40.416132 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5195ad98-9339-425c-a59b-1c64e2bd5944 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.100626 Oct 27 03:23:40.416932 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 435/896] 10.222.0.20 () {60 vars in 1217 bytes} [Thu Oct 27 03:23:40 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 03:23:40.431621 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4e7033d8-a9b0-4388-83cf-d0b4fac13bb2 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-862769-1", "block_migration": "auto"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:23:40.433912 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4e7033d8-a9b0-4388-83cf-d0b4fac13bb2 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] [instance: 87ad30f8-b432-45dc-82ff-aed508afddd7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:40.441909 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4e7033d8-a9b0-4388-83cf-d0b4fac13bb2 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:40.442461 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4e7033d8-a9b0-4388-83cf-d0b4fac13bb2 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:40.442908 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4e7033d8-a9b0-4388-83cf-d0b4fac13bb2 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:40.443640 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4e7033d8-a9b0-4388-83cf-d0b4fac13bb2 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:40.444232 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4e7033d8-a9b0-4388-83cf-d0b4fac13bb2 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:40.444679 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4e7033d8-a9b0-4388-83cf-d0b4fac13bb2 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:40.477847 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7780743a-29bb-4a62-a101-cdfeaff25786 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:40.494385 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7780743a-29bb-4a62-a101-cdfeaff25786 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/a4abccf0-a093-4148-a260-40ab363b12f6" status: 200 len: 1317 microversion: 2.1 time: 0.296694 Oct 27 03:23:40.495310 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 462/897] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:40 2022] GET /compute/v2.1/servers/a4abccf0-a093-4148-a260-40ab363b12f6 => generated 1317 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:40.498595 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-4e7033d8-a9b0-4388-83cf-d0b4fac13bb2 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lazy-loading 'flavor' on Instance uuid 87ad30f8-b432-45dc-82ff-aed508afddd7 {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:23:40.500909 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-762f1491-3702-4bcf-86e8-76fcd0f4b786 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:40.503455 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-762f1491-3702-4bcf-86e8-76fcd0f4b786 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:40.511048 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-762f1491-3702-4bcf-86e8-76fcd0f4b786 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:40.511712 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-762f1491-3702-4bcf-86e8-76fcd0f4b786 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:40.512244 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-762f1491-3702-4bcf-86e8-76fcd0f4b786 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:40.513087 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-762f1491-3702-4bcf-86e8-76fcd0f4b786 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:40.513672 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-762f1491-3702-4bcf-86e8-76fcd0f4b786 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:40.514265 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-762f1491-3702-4bcf-86e8-76fcd0f4b786 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:40.528040 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4e7033d8-a9b0-4388-83cf-d0b4fac13bb2 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] [instance: 87ad30f8-b432-45dc-82ff-aed508afddd7] Going to try to live migrate instance to n-h1-862769-1 {{(pid=121001) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 27 03:23:40.607436 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-762f1491-3702-4bcf-86e8-76fcd0f4b786 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:40.617535 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-762f1491-3702-4bcf-86e8-76fcd0f4b786 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:40.619045 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-762f1491-3702-4bcf-86e8-76fcd0f4b786 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:40.625724 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-762f1491-3702-4bcf-86e8-76fcd0f4b786 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1560 microversion: 2.91 time: 0.128993 Oct 27 03:23:40.634124 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 463/898] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:23:40 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1560 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:23:40.862614 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-4b74ce31-747b-430b-82b6-fcf27d567092 req-6014b8b6-52d5-4228-b0e0-c9d384b27f4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a52fed88-50f8-4dea-b83d-6878adccb024", "name": "network-vif-plugged", "status": "completed", "tag": "7caf6b22-42ec-4a60-b619-9a8f7eecc633"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:23:40.872729 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-4b74ce31-747b-430b-82b6-fcf27d567092 req-6014b8b6-52d5-4228-b0e0-c9d384b27f4b service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:40.873448 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-4b74ce31-747b-430b-82b6-fcf27d567092 req-6014b8b6-52d5-4228-b0e0-c9d384b27f4b service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:40.874099 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-4b74ce31-747b-430b-82b6-fcf27d567092 req-6014b8b6-52d5-4228-b0e0-c9d384b27f4b service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:40.886212 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-4b74ce31-747b-430b-82b6-fcf27d567092 req-6014b8b6-52d5-4228-b0e0-c9d384b27f4b service nova] Creating event network-vif-plugged:7caf6b22-42ec-4a60-b619-9a8f7eecc633 for instance a52fed88-50f8-4dea-b83d-6878adccb024 on n-h2-862769-1 Oct 27 03:23:40.893190 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-4b74ce31-747b-430b-82b6-fcf27d567092 req-6014b8b6-52d5-4228-b0e0-c9d384b27f4b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034243 Oct 27 03:23:40.894272 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 464/899] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:23:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:23:41.026965 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a981a363-a6c6-4b07-827d-0e30bb398230 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:41.028122 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a981a363-a6c6-4b07-827d-0e30bb398230 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] [instance: 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:41.030506 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:41.039537 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a981a363-a6c6-4b07-827d-0e30bb398230 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:41.043409 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a981a363-a6c6-4b07-827d-0e30bb398230 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:41.048807 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a981a363-a6c6-4b07-827d-0e30bb398230 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:41.049878 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a981a363-a6c6-4b07-827d-0e30bb398230 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:41.050600 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a981a363-a6c6-4b07-827d-0e30bb398230 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:41.051321 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a981a363-a6c6-4b07-827d-0e30bb398230 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:41.142173 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a981a363-a6c6-4b07-827d-0e30bb398230 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:41.160183 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a981a363-a6c6-4b07-827d-0e30bb398230 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:41.162099 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a981a363-a6c6-4b07-827d-0e30bb398230 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:41.172147 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a981a363-a6c6-4b07-827d-0e30bb398230 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] 10.222.0.20 "GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503" status: 200 len: 1446 microversion: 2.75 time: 0.149995 Oct 27 03:23:41.187990 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 465/900] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:23:41 2022] GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503 => generated 1446 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:23:41.205103 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-89b9b75b-bfc0-4472-a196-a628c67949cf tempest-MigrationsAdminTest-707106630 tempest-MigrationsAdminTest-707106630-project-admin] Calling method '.version_select at 0x7f7dda923700>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:41.208678 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-89b9b75b-bfc0-4472-a196-a628c67949cf tempest-MigrationsAdminTest-707106630 tempest-MigrationsAdminTest-707106630-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:41.209172 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-89b9b75b-bfc0-4472-a196-a628c67949cf tempest-MigrationsAdminTest-707106630 tempest-MigrationsAdminTest-707106630-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:41.209616 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-89b9b75b-bfc0-4472-a196-a628c67949cf tempest-MigrationsAdminTest-707106630 tempest-MigrationsAdminTest-707106630-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:41.221068 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-89b9b75b-bfc0-4472-a196-a628c67949cf tempest-MigrationsAdminTest-707106630 tempest-MigrationsAdminTest-707106630-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 1523 microversion: 2.1 time: 0.031782 Oct 27 03:23:41.221467 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 466/901] 10.222.0.20 () {58 vars in 1143 bytes} [Thu Oct 27 03:23:41 2022] GET /compute/v2.1/os-migrations => generated 1523 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:41.251048 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b6e33c0c-1218-4235-a0ac-c22550c95325 tempest-MigrationsAdminTest-707106630 tempest-MigrationsAdminTest-707106630-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:41.259406 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b6e33c0c-1218-4235-a0ac-c22550c95325 tempest-MigrationsAdminTest-707106630 tempest-MigrationsAdminTest-707106630-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012597 Oct 27 03:23:41.260254 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 467/902] 10.222.0.20 () {58 vars in 1137 bytes} [Thu Oct 27 03:23:41 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:23:41.272664 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d4afc17d-b9e8-4be5-8872-8b883e97f622 tempest-MigrationsAdminTest-707106630 tempest-MigrationsAdminTest-707106630-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-8399933", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:23:41.338790 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d4afc17d-b9e8-4be5-8872-8b883e97f622 tempest-MigrationsAdminTest-707106630 tempest-MigrationsAdminTest-707106630-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 496 microversion: 2.1 time: 0.070194 Oct 27 03:23:41.340092 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 468/903] 10.222.0.20 () {60 vars in 1146 bytes} [Thu Oct 27 03:23:41 2022] POST /compute/v2.1/flavors => generated 496 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:23:41.346987 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5e805afc-add4-429e-86c4-2f42f005b6e7 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:41.347863 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5e805afc-add4-429e-86c4-2f42f005b6e7 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: a52fed88-50f8-4dea-b83d-6878adccb024] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:41.354351 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5e805afc-add4-429e-86c4-2f42f005b6e7 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:41.355143 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5e805afc-add4-429e-86c4-2f42f005b6e7 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:41.355808 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5e805afc-add4-429e-86c4-2f42f005b6e7 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:41.356606 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5e805afc-add4-429e-86c4-2f42f005b6e7 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:41.357170 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5e805afc-add4-429e-86c4-2f42f005b6e7 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:41.357675 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5e805afc-add4-429e-86c4-2f42f005b6e7 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:41.521559 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5e805afc-add4-429e-86c4-2f42f005b6e7 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:41.532068 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5e805afc-add4-429e-86c4-2f42f005b6e7 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/a52fed88-50f8-4dea-b83d-6878adccb024" status: 200 len: 1311 microversion: 2.1 time: 0.190056 Oct 27 03:23:41.534797 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 469/904] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:41 2022] GET /compute/v2.1/servers/a52fed88-50f8-4dea-b83d-6878adccb024 => generated 1311 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:41.548854 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-fff9f8f4-5738-4ffd-baae-cfba2b1d4cea tempest-MigrationsAdminTest-707106630 tempest-MigrationsAdminTest-707106630-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:41.564273 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-fff9f8f4-5738-4ffd-baae-cfba2b1d4cea tempest-MigrationsAdminTest-707106630 tempest-MigrationsAdminTest-707106630-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.027153 Oct 27 03:23:41.565035 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 470/905] 10.222.0.20 () {58 vars in 1182 bytes} [Thu Oct 27 03:23:41 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 03:23:41.569888 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-baeb7bac-fbad-4a86-99ff-0757cd11f56d tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:41.570730 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-baeb7bac-fbad-4a86-99ff-0757cd11f56d tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: a4abccf0-a093-4148-a260-40ab363b12f6] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:41.587599 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-baeb7bac-fbad-4a86-99ff-0757cd11f56d tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:41.588114 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-baeb7bac-fbad-4a86-99ff-0757cd11f56d tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:41.588555 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-baeb7bac-fbad-4a86-99ff-0757cd11f56d tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:41.589305 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-baeb7bac-fbad-4a86-99ff-0757cd11f56d tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:41.591084 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-baeb7bac-fbad-4a86-99ff-0757cd11f56d tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:41.591506 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-baeb7bac-fbad-4a86-99ff-0757cd11f56d tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:41.607096 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=100 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:41.770513 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-baeb7bac-fbad-4a86-99ff-0757cd11f56d tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:41.778722 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-baeb7bac-fbad-4a86-99ff-0757cd11f56d tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/a4abccf0-a093-4148-a260-40ab363b12f6" status: 200 len: 1317 microversion: 2.1 time: 0.212369 Oct 27 03:23:41.779505 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 471/906] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:41 2022] GET /compute/v2.1/servers/a4abccf0-a093-4148-a260-40ab363b12f6 => generated 1317 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:41.784788 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8b20eb10-8fd5-4b0e-8569-278bd7981024 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:41.785674 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8b20eb10-8fd5-4b0e-8569-278bd7981024 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:41.795020 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8b20eb10-8fd5-4b0e-8569-278bd7981024 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:41.795508 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8b20eb10-8fd5-4b0e-8569-278bd7981024 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:41.795976 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8b20eb10-8fd5-4b0e-8569-278bd7981024 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:41.800473 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8b20eb10-8fd5-4b0e-8569-278bd7981024 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:41.800473 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8b20eb10-8fd5-4b0e-8569-278bd7981024 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:41.800473 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8b20eb10-8fd5-4b0e-8569-278bd7981024 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:41.895196 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8b20eb10-8fd5-4b0e-8569-278bd7981024 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:41.904989 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8b20eb10-8fd5-4b0e-8569-278bd7981024 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:41.907031 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8b20eb10-8fd5-4b0e-8569-278bd7981024 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:41.912331 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8b20eb10-8fd5-4b0e-8569-278bd7981024 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1560 microversion: 2.91 time: 0.131390 Oct 27 03:23:41.912924 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 472/907] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:23:41 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1560 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:23:41.919370 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e457cc6e-fbd9-4c77-94c4-7e0019b7b0f1 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1376489223", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "373ee9d3-42fb-4650-9a9e-1bc4c5ae3e0a"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:23:41.979076 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-e457cc6e-fbd9-4c77-94c4-7e0019b7b0f1 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] validate_networks() for None {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:23:42.220273 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-e457cc6e-fbd9-4c77-94c4-7e0019b7b0f1 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:23:42.220943 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-e457cc6e-fbd9-4c77-94c4-7e0019b7b0f1 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:23:42.221174 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-e457cc6e-fbd9-4c77-94c4-7e0019b7b0f1 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:23:42.221880 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-e457cc6e-fbd9-4c77-94c4-7e0019b7b0f1 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:23:42.222086 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-e457cc6e-fbd9-4c77-94c4-7e0019b7b0f1 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:23:42.229254 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=70 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:42.231913 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e457cc6e-fbd9-4c77-94c4-7e0019b7b0f1 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:42.232405 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e457cc6e-fbd9-4c77-94c4-7e0019b7b0f1 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:42.232854 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e457cc6e-fbd9-4c77-94c4-7e0019b7b0f1 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:42.233693 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e457cc6e-fbd9-4c77-94c4-7e0019b7b0f1 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:42.234112 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e457cc6e-fbd9-4c77-94c4-7e0019b7b0f1 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:42.234545 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e457cc6e-fbd9-4c77-94c4-7e0019b7b0f1 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:42.253907 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-e457cc6e-fbd9-4c77-94c4-7e0019b7b0f1 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Getting quotas for project 48e708fb3bdd45bc976db7bd92af09c8. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:23:42.259845 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-e457cc6e-fbd9-4c77-94c4-7e0019b7b0f1 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Getting quotas for user d3f1177e2cbd4ba6b659f8a714be86ac and project 48e708fb3bdd45bc976db7bd92af09c8. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:23:42.273842 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e457cc6e-fbd9-4c77-94c4-7e0019b7b0f1 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:23:42.276239 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e457cc6e-fbd9-4c77-94c4-7e0019b7b0f1 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 77dd3d48-fede-491a-b6ce-5ad36a1d7cab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:23:42.421887 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e457cc6e-fbd9-4c77-94c4-7e0019b7b0f1 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.507437 Oct 27 03:23:42.422902 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 473/908] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:23:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 509 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 03:23:42.427505 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6c599ebd-abd0-43f1-b2cd-a0a607e53362 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:42.428096 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6c599ebd-abd0-43f1-b2cd-a0a607e53362 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] [instance: 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:42.435059 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6c599ebd-abd0-43f1-b2cd-a0a607e53362 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:42.435572 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6c599ebd-abd0-43f1-b2cd-a0a607e53362 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:42.440540 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6c599ebd-abd0-43f1-b2cd-a0a607e53362 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:42.440540 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6c599ebd-abd0-43f1-b2cd-a0a607e53362 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:42.440540 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6c599ebd-abd0-43f1-b2cd-a0a607e53362 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:42.440540 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6c599ebd-abd0-43f1-b2cd-a0a607e53362 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:42.596309 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-6c599ebd-abd0-43f1-b2cd-a0a607e53362 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:42.607694 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-6c599ebd-abd0-43f1-b2cd-a0a607e53362 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:42.609542 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-6c599ebd-abd0-43f1-b2cd-a0a607e53362 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:42.617190 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6c599ebd-abd0-43f1-b2cd-a0a607e53362 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] 10.222.0.20 "GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503" status: 200 len: 1446 microversion: 2.75 time: 0.193106 Oct 27 03:23:42.623153 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 474/909] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:23:42 2022] GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503 => generated 1446 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:23:42.634640 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3c5123ee-4f06-4dc6-a580-5c03372db877 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:42.636763 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-3c5123ee-4f06-4dc6-a580-5c03372db877 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 77dd3d48-fede-491a-b6ce-5ad36a1d7cab] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:42.763569 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-3c5123ee-4f06-4dc6-a580-5c03372db877 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:42.772710 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3c5123ee-4f06-4dc6-a580-5c03372db877 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab" status: 200 len: 1279 microversion: 2.1 time: 0.148282 Oct 27 03:23:42.778252 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 475/910] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:42 2022] GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab => generated 1279 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:42.805301 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-fa3d32c3-e24d-4bce-ba4d-a19a3a848084 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:42.805976 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-fa3d32c3-e24d-4bce-ba4d-a19a3a848084 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: a52fed88-50f8-4dea-b83d-6878adccb024] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:42.822623 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fa3d32c3-e24d-4bce-ba4d-a19a3a848084 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:42.823222 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fa3d32c3-e24d-4bce-ba4d-a19a3a848084 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:42.823725 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fa3d32c3-e24d-4bce-ba4d-a19a3a848084 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:42.826412 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fa3d32c3-e24d-4bce-ba4d-a19a3a848084 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:42.827345 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fa3d32c3-e24d-4bce-ba4d-a19a3a848084 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:42.829191 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fa3d32c3-e24d-4bce-ba4d-a19a3a848084 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:43.006553 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=12 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:43.100480 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-fa3d32c3-e24d-4bce-ba4d-a19a3a848084 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:43.112444 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-fa3d32c3-e24d-4bce-ba4d-a19a3a848084 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/a52fed88-50f8-4dea-b83d-6878adccb024" status: 200 len: 1495 microversion: 2.1 time: 0.318666 Oct 27 03:23:43.114028 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 476/911] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:42 2022] GET /compute/v2.1/servers/a52fed88-50f8-4dea-b83d-6878adccb024 => generated 1495 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:43.130568 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7697a68b-355b-4fc8-bcfb-92f9808b5b7a tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:43.131387 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7697a68b-355b-4fc8-bcfb-92f9808b5b7a tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: a4abccf0-a093-4148-a260-40ab363b12f6] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:43.150346 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7697a68b-355b-4fc8-bcfb-92f9808b5b7a tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:43.150346 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7697a68b-355b-4fc8-bcfb-92f9808b5b7a tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:43.150346 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7697a68b-355b-4fc8-bcfb-92f9808b5b7a tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:43.150346 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7697a68b-355b-4fc8-bcfb-92f9808b5b7a tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:43.150627 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7697a68b-355b-4fc8-bcfb-92f9808b5b7a tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:43.150627 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7697a68b-355b-4fc8-bcfb-92f9808b5b7a tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:43.356101 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7697a68b-355b-4fc8-bcfb-92f9808b5b7a tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:43.367008 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7697a68b-355b-4fc8-bcfb-92f9808b5b7a tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/a4abccf0-a093-4148-a260-40ab363b12f6" status: 200 len: 1317 microversion: 2.1 time: 0.251531 Oct 27 03:23:43.378130 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 477/912] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:43 2022] GET /compute/v2.1/servers/a4abccf0-a093-4148-a260-40ab363b12f6 => generated 1317 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:43.378130 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-becb96b1-f973-41f0-96ef-066d6df7161a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:43.378130 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-becb96b1-f973-41f0-96ef-066d6df7161a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:43.386332 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-becb96b1-f973-41f0-96ef-066d6df7161a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:43.386332 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-becb96b1-f973-41f0-96ef-066d6df7161a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:43.386332 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-becb96b1-f973-41f0-96ef-066d6df7161a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:43.386332 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-becb96b1-f973-41f0-96ef-066d6df7161a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:43.387113 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-becb96b1-f973-41f0-96ef-066d6df7161a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:43.387113 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-becb96b1-f973-41f0-96ef-066d6df7161a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:43.544726 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-becb96b1-f973-41f0-96ef-066d6df7161a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:43.557918 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-becb96b1-f973-41f0-96ef-066d6df7161a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:43.560254 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-becb96b1-f973-41f0-96ef-066d6df7161a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:43.566290 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-becb96b1-f973-41f0-96ef-066d6df7161a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1555 microversion: 2.91 time: 0.197015 Oct 27 03:23:43.571352 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 478/913] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:23:43 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1555 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:23:43.588700 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-67980048-0137-41b2-aaa5-850d31fe9695 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:43.589222 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-67980048-0137-41b2-aaa5-850d31fe9695 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] [instance: 2d4fe59a-b31c-4fc0-8994-eb21e313d18a] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:43.602606 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-67980048-0137-41b2-aaa5-850d31fe9695 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:43.603294 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-67980048-0137-41b2-aaa5-850d31fe9695 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:43.603746 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-67980048-0137-41b2-aaa5-850d31fe9695 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:43.604474 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-67980048-0137-41b2-aaa5-850d31fe9695 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:43.605088 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-67980048-0137-41b2-aaa5-850d31fe9695 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:43.605567 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-67980048-0137-41b2-aaa5-850d31fe9695 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:43.659411 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-67980048-0137-41b2-aaa5-850d31fe9695 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] [instance: 2d4fe59a-b31c-4fc0-8994-eb21e313d18a] Going to try to terminate instance {{(pid=121000) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:23:44.049789 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-67980048-0137-41b2-aaa5-850d31fe9695 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2d4fe59a-b31c-4fc0-8994-eb21e313d18a" status: 204 len: 0 microversion: 2.1 time: 0.476574 Oct 27 03:23:44.051050 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 479/914] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:23:43 2022] DELETE /compute/v2.1/servers/2d4fe59a-b31c-4fc0-8994-eb21e313d18a => generated 0 bytes in 479 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:23:44.057241 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-51220c7d-1a72-4609-be4e-cd1cb2c0f04a tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:44.058301 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-51220c7d-1a72-4609-be4e-cd1cb2c0f04a tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] [instance: a52fed88-50f8-4dea-b83d-6878adccb024] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:44.066460 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-51220c7d-1a72-4609-be4e-cd1cb2c0f04a tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:44.067154 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-51220c7d-1a72-4609-be4e-cd1cb2c0f04a tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:44.067794 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-51220c7d-1a72-4609-be4e-cd1cb2c0f04a tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:44.068789 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-51220c7d-1a72-4609-be4e-cd1cb2c0f04a tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:44.069673 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-51220c7d-1a72-4609-be4e-cd1cb2c0f04a tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:44.070468 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-51220c7d-1a72-4609-be4e-cd1cb2c0f04a tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:44.303638 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-51220c7d-1a72-4609-be4e-cd1cb2c0f04a tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/a52fed88-50f8-4dea-b83d-6878adccb024" status: 200 len: 1646 microversion: 2.1 time: 0.250709 Oct 27 03:23:44.304556 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 480/915] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:44 2022] GET /compute/v2.1/servers/a52fed88-50f8-4dea-b83d-6878adccb024 => generated 1646 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:44.312117 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-bfc8a612-6ab4-47de-9640-db1b1c64c71b tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:44.313505 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-bfc8a612-6ab4-47de-9640-db1b1c64c71b tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] [instance: 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:44.320428 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bfc8a612-6ab4-47de-9640-db1b1c64c71b tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:44.320930 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bfc8a612-6ab4-47de-9640-db1b1c64c71b tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:44.321372 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bfc8a612-6ab4-47de-9640-db1b1c64c71b tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:44.322209 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bfc8a612-6ab4-47de-9640-db1b1c64c71b tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:44.322701 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bfc8a612-6ab4-47de-9640-db1b1c64c71b tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:44.323066 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bfc8a612-6ab4-47de-9640-db1b1c64c71b tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:44.429148 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-bfc8a612-6ab4-47de-9640-db1b1c64c71b tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:44.438439 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4e7033d8-a9b0-4388-83cf-d0b4fac13bb2 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/87ad30f8-b432-45dc-82ff-aed508afddd7/action" status: 202 len: 0 microversion: 2.25 time: 4.009627 Oct 27 03:23:44.440487 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 436/916] 10.222.0.20 () {62 vars in 1319 bytes} [Thu Oct 27 03:23:40 2022] POST /compute/v2.1/servers/87ad30f8-b432-45dc-82ff-aed508afddd7/action => generated 0 bytes in 4014 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:23:44.441586 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-bfc8a612-6ab4-47de-9640-db1b1c64c71b tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:44.443391 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-bfc8a612-6ab4-47de-9640-db1b1c64c71b tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:44.447617 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f9f759b4-228e-484e-a787-f05b0f97d9ab tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:44.449464 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-bfc8a612-6ab4-47de-9640-db1b1c64c71b tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] 10.222.0.20 "GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503" status: 200 len: 1446 microversion: 2.75 time: 0.143604 Oct 27 03:23:44.449775 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f9f759b4-228e-484e-a787-f05b0f97d9ab tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 77dd3d48-fede-491a-b6ce-5ad36a1d7cab] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:44.451088 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 481/917] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:23:44 2022] GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503 => generated 1446 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:23:44.456606 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3a3b4e30-6245-4608-bac3-de81d04175a2 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-603653237", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "719476185", "adminPass": "***", "networks": [{"uuid": "752da8de-f675-4935-b6b0-82279e0cd445"}], "security_groups": [{"name": "tempest-securitygroup--1058824952"}], "key_name": "tempest-keypair-831517697", "user_data": "}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:23:44.462508 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f9f759b4-228e-484e-a787-f05b0f97d9ab tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:44.463263 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f9f759b4-228e-484e-a787-f05b0f97d9ab tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:44.463977 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f9f759b4-228e-484e-a787-f05b0f97d9ab tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:44.465027 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f9f759b4-228e-484e-a787-f05b0f97d9ab tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:44.465910 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f9f759b4-228e-484e-a787-f05b0f97d9ab tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:44.466582 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f9f759b4-228e-484e-a787-f05b0f97d9ab tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:44.564429 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f9f759b4-228e-484e-a787-f05b0f97d9ab tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:44.576989 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f9f759b4-228e-484e-a787-f05b0f97d9ab tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab" status: 200 len: 1283 microversion: 2.1 time: 0.135215 Oct 27 03:23:44.577735 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 437/918] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:44 2022] GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab => generated 1283 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:44.661591 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a2b3a03b-5a67-4570-93f0-e2226096faa3 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1444319739", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": [{"uuid": "a487df35-1b16-4301-a7dc-3642f0ac024b"}]}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:23:44.673713 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-3a3b4e30-6245-4608-bac3-de81d04175a2 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] validate_networks() for [('752da8de-f675-4935-b6b0-82279e0cd445', None, None, None, None, None)] {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:23:44.756650 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.network.neutron [None req-a2b3a03b-5a67-4570-93f0-e2226096faa3 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] validate_networks() for [('a487df35-1b16-4301-a7dc-3642f0ac024b', None, None, None, None, None)] {{(pid=121001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:23:45.416562 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-a2b3a03b-5a67-4570-93f0-e2226096faa3 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Flavor limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:23:45.419911 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-a2b3a03b-5a67-4570-93f0-e2226096faa3 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Image limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:23:45.423808 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-a2b3a03b-5a67-4570-93f0-e2226096faa3 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Flavor pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:23:45.424513 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-a2b3a03b-5a67-4570-93f0-e2226096faa3 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Image pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:23:45.427075 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-a2b3a03b-5a67-4570-93f0-e2226096faa3 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:23:45.438723 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a2b3a03b-5a67-4570-93f0-e2226096faa3 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:45.441113 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a2b3a03b-5a67-4570-93f0-e2226096faa3 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:45.441902 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a2b3a03b-5a67-4570-93f0-e2226096faa3 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:45.443495 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a2b3a03b-5a67-4570-93f0-e2226096faa3 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:45.444173 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a2b3a03b-5a67-4570-93f0-e2226096faa3 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:45.444751 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a2b3a03b-5a67-4570-93f0-e2226096faa3 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:45.484780 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-a2b3a03b-5a67-4570-93f0-e2226096faa3 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Getting quotas for project ae78c307a1504172828e668f915a3677. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:23:45.491071 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-a2b3a03b-5a67-4570-93f0-e2226096faa3 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Getting quotas for user 1d6175f2ac39494f8cba3db225150d6c and project ae78c307a1504172828e668f915a3677. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:23:45.506185 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a2b3a03b-5a67-4570-93f0-e2226096faa3 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Going to run 1 instances... {{(pid=121001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:23:45.508551 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a2b3a03b-5a67-4570-93f0-e2226096faa3 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 521ddedc-cff2-4c42-a737-9590906b07a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:23:45.678480 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a2b3a03b-5a67-4570-93f0-e2226096faa3 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.099203 Oct 27 03:23:45.688899 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 438/919] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:23:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1104 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 03:23:45.695283 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a8de31dc-5be2-47b5-910d-4a9ba1448e45 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:45.699189 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a8de31dc-5be2-47b5-910d-4a9ba1448e45 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] [instance: a52fed88-50f8-4dea-b83d-6878adccb024] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:45.722385 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a8de31dc-5be2-47b5-910d-4a9ba1448e45 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:45.723052 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a8de31dc-5be2-47b5-910d-4a9ba1448e45 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:45.723602 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a8de31dc-5be2-47b5-910d-4a9ba1448e45 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:45.724418 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a8de31dc-5be2-47b5-910d-4a9ba1448e45 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:45.725031 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a8de31dc-5be2-47b5-910d-4a9ba1448e45 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:45.731642 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a8de31dc-5be2-47b5-910d-4a9ba1448e45 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:45.753310 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-3a3b4e30-6245-4608-bac3-de81d04175a2 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:23:45.754233 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-3a3b4e30-6245-4608-bac3-de81d04175a2 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:23:45.755053 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-3a3b4e30-6245-4608-bac3-de81d04175a2 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:23:45.755677 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-3a3b4e30-6245-4608-bac3-de81d04175a2 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:23:45.756291 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-3a3b4e30-6245-4608-bac3-de81d04175a2 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:23:45.779784 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3a3b4e30-6245-4608-bac3-de81d04175a2 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:45.780884 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3a3b4e30-6245-4608-bac3-de81d04175a2 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:45.783085 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3a3b4e30-6245-4608-bac3-de81d04175a2 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:45.784401 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3a3b4e30-6245-4608-bac3-de81d04175a2 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:45.786716 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3a3b4e30-6245-4608-bac3-de81d04175a2 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:45.787329 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3a3b4e30-6245-4608-bac3-de81d04175a2 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:45.841830 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-3a3b4e30-6245-4608-bac3-de81d04175a2 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Getting quotas for project 39f033d34ad44397bfda5cba4c041071. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:23:45.856068 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-3a3b4e30-6245-4608-bac3-de81d04175a2 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Getting quotas for user 2e23378ed283426cbff623265d9bbc96 and project 39f033d34ad44397bfda5cba4c041071. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:23:45.896731 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-3a3b4e30-6245-4608-bac3-de81d04175a2 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:23:45.905263 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-3a3b4e30-6245-4608-bac3-de81d04175a2 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] [instance: acb62f35-0751-41fe-ba8d-78b2357380e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:23:46.152768 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3a3b4e30-6245-4608-bac3-de81d04175a2 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.700548 Oct 27 03:23:46.154126 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 482/920] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:23:44 2022] POST /compute/v2.1/servers => generated 402 bytes in 1702 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 03:23:46.163836 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3e57d4cc-08a7-4b8d-9142-9cab240edb73 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:46.168014 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-3e57d4cc-08a7-4b8d-9142-9cab240edb73 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: a4abccf0-a093-4148-a260-40ab363b12f6] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:46.183026 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3e57d4cc-08a7-4b8d-9142-9cab240edb73 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:46.184133 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3e57d4cc-08a7-4b8d-9142-9cab240edb73 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:46.184945 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3e57d4cc-08a7-4b8d-9142-9cab240edb73 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:46.193293 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3e57d4cc-08a7-4b8d-9142-9cab240edb73 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:46.200278 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3e57d4cc-08a7-4b8d-9142-9cab240edb73 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:46.200278 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3e57d4cc-08a7-4b8d-9142-9cab240edb73 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:46.527217 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-3e57d4cc-08a7-4b8d-9142-9cab240edb73 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:46.539592 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3e57d4cc-08a7-4b8d-9142-9cab240edb73 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/a4abccf0-a093-4148-a260-40ab363b12f6" status: 200 len: 1317 microversion: 2.1 time: 0.383837 Oct 27 03:23:46.554084 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 483/921] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:46 2022] GET /compute/v2.1/servers/a4abccf0-a093-4148-a260-40ab363b12f6 => generated 1317 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:46.554084 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9d7ffd0c-e592-4fe8-8982-bdbe4500bf18 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:46.554084 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9d7ffd0c-e592-4fe8-8982-bdbe4500bf18 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 87ad30f8-b432-45dc-82ff-aed508afddd7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:46.565823 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9d7ffd0c-e592-4fe8-8982-bdbe4500bf18 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:46.567284 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9d7ffd0c-e592-4fe8-8982-bdbe4500bf18 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:46.571937 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9d7ffd0c-e592-4fe8-8982-bdbe4500bf18 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:46.572811 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9d7ffd0c-e592-4fe8-8982-bdbe4500bf18 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:46.573481 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9d7ffd0c-e592-4fe8-8982-bdbe4500bf18 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:46.574047 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9d7ffd0c-e592-4fe8-8982-bdbe4500bf18 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:46.797770 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a8de31dc-5be2-47b5-910d-4a9ba1448e45 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/a52fed88-50f8-4dea-b83d-6878adccb024" status: 200 len: 1646 microversion: 2.1 time: 1.107869 Oct 27 03:23:46.801722 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 439/922] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:45 2022] GET /compute/v2.1/servers/a52fed88-50f8-4dea-b83d-6878adccb024 => generated 1646 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:46.809913 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-cc8ac434-e550-4a9a-9558-74e24832c785 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:46.810505 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-cc8ac434-e550-4a9a-9558-74e24832c785 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:46.838529 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cc8ac434-e550-4a9a-9558-74e24832c785 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:46.839034 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cc8ac434-e550-4a9a-9558-74e24832c785 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:46.845409 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cc8ac434-e550-4a9a-9558-74e24832c785 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:46.846444 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cc8ac434-e550-4a9a-9558-74e24832c785 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:46.847084 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cc8ac434-e550-4a9a-9558-74e24832c785 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:46.847684 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cc8ac434-e550-4a9a-9558-74e24832c785 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:46.852518 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:46.923550 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9d7ffd0c-e592-4fe8-8982-bdbe4500bf18 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:46.932081 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9d7ffd0c-e592-4fe8-8982-bdbe4500bf18 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:46.938928 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9d7ffd0c-e592-4fe8-8982-bdbe4500bf18 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:46.940321 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9d7ffd0c-e592-4fe8-8982-bdbe4500bf18 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/87ad30f8-b432-45dc-82ff-aed508afddd7" status: 200 len: 1569 microversion: 2.25 time: 0.397149 Oct 27 03:23:46.945927 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 484/923] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:23:46 2022] GET /compute/v2.1/servers/87ad30f8-b432-45dc-82ff-aed508afddd7 => generated 1569 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:23:46.951275 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-fb098f86-55d4-4435-877c-3a1d07f7fa62 req-d9bdbd2d-e471-42b8-980d-349674820720 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4abccf0-a093-4148-a260-40ab363b12f6", "name": "network-vif-plugged", "status": "completed", "tag": "69c8815d-cc5c-4226-a70c-449f3d54e905"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:23:46.962074 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-fb098f86-55d4-4435-877c-3a1d07f7fa62 req-d9bdbd2d-e471-42b8-980d-349674820720 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:46.962588 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-fb098f86-55d4-4435-877c-3a1d07f7fa62 req-d9bdbd2d-e471-42b8-980d-349674820720 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:46.963029 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-fb098f86-55d4-4435-877c-3a1d07f7fa62 req-d9bdbd2d-e471-42b8-980d-349674820720 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:46.975342 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-fb098f86-55d4-4435-877c-3a1d07f7fa62 req-d9bdbd2d-e471-42b8-980d-349674820720 service nova] Creating event network-vif-plugged:69c8815d-cc5c-4226-a70c-449f3d54e905 for instance a4abccf0-a093-4148-a260-40ab363b12f6 on n-h1-862769-1 Oct 27 03:23:46.980370 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-fb098f86-55d4-4435-877c-3a1d07f7fa62 req-d9bdbd2d-e471-42b8-980d-349674820720 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033157 Oct 27 03:23:46.980990 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 485/924] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:23:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:23:46.986998 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e2645c6f-0384-45a8-8013-44d2d99e6252 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:46.990681 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e2645c6f-0384-45a8-8013-44d2d99e6252 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] [instance: 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:46.994702 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e2645c6f-0384-45a8-8013-44d2d99e6252 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:46.995162 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e2645c6f-0384-45a8-8013-44d2d99e6252 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:46.995596 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e2645c6f-0384-45a8-8013-44d2d99e6252 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:46.996435 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e2645c6f-0384-45a8-8013-44d2d99e6252 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:46.996905 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e2645c6f-0384-45a8-8013-44d2d99e6252 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:46.997390 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e2645c6f-0384-45a8-8013-44d2d99e6252 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:47.087981 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e2645c6f-0384-45a8-8013-44d2d99e6252 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:47.105671 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e2645c6f-0384-45a8-8013-44d2d99e6252 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:47.116920 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e2645c6f-0384-45a8-8013-44d2d99e6252 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:47.137107 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e2645c6f-0384-45a8-8013-44d2d99e6252 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] 10.222.0.20 "GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503" status: 200 len: 1446 microversion: 2.75 time: 0.151329 Oct 27 03:23:47.139762 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-cc8ac434-e550-4a9a-9558-74e24832c785 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:47.140052 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 486/925] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:23:46 2022] GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503 => generated 1446 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:23:47.152384 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-cc8ac434-e550-4a9a-9558-74e24832c785 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:47.154615 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-cc8ac434-e550-4a9a-9558-74e24832c785 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:47.155887 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d36111d2-ca63-4da3-bb43-56135662abfd tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:47.158226 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d36111d2-ca63-4da3-bb43-56135662abfd tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 77dd3d48-fede-491a-b6ce-5ad36a1d7cab] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:47.161443 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-cc8ac434-e550-4a9a-9558-74e24832c785 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1555 microversion: 2.91 time: 0.358482 Oct 27 03:23:47.162782 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 440/926] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:23:46 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1555 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:23:47.168275 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c7ab4041-d073-4793-9950-e96515409ddb tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:47.169235 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c7ab4041-d073-4793-9950-e96515409ddb tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 521ddedc-cff2-4c42-a737-9590906b07a6] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:47.185267 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d36111d2-ca63-4da3-bb43-56135662abfd tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:47.185267 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d36111d2-ca63-4da3-bb43-56135662abfd tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:47.185267 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d36111d2-ca63-4da3-bb43-56135662abfd tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:47.185267 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d36111d2-ca63-4da3-bb43-56135662abfd tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:47.198524 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d36111d2-ca63-4da3-bb43-56135662abfd tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:47.199788 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d36111d2-ca63-4da3-bb43-56135662abfd tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:47.288005 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c7ab4041-d073-4793-9950-e96515409ddb tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:47.295172 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c7ab4041-d073-4793-9950-e96515409ddb tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/521ddedc-cff2-4c42-a737-9590906b07a6" status: 200 len: 1208 microversion: 2.1 time: 0.131035 Oct 27 03:23:47.298333 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 441/927] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:47 2022] GET /compute/v2.1/servers/521ddedc-cff2-4c42-a737-9590906b07a6 => generated 1208 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:47.314448 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f22aabda-1426-4829-b1be-c1db94aad934 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:47.315245 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f22aabda-1426-4829-b1be-c1db94aad934 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] [instance: acb62f35-0751-41fe-ba8d-78b2357380e9] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:47.379123 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d36111d2-ca63-4da3-bb43-56135662abfd tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:47.400180 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d36111d2-ca63-4da3-bb43-56135662abfd tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab" status: 200 len: 1337 microversion: 2.1 time: 0.252622 Oct 27 03:23:47.401497 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 487/928] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:47 2022] GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab => generated 1337 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:47.433308 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5d185531-4ba0-40a4-9ad8-1437a19ac889 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:47.459088 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5d185531-4ba0-40a4-9ad8-1437a19ac889 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:47.460099 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5d185531-4ba0-40a4-9ad8-1437a19ac889 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:47.462089 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5d185531-4ba0-40a4-9ad8-1437a19ac889 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:47.464492 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5d185531-4ba0-40a4-9ad8-1437a19ac889 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:47.466241 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5d185531-4ba0-40a4-9ad8-1437a19ac889 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:47.468476 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5d185531-4ba0-40a4-9ad8-1437a19ac889 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:47.579624 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5d185531-4ba0-40a4-9ad8-1437a19ac889 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.173613 Oct 27 03:23:47.580631 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 488/929] 10.222.0.20 () {58 vars in 1176 bytes} [Thu Oct 27 03:23:47 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:23:47.590465 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f22aabda-1426-4829-b1be-c1db94aad934 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e23378ed283426cbff623265d9bbc96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f033d34ad44397bfda5cba4c041071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:47.606122 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3d72b539-e0b1-43b4-9e12-d18570f6ebc2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:47.607067 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-3d72b539-e0b1-43b4-9e12-d18570f6ebc2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: a4abccf0-a093-4148-a260-40ab363b12f6] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:47.611300 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:47.613979 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f22aabda-1426-4829-b1be-c1db94aad934 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] 10.222.0.20 "GET /compute/v2.1/servers/acb62f35-0751-41fe-ba8d-78b2357380e9" status: 200 len: 1261 microversion: 2.1 time: 0.314445 Oct 27 03:23:47.617010 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 442/930] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:47 2022] GET /compute/v2.1/servers/acb62f35-0751-41fe-ba8d-78b2357380e9 => generated 1261 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:47.623887 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3d72b539-e0b1-43b4-9e12-d18570f6ebc2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:47.628438 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3d72b539-e0b1-43b4-9e12-d18570f6ebc2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:47.628438 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3d72b539-e0b1-43b4-9e12-d18570f6ebc2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:47.636056 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3d72b539-e0b1-43b4-9e12-d18570f6ebc2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:47.636056 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3d72b539-e0b1-43b4-9e12-d18570f6ebc2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:47.636056 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3d72b539-e0b1-43b4-9e12-d18570f6ebc2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:47.643701 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ab763b82-9f1e-4628-9487-6dae2a02ac66 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:23:47.644502 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ab763b82-9f1e-4628-9487-6dae2a02ac66 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] [instance: a52fed88-50f8-4dea-b83d-6878adccb024] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:47.664698 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ab763b82-9f1e-4628-9487-6dae2a02ac66 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:47.668075 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ab763b82-9f1e-4628-9487-6dae2a02ac66 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:47.668738 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ab763b82-9f1e-4628-9487-6dae2a02ac66 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:47.672857 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ab763b82-9f1e-4628-9487-6dae2a02ac66 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:47.673624 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ab763b82-9f1e-4628-9487-6dae2a02ac66 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:47.676314 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ab763b82-9f1e-4628-9487-6dae2a02ac66 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:48.033247 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ab763b82-9f1e-4628-9487-6dae2a02ac66 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/a52fed88-50f8-4dea-b83d-6878adccb024/action" status: 202 len: 0 microversion: 2.1 time: 0.412631 Oct 27 03:23:48.034330 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 443/931] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:23:47 2022] POST /compute/v2.1/servers/a52fed88-50f8-4dea-b83d-6878adccb024/action => generated 0 bytes in 416 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:23:48.045402 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4e83fd81-6550-4393-aaed-dd381134503e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:48.046435 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4e83fd81-6550-4393-aaed-dd381134503e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 87ad30f8-b432-45dc-82ff-aed508afddd7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:48.063440 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4e83fd81-6550-4393-aaed-dd381134503e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:48.064874 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4e83fd81-6550-4393-aaed-dd381134503e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:48.065270 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4e83fd81-6550-4393-aaed-dd381134503e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:48.066928 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4e83fd81-6550-4393-aaed-dd381134503e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:48.070969 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4e83fd81-6550-4393-aaed-dd381134503e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:48.071649 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4e83fd81-6550-4393-aaed-dd381134503e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:48.219939 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-3d72b539-e0b1-43b4-9e12-d18570f6ebc2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:48.223784 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:48.233884 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3d72b539-e0b1-43b4-9e12-d18570f6ebc2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/a4abccf0-a093-4148-a260-40ab363b12f6" status: 200 len: 1317 microversion: 2.1 time: 0.643034 Oct 27 03:23:48.250278 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 489/932] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:47 2022] GET /compute/v2.1/servers/a4abccf0-a093-4148-a260-40ab363b12f6 => generated 1317 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:48.250278 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-55d29aeb-ad40-46e3-ac15-b6b68ae5878e tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:48.250278 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-55d29aeb-ad40-46e3-ac15-b6b68ae5878e tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] [instance: a52fed88-50f8-4dea-b83d-6878adccb024] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:48.269738 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-55d29aeb-ad40-46e3-ac15-b6b68ae5878e tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:48.270154 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-55d29aeb-ad40-46e3-ac15-b6b68ae5878e tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:48.270615 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-55d29aeb-ad40-46e3-ac15-b6b68ae5878e tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:48.271553 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-55d29aeb-ad40-46e3-ac15-b6b68ae5878e tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:48.271820 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-55d29aeb-ad40-46e3-ac15-b6b68ae5878e tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:48.276018 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-55d29aeb-ad40-46e3-ac15-b6b68ae5878e tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:48.525795 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-55d29aeb-ad40-46e3-ac15-b6b68ae5878e tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/a52fed88-50f8-4dea-b83d-6878adccb024" status: 200 len: 1651 microversion: 2.1 time: 0.288143 Oct 27 03:23:48.528111 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 490/933] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:48 2022] GET /compute/v2.1/servers/a52fed88-50f8-4dea-b83d-6878adccb024 => generated 1651 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:48.546610 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-af49bdc9-10fc-454d-927c-fd125dcfd479 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:48.546610 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-af49bdc9-10fc-454d-927c-fd125dcfd479 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] [instance: 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:48.555034 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-af49bdc9-10fc-454d-927c-fd125dcfd479 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:48.557874 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-af49bdc9-10fc-454d-927c-fd125dcfd479 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:48.558061 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-af49bdc9-10fc-454d-927c-fd125dcfd479 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:48.564540 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-af49bdc9-10fc-454d-927c-fd125dcfd479 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:48.565125 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-af49bdc9-10fc-454d-927c-fd125dcfd479 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:48.565974 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-af49bdc9-10fc-454d-927c-fd125dcfd479 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:48.610407 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4e83fd81-6550-4393-aaed-dd381134503e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:48.623155 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4e83fd81-6550-4393-aaed-dd381134503e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:48.627562 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4e83fd81-6550-4393-aaed-dd381134503e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:48.628859 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4e83fd81-6550-4393-aaed-dd381134503e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/87ad30f8-b432-45dc-82ff-aed508afddd7" status: 200 len: 1569 microversion: 2.25 time: 0.593369 Oct 27 03:23:48.643810 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 444/934] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:23:48 2022] GET /compute/v2.1/servers/87ad30f8-b432-45dc-82ff-aed508afddd7 => generated 1569 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:23:48.674823 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c5d3463b-2819-4217-bc08-8ef750d0cc97 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:48.675475 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c5d3463b-2819-4217-bc08-8ef750d0cc97 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:48.693417 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c5d3463b-2819-4217-bc08-8ef750d0cc97 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:48.698164 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c5d3463b-2819-4217-bc08-8ef750d0cc97 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:48.698772 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c5d3463b-2819-4217-bc08-8ef750d0cc97 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:48.704227 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c5d3463b-2819-4217-bc08-8ef750d0cc97 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:48.704736 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c5d3463b-2819-4217-bc08-8ef750d0cc97 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:48.705184 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c5d3463b-2819-4217-bc08-8ef750d0cc97 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:48.842423 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-af49bdc9-10fc-454d-927c-fd125dcfd479 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:48.863626 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-af49bdc9-10fc-454d-927c-fd125dcfd479 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:48.876250 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-af49bdc9-10fc-454d-927c-fd125dcfd479 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:48.898155 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-af49bdc9-10fc-454d-927c-fd125dcfd479 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] 10.222.0.20 "GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503" status: 200 len: 1446 microversion: 2.75 time: 0.368710 Oct 27 03:23:48.915134 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 491/935] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:23:48 2022] GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503 => generated 1446 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:23:48.925311 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e9835de5-cdbc-466a-aea3-c1e775939056 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:48.936577 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e9835de5-cdbc-466a-aea3-c1e775939056 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 521ddedc-cff2-4c42-a737-9590906b07a6] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:48.961580 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e9835de5-cdbc-466a-aea3-c1e775939056 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:48.963689 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e9835de5-cdbc-466a-aea3-c1e775939056 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:48.965134 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e9835de5-cdbc-466a-aea3-c1e775939056 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:48.968605 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e9835de5-cdbc-466a-aea3-c1e775939056 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:48.971824 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e9835de5-cdbc-466a-aea3-c1e775939056 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:48.972345 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e9835de5-cdbc-466a-aea3-c1e775939056 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:48.981157 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c5d3463b-2819-4217-bc08-8ef750d0cc97 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:49.002682 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c5d3463b-2819-4217-bc08-8ef750d0cc97 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:49.005608 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c5d3463b-2819-4217-bc08-8ef750d0cc97 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:49.020638 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c5d3463b-2819-4217-bc08-8ef750d0cc97 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1555 microversion: 2.91 time: 0.385324 Oct 27 03:23:49.026473 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 445/936] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:23:48 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1555 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:23:49.034582 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-45a3859b-98db-4b5d-bd85-233520d515c7 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:49.041122 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-45a3859b-98db-4b5d-bd85-233520d515c7 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 77dd3d48-fede-491a-b6ce-5ad36a1d7cab] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:49.053450 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-45a3859b-98db-4b5d-bd85-233520d515c7 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:49.054334 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-45a3859b-98db-4b5d-bd85-233520d515c7 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:49.057702 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-45a3859b-98db-4b5d-bd85-233520d515c7 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:49.058816 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-45a3859b-98db-4b5d-bd85-233520d515c7 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:49.059863 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-45a3859b-98db-4b5d-bd85-233520d515c7 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:49.061683 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-45a3859b-98db-4b5d-bd85-233520d515c7 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:49.191066 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e9835de5-cdbc-466a-aea3-c1e775939056 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:49.197698 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-45a3859b-98db-4b5d-bd85-233520d515c7 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:49.201358 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e9835de5-cdbc-466a-aea3-c1e775939056 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/521ddedc-cff2-4c42-a737-9590906b07a6" status: 200 len: 1204 microversion: 2.1 time: 0.283609 Oct 27 03:23:49.201950 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 492/937] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:48 2022] GET /compute/v2.1/servers/521ddedc-cff2-4c42-a737-9590906b07a6 => generated 1204 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:49.223755 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-e18bb0a8-bc08-4d31-ae82-319c19132d14 req-cfb0a450-b90d-4b69-8bae-af55b39ee7cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87ad30f8-b432-45dc-82ff-aed508afddd7", "name": "network-vif-unplugged", "status": "completed", "tag": "e564d375-d22d-4aff-a377-d7085a068b58"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:23:49.229681 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-45a3859b-98db-4b5d-bd85-233520d515c7 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab" status: 200 len: 1337 microversion: 2.1 time: 0.201657 Oct 27 03:23:49.230299 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 446/938] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:49 2022] GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab => generated 1337 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:49.241011 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e5c810da-a9ca-452d-a5ec-987cce4afec9 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:49.246282 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e5c810da-a9ca-452d-a5ec-987cce4afec9 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] [instance: acb62f35-0751-41fe-ba8d-78b2357380e9] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:49.259536 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e5c810da-a9ca-452d-a5ec-987cce4afec9 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:49.264910 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e5c810da-a9ca-452d-a5ec-987cce4afec9 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:49.265666 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e5c810da-a9ca-452d-a5ec-987cce4afec9 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:49.266403 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-e18bb0a8-bc08-4d31-ae82-319c19132d14 req-cfb0a450-b90d-4b69-8bae-af55b39ee7cb service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:49.267243 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-e18bb0a8-bc08-4d31-ae82-319c19132d14 req-cfb0a450-b90d-4b69-8bae-af55b39ee7cb service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:49.269199 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-e18bb0a8-bc08-4d31-ae82-319c19132d14 req-cfb0a450-b90d-4b69-8bae-af55b39ee7cb service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:49.269473 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e5c810da-a9ca-452d-a5ec-987cce4afec9 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:49.270249 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e5c810da-a9ca-452d-a5ec-987cce4afec9 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:49.270871 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e5c810da-a9ca-452d-a5ec-987cce4afec9 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:49.304777 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-e18bb0a8-bc08-4d31-ae82-319c19132d14 req-cfb0a450-b90d-4b69-8bae-af55b39ee7cb service nova] Creating event network-vif-unplugged:e564d375-d22d-4aff-a377-d7085a068b58 for instance 87ad30f8-b432-45dc-82ff-aed508afddd7 on n-h2-862769-1 Oct 27 03:23:49.313994 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-e18bb0a8-bc08-4d31-ae82-319c19132d14 req-cfb0a450-b90d-4b69-8bae-af55b39ee7cb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.103549 Oct 27 03:23:49.315176 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 493/939] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:23:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:23:49.322263 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4c03d05c-9f1d-48f2-becf-33b34905a79b tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:49.323159 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4c03d05c-9f1d-48f2-becf-33b34905a79b tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: a4abccf0-a093-4148-a260-40ab363b12f6] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:49.333140 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4c03d05c-9f1d-48f2-becf-33b34905a79b tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:49.333863 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4c03d05c-9f1d-48f2-becf-33b34905a79b tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:49.335035 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4c03d05c-9f1d-48f2-becf-33b34905a79b tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:49.339515 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4c03d05c-9f1d-48f2-becf-33b34905a79b tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:49.339515 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4c03d05c-9f1d-48f2-becf-33b34905a79b tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:49.339515 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4c03d05c-9f1d-48f2-becf-33b34905a79b tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:49.515195 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e5c810da-a9ca-452d-a5ec-987cce4afec9 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e23378ed283426cbff623265d9bbc96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f033d34ad44397bfda5cba4c041071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:49.534366 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e5c810da-a9ca-452d-a5ec-987cce4afec9 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] 10.222.0.20 "GET /compute/v2.1/servers/acb62f35-0751-41fe-ba8d-78b2357380e9" status: 200 len: 1257 microversion: 2.1 time: 0.295512 Oct 27 03:23:49.534366 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 447/940] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:49 2022] GET /compute/v2.1/servers/acb62f35-0751-41fe-ba8d-78b2357380e9 => generated 1257 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:49.557325 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-91364c13-3be0-4be8-bcda-1e61324d3a9c tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:49.557943 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-91364c13-3be0-4be8-bcda-1e61324d3a9c tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] [instance: a52fed88-50f8-4dea-b83d-6878adccb024] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:49.588289 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-91364c13-3be0-4be8-bcda-1e61324d3a9c tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:49.591668 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-91364c13-3be0-4be8-bcda-1e61324d3a9c tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:49.591668 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-91364c13-3be0-4be8-bcda-1e61324d3a9c tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:49.598413 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-91364c13-3be0-4be8-bcda-1e61324d3a9c tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:49.598920 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-91364c13-3be0-4be8-bcda-1e61324d3a9c tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:49.599370 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-91364c13-3be0-4be8-bcda-1e61324d3a9c tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:50.035380 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4c03d05c-9f1d-48f2-becf-33b34905a79b tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:50.050357 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4c03d05c-9f1d-48f2-becf-33b34905a79b tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/a4abccf0-a093-4148-a260-40ab363b12f6" status: 200 len: 1317 microversion: 2.1 time: 0.733226 Oct 27 03:23:50.063537 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 494/941] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:49 2022] GET /compute/v2.1/servers/a4abccf0-a093-4148-a260-40ab363b12f6 => generated 1317 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:50.089930 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-426f4b83-06ed-4f40-928b-b7cefe54e886 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:50.094473 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-426f4b83-06ed-4f40-928b-b7cefe54e886 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 87ad30f8-b432-45dc-82ff-aed508afddd7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:50.128094 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-426f4b83-06ed-4f40-928b-b7cefe54e886 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:50.129987 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-426f4b83-06ed-4f40-928b-b7cefe54e886 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:50.130697 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-426f4b83-06ed-4f40-928b-b7cefe54e886 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:50.131616 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-426f4b83-06ed-4f40-928b-b7cefe54e886 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:50.132269 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-426f4b83-06ed-4f40-928b-b7cefe54e886 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:50.133426 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-426f4b83-06ed-4f40-928b-b7cefe54e886 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:50.367156 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-426f4b83-06ed-4f40-928b-b7cefe54e886 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:50.376368 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-426f4b83-06ed-4f40-928b-b7cefe54e886 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:50.377822 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-426f4b83-06ed-4f40-928b-b7cefe54e886 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:50.394750 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-426f4b83-06ed-4f40-928b-b7cefe54e886 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/87ad30f8-b432-45dc-82ff-aed508afddd7" status: 200 len: 1569 microversion: 2.25 time: 0.314268 Oct 27 03:23:50.394750 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 495/942] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:23:50 2022] GET /compute/v2.1/servers/87ad30f8-b432-45dc-82ff-aed508afddd7 => generated 1569 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:23:50.395340 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-87b7c385-2fd6-4faa-ada7-ebe6fad0f07f tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:50.396035 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-87b7c385-2fd6-4faa-ada7-ebe6fad0f07f tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] [instance: 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:50.403278 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-87b7c385-2fd6-4faa-ada7-ebe6fad0f07f tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:50.403278 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-87b7c385-2fd6-4faa-ada7-ebe6fad0f07f tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:50.403538 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-87b7c385-2fd6-4faa-ada7-ebe6fad0f07f tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:50.407617 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-87b7c385-2fd6-4faa-ada7-ebe6fad0f07f tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:50.407617 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-87b7c385-2fd6-4faa-ada7-ebe6fad0f07f tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:50.407617 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-87b7c385-2fd6-4faa-ada7-ebe6fad0f07f tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:50.472787 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-91364c13-3be0-4be8-bcda-1e61324d3a9c tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/a52fed88-50f8-4dea-b83d-6878adccb024" status: 200 len: 1631 microversion: 2.1 time: 0.924215 Oct 27 03:23:50.475891 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 448/943] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:49 2022] GET /compute/v2.1/servers/a52fed88-50f8-4dea-b83d-6878adccb024 => generated 1631 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:50.492648 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8b4c2bd0-d7d4-4987-9dca-c62b59eaa072 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:50.493291 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8b4c2bd0-d7d4-4987-9dca-c62b59eaa072 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:50.511181 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-87b7c385-2fd6-4faa-ada7-ebe6fad0f07f tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:50.515139 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8b4c2bd0-d7d4-4987-9dca-c62b59eaa072 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:50.515791 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8b4c2bd0-d7d4-4987-9dca-c62b59eaa072 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:50.516265 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8b4c2bd0-d7d4-4987-9dca-c62b59eaa072 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:50.517025 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8b4c2bd0-d7d4-4987-9dca-c62b59eaa072 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:50.517605 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8b4c2bd0-d7d4-4987-9dca-c62b59eaa072 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:50.518343 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8b4c2bd0-d7d4-4987-9dca-c62b59eaa072 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:50.523634 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-87b7c385-2fd6-4faa-ada7-ebe6fad0f07f tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:50.525408 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-87b7c385-2fd6-4faa-ada7-ebe6fad0f07f tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:50.545728 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-87b7c385-2fd6-4faa-ada7-ebe6fad0f07f tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] 10.222.0.20 "GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503" status: 200 len: 1446 microversion: 2.75 time: 0.158915 Oct 27 03:23:50.549167 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 496/944] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:23:50 2022] GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503 => generated 1446 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:23:50.564049 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-462e1227-4ab1-4ad6-8683-3a80254f1d63 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:50.566591 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-462e1227-4ab1-4ad6-8683-3a80254f1d63 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 521ddedc-cff2-4c42-a737-9590906b07a6] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:50.578470 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-462e1227-4ab1-4ad6-8683-3a80254f1d63 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:50.585244 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-462e1227-4ab1-4ad6-8683-3a80254f1d63 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:50.585851 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-462e1227-4ab1-4ad6-8683-3a80254f1d63 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:50.586960 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-462e1227-4ab1-4ad6-8683-3a80254f1d63 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:50.589554 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-462e1227-4ab1-4ad6-8683-3a80254f1d63 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:50.589554 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-462e1227-4ab1-4ad6-8683-3a80254f1d63 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:50.840042 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-462e1227-4ab1-4ad6-8683-3a80254f1d63 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:50.849462 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-462e1227-4ab1-4ad6-8683-3a80254f1d63 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/521ddedc-cff2-4c42-a737-9590906b07a6" status: 200 len: 1260 microversion: 2.1 time: 0.300025 Oct 27 03:23:50.864281 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 497/945] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:50 2022] GET /compute/v2.1/servers/521ddedc-cff2-4c42-a737-9590906b07a6 => generated 1260 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:50.864281 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c63c9a32-e777-4f43-b5d3-3f5098058aec tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:50.864281 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c63c9a32-e777-4f43-b5d3-3f5098058aec tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 77dd3d48-fede-491a-b6ce-5ad36a1d7cab] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:50.892347 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c63c9a32-e777-4f43-b5d3-3f5098058aec tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:50.892872 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c63c9a32-e777-4f43-b5d3-3f5098058aec tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:50.893591 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c63c9a32-e777-4f43-b5d3-3f5098058aec tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:50.893966 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8b4c2bd0-d7d4-4987-9dca-c62b59eaa072 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:50.894359 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c63c9a32-e777-4f43-b5d3-3f5098058aec tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:50.894826 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c63c9a32-e777-4f43-b5d3-3f5098058aec tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:50.895256 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c63c9a32-e777-4f43-b5d3-3f5098058aec tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:50.907268 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8b4c2bd0-d7d4-4987-9dca-c62b59eaa072 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:50.909795 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8b4c2bd0-d7d4-4987-9dca-c62b59eaa072 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:50.919409 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8b4c2bd0-d7d4-4987-9dca-c62b59eaa072 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1555 microversion: 2.91 time: 0.442390 Oct 27 03:23:50.921113 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 449/946] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:23:50 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1555 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:23:50.926443 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-483af933-c214-4c99-a204-d97827428f2f tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-862769-1", "block_migration": true, "disk_over_commit": false}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:23:50.931362 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-483af933-c214-4c99-a204-d97827428f2f tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] [instance: a52fed88-50f8-4dea-b83d-6878adccb024] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:50.958730 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-483af933-c214-4c99-a204-d97827428f2f tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:50.961177 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-483af933-c214-4c99-a204-d97827428f2f tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:50.967139 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-483af933-c214-4c99-a204-d97827428f2f tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:50.972005 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-483af933-c214-4c99-a204-d97827428f2f tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:50.972771 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-483af933-c214-4c99-a204-d97827428f2f tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:50.973776 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-483af933-c214-4c99-a204-d97827428f2f tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:51.073476 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-483af933-c214-4c99-a204-d97827428f2f tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lazy-loading 'flavor' on Instance uuid a52fed88-50f8-4dea-b83d-6878adccb024 {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:23:51.127858 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-483af933-c214-4c99-a204-d97827428f2f tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] [instance: a52fed88-50f8-4dea-b83d-6878adccb024] Going to try to live migrate instance to n-h1-862769-1 {{(pid=121001) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 27 03:23:51.607712 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c63c9a32-e777-4f43-b5d3-3f5098058aec tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:51.620551 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c63c9a32-e777-4f43-b5d3-3f5098058aec tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab" status: 200 len: 1379 microversion: 2.1 time: 0.769409 Oct 27 03:23:51.623722 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 498/947] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:50 2022] GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab => generated 1379 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:51.636083 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-10d7b09f-c898-4614-8aed-c99fdf91c6f8 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:51.639966 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-10d7b09f-c898-4614-8aed-c99fdf91c6f8 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] [instance: acb62f35-0751-41fe-ba8d-78b2357380e9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:51.654623 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-10d7b09f-c898-4614-8aed-c99fdf91c6f8 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:51.658146 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-10d7b09f-c898-4614-8aed-c99fdf91c6f8 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:51.660861 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-10d7b09f-c898-4614-8aed-c99fdf91c6f8 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:51.661699 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-10d7b09f-c898-4614-8aed-c99fdf91c6f8 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:51.662532 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-10d7b09f-c898-4614-8aed-c99fdf91c6f8 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:51.663486 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-10d7b09f-c898-4614-8aed-c99fdf91c6f8 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:51.773265 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-10d7b09f-c898-4614-8aed-c99fdf91c6f8 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e23378ed283426cbff623265d9bbc96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f033d34ad44397bfda5cba4c041071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:51.795135 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-10d7b09f-c898-4614-8aed-c99fdf91c6f8 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] 10.222.0.20 "GET /compute/v2.1/servers/acb62f35-0751-41fe-ba8d-78b2357380e9" status: 200 len: 1313 microversion: 2.1 time: 0.169958 Oct 27 03:23:51.811391 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 499/948] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:51 2022] GET /compute/v2.1/servers/acb62f35-0751-41fe-ba8d-78b2357380e9 => generated 1313 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:51.816916 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c77a61e7-add6-435d-b590-20b534eb5dcb tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:51.817735 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c77a61e7-add6-435d-b590-20b534eb5dcb tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: a4abccf0-a093-4148-a260-40ab363b12f6] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:51.824365 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c77a61e7-add6-435d-b590-20b534eb5dcb tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:51.825150 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c77a61e7-add6-435d-b590-20b534eb5dcb tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:51.825748 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c77a61e7-add6-435d-b590-20b534eb5dcb tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:51.826655 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c77a61e7-add6-435d-b590-20b534eb5dcb tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:51.827269 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c77a61e7-add6-435d-b590-20b534eb5dcb tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:51.827886 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c77a61e7-add6-435d-b590-20b534eb5dcb tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:52.170541 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c77a61e7-add6-435d-b590-20b534eb5dcb tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:52.188153 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c77a61e7-add6-435d-b590-20b534eb5dcb tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/a4abccf0-a093-4148-a260-40ab363b12f6" status: 200 len: 1466 microversion: 2.1 time: 0.374646 Oct 27 03:23:52.198295 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 500/949] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:51 2022] GET /compute/v2.1/servers/a4abccf0-a093-4148-a260-40ab363b12f6 => generated 1466 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:52.206788 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-7999f2f6-9d15-4037-be9b-f3756e017f27 req-a9276c7b-26ab-4237-a1c6-1cee30b75295 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d4fe59a-b31c-4fc0-8994-eb21e313d18a", "name": "network-vif-deleted", "tag": "4fbcc2f0-a04c-48c8-a4da-059f29a4e11f"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:23:52.279974 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-7999f2f6-9d15-4037-be9b-f3756e017f27 req-a9276c7b-26ab-4237-a1c6-1cee30b75295 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:52.280588 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-7999f2f6-9d15-4037-be9b-f3756e017f27 req-a9276c7b-26ab-4237-a1c6-1cee30b75295 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:52.281578 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-7999f2f6-9d15-4037-be9b-f3756e017f27 req-a9276c7b-26ab-4237-a1c6-1cee30b75295 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:52.327727 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-7999f2f6-9d15-4037-be9b-f3756e017f27 req-a9276c7b-26ab-4237-a1c6-1cee30b75295 service nova] Creating event network-vif-deleted:4fbcc2f0-a04c-48c8-a4da-059f29a4e11f for instance 2d4fe59a-b31c-4fc0-8994-eb21e313d18a on n-h1-862769-1 Oct 27 03:23:52.334562 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-7999f2f6-9d15-4037-be9b-f3756e017f27 req-a9276c7b-26ab-4237-a1c6-1cee30b75295 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134686 Oct 27 03:23:52.335523 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 501/950] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:23:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:23:52.355452 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4af26c05-808c-40d7-a508-71eddbe18c78 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:52.358854 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4af26c05-808c-40d7-a508-71eddbe18c78 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 87ad30f8-b432-45dc-82ff-aed508afddd7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:52.371554 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4af26c05-808c-40d7-a508-71eddbe18c78 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:52.372217 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4af26c05-808c-40d7-a508-71eddbe18c78 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:52.372688 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4af26c05-808c-40d7-a508-71eddbe18c78 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:52.373538 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4af26c05-808c-40d7-a508-71eddbe18c78 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:52.374220 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4af26c05-808c-40d7-a508-71eddbe18c78 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:52.374528 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4af26c05-808c-40d7-a508-71eddbe18c78 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:52.832383 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4af26c05-808c-40d7-a508-71eddbe18c78 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:52.849922 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4af26c05-808c-40d7-a508-71eddbe18c78 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:52.851878 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4af26c05-808c-40d7-a508-71eddbe18c78 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:52.855273 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4af26c05-808c-40d7-a508-71eddbe18c78 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/87ad30f8-b432-45dc-82ff-aed508afddd7" status: 200 len: 1569 microversion: 2.25 time: 0.517618 Oct 27 03:23:52.857916 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 502/951] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:23:52 2022] GET /compute/v2.1/servers/87ad30f8-b432-45dc-82ff-aed508afddd7 => generated 1569 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:23:52.869062 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-9d3b8783-e4b9-404e-bc88-b4136db0a29d req-ac7e2294-664a-4af9-a7f6-ccf1550c0d45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87ad30f8-b432-45dc-82ff-aed508afddd7", "tag": "e564d375-d22d-4aff-a377-d7085a068b58"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:23:52.893433 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-9d3b8783-e4b9-404e-bc88-b4136db0a29d req-ac7e2294-664a-4af9-a7f6-ccf1550c0d45 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:52.893916 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-9d3b8783-e4b9-404e-bc88-b4136db0a29d req-ac7e2294-664a-4af9-a7f6-ccf1550c0d45 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:52.894375 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-9d3b8783-e4b9-404e-bc88-b4136db0a29d req-ac7e2294-664a-4af9-a7f6-ccf1550c0d45 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:52.920160 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-9d3b8783-e4b9-404e-bc88-b4136db0a29d req-ac7e2294-664a-4af9-a7f6-ccf1550c0d45 service nova] Creating event network-changed:e564d375-d22d-4aff-a377-d7085a068b58 for instance 87ad30f8-b432-45dc-82ff-aed508afddd7 on n-h2-862769-1 Oct 27 03:23:52.938888 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-9d3b8783-e4b9-404e-bc88-b4136db0a29d req-ac7e2294-664a-4af9-a7f6-ccf1550c0d45 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071126 Oct 27 03:23:52.938888 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 503/952] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:23:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:23:52.958779 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ac57fbd7-1096-4298-8f6a-e2c8439044ca tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:52.959580 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ac57fbd7-1096-4298-8f6a-e2c8439044ca tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] [instance: 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:52.966058 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ac57fbd7-1096-4298-8f6a-e2c8439044ca tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:52.966567 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ac57fbd7-1096-4298-8f6a-e2c8439044ca tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:52.967007 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ac57fbd7-1096-4298-8f6a-e2c8439044ca tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:52.967729 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ac57fbd7-1096-4298-8f6a-e2c8439044ca tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:52.968187 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ac57fbd7-1096-4298-8f6a-e2c8439044ca tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:52.968654 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ac57fbd7-1096-4298-8f6a-e2c8439044ca tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:53.237214 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ac57fbd7-1096-4298-8f6a-e2c8439044ca tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:53.256867 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ac57fbd7-1096-4298-8f6a-e2c8439044ca tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:53.263874 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ac57fbd7-1096-4298-8f6a-e2c8439044ca tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:53.274024 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ac57fbd7-1096-4298-8f6a-e2c8439044ca tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] 10.222.0.20 "GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503" status: 200 len: 1446 microversion: 2.75 time: 0.334465 Oct 27 03:23:53.274897 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 504/953] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:23:52 2022] GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503 => generated 1446 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:23:53.286207 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-347a2b94-6e08-4403-bc01-dce7197319b8 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:53.288694 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-347a2b94-6e08-4403-bc01-dce7197319b8 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 521ddedc-cff2-4c42-a737-9590906b07a6] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:53.303155 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-347a2b94-6e08-4403-bc01-dce7197319b8 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:53.305381 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-347a2b94-6e08-4403-bc01-dce7197319b8 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:53.306374 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-347a2b94-6e08-4403-bc01-dce7197319b8 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:53.307239 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-347a2b94-6e08-4403-bc01-dce7197319b8 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:53.308682 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-347a2b94-6e08-4403-bc01-dce7197319b8 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:53.310982 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-347a2b94-6e08-4403-bc01-dce7197319b8 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:54.275695 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-347a2b94-6e08-4403-bc01-dce7197319b8 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:54.284255 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-347a2b94-6e08-4403-bc01-dce7197319b8 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/521ddedc-cff2-4c42-a737-9590906b07a6" status: 200 len: 1308 microversion: 2.1 time: 1.007517 Oct 27 03:23:54.303213 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 505/954] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:53 2022] GET /compute/v2.1/servers/521ddedc-cff2-4c42-a737-9590906b07a6 => generated 1308 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:54.308292 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2fa23ab8-9445-472e-b2ac-7b7aff62717c tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:54.308968 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-2fa23ab8-9445-472e-b2ac-7b7aff62717c tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:54.338343 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2fa23ab8-9445-472e-b2ac-7b7aff62717c tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:54.338984 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2fa23ab8-9445-472e-b2ac-7b7aff62717c tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:54.339443 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2fa23ab8-9445-472e-b2ac-7b7aff62717c tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:54.340393 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2fa23ab8-9445-472e-b2ac-7b7aff62717c tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:54.341012 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2fa23ab8-9445-472e-b2ac-7b7aff62717c tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:54.341613 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2fa23ab8-9445-472e-b2ac-7b7aff62717c tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:54.456703 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2fa23ab8-9445-472e-b2ac-7b7aff62717c tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:54.468332 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2fa23ab8-9445-472e-b2ac-7b7aff62717c tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:54.470080 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2fa23ab8-9445-472e-b2ac-7b7aff62717c tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:54.480010 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2fa23ab8-9445-472e-b2ac-7b7aff62717c tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1555 microversion: 2.91 time: 0.175580 Oct 27 03:23:54.494522 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 506/955] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:23:54 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1555 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:23:54.507089 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d37e44cf-6bc4-463a-b2e1-112e572744c0 tempest-ServersOnMultiNodesTest-1789564933 tempest-ServersOnMultiNodesTest-1789564933-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:54.508068 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d37e44cf-6bc4-463a-b2e1-112e572744c0 tempest-ServersOnMultiNodesTest-1789564933 tempest-ServersOnMultiNodesTest-1789564933-project-admin] [instance: a4abccf0-a093-4148-a260-40ab363b12f6] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:54.514524 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d37e44cf-6bc4-463a-b2e1-112e572744c0 tempest-ServersOnMultiNodesTest-1789564933 tempest-ServersOnMultiNodesTest-1789564933-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:54.515315 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d37e44cf-6bc4-463a-b2e1-112e572744c0 tempest-ServersOnMultiNodesTest-1789564933 tempest-ServersOnMultiNodesTest-1789564933-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:54.516363 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d37e44cf-6bc4-463a-b2e1-112e572744c0 tempest-ServersOnMultiNodesTest-1789564933 tempest-ServersOnMultiNodesTest-1789564933-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:54.517127 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d37e44cf-6bc4-463a-b2e1-112e572744c0 tempest-ServersOnMultiNodesTest-1789564933 tempest-ServersOnMultiNodesTest-1789564933-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:54.517748 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d37e44cf-6bc4-463a-b2e1-112e572744c0 tempest-ServersOnMultiNodesTest-1789564933 tempest-ServersOnMultiNodesTest-1789564933-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:54.518474 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d37e44cf-6bc4-463a-b2e1-112e572744c0 tempest-ServersOnMultiNodesTest-1789564933 tempest-ServersOnMultiNodesTest-1789564933-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:54.839266 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d37e44cf-6bc4-463a-b2e1-112e572744c0 tempest-ServersOnMultiNodesTest-1789564933 tempest-ServersOnMultiNodesTest-1789564933-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/a4abccf0-a093-4148-a260-40ab363b12f6" status: 200 len: 1617 microversion: 2.1 time: 0.342965 Oct 27 03:23:54.846685 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 507/956] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:54 2022] GET /compute/v2.1/servers/a4abccf0-a093-4148-a260-40ab363b12f6 => generated 1617 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:54.853050 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5905076b-9bee-44c2-83d2-b9ad795bebeb tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:54.857211 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5905076b-9bee-44c2-83d2-b9ad795bebeb tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 77dd3d48-fede-491a-b6ce-5ad36a1d7cab] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:54.872616 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5905076b-9bee-44c2-83d2-b9ad795bebeb tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:54.873248 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5905076b-9bee-44c2-83d2-b9ad795bebeb tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:54.873768 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5905076b-9bee-44c2-83d2-b9ad795bebeb tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:54.874590 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5905076b-9bee-44c2-83d2-b9ad795bebeb tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:54.876882 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5905076b-9bee-44c2-83d2-b9ad795bebeb tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:54.877581 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5905076b-9bee-44c2-83d2-b9ad795bebeb tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:54.911834 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=100 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:55.138057 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5905076b-9bee-44c2-83d2-b9ad795bebeb tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:55.162084 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5905076b-9bee-44c2-83d2-b9ad795bebeb tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab" status: 200 len: 1379 microversion: 2.1 time: 0.312672 Oct 27 03:23:55.166171 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 508/957] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:54 2022] GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab => generated 1379 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:55.179908 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-96cc33cb-0bc3-44e1-b94e-800b4811a53f tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:55.183430 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-96cc33cb-0bc3-44e1-b94e-800b4811a53f tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] [instance: acb62f35-0751-41fe-ba8d-78b2357380e9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:55.195063 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-96cc33cb-0bc3-44e1-b94e-800b4811a53f tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:55.196227 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-96cc33cb-0bc3-44e1-b94e-800b4811a53f tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:55.197024 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-96cc33cb-0bc3-44e1-b94e-800b4811a53f tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:55.197966 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-96cc33cb-0bc3-44e1-b94e-800b4811a53f tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:55.198578 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-96cc33cb-0bc3-44e1-b94e-800b4811a53f tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:55.199371 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-96cc33cb-0bc3-44e1-b94e-800b4811a53f tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:55.465726 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-483af933-c214-4c99-a204-d97827428f2f tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/a52fed88-50f8-4dea-b83d-6878adccb024/action" status: 202 len: 0 microversion: 2.1 time: 4.542639 Oct 27 03:23:55.470813 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 450/958] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:23:50 2022] POST /compute/v2.1/servers/a52fed88-50f8-4dea-b83d-6878adccb024/action => generated 0 bytes in 4545 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:23:55.473119 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-530a13ba-4d34-4c0f-9eb8-9ec27b6584fc tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:55.473751 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-530a13ba-4d34-4c0f-9eb8-9ec27b6584fc tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 87ad30f8-b432-45dc-82ff-aed508afddd7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:55.476718 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=14 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:55.499824 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-530a13ba-4d34-4c0f-9eb8-9ec27b6584fc tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:55.499824 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-530a13ba-4d34-4c0f-9eb8-9ec27b6584fc tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:55.499824 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-530a13ba-4d34-4c0f-9eb8-9ec27b6584fc tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:55.501334 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-530a13ba-4d34-4c0f-9eb8-9ec27b6584fc tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:55.502346 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-530a13ba-4d34-4c0f-9eb8-9ec27b6584fc tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:55.503039 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-530a13ba-4d34-4c0f-9eb8-9ec27b6584fc tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:55.758841 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-96cc33cb-0bc3-44e1-b94e-800b4811a53f tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e23378ed283426cbff623265d9bbc96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f033d34ad44397bfda5cba4c041071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:55.776235 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-96cc33cb-0bc3-44e1-b94e-800b4811a53f tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] 10.222.0.20 "GET /compute/v2.1/servers/acb62f35-0751-41fe-ba8d-78b2357380e9" status: 200 len: 1387 microversion: 2.1 time: 0.608118 Oct 27 03:23:55.782339 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 509/959] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:55 2022] GET /compute/v2.1/servers/acb62f35-0751-41fe-ba8d-78b2357380e9 => generated 1387 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:55.796730 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-567a2370-eb71-4243-aec3-dc0bed547479 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:55.798782 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-567a2370-eb71-4243-aec3-dc0bed547479 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] [instance: 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:55.806119 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-530a13ba-4d34-4c0f-9eb8-9ec27b6584fc tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:55.818135 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-567a2370-eb71-4243-aec3-dc0bed547479 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:55.820576 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-567a2370-eb71-4243-aec3-dc0bed547479 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:55.821154 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-567a2370-eb71-4243-aec3-dc0bed547479 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:55.821482 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-530a13ba-4d34-4c0f-9eb8-9ec27b6584fc tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:55.822567 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-567a2370-eb71-4243-aec3-dc0bed547479 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:55.824728 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-530a13ba-4d34-4c0f-9eb8-9ec27b6584fc tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:55.825521 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-567a2370-eb71-4243-aec3-dc0bed547479 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:55.826260 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-567a2370-eb71-4243-aec3-dc0bed547479 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:55.826745 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-530a13ba-4d34-4c0f-9eb8-9ec27b6584fc tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/87ad30f8-b432-45dc-82ff-aed508afddd7" status: 200 len: 1569 microversion: 2.25 time: 0.358306 Oct 27 03:23:55.829643 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 451/960] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:23:55 2022] GET /compute/v2.1/servers/87ad30f8-b432-45dc-82ff-aed508afddd7 => generated 1569 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:23:55.835345 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-8df3357b-c934-476a-9c39-07ccd275b3d0 req-dde118e4-0000-46b8-a6dd-f5f2740843e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77dd3d48-fede-491a-b6ce-5ad36a1d7cab", "tag": "a67227e9-dd6a-4cad-96f1-1d8b74514779"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:23:55.850449 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-8df3357b-c934-476a-9c39-07ccd275b3d0 req-dde118e4-0000-46b8-a6dd-f5f2740843e4 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:55.854859 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-8df3357b-c934-476a-9c39-07ccd275b3d0 req-dde118e4-0000-46b8-a6dd-f5f2740843e4 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:55.854859 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-8df3357b-c934-476a-9c39-07ccd275b3d0 req-dde118e4-0000-46b8-a6dd-f5f2740843e4 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:55.865666 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-8df3357b-c934-476a-9c39-07ccd275b3d0 req-dde118e4-0000-46b8-a6dd-f5f2740843e4 service nova] Creating event network-changed:a67227e9-dd6a-4cad-96f1-1d8b74514779 for instance 77dd3d48-fede-491a-b6ce-5ad36a1d7cab on n-h2-862769-1 Oct 27 03:23:55.871734 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-8df3357b-c934-476a-9c39-07ccd275b3d0 req-dde118e4-0000-46b8-a6dd-f5f2740843e4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040346 Oct 27 03:23:55.873096 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 452/961] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:23:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:23:55.892260 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-625d87e2-89e3-4d8f-8d57-c99cbb9ffc24 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-4252743", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["d0a79872-c316-4bb2-914c-a118831bc023"]}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:23:55.892633 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=13 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:55.965657 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.network.neutron [None req-625d87e2-89e3-4d8f-8d57-c99cbb9ffc24 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] validate_networks() for None {{(pid=121001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:23:56.001220 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-567a2370-eb71-4243-aec3-dc0bed547479 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:56.013181 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-567a2370-eb71-4243-aec3-dc0bed547479 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:56.015484 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-567a2370-eb71-4243-aec3-dc0bed547479 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:56.023748 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-567a2370-eb71-4243-aec3-dc0bed547479 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] 10.222.0.20 "GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503" status: 200 len: 1446 microversion: 2.75 time: 0.240021 Oct 27 03:23:56.024669 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 510/962] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:23:55 2022] GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503 => generated 1446 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:23:56.029537 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-41ab4c31-39eb-4b26-99d6-ddb18210921f tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:56.030469 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-41ab4c31-39eb-4b26-99d6-ddb18210921f tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 521ddedc-cff2-4c42-a737-9590906b07a6] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:56.038265 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-41ab4c31-39eb-4b26-99d6-ddb18210921f tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:56.039165 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-41ab4c31-39eb-4b26-99d6-ddb18210921f tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:56.040732 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-41ab4c31-39eb-4b26-99d6-ddb18210921f tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:56.041694 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-41ab4c31-39eb-4b26-99d6-ddb18210921f tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:56.042409 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-41ab4c31-39eb-4b26-99d6-ddb18210921f tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:56.043350 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-41ab4c31-39eb-4b26-99d6-ddb18210921f tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:56.500136 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-41ab4c31-39eb-4b26-99d6-ddb18210921f tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:56.511112 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-41ab4c31-39eb-4b26-99d6-ddb18210921f tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/521ddedc-cff2-4c42-a737-9590906b07a6" status: 200 len: 1308 microversion: 2.1 time: 0.485054 Oct 27 03:23:56.517736 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 511/963] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:56 2022] GET /compute/v2.1/servers/521ddedc-cff2-4c42-a737-9590906b07a6 => generated 1308 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:56.527461 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-518691ee-b82d-4019-83cd-0fa5c3fc684b tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:56.530786 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-518691ee-b82d-4019-83cd-0fa5c3fc684b tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: a52fed88-50f8-4dea-b83d-6878adccb024] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:56.551038 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-518691ee-b82d-4019-83cd-0fa5c3fc684b tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:56.551340 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-518691ee-b82d-4019-83cd-0fa5c3fc684b tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:56.551918 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-518691ee-b82d-4019-83cd-0fa5c3fc684b tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:56.553341 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-518691ee-b82d-4019-83cd-0fa5c3fc684b tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:56.554376 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-518691ee-b82d-4019-83cd-0fa5c3fc684b tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:56.554938 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-518691ee-b82d-4019-83cd-0fa5c3fc684b tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:56.890375 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-625d87e2-89e3-4d8f-8d57-c99cbb9ffc24 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Flavor limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:23:56.890966 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-625d87e2-89e3-4d8f-8d57-c99cbb9ffc24 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Image limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:23:56.891391 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-625d87e2-89e3-4d8f-8d57-c99cbb9ffc24 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Flavor pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:23:56.891819 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-625d87e2-89e3-4d8f-8d57-c99cbb9ffc24 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Image pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:23:56.892244 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-625d87e2-89e3-4d8f-8d57-c99cbb9ffc24 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:23:56.912450 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-625d87e2-89e3-4d8f-8d57-c99cbb9ffc24 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:56.913054 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-625d87e2-89e3-4d8f-8d57-c99cbb9ffc24 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:56.913679 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-625d87e2-89e3-4d8f-8d57-c99cbb9ffc24 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:56.914616 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-625d87e2-89e3-4d8f-8d57-c99cbb9ffc24 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:56.915090 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-625d87e2-89e3-4d8f-8d57-c99cbb9ffc24 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:56.915530 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-625d87e2-89e3-4d8f-8d57-c99cbb9ffc24 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:56.967828 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-625d87e2-89e3-4d8f-8d57-c99cbb9ffc24 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Getting quotas for project b95729a8c8a14361b7cbf8b2b13900b2. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:23:56.980205 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-625d87e2-89e3-4d8f-8d57-c99cbb9ffc24 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Getting quotas for user 91d1351fcb6b4cd08f176e6d0cc5bb11 and project b95729a8c8a14361b7cbf8b2b13900b2. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:23:57.011402 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-625d87e2-89e3-4d8f-8d57-c99cbb9ffc24 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Going to run 1 instances... {{(pid=121001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:23:57.013915 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-625d87e2-89e3-4d8f-8d57-c99cbb9ffc24 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: b251e3ee-3076-4374-ba01-89488f4d8fc3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:23:57.028547 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-518691ee-b82d-4019-83cd-0fa5c3fc684b tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:57.044784 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-518691ee-b82d-4019-83cd-0fa5c3fc684b tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/a52fed88-50f8-4dea-b83d-6878adccb024" status: 200 len: 1505 microversion: 2.1 time: 0.525132 Oct 27 03:23:57.060867 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 512/964] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:56 2022] GET /compute/v2.1/servers/a52fed88-50f8-4dea-b83d-6878adccb024 => generated 1505 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:57.073474 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a8e1e55f-67bd-4693-b25c-ef10f032d826 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:57.075594 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a8e1e55f-67bd-4693-b25c-ef10f032d826 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:57.090935 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a8e1e55f-67bd-4693-b25c-ef10f032d826 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:57.091754 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a8e1e55f-67bd-4693-b25c-ef10f032d826 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:57.092376 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a8e1e55f-67bd-4693-b25c-ef10f032d826 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:57.093288 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a8e1e55f-67bd-4693-b25c-ef10f032d826 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:57.098432 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a8e1e55f-67bd-4693-b25c-ef10f032d826 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:57.098432 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a8e1e55f-67bd-4693-b25c-ef10f032d826 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:57.223498 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a8e1e55f-67bd-4693-b25c-ef10f032d826 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:57.251415 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a8e1e55f-67bd-4693-b25c-ef10f032d826 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:57.252895 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a8e1e55f-67bd-4693-b25c-ef10f032d826 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:57.256862 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-625d87e2-89e3-4d8f-8d57-c99cbb9ffc24 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.380752 Oct 27 03:23:57.265242 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 453/965] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:23:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1391 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 03:23:57.273501 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a8e1e55f-67bd-4693-b25c-ef10f032d826 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1555 microversion: 2.91 time: 0.211228 Oct 27 03:23:57.280794 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 513/966] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:23:57 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1555 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:23:57.285639 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e4dc9083-207c-4ef1-b627-4e0d8fc1f7bd tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:57.286986 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e4dc9083-207c-4ef1-b627-4e0d8fc1f7bd tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 77dd3d48-fede-491a-b6ce-5ad36a1d7cab] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:57.294568 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-6e4da2d8-872e-468e-b985-efdd2874605f req-0fb789b3-e21a-44bb-9275-91f6d63e0b31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "521ddedc-cff2-4c42-a737-9590906b07a6", "tag": "2ccfa709-ec86-42d4-88a8-c7f4dcb17bbe"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:23:57.323424 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e4dc9083-207c-4ef1-b627-4e0d8fc1f7bd tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:57.326602 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e4dc9083-207c-4ef1-b627-4e0d8fc1f7bd tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:57.330268 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e4dc9083-207c-4ef1-b627-4e0d8fc1f7bd tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:57.332752 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e4dc9083-207c-4ef1-b627-4e0d8fc1f7bd tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:57.341017 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e4dc9083-207c-4ef1-b627-4e0d8fc1f7bd tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:57.346378 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-6e4da2d8-872e-468e-b985-efdd2874605f req-0fb789b3-e21a-44bb-9275-91f6d63e0b31 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:57.347958 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e4dc9083-207c-4ef1-b627-4e0d8fc1f7bd tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:57.348832 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-6e4da2d8-872e-468e-b985-efdd2874605f req-0fb789b3-e21a-44bb-9275-91f6d63e0b31 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:57.349283 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-6e4da2d8-872e-468e-b985-efdd2874605f req-0fb789b3-e21a-44bb-9275-91f6d63e0b31 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:57.379872 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-6e4da2d8-872e-468e-b985-efdd2874605f req-0fb789b3-e21a-44bb-9275-91f6d63e0b31 service nova] Creating event network-changed:2ccfa709-ec86-42d4-88a8-c7f4dcb17bbe for instance 521ddedc-cff2-4c42-a737-9590906b07a6 on n-h1-862769-1 Oct 27 03:23:57.395908 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-6e4da2d8-872e-468e-b985-efdd2874605f req-0fb789b3-e21a-44bb-9275-91f6d63e0b31 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111405 Oct 27 03:23:57.396789 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 514/967] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:23:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:23:57.410669 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1a8546bd-9b0e-4421-8f8e-7f99f5e8c8a3 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:57.411423 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1a8546bd-9b0e-4421-8f8e-7f99f5e8c8a3 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] [instance: acb62f35-0751-41fe-ba8d-78b2357380e9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:57.427541 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1a8546bd-9b0e-4421-8f8e-7f99f5e8c8a3 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:57.428072 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1a8546bd-9b0e-4421-8f8e-7f99f5e8c8a3 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:57.428530 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1a8546bd-9b0e-4421-8f8e-7f99f5e8c8a3 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:57.433072 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1a8546bd-9b0e-4421-8f8e-7f99f5e8c8a3 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:57.434346 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1a8546bd-9b0e-4421-8f8e-7f99f5e8c8a3 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:57.435769 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1a8546bd-9b0e-4421-8f8e-7f99f5e8c8a3 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:57.533517 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=21 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:57.735521 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e4dc9083-207c-4ef1-b627-4e0d8fc1f7bd tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:57.744268 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e4dc9083-207c-4ef1-b627-4e0d8fc1f7bd tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab" status: 200 len: 1379 microversion: 2.1 time: 0.474687 Oct 27 03:23:57.764828 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 454/968] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:57 2022] GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab => generated 1379 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:57.764946 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1a8546bd-9b0e-4421-8f8e-7f99f5e8c8a3 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e23378ed283426cbff623265d9bbc96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f033d34ad44397bfda5cba4c041071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:57.765051 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-85c4885b-16b5-4eb6-bf59-af39c530d79e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:57.765051 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-85c4885b-16b5-4eb6-bf59-af39c530d79e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 87ad30f8-b432-45dc-82ff-aed508afddd7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:57.766684 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1a8546bd-9b0e-4421-8f8e-7f99f5e8c8a3 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] 10.222.0.20 "GET /compute/v2.1/servers/acb62f35-0751-41fe-ba8d-78b2357380e9" status: 200 len: 1387 microversion: 2.1 time: 0.368603 Oct 27 03:23:57.770977 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 515/969] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:57 2022] GET /compute/v2.1/servers/acb62f35-0751-41fe-ba8d-78b2357380e9 => generated 1387 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:57.776909 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a364f4e1-ed97-4837-afe5-6a66797187d8 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:57.778693 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a364f4e1-ed97-4837-afe5-6a66797187d8 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] [instance: 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:57.795650 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-85c4885b-16b5-4eb6-bf59-af39c530d79e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:57.796433 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-85c4885b-16b5-4eb6-bf59-af39c530d79e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:57.797646 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-85c4885b-16b5-4eb6-bf59-af39c530d79e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:57.798637 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-85c4885b-16b5-4eb6-bf59-af39c530d79e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:57.799333 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-85c4885b-16b5-4eb6-bf59-af39c530d79e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:57.806150 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-85c4885b-16b5-4eb6-bf59-af39c530d79e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:57.806369 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a364f4e1-ed97-4837-afe5-6a66797187d8 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:57.806369 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a364f4e1-ed97-4837-afe5-6a66797187d8 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:57.806369 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a364f4e1-ed97-4837-afe5-6a66797187d8 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:57.806369 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a364f4e1-ed97-4837-afe5-6a66797187d8 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:57.815484 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a364f4e1-ed97-4837-afe5-6a66797187d8 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:57.815484 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a364f4e1-ed97-4837-afe5-6a66797187d8 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:57.959058 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a364f4e1-ed97-4837-afe5-6a66797187d8 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:57.969181 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a364f4e1-ed97-4837-afe5-6a66797187d8 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:57.970891 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a364f4e1-ed97-4837-afe5-6a66797187d8 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:57.977386 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a364f4e1-ed97-4837-afe5-6a66797187d8 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] 10.222.0.20 "GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503" status: 200 len: 1446 microversion: 2.75 time: 0.205106 Oct 27 03:23:57.978371 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 516/970] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:23:57 2022] GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503 => generated 1446 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:23:57.984011 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d8879668-a49b-4c9e-99ae-88398aa3c9b2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:57.985220 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d8879668-a49b-4c9e-99ae-88398aa3c9b2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: b251e3ee-3076-4374-ba01-89488f4d8fc3] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:58.045234 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d8879668-a49b-4c9e-99ae-88398aa3c9b2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:58.048081 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-85c4885b-16b5-4eb6-bf59-af39c530d79e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:58.057982 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-85c4885b-16b5-4eb6-bf59-af39c530d79e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:58.059560 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-85c4885b-16b5-4eb6-bf59-af39c530d79e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:58.059708 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d8879668-a49b-4c9e-99ae-88398aa3c9b2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/b251e3ee-3076-4374-ba01-89488f4d8fc3" status: 200 len: 1214 microversion: 2.1 time: 0.079677 Oct 27 03:23:58.070533 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 517/971] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:57 2022] GET /compute/v2.1/servers/b251e3ee-3076-4374-ba01-89488f4d8fc3 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:58.070714 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-85c4885b-16b5-4eb6-bf59-af39c530d79e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/87ad30f8-b432-45dc-82ff-aed508afddd7" status: 200 len: 1569 microversion: 2.25 time: 0.304689 Oct 27 03:23:58.070810 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-91402d16-358c-48ea-ad3c-1970d605beb9 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:58.070810 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-91402d16-358c-48ea-ad3c-1970d605beb9 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 521ddedc-cff2-4c42-a737-9590906b07a6] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:58.070978 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 455/972] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:23:57 2022] GET /compute/v2.1/servers/87ad30f8-b432-45dc-82ff-aed508afddd7 => generated 1569 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:23:58.077496 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-91402d16-358c-48ea-ad3c-1970d605beb9 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:58.077496 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-91402d16-358c-48ea-ad3c-1970d605beb9 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:58.077496 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-91402d16-358c-48ea-ad3c-1970d605beb9 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:58.077496 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-91402d16-358c-48ea-ad3c-1970d605beb9 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:58.077897 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-91402d16-358c-48ea-ad3c-1970d605beb9 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:58.077897 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-91402d16-358c-48ea-ad3c-1970d605beb9 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:58.084518 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4bec8c52-0ce1-447a-847b-0eca645f0fcb tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:58.085189 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4bec8c52-0ce1-447a-847b-0eca645f0fcb tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: a52fed88-50f8-4dea-b83d-6878adccb024] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:58.091491 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4bec8c52-0ce1-447a-847b-0eca645f0fcb tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:58.091991 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4bec8c52-0ce1-447a-847b-0eca645f0fcb tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:58.092437 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4bec8c52-0ce1-447a-847b-0eca645f0fcb tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:58.093160 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4bec8c52-0ce1-447a-847b-0eca645f0fcb tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:58.094195 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4bec8c52-0ce1-447a-847b-0eca645f0fcb tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:58.094645 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4bec8c52-0ce1-447a-847b-0eca645f0fcb tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:58.216339 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-91402d16-358c-48ea-ad3c-1970d605beb9 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:58.226675 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-91402d16-358c-48ea-ad3c-1970d605beb9 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/521ddedc-cff2-4c42-a737-9590906b07a6" status: 200 len: 1308 microversion: 2.1 time: 0.165139 Oct 27 03:23:58.227267 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 518/973] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:58 2022] GET /compute/v2.1/servers/521ddedc-cff2-4c42-a737-9590906b07a6 => generated 1308 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:58.236735 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4bec8c52-0ce1-447a-847b-0eca645f0fcb tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:58.245503 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4bec8c52-0ce1-447a-847b-0eca645f0fcb tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/a52fed88-50f8-4dea-b83d-6878adccb024" status: 200 len: 1505 microversion: 2.1 time: 0.173874 Oct 27 03:23:58.246114 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 456/974] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:58 2022] GET /compute/v2.1/servers/a52fed88-50f8-4dea-b83d-6878adccb024 => generated 1505 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:58.313595 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9ed9007c-7f12-4f5b-860e-e8a404b49c1f tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:58.314242 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9ed9007c-7f12-4f5b-860e-e8a404b49c1f tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:58.320372 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9ed9007c-7f12-4f5b-860e-e8a404b49c1f tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:58.320875 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9ed9007c-7f12-4f5b-860e-e8a404b49c1f tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:58.321319 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9ed9007c-7f12-4f5b-860e-e8a404b49c1f tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:58.322028 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9ed9007c-7f12-4f5b-860e-e8a404b49c1f tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:58.322517 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9ed9007c-7f12-4f5b-860e-e8a404b49c1f tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:58.322952 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9ed9007c-7f12-4f5b-860e-e8a404b49c1f tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:58.389774 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9ed9007c-7f12-4f5b-860e-e8a404b49c1f tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:58.398329 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9ed9007c-7f12-4f5b-860e-e8a404b49c1f tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:58.399783 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9ed9007c-7f12-4f5b-860e-e8a404b49c1f tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:58.405247 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9ed9007c-7f12-4f5b-860e-e8a404b49c1f tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1555 microversion: 2.91 time: 0.095222 Oct 27 03:23:58.405394 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 519/975] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:23:58 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1555 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:23:58.500522 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-dd964c66-91cd-4e42-849e-209dc80084ff req-47523cbc-5a5a-44dd-9c21-c770fcf5c4f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acb62f35-0751-41fe-ba8d-78b2357380e9", "tag": "3f3c7991-4bc4-4933-8fde-a37f0e0f65a9"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:23:58.516873 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-dd964c66-91cd-4e42-849e-209dc80084ff req-47523cbc-5a5a-44dd-9c21-c770fcf5c4f9 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:58.517359 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-dd964c66-91cd-4e42-849e-209dc80084ff req-47523cbc-5a5a-44dd-9c21-c770fcf5c4f9 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:58.517776 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-dd964c66-91cd-4e42-849e-209dc80084ff req-47523cbc-5a5a-44dd-9c21-c770fcf5c4f9 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:58.522367 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:58.534294 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-dd964c66-91cd-4e42-849e-209dc80084ff req-47523cbc-5a5a-44dd-9c21-c770fcf5c4f9 service nova] Creating event network-changed:3f3c7991-4bc4-4933-8fde-a37f0e0f65a9 for instance acb62f35-0751-41fe-ba8d-78b2357380e9 on n-h1-862769-1 Oct 27 03:23:58.540055 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-dd964c66-91cd-4e42-849e-209dc80084ff req-47523cbc-5a5a-44dd-9c21-c770fcf5c4f9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042948 Oct 27 03:23:58.541189 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 457/976] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:23:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:23:58.616449 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-1b1fce37-105a-4c24-bf71-ba1153bcf49b req-e15add4a-f5a3-44f6-bafd-7c28ca90cae0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77dd3d48-fede-491a-b6ce-5ad36a1d7cab", "name": "network-vif-plugged", "status": "completed", "tag": "a67227e9-dd6a-4cad-96f1-1d8b74514779"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:23:58.626703 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-1b1fce37-105a-4c24-bf71-ba1153bcf49b req-e15add4a-f5a3-44f6-bafd-7c28ca90cae0 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:58.627194 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-1b1fce37-105a-4c24-bf71-ba1153bcf49b req-e15add4a-f5a3-44f6-bafd-7c28ca90cae0 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:58.627892 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-1b1fce37-105a-4c24-bf71-ba1153bcf49b req-e15add4a-f5a3-44f6-bafd-7c28ca90cae0 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:58.642693 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-1b1fce37-105a-4c24-bf71-ba1153bcf49b req-e15add4a-f5a3-44f6-bafd-7c28ca90cae0 service nova] Creating event network-vif-plugged:a67227e9-dd6a-4cad-96f1-1d8b74514779 for instance 77dd3d48-fede-491a-b6ce-5ad36a1d7cab on n-h2-862769-1 Oct 27 03:23:58.652157 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-1b1fce37-105a-4c24-bf71-ba1153bcf49b req-e15add4a-f5a3-44f6-bafd-7c28ca90cae0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039263 Oct 27 03:23:58.656774 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 520/977] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:23:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:23:58.780650 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ef108bc3-fe74-4383-9ece-11e5ab4eef00 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:58.782823 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ef108bc3-fe74-4383-9ece-11e5ab4eef00 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 77dd3d48-fede-491a-b6ce-5ad36a1d7cab] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:58.794141 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:23:58.802405 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-26b6357a-348e-4e6f-a17e-dffc2f534d60 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:58.807659 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-26b6357a-348e-4e6f-a17e-dffc2f534d60 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] [instance: acb62f35-0751-41fe-ba8d-78b2357380e9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:58.809645 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ef108bc3-fe74-4383-9ece-11e5ab4eef00 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:58.812146 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ef108bc3-fe74-4383-9ece-11e5ab4eef00 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:58.813461 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ef108bc3-fe74-4383-9ece-11e5ab4eef00 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:58.814444 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-26b6357a-348e-4e6f-a17e-dffc2f534d60 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:58.815338 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ef108bc3-fe74-4383-9ece-11e5ab4eef00 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:58.815778 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-26b6357a-348e-4e6f-a17e-dffc2f534d60 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:58.825664 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ef108bc3-fe74-4383-9ece-11e5ab4eef00 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:58.826521 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-26b6357a-348e-4e6f-a17e-dffc2f534d60 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:58.827249 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ef108bc3-fe74-4383-9ece-11e5ab4eef00 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:58.829517 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-26b6357a-348e-4e6f-a17e-dffc2f534d60 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:58.833874 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-26b6357a-348e-4e6f-a17e-dffc2f534d60 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:58.834617 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-26b6357a-348e-4e6f-a17e-dffc2f534d60 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:59.033068 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-26b6357a-348e-4e6f-a17e-dffc2f534d60 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e23378ed283426cbff623265d9bbc96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f033d34ad44397bfda5cba4c041071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:59.044928 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-26b6357a-348e-4e6f-a17e-dffc2f534d60 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] 10.222.0.20 "GET /compute/v2.1/servers/acb62f35-0751-41fe-ba8d-78b2357380e9" status: 200 len: 1387 microversion: 2.1 time: 0.247170 Oct 27 03:23:59.045994 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 521/978] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:58 2022] GET /compute/v2.1/servers/acb62f35-0751-41fe-ba8d-78b2357380e9 => generated 1387 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:59.048044 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ef108bc3-fe74-4383-9ece-11e5ab4eef00 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:59.052019 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-dc0d4992-e8da-47a8-83e8-e54f2d02e825 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:59.052962 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-dc0d4992-e8da-47a8-83e8-e54f2d02e825 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] [instance: 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:59.058079 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ef108bc3-fe74-4383-9ece-11e5ab4eef00 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab" status: 200 len: 1379 microversion: 2.1 time: 0.283723 Oct 27 03:23:59.060697 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dc0d4992-e8da-47a8-83e8-e54f2d02e825 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:59.061380 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dc0d4992-e8da-47a8-83e8-e54f2d02e825 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:59.070257 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dc0d4992-e8da-47a8-83e8-e54f2d02e825 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:59.070429 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 458/979] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:58 2022] GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab => generated 1379 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:59.070640 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dc0d4992-e8da-47a8-83e8-e54f2d02e825 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:59.070640 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dc0d4992-e8da-47a8-83e8-e54f2d02e825 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:59.070640 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dc0d4992-e8da-47a8-83e8-e54f2d02e825 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:59.087144 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-32f92aa7-0faa-4c75-af12-3c046a0abdba tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:59.088644 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-32f92aa7-0faa-4c75-af12-3c046a0abdba tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: b251e3ee-3076-4374-ba01-89488f4d8fc3] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:59.102549 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-32f92aa7-0faa-4c75-af12-3c046a0abdba tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:59.103049 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-32f92aa7-0faa-4c75-af12-3c046a0abdba tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:59.103494 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-32f92aa7-0faa-4c75-af12-3c046a0abdba tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:59.107665 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-32f92aa7-0faa-4c75-af12-3c046a0abdba tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:59.107665 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-32f92aa7-0faa-4c75-af12-3c046a0abdba tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:59.107665 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-32f92aa7-0faa-4c75-af12-3c046a0abdba tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:59.148663 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-dc0d4992-e8da-47a8-83e8-e54f2d02e825 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:59.157259 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-dc0d4992-e8da-47a8-83e8-e54f2d02e825 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:59.159046 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-dc0d4992-e8da-47a8-83e8-e54f2d02e825 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:59.168721 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-dc0d4992-e8da-47a8-83e8-e54f2d02e825 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] 10.222.0.20 "GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503" status: 200 len: 1446 microversion: 2.75 time: 0.120824 Oct 27 03:23:59.170236 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 522/980] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:23:59 2022] GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503 => generated 1446 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:23:59.175333 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b9765ff9-5385-46c7-8f79-cee05dfa01bf tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:59.176240 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b9765ff9-5385-46c7-8f79-cee05dfa01bf tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 87ad30f8-b432-45dc-82ff-aed508afddd7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:59.188062 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b9765ff9-5385-46c7-8f79-cee05dfa01bf tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:59.189006 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b9765ff9-5385-46c7-8f79-cee05dfa01bf tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:59.189873 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b9765ff9-5385-46c7-8f79-cee05dfa01bf tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:59.190889 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b9765ff9-5385-46c7-8f79-cee05dfa01bf tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:59.191582 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b9765ff9-5385-46c7-8f79-cee05dfa01bf tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:59.192240 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b9765ff9-5385-46c7-8f79-cee05dfa01bf tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:59.223066 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-32f92aa7-0faa-4c75-af12-3c046a0abdba tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:59.231652 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-32f92aa7-0faa-4c75-af12-3c046a0abdba tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/b251e3ee-3076-4374-ba01-89488f4d8fc3" status: 200 len: 1218 microversion: 2.1 time: 0.149995 Oct 27 03:23:59.232941 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 459/981] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:59 2022] GET /compute/v2.1/servers/b251e3ee-3076-4374-ba01-89488f4d8fc3 => generated 1218 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:59.251487 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-70c86aab-423e-4af4-9275-ad3c9da4b339 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:59.252407 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-70c86aab-423e-4af4-9275-ad3c9da4b339 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 521ddedc-cff2-4c42-a737-9590906b07a6] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:59.258848 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-70c86aab-423e-4af4-9275-ad3c9da4b339 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:59.259311 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-70c86aab-423e-4af4-9275-ad3c9da4b339 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:59.259784 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-70c86aab-423e-4af4-9275-ad3c9da4b339 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:59.260523 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-70c86aab-423e-4af4-9275-ad3c9da4b339 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:59.261139 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-70c86aab-423e-4af4-9275-ad3c9da4b339 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:59.261580 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-70c86aab-423e-4af4-9275-ad3c9da4b339 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:59.438207 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-70c86aab-423e-4af4-9275-ad3c9da4b339 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:59.447985 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-70c86aab-423e-4af4-9275-ad3c9da4b339 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/521ddedc-cff2-4c42-a737-9590906b07a6" status: 200 len: 1308 microversion: 2.1 time: 0.201199 Oct 27 03:23:59.463663 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 460/982] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:59 2022] GET /compute/v2.1/servers/521ddedc-cff2-4c42-a737-9590906b07a6 => generated 1308 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:59.468736 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c3fd8106-a112-4d12-bc00-b955059bfc08 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:59.469439 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c3fd8106-a112-4d12-bc00-b955059bfc08 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: a52fed88-50f8-4dea-b83d-6878adccb024] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:59.475927 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c3fd8106-a112-4d12-bc00-b955059bfc08 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:59.476534 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c3fd8106-a112-4d12-bc00-b955059bfc08 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:59.477025 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c3fd8106-a112-4d12-bc00-b955059bfc08 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:59.477771 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c3fd8106-a112-4d12-bc00-b955059bfc08 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:59.478347 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c3fd8106-a112-4d12-bc00-b955059bfc08 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:59.478791 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c3fd8106-a112-4d12-bc00-b955059bfc08 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:59.641379 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b9765ff9-5385-46c7-8f79-cee05dfa01bf tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:59.653243 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b9765ff9-5385-46c7-8f79-cee05dfa01bf tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:59.653494 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c3fd8106-a112-4d12-bc00-b955059bfc08 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:59.655193 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b9765ff9-5385-46c7-8f79-cee05dfa01bf tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:59.657028 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b9765ff9-5385-46c7-8f79-cee05dfa01bf tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/87ad30f8-b432-45dc-82ff-aed508afddd7" status: 200 len: 1569 microversion: 2.25 time: 0.485072 Oct 27 03:23:59.658396 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 523/983] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:23:59 2022] GET /compute/v2.1/servers/87ad30f8-b432-45dc-82ff-aed508afddd7 => generated 1569 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:23:59.663289 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f1f45eaf-859b-4832-9a6a-6753bb5ef506 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:23:59.664102 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f1f45eaf-859b-4832-9a6a-6753bb5ef506 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:23:59.669983 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f1f45eaf-859b-4832-9a6a-6753bb5ef506 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:59.670692 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f1f45eaf-859b-4832-9a6a-6753bb5ef506 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:59.672509 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f1f45eaf-859b-4832-9a6a-6753bb5ef506 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:59.673521 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f1f45eaf-859b-4832-9a6a-6753bb5ef506 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:23:59.673642 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c3fd8106-a112-4d12-bc00-b955059bfc08 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/a52fed88-50f8-4dea-b83d-6878adccb024" status: 200 len: 1505 microversion: 2.1 time: 0.208642 Oct 27 03:23:59.675419 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 461/984] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:23:59 2022] GET /compute/v2.1/servers/a52fed88-50f8-4dea-b83d-6878adccb024 => generated 1505 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:23:59.676023 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f1f45eaf-859b-4832-9a6a-6753bb5ef506 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:23:59.676822 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f1f45eaf-859b-4832-9a6a-6753bb5ef506 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:23:59.753475 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f1f45eaf-859b-4832-9a6a-6753bb5ef506 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:59.763015 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f1f45eaf-859b-4832-9a6a-6753bb5ef506 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:59.764792 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f1f45eaf-859b-4832-9a6a-6753bb5ef506 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:23:59.770511 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f1f45eaf-859b-4832-9a6a-6753bb5ef506 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1555 microversion: 2.91 time: 0.110886 Oct 27 03:23:59.771385 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 524/985] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:23:59 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1555 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:24:00.073427 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c4d443c2-adc2-47b7-b9e3-d6b284ac3027 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:00.074162 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c4d443c2-adc2-47b7-b9e3-d6b284ac3027 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] [instance: acb62f35-0751-41fe-ba8d-78b2357380e9] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:00.087208 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c4d443c2-adc2-47b7-b9e3-d6b284ac3027 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:00.088949 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c4d443c2-adc2-47b7-b9e3-d6b284ac3027 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:00.089498 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c4d443c2-adc2-47b7-b9e3-d6b284ac3027 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:00.091236 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c4d443c2-adc2-47b7-b9e3-d6b284ac3027 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:00.092412 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c4d443c2-adc2-47b7-b9e3-d6b284ac3027 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:00.093071 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5e9d062a-624e-4858-aa13-31f50b815e5b tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:00.093719 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5e9d062a-624e-4858-aa13-31f50b815e5b tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 77dd3d48-fede-491a-b6ce-5ad36a1d7cab] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:00.094195 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c4d443c2-adc2-47b7-b9e3-d6b284ac3027 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:00.101564 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5e9d062a-624e-4858-aa13-31f50b815e5b tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:00.106021 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5e9d062a-624e-4858-aa13-31f50b815e5b tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:00.106544 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5e9d062a-624e-4858-aa13-31f50b815e5b tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:00.107296 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5e9d062a-624e-4858-aa13-31f50b815e5b tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:00.112417 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5e9d062a-624e-4858-aa13-31f50b815e5b tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:00.112417 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5e9d062a-624e-4858-aa13-31f50b815e5b tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:00.399080 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c4d443c2-adc2-47b7-b9e3-d6b284ac3027 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e23378ed283426cbff623265d9bbc96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f033d34ad44397bfda5cba4c041071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:00.409002 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c4d443c2-adc2-47b7-b9e3-d6b284ac3027 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] 10.222.0.20 "GET /compute/v2.1/servers/acb62f35-0751-41fe-ba8d-78b2357380e9" status: 200 len: 1387 microversion: 2.1 time: 0.341055 Oct 27 03:24:00.410249 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 462/986] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:00 2022] GET /compute/v2.1/servers/acb62f35-0751-41fe-ba8d-78b2357380e9 => generated 1387 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:00.415950 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-eaa4a0e0-94fd-4b4c-bdd3-ac1f4cd81916 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:00.416694 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-eaa4a0e0-94fd-4b4c-bdd3-ac1f4cd81916 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] [instance: 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:00.429953 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eaa4a0e0-94fd-4b4c-bdd3-ac1f4cd81916 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:00.430953 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eaa4a0e0-94fd-4b4c-bdd3-ac1f4cd81916 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:00.431627 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eaa4a0e0-94fd-4b4c-bdd3-ac1f4cd81916 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:00.433144 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eaa4a0e0-94fd-4b4c-bdd3-ac1f4cd81916 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:00.433872 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eaa4a0e0-94fd-4b4c-bdd3-ac1f4cd81916 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:00.434591 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eaa4a0e0-94fd-4b4c-bdd3-ac1f4cd81916 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:00.463349 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5e9d062a-624e-4858-aa13-31f50b815e5b tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:00.472764 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5e9d062a-624e-4858-aa13-31f50b815e5b tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab" status: 200 len: 1379 microversion: 2.1 time: 0.383508 Oct 27 03:24:00.473291 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 525/987] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:00 2022] GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab => generated 1379 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:00.488021 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-bd6c877e-fde5-4497-a464-b49d8ee33bbc tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:00.488654 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-bd6c877e-fde5-4497-a464-b49d8ee33bbc tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: b251e3ee-3076-4374-ba01-89488f4d8fc3] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:00.509613 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bd6c877e-fde5-4497-a464-b49d8ee33bbc tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:00.510159 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bd6c877e-fde5-4497-a464-b49d8ee33bbc tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:00.510601 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bd6c877e-fde5-4497-a464-b49d8ee33bbc tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:00.511320 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bd6c877e-fde5-4497-a464-b49d8ee33bbc tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:00.511778 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bd6c877e-fde5-4497-a464-b49d8ee33bbc tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:00.512222 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bd6c877e-fde5-4497-a464-b49d8ee33bbc tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:00.544366 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-eaa4a0e0-94fd-4b4c-bdd3-ac1f4cd81916 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:00.555641 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-eaa4a0e0-94fd-4b4c-bdd3-ac1f4cd81916 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:00.557085 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-eaa4a0e0-94fd-4b4c-bdd3-ac1f4cd81916 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:00.572300 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-eaa4a0e0-94fd-4b4c-bdd3-ac1f4cd81916 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] 10.222.0.20 "GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503" status: 200 len: 1446 microversion: 2.75 time: 0.159455 Oct 27 03:24:00.587171 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 463/988] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:00 2022] GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503 => generated 1446 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:24:00.591514 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-bd6c877e-fde5-4497-a464-b49d8ee33bbc tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:00.601334 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b1fee77c-4bd1-465d-8bd1-b289346e8678 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:00.601956 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b1fee77c-4bd1-465d-8bd1-b289346e8678 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 521ddedc-cff2-4c42-a737-9590906b07a6] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:00.604086 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-bd6c877e-fde5-4497-a464-b49d8ee33bbc tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/b251e3ee-3076-4374-ba01-89488f4d8fc3" status: 200 len: 1266 microversion: 2.1 time: 0.129747 Oct 27 03:24:00.607467 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 526/989] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:00 2022] GET /compute/v2.1/servers/b251e3ee-3076-4374-ba01-89488f4d8fc3 => generated 1266 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:00.608386 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b1fee77c-4bd1-465d-8bd1-b289346e8678 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:00.609936 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b1fee77c-4bd1-465d-8bd1-b289346e8678 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:00.610415 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b1fee77c-4bd1-465d-8bd1-b289346e8678 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:00.611132 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b1fee77c-4bd1-465d-8bd1-b289346e8678 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:00.611587 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b1fee77c-4bd1-465d-8bd1-b289346e8678 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:00.612010 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b1fee77c-4bd1-465d-8bd1-b289346e8678 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:00.685882 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ec9a524d-d3fd-4461-8010-020c013db2b6 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:00.693641 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ec9a524d-d3fd-4461-8010-020c013db2b6 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 87ad30f8-b432-45dc-82ff-aed508afddd7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:00.708176 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ec9a524d-d3fd-4461-8010-020c013db2b6 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:00.709039 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ec9a524d-d3fd-4461-8010-020c013db2b6 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:00.710530 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ec9a524d-d3fd-4461-8010-020c013db2b6 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:00.711514 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ec9a524d-d3fd-4461-8010-020c013db2b6 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:00.712189 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ec9a524d-d3fd-4461-8010-020c013db2b6 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:00.712834 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ec9a524d-d3fd-4461-8010-020c013db2b6 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:00.758882 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=100 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:24:00.876744 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b1fee77c-4bd1-465d-8bd1-b289346e8678 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:00.891115 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b1fee77c-4bd1-465d-8bd1-b289346e8678 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/521ddedc-cff2-4c42-a737-9590906b07a6" status: 200 len: 1308 microversion: 2.1 time: 0.302207 Oct 27 03:24:00.892296 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 464/990] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:00 2022] GET /compute/v2.1/servers/521ddedc-cff2-4c42-a737-9590906b07a6 => generated 1308 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:00.897436 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-eee77f3f-ba27-44c5-b0ec-56a910097490 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:00.898243 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-eee77f3f-ba27-44c5-b0ec-56a910097490 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: a52fed88-50f8-4dea-b83d-6878adccb024] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:00.904431 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eee77f3f-ba27-44c5-b0ec-56a910097490 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:00.905153 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eee77f3f-ba27-44c5-b0ec-56a910097490 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:00.905851 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eee77f3f-ba27-44c5-b0ec-56a910097490 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:00.907492 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eee77f3f-ba27-44c5-b0ec-56a910097490 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:00.908101 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eee77f3f-ba27-44c5-b0ec-56a910097490 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:00.908699 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eee77f3f-ba27-44c5-b0ec-56a910097490 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:01.137305 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ec9a524d-d3fd-4461-8010-020c013db2b6 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:01.138344 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-eee77f3f-ba27-44c5-b0ec-56a910097490 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:01.156954 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ec9a524d-d3fd-4461-8010-020c013db2b6 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:01.157878 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-eee77f3f-ba27-44c5-b0ec-56a910097490 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/a52fed88-50f8-4dea-b83d-6878adccb024" status: 200 len: 1505 microversion: 2.1 time: 0.259929 Oct 27 03:24:01.160346 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 465/991] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:00 2022] GET /compute/v2.1/servers/a52fed88-50f8-4dea-b83d-6878adccb024 => generated 1505 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:01.162326 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ec9a524d-d3fd-4461-8010-020c013db2b6 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:01.165363 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ec9a524d-d3fd-4461-8010-020c013db2b6 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/87ad30f8-b432-45dc-82ff-aed508afddd7" status: 200 len: 1569 microversion: 2.25 time: 0.483808 Oct 27 03:24:01.166132 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 527/992] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:00 2022] GET /compute/v2.1/servers/87ad30f8-b432-45dc-82ff-aed508afddd7 => generated 1569 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:24:01.188556 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ec9185fd-1c8d-41dd-a923-5a7d71c9c7f9 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:01.189436 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ec9185fd-1c8d-41dd-a923-5a7d71c9c7f9 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:01.196433 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ec9185fd-1c8d-41dd-a923-5a7d71c9c7f9 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:01.197107 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ec9185fd-1c8d-41dd-a923-5a7d71c9c7f9 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:01.197786 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ec9185fd-1c8d-41dd-a923-5a7d71c9c7f9 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:01.198741 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ec9185fd-1c8d-41dd-a923-5a7d71c9c7f9 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:01.199357 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ec9185fd-1c8d-41dd-a923-5a7d71c9c7f9 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:01.200379 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ec9185fd-1c8d-41dd-a923-5a7d71c9c7f9 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:01.280651 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ec9185fd-1c8d-41dd-a923-5a7d71c9c7f9 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:01.290284 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ec9185fd-1c8d-41dd-a923-5a7d71c9c7f9 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:01.291894 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ec9185fd-1c8d-41dd-a923-5a7d71c9c7f9 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:01.297191 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ec9185fd-1c8d-41dd-a923-5a7d71c9c7f9 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1555 microversion: 2.91 time: 0.135605 Oct 27 03:24:01.297890 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 466/993] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:01 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1555 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:24:01.439052 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ca92b089-dc20-42ee-b7d7-a8c6c1cea1e4 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:01.440181 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ca92b089-dc20-42ee-b7d7-a8c6c1cea1e4 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] [instance: acb62f35-0751-41fe-ba8d-78b2357380e9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:01.445743 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=100 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:24:01.450167 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ca92b089-dc20-42ee-b7d7-a8c6c1cea1e4 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:01.450915 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ca92b089-dc20-42ee-b7d7-a8c6c1cea1e4 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:01.451557 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ca92b089-dc20-42ee-b7d7-a8c6c1cea1e4 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:01.455354 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ca92b089-dc20-42ee-b7d7-a8c6c1cea1e4 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:01.455354 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ca92b089-dc20-42ee-b7d7-a8c6c1cea1e4 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:01.455354 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ca92b089-dc20-42ee-b7d7-a8c6c1cea1e4 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:01.506697 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-83a4a84b-bcbf-40f8-b0d3-2c31d4dabf16 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:01.508322 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-83a4a84b-bcbf-40f8-b0d3-2c31d4dabf16 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 77dd3d48-fede-491a-b6ce-5ad36a1d7cab] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:01.516063 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-83a4a84b-bcbf-40f8-b0d3-2c31d4dabf16 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:01.516655 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-83a4a84b-bcbf-40f8-b0d3-2c31d4dabf16 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:01.517184 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-83a4a84b-bcbf-40f8-b0d3-2c31d4dabf16 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:01.518200 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-83a4a84b-bcbf-40f8-b0d3-2c31d4dabf16 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:01.518990 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-83a4a84b-bcbf-40f8-b0d3-2c31d4dabf16 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:01.519491 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-83a4a84b-bcbf-40f8-b0d3-2c31d4dabf16 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:01.685285 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-83a4a84b-bcbf-40f8-b0d3-2c31d4dabf16 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:01.702701 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-83a4a84b-bcbf-40f8-b0d3-2c31d4dabf16 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab" status: 200 len: 1528 microversion: 2.1 time: 0.205074 Oct 27 03:24:01.703342 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 467/994] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:01 2022] GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab => generated 1528 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:01.715928 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ab6862aa-3bc1-4dd7-9ed2-40f84d07dc39 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:01.715928 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ab6862aa-3bc1-4dd7-9ed2-40f84d07dc39 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] [instance: 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:01.722988 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ab6862aa-3bc1-4dd7-9ed2-40f84d07dc39 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:01.722988 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ab6862aa-3bc1-4dd7-9ed2-40f84d07dc39 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:01.722988 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ab6862aa-3bc1-4dd7-9ed2-40f84d07dc39 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:01.722988 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ab6862aa-3bc1-4dd7-9ed2-40f84d07dc39 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:01.723381 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ab6862aa-3bc1-4dd7-9ed2-40f84d07dc39 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:01.723381 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ab6862aa-3bc1-4dd7-9ed2-40f84d07dc39 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:01.782182 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ca92b089-dc20-42ee-b7d7-a8c6c1cea1e4 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e23378ed283426cbff623265d9bbc96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f033d34ad44397bfda5cba4c041071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:01.803194 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ab6862aa-3bc1-4dd7-9ed2-40f84d07dc39 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:01.818893 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ca92b089-dc20-42ee-b7d7-a8c6c1cea1e4 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] 10.222.0.20 "GET /compute/v2.1/servers/acb62f35-0751-41fe-ba8d-78b2357380e9" status: 200 len: 1387 microversion: 2.1 time: 0.384294 Oct 27 03:24:01.820478 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 528/995] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:01 2022] GET /compute/v2.1/servers/acb62f35-0751-41fe-ba8d-78b2357380e9 => generated 1387 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:01.826126 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b9b836ab-fc90-42c1-ad3c-cc906cf6f196 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:01.827031 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b9b836ab-fc90-42c1-ad3c-cc906cf6f196 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: b251e3ee-3076-4374-ba01-89488f4d8fc3] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:01.837037 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ab6862aa-3bc1-4dd7-9ed2-40f84d07dc39 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:01.839756 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ab6862aa-3bc1-4dd7-9ed2-40f84d07dc39 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:01.840154 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b9b836ab-fc90-42c1-ad3c-cc906cf6f196 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:01.841502 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b9b836ab-fc90-42c1-ad3c-cc906cf6f196 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:01.843112 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b9b836ab-fc90-42c1-ad3c-cc906cf6f196 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:01.844817 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b9b836ab-fc90-42c1-ad3c-cc906cf6f196 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:01.845507 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b9b836ab-fc90-42c1-ad3c-cc906cf6f196 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:01.846181 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b9b836ab-fc90-42c1-ad3c-cc906cf6f196 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:01.846568 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ab6862aa-3bc1-4dd7-9ed2-40f84d07dc39 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] 10.222.0.20 "GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503" status: 200 len: 1452 microversion: 2.75 time: 0.142155 Oct 27 03:24:01.848561 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 468/996] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:01 2022] GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503 => generated 1452 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:24:01.853333 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-31f42b03-8b1f-46c9-a1a7-a466b07096bc tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:01.854259 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-31f42b03-8b1f-46c9-a1a7-a466b07096bc tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 77dd3d48-fede-491a-b6ce-5ad36a1d7cab] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:01.882666 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-31f42b03-8b1f-46c9-a1a7-a466b07096bc tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:01.883228 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-31f42b03-8b1f-46c9-a1a7-a466b07096bc tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:01.883615 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-31f42b03-8b1f-46c9-a1a7-a466b07096bc tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:01.884344 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-31f42b03-8b1f-46c9-a1a7-a466b07096bc tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:01.884807 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-31f42b03-8b1f-46c9-a1a7-a466b07096bc tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:01.885237 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-31f42b03-8b1f-46c9-a1a7-a466b07096bc tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:02.041751 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b9b836ab-fc90-42c1-ad3c-cc906cf6f196 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:02.048985 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-31f42b03-8b1f-46c9-a1a7-a466b07096bc tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:02.055111 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b9b836ab-fc90-42c1-ad3c-cc906cf6f196 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/b251e3ee-3076-4374-ba01-89488f4d8fc3" status: 200 len: 1274 microversion: 2.1 time: 0.233280 Oct 27 03:24:02.059340 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-31f42b03-8b1f-46c9-a1a7-a466b07096bc tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab" status: 200 len: 1528 microversion: 2.1 time: 0.208710 Oct 27 03:24:02.059867 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 529/997] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:01 2022] GET /compute/v2.1/servers/b251e3ee-3076-4374-ba01-89488f4d8fc3 => generated 1274 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:02.061478 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 469/998] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:01 2022] GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab => generated 1528 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:02.085771 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-139d2b01-25ee-48e9-aec2-cef287a77792 tempest-MigrationsAdminTest-707106630 tempest-MigrationsAdminTest-707106630-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:02.088447 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6b1338bc-80fa-474a-b481-4b8bacda2570 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:02.089187 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6b1338bc-80fa-474a-b481-4b8bacda2570 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 521ddedc-cff2-4c42-a737-9590906b07a6] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:02.095995 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6b1338bc-80fa-474a-b481-4b8bacda2570 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:02.098935 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6b1338bc-80fa-474a-b481-4b8bacda2570 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:02.099409 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6b1338bc-80fa-474a-b481-4b8bacda2570 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:02.100139 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6b1338bc-80fa-474a-b481-4b8bacda2570 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:02.104753 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6b1338bc-80fa-474a-b481-4b8bacda2570 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:02.105635 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6b1338bc-80fa-474a-b481-4b8bacda2570 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:02.167773 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-139d2b01-25ee-48e9-aec2-cef287a77792 tempest-MigrationsAdminTest-707106630 tempest-MigrationsAdminTest-707106630-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/373ee9d3-42fb-4650-9a9e-1bc4c5ae3e0a" status: 202 len: 0 microversion: 2.1 time: 0.087089 Oct 27 03:24:02.173674 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 470/999] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:24:02 2022] DELETE /compute/v2.1/flavors/373ee9d3-42fb-4650-9a9e-1bc4c5ae3e0a => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:24:02.180127 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-40ce7524-d483-4858-92fe-c843aad24702 tempest-MigrationsAdminTest-707106630 tempest-MigrationsAdminTest-707106630-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:02.225169 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-40ce7524-d483-4858-92fe-c843aad24702 tempest-MigrationsAdminTest-707106630 tempest-MigrationsAdminTest-707106630-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.049037 Oct 27 03:24:02.230518 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 471/1000] 10.222.0.20 () {58 vars in 1146 bytes} [Thu Oct 27 03:24:02 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:02.238010 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0bdf35af-76bf-48a1-8924-a1c404d43bf6 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:02.238982 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0bdf35af-76bf-48a1-8924-a1c404d43bf6 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: a52fed88-50f8-4dea-b83d-6878adccb024] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:02.248749 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0bdf35af-76bf-48a1-8924-a1c404d43bf6 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:02.249252 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0bdf35af-76bf-48a1-8924-a1c404d43bf6 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:02.249772 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0bdf35af-76bf-48a1-8924-a1c404d43bf6 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:02.251289 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0bdf35af-76bf-48a1-8924-a1c404d43bf6 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:02.251609 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0bdf35af-76bf-48a1-8924-a1c404d43bf6 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:02.252095 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0bdf35af-76bf-48a1-8924-a1c404d43bf6 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:02.283007 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-6b1338bc-80fa-474a-b481-4b8bacda2570 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:02.305259 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6b1338bc-80fa-474a-b481-4b8bacda2570 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/521ddedc-cff2-4c42-a737-9590906b07a6" status: 200 len: 1308 microversion: 2.1 time: 0.243496 Oct 27 03:24:02.305976 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 530/1001] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:02 2022] GET /compute/v2.1/servers/521ddedc-cff2-4c42-a737-9590906b07a6 => generated 1308 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:02.310982 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8e821d48-73bb-41a1-92cd-98ee5bdc495b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:02.313798 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8e821d48-73bb-41a1-92cd-98ee5bdc495b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 87ad30f8-b432-45dc-82ff-aed508afddd7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:02.320645 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8e821d48-73bb-41a1-92cd-98ee5bdc495b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:02.322321 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8e821d48-73bb-41a1-92cd-98ee5bdc495b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:02.322321 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8e821d48-73bb-41a1-92cd-98ee5bdc495b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:02.322530 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8e821d48-73bb-41a1-92cd-98ee5bdc495b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:02.322823 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8e821d48-73bb-41a1-92cd-98ee5bdc495b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:02.323313 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8e821d48-73bb-41a1-92cd-98ee5bdc495b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:02.437178 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0bdf35af-76bf-48a1-8924-a1c404d43bf6 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:02.446467 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0bdf35af-76bf-48a1-8924-a1c404d43bf6 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/a52fed88-50f8-4dea-b83d-6878adccb024" status: 200 len: 1505 microversion: 2.1 time: 0.214542 Oct 27 03:24:02.447081 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 472/1002] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:02 2022] GET /compute/v2.1/servers/a52fed88-50f8-4dea-b83d-6878adccb024 => generated 1505 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:02.453258 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6e6b5e61-c1e3-466d-8cf3-055c11b60b61 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:24:02.472401 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-6e6b5e61-c1e3-466d-8cf3-055c11b60b61 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 77dd3d48-fede-491a-b6ce-5ad36a1d7cab] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:02.479078 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6e6b5e61-c1e3-466d-8cf3-055c11b60b61 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:02.486322 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6e6b5e61-c1e3-466d-8cf3-055c11b60b61 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:02.486322 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6e6b5e61-c1e3-466d-8cf3-055c11b60b61 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:02.486322 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6e6b5e61-c1e3-466d-8cf3-055c11b60b61 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:02.486322 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6e6b5e61-c1e3-466d-8cf3-055c11b60b61 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:02.486732 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6e6b5e61-c1e3-466d-8cf3-055c11b60b61 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:02.499536 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8e821d48-73bb-41a1-92cd-98ee5bdc495b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:02.509971 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8e821d48-73bb-41a1-92cd-98ee5bdc495b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:02.524945 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8e821d48-73bb-41a1-92cd-98ee5bdc495b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:02.524945 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8e821d48-73bb-41a1-92cd-98ee5bdc495b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/87ad30f8-b432-45dc-82ff-aed508afddd7" status: 200 len: 1569 microversion: 2.25 time: 0.205707 Oct 27 03:24:02.524945 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 531/1003] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:02 2022] GET /compute/v2.1/servers/87ad30f8-b432-45dc-82ff-aed508afddd7 => generated 1569 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:24:02.524945 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5647e8eb-8c6e-4737-8cb6-d2301fa0f89d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:02.525326 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5647e8eb-8c6e-4737-8cb6-d2301fa0f89d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:02.530428 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5647e8eb-8c6e-4737-8cb6-d2301fa0f89d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:02.534884 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5647e8eb-8c6e-4737-8cb6-d2301fa0f89d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:02.535680 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5647e8eb-8c6e-4737-8cb6-d2301fa0f89d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:02.536868 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5647e8eb-8c6e-4737-8cb6-d2301fa0f89d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:02.537982 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5647e8eb-8c6e-4737-8cb6-d2301fa0f89d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:02.537982 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5647e8eb-8c6e-4737-8cb6-d2301fa0f89d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:02.816226 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6e6b5e61-c1e3-466d-8cf3-055c11b60b61 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:02.816226 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-6e6b5e61-c1e3-466d-8cf3-055c11b60b61 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 77dd3d48-fede-491a-b6ce-5ad36a1d7cab] Old instance type tempest-test_resize_flavor_-8399933, new instance type m1.heat {{(pid=121001) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 27 03:24:02.816226 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-6e6b5e61-c1e3-466d-8cf3-055c11b60b61 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Flavor limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:24:02.816226 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-6e6b5e61-c1e3-466d-8cf3-055c11b60b61 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Image limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:24:02.817299 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-6e6b5e61-c1e3-466d-8cf3-055c11b60b61 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Flavor pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:24:02.817299 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-6e6b5e61-c1e3-466d-8cf3-055c11b60b61 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Image pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:24:02.817299 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-6e6b5e61-c1e3-466d-8cf3-055c11b60b61 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:24:02.817950 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5647e8eb-8c6e-4737-8cb6-d2301fa0f89d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:02.817950 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5647e8eb-8c6e-4737-8cb6-d2301fa0f89d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:02.818259 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5647e8eb-8c6e-4737-8cb6-d2301fa0f89d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:02.818259 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5647e8eb-8c6e-4737-8cb6-d2301fa0f89d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1555 microversion: 2.91 time: 0.113929 Oct 27 03:24:02.818259 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 532/1004] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:02 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1555 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:24:02.847196 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-97392070-29b4-4c99-a47b-6f735188c3b2 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:02.847824 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-97392070-29b4-4c99-a47b-6f735188c3b2 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] [instance: acb62f35-0751-41fe-ba8d-78b2357380e9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:02.854457 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-97392070-29b4-4c99-a47b-6f735188c3b2 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:02.855032 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-97392070-29b4-4c99-a47b-6f735188c3b2 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:02.855507 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-97392070-29b4-4c99-a47b-6f735188c3b2 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:02.856310 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-97392070-29b4-4c99-a47b-6f735188c3b2 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:02.856781 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-97392070-29b4-4c99-a47b-6f735188c3b2 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:02.857297 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-97392070-29b4-4c99-a47b-6f735188c3b2 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:03.022786 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-97392070-29b4-4c99-a47b-6f735188c3b2 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e23378ed283426cbff623265d9bbc96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f033d34ad44397bfda5cba4c041071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:03.030874 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-97392070-29b4-4c99-a47b-6f735188c3b2 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] 10.222.0.20 "GET /compute/v2.1/servers/acb62f35-0751-41fe-ba8d-78b2357380e9" status: 200 len: 1387 microversion: 2.1 time: 0.188320 Oct 27 03:24:03.032292 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 533/1005] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:02 2022] GET /compute/v2.1/servers/acb62f35-0751-41fe-ba8d-78b2357380e9 => generated 1387 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:24:03.036782 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6685219b-3484-4b99-a9a5-bbcb9068ae28 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:03.039965 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6685219b-3484-4b99-a9a5-bbcb9068ae28 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] [instance: 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:03.043099 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6685219b-3484-4b99-a9a5-bbcb9068ae28 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:03.043586 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6685219b-3484-4b99-a9a5-bbcb9068ae28 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:03.044030 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6685219b-3484-4b99-a9a5-bbcb9068ae28 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:03.044730 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6685219b-3484-4b99-a9a5-bbcb9068ae28 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:03.045186 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6685219b-3484-4b99-a9a5-bbcb9068ae28 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:03.045613 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6685219b-3484-4b99-a9a5-bbcb9068ae28 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:03.110572 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-6685219b-3484-4b99-a9a5-bbcb9068ae28 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:03.119452 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-6685219b-3484-4b99-a9a5-bbcb9068ae28 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:03.120970 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-6685219b-3484-4b99-a9a5-bbcb9068ae28 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:03.129743 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6685219b-3484-4b99-a9a5-bbcb9068ae28 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] 10.222.0.20 "GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503" status: 200 len: 1452 microversion: 2.75 time: 0.094932 Oct 27 03:24:03.129743 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 534/1006] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:03 2022] GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503 => generated 1452 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:24:03.135112 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4c7790ab-75f5-401e-bd29-cf1c0cef7b04 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:03.135738 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4c7790ab-75f5-401e-bd29-cf1c0cef7b04 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: b251e3ee-3076-4374-ba01-89488f4d8fc3] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:03.142201 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4c7790ab-75f5-401e-bd29-cf1c0cef7b04 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:03.142700 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4c7790ab-75f5-401e-bd29-cf1c0cef7b04 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:03.143274 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4c7790ab-75f5-401e-bd29-cf1c0cef7b04 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:03.144101 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4c7790ab-75f5-401e-bd29-cf1c0cef7b04 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:03.144557 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4c7790ab-75f5-401e-bd29-cf1c0cef7b04 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:03.144988 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4c7790ab-75f5-401e-bd29-cf1c0cef7b04 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:03.232659 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6e6b5e61-c1e3-466d-8cf3-055c11b60b61 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "POST /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab/action" status: 202 len: 0 microversion: 2.1 time: 0.784486 Oct 27 03:24:03.233428 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4c7790ab-75f5-401e-bd29-cf1c0cef7b04 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:03.234511 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 473/1007] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:24:02 2022] POST /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab/action => generated 0 bytes in 787 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:24:03.242650 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ef993e06-42da-4dc4-a3c8-b431232bfd78 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:03.243340 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4c7790ab-75f5-401e-bd29-cf1c0cef7b04 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/b251e3ee-3076-4374-ba01-89488f4d8fc3" status: 200 len: 1284 microversion: 2.1 time: 0.112815 Oct 27 03:24:03.245063 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 535/1008] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:03 2022] GET /compute/v2.1/servers/b251e3ee-3076-4374-ba01-89488f4d8fc3 => generated 1284 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:03.251060 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ef993e06-42da-4dc4-a3c8-b431232bfd78 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 77dd3d48-fede-491a-b6ce-5ad36a1d7cab] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:03.258722 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ef993e06-42da-4dc4-a3c8-b431232bfd78 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:03.259547 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ef993e06-42da-4dc4-a3c8-b431232bfd78 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:03.260060 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ef993e06-42da-4dc4-a3c8-b431232bfd78 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:03.261079 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ef993e06-42da-4dc4-a3c8-b431232bfd78 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:03.261572 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ef993e06-42da-4dc4-a3c8-b431232bfd78 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:03.262006 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ef993e06-42da-4dc4-a3c8-b431232bfd78 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:03.329500 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2193f304-04b6-42b9-b89a-e402a94217f1 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:03.331769 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-2193f304-04b6-42b9-b89a-e402a94217f1 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 521ddedc-cff2-4c42-a737-9590906b07a6] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:03.343422 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2193f304-04b6-42b9-b89a-e402a94217f1 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:03.344508 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2193f304-04b6-42b9-b89a-e402a94217f1 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:03.344956 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2193f304-04b6-42b9-b89a-e402a94217f1 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:03.345680 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2193f304-04b6-42b9-b89a-e402a94217f1 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:03.346178 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2193f304-04b6-42b9-b89a-e402a94217f1 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:03.346617 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2193f304-04b6-42b9-b89a-e402a94217f1 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:03.435519 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ef993e06-42da-4dc4-a3c8-b431232bfd78 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:03.446050 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ef993e06-42da-4dc4-a3c8-b431232bfd78 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab" status: 200 len: 1537 microversion: 2.1 time: 0.207495 Oct 27 03:24:03.463191 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 474/1009] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:03 2022] GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab => generated 1537 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:03.472030 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e0530c6e-02e3-4046-bd79-839fd996498e tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:03.472983 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e0530c6e-02e3-4046-bd79-839fd996498e tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: a52fed88-50f8-4dea-b83d-6878adccb024] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:03.479222 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e0530c6e-02e3-4046-bd79-839fd996498e tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:03.480003 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e0530c6e-02e3-4046-bd79-839fd996498e tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:03.480664 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e0530c6e-02e3-4046-bd79-839fd996498e tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:03.481604 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e0530c6e-02e3-4046-bd79-839fd996498e tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:03.482348 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e0530c6e-02e3-4046-bd79-839fd996498e tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:03.482857 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e0530c6e-02e3-4046-bd79-839fd996498e tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:03.489397 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:24:03.530745 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2193f304-04b6-42b9-b89a-e402a94217f1 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:03.540833 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2193f304-04b6-42b9-b89a-e402a94217f1 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/521ddedc-cff2-4c42-a737-9590906b07a6" status: 200 len: 1308 microversion: 2.1 time: 0.215863 Oct 27 03:24:03.554903 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 536/1010] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:03 2022] GET /compute/v2.1/servers/521ddedc-cff2-4c42-a737-9590906b07a6 => generated 1308 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:24:03.569487 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f867e402-e752-4832-99c2-fb589589d5b9 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:03.570157 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f867e402-e752-4832-99c2-fb589589d5b9 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 87ad30f8-b432-45dc-82ff-aed508afddd7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:03.580417 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f867e402-e752-4832-99c2-fb589589d5b9 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:03.580924 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f867e402-e752-4832-99c2-fb589589d5b9 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:03.581372 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f867e402-e752-4832-99c2-fb589589d5b9 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:03.582126 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f867e402-e752-4832-99c2-fb589589d5b9 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:03.582592 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f867e402-e752-4832-99c2-fb589589d5b9 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:03.583025 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f867e402-e752-4832-99c2-fb589589d5b9 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:03.786125 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f867e402-e752-4832-99c2-fb589589d5b9 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:03.795613 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f867e402-e752-4832-99c2-fb589589d5b9 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:03.798184 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f867e402-e752-4832-99c2-fb589589d5b9 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:03.799500 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f867e402-e752-4832-99c2-fb589589d5b9 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/87ad30f8-b432-45dc-82ff-aed508afddd7" status: 200 len: 1569 microversion: 2.25 time: 0.243466 Oct 27 03:24:03.800148 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 537/1011] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:03 2022] GET /compute/v2.1/servers/87ad30f8-b432-45dc-82ff-aed508afddd7 => generated 1569 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:24:03.841582 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0db1e761-731f-4725-8079-45b82a1ca50a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:03.842652 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0db1e761-731f-4725-8079-45b82a1ca50a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:03.849397 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0db1e761-731f-4725-8079-45b82a1ca50a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:03.850299 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0db1e761-731f-4725-8079-45b82a1ca50a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:03.850878 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0db1e761-731f-4725-8079-45b82a1ca50a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:03.851805 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0db1e761-731f-4725-8079-45b82a1ca50a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:03.852378 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0db1e761-731f-4725-8079-45b82a1ca50a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:03.852917 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0db1e761-731f-4725-8079-45b82a1ca50a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:03.946258 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0db1e761-731f-4725-8079-45b82a1ca50a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:03.959426 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0db1e761-731f-4725-8079-45b82a1ca50a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:03.960163 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0db1e761-731f-4725-8079-45b82a1ca50a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:03.965713 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0db1e761-731f-4725-8079-45b82a1ca50a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1555 microversion: 2.91 time: 0.128687 Oct 27 03:24:03.967018 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 538/1012] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:03 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1555 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:24:03.992067 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e0530c6e-02e3-4046-bd79-839fd996498e tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:03.999871 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e0530c6e-02e3-4046-bd79-839fd996498e tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/a52fed88-50f8-4dea-b83d-6878adccb024" status: 200 len: 1505 microversion: 2.1 time: 0.532257 Oct 27 03:24:04.002075 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 475/1013] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:03 2022] GET /compute/v2.1/servers/a52fed88-50f8-4dea-b83d-6878adccb024 => generated 1505 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:04.059561 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0225ddf8-7e1b-4505-8810-743143eb92aa tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:04.060311 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0225ddf8-7e1b-4505-8810-743143eb92aa tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] [instance: acb62f35-0751-41fe-ba8d-78b2357380e9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:04.067671 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0225ddf8-7e1b-4505-8810-743143eb92aa tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:04.068179 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0225ddf8-7e1b-4505-8810-743143eb92aa tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:04.068669 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0225ddf8-7e1b-4505-8810-743143eb92aa tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:04.069416 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0225ddf8-7e1b-4505-8810-743143eb92aa tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:04.069901 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0225ddf8-7e1b-4505-8810-743143eb92aa tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:04.070543 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0225ddf8-7e1b-4505-8810-743143eb92aa tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:04.163361 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-595ac26e-b4a2-42f1-b226-f02dc0b27e0b tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:04.164051 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-595ac26e-b4a2-42f1-b226-f02dc0b27e0b tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] [instance: 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:04.174009 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-595ac26e-b4a2-42f1-b226-f02dc0b27e0b tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:04.176071 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-595ac26e-b4a2-42f1-b226-f02dc0b27e0b tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:04.177330 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-595ac26e-b4a2-42f1-b226-f02dc0b27e0b tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:04.178691 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-595ac26e-b4a2-42f1-b226-f02dc0b27e0b tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:04.179842 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-595ac26e-b4a2-42f1-b226-f02dc0b27e0b tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:04.180361 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-595ac26e-b4a2-42f1-b226-f02dc0b27e0b tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:04.249080 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-595ac26e-b4a2-42f1-b226-f02dc0b27e0b tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:04.257607 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-595ac26e-b4a2-42f1-b226-f02dc0b27e0b tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:04.259147 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-595ac26e-b4a2-42f1-b226-f02dc0b27e0b tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:04.264667 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-595ac26e-b4a2-42f1-b226-f02dc0b27e0b tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] 10.222.0.20 "GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503" status: 200 len: 1437 microversion: 2.75 time: 0.105231 Oct 27 03:24:04.265338 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 476/1014] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:04 2022] GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503 => generated 1437 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:24:04.271418 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f410f07f-0a85-4f10-bd16-e019519734b5 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:04.272124 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f410f07f-0a85-4f10-bd16-e019519734b5 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: b251e3ee-3076-4374-ba01-89488f4d8fc3] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:04.287886 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f410f07f-0a85-4f10-bd16-e019519734b5 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:04.288454 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f410f07f-0a85-4f10-bd16-e019519734b5 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:04.291034 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f410f07f-0a85-4f10-bd16-e019519734b5 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:04.291034 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f410f07f-0a85-4f10-bd16-e019519734b5 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:04.291034 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f410f07f-0a85-4f10-bd16-e019519734b5 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:04.291034 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f410f07f-0a85-4f10-bd16-e019519734b5 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:04.314701 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0225ddf8-7e1b-4505-8810-743143eb92aa tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e23378ed283426cbff623265d9bbc96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f033d34ad44397bfda5cba4c041071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:04.336734 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0225ddf8-7e1b-4505-8810-743143eb92aa tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] 10.222.0.20 "GET /compute/v2.1/servers/acb62f35-0751-41fe-ba8d-78b2357380e9" status: 200 len: 1387 microversion: 2.1 time: 0.268594 Oct 27 03:24:04.342907 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 539/1015] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:04 2022] GET /compute/v2.1/servers/acb62f35-0751-41fe-ba8d-78b2357380e9 => generated 1387 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:04.372551 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f410f07f-0a85-4f10-bd16-e019519734b5 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:04.395513 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f410f07f-0a85-4f10-bd16-e019519734b5 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/b251e3ee-3076-4374-ba01-89488f4d8fc3" status: 200 len: 1272 microversion: 2.1 time: 0.128541 Oct 27 03:24:04.412633 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 477/1016] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:04 2022] GET /compute/v2.1/servers/b251e3ee-3076-4374-ba01-89488f4d8fc3 => generated 1272 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:04.473533 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-24ea59ab-1f7d-42d2-aabd-f4325537a9f0 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:04.474460 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-24ea59ab-1f7d-42d2-aabd-f4325537a9f0 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 77dd3d48-fede-491a-b6ce-5ad36a1d7cab] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:04.483232 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-24ea59ab-1f7d-42d2-aabd-f4325537a9f0 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:04.483969 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-24ea59ab-1f7d-42d2-aabd-f4325537a9f0 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:04.484683 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-24ea59ab-1f7d-42d2-aabd-f4325537a9f0 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:04.487007 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-24ea59ab-1f7d-42d2-aabd-f4325537a9f0 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:04.487599 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-24ea59ab-1f7d-42d2-aabd-f4325537a9f0 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:04.488117 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-24ea59ab-1f7d-42d2-aabd-f4325537a9f0 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:04.491400 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e4ac0ccc-5d42-4209-9f47-99b665a1027e tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:24:04.495567 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e4ac0ccc-5d42-4209-9f47-99b665a1027e tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] [instance: 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:04.504014 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e4ac0ccc-5d42-4209-9f47-99b665a1027e tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:04.504362 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e4ac0ccc-5d42-4209-9f47-99b665a1027e tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:04.504845 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e4ac0ccc-5d42-4209-9f47-99b665a1027e tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:04.505721 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e4ac0ccc-5d42-4209-9f47-99b665a1027e tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:04.506472 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e4ac0ccc-5d42-4209-9f47-99b665a1027e tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:04.506921 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e4ac0ccc-5d42-4209-9f47-99b665a1027e tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:04.621792 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-e4ac0ccc-5d42-4209-9f47-99b665a1027e tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:24:04.622368 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-e4ac0ccc-5d42-4209-9f47-99b665a1027e tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:24:04.622931 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-e4ac0ccc-5d42-4209-9f47-99b665a1027e tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:24:04.623420 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-e4ac0ccc-5d42-4209-9f47-99b665a1027e tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:24:04.623919 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-e4ac0ccc-5d42-4209-9f47-99b665a1027e tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:24:04.699952 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-24ea59ab-1f7d-42d2-aabd-f4325537a9f0 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:04.709717 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-24ea59ab-1f7d-42d2-aabd-f4325537a9f0 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab" status: 200 len: 1537 microversion: 2.1 time: 0.241252 Oct 27 03:24:04.711817 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 478/1017] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:04 2022] GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab => generated 1537 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:24:04.719355 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4565c07c-c372-42e3-941d-d0f5673b2982 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:04.720791 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4565c07c-c372-42e3-941d-d0f5673b2982 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 521ddedc-cff2-4c42-a737-9590906b07a6] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:04.733526 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4565c07c-c372-42e3-941d-d0f5673b2982 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:04.734205 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4565c07c-c372-42e3-941d-d0f5673b2982 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:04.734789 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4565c07c-c372-42e3-941d-d0f5673b2982 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:04.735866 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4565c07c-c372-42e3-941d-d0f5673b2982 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:04.736426 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4565c07c-c372-42e3-941d-d0f5673b2982 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:04.737515 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4565c07c-c372-42e3-941d-d0f5673b2982 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:04.867109 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e4ac0ccc-5d42-4209-9f47-99b665a1027e tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] [instance: 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:04.874260 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e4ac0ccc-5d42-4209-9f47-99b665a1027e tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:04.875740 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e4ac0ccc-5d42-4209-9f47-99b665a1027e tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:04.876346 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e4ac0ccc-5d42-4209-9f47-99b665a1027e tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:04.877288 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e4ac0ccc-5d42-4209-9f47-99b665a1027e tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:04.877903 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e4ac0ccc-5d42-4209-9f47-99b665a1027e tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:04.878702 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e4ac0ccc-5d42-4209-9f47-99b665a1027e tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:04.971281 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4565c07c-c372-42e3-941d-d0f5673b2982 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:04.981952 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4565c07c-c372-42e3-941d-d0f5673b2982 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/521ddedc-cff2-4c42-a737-9590906b07a6" status: 200 len: 1308 microversion: 2.1 time: 0.268854 Oct 27 03:24:04.983149 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 479/1018] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:04 2022] GET /compute/v2.1/servers/521ddedc-cff2-4c42-a737-9590906b07a6 => generated 1308 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:04.988222 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-80b1f73e-353b-4701-978d-1732aab494fb tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:04.989139 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-80b1f73e-353b-4701-978d-1732aab494fb tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 87ad30f8-b432-45dc-82ff-aed508afddd7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:04.995520 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-80b1f73e-353b-4701-978d-1732aab494fb tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:04.996080 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-80b1f73e-353b-4701-978d-1732aab494fb tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:04.996590 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-80b1f73e-353b-4701-978d-1732aab494fb tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:04.997380 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-80b1f73e-353b-4701-978d-1732aab494fb tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:04.997913 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-80b1f73e-353b-4701-978d-1732aab494fb tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:04.998427 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-80b1f73e-353b-4701-978d-1732aab494fb tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:05.025538 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-e4ac0ccc-5d42-4209-9f47-99b665a1027e tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lazy-loading 'services' on Instance uuid 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503 {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:24:05.046762 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e4ac0ccc-5d42-4209-9f47-99b665a1027e tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503/action" status: 202 len: 1940 microversion: 2.75 time: 0.702656 Oct 27 03:24:05.049201 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 540/1019] 10.222.0.20 () {62 vars in 1319 bytes} [Thu Oct 27 03:24:04 2022] POST /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503/action => generated 1940 bytes in 706 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 27 03:24:05.055558 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d7c3d9ff-e307-474d-b9ac-41e953b9706a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:05.056565 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d7c3d9ff-e307-474d-b9ac-41e953b9706a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:05.063628 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d7c3d9ff-e307-474d-b9ac-41e953b9706a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:05.067001 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d7c3d9ff-e307-474d-b9ac-41e953b9706a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:05.067001 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d7c3d9ff-e307-474d-b9ac-41e953b9706a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:05.067001 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d7c3d9ff-e307-474d-b9ac-41e953b9706a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:05.067001 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d7c3d9ff-e307-474d-b9ac-41e953b9706a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:05.067584 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d7c3d9ff-e307-474d-b9ac-41e953b9706a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:05.125889 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:24:05.202612 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d7c3d9ff-e307-474d-b9ac-41e953b9706a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:05.207688 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-80b1f73e-353b-4701-978d-1732aab494fb tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:05.220341 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d7c3d9ff-e307-474d-b9ac-41e953b9706a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:05.220341 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d7c3d9ff-e307-474d-b9ac-41e953b9706a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:05.235595 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d7c3d9ff-e307-474d-b9ac-41e953b9706a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1537 microversion: 2.91 time: 0.173292 Oct 27 03:24:05.236095 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-80b1f73e-353b-4701-978d-1732aab494fb tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:05.241187 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-80b1f73e-353b-4701-978d-1732aab494fb tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:05.243871 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-80b1f73e-353b-4701-978d-1732aab494fb tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/87ad30f8-b432-45dc-82ff-aed508afddd7" status: 200 len: 1559 microversion: 2.25 time: 0.259582 Oct 27 03:24:05.246083 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 480/1020] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:04 2022] GET /compute/v2.1/servers/87ad30f8-b432-45dc-82ff-aed508afddd7 => generated 1559 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:24:05.254138 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 541/1021] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:05 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1537 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:24:05.261875 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-80d667b0-40c5-4a9b-89b6-6278516417d5 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:05.271393 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-80d667b0-40c5-4a9b-89b6-6278516417d5 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: a52fed88-50f8-4dea-b83d-6878adccb024] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:05.272525 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3f30b077-d25c-43b6-af8b-c10aac475089 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:05.273470 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-3f30b077-d25c-43b6-af8b-c10aac475089 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] [instance: 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:05.283394 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-80d667b0-40c5-4a9b-89b6-6278516417d5 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:05.284663 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-80d667b0-40c5-4a9b-89b6-6278516417d5 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:05.285136 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-80d667b0-40c5-4a9b-89b6-6278516417d5 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:05.285876 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-80d667b0-40c5-4a9b-89b6-6278516417d5 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:05.286372 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-80d667b0-40c5-4a9b-89b6-6278516417d5 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:05.286806 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-80d667b0-40c5-4a9b-89b6-6278516417d5 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:05.288320 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3f30b077-d25c-43b6-af8b-c10aac475089 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:05.288834 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3f30b077-d25c-43b6-af8b-c10aac475089 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:05.290461 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3f30b077-d25c-43b6-af8b-c10aac475089 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:05.292422 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3f30b077-d25c-43b6-af8b-c10aac475089 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:05.292944 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3f30b077-d25c-43b6-af8b-c10aac475089 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:05.293395 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3f30b077-d25c-43b6-af8b-c10aac475089 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:05.552446 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-3f30b077-d25c-43b6-af8b-c10aac475089 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lazy-loading 'services' on Instance uuid 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503 {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:24:05.569384 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-80d667b0-40c5-4a9b-89b6-6278516417d5 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:05.578244 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-80d667b0-40c5-4a9b-89b6-6278516417d5 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/a52fed88-50f8-4dea-b83d-6878adccb024" status: 200 len: 1505 microversion: 2.1 time: 0.330432 Oct 27 03:24:05.578827 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 481/1022] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:05 2022] GET /compute/v2.1/servers/a52fed88-50f8-4dea-b83d-6878adccb024 => generated 1505 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:05.599684 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-45264b5b-e05d-496c-b52a-6cc75819c227 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Calling method '.version_select at 0x7f7ddab7a670>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:05.604862 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3f30b077-d25c-43b6-af8b-c10aac475089 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503" status: 200 len: 1927 microversion: 2.75 time: 0.351092 Oct 27 03:24:05.630621 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 542/1023] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:05 2022] GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503 => generated 1927 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:24:05.632491 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-45264b5b-e05d-496c-b52a-6cc75819c227 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:05.632998 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-45264b5b-e05d-496c-b52a-6cc75819c227 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:05.638702 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-45264b5b-e05d-496c-b52a-6cc75819c227 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:05.640999 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6184ba87-0207-4a3f-9a36-d05952708c04 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:05.641765 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6184ba87-0207-4a3f-9a36-d05952708c04 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] [instance: acb62f35-0751-41fe-ba8d-78b2357380e9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:05.654925 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6184ba87-0207-4a3f-9a36-d05952708c04 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:05.657144 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6184ba87-0207-4a3f-9a36-d05952708c04 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:05.657676 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6184ba87-0207-4a3f-9a36-d05952708c04 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:05.658534 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6184ba87-0207-4a3f-9a36-d05952708c04 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:05.661450 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6184ba87-0207-4a3f-9a36-d05952708c04 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:05.661985 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6184ba87-0207-4a3f-9a36-d05952708c04 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:05.662907 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-45264b5b-e05d-496c-b52a-6cc75819c227 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 2978 microversion: 2.25 time: 0.082009 Oct 27 03:24:05.670089 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 482/1024] 10.222.0.20 () {60 vars in 1184 bytes} [Thu Oct 27 03:24:05 2022] GET /compute/v2.1/os-migrations => generated 2978 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:24:05.676287 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8ef35161-6522-4a84-90cb-2b88d2a27853 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:05.677119 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8ef35161-6522-4a84-90cb-2b88d2a27853 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: b251e3ee-3076-4374-ba01-89488f4d8fc3] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:05.684250 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8ef35161-6522-4a84-90cb-2b88d2a27853 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:05.684686 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8ef35161-6522-4a84-90cb-2b88d2a27853 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:05.685204 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8ef35161-6522-4a84-90cb-2b88d2a27853 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:05.686078 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8ef35161-6522-4a84-90cb-2b88d2a27853 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:05.686870 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8ef35161-6522-4a84-90cb-2b88d2a27853 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:05.687203 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8ef35161-6522-4a84-90cb-2b88d2a27853 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:05.927981 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8ef35161-6522-4a84-90cb-2b88d2a27853 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:05.936588 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8ef35161-6522-4a84-90cb-2b88d2a27853 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/b251e3ee-3076-4374-ba01-89488f4d8fc3" status: 200 len: 1314 microversion: 2.1 time: 0.271515 Oct 27 03:24:05.937667 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 483/1025] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:05 2022] GET /compute/v2.1/servers/b251e3ee-3076-4374-ba01-89488f4d8fc3 => generated 1314 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:05.958703 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-a11a1400-d7cc-4f51-a2be-1e75182140f3 req-d5f41b91-04c0-4d53-8ced-dc1390a79fe8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "521ddedc-cff2-4c42-a737-9590906b07a6", "name": "network-vif-plugged", "status": "completed", "tag": "2ccfa709-ec86-42d4-88a8-c7f4dcb17bbe"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:24:05.978410 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-a11a1400-d7cc-4f51-a2be-1e75182140f3 req-d5f41b91-04c0-4d53-8ced-dc1390a79fe8 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:05.978952 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-a11a1400-d7cc-4f51-a2be-1e75182140f3 req-d5f41b91-04c0-4d53-8ced-dc1390a79fe8 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:05.979404 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-a11a1400-d7cc-4f51-a2be-1e75182140f3 req-d5f41b91-04c0-4d53-8ced-dc1390a79fe8 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:05.992083 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-a11a1400-d7cc-4f51-a2be-1e75182140f3 req-d5f41b91-04c0-4d53-8ced-dc1390a79fe8 service nova] Creating event network-vif-plugged:2ccfa709-ec86-42d4-88a8-c7f4dcb17bbe for instance 521ddedc-cff2-4c42-a737-9590906b07a6 on n-h1-862769-1 Oct 27 03:24:05.997596 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-a11a1400-d7cc-4f51-a2be-1e75182140f3 req-d5f41b91-04c0-4d53-8ced-dc1390a79fe8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058509 Oct 27 03:24:05.998550 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 484/1026] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:24:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:24:06.003684 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d42b65b0-53a7-4a82-9bd8-efed3e826387 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:06.005504 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d42b65b0-53a7-4a82-9bd8-efed3e826387 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] [instance: 87ad30f8-b432-45dc-82ff-aed508afddd7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:06.011767 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d42b65b0-53a7-4a82-9bd8-efed3e826387 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:06.012331 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d42b65b0-53a7-4a82-9bd8-efed3e826387 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:06.012779 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d42b65b0-53a7-4a82-9bd8-efed3e826387 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:06.013493 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d42b65b0-53a7-4a82-9bd8-efed3e826387 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:06.013958 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d42b65b0-53a7-4a82-9bd8-efed3e826387 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:06.014432 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d42b65b0-53a7-4a82-9bd8-efed3e826387 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:06.015495 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-6184ba87-0207-4a3f-9a36-d05952708c04 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e23378ed283426cbff623265d9bbc96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f033d34ad44397bfda5cba4c041071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:06.029173 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6184ba87-0207-4a3f-9a36-d05952708c04 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] 10.222.0.20 "GET /compute/v2.1/servers/acb62f35-0751-41fe-ba8d-78b2357380e9" status: 200 len: 1387 microversion: 2.1 time: 0.397073 Oct 27 03:24:06.030297 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 543/1027] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:05 2022] GET /compute/v2.1/servers/acb62f35-0751-41fe-ba8d-78b2357380e9 => generated 1387 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:06.050529 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-267f2196-208f-4368-9e69-3dd7cfc5800e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:06.051633 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-267f2196-208f-4368-9e69-3dd7cfc5800e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 77dd3d48-fede-491a-b6ce-5ad36a1d7cab] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:06.060134 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-267f2196-208f-4368-9e69-3dd7cfc5800e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:06.060828 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-267f2196-208f-4368-9e69-3dd7cfc5800e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:06.061823 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-267f2196-208f-4368-9e69-3dd7cfc5800e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:06.063610 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-267f2196-208f-4368-9e69-3dd7cfc5800e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:06.064448 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-267f2196-208f-4368-9e69-3dd7cfc5800e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:06.064827 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-267f2196-208f-4368-9e69-3dd7cfc5800e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:06.204692 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-d42b65b0-53a7-4a82-9bd8-efed3e826387 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lazy-loading 'services' on Instance uuid 87ad30f8-b432-45dc-82ff-aed508afddd7 {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:24:06.218743 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d42b65b0-53a7-4a82-9bd8-efed3e826387 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/87ad30f8-b432-45dc-82ff-aed508afddd7" status: 200 len: 2052 microversion: 2.25 time: 0.218833 Oct 27 03:24:06.220624 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 485/1028] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:05 2022] GET /compute/v2.1/servers/87ad30f8-b432-45dc-82ff-aed508afddd7 => generated 2052 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:24:06.225443 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4b433fac-9071-4ca5-b3c6-9e6909c08cfa tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:06.226363 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4b433fac-9071-4ca5-b3c6-9e6909c08cfa tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 521ddedc-cff2-4c42-a737-9590906b07a6] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:06.233006 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4b433fac-9071-4ca5-b3c6-9e6909c08cfa tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:06.233654 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4b433fac-9071-4ca5-b3c6-9e6909c08cfa tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:06.234279 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4b433fac-9071-4ca5-b3c6-9e6909c08cfa tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:06.235172 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4b433fac-9071-4ca5-b3c6-9e6909c08cfa tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:06.235784 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4b433fac-9071-4ca5-b3c6-9e6909c08cfa tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:06.236378 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4b433fac-9071-4ca5-b3c6-9e6909c08cfa tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:06.354466 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-267f2196-208f-4368-9e69-3dd7cfc5800e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:06.367439 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-267f2196-208f-4368-9e69-3dd7cfc5800e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab" status: 200 len: 1537 microversion: 2.1 time: 0.335762 Oct 27 03:24:06.368285 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 544/1029] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:06 2022] GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab => generated 1537 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:06.377063 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-996dc06c-34d5-4ce5-b5a7-8b2f41c07311 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:06.378810 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-996dc06c-34d5-4ce5-b5a7-8b2f41c07311 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:06.387452 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-996dc06c-34d5-4ce5-b5a7-8b2f41c07311 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:06.388210 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-996dc06c-34d5-4ce5-b5a7-8b2f41c07311 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:06.388862 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-996dc06c-34d5-4ce5-b5a7-8b2f41c07311 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:06.389852 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-996dc06c-34d5-4ce5-b5a7-8b2f41c07311 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:06.391282 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-996dc06c-34d5-4ce5-b5a7-8b2f41c07311 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:06.392727 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-996dc06c-34d5-4ce5-b5a7-8b2f41c07311 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:06.396679 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4b433fac-9071-4ca5-b3c6-9e6909c08cfa tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:06.406909 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4b433fac-9071-4ca5-b3c6-9e6909c08cfa tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/521ddedc-cff2-4c42-a737-9590906b07a6" status: 200 len: 1308 microversion: 2.1 time: 0.184247 Oct 27 03:24:06.411051 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 486/1030] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:06 2022] GET /compute/v2.1/servers/521ddedc-cff2-4c42-a737-9590906b07a6 => generated 1308 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:06.416838 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-72d9c39f-1195-413f-8982-e4a4c89cce77 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-324917956", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": [{"uuid": "1257014e-2ff1-4e8e-a591-63c86a5e0d4b"}]}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:24:06.471112 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-996dc06c-34d5-4ce5-b5a7-8b2f41c07311 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:06.474834 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.network.neutron [None req-72d9c39f-1195-413f-8982-e4a4c89cce77 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] validate_networks() for [('1257014e-2ff1-4e8e-a591-63c86a5e0d4b', None, None, None, None, None)] {{(pid=121001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:24:06.480083 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-996dc06c-34d5-4ce5-b5a7-8b2f41c07311 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:06.481534 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-996dc06c-34d5-4ce5-b5a7-8b2f41c07311 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:06.487360 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-996dc06c-34d5-4ce5-b5a7-8b2f41c07311 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1537 microversion: 2.91 time: 0.115431 Oct 27 03:24:06.488273 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 545/1031] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:06 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1537 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:24:06.607571 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-40a829ac-7e06-428b-85f8-cbc8d0d3f3d3 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:06.608291 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-40a829ac-7e06-428b-85f8-cbc8d0d3f3d3 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: a52fed88-50f8-4dea-b83d-6878adccb024] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:06.614519 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-40a829ac-7e06-428b-85f8-cbc8d0d3f3d3 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:06.615019 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-40a829ac-7e06-428b-85f8-cbc8d0d3f3d3 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:06.615461 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-40a829ac-7e06-428b-85f8-cbc8d0d3f3d3 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:06.616169 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-40a829ac-7e06-428b-85f8-cbc8d0d3f3d3 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:06.616633 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-40a829ac-7e06-428b-85f8-cbc8d0d3f3d3 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:06.617066 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-40a829ac-7e06-428b-85f8-cbc8d0d3f3d3 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:06.818097 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-40a829ac-7e06-428b-85f8-cbc8d0d3f3d3 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:06.826802 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-40a829ac-7e06-428b-85f8-cbc8d0d3f3d3 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/a52fed88-50f8-4dea-b83d-6878adccb024" status: 200 len: 1505 microversion: 2.1 time: 0.223294 Oct 27 03:24:06.827397 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 546/1032] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:06 2022] GET /compute/v2.1/servers/a52fed88-50f8-4dea-b83d-6878adccb024 => generated 1505 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:24:06.832209 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-013cb7c2-5cbe-4abe-b29f-489df1f9cf54 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:06.832827 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-013cb7c2-5cbe-4abe-b29f-489df1f9cf54 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] [instance: 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:06.843077 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-013cb7c2-5cbe-4abe-b29f-489df1f9cf54 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:06.843580 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-013cb7c2-5cbe-4abe-b29f-489df1f9cf54 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:06.844181 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-013cb7c2-5cbe-4abe-b29f-489df1f9cf54 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:06.844962 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-013cb7c2-5cbe-4abe-b29f-489df1f9cf54 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:06.845495 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-013cb7c2-5cbe-4abe-b29f-489df1f9cf54 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:06.846129 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-013cb7c2-5cbe-4abe-b29f-489df1f9cf54 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:06.905266 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-72d9c39f-1195-413f-8982-e4a4c89cce77 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Flavor limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:24:06.905692 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-72d9c39f-1195-413f-8982-e4a4c89cce77 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Image limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:24:06.906218 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-72d9c39f-1195-413f-8982-e4a4c89cce77 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Flavor pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:24:06.907328 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-72d9c39f-1195-413f-8982-e4a4c89cce77 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Image pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:24:06.907782 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-72d9c39f-1195-413f-8982-e4a4c89cce77 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:24:06.921473 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-013cb7c2-5cbe-4abe-b29f-489df1f9cf54 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lazy-loading 'services' on Instance uuid 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503 {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:24:06.926856 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-72d9c39f-1195-413f-8982-e4a4c89cce77 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:06.927578 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-72d9c39f-1195-413f-8982-e4a4c89cce77 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:06.928021 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-72d9c39f-1195-413f-8982-e4a4c89cce77 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:06.928791 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-72d9c39f-1195-413f-8982-e4a4c89cce77 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:06.929413 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-72d9c39f-1195-413f-8982-e4a4c89cce77 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:06.929854 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-72d9c39f-1195-413f-8982-e4a4c89cce77 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:06.945162 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-013cb7c2-5cbe-4abe-b29f-489df1f9cf54 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503" status: 200 len: 1927 microversion: 2.75 time: 0.115765 Oct 27 03:24:06.945162 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 547/1033] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:06 2022] GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503 => generated 1927 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:24:06.948009 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-72d9c39f-1195-413f-8982-e4a4c89cce77 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Getting quotas for project 3b1cf79289db4d7883d93ec3fe908d66. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:24:06.950174 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-b0c274af-90e7-4231-bec4-c5475c610fbb req-0f29346e-2b14-40e3-bcb4-5c76da2da924 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b251e3ee-3076-4374-ba01-89488f4d8fc3", "tag": "0a82a95e-2201-4788-9f0f-38a02ca38ffc"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:24:06.955937 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-72d9c39f-1195-413f-8982-e4a4c89cce77 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Getting quotas for user ba3ce7f040d24c33bcf9b97d1ef25268 and project 3b1cf79289db4d7883d93ec3fe908d66. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:24:06.961902 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-b0c274af-90e7-4231-bec4-c5475c610fbb req-0f29346e-2b14-40e3-bcb4-5c76da2da924 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:06.962818 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-b0c274af-90e7-4231-bec4-c5475c610fbb req-0f29346e-2b14-40e3-bcb4-5c76da2da924 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:06.963400 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-b0c274af-90e7-4231-bec4-c5475c610fbb req-0f29346e-2b14-40e3-bcb4-5c76da2da924 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:06.970504 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-72d9c39f-1195-413f-8982-e4a4c89cce77 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Going to run 1 instances... {{(pid=121001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:24:06.974113 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-72d9c39f-1195-413f-8982-e4a4c89cce77 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 8559e641-f41e-4b21-88b1-56d57ded5ce6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:24:06.981249 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-b0c274af-90e7-4231-bec4-c5475c610fbb req-0f29346e-2b14-40e3-bcb4-5c76da2da924 service nova] Creating event network-changed:0a82a95e-2201-4788-9f0f-38a02ca38ffc for instance b251e3ee-3076-4374-ba01-89488f4d8fc3 on n-h1-862769-1 Oct 27 03:24:06.986581 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-b0c274af-90e7-4231-bec4-c5475c610fbb req-0f29346e-2b14-40e3-bcb4-5c76da2da924 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040565 Oct 27 03:24:06.987186 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 548/1034] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:24:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:24:06.993752 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-54ccd117-35fa-41e8-8cf2-7217474f7362 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:06.994493 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-54ccd117-35fa-41e8-8cf2-7217474f7362 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: b251e3ee-3076-4374-ba01-89488f4d8fc3] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:07.000792 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-54ccd117-35fa-41e8-8cf2-7217474f7362 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:07.001287 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-54ccd117-35fa-41e8-8cf2-7217474f7362 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:07.001732 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-54ccd117-35fa-41e8-8cf2-7217474f7362 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:07.002476 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-54ccd117-35fa-41e8-8cf2-7217474f7362 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:07.002943 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-54ccd117-35fa-41e8-8cf2-7217474f7362 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:07.003444 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-54ccd117-35fa-41e8-8cf2-7217474f7362 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:07.103794 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-72d9c39f-1195-413f-8982-e4a4c89cce77 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 0.688915 Oct 27 03:24:07.104934 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 487/1035] 10.222.0.20 () {62 vars in 1188 bytes} [Thu Oct 27 03:24:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 693 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 27 03:24:07.109920 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d92164e4-41c9-4420-963f-c1b30132b673 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:07.111054 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d92164e4-41c9-4420-963f-c1b30132b673 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] [instance: acb62f35-0751-41fe-ba8d-78b2357380e9] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:07.131197 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d92164e4-41c9-4420-963f-c1b30132b673 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:07.132381 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d92164e4-41c9-4420-963f-c1b30132b673 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:07.133085 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d92164e4-41c9-4420-963f-c1b30132b673 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:07.133968 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d92164e4-41c9-4420-963f-c1b30132b673 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:07.134610 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d92164e4-41c9-4420-963f-c1b30132b673 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:07.135039 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d92164e4-41c9-4420-963f-c1b30132b673 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:07.153327 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-54ccd117-35fa-41e8-8cf2-7217474f7362 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:07.161165 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-54ccd117-35fa-41e8-8cf2-7217474f7362 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/b251e3ee-3076-4374-ba01-89488f4d8fc3" status: 200 len: 1314 microversion: 2.1 time: 0.172706 Oct 27 03:24:07.162011 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 549/1036] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:06 2022] GET /compute/v2.1/servers/b251e3ee-3076-4374-ba01-89488f4d8fc3 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:07.166946 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c3081813-bb2d-4287-8c61-fb8ff55beb8a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:07.167827 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c3081813-bb2d-4287-8c61-fb8ff55beb8a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 8559e641-f41e-4b21-88b1-56d57ded5ce6] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:07.223910 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c3081813-bb2d-4287-8c61-fb8ff55beb8a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:07.232579 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c3081813-bb2d-4287-8c61-fb8ff55beb8a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:07.234018 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c3081813-bb2d-4287-8c61-fb8ff55beb8a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:07.235220 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c3081813-bb2d-4287-8c61-fb8ff55beb8a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/8559e641-f41e-4b21-88b1-56d57ded5ce6" status: 200 len: 1261 microversion: 2.25 time: 0.071890 Oct 27 03:24:07.236090 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 550/1037] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:07 2022] GET /compute/v2.1/servers/8559e641-f41e-4b21-88b1-56d57ded5ce6 => generated 1261 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:24:07.305261 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d92164e4-41c9-4420-963f-c1b30132b673 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e23378ed283426cbff623265d9bbc96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f033d34ad44397bfda5cba4c041071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:07.314594 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d92164e4-41c9-4420-963f-c1b30132b673 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] 10.222.0.20 "GET /compute/v2.1/servers/acb62f35-0751-41fe-ba8d-78b2357380e9" status: 200 len: 1387 microversion: 2.1 time: 0.208044 Oct 27 03:24:07.315420 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 488/1038] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:07 2022] GET /compute/v2.1/servers/acb62f35-0751-41fe-ba8d-78b2357380e9 => generated 1387 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:07.398691 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b32010a4-b74d-4214-a6b9-9ce56c426b32 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:07.399242 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b32010a4-b74d-4214-a6b9-9ce56c426b32 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 77dd3d48-fede-491a-b6ce-5ad36a1d7cab] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:07.405611 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b32010a4-b74d-4214-a6b9-9ce56c426b32 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:07.406144 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b32010a4-b74d-4214-a6b9-9ce56c426b32 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:07.406618 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b32010a4-b74d-4214-a6b9-9ce56c426b32 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:07.407758 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b32010a4-b74d-4214-a6b9-9ce56c426b32 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:07.407874 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b32010a4-b74d-4214-a6b9-9ce56c426b32 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:07.408410 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b32010a4-b74d-4214-a6b9-9ce56c426b32 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:07.432996 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1248edb1-7bc2-41f5-821e-c22033e42a87 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:07.438076 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1248edb1-7bc2-41f5-821e-c22033e42a87 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 521ddedc-cff2-4c42-a737-9590906b07a6] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:07.447571 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1248edb1-7bc2-41f5-821e-c22033e42a87 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:07.454809 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1248edb1-7bc2-41f5-821e-c22033e42a87 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:07.455606 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1248edb1-7bc2-41f5-821e-c22033e42a87 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:07.456483 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1248edb1-7bc2-41f5-821e-c22033e42a87 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:07.457018 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1248edb1-7bc2-41f5-821e-c22033e42a87 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:07.458468 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1248edb1-7bc2-41f5-821e-c22033e42a87 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:07.716989 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1248edb1-7bc2-41f5-821e-c22033e42a87 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:07.722498 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b32010a4-b74d-4214-a6b9-9ce56c426b32 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:07.728260 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1248edb1-7bc2-41f5-821e-c22033e42a87 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/521ddedc-cff2-4c42-a737-9590906b07a6" status: 200 len: 1308 microversion: 2.1 time: 0.301903 Oct 27 03:24:07.729117 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 489/1039] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:07 2022] GET /compute/v2.1/servers/521ddedc-cff2-4c42-a737-9590906b07a6 => generated 1308 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:24:07.733673 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b32010a4-b74d-4214-a6b9-9ce56c426b32 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab" status: 200 len: 1537 microversion: 2.1 time: 0.337388 Oct 27 03:24:07.734392 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 551/1040] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:07 2022] GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab => generated 1537 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:07.749577 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d06ad85c-4e59-4325-b551-a5b6ce61c1c1 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:07.749577 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d06ad85c-4e59-4325-b551-a5b6ce61c1c1 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:07.762639 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d06ad85c-4e59-4325-b551-a5b6ce61c1c1 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:07.763144 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d06ad85c-4e59-4325-b551-a5b6ce61c1c1 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:07.763582 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d06ad85c-4e59-4325-b551-a5b6ce61c1c1 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:07.764510 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d06ad85c-4e59-4325-b551-a5b6ce61c1c1 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:07.765165 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d06ad85c-4e59-4325-b551-a5b6ce61c1c1 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:07.765833 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d06ad85c-4e59-4325-b551-a5b6ce61c1c1 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:07.851238 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-24f6b391-c7d3-46a3-ae2f-18b988e36f4e tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:07.852821 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-24f6b391-c7d3-46a3-ae2f-18b988e36f4e tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: a52fed88-50f8-4dea-b83d-6878adccb024] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:07.864532 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-24f6b391-c7d3-46a3-ae2f-18b988e36f4e tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:07.865043 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-24f6b391-c7d3-46a3-ae2f-18b988e36f4e tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:07.865489 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-24f6b391-c7d3-46a3-ae2f-18b988e36f4e tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:07.866401 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-24f6b391-c7d3-46a3-ae2f-18b988e36f4e tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:07.866865 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-24f6b391-c7d3-46a3-ae2f-18b988e36f4e tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:07.869428 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-24f6b391-c7d3-46a3-ae2f-18b988e36f4e tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:07.906090 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d06ad85c-4e59-4325-b551-a5b6ce61c1c1 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:07.923759 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d06ad85c-4e59-4325-b551-a5b6ce61c1c1 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:07.930238 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d06ad85c-4e59-4325-b551-a5b6ce61c1c1 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:07.936827 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d06ad85c-4e59-4325-b551-a5b6ce61c1c1 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1537 microversion: 2.91 time: 0.206146 Oct 27 03:24:07.938908 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 490/1041] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:07 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1537 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:24:07.980682 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c9239254-1924-400a-b465-aa8c97a7d31a tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:07.981303 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c9239254-1924-400a-b465-aa8c97a7d31a tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] [instance: 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:07.988391 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c9239254-1924-400a-b465-aa8c97a7d31a tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:07.989118 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c9239254-1924-400a-b465-aa8c97a7d31a tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:07.989561 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c9239254-1924-400a-b465-aa8c97a7d31a tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:07.990308 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c9239254-1924-400a-b465-aa8c97a7d31a tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:07.990766 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c9239254-1924-400a-b465-aa8c97a7d31a tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:07.991374 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c9239254-1924-400a-b465-aa8c97a7d31a tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:08.028673 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-24f6b391-c7d3-46a3-ae2f-18b988e36f4e tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:08.037245 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-24f6b391-c7d3-46a3-ae2f-18b988e36f4e tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/a52fed88-50f8-4dea-b83d-6878adccb024" status: 200 len: 1505 microversion: 2.1 time: 0.189827 Oct 27 03:24:08.037841 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 552/1042] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:07 2022] GET /compute/v2.1/servers/a52fed88-50f8-4dea-b83d-6878adccb024 => generated 1505 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:24:08.117694 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-c9239254-1924-400a-b465-aa8c97a7d31a tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lazy-loading 'services' on Instance uuid 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503 {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:24:08.135392 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:24:08.138379 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c9239254-1924-400a-b465-aa8c97a7d31a tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503" status: 200 len: 1927 microversion: 2.75 time: 0.161389 Oct 27 03:24:08.139356 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 491/1043] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:07 2022] GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503 => generated 1927 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:24:08.189123 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-44edd168-3a6f-40ed-93d4-bc18ffdf3c57 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:08.189834 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-44edd168-3a6f-40ed-93d4-bc18ffdf3c57 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: b251e3ee-3076-4374-ba01-89488f4d8fc3] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:08.220878 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-44edd168-3a6f-40ed-93d4-bc18ffdf3c57 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:08.221629 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-44edd168-3a6f-40ed-93d4-bc18ffdf3c57 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:08.224348 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-44edd168-3a6f-40ed-93d4-bc18ffdf3c57 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:08.224348 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-44edd168-3a6f-40ed-93d4-bc18ffdf3c57 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:08.224348 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-44edd168-3a6f-40ed-93d4-bc18ffdf3c57 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:08.224348 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-44edd168-3a6f-40ed-93d4-bc18ffdf3c57 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:08.271491 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3eb5ad30-fdf0-46a7-974b-8dc045e82bf6 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:08.273861 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3eb5ad30-fdf0-46a7-974b-8dc045e82bf6 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 8559e641-f41e-4b21-88b1-56d57ded5ce6] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:08.291984 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3eb5ad30-fdf0-46a7-974b-8dc045e82bf6 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:08.293864 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3eb5ad30-fdf0-46a7-974b-8dc045e82bf6 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:08.297066 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3eb5ad30-fdf0-46a7-974b-8dc045e82bf6 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:08.298183 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3eb5ad30-fdf0-46a7-974b-8dc045e82bf6 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:08.299077 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3eb5ad30-fdf0-46a7-974b-8dc045e82bf6 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:08.301211 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3eb5ad30-fdf0-46a7-974b-8dc045e82bf6 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:08.389949 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-44edd168-3a6f-40ed-93d4-bc18ffdf3c57 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:08.399334 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-44edd168-3a6f-40ed-93d4-bc18ffdf3c57 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/b251e3ee-3076-4374-ba01-89488f4d8fc3" status: 200 len: 1314 microversion: 2.1 time: 0.218978 Oct 27 03:24:08.400264 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 553/1044] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:08 2022] GET /compute/v2.1/servers/b251e3ee-3076-4374-ba01-89488f4d8fc3 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:08.406431 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7800a77e-ce71-4a9c-bea2-60e0de9ee342 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:08.407878 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7800a77e-ce71-4a9c-bea2-60e0de9ee342 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] [instance: acb62f35-0751-41fe-ba8d-78b2357380e9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:08.410416 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3eb5ad30-fdf0-46a7-974b-8dc045e82bf6 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:08.414577 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7800a77e-ce71-4a9c-bea2-60e0de9ee342 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:08.415233 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7800a77e-ce71-4a9c-bea2-60e0de9ee342 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:08.415828 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7800a77e-ce71-4a9c-bea2-60e0de9ee342 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:08.424082 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3eb5ad30-fdf0-46a7-974b-8dc045e82bf6 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:08.425387 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7800a77e-ce71-4a9c-bea2-60e0de9ee342 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:08.425585 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3eb5ad30-fdf0-46a7-974b-8dc045e82bf6 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:08.426272 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7800a77e-ce71-4a9c-bea2-60e0de9ee342 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:08.426885 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7800a77e-ce71-4a9c-bea2-60e0de9ee342 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:08.427415 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3eb5ad30-fdf0-46a7-974b-8dc045e82bf6 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/8559e641-f41e-4b21-88b1-56d57ded5ce6" status: 200 len: 1265 microversion: 2.25 time: 0.169936 Oct 27 03:24:08.428611 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 492/1045] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:08 2022] GET /compute/v2.1/servers/8559e641-f41e-4b21-88b1-56d57ded5ce6 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:24:08.562692 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7800a77e-ce71-4a9c-bea2-60e0de9ee342 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e23378ed283426cbff623265d9bbc96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f033d34ad44397bfda5cba4c041071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:08.571004 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7800a77e-ce71-4a9c-bea2-60e0de9ee342 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] 10.222.0.20 "GET /compute/v2.1/servers/acb62f35-0751-41fe-ba8d-78b2357380e9" status: 200 len: 1387 microversion: 2.1 time: 0.169354 Oct 27 03:24:08.571586 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 554/1046] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:08 2022] GET /compute/v2.1/servers/acb62f35-0751-41fe-ba8d-78b2357380e9 => generated 1387 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:08.752907 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7ac19dab-bbf8-4c1b-8347-eea2f8fe7b42 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:08.753527 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7ac19dab-bbf8-4c1b-8347-eea2f8fe7b42 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 521ddedc-cff2-4c42-a737-9590906b07a6] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:08.761154 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-44646c47-0f7f-4072-b7f2-4bd2ebb19899 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:08.761612 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7ac19dab-bbf8-4c1b-8347-eea2f8fe7b42 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:08.761876 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-44646c47-0f7f-4072-b7f2-4bd2ebb19899 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 77dd3d48-fede-491a-b6ce-5ad36a1d7cab] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:08.762075 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7ac19dab-bbf8-4c1b-8347-eea2f8fe7b42 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:08.762527 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7ac19dab-bbf8-4c1b-8347-eea2f8fe7b42 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:08.763230 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7ac19dab-bbf8-4c1b-8347-eea2f8fe7b42 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:08.763899 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7ac19dab-bbf8-4c1b-8347-eea2f8fe7b42 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:08.764333 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7ac19dab-bbf8-4c1b-8347-eea2f8fe7b42 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:08.769498 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=100 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:24:08.769791 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-44646c47-0f7f-4072-b7f2-4bd2ebb19899 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:08.770518 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-44646c47-0f7f-4072-b7f2-4bd2ebb19899 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:08.770968 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-44646c47-0f7f-4072-b7f2-4bd2ebb19899 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:08.771706 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-44646c47-0f7f-4072-b7f2-4bd2ebb19899 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:08.772258 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-44646c47-0f7f-4072-b7f2-4bd2ebb19899 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:08.772702 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-44646c47-0f7f-4072-b7f2-4bd2ebb19899 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:09.004644 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7ac19dab-bbf8-4c1b-8347-eea2f8fe7b42 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:09.008927 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-44646c47-0f7f-4072-b7f2-4bd2ebb19899 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:09.017020 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7ac19dab-bbf8-4c1b-8347-eea2f8fe7b42 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/521ddedc-cff2-4c42-a737-9590906b07a6" status: 200 len: 1308 microversion: 2.1 time: 0.268892 Oct 27 03:24:09.020042 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-44646c47-0f7f-4072-b7f2-4bd2ebb19899 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab" status: 200 len: 1537 microversion: 2.1 time: 0.263011 Oct 27 03:24:09.020493 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 493/1047] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:08 2022] GET /compute/v2.1/servers/521ddedc-cff2-4c42-a737-9590906b07a6 => generated 1308 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:09.020617 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 555/1048] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:08 2022] GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab => generated 1537 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:24:09.034296 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c3b5bf4d-bede-4b0e-99c3-0eb220716778 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:09.034708 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c3b5bf4d-bede-4b0e-99c3-0eb220716778 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:09.043227 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c3b5bf4d-bede-4b0e-99c3-0eb220716778 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:09.047980 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c3b5bf4d-bede-4b0e-99c3-0eb220716778 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:09.048668 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c3b5bf4d-bede-4b0e-99c3-0eb220716778 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:09.049536 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c3b5bf4d-bede-4b0e-99c3-0eb220716778 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:09.050012 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c3b5bf4d-bede-4b0e-99c3-0eb220716778 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:09.050655 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c3b5bf4d-bede-4b0e-99c3-0eb220716778 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:09.060896 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4d2e4db2-be02-4e87-918f-5e1fe1823d35 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:09.061713 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4d2e4db2-be02-4e87-918f-5e1fe1823d35 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: a52fed88-50f8-4dea-b83d-6878adccb024] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:09.068584 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4d2e4db2-be02-4e87-918f-5e1fe1823d35 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:09.069285 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4d2e4db2-be02-4e87-918f-5e1fe1823d35 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:09.070144 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4d2e4db2-be02-4e87-918f-5e1fe1823d35 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:09.071212 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4d2e4db2-be02-4e87-918f-5e1fe1823d35 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:09.071831 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4d2e4db2-be02-4e87-918f-5e1fe1823d35 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:09.072418 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4d2e4db2-be02-4e87-918f-5e1fe1823d35 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:09.190648 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c3b5bf4d-bede-4b0e-99c3-0eb220716778 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:09.222964 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c3b5bf4d-bede-4b0e-99c3-0eb220716778 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:09.226432 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c3b5bf4d-bede-4b0e-99c3-0eb220716778 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:09.234976 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c3b5bf4d-bede-4b0e-99c3-0eb220716778 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1540 microversion: 2.91 time: 0.211829 Oct 27 03:24:09.235837 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 556/1049] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:09 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1540 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:24:09.241542 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e8373032-eb83-42d6-909e-6f2bf80fb8a6 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:09.243142 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e8373032-eb83-42d6-909e-6f2bf80fb8a6 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] [instance: 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:09.251277 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e8373032-eb83-42d6-909e-6f2bf80fb8a6 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:09.252622 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e8373032-eb83-42d6-909e-6f2bf80fb8a6 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:09.253098 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e8373032-eb83-42d6-909e-6f2bf80fb8a6 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:09.253813 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e8373032-eb83-42d6-909e-6f2bf80fb8a6 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:09.254502 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e8373032-eb83-42d6-909e-6f2bf80fb8a6 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:09.255101 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e8373032-eb83-42d6-909e-6f2bf80fb8a6 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:09.268363 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4d2e4db2-be02-4e87-918f-5e1fe1823d35 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:09.277208 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4d2e4db2-be02-4e87-918f-5e1fe1823d35 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/a52fed88-50f8-4dea-b83d-6878adccb024" status: 200 len: 1505 microversion: 2.1 time: 0.220456 Oct 27 03:24:09.277769 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 494/1050] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:09 2022] GET /compute/v2.1/servers/a52fed88-50f8-4dea-b83d-6878adccb024 => generated 1505 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:24:09.283282 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-fca368d7-a17c-4e6a-ae6c-73c37e7956a5 tempest-UnshelveToHostMultiNodesTest-20786752 tempest-UnshelveToHostMultiNodesTest-20786752-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h2-862769-1"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:24:09.286054 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-fca368d7-a17c-4e6a-ae6c-73c37e7956a5 tempest-UnshelveToHostMultiNodesTest-20786752 tempest-UnshelveToHostMultiNodesTest-20786752-project-admin] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:09.292736 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fca368d7-a17c-4e6a-ae6c-73c37e7956a5 tempest-UnshelveToHostMultiNodesTest-20786752 tempest-UnshelveToHostMultiNodesTest-20786752-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:09.293303 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fca368d7-a17c-4e6a-ae6c-73c37e7956a5 tempest-UnshelveToHostMultiNodesTest-20786752 tempest-UnshelveToHostMultiNodesTest-20786752-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:09.293801 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fca368d7-a17c-4e6a-ae6c-73c37e7956a5 tempest-UnshelveToHostMultiNodesTest-20786752 tempest-UnshelveToHostMultiNodesTest-20786752-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:09.294571 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fca368d7-a17c-4e6a-ae6c-73c37e7956a5 tempest-UnshelveToHostMultiNodesTest-20786752 tempest-UnshelveToHostMultiNodesTest-20786752-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:09.295193 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fca368d7-a17c-4e6a-ae6c-73c37e7956a5 tempest-UnshelveToHostMultiNodesTest-20786752 tempest-UnshelveToHostMultiNodesTest-20786752-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:09.295925 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fca368d7-a17c-4e6a-ae6c-73c37e7956a5 tempest-UnshelveToHostMultiNodesTest-20786752 tempest-UnshelveToHostMultiNodesTest-20786752-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:09.331500 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-e8373032-eb83-42d6-909e-6f2bf80fb8a6 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lazy-loading 'services' on Instance uuid 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503 {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:24:09.337796 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-fca368d7-a17c-4e6a-ae6c-73c37e7956a5 tempest-UnshelveToHostMultiNodesTest-20786752 tempest-UnshelveToHostMultiNodesTest-20786752-project-admin] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h2-862769-1". {{(pid=121001) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 27 03:24:09.380780 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e8373032-eb83-42d6-909e-6f2bf80fb8a6 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503" status: 200 len: 1927 microversion: 2.75 time: 0.143732 Oct 27 03:24:09.381489 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 557/1051] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:09 2022] GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503 => generated 1927 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:24:09.424369 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-63750be5-b470-4eab-8857-b0e47547a6c7 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:09.425142 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-63750be5-b470-4eab-8857-b0e47547a6c7 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: b251e3ee-3076-4374-ba01-89488f4d8fc3] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:09.431001 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-63750be5-b470-4eab-8857-b0e47547a6c7 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:09.431491 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-63750be5-b470-4eab-8857-b0e47547a6c7 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:09.431934 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-63750be5-b470-4eab-8857-b0e47547a6c7 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:09.432632 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-63750be5-b470-4eab-8857-b0e47547a6c7 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:09.433091 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-63750be5-b470-4eab-8857-b0e47547a6c7 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:09.433520 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-63750be5-b470-4eab-8857-b0e47547a6c7 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:09.594557 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-63750be5-b470-4eab-8857-b0e47547a6c7 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:09.598048 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=100 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:24:09.602524 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-63750be5-b470-4eab-8857-b0e47547a6c7 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/b251e3ee-3076-4374-ba01-89488f4d8fc3" status: 200 len: 1314 microversion: 2.1 time: 0.182632 Oct 27 03:24:09.609212 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 558/1052] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:09 2022] GET /compute/v2.1/servers/b251e3ee-3076-4374-ba01-89488f4d8fc3 => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:24:09.609212 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-538e2155-7616-4aa2-a273-9b8829b3c968 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:09.609212 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-538e2155-7616-4aa2-a273-9b8829b3c968 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 8559e641-f41e-4b21-88b1-56d57ded5ce6] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:09.614716 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-538e2155-7616-4aa2-a273-9b8829b3c968 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:09.615206 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-538e2155-7616-4aa2-a273-9b8829b3c968 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:09.615651 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-538e2155-7616-4aa2-a273-9b8829b3c968 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:09.616349 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-538e2155-7616-4aa2-a273-9b8829b3c968 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:09.616807 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-538e2155-7616-4aa2-a273-9b8829b3c968 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:09.617268 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-538e2155-7616-4aa2-a273-9b8829b3c968 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:09.679798 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-538e2155-7616-4aa2-a273-9b8829b3c968 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:09.687299 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-fca368d7-a17c-4e6a-ae6c-73c37e7956a5 tempest-UnshelveToHostMultiNodesTest-20786752 tempest-UnshelveToHostMultiNodesTest-20786752-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b/action" status: 202 len: 0 microversion: 2.91 time: 0.403726 Oct 27 03:24:09.687951 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 495/1053] 10.222.0.20 () {62 vars in 1319 bytes} [Thu Oct 27 03:24:09 2022] POST /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b/action => generated 0 bytes in 410 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:24:09.696580 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b3eef8c3-2f5d-4e7e-9fb4-c47aea853ce0 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:09.697760 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b3eef8c3-2f5d-4e7e-9fb4-c47aea853ce0 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] [instance: acb62f35-0751-41fe-ba8d-78b2357380e9] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:09.700709 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-538e2155-7616-4aa2-a273-9b8829b3c968 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:09.704920 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-538e2155-7616-4aa2-a273-9b8829b3c968 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:09.706308 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-538e2155-7616-4aa2-a273-9b8829b3c968 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/8559e641-f41e-4b21-88b1-56d57ded5ce6" status: 200 len: 1313 microversion: 2.25 time: 0.102259 Oct 27 03:24:09.708465 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 559/1054] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:09 2022] GET /compute/v2.1/servers/8559e641-f41e-4b21-88b1-56d57ded5ce6 => generated 1313 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:24:09.715124 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c4e1c747-3559-47cb-902c-74ebe0498428 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:09.716718 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c4e1c747-3559-47cb-902c-74ebe0498428 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:09.724097 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c4e1c747-3559-47cb-902c-74ebe0498428 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:09.725380 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c4e1c747-3559-47cb-902c-74ebe0498428 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:09.725380 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c4e1c747-3559-47cb-902c-74ebe0498428 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:09.725737 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c4e1c747-3559-47cb-902c-74ebe0498428 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:09.727169 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c4e1c747-3559-47cb-902c-74ebe0498428 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:09.727622 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c4e1c747-3559-47cb-902c-74ebe0498428 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:09.736649 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b3eef8c3-2f5d-4e7e-9fb4-c47aea853ce0 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:09.743078 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b3eef8c3-2f5d-4e7e-9fb4-c47aea853ce0 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:09.743078 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b3eef8c3-2f5d-4e7e-9fb4-c47aea853ce0 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:09.743078 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b3eef8c3-2f5d-4e7e-9fb4-c47aea853ce0 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:09.743356 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b3eef8c3-2f5d-4e7e-9fb4-c47aea853ce0 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:09.743356 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b3eef8c3-2f5d-4e7e-9fb4-c47aea853ce0 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:09.799970 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c4e1c747-3559-47cb-902c-74ebe0498428 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:09.808309 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c4e1c747-3559-47cb-902c-74ebe0498428 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:09.809756 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c4e1c747-3559-47cb-902c-74ebe0498428 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:09.814738 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c4e1c747-3559-47cb-902c-74ebe0498428 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1548 microversion: 2.91 time: 0.105005 Oct 27 03:24:09.815323 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 560/1055] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:09 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1548 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:24:09.822063 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-3682dc3c-cf14-4977-8313-73472c0ee68f req-2e7d7271-a7e4-434f-9415-81137238adad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acb62f35-0751-41fe-ba8d-78b2357380e9", "name": "network-vif-plugged", "status": "completed", "tag": "3f3c7991-4bc4-4933-8fde-a37f0e0f65a9"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:24:09.829823 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-3682dc3c-cf14-4977-8313-73472c0ee68f req-2e7d7271-a7e4-434f-9415-81137238adad service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:09.830224 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-3682dc3c-cf14-4977-8313-73472c0ee68f req-2e7d7271-a7e4-434f-9415-81137238adad service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:09.830650 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-3682dc3c-cf14-4977-8313-73472c0ee68f req-2e7d7271-a7e4-434f-9415-81137238adad service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:09.843057 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-3682dc3c-cf14-4977-8313-73472c0ee68f req-2e7d7271-a7e4-434f-9415-81137238adad service nova] Creating event network-vif-plugged:3f3c7991-4bc4-4933-8fde-a37f0e0f65a9 for instance acb62f35-0751-41fe-ba8d-78b2357380e9 on n-h1-862769-1 Oct 27 03:24:09.848594 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-3682dc3c-cf14-4977-8313-73472c0ee68f req-2e7d7271-a7e4-434f-9415-81137238adad service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032096 Oct 27 03:24:09.849206 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 561/1056] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:24:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:24:09.998726 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b3eef8c3-2f5d-4e7e-9fb4-c47aea853ce0 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e23378ed283426cbff623265d9bbc96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f033d34ad44397bfda5cba4c041071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:10.007998 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b3eef8c3-2f5d-4e7e-9fb4-c47aea853ce0 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] 10.222.0.20 "GET /compute/v2.1/servers/acb62f35-0751-41fe-ba8d-78b2357380e9" status: 200 len: 1387 microversion: 2.1 time: 0.318649 Oct 27 03:24:10.008681 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 496/1057] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:09 2022] GET /compute/v2.1/servers/acb62f35-0751-41fe-ba8d-78b2357380e9 => generated 1387 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:10.048768 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-00fdb8d1-06b9-4eed-bd8e-61b8584bbc9c tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:10.050138 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-12c49a44-e570-4f0f-9663-548e0535360b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:10.050830 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-00fdb8d1-06b9-4eed-bd8e-61b8584bbc9c tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 77dd3d48-fede-491a-b6ce-5ad36a1d7cab] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:10.054495 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-12c49a44-e570-4f0f-9663-548e0535360b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 521ddedc-cff2-4c42-a737-9590906b07a6] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:10.062800 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-12c49a44-e570-4f0f-9663-548e0535360b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:10.063337 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-12c49a44-e570-4f0f-9663-548e0535360b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:10.063742 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-12c49a44-e570-4f0f-9663-548e0535360b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:10.064457 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-12c49a44-e570-4f0f-9663-548e0535360b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:10.064913 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-12c49a44-e570-4f0f-9663-548e0535360b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:10.065342 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-12c49a44-e570-4f0f-9663-548e0535360b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:10.067695 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-00fdb8d1-06b9-4eed-bd8e-61b8584bbc9c tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:10.068184 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-00fdb8d1-06b9-4eed-bd8e-61b8584bbc9c tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:10.068623 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-00fdb8d1-06b9-4eed-bd8e-61b8584bbc9c tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:10.069328 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-00fdb8d1-06b9-4eed-bd8e-61b8584bbc9c tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:10.069781 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-00fdb8d1-06b9-4eed-bd8e-61b8584bbc9c tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:10.070245 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-00fdb8d1-06b9-4eed-bd8e-61b8584bbc9c tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:10.227731 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-12c49a44-e570-4f0f-9663-548e0535360b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:10.237108 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-12c49a44-e570-4f0f-9663-548e0535360b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/521ddedc-cff2-4c42-a737-9590906b07a6" status: 200 len: 1487 microversion: 2.1 time: 0.196878 Oct 27 03:24:10.250087 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 562/1058] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:10 2022] GET /compute/v2.1/servers/521ddedc-cff2-4c42-a737-9590906b07a6 => generated 1487 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:10.266621 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d078e552-164e-4889-a009-ffadb3f0cf35 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:24:10.267739 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d078e552-164e-4889-a009-ffadb3f0cf35 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 521ddedc-cff2-4c42-a737-9590906b07a6] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:10.273476 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d078e552-164e-4889-a009-ffadb3f0cf35 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:10.273972 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d078e552-164e-4889-a009-ffadb3f0cf35 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:10.274437 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d078e552-164e-4889-a009-ffadb3f0cf35 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:10.275145 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d078e552-164e-4889-a009-ffadb3f0cf35 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:10.275624 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d078e552-164e-4889-a009-ffadb3f0cf35 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:10.276041 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d078e552-164e-4889-a009-ffadb3f0cf35 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:10.283152 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-00fdb8d1-06b9-4eed-bd8e-61b8584bbc9c tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:10.301477 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-00fdb8d1-06b9-4eed-bd8e-61b8584bbc9c tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab" status: 200 len: 1542 microversion: 2.1 time: 0.260407 Oct 27 03:24:10.315203 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 497/1059] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:10 2022] GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab => generated 1542 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:10.320166 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-65bf6775-066b-4f1d-a163-7d6bdc09e537 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:10.321450 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-65bf6775-066b-4f1d-a163-7d6bdc09e537 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: a52fed88-50f8-4dea-b83d-6878adccb024] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:10.329850 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-65bf6775-066b-4f1d-a163-7d6bdc09e537 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:10.330370 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-65bf6775-066b-4f1d-a163-7d6bdc09e537 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:10.330841 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-65bf6775-066b-4f1d-a163-7d6bdc09e537 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:10.331778 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-65bf6775-066b-4f1d-a163-7d6bdc09e537 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:10.332236 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-65bf6775-066b-4f1d-a163-7d6bdc09e537 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:10.332665 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-65bf6775-066b-4f1d-a163-7d6bdc09e537 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:10.541211 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-65bf6775-066b-4f1d-a163-7d6bdc09e537 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:10.549606 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-65bf6775-066b-4f1d-a163-7d6bdc09e537 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/a52fed88-50f8-4dea-b83d-6878adccb024" status: 200 len: 1505 microversion: 2.1 time: 0.234495 Oct 27 03:24:10.550472 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 498/1060] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:10 2022] GET /compute/v2.1/servers/a52fed88-50f8-4dea-b83d-6878adccb024 => generated 1505 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:10.555056 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2f5b2bd9-c084-423f-8a91-e1eae3e6da4d tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:10.555605 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2f5b2bd9-c084-423f-8a91-e1eae3e6da4d tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] [instance: 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:10.561349 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2f5b2bd9-c084-423f-8a91-e1eae3e6da4d tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:10.562060 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2f5b2bd9-c084-423f-8a91-e1eae3e6da4d tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:10.563363 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2f5b2bd9-c084-423f-8a91-e1eae3e6da4d tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:10.564221 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2f5b2bd9-c084-423f-8a91-e1eae3e6da4d tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:10.564835 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2f5b2bd9-c084-423f-8a91-e1eae3e6da4d tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:10.565423 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2f5b2bd9-c084-423f-8a91-e1eae3e6da4d tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:10.603122 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d078e552-164e-4889-a009-ffadb3f0cf35 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "POST /compute/v2.1/servers/521ddedc-cff2-4c42-a737-9590906b07a6/action" status: 202 len: 0 microversion: 2.1 time: 0.341267 Oct 27 03:24:10.607957 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 563/1061] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:24:10 2022] POST /compute/v2.1/servers/521ddedc-cff2-4c42-a737-9590906b07a6/action => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:24:10.614348 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5b94ad3f-b93d-4980-b72f-07ed10623f22 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:10.615113 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5b94ad3f-b93d-4980-b72f-07ed10623f22 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 521ddedc-cff2-4c42-a737-9590906b07a6] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:10.622305 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=100 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:24:10.624400 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5b94ad3f-b93d-4980-b72f-07ed10623f22 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:10.625015 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5b94ad3f-b93d-4980-b72f-07ed10623f22 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:10.626024 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5b94ad3f-b93d-4980-b72f-07ed10623f22 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:10.626782 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5b94ad3f-b93d-4980-b72f-07ed10623f22 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:10.627308 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5b94ad3f-b93d-4980-b72f-07ed10623f22 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:10.628618 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5b94ad3f-b93d-4980-b72f-07ed10623f22 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:10.649317 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-2f5b2bd9-c084-423f-8a91-e1eae3e6da4d tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lazy-loading 'services' on Instance uuid 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503 {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:24:10.671680 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2f5b2bd9-c084-423f-8a91-e1eae3e6da4d tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503" status: 200 len: 1927 microversion: 2.75 time: 0.120136 Oct 27 03:24:10.676913 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 499/1062] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:10 2022] GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503 => generated 1927 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:24:10.679075 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3f143209-0373-49fe-9045-b5ea0ea702f2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:10.679693 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3f143209-0373-49fe-9045-b5ea0ea702f2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: b251e3ee-3076-4374-ba01-89488f4d8fc3] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:10.685454 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3f143209-0373-49fe-9045-b5ea0ea702f2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:10.685943 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3f143209-0373-49fe-9045-b5ea0ea702f2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:10.686415 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3f143209-0373-49fe-9045-b5ea0ea702f2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:10.687112 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3f143209-0373-49fe-9045-b5ea0ea702f2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:10.687561 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3f143209-0373-49fe-9045-b5ea0ea702f2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:10.688592 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3f143209-0373-49fe-9045-b5ea0ea702f2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:10.774436 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5b94ad3f-b93d-4980-b72f-07ed10623f22 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:10.782314 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5b94ad3f-b93d-4980-b72f-07ed10623f22 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/521ddedc-cff2-4c42-a737-9590906b07a6" status: 200 len: 1492 microversion: 2.1 time: 0.173108 Oct 27 03:24:10.782892 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 564/1063] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:10 2022] GET /compute/v2.1/servers/521ddedc-cff2-4c42-a737-9590906b07a6 => generated 1492 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:10.787338 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b4cd816d-2212-4110-8948-9f81ff0dccb1 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:10.787941 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b4cd816d-2212-4110-8948-9f81ff0dccb1 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 8559e641-f41e-4b21-88b1-56d57ded5ce6] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:10.793595 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b4cd816d-2212-4110-8948-9f81ff0dccb1 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:10.794132 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b4cd816d-2212-4110-8948-9f81ff0dccb1 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:10.794573 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b4cd816d-2212-4110-8948-9f81ff0dccb1 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:10.795270 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b4cd816d-2212-4110-8948-9f81ff0dccb1 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:10.795725 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b4cd816d-2212-4110-8948-9f81ff0dccb1 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:10.796160 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b4cd816d-2212-4110-8948-9f81ff0dccb1 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:10.902694 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3f143209-0373-49fe-9045-b5ea0ea702f2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:10.916249 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3f143209-0373-49fe-9045-b5ea0ea702f2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/b251e3ee-3076-4374-ba01-89488f4d8fc3" status: 200 len: 1314 microversion: 2.1 time: 0.235770 Oct 27 03:24:10.916249 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 500/1064] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:10 2022] GET /compute/v2.1/servers/b251e3ee-3076-4374-ba01-89488f4d8fc3 => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:10.916716 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-fcf1b65a-3a65-417f-ac16-878e7e54d96d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:10.917688 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-fcf1b65a-3a65-417f-ac16-878e7e54d96d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:10.928653 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fcf1b65a-3a65-417f-ac16-878e7e54d96d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:10.929151 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fcf1b65a-3a65-417f-ac16-878e7e54d96d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:10.929601 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fcf1b65a-3a65-417f-ac16-878e7e54d96d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:10.930347 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fcf1b65a-3a65-417f-ac16-878e7e54d96d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:10.930807 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fcf1b65a-3a65-417f-ac16-878e7e54d96d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:10.931235 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fcf1b65a-3a65-417f-ac16-878e7e54d96d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:10.951795 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b4cd816d-2212-4110-8948-9f81ff0dccb1 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:10.960709 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b4cd816d-2212-4110-8948-9f81ff0dccb1 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:10.962424 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b4cd816d-2212-4110-8948-9f81ff0dccb1 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:10.963406 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b4cd816d-2212-4110-8948-9f81ff0dccb1 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/8559e641-f41e-4b21-88b1-56d57ded5ce6" status: 200 len: 1361 microversion: 2.25 time: 0.179470 Oct 27 03:24:10.984472 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 565/1065] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:10 2022] GET /compute/v2.1/servers/8559e641-f41e-4b21-88b1-56d57ded5ce6 => generated 1361 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:24:11.033835 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9c44d50f-db4e-4295-9b50-ded15224115e tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:11.034629 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9c44d50f-db4e-4295-9b50-ded15224115e tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] [instance: acb62f35-0751-41fe-ba8d-78b2357380e9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:11.041511 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9c44d50f-db4e-4295-9b50-ded15224115e tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:11.042098 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9c44d50f-db4e-4295-9b50-ded15224115e tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:11.042649 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9c44d50f-db4e-4295-9b50-ded15224115e tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:11.043465 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9c44d50f-db4e-4295-9b50-ded15224115e tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:11.045041 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9c44d50f-db4e-4295-9b50-ded15224115e tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:11.045041 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9c44d50f-db4e-4295-9b50-ded15224115e tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:11.050612 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-fcf1b65a-3a65-417f-ac16-878e7e54d96d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:11.068309 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-fcf1b65a-3a65-417f-ac16-878e7e54d96d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:11.068309 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-fcf1b65a-3a65-417f-ac16-878e7e54d96d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:11.074817 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-fcf1b65a-3a65-417f-ac16-878e7e54d96d tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1548 microversion: 2.91 time: 0.161053 Oct 27 03:24:11.075968 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 501/1066] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:10 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1548 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:24:11.291172 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9c44d50f-db4e-4295-9b50-ded15224115e tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e23378ed283426cbff623265d9bbc96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f033d34ad44397bfda5cba4c041071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:11.300699 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9c44d50f-db4e-4295-9b50-ded15224115e tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] 10.222.0.20 "GET /compute/v2.1/servers/acb62f35-0751-41fe-ba8d-78b2357380e9" status: 200 len: 1387 microversion: 2.1 time: 0.271549 Oct 27 03:24:11.301290 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 566/1067] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:11 2022] GET /compute/v2.1/servers/acb62f35-0751-41fe-ba8d-78b2357380e9 => generated 1387 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:11.325155 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5679a2af-5f20-4c59-b9da-96203ffd83a2 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:11.326148 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5679a2af-5f20-4c59-b9da-96203ffd83a2 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 77dd3d48-fede-491a-b6ce-5ad36a1d7cab] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:11.333302 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5679a2af-5f20-4c59-b9da-96203ffd83a2 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:11.333925 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5679a2af-5f20-4c59-b9da-96203ffd83a2 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:11.334503 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5679a2af-5f20-4c59-b9da-96203ffd83a2 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:11.335316 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5679a2af-5f20-4c59-b9da-96203ffd83a2 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:11.335923 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5679a2af-5f20-4c59-b9da-96203ffd83a2 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:11.336458 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5679a2af-5f20-4c59-b9da-96203ffd83a2 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:11.540533 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-8dfaac39-e7ba-46a2-9963-69a6c9334110 req-a20d2c2a-aa47-415e-b66b-6fba23d69d3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a52fed88-50f8-4dea-b83d-6878adccb024", "name": "network-vif-unplugged", "status": "completed", "tag": "7caf6b22-42ec-4a60-b619-9a8f7eecc633"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:24:11.550870 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-8dfaac39-e7ba-46a2-9963-69a6c9334110 req-a20d2c2a-aa47-415e-b66b-6fba23d69d3a service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:11.551447 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-8dfaac39-e7ba-46a2-9963-69a6c9334110 req-a20d2c2a-aa47-415e-b66b-6fba23d69d3a service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:11.551785 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-8dfaac39-e7ba-46a2-9963-69a6c9334110 req-a20d2c2a-aa47-415e-b66b-6fba23d69d3a service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:11.563888 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-8dfaac39-e7ba-46a2-9963-69a6c9334110 req-a20d2c2a-aa47-415e-b66b-6fba23d69d3a service nova] Creating event network-vif-unplugged:7caf6b22-42ec-4a60-b619-9a8f7eecc633 for instance a52fed88-50f8-4dea-b83d-6878adccb024 on n-h2-862769-1 Oct 27 03:24:11.571428 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-8dfaac39-e7ba-46a2-9963-69a6c9334110 req-a20d2c2a-aa47-415e-b66b-6fba23d69d3a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035996 Oct 27 03:24:11.572621 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 567/1068] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:24:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:24:11.577721 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f3370fd1-31be-4184-8e76-2eff830e2a1e tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:11.578173 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5679a2af-5f20-4c59-b9da-96203ffd83a2 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:11.582919 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f3370fd1-31be-4184-8e76-2eff830e2a1e tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: a52fed88-50f8-4dea-b83d-6878adccb024] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:11.585948 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f3370fd1-31be-4184-8e76-2eff830e2a1e tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:11.586464 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5679a2af-5f20-4c59-b9da-96203ffd83a2 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab" status: 200 len: 1542 microversion: 2.1 time: 0.265542 Oct 27 03:24:11.586652 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f3370fd1-31be-4184-8e76-2eff830e2a1e tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:11.587037 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 502/1069] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:11 2022] GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab => generated 1542 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:11.587160 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f3370fd1-31be-4184-8e76-2eff830e2a1e tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:11.587796 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f3370fd1-31be-4184-8e76-2eff830e2a1e tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:11.588265 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f3370fd1-31be-4184-8e76-2eff830e2a1e tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:11.588699 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f3370fd1-31be-4184-8e76-2eff830e2a1e tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:11.701280 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0ccea1f8-9c64-466e-8908-d3c0b7338a7c tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:11.702544 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0ccea1f8-9c64-466e-8908-d3c0b7338a7c tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] [instance: 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:11.719671 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0ccea1f8-9c64-466e-8908-d3c0b7338a7c tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:11.721137 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0ccea1f8-9c64-466e-8908-d3c0b7338a7c tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:11.721814 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0ccea1f8-9c64-466e-8908-d3c0b7338a7c tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:11.722941 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0ccea1f8-9c64-466e-8908-d3c0b7338a7c tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:11.723585 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0ccea1f8-9c64-466e-8908-d3c0b7338a7c tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:11.725060 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0ccea1f8-9c64-466e-8908-d3c0b7338a7c tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:11.826709 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f3370fd1-31be-4184-8e76-2eff830e2a1e tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:11.837737 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f3370fd1-31be-4184-8e76-2eff830e2a1e tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/a52fed88-50f8-4dea-b83d-6878adccb024" status: 200 len: 1505 microversion: 2.1 time: 0.264128 Oct 27 03:24:11.841961 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-0ccea1f8-9c64-466e-8908-d3c0b7338a7c tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lazy-loading 'services' on Instance uuid 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503 {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:24:11.844475 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 568/1070] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:11 2022] GET /compute/v2.1/servers/a52fed88-50f8-4dea-b83d-6878adccb024 => generated 1505 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:11.849631 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-09aa366a-4090-4cd0-af4b-5360ba2c9a48 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:11.850819 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-09aa366a-4090-4cd0-af4b-5360ba2c9a48 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 521ddedc-cff2-4c42-a737-9590906b07a6] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:11.858614 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-09aa366a-4090-4cd0-af4b-5360ba2c9a48 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:11.860040 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-09aa366a-4090-4cd0-af4b-5360ba2c9a48 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:11.860757 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-09aa366a-4090-4cd0-af4b-5360ba2c9a48 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:11.861480 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-09aa366a-4090-4cd0-af4b-5360ba2c9a48 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:11.862021 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-09aa366a-4090-4cd0-af4b-5360ba2c9a48 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:11.862403 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-09aa366a-4090-4cd0-af4b-5360ba2c9a48 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:11.870380 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0ccea1f8-9c64-466e-8908-d3c0b7338a7c tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503" status: 200 len: 1927 microversion: 2.75 time: 0.173849 Oct 27 03:24:11.871147 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 503/1071] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:11 2022] GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503 => generated 1927 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:24:11.935450 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-942e3887-b95f-462d-9355-f23dc6a68609 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:11.936216 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-942e3887-b95f-462d-9355-f23dc6a68609 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: b251e3ee-3076-4374-ba01-89488f4d8fc3] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:11.942938 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-942e3887-b95f-462d-9355-f23dc6a68609 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:11.943527 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-942e3887-b95f-462d-9355-f23dc6a68609 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:11.944032 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-942e3887-b95f-462d-9355-f23dc6a68609 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:11.944807 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-942e3887-b95f-462d-9355-f23dc6a68609 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:11.945333 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-942e3887-b95f-462d-9355-f23dc6a68609 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:11.945827 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-942e3887-b95f-462d-9355-f23dc6a68609 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:12.257547 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-942e3887-b95f-462d-9355-f23dc6a68609 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:12.260321 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-09aa366a-4090-4cd0-af4b-5360ba2c9a48 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:12.267109 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-942e3887-b95f-462d-9355-f23dc6a68609 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/b251e3ee-3076-4374-ba01-89488f4d8fc3" status: 200 len: 1314 microversion: 2.1 time: 0.335534 Oct 27 03:24:12.268586 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 504/1072] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:11 2022] GET /compute/v2.1/servers/b251e3ee-3076-4374-ba01-89488f4d8fc3 => generated 1314 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:24:12.268690 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-09aa366a-4090-4cd0-af4b-5360ba2c9a48 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/521ddedc-cff2-4c42-a737-9590906b07a6" status: 200 len: 1472 microversion: 2.1 time: 0.422379 Oct 27 03:24:12.282578 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 569/1073] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:11 2022] GET /compute/v2.1/servers/521ddedc-cff2-4c42-a737-9590906b07a6 => generated 1472 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:12.287826 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e60734e1-62a0-402c-a159-211d1580a634 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:12.288230 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-d8678fd8-83c7-43fe-b529-2e0c39939f2a req-85ba1b91-4787-4f5e-aeb0-8e471649c78d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8559e641-f41e-4b21-88b1-56d57ded5ce6", "tag": "959f9b77-f7a5-423f-9c4f-1a5a89ebede9"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:24:12.289386 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e60734e1-62a0-402c-a159-211d1580a634 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 8559e641-f41e-4b21-88b1-56d57ded5ce6] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:12.297880 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e60734e1-62a0-402c-a159-211d1580a634 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:12.298552 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-d8678fd8-83c7-43fe-b529-2e0c39939f2a req-85ba1b91-4787-4f5e-aeb0-8e471649c78d service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:12.298793 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e60734e1-62a0-402c-a159-211d1580a634 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:12.299031 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-d8678fd8-83c7-43fe-b529-2e0c39939f2a req-85ba1b91-4787-4f5e-aeb0-8e471649c78d service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:12.299404 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e60734e1-62a0-402c-a159-211d1580a634 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:12.299526 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-d8678fd8-83c7-43fe-b529-2e0c39939f2a req-85ba1b91-4787-4f5e-aeb0-8e471649c78d service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:12.300211 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e60734e1-62a0-402c-a159-211d1580a634 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:12.300855 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e60734e1-62a0-402c-a159-211d1580a634 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:12.301469 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e60734e1-62a0-402c-a159-211d1580a634 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:12.311034 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-d8678fd8-83c7-43fe-b529-2e0c39939f2a req-85ba1b91-4787-4f5e-aeb0-8e471649c78d service nova] Creating event network-changed:959f9b77-f7a5-423f-9c4f-1a5a89ebede9 for instance 8559e641-f41e-4b21-88b1-56d57ded5ce6 on n-h2-862769-1 Oct 27 03:24:12.316353 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-d8678fd8-83c7-43fe-b529-2e0c39939f2a req-85ba1b91-4787-4f5e-aeb0-8e471649c78d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032399 Oct 27 03:24:12.317344 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 570/1074] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:24:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:24:12.322516 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-80ca9e89-180b-4d5e-bc0e-7890363f0b03 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:12.323246 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-80ca9e89-180b-4d5e-bc0e-7890363f0b03 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:12.340706 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-80ca9e89-180b-4d5e-bc0e-7890363f0b03 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:12.341222 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-80ca9e89-180b-4d5e-bc0e-7890363f0b03 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:12.341857 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-80ca9e89-180b-4d5e-bc0e-7890363f0b03 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:12.342660 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-80ca9e89-180b-4d5e-bc0e-7890363f0b03 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:12.343138 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-80ca9e89-180b-4d5e-bc0e-7890363f0b03 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:12.343687 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-80ca9e89-180b-4d5e-bc0e-7890363f0b03 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:12.441798 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-80ca9e89-180b-4d5e-bc0e-7890363f0b03 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:12.450666 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-80ca9e89-180b-4d5e-bc0e-7890363f0b03 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:12.452266 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-80ca9e89-180b-4d5e-bc0e-7890363f0b03 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:12.457104 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-80ca9e89-180b-4d5e-bc0e-7890363f0b03 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1546 microversion: 2.91 time: 0.138654 Oct 27 03:24:12.457790 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 571/1075] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:12 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1546 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:24:12.462440 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-312fb76f-3157-4fc4-adb6-2f15aea4c424 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1012839774"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:24:12.465066 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-312fb76f-3157-4fc4-adb6-2f15aea4c424 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 521ddedc-cff2-4c42-a737-9590906b07a6] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:12.471731 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-312fb76f-3157-4fc4-adb6-2f15aea4c424 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:12.472418 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-312fb76f-3157-4fc4-adb6-2f15aea4c424 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:12.473003 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-312fb76f-3157-4fc4-adb6-2f15aea4c424 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:12.473879 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-312fb76f-3157-4fc4-adb6-2f15aea4c424 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:12.474505 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-312fb76f-3157-4fc4-adb6-2f15aea4c424 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:12.475081 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-312fb76f-3157-4fc4-adb6-2f15aea4c424 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:12.821858 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e60734e1-62a0-402c-a159-211d1580a634 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:12.830719 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e60734e1-62a0-402c-a159-211d1580a634 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:12.832204 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e60734e1-62a0-402c-a159-211d1580a634 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:12.833318 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e60734e1-62a0-402c-a159-211d1580a634 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/8559e641-f41e-4b21-88b1-56d57ded5ce6" status: 200 len: 1361 microversion: 2.25 time: 0.553952 Oct 27 03:24:12.833877 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 505/1076] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:12 2022] GET /compute/v2.1/servers/8559e641-f41e-4b21-88b1-56d57ded5ce6 => generated 1361 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:24:12.838320 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d34f58aa-da4d-4bdc-90e6-547a5c0b2a57 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:12.838924 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d34f58aa-da4d-4bdc-90e6-547a5c0b2a57 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] [instance: acb62f35-0751-41fe-ba8d-78b2357380e9] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:12.845263 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d34f58aa-da4d-4bdc-90e6-547a5c0b2a57 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:12.845749 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d34f58aa-da4d-4bdc-90e6-547a5c0b2a57 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:12.846215 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d34f58aa-da4d-4bdc-90e6-547a5c0b2a57 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:12.846908 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d34f58aa-da4d-4bdc-90e6-547a5c0b2a57 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:12.847362 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d34f58aa-da4d-4bdc-90e6-547a5c0b2a57 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:12.847786 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d34f58aa-da4d-4bdc-90e6-547a5c0b2a57 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:12.858556 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-312fb76f-3157-4fc4-adb6-2f15aea4c424 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "POST /compute/v2.1/servers/521ddedc-cff2-4c42-a737-9590906b07a6/action" status: 202 len: 0 microversion: 2.1 time: 0.399506 Oct 27 03:24:12.859349 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 572/1077] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:24:12 2022] POST /compute/v2.1/servers/521ddedc-cff2-4c42-a737-9590906b07a6/action => generated 0 bytes in 401 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 27 03:24:12.865732 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e90205bd-c63b-4c92-aecb-9712a3d773e6 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:12.866526 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e90205bd-c63b-4c92-aecb-9712a3d773e6 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 77dd3d48-fede-491a-b6ce-5ad36a1d7cab] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:12.872968 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e90205bd-c63b-4c92-aecb-9712a3d773e6 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:12.873459 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e90205bd-c63b-4c92-aecb-9712a3d773e6 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:12.873897 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e90205bd-c63b-4c92-aecb-9712a3d773e6 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:12.877149 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e90205bd-c63b-4c92-aecb-9712a3d773e6 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:12.877149 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e90205bd-c63b-4c92-aecb-9712a3d773e6 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:12.877149 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e90205bd-c63b-4c92-aecb-9712a3d773e6 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:13.000999 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d34f58aa-da4d-4bdc-90e6-547a5c0b2a57 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e23378ed283426cbff623265d9bbc96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f033d34ad44397bfda5cba4c041071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:13.010255 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d34f58aa-da4d-4bdc-90e6-547a5c0b2a57 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] 10.222.0.20 "GET /compute/v2.1/servers/acb62f35-0751-41fe-ba8d-78b2357380e9" status: 200 len: 1387 microversion: 2.1 time: 0.175269 Oct 27 03:24:13.025953 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e90205bd-c63b-4c92-aecb-9712a3d773e6 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:13.027059 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 506/1078] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:12 2022] GET /compute/v2.1/servers/acb62f35-0751-41fe-ba8d-78b2357380e9 => generated 1387 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:13.046958 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e90205bd-c63b-4c92-aecb-9712a3d773e6 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab" status: 200 len: 1542 microversion: 2.1 time: 0.186274 Oct 27 03:24:13.049340 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 573/1079] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:12 2022] GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab => generated 1542 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:13.058624 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3b9563f5-da5c-4983-ad05-b5ca2dcda4e8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:13.059253 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3b9563f5-da5c-4983-ad05-b5ca2dcda4e8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: a52fed88-50f8-4dea-b83d-6878adccb024] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:13.064689 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-02a54a72-25a8-4353-b07b-7ac9c101447e tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7dda7a2040>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:13.072102 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3b9563f5-da5c-4983-ad05-b5ca2dcda4e8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:13.072838 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3b9563f5-da5c-4983-ad05-b5ca2dcda4e8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:13.073282 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3b9563f5-da5c-4983-ad05-b5ca2dcda4e8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:13.074269 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3b9563f5-da5c-4983-ad05-b5ca2dcda4e8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:13.074729 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3b9563f5-da5c-4983-ad05-b5ca2dcda4e8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:13.075165 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3b9563f5-da5c-4983-ad05-b5ca2dcda4e8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:13.123182 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-02a54a72-25a8-4353-b07b-7ac9c101447e tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/images/d07d1961-c000-42bf-b042-6a2852956faf" status: 200 len: 1414 microversion: 2.1 time: 0.072583 Oct 27 03:24:13.124052 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 574/1080] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:24:13 2022] GET /compute/v2.1/images/d07d1961-c000-42bf-b042-6a2852956faf => generated 1414 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:13.139300 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-79d716dd-c225-436d-932e-35a2ab5e6cae tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:13.140116 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-79d716dd-c225-436d-932e-35a2ab5e6cae tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] [instance: 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:13.149075 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-79d716dd-c225-436d-932e-35a2ab5e6cae tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:13.149717 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-79d716dd-c225-436d-932e-35a2ab5e6cae tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:13.150410 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-79d716dd-c225-436d-932e-35a2ab5e6cae tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:13.151310 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-79d716dd-c225-436d-932e-35a2ab5e6cae tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:13.151869 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-79d716dd-c225-436d-932e-35a2ab5e6cae tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:13.152389 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-79d716dd-c225-436d-932e-35a2ab5e6cae tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:13.260838 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-79d716dd-c225-436d-932e-35a2ab5e6cae tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lazy-loading 'services' on Instance uuid 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503 {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:24:13.264297 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:24:13.279075 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-79d716dd-c225-436d-932e-35a2ab5e6cae tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503" status: 200 len: 1927 microversion: 2.75 time: 0.147659 Oct 27 03:24:13.279801 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 575/1081] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:13 2022] GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503 => generated 1927 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:24:13.298582 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3b9563f5-da5c-4983-ad05-b5ca2dcda4e8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:13.302538 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:24:13.304104 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-edaab42b-da0d-457a-9fca-6b7d4a4fc70f tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:13.304920 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-edaab42b-da0d-457a-9fca-6b7d4a4fc70f tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: b251e3ee-3076-4374-ba01-89488f4d8fc3] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:13.307869 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3b9563f5-da5c-4983-ad05-b5ca2dcda4e8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/a52fed88-50f8-4dea-b83d-6878adccb024" status: 200 len: 1505 microversion: 2.1 time: 0.261128 Oct 27 03:24:13.308064 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 507/1082] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:13 2022] GET /compute/v2.1/servers/a52fed88-50f8-4dea-b83d-6878adccb024 => generated 1505 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:13.313144 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-edaab42b-da0d-457a-9fca-6b7d4a4fc70f tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:13.313723 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-edaab42b-da0d-457a-9fca-6b7d4a4fc70f tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:13.314318 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-edaab42b-da0d-457a-9fca-6b7d4a4fc70f tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:13.315276 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-edaab42b-da0d-457a-9fca-6b7d4a4fc70f tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:13.315830 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-edaab42b-da0d-457a-9fca-6b7d4a4fc70f tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:13.316333 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-edaab42b-da0d-457a-9fca-6b7d4a4fc70f tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:13.459273 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-edaab42b-da0d-457a-9fca-6b7d4a4fc70f tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:13.470466 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-edaab42b-da0d-457a-9fca-6b7d4a4fc70f tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/b251e3ee-3076-4374-ba01-89488f4d8fc3" status: 200 len: 1314 microversion: 2.1 time: 0.170395 Oct 27 03:24:13.474109 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 576/1083] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:13 2022] GET /compute/v2.1/servers/b251e3ee-3076-4374-ba01-89488f4d8fc3 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:13.487431 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d67bf282-d969-4b0d-b6ba-dda6954a6ccf tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:13.488051 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d67bf282-d969-4b0d-b6ba-dda6954a6ccf tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:13.495231 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d67bf282-d969-4b0d-b6ba-dda6954a6ccf tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:13.495728 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d67bf282-d969-4b0d-b6ba-dda6954a6ccf tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:13.496169 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d67bf282-d969-4b0d-b6ba-dda6954a6ccf tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:13.497068 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d67bf282-d969-4b0d-b6ba-dda6954a6ccf tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:13.497548 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d67bf282-d969-4b0d-b6ba-dda6954a6ccf tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:13.497979 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d67bf282-d969-4b0d-b6ba-dda6954a6ccf tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:13.570933 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d67bf282-d969-4b0d-b6ba-dda6954a6ccf tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:13.589383 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d67bf282-d969-4b0d-b6ba-dda6954a6ccf tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:13.590669 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-5cae88a6-ea88-419c-bd98-0304e5b596ff req-bec67b2f-deea-439c-adcd-0c957a3e7db5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a52fed88-50f8-4dea-b83d-6878adccb024", "tag": "7caf6b22-42ec-4a60-b619-9a8f7eecc633"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:24:13.591064 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d67bf282-d969-4b0d-b6ba-dda6954a6ccf tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:13.598252 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d67bf282-d969-4b0d-b6ba-dda6954a6ccf tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1546 microversion: 2.91 time: 0.115041 Oct 27 03:24:13.601583 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-5cae88a6-ea88-419c-bd98-0304e5b596ff req-bec67b2f-deea-439c-adcd-0c957a3e7db5 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:13.602459 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 508/1084] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:13 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1546 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:24:13.610127 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-5cae88a6-ea88-419c-bd98-0304e5b596ff req-bec67b2f-deea-439c-adcd-0c957a3e7db5 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:13.610858 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-5cae88a6-ea88-419c-bd98-0304e5b596ff req-bec67b2f-deea-439c-adcd-0c957a3e7db5 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:13.624155 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-5cae88a6-ea88-419c-bd98-0304e5b596ff req-bec67b2f-deea-439c-adcd-0c957a3e7db5 service nova] Creating event network-changed:7caf6b22-42ec-4a60-b619-9a8f7eecc633 for instance a52fed88-50f8-4dea-b83d-6878adccb024 on n-h2-862769-1 Oct 27 03:24:13.629809 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-5cae88a6-ea88-419c-bd98-0304e5b596ff req-bec67b2f-deea-439c-adcd-0c957a3e7db5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043139 Oct 27 03:24:13.630477 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 577/1085] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:24:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:24:13.860753 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f245015a-88b3-44ec-a13f-da769e423b6d tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:13.861661 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f245015a-88b3-44ec-a13f-da769e423b6d tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 8559e641-f41e-4b21-88b1-56d57ded5ce6] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:13.868855 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f245015a-88b3-44ec-a13f-da769e423b6d tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:13.869349 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f245015a-88b3-44ec-a13f-da769e423b6d tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:13.869794 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f245015a-88b3-44ec-a13f-da769e423b6d tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:13.870598 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f245015a-88b3-44ec-a13f-da769e423b6d tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:13.871059 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f245015a-88b3-44ec-a13f-da769e423b6d tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:13.871493 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f245015a-88b3-44ec-a13f-da769e423b6d tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:14.002155 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f245015a-88b3-44ec-a13f-da769e423b6d tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:14.010252 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f245015a-88b3-44ec-a13f-da769e423b6d tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:14.011700 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f245015a-88b3-44ec-a13f-da769e423b6d tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:14.012815 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f245015a-88b3-44ec-a13f-da769e423b6d tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/8559e641-f41e-4b21-88b1-56d57ded5ce6" status: 200 len: 1361 microversion: 2.25 time: 0.157648 Oct 27 03:24:14.013376 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 509/1086] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:13 2022] GET /compute/v2.1/servers/8559e641-f41e-4b21-88b1-56d57ded5ce6 => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:24:14.042127 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a718c0a5-4032-443f-b8de-980c42db598a tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:14.042840 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a718c0a5-4032-443f-b8de-980c42db598a tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] [instance: acb62f35-0751-41fe-ba8d-78b2357380e9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:14.049647 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a718c0a5-4032-443f-b8de-980c42db598a tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:14.053410 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a718c0a5-4032-443f-b8de-980c42db598a tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:14.053410 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a718c0a5-4032-443f-b8de-980c42db598a tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:14.053410 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a718c0a5-4032-443f-b8de-980c42db598a tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:14.053697 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a718c0a5-4032-443f-b8de-980c42db598a tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:14.053697 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a718c0a5-4032-443f-b8de-980c42db598a tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:14.077743 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ef2fcb16-5780-4380-9864-ab4ce47373c5 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:14.079152 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ef2fcb16-5780-4380-9864-ab4ce47373c5 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 77dd3d48-fede-491a-b6ce-5ad36a1d7cab] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:14.085176 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ef2fcb16-5780-4380-9864-ab4ce47373c5 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:14.085783 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ef2fcb16-5780-4380-9864-ab4ce47373c5 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:14.086387 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ef2fcb16-5780-4380-9864-ab4ce47373c5 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:14.087266 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ef2fcb16-5780-4380-9864-ab4ce47373c5 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:14.087933 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ef2fcb16-5780-4380-9864-ab4ce47373c5 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:14.088549 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ef2fcb16-5780-4380-9864-ab4ce47373c5 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:14.208091 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a718c0a5-4032-443f-b8de-980c42db598a tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e23378ed283426cbff623265d9bbc96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f033d34ad44397bfda5cba4c041071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:14.216605 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a718c0a5-4032-443f-b8de-980c42db598a tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] 10.222.0.20 "GET /compute/v2.1/servers/acb62f35-0751-41fe-ba8d-78b2357380e9" status: 200 len: 1587 microversion: 2.1 time: 0.179538 Oct 27 03:24:14.217190 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 578/1087] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:14 2022] GET /compute/v2.1/servers/acb62f35-0751-41fe-ba8d-78b2357380e9 => generated 1587 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:14.221825 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-173fe0d7-37e1-47c6-8b3d-9c2213aa40b6 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7dda87e280>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:14.246085 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ef2fcb16-5780-4380-9864-ab4ce47373c5 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:14.255179 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ef2fcb16-5780-4380-9864-ab4ce47373c5 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab" status: 200 len: 1542 microversion: 2.1 time: 0.181159 Oct 27 03:24:14.265935 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 510/1088] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:14 2022] GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab => generated 1542 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:24:14.268666 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-173fe0d7-37e1-47c6-8b3d-9c2213aa40b6 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/images/d07d1961-c000-42bf-b042-6a2852956faf" status: 200 len: 1414 microversion: 2.1 time: 0.050280 Oct 27 03:24:14.269798 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 579/1089] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:24:14 2022] GET /compute/v2.1/images/d07d1961-c000-42bf-b042-6a2852956faf => generated 1414 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:14.271854 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5f64a88f-32c6-4a55-a1b7-8fef4df8d91d tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:14.272356 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5f64a88f-32c6-4a55-a1b7-8fef4df8d91d tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] [instance: acb62f35-0751-41fe-ba8d-78b2357380e9] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:14.278469 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5f64a88f-32c6-4a55-a1b7-8fef4df8d91d tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:14.279025 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5f64a88f-32c6-4a55-a1b7-8fef4df8d91d tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:14.279540 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5f64a88f-32c6-4a55-a1b7-8fef4df8d91d tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:14.280341 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5f64a88f-32c6-4a55-a1b7-8fef4df8d91d tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:14.280870 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5f64a88f-32c6-4a55-a1b7-8fef4df8d91d tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:14.281371 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5f64a88f-32c6-4a55-a1b7-8fef4df8d91d tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:14.308807 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-abed6efe-565c-4469-8f19-5915191d48c6 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:14.309831 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-abed6efe-565c-4469-8f19-5915191d48c6 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] [instance: 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:14.316888 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-abed6efe-565c-4469-8f19-5915191d48c6 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:14.317450 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-abed6efe-565c-4469-8f19-5915191d48c6 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:14.317905 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-abed6efe-565c-4469-8f19-5915191d48c6 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:14.318652 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-abed6efe-565c-4469-8f19-5915191d48c6 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:14.319119 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-abed6efe-565c-4469-8f19-5915191d48c6 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:14.319696 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-abed6efe-565c-4469-8f19-5915191d48c6 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:14.362146 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5f64a88f-32c6-4a55-a1b7-8fef4df8d91d tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] 10.222.0.20 "GET /compute/v2.1/servers/acb62f35-0751-41fe-ba8d-78b2357380e9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094843 Oct 27 03:24:14.362776 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 511/1090] 10.222.0.20 () {58 vars in 1275 bytes} [Thu Oct 27 03:24:14 2022] GET /compute/v2.1/servers/acb62f35-0751-41fe-ba8d-78b2357380e9/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:24:14.367215 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4fa1106e-bd44-4b6a-87ba-f30957eb206a tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:14.367830 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4fa1106e-bd44-4b6a-87ba-f30957eb206a tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: a52fed88-50f8-4dea-b83d-6878adccb024] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:14.380475 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4fa1106e-bd44-4b6a-87ba-f30957eb206a tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:14.380992 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4fa1106e-bd44-4b6a-87ba-f30957eb206a tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:14.381437 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4fa1106e-bd44-4b6a-87ba-f30957eb206a tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:14.382194 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4fa1106e-bd44-4b6a-87ba-f30957eb206a tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:14.382655 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4fa1106e-bd44-4b6a-87ba-f30957eb206a tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:14.383088 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4fa1106e-bd44-4b6a-87ba-f30957eb206a tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:14.721773 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4fa1106e-bd44-4b6a-87ba-f30957eb206a tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:14.742383 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4fa1106e-bd44-4b6a-87ba-f30957eb206a tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/a52fed88-50f8-4dea-b83d-6878adccb024" status: 200 len: 1505 microversion: 2.1 time: 0.378157 Oct 27 03:24:14.743431 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 512/1091] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:14 2022] GET /compute/v2.1/servers/a52fed88-50f8-4dea-b83d-6878adccb024 => generated 1505 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:14.758741 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8bb24785-0955-4ef8-92e5-8fe8d68dce11 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:14.764026 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8bb24785-0955-4ef8-92e5-8fe8d68dce11 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: b251e3ee-3076-4374-ba01-89488f4d8fc3] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:14.776833 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8bb24785-0955-4ef8-92e5-8fe8d68dce11 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:14.777793 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8bb24785-0955-4ef8-92e5-8fe8d68dce11 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:14.778541 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8bb24785-0955-4ef8-92e5-8fe8d68dce11 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:14.779718 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8bb24785-0955-4ef8-92e5-8fe8d68dce11 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:14.780390 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8bb24785-0955-4ef8-92e5-8fe8d68dce11 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:14.781029 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8bb24785-0955-4ef8-92e5-8fe8d68dce11 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:14.861664 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-abed6efe-565c-4469-8f19-5915191d48c6 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lazy-loading 'services' on Instance uuid 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503 {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:24:14.914391 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-abed6efe-565c-4469-8f19-5915191d48c6 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503" status: 200 len: 1927 microversion: 2.75 time: 0.609331 Oct 27 03:24:14.917130 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 580/1092] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:14 2022] GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503 => generated 1927 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:24:14.935031 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d8dcde84-3c23-4377-897f-173c174f4e20 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:14.935816 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d8dcde84-3c23-4377-897f-173c174f4e20 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:14.945530 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d8dcde84-3c23-4377-897f-173c174f4e20 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:14.946351 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d8dcde84-3c23-4377-897f-173c174f4e20 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:14.947091 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d8dcde84-3c23-4377-897f-173c174f4e20 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:14.948086 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d8dcde84-3c23-4377-897f-173c174f4e20 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:14.948906 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d8dcde84-3c23-4377-897f-173c174f4e20 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:14.949591 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d8dcde84-3c23-4377-897f-173c174f4e20 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:15.102789 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d8dcde84-3c23-4377-897f-173c174f4e20 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:15.120909 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d8dcde84-3c23-4377-897f-173c174f4e20 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:15.122912 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d8dcde84-3c23-4377-897f-173c174f4e20 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:15.133320 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d8dcde84-3c23-4377-897f-173c174f4e20 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1546 microversion: 2.91 time: 0.215673 Oct 27 03:24:15.134292 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 581/1093] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:14 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1546 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:24:15.150617 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0704ceec-e1a1-40f4-8a50-e638adb4a648 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:15.151602 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0704ceec-e1a1-40f4-8a50-e638adb4a648 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 8559e641-f41e-4b21-88b1-56d57ded5ce6] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:15.158720 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0704ceec-e1a1-40f4-8a50-e638adb4a648 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:15.170760 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0704ceec-e1a1-40f4-8a50-e638adb4a648 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:15.171333 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0704ceec-e1a1-40f4-8a50-e638adb4a648 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:15.172273 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0704ceec-e1a1-40f4-8a50-e638adb4a648 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:15.172850 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0704ceec-e1a1-40f4-8a50-e638adb4a648 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:15.173414 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0704ceec-e1a1-40f4-8a50-e638adb4a648 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:15.359657 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8bb24785-0955-4ef8-92e5-8fe8d68dce11 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:15.368188 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8bb24785-0955-4ef8-92e5-8fe8d68dce11 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/b251e3ee-3076-4374-ba01-89488f4d8fc3" status: 200 len: 1314 microversion: 2.1 time: 0.623492 Oct 27 03:24:15.381065 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 513/1094] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:14 2022] GET /compute/v2.1/servers/b251e3ee-3076-4374-ba01-89488f4d8fc3 => generated 1314 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:15.381065 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-16b5fe59-9744-4872-862d-09c78a46d9e1 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:15.381065 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-16b5fe59-9744-4872-862d-09c78a46d9e1 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 77dd3d48-fede-491a-b6ce-5ad36a1d7cab] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:15.385748 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-16b5fe59-9744-4872-862d-09c78a46d9e1 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:15.386670 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-16b5fe59-9744-4872-862d-09c78a46d9e1 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:15.387337 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-16b5fe59-9744-4872-862d-09c78a46d9e1 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:15.388302 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-16b5fe59-9744-4872-862d-09c78a46d9e1 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:15.388979 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-16b5fe59-9744-4872-862d-09c78a46d9e1 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:15.389641 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-16b5fe59-9744-4872-862d-09c78a46d9e1 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:15.571148 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0704ceec-e1a1-40f4-8a50-e638adb4a648 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:15.586324 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0704ceec-e1a1-40f4-8a50-e638adb4a648 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:15.590091 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-16b5fe59-9744-4872-862d-09c78a46d9e1 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:15.591118 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0704ceec-e1a1-40f4-8a50-e638adb4a648 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:15.592538 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0704ceec-e1a1-40f4-8a50-e638adb4a648 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/8559e641-f41e-4b21-88b1-56d57ded5ce6" status: 200 len: 1361 microversion: 2.25 time: 0.457037 Oct 27 03:24:15.608211 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 582/1095] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:15 2022] GET /compute/v2.1/servers/8559e641-f41e-4b21-88b1-56d57ded5ce6 => generated 1361 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:24:15.616867 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-01da675a-5392-48bc-8f68-6e8857f88ac6 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7dda828c10>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:15.629624 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-16b5fe59-9744-4872-862d-09c78a46d9e1 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab" status: 200 len: 1542 microversion: 2.1 time: 0.255692 Oct 27 03:24:15.630556 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 514/1096] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:15 2022] GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab => generated 1542 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:15.670962 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-01da675a-5392-48bc-8f68-6e8857f88ac6 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/images/d07d1961-c000-42bf-b042-6a2852956faf" status: 200 len: 1414 microversion: 2.1 time: 0.074960 Oct 27 03:24:15.678092 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 583/1097] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:24:15 2022] GET /compute/v2.1/images/d07d1961-c000-42bf-b042-6a2852956faf => generated 1414 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:15.770325 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1d99a74a-83e7-4bbf-a0cf-78a8fb2cf624 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:15.770941 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1d99a74a-83e7-4bbf-a0cf-78a8fb2cf624 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: a52fed88-50f8-4dea-b83d-6878adccb024] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:15.790433 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1d99a74a-83e7-4bbf-a0cf-78a8fb2cf624 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:15.791371 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1d99a74a-83e7-4bbf-a0cf-78a8fb2cf624 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:15.792025 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1d99a74a-83e7-4bbf-a0cf-78a8fb2cf624 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:15.793173 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1d99a74a-83e7-4bbf-a0cf-78a8fb2cf624 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:15.794114 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1d99a74a-83e7-4bbf-a0cf-78a8fb2cf624 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:15.794821 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1d99a74a-83e7-4bbf-a0cf-78a8fb2cf624 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:15.952818 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-025ba2e5-8810-402b-b7a8-d384eba3c281 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:15.953652 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-025ba2e5-8810-402b-b7a8-d384eba3c281 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] [instance: 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:15.965260 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-025ba2e5-8810-402b-b7a8-d384eba3c281 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:15.965771 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-025ba2e5-8810-402b-b7a8-d384eba3c281 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:15.967188 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-025ba2e5-8810-402b-b7a8-d384eba3c281 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:15.967930 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-025ba2e5-8810-402b-b7a8-d384eba3c281 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:15.968400 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-025ba2e5-8810-402b-b7a8-d384eba3c281 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:15.968836 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-025ba2e5-8810-402b-b7a8-d384eba3c281 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:16.007145 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1d99a74a-83e7-4bbf-a0cf-78a8fb2cf624 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:16.015378 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1d99a74a-83e7-4bbf-a0cf-78a8fb2cf624 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/a52fed88-50f8-4dea-b83d-6878adccb024" status: 200 len: 1505 microversion: 2.1 time: 0.249107 Oct 27 03:24:16.015991 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 515/1098] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:15 2022] GET /compute/v2.1/servers/a52fed88-50f8-4dea-b83d-6878adccb024 => generated 1505 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:16.067338 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-025ba2e5-8810-402b-b7a8-d384eba3c281 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lazy-loading 'services' on Instance uuid 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503 {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:24:16.101269 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-025ba2e5-8810-402b-b7a8-d384eba3c281 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503" status: 200 len: 1927 microversion: 2.75 time: 0.153133 Oct 27 03:24:16.102012 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 584/1099] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:15 2022] GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503 => generated 1927 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:24:16.170858 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7965ce36-cb98-4f54-82cd-b49b6ab51422 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:16.171588 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7965ce36-cb98-4f54-82cd-b49b6ab51422 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:16.181350 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7965ce36-cb98-4f54-82cd-b49b6ab51422 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:16.182740 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7965ce36-cb98-4f54-82cd-b49b6ab51422 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:16.183447 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7965ce36-cb98-4f54-82cd-b49b6ab51422 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:16.184969 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7965ce36-cb98-4f54-82cd-b49b6ab51422 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:16.185666 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7965ce36-cb98-4f54-82cd-b49b6ab51422 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:16.188195 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7965ce36-cb98-4f54-82cd-b49b6ab51422 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:16.292514 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7965ce36-cb98-4f54-82cd-b49b6ab51422 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:16.301045 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7965ce36-cb98-4f54-82cd-b49b6ab51422 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:16.302542 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7965ce36-cb98-4f54-82cd-b49b6ab51422 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:16.307988 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7965ce36-cb98-4f54-82cd-b49b6ab51422 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1546 microversion: 2.91 time: 0.141798 Oct 27 03:24:16.308815 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 516/1100] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:16 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1546 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:24:16.397027 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5a8a5af8-ed27-46ca-8f64-4a13c73ca235 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:16.397661 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5a8a5af8-ed27-46ca-8f64-4a13c73ca235 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: b251e3ee-3076-4374-ba01-89488f4d8fc3] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:16.404177 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5a8a5af8-ed27-46ca-8f64-4a13c73ca235 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:16.404685 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5a8a5af8-ed27-46ca-8f64-4a13c73ca235 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:16.405264 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5a8a5af8-ed27-46ca-8f64-4a13c73ca235 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:16.405989 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5a8a5af8-ed27-46ca-8f64-4a13c73ca235 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:16.407118 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5a8a5af8-ed27-46ca-8f64-4a13c73ca235 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:16.407684 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5a8a5af8-ed27-46ca-8f64-4a13c73ca235 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:16.631229 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5099163f-201d-4836-b85d-ab1f570f5eb5 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:16.631867 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5099163f-201d-4836-b85d-ab1f570f5eb5 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 8559e641-f41e-4b21-88b1-56d57ded5ce6] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:16.649883 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5099163f-201d-4836-b85d-ab1f570f5eb5 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:16.650552 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5099163f-201d-4836-b85d-ab1f570f5eb5 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:16.651007 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5099163f-201d-4836-b85d-ab1f570f5eb5 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:16.651767 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5099163f-201d-4836-b85d-ab1f570f5eb5 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:16.652277 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5099163f-201d-4836-b85d-ab1f570f5eb5 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:16.652675 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5099163f-201d-4836-b85d-ab1f570f5eb5 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:16.797126 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5099163f-201d-4836-b85d-ab1f570f5eb5 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:16.806791 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5099163f-201d-4836-b85d-ab1f570f5eb5 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:16.808699 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5099163f-201d-4836-b85d-ab1f570f5eb5 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:16.810052 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5099163f-201d-4836-b85d-ab1f570f5eb5 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/8559e641-f41e-4b21-88b1-56d57ded5ce6" status: 200 len: 1361 microversion: 2.25 time: 0.182809 Oct 27 03:24:16.811286 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 517/1101] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:16 2022] GET /compute/v2.1/servers/8559e641-f41e-4b21-88b1-56d57ded5ce6 => generated 1361 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:24:16.816255 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0fb93992-1573-4e15-8c55-576fd76bb7ee tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:16.817159 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0fb93992-1573-4e15-8c55-576fd76bb7ee tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 77dd3d48-fede-491a-b6ce-5ad36a1d7cab] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:16.823883 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0fb93992-1573-4e15-8c55-576fd76bb7ee tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:16.824603 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0fb93992-1573-4e15-8c55-576fd76bb7ee tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:16.835976 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0fb93992-1573-4e15-8c55-576fd76bb7ee tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:16.835976 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0fb93992-1573-4e15-8c55-576fd76bb7ee tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:16.835976 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0fb93992-1573-4e15-8c55-576fd76bb7ee tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:16.835976 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0fb93992-1573-4e15-8c55-576fd76bb7ee tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:16.937554 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=4 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:24:16.977757 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=22 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:24:17.050944 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5a8a5af8-ed27-46ca-8f64-4a13c73ca235 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:17.053328 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0fb93992-1573-4e15-8c55-576fd76bb7ee tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:17.058889 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5a8a5af8-ed27-46ca-8f64-4a13c73ca235 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/b251e3ee-3076-4374-ba01-89488f4d8fc3" status: 200 len: 1314 microversion: 2.1 time: 0.665919 Oct 27 03:24:17.059474 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 585/1102] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:16 2022] GET /compute/v2.1/servers/b251e3ee-3076-4374-ba01-89488f4d8fc3 => generated 1314 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:17.068801 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0fb93992-1573-4e15-8c55-576fd76bb7ee tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab" status: 200 len: 1542 microversion: 2.1 time: 0.256181 Oct 27 03:24:17.083342 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 518/1103] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:16 2022] GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab => generated 1542 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:17.085841 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6cdf9603-1c63-48ec-b676-9e3b1ccc7db4 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:17.086526 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-6cdf9603-1c63-48ec-b676-9e3b1ccc7db4 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] [instance: acb62f35-0751-41fe-ba8d-78b2357380e9] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:17.089358 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2d07ff71-6587-4a1f-b2df-cf1953186144 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7dda873f70>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:17.093151 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6cdf9603-1c63-48ec-b676-9e3b1ccc7db4 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:17.095123 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6cdf9603-1c63-48ec-b676-9e3b1ccc7db4 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:17.095628 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6cdf9603-1c63-48ec-b676-9e3b1ccc7db4 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:17.096685 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6cdf9603-1c63-48ec-b676-9e3b1ccc7db4 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:17.096854 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6cdf9603-1c63-48ec-b676-9e3b1ccc7db4 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:17.097222 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6cdf9603-1c63-48ec-b676-9e3b1ccc7db4 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:17.163863 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2d07ff71-6587-4a1f-b2df-cf1953186144 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/images/d07d1961-c000-42bf-b042-6a2852956faf" status: 200 len: 1414 microversion: 2.1 time: 0.078032 Oct 27 03:24:17.164744 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 586/1104] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:24:17 2022] GET /compute/v2.1/images/d07d1961-c000-42bf-b042-6a2852956faf => generated 1414 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:17.173099 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-3082a968-8326-4ac8-8d3a-27572af23ce2 req-b415af5d-9ba5-4a21-a94c-bae05d360add service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acb62f35-0751-41fe-ba8d-78b2357380e9", "tag": "3f3c7991-4bc4-4933-8fde-a37f0e0f65a9"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:24:17.198121 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-3082a968-8326-4ac8-8d3a-27572af23ce2 req-b415af5d-9ba5-4a21-a94c-bae05d360add service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:17.199301 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-3082a968-8326-4ac8-8d3a-27572af23ce2 req-b415af5d-9ba5-4a21-a94c-bae05d360add service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:17.199865 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-3082a968-8326-4ac8-8d3a-27572af23ce2 req-b415af5d-9ba5-4a21-a94c-bae05d360add service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:17.215952 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-3082a968-8326-4ac8-8d3a-27572af23ce2 req-b415af5d-9ba5-4a21-a94c-bae05d360add service nova] Creating event network-changed:3f3c7991-4bc4-4933-8fde-a37f0e0f65a9 for instance acb62f35-0751-41fe-ba8d-78b2357380e9 on n-h1-862769-1 Oct 27 03:24:17.244525 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-3082a968-8326-4ac8-8d3a-27572af23ce2 req-b415af5d-9ba5-4a21-a94c-bae05d360add service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078289 Oct 27 03:24:17.259487 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 587/1105] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:24:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:24:17.278940 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-13e3ad91-88c2-43c6-9080-7768a0db5c6c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:17.281244 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-13e3ad91-88c2-43c6-9080-7768a0db5c6c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: a52fed88-50f8-4dea-b83d-6878adccb024] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:17.287957 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=4 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:24:17.298176 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-13e3ad91-88c2-43c6-9080-7768a0db5c6c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:17.300004 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-13e3ad91-88c2-43c6-9080-7768a0db5c6c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:17.300473 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-13e3ad91-88c2-43c6-9080-7768a0db5c6c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:17.301213 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-13e3ad91-88c2-43c6-9080-7768a0db5c6c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:17.302393 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-13e3ad91-88c2-43c6-9080-7768a0db5c6c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:17.302843 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-13e3ad91-88c2-43c6-9080-7768a0db5c6c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:17.316806 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6cdf9603-1c63-48ec-b676-9e3b1ccc7db4 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e23378ed283426cbff623265d9bbc96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f033d34ad44397bfda5cba4c041071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:17.326118 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6cdf9603-1c63-48ec-b676-9e3b1ccc7db4 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] 10.222.0.20 "GET /compute/v2.1/servers/acb62f35-0751-41fe-ba8d-78b2357380e9" status: 200 len: 1587 microversion: 2.1 time: 0.245742 Oct 27 03:24:17.327369 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 519/1106] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:17 2022] GET /compute/v2.1/servers/acb62f35-0751-41fe-ba8d-78b2357380e9 => generated 1587 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:17.336308 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3490aca0-c108-4b95-96db-7573690f4810 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:17.338119 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3490aca0-c108-4b95-96db-7573690f4810 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] [instance: 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:17.365113 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3490aca0-c108-4b95-96db-7573690f4810 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:17.365734 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3490aca0-c108-4b95-96db-7573690f4810 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:17.366434 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3490aca0-c108-4b95-96db-7573690f4810 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:17.367639 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3490aca0-c108-4b95-96db-7573690f4810 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:17.370018 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3490aca0-c108-4b95-96db-7573690f4810 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:17.372050 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3490aca0-c108-4b95-96db-7573690f4810 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:17.509426 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-3490aca0-c108-4b95-96db-7573690f4810 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lazy-loading 'services' on Instance uuid 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503 {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:24:17.549476 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3490aca0-c108-4b95-96db-7573690f4810 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503" status: 200 len: 1927 microversion: 2.75 time: 0.219899 Oct 27 03:24:17.553128 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 520/1107] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:17 2022] GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503 => generated 1927 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:24:17.564569 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9d95f039-9f04-49c2-9255-c4aeefbd57f1 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:17.567537 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-9d95f039-9f04-49c2-9255-c4aeefbd57f1 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:17.574545 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9d95f039-9f04-49c2-9255-c4aeefbd57f1 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:17.579517 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9d95f039-9f04-49c2-9255-c4aeefbd57f1 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:17.582360 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9d95f039-9f04-49c2-9255-c4aeefbd57f1 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:17.586730 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9d95f039-9f04-49c2-9255-c4aeefbd57f1 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:17.587370 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9d95f039-9f04-49c2-9255-c4aeefbd57f1 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:17.587928 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9d95f039-9f04-49c2-9255-c4aeefbd57f1 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:17.728012 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9d95f039-9f04-49c2-9255-c4aeefbd57f1 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:17.739759 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9d95f039-9f04-49c2-9255-c4aeefbd57f1 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:17.748045 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9d95f039-9f04-49c2-9255-c4aeefbd57f1 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:17.751545 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-13e3ad91-88c2-43c6-9080-7768a0db5c6c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:17.760928 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-13e3ad91-88c2-43c6-9080-7768a0db5c6c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/a52fed88-50f8-4dea-b83d-6878adccb024" status: 200 len: 1505 microversion: 2.1 time: 0.493747 Oct 27 03:24:17.778064 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 588/1108] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:17 2022] GET /compute/v2.1/servers/a52fed88-50f8-4dea-b83d-6878adccb024 => generated 1505 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:17.778064 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-1d4eafc1-a451-4592-9ca0-e810eec73063 req-ed59f07e-385a-40b8-b7f1-095e6aa47c17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b251e3ee-3076-4374-ba01-89488f4d8fc3", "name": "network-vif-plugged", "status": "completed", "tag": "0a82a95e-2201-4788-9f0f-38a02ca38ffc"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:24:17.779020 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9d95f039-9f04-49c2-9255-c4aeefbd57f1 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1546 microversion: 2.91 time: 0.206821 Oct 27 03:24:17.780132 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 521/1109] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:17 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1546 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:24:17.810317 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-1d4eafc1-a451-4592-9ca0-e810eec73063 req-ed59f07e-385a-40b8-b7f1-095e6aa47c17 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:17.811202 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-1d4eafc1-a451-4592-9ca0-e810eec73063 req-ed59f07e-385a-40b8-b7f1-095e6aa47c17 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:17.819081 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-1d4eafc1-a451-4592-9ca0-e810eec73063 req-ed59f07e-385a-40b8-b7f1-095e6aa47c17 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:17.841017 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-cbdfa552-2e7c-4a04-924c-7d83d4066774 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:17.841601 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-cbdfa552-2e7c-4a04-924c-7d83d4066774 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 8559e641-f41e-4b21-88b1-56d57ded5ce6] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:17.850858 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-1d4eafc1-a451-4592-9ca0-e810eec73063 req-ed59f07e-385a-40b8-b7f1-095e6aa47c17 service nova] Creating event network-vif-plugged:0a82a95e-2201-4788-9f0f-38a02ca38ffc for instance b251e3ee-3076-4374-ba01-89488f4d8fc3 on n-h1-862769-1 Oct 27 03:24:17.851953 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cbdfa552-2e7c-4a04-924c-7d83d4066774 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:17.852465 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cbdfa552-2e7c-4a04-924c-7d83d4066774 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:17.852906 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cbdfa552-2e7c-4a04-924c-7d83d4066774 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:17.853620 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cbdfa552-2e7c-4a04-924c-7d83d4066774 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:17.855779 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cbdfa552-2e7c-4a04-924c-7d83d4066774 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:17.856276 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cbdfa552-2e7c-4a04-924c-7d83d4066774 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:17.863281 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-1d4eafc1-a451-4592-9ca0-e810eec73063 req-ed59f07e-385a-40b8-b7f1-095e6aa47c17 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094609 Oct 27 03:24:17.867645 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 589/1110] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:24:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:24:18.093063 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-85777c7b-91fc-4fbf-a83a-9be5f0c1ac3d tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:18.094816 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-85777c7b-91fc-4fbf-a83a-9be5f0c1ac3d tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: b251e3ee-3076-4374-ba01-89488f4d8fc3] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:18.116723 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-85777c7b-91fc-4fbf-a83a-9be5f0c1ac3d tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:18.117279 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-85777c7b-91fc-4fbf-a83a-9be5f0c1ac3d tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:18.117743 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-85777c7b-91fc-4fbf-a83a-9be5f0c1ac3d tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:18.123979 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-85777c7b-91fc-4fbf-a83a-9be5f0c1ac3d tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:18.127621 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-85777c7b-91fc-4fbf-a83a-9be5f0c1ac3d tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:18.128296 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-85777c7b-91fc-4fbf-a83a-9be5f0c1ac3d tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:18.434259 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-cbdfa552-2e7c-4a04-924c-7d83d4066774 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:18.454094 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-cbdfa552-2e7c-4a04-924c-7d83d4066774 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:18.459012 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-cbdfa552-2e7c-4a04-924c-7d83d4066774 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:18.460933 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-cbdfa552-2e7c-4a04-924c-7d83d4066774 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/8559e641-f41e-4b21-88b1-56d57ded5ce6" status: 200 len: 1361 microversion: 2.25 time: 0.625300 Oct 27 03:24:18.461759 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 522/1111] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:17 2022] GET /compute/v2.1/servers/8559e641-f41e-4b21-88b1-56d57ded5ce6 => generated 1361 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:24:18.466848 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-10b27bc1-cbd5-4d62-97b6-adf717c10058 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:18.468174 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-10b27bc1-cbd5-4d62-97b6-adf717c10058 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 77dd3d48-fede-491a-b6ce-5ad36a1d7cab] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:18.476091 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-10b27bc1-cbd5-4d62-97b6-adf717c10058 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:18.476814 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-10b27bc1-cbd5-4d62-97b6-adf717c10058 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:18.477517 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-10b27bc1-cbd5-4d62-97b6-adf717c10058 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:18.478958 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-10b27bc1-cbd5-4d62-97b6-adf717c10058 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:18.479712 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-10b27bc1-cbd5-4d62-97b6-adf717c10058 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:18.481249 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-10b27bc1-cbd5-4d62-97b6-adf717c10058 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:18.522643 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-85777c7b-91fc-4fbf-a83a-9be5f0c1ac3d tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:18.534085 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-85777c7b-91fc-4fbf-a83a-9be5f0c1ac3d tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/b251e3ee-3076-4374-ba01-89488f4d8fc3" status: 200 len: 1314 microversion: 2.1 time: 0.446076 Oct 27 03:24:18.544187 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 590/1112] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:18 2022] GET /compute/v2.1/servers/b251e3ee-3076-4374-ba01-89488f4d8fc3 => generated 1314 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:18.554696 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9647ac1e-44aa-44a6-be15-6bd1ad0b7a9f tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7dda828c10>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:19.511611 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-10b27bc1-cbd5-4d62-97b6-adf717c10058 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:19.511611 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-10b27bc1-cbd5-4d62-97b6-adf717c10058 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab" status: 200 len: 1542 microversion: 2.1 time: 1.035681 Oct 27 03:24:19.511611 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 523/1113] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:18 2022] GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab => generated 1542 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:19.534535 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6e8a5fa8-41c4-4d78-86a0-68b9cb163dd4 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:19.535161 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-6e8a5fa8-41c4-4d78-86a0-68b9cb163dd4 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] [instance: 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:19.564373 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6e8a5fa8-41c4-4d78-86a0-68b9cb163dd4 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:19.564873 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6e8a5fa8-41c4-4d78-86a0-68b9cb163dd4 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:19.565315 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6e8a5fa8-41c4-4d78-86a0-68b9cb163dd4 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:19.570391 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6e8a5fa8-41c4-4d78-86a0-68b9cb163dd4 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:19.570918 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6e8a5fa8-41c4-4d78-86a0-68b9cb163dd4 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:19.571367 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6e8a5fa8-41c4-4d78-86a0-68b9cb163dd4 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:19.635361 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=100 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:24:19.765678 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-6e8a5fa8-41c4-4d78-86a0-68b9cb163dd4 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lazy-loading 'services' on Instance uuid 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503 {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:24:19.787729 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6e8a5fa8-41c4-4d78-86a0-68b9cb163dd4 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503" status: 200 len: 1927 microversion: 2.75 time: 0.287325 Oct 27 03:24:19.802061 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 524/1114] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:19 2022] GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503 => generated 1927 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:24:19.802061 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-28e48a4e-aaa7-4f76-909e-c768fc177188 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:19.802380 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-28e48a4e-aaa7-4f76-909e-c768fc177188 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: a52fed88-50f8-4dea-b83d-6878adccb024] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:19.812050 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-28e48a4e-aaa7-4f76-909e-c768fc177188 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:19.812050 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-28e48a4e-aaa7-4f76-909e-c768fc177188 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:19.812050 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-28e48a4e-aaa7-4f76-909e-c768fc177188 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:19.812050 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-28e48a4e-aaa7-4f76-909e-c768fc177188 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:19.812492 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-28e48a4e-aaa7-4f76-909e-c768fc177188 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:19.812492 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-28e48a4e-aaa7-4f76-909e-c768fc177188 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:20.369579 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-28e48a4e-aaa7-4f76-909e-c768fc177188 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:20.377921 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-28e48a4e-aaa7-4f76-909e-c768fc177188 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/a52fed88-50f8-4dea-b83d-6878adccb024" status: 200 len: 1505 microversion: 2.1 time: 0.588146 Oct 27 03:24:20.381783 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 525/1115] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:19 2022] GET /compute/v2.1/servers/a52fed88-50f8-4dea-b83d-6878adccb024 => generated 1505 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:20.395006 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f5a09590-f580-4310-b821-e8d5cf8949ff tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:20.403896 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f5a09590-f580-4310-b821-e8d5cf8949ff tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:20.420919 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f5a09590-f580-4310-b821-e8d5cf8949ff tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:20.426159 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f5a09590-f580-4310-b821-e8d5cf8949ff tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:20.426159 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f5a09590-f580-4310-b821-e8d5cf8949ff tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:20.426159 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f5a09590-f580-4310-b821-e8d5cf8949ff tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:20.426159 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f5a09590-f580-4310-b821-e8d5cf8949ff tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:20.426726 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f5a09590-f580-4310-b821-e8d5cf8949ff tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:20.556162 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f5a09590-f580-4310-b821-e8d5cf8949ff tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:20.581299 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f5a09590-f580-4310-b821-e8d5cf8949ff tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:20.587340 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f5a09590-f580-4310-b821-e8d5cf8949ff tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:20.602509 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f5a09590-f580-4310-b821-e8d5cf8949ff tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1546 microversion: 2.91 time: 0.215050 Oct 27 03:24:20.619941 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 526/1116] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:20 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1546 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:24:20.640336 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ce2412bd-0b5f-48bd-acc6-e3a1fabef89b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:20.641573 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ce2412bd-0b5f-48bd-acc6-e3a1fabef89b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 8559e641-f41e-4b21-88b1-56d57ded5ce6] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:20.658256 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ce2412bd-0b5f-48bd-acc6-e3a1fabef89b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:20.658949 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ce2412bd-0b5f-48bd-acc6-e3a1fabef89b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:20.663931 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ce2412bd-0b5f-48bd-acc6-e3a1fabef89b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:20.663931 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ce2412bd-0b5f-48bd-acc6-e3a1fabef89b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:20.663931 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ce2412bd-0b5f-48bd-acc6-e3a1fabef89b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:20.663931 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ce2412bd-0b5f-48bd-acc6-e3a1fabef89b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:20.888733 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ce2412bd-0b5f-48bd-acc6-e3a1fabef89b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:20.914011 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ce2412bd-0b5f-48bd-acc6-e3a1fabef89b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:20.914011 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ce2412bd-0b5f-48bd-acc6-e3a1fabef89b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:20.914011 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ce2412bd-0b5f-48bd-acc6-e3a1fabef89b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/8559e641-f41e-4b21-88b1-56d57ded5ce6" status: 200 len: 1361 microversion: 2.25 time: 0.287868 Oct 27 03:24:20.914499 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 527/1117] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:20 2022] GET /compute/v2.1/servers/8559e641-f41e-4b21-88b1-56d57ded5ce6 => generated 1361 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:24:20.945389 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8630a1af-fe63-41eb-ae7f-9b26e471762b tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:20.946512 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8630a1af-fe63-41eb-ae7f-9b26e471762b tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: b251e3ee-3076-4374-ba01-89488f4d8fc3] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:20.954210 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8630a1af-fe63-41eb-ae7f-9b26e471762b tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:20.956955 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8630a1af-fe63-41eb-ae7f-9b26e471762b tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:20.956955 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8630a1af-fe63-41eb-ae7f-9b26e471762b tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:20.956955 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8630a1af-fe63-41eb-ae7f-9b26e471762b tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:20.956955 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8630a1af-fe63-41eb-ae7f-9b26e471762b tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:20.957351 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8630a1af-fe63-41eb-ae7f-9b26e471762b tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:21.197637 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8630a1af-fe63-41eb-ae7f-9b26e471762b tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:21.221257 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8630a1af-fe63-41eb-ae7f-9b26e471762b tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/b251e3ee-3076-4374-ba01-89488f4d8fc3" status: 200 len: 1464 microversion: 2.1 time: 0.287359 Oct 27 03:24:21.222462 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 528/1118] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:20 2022] GET /compute/v2.1/servers/b251e3ee-3076-4374-ba01-89488f4d8fc3 => generated 1464 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:21.228474 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-117502e9-587d-412e-a8af-7d0ca59b8341 req-294d586f-d7ce-4eaf-bdce-74caa8ed2bc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8559e641-f41e-4b21-88b1-56d57ded5ce6", "name": "network-vif-plugged", "status": "completed", "tag": "959f9b77-f7a5-423f-9c4f-1a5a89ebede9"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:24:21.241453 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-117502e9-587d-412e-a8af-7d0ca59b8341 req-294d586f-d7ce-4eaf-bdce-74caa8ed2bc0 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:21.242277 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-117502e9-587d-412e-a8af-7d0ca59b8341 req-294d586f-d7ce-4eaf-bdce-74caa8ed2bc0 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:21.242913 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-117502e9-587d-412e-a8af-7d0ca59b8341 req-294d586f-d7ce-4eaf-bdce-74caa8ed2bc0 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:21.260790 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-117502e9-587d-412e-a8af-7d0ca59b8341 req-294d586f-d7ce-4eaf-bdce-74caa8ed2bc0 service nova] Creating event network-vif-plugged:959f9b77-f7a5-423f-9c4f-1a5a89ebede9 for instance 8559e641-f41e-4b21-88b1-56d57ded5ce6 on n-h2-862769-1 Oct 27 03:24:21.267618 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-117502e9-587d-412e-a8af-7d0ca59b8341 req-294d586f-d7ce-4eaf-bdce-74caa8ed2bc0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043204 Oct 27 03:24:21.269091 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 529/1119] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:24:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:24:21.275937 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5a1831bb-795a-48d8-a408-9fca14e9c91c tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:21.277488 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5a1831bb-795a-48d8-a408-9fca14e9c91c tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 77dd3d48-fede-491a-b6ce-5ad36a1d7cab] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:21.283952 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:24:21.285839 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5a1831bb-795a-48d8-a408-9fca14e9c91c tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:21.286689 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5a1831bb-795a-48d8-a408-9fca14e9c91c tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:21.291437 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5a1831bb-795a-48d8-a408-9fca14e9c91c tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:21.292576 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5a1831bb-795a-48d8-a408-9fca14e9c91c tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:21.293253 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5a1831bb-795a-48d8-a408-9fca14e9c91c tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:21.293982 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5a1831bb-795a-48d8-a408-9fca14e9c91c tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:21.532577 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5a1831bb-795a-48d8-a408-9fca14e9c91c tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:21.542759 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5a1831bb-795a-48d8-a408-9fca14e9c91c tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab" status: 200 len: 1542 microversion: 2.1 time: 0.271641 Oct 27 03:24:21.544171 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 530/1120] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:21 2022] GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab => generated 1542 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:21.549905 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9bd4ef6d-25a4-41d9-a267-bd7a42c1e305 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:21.550671 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-9bd4ef6d-25a4-41d9-a267-bd7a42c1e305 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] [instance: 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:21.557535 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9bd4ef6d-25a4-41d9-a267-bd7a42c1e305 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:21.558252 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9bd4ef6d-25a4-41d9-a267-bd7a42c1e305 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:21.558803 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9bd4ef6d-25a4-41d9-a267-bd7a42c1e305 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:21.559642 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9bd4ef6d-25a4-41d9-a267-bd7a42c1e305 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:21.560272 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9bd4ef6d-25a4-41d9-a267-bd7a42c1e305 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:21.560829 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9bd4ef6d-25a4-41d9-a267-bd7a42c1e305 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:21.639013 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-9bd4ef6d-25a4-41d9-a267-bd7a42c1e305 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lazy-loading 'services' on Instance uuid 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503 {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:24:21.661049 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9bd4ef6d-25a4-41d9-a267-bd7a42c1e305 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503" status: 200 len: 1927 microversion: 2.75 time: 0.115392 Oct 27 03:24:21.662287 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 531/1121] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:21 2022] GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503 => generated 1927 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:24:21.667309 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2bc0b8d1-94a8-41fe-bb2a-711edc577e5c tempest-ServersOnMultiNodesTest-1789564933 tempest-ServersOnMultiNodesTest-1789564933-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:21.668286 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2bc0b8d1-94a8-41fe-bb2a-711edc577e5c tempest-ServersOnMultiNodesTest-1789564933 tempest-ServersOnMultiNodesTest-1789564933-project-admin] [instance: b251e3ee-3076-4374-ba01-89488f4d8fc3] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:21.676587 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2bc0b8d1-94a8-41fe-bb2a-711edc577e5c tempest-ServersOnMultiNodesTest-1789564933 tempest-ServersOnMultiNodesTest-1789564933-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:21.677235 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2bc0b8d1-94a8-41fe-bb2a-711edc577e5c tempest-ServersOnMultiNodesTest-1789564933 tempest-ServersOnMultiNodesTest-1789564933-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:21.677945 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2bc0b8d1-94a8-41fe-bb2a-711edc577e5c tempest-ServersOnMultiNodesTest-1789564933 tempest-ServersOnMultiNodesTest-1789564933-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:21.678774 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2bc0b8d1-94a8-41fe-bb2a-711edc577e5c tempest-ServersOnMultiNodesTest-1789564933 tempest-ServersOnMultiNodesTest-1789564933-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:21.679340 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2bc0b8d1-94a8-41fe-bb2a-711edc577e5c tempest-ServersOnMultiNodesTest-1789564933 tempest-ServersOnMultiNodesTest-1789564933-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:21.679878 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2bc0b8d1-94a8-41fe-bb2a-711edc577e5c tempest-ServersOnMultiNodesTest-1789564933 tempest-ServersOnMultiNodesTest-1789564933-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:21.862580 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2bc0b8d1-94a8-41fe-bb2a-711edc577e5c tempest-ServersOnMultiNodesTest-1789564933 tempest-ServersOnMultiNodesTest-1789564933-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/b251e3ee-3076-4374-ba01-89488f4d8fc3" status: 200 len: 1615 microversion: 2.1 time: 0.198852 Oct 27 03:24:21.865135 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 532/1122] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:21 2022] GET /compute/v2.1/servers/b251e3ee-3076-4374-ba01-89488f4d8fc3 => generated 1615 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:21.871902 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9850a399-6f7f-48b6-8fcf-5d17fd92b1f8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:21.872815 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-9850a399-6f7f-48b6-8fcf-5d17fd92b1f8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: a52fed88-50f8-4dea-b83d-6878adccb024] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:21.881760 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9850a399-6f7f-48b6-8fcf-5d17fd92b1f8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:21.882561 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9850a399-6f7f-48b6-8fcf-5d17fd92b1f8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:21.884562 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9850a399-6f7f-48b6-8fcf-5d17fd92b1f8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:21.885970 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9850a399-6f7f-48b6-8fcf-5d17fd92b1f8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:21.886562 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9850a399-6f7f-48b6-8fcf-5d17fd92b1f8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:21.887096 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9850a399-6f7f-48b6-8fcf-5d17fd92b1f8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:22.073994 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9850a399-6f7f-48b6-8fcf-5d17fd92b1f8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:22.086670 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9850a399-6f7f-48b6-8fcf-5d17fd92b1f8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/a52fed88-50f8-4dea-b83d-6878adccb024" status: 200 len: 1505 microversion: 2.1 time: 0.219966 Oct 27 03:24:22.087707 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 533/1123] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:21 2022] GET /compute/v2.1/servers/a52fed88-50f8-4dea-b83d-6878adccb024 => generated 1505 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:22.092655 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8d21bbec-f5ce-4d1e-a691-1ca5c549449c tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:22.094779 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8d21bbec-f5ce-4d1e-a691-1ca5c549449c tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:22.102593 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8d21bbec-f5ce-4d1e-a691-1ca5c549449c tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:22.103880 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8d21bbec-f5ce-4d1e-a691-1ca5c549449c tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:22.104462 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8d21bbec-f5ce-4d1e-a691-1ca5c549449c tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:22.105274 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8d21bbec-f5ce-4d1e-a691-1ca5c549449c tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:22.106384 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8d21bbec-f5ce-4d1e-a691-1ca5c549449c tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:22.106766 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8d21bbec-f5ce-4d1e-a691-1ca5c549449c tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:22.218260 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8d21bbec-f5ce-4d1e-a691-1ca5c549449c tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:22.235507 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8d21bbec-f5ce-4d1e-a691-1ca5c549449c tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:22.238067 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8d21bbec-f5ce-4d1e-a691-1ca5c549449c tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:22.244707 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8d21bbec-f5ce-4d1e-a691-1ca5c549449c tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1546 microversion: 2.91 time: 0.155776 Oct 27 03:24:22.246552 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 534/1124] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:22 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1546 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:24:22.254133 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e4f737ac-9163-4f2a-a68d-3257eaee336c tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:22.255047 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e4f737ac-9163-4f2a-a68d-3257eaee336c tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 8559e641-f41e-4b21-88b1-56d57ded5ce6] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:22.272852 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e4f737ac-9163-4f2a-a68d-3257eaee336c tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:22.273398 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e4f737ac-9163-4f2a-a68d-3257eaee336c tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:22.273882 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e4f737ac-9163-4f2a-a68d-3257eaee336c tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:22.274736 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e4f737ac-9163-4f2a-a68d-3257eaee336c tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:22.275318 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e4f737ac-9163-4f2a-a68d-3257eaee336c tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:22.275763 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e4f737ac-9163-4f2a-a68d-3257eaee336c tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:22.455841 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e4f737ac-9163-4f2a-a68d-3257eaee336c tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:22.464162 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e4f737ac-9163-4f2a-a68d-3257eaee336c tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:22.465622 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e4f737ac-9163-4f2a-a68d-3257eaee336c tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:22.466776 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e4f737ac-9163-4f2a-a68d-3257eaee336c tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/8559e641-f41e-4b21-88b1-56d57ded5ce6" status: 200 len: 1361 microversion: 2.25 time: 0.218386 Oct 27 03:24:22.467348 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 535/1125] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:22 2022] GET /compute/v2.1/servers/8559e641-f41e-4b21-88b1-56d57ded5ce6 => generated 1361 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:24:22.472339 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7f76bbde-3218-4f9f-8994-97242522bbb2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1366885142", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "d0a79872-c316-4bb2-914c-a118831bc023"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:24:26.829623 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9647ac1e-44aa-44a6-be15-6bd1ad0b7a9f tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/images/d07d1961-c000-42bf-b042-6a2852956faf" status: 200 len: 1414 microversion: 2.1 time: 8.283248 Oct 27 03:24:26.830856 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 591/1126] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:24:18 2022] GET /compute/v2.1/images/d07d1961-c000-42bf-b042-6a2852956faf => generated 1414 bytes in 8286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:26.833751 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.network.neutron [None req-7f76bbde-3218-4f9f-8994-97242522bbb2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] validate_networks() for None {{(pid=121001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:24:26.835988 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4304b1c7-7531-49d7-bd84-b0d59a6c52fe tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:26.836758 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4304b1c7-7531-49d7-bd84-b0d59a6c52fe tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 77dd3d48-fede-491a-b6ce-5ad36a1d7cab] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:26.860335 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4304b1c7-7531-49d7-bd84-b0d59a6c52fe tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:26.861159 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4304b1c7-7531-49d7-bd84-b0d59a6c52fe tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:26.861928 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4304b1c7-7531-49d7-bd84-b0d59a6c52fe tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:26.862904 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4304b1c7-7531-49d7-bd84-b0d59a6c52fe tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:26.864022 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4304b1c7-7531-49d7-bd84-b0d59a6c52fe tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:26.864648 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4304b1c7-7531-49d7-bd84-b0d59a6c52fe tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:27.027551 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4304b1c7-7531-49d7-bd84-b0d59a6c52fe tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:27.038578 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4304b1c7-7531-49d7-bd84-b0d59a6c52fe tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab" status: 200 len: 1542 microversion: 2.1 time: 0.206462 Oct 27 03:24:27.060159 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 592/1127] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:26 2022] GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab => generated 1542 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:27.064013 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-11a84239-056d-4611-85c2-3ccb0d6b43f8 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:27.064860 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-11a84239-056d-4611-85c2-3ccb0d6b43f8 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] [instance: 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:27.071491 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-11a84239-056d-4611-85c2-3ccb0d6b43f8 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:27.072217 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-11a84239-056d-4611-85c2-3ccb0d6b43f8 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:27.072835 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-11a84239-056d-4611-85c2-3ccb0d6b43f8 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:27.073711 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-11a84239-056d-4611-85c2-3ccb0d6b43f8 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:27.074505 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-11a84239-056d-4611-85c2-3ccb0d6b43f8 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:27.075088 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-11a84239-056d-4611-85c2-3ccb0d6b43f8 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:27.094124 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-7f76bbde-3218-4f9f-8994-97242522bbb2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Flavor limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:24:27.094124 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-7f76bbde-3218-4f9f-8994-97242522bbb2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Image limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:24:27.095174 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-7f76bbde-3218-4f9f-8994-97242522bbb2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Flavor pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:24:27.095174 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-7f76bbde-3218-4f9f-8994-97242522bbb2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Image pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:24:27.095675 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-7f76bbde-3218-4f9f-8994-97242522bbb2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:24:27.106006 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7f76bbde-3218-4f9f-8994-97242522bbb2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:27.106866 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7f76bbde-3218-4f9f-8994-97242522bbb2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:27.107394 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7f76bbde-3218-4f9f-8994-97242522bbb2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:27.108226 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7f76bbde-3218-4f9f-8994-97242522bbb2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:27.108764 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7f76bbde-3218-4f9f-8994-97242522bbb2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:27.109275 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7f76bbde-3218-4f9f-8994-97242522bbb2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:27.131800 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-7f76bbde-3218-4f9f-8994-97242522bbb2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Getting quotas for project b95729a8c8a14361b7cbf8b2b13900b2. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:24:27.138624 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-7f76bbde-3218-4f9f-8994-97242522bbb2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Getting quotas for user 91d1351fcb6b4cd08f176e6d0cc5bb11 and project b95729a8c8a14361b7cbf8b2b13900b2. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:24:27.153446 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7f76bbde-3218-4f9f-8994-97242522bbb2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Going to run 1 instances... {{(pid=121001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:24:27.156332 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7f76bbde-3218-4f9f-8994-97242522bbb2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: c23b6c42-df64-4fab-9a29-ba638027a163] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:24:27.197802 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-11a84239-056d-4611-85c2-3ccb0d6b43f8 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lazy-loading 'services' on Instance uuid 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503 {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:24:27.219617 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-11a84239-056d-4611-85c2-3ccb0d6b43f8 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503" status: 200 len: 1927 microversion: 2.75 time: 0.163606 Oct 27 03:24:27.220169 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 593/1128] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:27 2022] GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503 => generated 1927 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:24:27.225304 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f82dcda2-49ee-4308-898c-4fd5db9e47f6 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:27.227385 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f82dcda2-49ee-4308-898c-4fd5db9e47f6 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: a52fed88-50f8-4dea-b83d-6878adccb024] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:27.234205 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f82dcda2-49ee-4308-898c-4fd5db9e47f6 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:27.235419 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f82dcda2-49ee-4308-898c-4fd5db9e47f6 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:27.236026 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f82dcda2-49ee-4308-898c-4fd5db9e47f6 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:27.236909 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f82dcda2-49ee-4308-898c-4fd5db9e47f6 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:27.237515 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f82dcda2-49ee-4308-898c-4fd5db9e47f6 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:27.238168 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f82dcda2-49ee-4308-898c-4fd5db9e47f6 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:27.316772 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7f76bbde-3218-4f9f-8994-97242522bbb2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.848330 Oct 27 03:24:27.326003 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 536/1129] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:24:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 4853 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 03:24:27.333515 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e4df7c1e-587c-4230-b238-b1786f2b66a6 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:27.334288 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e4df7c1e-587c-4230-b238-b1786f2b66a6 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:27.343009 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e4df7c1e-587c-4230-b238-b1786f2b66a6 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:27.343607 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e4df7c1e-587c-4230-b238-b1786f2b66a6 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:27.344135 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e4df7c1e-587c-4230-b238-b1786f2b66a6 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:27.345467 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e4df7c1e-587c-4230-b238-b1786f2b66a6 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:27.346014 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e4df7c1e-587c-4230-b238-b1786f2b66a6 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:27.346554 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e4df7c1e-587c-4230-b238-b1786f2b66a6 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:27.424008 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e4df7c1e-587c-4230-b238-b1786f2b66a6 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:27.432565 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e4df7c1e-587c-4230-b238-b1786f2b66a6 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:27.435066 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e4df7c1e-587c-4230-b238-b1786f2b66a6 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:27.440612 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e4df7c1e-587c-4230-b238-b1786f2b66a6 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1546 microversion: 2.91 time: 0.118115 Oct 27 03:24:27.445884 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f82dcda2-49ee-4308-898c-4fd5db9e47f6 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:27.457121 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f82dcda2-49ee-4308-898c-4fd5db9e47f6 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/a52fed88-50f8-4dea-b83d-6878adccb024" status: 200 len: 1480 microversion: 2.1 time: 0.235370 Oct 27 03:24:27.464600 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 537/1130] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:27 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1546 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:24:27.470123 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-58d85ee8-5a6a-4892-b365-246c32ffc73d req-9bbe3caa-4739-44b4-9692-f9adfb2f3e25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "521ddedc-cff2-4c42-a737-9590906b07a6", "name": "network-vif-plugged", "status": "completed", "tag": "2ccfa709-ec86-42d4-88a8-c7f4dcb17bbe"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:24:27.472074 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 594/1131] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:27 2022] GET /compute/v2.1/servers/a52fed88-50f8-4dea-b83d-6878adccb024 => generated 1480 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:27.480853 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-58d85ee8-5a6a-4892-b365-246c32ffc73d req-9bbe3caa-4739-44b4-9692-f9adfb2f3e25 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:27.481453 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-58d85ee8-5a6a-4892-b365-246c32ffc73d req-9bbe3caa-4739-44b4-9692-f9adfb2f3e25 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:27.482128 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-58d85ee8-5a6a-4892-b365-246c32ffc73d req-9bbe3caa-4739-44b4-9692-f9adfb2f3e25 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:27.482933 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9ca8cbf7-15a7-497f-86e5-9456ac3a97d0 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:27.483605 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9ca8cbf7-15a7-497f-86e5-9456ac3a97d0 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 8559e641-f41e-4b21-88b1-56d57ded5ce6] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:27.494687 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9ca8cbf7-15a7-497f-86e5-9456ac3a97d0 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:27.495825 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9ca8cbf7-15a7-497f-86e5-9456ac3a97d0 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:27.496557 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9ca8cbf7-15a7-497f-86e5-9456ac3a97d0 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:27.497440 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9ca8cbf7-15a7-497f-86e5-9456ac3a97d0 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:27.498266 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9ca8cbf7-15a7-497f-86e5-9456ac3a97d0 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:27.498855 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9ca8cbf7-15a7-497f-86e5-9456ac3a97d0 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:27.499327 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-58d85ee8-5a6a-4892-b365-246c32ffc73d req-9bbe3caa-4739-44b4-9692-f9adfb2f3e25 service nova] Creating event network-vif-plugged:2ccfa709-ec86-42d4-88a8-c7f4dcb17bbe for instance 521ddedc-cff2-4c42-a737-9590906b07a6 on n-h1-862769-1 Oct 27 03:24:27.505107 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-58d85ee8-5a6a-4892-b365-246c32ffc73d req-9bbe3caa-4739-44b4-9692-f9adfb2f3e25 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039114 Oct 27 03:24:27.505870 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 538/1132] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:24:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:24:27.513580 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4734d542-c73f-4c69-8e2f-ed12d78e1942 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:27.514477 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4734d542-c73f-4c69-8e2f-ed12d78e1942 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: c23b6c42-df64-4fab-9a29-ba638027a163] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:27.586277 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4734d542-c73f-4c69-8e2f-ed12d78e1942 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:27.598158 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4734d542-c73f-4c69-8e2f-ed12d78e1942 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/c23b6c42-df64-4fab-9a29-ba638027a163" status: 200 len: 1217 microversion: 2.1 time: 0.088588 Oct 27 03:24:27.614409 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 539/1133] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:27 2022] GET /compute/v2.1/servers/c23b6c42-df64-4fab-9a29-ba638027a163 => generated 1217 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:27.618987 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7553e9c5-08fd-492a-9ab4-f0f2d00f2a02 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Calling method '.version_select at 0x7f7ddab94e50>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:27.623841 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7553e9c5-08fd-492a-9ab4-f0f2d00f2a02 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:27.623841 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7553e9c5-08fd-492a-9ab4-f0f2d00f2a02 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:27.623841 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7553e9c5-08fd-492a-9ab4-f0f2d00f2a02 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:27.635724 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7553e9c5-08fd-492a-9ab4-f0f2d00f2a02 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 2345 microversion: 2.1 time: 0.020156 Oct 27 03:24:27.646759 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 540/1134] 10.222.0.20 () {58 vars in 1143 bytes} [Thu Oct 27 03:24:27 2022] GET /compute/v2.1/os-migrations => generated 2345 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:27.651394 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-18fa8f93-fd46-4b8c-934d-927e30608098 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:27.652012 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-18fa8f93-fd46-4b8c-934d-927e30608098 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] [instance: a52fed88-50f8-4dea-b83d-6878adccb024] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:27.659341 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-18fa8f93-fd46-4b8c-934d-927e30608098 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:27.659839 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-18fa8f93-fd46-4b8c-934d-927e30608098 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:27.660286 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-18fa8f93-fd46-4b8c-934d-927e30608098 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:27.661037 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-18fa8f93-fd46-4b8c-934d-927e30608098 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:27.661550 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-18fa8f93-fd46-4b8c-934d-927e30608098 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:27.661993 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-18fa8f93-fd46-4b8c-934d-927e30608098 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:27.705030 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9ca8cbf7-15a7-497f-86e5-9456ac3a97d0 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:27.714657 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9ca8cbf7-15a7-497f-86e5-9456ac3a97d0 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:27.716642 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9ca8cbf7-15a7-497f-86e5-9456ac3a97d0 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:27.719404 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9ca8cbf7-15a7-497f-86e5-9456ac3a97d0 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/8559e641-f41e-4b21-88b1-56d57ded5ce6" status: 200 len: 1557 microversion: 2.25 time: 0.245649 Oct 27 03:24:27.721411 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 595/1135] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:27 2022] GET /compute/v2.1/servers/8559e641-f41e-4b21-88b1-56d57ded5ce6 => generated 1557 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:24:27.750871 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e5e5bc77-d283-4310-be96-a92175424dfa tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:27.751482 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e5e5bc77-d283-4310-be96-a92175424dfa tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] [instance: 8559e641-f41e-4b21-88b1-56d57ded5ce6] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:27.760128 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e5e5bc77-d283-4310-be96-a92175424dfa tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:27.760128 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e5e5bc77-d283-4310-be96-a92175424dfa tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:27.760128 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e5e5bc77-d283-4310-be96-a92175424dfa tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:27.761218 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e5e5bc77-d283-4310-be96-a92175424dfa tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:27.761427 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e5e5bc77-d283-4310-be96-a92175424dfa tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:27.761839 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e5e5bc77-d283-4310-be96-a92175424dfa tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:27.828581 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-18fa8f93-fd46-4b8c-934d-927e30608098 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/a52fed88-50f8-4dea-b83d-6878adccb024" status: 200 len: 1631 microversion: 2.1 time: 0.180676 Oct 27 03:24:27.829713 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 541/1136] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:27 2022] GET /compute/v2.1/servers/a52fed88-50f8-4dea-b83d-6878adccb024 => generated 1631 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:27.855707 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-04b50ca8-92d9-4322-af70-60c3f0ffac2a tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7ddab72550>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:27.920131 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-04b50ca8-92d9-4322-af70-60c3f0ffac2a tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/images/d07d1961-c000-42bf-b042-6a2852956faf" status: 200 len: 1414 microversion: 2.1 time: 0.077907 Oct 27 03:24:27.922271 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 542/1137] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:24:27 2022] GET /compute/v2.1/images/d07d1961-c000-42bf-b042-6a2852956faf => generated 1414 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:27.935791 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-18604d96-c28c-47df-a9e3-e3f8065ecd50 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Action: 'create', calling method: .version_select at 0x7f7ddee28940>, body: {"keypair": {"name": "tempest-keypair-1102074251", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIy3iyjVqpPLPs7AFDltWIdc9Jgy+uehLIctkBLEjP8p/Q6K1AHH5vrFel/Ypne14wIP1lSeFWWb1xohYjNchO0eIccDwsRAL7BBn+lxyjp5TpDaxY2s5L8U/Tur0B6UmA=="}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:24:27.958519 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-18604d96-c28c-47df-a9e3-e3f8065ecd50 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Getting quotas for project aaee7e66f16e4ed5b49394311bd2803a. Resources: {'key_pairs'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:24:27.963906 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-18604d96-c28c-47df-a9e3-e3f8065ecd50 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Getting quotas for user 8c93886c5818439690564c2299a4f3ee and project aaee7e66f16e4ed5b49394311bd2803a. Resources: {'key_pairs'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:24:28.001713 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-e5e5bc77-d283-4310-be96-a92175424dfa tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lazy-loading 'services' on Instance uuid 8559e641-f41e-4b21-88b1-56d57ded5ce6 {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:24:28.018346 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e5e5bc77-d283-4310-be96-a92175424dfa tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/8559e641-f41e-4b21-88b1-56d57ded5ce6" status: 200 len: 2049 microversion: 2.25 time: 0.271910 Oct 27 03:24:28.020636 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 596/1138] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:27 2022] GET /compute/v2.1/servers/8559e641-f41e-4b21-88b1-56d57ded5ce6 => generated 2049 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:24:28.049234 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-66ad9610-dafa-4664-9d58-219b77b3fb99 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:28.052010 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-66ad9610-dafa-4664-9d58-219b77b3fb99 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] [instance: 8559e641-f41e-4b21-88b1-56d57ded5ce6] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:28.059606 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-66ad9610-dafa-4664-9d58-219b77b3fb99 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:28.060338 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-66ad9610-dafa-4664-9d58-219b77b3fb99 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:28.060973 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-66ad9610-dafa-4664-9d58-219b77b3fb99 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:28.061893 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-66ad9610-dafa-4664-9d58-219b77b3fb99 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:28.062514 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-66ad9610-dafa-4664-9d58-219b77b3fb99 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:28.062954 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-66ad9610-dafa-4664-9d58-219b77b3fb99 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:28.067729 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=100 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:24:28.076259 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-18604d96-c28c-47df-a9e3-e3f8065ecd50 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.152822 Oct 27 03:24:28.077469 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 543/1139] 10.222.0.20 () {60 vars in 1159 bytes} [Thu Oct 27 03:24:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:24:28.083815 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8480e211-b354-4320-ba59-1623789598c8 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:28.084478 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8480e211-b354-4320-ba59-1623789598c8 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 77dd3d48-fede-491a-b6ce-5ad36a1d7cab] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:28.109977 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8480e211-b354-4320-ba59-1623789598c8 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:28.110836 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8480e211-b354-4320-ba59-1623789598c8 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:28.111468 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8480e211-b354-4320-ba59-1623789598c8 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:28.112386 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8480e211-b354-4320-ba59-1623789598c8 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:28.113222 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8480e211-b354-4320-ba59-1623789598c8 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:28.113859 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8480e211-b354-4320-ba59-1623789598c8 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:28.259740 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-66ad9610-dafa-4664-9d58-219b77b3fb99 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lazy-loading 'services' on Instance uuid 8559e641-f41e-4b21-88b1-56d57ded5ce6 {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:24:28.295951 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-66ad9610-dafa-4664-9d58-219b77b3fb99 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/8559e641-f41e-4b21-88b1-56d57ded5ce6" status: 200 len: 2049 microversion: 2.25 time: 0.250798 Oct 27 03:24:28.302672 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 597/1140] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:28 2022] GET /compute/v2.1/servers/8559e641-f41e-4b21-88b1-56d57ded5ce6 => generated 2049 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:24:28.307891 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-09d4b870-5ccb-46e1-932a-939217a96a30 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:28.312238 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-09d4b870-5ccb-46e1-932a-939217a96a30 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] [instance: 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:28.328401 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-09d4b870-5ccb-46e1-932a-939217a96a30 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:28.330918 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-09d4b870-5ccb-46e1-932a-939217a96a30 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:28.332371 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-09d4b870-5ccb-46e1-932a-939217a96a30 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:28.335077 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-09d4b870-5ccb-46e1-932a-939217a96a30 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:28.335824 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-09d4b870-5ccb-46e1-932a-939217a96a30 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:28.339601 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-09d4b870-5ccb-46e1-932a-939217a96a30 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:28.377060 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8480e211-b354-4320-ba59-1623789598c8 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:28.387824 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8480e211-b354-4320-ba59-1623789598c8 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab" status: 200 len: 1542 microversion: 2.1 time: 0.308683 Oct 27 03:24:28.389011 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 544/1141] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:28 2022] GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab => generated 1542 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:28.396528 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e57c6e22-024b-40a8-bb63-d62a22647620 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:28.399902 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e57c6e22-024b-40a8-bb63-d62a22647620 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:28.401393 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e57c6e22-024b-40a8-bb63-d62a22647620 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:28.401977 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e57c6e22-024b-40a8-bb63-d62a22647620 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:28.402887 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e57c6e22-024b-40a8-bb63-d62a22647620 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:28.403421 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e57c6e22-024b-40a8-bb63-d62a22647620 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:28.403925 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e57c6e22-024b-40a8-bb63-d62a22647620 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:28.479679 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e57c6e22-024b-40a8-bb63-d62a22647620 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.088751 Oct 27 03:24:28.489451 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 545/1142] 10.222.0.20 () {60 vars in 1217 bytes} [Thu Oct 27 03:24:28 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 03:24:28.494556 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-cf7ade3f-acc9-449d-9f7d-d0ca119f7bec tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:28.495189 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-cf7ade3f-acc9-449d-9f7d-d0ca119f7bec tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:28.503479 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cf7ade3f-acc9-449d-9f7d-d0ca119f7bec tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:28.503989 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cf7ade3f-acc9-449d-9f7d-d0ca119f7bec tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:28.508971 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cf7ade3f-acc9-449d-9f7d-d0ca119f7bec tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:28.509820 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cf7ade3f-acc9-449d-9f7d-d0ca119f7bec tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:28.510362 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cf7ade3f-acc9-449d-9f7d-d0ca119f7bec tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:28.510808 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cf7ade3f-acc9-449d-9f7d-d0ca119f7bec tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:28.518005 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-09d4b870-5ccb-46e1-932a-939217a96a30 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lazy-loading 'services' on Instance uuid 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503 {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:24:28.570642 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-09d4b870-5ccb-46e1-932a-939217a96a30 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503" status: 200 len: 1927 microversion: 2.75 time: 0.266761 Oct 27 03:24:28.571654 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 598/1143] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:28 2022] GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503 => generated 1927 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:24:28.578463 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-992b1802-b3d6-4a97-9113-db69392ed390 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:24:28.579285 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-992b1802-b3d6-4a97-9113-db69392ed390 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] [instance: 8559e641-f41e-4b21-88b1-56d57ded5ce6] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:28.588366 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-992b1802-b3d6-4a97-9113-db69392ed390 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:28.588984 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-992b1802-b3d6-4a97-9113-db69392ed390 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:28.589576 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-992b1802-b3d6-4a97-9113-db69392ed390 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:28.593811 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-992b1802-b3d6-4a97-9113-db69392ed390 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:28.595171 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-992b1802-b3d6-4a97-9113-db69392ed390 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:28.597688 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-992b1802-b3d6-4a97-9113-db69392ed390 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:28.646293 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-cf7ade3f-acc9-449d-9f7d-d0ca119f7bec tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:28.652085 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=100 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:24:28.666203 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-cf7ade3f-acc9-449d-9f7d-d0ca119f7bec tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:28.668699 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-cf7ade3f-acc9-449d-9f7d-d0ca119f7bec tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:28.680048 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-cf7ade3f-acc9-449d-9f7d-d0ca119f7bec tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1546 microversion: 2.91 time: 0.189250 Oct 27 03:24:28.681079 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 546/1144] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:28 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1546 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:24:28.705817 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2cb48530-ddf9-4c6d-996a-22a13b19fcd3 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:28.717160 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2cb48530-ddf9-4c6d-996a-22a13b19fcd3 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: c23b6c42-df64-4fab-9a29-ba638027a163] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:28.718706 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2cb48530-ddf9-4c6d-996a-22a13b19fcd3 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:28.719224 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2cb48530-ddf9-4c6d-996a-22a13b19fcd3 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:28.719677 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2cb48530-ddf9-4c6d-996a-22a13b19fcd3 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:28.720552 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2cb48530-ddf9-4c6d-996a-22a13b19fcd3 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:28.721016 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2cb48530-ddf9-4c6d-996a-22a13b19fcd3 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:28.721856 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2cb48530-ddf9-4c6d-996a-22a13b19fcd3 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:28.804990 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2cb48530-ddf9-4c6d-996a-22a13b19fcd3 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:28.814128 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2cb48530-ddf9-4c6d-996a-22a13b19fcd3 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/c23b6c42-df64-4fab-9a29-ba638027a163" status: 200 len: 1221 microversion: 2.1 time: 0.131078 Oct 27 03:24:28.827435 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 547/1145] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:28 2022] GET /compute/v2.1/servers/c23b6c42-df64-4fab-9a29-ba638027a163 => generated 1221 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:28.939627 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0f8a60d9-d0f0-4a99-9edc-57a1bc91b10c tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7ddee4a160>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:28.971822 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-992b1802-b3d6-4a97-9113-db69392ed390 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/8559e641-f41e-4b21-88b1-56d57ded5ce6/action" status: 202 len: 0 microversion: 2.25 time: 0.398417 Oct 27 03:24:28.975680 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 599/1146] 10.222.0.20 () {62 vars in 1319 bytes} [Thu Oct 27 03:24:28 2022] POST /compute/v2.1/servers/8559e641-f41e-4b21-88b1-56d57ded5ce6/action => generated 0 bytes in 400 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:24:28.983013 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e067a51e-f206-4e9f-a3b0-96e8c3ffc451 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:28.985769 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e067a51e-f206-4e9f-a3b0-96e8c3ffc451 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] [instance: 8559e641-f41e-4b21-88b1-56d57ded5ce6] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:29.005493 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e067a51e-f206-4e9f-a3b0-96e8c3ffc451 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:29.005493 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e067a51e-f206-4e9f-a3b0-96e8c3ffc451 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:29.005493 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e067a51e-f206-4e9f-a3b0-96e8c3ffc451 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:29.005493 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e067a51e-f206-4e9f-a3b0-96e8c3ffc451 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:29.006413 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e067a51e-f206-4e9f-a3b0-96e8c3ffc451 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:29.006413 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e067a51e-f206-4e9f-a3b0-96e8c3ffc451 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:29.007451 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0f8a60d9-d0f0-4a99-9edc-57a1bc91b10c tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/images/d07d1961-c000-42bf-b042-6a2852956faf" status: 200 len: 1414 microversion: 2.1 time: 0.075013 Oct 27 03:24:29.020714 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 548/1147] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:24:28 2022] GET /compute/v2.1/images/d07d1961-c000-42bf-b042-6a2852956faf => generated 1414 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:24:29.175482 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-e067a51e-f206-4e9f-a3b0-96e8c3ffc451 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lazy-loading 'services' on Instance uuid 8559e641-f41e-4b21-88b1-56d57ded5ce6 {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:24:29.216865 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e067a51e-f206-4e9f-a3b0-96e8c3ffc451 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/8559e641-f41e-4b21-88b1-56d57ded5ce6" status: 200 len: 2054 microversion: 2.25 time: 0.238595 Oct 27 03:24:29.230616 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 600/1148] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:28 2022] GET /compute/v2.1/servers/8559e641-f41e-4b21-88b1-56d57ded5ce6 => generated 2054 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:24:29.416921 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7f518720-4c92-4cce-9820-dd27b9d6f900 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:29.417931 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7f518720-4c92-4cce-9820-dd27b9d6f900 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 77dd3d48-fede-491a-b6ce-5ad36a1d7cab] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:29.425042 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7f518720-4c92-4cce-9820-dd27b9d6f900 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:29.425530 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7f518720-4c92-4cce-9820-dd27b9d6f900 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:29.426182 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7f518720-4c92-4cce-9820-dd27b9d6f900 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:29.427064 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7f518720-4c92-4cce-9820-dd27b9d6f900 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:29.427518 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7f518720-4c92-4cce-9820-dd27b9d6f900 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:29.427946 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7f518720-4c92-4cce-9820-dd27b9d6f900 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:29.607489 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4c983d80-cbca-4f46-9534-35aa1d14482f tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:29.608210 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4c983d80-cbca-4f46-9534-35aa1d14482f tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] [instance: 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:29.615843 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4c983d80-cbca-4f46-9534-35aa1d14482f tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:29.622178 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4c983d80-cbca-4f46-9534-35aa1d14482f tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:29.623416 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4c983d80-cbca-4f46-9534-35aa1d14482f tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:29.626871 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4c983d80-cbca-4f46-9534-35aa1d14482f tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:29.627463 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7f518720-4c92-4cce-9820-dd27b9d6f900 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:29.627831 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4c983d80-cbca-4f46-9534-35aa1d14482f tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:29.628424 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4c983d80-cbca-4f46-9534-35aa1d14482f tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:29.659229 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7f518720-4c92-4cce-9820-dd27b9d6f900 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab" status: 200 len: 1542 microversion: 2.1 time: 0.246205 Oct 27 03:24:29.659819 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 549/1149] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:29 2022] GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab => generated 1542 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:29.712990 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1eaf47e1-ce0a-4b88-813d-a655223a39d5 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:29.713948 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1eaf47e1-ce0a-4b88-813d-a655223a39d5 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:29.722064 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1eaf47e1-ce0a-4b88-813d-a655223a39d5 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:29.722657 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1eaf47e1-ce0a-4b88-813d-a655223a39d5 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:29.723173 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1eaf47e1-ce0a-4b88-813d-a655223a39d5 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:29.723979 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1eaf47e1-ce0a-4b88-813d-a655223a39d5 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:29.724509 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1eaf47e1-ce0a-4b88-813d-a655223a39d5 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:29.725038 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1eaf47e1-ce0a-4b88-813d-a655223a39d5 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:29.740493 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-4c983d80-cbca-4f46-9534-35aa1d14482f tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lazy-loading 'services' on Instance uuid 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503 {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:24:29.763804 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4c983d80-cbca-4f46-9534-35aa1d14482f tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503" status: 200 len: 1927 microversion: 2.75 time: 0.160251 Oct 27 03:24:29.777245 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 601/1150] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:29 2022] GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503 => generated 1927 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:24:29.840809 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1e152742-6864-493b-921b-0ca7cde1d889 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:29.841937 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1e152742-6864-493b-921b-0ca7cde1d889 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: c23b6c42-df64-4fab-9a29-ba638027a163] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:29.850584 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1e152742-6864-493b-921b-0ca7cde1d889 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:29.851096 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1e152742-6864-493b-921b-0ca7cde1d889 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:29.851546 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1e152742-6864-493b-921b-0ca7cde1d889 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:29.852283 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1e152742-6864-493b-921b-0ca7cde1d889 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:29.852754 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1e152742-6864-493b-921b-0ca7cde1d889 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:29.853190 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1e152742-6864-493b-921b-0ca7cde1d889 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:29.871896 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1eaf47e1-ce0a-4b88-813d-a655223a39d5 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:29.901283 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1eaf47e1-ce0a-4b88-813d-a655223a39d5 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:29.913872 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1eaf47e1-ce0a-4b88-813d-a655223a39d5 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:29.931082 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1eaf47e1-ce0a-4b88-813d-a655223a39d5 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1546 microversion: 2.91 time: 0.221931 Oct 27 03:24:29.933651 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 550/1151] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:29 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1546 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:24:29.979301 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1e152742-6864-493b-921b-0ca7cde1d889 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:30.006767 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1e152742-6864-493b-921b-0ca7cde1d889 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/c23b6c42-df64-4fab-9a29-ba638027a163" status: 200 len: 1213 microversion: 2.1 time: 0.169906 Oct 27 03:24:30.010665 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 602/1152] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:29 2022] GET /compute/v2.1/servers/c23b6c42-df64-4fab-9a29-ba638027a163 => generated 1213 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:24:30.030974 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-96b9343c-bbdd-4d08-99d9-531b7adf0b50 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7ddaaddd30>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:30.246314 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f07a407b-99f6-4440-a9fd-31a9b3186e39 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:30.246935 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f07a407b-99f6-4440-a9fd-31a9b3186e39 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] [instance: 8559e641-f41e-4b21-88b1-56d57ded5ce6] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:30.254423 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f07a407b-99f6-4440-a9fd-31a9b3186e39 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:30.254913 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f07a407b-99f6-4440-a9fd-31a9b3186e39 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:30.255363 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f07a407b-99f6-4440-a9fd-31a9b3186e39 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:30.256073 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f07a407b-99f6-4440-a9fd-31a9b3186e39 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:30.256539 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f07a407b-99f6-4440-a9fd-31a9b3186e39 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:30.256972 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f07a407b-99f6-4440-a9fd-31a9b3186e39 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:30.408684 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-f07a407b-99f6-4440-a9fd-31a9b3186e39 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lazy-loading 'services' on Instance uuid 8559e641-f41e-4b21-88b1-56d57ded5ce6 {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:24:30.424918 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f07a407b-99f6-4440-a9fd-31a9b3186e39 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/8559e641-f41e-4b21-88b1-56d57ded5ce6" status: 200 len: 2034 microversion: 2.25 time: 0.182421 Oct 27 03:24:30.425438 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 603/1153] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:30 2022] GET /compute/v2.1/servers/8559e641-f41e-4b21-88b1-56d57ded5ce6 => generated 2034 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:24:30.452344 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c94fa697-b3ab-4342-9189-a80f5c22bb89 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-862769-1", "block_migration": "auto"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:24:30.455266 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c94fa697-b3ab-4342-9189-a80f5c22bb89 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] [instance: 8559e641-f41e-4b21-88b1-56d57ded5ce6] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:30.461540 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c94fa697-b3ab-4342-9189-a80f5c22bb89 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:30.462104 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c94fa697-b3ab-4342-9189-a80f5c22bb89 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:30.462598 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c94fa697-b3ab-4342-9189-a80f5c22bb89 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:30.463373 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c94fa697-b3ab-4342-9189-a80f5c22bb89 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:30.463846 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c94fa697-b3ab-4342-9189-a80f5c22bb89 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:30.464287 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c94fa697-b3ab-4342-9189-a80f5c22bb89 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:30.491818 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-c94fa697-b3ab-4342-9189-a80f5c22bb89 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lazy-loading 'flavor' on Instance uuid 8559e641-f41e-4b21-88b1-56d57ded5ce6 {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:24:30.505801 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c94fa697-b3ab-4342-9189-a80f5c22bb89 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] [instance: 8559e641-f41e-4b21-88b1-56d57ded5ce6] Going to try to live migrate instance to n-h1-862769-1 {{(pid=121000) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 27 03:24:32.168822 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-96b9343c-bbdd-4d08-99d9-531b7adf0b50 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/images/d07d1961-c000-42bf-b042-6a2852956faf" status: 200 len: 1423 microversion: 2.1 time: 2.143146 Oct 27 03:24:32.169402 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 551/1154] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:24:30 2022] GET /compute/v2.1/images/d07d1961-c000-42bf-b042-6a2852956faf => generated 1423 bytes in 2145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:32.174573 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-82dc8c30-8f97-45ef-9f1e-64b2b7f9e078 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:32.175192 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-82dc8c30-8f97-45ef-9f1e-64b2b7f9e078 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 77dd3d48-fede-491a-b6ce-5ad36a1d7cab] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:32.182506 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-82dc8c30-8f97-45ef-9f1e-64b2b7f9e078 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:32.183012 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-82dc8c30-8f97-45ef-9f1e-64b2b7f9e078 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:32.183459 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-82dc8c30-8f97-45ef-9f1e-64b2b7f9e078 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:32.184988 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-82dc8c30-8f97-45ef-9f1e-64b2b7f9e078 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:32.185455 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-82dc8c30-8f97-45ef-9f1e-64b2b7f9e078 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:32.185944 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-82dc8c30-8f97-45ef-9f1e-64b2b7f9e078 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:32.473378 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-82dc8c30-8f97-45ef-9f1e-64b2b7f9e078 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:32.486118 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-82dc8c30-8f97-45ef-9f1e-64b2b7f9e078 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab" status: 200 len: 1541 microversion: 2.1 time: 0.315604 Oct 27 03:24:32.487320 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 552/1155] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:32 2022] GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab => generated 1541 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:32.492590 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c2af5881-104a-4df1-bbd8-dae87cf75706 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:32.493706 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c2af5881-104a-4df1-bbd8-dae87cf75706 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] [instance: 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:32.502968 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c2af5881-104a-4df1-bbd8-dae87cf75706 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:32.507382 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c2af5881-104a-4df1-bbd8-dae87cf75706 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:32.507382 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c2af5881-104a-4df1-bbd8-dae87cf75706 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:32.507940 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c2af5881-104a-4df1-bbd8-dae87cf75706 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:32.509246 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c2af5881-104a-4df1-bbd8-dae87cf75706 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:32.511426 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c2af5881-104a-4df1-bbd8-dae87cf75706 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:32.865771 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-c2af5881-104a-4df1-bbd8-dae87cf75706 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lazy-loading 'services' on Instance uuid 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503 {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:24:32.886602 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c2af5881-104a-4df1-bbd8-dae87cf75706 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503" status: 200 len: 1927 microversion: 2.75 time: 0.397794 Oct 27 03:24:32.887446 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 553/1156] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:32 2022] GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503 => generated 1927 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:24:32.892498 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b1f255a3-9802-46bf-bb63-5400d2d5b172 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:32.893119 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b1f255a3-9802-46bf-bb63-5400d2d5b172 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:32.899551 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b1f255a3-9802-46bf-bb63-5400d2d5b172 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:32.900045 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b1f255a3-9802-46bf-bb63-5400d2d5b172 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:32.900488 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b1f255a3-9802-46bf-bb63-5400d2d5b172 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:32.901190 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b1f255a3-9802-46bf-bb63-5400d2d5b172 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:32.901831 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b1f255a3-9802-46bf-bb63-5400d2d5b172 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:32.902318 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b1f255a3-9802-46bf-bb63-5400d2d5b172 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:32.968277 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b1f255a3-9802-46bf-bb63-5400d2d5b172 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:32.977033 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b1f255a3-9802-46bf-bb63-5400d2d5b172 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:32.979067 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b1f255a3-9802-46bf-bb63-5400d2d5b172 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:32.983986 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b1f255a3-9802-46bf-bb63-5400d2d5b172 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1533 microversion: 2.91 time: 0.095778 Oct 27 03:24:32.984909 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 554/1157] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:32 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1533 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:24:32.990471 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f83d8684-84a9-407c-974b-cd0b7108b5db tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:32.991487 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f83d8684-84a9-407c-974b-cd0b7108b5db tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: c23b6c42-df64-4fab-9a29-ba638027a163] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:33.001573 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f83d8684-84a9-407c-974b-cd0b7108b5db tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:33.002092 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f83d8684-84a9-407c-974b-cd0b7108b5db tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:33.002618 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f83d8684-84a9-407c-974b-cd0b7108b5db tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:33.003418 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f83d8684-84a9-407c-974b-cd0b7108b5db tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:33.003874 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f83d8684-84a9-407c-974b-cd0b7108b5db tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:33.004299 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f83d8684-84a9-407c-974b-cd0b7108b5db tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:33.115054 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f83d8684-84a9-407c-974b-cd0b7108b5db tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:33.123339 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f83d8684-84a9-407c-974b-cd0b7108b5db tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/c23b6c42-df64-4fab-9a29-ba638027a163" status: 200 len: 1275 microversion: 2.1 time: 0.136929 Oct 27 03:24:33.123944 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 555/1158] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:32 2022] GET /compute/v2.1/servers/c23b6c42-df64-4fab-9a29-ba638027a163 => generated 1275 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:33.129122 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2d0195fd-37e7-4922-9338-93c961a5c71f tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-107501271", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": [{"uuid": "bccdb388-9120-416e-ba10-d9831d24a110"}], "security_groups": [{"name": "tempest-securitygroup--1243229367"}], "key_name": "tempest-keypair-1102074251", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:24:33.332600 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.network.neutron [None req-2d0195fd-37e7-4922-9338-93c961a5c71f tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] validate_networks() for [('bccdb388-9120-416e-ba10-d9831d24a110', None, None, None, None, None)] {{(pid=121001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:24:34.066161 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-2d0195fd-37e7-4922-9338-93c961a5c71f tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Flavor limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:24:34.066902 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-2d0195fd-37e7-4922-9338-93c961a5c71f tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Image limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:24:34.067484 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-2d0195fd-37e7-4922-9338-93c961a5c71f tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Flavor pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:24:34.068283 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-2d0195fd-37e7-4922-9338-93c961a5c71f tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Image pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:24:34.068804 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-2d0195fd-37e7-4922-9338-93c961a5c71f tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:24:34.080361 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2d0195fd-37e7-4922-9338-93c961a5c71f tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:34.081292 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2d0195fd-37e7-4922-9338-93c961a5c71f tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:34.081953 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2d0195fd-37e7-4922-9338-93c961a5c71f tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:34.082943 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2d0195fd-37e7-4922-9338-93c961a5c71f tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:34.083609 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2d0195fd-37e7-4922-9338-93c961a5c71f tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:34.084413 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2d0195fd-37e7-4922-9338-93c961a5c71f tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:34.106985 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-2d0195fd-37e7-4922-9338-93c961a5c71f tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Getting quotas for project aaee7e66f16e4ed5b49394311bd2803a. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:24:34.112514 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-2d0195fd-37e7-4922-9338-93c961a5c71f tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Getting quotas for user 8c93886c5818439690564c2299a4f3ee and project aaee7e66f16e4ed5b49394311bd2803a. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:24:34.126343 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2d0195fd-37e7-4922-9338-93c961a5c71f tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Going to run 1 instances... {{(pid=121001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:24:34.128635 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2d0195fd-37e7-4922-9338-93c961a5c71f tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: 543fdf60-10ec-4a25-a9d0-30c386efb104] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:24:34.142555 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:24:34.181020 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c94fa697-b3ab-4342-9189-a80f5c22bb89 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/8559e641-f41e-4b21-88b1-56d57ded5ce6/action" status: 202 len: 0 microversion: 2.25 time: 3.732431 Oct 27 03:24:34.181961 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 604/1159] 10.222.0.20 () {62 vars in 1319 bytes} [Thu Oct 27 03:24:30 2022] POST /compute/v2.1/servers/8559e641-f41e-4b21-88b1-56d57ded5ce6/action => generated 0 bytes in 3734 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 27 03:24:34.192843 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4e8f2c5a-32ae-4e8d-8a63-d6d64a614109 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7dda923f70>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:34.236721 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4e8f2c5a-32ae-4e8d-8a63-d6d64a614109 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/images/d07d1961-c000-42bf-b042-6a2852956faf" status: 200 len: 1423 microversion: 2.1 time: 0.053666 Oct 27 03:24:34.237322 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 605/1160] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:24:34 2022] GET /compute/v2.1/images/d07d1961-c000-42bf-b042-6a2852956faf => generated 1423 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:34.241725 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6750ed12-05cd-4124-a8bb-d46400828e49 tempest-UnshelveToHostMultiNodesTest-20786752 tempest-UnshelveToHostMultiNodesTest-20786752-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:34.242353 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6750ed12-05cd-4124-a8bb-d46400828e49 tempest-UnshelveToHostMultiNodesTest-20786752 tempest-UnshelveToHostMultiNodesTest-20786752-project-admin] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:34.248664 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6750ed12-05cd-4124-a8bb-d46400828e49 tempest-UnshelveToHostMultiNodesTest-20786752 tempest-UnshelveToHostMultiNodesTest-20786752-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:34.249437 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6750ed12-05cd-4124-a8bb-d46400828e49 tempest-UnshelveToHostMultiNodesTest-20786752 tempest-UnshelveToHostMultiNodesTest-20786752-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:34.249892 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6750ed12-05cd-4124-a8bb-d46400828e49 tempest-UnshelveToHostMultiNodesTest-20786752 tempest-UnshelveToHostMultiNodesTest-20786752-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:34.251152 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6750ed12-05cd-4124-a8bb-d46400828e49 tempest-UnshelveToHostMultiNodesTest-20786752 tempest-UnshelveToHostMultiNodesTest-20786752-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:34.251617 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6750ed12-05cd-4124-a8bb-d46400828e49 tempest-UnshelveToHostMultiNodesTest-20786752 tempest-UnshelveToHostMultiNodesTest-20786752-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:34.252044 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6750ed12-05cd-4124-a8bb-d46400828e49 tempest-UnshelveToHostMultiNodesTest-20786752 tempest-UnshelveToHostMultiNodesTest-20786752-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:34.296732 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2d0195fd-37e7-4922-9338-93c961a5c71f tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.171250 Oct 27 03:24:34.301083 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 556/1161] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:24:33 2022] POST /compute/v2.1/servers => generated 406 bytes in 1173 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 03:24:34.303483 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b1133ac1-08fb-4086-8856-17a7ba598a92 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:34.304609 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b1133ac1-08fb-4086-8856-17a7ba598a92 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 77dd3d48-fede-491a-b6ce-5ad36a1d7cab] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:34.311156 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b1133ac1-08fb-4086-8856-17a7ba598a92 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:34.311853 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b1133ac1-08fb-4086-8856-17a7ba598a92 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:34.312495 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b1133ac1-08fb-4086-8856-17a7ba598a92 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:34.314093 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b1133ac1-08fb-4086-8856-17a7ba598a92 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:34.314722 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b1133ac1-08fb-4086-8856-17a7ba598a92 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:34.315302 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b1133ac1-08fb-4086-8856-17a7ba598a92 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:34.336448 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-6750ed12-05cd-4124-a8bb-d46400828e49 tempest-UnshelveToHostMultiNodesTest-20786752 tempest-UnshelveToHostMultiNodesTest-20786752-project-admin] Lazy-loading 'services' on Instance uuid c3536a26-29e6-4208-a03b-9609511fb53b {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:24:34.358159 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6750ed12-05cd-4124-a8bb-d46400828e49 tempest-UnshelveToHostMultiNodesTest-20786752 tempest-UnshelveToHostMultiNodesTest-20786752-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1938 microversion: 2.91 time: 0.119745 Oct 27 03:24:34.359226 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 606/1162] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:34 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1938 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:24:34.364810 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-05dd3492-ea23-473f-ac17-0643e20d1628 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:34.368439 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-05dd3492-ea23-473f-ac17-0643e20d1628 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] [instance: 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:34.376357 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-05dd3492-ea23-473f-ac17-0643e20d1628 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:34.377195 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-05dd3492-ea23-473f-ac17-0643e20d1628 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:34.378025 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-05dd3492-ea23-473f-ac17-0643e20d1628 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:34.379194 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-05dd3492-ea23-473f-ac17-0643e20d1628 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:34.379872 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-05dd3492-ea23-473f-ac17-0643e20d1628 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:34.380778 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-05dd3492-ea23-473f-ac17-0643e20d1628 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:34.486258 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-05dd3492-ea23-473f-ac17-0643e20d1628 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lazy-loading 'services' on Instance uuid 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503 {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:24:34.506584 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-05dd3492-ea23-473f-ac17-0643e20d1628 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503" status: 200 len: 1927 microversion: 2.75 time: 0.146009 Oct 27 03:24:34.516665 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 607/1163] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:34 2022] GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503 => generated 1927 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:24:34.526225 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9df919d0-c2f5-4325-aab3-e725612ce68b tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:34.528660 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9df919d0-c2f5-4325-aab3-e725612ce68b tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: c23b6c42-df64-4fab-9a29-ba638027a163] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:34.535790 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9df919d0-c2f5-4325-aab3-e725612ce68b tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:34.536826 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9df919d0-c2f5-4325-aab3-e725612ce68b tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:34.537322 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9df919d0-c2f5-4325-aab3-e725612ce68b tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:34.538363 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9df919d0-c2f5-4325-aab3-e725612ce68b tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:34.538883 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9df919d0-c2f5-4325-aab3-e725612ce68b tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:34.539254 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9df919d0-c2f5-4325-aab3-e725612ce68b tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:34.587788 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b1133ac1-08fb-4086-8856-17a7ba598a92 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:34.598683 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b1133ac1-08fb-4086-8856-17a7ba598a92 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab" status: 200 len: 1473 microversion: 2.1 time: 0.299987 Oct 27 03:24:34.601481 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 557/1164] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:34 2022] GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab => generated 1473 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:34.610982 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b2fe4cb9-42fb-4564-82bb-5f3198b75e31 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:34.615844 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b2fe4cb9-42fb-4564-82bb-5f3198b75e31 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 8559e641-f41e-4b21-88b1-56d57ded5ce6] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:34.631028 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b2fe4cb9-42fb-4564-82bb-5f3198b75e31 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:34.631648 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b2fe4cb9-42fb-4564-82bb-5f3198b75e31 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:34.632157 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b2fe4cb9-42fb-4564-82bb-5f3198b75e31 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:34.633074 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b2fe4cb9-42fb-4564-82bb-5f3198b75e31 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:34.634786 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b2fe4cb9-42fb-4564-82bb-5f3198b75e31 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:34.635220 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b2fe4cb9-42fb-4564-82bb-5f3198b75e31 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:34.741125 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9df919d0-c2f5-4325-aab3-e725612ce68b tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:34.749824 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9df919d0-c2f5-4325-aab3-e725612ce68b tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/c23b6c42-df64-4fab-9a29-ba638027a163" status: 200 len: 1317 microversion: 2.1 time: 0.231572 Oct 27 03:24:34.750479 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 608/1165] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:34 2022] GET /compute/v2.1/servers/c23b6c42-df64-4fab-9a29-ba638027a163 => generated 1317 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:34.755907 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-35a4c6c5-c218-426a-b115-53a404220a5e tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7dda99f790>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:34.898543 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b2fe4cb9-42fb-4564-82bb-5f3198b75e31 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:34.909152 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b2fe4cb9-42fb-4564-82bb-5f3198b75e31 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:34.910651 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b2fe4cb9-42fb-4564-82bb-5f3198b75e31 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:34.911817 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b2fe4cb9-42fb-4564-82bb-5f3198b75e31 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/8559e641-f41e-4b21-88b1-56d57ded5ce6" status: 200 len: 1567 microversion: 2.25 time: 0.309244 Oct 27 03:24:34.912364 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 558/1166] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:34 2022] GET /compute/v2.1/servers/8559e641-f41e-4b21-88b1-56d57ded5ce6 => generated 1567 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:24:34.917278 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d744af27-74ca-4245-aafa-815b84cd898a tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:34.917896 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d744af27-74ca-4245-aafa-815b84cd898a tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: 543fdf60-10ec-4a25-a9d0-30c386efb104] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:34.993392 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d744af27-74ca-4245-aafa-815b84cd898a tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:35.000622 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d744af27-74ca-4245-aafa-815b84cd898a tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104" status: 200 len: 1234 microversion: 2.1 time: 0.087101 Oct 27 03:24:35.001460 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 559/1167] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:34 2022] GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104 => generated 1234 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:35.005849 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-34b30fbb-0e20-4a1d-a650-f81e2a2459ab tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:35.006870 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-34b30fbb-0e20-4a1d-a650-f81e2a2459ab tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:35.012710 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-34b30fbb-0e20-4a1d-a650-f81e2a2459ab tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:35.013194 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-34b30fbb-0e20-4a1d-a650-f81e2a2459ab tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:35.013678 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-34b30fbb-0e20-4a1d-a650-f81e2a2459ab tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:35.014451 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-34b30fbb-0e20-4a1d-a650-f81e2a2459ab tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:35.015117 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-34b30fbb-0e20-4a1d-a650-f81e2a2459ab tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:35.015742 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-34b30fbb-0e20-4a1d-a650-f81e2a2459ab tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:35.042592 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-34b30fbb-0e20-4a1d-a650-f81e2a2459ab tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Going to try to terminate instance {{(pid=121001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:24:35.441051 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-34b30fbb-0e20-4a1d-a650-f81e2a2459ab tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 204 len: 0 microversion: 2.91 time: 0.438545 Oct 27 03:24:35.442169 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 560/1168] 10.222.0.20 () {60 vars in 1280 bytes} [Thu Oct 27 03:24:35 2022] DELETE /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 0 bytes in 440 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 03:24:35.451427 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-85ed92eb-3a76-4f35-9f63-591fcaa60c16 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:35.453438 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-85ed92eb-3a76-4f35-9f63-591fcaa60c16 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:35.462852 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-85ed92eb-3a76-4f35-9f63-591fcaa60c16 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:35.463353 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-85ed92eb-3a76-4f35-9f63-591fcaa60c16 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:35.463834 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-85ed92eb-3a76-4f35-9f63-591fcaa60c16 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:35.464583 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-85ed92eb-3a76-4f35-9f63-591fcaa60c16 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:35.465031 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-85ed92eb-3a76-4f35-9f63-591fcaa60c16 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:35.465466 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-85ed92eb-3a76-4f35-9f63-591fcaa60c16 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:35.546391 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-85ed92eb-3a76-4f35-9f63-591fcaa60c16 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:35.557370 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-85ed92eb-3a76-4f35-9f63-591fcaa60c16 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:35.559104 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-85ed92eb-3a76-4f35-9f63-591fcaa60c16 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:35.564633 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-85ed92eb-3a76-4f35-9f63-591fcaa60c16 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1539 microversion: 2.91 time: 0.117705 Oct 27 03:24:35.565204 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 561/1169] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:35 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1539 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:24:35.569597 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-b4bc348b-f2d6-4f68-bcda-4acb46149770 req-8180d5e5-21e5-45fe-88ef-553bb8099230 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c23b6c42-df64-4fab-9a29-ba638027a163", "tag": "c02998a4-ec7c-4865-b3b7-76a1f4abc2a9"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:24:35.604076 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-b4bc348b-f2d6-4f68-bcda-4acb46149770 req-8180d5e5-21e5-45fe-88ef-553bb8099230 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:35.608489 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-b4bc348b-f2d6-4f68-bcda-4acb46149770 req-8180d5e5-21e5-45fe-88ef-553bb8099230 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:35.608992 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-b4bc348b-f2d6-4f68-bcda-4acb46149770 req-8180d5e5-21e5-45fe-88ef-553bb8099230 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:35.624946 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-b4bc348b-f2d6-4f68-bcda-4acb46149770 req-8180d5e5-21e5-45fe-88ef-553bb8099230 service nova] Creating event network-changed:c02998a4-ec7c-4865-b3b7-76a1f4abc2a9 for instance c23b6c42-df64-4fab-9a29-ba638027a163 on n-h2-862769-1 Oct 27 03:24:35.630821 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-b4bc348b-f2d6-4f68-bcda-4acb46149770 req-8180d5e5-21e5-45fe-88ef-553bb8099230 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064122 Oct 27 03:24:35.631431 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 562/1170] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:24:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:24:35.636449 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5229362a-4393-41fa-9daa-f68a8f70efee tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:35.642088 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5229362a-4393-41fa-9daa-f68a8f70efee tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] [instance: 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:35.648034 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5229362a-4393-41fa-9daa-f68a8f70efee tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:35.648610 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5229362a-4393-41fa-9daa-f68a8f70efee tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:35.649416 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5229362a-4393-41fa-9daa-f68a8f70efee tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:35.650414 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5229362a-4393-41fa-9daa-f68a8f70efee tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:35.651051 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5229362a-4393-41fa-9daa-f68a8f70efee tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:35.651686 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5229362a-4393-41fa-9daa-f68a8f70efee tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:35.756162 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-5229362a-4393-41fa-9daa-f68a8f70efee tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lazy-loading 'services' on Instance uuid 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503 {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:24:35.776389 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5229362a-4393-41fa-9daa-f68a8f70efee tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503" status: 200 len: 1927 microversion: 2.75 time: 0.143769 Oct 27 03:24:35.777076 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 563/1171] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:35 2022] GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503 => generated 1927 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:24:35.782960 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-48f4823f-97b7-42ef-9a14-63904ddff05f tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:35.783674 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-48f4823f-97b7-42ef-9a14-63904ddff05f tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 77dd3d48-fede-491a-b6ce-5ad36a1d7cab] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:35.790615 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-48f4823f-97b7-42ef-9a14-63904ddff05f tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:35.791203 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-48f4823f-97b7-42ef-9a14-63904ddff05f tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:35.791856 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-48f4823f-97b7-42ef-9a14-63904ddff05f tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:35.792730 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-48f4823f-97b7-42ef-9a14-63904ddff05f tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:35.793978 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-48f4823f-97b7-42ef-9a14-63904ddff05f tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:35.794692 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-48f4823f-97b7-42ef-9a14-63904ddff05f tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:35.975365 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-48f4823f-97b7-42ef-9a14-63904ddff05f tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:35.983799 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-48f4823f-97b7-42ef-9a14-63904ddff05f tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab" status: 200 len: 1473 microversion: 2.1 time: 0.204900 Oct 27 03:24:35.984581 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 564/1172] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:35 2022] GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab => generated 1473 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:36.005359 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c4e7b0d4-f880-43ea-b5ac-281e373aa44d tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:36.005998 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c4e7b0d4-f880-43ea-b5ac-281e373aa44d tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: c23b6c42-df64-4fab-9a29-ba638027a163] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:36.012077 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c4e7b0d4-f880-43ea-b5ac-281e373aa44d tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:36.015855 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c4e7b0d4-f880-43ea-b5ac-281e373aa44d tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:36.015855 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c4e7b0d4-f880-43ea-b5ac-281e373aa44d tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:36.015855 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c4e7b0d4-f880-43ea-b5ac-281e373aa44d tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:36.015855 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c4e7b0d4-f880-43ea-b5ac-281e373aa44d tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:36.016234 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c4e7b0d4-f880-43ea-b5ac-281e373aa44d tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:36.034715 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:24:36.113284 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-35a4c6c5-c218-426a-b115-53a404220a5e tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "DELETE /compute/v2.1/images/d07d1961-c000-42bf-b042-6a2852956faf" status: 204 len: 0 microversion: 2.1 time: 1.355175 Oct 27 03:24:36.113284 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 609/1173] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:34 2022] DELETE /compute/v2.1/images/d07d1961-c000-42bf-b042-6a2852956faf => generated 0 bytes in 1357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:24:36.114000 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-313673a8-8e87-43f9-a926-c985bd0b9d71 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:36.114132 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-313673a8-8e87-43f9-a926-c985bd0b9d71 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 8559e641-f41e-4b21-88b1-56d57ded5ce6] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:36.118766 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=100 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:24:36.122290 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-313673a8-8e87-43f9-a926-c985bd0b9d71 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:36.122773 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-313673a8-8e87-43f9-a926-c985bd0b9d71 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:36.123830 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-313673a8-8e87-43f9-a926-c985bd0b9d71 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:36.124744 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-313673a8-8e87-43f9-a926-c985bd0b9d71 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:36.125212 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-313673a8-8e87-43f9-a926-c985bd0b9d71 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:36.125723 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-313673a8-8e87-43f9-a926-c985bd0b9d71 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:36.153762 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:24:36.164269 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c4e7b0d4-f880-43ea-b5ac-281e373aa44d tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:36.172364 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c4e7b0d4-f880-43ea-b5ac-281e373aa44d tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/c23b6c42-df64-4fab-9a29-ba638027a163" status: 200 len: 1317 microversion: 2.1 time: 0.173127 Oct 27 03:24:36.173552 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 565/1174] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:35 2022] GET /compute/v2.1/servers/c23b6c42-df64-4fab-9a29-ba638027a163 => generated 1317 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:36.178136 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-de11c58d-9daa-435a-ad1f-516971200ce2 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:36.193480 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-de11c58d-9daa-435a-ad1f-516971200ce2 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: 543fdf60-10ec-4a25-a9d0-30c386efb104] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:36.198073 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-de11c58d-9daa-435a-ad1f-516971200ce2 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:36.199031 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-de11c58d-9daa-435a-ad1f-516971200ce2 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:36.199600 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-de11c58d-9daa-435a-ad1f-516971200ce2 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:36.200318 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-de11c58d-9daa-435a-ad1f-516971200ce2 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:36.200779 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-de11c58d-9daa-435a-ad1f-516971200ce2 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:36.201209 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-de11c58d-9daa-435a-ad1f-516971200ce2 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:36.263884 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-de11c58d-9daa-435a-ad1f-516971200ce2 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:36.271737 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-de11c58d-9daa-435a-ad1f-516971200ce2 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104" status: 200 len: 1230 microversion: 2.1 time: 0.097143 Oct 27 03:24:36.279994 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 566/1175] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:36 2022] GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104 => generated 1230 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:36.279994 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a4e8d094-c0a8-495a-bb7a-da2028d4ef51 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:36.279994 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a4e8d094-c0a8-495a-bb7a-da2028d4ef51 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 521ddedc-cff2-4c42-a737-9590906b07a6] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:36.283505 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a4e8d094-c0a8-495a-bb7a-da2028d4ef51 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:36.284148 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a4e8d094-c0a8-495a-bb7a-da2028d4ef51 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:36.284816 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a4e8d094-c0a8-495a-bb7a-da2028d4ef51 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:36.285288 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a4e8d094-c0a8-495a-bb7a-da2028d4ef51 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:36.285748 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a4e8d094-c0a8-495a-bb7a-da2028d4ef51 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:36.286358 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a4e8d094-c0a8-495a-bb7a-da2028d4ef51 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:36.312963 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a4e8d094-c0a8-495a-bb7a-da2028d4ef51 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 521ddedc-cff2-4c42-a737-9590906b07a6] Going to try to terminate instance {{(pid=121001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:24:36.351447 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-313673a8-8e87-43f9-a926-c985bd0b9d71 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:36.360774 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-313673a8-8e87-43f9-a926-c985bd0b9d71 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:36.362411 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-313673a8-8e87-43f9-a926-c985bd0b9d71 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:36.363603 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-313673a8-8e87-43f9-a926-c985bd0b9d71 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/8559e641-f41e-4b21-88b1-56d57ded5ce6" status: 200 len: 1567 microversion: 2.25 time: 0.254369 Oct 27 03:24:36.364177 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 610/1176] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:36 2022] GET /compute/v2.1/servers/8559e641-f41e-4b21-88b1-56d57ded5ce6 => generated 1567 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:24:36.586776 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a4e8d094-c0a8-495a-bb7a-da2028d4ef51 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "DELETE /compute/v2.1/servers/521ddedc-cff2-4c42-a737-9590906b07a6" status: 204 len: 0 microversion: 2.1 time: 0.312999 Oct 27 03:24:36.596707 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-347d58ec-2dcb-4712-a48d-df77324d9f6a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:36.597077 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-347d58ec-2dcb-4712-a48d-df77324d9f6a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:36.604021 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-347d58ec-2dcb-4712-a48d-df77324d9f6a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:36.604474 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-347d58ec-2dcb-4712-a48d-df77324d9f6a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:36.604921 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-347d58ec-2dcb-4712-a48d-df77324d9f6a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:36.605630 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-347d58ec-2dcb-4712-a48d-df77324d9f6a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:36.610774 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 567/1177] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:24:36 2022] DELETE /compute/v2.1/servers/521ddedc-cff2-4c42-a737-9590906b07a6 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:24:36.612220 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-347d58ec-2dcb-4712-a48d-df77324d9f6a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:36.612598 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-347d58ec-2dcb-4712-a48d-df77324d9f6a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:36.641642 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-be79994e-7855-4ade-872d-75bc4b22ca63 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1331754819", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": [{"uuid": "a487df35-1b16-4301-a7dc-3642f0ac024b"}]}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:24:36.703732 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.network.neutron [None req-be79994e-7855-4ade-872d-75bc4b22ca63 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] validate_networks() for [('a487df35-1b16-4301-a7dc-3642f0ac024b', None, None, None, None, None)] {{(pid=121001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:24:36.712560 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-347d58ec-2dcb-4712-a48d-df77324d9f6a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:36.724463 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-347d58ec-2dcb-4712-a48d-df77324d9f6a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:36.726269 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-347d58ec-2dcb-4712-a48d-df77324d9f6a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:36.743214 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-347d58ec-2dcb-4712-a48d-df77324d9f6a tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1539 microversion: 2.91 time: 0.148597 Oct 27 03:24:36.758073 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 611/1178] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:36 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1539 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:24:36.794204 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-ce607d0d-a310-446b-ac19-5154563aa206 req-e863d436-1e0c-4700-b0c7-4e5db15644a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "521ddedc-cff2-4c42-a737-9590906b07a6", "name": "network-vif-unplugged", "status": "completed", "tag": "2ccfa709-ec86-42d4-88a8-c7f4dcb17bbe"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:24:36.804229 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-ce607d0d-a310-446b-ac19-5154563aa206 req-e863d436-1e0c-4700-b0c7-4e5db15644a1 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:36.804950 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-ce607d0d-a310-446b-ac19-5154563aa206 req-e863d436-1e0c-4700-b0c7-4e5db15644a1 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:36.805542 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-ce607d0d-a310-446b-ac19-5154563aa206 req-e863d436-1e0c-4700-b0c7-4e5db15644a1 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:36.818479 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-ce607d0d-a310-446b-ac19-5154563aa206 req-e863d436-1e0c-4700-b0c7-4e5db15644a1 service nova] Creating event network-vif-unplugged:2ccfa709-ec86-42d4-88a8-c7f4dcb17bbe for instance 521ddedc-cff2-4c42-a737-9590906b07a6 on n-h1-862769-1 Oct 27 03:24:36.826071 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-ce607d0d-a310-446b-ac19-5154563aa206 req-e863d436-1e0c-4700-b0c7-4e5db15644a1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035477 Oct 27 03:24:36.827054 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 612/1179] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:24:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:24:36.832844 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-db86c50b-7535-4643-86d3-44c3c4edb70f tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:36.833568 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-db86c50b-7535-4643-86d3-44c3c4edb70f tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] [instance: 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:36.840185 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-db86c50b-7535-4643-86d3-44c3c4edb70f tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:36.840691 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-db86c50b-7535-4643-86d3-44c3c4edb70f tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:36.841133 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-db86c50b-7535-4643-86d3-44c3c4edb70f tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:36.842275 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-db86c50b-7535-4643-86d3-44c3c4edb70f tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:36.842874 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-db86c50b-7535-4643-86d3-44c3c4edb70f tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:36.843310 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-db86c50b-7535-4643-86d3-44c3c4edb70f tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:36.953145 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-db86c50b-7535-4643-86d3-44c3c4edb70f tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lazy-loading 'services' on Instance uuid 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503 {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:24:36.972730 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-db86c50b-7535-4643-86d3-44c3c4edb70f tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503" status: 200 len: 1933 microversion: 2.75 time: 0.144362 Oct 27 03:24:36.974018 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 613/1180] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:36 2022] GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503 => generated 1933 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:24:37.015200 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-64021381-4b7c-4ab0-9614-88711b881ecc tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:37.016009 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-64021381-4b7c-4ab0-9614-88711b881ecc tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 77dd3d48-fede-491a-b6ce-5ad36a1d7cab] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:37.031776 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-64021381-4b7c-4ab0-9614-88711b881ecc tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:37.033570 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-64021381-4b7c-4ab0-9614-88711b881ecc tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:37.034204 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-64021381-4b7c-4ab0-9614-88711b881ecc tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:37.035101 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-64021381-4b7c-4ab0-9614-88711b881ecc tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:37.035714 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-64021381-4b7c-4ab0-9614-88711b881ecc tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:37.036296 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-64021381-4b7c-4ab0-9614-88711b881ecc tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:37.194906 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-64021381-4b7c-4ab0-9614-88711b881ecc tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:37.195860 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-be79994e-7855-4ade-872d-75bc4b22ca63 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Flavor limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:24:37.196297 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-be79994e-7855-4ade-872d-75bc4b22ca63 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Image limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:24:37.196824 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-be79994e-7855-4ade-872d-75bc4b22ca63 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Flavor pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:24:37.197443 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-be79994e-7855-4ade-872d-75bc4b22ca63 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Image pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:24:37.197927 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-be79994e-7855-4ade-872d-75bc4b22ca63 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:24:37.203712 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-64021381-4b7c-4ab0-9614-88711b881ecc tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab" status: 200 len: 1470 microversion: 2.1 time: 0.194503 Oct 27 03:24:37.214086 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 614/1181] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:37 2022] GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab => generated 1470 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:24:37.214293 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-be79994e-7855-4ade-872d-75bc4b22ca63 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:37.214293 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-be79994e-7855-4ade-872d-75bc4b22ca63 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:37.214293 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-be79994e-7855-4ade-872d-75bc4b22ca63 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:37.214293 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-be79994e-7855-4ade-872d-75bc4b22ca63 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:37.214632 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-be79994e-7855-4ade-872d-75bc4b22ca63 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:37.214719 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-66ee23a6-58db-4dc7-807c-366970aac4d5 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:37.214806 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-be79994e-7855-4ade-872d-75bc4b22ca63 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:37.214901 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-66ee23a6-58db-4dc7-807c-366970aac4d5 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: c23b6c42-df64-4fab-9a29-ba638027a163] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:37.219277 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-66ee23a6-58db-4dc7-807c-366970aac4d5 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:37.220059 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-66ee23a6-58db-4dc7-807c-366970aac4d5 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:37.220756 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-66ee23a6-58db-4dc7-807c-366970aac4d5 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:37.221678 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-66ee23a6-58db-4dc7-807c-366970aac4d5 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:37.222527 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-66ee23a6-58db-4dc7-807c-366970aac4d5 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:37.223062 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-66ee23a6-58db-4dc7-807c-366970aac4d5 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:37.230111 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-be79994e-7855-4ade-872d-75bc4b22ca63 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Getting quotas for project ae78c307a1504172828e668f915a3677. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:24:37.235773 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-be79994e-7855-4ade-872d-75bc4b22ca63 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Getting quotas for user 1d6175f2ac39494f8cba3db225150d6c and project ae78c307a1504172828e668f915a3677. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:24:37.249162 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-be79994e-7855-4ade-872d-75bc4b22ca63 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Going to run 1 instances... {{(pid=121001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:24:37.252285 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-be79994e-7855-4ade-872d-75bc4b22ca63 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 33d5c62a-898f-441b-a1a1-3cb12836755d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:24:37.365059 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-66ee23a6-58db-4dc7-807c-366970aac4d5 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:37.372789 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-66ee23a6-58db-4dc7-807c-366970aac4d5 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/c23b6c42-df64-4fab-9a29-ba638027a163" status: 200 len: 1317 microversion: 2.1 time: 0.165923 Oct 27 03:24:37.373464 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 615/1182] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:37 2022] GET /compute/v2.1/servers/c23b6c42-df64-4fab-9a29-ba638027a163 => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:37.378832 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8eb68765-a9d6-44a6-b048-0917718543bd tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:24:37.379445 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8eb68765-a9d6-44a6-b048-0917718543bd tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 77dd3d48-fede-491a-b6ce-5ad36a1d7cab] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:37.385375 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8eb68765-a9d6-44a6-b048-0917718543bd tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:37.385923 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8eb68765-a9d6-44a6-b048-0917718543bd tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:37.386405 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8eb68765-a9d6-44a6-b048-0917718543bd tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:37.387110 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8eb68765-a9d6-44a6-b048-0917718543bd tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:37.388521 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8eb68765-a9d6-44a6-b048-0917718543bd tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:37.388521 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8eb68765-a9d6-44a6-b048-0917718543bd tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:37.391243 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-be79994e-7855-4ade-872d-75bc4b22ca63 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.753814 Oct 27 03:24:37.392932 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 568/1183] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:24:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 756 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 03:24:37.398013 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-883fe9db-7cba-4e98-984b-fb9be90875ef tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:37.398787 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-883fe9db-7cba-4e98-984b-fb9be90875ef tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: 543fdf60-10ec-4a25-a9d0-30c386efb104] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:37.405651 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-883fe9db-7cba-4e98-984b-fb9be90875ef tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:37.406416 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-883fe9db-7cba-4e98-984b-fb9be90875ef tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:37.406963 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-883fe9db-7cba-4e98-984b-fb9be90875ef tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:37.407780 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-883fe9db-7cba-4e98-984b-fb9be90875ef tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:37.408324 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-883fe9db-7cba-4e98-984b-fb9be90875ef tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:37.408987 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-883fe9db-7cba-4e98-984b-fb9be90875ef tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:37.430640 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8eb68765-a9d6-44a6-b048-0917718543bd tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:37.431136 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8eb68765-a9d6-44a6-b048-0917718543bd tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:37.431581 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8eb68765-a9d6-44a6-b048-0917718543bd tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:37.432334 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8eb68765-a9d6-44a6-b048-0917718543bd tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:37.432955 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8eb68765-a9d6-44a6-b048-0917718543bd tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:37.433478 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8eb68765-a9d6-44a6-b048-0917718543bd tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:37.462497 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-8eb68765-a9d6-44a6-b048-0917718543bd tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Getting quotas for project 48e708fb3bdd45bc976db7bd92af09c8. Resources: {'cores', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:24:37.468399 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-8eb68765-a9d6-44a6-b048-0917718543bd tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Getting quotas for user d3f1177e2cbd4ba6b659f8a714be86ac and project 48e708fb3bdd45bc976db7bd92af09c8. Resources: {'cores', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:24:37.481412 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-883fe9db-7cba-4e98-984b-fb9be90875ef tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:37.490644 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-883fe9db-7cba-4e98-984b-fb9be90875ef tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104" status: 200 len: 1286 microversion: 2.1 time: 0.096469 Oct 27 03:24:37.492167 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 569/1184] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:37 2022] GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104 => generated 1286 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:37.498342 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-345a289c-6263-4e9d-a7b9-f7adbbfab770 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:37.499488 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-345a289c-6263-4e9d-a7b9-f7adbbfab770 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 8559e641-f41e-4b21-88b1-56d57ded5ce6] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:37.507968 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-345a289c-6263-4e9d-a7b9-f7adbbfab770 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:37.510125 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-345a289c-6263-4e9d-a7b9-f7adbbfab770 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:37.510125 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-345a289c-6263-4e9d-a7b9-f7adbbfab770 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:37.510125 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-345a289c-6263-4e9d-a7b9-f7adbbfab770 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:37.510125 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-345a289c-6263-4e9d-a7b9-f7adbbfab770 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:37.510518 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-345a289c-6263-4e9d-a7b9-f7adbbfab770 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:37.653576 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-345a289c-6263-4e9d-a7b9-f7adbbfab770 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:37.661951 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-345a289c-6263-4e9d-a7b9-f7adbbfab770 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:37.663432 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-345a289c-6263-4e9d-a7b9-f7adbbfab770 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:37.664665 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-345a289c-6263-4e9d-a7b9-f7adbbfab770 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/8559e641-f41e-4b21-88b1-56d57ded5ce6" status: 200 len: 1567 microversion: 2.25 time: 0.171059 Oct 27 03:24:37.665299 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 570/1185] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:37 2022] GET /compute/v2.1/servers/8559e641-f41e-4b21-88b1-56d57ded5ce6 => generated 1567 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:24:37.669894 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-899c4ce2-ceeb-4125-af19-30ae16f526fe tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:37.670588 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-899c4ce2-ceeb-4125-af19-30ae16f526fe tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 33d5c62a-898f-441b-a1a1-3cb12836755d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:37.722762 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-899c4ce2-ceeb-4125-af19-30ae16f526fe tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:37.729751 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-899c4ce2-ceeb-4125-af19-30ae16f526fe tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/33d5c62a-898f-441b-a1a1-3cb12836755d" status: 200 len: 1208 microversion: 2.1 time: 0.063387 Oct 27 03:24:37.730353 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 571/1186] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:37 2022] GET /compute/v2.1/servers/33d5c62a-898f-441b-a1a1-3cb12836755d => generated 1208 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:37.771448 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b97ef7e1-c867-4103-85b4-95ef349b1513 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:37.772054 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b97ef7e1-c867-4103-85b4-95ef349b1513 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:37.780074 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b97ef7e1-c867-4103-85b4-95ef349b1513 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:37.780813 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b97ef7e1-c867-4103-85b4-95ef349b1513 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:37.783386 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b97ef7e1-c867-4103-85b4-95ef349b1513 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:37.783386 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b97ef7e1-c867-4103-85b4-95ef349b1513 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:37.783386 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b97ef7e1-c867-4103-85b4-95ef349b1513 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:37.784762 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b97ef7e1-c867-4103-85b4-95ef349b1513 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:37.869050 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b97ef7e1-c867-4103-85b4-95ef349b1513 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:37.892155 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b97ef7e1-c867-4103-85b4-95ef349b1513 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:37.893652 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b97ef7e1-c867-4103-85b4-95ef349b1513 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:37.913136 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b97ef7e1-c867-4103-85b4-95ef349b1513 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1539 microversion: 2.91 time: 0.144238 Oct 27 03:24:37.915997 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 572/1187] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:37 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1539 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:24:37.920313 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8eb68765-a9d6-44a6-b048-0917718543bd tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "POST /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab/action" status: 202 len: 0 microversion: 2.1 time: 0.544757 Oct 27 03:24:37.922003 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 616/1188] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:24:37 2022] POST /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab/action => generated 0 bytes in 548 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:24:37.932209 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-aa875813-cf65-4411-b60b-e3fbbd82535d tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:37.933476 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-aa875813-cf65-4411-b60b-e3fbbd82535d tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 77dd3d48-fede-491a-b6ce-5ad36a1d7cab] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:37.943872 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aa875813-cf65-4411-b60b-e3fbbd82535d tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:37.944499 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aa875813-cf65-4411-b60b-e3fbbd82535d tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:37.945010 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aa875813-cf65-4411-b60b-e3fbbd82535d tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:37.946641 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aa875813-cf65-4411-b60b-e3fbbd82535d tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:37.947024 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aa875813-cf65-4411-b60b-e3fbbd82535d tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:37.947526 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aa875813-cf65-4411-b60b-e3fbbd82535d tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:38.004349 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-43412321-dc4a-456c-9cb0-28e4b423ddcf tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:38.005109 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-43412321-dc4a-456c-9cb0-28e4b423ddcf tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] [instance: 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:38.013811 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-43412321-dc4a-456c-9cb0-28e4b423ddcf tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:38.014574 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-43412321-dc4a-456c-9cb0-28e4b423ddcf tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:38.015233 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-43412321-dc4a-456c-9cb0-28e4b423ddcf tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:38.016139 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-43412321-dc4a-456c-9cb0-28e4b423ddcf tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:38.016773 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-43412321-dc4a-456c-9cb0-28e4b423ddcf tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:38.017513 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-43412321-dc4a-456c-9cb0-28e4b423ddcf tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:38.106823 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-43412321-dc4a-456c-9cb0-28e4b423ddcf tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lazy-loading 'services' on Instance uuid 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503 {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:24:38.127653 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-aa875813-cf65-4411-b60b-e3fbbd82535d tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:38.133957 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-43412321-dc4a-456c-9cb0-28e4b423ddcf tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503" status: 200 len: 1933 microversion: 2.75 time: 0.135392 Oct 27 03:24:38.133957 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 617/1189] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:37 2022] GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503 => generated 1933 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:24:38.136858 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-aa875813-cf65-4411-b60b-e3fbbd82535d tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab" status: 200 len: 1469 microversion: 2.1 time: 0.209769 Oct 27 03:24:38.137542 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 573/1190] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:37 2022] GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab => generated 1469 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:38.397390 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-63f42277-dfeb-4574-b687-17b7fa690129 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:38.398003 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-63f42277-dfeb-4574-b687-17b7fa690129 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: c23b6c42-df64-4fab-9a29-ba638027a163] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:38.404289 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-63f42277-dfeb-4574-b687-17b7fa690129 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:38.404787 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-63f42277-dfeb-4574-b687-17b7fa690129 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:38.405256 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-63f42277-dfeb-4574-b687-17b7fa690129 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:38.405955 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-63f42277-dfeb-4574-b687-17b7fa690129 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:38.406436 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-63f42277-dfeb-4574-b687-17b7fa690129 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:38.406863 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-63f42277-dfeb-4574-b687-17b7fa690129 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:38.516275 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e2255828-e70f-4b48-9498-10a6de113ded tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:38.517438 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e2255828-e70f-4b48-9498-10a6de113ded tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: 543fdf60-10ec-4a25-a9d0-30c386efb104] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:38.523753 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e2255828-e70f-4b48-9498-10a6de113ded tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:38.524246 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e2255828-e70f-4b48-9498-10a6de113ded tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:38.524687 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e2255828-e70f-4b48-9498-10a6de113ded tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:38.525396 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e2255828-e70f-4b48-9498-10a6de113ded tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:38.525853 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e2255828-e70f-4b48-9498-10a6de113ded tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:38.526313 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e2255828-e70f-4b48-9498-10a6de113ded tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:38.599645 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e2255828-e70f-4b48-9498-10a6de113ded tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:38.609626 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e2255828-e70f-4b48-9498-10a6de113ded tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104" status: 200 len: 1286 microversion: 2.1 time: 0.095721 Oct 27 03:24:38.609626 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 574/1191] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:38 2022] GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104 => generated 1286 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:24:38.627283 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-63f42277-dfeb-4574-b687-17b7fa690129 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:38.635240 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-63f42277-dfeb-4574-b687-17b7fa690129 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/c23b6c42-df64-4fab-9a29-ba638027a163" status: 200 len: 1317 microversion: 2.1 time: 0.242145 Oct 27 03:24:38.635854 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 618/1192] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:38 2022] GET /compute/v2.1/servers/c23b6c42-df64-4fab-9a29-ba638027a163 => generated 1317 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:38.691328 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-42ed2e18-5d67-425a-8462-aeb93a973b8b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:38.696684 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-42ed2e18-5d67-425a-8462-aeb93a973b8b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 8559e641-f41e-4b21-88b1-56d57ded5ce6] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:38.718831 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-42ed2e18-5d67-425a-8462-aeb93a973b8b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:38.721382 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-42ed2e18-5d67-425a-8462-aeb93a973b8b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:38.723381 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-42ed2e18-5d67-425a-8462-aeb93a973b8b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:38.726765 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-42ed2e18-5d67-425a-8462-aeb93a973b8b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:38.728156 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-42ed2e18-5d67-425a-8462-aeb93a973b8b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:38.729012 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-42ed2e18-5d67-425a-8462-aeb93a973b8b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:38.755089 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8767de17-b0cc-4694-9d06-75c3fcd1bc0a tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:38.755769 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8767de17-b0cc-4694-9d06-75c3fcd1bc0a tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 33d5c62a-898f-441b-a1a1-3cb12836755d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:38.763376 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8767de17-b0cc-4694-9d06-75c3fcd1bc0a tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:38.769270 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8767de17-b0cc-4694-9d06-75c3fcd1bc0a tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:38.769270 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8767de17-b0cc-4694-9d06-75c3fcd1bc0a tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:38.769270 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8767de17-b0cc-4694-9d06-75c3fcd1bc0a tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:38.769270 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8767de17-b0cc-4694-9d06-75c3fcd1bc0a tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:38.769652 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8767de17-b0cc-4694-9d06-75c3fcd1bc0a tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:38.859522 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8767de17-b0cc-4694-9d06-75c3fcd1bc0a tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:38.867891 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8767de17-b0cc-4694-9d06-75c3fcd1bc0a tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/33d5c62a-898f-441b-a1a1-3cb12836755d" status: 200 len: 1212 microversion: 2.1 time: 0.118348 Oct 27 03:24:38.868692 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 619/1193] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:38 2022] GET /compute/v2.1/servers/33d5c62a-898f-441b-a1a1-3cb12836755d => generated 1212 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:24:38.873530 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-9d49c9c4-e17a-46bf-9443-f4893be5f241 req-87e4ab2c-2ab1-456d-a9e0-49d60055d463 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77dd3d48-fede-491a-b6ce-5ad36a1d7cab", "name": "network-vif-unplugged", "status": "completed", "tag": "a67227e9-dd6a-4cad-96f1-1d8b74514779"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:24:38.885668 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-9d49c9c4-e17a-46bf-9443-f4893be5f241 req-87e4ab2c-2ab1-456d-a9e0-49d60055d463 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:38.886345 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-9d49c9c4-e17a-46bf-9443-f4893be5f241 req-87e4ab2c-2ab1-456d-a9e0-49d60055d463 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:38.886735 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-9d49c9c4-e17a-46bf-9443-f4893be5f241 req-87e4ab2c-2ab1-456d-a9e0-49d60055d463 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:38.900609 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-9d49c9c4-e17a-46bf-9443-f4893be5f241 req-87e4ab2c-2ab1-456d-a9e0-49d60055d463 service nova] Creating event network-vif-unplugged:a67227e9-dd6a-4cad-96f1-1d8b74514779 for instance 77dd3d48-fede-491a-b6ce-5ad36a1d7cab on n-h2-862769-1 Oct 27 03:24:38.906365 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [req-9d49c9c4-e17a-46bf-9443-f4893be5f241 req-87e4ab2c-2ab1-456d-a9e0-49d60055d463 service nova] Instance 77dd3d48-fede-491a-b6ce-5ad36a1d7cab is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862769-1'} {{(pid=121000) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 03:24:38.912955 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-9d49c9c4-e17a-46bf-9443-f4893be5f241 req-87e4ab2c-2ab1-456d-a9e0-49d60055d463 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042955 Oct 27 03:24:38.917726 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 620/1194] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:24:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:24:38.918848 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-d0c02f9f-2b3c-4ba9-bdbd-1b1384624c6a req-55274108-1c57-48af-afd5-4051619cbfe7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8559e641-f41e-4b21-88b1-56d57ded5ce6", "name": "network-vif-unplugged", "status": "completed", "tag": "959f9b77-f7a5-423f-9c4f-1a5a89ebede9"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:24:38.928926 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-d0c02f9f-2b3c-4ba9-bdbd-1b1384624c6a req-55274108-1c57-48af-afd5-4051619cbfe7 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:38.929456 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-d0c02f9f-2b3c-4ba9-bdbd-1b1384624c6a req-55274108-1c57-48af-afd5-4051619cbfe7 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:38.929889 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-d0c02f9f-2b3c-4ba9-bdbd-1b1384624c6a req-55274108-1c57-48af-afd5-4051619cbfe7 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:38.945427 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-d0c02f9f-2b3c-4ba9-bdbd-1b1384624c6a req-55274108-1c57-48af-afd5-4051619cbfe7 service nova] Creating event network-vif-unplugged:959f9b77-f7a5-423f-9c4f-1a5a89ebede9 for instance 8559e641-f41e-4b21-88b1-56d57ded5ce6 on n-h2-862769-1 Oct 27 03:24:38.947380 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-d0c02f9f-2b3c-4ba9-bdbd-1b1384624c6a req-55274108-1c57-48af-afd5-4051619cbfe7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032546 Oct 27 03:24:38.947986 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 621/1195] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:24:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:24:38.953010 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7b8a0bf6-fc02-4409-ab3b-86c49310d2f6 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:38.953715 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7b8a0bf6-fc02-4409-ab3b-86c49310d2f6 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:38.961034 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7b8a0bf6-fc02-4409-ab3b-86c49310d2f6 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:38.961526 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7b8a0bf6-fc02-4409-ab3b-86c49310d2f6 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:38.961964 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7b8a0bf6-fc02-4409-ab3b-86c49310d2f6 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:38.962698 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7b8a0bf6-fc02-4409-ab3b-86c49310d2f6 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:38.963274 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7b8a0bf6-fc02-4409-ab3b-86c49310d2f6 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:38.963575 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7b8a0bf6-fc02-4409-ab3b-86c49310d2f6 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:38.989004 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-42ed2e18-5d67-425a-8462-aeb93a973b8b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:38.997680 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-42ed2e18-5d67-425a-8462-aeb93a973b8b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:38.999190 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-42ed2e18-5d67-425a-8462-aeb93a973b8b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:38.999552 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7b8a0bf6-fc02-4409-ab3b-86c49310d2f6 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:39.000046 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7b8a0bf6-fc02-4409-ab3b-86c49310d2f6 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:39.000489 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7b8a0bf6-fc02-4409-ab3b-86c49310d2f6 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:39.000604 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-42ed2e18-5d67-425a-8462-aeb93a973b8b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/8559e641-f41e-4b21-88b1-56d57ded5ce6" status: 200 len: 1567 microversion: 2.25 time: 0.313827 Oct 27 03:24:39.001521 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-7b8a0bf6-fc02-4409-ab3b-86c49310d2f6 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lazy-loading 'fault' on Instance uuid c3536a26-29e6-4208-a03b-9609511fb53b {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:24:39.001958 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 575/1196] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:38 2022] GET /compute/v2.1/servers/8559e641-f41e-4b21-88b1-56d57ded5ce6 => generated 1567 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:24:39.054056 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7b8a0bf6-fc02-4409-ab3b-86c49310d2f6 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:39.063142 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7b8a0bf6-fc02-4409-ab3b-86c49310d2f6 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:39.065196 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7b8a0bf6-fc02-4409-ab3b-86c49310d2f6 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:39.070933 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7b8a0bf6-fc02-4409-ab3b-86c49310d2f6 tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1544 microversion: 2.91 time: 0.121802 Oct 27 03:24:39.072222 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 622/1197] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:38 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1544 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:24:39.164991 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-644178c4-4595-4086-bd50-3d064ae80316 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:39.165730 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-fe86edbb-9db9-4f7b-af6a-dd272bee1281 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:39.166455 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-644178c4-4595-4086-bd50-3d064ae80316 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] [instance: 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:39.168548 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-fe86edbb-9db9-4f7b-af6a-dd272bee1281 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 77dd3d48-fede-491a-b6ce-5ad36a1d7cab] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:39.178713 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fe86edbb-9db9-4f7b-af6a-dd272bee1281 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:39.185242 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-644178c4-4595-4086-bd50-3d064ae80316 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:39.185242 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-644178c4-4595-4086-bd50-3d064ae80316 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:39.185242 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-644178c4-4595-4086-bd50-3d064ae80316 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:39.185242 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-644178c4-4595-4086-bd50-3d064ae80316 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:39.185843 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-644178c4-4595-4086-bd50-3d064ae80316 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:39.185843 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-644178c4-4595-4086-bd50-3d064ae80316 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:39.186280 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fe86edbb-9db9-4f7b-af6a-dd272bee1281 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:39.186801 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fe86edbb-9db9-4f7b-af6a-dd272bee1281 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:39.187540 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fe86edbb-9db9-4f7b-af6a-dd272bee1281 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:39.188020 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fe86edbb-9db9-4f7b-af6a-dd272bee1281 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:39.189016 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fe86edbb-9db9-4f7b-af6a-dd272bee1281 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:39.312466 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-644178c4-4595-4086-bd50-3d064ae80316 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lazy-loading 'services' on Instance uuid 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503 {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:24:39.334795 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-644178c4-4595-4086-bd50-3d064ae80316 tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503" status: 200 len: 1933 microversion: 2.75 time: 0.173490 Oct 27 03:24:39.335398 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 623/1198] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:39 2022] GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503 => generated 1933 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:24:39.632791 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f0ec90aa-06e3-4147-8331-4ca6144b210d tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:39.634278 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f0ec90aa-06e3-4147-8331-4ca6144b210d tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: 543fdf60-10ec-4a25-a9d0-30c386efb104] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:39.641933 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f0ec90aa-06e3-4147-8331-4ca6144b210d tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:39.642757 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f0ec90aa-06e3-4147-8331-4ca6144b210d tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:39.643368 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f0ec90aa-06e3-4147-8331-4ca6144b210d tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:39.644246 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f0ec90aa-06e3-4147-8331-4ca6144b210d tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:39.644855 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f0ec90aa-06e3-4147-8331-4ca6144b210d tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:39.645439 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f0ec90aa-06e3-4147-8331-4ca6144b210d tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:39.668801 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:24:39.714595 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-fe86edbb-9db9-4f7b-af6a-dd272bee1281 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:39.734814 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-fe86edbb-9db9-4f7b-af6a-dd272bee1281 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab" status: 200 len: 1469 microversion: 2.1 time: 0.576763 Oct 27 03:24:39.735894 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 576/1199] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:39 2022] GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab => generated 1469 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:39.741340 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f0ec90aa-06e3-4147-8331-4ca6144b210d tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:39.741505 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-ef4e4cf8-ad89-4e3b-ac15-5f5efb285f67 req-4ed962f0-a5f0-4eb5-810e-bc7b5fdd0e89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "521ddedc-cff2-4c42-a737-9590906b07a6", "name": "network-vif-deleted", "tag": "2ccfa709-ec86-42d4-88a8-c7f4dcb17bbe"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:24:39.750783 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f0ec90aa-06e3-4147-8331-4ca6144b210d tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104" status: 200 len: 1286 microversion: 2.1 time: 0.123491 Oct 27 03:24:39.762100 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 624/1200] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:39 2022] GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104 => generated 1286 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:24:39.762100 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f556b424-2da1-46e7-9047-5d6b732d7d54 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:39.762376 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-ef4e4cf8-ad89-4e3b-ac15-5f5efb285f67 req-4ed962f0-a5f0-4eb5-810e-bc7b5fdd0e89 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:39.762486 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f556b424-2da1-46e7-9047-5d6b732d7d54 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: c23b6c42-df64-4fab-9a29-ba638027a163] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:39.762566 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-ef4e4cf8-ad89-4e3b-ac15-5f5efb285f67 req-4ed962f0-a5f0-4eb5-810e-bc7b5fdd0e89 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:39.762693 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-ef4e4cf8-ad89-4e3b-ac15-5f5efb285f67 req-4ed962f0-a5f0-4eb5-810e-bc7b5fdd0e89 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:39.768918 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f556b424-2da1-46e7-9047-5d6b732d7d54 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:39.772200 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f556b424-2da1-46e7-9047-5d6b732d7d54 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:39.772200 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f556b424-2da1-46e7-9047-5d6b732d7d54 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:39.772200 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f556b424-2da1-46e7-9047-5d6b732d7d54 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:39.772200 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f556b424-2da1-46e7-9047-5d6b732d7d54 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:39.772548 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f556b424-2da1-46e7-9047-5d6b732d7d54 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:39.780163 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-ef4e4cf8-ad89-4e3b-ac15-5f5efb285f67 req-4ed962f0-a5f0-4eb5-810e-bc7b5fdd0e89 service nova] Creating event network-vif-deleted:2ccfa709-ec86-42d4-88a8-c7f4dcb17bbe for instance 521ddedc-cff2-4c42-a737-9590906b07a6 on n-h1-862769-1 Oct 27 03:24:39.788760 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-ef4e4cf8-ad89-4e3b-ac15-5f5efb285f67 req-4ed962f0-a5f0-4eb5-810e-bc7b5fdd0e89 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051478 Oct 27 03:24:39.789586 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 577/1201] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:24:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:24:39.892148 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d6c0afc6-ace6-4795-a429-b3690e8718ae tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:39.892928 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d6c0afc6-ace6-4795-a429-b3690e8718ae tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 33d5c62a-898f-441b-a1a1-3cb12836755d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:39.899356 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d6c0afc6-ace6-4795-a429-b3690e8718ae tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:39.899843 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d6c0afc6-ace6-4795-a429-b3690e8718ae tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:39.900277 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d6c0afc6-ace6-4795-a429-b3690e8718ae tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:39.900975 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d6c0afc6-ace6-4795-a429-b3690e8718ae tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:39.901429 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d6c0afc6-ace6-4795-a429-b3690e8718ae tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:39.902028 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d6c0afc6-ace6-4795-a429-b3690e8718ae tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:39.943234 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f556b424-2da1-46e7-9047-5d6b732d7d54 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:39.955263 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f556b424-2da1-46e7-9047-5d6b732d7d54 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/c23b6c42-df64-4fab-9a29-ba638027a163" status: 200 len: 1317 microversion: 2.1 time: 0.198263 Oct 27 03:24:39.956584 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 625/1202] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:39 2022] GET /compute/v2.1/servers/c23b6c42-df64-4fab-9a29-ba638027a163 => generated 1317 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:40.015785 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d6c0afc6-ace6-4795-a429-b3690e8718ae tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:40.025073 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d6c0afc6-ace6-4795-a429-b3690e8718ae tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/33d5c62a-898f-441b-a1a1-3cb12836755d" status: 200 len: 1212 microversion: 2.1 time: 0.138000 Oct 27 03:24:40.038064 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-98df9d76-5099-454c-a3d8-398108836e9a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:40.038064 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-98df9d76-5099-454c-a3d8-398108836e9a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 8559e641-f41e-4b21-88b1-56d57ded5ce6] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:40.038064 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-98df9d76-5099-454c-a3d8-398108836e9a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:40.038064 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-98df9d76-5099-454c-a3d8-398108836e9a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:40.038561 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-98df9d76-5099-454c-a3d8-398108836e9a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:40.038561 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-98df9d76-5099-454c-a3d8-398108836e9a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:40.038561 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-98df9d76-5099-454c-a3d8-398108836e9a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:40.038561 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-98df9d76-5099-454c-a3d8-398108836e9a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:40.040699 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 578/1203] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:39 2022] GET /compute/v2.1/servers/33d5c62a-898f-441b-a1a1-3cb12836755d => generated 1212 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:24:40.098126 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1412c9bd-bfbe-4350-9b83-a492acfd0e2b tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:40.098886 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1412c9bd-bfbe-4350-9b83-a492acfd0e2b tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:40.106335 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1412c9bd-bfbe-4350-9b83-a492acfd0e2b tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:40.107138 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1412c9bd-bfbe-4350-9b83-a492acfd0e2b tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:40.107685 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1412c9bd-bfbe-4350-9b83-a492acfd0e2b tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:40.108613 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1412c9bd-bfbe-4350-9b83-a492acfd0e2b tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:40.109172 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1412c9bd-bfbe-4350-9b83-a492acfd0e2b tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:40.109712 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1412c9bd-bfbe-4350-9b83-a492acfd0e2b tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:40.144921 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1412c9bd-bfbe-4350-9b83-a492acfd0e2b tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:40.145413 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1412c9bd-bfbe-4350-9b83-a492acfd0e2b tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:40.146143 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1412c9bd-bfbe-4350-9b83-a492acfd0e2b tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:40.146616 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-1412c9bd-bfbe-4350-9b83-a492acfd0e2b tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lazy-loading 'fault' on Instance uuid c3536a26-29e6-4208-a03b-9609511fb53b {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:24:40.183241 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-98df9d76-5099-454c-a3d8-398108836e9a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:40.193398 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1412c9bd-bfbe-4350-9b83-a492acfd0e2b tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:40.193945 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-98df9d76-5099-454c-a3d8-398108836e9a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:40.195602 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-98df9d76-5099-454c-a3d8-398108836e9a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:40.196666 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-98df9d76-5099-454c-a3d8-398108836e9a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/8559e641-f41e-4b21-88b1-56d57ded5ce6" status: 200 len: 1567 microversion: 2.25 time: 0.173221 Oct 27 03:24:40.197585 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 626/1204] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:40 2022] GET /compute/v2.1/servers/8559e641-f41e-4b21-88b1-56d57ded5ce6 => generated 1567 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:24:40.202204 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1412c9bd-bfbe-4350-9b83-a492acfd0e2b tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:40.203661 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1412c9bd-bfbe-4350-9b83-a492acfd0e2b tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3756b0d73d634269bec89f1be45cdc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb9090ce414b1d9ab195faec4cc45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:40.209582 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1412c9bd-bfbe-4350-9b83-a492acfd0e2b tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 200 len: 1544 microversion: 2.91 time: 0.115923 Oct 27 03:24:40.215303 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 579/1205] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:40 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 1544 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:24:40.367449 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7340010a-b668-40b6-b42e-3952f09dcd5e tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:40.368093 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7340010a-b668-40b6-b42e-3952f09dcd5e tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] [instance: 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:40.374819 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7340010a-b668-40b6-b42e-3952f09dcd5e tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:40.375308 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7340010a-b668-40b6-b42e-3952f09dcd5e tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:40.376251 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7340010a-b668-40b6-b42e-3952f09dcd5e tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:40.376947 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7340010a-b668-40b6-b42e-3952f09dcd5e tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:40.377402 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7340010a-b668-40b6-b42e-3952f09dcd5e tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:40.377829 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7340010a-b668-40b6-b42e-3952f09dcd5e tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:40.447728 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-7340010a-b668-40b6-b42e-3952f09dcd5e tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] Lazy-loading 'services' on Instance uuid 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503 {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:24:40.464835 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7340010a-b668-40b6-b42e-3952f09dcd5e tempest-ServersAdmin275Test-1464923290 tempest-ServersAdmin275Test-1464923290-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503" status: 200 len: 1918 microversion: 2.75 time: 0.101076 Oct 27 03:24:40.465416 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 627/1206] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:40 2022] GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503 => generated 1918 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:24:40.504556 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-647c75c7-6333-46e3-adec-92580dc48f90 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:40.505200 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-647c75c7-6333-46e3-adec-92580dc48f90 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] [instance: 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:40.511449 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-647c75c7-6333-46e3-adec-92580dc48f90 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:40.511935 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-647c75c7-6333-46e3-adec-92580dc48f90 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:40.512379 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-647c75c7-6333-46e3-adec-92580dc48f90 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:40.513079 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-647c75c7-6333-46e3-adec-92580dc48f90 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:40.513573 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-647c75c7-6333-46e3-adec-92580dc48f90 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:40.513998 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-647c75c7-6333-46e3-adec-92580dc48f90 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:40.539805 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-647c75c7-6333-46e3-adec-92580dc48f90 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] [instance: 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503] Going to try to terminate instance {{(pid=121001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:24:40.680742 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:24:40.757627 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-bbcb327b-464c-4f75-b9b9-ba129cfed647 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:40.758435 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-bbcb327b-464c-4f75-b9b9-ba129cfed647 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 77dd3d48-fede-491a-b6ce-5ad36a1d7cab] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:40.765393 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bbcb327b-464c-4f75-b9b9-ba129cfed647 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:40.766057 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bbcb327b-464c-4f75-b9b9-ba129cfed647 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:40.766532 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bbcb327b-464c-4f75-b9b9-ba129cfed647 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:40.767265 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bbcb327b-464c-4f75-b9b9-ba129cfed647 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:40.767714 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bbcb327b-464c-4f75-b9b9-ba129cfed647 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:40.768150 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bbcb327b-464c-4f75-b9b9-ba129cfed647 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:40.901455 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-647c75c7-6333-46e3-adec-92580dc48f90 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503" status: 204 len: 0 microversion: 2.75 time: 0.402355 Oct 27 03:24:40.902273 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 580/1207] 10.222.0.20 () {60 vars in 1280 bytes} [Thu Oct 27 03:24:40 2022] DELETE /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 03:24:40.908669 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2ac627da-7bd1-407c-b1ab-ea4b1df3ae93 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:40.910283 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2ac627da-7bd1-407c-b1ab-ea4b1df3ae93 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: 543fdf60-10ec-4a25-a9d0-30c386efb104] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:40.917344 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2ac627da-7bd1-407c-b1ab-ea4b1df3ae93 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:40.927905 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2ac627da-7bd1-407c-b1ab-ea4b1df3ae93 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:40.930631 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2ac627da-7bd1-407c-b1ab-ea4b1df3ae93 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:40.933962 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2ac627da-7bd1-407c-b1ab-ea4b1df3ae93 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:40.934487 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2ac627da-7bd1-407c-b1ab-ea4b1df3ae93 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:40.935465 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2ac627da-7bd1-407c-b1ab-ea4b1df3ae93 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:41.015993 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2ac627da-7bd1-407c-b1ab-ea4b1df3ae93 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:41.023999 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2ac627da-7bd1-407c-b1ab-ea4b1df3ae93 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104" status: 200 len: 1294 microversion: 2.1 time: 0.120424 Oct 27 03:24:41.024645 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 581/1208] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:40 2022] GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104 => generated 1294 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:41.040083 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-bbcb327b-464c-4f75-b9b9-ba129cfed647 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:41.041375 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-bfdb360a-12a2-46d7-af7f-2702962738a0 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:41.042010 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-bfdb360a-12a2-46d7-af7f-2702962738a0 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] [instance: 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:41.043970 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=91,nova_api:UPDATE=3 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:24:41.048910 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-bbcb327b-464c-4f75-b9b9-ba129cfed647 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab" status: 200 len: 1469 microversion: 2.1 time: 0.295298 Oct 27 03:24:41.049643 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 628/1209] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:40 2022] GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab => generated 1469 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:24:41.051216 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bfdb360a-12a2-46d7-af7f-2702962738a0 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:41.051772 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bfdb360a-12a2-46d7-af7f-2702962738a0 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:41.052280 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bfdb360a-12a2-46d7-af7f-2702962738a0 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:41.053313 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bfdb360a-12a2-46d7-af7f-2702962738a0 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:41.053582 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bfdb360a-12a2-46d7-af7f-2702962738a0 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:41.054136 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bfdb360a-12a2-46d7-af7f-2702962738a0 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:41.057935 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-366bd5b1-560a-408c-ac83-9d6c73ab64e4 req-4afce40b-8099-414a-a28a-9717b384821f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77dd3d48-fede-491a-b6ce-5ad36a1d7cab", "name": "network-vif-plugged", "status": "completed", "tag": "a67227e9-dd6a-4cad-96f1-1d8b74514779"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:24:41.075356 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-366bd5b1-560a-408c-ac83-9d6c73ab64e4 req-4afce40b-8099-414a-a28a-9717b384821f service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:41.076065 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-366bd5b1-560a-408c-ac83-9d6c73ab64e4 req-4afce40b-8099-414a-a28a-9717b384821f service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:41.076656 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-366bd5b1-560a-408c-ac83-9d6c73ab64e4 req-4afce40b-8099-414a-a28a-9717b384821f service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:41.091705 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-366bd5b1-560a-408c-ac83-9d6c73ab64e4 req-4afce40b-8099-414a-a28a-9717b384821f service nova] Creating event network-vif-plugged:a67227e9-dd6a-4cad-96f1-1d8b74514779 for instance 77dd3d48-fede-491a-b6ce-5ad36a1d7cab on n-h2-862769-1 Oct 27 03:24:41.098632 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [req-366bd5b1-560a-408c-ac83-9d6c73ab64e4 req-4afce40b-8099-414a-a28a-9717b384821f service nova] Instance 77dd3d48-fede-491a-b6ce-5ad36a1d7cab is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862769-1'} {{(pid=121000) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 03:24:41.111463 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-366bd5b1-560a-408c-ac83-9d6c73ab64e4 req-4afce40b-8099-414a-a28a-9717b384821f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060743 Oct 27 03:24:41.112360 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 629/1210] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:24:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:24:41.119775 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-92247934-7fb6-4452-acd5-9618a874f7c2 req-46322967-c4a5-46ed-ab0b-fe1fc91ff06a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8559e641-f41e-4b21-88b1-56d57ded5ce6", "tag": "959f9b77-f7a5-423f-9c4f-1a5a89ebede9"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:24:41.126772 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-bfdb360a-12a2-46d7-af7f-2702962738a0 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:41.132461 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-92247934-7fb6-4452-acd5-9618a874f7c2 req-46322967-c4a5-46ed-ab0b-fe1fc91ff06a service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:41.132953 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-92247934-7fb6-4452-acd5-9618a874f7c2 req-46322967-c4a5-46ed-ab0b-fe1fc91ff06a service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:41.133601 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-92247934-7fb6-4452-acd5-9618a874f7c2 req-46322967-c4a5-46ed-ab0b-fe1fc91ff06a service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:41.135919 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-bfdb360a-12a2-46d7-af7f-2702962738a0 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:41.137558 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-bfdb360a-12a2-46d7-af7f-2702962738a0 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:41.142680 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-bfdb360a-12a2-46d7-af7f-2702962738a0 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] 10.222.0.20 "GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503" status: 200 len: 1443 microversion: 2.75 time: 0.117046 Oct 27 03:24:41.143261 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 582/1211] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:41 2022] GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503 => generated 1443 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:24:41.148411 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-069b970e-97f4-4378-b377-348e41b3df9c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:41.149028 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-069b970e-97f4-4378-b377-348e41b3df9c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: c23b6c42-df64-4fab-9a29-ba638027a163] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:41.152376 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-92247934-7fb6-4452-acd5-9618a874f7c2 req-46322967-c4a5-46ed-ab0b-fe1fc91ff06a service nova] Creating event network-changed:959f9b77-f7a5-423f-9c4f-1a5a89ebede9 for instance 8559e641-f41e-4b21-88b1-56d57ded5ce6 on n-h2-862769-1 Oct 27 03:24:41.155088 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-069b970e-97f4-4378-b377-348e41b3df9c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:41.155740 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-069b970e-97f4-4378-b377-348e41b3df9c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:41.156181 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-069b970e-97f4-4378-b377-348e41b3df9c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:41.157575 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-069b970e-97f4-4378-b377-348e41b3df9c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:41.158061 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-069b970e-97f4-4378-b377-348e41b3df9c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:41.158495 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-069b970e-97f4-4378-b377-348e41b3df9c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:41.160427 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-92247934-7fb6-4452-acd5-9618a874f7c2 req-46322967-c4a5-46ed-ab0b-fe1fc91ff06a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046670 Oct 27 03:24:41.161558 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 630/1212] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:24:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:24:41.167476 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9320d008-e015-4ba8-89b3-9178396dace9 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:41.168299 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9320d008-e015-4ba8-89b3-9178396dace9 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 33d5c62a-898f-441b-a1a1-3cb12836755d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:41.176279 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9320d008-e015-4ba8-89b3-9178396dace9 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:41.176859 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9320d008-e015-4ba8-89b3-9178396dace9 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:41.177410 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9320d008-e015-4ba8-89b3-9178396dace9 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:41.178223 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9320d008-e015-4ba8-89b3-9178396dace9 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:41.178775 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9320d008-e015-4ba8-89b3-9178396dace9 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:41.186235 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9320d008-e015-4ba8-89b3-9178396dace9 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:41.245600 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9320d008-e015-4ba8-89b3-9178396dace9 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:41.253634 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9320d008-e015-4ba8-89b3-9178396dace9 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/33d5c62a-898f-441b-a1a1-3cb12836755d" status: 200 len: 1260 microversion: 2.1 time: 0.090889 Oct 27 03:24:41.254256 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 631/1213] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:41 2022] GET /compute/v2.1/servers/33d5c62a-898f-441b-a1a1-3cb12836755d => generated 1260 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:41.265992 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-fb87abde-587e-496e-b864-3ca7f35c1158 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:41.267211 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-fb87abde-587e-496e-b864-3ca7f35c1158 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 8559e641-f41e-4b21-88b1-56d57ded5ce6] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:41.273724 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fb87abde-587e-496e-b864-3ca7f35c1158 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:41.274400 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fb87abde-587e-496e-b864-3ca7f35c1158 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:41.274927 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fb87abde-587e-496e-b864-3ca7f35c1158 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:41.275712 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fb87abde-587e-496e-b864-3ca7f35c1158 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:41.276320 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fb87abde-587e-496e-b864-3ca7f35c1158 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:41.280289 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fb87abde-587e-496e-b864-3ca7f35c1158 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:41.299488 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-069b970e-97f4-4378-b377-348e41b3df9c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:41.307281 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-069b970e-97f4-4378-b377-348e41b3df9c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/c23b6c42-df64-4fab-9a29-ba638027a163" status: 200 len: 1317 microversion: 2.1 time: 0.162751 Oct 27 03:24:41.307846 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 583/1214] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:41 2022] GET /compute/v2.1/servers/c23b6c42-df64-4fab-9a29-ba638027a163 => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:41.312453 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-075e4b5d-a0f9-4862-b2db-d1c729d3f61c tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:41.313065 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-075e4b5d-a0f9-4862-b2db-d1c729d3f61c tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] [instance: c3536a26-29e6-4208-a03b-9609511fb53b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:41.320144 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-075e4b5d-a0f9-4862-b2db-d1c729d3f61c tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:41.320737 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-075e4b5d-a0f9-4862-b2db-d1c729d3f61c tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:41.326305 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-075e4b5d-a0f9-4862-b2db-d1c729d3f61c tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:41.326305 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-075e4b5d-a0f9-4862-b2db-d1c729d3f61c tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:41.326305 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-075e4b5d-a0f9-4862-b2db-d1c729d3f61c tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:41.326305 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-075e4b5d-a0f9-4862-b2db-d1c729d3f61c tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:41.337636 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-075e4b5d-a0f9-4862-b2db-d1c729d3f61c tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] HTTP exception thrown: Instance c3536a26-29e6-4208-a03b-9609511fb53b could not be found. Oct 27 03:24:41.339303 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-075e4b5d-a0f9-4862-b2db-d1c729d3f61c tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Request method failure captured: Oct 27 03:24:41.339303 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b HTTP/1.1 Oct 27 03:24:41.339303 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:24:41.339303 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:24:41.339303 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:24:41.339303 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:24:41.339303 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:24:41.339303 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:24:41.339303 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:24:41.339303 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:24:41.339303 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfkuCEmNSKm9UlDDq60accxwqgGaQC1plYlKAnBCGx-7yq8uhfeYqg_J-f5MVUlDWQxh_ja-EHQcduez-KG5c2ORO35xIZVfrHYpLN-ZoR0VOa5g6Uwlktqe35YKdd1c9s6xbTO4FOJZwoWvtCPUt4MIDG-cDEldQAulNmPZTGS2NaA Oct 27 03:24:41.339303 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:24:41.339303 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:24:41.339303 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:24:41.339303 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:24:41.339303 n-d-862769-1 devstack@n-api.service[121001]: X-Openstack-Nova-Api-Version: 2.91 Oct 27 03:24:41.339303 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:24:41.339303 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:24:41.339303 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 11fb9090ce414b1d9ab195faec4cc45e Oct 27 03:24:41.339303 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-689406482 Oct 27 03:24:41.339303 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:24:41.339303 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:24:41.341003 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/11fb9090ce414b1d9ab195faec4cc45e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/11fb9090ce414b1d9ab195faec4cc45e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/11fb9090ce414b1d9ab195faec4cc45e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_11fb9090ce414b1d9ab195faec4cc45e"}]}] Oct 27 03:24:41.341003 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-689406482 Oct 27 03:24:41.341003 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 11fb9090ce414b1d9ab195faec4cc45e Oct 27 03:24:41.341003 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-689406482 Oct 27 03:24:41.341003 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-UnshelveToHostMultiNodesTest-689406482-project Oct 27 03:24:41.341003 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:24:41.341003 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:24:41.341003 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 3756b0d73d634269bec89f1be45cdc5d Oct 27 03:24:41.341003 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-689406482-project Oct 27 03:24:41.341003 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:24:41.341003 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance c3536a26-29e6-4208-a03b-9609511fb53b could not be found. Oct 27 03:24:41.341003 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': 'c3536a26-29e6-4208-a03b-9609511fb53b'} Oct 27 03:24:41.341930 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:24:41.341930 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:24:41.341930 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:24:41.341930 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:24:41.341930 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:24:41.341930 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:24:41.341930 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:24:41.341930 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:24:41.341930 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:24:41.341930 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:24:41.341930 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3536a26-29e6-4208-a03b-9609511fb53b could not be found. Oct 27 03:24:41.341930 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:24:41.341930 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:24:41.341930 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:24:41.341930 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:24:41.341930 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:24:41.341930 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:24:41.341930 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:24:41.341930 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:24:41.341930 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:24:41.343446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:24:41.343446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:24:41.343446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:24:41.343446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:24:41.343446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:24:41.343446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:24:41.343446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:24:41.343446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3536a26-29e6-4208-a03b-9609511fb53b could not be found. Oct 27 03:24:41.343446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:24:41.343446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:24:41.343446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:24:41.343446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:24:41.343446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:24:41.343446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:24:41.343446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:24:41.343446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:24:41.343446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3536a26-29e6-4208-a03b-9609511fb53b could not be found. Oct 27 03:24:41.343446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:24:41.345726 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-075e4b5d-a0f9-4862-b2db-d1c729d3f61c tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] Returning 404 to user: Instance c3536a26-29e6-4208-a03b-9609511fb53b could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:24:41.345726 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-075e4b5d-a0f9-4862-b2db-d1c729d3f61c tempest-UnshelveToHostMultiNodesTest-689406482 tempest-UnshelveToHostMultiNodesTest-689406482-project] 10.222.0.20 "GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b" status: 404 len: 111 microversion: 2.91 time: 0.031738 Oct 27 03:24:41.345726 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 584/1215] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:41 2022] GET /compute/v2.1/servers/c3536a26-29e6-4208-a03b-9609511fb53b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 03:24:41.426369 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-fb87abde-587e-496e-b864-3ca7f35c1158 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:41.434593 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-fb87abde-587e-496e-b864-3ca7f35c1158 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:41.436039 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-fb87abde-587e-496e-b864-3ca7f35c1158 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:41.437247 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-fb87abde-587e-496e-b864-3ca7f35c1158 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/8559e641-f41e-4b21-88b1-56d57ded5ce6" status: 200 len: 1567 microversion: 2.25 time: 0.177592 Oct 27 03:24:41.437804 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 632/1216] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:41 2022] GET /compute/v2.1/servers/8559e641-f41e-4b21-88b1-56d57ded5ce6 => generated 1567 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:24:42.049478 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-02cd5d9c-6f7e-4a45-8b66-928d5e69e3be tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:42.051104 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-02cd5d9c-6f7e-4a45-8b66-928d5e69e3be tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: 543fdf60-10ec-4a25-a9d0-30c386efb104] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:42.059315 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-02cd5d9c-6f7e-4a45-8b66-928d5e69e3be tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:42.064302 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-02cd5d9c-6f7e-4a45-8b66-928d5e69e3be tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:42.064302 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-02cd5d9c-6f7e-4a45-8b66-928d5e69e3be tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:42.064302 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-02cd5d9c-6f7e-4a45-8b66-928d5e69e3be tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:42.064302 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-02cd5d9c-6f7e-4a45-8b66-928d5e69e3be tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:42.064757 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-02cd5d9c-6f7e-4a45-8b66-928d5e69e3be tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:42.072653 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-38b59f18-cb81-4113-a155-2f78d06a1619 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:42.073276 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-38b59f18-cb81-4113-a155-2f78d06a1619 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 77dd3d48-fede-491a-b6ce-5ad36a1d7cab] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:42.080426 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-38b59f18-cb81-4113-a155-2f78d06a1619 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:42.080843 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-38b59f18-cb81-4113-a155-2f78d06a1619 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:42.081463 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-38b59f18-cb81-4113-a155-2f78d06a1619 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:42.082211 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-38b59f18-cb81-4113-a155-2f78d06a1619 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:42.082826 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-38b59f18-cb81-4113-a155-2f78d06a1619 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:42.083261 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-38b59f18-cb81-4113-a155-2f78d06a1619 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:42.133329 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-02cd5d9c-6f7e-4a45-8b66-928d5e69e3be tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:42.148583 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-02cd5d9c-6f7e-4a45-8b66-928d5e69e3be tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104" status: 200 len: 1304 microversion: 2.1 time: 0.104462 Oct 27 03:24:42.149168 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 585/1217] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:42 2022] GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104 => generated 1304 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:42.173756 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9e2b4199-dad2-4643-8155-219e49cadb6a tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:42.174580 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-9e2b4199-dad2-4643-8155-219e49cadb6a tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] [instance: 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:42.189219 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9e2b4199-dad2-4643-8155-219e49cadb6a tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:42.189674 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9e2b4199-dad2-4643-8155-219e49cadb6a tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:42.190317 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9e2b4199-dad2-4643-8155-219e49cadb6a tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:42.191354 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9e2b4199-dad2-4643-8155-219e49cadb6a tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:42.191961 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9e2b4199-dad2-4643-8155-219e49cadb6a tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:42.193892 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9e2b4199-dad2-4643-8155-219e49cadb6a tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:42.306352 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9e2b4199-dad2-4643-8155-219e49cadb6a tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:42.323861 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9e2b4199-dad2-4643-8155-219e49cadb6a tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:42.333896 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9e2b4199-dad2-4643-8155-219e49cadb6a tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:42.343549 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9e2b4199-dad2-4643-8155-219e49cadb6a tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] 10.222.0.20 "GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503" status: 200 len: 1443 microversion: 2.75 time: 0.174302 Oct 27 03:24:42.345279 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 586/1218] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:42 2022] GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503 => generated 1443 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:24:42.351544 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-55f8f94f-cc7d-4a3a-b5a9-1493cf57e5d0 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:42.352570 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-55f8f94f-cc7d-4a3a-b5a9-1493cf57e5d0 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 33d5c62a-898f-441b-a1a1-3cb12836755d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:42.371257 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-55f8f94f-cc7d-4a3a-b5a9-1493cf57e5d0 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:42.372165 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-55f8f94f-cc7d-4a3a-b5a9-1493cf57e5d0 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:42.373057 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-55f8f94f-cc7d-4a3a-b5a9-1493cf57e5d0 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:42.373682 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-55f8f94f-cc7d-4a3a-b5a9-1493cf57e5d0 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:42.374173 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-55f8f94f-cc7d-4a3a-b5a9-1493cf57e5d0 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:42.375150 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-55f8f94f-cc7d-4a3a-b5a9-1493cf57e5d0 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:42.445983 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-38b59f18-cb81-4113-a155-2f78d06a1619 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:42.462527 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-38b59f18-cb81-4113-a155-2f78d06a1619 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab" status: 200 len: 1469 microversion: 2.1 time: 0.393625 Oct 27 03:24:42.463559 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 633/1219] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:42 2022] GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab => generated 1469 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:24:42.478883 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-28c747fe-9a6a-44a6-8539-8eb46f46c37e tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:42.479894 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-28c747fe-9a6a-44a6-8539-8eb46f46c37e tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: c23b6c42-df64-4fab-9a29-ba638027a163] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:42.486491 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-28c747fe-9a6a-44a6-8539-8eb46f46c37e tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:42.486986 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-28c747fe-9a6a-44a6-8539-8eb46f46c37e tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:42.487335 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-55f8f94f-cc7d-4a3a-b5a9-1493cf57e5d0 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:42.487564 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-28c747fe-9a6a-44a6-8539-8eb46f46c37e tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:42.488524 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-28c747fe-9a6a-44a6-8539-8eb46f46c37e tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:42.488986 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-28c747fe-9a6a-44a6-8539-8eb46f46c37e tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:42.489643 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-28c747fe-9a6a-44a6-8539-8eb46f46c37e tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:42.496546 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-55f8f94f-cc7d-4a3a-b5a9-1493cf57e5d0 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/33d5c62a-898f-441b-a1a1-3cb12836755d" status: 200 len: 1260 microversion: 2.1 time: 0.150054 Oct 27 03:24:42.506163 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 587/1220] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:42 2022] GET /compute/v2.1/servers/33d5c62a-898f-441b-a1a1-3cb12836755d => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:42.512741 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8ce83a1b-41c8-4c6d-b546-292040dbdc09 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:42.512741 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8ce83a1b-41c8-4c6d-b546-292040dbdc09 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 8559e641-f41e-4b21-88b1-56d57ded5ce6] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:42.515284 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8ce83a1b-41c8-4c6d-b546-292040dbdc09 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:42.515777 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8ce83a1b-41c8-4c6d-b546-292040dbdc09 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:42.516218 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8ce83a1b-41c8-4c6d-b546-292040dbdc09 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:42.517514 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8ce83a1b-41c8-4c6d-b546-292040dbdc09 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:42.517975 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8ce83a1b-41c8-4c6d-b546-292040dbdc09 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:42.518452 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8ce83a1b-41c8-4c6d-b546-292040dbdc09 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:42.698076 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8ce83a1b-41c8-4c6d-b546-292040dbdc09 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:42.709062 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8ce83a1b-41c8-4c6d-b546-292040dbdc09 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:42.715064 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8ce83a1b-41c8-4c6d-b546-292040dbdc09 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:42.715064 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8ce83a1b-41c8-4c6d-b546-292040dbdc09 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/8559e641-f41e-4b21-88b1-56d57ded5ce6" status: 200 len: 1567 microversion: 2.25 time: 0.214023 Oct 27 03:24:42.715064 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 588/1221] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:42 2022] GET /compute/v2.1/servers/8559e641-f41e-4b21-88b1-56d57ded5ce6 => generated 1567 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:24:42.746298 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-28c747fe-9a6a-44a6-8539-8eb46f46c37e tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:42.754706 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-28c747fe-9a6a-44a6-8539-8eb46f46c37e tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/c23b6c42-df64-4fab-9a29-ba638027a163" status: 200 len: 1317 microversion: 2.1 time: 0.289316 Oct 27 03:24:42.755406 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 634/1222] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:42 2022] GET /compute/v2.1/servers/c23b6c42-df64-4fab-9a29-ba638027a163 => generated 1317 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:43.178283 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b59a207a-329b-4f6b-9de5-71f1f1997845 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:43.179463 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b59a207a-329b-4f6b-9de5-71f1f1997845 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: 543fdf60-10ec-4a25-a9d0-30c386efb104] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:43.189715 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b59a207a-329b-4f6b-9de5-71f1f1997845 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:43.189715 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b59a207a-329b-4f6b-9de5-71f1f1997845 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:43.189715 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b59a207a-329b-4f6b-9de5-71f1f1997845 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:43.189715 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b59a207a-329b-4f6b-9de5-71f1f1997845 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:43.190095 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b59a207a-329b-4f6b-9de5-71f1f1997845 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:43.190095 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b59a207a-329b-4f6b-9de5-71f1f1997845 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:43.343383 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b59a207a-329b-4f6b-9de5-71f1f1997845 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:43.352092 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b59a207a-329b-4f6b-9de5-71f1f1997845 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104" status: 200 len: 1360 microversion: 2.1 time: 0.177669 Oct 27 03:24:43.354086 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 589/1223] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:43 2022] GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104 => generated 1360 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:43.374250 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-eae2a106-db85-464c-be42-a4ae902c79ae tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:43.374957 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-eae2a106-db85-464c-be42-a4ae902c79ae tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] [instance: 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:43.382595 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eae2a106-db85-464c-be42-a4ae902c79ae tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:43.383127 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eae2a106-db85-464c-be42-a4ae902c79ae tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:43.383568 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eae2a106-db85-464c-be42-a4ae902c79ae tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:43.384275 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eae2a106-db85-464c-be42-a4ae902c79ae tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:43.384776 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eae2a106-db85-464c-be42-a4ae902c79ae tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:43.385202 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eae2a106-db85-464c-be42-a4ae902c79ae tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:43.457369 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-eae2a106-db85-464c-be42-a4ae902c79ae tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:43.466614 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-eae2a106-db85-464c-be42-a4ae902c79ae tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:43.468748 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-eae2a106-db85-464c-be42-a4ae902c79ae tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:43.473758 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-eae2a106-db85-464c-be42-a4ae902c79ae tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] 10.222.0.20 "GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503" status: 200 len: 1443 microversion: 2.75 time: 0.104350 Oct 27 03:24:43.475151 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 635/1224] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:43 2022] GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503 => generated 1443 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:24:43.486849 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-fb050f56-6ded-48c1-b93b-8e5a2a1b52ec tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:43.487487 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-fb050f56-6ded-48c1-b93b-8e5a2a1b52ec tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 77dd3d48-fede-491a-b6ce-5ad36a1d7cab] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:43.493316 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fb050f56-6ded-48c1-b93b-8e5a2a1b52ec tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:43.493800 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fb050f56-6ded-48c1-b93b-8e5a2a1b52ec tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:43.494274 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fb050f56-6ded-48c1-b93b-8e5a2a1b52ec tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:43.494969 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fb050f56-6ded-48c1-b93b-8e5a2a1b52ec tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:43.495429 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fb050f56-6ded-48c1-b93b-8e5a2a1b52ec tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:43.495851 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fb050f56-6ded-48c1-b93b-8e5a2a1b52ec tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:43.523281 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-62289c7f-468f-44aa-9826-b1fb1e0bd9ce tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:43.524074 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-62289c7f-468f-44aa-9826-b1fb1e0bd9ce tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 33d5c62a-898f-441b-a1a1-3cb12836755d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:43.530259 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-62289c7f-468f-44aa-9826-b1fb1e0bd9ce tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:43.530749 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-62289c7f-468f-44aa-9826-b1fb1e0bd9ce tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:43.531182 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-62289c7f-468f-44aa-9826-b1fb1e0bd9ce tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:43.532132 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-62289c7f-468f-44aa-9826-b1fb1e0bd9ce tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:43.533094 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-62289c7f-468f-44aa-9826-b1fb1e0bd9ce tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:43.533677 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-62289c7f-468f-44aa-9826-b1fb1e0bd9ce tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:43.617453 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-62289c7f-468f-44aa-9826-b1fb1e0bd9ce tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:43.625877 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-62289c7f-468f-44aa-9826-b1fb1e0bd9ce tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/33d5c62a-898f-441b-a1a1-3cb12836755d" status: 200 len: 1268 microversion: 2.1 time: 0.106736 Oct 27 03:24:43.626513 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 636/1225] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:43 2022] GET /compute/v2.1/servers/33d5c62a-898f-441b-a1a1-3cb12836755d => generated 1268 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:24:43.636006 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-fb050f56-6ded-48c1-b93b-8e5a2a1b52ec tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:43.644737 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-fb050f56-6ded-48c1-b93b-8e5a2a1b52ec tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab" status: 200 len: 1469 microversion: 2.1 time: 0.161811 Oct 27 03:24:43.645421 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 590/1226] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:43 2022] GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab => generated 1469 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:43.739258 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-35100174-efb5-4f21-9cdc-e3760d70a0da tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:43.739958 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-35100174-efb5-4f21-9cdc-e3760d70a0da tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 8559e641-f41e-4b21-88b1-56d57ded5ce6] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:43.746236 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-35100174-efb5-4f21-9cdc-e3760d70a0da tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:43.746756 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-35100174-efb5-4f21-9cdc-e3760d70a0da tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:43.747224 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-35100174-efb5-4f21-9cdc-e3760d70a0da tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:43.747929 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-35100174-efb5-4f21-9cdc-e3760d70a0da tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:43.748390 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-35100174-efb5-4f21-9cdc-e3760d70a0da tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:43.748870 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-35100174-efb5-4f21-9cdc-e3760d70a0da tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:43.784262 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c2805c9a-bce7-418a-96a0-c8526adf15a0 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:43.785006 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c2805c9a-bce7-418a-96a0-c8526adf15a0 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: c23b6c42-df64-4fab-9a29-ba638027a163] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:43.791747 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c2805c9a-bce7-418a-96a0-c8526adf15a0 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:43.792329 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c2805c9a-bce7-418a-96a0-c8526adf15a0 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:43.793019 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c2805c9a-bce7-418a-96a0-c8526adf15a0 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:43.793807 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c2805c9a-bce7-418a-96a0-c8526adf15a0 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:43.794495 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c2805c9a-bce7-418a-96a0-c8526adf15a0 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:43.795175 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c2805c9a-bce7-418a-96a0-c8526adf15a0 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:44.087179 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c2805c9a-bce7-418a-96a0-c8526adf15a0 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:44.101772 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c2805c9a-bce7-418a-96a0-c8526adf15a0 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/c23b6c42-df64-4fab-9a29-ba638027a163" status: 200 len: 1317 microversion: 2.1 time: 0.322438 Oct 27 03:24:44.103288 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 591/1227] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:43 2022] GET /compute/v2.1/servers/c23b6c42-df64-4fab-9a29-ba638027a163 => generated 1317 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:44.155793 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-35100174-efb5-4f21-9cdc-e3760d70a0da tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:44.179364 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-35100174-efb5-4f21-9cdc-e3760d70a0da tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:44.183253 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-35100174-efb5-4f21-9cdc-e3760d70a0da tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:44.191719 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-35100174-efb5-4f21-9cdc-e3760d70a0da tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/8559e641-f41e-4b21-88b1-56d57ded5ce6" status: 200 len: 1567 microversion: 2.25 time: 0.449336 Oct 27 03:24:44.193267 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 637/1228] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:43 2022] GET /compute/v2.1/servers/8559e641-f41e-4b21-88b1-56d57ded5ce6 => generated 1567 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:24:44.376398 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-df6a2461-21fe-4b80-8d72-3cc22ae04d1d tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:44.377125 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-df6a2461-21fe-4b80-8d72-3cc22ae04d1d tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: 543fdf60-10ec-4a25-a9d0-30c386efb104] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:44.385455 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-df6a2461-21fe-4b80-8d72-3cc22ae04d1d tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:44.386157 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-df6a2461-21fe-4b80-8d72-3cc22ae04d1d tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:44.408756 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-df6a2461-21fe-4b80-8d72-3cc22ae04d1d tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:44.412553 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-df6a2461-21fe-4b80-8d72-3cc22ae04d1d tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:44.414349 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-df6a2461-21fe-4b80-8d72-3cc22ae04d1d tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:44.416837 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-df6a2461-21fe-4b80-8d72-3cc22ae04d1d tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:44.502241 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4c8f26a1-f6c3-4784-8d8d-1431153ad22c tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:44.503102 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4c8f26a1-f6c3-4784-8d8d-1431153ad22c tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] [instance: 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:44.511411 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4c8f26a1-f6c3-4784-8d8d-1431153ad22c tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:44.511981 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4c8f26a1-f6c3-4784-8d8d-1431153ad22c tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:44.512490 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4c8f26a1-f6c3-4784-8d8d-1431153ad22c tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:44.513227 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4c8f26a1-f6c3-4784-8d8d-1431153ad22c tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:44.513692 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4c8f26a1-f6c3-4784-8d8d-1431153ad22c tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:44.514455 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4c8f26a1-f6c3-4784-8d8d-1431153ad22c tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:44.572746 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4c8f26a1-f6c3-4784-8d8d-1431153ad22c tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:44.574557 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4c8f26a1-f6c3-4784-8d8d-1431153ad22c tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:44.575121 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4c8f26a1-f6c3-4784-8d8d-1431153ad22c tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:44.575517 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-4c8f26a1-f6c3-4784-8d8d-1431153ad22c tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lazy-loading 'fault' on Instance uuid 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503 {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:24:44.640983 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-df6a2461-21fe-4b80-8d72-3cc22ae04d1d tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:44.650998 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4c8f26a1-f6c3-4784-8d8d-1431153ad22c tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:44.653304 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-df6a2461-21fe-4b80-8d72-3cc22ae04d1d tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104" status: 200 len: 1360 microversion: 2.1 time: 0.281330 Oct 27 03:24:44.654648 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 592/1229] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:44 2022] GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104 => generated 1360 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:44.660406 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a8c5f2c2-835e-40af-8989-47a93b1748cd tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:44.661368 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a8c5f2c2-835e-40af-8989-47a93b1748cd tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 33d5c62a-898f-441b-a1a1-3cb12836755d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:44.671257 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4c8f26a1-f6c3-4784-8d8d-1431153ad22c tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:44.671994 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a8c5f2c2-835e-40af-8989-47a93b1748cd tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:44.672277 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a8c5f2c2-835e-40af-8989-47a93b1748cd tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:44.673578 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a8c5f2c2-835e-40af-8989-47a93b1748cd tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:44.674677 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a8c5f2c2-835e-40af-8989-47a93b1748cd tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:44.675567 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a8c5f2c2-835e-40af-8989-47a93b1748cd tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:44.676292 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a8c5f2c2-835e-40af-8989-47a93b1748cd tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:44.676414 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4c8f26a1-f6c3-4784-8d8d-1431153ad22c tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:44.685134 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4c8f26a1-f6c3-4784-8d8d-1431153ad22c tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] 10.222.0.20 "GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503" status: 200 len: 1448 microversion: 2.75 time: 0.188147 Oct 27 03:24:44.697229 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 638/1230] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:44 2022] GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503 => generated 1448 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:24:44.711394 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-527a7c37-492d-4415-8abb-2b106cd01df4 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:44.714432 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-527a7c37-492d-4415-8abb-2b106cd01df4 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 77dd3d48-fede-491a-b6ce-5ad36a1d7cab] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:44.724500 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-527a7c37-492d-4415-8abb-2b106cd01df4 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:44.726898 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-527a7c37-492d-4415-8abb-2b106cd01df4 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:44.727999 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-527a7c37-492d-4415-8abb-2b106cd01df4 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:44.728937 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-527a7c37-492d-4415-8abb-2b106cd01df4 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:44.729558 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-527a7c37-492d-4415-8abb-2b106cd01df4 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:44.730327 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-527a7c37-492d-4415-8abb-2b106cd01df4 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:44.788701 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a8c5f2c2-835e-40af-8989-47a93b1748cd tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:44.812675 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a8c5f2c2-835e-40af-8989-47a93b1748cd tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/33d5c62a-898f-441b-a1a1-3cb12836755d" status: 200 len: 1266 microversion: 2.1 time: 0.154392 Oct 27 03:24:44.816367 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 593/1231] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:44 2022] GET /compute/v2.1/servers/33d5c62a-898f-441b-a1a1-3cb12836755d => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:44.991876 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-527a7c37-492d-4415-8abb-2b106cd01df4 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:45.005244 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-527a7c37-492d-4415-8abb-2b106cd01df4 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab" status: 200 len: 1469 microversion: 2.1 time: 0.302478 Oct 27 03:24:45.005244 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 639/1232] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:44 2022] GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab => generated 1469 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:45.125803 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-897820ab-03f6-4968-bad3-711615e27613 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:45.126461 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-897820ab-03f6-4968-bad3-711615e27613 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: c23b6c42-df64-4fab-9a29-ba638027a163] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:45.133771 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-897820ab-03f6-4968-bad3-711615e27613 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:45.134291 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-897820ab-03f6-4968-bad3-711615e27613 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:45.134737 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-897820ab-03f6-4968-bad3-711615e27613 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:45.143162 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-897820ab-03f6-4968-bad3-711615e27613 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:45.143985 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-897820ab-03f6-4968-bad3-711615e27613 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:45.146728 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-897820ab-03f6-4968-bad3-711615e27613 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:45.225372 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2502d8de-23c6-4a05-9a70-3c65a43b1b43 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:45.226675 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-2502d8de-23c6-4a05-9a70-3c65a43b1b43 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 8559e641-f41e-4b21-88b1-56d57ded5ce6] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:45.235709 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2502d8de-23c6-4a05-9a70-3c65a43b1b43 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:45.236784 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2502d8de-23c6-4a05-9a70-3c65a43b1b43 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:45.237344 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2502d8de-23c6-4a05-9a70-3c65a43b1b43 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:45.238176 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2502d8de-23c6-4a05-9a70-3c65a43b1b43 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:45.238725 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2502d8de-23c6-4a05-9a70-3c65a43b1b43 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:45.239365 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2502d8de-23c6-4a05-9a70-3c65a43b1b43 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:45.377459 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-897820ab-03f6-4968-bad3-711615e27613 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:45.388333 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-897820ab-03f6-4968-bad3-711615e27613 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/c23b6c42-df64-4fab-9a29-ba638027a163" status: 200 len: 1317 microversion: 2.1 time: 0.267411 Oct 27 03:24:45.393790 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 594/1233] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:45 2022] GET /compute/v2.1/servers/c23b6c42-df64-4fab-9a29-ba638027a163 => generated 1317 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:24:45.492937 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-1f3054ee-ad47-4d5b-a067-d99e0f0a0100 req-f8b2adf2-26aa-4583-abe9-abae6331f656 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c23b6c42-df64-4fab-9a29-ba638027a163", "name": "network-vif-plugged", "status": "completed", "tag": "c02998a4-ec7c-4865-b3b7-76a1f4abc2a9"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:24:45.504986 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-1f3054ee-ad47-4d5b-a067-d99e0f0a0100 req-f8b2adf2-26aa-4583-abe9-abae6331f656 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:45.505708 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-1f3054ee-ad47-4d5b-a067-d99e0f0a0100 req-f8b2adf2-26aa-4583-abe9-abae6331f656 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:45.506332 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-1f3054ee-ad47-4d5b-a067-d99e0f0a0100 req-f8b2adf2-26aa-4583-abe9-abae6331f656 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:45.511304 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2502d8de-23c6-4a05-9a70-3c65a43b1b43 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:45.522440 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-1f3054ee-ad47-4d5b-a067-d99e0f0a0100 req-f8b2adf2-26aa-4583-abe9-abae6331f656 service nova] Creating event network-vif-plugged:c02998a4-ec7c-4865-b3b7-76a1f4abc2a9 for instance c23b6c42-df64-4fab-9a29-ba638027a163 on n-h2-862769-1 Oct 27 03:24:45.525590 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2502d8de-23c6-4a05-9a70-3c65a43b1b43 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:45.527412 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2502d8de-23c6-4a05-9a70-3c65a43b1b43 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:45.528603 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2502d8de-23c6-4a05-9a70-3c65a43b1b43 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/8559e641-f41e-4b21-88b1-56d57ded5ce6" status: 200 len: 1567 microversion: 2.25 time: 0.312128 Oct 27 03:24:45.528864 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-1f3054ee-ad47-4d5b-a067-d99e0f0a0100 req-f8b2adf2-26aa-4583-abe9-abae6331f656 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039721 Oct 27 03:24:45.529158 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 640/1234] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:45 2022] GET /compute/v2.1/servers/8559e641-f41e-4b21-88b1-56d57ded5ce6 => generated 1567 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:24:45.530712 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 595/1235] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:24:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:24:45.658569 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-936f2853-36fa-4638-9709-00a383e9f206 req-5e09b9cc-07f9-445e-97cc-7d5ea99d94a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "543fdf60-10ec-4a25-a9d0-30c386efb104", "tag": "d7e171e9-cc70-4509-97bd-e3890c3c8411"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:24:45.680492 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5aa73af2-4a2d-4d58-82b3-793d490c0ec8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:45.681395 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5aa73af2-4a2d-4d58-82b3-793d490c0ec8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: 543fdf60-10ec-4a25-a9d0-30c386efb104] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:45.698977 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-936f2853-36fa-4638-9709-00a383e9f206 req-5e09b9cc-07f9-445e-97cc-7d5ea99d94a7 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:45.698977 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-936f2853-36fa-4638-9709-00a383e9f206 req-5e09b9cc-07f9-445e-97cc-7d5ea99d94a7 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:45.701203 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-936f2853-36fa-4638-9709-00a383e9f206 req-5e09b9cc-07f9-445e-97cc-7d5ea99d94a7 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:45.713201 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5aa73af2-4a2d-4d58-82b3-793d490c0ec8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:45.717202 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5aa73af2-4a2d-4d58-82b3-793d490c0ec8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:45.718322 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5aa73af2-4a2d-4d58-82b3-793d490c0ec8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:45.722080 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5aa73af2-4a2d-4d58-82b3-793d490c0ec8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:45.722080 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5aa73af2-4a2d-4d58-82b3-793d490c0ec8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:45.722080 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5aa73af2-4a2d-4d58-82b3-793d490c0ec8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:45.743389 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-936f2853-36fa-4638-9709-00a383e9f206 req-5e09b9cc-07f9-445e-97cc-7d5ea99d94a7 service nova] Creating event network-changed:d7e171e9-cc70-4509-97bd-e3890c3c8411 for instance 543fdf60-10ec-4a25-a9d0-30c386efb104 on n-h2-862769-1 Oct 27 03:24:45.785945 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-936f2853-36fa-4638-9709-00a383e9f206 req-5e09b9cc-07f9-445e-97cc-7d5ea99d94a7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143912 Oct 27 03:24:45.792635 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 641/1236] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:24:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:24:45.822055 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-616cbe96-6bb1-4f2f-9d1a-d13e4bd5963a tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:45.825005 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-616cbe96-6bb1-4f2f-9d1a-d13e4bd5963a tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] [instance: 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:45.837689 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:24:45.853362 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-616cbe96-6bb1-4f2f-9d1a-d13e4bd5963a tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:45.856789 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-616cbe96-6bb1-4f2f-9d1a-d13e4bd5963a tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:45.857429 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-616cbe96-6bb1-4f2f-9d1a-d13e4bd5963a tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:45.858682 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-616cbe96-6bb1-4f2f-9d1a-d13e4bd5963a tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:45.861750 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-616cbe96-6bb1-4f2f-9d1a-d13e4bd5963a tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:45.863172 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-616cbe96-6bb1-4f2f-9d1a-d13e4bd5963a tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:45.897685 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=100 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:24:45.915296 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-616cbe96-6bb1-4f2f-9d1a-d13e4bd5963a tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:45.917881 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-616cbe96-6bb1-4f2f-9d1a-d13e4bd5963a tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:45.918549 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-616cbe96-6bb1-4f2f-9d1a-d13e4bd5963a tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:45.919202 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-616cbe96-6bb1-4f2f-9d1a-d13e4bd5963a tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lazy-loading 'fault' on Instance uuid 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503 {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:24:45.991387 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-616cbe96-6bb1-4f2f-9d1a-d13e4bd5963a tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:45.999082 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5aa73af2-4a2d-4d58-82b3-793d490c0ec8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:45.999936 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-616cbe96-6bb1-4f2f-9d1a-d13e4bd5963a tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:46.001972 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-616cbe96-6bb1-4f2f-9d1a-d13e4bd5963a tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:46.009477 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-616cbe96-6bb1-4f2f-9d1a-d13e4bd5963a tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] 10.222.0.20 "GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503" status: 200 len: 1448 microversion: 2.75 time: 0.212611 Oct 27 03:24:46.010882 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 642/1237] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:45 2022] GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503 => generated 1448 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:24:46.014416 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5aa73af2-4a2d-4d58-82b3-793d490c0ec8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104" status: 200 len: 1360 microversion: 2.1 time: 0.340483 Oct 27 03:24:46.018507 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 596/1238] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:45 2022] GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104 => generated 1360 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:24:46.018618 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-83900cbd-823c-4662-a29c-0c0bd9587b85 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:46.018618 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-83900cbd-823c-4662-a29c-0c0bd9587b85 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 33d5c62a-898f-441b-a1a1-3cb12836755d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:46.023334 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-83900cbd-823c-4662-a29c-0c0bd9587b85 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:46.024174 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-83900cbd-823c-4662-a29c-0c0bd9587b85 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:46.024799 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-83900cbd-823c-4662-a29c-0c0bd9587b85 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:46.025673 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-83900cbd-823c-4662-a29c-0c0bd9587b85 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:46.026317 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-83900cbd-823c-4662-a29c-0c0bd9587b85 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:46.026940 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-83900cbd-823c-4662-a29c-0c0bd9587b85 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:46.032995 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3b398354-2bec-40c1-9373-c59b29822f5a tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:46.035770 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3b398354-2bec-40c1-9373-c59b29822f5a tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 77dd3d48-fede-491a-b6ce-5ad36a1d7cab] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:46.067726 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3b398354-2bec-40c1-9373-c59b29822f5a tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:46.068633 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3b398354-2bec-40c1-9373-c59b29822f5a tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:46.069246 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3b398354-2bec-40c1-9373-c59b29822f5a tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:46.070790 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3b398354-2bec-40c1-9373-c59b29822f5a tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:46.071568 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3b398354-2bec-40c1-9373-c59b29822f5a tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:46.072154 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3b398354-2bec-40c1-9373-c59b29822f5a tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:46.265515 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3b398354-2bec-40c1-9373-c59b29822f5a tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:46.274413 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3b398354-2bec-40c1-9373-c59b29822f5a tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab" status: 200 len: 1535 microversion: 2.1 time: 0.250768 Oct 27 03:24:46.274997 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 597/1239] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:46 2022] GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab => generated 1535 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:46.418719 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ca9df9e2-da8b-478a-953c-26c483c2ddab tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:46.419574 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ca9df9e2-da8b-478a-953c-26c483c2ddab tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: c23b6c42-df64-4fab-9a29-ba638027a163] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:46.432907 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ca9df9e2-da8b-478a-953c-26c483c2ddab tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:46.433664 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ca9df9e2-da8b-478a-953c-26c483c2ddab tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:46.434148 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ca9df9e2-da8b-478a-953c-26c483c2ddab tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:46.434865 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ca9df9e2-da8b-478a-953c-26c483c2ddab tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:46.435380 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ca9df9e2-da8b-478a-953c-26c483c2ddab tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:46.435813 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ca9df9e2-da8b-478a-953c-26c483c2ddab tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:46.580209 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ca9df9e2-da8b-478a-953c-26c483c2ddab tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:46.583879 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=100 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:24:46.588420 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ca9df9e2-da8b-478a-953c-26c483c2ddab tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/c23b6c42-df64-4fab-9a29-ba638027a163" status: 200 len: 1317 microversion: 2.1 time: 0.174035 Oct 27 03:24:46.589009 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 598/1240] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:46 2022] GET /compute/v2.1/servers/c23b6c42-df64-4fab-9a29-ba638027a163 => generated 1317 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:24:46.606962 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-83900cbd-823c-4662-a29c-0c0bd9587b85 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:46.616477 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-83900cbd-823c-4662-a29c-0c0bd9587b85 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/33d5c62a-898f-441b-a1a1-3cb12836755d" status: 200 len: 1308 microversion: 2.1 time: 0.604297 Oct 27 03:24:46.628529 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 643/1241] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:46 2022] GET /compute/v2.1/servers/33d5c62a-898f-441b-a1a1-3cb12836755d => generated 1308 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:46.628529 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8ee0775e-206c-44f5-aee1-6bcc0ed78677 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:46.628529 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8ee0775e-206c-44f5-aee1-6bcc0ed78677 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 8559e641-f41e-4b21-88b1-56d57ded5ce6] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:46.629201 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8ee0775e-206c-44f5-aee1-6bcc0ed78677 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:46.629787 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8ee0775e-206c-44f5-aee1-6bcc0ed78677 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:46.630656 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8ee0775e-206c-44f5-aee1-6bcc0ed78677 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:46.631730 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8ee0775e-206c-44f5-aee1-6bcc0ed78677 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:46.632399 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8ee0775e-206c-44f5-aee1-6bcc0ed78677 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:46.633035 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8ee0775e-206c-44f5-aee1-6bcc0ed78677 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:46.773357 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-64aebc42-a5fd-47f2-8ad5-e891cb608e08 tempest-ServicesAdminTestJSON-763589402 tempest-ServicesAdminTestJSON-763589402-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:46.777148 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-64aebc42-a5fd-47f2-8ad5-e891cb608e08 tempest-ServicesAdminTestJSON-763589402 tempest-ServicesAdminTestJSON-763589402-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:46.777848 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-64aebc42-a5fd-47f2-8ad5-e891cb608e08 tempest-ServicesAdminTestJSON-763589402 tempest-ServicesAdminTestJSON-763589402-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:46.778332 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-64aebc42-a5fd-47f2-8ad5-e891cb608e08 tempest-ServicesAdminTestJSON-763589402 tempest-ServicesAdminTestJSON-763589402-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:46.779080 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-64aebc42-a5fd-47f2-8ad5-e891cb608e08 tempest-ServicesAdminTestJSON-763589402 tempest-ServicesAdminTestJSON-763589402-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:46.779539 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-64aebc42-a5fd-47f2-8ad5-e891cb608e08 tempest-ServicesAdminTestJSON-763589402 tempest-ServicesAdminTestJSON-763589402-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:46.779971 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-64aebc42-a5fd-47f2-8ad5-e891cb608e08 tempest-ServicesAdminTestJSON-763589402 tempest-ServicesAdminTestJSON-763589402-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:46.808741 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-64aebc42-a5fd-47f2-8ad5-e891cb608e08 tempest-ServicesAdminTestJSON-763589402 tempest-ServicesAdminTestJSON-763589402-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.211942 Oct 27 03:24:46.809643 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 599/1242] 10.222.0.20 () {58 vars in 1137 bytes} [Thu Oct 27 03:24:46 2022] GET /compute/v2.1/os-services => generated 944 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:24:46.822196 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5041c845-1faf-421f-92b2-fc5c38987f17 tempest-ServicesAdminTestJSON-763589402 tempest-ServicesAdminTestJSON-763589402-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:46.826065 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5041c845-1faf-421f-92b2-fc5c38987f17 tempest-ServicesAdminTestJSON-763589402 tempest-ServicesAdminTestJSON-763589402-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:46.826592 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5041c845-1faf-421f-92b2-fc5c38987f17 tempest-ServicesAdminTestJSON-763589402 tempest-ServicesAdminTestJSON-763589402-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:46.827047 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5041c845-1faf-421f-92b2-fc5c38987f17 tempest-ServicesAdminTestJSON-763589402 tempest-ServicesAdminTestJSON-763589402-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:46.827789 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5041c845-1faf-421f-92b2-fc5c38987f17 tempest-ServicesAdminTestJSON-763589402 tempest-ServicesAdminTestJSON-763589402-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:46.828250 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5041c845-1faf-421f-92b2-fc5c38987f17 tempest-ServicesAdminTestJSON-763589402 tempest-ServicesAdminTestJSON-763589402-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:46.828859 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5041c845-1faf-421f-92b2-fc5c38987f17 tempest-ServicesAdminTestJSON-763589402 tempest-ServicesAdminTestJSON-763589402-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:46.863352 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5041c845-1faf-421f-92b2-fc5c38987f17 tempest-ServicesAdminTestJSON-763589402 tempest-ServicesAdminTestJSON-763589402-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?host=n-d-862769-1" status: 200 len: 578 microversion: 2.1 time: 0.045188 Oct 27 03:24:46.865150 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 600/1243] 10.222.0.20 () {58 vars in 1172 bytes} [Thu Oct 27 03:24:46 2022] GET /compute/v2.1/os-services?host=n-d-862769-1 => generated 578 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:24:46.880734 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-05676ee0-12f4-4d0b-9dc9-f00f1c0cffd0 tempest-ServicesAdminTestJSON-763589402 tempest-ServicesAdminTestJSON-763589402-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:46.884580 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-05676ee0-12f4-4d0b-9dc9-f00f1c0cffd0 tempest-ServicesAdminTestJSON-763589402 tempest-ServicesAdminTestJSON-763589402-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:46.885327 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-05676ee0-12f4-4d0b-9dc9-f00f1c0cffd0 tempest-ServicesAdminTestJSON-763589402 tempest-ServicesAdminTestJSON-763589402-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:46.885996 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-05676ee0-12f4-4d0b-9dc9-f00f1c0cffd0 tempest-ServicesAdminTestJSON-763589402 tempest-ServicesAdminTestJSON-763589402-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:46.886860 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-05676ee0-12f4-4d0b-9dc9-f00f1c0cffd0 tempest-ServicesAdminTestJSON-763589402 tempest-ServicesAdminTestJSON-763589402-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:46.887510 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-05676ee0-12f4-4d0b-9dc9-f00f1c0cffd0 tempest-ServicesAdminTestJSON-763589402 tempest-ServicesAdminTestJSON-763589402-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:46.887944 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-05676ee0-12f4-4d0b-9dc9-f00f1c0cffd0 tempest-ServicesAdminTestJSON-763589402 tempest-ServicesAdminTestJSON-763589402-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:46.915400 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-05676ee0-12f4-4d0b-9dc9-f00f1c0cffd0 tempest-ServicesAdminTestJSON-763589402 tempest-ServicesAdminTestJSON-763589402-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.039223 Oct 27 03:24:46.916203 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 601/1244] 10.222.0.20 () {58 vars in 1176 bytes} [Thu Oct 27 03:24:46 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:24:46.933403 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-fb04c74f-0488-426f-baab-e0e10770871e tempest-ServicesAdminTestJSON-763589402 tempest-ServicesAdminTestJSON-763589402-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:46.938970 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fb04c74f-0488-426f-baab-e0e10770871e tempest-ServicesAdminTestJSON-763589402 tempest-ServicesAdminTestJSON-763589402-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:46.940226 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fb04c74f-0488-426f-baab-e0e10770871e tempest-ServicesAdminTestJSON-763589402 tempest-ServicesAdminTestJSON-763589402-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:46.942873 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fb04c74f-0488-426f-baab-e0e10770871e tempest-ServicesAdminTestJSON-763589402 tempest-ServicesAdminTestJSON-763589402-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:46.944187 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fb04c74f-0488-426f-baab-e0e10770871e tempest-ServicesAdminTestJSON-763589402 tempest-ServicesAdminTestJSON-763589402-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:46.945740 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fb04c74f-0488-426f-baab-e0e10770871e tempest-ServicesAdminTestJSON-763589402 tempest-ServicesAdminTestJSON-763589402-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:46.946417 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fb04c74f-0488-426f-baab-e0e10770871e tempest-ServicesAdminTestJSON-763589402 tempest-ServicesAdminTestJSON-763589402-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:46.966879 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8ee0775e-206c-44f5-aee1-6bcc0ed78677 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:46.977665 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8ee0775e-206c-44f5-aee1-6bcc0ed78677 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:46.979658 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8ee0775e-206c-44f5-aee1-6bcc0ed78677 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:46.980897 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-fb04c74f-0488-426f-baab-e0e10770871e tempest-ServicesAdminTestJSON-763589402 tempest-ServicesAdminTestJSON-763589402-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.055170 Oct 27 03:24:46.981500 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8ee0775e-206c-44f5-aee1-6bcc0ed78677 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/8559e641-f41e-4b21-88b1-56d57ded5ce6" status: 200 len: 1567 microversion: 2.25 time: 0.362604 Oct 27 03:24:46.994137 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 602/1245] 10.222.0.20 () {58 vars in 1137 bytes} [Thu Oct 27 03:24:46 2022] GET /compute/v2.1/os-services => generated 944 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:24:47.000024 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 644/1246] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:46 2022] GET /compute/v2.1/servers/8559e641-f41e-4b21-88b1-56d57ded5ce6 => generated 1567 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:24:47.040663 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a6374c63-6919-4077-9582-bc0e4a6c48a3 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:47.041747 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a6374c63-6919-4077-9582-bc0e4a6c48a3 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] [instance: 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:47.042552 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-62c44cb5-fa33-47dd-be06-4ff0e00a2278 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:47.043369 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-62c44cb5-fa33-47dd-be06-4ff0e00a2278 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: 543fdf60-10ec-4a25-a9d0-30c386efb104] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:47.051604 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a6374c63-6919-4077-9582-bc0e4a6c48a3 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:47.052439 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a6374c63-6919-4077-9582-bc0e4a6c48a3 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:47.053443 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a6374c63-6919-4077-9582-bc0e4a6c48a3 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:47.055898 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-62c44cb5-fa33-47dd-be06-4ff0e00a2278 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:47.056251 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a6374c63-6919-4077-9582-bc0e4a6c48a3 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:47.056627 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-62c44cb5-fa33-47dd-be06-4ff0e00a2278 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:47.057083 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-62c44cb5-fa33-47dd-be06-4ff0e00a2278 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:47.057568 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a6374c63-6919-4077-9582-bc0e4a6c48a3 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:47.057819 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-62c44cb5-fa33-47dd-be06-4ff0e00a2278 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:47.058619 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a6374c63-6919-4077-9582-bc0e4a6c48a3 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:47.059166 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-62c44cb5-fa33-47dd-be06-4ff0e00a2278 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:47.059609 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-62c44cb5-fa33-47dd-be06-4ff0e00a2278 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:47.158222 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a6374c63-6919-4077-9582-bc0e4a6c48a3 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:47.159166 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a6374c63-6919-4077-9582-bc0e4a6c48a3 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:47.159946 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a6374c63-6919-4077-9582-bc0e4a6c48a3 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:47.160520 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-a6374c63-6919-4077-9582-bc0e4a6c48a3 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lazy-loading 'fault' on Instance uuid 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503 {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:24:47.262689 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a6374c63-6919-4077-9582-bc0e4a6c48a3 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:47.277398 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a6374c63-6919-4077-9582-bc0e4a6c48a3 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:47.279872 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a6374c63-6919-4077-9582-bc0e4a6c48a3 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a50a0c4308064b25a67182b77431087b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78742a1d089f4aa2985fc7060d5e7cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:47.287157 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a6374c63-6919-4077-9582-bc0e4a6c48a3 tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] 10.222.0.20 "GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503" status: 200 len: 1448 microversion: 2.75 time: 0.252806 Oct 27 03:24:47.302734 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 603/1247] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:47 2022] GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503 => generated 1448 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:24:47.302734 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a56677ee-9638-4a8d-ab6e-f182195eb246 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:47.309678 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a56677ee-9638-4a8d-ab6e-f182195eb246 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 77dd3d48-fede-491a-b6ce-5ad36a1d7cab] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:47.312116 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a56677ee-9638-4a8d-ab6e-f182195eb246 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:47.312936 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a56677ee-9638-4a8d-ab6e-f182195eb246 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:47.313280 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a56677ee-9638-4a8d-ab6e-f182195eb246 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:47.317109 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a56677ee-9638-4a8d-ab6e-f182195eb246 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:47.319414 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a56677ee-9638-4a8d-ab6e-f182195eb246 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:47.319414 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a56677ee-9638-4a8d-ab6e-f182195eb246 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:47.448455 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-62c44cb5-fa33-47dd-be06-4ff0e00a2278 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:47.453256 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=3 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:24:47.470131 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-62c44cb5-fa33-47dd-be06-4ff0e00a2278 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104" status: 200 len: 1360 microversion: 2.1 time: 0.431827 Oct 27 03:24:47.471179 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 645/1248] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:47 2022] GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104 => generated 1360 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:47.550008 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-ba5dc5b0-9fda-4109-aa3a-8a5a2a7e77b7 req-1aaf352e-5910-4f02-8661-50faf8cee8f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77dd3d48-fede-491a-b6ce-5ad36a1d7cab", "name": "network-vif-unplugged", "status": "completed", "tag": "a67227e9-dd6a-4cad-96f1-1d8b74514779"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:24:47.561229 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-ba5dc5b0-9fda-4109-aa3a-8a5a2a7e77b7 req-1aaf352e-5910-4f02-8661-50faf8cee8f2 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:47.561737 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-ba5dc5b0-9fda-4109-aa3a-8a5a2a7e77b7 req-1aaf352e-5910-4f02-8661-50faf8cee8f2 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:47.565545 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-ba5dc5b0-9fda-4109-aa3a-8a5a2a7e77b7 req-1aaf352e-5910-4f02-8661-50faf8cee8f2 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:47.584679 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-ba5dc5b0-9fda-4109-aa3a-8a5a2a7e77b7 req-1aaf352e-5910-4f02-8661-50faf8cee8f2 service nova] Creating event network-vif-unplugged:a67227e9-dd6a-4cad-96f1-1d8b74514779 for instance 77dd3d48-fede-491a-b6ce-5ad36a1d7cab on n-h2-862769-1 Oct 27 03:24:47.592416 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [req-ba5dc5b0-9fda-4109-aa3a-8a5a2a7e77b7 req-1aaf352e-5910-4f02-8661-50faf8cee8f2 service nova] Instance 77dd3d48-fede-491a-b6ce-5ad36a1d7cab is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862769-1'} {{(pid=121000) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 03:24:47.603502 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-ba5dc5b0-9fda-4109-aa3a-8a5a2a7e77b7 req-1aaf352e-5910-4f02-8661-50faf8cee8f2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059226 Oct 27 03:24:47.612437 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 646/1249] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:24:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:24:47.619672 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-61313ea6-8492-4d86-9ee6-0e928aef9cc4 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:47.620716 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-61313ea6-8492-4d86-9ee6-0e928aef9cc4 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: c23b6c42-df64-4fab-9a29-ba638027a163] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:47.631319 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-61313ea6-8492-4d86-9ee6-0e928aef9cc4 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:47.631319 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-61313ea6-8492-4d86-9ee6-0e928aef9cc4 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:47.631319 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-61313ea6-8492-4d86-9ee6-0e928aef9cc4 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:47.635900 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-61313ea6-8492-4d86-9ee6-0e928aef9cc4 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:47.635900 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-61313ea6-8492-4d86-9ee6-0e928aef9cc4 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:47.635900 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-61313ea6-8492-4d86-9ee6-0e928aef9cc4 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:47.714675 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a56677ee-9638-4a8d-ab6e-f182195eb246 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:47.722495 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a56677ee-9638-4a8d-ab6e-f182195eb246 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab" status: 200 len: 1535 microversion: 2.1 time: 0.426410 Oct 27 03:24:47.723184 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 604/1250] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:47 2022] GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab => generated 1535 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:47.728649 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8a4f5ee5-b9a8-41e8-a20b-aef8a572e45e tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:47.730238 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8a4f5ee5-b9a8-41e8-a20b-aef8a572e45e tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 33d5c62a-898f-441b-a1a1-3cb12836755d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:47.736181 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=28 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:24:47.744327 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8a4f5ee5-b9a8-41e8-a20b-aef8a572e45e tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:47.744327 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8a4f5ee5-b9a8-41e8-a20b-aef8a572e45e tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:47.744327 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8a4f5ee5-b9a8-41e8-a20b-aef8a572e45e tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:47.744327 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8a4f5ee5-b9a8-41e8-a20b-aef8a572e45e tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:47.744794 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8a4f5ee5-b9a8-41e8-a20b-aef8a572e45e tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:47.747084 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8a4f5ee5-b9a8-41e8-a20b-aef8a572e45e tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:48.018685 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-61313ea6-8492-4d86-9ee6-0e928aef9cc4 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:48.029673 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-61313ea6-8492-4d86-9ee6-0e928aef9cc4 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/c23b6c42-df64-4fab-9a29-ba638027a163" status: 200 len: 1466 microversion: 2.1 time: 0.414289 Oct 27 03:24:48.030725 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 647/1251] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:47 2022] GET /compute/v2.1/servers/c23b6c42-df64-4fab-9a29-ba638027a163 => generated 1466 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:48.036238 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-ef4a0ce6-0fa8-4890-a5ec-6489a1f12801 req-0e55949d-75ff-4861-b124-27ce9ad63ae0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33d5c62a-898f-441b-a1a1-3cb12836755d", "tag": "0fee4f52-9d23-48f3-b849-8399851e00ed"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:24:48.047344 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-ef4a0ce6-0fa8-4890-a5ec-6489a1f12801 req-0e55949d-75ff-4861-b124-27ce9ad63ae0 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:48.055374 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-ef4a0ce6-0fa8-4890-a5ec-6489a1f12801 req-0e55949d-75ff-4861-b124-27ce9ad63ae0 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:48.055374 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-ef4a0ce6-0fa8-4890-a5ec-6489a1f12801 req-0e55949d-75ff-4861-b124-27ce9ad63ae0 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:48.067350 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-ef4a0ce6-0fa8-4890-a5ec-6489a1f12801 req-0e55949d-75ff-4861-b124-27ce9ad63ae0 service nova] Creating event network-changed:0fee4f52-9d23-48f3-b849-8399851e00ed for instance 33d5c62a-898f-441b-a1a1-3cb12836755d on n-h2-862769-1 Oct 27 03:24:48.073097 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-ef4a0ce6-0fa8-4890-a5ec-6489a1f12801 req-0e55949d-75ff-4861-b124-27ce9ad63ae0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040860 Oct 27 03:24:48.074612 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 648/1252] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:24:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:24:48.081348 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2ce77acd-9992-4861-9069-50918cc541f3 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:48.082665 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-2ce77acd-9992-4861-9069-50918cc541f3 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 8559e641-f41e-4b21-88b1-56d57ded5ce6] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:48.090135 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2ce77acd-9992-4861-9069-50918cc541f3 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:48.090927 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2ce77acd-9992-4861-9069-50918cc541f3 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:48.091625 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2ce77acd-9992-4861-9069-50918cc541f3 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:48.092564 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2ce77acd-9992-4861-9069-50918cc541f3 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:48.093401 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2ce77acd-9992-4861-9069-50918cc541f3 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:48.093847 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2ce77acd-9992-4861-9069-50918cc541f3 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:48.296129 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2ce77acd-9992-4861-9069-50918cc541f3 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:48.306095 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2ce77acd-9992-4861-9069-50918cc541f3 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:48.309189 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8a4f5ee5-b9a8-41e8-a20b-aef8a572e45e tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:48.319296 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2ce77acd-9992-4861-9069-50918cc541f3 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:48.324471 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2ce77acd-9992-4861-9069-50918cc541f3 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/8559e641-f41e-4b21-88b1-56d57ded5ce6" status: 200 len: 1567 microversion: 2.25 time: 0.248255 Oct 27 03:24:48.324641 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8a4f5ee5-b9a8-41e8-a20b-aef8a572e45e tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/33d5c62a-898f-441b-a1a1-3cb12836755d" status: 200 len: 1308 microversion: 2.1 time: 0.599321 Oct 27 03:24:48.334067 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 605/1253] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:47 2022] GET /compute/v2.1/servers/33d5c62a-898f-441b-a1a1-3cb12836755d => generated 1308 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:48.334259 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 649/1254] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:48 2022] GET /compute/v2.1/servers/8559e641-f41e-4b21-88b1-56d57ded5ce6 => generated 1567 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:24:48.334386 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-958cbd81-f50c-4260-96db-224bac1e615a tempest-ServersOnMultiNodesTest-1789564933 tempest-ServersOnMultiNodesTest-1789564933-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:48.334386 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-958cbd81-f50c-4260-96db-224bac1e615a tempest-ServersOnMultiNodesTest-1789564933 tempest-ServersOnMultiNodesTest-1789564933-project-admin] [instance: c23b6c42-df64-4fab-9a29-ba638027a163] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:48.334566 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ffad39d7-b4b6-47f3-a113-abea910422ce tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:48.335981 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ffad39d7-b4b6-47f3-a113-abea910422ce tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] [instance: 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:48.336766 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-958cbd81-f50c-4260-96db-224bac1e615a tempest-ServersOnMultiNodesTest-1789564933 tempest-ServersOnMultiNodesTest-1789564933-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:48.338012 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-958cbd81-f50c-4260-96db-224bac1e615a tempest-ServersOnMultiNodesTest-1789564933 tempest-ServersOnMultiNodesTest-1789564933-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:48.348187 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-958cbd81-f50c-4260-96db-224bac1e615a tempest-ServersOnMultiNodesTest-1789564933 tempest-ServersOnMultiNodesTest-1789564933-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:48.348187 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-958cbd81-f50c-4260-96db-224bac1e615a tempest-ServersOnMultiNodesTest-1789564933 tempest-ServersOnMultiNodesTest-1789564933-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:48.348187 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-958cbd81-f50c-4260-96db-224bac1e615a tempest-ServersOnMultiNodesTest-1789564933 tempest-ServersOnMultiNodesTest-1789564933-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:48.348187 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-958cbd81-f50c-4260-96db-224bac1e615a tempest-ServersOnMultiNodesTest-1789564933 tempest-ServersOnMultiNodesTest-1789564933-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:48.354922 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ffad39d7-b4b6-47f3-a113-abea910422ce tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:48.355637 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ffad39d7-b4b6-47f3-a113-abea910422ce tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:48.356295 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ffad39d7-b4b6-47f3-a113-abea910422ce tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:48.357214 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ffad39d7-b4b6-47f3-a113-abea910422ce tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:48.357685 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ffad39d7-b4b6-47f3-a113-abea910422ce tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:48.358156 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ffad39d7-b4b6-47f3-a113-abea910422ce tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:48.379586 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-ffad39d7-b4b6-47f3-a113-abea910422ce tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] HTTP exception thrown: Instance 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503 could not be found. Oct 27 03:24:48.381303 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ffad39d7-b4b6-47f3-a113-abea910422ce tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Request method failure captured: Oct 27 03:24:48.381303 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503 HTTP/1.1 Oct 27 03:24:48.381303 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:24:48.381303 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:24:48.381303 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:24:48.381303 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:24:48.381303 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:24:48.381303 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:24:48.381303 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:24:48.381303 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:24:48.381303 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfmn_NBVDhI_Q2GeVXGkL7jLONazC45R5W1Wi5FxQje_3YRTCQMVPFmh0dmT7oX-FWSA_PudfXB0Fw09EFzmjOvZEyeSFu0ZJF_KEWmRUAcuLreijxJ6lsOQQIqs9Rm7ALHJ4oO7zhvPiJbWKP-uxE_5PCaqmyfNcOpDkGUMFjhmYVI Oct 27 03:24:48.381303 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:24:48.381303 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:24:48.381303 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:24:48.381303 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:24:48.381303 n-d-862769-1 devstack@n-api.service[121000]: X-Openstack-Nova-Api-Version: 2.75 Oct 27 03:24:48.381303 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:24:48.381303 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:24:48.381303 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 78742a1d089f4aa2985fc7060d5e7cb9 Oct 27 03:24:48.381303 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ServersAdmin275Test-1787195175 Oct 27 03:24:48.381303 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:24:48.381303 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:24:48.382996 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/78742a1d089f4aa2985fc7060d5e7cb9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/78742a1d089f4aa2985fc7060d5e7cb9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/78742a1d089f4aa2985fc7060d5e7cb9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_78742a1d089f4aa2985fc7060d5e7cb9"}]}] Oct 27 03:24:48.382996 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ServersAdmin275Test-1787195175 Oct 27 03:24:48.382996 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 78742a1d089f4aa2985fc7060d5e7cb9 Oct 27 03:24:48.382996 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ServersAdmin275Test-1787195175 Oct 27 03:24:48.382996 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ServersAdmin275Test-1787195175-project Oct 27 03:24:48.382996 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:24:48.382996 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:24:48.382996 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: a50a0c4308064b25a67182b77431087b Oct 27 03:24:48.382996 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ServersAdmin275Test-1787195175-project Oct 27 03:24:48.382996 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:24:48.382996 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503 could not be found. Oct 27 03:24:48.382996 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '3081ee2b-4da6-45ad-8eda-3cbc9e0cc503'} Oct 27 03:24:48.383929 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:24:48.383929 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:24:48.383929 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:24:48.383929 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:24:48.383929 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:24:48.383929 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:24:48.383929 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:24:48.383929 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:24:48.383929 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:24:48.383929 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:24:48.383929 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503 could not be found. Oct 27 03:24:48.383929 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:24:48.383929 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:24:48.383929 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:24:48.383929 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:24:48.383929 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:24:48.383929 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:24:48.383929 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:24:48.383929 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:24:48.383929 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:24:48.386684 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:24:48.386684 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:24:48.386684 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:24:48.386684 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:24:48.386684 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:24:48.386684 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:24:48.386684 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:24:48.386684 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503 could not be found. Oct 27 03:24:48.386684 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:24:48.386684 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:24:48.386684 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:24:48.386684 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:24:48.386684 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:24:48.386684 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:24:48.386684 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:24:48.386684 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:24:48.386684 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503 could not be found. Oct 27 03:24:48.386684 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:24:48.388147 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ffad39d7-b4b6-47f3-a113-abea910422ce tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] Returning 404 to user: Instance 3081ee2b-4da6-45ad-8eda-3cbc9e0cc503 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:24:48.388147 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ffad39d7-b4b6-47f3-a113-abea910422ce tempest-ServersAdmin275Test-1787195175 tempest-ServersAdmin275Test-1787195175-project] 10.222.0.20 "GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503" status: 404 len: 111 microversion: 2.75 time: 0.055472 Oct 27 03:24:48.388147 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 650/1255] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:48 2022] GET /compute/v2.1/servers/3081ee2b-4da6-45ad-8eda-3cbc9e0cc503 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 03:24:48.495721 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-89213f52-88db-425e-baa8-c6d4d7f1c700 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:48.496487 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-89213f52-88db-425e-baa8-c6d4d7f1c700 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: 543fdf60-10ec-4a25-a9d0-30c386efb104] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:48.497287 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-958cbd81-f50c-4260-96db-224bac1e615a tempest-ServersOnMultiNodesTest-1789564933 tempest-ServersOnMultiNodesTest-1789564933-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/c23b6c42-df64-4fab-9a29-ba638027a163" status: 200 len: 1617 microversion: 2.1 time: 0.171004 Oct 27 03:24:48.497909 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 606/1256] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:48 2022] GET /compute/v2.1/servers/c23b6c42-df64-4fab-9a29-ba638027a163 => generated 1617 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:48.503659 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-89213f52-88db-425e-baa8-c6d4d7f1c700 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:48.504160 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-89213f52-88db-425e-baa8-c6d4d7f1c700 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:48.504631 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-89213f52-88db-425e-baa8-c6d4d7f1c700 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:48.505349 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-89213f52-88db-425e-baa8-c6d4d7f1c700 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:48.505808 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-89213f52-88db-425e-baa8-c6d4d7f1c700 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:48.506275 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-89213f52-88db-425e-baa8-c6d4d7f1c700 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:48.524111 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f3b735ec-8eaf-4e81-b961-c7e6a9e81b65 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:48.524628 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f3b735ec-8eaf-4e81-b961-c7e6a9e81b65 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: c23b6c42-df64-4fab-9a29-ba638027a163] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:48.544599 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f3b735ec-8eaf-4e81-b961-c7e6a9e81b65 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:48.545638 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f3b735ec-8eaf-4e81-b961-c7e6a9e81b65 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:48.547353 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f3b735ec-8eaf-4e81-b961-c7e6a9e81b65 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:48.548306 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f3b735ec-8eaf-4e81-b961-c7e6a9e81b65 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:48.549968 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f3b735ec-8eaf-4e81-b961-c7e6a9e81b65 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:48.550789 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f3b735ec-8eaf-4e81-b961-c7e6a9e81b65 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:48.585746 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f3b735ec-8eaf-4e81-b961-c7e6a9e81b65 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: c23b6c42-df64-4fab-9a29-ba638027a163] Going to try to terminate instance {{(pid=121001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:24:48.662566 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-89213f52-88db-425e-baa8-c6d4d7f1c700 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:48.672116 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-89213f52-88db-425e-baa8-c6d4d7f1c700 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104" status: 200 len: 1360 microversion: 2.1 time: 0.180881 Oct 27 03:24:48.672710 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 651/1257] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:48 2022] GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104 => generated 1360 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:48.759612 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ccc243f7-340d-4b96-b839-ccdcca260be4 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:48.760233 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ccc243f7-340d-4b96-b839-ccdcca260be4 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 77dd3d48-fede-491a-b6ce-5ad36a1d7cab] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:48.767106 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ccc243f7-340d-4b96-b839-ccdcca260be4 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:48.767601 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ccc243f7-340d-4b96-b839-ccdcca260be4 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:48.768061 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ccc243f7-340d-4b96-b839-ccdcca260be4 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:48.768779 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ccc243f7-340d-4b96-b839-ccdcca260be4 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:48.769237 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ccc243f7-340d-4b96-b839-ccdcca260be4 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:48.769670 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ccc243f7-340d-4b96-b839-ccdcca260be4 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:48.931747 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f3b735ec-8eaf-4e81-b961-c7e6a9e81b65 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c23b6c42-df64-4fab-9a29-ba638027a163" status: 204 len: 0 microversion: 2.1 time: 0.412099 Oct 27 03:24:48.933359 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 607/1258] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:24:48 2022] DELETE /compute/v2.1/servers/c23b6c42-df64-4fab-9a29-ba638027a163 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:24:48.934876 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ccc243f7-340d-4b96-b839-ccdcca260be4 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:48.944210 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-51475f8c-07ed-4df2-a2b7-2aa521ab10dd tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:48.945229 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ccc243f7-340d-4b96-b839-ccdcca260be4 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab" status: 200 len: 1535 microversion: 2.1 time: 0.189402 Oct 27 03:24:48.945370 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-51475f8c-07ed-4df2-a2b7-2aa521ab10dd tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: c23b6c42-df64-4fab-9a29-ba638027a163] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:48.946205 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 652/1259] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:48 2022] GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab => generated 1535 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:48.953871 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-51475f8c-07ed-4df2-a2b7-2aa521ab10dd tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:48.954582 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-51475f8c-07ed-4df2-a2b7-2aa521ab10dd tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:48.955217 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-51475f8c-07ed-4df2-a2b7-2aa521ab10dd tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:48.956100 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-51475f8c-07ed-4df2-a2b7-2aa521ab10dd tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:48.956553 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-51475f8c-07ed-4df2-a2b7-2aa521ab10dd tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:48.957711 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-51475f8c-07ed-4df2-a2b7-2aa521ab10dd tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:49.101974 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-51475f8c-07ed-4df2-a2b7-2aa521ab10dd tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:49.110178 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-51475f8c-07ed-4df2-a2b7-2aa521ab10dd tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/c23b6c42-df64-4fab-9a29-ba638027a163" status: 200 len: 1472 microversion: 2.1 time: 0.172304 Oct 27 03:24:49.111349 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 608/1260] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:48 2022] GET /compute/v2.1/servers/c23b6c42-df64-4fab-9a29-ba638027a163 => generated 1472 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:24:49.347691 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f780af19-ed74-4a6f-aa70-ba962e105763 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:49.348473 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f780af19-ed74-4a6f-aa70-ba962e105763 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 33d5c62a-898f-441b-a1a1-3cb12836755d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:49.354473 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f780af19-ed74-4a6f-aa70-ba962e105763 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:49.354972 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f780af19-ed74-4a6f-aa70-ba962e105763 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:49.355417 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f780af19-ed74-4a6f-aa70-ba962e105763 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:49.356308 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f780af19-ed74-4a6f-aa70-ba962e105763 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:49.356773 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f780af19-ed74-4a6f-aa70-ba962e105763 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:49.357206 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f780af19-ed74-4a6f-aa70-ba962e105763 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:49.365305 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-937a77e4-3295-488b-98df-4f7d47aceffc tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:49.365930 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-937a77e4-3295-488b-98df-4f7d47aceffc tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 8559e641-f41e-4b21-88b1-56d57ded5ce6] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:49.375206 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-937a77e4-3295-488b-98df-4f7d47aceffc tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:49.375690 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-937a77e4-3295-488b-98df-4f7d47aceffc tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:49.376134 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-937a77e4-3295-488b-98df-4f7d47aceffc tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:49.376850 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-937a77e4-3295-488b-98df-4f7d47aceffc tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:49.380086 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-937a77e4-3295-488b-98df-4f7d47aceffc tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:49.380086 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-937a77e4-3295-488b-98df-4f7d47aceffc tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:49.515100 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f780af19-ed74-4a6f-aa70-ba962e105763 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:49.524043 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f780af19-ed74-4a6f-aa70-ba962e105763 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/33d5c62a-898f-441b-a1a1-3cb12836755d" status: 200 len: 1308 microversion: 2.1 time: 0.181010 Oct 27 03:24:49.524635 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 653/1261] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:49 2022] GET /compute/v2.1/servers/33d5c62a-898f-441b-a1a1-3cb12836755d => generated 1308 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:49.560434 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-937a77e4-3295-488b-98df-4f7d47aceffc tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:49.568917 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-937a77e4-3295-488b-98df-4f7d47aceffc tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:49.570403 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-937a77e4-3295-488b-98df-4f7d47aceffc tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:49.571613 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-937a77e4-3295-488b-98df-4f7d47aceffc tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/8559e641-f41e-4b21-88b1-56d57ded5ce6" status: 200 len: 1542 microversion: 2.25 time: 0.210321 Oct 27 03:24:49.572179 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 609/1262] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:49 2022] GET /compute/v2.1/servers/8559e641-f41e-4b21-88b1-56d57ded5ce6 => generated 1542 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:24:49.601630 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-386ae531-7bb3-4958-aa53-17df010d0897 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Calling method '.version_select at 0x7f7ddaefa790>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:49.607206 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-386ae531-7bb3-4958-aa53-17df010d0897 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:49.608165 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-386ae531-7bb3-4958-aa53-17df010d0897 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:49.609154 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-386ae531-7bb3-4958-aa53-17df010d0897 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:49.623267 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-386ae531-7bb3-4958-aa53-17df010d0897 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 3205 microversion: 2.25 time: 0.028856 Oct 27 03:24:49.635908 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 654/1263] 10.222.0.20 () {60 vars in 1184 bytes} [Thu Oct 27 03:24:49 2022] GET /compute/v2.1/os-migrations => generated 3205 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:24:49.644215 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-161579f8-e43c-487e-ab39-91ca3fd476af tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:49.644910 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-161579f8-e43c-487e-ab39-91ca3fd476af tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] [instance: 8559e641-f41e-4b21-88b1-56d57ded5ce6] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:49.660412 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-161579f8-e43c-487e-ab39-91ca3fd476af tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:49.661363 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-161579f8-e43c-487e-ab39-91ca3fd476af tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:49.661769 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-161579f8-e43c-487e-ab39-91ca3fd476af tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:49.662892 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-161579f8-e43c-487e-ab39-91ca3fd476af tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:49.663632 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-161579f8-e43c-487e-ab39-91ca3fd476af tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:49.664309 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-161579f8-e43c-487e-ab39-91ca3fd476af tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:49.696582 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4ac131e2-e6b8-4846-a248-c4fae80274ac tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:49.697411 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4ac131e2-e6b8-4846-a248-c4fae80274ac tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: 543fdf60-10ec-4a25-a9d0-30c386efb104] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:49.706944 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4ac131e2-e6b8-4846-a248-c4fae80274ac tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:49.707670 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4ac131e2-e6b8-4846-a248-c4fae80274ac tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:49.708453 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4ac131e2-e6b8-4846-a248-c4fae80274ac tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:49.709204 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4ac131e2-e6b8-4846-a248-c4fae80274ac tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:49.710130 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4ac131e2-e6b8-4846-a248-c4fae80274ac tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:49.710811 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4ac131e2-e6b8-4846-a248-c4fae80274ac tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:49.824618 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-161579f8-e43c-487e-ab39-91ca3fd476af tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lazy-loading 'services' on Instance uuid 8559e641-f41e-4b21-88b1-56d57ded5ce6 {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:24:49.838755 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-161579f8-e43c-487e-ab39-91ca3fd476af tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/8559e641-f41e-4b21-88b1-56d57ded5ce6" status: 200 len: 2034 microversion: 2.25 time: 0.201852 Oct 27 03:24:49.839347 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 610/1264] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:49 2022] GET /compute/v2.1/servers/8559e641-f41e-4b21-88b1-56d57ded5ce6 => generated 2034 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:24:49.849996 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4ac131e2-e6b8-4846-a248-c4fae80274ac tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:49.857829 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4ac131e2-e6b8-4846-a248-c4fae80274ac tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104" status: 200 len: 1360 microversion: 2.1 time: 0.166285 Oct 27 03:24:49.858594 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 655/1265] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:49 2022] GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104 => generated 1360 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:49.875329 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-406762e5-11fd-47ba-b7d2-4ff0d2b93ed3 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Action: 'create', calling method: .version_select at 0x7f7ddab16a60>, body: {"keypair": {"name": "tempest-keypair-311856655", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7z4EueglWxf/mhQ64fCt0XWzpOW+UMd48kMiegRwCL5/OpESWBciOVaxrZ4dnVTXe6EepgjCwkdHFQsheicIKAAq6aT4mRTUkzgSMXR9z0qXWD7UF+NqM76rhebW/tew=="}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:24:49.891205 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-406762e5-11fd-47ba-b7d2-4ff0d2b93ed3 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Getting quotas for project 3b1cf79289db4d7883d93ec3fe908d66. Resources: {'key_pairs'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:24:49.904781 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-406762e5-11fd-47ba-b7d2-4ff0d2b93ed3 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Getting quotas for user ba3ce7f040d24c33bcf9b97d1ef25268 and project 3b1cf79289db4d7883d93ec3fe908d66. Resources: {'key_pairs'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:24:49.969875 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-88f320be-8f9b-4c71-9f15-9c5c78ad12f6 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:49.970599 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-88f320be-8f9b-4c71-9f15-9c5c78ad12f6 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 77dd3d48-fede-491a-b6ce-5ad36a1d7cab] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:49.976842 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-88f320be-8f9b-4c71-9f15-9c5c78ad12f6 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:49.977560 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-88f320be-8f9b-4c71-9f15-9c5c78ad12f6 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:49.978006 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-88f320be-8f9b-4c71-9f15-9c5c78ad12f6 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:49.978776 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-88f320be-8f9b-4c71-9f15-9c5c78ad12f6 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:49.979240 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-88f320be-8f9b-4c71-9f15-9c5c78ad12f6 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:49.979713 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-88f320be-8f9b-4c71-9f15-9c5c78ad12f6 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:50.012502 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-406762e5-11fd-47ba-b7d2-4ff0d2b93ed3 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.25 time: 0.140740 Oct 27 03:24:50.020587 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 611/1266] 10.222.0.20 () {62 vars in 1200 bytes} [Thu Oct 27 03:24:49 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 150 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 27 03:24:50.113712 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-88f320be-8f9b-4c71-9f15-9c5c78ad12f6 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:50.121957 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-88f320be-8f9b-4c71-9f15-9c5c78ad12f6 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab" status: 200 len: 1535 microversion: 2.1 time: 0.156012 Oct 27 03:24:50.122579 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 656/1267] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:49 2022] GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab => generated 1535 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:24:50.134198 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6dfc0fb8-3249-4b31-b03e-7eb33e1abb3b tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:50.134198 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-6dfc0fb8-3249-4b31-b03e-7eb33e1abb3b tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: c23b6c42-df64-4fab-9a29-ba638027a163] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:50.140467 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6dfc0fb8-3249-4b31-b03e-7eb33e1abb3b tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:50.140951 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6dfc0fb8-3249-4b31-b03e-7eb33e1abb3b tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:50.142327 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6dfc0fb8-3249-4b31-b03e-7eb33e1abb3b tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:50.142683 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6dfc0fb8-3249-4b31-b03e-7eb33e1abb3b tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:50.143130 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6dfc0fb8-3249-4b31-b03e-7eb33e1abb3b tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:50.143553 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6dfc0fb8-3249-4b31-b03e-7eb33e1abb3b tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:50.324636 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6dfc0fb8-3249-4b31-b03e-7eb33e1abb3b tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:50.332912 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6dfc0fb8-3249-4b31-b03e-7eb33e1abb3b tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/c23b6c42-df64-4fab-9a29-ba638027a163" status: 200 len: 1472 microversion: 2.1 time: 0.203720 Oct 27 03:24:50.333705 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 612/1268] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:50 2022] GET /compute/v2.1/servers/c23b6c42-df64-4fab-9a29-ba638027a163 => generated 1472 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:24:50.546940 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3cc7e650-7866-433e-ba71-96464c0ce905 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:50.552094 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-3cc7e650-7866-433e-ba71-96464c0ce905 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 33d5c62a-898f-441b-a1a1-3cb12836755d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:50.554198 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3cc7e650-7866-433e-ba71-96464c0ce905 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:50.554695 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3cc7e650-7866-433e-ba71-96464c0ce905 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:50.555138 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3cc7e650-7866-433e-ba71-96464c0ce905 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:50.555870 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3cc7e650-7866-433e-ba71-96464c0ce905 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:50.556311 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3cc7e650-7866-433e-ba71-96464c0ce905 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:50.556747 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3cc7e650-7866-433e-ba71-96464c0ce905 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:50.701352 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-3cc7e650-7866-433e-ba71-96464c0ce905 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:50.711840 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3cc7e650-7866-433e-ba71-96464c0ce905 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/33d5c62a-898f-441b-a1a1-3cb12836755d" status: 200 len: 1308 microversion: 2.1 time: 0.168770 Oct 27 03:24:50.712536 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 657/1269] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:50 2022] GET /compute/v2.1/servers/33d5c62a-898f-441b-a1a1-3cb12836755d => generated 1308 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:50.880928 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7cc4e304-b504-40bf-992b-6e7602e7adb4 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:50.881473 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7cc4e304-b504-40bf-992b-6e7602e7adb4 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: 543fdf60-10ec-4a25-a9d0-30c386efb104] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:50.894069 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7cc4e304-b504-40bf-992b-6e7602e7adb4 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:50.894715 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7cc4e304-b504-40bf-992b-6e7602e7adb4 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:50.895176 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7cc4e304-b504-40bf-992b-6e7602e7adb4 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:50.898975 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7cc4e304-b504-40bf-992b-6e7602e7adb4 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:50.899520 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7cc4e304-b504-40bf-992b-6e7602e7adb4 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:50.900565 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7cc4e304-b504-40bf-992b-6e7602e7adb4 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:51.052356 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7cc4e304-b504-40bf-992b-6e7602e7adb4 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:51.060148 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7cc4e304-b504-40bf-992b-6e7602e7adb4 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104" status: 200 len: 1360 microversion: 2.1 time: 0.183194 Oct 27 03:24:51.060718 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 613/1270] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:50 2022] GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104 => generated 1360 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:51.149949 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d291510b-6a3c-4d24-aae2-4a283544f16d tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:51.149949 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d291510b-6a3c-4d24-aae2-4a283544f16d tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 77dd3d48-fede-491a-b6ce-5ad36a1d7cab] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:51.158296 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d291510b-6a3c-4d24-aae2-4a283544f16d tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:51.164803 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d291510b-6a3c-4d24-aae2-4a283544f16d tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:51.165620 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d291510b-6a3c-4d24-aae2-4a283544f16d tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:51.166681 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d291510b-6a3c-4d24-aae2-4a283544f16d tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:51.168314 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d291510b-6a3c-4d24-aae2-4a283544f16d tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:51.169303 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d291510b-6a3c-4d24-aae2-4a283544f16d tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:51.356888 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b68dc4d1-6fe5-45bd-b56d-c956f7487abc tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:51.357241 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b68dc4d1-6fe5-45bd-b56d-c956f7487abc tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: c23b6c42-df64-4fab-9a29-ba638027a163] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:51.364511 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b68dc4d1-6fe5-45bd-b56d-c956f7487abc tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:51.368197 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b68dc4d1-6fe5-45bd-b56d-c956f7487abc tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:51.370651 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b68dc4d1-6fe5-45bd-b56d-c956f7487abc tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:51.371679 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b68dc4d1-6fe5-45bd-b56d-c956f7487abc tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:51.372410 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b68dc4d1-6fe5-45bd-b56d-c956f7487abc tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:51.388537 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b68dc4d1-6fe5-45bd-b56d-c956f7487abc tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:51.411535 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d291510b-6a3c-4d24-aae2-4a283544f16d tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:51.421283 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d291510b-6a3c-4d24-aae2-4a283544f16d tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab" status: 200 len: 1535 microversion: 2.1 time: 0.277975 Oct 27 03:24:51.421937 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 658/1271] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:51 2022] GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab => generated 1535 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:51.667265 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b68dc4d1-6fe5-45bd-b56d-c956f7487abc tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:51.682756 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b68dc4d1-6fe5-45bd-b56d-c956f7487abc tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/c23b6c42-df64-4fab-9a29-ba638027a163" status: 200 len: 1472 microversion: 2.1 time: 0.331045 Oct 27 03:24:51.683813 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 614/1272] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:51 2022] GET /compute/v2.1/servers/c23b6c42-df64-4fab-9a29-ba638027a163 => generated 1472 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:24:51.735118 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7c846a0e-03b9-4d65-928f-f467623ce6dd tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:51.736311 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7c846a0e-03b9-4d65-928f-f467623ce6dd tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 33d5c62a-898f-441b-a1a1-3cb12836755d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:51.750856 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7c846a0e-03b9-4d65-928f-f467623ce6dd tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:51.752065 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7c846a0e-03b9-4d65-928f-f467623ce6dd tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:51.753202 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7c846a0e-03b9-4d65-928f-f467623ce6dd tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:51.753324 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7c846a0e-03b9-4d65-928f-f467623ce6dd tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:51.753791 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7c846a0e-03b9-4d65-928f-f467623ce6dd tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:51.754289 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7c846a0e-03b9-4d65-928f-f467623ce6dd tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:52.052807 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7c846a0e-03b9-4d65-928f-f467623ce6dd tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:52.072569 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7c846a0e-03b9-4d65-928f-f467623ce6dd tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/33d5c62a-898f-441b-a1a1-3cb12836755d" status: 200 len: 1308 microversion: 2.1 time: 0.341226 Oct 27 03:24:52.081310 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 659/1273] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:51 2022] GET /compute/v2.1/servers/33d5c62a-898f-441b-a1a1-3cb12836755d => generated 1308 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:52.089850 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b9623ad0-430a-4b05-9503-7c0c6cedc7b2 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:52.089850 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b9623ad0-430a-4b05-9503-7c0c6cedc7b2 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: 543fdf60-10ec-4a25-a9d0-30c386efb104] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:52.098117 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b9623ad0-430a-4b05-9503-7c0c6cedc7b2 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:52.098617 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b9623ad0-430a-4b05-9503-7c0c6cedc7b2 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:52.099122 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b9623ad0-430a-4b05-9503-7c0c6cedc7b2 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:52.099831 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b9623ad0-430a-4b05-9503-7c0c6cedc7b2 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:52.100290 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b9623ad0-430a-4b05-9503-7c0c6cedc7b2 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:52.100714 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b9623ad0-430a-4b05-9503-7c0c6cedc7b2 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:52.387608 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b9623ad0-430a-4b05-9503-7c0c6cedc7b2 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:52.401654 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b9623ad0-430a-4b05-9503-7c0c6cedc7b2 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104" status: 200 len: 1360 microversion: 2.1 time: 0.322055 Oct 27 03:24:52.415075 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 615/1274] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:52 2022] GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104 => generated 1360 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:24:52.445691 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-36dfb04b-019c-4522-8dce-df6312b955ef tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:52.447045 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-36dfb04b-019c-4522-8dce-df6312b955ef tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 77dd3d48-fede-491a-b6ce-5ad36a1d7cab] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:52.456989 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-36dfb04b-019c-4522-8dce-df6312b955ef tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:52.457906 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-36dfb04b-019c-4522-8dce-df6312b955ef tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:52.458587 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-36dfb04b-019c-4522-8dce-df6312b955ef tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:52.459582 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-36dfb04b-019c-4522-8dce-df6312b955ef tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:52.460048 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-36dfb04b-019c-4522-8dce-df6312b955ef tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:52.460476 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-36dfb04b-019c-4522-8dce-df6312b955ef tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:52.640288 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-36dfb04b-019c-4522-8dce-df6312b955ef tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:52.647978 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=100 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:24:52.651148 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-36dfb04b-019c-4522-8dce-df6312b955ef tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab" status: 200 len: 1528 microversion: 2.1 time: 0.209193 Oct 27 03:24:52.655503 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 660/1275] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:52 2022] GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab => generated 1528 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:52.683208 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6e2058ac-0653-4780-addb-e535461b141e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:52.683928 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6e2058ac-0653-4780-addb-e535461b141e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 77dd3d48-fede-491a-b6ce-5ad36a1d7cab] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:52.713783 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6e2058ac-0653-4780-addb-e535461b141e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:52.715313 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6e2058ac-0653-4780-addb-e535461b141e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:52.716095 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6e2058ac-0653-4780-addb-e535461b141e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:52.717846 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6e2058ac-0653-4780-addb-e535461b141e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:52.718584 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6e2058ac-0653-4780-addb-e535461b141e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:52.719206 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6e2058ac-0653-4780-addb-e535461b141e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:52.977722 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-6e2058ac-0653-4780-addb-e535461b141e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:52.986112 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6e2058ac-0653-4780-addb-e535461b141e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab" status: 200 len: 1528 microversion: 2.1 time: 0.310181 Oct 27 03:24:52.987824 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 661/1276] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:52 2022] GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab => generated 1528 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:52.993368 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5cd6e327-1332-4907-b3dd-907a09e8c3c4 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:52.994475 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5cd6e327-1332-4907-b3dd-907a09e8c3c4 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: c23b6c42-df64-4fab-9a29-ba638027a163] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:53.006929 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5cd6e327-1332-4907-b3dd-907a09e8c3c4 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:53.007397 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5cd6e327-1332-4907-b3dd-907a09e8c3c4 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:53.008022 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5cd6e327-1332-4907-b3dd-907a09e8c3c4 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:53.008921 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5cd6e327-1332-4907-b3dd-907a09e8c3c4 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:53.009893 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5cd6e327-1332-4907-b3dd-907a09e8c3c4 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:53.010856 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5cd6e327-1332-4907-b3dd-907a09e8c3c4 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:53.099554 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5dbb0db4-4968-4d50-a436-269bd88640fa tempest-ServicesAdminNegativeTestJSON-553993543 tempest-ServicesAdminNegativeTestJSON-553993543-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:53.105599 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5dbb0db4-4968-4d50-a436-269bd88640fa tempest-ServicesAdminNegativeTestJSON-553993543 tempest-ServicesAdminNegativeTestJSON-553993543-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:53.110546 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5dbb0db4-4968-4d50-a436-269bd88640fa tempest-ServicesAdminNegativeTestJSON-553993543 tempest-ServicesAdminNegativeTestJSON-553993543-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:53.110546 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5dbb0db4-4968-4d50-a436-269bd88640fa tempest-ServicesAdminNegativeTestJSON-553993543 tempest-ServicesAdminNegativeTestJSON-553993543-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:53.111094 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5dbb0db4-4968-4d50-a436-269bd88640fa tempest-ServicesAdminNegativeTestJSON-553993543 tempest-ServicesAdminNegativeTestJSON-553993543-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:53.111738 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5dbb0db4-4968-4d50-a436-269bd88640fa tempest-ServicesAdminNegativeTestJSON-553993543 tempest-ServicesAdminNegativeTestJSON-553993543-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:53.114023 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5dbb0db4-4968-4d50-a436-269bd88640fa tempest-ServicesAdminNegativeTestJSON-553993543 tempest-ServicesAdminNegativeTestJSON-553993543-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:53.125698 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5cd6e327-1332-4907-b3dd-907a09e8c3c4 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:53.136526 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5cd6e327-1332-4907-b3dd-907a09e8c3c4 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/c23b6c42-df64-4fab-9a29-ba638027a163" status: 200 len: 1430 microversion: 2.1 time: 0.147487 Oct 27 03:24:53.138602 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 662/1277] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:52 2022] GET /compute/v2.1/servers/c23b6c42-df64-4fab-9a29-ba638027a163 => generated 1430 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:53.152708 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:24:53.160025 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-0dc63faf-d2ec-4dd5-8731-b37d77b01c08 req-684dcc51-a5f6-4be6-bf78-e4594a7f33b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c23b6c42-df64-4fab-9a29-ba638027a163", "name": "network-vif-deleted", "tag": "c02998a4-ec7c-4865-b3b7-76a1f4abc2a9"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:24:53.178696 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-0dc63faf-d2ec-4dd5-8731-b37d77b01c08 req-684dcc51-a5f6-4be6-bf78-e4594a7f33b3 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:53.183274 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-0dc63faf-d2ec-4dd5-8731-b37d77b01c08 req-684dcc51-a5f6-4be6-bf78-e4594a7f33b3 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:53.184019 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-0dc63faf-d2ec-4dd5-8731-b37d77b01c08 req-684dcc51-a5f6-4be6-bf78-e4594a7f33b3 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:53.200035 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5dbb0db4-4968-4d50-a436-269bd88640fa tempest-ServicesAdminNegativeTestJSON-553993543 tempest-ServicesAdminNegativeTestJSON-553993543-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.601791 Oct 27 03:24:53.207314 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 616/1278] 10.222.0.20 () {58 vars in 1137 bytes} [Thu Oct 27 03:24:52 2022] GET /compute/v2.1/os-services => generated 944 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:24:53.221727 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a3dded3f-bf3f-4e09-8501-d5de4acde94e tempest-MigrationsAdminTest-707106630 tempest-MigrationsAdminTest-707106630-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:53.231330 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-0dc63faf-d2ec-4dd5-8731-b37d77b01c08 req-684dcc51-a5f6-4be6-bf78-e4594a7f33b3 service nova] Creating event network-vif-deleted:c02998a4-ec7c-4865-b3b7-76a1f4abc2a9 for instance c23b6c42-df64-4fab-9a29-ba638027a163 on n-h2-862769-1 Oct 27 03:24:53.231429 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-a3dded3f-bf3f-4e09-8501-d5de4acde94e tempest-MigrationsAdminTest-707106630 tempest-MigrationsAdminTest-707106630-project-admin] HTTP exception thrown: Flavor 373ee9d3-42fb-4650-9a9e-1bc4c5ae3e0a could not be found. Oct 27 03:24:53.236455 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-0dc63faf-d2ec-4dd5-8731-b37d77b01c08 req-684dcc51-a5f6-4be6-bf78-e4594a7f33b3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094509 Oct 27 03:24:53.237585 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 663/1279] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:24:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:24:53.238915 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a3dded3f-bf3f-4e09-8501-d5de4acde94e tempest-MigrationsAdminTest-707106630 tempest-MigrationsAdminTest-707106630-project-admin] Request method failure captured: Oct 27 03:24:53.238915 n-d-862769-1 devstack@n-api.service[121001]: request: DELETE /compute/v2.1/flavors/373ee9d3-42fb-4650-9a9e-1bc4c5ae3e0a HTTP/1.1 Oct 27 03:24:53.238915 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:24:53.238915 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:24:53.238915 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:24:53.238915 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:24:53.238915 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:24:53.238915 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:24:53.238915 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:24:53.238915 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:24:53.238915 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfks68a4hh3-vn8F_FZ2eaVUWZpS_i3uI8a017MKFkcHGWGu0u0ai0XpCRiDcT96tGIxC4tfpVfqT8_-jASp2t04rQwuG6Qu8jQ10ZZk-phVxXwVDC0L6RwLKhWgYqRhPbcfQnJAjhmGp4QacJuL-ZyWsLLLqMt4QQr6UNPoWGOI5ew Oct 27 03:24:53.238915 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:24:53.238915 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:24:53.238915 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:24:53.238915 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:24:53.238915 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:24:53.238915 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:24:53.238915 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 333b6e5cda4e482ab1ce3f241ec6cfe9 Oct 27 03:24:53.238915 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-MigrationsAdminTest-707106630 Oct 27 03:24:53.238915 n-d-862769-1 devstack@n-api.service[121001]: X-Role: admin,member,reader Oct 27 03:24:53.238915 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: admin,member,reader Oct 27 03:24:53.240286 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/333b6e5cda4e482ab1ce3f241ec6cfe9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/333b6e5cda4e482ab1ce3f241ec6cfe9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/333b6e5cda4e482ab1ce3f241ec6cfe9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_333b6e5cda4e482ab1ce3f241ec6cfe9"}]}] Oct 27 03:24:53.240286 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-MigrationsAdminTest-707106630 Oct 27 03:24:53.240286 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 333b6e5cda4e482ab1ce3f241ec6cfe9 Oct 27 03:24:53.240286 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-MigrationsAdminTest-707106630 Oct 27 03:24:53.240286 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-MigrationsAdminTest-707106630-project-admin Oct 27 03:24:53.240286 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:24:53.240286 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:24:53.240286 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 4e8002bf6ca34327b2d4faa37f93c6ac Oct 27 03:24:53.240286 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-MigrationsAdminTest-707106630-project-admin Oct 27 03:24:53.240286 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:24:53.240286 n-d-862769-1 devstack@n-api.service[121001]: exception: Flavor 373ee9d3-42fb-4650-9a9e-1bc4c5ae3e0a could not be found. Oct 27 03:24:53.240286 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '373ee9d3-42fb-4650-9a9e-1bc4c5ae3e0a'} Oct 27 03:24:53.241057 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:24:53.241057 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:24:53.241057 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Oct 27 03:24:53.241057 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi flavor.destroy() Oct 27 03:24:53.241057 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 27 03:24:53.241057 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 27 03:24:53.241057 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Oct 27 03:24:53.241057 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Oct 27 03:24:53.241057 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Oct 27 03:24:53.241057 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Oct 27 03:24:53.241057 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 03:24:53.241057 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 03:24:53.241057 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Oct 27 03:24:53.241057 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Oct 27 03:24:53.241057 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 373ee9d3-42fb-4650-9a9e-1bc4c5ae3e0a could not be found. Oct 27 03:24:53.241057 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:24:53.241057 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:24:53.241057 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:24:53.241057 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:24:53.241057 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:24:53.242301 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:24:53.242301 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:24:53.242301 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:24:53.242301 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:24:53.242301 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:24:53.242301 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Oct 27 03:24:53.242301 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:24:53.242301 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 373ee9d3-42fb-4650-9a9e-1bc4c5ae3e0a could not be found. Oct 27 03:24:53.242301 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:24:53.242301 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:24:53.242301 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:24:53.242301 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:24:53.242301 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:24:53.242301 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:24:53.242301 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:24:53.242301 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:24:53.242301 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 373ee9d3-42fb-4650-9a9e-1bc4c5ae3e0a could not be found. Oct 27 03:24:53.242301 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:24:53.246735 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a3dded3f-bf3f-4e09-8501-d5de4acde94e tempest-MigrationsAdminTest-707106630 tempest-MigrationsAdminTest-707106630-project-admin] Returning 404 to user: Flavor 373ee9d3-42fb-4650-9a9e-1bc4c5ae3e0a could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:24:53.248085 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a3dded3f-bf3f-4e09-8501-d5de4acde94e tempest-MigrationsAdminTest-707106630 tempest-MigrationsAdminTest-707106630-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/373ee9d3-42fb-4650-9a9e-1bc4c5ae3e0a" status: 404 len: 109 microversion: 2.1 time: 0.031788 Oct 27 03:24:53.248923 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 617/1280] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:24:53 2022] DELETE /compute/v2.1/flavors/373ee9d3-42fb-4650-9a9e-1bc4c5ae3e0a => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:24:53.267337 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c91bc730-6b6f-45f9-aa72-5941d3c90926 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:53.268055 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c91bc730-6b6f-45f9-aa72-5941d3c90926 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 33d5c62a-898f-441b-a1a1-3cb12836755d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:53.269961 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f15ca1b5-94df-48cc-9bdc-9a24bffcaca4 tempest-ServicesAdminNegativeTestJSON-553993543 tempest-ServicesAdminNegativeTestJSON-553993543-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:53.278257 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f15ca1b5-94df-48cc-9bdc-9a24bffcaca4 tempest-ServicesAdminNegativeTestJSON-553993543 tempest-ServicesAdminNegativeTestJSON-553993543-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:53.279158 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f15ca1b5-94df-48cc-9bdc-9a24bffcaca4 tempest-ServicesAdminNegativeTestJSON-553993543 tempest-ServicesAdminNegativeTestJSON-553993543-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:53.279800 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f15ca1b5-94df-48cc-9bdc-9a24bffcaca4 tempest-ServicesAdminNegativeTestJSON-553993543 tempest-ServicesAdminNegativeTestJSON-553993543-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:53.280911 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f15ca1b5-94df-48cc-9bdc-9a24bffcaca4 tempest-ServicesAdminNegativeTestJSON-553993543 tempest-ServicesAdminNegativeTestJSON-553993543-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:53.281524 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f15ca1b5-94df-48cc-9bdc-9a24bffcaca4 tempest-ServicesAdminNegativeTestJSON-553993543 tempest-ServicesAdminNegativeTestJSON-553993543-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:53.283087 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f15ca1b5-94df-48cc-9bdc-9a24bffcaca4 tempest-ServicesAdminNegativeTestJSON-553993543 tempest-ServicesAdminNegativeTestJSON-553993543-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:53.303494 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c91bc730-6b6f-45f9-aa72-5941d3c90926 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:53.304178 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c91bc730-6b6f-45f9-aa72-5941d3c90926 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:53.305500 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c91bc730-6b6f-45f9-aa72-5941d3c90926 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:53.308966 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c91bc730-6b6f-45f9-aa72-5941d3c90926 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:53.309465 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c91bc730-6b6f-45f9-aa72-5941d3c90926 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:53.311260 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c91bc730-6b6f-45f9-aa72-5941d3c90926 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:53.317453 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f15ca1b5-94df-48cc-9bdc-9a24bffcaca4 tempest-ServicesAdminNegativeTestJSON-553993543 tempest-ServicesAdminNegativeTestJSON-553993543-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.052809 Oct 27 03:24:53.318081 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 618/1281] 10.222.0.20 () {58 vars in 1170 bytes} [Thu Oct 27 03:24:53 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:24:53.338992 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-fee76489-2335-4a48-9567-f4818ef57b37 tempest-ServicesAdminNegativeTestJSON-553993543 tempest-ServicesAdminNegativeTestJSON-553993543-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:53.343173 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fee76489-2335-4a48-9567-f4818ef57b37 tempest-ServicesAdminNegativeTestJSON-553993543 tempest-ServicesAdminNegativeTestJSON-553993543-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:53.345615 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fee76489-2335-4a48-9567-f4818ef57b37 tempest-ServicesAdminNegativeTestJSON-553993543 tempest-ServicesAdminNegativeTestJSON-553993543-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:53.352859 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fee76489-2335-4a48-9567-f4818ef57b37 tempest-ServicesAdminNegativeTestJSON-553993543 tempest-ServicesAdminNegativeTestJSON-553993543-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:53.354790 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fee76489-2335-4a48-9567-f4818ef57b37 tempest-ServicesAdminNegativeTestJSON-553993543 tempest-ServicesAdminNegativeTestJSON-553993543-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:53.355513 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fee76489-2335-4a48-9567-f4818ef57b37 tempest-ServicesAdminNegativeTestJSON-553993543 tempest-ServicesAdminNegativeTestJSON-553993543-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:53.356925 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fee76489-2335-4a48-9567-f4818ef57b37 tempest-ServicesAdminNegativeTestJSON-553993543 tempest-ServicesAdminNegativeTestJSON-553993543-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:53.388944 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:24:53.417819 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-fee76489-2335-4a48-9567-f4818ef57b37 tempest-ServicesAdminNegativeTestJSON-553993543 tempest-ServicesAdminNegativeTestJSON-553993543-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.089214 Oct 27 03:24:53.430460 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 619/1282] 10.222.0.20 () {58 vars in 1137 bytes} [Thu Oct 27 03:24:53 2022] GET /compute/v2.1/os-services => generated 944 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:24:53.436263 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-596b6fdb-ce6d-4d17-812c-dfba85ebecb2 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:53.440886 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-596b6fdb-ce6d-4d17-812c-dfba85ebecb2 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: 543fdf60-10ec-4a25-a9d0-30c386efb104] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:53.454565 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-596b6fdb-ce6d-4d17-812c-dfba85ebecb2 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:53.455725 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-596b6fdb-ce6d-4d17-812c-dfba85ebecb2 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:53.457046 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-596b6fdb-ce6d-4d17-812c-dfba85ebecb2 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:53.465714 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-596b6fdb-ce6d-4d17-812c-dfba85ebecb2 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:53.466419 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-596b6fdb-ce6d-4d17-812c-dfba85ebecb2 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:53.467023 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-596b6fdb-ce6d-4d17-812c-dfba85ebecb2 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:53.505935 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c91bc730-6b6f-45f9-aa72-5941d3c90926 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:53.516124 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c91bc730-6b6f-45f9-aa72-5941d3c90926 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/33d5c62a-898f-441b-a1a1-3cb12836755d" status: 200 len: 1308 microversion: 2.1 time: 0.277241 Oct 27 03:24:53.517146 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 664/1283] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:53 2022] GET /compute/v2.1/servers/33d5c62a-898f-441b-a1a1-3cb12836755d => generated 1308 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:53.524825 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-46a4e018-0145-407d-879d-431d76eb6af9 tempest-ServicesAdminNegativeTestJSON-553993543 tempest-ServicesAdminNegativeTestJSON-553993543-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:53.529878 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-46a4e018-0145-407d-879d-431d76eb6af9 tempest-ServicesAdminNegativeTestJSON-553993543 tempest-ServicesAdminNegativeTestJSON-553993543-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:53.530276 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-46a4e018-0145-407d-879d-431d76eb6af9 tempest-ServicesAdminNegativeTestJSON-553993543 tempest-ServicesAdminNegativeTestJSON-553993543-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:53.531280 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-46a4e018-0145-407d-879d-431d76eb6af9 tempest-ServicesAdminNegativeTestJSON-553993543 tempest-ServicesAdminNegativeTestJSON-553993543-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:53.532499 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-46a4e018-0145-407d-879d-431d76eb6af9 tempest-ServicesAdminNegativeTestJSON-553993543 tempest-ServicesAdminNegativeTestJSON-553993543-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:53.533370 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-46a4e018-0145-407d-879d-431d76eb6af9 tempest-ServicesAdminNegativeTestJSON-553993543 tempest-ServicesAdminNegativeTestJSON-553993543-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:53.534131 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-46a4e018-0145-407d-879d-431d76eb6af9 tempest-ServicesAdminNegativeTestJSON-553993543 tempest-ServicesAdminNegativeTestJSON-553993543-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:53.577215 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-46a4e018-0145-407d-879d-431d76eb6af9 tempest-ServicesAdminNegativeTestJSON-553993543 tempest-ServicesAdminNegativeTestJSON-553993543-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?host=n-d-862769-1&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.058523 Oct 27 03:24:53.578348 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 665/1284] 10.222.0.20 () {58 vars in 1194 bytes} [Thu Oct 27 03:24:53 2022] GET /compute/v2.1/os-services?host=n-d-862769-1&binary=xxx => generated 16 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 03:24:53.584773 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6ba64900-76c9-4cd4-9ba1-988f9895bcd5 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1718734723", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:24:53.656222 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-6ba64900-76c9-4cd4-9ba1-988f9895bcd5 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] validate_networks() for None {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:24:54.011589 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-596b6fdb-ce6d-4d17-812c-dfba85ebecb2 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:54.024260 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-596b6fdb-ce6d-4d17-812c-dfba85ebecb2 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104" status: 200 len: 1360 microversion: 2.1 time: 0.591748 Oct 27 03:24:54.024982 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 620/1285] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:53 2022] GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104 => generated 1360 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:54.039326 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-735f65fe-3b0b-4243-89d0-57ac640e7210 tempest-ServicesAdminNegativeTestJSON-553993543 tempest-ServicesAdminNegativeTestJSON-553993543-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:54.044829 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-6ba64900-76c9-4cd4-9ba1-988f9895bcd5 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:24:54.045961 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-6ba64900-76c9-4cd4-9ba1-988f9895bcd5 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:24:54.046696 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-6ba64900-76c9-4cd4-9ba1-988f9895bcd5 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:24:54.047472 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-6ba64900-76c9-4cd4-9ba1-988f9895bcd5 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:24:54.048435 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-6ba64900-76c9-4cd4-9ba1-988f9895bcd5 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:24:54.050190 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-735f65fe-3b0b-4243-89d0-57ac640e7210 tempest-ServicesAdminNegativeTestJSON-553993543 tempest-ServicesAdminNegativeTestJSON-553993543-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:54.052446 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-735f65fe-3b0b-4243-89d0-57ac640e7210 tempest-ServicesAdminNegativeTestJSON-553993543 tempest-ServicesAdminNegativeTestJSON-553993543-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:54.052976 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-735f65fe-3b0b-4243-89d0-57ac640e7210 tempest-ServicesAdminNegativeTestJSON-553993543 tempest-ServicesAdminNegativeTestJSON-553993543-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:54.053935 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-735f65fe-3b0b-4243-89d0-57ac640e7210 tempest-ServicesAdminNegativeTestJSON-553993543 tempest-ServicesAdminNegativeTestJSON-553993543-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:54.055427 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-735f65fe-3b0b-4243-89d0-57ac640e7210 tempest-ServicesAdminNegativeTestJSON-553993543 tempest-ServicesAdminNegativeTestJSON-553993543-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:54.059771 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-735f65fe-3b0b-4243-89d0-57ac640e7210 tempest-ServicesAdminNegativeTestJSON-553993543 tempest-ServicesAdminNegativeTestJSON-553993543-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:54.061561 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6ba64900-76c9-4cd4-9ba1-988f9895bcd5 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:54.063066 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6ba64900-76c9-4cd4-9ba1-988f9895bcd5 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:54.067987 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6ba64900-76c9-4cd4-9ba1-988f9895bcd5 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:54.067987 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6ba64900-76c9-4cd4-9ba1-988f9895bcd5 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:54.067987 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6ba64900-76c9-4cd4-9ba1-988f9895bcd5 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:54.067987 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6ba64900-76c9-4cd4-9ba1-988f9895bcd5 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:54.088237 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-6ba64900-76c9-4cd4-9ba1-988f9895bcd5 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Getting quotas for project 48e708fb3bdd45bc976db7bd92af09c8. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:24:54.095555 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-6ba64900-76c9-4cd4-9ba1-988f9895bcd5 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Getting quotas for user d3f1177e2cbd4ba6b659f8a714be86ac and project 48e708fb3bdd45bc976db7bd92af09c8. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:24:54.111049 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6ba64900-76c9-4cd4-9ba1-988f9895bcd5 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:24:54.113602 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6ba64900-76c9-4cd4-9ba1-988f9895bcd5 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: e8781053-3dad-4951-b4cb-1f4aaf97e19b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:24:54.134121 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-735f65fe-3b0b-4243-89d0-57ac640e7210 tempest-ServicesAdminNegativeTestJSON-553993543 tempest-ServicesAdminNegativeTestJSON-553993543-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.107739 Oct 27 03:24:54.136531 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 621/1286] 10.222.0.20 () {58 vars in 1137 bytes} [Thu Oct 27 03:24:54 2022] GET /compute/v2.1/os-services => generated 944 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:24:54.147489 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-15072d8c-9e16-4d0c-953e-a23eebc40b8e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-949874200", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": [{"uuid": "1257014e-2ff1-4e8e-a591-63c86a5e0d4b"}], "security_groups": [{"name": "tempest-securitygroup--1362823740"}], "key_name": "tempest-keypair-311856655", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:24:54.294378 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6ba64900-76c9-4cd4-9ba1-988f9895bcd5 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.714515 Oct 27 03:24:54.295665 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 666/1287] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:24:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 717 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 03:24:54.300573 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-c5caa923-9881-4820-85f3-0698b7f38da0 req-2c38644a-de1d-4e4b-9025-d2a6bc4ec669 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77dd3d48-fede-491a-b6ce-5ad36a1d7cab", "name": "network-vif-plugged", "status": "completed", "tag": "a67227e9-dd6a-4cad-96f1-1d8b74514779"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:24:54.313723 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-c5caa923-9881-4820-85f3-0698b7f38da0 req-2c38644a-de1d-4e4b-9025-d2a6bc4ec669 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:54.316341 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-c5caa923-9881-4820-85f3-0698b7f38da0 req-2c38644a-de1d-4e4b-9025-d2a6bc4ec669 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:54.319319 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-c5caa923-9881-4820-85f3-0698b7f38da0 req-2c38644a-de1d-4e4b-9025-d2a6bc4ec669 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:54.334348 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-c5caa923-9881-4820-85f3-0698b7f38da0 req-2c38644a-de1d-4e4b-9025-d2a6bc4ec669 service nova] Creating event network-vif-plugged:a67227e9-dd6a-4cad-96f1-1d8b74514779 for instance 77dd3d48-fede-491a-b6ce-5ad36a1d7cab on n-h2-862769-1 Oct 27 03:24:54.339900 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-c5caa923-9881-4820-85f3-0698b7f38da0 req-2c38644a-de1d-4e4b-9025-d2a6bc4ec669 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042990 Oct 27 03:24:54.342191 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 667/1288] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:24:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:24:54.346644 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.network.neutron [None req-15072d8c-9e16-4d0c-953e-a23eebc40b8e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] validate_networks() for [('1257014e-2ff1-4e8e-a591-63c86a5e0d4b', None, None, None, None, None)] {{(pid=121001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:24:54.520707 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e992bf47-56f8-4ae0-a018-a5e03d97e203 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1293293066", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:24:54.587963 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-e992bf47-56f8-4ae0-a018-a5e03d97e203 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] validate_networks() for None {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:24:54.840981 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-e992bf47-56f8-4ae0-a018-a5e03d97e203 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:24:54.841554 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-e992bf47-56f8-4ae0-a018-a5e03d97e203 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:24:54.842176 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-e992bf47-56f8-4ae0-a018-a5e03d97e203 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:24:54.842692 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-e992bf47-56f8-4ae0-a018-a5e03d97e203 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:24:54.843377 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-e992bf47-56f8-4ae0-a018-a5e03d97e203 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:24:54.856145 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e992bf47-56f8-4ae0-a018-a5e03d97e203 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:54.857122 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e992bf47-56f8-4ae0-a018-a5e03d97e203 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:54.857786 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e992bf47-56f8-4ae0-a018-a5e03d97e203 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:54.859148 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e992bf47-56f8-4ae0-a018-a5e03d97e203 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:54.860024 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e992bf47-56f8-4ae0-a018-a5e03d97e203 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:54.861602 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e992bf47-56f8-4ae0-a018-a5e03d97e203 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:54.892943 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-e992bf47-56f8-4ae0-a018-a5e03d97e203 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Getting quotas for project 49d2c150feac4d03966a860ab8bafe00. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:24:54.908927 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-e992bf47-56f8-4ae0-a018-a5e03d97e203 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Getting quotas for user 2ccd5909fb214f71ad68704019c9e4f0 and project 49d2c150feac4d03966a860ab8bafe00. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:24:54.930088 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e992bf47-56f8-4ae0-a018-a5e03d97e203 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:24:54.933394 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e992bf47-56f8-4ae0-a018-a5e03d97e203 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] [instance: 2d8a44aa-62e4-4385-b295-924517b6f850] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:24:55.023624 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-15072d8c-9e16-4d0c-953e-a23eebc40b8e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Flavor limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:24:55.024155 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-15072d8c-9e16-4d0c-953e-a23eebc40b8e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Image limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:24:55.024705 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-15072d8c-9e16-4d0c-953e-a23eebc40b8e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Flavor pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:24:55.025240 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-15072d8c-9e16-4d0c-953e-a23eebc40b8e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Image pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:24:55.025725 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-15072d8c-9e16-4d0c-953e-a23eebc40b8e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:24:55.034914 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-15072d8c-9e16-4d0c-953e-a23eebc40b8e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:55.035497 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-15072d8c-9e16-4d0c-953e-a23eebc40b8e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:55.036141 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-15072d8c-9e16-4d0c-953e-a23eebc40b8e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:55.036887 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-15072d8c-9e16-4d0c-953e-a23eebc40b8e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:55.037376 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-15072d8c-9e16-4d0c-953e-a23eebc40b8e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:55.037811 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-15072d8c-9e16-4d0c-953e-a23eebc40b8e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:55.055804 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-15072d8c-9e16-4d0c-953e-a23eebc40b8e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Getting quotas for project 3b1cf79289db4d7883d93ec3fe908d66. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:24:55.061285 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-15072d8c-9e16-4d0c-953e-a23eebc40b8e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Getting quotas for user ba3ce7f040d24c33bcf9b97d1ef25268 and project 3b1cf79289db4d7883d93ec3fe908d66. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:24:55.074561 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-15072d8c-9e16-4d0c-953e-a23eebc40b8e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Going to run 1 instances... {{(pid=121001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:24:55.076877 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-15072d8c-9e16-4d0c-953e-a23eebc40b8e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:24:55.080957 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e992bf47-56f8-4ae0-a018-a5e03d97e203 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.736762 Oct 27 03:24:55.082456 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 668/1289] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:24:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 739 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 03:24:55.086966 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ba09c33e-99d0-4f31-bfff-fd388723c2d7 tempest-ServicesAdminNegativeTestJSON-553993543 tempest-ServicesAdminNegativeTestJSON-553993543-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:55.091244 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ba09c33e-99d0-4f31-bfff-fd388723c2d7 tempest-ServicesAdminNegativeTestJSON-553993543 tempest-ServicesAdminNegativeTestJSON-553993543-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:55.091729 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ba09c33e-99d0-4f31-bfff-fd388723c2d7 tempest-ServicesAdminNegativeTestJSON-553993543 tempest-ServicesAdminNegativeTestJSON-553993543-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:55.092169 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ba09c33e-99d0-4f31-bfff-fd388723c2d7 tempest-ServicesAdminNegativeTestJSON-553993543 tempest-ServicesAdminNegativeTestJSON-553993543-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:55.092901 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ba09c33e-99d0-4f31-bfff-fd388723c2d7 tempest-ServicesAdminNegativeTestJSON-553993543 tempest-ServicesAdminNegativeTestJSON-553993543-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:55.093356 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ba09c33e-99d0-4f31-bfff-fd388723c2d7 tempest-ServicesAdminNegativeTestJSON-553993543 tempest-ServicesAdminNegativeTestJSON-553993543-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:55.093780 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ba09c33e-99d0-4f31-bfff-fd388723c2d7 tempest-ServicesAdminNegativeTestJSON-553993543 tempest-ServicesAdminNegativeTestJSON-553993543-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:55.125419 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ba09c33e-99d0-4f31-bfff-fd388723c2d7 tempest-ServicesAdminNegativeTestJSON-553993543 tempest-ServicesAdminNegativeTestJSON-553993543-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.041767 Oct 27 03:24:55.126637 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 669/1290] 10.222.0.20 () {58 vars in 1198 bytes} [Thu Oct 27 03:24:55 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 03:24:55.132324 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6687f046-aa24-4314-bcd1-7c948ac0b75c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:55.133122 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6687f046-aa24-4314-bcd1-7c948ac0b75c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: c23b6c42-df64-4fab-9a29-ba638027a163] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:55.140316 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6687f046-aa24-4314-bcd1-7c948ac0b75c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:55.141059 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6687f046-aa24-4314-bcd1-7c948ac0b75c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:55.141726 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6687f046-aa24-4314-bcd1-7c948ac0b75c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:55.142647 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6687f046-aa24-4314-bcd1-7c948ac0b75c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:55.143259 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6687f046-aa24-4314-bcd1-7c948ac0b75c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:55.143890 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6687f046-aa24-4314-bcd1-7c948ac0b75c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:55.160899 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-6687f046-aa24-4314-bcd1-7c948ac0b75c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] HTTP exception thrown: Instance c23b6c42-df64-4fab-9a29-ba638027a163 could not be found. Oct 27 03:24:55.162865 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6687f046-aa24-4314-bcd1-7c948ac0b75c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Request method failure captured: Oct 27 03:24:55.162865 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/c23b6c42-df64-4fab-9a29-ba638027a163 HTTP/1.1 Oct 27 03:24:55.162865 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:24:55.162865 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:24:55.162865 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:24:55.162865 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:24:55.162865 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:24:55.162865 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:24:55.162865 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:24:55.162865 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:24:55.162865 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWflSNQach9Nb5a-nwpaet3DOMbW4rovpwiSisAjqFscpzZFwT6bcg_up1i76ycL6ujOTUfNYz_zBzvxITJnmbBErQShJ1lwwCzCfbPi_i3gA3nNTv5XKeqZukq5d_laOkT4ryxL3BEyqvlbo-j2kkQUt_sjeDJRyUijGXNWQdhqp_K4 Oct 27 03:24:55.162865 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:24:55.162865 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:24:55.162865 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:24:55.162865 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:24:55.162865 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:24:55.162865 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:24:55.162865 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: b95729a8c8a14361b7cbf8b2b13900b2 Oct 27 03:24:55.162865 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ServersOnMultiNodesTest-265997062 Oct 27 03:24:55.162865 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:24:55.162865 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:24:55.164326 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b95729a8c8a14361b7cbf8b2b13900b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b95729a8c8a14361b7cbf8b2b13900b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b95729a8c8a14361b7cbf8b2b13900b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b95729a8c8a14361b7cbf8b2b13900b2"}]}] Oct 27 03:24:55.164326 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ServersOnMultiNodesTest-265997062 Oct 27 03:24:55.164326 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: b95729a8c8a14361b7cbf8b2b13900b2 Oct 27 03:24:55.164326 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-265997062 Oct 27 03:24:55.164326 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ServersOnMultiNodesTest-265997062-project Oct 27 03:24:55.164326 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:24:55.164326 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:24:55.164326 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 91d1351fcb6b4cd08f176e6d0cc5bb11 Oct 27 03:24:55.164326 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ServersOnMultiNodesTest-265997062-project Oct 27 03:24:55.164326 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:24:55.164326 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance c23b6c42-df64-4fab-9a29-ba638027a163 could not be found. Oct 27 03:24:55.164326 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': 'c23b6c42-df64-4fab-9a29-ba638027a163'} Oct 27 03:24:55.165226 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:24:55.165226 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:24:55.165226 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:24:55.165226 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:24:55.165226 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:24:55.165226 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:24:55.165226 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:24:55.165226 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:24:55.165226 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:24:55.165226 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:24:55.165226 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c23b6c42-df64-4fab-9a29-ba638027a163 could not be found. Oct 27 03:24:55.165226 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:24:55.165226 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:24:55.165226 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:24:55.165226 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:24:55.165226 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:24:55.165226 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:24:55.165226 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:24:55.165226 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:24:55.165226 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:24:55.167184 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:24:55.167184 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:24:55.167184 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:24:55.167184 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:24:55.167184 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:24:55.167184 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:24:55.167184 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:24:55.167184 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c23b6c42-df64-4fab-9a29-ba638027a163 could not be found. Oct 27 03:24:55.167184 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:24:55.167184 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:24:55.167184 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:24:55.167184 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:24:55.167184 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:24:55.167184 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:24:55.167184 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:24:55.167184 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:24:55.167184 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c23b6c42-df64-4fab-9a29-ba638027a163 could not be found. Oct 27 03:24:55.167184 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:24:55.170526 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6687f046-aa24-4314-bcd1-7c948ac0b75c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Returning 404 to user: Instance c23b6c42-df64-4fab-9a29-ba638027a163 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:24:55.171847 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6687f046-aa24-4314-bcd1-7c948ac0b75c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/c23b6c42-df64-4fab-9a29-ba638027a163" status: 404 len: 111 microversion: 2.1 time: 0.043433 Oct 27 03:24:55.172815 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 670/1291] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:55 2022] GET /compute/v2.1/servers/c23b6c42-df64-4fab-9a29-ba638027a163 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:24:55.194839 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2b183207-1aff-4c42-93bf-470514a0b10f tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:55.196497 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-2b183207-1aff-4c42-93bf-470514a0b10f tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: e8781053-3dad-4951-b4cb-1f4aaf97e19b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:55.262224 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2b183207-1aff-4c42-93bf-470514a0b10f tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:55.267699 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-15072d8c-9e16-4d0c-953e-a23eebc40b8e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.25 time: 1.129896 Oct 27 03:24:55.275305 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 622/1292] 10.222.0.20 () {62 vars in 1188 bytes} [Thu Oct 27 03:24:54 2022] POST /compute/v2.1/servers => generated 406 bytes in 1138 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 27 03:24:55.279213 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2b183207-1aff-4c42-93bf-470514a0b10f tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b" status: 200 len: 1213 microversion: 2.1 time: 0.104227 Oct 27 03:24:55.279973 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 671/1293] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:55 2022] GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b => generated 1213 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:55.281942 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0c0ec219-2594-4aa0-8684-f7de6cd74d91 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:55.283316 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0c0ec219-2594-4aa0-8684-f7de6cd74d91 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 33d5c62a-898f-441b-a1a1-3cb12836755d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:55.291537 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0c0ec219-2594-4aa0-8684-f7de6cd74d91 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:55.292695 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0c0ec219-2594-4aa0-8684-f7de6cd74d91 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:55.293372 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0c0ec219-2594-4aa0-8684-f7de6cd74d91 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:55.294429 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0c0ec219-2594-4aa0-8684-f7de6cd74d91 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:55.295374 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0c0ec219-2594-4aa0-8684-f7de6cd74d91 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:55.296295 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0c0ec219-2594-4aa0-8684-f7de6cd74d91 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:55.297277 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8e3a748a-e956-4fe4-8381-bf8433b22468 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:55.298619 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8e3a748a-e956-4fe4-8381-bf8433b22468 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: 543fdf60-10ec-4a25-a9d0-30c386efb104] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:55.312601 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8e3a748a-e956-4fe4-8381-bf8433b22468 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:55.313723 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8e3a748a-e956-4fe4-8381-bf8433b22468 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:55.315040 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8e3a748a-e956-4fe4-8381-bf8433b22468 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:55.315883 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8e3a748a-e956-4fe4-8381-bf8433b22468 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:55.316632 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8e3a748a-e956-4fe4-8381-bf8433b22468 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:55.317744 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8e3a748a-e956-4fe4-8381-bf8433b22468 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:55.491785 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0c0ec219-2594-4aa0-8684-f7de6cd74d91 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:55.505147 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0c0ec219-2594-4aa0-8684-f7de6cd74d91 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/33d5c62a-898f-441b-a1a1-3cb12836755d" status: 200 len: 1308 microversion: 2.1 time: 0.226987 Oct 27 03:24:55.509769 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 623/1294] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:55 2022] GET /compute/v2.1/servers/33d5c62a-898f-441b-a1a1-3cb12836755d => generated 1308 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:55.534163 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e759f28e-c629-42e4-8364-6b054b328921 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:55.537044 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e759f28e-c629-42e4-8364-6b054b328921 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] [instance: 2d8a44aa-62e4-4385-b295-924517b6f850] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:55.551558 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8e3a748a-e956-4fe4-8381-bf8433b22468 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:55.561336 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8e3a748a-e956-4fe4-8381-bf8433b22468 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104" status: 200 len: 1360 microversion: 2.1 time: 0.280508 Oct 27 03:24:55.562293 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 672/1295] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:55 2022] GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104 => generated 1360 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:55.622397 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e759f28e-c629-42e4-8364-6b054b328921 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ccd5909fb214f71ad68704019c9e4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d2c150feac4d03966a860ab8bafe00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:55.633002 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e759f28e-c629-42e4-8364-6b054b328921 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] 10.222.0.20 "GET /compute/v2.1/servers/2d8a44aa-62e4-4385-b295-924517b6f850" status: 200 len: 1222 microversion: 2.1 time: 0.109716 Oct 27 03:24:55.633977 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 624/1296] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:55 2022] GET /compute/v2.1/servers/2d8a44aa-62e4-4385-b295-924517b6f850 => generated 1222 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:55.654857 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-14651b6d-088d-4225-8808-e63c42ede87e tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:55.665575 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-14651b6d-088d-4225-8808-e63c42ede87e tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: b251e3ee-3076-4374-ba01-89488f4d8fc3] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:55.674098 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-14651b6d-088d-4225-8808-e63c42ede87e tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:55.674689 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-14651b6d-088d-4225-8808-e63c42ede87e tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:55.675169 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-14651b6d-088d-4225-8808-e63c42ede87e tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:55.677403 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-14651b6d-088d-4225-8808-e63c42ede87e tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:55.677979 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-14651b6d-088d-4225-8808-e63c42ede87e tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:55.683027 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-14651b6d-088d-4225-8808-e63c42ede87e tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:55.721338 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-14651b6d-088d-4225-8808-e63c42ede87e tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: b251e3ee-3076-4374-ba01-89488f4d8fc3] Going to try to terminate instance {{(pid=121001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:24:55.853391 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-960fcb6b-9194-40d8-bf42-997e96357edd tempest-ServicesAdminNegativeTestJSON-1473358602 tempest-ServicesAdminNegativeTestJSON-1473358602-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:55.853391 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-960fcb6b-9194-40d8-bf42-997e96357edd tempest-ServicesAdminNegativeTestJSON-1473358602 tempest-ServicesAdminNegativeTestJSON-1473358602-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'bb5c75219676452896894e07d79cc57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53cd3ceb4fb412e917276a06b82da88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:55.853391 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-960fcb6b-9194-40d8-bf42-997e96357edd tempest-ServicesAdminNegativeTestJSON-1473358602 tempest-ServicesAdminNegativeTestJSON-1473358602-project] Request method failure captured: Oct 27 03:24:55.853391 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 27 03:24:55.853391 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:24:55.853391 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:24:55.853391 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:24:55.853391 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:24:55.853391 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:24:55.853391 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:24:55.853391 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:24:55.853391 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:24:55.853391 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfoD6MKrCeTYpWqm840YYaLPoy5FQn4qpz3LJYPhTlsXNHQf1upwC58cC58yBuQyLiA6G-7T5Aoo4_Uygnqhp5W4_h_8O6qklAT_yFhDwU07FDVvwEm7k6eVs62nr1rSZnPuaalps3XcokFLRq3rxY3SXUNuCKSe8lRIXLiQZSRIhuQ Oct 27 03:24:55.853391 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:24:55.853391 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:24:55.855440 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:24:55.855440 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:24:55.855440 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:24:55.855440 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:24:55.855440 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: d53cd3ceb4fb412e917276a06b82da88 Oct 27 03:24:55.855440 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-1473358602 Oct 27 03:24:55.855440 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:24:55.855440 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:24:55.855440 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d53cd3ceb4fb412e917276a06b82da88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d53cd3ceb4fb412e917276a06b82da88"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d53cd3ceb4fb412e917276a06b82da88"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d53cd3ceb4fb412e917276a06b82da88"}]}] Oct 27 03:24:55.855440 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-1473358602 Oct 27 03:24:55.855440 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: d53cd3ceb4fb412e917276a06b82da88 Oct 27 03:24:55.855440 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-1473358602 Oct 27 03:24:55.855440 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ServicesAdminNegativeTestJSON-1473358602-project Oct 27 03:24:55.855440 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:24:55.855440 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:24:55.855440 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: bb5c75219676452896894e07d79cc57e Oct 27 03:24:55.855440 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-1473358602-project Oct 27 03:24:55.856887 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:24:55.856887 n-d-862769-1 devstack@n-api.service[121000]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 27 03:24:55.856887 n-d-862769-1 devstack@n-api.service[121000]: action_args: {} Oct 27 03:24:55.856887 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:24:55.856887 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:24:55.856887 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:24:55.856887 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:24:55.856887 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:24:55.856887 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:24:55.856887 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 03:24:55.856887 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:24:55.856887 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 03:24:55.856887 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:24:55.856887 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:24:55.856887 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:24:55.856887 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 27 03:24:55.856887 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 27 03:24:55.856887 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 03:24:55.856887 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 03:24:55.856887 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 03:24:55.858166 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 03:24:55.858166 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 03:24:55.858166 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 03:24:55.858166 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 03:24:55.858166 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 03:24:55.858166 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 03:24:55.858166 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 03:24:55.858166 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 03:24:55.858166 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 03:24:55.858166 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 03:24:55.858166 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 03:24:55.858166 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 27 03:24:55.858166 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:24:55.858166 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:24:55.858166 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:24:55.858166 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:24:55.858166 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:24:55.858166 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:24:55.858166 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 03:24:55.858166 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 03:24:55.859392 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 27 03:24:55.859392 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:24:55.859392 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-960fcb6b-9194-40d8-bf42-997e96357edd tempest-ServicesAdminNegativeTestJSON-1473358602 tempest-ServicesAdminNegativeTestJSON-1473358602-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:24:55.859392 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-960fcb6b-9194-40d8-bf42-997e96357edd tempest-ServicesAdminNegativeTestJSON-1473358602 tempest-ServicesAdminNegativeTestJSON-1473358602-project] 10.222.0.20 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.195529 Oct 27 03:24:55.859392 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 673/1297] 10.222.0.20 () {58 vars in 1137 bytes} [Thu Oct 27 03:24:55 2022] GET /compute/v2.1/os-services => generated 112 bytes in 196 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:24:55.859392 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-dada52d2-5be5-41ed-af11-cd31d20600fc tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:55.859392 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-dada52d2-5be5-41ed-af11-cd31d20600fc tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:55.859872 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:24:55.859872 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-dada52d2-5be5-41ed-af11-cd31d20600fc tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:55.859872 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-dada52d2-5be5-41ed-af11-cd31d20600fc tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:55.860111 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-dada52d2-5be5-41ed-af11-cd31d20600fc tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:55.860111 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-dada52d2-5be5-41ed-af11-cd31d20600fc tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f" status: 200 len: 1284 microversion: 2.25 time: 0.071484 Oct 27 03:24:55.860111 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 674/1298] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:55 2022] GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f => generated 1284 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:24:56.307039 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-674876c6-a0e2-4f89-9635-56aed8d575fc tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:56.308818 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-674876c6-a0e2-4f89-9635-56aed8d575fc tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: e8781053-3dad-4951-b4cb-1f4aaf97e19b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:56.320067 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-674876c6-a0e2-4f89-9635-56aed8d575fc tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:56.321103 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-674876c6-a0e2-4f89-9635-56aed8d575fc tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:56.321886 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-674876c6-a0e2-4f89-9635-56aed8d575fc tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:56.322880 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-674876c6-a0e2-4f89-9635-56aed8d575fc tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:56.323726 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-674876c6-a0e2-4f89-9635-56aed8d575fc tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:56.324447 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-674876c6-a0e2-4f89-9635-56aed8d575fc tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:56.415856 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-674876c6-a0e2-4f89-9635-56aed8d575fc tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:56.425797 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-674876c6-a0e2-4f89-9635-56aed8d575fc tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b" status: 200 len: 1217 microversion: 2.1 time: 0.124005 Oct 27 03:24:56.427274 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 675/1299] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:56 2022] GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b => generated 1217 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:24:56.432280 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-1d1ce17c-599d-474f-a0ed-2d37a74af26b req-f32b84f9-a388-4494-b35c-6c5976d16b6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "543fdf60-10ec-4a25-a9d0-30c386efb104", "name": "network-vif-plugged", "status": "completed", "tag": "d7e171e9-cc70-4509-97bd-e3890c3c8411"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:24:56.444031 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-1d1ce17c-599d-474f-a0ed-2d37a74af26b req-f32b84f9-a388-4494-b35c-6c5976d16b6c service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:56.444494 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-1d1ce17c-599d-474f-a0ed-2d37a74af26b req-f32b84f9-a388-4494-b35c-6c5976d16b6c service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:56.444937 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-1d1ce17c-599d-474f-a0ed-2d37a74af26b req-f32b84f9-a388-4494-b35c-6c5976d16b6c service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:56.472744 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-1d1ce17c-599d-474f-a0ed-2d37a74af26b req-f32b84f9-a388-4494-b35c-6c5976d16b6c service nova] Creating event network-vif-plugged:d7e171e9-cc70-4509-97bd-e3890c3c8411 for instance 543fdf60-10ec-4a25-a9d0-30c386efb104 on n-h2-862769-1 Oct 27 03:24:56.479914 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-1d1ce17c-599d-474f-a0ed-2d37a74af26b req-f32b84f9-a388-4494-b35c-6c5976d16b6c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051045 Oct 27 03:24:56.480723 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 676/1300] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:24:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:24:56.538627 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ba289f13-4690-4dd6-a501-03dd17877807 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:56.539895 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ba289f13-4690-4dd6-a501-03dd17877807 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 33d5c62a-898f-441b-a1a1-3cb12836755d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:56.556931 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ba289f13-4690-4dd6-a501-03dd17877807 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:56.558603 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ba289f13-4690-4dd6-a501-03dd17877807 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:56.565175 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ba289f13-4690-4dd6-a501-03dd17877807 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:56.566406 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ba289f13-4690-4dd6-a501-03dd17877807 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:56.568267 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ba289f13-4690-4dd6-a501-03dd17877807 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:56.570880 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ba289f13-4690-4dd6-a501-03dd17877807 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:56.596781 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-14651b6d-088d-4225-8808-e63c42ede87e tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b251e3ee-3076-4374-ba01-89488f4d8fc3" status: 204 len: 0 microversion: 2.1 time: 0.960467 Oct 27 03:24:56.599097 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 625/1301] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:24:55 2022] DELETE /compute/v2.1/servers/b251e3ee-3076-4374-ba01-89488f4d8fc3 => generated 0 bytes in 963 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:24:56.610648 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-fcf99541-5036-4239-9767-604d41d4aeb8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:56.612200 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-fcf99541-5036-4239-9767-604d41d4aeb8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: 543fdf60-10ec-4a25-a9d0-30c386efb104] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:56.625960 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fcf99541-5036-4239-9767-604d41d4aeb8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:56.629903 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fcf99541-5036-4239-9767-604d41d4aeb8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:56.631047 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fcf99541-5036-4239-9767-604d41d4aeb8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:56.635206 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fcf99541-5036-4239-9767-604d41d4aeb8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:56.635787 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fcf99541-5036-4239-9767-604d41d4aeb8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:56.636242 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fcf99541-5036-4239-9767-604d41d4aeb8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:56.879907 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ba289f13-4690-4dd6-a501-03dd17877807 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:56.889013 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ba289f13-4690-4dd6-a501-03dd17877807 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/33d5c62a-898f-441b-a1a1-3cb12836755d" status: 200 len: 1308 microversion: 2.1 time: 0.355999 Oct 27 03:24:56.889618 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 677/1302] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:56 2022] GET /compute/v2.1/servers/33d5c62a-898f-441b-a1a1-3cb12836755d => generated 1308 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:56.898354 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0ae16bab-0dc5-4b47-adf6-1d5eb703a65f tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:56.899175 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0ae16bab-0dc5-4b47-adf6-1d5eb703a65f tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: b251e3ee-3076-4374-ba01-89488f4d8fc3] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:56.907923 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0ae16bab-0dc5-4b47-adf6-1d5eb703a65f tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:56.907923 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0ae16bab-0dc5-4b47-adf6-1d5eb703a65f tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:56.908890 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0ae16bab-0dc5-4b47-adf6-1d5eb703a65f tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:56.909760 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0ae16bab-0dc5-4b47-adf6-1d5eb703a65f tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:56.910388 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0ae16bab-0dc5-4b47-adf6-1d5eb703a65f tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:56.911005 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0ae16bab-0dc5-4b47-adf6-1d5eb703a65f tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:57.020547 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-fcf99541-5036-4239-9767-604d41d4aeb8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:57.028831 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-fcf99541-5036-4239-9767-604d41d4aeb8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104" status: 200 len: 1360 microversion: 2.1 time: 0.428398 Oct 27 03:24:57.029426 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 626/1303] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:56 2022] GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104 => generated 1360 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:57.034966 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0d9df058-fd73-4457-9506-b0d233fd1293 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:57.035823 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0d9df058-fd73-4457-9506-b0d233fd1293 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] [instance: 2d8a44aa-62e4-4385-b295-924517b6f850] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:57.118498 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0ae16bab-0dc5-4b47-adf6-1d5eb703a65f tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:57.135834 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0ae16bab-0dc5-4b47-adf6-1d5eb703a65f tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/b251e3ee-3076-4374-ba01-89488f4d8fc3" status: 200 len: 1470 microversion: 2.1 time: 0.245096 Oct 27 03:24:57.140880 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0d9df058-fd73-4457-9506-b0d233fd1293 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ccd5909fb214f71ad68704019c9e4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d2c150feac4d03966a860ab8bafe00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:57.150551 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 678/1304] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:56 2022] GET /compute/v2.1/servers/b251e3ee-3076-4374-ba01-89488f4d8fc3 => generated 1470 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:57.151653 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0d9df058-fd73-4457-9506-b0d233fd1293 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] 10.222.0.20 "GET /compute/v2.1/servers/2d8a44aa-62e4-4385-b295-924517b6f850" status: 200 len: 1222 microversion: 2.1 time: 0.121158 Oct 27 03:24:57.166065 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 627/1305] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:57 2022] GET /compute/v2.1/servers/2d8a44aa-62e4-4385-b295-924517b6f850 => generated 1222 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:57.170824 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7c45bd85-6f33-4c64-b43b-12ef95723118 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:57.170824 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7c45bd85-6f33-4c64-b43b-12ef95723118 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:57.170824 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7c45bd85-6f33-4c64-b43b-12ef95723118 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:57.170824 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7c45bd85-6f33-4c64-b43b-12ef95723118 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:57.171498 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7c45bd85-6f33-4c64-b43b-12ef95723118 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:57.171498 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7c45bd85-6f33-4c64-b43b-12ef95723118 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:57.171498 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7c45bd85-6f33-4c64-b43b-12ef95723118 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:57.171498 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7c45bd85-6f33-4c64-b43b-12ef95723118 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:57.247041 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7c45bd85-6f33-4c64-b43b-12ef95723118 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:57.255283 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7c45bd85-6f33-4c64-b43b-12ef95723118 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:57.256720 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7c45bd85-6f33-4c64-b43b-12ef95723118 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:57.257833 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7c45bd85-6f33-4c64-b43b-12ef95723118 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f" status: 200 len: 1288 microversion: 2.25 time: 0.106164 Oct 27 03:24:57.258421 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 679/1306] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:57 2022] GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f => generated 1288 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:24:57.449573 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a46be911-0861-445e-bdeb-934301968ae8 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:57.450260 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a46be911-0861-445e-bdeb-934301968ae8 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: e8781053-3dad-4951-b4cb-1f4aaf97e19b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:57.456781 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a46be911-0861-445e-bdeb-934301968ae8 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:57.457266 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a46be911-0861-445e-bdeb-934301968ae8 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:57.457705 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a46be911-0861-445e-bdeb-934301968ae8 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:57.458427 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a46be911-0861-445e-bdeb-934301968ae8 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:57.458907 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a46be911-0861-445e-bdeb-934301968ae8 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:57.459498 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a46be911-0861-445e-bdeb-934301968ae8 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:57.537695 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a46be911-0861-445e-bdeb-934301968ae8 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:57.548348 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a46be911-0861-445e-bdeb-934301968ae8 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b" status: 200 len: 1265 microversion: 2.1 time: 0.102477 Oct 27 03:24:57.550430 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 628/1307] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:57 2022] GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b => generated 1265 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:57.912202 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f0edfef4-e5d6-4b32-aa1b-81465163a12e tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:57.912832 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f0edfef4-e5d6-4b32-aa1b-81465163a12e tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 33d5c62a-898f-441b-a1a1-3cb12836755d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:57.919529 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f0edfef4-e5d6-4b32-aa1b-81465163a12e tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:57.920024 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f0edfef4-e5d6-4b32-aa1b-81465163a12e tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:57.920472 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f0edfef4-e5d6-4b32-aa1b-81465163a12e tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:57.921175 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f0edfef4-e5d6-4b32-aa1b-81465163a12e tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:57.921639 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f0edfef4-e5d6-4b32-aa1b-81465163a12e tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:57.922110 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f0edfef4-e5d6-4b32-aa1b-81465163a12e tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:58.062268 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2daf4099-6b2f-4dbb-892d-b29376a49894 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:58.067970 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2daf4099-6b2f-4dbb-892d-b29376a49894 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: 543fdf60-10ec-4a25-a9d0-30c386efb104] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:58.075641 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2daf4099-6b2f-4dbb-892d-b29376a49894 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:58.075807 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2daf4099-6b2f-4dbb-892d-b29376a49894 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:58.076248 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2daf4099-6b2f-4dbb-892d-b29376a49894 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:58.077517 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2daf4099-6b2f-4dbb-892d-b29376a49894 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:58.078259 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2daf4099-6b2f-4dbb-892d-b29376a49894 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:58.078904 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2daf4099-6b2f-4dbb-892d-b29376a49894 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:58.082431 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f0edfef4-e5d6-4b32-aa1b-81465163a12e tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:58.110911 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f0edfef4-e5d6-4b32-aa1b-81465163a12e tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/33d5c62a-898f-441b-a1a1-3cb12836755d" status: 200 len: 1308 microversion: 2.1 time: 0.202552 Oct 27 03:24:58.112105 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 680/1308] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:57 2022] GET /compute/v2.1/servers/33d5c62a-898f-441b-a1a1-3cb12836755d => generated 1308 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:58.164299 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d7b48abc-287d-40df-baac-91695c2f583c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:58.164929 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d7b48abc-287d-40df-baac-91695c2f583c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: b251e3ee-3076-4374-ba01-89488f4d8fc3] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:58.171569 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d7b48abc-287d-40df-baac-91695c2f583c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:58.172121 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d7b48abc-287d-40df-baac-91695c2f583c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:58.172576 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d7b48abc-287d-40df-baac-91695c2f583c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:58.176877 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d7b48abc-287d-40df-baac-91695c2f583c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:58.177460 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d7b48abc-287d-40df-baac-91695c2f583c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:58.177928 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d7b48abc-287d-40df-baac-91695c2f583c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:58.388110 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d7b48abc-287d-40df-baac-91695c2f583c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:58.398932 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d7b48abc-287d-40df-baac-91695c2f583c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/b251e3ee-3076-4374-ba01-89488f4d8fc3" status: 200 len: 1470 microversion: 2.1 time: 0.238260 Oct 27 03:24:58.402214 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 681/1309] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:58 2022] GET /compute/v2.1/servers/b251e3ee-3076-4374-ba01-89488f4d8fc3 => generated 1470 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:24:58.405267 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f238e43e-a9f8-48ca-8e22-a9603a1fd0bc tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:58.409340 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2daf4099-6b2f-4dbb-892d-b29376a49894 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:58.418184 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f238e43e-a9f8-48ca-8e22-a9603a1fd0bc tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] [instance: 2d8a44aa-62e4-4385-b295-924517b6f850] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:58.419401 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2daf4099-6b2f-4dbb-892d-b29376a49894 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104" status: 200 len: 1360 microversion: 2.1 time: 0.370991 Oct 27 03:24:58.423478 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 629/1310] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:58 2022] GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104 => generated 1360 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:24:58.431805 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-fa6a213b-7233-4e09-8ca5-e33483bba250 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:58.436350 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f238e43e-a9f8-48ca-8e22-a9603a1fd0bc tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:58.436350 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f238e43e-a9f8-48ca-8e22-a9603a1fd0bc tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:58.436350 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f238e43e-a9f8-48ca-8e22-a9603a1fd0bc tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:58.436635 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-fa6a213b-7233-4e09-8ca5-e33483bba250 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:58.436950 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f238e43e-a9f8-48ca-8e22-a9603a1fd0bc tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:58.437447 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f238e43e-a9f8-48ca-8e22-a9603a1fd0bc tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:58.438497 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f238e43e-a9f8-48ca-8e22-a9603a1fd0bc tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:58.449338 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fa6a213b-7233-4e09-8ca5-e33483bba250 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:58.449844 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fa6a213b-7233-4e09-8ca5-e33483bba250 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:58.450387 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fa6a213b-7233-4e09-8ca5-e33483bba250 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:58.451180 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fa6a213b-7233-4e09-8ca5-e33483bba250 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:58.451650 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fa6a213b-7233-4e09-8ca5-e33483bba250 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:58.452085 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fa6a213b-7233-4e09-8ca5-e33483bba250 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:58.521710 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f238e43e-a9f8-48ca-8e22-a9603a1fd0bc tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ccd5909fb214f71ad68704019c9e4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d2c150feac4d03966a860ab8bafe00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:58.529771 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f238e43e-a9f8-48ca-8e22-a9603a1fd0bc tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] 10.222.0.20 "GET /compute/v2.1/servers/2d8a44aa-62e4-4385-b295-924517b6f850" status: 200 len: 1218 microversion: 2.1 time: 0.128688 Oct 27 03:24:58.530410 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 682/1311] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:58 2022] GET /compute/v2.1/servers/2d8a44aa-62e4-4385-b295-924517b6f850 => generated 1218 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:58.535730 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-8c83a127-7fef-4951-98a7-204d150acaec req-26d6e4db-39cc-4a5c-becd-376b9b44c67b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33d5c62a-898f-441b-a1a1-3cb12836755d", "name": "network-vif-plugged", "status": "completed", "tag": "0fee4f52-9d23-48f3-b849-8399851e00ed"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:24:58.545355 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-8c83a127-7fef-4951-98a7-204d150acaec req-26d6e4db-39cc-4a5c-becd-376b9b44c67b service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:58.545840 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-8c83a127-7fef-4951-98a7-204d150acaec req-26d6e4db-39cc-4a5c-becd-376b9b44c67b service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:58.546314 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-8c83a127-7fef-4951-98a7-204d150acaec req-26d6e4db-39cc-4a5c-becd-376b9b44c67b service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:58.557706 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-8c83a127-7fef-4951-98a7-204d150acaec req-26d6e4db-39cc-4a5c-becd-376b9b44c67b service nova] Creating event network-vif-plugged:0fee4f52-9d23-48f3-b849-8399851e00ed for instance 33d5c62a-898f-441b-a1a1-3cb12836755d on n-h2-862769-1 Oct 27 03:24:58.562558 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-8c83a127-7fef-4951-98a7-204d150acaec req-26d6e4db-39cc-4a5c-becd-376b9b44c67b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030816 Oct 27 03:24:58.563162 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 683/1312] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:24:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:24:58.575584 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b65d96e8-c4d8-416b-abc7-adc02bc3b58b tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:58.576775 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b65d96e8-c4d8-416b-abc7-adc02bc3b58b tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: e8781053-3dad-4951-b4cb-1f4aaf97e19b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:58.584217 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b65d96e8-c4d8-416b-abc7-adc02bc3b58b tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:58.585291 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b65d96e8-c4d8-416b-abc7-adc02bc3b58b tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:58.585737 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b65d96e8-c4d8-416b-abc7-adc02bc3b58b tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:58.586495 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b65d96e8-c4d8-416b-abc7-adc02bc3b58b tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:58.586963 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b65d96e8-c4d8-416b-abc7-adc02bc3b58b tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:58.587400 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b65d96e8-c4d8-416b-abc7-adc02bc3b58b tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:58.616965 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-fa6a213b-7233-4e09-8ca5-e33483bba250 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:58.625819 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-fa6a213b-7233-4e09-8ca5-e33483bba250 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:58.627363 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-fa6a213b-7233-4e09-8ca5-e33483bba250 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:58.632784 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-fa6a213b-7233-4e09-8ca5-e33483bba250 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f" status: 200 len: 1280 microversion: 2.25 time: 0.207354 Oct 27 03:24:58.638644 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 630/1313] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:58 2022] GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f => generated 1280 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:24:58.700364 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b65d96e8-c4d8-416b-abc7-adc02bc3b58b tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:58.717592 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b65d96e8-c4d8-416b-abc7-adc02bc3b58b tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b" status: 200 len: 1273 microversion: 2.1 time: 0.147565 Oct 27 03:24:58.719756 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 684/1314] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:58 2022] GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b => generated 1273 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:24:59.135183 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4d525fdb-f535-4b4c-b138-c7be678dcb32 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:59.136206 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4d525fdb-f535-4b4c-b138-c7be678dcb32 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 33d5c62a-898f-441b-a1a1-3cb12836755d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:59.148209 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4d525fdb-f535-4b4c-b138-c7be678dcb32 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:59.148702 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4d525fdb-f535-4b4c-b138-c7be678dcb32 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:59.149200 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4d525fdb-f535-4b4c-b138-c7be678dcb32 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:59.149897 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4d525fdb-f535-4b4c-b138-c7be678dcb32 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:59.150394 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4d525fdb-f535-4b4c-b138-c7be678dcb32 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:59.150827 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4d525fdb-f535-4b4c-b138-c7be678dcb32 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:59.277990 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-222529f6-2b89-4e17-8d31-a20e0c451381 req-a97eb263-5bf0-4745-bf1b-107f38f8dd49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b251e3ee-3076-4374-ba01-89488f4d8fc3", "name": "network-vif-deleted", "tag": "0a82a95e-2201-4788-9f0f-38a02ca38ffc"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:24:59.290103 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-222529f6-2b89-4e17-8d31-a20e0c451381 req-a97eb263-5bf0-4745-bf1b-107f38f8dd49 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:59.290866 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-222529f6-2b89-4e17-8d31-a20e0c451381 req-a97eb263-5bf0-4745-bf1b-107f38f8dd49 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:59.291300 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-222529f6-2b89-4e17-8d31-a20e0c451381 req-a97eb263-5bf0-4745-bf1b-107f38f8dd49 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:59.304468 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-222529f6-2b89-4e17-8d31-a20e0c451381 req-a97eb263-5bf0-4745-bf1b-107f38f8dd49 service nova] Creating event network-vif-deleted:0a82a95e-2201-4788-9f0f-38a02ca38ffc for instance b251e3ee-3076-4374-ba01-89488f4d8fc3 on n-h1-862769-1 Oct 27 03:24:59.310471 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-222529f6-2b89-4e17-8d31-a20e0c451381 req-a97eb263-5bf0-4745-bf1b-107f38f8dd49 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036045 Oct 27 03:24:59.311511 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 685/1315] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:24:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:24:59.424767 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4d525fdb-f535-4b4c-b138-c7be678dcb32 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:59.429994 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-975f8dcc-387b-4b97-9881-10b2699fe18c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:59.431465 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-975f8dcc-387b-4b97-9881-10b2699fe18c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: b251e3ee-3076-4374-ba01-89488f4d8fc3] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:59.446598 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-975f8dcc-387b-4b97-9881-10b2699fe18c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:59.448692 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4d525fdb-f535-4b4c-b138-c7be678dcb32 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/33d5c62a-898f-441b-a1a1-3cb12836755d" status: 200 len: 1308 microversion: 2.1 time: 0.317553 Oct 27 03:24:59.449440 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-975f8dcc-387b-4b97-9881-10b2699fe18c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:59.451755 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-975f8dcc-387b-4b97-9881-10b2699fe18c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:59.453303 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 631/1316] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:59 2022] GET /compute/v2.1/servers/33d5c62a-898f-441b-a1a1-3cb12836755d => generated 1308 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:59.458063 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-975f8dcc-387b-4b97-9881-10b2699fe18c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:59.458806 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-975f8dcc-387b-4b97-9881-10b2699fe18c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:59.459536 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-975f8dcc-387b-4b97-9881-10b2699fe18c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:59.471536 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-91576bbb-9ab7-4b77-8a9f-470ac362d6a8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:59.473146 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-91576bbb-9ab7-4b77-8a9f-470ac362d6a8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: 543fdf60-10ec-4a25-a9d0-30c386efb104] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:59.489815 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-91576bbb-9ab7-4b77-8a9f-470ac362d6a8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:59.493904 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-91576bbb-9ab7-4b77-8a9f-470ac362d6a8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:59.494490 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-91576bbb-9ab7-4b77-8a9f-470ac362d6a8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:59.495466 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-91576bbb-9ab7-4b77-8a9f-470ac362d6a8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:59.496144 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-91576bbb-9ab7-4b77-8a9f-470ac362d6a8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:59.498840 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-91576bbb-9ab7-4b77-8a9f-470ac362d6a8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:59.634753 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-975f8dcc-387b-4b97-9881-10b2699fe18c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:59.642715 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-975f8dcc-387b-4b97-9881-10b2699fe18c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/b251e3ee-3076-4374-ba01-89488f4d8fc3" status: 200 len: 1428 microversion: 2.1 time: 0.220534 Oct 27 03:24:59.643303 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 686/1317] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:59 2022] GET /compute/v2.1/servers/b251e3ee-3076-4374-ba01-89488f4d8fc3 => generated 1428 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:24:59.650530 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2180649b-30e2-42cb-b42c-cfb3d0a56856 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:59.651967 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-2180649b-30e2-42cb-b42c-cfb3d0a56856 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] [instance: 2d8a44aa-62e4-4385-b295-924517b6f850] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:59.658678 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2180649b-30e2-42cb-b42c-cfb3d0a56856 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:59.666640 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2180649b-30e2-42cb-b42c-cfb3d0a56856 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:59.670795 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2180649b-30e2-42cb-b42c-cfb3d0a56856 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:59.672173 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2180649b-30e2-42cb-b42c-cfb3d0a56856 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:59.672769 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2180649b-30e2-42cb-b42c-cfb3d0a56856 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:59.673313 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2180649b-30e2-42cb-b42c-cfb3d0a56856 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:59.678938 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=100 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:24:59.746674 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-91576bbb-9ab7-4b77-8a9f-470ac362d6a8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:59.779605 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-91576bbb-9ab7-4b77-8a9f-470ac362d6a8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104" status: 200 len: 1544 microversion: 2.1 time: 0.309021 Oct 27 03:24:59.781339 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 632/1318] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:59 2022] GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104 => generated 1544 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:59.794379 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8af28ec7-947f-424b-b428-634d209d4d75 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:59.802902 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8af28ec7-947f-424b-b428-634d209d4d75 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:59.806788 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8af28ec7-947f-424b-b428-634d209d4d75 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:59.807302 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8af28ec7-947f-424b-b428-634d209d4d75 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:59.807758 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8af28ec7-947f-424b-b428-634d209d4d75 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:59.809237 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8af28ec7-947f-424b-b428-634d209d4d75 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:59.812465 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8af28ec7-947f-424b-b428-634d209d4d75 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:59.813134 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8af28ec7-947f-424b-b428-634d209d4d75 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:59.831190 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2180649b-30e2-42cb-b42c-cfb3d0a56856 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ccd5909fb214f71ad68704019c9e4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d2c150feac4d03966a860ab8bafe00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:59.841347 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2180649b-30e2-42cb-b42c-cfb3d0a56856 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] 10.222.0.20 "GET /compute/v2.1/servers/2d8a44aa-62e4-4385-b295-924517b6f850" status: 200 len: 1218 microversion: 2.1 time: 0.196671 Oct 27 03:24:59.866470 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 687/1319] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:59 2022] GET /compute/v2.1/servers/2d8a44aa-62e4-4385-b295-924517b6f850 => generated 1218 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:24:59.872178 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1b967793-10ff-4b78-91b9-ac7f65683209 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:59.874756 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1b967793-10ff-4b78-91b9-ac7f65683209 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: e8781053-3dad-4951-b4cb-1f4aaf97e19b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:24:59.889477 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1b967793-10ff-4b78-91b9-ac7f65683209 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:59.889477 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1b967793-10ff-4b78-91b9-ac7f65683209 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:59.890309 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1b967793-10ff-4b78-91b9-ac7f65683209 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:59.891089 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1b967793-10ff-4b78-91b9-ac7f65683209 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:24:59.892322 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1b967793-10ff-4b78-91b9-ac7f65683209 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:24:59.892972 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1b967793-10ff-4b78-91b9-ac7f65683209 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:24:59.936570 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8af28ec7-947f-424b-b428-634d209d4d75 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:59.947004 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8af28ec7-947f-424b-b428-634d209d4d75 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:59.948915 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8af28ec7-947f-424b-b428-634d209d4d75 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:24:59.950304 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8af28ec7-947f-424b-b428-634d209d4d75 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f" status: 200 len: 1344 microversion: 2.25 time: 0.167664 Oct 27 03:24:59.951083 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 633/1320] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:24:59 2022] GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f => generated 1344 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:24:59.957084 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3780b5b5-2d84-4dab-ab94-c36ab6eacff5 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:24:59.957949 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3780b5b5-2d84-4dab-ab94-c36ab6eacff5 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: 543fdf60-10ec-4a25-a9d0-30c386efb104] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:00.004722 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3780b5b5-2d84-4dab-ab94-c36ab6eacff5 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:00.004722 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3780b5b5-2d84-4dab-ab94-c36ab6eacff5 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:00.004722 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3780b5b5-2d84-4dab-ab94-c36ab6eacff5 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:00.007521 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3780b5b5-2d84-4dab-ab94-c36ab6eacff5 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:00.008042 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3780b5b5-2d84-4dab-ab94-c36ab6eacff5 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:00.008497 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3780b5b5-2d84-4dab-ab94-c36ab6eacff5 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:00.156972 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1b967793-10ff-4b78-91b9-ac7f65683209 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:00.165562 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1b967793-10ff-4b78-91b9-ac7f65683209 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b" status: 200 len: 1313 microversion: 2.1 time: 0.297541 Oct 27 03:25:00.166299 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 688/1321] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:24:59 2022] GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b => generated 1313 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:00.270098 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3780b5b5-2d84-4dab-ab94-c36ab6eacff5 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.317759 Oct 27 03:25:00.270706 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 634/1322] 10.222.0.20 () {58 vars in 1275 bytes} [Thu Oct 27 03:24:59 2022] GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104/os-interface => generated 285 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:25:00.476863 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5fa428f8-62d4-4c3f-91de-9ec960434ad2 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:00.477501 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5fa428f8-62d4-4c3f-91de-9ec960434ad2 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 33d5c62a-898f-441b-a1a1-3cb12836755d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:00.495025 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5fa428f8-62d4-4c3f-91de-9ec960434ad2 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:00.495749 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5fa428f8-62d4-4c3f-91de-9ec960434ad2 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:00.502453 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5fa428f8-62d4-4c3f-91de-9ec960434ad2 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:00.502453 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5fa428f8-62d4-4c3f-91de-9ec960434ad2 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:00.502453 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5fa428f8-62d4-4c3f-91de-9ec960434ad2 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:00.502453 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5fa428f8-62d4-4c3f-91de-9ec960434ad2 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:00.676283 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6a9e59a3-bcff-4cad-ba7f-087ae0f140ee tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:00.677141 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-6a9e59a3-bcff-4cad-ba7f-087ae0f140ee tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: b251e3ee-3076-4374-ba01-89488f4d8fc3] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:00.688527 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6a9e59a3-bcff-4cad-ba7f-087ae0f140ee tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:00.690215 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6a9e59a3-bcff-4cad-ba7f-087ae0f140ee tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:00.690825 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6a9e59a3-bcff-4cad-ba7f-087ae0f140ee tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:00.692372 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6a9e59a3-bcff-4cad-ba7f-087ae0f140ee tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:00.693030 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6a9e59a3-bcff-4cad-ba7f-087ae0f140ee tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:00.693704 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6a9e59a3-bcff-4cad-ba7f-087ae0f140ee tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:00.740549 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6a9e59a3-bcff-4cad-ba7f-087ae0f140ee tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:00.741320 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6a9e59a3-bcff-4cad-ba7f-087ae0f140ee tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:00.741935 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6a9e59a3-bcff-4cad-ba7f-087ae0f140ee tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:00.742581 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-6a9e59a3-bcff-4cad-ba7f-087ae0f140ee tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lazy-loading 'fault' on Instance uuid b251e3ee-3076-4374-ba01-89488f4d8fc3 {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:25:00.846960 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6a9e59a3-bcff-4cad-ba7f-087ae0f140ee tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:00.856089 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6a9e59a3-bcff-4cad-ba7f-087ae0f140ee tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/b251e3ee-3076-4374-ba01-89488f4d8fc3" status: 200 len: 1304 microversion: 2.1 time: 0.192073 Oct 27 03:25:00.870914 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 635/1323] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:00 2022] GET /compute/v2.1/servers/b251e3ee-3076-4374-ba01-89488f4d8fc3 => generated 1304 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:00.879780 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4c2a6d10-26f6-48ae-925e-17e35661c99f tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:00.881141 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4c2a6d10-26f6-48ae-925e-17e35661c99f tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] [instance: 2d8a44aa-62e4-4385-b295-924517b6f850] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:00.888810 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4c2a6d10-26f6-48ae-925e-17e35661c99f tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:00.889554 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4c2a6d10-26f6-48ae-925e-17e35661c99f tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:00.890233 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4c2a6d10-26f6-48ae-925e-17e35661c99f tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:00.891630 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4c2a6d10-26f6-48ae-925e-17e35661c99f tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:00.892256 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4c2a6d10-26f6-48ae-925e-17e35661c99f tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:00.892898 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4c2a6d10-26f6-48ae-925e-17e35661c99f tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:00.976082 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5fa428f8-62d4-4c3f-91de-9ec960434ad2 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:00.994257 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5fa428f8-62d4-4c3f-91de-9ec960434ad2 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/33d5c62a-898f-441b-a1a1-3cb12836755d" status: 200 len: 1487 microversion: 2.1 time: 0.521609 Oct 27 03:25:00.995383 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 689/1324] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:00 2022] GET /compute/v2.1/servers/33d5c62a-898f-441b-a1a1-3cb12836755d => generated 1487 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:01.003149 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9b16891c-7e40-451c-befe-487ab2cecf37 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:01.004054 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9b16891c-7e40-451c-befe-487ab2cecf37 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:01.019302 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9b16891c-7e40-451c-befe-487ab2cecf37 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:01.019736 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9b16891c-7e40-451c-befe-487ab2cecf37 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:01.020181 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9b16891c-7e40-451c-befe-487ab2cecf37 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:01.020950 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9b16891c-7e40-451c-befe-487ab2cecf37 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:01.021434 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9b16891c-7e40-451c-befe-487ab2cecf37 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:01.022154 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9b16891c-7e40-451c-befe-487ab2cecf37 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:01.025581 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4c2a6d10-26f6-48ae-925e-17e35661c99f tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ccd5909fb214f71ad68704019c9e4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d2c150feac4d03966a860ab8bafe00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:01.039665 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4c2a6d10-26f6-48ae-925e-17e35661c99f tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] 10.222.0.20 "GET /compute/v2.1/servers/2d8a44aa-62e4-4385-b295-924517b6f850" status: 200 len: 1274 microversion: 2.1 time: 0.167563 Oct 27 03:25:01.041845 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 636/1325] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:00 2022] GET /compute/v2.1/servers/2d8a44aa-62e4-4385-b295-924517b6f850 => generated 1274 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:01.055671 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0b51f90e-9a0c-4760-81aa-a963e58d3e25 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:25:01.067531 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0b51f90e-9a0c-4760-81aa-a963e58d3e25 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:01.068219 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0b51f90e-9a0c-4760-81aa-a963e58d3e25 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:01.068967 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0b51f90e-9a0c-4760-81aa-a963e58d3e25 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:01.175190 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0b51f90e-9a0c-4760-81aa-a963e58d3e25 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 33d5c62a-898f-441b-a1a1-3cb12836755d] Going to try to stop instance {{(pid=121001) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 27 03:25:01.208010 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:25:01.252394 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9b16891c-7e40-451c-befe-487ab2cecf37 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:01.268754 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9b16891c-7e40-451c-befe-487ab2cecf37 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:01.272463 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9b16891c-7e40-451c-befe-487ab2cecf37 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:01.276361 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9b16891c-7e40-451c-befe-487ab2cecf37 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f" status: 200 len: 1342 microversion: 2.25 time: 0.277781 Oct 27 03:25:01.277259 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 690/1326] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:25:00 2022] GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f => generated 1342 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:25:01.287572 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7fe982da-2844-4281-9d30-20cc2b25be3e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:01.289285 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7fe982da-2844-4281-9d30-20cc2b25be3e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: e8781053-3dad-4951-b4cb-1f4aaf97e19b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:01.295988 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7fe982da-2844-4281-9d30-20cc2b25be3e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:01.296805 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7fe982da-2844-4281-9d30-20cc2b25be3e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:01.297338 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7fe982da-2844-4281-9d30-20cc2b25be3e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:01.298267 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7fe982da-2844-4281-9d30-20cc2b25be3e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:01.299561 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7fe982da-2844-4281-9d30-20cc2b25be3e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:01.300073 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7fe982da-2844-4281-9d30-20cc2b25be3e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:01.422628 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0b51f90e-9a0c-4760-81aa-a963e58d3e25 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "POST /compute/v2.1/servers/33d5c62a-898f-441b-a1a1-3cb12836755d/action" status: 202 len: 0 microversion: 2.1 time: 0.379195 Oct 27 03:25:01.425267 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 637/1327] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:25:01 2022] POST /compute/v2.1/servers/33d5c62a-898f-441b-a1a1-3cb12836755d/action => generated 0 bytes in 383 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:25:01.443430 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ed1d80da-6241-4ca3-8310-3ce9c32b56fb tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:01.447370 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ed1d80da-6241-4ca3-8310-3ce9c32b56fb tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 33d5c62a-898f-441b-a1a1-3cb12836755d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:01.463681 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ed1d80da-6241-4ca3-8310-3ce9c32b56fb tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:01.464220 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ed1d80da-6241-4ca3-8310-3ce9c32b56fb tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:01.464955 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ed1d80da-6241-4ca3-8310-3ce9c32b56fb tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:01.465789 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ed1d80da-6241-4ca3-8310-3ce9c32b56fb tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:01.466439 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ed1d80da-6241-4ca3-8310-3ce9c32b56fb tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:01.468457 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ed1d80da-6241-4ca3-8310-3ce9c32b56fb tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:01.797168 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7fe982da-2844-4281-9d30-20cc2b25be3e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:01.813676 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7fe982da-2844-4281-9d30-20cc2b25be3e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b" status: 200 len: 1313 microversion: 2.1 time: 0.532512 Oct 27 03:25:01.830185 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 691/1328] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:01 2022] GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b => generated 1313 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:01.885379 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-74a1213f-40b8-4123-8745-92929af71b47 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:01.886010 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-74a1213f-40b8-4123-8745-92929af71b47 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: b251e3ee-3076-4374-ba01-89488f4d8fc3] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:01.896576 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-74a1213f-40b8-4123-8745-92929af71b47 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:01.897521 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-74a1213f-40b8-4123-8745-92929af71b47 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:01.910434 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-74a1213f-40b8-4123-8745-92929af71b47 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:01.911364 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-74a1213f-40b8-4123-8745-92929af71b47 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:01.911840 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-74a1213f-40b8-4123-8745-92929af71b47 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:01.912289 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-74a1213f-40b8-4123-8745-92929af71b47 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:01.922405 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ed1d80da-6241-4ca3-8310-3ce9c32b56fb tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:01.936960 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ed1d80da-6241-4ca3-8310-3ce9c32b56fb tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/33d5c62a-898f-441b-a1a1-3cb12836755d" status: 200 len: 1497 microversion: 2.1 time: 0.505985 Oct 27 03:25:01.938588 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 638/1329] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:01 2022] GET /compute/v2.1/servers/33d5c62a-898f-441b-a1a1-3cb12836755d => generated 1497 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:01.945990 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-30fb14a1-3237-4a6a-be13-8d973ed40899 req-e1c96e60-84a1-4b05-b602-3ecc638c927c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8781053-3dad-4951-b4cb-1f4aaf97e19b", "tag": "2db0e1c6-c7e9-4994-9a8c-c23e51c0e800"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:25:01.967648 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-30fb14a1-3237-4a6a-be13-8d973ed40899 req-e1c96e60-84a1-4b05-b602-3ecc638c927c service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:01.971383 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-30fb14a1-3237-4a6a-be13-8d973ed40899 req-e1c96e60-84a1-4b05-b602-3ecc638c927c service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:01.971383 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-30fb14a1-3237-4a6a-be13-8d973ed40899 req-e1c96e60-84a1-4b05-b602-3ecc638c927c service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:01.971600 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-74a1213f-40b8-4123-8745-92929af71b47 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:01.971600 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-74a1213f-40b8-4123-8745-92929af71b47 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:01.971600 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-74a1213f-40b8-4123-8745-92929af71b47 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:01.971600 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-74a1213f-40b8-4123-8745-92929af71b47 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lazy-loading 'fault' on Instance uuid b251e3ee-3076-4374-ba01-89488f4d8fc3 {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:25:01.993459 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-30fb14a1-3237-4a6a-be13-8d973ed40899 req-e1c96e60-84a1-4b05-b602-3ecc638c927c service nova] Creating event network-changed:2db0e1c6-c7e9-4994-9a8c-c23e51c0e800 for instance e8781053-3dad-4951-b4cb-1f4aaf97e19b on n-h2-862769-1 Oct 27 03:25:01.998714 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-30fb14a1-3237-4a6a-be13-8d973ed40899 req-e1c96e60-84a1-4b05-b602-3ecc638c927c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056435 Oct 27 03:25:01.999520 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 639/1330] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:25:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:25:02.078531 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-00f9ad72-8ffc-4e38-a67a-8dbb9067ed21 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:02.079506 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-00f9ad72-8ffc-4e38-a67a-8dbb9067ed21 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] [instance: 2d8a44aa-62e4-4385-b295-924517b6f850] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:02.086462 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-00f9ad72-8ffc-4e38-a67a-8dbb9067ed21 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:02.087644 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-00f9ad72-8ffc-4e38-a67a-8dbb9067ed21 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:02.088258 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-00f9ad72-8ffc-4e38-a67a-8dbb9067ed21 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:02.089141 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-00f9ad72-8ffc-4e38-a67a-8dbb9067ed21 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:02.089756 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-00f9ad72-8ffc-4e38-a67a-8dbb9067ed21 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:02.090369 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-00f9ad72-8ffc-4e38-a67a-8dbb9067ed21 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:02.102425 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-74a1213f-40b8-4123-8745-92929af71b47 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:02.111050 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-74a1213f-40b8-4123-8745-92929af71b47 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/b251e3ee-3076-4374-ba01-89488f4d8fc3" status: 200 len: 1304 microversion: 2.1 time: 0.229645 Oct 27 03:25:02.115529 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 692/1331] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:01 2022] GET /compute/v2.1/servers/b251e3ee-3076-4374-ba01-89488f4d8fc3 => generated 1304 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:25:02.239858 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-00f9ad72-8ffc-4e38-a67a-8dbb9067ed21 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ccd5909fb214f71ad68704019c9e4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d2c150feac4d03966a860ab8bafe00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:02.247621 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-00f9ad72-8ffc-4e38-a67a-8dbb9067ed21 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] 10.222.0.20 "GET /compute/v2.1/servers/2d8a44aa-62e4-4385-b295-924517b6f850" status: 200 len: 1280 microversion: 2.1 time: 0.173338 Oct 27 03:25:02.256211 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 640/1332] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:02 2022] GET /compute/v2.1/servers/2d8a44aa-62e4-4385-b295-924517b6f850 => generated 1280 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:02.305076 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c3ec0d56-d3a7-41d1-8ef0-def20b520a0b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:02.306017 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c3ec0d56-d3a7-41d1-8ef0-def20b520a0b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:02.312927 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c3ec0d56-d3a7-41d1-8ef0-def20b520a0b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:02.318303 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c3ec0d56-d3a7-41d1-8ef0-def20b520a0b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:02.318303 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c3ec0d56-d3a7-41d1-8ef0-def20b520a0b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:02.318303 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c3ec0d56-d3a7-41d1-8ef0-def20b520a0b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:02.318303 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c3ec0d56-d3a7-41d1-8ef0-def20b520a0b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:02.318754 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c3ec0d56-d3a7-41d1-8ef0-def20b520a0b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:02.681082 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c3ec0d56-d3a7-41d1-8ef0-def20b520a0b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:02.689361 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c3ec0d56-d3a7-41d1-8ef0-def20b520a0b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:02.691129 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c3ec0d56-d3a7-41d1-8ef0-def20b520a0b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:02.692716 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c3ec0d56-d3a7-41d1-8ef0-def20b520a0b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f" status: 200 len: 1410 microversion: 2.25 time: 0.391472 Oct 27 03:25:02.693440 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 693/1333] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:25:02 2022] GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f => generated 1410 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:25:02.837279 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-da5089a1-911a-42da-9984-84f88496af75 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:02.837923 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-da5089a1-911a-42da-9984-84f88496af75 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: e8781053-3dad-4951-b4cb-1f4aaf97e19b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:02.844800 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-da5089a1-911a-42da-9984-84f88496af75 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:02.845290 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-da5089a1-911a-42da-9984-84f88496af75 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:02.846421 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-da5089a1-911a-42da-9984-84f88496af75 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:02.847315 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-da5089a1-911a-42da-9984-84f88496af75 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:02.847780 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-da5089a1-911a-42da-9984-84f88496af75 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:02.848210 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-da5089a1-911a-42da-9984-84f88496af75 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:02.963975 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0bc7637d-faa7-4948-ba10-b817007c0e0c tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:02.971408 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0bc7637d-faa7-4948-ba10-b817007c0e0c tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 33d5c62a-898f-441b-a1a1-3cb12836755d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:02.978000 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0bc7637d-faa7-4948-ba10-b817007c0e0c tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:02.979115 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0bc7637d-faa7-4948-ba10-b817007c0e0c tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:02.979884 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0bc7637d-faa7-4948-ba10-b817007c0e0c tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:02.981325 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0bc7637d-faa7-4948-ba10-b817007c0e0c tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:02.983571 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0bc7637d-faa7-4948-ba10-b817007c0e0c tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:02.984492 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0bc7637d-faa7-4948-ba10-b817007c0e0c tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:03.160665 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-da5089a1-911a-42da-9984-84f88496af75 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:03.171978 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-da5089a1-911a-42da-9984-84f88496af75 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b" status: 200 len: 1313 microversion: 2.1 time: 0.338888 Oct 27 03:25:03.188541 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 641/1334] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:02 2022] GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b => generated 1313 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:03.203915 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-7ea1eba7-2455-40f8-97ac-cd558fc785fa req-382d3fc5-0b9a-4636-b086-d560998f136d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "543fdf60-10ec-4a25-a9d0-30c386efb104", "tag": "d7e171e9-cc70-4509-97bd-e3890c3c8411"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:25:03.219717 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-7ea1eba7-2455-40f8-97ac-cd558fc785fa req-382d3fc5-0b9a-4636-b086-d560998f136d service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:03.220424 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-7ea1eba7-2455-40f8-97ac-cd558fc785fa req-382d3fc5-0b9a-4636-b086-d560998f136d service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:03.221276 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-7ea1eba7-2455-40f8-97ac-cd558fc785fa req-382d3fc5-0b9a-4636-b086-d560998f136d service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:03.239044 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-7ea1eba7-2455-40f8-97ac-cd558fc785fa req-382d3fc5-0b9a-4636-b086-d560998f136d service nova] Creating event network-changed:d7e171e9-cc70-4509-97bd-e3890c3c8411 for instance 543fdf60-10ec-4a25-a9d0-30c386efb104 on n-h2-862769-1 Oct 27 03:25:03.248589 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-7ea1eba7-2455-40f8-97ac-cd558fc785fa req-382d3fc5-0b9a-4636-b086-d560998f136d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056082 Oct 27 03:25:03.251726 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 642/1335] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:25:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:25:03.258655 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-75a0c03e-f86f-4100-98b5-5204f5986911 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:03.261262 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-75a0c03e-f86f-4100-98b5-5204f5986911 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: b251e3ee-3076-4374-ba01-89488f4d8fc3] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:03.269933 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-75a0c03e-f86f-4100-98b5-5204f5986911 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:03.270795 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-75a0c03e-f86f-4100-98b5-5204f5986911 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:03.272717 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-75a0c03e-f86f-4100-98b5-5204f5986911 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:03.273859 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-75a0c03e-f86f-4100-98b5-5204f5986911 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:03.274556 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-75a0c03e-f86f-4100-98b5-5204f5986911 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:03.276287 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-75a0c03e-f86f-4100-98b5-5204f5986911 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:03.292141 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-75a0c03e-f86f-4100-98b5-5204f5986911 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] HTTP exception thrown: Instance b251e3ee-3076-4374-ba01-89488f4d8fc3 could not be found. Oct 27 03:25:03.293836 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-75a0c03e-f86f-4100-98b5-5204f5986911 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Request method failure captured: Oct 27 03:25:03.293836 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/b251e3ee-3076-4374-ba01-89488f4d8fc3 HTTP/1.1 Oct 27 03:25:03.293836 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:25:03.293836 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:25:03.293836 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:25:03.293836 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:25:03.293836 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:25:03.293836 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:25:03.293836 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:25:03.293836 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:25:03.293836 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWflSNQach9Nb5a-nwpaet3DOMbW4rovpwiSisAjqFscpzZFwT6bcg_up1i76ycL6ujOTUfNYz_zBzvxITJnmbBErQShJ1lwwCzCfbPi_i3gA3nNTv5XKeqZukq5d_laOkT4ryxL3BEyqvlbo-j2kkQUt_sjeDJRyUijGXNWQdhqp_K4 Oct 27 03:25:03.293836 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:25:03.293836 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:25:03.293836 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:25:03.293836 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:25:03.293836 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:25:03.293836 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:25:03.293836 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: b95729a8c8a14361b7cbf8b2b13900b2 Oct 27 03:25:03.293836 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServersOnMultiNodesTest-265997062 Oct 27 03:25:03.293836 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:25:03.293836 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:25:03.295529 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b95729a8c8a14361b7cbf8b2b13900b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b95729a8c8a14361b7cbf8b2b13900b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b95729a8c8a14361b7cbf8b2b13900b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b95729a8c8a14361b7cbf8b2b13900b2"}]}] Oct 27 03:25:03.295529 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServersOnMultiNodesTest-265997062 Oct 27 03:25:03.295529 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: b95729a8c8a14361b7cbf8b2b13900b2 Oct 27 03:25:03.295529 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-265997062 Oct 27 03:25:03.295529 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServersOnMultiNodesTest-265997062-project Oct 27 03:25:03.295529 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:25:03.295529 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:25:03.295529 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 91d1351fcb6b4cd08f176e6d0cc5bb11 Oct 27 03:25:03.295529 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServersOnMultiNodesTest-265997062-project Oct 27 03:25:03.295529 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:25:03.295529 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance b251e3ee-3076-4374-ba01-89488f4d8fc3 could not be found. Oct 27 03:25:03.295529 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': 'b251e3ee-3076-4374-ba01-89488f4d8fc3'} Oct 27 03:25:03.296305 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:25:03.296305 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:25:03.296305 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:25:03.296305 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:25:03.296305 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:25:03.296305 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:25:03.296305 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:25:03.296305 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:25:03.296305 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:25:03.296305 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:25:03.296305 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b251e3ee-3076-4374-ba01-89488f4d8fc3 could not be found. Oct 27 03:25:03.296305 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:25:03.296305 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:25:03.296305 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:25:03.296305 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:25:03.296305 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:25:03.296305 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:25:03.296305 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:25:03.296305 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:25:03.296305 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:25:03.297499 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:25:03.297499 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:25:03.297499 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:25:03.297499 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:25:03.297499 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:25:03.297499 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:25:03.297499 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:25:03.297499 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b251e3ee-3076-4374-ba01-89488f4d8fc3 could not be found. Oct 27 03:25:03.297499 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:25:03.297499 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:25:03.297499 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:25:03.297499 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:25:03.297499 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:25:03.297499 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:25:03.297499 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:25:03.297499 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:25:03.297499 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b251e3ee-3076-4374-ba01-89488f4d8fc3 could not be found. Oct 27 03:25:03.297499 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:25:03.298657 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-75a0c03e-f86f-4100-98b5-5204f5986911 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Returning 404 to user: Instance b251e3ee-3076-4374-ba01-89488f4d8fc3 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:25:03.298657 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-75a0c03e-f86f-4100-98b5-5204f5986911 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/b251e3ee-3076-4374-ba01-89488f4d8fc3" status: 404 len: 111 microversion: 2.1 time: 0.044914 Oct 27 03:25:03.298657 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 643/1336] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:03 2022] GET /compute/v2.1/servers/b251e3ee-3076-4374-ba01-89488f4d8fc3 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:25:03.302152 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6edd381e-3502-40fe-a294-d188d792826f tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:03.302784 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-6edd381e-3502-40fe-a294-d188d792826f tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] [instance: 2d8a44aa-62e4-4385-b295-924517b6f850] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:03.308927 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6edd381e-3502-40fe-a294-d188d792826f tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:03.315256 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6edd381e-3502-40fe-a294-d188d792826f tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:03.315256 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6edd381e-3502-40fe-a294-d188d792826f tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:03.315256 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6edd381e-3502-40fe-a294-d188d792826f tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:03.315256 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6edd381e-3502-40fe-a294-d188d792826f tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:03.316072 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6edd381e-3502-40fe-a294-d188d792826f tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:03.376144 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0bc7637d-faa7-4948-ba10-b817007c0e0c tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:03.394107 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0bc7637d-faa7-4948-ba10-b817007c0e0c tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/33d5c62a-898f-441b-a1a1-3cb12836755d" status: 200 len: 1497 microversion: 2.1 time: 0.435931 Oct 27 03:25:03.395868 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 694/1337] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:02 2022] GET /compute/v2.1/servers/33d5c62a-898f-441b-a1a1-3cb12836755d => generated 1497 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:03.403227 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7ab1f70d-4fe8-41f3-962c-1f2a8816789b tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:03.403968 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7ab1f70d-4fe8-41f3-962c-1f2a8816789b tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: a4abccf0-a093-4148-a260-40ab363b12f6] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:03.409013 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6edd381e-3502-40fe-a294-d188d792826f tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ccd5909fb214f71ad68704019c9e4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d2c150feac4d03966a860ab8bafe00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:03.434615 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6edd381e-3502-40fe-a294-d188d792826f tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] 10.222.0.20 "GET /compute/v2.1/servers/2d8a44aa-62e4-4385-b295-924517b6f850" status: 200 len: 1280 microversion: 2.1 time: 0.123872 Oct 27 03:25:03.434615 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 644/1338] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:03 2022] GET /compute/v2.1/servers/2d8a44aa-62e4-4385-b295-924517b6f850 => generated 1280 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:03.436557 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7ab1f70d-4fe8-41f3-962c-1f2a8816789b tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:03.439793 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7ab1f70d-4fe8-41f3-962c-1f2a8816789b tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:03.440429 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7ab1f70d-4fe8-41f3-962c-1f2a8816789b tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:03.443485 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7ab1f70d-4fe8-41f3-962c-1f2a8816789b tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:03.444138 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7ab1f70d-4fe8-41f3-962c-1f2a8816789b tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:03.444569 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7ab1f70d-4fe8-41f3-962c-1f2a8816789b tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:03.478234 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3d35d4bf-3f67-4523-b54d-289eabd38bf9 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:03.479076 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3d35d4bf-3f67-4523-b54d-289eabd38bf9 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] [instance: acb62f35-0751-41fe-ba8d-78b2357380e9] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:03.480271 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7ab1f70d-4fe8-41f3-962c-1f2a8816789b tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: a4abccf0-a093-4148-a260-40ab363b12f6] Going to try to terminate instance {{(pid=121000) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:25:03.491502 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3d35d4bf-3f67-4523-b54d-289eabd38bf9 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:03.499523 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3d35d4bf-3f67-4523-b54d-289eabd38bf9 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:03.500336 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3d35d4bf-3f67-4523-b54d-289eabd38bf9 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:03.501388 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3d35d4bf-3f67-4523-b54d-289eabd38bf9 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:03.503999 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3d35d4bf-3f67-4523-b54d-289eabd38bf9 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:03.506673 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3d35d4bf-3f67-4523-b54d-289eabd38bf9 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:03.560349 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3d35d4bf-3f67-4523-b54d-289eabd38bf9 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] [instance: acb62f35-0751-41fe-ba8d-78b2357380e9] Going to try to terminate instance {{(pid=121001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:25:03.879287 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7ab1f70d-4fe8-41f3-962c-1f2a8816789b tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a4abccf0-a093-4148-a260-40ab363b12f6" status: 204 len: 0 microversion: 2.1 time: 0.481871 Oct 27 03:25:03.880661 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 695/1339] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:25:03 2022] DELETE /compute/v2.1/servers/a4abccf0-a093-4148-a260-40ab363b12f6 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:25:03.881690 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:25:03.886761 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0581d767-6e20-4775-aacd-ae3a9046ea96 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:03.887688 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0581d767-6e20-4775-aacd-ae3a9046ea96 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:03.895028 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0581d767-6e20-4775-aacd-ae3a9046ea96 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:03.895581 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0581d767-6e20-4775-aacd-ae3a9046ea96 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:03.896027 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0581d767-6e20-4775-aacd-ae3a9046ea96 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:03.896990 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0581d767-6e20-4775-aacd-ae3a9046ea96 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:03.897676 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0581d767-6e20-4775-aacd-ae3a9046ea96 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:03.898136 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0581d767-6e20-4775-aacd-ae3a9046ea96 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:03.982238 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3d35d4bf-3f67-4523-b54d-289eabd38bf9 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] 10.222.0.20 "DELETE /compute/v2.1/servers/acb62f35-0751-41fe-ba8d-78b2357380e9" status: 204 len: 0 microversion: 2.1 time: 0.509800 Oct 27 03:25:03.983141 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 645/1340] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:25:03 2022] DELETE /compute/v2.1/servers/acb62f35-0751-41fe-ba8d-78b2357380e9 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 03:25:03.989158 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a94d5cc6-e3f9-4362-8d2e-fa16cde8ecc1 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:03.990739 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a94d5cc6-e3f9-4362-8d2e-fa16cde8ecc1 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: a4abccf0-a093-4148-a260-40ab363b12f6] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:03.996343 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a94d5cc6-e3f9-4362-8d2e-fa16cde8ecc1 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:03.996835 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a94d5cc6-e3f9-4362-8d2e-fa16cde8ecc1 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:03.997275 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a94d5cc6-e3f9-4362-8d2e-fa16cde8ecc1 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:03.997994 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a94d5cc6-e3f9-4362-8d2e-fa16cde8ecc1 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:03.998474 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a94d5cc6-e3f9-4362-8d2e-fa16cde8ecc1 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:03.999220 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a94d5cc6-e3f9-4362-8d2e-fa16cde8ecc1 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:04.066699 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0581d767-6e20-4775-aacd-ae3a9046ea96 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:04.081692 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0581d767-6e20-4775-aacd-ae3a9046ea96 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:04.083615 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0581d767-6e20-4775-aacd-ae3a9046ea96 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:04.084922 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0581d767-6e20-4775-aacd-ae3a9046ea96 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f" status: 200 len: 1410 microversion: 2.25 time: 0.202876 Oct 27 03:25:04.085852 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 696/1341] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:25:03 2022] GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f => generated 1410 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:25:04.109633 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d34c1bd8-a317-4f2f-9629-5cac5ac707c7 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:04.111187 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d34c1bd8-a317-4f2f-9629-5cac5ac707c7 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] [instance: acb62f35-0751-41fe-ba8d-78b2357380e9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:04.118017 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d34c1bd8-a317-4f2f-9629-5cac5ac707c7 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:04.119826 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d34c1bd8-a317-4f2f-9629-5cac5ac707c7 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:04.120345 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d34c1bd8-a317-4f2f-9629-5cac5ac707c7 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:04.121143 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d34c1bd8-a317-4f2f-9629-5cac5ac707c7 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:04.122027 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d34c1bd8-a317-4f2f-9629-5cac5ac707c7 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:04.122908 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d34c1bd8-a317-4f2f-9629-5cac5ac707c7 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:04.165020 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a94d5cc6-e3f9-4362-8d2e-fa16cde8ecc1 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:04.174310 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a94d5cc6-e3f9-4362-8d2e-fa16cde8ecc1 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/a4abccf0-a093-4148-a260-40ab363b12f6" status: 200 len: 1472 microversion: 2.1 time: 0.189779 Oct 27 03:25:04.175592 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 646/1342] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:03 2022] GET /compute/v2.1/servers/a4abccf0-a093-4148-a260-40ab363b12f6 => generated 1472 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:04.180441 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-7920bc10-24da-4875-abc7-f6e4cdc9ea42 req-9f70d079-9e40-4141-9161-97ce54415ae8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f", "tag": "43cfec0a-97df-4480-8645-66f623cb4eaa"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:25:04.202247 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-7920bc10-24da-4875-abc7-f6e4cdc9ea42 req-9f70d079-9e40-4141-9161-97ce54415ae8 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:04.202733 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-7920bc10-24da-4875-abc7-f6e4cdc9ea42 req-9f70d079-9e40-4141-9161-97ce54415ae8 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:04.203170 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-7920bc10-24da-4875-abc7-f6e4cdc9ea42 req-9f70d079-9e40-4141-9161-97ce54415ae8 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:04.219723 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-7920bc10-24da-4875-abc7-f6e4cdc9ea42 req-9f70d079-9e40-4141-9161-97ce54415ae8 service nova] Creating event network-changed:43cfec0a-97df-4480-8645-66f623cb4eaa for instance 09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f on n-h1-862769-1 Oct 27 03:25:04.225697 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-7920bc10-24da-4875-abc7-f6e4cdc9ea42 req-9f70d079-9e40-4141-9161-97ce54415ae8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048668 Oct 27 03:25:04.226503 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 647/1343] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:25:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:25:04.233726 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-af0d7b48-0418-4b0e-830e-231d65b83362 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:04.234812 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-af0d7b48-0418-4b0e-830e-231d65b83362 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: e8781053-3dad-4951-b4cb-1f4aaf97e19b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:04.241581 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-af0d7b48-0418-4b0e-830e-231d65b83362 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:04.242423 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-af0d7b48-0418-4b0e-830e-231d65b83362 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:04.243060 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-af0d7b48-0418-4b0e-830e-231d65b83362 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:04.244002 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-af0d7b48-0418-4b0e-830e-231d65b83362 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:04.244799 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-af0d7b48-0418-4b0e-830e-231d65b83362 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:04.245422 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-af0d7b48-0418-4b0e-830e-231d65b83362 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:04.380530 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d34c1bd8-a317-4f2f-9629-5cac5ac707c7 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e23378ed283426cbff623265d9bbc96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f033d34ad44397bfda5cba4c041071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:04.390288 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d34c1bd8-a317-4f2f-9629-5cac5ac707c7 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] 10.222.0.20 "GET /compute/v2.1/servers/acb62f35-0751-41fe-ba8d-78b2357380e9" status: 200 len: 1712 microversion: 2.1 time: 0.302908 Oct 27 03:25:04.390898 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 697/1344] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:04 2022] GET /compute/v2.1/servers/acb62f35-0751-41fe-ba8d-78b2357380e9 => generated 1712 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:04.418517 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0fbba47d-194c-472b-acf9-c684ede8929c tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:04.419489 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0fbba47d-194c-472b-acf9-c684ede8929c tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 33d5c62a-898f-441b-a1a1-3cb12836755d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:04.427481 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0fbba47d-194c-472b-acf9-c684ede8929c tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:04.428608 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0fbba47d-194c-472b-acf9-c684ede8929c tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:04.429258 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0fbba47d-194c-472b-acf9-c684ede8929c tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:04.430682 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0fbba47d-194c-472b-acf9-c684ede8929c tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:04.431336 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0fbba47d-194c-472b-acf9-c684ede8929c tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:04.432559 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0fbba47d-194c-472b-acf9-c684ede8929c tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:04.457742 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-af0d7b48-0418-4b0e-830e-231d65b83362 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:04.474733 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-af0d7b48-0418-4b0e-830e-231d65b83362 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b" status: 200 len: 1313 microversion: 2.1 time: 0.242610 Oct 27 03:25:04.478730 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 648/1345] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:04 2022] GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b => generated 1313 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:04.485911 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-26aaac10-542a-4386-95d4-66efa2571c8c tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:04.487781 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-26aaac10-542a-4386-95d4-66efa2571c8c tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] [instance: 2d8a44aa-62e4-4385-b295-924517b6f850] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:04.495831 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-26aaac10-542a-4386-95d4-66efa2571c8c tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:04.496656 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-26aaac10-542a-4386-95d4-66efa2571c8c tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:04.497369 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-26aaac10-542a-4386-95d4-66efa2571c8c tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:04.498374 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-26aaac10-542a-4386-95d4-66efa2571c8c tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:04.499223 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-26aaac10-542a-4386-95d4-66efa2571c8c tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:04.500554 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-26aaac10-542a-4386-95d4-66efa2571c8c tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:04.594501 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0fbba47d-194c-472b-acf9-c684ede8929c tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:04.603819 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0fbba47d-194c-472b-acf9-c684ede8929c tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/33d5c62a-898f-441b-a1a1-3cb12836755d" status: 200 len: 1497 microversion: 2.1 time: 0.189291 Oct 27 03:25:04.604781 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 698/1346] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:04 2022] GET /compute/v2.1/servers/33d5c62a-898f-441b-a1a1-3cb12836755d => generated 1497 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:04.752638 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-26aaac10-542a-4386-95d4-66efa2571c8c tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ccd5909fb214f71ad68704019c9e4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d2c150feac4d03966a860ab8bafe00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:04.761337 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-26aaac10-542a-4386-95d4-66efa2571c8c tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] 10.222.0.20 "GET /compute/v2.1/servers/2d8a44aa-62e4-4385-b295-924517b6f850" status: 200 len: 1322 microversion: 2.1 time: 0.280964 Oct 27 03:25:04.762202 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 649/1347] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:04 2022] GET /compute/v2.1/servers/2d8a44aa-62e4-4385-b295-924517b6f850 => generated 1322 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:05.110309 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7e954ed2-0346-45ba-a0f6-faf0cec19f73 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:05.112465 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7e954ed2-0346-45ba-a0f6-faf0cec19f73 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:05.118471 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=8 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:25:05.120431 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7e954ed2-0346-45ba-a0f6-faf0cec19f73 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:05.121143 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7e954ed2-0346-45ba-a0f6-faf0cec19f73 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:05.121800 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7e954ed2-0346-45ba-a0f6-faf0cec19f73 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:05.122826 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7e954ed2-0346-45ba-a0f6-faf0cec19f73 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:05.123504 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7e954ed2-0346-45ba-a0f6-faf0cec19f73 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:05.124134 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7e954ed2-0346-45ba-a0f6-faf0cec19f73 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:05.201173 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ccff44cc-a6e3-4ecc-8905-fa1f3bc8304c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:05.202453 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ccff44cc-a6e3-4ecc-8905-fa1f3bc8304c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: a4abccf0-a093-4148-a260-40ab363b12f6] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:05.216912 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=26 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:25:05.219883 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ccff44cc-a6e3-4ecc-8905-fa1f3bc8304c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:05.221448 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ccff44cc-a6e3-4ecc-8905-fa1f3bc8304c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:05.221827 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ccff44cc-a6e3-4ecc-8905-fa1f3bc8304c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:05.222755 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ccff44cc-a6e3-4ecc-8905-fa1f3bc8304c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:05.223243 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ccff44cc-a6e3-4ecc-8905-fa1f3bc8304c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:05.224927 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ccff44cc-a6e3-4ecc-8905-fa1f3bc8304c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:05.294046 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7e954ed2-0346-45ba-a0f6-faf0cec19f73 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:05.303061 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7e954ed2-0346-45ba-a0f6-faf0cec19f73 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:05.304538 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7e954ed2-0346-45ba-a0f6-faf0cec19f73 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:05.305681 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7e954ed2-0346-45ba-a0f6-faf0cec19f73 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f" status: 200 len: 1410 microversion: 2.25 time: 0.199458 Oct 27 03:25:05.318057 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 699/1348] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:25:05 2022] GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f => generated 1410 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:25:05.417700 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2a7c7309-eac6-4ddf-8d3e-80272964d6be tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:05.418367 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-2a7c7309-eac6-4ddf-8d3e-80272964d6be tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] [instance: acb62f35-0751-41fe-ba8d-78b2357380e9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:05.432874 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ccff44cc-a6e3-4ecc-8905-fa1f3bc8304c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:05.438010 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2a7c7309-eac6-4ddf-8d3e-80272964d6be tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:05.440715 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2a7c7309-eac6-4ddf-8d3e-80272964d6be tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:05.441165 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2a7c7309-eac6-4ddf-8d3e-80272964d6be tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:05.444304 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2a7c7309-eac6-4ddf-8d3e-80272964d6be tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:05.445010 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2a7c7309-eac6-4ddf-8d3e-80272964d6be tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:05.446519 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2a7c7309-eac6-4ddf-8d3e-80272964d6be tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:05.467106 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ccff44cc-a6e3-4ecc-8905-fa1f3bc8304c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/a4abccf0-a093-4148-a260-40ab363b12f6" status: 200 len: 1472 microversion: 2.1 time: 0.258862 Oct 27 03:25:05.467590 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 650/1349] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:05 2022] GET /compute/v2.1/servers/a4abccf0-a093-4148-a260-40ab363b12f6 => generated 1472 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:05.505129 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c6018ada-82db-4649-bb81-94db228c39e4 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:05.505911 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c6018ada-82db-4649-bb81-94db228c39e4 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: e8781053-3dad-4951-b4cb-1f4aaf97e19b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:05.522168 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c6018ada-82db-4649-bb81-94db228c39e4 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:05.524957 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c6018ada-82db-4649-bb81-94db228c39e4 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:05.525701 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c6018ada-82db-4649-bb81-94db228c39e4 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:05.526777 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c6018ada-82db-4649-bb81-94db228c39e4 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:05.529237 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c6018ada-82db-4649-bb81-94db228c39e4 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:05.529918 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c6018ada-82db-4649-bb81-94db228c39e4 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:05.638694 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2a7c7309-eac6-4ddf-8d3e-80272964d6be tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e23378ed283426cbff623265d9bbc96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f033d34ad44397bfda5cba4c041071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:05.652716 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2a7c7309-eac6-4ddf-8d3e-80272964d6be tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] 10.222.0.20 "GET /compute/v2.1/servers/acb62f35-0751-41fe-ba8d-78b2357380e9" status: 200 len: 1712 microversion: 2.1 time: 0.238707 Oct 27 03:25:05.653565 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 700/1350] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:05 2022] GET /compute/v2.1/servers/acb62f35-0751-41fe-ba8d-78b2357380e9 => generated 1712 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:25:05.660191 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9141b5eb-656d-4b66-a531-4e95e6cf50c0 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:05.666902 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9141b5eb-656d-4b66-a531-4e95e6cf50c0 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 33d5c62a-898f-441b-a1a1-3cb12836755d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:05.676094 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9141b5eb-656d-4b66-a531-4e95e6cf50c0 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:05.676094 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9141b5eb-656d-4b66-a531-4e95e6cf50c0 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:05.676094 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9141b5eb-656d-4b66-a531-4e95e6cf50c0 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:05.676560 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9141b5eb-656d-4b66-a531-4e95e6cf50c0 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:05.676912 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9141b5eb-656d-4b66-a531-4e95e6cf50c0 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:05.677350 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9141b5eb-656d-4b66-a531-4e95e6cf50c0 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:05.825828 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=16 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:25:05.837746 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c6018ada-82db-4649-bb81-94db228c39e4 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:05.848631 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c6018ada-82db-4649-bb81-94db228c39e4 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b" status: 200 len: 1313 microversion: 2.1 time: 0.348741 Oct 27 03:25:05.849811 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 651/1351] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:05 2022] GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b => generated 1313 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:05.854796 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-29dc6d7b-d0eb-4aa5-a590-6c4c016c3eb2 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:05.855642 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-29dc6d7b-d0eb-4aa5-a590-6c4c016c3eb2 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] [instance: 2d8a44aa-62e4-4385-b295-924517b6f850] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:05.862065 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-29dc6d7b-d0eb-4aa5-a590-6c4c016c3eb2 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:05.862657 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-29dc6d7b-d0eb-4aa5-a590-6c4c016c3eb2 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:05.863096 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-29dc6d7b-d0eb-4aa5-a590-6c4c016c3eb2 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:05.863815 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-29dc6d7b-d0eb-4aa5-a590-6c4c016c3eb2 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:05.864709 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-29dc6d7b-d0eb-4aa5-a590-6c4c016c3eb2 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:05.864709 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-29dc6d7b-d0eb-4aa5-a590-6c4c016c3eb2 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:05.877533 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9141b5eb-656d-4b66-a531-4e95e6cf50c0 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:05.881152 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:25:05.902253 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9141b5eb-656d-4b66-a531-4e95e6cf50c0 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/33d5c62a-898f-441b-a1a1-3cb12836755d" status: 200 len: 1497 microversion: 2.1 time: 0.247308 Oct 27 03:25:05.907718 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 701/1352] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:05 2022] GET /compute/v2.1/servers/33d5c62a-898f-441b-a1a1-3cb12836755d => generated 1497 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:06.151615 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-29dc6d7b-d0eb-4aa5-a590-6c4c016c3eb2 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ccd5909fb214f71ad68704019c9e4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d2c150feac4d03966a860ab8bafe00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:06.159361 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-29dc6d7b-d0eb-4aa5-a590-6c4c016c3eb2 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] 10.222.0.20 "GET /compute/v2.1/servers/2d8a44aa-62e4-4385-b295-924517b6f850" status: 200 len: 1322 microversion: 2.1 time: 0.308358 Oct 27 03:25:06.159941 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 652/1353] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:05 2022] GET /compute/v2.1/servers/2d8a44aa-62e4-4385-b295-924517b6f850 => generated 1322 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:06.331833 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d6be3c00-d612-4587-b0ba-cb989c5ac65a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:06.332459 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d6be3c00-d612-4587-b0ba-cb989c5ac65a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:06.339178 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d6be3c00-d612-4587-b0ba-cb989c5ac65a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:06.339556 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d6be3c00-d612-4587-b0ba-cb989c5ac65a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:06.340000 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d6be3c00-d612-4587-b0ba-cb989c5ac65a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:06.340724 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d6be3c00-d612-4587-b0ba-cb989c5ac65a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:06.341182 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d6be3c00-d612-4587-b0ba-cb989c5ac65a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:06.341615 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d6be3c00-d612-4587-b0ba-cb989c5ac65a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:06.479101 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-fffc1323-1992-454f-8a1c-f4ed77d30e4d tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:06.479875 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-fffc1323-1992-454f-8a1c-f4ed77d30e4d tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: a4abccf0-a093-4148-a260-40ab363b12f6] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:06.488959 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fffc1323-1992-454f-8a1c-f4ed77d30e4d tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:06.489687 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fffc1323-1992-454f-8a1c-f4ed77d30e4d tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:06.490409 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fffc1323-1992-454f-8a1c-f4ed77d30e4d tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:06.491578 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fffc1323-1992-454f-8a1c-f4ed77d30e4d tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:06.492109 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fffc1323-1992-454f-8a1c-f4ed77d30e4d tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:06.492742 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fffc1323-1992-454f-8a1c-f4ed77d30e4d tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:06.540966 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d6be3c00-d612-4587-b0ba-cb989c5ac65a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:06.553547 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d6be3c00-d612-4587-b0ba-cb989c5ac65a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:06.558539 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d6be3c00-d612-4587-b0ba-cb989c5ac65a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:06.562422 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d6be3c00-d612-4587-b0ba-cb989c5ac65a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f" status: 200 len: 1410 microversion: 2.25 time: 0.232800 Oct 27 03:25:06.562422 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 702/1354] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:25:06 2022] GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f => generated 1410 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:25:06.687189 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-aa900f0c-c508-4563-a560-b341421cfe94 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:06.687936 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-aa900f0c-c508-4563-a560-b341421cfe94 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] [instance: acb62f35-0751-41fe-ba8d-78b2357380e9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:06.694573 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aa900f0c-c508-4563-a560-b341421cfe94 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:06.695381 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aa900f0c-c508-4563-a560-b341421cfe94 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:06.696098 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aa900f0c-c508-4563-a560-b341421cfe94 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:06.697030 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aa900f0c-c508-4563-a560-b341421cfe94 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:06.697683 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aa900f0c-c508-4563-a560-b341421cfe94 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:06.698335 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aa900f0c-c508-4563-a560-b341421cfe94 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:07.097463 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-fffc1323-1992-454f-8a1c-f4ed77d30e4d tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:07.108749 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-fffc1323-1992-454f-8a1c-f4ed77d30e4d tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/a4abccf0-a093-4148-a260-40ab363b12f6" status: 200 len: 1472 microversion: 2.1 time: 0.633314 Oct 27 03:25:07.115122 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 653/1355] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:06 2022] GET /compute/v2.1/servers/a4abccf0-a093-4148-a260-40ab363b12f6 => generated 1472 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:25:07.129492 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-307f7c53-4140-40d5-a881-b0b5c66e61da tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:07.133626 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-307f7c53-4140-40d5-a881-b0b5c66e61da tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: e8781053-3dad-4951-b4cb-1f4aaf97e19b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:07.150116 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-307f7c53-4140-40d5-a881-b0b5c66e61da tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:07.150700 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-307f7c53-4140-40d5-a881-b0b5c66e61da tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:07.151186 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-307f7c53-4140-40d5-a881-b0b5c66e61da tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:07.152016 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-307f7c53-4140-40d5-a881-b0b5c66e61da tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:07.152570 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-307f7c53-4140-40d5-a881-b0b5c66e61da tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:07.153002 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-307f7c53-4140-40d5-a881-b0b5c66e61da tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:07.153466 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=14 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:25:07.263043 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-aa900f0c-c508-4563-a560-b341421cfe94 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e23378ed283426cbff623265d9bbc96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f033d34ad44397bfda5cba4c041071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:07.274367 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-aa900f0c-c508-4563-a560-b341421cfe94 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] 10.222.0.20 "GET /compute/v2.1/servers/acb62f35-0751-41fe-ba8d-78b2357380e9" status: 200 len: 1712 microversion: 2.1 time: 0.590945 Oct 27 03:25:07.277869 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 703/1356] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:06 2022] GET /compute/v2.1/servers/acb62f35-0751-41fe-ba8d-78b2357380e9 => generated 1712 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:07.282887 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e2301410-8e2c-4d5f-971e-4ceae021fb3b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:07.290243 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e2301410-8e2c-4d5f-971e-4ceae021fb3b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 33d5c62a-898f-441b-a1a1-3cb12836755d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:07.299559 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e2301410-8e2c-4d5f-971e-4ceae021fb3b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:07.299559 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e2301410-8e2c-4d5f-971e-4ceae021fb3b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:07.299559 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e2301410-8e2c-4d5f-971e-4ceae021fb3b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:07.305443 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e2301410-8e2c-4d5f-971e-4ceae021fb3b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:07.305944 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e2301410-8e2c-4d5f-971e-4ceae021fb3b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:07.306428 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e2301410-8e2c-4d5f-971e-4ceae021fb3b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:07.481843 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-307f7c53-4140-40d5-a881-b0b5c66e61da tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:07.487685 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:25:07.498697 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-307f7c53-4140-40d5-a881-b0b5c66e61da tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b" status: 200 len: 1313 microversion: 2.1 time: 0.382457 Oct 27 03:25:07.499645 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 654/1357] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:07 2022] GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b => generated 1313 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:07.512377 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-719db9c3-d5e1-43bc-bfa8-5f4275b331fb tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:07.514826 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-719db9c3-d5e1-43bc-bfa8-5f4275b331fb tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] [instance: 2d8a44aa-62e4-4385-b295-924517b6f850] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:07.527737 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-719db9c3-d5e1-43bc-bfa8-5f4275b331fb tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:07.528632 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-719db9c3-d5e1-43bc-bfa8-5f4275b331fb tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:07.529168 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-719db9c3-d5e1-43bc-bfa8-5f4275b331fb tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:07.530856 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-719db9c3-d5e1-43bc-bfa8-5f4275b331fb tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:07.535430 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-719db9c3-d5e1-43bc-bfa8-5f4275b331fb tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:07.536019 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-719db9c3-d5e1-43bc-bfa8-5f4275b331fb tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:07.858583 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-719db9c3-d5e1-43bc-bfa8-5f4275b331fb tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ccd5909fb214f71ad68704019c9e4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d2c150feac4d03966a860ab8bafe00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:07.868349 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-719db9c3-d5e1-43bc-bfa8-5f4275b331fb tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] 10.222.0.20 "GET /compute/v2.1/servers/2d8a44aa-62e4-4385-b295-924517b6f850" status: 200 len: 1322 microversion: 2.1 time: 0.367383 Oct 27 03:25:07.871864 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 655/1358] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:07 2022] GET /compute/v2.1/servers/2d8a44aa-62e4-4385-b295-924517b6f850 => generated 1322 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:07.882176 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e6262a5e-cc16-46f4-a9cc-69445ab7beed tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:07.884465 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e6262a5e-cc16-46f4-a9cc-69445ab7beed tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:07.896541 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e6262a5e-cc16-46f4-a9cc-69445ab7beed tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:07.901001 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e6262a5e-cc16-46f4-a9cc-69445ab7beed tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:07.902022 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e6262a5e-cc16-46f4-a9cc-69445ab7beed tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:07.905347 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e6262a5e-cc16-46f4-a9cc-69445ab7beed tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:07.916984 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e6262a5e-cc16-46f4-a9cc-69445ab7beed tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:07.918688 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e6262a5e-cc16-46f4-a9cc-69445ab7beed tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:07.989194 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e2301410-8e2c-4d5f-971e-4ceae021fb3b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:08.005532 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e2301410-8e2c-4d5f-971e-4ceae021fb3b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/33d5c62a-898f-441b-a1a1-3cb12836755d" status: 200 len: 1497 microversion: 2.1 time: 0.726227 Oct 27 03:25:08.006579 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 704/1359] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:07 2022] GET /compute/v2.1/servers/33d5c62a-898f-441b-a1a1-3cb12836755d => generated 1497 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:08.136430 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7d3137cc-c102-4379-b9d5-db569056bce4 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:08.137134 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7d3137cc-c102-4379-b9d5-db569056bce4 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: a4abccf0-a093-4148-a260-40ab363b12f6] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:08.144854 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7d3137cc-c102-4379-b9d5-db569056bce4 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:08.154650 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7d3137cc-c102-4379-b9d5-db569056bce4 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:08.155221 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e6262a5e-cc16-46f4-a9cc-69445ab7beed tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:08.156141 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7d3137cc-c102-4379-b9d5-db569056bce4 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:08.158080 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7d3137cc-c102-4379-b9d5-db569056bce4 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:08.158226 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7d3137cc-c102-4379-b9d5-db569056bce4 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:08.158659 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7d3137cc-c102-4379-b9d5-db569056bce4 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:08.168237 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e6262a5e-cc16-46f4-a9cc-69445ab7beed tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:08.169852 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e6262a5e-cc16-46f4-a9cc-69445ab7beed tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:08.172082 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e6262a5e-cc16-46f4-a9cc-69445ab7beed tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f" status: 200 len: 1410 microversion: 2.25 time: 0.298687 Oct 27 03:25:08.176553 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 656/1360] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:25:07 2022] GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f => generated 1410 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:25:08.303855 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-fb89d174-267d-462b-a258-90e752b4bd64 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:08.306540 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-fb89d174-267d-462b-a258-90e752b4bd64 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] [instance: acb62f35-0751-41fe-ba8d-78b2357380e9] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:08.322019 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fb89d174-267d-462b-a258-90e752b4bd64 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:08.322861 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fb89d174-267d-462b-a258-90e752b4bd64 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:08.324317 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fb89d174-267d-462b-a258-90e752b4bd64 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:08.325267 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fb89d174-267d-462b-a258-90e752b4bd64 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:08.325910 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fb89d174-267d-462b-a258-90e752b4bd64 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:08.327400 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fb89d174-267d-462b-a258-90e752b4bd64 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:08.553127 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-fb89d174-267d-462b-a258-90e752b4bd64 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e23378ed283426cbff623265d9bbc96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f033d34ad44397bfda5cba4c041071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:08.564101 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-fb89d174-267d-462b-a258-90e752b4bd64 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] 10.222.0.20 "GET /compute/v2.1/servers/acb62f35-0751-41fe-ba8d-78b2357380e9" status: 200 len: 1712 microversion: 2.1 time: 0.265346 Oct 27 03:25:08.565509 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 657/1361] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:08 2022] GET /compute/v2.1/servers/acb62f35-0751-41fe-ba8d-78b2357380e9 => generated 1712 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:25:08.570366 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d09f7f4a-1637-4be9-8389-472c20eed10a tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:08.571105 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d09f7f4a-1637-4be9-8389-472c20eed10a tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: e8781053-3dad-4951-b4cb-1f4aaf97e19b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:08.576993 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d09f7f4a-1637-4be9-8389-472c20eed10a tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:08.577608 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d09f7f4a-1637-4be9-8389-472c20eed10a tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:08.578185 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d09f7f4a-1637-4be9-8389-472c20eed10a tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:08.578992 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d09f7f4a-1637-4be9-8389-472c20eed10a tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:08.579560 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d09f7f4a-1637-4be9-8389-472c20eed10a tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:08.580846 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d09f7f4a-1637-4be9-8389-472c20eed10a tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:08.741973 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d09f7f4a-1637-4be9-8389-472c20eed10a tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:08.750057 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d09f7f4a-1637-4be9-8389-472c20eed10a tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b" status: 200 len: 1313 microversion: 2.1 time: 0.183289 Oct 27 03:25:08.768855 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 658/1362] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:08 2022] GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b => generated 1313 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:08.835245 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7d3137cc-c102-4379-b9d5-db569056bce4 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:08.846725 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7d3137cc-c102-4379-b9d5-db569056bce4 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/a4abccf0-a093-4148-a260-40ab363b12f6" status: 200 len: 1472 microversion: 2.1 time: 0.712176 Oct 27 03:25:08.849182 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 705/1363] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:08 2022] GET /compute/v2.1/servers/a4abccf0-a093-4148-a260-40ab363b12f6 => generated 1472 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:25:08.895641 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a8850ffe-77fc-4879-9d13-b01e6fa73c55 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:08.896423 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a8850ffe-77fc-4879-9d13-b01e6fa73c55 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] [instance: 2d8a44aa-62e4-4385-b295-924517b6f850] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:08.909970 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a8850ffe-77fc-4879-9d13-b01e6fa73c55 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:08.910723 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a8850ffe-77fc-4879-9d13-b01e6fa73c55 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:08.913090 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a8850ffe-77fc-4879-9d13-b01e6fa73c55 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:08.913857 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a8850ffe-77fc-4879-9d13-b01e6fa73c55 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:08.915821 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a8850ffe-77fc-4879-9d13-b01e6fa73c55 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:08.916281 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a8850ffe-77fc-4879-9d13-b01e6fa73c55 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:08.962153 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-e2750da1-e12c-45c1-83e4-d3df73560bee req-8c5d82f7-0b48-4807-929a-2338b29b6d89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4abccf0-a093-4148-a260-40ab363b12f6", "name": "network-vif-deleted", "tag": "69c8815d-cc5c-4226-a70c-449f3d54e905"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:25:08.983997 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-e2750da1-e12c-45c1-83e4-d3df73560bee req-8c5d82f7-0b48-4807-929a-2338b29b6d89 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:08.987386 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-e2750da1-e12c-45c1-83e4-d3df73560bee req-8c5d82f7-0b48-4807-929a-2338b29b6d89 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:08.987889 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-e2750da1-e12c-45c1-83e4-d3df73560bee req-8c5d82f7-0b48-4807-929a-2338b29b6d89 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:09.024320 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-e2750da1-e12c-45c1-83e4-d3df73560bee req-8c5d82f7-0b48-4807-929a-2338b29b6d89 service nova] Creating event network-vif-deleted:69c8815d-cc5c-4226-a70c-449f3d54e905 for instance a4abccf0-a093-4148-a260-40ab363b12f6 on n-h1-862769-1 Oct 27 03:25:09.035993 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-e2750da1-e12c-45c1-83e4-d3df73560bee req-8c5d82f7-0b48-4807-929a-2338b29b6d89 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077809 Oct 27 03:25:09.038912 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 706/1364] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:25:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:25:09.055380 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d6457316-45a2-470c-8cab-a6df025d3847 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:09.055380 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d6457316-45a2-470c-8cab-a6df025d3847 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 33d5c62a-898f-441b-a1a1-3cb12836755d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:09.070536 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d6457316-45a2-470c-8cab-a6df025d3847 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:09.071262 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d6457316-45a2-470c-8cab-a6df025d3847 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:09.071884 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d6457316-45a2-470c-8cab-a6df025d3847 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:09.074022 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d6457316-45a2-470c-8cab-a6df025d3847 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:09.077342 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d6457316-45a2-470c-8cab-a6df025d3847 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:09.077841 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d6457316-45a2-470c-8cab-a6df025d3847 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:09.599890 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a8850ffe-77fc-4879-9d13-b01e6fa73c55 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ccd5909fb214f71ad68704019c9e4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d2c150feac4d03966a860ab8bafe00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:09.610884 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a8850ffe-77fc-4879-9d13-b01e6fa73c55 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] 10.222.0.20 "GET /compute/v2.1/servers/2d8a44aa-62e4-4385-b295-924517b6f850" status: 200 len: 1322 microversion: 2.1 time: 0.718786 Oct 27 03:25:09.624908 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 659/1365] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:08 2022] GET /compute/v2.1/servers/2d8a44aa-62e4-4385-b295-924517b6f850 => generated 1322 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:09.629789 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-04af5289-65bb-498e-b498-3752a791529e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:09.632092 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-04af5289-65bb-498e-b498-3752a791529e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:09.654328 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-04af5289-65bb-498e-b498-3752a791529e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:09.655700 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-04af5289-65bb-498e-b498-3752a791529e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:09.656165 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-04af5289-65bb-498e-b498-3752a791529e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:09.659617 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-04af5289-65bb-498e-b498-3752a791529e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:09.661562 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-04af5289-65bb-498e-b498-3752a791529e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:09.663027 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-04af5289-65bb-498e-b498-3752a791529e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:10.015280 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-04af5289-65bb-498e-b498-3752a791529e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:10.028329 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-04af5289-65bb-498e-b498-3752a791529e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:10.038459 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-04af5289-65bb-498e-b498-3752a791529e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:10.040067 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-04af5289-65bb-498e-b498-3752a791529e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f" status: 200 len: 1410 microversion: 2.25 time: 0.426967 Oct 27 03:25:10.042073 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 660/1366] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:25:09 2022] GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f => generated 1410 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:25:10.075938 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f9880b9a-58f5-46a3-b0e3-4f1bf970cfad tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:10.078898 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f9880b9a-58f5-46a3-b0e3-4f1bf970cfad tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] [instance: acb62f35-0751-41fe-ba8d-78b2357380e9] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:10.095137 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f9880b9a-58f5-46a3-b0e3-4f1bf970cfad tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:10.097001 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f9880b9a-58f5-46a3-b0e3-4f1bf970cfad tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:10.097623 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f9880b9a-58f5-46a3-b0e3-4f1bf970cfad tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:10.100171 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f9880b9a-58f5-46a3-b0e3-4f1bf970cfad tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:10.100904 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f9880b9a-58f5-46a3-b0e3-4f1bf970cfad tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:10.101502 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f9880b9a-58f5-46a3-b0e3-4f1bf970cfad tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:10.229060 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f9880b9a-58f5-46a3-b0e3-4f1bf970cfad tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e23378ed283426cbff623265d9bbc96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f033d34ad44397bfda5cba4c041071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:10.247777 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f9880b9a-58f5-46a3-b0e3-4f1bf970cfad tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] 10.222.0.20 "GET /compute/v2.1/servers/acb62f35-0751-41fe-ba8d-78b2357380e9" status: 200 len: 1644 microversion: 2.1 time: 0.194006 Oct 27 03:25:10.249437 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 661/1367] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:10 2022] GET /compute/v2.1/servers/acb62f35-0751-41fe-ba8d-78b2357380e9 => generated 1644 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:10.258072 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-54fdb49b-b237-4329-9557-243cf2d363fd tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:10.258836 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-54fdb49b-b237-4329-9557-243cf2d363fd tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: e8781053-3dad-4951-b4cb-1f4aaf97e19b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:10.265256 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-54fdb49b-b237-4329-9557-243cf2d363fd tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:10.266984 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-54fdb49b-b237-4329-9557-243cf2d363fd tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:10.267758 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-54fdb49b-b237-4329-9557-243cf2d363fd tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:10.268379 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-54fdb49b-b237-4329-9557-243cf2d363fd tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:10.269164 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-54fdb49b-b237-4329-9557-243cf2d363fd tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:10.269804 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-54fdb49b-b237-4329-9557-243cf2d363fd tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:10.364417 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d6457316-45a2-470c-8cab-a6df025d3847 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:10.376910 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d6457316-45a2-470c-8cab-a6df025d3847 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/33d5c62a-898f-441b-a1a1-3cb12836755d" status: 200 len: 1497 microversion: 2.1 time: 1.336811 Oct 27 03:25:10.381695 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 707/1368] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:09 2022] GET /compute/v2.1/servers/33d5c62a-898f-441b-a1a1-3cb12836755d => generated 1497 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:10.395327 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ecf9874a-b2e8-4a70-b436-752e1ec670a4 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:10.396222 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ecf9874a-b2e8-4a70-b436-752e1ec670a4 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: a4abccf0-a093-4148-a260-40ab363b12f6] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:10.406243 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ecf9874a-b2e8-4a70-b436-752e1ec670a4 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:10.407684 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ecf9874a-b2e8-4a70-b436-752e1ec670a4 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:10.409559 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ecf9874a-b2e8-4a70-b436-752e1ec670a4 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:10.410956 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ecf9874a-b2e8-4a70-b436-752e1ec670a4 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:10.411966 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ecf9874a-b2e8-4a70-b436-752e1ec670a4 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:10.412618 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ecf9874a-b2e8-4a70-b436-752e1ec670a4 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:10.459225 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ecf9874a-b2e8-4a70-b436-752e1ec670a4 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:10.459929 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ecf9874a-b2e8-4a70-b436-752e1ec670a4 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:10.460585 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ecf9874a-b2e8-4a70-b436-752e1ec670a4 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:10.461705 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-ecf9874a-b2e8-4a70-b436-752e1ec670a4 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lazy-loading 'fault' on Instance uuid a4abccf0-a093-4148-a260-40ab363b12f6 {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:25:10.540007 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-54fdb49b-b237-4329-9557-243cf2d363fd tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:10.554993 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-54fdb49b-b237-4329-9557-243cf2d363fd tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b" status: 200 len: 1313 microversion: 2.1 time: 0.304414 Oct 27 03:25:10.572657 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 662/1369] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:10 2022] GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b => generated 1313 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:10.577449 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-95a4b8f6-811a-46d2-adc6-1f3c404356cc req-60361335-359f-4953-b270-143788bdcc3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8781053-3dad-4951-b4cb-1f4aaf97e19b", "name": "network-vif-plugged", "status": "completed", "tag": "2db0e1c6-c7e9-4994-9a8c-c23e51c0e800"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:25:10.594999 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-95a4b8f6-811a-46d2-adc6-1f3c404356cc req-60361335-359f-4953-b270-143788bdcc3f service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:10.595496 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-95a4b8f6-811a-46d2-adc6-1f3c404356cc req-60361335-359f-4953-b270-143788bdcc3f service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:10.596508 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-95a4b8f6-811a-46d2-adc6-1f3c404356cc req-60361335-359f-4953-b270-143788bdcc3f service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:10.620602 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-95a4b8f6-811a-46d2-adc6-1f3c404356cc req-60361335-359f-4953-b270-143788bdcc3f service nova] Creating event network-vif-plugged:2db0e1c6-c7e9-4994-9a8c-c23e51c0e800 for instance e8781053-3dad-4951-b4cb-1f4aaf97e19b on n-h2-862769-1 Oct 27 03:25:10.629927 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-95a4b8f6-811a-46d2-adc6-1f3c404356cc req-60361335-359f-4953-b270-143788bdcc3f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056261 Oct 27 03:25:10.630898 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 663/1370] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:25:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:25:10.646251 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-88329fb5-3f7d-4dbe-ae62-0c14afeedad4 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:10.647612 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-88329fb5-3f7d-4dbe-ae62-0c14afeedad4 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] [instance: 2d8a44aa-62e4-4385-b295-924517b6f850] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:10.656005 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-88329fb5-3f7d-4dbe-ae62-0c14afeedad4 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:10.659110 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-88329fb5-3f7d-4dbe-ae62-0c14afeedad4 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:10.661064 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-88329fb5-3f7d-4dbe-ae62-0c14afeedad4 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:10.664908 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ecf9874a-b2e8-4a70-b436-752e1ec670a4 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:10.675009 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-88329fb5-3f7d-4dbe-ae62-0c14afeedad4 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:10.675798 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-88329fb5-3f7d-4dbe-ae62-0c14afeedad4 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:10.678780 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ecf9874a-b2e8-4a70-b436-752e1ec670a4 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/a4abccf0-a093-4148-a260-40ab363b12f6" status: 200 len: 1307 microversion: 2.1 time: 0.298256 Oct 27 03:25:10.679578 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-88329fb5-3f7d-4dbe-ae62-0c14afeedad4 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:10.682759 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 708/1371] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:10 2022] GET /compute/v2.1/servers/a4abccf0-a093-4148-a260-40ab363b12f6 => generated 1307 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:10.898649 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-88329fb5-3f7d-4dbe-ae62-0c14afeedad4 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ccd5909fb214f71ad68704019c9e4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d2c150feac4d03966a860ab8bafe00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:10.913388 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-88329fb5-3f7d-4dbe-ae62-0c14afeedad4 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] 10.222.0.20 "GET /compute/v2.1/servers/2d8a44aa-62e4-4385-b295-924517b6f850" status: 200 len: 1322 microversion: 2.1 time: 0.273237 Oct 27 03:25:10.914318 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 664/1372] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:10 2022] GET /compute/v2.1/servers/2d8a44aa-62e4-4385-b295-924517b6f850 => generated 1322 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:11.081975 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d2bd5ee4-e1a1-4405-b6a9-bfffe5ed05cf tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:11.083091 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d2bd5ee4-e1a1-4405-b6a9-bfffe5ed05cf tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:11.099018 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d2bd5ee4-e1a1-4405-b6a9-bfffe5ed05cf tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:11.103190 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d2bd5ee4-e1a1-4405-b6a9-bfffe5ed05cf tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:11.103190 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d2bd5ee4-e1a1-4405-b6a9-bfffe5ed05cf tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:11.103807 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d2bd5ee4-e1a1-4405-b6a9-bfffe5ed05cf tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:11.105246 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d2bd5ee4-e1a1-4405-b6a9-bfffe5ed05cf tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:11.105704 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d2bd5ee4-e1a1-4405-b6a9-bfffe5ed05cf tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:11.276939 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c00a3b1d-c26d-4395-ae1d-f7efd18b7002 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:11.277673 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c00a3b1d-c26d-4395-ae1d-f7efd18b7002 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] [instance: acb62f35-0751-41fe-ba8d-78b2357380e9] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:11.286428 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c00a3b1d-c26d-4395-ae1d-f7efd18b7002 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:11.287459 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c00a3b1d-c26d-4395-ae1d-f7efd18b7002 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:11.290239 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c00a3b1d-c26d-4395-ae1d-f7efd18b7002 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:11.291175 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c00a3b1d-c26d-4395-ae1d-f7efd18b7002 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:11.291828 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c00a3b1d-c26d-4395-ae1d-f7efd18b7002 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:11.292437 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c00a3b1d-c26d-4395-ae1d-f7efd18b7002 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:11.351503 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c00a3b1d-c26d-4395-ae1d-f7efd18b7002 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:11.352350 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c00a3b1d-c26d-4395-ae1d-f7efd18b7002 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:11.353137 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c00a3b1d-c26d-4395-ae1d-f7efd18b7002 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:11.354059 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-c00a3b1d-c26d-4395-ae1d-f7efd18b7002 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lazy-loading 'fault' on Instance uuid acb62f35-0751-41fe-ba8d-78b2357380e9 {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:25:11.425037 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c00a3b1d-c26d-4395-ae1d-f7efd18b7002 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e23378ed283426cbff623265d9bbc96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f033d34ad44397bfda5cba4c041071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:11.460942 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c00a3b1d-c26d-4395-ae1d-f7efd18b7002 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] 10.222.0.20 "GET /compute/v2.1/servers/acb62f35-0751-41fe-ba8d-78b2357380e9" status: 200 len: 1351 microversion: 2.1 time: 0.188820 Oct 27 03:25:11.476304 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 665/1373] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:11 2022] GET /compute/v2.1/servers/acb62f35-0751-41fe-ba8d-78b2357380e9 => generated 1351 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:11.487544 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-41d6448e-3164-4705-94f5-641b4d7afb88 req-b1c65123-50b3-45b3-9057-fcb4f3f93378 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d8a44aa-62e4-4385-b295-924517b6f850", "tag": "c7d8654a-e058-4157-b215-5b6094b1dbfe"}, {"server_uuid": "acb62f35-0751-41fe-ba8d-78b2357380e9", "name": "network-vif-deleted", "tag": "3f3c7991-4bc4-4933-8fde-a37f0e0f65a9"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:25:11.503476 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-41d6448e-3164-4705-94f5-641b4d7afb88 req-b1c65123-50b3-45b3-9057-fcb4f3f93378 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:11.504049 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-41d6448e-3164-4705-94f5-641b4d7afb88 req-b1c65123-50b3-45b3-9057-fcb4f3f93378 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:11.504562 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-41d6448e-3164-4705-94f5-641b4d7afb88 req-b1c65123-50b3-45b3-9057-fcb4f3f93378 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:11.514694 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d2bd5ee4-e1a1-4405-b6a9-bfffe5ed05cf tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:11.528046 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-41d6448e-3164-4705-94f5-641b4d7afb88 req-b1c65123-50b3-45b3-9057-fcb4f3f93378 service nova] Creating event network-changed:c7d8654a-e058-4157-b215-5b6094b1dbfe for instance 2d8a44aa-62e4-4385-b295-924517b6f850 on n-h1-862769-1 Oct 27 03:25:11.528730 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d2bd5ee4-e1a1-4405-b6a9-bfffe5ed05cf tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:11.529006 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-41d6448e-3164-4705-94f5-641b4d7afb88 req-b1c65123-50b3-45b3-9057-fcb4f3f93378 service nova] Creating event network-vif-deleted:3f3c7991-4bc4-4933-8fde-a37f0e0f65a9 for instance acb62f35-0751-41fe-ba8d-78b2357380e9 on n-h1-862769-1 Oct 27 03:25:11.534547 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d2bd5ee4-e1a1-4405-b6a9-bfffe5ed05cf tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:11.537003 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d2bd5ee4-e1a1-4405-b6a9-bfffe5ed05cf tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f" status: 200 len: 1410 microversion: 2.25 time: 0.470826 Oct 27 03:25:11.537816 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-41d6448e-3164-4705-94f5-641b4d7afb88 req-b1c65123-50b3-45b3-9057-fcb4f3f93378 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.067773 Oct 27 03:25:11.539073 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 666/1374] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:25:11 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:25:11.540320 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 709/1375] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:25:11 2022] GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f => generated 1410 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:25:11.549771 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e6132e04-0aed-4115-a025-af0ad7852b9f tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:11.550961 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e6132e04-0aed-4115-a025-af0ad7852b9f tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 33d5c62a-898f-441b-a1a1-3cb12836755d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:11.558163 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e6132e04-0aed-4115-a025-af0ad7852b9f tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:11.558935 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e6132e04-0aed-4115-a025-af0ad7852b9f tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:11.559965 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e6132e04-0aed-4115-a025-af0ad7852b9f tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:11.560614 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e6132e04-0aed-4115-a025-af0ad7852b9f tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:11.561738 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e6132e04-0aed-4115-a025-af0ad7852b9f tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:11.562549 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e6132e04-0aed-4115-a025-af0ad7852b9f tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:11.578756 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-de65fef0-4b98-4fd8-a0ca-6750969447cb tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:11.579470 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-de65fef0-4b98-4fd8-a0ca-6750969447cb tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: e8781053-3dad-4951-b4cb-1f4aaf97e19b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:11.593112 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-de65fef0-4b98-4fd8-a0ca-6750969447cb tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:11.595786 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-de65fef0-4b98-4fd8-a0ca-6750969447cb tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:11.596437 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-de65fef0-4b98-4fd8-a0ca-6750969447cb tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:11.597979 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-de65fef0-4b98-4fd8-a0ca-6750969447cb tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:11.600779 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-de65fef0-4b98-4fd8-a0ca-6750969447cb tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:11.601553 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-de65fef0-4b98-4fd8-a0ca-6750969447cb tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:11.784118 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e6132e04-0aed-4115-a025-af0ad7852b9f tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:11.794430 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e6132e04-0aed-4115-a025-af0ad7852b9f tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/33d5c62a-898f-441b-a1a1-3cb12836755d" status: 200 len: 1497 microversion: 2.1 time: 0.252706 Oct 27 03:25:11.795279 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 667/1376] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:11 2022] GET /compute/v2.1/servers/33d5c62a-898f-441b-a1a1-3cb12836755d => generated 1497 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:11.801672 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-cc2c1fc9-106e-4c40-a303-86b4bd1f9635 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:11.802502 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-cc2c1fc9-106e-4c40-a303-86b4bd1f9635 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: a4abccf0-a093-4148-a260-40ab363b12f6] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:11.820985 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cc2c1fc9-106e-4c40-a303-86b4bd1f9635 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:11.821778 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cc2c1fc9-106e-4c40-a303-86b4bd1f9635 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:11.822507 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cc2c1fc9-106e-4c40-a303-86b4bd1f9635 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:11.823899 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cc2c1fc9-106e-4c40-a303-86b4bd1f9635 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:11.824543 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cc2c1fc9-106e-4c40-a303-86b4bd1f9635 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:11.824949 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cc2c1fc9-106e-4c40-a303-86b4bd1f9635 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:11.841931 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-cc2c1fc9-106e-4c40-a303-86b4bd1f9635 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] HTTP exception thrown: Instance a4abccf0-a093-4148-a260-40ab363b12f6 could not be found. Oct 27 03:25:11.843871 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-cc2c1fc9-106e-4c40-a303-86b4bd1f9635 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Request method failure captured: Oct 27 03:25:11.843871 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/a4abccf0-a093-4148-a260-40ab363b12f6 HTTP/1.1 Oct 27 03:25:11.843871 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:25:11.843871 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:25:11.843871 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:25:11.843871 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:25:11.843871 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:25:11.843871 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:25:11.843871 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:25:11.843871 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:25:11.843871 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWflSNQach9Nb5a-nwpaet3DOMbW4rovpwiSisAjqFscpzZFwT6bcg_up1i76ycL6ujOTUfNYz_zBzvxITJnmbBErQShJ1lwwCzCfbPi_i3gA3nNTv5XKeqZukq5d_laOkT4ryxL3BEyqvlbo-j2kkQUt_sjeDJRyUijGXNWQdhqp_K4 Oct 27 03:25:11.843871 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:25:11.843871 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:25:11.843871 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:25:11.843871 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:25:11.843871 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:25:11.843871 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:25:11.843871 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: b95729a8c8a14361b7cbf8b2b13900b2 Oct 27 03:25:11.843871 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServersOnMultiNodesTest-265997062 Oct 27 03:25:11.843871 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:25:11.843871 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:25:11.847620 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b95729a8c8a14361b7cbf8b2b13900b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b95729a8c8a14361b7cbf8b2b13900b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b95729a8c8a14361b7cbf8b2b13900b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b95729a8c8a14361b7cbf8b2b13900b2"}]}] Oct 27 03:25:11.847620 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServersOnMultiNodesTest-265997062 Oct 27 03:25:11.847620 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: b95729a8c8a14361b7cbf8b2b13900b2 Oct 27 03:25:11.847620 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-265997062 Oct 27 03:25:11.847620 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServersOnMultiNodesTest-265997062-project Oct 27 03:25:11.847620 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:25:11.847620 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:25:11.847620 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 91d1351fcb6b4cd08f176e6d0cc5bb11 Oct 27 03:25:11.847620 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServersOnMultiNodesTest-265997062-project Oct 27 03:25:11.847620 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:25:11.847620 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance a4abccf0-a093-4148-a260-40ab363b12f6 could not be found. Oct 27 03:25:11.847620 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': 'a4abccf0-a093-4148-a260-40ab363b12f6'} Oct 27 03:25:11.848939 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:25:11.848939 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:25:11.848939 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:25:11.848939 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:25:11.848939 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:25:11.848939 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:25:11.848939 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:25:11.848939 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:25:11.848939 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:25:11.848939 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:25:11.848939 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4abccf0-a093-4148-a260-40ab363b12f6 could not be found. Oct 27 03:25:11.848939 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:25:11.848939 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:25:11.848939 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:25:11.848939 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:25:11.848939 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:25:11.848939 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:25:11.848939 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:25:11.848939 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:25:11.848939 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:25:11.850805 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:25:11.850805 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:25:11.850805 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:25:11.850805 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:25:11.850805 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:25:11.850805 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:25:11.850805 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:25:11.850805 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4abccf0-a093-4148-a260-40ab363b12f6 could not be found. Oct 27 03:25:11.850805 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:25:11.850805 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:25:11.850805 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:25:11.850805 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:25:11.850805 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:25:11.850805 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:25:11.850805 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:25:11.850805 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:25:11.850805 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4abccf0-a093-4148-a260-40ab363b12f6 could not be found. Oct 27 03:25:11.850805 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:25:11.852172 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-cc2c1fc9-106e-4c40-a303-86b4bd1f9635 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Returning 404 to user: Instance a4abccf0-a093-4148-a260-40ab363b12f6 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:25:11.852172 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-cc2c1fc9-106e-4c40-a303-86b4bd1f9635 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/a4abccf0-a093-4148-a260-40ab363b12f6" status: 404 len: 111 microversion: 2.1 time: 0.048845 Oct 27 03:25:11.852172 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 668/1377] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:11 2022] GET /compute/v2.1/servers/a4abccf0-a093-4148-a260-40ab363b12f6 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:25:11.859032 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-011b6017-6693-48bf-bb17-73440af39aaf tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:11.859589 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-011b6017-6693-48bf-bb17-73440af39aaf tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: 6f360a9c-90c7-4efd-90c2-c0d3bd15c154] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:11.869030 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-011b6017-6693-48bf-bb17-73440af39aaf tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:11.870154 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-011b6017-6693-48bf-bb17-73440af39aaf tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:11.870768 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-011b6017-6693-48bf-bb17-73440af39aaf tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:11.872102 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-011b6017-6693-48bf-bb17-73440af39aaf tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:11.873103 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-011b6017-6693-48bf-bb17-73440af39aaf tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:11.873587 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-011b6017-6693-48bf-bb17-73440af39aaf tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:11.904911 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-011b6017-6693-48bf-bb17-73440af39aaf tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: 6f360a9c-90c7-4efd-90c2-c0d3bd15c154] Going to try to terminate instance {{(pid=121001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:25:11.993457 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-de65fef0-4b98-4fd8-a0ca-6750969447cb tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:12.001721 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-de65fef0-4b98-4fd8-a0ca-6750969447cb tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b" status: 200 len: 1313 microversion: 2.1 time: 0.426681 Oct 27 03:25:12.003534 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 710/1378] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:11 2022] GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b => generated 1313 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:12.009467 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9fea1400-759a-46c3-b041-af66596b5a31 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:12.010346 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9fea1400-759a-46c3-b041-af66596b5a31 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] [instance: 2d8a44aa-62e4-4385-b295-924517b6f850] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:12.017310 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9fea1400-759a-46c3-b041-af66596b5a31 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:12.018220 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9fea1400-759a-46c3-b041-af66596b5a31 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:12.018887 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9fea1400-759a-46c3-b041-af66596b5a31 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:12.019824 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9fea1400-759a-46c3-b041-af66596b5a31 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:12.020463 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9fea1400-759a-46c3-b041-af66596b5a31 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:12.021177 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9fea1400-759a-46c3-b041-af66596b5a31 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:12.231953 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9fea1400-759a-46c3-b041-af66596b5a31 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ccd5909fb214f71ad68704019c9e4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d2c150feac4d03966a860ab8bafe00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:12.244594 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9fea1400-759a-46c3-b041-af66596b5a31 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] 10.222.0.20 "GET /compute/v2.1/servers/2d8a44aa-62e4-4385-b295-924517b6f850" status: 200 len: 1322 microversion: 2.1 time: 0.239473 Oct 27 03:25:12.245412 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 711/1379] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:12 2022] GET /compute/v2.1/servers/2d8a44aa-62e4-4385-b295-924517b6f850 => generated 1322 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:12.264172 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-011b6017-6693-48bf-bb17-73440af39aaf tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6f360a9c-90c7-4efd-90c2-c0d3bd15c154" status: 204 len: 0 microversion: 2.1 time: 0.410186 Oct 27 03:25:12.264761 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 669/1380] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:25:11 2022] DELETE /compute/v2.1/servers/6f360a9c-90c7-4efd-90c2-c0d3bd15c154 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:25:12.273953 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2ca86111-4102-43a0-bc30-9a3b0b2f3a5e tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:12.274569 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-2ca86111-4102-43a0-bc30-9a3b0b2f3a5e tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: ac5fc2b3-c92e-470a-9bc6-885dce75fb8c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:12.280945 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2ca86111-4102-43a0-bc30-9a3b0b2f3a5e tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:12.281556 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2ca86111-4102-43a0-bc30-9a3b0b2f3a5e tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:12.282153 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2ca86111-4102-43a0-bc30-9a3b0b2f3a5e tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:12.283103 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2ca86111-4102-43a0-bc30-9a3b0b2f3a5e tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:12.283816 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2ca86111-4102-43a0-bc30-9a3b0b2f3a5e tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:12.284485 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2ca86111-4102-43a0-bc30-9a3b0b2f3a5e tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:12.318649 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-2ca86111-4102-43a0-bc30-9a3b0b2f3a5e tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: ac5fc2b3-c92e-470a-9bc6-885dce75fb8c] Going to try to terminate instance {{(pid=121000) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:25:12.491850 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-271261ff-0a10-45fd-913e-090f95cb3274 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:12.492648 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-271261ff-0a10-45fd-913e-090f95cb3274 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] [instance: acb62f35-0751-41fe-ba8d-78b2357380e9] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:12.499898 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-271261ff-0a10-45fd-913e-090f95cb3274 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:12.500526 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-271261ff-0a10-45fd-913e-090f95cb3274 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:12.501195 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-271261ff-0a10-45fd-913e-090f95cb3274 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:12.502020 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-271261ff-0a10-45fd-913e-090f95cb3274 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:12.502682 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-271261ff-0a10-45fd-913e-090f95cb3274 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:12.503228 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-271261ff-0a10-45fd-913e-090f95cb3274 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:12.535699 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-271261ff-0a10-45fd-913e-090f95cb3274 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:12.536243 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-271261ff-0a10-45fd-913e-090f95cb3274 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:12.536755 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-271261ff-0a10-45fd-913e-090f95cb3274 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:12.537280 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-271261ff-0a10-45fd-913e-090f95cb3274 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lazy-loading 'fault' on Instance uuid acb62f35-0751-41fe-ba8d-78b2357380e9 {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:25:12.586387 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-271261ff-0a10-45fd-913e-090f95cb3274 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e23378ed283426cbff623265d9bbc96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f033d34ad44397bfda5cba4c041071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:12.595008 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-271261ff-0a10-45fd-913e-090f95cb3274 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] 10.222.0.20 "GET /compute/v2.1/servers/acb62f35-0751-41fe-ba8d-78b2357380e9" status: 200 len: 1351 microversion: 2.1 time: 0.109679 Oct 27 03:25:12.596507 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 670/1381] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:12 2022] GET /compute/v2.1/servers/acb62f35-0751-41fe-ba8d-78b2357380e9 => generated 1351 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:25:12.601712 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b23f7e83-d22a-48cd-aeb7-ec4f2019c0d6 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:12.602675 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b23f7e83-d22a-48cd-aeb7-ec4f2019c0d6 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:12.609351 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b23f7e83-d22a-48cd-aeb7-ec4f2019c0d6 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:12.610003 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b23f7e83-d22a-48cd-aeb7-ec4f2019c0d6 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:12.610648 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b23f7e83-d22a-48cd-aeb7-ec4f2019c0d6 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:12.614805 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b23f7e83-d22a-48cd-aeb7-ec4f2019c0d6 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:12.614805 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b23f7e83-d22a-48cd-aeb7-ec4f2019c0d6 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:12.614805 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b23f7e83-d22a-48cd-aeb7-ec4f2019c0d6 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:12.617859 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:25:12.673465 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2ca86111-4102-43a0-bc30-9a3b0b2f3a5e tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ac5fc2b3-c92e-470a-9bc6-885dce75fb8c" status: 204 len: 0 microversion: 2.1 time: 0.403328 Oct 27 03:25:12.678545 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 712/1382] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:25:12 2022] DELETE /compute/v2.1/servers/ac5fc2b3-c92e-470a-9bc6-885dce75fb8c => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:25:12.683174 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d64ad357-699a-4bc5-9519-e1c55a7b9f1f tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:12.684141 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d64ad357-699a-4bc5-9519-e1c55a7b9f1f tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: 6f360a9c-90c7-4efd-90c2-c0d3bd15c154] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:12.690650 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d64ad357-699a-4bc5-9519-e1c55a7b9f1f tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:12.691350 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d64ad357-699a-4bc5-9519-e1c55a7b9f1f tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:12.691953 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d64ad357-699a-4bc5-9519-e1c55a7b9f1f tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:12.692831 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d64ad357-699a-4bc5-9519-e1c55a7b9f1f tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:12.693449 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d64ad357-699a-4bc5-9519-e1c55a7b9f1f tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:12.694089 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d64ad357-699a-4bc5-9519-e1c55a7b9f1f tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:12.769769 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b23f7e83-d22a-48cd-aeb7-ec4f2019c0d6 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:12.778267 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b23f7e83-d22a-48cd-aeb7-ec4f2019c0d6 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:12.779802 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b23f7e83-d22a-48cd-aeb7-ec4f2019c0d6 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:12.781129 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b23f7e83-d22a-48cd-aeb7-ec4f2019c0d6 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f" status: 200 len: 1410 microversion: 2.25 time: 0.183330 Oct 27 03:25:12.781783 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 671/1383] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:25:12 2022] GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f => generated 1410 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:25:12.817072 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c64b773c-54ab-4e55-b6d7-4e2aed43e951 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:12.823962 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c64b773c-54ab-4e55-b6d7-4e2aed43e951 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 33d5c62a-898f-441b-a1a1-3cb12836755d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:12.824358 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c64b773c-54ab-4e55-b6d7-4e2aed43e951 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:12.825108 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c64b773c-54ab-4e55-b6d7-4e2aed43e951 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:12.825756 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c64b773c-54ab-4e55-b6d7-4e2aed43e951 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:12.826576 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c64b773c-54ab-4e55-b6d7-4e2aed43e951 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:12.827123 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c64b773c-54ab-4e55-b6d7-4e2aed43e951 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:12.827848 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c64b773c-54ab-4e55-b6d7-4e2aed43e951 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:12.911871 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d64ad357-699a-4bc5-9519-e1c55a7b9f1f tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:12.920580 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d64ad357-699a-4bc5-9519-e1c55a7b9f1f tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/6f360a9c-90c7-4efd-90c2-c0d3bd15c154" status: 200 len: 1475 microversion: 2.1 time: 0.241620 Oct 27 03:25:12.921170 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 713/1384] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:12 2022] GET /compute/v2.1/servers/6f360a9c-90c7-4efd-90c2-c0d3bd15c154 => generated 1475 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:12.973032 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c64b773c-54ab-4e55-b6d7-4e2aed43e951 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:12.981916 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c64b773c-54ab-4e55-b6d7-4e2aed43e951 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/33d5c62a-898f-441b-a1a1-3cb12836755d" status: 200 len: 1497 microversion: 2.1 time: 0.168966 Oct 27 03:25:12.983141 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 672/1385] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:12 2022] GET /compute/v2.1/servers/33d5c62a-898f-441b-a1a1-3cb12836755d => generated 1497 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:25:13.034795 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-92c5ea11-0ee2-4eec-8ae5-8ae5e6ff4558 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:13.035863 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-92c5ea11-0ee2-4eec-8ae5-8ae5e6ff4558 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: e8781053-3dad-4951-b4cb-1f4aaf97e19b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:13.049683 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-92c5ea11-0ee2-4eec-8ae5-8ae5e6ff4558 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:13.055466 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-92c5ea11-0ee2-4eec-8ae5-8ae5e6ff4558 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:13.055466 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-92c5ea11-0ee2-4eec-8ae5-8ae5e6ff4558 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:13.055466 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-92c5ea11-0ee2-4eec-8ae5-8ae5e6ff4558 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:13.055466 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-92c5ea11-0ee2-4eec-8ae5-8ae5e6ff4558 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:13.055834 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-92c5ea11-0ee2-4eec-8ae5-8ae5e6ff4558 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:13.212001 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-92c5ea11-0ee2-4eec-8ae5-8ae5e6ff4558 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:13.220287 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-92c5ea11-0ee2-4eec-8ae5-8ae5e6ff4558 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b" status: 200 len: 1313 microversion: 2.1 time: 0.196770 Oct 27 03:25:13.220976 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 714/1386] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:13 2022] GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b => generated 1313 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:13.269832 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9f1de35b-3de8-470b-90be-7096ea75a190 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:13.270492 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-9f1de35b-3de8-470b-90be-7096ea75a190 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] [instance: 2d8a44aa-62e4-4385-b295-924517b6f850] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:13.280701 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9f1de35b-3de8-470b-90be-7096ea75a190 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:13.281497 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9f1de35b-3de8-470b-90be-7096ea75a190 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:13.281942 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9f1de35b-3de8-470b-90be-7096ea75a190 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:13.282881 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9f1de35b-3de8-470b-90be-7096ea75a190 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:13.283350 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9f1de35b-3de8-470b-90be-7096ea75a190 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:13.283786 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9f1de35b-3de8-470b-90be-7096ea75a190 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:13.454879 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9f1de35b-3de8-470b-90be-7096ea75a190 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ccd5909fb214f71ad68704019c9e4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d2c150feac4d03966a860ab8bafe00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:13.467470 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9f1de35b-3de8-470b-90be-7096ea75a190 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] 10.222.0.20 "GET /compute/v2.1/servers/2d8a44aa-62e4-4385-b295-924517b6f850" status: 200 len: 1322 microversion: 2.1 time: 0.203001 Oct 27 03:25:13.468183 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 673/1387] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:13 2022] GET /compute/v2.1/servers/2d8a44aa-62e4-4385-b295-924517b6f850 => generated 1322 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:13.621147 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8bd716c0-8895-48da-b196-712b9a555556 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:13.621950 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8bd716c0-8895-48da-b196-712b9a555556 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] [instance: acb62f35-0751-41fe-ba8d-78b2357380e9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:13.630433 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8bd716c0-8895-48da-b196-712b9a555556 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:13.631054 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8bd716c0-8895-48da-b196-712b9a555556 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:13.631562 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8bd716c0-8895-48da-b196-712b9a555556 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:13.632351 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8bd716c0-8895-48da-b196-712b9a555556 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:13.632884 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8bd716c0-8895-48da-b196-712b9a555556 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:13.633577 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8bd716c0-8895-48da-b196-712b9a555556 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:13.653622 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-8bd716c0-8895-48da-b196-712b9a555556 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] HTTP exception thrown: Instance acb62f35-0751-41fe-ba8d-78b2357380e9 could not be found. Oct 27 03:25:13.655490 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8bd716c0-8895-48da-b196-712b9a555556 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Request method failure captured: Oct 27 03:25:13.655490 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/acb62f35-0751-41fe-ba8d-78b2357380e9 HTTP/1.1 Oct 27 03:25:13.655490 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:25:13.655490 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:25:13.655490 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:25:13.655490 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:25:13.655490 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:25:13.655490 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:25:13.655490 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:25:13.655490 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:25:13.655490 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWflVgkubTMkxsjZs-C9cKVG4uOTUcUki_H0M25KVUX1izwlO3Epjw6hffDxpWwwDluPhuc1dFqy3H7AFfH18_sKiEtj3yigRz4JHysUFah5ZtcrSX59YOeWG6lhiaQHiPwRG_BN4o9uCCOMjfRcm1mbuRg2L8nfQMkzpaza-ba0UmyY Oct 27 03:25:13.655490 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:25:13.655490 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:25:13.655490 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:25:13.655490 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:25:13.655490 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:25:13.655490 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:25:13.655490 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 39f033d34ad44397bfda5cba4c041071 Oct 27 03:25:13.655490 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1092761873 Oct 27 03:25:13.655490 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:25:13.655490 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:25:13.658948 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/39f033d34ad44397bfda5cba4c041071"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/39f033d34ad44397bfda5cba4c041071"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/39f033d34ad44397bfda5cba4c041071"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_39f033d34ad44397bfda5cba4c041071"}]}] Oct 27 03:25:13.658948 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1092761873 Oct 27 03:25:13.658948 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 39f033d34ad44397bfda5cba4c041071 Oct 27 03:25:13.658948 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1092761873 Oct 27 03:25:13.658948 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1092761873-project Oct 27 03:25:13.658948 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:25:13.658948 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:25:13.658948 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 2e23378ed283426cbff623265d9bbc96 Oct 27 03:25:13.658948 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1092761873-project Oct 27 03:25:13.658948 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:25:13.658948 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance acb62f35-0751-41fe-ba8d-78b2357380e9 could not be found. Oct 27 03:25:13.658948 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': 'acb62f35-0751-41fe-ba8d-78b2357380e9'} Oct 27 03:25:13.659723 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:25:13.659723 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:25:13.659723 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:25:13.659723 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:25:13.659723 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:25:13.659723 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:25:13.659723 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:25:13.659723 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:25:13.659723 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:25:13.659723 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:25:13.659723 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acb62f35-0751-41fe-ba8d-78b2357380e9 could not be found. Oct 27 03:25:13.659723 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:25:13.659723 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:25:13.659723 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:25:13.659723 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:25:13.659723 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:25:13.659723 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:25:13.659723 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:25:13.659723 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:25:13.659723 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:25:13.661019 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:25:13.661019 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:25:13.661019 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:25:13.661019 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:25:13.661019 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:25:13.661019 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:25:13.661019 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:25:13.661019 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acb62f35-0751-41fe-ba8d-78b2357380e9 could not be found. Oct 27 03:25:13.661019 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:25:13.661019 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:25:13.661019 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:25:13.661019 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:25:13.661019 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:25:13.661019 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:25:13.661019 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:25:13.661019 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:25:13.661019 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acb62f35-0751-41fe-ba8d-78b2357380e9 could not be found. Oct 27 03:25:13.661019 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:25:13.662675 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8bd716c0-8895-48da-b196-712b9a555556 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Returning 404 to user: Instance acb62f35-0751-41fe-ba8d-78b2357380e9 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:25:13.662675 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8bd716c0-8895-48da-b196-712b9a555556 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] 10.222.0.20 "GET /compute/v2.1/servers/acb62f35-0751-41fe-ba8d-78b2357380e9" status: 404 len: 111 microversion: 2.1 time: 0.040280 Oct 27 03:25:13.662675 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 715/1388] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:13 2022] GET /compute/v2.1/servers/acb62f35-0751-41fe-ba8d-78b2357380e9 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:25:13.667478 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c9ebb758-525e-46e9-ac7c-bf9bf34045dd tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:13.667984 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c9ebb758-525e-46e9-ac7c-bf9bf34045dd tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] [instance: 2d4fe59a-b31c-4fc0-8994-eb21e313d18a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:13.677106 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c9ebb758-525e-46e9-ac7c-bf9bf34045dd tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:13.677845 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c9ebb758-525e-46e9-ac7c-bf9bf34045dd tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:13.682761 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c9ebb758-525e-46e9-ac7c-bf9bf34045dd tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:13.682761 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c9ebb758-525e-46e9-ac7c-bf9bf34045dd tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:13.682761 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c9ebb758-525e-46e9-ac7c-bf9bf34045dd tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:13.683432 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c9ebb758-525e-46e9-ac7c-bf9bf34045dd tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:13.695442 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-c9ebb758-525e-46e9-ac7c-bf9bf34045dd tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] HTTP exception thrown: Instance 2d4fe59a-b31c-4fc0-8994-eb21e313d18a could not be found. Oct 27 03:25:13.697131 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c9ebb758-525e-46e9-ac7c-bf9bf34045dd tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Request method failure captured: Oct 27 03:25:13.697131 n-d-862769-1 devstack@n-api.service[121001]: request: DELETE /compute/v2.1/servers/2d4fe59a-b31c-4fc0-8994-eb21e313d18a HTTP/1.1 Oct 27 03:25:13.697131 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:25:13.697131 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:25:13.697131 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:25:13.697131 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:25:13.697131 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:25:13.697131 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:25:13.697131 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:25:13.697131 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:25:13.697131 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWflVgkubTMkxsjZs-C9cKVG4uOTUcUki_H0M25KVUX1izwlO3Epjw6hffDxpWwwDluPhuc1dFqy3H7AFfH18_sKiEtj3yigRz4JHysUFah5ZtcrSX59YOeWG6lhiaQHiPwRG_BN4o9uCCOMjfRcm1mbuRg2L8nfQMkzpaza-ba0UmyY Oct 27 03:25:13.697131 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:25:13.697131 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:25:13.697131 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:25:13.697131 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:25:13.697131 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:25:13.697131 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:25:13.697131 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 39f033d34ad44397bfda5cba4c041071 Oct 27 03:25:13.697131 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1092761873 Oct 27 03:25:13.697131 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:25:13.697131 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:25:13.698692 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/39f033d34ad44397bfda5cba4c041071"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/39f033d34ad44397bfda5cba4c041071"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/39f033d34ad44397bfda5cba4c041071"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_39f033d34ad44397bfda5cba4c041071"}]}] Oct 27 03:25:13.698692 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1092761873 Oct 27 03:25:13.698692 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 39f033d34ad44397bfda5cba4c041071 Oct 27 03:25:13.698692 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1092761873 Oct 27 03:25:13.698692 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1092761873-project Oct 27 03:25:13.698692 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:25:13.698692 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:25:13.698692 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 2e23378ed283426cbff623265d9bbc96 Oct 27 03:25:13.698692 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1092761873-project Oct 27 03:25:13.698692 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:25:13.698692 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 2d4fe59a-b31c-4fc0-8994-eb21e313d18a could not be found. Oct 27 03:25:13.698692 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '2d4fe59a-b31c-4fc0-8994-eb21e313d18a'} Oct 27 03:25:13.699596 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:25:13.699596 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:25:13.699596 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:25:13.699596 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:25:13.699596 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:25:13.699596 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:25:13.699596 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:25:13.699596 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:25:13.699596 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:25:13.699596 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:25:13.699596 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d4fe59a-b31c-4fc0-8994-eb21e313d18a could not be found. Oct 27 03:25:13.699596 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:25:13.699596 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:25:13.699596 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:25:13.699596 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:25:13.699596 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:25:13.699596 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:25:13.699596 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:25:13.699596 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:25:13.699596 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:25:13.701099 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:25:13.701099 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 03:25:13.701099 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 03:25:13.701099 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 03:25:13.701099 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 03:25:13.701099 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:25:13.701099 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:25:13.701099 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:25:13.701099 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:25:13.701099 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d4fe59a-b31c-4fc0-8994-eb21e313d18a could not be found. Oct 27 03:25:13.701099 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:25:13.701099 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:25:13.701099 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:25:13.701099 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:25:13.701099 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:25:13.701099 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:25:13.701099 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:25:13.701099 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:25:13.701099 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d4fe59a-b31c-4fc0-8994-eb21e313d18a could not be found. Oct 27 03:25:13.701099 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:25:13.702478 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c9ebb758-525e-46e9-ac7c-bf9bf34045dd tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Returning 404 to user: Instance 2d4fe59a-b31c-4fc0-8994-eb21e313d18a could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:25:13.702478 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c9ebb758-525e-46e9-ac7c-bf9bf34045dd tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2d4fe59a-b31c-4fc0-8994-eb21e313d18a" status: 404 len: 111 microversion: 2.1 time: 0.036139 Oct 27 03:25:13.702874 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 674/1389] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:25:13 2022] DELETE /compute/v2.1/servers/2d4fe59a-b31c-4fc0-8994-eb21e313d18a => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:25:13.711827 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-dbaa45d9-a635-4d84-9f40-5891b4707b2e tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:13.711827 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-dbaa45d9-a635-4d84-9f40-5891b4707b2e tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] [instance: 2d4fe59a-b31c-4fc0-8994-eb21e313d18a] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:13.711827 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:25:13.714846 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dbaa45d9-a635-4d84-9f40-5891b4707b2e tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:13.715338 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dbaa45d9-a635-4d84-9f40-5891b4707b2e tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:13.715989 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dbaa45d9-a635-4d84-9f40-5891b4707b2e tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:13.716901 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dbaa45d9-a635-4d84-9f40-5891b4707b2e tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:13.717530 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dbaa45d9-a635-4d84-9f40-5891b4707b2e tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:13.717966 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dbaa45d9-a635-4d84-9f40-5891b4707b2e tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:13.733763 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-dbaa45d9-a635-4d84-9f40-5891b4707b2e tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] HTTP exception thrown: Instance 2d4fe59a-b31c-4fc0-8994-eb21e313d18a could not be found. Oct 27 03:25:13.735745 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-dbaa45d9-a635-4d84-9f40-5891b4707b2e tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Request method failure captured: Oct 27 03:25:13.735745 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/2d4fe59a-b31c-4fc0-8994-eb21e313d18a HTTP/1.1 Oct 27 03:25:13.735745 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:25:13.735745 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:25:13.735745 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:25:13.735745 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:25:13.735745 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:25:13.735745 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:25:13.735745 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:25:13.735745 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:25:13.735745 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWflVgkubTMkxsjZs-C9cKVG4uOTUcUki_H0M25KVUX1izwlO3Epjw6hffDxpWwwDluPhuc1dFqy3H7AFfH18_sKiEtj3yigRz4JHysUFah5ZtcrSX59YOeWG6lhiaQHiPwRG_BN4o9uCCOMjfRcm1mbuRg2L8nfQMkzpaza-ba0UmyY Oct 27 03:25:13.735745 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:25:13.735745 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:25:13.735745 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:25:13.735745 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:25:13.735745 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:25:13.735745 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:25:13.735745 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 39f033d34ad44397bfda5cba4c041071 Oct 27 03:25:13.735745 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1092761873 Oct 27 03:25:13.735745 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:25:13.735745 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:25:13.737590 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/39f033d34ad44397bfda5cba4c041071"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/39f033d34ad44397bfda5cba4c041071"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/39f033d34ad44397bfda5cba4c041071"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_39f033d34ad44397bfda5cba4c041071"}]}] Oct 27 03:25:13.737590 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1092761873 Oct 27 03:25:13.737590 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 39f033d34ad44397bfda5cba4c041071 Oct 27 03:25:13.737590 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1092761873 Oct 27 03:25:13.737590 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1092761873-project Oct 27 03:25:13.737590 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:25:13.737590 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:25:13.737590 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 2e23378ed283426cbff623265d9bbc96 Oct 27 03:25:13.737590 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1092761873-project Oct 27 03:25:13.737590 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:25:13.737590 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 2d4fe59a-b31c-4fc0-8994-eb21e313d18a could not be found. Oct 27 03:25:13.737590 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '2d4fe59a-b31c-4fc0-8994-eb21e313d18a'} Oct 27 03:25:13.738415 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:25:13.738415 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:25:13.738415 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:25:13.738415 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:25:13.738415 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:25:13.738415 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:25:13.738415 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:25:13.738415 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:25:13.738415 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:25:13.738415 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:25:13.738415 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d4fe59a-b31c-4fc0-8994-eb21e313d18a could not be found. Oct 27 03:25:13.738415 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:25:13.738415 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:25:13.738415 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:25:13.738415 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:25:13.738415 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:25:13.738415 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:25:13.738415 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:25:13.738415 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:25:13.738415 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:25:13.739686 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:25:13.739686 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:25:13.739686 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:25:13.739686 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:25:13.739686 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:25:13.739686 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:25:13.739686 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:25:13.739686 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d4fe59a-b31c-4fc0-8994-eb21e313d18a could not be found. Oct 27 03:25:13.739686 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:25:13.739686 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:25:13.739686 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:25:13.739686 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:25:13.739686 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:25:13.739686 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:25:13.739686 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:25:13.739686 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:25:13.739686 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d4fe59a-b31c-4fc0-8994-eb21e313d18a could not be found. Oct 27 03:25:13.739686 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:25:13.741632 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-dbaa45d9-a635-4d84-9f40-5891b4707b2e tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Returning 404 to user: Instance 2d4fe59a-b31c-4fc0-8994-eb21e313d18a could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:25:13.742702 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-dbaa45d9-a635-4d84-9f40-5891b4707b2e tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] 10.222.0.20 "GET /compute/v2.1/servers/2d4fe59a-b31c-4fc0-8994-eb21e313d18a" status: 404 len: 111 microversion: 2.1 time: 0.039016 Oct 27 03:25:13.743421 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 716/1390] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:13 2022] GET /compute/v2.1/servers/2d4fe59a-b31c-4fc0-8994-eb21e313d18a => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 03:25:13.761967 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a7d69591-eb7d-4d85-95af-aec0b68b1d66 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Calling method '.version_select at 0x7f7ddee02d30>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:13.808808 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-deb30f81-e018-42f6-9a1a-5c955a43abb7 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:13.809523 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-deb30f81-e018-42f6-9a1a-5c955a43abb7 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:13.816625 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-deb30f81-e018-42f6-9a1a-5c955a43abb7 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:13.817392 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-deb30f81-e018-42f6-9a1a-5c955a43abb7 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:13.818150 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-deb30f81-e018-42f6-9a1a-5c955a43abb7 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:13.819085 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-deb30f81-e018-42f6-9a1a-5c955a43abb7 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:13.820105 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-deb30f81-e018-42f6-9a1a-5c955a43abb7 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:13.820619 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-deb30f81-e018-42f6-9a1a-5c955a43abb7 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:13.882641 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a7d69591-eb7d-4d85-95af-aec0b68b1d66 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-831517697" status: 202 len: 0 microversion: 2.1 time: 0.126350 Oct 27 03:25:13.886687 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 675/1391] 10.222.0.20 () {58 vars in 1218 bytes} [Thu Oct 27 03:25:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-831517697 => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:25:13.947812 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-52322d71-106a-418d-a460-88efbf289fe9 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:13.950504 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-52322d71-106a-418d-a460-88efbf289fe9 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: 6f360a9c-90c7-4efd-90c2-c0d3bd15c154] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:13.974002 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-52322d71-106a-418d-a460-88efbf289fe9 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:13.975314 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-52322d71-106a-418d-a460-88efbf289fe9 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:13.978992 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-52322d71-106a-418d-a460-88efbf289fe9 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:13.983419 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-52322d71-106a-418d-a460-88efbf289fe9 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:13.984195 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-52322d71-106a-418d-a460-88efbf289fe9 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:13.985942 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-52322d71-106a-418d-a460-88efbf289fe9 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:13.998782 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-deb30f81-e018-42f6-9a1a-5c955a43abb7 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:14.020594 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-deb30f81-e018-42f6-9a1a-5c955a43abb7 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:14.022752 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-deb30f81-e018-42f6-9a1a-5c955a43abb7 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:14.023959 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-deb30f81-e018-42f6-9a1a-5c955a43abb7 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f" status: 200 len: 1410 microversion: 2.25 time: 0.220596 Oct 27 03:25:14.040098 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 717/1392] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:25:13 2022] GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f => generated 1410 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:25:14.072760 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1fe80369-ae7a-4f98-913b-3acd63c7a226 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:14.075276 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1fe80369-ae7a-4f98-913b-3acd63c7a226 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 33d5c62a-898f-441b-a1a1-3cb12836755d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:14.098876 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1fe80369-ae7a-4f98-913b-3acd63c7a226 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:14.099942 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1fe80369-ae7a-4f98-913b-3acd63c7a226 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:14.100606 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1fe80369-ae7a-4f98-913b-3acd63c7a226 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:14.101565 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1fe80369-ae7a-4f98-913b-3acd63c7a226 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:14.102616 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1fe80369-ae7a-4f98-913b-3acd63c7a226 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:14.103277 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1fe80369-ae7a-4f98-913b-3acd63c7a226 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:14.134095 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:25:14.337746 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-52322d71-106a-418d-a460-88efbf289fe9 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:14.347120 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-52322d71-106a-418d-a460-88efbf289fe9 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/6f360a9c-90c7-4efd-90c2-c0d3bd15c154" status: 200 len: 1475 microversion: 2.1 time: 0.407578 Oct 27 03:25:14.358827 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 676/1393] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:13 2022] GET /compute/v2.1/servers/6f360a9c-90c7-4efd-90c2-c0d3bd15c154 => generated 1475 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:14.369341 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5c25b722-2784-4299-8ab4-b62aa2abe74e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:14.370243 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5c25b722-2784-4299-8ab4-b62aa2abe74e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: e8781053-3dad-4951-b4cb-1f4aaf97e19b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:14.376803 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5c25b722-2784-4299-8ab4-b62aa2abe74e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:14.377574 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5c25b722-2784-4299-8ab4-b62aa2abe74e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:14.378225 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5c25b722-2784-4299-8ab4-b62aa2abe74e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:14.379367 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5c25b722-2784-4299-8ab4-b62aa2abe74e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:14.379996 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5c25b722-2784-4299-8ab4-b62aa2abe74e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:14.380602 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5c25b722-2784-4299-8ab4-b62aa2abe74e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:14.618491 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5c25b722-2784-4299-8ab4-b62aa2abe74e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:14.629190 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5c25b722-2784-4299-8ab4-b62aa2abe74e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b" status: 200 len: 1462 microversion: 2.1 time: 0.268840 Oct 27 03:25:14.630560 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 677/1394] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:14 2022] GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b => generated 1462 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:14.637107 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f05042f8-9349-4105-9c98-6312d42f3c7e tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:14.638066 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f05042f8-9349-4105-9c98-6312d42f3c7e tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] [instance: 2d8a44aa-62e4-4385-b295-924517b6f850] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:14.647072 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f05042f8-9349-4105-9c98-6312d42f3c7e tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:14.648121 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f05042f8-9349-4105-9c98-6312d42f3c7e tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:14.648811 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f05042f8-9349-4105-9c98-6312d42f3c7e tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:14.649769 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f05042f8-9349-4105-9c98-6312d42f3c7e tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:14.650786 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f05042f8-9349-4105-9c98-6312d42f3c7e tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:14.651458 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f05042f8-9349-4105-9c98-6312d42f3c7e tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:14.916906 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f05042f8-9349-4105-9c98-6312d42f3c7e tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ccd5909fb214f71ad68704019c9e4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d2c150feac4d03966a860ab8bafe00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:14.931678 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f05042f8-9349-4105-9c98-6312d42f3c7e tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] 10.222.0.20 "GET /compute/v2.1/servers/2d8a44aa-62e4-4385-b295-924517b6f850" status: 200 len: 1322 microversion: 2.1 time: 0.297494 Oct 27 03:25:14.932870 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 678/1395] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:14 2022] GET /compute/v2.1/servers/2d8a44aa-62e4-4385-b295-924517b6f850 => generated 1322 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:14.947527 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9150b25d-76bd-40fa-8f49-b3d72eb1edef tempest-MigrationsAdminTest-707106630 tempest-MigrationsAdminTest-707106630-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:14.947527 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-9150b25d-76bd-40fa-8f49-b3d72eb1edef tempest-MigrationsAdminTest-707106630 tempest-MigrationsAdminTest-707106630-project-admin] [instance: e8781053-3dad-4951-b4cb-1f4aaf97e19b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:14.959450 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9150b25d-76bd-40fa-8f49-b3d72eb1edef tempest-MigrationsAdminTest-707106630 tempest-MigrationsAdminTest-707106630-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:14.960184 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9150b25d-76bd-40fa-8f49-b3d72eb1edef tempest-MigrationsAdminTest-707106630 tempest-MigrationsAdminTest-707106630-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:14.960956 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9150b25d-76bd-40fa-8f49-b3d72eb1edef tempest-MigrationsAdminTest-707106630 tempest-MigrationsAdminTest-707106630-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:14.961828 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9150b25d-76bd-40fa-8f49-b3d72eb1edef tempest-MigrationsAdminTest-707106630 tempest-MigrationsAdminTest-707106630-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:14.962559 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9150b25d-76bd-40fa-8f49-b3d72eb1edef tempest-MigrationsAdminTest-707106630 tempest-MigrationsAdminTest-707106630-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:14.963172 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9150b25d-76bd-40fa-8f49-b3d72eb1edef tempest-MigrationsAdminTest-707106630 tempest-MigrationsAdminTest-707106630-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:15.178140 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9150b25d-76bd-40fa-8f49-b3d72eb1edef tempest-MigrationsAdminTest-707106630 tempest-MigrationsAdminTest-707106630-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b" status: 200 len: 1613 microversion: 2.1 time: 0.243657 Oct 27 03:25:15.180379 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 679/1396] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:14 2022] GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b => generated 1613 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:15.211061 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1fe80369-ae7a-4f98-913b-3acd63c7a226 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:15.211516 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c7a7d696-e500-4d28-a933-a22ac9f39666 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:15.211516 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c7a7d696-e500-4d28-a933-a22ac9f39666 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:15.216678 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1fe80369-ae7a-4f98-913b-3acd63c7a226 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/33d5c62a-898f-441b-a1a1-3cb12836755d" status: 200 len: 1497 microversion: 2.1 time: 1.175043 Oct 27 03:25:15.217731 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 718/1397] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:14 2022] GET /compute/v2.1/servers/33d5c62a-898f-441b-a1a1-3cb12836755d => generated 1497 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:15.218416 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c7a7d696-e500-4d28-a933-a22ac9f39666 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:15.219245 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c7a7d696-e500-4d28-a933-a22ac9f39666 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:15.224340 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c7a7d696-e500-4d28-a933-a22ac9f39666 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:15.224340 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c7a7d696-e500-4d28-a933-a22ac9f39666 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:15.226989 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c7a7d696-e500-4d28-a933-a22ac9f39666 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:15.227912 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c7a7d696-e500-4d28-a933-a22ac9f39666 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:15.229317 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-67271234-65f6-4ccd-81c2-2320f05ce3e9 tempest-ServersWithSpecificFlavorTestJSON-879588589 tempest-ServersWithSpecificFlavorTestJSON-879588589-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:15.378538 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-67271234-65f6-4ccd-81c2-2320f05ce3e9 tempest-ServersWithSpecificFlavorTestJSON-879588589 tempest-ServersWithSpecificFlavorTestJSON-879588589-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/651676802" status: 202 len: 0 microversion: 2.1 time: 0.159548 Oct 27 03:25:15.379635 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 719/1398] 10.222.0.20 () {58 vars in 1158 bytes} [Thu Oct 27 03:25:15 2022] DELETE /compute/v2.1/flavors/651676802 => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:25:15.384413 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-947938a0-2b25-4d6c-a802-00160ea3d4d3 tempest-MigrationsAdminTest-707106630 tempest-MigrationsAdminTest-707106630-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:25:15.385001 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-947938a0-2b25-4d6c-a802-00160ea3d4d3 tempest-MigrationsAdminTest-707106630 tempest-MigrationsAdminTest-707106630-project-admin] [instance: e8781053-3dad-4951-b4cb-1f4aaf97e19b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:15.401391 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-947938a0-2b25-4d6c-a802-00160ea3d4d3 tempest-MigrationsAdminTest-707106630 tempest-MigrationsAdminTest-707106630-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:15.401901 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-947938a0-2b25-4d6c-a802-00160ea3d4d3 tempest-MigrationsAdminTest-707106630 tempest-MigrationsAdminTest-707106630-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:15.402384 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-947938a0-2b25-4d6c-a802-00160ea3d4d3 tempest-MigrationsAdminTest-707106630 tempest-MigrationsAdminTest-707106630-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:15.403105 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-947938a0-2b25-4d6c-a802-00160ea3d4d3 tempest-MigrationsAdminTest-707106630 tempest-MigrationsAdminTest-707106630-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:15.403567 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-947938a0-2b25-4d6c-a802-00160ea3d4d3 tempest-MigrationsAdminTest-707106630 tempest-MigrationsAdminTest-707106630-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:15.404007 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-947938a0-2b25-4d6c-a802-00160ea3d4d3 tempest-MigrationsAdminTest-707106630 tempest-MigrationsAdminTest-707106630-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:15.568573 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-947938a0-2b25-4d6c-a802-00160ea3d4d3 tempest-MigrationsAdminTest-707106630 tempest-MigrationsAdminTest-707106630-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '4e8002bf6ca34327b2d4faa37f93c6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333b6e5cda4e482ab1ce3f241ec6cfe9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:15.573291 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-947938a0-2b25-4d6c-a802-00160ea3d4d3 tempest-MigrationsAdminTest-707106630 tempest-MigrationsAdminTest-707106630-project-admin] [instance: e8781053-3dad-4951-b4cb-1f4aaf97e19b] flavor_id is None. Assuming migration. {{(pid=121000) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 27 03:25:15.574135 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-947938a0-2b25-4d6c-a802-00160ea3d4d3 tempest-MigrationsAdminTest-707106630 tempest-MigrationsAdminTest-707106630-project-admin] [instance: e8781053-3dad-4951-b4cb-1f4aaf97e19b] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=121000) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 27 03:25:15.586576 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c7a7d696-e500-4d28-a933-a22ac9f39666 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:15.630354 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c7a7d696-e500-4d28-a933-a22ac9f39666 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:15.642391 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c7a7d696-e500-4d28-a933-a22ac9f39666 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:15.650929 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c7a7d696-e500-4d28-a933-a22ac9f39666 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f" status: 200 len: 1410 microversion: 2.25 time: 0.461181 Oct 27 03:25:15.653114 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 680/1399] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:25:15 2022] GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f => generated 1410 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:25:15.675997 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c085c81e-f4f3-46c6-b03c-d7af242a9872 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:15.677327 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c085c81e-f4f3-46c6-b03c-d7af242a9872 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: 6f360a9c-90c7-4efd-90c2-c0d3bd15c154] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:15.686321 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c085c81e-f4f3-46c6-b03c-d7af242a9872 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:15.687348 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c085c81e-f4f3-46c6-b03c-d7af242a9872 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:15.688398 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c085c81e-f4f3-46c6-b03c-d7af242a9872 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:15.689288 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c085c81e-f4f3-46c6-b03c-d7af242a9872 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:15.689942 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c085c81e-f4f3-46c6-b03c-d7af242a9872 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:15.690548 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c085c81e-f4f3-46c6-b03c-d7af242a9872 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:15.913713 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c085c81e-f4f3-46c6-b03c-d7af242a9872 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:15.925936 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c085c81e-f4f3-46c6-b03c-d7af242a9872 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/6f360a9c-90c7-4efd-90c2-c0d3bd15c154" status: 200 len: 1475 microversion: 2.1 time: 0.268999 Oct 27 03:25:15.925936 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 681/1400] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:15 2022] GET /compute/v2.1/servers/6f360a9c-90c7-4efd-90c2-c0d3bd15c154 => generated 1475 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:15.929608 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0e6c94b9-864a-491a-8366-77affeef5cb4 tempest-ServersWithSpecificFlavorTestJSON-879588589 tempest-ServersWithSpecificFlavorTestJSON-879588589-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:15.966595 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0e6c94b9-864a-491a-8366-77affeef5cb4 tempest-ServersWithSpecificFlavorTestJSON-879588589 tempest-ServersWithSpecificFlavorTestJSON-879588589-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5403 microversion: 2.1 time: 0.040874 Oct 27 03:25:15.978574 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 682/1401] 10.222.0.20 () {58 vars in 1146 bytes} [Thu Oct 27 03:25:15 2022] GET /compute/v2.1/flavors/detail => generated 5403 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:15.988875 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-6d4ff7fb-c94d-411d-b5bf-8263ad3e8942 req-78a52882-789a-497b-b117-bb54af3dec3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f", "name": "network-vif-plugged", "status": "completed", "tag": "43cfec0a-97df-4480-8645-66f623cb4eaa"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:25:15.999039 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-6d4ff7fb-c94d-411d-b5bf-8263ad3e8942 req-78a52882-789a-497b-b117-bb54af3dec3e service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:15.999525 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-6d4ff7fb-c94d-411d-b5bf-8263ad3e8942 req-78a52882-789a-497b-b117-bb54af3dec3e service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:16.000289 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-6d4ff7fb-c94d-411d-b5bf-8263ad3e8942 req-78a52882-789a-497b-b117-bb54af3dec3e service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:16.012086 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-6d4ff7fb-c94d-411d-b5bf-8263ad3e8942 req-78a52882-789a-497b-b117-bb54af3dec3e service nova] Creating event network-vif-plugged:43cfec0a-97df-4480-8645-66f623cb4eaa for instance 09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f on n-h1-862769-1 Oct 27 03:25:16.018283 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-6d4ff7fb-c94d-411d-b5bf-8263ad3e8942 req-78a52882-789a-497b-b117-bb54af3dec3e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037421 Oct 27 03:25:16.019150 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 683/1402] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:25:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:25:16.026679 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-203086aa-958c-49a8-841d-3d02ee13e4e7 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:16.027397 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-203086aa-958c-49a8-841d-3d02ee13e4e7 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] [instance: 2d8a44aa-62e4-4385-b295-924517b6f850] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:16.036350 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-203086aa-958c-49a8-841d-3d02ee13e4e7 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:16.037178 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-203086aa-958c-49a8-841d-3d02ee13e4e7 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:16.037827 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-203086aa-958c-49a8-841d-3d02ee13e4e7 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:16.038770 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-203086aa-958c-49a8-841d-3d02ee13e4e7 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:16.039392 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-203086aa-958c-49a8-841d-3d02ee13e4e7 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:16.040207 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-203086aa-958c-49a8-841d-3d02ee13e4e7 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:16.056869 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-947938a0-2b25-4d6c-a802-00160ea3d4d3 tempest-MigrationsAdminTest-707106630 tempest-MigrationsAdminTest-707106630-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b/action" status: 202 len: 0 microversion: 2.1 time: 0.676089 Oct 27 03:25:16.057906 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 720/1403] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:25:15 2022] POST /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b/action => generated 0 bytes in 678 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:25:16.067269 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7991373f-574a-444e-89fa-cbc8c4cb7c1c tempest-ServersWithSpecificFlavorTestJSON-879588589 tempest-ServersWithSpecificFlavorTestJSON-879588589-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:16.394981 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-203086aa-958c-49a8-841d-3d02ee13e4e7 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ccd5909fb214f71ad68704019c9e4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d2c150feac4d03966a860ab8bafe00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:16.394981 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-203086aa-958c-49a8-841d-3d02ee13e4e7 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] 10.222.0.20 "GET /compute/v2.1/servers/2d8a44aa-62e4-4385-b295-924517b6f850" status: 200 len: 1322 microversion: 2.1 time: 0.241289 Oct 27 03:25:16.394981 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 684/1404] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:16 2022] GET /compute/v2.1/servers/2d8a44aa-62e4-4385-b295-924517b6f850 => generated 1322 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:16.394981 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a07fb17c-cea9-49b1-b944-fd55520b2e5b tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:16.396290 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a07fb17c-cea9-49b1-b944-fd55520b2e5b tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: e8781053-3dad-4951-b4cb-1f4aaf97e19b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:16.396290 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a07fb17c-cea9-49b1-b944-fd55520b2e5b tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:16.396290 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a07fb17c-cea9-49b1-b944-fd55520b2e5b tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:16.396290 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a07fb17c-cea9-49b1-b944-fd55520b2e5b tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:16.397078 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a07fb17c-cea9-49b1-b944-fd55520b2e5b tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:16.397078 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a07fb17c-cea9-49b1-b944-fd55520b2e5b tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:16.397078 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a07fb17c-cea9-49b1-b944-fd55520b2e5b tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:16.421318 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7991373f-574a-444e-89fa-cbc8c4cb7c1c tempest-ServersWithSpecificFlavorTestJSON-879588589 tempest-ServersWithSpecificFlavorTestJSON-879588589-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/719476185" status: 202 len: 0 microversion: 2.1 time: 0.359238 Oct 27 03:25:16.421318 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 721/1405] 10.222.0.20 () {58 vars in 1158 bytes} [Thu Oct 27 03:25:16 2022] DELETE /compute/v2.1/flavors/719476185 => generated 0 bytes in 361 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:25:16.427881 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7fd41b60-96c0-4e9e-a423-afbfaf0894f7 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:16.429333 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7fd41b60-96c0-4e9e-a423-afbfaf0894f7 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 33d5c62a-898f-441b-a1a1-3cb12836755d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:16.456127 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7fd41b60-96c0-4e9e-a423-afbfaf0894f7 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:16.456513 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7fd41b60-96c0-4e9e-a423-afbfaf0894f7 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:16.456966 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7fd41b60-96c0-4e9e-a423-afbfaf0894f7 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:16.457704 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7fd41b60-96c0-4e9e-a423-afbfaf0894f7 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:16.458207 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7fd41b60-96c0-4e9e-a423-afbfaf0894f7 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:16.458644 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7fd41b60-96c0-4e9e-a423-afbfaf0894f7 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:16.474363 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a07fb17c-cea9-49b1-b944-fd55520b2e5b tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:16.483616 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a07fb17c-cea9-49b1-b944-fd55520b2e5b tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b" status: 200 len: 1471 microversion: 2.1 time: 0.219257 Oct 27 03:25:16.500829 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 685/1406] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:16 2022] GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b => generated 1471 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:16.508861 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b6ad50dc-f91e-4796-ad93-77d2a4ec4f2f tempest-ServersWithSpecificFlavorTestJSON-879588589 tempest-ServersWithSpecificFlavorTestJSON-879588589-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:16.538641 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b6ad50dc-f91e-4796-ad93-77d2a4ec4f2f tempest-ServersWithSpecificFlavorTestJSON-879588589 tempest-ServersWithSpecificFlavorTestJSON-879588589-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.036043 Oct 27 03:25:16.539982 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 686/1407] 10.222.0.20 () {58 vars in 1146 bytes} [Thu Oct 27 03:25:16 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:16.570328 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-da9f433a-13a3-43f1-acdd-a4cbc1caabd1 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:16.571261 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-da9f433a-13a3-43f1-acdd-a4cbc1caabd1 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] [instance: acb62f35-0751-41fe-ba8d-78b2357380e9] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:16.584043 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-da9f433a-13a3-43f1-acdd-a4cbc1caabd1 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:16.585000 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-da9f433a-13a3-43f1-acdd-a4cbc1caabd1 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:16.585771 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-da9f433a-13a3-43f1-acdd-a4cbc1caabd1 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:16.586836 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-da9f433a-13a3-43f1-acdd-a4cbc1caabd1 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:16.587562 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-da9f433a-13a3-43f1-acdd-a4cbc1caabd1 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:16.588195 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-da9f433a-13a3-43f1-acdd-a4cbc1caabd1 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:16.605207 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-da9f433a-13a3-43f1-acdd-a4cbc1caabd1 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] HTTP exception thrown: Instance acb62f35-0751-41fe-ba8d-78b2357380e9 could not be found. Oct 27 03:25:16.610654 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-da9f433a-13a3-43f1-acdd-a4cbc1caabd1 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Request method failure captured: Oct 27 03:25:16.610654 n-d-862769-1 devstack@n-api.service[121001]: request: DELETE /compute/v2.1/servers/acb62f35-0751-41fe-ba8d-78b2357380e9 HTTP/1.1 Oct 27 03:25:16.610654 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:25:16.610654 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:25:16.610654 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:25:16.610654 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:25:16.610654 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:25:16.610654 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:25:16.610654 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:25:16.610654 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:25:16.610654 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWflVgkubTMkxsjZs-C9cKVG4uOTUcUki_H0M25KVUX1izwlO3Epjw6hffDxpWwwDluPhuc1dFqy3H7AFfH18_sKiEtj3yigRz4JHysUFah5ZtcrSX59YOeWG6lhiaQHiPwRG_BN4o9uCCOMjfRcm1mbuRg2L8nfQMkzpaza-ba0UmyY Oct 27 03:25:16.610654 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:25:16.610654 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:25:16.610654 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:25:16.610654 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:25:16.610654 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:25:16.610654 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:25:16.610654 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 39f033d34ad44397bfda5cba4c041071 Oct 27 03:25:16.610654 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1092761873 Oct 27 03:25:16.610654 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:25:16.610654 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:25:16.613066 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/39f033d34ad44397bfda5cba4c041071"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/39f033d34ad44397bfda5cba4c041071"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/39f033d34ad44397bfda5cba4c041071"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_39f033d34ad44397bfda5cba4c041071"}]}] Oct 27 03:25:16.613066 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1092761873 Oct 27 03:25:16.613066 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 39f033d34ad44397bfda5cba4c041071 Oct 27 03:25:16.613066 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1092761873 Oct 27 03:25:16.613066 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1092761873-project Oct 27 03:25:16.613066 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:25:16.613066 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:25:16.613066 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 2e23378ed283426cbff623265d9bbc96 Oct 27 03:25:16.613066 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1092761873-project Oct 27 03:25:16.613066 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:25:16.613066 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance acb62f35-0751-41fe-ba8d-78b2357380e9 could not be found. Oct 27 03:25:16.613066 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': 'acb62f35-0751-41fe-ba8d-78b2357380e9'} Oct 27 03:25:16.613818 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:25:16.613818 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:25:16.613818 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:25:16.613818 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:25:16.613818 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:25:16.613818 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:25:16.613818 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:25:16.613818 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:25:16.613818 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:25:16.613818 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:25:16.613818 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acb62f35-0751-41fe-ba8d-78b2357380e9 could not be found. Oct 27 03:25:16.613818 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:25:16.613818 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:25:16.613818 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:25:16.613818 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:25:16.613818 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:25:16.613818 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:25:16.613818 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:25:16.613818 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:25:16.613818 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:25:16.615074 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:25:16.615074 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 03:25:16.615074 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 03:25:16.615074 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 03:25:16.615074 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 03:25:16.615074 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:25:16.615074 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:25:16.615074 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:25:16.615074 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:25:16.615074 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acb62f35-0751-41fe-ba8d-78b2357380e9 could not be found. Oct 27 03:25:16.615074 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:25:16.615074 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:25:16.615074 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:25:16.615074 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:25:16.615074 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:25:16.615074 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:25:16.615074 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:25:16.615074 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:25:16.615074 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acb62f35-0751-41fe-ba8d-78b2357380e9 could not be found. Oct 27 03:25:16.615074 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:25:16.616724 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-da9f433a-13a3-43f1-acdd-a4cbc1caabd1 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Returning 404 to user: Instance acb62f35-0751-41fe-ba8d-78b2357380e9 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:25:16.616724 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-da9f433a-13a3-43f1-acdd-a4cbc1caabd1 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] 10.222.0.20 "DELETE /compute/v2.1/servers/acb62f35-0751-41fe-ba8d-78b2357380e9" status: 404 len: 111 microversion: 2.1 time: 0.044335 Oct 27 03:25:16.616724 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 687/1408] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:25:16 2022] DELETE /compute/v2.1/servers/acb62f35-0751-41fe-ba8d-78b2357380e9 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:25:16.623922 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b469b19b-76fc-4500-97a7-7e21a000a4c2 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:16.624812 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b469b19b-76fc-4500-97a7-7e21a000a4c2 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] [instance: acb62f35-0751-41fe-ba8d-78b2357380e9] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:16.638681 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b469b19b-76fc-4500-97a7-7e21a000a4c2 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:16.639330 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b469b19b-76fc-4500-97a7-7e21a000a4c2 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:16.639808 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b469b19b-76fc-4500-97a7-7e21a000a4c2 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:16.640540 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b469b19b-76fc-4500-97a7-7e21a000a4c2 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:16.641001 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b469b19b-76fc-4500-97a7-7e21a000a4c2 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:16.641432 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b469b19b-76fc-4500-97a7-7e21a000a4c2 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:16.661296 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-b469b19b-76fc-4500-97a7-7e21a000a4c2 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] HTTP exception thrown: Instance acb62f35-0751-41fe-ba8d-78b2357380e9 could not be found. Oct 27 03:25:16.668415 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b469b19b-76fc-4500-97a7-7e21a000a4c2 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Request method failure captured: Oct 27 03:25:16.668415 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/acb62f35-0751-41fe-ba8d-78b2357380e9 HTTP/1.1 Oct 27 03:25:16.668415 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:25:16.668415 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:25:16.668415 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:25:16.668415 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:25:16.668415 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:25:16.668415 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:25:16.668415 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:25:16.668415 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:25:16.668415 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWflVgkubTMkxsjZs-C9cKVG4uOTUcUki_H0M25KVUX1izwlO3Epjw6hffDxpWwwDluPhuc1dFqy3H7AFfH18_sKiEtj3yigRz4JHysUFah5ZtcrSX59YOeWG6lhiaQHiPwRG_BN4o9uCCOMjfRcm1mbuRg2L8nfQMkzpaza-ba0UmyY Oct 27 03:25:16.668415 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:25:16.668415 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:25:16.668415 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:25:16.668415 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:25:16.668415 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:25:16.668415 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:25:16.668415 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 39f033d34ad44397bfda5cba4c041071 Oct 27 03:25:16.668415 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1092761873 Oct 27 03:25:16.668415 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:25:16.668415 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:25:16.671534 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/39f033d34ad44397bfda5cba4c041071"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/39f033d34ad44397bfda5cba4c041071"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/39f033d34ad44397bfda5cba4c041071"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_39f033d34ad44397bfda5cba4c041071"}]}] Oct 27 03:25:16.671534 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1092761873 Oct 27 03:25:16.671534 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 39f033d34ad44397bfda5cba4c041071 Oct 27 03:25:16.671534 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1092761873 Oct 27 03:25:16.671534 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1092761873-project Oct 27 03:25:16.671534 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:25:16.671534 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:25:16.671534 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 2e23378ed283426cbff623265d9bbc96 Oct 27 03:25:16.671534 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1092761873-project Oct 27 03:25:16.671534 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:25:16.671534 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance acb62f35-0751-41fe-ba8d-78b2357380e9 could not be found. Oct 27 03:25:16.671534 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': 'acb62f35-0751-41fe-ba8d-78b2357380e9'} Oct 27 03:25:16.672277 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:25:16.672277 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:25:16.672277 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:25:16.672277 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:25:16.672277 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:25:16.672277 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:25:16.672277 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:25:16.672277 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:25:16.672277 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:25:16.672277 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:25:16.672277 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acb62f35-0751-41fe-ba8d-78b2357380e9 could not be found. Oct 27 03:25:16.672277 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:25:16.672277 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:25:16.672277 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:25:16.672277 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:25:16.672277 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:25:16.672277 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:25:16.672277 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:25:16.672277 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:25:16.672277 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:25:16.673496 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:25:16.673496 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:25:16.673496 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:25:16.673496 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:25:16.673496 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:25:16.673496 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:25:16.673496 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:25:16.673496 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acb62f35-0751-41fe-ba8d-78b2357380e9 could not be found. Oct 27 03:25:16.673496 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:25:16.673496 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:25:16.673496 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:25:16.673496 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:25:16.673496 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:25:16.673496 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:25:16.673496 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:25:16.673496 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:25:16.673496 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acb62f35-0751-41fe-ba8d-78b2357380e9 could not be found. Oct 27 03:25:16.673496 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:25:16.676648 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b469b19b-76fc-4500-97a7-7e21a000a4c2 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Returning 404 to user: Instance acb62f35-0751-41fe-ba8d-78b2357380e9 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:25:16.676648 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b469b19b-76fc-4500-97a7-7e21a000a4c2 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] 10.222.0.20 "GET /compute/v2.1/servers/acb62f35-0751-41fe-ba8d-78b2357380e9" status: 404 len: 111 microversion: 2.1 time: 0.049129 Oct 27 03:25:16.676648 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 688/1409] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:16 2022] GET /compute/v2.1/servers/acb62f35-0751-41fe-ba8d-78b2357380e9 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:25:16.676648 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2f5e0cc8-880d-41fd-b510-4e0edd5228d2 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:16.676648 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2f5e0cc8-880d-41fd-b510-4e0edd5228d2 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] [instance: 2d4fe59a-b31c-4fc0-8994-eb21e313d18a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:16.683238 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:25:16.685337 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2f5e0cc8-880d-41fd-b510-4e0edd5228d2 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:16.685974 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2f5e0cc8-880d-41fd-b510-4e0edd5228d2 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:16.686448 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2f5e0cc8-880d-41fd-b510-4e0edd5228d2 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:16.687168 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2f5e0cc8-880d-41fd-b510-4e0edd5228d2 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:16.687624 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2f5e0cc8-880d-41fd-b510-4e0edd5228d2 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:16.688054 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2f5e0cc8-880d-41fd-b510-4e0edd5228d2 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:16.717414 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-2f5e0cc8-880d-41fd-b510-4e0edd5228d2 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] HTTP exception thrown: Instance 2d4fe59a-b31c-4fc0-8994-eb21e313d18a could not be found. Oct 27 03:25:16.720211 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2f5e0cc8-880d-41fd-b510-4e0edd5228d2 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Request method failure captured: Oct 27 03:25:16.720211 n-d-862769-1 devstack@n-api.service[121001]: request: DELETE /compute/v2.1/servers/2d4fe59a-b31c-4fc0-8994-eb21e313d18a HTTP/1.1 Oct 27 03:25:16.720211 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:25:16.720211 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:25:16.720211 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:25:16.720211 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:25:16.720211 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:25:16.720211 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:25:16.720211 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:25:16.720211 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:25:16.720211 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWflVgkubTMkxsjZs-C9cKVG4uOTUcUki_H0M25KVUX1izwlO3Epjw6hffDxpWwwDluPhuc1dFqy3H7AFfH18_sKiEtj3yigRz4JHysUFah5ZtcrSX59YOeWG6lhiaQHiPwRG_BN4o9uCCOMjfRcm1mbuRg2L8nfQMkzpaza-ba0UmyY Oct 27 03:25:16.720211 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:25:16.720211 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:25:16.720211 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:25:16.720211 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:25:16.720211 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:25:16.720211 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:25:16.720211 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 39f033d34ad44397bfda5cba4c041071 Oct 27 03:25:16.720211 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1092761873 Oct 27 03:25:16.720211 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:25:16.720211 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:25:16.724550 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/39f033d34ad44397bfda5cba4c041071"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/39f033d34ad44397bfda5cba4c041071"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/39f033d34ad44397bfda5cba4c041071"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_39f033d34ad44397bfda5cba4c041071"}]}] Oct 27 03:25:16.724550 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1092761873 Oct 27 03:25:16.724550 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 39f033d34ad44397bfda5cba4c041071 Oct 27 03:25:16.724550 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1092761873 Oct 27 03:25:16.724550 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1092761873-project Oct 27 03:25:16.724550 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:25:16.724550 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:25:16.724550 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 2e23378ed283426cbff623265d9bbc96 Oct 27 03:25:16.724550 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1092761873-project Oct 27 03:25:16.724550 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:25:16.724550 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 2d4fe59a-b31c-4fc0-8994-eb21e313d18a could not be found. Oct 27 03:25:16.724550 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '2d4fe59a-b31c-4fc0-8994-eb21e313d18a'} Oct 27 03:25:16.725340 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:25:16.725340 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:25:16.725340 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:25:16.725340 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:25:16.725340 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:25:16.725340 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:25:16.725340 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:25:16.725340 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:25:16.725340 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:25:16.725340 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:25:16.725340 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d4fe59a-b31c-4fc0-8994-eb21e313d18a could not be found. Oct 27 03:25:16.725340 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:25:16.725340 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:25:16.725340 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:25:16.725340 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:25:16.725340 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:25:16.725340 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:25:16.725340 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:25:16.725340 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:25:16.725340 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:25:16.727128 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:25:16.727128 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 03:25:16.727128 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 03:25:16.727128 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 03:25:16.727128 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 03:25:16.727128 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:25:16.727128 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:25:16.727128 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:25:16.727128 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:25:16.727128 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d4fe59a-b31c-4fc0-8994-eb21e313d18a could not be found. Oct 27 03:25:16.727128 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:25:16.727128 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:25:16.727128 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:25:16.727128 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:25:16.727128 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:25:16.727128 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:25:16.727128 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:25:16.727128 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:25:16.727128 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d4fe59a-b31c-4fc0-8994-eb21e313d18a could not be found. Oct 27 03:25:16.727128 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:25:16.728976 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2f5e0cc8-880d-41fd-b510-4e0edd5228d2 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Returning 404 to user: Instance 2d4fe59a-b31c-4fc0-8994-eb21e313d18a could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:25:16.728976 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2f5e0cc8-880d-41fd-b510-4e0edd5228d2 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2d4fe59a-b31c-4fc0-8994-eb21e313d18a" status: 404 len: 111 microversion: 2.1 time: 0.052109 Oct 27 03:25:16.729720 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 689/1410] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:25:16 2022] DELETE /compute/v2.1/servers/2d4fe59a-b31c-4fc0-8994-eb21e313d18a => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 03:25:16.744009 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ce608899-205b-4d62-a18f-d607cdfd606d tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:16.744899 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ce608899-205b-4d62-a18f-d607cdfd606d tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:16.762292 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ce608899-205b-4d62-a18f-d607cdfd606d tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:16.763413 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ce608899-205b-4d62-a18f-d607cdfd606d tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:16.764347 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ce608899-205b-4d62-a18f-d607cdfd606d tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:16.765728 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ce608899-205b-4d62-a18f-d607cdfd606d tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:16.766594 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ce608899-205b-4d62-a18f-d607cdfd606d tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:16.767248 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ce608899-205b-4d62-a18f-d607cdfd606d tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:16.929968 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7fd41b60-96c0-4e9e-a423-afbfaf0894f7 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:16.955485 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7fd41b60-96c0-4e9e-a423-afbfaf0894f7 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/33d5c62a-898f-441b-a1a1-3cb12836755d" status: 200 len: 1497 microversion: 2.1 time: 0.534396 Oct 27 03:25:16.956149 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 722/1411] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:16 2022] GET /compute/v2.1/servers/33d5c62a-898f-441b-a1a1-3cb12836755d => generated 1497 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:16.987823 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ca4540f4-de03-4a5a-9f85-0ad2a0e72a26 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:16.987823 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ca4540f4-de03-4a5a-9f85-0ad2a0e72a26 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] [instance: 2d4fe59a-b31c-4fc0-8994-eb21e313d18a] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:17.003970 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ca4540f4-de03-4a5a-9f85-0ad2a0e72a26 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:17.006273 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ca4540f4-de03-4a5a-9f85-0ad2a0e72a26 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:17.010282 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ca4540f4-de03-4a5a-9f85-0ad2a0e72a26 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:17.010282 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ca4540f4-de03-4a5a-9f85-0ad2a0e72a26 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:17.010807 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ca4540f4-de03-4a5a-9f85-0ad2a0e72a26 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:17.011417 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ca4540f4-de03-4a5a-9f85-0ad2a0e72a26 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:17.057541 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-ca4540f4-de03-4a5a-9f85-0ad2a0e72a26 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] HTTP exception thrown: Instance 2d4fe59a-b31c-4fc0-8994-eb21e313d18a could not be found. Oct 27 03:25:17.063880 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ca4540f4-de03-4a5a-9f85-0ad2a0e72a26 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Request method failure captured: Oct 27 03:25:17.063880 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/2d4fe59a-b31c-4fc0-8994-eb21e313d18a HTTP/1.1 Oct 27 03:25:17.063880 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:25:17.063880 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:25:17.063880 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:25:17.063880 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:25:17.063880 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:25:17.063880 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:25:17.063880 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:25:17.063880 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:25:17.063880 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWflVgkubTMkxsjZs-C9cKVG4uOTUcUki_H0M25KVUX1izwlO3Epjw6hffDxpWwwDluPhuc1dFqy3H7AFfH18_sKiEtj3yigRz4JHysUFah5ZtcrSX59YOeWG6lhiaQHiPwRG_BN4o9uCCOMjfRcm1mbuRg2L8nfQMkzpaza-ba0UmyY Oct 27 03:25:17.063880 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:25:17.063880 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:25:17.063880 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:25:17.063880 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:25:17.063880 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:25:17.063880 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:25:17.063880 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 39f033d34ad44397bfda5cba4c041071 Oct 27 03:25:17.063880 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1092761873 Oct 27 03:25:17.063880 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:25:17.063880 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:25:17.065617 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/39f033d34ad44397bfda5cba4c041071"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/39f033d34ad44397bfda5cba4c041071"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/39f033d34ad44397bfda5cba4c041071"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_39f033d34ad44397bfda5cba4c041071"}]}] Oct 27 03:25:17.065617 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1092761873 Oct 27 03:25:17.065617 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 39f033d34ad44397bfda5cba4c041071 Oct 27 03:25:17.065617 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1092761873 Oct 27 03:25:17.065617 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1092761873-project Oct 27 03:25:17.065617 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:25:17.065617 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:25:17.065617 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 2e23378ed283426cbff623265d9bbc96 Oct 27 03:25:17.065617 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1092761873-project Oct 27 03:25:17.065617 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:25:17.065617 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 2d4fe59a-b31c-4fc0-8994-eb21e313d18a could not be found. Oct 27 03:25:17.065617 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '2d4fe59a-b31c-4fc0-8994-eb21e313d18a'} Oct 27 03:25:17.066592 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:25:17.066592 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:25:17.066592 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:25:17.066592 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:25:17.066592 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:25:17.066592 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:25:17.066592 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:25:17.066592 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:25:17.066592 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:25:17.066592 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:25:17.066592 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d4fe59a-b31c-4fc0-8994-eb21e313d18a could not be found. Oct 27 03:25:17.066592 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:25:17.066592 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:25:17.066592 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:25:17.066592 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:25:17.066592 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:25:17.066592 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:25:17.066592 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:25:17.066592 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:25:17.066592 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:25:17.068848 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:25:17.068848 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:25:17.068848 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:25:17.068848 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:25:17.068848 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:25:17.068848 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:25:17.068848 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:25:17.068848 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d4fe59a-b31c-4fc0-8994-eb21e313d18a could not be found. Oct 27 03:25:17.068848 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:25:17.068848 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:25:17.068848 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:25:17.068848 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:25:17.068848 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:25:17.068848 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:25:17.068848 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:25:17.068848 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:25:17.068848 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d4fe59a-b31c-4fc0-8994-eb21e313d18a could not be found. Oct 27 03:25:17.068848 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:25:17.076468 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ca4540f4-de03-4a5a-9f85-0ad2a0e72a26 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] Returning 404 to user: Instance 2d4fe59a-b31c-4fc0-8994-eb21e313d18a could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:25:17.080614 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ca4540f4-de03-4a5a-9f85-0ad2a0e72a26 tempest-ServersWithSpecificFlavorTestJSON-1092761873 tempest-ServersWithSpecificFlavorTestJSON-1092761873-project] 10.222.0.20 "GET /compute/v2.1/servers/2d4fe59a-b31c-4fc0-8994-eb21e313d18a" status: 404 len: 111 microversion: 2.1 time: 0.103722 Oct 27 03:25:17.082362 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 723/1412] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:16 2022] GET /compute/v2.1/servers/2d4fe59a-b31c-4fc0-8994-eb21e313d18a => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:25:17.092595 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f845b24b-545e-4c36-906e-f1297ecb083c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:17.093228 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f845b24b-545e-4c36-906e-f1297ecb083c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: 6f360a9c-90c7-4efd-90c2-c0d3bd15c154] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:17.123449 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f845b24b-545e-4c36-906e-f1297ecb083c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:17.126712 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f845b24b-545e-4c36-906e-f1297ecb083c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:17.128662 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f845b24b-545e-4c36-906e-f1297ecb083c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:17.129105 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ce608899-205b-4d62-a18f-d607cdfd606d tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:17.143535 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f845b24b-545e-4c36-906e-f1297ecb083c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:17.144628 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f845b24b-545e-4c36-906e-f1297ecb083c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:17.145136 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f845b24b-545e-4c36-906e-f1297ecb083c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:17.149951 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ce608899-205b-4d62-a18f-d607cdfd606d tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:17.152826 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ce608899-205b-4d62-a18f-d607cdfd606d tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:17.159750 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ce608899-205b-4d62-a18f-d607cdfd606d tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f" status: 200 len: 1410 microversion: 2.25 time: 0.425994 Oct 27 03:25:17.175826 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 690/1413] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:25:16 2022] GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f => generated 1410 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:25:17.194865 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-78942359-21bc-4fed-8c81-8193bb5a226d req-f3816e13-e666-40ff-bc4b-4c4ac3bdad09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f360a9c-90c7-4efd-90c2-c0d3bd15c154", "name": "network-vif-deleted", "tag": "d05292be-7d41-4722-906b-1b0c37b313fc"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:25:17.227806 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-78942359-21bc-4fed-8c81-8193bb5a226d req-f3816e13-e666-40ff-bc4b-4c4ac3bdad09 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:17.233552 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-78942359-21bc-4fed-8c81-8193bb5a226d req-f3816e13-e666-40ff-bc4b-4c4ac3bdad09 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:17.234460 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-78942359-21bc-4fed-8c81-8193bb5a226d req-f3816e13-e666-40ff-bc4b-4c4ac3bdad09 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:17.264247 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-78942359-21bc-4fed-8c81-8193bb5a226d req-f3816e13-e666-40ff-bc4b-4c4ac3bdad09 service nova] Creating event network-vif-deleted:d05292be-7d41-4722-906b-1b0c37b313fc for instance 6f360a9c-90c7-4efd-90c2-c0d3bd15c154 on n-h2-862769-1 Oct 27 03:25:17.278904 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-78942359-21bc-4fed-8c81-8193bb5a226d req-f3816e13-e666-40ff-bc4b-4c4ac3bdad09 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099241 Oct 27 03:25:17.279174 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 691/1414] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:25:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:25:17.290945 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b4aa931b-e881-496f-b251-e47c9cf4f490 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:17.295852 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b4aa931b-e881-496f-b251-e47c9cf4f490 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] [instance: 2d8a44aa-62e4-4385-b295-924517b6f850] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:17.310439 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b4aa931b-e881-496f-b251-e47c9cf4f490 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:17.311523 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b4aa931b-e881-496f-b251-e47c9cf4f490 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:17.311811 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b4aa931b-e881-496f-b251-e47c9cf4f490 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:17.314824 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b4aa931b-e881-496f-b251-e47c9cf4f490 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:17.315449 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b4aa931b-e881-496f-b251-e47c9cf4f490 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:17.316135 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b4aa931b-e881-496f-b251-e47c9cf4f490 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:17.482864 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f845b24b-545e-4c36-906e-f1297ecb083c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:17.498119 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f845b24b-545e-4c36-906e-f1297ecb083c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/6f360a9c-90c7-4efd-90c2-c0d3bd15c154" status: 200 len: 1433 microversion: 2.1 time: 0.413694 Oct 27 03:25:17.499237 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 724/1415] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:17 2022] GET /compute/v2.1/servers/6f360a9c-90c7-4efd-90c2-c0d3bd15c154 => generated 1433 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:17.517308 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-dabbbf27-4d36-4d42-a3e7-159054e47262 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:17.518768 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-dabbbf27-4d36-4d42-a3e7-159054e47262 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: e8781053-3dad-4951-b4cb-1f4aaf97e19b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:17.535326 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dabbbf27-4d36-4d42-a3e7-159054e47262 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:17.535837 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dabbbf27-4d36-4d42-a3e7-159054e47262 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:17.536369 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dabbbf27-4d36-4d42-a3e7-159054e47262 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:17.537950 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dabbbf27-4d36-4d42-a3e7-159054e47262 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:17.538629 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dabbbf27-4d36-4d42-a3e7-159054e47262 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:17.539157 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dabbbf27-4d36-4d42-a3e7-159054e47262 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:18.033682 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b4aa931b-e881-496f-b251-e47c9cf4f490 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ccd5909fb214f71ad68704019c9e4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d2c150feac4d03966a860ab8bafe00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:18.044101 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b4aa931b-e881-496f-b251-e47c9cf4f490 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] 10.222.0.20 "GET /compute/v2.1/servers/2d8a44aa-62e4-4385-b295-924517b6f850" status: 200 len: 1322 microversion: 2.1 time: 0.757288 Oct 27 03:25:18.048199 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 692/1416] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:17 2022] GET /compute/v2.1/servers/2d8a44aa-62e4-4385-b295-924517b6f850 => generated 1322 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:18.057977 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a60f63ba-c23a-4a27-bd67-8e5d26708150 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:18.061198 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a60f63ba-c23a-4a27-bd67-8e5d26708150 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 33d5c62a-898f-441b-a1a1-3cb12836755d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:18.080118 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a60f63ba-c23a-4a27-bd67-8e5d26708150 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:18.084238 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a60f63ba-c23a-4a27-bd67-8e5d26708150 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:18.084238 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a60f63ba-c23a-4a27-bd67-8e5d26708150 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:18.084238 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a60f63ba-c23a-4a27-bd67-8e5d26708150 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:18.084238 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a60f63ba-c23a-4a27-bd67-8e5d26708150 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:18.084601 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a60f63ba-c23a-4a27-bd67-8e5d26708150 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:18.403978 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a60f63ba-c23a-4a27-bd67-8e5d26708150 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:18.412507 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a60f63ba-c23a-4a27-bd67-8e5d26708150 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/33d5c62a-898f-441b-a1a1-3cb12836755d" status: 200 len: 1497 microversion: 2.1 time: 0.362359 Oct 27 03:25:18.426426 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 693/1417] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:18 2022] GET /compute/v2.1/servers/33d5c62a-898f-441b-a1a1-3cb12836755d => generated 1497 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:18.434201 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-33b5255b-0b48-4270-9422-dd2aa991715c tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:18.435096 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-33b5255b-0b48-4270-9422-dd2aa991715c tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:18.441517 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-33b5255b-0b48-4270-9422-dd2aa991715c tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:18.442316 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-33b5255b-0b48-4270-9422-dd2aa991715c tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:18.442983 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-33b5255b-0b48-4270-9422-dd2aa991715c tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:18.443913 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-33b5255b-0b48-4270-9422-dd2aa991715c tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:18.444588 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-33b5255b-0b48-4270-9422-dd2aa991715c tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:18.445237 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-33b5255b-0b48-4270-9422-dd2aa991715c tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:18.492531 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-dabbbf27-4d36-4d42-a3e7-159054e47262 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:18.507217 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-dabbbf27-4d36-4d42-a3e7-159054e47262 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b" status: 200 len: 1471 microversion: 2.1 time: 1.001848 Oct 27 03:25:18.508517 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 725/1418] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:17 2022] GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b => generated 1471 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:18.530628 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0e104ac4-f5e9-478c-8eb9-1fe8b9f51721 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:18.536972 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0e104ac4-f5e9-478c-8eb9-1fe8b9f51721 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: 6f360a9c-90c7-4efd-90c2-c0d3bd15c154] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:18.553226 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0e104ac4-f5e9-478c-8eb9-1fe8b9f51721 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:18.554006 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0e104ac4-f5e9-478c-8eb9-1fe8b9f51721 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:18.555494 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0e104ac4-f5e9-478c-8eb9-1fe8b9f51721 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:18.556424 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0e104ac4-f5e9-478c-8eb9-1fe8b9f51721 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:18.557046 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0e104ac4-f5e9-478c-8eb9-1fe8b9f51721 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:18.557652 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0e104ac4-f5e9-478c-8eb9-1fe8b9f51721 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:18.600579 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0e104ac4-f5e9-478c-8eb9-1fe8b9f51721 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:18.601585 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0e104ac4-f5e9-478c-8eb9-1fe8b9f51721 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:18.602215 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0e104ac4-f5e9-478c-8eb9-1fe8b9f51721 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:18.602825 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-0e104ac4-f5e9-478c-8eb9-1fe8b9f51721 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lazy-loading 'fault' on Instance uuid 6f360a9c-90c7-4efd-90c2-c0d3bd15c154 {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:25:18.766426 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0e104ac4-f5e9-478c-8eb9-1fe8b9f51721 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:18.788471 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0e104ac4-f5e9-478c-8eb9-1fe8b9f51721 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/6f360a9c-90c7-4efd-90c2-c0d3bd15c154" status: 200 len: 1309 microversion: 2.1 time: 0.267943 Oct 27 03:25:18.802219 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 726/1419] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:18 2022] GET /compute/v2.1/servers/6f360a9c-90c7-4efd-90c2-c0d3bd15c154 => generated 1309 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:18.971641 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-33b5255b-0b48-4270-9422-dd2aa991715c tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:18.977241 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=100 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:25:18.982681 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-33b5255b-0b48-4270-9422-dd2aa991715c tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:18.984399 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-33b5255b-0b48-4270-9422-dd2aa991715c tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:18.985804 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-33b5255b-0b48-4270-9422-dd2aa991715c tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f" status: 200 len: 1606 microversion: 2.25 time: 0.557978 Oct 27 03:25:19.002125 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 694/1420] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:25:18 2022] GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f => generated 1606 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:25:19.012963 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-890b79ad-187a-40e5-87f6-dea0a0a0050d tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:19.013476 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-890b79ad-187a-40e5-87f6-dea0a0a0050d tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:19.019683 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-890b79ad-187a-40e5-87f6-dea0a0a0050d tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:19.020448 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-890b79ad-187a-40e5-87f6-dea0a0a0050d tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:19.020897 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-890b79ad-187a-40e5-87f6-dea0a0a0050d tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:19.021775 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-890b79ad-187a-40e5-87f6-dea0a0a0050d tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:19.022683 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-890b79ad-187a-40e5-87f6-dea0a0a0050d tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:19.023268 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-890b79ad-187a-40e5-87f6-dea0a0a0050d tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:19.076087 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e38dd576-c6ab-4ce4-974d-6c1e093c82a2 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:19.076995 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e38dd576-c6ab-4ce4-974d-6c1e093c82a2 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] [instance: 2d8a44aa-62e4-4385-b295-924517b6f850] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:19.087689 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e38dd576-c6ab-4ce4-974d-6c1e093c82a2 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:19.088191 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e38dd576-c6ab-4ce4-974d-6c1e093c82a2 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:19.088779 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e38dd576-c6ab-4ce4-974d-6c1e093c82a2 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:19.090015 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e38dd576-c6ab-4ce4-974d-6c1e093c82a2 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:19.090501 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e38dd576-c6ab-4ce4-974d-6c1e093c82a2 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:19.090937 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e38dd576-c6ab-4ce4-974d-6c1e093c82a2 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:19.141573 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-890b79ad-187a-40e5-87f6-dea0a0a0050d tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f/os-interface" status: 200 len: 284 microversion: 2.25 time: 0.132451 Oct 27 03:25:19.142748 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 727/1421] 10.222.0.20 () {60 vars in 1316 bytes} [Thu Oct 27 03:25:19 2022] GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f/os-interface => generated 284 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 03:25:19.403474 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-3d56eeb3-f079-4bd2-809a-cf1bf539f55b req-ae033a56-a0dd-4520-b4bd-64097fa3a636 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac5fc2b3-c92e-470a-9bc6-885dce75fb8c", "name": "network-vif-deleted", "tag": "46d55368-0f87-40d8-99d6-d7efc67e997a"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:25:19.424585 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-3d56eeb3-f079-4bd2-809a-cf1bf539f55b req-ae033a56-a0dd-4520-b4bd-64097fa3a636 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:19.432578 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-3d56eeb3-f079-4bd2-809a-cf1bf539f55b req-ae033a56-a0dd-4520-b4bd-64097fa3a636 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:19.437600 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-3d56eeb3-f079-4bd2-809a-cf1bf539f55b req-ae033a56-a0dd-4520-b4bd-64097fa3a636 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:19.463665 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-3d56eeb3-f079-4bd2-809a-cf1bf539f55b req-ae033a56-a0dd-4520-b4bd-64097fa3a636 service nova] Creating event network-vif-deleted:46d55368-0f87-40d8-99d6-d7efc67e997a for instance ac5fc2b3-c92e-470a-9bc6-885dce75fb8c on n-h1-862769-1 Oct 27 03:25:19.473714 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-3d56eeb3-f079-4bd2-809a-cf1bf539f55b req-ae033a56-a0dd-4520-b4bd-64097fa3a636 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073774 Oct 27 03:25:19.475834 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 728/1422] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:25:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:25:19.490896 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7941b874-7d34-4718-bdac-7cf79613ac44 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:19.494390 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7941b874-7d34-4718-bdac-7cf79613ac44 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 33d5c62a-898f-441b-a1a1-3cb12836755d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:19.510274 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7941b874-7d34-4718-bdac-7cf79613ac44 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:19.513137 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7941b874-7d34-4718-bdac-7cf79613ac44 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:19.513794 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7941b874-7d34-4718-bdac-7cf79613ac44 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:19.515668 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7941b874-7d34-4718-bdac-7cf79613ac44 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:19.521531 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7941b874-7d34-4718-bdac-7cf79613ac44 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:19.522251 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7941b874-7d34-4718-bdac-7cf79613ac44 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:20.057548 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e38dd576-c6ab-4ce4-974d-6c1e093c82a2 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ccd5909fb214f71ad68704019c9e4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d2c150feac4d03966a860ab8bafe00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:20.066371 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7941b874-7d34-4718-bdac-7cf79613ac44 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:20.076003 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e38dd576-c6ab-4ce4-974d-6c1e093c82a2 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] 10.222.0.20 "GET /compute/v2.1/servers/2d8a44aa-62e4-4385-b295-924517b6f850" status: 200 len: 1322 microversion: 2.1 time: 1.003813 Oct 27 03:25:20.078760 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 695/1423] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:19 2022] GET /compute/v2.1/servers/2d8a44aa-62e4-4385-b295-924517b6f850 => generated 1322 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:20.087614 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1843e8ac-819a-4119-87b4-312d5cdf4050 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:20.088567 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1843e8ac-819a-4119-87b4-312d5cdf4050 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: e8781053-3dad-4951-b4cb-1f4aaf97e19b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:20.093819 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7941b874-7d34-4718-bdac-7cf79613ac44 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/33d5c62a-898f-441b-a1a1-3cb12836755d" status: 200 len: 1497 microversion: 2.1 time: 0.601368 Oct 27 03:25:20.103738 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1843e8ac-819a-4119-87b4-312d5cdf4050 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:20.103738 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1843e8ac-819a-4119-87b4-312d5cdf4050 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:20.103738 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1843e8ac-819a-4119-87b4-312d5cdf4050 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:20.103738 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1843e8ac-819a-4119-87b4-312d5cdf4050 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:20.106549 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1843e8ac-819a-4119-87b4-312d5cdf4050 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:20.106549 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1843e8ac-819a-4119-87b4-312d5cdf4050 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:20.125396 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 729/1424] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:19 2022] GET /compute/v2.1/servers/33d5c62a-898f-441b-a1a1-3cb12836755d => generated 1497 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:20.135099 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3a91fda5-8697-44fe-8ddd-e4f155344743 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:20.138591 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-3a91fda5-8697-44fe-8ddd-e4f155344743 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: 6f360a9c-90c7-4efd-90c2-c0d3bd15c154] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:20.146386 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3a91fda5-8697-44fe-8ddd-e4f155344743 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:20.147375 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3a91fda5-8697-44fe-8ddd-e4f155344743 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:20.148769 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3a91fda5-8697-44fe-8ddd-e4f155344743 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:20.149692 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3a91fda5-8697-44fe-8ddd-e4f155344743 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:20.150361 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3a91fda5-8697-44fe-8ddd-e4f155344743 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:20.150973 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3a91fda5-8697-44fe-8ddd-e4f155344743 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:20.166240 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-3a91fda5-8697-44fe-8ddd-e4f155344743 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] HTTP exception thrown: Instance 6f360a9c-90c7-4efd-90c2-c0d3bd15c154 could not be found. Oct 27 03:25:20.170862 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3a91fda5-8697-44fe-8ddd-e4f155344743 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Request method failure captured: Oct 27 03:25:20.170862 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/6f360a9c-90c7-4efd-90c2-c0d3bd15c154 HTTP/1.1 Oct 27 03:25:20.170862 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:25:20.170862 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:25:20.170862 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:25:20.170862 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:25:20.170862 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:25:20.170862 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:25:20.170862 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:25:20.170862 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:25:20.170862 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWflSNQach9Nb5a-nwpaet3DOMbW4rovpwiSisAjqFscpzZFwT6bcg_up1i76ycL6ujOTUfNYz_zBzvxITJnmbBErQShJ1lwwCzCfbPi_i3gA3nNTv5XKeqZukq5d_laOkT4ryxL3BEyqvlbo-j2kkQUt_sjeDJRyUijGXNWQdhqp_K4 Oct 27 03:25:20.170862 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:25:20.170862 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:25:20.170862 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:25:20.170862 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:25:20.170862 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:25:20.170862 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:25:20.170862 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: b95729a8c8a14361b7cbf8b2b13900b2 Oct 27 03:25:20.170862 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ServersOnMultiNodesTest-265997062 Oct 27 03:25:20.170862 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:25:20.170862 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:25:20.172242 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b95729a8c8a14361b7cbf8b2b13900b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b95729a8c8a14361b7cbf8b2b13900b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b95729a8c8a14361b7cbf8b2b13900b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b95729a8c8a14361b7cbf8b2b13900b2"}]}] Oct 27 03:25:20.172242 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ServersOnMultiNodesTest-265997062 Oct 27 03:25:20.172242 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: b95729a8c8a14361b7cbf8b2b13900b2 Oct 27 03:25:20.172242 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-265997062 Oct 27 03:25:20.172242 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ServersOnMultiNodesTest-265997062-project Oct 27 03:25:20.172242 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:25:20.172242 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:25:20.172242 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 91d1351fcb6b4cd08f176e6d0cc5bb11 Oct 27 03:25:20.172242 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ServersOnMultiNodesTest-265997062-project Oct 27 03:25:20.172242 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:25:20.172242 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 6f360a9c-90c7-4efd-90c2-c0d3bd15c154 could not be found. Oct 27 03:25:20.172242 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '6f360a9c-90c7-4efd-90c2-c0d3bd15c154'} Oct 27 03:25:20.172973 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:25:20.172973 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:25:20.172973 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:25:20.172973 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:25:20.172973 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:25:20.172973 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:25:20.172973 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:25:20.172973 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:25:20.172973 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:25:20.172973 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:25:20.172973 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f360a9c-90c7-4efd-90c2-c0d3bd15c154 could not be found. Oct 27 03:25:20.172973 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:25:20.172973 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:25:20.172973 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:25:20.172973 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:25:20.172973 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:25:20.172973 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:25:20.172973 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:25:20.172973 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:25:20.172973 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:25:20.174726 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:25:20.174726 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:25:20.174726 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:25:20.174726 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:25:20.174726 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:25:20.174726 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:25:20.174726 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:25:20.174726 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f360a9c-90c7-4efd-90c2-c0d3bd15c154 could not be found. Oct 27 03:25:20.174726 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:25:20.174726 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:25:20.174726 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:25:20.174726 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:25:20.174726 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:25:20.174726 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:25:20.174726 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:25:20.174726 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:25:20.174726 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f360a9c-90c7-4efd-90c2-c0d3bd15c154 could not be found. Oct 27 03:25:20.174726 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:25:20.177475 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3a91fda5-8697-44fe-8ddd-e4f155344743 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Returning 404 to user: Instance 6f360a9c-90c7-4efd-90c2-c0d3bd15c154 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:25:20.178920 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3a91fda5-8697-44fe-8ddd-e4f155344743 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/6f360a9c-90c7-4efd-90c2-c0d3bd15c154" status: 404 len: 111 microversion: 2.1 time: 0.051946 Oct 27 03:25:20.183380 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 730/1425] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:20 2022] GET /compute/v2.1/servers/6f360a9c-90c7-4efd-90c2-c0d3bd15c154 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:25:20.190071 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4d466b5d-1248-4bb4-8660-cdfd6eb8ec6c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:20.190962 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4d466b5d-1248-4bb4-8660-cdfd6eb8ec6c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: ac5fc2b3-c92e-470a-9bc6-885dce75fb8c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:20.199260 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4d466b5d-1248-4bb4-8660-cdfd6eb8ec6c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:20.212610 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4d466b5d-1248-4bb4-8660-cdfd6eb8ec6c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:20.214858 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4d466b5d-1248-4bb4-8660-cdfd6eb8ec6c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:20.215812 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4d466b5d-1248-4bb4-8660-cdfd6eb8ec6c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:20.217529 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4d466b5d-1248-4bb4-8660-cdfd6eb8ec6c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:20.219037 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4d466b5d-1248-4bb4-8660-cdfd6eb8ec6c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:20.242596 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-4d466b5d-1248-4bb4-8660-cdfd6eb8ec6c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] HTTP exception thrown: Instance ac5fc2b3-c92e-470a-9bc6-885dce75fb8c could not be found. Oct 27 03:25:20.244621 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4d466b5d-1248-4bb4-8660-cdfd6eb8ec6c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Request method failure captured: Oct 27 03:25:20.244621 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/ac5fc2b3-c92e-470a-9bc6-885dce75fb8c HTTP/1.1 Oct 27 03:25:20.244621 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:25:20.244621 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:25:20.244621 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:25:20.244621 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:25:20.244621 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:25:20.244621 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:25:20.244621 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:25:20.244621 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:25:20.244621 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWflSNQach9Nb5a-nwpaet3DOMbW4rovpwiSisAjqFscpzZFwT6bcg_up1i76ycL6ujOTUfNYz_zBzvxITJnmbBErQShJ1lwwCzCfbPi_i3gA3nNTv5XKeqZukq5d_laOkT4ryxL3BEyqvlbo-j2kkQUt_sjeDJRyUijGXNWQdhqp_K4 Oct 27 03:25:20.244621 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:25:20.244621 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:25:20.244621 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:25:20.244621 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:25:20.244621 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:25:20.244621 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:25:20.244621 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: b95729a8c8a14361b7cbf8b2b13900b2 Oct 27 03:25:20.244621 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ServersOnMultiNodesTest-265997062 Oct 27 03:25:20.244621 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:25:20.244621 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:25:20.246217 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b95729a8c8a14361b7cbf8b2b13900b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b95729a8c8a14361b7cbf8b2b13900b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b95729a8c8a14361b7cbf8b2b13900b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b95729a8c8a14361b7cbf8b2b13900b2"}]}] Oct 27 03:25:20.246217 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ServersOnMultiNodesTest-265997062 Oct 27 03:25:20.246217 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: b95729a8c8a14361b7cbf8b2b13900b2 Oct 27 03:25:20.246217 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-265997062 Oct 27 03:25:20.246217 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ServersOnMultiNodesTest-265997062-project Oct 27 03:25:20.246217 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:25:20.246217 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:25:20.246217 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 91d1351fcb6b4cd08f176e6d0cc5bb11 Oct 27 03:25:20.246217 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ServersOnMultiNodesTest-265997062-project Oct 27 03:25:20.246217 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:25:20.246217 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance ac5fc2b3-c92e-470a-9bc6-885dce75fb8c could not be found. Oct 27 03:25:20.246217 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': 'ac5fc2b3-c92e-470a-9bc6-885dce75fb8c'} Oct 27 03:25:20.246980 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:25:20.246980 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:25:20.246980 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:25:20.246980 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:25:20.246980 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:25:20.246980 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:25:20.246980 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:25:20.246980 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:25:20.246980 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:25:20.246980 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:25:20.246980 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac5fc2b3-c92e-470a-9bc6-885dce75fb8c could not be found. Oct 27 03:25:20.246980 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:25:20.246980 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:25:20.246980 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:25:20.246980 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:25:20.246980 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:25:20.246980 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:25:20.246980 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:25:20.246980 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:25:20.246980 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:25:20.248269 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:25:20.248269 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:25:20.248269 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:25:20.248269 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:25:20.248269 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:25:20.248269 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:25:20.248269 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:25:20.248269 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac5fc2b3-c92e-470a-9bc6-885dce75fb8c could not be found. Oct 27 03:25:20.248269 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:25:20.248269 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:25:20.248269 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:25:20.248269 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:25:20.248269 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:25:20.248269 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:25:20.248269 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:25:20.248269 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:25:20.248269 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac5fc2b3-c92e-470a-9bc6-885dce75fb8c could not be found. Oct 27 03:25:20.248269 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:25:20.249312 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4d466b5d-1248-4bb4-8660-cdfd6eb8ec6c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Returning 404 to user: Instance ac5fc2b3-c92e-470a-9bc6-885dce75fb8c could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:25:20.250124 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4d466b5d-1248-4bb4-8660-cdfd6eb8ec6c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/ac5fc2b3-c92e-470a-9bc6-885dce75fb8c" status: 404 len: 111 microversion: 2.1 time: 0.065082 Oct 27 03:25:20.257391 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 731/1426] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:20 2022] GET /compute/v2.1/servers/ac5fc2b3-c92e-470a-9bc6-885dce75fb8c => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:25:20.264270 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b00f28df-49ab-499f-9167-8cebe3bf80cf tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:20.375085 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b00f28df-49ab-499f-9167-8cebe3bf80cf tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/4835bc27-4897-4969-a9df-56f3801b9332" status: 204 len: 0 microversion: 2.1 time: 0.116544 Oct 27 03:25:20.375675 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 732/1427] 10.222.0.20 () {58 vars in 1266 bytes} [Thu Oct 27 03:25:20 2022] DELETE /compute/v2.1/os-server-groups/4835bc27-4897-4969-a9df-56f3801b9332 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:25:20.383896 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c288e5d5-3490-493d-80c8-6471d70e5c59 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:20.384400 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c288e5d5-3490-493d-80c8-6471d70e5c59 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: 37b3577c-f561-4d8e-957d-cdf1819ef5c1] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:20.391381 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c288e5d5-3490-493d-80c8-6471d70e5c59 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:20.392123 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c288e5d5-3490-493d-80c8-6471d70e5c59 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:20.393271 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c288e5d5-3490-493d-80c8-6471d70e5c59 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:20.394264 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c288e5d5-3490-493d-80c8-6471d70e5c59 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:20.394952 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c288e5d5-3490-493d-80c8-6471d70e5c59 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:20.395486 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c288e5d5-3490-493d-80c8-6471d70e5c59 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:20.418123 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1843e8ac-819a-4119-87b4-312d5cdf4050 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:20.426179 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1843e8ac-819a-4119-87b4-312d5cdf4050 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b" status: 200 len: 1471 microversion: 2.1 time: 0.346195 Oct 27 03:25:20.427474 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 696/1428] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:20 2022] GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b => generated 1471 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:20.428847 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c288e5d5-3490-493d-80c8-6471d70e5c59 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: 37b3577c-f561-4d8e-957d-cdf1819ef5c1] Going to try to terminate instance {{(pid=121000) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:25:20.754506 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c288e5d5-3490-493d-80c8-6471d70e5c59 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "DELETE /compute/v2.1/servers/37b3577c-f561-4d8e-957d-cdf1819ef5c1" status: 204 len: 0 microversion: 2.1 time: 0.374183 Oct 27 03:25:20.756715 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 733/1429] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:25:20 2022] DELETE /compute/v2.1/servers/37b3577c-f561-4d8e-957d-cdf1819ef5c1 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 03:25:20.765400 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5ffe0be1-ecb5-4230-8d3b-ba8082084214 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:20.765566 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5ffe0be1-ecb5-4230-8d3b-ba8082084214 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: 1a733f7d-4f8d-4190-9795-937510f1a516] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:20.773516 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5ffe0be1-ecb5-4230-8d3b-ba8082084214 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:20.774058 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5ffe0be1-ecb5-4230-8d3b-ba8082084214 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:20.774496 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5ffe0be1-ecb5-4230-8d3b-ba8082084214 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:20.775213 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5ffe0be1-ecb5-4230-8d3b-ba8082084214 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:20.775669 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5ffe0be1-ecb5-4230-8d3b-ba8082084214 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:20.776100 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5ffe0be1-ecb5-4230-8d3b-ba8082084214 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:20.850001 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5ffe0be1-ecb5-4230-8d3b-ba8082084214 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: 1a733f7d-4f8d-4190-9795-937510f1a516] Going to try to terminate instance {{(pid=121001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:25:21.104994 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a910372b-a926-465d-b8db-256057808957 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:21.106149 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a910372b-a926-465d-b8db-256057808957 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] [instance: 2d8a44aa-62e4-4385-b295-924517b6f850] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:21.123879 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a910372b-a926-465d-b8db-256057808957 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:21.124644 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a910372b-a926-465d-b8db-256057808957 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:21.125302 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a910372b-a926-465d-b8db-256057808957 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:21.129099 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a910372b-a926-465d-b8db-256057808957 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:21.133136 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a910372b-a926-465d-b8db-256057808957 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:21.133599 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a910372b-a926-465d-b8db-256057808957 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:21.218623 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5ffe0be1-ecb5-4230-8d3b-ba8082084214 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1a733f7d-4f8d-4190-9795-937510f1a516" status: 204 len: 0 microversion: 2.1 time: 0.457299 Oct 27 03:25:21.220387 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 697/1430] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:25:20 2022] DELETE /compute/v2.1/servers/1a733f7d-4f8d-4190-9795-937510f1a516 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 03:25:21.225945 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ed18974d-7680-4d29-8352-24f5b20cc4d0 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:21.226729 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ed18974d-7680-4d29-8352-24f5b20cc4d0 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 33d5c62a-898f-441b-a1a1-3cb12836755d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:21.245281 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ed18974d-7680-4d29-8352-24f5b20cc4d0 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:21.246388 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ed18974d-7680-4d29-8352-24f5b20cc4d0 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:21.247003 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ed18974d-7680-4d29-8352-24f5b20cc4d0 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:21.248500 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ed18974d-7680-4d29-8352-24f5b20cc4d0 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:21.249131 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ed18974d-7680-4d29-8352-24f5b20cc4d0 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:21.249989 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ed18974d-7680-4d29-8352-24f5b20cc4d0 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:21.551545 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a910372b-a926-465d-b8db-256057808957 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ccd5909fb214f71ad68704019c9e4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d2c150feac4d03966a860ab8bafe00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:21.559627 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a910372b-a926-465d-b8db-256057808957 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] 10.222.0.20 "GET /compute/v2.1/servers/2d8a44aa-62e4-4385-b295-924517b6f850" status: 200 len: 1322 microversion: 2.1 time: 0.462300 Oct 27 03:25:21.560220 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 734/1431] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:21 2022] GET /compute/v2.1/servers/2d8a44aa-62e4-4385-b295-924517b6f850 => generated 1322 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:25:21.578575 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-05cee7d8-7c78-4ed2-acf5-5d6898354c87 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:21.579195 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-05cee7d8-7c78-4ed2-acf5-5d6898354c87 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: 37b3577c-f561-4d8e-957d-cdf1819ef5c1] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:21.586020 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-05cee7d8-7c78-4ed2-acf5-5d6898354c87 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:21.586629 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-05cee7d8-7c78-4ed2-acf5-5d6898354c87 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:21.587448 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-05cee7d8-7c78-4ed2-acf5-5d6898354c87 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:21.588356 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-05cee7d8-7c78-4ed2-acf5-5d6898354c87 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:21.588979 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-05cee7d8-7c78-4ed2-acf5-5d6898354c87 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:21.589570 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-05cee7d8-7c78-4ed2-acf5-5d6898354c87 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:21.753787 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ed18974d-7680-4d29-8352-24f5b20cc4d0 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:21.769972 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ed18974d-7680-4d29-8352-24f5b20cc4d0 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/33d5c62a-898f-441b-a1a1-3cb12836755d" status: 200 len: 1497 microversion: 2.1 time: 0.548204 Oct 27 03:25:21.775873 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 698/1432] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:21 2022] GET /compute/v2.1/servers/33d5c62a-898f-441b-a1a1-3cb12836755d => generated 1497 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:21.790570 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-92d15ef6-06eb-4955-9a98-1d05b32ae405 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:21.791758 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-92d15ef6-06eb-4955-9a98-1d05b32ae405 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: e8781053-3dad-4951-b4cb-1f4aaf97e19b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:21.809998 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-92d15ef6-06eb-4955-9a98-1d05b32ae405 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:21.811841 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-92d15ef6-06eb-4955-9a98-1d05b32ae405 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:21.813368 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-92d15ef6-06eb-4955-9a98-1d05b32ae405 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:21.814372 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-92d15ef6-06eb-4955-9a98-1d05b32ae405 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:21.816160 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-92d15ef6-06eb-4955-9a98-1d05b32ae405 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:21.817709 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-92d15ef6-06eb-4955-9a98-1d05b32ae405 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:22.168359 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-05cee7d8-7c78-4ed2-acf5-5d6898354c87 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:22.199573 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-92d15ef6-06eb-4955-9a98-1d05b32ae405 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:22.210371 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-92d15ef6-06eb-4955-9a98-1d05b32ae405 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b" status: 200 len: 1471 microversion: 2.1 time: 0.432024 Oct 27 03:25:22.213867 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 699/1433] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:21 2022] GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b => generated 1471 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:22.217765 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-05cee7d8-7c78-4ed2-acf5-5d6898354c87 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/37b3577c-f561-4d8e-957d-cdf1819ef5c1" status: 200 len: 1474 microversion: 2.1 time: 0.652538 Oct 27 03:25:22.219713 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 735/1434] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:21 2022] GET /compute/v2.1/servers/37b3577c-f561-4d8e-957d-cdf1819ef5c1 => generated 1474 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:22.240324 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-98660c11-8d75-4fd1-be49-fb693d07df2f req-5a797b30-1a45-438c-8c28-a02377fd8197 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d8a44aa-62e4-4385-b295-924517b6f850", "name": "network-vif-plugged", "status": "completed", "tag": "c7d8654a-e058-4157-b215-5b6094b1dbfe"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:25:22.250268 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-98660c11-8d75-4fd1-be49-fb693d07df2f req-5a797b30-1a45-438c-8c28-a02377fd8197 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:22.251310 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-98660c11-8d75-4fd1-be49-fb693d07df2f req-5a797b30-1a45-438c-8c28-a02377fd8197 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:22.252786 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-98660c11-8d75-4fd1-be49-fb693d07df2f req-5a797b30-1a45-438c-8c28-a02377fd8197 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:22.273984 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-3e922e7f-eb24-4f0d-9812-4e6636168b9e req-b4b7430b-5dc7-4e58-b840-45f0b669c2a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f", "tag": "43cfec0a-97df-4480-8645-66f623cb4eaa"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:25:22.274165 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-98660c11-8d75-4fd1-be49-fb693d07df2f req-5a797b30-1a45-438c-8c28-a02377fd8197 service nova] Creating event network-vif-plugged:c7d8654a-e058-4157-b215-5b6094b1dbfe for instance 2d8a44aa-62e4-4385-b295-924517b6f850 on n-h1-862769-1 Oct 27 03:25:22.275613 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-98660c11-8d75-4fd1-be49-fb693d07df2f req-5a797b30-1a45-438c-8c28-a02377fd8197 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057228 Oct 27 03:25:22.276804 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 700/1435] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:25:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:25:22.292459 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-3e922e7f-eb24-4f0d-9812-4e6636168b9e req-b4b7430b-5dc7-4e58-b840-45f0b669c2a1 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:22.298411 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-3e922e7f-eb24-4f0d-9812-4e6636168b9e req-b4b7430b-5dc7-4e58-b840-45f0b669c2a1 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:22.303030 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-3e922e7f-eb24-4f0d-9812-4e6636168b9e req-b4b7430b-5dc7-4e58-b840-45f0b669c2a1 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:22.342760 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-3e922e7f-eb24-4f0d-9812-4e6636168b9e req-b4b7430b-5dc7-4e58-b840-45f0b669c2a1 service nova] Creating event network-changed:43cfec0a-97df-4480-8645-66f623cb4eaa for instance 09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f on n-h1-862769-1 Oct 27 03:25:22.353902 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-3e922e7f-eb24-4f0d-9812-4e6636168b9e req-b4b7430b-5dc7-4e58-b840-45f0b669c2a1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103307 Oct 27 03:25:22.357435 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 736/1436] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:25:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:25:22.583933 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9b965494-dbe0-44c0-ab12-9f177dad3383 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:22.590489 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-9b965494-dbe0-44c0-ab12-9f177dad3383 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] [instance: 2d8a44aa-62e4-4385-b295-924517b6f850] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:22.604797 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9b965494-dbe0-44c0-ab12-9f177dad3383 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:22.606558 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9b965494-dbe0-44c0-ab12-9f177dad3383 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:22.607124 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9b965494-dbe0-44c0-ab12-9f177dad3383 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:22.609087 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9b965494-dbe0-44c0-ab12-9f177dad3383 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:22.609247 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9b965494-dbe0-44c0-ab12-9f177dad3383 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:22.613526 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9b965494-dbe0-44c0-ab12-9f177dad3383 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:22.800102 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3deeeb3b-7d16-4f65-8bed-560940f74ab6 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:22.800799 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-3deeeb3b-7d16-4f65-8bed-560940f74ab6 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 33d5c62a-898f-441b-a1a1-3cb12836755d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:22.813579 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3deeeb3b-7d16-4f65-8bed-560940f74ab6 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:22.814083 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3deeeb3b-7d16-4f65-8bed-560940f74ab6 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:22.817025 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3deeeb3b-7d16-4f65-8bed-560940f74ab6 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:22.817025 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3deeeb3b-7d16-4f65-8bed-560940f74ab6 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:22.823726 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3deeeb3b-7d16-4f65-8bed-560940f74ab6 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:22.824188 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3deeeb3b-7d16-4f65-8bed-560940f74ab6 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:22.888846 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9b965494-dbe0-44c0-ab12-9f177dad3383 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ccd5909fb214f71ad68704019c9e4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d2c150feac4d03966a860ab8bafe00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:22.900309 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9b965494-dbe0-44c0-ab12-9f177dad3383 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] 10.222.0.20 "GET /compute/v2.1/servers/2d8a44aa-62e4-4385-b295-924517b6f850" status: 200 len: 1322 microversion: 2.1 time: 0.319026 Oct 27 03:25:22.901038 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 701/1437] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:22 2022] GET /compute/v2.1/servers/2d8a44aa-62e4-4385-b295-924517b6f850 => generated 1322 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:23.238797 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2b94dada-f88e-4e0b-b673-318ddd37a04d tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:23.239840 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2b94dada-f88e-4e0b-b673-318ddd37a04d tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: e8781053-3dad-4951-b4cb-1f4aaf97e19b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:23.248668 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2b94dada-f88e-4e0b-b673-318ddd37a04d tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:23.252548 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2b94dada-f88e-4e0b-b673-318ddd37a04d tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:23.253335 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2b94dada-f88e-4e0b-b673-318ddd37a04d tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:23.254963 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2b94dada-f88e-4e0b-b673-318ddd37a04d tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:23.261183 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2b94dada-f88e-4e0b-b673-318ddd37a04d tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:23.261183 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2b94dada-f88e-4e0b-b673-318ddd37a04d tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:23.652813 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2b94dada-f88e-4e0b-b673-318ddd37a04d tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:23.664224 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2b94dada-f88e-4e0b-b673-318ddd37a04d tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b" status: 200 len: 1476 microversion: 2.1 time: 0.429901 Oct 27 03:25:23.667500 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 702/1438] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:23 2022] GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b => generated 1476 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:23.684336 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e1b3e654-57e2-43a9-a8d4-73935d869ee3 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:23.688719 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e1b3e654-57e2-43a9-a8d4-73935d869ee3 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: 37b3577c-f561-4d8e-957d-cdf1819ef5c1] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:23.707003 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e1b3e654-57e2-43a9-a8d4-73935d869ee3 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:23.707510 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e1b3e654-57e2-43a9-a8d4-73935d869ee3 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:23.707958 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e1b3e654-57e2-43a9-a8d4-73935d869ee3 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:23.711196 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e1b3e654-57e2-43a9-a8d4-73935d869ee3 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:23.714184 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e1b3e654-57e2-43a9-a8d4-73935d869ee3 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:23.714697 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e1b3e654-57e2-43a9-a8d4-73935d869ee3 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:23.884488 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-3deeeb3b-7d16-4f65-8bed-560940f74ab6 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:23.895073 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3deeeb3b-7d16-4f65-8bed-560940f74ab6 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/33d5c62a-898f-441b-a1a1-3cb12836755d" status: 200 len: 1497 microversion: 2.1 time: 1.099757 Oct 27 03:25:23.900330 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 737/1439] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:22 2022] GET /compute/v2.1/servers/33d5c62a-898f-441b-a1a1-3cb12836755d => generated 1497 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:23.953860 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c6248ef8-c694-4a04-81bd-6ac971dc27a1 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:23.956556 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c6248ef8-c694-4a04-81bd-6ac971dc27a1 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] [instance: 2d8a44aa-62e4-4385-b295-924517b6f850] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:23.966599 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c6248ef8-c694-4a04-81bd-6ac971dc27a1 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:23.967674 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c6248ef8-c694-4a04-81bd-6ac971dc27a1 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:23.968306 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c6248ef8-c694-4a04-81bd-6ac971dc27a1 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:23.969195 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c6248ef8-c694-4a04-81bd-6ac971dc27a1 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:23.969809 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c6248ef8-c694-4a04-81bd-6ac971dc27a1 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:23.970488 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c6248ef8-c694-4a04-81bd-6ac971dc27a1 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:23.976766 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:25:24.239466 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c6248ef8-c694-4a04-81bd-6ac971dc27a1 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ccd5909fb214f71ad68704019c9e4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d2c150feac4d03966a860ab8bafe00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:24.240293 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e1b3e654-57e2-43a9-a8d4-73935d869ee3 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:24.283184 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c6248ef8-c694-4a04-81bd-6ac971dc27a1 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] 10.222.0.20 "GET /compute/v2.1/servers/2d8a44aa-62e4-4385-b295-924517b6f850" status: 200 len: 1322 microversion: 2.1 time: 0.352288 Oct 27 03:25:24.284028 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e1b3e654-57e2-43a9-a8d4-73935d869ee3 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/37b3577c-f561-4d8e-957d-cdf1819ef5c1" status: 200 len: 1474 microversion: 2.1 time: 0.614501 Oct 27 03:25:24.309072 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 738/1440] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:23 2022] GET /compute/v2.1/servers/2d8a44aa-62e4-4385-b295-924517b6f850 => generated 1322 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:24.311599 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 703/1441] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:23 2022] GET /compute/v2.1/servers/37b3577c-f561-4d8e-957d-cdf1819ef5c1 => generated 1474 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:24.601797 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3add09b8-6665-465c-8318-5f5d266cf001 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Action: 'create', calling method: .version_select at 0x7f7ddee305e0>, body: {"keypair": {"name": "tempest-keypair-2021389453", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPuv8XTNjtE9lBxnvDClOunQ0EIQ5xXe3ASeZKpyqfvcIWPyyAie/jZT0yRlSmvJoYC2Oxlk3RGuOYpOxt7syrkmdBKPsbpUu38RxVypAzHHNvzBLSRNDcRftN0cxO6hrQ=="}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:25:24.638297 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-3add09b8-6665-465c-8318-5f5d266cf001 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Getting quotas for project 59c57f8e9a0e4debae18d98918ba8c2f. Resources: {'key_pairs'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:25:24.649035 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-3add09b8-6665-465c-8318-5f5d266cf001 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Getting quotas for user c65ddc0af5854d7a89192d01bc5f4576 and project 59c57f8e9a0e4debae18d98918ba8c2f. Resources: {'key_pairs'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:25:24.692450 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f7875ffc-0e22-4427-84c5-d18fab9dace8 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:24.693411 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f7875ffc-0e22-4427-84c5-d18fab9dace8 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: e8781053-3dad-4951-b4cb-1f4aaf97e19b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:24.707839 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f7875ffc-0e22-4427-84c5-d18fab9dace8 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:24.708190 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f7875ffc-0e22-4427-84c5-d18fab9dace8 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:24.708977 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f7875ffc-0e22-4427-84c5-d18fab9dace8 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:24.711114 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f7875ffc-0e22-4427-84c5-d18fab9dace8 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:24.713864 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f7875ffc-0e22-4427-84c5-d18fab9dace8 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:24.714564 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f7875ffc-0e22-4427-84c5-d18fab9dace8 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:24.783375 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3add09b8-6665-465c-8318-5f5d266cf001 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.472152 Oct 27 03:25:24.784822 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 739/1442] 10.222.0.20 () {60 vars in 1159 bytes} [Thu Oct 27 03:25:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:25:24.789564 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-a00dbf0e-5f3b-4657-ac8b-7fee9951d3e0 req-79f0c0f6-6b28-43ab-9ce7-23eabc9e0335 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37b3577c-f561-4d8e-957d-cdf1819ef5c1", "name": "network-vif-deleted", "tag": "fea19390-7267-4a02-8335-c138eabc8d80"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:25:24.819405 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-a00dbf0e-5f3b-4657-ac8b-7fee9951d3e0 req-79f0c0f6-6b28-43ab-9ce7-23eabc9e0335 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:24.820166 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-a00dbf0e-5f3b-4657-ac8b-7fee9951d3e0 req-79f0c0f6-6b28-43ab-9ce7-23eabc9e0335 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:24.820770 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-a00dbf0e-5f3b-4657-ac8b-7fee9951d3e0 req-79f0c0f6-6b28-43ab-9ce7-23eabc9e0335 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:24.844926 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-a00dbf0e-5f3b-4657-ac8b-7fee9951d3e0 req-79f0c0f6-6b28-43ab-9ce7-23eabc9e0335 service nova] Creating event network-vif-deleted:fea19390-7267-4a02-8335-c138eabc8d80 for instance 37b3577c-f561-4d8e-957d-cdf1819ef5c1 on n-h1-862769-1 Oct 27 03:25:24.852642 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-a00dbf0e-5f3b-4657-ac8b-7fee9951d3e0 req-79f0c0f6-6b28-43ab-9ce7-23eabc9e0335 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066445 Oct 27 03:25:24.854197 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 740/1443] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:25:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:25:24.928553 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-46835876-d2ef-4283-ac18-ee61329395dd tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:24.938722 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-46835876-d2ef-4283-ac18-ee61329395dd tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 33d5c62a-898f-441b-a1a1-3cb12836755d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:24.939136 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-46835876-d2ef-4283-ac18-ee61329395dd tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:24.948680 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-46835876-d2ef-4283-ac18-ee61329395dd tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:24.950160 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-46835876-d2ef-4283-ac18-ee61329395dd tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:24.951103 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-46835876-d2ef-4283-ac18-ee61329395dd tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:24.951867 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-46835876-d2ef-4283-ac18-ee61329395dd tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:24.952484 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-46835876-d2ef-4283-ac18-ee61329395dd tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:25.108142 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f7875ffc-0e22-4427-84c5-d18fab9dace8 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:25.120614 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f7875ffc-0e22-4427-84c5-d18fab9dace8 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b" status: 200 len: 1476 microversion: 2.1 time: 0.431489 Oct 27 03:25:25.137149 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 704/1444] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:24 2022] GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b => generated 1476 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:25:25.145541 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-4acb063f-e5fc-4e18-8639-9af07a996ac3 req-bee92a44-3f5b-48bc-955c-500931a96425 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a733f7d-4f8d-4190-9795-937510f1a516", "name": "network-vif-deleted", "tag": "969d061b-4cd2-41dd-8d2b-52277a30b8ea"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:25:25.173429 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-4acb063f-e5fc-4e18-8639-9af07a996ac3 req-bee92a44-3f5b-48bc-955c-500931a96425 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:25.173429 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-4acb063f-e5fc-4e18-8639-9af07a996ac3 req-bee92a44-3f5b-48bc-955c-500931a96425 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:25.173429 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-4acb063f-e5fc-4e18-8639-9af07a996ac3 req-bee92a44-3f5b-48bc-955c-500931a96425 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:25.199114 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-4acb063f-e5fc-4e18-8639-9af07a996ac3 req-bee92a44-3f5b-48bc-955c-500931a96425 service nova] Creating event network-vif-deleted:969d061b-4cd2-41dd-8d2b-52277a30b8ea for instance 1a733f7d-4f8d-4190-9795-937510f1a516 on n-h1-862769-1 Oct 27 03:25:25.214253 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-4acb063f-e5fc-4e18-8639-9af07a996ac3 req-bee92a44-3f5b-48bc-955c-500931a96425 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074551 Oct 27 03:25:25.218096 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 705/1445] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:25:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:25:25.319380 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-480eb5b4-42ac-4809-843a-ca6c17ef24cf tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:25.319380 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-480eb5b4-42ac-4809-843a-ca6c17ef24cf tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: 37b3577c-f561-4d8e-957d-cdf1819ef5c1] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:25.331656 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-480eb5b4-42ac-4809-843a-ca6c17ef24cf tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:25.332163 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-480eb5b4-42ac-4809-843a-ca6c17ef24cf tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:25.332610 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-480eb5b4-42ac-4809-843a-ca6c17ef24cf tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:25.333350 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-480eb5b4-42ac-4809-843a-ca6c17ef24cf tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:25.337798 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-480eb5b4-42ac-4809-843a-ca6c17ef24cf tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:25.338781 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-480eb5b4-42ac-4809-843a-ca6c17ef24cf tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:25.384213 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-480eb5b4-42ac-4809-843a-ca6c17ef24cf tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:25.384841 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-480eb5b4-42ac-4809-843a-ca6c17ef24cf tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:25.385264 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-480eb5b4-42ac-4809-843a-ca6c17ef24cf tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:25.385743 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-480eb5b4-42ac-4809-843a-ca6c17ef24cf tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lazy-loading 'fault' on Instance uuid 37b3577c-f561-4d8e-957d-cdf1819ef5c1 {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:25:25.455930 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-480eb5b4-42ac-4809-843a-ca6c17ef24cf tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:25.466944 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-480eb5b4-42ac-4809-843a-ca6c17ef24cf tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/37b3577c-f561-4d8e-957d-cdf1819ef5c1" status: 200 len: 1309 microversion: 2.1 time: 0.152727 Oct 27 03:25:25.467141 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 706/1446] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:25 2022] GET /compute/v2.1/servers/37b3577c-f561-4d8e-957d-cdf1819ef5c1 => generated 1309 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:25.472015 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a06f00a0-ad8e-473e-b328-d278fb6d69b2 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:25.472646 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a06f00a0-ad8e-473e-b328-d278fb6d69b2 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] [instance: 2d8a44aa-62e4-4385-b295-924517b6f850] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:25.479551 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a06f00a0-ad8e-473e-b328-d278fb6d69b2 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:25.480256 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a06f00a0-ad8e-473e-b328-d278fb6d69b2 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:25.480863 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a06f00a0-ad8e-473e-b328-d278fb6d69b2 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:25.481763 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a06f00a0-ad8e-473e-b328-d278fb6d69b2 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:25.482893 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a06f00a0-ad8e-473e-b328-d278fb6d69b2 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:25.483525 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a06f00a0-ad8e-473e-b328-d278fb6d69b2 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:25.567826 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-46835876-d2ef-4283-ac18-ee61329395dd tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:25.598710 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-46835876-d2ef-4283-ac18-ee61329395dd tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/33d5c62a-898f-441b-a1a1-3cb12836755d" status: 200 len: 1497 microversion: 2.1 time: 0.675148 Oct 27 03:25:25.601627 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 741/1447] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:24 2022] GET /compute/v2.1/servers/33d5c62a-898f-441b-a1a1-3cb12836755d => generated 1497 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:25.646602 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a06f00a0-ad8e-473e-b328-d278fb6d69b2 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ccd5909fb214f71ad68704019c9e4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d2c150feac4d03966a860ab8bafe00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:25.659423 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a06f00a0-ad8e-473e-b328-d278fb6d69b2 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] 10.222.0.20 "GET /compute/v2.1/servers/2d8a44aa-62e4-4385-b295-924517b6f850" status: 200 len: 1472 microversion: 2.1 time: 0.191028 Oct 27 03:25:25.660006 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 707/1448] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:25 2022] GET /compute/v2.1/servers/2d8a44aa-62e4-4385-b295-924517b6f850 => generated 1472 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:25.902487 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-24436568-a539-41bb-820c-06c8539adfb8 tempest-ServersAdminNegativeTestJSON-1854954566 tempest-ServersAdminNegativeTestJSON-1854954566-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:25:25.903465 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-24436568-a539-41bb-820c-06c8539adfb8 tempest-ServersAdminNegativeTestJSON-1854954566 tempest-ServersAdminNegativeTestJSON-1854954566-project-admin] [instance: 18da795d-e892-4b49-8902-8e32bc36411b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:25.910315 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-24436568-a539-41bb-820c-06c8539adfb8 tempest-ServersAdminNegativeTestJSON-1854954566 tempest-ServersAdminNegativeTestJSON-1854954566-project-admin] HTTP exception thrown: Instance 18da795d-e892-4b49-8902-8e32bc36411b could not be found. Oct 27 03:25:25.913009 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-24436568-a539-41bb-820c-06c8539adfb8 tempest-ServersAdminNegativeTestJSON-1854954566 tempest-ServersAdminNegativeTestJSON-1854954566-project-admin] Request method failure captured: Oct 27 03:25:25.913009 n-d-862769-1 devstack@n-api.service[121000]: request: POST /compute/v2.1/servers/18da795d-e892-4b49-8902-8e32bc36411b/action HTTP/1.1 Oct 27 03:25:25.913009 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:25:25.913009 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:25:25.913009 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:25:25.913009 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 15 Oct 27 03:25:25.913009 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:25:25.913009 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:25:25.913009 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:25:25.913009 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:25:25.913009 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfoFdSedD8do6mz2HrdDJl_A9DppHq4-R7WQdmvE88nilO6yRdbw6lhWjnrNUW_1C1dTE33a5qj_uIrpMqXCMzYZPQ8I54Oqfrk7GemfqTLWQNRtTU14ciQ8qfb_gp9-F8q7A8G9LHtDqDY3TxROHKjW1POYQESSSzFcPwVFChjMS3Y Oct 27 03:25:25.913009 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:25:25.913009 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:25:25.913009 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:25:25.913009 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:25:25.913009 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:25:25.913009 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:25:25.913009 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: dc250ed4d4ca4645bbb9bd83d3d3ac9f Oct 27 03:25:25.913009 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1854954566 Oct 27 03:25:25.913009 n-d-862769-1 devstack@n-api.service[121000]: X-Role: admin,member,reader Oct 27 03:25:25.913009 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: admin,member,reader Oct 27 03:25:25.914616 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dc250ed4d4ca4645bbb9bd83d3d3ac9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dc250ed4d4ca4645bbb9bd83d3d3ac9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dc250ed4d4ca4645bbb9bd83d3d3ac9f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dc250ed4d4ca4645bbb9bd83d3d3ac9f"}]}] Oct 27 03:25:25.914616 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1854954566 Oct 27 03:25:25.914616 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: dc250ed4d4ca4645bbb9bd83d3d3ac9f Oct 27 03:25:25.914616 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1854954566 Oct 27 03:25:25.914616 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ServersAdminNegativeTestJSON-1854954566-project-admin Oct 27 03:25:25.914616 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:25:25.914616 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:25:25.914616 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: fc8e662e5b2f4e32ba368bd697294803 Oct 27 03:25:25.914616 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1854954566-project-admin Oct 27 03:25:25.914616 n-d-862769-1 devstack@n-api.service[121000]: Oct 27 03:25:25.914616 n-d-862769-1 devstack@n-api.service[121000]: {"migrate": {}} Oct 27 03:25:25.914616 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:25:25.914616 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 18da795d-e892-4b49-8902-8e32bc36411b could not be found. Oct 27 03:25:25.915956 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '18da795d-e892-4b49-8902-8e32bc36411b', 'body': {'migrate': {}}} Oct 27 03:25:25.915956 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:25:25.915956 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:25:25.915956 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:25:25.915956 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:25:25.915956 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:25:25.915956 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:25:25.915956 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 03:25:25.915956 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 03:25:25.915956 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18da795d-e892-4b49-8902-8e32bc36411b could not be found. Oct 27 03:25:25.915956 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:25:25.915956 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:25:25.915956 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:25:25.915956 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:25:25.915956 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:25:25.915956 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:25:25.915956 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:25:25.915956 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:25:25.915956 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:25:25.915956 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:25:25.917584 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:25:25.917584 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:25:25.917584 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Oct 27 03:25:25.917584 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Oct 27 03:25:25.917584 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:25:25.917584 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:25:25.917584 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18da795d-e892-4b49-8902-8e32bc36411b could not be found. Oct 27 03:25:25.917584 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:25:25.917584 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:25:25.917584 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:25:25.917584 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:25:25.917584 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:25:25.917584 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:25:25.917584 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:25:25.917584 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:25:25.917584 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18da795d-e892-4b49-8902-8e32bc36411b could not be found. Oct 27 03:25:25.917584 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:25:25.920392 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-24436568-a539-41bb-820c-06c8539adfb8 tempest-ServersAdminNegativeTestJSON-1854954566 tempest-ServersAdminNegativeTestJSON-1854954566-project-admin] Returning 404 to user: Instance 18da795d-e892-4b49-8902-8e32bc36411b could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:25:25.921333 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-24436568-a539-41bb-820c-06c8539adfb8 tempest-ServersAdminNegativeTestJSON-1854954566 tempest-ServersAdminNegativeTestJSON-1854954566-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/18da795d-e892-4b49-8902-8e32bc36411b/action" status: 404 len: 111 microversion: 2.1 time: 0.236095 Oct 27 03:25:25.921934 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 742/1449] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:25:25 2022] POST /compute/v2.1/servers/18da795d-e892-4b49-8902-8e32bc36411b/action => generated 111 bytes in 237 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:25:26.053401 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-66a00563-b552-4f55-a024-7f24859e42e7 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-284973386", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:25:26.163449 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-eedc15ea-4fdb-48b6-8476-910b572d59bf tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:26.164538 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-eedc15ea-4fdb-48b6-8476-910b572d59bf tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: e8781053-3dad-4951-b4cb-1f4aaf97e19b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:26.178673 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.network.neutron [None req-66a00563-b552-4f55-a024-7f24859e42e7 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] validate_networks() for None {{(pid=121001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:25:26.207672 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eedc15ea-4fdb-48b6-8476-910b572d59bf tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:26.208802 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eedc15ea-4fdb-48b6-8476-910b572d59bf tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:26.208802 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eedc15ea-4fdb-48b6-8476-910b572d59bf tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:26.209505 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eedc15ea-4fdb-48b6-8476-910b572d59bf tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:26.209796 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eedc15ea-4fdb-48b6-8476-910b572d59bf tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:26.210268 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eedc15ea-4fdb-48b6-8476-910b572d59bf tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:26.426432 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-eedc15ea-4fdb-48b6-8476-910b572d59bf tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:26.445543 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-eedc15ea-4fdb-48b6-8476-910b572d59bf tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b" status: 200 len: 1476 microversion: 2.1 time: 0.284974 Oct 27 03:25:26.457511 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 743/1450] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:26 2022] GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b => generated 1476 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:26.494010 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c706871c-38f1-47d1-89aa-219f01c80f6c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:26.496557 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c706871c-38f1-47d1-89aa-219f01c80f6c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: 37b3577c-f561-4d8e-957d-cdf1819ef5c1] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:26.503683 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c706871c-38f1-47d1-89aa-219f01c80f6c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:26.504500 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c706871c-38f1-47d1-89aa-219f01c80f6c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:26.506006 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c706871c-38f1-47d1-89aa-219f01c80f6c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:26.507112 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c706871c-38f1-47d1-89aa-219f01c80f6c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:26.507886 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c706871c-38f1-47d1-89aa-219f01c80f6c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:26.508630 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c706871c-38f1-47d1-89aa-219f01c80f6c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:26.528337 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-c706871c-38f1-47d1-89aa-219f01c80f6c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] HTTP exception thrown: Instance 37b3577c-f561-4d8e-957d-cdf1819ef5c1 could not be found. Oct 27 03:25:26.529996 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c706871c-38f1-47d1-89aa-219f01c80f6c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Request method failure captured: Oct 27 03:25:26.529996 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/37b3577c-f561-4d8e-957d-cdf1819ef5c1 HTTP/1.1 Oct 27 03:25:26.529996 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:25:26.529996 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:25:26.529996 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:25:26.529996 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:25:26.529996 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:25:26.529996 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:25:26.529996 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:25:26.529996 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:25:26.529996 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWflSNQach9Nb5a-nwpaet3DOMbW4rovpwiSisAjqFscpzZFwT6bcg_up1i76ycL6ujOTUfNYz_zBzvxITJnmbBErQShJ1lwwCzCfbPi_i3gA3nNTv5XKeqZukq5d_laOkT4ryxL3BEyqvlbo-j2kkQUt_sjeDJRyUijGXNWQdhqp_K4 Oct 27 03:25:26.529996 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:25:26.529996 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:25:26.529996 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:25:26.529996 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:25:26.529996 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:25:26.529996 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:25:26.529996 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: b95729a8c8a14361b7cbf8b2b13900b2 Oct 27 03:25:26.529996 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ServersOnMultiNodesTest-265997062 Oct 27 03:25:26.529996 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:25:26.529996 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:25:26.531707 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b95729a8c8a14361b7cbf8b2b13900b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b95729a8c8a14361b7cbf8b2b13900b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b95729a8c8a14361b7cbf8b2b13900b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b95729a8c8a14361b7cbf8b2b13900b2"}]}] Oct 27 03:25:26.531707 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ServersOnMultiNodesTest-265997062 Oct 27 03:25:26.531707 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: b95729a8c8a14361b7cbf8b2b13900b2 Oct 27 03:25:26.531707 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-265997062 Oct 27 03:25:26.531707 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ServersOnMultiNodesTest-265997062-project Oct 27 03:25:26.531707 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:25:26.531707 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:25:26.531707 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 91d1351fcb6b4cd08f176e6d0cc5bb11 Oct 27 03:25:26.531707 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ServersOnMultiNodesTest-265997062-project Oct 27 03:25:26.531707 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:25:26.531707 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 37b3577c-f561-4d8e-957d-cdf1819ef5c1 could not be found. Oct 27 03:25:26.531707 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '37b3577c-f561-4d8e-957d-cdf1819ef5c1'} Oct 27 03:25:26.532571 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:25:26.532571 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:25:26.532571 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:25:26.532571 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:25:26.532571 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:25:26.532571 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:25:26.532571 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:25:26.532571 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:25:26.532571 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:25:26.532571 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:25:26.532571 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37b3577c-f561-4d8e-957d-cdf1819ef5c1 could not be found. Oct 27 03:25:26.532571 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:25:26.532571 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:25:26.532571 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:25:26.532571 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:25:26.532571 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:25:26.532571 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:25:26.532571 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:25:26.532571 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:25:26.532571 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:25:26.535689 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:25:26.535689 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:25:26.535689 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:25:26.535689 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:25:26.535689 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:25:26.535689 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:25:26.535689 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:25:26.535689 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37b3577c-f561-4d8e-957d-cdf1819ef5c1 could not be found. Oct 27 03:25:26.535689 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:25:26.535689 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:25:26.535689 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:25:26.535689 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:25:26.535689 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:25:26.535689 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:25:26.535689 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:25:26.535689 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:25:26.535689 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37b3577c-f561-4d8e-957d-cdf1819ef5c1 could not be found. Oct 27 03:25:26.535689 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:25:26.541348 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c706871c-38f1-47d1-89aa-219f01c80f6c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Returning 404 to user: Instance 37b3577c-f561-4d8e-957d-cdf1819ef5c1 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:25:26.542846 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c706871c-38f1-47d1-89aa-219f01c80f6c tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/37b3577c-f561-4d8e-957d-cdf1819ef5c1" status: 404 len: 111 microversion: 2.1 time: 0.054174 Oct 27 03:25:26.543443 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 744/1451] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:26 2022] GET /compute/v2.1/servers/37b3577c-f561-4d8e-957d-cdf1819ef5c1 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:25:26.552798 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-47918807-d0ae-4a50-988c-646866991644 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:26.555881 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-47918807-d0ae-4a50-988c-646866991644 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: 1a733f7d-4f8d-4190-9795-937510f1a516] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:26.564242 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-47918807-d0ae-4a50-988c-646866991644 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:26.566195 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-47918807-d0ae-4a50-988c-646866991644 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:26.566849 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-47918807-d0ae-4a50-988c-646866991644 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:26.567774 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-47918807-d0ae-4a50-988c-646866991644 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:26.569397 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-47918807-d0ae-4a50-988c-646866991644 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:26.569834 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-47918807-d0ae-4a50-988c-646866991644 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:26.627878 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-47918807-d0ae-4a50-988c-646866991644 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:26.627878 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-47918807-d0ae-4a50-988c-646866991644 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:26.628337 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-47918807-d0ae-4a50-988c-646866991644 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:26.628795 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-47918807-d0ae-4a50-988c-646866991644 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lazy-loading 'fault' on Instance uuid 1a733f7d-4f8d-4190-9795-937510f1a516 {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:25:26.673659 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-47918807-d0ae-4a50-988c-646866991644 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:26.681985 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-47918807-d0ae-4a50-988c-646866991644 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/1a733f7d-4f8d-4190-9795-937510f1a516" status: 200 len: 1309 microversion: 2.1 time: 0.134367 Oct 27 03:25:26.682584 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 745/1452] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:26 2022] GET /compute/v2.1/servers/1a733f7d-4f8d-4190-9795-937510f1a516 => generated 1309 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:25:26.690847 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3f6b96a9-657b-4238-bc30-d6f91b4bf350 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:26.691698 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-3f6b96a9-657b-4238-bc30-d6f91b4bf350 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 33d5c62a-898f-441b-a1a1-3cb12836755d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:26.699676 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3f6b96a9-657b-4238-bc30-d6f91b4bf350 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:26.700803 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3f6b96a9-657b-4238-bc30-d6f91b4bf350 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:26.701005 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3f6b96a9-657b-4238-bc30-d6f91b4bf350 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:26.702627 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3f6b96a9-657b-4238-bc30-d6f91b4bf350 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:26.703121 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3f6b96a9-657b-4238-bc30-d6f91b4bf350 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:26.703564 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3f6b96a9-657b-4238-bc30-d6f91b4bf350 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:26.875278 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-3f6b96a9-657b-4238-bc30-d6f91b4bf350 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:26.889078 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3f6b96a9-657b-4238-bc30-d6f91b4bf350 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/33d5c62a-898f-441b-a1a1-3cb12836755d" status: 200 len: 1497 microversion: 2.1 time: 0.204924 Oct 27 03:25:26.891638 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 746/1453] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:26 2022] GET /compute/v2.1/servers/33d5c62a-898f-441b-a1a1-3cb12836755d => generated 1497 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:26.907892 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-66a00563-b552-4f55-a024-7f24859e42e7 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Flavor limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:25:26.908470 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-66a00563-b552-4f55-a024-7f24859e42e7 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Image limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:25:26.909183 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-66a00563-b552-4f55-a024-7f24859e42e7 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Flavor pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:25:26.909699 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-66a00563-b552-4f55-a024-7f24859e42e7 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Image pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:25:26.910264 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-66a00563-b552-4f55-a024-7f24859e42e7 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:25:26.919834 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-66a00563-b552-4f55-a024-7f24859e42e7 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:26.920326 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-66a00563-b552-4f55-a024-7f24859e42e7 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:26.920804 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-66a00563-b552-4f55-a024-7f24859e42e7 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:26.921498 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-66a00563-b552-4f55-a024-7f24859e42e7 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:26.921963 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-66a00563-b552-4f55-a024-7f24859e42e7 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:26.922425 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-66a00563-b552-4f55-a024-7f24859e42e7 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:26.942166 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-66a00563-b552-4f55-a024-7f24859e42e7 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Getting quotas for project 49d2c150feac4d03966a860ab8bafe00. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:25:26.947609 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-66a00563-b552-4f55-a024-7f24859e42e7 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Getting quotas for user 2ccd5909fb214f71ad68704019c9e4f0 and project 49d2c150feac4d03966a860ab8bafe00. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:25:26.961673 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-66a00563-b552-4f55-a024-7f24859e42e7 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Going to run 1 instances... {{(pid=121001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:25:26.964115 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-66a00563-b552-4f55-a024-7f24859e42e7 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] [instance: b3e22e1e-77a7-4f06-b099-eee6d631d3c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:25:27.179191 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-66a00563-b552-4f55-a024-7f24859e42e7 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.131621 Oct 27 03:25:27.182488 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 708/1454] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:25:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1136 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 03:25:27.194844 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7d29190b-fac4-4426-83cb-aa58c1a7e3e1 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:27.195993 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7d29190b-fac4-4426-83cb-aa58c1a7e3e1 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] [instance: b3e22e1e-77a7-4f06-b099-eee6d631d3c9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:27.209893 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=9,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:25:27.413974 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7d29190b-fac4-4426-83cb-aa58c1a7e3e1 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ccd5909fb214f71ad68704019c9e4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d2c150feac4d03966a860ab8bafe00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:27.425602 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7d29190b-fac4-4426-83cb-aa58c1a7e3e1 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] 10.222.0.20 "GET /compute/v2.1/servers/b3e22e1e-77a7-4f06-b099-eee6d631d3c9" status: 200 len: 1221 microversion: 2.1 time: 0.233528 Oct 27 03:25:27.426289 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 747/1455] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:27 2022] GET /compute/v2.1/servers/b3e22e1e-77a7-4f06-b099-eee6d631d3c9 => generated 1221 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:27.469384 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2945bb4f-7eec-4d1e-8860-042336460272 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:27.470397 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2945bb4f-7eec-4d1e-8860-042336460272 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: e8781053-3dad-4951-b4cb-1f4aaf97e19b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:27.489372 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2945bb4f-7eec-4d1e-8860-042336460272 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:27.489372 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2945bb4f-7eec-4d1e-8860-042336460272 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:27.489372 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2945bb4f-7eec-4d1e-8860-042336460272 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:27.489372 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2945bb4f-7eec-4d1e-8860-042336460272 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:27.489939 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2945bb4f-7eec-4d1e-8860-042336460272 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:27.489939 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2945bb4f-7eec-4d1e-8860-042336460272 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:27.708627 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1eec23d7-2ebe-4a09-bba5-495d6280af91 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:27.709473 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1eec23d7-2ebe-4a09-bba5-495d6280af91 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: 1a733f7d-4f8d-4190-9795-937510f1a516] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:27.722207 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1eec23d7-2ebe-4a09-bba5-495d6280af91 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:27.722942 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1eec23d7-2ebe-4a09-bba5-495d6280af91 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:27.723542 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1eec23d7-2ebe-4a09-bba5-495d6280af91 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:27.724429 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1eec23d7-2ebe-4a09-bba5-495d6280af91 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:27.725041 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1eec23d7-2ebe-4a09-bba5-495d6280af91 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:27.725830 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1eec23d7-2ebe-4a09-bba5-495d6280af91 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:27.741594 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-1eec23d7-2ebe-4a09-bba5-495d6280af91 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] HTTP exception thrown: Instance 1a733f7d-4f8d-4190-9795-937510f1a516 could not be found. Oct 27 03:25:27.743689 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1eec23d7-2ebe-4a09-bba5-495d6280af91 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Request method failure captured: Oct 27 03:25:27.743689 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/1a733f7d-4f8d-4190-9795-937510f1a516 HTTP/1.1 Oct 27 03:25:27.743689 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:25:27.743689 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:25:27.743689 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:25:27.743689 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:25:27.743689 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:25:27.743689 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:25:27.743689 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:25:27.743689 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:25:27.743689 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWflSNQach9Nb5a-nwpaet3DOMbW4rovpwiSisAjqFscpzZFwT6bcg_up1i76ycL6ujOTUfNYz_zBzvxITJnmbBErQShJ1lwwCzCfbPi_i3gA3nNTv5XKeqZukq5d_laOkT4ryxL3BEyqvlbo-j2kkQUt_sjeDJRyUijGXNWQdhqp_K4 Oct 27 03:25:27.743689 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:25:27.743689 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:25:27.743689 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:25:27.743689 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:25:27.743689 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:25:27.743689 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:25:27.743689 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: b95729a8c8a14361b7cbf8b2b13900b2 Oct 27 03:25:27.743689 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ServersOnMultiNodesTest-265997062 Oct 27 03:25:27.743689 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:25:27.743689 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:25:27.745332 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b95729a8c8a14361b7cbf8b2b13900b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b95729a8c8a14361b7cbf8b2b13900b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b95729a8c8a14361b7cbf8b2b13900b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b95729a8c8a14361b7cbf8b2b13900b2"}]}] Oct 27 03:25:27.745332 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ServersOnMultiNodesTest-265997062 Oct 27 03:25:27.745332 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: b95729a8c8a14361b7cbf8b2b13900b2 Oct 27 03:25:27.745332 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-265997062 Oct 27 03:25:27.745332 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ServersOnMultiNodesTest-265997062-project Oct 27 03:25:27.745332 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:25:27.745332 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:25:27.745332 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 91d1351fcb6b4cd08f176e6d0cc5bb11 Oct 27 03:25:27.745332 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ServersOnMultiNodesTest-265997062-project Oct 27 03:25:27.745332 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:25:27.745332 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 1a733f7d-4f8d-4190-9795-937510f1a516 could not be found. Oct 27 03:25:27.745332 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '1a733f7d-4f8d-4190-9795-937510f1a516'} Oct 27 03:25:27.746285 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:25:27.746285 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:25:27.746285 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:25:27.746285 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:25:27.746285 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:25:27.746285 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:25:27.746285 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:25:27.746285 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:25:27.746285 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:25:27.746285 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:25:27.746285 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a733f7d-4f8d-4190-9795-937510f1a516 could not be found. Oct 27 03:25:27.746285 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:25:27.746285 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:25:27.746285 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:25:27.746285 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:25:27.746285 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:25:27.746285 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:25:27.746285 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:25:27.746285 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:25:27.746285 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:25:27.747788 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:25:27.747788 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:25:27.747788 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:25:27.747788 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:25:27.747788 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:25:27.747788 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:25:27.747788 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:25:27.747788 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a733f7d-4f8d-4190-9795-937510f1a516 could not be found. Oct 27 03:25:27.747788 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:25:27.747788 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:25:27.747788 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:25:27.747788 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:25:27.747788 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:25:27.747788 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:25:27.747788 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:25:27.747788 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:25:27.747788 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a733f7d-4f8d-4190-9795-937510f1a516 could not be found. Oct 27 03:25:27.747788 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:25:27.749857 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1eec23d7-2ebe-4a09-bba5-495d6280af91 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Returning 404 to user: Instance 1a733f7d-4f8d-4190-9795-937510f1a516 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:25:27.751254 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1eec23d7-2ebe-4a09-bba5-495d6280af91 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/1a733f7d-4f8d-4190-9795-937510f1a516" status: 404 len: 111 microversion: 2.1 time: 0.047025 Oct 27 03:25:27.752336 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 748/1456] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:27 2022] GET /compute/v2.1/servers/1a733f7d-4f8d-4190-9795-937510f1a516 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 03:25:27.761271 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-cabe9463-952b-45a5-9630-2c7a672951c4 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:27.853020 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2945bb4f-7eec-4d1e-8860-042336460272 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:27.866814 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2945bb4f-7eec-4d1e-8860-042336460272 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b" status: 200 len: 1476 microversion: 2.1 time: 0.401497 Oct 27 03:25:27.872350 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 709/1457] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:27 2022] GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b => generated 1476 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:27.901641 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-cabe9463-952b-45a5-9630-2c7a672951c4 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/42ad9f2d-227d-4b2a-b208-60d85ad55118" status: 204 len: 0 microversion: 2.1 time: 0.145371 Oct 27 03:25:27.903220 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 749/1458] 10.222.0.20 () {58 vars in 1266 bytes} [Thu Oct 27 03:25:27 2022] DELETE /compute/v2.1/os-server-groups/42ad9f2d-227d-4b2a-b208-60d85ad55118 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:25:27.913494 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-58908a18-43b9-418d-aa0c-f3e6da659787 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:27.913494 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-58908a18-43b9-418d-aa0c-f3e6da659787 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: d0a79872-c316-4bb2-914c-a118831bc023] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:27.922409 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-affb4a8b-fd1b-4712-b804-efe4d25d2f50 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:27.923851 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-affb4a8b-fd1b-4712-b804-efe4d25d2f50 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 33d5c62a-898f-441b-a1a1-3cb12836755d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:27.928719 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-58908a18-43b9-418d-aa0c-f3e6da659787 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:27.930708 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-58908a18-43b9-418d-aa0c-f3e6da659787 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:27.931529 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-58908a18-43b9-418d-aa0c-f3e6da659787 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:27.935360 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-58908a18-43b9-418d-aa0c-f3e6da659787 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:27.936583 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-affb4a8b-fd1b-4712-b804-efe4d25d2f50 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:27.942309 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-58908a18-43b9-418d-aa0c-f3e6da659787 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:27.942309 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-58908a18-43b9-418d-aa0c-f3e6da659787 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:27.942534 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-affb4a8b-fd1b-4712-b804-efe4d25d2f50 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:27.942534 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-affb4a8b-fd1b-4712-b804-efe4d25d2f50 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:27.942534 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-affb4a8b-fd1b-4712-b804-efe4d25d2f50 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:27.942534 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-affb4a8b-fd1b-4712-b804-efe4d25d2f50 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:27.942882 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-affb4a8b-fd1b-4712-b804-efe4d25d2f50 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:27.976897 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-58908a18-43b9-418d-aa0c-f3e6da659787 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: d0a79872-c316-4bb2-914c-a118831bc023] Going to try to terminate instance {{(pid=121001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:25:28.045447 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:25:28.419194 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-58908a18-43b9-418d-aa0c-f3e6da659787 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d0a79872-c316-4bb2-914c-a118831bc023" status: 204 len: 0 microversion: 2.1 time: 0.511217 Oct 27 03:25:28.419958 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 710/1459] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:25:27 2022] DELETE /compute/v2.1/servers/d0a79872-c316-4bb2-914c-a118831bc023 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:25:28.432326 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-61178435-1dc5-4297-9132-5c5ce972039f tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:28.434028 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-61178435-1dc5-4297-9132-5c5ce972039f tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: d0a79872-c316-4bb2-914c-a118831bc023] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:28.448928 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-61178435-1dc5-4297-9132-5c5ce972039f tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:28.449830 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-61178435-1dc5-4297-9132-5c5ce972039f tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:28.450478 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-61178435-1dc5-4297-9132-5c5ce972039f tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:28.451498 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-61178435-1dc5-4297-9132-5c5ce972039f tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:28.452249 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-61178435-1dc5-4297-9132-5c5ce972039f tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:28.452836 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-61178435-1dc5-4297-9132-5c5ce972039f tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:28.514180 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-affb4a8b-fd1b-4712-b804-efe4d25d2f50 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:28.525547 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-affb4a8b-fd1b-4712-b804-efe4d25d2f50 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/33d5c62a-898f-441b-a1a1-3cb12836755d" status: 200 len: 1497 microversion: 2.1 time: 0.606940 Oct 27 03:25:28.544597 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 750/1460] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:27 2022] GET /compute/v2.1/servers/33d5c62a-898f-441b-a1a1-3cb12836755d => generated 1497 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:25:28.549705 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c3a4d891-a339-45f9-a8fd-c30e86a24dc5 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:28.551104 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c3a4d891-a339-45f9-a8fd-c30e86a24dc5 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] [instance: b3e22e1e-77a7-4f06-b099-eee6d631d3c9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:28.558444 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c3a4d891-a339-45f9-a8fd-c30e86a24dc5 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:28.559144 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c3a4d891-a339-45f9-a8fd-c30e86a24dc5 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:28.559774 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c3a4d891-a339-45f9-a8fd-c30e86a24dc5 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:28.560673 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c3a4d891-a339-45f9-a8fd-c30e86a24dc5 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:28.561297 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c3a4d891-a339-45f9-a8fd-c30e86a24dc5 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:28.561888 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c3a4d891-a339-45f9-a8fd-c30e86a24dc5 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:28.653643 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c3a4d891-a339-45f9-a8fd-c30e86a24dc5 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ccd5909fb214f71ad68704019c9e4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d2c150feac4d03966a860ab8bafe00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:28.666195 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c3a4d891-a339-45f9-a8fd-c30e86a24dc5 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] 10.222.0.20 "GET /compute/v2.1/servers/b3e22e1e-77a7-4f06-b099-eee6d631d3c9" status: 200 len: 1225 microversion: 2.1 time: 0.120239 Oct 27 03:25:28.681751 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-61178435-1dc5-4297-9132-5c5ce972039f tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:28.683947 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 751/1461] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:28 2022] GET /compute/v2.1/servers/b3e22e1e-77a7-4f06-b099-eee6d631d3c9 => generated 1225 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:28.687833 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-61178435-1dc5-4297-9132-5c5ce972039f tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/d0a79872-c316-4bb2-914c-a118831bc023" status: 200 len: 1471 microversion: 2.1 time: 0.261699 Oct 27 03:25:28.700454 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 711/1462] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:28 2022] GET /compute/v2.1/servers/d0a79872-c316-4bb2-914c-a118831bc023 => generated 1471 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:28.898409 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-597f3e50-e06a-4302-976f-a8f87fc5f3f2 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:28.899312 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-597f3e50-e06a-4302-976f-a8f87fc5f3f2 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: e8781053-3dad-4951-b4cb-1f4aaf97e19b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:28.906476 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-597f3e50-e06a-4302-976f-a8f87fc5f3f2 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:28.907000 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-597f3e50-e06a-4302-976f-a8f87fc5f3f2 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:28.907636 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-597f3e50-e06a-4302-976f-a8f87fc5f3f2 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:28.908349 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-597f3e50-e06a-4302-976f-a8f87fc5f3f2 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:28.909352 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-597f3e50-e06a-4302-976f-a8f87fc5f3f2 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:28.909777 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-597f3e50-e06a-4302-976f-a8f87fc5f3f2 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:29.125855 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ad831a07-a9fb-4dac-976b-d4e273bc0adf tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-464836011", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": [{"uuid": "7314d059-3fb1-4d01-906a-7ea3e40ff99a"}], "security_groups": [{"name": "tempest-securitygroup--1030081651"}], "key_name": "tempest-keypair-2021389453", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:25:29.147435 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-597f3e50-e06a-4302-976f-a8f87fc5f3f2 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:29.156144 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-597f3e50-e06a-4302-976f-a8f87fc5f3f2 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b" status: 200 len: 1476 microversion: 2.1 time: 0.262348 Oct 27 03:25:29.156736 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 752/1463] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:28 2022] GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b => generated 1476 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:29.291075 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.network.neutron [None req-ad831a07-a9fb-4dac-976b-d4e273bc0adf tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] validate_networks() for [('7314d059-3fb1-4d01-906a-7ea3e40ff99a', None, None, None, None, None)] {{(pid=121001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:25:29.558640 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0f482dc8-fb00-4a52-8d5e-5050fdaaf7ee tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:29.560002 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0f482dc8-fb00-4a52-8d5e-5050fdaaf7ee tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 33d5c62a-898f-441b-a1a1-3cb12836755d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:29.566854 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0f482dc8-fb00-4a52-8d5e-5050fdaaf7ee tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:29.567671 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0f482dc8-fb00-4a52-8d5e-5050fdaaf7ee tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:29.568335 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0f482dc8-fb00-4a52-8d5e-5050fdaaf7ee tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:29.569303 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0f482dc8-fb00-4a52-8d5e-5050fdaaf7ee tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:29.569996 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0f482dc8-fb00-4a52-8d5e-5050fdaaf7ee tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:29.570668 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0f482dc8-fb00-4a52-8d5e-5050fdaaf7ee tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:29.823593 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0f482dc8-fb00-4a52-8d5e-5050fdaaf7ee tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:29.833483 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0f482dc8-fb00-4a52-8d5e-5050fdaaf7ee tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/33d5c62a-898f-441b-a1a1-3cb12836755d" status: 200 len: 1497 microversion: 2.1 time: 0.278641 Oct 27 03:25:29.852272 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 753/1464] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:29 2022] GET /compute/v2.1/servers/33d5c62a-898f-441b-a1a1-3cb12836755d => generated 1497 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:25:29.857832 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-ad831a07-a9fb-4dac-976b-d4e273bc0adf tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Flavor limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:25:29.863047 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-ad831a07-a9fb-4dac-976b-d4e273bc0adf tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Image limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:25:29.863047 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-ad831a07-a9fb-4dac-976b-d4e273bc0adf tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Flavor pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:25:29.863047 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-ad831a07-a9fb-4dac-976b-d4e273bc0adf tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Image pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:25:29.863348 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3cd241e6-2529-4446-a96c-cd25b4c7de1a tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:29.863348 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-3cd241e6-2529-4446-a96c-cd25b4c7de1a tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] [instance: b3e22e1e-77a7-4f06-b099-eee6d631d3c9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:29.863508 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-ad831a07-a9fb-4dac-976b-d4e273bc0adf tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:25:29.870936 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3cd241e6-2529-4446-a96c-cd25b4c7de1a tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:29.872019 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3cd241e6-2529-4446-a96c-cd25b4c7de1a tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:29.872682 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3cd241e6-2529-4446-a96c-cd25b4c7de1a tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:29.873645 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3cd241e6-2529-4446-a96c-cd25b4c7de1a tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:29.874345 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3cd241e6-2529-4446-a96c-cd25b4c7de1a tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:29.875674 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3cd241e6-2529-4446-a96c-cd25b4c7de1a tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:29.894780 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ad831a07-a9fb-4dac-976b-d4e273bc0adf tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:29.897503 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ad831a07-a9fb-4dac-976b-d4e273bc0adf tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:29.897503 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ad831a07-a9fb-4dac-976b-d4e273bc0adf tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:29.897503 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ad831a07-a9fb-4dac-976b-d4e273bc0adf tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:29.898624 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ad831a07-a9fb-4dac-976b-d4e273bc0adf tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:29.899756 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ad831a07-a9fb-4dac-976b-d4e273bc0adf tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:29.934002 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-ad831a07-a9fb-4dac-976b-d4e273bc0adf tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Getting quotas for project 59c57f8e9a0e4debae18d98918ba8c2f. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:25:29.945749 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-ad831a07-a9fb-4dac-976b-d4e273bc0adf tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Getting quotas for user c65ddc0af5854d7a89192d01bc5f4576 and project 59c57f8e9a0e4debae18d98918ba8c2f. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:25:29.986330 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ad831a07-a9fb-4dac-976b-d4e273bc0adf tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Going to run 1 instances... {{(pid=121001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:25:29.991378 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ad831a07-a9fb-4dac-976b-d4e273bc0adf tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] [instance: 1d9172bd-aa20-4f49-87fa-64300cf861be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:25:30.048187 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-3cd241e6-2529-4446-a96c-cd25b4c7de1a tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ccd5909fb214f71ad68704019c9e4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d2c150feac4d03966a860ab8bafe00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:30.060182 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3cd241e6-2529-4446-a96c-cd25b4c7de1a tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] 10.222.0.20 "GET /compute/v2.1/servers/b3e22e1e-77a7-4f06-b099-eee6d631d3c9" status: 200 len: 1225 microversion: 2.1 time: 0.206328 Oct 27 03:25:30.078197 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 754/1465] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:29 2022] GET /compute/v2.1/servers/b3e22e1e-77a7-4f06-b099-eee6d631d3c9 => generated 1225 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:30.088525 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e77ac9f3-7813-497e-8f73-b627e7cde902 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:30.089163 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e77ac9f3-7813-497e-8f73-b627e7cde902 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: d0a79872-c316-4bb2-914c-a118831bc023] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:30.095894 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e77ac9f3-7813-497e-8f73-b627e7cde902 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:30.096438 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e77ac9f3-7813-497e-8f73-b627e7cde902 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:30.096887 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e77ac9f3-7813-497e-8f73-b627e7cde902 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:30.097738 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e77ac9f3-7813-497e-8f73-b627e7cde902 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:30.098266 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e77ac9f3-7813-497e-8f73-b627e7cde902 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:30.098707 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e77ac9f3-7813-497e-8f73-b627e7cde902 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:30.229756 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ad831a07-a9fb-4dac-976b-d4e273bc0adf tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.105770 Oct 27 03:25:30.231942 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 712/1466] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:25:29 2022] POST /compute/v2.1/servers => generated 406 bytes in 1111 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 03:25:30.250671 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2a365178-ba08-4c2f-bf70-b281caf795e8 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:30.254801 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2a365178-ba08-4c2f-bf70-b281caf795e8 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: e8781053-3dad-4951-b4cb-1f4aaf97e19b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:30.266258 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2a365178-ba08-4c2f-bf70-b281caf795e8 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:30.270067 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2a365178-ba08-4c2f-bf70-b281caf795e8 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:30.273363 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2a365178-ba08-4c2f-bf70-b281caf795e8 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:30.273363 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2a365178-ba08-4c2f-bf70-b281caf795e8 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:30.273363 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2a365178-ba08-4c2f-bf70-b281caf795e8 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:30.273363 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2a365178-ba08-4c2f-bf70-b281caf795e8 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:30.564011 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2a365178-ba08-4c2f-bf70-b281caf795e8 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:30.573245 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2a365178-ba08-4c2f-bf70-b281caf795e8 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b" status: 200 len: 1476 microversion: 2.1 time: 0.338225 Oct 27 03:25:30.574062 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 713/1467] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:30 2022] GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b => generated 1476 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:30.583183 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-fd71a9dd-0991-4644-8895-484e5e3fa90f tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:30.584028 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-fd71a9dd-0991-4644-8895-484e5e3fa90f tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] [instance: 1d9172bd-aa20-4f49-87fa-64300cf861be] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:30.609712 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e77ac9f3-7813-497e-8f73-b627e7cde902 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:30.623841 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e77ac9f3-7813-497e-8f73-b627e7cde902 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/d0a79872-c316-4bb2-914c-a118831bc023" status: 200 len: 1471 microversion: 2.1 time: 0.538743 Oct 27 03:25:30.638306 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 755/1468] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:30 2022] GET /compute/v2.1/servers/d0a79872-c316-4bb2-914c-a118831bc023 => generated 1471 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:30.678625 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-fd71a9dd-0991-4644-8895-484e5e3fa90f tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c65ddc0af5854d7a89192d01bc5f4576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c57f8e9a0e4debae18d98918ba8c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:30.686089 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-fd71a9dd-0991-4644-8895-484e5e3fa90f tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] 10.222.0.20 "GET /compute/v2.1/servers/1d9172bd-aa20-4f49-87fa-64300cf861be" status: 200 len: 1241 microversion: 2.1 time: 0.110589 Oct 27 03:25:30.690090 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 714/1469] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:30 2022] GET /compute/v2.1/servers/1d9172bd-aa20-4f49-87fa-64300cf861be => generated 1241 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:30.864968 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9073e203-fe15-4d9a-ac1d-bc3e0ea6ee68 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:30.865931 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9073e203-fe15-4d9a-ac1d-bc3e0ea6ee68 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 33d5c62a-898f-441b-a1a1-3cb12836755d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:30.872848 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9073e203-fe15-4d9a-ac1d-bc3e0ea6ee68 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:30.873429 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9073e203-fe15-4d9a-ac1d-bc3e0ea6ee68 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:30.874134 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9073e203-fe15-4d9a-ac1d-bc3e0ea6ee68 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:30.875069 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9073e203-fe15-4d9a-ac1d-bc3e0ea6ee68 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:30.875757 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9073e203-fe15-4d9a-ac1d-bc3e0ea6ee68 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:30.876256 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9073e203-fe15-4d9a-ac1d-bc3e0ea6ee68 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:31.085565 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-972ab31e-5460-4bb4-aa80-58951e3b0bdb tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:31.086096 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-972ab31e-5460-4bb4-aa80-58951e3b0bdb tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] [instance: b3e22e1e-77a7-4f06-b099-eee6d631d3c9] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:31.093321 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-972ab31e-5460-4bb4-aa80-58951e3b0bdb tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:31.100545 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-972ab31e-5460-4bb4-aa80-58951e3b0bdb tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:31.101008 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-972ab31e-5460-4bb4-aa80-58951e3b0bdb tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:31.101772 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-972ab31e-5460-4bb4-aa80-58951e3b0bdb tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:31.102278 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-972ab31e-5460-4bb4-aa80-58951e3b0bdb tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:31.102717 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-972ab31e-5460-4bb4-aa80-58951e3b0bdb tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:31.230201 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9073e203-fe15-4d9a-ac1d-bc3e0ea6ee68 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:31.239768 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9073e203-fe15-4d9a-ac1d-bc3e0ea6ee68 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/33d5c62a-898f-441b-a1a1-3cb12836755d" status: 200 len: 1497 microversion: 2.1 time: 0.379508 Oct 27 03:25:31.240177 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-972ab31e-5460-4bb4-aa80-58951e3b0bdb tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ccd5909fb214f71ad68704019c9e4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d2c150feac4d03966a860ab8bafe00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:31.250681 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 756/1470] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:30 2022] GET /compute/v2.1/servers/33d5c62a-898f-441b-a1a1-3cb12836755d => generated 1497 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:31.258498 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-972ab31e-5460-4bb4-aa80-58951e3b0bdb tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] 10.222.0.20 "GET /compute/v2.1/servers/b3e22e1e-77a7-4f06-b099-eee6d631d3c9" status: 200 len: 1273 microversion: 2.1 time: 0.177640 Oct 27 03:25:31.259087 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 715/1471] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:31 2022] GET /compute/v2.1/servers/b3e22e1e-77a7-4f06-b099-eee6d631d3c9 => generated 1273 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:25:31.261863 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-6505beed-d76c-49ac-8355-6a9306b5ff37 req-0f012d14-35d0-48d8-a8a7-4f72b4eed30a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0a79872-c316-4bb2-914c-a118831bc023", "name": "network-vif-deleted", "tag": "d6726828-5fd6-412a-bd4f-f5918742c962"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:25:31.272168 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-6505beed-d76c-49ac-8355-6a9306b5ff37 req-0f012d14-35d0-48d8-a8a7-4f72b4eed30a service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:31.272871 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-6505beed-d76c-49ac-8355-6a9306b5ff37 req-0f012d14-35d0-48d8-a8a7-4f72b4eed30a service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:31.273837 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-6505beed-d76c-49ac-8355-6a9306b5ff37 req-0f012d14-35d0-48d8-a8a7-4f72b4eed30a service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:31.287181 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-6505beed-d76c-49ac-8355-6a9306b5ff37 req-0f012d14-35d0-48d8-a8a7-4f72b4eed30a service nova] Creating event network-vif-deleted:d6726828-5fd6-412a-bd4f-f5918742c962 for instance d0a79872-c316-4bb2-914c-a118831bc023 on n-h2-862769-1 Oct 27 03:25:31.292084 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-6505beed-d76c-49ac-8355-6a9306b5ff37 req-0f012d14-35d0-48d8-a8a7-4f72b4eed30a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040221 Oct 27 03:25:31.293004 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 757/1472] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:25:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:25:31.599329 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e2acf53b-99b6-4a96-b5cd-dd847201bd78 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:31.600209 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e2acf53b-99b6-4a96-b5cd-dd847201bd78 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: e8781053-3dad-4951-b4cb-1f4aaf97e19b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:31.604039 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:25:31.609591 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e2acf53b-99b6-4a96-b5cd-dd847201bd78 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:31.610775 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e2acf53b-99b6-4a96-b5cd-dd847201bd78 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:31.611406 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e2acf53b-99b6-4a96-b5cd-dd847201bd78 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:31.613428 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e2acf53b-99b6-4a96-b5cd-dd847201bd78 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:31.614180 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e2acf53b-99b6-4a96-b5cd-dd847201bd78 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:31.614782 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e2acf53b-99b6-4a96-b5cd-dd847201bd78 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:31.652889 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a6037256-ae17-4da8-b24f-96b128c05aa6 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:31.653592 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a6037256-ae17-4da8-b24f-96b128c05aa6 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: d0a79872-c316-4bb2-914c-a118831bc023] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:31.670753 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a6037256-ae17-4da8-b24f-96b128c05aa6 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:31.673281 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a6037256-ae17-4da8-b24f-96b128c05aa6 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:31.674675 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a6037256-ae17-4da8-b24f-96b128c05aa6 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:31.676800 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a6037256-ae17-4da8-b24f-96b128c05aa6 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:31.678633 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a6037256-ae17-4da8-b24f-96b128c05aa6 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:31.679431 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a6037256-ae17-4da8-b24f-96b128c05aa6 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:31.725995 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a6037256-ae17-4da8-b24f-96b128c05aa6 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:31.730498 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a6037256-ae17-4da8-b24f-96b128c05aa6 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:31.730498 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a6037256-ae17-4da8-b24f-96b128c05aa6 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:31.730498 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-a6037256-ae17-4da8-b24f-96b128c05aa6 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lazy-loading 'fault' on Instance uuid d0a79872-c316-4bb2-914c-a118831bc023 {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:25:31.847743 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e2acf53b-99b6-4a96-b5cd-dd847201bd78 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:31.869165 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e2acf53b-99b6-4a96-b5cd-dd847201bd78 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b" status: 200 len: 1476 microversion: 2.1 time: 0.276056 Oct 27 03:25:31.870172 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 716/1473] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:31 2022] GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b => generated 1476 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:31.879625 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0de80750-03c7-4555-a4b1-138c3236042e tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:31.880496 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0de80750-03c7-4555-a4b1-138c3236042e tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] [instance: 1d9172bd-aa20-4f49-87fa-64300cf861be] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:31.888659 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0de80750-03c7-4555-a4b1-138c3236042e tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:31.889758 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0de80750-03c7-4555-a4b1-138c3236042e tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:31.894146 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0de80750-03c7-4555-a4b1-138c3236042e tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:31.895513 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0de80750-03c7-4555-a4b1-138c3236042e tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:31.896458 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0de80750-03c7-4555-a4b1-138c3236042e tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:31.898523 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0de80750-03c7-4555-a4b1-138c3236042e tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:32.008034 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0de80750-03c7-4555-a4b1-138c3236042e tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c65ddc0af5854d7a89192d01bc5f4576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c57f8e9a0e4debae18d98918ba8c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:32.016724 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0de80750-03c7-4555-a4b1-138c3236042e tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] 10.222.0.20 "GET /compute/v2.1/servers/1d9172bd-aa20-4f49-87fa-64300cf861be" status: 200 len: 1245 microversion: 2.1 time: 0.141249 Oct 27 03:25:32.017381 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 717/1474] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:31 2022] GET /compute/v2.1/servers/1d9172bd-aa20-4f49-87fa-64300cf861be => generated 1245 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:32.143369 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a6037256-ae17-4da8-b24f-96b128c05aa6 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d1351fcb6b4cd08f176e6d0cc5bb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95729a8c8a14361b7cbf8b2b13900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:32.155024 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a6037256-ae17-4da8-b24f-96b128c05aa6 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/d0a79872-c316-4bb2-914c-a118831bc023" status: 200 len: 1306 microversion: 2.1 time: 0.508983 Oct 27 03:25:32.173818 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 758/1475] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:31 2022] GET /compute/v2.1/servers/d0a79872-c316-4bb2-914c-a118831bc023 => generated 1306 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:32.265996 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ec789810-e10e-46a4-921c-745ea4da6c2c tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:32.266796 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ec789810-e10e-46a4-921c-745ea4da6c2c tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 33d5c62a-898f-441b-a1a1-3cb12836755d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:32.274740 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ec789810-e10e-46a4-921c-745ea4da6c2c tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:32.275228 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ec789810-e10e-46a4-921c-745ea4da6c2c tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:32.275667 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ec789810-e10e-46a4-921c-745ea4da6c2c tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:32.276413 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ec789810-e10e-46a4-921c-745ea4da6c2c tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:32.276921 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ec789810-e10e-46a4-921c-745ea4da6c2c tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:32.277742 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ec789810-e10e-46a4-921c-745ea4da6c2c tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:32.286969 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-aa8087e3-a70e-4210-9a51-d44d2ab50f70 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:32.288263 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-aa8087e3-a70e-4210-9a51-d44d2ab50f70 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] [instance: b3e22e1e-77a7-4f06-b099-eee6d631d3c9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:32.297091 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aa8087e3-a70e-4210-9a51-d44d2ab50f70 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:32.297214 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aa8087e3-a70e-4210-9a51-d44d2ab50f70 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:32.297551 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aa8087e3-a70e-4210-9a51-d44d2ab50f70 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:32.298292 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aa8087e3-a70e-4210-9a51-d44d2ab50f70 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:32.299093 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aa8087e3-a70e-4210-9a51-d44d2ab50f70 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:32.299237 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aa8087e3-a70e-4210-9a51-d44d2ab50f70 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:32.390642 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-aa8087e3-a70e-4210-9a51-d44d2ab50f70 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ccd5909fb214f71ad68704019c9e4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d2c150feac4d03966a860ab8bafe00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:32.401400 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-aa8087e3-a70e-4210-9a51-d44d2ab50f70 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] 10.222.0.20 "GET /compute/v2.1/servers/b3e22e1e-77a7-4f06-b099-eee6d631d3c9" status: 200 len: 1279 microversion: 2.1 time: 0.118086 Oct 27 03:25:32.401980 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 759/1476] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:32 2022] GET /compute/v2.1/servers/b3e22e1e-77a7-4f06-b099-eee6d631d3c9 => generated 1279 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:25:32.540640 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ec789810-e10e-46a4-921c-745ea4da6c2c tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:32.550404 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ec789810-e10e-46a4-921c-745ea4da6c2c tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/33d5c62a-898f-441b-a1a1-3cb12836755d" status: 200 len: 1474 microversion: 2.1 time: 0.289279 Oct 27 03:25:32.551543 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 718/1477] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:32 2022] GET /compute/v2.1/servers/33d5c62a-898f-441b-a1a1-3cb12836755d => generated 1474 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:32.587456 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0e8eaed0-138d-430c-95ab-787aab5ea324 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-633284587"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:25:32.590197 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0e8eaed0-138d-430c-95ab-787aab5ea324 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 33d5c62a-898f-441b-a1a1-3cb12836755d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:32.598795 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0e8eaed0-138d-430c-95ab-787aab5ea324 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:32.599936 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0e8eaed0-138d-430c-95ab-787aab5ea324 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:32.600709 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0e8eaed0-138d-430c-95ab-787aab5ea324 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:32.601953 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0e8eaed0-138d-430c-95ab-787aab5ea324 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:32.602820 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0e8eaed0-138d-430c-95ab-787aab5ea324 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:32.603600 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0e8eaed0-138d-430c-95ab-787aab5ea324 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:32.640926 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=100 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:25:32.896590 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-02b46cbe-306c-475d-9bce-3fca98e35ec8 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:32.896590 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-02b46cbe-306c-475d-9bce-3fca98e35ec8 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: e8781053-3dad-4951-b4cb-1f4aaf97e19b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:32.910210 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-02b46cbe-306c-475d-9bce-3fca98e35ec8 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:32.910724 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-02b46cbe-306c-475d-9bce-3fca98e35ec8 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:32.911720 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-02b46cbe-306c-475d-9bce-3fca98e35ec8 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:32.911892 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-02b46cbe-306c-475d-9bce-3fca98e35ec8 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:32.912357 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-02b46cbe-306c-475d-9bce-3fca98e35ec8 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:32.912795 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-02b46cbe-306c-475d-9bce-3fca98e35ec8 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:33.125553 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0e8eaed0-138d-430c-95ab-787aab5ea324 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "POST /compute/v2.1/servers/33d5c62a-898f-441b-a1a1-3cb12836755d/action" status: 202 len: 0 microversion: 2.1 time: 0.544175 Oct 27 03:25:33.128025 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 760/1478] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:25:32 2022] POST /compute/v2.1/servers/33d5c62a-898f-441b-a1a1-3cb12836755d/action => generated 0 bytes in 547 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 27 03:25:33.133822 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-703a5250-c7e0-4c73-a9cf-484ffb7d4ade tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:33.134818 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-703a5250-c7e0-4c73-a9cf-484ffb7d4ade tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] [instance: 1d9172bd-aa20-4f49-87fa-64300cf861be] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:33.150849 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-703a5250-c7e0-4c73-a9cf-484ffb7d4ade tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:33.151279 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-703a5250-c7e0-4c73-a9cf-484ffb7d4ade tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:33.151836 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-703a5250-c7e0-4c73-a9cf-484ffb7d4ade tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:33.176685 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-703a5250-c7e0-4c73-a9cf-484ffb7d4ade tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:33.177234 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-703a5250-c7e0-4c73-a9cf-484ffb7d4ade tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:33.179166 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-703a5250-c7e0-4c73-a9cf-484ffb7d4ade tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:33.222864 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-02b46cbe-306c-475d-9bce-3fca98e35ec8 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:33.239514 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-02b46cbe-306c-475d-9bce-3fca98e35ec8 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b" status: 200 len: 1476 microversion: 2.1 time: 0.349392 Oct 27 03:25:33.240292 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 719/1479] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:32 2022] GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b => generated 1476 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:25:33.253728 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-75dbf535-96a9-4454-a3b8-2475739bf1da tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7ddee4a940>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:33.311305 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-75dbf535-96a9-4454-a3b8-2475739bf1da tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/images/7115c53b-83c1-4282-b3b3-cadb0c0b6d70" status: 200 len: 1413 microversion: 2.1 time: 0.067555 Oct 27 03:25:33.312972 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 720/1480] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:25:33 2022] GET /compute/v2.1/images/7115c53b-83c1-4282-b3b3-cadb0c0b6d70 => generated 1413 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:33.313599 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-703a5250-c7e0-4c73-a9cf-484ffb7d4ade tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c65ddc0af5854d7a89192d01bc5f4576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c57f8e9a0e4debae18d98918ba8c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:33.320398 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b53a9e0c-7a37-48e3-a949-321e1e986aa2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:33.321612 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b53a9e0c-7a37-48e3-a949-321e1e986aa2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] [instance: d0a79872-c316-4bb2-914c-a118831bc023] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:33.325507 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-703a5250-c7e0-4c73-a9cf-484ffb7d4ade tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] 10.222.0.20 "GET /compute/v2.1/servers/1d9172bd-aa20-4f49-87fa-64300cf861be" status: 200 len: 1293 microversion: 2.1 time: 0.196243 Oct 27 03:25:33.338058 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 761/1481] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:33 2022] GET /compute/v2.1/servers/1d9172bd-aa20-4f49-87fa-64300cf861be => generated 1293 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:33.338429 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b53a9e0c-7a37-48e3-a949-321e1e986aa2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:33.338429 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b53a9e0c-7a37-48e3-a949-321e1e986aa2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:33.338429 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b53a9e0c-7a37-48e3-a949-321e1e986aa2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:33.338429 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b53a9e0c-7a37-48e3-a949-321e1e986aa2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:33.338768 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b53a9e0c-7a37-48e3-a949-321e1e986aa2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:33.338768 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b53a9e0c-7a37-48e3-a949-321e1e986aa2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:33.348393 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-b53a9e0c-7a37-48e3-a949-321e1e986aa2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] HTTP exception thrown: Instance d0a79872-c316-4bb2-914c-a118831bc023 could not be found. Oct 27 03:25:33.349806 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b53a9e0c-7a37-48e3-a949-321e1e986aa2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Request method failure captured: Oct 27 03:25:33.349806 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/d0a79872-c316-4bb2-914c-a118831bc023 HTTP/1.1 Oct 27 03:25:33.349806 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:25:33.349806 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:25:33.349806 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:25:33.349806 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:25:33.349806 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:25:33.349806 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:25:33.349806 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:25:33.349806 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:25:33.349806 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWflSNQach9Nb5a-nwpaet3DOMbW4rovpwiSisAjqFscpzZFwT6bcg_up1i76ycL6ujOTUfNYz_zBzvxITJnmbBErQShJ1lwwCzCfbPi_i3gA3nNTv5XKeqZukq5d_laOkT4ryxL3BEyqvlbo-j2kkQUt_sjeDJRyUijGXNWQdhqp_K4 Oct 27 03:25:33.349806 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:25:33.349806 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:25:33.349806 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:25:33.349806 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:25:33.349806 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:25:33.349806 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:25:33.349806 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: b95729a8c8a14361b7cbf8b2b13900b2 Oct 27 03:25:33.349806 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServersOnMultiNodesTest-265997062 Oct 27 03:25:33.349806 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:25:33.349806 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:25:33.351425 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b95729a8c8a14361b7cbf8b2b13900b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b95729a8c8a14361b7cbf8b2b13900b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b95729a8c8a14361b7cbf8b2b13900b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b95729a8c8a14361b7cbf8b2b13900b2"}]}] Oct 27 03:25:33.351425 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServersOnMultiNodesTest-265997062 Oct 27 03:25:33.351425 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: b95729a8c8a14361b7cbf8b2b13900b2 Oct 27 03:25:33.351425 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-265997062 Oct 27 03:25:33.351425 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServersOnMultiNodesTest-265997062-project Oct 27 03:25:33.351425 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:25:33.351425 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:25:33.351425 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 91d1351fcb6b4cd08f176e6d0cc5bb11 Oct 27 03:25:33.351425 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServersOnMultiNodesTest-265997062-project Oct 27 03:25:33.351425 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:25:33.351425 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance d0a79872-c316-4bb2-914c-a118831bc023 could not be found. Oct 27 03:25:33.351425 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': 'd0a79872-c316-4bb2-914c-a118831bc023'} Oct 27 03:25:33.352250 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:25:33.352250 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:25:33.352250 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:25:33.352250 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:25:33.352250 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:25:33.352250 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:25:33.352250 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:25:33.352250 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:25:33.352250 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:25:33.352250 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:25:33.352250 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0a79872-c316-4bb2-914c-a118831bc023 could not be found. Oct 27 03:25:33.352250 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:25:33.352250 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:25:33.352250 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:25:33.352250 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:25:33.352250 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:25:33.352250 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:25:33.352250 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:25:33.352250 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:25:33.352250 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:25:33.353670 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:25:33.353670 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:25:33.353670 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:25:33.353670 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:25:33.353670 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:25:33.353670 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:25:33.353670 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:25:33.353670 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0a79872-c316-4bb2-914c-a118831bc023 could not be found. Oct 27 03:25:33.353670 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:25:33.353670 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:25:33.353670 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:25:33.353670 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:25:33.353670 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:25:33.353670 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:25:33.353670 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:25:33.353670 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:25:33.353670 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0a79872-c316-4bb2-914c-a118831bc023 could not be found. Oct 27 03:25:33.353670 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:25:33.357905 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b53a9e0c-7a37-48e3-a949-321e1e986aa2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] Returning 404 to user: Instance d0a79872-c316-4bb2-914c-a118831bc023 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:25:33.357905 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b53a9e0c-7a37-48e3-a949-321e1e986aa2 tempest-ServersOnMultiNodesTest-265997062 tempest-ServersOnMultiNodesTest-265997062-project] 10.222.0.20 "GET /compute/v2.1/servers/d0a79872-c316-4bb2-914c-a118831bc023" status: 404 len: 111 microversion: 2.1 time: 0.039386 Oct 27 03:25:33.357905 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 721/1482] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:33 2022] GET /compute/v2.1/servers/d0a79872-c316-4bb2-914c-a118831bc023 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:25:33.426676 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-303d33a6-7e43-4158-a136-9dfd5cdbecb9 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:33.427467 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-303d33a6-7e43-4158-a136-9dfd5cdbecb9 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] [instance: b3e22e1e-77a7-4f06-b099-eee6d631d3c9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:33.441618 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-303d33a6-7e43-4158-a136-9dfd5cdbecb9 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:33.446075 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-303d33a6-7e43-4158-a136-9dfd5cdbecb9 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:33.447248 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-303d33a6-7e43-4158-a136-9dfd5cdbecb9 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:33.450846 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-303d33a6-7e43-4158-a136-9dfd5cdbecb9 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:33.451446 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-303d33a6-7e43-4158-a136-9dfd5cdbecb9 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:33.453083 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-303d33a6-7e43-4158-a136-9dfd5cdbecb9 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:33.733769 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-303d33a6-7e43-4158-a136-9dfd5cdbecb9 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ccd5909fb214f71ad68704019c9e4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d2c150feac4d03966a860ab8bafe00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:33.745623 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-303d33a6-7e43-4158-a136-9dfd5cdbecb9 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] 10.222.0.20 "GET /compute/v2.1/servers/b3e22e1e-77a7-4f06-b099-eee6d631d3c9" status: 200 len: 1321 microversion: 2.1 time: 0.324636 Oct 27 03:25:33.756577 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 762/1483] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:33 2022] GET /compute/v2.1/servers/b3e22e1e-77a7-4f06-b099-eee6d631d3c9 => generated 1321 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:34.267094 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5d4118ad-8ec3-4ac8-ad2a-109a1fbd3cb0 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:34.267729 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5d4118ad-8ec3-4ac8-ad2a-109a1fbd3cb0 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: e8781053-3dad-4951-b4cb-1f4aaf97e19b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:34.280385 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5d4118ad-8ec3-4ac8-ad2a-109a1fbd3cb0 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:34.281066 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5d4118ad-8ec3-4ac8-ad2a-109a1fbd3cb0 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:34.281617 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5d4118ad-8ec3-4ac8-ad2a-109a1fbd3cb0 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:34.283204 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5d4118ad-8ec3-4ac8-ad2a-109a1fbd3cb0 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:34.284178 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5d4118ad-8ec3-4ac8-ad2a-109a1fbd3cb0 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:34.285100 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5d4118ad-8ec3-4ac8-ad2a-109a1fbd3cb0 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:34.328987 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d5f1451f-2ded-4c11-95a1-7e4d87579c77 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7ddee3d550>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:34.381275 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d5f1451f-2ded-4c11-95a1-7e4d87579c77 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/images/7115c53b-83c1-4282-b3b3-cadb0c0b6d70" status: 200 len: 1413 microversion: 2.1 time: 0.057512 Oct 27 03:25:34.383383 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 763/1484] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:25:34 2022] GET /compute/v2.1/images/7115c53b-83c1-4282-b3b3-cadb0c0b6d70 => generated 1413 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:25:34.397404 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-fa4df7dc-c7d9-4ab9-a033-4ba398670712 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:34.398081 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-fa4df7dc-c7d9-4ab9-a033-4ba398670712 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] [instance: 1d9172bd-aa20-4f49-87fa-64300cf861be] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:34.405268 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fa4df7dc-c7d9-4ab9-a033-4ba398670712 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:34.405790 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fa4df7dc-c7d9-4ab9-a033-4ba398670712 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:34.406612 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fa4df7dc-c7d9-4ab9-a033-4ba398670712 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:34.407339 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fa4df7dc-c7d9-4ab9-a033-4ba398670712 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:34.407793 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fa4df7dc-c7d9-4ab9-a033-4ba398670712 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:34.408387 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fa4df7dc-c7d9-4ab9-a033-4ba398670712 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:34.504233 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-fa4df7dc-c7d9-4ab9-a033-4ba398670712 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c65ddc0af5854d7a89192d01bc5f4576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c57f8e9a0e4debae18d98918ba8c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:34.512002 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5d4118ad-8ec3-4ac8-ad2a-109a1fbd3cb0 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:34.513136 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-fa4df7dc-c7d9-4ab9-a033-4ba398670712 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] 10.222.0.20 "GET /compute/v2.1/servers/1d9172bd-aa20-4f49-87fa-64300cf861be" status: 200 len: 1299 microversion: 2.1 time: 0.128689 Oct 27 03:25:34.513718 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 764/1485] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:34 2022] GET /compute/v2.1/servers/1d9172bd-aa20-4f49-87fa-64300cf861be => generated 1299 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:34.523627 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5d4118ad-8ec3-4ac8-ad2a-109a1fbd3cb0 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b" status: 200 len: 1476 microversion: 2.1 time: 0.260072 Oct 27 03:25:34.524525 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 722/1486] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:34 2022] GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b => generated 1476 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:34.538175 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-a23dd8ed-ee8f-42e7-9607-f307d88d3ba6 req-cd1d32a7-d062-4c20-afc5-470ca0c612d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3e22e1e-77a7-4f06-b099-eee6d631d3c9", "tag": "60d343b3-3185-46f8-aaa0-ac75ba00f598"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:25:34.549913 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-a23dd8ed-ee8f-42e7-9607-f307d88d3ba6 req-cd1d32a7-d062-4c20-afc5-470ca0c612d8 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:34.550574 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-a23dd8ed-ee8f-42e7-9607-f307d88d3ba6 req-cd1d32a7-d062-4c20-afc5-470ca0c612d8 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:34.551097 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-a23dd8ed-ee8f-42e7-9607-f307d88d3ba6 req-cd1d32a7-d062-4c20-afc5-470ca0c612d8 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:34.565742 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-a23dd8ed-ee8f-42e7-9607-f307d88d3ba6 req-cd1d32a7-d062-4c20-afc5-470ca0c612d8 service nova] Creating event network-changed:60d343b3-3185-46f8-aaa0-ac75ba00f598 for instance b3e22e1e-77a7-4f06-b099-eee6d631d3c9 on n-h2-862769-1 Oct 27 03:25:34.571862 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-a23dd8ed-ee8f-42e7-9607-f307d88d3ba6 req-cd1d32a7-d062-4c20-afc5-470ca0c612d8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037743 Oct 27 03:25:34.572735 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 765/1487] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:25:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:25:34.769969 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1cc693a0-face-4431-8df4-6d827f993a0b tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:34.776156 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1cc693a0-face-4431-8df4-6d827f993a0b tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] [instance: b3e22e1e-77a7-4f06-b099-eee6d631d3c9] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:34.794382 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1cc693a0-face-4431-8df4-6d827f993a0b tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:34.794382 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1cc693a0-face-4431-8df4-6d827f993a0b tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:34.794382 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1cc693a0-face-4431-8df4-6d827f993a0b tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:34.794382 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1cc693a0-face-4431-8df4-6d827f993a0b tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:34.794754 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1cc693a0-face-4431-8df4-6d827f993a0b tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:34.794754 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1cc693a0-face-4431-8df4-6d827f993a0b tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:34.953450 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1cc693a0-face-4431-8df4-6d827f993a0b tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ccd5909fb214f71ad68704019c9e4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d2c150feac4d03966a860ab8bafe00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:34.961630 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1cc693a0-face-4431-8df4-6d827f993a0b tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] 10.222.0.20 "GET /compute/v2.1/servers/b3e22e1e-77a7-4f06-b099-eee6d631d3c9" status: 200 len: 1321 microversion: 2.1 time: 0.196823 Oct 27 03:25:34.962260 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 723/1488] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:34 2022] GET /compute/v2.1/servers/b3e22e1e-77a7-4f06-b099-eee6d631d3c9 => generated 1321 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:35.400973 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-78e2ddc2-078e-4db7-9f14-5ce0cd2618b0 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7ddb4a55e0>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:35.459894 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-78e2ddc2-078e-4db7-9f14-5ce0cd2618b0 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/images/7115c53b-83c1-4282-b3b3-cadb0c0b6d70" status: 200 len: 1413 microversion: 2.1 time: 0.064303 Oct 27 03:25:35.461302 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 766/1489] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:25:35 2022] GET /compute/v2.1/images/7115c53b-83c1-4282-b3b3-cadb0c0b6d70 => generated 1413 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:35.552599 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-29e842a7-428b-4fbd-985f-fae89a368520 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:35.552599 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-29e842a7-428b-4fbd-985f-fae89a368520 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] [instance: 1d9172bd-aa20-4f49-87fa-64300cf861be] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:35.553156 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-02586cb6-acaf-49ea-aa9b-080dd66868ce tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:35.553156 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-02586cb6-acaf-49ea-aa9b-080dd66868ce tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: e8781053-3dad-4951-b4cb-1f4aaf97e19b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:35.553328 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-29e842a7-428b-4fbd-985f-fae89a368520 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:35.553328 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-29e842a7-428b-4fbd-985f-fae89a368520 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:35.553328 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-29e842a7-428b-4fbd-985f-fae89a368520 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:35.553818 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-29e842a7-428b-4fbd-985f-fae89a368520 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:35.554481 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-29e842a7-428b-4fbd-985f-fae89a368520 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:35.555066 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-29e842a7-428b-4fbd-985f-fae89a368520 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:35.558474 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-02586cb6-acaf-49ea-aa9b-080dd66868ce tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:35.559253 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-02586cb6-acaf-49ea-aa9b-080dd66868ce tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:35.559909 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-02586cb6-acaf-49ea-aa9b-080dd66868ce tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:35.560850 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-02586cb6-acaf-49ea-aa9b-080dd66868ce tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:35.561542 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-02586cb6-acaf-49ea-aa9b-080dd66868ce tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:35.562382 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-02586cb6-acaf-49ea-aa9b-080dd66868ce tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:35.776754 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-29e842a7-428b-4fbd-985f-fae89a368520 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c65ddc0af5854d7a89192d01bc5f4576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c57f8e9a0e4debae18d98918ba8c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:35.785350 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-29e842a7-428b-4fbd-985f-fae89a368520 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] 10.222.0.20 "GET /compute/v2.1/servers/1d9172bd-aa20-4f49-87fa-64300cf861be" status: 200 len: 1367 microversion: 2.1 time: 0.244079 Oct 27 03:25:35.802606 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 724/1490] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:35 2022] GET /compute/v2.1/servers/1d9172bd-aa20-4f49-87fa-64300cf861be => generated 1367 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:35.857859 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-02586cb6-acaf-49ea-aa9b-080dd66868ce tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:35.869318 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-02586cb6-acaf-49ea-aa9b-080dd66868ce tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b" status: 200 len: 1476 microversion: 2.1 time: 0.324050 Oct 27 03:25:35.882365 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 767/1491] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:35 2022] GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b => generated 1476 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:35.985578 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-fc090d20-b2d4-44d6-a092-2c5437bb64f4 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:35.986390 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-fc090d20-b2d4-44d6-a092-2c5437bb64f4 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] [instance: b3e22e1e-77a7-4f06-b099-eee6d631d3c9] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:35.993838 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fc090d20-b2d4-44d6-a092-2c5437bb64f4 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:35.994439 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fc090d20-b2d4-44d6-a092-2c5437bb64f4 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:35.994918 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fc090d20-b2d4-44d6-a092-2c5437bb64f4 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:35.995895 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fc090d20-b2d4-44d6-a092-2c5437bb64f4 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:35.996927 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fc090d20-b2d4-44d6-a092-2c5437bb64f4 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:35.997398 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fc090d20-b2d4-44d6-a092-2c5437bb64f4 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:36.139836 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-fc090d20-b2d4-44d6-a092-2c5437bb64f4 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ccd5909fb214f71ad68704019c9e4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d2c150feac4d03966a860ab8bafe00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:36.149295 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-fc090d20-b2d4-44d6-a092-2c5437bb64f4 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] 10.222.0.20 "GET /compute/v2.1/servers/b3e22e1e-77a7-4f06-b099-eee6d631d3c9" status: 200 len: 1321 microversion: 2.1 time: 0.168289 Oct 27 03:25:36.149875 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 725/1492] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:35 2022] GET /compute/v2.1/servers/b3e22e1e-77a7-4f06-b099-eee6d631d3c9 => generated 1321 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:36.481182 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ab498de5-b9ee-4cbf-b97b-0991629a344c tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7dda9238b0>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:36.529660 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ab498de5-b9ee-4cbf-b97b-0991629a344c tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/images/7115c53b-83c1-4282-b3b3-cadb0c0b6d70" status: 200 len: 1413 microversion: 2.1 time: 0.056789 Oct 27 03:25:36.530383 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 768/1493] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:25:36 2022] GET /compute/v2.1/images/7115c53b-83c1-4282-b3b3-cadb0c0b6d70 => generated 1413 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:36.593150 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-e1551b8c-d073-45ce-a4fb-e4b8edf9e1d4 req-1d0fe069-e475-4748-bf37-0d0e69bf939d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d9172bd-aa20-4f49-87fa-64300cf861be", "tag": "7137a87b-6939-4f63-9975-97cc9919bde1"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:25:36.602368 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-e1551b8c-d073-45ce-a4fb-e4b8edf9e1d4 req-1d0fe069-e475-4748-bf37-0d0e69bf939d service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:36.603008 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-e1551b8c-d073-45ce-a4fb-e4b8edf9e1d4 req-1d0fe069-e475-4748-bf37-0d0e69bf939d service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:36.603654 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-e1551b8c-d073-45ce-a4fb-e4b8edf9e1d4 req-1d0fe069-e475-4748-bf37-0d0e69bf939d service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:36.615811 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-e1551b8c-d073-45ce-a4fb-e4b8edf9e1d4 req-1d0fe069-e475-4748-bf37-0d0e69bf939d service nova] Creating event network-changed:7137a87b-6939-4f63-9975-97cc9919bde1 for instance 1d9172bd-aa20-4f49-87fa-64300cf861be on n-h1-862769-1 Oct 27 03:25:36.622077 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-e1551b8c-d073-45ce-a4fb-e4b8edf9e1d4 req-1d0fe069-e475-4748-bf37-0d0e69bf939d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035458 Oct 27 03:25:36.622697 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 726/1494] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:25:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:25:36.809072 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-442ebf0b-956b-407d-be0b-207e8190921e tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:36.810664 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-442ebf0b-956b-407d-be0b-207e8190921e tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] [instance: 1d9172bd-aa20-4f49-87fa-64300cf861be] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:36.818836 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-442ebf0b-956b-407d-be0b-207e8190921e tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:36.819568 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-442ebf0b-956b-407d-be0b-207e8190921e tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:36.827055 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-442ebf0b-956b-407d-be0b-207e8190921e tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:36.827055 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-442ebf0b-956b-407d-be0b-207e8190921e tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:36.827055 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-442ebf0b-956b-407d-be0b-207e8190921e tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:36.827055 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-442ebf0b-956b-407d-be0b-207e8190921e tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:36.893289 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-72ac55d3-f90c-4b03-8b0a-64c73fd7b002 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:36.894003 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-72ac55d3-f90c-4b03-8b0a-64c73fd7b002 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: e8781053-3dad-4951-b4cb-1f4aaf97e19b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:36.901022 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-72ac55d3-f90c-4b03-8b0a-64c73fd7b002 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:36.901543 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-72ac55d3-f90c-4b03-8b0a-64c73fd7b002 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:36.901971 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-72ac55d3-f90c-4b03-8b0a-64c73fd7b002 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:36.902720 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-72ac55d3-f90c-4b03-8b0a-64c73fd7b002 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:36.903182 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-72ac55d3-f90c-4b03-8b0a-64c73fd7b002 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:36.903613 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-72ac55d3-f90c-4b03-8b0a-64c73fd7b002 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:37.052632 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-442ebf0b-956b-407d-be0b-207e8190921e tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c65ddc0af5854d7a89192d01bc5f4576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c57f8e9a0e4debae18d98918ba8c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:37.060535 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-442ebf0b-956b-407d-be0b-207e8190921e tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] 10.222.0.20 "GET /compute/v2.1/servers/1d9172bd-aa20-4f49-87fa-64300cf861be" status: 200 len: 1367 microversion: 2.1 time: 0.255684 Oct 27 03:25:37.061117 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 769/1495] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:36 2022] GET /compute/v2.1/servers/1d9172bd-aa20-4f49-87fa-64300cf861be => generated 1367 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:37.129173 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-72ac55d3-f90c-4b03-8b0a-64c73fd7b002 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:37.143444 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-72ac55d3-f90c-4b03-8b0a-64c73fd7b002 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b" status: 200 len: 1476 microversion: 2.1 time: 0.253654 Oct 27 03:25:37.145199 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 727/1496] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:36 2022] GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b => generated 1476 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:25:37.175062 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-aa134056-2014-405b-b409-12ac542a0a06 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:37.175741 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-aa134056-2014-405b-b409-12ac542a0a06 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] [instance: b3e22e1e-77a7-4f06-b099-eee6d631d3c9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:37.185012 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aa134056-2014-405b-b409-12ac542a0a06 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:37.185507 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aa134056-2014-405b-b409-12ac542a0a06 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:37.185950 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aa134056-2014-405b-b409-12ac542a0a06 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:37.186693 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aa134056-2014-405b-b409-12ac542a0a06 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:37.187135 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aa134056-2014-405b-b409-12ac542a0a06 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:37.193667 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aa134056-2014-405b-b409-12ac542a0a06 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:37.345935 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-aa134056-2014-405b-b409-12ac542a0a06 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ccd5909fb214f71ad68704019c9e4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d2c150feac4d03966a860ab8bafe00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:37.352179 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-aa134056-2014-405b-b409-12ac542a0a06 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] 10.222.0.20 "GET /compute/v2.1/servers/b3e22e1e-77a7-4f06-b099-eee6d631d3c9" status: 200 len: 1321 microversion: 2.1 time: 0.182925 Oct 27 03:25:37.352776 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 770/1497] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:37 2022] GET /compute/v2.1/servers/b3e22e1e-77a7-4f06-b099-eee6d631d3c9 => generated 1321 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:37.544691 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2b63e9e0-0feb-49df-9b7b-7cf78956eef7 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7ddab7a550>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:37.589144 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2b63e9e0-0feb-49df-9b7b-7cf78956eef7 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/images/7115c53b-83c1-4282-b3b3-cadb0c0b6d70" status: 200 len: 1413 microversion: 2.1 time: 0.048210 Oct 27 03:25:37.589736 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 728/1498] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:25:37 2022] GET /compute/v2.1/images/7115c53b-83c1-4282-b3b3-cadb0c0b6d70 => generated 1413 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:38.075203 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=6 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:25:38.090983 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-186ce9cf-c2ba-4dbb-acc9-d202ee449216 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:38.092415 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-186ce9cf-c2ba-4dbb-acc9-d202ee449216 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] [instance: 1d9172bd-aa20-4f49-87fa-64300cf861be] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:38.102263 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-186ce9cf-c2ba-4dbb-acc9-d202ee449216 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:38.103327 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-186ce9cf-c2ba-4dbb-acc9-d202ee449216 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:38.103961 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-186ce9cf-c2ba-4dbb-acc9-d202ee449216 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:38.104864 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-186ce9cf-c2ba-4dbb-acc9-d202ee449216 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:38.105479 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-186ce9cf-c2ba-4dbb-acc9-d202ee449216 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:38.106105 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-186ce9cf-c2ba-4dbb-acc9-d202ee449216 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:38.275819 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1e03fe91-43c7-4ffc-85aa-93d3e5283723 tempest-FlavorsExtraSpecsNegativeTestJSON-104711146 tempest-FlavorsExtraSpecsNegativeTestJSON-104711146-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-778780062", "ram": 512, "vcpus": 1, "disk": 10, "id": 594127456, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:25:38.351696 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-186ce9cf-c2ba-4dbb-acc9-d202ee449216 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c65ddc0af5854d7a89192d01bc5f4576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c57f8e9a0e4debae18d98918ba8c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:38.363596 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-186ce9cf-c2ba-4dbb-acc9-d202ee449216 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] 10.222.0.20 "GET /compute/v2.1/servers/1d9172bd-aa20-4f49-87fa-64300cf861be" status: 200 len: 1367 microversion: 2.1 time: 0.278121 Oct 27 03:25:38.367630 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 729/1499] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:38 2022] GET /compute/v2.1/servers/1d9172bd-aa20-4f49-87fa-64300cf861be => generated 1367 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:38.382188 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-cf45318a-430f-44da-8efd-a1006e884eab tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:38.382418 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1e03fe91-43c7-4ffc-85aa-93d3e5283723 tempest-FlavorsExtraSpecsNegativeTestJSON-104711146 tempest-FlavorsExtraSpecsNegativeTestJSON-104711146-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.312461 Oct 27 03:25:38.383959 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-cf45318a-430f-44da-8efd-a1006e884eab tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: e8781053-3dad-4951-b4cb-1f4aaf97e19b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:38.392532 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 771/1500] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:25:38 2022] POST /compute/v2.1/flavors => generated 412 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:25:38.397029 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cf45318a-430f-44da-8efd-a1006e884eab tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:38.399033 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-792b536b-708d-4873-91b2-f850a385f01f tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:38.399487 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cf45318a-430f-44da-8efd-a1006e884eab tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:38.400087 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cf45318a-430f-44da-8efd-a1006e884eab tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:38.400509 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-792b536b-708d-4873-91b2-f850a385f01f tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] [instance: b3e22e1e-77a7-4f06-b099-eee6d631d3c9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:38.401321 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cf45318a-430f-44da-8efd-a1006e884eab tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:38.402981 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cf45318a-430f-44da-8efd-a1006e884eab tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:38.409434 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cf45318a-430f-44da-8efd-a1006e884eab tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:38.409557 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-792b536b-708d-4873-91b2-f850a385f01f tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:38.409557 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-792b536b-708d-4873-91b2-f850a385f01f tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:38.409720 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-792b536b-708d-4873-91b2-f850a385f01f tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:38.410681 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-792b536b-708d-4873-91b2-f850a385f01f tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:38.412711 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-792b536b-708d-4873-91b2-f850a385f01f tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:38.413368 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-792b536b-708d-4873-91b2-f850a385f01f tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:38.697767 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-cf45318a-430f-44da-8efd-a1006e884eab tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:38.706589 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-cf45318a-430f-44da-8efd-a1006e884eab tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b" status: 200 len: 1476 microversion: 2.1 time: 0.335536 Oct 27 03:25:38.707156 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 730/1501] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:38 2022] GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b => generated 1476 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:38.754188 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-792b536b-708d-4873-91b2-f850a385f01f tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ccd5909fb214f71ad68704019c9e4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d2c150feac4d03966a860ab8bafe00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:38.796483 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-792b536b-708d-4873-91b2-f850a385f01f tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] 10.222.0.20 "GET /compute/v2.1/servers/b3e22e1e-77a7-4f06-b099-eee6d631d3c9" status: 200 len: 1321 microversion: 2.1 time: 0.401998 Oct 27 03:25:38.798879 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 772/1502] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:38 2022] GET /compute/v2.1/servers/b3e22e1e-77a7-4f06-b099-eee6d631d3c9 => generated 1321 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:38.806677 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-efc072fe-e270-4809-820f-cd6b350e238f tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7ddedefa60>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:38.877919 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-efc072fe-e270-4809-820f-cd6b350e238f tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/images/7115c53b-83c1-4282-b3b3-cadb0c0b6d70" status: 200 len: 1413 microversion: 2.1 time: 0.076597 Oct 27 03:25:38.881630 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 773/1503] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:25:38 2022] GET /compute/v2.1/images/7115c53b-83c1-4282-b3b3-cadb0c0b6d70 => generated 1413 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:38.916804 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-07e23286-8543-4518-8df9-07a057af6c5c tempest-FlavorsExtraSpecsNegativeTestJSON-1756987603 tempest-FlavorsExtraSpecsNegativeTestJSON-1756987603-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:38.931577 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-07e23286-8543-4518-8df9-07a057af6c5c tempest-FlavorsExtraSpecsNegativeTestJSON-1756987603 tempest-FlavorsExtraSpecsNegativeTestJSON-1756987603-project] HTTP exception thrown: Flavor 594127456 has no extra specs with key hw:cpu_thread_policy. Oct 27 03:25:38.945010 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-07e23286-8543-4518-8df9-07a057af6c5c tempest-FlavorsExtraSpecsNegativeTestJSON-1756987603 tempest-FlavorsExtraSpecsNegativeTestJSON-1756987603-project] Request method failure captured: Oct 27 03:25:38.945010 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/flavors/594127456/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 27 03:25:38.945010 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:25:38.945010 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:25:38.945010 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:25:38.945010 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:25:38.945010 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:25:38.945010 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:25:38.945010 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:25:38.945010 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:25:38.945010 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfoxFi_XNZLV2yzZEhBjVf7d7Qvk-ud3vWuKZtmAhYB7vpi2D-nys2GYJdOtDdBkqfRlLLSV6nhAd1gh8_GcH5KlatKemNH76bJo0U0CzTfGdjSU_vTLzxWcoWUNe_UddZ3y85UXlgtpp6hXDMt5bHYxTr-ICUvdIHQThfEcqhdEJpc Oct 27 03:25:38.945010 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:25:38.945010 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:25:38.945010 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:25:38.945010 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:25:38.945010 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:25:38.945010 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:25:38.945010 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: fff3d7ff6ef44232aeaff789bbd38c51 Oct 27 03:25:38.945010 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1756987603 Oct 27 03:25:38.945010 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:25:38.945010 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:25:38.946648 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fff3d7ff6ef44232aeaff789bbd38c51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fff3d7ff6ef44232aeaff789bbd38c51"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fff3d7ff6ef44232aeaff789bbd38c51"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fff3d7ff6ef44232aeaff789bbd38c51"}]}] Oct 27 03:25:38.946648 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1756987603 Oct 27 03:25:38.946648 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: fff3d7ff6ef44232aeaff789bbd38c51 Oct 27 03:25:38.946648 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1756987603 Oct 27 03:25:38.946648 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1756987603-project Oct 27 03:25:38.946648 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:25:38.946648 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:25:38.946648 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 6944304c03aa4000a99e11107cb78cf9 Oct 27 03:25:38.946648 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1756987603-project Oct 27 03:25:38.946648 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:25:38.946648 n-d-862769-1 devstack@n-api.service[121001]: exception: Flavor 594127456 has no extra specs with key hw:cpu_thread_policy. Oct 27 03:25:38.947351 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'flavor_id': '594127456', 'id': 'hw:cpu_thread_policy'} Oct 27 03:25:38.947351 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:25:38.947351 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:25:38.947351 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Oct 27 03:25:38.947351 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Oct 27 03:25:38.947351 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 27 03:25:38.947351 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:25:38.947351 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:25:38.947351 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:25:38.947351 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:25:38.947351 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:25:38.947351 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:25:38.947351 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:25:38.947351 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:25:38.947351 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:25:38.947351 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:25:38.947351 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Oct 27 03:25:38.947351 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 27 03:25:38.947351 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 594127456 has no extra specs with key hw:cpu_thread_policy. Oct 27 03:25:38.947351 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:25:38.947351 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:25:38.947351 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:25:38.948746 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:25:38.948746 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:25:38.948746 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:25:38.948746 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:25:38.948746 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:25:38.948746 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 594127456 has no extra specs with key hw:cpu_thread_policy. Oct 27 03:25:38.948746 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:25:38.950486 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-07e23286-8543-4518-8df9-07a057af6c5c tempest-FlavorsExtraSpecsNegativeTestJSON-1756987603 tempest-FlavorsExtraSpecsNegativeTestJSON-1756987603-project] Returning 404 to user: Flavor 594127456 has no extra specs with key hw:cpu_thread_policy. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:25:38.951600 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-07e23286-8543-4518-8df9-07a057af6c5c tempest-FlavorsExtraSpecsNegativeTestJSON-1756987603 tempest-FlavorsExtraSpecsNegativeTestJSON-1756987603-project] 10.222.0.20 "GET /compute/v2.1/flavors/594127456/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.230130 Oct 27 03:25:38.952469 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 731/1504] 10.222.0.20 () {58 vars in 1263 bytes} [Thu Oct 27 03:25:38 2022] GET /compute/v2.1/flavors/594127456/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 242 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:25:38.962894 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e1908e1b-1c3a-47fb-8420-95343fc439f9 tempest-FlavorsExtraSpecsNegativeTestJSON-1756987603 tempest-FlavorsExtraSpecsNegativeTestJSON-1756987603-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:25:38.970965 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e1908e1b-1c3a-47fb-8420-95343fc439f9 tempest-FlavorsExtraSpecsNegativeTestJSON-1756987603 tempest-FlavorsExtraSpecsNegativeTestJSON-1756987603-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '6944304c03aa4000a99e11107cb78cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff3d7ff6ef44232aeaff789bbd38c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:38.978620 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e1908e1b-1c3a-47fb-8420-95343fc439f9 tempest-FlavorsExtraSpecsNegativeTestJSON-1756987603 tempest-FlavorsExtraSpecsNegativeTestJSON-1756987603-project] Request method failure captured: Oct 27 03:25:38.978620 n-d-862769-1 devstack@n-api.service[121000]: request: POST /compute/v2.1/flavors/594127456/os-extra_specs HTTP/1.1 Oct 27 03:25:38.978620 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:25:38.978620 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:25:38.978620 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:25:38.978620 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 66 Oct 27 03:25:38.978620 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:25:38.978620 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:25:38.978620 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:25:38.978620 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:25:38.978620 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfoxFi_XNZLV2yzZEhBjVf7d7Qvk-ud3vWuKZtmAhYB7vpi2D-nys2GYJdOtDdBkqfRlLLSV6nhAd1gh8_GcH5KlatKemNH76bJo0U0CzTfGdjSU_vTLzxWcoWUNe_UddZ3y85UXlgtpp6hXDMt5bHYxTr-ICUvdIHQThfEcqhdEJpc Oct 27 03:25:38.978620 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:25:38.978620 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:25:38.978620 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:25:38.978620 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:25:38.978620 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:25:38.978620 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:25:38.978620 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: fff3d7ff6ef44232aeaff789bbd38c51 Oct 27 03:25:38.978620 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1756987603 Oct 27 03:25:38.978620 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:25:38.978620 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:25:38.980008 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fff3d7ff6ef44232aeaff789bbd38c51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fff3d7ff6ef44232aeaff789bbd38c51"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fff3d7ff6ef44232aeaff789bbd38c51"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fff3d7ff6ef44232aeaff789bbd38c51"}]}] Oct 27 03:25:38.980008 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1756987603 Oct 27 03:25:38.980008 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: fff3d7ff6ef44232aeaff789bbd38c51 Oct 27 03:25:38.980008 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1756987603 Oct 27 03:25:38.980008 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1756987603-project Oct 27 03:25:38.980008 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:25:38.980008 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:25:38.980008 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 6944304c03aa4000a99e11107cb78cf9 Oct 27 03:25:38.980008 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1756987603-project Oct 27 03:25:38.980008 n-d-862769-1 devstack@n-api.service[121000]: Oct 27 03:25:38.980008 n-d-862769-1 devstack@n-api.service[121000]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Oct 27 03:25:38.980008 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:25:38.980738 n-d-862769-1 devstack@n-api.service[121000]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 27 03:25:38.980738 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'flavor_id': '594127456', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Oct 27 03:25:38.980738 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:25:38.980738 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:25:38.980738 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:25:38.980738 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:25:38.980738 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:25:38.980738 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:25:38.980738 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:25:38.980738 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:25:38.980738 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:25:38.980738 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:25:38.980738 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Oct 27 03:25:38.980738 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Oct 27 03:25:38.980738 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 03:25:38.980738 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 03:25:38.980738 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 03:25:38.980738 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 03:25:38.980738 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 03:25:38.981923 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 03:25:38.981923 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 03:25:38.981923 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 03:25:38.981923 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 03:25:38.981923 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 03:25:38.981923 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 03:25:38.981923 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 03:25:38.981923 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 03:25:38.981923 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 03:25:38.981923 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 27 03:25:38.981923 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:25:38.981923 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:25:38.981923 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:25:38.981923 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:25:38.981923 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:25:38.981923 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:25:38.981923 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 03:25:38.981923 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 03:25:38.981923 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 27 03:25:38.981923 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:25:38.984636 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e1908e1b-1c3a-47fb-8420-95343fc439f9 tempest-FlavorsExtraSpecsNegativeTestJSON-1756987603 tempest-FlavorsExtraSpecsNegativeTestJSON-1756987603-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:25:38.984636 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e1908e1b-1c3a-47fb-8420-95343fc439f9 tempest-FlavorsExtraSpecsNegativeTestJSON-1756987603 tempest-FlavorsExtraSpecsNegativeTestJSON-1756987603-project] 10.222.0.20 "POST /compute/v2.1/flavors/594127456/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.021523 Oct 27 03:25:38.984636 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 774/1505] 10.222.0.20 () {60 vars in 1221 bytes} [Thu Oct 27 03:25:38 2022] POST /compute/v2.1/flavors/594127456/os-extra_specs => generated 124 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:25:38.992839 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-33b6fe97-39a2-4ba0-9899-81330c6bc69f tempest-FlavorsExtraSpecsNegativeTestJSON-104711146 tempest-FlavorsExtraSpecsNegativeTestJSON-104711146-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:25:39.081568 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-33b6fe97-39a2-4ba0-9899-81330c6bc69f tempest-FlavorsExtraSpecsNegativeTestJSON-104711146 tempest-FlavorsExtraSpecsNegativeTestJSON-104711146-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/594127456/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.095151 Oct 27 03:25:39.092657 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 732/1506] 10.222.0.20 () {60 vars in 1221 bytes} [Thu Oct 27 03:25:38 2022] POST /compute/v2.1/flavors/594127456/os-extra_specs => generated 66 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 03:25:39.105058 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9845e0c0-a172-4f45-ba32-5e644f68c9a2 tempest-FlavorsExtraSpecsNegativeTestJSON-1756987603 tempest-FlavorsExtraSpecsNegativeTestJSON-1756987603-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:39.106658 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9845e0c0-a172-4f45-ba32-5e644f68c9a2 tempest-FlavorsExtraSpecsNegativeTestJSON-1756987603 tempest-FlavorsExtraSpecsNegativeTestJSON-1756987603-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '6944304c03aa4000a99e11107cb78cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff3d7ff6ef44232aeaff789bbd38c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:39.108443 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9845e0c0-a172-4f45-ba32-5e644f68c9a2 tempest-FlavorsExtraSpecsNegativeTestJSON-1756987603 tempest-FlavorsExtraSpecsNegativeTestJSON-1756987603-project] Request method failure captured: Oct 27 03:25:39.108443 n-d-862769-1 devstack@n-api.service[121000]: request: DELETE /compute/v2.1/flavors/594127456/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 27 03:25:39.108443 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:25:39.108443 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:25:39.108443 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:25:39.108443 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:25:39.108443 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:25:39.108443 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:25:39.108443 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:25:39.108443 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:25:39.108443 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfoxFi_XNZLV2yzZEhBjVf7d7Qvk-ud3vWuKZtmAhYB7vpi2D-nys2GYJdOtDdBkqfRlLLSV6nhAd1gh8_GcH5KlatKemNH76bJo0U0CzTfGdjSU_vTLzxWcoWUNe_UddZ3y85UXlgtpp6hXDMt5bHYxTr-ICUvdIHQThfEcqhdEJpc Oct 27 03:25:39.108443 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:25:39.108443 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:25:39.108443 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:25:39.108443 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:25:39.108443 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:25:39.108443 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:25:39.108443 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: fff3d7ff6ef44232aeaff789bbd38c51 Oct 27 03:25:39.108443 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1756987603 Oct 27 03:25:39.108443 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:25:39.108443 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:25:39.110003 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fff3d7ff6ef44232aeaff789bbd38c51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fff3d7ff6ef44232aeaff789bbd38c51"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fff3d7ff6ef44232aeaff789bbd38c51"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fff3d7ff6ef44232aeaff789bbd38c51"}]}] Oct 27 03:25:39.110003 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1756987603 Oct 27 03:25:39.110003 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: fff3d7ff6ef44232aeaff789bbd38c51 Oct 27 03:25:39.110003 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1756987603 Oct 27 03:25:39.110003 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1756987603-project Oct 27 03:25:39.110003 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:25:39.110003 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:25:39.110003 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 6944304c03aa4000a99e11107cb78cf9 Oct 27 03:25:39.110003 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1756987603-project Oct 27 03:25:39.110003 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:25:39.110003 n-d-862769-1 devstack@n-api.service[121000]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 27 03:25:39.119714 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'flavor_id': '594127456', 'id': 'hw:numa_nodes'} Oct 27 03:25:39.119714 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:25:39.119714 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:25:39.119714 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:25:39.119714 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:25:39.119714 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:25:39.119714 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:25:39.119714 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:25:39.119714 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:25:39.119714 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Oct 27 03:25:39.119714 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Oct 27 03:25:39.119714 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 03:25:39.119714 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 03:25:39.119714 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 03:25:39.119714 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 03:25:39.119714 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 03:25:39.119714 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 03:25:39.119714 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 03:25:39.119714 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 03:25:39.119714 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 03:25:39.123453 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 03:25:39.123453 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 03:25:39.123453 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 03:25:39.123453 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 03:25:39.123453 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 03:25:39.123453 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 27 03:25:39.123453 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:25:39.123453 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:25:39.123453 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:25:39.123453 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:25:39.123453 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:25:39.123453 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:25:39.123453 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 03:25:39.123453 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 03:25:39.123453 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 27 03:25:39.123453 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:25:39.123453 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9845e0c0-a172-4f45-ba32-5e644f68c9a2 tempest-FlavorsExtraSpecsNegativeTestJSON-1756987603 tempest-FlavorsExtraSpecsNegativeTestJSON-1756987603-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:25:39.124653 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9845e0c0-a172-4f45-ba32-5e644f68c9a2 tempest-FlavorsExtraSpecsNegativeTestJSON-1756987603 tempest-FlavorsExtraSpecsNegativeTestJSON-1756987603-project] 10.222.0.20 "DELETE /compute/v2.1/flavors/594127456/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.013954 Oct 27 03:25:39.124653 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 775/1507] 10.222.0.20 () {58 vars in 1245 bytes} [Thu Oct 27 03:25:39 2022] DELETE /compute/v2.1/flavors/594127456/os-extra_specs/hw:numa_nodes => generated 124 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:25:39.127221 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a8c5914d-adca-4230-999a-e94e44657ecd tempest-FlavorsExtraSpecsNegativeTestJSON-104711146 tempest-FlavorsExtraSpecsNegativeTestJSON-104711146-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:25:39.159253 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a8c5914d-adca-4230-999a-e94e44657ecd tempest-FlavorsExtraSpecsNegativeTestJSON-104711146 tempest-FlavorsExtraSpecsNegativeTestJSON-104711146-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/594127456/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.035332 Oct 27 03:25:39.161753 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 733/1508] 10.222.0.20 () {60 vars in 1221 bytes} [Thu Oct 27 03:25:39 2022] POST /compute/v2.1/flavors/594127456/os-extra_specs => generated 66 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 03:25:39.173892 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6246762c-49b3-4811-8a58-ddd1e8eccd8e tempest-FlavorsExtraSpecsNegativeTestJSON-1756987603 tempest-FlavorsExtraSpecsNegativeTestJSON-1756987603-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:25:39.178173 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-6246762c-49b3-4811-8a58-ddd1e8eccd8e tempest-FlavorsExtraSpecsNegativeTestJSON-1756987603 tempest-FlavorsExtraSpecsNegativeTestJSON-1756987603-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '6944304c03aa4000a99e11107cb78cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff3d7ff6ef44232aeaff789bbd38c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:39.179989 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6246762c-49b3-4811-8a58-ddd1e8eccd8e tempest-FlavorsExtraSpecsNegativeTestJSON-1756987603 tempest-FlavorsExtraSpecsNegativeTestJSON-1756987603-project] Request method failure captured: Oct 27 03:25:39.179989 n-d-862769-1 devstack@n-api.service[121000]: request: PUT /compute/v2.1/flavors/594127456/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 27 03:25:39.179989 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:25:39.179989 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:25:39.179989 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:25:39.179989 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 22 Oct 27 03:25:39.179989 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:25:39.179989 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:25:39.179989 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:25:39.179989 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:25:39.179989 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfoxFi_XNZLV2yzZEhBjVf7d7Qvk-ud3vWuKZtmAhYB7vpi2D-nys2GYJdOtDdBkqfRlLLSV6nhAd1gh8_GcH5KlatKemNH76bJo0U0CzTfGdjSU_vTLzxWcoWUNe_UddZ3y85UXlgtpp6hXDMt5bHYxTr-ICUvdIHQThfEcqhdEJpc Oct 27 03:25:39.179989 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:25:39.179989 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:25:39.179989 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:25:39.179989 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:25:39.179989 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:25:39.179989 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:25:39.179989 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: fff3d7ff6ef44232aeaff789bbd38c51 Oct 27 03:25:39.179989 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1756987603 Oct 27 03:25:39.179989 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:25:39.179989 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:25:39.181369 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fff3d7ff6ef44232aeaff789bbd38c51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fff3d7ff6ef44232aeaff789bbd38c51"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fff3d7ff6ef44232aeaff789bbd38c51"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fff3d7ff6ef44232aeaff789bbd38c51"}]}] Oct 27 03:25:39.181369 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1756987603 Oct 27 03:25:39.181369 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: fff3d7ff6ef44232aeaff789bbd38c51 Oct 27 03:25:39.181369 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1756987603 Oct 27 03:25:39.181369 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1756987603-project Oct 27 03:25:39.181369 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:25:39.181369 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:25:39.181369 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 6944304c03aa4000a99e11107cb78cf9 Oct 27 03:25:39.181369 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1756987603-project Oct 27 03:25:39.181369 n-d-862769-1 devstack@n-api.service[121000]: Oct 27 03:25:39.181369 n-d-862769-1 devstack@n-api.service[121000]: {"hw:numa_nodes": "1"} Oct 27 03:25:39.181369 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:25:39.181369 n-d-862769-1 devstack@n-api.service[121000]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 27 03:25:39.188002 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'flavor_id': '594127456', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Oct 27 03:25:39.188002 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:25:39.188002 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:25:39.188002 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:25:39.188002 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:25:39.188002 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:25:39.188002 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:25:39.188002 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:25:39.188002 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:25:39.188002 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:25:39.188002 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:25:39.188002 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Oct 27 03:25:39.188002 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Oct 27 03:25:39.188002 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 03:25:39.188002 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 03:25:39.188002 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 03:25:39.188002 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 03:25:39.188002 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 03:25:39.188002 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 03:25:39.189184 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 03:25:39.189184 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 03:25:39.189184 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 03:25:39.189184 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 03:25:39.189184 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 03:25:39.189184 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 03:25:39.189184 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 03:25:39.189184 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 03:25:39.189184 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 27 03:25:39.189184 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:25:39.189184 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:25:39.189184 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:25:39.189184 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:25:39.189184 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:25:39.189184 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:25:39.189184 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 03:25:39.189184 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 03:25:39.189184 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 27 03:25:39.189184 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:25:39.191619 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6246762c-49b3-4811-8a58-ddd1e8eccd8e tempest-FlavorsExtraSpecsNegativeTestJSON-1756987603 tempest-FlavorsExtraSpecsNegativeTestJSON-1756987603-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:25:39.191619 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6246762c-49b3-4811-8a58-ddd1e8eccd8e tempest-FlavorsExtraSpecsNegativeTestJSON-1756987603 tempest-FlavorsExtraSpecsNegativeTestJSON-1756987603-project] 10.222.0.20 "PUT /compute/v2.1/flavors/594127456/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.014624 Oct 27 03:25:39.191619 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 776/1509] 10.222.0.20 () {60 vars in 1262 bytes} [Thu Oct 27 03:25:39 2022] PUT /compute/v2.1/flavors/594127456/os-extra_specs/hw:numa_nodes => generated 124 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:25:39.197260 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e1b160a8-0408-47d6-9769-5be43ba890e3 tempest-FlavorsExtraSpecsNegativeTestJSON-104711146 tempest-FlavorsExtraSpecsNegativeTestJSON-104711146-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:39.213449 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-e1b160a8-0408-47d6-9769-5be43ba890e3 tempest-FlavorsExtraSpecsNegativeTestJSON-104711146 tempest-FlavorsExtraSpecsNegativeTestJSON-104711146-project-admin] HTTP exception thrown: Flavor 594127456 has no extra specs with key hw:cpu_thread_policy. Oct 27 03:25:39.216531 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e1b160a8-0408-47d6-9769-5be43ba890e3 tempest-FlavorsExtraSpecsNegativeTestJSON-104711146 tempest-FlavorsExtraSpecsNegativeTestJSON-104711146-project-admin] Request method failure captured: Oct 27 03:25:39.216531 n-d-862769-1 devstack@n-api.service[121001]: request: DELETE /compute/v2.1/flavors/594127456/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 27 03:25:39.216531 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:25:39.216531 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:25:39.216531 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:25:39.216531 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:25:39.216531 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:25:39.216531 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:25:39.216531 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:25:39.216531 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:25:39.216531 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfoxuXqSz7usPnH4sPgqTGoEiyM0z9Al3DqLcvxsVVmj9EUmrnE8CO89XJhj-9y7vqS1Vz9MQFjz2ISDwvGlg6811Ps4eu4O04cDe9Nun5j_XmnU9f7eiIviZ6vVcw9eBe4wVP6iTBZhqM0e0yVR_yeDbwt_ciXFKgoJvjz_R74Rwps Oct 27 03:25:39.216531 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:25:39.216531 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:25:39.216531 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:25:39.216531 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:25:39.216531 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:25:39.216531 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:25:39.216531 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 9fe4fc63063b4d8b9ae8e47dd20423de Oct 27 03:25:39.216531 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-104711146 Oct 27 03:25:39.216531 n-d-862769-1 devstack@n-api.service[121001]: X-Role: admin,member,reader Oct 27 03:25:39.216531 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: admin,member,reader Oct 27 03:25:39.217837 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9fe4fc63063b4d8b9ae8e47dd20423de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9fe4fc63063b4d8b9ae8e47dd20423de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9fe4fc63063b4d8b9ae8e47dd20423de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9fe4fc63063b4d8b9ae8e47dd20423de"}]}] Oct 27 03:25:39.217837 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-104711146 Oct 27 03:25:39.217837 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 9fe4fc63063b4d8b9ae8e47dd20423de Oct 27 03:25:39.217837 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-104711146 Oct 27 03:25:39.217837 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-104711146-project-admin Oct 27 03:25:39.217837 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:25:39.217837 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:25:39.217837 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: e961803e22ea4bfab2eb4b0c9cef2c24 Oct 27 03:25:39.217837 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-104711146-project-admin Oct 27 03:25:39.217837 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:25:39.217837 n-d-862769-1 devstack@n-api.service[121001]: exception: Flavor 594127456 has no extra specs with key hw:cpu_thread_policy. Oct 27 03:25:39.218562 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'flavor_id': '594127456', 'id': 'hw:cpu_thread_policy'} Oct 27 03:25:39.218562 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:25:39.218562 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:25:39.218562 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Oct 27 03:25:39.218562 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Oct 27 03:25:39.218562 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 27 03:25:39.218562 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:25:39.218562 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:25:39.218562 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:25:39.218562 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:25:39.218562 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:25:39.218562 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:25:39.218562 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:25:39.218562 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:25:39.218562 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:25:39.218562 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:25:39.218562 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Oct 27 03:25:39.218562 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 27 03:25:39.218562 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 594127456 has no extra specs with key hw:cpu_thread_policy. Oct 27 03:25:39.218562 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:25:39.218562 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:25:39.218562 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:25:39.219859 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:25:39.219859 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:25:39.219859 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:25:39.219859 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:25:39.219859 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:25:39.219859 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 594127456 has no extra specs with key hw:cpu_thread_policy. Oct 27 03:25:39.219859 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:25:39.219859 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e1b160a8-0408-47d6-9769-5be43ba890e3 tempest-FlavorsExtraSpecsNegativeTestJSON-104711146 tempest-FlavorsExtraSpecsNegativeTestJSON-104711146-project-admin] Returning 404 to user: Flavor 594127456 has no extra specs with key hw:cpu_thread_policy. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:25:39.223479 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e1b160a8-0408-47d6-9769-5be43ba890e3 tempest-FlavorsExtraSpecsNegativeTestJSON-104711146 tempest-FlavorsExtraSpecsNegativeTestJSON-104711146-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/594127456/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.030201 Oct 27 03:25:39.224291 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 734/1510] 10.222.0.20 () {58 vars in 1266 bytes} [Thu Oct 27 03:25:39 2022] DELETE /compute/v2.1/flavors/594127456/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:25:39.233971 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-eae17d13-10e2-4521-85d3-80abb9396cc3 tempest-FlavorsExtraSpecsNegativeTestJSON-104711146 tempest-FlavorsExtraSpecsNegativeTestJSON-104711146-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:25:39.239332 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-eae17d13-10e2-4521-85d3-80abb9396cc3 tempest-FlavorsExtraSpecsNegativeTestJSON-104711146 tempest-FlavorsExtraSpecsNegativeTestJSON-104711146-project-admin] HTTP exception thrown: Request body and URI mismatch Oct 27 03:25:39.242166 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-eae17d13-10e2-4521-85d3-80abb9396cc3 tempest-FlavorsExtraSpecsNegativeTestJSON-104711146 tempest-FlavorsExtraSpecsNegativeTestJSON-104711146-project-admin] Request method failure captured: Oct 27 03:25:39.242166 n-d-862769-1 devstack@n-api.service[121000]: request: PUT /compute/v2.1/flavors/594127456/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 27 03:25:39.242166 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:25:39.242166 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:25:39.242166 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:25:39.242166 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 27 Oct 27 03:25:39.242166 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:25:39.242166 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:25:39.242166 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:25:39.242166 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:25:39.242166 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfoxuXqSz7usPnH4sPgqTGoEiyM0z9Al3DqLcvxsVVmj9EUmrnE8CO89XJhj-9y7vqS1Vz9MQFjz2ISDwvGlg6811Ps4eu4O04cDe9Nun5j_XmnU9f7eiIviZ6vVcw9eBe4wVP6iTBZhqM0e0yVR_yeDbwt_ciXFKgoJvjz_R74Rwps Oct 27 03:25:39.242166 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:25:39.242166 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:25:39.242166 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:25:39.242166 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:25:39.242166 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:25:39.242166 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:25:39.242166 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 9fe4fc63063b4d8b9ae8e47dd20423de Oct 27 03:25:39.242166 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-104711146 Oct 27 03:25:39.242166 n-d-862769-1 devstack@n-api.service[121000]: X-Role: admin,member,reader Oct 27 03:25:39.242166 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: admin,member,reader Oct 27 03:25:39.246696 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9fe4fc63063b4d8b9ae8e47dd20423de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9fe4fc63063b4d8b9ae8e47dd20423de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9fe4fc63063b4d8b9ae8e47dd20423de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9fe4fc63063b4d8b9ae8e47dd20423de"}]}] Oct 27 03:25:39.246696 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-104711146 Oct 27 03:25:39.246696 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 9fe4fc63063b4d8b9ae8e47dd20423de Oct 27 03:25:39.246696 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-104711146 Oct 27 03:25:39.246696 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-104711146-project-admin Oct 27 03:25:39.246696 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:25:39.246696 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:25:39.246696 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: e961803e22ea4bfab2eb4b0c9cef2c24 Oct 27 03:25:39.246696 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-104711146-project-admin Oct 27 03:25:39.246696 n-d-862769-1 devstack@n-api.service[121000]: Oct 27 03:25:39.246696 n-d-862769-1 devstack@n-api.service[121000]: {"hw:cpu_policy": "shared"} Oct 27 03:25:39.246696 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:25:39.246696 n-d-862769-1 devstack@n-api.service[121000]: exception: Request body and URI mismatch Oct 27 03:25:39.247470 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'flavor_id': '594127456', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Oct 27 03:25:39.247470 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:25:39.247470 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:25:39.247470 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:25:39.247470 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:25:39.247470 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:25:39.247470 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:25:39.247470 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:25:39.247470 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:25:39.247470 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:25:39.247470 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:25:39.247470 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Oct 27 03:25:39.247470 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Oct 27 03:25:39.247470 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Oct 27 03:25:39.247470 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:25:39.247470 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:25:39.247470 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:25:39.247470 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:25:39.247470 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:25:39.247470 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:25:39.248770 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:25:39.248770 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:25:39.248770 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Oct 27 03:25:39.248770 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:25:39.250421 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-eae17d13-10e2-4521-85d3-80abb9396cc3 tempest-FlavorsExtraSpecsNegativeTestJSON-104711146 tempest-FlavorsExtraSpecsNegativeTestJSON-104711146-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:25:39.251590 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-eae17d13-10e2-4521-85d3-80abb9396cc3 tempest-FlavorsExtraSpecsNegativeTestJSON-104711146 tempest-FlavorsExtraSpecsNegativeTestJSON-104711146-project-admin] 10.222.0.20 "PUT /compute/v2.1/flavors/594127456/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.021616 Oct 27 03:25:39.260989 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 777/1511] 10.222.0.20 () {60 vars in 1262 bytes} [Thu Oct 27 03:25:39 2022] PUT /compute/v2.1/flavors/594127456/os-extra_specs/hw:numa_nodes => generated 73 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 27 03:25:39.270638 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b7dcc1eb-dc68-4f77-a26f-4bce09f67cc6 tempest-FlavorsExtraSpecsNegativeTestJSON-104711146 tempest-FlavorsExtraSpecsNegativeTestJSON-104711146-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:25:39.275946 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b7dcc1eb-dc68-4f77-a26f-4bce09f67cc6 tempest-FlavorsExtraSpecsNegativeTestJSON-104711146 tempest-FlavorsExtraSpecsNegativeTestJSON-104711146-project-admin] Request method failure captured: Oct 27 03:25:39.275946 n-d-862769-1 devstack@n-api.service[121001]: request: PUT /compute/v2.1/flavors/594127456/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 27 03:25:39.275946 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:25:39.275946 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:25:39.275946 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:25:39.275946 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 49 Oct 27 03:25:39.275946 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:25:39.275946 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:25:39.275946 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:25:39.275946 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:25:39.275946 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfoxuXqSz7usPnH4sPgqTGoEiyM0z9Al3DqLcvxsVVmj9EUmrnE8CO89XJhj-9y7vqS1Vz9MQFjz2ISDwvGlg6811Ps4eu4O04cDe9Nun5j_XmnU9f7eiIviZ6vVcw9eBe4wVP6iTBZhqM0e0yVR_yeDbwt_ciXFKgoJvjz_R74Rwps Oct 27 03:25:39.275946 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:25:39.275946 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:25:39.275946 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:25:39.275946 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:25:39.275946 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:25:39.275946 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:25:39.275946 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 9fe4fc63063b4d8b9ae8e47dd20423de Oct 27 03:25:39.275946 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-104711146 Oct 27 03:25:39.275946 n-d-862769-1 devstack@n-api.service[121001]: X-Role: admin,member,reader Oct 27 03:25:39.275946 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: admin,member,reader Oct 27 03:25:39.277274 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9fe4fc63063b4d8b9ae8e47dd20423de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9fe4fc63063b4d8b9ae8e47dd20423de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9fe4fc63063b4d8b9ae8e47dd20423de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9fe4fc63063b4d8b9ae8e47dd20423de"}]}] Oct 27 03:25:39.277274 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-104711146 Oct 27 03:25:39.277274 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 9fe4fc63063b4d8b9ae8e47dd20423de Oct 27 03:25:39.277274 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-104711146 Oct 27 03:25:39.277274 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-104711146-project-admin Oct 27 03:25:39.277274 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:25:39.277274 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:25:39.277274 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: e961803e22ea4bfab2eb4b0c9cef2c24 Oct 27 03:25:39.277274 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-104711146-project-admin Oct 27 03:25:39.277274 n-d-862769-1 devstack@n-api.service[121001]: Oct 27 03:25:39.277274 n-d-862769-1 devstack@n-api.service[121001]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Oct 27 03:25:39.277274 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:25:39.278017 n-d-862769-1 devstack@n-api.service[121001]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 27 03:25:39.278017 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'flavor_id': '594127456', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Oct 27 03:25:39.278017 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:25:39.278017 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:25:39.278017 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 03:25:39.278017 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 03:25:39.278017 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 03:25:39.278017 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise error Oct 27 03:25:39.278017 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 27 03:25:39.278017 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:25:39.278017 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Oct 27 03:25:39.278017 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 27 03:25:39.278017 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Oct 27 03:25:39.278017 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Oct 27 03:25:39.278017 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 27 03:25:39.278017 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi 'type': ['string', Oct 27 03:25:39.278017 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi 'number']}}, Oct 27 03:25:39.278017 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 27 03:25:39.278017 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:25:39.278017 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi On instance: Oct 27 03:25:39.278017 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Oct 27 03:25:39.278017 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:25:39.279406 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:25:39.279406 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:25:39.279406 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:25:39.279406 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:25:39.279406 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:25:39.279406 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:25:39.279406 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:25:39.279406 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:25:39.279406 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:25:39.279406 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 03:25:39.279406 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 03:25:39.279406 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 03:25:39.279406 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 03:25:39.279406 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 03:25:39.279406 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 03:25:39.279406 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 27 03:25:39.279406 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:25:39.279406 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:25:39.279406 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:25:39.279406 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:25:39.280620 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:25:39.280620 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:25:39.280620 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 03:25:39.280620 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 03:25:39.280620 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 27 03:25:39.280620 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:25:39.287539 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b7dcc1eb-dc68-4f77-a26f-4bce09f67cc6 tempest-FlavorsExtraSpecsNegativeTestJSON-104711146 tempest-FlavorsExtraSpecsNegativeTestJSON-104711146-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:25:39.288753 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b7dcc1eb-dc68-4f77-a26f-4bce09f67cc6 tempest-FlavorsExtraSpecsNegativeTestJSON-104711146 tempest-FlavorsExtraSpecsNegativeTestJSON-104711146-project-admin] 10.222.0.20 "PUT /compute/v2.1/flavors/594127456/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.022149 Oct 27 03:25:39.289561 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 735/1512] 10.222.0.20 () {60 vars in 1262 bytes} [Thu Oct 27 03:25:39 2022] PUT /compute/v2.1/flavors/594127456/os-extra_specs/hw:numa_nodes => generated 117 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 27 03:25:39.302326 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-59dfda07-73d0-44f7-90b5-c26ba95a0317 tempest-FlavorsExtraSpecsNegativeTestJSON-104711146 tempest-FlavorsExtraSpecsNegativeTestJSON-104711146-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:39.399280 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-dd7d0f10-c8f5-4b35-b4c6-7ea96da34c30 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:39.400944 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-dd7d0f10-c8f5-4b35-b4c6-7ea96da34c30 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] [instance: 1d9172bd-aa20-4f49-87fa-64300cf861be] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:39.407234 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-59dfda07-73d0-44f7-90b5-c26ba95a0317 tempest-FlavorsExtraSpecsNegativeTestJSON-104711146 tempest-FlavorsExtraSpecsNegativeTestJSON-104711146-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/594127456" status: 202 len: 0 microversion: 2.1 time: 0.112143 Oct 27 03:25:39.409967 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 778/1513] 10.222.0.20 () {58 vars in 1158 bytes} [Thu Oct 27 03:25:39 2022] DELETE /compute/v2.1/flavors/594127456 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:25:39.419637 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-af7ec0db-b292-4f90-a5e8-0bb170703ad4 tempest-FlavorsExtraSpecsNegativeTestJSON-104711146 tempest-FlavorsExtraSpecsNegativeTestJSON-104711146-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:39.426843 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dd7d0f10-c8f5-4b35-b4c6-7ea96da34c30 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:39.429080 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dd7d0f10-c8f5-4b35-b4c6-7ea96da34c30 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:39.429080 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dd7d0f10-c8f5-4b35-b4c6-7ea96da34c30 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:39.431959 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dd7d0f10-c8f5-4b35-b4c6-7ea96da34c30 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:39.432754 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dd7d0f10-c8f5-4b35-b4c6-7ea96da34c30 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:39.433438 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dd7d0f10-c8f5-4b35-b4c6-7ea96da34c30 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:39.474869 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-af7ec0db-b292-4f90-a5e8-0bb170703ad4 tempest-FlavorsExtraSpecsNegativeTestJSON-104711146 tempest-FlavorsExtraSpecsNegativeTestJSON-104711146-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.053624 Oct 27 03:25:39.476191 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 779/1514] 10.222.0.20 () {58 vars in 1146 bytes} [Thu Oct 27 03:25:39 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:25:39.478902 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:25:39.488580 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1af7626b-db75-444e-837d-aed66e3e0f6c tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:39.489498 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1af7626b-db75-444e-837d-aed66e3e0f6c tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] [instance: 543fdf60-10ec-4a25-a9d0-30c386efb104] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:39.498916 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1af7626b-db75-444e-837d-aed66e3e0f6c tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:39.502353 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1af7626b-db75-444e-837d-aed66e3e0f6c tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:39.502911 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1af7626b-db75-444e-837d-aed66e3e0f6c tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:39.505655 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1af7626b-db75-444e-837d-aed66e3e0f6c tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:39.507502 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1af7626b-db75-444e-837d-aed66e3e0f6c tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:39.510861 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1af7626b-db75-444e-837d-aed66e3e0f6c tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:39.750431 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1af7626b-db75-444e-837d-aed66e3e0f6c tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104" status: 200 len: 1813 microversion: 2.1 time: 0.258499 Oct 27 03:25:39.750431 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 780/1515] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:39 2022] GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104 => generated 1813 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:25:39.750812 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-dd7d0f10-c8f5-4b35-b4c6-7ea96da34c30 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c65ddc0af5854d7a89192d01bc5f4576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c57f8e9a0e4debae18d98918ba8c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:39.761503 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-dd7d0f10-c8f5-4b35-b4c6-7ea96da34c30 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] 10.222.0.20 "GET /compute/v2.1/servers/1d9172bd-aa20-4f49-87fa-64300cf861be" status: 200 len: 1367 microversion: 2.1 time: 0.368901 Oct 27 03:25:39.763031 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b73c5313-e971-4a29-a333-ea7a9d62eabf tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:39.763449 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 736/1516] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:39 2022] GET /compute/v2.1/servers/1d9172bd-aa20-4f49-87fa-64300cf861be => generated 1367 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:39.765272 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b73c5313-e971-4a29-a333-ea7a9d62eabf tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: e8781053-3dad-4951-b4cb-1f4aaf97e19b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:39.782710 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d75b04b7-61e1-4308-a73d-77123846b07f tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:39.792328 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b73c5313-e971-4a29-a333-ea7a9d62eabf tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:39.797099 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b73c5313-e971-4a29-a333-ea7a9d62eabf tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:39.799454 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d75b04b7-61e1-4308-a73d-77123846b07f tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:39.800044 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b73c5313-e971-4a29-a333-ea7a9d62eabf tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:39.801074 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b73c5313-e971-4a29-a333-ea7a9d62eabf tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:39.801655 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b73c5313-e971-4a29-a333-ea7a9d62eabf tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:39.802276 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d75b04b7-61e1-4308-a73d-77123846b07f tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:39.806917 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b73c5313-e971-4a29-a333-ea7a9d62eabf tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:39.807042 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d75b04b7-61e1-4308-a73d-77123846b07f tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:39.807042 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d75b04b7-61e1-4308-a73d-77123846b07f tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:39.807042 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d75b04b7-61e1-4308-a73d-77123846b07f tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:39.807042 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d75b04b7-61e1-4308-a73d-77123846b07f tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:39.911500 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d75b04b7-61e1-4308-a73d-77123846b07f tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.146751 Oct 27 03:25:39.914116 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 737/1517] 10.222.0.20 () {58 vars in 1176 bytes} [Thu Oct 27 03:25:39 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:25:39.920242 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-04540f0b-11f1-49dd-8977-85228ec4670b tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:39.921184 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-04540f0b-11f1-49dd-8977-85228ec4670b tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] [instance: b3e22e1e-77a7-4f06-b099-eee6d631d3c9] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:39.931799 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-04540f0b-11f1-49dd-8977-85228ec4670b tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:39.932542 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-04540f0b-11f1-49dd-8977-85228ec4670b tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:39.933209 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-04540f0b-11f1-49dd-8977-85228ec4670b tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:39.935091 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-04540f0b-11f1-49dd-8977-85228ec4670b tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:39.935784 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-04540f0b-11f1-49dd-8977-85228ec4670b tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:39.936401 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-04540f0b-11f1-49dd-8977-85228ec4670b tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:40.175649 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-04540f0b-11f1-49dd-8977-85228ec4670b tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ccd5909fb214f71ad68704019c9e4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d2c150feac4d03966a860ab8bafe00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:40.194868 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-04540f0b-11f1-49dd-8977-85228ec4670b tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] 10.222.0.20 "GET /compute/v2.1/servers/b3e22e1e-77a7-4f06-b099-eee6d631d3c9" status: 200 len: 1321 microversion: 2.1 time: 0.278304 Oct 27 03:25:40.202361 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 738/1518] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:39 2022] GET /compute/v2.1/servers/b3e22e1e-77a7-4f06-b099-eee6d631d3c9 => generated 1321 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:40.217065 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9a914fdf-b103-463f-bc42-f6733d3814a5 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7ddac4cc10>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:40.274132 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b73c5313-e971-4a29-a333-ea7a9d62eabf tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:40.289565 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b73c5313-e971-4a29-a333-ea7a9d62eabf tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b" status: 200 len: 1476 microversion: 2.1 time: 0.543139 Oct 27 03:25:40.304365 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 781/1519] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:39 2022] GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b => generated 1476 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:40.342672 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9a914fdf-b103-463f-bc42-f6733d3814a5 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/images/7115c53b-83c1-4282-b3b3-cadb0c0b6d70" status: 200 len: 1413 microversion: 2.1 time: 0.141090 Oct 27 03:25:40.349435 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 739/1520] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:25:40 2022] GET /compute/v2.1/images/7115c53b-83c1-4282-b3b3-cadb0c0b6d70 => generated 1413 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:40.796671 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c7cb2a95-27b6-4da4-b833-f8350edf3a51 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:40.796671 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c7cb2a95-27b6-4da4-b833-f8350edf3a51 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] [instance: 1d9172bd-aa20-4f49-87fa-64300cf861be] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:40.812847 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c7cb2a95-27b6-4da4-b833-f8350edf3a51 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:40.816588 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c7cb2a95-27b6-4da4-b833-f8350edf3a51 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:40.818879 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c7cb2a95-27b6-4da4-b833-f8350edf3a51 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:40.822487 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c7cb2a95-27b6-4da4-b833-f8350edf3a51 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:40.825948 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c7cb2a95-27b6-4da4-b833-f8350edf3a51 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:40.827866 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c7cb2a95-27b6-4da4-b833-f8350edf3a51 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:40.875966 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-294e1850-ff90-4f02-9678-a9de4f4d6282 req-bc109b33-945b-4a2a-ab80-b9ea0dd353a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33d5c62a-898f-441b-a1a1-3cb12836755d", "name": "network-vif-plugged", "status": "completed", "tag": "0fee4f52-9d23-48f3-b849-8399851e00ed"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:25:40.883378 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=14 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:25:40.900783 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-294e1850-ff90-4f02-9678-a9de4f4d6282 req-bc109b33-945b-4a2a-ab80-b9ea0dd353a9 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:40.902657 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-294e1850-ff90-4f02-9678-a9de4f4d6282 req-bc109b33-945b-4a2a-ab80-b9ea0dd353a9 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:40.905159 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-294e1850-ff90-4f02-9678-a9de4f4d6282 req-bc109b33-945b-4a2a-ab80-b9ea0dd353a9 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:40.938804 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-294e1850-ff90-4f02-9678-a9de4f4d6282 req-bc109b33-945b-4a2a-ab80-b9ea0dd353a9 service nova] Creating event network-vif-plugged:0fee4f52-9d23-48f3-b849-8399851e00ed for instance 33d5c62a-898f-441b-a1a1-3cb12836755d on n-h2-862769-1 Oct 27 03:25:40.948062 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-294e1850-ff90-4f02-9678-a9de4f4d6282 req-bc109b33-945b-4a2a-ab80-b9ea0dd353a9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075884 Oct 27 03:25:40.953468 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 740/1521] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:25:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:25:41.226902 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-48141e13-6111-4baa-9ae8-44f0e7f4684b tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:41.228328 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-48141e13-6111-4baa-9ae8-44f0e7f4684b tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] [instance: b3e22e1e-77a7-4f06-b099-eee6d631d3c9] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:41.245016 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c7cb2a95-27b6-4da4-b833-f8350edf3a51 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c65ddc0af5854d7a89192d01bc5f4576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c57f8e9a0e4debae18d98918ba8c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:41.246641 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-48141e13-6111-4baa-9ae8-44f0e7f4684b tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:41.250881 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-48141e13-6111-4baa-9ae8-44f0e7f4684b tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:41.250881 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-48141e13-6111-4baa-9ae8-44f0e7f4684b tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:41.250881 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-48141e13-6111-4baa-9ae8-44f0e7f4684b tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:41.250881 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-48141e13-6111-4baa-9ae8-44f0e7f4684b tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:41.251240 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-48141e13-6111-4baa-9ae8-44f0e7f4684b tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:41.261727 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c7cb2a95-27b6-4da4-b833-f8350edf3a51 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] 10.222.0.20 "GET /compute/v2.1/servers/1d9172bd-aa20-4f49-87fa-64300cf861be" status: 200 len: 1367 microversion: 2.1 time: 0.466959 Oct 27 03:25:41.262455 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 782/1522] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:40 2022] GET /compute/v2.1/servers/1d9172bd-aa20-4f49-87fa-64300cf861be => generated 1367 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:41.315887 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e670c987-1a3b-47e4-a083-b75c4169c2ce tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:41.316515 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e670c987-1a3b-47e4-a083-b75c4169c2ce tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: e8781053-3dad-4951-b4cb-1f4aaf97e19b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:41.331889 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e670c987-1a3b-47e4-a083-b75c4169c2ce tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:41.333348 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e670c987-1a3b-47e4-a083-b75c4169c2ce tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:41.334121 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e670c987-1a3b-47e4-a083-b75c4169c2ce tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:41.335061 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e670c987-1a3b-47e4-a083-b75c4169c2ce tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:41.335704 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e670c987-1a3b-47e4-a083-b75c4169c2ce tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:41.336355 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e670c987-1a3b-47e4-a083-b75c4169c2ce tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:42.077570 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e670c987-1a3b-47e4-a083-b75c4169c2ce tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:42.080097 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-48141e13-6111-4baa-9ae8-44f0e7f4684b tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ccd5909fb214f71ad68704019c9e4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d2c150feac4d03966a860ab8bafe00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:42.089934 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e670c987-1a3b-47e4-a083-b75c4169c2ce tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b" status: 200 len: 1475 microversion: 2.1 time: 0.778573 Oct 27 03:25:42.092229 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 783/1523] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:41 2022] GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b => generated 1475 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:25:42.103593 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e820fd5d-ead2-4564-816c-0a2c8cd0c2ec tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7ddaac54c0>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:42.110529 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-48141e13-6111-4baa-9ae8-44f0e7f4684b tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] 10.222.0.20 "GET /compute/v2.1/servers/b3e22e1e-77a7-4f06-b099-eee6d631d3c9" status: 200 len: 1321 microversion: 2.1 time: 0.888170 Oct 27 03:25:42.111132 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 741/1524] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:41 2022] GET /compute/v2.1/servers/b3e22e1e-77a7-4f06-b099-eee6d631d3c9 => generated 1321 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:25:42.227635 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e820fd5d-ead2-4564-816c-0a2c8cd0c2ec tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/images/7115c53b-83c1-4282-b3b3-cadb0c0b6d70" status: 200 len: 1413 microversion: 2.1 time: 0.128692 Oct 27 03:25:42.228839 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 784/1525] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:25:42 2022] GET /compute/v2.1/images/7115c53b-83c1-4282-b3b3-cadb0c0b6d70 => generated 1413 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:42.239132 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-8e192230-62ad-4db5-aa25-03a2d5e2ebd8 req-4722c090-5a42-4828-855a-7ffa45e93ab4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8781053-3dad-4951-b4cb-1f4aaf97e19b", "name": "network-vif-unplugged", "status": "completed", "tag": "2db0e1c6-c7e9-4994-9a8c-c23e51c0e800"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:25:42.257688 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-8e192230-62ad-4db5-aa25-03a2d5e2ebd8 req-4722c090-5a42-4828-855a-7ffa45e93ab4 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:42.262177 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-8e192230-62ad-4db5-aa25-03a2d5e2ebd8 req-4722c090-5a42-4828-855a-7ffa45e93ab4 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:42.262177 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-8e192230-62ad-4db5-aa25-03a2d5e2ebd8 req-4722c090-5a42-4828-855a-7ffa45e93ab4 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:42.289017 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c54a2315-b9da-4a22-85d1-18c1fa57a773 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:42.289655 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c54a2315-b9da-4a22-85d1-18c1fa57a773 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] [instance: 1d9172bd-aa20-4f49-87fa-64300cf861be] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:42.295330 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-8e192230-62ad-4db5-aa25-03a2d5e2ebd8 req-4722c090-5a42-4828-855a-7ffa45e93ab4 service nova] Creating event network-vif-unplugged:2db0e1c6-c7e9-4994-9a8c-c23e51c0e800 for instance e8781053-3dad-4951-b4cb-1f4aaf97e19b on n-h1-862769-1 Oct 27 03:25:42.301233 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c54a2315-b9da-4a22-85d1-18c1fa57a773 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:42.303305 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c54a2315-b9da-4a22-85d1-18c1fa57a773 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:42.308315 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c54a2315-b9da-4a22-85d1-18c1fa57a773 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:42.308315 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c54a2315-b9da-4a22-85d1-18c1fa57a773 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:42.308315 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c54a2315-b9da-4a22-85d1-18c1fa57a773 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:42.308315 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c54a2315-b9da-4a22-85d1-18c1fa57a773 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:42.308689 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [req-8e192230-62ad-4db5-aa25-03a2d5e2ebd8 req-4722c090-5a42-4828-855a-7ffa45e93ab4 service nova] Instance e8781053-3dad-4951-b4cb-1f4aaf97e19b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862769-1', 'n-h1-862769-1'} {{(pid=121001) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 03:25:42.332671 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-8e192230-62ad-4db5-aa25-03a2d5e2ebd8 req-4722c090-5a42-4828-855a-7ffa45e93ab4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.097498 Oct 27 03:25:42.333572 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 742/1526] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:25:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:25:43.114937 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ebe7f743-74f3-4557-ab4c-c1ff525f9441 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:43.120355 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ebe7f743-74f3-4557-ab4c-c1ff525f9441 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: e8781053-3dad-4951-b4cb-1f4aaf97e19b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:43.145932 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ebe7f743-74f3-4557-ab4c-c1ff525f9441 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:43.147986 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ebe7f743-74f3-4557-ab4c-c1ff525f9441 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:43.147986 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ebe7f743-74f3-4557-ab4c-c1ff525f9441 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:43.156625 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ebe7f743-74f3-4557-ab4c-c1ff525f9441 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:43.157138 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ebe7f743-74f3-4557-ab4c-c1ff525f9441 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:43.157590 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ebe7f743-74f3-4557-ab4c-c1ff525f9441 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:43.507740 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ebe7f743-74f3-4557-ab4c-c1ff525f9441 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:43.522062 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ebe7f743-74f3-4557-ab4c-c1ff525f9441 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b" status: 200 len: 1475 microversion: 2.1 time: 0.412945 Oct 27 03:25:43.552757 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 743/1527] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:43 2022] GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b => generated 1475 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:25:43.559669 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c54a2315-b9da-4a22-85d1-18c1fa57a773 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c65ddc0af5854d7a89192d01bc5f4576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c57f8e9a0e4debae18d98918ba8c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:43.568539 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c54a2315-b9da-4a22-85d1-18c1fa57a773 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] 10.222.0.20 "GET /compute/v2.1/servers/1d9172bd-aa20-4f49-87fa-64300cf861be" status: 200 len: 1367 microversion: 2.1 time: 1.283503 Oct 27 03:25:43.577843 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 785/1528] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:42 2022] GET /compute/v2.1/servers/1d9172bd-aa20-4f49-87fa-64300cf861be => generated 1367 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:25:43.581714 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5e888d38-c839-490e-a071-494bbc9b2872 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:43.581714 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5e888d38-c839-490e-a071-494bbc9b2872 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] [instance: b3e22e1e-77a7-4f06-b099-eee6d631d3c9] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:43.597550 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-7c33c702-4975-4752-8dc6-e420c1603f01 req-2c01bc34-04ce-41cf-a207-514b708f8afe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d9172bd-aa20-4f49-87fa-64300cf861be", "name": "network-vif-plugged", "status": "completed", "tag": "7137a87b-6939-4f63-9975-97cc9919bde1"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:25:43.609028 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5e888d38-c839-490e-a071-494bbc9b2872 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:43.609528 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5e888d38-c839-490e-a071-494bbc9b2872 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:43.609968 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5e888d38-c839-490e-a071-494bbc9b2872 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:43.610722 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5e888d38-c839-490e-a071-494bbc9b2872 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:43.611179 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5e888d38-c839-490e-a071-494bbc9b2872 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:43.621633 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5e888d38-c839-490e-a071-494bbc9b2872 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:43.627298 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-7c33c702-4975-4752-8dc6-e420c1603f01 req-2c01bc34-04ce-41cf-a207-514b708f8afe service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:43.627825 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-7c33c702-4975-4752-8dc6-e420c1603f01 req-2c01bc34-04ce-41cf-a207-514b708f8afe service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:43.628253 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-7c33c702-4975-4752-8dc6-e420c1603f01 req-2c01bc34-04ce-41cf-a207-514b708f8afe service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:43.672251 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-7c33c702-4975-4752-8dc6-e420c1603f01 req-2c01bc34-04ce-41cf-a207-514b708f8afe service nova] Creating event network-vif-plugged:7137a87b-6939-4f63-9975-97cc9919bde1 for instance 1d9172bd-aa20-4f49-87fa-64300cf861be on n-h1-862769-1 Oct 27 03:25:43.691215 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-7c33c702-4975-4752-8dc6-e420c1603f01 req-2c01bc34-04ce-41cf-a207-514b708f8afe service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108573 Oct 27 03:25:43.691869 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 786/1529] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:25:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:25:43.721079 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2f21c8e6-18a4-4faf-b5d8-017f9a820cee tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7ddee2a430>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:43.852555 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2f21c8e6-18a4-4faf-b5d8-017f9a820cee tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/images/7115c53b-83c1-4282-b3b3-cadb0c0b6d70" status: 200 len: 1413 microversion: 2.1 time: 0.153182 Oct 27 03:25:43.861145 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 787/1530] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:25:43 2022] GET /compute/v2.1/images/7115c53b-83c1-4282-b3b3-cadb0c0b6d70 => generated 1413 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:44.537241 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-985eab80-28d5-490a-86f7-41a4b1267075 req-e8e52548-191f-4be5-810c-80e1d047a4d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8781053-3dad-4951-b4cb-1f4aaf97e19b", "tag": "2db0e1c6-c7e9-4994-9a8c-c23e51c0e800"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:25:44.567829 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-985eab80-28d5-490a-86f7-41a4b1267075 req-e8e52548-191f-4be5-810c-80e1d047a4d1 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:44.569264 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-985eab80-28d5-490a-86f7-41a4b1267075 req-e8e52548-191f-4be5-810c-80e1d047a4d1 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:44.569924 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-985eab80-28d5-490a-86f7-41a4b1267075 req-e8e52548-191f-4be5-810c-80e1d047a4d1 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:44.605291 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-985eab80-28d5-490a-86f7-41a4b1267075 req-e8e52548-191f-4be5-810c-80e1d047a4d1 service nova] Creating event network-changed:2db0e1c6-c7e9-4994-9a8c-c23e51c0e800 for instance e8781053-3dad-4951-b4cb-1f4aaf97e19b on n-h1-862769-1 Oct 27 03:25:44.635063 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [req-985eab80-28d5-490a-86f7-41a4b1267075 req-e8e52548-191f-4be5-810c-80e1d047a4d1 service nova] Instance e8781053-3dad-4951-b4cb-1f4aaf97e19b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862769-1', 'n-h1-862769-1'} {{(pid=121000) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 03:25:44.669276 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-985eab80-28d5-490a-86f7-41a4b1267075 req-e8e52548-191f-4be5-810c-80e1d047a4d1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134231 Oct 27 03:25:44.670947 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 788/1531] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:25:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:25:44.691095 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6fc11148-68c9-44be-8342-062d5402bb43 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:44.692470 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6fc11148-68c9-44be-8342-062d5402bb43 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: e8781053-3dad-4951-b4cb-1f4aaf97e19b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:44.711055 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6fc11148-68c9-44be-8342-062d5402bb43 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:44.712416 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6fc11148-68c9-44be-8342-062d5402bb43 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:44.713031 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6fc11148-68c9-44be-8342-062d5402bb43 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:44.713974 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6fc11148-68c9-44be-8342-062d5402bb43 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:44.715342 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6fc11148-68c9-44be-8342-062d5402bb43 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:44.715977 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6fc11148-68c9-44be-8342-062d5402bb43 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:45.080359 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5e888d38-c839-490e-a071-494bbc9b2872 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ccd5909fb214f71ad68704019c9e4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d2c150feac4d03966a860ab8bafe00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:45.093079 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5e888d38-c839-490e-a071-494bbc9b2872 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] 10.222.0.20 "GET /compute/v2.1/servers/b3e22e1e-77a7-4f06-b099-eee6d631d3c9" status: 200 len: 1321 microversion: 2.1 time: 1.539082 Oct 27 03:25:45.099281 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 744/1532] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:43 2022] GET /compute/v2.1/servers/b3e22e1e-77a7-4f06-b099-eee6d631d3c9 => generated 1321 bytes in 1546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:45.106701 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-cd992cab-7278-447a-b263-58601f8f1bc7 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:45.108106 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-cd992cab-7278-447a-b263-58601f8f1bc7 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] [instance: 1d9172bd-aa20-4f49-87fa-64300cf861be] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:45.135689 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cd992cab-7278-447a-b263-58601f8f1bc7 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:45.138836 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cd992cab-7278-447a-b263-58601f8f1bc7 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:45.144494 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cd992cab-7278-447a-b263-58601f8f1bc7 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:45.146797 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cd992cab-7278-447a-b263-58601f8f1bc7 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:45.147526 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cd992cab-7278-447a-b263-58601f8f1bc7 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:45.149705 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cd992cab-7278-447a-b263-58601f8f1bc7 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:45.275872 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-6fc11148-68c9-44be-8342-062d5402bb43 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:45.294449 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6fc11148-68c9-44be-8342-062d5402bb43 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b" status: 200 len: 1475 microversion: 2.1 time: 0.617796 Oct 27 03:25:45.296164 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 789/1533] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:44 2022] GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b => generated 1475 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:45.304633 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-05f9fb74-4bd6-4571-9063-46767256b022 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7ddee4c820>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:45.378376 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-05f9fb74-4bd6-4571-9063-46767256b022 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/images/7115c53b-83c1-4282-b3b3-cadb0c0b6d70" status: 200 len: 1413 microversion: 2.1 time: 0.080318 Oct 27 03:25:45.379174 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 790/1534] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:25:45 2022] GET /compute/v2.1/images/7115c53b-83c1-4282-b3b3-cadb0c0b6d70 => generated 1413 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:45.497243 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-cd992cab-7278-447a-b263-58601f8f1bc7 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c65ddc0af5854d7a89192d01bc5f4576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c57f8e9a0e4debae18d98918ba8c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:45.509564 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-cd992cab-7278-447a-b263-58601f8f1bc7 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] 10.222.0.20 "GET /compute/v2.1/servers/1d9172bd-aa20-4f49-87fa-64300cf861be" status: 200 len: 1367 microversion: 2.1 time: 0.408800 Oct 27 03:25:45.525173 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 745/1535] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:45 2022] GET /compute/v2.1/servers/1d9172bd-aa20-4f49-87fa-64300cf861be => generated 1367 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:45.870412 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-db379894-aede-4ebc-ae8a-882b7772926f req-81037b41-f595-4a8c-b130-330024e04e0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3e22e1e-77a7-4f06-b099-eee6d631d3c9", "name": "network-vif-plugged", "status": "completed", "tag": "60d343b3-3185-46f8-aaa0-ac75ba00f598"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:25:45.906758 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-db379894-aede-4ebc-ae8a-882b7772926f req-81037b41-f595-4a8c-b130-330024e04e0e service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:45.907353 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-db379894-aede-4ebc-ae8a-882b7772926f req-81037b41-f595-4a8c-b130-330024e04e0e service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:45.910173 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-db379894-aede-4ebc-ae8a-882b7772926f req-81037b41-f595-4a8c-b130-330024e04e0e service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:45.936561 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-db379894-aede-4ebc-ae8a-882b7772926f req-81037b41-f595-4a8c-b130-330024e04e0e service nova] Creating event network-vif-plugged:60d343b3-3185-46f8-aaa0-ac75ba00f598 for instance b3e22e1e-77a7-4f06-b099-eee6d631d3c9 on n-h2-862769-1 Oct 27 03:25:45.953289 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-db379894-aede-4ebc-ae8a-882b7772926f req-81037b41-f595-4a8c-b130-330024e04e0e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093031 Oct 27 03:25:45.953910 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 791/1536] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:25:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:25:46.079393 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-00f8aae4-6c9c-4f4c-b055-1881fd183669 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e37d34d7-aaba-47fa-810a-75cd1c95b517", "device": "/dev/xvdb"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:25:46.082949 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-00f8aae4-6c9c-4f4c-b055-1881fd183669 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: 543fdf60-10ec-4a25-a9d0-30c386efb104] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:46.106153 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-00f8aae4-6c9c-4f4c-b055-1881fd183669 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:46.106688 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-00f8aae4-6c9c-4f4c-b055-1881fd183669 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:46.107111 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-00f8aae4-6c9c-4f4c-b055-1881fd183669 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:46.120281 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-751208fb-7444-4ba3-aabb-1ab52fa1db8a tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:46.128766 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-751208fb-7444-4ba3-aabb-1ab52fa1db8a tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] [instance: b3e22e1e-77a7-4f06-b099-eee6d631d3c9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:46.128909 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-00f8aae4-6c9c-4f4c-b055-1881fd183669 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:46.129001 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-00f8aae4-6c9c-4f4c-b055-1881fd183669 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:46.129409 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-00f8aae4-6c9c-4f4c-b055-1881fd183669 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:46.132583 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-751208fb-7444-4ba3-aabb-1ab52fa1db8a tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:46.133076 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-751208fb-7444-4ba3-aabb-1ab52fa1db8a tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:46.133519 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-751208fb-7444-4ba3-aabb-1ab52fa1db8a tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:46.134269 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-751208fb-7444-4ba3-aabb-1ab52fa1db8a tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:46.134727 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-751208fb-7444-4ba3-aabb-1ab52fa1db8a tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:46.135154 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-751208fb-7444-4ba3-aabb-1ab52fa1db8a tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:46.232412 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:25:46.792032 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-751208fb-7444-4ba3-aabb-1ab52fa1db8a tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ccd5909fb214f71ad68704019c9e4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d2c150feac4d03966a860ab8bafe00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:46.812091 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-751208fb-7444-4ba3-aabb-1ab52fa1db8a tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] 10.222.0.20 "GET /compute/v2.1/servers/b3e22e1e-77a7-4f06-b099-eee6d631d3c9" status: 200 len: 1321 microversion: 2.1 time: 0.696411 Oct 27 03:25:46.812736 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 792/1537] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:46 2022] GET /compute/v2.1/servers/b3e22e1e-77a7-4f06-b099-eee6d631d3c9 => generated 1321 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:25:46.819957 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e4087e5f-ab94-4034-bde7-328404413c25 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:46.820796 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e4087e5f-ab94-4034-bde7-328404413c25 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: e8781053-3dad-4951-b4cb-1f4aaf97e19b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:46.827352 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e4087e5f-ab94-4034-bde7-328404413c25 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:46.827854 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e4087e5f-ab94-4034-bde7-328404413c25 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:46.828318 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e4087e5f-ab94-4034-bde7-328404413c25 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:46.830212 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e4087e5f-ab94-4034-bde7-328404413c25 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:46.831026 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e4087e5f-ab94-4034-bde7-328404413c25 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:46.831470 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e4087e5f-ab94-4034-bde7-328404413c25 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:47.007480 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e4087e5f-ab94-4034-bde7-328404413c25 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:47.016546 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e4087e5f-ab94-4034-bde7-328404413c25 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b" status: 200 len: 1475 microversion: 2.1 time: 0.202449 Oct 27 03:25:47.017142 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 793/1538] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:46 2022] GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b => generated 1475 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:47.026990 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-747e960d-b457-4fd3-b68d-42e76bea268d tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7ddee06040>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:47.071321 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-747e960d-b457-4fd3-b68d-42e76bea268d tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/images/7115c53b-83c1-4282-b3b3-cadb0c0b6d70" status: 200 len: 1413 microversion: 2.1 time: 0.048956 Oct 27 03:25:47.072378 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 794/1539] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:25:47 2022] GET /compute/v2.1/images/7115c53b-83c1-4282-b3b3-cadb0c0b6d70 => generated 1413 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:47.077795 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2938a522-08b5-49ba-a2dd-f1e8dfcbded9 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:47.078439 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-2938a522-08b5-49ba-a2dd-f1e8dfcbded9 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] [instance: 1d9172bd-aa20-4f49-87fa-64300cf861be] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:47.086834 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2938a522-08b5-49ba-a2dd-f1e8dfcbded9 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:47.087337 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2938a522-08b5-49ba-a2dd-f1e8dfcbded9 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:47.087811 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2938a522-08b5-49ba-a2dd-f1e8dfcbded9 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:47.088600 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2938a522-08b5-49ba-a2dd-f1e8dfcbded9 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:47.089349 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2938a522-08b5-49ba-a2dd-f1e8dfcbded9 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:47.089783 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2938a522-08b5-49ba-a2dd-f1e8dfcbded9 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:47.708539 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2938a522-08b5-49ba-a2dd-f1e8dfcbded9 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c65ddc0af5854d7a89192d01bc5f4576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c57f8e9a0e4debae18d98918ba8c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:47.734087 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2938a522-08b5-49ba-a2dd-f1e8dfcbded9 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] 10.222.0.20 "GET /compute/v2.1/servers/1d9172bd-aa20-4f49-87fa-64300cf861be" status: 200 len: 1557 microversion: 2.1 time: 0.660261 Oct 27 03:25:47.735779 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 795/1540] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:47 2022] GET /compute/v2.1/servers/1d9172bd-aa20-4f49-87fa-64300cf861be => generated 1557 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:48.026140 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-00f8aae4-6c9c-4f4c-b055-1881fd183669 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "POST /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.954921 Oct 27 03:25:48.027921 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 746/1541] 10.222.0.20 () {60 vars in 1323 bytes} [Thu Oct 27 03:25:46 2022] POST /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104/os-volume_attachments => generated 194 bytes in 1958 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:25:48.056370 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-be5a9e22-7afc-400b-abe5-380e35c35138 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:48.063904 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d416042f-75e2-4124-9a51-9e06b3fb4c66 tempest-FloatingIPsTestJSON-1550638952 tempest-FloatingIPsTestJSON-1550638952-project] Action: 'create', calling method: .version_select at 0x7f7ddee00670>, body: {"pool": null} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:25:48.071136 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-be5a9e22-7afc-400b-abe5-380e35c35138 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] [instance: 1d9172bd-aa20-4f49-87fa-64300cf861be] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:48.093354 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-be5a9e22-7afc-400b-abe5-380e35c35138 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:48.095352 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-be5a9e22-7afc-400b-abe5-380e35c35138 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:48.096266 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-be5a9e22-7afc-400b-abe5-380e35c35138 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:48.101435 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-be5a9e22-7afc-400b-abe5-380e35c35138 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:48.102332 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-be5a9e22-7afc-400b-abe5-380e35c35138 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:48.102950 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-be5a9e22-7afc-400b-abe5-380e35c35138 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:48.298263 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-be5a9e22-7afc-400b-abe5-380e35c35138 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] 10.222.0.20 "GET /compute/v2.1/servers/1d9172bd-aa20-4f49-87fa-64300cf861be/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.265959 Oct 27 03:25:48.301013 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 747/1542] 10.222.0.20 () {58 vars in 1275 bytes} [Thu Oct 27 03:25:48 2022] GET /compute/v2.1/servers/1d9172bd-aa20-4f49-87fa-64300cf861be/os-interface => generated 284 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:25:48.304881 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-059f8da6-6ff3-4504-8f32-d322863d9554 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:48.305635 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-059f8da6-6ff3-4504-8f32-d322863d9554 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] [instance: b3e22e1e-77a7-4f06-b099-eee6d631d3c9] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:48.322712 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-059f8da6-6ff3-4504-8f32-d322863d9554 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:48.325647 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-059f8da6-6ff3-4504-8f32-d322863d9554 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:48.326226 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-059f8da6-6ff3-4504-8f32-d322863d9554 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:48.329818 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-059f8da6-6ff3-4504-8f32-d322863d9554 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:48.329818 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-059f8da6-6ff3-4504-8f32-d322863d9554 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:48.329818 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-059f8da6-6ff3-4504-8f32-d322863d9554 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:49.163721 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-059f8da6-6ff3-4504-8f32-d322863d9554 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ccd5909fb214f71ad68704019c9e4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d2c150feac4d03966a860ab8bafe00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:49.173631 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-059f8da6-6ff3-4504-8f32-d322863d9554 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] 10.222.0.20 "GET /compute/v2.1/servers/b3e22e1e-77a7-4f06-b099-eee6d631d3c9" status: 200 len: 1471 microversion: 2.1 time: 0.873099 Oct 27 03:25:49.177093 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 748/1543] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:48 2022] GET /compute/v2.1/servers/b3e22e1e-77a7-4f06-b099-eee6d631d3c9 => generated 1471 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:49.184090 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-280736d7-00b8-4743-b063-b73c39191c70 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:49.196438 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-280736d7-00b8-4743-b063-b73c39191c70 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: e8781053-3dad-4951-b4cb-1f4aaf97e19b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:49.227017 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-280736d7-00b8-4743-b063-b73c39191c70 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:49.233974 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-280736d7-00b8-4743-b063-b73c39191c70 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:49.234897 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-280736d7-00b8-4743-b063-b73c39191c70 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:49.238354 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-280736d7-00b8-4743-b063-b73c39191c70 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:49.238354 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-280736d7-00b8-4743-b063-b73c39191c70 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:49.238354 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-280736d7-00b8-4743-b063-b73c39191c70 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:49.832463 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=6 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:25:50.043824 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-280736d7-00b8-4743-b063-b73c39191c70 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:50.054357 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-280736d7-00b8-4743-b063-b73c39191c70 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b" status: 200 len: 1473 microversion: 2.1 time: 0.873989 Oct 27 03:25:50.057796 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 749/1544] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:49 2022] GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b => generated 1473 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:50.075734 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2d28519c-93ae-4770-aa18-8e48646ef13f tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7ddab3dc10>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:50.207248 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2d28519c-93ae-4770-aa18-8e48646ef13f tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/images/7115c53b-83c1-4282-b3b3-cadb0c0b6d70" status: 200 len: 1413 microversion: 2.1 time: 0.145830 Oct 27 03:25:50.208626 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 750/1545] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:25:50 2022] GET /compute/v2.1/images/7115c53b-83c1-4282-b3b3-cadb0c0b6d70 => generated 1413 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:50.514762 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6d198c73-4a26-4b3c-be13-c9f636880f0f tempest-HypervisorAdminNegativeUnderV252Test-1242229464 tempest-HypervisorAdminNegativeUnderV252Test-1242229464-project-admin] Calling method '.version_select at 0x7f7dded66c10>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:50.516876 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6d198c73-4a26-4b3c-be13-c9f636880f0f tempest-HypervisorAdminNegativeUnderV252Test-1242229464 tempest-HypervisorAdminNegativeUnderV252Test-1242229464-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:50.517968 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6d198c73-4a26-4b3c-be13-c9f636880f0f tempest-HypervisorAdminNegativeUnderV252Test-1242229464 tempest-HypervisorAdminNegativeUnderV252Test-1242229464-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:50.519006 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6d198c73-4a26-4b3c-be13-c9f636880f0f tempest-HypervisorAdminNegativeUnderV252Test-1242229464 tempest-HypervisorAdminNegativeUnderV252Test-1242229464-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:50.556742 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6d198c73-4a26-4b3c-be13-c9f636880f0f tempest-HypervisorAdminNegativeUnderV252Test-1242229464 tempest-HypervisorAdminNegativeUnderV252Test-1242229464-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:50.557641 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6d198c73-4a26-4b3c-be13-c9f636880f0f tempest-HypervisorAdminNegativeUnderV252Test-1242229464 tempest-HypervisorAdminNegativeUnderV252Test-1242229464-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:50.558300 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6d198c73-4a26-4b3c-be13-c9f636880f0f tempest-HypervisorAdminNegativeUnderV252Test-1242229464 tempest-HypervisorAdminNegativeUnderV252Test-1242229464-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:50.584170 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6d198c73-4a26-4b3c-be13-c9f636880f0f tempest-HypervisorAdminNegativeUnderV252Test-1242229464 tempest-HypervisorAdminNegativeUnderV252Test-1242229464-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:50.584946 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6d198c73-4a26-4b3c-be13-c9f636880f0f tempest-HypervisorAdminNegativeUnderV252Test-1242229464 tempest-HypervisorAdminNegativeUnderV252Test-1242229464-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:50.586577 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6d198c73-4a26-4b3c-be13-c9f636880f0f tempest-HypervisorAdminNegativeUnderV252Test-1242229464 tempest-HypervisorAdminNegativeUnderV252Test-1242229464-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:50.608596 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6d198c73-4a26-4b3c-be13-c9f636880f0f tempest-HypervisorAdminNegativeUnderV252Test-1242229464 tempest-HypervisorAdminNegativeUnderV252Test-1242229464-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.398650 Oct 27 03:25:50.616943 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 751/1546] 10.222.0.20 () {58 vars in 1146 bytes} [Thu Oct 27 03:25:50 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:25:50.640827 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ae69bd9e-8494-4c71-a4e5-166bad0a0912 tempest-ServersAdminNegativeTestJSON-1854954566 tempest-ServersAdminNegativeTestJSON-1854954566-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:25:50.641404 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ae69bd9e-8494-4c71-a4e5-166bad0a0912 tempest-ServersAdminNegativeTestJSON-1854954566 tempest-ServersAdminNegativeTestJSON-1854954566-project-admin] [instance: b3e22e1e-77a7-4f06-b099-eee6d631d3c9] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:50.673831 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ae69bd9e-8494-4c71-a4e5-166bad0a0912 tempest-ServersAdminNegativeTestJSON-1854954566 tempest-ServersAdminNegativeTestJSON-1854954566-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:50.674411 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ae69bd9e-8494-4c71-a4e5-166bad0a0912 tempest-ServersAdminNegativeTestJSON-1854954566 tempest-ServersAdminNegativeTestJSON-1854954566-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:50.674867 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ae69bd9e-8494-4c71-a4e5-166bad0a0912 tempest-ServersAdminNegativeTestJSON-1854954566 tempest-ServersAdminNegativeTestJSON-1854954566-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:50.675621 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ae69bd9e-8494-4c71-a4e5-166bad0a0912 tempest-ServersAdminNegativeTestJSON-1854954566 tempest-ServersAdminNegativeTestJSON-1854954566-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:50.676124 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ae69bd9e-8494-4c71-a4e5-166bad0a0912 tempest-ServersAdminNegativeTestJSON-1854954566 tempest-ServersAdminNegativeTestJSON-1854954566-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:50.676548 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ae69bd9e-8494-4c71-a4e5-166bad0a0912 tempest-ServersAdminNegativeTestJSON-1854954566 tempest-ServersAdminNegativeTestJSON-1854954566-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:50.773824 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-ae69bd9e-8494-4c71-a4e5-166bad0a0912 tempest-ServersAdminNegativeTestJSON-1854954566 tempest-ServersAdminNegativeTestJSON-1854954566-project-admin] Lazy-loading 'flavor' on Instance uuid b3e22e1e-77a7-4f06-b099-eee6d631d3c9 {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:25:51.126603 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ae69bd9e-8494-4c71-a4e5-166bad0a0912 tempest-ServersAdminNegativeTestJSON-1854954566 tempest-ServersAdminNegativeTestJSON-1854954566-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/b3e22e1e-77a7-4f06-b099-eee6d631d3c9/action" status: 202 len: 0 microversion: 2.1 time: 0.506011 Oct 27 03:25:51.127409 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 752/1547] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:25:50 2022] POST /compute/v2.1/servers/b3e22e1e-77a7-4f06-b099-eee6d631d3c9/action => generated 0 bytes in 509 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:25:51.387229 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3e7cc6d2-f5fd-4ec3-84ed-cb0287c85c8e tempest-HypervisorAdminNegativeUnderV252Test-944054468 tempest-HypervisorAdminNegativeUnderV252Test-944054468-project] Calling method '.version_select at 0x7f7ddac9dd30>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:51.389502 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3e7cc6d2-f5fd-4ec3-84ed-cb0287c85c8e tempest-HypervisorAdminNegativeUnderV252Test-944054468 tempest-HypervisorAdminNegativeUnderV252Test-944054468-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': 'debcb19de6304ccc8bb18e4e03633181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ae060395764d6599a182638513bed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:51.391248 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3e7cc6d2-f5fd-4ec3-84ed-cb0287c85c8e tempest-HypervisorAdminNegativeUnderV252Test-944054468 tempest-HypervisorAdminNegativeUnderV252Test-944054468-project] Request method failure captured: Oct 27 03:25:51.391248 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/os-hypervisors/n-h2-862769-1/search HTTP/1.1 Oct 27 03:25:51.391248 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:25:51.391248 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:25:51.391248 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:25:51.391248 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:25:51.391248 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:25:51.391248 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:25:51.391248 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:25:51.391248 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:25:51.391248 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfo71Y-2Bqx8tWn3Xr7PiFyHuy1DfKdBwyMT8cSpjSyvJE0hNr93DWN1pkHp3kw2Rd0MPojySX1-iOrRZHlJX5sGtXv5CVUKB74btmiZl-N7RQzcGNjWd8l8qiAAlmiQ-dbsnmyRR9oYGkJpqDqRfyKAcor_SA7tkZeqWlxrSQ0YFS0 Oct 27 03:25:51.391248 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:25:51.391248 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:25:51.391248 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:25:51.391248 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:25:51.391248 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:25:51.391248 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:25:51.391248 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: b2ae060395764d6599a182638513bed9 Oct 27 03:25:51.391248 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-944054468 Oct 27 03:25:51.391248 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:25:51.391248 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:25:51.392861 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b2ae060395764d6599a182638513bed9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b2ae060395764d6599a182638513bed9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b2ae060395764d6599a182638513bed9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b2ae060395764d6599a182638513bed9"}]}] Oct 27 03:25:51.392861 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-944054468 Oct 27 03:25:51.392861 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: b2ae060395764d6599a182638513bed9 Oct 27 03:25:51.392861 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-944054468 Oct 27 03:25:51.392861 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-944054468-project Oct 27 03:25:51.392861 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:25:51.392861 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:25:51.392861 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: debcb19de6304ccc8bb18e4e03633181 Oct 27 03:25:51.392861 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-944054468-project Oct 27 03:25:51.392861 n-d-862769-1 devstack@n-api.service[121001]: method: Oct 27 03:25:51.392861 n-d-862769-1 devstack@n-api.service[121001]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 27 03:25:51.392861 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': 'n-h2-862769-1'} Oct 27 03:25:51.393785 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:25:51.393785 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:25:51.393785 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:25:51.393785 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:25:51.393785 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:25:51.393785 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:25:51.393785 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:25:51.393785 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:25:51.393785 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:25:51.393785 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:25:51.393785 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Oct 27 03:25:51.393785 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Oct 27 03:25:51.393785 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 03:25:51.393785 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 03:25:51.393785 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 03:25:51.393785 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 03:25:51.393785 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 03:25:51.393785 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 03:25:51.393785 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 03:25:51.395071 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 03:25:51.395071 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 03:25:51.395071 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 03:25:51.395071 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 03:25:51.395071 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 03:25:51.395071 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 03:25:51.395071 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 03:25:51.395071 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 27 03:25:51.395071 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:25:51.395071 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:25:51.395071 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:25:51.395071 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:25:51.395071 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:25:51.395071 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:25:51.395071 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 03:25:51.395071 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 03:25:51.395071 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 27 03:25:51.395071 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:25:51.396328 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3e7cc6d2-f5fd-4ec3-84ed-cb0287c85c8e tempest-HypervisorAdminNegativeUnderV252Test-944054468 tempest-HypervisorAdminNegativeUnderV252Test-944054468-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:25:51.396328 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3e7cc6d2-f5fd-4ec3-84ed-cb0287c85c8e tempest-HypervisorAdminNegativeUnderV252Test-944054468 tempest-HypervisorAdminNegativeUnderV252Test-944054468-project] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/n-h2-862769-1/search" status: 403 len: 117 microversion: 2.1 time: 0.266407 Oct 27 03:25:51.403101 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 753/1548] 10.222.0.20 () {58 vars in 1209 bytes} [Thu Oct 27 03:25:51 2022] GET /compute/v2.1/os-hypervisors/n-h2-862769-1/search => generated 117 bytes in 275 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:25:51.414568 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d85dad60-999f-43cc-bb03-9c5b0fefdeb6 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:51.415462 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d85dad60-999f-43cc-bb03-9c5b0fefdeb6 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: e8781053-3dad-4951-b4cb-1f4aaf97e19b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:51.432877 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d85dad60-999f-43cc-bb03-9c5b0fefdeb6 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:51.453841 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d85dad60-999f-43cc-bb03-9c5b0fefdeb6 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:51.458462 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d85dad60-999f-43cc-bb03-9c5b0fefdeb6 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:51.461860 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d85dad60-999f-43cc-bb03-9c5b0fefdeb6 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:51.462406 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d85dad60-999f-43cc-bb03-9c5b0fefdeb6 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:51.462865 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d85dad60-999f-43cc-bb03-9c5b0fefdeb6 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:51.688595 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d85dad60-999f-43cc-bb03-9c5b0fefdeb6 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:51.697675 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d85dad60-999f-43cc-bb03-9c5b0fefdeb6 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b" status: 200 len: 1470 microversion: 2.1 time: 0.293295 Oct 27 03:25:51.699529 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 754/1549] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:51 2022] GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b => generated 1470 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:51.706369 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4df7c3a1-4d98-49fd-a0d5-a43505b31849 tempest-ServersAdminNegativeTestJSON-1854954566 tempest-ServersAdminNegativeTestJSON-1854954566-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:51.707199 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4df7c3a1-4d98-49fd-a0d5-a43505b31849 tempest-ServersAdminNegativeTestJSON-1854954566 tempest-ServersAdminNegativeTestJSON-1854954566-project-admin] [instance: b3e22e1e-77a7-4f06-b099-eee6d631d3c9] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:51.714517 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4df7c3a1-4d98-49fd-a0d5-a43505b31849 tempest-ServersAdminNegativeTestJSON-1854954566 tempest-ServersAdminNegativeTestJSON-1854954566-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:51.715315 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4df7c3a1-4d98-49fd-a0d5-a43505b31849 tempest-ServersAdminNegativeTestJSON-1854954566 tempest-ServersAdminNegativeTestJSON-1854954566-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:51.715942 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4df7c3a1-4d98-49fd-a0d5-a43505b31849 tempest-ServersAdminNegativeTestJSON-1854954566 tempest-ServersAdminNegativeTestJSON-1854954566-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:51.716838 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4df7c3a1-4d98-49fd-a0d5-a43505b31849 tempest-ServersAdminNegativeTestJSON-1854954566 tempest-ServersAdminNegativeTestJSON-1854954566-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:51.717506 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4df7c3a1-4d98-49fd-a0d5-a43505b31849 tempest-ServersAdminNegativeTestJSON-1854954566 tempest-ServersAdminNegativeTestJSON-1854954566-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:51.718127 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4df7c3a1-4d98-49fd-a0d5-a43505b31849 tempest-ServersAdminNegativeTestJSON-1854954566 tempest-ServersAdminNegativeTestJSON-1854954566-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:51.744950 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:25:52.004198 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d416042f-75e2-4124-9a51-9e06b3fb4c66 tempest-FloatingIPsTestJSON-1550638952 tempest-FloatingIPsTestJSON-1550638952-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.267154 Oct 27 03:25:52.005345 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 796/1550] 10.222.0.20 () {60 vars in 1170 bytes} [Thu Oct 27 03:25:47 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:25:52.010303 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-51c1f33b-fce8-4158-8ea4-80030eee6f48 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7ddee32ca0>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:52.085835 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-51c1f33b-fce8-4158-8ea4-80030eee6f48 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/images/7115c53b-83c1-4282-b3b3-cadb0c0b6d70" status: 200 len: 1413 microversion: 2.1 time: 0.079242 Oct 27 03:25:52.087329 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 797/1551] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:25:52 2022] GET /compute/v2.1/images/7115c53b-83c1-4282-b3b3-cadb0c0b6d70 => generated 1413 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:52.093343 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8ba1dc51-7300-4665-806a-27ff4d0c3487 tempest-HypervisorAdminNegativeUnderV252Test-1242229464 tempest-HypervisorAdminNegativeUnderV252Test-1242229464-project-admin] Calling method '.version_select at 0x7f7ddee06280>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:52.103869 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8ba1dc51-7300-4665-806a-27ff4d0c3487 tempest-HypervisorAdminNegativeUnderV252Test-1242229464 tempest-HypervisorAdminNegativeUnderV252Test-1242229464-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:52.106356 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8ba1dc51-7300-4665-806a-27ff4d0c3487 tempest-HypervisorAdminNegativeUnderV252Test-1242229464 tempest-HypervisorAdminNegativeUnderV252Test-1242229464-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:52.107989 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8ba1dc51-7300-4665-806a-27ff4d0c3487 tempest-HypervisorAdminNegativeUnderV252Test-1242229464 tempest-HypervisorAdminNegativeUnderV252Test-1242229464-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:52.130942 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-8ba1dc51-7300-4665-806a-27ff4d0c3487 tempest-HypervisorAdminNegativeUnderV252Test-1242229464 tempest-HypervisorAdminNegativeUnderV252Test-1242229464-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 27 03:25:52.132861 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8ba1dc51-7300-4665-806a-27ff4d0c3487 tempest-HypervisorAdminNegativeUnderV252Test-1242229464 tempest-HypervisorAdminNegativeUnderV252Test-1242229464-project-admin] Request method failure captured: Oct 27 03:25:52.132861 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Oct 27 03:25:52.132861 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:25:52.132861 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:25:52.132861 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:25:52.132861 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:25:52.132861 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:25:52.132861 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:25:52.132861 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:25:52.132861 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:25:52.132861 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfo8snsLEixHNpJ2x8HrE_ZGOtF8lFxZVtn7FicWd7j8Ms3uIT7NR8dbx7Q0nzLvnsaU3y5vvoBG-B5w8xT0BBOCnD8tM8QYPVzISbnhzKQdlspm1iKg2EMLSwr0oc-etZLDVKYeYnjE6boXH6NumlvEsIzll4filyk11U0VFvnkY48 Oct 27 03:25:52.132861 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:25:52.132861 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:25:52.132861 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:25:52.132861 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:25:52.132861 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:25:52.132861 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:25:52.132861 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: d63acd3e6b3544759e412f95a428a4ec Oct 27 03:25:52.132861 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1242229464 Oct 27 03:25:52.132861 n-d-862769-1 devstack@n-api.service[121000]: X-Role: admin,member,reader Oct 27 03:25:52.132861 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: admin,member,reader Oct 27 03:25:52.134389 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d63acd3e6b3544759e412f95a428a4ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d63acd3e6b3544759e412f95a428a4ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d63acd3e6b3544759e412f95a428a4ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d63acd3e6b3544759e412f95a428a4ec"}]}] Oct 27 03:25:52.134389 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1242229464 Oct 27 03:25:52.134389 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: d63acd3e6b3544759e412f95a428a4ec Oct 27 03:25:52.134389 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1242229464 Oct 27 03:25:52.134389 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1242229464-project-admin Oct 27 03:25:52.134389 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:25:52.134389 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:25:52.134389 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 6b37b5b692944acebc314deff793444b Oct 27 03:25:52.134389 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1242229464-project-admin Oct 27 03:25:52.134389 n-d-862769-1 devstack@n-api.service[121000]: method: Oct 27 03:25:52.134389 n-d-862769-1 devstack@n-api.service[121000]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 27 03:25:52.134389 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': 'nonexistent_hypervisor_name'} Oct 27 03:25:52.135151 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:25:52.135151 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:25:52.135151 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:25:52.135151 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:25:52.135151 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:25:52.135151 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:25:52.135151 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:25:52.135151 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:25:52.135151 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:25:52.135151 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:25:52.135151 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Oct 27 03:25:52.135151 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 27 03:25:52.135151 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 27 03:25:52.135151 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 27 03:25:52.135151 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 27 03:25:52.135151 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:25:52.135151 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:25:52.135151 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:25:52.135151 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:25:52.135151 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:25:52.136382 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:25:52.136382 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:25:52.136382 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:25:52.136382 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 27 03:25:52.136382 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:25:52.139753 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8ba1dc51-7300-4665-806a-27ff4d0c3487 tempest-HypervisorAdminNegativeUnderV252Test-1242229464 tempest-HypervisorAdminNegativeUnderV252Test-1242229464-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:25:52.140924 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8ba1dc51-7300-4665-806a-27ff4d0c3487 tempest-HypervisorAdminNegativeUnderV252Test-1242229464 tempest-HypervisorAdminNegativeUnderV252Test-1242229464-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.051205 Oct 27 03:25:52.148448 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 798/1552] 10.222.0.20 () {58 vars in 1251 bytes} [Thu Oct 27 03:25:52 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:25:52.170191 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-03f75f4a-9439-4435-ab5e-a7f327b1b1af req-dc6d8b53-d26b-4cf0-a88a-f6603a352cb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d9172bd-aa20-4f49-87fa-64300cf861be", "tag": "7137a87b-6939-4f63-9975-97cc9919bde1"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:25:52.192317 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-03f75f4a-9439-4435-ab5e-a7f327b1b1af req-dc6d8b53-d26b-4cf0-a88a-f6603a352cb9 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:52.193134 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-03f75f4a-9439-4435-ab5e-a7f327b1b1af req-dc6d8b53-d26b-4cf0-a88a-f6603a352cb9 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:52.193789 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-03f75f4a-9439-4435-ab5e-a7f327b1b1af req-dc6d8b53-d26b-4cf0-a88a-f6603a352cb9 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:52.198255 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4df7c3a1-4d98-49fd-a0d5-a43505b31849 tempest-ServersAdminNegativeTestJSON-1854954566 tempest-ServersAdminNegativeTestJSON-1854954566-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/b3e22e1e-77a7-4f06-b099-eee6d631d3c9" status: 200 len: 1630 microversion: 2.1 time: 0.496825 Oct 27 03:25:52.199724 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 755/1553] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:51 2022] GET /compute/v2.1/servers/b3e22e1e-77a7-4f06-b099-eee6d631d3c9 => generated 1630 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:52.231326 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-03f75f4a-9439-4435-ab5e-a7f327b1b1af req-dc6d8b53-d26b-4cf0-a88a-f6603a352cb9 service nova] Creating event network-changed:7137a87b-6939-4f63-9975-97cc9919bde1 for instance 1d9172bd-aa20-4f49-87fa-64300cf861be on n-h1-862769-1 Oct 27 03:25:52.232474 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d3b0d432-ebb4-45ef-9110-4d8e13a8e766 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:25:52.234417 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d3b0d432-ebb4-45ef-9110-4d8e13a8e766 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: e8781053-3dad-4951-b4cb-1f4aaf97e19b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:52.240273 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-03f75f4a-9439-4435-ab5e-a7f327b1b1af req-dc6d8b53-d26b-4cf0-a88a-f6603a352cb9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088595 Oct 27 03:25:52.240273 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 799/1554] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:25:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:25:52.247037 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-472a212f-3c60-47a5-8ecb-e43210ba16f1 tempest-FloatingIPsTestJSON-1550638952 tempest-FloatingIPsTestJSON-1550638952-project] Calling method '.version_select at 0x7f7ddaac5ee0>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:52.255362 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d3b0d432-ebb4-45ef-9110-4d8e13a8e766 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:52.255863 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d3b0d432-ebb4-45ef-9110-4d8e13a8e766 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:52.257222 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d3b0d432-ebb4-45ef-9110-4d8e13a8e766 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:52.258909 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d3b0d432-ebb4-45ef-9110-4d8e13a8e766 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:52.259385 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d3b0d432-ebb4-45ef-9110-4d8e13a8e766 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:52.260174 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d3b0d432-ebb4-45ef-9110-4d8e13a8e766 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:52.749699 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d3b0d432-ebb4-45ef-9110-4d8e13a8e766 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "POST /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b/action" status: 202 len: 0 microversion: 2.1 time: 0.547113 Oct 27 03:25:52.750403 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 756/1555] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:25:52 2022] POST /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b/action => generated 0 bytes in 549 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:25:52.759254 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-76ea149c-2563-46a7-91ec-a674e908bd59 tempest-HypervisorAdminNegativeUnderV252Test-1242229464 tempest-HypervisorAdminNegativeUnderV252Test-1242229464-project-admin] Calling method '.version_select at 0x7f7ddab3dca0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:52.777418 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-76ea149c-2563-46a7-91ec-a674e908bd59 tempest-HypervisorAdminNegativeUnderV252Test-1242229464 tempest-HypervisorAdminNegativeUnderV252Test-1242229464-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:52.777938 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-76ea149c-2563-46a7-91ec-a674e908bd59 tempest-HypervisorAdminNegativeUnderV252Test-1242229464 tempest-HypervisorAdminNegativeUnderV252Test-1242229464-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:52.778561 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-76ea149c-2563-46a7-91ec-a674e908bd59 tempest-HypervisorAdminNegativeUnderV252Test-1242229464 tempest-HypervisorAdminNegativeUnderV252Test-1242229464-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:52.798648 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-472a212f-3c60-47a5-8ecb-e43210ba16f1 tempest-FloatingIPsTestJSON-1550638952 tempest-FloatingIPsTestJSON-1550638952-project] 10.222.0.20 "GET /compute/v2.1/os-floating-ips/4a818186-dd60-4aad-8846-5b8320feab88" status: 200 len: 142 microversion: 2.1 time: 0.556035 Oct 27 03:25:52.800508 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 800/1556] 10.222.0.20 () {58 vars in 1260 bytes} [Thu Oct 27 03:25:52 2022] GET /compute/v2.1/os-floating-ips/4a818186-dd60-4aad-8846-5b8320feab88 => generated 142 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:25:52.805323 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-76ea149c-2563-46a7-91ec-a674e908bd59 tempest-HypervisorAdminNegativeUnderV252Test-1242229464 tempest-HypervisorAdminNegativeUnderV252Test-1242229464-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:52.805323 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-76ea149c-2563-46a7-91ec-a674e908bd59 tempest-HypervisorAdminNegativeUnderV252Test-1242229464 tempest-HypervisorAdminNegativeUnderV252Test-1242229464-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:52.805323 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-76ea149c-2563-46a7-91ec-a674e908bd59 tempest-HypervisorAdminNegativeUnderV252Test-1242229464 tempest-HypervisorAdminNegativeUnderV252Test-1242229464-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:52.809446 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e2df29f9-cdfc-403f-b0d6-010fbbaa2446 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:52.810872 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e2df29f9-cdfc-403f-b0d6-010fbbaa2446 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: e8781053-3dad-4951-b4cb-1f4aaf97e19b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:52.818364 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-76ea149c-2563-46a7-91ec-a674e908bd59 tempest-HypervisorAdminNegativeUnderV252Test-1242229464 tempest-HypervisorAdminNegativeUnderV252Test-1242229464-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:52.819158 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-76ea149c-2563-46a7-91ec-a674e908bd59 tempest-HypervisorAdminNegativeUnderV252Test-1242229464 tempest-HypervisorAdminNegativeUnderV252Test-1242229464-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:52.819754 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-76ea149c-2563-46a7-91ec-a674e908bd59 tempest-HypervisorAdminNegativeUnderV252Test-1242229464 tempest-HypervisorAdminNegativeUnderV252Test-1242229464-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:52.827480 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e2df29f9-cdfc-403f-b0d6-010fbbaa2446 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:52.827958 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-76ea149c-2563-46a7-91ec-a674e908bd59 tempest-HypervisorAdminNegativeUnderV252Test-1242229464 tempest-HypervisorAdminNegativeUnderV252Test-1242229464-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.075062 Oct 27 03:25:52.828543 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e2df29f9-cdfc-403f-b0d6-010fbbaa2446 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:52.833621 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 757/1557] 10.222.0.20 () {58 vars in 1146 bytes} [Thu Oct 27 03:25:52 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:25:52.833934 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e2df29f9-cdfc-403f-b0d6-010fbbaa2446 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:52.833934 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e2df29f9-cdfc-403f-b0d6-010fbbaa2446 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:52.834855 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e2df29f9-cdfc-403f-b0d6-010fbbaa2446 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:52.835481 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e2df29f9-cdfc-403f-b0d6-010fbbaa2446 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:52.840497 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-eca982c3-7822-49e7-8f90-1fac3592a651 tempest-FloatingIPsTestJSON-1550638952 tempest-FloatingIPsTestJSON-1550638952-project] Calling method '.version_select at 0x7f7ddac4c5e0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:53.319537 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-eca982c3-7822-49e7-8f90-1fac3592a651 tempest-FloatingIPsTestJSON-1550638952 tempest-FloatingIPsTestJSON-1550638952-project] 10.222.0.20 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.489674 Oct 27 03:25:53.321010 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 758/1558] 10.222.0.20 () {58 vars in 1149 bytes} [Thu Oct 27 03:25:52 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:25:53.325690 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-246cf1c3-33af-43d5-a9da-af09edea4a6e tempest-HypervisorAdminNegativeUnderV252Test-944054468 tempest-HypervisorAdminNegativeUnderV252Test-944054468-project] Calling method '.version_select at 0x7f7dded9b670>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:53.327507 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-246cf1c3-33af-43d5-a9da-af09edea4a6e tempest-HypervisorAdminNegativeUnderV252Test-944054468 tempest-HypervisorAdminNegativeUnderV252Test-944054468-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': 'debcb19de6304ccc8bb18e4e03633181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ae060395764d6599a182638513bed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:53.339363 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-246cf1c3-33af-43d5-a9da-af09edea4a6e tempest-HypervisorAdminNegativeUnderV252Test-944054468 tempest-HypervisorAdminNegativeUnderV252Test-944054468-project] Request method failure captured: Oct 27 03:25:53.339363 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Oct 27 03:25:53.339363 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:25:53.339363 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:25:53.339363 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:25:53.339363 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:25:53.339363 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:25:53.339363 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:25:53.339363 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:25:53.339363 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:25:53.339363 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfo71Y-2Bqx8tWn3Xr7PiFyHuy1DfKdBwyMT8cSpjSyvJE0hNr93DWN1pkHp3kw2Rd0MPojySX1-iOrRZHlJX5sGtXv5CVUKB74btmiZl-N7RQzcGNjWd8l8qiAAlmiQ-dbsnmyRR9oYGkJpqDqRfyKAcor_SA7tkZeqWlxrSQ0YFS0 Oct 27 03:25:53.339363 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:25:53.339363 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:25:53.339363 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:25:53.339363 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:25:53.339363 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:25:53.339363 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:25:53.339363 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: b2ae060395764d6599a182638513bed9 Oct 27 03:25:53.339363 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-944054468 Oct 27 03:25:53.339363 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:25:53.339363 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:25:53.340988 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b2ae060395764d6599a182638513bed9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b2ae060395764d6599a182638513bed9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b2ae060395764d6599a182638513bed9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b2ae060395764d6599a182638513bed9"}]}] Oct 27 03:25:53.340988 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-944054468 Oct 27 03:25:53.340988 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: b2ae060395764d6599a182638513bed9 Oct 27 03:25:53.340988 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-944054468 Oct 27 03:25:53.340988 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-944054468-project Oct 27 03:25:53.340988 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:25:53.340988 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:25:53.340988 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: debcb19de6304ccc8bb18e4e03633181 Oct 27 03:25:53.340988 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-944054468-project Oct 27 03:25:53.340988 n-d-862769-1 devstack@n-api.service[121001]: method: Oct 27 03:25:53.340988 n-d-862769-1 devstack@n-api.service[121001]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 27 03:25:53.340988 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '1'} Oct 27 03:25:53.341864 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:25:53.341864 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:25:53.341864 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:25:53.341864 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:25:53.341864 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:25:53.341864 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:25:53.341864 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:25:53.341864 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:25:53.341864 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:25:53.341864 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:25:53.341864 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Oct 27 03:25:53.341864 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Oct 27 03:25:53.341864 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 03:25:53.341864 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 03:25:53.341864 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 03:25:53.341864 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 03:25:53.341864 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 03:25:53.341864 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 03:25:53.341864 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 03:25:53.343414 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 03:25:53.343414 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 03:25:53.343414 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 03:25:53.343414 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 03:25:53.343414 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 03:25:53.343414 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 03:25:53.343414 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 03:25:53.343414 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 27 03:25:53.343414 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:25:53.343414 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:25:53.343414 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:25:53.343414 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:25:53.343414 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:25:53.343414 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:25:53.343414 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 03:25:53.343414 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 03:25:53.343414 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 27 03:25:53.343414 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:25:53.344689 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-246cf1c3-33af-43d5-a9da-af09edea4a6e tempest-HypervisorAdminNegativeUnderV252Test-944054468 tempest-HypervisorAdminNegativeUnderV252Test-944054468-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:25:53.344689 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-246cf1c3-33af-43d5-a9da-af09edea4a6e tempest-HypervisorAdminNegativeUnderV252Test-944054468 tempest-HypervisorAdminNegativeUnderV252Test-944054468-project] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.018845 Oct 27 03:25:53.348199 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 759/1559] 10.222.0.20 () {58 vars in 1176 bytes} [Thu Oct 27 03:25:53 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:25:53.356349 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a7ac1d04-3c48-4df3-8323-4fa61d1e593a tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7dded6d310>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:53.371753 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e2df29f9-cdfc-403f-b0d6-010fbbaa2446 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:53.382639 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e2df29f9-cdfc-403f-b0d6-010fbbaa2446 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b" status: 200 len: 1469 microversion: 2.1 time: 0.580918 Oct 27 03:25:53.388307 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 801/1560] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:52 2022] GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b => generated 1469 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:53.416673 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-506a666f-aa00-4ed7-a331-ab4661a8cf5a tempest-ServersAdminNegativeTestJSON-1854954566 tempest-ServersAdminNegativeTestJSON-1854954566-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:53.431592 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-506a666f-aa00-4ed7-a331-ab4661a8cf5a tempest-ServersAdminNegativeTestJSON-1854954566 tempest-ServersAdminNegativeTestJSON-1854954566-project-admin] [instance: b3e22e1e-77a7-4f06-b099-eee6d631d3c9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:53.448619 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-506a666f-aa00-4ed7-a331-ab4661a8cf5a tempest-ServersAdminNegativeTestJSON-1854954566 tempest-ServersAdminNegativeTestJSON-1854954566-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:53.449431 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-506a666f-aa00-4ed7-a331-ab4661a8cf5a tempest-ServersAdminNegativeTestJSON-1854954566 tempest-ServersAdminNegativeTestJSON-1854954566-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:53.450064 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-506a666f-aa00-4ed7-a331-ab4661a8cf5a tempest-ServersAdminNegativeTestJSON-1854954566 tempest-ServersAdminNegativeTestJSON-1854954566-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:53.450959 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-506a666f-aa00-4ed7-a331-ab4661a8cf5a tempest-ServersAdminNegativeTestJSON-1854954566 tempest-ServersAdminNegativeTestJSON-1854954566-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:53.451579 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-506a666f-aa00-4ed7-a331-ab4661a8cf5a tempest-ServersAdminNegativeTestJSON-1854954566 tempest-ServersAdminNegativeTestJSON-1854954566-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:53.452670 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-506a666f-aa00-4ed7-a331-ab4661a8cf5a tempest-ServersAdminNegativeTestJSON-1854954566 tempest-ServersAdminNegativeTestJSON-1854954566-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:53.483226 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a7ac1d04-3c48-4df3-8323-4fa61d1e593a tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/images/7115c53b-83c1-4282-b3b3-cadb0c0b6d70" status: 200 len: 1413 microversion: 2.1 time: 0.131631 Oct 27 03:25:53.484109 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 760/1561] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:25:53 2022] GET /compute/v2.1/images/7115c53b-83c1-4282-b3b3-cadb0c0b6d70 => generated 1413 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:53.495549 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-dfeb093a-5cde-4e1e-b911-03b8f3100156 tempest-FloatingIPsTestJSON-1550638952 tempest-FloatingIPsTestJSON-1550638952-project] Calling method '.version_select at 0x7f7ddab728b0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:54.080460 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-506a666f-aa00-4ed7-a331-ab4661a8cf5a tempest-ServersAdminNegativeTestJSON-1854954566 tempest-ServersAdminNegativeTestJSON-1854954566-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/b3e22e1e-77a7-4f06-b099-eee6d631d3c9" status: 200 len: 1613 microversion: 2.1 time: 0.690836 Oct 27 03:25:54.081333 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 802/1562] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:53 2022] GET /compute/v2.1/servers/b3e22e1e-77a7-4f06-b099-eee6d631d3c9 => generated 1613 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:54.085884 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-616b2f17-8da2-41fa-865c-5eb99c7835bb tempest-HypervisorAdminNegativeUnderV252Test-1242229464 tempest-HypervisorAdminNegativeUnderV252Test-1242229464-project-admin] Calling method '.version_select at 0x7f7ddeda1d30>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:54.091817 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-616b2f17-8da2-41fa-865c-5eb99c7835bb tempest-HypervisorAdminNegativeUnderV252Test-1242229464 tempest-HypervisorAdminNegativeUnderV252Test-1242229464-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:54.092530 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-616b2f17-8da2-41fa-865c-5eb99c7835bb tempest-HypervisorAdminNegativeUnderV252Test-1242229464 tempest-HypervisorAdminNegativeUnderV252Test-1242229464-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:54.093138 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-616b2f17-8da2-41fa-865c-5eb99c7835bb tempest-HypervisorAdminNegativeUnderV252Test-1242229464 tempest-HypervisorAdminNegativeUnderV252Test-1242229464-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:54.112474 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-616b2f17-8da2-41fa-865c-5eb99c7835bb tempest-HypervisorAdminNegativeUnderV252Test-1242229464 tempest-HypervisorAdminNegativeUnderV252Test-1242229464-project-admin] HTTP exception thrown: No hypervisor matching '346f59ba-c1bd-44fa-b298-0e59af050267' could be found. Oct 27 03:25:54.120060 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-616b2f17-8da2-41fa-865c-5eb99c7835bb tempest-HypervisorAdminNegativeUnderV252Test-1242229464 tempest-HypervisorAdminNegativeUnderV252Test-1242229464-project-admin] Request method failure captured: Oct 27 03:25:54.120060 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/os-hypervisors/346f59ba-c1bd-44fa-b298-0e59af050267/servers HTTP/1.1 Oct 27 03:25:54.120060 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:25:54.120060 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:25:54.120060 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:25:54.120060 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:25:54.120060 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:25:54.120060 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:25:54.120060 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:25:54.120060 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:25:54.120060 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfo8snsLEixHNpJ2x8HrE_ZGOtF8lFxZVtn7FicWd7j8Ms3uIT7NR8dbx7Q0nzLvnsaU3y5vvoBG-B5w8xT0BBOCnD8tM8QYPVzISbnhzKQdlspm1iKg2EMLSwr0oc-etZLDVKYeYnjE6boXH6NumlvEsIzll4filyk11U0VFvnkY48 Oct 27 03:25:54.120060 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:25:54.120060 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:25:54.120060 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:25:54.120060 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:25:54.120060 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:25:54.120060 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:25:54.120060 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: d63acd3e6b3544759e412f95a428a4ec Oct 27 03:25:54.120060 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1242229464 Oct 27 03:25:54.120060 n-d-862769-1 devstack@n-api.service[121000]: X-Role: admin,member,reader Oct 27 03:25:54.120060 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: admin,member,reader Oct 27 03:25:54.121709 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d63acd3e6b3544759e412f95a428a4ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d63acd3e6b3544759e412f95a428a4ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d63acd3e6b3544759e412f95a428a4ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d63acd3e6b3544759e412f95a428a4ec"}]}] Oct 27 03:25:54.121709 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1242229464 Oct 27 03:25:54.121709 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: d63acd3e6b3544759e412f95a428a4ec Oct 27 03:25:54.121709 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1242229464 Oct 27 03:25:54.121709 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1242229464-project-admin Oct 27 03:25:54.121709 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:25:54.121709 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:25:54.121709 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 6b37b5b692944acebc314deff793444b Oct 27 03:25:54.121709 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1242229464-project-admin Oct 27 03:25:54.121709 n-d-862769-1 devstack@n-api.service[121000]: method: Oct 27 03:25:54.121709 n-d-862769-1 devstack@n-api.service[121000]: exception: No hypervisor matching '346f59ba-c1bd-44fa-b298-0e59af050267' could be found. Oct 27 03:25:54.121709 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '346f59ba-c1bd-44fa-b298-0e59af050267'} Oct 27 03:25:54.122713 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:25:54.122713 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:25:54.122713 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:25:54.122713 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:25:54.122713 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:25:54.122713 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:25:54.122713 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:25:54.122713 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:25:54.122713 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:25:54.122713 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:25:54.122713 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Oct 27 03:25:54.122713 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 27 03:25:54.122713 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 27 03:25:54.122713 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 27 03:25:54.122713 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '346f59ba-c1bd-44fa-b298-0e59af050267' could be found. Oct 27 03:25:54.122713 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:25:54.122713 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:25:54.122713 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:25:54.122713 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:25:54.123897 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:25:54.123897 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:25:54.123897 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:25:54.123897 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:25:54.123897 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '346f59ba-c1bd-44fa-b298-0e59af050267' could be found. Oct 27 03:25:54.123897 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:25:54.129663 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-616b2f17-8da2-41fa-865c-5eb99c7835bb tempest-HypervisorAdminNegativeUnderV252Test-1242229464 tempest-HypervisorAdminNegativeUnderV252Test-1242229464-project-admin] Returning 404 to user: No hypervisor matching '346f59ba-c1bd-44fa-b298-0e59af050267' could be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:25:54.133349 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-616b2f17-8da2-41fa-865c-5eb99c7835bb tempest-HypervisorAdminNegativeUnderV252Test-1242229464 tempest-HypervisorAdminNegativeUnderV252Test-1242229464-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/346f59ba-c1bd-44fa-b298-0e59af050267/servers" status: 404 len: 123 microversion: 2.1 time: 0.050825 Oct 27 03:25:54.139864 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 803/1563] 10.222.0.20 () {58 vars in 1281 bytes} [Thu Oct 27 03:25:54 2022] GET /compute/v2.1/os-hypervisors/346f59ba-c1bd-44fa-b298-0e59af050267/servers => generated 123 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:25:54.166787 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ee976451-bfb2-4360-9935-09c5b5a5c1d3 tempest-ServersAdminNegativeTestJSON-1854954566 tempest-ServersAdminNegativeTestJSON-1854954566-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:25:54.173085 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ee976451-bfb2-4360-9935-09c5b5a5c1d3 tempest-ServersAdminNegativeTestJSON-1854954566 tempest-ServersAdminNegativeTestJSON-1854954566-project-admin] [instance: b3e22e1e-77a7-4f06-b099-eee6d631d3c9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:54.198520 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ee976451-bfb2-4360-9935-09c5b5a5c1d3 tempest-ServersAdminNegativeTestJSON-1854954566 tempest-ServersAdminNegativeTestJSON-1854954566-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:54.201549 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ee976451-bfb2-4360-9935-09c5b5a5c1d3 tempest-ServersAdminNegativeTestJSON-1854954566 tempest-ServersAdminNegativeTestJSON-1854954566-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:54.202277 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ee976451-bfb2-4360-9935-09c5b5a5c1d3 tempest-ServersAdminNegativeTestJSON-1854954566 tempest-ServersAdminNegativeTestJSON-1854954566-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:54.205715 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ee976451-bfb2-4360-9935-09c5b5a5c1d3 tempest-ServersAdminNegativeTestJSON-1854954566 tempest-ServersAdminNegativeTestJSON-1854954566-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:54.206517 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ee976451-bfb2-4360-9935-09c5b5a5c1d3 tempest-ServersAdminNegativeTestJSON-1854954566 tempest-ServersAdminNegativeTestJSON-1854954566-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:54.212782 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ee976451-bfb2-4360-9935-09c5b5a5c1d3 tempest-ServersAdminNegativeTestJSON-1854954566 tempest-ServersAdminNegativeTestJSON-1854954566-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:54.326780 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-ee976451-bfb2-4360-9935-09c5b5a5c1d3 tempest-ServersAdminNegativeTestJSON-1854954566 tempest-ServersAdminNegativeTestJSON-1854954566-project-admin] HTTP exception thrown: Cannot 'migrate' instance b3e22e1e-77a7-4f06-b099-eee6d631d3c9 while it is in vm_state suspended Oct 27 03:25:54.330920 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ee976451-bfb2-4360-9935-09c5b5a5c1d3 tempest-ServersAdminNegativeTestJSON-1854954566 tempest-ServersAdminNegativeTestJSON-1854954566-project-admin] Request method failure captured: Oct 27 03:25:54.330920 n-d-862769-1 devstack@n-api.service[121000]: request: POST /compute/v2.1/servers/b3e22e1e-77a7-4f06-b099-eee6d631d3c9/action HTTP/1.1 Oct 27 03:25:54.330920 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:25:54.330920 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:25:54.330920 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:25:54.330920 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 15 Oct 27 03:25:54.330920 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:25:54.330920 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:25:54.330920 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:25:54.330920 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:25:54.330920 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfoFdSedD8do6mz2HrdDJl_A9DppHq4-R7WQdmvE88nilO6yRdbw6lhWjnrNUW_1C1dTE33a5qj_uIrpMqXCMzYZPQ8I54Oqfrk7GemfqTLWQNRtTU14ciQ8qfb_gp9-F8q7A8G9LHtDqDY3TxROHKjW1POYQESSSzFcPwVFChjMS3Y Oct 27 03:25:54.330920 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:25:54.330920 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:25:54.330920 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:25:54.330920 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:25:54.330920 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:25:54.330920 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:25:54.330920 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: dc250ed4d4ca4645bbb9bd83d3d3ac9f Oct 27 03:25:54.330920 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1854954566 Oct 27 03:25:54.330920 n-d-862769-1 devstack@n-api.service[121000]: X-Role: admin,member,reader Oct 27 03:25:54.330920 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: admin,member,reader Oct 27 03:25:54.333634 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dc250ed4d4ca4645bbb9bd83d3d3ac9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dc250ed4d4ca4645bbb9bd83d3d3ac9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dc250ed4d4ca4645bbb9bd83d3d3ac9f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dc250ed4d4ca4645bbb9bd83d3d3ac9f"}]}] Oct 27 03:25:54.333634 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1854954566 Oct 27 03:25:54.333634 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: dc250ed4d4ca4645bbb9bd83d3d3ac9f Oct 27 03:25:54.333634 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1854954566 Oct 27 03:25:54.333634 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ServersAdminNegativeTestJSON-1854954566-project-admin Oct 27 03:25:54.333634 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:25:54.333634 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:25:54.333634 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: fc8e662e5b2f4e32ba368bd697294803 Oct 27 03:25:54.333634 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1854954566-project-admin Oct 27 03:25:54.333634 n-d-862769-1 devstack@n-api.service[121000]: Oct 27 03:25:54.333634 n-d-862769-1 devstack@n-api.service[121000]: {"migrate": {}} Oct 27 03:25:54.333634 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:25:54.333634 n-d-862769-1 devstack@n-api.service[121000]: exception: Cannot 'migrate' instance b3e22e1e-77a7-4f06-b099-eee6d631d3c9 while it is in vm_state suspended Oct 27 03:25:54.334757 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': 'b3e22e1e-77a7-4f06-b099-eee6d631d3c9', 'body': {'migrate': {}}} Oct 27 03:25:54.334757 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:25:54.334757 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:25:54.334757 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Oct 27 03:25:54.334757 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Oct 27 03:25:54.334757 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 27 03:25:54.334757 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 03:25:54.334757 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 27 03:25:54.334757 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 27 03:25:54.334757 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 27 03:25:54.334757 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 27 03:25:54.334757 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 03:25:54.334757 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 03:25:54.334757 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 27 03:25:54.334757 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 27 03:25:54.334757 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b3e22e1e-77a7-4f06-b099-eee6d631d3c9 in vm_state suspended. Cannot resize while the instance is in this state. Oct 27 03:25:54.334757 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:25:54.334757 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:25:54.334757 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:25:54.334757 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:25:54.336405 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:25:54.336405 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:25:54.336405 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:25:54.336405 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:25:54.336405 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:25:54.336405 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:25:54.336405 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:25:54.336405 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:25:54.336405 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Oct 27 03:25:54.336405 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 27 03:25:54.336405 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 27 03:25:54.336405 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 27 03:25:54.336405 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance b3e22e1e-77a7-4f06-b099-eee6d631d3c9 while it is in vm_state suspended Oct 27 03:25:54.336405 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:25:54.336405 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:25:54.336405 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:25:54.336405 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:25:54.336405 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:25:54.336405 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:25:54.339237 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:25:54.339237 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:25:54.339237 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance b3e22e1e-77a7-4f06-b099-eee6d631d3c9 while it is in vm_state suspended Oct 27 03:25:54.339237 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:25:54.342278 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ee976451-bfb2-4360-9935-09c5b5a5c1d3 tempest-ServersAdminNegativeTestJSON-1854954566 tempest-ServersAdminNegativeTestJSON-1854954566-project-admin] Returning 409 to user: Cannot 'migrate' instance b3e22e1e-77a7-4f06-b099-eee6d631d3c9 while it is in vm_state suspended {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:25:54.343580 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ee976451-bfb2-4360-9935-09c5b5a5c1d3 tempest-ServersAdminNegativeTestJSON-1854954566 tempest-ServersAdminNegativeTestJSON-1854954566-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/b3e22e1e-77a7-4f06-b099-eee6d631d3c9/action" status: 409 len: 148 microversion: 2.1 time: 0.206832 Oct 27 03:25:54.348431 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 804/1564] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:25:54 2022] POST /compute/v2.1/servers/b3e22e1e-77a7-4f06-b099-eee6d631d3c9/action => generated 148 bytes in 212 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 27 03:25:54.359162 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9ab7f85a-54b7-4432-b103-33ca2af54610 tempest-ServersAdminNegativeTestJSON-1854954566 tempest-ServersAdminNegativeTestJSON-1854954566-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:25:54.364780 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9ab7f85a-54b7-4432-b103-33ca2af54610 tempest-ServersAdminNegativeTestJSON-1854954566 tempest-ServersAdminNegativeTestJSON-1854954566-project-admin] Request method failure captured: Oct 27 03:25:54.364780 n-d-862769-1 devstack@n-api.service[121000]: request: POST /compute/v2.1/servers/2d8a44aa-62e4-4385-b295-924517b6f850/action HTTP/1.1 Oct 27 03:25:54.364780 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:25:54.364780 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:25:54.364780 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:25:54.364780 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 39 Oct 27 03:25:54.364780 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:25:54.364780 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:25:54.364780 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:25:54.364780 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:25:54.364780 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfoFdSedD8do6mz2HrdDJl_A9DppHq4-R7WQdmvE88nilO6yRdbw6lhWjnrNUW_1C1dTE33a5qj_uIrpMqXCMzYZPQ8I54Oqfrk7GemfqTLWQNRtTU14ciQ8qfb_gp9-F8q7A8G9LHtDqDY3TxROHKjW1POYQESSSzFcPwVFChjMS3Y Oct 27 03:25:54.364780 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:25:54.364780 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:25:54.364780 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:25:54.364780 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:25:54.364780 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:25:54.364780 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:25:54.364780 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: dc250ed4d4ca4645bbb9bd83d3d3ac9f Oct 27 03:25:54.364780 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1854954566 Oct 27 03:25:54.364780 n-d-862769-1 devstack@n-api.service[121000]: X-Role: admin,member,reader Oct 27 03:25:54.364780 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: admin,member,reader Oct 27 03:25:54.366291 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dc250ed4d4ca4645bbb9bd83d3d3ac9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dc250ed4d4ca4645bbb9bd83d3d3ac9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dc250ed4d4ca4645bbb9bd83d3d3ac9f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dc250ed4d4ca4645bbb9bd83d3d3ac9f"}]}] Oct 27 03:25:54.366291 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1854954566 Oct 27 03:25:54.366291 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: dc250ed4d4ca4645bbb9bd83d3d3ac9f Oct 27 03:25:54.366291 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1854954566 Oct 27 03:25:54.366291 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ServersAdminNegativeTestJSON-1854954566-project-admin Oct 27 03:25:54.366291 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:25:54.366291 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:25:54.366291 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: fc8e662e5b2f4e32ba368bd697294803 Oct 27 03:25:54.366291 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1854954566-project-admin Oct 27 03:25:54.366291 n-d-862769-1 devstack@n-api.service[121000]: Oct 27 03:25:54.366291 n-d-862769-1 devstack@n-api.service[121000]: {"os-resetState": {"state": "invalid"}} Oct 27 03:25:54.366291 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:25:54.367636 n-d-862769-1 devstack@n-api.service[121000]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 27 03:25:54.367636 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '2d8a44aa-62e4-4385-b295-924517b6f850', 'body': {'os-resetState': {'state': 'invalid'}}} Oct 27 03:25:54.367636 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:25:54.367636 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:25:54.367636 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 03:25:54.367636 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 03:25:54.367636 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 03:25:54.367636 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise error Oct 27 03:25:54.367636 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Oct 27 03:25:54.367636 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:25:54.367636 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Oct 27 03:25:54.367636 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 27 03:25:54.367636 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:25:54.367636 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 27 03:25:54.367636 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi 'invalid' Oct 27 03:25:54.367636 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:25:54.367636 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:25:54.367636 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:25:54.367636 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:25:54.367636 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:25:54.367636 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:25:54.367636 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:25:54.369025 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:25:54.369025 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:25:54.369025 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:25:54.369025 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 03:25:54.369025 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 03:25:54.369025 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 03:25:54.369025 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 03:25:54.369025 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 03:25:54.369025 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 03:25:54.369025 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 27 03:25:54.369025 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:25:54.369025 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:25:54.369025 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:25:54.369025 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:25:54.369025 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:25:54.369025 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:25:54.369025 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 03:25:54.369025 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 03:25:54.369025 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 27 03:25:54.370857 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:25:54.370857 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9ab7f85a-54b7-4432-b103-33ca2af54610 tempest-ServersAdminNegativeTestJSON-1854954566 tempest-ServersAdminNegativeTestJSON-1854954566-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:25:54.370857 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9ab7f85a-54b7-4432-b103-33ca2af54610 tempest-ServersAdminNegativeTestJSON-1854954566 tempest-ServersAdminNegativeTestJSON-1854954566-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/2d8a44aa-62e4-4385-b295-924517b6f850/action" status: 400 len: 144 microversion: 2.1 time: 0.011631 Oct 27 03:25:54.370857 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 805/1565] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:25:54 2022] POST /compute/v2.1/servers/2d8a44aa-62e4-4385-b295-924517b6f850/action => generated 144 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 03:25:54.381299 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4b95b6c0-dbed-4a68-a76f-f88473abda23 tempest-ServersAdminNegativeTestJSON-1854954566 tempest-ServersAdminNegativeTestJSON-1854954566-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:25:54.387406 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4b95b6c0-dbed-4a68-a76f-f88473abda23 tempest-ServersAdminNegativeTestJSON-1854954566 tempest-ServersAdminNegativeTestJSON-1854954566-project-admin] Request method failure captured: Oct 27 03:25:54.387406 n-d-862769-1 devstack@n-api.service[121000]: request: POST /compute/v2.1/servers/2d8a44aa-62e4-4385-b295-924517b6f850/action HTTP/1.1 Oct 27 03:25:54.387406 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:25:54.387406 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:25:54.387406 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:25:54.387406 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 31 Oct 27 03:25:54.387406 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:25:54.387406 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:25:54.387406 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:25:54.387406 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:25:54.387406 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfoFdSedD8do6mz2HrdDJl_A9DppHq4-R7WQdmvE88nilO6yRdbw6lhWjnrNUW_1C1dTE33a5qj_uIrpMqXCMzYZPQ8I54Oqfrk7GemfqTLWQNRtTU14ciQ8qfb_gp9-F8q7A8G9LHtDqDY3TxROHKjW1POYQESSSzFcPwVFChjMS3Y Oct 27 03:25:54.387406 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:25:54.387406 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:25:54.387406 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:25:54.387406 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:25:54.387406 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:25:54.387406 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:25:54.387406 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: dc250ed4d4ca4645bbb9bd83d3d3ac9f Oct 27 03:25:54.387406 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1854954566 Oct 27 03:25:54.387406 n-d-862769-1 devstack@n-api.service[121000]: X-Role: admin,member,reader Oct 27 03:25:54.387406 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: admin,member,reader Oct 27 03:25:54.388792 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dc250ed4d4ca4645bbb9bd83d3d3ac9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dc250ed4d4ca4645bbb9bd83d3d3ac9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dc250ed4d4ca4645bbb9bd83d3d3ac9f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dc250ed4d4ca4645bbb9bd83d3d3ac9f"}]}] Oct 27 03:25:54.388792 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1854954566 Oct 27 03:25:54.388792 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: dc250ed4d4ca4645bbb9bd83d3d3ac9f Oct 27 03:25:54.388792 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1854954566 Oct 27 03:25:54.388792 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ServersAdminNegativeTestJSON-1854954566-project-admin Oct 27 03:25:54.388792 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:25:54.388792 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:25:54.388792 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: fc8e662e5b2f4e32ba368bd697294803 Oct 27 03:25:54.388792 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1854954566-project-admin Oct 27 03:25:54.388792 n-d-862769-1 devstack@n-api.service[121000]: Oct 27 03:25:54.388792 n-d-862769-1 devstack@n-api.service[121000]: {"os-resetState": {"state": 1}} Oct 27 03:25:54.388792 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:25:54.388792 n-d-862769-1 devstack@n-api.service[121000]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 27 03:25:54.389606 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '2d8a44aa-62e4-4385-b295-924517b6f850', 'body': {'os-resetState': {'state': 1}}} Oct 27 03:25:54.389606 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:25:54.389606 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:25:54.389606 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 03:25:54.389606 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 03:25:54.389606 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 03:25:54.389606 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise error Oct 27 03:25:54.389606 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Oct 27 03:25:54.389606 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:25:54.389606 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Oct 27 03:25:54.389606 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 27 03:25:54.389606 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:25:54.389606 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 27 03:25:54.389606 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi 1 Oct 27 03:25:54.389606 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:25:54.389606 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:25:54.389606 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:25:54.389606 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:25:54.389606 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:25:54.389606 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:25:54.389606 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:25:54.389606 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:25:54.391425 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:25:54.391425 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:25:54.391425 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 03:25:54.391425 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 03:25:54.391425 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 03:25:54.391425 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 03:25:54.391425 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 03:25:54.391425 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 03:25:54.391425 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 27 03:25:54.391425 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:25:54.391425 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:25:54.391425 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:25:54.391425 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:25:54.391425 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:25:54.391425 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:25:54.391425 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 03:25:54.391425 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 03:25:54.391425 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 27 03:25:54.391425 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:25:54.392720 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4b95b6c0-dbed-4a68-a76f-f88473abda23 tempest-ServersAdminNegativeTestJSON-1854954566 tempest-ServersAdminNegativeTestJSON-1854954566-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:25:54.392720 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4b95b6c0-dbed-4a68-a76f-f88473abda23 tempest-ServersAdminNegativeTestJSON-1854954566 tempest-ServersAdminNegativeTestJSON-1854954566-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/2d8a44aa-62e4-4385-b295-924517b6f850/action" status: 400 len: 120 microversion: 2.1 time: 0.015465 Oct 27 03:25:54.392720 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 806/1566] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:25:54 2022] POST /compute/v2.1/servers/2d8a44aa-62e4-4385-b295-924517b6f850/action => generated 120 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 27 03:25:54.400658 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-cedd7f21-e021-4646-adda-a3619b6d7cce tempest-ServersAdminNegativeTestJSON-1854954566 tempest-ServersAdminNegativeTestJSON-1854954566-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:25:54.403147 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-cedd7f21-e021-4646-adda-a3619b6d7cce tempest-ServersAdminNegativeTestJSON-1854954566 tempest-ServersAdminNegativeTestJSON-1854954566-project-admin] Failed to fetch instance by id 999 {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 27 03:25:54.404269 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-cedd7f21-e021-4646-adda-a3619b6d7cce tempest-ServersAdminNegativeTestJSON-1854954566 tempest-ServersAdminNegativeTestJSON-1854954566-project-admin] HTTP exception thrown: Instance 999 could not be found. Oct 27 03:25:54.640121 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-cedd7f21-e021-4646-adda-a3619b6d7cce tempest-ServersAdminNegativeTestJSON-1854954566 tempest-ServersAdminNegativeTestJSON-1854954566-project-admin] Request method failure captured: Oct 27 03:25:54.640121 n-d-862769-1 devstack@n-api.service[121000]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Oct 27 03:25:54.640121 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:25:54.640121 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:25:54.640121 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:25:54.640121 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 37 Oct 27 03:25:54.640121 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:25:54.640121 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:25:54.640121 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:25:54.640121 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:25:54.640121 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfoFdSedD8do6mz2HrdDJl_A9DppHq4-R7WQdmvE88nilO6yRdbw6lhWjnrNUW_1C1dTE33a5qj_uIrpMqXCMzYZPQ8I54Oqfrk7GemfqTLWQNRtTU14ciQ8qfb_gp9-F8q7A8G9LHtDqDY3TxROHKjW1POYQESSSzFcPwVFChjMS3Y Oct 27 03:25:54.640121 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:25:54.640121 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:25:54.640121 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:25:54.640121 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:25:54.640121 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:25:54.640121 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:25:54.640121 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: dc250ed4d4ca4645bbb9bd83d3d3ac9f Oct 27 03:25:54.640121 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1854954566 Oct 27 03:25:54.640121 n-d-862769-1 devstack@n-api.service[121000]: X-Role: admin,member,reader Oct 27 03:25:54.640121 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: admin,member,reader Oct 27 03:25:54.641659 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dc250ed4d4ca4645bbb9bd83d3d3ac9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dc250ed4d4ca4645bbb9bd83d3d3ac9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dc250ed4d4ca4645bbb9bd83d3d3ac9f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dc250ed4d4ca4645bbb9bd83d3d3ac9f"}]}] Oct 27 03:25:54.641659 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1854954566 Oct 27 03:25:54.641659 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: dc250ed4d4ca4645bbb9bd83d3d3ac9f Oct 27 03:25:54.641659 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1854954566 Oct 27 03:25:54.641659 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ServersAdminNegativeTestJSON-1854954566-project-admin Oct 27 03:25:54.641659 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:25:54.641659 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:25:54.641659 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: fc8e662e5b2f4e32ba368bd697294803 Oct 27 03:25:54.641659 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1854954566-project-admin Oct 27 03:25:54.641659 n-d-862769-1 devstack@n-api.service[121000]: Oct 27 03:25:54.641659 n-d-862769-1 devstack@n-api.service[121000]: {"os-resetState": {"state": "error"}} Oct 27 03:25:54.641659 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:25:54.641659 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 999 could not be found. Oct 27 03:25:54.642533 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Oct 27 03:25:54.642533 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:25:54.642533 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:25:54.642533 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:25:54.642533 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:25:54.642533 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 27 03:25:54.642533 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 27 03:25:54.642533 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 27 03:25:54.642533 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:25:54.642533 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:25:54.642533 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:25:54.642533 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:25:54.642533 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:25:54.642533 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:25:54.642533 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:25:54.642533 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:25:54.642533 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:25:54.642533 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:25:54.642533 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:25:54.642533 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:25:54.642533 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Oct 27 03:25:54.643968 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 27 03:25:54.643968 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:25:54.643968 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:25:54.643968 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 27 03:25:54.643968 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:25:54.643968 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:25:54.643968 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:25:54.643968 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:25:54.643968 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:25:54.643968 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:25:54.643968 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:25:54.643968 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:25:54.643968 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 27 03:25:54.643968 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:25:54.643968 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-cedd7f21-e021-4646-adda-a3619b6d7cce tempest-ServersAdminNegativeTestJSON-1854954566 tempest-ServersAdminNegativeTestJSON-1854954566-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:25:54.643968 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-cedd7f21-e021-4646-adda-a3619b6d7cce tempest-ServersAdminNegativeTestJSON-1854954566 tempest-ServersAdminNegativeTestJSON-1854954566-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.245968 Oct 27 03:25:54.651253 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 807/1567] 10.222.0.20 () {60 vars in 1179 bytes} [Thu Oct 27 03:25:54 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 256 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 27 03:25:54.656422 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6cf70c69-dc50-4a6a-96f4-74e00783d3dd tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:54.657157 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6cf70c69-dc50-4a6a-96f4-74e00783d3dd tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: e8781053-3dad-4951-b4cb-1f4aaf97e19b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:54.665954 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6cf70c69-dc50-4a6a-96f4-74e00783d3dd tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:54.666519 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6cf70c69-dc50-4a6a-96f4-74e00783d3dd tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:54.667099 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6cf70c69-dc50-4a6a-96f4-74e00783d3dd tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:54.667856 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6cf70c69-dc50-4a6a-96f4-74e00783d3dd tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:54.668335 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6cf70c69-dc50-4a6a-96f4-74e00783d3dd tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:54.668837 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6cf70c69-dc50-4a6a-96f4-74e00783d3dd tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:55.158191 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-6cf70c69-dc50-4a6a-96f4-74e00783d3dd tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:55.192099 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6cf70c69-dc50-4a6a-96f4-74e00783d3dd tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b" status: 200 len: 1469 microversion: 2.1 time: 0.538330 Oct 27 03:25:55.202229 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 808/1568] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:54 2022] GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b => generated 1469 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:55.220808 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e5619a0e-ef4d-47de-9f86-d829fe284ff1 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7ddabcfdc0>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:55.318925 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e5619a0e-ef4d-47de-9f86-d829fe284ff1 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/images/7115c53b-83c1-4282-b3b3-cadb0c0b6d70" status: 200 len: 1413 microversion: 2.1 time: 0.115545 Oct 27 03:25:55.327021 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 809/1569] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:25:55 2022] GET /compute/v2.1/images/7115c53b-83c1-4282-b3b3-cadb0c0b6d70 => generated 1413 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:55.332475 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-13751dd9-33a0-4f96-ba85-8f7727c3b0f6 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:55.333003 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-13751dd9-33a0-4f96-ba85-8f7727c3b0f6 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] [instance: b3e22e1e-77a7-4f06-b099-eee6d631d3c9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:55.345394 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=6,nova_api:INSERT=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:25:55.355561 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-13751dd9-33a0-4f96-ba85-8f7727c3b0f6 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:55.356422 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-13751dd9-33a0-4f96-ba85-8f7727c3b0f6 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:55.357614 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-13751dd9-33a0-4f96-ba85-8f7727c3b0f6 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:55.360188 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-13751dd9-33a0-4f96-ba85-8f7727c3b0f6 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:55.360858 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-13751dd9-33a0-4f96-ba85-8f7727c3b0f6 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:55.361470 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-13751dd9-33a0-4f96-ba85-8f7727c3b0f6 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:55.430318 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-13751dd9-33a0-4f96-ba85-8f7727c3b0f6 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] [instance: b3e22e1e-77a7-4f06-b099-eee6d631d3c9] Going to try to terminate instance {{(pid=121000) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:25:55.757231 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-13751dd9-33a0-4f96-ba85-8f7727c3b0f6 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b3e22e1e-77a7-4f06-b099-eee6d631d3c9" status: 204 len: 0 microversion: 2.1 time: 0.434285 Oct 27 03:25:55.757941 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 810/1570] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:25:55 2022] DELETE /compute/v2.1/servers/b3e22e1e-77a7-4f06-b099-eee6d631d3c9 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:25:55.764421 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-18694986-c7fb-46ec-9912-5bd0bf4c0f3f req-01bec8c0-d5c9-4659-b8c6-0f052945ed88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8781053-3dad-4951-b4cb-1f4aaf97e19b", "name": "network-vif-plugged", "status": "completed", "tag": "2db0e1c6-c7e9-4994-9a8c-c23e51c0e800"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:25:55.786234 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-18694986-c7fb-46ec-9912-5bd0bf4c0f3f req-01bec8c0-d5c9-4659-b8c6-0f052945ed88 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:55.786739 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-18694986-c7fb-46ec-9912-5bd0bf4c0f3f req-01bec8c0-d5c9-4659-b8c6-0f052945ed88 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:55.792242 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-18694986-c7fb-46ec-9912-5bd0bf4c0f3f req-01bec8c0-d5c9-4659-b8c6-0f052945ed88 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:55.816899 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-18694986-c7fb-46ec-9912-5bd0bf4c0f3f req-01bec8c0-d5c9-4659-b8c6-0f052945ed88 service nova] Creating event network-vif-plugged:2db0e1c6-c7e9-4994-9a8c-c23e51c0e800 for instance e8781053-3dad-4951-b4cb-1f4aaf97e19b on n-h1-862769-1 Oct 27 03:25:55.832374 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [req-18694986-c7fb-46ec-9912-5bd0bf4c0f3f req-01bec8c0-d5c9-4659-b8c6-0f052945ed88 service nova] Instance e8781053-3dad-4951-b4cb-1f4aaf97e19b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862769-1', 'n-h1-862769-1'} {{(pid=121000) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 03:25:55.851619 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-18694986-c7fb-46ec-9912-5bd0bf4c0f3f req-01bec8c0-d5c9-4659-b8c6-0f052945ed88 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091660 Oct 27 03:25:55.852962 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 811/1571] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:25:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:25:55.861355 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2a165223-2e48-4294-884b-de390eaa72aa tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:55.861355 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-2a165223-2e48-4294-884b-de390eaa72aa tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] [instance: b3e22e1e-77a7-4f06-b099-eee6d631d3c9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:55.871447 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2a165223-2e48-4294-884b-de390eaa72aa tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:55.871963 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2a165223-2e48-4294-884b-de390eaa72aa tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:55.872462 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2a165223-2e48-4294-884b-de390eaa72aa tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:55.873825 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2a165223-2e48-4294-884b-de390eaa72aa tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:55.874381 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2a165223-2e48-4294-884b-de390eaa72aa tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:55.875771 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2a165223-2e48-4294-884b-de390eaa72aa tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:56.111851 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2a165223-2e48-4294-884b-de390eaa72aa tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ccd5909fb214f71ad68704019c9e4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d2c150feac4d03966a860ab8bafe00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:56.126363 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2a165223-2e48-4294-884b-de390eaa72aa tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] 10.222.0.20 "GET /compute/v2.1/servers/b3e22e1e-77a7-4f06-b099-eee6d631d3c9" status: 200 len: 1468 microversion: 2.1 time: 0.271881 Oct 27 03:25:56.130055 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 812/1572] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:55 2022] GET /compute/v2.1/servers/b3e22e1e-77a7-4f06-b099-eee6d631d3c9 => generated 1468 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:56.163028 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-dfeb093a-5cde-4e1e-b911-03b8f3100156 tempest-FloatingIPsTestJSON-1550638952 tempest-FloatingIPsTestJSON-1550638952-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/4a818186-dd60-4aad-8846-5b8320feab88" status: 202 len: 0 microversion: 2.1 time: 2.672669 Oct 27 03:25:56.164331 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 761/1573] 10.222.0.20 () {58 vars in 1263 bytes} [Thu Oct 27 03:25:53 2022] DELETE /compute/v2.1/os-floating-ips/4a818186-dd60-4aad-8846-5b8320feab88 => generated 0 bytes in 2675 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:25:56.173752 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3ec29446-d1aa-40fe-98f2-c175ce0f88a1 tempest-FloatingIPsTestJSON-1550638952 tempest-FloatingIPsTestJSON-1550638952-project] Action: 'create', calling method: .version_select at 0x7f7ddee4cb80>, body: {"pool": null} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:25:56.227992 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-042d340e-6555-46a9-8f32-d7e6484378f9 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:56.228747 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-042d340e-6555-46a9-8f32-d7e6484378f9 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: e8781053-3dad-4951-b4cb-1f4aaf97e19b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:56.232303 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=90,nova_api:SAVEPOINT=4,nova_api:INSERT=2,nova_api:RELEASE=4 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:25:56.236010 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-042d340e-6555-46a9-8f32-d7e6484378f9 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:56.236510 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-042d340e-6555-46a9-8f32-d7e6484378f9 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:56.237007 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-042d340e-6555-46a9-8f32-d7e6484378f9 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:56.237832 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-042d340e-6555-46a9-8f32-d7e6484378f9 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:56.249261 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-042d340e-6555-46a9-8f32-d7e6484378f9 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:56.249984 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-042d340e-6555-46a9-8f32-d7e6484378f9 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:56.462480 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-042d340e-6555-46a9-8f32-d7e6484378f9 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:56.477874 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-042d340e-6555-46a9-8f32-d7e6484378f9 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b" status: 200 len: 1469 microversion: 2.1 time: 0.253575 Oct 27 03:25:56.478837 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 762/1574] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:56 2022] GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b => generated 1469 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:25:56.484421 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a1a14bda-e6b8-4db4-b605-14b900d994d5 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7ddac4cee0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:56.548442 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a1a14bda-e6b8-4db4-b605-14b900d994d5 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/images/7115c53b-83c1-4282-b3b3-cadb0c0b6d70" status: 200 len: 1413 microversion: 2.1 time: 0.068377 Oct 27 03:25:56.556291 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 763/1575] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:25:56 2022] GET /compute/v2.1/images/7115c53b-83c1-4282-b3b3-cadb0c0b6d70 => generated 1413 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:57.154756 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-78a71ed5-59b4-461d-ad02-ea72d23613ec tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:57.155221 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-78a71ed5-59b4-461d-ad02-ea72d23613ec tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] [instance: b3e22e1e-77a7-4f06-b099-eee6d631d3c9] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:57.164221 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-78a71ed5-59b4-461d-ad02-ea72d23613ec tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:57.164890 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-78a71ed5-59b4-461d-ad02-ea72d23613ec tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:57.170370 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-78a71ed5-59b4-461d-ad02-ea72d23613ec tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:57.171397 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-78a71ed5-59b4-461d-ad02-ea72d23613ec tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:57.171896 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-78a71ed5-59b4-461d-ad02-ea72d23613ec tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:57.172344 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-78a71ed5-59b4-461d-ad02-ea72d23613ec tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:57.706225 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-78a71ed5-59b4-461d-ad02-ea72d23613ec tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ccd5909fb214f71ad68704019c9e4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d2c150feac4d03966a860ab8bafe00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:57.717544 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-78a71ed5-59b4-461d-ad02-ea72d23613ec tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] 10.222.0.20 "GET /compute/v2.1/servers/b3e22e1e-77a7-4f06-b099-eee6d631d3c9" status: 200 len: 1468 microversion: 2.1 time: 0.564903 Oct 27 03:25:57.750678 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 764/1576] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:57 2022] GET /compute/v2.1/servers/b3e22e1e-77a7-4f06-b099-eee6d631d3c9 => generated 1468 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:57.771454 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-99cbb54f-9a44-4b32-919d-399f166f74bf tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:57.776351 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-99cbb54f-9a44-4b32-919d-399f166f74bf tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] [instance: 09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:57.787300 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-99cbb54f-9a44-4b32-919d-399f166f74bf tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:57.791668 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-99cbb54f-9a44-4b32-919d-399f166f74bf tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:57.795553 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-99cbb54f-9a44-4b32-919d-399f166f74bf tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:57.796545 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-99cbb54f-9a44-4b32-919d-399f166f74bf tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:57.797223 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-99cbb54f-9a44-4b32-919d-399f166f74bf tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:57.800222 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-99cbb54f-9a44-4b32-919d-399f166f74bf tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:58.058794 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-99cbb54f-9a44-4b32-919d-399f166f74bf tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lazy-loading 'services' on Instance uuid 09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:25:58.091091 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-99cbb54f-9a44-4b32-919d-399f166f74bf tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f" status: 200 len: 2343 microversion: 2.25 time: 0.333651 Oct 27 03:25:58.096632 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 765/1577] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:25:57 2022] GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f => generated 2343 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:25:58.105684 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a6a6cc73-60f3-46ae-924a-9aabdf0a1419 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:58.107726 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a6a6cc73-60f3-46ae-924a-9aabdf0a1419 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: e8781053-3dad-4951-b4cb-1f4aaf97e19b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:58.120859 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a6a6cc73-60f3-46ae-924a-9aabdf0a1419 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:58.125974 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a6a6cc73-60f3-46ae-924a-9aabdf0a1419 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:58.126991 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a6a6cc73-60f3-46ae-924a-9aabdf0a1419 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:58.128043 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a6a6cc73-60f3-46ae-924a-9aabdf0a1419 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:58.128549 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a6a6cc73-60f3-46ae-924a-9aabdf0a1419 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:58.128987 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a6a6cc73-60f3-46ae-924a-9aabdf0a1419 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:58.620348 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a6a6cc73-60f3-46ae-924a-9aabdf0a1419 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:58.633667 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a6a6cc73-60f3-46ae-924a-9aabdf0a1419 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b" status: 200 len: 1469 microversion: 2.1 time: 0.535234 Oct 27 03:25:58.635156 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 766/1578] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:58 2022] GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b => generated 1469 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:58.643699 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-94dad5b5-27e4-4a8f-af65-bc1a3777c5a7 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7dded9baf0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:58.708638 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-94dad5b5-27e4-4a8f-af65-bc1a3777c5a7 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/images/7115c53b-83c1-4282-b3b3-cadb0c0b6d70" status: 200 len: 1413 microversion: 2.1 time: 0.071917 Oct 27 03:25:58.715945 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 767/1579] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:25:58 2022] GET /compute/v2.1/images/7115c53b-83c1-4282-b3b3-cadb0c0b6d70 => generated 1413 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:58.715945 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c76e9e93-a209-4a3d-be35-a2432a74ff70 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:58.719384 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c76e9e93-a209-4a3d-be35-a2432a74ff70 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:58.720198 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c76e9e93-a209-4a3d-be35-a2432a74ff70 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:58.720902 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c76e9e93-a209-4a3d-be35-a2432a74ff70 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:58.721950 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c76e9e93-a209-4a3d-be35-a2432a74ff70 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:58.722834 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c76e9e93-a209-4a3d-be35-a2432a74ff70 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:58.723611 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c76e9e93-a209-4a3d-be35-a2432a74ff70 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:58.799139 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c76e9e93-a209-4a3d-be35-a2432a74ff70 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.088725 Oct 27 03:25:58.800942 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 768/1580] 10.222.0.20 () {60 vars in 1217 bytes} [Thu Oct 27 03:25:58 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 03:25:58.809194 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-20eae4a6-2089-4256-b45f-85002acb75e1 req-6ea5647b-5c0b-4129-9b8d-c62caf434c75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3e22e1e-77a7-4f06-b099-eee6d631d3c9", "name": "network-vif-deleted", "tag": "60d343b3-3185-46f8-aaa0-ac75ba00f598"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:25:58.831483 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-20eae4a6-2089-4256-b45f-85002acb75e1 req-6ea5647b-5c0b-4129-9b8d-c62caf434c75 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:58.836399 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-20eae4a6-2089-4256-b45f-85002acb75e1 req-6ea5647b-5c0b-4129-9b8d-c62caf434c75 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:58.836399 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-20eae4a6-2089-4256-b45f-85002acb75e1 req-6ea5647b-5c0b-4129-9b8d-c62caf434c75 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:58.870365 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-20eae4a6-2089-4256-b45f-85002acb75e1 req-6ea5647b-5c0b-4129-9b8d-c62caf434c75 service nova] Creating event network-vif-deleted:60d343b3-3185-46f8-aaa0-ac75ba00f598 for instance b3e22e1e-77a7-4f06-b099-eee6d631d3c9 on n-h2-862769-1 Oct 27 03:25:58.892389 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-20eae4a6-2089-4256-b45f-85002acb75e1 req-6ea5647b-5c0b-4129-9b8d-c62caf434c75 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088812 Oct 27 03:25:58.893911 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 769/1581] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:25:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:25:58.902099 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ad5b7273-e689-4c25-ad35-9fa92ba08d8e tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:58.903093 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ad5b7273-e689-4c25-ad35-9fa92ba08d8e tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] [instance: b3e22e1e-77a7-4f06-b099-eee6d631d3c9] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:58.918209 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ad5b7273-e689-4c25-ad35-9fa92ba08d8e tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:58.919649 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ad5b7273-e689-4c25-ad35-9fa92ba08d8e tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:58.920592 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ad5b7273-e689-4c25-ad35-9fa92ba08d8e tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:58.925333 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ad5b7273-e689-4c25-ad35-9fa92ba08d8e tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:58.929258 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ad5b7273-e689-4c25-ad35-9fa92ba08d8e tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:58.930073 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ad5b7273-e689-4c25-ad35-9fa92ba08d8e tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:59.088084 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ad5b7273-e689-4c25-ad35-9fa92ba08d8e tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ccd5909fb214f71ad68704019c9e4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d2c150feac4d03966a860ab8bafe00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:25:59.099371 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ad5b7273-e689-4c25-ad35-9fa92ba08d8e tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] 10.222.0.20 "GET /compute/v2.1/servers/b3e22e1e-77a7-4f06-b099-eee6d631d3c9" status: 200 len: 1297 microversion: 2.1 time: 0.202795 Oct 27 03:25:59.100747 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 770/1582] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:58 2022] GET /compute/v2.1/servers/b3e22e1e-77a7-4f06-b099-eee6d631d3c9 => generated 1297 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:25:59.588112 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3ec29446-d1aa-40fe-98f2-c175ce0f88a1 tempest-FloatingIPsTestJSON-1550638952 tempest-FloatingIPsTestJSON-1550638952-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.418289 Oct 27 03:25:59.601827 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 813/1583] 10.222.0.20 () {60 vars in 1170 bytes} [Thu Oct 27 03:25:56 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3433 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:25:59.603968 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a0fc45f8-7f8c-4896-b9c1-433b38cb3b83 tempest-FloatingIPsTestJSON-1550638952 tempest-FloatingIPsTestJSON-1550638952-project] Calling method '.version_select at 0x7f7dded91430>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:59.663364 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f0cfdaff-5bd6-43f9-b901-b35de6dc1c56 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:25:59.664477 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f0cfdaff-5bd6-43f9-b901-b35de6dc1c56 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: e8781053-3dad-4951-b4cb-1f4aaf97e19b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:25:59.674103 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f0cfdaff-5bd6-43f9-b901-b35de6dc1c56 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:59.679177 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f0cfdaff-5bd6-43f9-b901-b35de6dc1c56 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:59.679900 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f0cfdaff-5bd6-43f9-b901-b35de6dc1c56 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:25:59.680910 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f0cfdaff-5bd6-43f9-b901-b35de6dc1c56 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:25:59.681550 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f0cfdaff-5bd6-43f9-b901-b35de6dc1c56 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:25:59.682192 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f0cfdaff-5bd6-43f9-b901-b35de6dc1c56 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:00.099350 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f0cfdaff-5bd6-43f9-b901-b35de6dc1c56 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:00.116801 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f0cfdaff-5bd6-43f9-b901-b35de6dc1c56 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b" status: 200 len: 1469 microversion: 2.1 time: 0.453847 Oct 27 03:26:00.116801 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 814/1584] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:25:59 2022] GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b => generated 1469 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:26:00.139971 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-112b5fd7-ed1e-49fb-a838-12439cb7265b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7ddedd74c0>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:00.725354 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-112b5fd7-ed1e-49fb-a838-12439cb7265b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/images/7115c53b-83c1-4282-b3b3-cadb0c0b6d70" status: 200 len: 1413 microversion: 2.1 time: 0.608687 Oct 27 03:26:00.734438 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 815/1585] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:26:00 2022] GET /compute/v2.1/images/7115c53b-83c1-4282-b3b3-cadb0c0b6d70 => generated 1413 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:26:00.739925 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ae86b145-f33f-4868-9dc2-4acca154bf81 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:00.740760 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ae86b145-f33f-4868-9dc2-4acca154bf81 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] [instance: b3e22e1e-77a7-4f06-b099-eee6d631d3c9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:00.747591 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ae86b145-f33f-4868-9dc2-4acca154bf81 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:00.748094 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ae86b145-f33f-4868-9dc2-4acca154bf81 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:00.748543 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ae86b145-f33f-4868-9dc2-4acca154bf81 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:00.749297 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ae86b145-f33f-4868-9dc2-4acca154bf81 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:00.749731 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ae86b145-f33f-4868-9dc2-4acca154bf81 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:00.750195 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ae86b145-f33f-4868-9dc2-4acca154bf81 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:00.764673 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-ae86b145-f33f-4868-9dc2-4acca154bf81 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] HTTP exception thrown: Instance b3e22e1e-77a7-4f06-b099-eee6d631d3c9 could not be found. Oct 27 03:26:00.766544 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ae86b145-f33f-4868-9dc2-4acca154bf81 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Request method failure captured: Oct 27 03:26:00.766544 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/b3e22e1e-77a7-4f06-b099-eee6d631d3c9 HTTP/1.1 Oct 27 03:26:00.766544 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:26:00.766544 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:26:00.766544 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:26:00.766544 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:26:00.766544 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:26:00.766544 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:26:00.766544 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:26:00.766544 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:26:00.766544 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfoE0yX6JFLcB0GO9fVw_jSNEfgM2F4F4laX2HkdGObk6PAhjXVNSFXETRUlO_FuTC-8tmTTo7oc-Q_fxKWwSXWqOud6Cnw0dq-VKujNCtN68wUABmt53DuFeIlrL5xrFue_0CVs_mqq7pdie7DIn3-rR0Gx9x8psqxk-mOoRrxDaF8 Oct 27 03:26:00.766544 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:26:00.766544 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:26:00.766544 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:26:00.766544 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:26:00.766544 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:26:00.766544 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:26:00.766544 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 49d2c150feac4d03966a860ab8bafe00 Oct 27 03:26:00.766544 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-879662411 Oct 27 03:26:00.766544 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:26:00.766544 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:26:00.768770 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/49d2c150feac4d03966a860ab8bafe00"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/49d2c150feac4d03966a860ab8bafe00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/49d2c150feac4d03966a860ab8bafe00"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_49d2c150feac4d03966a860ab8bafe00"}]}] Oct 27 03:26:00.768770 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ServersAdminNegativeTestJSON-879662411 Oct 27 03:26:00.768770 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 49d2c150feac4d03966a860ab8bafe00 Oct 27 03:26:00.768770 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-879662411 Oct 27 03:26:00.768770 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ServersAdminNegativeTestJSON-879662411-project Oct 27 03:26:00.768770 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:26:00.768770 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:26:00.768770 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 2ccd5909fb214f71ad68704019c9e4f0 Oct 27 03:26:00.768770 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ServersAdminNegativeTestJSON-879662411-project Oct 27 03:26:00.768770 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:26:00.768770 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance b3e22e1e-77a7-4f06-b099-eee6d631d3c9 could not be found. Oct 27 03:26:00.768770 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': 'b3e22e1e-77a7-4f06-b099-eee6d631d3c9'} Oct 27 03:26:00.769755 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:26:00.769755 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:26:00.769755 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:26:00.769755 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:26:00.769755 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:26:00.769755 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:26:00.769755 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:26:00.769755 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:26:00.769755 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:26:00.769755 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:26:00.769755 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3e22e1e-77a7-4f06-b099-eee6d631d3c9 could not be found. Oct 27 03:26:00.769755 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:26:00.769755 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:26:00.769755 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:26:00.769755 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:26:00.769755 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:26:00.769755 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:26:00.769755 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:26:00.769755 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:26:00.769755 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:26:00.772048 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:26:00.772048 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:26:00.772048 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:26:00.772048 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:26:00.772048 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:26:00.772048 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:26:00.772048 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:26:00.772048 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3e22e1e-77a7-4f06-b099-eee6d631d3c9 could not be found. Oct 27 03:26:00.772048 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:26:00.772048 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:26:00.772048 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:26:00.772048 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:26:00.772048 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:26:00.772048 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:26:00.772048 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:26:00.772048 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:26:00.772048 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3e22e1e-77a7-4f06-b099-eee6d631d3c9 could not be found. Oct 27 03:26:00.772048 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:26:00.773579 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ae86b145-f33f-4868-9dc2-4acca154bf81 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Returning 404 to user: Instance b3e22e1e-77a7-4f06-b099-eee6d631d3c9 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:26:00.773579 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ae86b145-f33f-4868-9dc2-4acca154bf81 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] 10.222.0.20 "GET /compute/v2.1/servers/b3e22e1e-77a7-4f06-b099-eee6d631d3c9" status: 404 len: 111 microversion: 2.1 time: 0.032238 Oct 27 03:26:00.773579 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 816/1586] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:26:00 2022] GET /compute/v2.1/servers/b3e22e1e-77a7-4f06-b099-eee6d631d3c9 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:26:00.779175 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5cfe7fdd-c1af-4422-a57a-2d3b0fa8cdfe tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:00.779734 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5cfe7fdd-c1af-4422-a57a-2d3b0fa8cdfe tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] [instance: 2d8a44aa-62e4-4385-b295-924517b6f850] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:00.786479 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5cfe7fdd-c1af-4422-a57a-2d3b0fa8cdfe tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:00.786940 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5cfe7fdd-c1af-4422-a57a-2d3b0fa8cdfe tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:00.787476 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5cfe7fdd-c1af-4422-a57a-2d3b0fa8cdfe tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:00.788202 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5cfe7fdd-c1af-4422-a57a-2d3b0fa8cdfe tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:00.788684 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5cfe7fdd-c1af-4422-a57a-2d3b0fa8cdfe tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:00.789103 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5cfe7fdd-c1af-4422-a57a-2d3b0fa8cdfe tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:00.826315 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5cfe7fdd-c1af-4422-a57a-2d3b0fa8cdfe tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] [instance: 2d8a44aa-62e4-4385-b295-924517b6f850] Going to try to terminate instance {{(pid=121000) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:26:01.281283 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5cfe7fdd-c1af-4422-a57a-2d3b0fa8cdfe tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2d8a44aa-62e4-4385-b295-924517b6f850" status: 204 len: 0 microversion: 2.1 time: 0.507636 Oct 27 03:26:01.281809 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 817/1587] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:26:00 2022] DELETE /compute/v2.1/servers/2d8a44aa-62e4-4385-b295-924517b6f850 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:26:01.303655 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2037fa90-c902-4712-b668-89d398fb832a tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:01.309157 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-2037fa90-c902-4712-b668-89d398fb832a tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: e8781053-3dad-4951-b4cb-1f4aaf97e19b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:01.327597 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2037fa90-c902-4712-b668-89d398fb832a tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:01.333641 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2037fa90-c902-4712-b668-89d398fb832a tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:01.333641 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2037fa90-c902-4712-b668-89d398fb832a tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:01.333641 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2037fa90-c902-4712-b668-89d398fb832a tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:01.333641 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2037fa90-c902-4712-b668-89d398fb832a tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:01.335326 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2037fa90-c902-4712-b668-89d398fb832a tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:01.616314 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2037fa90-c902-4712-b668-89d398fb832a tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:01.622210 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a0fc45f8-7f8c-4896-b9c1-433b38cb3b83 tempest-FloatingIPsTestJSON-1550638952 tempest-FloatingIPsTestJSON-1550638952-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/aeda612c-00e9-44b9-a555-9cf4fe98d423" status: 202 len: 0 microversion: 2.1 time: 2.023091 Oct 27 03:26:01.622808 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 771/1588] 10.222.0.20 () {58 vars in 1263 bytes} [Thu Oct 27 03:25:59 2022] DELETE /compute/v2.1/os-floating-ips/aeda612c-00e9-44b9-a555-9cf4fe98d423 => generated 0 bytes in 2025 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:26:01.628654 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5ae1aace-6778-470a-86aa-7017b9ba1367 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:01.628830 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2037fa90-c902-4712-b668-89d398fb832a tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b" status: 200 len: 1469 microversion: 2.1 time: 0.336877 Oct 27 03:26:01.629365 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5ae1aace-6778-470a-86aa-7017b9ba1367 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] [instance: 2d8a44aa-62e4-4385-b295-924517b6f850] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:01.629714 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 818/1589] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:26:01 2022] GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b => generated 1469 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:26:01.646084 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b06a2f76-5a70-48f2-9ef0-233363a0c7e6 tempest-FloatingIPsTestJSON-1550638952 tempest-FloatingIPsTestJSON-1550638952-project] Calling method '.version_select at 0x7f7ddee45af0>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:01.659495 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5ae1aace-6778-470a-86aa-7017b9ba1367 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:01.660190 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5ae1aace-6778-470a-86aa-7017b9ba1367 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:01.661303 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5ae1aace-6778-470a-86aa-7017b9ba1367 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:01.662127 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5ae1aace-6778-470a-86aa-7017b9ba1367 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:01.663665 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5ae1aace-6778-470a-86aa-7017b9ba1367 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:01.664289 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5ae1aace-6778-470a-86aa-7017b9ba1367 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:01.746237 n-d-862769-1 devstack@n-api.service[121000]: DEBUG neutronclient.v2_0.client [None req-b06a2f76-5a70-48f2-9ef0-233363a0c7e6 tempest-FloatingIPsTestJSON-1550638952 tempest-FloatingIPsTestJSON-1550638952-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP aeda612c-00e9-44b9-a555-9cf4fe98d423 could not be found", "detail": ""}} {{(pid=121000) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 03:26:01.747551 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-b06a2f76-5a70-48f2-9ef0-233363a0c7e6 tempest-FloatingIPsTestJSON-1550638952 tempest-FloatingIPsTestJSON-1550638952-project] HTTP exception thrown: Floating IP not found for ID aeda612c-00e9-44b9-a555-9cf4fe98d423 Oct 27 03:26:01.808982 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b06a2f76-5a70-48f2-9ef0-233363a0c7e6 tempest-FloatingIPsTestJSON-1550638952 tempest-FloatingIPsTestJSON-1550638952-project] Request method failure captured: Oct 27 03:26:01.808982 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/os-floating-ips/aeda612c-00e9-44b9-a555-9cf4fe98d423 HTTP/1.1 Oct 27 03:26:01.808982 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:26:01.808982 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:26:01.808982 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:26:01.808982 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:26:01.808982 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:26:01.808982 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:26:01.808982 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:26:01.808982 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:26:01.808982 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfo6mqZdnPhfc0NgUWU_9LvzrAx7n9maHSL--mieDWV5UF3G5tRhzJBDf05DvSUMoONDJ8FnenkDmreNoMsyNFnZg2FI_eL1foWv5WKd9353-Ju2Ec5VRb3Sijlsrz3oomateFG3spyMEnEaPYqAe5YXmgjwKKElxiokfNB-7CGfn7g Oct 27 03:26:01.808982 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:26:01.808982 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:26:01.808982 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:26:01.808982 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:26:01.808982 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:26:01.808982 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:26:01.808982 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: a2ee874d160a470b96e1d50fc1131f81 Oct 27 03:26:01.808982 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-FloatingIPsTestJSON-1550638952 Oct 27 03:26:01.808982 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:26:01.808982 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:26:01.810822 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a2ee874d160a470b96e1d50fc1131f81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a2ee874d160a470b96e1d50fc1131f81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a2ee874d160a470b96e1d50fc1131f81"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a2ee874d160a470b96e1d50fc1131f81"}]}] Oct 27 03:26:01.810822 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-FloatingIPsTestJSON-1550638952 Oct 27 03:26:01.810822 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: a2ee874d160a470b96e1d50fc1131f81 Oct 27 03:26:01.810822 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1550638952 Oct 27 03:26:01.810822 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-FloatingIPsTestJSON-1550638952-project Oct 27 03:26:01.810822 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:26:01.810822 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:26:01.810822 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 1245e7aa1c6a420fa7ebe0c098a6396a Oct 27 03:26:01.810822 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-FloatingIPsTestJSON-1550638952-project Oct 27 03:26:01.810822 n-d-862769-1 devstack@n-api.service[121000]: method: Oct 27 03:26:01.810822 n-d-862769-1 devstack@n-api.service[121000]: exception: Floating IP not found for ID aeda612c-00e9-44b9-a555-9cf4fe98d423 Oct 27 03:26:01.810822 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': 'aeda612c-00e9-44b9-a555-9cf4fe98d423'} Oct 27 03:26:01.810822 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:26:01.811855 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:26:01.811855 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 27 03:26:01.811855 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 27 03:26:01.811855 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:26:01.811855 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:26:01.811855 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 27 03:26:01.811855 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 27 03:26:01.811855 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:26:01.811855 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:26:01.811855 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 27 03:26:01.811855 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 27 03:26:01.811855 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:26:01.811855 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:26:01.811855 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 03:26:01.811855 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 03:26:01.811855 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:26:01.811855 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:26:01.811855 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 03:26:01.811855 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 03:26:01.813383 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:26:01.813383 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:26:01.813383 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 03:26:01.813383 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 03:26:01.813383 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 03:26:01.813383 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 03:26:01.813383 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP aeda612c-00e9-44b9-a555-9cf4fe98d423 could not be found Oct 27 03:26:01.813383 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e5d9ce92-0c31-4416-aaac-2b327499a300'] Oct 27 03:26:01.813383 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:26:01.813383 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:26:01.813383 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:26:01.813383 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:26:01.813383 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 27 03:26:01.813383 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 27 03:26:01.813383 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 27 03:26:01.813383 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 27 03:26:01.813383 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID aeda612c-00e9-44b9-a555-9cf4fe98d423. Oct 27 03:26:01.813383 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:26:01.813383 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:26:01.813383 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:26:01.817772 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:26:01.817772 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:26:01.817772 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:26:01.817772 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:26:01.817772 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:26:01.817772 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:26:01.817772 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:26:01.817772 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:26:01.817772 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:26:01.817772 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 27 03:26:01.817772 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 27 03:26:01.817772 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID aeda612c-00e9-44b9-a555-9cf4fe98d423 Oct 27 03:26:01.817772 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:26:01.817772 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:26:01.817772 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:26:01.817772 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:26:01.817772 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:26:01.817772 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:26:01.817772 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:26:01.817772 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:26:01.819717 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID aeda612c-00e9-44b9-a555-9cf4fe98d423 Oct 27 03:26:01.819717 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:26:01.819717 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b06a2f76-5a70-48f2-9ef0-233363a0c7e6 tempest-FloatingIPsTestJSON-1550638952 tempest-FloatingIPsTestJSON-1550638952-project] Returning 404 to user: Floating IP not found for ID aeda612c-00e9-44b9-a555-9cf4fe98d423 {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:26:01.819717 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b06a2f76-5a70-48f2-9ef0-233363a0c7e6 tempest-FloatingIPsTestJSON-1550638952 tempest-FloatingIPsTestJSON-1550638952-project] 10.222.0.20 "GET /compute/v2.1/os-floating-ips/aeda612c-00e9-44b9-a555-9cf4fe98d423" status: 404 len: 111 microversion: 2.1 time: 0.180121 Oct 27 03:26:01.819717 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 819/1590] 10.222.0.20 () {58 vars in 1260 bytes} [Thu Oct 27 03:26:01 2022] GET /compute/v2.1/os-floating-ips/aeda612c-00e9-44b9-a555-9cf4fe98d423 => generated 111 bytes in 185 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:26:01.828570 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9b857cae-3b15-4373-9421-5abde00ab67b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7ddece8550>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:01.884577 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9b857cae-3b15-4373-9421-5abde00ab67b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/images/7115c53b-83c1-4282-b3b3-cadb0c0b6d70" status: 200 len: 1413 microversion: 2.1 time: 0.066572 Oct 27 03:26:01.885416 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 820/1591] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:26:01 2022] GET /compute/v2.1/images/7115c53b-83c1-4282-b3b3-cadb0c0b6d70 => generated 1413 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:26:01.891026 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-fa72b664-d702-453c-aa67-d78ef4959646 tempest-FloatingIPsTestJSON-1550638952 tempest-FloatingIPsTestJSON-1550638952-project] Calling method '.version_select at 0x7f7ddedd70d0>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:01.970214 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5ae1aace-6778-470a-86aa-7017b9ba1367 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ccd5909fb214f71ad68704019c9e4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d2c150feac4d03966a860ab8bafe00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:01.979017 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5ae1aace-6778-470a-86aa-7017b9ba1367 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] 10.222.0.20 "GET /compute/v2.1/servers/2d8a44aa-62e4-4385-b295-924517b6f850" status: 200 len: 1478 microversion: 2.1 time: 0.355112 Oct 27 03:26:01.985736 n-d-862769-1 devstack@n-api.service[121000]: DEBUG neutronclient.v2_0.client [None req-fa72b664-d702-453c-aa67-d78ef4959646 tempest-FloatingIPsTestJSON-1550638952 tempest-FloatingIPsTestJSON-1550638952-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP aeda612c-00e9-44b9-a555-9cf4fe98d423 could not be found", "detail": ""}} {{(pid=121000) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 03:26:01.988095 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-fa72b664-d702-453c-aa67-d78ef4959646 tempest-FloatingIPsTestJSON-1550638952 tempest-FloatingIPsTestJSON-1550638952-project] HTTP exception thrown: Floating IP not found for ID aeda612c-00e9-44b9-a555-9cf4fe98d423 Oct 27 03:26:01.990210 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-fa72b664-d702-453c-aa67-d78ef4959646 tempest-FloatingIPsTestJSON-1550638952 tempest-FloatingIPsTestJSON-1550638952-project] Request method failure captured: Oct 27 03:26:01.990210 n-d-862769-1 devstack@n-api.service[121000]: request: DELETE /compute/v2.1/os-floating-ips/aeda612c-00e9-44b9-a555-9cf4fe98d423 HTTP/1.1 Oct 27 03:26:01.990210 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:26:01.990210 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:26:01.990210 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:26:01.990210 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:26:01.990210 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:26:01.990210 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:26:01.990210 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:26:01.990210 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:26:01.990210 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfo6mqZdnPhfc0NgUWU_9LvzrAx7n9maHSL--mieDWV5UF3G5tRhzJBDf05DvSUMoONDJ8FnenkDmreNoMsyNFnZg2FI_eL1foWv5WKd9353-Ju2Ec5VRb3Sijlsrz3oomateFG3spyMEnEaPYqAe5YXmgjwKKElxiokfNB-7CGfn7g Oct 27 03:26:01.990210 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:26:01.990210 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:26:01.990210 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:26:01.990210 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:26:01.990210 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:26:01.990210 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:26:01.990210 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: a2ee874d160a470b96e1d50fc1131f81 Oct 27 03:26:01.990210 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-FloatingIPsTestJSON-1550638952 Oct 27 03:26:01.990210 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:26:01.990210 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:26:01.993566 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a2ee874d160a470b96e1d50fc1131f81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a2ee874d160a470b96e1d50fc1131f81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a2ee874d160a470b96e1d50fc1131f81"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a2ee874d160a470b96e1d50fc1131f81"}]}] Oct 27 03:26:01.993566 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-FloatingIPsTestJSON-1550638952 Oct 27 03:26:01.993566 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: a2ee874d160a470b96e1d50fc1131f81 Oct 27 03:26:01.993566 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1550638952 Oct 27 03:26:01.993566 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-FloatingIPsTestJSON-1550638952-project Oct 27 03:26:01.993566 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:26:01.993566 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:26:01.993566 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 1245e7aa1c6a420fa7ebe0c098a6396a Oct 27 03:26:01.993566 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-FloatingIPsTestJSON-1550638952-project Oct 27 03:26:01.993566 n-d-862769-1 devstack@n-api.service[121000]: method: Oct 27 03:26:01.993566 n-d-862769-1 devstack@n-api.service[121000]: exception: Floating IP not found for ID aeda612c-00e9-44b9-a555-9cf4fe98d423 Oct 27 03:26:01.993566 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': 'aeda612c-00e9-44b9-a555-9cf4fe98d423'} Oct 27 03:26:01.993566 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:26:01.994587 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:26:01.994587 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 27 03:26:01.994587 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 27 03:26:01.994587 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:26:01.994587 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:26:01.994587 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 27 03:26:01.994587 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 27 03:26:01.994587 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:26:01.994587 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:26:01.994587 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 27 03:26:01.994587 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 27 03:26:01.994587 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:26:01.994587 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:26:01.994587 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 03:26:01.994587 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 03:26:01.994587 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:26:01.994587 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:26:01.994587 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 03:26:01.994587 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 03:26:01.995910 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:26:01.995910 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:26:01.995910 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 03:26:01.995910 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 03:26:01.995910 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 03:26:01.995910 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 03:26:01.995910 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP aeda612c-00e9-44b9-a555-9cf4fe98d423 could not be found Oct 27 03:26:01.995910 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-544fbc39-9cb2-436b-b9b0-94db029eec57'] Oct 27 03:26:01.995910 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:26:01.995910 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:26:01.995910 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:26:01.995910 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:26:01.995910 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 27 03:26:01.995910 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 27 03:26:01.995910 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 27 03:26:01.995910 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 27 03:26:01.995910 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID aeda612c-00e9-44b9-a555-9cf4fe98d423. Oct 27 03:26:01.995910 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:26:01.995910 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:26:01.995910 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:26:01.997118 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:26:01.997118 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:26:01.997118 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:26:01.997118 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:26:01.997118 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:26:01.997118 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:26:01.997118 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:26:01.997118 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:26:01.997118 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:26:01.997118 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 27 03:26:01.997118 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 27 03:26:01.997118 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID aeda612c-00e9-44b9-a555-9cf4fe98d423 Oct 27 03:26:01.997118 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:26:01.997118 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:26:01.997118 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:26:01.997118 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:26:01.997118 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:26:01.997118 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:26:01.997118 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:26:01.997118 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:26:01.998991 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID aeda612c-00e9-44b9-a555-9cf4fe98d423 Oct 27 03:26:01.998991 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:26:01.998991 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-fa72b664-d702-453c-aa67-d78ef4959646 tempest-FloatingIPsTestJSON-1550638952 tempest-FloatingIPsTestJSON-1550638952-project] Returning 404 to user: Floating IP not found for ID aeda612c-00e9-44b9-a555-9cf4fe98d423 {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:26:01.998991 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-fa72b664-d702-453c-aa67-d78ef4959646 tempest-FloatingIPsTestJSON-1550638952 tempest-FloatingIPsTestJSON-1550638952-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/aeda612c-00e9-44b9-a555-9cf4fe98d423" status: 404 len: 111 microversion: 2.1 time: 0.105434 Oct 27 03:26:01.998991 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 821/1592] 10.222.0.20 () {58 vars in 1263 bytes} [Thu Oct 27 03:26:01 2022] DELETE /compute/v2.1/os-floating-ips/aeda612c-00e9-44b9-a555-9cf4fe98d423 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:26:01.999644 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 772/1593] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:26:01 2022] GET /compute/v2.1/servers/2d8a44aa-62e4-4385-b295-924517b6f850 => generated 1478 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:26:02.157950 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-14f484b9-939c-442f-9212-79b0a067f1b9 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "701ae3a1-1805-43cd-a306-92c9067ce78e", "device": "/dev/xvdb"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:26:02.161818 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-14f484b9-939c-442f-9212-79b0a067f1b9 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:02.170349 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-14f484b9-939c-442f-9212-79b0a067f1b9 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:02.171127 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-14f484b9-939c-442f-9212-79b0a067f1b9 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:02.171579 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-14f484b9-939c-442f-9212-79b0a067f1b9 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:02.172317 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-14f484b9-939c-442f-9212-79b0a067f1b9 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:02.172791 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-14f484b9-939c-442f-9212-79b0a067f1b9 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:02.173225 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-14f484b9-939c-442f-9212-79b0a067f1b9 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:02.178694 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:26:02.387007 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8224dc6c-f162-487b-b718-4a7b96ccb3dd tempest-InstanceUsageAuditLogTestJSON-338853340 tempest-InstanceUsageAuditLogTestJSON-338853340-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:02.408853 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8224dc6c-f162-487b-b718-4a7b96ccb3dd tempest-InstanceUsageAuditLogTestJSON-338853340 tempest-InstanceUsageAuditLogTestJSON-338853340-project-admin] 10.222.0.20 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-27 03:26:02" status: 200 len: 318 microversion: 2.1 time: 0.179826 Oct 27 03:26:02.410816 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 773/1594] 10.222.0.20 () {58 vars in 1251 bytes} [Thu Oct 27 03:26:02 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-27%2003%3A26%3A02 => generated 318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:26:02.423636 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c2a4cb2b-4722-499b-9b62-c6f424d256c6 tempest-InstanceUsageAuditLogTestJSON-338853340 tempest-InstanceUsageAuditLogTestJSON-338853340-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:02.445057 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c2a4cb2b-4722-499b-9b62-c6f424d256c6 tempest-InstanceUsageAuditLogTestJSON-338853340 tempest-InstanceUsageAuditLogTestJSON-338853340-project-admin] 10.222.0.20 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.025242 Oct 27 03:26:02.445689 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 774/1595] 10.222.0.20 () {58 vars in 1185 bytes} [Thu Oct 27 03:26:02 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:26:02.451513 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-5afc5dbb-b34b-46a2-9e4b-927f764aac0f req-c6e21534-d4da-4063-ae1a-d0d9d89b8b7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8781053-3dad-4951-b4cb-1f4aaf97e19b", "name": "network-vif-unplugged", "status": "completed", "tag": "2db0e1c6-c7e9-4994-9a8c-c23e51c0e800"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:26:02.463179 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-5afc5dbb-b34b-46a2-9e4b-927f764aac0f req-c6e21534-d4da-4063-ae1a-d0d9d89b8b7d service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:02.463874 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-5afc5dbb-b34b-46a2-9e4b-927f764aac0f req-c6e21534-d4da-4063-ae1a-d0d9d89b8b7d service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:02.464492 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-5afc5dbb-b34b-46a2-9e4b-927f764aac0f req-c6e21534-d4da-4063-ae1a-d0d9d89b8b7d service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:02.477884 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-5afc5dbb-b34b-46a2-9e4b-927f764aac0f req-c6e21534-d4da-4063-ae1a-d0d9d89b8b7d service nova] Creating event network-vif-unplugged:2db0e1c6-c7e9-4994-9a8c-c23e51c0e800 for instance e8781053-3dad-4951-b4cb-1f4aaf97e19b on n-h2-862769-1 Oct 27 03:26:02.483977 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [req-5afc5dbb-b34b-46a2-9e4b-927f764aac0f req-c6e21534-d4da-4063-ae1a-d0d9d89b8b7d service nova] Instance e8781053-3dad-4951-b4cb-1f4aaf97e19b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862769-1', 'n-h1-862769-1'} {{(pid=121001) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 03:26:02.495542 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-5afc5dbb-b34b-46a2-9e4b-927f764aac0f req-c6e21534-d4da-4063-ae1a-d0d9d89b8b7d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048424 Oct 27 03:26:02.496450 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 775/1596] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:26:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:26:02.653163 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-58f99597-8dba-4df8-9735-cf547fdd8d2f tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:02.653965 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-58f99597-8dba-4df8-9735-cf547fdd8d2f tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: e8781053-3dad-4951-b4cb-1f4aaf97e19b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:02.660363 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-58f99597-8dba-4df8-9735-cf547fdd8d2f tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:02.660933 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-58f99597-8dba-4df8-9735-cf547fdd8d2f tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:02.661503 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-58f99597-8dba-4df8-9735-cf547fdd8d2f tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:02.662322 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-58f99597-8dba-4df8-9735-cf547fdd8d2f tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:02.662944 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-58f99597-8dba-4df8-9735-cf547fdd8d2f tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:02.663587 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-58f99597-8dba-4df8-9735-cf547fdd8d2f tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:03.093693 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-58f99597-8dba-4df8-9735-cf547fdd8d2f tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:03.104491 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-58f99597-8dba-4df8-9735-cf547fdd8d2f tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b" status: 200 len: 1469 microversion: 2.1 time: 0.456333 Oct 27 03:26:03.105083 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 776/1597] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:26:02 2022] GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b => generated 1469 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:26:03.110227 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-bad0a2b4-d865-4b78-a912-d4051f0d9c09 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7dded2a8b0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:03.173038 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-bad0a2b4-d865-4b78-a912-d4051f0d9c09 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/images/7115c53b-83c1-4282-b3b3-cadb0c0b6d70" status: 200 len: 1422 microversion: 2.1 time: 0.064304 Oct 27 03:26:03.173657 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 777/1598] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:26:03 2022] GET /compute/v2.1/images/7115c53b-83c1-4282-b3b3-cadb0c0b6d70 => generated 1422 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:26:03.189420 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7a5e3294-3396-42e1-af6d-7e1303baac9d tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:03.189420 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7a5e3294-3396-42e1-af6d-7e1303baac9d tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] [instance: 2d8a44aa-62e4-4385-b295-924517b6f850] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:03.196164 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7a5e3294-3396-42e1-af6d-7e1303baac9d tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:03.196663 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7a5e3294-3396-42e1-af6d-7e1303baac9d tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:03.197106 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7a5e3294-3396-42e1-af6d-7e1303baac9d tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:03.197813 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7a5e3294-3396-42e1-af6d-7e1303baac9d tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:03.198303 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7a5e3294-3396-42e1-af6d-7e1303baac9d tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:03.198732 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7a5e3294-3396-42e1-af6d-7e1303baac9d tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:03.348989 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-14f484b9-939c-442f-9212-79b0a067f1b9 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "POST /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 1.195140 Oct 27 03:26:03.350316 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 822/1599] 10.222.0.20 () {62 vars in 1364 bytes} [Thu Oct 27 03:26:02 2022] POST /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f/os-volume_attachments => generated 194 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 03:26:03.357276 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-955d38da-3b7c-4f7c-91a2-966712c231db tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7ddecae310>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:03.418902 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-955d38da-3b7c-4f7c-91a2-966712c231db tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/images/7115c53b-83c1-4282-b3b3-cadb0c0b6d70" status: 200 len: 1422 microversion: 2.1 time: 0.067377 Oct 27 03:26:03.420027 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 823/1600] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:26:03 2022] GET /compute/v2.1/images/7115c53b-83c1-4282-b3b3-cadb0c0b6d70 => generated 1422 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:26:03.433689 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-29b1cd92-3612-4511-b36a-f08116fce251 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7ddeca8af0>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:03.618452 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7a5e3294-3396-42e1-af6d-7e1303baac9d tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ccd5909fb214f71ad68704019c9e4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d2c150feac4d03966a860ab8bafe00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:03.628268 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7a5e3294-3396-42e1-af6d-7e1303baac9d tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] 10.222.0.20 "GET /compute/v2.1/servers/2d8a44aa-62e4-4385-b295-924517b6f850" status: 200 len: 1478 microversion: 2.1 time: 0.443065 Oct 27 03:26:03.629291 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 778/1601] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:26:03 2022] GET /compute/v2.1/servers/2d8a44aa-62e4-4385-b295-924517b6f850 => generated 1478 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:26:04.128782 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e683d70a-1aac-4ebd-8fe1-bd03faae53db tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:04.129555 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e683d70a-1aac-4ebd-8fe1-bd03faae53db tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: e8781053-3dad-4951-b4cb-1f4aaf97e19b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:04.137137 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e683d70a-1aac-4ebd-8fe1-bd03faae53db tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:04.137734 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e683d70a-1aac-4ebd-8fe1-bd03faae53db tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:04.138349 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e683d70a-1aac-4ebd-8fe1-bd03faae53db tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:04.139205 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e683d70a-1aac-4ebd-8fe1-bd03faae53db tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:04.139770 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e683d70a-1aac-4ebd-8fe1-bd03faae53db tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:04.140290 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e683d70a-1aac-4ebd-8fe1-bd03faae53db tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:04.500311 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e683d70a-1aac-4ebd-8fe1-bd03faae53db tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:04.520843 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e683d70a-1aac-4ebd-8fe1-bd03faae53db tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b" status: 200 len: 1469 microversion: 2.1 time: 0.395864 Oct 27 03:26:04.521561 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 779/1602] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:26:04 2022] GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b => generated 1469 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:26:04.527268 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-cfee36ff-c925-41c4-9575-0feca20632d7 req-28f3ce22-c09b-4d86-a0b6-0fd9e1d751ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8781053-3dad-4951-b4cb-1f4aaf97e19b", "tag": "2db0e1c6-c7e9-4994-9a8c-c23e51c0e800"}, {"server_uuid": "2d8a44aa-62e4-4385-b295-924517b6f850", "name": "network-vif-deleted", "tag": "c7d8654a-e058-4157-b215-5b6094b1dbfe"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:26:04.540073 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-cfee36ff-c925-41c4-9575-0feca20632d7 req-28f3ce22-c09b-4d86-a0b6-0fd9e1d751ee service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:04.540869 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-cfee36ff-c925-41c4-9575-0feca20632d7 req-28f3ce22-c09b-4d86-a0b6-0fd9e1d751ee service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:04.541737 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-cfee36ff-c925-41c4-9575-0feca20632d7 req-28f3ce22-c09b-4d86-a0b6-0fd9e1d751ee service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:04.560032 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-cfee36ff-c925-41c4-9575-0feca20632d7 req-28f3ce22-c09b-4d86-a0b6-0fd9e1d751ee service nova] Creating event network-changed:2db0e1c6-c7e9-4994-9a8c-c23e51c0e800 for instance e8781053-3dad-4951-b4cb-1f4aaf97e19b on n-h2-862769-1 Oct 27 03:26:04.560919 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-cfee36ff-c925-41c4-9575-0feca20632d7 req-28f3ce22-c09b-4d86-a0b6-0fd9e1d751ee service nova] Creating event network-vif-deleted:c7d8654a-e058-4157-b215-5b6094b1dbfe for instance 2d8a44aa-62e4-4385-b295-924517b6f850 on n-h1-862769-1 Oct 27 03:26:04.568088 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [req-cfee36ff-c925-41c4-9575-0feca20632d7 req-28f3ce22-c09b-4d86-a0b6-0fd9e1d751ee service nova] Instance e8781053-3dad-4951-b4cb-1f4aaf97e19b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862769-1', 'n-h1-862769-1'} {{(pid=121001) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 03:26:04.582428 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-cfee36ff-c925-41c4-9575-0feca20632d7 req-28f3ce22-c09b-4d86-a0b6-0fd9e1d751ee service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.059201 Oct 27 03:26:04.583120 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 780/1603] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:26:04 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:26:04.660632 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-22fe65d6-7059-40ab-be0c-04d993fd3cf3 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:04.661380 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-22fe65d6-7059-40ab-be0c-04d993fd3cf3 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] [instance: 2d8a44aa-62e4-4385-b295-924517b6f850] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:04.676699 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-22fe65d6-7059-40ab-be0c-04d993fd3cf3 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:04.677220 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-22fe65d6-7059-40ab-be0c-04d993fd3cf3 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:04.677678 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-22fe65d6-7059-40ab-be0c-04d993fd3cf3 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:04.678443 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-22fe65d6-7059-40ab-be0c-04d993fd3cf3 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:04.678906 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-22fe65d6-7059-40ab-be0c-04d993fd3cf3 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:04.679347 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-22fe65d6-7059-40ab-be0c-04d993fd3cf3 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:04.908699 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-29b1cd92-3612-4511-b36a-f08116fce251 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "DELETE /compute/v2.1/images/7115c53b-83c1-4282-b3b3-cadb0c0b6d70" status: 204 len: 0 microversion: 2.1 time: 1.478746 Oct 27 03:26:04.919769 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 824/1604] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:26:03 2022] DELETE /compute/v2.1/images/7115c53b-83c1-4282-b3b3-cadb0c0b6d70 => generated 0 bytes in 1481 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:26:04.919769 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f993c738-6eed-4825-bb9f-e708ef8df8db tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:04.920259 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f993c738-6eed-4825-bb9f-e708ef8df8db tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 33d5c62a-898f-441b-a1a1-3cb12836755d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:04.955061 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f993c738-6eed-4825-bb9f-e708ef8df8db tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:04.959777 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f993c738-6eed-4825-bb9f-e708ef8df8db tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:04.959777 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f993c738-6eed-4825-bb9f-e708ef8df8db tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:04.959777 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f993c738-6eed-4825-bb9f-e708ef8df8db tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:04.959777 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f993c738-6eed-4825-bb9f-e708ef8df8db tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:04.960423 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f993c738-6eed-4825-bb9f-e708ef8df8db tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:04.992865 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f993c738-6eed-4825-bb9f-e708ef8df8db tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 33d5c62a-898f-441b-a1a1-3cb12836755d] Going to try to terminate instance {{(pid=121000) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:26:04.995598 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-22fe65d6-7059-40ab-be0c-04d993fd3cf3 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ccd5909fb214f71ad68704019c9e4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d2c150feac4d03966a860ab8bafe00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:04.997983 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:26:05.014977 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-22fe65d6-7059-40ab-be0c-04d993fd3cf3 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] 10.222.0.20 "GET /compute/v2.1/servers/2d8a44aa-62e4-4385-b295-924517b6f850" status: 200 len: 1307 microversion: 2.1 time: 0.364200 Oct 27 03:26:05.015600 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 781/1605] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:26:04 2022] GET /compute/v2.1/servers/2d8a44aa-62e4-4385-b295-924517b6f850 => generated 1307 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:26:05.396527 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f993c738-6eed-4825-bb9f-e708ef8df8db tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "DELETE /compute/v2.1/servers/33d5c62a-898f-441b-a1a1-3cb12836755d" status: 204 len: 0 microversion: 2.1 time: 0.481604 Oct 27 03:26:05.397868 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 825/1606] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:26:04 2022] DELETE /compute/v2.1/servers/33d5c62a-898f-441b-a1a1-3cb12836755d => generated 0 bytes in 484 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 03:26:05.546194 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d1c539df-421c-462b-b239-9980051db442 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:05.548065 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d1c539df-421c-462b-b239-9980051db442 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: e8781053-3dad-4951-b4cb-1f4aaf97e19b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:05.568537 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d1c539df-421c-462b-b239-9980051db442 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:05.571798 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d1c539df-421c-462b-b239-9980051db442 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:05.571798 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d1c539df-421c-462b-b239-9980051db442 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:05.576599 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d1c539df-421c-462b-b239-9980051db442 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:05.577346 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d1c539df-421c-462b-b239-9980051db442 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:05.578462 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d1c539df-421c-462b-b239-9980051db442 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:05.609905 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f0f76a0a-f016-4fc2-a02e-3e28c1adc20e tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-232728969", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": [{"uuid": "a487df35-1b16-4301-a7dc-3642f0ac024b"}]}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:26:05.710861 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-f0f76a0a-f016-4fc2-a02e-3e28c1adc20e tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] validate_networks() for [('a487df35-1b16-4301-a7dc-3642f0ac024b', None, None, None, None, None)] {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:26:06.481433 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-f0f76a0a-f016-4fc2-a02e-3e28c1adc20e tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:26:06.485954 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-f0f76a0a-f016-4fc2-a02e-3e28c1adc20e tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:26:06.485954 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-f0f76a0a-f016-4fc2-a02e-3e28c1adc20e tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:26:06.485954 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-f0f76a0a-f016-4fc2-a02e-3e28c1adc20e tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:26:06.485954 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-f0f76a0a-f016-4fc2-a02e-3e28c1adc20e tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:26:06.504778 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f0f76a0a-f016-4fc2-a02e-3e28c1adc20e tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:06.505285 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f0f76a0a-f016-4fc2-a02e-3e28c1adc20e tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:06.505737 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f0f76a0a-f016-4fc2-a02e-3e28c1adc20e tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:06.506522 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f0f76a0a-f016-4fc2-a02e-3e28c1adc20e tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:06.506986 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f0f76a0a-f016-4fc2-a02e-3e28c1adc20e tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:06.507419 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f0f76a0a-f016-4fc2-a02e-3e28c1adc20e tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:06.541434 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-f0f76a0a-f016-4fc2-a02e-3e28c1adc20e tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Getting quotas for project ae78c307a1504172828e668f915a3677. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:26:06.548503 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-f0f76a0a-f016-4fc2-a02e-3e28c1adc20e tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Getting quotas for user 1d6175f2ac39494f8cba3db225150d6c and project ae78c307a1504172828e668f915a3677. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:26:06.567481 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f0f76a0a-f016-4fc2-a02e-3e28c1adc20e tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:26:06.570819 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f0f76a0a-f016-4fc2-a02e-3e28c1adc20e tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 2be00171-65ea-411a-b2d8-86b4e42d5de9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:26:06.676174 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d1c539df-421c-462b-b239-9980051db442 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:06.696360 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d1c539df-421c-462b-b239-9980051db442 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b" status: 200 len: 1469 microversion: 2.1 time: 1.154939 Oct 27 03:26:06.712613 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 782/1607] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:26:05 2022] GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b => generated 1469 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:26:06.723892 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b785d856-ccee-4315-828a-496d577c6647 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:06.724697 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f0f76a0a-f016-4fc2-a02e-3e28c1adc20e tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.111197 Oct 27 03:26:06.725989 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 826/1608] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:26:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1122 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 03:26:06.730930 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-7d340055-cb21-4432-963a-3199efead0af req-ed60b84e-4be6-4f27-b8b9-0d8a7093c6a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33d5c62a-898f-441b-a1a1-3cb12836755d", "name": "network-vif-unplugged", "status": "completed", "tag": "0fee4f52-9d23-48f3-b849-8399851e00ed"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:26:06.732165 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b785d856-ccee-4315-828a-496d577c6647 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] [instance: 2d8a44aa-62e4-4385-b295-924517b6f850] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:06.744221 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b785d856-ccee-4315-828a-496d577c6647 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:06.745069 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b785d856-ccee-4315-828a-496d577c6647 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:06.746641 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b785d856-ccee-4315-828a-496d577c6647 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:06.747511 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b785d856-ccee-4315-828a-496d577c6647 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:06.749474 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b785d856-ccee-4315-828a-496d577c6647 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:06.752541 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b785d856-ccee-4315-828a-496d577c6647 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:06.757615 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-7d340055-cb21-4432-963a-3199efead0af req-ed60b84e-4be6-4f27-b8b9-0d8a7093c6a1 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:06.760676 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-7d340055-cb21-4432-963a-3199efead0af req-ed60b84e-4be6-4f27-b8b9-0d8a7093c6a1 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:06.761552 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-7d340055-cb21-4432-963a-3199efead0af req-ed60b84e-4be6-4f27-b8b9-0d8a7093c6a1 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:06.806149 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-b785d856-ccee-4315-828a-496d577c6647 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] HTTP exception thrown: Instance 2d8a44aa-62e4-4385-b295-924517b6f850 could not be found. Oct 27 03:26:06.809551 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-7d340055-cb21-4432-963a-3199efead0af req-ed60b84e-4be6-4f27-b8b9-0d8a7093c6a1 service nova] Creating event network-vif-unplugged:0fee4f52-9d23-48f3-b849-8399851e00ed for instance 33d5c62a-898f-441b-a1a1-3cb12836755d on n-h2-862769-1 Oct 27 03:26:06.810488 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b785d856-ccee-4315-828a-496d577c6647 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Request method failure captured: Oct 27 03:26:06.810488 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/2d8a44aa-62e4-4385-b295-924517b6f850 HTTP/1.1 Oct 27 03:26:06.810488 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:26:06.810488 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:26:06.810488 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:26:06.810488 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:26:06.810488 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:26:06.810488 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:26:06.810488 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:26:06.810488 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:26:06.810488 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfoE0yX6JFLcB0GO9fVw_jSNEfgM2F4F4laX2HkdGObk6PAhjXVNSFXETRUlO_FuTC-8tmTTo7oc-Q_fxKWwSXWqOud6Cnw0dq-VKujNCtN68wUABmt53DuFeIlrL5xrFue_0CVs_mqq7pdie7DIn3-rR0Gx9x8psqxk-mOoRrxDaF8 Oct 27 03:26:06.810488 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:26:06.810488 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:26:06.810488 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:26:06.810488 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:26:06.810488 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:26:06.810488 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:26:06.810488 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 49d2c150feac4d03966a860ab8bafe00 Oct 27 03:26:06.810488 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-879662411 Oct 27 03:26:06.810488 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:26:06.810488 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:26:06.812150 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/49d2c150feac4d03966a860ab8bafe00"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/49d2c150feac4d03966a860ab8bafe00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/49d2c150feac4d03966a860ab8bafe00"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_49d2c150feac4d03966a860ab8bafe00"}]}] Oct 27 03:26:06.812150 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServersAdminNegativeTestJSON-879662411 Oct 27 03:26:06.812150 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 49d2c150feac4d03966a860ab8bafe00 Oct 27 03:26:06.812150 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-879662411 Oct 27 03:26:06.812150 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServersAdminNegativeTestJSON-879662411-project Oct 27 03:26:06.812150 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:26:06.812150 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:26:06.812150 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 2ccd5909fb214f71ad68704019c9e4f0 Oct 27 03:26:06.812150 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServersAdminNegativeTestJSON-879662411-project Oct 27 03:26:06.812150 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:26:06.812150 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 2d8a44aa-62e4-4385-b295-924517b6f850 could not be found. Oct 27 03:26:06.812150 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '2d8a44aa-62e4-4385-b295-924517b6f850'} Oct 27 03:26:06.813074 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:26:06.813074 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:26:06.813074 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:26:06.813074 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:26:06.813074 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:26:06.813074 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:26:06.813074 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:26:06.813074 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:26:06.813074 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:26:06.813074 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:26:06.813074 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d8a44aa-62e4-4385-b295-924517b6f850 could not be found. Oct 27 03:26:06.813074 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:26:06.813074 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:26:06.813074 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:26:06.813074 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:26:06.813074 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:26:06.813074 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:26:06.813074 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:26:06.813074 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:26:06.813074 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:26:06.814783 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:26:06.814783 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:26:06.814783 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:26:06.814783 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:26:06.814783 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:26:06.814783 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:26:06.814783 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:26:06.814783 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d8a44aa-62e4-4385-b295-924517b6f850 could not be found. Oct 27 03:26:06.814783 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:26:06.814783 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:26:06.814783 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:26:06.814783 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:26:06.814783 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:26:06.814783 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:26:06.814783 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:26:06.814783 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:26:06.814783 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d8a44aa-62e4-4385-b295-924517b6f850 could not be found. Oct 27 03:26:06.814783 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:26:06.821164 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b785d856-ccee-4315-828a-496d577c6647 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] Returning 404 to user: Instance 2d8a44aa-62e4-4385-b295-924517b6f850 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:26:06.821164 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b785d856-ccee-4315-828a-496d577c6647 tempest-ServersAdminNegativeTestJSON-879662411 tempest-ServersAdminNegativeTestJSON-879662411-project] 10.222.0.20 "GET /compute/v2.1/servers/2d8a44aa-62e4-4385-b295-924517b6f850" status: 404 len: 111 microversion: 2.1 time: 0.106762 Oct 27 03:26:06.827108 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 783/1609] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:26:06 2022] GET /compute/v2.1/servers/2d8a44aa-62e4-4385-b295-924517b6f850 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:26:06.833692 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-7d340055-cb21-4432-963a-3199efead0af req-ed60b84e-4be6-4f27-b8b9-0d8a7093c6a1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.106197 Oct 27 03:26:06.838560 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 827/1610] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:26:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:26:06.845292 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a3eaca88-0cb4-4846-92d8-0be811570f83 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:06.849910 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a3eaca88-0cb4-4846-92d8-0be811570f83 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] [instance: 543fdf60-10ec-4a25-a9d0-30c386efb104] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:06.863357 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1fe0ad1c-1d62-442f-bd25-28636379016a tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:06.869683 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1fe0ad1c-1d62-442f-bd25-28636379016a tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 2be00171-65ea-411a-b2d8-86b4e42d5de9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:06.876763 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a3eaca88-0cb4-4846-92d8-0be811570f83 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:06.880466 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a3eaca88-0cb4-4846-92d8-0be811570f83 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:06.880466 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a3eaca88-0cb4-4846-92d8-0be811570f83 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:06.880466 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a3eaca88-0cb4-4846-92d8-0be811570f83 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:06.880466 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a3eaca88-0cb4-4846-92d8-0be811570f83 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:06.880831 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a3eaca88-0cb4-4846-92d8-0be811570f83 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:07.055290 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1fe0ad1c-1d62-442f-bd25-28636379016a tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:07.063284 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1fe0ad1c-1d62-442f-bd25-28636379016a tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/2be00171-65ea-411a-b2d8-86b4e42d5de9" status: 200 len: 1207 microversion: 2.1 time: 0.223171 Oct 27 03:26:07.063880 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 828/1611] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:26:06 2022] GET /compute/v2.1/servers/2be00171-65ea-411a-b2d8-86b4e42d5de9 => generated 1207 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:26:07.218486 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a3eaca88-0cb4-4846-92d8-0be811570f83 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104" status: 200 len: 1859 microversion: 2.1 time: 0.389555 Oct 27 03:26:07.227081 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 784/1612] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:26:06 2022] GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104 => generated 1859 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:26:07.242629 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-054eede8-e4aa-45cb-965b-d65ae7163706 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-862769-1", "block_migration": true, "disk_over_commit": false}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:26:07.245636 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-054eede8-e4aa-45cb-965b-d65ae7163706 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] [instance: 543fdf60-10ec-4a25-a9d0-30c386efb104] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:07.254343 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-054eede8-e4aa-45cb-965b-d65ae7163706 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:07.255616 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-054eede8-e4aa-45cb-965b-d65ae7163706 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:07.256247 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-054eede8-e4aa-45cb-965b-d65ae7163706 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:07.257435 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-054eede8-e4aa-45cb-965b-d65ae7163706 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:07.258095 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-054eede8-e4aa-45cb-965b-d65ae7163706 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:07.259114 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-054eede8-e4aa-45cb-965b-d65ae7163706 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:07.297044 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-054eede8-e4aa-45cb-965b-d65ae7163706 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lazy-loading 'flavor' on Instance uuid 543fdf60-10ec-4a25-a9d0-30c386efb104 {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:26:07.332776 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-054eede8-e4aa-45cb-965b-d65ae7163706 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] [instance: 543fdf60-10ec-4a25-a9d0-30c386efb104] Going to try to live migrate instance to n-h1-862769-1 {{(pid=121000) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 27 03:26:07.729862 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-20ee8392-ab57-4b26-905d-646c8038fd78 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:07.731200 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-20ee8392-ab57-4b26-905d-646c8038fd78 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: e8781053-3dad-4951-b4cb-1f4aaf97e19b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:07.745612 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-20ee8392-ab57-4b26-905d-646c8038fd78 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:07.747928 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-20ee8392-ab57-4b26-905d-646c8038fd78 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:07.749507 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-20ee8392-ab57-4b26-905d-646c8038fd78 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:07.751821 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-20ee8392-ab57-4b26-905d-646c8038fd78 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:07.758507 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-20ee8392-ab57-4b26-905d-646c8038fd78 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:07.760349 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-20ee8392-ab57-4b26-905d-646c8038fd78 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:08.108519 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-20ee8392-ab57-4b26-905d-646c8038fd78 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:08.123554 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-20ee8392-ab57-4b26-905d-646c8038fd78 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b" status: 200 len: 1469 microversion: 2.1 time: 0.400059 Oct 27 03:26:08.125403 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 785/1613] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:26:07 2022] GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b => generated 1469 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:26:08.141640 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4008f89b-491c-49a4-8a9f-aa77e880e9ea tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:08.145904 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4008f89b-491c-49a4-8a9f-aa77e880e9ea tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 2be00171-65ea-411a-b2d8-86b4e42d5de9] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:08.236269 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4008f89b-491c-49a4-8a9f-aa77e880e9ea tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:08.261832 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4008f89b-491c-49a4-8a9f-aa77e880e9ea tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/2be00171-65ea-411a-b2d8-86b4e42d5de9" status: 200 len: 1207 microversion: 2.1 time: 0.135293 Oct 27 03:26:08.262547 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 786/1614] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:26:08 2022] GET /compute/v2.1/servers/2be00171-65ea-411a-b2d8-86b4e42d5de9 => generated 1207 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:26:08.752311 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:26:09.300964 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3f8e40ff-b55c-40c8-880b-0ce324f4c0f4 tempest-InstanceUsageAuditLogNegativeTestJSON-2102566575 tempest-InstanceUsageAuditLogNegativeTestJSON-2102566575-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:09.307037 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-3f8e40ff-b55c-40c8-880b-0ce324f4c0f4 tempest-InstanceUsageAuditLogNegativeTestJSON-2102566575 tempest-InstanceUsageAuditLogNegativeTestJSON-2102566575-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Oct 27 03:26:09.328321 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3f8e40ff-b55c-40c8-880b-0ce324f4c0f4 tempest-InstanceUsageAuditLogNegativeTestJSON-2102566575 tempest-InstanceUsageAuditLogNegativeTestJSON-2102566575-project-admin] Request method failure captured: Oct 27 03:26:09.328321 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Oct 27 03:26:09.328321 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:26:09.328321 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:26:09.328321 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:26:09.328321 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:26:09.328321 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:26:09.328321 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:26:09.328321 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:26:09.328321 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:26:09.328321 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfpQDOCaQyPh8GsiDiwFFdNcZjL28lHUx-EpCDAc-dKNAAkjdhqeoYjDPPiz36wxoh30Q4FDWU7Bvb2b14Dhrsogo2mT_Tv0R31_VpmRMuzGovLyMjsWfdhhG7XoF2h_0yXZJ4bRUZ_cuILvRRqWaxXAnu7Lnxoj1eXvhzUkqKN42js Oct 27 03:26:09.328321 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:26:09.328321 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:26:09.328321 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:26:09.328321 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:26:09.328321 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:26:09.328321 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:26:09.328321 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 26d595e9c1ba430cb825e41001c96744 Oct 27 03:26:09.328321 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2102566575 Oct 27 03:26:09.328321 n-d-862769-1 devstack@n-api.service[121001]: X-Role: admin,member,reader Oct 27 03:26:09.328321 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: admin,member,reader Oct 27 03:26:09.336792 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/26d595e9c1ba430cb825e41001c96744"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/26d595e9c1ba430cb825e41001c96744"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/26d595e9c1ba430cb825e41001c96744"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_26d595e9c1ba430cb825e41001c96744"}]}] Oct 27 03:26:09.336792 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-2102566575 Oct 27 03:26:09.336792 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 26d595e9c1ba430cb825e41001c96744 Oct 27 03:26:09.336792 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2102566575 Oct 27 03:26:09.336792 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-2102566575-project-admin Oct 27 03:26:09.336792 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:26:09.336792 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:26:09.336792 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 0964ab9d4f294398a0c92e2b0fb9fa30 Oct 27 03:26:09.336792 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2102566575-project-admin Oct 27 03:26:09.336792 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:26:09.336792 n-d-862769-1 devstack@n-api.service[121001]: exception: Invalid timestamp for date invalid_time Oct 27 03:26:09.337644 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': 'invalid_time'} Oct 27 03:26:09.337644 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:26:09.337644 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:26:09.337644 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Oct 27 03:26:09.337644 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Oct 27 03:26:09.337644 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Oct 27 03:26:09.337644 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Oct 27 03:26:09.337644 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Oct 27 03:26:09.337644 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Oct 27 03:26:09.337644 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Oct 27 03:26:09.337644 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:26:09.337644 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:26:09.337644 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:26:09.337644 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:26:09.337644 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:26:09.337644 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:26:09.337644 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:26:09.337644 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:26:09.337644 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:26:09.337644 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:26:09.339143 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Oct 27 03:26:09.339143 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Oct 27 03:26:09.339143 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Oct 27 03:26:09.339143 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:26:09.339143 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:26:09.339143 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:26:09.339143 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:26:09.339143 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:26:09.339143 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:26:09.339143 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:26:09.339143 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:26:09.339143 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Oct 27 03:26:09.339143 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:26:09.339143 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3f8e40ff-b55c-40c8-880b-0ce324f4c0f4 tempest-InstanceUsageAuditLogNegativeTestJSON-2102566575 tempest-InstanceUsageAuditLogNegativeTestJSON-2102566575-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:26:09.339143 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3f8e40ff-b55c-40c8-880b-0ce324f4c0f4 tempest-InstanceUsageAuditLogNegativeTestJSON-2102566575 tempest-InstanceUsageAuditLogNegativeTestJSON-2102566575-project-admin] 10.222.0.20 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.643694 Oct 27 03:26:09.340273 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 787/1615] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Oct 27 03:26:08 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 646 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 27 03:26:09.350614 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-869b9767-4434-4f4b-bb73-24b7eaccb682 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:09.354156 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-869b9767-4434-4f4b-bb73-24b7eaccb682 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: e8781053-3dad-4951-b4cb-1f4aaf97e19b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:09.378927 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-869b9767-4434-4f4b-bb73-24b7eaccb682 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:09.381482 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-869b9767-4434-4f4b-bb73-24b7eaccb682 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:09.382249 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-869b9767-4434-4f4b-bb73-24b7eaccb682 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:09.386203 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-869b9767-4434-4f4b-bb73-24b7eaccb682 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:09.387009 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-869b9767-4434-4f4b-bb73-24b7eaccb682 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:09.387571 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-869b9767-4434-4f4b-bb73-24b7eaccb682 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:09.901168 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-869b9767-4434-4f4b-bb73-24b7eaccb682 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:09.914877 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-869b9767-4434-4f4b-bb73-24b7eaccb682 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b" status: 200 len: 1469 microversion: 2.1 time: 0.580524 Oct 27 03:26:09.917945 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 788/1616] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:26:09 2022] GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b => generated 1469 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:26:09.930396 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e2948016-e82c-493f-bda5-79633983fde0 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:09.931276 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e2948016-e82c-493f-bda5-79633983fde0 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 2be00171-65ea-411a-b2d8-86b4e42d5de9] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:09.946275 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e2948016-e82c-493f-bda5-79633983fde0 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:09.947829 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e2948016-e82c-493f-bda5-79633983fde0 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:09.949659 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e2948016-e82c-493f-bda5-79633983fde0 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:09.960671 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e2948016-e82c-493f-bda5-79633983fde0 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:09.960671 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e2948016-e82c-493f-bda5-79633983fde0 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:09.960671 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e2948016-e82c-493f-bda5-79633983fde0 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:10.138863 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e2948016-e82c-493f-bda5-79633983fde0 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:10.152212 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e2948016-e82c-493f-bda5-79633983fde0 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/2be00171-65ea-411a-b2d8-86b4e42d5de9" status: 200 len: 1259 microversion: 2.1 time: 0.231485 Oct 27 03:26:10.152814 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 789/1617] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:26:09 2022] GET /compute/v2.1/servers/2be00171-65ea-411a-b2d8-86b4e42d5de9 => generated 1259 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:26:10.447775 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6e435de2-aaee-480d-a32b-14b906db3561 tempest-InstanceUsageAuditLogNegativeTestJSON-674963476 tempest-InstanceUsageAuditLogNegativeTestJSON-674963476-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:10.449522 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6e435de2-aaee-480d-a32b-14b906db3561 tempest-InstanceUsageAuditLogNegativeTestJSON-674963476 tempest-InstanceUsageAuditLogNegativeTestJSON-674963476-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '27ed0670f5264d81b3fc2542eea5467f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba57de09ea74467396f82dcf36761480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:10.451363 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6e435de2-aaee-480d-a32b-14b906db3561 tempest-InstanceUsageAuditLogNegativeTestJSON-674963476 tempest-InstanceUsageAuditLogNegativeTestJSON-674963476-project] Request method failure captured: Oct 27 03:26:10.451363 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Oct 27 03:26:10.451363 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:26:10.451363 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:26:10.451363 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:26:10.451363 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:26:10.451363 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:26:10.451363 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:26:10.451363 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:26:10.451363 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:26:10.451363 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfpOob8tOdiEH9mn9ZCI6svxsD1vl_tPPHUAhAEDUuFUeujM6M3aTEvaxPZWIJmGyqdkbKTEi0tYKT3gB9a8YBEwoXj_conbDGfOlxks1GUsiD2IMJIkhUc56DWObKp0N4WVR08QLis77HntSUbwolOjxNb5Mkox1oYJtCbVacE9BGA Oct 27 03:26:10.451363 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:26:10.451363 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:26:10.451363 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:26:10.451363 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:26:10.451363 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:26:10.451363 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:26:10.451363 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: ba57de09ea74467396f82dcf36761480 Oct 27 03:26:10.451363 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-674963476 Oct 27 03:26:10.451363 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:26:10.451363 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:26:10.452817 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ba57de09ea74467396f82dcf36761480"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ba57de09ea74467396f82dcf36761480"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ba57de09ea74467396f82dcf36761480"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ba57de09ea74467396f82dcf36761480"}]}] Oct 27 03:26:10.452817 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-674963476 Oct 27 03:26:10.452817 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: ba57de09ea74467396f82dcf36761480 Oct 27 03:26:10.452817 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-674963476 Oct 27 03:26:10.452817 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-674963476-project Oct 27 03:26:10.452817 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:26:10.452817 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:26:10.452817 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 27ed0670f5264d81b3fc2542eea5467f Oct 27 03:26:10.452817 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-674963476-project Oct 27 03:26:10.452817 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:26:10.453589 n-d-862769-1 devstack@n-api.service[121001]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 27 03:26:10.453589 n-d-862769-1 devstack@n-api.service[121001]: action_args: {} Oct 27 03:26:10.453589 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:26:10.453589 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:26:10.453589 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:26:10.453589 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:26:10.453589 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:26:10.453589 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:26:10.453589 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:26:10.453589 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:26:10.453589 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Oct 27 03:26:10.453589 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Oct 27 03:26:10.453589 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 03:26:10.453589 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 03:26:10.453589 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 03:26:10.453589 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 03:26:10.453589 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 03:26:10.453589 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 03:26:10.453589 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 03:26:10.453589 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 03:26:10.455147 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 03:26:10.455147 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 03:26:10.455147 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 03:26:10.455147 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 03:26:10.455147 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 03:26:10.455147 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 03:26:10.455147 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 27 03:26:10.455147 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:26:10.455147 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:26:10.455147 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:26:10.455147 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:26:10.455147 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:26:10.455147 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:26:10.455147 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 03:26:10.455147 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 03:26:10.455147 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 27 03:26:10.455147 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:26:10.461254 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6e435de2-aaee-480d-a32b-14b906db3561 tempest-InstanceUsageAuditLogNegativeTestJSON-674963476 tempest-InstanceUsageAuditLogNegativeTestJSON-674963476-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:26:10.461254 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6e435de2-aaee-480d-a32b-14b906db3561 tempest-InstanceUsageAuditLogNegativeTestJSON-674963476 tempest-InstanceUsageAuditLogNegativeTestJSON-674963476-project] 10.222.0.20 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.301006 Oct 27 03:26:10.461254 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 790/1618] 10.222.0.20 () {58 vars in 1185 bytes} [Thu Oct 27 03:26:10 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 302 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:26:10.465045 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-b2d6ac0c-e8af-41d8-bc25-64ed2ce71a31 req-728e28d4-ec6e-4968-8250-a9d3403e5b78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33d5c62a-898f-441b-a1a1-3cb12836755d", "name": "network-vif-deleted", "tag": "0fee4f52-9d23-48f3-b849-8399851e00ed"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:26:10.476450 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-b2d6ac0c-e8af-41d8-bc25-64ed2ce71a31 req-728e28d4-ec6e-4968-8250-a9d3403e5b78 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:10.476931 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-b2d6ac0c-e8af-41d8-bc25-64ed2ce71a31 req-728e28d4-ec6e-4968-8250-a9d3403e5b78 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:10.477368 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-b2d6ac0c-e8af-41d8-bc25-64ed2ce71a31 req-728e28d4-ec6e-4968-8250-a9d3403e5b78 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:10.488947 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-b2d6ac0c-e8af-41d8-bc25-64ed2ce71a31 req-728e28d4-ec6e-4968-8250-a9d3403e5b78 service nova] Creating event network-vif-deleted:0fee4f52-9d23-48f3-b849-8399851e00ed for instance 33d5c62a-898f-441b-a1a1-3cb12836755d on n-h2-862769-1 Oct 27 03:26:10.494503 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-b2d6ac0c-e8af-41d8-bc25-64ed2ce71a31 req-728e28d4-ec6e-4968-8250-a9d3403e5b78 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032757 Oct 27 03:26:10.495303 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 791/1619] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:26:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:26:10.500990 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-299dbce6-7980-4681-81f1-72c1ed95c97e tempest-InstanceUsageAuditLogNegativeTestJSON-674963476 tempest-InstanceUsageAuditLogNegativeTestJSON-674963476-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:10.510280 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-299dbce6-7980-4681-81f1-72c1ed95c97e tempest-InstanceUsageAuditLogNegativeTestJSON-674963476 tempest-InstanceUsageAuditLogNegativeTestJSON-674963476-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '27ed0670f5264d81b3fc2542eea5467f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba57de09ea74467396f82dcf36761480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:10.510280 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-299dbce6-7980-4681-81f1-72c1ed95c97e tempest-InstanceUsageAuditLogNegativeTestJSON-674963476 tempest-InstanceUsageAuditLogNegativeTestJSON-674963476-project] Request method failure captured: Oct 27 03:26:10.510280 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-10-27%2003:26:10 HTTP/1.1 Oct 27 03:26:10.510280 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:26:10.510280 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:26:10.510280 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:26:10.510280 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:26:10.510280 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:26:10.510280 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:26:10.510280 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:26:10.510280 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:26:10.510280 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfpOob8tOdiEH9mn9ZCI6svxsD1vl_tPPHUAhAEDUuFUeujM6M3aTEvaxPZWIJmGyqdkbKTEi0tYKT3gB9a8YBEwoXj_conbDGfOlxks1GUsiD2IMJIkhUc56DWObKp0N4WVR08QLis77HntSUbwolOjxNb5Mkox1oYJtCbVacE9BGA Oct 27 03:26:10.510280 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:26:10.510280 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:26:10.510280 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:26:10.510280 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:26:10.510280 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:26:10.510280 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:26:10.510280 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: ba57de09ea74467396f82dcf36761480 Oct 27 03:26:10.510280 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-674963476 Oct 27 03:26:10.510280 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:26:10.510280 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:26:10.512760 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ba57de09ea74467396f82dcf36761480"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ba57de09ea74467396f82dcf36761480"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ba57de09ea74467396f82dcf36761480"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ba57de09ea74467396f82dcf36761480"}]}] Oct 27 03:26:10.512760 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-674963476 Oct 27 03:26:10.512760 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: ba57de09ea74467396f82dcf36761480 Oct 27 03:26:10.512760 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-674963476 Oct 27 03:26:10.512760 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-674963476-project Oct 27 03:26:10.512760 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:26:10.512760 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:26:10.512760 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 27ed0670f5264d81b3fc2542eea5467f Oct 27 03:26:10.512760 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-674963476-project Oct 27 03:26:10.512760 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:26:10.513398 n-d-862769-1 devstack@n-api.service[121001]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 27 03:26:10.513398 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '2022-10-27 03:26:10'} Oct 27 03:26:10.513398 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:26:10.513398 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:26:10.513398 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:26:10.513398 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:26:10.513398 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:26:10.513398 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:26:10.513398 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:26:10.513398 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:26:10.513398 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Oct 27 03:26:10.513398 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Oct 27 03:26:10.513398 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 03:26:10.513398 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 03:26:10.513398 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 03:26:10.513398 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 03:26:10.513398 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 03:26:10.513398 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 03:26:10.513398 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 03:26:10.513398 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 03:26:10.515314 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 03:26:10.515314 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 03:26:10.515314 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 03:26:10.515314 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 03:26:10.515314 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 03:26:10.515314 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 03:26:10.515314 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 27 03:26:10.515314 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:26:10.515314 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:26:10.515314 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:26:10.515314 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:26:10.515314 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:26:10.515314 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:26:10.515314 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 03:26:10.515314 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 03:26:10.515314 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 27 03:26:10.515314 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:26:10.516999 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-299dbce6-7980-4681-81f1-72c1ed95c97e tempest-InstanceUsageAuditLogNegativeTestJSON-674963476 tempest-InstanceUsageAuditLogNegativeTestJSON-674963476-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:26:10.516999 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-299dbce6-7980-4681-81f1-72c1ed95c97e tempest-InstanceUsageAuditLogNegativeTestJSON-674963476 tempest-InstanceUsageAuditLogNegativeTestJSON-674963476-project] 10.222.0.20 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-27 03:26:10" status: 403 len: 128 microversion: 2.1 time: 0.011230 Oct 27 03:26:10.516999 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 792/1620] 10.222.0.20 () {58 vars in 1251 bytes} [Thu Oct 27 03:26:10 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-27%2003%3A26%3A10 => generated 128 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:26:10.949042 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-54c02fad-8f92-498f-b32a-0511db444194 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:10.950186 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-54c02fad-8f92-498f-b32a-0511db444194 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: e8781053-3dad-4951-b4cb-1f4aaf97e19b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:10.978071 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-54c02fad-8f92-498f-b32a-0511db444194 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:10.978546 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-54c02fad-8f92-498f-b32a-0511db444194 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:10.978998 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-54c02fad-8f92-498f-b32a-0511db444194 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:10.979738 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-54c02fad-8f92-498f-b32a-0511db444194 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:10.980205 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-54c02fad-8f92-498f-b32a-0511db444194 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:10.980646 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-54c02fad-8f92-498f-b32a-0511db444194 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:11.307950 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-54c02fad-8f92-498f-b32a-0511db444194 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:11.317282 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-54c02fad-8f92-498f-b32a-0511db444194 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b" status: 200 len: 1462 microversion: 2.1 time: 0.375160 Oct 27 03:26:11.349830 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 793/1621] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:26:10 2022] GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b => generated 1462 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:26:11.361870 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c69c51b3-0562-4835-96a7-b93ca8cbb35e tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:11.363516 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c69c51b3-0562-4835-96a7-b93ca8cbb35e tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 2be00171-65ea-411a-b2d8-86b4e42d5de9] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:11.375207 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c69c51b3-0562-4835-96a7-b93ca8cbb35e tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:11.378948 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c69c51b3-0562-4835-96a7-b93ca8cbb35e tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:11.380299 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c69c51b3-0562-4835-96a7-b93ca8cbb35e tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:11.381271 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c69c51b3-0562-4835-96a7-b93ca8cbb35e tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:11.381744 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c69c51b3-0562-4835-96a7-b93ca8cbb35e tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:11.382216 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c69c51b3-0562-4835-96a7-b93ca8cbb35e tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:11.412130 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-054eede8-e4aa-45cb-965b-d65ae7163706 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104/action" status: 202 len: 0 microversion: 2.1 time: 4.173515 Oct 27 03:26:11.413112 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 829/1622] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:26:07 2022] POST /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104/action => generated 0 bytes in 4175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:26:11.443437 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-648c38fd-61b0-49fc-ae25-a8ee61d906ee tempest-MigrationsAdminTest-707106630 tempest-MigrationsAdminTest-707106630-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:11.449739 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-648c38fd-61b0-49fc-ae25-a8ee61d906ee tempest-MigrationsAdminTest-707106630 tempest-MigrationsAdminTest-707106630-project-admin] [instance: e8781053-3dad-4951-b4cb-1f4aaf97e19b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:11.468858 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-648c38fd-61b0-49fc-ae25-a8ee61d906ee tempest-MigrationsAdminTest-707106630 tempest-MigrationsAdminTest-707106630-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:11.476376 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-648c38fd-61b0-49fc-ae25-a8ee61d906ee tempest-MigrationsAdminTest-707106630 tempest-MigrationsAdminTest-707106630-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:11.477049 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-648c38fd-61b0-49fc-ae25-a8ee61d906ee tempest-MigrationsAdminTest-707106630 tempest-MigrationsAdminTest-707106630-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:11.478087 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-648c38fd-61b0-49fc-ae25-a8ee61d906ee tempest-MigrationsAdminTest-707106630 tempest-MigrationsAdminTest-707106630-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:11.478706 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-648c38fd-61b0-49fc-ae25-a8ee61d906ee tempest-MigrationsAdminTest-707106630 tempest-MigrationsAdminTest-707106630-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:11.479507 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-648c38fd-61b0-49fc-ae25-a8ee61d906ee tempest-MigrationsAdminTest-707106630 tempest-MigrationsAdminTest-707106630-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:11.533293 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c69c51b3-0562-4835-96a7-b93ca8cbb35e tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:11.537876 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c69c51b3-0562-4835-96a7-b93ca8cbb35e tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/2be00171-65ea-411a-b2d8-86b4e42d5de9" status: 200 len: 1265 microversion: 2.1 time: 0.186548 Oct 27 03:26:11.554060 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 794/1623] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:26:11 2022] GET /compute/v2.1/servers/2be00171-65ea-411a-b2d8-86b4e42d5de9 => generated 1265 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:26:11.554060 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-90ef1ead-7e3c-4e7d-88a8-df04ffe80b50 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:11.554060 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-90ef1ead-7e3c-4e7d-88a8-df04ffe80b50 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: 543fdf60-10ec-4a25-a9d0-30c386efb104] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:11.569965 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-90ef1ead-7e3c-4e7d-88a8-df04ffe80b50 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:11.573501 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-90ef1ead-7e3c-4e7d-88a8-df04ffe80b50 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:11.574206 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-90ef1ead-7e3c-4e7d-88a8-df04ffe80b50 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:11.575160 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-90ef1ead-7e3c-4e7d-88a8-df04ffe80b50 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:11.576866 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-90ef1ead-7e3c-4e7d-88a8-df04ffe80b50 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:11.578073 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-90ef1ead-7e3c-4e7d-88a8-df04ffe80b50 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:11.696530 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-648c38fd-61b0-49fc-ae25-a8ee61d906ee tempest-MigrationsAdminTest-707106630 tempest-MigrationsAdminTest-707106630-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b" status: 200 len: 1613 microversion: 2.1 time: 0.281504 Oct 27 03:26:11.716224 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 830/1624] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:26:11 2022] GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b => generated 1613 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:26:11.729357 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a05cdcb8-0147-42b9-83a8-12d1ecc13b48 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:11.729963 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a05cdcb8-0147-42b9-83a8-12d1ecc13b48 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: e8781053-3dad-4951-b4cb-1f4aaf97e19b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:11.736930 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a05cdcb8-0147-42b9-83a8-12d1ecc13b48 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:11.738255 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a05cdcb8-0147-42b9-83a8-12d1ecc13b48 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:11.738973 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a05cdcb8-0147-42b9-83a8-12d1ecc13b48 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:11.739761 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a05cdcb8-0147-42b9-83a8-12d1ecc13b48 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:11.740414 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a05cdcb8-0147-42b9-83a8-12d1ecc13b48 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:11.741100 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a05cdcb8-0147-42b9-83a8-12d1ecc13b48 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:11.772009 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a05cdcb8-0147-42b9-83a8-12d1ecc13b48 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: e8781053-3dad-4951-b4cb-1f4aaf97e19b] Going to try to terminate instance {{(pid=121000) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:26:11.920095 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-90ef1ead-7e3c-4e7d-88a8-df04ffe80b50 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:11.933279 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-90ef1ead-7e3c-4e7d-88a8-df04ffe80b50 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104" status: 200 len: 1718 microversion: 2.1 time: 0.389036 Oct 27 03:26:11.934153 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 795/1625] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:26:11 2022] GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104 => generated 1718 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:26:12.162851 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a05cdcb8-0147-42b9-83a8-12d1ecc13b48 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b" status: 204 len: 0 microversion: 2.1 time: 0.436578 Oct 27 03:26:12.168050 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 831/1626] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:26:11 2022] DELETE /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b => generated 0 bytes in 440 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:26:12.173875 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-be2b49e4-2cc9-441f-82e3-d947971e379c tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:12.173875 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-be2b49e4-2cc9-441f-82e3-d947971e379c tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: e8781053-3dad-4951-b4cb-1f4aaf97e19b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:12.194517 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-be2b49e4-2cc9-441f-82e3-d947971e379c tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:12.195394 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-be2b49e4-2cc9-441f-82e3-d947971e379c tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:12.195996 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-be2b49e4-2cc9-441f-82e3-d947971e379c tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:12.197044 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-be2b49e4-2cc9-441f-82e3-d947971e379c tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:12.197822 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-be2b49e4-2cc9-441f-82e3-d947971e379c tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:12.198437 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-be2b49e4-2cc9-441f-82e3-d947971e379c tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:12.508917 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-be2b49e4-2cc9-441f-82e3-d947971e379c tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:12.519916 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-be2b49e4-2cc9-441f-82e3-d947971e379c tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b" status: 200 len: 1468 microversion: 2.1 time: 0.350468 Oct 27 03:26:12.531823 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 796/1627] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:26:12 2022] GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b => generated 1468 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:26:12.573170 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3dd66f52-2a71-4300-b88f-dda6a3360d64 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:12.573881 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-3dd66f52-2a71-4300-b88f-dda6a3360d64 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 2be00171-65ea-411a-b2d8-86b4e42d5de9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:12.588654 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3dd66f52-2a71-4300-b88f-dda6a3360d64 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:12.588654 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3dd66f52-2a71-4300-b88f-dda6a3360d64 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:12.591829 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3dd66f52-2a71-4300-b88f-dda6a3360d64 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:12.592684 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3dd66f52-2a71-4300-b88f-dda6a3360d64 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:12.593173 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3dd66f52-2a71-4300-b88f-dda6a3360d64 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:12.593649 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3dd66f52-2a71-4300-b88f-dda6a3360d64 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:12.931426 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-3dd66f52-2a71-4300-b88f-dda6a3360d64 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:12.942263 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3dd66f52-2a71-4300-b88f-dda6a3360d64 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/2be00171-65ea-411a-b2d8-86b4e42d5de9" status: 200 len: 1307 microversion: 2.1 time: 0.372965 Oct 27 03:26:12.945549 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 832/1628] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:26:12 2022] GET /compute/v2.1/servers/2be00171-65ea-411a-b2d8-86b4e42d5de9 => generated 1307 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:26:12.963400 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3e7a649c-7165-4ce4-9e53-ff4d923f885e tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:12.963623 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3e7a649c-7165-4ce4-9e53-ff4d923f885e tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: 543fdf60-10ec-4a25-a9d0-30c386efb104] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:12.976519 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3e7a649c-7165-4ce4-9e53-ff4d923f885e tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:12.977401 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3e7a649c-7165-4ce4-9e53-ff4d923f885e tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:12.979252 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3e7a649c-7165-4ce4-9e53-ff4d923f885e tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:12.982080 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3e7a649c-7165-4ce4-9e53-ff4d923f885e tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:12.982805 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3e7a649c-7165-4ce4-9e53-ff4d923f885e tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:12.983494 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3e7a649c-7165-4ce4-9e53-ff4d923f885e tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:13.313756 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3e7a649c-7165-4ce4-9e53-ff4d923f885e tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:13.325338 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3e7a649c-7165-4ce4-9e53-ff4d923f885e tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104" status: 200 len: 1718 microversion: 2.1 time: 0.367808 Oct 27 03:26:13.325928 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 797/1629] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:26:12 2022] GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104 => generated 1718 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:26:13.426009 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d556b7b1-7e7c-41cc-8343-a27b717df2c5 tempest-FlavorsV2NegativeTest-991591620 tempest-FlavorsV2NegativeTest-991591620-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:13.435986 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d556b7b1-7e7c-41cc-8343-a27b717df2c5 tempest-FlavorsV2NegativeTest-991591620 tempest-FlavorsV2NegativeTest-991591620-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.161169 Oct 27 03:26:13.436960 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 833/1630] 10.222.0.20 () {58 vars in 1137 bytes} [Thu Oct 27 03:26:13 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:26:13.544012 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-29a69307-5dcf-4048-a3b3-5bfca4b6bc6a tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:13.544998 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-29a69307-5dcf-4048-a3b3-5bfca4b6bc6a tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: e8781053-3dad-4951-b4cb-1f4aaf97e19b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:13.553807 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-29a69307-5dcf-4048-a3b3-5bfca4b6bc6a tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:13.554889 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-29a69307-5dcf-4048-a3b3-5bfca4b6bc6a tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:13.555548 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-29a69307-5dcf-4048-a3b3-5bfca4b6bc6a tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:13.556493 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-29a69307-5dcf-4048-a3b3-5bfca4b6bc6a tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:13.557170 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-29a69307-5dcf-4048-a3b3-5bfca4b6bc6a tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:13.557828 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-29a69307-5dcf-4048-a3b3-5bfca4b6bc6a tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:13.972960 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0132011d-fae5-4ba5-8301-aeb2578f6cbb tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:13.974344 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0132011d-fae5-4ba5-8301-aeb2578f6cbb tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 2be00171-65ea-411a-b2d8-86b4e42d5de9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:14.005435 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0132011d-fae5-4ba5-8301-aeb2578f6cbb tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:14.010680 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0132011d-fae5-4ba5-8301-aeb2578f6cbb tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:14.011532 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0132011d-fae5-4ba5-8301-aeb2578f6cbb tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:14.012520 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0132011d-fae5-4ba5-8301-aeb2578f6cbb tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:14.014557 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0132011d-fae5-4ba5-8301-aeb2578f6cbb tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:14.017723 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0132011d-fae5-4ba5-8301-aeb2578f6cbb tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:14.059995 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-29a69307-5dcf-4048-a3b3-5bfca4b6bc6a tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:14.071896 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-29a69307-5dcf-4048-a3b3-5bfca4b6bc6a tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b" status: 200 len: 1468 microversion: 2.1 time: 0.531803 Oct 27 03:26:14.094455 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 798/1631] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:26:13 2022] GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b => generated 1468 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:26:14.349634 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d03fdf01-5aa4-4e4f-8dec-dd3b04f40e2c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:14.350943 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d03fdf01-5aa4-4e4f-8dec-dd3b04f40e2c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: 543fdf60-10ec-4a25-a9d0-30c386efb104] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:14.369583 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d03fdf01-5aa4-4e4f-8dec-dd3b04f40e2c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:14.370263 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d03fdf01-5aa4-4e4f-8dec-dd3b04f40e2c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:14.370945 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d03fdf01-5aa4-4e4f-8dec-dd3b04f40e2c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:14.377613 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d03fdf01-5aa4-4e4f-8dec-dd3b04f40e2c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:14.377613 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d03fdf01-5aa4-4e4f-8dec-dd3b04f40e2c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:14.377613 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d03fdf01-5aa4-4e4f-8dec-dd3b04f40e2c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:14.387172 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0132011d-fae5-4ba5-8301-aeb2578f6cbb tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:14.400623 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0132011d-fae5-4ba5-8301-aeb2578f6cbb tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/2be00171-65ea-411a-b2d8-86b4e42d5de9" status: 200 len: 1307 microversion: 2.1 time: 0.431243 Oct 27 03:26:14.401566 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 834/1632] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:26:13 2022] GET /compute/v2.1/servers/2be00171-65ea-411a-b2d8-86b4e42d5de9 => generated 1307 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:26:14.764734 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-4779ba3a-32a7-4fdf-81ff-5ee7c0ca7a57 req-a068325b-7b9f-4065-80ff-3ef34086758c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8781053-3dad-4951-b4cb-1f4aaf97e19b", "name": "network-vif-deleted", "tag": "2db0e1c6-c7e9-4994-9a8c-c23e51c0e800"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:26:14.798093 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-4779ba3a-32a7-4fdf-81ff-5ee7c0ca7a57 req-a068325b-7b9f-4065-80ff-3ef34086758c service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:14.798563 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-4779ba3a-32a7-4fdf-81ff-5ee7c0ca7a57 req-a068325b-7b9f-4065-80ff-3ef34086758c service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:14.799010 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-4779ba3a-32a7-4fdf-81ff-5ee7c0ca7a57 req-a068325b-7b9f-4065-80ff-3ef34086758c service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:14.833094 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-4779ba3a-32a7-4fdf-81ff-5ee7c0ca7a57 req-a068325b-7b9f-4065-80ff-3ef34086758c service nova] Creating event network-vif-deleted:2db0e1c6-c7e9-4994-9a8c-c23e51c0e800 for instance e8781053-3dad-4951-b4cb-1f4aaf97e19b on n-h2-862769-1 Oct 27 03:26:14.860078 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-4779ba3a-32a7-4fdf-81ff-5ee7c0ca7a57 req-a068325b-7b9f-4065-80ff-3ef34086758c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098859 Oct 27 03:26:14.860704 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 835/1633] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:26:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:26:14.904060 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d03fdf01-5aa4-4e4f-8dec-dd3b04f40e2c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:14.914407 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d03fdf01-5aa4-4e4f-8dec-dd3b04f40e2c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104" status: 200 len: 1718 microversion: 2.1 time: 0.569466 Oct 27 03:26:14.917451 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 799/1634] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:26:14 2022] GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104 => generated 1718 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:26:14.966269 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-00b6966c-742f-4e81-ae2b-39a2b8b92f4c tempest-FlavorsV2NegativeTest-991591620 tempest-FlavorsV2NegativeTest-991591620-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-2116724260", "imageRef": "1e95c7bb-2035-43ba-ab51-59b0dc2dde30", "flavorRef": "452"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:26:15.059516 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-00b6966c-742f-4e81-ae2b-39a2b8b92f4c tempest-FlavorsV2NegativeTest-991591620 tempest-FlavorsV2NegativeTest-991591620-project] validate_networks() for None {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:26:15.102554 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-054bc934-4a9c-4e0e-a2d8-0e6e069d4a3c tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:15.103189 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-054bc934-4a9c-4e0e-a2d8-0e6e069d4a3c tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: e8781053-3dad-4951-b4cb-1f4aaf97e19b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:15.119948 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-054bc934-4a9c-4e0e-a2d8-0e6e069d4a3c tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:15.120459 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-054bc934-4a9c-4e0e-a2d8-0e6e069d4a3c tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:15.121096 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-054bc934-4a9c-4e0e-a2d8-0e6e069d4a3c tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:15.121990 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-054bc934-4a9c-4e0e-a2d8-0e6e069d4a3c tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:15.122649 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-054bc934-4a9c-4e0e-a2d8-0e6e069d4a3c tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:15.123260 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-054bc934-4a9c-4e0e-a2d8-0e6e069d4a3c tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:15.179124 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-054bc934-4a9c-4e0e-a2d8-0e6e069d4a3c tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:15.180324 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-054bc934-4a9c-4e0e-a2d8-0e6e069d4a3c tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:15.181546 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-054bc934-4a9c-4e0e-a2d8-0e6e069d4a3c tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:15.182203 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-054bc934-4a9c-4e0e-a2d8-0e6e069d4a3c tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lazy-loading 'fault' on Instance uuid e8781053-3dad-4951-b4cb-1f4aaf97e19b {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:26:15.254601 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-054bc934-4a9c-4e0e-a2d8-0e6e069d4a3c tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:15.263336 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-054bc934-4a9c-4e0e-a2d8-0e6e069d4a3c tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b" status: 200 len: 1303 microversion: 2.1 time: 0.165507 Oct 27 03:26:15.264585 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 800/1635] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:26:15 2022] GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b => generated 1303 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:26:15.560204 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-00b6966c-742f-4e81-ae2b-39a2b8b92f4c tempest-FlavorsV2NegativeTest-991591620 tempest-FlavorsV2NegativeTest-991591620-project] HTTP exception thrown: Flavor's memory is too small for requested image. Oct 27 03:26:15.560702 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-00b6966c-742f-4e81-ae2b-39a2b8b92f4c tempest-FlavorsV2NegativeTest-991591620 tempest-FlavorsV2NegativeTest-991591620-project] Request method failure captured: Oct 27 03:26:15.560702 n-d-862769-1 devstack@n-api.service[121000]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 03:26:15.560702 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:26:15.560702 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:26:15.560702 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:26:15.560702 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 143 Oct 27 03:26:15.560702 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:26:15.560702 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:26:15.560702 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:26:15.560702 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:26:15.560702 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfpVqZIYSA_7Op6tJVrX7kOXBnKLrkdu9lyaFlXcDvquCnoQIq2HH3rUFFhv-DCVYyL5k__Ny6hhrxfVS2pnusoig9LB9hc0vr-qamzDiWBQGLxioknb6KZabIsKZ7C_3MGFfvDiLw4MKawbUOVzeowRI7BtMu5zS_2-s-lu8y8q5aM Oct 27 03:26:15.560702 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:26:15.560702 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:26:15.560702 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:26:15.560702 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:26:15.560702 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:26:15.560702 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:26:15.560702 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 719aefbc2ab2403a9430215011cee458 Oct 27 03:26:15.560702 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-FlavorsV2NegativeTest-991591620 Oct 27 03:26:15.560702 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:26:15.560702 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:26:15.562238 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/719aefbc2ab2403a9430215011cee458"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/719aefbc2ab2403a9430215011cee458"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/719aefbc2ab2403a9430215011cee458"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_719aefbc2ab2403a9430215011cee458"}]}] Oct 27 03:26:15.562238 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-FlavorsV2NegativeTest-991591620 Oct 27 03:26:15.562238 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 719aefbc2ab2403a9430215011cee458 Oct 27 03:26:15.562238 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-991591620 Oct 27 03:26:15.562238 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-FlavorsV2NegativeTest-991591620-project Oct 27 03:26:15.562238 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:26:15.562238 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:26:15.562238 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 0a1ad10d402846199297f49a6aa0f47c Oct 27 03:26:15.562238 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-FlavorsV2NegativeTest-991591620-project Oct 27 03:26:15.562238 n-d-862769-1 devstack@n-api.service[121000]: Oct 27 03:26:15.562238 n-d-862769-1 devstack@n-api.service[121000]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-2116724260", "imageRef": "1e95c7bb-2035-43ba-ab51-59b0dc2dde30", "flavorRef": "452"}} Oct 27 03:26:15.562238 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:26:15.563125 n-d-862769-1 devstack@n-api.service[121000]: exception: Flavor's memory is too small for requested image. Oct 27 03:26:15.563125 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-2116724260', 'imageRef': '1e95c7bb-2035-43ba-ab51-59b0dc2dde30', 'flavorRef': '452'}}} Oct 27 03:26:15.563125 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:26:15.563125 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:26:15.563125 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 27 03:26:15.563125 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 27 03:26:15.563125 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 27 03:26:15.563125 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 27 03:26:15.563125 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 27 03:26:15.563125 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 27 03:26:15.563125 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Oct 27 03:26:15.563125 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Oct 27 03:26:15.563125 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Oct 27 03:26:15.563125 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Oct 27 03:26:15.563125 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Oct 27 03:26:15.563125 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Oct 27 03:26:15.563125 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Oct 27 03:26:15.563125 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:26:15.563125 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:26:15.563125 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:26:15.564988 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:26:15.564988 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:26:15.564988 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:26:15.564988 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:26:15.564988 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:26:15.564988 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:26:15.564988 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:26:15.564988 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:26:15.564988 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:26:15.564988 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:26:15.564988 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:26:15.564988 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:26:15.564988 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:26:15.564988 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 27 03:26:15.564988 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Oct 27 03:26:15.564988 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 27 03:26:15.564988 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Oct 27 03:26:15.564988 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:26:15.564988 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:26:15.564988 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:26:15.564988 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:26:15.567611 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:26:15.567611 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:26:15.567611 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:26:15.567611 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:26:15.567611 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Oct 27 03:26:15.567611 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:26:15.569783 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-00b6966c-742f-4e81-ae2b-39a2b8b92f4c tempest-FlavorsV2NegativeTest-991591620 tempest-FlavorsV2NegativeTest-991591620-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:26:15.570922 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-00b6966c-742f-4e81-ae2b-39a2b8b92f4c tempest-FlavorsV2NegativeTest-991591620 tempest-FlavorsV2NegativeTest-991591620-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.609103 Oct 27 03:26:15.572098 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 836/1636] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:26:14 2022] POST /compute/v2.1/servers => generated 93 bytes in 611 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 27 03:26:15.599051 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a6796739-4956-421b-b64e-e015093c8ced tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:15.601504 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a6796739-4956-421b-b64e-e015093c8ced tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 2be00171-65ea-411a-b2d8-86b4e42d5de9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:15.619001 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a6796739-4956-421b-b64e-e015093c8ced tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:15.621858 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a6796739-4956-421b-b64e-e015093c8ced tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:15.623591 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a6796739-4956-421b-b64e-e015093c8ced tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:15.625536 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a6796739-4956-421b-b64e-e015093c8ced tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:15.628176 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a6796739-4956-421b-b64e-e015093c8ced tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:15.630385 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a6796739-4956-421b-b64e-e015093c8ced tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:15.737616 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-394595ee-c2dd-426c-a284-0eb13710a092 req-1117a4e4-09b2-4476-a5f7-8f2e2eaee40d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2be00171-65ea-411a-b2d8-86b4e42d5de9", "tag": "eb76ab11-86f3-4dc6-8ddf-18ea2272de05"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:26:15.759911 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-394595ee-c2dd-426c-a284-0eb13710a092 req-1117a4e4-09b2-4476-a5f7-8f2e2eaee40d service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:15.760415 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-394595ee-c2dd-426c-a284-0eb13710a092 req-1117a4e4-09b2-4476-a5f7-8f2e2eaee40d service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:15.760868 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-394595ee-c2dd-426c-a284-0eb13710a092 req-1117a4e4-09b2-4476-a5f7-8f2e2eaee40d service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:15.792535 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-394595ee-c2dd-426c-a284-0eb13710a092 req-1117a4e4-09b2-4476-a5f7-8f2e2eaee40d service nova] Creating event network-changed:eb76ab11-86f3-4dc6-8ddf-18ea2272de05 for instance 2be00171-65ea-411a-b2d8-86b4e42d5de9 on n-h2-862769-1 Oct 27 03:26:15.808454 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-394595ee-c2dd-426c-a284-0eb13710a092 req-1117a4e4-09b2-4476-a5f7-8f2e2eaee40d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.390158 Oct 27 03:26:15.814539 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 801/1637] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:26:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:26:15.855369 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a6796739-4956-421b-b64e-e015093c8ced tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:15.879022 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a6796739-4956-421b-b64e-e015093c8ced tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/2be00171-65ea-411a-b2d8-86b4e42d5de9" status: 200 len: 1307 microversion: 2.1 time: 0.305588 Oct 27 03:26:15.879957 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 837/1638] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:26:15 2022] GET /compute/v2.1/servers/2be00171-65ea-411a-b2d8-86b4e42d5de9 => generated 1307 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:26:15.944423 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-07c1684b-fe43-4982-af71-8f4c6ba237c8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:15.946341 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-07c1684b-fe43-4982-af71-8f4c6ba237c8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: 543fdf60-10ec-4a25-a9d0-30c386efb104] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:15.963626 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-07c1684b-fe43-4982-af71-8f4c6ba237c8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:15.964704 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-07c1684b-fe43-4982-af71-8f4c6ba237c8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:15.965401 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-07c1684b-fe43-4982-af71-8f4c6ba237c8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:15.966376 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-07c1684b-fe43-4982-af71-8f4c6ba237c8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:15.972424 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-07c1684b-fe43-4982-af71-8f4c6ba237c8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:15.988036 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-07c1684b-fe43-4982-af71-8f4c6ba237c8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:16.288153 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c5826f97-374c-4e89-80bb-a2423460c3dc tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:16.289388 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c5826f97-374c-4e89-80bb-a2423460c3dc tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: e8781053-3dad-4951-b4cb-1f4aaf97e19b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:16.303398 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c5826f97-374c-4e89-80bb-a2423460c3dc tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:16.304243 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c5826f97-374c-4e89-80bb-a2423460c3dc tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:16.307650 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c5826f97-374c-4e89-80bb-a2423460c3dc tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:16.307650 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c5826f97-374c-4e89-80bb-a2423460c3dc tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:16.307650 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c5826f97-374c-4e89-80bb-a2423460c3dc tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:16.307650 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c5826f97-374c-4e89-80bb-a2423460c3dc tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:16.341907 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-c5826f97-374c-4e89-80bb-a2423460c3dc tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] HTTP exception thrown: Instance e8781053-3dad-4951-b4cb-1f4aaf97e19b could not be found. Oct 27 03:26:16.343767 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c5826f97-374c-4e89-80bb-a2423460c3dc tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Request method failure captured: Oct 27 03:26:16.343767 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b HTTP/1.1 Oct 27 03:26:16.343767 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:26:16.343767 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:26:16.343767 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:26:16.343767 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:26:16.343767 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:26:16.343767 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:26:16.343767 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:26:16.343767 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:26:16.343767 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfkpsOdThwfxJ33-tvm9iyGYYH_ZEpxzKnwGDpraQk76sUDZ1GapHGOV16AB5VdWdfnwUaPYp4vgB7g5YsapertEYrEV0--d0qxDYMTapJeYZLFonTVKFj7aGGk3qWLH_Mm5fIfjgxAHHREZrHHg-wylU5NsG7duQZp_6q3wnJSCyhQ Oct 27 03:26:16.343767 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:26:16.343767 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:26:16.343767 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:26:16.343767 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:26:16.343767 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:26:16.343767 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:26:16.343767 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 48e708fb3bdd45bc976db7bd92af09c8 Oct 27 03:26:16.343767 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-MigrationsAdminTest-1680714986 Oct 27 03:26:16.343767 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:26:16.343767 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:26:16.345073 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/48e708fb3bdd45bc976db7bd92af09c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/48e708fb3bdd45bc976db7bd92af09c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/48e708fb3bdd45bc976db7bd92af09c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_48e708fb3bdd45bc976db7bd92af09c8"}]}] Oct 27 03:26:16.345073 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-MigrationsAdminTest-1680714986 Oct 27 03:26:16.345073 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 48e708fb3bdd45bc976db7bd92af09c8 Oct 27 03:26:16.345073 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-MigrationsAdminTest-1680714986 Oct 27 03:26:16.345073 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-MigrationsAdminTest-1680714986-project Oct 27 03:26:16.345073 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:26:16.345073 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:26:16.345073 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: d3f1177e2cbd4ba6b659f8a714be86ac Oct 27 03:26:16.345073 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-MigrationsAdminTest-1680714986-project Oct 27 03:26:16.345073 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:26:16.345073 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance e8781053-3dad-4951-b4cb-1f4aaf97e19b could not be found. Oct 27 03:26:16.345073 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': 'e8781053-3dad-4951-b4cb-1f4aaf97e19b'} Oct 27 03:26:16.345838 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:26:16.345838 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:26:16.345838 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:26:16.345838 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:26:16.345838 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:26:16.345838 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:26:16.345838 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:26:16.345838 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:26:16.345838 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:26:16.345838 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:26:16.345838 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8781053-3dad-4951-b4cb-1f4aaf97e19b could not be found. Oct 27 03:26:16.345838 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:26:16.345838 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:26:16.345838 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:26:16.345838 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:26:16.345838 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:26:16.345838 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:26:16.345838 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:26:16.345838 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:26:16.345838 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:26:16.347207 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:26:16.347207 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:26:16.347207 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:26:16.347207 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:26:16.347207 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:26:16.347207 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:26:16.347207 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:26:16.347207 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8781053-3dad-4951-b4cb-1f4aaf97e19b could not be found. Oct 27 03:26:16.347207 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:26:16.347207 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:26:16.347207 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:26:16.347207 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:26:16.347207 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:26:16.347207 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:26:16.347207 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:26:16.347207 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:26:16.347207 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8781053-3dad-4951-b4cb-1f4aaf97e19b could not be found. Oct 27 03:26:16.347207 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:26:16.349772 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c5826f97-374c-4e89-80bb-a2423460c3dc tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Returning 404 to user: Instance e8781053-3dad-4951-b4cb-1f4aaf97e19b could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:26:16.350905 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c5826f97-374c-4e89-80bb-a2423460c3dc tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b" status: 404 len: 111 microversion: 2.1 time: 0.066659 Oct 27 03:26:16.351546 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 838/1639] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:26:16 2022] GET /compute/v2.1/servers/e8781053-3dad-4951-b4cb-1f4aaf97e19b => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 03:26:16.364450 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-849ac5b7-8789-4659-917c-912d0be7ac4a tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:16.367235 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-849ac5b7-8789-4659-917c-912d0be7ac4a tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 77dd3d48-fede-491a-b6ce-5ad36a1d7cab] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:16.371941 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-07c1684b-fe43-4982-af71-8f4c6ba237c8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:16.376635 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-849ac5b7-8789-4659-917c-912d0be7ac4a tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:16.377164 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-849ac5b7-8789-4659-917c-912d0be7ac4a tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:16.377673 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-849ac5b7-8789-4659-917c-912d0be7ac4a tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:16.380137 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-849ac5b7-8789-4659-917c-912d0be7ac4a tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:16.380666 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-849ac5b7-8789-4659-917c-912d0be7ac4a tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:16.381105 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-849ac5b7-8789-4659-917c-912d0be7ac4a tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:16.386451 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-07c1684b-fe43-4982-af71-8f4c6ba237c8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104" status: 200 len: 1718 microversion: 2.1 time: 0.446875 Oct 27 03:26:16.399198 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 802/1640] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:26:15 2022] GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104 => generated 1718 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:26:16.416912 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-849ac5b7-8789-4659-917c-912d0be7ac4a tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 77dd3d48-fede-491a-b6ce-5ad36a1d7cab] Going to try to terminate instance {{(pid=121000) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:26:16.427329 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:26:16.522214 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:26:16.723158 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-849ac5b7-8789-4659-917c-912d0be7ac4a tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "DELETE /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab" status: 204 len: 0 microversion: 2.1 time: 0.365310 Oct 27 03:26:16.724525 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 839/1641] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:26:16 2022] DELETE /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:26:16.735109 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-fa12ddc9-e541-4420-aec2-5a0bc301d67c tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:16.735109 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-fa12ddc9-e541-4420-aec2-5a0bc301d67c tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 77dd3d48-fede-491a-b6ce-5ad36a1d7cab] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:16.742356 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fa12ddc9-e541-4420-aec2-5a0bc301d67c tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:16.743132 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fa12ddc9-e541-4420-aec2-5a0bc301d67c tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:16.743694 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fa12ddc9-e541-4420-aec2-5a0bc301d67c tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:16.745151 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fa12ddc9-e541-4420-aec2-5a0bc301d67c tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:16.745709 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fa12ddc9-e541-4420-aec2-5a0bc301d67c tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:16.746270 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fa12ddc9-e541-4420-aec2-5a0bc301d67c tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:16.907161 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-005f86a8-52b9-411a-b1c0-250034ddcb3a tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:16.920080 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-005f86a8-52b9-411a-b1c0-250034ddcb3a tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 2be00171-65ea-411a-b2d8-86b4e42d5de9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:16.924375 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-fa12ddc9-e541-4420-aec2-5a0bc301d67c tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:16.936781 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-fa12ddc9-e541-4420-aec2-5a0bc301d67c tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab" status: 200 len: 1534 microversion: 2.1 time: 0.207301 Oct 27 03:26:16.940436 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-005f86a8-52b9-411a-b1c0-250034ddcb3a tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:16.948596 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-005f86a8-52b9-411a-b1c0-250034ddcb3a tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:16.948596 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-005f86a8-52b9-411a-b1c0-250034ddcb3a tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:16.948596 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-005f86a8-52b9-411a-b1c0-250034ddcb3a tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:16.948596 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-005f86a8-52b9-411a-b1c0-250034ddcb3a tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:16.948988 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-005f86a8-52b9-411a-b1c0-250034ddcb3a tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:16.949079 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 803/1642] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:26:16 2022] GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab => generated 1534 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:26:17.063107 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=8 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:26:17.249982 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-005f86a8-52b9-411a-b1c0-250034ddcb3a tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:17.258313 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-005f86a8-52b9-411a-b1c0-250034ddcb3a tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/2be00171-65ea-411a-b2d8-86b4e42d5de9" status: 200 len: 1307 microversion: 2.1 time: 0.357258 Oct 27 03:26:17.258902 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 840/1643] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:26:16 2022] GET /compute/v2.1/servers/2be00171-65ea-411a-b2d8-86b4e42d5de9 => generated 1307 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:26:17.415484 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1af188ec-9fcf-43cf-a21b-0b5434ba4d69 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:17.420229 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1af188ec-9fcf-43cf-a21b-0b5434ba4d69 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: 543fdf60-10ec-4a25-a9d0-30c386efb104] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:17.433497 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1af188ec-9fcf-43cf-a21b-0b5434ba4d69 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:17.434915 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1af188ec-9fcf-43cf-a21b-0b5434ba4d69 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:17.436568 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1af188ec-9fcf-43cf-a21b-0b5434ba4d69 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:17.439406 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1af188ec-9fcf-43cf-a21b-0b5434ba4d69 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:17.443949 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1af188ec-9fcf-43cf-a21b-0b5434ba4d69 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:17.446876 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1af188ec-9fcf-43cf-a21b-0b5434ba4d69 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:17.492753 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=100 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:26:17.711508 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1af188ec-9fcf-43cf-a21b-0b5434ba4d69 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:17.724558 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1af188ec-9fcf-43cf-a21b-0b5434ba4d69 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104" status: 200 len: 1718 microversion: 2.1 time: 0.312762 Oct 27 03:26:17.727225 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 804/1644] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:26:17 2022] GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104 => generated 1718 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:26:17.965766 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b60dafd2-01a4-4a64-9937-da826de4509e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:17.966592 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b60dafd2-01a4-4a64-9937-da826de4509e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 77dd3d48-fede-491a-b6ce-5ad36a1d7cab] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:17.990521 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b60dafd2-01a4-4a64-9937-da826de4509e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:17.990521 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b60dafd2-01a4-4a64-9937-da826de4509e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:17.990521 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b60dafd2-01a4-4a64-9937-da826de4509e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:17.990521 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b60dafd2-01a4-4a64-9937-da826de4509e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:17.991228 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b60dafd2-01a4-4a64-9937-da826de4509e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:17.992644 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b60dafd2-01a4-4a64-9937-da826de4509e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:18.284963 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-08b3962c-bbac-41e2-b26f-e1209606d097 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:18.286388 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-08b3962c-bbac-41e2-b26f-e1209606d097 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 2be00171-65ea-411a-b2d8-86b4e42d5de9] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:18.295937 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=10 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:26:18.298174 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-08b3962c-bbac-41e2-b26f-e1209606d097 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:18.298890 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-08b3962c-bbac-41e2-b26f-e1209606d097 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:18.300870 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-08b3962c-bbac-41e2-b26f-e1209606d097 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:18.304046 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-08b3962c-bbac-41e2-b26f-e1209606d097 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:18.304815 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-08b3962c-bbac-41e2-b26f-e1209606d097 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:18.311354 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-08b3962c-bbac-41e2-b26f-e1209606d097 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:18.637731 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-08b3962c-bbac-41e2-b26f-e1209606d097 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:18.668909 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-08b3962c-bbac-41e2-b26f-e1209606d097 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/2be00171-65ea-411a-b2d8-86b4e42d5de9" status: 200 len: 1307 microversion: 2.1 time: 0.375836 Oct 27 03:26:18.669133 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b60dafd2-01a4-4a64-9937-da826de4509e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:18.670915 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 805/1645] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:26:18 2022] GET /compute/v2.1/servers/2be00171-65ea-411a-b2d8-86b4e42d5de9 => generated 1307 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:26:18.707997 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b60dafd2-01a4-4a64-9937-da826de4509e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab" status: 200 len: 1534 microversion: 2.1 time: 0.733263 Oct 27 03:26:18.707997 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 841/1646] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:26:17 2022] GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab => generated 1534 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:26:18.759585 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-80e294c2-3220-4c96-937c-cb4aa417b125 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:18.759585 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-80e294c2-3220-4c96-937c-cb4aa417b125 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: 543fdf60-10ec-4a25-a9d0-30c386efb104] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:18.765733 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-80e294c2-3220-4c96-937c-cb4aa417b125 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:18.766537 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-80e294c2-3220-4c96-937c-cb4aa417b125 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:18.770264 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-80e294c2-3220-4c96-937c-cb4aa417b125 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:18.771073 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-80e294c2-3220-4c96-937c-cb4aa417b125 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:18.773661 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-80e294c2-3220-4c96-937c-cb4aa417b125 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:18.774557 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-80e294c2-3220-4c96-937c-cb4aa417b125 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:19.158932 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-80e294c2-3220-4c96-937c-cb4aa417b125 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:19.194466 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-80e294c2-3220-4c96-937c-cb4aa417b125 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104" status: 200 len: 1718 microversion: 2.1 time: 0.448692 Oct 27 03:26:19.221598 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 806/1647] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:26:18 2022] GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104 => generated 1718 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:26:19.692719 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b5cdfbef-bf15-4a22-be97-611d81e03583 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:19.693332 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b5cdfbef-bf15-4a22-be97-611d81e03583 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 2be00171-65ea-411a-b2d8-86b4e42d5de9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:19.712234 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b5cdfbef-bf15-4a22-be97-611d81e03583 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:19.712743 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b5cdfbef-bf15-4a22-be97-611d81e03583 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:19.717897 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b5cdfbef-bf15-4a22-be97-611d81e03583 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:19.717897 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b5cdfbef-bf15-4a22-be97-611d81e03583 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:19.717897 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b5cdfbef-bf15-4a22-be97-611d81e03583 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:19.717897 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b5cdfbef-bf15-4a22-be97-611d81e03583 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:19.724574 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9554bf78-92f4-47ba-975a-191a6f976837 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:19.725260 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-9554bf78-92f4-47ba-975a-191a6f976837 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 77dd3d48-fede-491a-b6ce-5ad36a1d7cab] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:19.745138 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9554bf78-92f4-47ba-975a-191a6f976837 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:19.749143 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9554bf78-92f4-47ba-975a-191a6f976837 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:19.749817 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9554bf78-92f4-47ba-975a-191a6f976837 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:19.750790 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9554bf78-92f4-47ba-975a-191a6f976837 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:19.757838 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9554bf78-92f4-47ba-975a-191a6f976837 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:19.759712 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9554bf78-92f4-47ba-975a-191a6f976837 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:19.905044 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9554bf78-92f4-47ba-975a-191a6f976837 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:19.916269 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9554bf78-92f4-47ba-975a-191a6f976837 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab" status: 200 len: 1492 microversion: 2.1 time: 0.194479 Oct 27 03:26:19.926290 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 807/1648] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:26:19 2022] GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab => generated 1492 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:26:20.276953 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-8f546880-0a5f-4ace-add2-17c855808bfa req-cee31107-99c0-4ddf-8052-e0dfd77410a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77dd3d48-fede-491a-b6ce-5ad36a1d7cab", "name": "network-vif-deleted", "tag": "a67227e9-dd6a-4cad-96f1-1d8b74514779"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:26:20.287671 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-8f546880-0a5f-4ace-add2-17c855808bfa req-cee31107-99c0-4ddf-8052-e0dfd77410a9 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:20.288588 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-8f546880-0a5f-4ace-add2-17c855808bfa req-cee31107-99c0-4ddf-8052-e0dfd77410a9 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:20.289326 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-8f546880-0a5f-4ace-add2-17c855808bfa req-cee31107-99c0-4ddf-8052-e0dfd77410a9 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:20.316224 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-8f546880-0a5f-4ace-add2-17c855808bfa req-cee31107-99c0-4ddf-8052-e0dfd77410a9 service nova] Creating event network-vif-deleted:a67227e9-dd6a-4cad-96f1-1d8b74514779 for instance 77dd3d48-fede-491a-b6ce-5ad36a1d7cab on n-h2-862769-1 Oct 27 03:26:20.327789 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-8f546880-0a5f-4ace-add2-17c855808bfa req-cee31107-99c0-4ddf-8052-e0dfd77410a9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.408223 Oct 27 03:26:20.329671 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 808/1649] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:26:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:26:20.338445 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f9a3a860-9cdb-4a91-9965-362bd4fc296e tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:20.344971 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f9a3a860-9cdb-4a91-9965-362bd4fc296e tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: 543fdf60-10ec-4a25-a9d0-30c386efb104] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:20.348574 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f9a3a860-9cdb-4a91-9965-362bd4fc296e tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:20.349271 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f9a3a860-9cdb-4a91-9965-362bd4fc296e tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:20.350185 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f9a3a860-9cdb-4a91-9965-362bd4fc296e tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:20.363185 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f9a3a860-9cdb-4a91-9965-362bd4fc296e tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:20.365108 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f9a3a860-9cdb-4a91-9965-362bd4fc296e tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:20.367434 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f9a3a860-9cdb-4a91-9965-362bd4fc296e tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:20.469519 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b5cdfbef-bf15-4a22-be97-611d81e03583 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:20.494817 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b5cdfbef-bf15-4a22-be97-611d81e03583 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/2be00171-65ea-411a-b2d8-86b4e42d5de9" status: 200 len: 1307 microversion: 2.1 time: 0.789237 Oct 27 03:26:20.494817 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 842/1650] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:26:19 2022] GET /compute/v2.1/servers/2be00171-65ea-411a-b2d8-86b4e42d5de9 => generated 1307 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:26:20.597031 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-eda9c0dd-cfca-41c2-96ad-f33da20775c0 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:20.597866 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-eda9c0dd-cfca-41c2-96ad-f33da20775c0 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] [instance: 09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:20.608374 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=5,nova_api:INSERT=3 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:26:20.614611 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eda9c0dd-cfca-41c2-96ad-f33da20775c0 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:20.619226 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eda9c0dd-cfca-41c2-96ad-f33da20775c0 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:20.619226 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eda9c0dd-cfca-41c2-96ad-f33da20775c0 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:20.622767 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eda9c0dd-cfca-41c2-96ad-f33da20775c0 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:20.623466 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eda9c0dd-cfca-41c2-96ad-f33da20775c0 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:20.623925 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eda9c0dd-cfca-41c2-96ad-f33da20775c0 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:20.718718 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f9a3a860-9cdb-4a91-9965-362bd4fc296e tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:20.735668 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f9a3a860-9cdb-4a91-9965-362bd4fc296e tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104" status: 200 len: 1718 microversion: 2.1 time: 0.401958 Oct 27 03:26:20.738170 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 809/1651] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:26:20 2022] GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104 => generated 1718 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:26:20.928866 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-eda9c0dd-cfca-41c2-96ad-f33da20775c0 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lazy-loading 'services' on Instance uuid 09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:26:20.942840 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-23b1ae56-826f-42cf-9395-e553b4aec96f tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:20.943477 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-23b1ae56-826f-42cf-9395-e553b4aec96f tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 77dd3d48-fede-491a-b6ce-5ad36a1d7cab] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:20.954876 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-23b1ae56-826f-42cf-9395-e553b4aec96f tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:20.955378 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-23b1ae56-826f-42cf-9395-e553b4aec96f tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:20.955823 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-23b1ae56-826f-42cf-9395-e553b4aec96f tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:20.962370 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-23b1ae56-826f-42cf-9395-e553b4aec96f tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:20.967783 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-23b1ae56-826f-42cf-9395-e553b4aec96f tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:20.969882 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-23b1ae56-826f-42cf-9395-e553b4aec96f tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:20.981577 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-eda9c0dd-cfca-41c2-96ad-f33da20775c0 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f" status: 200 len: 2421 microversion: 2.25 time: 0.391248 Oct 27 03:26:20.985338 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 843/1652] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:26:20 2022] GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f => generated 2421 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:26:21.016782 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f1c6a4f2-f04f-42d3-be98-73c8f23369a4 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-862769-1", "block_migration": "auto"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:26:21.020871 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f1c6a4f2-f04f-42d3-be98-73c8f23369a4 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] [instance: 09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:21.035269 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f1c6a4f2-f04f-42d3-be98-73c8f23369a4 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:21.036163 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f1c6a4f2-f04f-42d3-be98-73c8f23369a4 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:21.036846 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f1c6a4f2-f04f-42d3-be98-73c8f23369a4 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:21.037839 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f1c6a4f2-f04f-42d3-be98-73c8f23369a4 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:21.038551 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f1c6a4f2-f04f-42d3-be98-73c8f23369a4 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:21.039381 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f1c6a4f2-f04f-42d3-be98-73c8f23369a4 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:21.041676 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-23b1ae56-826f-42cf-9395-e553b4aec96f tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:21.042210 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-23b1ae56-826f-42cf-9395-e553b4aec96f tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:21.042667 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-23b1ae56-826f-42cf-9395-e553b4aec96f tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:21.043125 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-23b1ae56-826f-42cf-9395-e553b4aec96f tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lazy-loading 'fault' on Instance uuid 77dd3d48-fede-491a-b6ce-5ad36a1d7cab {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:26:21.078782 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-f1c6a4f2-f04f-42d3-be98-73c8f23369a4 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lazy-loading 'flavor' on Instance uuid 09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:26:21.118730 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f1c6a4f2-f04f-42d3-be98-73c8f23369a4 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] [instance: 09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f] Going to try to live migrate instance to n-h2-862769-1 {{(pid=121000) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 27 03:26:21.181131 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-23b1ae56-826f-42cf-9395-e553b4aec96f tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:21.206544 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-23b1ae56-826f-42cf-9395-e553b4aec96f tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab" status: 200 len: 1369 microversion: 2.1 time: 0.267212 Oct 27 03:26:21.224265 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 810/1653] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:26:20 2022] GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab => generated 1369 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:26:21.515427 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f3df437c-df7d-4b1a-9c1c-18def6cb0dc8 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:21.516402 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f3df437c-df7d-4b1a-9c1c-18def6cb0dc8 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 2be00171-65ea-411a-b2d8-86b4e42d5de9] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:21.537537 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f3df437c-df7d-4b1a-9c1c-18def6cb0dc8 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:21.543918 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f3df437c-df7d-4b1a-9c1c-18def6cb0dc8 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:21.545498 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f3df437c-df7d-4b1a-9c1c-18def6cb0dc8 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:21.547012 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f3df437c-df7d-4b1a-9c1c-18def6cb0dc8 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:21.550492 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f3df437c-df7d-4b1a-9c1c-18def6cb0dc8 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:21.552570 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f3df437c-df7d-4b1a-9c1c-18def6cb0dc8 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:21.863829 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f3df437c-df7d-4b1a-9c1c-18def6cb0dc8 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:21.886674 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f3df437c-df7d-4b1a-9c1c-18def6cb0dc8 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/2be00171-65ea-411a-b2d8-86b4e42d5de9" status: 200 len: 1307 microversion: 2.1 time: 0.375077 Oct 27 03:26:21.897919 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 811/1654] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:26:21 2022] GET /compute/v2.1/servers/2be00171-65ea-411a-b2d8-86b4e42d5de9 => generated 1307 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:26:21.927067 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7d826f13-a1bb-4ecc-b9e3-5aa952b46323 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:21.928522 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7d826f13-a1bb-4ecc-b9e3-5aa952b46323 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: 543fdf60-10ec-4a25-a9d0-30c386efb104] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:21.941452 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7d826f13-a1bb-4ecc-b9e3-5aa952b46323 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:21.941950 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7d826f13-a1bb-4ecc-b9e3-5aa952b46323 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:21.942802 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7d826f13-a1bb-4ecc-b9e3-5aa952b46323 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:21.943609 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7d826f13-a1bb-4ecc-b9e3-5aa952b46323 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:21.944164 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7d826f13-a1bb-4ecc-b9e3-5aa952b46323 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:21.944731 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7d826f13-a1bb-4ecc-b9e3-5aa952b46323 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:22.254604 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7d826f13-a1bb-4ecc-b9e3-5aa952b46323 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:22.267681 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7d826f13-a1bb-4ecc-b9e3-5aa952b46323 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104" status: 200 len: 1718 microversion: 2.1 time: 0.362786 Oct 27 03:26:22.270356 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 812/1655] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:26:21 2022] GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104 => generated 1718 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:26:22.283230 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2acc3962-5554-497c-8e46-ab5791d67e6e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:22.284035 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2acc3962-5554-497c-8e46-ab5791d67e6e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 77dd3d48-fede-491a-b6ce-5ad36a1d7cab] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:22.295047 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2acc3962-5554-497c-8e46-ab5791d67e6e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:22.299248 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2acc3962-5554-497c-8e46-ab5791d67e6e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:22.299874 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2acc3962-5554-497c-8e46-ab5791d67e6e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:22.300725 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2acc3962-5554-497c-8e46-ab5791d67e6e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:22.301453 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2acc3962-5554-497c-8e46-ab5791d67e6e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:22.301998 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2acc3962-5554-497c-8e46-ab5791d67e6e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:22.333714 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-2acc3962-5554-497c-8e46-ab5791d67e6e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] HTTP exception thrown: Instance 77dd3d48-fede-491a-b6ce-5ad36a1d7cab could not be found. Oct 27 03:26:22.335990 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2acc3962-5554-497c-8e46-ab5791d67e6e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Request method failure captured: Oct 27 03:26:22.335990 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab HTTP/1.1 Oct 27 03:26:22.335990 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:26:22.335990 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:26:22.335990 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:26:22.335990 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:26:22.335990 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:26:22.335990 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:26:22.335990 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:26:22.335990 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:26:22.335990 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfkpsOdThwfxJ33-tvm9iyGYYH_ZEpxzKnwGDpraQk76sUDZ1GapHGOV16AB5VdWdfnwUaPYp4vgB7g5YsapertEYrEV0--d0qxDYMTapJeYZLFonTVKFj7aGGk3qWLH_Mm5fIfjgxAHHREZrHHg-wylU5NsG7duQZp_6q3wnJSCyhQ Oct 27 03:26:22.335990 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:26:22.335990 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:26:22.335990 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:26:22.335990 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:26:22.335990 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:26:22.335990 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:26:22.335990 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 48e708fb3bdd45bc976db7bd92af09c8 Oct 27 03:26:22.335990 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-MigrationsAdminTest-1680714986 Oct 27 03:26:22.335990 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:26:22.335990 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:26:22.337584 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/48e708fb3bdd45bc976db7bd92af09c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/48e708fb3bdd45bc976db7bd92af09c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/48e708fb3bdd45bc976db7bd92af09c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_48e708fb3bdd45bc976db7bd92af09c8"}]}] Oct 27 03:26:22.337584 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-MigrationsAdminTest-1680714986 Oct 27 03:26:22.337584 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 48e708fb3bdd45bc976db7bd92af09c8 Oct 27 03:26:22.337584 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-MigrationsAdminTest-1680714986 Oct 27 03:26:22.337584 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-MigrationsAdminTest-1680714986-project Oct 27 03:26:22.337584 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:26:22.337584 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:26:22.337584 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: d3f1177e2cbd4ba6b659f8a714be86ac Oct 27 03:26:22.337584 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-MigrationsAdminTest-1680714986-project Oct 27 03:26:22.337584 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:26:22.337584 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 77dd3d48-fede-491a-b6ce-5ad36a1d7cab could not be found. Oct 27 03:26:22.337584 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '77dd3d48-fede-491a-b6ce-5ad36a1d7cab'} Oct 27 03:26:22.338485 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:26:22.338485 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:26:22.338485 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:26:22.338485 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:26:22.338485 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:26:22.338485 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:26:22.338485 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:26:22.338485 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:26:22.338485 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:26:22.338485 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:26:22.338485 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77dd3d48-fede-491a-b6ce-5ad36a1d7cab could not be found. Oct 27 03:26:22.338485 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:26:22.338485 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:26:22.338485 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:26:22.338485 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:26:22.338485 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:26:22.338485 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:26:22.338485 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:26:22.338485 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:26:22.338485 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:26:22.340073 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:26:22.340073 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:26:22.340073 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:26:22.340073 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:26:22.340073 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:26:22.340073 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:26:22.340073 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:26:22.340073 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77dd3d48-fede-491a-b6ce-5ad36a1d7cab could not be found. Oct 27 03:26:22.340073 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:26:22.340073 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:26:22.340073 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:26:22.340073 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:26:22.340073 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:26:22.340073 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:26:22.340073 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:26:22.340073 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:26:22.340073 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77dd3d48-fede-491a-b6ce-5ad36a1d7cab could not be found. Oct 27 03:26:22.340073 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:26:22.349149 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2acc3962-5554-497c-8e46-ab5791d67e6e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Returning 404 to user: Instance 77dd3d48-fede-491a-b6ce-5ad36a1d7cab could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:26:22.350952 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2acc3962-5554-497c-8e46-ab5791d67e6e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab" status: 404 len: 111 microversion: 2.1 time: 0.077609 Oct 27 03:26:22.355625 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 813/1656] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:26:22 2022] GET /compute/v2.1/servers/77dd3d48-fede-491a-b6ce-5ad36a1d7cab => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:26:22.361710 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-182e2b84-20c7-4af2-b2df-1a801f53bf71 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '.version_select at 0x7f7ddecf03a0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:22.460956 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-182e2b84-20c7-4af2-b2df-1a801f53bf71 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-185634273" status: 202 len: 0 microversion: 2.1 time: 0.103929 Oct 27 03:26:22.461737 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 814/1657] 10.222.0.20 () {58 vars in 1218 bytes} [Thu Oct 27 03:26:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-185634273 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:26:22.921011 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-205a459b-b281-4eb4-a594-63ebe8159b26 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:22.921808 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-205a459b-b281-4eb4-a594-63ebe8159b26 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 2be00171-65ea-411a-b2d8-86b4e42d5de9] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:22.930633 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-205a459b-b281-4eb4-a594-63ebe8159b26 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:22.931540 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-205a459b-b281-4eb4-a594-63ebe8159b26 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:22.932227 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-205a459b-b281-4eb4-a594-63ebe8159b26 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:22.933250 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-205a459b-b281-4eb4-a594-63ebe8159b26 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:22.933954 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-205a459b-b281-4eb4-a594-63ebe8159b26 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:22.934646 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-205a459b-b281-4eb4-a594-63ebe8159b26 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:23.304693 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-205a459b-b281-4eb4-a594-63ebe8159b26 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:23.313102 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-205a459b-b281-4eb4-a594-63ebe8159b26 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/2be00171-65ea-411a-b2d8-86b4e42d5de9" status: 200 len: 1307 microversion: 2.1 time: 0.396903 Oct 27 03:26:23.321970 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 815/1658] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:26:22 2022] GET /compute/v2.1/servers/2be00171-65ea-411a-b2d8-86b4e42d5de9 => generated 1307 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:26:23.327588 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0810e393-72ec-40a8-b4d3-3c54d2f75cc8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:23.328415 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0810e393-72ec-40a8-b4d3-3c54d2f75cc8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: 543fdf60-10ec-4a25-a9d0-30c386efb104] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:23.333321 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:26:23.345597 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0810e393-72ec-40a8-b4d3-3c54d2f75cc8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:23.346389 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0810e393-72ec-40a8-b4d3-3c54d2f75cc8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:23.347598 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0810e393-72ec-40a8-b4d3-3c54d2f75cc8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:23.350945 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0810e393-72ec-40a8-b4d3-3c54d2f75cc8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:23.351636 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0810e393-72ec-40a8-b4d3-3c54d2f75cc8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:23.355316 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0810e393-72ec-40a8-b4d3-3c54d2f75cc8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:23.832627 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0810e393-72ec-40a8-b4d3-3c54d2f75cc8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:23.841790 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0810e393-72ec-40a8-b4d3-3c54d2f75cc8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104" status: 200 len: 1718 microversion: 2.1 time: 0.518352 Oct 27 03:26:23.845652 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 816/1659] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:26:23 2022] GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104 => generated 1718 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:26:24.350619 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3c4b9154-9a5d-43c1-b4f3-731e121dcf65 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:24.352003 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3c4b9154-9a5d-43c1-b4f3-731e121dcf65 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 2be00171-65ea-411a-b2d8-86b4e42d5de9] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:24.362495 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3c4b9154-9a5d-43c1-b4f3-731e121dcf65 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:24.363181 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3c4b9154-9a5d-43c1-b4f3-731e121dcf65 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:24.363830 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3c4b9154-9a5d-43c1-b4f3-731e121dcf65 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:24.365019 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3c4b9154-9a5d-43c1-b4f3-731e121dcf65 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:24.368649 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3c4b9154-9a5d-43c1-b4f3-731e121dcf65 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:24.369463 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3c4b9154-9a5d-43c1-b4f3-731e121dcf65 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:24.723975 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f1c6a4f2-f04f-42d3-be98-73c8f23369a4 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f/action" status: 202 len: 0 microversion: 2.25 time: 3.712432 Oct 27 03:26:24.724601 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 844/1660] 10.222.0.20 () {62 vars in 1319 bytes} [Thu Oct 27 03:26:21 2022] POST /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f/action => generated 0 bytes in 3714 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:26:24.734561 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0e441c8b-162a-4bd2-871e-c6db5accda65 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:24.735615 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0e441c8b-162a-4bd2-871e-c6db5accda65 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:24.753750 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0e441c8b-162a-4bd2-871e-c6db5accda65 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:24.756922 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0e441c8b-162a-4bd2-871e-c6db5accda65 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:24.760980 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0e441c8b-162a-4bd2-871e-c6db5accda65 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:24.761483 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0e441c8b-162a-4bd2-871e-c6db5accda65 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:24.762048 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0e441c8b-162a-4bd2-871e-c6db5accda65 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:24.762497 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0e441c8b-162a-4bd2-871e-c6db5accda65 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:24.775948 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3c4b9154-9a5d-43c1-b4f3-731e121dcf65 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:24.801636 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3c4b9154-9a5d-43c1-b4f3-731e121dcf65 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/2be00171-65ea-411a-b2d8-86b4e42d5de9" status: 200 len: 1307 microversion: 2.1 time: 0.456055 Oct 27 03:26:24.802275 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 817/1661] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:26:24 2022] GET /compute/v2.1/servers/2be00171-65ea-411a-b2d8-86b4e42d5de9 => generated 1307 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:26:24.874099 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-86fd4ebb-7522-499d-a14c-1bcedf6f9b2a tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:24.875485 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-86fd4ebb-7522-499d-a14c-1bcedf6f9b2a tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: 543fdf60-10ec-4a25-a9d0-30c386efb104] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:24.896099 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-86fd4ebb-7522-499d-a14c-1bcedf6f9b2a tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:24.898744 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-86fd4ebb-7522-499d-a14c-1bcedf6f9b2a tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:24.898931 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-86fd4ebb-7522-499d-a14c-1bcedf6f9b2a tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:24.899961 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-86fd4ebb-7522-499d-a14c-1bcedf6f9b2a tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:24.906311 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-86fd4ebb-7522-499d-a14c-1bcedf6f9b2a tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:24.907105 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-86fd4ebb-7522-499d-a14c-1bcedf6f9b2a tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:25.473010 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-86fd4ebb-7522-499d-a14c-1bcedf6f9b2a tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:25.490687 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-86fd4ebb-7522-499d-a14c-1bcedf6f9b2a tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104" status: 200 len: 1718 microversion: 2.1 time: 0.620556 Oct 27 03:26:25.493112 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 818/1662] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:26:24 2022] GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104 => generated 1718 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:26:25.517574 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0e441c8b-162a-4bd2-871e-c6db5accda65 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:25.537355 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0e441c8b-162a-4bd2-871e-c6db5accda65 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:25.539960 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0e441c8b-162a-4bd2-871e-c6db5accda65 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:25.543081 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0e441c8b-162a-4bd2-871e-c6db5accda65 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f" status: 200 len: 1813 microversion: 2.25 time: 0.813885 Oct 27 03:26:25.558058 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 845/1663] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:26:24 2022] GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f => generated 1813 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:26:25.824839 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f93e12c1-8b7b-4475-b945-a6e3bbcd2c96 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:25.825661 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f93e12c1-8b7b-4475-b945-a6e3bbcd2c96 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 2be00171-65ea-411a-b2d8-86b4e42d5de9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:25.847954 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f93e12c1-8b7b-4475-b945-a6e3bbcd2c96 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:25.848654 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f93e12c1-8b7b-4475-b945-a6e3bbcd2c96 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:25.849301 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f93e12c1-8b7b-4475-b945-a6e3bbcd2c96 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:25.850103 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f93e12c1-8b7b-4475-b945-a6e3bbcd2c96 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:25.850676 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f93e12c1-8b7b-4475-b945-a6e3bbcd2c96 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:25.851120 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f93e12c1-8b7b-4475-b945-a6e3bbcd2c96 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:25.925698 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-2ca8ae1f-2692-4df0-ab06-6fc2fda4cdc2 req-34eb0773-174a-46c3-bb3c-e84adfdec90a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2be00171-65ea-411a-b2d8-86b4e42d5de9", "name": "network-vif-plugged", "status": "completed", "tag": "eb76ab11-86f3-4dc6-8ddf-18ea2272de05"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:26:25.942753 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-2ca8ae1f-2692-4df0-ab06-6fc2fda4cdc2 req-34eb0773-174a-46c3-bb3c-e84adfdec90a service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:25.943294 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-2ca8ae1f-2692-4df0-ab06-6fc2fda4cdc2 req-34eb0773-174a-46c3-bb3c-e84adfdec90a service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:25.943744 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-2ca8ae1f-2692-4df0-ab06-6fc2fda4cdc2 req-34eb0773-174a-46c3-bb3c-e84adfdec90a service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:25.978678 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-2ca8ae1f-2692-4df0-ab06-6fc2fda4cdc2 req-34eb0773-174a-46c3-bb3c-e84adfdec90a service nova] Creating event network-vif-plugged:eb76ab11-86f3-4dc6-8ddf-18ea2272de05 for instance 2be00171-65ea-411a-b2d8-86b4e42d5de9 on n-h2-862769-1 Oct 27 03:26:25.994759 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-2ca8ae1f-2692-4df0-ab06-6fc2fda4cdc2 req-34eb0773-174a-46c3-bb3c-e84adfdec90a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.318208 Oct 27 03:26:25.996161 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 819/1664] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:26:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:26:26.119896 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-499d80ba-22a8-4a7d-80a4-dfa31c43c6b3 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:26.129564 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-499d80ba-22a8-4a7d-80a4-dfa31c43c6b3 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: b2ef080f-30ca-4dc5-ba03-9cf1899346a4] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:26.174291 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-499d80ba-22a8-4a7d-80a4-dfa31c43c6b3 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:26.178821 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-499d80ba-22a8-4a7d-80a4-dfa31c43c6b3 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:26.179870 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-499d80ba-22a8-4a7d-80a4-dfa31c43c6b3 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:26.180806 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-499d80ba-22a8-4a7d-80a4-dfa31c43c6b3 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:26.184918 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-499d80ba-22a8-4a7d-80a4-dfa31c43c6b3 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:26.185675 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-499d80ba-22a8-4a7d-80a4-dfa31c43c6b3 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:26.260400 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-499d80ba-22a8-4a7d-80a4-dfa31c43c6b3 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: b2ef080f-30ca-4dc5-ba03-9cf1899346a4] Going to try to terminate instance {{(pid=121001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:26:26.644411 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f93e12c1-8b7b-4475-b945-a6e3bbcd2c96 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:26.658284 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f93e12c1-8b7b-4475-b945-a6e3bbcd2c96 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/2be00171-65ea-411a-b2d8-86b4e42d5de9" status: 200 len: 1307 microversion: 2.1 time: 0.833210 Oct 27 03:26:26.659767 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 846/1665] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:26:25 2022] GET /compute/v2.1/servers/2be00171-65ea-411a-b2d8-86b4e42d5de9 => generated 1307 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:26:26.676816 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0b29be62-03a4-462c-a3d2-dfe15df458f0 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:26.677559 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0b29be62-03a4-462c-a3d2-dfe15df458f0 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: 543fdf60-10ec-4a25-a9d0-30c386efb104] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:26.697179 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0b29be62-03a4-462c-a3d2-dfe15df458f0 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:26.699347 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0b29be62-03a4-462c-a3d2-dfe15df458f0 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:26.699806 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0b29be62-03a4-462c-a3d2-dfe15df458f0 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:26.700555 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0b29be62-03a4-462c-a3d2-dfe15df458f0 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:26.701025 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0b29be62-03a4-462c-a3d2-dfe15df458f0 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:26.701463 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0b29be62-03a4-462c-a3d2-dfe15df458f0 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:26.733462 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-499d80ba-22a8-4a7d-80a4-dfa31c43c6b3 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4" status: 204 len: 0 microversion: 2.1 time: 0.619159 Oct 27 03:26:26.734117 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 820/1666] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:26:26 2022] DELETE /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4 => generated 0 bytes in 627 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:26:26.753552 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-fea96e1c-f997-45dd-9159-f477699f2c78 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:26.755756 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-fea96e1c-f997-45dd-9159-f477699f2c78 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:26.778889 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fea96e1c-f997-45dd-9159-f477699f2c78 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:26.779407 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fea96e1c-f997-45dd-9159-f477699f2c78 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:26.779860 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fea96e1c-f997-45dd-9159-f477699f2c78 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:26.780590 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fea96e1c-f997-45dd-9159-f477699f2c78 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:26.785500 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fea96e1c-f997-45dd-9159-f477699f2c78 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:26.787118 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fea96e1c-f997-45dd-9159-f477699f2c78 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:27.435098 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-fea96e1c-f997-45dd-9159-f477699f2c78 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:27.442575 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:26:27.467103 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-fea96e1c-f997-45dd-9159-f477699f2c78 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:27.468557 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-fea96e1c-f997-45dd-9159-f477699f2c78 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:27.484555 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-fea96e1c-f997-45dd-9159-f477699f2c78 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f" status: 200 len: 1813 microversion: 2.25 time: 0.743716 Oct 27 03:26:27.489059 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 821/1667] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:26:26 2022] GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f => generated 1813 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:26:27.493399 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-aaabc2c7-f5c7-4b65-8f3c-9bdd8ee88f05 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:27.498981 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-aaabc2c7-f5c7-4b65-8f3c-9bdd8ee88f05 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: b2ef080f-30ca-4dc5-ba03-9cf1899346a4] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:27.526396 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aaabc2c7-f5c7-4b65-8f3c-9bdd8ee88f05 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:27.527128 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aaabc2c7-f5c7-4b65-8f3c-9bdd8ee88f05 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:27.527808 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aaabc2c7-f5c7-4b65-8f3c-9bdd8ee88f05 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:27.532258 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aaabc2c7-f5c7-4b65-8f3c-9bdd8ee88f05 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:27.532962 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aaabc2c7-f5c7-4b65-8f3c-9bdd8ee88f05 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:27.533606 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aaabc2c7-f5c7-4b65-8f3c-9bdd8ee88f05 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:28.134635 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0b29be62-03a4-462c-a3d2-dfe15df458f0 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:28.141448 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0b29be62-03a4-462c-a3d2-dfe15df458f0 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104" status: 200 len: 1718 microversion: 2.1 time: 1.477085 Oct 27 03:26:28.141869 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-aaabc2c7-f5c7-4b65-8f3c-9bdd8ee88f05 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:28.159750 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 847/1668] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:26:26 2022] GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104 => generated 1718 bytes in 1496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:26:28.163422 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-aaabc2c7-f5c7-4b65-8f3c-9bdd8ee88f05 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4" status: 200 len: 1469 microversion: 2.1 time: 0.674114 Oct 27 03:26:28.164086 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 822/1669] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:26:27 2022] GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4 => generated 1469 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:26:28.168545 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1465f4a7-28c8-404c-b373-b0398ffd5609 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:28.168545 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1465f4a7-28c8-404c-b373-b0398ffd5609 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 2be00171-65ea-411a-b2d8-86b4e42d5de9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:28.186074 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1465f4a7-28c8-404c-b373-b0398ffd5609 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:28.186975 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1465f4a7-28c8-404c-b373-b0398ffd5609 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:28.187768 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1465f4a7-28c8-404c-b373-b0398ffd5609 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:28.188889 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1465f4a7-28c8-404c-b373-b0398ffd5609 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:28.189811 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1465f4a7-28c8-404c-b373-b0398ffd5609 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:28.190522 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1465f4a7-28c8-404c-b373-b0398ffd5609 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:28.266692 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a724b62e-b941-44b6-8d4c-03bd3ec1d8e0 tempest-FloatingIPsNegativeTestJSON-1137338783 tempest-FloatingIPsNegativeTestJSON-1137338783-project] Calling method '.version_select at 0x7f7dded2adc0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:28.432004 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a724b62e-b941-44b6-8d4c-03bd3ec1d8e0 tempest-FloatingIPsNegativeTestJSON-1137338783 tempest-FloatingIPsNegativeTestJSON-1137338783-project] 10.222.0.20 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.265206 Oct 27 03:26:28.435349 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 823/1670] 10.222.0.20 () {58 vars in 1149 bytes} [Thu Oct 27 03:26:28 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 03:26:28.457964 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1a530b95-8ae5-497c-91a9-ef68f130ace0 tempest-FloatingIPsNegativeTestJSON-1137338783 tempest-FloatingIPsNegativeTestJSON-1137338783-project] Action: 'create', calling method: .version_select at 0x7f7dded9b670>, body: {"pool": "non_exist_pool"} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:26:28.538124 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1465f4a7-28c8-404c-b373-b0398ffd5609 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:28.554634 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1465f4a7-28c8-404c-b373-b0398ffd5609 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/2be00171-65ea-411a-b2d8-86b4e42d5de9" status: 200 len: 1486 microversion: 2.1 time: 0.393346 Oct 27 03:26:28.575052 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 848/1671] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:26:28 2022] GET /compute/v2.1/servers/2be00171-65ea-411a-b2d8-86b4e42d5de9 => generated 1486 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:26:28.668823 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-22606f57-c014-4e7b-9518-e58f9551e434 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:28.668823 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-22606f57-c014-4e7b-9518-e58f9551e434 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:28.668823 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-22606f57-c014-4e7b-9518-e58f9551e434 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:28.668823 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-22606f57-c014-4e7b-9518-e58f9551e434 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:28.672395 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-22606f57-c014-4e7b-9518-e58f9551e434 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:28.672395 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-22606f57-c014-4e7b-9518-e58f9551e434 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:28.672395 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-22606f57-c014-4e7b-9518-e58f9551e434 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:28.672395 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-22606f57-c014-4e7b-9518-e58f9551e434 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:28.673091 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-1a530b95-8ae5-497c-91a9-ef68f130ace0 tempest-FloatingIPsNegativeTestJSON-1137338783 tempest-FloatingIPsNegativeTestJSON-1137338783-project] HTTP exception thrown: Floating IP pool not found. Oct 27 03:26:28.673284 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1a530b95-8ae5-497c-91a9-ef68f130ace0 tempest-FloatingIPsNegativeTestJSON-1137338783 tempest-FloatingIPsNegativeTestJSON-1137338783-project] Request method failure captured: Oct 27 03:26:28.673284 n-d-862769-1 devstack@n-api.service[121001]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Oct 27 03:26:28.673284 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:26:28.673284 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:26:28.673284 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:26:28.673284 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 26 Oct 27 03:26:28.673284 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:26:28.673284 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:26:28.673284 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:26:28.673284 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:26:28.673284 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfpkHXiIWNVwFxR_7JydffD4rAirmMZVEZ1YFJWbygl2O6f7dV_kPbgZ_VQYOk6x9Q6nab3vsh6OhyoAxqSpRL8EnxRgulRwtDYub6Kcs0ZDKFCZ0DNnt1DX4C_T4ElcrKajy1-xkXQaDS6SGPFf9x3pvHBCL3JTJrLLd9XhmMmW_wY Oct 27 03:26:28.673284 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:26:28.673284 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:26:28.673284 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:26:28.673284 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:26:28.673284 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:26:28.673284 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:26:28.673284 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: a02bbe0ff0c54ac5bc82af370b6f8ea8 Oct 27 03:26:28.673284 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1137338783 Oct 27 03:26:28.673284 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:26:28.673284 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:26:28.678900 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a02bbe0ff0c54ac5bc82af370b6f8ea8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a02bbe0ff0c54ac5bc82af370b6f8ea8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a02bbe0ff0c54ac5bc82af370b6f8ea8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a02bbe0ff0c54ac5bc82af370b6f8ea8"}]}] Oct 27 03:26:28.678900 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1137338783 Oct 27 03:26:28.678900 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: a02bbe0ff0c54ac5bc82af370b6f8ea8 Oct 27 03:26:28.678900 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1137338783 Oct 27 03:26:28.678900 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-FloatingIPsNegativeTestJSON-1137338783-project Oct 27 03:26:28.678900 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:26:28.678900 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:26:28.678900 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 24b378191855485d91a08b567f6d6776 Oct 27 03:26:28.678900 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1137338783-project Oct 27 03:26:28.678900 n-d-862769-1 devstack@n-api.service[121001]: Oct 27 03:26:28.678900 n-d-862769-1 devstack@n-api.service[121001]: {"pool": "non_exist_pool"} Oct 27 03:26:28.678900 n-d-862769-1 devstack@n-api.service[121001]: method: Oct 27 03:26:28.678900 n-d-862769-1 devstack@n-api.service[121001]: exception: Floating IP pool not found. Oct 27 03:26:28.678900 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'body': {'pool': 'non_exist_pool'}} Oct 27 03:26:28.678900 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:26:28.681464 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:26:28.681464 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Oct 27 03:26:28.681464 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Oct 27 03:26:28.681464 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Oct 27 03:26:28.681464 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Oct 27 03:26:28.681464 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Oct 27 03:26:28.681464 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Oct 27 03:26:28.681464 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Oct 27 03:26:28.681464 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:26:28.681464 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:26:28.681464 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:26:28.681464 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:26:28.681464 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:26:28.681464 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:26:28.681464 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:26:28.681464 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:26:28.681464 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:26:28.681464 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:26:28.681464 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:26:28.681464 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:26:28.684663 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Oct 27 03:26:28.684663 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:26:28.684663 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Oct 27 03:26:28.684663 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:26:28.684663 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:26:28.684663 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:26:28.684663 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:26:28.684663 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:26:28.684663 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:26:28.684663 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:26:28.684663 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:26:28.684663 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Oct 27 03:26:28.684663 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:26:28.684663 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1a530b95-8ae5-497c-91a9-ef68f130ace0 tempest-FloatingIPsNegativeTestJSON-1137338783 tempest-FloatingIPsNegativeTestJSON-1137338783-project] Returning 404 to user: Floating IP pool not found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:26:28.684663 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1a530b95-8ae5-497c-91a9-ef68f130ace0 tempest-FloatingIPsNegativeTestJSON-1137338783 tempest-FloatingIPsNegativeTestJSON-1137338783-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.232611 Oct 27 03:26:28.687961 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 824/1672] 10.222.0.20 () {60 vars in 1170 bytes} [Thu Oct 27 03:26:28 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 236 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 03:26:28.704123 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-58cbbfa6-5933-411a-a2b4-a8931d794fe2 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:26:28.723036 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-58cbbfa6-5933-411a-a2b4-a8931d794fe2 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 2be00171-65ea-411a-b2d8-86b4e42d5de9] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:28.766117 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-58cbbfa6-5933-411a-a2b4-a8931d794fe2 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:28.766692 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-58cbbfa6-5933-411a-a2b4-a8931d794fe2 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:28.767177 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-58cbbfa6-5933-411a-a2b4-a8931d794fe2 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:28.775243 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-58cbbfa6-5933-411a-a2b4-a8931d794fe2 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:28.776389 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-58cbbfa6-5933-411a-a2b4-a8931d794fe2 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:28.780464 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-58cbbfa6-5933-411a-a2b4-a8931d794fe2 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:28.875294 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-58cbbfa6-5933-411a-a2b4-a8931d794fe2 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lazy-loading 'flavor' on Instance uuid 2be00171-65ea-411a-b2d8-86b4e42d5de9 {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:26:29.301569 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-58cbbfa6-5933-411a-a2b4-a8931d794fe2 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "POST /compute/v2.1/servers/2be00171-65ea-411a-b2d8-86b4e42d5de9/action" status: 202 len: 0 microversion: 2.1 time: 0.619478 Oct 27 03:26:29.303535 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 825/1673] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:26:28 2022] POST /compute/v2.1/servers/2be00171-65ea-411a-b2d8-86b4e42d5de9/action => generated 0 bytes in 623 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:26:29.318904 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9eacc412-8ffc-444d-8b05-07fd6810aabb tempest-FloatingIPsNegativeTestJSON-1137338783 tempest-FloatingIPsNegativeTestJSON-1137338783-project] Calling method '.version_select at 0x7f7dded2a430>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:29.511974 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-22606f57-c014-4e7b-9518-e58f9551e434 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:29.538235 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-22606f57-c014-4e7b-9518-e58f9551e434 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:29.544387 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-22606f57-c014-4e7b-9518-e58f9551e434 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:29.549351 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-22606f57-c014-4e7b-9518-e58f9551e434 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f" status: 200 len: 1813 microversion: 2.25 time: 0.975438 Oct 27 03:26:29.556427 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 849/1674] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:26:28 2022] GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f => generated 1813 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:26:29.579184 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-cc570592-6e08-4aa1-bfdf-388c1a533fad tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:29.579833 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-cc570592-6e08-4aa1-bfdf-388c1a533fad tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: 543fdf60-10ec-4a25-a9d0-30c386efb104] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:29.606735 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cc570592-6e08-4aa1-bfdf-388c1a533fad tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:29.607265 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cc570592-6e08-4aa1-bfdf-388c1a533fad tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:29.607915 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cc570592-6e08-4aa1-bfdf-388c1a533fad tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:29.608935 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cc570592-6e08-4aa1-bfdf-388c1a533fad tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:29.616665 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cc570592-6e08-4aa1-bfdf-388c1a533fad tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:29.620826 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cc570592-6e08-4aa1-bfdf-388c1a533fad tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:29.791344 n-d-862769-1 devstack@n-api.service[121001]: DEBUG neutronclient.v2_0.client [None req-9eacc412-8ffc-444d-8b05-07fd6810aabb tempest-FloatingIPsNegativeTestJSON-1137338783 tempest-FloatingIPsNegativeTestJSON-1137338783-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP d622c606-7d40-46d7-92e6-1e4c851d1a49 could not be found", "detail": ""}} {{(pid=121001) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 03:26:29.797686 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-9eacc412-8ffc-444d-8b05-07fd6810aabb tempest-FloatingIPsNegativeTestJSON-1137338783 tempest-FloatingIPsNegativeTestJSON-1137338783-project] HTTP exception thrown: Floating IP not found for ID d622c606-7d40-46d7-92e6-1e4c851d1a49 Oct 27 03:26:29.806685 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9eacc412-8ffc-444d-8b05-07fd6810aabb tempest-FloatingIPsNegativeTestJSON-1137338783 tempest-FloatingIPsNegativeTestJSON-1137338783-project] Request method failure captured: Oct 27 03:26:29.806685 n-d-862769-1 devstack@n-api.service[121001]: request: DELETE /compute/v2.1/os-floating-ips/d622c606-7d40-46d7-92e6-1e4c851d1a49 HTTP/1.1 Oct 27 03:26:29.806685 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:26:29.806685 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:26:29.806685 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:26:29.806685 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:26:29.806685 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:26:29.806685 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:26:29.806685 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:26:29.806685 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:26:29.806685 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfpkHXiIWNVwFxR_7JydffD4rAirmMZVEZ1YFJWbygl2O6f7dV_kPbgZ_VQYOk6x9Q6nab3vsh6OhyoAxqSpRL8EnxRgulRwtDYub6Kcs0ZDKFCZ0DNnt1DX4C_T4ElcrKajy1-xkXQaDS6SGPFf9x3pvHBCL3JTJrLLd9XhmMmW_wY Oct 27 03:26:29.806685 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:26:29.806685 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:26:29.806685 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:26:29.806685 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:26:29.806685 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:26:29.806685 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:26:29.806685 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: a02bbe0ff0c54ac5bc82af370b6f8ea8 Oct 27 03:26:29.806685 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1137338783 Oct 27 03:26:29.806685 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:26:29.806685 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:26:29.808365 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a02bbe0ff0c54ac5bc82af370b6f8ea8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a02bbe0ff0c54ac5bc82af370b6f8ea8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a02bbe0ff0c54ac5bc82af370b6f8ea8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a02bbe0ff0c54ac5bc82af370b6f8ea8"}]}] Oct 27 03:26:29.808365 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1137338783 Oct 27 03:26:29.808365 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: a02bbe0ff0c54ac5bc82af370b6f8ea8 Oct 27 03:26:29.808365 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1137338783 Oct 27 03:26:29.808365 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-FloatingIPsNegativeTestJSON-1137338783-project Oct 27 03:26:29.808365 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:26:29.808365 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:26:29.808365 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 24b378191855485d91a08b567f6d6776 Oct 27 03:26:29.808365 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1137338783-project Oct 27 03:26:29.808365 n-d-862769-1 devstack@n-api.service[121001]: method: Oct 27 03:26:29.808365 n-d-862769-1 devstack@n-api.service[121001]: exception: Floating IP not found for ID d622c606-7d40-46d7-92e6-1e4c851d1a49 Oct 27 03:26:29.808365 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': 'd622c606-7d40-46d7-92e6-1e4c851d1a49'} Oct 27 03:26:29.808365 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:26:29.809230 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:26:29.809230 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 27 03:26:29.809230 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 27 03:26:29.809230 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:26:29.809230 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:26:29.809230 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 27 03:26:29.809230 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 27 03:26:29.809230 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:26:29.809230 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:26:29.809230 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 27 03:26:29.809230 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 27 03:26:29.809230 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:26:29.809230 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:26:29.809230 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 03:26:29.809230 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 03:26:29.809230 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:26:29.809230 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:26:29.809230 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 03:26:29.809230 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 03:26:29.810451 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:26:29.810451 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:26:29.810451 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 03:26:29.810451 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 03:26:29.810451 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 03:26:29.810451 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 03:26:29.810451 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP d622c606-7d40-46d7-92e6-1e4c851d1a49 could not be found Oct 27 03:26:29.810451 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-192e224a-527d-4e55-9163-d56182358ac8'] Oct 27 03:26:29.810451 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:26:29.810451 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:26:29.810451 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:26:29.810451 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:26:29.810451 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 27 03:26:29.810451 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 27 03:26:29.810451 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 27 03:26:29.810451 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 27 03:26:29.810451 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID d622c606-7d40-46d7-92e6-1e4c851d1a49. Oct 27 03:26:29.810451 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:26:29.810451 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:26:29.810451 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:26:29.811710 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:26:29.811710 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:26:29.811710 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:26:29.811710 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:26:29.811710 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:26:29.811710 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:26:29.811710 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:26:29.811710 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:26:29.811710 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:26:29.811710 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 27 03:26:29.811710 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 27 03:26:29.811710 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID d622c606-7d40-46d7-92e6-1e4c851d1a49 Oct 27 03:26:29.811710 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:26:29.811710 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:26:29.811710 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:26:29.811710 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:26:29.811710 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:26:29.811710 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:26:29.811710 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:26:29.811710 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:26:29.812945 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID d622c606-7d40-46d7-92e6-1e4c851d1a49 Oct 27 03:26:29.812945 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:26:29.817493 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9eacc412-8ffc-444d-8b05-07fd6810aabb tempest-FloatingIPsNegativeTestJSON-1137338783 tempest-FloatingIPsNegativeTestJSON-1137338783-project] Returning 404 to user: Floating IP not found for ID d622c606-7d40-46d7-92e6-1e4c851d1a49 {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:26:29.828020 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9eacc412-8ffc-444d-8b05-07fd6810aabb tempest-FloatingIPsNegativeTestJSON-1137338783 tempest-FloatingIPsNegativeTestJSON-1137338783-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/d622c606-7d40-46d7-92e6-1e4c851d1a49" status: 404 len: 111 microversion: 2.1 time: 0.514441 Oct 27 03:26:29.828020 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 826/1675] 10.222.0.20 () {58 vars in 1263 bytes} [Thu Oct 27 03:26:29 2022] DELETE /compute/v2.1/os-floating-ips/d622c606-7d40-46d7-92e6-1e4c851d1a49 => generated 111 bytes in 518 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:26:29.838734 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1a1b0e59-5159-4233-bd36-1c2838f12acc tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:29.842380 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1a1b0e59-5159-4233-bd36-1c2838f12acc tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: b2ef080f-30ca-4dc5-ba03-9cf1899346a4] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:29.890266 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1a1b0e59-5159-4233-bd36-1c2838f12acc tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:29.890964 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1a1b0e59-5159-4233-bd36-1c2838f12acc tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:29.891633 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1a1b0e59-5159-4233-bd36-1c2838f12acc tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:29.892593 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1a1b0e59-5159-4233-bd36-1c2838f12acc tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:29.893225 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1a1b0e59-5159-4233-bd36-1c2838f12acc tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:29.893919 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1a1b0e59-5159-4233-bd36-1c2838f12acc tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:30.211054 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-cc570592-6e08-4aa1-bfdf-388c1a533fad tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:30.231908 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-cc570592-6e08-4aa1-bfdf-388c1a533fad tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104" status: 200 len: 1718 microversion: 2.1 time: 0.667775 Oct 27 03:26:30.236219 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 850/1676] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:26:29 2022] GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104 => generated 1718 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:26:30.256543 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-287f5c52-ac21-42fc-9fa6-6bbe4665fa49 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:30.259900 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-287f5c52-ac21-42fc-9fa6-6bbe4665fa49 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 2be00171-65ea-411a-b2d8-86b4e42d5de9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:30.292503 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-287f5c52-ac21-42fc-9fa6-6bbe4665fa49 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:30.293968 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-287f5c52-ac21-42fc-9fa6-6bbe4665fa49 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:30.295350 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-287f5c52-ac21-42fc-9fa6-6bbe4665fa49 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:30.299035 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-287f5c52-ac21-42fc-9fa6-6bbe4665fa49 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:30.300580 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-287f5c52-ac21-42fc-9fa6-6bbe4665fa49 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:30.301825 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-287f5c52-ac21-42fc-9fa6-6bbe4665fa49 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:31.268403 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-287f5c52-ac21-42fc-9fa6-6bbe4665fa49 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:31.290875 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-287f5c52-ac21-42fc-9fa6-6bbe4665fa49 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/2be00171-65ea-411a-b2d8-86b4e42d5de9" status: 200 len: 1477 microversion: 2.1 time: 1.048786 Oct 27 03:26:31.301119 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 851/1677] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:26:30 2022] GET /compute/v2.1/servers/2be00171-65ea-411a-b2d8-86b4e42d5de9 => generated 1477 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:26:31.310214 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1a1b0e59-5159-4233-bd36-1c2838f12acc tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:31.323894 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1a1b0e59-5159-4233-bd36-1c2838f12acc tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4" status: 200 len: 1469 microversion: 2.1 time: 1.498521 Oct 27 03:26:31.326715 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 827/1678] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:26:29 2022] GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4 => generated 1469 bytes in 1503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:26:31.338382 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-38992aa4-8322-4911-942d-45e20e487e37 req-b94b4c5f-9254-425f-ac22-df75df352f6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "543fdf60-10ec-4a25-a9d0-30c386efb104", "name": "network-vif-unplugged", "status": "completed", "tag": "d7e171e9-cc70-4509-97bd-e3890c3c8411"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:26:31.347246 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-93793b5f-2600-42cc-b429-b936b7047ced tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "30da14c6-516c-4117-b5cc-e040a8ad9e13"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:26:31.350635 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-93793b5f-2600-42cc-b429-b936b7047ced tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] [instance: 1d9172bd-aa20-4f49-87fa-64300cf861be] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:31.359950 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-93793b5f-2600-42cc-b429-b936b7047ced tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:31.360121 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-38992aa4-8322-4911-942d-45e20e487e37 req-b94b4c5f-9254-425f-ac22-df75df352f6f service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:31.361780 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-38992aa4-8322-4911-942d-45e20e487e37 req-b94b4c5f-9254-425f-ac22-df75df352f6f service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:31.362322 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-38992aa4-8322-4911-942d-45e20e487e37 req-b94b4c5f-9254-425f-ac22-df75df352f6f service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:31.362841 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-93793b5f-2600-42cc-b429-b936b7047ced tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:31.367834 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-93793b5f-2600-42cc-b429-b936b7047ced tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:31.367834 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-93793b5f-2600-42cc-b429-b936b7047ced tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:31.367834 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-93793b5f-2600-42cc-b429-b936b7047ced tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:31.367834 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-93793b5f-2600-42cc-b429-b936b7047ced tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:31.401200 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-38992aa4-8322-4911-942d-45e20e487e37 req-b94b4c5f-9254-425f-ac22-df75df352f6f service nova] Creating event network-vif-unplugged:d7e171e9-cc70-4509-97bd-e3890c3c8411 for instance 543fdf60-10ec-4a25-a9d0-30c386efb104 on n-h2-862769-1 Oct 27 03:26:31.408856 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:26:31.416351 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-38992aa4-8322-4911-942d-45e20e487e37 req-b94b4c5f-9254-425f-ac22-df75df352f6f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.088098 Oct 27 03:26:31.421164 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 828/1679] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:26:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:26:31.436573 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d0394abf-9b13-4577-8d2c-72732d3dd680 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:31.437585 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d0394abf-9b13-4577-8d2c-72732d3dd680 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:31.452569 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d0394abf-9b13-4577-8d2c-72732d3dd680 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:31.453857 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d0394abf-9b13-4577-8d2c-72732d3dd680 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:31.455570 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d0394abf-9b13-4577-8d2c-72732d3dd680 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:31.458048 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d0394abf-9b13-4577-8d2c-72732d3dd680 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:31.459529 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d0394abf-9b13-4577-8d2c-72732d3dd680 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:31.461310 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d0394abf-9b13-4577-8d2c-72732d3dd680 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:32.017487 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d0394abf-9b13-4577-8d2c-72732d3dd680 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:32.040253 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d0394abf-9b13-4577-8d2c-72732d3dd680 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:32.045175 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d0394abf-9b13-4577-8d2c-72732d3dd680 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:32.053014 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d0394abf-9b13-4577-8d2c-72732d3dd680 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f" status: 200 len: 1813 microversion: 2.25 time: 0.626609 Oct 27 03:26:32.055401 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 829/1680] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:26:31 2022] GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f => generated 1813 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:26:32.071043 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-00085a21-5cb9-400c-a36d-0406632cd529 req-2b373612-faf8-43e2-8c42-504b6f2a0a20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2ef080f-30ca-4dc5-ba03-9cf1899346a4", "name": "network-vif-deleted", "tag": "7bd75d20-f08a-4aa0-b246-a0898c1313cc"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:26:32.102525 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-00085a21-5cb9-400c-a36d-0406632cd529 req-2b373612-faf8-43e2-8c42-504b6f2a0a20 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:32.103543 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-00085a21-5cb9-400c-a36d-0406632cd529 req-2b373612-faf8-43e2-8c42-504b6f2a0a20 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:32.104361 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-00085a21-5cb9-400c-a36d-0406632cd529 req-2b373612-faf8-43e2-8c42-504b6f2a0a20 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:32.146587 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-00085a21-5cb9-400c-a36d-0406632cd529 req-2b373612-faf8-43e2-8c42-504b6f2a0a20 service nova] Creating event network-vif-deleted:7bd75d20-f08a-4aa0-b246-a0898c1313cc for instance b2ef080f-30ca-4dc5-ba03-9cf1899346a4 on n-h1-862769-1 Oct 27 03:26:32.157921 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-00085a21-5cb9-400c-a36d-0406632cd529 req-2b373612-faf8-43e2-8c42-504b6f2a0a20 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101068 Oct 27 03:26:32.160678 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 830/1681] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:26:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:26:32.178290 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-fbe873a3-7666-4a4c-9879-6ef49db8e15c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:32.204443 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-fbe873a3-7666-4a4c-9879-6ef49db8e15c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: 543fdf60-10ec-4a25-a9d0-30c386efb104] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:32.220324 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fbe873a3-7666-4a4c-9879-6ef49db8e15c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:32.224558 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fbe873a3-7666-4a4c-9879-6ef49db8e15c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:32.225220 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fbe873a3-7666-4a4c-9879-6ef49db8e15c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:32.226192 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fbe873a3-7666-4a4c-9879-6ef49db8e15c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:32.229968 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fbe873a3-7666-4a4c-9879-6ef49db8e15c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:32.234770 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fbe873a3-7666-4a4c-9879-6ef49db8e15c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:32.372895 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-93793b5f-2600-42cc-b429-b936b7047ced tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] 10.222.0.20 "POST /compute/v2.1/servers/1d9172bd-aa20-4f49-87fa-64300cf861be/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.068557 Oct 27 03:26:32.373520 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 852/1682] 10.222.0.20 () {60 vars in 1323 bytes} [Thu Oct 27 03:26:31 2022] POST /compute/v2.1/servers/1d9172bd-aa20-4f49-87fa-64300cf861be/os-volume_attachments => generated 194 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:26:32.381714 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-be07be72-b7f5-409f-b46e-6bf01f43e00d tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-942276827"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:26:32.407003 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-be07be72-b7f5-409f-b46e-6bf01f43e00d tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 2be00171-65ea-411a-b2d8-86b4e42d5de9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:32.460315 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-be07be72-b7f5-409f-b46e-6bf01f43e00d tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:32.462830 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-be07be72-b7f5-409f-b46e-6bf01f43e00d tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:32.469085 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-be07be72-b7f5-409f-b46e-6bf01f43e00d tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:32.472216 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-be07be72-b7f5-409f-b46e-6bf01f43e00d tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:32.480194 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-be07be72-b7f5-409f-b46e-6bf01f43e00d tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:32.482488 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-be07be72-b7f5-409f-b46e-6bf01f43e00d tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:33.044031 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-fbe873a3-7666-4a4c-9879-6ef49db8e15c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:33.059813 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-fbe873a3-7666-4a4c-9879-6ef49db8e15c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104" status: 200 len: 1718 microversion: 2.1 time: 0.891237 Oct 27 03:26:33.060774 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 831/1683] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:26:32 2022] GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104 => generated 1718 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:26:33.099398 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-46b1f202-ea75-4e02-8d3c-e69b5300ae52 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:33.100335 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-46b1f202-ea75-4e02-8d3c-e69b5300ae52 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: b2ef080f-30ca-4dc5-ba03-9cf1899346a4] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:33.128576 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-46b1f202-ea75-4e02-8d3c-e69b5300ae52 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:33.128576 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-46b1f202-ea75-4e02-8d3c-e69b5300ae52 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:33.128576 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-46b1f202-ea75-4e02-8d3c-e69b5300ae52 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:33.128576 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-46b1f202-ea75-4e02-8d3c-e69b5300ae52 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:33.129077 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-46b1f202-ea75-4e02-8d3c-e69b5300ae52 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:33.129077 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-46b1f202-ea75-4e02-8d3c-e69b5300ae52 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:33.210851 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-46b1f202-ea75-4e02-8d3c-e69b5300ae52 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] HTTP exception thrown: Instance b2ef080f-30ca-4dc5-ba03-9cf1899346a4 could not be found. Oct 27 03:26:33.217658 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-46b1f202-ea75-4e02-8d3c-e69b5300ae52 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Request method failure captured: Oct 27 03:26:33.217658 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4 HTTP/1.1 Oct 27 03:26:33.217658 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:26:33.217658 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:26:33.217658 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:26:33.217658 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:26:33.217658 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:26:33.217658 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:26:33.217658 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:26:33.217658 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:26:33.217658 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfkpsOdThwfxJ33-tvm9iyGYYH_ZEpxzKnwGDpraQk76sUDZ1GapHGOV16AB5VdWdfnwUaPYp4vgB7g5YsapertEYrEV0--d0qxDYMTapJeYZLFonTVKFj7aGGk3qWLH_Mm5fIfjgxAHHREZrHHg-wylU5NsG7duQZp_6q3wnJSCyhQ Oct 27 03:26:33.217658 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:26:33.217658 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:26:33.217658 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:26:33.217658 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:26:33.217658 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:26:33.217658 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:26:33.217658 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 48e708fb3bdd45bc976db7bd92af09c8 Oct 27 03:26:33.217658 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-MigrationsAdminTest-1680714986 Oct 27 03:26:33.217658 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:26:33.217658 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:26:33.219394 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/48e708fb3bdd45bc976db7bd92af09c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/48e708fb3bdd45bc976db7bd92af09c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/48e708fb3bdd45bc976db7bd92af09c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_48e708fb3bdd45bc976db7bd92af09c8"}]}] Oct 27 03:26:33.219394 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-MigrationsAdminTest-1680714986 Oct 27 03:26:33.219394 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 48e708fb3bdd45bc976db7bd92af09c8 Oct 27 03:26:33.219394 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-MigrationsAdminTest-1680714986 Oct 27 03:26:33.219394 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-MigrationsAdminTest-1680714986-project Oct 27 03:26:33.219394 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:26:33.219394 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:26:33.219394 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: d3f1177e2cbd4ba6b659f8a714be86ac Oct 27 03:26:33.219394 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-MigrationsAdminTest-1680714986-project Oct 27 03:26:33.219394 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:26:33.219394 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance b2ef080f-30ca-4dc5-ba03-9cf1899346a4 could not be found. Oct 27 03:26:33.219394 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': 'b2ef080f-30ca-4dc5-ba03-9cf1899346a4'} Oct 27 03:26:33.220311 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:26:33.220311 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:26:33.220311 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:26:33.220311 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:26:33.220311 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:26:33.220311 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:26:33.220311 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:26:33.220311 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:26:33.220311 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:26:33.220311 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:26:33.220311 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2ef080f-30ca-4dc5-ba03-9cf1899346a4 could not be found. Oct 27 03:26:33.220311 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:26:33.220311 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:26:33.220311 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:26:33.220311 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:26:33.220311 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:26:33.220311 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:26:33.220311 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:26:33.220311 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:26:33.220311 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:26:33.221708 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:26:33.221708 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:26:33.221708 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:26:33.221708 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:26:33.221708 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:26:33.221708 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:26:33.221708 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:26:33.221708 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2ef080f-30ca-4dc5-ba03-9cf1899346a4 could not be found. Oct 27 03:26:33.221708 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:26:33.221708 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:26:33.221708 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:26:33.221708 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:26:33.221708 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:26:33.221708 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:26:33.221708 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:26:33.221708 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:26:33.221708 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2ef080f-30ca-4dc5-ba03-9cf1899346a4 could not be found. Oct 27 03:26:33.221708 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:26:33.223928 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-46b1f202-ea75-4e02-8d3c-e69b5300ae52 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Returning 404 to user: Instance b2ef080f-30ca-4dc5-ba03-9cf1899346a4 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:26:33.224968 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-46b1f202-ea75-4e02-8d3c-e69b5300ae52 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4" status: 404 len: 111 microversion: 2.1 time: 0.131393 Oct 27 03:26:33.238001 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 832/1684] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:26:33 2022] GET /compute/v2.1/servers/b2ef080f-30ca-4dc5-ba03-9cf1899346a4 => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:26:33.249243 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0e489f34-550a-45a4-ab8a-d0c79098ebde tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:33.254118 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0e489f34-550a-45a4-ab8a-d0c79098ebde tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:33.266457 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0e489f34-550a-45a4-ab8a-d0c79098ebde tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:33.267111 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0e489f34-550a-45a4-ab8a-d0c79098ebde tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:33.267725 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0e489f34-550a-45a4-ab8a-d0c79098ebde tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:33.268762 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0e489f34-550a-45a4-ab8a-d0c79098ebde tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:33.269338 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0e489f34-550a-45a4-ab8a-d0c79098ebde tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:33.270017 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0e489f34-550a-45a4-ab8a-d0c79098ebde tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:33.427767 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-be07be72-b7f5-409f-b46e-6bf01f43e00d tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "POST /compute/v2.1/servers/2be00171-65ea-411a-b2d8-86b4e42d5de9/action" status: 202 len: 0 microversion: 2.1 time: 1.050202 Oct 27 03:26:33.436192 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 853/1685] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:26:32 2022] POST /compute/v2.1/servers/2be00171-65ea-411a-b2d8-86b4e42d5de9/action => generated 0 bytes in 1059 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 27 03:26:33.449810 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ead2198e-4b6d-47f6-b255-95255502fd18 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:33.463266 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ead2198e-4b6d-47f6-b255-95255502fd18 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 5910c783-6877-4a41-8650-0973a11f3578] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:33.484824 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ead2198e-4b6d-47f6-b255-95255502fd18 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:33.489357 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ead2198e-4b6d-47f6-b255-95255502fd18 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:33.490732 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ead2198e-4b6d-47f6-b255-95255502fd18 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:33.491568 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ead2198e-4b6d-47f6-b255-95255502fd18 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:33.493043 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ead2198e-4b6d-47f6-b255-95255502fd18 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:33.497043 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ead2198e-4b6d-47f6-b255-95255502fd18 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:33.572812 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ead2198e-4b6d-47f6-b255-95255502fd18 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 5910c783-6877-4a41-8650-0973a11f3578] Going to try to terminate instance {{(pid=121000) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:26:33.705440 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0e489f34-550a-45a4-ab8a-d0c79098ebde tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:33.716612 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0e489f34-550a-45a4-ab8a-d0c79098ebde tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:33.725534 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0e489f34-550a-45a4-ab8a-d0c79098ebde tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:33.727200 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0e489f34-550a-45a4-ab8a-d0c79098ebde tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f" status: 200 len: 1813 microversion: 2.25 time: 0.487878 Oct 27 03:26:33.728983 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 833/1686] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:26:33 2022] GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f => generated 1813 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:26:33.750136 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-dc0b2b87-fcbd-4d7a-a018-db9d5196c339 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7ddec28040>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:33.838827 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-dc0b2b87-fcbd-4d7a-a018-db9d5196c339 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/images/83da6741-8184-4eb0-a871-04737ab02803" status: 200 len: 1439 microversion: 2.1 time: 0.108497 Oct 27 03:26:33.850069 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 834/1687] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:26:33 2022] GET /compute/v2.1/images/83da6741-8184-4eb0-a871-04737ab02803 => generated 1439 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:26:33.914594 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-e25afae9-e324-4579-8344-3e90dbf364c8 req-1b95fc8e-0b9b-4d66-8cab-40e01b1dc96b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "543fdf60-10ec-4a25-a9d0-30c386efb104", "tag": "d7e171e9-cc70-4509-97bd-e3890c3c8411"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:26:33.933926 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-e25afae9-e324-4579-8344-3e90dbf364c8 req-1b95fc8e-0b9b-4d66-8cab-40e01b1dc96b service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:33.941870 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-e25afae9-e324-4579-8344-3e90dbf364c8 req-1b95fc8e-0b9b-4d66-8cab-40e01b1dc96b service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:33.942501 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-e25afae9-e324-4579-8344-3e90dbf364c8 req-1b95fc8e-0b9b-4d66-8cab-40e01b1dc96b service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:33.970876 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-e25afae9-e324-4579-8344-3e90dbf364c8 req-1b95fc8e-0b9b-4d66-8cab-40e01b1dc96b service nova] Creating event network-changed:d7e171e9-cc70-4509-97bd-e3890c3c8411 for instance 543fdf60-10ec-4a25-a9d0-30c386efb104 on n-h2-862769-1 Oct 27 03:26:33.979422 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ead2198e-4b6d-47f6-b255-95255502fd18 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578" status: 204 len: 0 microversion: 2.1 time: 0.541328 Oct 27 03:26:33.980722 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 854/1688] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:26:33 2022] DELETE /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:26:33.982813 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-e25afae9-e324-4579-8344-3e90dbf364c8 req-1b95fc8e-0b9b-4d66-8cab-40e01b1dc96b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072882 Oct 27 03:26:33.985864 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 835/1689] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:26:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:26:33.996407 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d4852705-38f1-4440-ae43-27dce4b1be8e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:34.002818 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d4852705-38f1-4440-ae43-27dce4b1be8e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 5910c783-6877-4a41-8650-0973a11f3578] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:34.040117 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d4852705-38f1-4440-ae43-27dce4b1be8e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:34.040874 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d4852705-38f1-4440-ae43-27dce4b1be8e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:34.042965 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d4852705-38f1-4440-ae43-27dce4b1be8e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:34.043911 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d4852705-38f1-4440-ae43-27dce4b1be8e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:34.044464 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d4852705-38f1-4440-ae43-27dce4b1be8e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:34.047018 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d4852705-38f1-4440-ae43-27dce4b1be8e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:34.085844 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-19035b9f-25eb-4020-8a15-d0bb320cbb36 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:34.087951 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-19035b9f-25eb-4020-8a15-d0bb320cbb36 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: 543fdf60-10ec-4a25-a9d0-30c386efb104] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:34.101558 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-19035b9f-25eb-4020-8a15-d0bb320cbb36 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:34.105463 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-19035b9f-25eb-4020-8a15-d0bb320cbb36 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:34.110975 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-19035b9f-25eb-4020-8a15-d0bb320cbb36 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:34.110975 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-19035b9f-25eb-4020-8a15-d0bb320cbb36 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:34.112147 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-19035b9f-25eb-4020-8a15-d0bb320cbb36 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:34.112823 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-19035b9f-25eb-4020-8a15-d0bb320cbb36 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:34.530262 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-19035b9f-25eb-4020-8a15-d0bb320cbb36 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:34.541867 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-19035b9f-25eb-4020-8a15-d0bb320cbb36 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104" status: 200 len: 1718 microversion: 2.1 time: 0.458347 Oct 27 03:26:34.561472 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 836/1690] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:26:34 2022] GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104 => generated 1718 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:26:34.752152 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-fc0829fe-3c61-4510-af8f-5246891ba29a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:34.752788 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-fc0829fe-3c61-4510-af8f-5246891ba29a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:34.767698 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fc0829fe-3c61-4510-af8f-5246891ba29a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:34.768460 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fc0829fe-3c61-4510-af8f-5246891ba29a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:34.769116 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fc0829fe-3c61-4510-af8f-5246891ba29a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:34.773138 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fc0829fe-3c61-4510-af8f-5246891ba29a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:34.773829 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fc0829fe-3c61-4510-af8f-5246891ba29a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:34.774465 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fc0829fe-3c61-4510-af8f-5246891ba29a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:34.933221 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d4852705-38f1-4440-ae43-27dce4b1be8e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:34.945550 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d4852705-38f1-4440-ae43-27dce4b1be8e tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578" status: 200 len: 1469 microversion: 2.1 time: 0.957041 Oct 27 03:26:34.946465 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 855/1691] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:26:33 2022] GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578 => generated 1469 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:26:34.967483 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-cc8abc14-9e45-4ed9-b8cc-4dd20e7826c4 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7ddec55280>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:35.044878 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-cc8abc14-9e45-4ed9-b8cc-4dd20e7826c4 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/images/83da6741-8184-4eb0-a871-04737ab02803" status: 200 len: 1439 microversion: 2.1 time: 0.097019 Oct 27 03:26:35.053418 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 856/1692] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:26:34 2022] GET /compute/v2.1/images/83da6741-8184-4eb0-a871-04737ab02803 => generated 1439 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:26:35.079201 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-fc0829fe-3c61-4510-af8f-5246891ba29a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:35.088353 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-fc0829fe-3c61-4510-af8f-5246891ba29a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:35.099951 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-fc0829fe-3c61-4510-af8f-5246891ba29a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:35.101553 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-fc0829fe-3c61-4510-af8f-5246891ba29a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f" status: 200 len: 1813 microversion: 2.25 time: 0.353570 Oct 27 03:26:35.102331 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 837/1693] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:26:34 2022] GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f => generated 1813 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:26:35.572168 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5e4cc3ae-774f-4b92-8843-f11344ef65d1 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:35.572954 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5e4cc3ae-774f-4b92-8843-f11344ef65d1 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: 543fdf60-10ec-4a25-a9d0-30c386efb104] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:35.590852 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5e4cc3ae-774f-4b92-8843-f11344ef65d1 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:35.591425 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5e4cc3ae-774f-4b92-8843-f11344ef65d1 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:35.593041 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5e4cc3ae-774f-4b92-8843-f11344ef65d1 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:35.594463 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5e4cc3ae-774f-4b92-8843-f11344ef65d1 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:35.596238 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5e4cc3ae-774f-4b92-8843-f11344ef65d1 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:35.598487 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5e4cc3ae-774f-4b92-8843-f11344ef65d1 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:35.969285 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5391ab8a-b6a5-4948-a71b-63d3c8506cd9 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:35.969913 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5391ab8a-b6a5-4948-a71b-63d3c8506cd9 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 5910c783-6877-4a41-8650-0973a11f3578] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:35.980196 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5391ab8a-b6a5-4948-a71b-63d3c8506cd9 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:35.984662 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5391ab8a-b6a5-4948-a71b-63d3c8506cd9 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:35.985323 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5391ab8a-b6a5-4948-a71b-63d3c8506cd9 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:35.987864 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5391ab8a-b6a5-4948-a71b-63d3c8506cd9 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:35.990326 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5391ab8a-b6a5-4948-a71b-63d3c8506cd9 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:35.996374 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5391ab8a-b6a5-4948-a71b-63d3c8506cd9 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:36.457188 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5e4cc3ae-774f-4b92-8843-f11344ef65d1 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:36.469411 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5e4cc3ae-774f-4b92-8843-f11344ef65d1 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104" status: 200 len: 1718 microversion: 2.1 time: 0.902720 Oct 27 03:26:36.470016 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 857/1694] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:26:35 2022] GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104 => generated 1718 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:26:36.482230 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f46ca8ae-51d8-4f8f-86be-50f949f8a3cc tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7ddec88940>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:36.562879 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5391ab8a-b6a5-4948-a71b-63d3c8506cd9 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:36.571550 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f46ca8ae-51d8-4f8f-86be-50f949f8a3cc tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/images/83da6741-8184-4eb0-a871-04737ab02803" status: 200 len: 1439 microversion: 2.1 time: 0.097420 Oct 27 03:26:36.572916 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 858/1695] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:26:36 2022] GET /compute/v2.1/images/83da6741-8184-4eb0-a871-04737ab02803 => generated 1439 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:26:36.580562 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5391ab8a-b6a5-4948-a71b-63d3c8506cd9 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578" status: 200 len: 1469 microversion: 2.1 time: 0.612334 Oct 27 03:26:36.580562 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 838/1696] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:26:35 2022] GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578 => generated 1469 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:26:36.583869 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-fe0886c9-f0c6-4e40-9304-1fc5c26a67bb tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:36.585925 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-fe0886c9-f0c6-4e40-9304-1fc5c26a67bb tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:36.605043 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fe0886c9-f0c6-4e40-9304-1fc5c26a67bb tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:36.606209 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fe0886c9-f0c6-4e40-9304-1fc5c26a67bb tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:36.606924 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fe0886c9-f0c6-4e40-9304-1fc5c26a67bb tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:36.607827 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fe0886c9-f0c6-4e40-9304-1fc5c26a67bb tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:36.608597 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fe0886c9-f0c6-4e40-9304-1fc5c26a67bb tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:36.609407 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fe0886c9-f0c6-4e40-9304-1fc5c26a67bb tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:37.164888 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-870273ee-cf26-4eea-8115-236813df7b62 req-670a5c18-16ee-4f20-ab16-555c9e896cb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5910c783-6877-4a41-8650-0973a11f3578", "name": "network-vif-deleted", "tag": "30830547-1d6a-4cee-9341-539819ef5a04"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:26:37.219379 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-870273ee-cf26-4eea-8115-236813df7b62 req-670a5c18-16ee-4f20-ab16-555c9e896cb1 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:37.222866 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-870273ee-cf26-4eea-8115-236813df7b62 req-670a5c18-16ee-4f20-ab16-555c9e896cb1 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:37.230262 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-870273ee-cf26-4eea-8115-236813df7b62 req-670a5c18-16ee-4f20-ab16-555c9e896cb1 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:37.265584 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-870273ee-cf26-4eea-8115-236813df7b62 req-670a5c18-16ee-4f20-ab16-555c9e896cb1 service nova] Creating event network-vif-deleted:30830547-1d6a-4cee-9341-539819ef5a04 for instance 5910c783-6877-4a41-8650-0973a11f3578 on n-h2-862769-1 Oct 27 03:26:37.287020 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-870273ee-cf26-4eea-8115-236813df7b62 req-670a5c18-16ee-4f20-ab16-555c9e896cb1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125801 Oct 27 03:26:37.288195 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 839/1697] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:26:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:26:37.425309 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-fe0886c9-f0c6-4e40-9304-1fc5c26a67bb tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:37.465454 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-fe0886c9-f0c6-4e40-9304-1fc5c26a67bb tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:37.470571 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-fe0886c9-f0c6-4e40-9304-1fc5c26a67bb tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:37.478570 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-fe0886c9-f0c6-4e40-9304-1fc5c26a67bb tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f" status: 200 len: 1813 microversion: 2.25 time: 0.896996 Oct 27 03:26:37.479450 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 859/1698] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:26:36 2022] GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f => generated 1813 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:26:37.496795 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0da46e2f-2cda-46f5-856e-8d03b90b075b tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:37.497569 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0da46e2f-2cda-46f5-856e-8d03b90b075b tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: 543fdf60-10ec-4a25-a9d0-30c386efb104] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:37.515576 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0da46e2f-2cda-46f5-856e-8d03b90b075b tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:37.516089 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0da46e2f-2cda-46f5-856e-8d03b90b075b tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:37.516550 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0da46e2f-2cda-46f5-856e-8d03b90b075b tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:37.518851 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0da46e2f-2cda-46f5-856e-8d03b90b075b tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:37.520109 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0da46e2f-2cda-46f5-856e-8d03b90b075b tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:37.522487 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0da46e2f-2cda-46f5-856e-8d03b90b075b tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:37.587953 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-100d8e28-aadd-462a-ac62-cb80d8d024ca tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7ddec431f0>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:37.695229 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-100d8e28-aadd-462a-ac62-cb80d8d024ca tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/images/83da6741-8184-4eb0-a871-04737ab02803" status: 200 len: 1439 microversion: 2.1 time: 0.111221 Oct 27 03:26:37.697644 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 860/1699] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:26:37 2022] GET /compute/v2.1/images/83da6741-8184-4eb0-a871-04737ab02803 => generated 1439 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:26:37.710499 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ce44ceec-927f-4586-9a2d-d0c2b0b48bd2 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:37.712833 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ce44ceec-927f-4586-9a2d-d0c2b0b48bd2 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 5910c783-6877-4a41-8650-0973a11f3578] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:37.729133 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ce44ceec-927f-4586-9a2d-d0c2b0b48bd2 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:37.729912 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ce44ceec-927f-4586-9a2d-d0c2b0b48bd2 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:37.732131 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ce44ceec-927f-4586-9a2d-d0c2b0b48bd2 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:37.739848 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ce44ceec-927f-4586-9a2d-d0c2b0b48bd2 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:37.739848 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ce44ceec-927f-4586-9a2d-d0c2b0b48bd2 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:37.739848 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ce44ceec-927f-4586-9a2d-d0c2b0b48bd2 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:37.828639 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ce44ceec-927f-4586-9a2d-d0c2b0b48bd2 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:37.829375 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ce44ceec-927f-4586-9a2d-d0c2b0b48bd2 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:37.831708 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ce44ceec-927f-4586-9a2d-d0c2b0b48bd2 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:37.832463 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-ce44ceec-927f-4586-9a2d-d0c2b0b48bd2 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lazy-loading 'fault' on Instance uuid 5910c783-6877-4a41-8650-0973a11f3578 {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:26:37.887370 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0da46e2f-2cda-46f5-856e-8d03b90b075b tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:37.901609 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0da46e2f-2cda-46f5-856e-8d03b90b075b tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104" status: 200 len: 1718 microversion: 2.1 time: 0.408549 Oct 27 03:26:37.903429 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 840/1700] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:26:37 2022] GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104 => generated 1718 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:26:37.934913 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ce44ceec-927f-4586-9a2d-d0c2b0b48bd2 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f1177e2cbd4ba6b659f8a714be86ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e708fb3bdd45bc976db7bd92af09c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:37.969223 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ce44ceec-927f-4586-9a2d-d0c2b0b48bd2 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578" status: 200 len: 1303 microversion: 2.1 time: 0.269309 Oct 27 03:26:37.979213 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 861/1701] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:26:37 2022] GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578 => generated 1303 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:26:38.511390 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-52f74d7d-4020-402f-aa38-87bc0d07fc29 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:38.513018 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-52f74d7d-4020-402f-aa38-87bc0d07fc29 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:38.532194 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-52f74d7d-4020-402f-aa38-87bc0d07fc29 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:38.533254 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-52f74d7d-4020-402f-aa38-87bc0d07fc29 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:38.533921 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-52f74d7d-4020-402f-aa38-87bc0d07fc29 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:38.535462 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-52f74d7d-4020-402f-aa38-87bc0d07fc29 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:38.538535 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-52f74d7d-4020-402f-aa38-87bc0d07fc29 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:38.539211 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-52f74d7d-4020-402f-aa38-87bc0d07fc29 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:38.715484 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c2021c43-117c-489d-af46-ad7227c7a336 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7ddec434c0>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:38.793548 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-52f74d7d-4020-402f-aa38-87bc0d07fc29 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:38.816355 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-52f74d7d-4020-402f-aa38-87bc0d07fc29 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:38.827720 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-52f74d7d-4020-402f-aa38-87bc0d07fc29 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:38.835903 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-52f74d7d-4020-402f-aa38-87bc0d07fc29 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f" status: 200 len: 1813 microversion: 2.25 time: 0.330632 Oct 27 03:26:38.842468 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 841/1702] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:26:38 2022] GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f => generated 1813 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:26:38.849885 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c2021c43-117c-489d-af46-ad7227c7a336 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/images/83da6741-8184-4eb0-a871-04737ab02803" status: 200 len: 1439 microversion: 2.1 time: 0.141660 Oct 27 03:26:38.853363 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 862/1703] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:26:38 2022] GET /compute/v2.1/images/83da6741-8184-4eb0-a871-04737ab02803 => generated 1439 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:26:38.928970 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f29160d9-ef2a-4354-88af-ba7e96d04312 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:38.929599 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f29160d9-ef2a-4354-88af-ba7e96d04312 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: 543fdf60-10ec-4a25-a9d0-30c386efb104] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:38.945951 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f29160d9-ef2a-4354-88af-ba7e96d04312 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:38.951099 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f29160d9-ef2a-4354-88af-ba7e96d04312 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:38.951099 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f29160d9-ef2a-4354-88af-ba7e96d04312 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:38.951099 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f29160d9-ef2a-4354-88af-ba7e96d04312 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:38.951099 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f29160d9-ef2a-4354-88af-ba7e96d04312 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:38.951569 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f29160d9-ef2a-4354-88af-ba7e96d04312 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:39.010888 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4c9132c4-f21e-418b-a17e-70d6f3d7f378 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:39.011409 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4c9132c4-f21e-418b-a17e-70d6f3d7f378 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] [instance: 5910c783-6877-4a41-8650-0973a11f3578] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:39.021233 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4c9132c4-f21e-418b-a17e-70d6f3d7f378 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:39.022972 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4c9132c4-f21e-418b-a17e-70d6f3d7f378 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:39.026365 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4c9132c4-f21e-418b-a17e-70d6f3d7f378 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:39.027503 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4c9132c4-f21e-418b-a17e-70d6f3d7f378 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:39.034330 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4c9132c4-f21e-418b-a17e-70d6f3d7f378 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:39.034330 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4c9132c4-f21e-418b-a17e-70d6f3d7f378 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:39.069555 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-4c9132c4-f21e-418b-a17e-70d6f3d7f378 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] HTTP exception thrown: Instance 5910c783-6877-4a41-8650-0973a11f3578 could not be found. Oct 27 03:26:39.075895 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4c9132c4-f21e-418b-a17e-70d6f3d7f378 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Request method failure captured: Oct 27 03:26:39.075895 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578 HTTP/1.1 Oct 27 03:26:39.075895 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:26:39.075895 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:26:39.075895 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:26:39.075895 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:26:39.075895 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:26:39.075895 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:26:39.075895 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:26:39.075895 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:26:39.075895 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfkpsOdThwfxJ33-tvm9iyGYYH_ZEpxzKnwGDpraQk76sUDZ1GapHGOV16AB5VdWdfnwUaPYp4vgB7g5YsapertEYrEV0--d0qxDYMTapJeYZLFonTVKFj7aGGk3qWLH_Mm5fIfjgxAHHREZrHHg-wylU5NsG7duQZp_6q3wnJSCyhQ Oct 27 03:26:39.075895 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:26:39.075895 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:26:39.075895 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:26:39.075895 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:26:39.075895 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:26:39.075895 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:26:39.075895 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 48e708fb3bdd45bc976db7bd92af09c8 Oct 27 03:26:39.075895 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-MigrationsAdminTest-1680714986 Oct 27 03:26:39.075895 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:26:39.075895 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:26:39.077776 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/48e708fb3bdd45bc976db7bd92af09c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/48e708fb3bdd45bc976db7bd92af09c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/48e708fb3bdd45bc976db7bd92af09c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_48e708fb3bdd45bc976db7bd92af09c8"}]}] Oct 27 03:26:39.077776 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-MigrationsAdminTest-1680714986 Oct 27 03:26:39.077776 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 48e708fb3bdd45bc976db7bd92af09c8 Oct 27 03:26:39.077776 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-MigrationsAdminTest-1680714986 Oct 27 03:26:39.077776 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-MigrationsAdminTest-1680714986-project Oct 27 03:26:39.077776 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:26:39.077776 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:26:39.077776 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: d3f1177e2cbd4ba6b659f8a714be86ac Oct 27 03:26:39.077776 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-MigrationsAdminTest-1680714986-project Oct 27 03:26:39.077776 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:26:39.077776 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 5910c783-6877-4a41-8650-0973a11f3578 could not be found. Oct 27 03:26:39.077776 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '5910c783-6877-4a41-8650-0973a11f3578'} Oct 27 03:26:39.078688 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:26:39.078688 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:26:39.078688 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:26:39.078688 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:26:39.078688 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:26:39.078688 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:26:39.078688 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:26:39.078688 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:26:39.078688 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:26:39.078688 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:26:39.078688 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5910c783-6877-4a41-8650-0973a11f3578 could not be found. Oct 27 03:26:39.078688 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:26:39.078688 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:26:39.078688 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:26:39.078688 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:26:39.078688 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:26:39.078688 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:26:39.078688 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:26:39.078688 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:26:39.078688 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:26:39.080173 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:26:39.080173 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:26:39.080173 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:26:39.080173 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:26:39.080173 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:26:39.080173 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:26:39.080173 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:26:39.080173 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5910c783-6877-4a41-8650-0973a11f3578 could not be found. Oct 27 03:26:39.080173 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:26:39.080173 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:26:39.080173 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:26:39.080173 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:26:39.080173 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:26:39.080173 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:26:39.080173 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:26:39.080173 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:26:39.080173 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5910c783-6877-4a41-8650-0973a11f3578 could not be found. Oct 27 03:26:39.080173 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:26:39.082537 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4c9132c4-f21e-418b-a17e-70d6f3d7f378 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] Returning 404 to user: Instance 5910c783-6877-4a41-8650-0973a11f3578 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:26:39.085579 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4c9132c4-f21e-418b-a17e-70d6f3d7f378 tempest-MigrationsAdminTest-1680714986 tempest-MigrationsAdminTest-1680714986-project] 10.222.0.20 "GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578" status: 404 len: 111 microversion: 2.1 time: 0.079209 Oct 27 03:26:39.089554 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 863/1704] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:26:39 2022] GET /compute/v2.1/servers/5910c783-6877-4a41-8650-0973a11f3578 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 03:26:39.833935 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f29160d9-ef2a-4354-88af-ba7e96d04312 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:39.863913 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f29160d9-ef2a-4354-88af-ba7e96d04312 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104" status: 200 len: 1718 microversion: 2.1 time: 0.938820 Oct 27 03:26:39.864710 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 842/1705] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:26:38 2022] GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104 => generated 1718 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:26:39.881744 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-bfee066a-bd8b-4d94-857e-3ba5fd0fa179 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:39.882487 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-bfee066a-bd8b-4d94-857e-3ba5fd0fa179 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:39.882808 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c521c1e4-a1af-4857-a456-3f51fe491d31 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7ddecc80d0>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:39.918256 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bfee066a-bd8b-4d94-857e-3ba5fd0fa179 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:39.919019 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bfee066a-bd8b-4d94-857e-3ba5fd0fa179 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:39.919495 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bfee066a-bd8b-4d94-857e-3ba5fd0fa179 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:39.920310 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bfee066a-bd8b-4d94-857e-3ba5fd0fa179 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:39.920774 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bfee066a-bd8b-4d94-857e-3ba5fd0fa179 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:39.921207 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bfee066a-bd8b-4d94-857e-3ba5fd0fa179 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:39.965384 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c521c1e4-a1af-4857-a456-3f51fe491d31 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/images/83da6741-8184-4eb0-a871-04737ab02803" status: 200 len: 1439 microversion: 2.1 time: 0.102895 Oct 27 03:26:39.967397 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 864/1706] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:26:39 2022] GET /compute/v2.1/images/83da6741-8184-4eb0-a871-04737ab02803 => generated 1439 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:26:40.423011 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-bfee066a-bd8b-4d94-857e-3ba5fd0fa179 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:40.432752 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-bfee066a-bd8b-4d94-857e-3ba5fd0fa179 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:40.443346 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-bfee066a-bd8b-4d94-857e-3ba5fd0fa179 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:40.444831 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-bfee066a-bd8b-4d94-857e-3ba5fd0fa179 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f" status: 200 len: 1813 microversion: 2.25 time: 0.573701 Oct 27 03:26:40.456250 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 843/1707] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:26:39 2022] GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f => generated 1813 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:26:40.893424 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e1bcb261-aede-4c97-a3c6-16b3ec758802 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:40.894118 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e1bcb261-aede-4c97-a3c6-16b3ec758802 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: 543fdf60-10ec-4a25-a9d0-30c386efb104] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:40.908119 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e1bcb261-aede-4c97-a3c6-16b3ec758802 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:40.915345 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e1bcb261-aede-4c97-a3c6-16b3ec758802 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:40.919139 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e1bcb261-aede-4c97-a3c6-16b3ec758802 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:40.919139 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e1bcb261-aede-4c97-a3c6-16b3ec758802 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:40.919139 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e1bcb261-aede-4c97-a3c6-16b3ec758802 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:40.920310 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e1bcb261-aede-4c97-a3c6-16b3ec758802 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:40.982822 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c9eb45d1-0360-4fa6-b4f6-a842e286104f tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7ddec280d0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:41.105231 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c9eb45d1-0360-4fa6-b4f6-a842e286104f tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/images/83da6741-8184-4eb0-a871-04737ab02803" status: 200 len: 1439 microversion: 2.1 time: 0.127685 Oct 27 03:26:41.119352 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 844/1708] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:26:40 2022] GET /compute/v2.1/images/83da6741-8184-4eb0-a871-04737ab02803 => generated 1439 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:26:41.439472 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e1bcb261-aede-4c97-a3c6-16b3ec758802 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:41.454756 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e1bcb261-aede-4c97-a3c6-16b3ec758802 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104" status: 200 len: 1718 microversion: 2.1 time: 0.565160 Oct 27 03:26:41.478433 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1a7ad88a-0f4a-45f0-8859-a4c839bc5d45 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:41.485113 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1a7ad88a-0f4a-45f0-8859-a4c839bc5d45 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:41.485422 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 865/1709] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:26:40 2022] GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104 => generated 1718 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:26:41.488870 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1a7ad88a-0f4a-45f0-8859-a4c839bc5d45 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:41.490012 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1a7ad88a-0f4a-45f0-8859-a4c839bc5d45 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:41.490825 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1a7ad88a-0f4a-45f0-8859-a4c839bc5d45 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:41.494685 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1a7ad88a-0f4a-45f0-8859-a4c839bc5d45 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:41.497546 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1a7ad88a-0f4a-45f0-8859-a4c839bc5d45 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:41.498235 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1a7ad88a-0f4a-45f0-8859-a4c839bc5d45 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:41.539121 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:26:41.765296 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1a7ad88a-0f4a-45f0-8859-a4c839bc5d45 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:41.782611 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1a7ad88a-0f4a-45f0-8859-a4c839bc5d45 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:41.788220 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1a7ad88a-0f4a-45f0-8859-a4c839bc5d45 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:41.796712 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1a7ad88a-0f4a-45f0-8859-a4c839bc5d45 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f" status: 200 len: 1813 microversion: 2.25 time: 0.318921 Oct 27 03:26:41.797986 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 845/1710] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:26:41 2022] GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f => generated 1813 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:26:41.948635 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ddb1e9a1-fbfc-4a03-af1d-632ed7a3cdcf tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1029210020", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": [{"uuid": "81b040e4-6976-445b-88ab-1bc0d779ceb2"}]}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:26:42.113082 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-ddb1e9a1-fbfc-4a03-af1d-632ed7a3cdcf tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] validate_networks() for [('81b040e4-6976-445b-88ab-1bc0d779ceb2', None, None, None, None, None)] {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:26:42.121131 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4d04b8ae-c081-4b23-977c-ebf81c227596 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7ddec65940>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:42.264808 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4d04b8ae-c081-4b23-977c-ebf81c227596 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/images/83da6741-8184-4eb0-a871-04737ab02803" status: 200 len: 1439 microversion: 2.1 time: 0.147403 Oct 27 03:26:42.280777 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 846/1711] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:26:42 2022] GET /compute/v2.1/images/83da6741-8184-4eb0-a871-04737ab02803 => generated 1439 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:26:42.483862 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-71d18f11-7657-4bde-8705-a6cc8539eead tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:42.484555 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-71d18f11-7657-4bde-8705-a6cc8539eead tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: 543fdf60-10ec-4a25-a9d0-30c386efb104] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:42.526714 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-71d18f11-7657-4bde-8705-a6cc8539eead tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:42.527249 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-71d18f11-7657-4bde-8705-a6cc8539eead tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:42.532046 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-71d18f11-7657-4bde-8705-a6cc8539eead tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:42.537644 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-71d18f11-7657-4bde-8705-a6cc8539eead tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:42.539640 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-71d18f11-7657-4bde-8705-a6cc8539eead tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:42.540176 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-71d18f11-7657-4bde-8705-a6cc8539eead tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:42.969713 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-71d18f11-7657-4bde-8705-a6cc8539eead tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:42.992774 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-71d18f11-7657-4bde-8705-a6cc8539eead tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104" status: 200 len: 1718 microversion: 2.1 time: 0.508901 Oct 27 03:26:42.994248 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 847/1712] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:26:42 2022] GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104 => generated 1718 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:26:43.015020 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d0fda037-ee9c-4197-a7aa-f077c316d22b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:43.020008 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d0fda037-ee9c-4197-a7aa-f077c316d22b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:43.060736 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d0fda037-ee9c-4197-a7aa-f077c316d22b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:43.061690 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d0fda037-ee9c-4197-a7aa-f077c316d22b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:43.066112 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d0fda037-ee9c-4197-a7aa-f077c316d22b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:43.067312 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d0fda037-ee9c-4197-a7aa-f077c316d22b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:43.068627 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d0fda037-ee9c-4197-a7aa-f077c316d22b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:43.070487 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d0fda037-ee9c-4197-a7aa-f077c316d22b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:43.407506 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d0fda037-ee9c-4197-a7aa-f077c316d22b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:43.431652 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d0fda037-ee9c-4197-a7aa-f077c316d22b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:43.435878 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d0fda037-ee9c-4197-a7aa-f077c316d22b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:43.443680 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d0fda037-ee9c-4197-a7aa-f077c316d22b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f" status: 200 len: 1813 microversion: 2.25 time: 0.446429 Oct 27 03:26:43.456772 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 848/1713] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:26:42 2022] GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f => generated 1813 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:26:43.456772 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0a79cd88-06da-47c7-9ead-9d5663db6b12 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7ddec281f0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:43.545378 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0a79cd88-06da-47c7-9ead-9d5663db6b12 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/images/83da6741-8184-4eb0-a871-04737ab02803" status: 200 len: 1439 microversion: 2.1 time: 0.099312 Oct 27 03:26:43.546277 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 849/1714] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:26:43 2022] GET /compute/v2.1/images/83da6741-8184-4eb0-a871-04737ab02803 => generated 1439 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:26:43.913643 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-ddb1e9a1-fbfc-4a03-af1d-632ed7a3cdcf tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:26:43.913643 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-ddb1e9a1-fbfc-4a03-af1d-632ed7a3cdcf tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:26:43.913643 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-ddb1e9a1-fbfc-4a03-af1d-632ed7a3cdcf tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:26:43.913643 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-ddb1e9a1-fbfc-4a03-af1d-632ed7a3cdcf tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:26:43.913643 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-ddb1e9a1-fbfc-4a03-af1d-632ed7a3cdcf tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:26:43.933261 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ddb1e9a1-fbfc-4a03-af1d-632ed7a3cdcf tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:43.942752 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ddb1e9a1-fbfc-4a03-af1d-632ed7a3cdcf tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:43.943644 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ddb1e9a1-fbfc-4a03-af1d-632ed7a3cdcf tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:43.944667 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ddb1e9a1-fbfc-4a03-af1d-632ed7a3cdcf tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:43.947363 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ddb1e9a1-fbfc-4a03-af1d-632ed7a3cdcf tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:43.950399 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ddb1e9a1-fbfc-4a03-af1d-632ed7a3cdcf tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:44.002531 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-ddb1e9a1-fbfc-4a03-af1d-632ed7a3cdcf tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Getting quotas for project f1cee634bb1f4bb0a47f33a49f24ccdf. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:26:44.019119 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-ddb1e9a1-fbfc-4a03-af1d-632ed7a3cdcf tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Getting quotas for user 8e8640291c8745609faae41bdd731c17 and project f1cee634bb1f4bb0a47f33a49f24ccdf. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:26:44.021455 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2f03e879-6351-4d1a-8be9-ea6512a0a475 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:44.022127 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2f03e879-6351-4d1a-8be9-ea6512a0a475 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: 543fdf60-10ec-4a25-a9d0-30c386efb104] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:44.044280 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ddb1e9a1-fbfc-4a03-af1d-632ed7a3cdcf tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:26:44.047029 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ddb1e9a1-fbfc-4a03-af1d-632ed7a3cdcf tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] [instance: 4a09478e-ae93-4bf9-b270-95cd88d88476] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:26:44.048756 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2f03e879-6351-4d1a-8be9-ea6512a0a475 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:44.049329 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2f03e879-6351-4d1a-8be9-ea6512a0a475 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:44.057988 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2f03e879-6351-4d1a-8be9-ea6512a0a475 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:44.058885 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2f03e879-6351-4d1a-8be9-ea6512a0a475 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:44.067980 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2f03e879-6351-4d1a-8be9-ea6512a0a475 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:44.068453 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2f03e879-6351-4d1a-8be9-ea6512a0a475 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:44.201382 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ddb1e9a1-fbfc-4a03-af1d-632ed7a3cdcf tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.599060 Oct 27 03:26:44.210575 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 866/1715] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:26:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 2600 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 03:26:44.245567 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ccced5ce-b1f9-4085-b400-1a1f7224fcb8 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:44.254277 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ccced5ce-b1f9-4085-b400-1a1f7224fcb8 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] [instance: 4a09478e-ae93-4bf9-b270-95cd88d88476] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:44.643039 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2f03e879-6351-4d1a-8be9-ea6512a0a475 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:44.653527 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2f03e879-6351-4d1a-8be9-ea6512a0a475 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104" status: 200 len: 1718 microversion: 2.1 time: 0.636498 Oct 27 03:26:44.654132 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 850/1716] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:26:44 2022] GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104 => generated 1718 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:26:44.678274 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b75b126c-3147-4585-9489-595f401d49ac tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:44.678901 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b75b126c-3147-4585-9489-595f401d49ac tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:44.722131 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b75b126c-3147-4585-9489-595f401d49ac tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:44.725623 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b75b126c-3147-4585-9489-595f401d49ac tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:44.725623 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b75b126c-3147-4585-9489-595f401d49ac tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:44.725623 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b75b126c-3147-4585-9489-595f401d49ac tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:44.725623 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b75b126c-3147-4585-9489-595f401d49ac tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:44.726325 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b75b126c-3147-4585-9489-595f401d49ac tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:44.772185 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ccced5ce-b1f9-4085-b400-1a1f7224fcb8 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8640291c8745609faae41bdd731c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cee634bb1f4bb0a47f33a49f24ccdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:44.808538 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ccced5ce-b1f9-4085-b400-1a1f7224fcb8 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] 10.222.0.20 "GET /compute/v2.1/servers/4a09478e-ae93-4bf9-b270-95cd88d88476" status: 200 len: 1224 microversion: 2.1 time: 0.596331 Oct 27 03:26:44.817740 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 867/1717] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:26:44 2022] GET /compute/v2.1/servers/4a09478e-ae93-4bf9-b270-95cd88d88476 => generated 1224 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:26:44.826566 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-fa1911e0-5a2b-4045-99e2-fb5ec62cb2bf tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7ddecae700>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:44.998248 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-fa1911e0-5a2b-4045-99e2-fb5ec62cb2bf tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/images/83da6741-8184-4eb0-a871-04737ab02803" status: 200 len: 1439 microversion: 2.1 time: 0.185121 Oct 27 03:26:45.001287 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 868/1718] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:26:44 2022] GET /compute/v2.1/images/83da6741-8184-4eb0-a871-04737ab02803 => generated 1439 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:26:45.160618 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b75b126c-3147-4585-9489-595f401d49ac tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:45.176337 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b75b126c-3147-4585-9489-595f401d49ac tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:45.177757 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b75b126c-3147-4585-9489-595f401d49ac tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:45.198630 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b75b126c-3147-4585-9489-595f401d49ac tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f" status: 200 len: 1813 microversion: 2.25 time: 0.527020 Oct 27 03:26:45.199753 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 851/1719] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:26:44 2022] GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f => generated 1813 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:26:45.679869 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6f7ba879-62b2-4745-a4f2-12bf495e1966 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:45.680494 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6f7ba879-62b2-4745-a4f2-12bf495e1966 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: 543fdf60-10ec-4a25-a9d0-30c386efb104] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:45.708859 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6f7ba879-62b2-4745-a4f2-12bf495e1966 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:45.716569 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6f7ba879-62b2-4745-a4f2-12bf495e1966 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:45.717039 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6f7ba879-62b2-4745-a4f2-12bf495e1966 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:45.721531 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6f7ba879-62b2-4745-a4f2-12bf495e1966 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:45.722063 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6f7ba879-62b2-4745-a4f2-12bf495e1966 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:45.722520 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6f7ba879-62b2-4745-a4f2-12bf495e1966 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:45.834685 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f494b610-b7f7-44c7-a0c1-0d0b699e7de9 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:45.835599 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f494b610-b7f7-44c7-a0c1-0d0b699e7de9 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] [instance: 4a09478e-ae93-4bf9-b270-95cd88d88476] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:45.989361 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f494b610-b7f7-44c7-a0c1-0d0b699e7de9 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8640291c8745609faae41bdd731c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cee634bb1f4bb0a47f33a49f24ccdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:45.998982 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f494b610-b7f7-44c7-a0c1-0d0b699e7de9 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] 10.222.0.20 "GET /compute/v2.1/servers/4a09478e-ae93-4bf9-b270-95cd88d88476" status: 200 len: 1224 microversion: 2.1 time: 0.168039 Oct 27 03:26:46.000124 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 852/1720] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:26:45 2022] GET /compute/v2.1/servers/4a09478e-ae93-4bf9-b270-95cd88d88476 => generated 1224 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:26:46.017293 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-38e8ba4a-1aab-41ea-a2f8-308355a376d4 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7ddec3fc10>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:46.107422 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-38e8ba4a-1aab-41ea-a2f8-308355a376d4 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/images/83da6741-8184-4eb0-a871-04737ab02803" status: 200 len: 1439 microversion: 2.1 time: 0.094869 Oct 27 03:26:46.108502 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 853/1721] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:26:46 2022] GET /compute/v2.1/images/83da6741-8184-4eb0-a871-04737ab02803 => generated 1439 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:26:46.238275 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f28c09f8-4737-4820-9943-edfd39bbd80c tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:46.238275 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f28c09f8-4737-4820-9943-edfd39bbd80c tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:46.245691 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f28c09f8-4737-4820-9943-edfd39bbd80c tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:46.246285 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f28c09f8-4737-4820-9943-edfd39bbd80c tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:46.246735 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f28c09f8-4737-4820-9943-edfd39bbd80c tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:46.247457 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f28c09f8-4737-4820-9943-edfd39bbd80c tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:46.247918 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f28c09f8-4737-4820-9943-edfd39bbd80c tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:46.266385 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f28c09f8-4737-4820-9943-edfd39bbd80c tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:46.478876 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-6f7ba879-62b2-4745-a4f2-12bf495e1966 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:46.492044 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6f7ba879-62b2-4745-a4f2-12bf495e1966 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104" status: 200 len: 1718 microversion: 2.1 time: 0.816828 Oct 27 03:26:46.507374 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 869/1722] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:26:45 2022] GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104 => generated 1718 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:26:46.523296 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-ee075c64-fb98-4117-9e8b-70e6d453ef7a req-b501f5b7-f986-4e49-88b9-c0af0bc7c721 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2be00171-65ea-411a-b2d8-86b4e42d5de9", "name": "network-vif-plugged", "status": "completed", "tag": "eb76ab11-86f3-4dc6-8ddf-18ea2272de05"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:26:46.547725 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-ee075c64-fb98-4117-9e8b-70e6d453ef7a req-b501f5b7-f986-4e49-88b9-c0af0bc7c721 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:46.548645 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f28c09f8-4737-4820-9943-edfd39bbd80c tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:46.549363 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-ee075c64-fb98-4117-9e8b-70e6d453ef7a req-b501f5b7-f986-4e49-88b9-c0af0bc7c721 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:46.550022 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-ee075c64-fb98-4117-9e8b-70e6d453ef7a req-b501f5b7-f986-4e49-88b9-c0af0bc7c721 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:46.573173 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f28c09f8-4737-4820-9943-edfd39bbd80c tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:46.573918 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f28c09f8-4737-4820-9943-edfd39bbd80c tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:46.574649 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-ee075c64-fb98-4117-9e8b-70e6d453ef7a req-b501f5b7-f986-4e49-88b9-c0af0bc7c721 service nova] Creating event network-vif-plugged:eb76ab11-86f3-4dc6-8ddf-18ea2272de05 for instance 2be00171-65ea-411a-b2d8-86b4e42d5de9 on n-h2-862769-1 Oct 27 03:26:46.577239 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f28c09f8-4737-4820-9943-edfd39bbd80c tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f" status: 200 len: 1813 microversion: 2.25 time: 0.351090 Oct 27 03:26:46.582890 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-ee075c64-fb98-4117-9e8b-70e6d453ef7a req-b501f5b7-f986-4e49-88b9-c0af0bc7c721 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074197 Oct 27 03:26:46.584317 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 870/1723] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:26:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:26:46.586183 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 854/1724] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:26:46 2022] GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f => generated 1813 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:26:47.030865 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4ac3dcf7-fbe6-4469-aeca-a570846a1271 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:47.031934 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4ac3dcf7-fbe6-4469-aeca-a570846a1271 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] [instance: 4a09478e-ae93-4bf9-b270-95cd88d88476] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:47.057458 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4ac3dcf7-fbe6-4469-aeca-a570846a1271 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:47.058671 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4ac3dcf7-fbe6-4469-aeca-a570846a1271 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:47.059359 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4ac3dcf7-fbe6-4469-aeca-a570846a1271 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:47.060332 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4ac3dcf7-fbe6-4469-aeca-a570846a1271 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:47.072480 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4ac3dcf7-fbe6-4469-aeca-a570846a1271 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:47.075696 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4ac3dcf7-fbe6-4469-aeca-a570846a1271 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:47.127404 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-51e96229-7647-4266-a91f-4c1cfadd0632 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7ddecea700>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:47.240043 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-51e96229-7647-4266-a91f-4c1cfadd0632 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/images/83da6741-8184-4eb0-a871-04737ab02803" status: 200 len: 1439 microversion: 2.1 time: 0.120167 Oct 27 03:26:47.242881 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 855/1725] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:26:47 2022] GET /compute/v2.1/images/83da6741-8184-4eb0-a871-04737ab02803 => generated 1439 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:26:47.444861 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4ac3dcf7-fbe6-4469-aeca-a570846a1271 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8640291c8745609faae41bdd731c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cee634bb1f4bb0a47f33a49f24ccdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:47.455825 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4ac3dcf7-fbe6-4469-aeca-a570846a1271 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] 10.222.0.20 "GET /compute/v2.1/servers/4a09478e-ae93-4bf9-b270-95cd88d88476" status: 200 len: 1276 microversion: 2.1 time: 0.430975 Oct 27 03:26:47.464322 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 871/1726] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:26:47 2022] GET /compute/v2.1/servers/4a09478e-ae93-4bf9-b270-95cd88d88476 => generated 1276 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:26:47.522652 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9a28fda4-5dbe-4ed7-8d2b-a336e678eac9 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:47.523920 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-9a28fda4-5dbe-4ed7-8d2b-a336e678eac9 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: 543fdf60-10ec-4a25-a9d0-30c386efb104] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:47.540142 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9a28fda4-5dbe-4ed7-8d2b-a336e678eac9 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:47.540941 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9a28fda4-5dbe-4ed7-8d2b-a336e678eac9 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:47.541561 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9a28fda4-5dbe-4ed7-8d2b-a336e678eac9 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:47.543165 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9a28fda4-5dbe-4ed7-8d2b-a336e678eac9 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:47.554610 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9a28fda4-5dbe-4ed7-8d2b-a336e678eac9 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:47.559364 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9a28fda4-5dbe-4ed7-8d2b-a336e678eac9 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:47.912659 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-eb5d5a58-d0e8-4f7f-ae0b-cfb9fbceeba2 tempest-TenantUsagesNegativeTestJSON-1244176445 tempest-TenantUsagesNegativeTestJSON-1244176445-project-admin] 10.222.0.20 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-26T03%3A26%3A47.595485&end=2022-10-28T03%3A26%3A47.595485" status: 404 len: 112 microversion: - time: 0.311779 Oct 27 03:26:47.914085 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 872/1727] 10.222.0.20 () {58 vars in 1316 bytes} [Thu Oct 27 03:26:47 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-26T03%3A26%3A47.595485&end=2022-10-28T03%3A26%3A47.595485 => generated 112 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 27 03:26:47.948575 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9a28fda4-5dbe-4ed7-8d2b-a336e678eac9 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:47.978362 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d62708af-6adb-4286-a3c6-d9e150628dc0 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:47.979874 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9a28fda4-5dbe-4ed7-8d2b-a336e678eac9 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104" status: 200 len: 1718 microversion: 2.1 time: 0.462620 Oct 27 03:26:47.981330 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 856/1728] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:26:47 2022] GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104 => generated 1718 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:26:47.986082 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d62708af-6adb-4286-a3c6-d9e150628dc0 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:48.006445 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d62708af-6adb-4286-a3c6-d9e150628dc0 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:48.006940 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d62708af-6adb-4286-a3c6-d9e150628dc0 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:48.010604 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d62708af-6adb-4286-a3c6-d9e150628dc0 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:48.013600 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9b328093-704b-4e66-9520-e131fbba5fcf tempest-TenantUsagesNegativeTestJSON-1244176445 tempest-TenantUsagesNegativeTestJSON-1244176445-project-admin] Calling method '.version_select at 0x7f7ddac489d0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:48.018019 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d62708af-6adb-4286-a3c6-d9e150628dc0 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:48.019639 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d62708af-6adb-4286-a3c6-d9e150628dc0 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:48.021998 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d62708af-6adb-4286-a3c6-d9e150628dc0 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:48.027794 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-9b328093-704b-4e66-9520-e131fbba5fcf tempest-TenantUsagesNegativeTestJSON-1244176445 tempest-TenantUsagesNegativeTestJSON-1244176445-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Oct 27 03:26:48.045323 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9b328093-704b-4e66-9520-e131fbba5fcf tempest-TenantUsagesNegativeTestJSON-1244176445 tempest-TenantUsagesNegativeTestJSON-1244176445-project-admin] Request method failure captured: Oct 27 03:26:48.045323 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/os-simple-tenant-usage/e3abedd135814be5b8c75451d4e726e1?start=2022-10-28T03%3A26%3A47.595485&end=2022-10-26T03%3A26%3A47.595485 HTTP/1.1 Oct 27 03:26:48.045323 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:26:48.045323 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:26:48.045323 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:26:48.045323 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:26:48.045323 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:26:48.045323 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:26:48.045323 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:26:48.045323 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:26:48.045323 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfp34aDpQsnaG2qJWolgHZ0qDH7zwzPJpayrfagDBWMZ7TqGThKt5FGJ55IPR7sqILzaJG11UBj46n6y32pGyfDzb68fhU2rwYILiAcknP5yrsrL_jqNbKa9xwQ4aB_OoIJ0rm2AXpEQy3Eh3LMWgoypX0AZEK1GsQnHWStOnh2cocg Oct 27 03:26:48.045323 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:26:48.045323 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:26:48.045323 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:26:48.045323 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:26:48.045323 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:26:48.045323 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:26:48.045323 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 1d167557f4d042c28da315c93d358748 Oct 27 03:26:48.045323 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1244176445 Oct 27 03:26:48.045323 n-d-862769-1 devstack@n-api.service[121001]: X-Role: admin,member,reader Oct 27 03:26:48.045323 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: admin,member,reader Oct 27 03:26:48.047120 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1d167557f4d042c28da315c93d358748"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1d167557f4d042c28da315c93d358748"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1d167557f4d042c28da315c93d358748"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1d167557f4d042c28da315c93d358748"}]}] Oct 27 03:26:48.047120 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1244176445 Oct 27 03:26:48.047120 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 1d167557f4d042c28da315c93d358748 Oct 27 03:26:48.047120 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1244176445 Oct 27 03:26:48.047120 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-TenantUsagesNegativeTestJSON-1244176445-project-admin Oct 27 03:26:48.047120 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:26:48.047120 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:26:48.047120 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 6598acbe4bae4c6893f5ccc4cd236af0 Oct 27 03:26:48.047120 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1244176445-project-admin Oct 27 03:26:48.047120 n-d-862769-1 devstack@n-api.service[121001]: method: Oct 27 03:26:48.047120 n-d-862769-1 devstack@n-api.service[121001]: exception: Invalid start time. The start time cannot occur after the end time. Oct 27 03:26:48.047120 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': 'e3abedd135814be5b8c75451d4e726e1'} Oct 27 03:26:48.048064 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:26:48.048064 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:26:48.048064 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:26:48.048064 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:26:48.048064 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:26:48.048064 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:26:48.048064 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:26:48.048064 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:26:48.048064 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 03:26:48.048064 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:26:48.048064 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:26:48.048064 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:26:48.048064 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Oct 27 03:26:48.048064 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 27 03:26:48.048064 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Oct 27 03:26:48.048064 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Oct 27 03:26:48.048064 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Oct 27 03:26:48.048064 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 27 03:26:48.048064 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Oct 27 03:26:48.049527 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:26:48.049527 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:26:48.049527 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:26:48.049527 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:26:48.049527 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:26:48.049527 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:26:48.049527 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:26:48.049527 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:26:48.049527 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Oct 27 03:26:48.049527 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:26:48.054811 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9b328093-704b-4e66-9520-e131fbba5fcf tempest-TenantUsagesNegativeTestJSON-1244176445 tempest-TenantUsagesNegativeTestJSON-1244176445-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:26:48.057318 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9b328093-704b-4e66-9520-e131fbba5fcf tempest-TenantUsagesNegativeTestJSON-1244176445 tempest-TenantUsagesNegativeTestJSON-1244176445-project-admin] 10.222.0.20 "GET /compute/v2.1/os-simple-tenant-usage/e3abedd135814be5b8c75451d4e726e1?start=2022-10-28T03%3A26%3A47.595485&end=2022-10-26T03%3A26%3A47.595485" status: 400 len: 111 microversion: 2.1 time: 0.074688 Oct 27 03:26:48.074090 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 857/1729] 10.222.0.20 () {58 vars in 1412 bytes} [Thu Oct 27 03:26:47 2022] GET /compute/v2.1/os-simple-tenant-usage/e3abedd135814be5b8c75451d4e726e1?start=2022-10-28T03%3A26%3A47.595485&end=2022-10-26T03%3A26%3A47.595485 => generated 111 bytes in 92 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 03:26:48.343919 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-34e6f48a-35c5-4b1e-82a9-330b0c804d84 tempest-TenantUsagesNegativeTestJSON-1517509957 tempest-TenantUsagesNegativeTestJSON-1517509957-project] Calling method '.version_select at 0x7f7ddac9d8b0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:48.354893 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-34e6f48a-35c5-4b1e-82a9-330b0c804d84 tempest-TenantUsagesNegativeTestJSON-1517509957 tempest-TenantUsagesNegativeTestJSON-1517509957-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '5441265fc78c416e8483d83625be08d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3abedd135814be5b8c75451d4e726e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:48.371506 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-34e6f48a-35c5-4b1e-82a9-330b0c804d84 tempest-TenantUsagesNegativeTestJSON-1517509957 tempest-TenantUsagesNegativeTestJSON-1517509957-project] Request method failure captured: Oct 27 03:26:48.371506 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-26T03%3A26%3A47.595485&end=2022-10-28T03%3A26%3A47.595485&detailed=1 HTTP/1.1 Oct 27 03:26:48.371506 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:26:48.371506 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:26:48.371506 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:26:48.371506 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:26:48.371506 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:26:48.371506 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:26:48.371506 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:26:48.371506 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:26:48.371506 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfp1GDmyG5RsAFY5hK_604r7ctzYNbic0MlpBt31f9_3scLPGdVNkk1enAgm97B7cZa_vWZhdksyUJkdBtGZxw8sQf29xgI5ro1WDJtQhaQESvLvIRLrMPr2LQHIZUICjotVv-VFOSCygnrirJfDHgazwb6N8x1yKabeHTbfBTY3V5k Oct 27 03:26:48.371506 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:26:48.371506 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:26:48.371506 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:26:48.371506 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:26:48.371506 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:26:48.371506 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:26:48.371506 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: e3abedd135814be5b8c75451d4e726e1 Oct 27 03:26:48.371506 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1517509957 Oct 27 03:26:48.371506 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:26:48.371506 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:26:48.372914 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e3abedd135814be5b8c75451d4e726e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e3abedd135814be5b8c75451d4e726e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e3abedd135814be5b8c75451d4e726e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e3abedd135814be5b8c75451d4e726e1"}]}] Oct 27 03:26:48.372914 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1517509957 Oct 27 03:26:48.372914 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: e3abedd135814be5b8c75451d4e726e1 Oct 27 03:26:48.372914 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1517509957 Oct 27 03:26:48.372914 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-TenantUsagesNegativeTestJSON-1517509957-project Oct 27 03:26:48.372914 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:26:48.372914 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:26:48.372914 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 5441265fc78c416e8483d83625be08d5 Oct 27 03:26:48.372914 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1517509957-project Oct 27 03:26:48.372914 n-d-862769-1 devstack@n-api.service[121001]: method: Oct 27 03:26:48.372914 n-d-862769-1 devstack@n-api.service[121001]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 27 03:26:48.372914 n-d-862769-1 devstack@n-api.service[121001]: action_args: {} Oct 27 03:26:48.372914 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:26:48.373985 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:26:48.373985 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:26:48.373985 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:26:48.373985 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:26:48.373985 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:26:48.373985 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:26:48.373985 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:26:48.373985 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 03:26:48.373985 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:26:48.373985 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:26:48.373985 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:26:48.373985 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Oct 27 03:26:48.373985 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 27 03:26:48.373985 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Oct 27 03:26:48.373985 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Oct 27 03:26:48.373985 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 03:26:48.373985 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 03:26:48.373985 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 03:26:48.373985 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 03:26:48.375202 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 03:26:48.375202 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 03:26:48.375202 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 03:26:48.375202 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 03:26:48.375202 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 03:26:48.375202 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 03:26:48.375202 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 03:26:48.375202 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 03:26:48.375202 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 03:26:48.375202 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 03:26:48.375202 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 27 03:26:48.375202 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:26:48.375202 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:26:48.375202 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:26:48.375202 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:26:48.375202 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:26:48.375202 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:26:48.375202 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 03:26:48.375202 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 03:26:48.376472 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 27 03:26:48.376472 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:26:48.376472 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-34e6f48a-35c5-4b1e-82a9-330b0c804d84 tempest-TenantUsagesNegativeTestJSON-1517509957 tempest-TenantUsagesNegativeTestJSON-1517509957-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:26:48.376472 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-34e6f48a-35c5-4b1e-82a9-330b0c804d84 tempest-TenantUsagesNegativeTestJSON-1517509957 tempest-TenantUsagesNegativeTestJSON-1517509957-project] 10.222.0.20 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-26T03%3A26%3A47.595485&end=2022-10-28T03%3A26%3A47.595485&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.299783 Oct 27 03:26:48.377140 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 858/1730] 10.222.0.20 () {58 vars in 1335 bytes} [Thu Oct 27 03:26:48 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-26T03%3A26%3A47.595485&end=2022-10-28T03%3A26%3A47.595485&detailed=1 => generated 123 bytes in 302 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:26:48.397054 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c9e4fe32-9abc-4493-8687-700cdcf537dd tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7ddec223a0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:48.507770 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c9e4fe32-9abc-4493-8687-700cdcf537dd tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/images/83da6741-8184-4eb0-a871-04737ab02803" status: 200 len: 1439 microversion: 2.1 time: 0.126842 Oct 27 03:26:48.509039 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 859/1731] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:26:48 2022] GET /compute/v2.1/images/83da6741-8184-4eb0-a871-04737ab02803 => generated 1439 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:26:48.530620 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7dee8f5a-1442-421a-9ae6-fff1f7c0bf34 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:48.532252 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7dee8f5a-1442-421a-9ae6-fff1f7c0bf34 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] [instance: 4a09478e-ae93-4bf9-b270-95cd88d88476] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:48.561851 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7dee8f5a-1442-421a-9ae6-fff1f7c0bf34 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:48.564989 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7dee8f5a-1442-421a-9ae6-fff1f7c0bf34 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:48.566427 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7dee8f5a-1442-421a-9ae6-fff1f7c0bf34 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:48.568587 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7dee8f5a-1442-421a-9ae6-fff1f7c0bf34 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:48.569220 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7dee8f5a-1442-421a-9ae6-fff1f7c0bf34 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:48.578337 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7dee8f5a-1442-421a-9ae6-fff1f7c0bf34 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:48.725010 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7dee8f5a-1442-421a-9ae6-fff1f7c0bf34 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8640291c8745609faae41bdd731c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cee634bb1f4bb0a47f33a49f24ccdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:48.735733 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7dee8f5a-1442-421a-9ae6-fff1f7c0bf34 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] 10.222.0.20 "GET /compute/v2.1/servers/4a09478e-ae93-4bf9-b270-95cd88d88476" status: 200 len: 1284 microversion: 2.1 time: 0.224802 Oct 27 03:26:48.749137 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 860/1732] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:26:48 2022] GET /compute/v2.1/servers/4a09478e-ae93-4bf9-b270-95cd88d88476 => generated 1284 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:26:49.010355 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9fc23fe8-6497-4499-b4bc-43e78b0e1b96 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:49.014922 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-9fc23fe8-6497-4499-b4bc-43e78b0e1b96 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: 543fdf60-10ec-4a25-a9d0-30c386efb104] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:49.039616 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9fc23fe8-6497-4499-b4bc-43e78b0e1b96 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:49.041105 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9fc23fe8-6497-4499-b4bc-43e78b0e1b96 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:49.045832 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9fc23fe8-6497-4499-b4bc-43e78b0e1b96 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:49.051017 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9fc23fe8-6497-4499-b4bc-43e78b0e1b96 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:49.051017 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9fc23fe8-6497-4499-b4bc-43e78b0e1b96 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:49.051017 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9fc23fe8-6497-4499-b4bc-43e78b0e1b96 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:49.348121 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d62708af-6adb-4286-a3c6-d9e150628dc0 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:49.361415 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d62708af-6adb-4286-a3c6-d9e150628dc0 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:49.368945 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d62708af-6adb-4286-a3c6-d9e150628dc0 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:49.370438 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d62708af-6adb-4286-a3c6-d9e150628dc0 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f" status: 200 len: 1813 microversion: 2.25 time: 1.426774 Oct 27 03:26:49.371389 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 873/1733] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:26:47 2022] GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f => generated 1813 bytes in 1457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:26:49.459409 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9fc23fe8-6497-4499-b4bc-43e78b0e1b96 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:49.497696 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9fc23fe8-6497-4499-b4bc-43e78b0e1b96 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104" status: 200 len: 1718 microversion: 2.1 time: 0.487063 Oct 27 03:26:49.500129 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 861/1734] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:26:49 2022] GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104 => generated 1718 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:26:49.527054 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e7a07f2a-fd88-4007-ae91-4dde8277f987 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7ddebf0550>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:49.703625 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e7a07f2a-fd88-4007-ae91-4dde8277f987 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/images/83da6741-8184-4eb0-a871-04737ab02803" status: 200 len: 1439 microversion: 2.1 time: 0.182214 Oct 27 03:26:49.719675 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 874/1735] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:26:49 2022] GET /compute/v2.1/images/83da6741-8184-4eb0-a871-04737ab02803 => generated 1439 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:26:49.789300 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ac0cb2d0-1c0b-4181-b481-f56b0b7499ab tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:49.792799 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ac0cb2d0-1c0b-4181-b481-f56b0b7499ab tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] [instance: 4a09478e-ae93-4bf9-b270-95cd88d88476] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:49.812987 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ac0cb2d0-1c0b-4181-b481-f56b0b7499ab tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:49.813812 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ac0cb2d0-1c0b-4181-b481-f56b0b7499ab tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:49.814994 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ac0cb2d0-1c0b-4181-b481-f56b0b7499ab tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:49.816586 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ac0cb2d0-1c0b-4181-b481-f56b0b7499ab tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:49.817389 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ac0cb2d0-1c0b-4181-b481-f56b0b7499ab tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:49.818099 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ac0cb2d0-1c0b-4181-b481-f56b0b7499ab tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:50.180900 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ac0cb2d0-1c0b-4181-b481-f56b0b7499ab tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8640291c8745609faae41bdd731c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cee634bb1f4bb0a47f33a49f24ccdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:50.201277 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ac0cb2d0-1c0b-4181-b481-f56b0b7499ab tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] 10.222.0.20 "GET /compute/v2.1/servers/4a09478e-ae93-4bf9-b270-95cd88d88476" status: 200 len: 1282 microversion: 2.1 time: 0.443190 Oct 27 03:26:50.234137 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 862/1736] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:26:49 2022] GET /compute/v2.1/servers/4a09478e-ae93-4bf9-b270-95cd88d88476 => generated 1282 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:26:50.397664 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-81f19aa5-3df5-4087-9ef1-f80592a562df tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:50.398947 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-81f19aa5-3df5-4087-9ef1-f80592a562df tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:50.434464 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-81f19aa5-3df5-4087-9ef1-f80592a562df tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:50.435069 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-81f19aa5-3df5-4087-9ef1-f80592a562df tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:50.435860 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-81f19aa5-3df5-4087-9ef1-f80592a562df tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:50.436097 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-81f19aa5-3df5-4087-9ef1-f80592a562df tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:50.436563 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-81f19aa5-3df5-4087-9ef1-f80592a562df tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:50.436999 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-81f19aa5-3df5-4087-9ef1-f80592a562df tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:50.521039 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-459c7ac6-2881-4806-aa4f-6bd66d9242a3 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:50.521666 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-459c7ac6-2881-4806-aa4f-6bd66d9242a3 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: 543fdf60-10ec-4a25-a9d0-30c386efb104] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:50.531406 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-459c7ac6-2881-4806-aa4f-6bd66d9242a3 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:50.531905 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-459c7ac6-2881-4806-aa4f-6bd66d9242a3 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:50.532350 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-459c7ac6-2881-4806-aa4f-6bd66d9242a3 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:50.533076 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-459c7ac6-2881-4806-aa4f-6bd66d9242a3 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:50.555500 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-459c7ac6-2881-4806-aa4f-6bd66d9242a3 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:50.555971 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-459c7ac6-2881-4806-aa4f-6bd66d9242a3 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:50.564012 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:26:50.982601 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-81f19aa5-3df5-4087-9ef1-f80592a562df tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:50.999114 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-81f19aa5-3df5-4087-9ef1-f80592a562df tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:51.008483 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-81f19aa5-3df5-4087-9ef1-f80592a562df tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:51.009928 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-81f19aa5-3df5-4087-9ef1-f80592a562df tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f" status: 200 len: 1813 microversion: 2.25 time: 0.617077 Oct 27 03:26:51.022088 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 875/1737] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:26:50 2022] GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f => generated 1813 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:26:51.022088 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b930ede6-f17c-42f1-99b9-e098cccb5991 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7ddecb5310>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:51.158561 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b930ede6-f17c-42f1-99b9-e098cccb5991 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/images/83da6741-8184-4eb0-a871-04737ab02803" status: 200 len: 1439 microversion: 2.1 time: 0.138709 Oct 27 03:26:51.159904 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 876/1738] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:26:51 2022] GET /compute/v2.1/images/83da6741-8184-4eb0-a871-04737ab02803 => generated 1439 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:26:51.260442 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2b91fa78-cc99-4723-bb2d-be3f50333482 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:51.262793 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-2b91fa78-cc99-4723-bb2d-be3f50333482 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] [instance: 4a09478e-ae93-4bf9-b270-95cd88d88476] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:51.280180 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2b91fa78-cc99-4723-bb2d-be3f50333482 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:51.281703 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2b91fa78-cc99-4723-bb2d-be3f50333482 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:51.283924 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2b91fa78-cc99-4723-bb2d-be3f50333482 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:51.287223 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2b91fa78-cc99-4723-bb2d-be3f50333482 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:51.287961 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2b91fa78-cc99-4723-bb2d-be3f50333482 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:51.292306 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2b91fa78-cc99-4723-bb2d-be3f50333482 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:51.473219 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-459c7ac6-2881-4806-aa4f-6bd66d9242a3 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:51.487053 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-459c7ac6-2881-4806-aa4f-6bd66d9242a3 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104" status: 200 len: 1718 microversion: 2.1 time: 0.969861 Oct 27 03:26:51.488013 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 863/1739] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:26:50 2022] GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104 => generated 1718 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:26:51.566197 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2b91fa78-cc99-4723-bb2d-be3f50333482 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8640291c8745609faae41bdd731c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cee634bb1f4bb0a47f33a49f24ccdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:51.587287 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2b91fa78-cc99-4723-bb2d-be3f50333482 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] 10.222.0.20 "GET /compute/v2.1/servers/4a09478e-ae93-4bf9-b270-95cd88d88476" status: 200 len: 1282 microversion: 2.1 time: 0.331634 Oct 27 03:26:51.591722 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 877/1740] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:26:51 2022] GET /compute/v2.1/servers/4a09478e-ae93-4bf9-b270-95cd88d88476 => generated 1282 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:26:52.040877 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4470569b-7d69-4da0-834a-b2bfc322466a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:52.041519 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4470569b-7d69-4da0-834a-b2bfc322466a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:52.055971 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4470569b-7d69-4da0-834a-b2bfc322466a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:52.065225 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4470569b-7d69-4da0-834a-b2bfc322466a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:52.066652 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4470569b-7d69-4da0-834a-b2bfc322466a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:52.067516 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4470569b-7d69-4da0-834a-b2bfc322466a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:52.070921 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4470569b-7d69-4da0-834a-b2bfc322466a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:52.071543 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4470569b-7d69-4da0-834a-b2bfc322466a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:52.175659 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e3d740cd-5a36-4637-ab30-07bb14b49eb4 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7ddecb5940>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:52.365935 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e3d740cd-5a36-4637-ab30-07bb14b49eb4 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/images/83da6741-8184-4eb0-a871-04737ab02803" status: 200 len: 1439 microversion: 2.1 time: 0.193440 Oct 27 03:26:52.367984 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 878/1741] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:26:52 2022] GET /compute/v2.1/images/83da6741-8184-4eb0-a871-04737ab02803 => generated 1439 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:26:52.517699 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-dac0ae5f-1979-41be-af49-e39649cab4c2 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:52.518767 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-dac0ae5f-1979-41be-af49-e39649cab4c2 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: 543fdf60-10ec-4a25-a9d0-30c386efb104] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:52.555612 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dac0ae5f-1979-41be-af49-e39649cab4c2 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:52.557180 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dac0ae5f-1979-41be-af49-e39649cab4c2 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:52.559229 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dac0ae5f-1979-41be-af49-e39649cab4c2 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:52.563809 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dac0ae5f-1979-41be-af49-e39649cab4c2 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:52.566670 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dac0ae5f-1979-41be-af49-e39649cab4c2 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:52.571624 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dac0ae5f-1979-41be-af49-e39649cab4c2 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:53.103841 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4470569b-7d69-4da0-834a-b2bfc322466a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:53.129889 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4470569b-7d69-4da0-834a-b2bfc322466a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:53.135339 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4470569b-7d69-4da0-834a-b2bfc322466a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:53.142951 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4470569b-7d69-4da0-834a-b2bfc322466a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f" status: 200 len: 1813 microversion: 2.25 time: 1.105976 Oct 27 03:26:53.147749 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 864/1742] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:26:52 2022] GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f => generated 1813 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:26:53.161855 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7b6897ed-f204-46eb-8995-9c2959fcf79f tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:53.165129 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7b6897ed-f204-46eb-8995-9c2959fcf79f tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] [instance: 4a09478e-ae93-4bf9-b270-95cd88d88476] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:53.178425 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7b6897ed-f204-46eb-8995-9c2959fcf79f tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:53.182166 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7b6897ed-f204-46eb-8995-9c2959fcf79f tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:53.183034 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7b6897ed-f204-46eb-8995-9c2959fcf79f tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:53.196000 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7b6897ed-f204-46eb-8995-9c2959fcf79f tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:53.201472 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7b6897ed-f204-46eb-8995-9c2959fcf79f tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:53.201472 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7b6897ed-f204-46eb-8995-9c2959fcf79f tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:53.283796 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-dac0ae5f-1979-41be-af49-e39649cab4c2 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:53.299184 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-dac0ae5f-1979-41be-af49-e39649cab4c2 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104" status: 200 len: 1718 microversion: 2.1 time: 0.787860 Oct 27 03:26:53.308315 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 879/1743] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:26:52 2022] GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104 => generated 1718 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:26:53.394796 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-11d2e53c-3fa2-4881-bb13-6b2770918c0b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7ddec5c790>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:53.491833 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-11d2e53c-3fa2-4881-bb13-6b2770918c0b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/images/83da6741-8184-4eb0-a871-04737ab02803" status: 200 len: 1439 microversion: 2.1 time: 0.104357 Oct 27 03:26:53.495852 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 880/1744] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:26:53 2022] GET /compute/v2.1/images/83da6741-8184-4eb0-a871-04737ab02803 => generated 1439 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:26:53.908218 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7b6897ed-f204-46eb-8995-9c2959fcf79f tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8640291c8745609faae41bdd731c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cee634bb1f4bb0a47f33a49f24ccdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:53.925613 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7b6897ed-f204-46eb-8995-9c2959fcf79f tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] 10.222.0.20 "GET /compute/v2.1/servers/4a09478e-ae93-4bf9-b270-95cd88d88476" status: 200 len: 1324 microversion: 2.1 time: 0.776273 Oct 27 03:26:53.927325 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 865/1745] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:26:53 2022] GET /compute/v2.1/servers/4a09478e-ae93-4bf9-b270-95cd88d88476 => generated 1324 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:26:54.179062 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:26:54.202402 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-946a5b4a-1901-4cc4-9a19-4743cf0156e2 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:54.203679 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-946a5b4a-1901-4cc4-9a19-4743cf0156e2 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:54.205855 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:26:54.222084 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-946a5b4a-1901-4cc4-9a19-4743cf0156e2 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:54.236561 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-946a5b4a-1901-4cc4-9a19-4743cf0156e2 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:54.242441 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-946a5b4a-1901-4cc4-9a19-4743cf0156e2 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:54.245742 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-946a5b4a-1901-4cc4-9a19-4743cf0156e2 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:54.248625 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-946a5b4a-1901-4cc4-9a19-4743cf0156e2 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:54.249293 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-946a5b4a-1901-4cc4-9a19-4743cf0156e2 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:54.333760 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7aacc90e-f8ff-4e7b-948a-ac6763a51230 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:54.336666 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7aacc90e-f8ff-4e7b-948a-ac6763a51230 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: 543fdf60-10ec-4a25-a9d0-30c386efb104] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:54.371475 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7aacc90e-f8ff-4e7b-948a-ac6763a51230 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:54.372327 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7aacc90e-f8ff-4e7b-948a-ac6763a51230 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:54.376777 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7aacc90e-f8ff-4e7b-948a-ac6763a51230 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:54.377768 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7aacc90e-f8ff-4e7b-948a-ac6763a51230 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:54.378477 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7aacc90e-f8ff-4e7b-948a-ac6763a51230 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:54.381963 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7aacc90e-f8ff-4e7b-948a-ac6763a51230 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:54.808681 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=8 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:26:54.923823 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7aacc90e-f8ff-4e7b-948a-ac6763a51230 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:54.937183 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7aacc90e-f8ff-4e7b-948a-ac6763a51230 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104" status: 200 len: 1718 microversion: 2.1 time: 0.611318 Oct 27 03:26:54.941265 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 866/1746] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:26:54 2022] GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104 => generated 1718 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:26:54.955705 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d482489b-e53b-4308-89eb-f71d723892db tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7ddec3fe50>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:55.053014 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d482489b-e53b-4308-89eb-f71d723892db tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/images/83da6741-8184-4eb0-a871-04737ab02803" status: 200 len: 1439 microversion: 2.1 time: 0.109666 Oct 27 03:26:55.061751 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 867/1747] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:26:54 2022] GET /compute/v2.1/images/83da6741-8184-4eb0-a871-04737ab02803 => generated 1439 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:26:55.075195 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f77af439-428d-4324-9816-10c9b0c3b279 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:55.078785 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f77af439-428d-4324-9816-10c9b0c3b279 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] [instance: 4a09478e-ae93-4bf9-b270-95cd88d88476] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:55.080974 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:26:55.094137 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f77af439-428d-4324-9816-10c9b0c3b279 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:55.095243 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f77af439-428d-4324-9816-10c9b0c3b279 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:55.095989 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f77af439-428d-4324-9816-10c9b0c3b279 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:55.097101 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f77af439-428d-4324-9816-10c9b0c3b279 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:55.100479 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f77af439-428d-4324-9816-10c9b0c3b279 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:55.101166 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f77af439-428d-4324-9816-10c9b0c3b279 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:55.195333 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-946a5b4a-1901-4cc4-9a19-4743cf0156e2 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:55.223652 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-946a5b4a-1901-4cc4-9a19-4743cf0156e2 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:55.223652 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-946a5b4a-1901-4cc4-9a19-4743cf0156e2 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:55.223652 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-946a5b4a-1901-4cc4-9a19-4743cf0156e2 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f" status: 200 len: 1813 microversion: 2.25 time: 1.045575 Oct 27 03:26:55.229091 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 881/1748] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:26:54 2022] GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f => generated 1813 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:26:55.995037 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:26:56.362072 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f77af439-428d-4324-9816-10c9b0c3b279 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8640291c8745609faae41bdd731c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cee634bb1f4bb0a47f33a49f24ccdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:56.378938 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f77af439-428d-4324-9816-10c9b0c3b279 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] 10.222.0.20 "GET /compute/v2.1/servers/4a09478e-ae93-4bf9-b270-95cd88d88476" status: 200 len: 1324 microversion: 2.1 time: 1.311186 Oct 27 03:26:56.378938 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 868/1749] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:26:55 2022] GET /compute/v2.1/servers/4a09478e-ae93-4bf9-b270-95cd88d88476 => generated 1324 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:26:56.424795 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-331b25c0-048d-41df-a271-841208533593 tempest-VolumesAdminNegativeTest-380053045 tempest-VolumesAdminNegativeTest-380053045-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "08cfe5a5-249a-40f3-91ce-4cb1e8070dcd"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:26:56.424795 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-331b25c0-048d-41df-a271-841208533593 tempest-VolumesAdminNegativeTest-380053045 tempest-VolumesAdminNegativeTest-380053045-project-admin] [instance: 1d9172bd-aa20-4f49-87fa-64300cf861be] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:56.430916 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d87a4b45-2ad8-460d-9f7e-089e484f589a tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:56.431550 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d87a4b45-2ad8-460d-9f7e-089e484f589a tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: 543fdf60-10ec-4a25-a9d0-30c386efb104] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:56.436809 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-331b25c0-048d-41df-a271-841208533593 tempest-VolumesAdminNegativeTest-380053045 tempest-VolumesAdminNegativeTest-380053045-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:56.438990 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-331b25c0-048d-41df-a271-841208533593 tempest-VolumesAdminNegativeTest-380053045 tempest-VolumesAdminNegativeTest-380053045-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:56.439585 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-331b25c0-048d-41df-a271-841208533593 tempest-VolumesAdminNegativeTest-380053045 tempest-VolumesAdminNegativeTest-380053045-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:56.440352 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-331b25c0-048d-41df-a271-841208533593 tempest-VolumesAdminNegativeTest-380053045 tempest-VolumesAdminNegativeTest-380053045-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:56.441381 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-331b25c0-048d-41df-a271-841208533593 tempest-VolumesAdminNegativeTest-380053045 tempest-VolumesAdminNegativeTest-380053045-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:56.441813 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-331b25c0-048d-41df-a271-841208533593 tempest-VolumesAdminNegativeTest-380053045 tempest-VolumesAdminNegativeTest-380053045-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:56.452469 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d87a4b45-2ad8-460d-9f7e-089e484f589a tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:56.459108 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d87a4b45-2ad8-460d-9f7e-089e484f589a tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:56.459782 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d87a4b45-2ad8-460d-9f7e-089e484f589a tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:56.460563 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d87a4b45-2ad8-460d-9f7e-089e484f589a tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:56.461044 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d87a4b45-2ad8-460d-9f7e-089e484f589a tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:56.461487 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d87a4b45-2ad8-460d-9f7e-089e484f589a tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:56.698518 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-331b25c0-048d-41df-a271-841208533593 tempest-VolumesAdminNegativeTest-380053045 tempest-VolumesAdminNegativeTest-380053045-project-admin] HTTP exception thrown: Volume 08cfe5a5-249a-40f3-91ce-4cb1e8070dcd could not be found. Oct 27 03:26:56.724873 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-331b25c0-048d-41df-a271-841208533593 tempest-VolumesAdminNegativeTest-380053045 tempest-VolumesAdminNegativeTest-380053045-project-admin] Request method failure captured: Oct 27 03:26:56.724873 n-d-862769-1 devstack@n-api.service[121000]: request: PUT /compute/v2.1/servers/1d9172bd-aa20-4f49-87fa-64300cf861be/os-volume_attachments/30da14c6-516c-4117-b5cc-e040a8ad9e13 HTTP/1.1 Oct 27 03:26:56.724873 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:26:56.724873 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:26:56.724873 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:26:56.724873 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 74 Oct 27 03:26:56.724873 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:26:56.724873 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:26:56.724873 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:26:56.724873 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:26:56.724873 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfoj9HZW1MizVjR1dWwd2bA1fGUJAz4Y024rc2RWAH5YMHoTuUPPsCHgXBezsoHgQZGdBJvJtJbAVP5-qEkwFqVImFo3askEgp2knuj5vw7HQsIi14t1gZ-d4rkkgTEoq1FiJ6uhpiFvMsiyprG2KUKl4Z5cpOl8E0CKHIKI_tFbnN8 Oct 27 03:26:56.724873 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:26:56.724873 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:26:56.724873 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:26:56.724873 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:26:56.724873 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:26:56.724873 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:26:56.724873 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: dca70d6b18304d5ebb73579d68dbfb76 Oct 27 03:26:56.724873 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-VolumesAdminNegativeTest-380053045 Oct 27 03:26:56.724873 n-d-862769-1 devstack@n-api.service[121000]: X-Role: admin,member,reader Oct 27 03:26:56.724873 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: admin,member,reader Oct 27 03:26:56.726396 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dca70d6b18304d5ebb73579d68dbfb76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dca70d6b18304d5ebb73579d68dbfb76"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dca70d6b18304d5ebb73579d68dbfb76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dca70d6b18304d5ebb73579d68dbfb76"}]}] Oct 27 03:26:56.726396 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-VolumesAdminNegativeTest-380053045 Oct 27 03:26:56.726396 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: dca70d6b18304d5ebb73579d68dbfb76 Oct 27 03:26:56.726396 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-380053045 Oct 27 03:26:56.726396 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-VolumesAdminNegativeTest-380053045-project-admin Oct 27 03:26:56.726396 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:26:56.726396 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:26:56.726396 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: eb3831e6ce63489c8315e932634ead86 Oct 27 03:26:56.726396 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-VolumesAdminNegativeTest-380053045-project-admin Oct 27 03:26:56.726396 n-d-862769-1 devstack@n-api.service[121000]: Oct 27 03:26:56.726396 n-d-862769-1 devstack@n-api.service[121000]: {"volumeAttachment": {"volumeId": "08cfe5a5-249a-40f3-91ce-4cb1e8070dcd"}} Oct 27 03:26:56.726396 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:26:56.726396 n-d-862769-1 devstack@n-api.service[121000]: exception: Volume 08cfe5a5-249a-40f3-91ce-4cb1e8070dcd could not be found. Oct 27 03:26:56.727235 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'server_id': '1d9172bd-aa20-4f49-87fa-64300cf861be', 'id': '30da14c6-516c-4117-b5cc-e040a8ad9e13', 'body': {'volumeAttachment': {'volumeId': '08cfe5a5-249a-40f3-91ce-4cb1e8070dcd'}}} Oct 27 03:26:56.727235 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:26:56.727235 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:26:56.727235 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 03:26:56.727235 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 03:26:56.727235 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 27 03:26:56.727235 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 27 03:26:56.727235 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 27 03:26:56.727235 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 27 03:26:56.727235 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 03:26:56.727235 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 03:26:56.727235 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 03:26:56.727235 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 03:26:56.727235 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 03:26:56.727235 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 03:26:56.727235 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 03:26:56.727235 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 03:26:56.728393 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 08cfe5a5-249a-40f3-91ce-4cb1e8070dcd could not be found. (HTTP 404) (Request-ID: req-5b2f090d-4e33-414f-9bb8-72ad47a6a4f6) Oct 27 03:26:56.728393 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:26:56.728393 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:26:56.728393 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:26:56.728393 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:26:56.728393 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Oct 27 03:26:56.728393 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Oct 27 03:26:56.728393 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 27 03:26:56.728393 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 27 03:26:56.728393 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 27 03:26:56.728393 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 27 03:26:56.728393 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 27 03:26:56.728393 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 27 03:26:56.728393 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 03:26:56.728393 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 03:26:56.728393 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 27 03:26:56.728393 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 27 03:26:56.728393 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 27 03:26:56.728393 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 27 03:26:56.731208 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 03:26:56.731208 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 03:26:56.731208 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 03:26:56.731208 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 03:26:56.731208 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 03:26:56.731208 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 03:26:56.731208 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 03:26:56.731208 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 03:26:56.731208 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 08cfe5a5-249a-40f3-91ce-4cb1e8070dcd could not be found. Oct 27 03:26:56.731208 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:26:56.731208 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:26:56.731208 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:26:56.731208 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:26:56.731208 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:26:56.731208 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:26:56.731208 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:26:56.731208 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:26:56.731208 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:26:56.731208 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:26:56.733558 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:26:56.733558 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:26:56.733558 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:26:56.733558 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:26:56.733558 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 27 03:26:56.733558 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 27 03:26:56.733558 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Oct 27 03:26:56.733558 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 27 03:26:56.733558 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 08cfe5a5-249a-40f3-91ce-4cb1e8070dcd could not be found. Oct 27 03:26:56.733558 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:26:56.733558 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:26:56.733558 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:26:56.733558 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:26:56.733558 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:26:56.733558 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:26:56.733558 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:26:56.733558 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:26:56.733558 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 08cfe5a5-249a-40f3-91ce-4cb1e8070dcd could not be found. Oct 27 03:26:56.733558 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:26:56.741956 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-331b25c0-048d-41df-a271-841208533593 tempest-VolumesAdminNegativeTest-380053045 tempest-VolumesAdminNegativeTest-380053045-project-admin] Returning 400 to user: Volume 08cfe5a5-249a-40f3-91ce-4cb1e8070dcd could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:26:56.741956 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-331b25c0-048d-41df-a271-841208533593 tempest-VolumesAdminNegativeTest-380053045 tempest-VolumesAdminNegativeTest-380053045-project-admin] 10.222.0.20 "PUT /compute/v2.1/servers/1d9172bd-aa20-4f49-87fa-64300cf861be/os-volume_attachments/30da14c6-516c-4117-b5cc-e040a8ad9e13" status: 400 len: 107 microversion: 2.1 time: 0.832698 Oct 27 03:26:56.741956 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 882/1750] 10.222.0.20 () {60 vars in 1433 bytes} [Thu Oct 27 03:26:55 2022] PUT /compute/v2.1/servers/1d9172bd-aa20-4f49-87fa-64300cf861be/os-volume_attachments/30da14c6-516c-4117-b5cc-e040a8ad9e13 => generated 107 bytes in 834 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 03:26:56.751984 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-23c80535-e747-44e4-8131-80308d8fc92f tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7ddec5c8b0>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:56.834461 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-23c80535-e747-44e4-8131-80308d8fc92f tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/images/83da6741-8184-4eb0-a871-04737ab02803" status: 200 len: 1439 microversion: 2.1 time: 0.089780 Oct 27 03:26:56.835689 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 883/1751] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:26:56 2022] GET /compute/v2.1/images/83da6741-8184-4eb0-a871-04737ab02803 => generated 1439 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:26:56.848909 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e249d09b-ac88-4ae4-96b6-1489e9559322 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:56.850345 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e249d09b-ac88-4ae4-96b6-1489e9559322 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:56.884927 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e249d09b-ac88-4ae4-96b6-1489e9559322 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:56.885218 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e249d09b-ac88-4ae4-96b6-1489e9559322 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:56.896060 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e249d09b-ac88-4ae4-96b6-1489e9559322 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:56.896907 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e249d09b-ac88-4ae4-96b6-1489e9559322 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:56.897401 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e249d09b-ac88-4ae4-96b6-1489e9559322 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:56.897848 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e249d09b-ac88-4ae4-96b6-1489e9559322 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:56.957024 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d87a4b45-2ad8-460d-9f7e-089e484f589a tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:56.965521 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d87a4b45-2ad8-460d-9f7e-089e484f589a tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104" status: 200 len: 1718 microversion: 2.1 time: 0.568583 Oct 27 03:26:56.992443 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 869/1752] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:26:56 2022] GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104 => generated 1718 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:26:56.997537 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-4e28aa7d-6b3e-4c46-af1e-43b6b39920dd req-199b8ddf-3442-48e5-b34e-b06eacb33ce7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a09478e-ae93-4bf9-b270-95cd88d88476", "tag": "b7642b15-cece-4456-a1d2-fefef01ecb62"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:26:57.021475 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-4e28aa7d-6b3e-4c46-af1e-43b6b39920dd req-199b8ddf-3442-48e5-b34e-b06eacb33ce7 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:57.021972 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-4e28aa7d-6b3e-4c46-af1e-43b6b39920dd req-199b8ddf-3442-48e5-b34e-b06eacb33ce7 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:57.022439 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-4e28aa7d-6b3e-4c46-af1e-43b6b39920dd req-199b8ddf-3442-48e5-b34e-b06eacb33ce7 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:57.047370 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-4e28aa7d-6b3e-4c46-af1e-43b6b39920dd req-199b8ddf-3442-48e5-b34e-b06eacb33ce7 service nova] Creating event network-changed:b7642b15-cece-4456-a1d2-fefef01ecb62 for instance 4a09478e-ae93-4bf9-b270-95cd88d88476 on n-h1-862769-1 Oct 27 03:26:57.061258 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-4e28aa7d-6b3e-4c46-af1e-43b6b39920dd req-199b8ddf-3442-48e5-b34e-b06eacb33ce7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067365 Oct 27 03:26:57.062259 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 870/1753] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:26:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:26:57.073255 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-97580dd0-2be2-4659-890e-800747b7105a tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:57.074511 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-97580dd0-2be2-4659-890e-800747b7105a tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] [instance: 1d9172bd-aa20-4f49-87fa-64300cf861be] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:57.094172 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-97580dd0-2be2-4659-890e-800747b7105a tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:57.095370 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-97580dd0-2be2-4659-890e-800747b7105a tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:57.096410 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-97580dd0-2be2-4659-890e-800747b7105a tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:57.097913 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-97580dd0-2be2-4659-890e-800747b7105a tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:57.099085 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-97580dd0-2be2-4659-890e-800747b7105a tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:57.099832 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-97580dd0-2be2-4659-890e-800747b7105a tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:57.226014 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=100 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:26:57.384617 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-97580dd0-2be2-4659-890e-800747b7105a tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lazy-loading 'services' on Instance uuid 1d9172bd-aa20-4f49-87fa-64300cf861be {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:26:57.819755 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-97580dd0-2be2-4659-890e-800747b7105a tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1d9172bd-aa20-4f49-87fa-64300cf861be/os-volume_attachments/30da14c6-516c-4117-b5cc-e040a8ad9e13" status: 202 len: 0 microversion: 2.1 time: 0.755445 Oct 27 03:26:57.821367 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 871/1754] 10.222.0.20 () {58 vars in 1416 bytes} [Thu Oct 27 03:26:57 2022] DELETE /compute/v2.1/servers/1d9172bd-aa20-4f49-87fa-64300cf861be/os-volume_attachments/30da14c6-516c-4117-b5cc-e040a8ad9e13 => generated 0 bytes in 758 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:26:57.843892 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1367a902-c604-4714-9fa7-bd5675ef4224 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:57.845089 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1367a902-c604-4714-9fa7-bd5675ef4224 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] [instance: 4a09478e-ae93-4bf9-b270-95cd88d88476] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:57.877497 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1367a902-c604-4714-9fa7-bd5675ef4224 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:57.883024 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1367a902-c604-4714-9fa7-bd5675ef4224 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:57.886215 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1367a902-c604-4714-9fa7-bd5675ef4224 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:57.887718 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1367a902-c604-4714-9fa7-bd5675ef4224 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:57.890159 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1367a902-c604-4714-9fa7-bd5675ef4224 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:57.891973 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1367a902-c604-4714-9fa7-bd5675ef4224 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:57.938643 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e249d09b-ac88-4ae4-96b6-1489e9559322 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:57.955178 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e249d09b-ac88-4ae4-96b6-1489e9559322 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:57.957169 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e249d09b-ac88-4ae4-96b6-1489e9559322 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:57.987445 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e249d09b-ac88-4ae4-96b6-1489e9559322 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f" status: 200 len: 1813 microversion: 2.25 time: 1.121287 Oct 27 03:26:57.988127 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 884/1755] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:26:56 2022] GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f => generated 1813 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:26:58.014327 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-eaaee5da-ed5f-4e19-8ec0-69ff26e42e93 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:58.020188 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-eaaee5da-ed5f-4e19-8ec0-69ff26e42e93 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] [instance: 1d9172bd-aa20-4f49-87fa-64300cf861be] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:58.056153 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eaaee5da-ed5f-4e19-8ec0-69ff26e42e93 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:58.062075 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eaaee5da-ed5f-4e19-8ec0-69ff26e42e93 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:58.064056 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eaaee5da-ed5f-4e19-8ec0-69ff26e42e93 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:58.067845 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eaaee5da-ed5f-4e19-8ec0-69ff26e42e93 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:58.070677 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eaaee5da-ed5f-4e19-8ec0-69ff26e42e93 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:58.074070 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eaaee5da-ed5f-4e19-8ec0-69ff26e42e93 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:58.221472 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-eaaee5da-ed5f-4e19-8ec0-69ff26e42e93 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] 10.222.0.20 "GET /compute/v2.1/servers/1d9172bd-aa20-4f49-87fa-64300cf861be/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.231424 Oct 27 03:26:58.227452 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 885/1756] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 27 03:26:57 2022] GET /compute/v2.1/servers/1d9172bd-aa20-4f49-87fa-64300cf861be/os-volume_attachments => generated 197 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:26:58.237412 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2302c7b7-1e35-44e7-83dc-c7be981bd65b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7ddec43430>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:58.327359 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2302c7b7-1e35-44e7-83dc-c7be981bd65b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/images/83da6741-8184-4eb0-a871-04737ab02803" status: 200 len: 1439 microversion: 2.1 time: 0.100881 Oct 27 03:26:58.332476 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 886/1757] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:26:58 2022] GET /compute/v2.1/images/83da6741-8184-4eb0-a871-04737ab02803 => generated 1439 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:26:58.344931 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e9c3515b-0a45-47e5-819f-2f03c48162a4 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:58.348747 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e9c3515b-0a45-47e5-819f-2f03c48162a4 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: 543fdf60-10ec-4a25-a9d0-30c386efb104] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:58.365425 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e9c3515b-0a45-47e5-819f-2f03c48162a4 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:58.365929 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e9c3515b-0a45-47e5-819f-2f03c48162a4 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:58.371338 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e9c3515b-0a45-47e5-819f-2f03c48162a4 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:58.372904 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e9c3515b-0a45-47e5-819f-2f03c48162a4 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:58.373412 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e9c3515b-0a45-47e5-819f-2f03c48162a4 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:58.373835 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e9c3515b-0a45-47e5-819f-2f03c48162a4 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:58.652850 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1367a902-c604-4714-9fa7-bd5675ef4224 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8640291c8745609faae41bdd731c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cee634bb1f4bb0a47f33a49f24ccdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:58.667887 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1367a902-c604-4714-9fa7-bd5675ef4224 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] 10.222.0.20 "GET /compute/v2.1/servers/4a09478e-ae93-4bf9-b270-95cd88d88476" status: 200 len: 1324 microversion: 2.1 time: 0.843182 Oct 27 03:26:58.669398 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 872/1758] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:26:57 2022] GET /compute/v2.1/servers/4a09478e-ae93-4bf9-b270-95cd88d88476 => generated 1324 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:26:58.939112 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e9c3515b-0a45-47e5-819f-2f03c48162a4 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:58.955917 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e9c3515b-0a45-47e5-819f-2f03c48162a4 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104" status: 200 len: 1718 microversion: 2.1 time: 0.621957 Oct 27 03:26:58.962448 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 887/1759] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:26:58 2022] GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104 => generated 1718 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:26:59.020832 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-18c3ae95-b65a-4d71-8213-f67b395315a5 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:59.021470 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-18c3ae95-b65a-4d71-8213-f67b395315a5 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:59.040245 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-18c3ae95-b65a-4d71-8213-f67b395315a5 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:59.040764 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-18c3ae95-b65a-4d71-8213-f67b395315a5 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:59.041214 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-18c3ae95-b65a-4d71-8213-f67b395315a5 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:59.041945 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-18c3ae95-b65a-4d71-8213-f67b395315a5 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:59.050739 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-18c3ae95-b65a-4d71-8213-f67b395315a5 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:59.051370 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-18c3ae95-b65a-4d71-8213-f67b395315a5 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:59.237123 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-912dfaee-2577-4421-8a2e-eb96766e2f4a tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:59.239810 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-912dfaee-2577-4421-8a2e-eb96766e2f4a tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] [instance: 1d9172bd-aa20-4f49-87fa-64300cf861be] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:59.272488 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-912dfaee-2577-4421-8a2e-eb96766e2f4a tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:59.278741 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-912dfaee-2577-4421-8a2e-eb96766e2f4a tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:59.279770 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-912dfaee-2577-4421-8a2e-eb96766e2f4a tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:59.281950 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-912dfaee-2577-4421-8a2e-eb96766e2f4a tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:59.282459 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-912dfaee-2577-4421-8a2e-eb96766e2f4a tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:59.286087 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-912dfaee-2577-4421-8a2e-eb96766e2f4a tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:59.415471 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-912dfaee-2577-4421-8a2e-eb96766e2f4a tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] 10.222.0.20 "GET /compute/v2.1/servers/1d9172bd-aa20-4f49-87fa-64300cf861be/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.180459 Oct 27 03:26:59.419250 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 888/1760] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 27 03:26:59 2022] GET /compute/v2.1/servers/1d9172bd-aa20-4f49-87fa-64300cf861be/os-volume_attachments => generated 197 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:26:59.442356 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b2a333c3-53f9-4709-8628-95f258966f28 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7ddec28310>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:59.580675 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b2a333c3-53f9-4709-8628-95f258966f28 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/images/83da6741-8184-4eb0-a871-04737ab02803" status: 200 len: 1439 microversion: 2.1 time: 0.154245 Oct 27 03:26:59.583277 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 889/1761] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:26:59 2022] GET /compute/v2.1/images/83da6741-8184-4eb0-a871-04737ab02803 => generated 1439 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:26:59.616828 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-b40c8eed-0276-42db-995e-e30228ceb008 req-ed73a082-ae33-4bcc-b48a-77b588089cb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f", "name": "network-vif-unplugged", "status": "completed", "tag": "43cfec0a-97df-4480-8645-66f623cb4eaa"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:26:59.631131 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-18c3ae95-b65a-4d71-8213-f67b395315a5 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:59.653827 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-b40c8eed-0276-42db-995e-e30228ceb008 req-ed73a082-ae33-4bcc-b48a-77b588089cb1 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:59.657012 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-18c3ae95-b65a-4d71-8213-f67b395315a5 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:59.658511 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-18c3ae95-b65a-4d71-8213-f67b395315a5 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:26:59.664916 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-b40c8eed-0276-42db-995e-e30228ceb008 req-ed73a082-ae33-4bcc-b48a-77b588089cb1 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:59.664916 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-b40c8eed-0276-42db-995e-e30228ceb008 req-ed73a082-ae33-4bcc-b48a-77b588089cb1 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:59.679639 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-18c3ae95-b65a-4d71-8213-f67b395315a5 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f" status: 200 len: 1813 microversion: 2.25 time: 0.662574 Oct 27 03:26:59.684130 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 873/1762] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:26:59 2022] GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f => generated 1813 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:26:59.710786 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1dd90e43-fc40-4421-8aa9-a2f836fd3974 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:59.712261 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1dd90e43-fc40-4421-8aa9-a2f836fd3974 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] [instance: 4a09478e-ae93-4bf9-b270-95cd88d88476] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:26:59.718958 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-b40c8eed-0276-42db-995e-e30228ceb008 req-ed73a082-ae33-4bcc-b48a-77b588089cb1 service nova] Creating event network-vif-unplugged:43cfec0a-97df-4480-8645-66f623cb4eaa for instance 09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f on n-h1-862769-1 Oct 27 03:26:59.752916 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1dd90e43-fc40-4421-8aa9-a2f836fd3974 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:59.753966 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1dd90e43-fc40-4421-8aa9-a2f836fd3974 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:59.756026 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-b40c8eed-0276-42db-995e-e30228ceb008 req-ed73a082-ae33-4bcc-b48a-77b588089cb1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.143794 Oct 27 03:26:59.756821 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 890/1763] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:26:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:26:59.759002 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1dd90e43-fc40-4421-8aa9-a2f836fd3974 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:59.759890 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1dd90e43-fc40-4421-8aa9-a2f836fd3974 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:26:59.763383 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1dd90e43-fc40-4421-8aa9-a2f836fd3974 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:26:59.763938 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1dd90e43-fc40-4421-8aa9-a2f836fd3974 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:26:59.990399 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a27006b2-bb0a-4235-895d-51601b0ecab8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:26:59.993762 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a27006b2-bb0a-4235-895d-51601b0ecab8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: 543fdf60-10ec-4a25-a9d0-30c386efb104] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:00.006825 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a27006b2-bb0a-4235-895d-51601b0ecab8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:00.007607 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a27006b2-bb0a-4235-895d-51601b0ecab8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:00.008229 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a27006b2-bb0a-4235-895d-51601b0ecab8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:00.009197 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a27006b2-bb0a-4235-895d-51601b0ecab8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:00.013680 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a27006b2-bb0a-4235-895d-51601b0ecab8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:00.014378 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a27006b2-bb0a-4235-895d-51601b0ecab8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:00.688416 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1dd90e43-fc40-4421-8aa9-a2f836fd3974 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8640291c8745609faae41bdd731c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cee634bb1f4bb0a47f33a49f24ccdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:00.707248 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1dd90e43-fc40-4421-8aa9-a2f836fd3974 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] 10.222.0.20 "GET /compute/v2.1/servers/4a09478e-ae93-4bf9-b270-95cd88d88476" status: 200 len: 1324 microversion: 2.1 time: 1.012499 Oct 27 03:27:00.708038 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 874/1764] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:26:59 2022] GET /compute/v2.1/servers/4a09478e-ae93-4bf9-b270-95cd88d88476 => generated 1324 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:27:00.741823 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e6ebeffb-a408-4cdd-b017-49b7f2b65637 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:00.747579 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e6ebeffb-a408-4cdd-b017-49b7f2b65637 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] [instance: 1d9172bd-aa20-4f49-87fa-64300cf861be] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:00.763781 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e6ebeffb-a408-4cdd-b017-49b7f2b65637 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:00.767178 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e6ebeffb-a408-4cdd-b017-49b7f2b65637 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:00.767741 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e6ebeffb-a408-4cdd-b017-49b7f2b65637 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:00.768496 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e6ebeffb-a408-4cdd-b017-49b7f2b65637 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:00.769074 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e6ebeffb-a408-4cdd-b017-49b7f2b65637 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:00.769595 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e6ebeffb-a408-4cdd-b017-49b7f2b65637 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:00.843572 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e6ebeffb-a408-4cdd-b017-49b7f2b65637 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] 10.222.0.20 "GET /compute/v2.1/servers/1d9172bd-aa20-4f49-87fa-64300cf861be/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.118465 Oct 27 03:27:00.844217 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 875/1765] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 27 03:27:00 2022] GET /compute/v2.1/servers/1d9172bd-aa20-4f49-87fa-64300cf861be/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:27:00.853132 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-009eebb6-89e2-40b1-8e29-231d3ab1fd2d tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7dded43c10>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:00.948060 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-009eebb6-89e2-40b1-8e29-231d3ab1fd2d tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/images/83da6741-8184-4eb0-a871-04737ab02803" status: 200 len: 1439 microversion: 2.1 time: 0.100178 Oct 27 03:27:00.957753 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 876/1766] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:27:00 2022] GET /compute/v2.1/images/83da6741-8184-4eb0-a871-04737ab02803 => generated 1439 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:27:00.972421 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7a181607-fcf0-4623-93e9-94ee7b49a783 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:00.974943 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7a181607-fcf0-4623-93e9-94ee7b49a783 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:00.995087 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7a181607-fcf0-4623-93e9-94ee7b49a783 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:00.999313 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7a181607-fcf0-4623-93e9-94ee7b49a783 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:01.000241 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7a181607-fcf0-4623-93e9-94ee7b49a783 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:01.002336 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7a181607-fcf0-4623-93e9-94ee7b49a783 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:01.005508 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7a181607-fcf0-4623-93e9-94ee7b49a783 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:01.006140 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7a181607-fcf0-4623-93e9-94ee7b49a783 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:01.737285 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7a181607-fcf0-4623-93e9-94ee7b49a783 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:01.743101 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a27006b2-bb0a-4235-895d-51601b0ecab8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:01.754422 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7a181607-fcf0-4623-93e9-94ee7b49a783 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:01.756054 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7a181607-fcf0-4623-93e9-94ee7b49a783 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:01.758371 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a27006b2-bb0a-4235-895d-51601b0ecab8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104" status: 200 len: 1718 microversion: 2.1 time: 1.773033 Oct 27 03:27:01.759319 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 891/1767] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:26:59 2022] GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104 => generated 1718 bytes in 1775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:27:01.769746 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3126bb7e-ec68-4379-8494-295d583f0478 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:01.771702 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7a181607-fcf0-4623-93e9-94ee7b49a783 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f" status: 200 len: 1813 microversion: 2.25 time: 0.812543 Oct 27 03:27:01.772476 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 877/1768] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:27:00 2022] GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f => generated 1813 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:27:01.772733 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-3126bb7e-ec68-4379-8494-295d583f0478 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] [instance: 4a09478e-ae93-4bf9-b270-95cd88d88476] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:01.787515 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3126bb7e-ec68-4379-8494-295d583f0478 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:01.788987 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3126bb7e-ec68-4379-8494-295d583f0478 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:01.789630 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3126bb7e-ec68-4379-8494-295d583f0478 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:01.794384 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3126bb7e-ec68-4379-8494-295d583f0478 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:01.795130 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3126bb7e-ec68-4379-8494-295d583f0478 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:01.795813 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3126bb7e-ec68-4379-8494-295d583f0478 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:01.857764 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a7a2fa67-ca97-429c-baca-72f505ab44f9 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:01.860046 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a7a2fa67-ca97-429c-baca-72f505ab44f9 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] [instance: 1d9172bd-aa20-4f49-87fa-64300cf861be] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:01.877280 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a7a2fa67-ca97-429c-baca-72f505ab44f9 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:01.877781 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a7a2fa67-ca97-429c-baca-72f505ab44f9 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:01.878812 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a7a2fa67-ca97-429c-baca-72f505ab44f9 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:01.879550 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a7a2fa67-ca97-429c-baca-72f505ab44f9 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:01.889093 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a7a2fa67-ca97-429c-baca-72f505ab44f9 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:01.892061 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a7a2fa67-ca97-429c-baca-72f505ab44f9 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:02.008676 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a7a2fa67-ca97-429c-baca-72f505ab44f9 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] 10.222.0.20 "GET /compute/v2.1/servers/1d9172bd-aa20-4f49-87fa-64300cf861be/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.156153 Oct 27 03:27:02.014153 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 878/1769] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 27 03:27:01 2022] GET /compute/v2.1/servers/1d9172bd-aa20-4f49-87fa-64300cf861be/os-volume_attachments => generated 197 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:27:02.033382 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ef8130bc-9a55-4bb9-9343-96eb9dacf738 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7dda56e1f0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:02.132945 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ef8130bc-9a55-4bb9-9343-96eb9dacf738 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/images/83da6741-8184-4eb0-a871-04737ab02803" status: 200 len: 1439 microversion: 2.1 time: 0.116002 Oct 27 03:27:02.133860 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 879/1770] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:27:02 2022] GET /compute/v2.1/images/83da6741-8184-4eb0-a871-04737ab02803 => generated 1439 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:27:02.789505 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a284b562-c529-4d7a-ae6e-e263ddf4392c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:02.790628 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a284b562-c529-4d7a-ae6e-e263ddf4392c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: 543fdf60-10ec-4a25-a9d0-30c386efb104] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:02.795038 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-3126bb7e-ec68-4379-8494-295d583f0478 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8640291c8745609faae41bdd731c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cee634bb1f4bb0a47f33a49f24ccdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:02.814240 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a284b562-c529-4d7a-ae6e-e263ddf4392c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:02.818121 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3126bb7e-ec68-4379-8494-295d583f0478 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] 10.222.0.20 "GET /compute/v2.1/servers/4a09478e-ae93-4bf9-b270-95cd88d88476" status: 200 len: 1324 microversion: 2.1 time: 1.057139 Oct 27 03:27:02.824582 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 892/1771] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:27:01 2022] GET /compute/v2.1/servers/4a09478e-ae93-4bf9-b270-95cd88d88476 => generated 1324 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:27:02.838663 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a284b562-c529-4d7a-ae6e-e263ddf4392c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:02.841099 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a284b562-c529-4d7a-ae6e-e263ddf4392c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:02.853433 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a284b562-c529-4d7a-ae6e-e263ddf4392c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:02.855822 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-19aad47e-f157-4ef4-be88-f8b1b7eb8218 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:02.856620 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a284b562-c529-4d7a-ae6e-e263ddf4392c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:02.857271 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a284b562-c529-4d7a-ae6e-e263ddf4392c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:02.860154 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-19aad47e-f157-4ef4-be88-f8b1b7eb8218 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:02.895273 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-19aad47e-f157-4ef4-be88-f8b1b7eb8218 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:02.895880 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-19aad47e-f157-4ef4-be88-f8b1b7eb8218 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:02.896628 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-19aad47e-f157-4ef4-be88-f8b1b7eb8218 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:02.901346 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-19aad47e-f157-4ef4-be88-f8b1b7eb8218 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:02.902526 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-19aad47e-f157-4ef4-be88-f8b1b7eb8218 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:02.903150 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-19aad47e-f157-4ef4-be88-f8b1b7eb8218 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:03.691250 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-19aad47e-f157-4ef4-be88-f8b1b7eb8218 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:03.708486 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-19aad47e-f157-4ef4-be88-f8b1b7eb8218 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:03.710070 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-19aad47e-f157-4ef4-be88-f8b1b7eb8218 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:03.711297 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-19aad47e-f157-4ef4-be88-f8b1b7eb8218 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f" status: 200 len: 1813 microversion: 2.25 time: 0.881734 Oct 27 03:27:03.711869 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 893/1772] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:27:02 2022] GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f => generated 1813 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:27:03.743133 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-60cea053-70e5-4b32-93e2-a05e2464c721 req-61b9afcd-45d5-45fd-9754-05f1c39c3eb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f", "tag": "43cfec0a-97df-4480-8645-66f623cb4eaa"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:27:03.783426 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-60cea053-70e5-4b32-93e2-a05e2464c721 req-61b9afcd-45d5-45fd-9754-05f1c39c3eb3 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:03.785029 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-60cea053-70e5-4b32-93e2-a05e2464c721 req-61b9afcd-45d5-45fd-9754-05f1c39c3eb3 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:03.785029 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-60cea053-70e5-4b32-93e2-a05e2464c721 req-61b9afcd-45d5-45fd-9754-05f1c39c3eb3 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:03.846526 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-60cea053-70e5-4b32-93e2-a05e2464c721 req-61b9afcd-45d5-45fd-9754-05f1c39c3eb3 service nova] Creating event network-changed:43cfec0a-97df-4480-8645-66f623cb4eaa for instance 09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f on n-h1-862769-1 Oct 27 03:27:03.869506 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a284b562-c529-4d7a-ae6e-e263ddf4392c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:03.883935 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-60cea053-70e5-4b32-93e2-a05e2464c721 req-61b9afcd-45d5-45fd-9754-05f1c39c3eb3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.170802 Oct 27 03:27:03.884568 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 894/1773] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:27:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:27:03.890490 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a284b562-c529-4d7a-ae6e-e263ddf4392c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104" status: 200 len: 1718 microversion: 2.1 time: 1.104859 Oct 27 03:27:03.907292 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 880/1774] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:27:02 2022] GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104 => generated 1718 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:27:03.913971 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-642cf0e0-9821-4186-9aa0-baaa446dc907 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:03.927668 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1341313c-1aad-48d5-b65b-b7b637255765 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7ddec583a0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:03.929024 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-642cf0e0-9821-4186-9aa0-baaa446dc907 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] [instance: 1d9172bd-aa20-4f49-87fa-64300cf861be] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:03.984403 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-642cf0e0-9821-4186-9aa0-baaa446dc907 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:03.985077 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-642cf0e0-9821-4186-9aa0-baaa446dc907 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:03.992198 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-642cf0e0-9821-4186-9aa0-baaa446dc907 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:03.996356 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-642cf0e0-9821-4186-9aa0-baaa446dc907 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:04.002241 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-642cf0e0-9821-4186-9aa0-baaa446dc907 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:04.009300 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-642cf0e0-9821-4186-9aa0-baaa446dc907 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:04.065078 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1341313c-1aad-48d5-b65b-b7b637255765 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/images/83da6741-8184-4eb0-a871-04737ab02803" status: 200 len: 1439 microversion: 2.1 time: 0.156439 Oct 27 03:27:04.066901 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 881/1775] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:27:03 2022] GET /compute/v2.1/images/83da6741-8184-4eb0-a871-04737ab02803 => generated 1439 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:27:04.090224 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-16e4224c-2e95-48af-af8f-99f7a915f439 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:04.097836 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-16e4224c-2e95-48af-af8f-99f7a915f439 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] [instance: 4a09478e-ae93-4bf9-b270-95cd88d88476] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:04.121692 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-16e4224c-2e95-48af-af8f-99f7a915f439 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:04.122464 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-16e4224c-2e95-48af-af8f-99f7a915f439 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:04.125741 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-16e4224c-2e95-48af-af8f-99f7a915f439 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:04.126865 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-16e4224c-2e95-48af-af8f-99f7a915f439 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:04.128496 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-16e4224c-2e95-48af-af8f-99f7a915f439 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:04.130638 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-16e4224c-2e95-48af-af8f-99f7a915f439 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:04.161596 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-642cf0e0-9821-4186-9aa0-baaa446dc907 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] 10.222.0.20 "GET /compute/v2.1/servers/1d9172bd-aa20-4f49-87fa-64300cf861be/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.275625 Oct 27 03:27:04.162149 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 895/1776] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 27 03:27:03 2022] GET /compute/v2.1/servers/1d9172bd-aa20-4f49-87fa-64300cf861be/os-volume_attachments => generated 197 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:27:04.740956 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b0a766dd-176f-43f2-832f-7b4ae9644e51 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:04.742534 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b0a766dd-176f-43f2-832f-7b4ae9644e51 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:04.768502 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b0a766dd-176f-43f2-832f-7b4ae9644e51 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:04.769788 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b0a766dd-176f-43f2-832f-7b4ae9644e51 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:04.770506 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b0a766dd-176f-43f2-832f-7b4ae9644e51 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:04.771415 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b0a766dd-176f-43f2-832f-7b4ae9644e51 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:04.773445 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b0a766dd-176f-43f2-832f-7b4ae9644e51 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:04.774089 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b0a766dd-176f-43f2-832f-7b4ae9644e51 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:05.057499 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b0a766dd-176f-43f2-832f-7b4ae9644e51 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:05.071869 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b0a766dd-176f-43f2-832f-7b4ae9644e51 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:05.075431 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b0a766dd-176f-43f2-832f-7b4ae9644e51 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:05.078659 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b0a766dd-176f-43f2-832f-7b4ae9644e51 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f" status: 200 len: 1813 microversion: 2.25 time: 0.340781 Oct 27 03:27:05.083706 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 896/1777] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:27:04 2022] GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f => generated 1813 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:27:05.092223 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ea164f62-8136-4ecd-8e1c-2872b99517d7 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:05.093031 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ea164f62-8136-4ecd-8e1c-2872b99517d7 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: 543fdf60-10ec-4a25-a9d0-30c386efb104] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:05.106264 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ea164f62-8136-4ecd-8e1c-2872b99517d7 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:05.110675 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ea164f62-8136-4ecd-8e1c-2872b99517d7 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:05.111407 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ea164f62-8136-4ecd-8e1c-2872b99517d7 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:05.112521 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ea164f62-8136-4ecd-8e1c-2872b99517d7 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:05.114995 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ea164f62-8136-4ecd-8e1c-2872b99517d7 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:05.115623 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ea164f62-8136-4ecd-8e1c-2872b99517d7 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:05.519663 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ea164f62-8136-4ecd-8e1c-2872b99517d7 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:05.535197 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ea164f62-8136-4ecd-8e1c-2872b99517d7 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104" status: 200 len: 1718 microversion: 2.1 time: 0.450279 Oct 27 03:27:05.550503 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 897/1778] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:27:05 2022] GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104 => generated 1718 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:27:05.550503 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-88ffcee3-94cf-4d06-bedf-47c42c519328 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7ddec54ca0>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:05.624973 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-88ffcee3-94cf-4d06-bedf-47c42c519328 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/images/83da6741-8184-4eb0-a871-04737ab02803" status: 200 len: 1439 microversion: 2.1 time: 0.085428 Oct 27 03:27:05.634636 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 898/1779] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:27:05 2022] GET /compute/v2.1/images/83da6741-8184-4eb0-a871-04737ab02803 => generated 1439 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:27:05.640060 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5d3fad86-e816-474b-b132-3bb7bb72c9ff tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:05.649076 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5d3fad86-e816-474b-b132-3bb7bb72c9ff tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] [instance: 1d9172bd-aa20-4f49-87fa-64300cf861be] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:05.665183 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5d3fad86-e816-474b-b132-3bb7bb72c9ff tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:05.667052 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5d3fad86-e816-474b-b132-3bb7bb72c9ff tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:05.669868 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5d3fad86-e816-474b-b132-3bb7bb72c9ff tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:05.680710 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5d3fad86-e816-474b-b132-3bb7bb72c9ff tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:05.681278 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5d3fad86-e816-474b-b132-3bb7bb72c9ff tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:05.686336 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5d3fad86-e816-474b-b132-3bb7bb72c9ff tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:05.785533 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5d3fad86-e816-474b-b132-3bb7bb72c9ff tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] 10.222.0.20 "GET /compute/v2.1/servers/1d9172bd-aa20-4f49-87fa-64300cf861be/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.152889 Oct 27 03:27:05.786893 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 899/1780] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 27 03:27:05 2022] GET /compute/v2.1/servers/1d9172bd-aa20-4f49-87fa-64300cf861be/os-volume_attachments => generated 197 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:27:06.286761 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-16e4224c-2e95-48af-af8f-99f7a915f439 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8640291c8745609faae41bdd731c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cee634bb1f4bb0a47f33a49f24ccdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:06.318635 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-16e4224c-2e95-48af-af8f-99f7a915f439 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] 10.222.0.20 "GET /compute/v2.1/servers/4a09478e-ae93-4bf9-b270-95cd88d88476" status: 200 len: 1324 microversion: 2.1 time: 2.227613 Oct 27 03:27:06.318635 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 882/1781] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:27:04 2022] GET /compute/v2.1/servers/4a09478e-ae93-4bf9-b270-95cd88d88476 => generated 1324 bytes in 2245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:27:06.358269 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-824d83cf-d1b4-412a-8847-44b89f3e1341 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:06.360493 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-824d83cf-d1b4-412a-8847-44b89f3e1341 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:06.368062 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-824d83cf-d1b4-412a-8847-44b89f3e1341 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:06.370076 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-824d83cf-d1b4-412a-8847-44b89f3e1341 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:06.381287 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-824d83cf-d1b4-412a-8847-44b89f3e1341 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:06.382709 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-824d83cf-d1b4-412a-8847-44b89f3e1341 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:06.383599 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-824d83cf-d1b4-412a-8847-44b89f3e1341 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:06.384212 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-824d83cf-d1b4-412a-8847-44b89f3e1341 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:06.387024 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-302097bd-d4fd-4fc5-8dae-8f6c39431fed tempest-FloatingIPDetailsTestJSON-1423882136 tempest-FloatingIPDetailsTestJSON-1423882136-project] Action: 'create', calling method: .version_select at 0x7f7ddebf0700>, body: {"pool": null} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:27:07.071581 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-824d83cf-d1b4-412a-8847-44b89f3e1341 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:07.091904 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-824d83cf-d1b4-412a-8847-44b89f3e1341 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:07.093512 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-824d83cf-d1b4-412a-8847-44b89f3e1341 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:07.098719 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-824d83cf-d1b4-412a-8847-44b89f3e1341 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f" status: 200 len: 1813 microversion: 2.25 time: 0.777413 Oct 27 03:27:07.104184 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 883/1782] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:27:06 2022] GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f => generated 1813 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:27:07.116311 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-260a7def-a583-4da8-8fe9-62c7f053285c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:07.117027 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-260a7def-a583-4da8-8fe9-62c7f053285c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: 543fdf60-10ec-4a25-a9d0-30c386efb104] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:07.133405 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-260a7def-a583-4da8-8fe9-62c7f053285c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:07.138446 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-260a7def-a583-4da8-8fe9-62c7f053285c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:07.148463 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-260a7def-a583-4da8-8fe9-62c7f053285c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:07.148463 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-260a7def-a583-4da8-8fe9-62c7f053285c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:07.148463 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-260a7def-a583-4da8-8fe9-62c7f053285c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:07.148463 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-260a7def-a583-4da8-8fe9-62c7f053285c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:07.660893 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-260a7def-a583-4da8-8fe9-62c7f053285c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:07.677734 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-260a7def-a583-4da8-8fe9-62c7f053285c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104" status: 200 len: 1718 microversion: 2.1 time: 0.571317 Oct 27 03:27:07.683381 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 884/1783] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:27:07 2022] GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104 => generated 1718 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:27:07.686607 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-62a1cc6f-edcc-4e96-a6d9-500152698e93 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7dda598940>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:07.780958 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-62a1cc6f-edcc-4e96-a6d9-500152698e93 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/images/83da6741-8184-4eb0-a871-04737ab02803" status: 200 len: 1439 microversion: 2.1 time: 0.099401 Oct 27 03:27:07.781744 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 885/1784] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:27:07 2022] GET /compute/v2.1/images/83da6741-8184-4eb0-a871-04737ab02803 => generated 1439 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:27:07.801421 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2dac7240-6496-4013-905b-c83d1999c4d1 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:07.802399 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2dac7240-6496-4013-905b-c83d1999c4d1 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] [instance: 1d9172bd-aa20-4f49-87fa-64300cf861be] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:07.820693 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2dac7240-6496-4013-905b-c83d1999c4d1 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:07.822129 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2dac7240-6496-4013-905b-c83d1999c4d1 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:07.824310 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2dac7240-6496-4013-905b-c83d1999c4d1 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:07.825624 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2dac7240-6496-4013-905b-c83d1999c4d1 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:07.827723 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2dac7240-6496-4013-905b-c83d1999c4d1 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:07.829366 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2dac7240-6496-4013-905b-c83d1999c4d1 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:07.872346 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2dac7240-6496-4013-905b-c83d1999c4d1 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] 10.222.0.20 "GET /compute/v2.1/servers/1d9172bd-aa20-4f49-87fa-64300cf861be/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088657 Oct 27 03:27:07.875460 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 886/1785] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 27 03:27:07 2022] GET /compute/v2.1/servers/1d9172bd-aa20-4f49-87fa-64300cf861be/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:27:07.879735 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f2fdef9c-c4b1-457f-8752-63f50c601858 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:07.880565 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f2fdef9c-c4b1-457f-8752-63f50c601858 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] [instance: 4a09478e-ae93-4bf9-b270-95cd88d88476] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:07.897830 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f2fdef9c-c4b1-457f-8752-63f50c601858 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:07.898395 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f2fdef9c-c4b1-457f-8752-63f50c601858 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:07.898845 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f2fdef9c-c4b1-457f-8752-63f50c601858 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:07.899602 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f2fdef9c-c4b1-457f-8752-63f50c601858 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:07.900061 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f2fdef9c-c4b1-457f-8752-63f50c601858 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:07.900499 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f2fdef9c-c4b1-457f-8752-63f50c601858 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:08.264203 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f2fdef9c-c4b1-457f-8752-63f50c601858 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8640291c8745609faae41bdd731c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cee634bb1f4bb0a47f33a49f24ccdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:08.272987 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f2fdef9c-c4b1-457f-8752-63f50c601858 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] 10.222.0.20 "GET /compute/v2.1/servers/4a09478e-ae93-4bf9-b270-95cd88d88476" status: 200 len: 1324 microversion: 2.1 time: 0.398355 Oct 27 03:27:08.277912 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 887/1786] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:27:07 2022] GET /compute/v2.1/servers/4a09478e-ae93-4bf9-b270-95cd88d88476 => generated 1324 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:27:08.289976 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f0bba3a5-f288-4800-88fa-9f4251c6175c tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:08.305954 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f0bba3a5-f288-4800-88fa-9f4251c6175c tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:08.318701 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f0bba3a5-f288-4800-88fa-9f4251c6175c tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:08.326199 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f0bba3a5-f288-4800-88fa-9f4251c6175c tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:08.326823 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f0bba3a5-f288-4800-88fa-9f4251c6175c tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:08.327702 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f0bba3a5-f288-4800-88fa-9f4251c6175c tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:08.331801 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f0bba3a5-f288-4800-88fa-9f4251c6175c tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:08.332362 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f0bba3a5-f288-4800-88fa-9f4251c6175c tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:08.939551 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f0bba3a5-f288-4800-88fa-9f4251c6175c tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:08.961968 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f0bba3a5-f288-4800-88fa-9f4251c6175c tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:08.983336 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f0bba3a5-f288-4800-88fa-9f4251c6175c tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:08.993558 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f0bba3a5-f288-4800-88fa-9f4251c6175c tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f" status: 200 len: 1813 microversion: 2.25 time: 0.713756 Oct 27 03:27:08.994597 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 888/1787] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:27:08 2022] GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f => generated 1813 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:27:09.019698 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ec833ec9-18b1-453f-ac33-59960af775cc tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:09.032064 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ec833ec9-18b1-453f-ac33-59960af775cc tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: 543fdf60-10ec-4a25-a9d0-30c386efb104] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:09.044072 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ec833ec9-18b1-453f-ac33-59960af775cc tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:09.045268 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ec833ec9-18b1-453f-ac33-59960af775cc tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:09.045888 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ec833ec9-18b1-453f-ac33-59960af775cc tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:09.047159 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ec833ec9-18b1-453f-ac33-59960af775cc tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:09.047856 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ec833ec9-18b1-453f-ac33-59960af775cc tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:09.048448 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ec833ec9-18b1-453f-ac33-59960af775cc tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:10.024248 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ec833ec9-18b1-453f-ac33-59960af775cc tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:10.035644 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ec833ec9-18b1-453f-ac33-59960af775cc tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104" status: 200 len: 1708 microversion: 2.1 time: 1.020334 Oct 27 03:27:10.040261 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 889/1788] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:27:08 2022] GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104 => generated 1708 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:27:10.055622 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f04453f4-f933-4296-8cd3-faa309ddc7b4 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7dda5b2790>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:10.144928 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f04453f4-f933-4296-8cd3-faa309ddc7b4 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/images/83da6741-8184-4eb0-a871-04737ab02803" status: 200 len: 1439 microversion: 2.1 time: 0.103177 Oct 27 03:27:10.146662 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 890/1789] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:27:10 2022] GET /compute/v2.1/images/83da6741-8184-4eb0-a871-04737ab02803 => generated 1439 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:27:10.164851 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-81c5564f-bf4b-4c33-bbb6-ac8daf7613aa tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:10.168790 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-81c5564f-bf4b-4c33-bbb6-ac8daf7613aa tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] [instance: 1d9172bd-aa20-4f49-87fa-64300cf861be] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:10.206925 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-81c5564f-bf4b-4c33-bbb6-ac8daf7613aa tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:10.210417 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-81c5564f-bf4b-4c33-bbb6-ac8daf7613aa tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:10.238898 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-81c5564f-bf4b-4c33-bbb6-ac8daf7613aa tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:10.240520 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-81c5564f-bf4b-4c33-bbb6-ac8daf7613aa tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:10.241228 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-81c5564f-bf4b-4c33-bbb6-ac8daf7613aa tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:10.241887 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-81c5564f-bf4b-4c33-bbb6-ac8daf7613aa tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:10.306909 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-81c5564f-bf4b-4c33-bbb6-ac8daf7613aa tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] 10.222.0.20 "GET /compute/v2.1/servers/1d9172bd-aa20-4f49-87fa-64300cf861be/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.158300 Oct 27 03:27:10.313406 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 891/1790] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 27 03:27:10 2022] GET /compute/v2.1/servers/1d9172bd-aa20-4f49-87fa-64300cf861be/os-volume_attachments => generated 25 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 03:27:10.328912 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9761bf46-ad1e-4577-969e-1ed89b5364a5 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:10.328912 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-9761bf46-ad1e-4577-969e-1ed89b5364a5 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] [instance: 4a09478e-ae93-4bf9-b270-95cd88d88476] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:10.348688 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9761bf46-ad1e-4577-969e-1ed89b5364a5 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:10.349300 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9761bf46-ad1e-4577-969e-1ed89b5364a5 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:10.349849 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9761bf46-ad1e-4577-969e-1ed89b5364a5 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:10.350706 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9761bf46-ad1e-4577-969e-1ed89b5364a5 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:10.351425 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9761bf46-ad1e-4577-969e-1ed89b5364a5 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:10.352079 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9761bf46-ad1e-4577-969e-1ed89b5364a5 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:10.383935 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:27:10.830360 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-302097bd-d4fd-4fc5-8dae-8f6c39431fed tempest-FloatingIPDetailsTestJSON-1423882136 tempest-FloatingIPDetailsTestJSON-1423882136-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.813770 Oct 27 03:27:10.841345 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 900/1791] 10.222.0.20 () {60 vars in 1170 bytes} [Thu Oct 27 03:27:06 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4825 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:27:10.851836 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-7d14fa16-83cc-4cfe-85d4-0c14c2ac7cf6 req-65c6cc54-3a1f-44e8-963b-4f7335995b24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a09478e-ae93-4bf9-b270-95cd88d88476", "name": "network-vif-plugged", "status": "completed", "tag": "b7642b15-cece-4456-a1d2-fefef01ecb62"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:27:10.866603 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-7d14fa16-83cc-4cfe-85d4-0c14c2ac7cf6 req-65c6cc54-3a1f-44e8-963b-4f7335995b24 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:10.867346 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-7d14fa16-83cc-4cfe-85d4-0c14c2ac7cf6 req-65c6cc54-3a1f-44e8-963b-4f7335995b24 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:10.867931 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-7d14fa16-83cc-4cfe-85d4-0c14c2ac7cf6 req-65c6cc54-3a1f-44e8-963b-4f7335995b24 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:10.883364 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-7d14fa16-83cc-4cfe-85d4-0c14c2ac7cf6 req-65c6cc54-3a1f-44e8-963b-4f7335995b24 service nova] Creating event network-vif-plugged:b7642b15-cece-4456-a1d2-fefef01ecb62 for instance 4a09478e-ae93-4bf9-b270-95cd88d88476 on n-h1-862769-1 Oct 27 03:27:10.889527 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-7d14fa16-83cc-4cfe-85d4-0c14c2ac7cf6 req-65c6cc54-3a1f-44e8-963b-4f7335995b24 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046767 Oct 27 03:27:10.894841 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 901/1792] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:27:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:27:10.901156 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ba1894e2-17be-490f-9b09-2d123074f162 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:10.901936 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ba1894e2-17be-490f-9b09-2d123074f162 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:10.910186 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ba1894e2-17be-490f-9b09-2d123074f162 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:10.910755 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ba1894e2-17be-490f-9b09-2d123074f162 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:10.911262 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ba1894e2-17be-490f-9b09-2d123074f162 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:10.912050 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ba1894e2-17be-490f-9b09-2d123074f162 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:10.912635 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ba1894e2-17be-490f-9b09-2d123074f162 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:10.913525 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ba1894e2-17be-490f-9b09-2d123074f162 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:10.936698 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=100 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:27:11.132827 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9761bf46-ad1e-4577-969e-1ed89b5364a5 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8640291c8745609faae41bdd731c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cee634bb1f4bb0a47f33a49f24ccdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:11.158244 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9761bf46-ad1e-4577-969e-1ed89b5364a5 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] 10.222.0.20 "GET /compute/v2.1/servers/4a09478e-ae93-4bf9-b270-95cd88d88476" status: 200 len: 1324 microversion: 2.1 time: 0.843447 Oct 27 03:27:11.159961 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 892/1793] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:27:10 2022] GET /compute/v2.1/servers/4a09478e-ae93-4bf9-b270-95cd88d88476 => generated 1324 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:27:11.166102 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-85f93e22-30aa-417f-a719-f43d1e1315cf tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Calling method '.version_select at 0x7f7ddac489d0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:11.170527 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-85f93e22-30aa-417f-a719-f43d1e1315cf tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:11.171439 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-85f93e22-30aa-417f-a719-f43d1e1315cf tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:11.172030 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-85f93e22-30aa-417f-a719-f43d1e1315cf tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:11.185633 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-85f93e22-30aa-417f-a719-f43d1e1315cf tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 2319 microversion: 2.1 time: 0.024393 Oct 27 03:27:11.187296 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 893/1794] 10.222.0.20 () {58 vars in 1143 bytes} [Thu Oct 27 03:27:11 2022] GET /compute/v2.1/os-migrations => generated 2319 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:27:11.193182 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5e5c4161-4925-4c85-9b21-32022502197c tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-78661421", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": [{"uuid": "7314d059-3fb1-4d01-906a-7ea3e40ff99a"}]}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:27:11.288280 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ba1894e2-17be-490f-9b09-2d123074f162 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:11.304113 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ba1894e2-17be-490f-9b09-2d123074f162 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:11.305869 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ba1894e2-17be-490f-9b09-2d123074f162 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:11.306805 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.network.neutron [None req-5e5c4161-4925-4c85-9b21-32022502197c tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] validate_networks() for [('7314d059-3fb1-4d01-906a-7ea3e40ff99a', None, None, None, None, None)] {{(pid=121001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:27:11.308210 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ba1894e2-17be-490f-9b09-2d123074f162 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f" status: 200 len: 1813 microversion: 2.25 time: 0.412012 Oct 27 03:27:11.323212 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 902/1795] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:27:10 2022] GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f => generated 1813 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:27:11.344724 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0e216f59-83e1-49e9-8f27-eec692b8a1c9 tempest-FloatingIPDetailsTestJSON-1423882136 tempest-FloatingIPDetailsTestJSON-1423882136-project] Action: 'create', calling method: .version_select at 0x7f7ddec7cdc0>, body: {"pool": null} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:27:12.809478 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-5e5c4161-4925-4c85-9b21-32022502197c tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Flavor limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:27:12.809960 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-5e5c4161-4925-4c85-9b21-32022502197c tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Image limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:27:12.812806 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-5e5c4161-4925-4c85-9b21-32022502197c tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Flavor pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:27:12.813418 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-5e5c4161-4925-4c85-9b21-32022502197c tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Image pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:27:12.814017 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-5e5c4161-4925-4c85-9b21-32022502197c tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:27:12.846389 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5e5c4161-4925-4c85-9b21-32022502197c tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:12.846947 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5e5c4161-4925-4c85-9b21-32022502197c tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:12.847905 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5e5c4161-4925-4c85-9b21-32022502197c tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:12.848656 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5e5c4161-4925-4c85-9b21-32022502197c tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:12.849120 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5e5c4161-4925-4c85-9b21-32022502197c tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:12.849567 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5e5c4161-4925-4c85-9b21-32022502197c tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:12.906314 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-5e5c4161-4925-4c85-9b21-32022502197c tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Getting quotas for project 59c57f8e9a0e4debae18d98918ba8c2f. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:27:12.914214 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-5e5c4161-4925-4c85-9b21-32022502197c tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Getting quotas for user c65ddc0af5854d7a89192d01bc5f4576 and project 59c57f8e9a0e4debae18d98918ba8c2f. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:27:12.953555 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5e5c4161-4925-4c85-9b21-32022502197c tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Going to run 1 instances... {{(pid=121001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:27:12.956874 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5e5c4161-4925-4c85-9b21-32022502197c tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] [instance: 135280a2-409f-4a5f-bf27-b5afe5f7694f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:27:13.075344 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5e5c4161-4925-4c85-9b21-32022502197c tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.886779 Oct 27 03:27:13.083396 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 894/1796] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:27:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1891 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 03:27:13.095537 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-70e829d1-9284-4d78-ae22-869d7af0de82 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7ddec3fee0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:13.150422 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-70e829d1-9284-4d78-ae22-869d7af0de82 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/images/83da6741-8184-4eb0-a871-04737ab02803" status: 200 len: 1448 microversion: 2.1 time: 0.068833 Oct 27 03:27:13.161007 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 895/1797] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:27:13 2022] GET /compute/v2.1/images/83da6741-8184-4eb0-a871-04737ab02803 => generated 1448 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:27:13.161007 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6470cb9e-8c04-4ed0-8b81-af53fed1f95a tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:13.161007 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-6470cb9e-8c04-4ed0-8b81-af53fed1f95a tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] [instance: 543fdf60-10ec-4a25-a9d0-30c386efb104] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:13.169229 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6470cb9e-8c04-4ed0-8b81-af53fed1f95a tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:13.170331 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6470cb9e-8c04-4ed0-8b81-af53fed1f95a tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:13.171140 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6470cb9e-8c04-4ed0-8b81-af53fed1f95a tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:13.172104 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6470cb9e-8c04-4ed0-8b81-af53fed1f95a tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:13.173055 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6470cb9e-8c04-4ed0-8b81-af53fed1f95a tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:13.173907 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6470cb9e-8c04-4ed0-8b81-af53fed1f95a tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:13.497818 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6470cb9e-8c04-4ed0-8b81-af53fed1f95a tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104" status: 200 len: 1859 microversion: 2.1 time: 0.344486 Oct 27 03:27:13.498449 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 896/1798] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:27:13 2022] GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104 => generated 1859 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:27:13.507525 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e07586e2-9370-4edf-964c-3a9681f8f75c tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:13.508343 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e07586e2-9370-4edf-964c-3a9681f8f75c tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] [instance: 4a09478e-ae93-4bf9-b270-95cd88d88476] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:13.522730 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e07586e2-9370-4edf-964c-3a9681f8f75c tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:13.524192 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e07586e2-9370-4edf-964c-3a9681f8f75c tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:13.526201 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e07586e2-9370-4edf-964c-3a9681f8f75c tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:13.527129 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e07586e2-9370-4edf-964c-3a9681f8f75c tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:13.527866 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e07586e2-9370-4edf-964c-3a9681f8f75c tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:13.528297 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e07586e2-9370-4edf-964c-3a9681f8f75c tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:13.810616 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e07586e2-9370-4edf-964c-3a9681f8f75c tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8640291c8745609faae41bdd731c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cee634bb1f4bb0a47f33a49f24ccdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:13.827289 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e07586e2-9370-4edf-964c-3a9681f8f75c tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] 10.222.0.20 "GET /compute/v2.1/servers/4a09478e-ae93-4bf9-b270-95cd88d88476" status: 200 len: 1520 microversion: 2.1 time: 0.326440 Oct 27 03:27:13.829236 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 897/1799] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:27:13 2022] GET /compute/v2.1/servers/4a09478e-ae93-4bf9-b270-95cd88d88476 => generated 1520 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:27:13.836782 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6e6b564f-5171-4527-94d3-2faf996d2db9 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:13.838547 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-6e6b564f-5171-4527-94d3-2faf996d2db9 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:13.849334 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6e6b564f-5171-4527-94d3-2faf996d2db9 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:13.851366 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6e6b564f-5171-4527-94d3-2faf996d2db9 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:13.853548 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6e6b564f-5171-4527-94d3-2faf996d2db9 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:13.855208 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6e6b564f-5171-4527-94d3-2faf996d2db9 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:13.856086 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6e6b564f-5171-4527-94d3-2faf996d2db9 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:13.858024 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6e6b564f-5171-4527-94d3-2faf996d2db9 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:14.099313 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6e6b564f-5171-4527-94d3-2faf996d2db9 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:14.109276 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6e6b564f-5171-4527-94d3-2faf996d2db9 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:14.110825 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6e6b564f-5171-4527-94d3-2faf996d2db9 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:14.112424 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6e6b564f-5171-4527-94d3-2faf996d2db9 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f" status: 200 len: 1813 microversion: 2.25 time: 0.281542 Oct 27 03:27:14.114507 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 898/1800] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:27:13 2022] GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f => generated 1813 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:27:14.119608 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d5774576-509e-4a92-9cb8-f2527ac7046d tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:14.120476 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d5774576-509e-4a92-9cb8-f2527ac7046d tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] [instance: 135280a2-409f-4a5f-bf27-b5afe5f7694f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:14.214908 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d5774576-509e-4a92-9cb8-f2527ac7046d tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c65ddc0af5854d7a89192d01bc5f4576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c57f8e9a0e4debae18d98918ba8c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:14.227510 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d5774576-509e-4a92-9cb8-f2527ac7046d tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] 10.222.0.20 "GET /compute/v2.1/servers/135280a2-409f-4a5f-bf27-b5afe5f7694f" status: 200 len: 1216 microversion: 2.1 time: 0.111404 Oct 27 03:27:14.245708 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 899/1801] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:27:14 2022] GET /compute/v2.1/servers/135280a2-409f-4a5f-bf27-b5afe5f7694f => generated 1216 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:27:14.255107 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2d82b0a0-3644-48af-b112-4087c454fccd tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7dda5989d0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:14.318732 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2d82b0a0-3644-48af-b112-4087c454fccd tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/images/83da6741-8184-4eb0-a871-04737ab02803" status: 200 len: 1448 microversion: 2.1 time: 0.071735 Oct 27 03:27:14.320584 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 900/1802] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:27:14 2022] GET /compute/v2.1/images/83da6741-8184-4eb0-a871-04737ab02803 => generated 1448 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:27:14.327889 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-da985f9a-7f49-40b0-8343-7f55fb532d11 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:14.339011 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-da985f9a-7f49-40b0-8343-7f55fb532d11 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] [instance: 543fdf60-10ec-4a25-a9d0-30c386efb104] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:14.346530 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-da985f9a-7f49-40b0-8343-7f55fb532d11 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:14.347600 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-da985f9a-7f49-40b0-8343-7f55fb532d11 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:14.350189 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-da985f9a-7f49-40b0-8343-7f55fb532d11 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:14.351179 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-da985f9a-7f49-40b0-8343-7f55fb532d11 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:14.351658 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-da985f9a-7f49-40b0-8343-7f55fb532d11 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:14.352092 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-da985f9a-7f49-40b0-8343-7f55fb532d11 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:14.605179 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-da985f9a-7f49-40b0-8343-7f55fb532d11 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104" status: 200 len: 1859 microversion: 2.1 time: 0.283308 Oct 27 03:27:14.610463 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 901/1803] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:27:14 2022] GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104 => generated 1859 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:27:14.612631 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-921db3be-0fc8-4866-a843-70449480b8b7 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Action: 'create', calling method: .version_select at 0x7f7ddac9dd30>, body: {"pool": null} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:27:16.069469 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0e216f59-83e1-49e9-8f27-eec692b8a1c9 tempest-FloatingIPDetailsTestJSON-1423882136 tempest-FloatingIPDetailsTestJSON-1423882136-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.744472 Oct 27 03:27:16.070472 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 903/1804] 10.222.0.20 () {60 vars in 1170 bytes} [Thu Oct 27 03:27:11 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4746 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:27:16.074796 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d274a85b-e4fc-4948-90f4-7b52337fc0f1 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7ddec559d0>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:16.733116 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-921db3be-0fc8-4866-a843-70449480b8b7 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.124760 Oct 27 03:27:16.734349 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 902/1805] 10.222.0.20 () {60 vars in 1170 bytes} [Thu Oct 27 03:27:14 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:27:16.744906 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ec5a3714-4e98-4bfa-9013-823bfaa9cf96 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:16.751789 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ec5a3714-4e98-4bfa-9013-823bfaa9cf96 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: 543fdf60-10ec-4a25-a9d0-30c386efb104] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:16.796254 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ec5a3714-4e98-4bfa-9013-823bfaa9cf96 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:16.798599 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ec5a3714-4e98-4bfa-9013-823bfaa9cf96 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:16.799086 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ec5a3714-4e98-4bfa-9013-823bfaa9cf96 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:16.801191 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ec5a3714-4e98-4bfa-9013-823bfaa9cf96 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:16.801727 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ec5a3714-4e98-4bfa-9013-823bfaa9cf96 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:16.802137 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ec5a3714-4e98-4bfa-9013-823bfaa9cf96 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:17.023210 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-ec5a3714-4e98-4bfa-9013-823bfaa9cf96 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lazy-loading 'services' on Instance uuid 543fdf60-10ec-4a25-a9d0-30c386efb104 {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:27:17.306783 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ec5a3714-4e98-4bfa-9013-823bfaa9cf96 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "DELETE /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104/os-volume_attachments/e37d34d7-aaba-47fa-810a-75cd1c95b517" status: 202 len: 0 microversion: 2.1 time: 0.570360 Oct 27 03:27:17.307294 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 903/1806] 10.222.0.20 () {58 vars in 1416 bytes} [Thu Oct 27 03:27:16 2022] DELETE /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104/os-volume_attachments/e37d34d7-aaba-47fa-810a-75cd1c95b517 => generated 0 bytes in 572 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:27:17.325344 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1c0afb31-d148-4378-9b6e-646f7b42d046 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:17.335421 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1c0afb31-d148-4378-9b6e-646f7b42d046 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:17.342185 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1c0afb31-d148-4378-9b6e-646f7b42d046 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:17.342987 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1c0afb31-d148-4378-9b6e-646f7b42d046 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:17.343598 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1c0afb31-d148-4378-9b6e-646f7b42d046 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:17.344592 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1c0afb31-d148-4378-9b6e-646f7b42d046 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:17.348875 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1c0afb31-d148-4378-9b6e-646f7b42d046 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:17.349619 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1c0afb31-d148-4378-9b6e-646f7b42d046 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:17.538769 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d274a85b-e4fc-4948-90f4-7b52337fc0f1 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "DELETE /compute/v2.1/images/83da6741-8184-4eb0-a871-04737ab02803" status: 204 len: 0 microversion: 2.1 time: 1.467557 Oct 27 03:27:17.550787 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 904/1807] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:27:16 2022] DELETE /compute/v2.1/images/83da6741-8184-4eb0-a871-04737ab02803 => generated 0 bytes in 1477 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:27:17.553237 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-35a9962d-f8d3-4e5b-9a32-f72ca12519cc tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:17.553892 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-35a9962d-f8d3-4e5b-9a32-f72ca12519cc tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] [instance: 135280a2-409f-4a5f-bf27-b5afe5f7694f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:17.568246 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-35a9962d-f8d3-4e5b-9a32-f72ca12519cc tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:17.569434 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-35a9962d-f8d3-4e5b-9a32-f72ca12519cc tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:17.570203 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-35a9962d-f8d3-4e5b-9a32-f72ca12519cc tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:17.572772 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-35a9962d-f8d3-4e5b-9a32-f72ca12519cc tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:17.573642 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-35a9962d-f8d3-4e5b-9a32-f72ca12519cc tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:17.574298 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-35a9962d-f8d3-4e5b-9a32-f72ca12519cc tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:17.693711 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1c0afb31-d148-4378-9b6e-646f7b42d046 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:17.705866 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1c0afb31-d148-4378-9b6e-646f7b42d046 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:17.708336 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1c0afb31-d148-4378-9b6e-646f7b42d046 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:17.709774 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1c0afb31-d148-4378-9b6e-646f7b42d046 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f" status: 200 len: 1813 microversion: 2.25 time: 0.401180 Oct 27 03:27:17.727458 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 904/1808] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:27:17 2022] GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f => generated 1813 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:27:17.743949 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c20ab0ba-9fe0-4240-a272-e57483d3e94b tempest-FloatingIPDetailsTestJSON-1423882136 tempest-FloatingIPDetailsTestJSON-1423882136-project] Action: 'create', calling method: .version_select at 0x7f7dda56ed30>, body: {"pool": null} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:27:17.749619 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-35a9962d-f8d3-4e5b-9a32-f72ca12519cc tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c65ddc0af5854d7a89192d01bc5f4576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c57f8e9a0e4debae18d98918ba8c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:17.761039 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-35a9962d-f8d3-4e5b-9a32-f72ca12519cc tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] 10.222.0.20 "GET /compute/v2.1/servers/135280a2-409f-4a5f-bf27-b5afe5f7694f" status: 200 len: 1274 microversion: 2.1 time: 0.212298 Oct 27 03:27:17.774138 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 905/1809] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:27:17 2022] GET /compute/v2.1/servers/135280a2-409f-4a5f-bf27-b5afe5f7694f => generated 1274 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:27:17.774138 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-fe614ffc-7012-46bb-80ad-0376f425a4a2 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-2140649092", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": [{"uuid": "81b040e4-6976-445b-88ab-1bc0d779ceb2"}]}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:27:17.836390 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-fe614ffc-7012-46bb-80ad-0376f425a4a2 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] validate_networks() for [('81b040e4-6976-445b-88ab-1bc0d779ceb2', None, None, None, None, None)] {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:27:19.787032 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-fe614ffc-7012-46bb-80ad-0376f425a4a2 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:27:19.789067 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-fe614ffc-7012-46bb-80ad-0376f425a4a2 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:27:19.790564 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-fe614ffc-7012-46bb-80ad-0376f425a4a2 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:27:19.791327 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-fe614ffc-7012-46bb-80ad-0376f425a4a2 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:27:19.791912 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-fe614ffc-7012-46bb-80ad-0376f425a4a2 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:27:19.833443 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fe614ffc-7012-46bb-80ad-0376f425a4a2 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:19.835457 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fe614ffc-7012-46bb-80ad-0376f425a4a2 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:19.836212 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fe614ffc-7012-46bb-80ad-0376f425a4a2 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:19.841747 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fe614ffc-7012-46bb-80ad-0376f425a4a2 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:19.842596 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fe614ffc-7012-46bb-80ad-0376f425a4a2 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:19.845569 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fe614ffc-7012-46bb-80ad-0376f425a4a2 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:19.924552 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-fe614ffc-7012-46bb-80ad-0376f425a4a2 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Getting quotas for project f1cee634bb1f4bb0a47f33a49f24ccdf. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:27:19.935058 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-fe614ffc-7012-46bb-80ad-0376f425a4a2 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Getting quotas for user 8e8640291c8745609faae41bdd731c17 and project f1cee634bb1f4bb0a47f33a49f24ccdf. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:27:19.971800 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-fe614ffc-7012-46bb-80ad-0376f425a4a2 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:27:19.974220 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-fe614ffc-7012-46bb-80ad-0376f425a4a2 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] [instance: 80bb98d2-3a48-40cd-85e4-ee8dfacbbadd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:27:20.199509 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-fe614ffc-7012-46bb-80ad-0376f425a4a2 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.435084 Oct 27 03:27:20.200242 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 906/1810] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:27:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 2436 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 03:27:20.228831 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c95c09d6-fbb1-4cbd-97af-2aa097e1399e tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:20.235864 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c95c09d6-fbb1-4cbd-97af-2aa097e1399e tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: 543fdf60-10ec-4a25-a9d0-30c386efb104] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:20.243589 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c95c09d6-fbb1-4cbd-97af-2aa097e1399e tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:20.247593 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c95c09d6-fbb1-4cbd-97af-2aa097e1399e tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:20.247593 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c95c09d6-fbb1-4cbd-97af-2aa097e1399e tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:20.247593 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c95c09d6-fbb1-4cbd-97af-2aa097e1399e tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:20.247593 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c95c09d6-fbb1-4cbd-97af-2aa097e1399e tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:20.247978 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c95c09d6-fbb1-4cbd-97af-2aa097e1399e tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:20.337813 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c95c09d6-fbb1-4cbd-97af-2aa097e1399e tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.133580 Oct 27 03:27:20.348074 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 907/1811] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 27 03:27:20 2022] GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104/os-volume_attachments => generated 197 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:27:20.359703 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4114ed0e-5a43-428a-95e4-4ae8f3e97da7 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:20.362099 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4114ed0e-5a43-428a-95e4-4ae8f3e97da7 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 2be00171-65ea-411a-b2d8-86b4e42d5de9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:20.375290 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4114ed0e-5a43-428a-95e4-4ae8f3e97da7 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:20.375932 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4114ed0e-5a43-428a-95e4-4ae8f3e97da7 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:20.376485 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4114ed0e-5a43-428a-95e4-4ae8f3e97da7 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:20.377396 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4114ed0e-5a43-428a-95e4-4ae8f3e97da7 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:20.379744 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4114ed0e-5a43-428a-95e4-4ae8f3e97da7 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:20.380592 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4114ed0e-5a43-428a-95e4-4ae8f3e97da7 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:20.437415 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4114ed0e-5a43-428a-95e4-4ae8f3e97da7 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 2be00171-65ea-411a-b2d8-86b4e42d5de9] Going to try to terminate instance {{(pid=121000) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:27:20.866555 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4114ed0e-5a43-428a-95e4-4ae8f3e97da7 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2be00171-65ea-411a-b2d8-86b4e42d5de9" status: 204 len: 0 microversion: 2.1 time: 0.521766 Oct 27 03:27:20.868248 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 908/1812] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:27:20 2022] DELETE /compute/v2.1/servers/2be00171-65ea-411a-b2d8-86b4e42d5de9 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:27:20.873827 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-6a04889d-820f-44ad-9254-95082823043c req-de23141b-9751-442c-a277-76ef5e3e8709 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2be00171-65ea-411a-b2d8-86b4e42d5de9", "name": "network-vif-unplugged", "status": "completed", "tag": "eb76ab11-86f3-4dc6-8ddf-18ea2272de05"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:27:20.911593 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-6a04889d-820f-44ad-9254-95082823043c req-de23141b-9751-442c-a277-76ef5e3e8709 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:20.915097 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-6a04889d-820f-44ad-9254-95082823043c req-de23141b-9751-442c-a277-76ef5e3e8709 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:20.918214 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-6a04889d-820f-44ad-9254-95082823043c req-de23141b-9751-442c-a277-76ef5e3e8709 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:20.946598 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-6a04889d-820f-44ad-9254-95082823043c req-de23141b-9751-442c-a277-76ef5e3e8709 service nova] Creating event network-vif-unplugged:eb76ab11-86f3-4dc6-8ddf-18ea2272de05 for instance 2be00171-65ea-411a-b2d8-86b4e42d5de9 on n-h2-862769-1 Oct 27 03:27:20.961537 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-6a04889d-820f-44ad-9254-95082823043c req-de23141b-9751-442c-a277-76ef5e3e8709 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.091681 Oct 27 03:27:20.965768 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 909/1813] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:27:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:27:20.983946 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-31136d63-1ae2-4db9-8cfe-c17030c28e0f tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:20.984869 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-31136d63-1ae2-4db9-8cfe-c17030c28e0f tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:21.006003 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-31136d63-1ae2-4db9-8cfe-c17030c28e0f tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:21.007788 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-31136d63-1ae2-4db9-8cfe-c17030c28e0f tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:21.009571 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-31136d63-1ae2-4db9-8cfe-c17030c28e0f tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:21.010637 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-31136d63-1ae2-4db9-8cfe-c17030c28e0f tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:21.011349 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-31136d63-1ae2-4db9-8cfe-c17030c28e0f tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:21.012529 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-31136d63-1ae2-4db9-8cfe-c17030c28e0f tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:21.390273 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c20ab0ba-9fe0-4240-a272-e57483d3e94b tempest-FloatingIPDetailsTestJSON-1423882136 tempest-FloatingIPDetailsTestJSON-1423882136-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.661175 Oct 27 03:27:21.391636 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 905/1814] 10.222.0.20 () {60 vars in 1170 bytes} [Thu Oct 27 03:27:17 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3664 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:27:21.404801 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b0d43906-51ce-4148-b4e3-eeb28d766974 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:21.405702 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b0d43906-51ce-4148-b4e3-eeb28d766974 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] [instance: 135280a2-409f-4a5f-bf27-b5afe5f7694f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:21.431947 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b0d43906-51ce-4148-b4e3-eeb28d766974 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:21.432705 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b0d43906-51ce-4148-b4e3-eeb28d766974 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:21.437662 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b0d43906-51ce-4148-b4e3-eeb28d766974 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:21.440474 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b0d43906-51ce-4148-b4e3-eeb28d766974 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:21.441335 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b0d43906-51ce-4148-b4e3-eeb28d766974 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:21.447112 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b0d43906-51ce-4148-b4e3-eeb28d766974 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:21.496188 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-31136d63-1ae2-4db9-8cfe-c17030c28e0f tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:21.517702 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-31136d63-1ae2-4db9-8cfe-c17030c28e0f tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:21.529182 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-31136d63-1ae2-4db9-8cfe-c17030c28e0f tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:21.548348 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-31136d63-1ae2-4db9-8cfe-c17030c28e0f tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f" status: 200 len: 1803 microversion: 2.25 time: 0.566252 Oct 27 03:27:21.549035 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 910/1815] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:27:20 2022] GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f => generated 1803 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:27:21.565500 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5a136b5d-751a-4e1c-a5d8-86745a2ff206 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:21.567277 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5a136b5d-751a-4e1c-a5d8-86745a2ff206 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] [instance: 80bb98d2-3a48-40cd-85e4-ee8dfacbbadd] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:21.678888 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5a136b5d-751a-4e1c-a5d8-86745a2ff206 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8640291c8745609faae41bdd731c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cee634bb1f4bb0a47f33a49f24ccdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:21.688760 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5a136b5d-751a-4e1c-a5d8-86745a2ff206 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] 10.222.0.20 "GET /compute/v2.1/servers/80bb98d2-3a48-40cd-85e4-ee8dfacbbadd" status: 200 len: 1224 microversion: 2.1 time: 0.136528 Oct 27 03:27:21.691724 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 911/1816] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:27:21 2022] GET /compute/v2.1/servers/80bb98d2-3a48-40cd-85e4-ee8dfacbbadd => generated 1224 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:27:21.702803 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-62a54964-abd6-44c4-9fa7-9e0c121ef567 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-591544023", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": [{"uuid": "a487df35-1b16-4301-a7dc-3642f0ac024b"}]}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:27:21.729654 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b0d43906-51ce-4148-b4e3-eeb28d766974 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c65ddc0af5854d7a89192d01bc5f4576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c57f8e9a0e4debae18d98918ba8c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:21.744689 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b0d43906-51ce-4148-b4e3-eeb28d766974 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] 10.222.0.20 "GET /compute/v2.1/servers/135280a2-409f-4a5f-bf27-b5afe5f7694f" status: 200 len: 1316 microversion: 2.1 time: 0.348016 Oct 27 03:27:21.749199 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 906/1817] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:27:21 2022] GET /compute/v2.1/servers/135280a2-409f-4a5f-bf27-b5afe5f7694f => generated 1316 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:27:21.763403 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d3776373-a484-405a-96e4-bbaf6632f786 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:21.765086 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d3776373-a484-405a-96e4-bbaf6632f786 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: 543fdf60-10ec-4a25-a9d0-30c386efb104] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:21.771971 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d3776373-a484-405a-96e4-bbaf6632f786 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:21.778134 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d3776373-a484-405a-96e4-bbaf6632f786 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:21.778134 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d3776373-a484-405a-96e4-bbaf6632f786 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:21.778134 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d3776373-a484-405a-96e4-bbaf6632f786 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:21.778134 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d3776373-a484-405a-96e4-bbaf6632f786 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:21.778506 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d3776373-a484-405a-96e4-bbaf6632f786 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:21.797343 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-62a54964-abd6-44c4-9fa7-9e0c121ef567 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] validate_networks() for [('a487df35-1b16-4301-a7dc-3642f0ac024b', None, None, None, None, None)] {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:27:21.839919 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d3776373-a484-405a-96e4-bbaf6632f786 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091378 Oct 27 03:27:21.840514 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 907/1818] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 27 03:27:21 2022] GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:27:21.957780 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2d50d845-e539-4f84-901c-084ff93a454f tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Action: 'create', calling method: .version_select at 0x7f7ddec6bb80>, body: {"keypair": {"name": "tempest-keypair-1265828847", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEODTi2n89tTC6m8KHxGpUDjaxBs3I8/gN67oVD0N2n4Q4PDMBpon2+sGIerMem9YSXz7atemtpTDXeTxZ0YgfZSqxlqQ+ZWv0RmbZNmRTYiQMEM36QrUAXFpKuNbRo1Ew=="}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:27:21.974524 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-2d50d845-e539-4f84-901c-084ff93a454f tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Getting quotas for project c3fc032a089f45efa4a66866a9c961c9. Resources: {'key_pairs'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:27:21.980309 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-2d50d845-e539-4f84-901c-084ff93a454f tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Getting quotas for user 17b2717ace074a579d33c60964e6668a and project c3fc032a089f45efa4a66866a9c961c9. Resources: {'key_pairs'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:27:22.062920 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2d50d845-e539-4f84-901c-084ff93a454f tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.219639 Oct 27 03:27:22.063498 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 908/1819] 10.222.0.20 () {60 vars in 1159 bytes} [Thu Oct 27 03:27:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:27:22.068926 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-de1b4077-e0b9-436f-a589-ee0846f9f21d tempest-FloatingIPDetailsTestJSON-1423882136 tempest-FloatingIPDetailsTestJSON-1423882136-project] Action: 'create', calling method: .version_select at 0x7f7dda590940>, body: {"pool": null} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:27:22.357575 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-62a54964-abd6-44c4-9fa7-9e0c121ef567 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:27:22.359956 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-62a54964-abd6-44c4-9fa7-9e0c121ef567 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:27:22.361375 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-62a54964-abd6-44c4-9fa7-9e0c121ef567 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:27:22.364707 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-62a54964-abd6-44c4-9fa7-9e0c121ef567 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:27:22.368231 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-62a54964-abd6-44c4-9fa7-9e0c121ef567 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:27:22.381576 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-62a54964-abd6-44c4-9fa7-9e0c121ef567 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:22.382926 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-62a54964-abd6-44c4-9fa7-9e0c121ef567 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:22.382926 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-62a54964-abd6-44c4-9fa7-9e0c121ef567 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:22.384108 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-62a54964-abd6-44c4-9fa7-9e0c121ef567 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:22.384760 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-62a54964-abd6-44c4-9fa7-9e0c121ef567 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:22.385491 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-62a54964-abd6-44c4-9fa7-9e0c121ef567 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:22.407080 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-62a54964-abd6-44c4-9fa7-9e0c121ef567 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Getting quotas for project ae78c307a1504172828e668f915a3677. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:27:22.414544 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-62a54964-abd6-44c4-9fa7-9e0c121ef567 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Getting quotas for user 1d6175f2ac39494f8cba3db225150d6c and project ae78c307a1504172828e668f915a3677. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:27:22.432721 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-62a54964-abd6-44c4-9fa7-9e0c121ef567 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:27:22.436604 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-62a54964-abd6-44c4-9fa7-9e0c121ef567 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 49f0475c-d9eb-4ad0-9f88-322521def6c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:27:22.588879 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-62a54964-abd6-44c4-9fa7-9e0c121ef567 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.895994 Oct 27 03:27:22.603285 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 912/1820] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:27:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 912 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 03:27:22.608315 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3696afe5-ed70-4932-80b9-4081a5bf0b19 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Calling method '.version_select at 0x7f7ddec38f70>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:22.612635 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3696afe5-ed70-4932-80b9-4081a5bf0b19 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:22.613340 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3696afe5-ed70-4932-80b9-4081a5bf0b19 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:22.613957 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3696afe5-ed70-4932-80b9-4081a5bf0b19 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:22.633649 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3696afe5-ed70-4932-80b9-4081a5bf0b19 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 2537 microversion: 2.25 time: 0.028927 Oct 27 03:27:22.647770 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 913/1821] 10.222.0.20 () {60 vars in 1184 bytes} [Thu Oct 27 03:27:22 2022] GET /compute/v2.1/os-migrations => generated 2537 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:27:22.653052 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-4269529d-c58e-4e0c-aca7-e5f6dd90b122 req-afa9ddaa-fd63-4375-9b23-e7dc9acab9cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "135280a2-409f-4a5f-bf27-b5afe5f7694f", "tag": "e44acda3-786a-423e-9885-daa65c21586b"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:27:22.677254 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-4269529d-c58e-4e0c-aca7-e5f6dd90b122 req-afa9ddaa-fd63-4375-9b23-e7dc9acab9cd service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:22.679349 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-4269529d-c58e-4e0c-aca7-e5f6dd90b122 req-afa9ddaa-fd63-4375-9b23-e7dc9acab9cd service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:22.680375 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-4269529d-c58e-4e0c-aca7-e5f6dd90b122 req-afa9ddaa-fd63-4375-9b23-e7dc9acab9cd service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:22.715618 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-4269529d-c58e-4e0c-aca7-e5f6dd90b122 req-afa9ddaa-fd63-4375-9b23-e7dc9acab9cd service nova] Creating event network-changed:e44acda3-786a-423e-9885-daa65c21586b for instance 135280a2-409f-4a5f-bf27-b5afe5f7694f on n-h2-862769-1 Oct 27 03:27:22.727407 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-4269529d-c58e-4e0c-aca7-e5f6dd90b122 req-afa9ddaa-fd63-4375-9b23-e7dc9acab9cd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078210 Oct 27 03:27:22.730509 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 914/1822] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:27:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:27:22.745600 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-95924dfe-4d3a-4284-9393-254c6e2f3794 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:22.746985 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-95924dfe-4d3a-4284-9393-254c6e2f3794 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 49f0475c-d9eb-4ad0-9f88-322521def6c7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:22.893637 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:27:23.151978 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-95924dfe-4d3a-4284-9393-254c6e2f3794 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:23.161778 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-95924dfe-4d3a-4284-9393-254c6e2f3794 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/49f0475c-d9eb-4ad0-9f88-322521def6c7" status: 200 len: 1207 microversion: 2.1 time: 0.429766 Oct 27 03:27:23.164532 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 915/1823] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:27:22 2022] GET /compute/v2.1/servers/49f0475c-d9eb-4ad0-9f88-322521def6c7 => generated 1207 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:27:23.176662 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0797bc7e-da01-4029-baec-c38e306b28bb tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:23.181134 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0797bc7e-da01-4029-baec-c38e306b28bb tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] [instance: 09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:23.196057 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0797bc7e-da01-4029-baec-c38e306b28bb tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:23.201138 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0797bc7e-da01-4029-baec-c38e306b28bb tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:23.202223 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0797bc7e-da01-4029-baec-c38e306b28bb tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:23.205826 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0797bc7e-da01-4029-baec-c38e306b28bb tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:23.207449 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0797bc7e-da01-4029-baec-c38e306b28bb tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:23.210611 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0797bc7e-da01-4029-baec-c38e306b28bb tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:23.623142 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-0797bc7e-da01-4029-baec-c38e306b28bb tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lazy-loading 'services' on Instance uuid 09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:27:23.657966 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0797bc7e-da01-4029-baec-c38e306b28bb tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f" status: 200 len: 2421 microversion: 2.25 time: 0.492091 Oct 27 03:27:23.658603 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 916/1824] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:27:23 2022] GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f => generated 2421 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:27:23.676175 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7151349a-c33b-4041-aab6-3f7c7639f81b tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:23.679505 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7151349a-c33b-4041-aab6-3f7c7639f81b tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] [instance: 80bb98d2-3a48-40cd-85e4-ee8dfacbbadd] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:23.699176 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7151349a-c33b-4041-aab6-3f7c7639f81b tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:23.699679 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7151349a-c33b-4041-aab6-3f7c7639f81b tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:23.700126 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7151349a-c33b-4041-aab6-3f7c7639f81b tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:23.700894 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7151349a-c33b-4041-aab6-3f7c7639f81b tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:23.701541 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7151349a-c33b-4041-aab6-3f7c7639f81b tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:23.702179 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7151349a-c33b-4041-aab6-3f7c7639f81b tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:23.905948 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7151349a-c33b-4041-aab6-3f7c7639f81b tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8640291c8745609faae41bdd731c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cee634bb1f4bb0a47f33a49f24ccdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:23.916190 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7151349a-c33b-4041-aab6-3f7c7639f81b tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] 10.222.0.20 "GET /compute/v2.1/servers/80bb98d2-3a48-40cd-85e4-ee8dfacbbadd" status: 200 len: 1276 microversion: 2.1 time: 0.251518 Oct 27 03:27:23.922794 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 917/1825] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:27:23 2022] GET /compute/v2.1/servers/80bb98d2-3a48-40cd-85e4-ee8dfacbbadd => generated 1276 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:27:23.941036 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0eac9651-bed0-4432-b372-9c400f678580 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:23.943671 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0eac9651-bed0-4432-b372-9c400f678580 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] [instance: 135280a2-409f-4a5f-bf27-b5afe5f7694f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:23.954994 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0eac9651-bed0-4432-b372-9c400f678580 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:23.955879 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0eac9651-bed0-4432-b372-9c400f678580 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:23.957122 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0eac9651-bed0-4432-b372-9c400f678580 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:23.959614 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0eac9651-bed0-4432-b372-9c400f678580 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:23.960320 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0eac9651-bed0-4432-b372-9c400f678580 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:23.963146 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0eac9651-bed0-4432-b372-9c400f678580 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:24.400645 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0eac9651-bed0-4432-b372-9c400f678580 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c65ddc0af5854d7a89192d01bc5f4576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c57f8e9a0e4debae18d98918ba8c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:24.410485 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0eac9651-bed0-4432-b372-9c400f678580 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] 10.222.0.20 "GET /compute/v2.1/servers/135280a2-409f-4a5f-bf27-b5afe5f7694f" status: 200 len: 1316 microversion: 2.1 time: 0.478458 Oct 27 03:27:24.417019 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 918/1826] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:27:23 2022] GET /compute/v2.1/servers/135280a2-409f-4a5f-bf27-b5afe5f7694f => generated 1316 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:27:24.422768 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-404359ac-626e-4170-b57e-344932152ae0 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:24.432893 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-404359ac-626e-4170-b57e-344932152ae0 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: 543fdf60-10ec-4a25-a9d0-30c386efb104] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:24.437898 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:27:24.444234 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-404359ac-626e-4170-b57e-344932152ae0 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:24.444968 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-404359ac-626e-4170-b57e-344932152ae0 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:24.445533 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-404359ac-626e-4170-b57e-344932152ae0 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:24.446662 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-404359ac-626e-4170-b57e-344932152ae0 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:24.453132 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-404359ac-626e-4170-b57e-344932152ae0 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:24.453132 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-404359ac-626e-4170-b57e-344932152ae0 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:24.551618 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-404359ac-626e-4170-b57e-344932152ae0 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.132152 Oct 27 03:27:24.553119 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 919/1827] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 27 03:27:24 2022] GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104/os-volume_attachments => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:27:24.598491 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ea88dd5d-58d1-4ec1-a036-9d64d956ea78 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:24.607487 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ea88dd5d-58d1-4ec1-a036-9d64d956ea78 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] [instance: 09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:24.630629 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ea88dd5d-58d1-4ec1-a036-9d64d956ea78 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:24.630629 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ea88dd5d-58d1-4ec1-a036-9d64d956ea78 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:24.630629 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ea88dd5d-58d1-4ec1-a036-9d64d956ea78 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:24.630629 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ea88dd5d-58d1-4ec1-a036-9d64d956ea78 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:24.632422 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ea88dd5d-58d1-4ec1-a036-9d64d956ea78 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:24.632422 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ea88dd5d-58d1-4ec1-a036-9d64d956ea78 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:24.926248 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-ea88dd5d-58d1-4ec1-a036-9d64d956ea78 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lazy-loading 'services' on Instance uuid 09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:27:24.953036 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ea88dd5d-58d1-4ec1-a036-9d64d956ea78 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f" status: 200 len: 2421 microversion: 2.25 time: 0.397013 Oct 27 03:27:24.978001 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 920/1828] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:27:24 2022] GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f => generated 2421 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:27:24.988547 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f7290fbd-3a2b-452c-bd63-a636589f3584 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:24.988547 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f7290fbd-3a2b-452c-bd63-a636589f3584 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 49f0475c-d9eb-4ad0-9f88-322521def6c7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:24.995290 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f7290fbd-3a2b-452c-bd63-a636589f3584 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:24.996679 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f7290fbd-3a2b-452c-bd63-a636589f3584 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:24.997532 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f7290fbd-3a2b-452c-bd63-a636589f3584 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:25.002148 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f7290fbd-3a2b-452c-bd63-a636589f3584 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:25.002860 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f7290fbd-3a2b-452c-bd63-a636589f3584 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:25.003469 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f7290fbd-3a2b-452c-bd63-a636589f3584 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:25.122574 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f7290fbd-3a2b-452c-bd63-a636589f3584 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:25.145663 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f7290fbd-3a2b-452c-bd63-a636589f3584 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/49f0475c-d9eb-4ad0-9f88-322521def6c7" status: 200 len: 1259 microversion: 2.1 time: 0.165888 Oct 27 03:27:25.148000 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 921/1829] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:27:24 2022] GET /compute/v2.1/servers/49f0475c-d9eb-4ad0-9f88-322521def6c7 => generated 1259 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:27:25.169931 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-dc472981-eb8d-4f2e-b751-919d108575b3 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:25.170598 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-dc472981-eb8d-4f2e-b751-919d108575b3 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] [instance: 80bb98d2-3a48-40cd-85e4-ee8dfacbbadd] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:25.199281 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dc472981-eb8d-4f2e-b751-919d108575b3 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:25.200089 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dc472981-eb8d-4f2e-b751-919d108575b3 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:25.200539 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dc472981-eb8d-4f2e-b751-919d108575b3 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:25.201285 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dc472981-eb8d-4f2e-b751-919d108575b3 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:25.201748 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dc472981-eb8d-4f2e-b751-919d108575b3 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:25.202410 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dc472981-eb8d-4f2e-b751-919d108575b3 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:25.437129 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-dc472981-eb8d-4f2e-b751-919d108575b3 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8640291c8745609faae41bdd731c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cee634bb1f4bb0a47f33a49f24ccdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:25.453313 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-dc472981-eb8d-4f2e-b751-919d108575b3 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] 10.222.0.20 "GET /compute/v2.1/servers/80bb98d2-3a48-40cd-85e4-ee8dfacbbadd" status: 200 len: 1282 microversion: 2.1 time: 0.292725 Oct 27 03:27:25.468294 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 922/1830] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:27:25 2022] GET /compute/v2.1/servers/80bb98d2-3a48-40cd-85e4-ee8dfacbbadd => generated 1282 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:27:25.481535 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-e76f1c90-f5ba-4c9b-82be-7c82388d81de req-63023e4a-8875-452a-af45-916a901410bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2be00171-65ea-411a-b2d8-86b4e42d5de9", "name": "network-vif-deleted", "tag": "eb76ab11-86f3-4dc6-8ddf-18ea2272de05"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:27:25.491605 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-e76f1c90-f5ba-4c9b-82be-7c82388d81de req-63023e4a-8875-452a-af45-916a901410bd service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:25.492346 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-e76f1c90-f5ba-4c9b-82be-7c82388d81de req-63023e4a-8875-452a-af45-916a901410bd service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:25.493134 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-e76f1c90-f5ba-4c9b-82be-7c82388d81de req-63023e4a-8875-452a-af45-916a901410bd service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:25.525008 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-e76f1c90-f5ba-4c9b-82be-7c82388d81de req-63023e4a-8875-452a-af45-916a901410bd service nova] Creating event network-vif-deleted:eb76ab11-86f3-4dc6-8ddf-18ea2272de05 for instance 2be00171-65ea-411a-b2d8-86b4e42d5de9 on n-h2-862769-1 Oct 27 03:27:25.538555 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-e76f1c90-f5ba-4c9b-82be-7c82388d81de req-63023e4a-8875-452a-af45-916a901410bd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063082 Oct 27 03:27:25.541115 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 923/1831] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:27:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:27:25.553747 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6d75ad83-1771-4e94-bc93-015773f6f353 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:25.554602 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6d75ad83-1771-4e94-bc93-015773f6f353 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:25.586691 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6d75ad83-1771-4e94-bc93-015773f6f353 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:25.586691 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6d75ad83-1771-4e94-bc93-015773f6f353 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:25.586691 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6d75ad83-1771-4e94-bc93-015773f6f353 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:25.586691 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6d75ad83-1771-4e94-bc93-015773f6f353 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:25.587119 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6d75ad83-1771-4e94-bc93-015773f6f353 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:25.587958 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6d75ad83-1771-4e94-bc93-015773f6f353 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:25.841288 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:27:25.850597 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-6d75ad83-1771-4e94-bc93-015773f6f353 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lazy-loading 'services' on Instance uuid 09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:27:26.101212 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-de1b4077-e0b9-436f-a589-ee0846f9f21d tempest-FloatingIPDetailsTestJSON-1423882136 tempest-FloatingIPDetailsTestJSON-1423882136-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.036603 Oct 27 03:27:26.108055 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 909/1832] 10.222.0.20 () {60 vars in 1170 bytes} [Thu Oct 27 03:27:22 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4044 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:27:26.114261 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e3aacc12-11de-4f34-8a52-c88564736786 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:26.114931 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e3aacc12-11de-4f34-8a52-c88564736786 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] [instance: 135280a2-409f-4a5f-bf27-b5afe5f7694f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:26.116895 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=4 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:27:26.150575 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e3aacc12-11de-4f34-8a52-c88564736786 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:26.151091 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e3aacc12-11de-4f34-8a52-c88564736786 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:26.152045 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e3aacc12-11de-4f34-8a52-c88564736786 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:26.153313 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e3aacc12-11de-4f34-8a52-c88564736786 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:26.153996 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e3aacc12-11de-4f34-8a52-c88564736786 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:26.154818 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e3aacc12-11de-4f34-8a52-c88564736786 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:26.237599 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6d75ad83-1771-4e94-bc93-015773f6f353 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "DELETE /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f/os-volume_attachments/701ae3a1-1805-43cd-a306-92c9067ce78e" status: 202 len: 0 microversion: 2.25 time: 0.692486 Oct 27 03:27:26.239047 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 924/1833] 10.222.0.20 () {60 vars in 1457 bytes} [Thu Oct 27 03:27:25 2022] DELETE /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f/os-volume_attachments/701ae3a1-1805-43cd-a306-92c9067ce78e => generated 0 bytes in 697 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:27:26.253895 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d1bf51fe-7aac-4faa-ab1c-b9ffdc8643e9 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:26.258445 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d1bf51fe-7aac-4faa-ab1c-b9ffdc8643e9 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: 543fdf60-10ec-4a25-a9d0-30c386efb104] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:26.265808 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d1bf51fe-7aac-4faa-ab1c-b9ffdc8643e9 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:26.267000 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d1bf51fe-7aac-4faa-ab1c-b9ffdc8643e9 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:26.270655 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d1bf51fe-7aac-4faa-ab1c-b9ffdc8643e9 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:26.270655 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d1bf51fe-7aac-4faa-ab1c-b9ffdc8643e9 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:26.270655 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d1bf51fe-7aac-4faa-ab1c-b9ffdc8643e9 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:26.270655 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d1bf51fe-7aac-4faa-ab1c-b9ffdc8643e9 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:26.343602 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d1bf51fe-7aac-4faa-ab1c-b9ffdc8643e9 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.097912 Oct 27 03:27:26.345457 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 925/1834] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 27 03:27:26 2022] GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104/os-volume_attachments => generated 25 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 03:27:26.353942 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-babea573-80ab-4f5c-92a7-eaacb3a46bec tempest-FloatingIPDetailsTestJSON-1423882136 tempest-FloatingIPDetailsTestJSON-1423882136-project] Calling method '.version_select at 0x7f7ddecae310>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:26.682930 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e3aacc12-11de-4f34-8a52-c88564736786 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c65ddc0af5854d7a89192d01bc5f4576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c57f8e9a0e4debae18d98918ba8c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:26.698525 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e3aacc12-11de-4f34-8a52-c88564736786 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] 10.222.0.20 "GET /compute/v2.1/servers/135280a2-409f-4a5f-bf27-b5afe5f7694f" status: 200 len: 1316 microversion: 2.1 time: 0.583883 Oct 27 03:27:26.699077 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 910/1835] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:27:26 2022] GET /compute/v2.1/servers/135280a2-409f-4a5f-bf27-b5afe5f7694f => generated 1316 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:27:26.705641 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4910eef2-13e8-44b5-b595-bde247833bff tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:26.705917 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4910eef2-13e8-44b5-b595-bde247833bff tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 49f0475c-d9eb-4ad0-9f88-322521def6c7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:26.712608 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4910eef2-13e8-44b5-b595-bde247833bff tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:26.713135 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4910eef2-13e8-44b5-b595-bde247833bff tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:26.716782 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4910eef2-13e8-44b5-b595-bde247833bff tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:26.718646 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4910eef2-13e8-44b5-b595-bde247833bff tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:26.719143 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4910eef2-13e8-44b5-b595-bde247833bff tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:26.719644 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4910eef2-13e8-44b5-b595-bde247833bff tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:26.898217 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-babea573-80ab-4f5c-92a7-eaacb3a46bec tempest-FloatingIPDetailsTestJSON-1423882136 tempest-FloatingIPDetailsTestJSON-1423882136-project] 10.222.0.20 "GET /compute/v2.1/os-floating-ips/8271c3e6-2b08-4c4c-b5fd-56bd32f0d0b1" status: 200 len: 141 microversion: 2.1 time: 0.551099 Oct 27 03:27:26.908033 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 926/1836] 10.222.0.20 () {58 vars in 1260 bytes} [Thu Oct 27 03:27:26 2022] GET /compute/v2.1/os-floating-ips/8271c3e6-2b08-4c4c-b5fd-56bd32f0d0b1 => generated 141 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:27:26.908033 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-06b14159-a4f4-49e7-a5e2-6673cc94b5dd tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:26.915435 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-06b14159-a4f4-49e7-a5e2-6673cc94b5dd tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:26.926869 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-06b14159-a4f4-49e7-a5e2-6673cc94b5dd tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:26.931566 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-06b14159-a4f4-49e7-a5e2-6673cc94b5dd tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:26.932076 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-06b14159-a4f4-49e7-a5e2-6673cc94b5dd tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:26.936955 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-06b14159-a4f4-49e7-a5e2-6673cc94b5dd tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:26.937485 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-06b14159-a4f4-49e7-a5e2-6673cc94b5dd tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:26.937935 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-06b14159-a4f4-49e7-a5e2-6673cc94b5dd tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:26.968356 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4910eef2-13e8-44b5-b595-bde247833bff tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:26.981871 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4910eef2-13e8-44b5-b595-bde247833bff tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/49f0475c-d9eb-4ad0-9f88-322521def6c7" status: 200 len: 1277 microversion: 2.1 time: 0.281683 Oct 27 03:27:27.002135 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 911/1837] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:27:26 2022] GET /compute/v2.1/servers/49f0475c-d9eb-4ad0-9f88-322521def6c7 => generated 1277 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:27:27.015053 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0bd628d3-fe5f-4c38-8e05-7936cbd56a33 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:27.018473 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0bd628d3-fe5f-4c38-8e05-7936cbd56a33 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] [instance: 80bb98d2-3a48-40cd-85e4-ee8dfacbbadd] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:27.026345 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-06b14159-a4f4-49e7-a5e2-6673cc94b5dd tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.126117 Oct 27 03:27:27.032358 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0bd628d3-fe5f-4c38-8e05-7936cbd56a33 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:27.040564 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0bd628d3-fe5f-4c38-8e05-7936cbd56a33 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:27.040564 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0bd628d3-fe5f-4c38-8e05-7936cbd56a33 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:27.040564 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0bd628d3-fe5f-4c38-8e05-7936cbd56a33 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:27.040564 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0bd628d3-fe5f-4c38-8e05-7936cbd56a33 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:27.041270 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0bd628d3-fe5f-4c38-8e05-7936cbd56a33 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:27.052319 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 927/1838] 10.222.0.20 () {60 vars in 1343 bytes} [Thu Oct 27 03:27:26 2022] GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f/os-volume_attachments => generated 197 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 03:27:27.061400 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b8ab29de-091e-4746-b541-acb28871ed5f tempest-FloatingIPDetailsTestJSON-1423882136 tempest-FloatingIPDetailsTestJSON-1423882136-project] Calling method '.version_select at 0x7f7ddaac5f70>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:27.498849 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0bd628d3-fe5f-4c38-8e05-7936cbd56a33 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8640291c8745609faae41bdd731c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cee634bb1f4bb0a47f33a49f24ccdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:27.516249 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0bd628d3-fe5f-4c38-8e05-7936cbd56a33 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] 10.222.0.20 "GET /compute/v2.1/servers/80bb98d2-3a48-40cd-85e4-ee8dfacbbadd" status: 200 len: 1324 microversion: 2.1 time: 0.512891 Oct 27 03:27:27.531267 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 912/1839] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:27:27 2022] GET /compute/v2.1/servers/80bb98d2-3a48-40cd-85e4-ee8dfacbbadd => generated 1324 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:27:27.725262 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1cd403de-57a0-45fd-9c07-12a5e572e1e1 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:27.725891 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1cd403de-57a0-45fd-9c07-12a5e572e1e1 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] [instance: 135280a2-409f-4a5f-bf27-b5afe5f7694f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:27.743643 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1cd403de-57a0-45fd-9c07-12a5e572e1e1 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:27.744153 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1cd403de-57a0-45fd-9c07-12a5e572e1e1 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:27.746840 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1cd403de-57a0-45fd-9c07-12a5e572e1e1 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:27.751121 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1cd403de-57a0-45fd-9c07-12a5e572e1e1 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:27.751716 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1cd403de-57a0-45fd-9c07-12a5e572e1e1 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:27.752180 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1cd403de-57a0-45fd-9c07-12a5e572e1e1 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:28.805052 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1cd403de-57a0-45fd-9c07-12a5e572e1e1 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c65ddc0af5854d7a89192d01bc5f4576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c57f8e9a0e4debae18d98918ba8c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:28.822253 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1cd403de-57a0-45fd-9c07-12a5e572e1e1 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] 10.222.0.20 "GET /compute/v2.1/servers/135280a2-409f-4a5f-bf27-b5afe5f7694f" status: 200 len: 1316 microversion: 2.1 time: 1.101421 Oct 27 03:27:28.841276 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 913/1840] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:27:27 2022] GET /compute/v2.1/servers/135280a2-409f-4a5f-bf27-b5afe5f7694f => generated 1316 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:27:28.841276 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-671ab7a9-34e4-45cb-9611-0ff6c00c0cfd tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:28.841276 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-671ab7a9-34e4-45cb-9611-0ff6c00c0cfd tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 49f0475c-d9eb-4ad0-9f88-322521def6c7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:28.841709 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-671ab7a9-34e4-45cb-9611-0ff6c00c0cfd tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:28.851411 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-671ab7a9-34e4-45cb-9611-0ff6c00c0cfd tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:28.851411 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-671ab7a9-34e4-45cb-9611-0ff6c00c0cfd tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:28.852291 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-671ab7a9-34e4-45cb-9611-0ff6c00c0cfd tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:28.853245 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-671ab7a9-34e4-45cb-9611-0ff6c00c0cfd tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:28.857068 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-671ab7a9-34e4-45cb-9611-0ff6c00c0cfd tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:29.267889 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-671ab7a9-34e4-45cb-9611-0ff6c00c0cfd tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:29.269415 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-671ab7a9-34e4-45cb-9611-0ff6c00c0cfd tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/49f0475c-d9eb-4ad0-9f88-322521def6c7" status: 200 len: 1307 microversion: 2.1 time: 0.439979 Oct 27 03:27:29.270563 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 914/1841] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:27:28 2022] GET /compute/v2.1/servers/49f0475c-d9eb-4ad0-9f88-322521def6c7 => generated 1307 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:27:29.275882 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5771d6a4-eb1e-48d2-abe4-8a3904a9c580 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:29.278639 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5771d6a4-eb1e-48d2-abe4-8a3904a9c580 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:29.287531 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5771d6a4-eb1e-48d2-abe4-8a3904a9c580 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:29.288307 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5771d6a4-eb1e-48d2-abe4-8a3904a9c580 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:29.288939 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5771d6a4-eb1e-48d2-abe4-8a3904a9c580 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:29.289844 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5771d6a4-eb1e-48d2-abe4-8a3904a9c580 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:29.290551 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5771d6a4-eb1e-48d2-abe4-8a3904a9c580 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:29.291174 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5771d6a4-eb1e-48d2-abe4-8a3904a9c580 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:29.330580 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5771d6a4-eb1e-48d2-abe4-8a3904a9c580 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.058589 Oct 27 03:27:29.332301 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 915/1842] 10.222.0.20 () {60 vars in 1343 bytes} [Thu Oct 27 03:27:29 2022] GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 03:27:29.552384 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b850179e-8557-4345-b4d4-6be4276f7fb4 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1302692245", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:27:29.663671 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.network.neutron [None req-b850179e-8557-4345-b4d4-6be4276f7fb4 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] validate_networks() for None {{(pid=121001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:27:29.680051 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b8ab29de-091e-4746-b541-acb28871ed5f tempest-FloatingIPDetailsTestJSON-1423882136 tempest-FloatingIPDetailsTestJSON-1423882136-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/8271c3e6-2b08-4c4c-b5fd-56bd32f0d0b1" status: 202 len: 0 microversion: 2.1 time: 2.626528 Oct 27 03:27:29.680705 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 928/1843] 10.222.0.20 () {58 vars in 1263 bytes} [Thu Oct 27 03:27:27 2022] DELETE /compute/v2.1/os-floating-ips/8271c3e6-2b08-4c4c-b5fd-56bd32f0d0b1 => generated 0 bytes in 2628 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:27:29.691567 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b74479f9-7bc3-4a34-9865-ca3d6c0031a0 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:29.692516 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b74479f9-7bc3-4a34-9865-ca3d6c0031a0 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] [instance: 80bb98d2-3a48-40cd-85e4-ee8dfacbbadd] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:29.712024 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b74479f9-7bc3-4a34-9865-ca3d6c0031a0 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:29.712536 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b74479f9-7bc3-4a34-9865-ca3d6c0031a0 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:29.712986 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b74479f9-7bc3-4a34-9865-ca3d6c0031a0 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:29.713930 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b74479f9-7bc3-4a34-9865-ca3d6c0031a0 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:29.714433 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b74479f9-7bc3-4a34-9865-ca3d6c0031a0 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:29.714872 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b74479f9-7bc3-4a34-9865-ca3d6c0031a0 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:29.981013 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b74479f9-7bc3-4a34-9865-ca3d6c0031a0 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8640291c8745609faae41bdd731c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cee634bb1f4bb0a47f33a49f24ccdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:29.984162 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b74479f9-7bc3-4a34-9865-ca3d6c0031a0 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] 10.222.0.20 "GET /compute/v2.1/servers/80bb98d2-3a48-40cd-85e4-ee8dfacbbadd" status: 200 len: 1324 microversion: 2.1 time: 0.301760 Oct 27 03:27:30.002145 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 929/1844] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:27:29 2022] GET /compute/v2.1/servers/80bb98d2-3a48-40cd-85e4-ee8dfacbbadd => generated 1324 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:27:30.009532 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6d1aa0b1-6354-46c0-a3fa-4dfe32ced37e tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-773840715", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "7657bad1-3036-4070-b357-348d72434ef6"}], "security_groups": [{"name": "tempest-securitygroup--1340277485"}], "key_name": "tempest-keypair-1265828847", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:27:30.127448 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-b850179e-8557-4345-b4d4-6be4276f7fb4 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Flavor limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:27:30.127962 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-b850179e-8557-4345-b4d4-6be4276f7fb4 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Image limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:27:30.129585 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-b850179e-8557-4345-b4d4-6be4276f7fb4 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Flavor pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:27:30.131234 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-b850179e-8557-4345-b4d4-6be4276f7fb4 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Image pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:27:30.131854 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-b850179e-8557-4345-b4d4-6be4276f7fb4 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:27:30.171051 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b850179e-8557-4345-b4d4-6be4276f7fb4 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:30.172986 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b850179e-8557-4345-b4d4-6be4276f7fb4 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:30.173632 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b850179e-8557-4345-b4d4-6be4276f7fb4 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:30.174670 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b850179e-8557-4345-b4d4-6be4276f7fb4 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:30.175836 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b850179e-8557-4345-b4d4-6be4276f7fb4 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:30.176539 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b850179e-8557-4345-b4d4-6be4276f7fb4 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:30.242298 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-b850179e-8557-4345-b4d4-6be4276f7fb4 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Getting quotas for project 2c8510a519f14deea6f35a437419e161. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:27:30.277243 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-6d1aa0b1-6354-46c0-a3fa-4dfe32ced37e tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] validate_networks() for [('7657bad1-3036-4070-b357-348d72434ef6', None, None, None, None, None)] {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:27:30.279817 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-b850179e-8557-4345-b4d4-6be4276f7fb4 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Getting quotas for user c13e05e253c94aadb1c089128ff35be5 and project 2c8510a519f14deea6f35a437419e161. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:27:30.315246 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b850179e-8557-4345-b4d4-6be4276f7fb4 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Going to run 1 instances... {{(pid=121001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:27:30.318077 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b850179e-8557-4345-b4d4-6be4276f7fb4 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: 339287fc-37b6-455d-96ab-08ab8e2c3e68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:27:30.512451 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b850179e-8557-4345-b4d4-6be4276f7fb4 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.177802 Oct 27 03:27:30.522355 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 916/1845] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:27:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1186 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 03:27:30.691380 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-3207a25c-b889-4ccc-8526-f9f800c0f88f req-6477864e-852b-4c0c-9960-c0b405bac865 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80bb98d2-3a48-40cd-85e4-ee8dfacbbadd", "tag": "2bbb3e1d-9309-4282-a03e-4c3ee27880e4"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:27:30.691380 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-3207a25c-b889-4ccc-8526-f9f800c0f88f req-6477864e-852b-4c0c-9960-c0b405bac865 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:30.691380 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-3207a25c-b889-4ccc-8526-f9f800c0f88f req-6477864e-852b-4c0c-9960-c0b405bac865 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:30.691380 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-3207a25c-b889-4ccc-8526-f9f800c0f88f req-6477864e-852b-4c0c-9960-c0b405bac865 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:30.692154 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-3207a25c-b889-4ccc-8526-f9f800c0f88f req-6477864e-852b-4c0c-9960-c0b405bac865 service nova] Creating event network-changed:2bbb3e1d-9309-4282-a03e-4c3ee27880e4 for instance 80bb98d2-3a48-40cd-85e4-ee8dfacbbadd on n-h2-862769-1 Oct 27 03:27:30.692154 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-3207a25c-b889-4ccc-8526-f9f800c0f88f req-6477864e-852b-4c0c-9960-c0b405bac865 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139110 Oct 27 03:27:30.692154 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 917/1846] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:27:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:27:30.692154 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a31bcdef-860b-4a5f-9b3a-58d42091f463 tempest-FloatingIPDetailsTestJSON-1423882136 tempest-FloatingIPDetailsTestJSON-1423882136-project] Calling method '.version_select at 0x7f7ddec6b9d0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:30.969400 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a31bcdef-860b-4a5f-9b3a-58d42091f463 tempest-FloatingIPDetailsTestJSON-1423882136 tempest-FloatingIPDetailsTestJSON-1423882136-project] 10.222.0.20 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.303924 Oct 27 03:27:30.971145 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 918/1847] 10.222.0.20 () {58 vars in 1164 bytes} [Thu Oct 27 03:27:30 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 03:27:30.977120 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-42b83d0f-1e88-4211-bed8-33a1ff555800 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:30.978010 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-42b83d0f-1e88-4211-bed8-33a1ff555800 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] [instance: 135280a2-409f-4a5f-bf27-b5afe5f7694f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:30.985335 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-42b83d0f-1e88-4211-bed8-33a1ff555800 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:30.986176 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-42b83d0f-1e88-4211-bed8-33a1ff555800 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:30.986882 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-42b83d0f-1e88-4211-bed8-33a1ff555800 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:30.987886 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-42b83d0f-1e88-4211-bed8-33a1ff555800 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:30.988618 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-42b83d0f-1e88-4211-bed8-33a1ff555800 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:30.989647 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-42b83d0f-1e88-4211-bed8-33a1ff555800 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:30.997525 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:27:31.069341 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-6d1aa0b1-6354-46c0-a3fa-4dfe32ced37e tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Getting quotas for project c3fc032a089f45efa4a66866a9c961c9. Resources: dict_keys(['metadata_items']) {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:27:31.081190 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-6d1aa0b1-6354-46c0-a3fa-4dfe32ced37e tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Getting quotas for user 17b2717ace074a579d33c60964e6668a and project c3fc032a089f45efa4a66866a9c961c9. Resources: dict_keys(['metadata_items']) {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:27:31.096970 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-6d1aa0b1-6354-46c0-a3fa-4dfe32ced37e tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:27:31.097752 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-6d1aa0b1-6354-46c0-a3fa-4dfe32ced37e tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:27:31.098448 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-6d1aa0b1-6354-46c0-a3fa-4dfe32ced37e tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:27:31.099679 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-6d1aa0b1-6354-46c0-a3fa-4dfe32ced37e tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:27:31.100548 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-6d1aa0b1-6354-46c0-a3fa-4dfe32ced37e tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:27:31.110989 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6d1aa0b1-6354-46c0-a3fa-4dfe32ced37e tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:31.111751 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6d1aa0b1-6354-46c0-a3fa-4dfe32ced37e tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:31.114394 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6d1aa0b1-6354-46c0-a3fa-4dfe32ced37e tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:31.115897 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6d1aa0b1-6354-46c0-a3fa-4dfe32ced37e tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:31.115897 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6d1aa0b1-6354-46c0-a3fa-4dfe32ced37e tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:31.116605 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6d1aa0b1-6354-46c0-a3fa-4dfe32ced37e tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:31.141098 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-6d1aa0b1-6354-46c0-a3fa-4dfe32ced37e tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Getting quotas for project c3fc032a089f45efa4a66866a9c961c9. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:27:31.147933 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-6d1aa0b1-6354-46c0-a3fa-4dfe32ced37e tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Getting quotas for user 17b2717ace074a579d33c60964e6668a and project c3fc032a089f45efa4a66866a9c961c9. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:27:31.163926 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-42b83d0f-1e88-4211-bed8-33a1ff555800 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c65ddc0af5854d7a89192d01bc5f4576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c57f8e9a0e4debae18d98918ba8c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:31.165235 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6d1aa0b1-6354-46c0-a3fa-4dfe32ced37e tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:27:31.167735 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6d1aa0b1-6354-46c0-a3fa-4dfe32ced37e tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] [instance: 0fb1f450-692f-4979-a489-c13ab4106607] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:27:31.172785 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-42b83d0f-1e88-4211-bed8-33a1ff555800 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] 10.222.0.20 "GET /compute/v2.1/servers/135280a2-409f-4a5f-bf27-b5afe5f7694f" status: 200 len: 1316 microversion: 2.1 time: 0.200086 Oct 27 03:27:31.175898 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 919/1848] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:27:30 2022] GET /compute/v2.1/servers/135280a2-409f-4a5f-bf27-b5afe5f7694f => generated 1316 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:27:31.181886 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-cb156082-eefd-4a53-ac67-ba1bbd512b77 req-144bf4e5-e10f-42c2-b9ed-c49ec8b2233c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49f0475c-d9eb-4ad0-9f88-322521def6c7", "tag": "2e7b6414-960b-4793-94ae-d4e9bc9cb2a7"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:27:31.223626 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-cb156082-eefd-4a53-ac67-ba1bbd512b77 req-144bf4e5-e10f-42c2-b9ed-c49ec8b2233c service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:31.223626 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-cb156082-eefd-4a53-ac67-ba1bbd512b77 req-144bf4e5-e10f-42c2-b9ed-c49ec8b2233c service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:31.223626 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-cb156082-eefd-4a53-ac67-ba1bbd512b77 req-144bf4e5-e10f-42c2-b9ed-c49ec8b2233c service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:31.241557 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-cb156082-eefd-4a53-ac67-ba1bbd512b77 req-144bf4e5-e10f-42c2-b9ed-c49ec8b2233c service nova] Creating event network-changed:2e7b6414-960b-4793-94ae-d4e9bc9cb2a7 for instance 49f0475c-d9eb-4ad0-9f88-322521def6c7 on n-h1-862769-1 Oct 27 03:27:31.249104 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-cb156082-eefd-4a53-ac67-ba1bbd512b77 req-144bf4e5-e10f-42c2-b9ed-c49ec8b2233c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071852 Oct 27 03:27:31.253915 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 920/1849] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:27:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:27:31.259055 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-300cc734-c8f0-4f4e-8723-1531e5decea2 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:31.259785 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-300cc734-c8f0-4f4e-8723-1531e5decea2 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 49f0475c-d9eb-4ad0-9f88-322521def6c7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:31.266481 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-300cc734-c8f0-4f4e-8723-1531e5decea2 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:31.266966 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-300cc734-c8f0-4f4e-8723-1531e5decea2 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:31.267403 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-300cc734-c8f0-4f4e-8723-1531e5decea2 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:31.268208 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-300cc734-c8f0-4f4e-8723-1531e5decea2 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:31.268669 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-300cc734-c8f0-4f4e-8723-1531e5decea2 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:31.269679 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-300cc734-c8f0-4f4e-8723-1531e5decea2 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:31.309360 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6d1aa0b1-6354-46c0-a3fa-4dfe32ced37e tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.304838 Oct 27 03:27:31.310655 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 930/1850] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:27:30 2022] POST /compute/v2.1/servers => generated 409 bytes in 1308 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 03:27:31.316382 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c18cf858-a78a-4cb5-b41e-bff17980cae9 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:31.319214 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c18cf858-a78a-4cb5-b41e-bff17980cae9 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:31.326285 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c18cf858-a78a-4cb5-b41e-bff17980cae9 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:31.327070 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c18cf858-a78a-4cb5-b41e-bff17980cae9 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:31.327855 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c18cf858-a78a-4cb5-b41e-bff17980cae9 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:31.328930 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c18cf858-a78a-4cb5-b41e-bff17980cae9 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:31.329768 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c18cf858-a78a-4cb5-b41e-bff17980cae9 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:31.330248 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c18cf858-a78a-4cb5-b41e-bff17980cae9 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:31.393296 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c18cf858-a78a-4cb5-b41e-bff17980cae9 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.078488 Oct 27 03:27:31.395308 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 931/1851] 10.222.0.20 () {60 vars in 1343 bytes} [Thu Oct 27 03:27:31 2022] GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 03:27:31.409726 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-43a70633-e70c-4b11-8f97-1f05337ecc1f req-4a23829f-d8f1-4faa-b40f-9f746c5c0a0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "135280a2-409f-4a5f-bf27-b5afe5f7694f", "name": "network-vif-plugged", "status": "completed", "tag": "e44acda3-786a-423e-9885-daa65c21586b"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:27:31.433006 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-43a70633-e70c-4b11-8f97-1f05337ecc1f req-4a23829f-d8f1-4faa-b40f-9f746c5c0a0e service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:31.433006 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-43a70633-e70c-4b11-8f97-1f05337ecc1f req-4a23829f-d8f1-4faa-b40f-9f746c5c0a0e service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:31.433384 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-43a70633-e70c-4b11-8f97-1f05337ecc1f req-4a23829f-d8f1-4faa-b40f-9f746c5c0a0e service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:31.455751 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-43a70633-e70c-4b11-8f97-1f05337ecc1f req-4a23829f-d8f1-4faa-b40f-9f746c5c0a0e service nova] Creating event network-vif-plugged:e44acda3-786a-423e-9885-daa65c21586b for instance 135280a2-409f-4a5f-bf27-b5afe5f7694f on n-h2-862769-1 Oct 27 03:27:31.475494 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-43a70633-e70c-4b11-8f97-1f05337ecc1f req-4a23829f-d8f1-4faa-b40f-9f746c5c0a0e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077835 Oct 27 03:27:31.476062 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 932/1852] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:27:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:27:31.484899 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-dff5823e-11cf-4090-ad07-236788cf4c54 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-888862746", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:27:31.577290 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-dff5823e-11cf-4090-ad07-236788cf4c54 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] validate_networks() for None {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:27:31.664499 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-300cc734-c8f0-4f4e-8723-1531e5decea2 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:31.674349 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-300cc734-c8f0-4f4e-8723-1531e5decea2 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/49f0475c-d9eb-4ad0-9f88-322521def6c7" status: 200 len: 1307 microversion: 2.1 time: 0.419317 Oct 27 03:27:31.693932 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 921/1853] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:27:31 2022] GET /compute/v2.1/servers/49f0475c-d9eb-4ad0-9f88-322521def6c7 => generated 1307 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:27:31.702385 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7abb53b3-e1b6-4398-9efd-4e9f91d51cf0 tempest-FloatingIPDetailsTestJSON-1423882136 tempest-FloatingIPDetailsTestJSON-1423882136-project] Calling method '.version_select at 0x7f7ddec60d30>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:31.936076 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-dff5823e-11cf-4090-ad07-236788cf4c54 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:27:31.936810 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-dff5823e-11cf-4090-ad07-236788cf4c54 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:27:31.937730 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-dff5823e-11cf-4090-ad07-236788cf4c54 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:27:31.938374 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-dff5823e-11cf-4090-ad07-236788cf4c54 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:27:31.938986 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-dff5823e-11cf-4090-ad07-236788cf4c54 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:27:31.955153 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dff5823e-11cf-4090-ad07-236788cf4c54 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:31.960725 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dff5823e-11cf-4090-ad07-236788cf4c54 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:31.960725 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dff5823e-11cf-4090-ad07-236788cf4c54 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:31.960725 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dff5823e-11cf-4090-ad07-236788cf4c54 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:31.960725 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dff5823e-11cf-4090-ad07-236788cf4c54 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:31.961487 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dff5823e-11cf-4090-ad07-236788cf4c54 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:31.983495 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-dff5823e-11cf-4090-ad07-236788cf4c54 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Getting quotas for project 2c8510a519f14deea6f35a437419e161. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:27:32.007506 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-dff5823e-11cf-4090-ad07-236788cf4c54 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Getting quotas for user c13e05e253c94aadb1c089128ff35be5 and project 2c8510a519f14deea6f35a437419e161. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:27:32.032265 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-dff5823e-11cf-4090-ad07-236788cf4c54 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:27:32.035833 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7abb53b3-e1b6-4398-9efd-4e9f91d51cf0 tempest-FloatingIPDetailsTestJSON-1423882136 tempest-FloatingIPDetailsTestJSON-1423882136-project] 10.222.0.20 "GET /compute/v2.1/os-floating-ips" status: 200 len: 398 microversion: 2.1 time: 0.339475 Oct 27 03:27:32.036793 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 922/1854] 10.222.0.20 () {58 vars in 1149 bytes} [Thu Oct 27 03:27:31 2022] GET /compute/v2.1/os-floating-ips => generated 398 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:27:32.039985 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-dff5823e-11cf-4090-ad07-236788cf4c54 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: 62224107-28c3-40c7-b4d3-13881d1c8d65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:27:32.048197 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c6cd3dc4-245b-4895-a6e2-fefc17c44adf tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:32.048197 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c6cd3dc4-245b-4895-a6e2-fefc17c44adf tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] [instance: 80bb98d2-3a48-40cd-85e4-ee8dfacbbadd] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:32.067985 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c6cd3dc4-245b-4895-a6e2-fefc17c44adf tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:32.071386 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c6cd3dc4-245b-4895-a6e2-fefc17c44adf tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:32.071386 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c6cd3dc4-245b-4895-a6e2-fefc17c44adf tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:32.071386 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c6cd3dc4-245b-4895-a6e2-fefc17c44adf tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:32.071386 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c6cd3dc4-245b-4895-a6e2-fefc17c44adf tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:32.071874 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c6cd3dc4-245b-4895-a6e2-fefc17c44adf tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:32.223240 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-dff5823e-11cf-4090-ad07-236788cf4c54 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.742622 Oct 27 03:27:32.229955 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 933/1855] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:27:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 753 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 03:27:32.243796 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-cea770b4-31dc-4712-afb9-fa37591e057c tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:32.244369 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-cea770b4-31dc-4712-afb9-fa37591e057c tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] [instance: 0fb1f450-692f-4979-a489-c13ab4106607] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:32.338466 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-cea770b4-31dc-4712-afb9-fa37591e057c tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b2717ace074a579d33c60964e6668a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3fc032a089f45efa4a66866a9c961c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:32.351430 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-cea770b4-31dc-4712-afb9-fa37591e057c tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] 10.222.0.20 "GET /compute/v2.1/servers/0fb1f450-692f-4979-a489-c13ab4106607" status: 200 len: 1277 microversion: 2.1 time: 0.119906 Oct 27 03:27:32.352659 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 934/1856] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:27:32 2022] GET /compute/v2.1/servers/0fb1f450-692f-4979-a489-c13ab4106607 => generated 1277 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:27:32.365398 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2dac2082-5a32-437c-b1cc-f6df753398bf tempest-FloatingIPDetailsTestJSON-1423882136 tempest-FloatingIPDetailsTestJSON-1423882136-project] Calling method '.version_select at 0x7f7dda2750d0>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:32.396465 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c6cd3dc4-245b-4895-a6e2-fefc17c44adf tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8640291c8745609faae41bdd731c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cee634bb1f4bb0a47f33a49f24ccdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:32.406634 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c6cd3dc4-245b-4895-a6e2-fefc17c44adf tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] 10.222.0.20 "GET /compute/v2.1/servers/80bb98d2-3a48-40cd-85e4-ee8dfacbbadd" status: 200 len: 1324 microversion: 2.1 time: 0.367577 Oct 27 03:27:32.423361 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 923/1857] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:27:32 2022] GET /compute/v2.1/servers/80bb98d2-3a48-40cd-85e4-ee8dfacbbadd => generated 1324 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:27:32.438407 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e2b656fa-1143-47cb-a901-da04918158ef tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:32.439158 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e2b656fa-1143-47cb-a901-da04918158ef tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] [instance: 135280a2-409f-4a5f-bf27-b5afe5f7694f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:32.452553 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e2b656fa-1143-47cb-a901-da04918158ef tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:32.453241 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e2b656fa-1143-47cb-a901-da04918158ef tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:32.453871 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e2b656fa-1143-47cb-a901-da04918158ef tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:32.454800 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e2b656fa-1143-47cb-a901-da04918158ef tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:32.457457 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e2b656fa-1143-47cb-a901-da04918158ef tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:32.470873 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e2b656fa-1143-47cb-a901-da04918158ef tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:32.892360 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e2b656fa-1143-47cb-a901-da04918158ef tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c65ddc0af5854d7a89192d01bc5f4576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c57f8e9a0e4debae18d98918ba8c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:32.916248 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e2b656fa-1143-47cb-a901-da04918158ef tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] 10.222.0.20 "GET /compute/v2.1/servers/135280a2-409f-4a5f-bf27-b5afe5f7694f" status: 200 len: 1316 microversion: 2.1 time: 0.488623 Oct 27 03:27:32.917163 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 924/1858] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:27:32 2022] GET /compute/v2.1/servers/135280a2-409f-4a5f-bf27-b5afe5f7694f => generated 1316 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:27:32.931819 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-301bf319-fdb8-440b-b4e8-d49a93a94c3c tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:32.932793 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-301bf319-fdb8-440b-b4e8-d49a93a94c3c tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: 62224107-28c3-40c7-b4d3-13881d1c8d65] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:33.061033 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-301bf319-fdb8-440b-b4e8-d49a93a94c3c tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13e05e253c94aadb1c089128ff35be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8510a519f14deea6f35a437419e161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:33.075008 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-301bf319-fdb8-440b-b4e8-d49a93a94c3c tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "GET /compute/v2.1/servers/62224107-28c3-40c7-b4d3-13881d1c8d65" status: 200 len: 1213 microversion: 2.1 time: 0.156298 Oct 27 03:27:33.075610 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 925/1859] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:27:32 2022] GET /compute/v2.1/servers/62224107-28c3-40c7-b4d3-13881d1c8d65 => generated 1213 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:27:33.113218 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-675099fd-59d0-4475-994a-86c40556a3eb tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:33.116056 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-675099fd-59d0-4475-994a-86c40556a3eb tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:33.125929 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-675099fd-59d0-4475-994a-86c40556a3eb tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:33.125929 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-675099fd-59d0-4475-994a-86c40556a3eb tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:33.125929 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-675099fd-59d0-4475-994a-86c40556a3eb tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:33.125929 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-675099fd-59d0-4475-994a-86c40556a3eb tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:33.126414 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-675099fd-59d0-4475-994a-86c40556a3eb tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:33.126795 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-675099fd-59d0-4475-994a-86c40556a3eb tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:33.205285 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-675099fd-59d0-4475-994a-86c40556a3eb tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.104900 Oct 27 03:27:33.213407 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 926/1860] 10.222.0.20 () {60 vars in 1343 bytes} [Thu Oct 27 03:27:33 2022] GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 03:27:33.236722 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-93e72705-19ef-4c54-9c31-2a3f76a808e0 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:33.243232 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-93e72705-19ef-4c54-9c31-2a3f76a808e0 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 49f0475c-d9eb-4ad0-9f88-322521def6c7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:33.259630 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-93e72705-19ef-4c54-9c31-2a3f76a808e0 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:33.260124 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-93e72705-19ef-4c54-9c31-2a3f76a808e0 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:33.260567 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-93e72705-19ef-4c54-9c31-2a3f76a808e0 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:33.261284 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-93e72705-19ef-4c54-9c31-2a3f76a808e0 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:33.261739 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-93e72705-19ef-4c54-9c31-2a3f76a808e0 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:33.262202 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-93e72705-19ef-4c54-9c31-2a3f76a808e0 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:33.514812 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-93e72705-19ef-4c54-9c31-2a3f76a808e0 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:33.534622 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-93e72705-19ef-4c54-9c31-2a3f76a808e0 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/49f0475c-d9eb-4ad0-9f88-322521def6c7" status: 200 len: 1307 microversion: 2.1 time: 0.308296 Oct 27 03:27:33.542090 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 927/1861] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:27:33 2022] GET /compute/v2.1/servers/49f0475c-d9eb-4ad0-9f88-322521def6c7 => generated 1307 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:27:33.546871 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5caede75-1cb5-4982-bf54-ff08cb01a381 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:33.548539 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5caede75-1cb5-4982-bf54-ff08cb01a381 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] [instance: 0fb1f450-692f-4979-a489-c13ab4106607] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:33.567312 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5caede75-1cb5-4982-bf54-ff08cb01a381 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:33.567312 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5caede75-1cb5-4982-bf54-ff08cb01a381 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:33.567507 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5caede75-1cb5-4982-bf54-ff08cb01a381 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:33.568213 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5caede75-1cb5-4982-bf54-ff08cb01a381 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:33.568896 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5caede75-1cb5-4982-bf54-ff08cb01a381 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:33.569348 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5caede75-1cb5-4982-bf54-ff08cb01a381 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:33.656867 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5caede75-1cb5-4982-bf54-ff08cb01a381 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b2717ace074a579d33c60964e6668a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3fc032a089f45efa4a66866a9c961c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:33.664778 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5caede75-1cb5-4982-bf54-ff08cb01a381 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] 10.222.0.20 "GET /compute/v2.1/servers/0fb1f450-692f-4979-a489-c13ab4106607" status: 200 len: 1273 microversion: 2.1 time: 0.128255 Oct 27 03:27:33.665485 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 928/1862] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:27:33 2022] GET /compute/v2.1/servers/0fb1f450-692f-4979-a489-c13ab4106607 => generated 1273 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:27:33.670056 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-83737b3b-f79c-46b6-930c-20e9a0eaca7b tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:33.670680 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-83737b3b-f79c-46b6-930c-20e9a0eaca7b tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] [instance: 80bb98d2-3a48-40cd-85e4-ee8dfacbbadd] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:33.676400 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-83737b3b-f79c-46b6-930c-20e9a0eaca7b tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:33.676901 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-83737b3b-f79c-46b6-930c-20e9a0eaca7b tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:33.681938 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-83737b3b-f79c-46b6-930c-20e9a0eaca7b tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:33.681938 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-83737b3b-f79c-46b6-930c-20e9a0eaca7b tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:33.681938 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-83737b3b-f79c-46b6-930c-20e9a0eaca7b tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:33.681938 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-83737b3b-f79c-46b6-930c-20e9a0eaca7b tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:33.828390 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-83737b3b-f79c-46b6-930c-20e9a0eaca7b tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8640291c8745609faae41bdd731c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cee634bb1f4bb0a47f33a49f24ccdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:33.837390 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-83737b3b-f79c-46b6-930c-20e9a0eaca7b tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] 10.222.0.20 "GET /compute/v2.1/servers/80bb98d2-3a48-40cd-85e4-ee8dfacbbadd" status: 200 len: 1324 microversion: 2.1 time: 0.170841 Oct 27 03:27:33.838351 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 929/1863] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:27:33 2022] GET /compute/v2.1/servers/80bb98d2-3a48-40cd-85e4-ee8dfacbbadd => generated 1324 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:27:33.943783 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-754c831c-8790-4e1f-8499-8ae7314f6abc tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:33.944407 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-754c831c-8790-4e1f-8499-8ae7314f6abc tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] [instance: 135280a2-409f-4a5f-bf27-b5afe5f7694f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:33.960830 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-754c831c-8790-4e1f-8499-8ae7314f6abc tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:33.961304 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-754c831c-8790-4e1f-8499-8ae7314f6abc tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:33.961753 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-754c831c-8790-4e1f-8499-8ae7314f6abc tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:33.974784 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-754c831c-8790-4e1f-8499-8ae7314f6abc tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:33.975394 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-754c831c-8790-4e1f-8499-8ae7314f6abc tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:33.977530 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-754c831c-8790-4e1f-8499-8ae7314f6abc tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:34.180780 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2dac2082-5a32-437c-b1cc-f6df753398bf tempest-FloatingIPDetailsTestJSON-1423882136 tempest-FloatingIPDetailsTestJSON-1423882136-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/22847034-b7a0-44a9-9b5d-a19ecd52629c" status: 202 len: 0 microversion: 2.1 time: 1.821048 Oct 27 03:27:34.180780 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 935/1864] 10.222.0.20 () {58 vars in 1263 bytes} [Thu Oct 27 03:27:32 2022] DELETE /compute/v2.1/os-floating-ips/22847034-b7a0-44a9-9b5d-a19ecd52629c => generated 0 bytes in 1824 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:27:34.185082 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-bf5ee611-88a4-48e1-bf0f-bbbd44dc7fd8 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:34.186067 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-bf5ee611-88a4-48e1-bf0f-bbbd44dc7fd8 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: 62224107-28c3-40c7-b4d3-13881d1c8d65] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:34.204538 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bf5ee611-88a4-48e1-bf0f-bbbd44dc7fd8 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:34.205677 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bf5ee611-88a4-48e1-bf0f-bbbd44dc7fd8 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:34.206962 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bf5ee611-88a4-48e1-bf0f-bbbd44dc7fd8 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:34.208083 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bf5ee611-88a4-48e1-bf0f-bbbd44dc7fd8 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:34.208726 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bf5ee611-88a4-48e1-bf0f-bbbd44dc7fd8 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:34.209436 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bf5ee611-88a4-48e1-bf0f-bbbd44dc7fd8 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:34.280959 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-bf5ee611-88a4-48e1-bf0f-bbbd44dc7fd8 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13e05e253c94aadb1c089128ff35be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8510a519f14deea6f35a437419e161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:34.290985 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-bf5ee611-88a4-48e1-bf0f-bbbd44dc7fd8 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "GET /compute/v2.1/servers/62224107-28c3-40c7-b4d3-13881d1c8d65" status: 200 len: 1209 microversion: 2.1 time: 0.111013 Oct 27 03:27:34.296625 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 936/1865] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:27:34 2022] GET /compute/v2.1/servers/62224107-28c3-40c7-b4d3-13881d1c8d65 => generated 1209 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:27:34.297944 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-605af39a-d794-4f31-88db-78edf6df100e tempest-FloatingIPDetailsTestJSON-1423882136 tempest-FloatingIPDetailsTestJSON-1423882136-project] Calling method '.version_select at 0x7f7dda1b68b0>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:34.374696 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-754c831c-8790-4e1f-8499-8ae7314f6abc tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c65ddc0af5854d7a89192d01bc5f4576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c57f8e9a0e4debae18d98918ba8c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:34.388653 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-754c831c-8790-4e1f-8499-8ae7314f6abc tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] 10.222.0.20 "GET /compute/v2.1/servers/135280a2-409f-4a5f-bf27-b5afe5f7694f" status: 200 len: 1507 microversion: 2.1 time: 0.445585 Oct 27 03:27:34.388653 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 930/1866] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:27:33 2022] GET /compute/v2.1/servers/135280a2-409f-4a5f-bf27-b5afe5f7694f => generated 1507 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:27:34.391470 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-cd1cea59-fd4b-436c-a782-ca17f53c00f8 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:34.394009 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-cd1cea59-fd4b-436c-a782-ca17f53c00f8 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:34.401421 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cd1cea59-fd4b-436c-a782-ca17f53c00f8 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:34.402205 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cd1cea59-fd4b-436c-a782-ca17f53c00f8 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:34.403409 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cd1cea59-fd4b-436c-a782-ca17f53c00f8 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:34.404809 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cd1cea59-fd4b-436c-a782-ca17f53c00f8 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:34.405479 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cd1cea59-fd4b-436c-a782-ca17f53c00f8 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:34.406411 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cd1cea59-fd4b-436c-a782-ca17f53c00f8 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:34.478879 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-cd1cea59-fd4b-436c-a782-ca17f53c00f8 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.076040 Oct 27 03:27:34.478879 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 931/1867] 10.222.0.20 () {60 vars in 1343 bytes} [Thu Oct 27 03:27:34 2022] GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f/os-volume_attachments => generated 25 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:27:34.558519 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4bd518e4-abe5-4a2a-9763-b966fa829cef tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:34.559259 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4bd518e4-abe5-4a2a-9763-b966fa829cef tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 49f0475c-d9eb-4ad0-9f88-322521def6c7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:34.576066 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4bd518e4-abe5-4a2a-9763-b966fa829cef tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:34.576655 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4bd518e4-abe5-4a2a-9763-b966fa829cef tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:34.578072 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4bd518e4-abe5-4a2a-9763-b966fa829cef tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:34.581004 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4bd518e4-abe5-4a2a-9763-b966fa829cef tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:34.582909 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4bd518e4-abe5-4a2a-9763-b966fa829cef tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:34.583537 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4bd518e4-abe5-4a2a-9763-b966fa829cef tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:35.093486 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4bd518e4-abe5-4a2a-9763-b966fa829cef tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:35.101126 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4bd518e4-abe5-4a2a-9763-b966fa829cef tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/49f0475c-d9eb-4ad0-9f88-322521def6c7" status: 200 len: 1307 microversion: 2.1 time: 0.544791 Oct 27 03:27:35.102147 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 932/1868] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:27:34 2022] GET /compute/v2.1/servers/49f0475c-d9eb-4ad0-9f88-322521def6c7 => generated 1307 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:27:35.108909 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6312bf26-d1f2-49be-96bf-99aa0a754153 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:35.111917 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-6312bf26-d1f2-49be-96bf-99aa0a754153 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] [instance: 0fb1f450-692f-4979-a489-c13ab4106607] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:35.129377 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6312bf26-d1f2-49be-96bf-99aa0a754153 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:35.129968 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6312bf26-d1f2-49be-96bf-99aa0a754153 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:35.130507 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6312bf26-d1f2-49be-96bf-99aa0a754153 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:35.135111 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6312bf26-d1f2-49be-96bf-99aa0a754153 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:35.136783 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6312bf26-d1f2-49be-96bf-99aa0a754153 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:35.141442 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6312bf26-d1f2-49be-96bf-99aa0a754153 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:35.319268 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6312bf26-d1f2-49be-96bf-99aa0a754153 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b2717ace074a579d33c60964e6668a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3fc032a089f45efa4a66866a9c961c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:35.330666 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6312bf26-d1f2-49be-96bf-99aa0a754153 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] 10.222.0.20 "GET /compute/v2.1/servers/0fb1f450-692f-4979-a489-c13ab4106607" status: 200 len: 1337 microversion: 2.1 time: 0.226338 Oct 27 03:27:35.342194 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 933/1869] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:27:35 2022] GET /compute/v2.1/servers/0fb1f450-692f-4979-a489-c13ab4106607 => generated 1337 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:27:35.355330 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f4029893-f5a2-4271-aa87-ef1f1742a66f tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:35.370649 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f4029893-f5a2-4271-aa87-ef1f1742a66f tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] [instance: 80bb98d2-3a48-40cd-85e4-ee8dfacbbadd] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:35.378365 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f4029893-f5a2-4271-aa87-ef1f1742a66f tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:35.379845 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f4029893-f5a2-4271-aa87-ef1f1742a66f tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:35.381875 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f4029893-f5a2-4271-aa87-ef1f1742a66f tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:35.382830 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f4029893-f5a2-4271-aa87-ef1f1742a66f tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:35.384267 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f4029893-f5a2-4271-aa87-ef1f1742a66f tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:35.385805 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f4029893-f5a2-4271-aa87-ef1f1742a66f tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:35.723309 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f4029893-f5a2-4271-aa87-ef1f1742a66f tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8640291c8745609faae41bdd731c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cee634bb1f4bb0a47f33a49f24ccdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:35.738022 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f4029893-f5a2-4271-aa87-ef1f1742a66f tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] 10.222.0.20 "GET /compute/v2.1/servers/80bb98d2-3a48-40cd-85e4-ee8dfacbbadd" status: 200 len: 1324 microversion: 2.1 time: 0.393166 Oct 27 03:27:35.738864 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 934/1870] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:27:35 2022] GET /compute/v2.1/servers/80bb98d2-3a48-40cd-85e4-ee8dfacbbadd => generated 1324 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:27:35.746349 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c19cacd6-039f-4258-bfd4-6d419db3049b tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:35.749790 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c19cacd6-039f-4258-bfd4-6d419db3049b tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: 62224107-28c3-40c7-b4d3-13881d1c8d65] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:35.758904 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c19cacd6-039f-4258-bfd4-6d419db3049b tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:35.764828 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c19cacd6-039f-4258-bfd4-6d419db3049b tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:35.765651 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c19cacd6-039f-4258-bfd4-6d419db3049b tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:35.770545 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c19cacd6-039f-4258-bfd4-6d419db3049b tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:35.771444 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c19cacd6-039f-4258-bfd4-6d419db3049b tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:35.772315 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c19cacd6-039f-4258-bfd4-6d419db3049b tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:35.879879 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c19cacd6-039f-4258-bfd4-6d419db3049b tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13e05e253c94aadb1c089128ff35be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8510a519f14deea6f35a437419e161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:35.891752 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c19cacd6-039f-4258-bfd4-6d419db3049b tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "GET /compute/v2.1/servers/62224107-28c3-40c7-b4d3-13881d1c8d65" status: 200 len: 1265 microversion: 2.1 time: 0.150290 Oct 27 03:27:35.894703 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 935/1871] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:27:35 2022] GET /compute/v2.1/servers/62224107-28c3-40c7-b4d3-13881d1c8d65 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:27:36.124188 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c8a7563e-cc35-4151-881e-cf94f50566b9 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:36.125611 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c8a7563e-cc35-4151-881e-cf94f50566b9 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 49f0475c-d9eb-4ad0-9f88-322521def6c7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:36.144570 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c8a7563e-cc35-4151-881e-cf94f50566b9 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:36.145070 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c8a7563e-cc35-4151-881e-cf94f50566b9 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:36.152874 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c8a7563e-cc35-4151-881e-cf94f50566b9 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:36.152874 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c8a7563e-cc35-4151-881e-cf94f50566b9 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:36.152874 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c8a7563e-cc35-4151-881e-cf94f50566b9 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:36.152874 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c8a7563e-cc35-4151-881e-cf94f50566b9 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:36.585800 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-605af39a-d794-4f31-88db-78edf6df100e tempest-FloatingIPDetailsTestJSON-1423882136 tempest-FloatingIPDetailsTestJSON-1423882136-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/7f03ea75-054b-4225-96f1-8ae96fee38d2" status: 202 len: 0 microversion: 2.1 time: 2.292672 Oct 27 03:27:36.591924 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 937/1872] 10.222.0.20 () {58 vars in 1263 bytes} [Thu Oct 27 03:27:34 2022] DELETE /compute/v2.1/os-floating-ips/7f03ea75-054b-4225-96f1-8ae96fee38d2 => generated 0 bytes in 2299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:27:36.600110 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-74d00771-9e2f-4cb7-8a30-7a5259ba9563 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:36.601012 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-74d00771-9e2f-4cb7-8a30-7a5259ba9563 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] [instance: 0fb1f450-692f-4979-a489-c13ab4106607] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:36.609589 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-74d00771-9e2f-4cb7-8a30-7a5259ba9563 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:36.610501 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-74d00771-9e2f-4cb7-8a30-7a5259ba9563 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:36.610945 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-74d00771-9e2f-4cb7-8a30-7a5259ba9563 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:36.611851 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-74d00771-9e2f-4cb7-8a30-7a5259ba9563 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:36.612308 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-74d00771-9e2f-4cb7-8a30-7a5259ba9563 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:36.613355 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-74d00771-9e2f-4cb7-8a30-7a5259ba9563 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:36.728073 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c8a7563e-cc35-4151-881e-cf94f50566b9 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:36.737917 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c8a7563e-cc35-4151-881e-cf94f50566b9 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/49f0475c-d9eb-4ad0-9f88-322521def6c7" status: 200 len: 1307 microversion: 2.1 time: 0.617615 Oct 27 03:27:36.741649 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 936/1873] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:27:36 2022] GET /compute/v2.1/servers/49f0475c-d9eb-4ad0-9f88-322521def6c7 => generated 1307 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:27:36.764732 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f40b04e0-efee-4d2d-ba3c-431643b0f546 tempest-FloatingIPDetailsTestJSON-1423882136 tempest-FloatingIPDetailsTestJSON-1423882136-project] Calling method '.version_select at 0x7f7dda590ca0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:36.937221 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-74d00771-9e2f-4cb7-8a30-7a5259ba9563 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b2717ace074a579d33c60964e6668a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3fc032a089f45efa4a66866a9c961c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:36.992010 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-74d00771-9e2f-4cb7-8a30-7a5259ba9563 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] 10.222.0.20 "GET /compute/v2.1/servers/0fb1f450-692f-4979-a489-c13ab4106607" status: 200 len: 1335 microversion: 2.1 time: 0.398770 Oct 27 03:27:37.015426 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 938/1874] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:27:36 2022] GET /compute/v2.1/servers/0fb1f450-692f-4979-a489-c13ab4106607 => generated 1335 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:27:37.029407 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-52266afb-f64b-4531-9a44-159b6207a947 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:37.044619 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-52266afb-f64b-4531-9a44-159b6207a947 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] [instance: 80bb98d2-3a48-40cd-85e4-ee8dfacbbadd] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:37.073399 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-52266afb-f64b-4531-9a44-159b6207a947 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:37.074272 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-52266afb-f64b-4531-9a44-159b6207a947 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:37.078991 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-52266afb-f64b-4531-9a44-159b6207a947 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:37.082665 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-52266afb-f64b-4531-9a44-159b6207a947 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:37.085974 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-52266afb-f64b-4531-9a44-159b6207a947 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:37.086916 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-52266afb-f64b-4531-9a44-159b6207a947 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:37.607988 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-52266afb-f64b-4531-9a44-159b6207a947 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8640291c8745609faae41bdd731c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cee634bb1f4bb0a47f33a49f24ccdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:37.617580 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-52266afb-f64b-4531-9a44-159b6207a947 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] 10.222.0.20 "GET /compute/v2.1/servers/80bb98d2-3a48-40cd-85e4-ee8dfacbbadd" status: 200 len: 1324 microversion: 2.1 time: 0.600396 Oct 27 03:27:37.618951 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 939/1875] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:27:37 2022] GET /compute/v2.1/servers/80bb98d2-3a48-40cd-85e4-ee8dfacbbadd => generated 1324 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:27:37.624258 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1b8a3f84-f130-4f89-8897-f049a73a3b45 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:37.625044 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1b8a3f84-f130-4f89-8897-f049a73a3b45 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: 62224107-28c3-40c7-b4d3-13881d1c8d65] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:37.632324 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1b8a3f84-f130-4f89-8897-f049a73a3b45 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:37.633113 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1b8a3f84-f130-4f89-8897-f049a73a3b45 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:37.633745 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1b8a3f84-f130-4f89-8897-f049a73a3b45 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:37.635386 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1b8a3f84-f130-4f89-8897-f049a73a3b45 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:37.635888 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1b8a3f84-f130-4f89-8897-f049a73a3b45 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:37.636317 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1b8a3f84-f130-4f89-8897-f049a73a3b45 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:37.754069 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1b8a3f84-f130-4f89-8897-f049a73a3b45 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13e05e253c94aadb1c089128ff35be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8510a519f14deea6f35a437419e161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:37.818734 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1b8a3f84-f130-4f89-8897-f049a73a3b45 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "GET /compute/v2.1/servers/62224107-28c3-40c7-b4d3-13881d1c8d65" status: 200 len: 1271 microversion: 2.1 time: 0.188115 Oct 27 03:27:37.820201 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 940/1876] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:27:37 2022] GET /compute/v2.1/servers/62224107-28c3-40c7-b4d3-13881d1c8d65 => generated 1271 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:27:37.825493 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-c7a2b946-c3ad-41f1-9371-8a260a92205e req-6abec9b7-de40-464f-bdba-0fe0a4033250 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80bb98d2-3a48-40cd-85e4-ee8dfacbbadd", "name": "network-vif-plugged", "status": "completed", "tag": "2bbb3e1d-9309-4282-a03e-4c3ee27880e4"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:27:37.854204 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-c7a2b946-c3ad-41f1-9371-8a260a92205e req-6abec9b7-de40-464f-bdba-0fe0a4033250 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:37.854878 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-c7a2b946-c3ad-41f1-9371-8a260a92205e req-6abec9b7-de40-464f-bdba-0fe0a4033250 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:37.855428 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-c7a2b946-c3ad-41f1-9371-8a260a92205e req-6abec9b7-de40-464f-bdba-0fe0a4033250 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:37.880106 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-c7a2b946-c3ad-41f1-9371-8a260a92205e req-6abec9b7-de40-464f-bdba-0fe0a4033250 service nova] Creating event network-vif-plugged:2bbb3e1d-9309-4282-a03e-4c3ee27880e4 for instance 80bb98d2-3a48-40cd-85e4-ee8dfacbbadd on n-h2-862769-1 Oct 27 03:27:37.888260 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-c7a2b946-c3ad-41f1-9371-8a260a92205e req-6abec9b7-de40-464f-bdba-0fe0a4033250 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065588 Oct 27 03:27:37.890987 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 941/1877] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:27:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:27:37.910845 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-206fdd41-6b14-4f8e-a24d-96ffc9becabc tempest-VolumesAdminNegativeTest-380053045 tempest-VolumesAdminNegativeTest-380053045-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "5e004669-966d-4b61-8932-845cc435e161"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:27:37.928544 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-206fdd41-6b14-4f8e-a24d-96ffc9becabc tempest-VolumesAdminNegativeTest-380053045 tempest-VolumesAdminNegativeTest-380053045-project-admin] [instance: 135280a2-409f-4a5f-bf27-b5afe5f7694f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:37.949803 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-206fdd41-6b14-4f8e-a24d-96ffc9becabc tempest-VolumesAdminNegativeTest-380053045 tempest-VolumesAdminNegativeTest-380053045-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:37.952182 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-206fdd41-6b14-4f8e-a24d-96ffc9becabc tempest-VolumesAdminNegativeTest-380053045 tempest-VolumesAdminNegativeTest-380053045-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:37.953019 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-206fdd41-6b14-4f8e-a24d-96ffc9becabc tempest-VolumesAdminNegativeTest-380053045 tempest-VolumesAdminNegativeTest-380053045-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:37.954161 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-206fdd41-6b14-4f8e-a24d-96ffc9becabc tempest-VolumesAdminNegativeTest-380053045 tempest-VolumesAdminNegativeTest-380053045-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:37.954840 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-206fdd41-6b14-4f8e-a24d-96ffc9becabc tempest-VolumesAdminNegativeTest-380053045 tempest-VolumesAdminNegativeTest-380053045-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:37.955434 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-206fdd41-6b14-4f8e-a24d-96ffc9becabc tempest-VolumesAdminNegativeTest-380053045 tempest-VolumesAdminNegativeTest-380053045-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:38.024549 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-206fdd41-6b14-4f8e-a24d-96ffc9becabc tempest-VolumesAdminNegativeTest-380053045 tempest-VolumesAdminNegativeTest-380053045-project-admin] HTTP exception thrown: Volume e96738c9-2f84-43a1-aead-c9377496c330 could not be found. Oct 27 03:27:38.027170 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-206fdd41-6b14-4f8e-a24d-96ffc9becabc tempest-VolumesAdminNegativeTest-380053045 tempest-VolumesAdminNegativeTest-380053045-project-admin] Request method failure captured: Oct 27 03:27:38.027170 n-d-862769-1 devstack@n-api.service[121000]: request: PUT /compute/v2.1/servers/135280a2-409f-4a5f-bf27-b5afe5f7694f/os-volume_attachments/e96738c9-2f84-43a1-aead-c9377496c330 HTTP/1.1 Oct 27 03:27:38.027170 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:27:38.027170 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:27:38.027170 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:27:38.027170 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 74 Oct 27 03:27:38.027170 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:27:38.027170 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:27:38.027170 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:27:38.027170 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:27:38.027170 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfoj9HZW1MizVjR1dWwd2bA1fGUJAz4Y024rc2RWAH5YMHoTuUPPsCHgXBezsoHgQZGdBJvJtJbAVP5-qEkwFqVImFo3askEgp2knuj5vw7HQsIi14t1gZ-d4rkkgTEoq1FiJ6uhpiFvMsiyprG2KUKl4Z5cpOl8E0CKHIKI_tFbnN8 Oct 27 03:27:38.027170 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:27:38.027170 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:27:38.027170 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:27:38.027170 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:27:38.027170 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:27:38.027170 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:27:38.027170 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: dca70d6b18304d5ebb73579d68dbfb76 Oct 27 03:27:38.027170 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-VolumesAdminNegativeTest-380053045 Oct 27 03:27:38.027170 n-d-862769-1 devstack@n-api.service[121000]: X-Role: admin,member,reader Oct 27 03:27:38.027170 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: admin,member,reader Oct 27 03:27:38.029292 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dca70d6b18304d5ebb73579d68dbfb76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dca70d6b18304d5ebb73579d68dbfb76"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dca70d6b18304d5ebb73579d68dbfb76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dca70d6b18304d5ebb73579d68dbfb76"}]}] Oct 27 03:27:38.029292 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-VolumesAdminNegativeTest-380053045 Oct 27 03:27:38.029292 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: dca70d6b18304d5ebb73579d68dbfb76 Oct 27 03:27:38.029292 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-380053045 Oct 27 03:27:38.029292 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-VolumesAdminNegativeTest-380053045-project-admin Oct 27 03:27:38.029292 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:27:38.029292 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:27:38.029292 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: eb3831e6ce63489c8315e932634ead86 Oct 27 03:27:38.029292 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-VolumesAdminNegativeTest-380053045-project-admin Oct 27 03:27:38.029292 n-d-862769-1 devstack@n-api.service[121000]: Oct 27 03:27:38.029292 n-d-862769-1 devstack@n-api.service[121000]: {"volumeAttachment": {"volumeId": "5e004669-966d-4b61-8932-845cc435e161"}} Oct 27 03:27:38.029292 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:27:38.029292 n-d-862769-1 devstack@n-api.service[121000]: exception: Volume e96738c9-2f84-43a1-aead-c9377496c330 could not be found. Oct 27 03:27:38.030393 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'server_id': '135280a2-409f-4a5f-bf27-b5afe5f7694f', 'id': 'e96738c9-2f84-43a1-aead-c9377496c330', 'body': {'volumeAttachment': {'volumeId': '5e004669-966d-4b61-8932-845cc435e161'}}} Oct 27 03:27:38.030393 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:27:38.030393 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:27:38.030393 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 03:27:38.030393 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 03:27:38.030393 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 27 03:27:38.030393 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 27 03:27:38.030393 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 27 03:27:38.030393 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 27 03:27:38.030393 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 03:27:38.030393 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 03:27:38.030393 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 03:27:38.030393 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 03:27:38.030393 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 03:27:38.030393 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 03:27:38.030393 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 03:27:38.030393 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 03:27:38.031898 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e96738c9-2f84-43a1-aead-c9377496c330 could not be found. (HTTP 404) (Request-ID: req-91d0c668-fcc4-4b1f-9a39-80ac58851416) Oct 27 03:27:38.031898 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:27:38.031898 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:27:38.031898 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:27:38.031898 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:27:38.031898 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Oct 27 03:27:38.031898 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Oct 27 03:27:38.031898 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 27 03:27:38.031898 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 27 03:27:38.031898 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 27 03:27:38.031898 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 27 03:27:38.031898 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 27 03:27:38.031898 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 27 03:27:38.031898 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 03:27:38.031898 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 03:27:38.031898 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 27 03:27:38.031898 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 27 03:27:38.031898 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 27 03:27:38.031898 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 27 03:27:38.033530 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 03:27:38.033530 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 03:27:38.033530 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 03:27:38.033530 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 03:27:38.033530 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 03:27:38.033530 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 03:27:38.033530 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 03:27:38.033530 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 03:27:38.033530 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e96738c9-2f84-43a1-aead-c9377496c330 could not be found. Oct 27 03:27:38.033530 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:27:38.033530 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:27:38.033530 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:27:38.033530 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:27:38.033530 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:27:38.033530 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:27:38.033530 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:27:38.033530 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:27:38.033530 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:27:38.033530 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:27:38.035830 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:27:38.035830 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:27:38.035830 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:27:38.035830 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:27:38.035830 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 27 03:27:38.035830 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 27 03:27:38.035830 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Oct 27 03:27:38.035830 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:27:38.035830 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e96738c9-2f84-43a1-aead-c9377496c330 could not be found. Oct 27 03:27:38.035830 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:27:38.035830 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:27:38.035830 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:27:38.035830 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:27:38.035830 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:27:38.035830 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:27:38.035830 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:27:38.035830 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:27:38.035830 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e96738c9-2f84-43a1-aead-c9377496c330 could not be found. Oct 27 03:27:38.035830 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:27:38.039693 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-206fdd41-6b14-4f8e-a24d-96ffc9becabc tempest-VolumesAdminNegativeTest-380053045 tempest-VolumesAdminNegativeTest-380053045-project-admin] Returning 404 to user: Volume e96738c9-2f84-43a1-aead-c9377496c330 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:27:38.040636 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-206fdd41-6b14-4f8e-a24d-96ffc9becabc tempest-VolumesAdminNegativeTest-380053045 tempest-VolumesAdminNegativeTest-380053045-project-admin] 10.222.0.20 "PUT /compute/v2.1/servers/135280a2-409f-4a5f-bf27-b5afe5f7694f/os-volume_attachments/e96738c9-2f84-43a1-aead-c9377496c330" status: 404 len: 109 microversion: 2.1 time: 0.148438 Oct 27 03:27:38.056798 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 942/1878] 10.222.0.20 () {60 vars in 1433 bytes} [Thu Oct 27 03:27:37 2022] PUT /compute/v2.1/servers/135280a2-409f-4a5f-bf27-b5afe5f7694f/os-volume_attachments/e96738c9-2f84-43a1-aead-c9377496c330 => generated 109 bytes in 165 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:27:38.065258 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-da7f748f-d5b6-4c5d-958c-b82bbe1eee8b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:38.065941 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-da7f748f-d5b6-4c5d-958c-b82bbe1eee8b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 49f0475c-d9eb-4ad0-9f88-322521def6c7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:38.093110 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-da7f748f-d5b6-4c5d-958c-b82bbe1eee8b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:38.093822 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-da7f748f-d5b6-4c5d-958c-b82bbe1eee8b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:38.095828 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-da7f748f-d5b6-4c5d-958c-b82bbe1eee8b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:38.098252 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-da7f748f-d5b6-4c5d-958c-b82bbe1eee8b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:38.098764 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-da7f748f-d5b6-4c5d-958c-b82bbe1eee8b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:38.099205 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-da7f748f-d5b6-4c5d-958c-b82bbe1eee8b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:38.614798 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-da7f748f-d5b6-4c5d-958c-b82bbe1eee8b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:38.623290 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-da7f748f-d5b6-4c5d-958c-b82bbe1eee8b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/49f0475c-d9eb-4ad0-9f88-322521def6c7" status: 200 len: 1307 microversion: 2.1 time: 0.565242 Oct 27 03:27:38.623976 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 943/1879] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:27:38 2022] GET /compute/v2.1/servers/49f0475c-d9eb-4ad0-9f88-322521def6c7 => generated 1307 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:27:38.629049 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0b6db4ba-9033-44dd-9f35-073c89c48970 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:38.630296 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0b6db4ba-9033-44dd-9f35-073c89c48970 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] [instance: 0fb1f450-692f-4979-a489-c13ab4106607] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:38.636679 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0b6db4ba-9033-44dd-9f35-073c89c48970 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:38.640787 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0b6db4ba-9033-44dd-9f35-073c89c48970 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:38.640787 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0b6db4ba-9033-44dd-9f35-073c89c48970 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:38.640787 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0b6db4ba-9033-44dd-9f35-073c89c48970 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:38.640787 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0b6db4ba-9033-44dd-9f35-073c89c48970 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:38.641235 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0b6db4ba-9033-44dd-9f35-073c89c48970 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:38.947840 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f40b04e0-efee-4d2d-ba3c-431643b0f546 tempest-FloatingIPDetailsTestJSON-1423882136 tempest-FloatingIPDetailsTestJSON-1423882136-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/ef5120df-020e-4ec8-98e0-f40c76913a1b" status: 202 len: 0 microversion: 2.1 time: 2.204390 Oct 27 03:27:38.948688 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 937/1880] 10.222.0.20 () {58 vars in 1263 bytes} [Thu Oct 27 03:27:36 2022] DELETE /compute/v2.1/os-floating-ips/ef5120df-020e-4ec8-98e0-f40c76913a1b => generated 0 bytes in 2206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:27:38.958065 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9349ff83-56a5-4eed-b3dc-c72975598d85 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:38.958941 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-9349ff83-56a5-4eed-b3dc-c72975598d85 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] [instance: 80bb98d2-3a48-40cd-85e4-ee8dfacbbadd] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:38.964751 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0b6db4ba-9033-44dd-9f35-073c89c48970 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b2717ace074a579d33c60964e6668a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3fc032a089f45efa4a66866a9c961c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:38.977542 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0b6db4ba-9033-44dd-9f35-073c89c48970 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] 10.222.0.20 "GET /compute/v2.1/servers/0fb1f450-692f-4979-a489-c13ab4106607" status: 200 len: 1403 microversion: 2.1 time: 0.352120 Oct 27 03:27:38.980996 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 944/1881] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:27:38 2022] GET /compute/v2.1/servers/0fb1f450-692f-4979-a489-c13ab4106607 => generated 1403 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:27:38.987023 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9349ff83-56a5-4eed-b3dc-c72975598d85 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:38.987826 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9349ff83-56a5-4eed-b3dc-c72975598d85 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:38.989526 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-96aa9869-148d-46b9-b3ef-daa4f66ddca1 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:38.990232 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9349ff83-56a5-4eed-b3dc-c72975598d85 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:38.991236 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9349ff83-56a5-4eed-b3dc-c72975598d85 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:38.992052 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-96aa9869-148d-46b9-b3ef-daa4f66ddca1 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: 62224107-28c3-40c7-b4d3-13881d1c8d65] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:38.992714 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9349ff83-56a5-4eed-b3dc-c72975598d85 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:38.995385 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9349ff83-56a5-4eed-b3dc-c72975598d85 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:39.012709 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-96aa9869-148d-46b9-b3ef-daa4f66ddca1 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:39.013794 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-96aa9869-148d-46b9-b3ef-daa4f66ddca1 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:39.014239 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-96aa9869-148d-46b9-b3ef-daa4f66ddca1 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:39.015278 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-96aa9869-148d-46b9-b3ef-daa4f66ddca1 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:39.015751 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-96aa9869-148d-46b9-b3ef-daa4f66ddca1 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:39.016186 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-96aa9869-148d-46b9-b3ef-daa4f66ddca1 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:39.139622 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-96aa9869-148d-46b9-b3ef-daa4f66ddca1 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13e05e253c94aadb1c089128ff35be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8510a519f14deea6f35a437419e161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:39.147748 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-96aa9869-148d-46b9-b3ef-daa4f66ddca1 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "GET /compute/v2.1/servers/62224107-28c3-40c7-b4d3-13881d1c8d65" status: 200 len: 1271 microversion: 2.1 time: 0.165498 Oct 27 03:27:39.165506 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 945/1882] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:27:38 2022] GET /compute/v2.1/servers/62224107-28c3-40c7-b4d3-13881d1c8d65 => generated 1271 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:27:39.337785 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9349ff83-56a5-4eed-b3dc-c72975598d85 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8640291c8745609faae41bdd731c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cee634bb1f4bb0a47f33a49f24ccdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:39.352958 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9349ff83-56a5-4eed-b3dc-c72975598d85 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] 10.222.0.20 "GET /compute/v2.1/servers/80bb98d2-3a48-40cd-85e4-ee8dfacbbadd" status: 200 len: 1324 microversion: 2.1 time: 0.399601 Oct 27 03:27:39.354650 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 938/1883] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:27:38 2022] GET /compute/v2.1/servers/80bb98d2-3a48-40cd-85e4-ee8dfacbbadd => generated 1324 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:27:39.657380 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7b78ef1d-b096-4557-99e8-22ad8797ca1b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:39.658695 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7b78ef1d-b096-4557-99e8-22ad8797ca1b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 49f0475c-d9eb-4ad0-9f88-322521def6c7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:39.671951 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7b78ef1d-b096-4557-99e8-22ad8797ca1b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:39.672832 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7b78ef1d-b096-4557-99e8-22ad8797ca1b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:39.673728 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7b78ef1d-b096-4557-99e8-22ad8797ca1b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:39.675627 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7b78ef1d-b096-4557-99e8-22ad8797ca1b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:39.676683 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7b78ef1d-b096-4557-99e8-22ad8797ca1b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:39.677919 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7b78ef1d-b096-4557-99e8-22ad8797ca1b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:39.821296 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-fa1b9fcc-78d0-43ad-ad12-f007ddd23eb9 req-88c82f3d-a108-47ac-9a76-b7e31b8e6efe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "339287fc-37b6-455d-96ab-08ab8e2c3e68", "tag": "b6134fcc-5cb7-4dad-a3b5-156ca229326d"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:27:39.842050 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-fa1b9fcc-78d0-43ad-ad12-f007ddd23eb9 req-88c82f3d-a108-47ac-9a76-b7e31b8e6efe service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:39.846132 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-fa1b9fcc-78d0-43ad-ad12-f007ddd23eb9 req-88c82f3d-a108-47ac-9a76-b7e31b8e6efe service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:39.846585 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-fa1b9fcc-78d0-43ad-ad12-f007ddd23eb9 req-88c82f3d-a108-47ac-9a76-b7e31b8e6efe service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:39.894752 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-fa1b9fcc-78d0-43ad-ad12-f007ddd23eb9 req-88c82f3d-a108-47ac-9a76-b7e31b8e6efe service nova] Creating event network-changed:b6134fcc-5cb7-4dad-a3b5-156ca229326d for instance 339287fc-37b6-455d-96ab-08ab8e2c3e68 on n-h2-862769-1 Oct 27 03:27:39.904529 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-fa1b9fcc-78d0-43ad-ad12-f007ddd23eb9 req-88c82f3d-a108-47ac-9a76-b7e31b8e6efe service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088361 Oct 27 03:27:39.910144 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 939/1884] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:27:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:27:39.925752 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-ea5c003a-a96a-4405-ab1a-76d967824493 req-976e9575-f121-45cd-9f78-d372a26e25fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49f0475c-d9eb-4ad0-9f88-322521def6c7", "name": "network-vif-plugged", "status": "completed", "tag": "2e7b6414-960b-4793-94ae-d4e9bc9cb2a7"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:27:39.960031 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-ea5c003a-a96a-4405-ab1a-76d967824493 req-976e9575-f121-45cd-9f78-d372a26e25fd service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:39.967294 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-ea5c003a-a96a-4405-ab1a-76d967824493 req-976e9575-f121-45cd-9f78-d372a26e25fd service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:39.967294 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-ea5c003a-a96a-4405-ab1a-76d967824493 req-976e9575-f121-45cd-9f78-d372a26e25fd service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:39.967294 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=100 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:27:40.001813 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-ea5c003a-a96a-4405-ab1a-76d967824493 req-976e9575-f121-45cd-9f78-d372a26e25fd service nova] Creating event network-vif-plugged:2e7b6414-960b-4793-94ae-d4e9bc9cb2a7 for instance 49f0475c-d9eb-4ad0-9f88-322521def6c7 on n-h1-862769-1 Oct 27 03:27:40.011908 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-ea5c003a-a96a-4405-ab1a-76d967824493 req-976e9575-f121-45cd-9f78-d372a26e25fd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096540 Oct 27 03:27:40.016872 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 940/1885] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:27:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:27:40.059552 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1759a43e-318e-4300-98a0-5cffca7fe725 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:40.060322 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1759a43e-318e-4300-98a0-5cffca7fe725 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] [instance: 0fb1f450-692f-4979-a489-c13ab4106607] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:40.082930 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1759a43e-318e-4300-98a0-5cffca7fe725 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:40.088463 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1759a43e-318e-4300-98a0-5cffca7fe725 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:40.088463 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1759a43e-318e-4300-98a0-5cffca7fe725 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:40.088463 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1759a43e-318e-4300-98a0-5cffca7fe725 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:40.088463 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1759a43e-318e-4300-98a0-5cffca7fe725 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:40.095490 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1759a43e-318e-4300-98a0-5cffca7fe725 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:40.224400 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:27:40.503983 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7b78ef1d-b096-4557-99e8-22ad8797ca1b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:40.529377 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7b78ef1d-b096-4557-99e8-22ad8797ca1b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/49f0475c-d9eb-4ad0-9f88-322521def6c7" status: 200 len: 1307 microversion: 2.1 time: 0.877122 Oct 27 03:27:40.535533 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 946/1886] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:27:39 2022] GET /compute/v2.1/servers/49f0475c-d9eb-4ad0-9f88-322521def6c7 => generated 1307 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:27:40.540673 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0532a3b6-579b-426a-bb98-18f4bd1d8987 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:40.544792 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0532a3b6-579b-426a-bb98-18f4bd1d8987 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: 62224107-28c3-40c7-b4d3-13881d1c8d65] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:40.560626 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0532a3b6-579b-426a-bb98-18f4bd1d8987 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:40.560626 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0532a3b6-579b-426a-bb98-18f4bd1d8987 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:40.560626 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0532a3b6-579b-426a-bb98-18f4bd1d8987 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:40.565212 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0532a3b6-579b-426a-bb98-18f4bd1d8987 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:40.566052 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0532a3b6-579b-426a-bb98-18f4bd1d8987 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:40.568573 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0532a3b6-579b-426a-bb98-18f4bd1d8987 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:40.822228 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1759a43e-318e-4300-98a0-5cffca7fe725 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b2717ace074a579d33c60964e6668a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3fc032a089f45efa4a66866a9c961c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:40.835051 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1759a43e-318e-4300-98a0-5cffca7fe725 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] 10.222.0.20 "GET /compute/v2.1/servers/0fb1f450-692f-4979-a489-c13ab4106607" status: 200 len: 1403 microversion: 2.1 time: 0.815901 Oct 27 03:27:40.836347 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 941/1887] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:27:40 2022] GET /compute/v2.1/servers/0fb1f450-692f-4979-a489-c13ab4106607 => generated 1403 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:27:40.842256 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-605a622b-0744-40ce-8ce7-2e97ee013a54 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:40.842890 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-605a622b-0744-40ce-8ce7-2e97ee013a54 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] [instance: 80bb98d2-3a48-40cd-85e4-ee8dfacbbadd] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:40.850453 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-605a622b-0744-40ce-8ce7-2e97ee013a54 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:40.851450 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-605a622b-0744-40ce-8ce7-2e97ee013a54 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:40.852547 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-605a622b-0744-40ce-8ce7-2e97ee013a54 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:40.854100 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-605a622b-0744-40ce-8ce7-2e97ee013a54 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:40.854584 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-605a622b-0744-40ce-8ce7-2e97ee013a54 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:40.855331 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-605a622b-0744-40ce-8ce7-2e97ee013a54 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:40.962853 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0532a3b6-579b-426a-bb98-18f4bd1d8987 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13e05e253c94aadb1c089128ff35be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8510a519f14deea6f35a437419e161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:40.973989 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0532a3b6-579b-426a-bb98-18f4bd1d8987 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "GET /compute/v2.1/servers/62224107-28c3-40c7-b4d3-13881d1c8d65" status: 200 len: 1313 microversion: 2.1 time: 0.436984 Oct 27 03:27:40.994458 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 947/1888] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:27:40 2022] GET /compute/v2.1/servers/62224107-28c3-40c7-b4d3-13881d1c8d65 => generated 1313 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:27:41.116693 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-aef91d21-26d1-4de1-a7e1-3846d30db3e6 req-25965d12-ce31-47cf-b45c-d2b225594086 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fb1f450-692f-4979-a489-c13ab4106607", "tag": "d7f6f05f-8194-4764-bde0-8189fafed192"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:27:41.151574 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-aef91d21-26d1-4de1-a7e1-3846d30db3e6 req-25965d12-ce31-47cf-b45c-d2b225594086 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:41.152640 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-aef91d21-26d1-4de1-a7e1-3846d30db3e6 req-25965d12-ce31-47cf-b45c-d2b225594086 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:41.153746 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-aef91d21-26d1-4de1-a7e1-3846d30db3e6 req-25965d12-ce31-47cf-b45c-d2b225594086 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:41.172358 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-aef91d21-26d1-4de1-a7e1-3846d30db3e6 req-25965d12-ce31-47cf-b45c-d2b225594086 service nova] Creating event network-changed:d7f6f05f-8194-4764-bde0-8189fafed192 for instance 0fb1f450-692f-4979-a489-c13ab4106607 on n-h2-862769-1 Oct 27 03:27:41.178389 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-aef91d21-26d1-4de1-a7e1-3846d30db3e6 req-25965d12-ce31-47cf-b45c-d2b225594086 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066329 Oct 27 03:27:41.179621 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 948/1889] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:27:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:27:41.318585 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-605a622b-0744-40ce-8ce7-2e97ee013a54 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8640291c8745609faae41bdd731c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cee634bb1f4bb0a47f33a49f24ccdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:41.331865 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-605a622b-0744-40ce-8ce7-2e97ee013a54 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] 10.222.0.20 "GET /compute/v2.1/servers/80bb98d2-3a48-40cd-85e4-ee8dfacbbadd" status: 200 len: 1520 microversion: 2.1 time: 0.493978 Oct 27 03:27:41.342748 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 942/1890] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:27:40 2022] GET /compute/v2.1/servers/80bb98d2-3a48-40cd-85e4-ee8dfacbbadd => generated 1520 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:27:41.365357 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-725576d1-8ceb-48f7-b039-2088b2c1696a tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Action: 'action', calling method: .version_select at 0x7f7ddc777af0>, body: {"addFloatingIp": {"address": "172.25.6.252"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:27:41.371388 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-725576d1-8ceb-48f7-b039-2088b2c1696a tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] [instance: 4a09478e-ae93-4bf9-b270-95cd88d88476] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:41.387025 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-725576d1-8ceb-48f7-b039-2088b2c1696a tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:41.388073 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-725576d1-8ceb-48f7-b039-2088b2c1696a tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:41.388775 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-725576d1-8ceb-48f7-b039-2088b2c1696a tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:41.389742 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-725576d1-8ceb-48f7-b039-2088b2c1696a tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:41.390683 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-725576d1-8ceb-48f7-b039-2088b2c1696a tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:41.391331 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-725576d1-8ceb-48f7-b039-2088b2c1696a tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:41.498248 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:27:41.507358 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-725576d1-8ceb-48f7-b039-2088b2c1696a tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Acquiring lock "refresh_cache-4a09478e-ae93-4bf9-b270-95cd88d88476" {{(pid=121000) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 27 03:27:41.510191 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-725576d1-8ceb-48f7-b039-2088b2c1696a tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Acquired lock "refresh_cache-4a09478e-ae93-4bf9-b270-95cd88d88476" {{(pid=121000) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 27 03:27:41.555308 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0924872a-1805-4285-8329-9fe8c3c71d76 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:41.555963 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0924872a-1805-4285-8329-9fe8c3c71d76 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 49f0475c-d9eb-4ad0-9f88-322521def6c7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:41.564667 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0924872a-1805-4285-8329-9fe8c3c71d76 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:41.565737 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0924872a-1805-4285-8329-9fe8c3c71d76 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:41.566690 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0924872a-1805-4285-8329-9fe8c3c71d76 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:41.567460 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0924872a-1805-4285-8329-9fe8c3c71d76 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:41.567919 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0924872a-1805-4285-8329-9fe8c3c71d76 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:41.568625 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0924872a-1805-4285-8329-9fe8c3c71d76 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:41.965955 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=8 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:27:42.042390 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0924872a-1805-4285-8329-9fe8c3c71d76 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:42.059467 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0924872a-1805-4285-8329-9fe8c3c71d76 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/49f0475c-d9eb-4ad0-9f88-322521def6c7" status: 200 len: 1307 microversion: 2.1 time: 0.509476 Oct 27 03:27:42.062351 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 943/1891] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:27:41 2022] GET /compute/v2.1/servers/49f0475c-d9eb-4ad0-9f88-322521def6c7 => generated 1307 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:27:42.074665 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ed799399-bd6b-4788-82d1-f7a5a4974daf tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:42.079482 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ed799399-bd6b-4788-82d1-f7a5a4974daf tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] [instance: 0fb1f450-692f-4979-a489-c13ab4106607] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:42.093183 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ed799399-bd6b-4788-82d1-f7a5a4974daf tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:42.095393 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ed799399-bd6b-4788-82d1-f7a5a4974daf tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:42.095393 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ed799399-bd6b-4788-82d1-f7a5a4974daf tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:42.095393 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ed799399-bd6b-4788-82d1-f7a5a4974daf tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:42.099177 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ed799399-bd6b-4788-82d1-f7a5a4974daf tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:42.101031 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ed799399-bd6b-4788-82d1-f7a5a4974daf tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:42.350799 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=34 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:27:42.867937 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ed799399-bd6b-4788-82d1-f7a5a4974daf tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b2717ace074a579d33c60964e6668a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3fc032a089f45efa4a66866a9c961c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:42.877691 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ed799399-bd6b-4788-82d1-f7a5a4974daf tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] 10.222.0.20 "GET /compute/v2.1/servers/0fb1f450-692f-4979-a489-c13ab4106607" status: 200 len: 1403 microversion: 2.1 time: 0.812942 Oct 27 03:27:42.886556 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 944/1892] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:27:42 2022] GET /compute/v2.1/servers/0fb1f450-692f-4979-a489-c13ab4106607 => generated 1403 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:27:42.904818 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-df119d34-e360-43d1-ba31-693f9d07fa5b tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:42.905477 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-df119d34-e360-43d1-ba31-693f9d07fa5b tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: 62224107-28c3-40c7-b4d3-13881d1c8d65] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:42.919017 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-df119d34-e360-43d1-ba31-693f9d07fa5b tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:42.920458 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-df119d34-e360-43d1-ba31-693f9d07fa5b tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:42.921119 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-df119d34-e360-43d1-ba31-693f9d07fa5b tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:42.922082 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-df119d34-e360-43d1-ba31-693f9d07fa5b tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:42.926081 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-df119d34-e360-43d1-ba31-693f9d07fa5b tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:42.926833 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-df119d34-e360-43d1-ba31-693f9d07fa5b tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:43.065620 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=20 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:27:44.125287 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-df119d34-e360-43d1-ba31-693f9d07fa5b tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13e05e253c94aadb1c089128ff35be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8510a519f14deea6f35a437419e161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:44.139237 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-df119d34-e360-43d1-ba31-693f9d07fa5b tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "GET /compute/v2.1/servers/62224107-28c3-40c7-b4d3-13881d1c8d65" status: 200 len: 1313 microversion: 2.1 time: 1.250896 Oct 27 03:27:44.140713 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 945/1893] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:27:42 2022] GET /compute/v2.1/servers/62224107-28c3-40c7-b4d3-13881d1c8d65 => generated 1313 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:27:44.147842 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6f1a545d-6fe0-44a6-869d-15aa2d11372d tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:44.148911 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-6f1a545d-6fe0-44a6-869d-15aa2d11372d tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] [instance: 135280a2-409f-4a5f-bf27-b5afe5f7694f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:44.164209 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6f1a545d-6fe0-44a6-869d-15aa2d11372d tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:44.165353 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6f1a545d-6fe0-44a6-869d-15aa2d11372d tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:44.166026 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6f1a545d-6fe0-44a6-869d-15aa2d11372d tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:44.167076 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6f1a545d-6fe0-44a6-869d-15aa2d11372d tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:44.168775 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6f1a545d-6fe0-44a6-869d-15aa2d11372d tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:44.169461 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6f1a545d-6fe0-44a6-869d-15aa2d11372d tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:44.211035 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-6f1a545d-6fe0-44a6-869d-15aa2d11372d tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] [instance: 135280a2-409f-4a5f-bf27-b5afe5f7694f] Going to try to terminate instance {{(pid=121001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:27:44.557405 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6f1a545d-6fe0-44a6-869d-15aa2d11372d tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] 10.222.0.20 "DELETE /compute/v2.1/servers/135280a2-409f-4a5f-bf27-b5afe5f7694f" status: 204 len: 0 microversion: 2.1 time: 0.414669 Oct 27 03:27:44.558811 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 946/1894] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:27:44 2022] DELETE /compute/v2.1/servers/135280a2-409f-4a5f-bf27-b5afe5f7694f => generated 0 bytes in 417 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:27:44.565337 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d1166add-3055-4f66-88a5-40e310984070 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:44.568313 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d1166add-3055-4f66-88a5-40e310984070 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 49f0475c-d9eb-4ad0-9f88-322521def6c7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:44.573531 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d1166add-3055-4f66-88a5-40e310984070 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:44.574142 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d1166add-3055-4f66-88a5-40e310984070 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:44.574694 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d1166add-3055-4f66-88a5-40e310984070 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:44.575474 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d1166add-3055-4f66-88a5-40e310984070 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:44.576102 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d1166add-3055-4f66-88a5-40e310984070 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:44.576613 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d1166add-3055-4f66-88a5-40e310984070 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:44.875533 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d1166add-3055-4f66-88a5-40e310984070 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:44.885265 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d1166add-3055-4f66-88a5-40e310984070 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/49f0475c-d9eb-4ad0-9f88-322521def6c7" status: 200 len: 1485 microversion: 2.1 time: 0.324568 Oct 27 03:27:44.885862 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 947/1895] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:27:44 2022] GET /compute/v2.1/servers/49f0475c-d9eb-4ad0-9f88-322521def6c7 => generated 1485 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:27:44.891264 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-2ae22407-43f6-455a-a48e-cd0be655a525 req-80e94e5b-c05f-4b9f-b012-31a9007177fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62224107-28c3-40c7-b4d3-13881d1c8d65", "tag": "e0db0ab6-e281-48a5-9ee5-abbdbaf11989"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:27:44.904324 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-2ae22407-43f6-455a-a48e-cd0be655a525 req-80e94e5b-c05f-4b9f-b012-31a9007177fe service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:44.908460 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-2ae22407-43f6-455a-a48e-cd0be655a525 req-80e94e5b-c05f-4b9f-b012-31a9007177fe service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:44.908460 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-2ae22407-43f6-455a-a48e-cd0be655a525 req-80e94e5b-c05f-4b9f-b012-31a9007177fe service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:44.931475 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-2ae22407-43f6-455a-a48e-cd0be655a525 req-80e94e5b-c05f-4b9f-b012-31a9007177fe service nova] Creating event network-changed:e0db0ab6-e281-48a5-9ee5-abbdbaf11989 for instance 62224107-28c3-40c7-b4d3-13881d1c8d65 on n-h2-862769-1 Oct 27 03:27:44.940153 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-2ae22407-43f6-455a-a48e-cd0be655a525 req-80e94e5b-c05f-4b9f-b012-31a9007177fe service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052710 Oct 27 03:27:44.942347 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 948/1896] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:27:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:27:44.951289 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-63e2c9c4-6900-4fd9-a514-3db5380841c6 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:44.952295 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-63e2c9c4-6900-4fd9-a514-3db5380841c6 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] [instance: 0fb1f450-692f-4979-a489-c13ab4106607] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:44.961310 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-63e2c9c4-6900-4fd9-a514-3db5380841c6 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:44.961823 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-63e2c9c4-6900-4fd9-a514-3db5380841c6 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:44.962321 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-63e2c9c4-6900-4fd9-a514-3db5380841c6 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:44.963048 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-63e2c9c4-6900-4fd9-a514-3db5380841c6 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:44.963590 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-63e2c9c4-6900-4fd9-a514-3db5380841c6 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:44.964290 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-63e2c9c4-6900-4fd9-a514-3db5380841c6 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:45.041387 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-725576d1-8ceb-48f7-b039-2088b2c1696a tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] [instance: 4a09478e-ae93-4bf9-b270-95cd88d88476] Building network info cache for instance {{(pid=121000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 27 03:27:45.293205 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-63e2c9c4-6900-4fd9-a514-3db5380841c6 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b2717ace074a579d33c60964e6668a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3fc032a089f45efa4a66866a9c961c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:45.308890 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-63e2c9c4-6900-4fd9-a514-3db5380841c6 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] 10.222.0.20 "GET /compute/v2.1/servers/0fb1f450-692f-4979-a489-c13ab4106607" status: 200 len: 1403 microversion: 2.1 time: 0.364752 Oct 27 03:27:45.326153 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 949/1897] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:27:44 2022] GET /compute/v2.1/servers/0fb1f450-692f-4979-a489-c13ab4106607 => generated 1403 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:27:45.332513 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-be1d170f-064b-4790-9f2b-2eaf48cb3dec tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:45.333364 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-be1d170f-064b-4790-9f2b-2eaf48cb3dec tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] [instance: 135280a2-409f-4a5f-bf27-b5afe5f7694f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:45.340527 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-be1d170f-064b-4790-9f2b-2eaf48cb3dec tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:45.341282 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-be1d170f-064b-4790-9f2b-2eaf48cb3dec tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:45.341912 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-be1d170f-064b-4790-9f2b-2eaf48cb3dec tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:45.342840 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-be1d170f-064b-4790-9f2b-2eaf48cb3dec tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:45.343470 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-be1d170f-064b-4790-9f2b-2eaf48cb3dec tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:45.344073 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-be1d170f-064b-4790-9f2b-2eaf48cb3dec tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:45.621506 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-be1d170f-064b-4790-9f2b-2eaf48cb3dec tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c65ddc0af5854d7a89192d01bc5f4576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c57f8e9a0e4debae18d98918ba8c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:45.629920 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-be1d170f-064b-4790-9f2b-2eaf48cb3dec tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] 10.222.0.20 "GET /compute/v2.1/servers/135280a2-409f-4a5f-bf27-b5afe5f7694f" status: 200 len: 1513 microversion: 2.1 time: 0.301860 Oct 27 03:27:45.630948 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 950/1898] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:27:45 2022] GET /compute/v2.1/servers/135280a2-409f-4a5f-bf27-b5afe5f7694f => generated 1513 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:27:45.636004 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5f51f9f9-1af6-45ef-8319-b5a91a3a7e64 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-936512256"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:27:45.638467 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5f51f9f9-1af6-45ef-8319-b5a91a3a7e64 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 49f0475c-d9eb-4ad0-9f88-322521def6c7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:45.668180 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5f51f9f9-1af6-45ef-8319-b5a91a3a7e64 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:45.668640 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5f51f9f9-1af6-45ef-8319-b5a91a3a7e64 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:45.673450 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5f51f9f9-1af6-45ef-8319-b5a91a3a7e64 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:45.673450 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5f51f9f9-1af6-45ef-8319-b5a91a3a7e64 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:45.673450 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5f51f9f9-1af6-45ef-8319-b5a91a3a7e64 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:45.673450 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5f51f9f9-1af6-45ef-8319-b5a91a3a7e64 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:45.943928 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-725576d1-8ceb-48f7-b039-2088b2c1696a tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] [instance: 4a09478e-ae93-4bf9-b270-95cd88d88476] Updating instance_info_cache with network_info: [{"id": "b7642b15-cece-4456-a1d2-fefef01ecb62", "address": "fa:16:3e:24:00:d2", "network": {"id": "81b040e4-6976-445b-88ab-1bc0d779ceb2", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-514262983-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.6.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "f1cee634bb1f4bb0a47f33a49f24ccdf", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapb7642b15-ce", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=121000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 27 03:27:46.036222 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-725576d1-8ceb-48f7-b039-2088b2c1696a tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Releasing lock "refresh_cache-4a09478e-ae93-4bf9-b270-95cd88d88476" {{(pid=121000) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 27 03:27:46.037125 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-725576d1-8ceb-48f7-b039-2088b2c1696a tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] 10.222.0.20 "POST /compute/v2.1/servers/4a09478e-ae93-4bf9-b270-95cd88d88476/action" status: 202 len: 0 microversion: 2.1 time: 4.681507 Oct 27 03:27:46.037783 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 949/1899] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:27:41 2022] POST /compute/v2.1/servers/4a09478e-ae93-4bf9-b270-95cd88d88476/action => generated 0 bytes in 4683 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 27 03:27:46.047340 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a740c389-447f-4c88-a83d-94025c42e362 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:46.047340 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a740c389-447f-4c88-a83d-94025c42e362 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: 62224107-28c3-40c7-b4d3-13881d1c8d65] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:46.050828 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a740c389-447f-4c88-a83d-94025c42e362 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:46.051558 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a740c389-447f-4c88-a83d-94025c42e362 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:46.052499 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a740c389-447f-4c88-a83d-94025c42e362 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:46.053673 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a740c389-447f-4c88-a83d-94025c42e362 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:46.054325 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a740c389-447f-4c88-a83d-94025c42e362 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:46.054923 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a740c389-447f-4c88-a83d-94025c42e362 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:46.229088 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a740c389-447f-4c88-a83d-94025c42e362 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13e05e253c94aadb1c089128ff35be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8510a519f14deea6f35a437419e161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:46.242776 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a740c389-447f-4c88-a83d-94025c42e362 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "GET /compute/v2.1/servers/62224107-28c3-40c7-b4d3-13881d1c8d65" status: 200 len: 1313 microversion: 2.1 time: 0.203852 Oct 27 03:27:46.243892 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 950/1900] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:27:46 2022] GET /compute/v2.1/servers/62224107-28c3-40c7-b4d3-13881d1c8d65 => generated 1313 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:27:46.248859 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c77ff4a4-b5b8-45f9-b205-b715ab5c7eb4 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.6.252"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:27:46.252636 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c77ff4a4-b5b8-45f9-b205-b715ab5c7eb4 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] [instance: 80bb98d2-3a48-40cd-85e4-ee8dfacbbadd] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:46.260001 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c77ff4a4-b5b8-45f9-b205-b715ab5c7eb4 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:46.260581 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c77ff4a4-b5b8-45f9-b205-b715ab5c7eb4 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:46.261107 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c77ff4a4-b5b8-45f9-b205-b715ab5c7eb4 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:46.261901 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c77ff4a4-b5b8-45f9-b205-b715ab5c7eb4 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:46.262464 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c77ff4a4-b5b8-45f9-b205-b715ab5c7eb4 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:46.262990 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c77ff4a4-b5b8-45f9-b205-b715ab5c7eb4 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:46.308749 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c77ff4a4-b5b8-45f9-b205-b715ab5c7eb4 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Acquiring lock "refresh_cache-80bb98d2-3a48-40cd-85e4-ee8dfacbbadd" {{(pid=121000) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 27 03:27:46.308749 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c77ff4a4-b5b8-45f9-b205-b715ab5c7eb4 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Acquired lock "refresh_cache-80bb98d2-3a48-40cd-85e4-ee8dfacbbadd" {{(pid=121000) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 27 03:27:50.146758 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.network.neutron [None req-c77ff4a4-b5b8-45f9-b205-b715ab5c7eb4 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] [instance: 80bb98d2-3a48-40cd-85e4-ee8dfacbbadd] re-assign floating IP 172.25.6.252 from instance 4a09478e-ae93-4bf9-b270-95cd88d88476 Oct 27 03:27:50.195609 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-c77ff4a4-b5b8-45f9-b205-b715ab5c7eb4 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] [instance: 4a09478e-ae93-4bf9-b270-95cd88d88476] Building network info cache for instance {{(pid=121000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 27 03:27:50.868964 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-c77ff4a4-b5b8-45f9-b205-b715ab5c7eb4 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] [instance: 4a09478e-ae93-4bf9-b270-95cd88d88476] Updating instance_info_cache with network_info: [{"id": "b7642b15-cece-4456-a1d2-fefef01ecb62", "address": "fa:16:3e:24:00:d2", "network": {"id": "81b040e4-6976-445b-88ab-1bc0d779ceb2", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-514262983-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "f1cee634bb1f4bb0a47f33a49f24ccdf", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapb7642b15-ce", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=121000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 27 03:27:50.945322 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-c77ff4a4-b5b8-45f9-b205-b715ab5c7eb4 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] [instance: 80bb98d2-3a48-40cd-85e4-ee8dfacbbadd] Building network info cache for instance {{(pid=121000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 27 03:27:51.639913 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-c77ff4a4-b5b8-45f9-b205-b715ab5c7eb4 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] [instance: 80bb98d2-3a48-40cd-85e4-ee8dfacbbadd] Updating instance_info_cache with network_info: [{"id": "2bbb3e1d-9309-4282-a03e-4c3ee27880e4", "address": "fa:16:3e:38:ec:81", "network": {"id": "81b040e4-6976-445b-88ab-1bc0d779ceb2", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-514262983-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.6.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "f1cee634bb1f4bb0a47f33a49f24ccdf", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap2bbb3e1d-93", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=121000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 27 03:27:51.693256 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c77ff4a4-b5b8-45f9-b205-b715ab5c7eb4 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Releasing lock "refresh_cache-80bb98d2-3a48-40cd-85e4-ee8dfacbbadd" {{(pid=121000) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 27 03:27:51.694397 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c77ff4a4-b5b8-45f9-b205-b715ab5c7eb4 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] 10.222.0.20 "POST /compute/v2.1/servers/80bb98d2-3a48-40cd-85e4-ee8dfacbbadd/action" status: 202 len: 0 microversion: 2.1 time: 5.449200 Oct 27 03:27:51.695444 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 951/1901] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:27:46 2022] POST /compute/v2.1/servers/80bb98d2-3a48-40cd-85e4-ee8dfacbbadd/action => generated 0 bytes in 5451 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 27 03:27:51.711060 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-62e86114-4fb9-4847-b1c0-0074a480424f tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:51.712150 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-62e86114-4fb9-4847-b1c0-0074a480424f tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] [instance: 0fb1f450-692f-4979-a489-c13ab4106607] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:51.725415 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-62e86114-4fb9-4847-b1c0-0074a480424f tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:51.727298 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-62e86114-4fb9-4847-b1c0-0074a480424f tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:51.729521 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-62e86114-4fb9-4847-b1c0-0074a480424f tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:51.730557 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-62e86114-4fb9-4847-b1c0-0074a480424f tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:51.733466 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-62e86114-4fb9-4847-b1c0-0074a480424f tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:51.734155 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-62e86114-4fb9-4847-b1c0-0074a480424f tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:51.892841 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-62e86114-4fb9-4847-b1c0-0074a480424f tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b2717ace074a579d33c60964e6668a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3fc032a089f45efa4a66866a9c961c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:51.902118 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-62e86114-4fb9-4847-b1c0-0074a480424f tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] 10.222.0.20 "GET /compute/v2.1/servers/0fb1f450-692f-4979-a489-c13ab4106607" status: 200 len: 1403 microversion: 2.1 time: 0.204153 Oct 27 03:27:51.902754 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 952/1902] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:27:51 2022] GET /compute/v2.1/servers/0fb1f450-692f-4979-a489-c13ab4106607 => generated 1403 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:27:51.908117 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8826a2f3-16ac-4a03-8561-a45e8454cda3 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:51.910889 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8826a2f3-16ac-4a03-8561-a45e8454cda3 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] [instance: 135280a2-409f-4a5f-bf27-b5afe5f7694f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:51.912966 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:27:51.918871 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8826a2f3-16ac-4a03-8561-a45e8454cda3 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:51.919373 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8826a2f3-16ac-4a03-8561-a45e8454cda3 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:51.919819 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8826a2f3-16ac-4a03-8561-a45e8454cda3 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:51.920537 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8826a2f3-16ac-4a03-8561-a45e8454cda3 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:51.920997 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8826a2f3-16ac-4a03-8561-a45e8454cda3 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:51.921418 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8826a2f3-16ac-4a03-8561-a45e8454cda3 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:51.935894 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-8826a2f3-16ac-4a03-8561-a45e8454cda3 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] HTTP exception thrown: Instance 135280a2-409f-4a5f-bf27-b5afe5f7694f could not be found. Oct 27 03:27:51.937844 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8826a2f3-16ac-4a03-8561-a45e8454cda3 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Request method failure captured: Oct 27 03:27:51.937844 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/135280a2-409f-4a5f-bf27-b5afe5f7694f HTTP/1.1 Oct 27 03:27:51.937844 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:27:51.937844 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:27:51.937844 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:27:51.937844 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:27:51.937844 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:27:51.937844 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:27:51.937844 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:27:51.937844 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:27:51.937844 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfoWUQL4FZlqmwwkfGEpN7us1p8KurLX2ZpnxBj9maIvCpbLnoG_A_YjQ2Qg9yKC41-47wRu0q590Mdmkc9aq7OPyw0F63hvi5oJri__sp9GEOn9Zs0stma5XDc6YXzFyEAO4m8JqZlfTjuQAsWrY6RTzSdJEG7jl5i7gZytzbfNjvQ Oct 27 03:27:51.937844 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:27:51.937844 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:27:51.937844 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:27:51.937844 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:27:51.937844 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:27:51.937844 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:27:51.937844 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 59c57f8e9a0e4debae18d98918ba8c2f Oct 27 03:27:51.937844 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-VolumesAdminNegativeTest-1455275401 Oct 27 03:27:51.937844 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:27:51.937844 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:27:51.939714 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59c57f8e9a0e4debae18d98918ba8c2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/59c57f8e9a0e4debae18d98918ba8c2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59c57f8e9a0e4debae18d98918ba8c2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_59c57f8e9a0e4debae18d98918ba8c2f"}]}] Oct 27 03:27:51.939714 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-VolumesAdminNegativeTest-1455275401 Oct 27 03:27:51.939714 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 59c57f8e9a0e4debae18d98918ba8c2f Oct 27 03:27:51.939714 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1455275401 Oct 27 03:27:51.939714 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-VolumesAdminNegativeTest-1455275401-project Oct 27 03:27:51.939714 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:27:51.939714 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:27:51.939714 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: c65ddc0af5854d7a89192d01bc5f4576 Oct 27 03:27:51.939714 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-VolumesAdminNegativeTest-1455275401-project Oct 27 03:27:51.939714 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:27:51.939714 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 135280a2-409f-4a5f-bf27-b5afe5f7694f could not be found. Oct 27 03:27:51.939714 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '135280a2-409f-4a5f-bf27-b5afe5f7694f'} Oct 27 03:27:51.941365 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:27:51.941365 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:27:51.941365 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:27:51.941365 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:27:51.941365 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:27:51.941365 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:27:51.941365 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:27:51.941365 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:27:51.941365 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:27:51.941365 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:27:51.941365 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 135280a2-409f-4a5f-bf27-b5afe5f7694f could not be found. Oct 27 03:27:51.941365 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:27:51.941365 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:27:51.941365 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:27:51.941365 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:27:51.941365 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:27:51.941365 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:27:51.941365 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:27:51.941365 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:27:51.941365 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:27:51.945607 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:27:51.945607 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:27:51.945607 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:27:51.945607 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:27:51.945607 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:27:51.945607 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:27:51.945607 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:27:51.945607 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 135280a2-409f-4a5f-bf27-b5afe5f7694f could not be found. Oct 27 03:27:51.945607 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:27:51.945607 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:27:51.945607 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:27:51.945607 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:27:51.945607 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:27:51.945607 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:27:51.945607 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:27:51.945607 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:27:51.945607 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 135280a2-409f-4a5f-bf27-b5afe5f7694f could not be found. Oct 27 03:27:51.945607 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:27:51.947363 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8826a2f3-16ac-4a03-8561-a45e8454cda3 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Returning 404 to user: Instance 135280a2-409f-4a5f-bf27-b5afe5f7694f could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:27:51.947363 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8826a2f3-16ac-4a03-8561-a45e8454cda3 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] 10.222.0.20 "GET /compute/v2.1/servers/135280a2-409f-4a5f-bf27-b5afe5f7694f" status: 404 len: 111 microversion: 2.1 time: 0.034940 Oct 27 03:27:51.947363 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 953/1903] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:27:51 2022] GET /compute/v2.1/servers/135280a2-409f-4a5f-bf27-b5afe5f7694f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:27:51.947363 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-b4e9783b-f1db-4c32-9555-f7df7f650736 req-d91ea269-1993-43b1-aea8-ee37c639546a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a09478e-ae93-4bf9-b270-95cd88d88476", "tag": "b7642b15-cece-4456-a1d2-fefef01ecb62"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:27:51.957276 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-b4e9783b-f1db-4c32-9555-f7df7f650736 req-d91ea269-1993-43b1-aea8-ee37c639546a service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:51.957756 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-b4e9783b-f1db-4c32-9555-f7df7f650736 req-d91ea269-1993-43b1-aea8-ee37c639546a service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:51.958218 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-b4e9783b-f1db-4c32-9555-f7df7f650736 req-d91ea269-1993-43b1-aea8-ee37c639546a service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:51.978736 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-b4e9783b-f1db-4c32-9555-f7df7f650736 req-d91ea269-1993-43b1-aea8-ee37c639546a service nova] Creating event network-changed:b7642b15-cece-4456-a1d2-fefef01ecb62 for instance 4a09478e-ae93-4bf9-b270-95cd88d88476 on n-h1-862769-1 Oct 27 03:27:51.984043 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-b4e9783b-f1db-4c32-9555-f7df7f650736 req-d91ea269-1993-43b1-aea8-ee37c639546a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043093 Oct 27 03:27:51.984722 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 954/1904] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:27:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:27:51.990885 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-06027635-de06-44b6-8a03-203595a3e93e req-2bba9d08-36a1-47ca-8939-fb3dcaddc319 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "339287fc-37b6-455d-96ab-08ab8e2c3e68", "name": "network-vif-plugged", "status": "completed", "tag": "b6134fcc-5cb7-4dad-a3b5-156ca229326d"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:27:52.000825 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-06027635-de06-44b6-8a03-203595a3e93e req-2bba9d08-36a1-47ca-8939-fb3dcaddc319 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:52.001311 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-06027635-de06-44b6-8a03-203595a3e93e req-2bba9d08-36a1-47ca-8939-fb3dcaddc319 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:52.002144 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-06027635-de06-44b6-8a03-203595a3e93e req-2bba9d08-36a1-47ca-8939-fb3dcaddc319 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:52.022415 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-06027635-de06-44b6-8a03-203595a3e93e req-2bba9d08-36a1-47ca-8939-fb3dcaddc319 service nova] Creating event network-vif-plugged:b6134fcc-5cb7-4dad-a3b5-156ca229326d for instance 339287fc-37b6-455d-96ab-08ab8e2c3e68 on n-h2-862769-1 Oct 27 03:27:52.082265 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-06027635-de06-44b6-8a03-203595a3e93e req-2bba9d08-36a1-47ca-8939-fb3dcaddc319 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038976 Oct 27 03:27:52.082265 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 955/1905] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:27:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:27:52.082265 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0d075d63-d096-4929-bf20-08cb50ca17e2 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:52.082265 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0d075d63-d096-4929-bf20-08cb50ca17e2 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: 62224107-28c3-40c7-b4d3-13881d1c8d65] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:52.082265 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0d075d63-d096-4929-bf20-08cb50ca17e2 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:52.083582 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0d075d63-d096-4929-bf20-08cb50ca17e2 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:52.083582 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0d075d63-d096-4929-bf20-08cb50ca17e2 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:52.083582 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0d075d63-d096-4929-bf20-08cb50ca17e2 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:52.083582 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0d075d63-d096-4929-bf20-08cb50ca17e2 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:52.084088 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0d075d63-d096-4929-bf20-08cb50ca17e2 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:52.386853 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0d075d63-d096-4929-bf20-08cb50ca17e2 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13e05e253c94aadb1c089128ff35be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8510a519f14deea6f35a437419e161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:52.398130 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0d075d63-d096-4929-bf20-08cb50ca17e2 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "GET /compute/v2.1/servers/62224107-28c3-40c7-b4d3-13881d1c8d65" status: 200 len: 1313 microversion: 2.1 time: 0.370952 Oct 27 03:27:52.398990 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 956/1906] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:27:52 2022] GET /compute/v2.1/servers/62224107-28c3-40c7-b4d3-13881d1c8d65 => generated 1313 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:27:52.550735 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-79719901-84dc-4556-9b8e-26c91a8e9f30 tempest-ListImageFiltersNegativeTestJSON-374951220 tempest-ListImageFiltersNegativeTestJSON-374951220-project] Calling method '.version_select at 0x7f7ddecc1c10>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:54.327320 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-79719901-84dc-4556-9b8e-26c91a8e9f30 tempest-ListImageFiltersNegativeTestJSON-374951220 tempest-ListImageFiltersNegativeTestJSON-374951220-project] HTTP exception thrown: Image not found. Oct 27 03:27:54.380177 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-79719901-84dc-4556-9b8e-26c91a8e9f30 tempest-ListImageFiltersNegativeTestJSON-374951220 tempest-ListImageFiltersNegativeTestJSON-374951220-project] Request method failure captured: Oct 27 03:27:54.380177 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/images/6f2a07c0-9cef-4e01-9020-57e731c1c867 HTTP/1.1 Oct 27 03:27:54.380177 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:27:54.380177 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:27:54.380177 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:27:54.380177 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:27:54.380177 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:27:54.380177 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:27:54.380177 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:27:54.380177 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:27:54.380177 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfq1mcWgTyP6uyS-GzCAqgzAeTxgtDzdQ17vC4wJCN0gqvOMUOghJp3apg-vUSjtUMhxSJno3wXEsDb9jBpIgS9HHCfbGdU2XTFNjJAHM9kbxTBE0rRZluR0O-eYX0Nvtb2UrpzOl0sMZa2bCibHBPn_8-ixxfjvm72FpMnRbesAiKk Oct 27 03:27:54.380177 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:27:54.380177 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:27:54.380177 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:27:54.380177 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:27:54.380177 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:27:54.380177 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:27:54.380177 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 1f7dfa065e7b4497a76e6b7bb02f5e2f Oct 27 03:27:54.380177 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-374951220 Oct 27 03:27:54.380177 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:27:54.380177 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:27:54.381781 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1f7dfa065e7b4497a76e6b7bb02f5e2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1f7dfa065e7b4497a76e6b7bb02f5e2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1f7dfa065e7b4497a76e6b7bb02f5e2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1f7dfa065e7b4497a76e6b7bb02f5e2f"}]}] Oct 27 03:27:54.381781 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-374951220 Oct 27 03:27:54.381781 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 1f7dfa065e7b4497a76e6b7bb02f5e2f Oct 27 03:27:54.381781 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-374951220 Oct 27 03:27:54.381781 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ListImageFiltersNegativeTestJSON-374951220-project Oct 27 03:27:54.381781 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:27:54.381781 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:27:54.381781 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 98252f131a4e4d8ba7e1e340dafbeea3 Oct 27 03:27:54.381781 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-374951220-project Oct 27 03:27:54.381781 n-d-862769-1 devstack@n-api.service[121000]: method: Oct 27 03:27:54.381781 n-d-862769-1 devstack@n-api.service[121000]: exception: Image not found. Oct 27 03:27:54.381781 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '6f2a07c0-9cef-4e01-9020-57e731c1c867'} Oct 27 03:27:54.381781 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:27:54.382743 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:27:54.382743 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 27 03:27:54.382743 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 27 03:27:54.382743 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 03:27:54.382743 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 03:27:54.382743 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 27 03:27:54.382743 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 27 03:27:54.382743 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 03:27:54.382743 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 03:27:54.382743 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 27 03:27:54.382743 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 27 03:27:54.382743 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 27 03:27:54.382743 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 27 03:27:54.382743 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 03:27:54.382743 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 03:27:54.382743 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 03:27:54.382743 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 03:27:54.382743 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 6f2a07c0-9cef-4e01-9020-57e731c1c867 Oct 27 03:27:54.384856 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:27:54.384856 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:27:54.384856 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:27:54.384856 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:27:54.384856 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 27 03:27:54.384856 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 27 03:27:54.384856 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 27 03:27:54.384856 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 27 03:27:54.384856 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 27 03:27:54.384856 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 27 03:27:54.384856 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 27 03:27:54.384856 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 27 03:27:54.384856 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 27 03:27:54.384856 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 27 03:27:54.384856 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 03:27:54.384856 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 03:27:54.384856 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 27 03:27:54.384856 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 27 03:27:54.384856 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 03:27:54.384856 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 03:27:54.387789 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 27 03:27:54.387789 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 27 03:27:54.387789 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 27 03:27:54.387789 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 27 03:27:54.387789 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 03:27:54.387789 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 03:27:54.387789 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 03:27:54.387789 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 03:27:54.387789 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6f2a07c0-9cef-4e01-9020-57e731c1c867 could not be found. Oct 27 03:27:54.387789 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:27:54.387789 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:27:54.387789 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:27:54.387789 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:27:54.387789 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:27:54.387789 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:27:54.387789 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:27:54.387789 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:27:54.387789 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:27:54.387789 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:27:54.390397 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:27:54.390397 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:27:54.390397 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 27 03:27:54.390397 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 27 03:27:54.390397 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 27 03:27:54.390397 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:27:54.390397 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:27:54.390397 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:27:54.390397 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:27:54.390397 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:27:54.390397 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:27:54.390397 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:27:54.390397 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:27:54.390397 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 27 03:27:54.390397 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:27:54.394537 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-79719901-84dc-4556-9b8e-26c91a8e9f30 tempest-ListImageFiltersNegativeTestJSON-374951220 tempest-ListImageFiltersNegativeTestJSON-374951220-project] Returning 404 to user: Image not found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:27:54.395666 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-79719901-84dc-4556-9b8e-26c91a8e9f30 tempest-ListImageFiltersNegativeTestJSON-374951220 tempest-ListImageFiltersNegativeTestJSON-374951220-project] 10.222.0.20 "GET /compute/v2.1/images/6f2a07c0-9cef-4e01-9020-57e731c1c867" status: 404 len: 62 microversion: 2.1 time: 1.995530 Oct 27 03:27:54.396450 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 957/1907] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:27:52 2022] GET /compute/v2.1/images/6f2a07c0-9cef-4e01-9020-57e731c1c867 => generated 62 bytes in 1997 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 03:27:54.404830 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8aa7c663-a162-4ac1-aaac-7f851c53f70c tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Action: 'action', calling method: .version_select at 0x7f7ddc777c10>, body: {"removeFloatingIp": {"address": "172.25.6.252"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:27:54.618797 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8aa7c663-a162-4ac1-aaac-7f851c53f70c tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] [instance: 80bb98d2-3a48-40cd-85e4-ee8dfacbbadd] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:54.625023 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8aa7c663-a162-4ac1-aaac-7f851c53f70c tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:54.625521 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8aa7c663-a162-4ac1-aaac-7f851c53f70c tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:54.625956 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8aa7c663-a162-4ac1-aaac-7f851c53f70c tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:54.626819 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8aa7c663-a162-4ac1-aaac-7f851c53f70c tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:54.627289 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8aa7c663-a162-4ac1-aaac-7f851c53f70c tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:54.627705 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8aa7c663-a162-4ac1-aaac-7f851c53f70c tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:54.758430 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5f51f9f9-1af6-45ef-8319-b5a91a3a7e64 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "POST /compute/v2.1/servers/49f0475c-d9eb-4ad0-9f88-322521def6c7/action" status: 202 len: 0 microversion: 2.1 time: 9.125942 Oct 27 03:27:54.766774 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 951/1908] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:27:45 2022] POST /compute/v2.1/servers/49f0475c-d9eb-4ad0-9f88-322521def6c7/action => generated 0 bytes in 9135 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 27 03:27:54.782135 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-50f9f72b-367b-48c8-ada8-70784bc8b660 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:54.786344 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-50f9f72b-367b-48c8-ada8-70784bc8b660 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] [instance: 0fb1f450-692f-4979-a489-c13ab4106607] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:54.787030 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:27:54.793835 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-50f9f72b-367b-48c8-ada8-70784bc8b660 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:54.795058 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-50f9f72b-367b-48c8-ada8-70784bc8b660 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:54.795848 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-50f9f72b-367b-48c8-ada8-70784bc8b660 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:54.796735 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-50f9f72b-367b-48c8-ada8-70784bc8b660 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:54.797205 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-50f9f72b-367b-48c8-ada8-70784bc8b660 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:54.797644 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-50f9f72b-367b-48c8-ada8-70784bc8b660 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:55.041680 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-50f9f72b-367b-48c8-ada8-70784bc8b660 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b2717ace074a579d33c60964e6668a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3fc032a089f45efa4a66866a9c961c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:55.064902 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-50f9f72b-367b-48c8-ada8-70784bc8b660 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] 10.222.0.20 "GET /compute/v2.1/servers/0fb1f450-692f-4979-a489-c13ab4106607" status: 200 len: 1403 microversion: 2.1 time: 0.296180 Oct 27 03:27:55.065531 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 952/1909] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:27:54 2022] GET /compute/v2.1/servers/0fb1f450-692f-4979-a489-c13ab4106607 => generated 1403 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:27:55.080374 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-fcc1a42a-d098-4066-be52-d4d1afe0d161 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:55.082957 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-fcc1a42a-d098-4066-be52-d4d1afe0d161 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: 62224107-28c3-40c7-b4d3-13881d1c8d65] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:55.101613 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fcc1a42a-d098-4066-be52-d4d1afe0d161 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:55.102790 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fcc1a42a-d098-4066-be52-d4d1afe0d161 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:55.103672 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fcc1a42a-d098-4066-be52-d4d1afe0d161 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:55.106315 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fcc1a42a-d098-4066-be52-d4d1afe0d161 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:55.107689 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fcc1a42a-d098-4066-be52-d4d1afe0d161 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:55.109341 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fcc1a42a-d098-4066-be52-d4d1afe0d161 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:55.305684 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-8aa7c663-a162-4ac1-aaac-7f851c53f70c tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] HTTP exception thrown: Floating IP 172.25.6.252 is not associated with instance 4a09478e-ae93-4bf9-b270-95cd88d88476. Oct 27 03:27:55.306835 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8aa7c663-a162-4ac1-aaac-7f851c53f70c tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Request method failure captured: Oct 27 03:27:55.306835 n-d-862769-1 devstack@n-api.service[121000]: request: POST /compute/v2.1/servers/4a09478e-ae93-4bf9-b270-95cd88d88476/action HTTP/1.1 Oct 27 03:27:55.306835 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:27:55.306835 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:27:55.306835 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:27:55.306835 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 49 Oct 27 03:27:55.306835 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:27:55.306835 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:27:55.306835 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:27:55.306835 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:27:55.306835 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfpxqXTQ_iW0ArXs975gZDY7uwJ5nHAF4hg8CDCuM3uj2pg20HzuZSTMGIAavvX9tg8x18_38hYZf-6YPCL1tkP6V8Q65rooyC_Nub0n_uQDqVJuEHOO4RnH61oKbBP3mHbYyV4YslidXoGUJNOsCvML8l67_M2-TEZbrHodlzZq55s Oct 27 03:27:55.306835 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:27:55.306835 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:27:55.306835 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:27:55.306835 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:27:55.306835 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:27:55.306835 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:27:55.306835 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: f1cee634bb1f4bb0a47f33a49f24ccdf Oct 27 03:27:55.306835 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-606388594 Oct 27 03:27:55.306835 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:27:55.306835 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:27:55.308335 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f1cee634bb1f4bb0a47f33a49f24ccdf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f1cee634bb1f4bb0a47f33a49f24ccdf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f1cee634bb1f4bb0a47f33a49f24ccdf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f1cee634bb1f4bb0a47f33a49f24ccdf"}]}] Oct 27 03:27:55.308335 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-606388594 Oct 27 03:27:55.308335 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: f1cee634bb1f4bb0a47f33a49f24ccdf Oct 27 03:27:55.308335 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-606388594 Oct 27 03:27:55.308335 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-FloatingIPsAssociationTestJSON-606388594-project Oct 27 03:27:55.308335 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:27:55.308335 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:27:55.308335 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 8e8640291c8745609faae41bdd731c17 Oct 27 03:27:55.308335 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-606388594-project Oct 27 03:27:55.308335 n-d-862769-1 devstack@n-api.service[121000]: Oct 27 03:27:55.308335 n-d-862769-1 devstack@n-api.service[121000]: {"removeFloatingIp": {"address": "172.25.6.252"}} Oct 27 03:27:55.308335 n-d-862769-1 devstack@n-api.service[121000]: method: Oct 27 03:27:55.308335 n-d-862769-1 devstack@n-api.service[121000]: exception: Floating IP 172.25.6.252 is not associated with instance 4a09478e-ae93-4bf9-b270-95cd88d88476. Oct 27 03:27:55.309293 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '4a09478e-ae93-4bf9-b270-95cd88d88476', 'body': {'removeFloatingIp': {'address': '172.25.6.252'}}} Oct 27 03:27:55.309293 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:27:55.309293 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:27:55.309293 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:27:55.309293 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:27:55.309293 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:27:55.309293 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:27:55.309293 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:27:55.309293 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:27:55.309293 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:27:55.309293 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:27:55.309293 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:27:55.309293 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:27:55.309293 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Oct 27 03:27:55.309293 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 27 03:27:55.309293 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.6.252 is not associated with instance 4a09478e-ae93-4bf9-b270-95cd88d88476. Oct 27 03:27:55.309293 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:27:55.309293 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:27:55.309293 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:27:55.309293 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:27:55.310710 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:27:55.310710 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:27:55.310710 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:27:55.310710 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:27:55.310710 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.6.252 is not associated with instance 4a09478e-ae93-4bf9-b270-95cd88d88476. Oct 27 03:27:55.310710 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:27:55.310710 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8aa7c663-a162-4ac1-aaac-7f851c53f70c tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Returning 409 to user: Floating IP 172.25.6.252 is not associated with instance 4a09478e-ae93-4bf9-b270-95cd88d88476. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:27:55.310710 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8aa7c663-a162-4ac1-aaac-7f851c53f70c tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] 10.222.0.20 "POST /compute/v2.1/servers/4a09478e-ae93-4bf9-b270-95cd88d88476/action" status: 409 len: 146 microversion: 2.1 time: 0.909690 Oct 27 03:27:55.312339 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 958/1910] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:27:54 2022] POST /compute/v2.1/servers/4a09478e-ae93-4bf9-b270-95cd88d88476/action => generated 146 bytes in 915 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 27 03:27:55.318985 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-eaff3312-2306-4951-b806-c261b8ca6b0f req-537ade9e-90b2-48fd-8525-f2c091b40c8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "135280a2-409f-4a5f-bf27-b5afe5f7694f", "name": "network-vif-deleted", "tag": "e44acda3-786a-423e-9885-daa65c21586b"}, {"name": "network-changed", "server_uuid": "4a09478e-ae93-4bf9-b270-95cd88d88476", "tag": "b7642b15-cece-4456-a1d2-fefef01ecb62"}, {"name": "network-changed", "server_uuid": "80bb98d2-3a48-40cd-85e4-ee8dfacbbadd", "tag": "2bbb3e1d-9309-4282-a03e-4c3ee27880e4"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:27:55.333134 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-eaff3312-2306-4951-b806-c261b8ca6b0f req-537ade9e-90b2-48fd-8525-f2c091b40c8e service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:55.333802 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-eaff3312-2306-4951-b806-c261b8ca6b0f req-537ade9e-90b2-48fd-8525-f2c091b40c8e service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:55.334050 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-eaff3312-2306-4951-b806-c261b8ca6b0f req-537ade9e-90b2-48fd-8525-f2c091b40c8e service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:55.350883 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-eaff3312-2306-4951-b806-c261b8ca6b0f req-537ade9e-90b2-48fd-8525-f2c091b40c8e service nova] Creating event network-vif-deleted:e44acda3-786a-423e-9885-daa65c21586b for instance 135280a2-409f-4a5f-bf27-b5afe5f7694f on n-h2-862769-1 Oct 27 03:27:55.351394 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-eaff3312-2306-4951-b806-c261b8ca6b0f req-537ade9e-90b2-48fd-8525-f2c091b40c8e service nova] Creating event network-changed:b7642b15-cece-4456-a1d2-fefef01ecb62 for instance 4a09478e-ae93-4bf9-b270-95cd88d88476 on n-h1-862769-1 Oct 27 03:27:55.351902 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-eaff3312-2306-4951-b806-c261b8ca6b0f req-537ade9e-90b2-48fd-8525-f2c091b40c8e service nova] Creating event network-changed:2bbb3e1d-9309-4282-a03e-4c3ee27880e4 for instance 80bb98d2-3a48-40cd-85e4-ee8dfacbbadd on n-h2-862769-1 Oct 27 03:27:55.364377 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-eaff3312-2306-4951-b806-c261b8ca6b0f req-537ade9e-90b2-48fd-8525-f2c091b40c8e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 517 microversion: 2.1 time: 0.050345 Oct 27 03:27:55.369418 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 959/1911] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:27:55 2022] POST /compute/v2.1/os-server-external-events => generated 517 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:27:55.376300 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-a6b45fd4-5830-44a3-ae8e-7f15b3ae9f4a req-174f1980-de25-41bb-9142-1a668e7470b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62224107-28c3-40c7-b4d3-13881d1c8d65", "name": "network-vif-plugged", "status": "completed", "tag": "e0db0ab6-e281-48a5-9ee5-abbdbaf11989"}, {"server_uuid": "0fb1f450-692f-4979-a489-c13ab4106607", "name": "network-vif-plugged", "status": "completed", "tag": "d7f6f05f-8194-4764-bde0-8189fafed192"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:27:55.388760 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-a6b45fd4-5830-44a3-ae8e-7f15b3ae9f4a req-174f1980-de25-41bb-9142-1a668e7470b9 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:55.390085 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-a6b45fd4-5830-44a3-ae8e-7f15b3ae9f4a req-174f1980-de25-41bb-9142-1a668e7470b9 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:55.390696 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-a6b45fd4-5830-44a3-ae8e-7f15b3ae9f4a req-174f1980-de25-41bb-9142-1a668e7470b9 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:55.418286 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-a6b45fd4-5830-44a3-ae8e-7f15b3ae9f4a req-174f1980-de25-41bb-9142-1a668e7470b9 service nova] Creating event network-vif-plugged:e0db0ab6-e281-48a5-9ee5-abbdbaf11989 for instance 62224107-28c3-40c7-b4d3-13881d1c8d65 on n-h2-862769-1 Oct 27 03:27:55.419159 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-a6b45fd4-5830-44a3-ae8e-7f15b3ae9f4a req-174f1980-de25-41bb-9142-1a668e7470b9 service nova] Creating event network-vif-plugged:d7f6f05f-8194-4764-bde0-8189fafed192 for instance 0fb1f450-692f-4979-a489-c13ab4106607 on n-h2-862769-1 Oct 27 03:27:55.435813 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-a6b45fd4-5830-44a3-ae8e-7f15b3ae9f4a req-174f1980-de25-41bb-9142-1a668e7470b9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.061820 Oct 27 03:27:55.447290 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 960/1912] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:27:55 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:27:55.459858 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d457f312-21d1-4121-be39-14702b9da258 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7ddecc1700>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:55.468236 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-fcc1a42a-d098-4066-be52-d4d1afe0d161 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13e05e253c94aadb1c089128ff35be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8510a519f14deea6f35a437419e161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:55.479513 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-fcc1a42a-d098-4066-be52-d4d1afe0d161 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "GET /compute/v2.1/servers/62224107-28c3-40c7-b4d3-13881d1c8d65" status: 200 len: 1313 microversion: 2.1 time: 0.410941 Oct 27 03:27:55.495651 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 953/1913] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:27:55 2022] GET /compute/v2.1/servers/62224107-28c3-40c7-b4d3-13881d1c8d65 => generated 1313 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:27:55.501109 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-31abbdb6-f248-4840-88c0-98047af68c09 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Action: 'action', calling method: .version_select at 0x7f7ddc777c10>, body: {"removeFloatingIp": {"address": "172.25.6.252"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:27:55.547959 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d457f312-21d1-4121-be39-14702b9da258 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/images/787934da-f249-4af1-9590-fecf6bc5d90f" status: 200 len: 1413 microversion: 2.1 time: 0.099049 Oct 27 03:27:55.555820 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 961/1914] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:27:55 2022] GET /compute/v2.1/images/787934da-f249-4af1-9590-fecf6bc5d90f => generated 1413 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:27:55.888818 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-31abbdb6-f248-4840-88c0-98047af68c09 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] [instance: 80bb98d2-3a48-40cd-85e4-ee8dfacbbadd] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:55.902453 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-31abbdb6-f248-4840-88c0-98047af68c09 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:55.903536 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-31abbdb6-f248-4840-88c0-98047af68c09 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:55.904975 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-31abbdb6-f248-4840-88c0-98047af68c09 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:55.906410 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-31abbdb6-f248-4840-88c0-98047af68c09 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:55.907078 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-31abbdb6-f248-4840-88c0-98047af68c09 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:55.907973 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-31abbdb6-f248-4840-88c0-98047af68c09 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:56.096696 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e364ed4f-7ed1-4494-929a-1f5ceb8f4589 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:56.097827 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e364ed4f-7ed1-4494-929a-1f5ceb8f4589 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] [instance: 0fb1f450-692f-4979-a489-c13ab4106607] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:56.109163 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e364ed4f-7ed1-4494-929a-1f5ceb8f4589 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:56.110004 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e364ed4f-7ed1-4494-929a-1f5ceb8f4589 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:56.111125 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e364ed4f-7ed1-4494-929a-1f5ceb8f4589 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:56.112558 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e364ed4f-7ed1-4494-929a-1f5ceb8f4589 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:56.113323 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e364ed4f-7ed1-4494-929a-1f5ceb8f4589 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:56.113915 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e364ed4f-7ed1-4494-929a-1f5ceb8f4589 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:56.287968 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-31abbdb6-f248-4840-88c0-98047af68c09 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Acquiring lock "refresh_cache-80bb98d2-3a48-40cd-85e4-ee8dfacbbadd" {{(pid=121001) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 27 03:27:56.288636 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-31abbdb6-f248-4840-88c0-98047af68c09 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Acquired lock "refresh_cache-80bb98d2-3a48-40cd-85e4-ee8dfacbbadd" {{(pid=121001) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 27 03:27:56.391845 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e364ed4f-7ed1-4494-929a-1f5ceb8f4589 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b2717ace074a579d33c60964e6668a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3fc032a089f45efa4a66866a9c961c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:56.408713 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e364ed4f-7ed1-4494-929a-1f5ceb8f4589 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] 10.222.0.20 "GET /compute/v2.1/servers/0fb1f450-692f-4979-a489-c13ab4106607" status: 200 len: 1403 microversion: 2.1 time: 0.311991 Oct 27 03:27:56.413704 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 962/1915] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:27:56 2022] GET /compute/v2.1/servers/0fb1f450-692f-4979-a489-c13ab4106607 => generated 1403 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:27:56.505107 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9886c5d4-a62a-4720-af09-b011d5c588c1 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:56.506901 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9886c5d4-a62a-4720-af09-b011d5c588c1 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: 62224107-28c3-40c7-b4d3-13881d1c8d65] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:56.516432 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9886c5d4-a62a-4720-af09-b011d5c588c1 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:56.518106 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9886c5d4-a62a-4720-af09-b011d5c588c1 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:56.520095 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9886c5d4-a62a-4720-af09-b011d5c588c1 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:56.521063 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9886c5d4-a62a-4720-af09-b011d5c588c1 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:56.522641 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9886c5d4-a62a-4720-af09-b011d5c588c1 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:56.525265 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9886c5d4-a62a-4720-af09-b011d5c588c1 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:56.929642 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9886c5d4-a62a-4720-af09-b011d5c588c1 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13e05e253c94aadb1c089128ff35be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8510a519f14deea6f35a437419e161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:56.941625 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9886c5d4-a62a-4720-af09-b011d5c588c1 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "GET /compute/v2.1/servers/62224107-28c3-40c7-b4d3-13881d1c8d65" status: 200 len: 1313 microversion: 2.1 time: 0.442646 Oct 27 03:27:56.946479 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 963/1916] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:27:56 2022] GET /compute/v2.1/servers/62224107-28c3-40c7-b4d3-13881d1c8d65 => generated 1313 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:27:56.971815 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f2646f65-46d5-4813-a8cb-5f0807bad190 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7ddecc1a60>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:57.067847 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f2646f65-46d5-4813-a8cb-5f0807bad190 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/images/787934da-f249-4af1-9590-fecf6bc5d90f" status: 200 len: 1413 microversion: 2.1 time: 0.117008 Oct 27 03:27:57.070419 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 964/1917] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:27:56 2022] GET /compute/v2.1/images/787934da-f249-4af1-9590-fecf6bc5d90f => generated 1413 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:27:57.083081 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-cdd5a4aa-2cc1-4d13-8866-3a5478e144c2 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:57.092021 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-cdd5a4aa-2cc1-4d13-8866-3a5478e144c2 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] [instance: 1d9172bd-aa20-4f49-87fa-64300cf861be] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:57.092021 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cdd5a4aa-2cc1-4d13-8866-3a5478e144c2 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:57.092021 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cdd5a4aa-2cc1-4d13-8866-3a5478e144c2 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:57.092021 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cdd5a4aa-2cc1-4d13-8866-3a5478e144c2 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:57.092568 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cdd5a4aa-2cc1-4d13-8866-3a5478e144c2 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:57.092734 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cdd5a4aa-2cc1-4d13-8866-3a5478e144c2 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:57.093403 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cdd5a4aa-2cc1-4d13-8866-3a5478e144c2 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:57.133344 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-cdd5a4aa-2cc1-4d13-8866-3a5478e144c2 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] [instance: 1d9172bd-aa20-4f49-87fa-64300cf861be] Going to try to terminate instance {{(pid=121000) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:27:57.421155 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.network.neutron [None req-31abbdb6-f248-4840-88c0-98047af68c09 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] [instance: 80bb98d2-3a48-40cd-85e4-ee8dfacbbadd] Building network info cache for instance {{(pid=121001) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 27 03:27:57.556749 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-cdd5a4aa-2cc1-4d13-8866-3a5478e144c2 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1d9172bd-aa20-4f49-87fa-64300cf861be" status: 204 len: 0 microversion: 2.1 time: 0.483939 Oct 27 03:27:57.561689 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 965/1918] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:27:57 2022] DELETE /compute/v2.1/servers/1d9172bd-aa20-4f49-87fa-64300cf861be => generated 0 bytes in 487 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:27:57.567717 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-02ff5326-cd2d-4893-bb64-6e6395ceeace tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:57.570881 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-02ff5326-cd2d-4893-bb64-6e6395ceeace tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] [instance: 0fb1f450-692f-4979-a489-c13ab4106607] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:57.614550 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-02ff5326-cd2d-4893-bb64-6e6395ceeace tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:57.615159 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-02ff5326-cd2d-4893-bb64-6e6395ceeace tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:57.615619 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-02ff5326-cd2d-4893-bb64-6e6395ceeace tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:57.616377 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-02ff5326-cd2d-4893-bb64-6e6395ceeace tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:57.616835 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-02ff5326-cd2d-4893-bb64-6e6395ceeace tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:57.617259 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-02ff5326-cd2d-4893-bb64-6e6395ceeace tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:58.184301 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-02ff5326-cd2d-4893-bb64-6e6395ceeace tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b2717ace074a579d33c60964e6668a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3fc032a089f45efa4a66866a9c961c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:58.209606 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-02ff5326-cd2d-4893-bb64-6e6395ceeace tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] 10.222.0.20 "GET /compute/v2.1/servers/0fb1f450-692f-4979-a489-c13ab4106607" status: 200 len: 1403 microversion: 2.1 time: 0.646531 Oct 27 03:27:58.210223 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 966/1919] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:27:57 2022] GET /compute/v2.1/servers/0fb1f450-692f-4979-a489-c13ab4106607 => generated 1403 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:27:58.222784 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-4d74094c-28b1-4ed7-bb33-eb0326ba57c7 req-72a1236f-0b76-47c5-91bb-40116b6e95bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80bb98d2-3a48-40cd-85e4-ee8dfacbbadd", "tag": "2bbb3e1d-9309-4282-a03e-4c3ee27880e4"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:27:58.254250 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-4d74094c-28b1-4ed7-bb33-eb0326ba57c7 req-72a1236f-0b76-47c5-91bb-40116b6e95bb service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:58.255935 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-4d74094c-28b1-4ed7-bb33-eb0326ba57c7 req-72a1236f-0b76-47c5-91bb-40116b6e95bb service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:58.258401 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-4d74094c-28b1-4ed7-bb33-eb0326ba57c7 req-72a1236f-0b76-47c5-91bb-40116b6e95bb service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:58.286197 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-4d74094c-28b1-4ed7-bb33-eb0326ba57c7 req-72a1236f-0b76-47c5-91bb-40116b6e95bb service nova] Creating event network-changed:2bbb3e1d-9309-4282-a03e-4c3ee27880e4 for instance 80bb98d2-3a48-40cd-85e4-ee8dfacbbadd on n-h2-862769-1 Oct 27 03:27:58.292671 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-4d74094c-28b1-4ed7-bb33-eb0326ba57c7 req-72a1236f-0b76-47c5-91bb-40116b6e95bb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080132 Oct 27 03:27:58.293889 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 967/1920] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:27:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:27:58.322720 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-30ce2554-0c09-4feb-8cbc-5d1323ee7cd5 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:58.325148 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-30ce2554-0c09-4feb-8cbc-5d1323ee7cd5 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] [instance: 1d9172bd-aa20-4f49-87fa-64300cf861be] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:58.340275 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-30ce2554-0c09-4feb-8cbc-5d1323ee7cd5 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:58.341315 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-30ce2554-0c09-4feb-8cbc-5d1323ee7cd5 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:58.341951 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-30ce2554-0c09-4feb-8cbc-5d1323ee7cd5 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:58.343342 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-30ce2554-0c09-4feb-8cbc-5d1323ee7cd5 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:58.348000 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-30ce2554-0c09-4feb-8cbc-5d1323ee7cd5 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:58.348584 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-30ce2554-0c09-4feb-8cbc-5d1323ee7cd5 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:58.548764 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.network.neutron [None req-31abbdb6-f248-4840-88c0-98047af68c09 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] [instance: 80bb98d2-3a48-40cd-85e4-ee8dfacbbadd] Updating instance_info_cache with network_info: [{"id": "2bbb3e1d-9309-4282-a03e-4c3ee27880e4", "address": "fa:16:3e:38:ec:81", "network": {"id": "81b040e4-6976-445b-88ab-1bc0d779ceb2", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-514262983-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "f1cee634bb1f4bb0a47f33a49f24ccdf", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap2bbb3e1d-93", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=121001) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 27 03:27:58.556341 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:27:58.641443 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-31abbdb6-f248-4840-88c0-98047af68c09 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Releasing lock "refresh_cache-80bb98d2-3a48-40cd-85e4-ee8dfacbbadd" {{(pid=121001) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 27 03:27:58.643318 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-31abbdb6-f248-4840-88c0-98047af68c09 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] 10.222.0.20 "POST /compute/v2.1/servers/80bb98d2-3a48-40cd-85e4-ee8dfacbbadd/action" status: 202 len: 0 microversion: 2.1 time: 3.146223 Oct 27 03:27:58.649992 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 954/1921] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:27:55 2022] POST /compute/v2.1/servers/80bb98d2-3a48-40cd-85e4-ee8dfacbbadd/action => generated 0 bytes in 3150 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 27 03:27:58.658529 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-30b223fa-f9de-44d4-8b4a-3a049b8dbc2c tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:58.660258 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-30b223fa-f9de-44d4-8b4a-3a049b8dbc2c tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: 62224107-28c3-40c7-b4d3-13881d1c8d65] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:58.670540 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-30b223fa-f9de-44d4-8b4a-3a049b8dbc2c tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:58.671401 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-30b223fa-f9de-44d4-8b4a-3a049b8dbc2c tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:58.672065 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-30b223fa-f9de-44d4-8b4a-3a049b8dbc2c tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:58.680173 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-30b223fa-f9de-44d4-8b4a-3a049b8dbc2c tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:58.681170 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-30b223fa-f9de-44d4-8b4a-3a049b8dbc2c tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:58.681729 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-30b223fa-f9de-44d4-8b4a-3a049b8dbc2c tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:58.687000 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-30ce2554-0c09-4feb-8cbc-5d1323ee7cd5 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c65ddc0af5854d7a89192d01bc5f4576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c57f8e9a0e4debae18d98918ba8c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:58.690459 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=89,nova_cell1:SAVEPOINT=3,nova_cell1:UPDATE=4,nova_cell1:RELEASE=3,nova_cell1:INSERT=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:27:58.698578 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-30ce2554-0c09-4feb-8cbc-5d1323ee7cd5 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] 10.222.0.20 "GET /compute/v2.1/servers/1d9172bd-aa20-4f49-87fa-64300cf861be" status: 200 len: 1682 microversion: 2.1 time: 0.403105 Oct 27 03:27:58.699587 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 968/1922] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:27:58 2022] GET /compute/v2.1/servers/1d9172bd-aa20-4f49-87fa-64300cf861be => generated 1682 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:27:58.711942 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-25c5cdd4-83c7-4a70-8f63-0f071fab165d tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7dda075e50>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:58.787717 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-25c5cdd4-83c7-4a70-8f63-0f071fab165d tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/images/787934da-f249-4af1-9590-fecf6bc5d90f" status: 200 len: 1413 microversion: 2.1 time: 0.086743 Oct 27 03:27:58.788347 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 969/1923] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:27:58 2022] GET /compute/v2.1/images/787934da-f249-4af1-9590-fecf6bc5d90f => generated 1413 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:27:59.060380 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-30b223fa-f9de-44d4-8b4a-3a049b8dbc2c tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13e05e253c94aadb1c089128ff35be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8510a519f14deea6f35a437419e161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:59.079697 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-30b223fa-f9de-44d4-8b4a-3a049b8dbc2c tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "GET /compute/v2.1/servers/62224107-28c3-40c7-b4d3-13881d1c8d65" status: 200 len: 1463 microversion: 2.1 time: 0.426417 Oct 27 03:27:59.080600 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 955/1924] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:27:58 2022] GET /compute/v2.1/servers/62224107-28c3-40c7-b4d3-13881d1c8d65 => generated 1463 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:27:59.086657 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b3787d3d-2f64-4113-b3e3-f69b8eb4aa42 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:59.087544 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b3787d3d-2f64-4113-b3e3-f69b8eb4aa42 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] [instance: 80bb98d2-3a48-40cd-85e4-ee8dfacbbadd] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:59.097808 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b3787d3d-2f64-4113-b3e3-f69b8eb4aa42 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:59.099316 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b3787d3d-2f64-4113-b3e3-f69b8eb4aa42 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:59.099981 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b3787d3d-2f64-4113-b3e3-f69b8eb4aa42 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:59.100717 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b3787d3d-2f64-4113-b3e3-f69b8eb4aa42 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:59.101177 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b3787d3d-2f64-4113-b3e3-f69b8eb4aa42 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:59.101862 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b3787d3d-2f64-4113-b3e3-f69b8eb4aa42 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:59.128335 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-fe9d5bd2-085e-47a7-a396-cef06d184fd3 tempest-ListImagesTestJSON-1620462652 tempest-ListImagesTestJSON-1620462652-project] Calling method '.version_select at 0x7f7dda130280>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:59.143661 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b3787d3d-2f64-4113-b3e3-f69b8eb4aa42 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] [instance: 80bb98d2-3a48-40cd-85e4-ee8dfacbbadd] Going to try to terminate instance {{(pid=121001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:27:59.204025 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-fe9d5bd2-085e-47a7-a396-cef06d184fd3 tempest-ListImagesTestJSON-1620462652 tempest-ListImagesTestJSON-1620462652-project] 10.222.0.20 "GET /compute/v2.1/images/c40fb871-5877-4b59-ab69-d9fd23b7a917" status: 200 len: 784 microversion: 2.1 time: 0.413170 Oct 27 03:27:59.206987 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 970/1925] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:27:58 2022] GET /compute/v2.1/images/c40fb871-5877-4b59-ab69-d9fd23b7a917 => generated 784 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:27:59.227071 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6fa3769b-c648-4fe8-8a6a-c965414bb447 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:59.239679 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6fa3769b-c648-4fe8-8a6a-c965414bb447 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: 339287fc-37b6-455d-96ab-08ab8e2c3e68] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:59.247241 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6fa3769b-c648-4fe8-8a6a-c965414bb447 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:59.248781 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6fa3769b-c648-4fe8-8a6a-c965414bb447 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:59.249467 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6fa3769b-c648-4fe8-8a6a-c965414bb447 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:59.250406 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6fa3769b-c648-4fe8-8a6a-c965414bb447 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:59.251083 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6fa3769b-c648-4fe8-8a6a-c965414bb447 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:59.251689 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6fa3769b-c648-4fe8-8a6a-c965414bb447 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:59.498470 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-6fa3769b-c648-4fe8-8a6a-c965414bb447 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13e05e253c94aadb1c089128ff35be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8510a519f14deea6f35a437419e161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:27:59.506477 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6fa3769b-c648-4fe8-8a6a-c965414bb447 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68" status: 200 len: 1463 microversion: 2.1 time: 0.287325 Oct 27 03:27:59.520631 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 971/1926] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:27:59 2022] GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68 => generated 1463 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:27:59.550201 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ded5104d-c8d7-4629-bec7-b4284d01d875 tempest-ListImagesTestJSON-1620462652 tempest-ListImagesTestJSON-1620462652-project] Calling method '.version_select at 0x7f7dda130af0>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:59.720090 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ded5104d-c8d7-4629-bec7-b4284d01d875 tempest-ListImagesTestJSON-1620462652 tempest-ListImagesTestJSON-1620462652-project] 10.222.0.20 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.195209 Oct 27 03:27:59.732195 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 972/1927] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:27:59 2022] GET /compute/v2.1/images => generated 445 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:27:59.742846 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b8605fd0-164a-4515-a730-43582f19916c tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:27:59.756865 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b3787d3d-2f64-4113-b3e3-f69b8eb4aa42 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] 10.222.0.20 "DELETE /compute/v2.1/servers/80bb98d2-3a48-40cd-85e4-ee8dfacbbadd" status: 204 len: 0 microversion: 2.1 time: 0.674972 Oct 27 03:27:59.758532 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 956/1928] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:27:59 2022] DELETE /compute/v2.1/servers/80bb98d2-3a48-40cd-85e4-ee8dfacbbadd => generated 0 bytes in 677 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:27:59.764297 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b260f6bb-189e-4c66-8b28-b06ab94526a8 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-96744433", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "339287fc-37b6-455d-96ab-08ab8e2c3e68"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:27:59.768400 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b8605fd0-164a-4515-a730-43582f19916c tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] [instance: 0fb1f450-692f-4979-a489-c13ab4106607] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:27:59.786535 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b8605fd0-164a-4515-a730-43582f19916c tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:59.790252 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b8605fd0-164a-4515-a730-43582f19916c tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:59.790717 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b8605fd0-164a-4515-a730-43582f19916c tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:59.791469 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b8605fd0-164a-4515-a730-43582f19916c tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:27:59.791927 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b8605fd0-164a-4515-a730-43582f19916c tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:27:59.792364 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b8605fd0-164a-4515-a730-43582f19916c tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:27:59.965465 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.network.neutron [None req-b260f6bb-189e-4c66-8b28-b06ab94526a8 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] validate_networks() for None {{(pid=121001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:28:00.154561 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b8605fd0-164a-4515-a730-43582f19916c tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b2717ace074a579d33c60964e6668a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3fc032a089f45efa4a66866a9c961c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:00.163878 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b8605fd0-164a-4515-a730-43582f19916c tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] 10.222.0.20 "GET /compute/v2.1/servers/0fb1f450-692f-4979-a489-c13ab4106607" status: 200 len: 1589 microversion: 2.1 time: 0.438285 Oct 27 03:28:00.164831 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 973/1929] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:27:59 2022] GET /compute/v2.1/servers/0fb1f450-692f-4979-a489-c13ab4106607 => generated 1589 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:00.182972 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e7ad63bd-a8b8-448a-946a-a4e5ab8163b9 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:00.188620 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e7ad63bd-a8b8-448a-946a-a4e5ab8163b9 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] [instance: 1d9172bd-aa20-4f49-87fa-64300cf861be] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:00.196126 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e7ad63bd-a8b8-448a-946a-a4e5ab8163b9 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:00.200424 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e7ad63bd-a8b8-448a-946a-a4e5ab8163b9 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:00.203182 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e7ad63bd-a8b8-448a-946a-a4e5ab8163b9 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:00.207808 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e7ad63bd-a8b8-448a-946a-a4e5ab8163b9 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:00.208340 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e7ad63bd-a8b8-448a-946a-a4e5ab8163b9 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:00.208978 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e7ad63bd-a8b8-448a-946a-a4e5ab8163b9 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:00.382256 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-b260f6bb-189e-4c66-8b28-b06ab94526a8 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Flavor limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:28:00.382694 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-b260f6bb-189e-4c66-8b28-b06ab94526a8 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Image limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:28:00.383176 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-b260f6bb-189e-4c66-8b28-b06ab94526a8 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Flavor pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:28:00.383597 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-b260f6bb-189e-4c66-8b28-b06ab94526a8 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Image pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:28:00.384016 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-b260f6bb-189e-4c66-8b28-b06ab94526a8 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:28:00.393656 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b260f6bb-189e-4c66-8b28-b06ab94526a8 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:00.394686 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b260f6bb-189e-4c66-8b28-b06ab94526a8 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:00.395440 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b260f6bb-189e-4c66-8b28-b06ab94526a8 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:00.396991 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b260f6bb-189e-4c66-8b28-b06ab94526a8 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:00.400862 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b260f6bb-189e-4c66-8b28-b06ab94526a8 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:00.400862 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b260f6bb-189e-4c66-8b28-b06ab94526a8 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:00.424150 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-b260f6bb-189e-4c66-8b28-b06ab94526a8 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Getting quotas for project 2c8510a519f14deea6f35a437419e161. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:28:00.433970 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-b260f6bb-189e-4c66-8b28-b06ab94526a8 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Getting quotas for user c13e05e253c94aadb1c089128ff35be5 and project 2c8510a519f14deea6f35a437419e161. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:28:00.450638 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b260f6bb-189e-4c66-8b28-b06ab94526a8 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Going to run 1 instances... {{(pid=121001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:28:00.453435 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b260f6bb-189e-4c66-8b28-b06ab94526a8 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: c214e6ec-8d3d-4cef-85fc-7c2bfe01b972] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:28:00.495597 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e7ad63bd-a8b8-448a-946a-a4e5ab8163b9 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c65ddc0af5854d7a89192d01bc5f4576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c57f8e9a0e4debae18d98918ba8c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:00.506761 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e7ad63bd-a8b8-448a-946a-a4e5ab8163b9 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] 10.222.0.20 "GET /compute/v2.1/servers/1d9172bd-aa20-4f49-87fa-64300cf861be" status: 200 len: 1682 microversion: 2.1 time: 0.338741 Oct 27 03:28:00.508051 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 974/1930] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:28:00 2022] GET /compute/v2.1/servers/1d9172bd-aa20-4f49-87fa-64300cf861be => generated 1682 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:00.530740 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7d3dc8be-970f-4848-92ef-142bd0d72b0a tempest-ListImagesTestJSON-1620462652 tempest-ListImagesTestJSON-1620462652-project] Calling method '.version_select at 0x7f7dda1e1040>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:00.565459 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b260f6bb-189e-4c66-8b28-b06ab94526a8 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.805220 Oct 27 03:28:00.567405 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 957/1931] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:27:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 808 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 03:28:00.573324 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-13bdf90c-8cc0-48ae-b109-9f9d4576d305 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Action: 'action', calling method: .version_select at 0x7f7ddc777af0>, body: {"addFloatingIp": {"address": "172.25.6.252"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:28:00.576569 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-13bdf90c-8cc0-48ae-b109-9f9d4576d305 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] [instance: 4a09478e-ae93-4bf9-b270-95cd88d88476] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:00.586023 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-13bdf90c-8cc0-48ae-b109-9f9d4576d305 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:00.586023 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-13bdf90c-8cc0-48ae-b109-9f9d4576d305 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:00.586023 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-13bdf90c-8cc0-48ae-b109-9f9d4576d305 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:00.586023 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-13bdf90c-8cc0-48ae-b109-9f9d4576d305 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:00.586711 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-13bdf90c-8cc0-48ae-b109-9f9d4576d305 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:00.586898 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-13bdf90c-8cc0-48ae-b109-9f9d4576d305 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:00.618286 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-13bdf90c-8cc0-48ae-b109-9f9d4576d305 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Acquiring lock "refresh_cache-4a09478e-ae93-4bf9-b270-95cd88d88476" {{(pid=121001) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 27 03:28:00.619006 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-13bdf90c-8cc0-48ae-b109-9f9d4576d305 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Acquired lock "refresh_cache-4a09478e-ae93-4bf9-b270-95cd88d88476" {{(pid=121001) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 27 03:28:02.503556 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7d3dc8be-970f-4848-92ef-142bd0d72b0a tempest-ListImagesTestJSON-1620462652 tempest-ListImagesTestJSON-1620462652-project] 10.222.0.20 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 1.986519 Oct 27 03:28:02.505059 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 975/1932] 10.222.0.20 () {58 vars in 1143 bytes} [Thu Oct 27 03:28:00 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 1991 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:28:02.544346 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-bd9a0a5b-6e4f-4eba-903d-a2a4a3a2104b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7dda180b80>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:02.679463 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-bd9a0a5b-6e4f-4eba-903d-a2a4a3a2104b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/images/787934da-f249-4af1-9590-fecf6bc5d90f" status: 200 len: 1413 microversion: 2.1 time: 0.166928 Oct 27 03:28:02.680181 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 976/1933] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:28:02 2022] GET /compute/v2.1/images/787934da-f249-4af1-9590-fecf6bc5d90f => generated 1413 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:02.700817 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d418d820-dcef-4488-85d9-8610ebaa91e7 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:02.701492 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d418d820-dcef-4488-85d9-8610ebaa91e7 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] [instance: 0fb1f450-692f-4979-a489-c13ab4106607] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:02.736451 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d418d820-dcef-4488-85d9-8610ebaa91e7 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:02.737234 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d418d820-dcef-4488-85d9-8610ebaa91e7 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:02.738510 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d418d820-dcef-4488-85d9-8610ebaa91e7 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:02.739860 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d418d820-dcef-4488-85d9-8610ebaa91e7 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:02.740792 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d418d820-dcef-4488-85d9-8610ebaa91e7 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:02.743058 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d418d820-dcef-4488-85d9-8610ebaa91e7 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:02.856445 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d418d820-dcef-4488-85d9-8610ebaa91e7 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] 10.222.0.20 "GET /compute/v2.1/servers/0fb1f450-692f-4979-a489-c13ab4106607/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.175077 Oct 27 03:28:02.858574 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 977/1934] 10.222.0.20 () {58 vars in 1275 bytes} [Thu Oct 27 03:28:02 2022] GET /compute/v2.1/servers/0fb1f450-692f-4979-a489-c13ab4106607/os-interface => generated 284 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:28:02.865885 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-78efb9b0-6e71-4bbf-8219-13990fda0ad9 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:02.866639 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-78efb9b0-6e71-4bbf-8219-13990fda0ad9 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: c214e6ec-8d3d-4cef-85fc-7c2bfe01b972] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:02.889480 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-78efb9b0-6e71-4bbf-8219-13990fda0ad9 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:02.890723 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-78efb9b0-6e71-4bbf-8219-13990fda0ad9 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:02.891206 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-78efb9b0-6e71-4bbf-8219-13990fda0ad9 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:02.893357 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-78efb9b0-6e71-4bbf-8219-13990fda0ad9 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:02.894080 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-78efb9b0-6e71-4bbf-8219-13990fda0ad9 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:02.897597 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-78efb9b0-6e71-4bbf-8219-13990fda0ad9 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:03.083776 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-78efb9b0-6e71-4bbf-8219-13990fda0ad9 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13e05e253c94aadb1c089128ff35be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8510a519f14deea6f35a437419e161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:03.108571 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-78efb9b0-6e71-4bbf-8219-13990fda0ad9 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "GET /compute/v2.1/servers/c214e6ec-8d3d-4cef-85fc-7c2bfe01b972" status: 200 len: 1208 microversion: 2.1 time: 0.247549 Oct 27 03:28:03.125522 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 978/1935] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:28:02 2022] GET /compute/v2.1/servers/c214e6ec-8d3d-4cef-85fc-7c2bfe01b972 => generated 1208 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:03.143411 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-3a6d6490-b8a8-43f6-b5a0-d0bfa8a8c990 req-c108511d-9386-4a8f-872c-ba55c0e77d6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49f0475c-d9eb-4ad0-9f88-322521def6c7", "name": "network-vif-plugged", "status": "completed", "tag": "2e7b6414-960b-4793-94ae-d4e9bc9cb2a7"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:28:03.157991 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-3a6d6490-b8a8-43f6-b5a0-d0bfa8a8c990 req-c108511d-9386-4a8f-872c-ba55c0e77d6c service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:03.159347 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-3a6d6490-b8a8-43f6-b5a0-d0bfa8a8c990 req-c108511d-9386-4a8f-872c-ba55c0e77d6c service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:03.160693 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-3a6d6490-b8a8-43f6-b5a0-d0bfa8a8c990 req-c108511d-9386-4a8f-872c-ba55c0e77d6c service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:03.193339 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-3a6d6490-b8a8-43f6-b5a0-d0bfa8a8c990 req-c108511d-9386-4a8f-872c-ba55c0e77d6c service nova] Creating event network-vif-plugged:2e7b6414-960b-4793-94ae-d4e9bc9cb2a7 for instance 49f0475c-d9eb-4ad0-9f88-322521def6c7 on n-h1-862769-1 Oct 27 03:28:03.208323 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-3a6d6490-b8a8-43f6-b5a0-d0bfa8a8c990 req-c108511d-9386-4a8f-872c-ba55c0e77d6c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078964 Oct 27 03:28:03.222706 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 979/1936] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:28:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:28:03.228330 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8ed46e30-1ddb-4226-b7a1-69ba6aba919a tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:03.229044 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8ed46e30-1ddb-4226-b7a1-69ba6aba919a tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] [instance: 1d9172bd-aa20-4f49-87fa-64300cf861be] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:03.268217 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8ed46e30-1ddb-4226-b7a1-69ba6aba919a tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:03.268761 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8ed46e30-1ddb-4226-b7a1-69ba6aba919a tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:03.269724 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8ed46e30-1ddb-4226-b7a1-69ba6aba919a tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:03.275522 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8ed46e30-1ddb-4226-b7a1-69ba6aba919a tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:03.276234 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8ed46e30-1ddb-4226-b7a1-69ba6aba919a tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:03.278538 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8ed46e30-1ddb-4226-b7a1-69ba6aba919a tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:03.374343 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8ed46e30-1ddb-4226-b7a1-69ba6aba919a tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:03.376933 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8ed46e30-1ddb-4226-b7a1-69ba6aba919a tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:03.381320 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8ed46e30-1ddb-4226-b7a1-69ba6aba919a tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:03.381973 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-8ed46e30-1ddb-4226-b7a1-69ba6aba919a tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lazy-loading 'fault' on Instance uuid 1d9172bd-aa20-4f49-87fa-64300cf861be {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:28:03.623054 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8ed46e30-1ddb-4226-b7a1-69ba6aba919a tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c65ddc0af5854d7a89192d01bc5f4576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c57f8e9a0e4debae18d98918ba8c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:03.641239 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8ed46e30-1ddb-4226-b7a1-69ba6aba919a tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] 10.222.0.20 "GET /compute/v2.1/servers/1d9172bd-aa20-4f49-87fa-64300cf861be" status: 200 len: 1331 microversion: 2.1 time: 0.416826 Oct 27 03:28:03.653906 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 980/1937] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:28:03 2022] GET /compute/v2.1/servers/1d9172bd-aa20-4f49-87fa-64300cf861be => generated 1331 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:03.668147 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-f6906db7-7192-4566-8f0b-0aecd6c54c53 req-6fb6b727-a2bc-45aa-884f-e3f10cf5be2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d9172bd-aa20-4f49-87fa-64300cf861be", "name": "network-vif-deleted", "tag": "7137a87b-6939-4f63-9975-97cc9919bde1"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:28:03.716675 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-f6906db7-7192-4566-8f0b-0aecd6c54c53 req-6fb6b727-a2bc-45aa-884f-e3f10cf5be2c service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:03.723368 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-f6906db7-7192-4566-8f0b-0aecd6c54c53 req-6fb6b727-a2bc-45aa-884f-e3f10cf5be2c service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:03.724371 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-f6906db7-7192-4566-8f0b-0aecd6c54c53 req-6fb6b727-a2bc-45aa-884f-e3f10cf5be2c service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:03.741061 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-f6906db7-7192-4566-8f0b-0aecd6c54c53 req-6fb6b727-a2bc-45aa-884f-e3f10cf5be2c service nova] Creating event network-vif-deleted:7137a87b-6939-4f63-9975-97cc9919bde1 for instance 1d9172bd-aa20-4f49-87fa-64300cf861be on n-h1-862769-1 Oct 27 03:28:03.754807 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-f6906db7-7192-4566-8f0b-0aecd6c54c53 req-6fb6b727-a2bc-45aa-884f-e3f10cf5be2c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097108 Oct 27 03:28:03.758804 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 981/1938] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:28:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:28:03.771532 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4aeab4ec-ac2a-4349-a15c-3233fe73b4e9 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7dda07bb80>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:03.938101 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4aeab4ec-ac2a-4349-a15c-3233fe73b4e9 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/images/787934da-f249-4af1-9590-fecf6bc5d90f" status: 200 len: 1413 microversion: 2.1 time: 0.177691 Oct 27 03:28:03.947066 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 982/1939] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:28:03 2022] GET /compute/v2.1/images/787934da-f249-4af1-9590-fecf6bc5d90f => generated 1413 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:04.131884 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-27f564c4-c245-4dab-bf2b-e03b09229e48 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:04.133167 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-27f564c4-c245-4dab-bf2b-e03b09229e48 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: c214e6ec-8d3d-4cef-85fc-7c2bfe01b972] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:04.144660 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-27f564c4-c245-4dab-bf2b-e03b09229e48 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:04.149306 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-27f564c4-c245-4dab-bf2b-e03b09229e48 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:04.150999 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-27f564c4-c245-4dab-bf2b-e03b09229e48 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:04.152019 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-27f564c4-c245-4dab-bf2b-e03b09229e48 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:04.154321 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-27f564c4-c245-4dab-bf2b-e03b09229e48 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:04.157965 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-27f564c4-c245-4dab-bf2b-e03b09229e48 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:04.306536 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-27f564c4-c245-4dab-bf2b-e03b09229e48 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13e05e253c94aadb1c089128ff35be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8510a519f14deea6f35a437419e161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:04.325987 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-27f564c4-c245-4dab-bf2b-e03b09229e48 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "GET /compute/v2.1/servers/c214e6ec-8d3d-4cef-85fc-7c2bfe01b972" status: 200 len: 1264 microversion: 2.1 time: 0.192260 Oct 27 03:28:04.333998 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 983/1940] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:28:04 2022] GET /compute/v2.1/servers/c214e6ec-8d3d-4cef-85fc-7c2bfe01b972 => generated 1264 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:28:04.696176 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a716e6ec-1216-410c-93df-1e21b5edf982 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:04.698601 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a716e6ec-1216-410c-93df-1e21b5edf982 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] [instance: 1d9172bd-aa20-4f49-87fa-64300cf861be] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:04.707986 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a716e6ec-1216-410c-93df-1e21b5edf982 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:04.708883 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a716e6ec-1216-410c-93df-1e21b5edf982 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:04.710719 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a716e6ec-1216-410c-93df-1e21b5edf982 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:04.711650 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a716e6ec-1216-410c-93df-1e21b5edf982 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:04.714249 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a716e6ec-1216-410c-93df-1e21b5edf982 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:04.714923 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a716e6ec-1216-410c-93df-1e21b5edf982 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:04.738789 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-a716e6ec-1216-410c-93df-1e21b5edf982 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] HTTP exception thrown: Instance 1d9172bd-aa20-4f49-87fa-64300cf861be could not be found. Oct 27 03:28:04.740480 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a716e6ec-1216-410c-93df-1e21b5edf982 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Request method failure captured: Oct 27 03:28:04.740480 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/1d9172bd-aa20-4f49-87fa-64300cf861be HTTP/1.1 Oct 27 03:28:04.740480 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:28:04.740480 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:28:04.740480 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:28:04.740480 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:28:04.740480 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:28:04.740480 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:28:04.740480 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:28:04.740480 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:28:04.740480 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfoWUQL4FZlqmwwkfGEpN7us1p8KurLX2ZpnxBj9maIvCpbLnoG_A_YjQ2Qg9yKC41-47wRu0q590Mdmkc9aq7OPyw0F63hvi5oJri__sp9GEOn9Zs0stma5XDc6YXzFyEAO4m8JqZlfTjuQAsWrY6RTzSdJEG7jl5i7gZytzbfNjvQ Oct 27 03:28:04.740480 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:28:04.740480 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:28:04.740480 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:28:04.740480 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:28:04.740480 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:28:04.740480 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:28:04.740480 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 59c57f8e9a0e4debae18d98918ba8c2f Oct 27 03:28:04.740480 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-VolumesAdminNegativeTest-1455275401 Oct 27 03:28:04.740480 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:28:04.740480 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:28:04.742269 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59c57f8e9a0e4debae18d98918ba8c2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/59c57f8e9a0e4debae18d98918ba8c2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59c57f8e9a0e4debae18d98918ba8c2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_59c57f8e9a0e4debae18d98918ba8c2f"}]}] Oct 27 03:28:04.742269 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-VolumesAdminNegativeTest-1455275401 Oct 27 03:28:04.742269 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 59c57f8e9a0e4debae18d98918ba8c2f Oct 27 03:28:04.742269 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1455275401 Oct 27 03:28:04.742269 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-VolumesAdminNegativeTest-1455275401-project Oct 27 03:28:04.742269 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:28:04.742269 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:28:04.742269 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: c65ddc0af5854d7a89192d01bc5f4576 Oct 27 03:28:04.742269 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-VolumesAdminNegativeTest-1455275401-project Oct 27 03:28:04.742269 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:28:04.742269 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 1d9172bd-aa20-4f49-87fa-64300cf861be could not be found. Oct 27 03:28:04.742269 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '1d9172bd-aa20-4f49-87fa-64300cf861be'} Oct 27 03:28:04.743119 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:28:04.743119 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:28:04.743119 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:28:04.743119 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:28:04.743119 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:28:04.743119 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:28:04.743119 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:28:04.743119 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:28:04.743119 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:28:04.743119 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:28:04.743119 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d9172bd-aa20-4f49-87fa-64300cf861be could not be found. Oct 27 03:28:04.743119 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:28:04.743119 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:28:04.743119 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:28:04.743119 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:28:04.743119 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:28:04.743119 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:28:04.743119 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:28:04.743119 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:28:04.743119 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:28:04.744663 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:28:04.744663 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:28:04.744663 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:28:04.744663 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:28:04.744663 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:28:04.744663 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:28:04.744663 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:28:04.744663 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d9172bd-aa20-4f49-87fa-64300cf861be could not be found. Oct 27 03:28:04.744663 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:28:04.744663 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:28:04.744663 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:28:04.744663 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:28:04.744663 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:28:04.744663 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:28:04.744663 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:28:04.744663 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:28:04.744663 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d9172bd-aa20-4f49-87fa-64300cf861be could not be found. Oct 27 03:28:04.744663 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:28:04.749007 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a716e6ec-1216-410c-93df-1e21b5edf982 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Returning 404 to user: Instance 1d9172bd-aa20-4f49-87fa-64300cf861be could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:28:04.749007 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a716e6ec-1216-410c-93df-1e21b5edf982 tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] 10.222.0.20 "GET /compute/v2.1/servers/1d9172bd-aa20-4f49-87fa-64300cf861be" status: 404 len: 111 microversion: 2.1 time: 0.070904 Oct 27 03:28:04.749007 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 984/1941] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:28:04 2022] GET /compute/v2.1/servers/1d9172bd-aa20-4f49-87fa-64300cf861be => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:28:04.767754 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ecf82637-8711-4a41-a499-9574415041bb tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] Calling method '.version_select at 0x7f7dda1079d0>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:04.869160 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ecf82637-8711-4a41-a499-9574415041bb tempest-VolumesAdminNegativeTest-1455275401 tempest-VolumesAdminNegativeTest-1455275401-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2021389453" status: 202 len: 0 microversion: 2.1 time: 0.110149 Oct 27 03:28:04.876653 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 985/1942] 10.222.0.20 () {58 vars in 1221 bytes} [Thu Oct 27 03:28:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2021389453 => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:28:04.961809 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1ebc425b-19e1-46fe-bd86-22d5c48457a8 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7dda07bf70>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:05.076054 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1ebc425b-19e1-46fe-bd86-22d5c48457a8 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/images/787934da-f249-4af1-9590-fecf6bc5d90f" status: 200 len: 1413 microversion: 2.1 time: 0.123816 Oct 27 03:28:05.079484 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 986/1943] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:28:04 2022] GET /compute/v2.1/images/787934da-f249-4af1-9590-fecf6bc5d90f => generated 1413 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:05.361009 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-72641d2e-3bdc-4fe3-8f29-0705965079c3 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:05.362222 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-72641d2e-3bdc-4fe3-8f29-0705965079c3 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: c214e6ec-8d3d-4cef-85fc-7c2bfe01b972] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:05.401995 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-72641d2e-3bdc-4fe3-8f29-0705965079c3 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:05.412027 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-72641d2e-3bdc-4fe3-8f29-0705965079c3 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:05.413156 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-72641d2e-3bdc-4fe3-8f29-0705965079c3 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:05.416123 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-72641d2e-3bdc-4fe3-8f29-0705965079c3 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:05.420420 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-72641d2e-3bdc-4fe3-8f29-0705965079c3 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:05.423349 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-72641d2e-3bdc-4fe3-8f29-0705965079c3 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:05.764499 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.network.neutron [None req-13bdf90c-8cc0-48ae-b109-9f9d4576d305 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] [instance: 4a09478e-ae93-4bf9-b270-95cd88d88476] Building network info cache for instance {{(pid=121001) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 27 03:28:06.331579 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-72641d2e-3bdc-4fe3-8f29-0705965079c3 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13e05e253c94aadb1c089128ff35be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8510a519f14deea6f35a437419e161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:06.350400 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-72641d2e-3bdc-4fe3-8f29-0705965079c3 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "GET /compute/v2.1/servers/c214e6ec-8d3d-4cef-85fc-7c2bfe01b972" status: 200 len: 1282 microversion: 2.1 time: 0.998257 Oct 27 03:28:06.354441 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 987/1944] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:28:05 2022] GET /compute/v2.1/servers/c214e6ec-8d3d-4cef-85fc-7c2bfe01b972 => generated 1282 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:06.373412 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-b4b0d81c-0e0e-4885-b5e4-f04dd6491b47 req-b190f9c2-2721-45d1-8611-f7c925476404 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a09478e-ae93-4bf9-b270-95cd88d88476", "tag": "b7642b15-cece-4456-a1d2-fefef01ecb62"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:28:06.405464 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-b4b0d81c-0e0e-4885-b5e4-f04dd6491b47 req-b190f9c2-2721-45d1-8611-f7c925476404 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:06.405953 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-b4b0d81c-0e0e-4885-b5e4-f04dd6491b47 req-b190f9c2-2721-45d1-8611-f7c925476404 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:06.406419 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-b4b0d81c-0e0e-4885-b5e4-f04dd6491b47 req-b190f9c2-2721-45d1-8611-f7c925476404 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:06.430689 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-b4b0d81c-0e0e-4885-b5e4-f04dd6491b47 req-b190f9c2-2721-45d1-8611-f7c925476404 service nova] Creating event network-changed:b7642b15-cece-4456-a1d2-fefef01ecb62 for instance 4a09478e-ae93-4bf9-b270-95cd88d88476 on n-h1-862769-1 Oct 27 03:28:06.440836 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-b4b0d81c-0e0e-4885-b5e4-f04dd6491b47 req-b190f9c2-2721-45d1-8611-f7c925476404 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084689 Oct 27 03:28:06.447027 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 988/1945] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:28:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:28:06.452845 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d902f7c0-c644-402d-9aca-35de754af9d5 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7dda180dc0>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:06.577590 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d902f7c0-c644-402d-9aca-35de754af9d5 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/images/787934da-f249-4af1-9590-fecf6bc5d90f" status: 200 len: 1413 microversion: 2.1 time: 0.128857 Oct 27 03:28:06.578417 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 989/1946] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:28:06 2022] GET /compute/v2.1/images/787934da-f249-4af1-9590-fecf6bc5d90f => generated 1413 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:06.588978 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-561baec6-1ba9-4f27-8002-c7ed2886d77e req-4f2b4901-0e1f-4e25-a381-d611bc34ad28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80bb98d2-3a48-40cd-85e4-ee8dfacbbadd", "name": "network-vif-deleted", "tag": "2bbb3e1d-9309-4282-a03e-4c3ee27880e4"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:28:06.613962 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-561baec6-1ba9-4f27-8002-c7ed2886d77e req-4f2b4901-0e1f-4e25-a381-d611bc34ad28 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:06.618891 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-561baec6-1ba9-4f27-8002-c7ed2886d77e req-4f2b4901-0e1f-4e25-a381-d611bc34ad28 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:06.619610 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-561baec6-1ba9-4f27-8002-c7ed2886d77e req-4f2b4901-0e1f-4e25-a381-d611bc34ad28 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:06.653886 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-561baec6-1ba9-4f27-8002-c7ed2886d77e req-4f2b4901-0e1f-4e25-a381-d611bc34ad28 service nova] Creating event network-vif-deleted:2bbb3e1d-9309-4282-a03e-4c3ee27880e4 for instance 80bb98d2-3a48-40cd-85e4-ee8dfacbbadd on n-h2-862769-1 Oct 27 03:28:06.660840 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-561baec6-1ba9-4f27-8002-c7ed2886d77e req-4f2b4901-0e1f-4e25-a381-d611bc34ad28 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081084 Oct 27 03:28:06.662078 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 990/1947] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:28:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:28:07.383917 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c060e46c-a43b-4f08-8c01-b14bc33b979f tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:07.384665 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c060e46c-a43b-4f08-8c01-b14bc33b979f tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: c214e6ec-8d3d-4cef-85fc-7c2bfe01b972] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:07.413835 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c060e46c-a43b-4f08-8c01-b14bc33b979f tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:07.417771 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c060e46c-a43b-4f08-8c01-b14bc33b979f tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:07.418505 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c060e46c-a43b-4f08-8c01-b14bc33b979f tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:07.419787 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c060e46c-a43b-4f08-8c01-b14bc33b979f tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:07.420272 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c060e46c-a43b-4f08-8c01-b14bc33b979f tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:07.420717 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c060e46c-a43b-4f08-8c01-b14bc33b979f tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:08.171324 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.network.neutron [None req-13bdf90c-8cc0-48ae-b109-9f9d4576d305 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] [instance: 4a09478e-ae93-4bf9-b270-95cd88d88476] Updating instance_info_cache with network_info: [{"id": "b7642b15-cece-4456-a1d2-fefef01ecb62", "address": "fa:16:3e:24:00:d2", "network": {"id": "81b040e4-6976-445b-88ab-1bc0d779ceb2", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-514262983-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.6.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "f1cee634bb1f4bb0a47f33a49f24ccdf", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapb7642b15-ce", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=121001) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 27 03:28:08.208731 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c060e46c-a43b-4f08-8c01-b14bc33b979f tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13e05e253c94aadb1c089128ff35be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8510a519f14deea6f35a437419e161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:08.223200 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c060e46c-a43b-4f08-8c01-b14bc33b979f tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "GET /compute/v2.1/servers/c214e6ec-8d3d-4cef-85fc-7c2bfe01b972" status: 200 len: 1270 microversion: 2.1 time: 0.846335 Oct 27 03:28:08.234844 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 991/1948] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:28:07 2022] GET /compute/v2.1/servers/c214e6ec-8d3d-4cef-85fc-7c2bfe01b972 => generated 1270 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:28:08.252145 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b036139c-b8fc-475e-b155-65506d01d8ba tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7dda180d30>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:08.293422 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-13bdf90c-8cc0-48ae-b109-9f9d4576d305 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Releasing lock "refresh_cache-4a09478e-ae93-4bf9-b270-95cd88d88476" {{(pid=121001) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 27 03:28:08.294356 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-13bdf90c-8cc0-48ae-b109-9f9d4576d305 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] 10.222.0.20 "POST /compute/v2.1/servers/4a09478e-ae93-4bf9-b270-95cd88d88476/action" status: 202 len: 0 microversion: 2.1 time: 7.725714 Oct 27 03:28:08.295711 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 958/1949] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:28:00 2022] POST /compute/v2.1/servers/4a09478e-ae93-4bf9-b270-95cd88d88476/action => generated 0 bytes in 7727 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 27 03:28:08.301113 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d5b7f022-be19-4a46-865b-13d96ea12499 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:08.307779 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d5b7f022-be19-4a46-865b-13d96ea12499 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] [instance: 0fb1f450-692f-4979-a489-c13ab4106607] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:08.322153 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d5b7f022-be19-4a46-865b-13d96ea12499 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:08.322846 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d5b7f022-be19-4a46-865b-13d96ea12499 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:08.323487 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d5b7f022-be19-4a46-865b-13d96ea12499 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:08.324418 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d5b7f022-be19-4a46-865b-13d96ea12499 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:08.325057 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d5b7f022-be19-4a46-865b-13d96ea12499 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:08.330157 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d5b7f022-be19-4a46-865b-13d96ea12499 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:08.351107 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b036139c-b8fc-475e-b155-65506d01d8ba tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/images/787934da-f249-4af1-9590-fecf6bc5d90f" status: 200 len: 1413 microversion: 2.1 time: 0.114995 Oct 27 03:28:08.360516 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 992/1950] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:28:08 2022] GET /compute/v2.1/images/787934da-f249-4af1-9590-fecf6bc5d90f => generated 1413 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:08.379826 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8384aae6-1557-4bbb-8395-b9da005801b7 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Calling method '.version_select at 0x7f7dda130d30>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:08.870570 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d5b7f022-be19-4a46-865b-13d96ea12499 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b2717ace074a579d33c60964e6668a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3fc032a089f45efa4a66866a9c961c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:08.882825 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d5b7f022-be19-4a46-865b-13d96ea12499 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] 10.222.0.20 "GET /compute/v2.1/servers/0fb1f450-692f-4979-a489-c13ab4106607" status: 200 len: 1589 microversion: 2.1 time: 0.585770 Oct 27 03:28:08.891287 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 959/1951] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:28:08 2022] GET /compute/v2.1/servers/0fb1f450-692f-4979-a489-c13ab4106607 => generated 1589 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:08.909059 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-d2b512fd-90c8-45d3-af7a-e36e53b98a27 req-671c08d9-4609-4809-ab6d-ff95f24eca1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fb1f450-692f-4979-a489-c13ab4106607", "tag": "d7f6f05f-8194-4764-bde0-8189fafed192"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:28:08.934248 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-d2b512fd-90c8-45d3-af7a-e36e53b98a27 req-671c08d9-4609-4809-ab6d-ff95f24eca1d service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:08.935727 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-d2b512fd-90c8-45d3-af7a-e36e53b98a27 req-671c08d9-4609-4809-ab6d-ff95f24eca1d service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:08.937790 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-d2b512fd-90c8-45d3-af7a-e36e53b98a27 req-671c08d9-4609-4809-ab6d-ff95f24eca1d service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:08.981090 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-d2b512fd-90c8-45d3-af7a-e36e53b98a27 req-671c08d9-4609-4809-ab6d-ff95f24eca1d service nova] Creating event network-changed:d7f6f05f-8194-4764-bde0-8189fafed192 for instance 0fb1f450-692f-4979-a489-c13ab4106607 on n-h2-862769-1 Oct 27 03:28:08.995026 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-d2b512fd-90c8-45d3-af7a-e36e53b98a27 req-671c08d9-4609-4809-ab6d-ff95f24eca1d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101000 Oct 27 03:28:08.996007 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 960/1952] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:28:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:28:09.255701 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a35ed9f5-dad5-45f3-b850-0d8526769d3e tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:09.266234 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a35ed9f5-dad5-45f3-b850-0d8526769d3e tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: c214e6ec-8d3d-4cef-85fc-7c2bfe01b972] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:09.288740 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a35ed9f5-dad5-45f3-b850-0d8526769d3e tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:09.301334 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a35ed9f5-dad5-45f3-b850-0d8526769d3e tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:09.301334 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a35ed9f5-dad5-45f3-b850-0d8526769d3e tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:09.301334 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a35ed9f5-dad5-45f3-b850-0d8526769d3e tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:09.301334 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a35ed9f5-dad5-45f3-b850-0d8526769d3e tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:09.301710 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a35ed9f5-dad5-45f3-b850-0d8526769d3e tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:09.332421 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8384aae6-1557-4bbb-8395-b9da005801b7 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] 10.222.0.20 "GET /compute/v2.1/os-floating-ips/084d2458-ef09-444a-8eb9-d4d4afb43491" status: 200 len: 185 microversion: 2.1 time: 0.958983 Oct 27 03:28:09.333621 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 993/1953] 10.222.0.20 () {58 vars in 1260 bytes} [Thu Oct 27 03:28:08 2022] GET /compute/v2.1/os-floating-ips/084d2458-ef09-444a-8eb9-d4d4afb43491 => generated 185 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:28:09.348490 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ec132df4-cbec-4c68-82fb-d8778d97cc33 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.6.252"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:28:09.776868 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a35ed9f5-dad5-45f3-b850-0d8526769d3e tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13e05e253c94aadb1c089128ff35be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8510a519f14deea6f35a437419e161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:09.794668 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a35ed9f5-dad5-45f3-b850-0d8526769d3e tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "GET /compute/v2.1/servers/c214e6ec-8d3d-4cef-85fc-7c2bfe01b972" status: 200 len: 1312 microversion: 2.1 time: 0.543156 Oct 27 03:28:09.796225 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 961/1954] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:28:09 2022] GET /compute/v2.1/servers/c214e6ec-8d3d-4cef-85fc-7c2bfe01b972 => generated 1312 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:09.818131 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a24a9245-128a-4752-98a2-608b055739a5 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7ddec65b80>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:09.916110 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a24a9245-128a-4752-98a2-608b055739a5 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/images/787934da-f249-4af1-9590-fecf6bc5d90f" status: 200 len: 1413 microversion: 2.1 time: 0.113422 Oct 27 03:28:09.917987 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 962/1955] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:28:09 2022] GET /compute/v2.1/images/787934da-f249-4af1-9590-fecf6bc5d90f => generated 1413 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:10.337918 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ec132df4-cbec-4c68-82fb-d8778d97cc33 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] [instance: 4a09478e-ae93-4bf9-b270-95cd88d88476] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:10.343846 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ec132df4-cbec-4c68-82fb-d8778d97cc33 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:10.344361 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ec132df4-cbec-4c68-82fb-d8778d97cc33 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:10.345056 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ec132df4-cbec-4c68-82fb-d8778d97cc33 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:10.345800 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ec132df4-cbec-4c68-82fb-d8778d97cc33 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:10.346307 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ec132df4-cbec-4c68-82fb-d8778d97cc33 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:10.346753 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ec132df4-cbec-4c68-82fb-d8778d97cc33 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:10.775954 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ec132df4-cbec-4c68-82fb-d8778d97cc33 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Acquiring lock "refresh_cache-4a09478e-ae93-4bf9-b270-95cd88d88476" {{(pid=121000) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 27 03:28:10.776377 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ec132df4-cbec-4c68-82fb-d8778d97cc33 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Acquired lock "refresh_cache-4a09478e-ae93-4bf9-b270-95cd88d88476" {{(pid=121000) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 27 03:28:10.823172 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b0aff578-4646-4aa7-82c1-af6b5f80ac68 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:10.824468 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b0aff578-4646-4aa7-82c1-af6b5f80ac68 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: c214e6ec-8d3d-4cef-85fc-7c2bfe01b972] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:10.839795 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:28:10.840920 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=6 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:28:10.845769 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b0aff578-4646-4aa7-82c1-af6b5f80ac68 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:10.847783 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b0aff578-4646-4aa7-82c1-af6b5f80ac68 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:10.849215 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b0aff578-4646-4aa7-82c1-af6b5f80ac68 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:10.853077 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b0aff578-4646-4aa7-82c1-af6b5f80ac68 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:10.855844 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b0aff578-4646-4aa7-82c1-af6b5f80ac68 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:10.864752 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b0aff578-4646-4aa7-82c1-af6b5f80ac68 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:11.516877 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b0aff578-4646-4aa7-82c1-af6b5f80ac68 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13e05e253c94aadb1c089128ff35be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8510a519f14deea6f35a437419e161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:11.528164 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b0aff578-4646-4aa7-82c1-af6b5f80ac68 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "GET /compute/v2.1/servers/c214e6ec-8d3d-4cef-85fc-7c2bfe01b972" status: 200 len: 1312 microversion: 2.1 time: 0.708793 Oct 27 03:28:11.537837 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 963/1956] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:28:10 2022] GET /compute/v2.1/servers/c214e6ec-8d3d-4cef-85fc-7c2bfe01b972 => generated 1312 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:11.551108 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7cd60645-3fa9-4bd3-9927-0ac2d311f79a tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7dda50e3a0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:11.650157 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7cd60645-3fa9-4bd3-9927-0ac2d311f79a tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/images/787934da-f249-4af1-9590-fecf6bc5d90f" status: 200 len: 1413 microversion: 2.1 time: 0.110197 Oct 27 03:28:11.652732 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 964/1957] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:28:11 2022] GET /compute/v2.1/images/787934da-f249-4af1-9590-fecf6bc5d90f => generated 1413 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:12.074697 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-13d8a27b-34eb-4429-8c6f-6079f99d0ee9 req-a95e5718-e4e3-4a3c-b4e3-6689223658de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c214e6ec-8d3d-4cef-85fc-7c2bfe01b972", "tag": "3602da80-5480-49d6-95b5-bdca0e2792ca"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:28:12.130965 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-13d8a27b-34eb-4429-8c6f-6079f99d0ee9 req-a95e5718-e4e3-4a3c-b4e3-6689223658de service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:12.134269 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-13d8a27b-34eb-4429-8c6f-6079f99d0ee9 req-a95e5718-e4e3-4a3c-b4e3-6689223658de service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:12.136875 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-13d8a27b-34eb-4429-8c6f-6079f99d0ee9 req-a95e5718-e4e3-4a3c-b4e3-6689223658de service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:12.184508 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-13d8a27b-34eb-4429-8c6f-6079f99d0ee9 req-a95e5718-e4e3-4a3c-b4e3-6689223658de service nova] Creating event network-changed:3602da80-5480-49d6-95b5-bdca0e2792ca for instance c214e6ec-8d3d-4cef-85fc-7c2bfe01b972 on n-h2-862769-1 Oct 27 03:28:12.200414 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-13d8a27b-34eb-4429-8c6f-6079f99d0ee9 req-a95e5718-e4e3-4a3c-b4e3-6689223658de service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128093 Oct 27 03:28:12.204312 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 965/1958] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:28:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:28:12.553143 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-eeae4131-dcbd-4ec4-86d1-917670e6f9ac tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:12.553893 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-eeae4131-dcbd-4ec4-86d1-917670e6f9ac tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: c214e6ec-8d3d-4cef-85fc-7c2bfe01b972] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:12.573847 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eeae4131-dcbd-4ec4-86d1-917670e6f9ac tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:12.574550 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eeae4131-dcbd-4ec4-86d1-917670e6f9ac tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:12.575175 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eeae4131-dcbd-4ec4-86d1-917670e6f9ac tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:12.575779 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eeae4131-dcbd-4ec4-86d1-917670e6f9ac tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:12.585724 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eeae4131-dcbd-4ec4-86d1-917670e6f9ac tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:12.586351 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eeae4131-dcbd-4ec4-86d1-917670e6f9ac tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:13.459898 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-eeae4131-dcbd-4ec4-86d1-917670e6f9ac tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13e05e253c94aadb1c089128ff35be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8510a519f14deea6f35a437419e161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:13.480765 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-eeae4131-dcbd-4ec4-86d1-917670e6f9ac tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "GET /compute/v2.1/servers/c214e6ec-8d3d-4cef-85fc-7c2bfe01b972" status: 200 len: 1312 microversion: 2.1 time: 0.928175 Oct 27 03:28:13.483097 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 966/1959] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:28:12 2022] GET /compute/v2.1/servers/c214e6ec-8d3d-4cef-85fc-7c2bfe01b972 => generated 1312 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:13.517548 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8430f683-cad8-4d95-baca-e65c0a5f5d05 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7ddee13040>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:13.626454 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8430f683-cad8-4d95-baca-e65c0a5f5d05 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/images/787934da-f249-4af1-9590-fecf6bc5d90f" status: 200 len: 1413 microversion: 2.1 time: 0.134179 Oct 27 03:28:13.627888 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 967/1960] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:28:13 2022] GET /compute/v2.1/images/787934da-f249-4af1-9590-fecf6bc5d90f => generated 1413 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:13.770551 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-ec132df4-cbec-4c68-82fb-d8778d97cc33 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] [instance: 4a09478e-ae93-4bf9-b270-95cd88d88476] Building network info cache for instance {{(pid=121000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 27 03:28:14.286952 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-f2ff1812-2c78-4173-96a4-65f64f42bf21 req-2446ff58-924c-4975-b11c-a4ccd69f345c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a09478e-ae93-4bf9-b270-95cd88d88476", "tag": "b7642b15-cece-4456-a1d2-fefef01ecb62"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:28:14.330803 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-f2ff1812-2c78-4173-96a4-65f64f42bf21 req-2446ff58-924c-4975-b11c-a4ccd69f345c service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:14.331289 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-f2ff1812-2c78-4173-96a4-65f64f42bf21 req-2446ff58-924c-4975-b11c-a4ccd69f345c service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:14.331751 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-f2ff1812-2c78-4173-96a4-65f64f42bf21 req-2446ff58-924c-4975-b11c-a4ccd69f345c service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:14.364404 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-f2ff1812-2c78-4173-96a4-65f64f42bf21 req-2446ff58-924c-4975-b11c-a4ccd69f345c service nova] Creating event network-changed:b7642b15-cece-4456-a1d2-fefef01ecb62 for instance 4a09478e-ae93-4bf9-b270-95cd88d88476 on n-h1-862769-1 Oct 27 03:28:14.393688 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-f2ff1812-2c78-4173-96a4-65f64f42bf21 req-2446ff58-924c-4975-b11c-a4ccd69f345c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109662 Oct 27 03:28:14.395691 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 968/1961] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:28:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:28:14.511793 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-88925ce9-e1f2-4f8c-8ceb-f3a9cf8f6fde tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:14.513368 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-88925ce9-e1f2-4f8c-8ceb-f3a9cf8f6fde tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: c214e6ec-8d3d-4cef-85fc-7c2bfe01b972] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:14.543828 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-88925ce9-e1f2-4f8c-8ceb-f3a9cf8f6fde tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:14.544362 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-88925ce9-e1f2-4f8c-8ceb-f3a9cf8f6fde tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:14.544824 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-88925ce9-e1f2-4f8c-8ceb-f3a9cf8f6fde tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:14.545571 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-88925ce9-e1f2-4f8c-8ceb-f3a9cf8f6fde tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:14.553666 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-88925ce9-e1f2-4f8c-8ceb-f3a9cf8f6fde tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:14.557517 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-88925ce9-e1f2-4f8c-8ceb-f3a9cf8f6fde tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:15.212047 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-88925ce9-e1f2-4f8c-8ceb-f3a9cf8f6fde tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13e05e253c94aadb1c089128ff35be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8510a519f14deea6f35a437419e161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:15.215731 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-88925ce9-e1f2-4f8c-8ceb-f3a9cf8f6fde tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "GET /compute/v2.1/servers/c214e6ec-8d3d-4cef-85fc-7c2bfe01b972" status: 200 len: 1312 microversion: 2.1 time: 0.711699 Oct 27 03:28:15.238353 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 969/1962] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:28:14 2022] GET /compute/v2.1/servers/c214e6ec-8d3d-4cef-85fc-7c2bfe01b972 => generated 1312 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:15.243845 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a78b0866-5f37-41eb-8cd6-25d3eac06870 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7ddec65b80>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:15.330880 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a78b0866-5f37-41eb-8cd6-25d3eac06870 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/images/787934da-f249-4af1-9590-fecf6bc5d90f" status: 200 len: 1413 microversion: 2.1 time: 0.090927 Oct 27 03:28:15.339921 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 970/1963] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:28:15 2022] GET /compute/v2.1/images/787934da-f249-4af1-9590-fecf6bc5d90f => generated 1413 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:15.649929 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-ec132df4-cbec-4c68-82fb-d8778d97cc33 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] [instance: 4a09478e-ae93-4bf9-b270-95cd88d88476] Updating instance_info_cache with network_info: [{"id": "b7642b15-cece-4456-a1d2-fefef01ecb62", "address": "fa:16:3e:24:00:d2", "network": {"id": "81b040e4-6976-445b-88ab-1bc0d779ceb2", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-514262983-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "f1cee634bb1f4bb0a47f33a49f24ccdf", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapb7642b15-ce", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=121000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 27 03:28:15.796627 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ec132df4-cbec-4c68-82fb-d8778d97cc33 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Releasing lock "refresh_cache-4a09478e-ae93-4bf9-b270-95cd88d88476" {{(pid=121000) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 27 03:28:15.797550 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ec132df4-cbec-4c68-82fb-d8778d97cc33 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] 10.222.0.20 "POST /compute/v2.1/servers/4a09478e-ae93-4bf9-b270-95cd88d88476/action" status: 202 len: 0 microversion: 2.1 time: 6.455593 Oct 27 03:28:15.798539 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 994/1964] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:28:09 2022] POST /compute/v2.1/servers/4a09478e-ae93-4bf9-b270-95cd88d88476/action => generated 0 bytes in 6457 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Oct 27 03:28:15.807219 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8430ec58-fdd8-4e39-8639-7f3a475d9e90 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:15.807792 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8430ec58-fdd8-4e39-8639-7f3a475d9e90 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] [instance: 80bb98d2-3a48-40cd-85e4-ee8dfacbbadd] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:15.818489 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8430ec58-fdd8-4e39-8639-7f3a475d9e90 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:15.818985 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8430ec58-fdd8-4e39-8639-7f3a475d9e90 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:15.819432 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8430ec58-fdd8-4e39-8639-7f3a475d9e90 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:15.823725 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8430ec58-fdd8-4e39-8639-7f3a475d9e90 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:15.824499 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8430ec58-fdd8-4e39-8639-7f3a475d9e90 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:15.826702 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8430ec58-fdd8-4e39-8639-7f3a475d9e90 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:15.864289 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-8430ec58-fdd8-4e39-8639-7f3a475d9e90 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] HTTP exception thrown: Instance 80bb98d2-3a48-40cd-85e4-ee8dfacbbadd could not be found. Oct 27 03:28:15.866401 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8430ec58-fdd8-4e39-8639-7f3a475d9e90 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Request method failure captured: Oct 27 03:28:15.866401 n-d-862769-1 devstack@n-api.service[121001]: request: DELETE /compute/v2.1/servers/80bb98d2-3a48-40cd-85e4-ee8dfacbbadd HTTP/1.1 Oct 27 03:28:15.866401 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:28:15.866401 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:28:15.866401 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:28:15.866401 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:28:15.866401 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:28:15.866401 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:28:15.866401 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:28:15.866401 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:28:15.866401 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfpxqXTQ_iW0ArXs975gZDY7uwJ5nHAF4hg8CDCuM3uj2pg20HzuZSTMGIAavvX9tg8x18_38hYZf-6YPCL1tkP6V8Q65rooyC_Nub0n_uQDqVJuEHOO4RnH61oKbBP3mHbYyV4YslidXoGUJNOsCvML8l67_M2-TEZbrHodlzZq55s Oct 27 03:28:15.866401 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:28:15.866401 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:28:15.866401 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:28:15.866401 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:28:15.866401 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:28:15.866401 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:28:15.866401 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: f1cee634bb1f4bb0a47f33a49f24ccdf Oct 27 03:28:15.866401 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-606388594 Oct 27 03:28:15.866401 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:28:15.866401 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:28:15.868101 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f1cee634bb1f4bb0a47f33a49f24ccdf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f1cee634bb1f4bb0a47f33a49f24ccdf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f1cee634bb1f4bb0a47f33a49f24ccdf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f1cee634bb1f4bb0a47f33a49f24ccdf"}]}] Oct 27 03:28:15.868101 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-606388594 Oct 27 03:28:15.868101 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: f1cee634bb1f4bb0a47f33a49f24ccdf Oct 27 03:28:15.868101 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-606388594 Oct 27 03:28:15.868101 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-FloatingIPsAssociationTestJSON-606388594-project Oct 27 03:28:15.868101 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:28:15.868101 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:28:15.868101 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 8e8640291c8745609faae41bdd731c17 Oct 27 03:28:15.868101 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-606388594-project Oct 27 03:28:15.868101 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:28:15.868101 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 80bb98d2-3a48-40cd-85e4-ee8dfacbbadd could not be found. Oct 27 03:28:15.868101 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '80bb98d2-3a48-40cd-85e4-ee8dfacbbadd'} Oct 27 03:28:15.868950 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:28:15.868950 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:28:15.868950 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:28:15.868950 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:28:15.868950 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:28:15.868950 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:28:15.868950 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:28:15.868950 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:28:15.868950 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:28:15.868950 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:28:15.868950 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80bb98d2-3a48-40cd-85e4-ee8dfacbbadd could not be found. Oct 27 03:28:15.868950 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:28:15.868950 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:28:15.868950 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:28:15.868950 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:28:15.868950 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:28:15.868950 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:28:15.868950 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:28:15.868950 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:28:15.868950 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:28:15.870516 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:28:15.870516 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 03:28:15.870516 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 03:28:15.870516 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 03:28:15.870516 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 03:28:15.870516 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:28:15.870516 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:28:15.870516 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:28:15.870516 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:28:15.870516 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80bb98d2-3a48-40cd-85e4-ee8dfacbbadd could not be found. Oct 27 03:28:15.870516 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:28:15.870516 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:28:15.870516 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:28:15.870516 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:28:15.870516 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:28:15.870516 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:28:15.870516 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:28:15.870516 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:28:15.870516 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80bb98d2-3a48-40cd-85e4-ee8dfacbbadd could not be found. Oct 27 03:28:15.870516 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:28:15.873581 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8430ec58-fdd8-4e39-8639-7f3a475d9e90 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Returning 404 to user: Instance 80bb98d2-3a48-40cd-85e4-ee8dfacbbadd could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:28:15.878657 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8430ec58-fdd8-4e39-8639-7f3a475d9e90 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] 10.222.0.20 "DELETE /compute/v2.1/servers/80bb98d2-3a48-40cd-85e4-ee8dfacbbadd" status: 404 len: 111 microversion: 2.1 time: 0.075180 Oct 27 03:28:15.879568 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 971/1965] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:28:15 2022] DELETE /compute/v2.1/servers/80bb98d2-3a48-40cd-85e4-ee8dfacbbadd => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:28:15.887761 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0a5d5c3a-eccd-48d9-917b-cbf6e5442061 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:15.888399 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0a5d5c3a-eccd-48d9-917b-cbf6e5442061 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] [instance: 80bb98d2-3a48-40cd-85e4-ee8dfacbbadd] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:15.907154 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0a5d5c3a-eccd-48d9-917b-cbf6e5442061 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:15.921669 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0a5d5c3a-eccd-48d9-917b-cbf6e5442061 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:15.922501 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0a5d5c3a-eccd-48d9-917b-cbf6e5442061 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:15.928883 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0a5d5c3a-eccd-48d9-917b-cbf6e5442061 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:15.929730 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0a5d5c3a-eccd-48d9-917b-cbf6e5442061 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:15.930464 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0a5d5c3a-eccd-48d9-917b-cbf6e5442061 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:15.985600 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-0a5d5c3a-eccd-48d9-917b-cbf6e5442061 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] HTTP exception thrown: Instance 80bb98d2-3a48-40cd-85e4-ee8dfacbbadd could not be found. Oct 27 03:28:15.989281 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0a5d5c3a-eccd-48d9-917b-cbf6e5442061 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Request method failure captured: Oct 27 03:28:15.989281 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/80bb98d2-3a48-40cd-85e4-ee8dfacbbadd HTTP/1.1 Oct 27 03:28:15.989281 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:28:15.989281 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:28:15.989281 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:28:15.989281 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:28:15.989281 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:28:15.989281 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:28:15.989281 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:28:15.989281 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:28:15.989281 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfpxqXTQ_iW0ArXs975gZDY7uwJ5nHAF4hg8CDCuM3uj2pg20HzuZSTMGIAavvX9tg8x18_38hYZf-6YPCL1tkP6V8Q65rooyC_Nub0n_uQDqVJuEHOO4RnH61oKbBP3mHbYyV4YslidXoGUJNOsCvML8l67_M2-TEZbrHodlzZq55s Oct 27 03:28:15.989281 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:28:15.989281 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:28:15.989281 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:28:15.989281 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:28:15.989281 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:28:15.989281 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:28:15.989281 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: f1cee634bb1f4bb0a47f33a49f24ccdf Oct 27 03:28:15.989281 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-606388594 Oct 27 03:28:15.989281 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:28:15.989281 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:28:15.991035 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f1cee634bb1f4bb0a47f33a49f24ccdf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f1cee634bb1f4bb0a47f33a49f24ccdf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f1cee634bb1f4bb0a47f33a49f24ccdf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f1cee634bb1f4bb0a47f33a49f24ccdf"}]}] Oct 27 03:28:15.991035 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-606388594 Oct 27 03:28:15.991035 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: f1cee634bb1f4bb0a47f33a49f24ccdf Oct 27 03:28:15.991035 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-606388594 Oct 27 03:28:15.991035 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-FloatingIPsAssociationTestJSON-606388594-project Oct 27 03:28:15.991035 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:28:15.991035 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:28:15.991035 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 8e8640291c8745609faae41bdd731c17 Oct 27 03:28:15.991035 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-606388594-project Oct 27 03:28:15.991035 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:28:15.991035 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 80bb98d2-3a48-40cd-85e4-ee8dfacbbadd could not be found. Oct 27 03:28:15.991035 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '80bb98d2-3a48-40cd-85e4-ee8dfacbbadd'} Oct 27 03:28:15.992030 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:28:15.992030 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:28:15.992030 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:28:15.992030 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:28:15.992030 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:28:15.992030 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:28:15.992030 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:28:15.992030 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:28:15.992030 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:28:15.992030 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:28:15.992030 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80bb98d2-3a48-40cd-85e4-ee8dfacbbadd could not be found. Oct 27 03:28:15.992030 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:28:15.992030 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:28:15.992030 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:28:15.992030 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:28:15.992030 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:28:15.992030 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:28:15.992030 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:28:15.992030 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:28:15.992030 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:28:15.993464 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:28:15.993464 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:28:15.993464 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:28:15.993464 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:28:15.993464 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:28:15.993464 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:28:15.993464 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:28:15.993464 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80bb98d2-3a48-40cd-85e4-ee8dfacbbadd could not be found. Oct 27 03:28:15.993464 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:28:15.993464 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:28:15.993464 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:28:15.993464 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:28:15.993464 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:28:15.993464 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:28:15.993464 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:28:15.993464 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:28:15.993464 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80bb98d2-3a48-40cd-85e4-ee8dfacbbadd could not be found. Oct 27 03:28:15.993464 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:28:15.997940 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0a5d5c3a-eccd-48d9-917b-cbf6e5442061 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Returning 404 to user: Instance 80bb98d2-3a48-40cd-85e4-ee8dfacbbadd could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:28:15.999088 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0a5d5c3a-eccd-48d9-917b-cbf6e5442061 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] 10.222.0.20 "GET /compute/v2.1/servers/80bb98d2-3a48-40cd-85e4-ee8dfacbbadd" status: 404 len: 111 microversion: 2.1 time: 0.115386 Oct 27 03:28:16.001654 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 995/1966] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:28:15 2022] GET /compute/v2.1/servers/80bb98d2-3a48-40cd-85e4-ee8dfacbbadd => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:28:16.016056 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-29320493-75c0-4ad8-9ee6-3819048ddcd2 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Calling method '.version_select at 0x7f7ddec65dc0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:16.241417 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a32e6051-4136-41fb-8648-f015ce0cedf5 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:16.242060 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a32e6051-4136-41fb-8648-f015ce0cedf5 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: c214e6ec-8d3d-4cef-85fc-7c2bfe01b972] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:16.251988 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a32e6051-4136-41fb-8648-f015ce0cedf5 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:16.262847 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a32e6051-4136-41fb-8648-f015ce0cedf5 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:16.263641 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a32e6051-4136-41fb-8648-f015ce0cedf5 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:16.276346 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a32e6051-4136-41fb-8648-f015ce0cedf5 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:16.276346 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a32e6051-4136-41fb-8648-f015ce0cedf5 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:16.276346 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a32e6051-4136-41fb-8648-f015ce0cedf5 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:17.187741 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a32e6051-4136-41fb-8648-f015ce0cedf5 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13e05e253c94aadb1c089128ff35be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8510a519f14deea6f35a437419e161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:17.196813 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a32e6051-4136-41fb-8648-f015ce0cedf5 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "GET /compute/v2.1/servers/c214e6ec-8d3d-4cef-85fc-7c2bfe01b972" status: 200 len: 1312 microversion: 2.1 time: 0.959195 Oct 27 03:28:17.224915 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 996/1967] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:28:16 2022] GET /compute/v2.1/servers/c214e6ec-8d3d-4cef-85fc-7c2bfe01b972 => generated 1312 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:28:17.230176 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-61889ea3-661e-4f2b-9eb7-5a1a52d0db67 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7dda075670>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:17.361679 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-61889ea3-661e-4f2b-9eb7-5a1a52d0db67 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/images/787934da-f249-4af1-9590-fecf6bc5d90f" status: 200 len: 1413 microversion: 2.1 time: 0.120914 Oct 27 03:28:17.371240 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 997/1968] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:28:17 2022] GET /compute/v2.1/images/787934da-f249-4af1-9590-fecf6bc5d90f => generated 1413 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:18.225889 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ac6379de-656e-4241-8254-8a36d887d257 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:18.227392 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ac6379de-656e-4241-8254-8a36d887d257 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: c214e6ec-8d3d-4cef-85fc-7c2bfe01b972] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:18.245078 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ac6379de-656e-4241-8254-8a36d887d257 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:18.246017 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ac6379de-656e-4241-8254-8a36d887d257 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:18.246709 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ac6379de-656e-4241-8254-8a36d887d257 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:18.247677 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ac6379de-656e-4241-8254-8a36d887d257 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:18.248257 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ac6379de-656e-4241-8254-8a36d887d257 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:18.248788 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ac6379de-656e-4241-8254-8a36d887d257 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:18.639305 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ac6379de-656e-4241-8254-8a36d887d257 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13e05e253c94aadb1c089128ff35be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8510a519f14deea6f35a437419e161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:18.653383 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ac6379de-656e-4241-8254-8a36d887d257 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "GET /compute/v2.1/servers/c214e6ec-8d3d-4cef-85fc-7c2bfe01b972" status: 200 len: 1312 microversion: 2.1 time: 0.428329 Oct 27 03:28:18.655982 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 998/1969] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:28:18 2022] GET /compute/v2.1/servers/c214e6ec-8d3d-4cef-85fc-7c2bfe01b972 => generated 1312 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:28:18.665043 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-438418b6-0a1e-4153-ac9a-ceca5070dc27 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7dda075310>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:18.747031 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-438418b6-0a1e-4153-ac9a-ceca5070dc27 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/images/787934da-f249-4af1-9590-fecf6bc5d90f" status: 200 len: 1413 microversion: 2.1 time: 0.089505 Oct 27 03:28:18.755505 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 999/1970] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:28:18 2022] GET /compute/v2.1/images/787934da-f249-4af1-9590-fecf6bc5d90f => generated 1413 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:19.085431 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-29320493-75c0-4ad8-9ee6-3819048ddcd2 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/084d2458-ef09-444a-8eb9-d4d4afb43491" status: 202 len: 0 microversion: 2.1 time: 3.079651 Oct 27 03:28:19.089870 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 972/1971] 10.222.0.20 () {58 vars in 1263 bytes} [Thu Oct 27 03:28:16 2022] DELETE /compute/v2.1/os-floating-ips/084d2458-ef09-444a-8eb9-d4d4afb43491 => generated 0 bytes in 3085 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:28:19.094897 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-708fc6d5-0785-42e0-9706-bbfee12a380b tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:19.103042 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-708fc6d5-0785-42e0-9706-bbfee12a380b tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] [instance: 4a09478e-ae93-4bf9-b270-95cd88d88476] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:19.103377 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-708fc6d5-0785-42e0-9706-bbfee12a380b tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:19.103875 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-708fc6d5-0785-42e0-9706-bbfee12a380b tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:19.115779 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-708fc6d5-0785-42e0-9706-bbfee12a380b tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:19.116575 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-708fc6d5-0785-42e0-9706-bbfee12a380b tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:19.117062 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-708fc6d5-0785-42e0-9706-bbfee12a380b tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:19.127816 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-708fc6d5-0785-42e0-9706-bbfee12a380b tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:19.212374 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-708fc6d5-0785-42e0-9706-bbfee12a380b tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] [instance: 4a09478e-ae93-4bf9-b270-95cd88d88476] Going to try to terminate instance {{(pid=121000) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:28:19.294412 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:28:19.454837 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-fa9035bb-4d17-4995-8c50-7dfd6307dd32 req-de868040-1896-4d10-a7b1-d83c3e59a62f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c214e6ec-8d3d-4cef-85fc-7c2bfe01b972", "name": "network-vif-plugged", "status": "completed", "tag": "3602da80-5480-49d6-95b5-bdca0e2792ca"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:28:19.484896 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-fa9035bb-4d17-4995-8c50-7dfd6307dd32 req-de868040-1896-4d10-a7b1-d83c3e59a62f service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:19.493006 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-fa9035bb-4d17-4995-8c50-7dfd6307dd32 req-de868040-1896-4d10-a7b1-d83c3e59a62f service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:19.505580 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-fa9035bb-4d17-4995-8c50-7dfd6307dd32 req-de868040-1896-4d10-a7b1-d83c3e59a62f service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:19.549824 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-fa9035bb-4d17-4995-8c50-7dfd6307dd32 req-de868040-1896-4d10-a7b1-d83c3e59a62f service nova] Creating event network-vif-plugged:3602da80-5480-49d6-95b5-bdca0e2792ca for instance c214e6ec-8d3d-4cef-85fc-7c2bfe01b972 on n-h2-862769-1 Oct 27 03:28:19.552664 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-fa9035bb-4d17-4995-8c50-7dfd6307dd32 req-de868040-1896-4d10-a7b1-d83c3e59a62f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101520 Oct 27 03:28:19.575726 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 973/1972] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:28:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:28:19.699100 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-542a4b90-d081-45d0-a0db-fb1e0b54afea tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:19.699100 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-542a4b90-d081-45d0-a0db-fb1e0b54afea tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: c214e6ec-8d3d-4cef-85fc-7c2bfe01b972] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:19.714180 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-542a4b90-d081-45d0-a0db-fb1e0b54afea tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:19.714696 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-542a4b90-d081-45d0-a0db-fb1e0b54afea tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:19.715146 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-542a4b90-d081-45d0-a0db-fb1e0b54afea tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:19.730478 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-542a4b90-d081-45d0-a0db-fb1e0b54afea tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:19.731326 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-542a4b90-d081-45d0-a0db-fb1e0b54afea tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:19.731986 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-542a4b90-d081-45d0-a0db-fb1e0b54afea tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:19.774300 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-708fc6d5-0785-42e0-9706-bbfee12a380b tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4a09478e-ae93-4bf9-b270-95cd88d88476" status: 204 len: 0 microversion: 2.1 time: 0.682903 Oct 27 03:28:19.775763 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1000/1973] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:28:19 2022] DELETE /compute/v2.1/servers/4a09478e-ae93-4bf9-b270-95cd88d88476 => generated 0 bytes in 685 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 03:28:19.784363 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4e7fef25-0391-457c-a502-486a2dad9cb7 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7ddec43790>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:19.905899 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4e7fef25-0391-457c-a502-486a2dad9cb7 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/images/787934da-f249-4af1-9590-fecf6bc5d90f" status: 200 len: 1413 microversion: 2.1 time: 0.128691 Oct 27 03:28:19.915115 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1001/1974] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:28:19 2022] GET /compute/v2.1/images/787934da-f249-4af1-9590-fecf6bc5d90f => generated 1413 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:19.923224 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6a9fc3cf-b62e-4584-9a28-d012ef08e4e2 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:19.923800 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6a9fc3cf-b62e-4584-9a28-d012ef08e4e2 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] [instance: 4a09478e-ae93-4bf9-b270-95cd88d88476] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:19.953307 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6a9fc3cf-b62e-4584-9a28-d012ef08e4e2 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:19.953842 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6a9fc3cf-b62e-4584-9a28-d012ef08e4e2 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:19.966195 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6a9fc3cf-b62e-4584-9a28-d012ef08e4e2 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:19.967325 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6a9fc3cf-b62e-4584-9a28-d012ef08e4e2 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:19.969073 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6a9fc3cf-b62e-4584-9a28-d012ef08e4e2 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:19.969697 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6a9fc3cf-b62e-4584-9a28-d012ef08e4e2 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:20.120658 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-542a4b90-d081-45d0-a0db-fb1e0b54afea tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13e05e253c94aadb1c089128ff35be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8510a519f14deea6f35a437419e161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:20.133166 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-542a4b90-d081-45d0-a0db-fb1e0b54afea tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "GET /compute/v2.1/servers/c214e6ec-8d3d-4cef-85fc-7c2bfe01b972" status: 200 len: 1312 microversion: 2.1 time: 0.453767 Oct 27 03:28:20.133795 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 974/1975] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:28:19 2022] GET /compute/v2.1/servers/c214e6ec-8d3d-4cef-85fc-7c2bfe01b972 => generated 1312 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:28:20.216732 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-6a9fc3cf-b62e-4584-9a28-d012ef08e4e2 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8640291c8745609faae41bdd731c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cee634bb1f4bb0a47f33a49f24ccdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:20.225504 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6a9fc3cf-b62e-4584-9a28-d012ef08e4e2 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] 10.222.0.20 "GET /compute/v2.1/servers/4a09478e-ae93-4bf9-b270-95cd88d88476" status: 200 len: 1526 microversion: 2.1 time: 0.309214 Oct 27 03:28:20.231838 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1002/1976] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:28:19 2022] GET /compute/v2.1/servers/4a09478e-ae93-4bf9-b270-95cd88d88476 => generated 1526 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:20.921957 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f1d7223e-2171-44cc-a13c-2b19217539ba tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7dda4525e0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:21.015020 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f1d7223e-2171-44cc-a13c-2b19217539ba tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/images/787934da-f249-4af1-9590-fecf6bc5d90f" status: 200 len: 1413 microversion: 2.1 time: 0.096941 Oct 27 03:28:21.039288 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 975/1977] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:28:20 2022] GET /compute/v2.1/images/787934da-f249-4af1-9590-fecf6bc5d90f => generated 1413 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:21.102400 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-206464ff-3845-4ebd-8db4-53066ed0779c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1891547450", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "bccdb388-9120-416e-ba10-d9831d24a110"}], "block_device_mapping_v2": [{"uuid": "7950748e-6e5b-4e65-8196-5466169003d8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:28:21.157966 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2741cec8-b56f-4270-8800-deb641f8d433 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:21.159274 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2741cec8-b56f-4270-8800-deb641f8d433 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: c214e6ec-8d3d-4cef-85fc-7c2bfe01b972] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:21.199155 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2741cec8-b56f-4270-8800-deb641f8d433 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:21.199660 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2741cec8-b56f-4270-8800-deb641f8d433 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:21.200109 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2741cec8-b56f-4270-8800-deb641f8d433 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:21.212708 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2741cec8-b56f-4270-8800-deb641f8d433 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:21.215350 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2741cec8-b56f-4270-8800-deb641f8d433 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:21.216224 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2741cec8-b56f-4270-8800-deb641f8d433 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:21.343681 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-206464ff-3845-4ebd-8db4-53066ed0779c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] validate_networks() for [('bccdb388-9120-416e-ba10-d9831d24a110', None, None, None, None, None)] {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:28:21.732484 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2741cec8-b56f-4270-8800-deb641f8d433 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13e05e253c94aadb1c089128ff35be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8510a519f14deea6f35a437419e161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:21.741526 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2741cec8-b56f-4270-8800-deb641f8d433 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "GET /compute/v2.1/servers/c214e6ec-8d3d-4cef-85fc-7c2bfe01b972" status: 200 len: 1312 microversion: 2.1 time: 0.588000 Oct 27 03:28:21.765077 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 976/1978] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:28:21 2022] GET /compute/v2.1/servers/c214e6ec-8d3d-4cef-85fc-7c2bfe01b972 => generated 1312 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:21.772512 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-18723e93-9e3d-4e36-95ff-613b2724adcd tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:21.773523 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-18723e93-9e3d-4e36-95ff-613b2724adcd tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] [instance: 4a09478e-ae93-4bf9-b270-95cd88d88476] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:21.797065 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-18723e93-9e3d-4e36-95ff-613b2724adcd tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:21.798934 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-18723e93-9e3d-4e36-95ff-613b2724adcd tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:21.800962 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-18723e93-9e3d-4e36-95ff-613b2724adcd tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:21.802133 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-18723e93-9e3d-4e36-95ff-613b2724adcd tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:21.803556 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-18723e93-9e3d-4e36-95ff-613b2724adcd tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:21.805827 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-18723e93-9e3d-4e36-95ff-613b2724adcd tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:22.226953 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-18723e93-9e3d-4e36-95ff-613b2724adcd tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8640291c8745609faae41bdd731c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cee634bb1f4bb0a47f33a49f24ccdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:22.237547 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-18723e93-9e3d-4e36-95ff-613b2724adcd tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] 10.222.0.20 "GET /compute/v2.1/servers/4a09478e-ae93-4bf9-b270-95cd88d88476" status: 200 len: 1526 microversion: 2.1 time: 0.470625 Oct 27 03:28:22.251656 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 977/1979] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:28:21 2022] GET /compute/v2.1/servers/4a09478e-ae93-4bf9-b270-95cd88d88476 => generated 1526 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:22.263842 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-36430f8d-c150-4238-94df-90042a50d5c3 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7ddecea1f0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:22.346537 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-36430f8d-c150-4238-94df-90042a50d5c3 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/images/787934da-f249-4af1-9590-fecf6bc5d90f" status: 200 len: 1413 microversion: 2.1 time: 0.093612 Oct 27 03:28:22.351769 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 978/1980] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:28:22 2022] GET /compute/v2.1/images/787934da-f249-4af1-9590-fecf6bc5d90f => generated 1413 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:22.575084 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-206464ff-3845-4ebd-8db4-53066ed0779c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:28:22.575588 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-206464ff-3845-4ebd-8db4-53066ed0779c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:28:22.576928 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-206464ff-3845-4ebd-8db4-53066ed0779c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:28:22.578413 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-206464ff-3845-4ebd-8db4-53066ed0779c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:28:22.579284 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-206464ff-3845-4ebd-8db4-53066ed0779c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:28:22.608927 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:28:22.645752 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-206464ff-3845-4ebd-8db4-53066ed0779c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:22.646300 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-206464ff-3845-4ebd-8db4-53066ed0779c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:22.646753 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-206464ff-3845-4ebd-8db4-53066ed0779c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:22.647515 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-206464ff-3845-4ebd-8db4-53066ed0779c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:22.647979 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-206464ff-3845-4ebd-8db4-53066ed0779c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:22.648414 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-206464ff-3845-4ebd-8db4-53066ed0779c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:22.730457 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-206464ff-3845-4ebd-8db4-53066ed0779c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Getting quotas for project aaee7e66f16e4ed5b49394311bd2803a. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:28:22.736636 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-206464ff-3845-4ebd-8db4-53066ed0779c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Getting quotas for user 8c93886c5818439690564c2299a4f3ee and project aaee7e66f16e4ed5b49394311bd2803a. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:28:22.772447 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6001c187-b10c-40ff-88be-2594c739e188 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:22.773367 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-6001c187-b10c-40ff-88be-2594c739e188 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: c214e6ec-8d3d-4cef-85fc-7c2bfe01b972] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:22.781300 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6001c187-b10c-40ff-88be-2594c739e188 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:22.782126 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6001c187-b10c-40ff-88be-2594c739e188 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:22.783091 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6001c187-b10c-40ff-88be-2594c739e188 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:22.784509 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6001c187-b10c-40ff-88be-2594c739e188 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:22.785219 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6001c187-b10c-40ff-88be-2594c739e188 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:22.785904 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6001c187-b10c-40ff-88be-2594c739e188 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:22.803809 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=3,nova_cell1:RELEASE=2,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:28:22.933281 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-206464ff-3845-4ebd-8db4-53066ed0779c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:28:22.935805 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-206464ff-3845-4ebd-8db4-53066ed0779c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: a8925d29-d9e0-4dbb-a73d-09473255fa34] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7950748e-6e5b-4e65-8196-5466169003d8',volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:28:23.130590 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6001c187-b10c-40ff-88be-2594c739e188 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13e05e253c94aadb1c089128ff35be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8510a519f14deea6f35a437419e161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:23.143412 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6001c187-b10c-40ff-88be-2594c739e188 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "GET /compute/v2.1/servers/c214e6ec-8d3d-4cef-85fc-7c2bfe01b972" status: 200 len: 1462 microversion: 2.1 time: 0.374935 Oct 27 03:28:23.145705 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 979/1981] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:28:22 2022] GET /compute/v2.1/servers/c214e6ec-8d3d-4cef-85fc-7c2bfe01b972 => generated 1462 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:23.538972 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d51cf06e-c256-4486-8d34-46b4633e9e1f tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:23.544593 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d51cf06e-c256-4486-8d34-46b4633e9e1f tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Searching by: {'deleted': False, 'project_id': 'cec0773722a6496381499feb8801a027'} {{(pid=121001) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 03:28:23.563233 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d51cf06e-c256-4486-8d34-46b4633e9e1f tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:23.565513 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d51cf06e-c256-4486-8d34-46b4633e9e1f tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:23.568289 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d51cf06e-c256-4486-8d34-46b4633e9e1f tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:23.570313 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d51cf06e-c256-4486-8d34-46b4633e9e1f tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:23.570967 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d51cf06e-c256-4486-8d34-46b4633e9e1f tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:23.571601 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d51cf06e-c256-4486-8d34-46b4633e9e1f tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:23.716591 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-206464ff-3845-4ebd-8db4-53066ed0779c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.611813 Oct 27 03:28:23.725497 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1003/1982] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:28:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 2629 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 03:28:23.735753 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-558ba610-9cc6-46f3-bab9-e90826fddc53 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:23.744124 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-558ba610-9cc6-46f3-bab9-e90826fddc53 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] [instance: 4a09478e-ae93-4bf9-b270-95cd88d88476] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:23.764430 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-558ba610-9cc6-46f3-bab9-e90826fddc53 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:23.765916 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-558ba610-9cc6-46f3-bab9-e90826fddc53 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:23.766681 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-558ba610-9cc6-46f3-bab9-e90826fddc53 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:23.767442 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-558ba610-9cc6-46f3-bab9-e90826fddc53 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:23.768010 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-558ba610-9cc6-46f3-bab9-e90826fddc53 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:23.768439 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-558ba610-9cc6-46f3-bab9-e90826fddc53 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:23.910178 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d51cf06e-c256-4486-8d34-46b4633e9e1f tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.724122 Oct 27 03:28:23.911231 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 980/1983] 10.222.0.20 () {58 vars in 1146 bytes} [Thu Oct 27 03:28:23 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 03:28:23.923911 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-96145ba7-b367-463f-8220-3a5807a57fdb tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7dda47a160>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:24.023381 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-96145ba7-b367-463f-8220-3a5807a57fdb tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/images/787934da-f249-4af1-9590-fecf6bc5d90f" status: 200 len: 1413 microversion: 2.1 time: 0.110730 Oct 27 03:28:24.032077 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 981/1984] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:28:23 2022] GET /compute/v2.1/images/787934da-f249-4af1-9590-fecf6bc5d90f => generated 1413 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:24.038673 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-191901d3-8b59-4ff7-a40b-65379dccd330 req-7cd291a5-5860-4bf1-8320-f0cb19474a86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a09478e-ae93-4bf9-b270-95cd88d88476", "name": "network-vif-deleted", "tag": "b7642b15-cece-4456-a1d2-fefef01ecb62"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:28:24.074261 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-191901d3-8b59-4ff7-a40b-65379dccd330 req-7cd291a5-5860-4bf1-8320-f0cb19474a86 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:24.076425 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-191901d3-8b59-4ff7-a40b-65379dccd330 req-7cd291a5-5860-4bf1-8320-f0cb19474a86 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:24.076425 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-191901d3-8b59-4ff7-a40b-65379dccd330 req-7cd291a5-5860-4bf1-8320-f0cb19474a86 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:24.144728 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-191901d3-8b59-4ff7-a40b-65379dccd330 req-7cd291a5-5860-4bf1-8320-f0cb19474a86 service nova] Creating event network-vif-deleted:b7642b15-cece-4456-a1d2-fefef01ecb62 for instance 4a09478e-ae93-4bf9-b270-95cd88d88476 on n-h1-862769-1 Oct 27 03:28:24.162688 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-191901d3-8b59-4ff7-a40b-65379dccd330 req-7cd291a5-5860-4bf1-8320-f0cb19474a86 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132000 Oct 27 03:28:24.162688 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 982/1985] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:28:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:28:24.172541 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-bbc88c9a-37b8-457e-bc54-51770a4ddb25 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:24.179531 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-bbc88c9a-37b8-457e-bc54-51770a4ddb25 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: a8925d29-d9e0-4dbb-a73d-09473255fa34] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:24.421645 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-bbc88c9a-37b8-457e-bc54-51770a4ddb25 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:24.437444 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-bbc88c9a-37b8-457e-bc54-51770a4ddb25 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34" status: 200 len: 1053 microversion: 2.1 time: 0.270393 Oct 27 03:28:24.440583 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 983/1986] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:28:24 2022] GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34 => generated 1053 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:24.462164 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-19f7c536-2cc2-415c-9474-05c4b8168b81 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:24.491220 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-19f7c536-2cc2-415c-9474-05c4b8168b81 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Searching by: {'deleted': False} {{(pid=121001) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 03:28:24.512421 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-558ba610-9cc6-46f3-bab9-e90826fddc53 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:24.516886 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-558ba610-9cc6-46f3-bab9-e90826fddc53 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:24.527442 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-558ba610-9cc6-46f3-bab9-e90826fddc53 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:24.528269 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-558ba610-9cc6-46f3-bab9-e90826fddc53 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lazy-loading 'fault' on Instance uuid 4a09478e-ae93-4bf9-b270-95cd88d88476 {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:28:24.544708 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-19f7c536-2cc2-415c-9474-05c4b8168b81 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:24.546588 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-19f7c536-2cc2-415c-9474-05c4b8168b81 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:24.549729 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-19f7c536-2cc2-415c-9474-05c4b8168b81 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:24.551356 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-19f7c536-2cc2-415c-9474-05c4b8168b81 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:24.555426 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-19f7c536-2cc2-415c-9474-05c4b8168b81 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:24.556419 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-19f7c536-2cc2-415c-9474-05c4b8168b81 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:24.777946 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.multi_cell_list [None req-19f7c536-2cc2-415c-9474-05c4b8168b81 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Listed batch of 12 results from cell out of 999 limit. Returned 12 total so far. {{(pid=121001) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 03:28:25.046082 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-558ba610-9cc6-46f3-bab9-e90826fddc53 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8640291c8745609faae41bdd731c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cee634bb1f4bb0a47f33a49f24ccdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:25.055409 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-558ba610-9cc6-46f3-bab9-e90826fddc53 tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] 10.222.0.20 "GET /compute/v2.1/servers/4a09478e-ae93-4bf9-b270-95cd88d88476" status: 200 len: 1314 microversion: 2.1 time: 1.328075 Oct 27 03:28:25.068735 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1004/1987] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:28:23 2022] GET /compute/v2.1/servers/4a09478e-ae93-4bf9-b270-95cd88d88476 => generated 1314 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:25.087485 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4c2626ea-13d5-4077-9efb-0ecd93af1def tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7dda130e50>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:25.244348 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4c2626ea-13d5-4077-9efb-0ecd93af1def tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/images/787934da-f249-4af1-9590-fecf6bc5d90f" status: 200 len: 1413 microversion: 2.1 time: 0.174122 Oct 27 03:28:25.245367 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1005/1988] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:28:25 2022] GET /compute/v2.1/images/787934da-f249-4af1-9590-fecf6bc5d90f => generated 1413 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:25.463066 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-039b6865-37d0-434e-8135-4766f3b8bc9c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:25.463705 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-039b6865-37d0-434e-8135-4766f3b8bc9c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: a8925d29-d9e0-4dbb-a73d-09473255fa34] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:25.735634 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-039b6865-37d0-434e-8135-4766f3b8bc9c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:25.752320 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-039b6865-37d0-434e-8135-4766f3b8bc9c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34" status: 200 len: 1053 microversion: 2.1 time: 0.293786 Oct 27 03:28:25.755267 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1006/1989] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:28:25 2022] GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34 => generated 1053 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:25.868093 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:28:25.876680 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-19f7c536-2cc2-415c-9474-05c4b8168b81 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:25.880670 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-19f7c536-2cc2-415c-9474-05c4b8168b81 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:25.883199 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-19f7c536-2cc2-415c-9474-05c4b8168b81 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:26.088996 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e2d0cec9-5153-4d6d-b9c5-528b6a7090de tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:26.089707 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e2d0cec9-5153-4d6d-b9c5-528b6a7090de tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] [instance: 4a09478e-ae93-4bf9-b270-95cd88d88476] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:26.096932 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e2d0cec9-5153-4d6d-b9c5-528b6a7090de tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:26.097982 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e2d0cec9-5153-4d6d-b9c5-528b6a7090de tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:26.116964 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e2d0cec9-5153-4d6d-b9c5-528b6a7090de tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:26.117772 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e2d0cec9-5153-4d6d-b9c5-528b6a7090de tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:26.126825 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e2d0cec9-5153-4d6d-b9c5-528b6a7090de tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:26.127467 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e2d0cec9-5153-4d6d-b9c5-528b6a7090de tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:26.155504 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-e2d0cec9-5153-4d6d-b9c5-528b6a7090de tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] HTTP exception thrown: Instance 4a09478e-ae93-4bf9-b270-95cd88d88476 could not be found. Oct 27 03:28:26.178263 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e2d0cec9-5153-4d6d-b9c5-528b6a7090de tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Request method failure captured: Oct 27 03:28:26.178263 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/4a09478e-ae93-4bf9-b270-95cd88d88476 HTTP/1.1 Oct 27 03:28:26.178263 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:28:26.178263 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:28:26.178263 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:28:26.178263 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:28:26.178263 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:28:26.178263 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:28:26.178263 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:28:26.178263 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:28:26.178263 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfpxqXTQ_iW0ArXs975gZDY7uwJ5nHAF4hg8CDCuM3uj2pg20HzuZSTMGIAavvX9tg8x18_38hYZf-6YPCL1tkP6V8Q65rooyC_Nub0n_uQDqVJuEHOO4RnH61oKbBP3mHbYyV4YslidXoGUJNOsCvML8l67_M2-TEZbrHodlzZq55s Oct 27 03:28:26.178263 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:28:26.178263 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:28:26.178263 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:28:26.178263 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:28:26.178263 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:28:26.178263 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:28:26.178263 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: f1cee634bb1f4bb0a47f33a49f24ccdf Oct 27 03:28:26.178263 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-606388594 Oct 27 03:28:26.178263 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:28:26.178263 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:28:26.180143 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f1cee634bb1f4bb0a47f33a49f24ccdf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f1cee634bb1f4bb0a47f33a49f24ccdf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f1cee634bb1f4bb0a47f33a49f24ccdf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f1cee634bb1f4bb0a47f33a49f24ccdf"}]}] Oct 27 03:28:26.180143 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-606388594 Oct 27 03:28:26.180143 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: f1cee634bb1f4bb0a47f33a49f24ccdf Oct 27 03:28:26.180143 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-606388594 Oct 27 03:28:26.180143 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-FloatingIPsAssociationTestJSON-606388594-project Oct 27 03:28:26.180143 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:28:26.180143 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:28:26.180143 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 8e8640291c8745609faae41bdd731c17 Oct 27 03:28:26.180143 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-606388594-project Oct 27 03:28:26.180143 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:28:26.180143 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 4a09478e-ae93-4bf9-b270-95cd88d88476 could not be found. Oct 27 03:28:26.180143 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '4a09478e-ae93-4bf9-b270-95cd88d88476'} Oct 27 03:28:26.181388 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:28:26.181388 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:28:26.181388 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:28:26.181388 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:28:26.181388 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:28:26.181388 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:28:26.181388 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:28:26.181388 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:28:26.181388 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:28:26.181388 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:28:26.181388 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a09478e-ae93-4bf9-b270-95cd88d88476 could not be found. Oct 27 03:28:26.181388 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:28:26.181388 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:28:26.181388 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:28:26.181388 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:28:26.181388 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:28:26.181388 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:28:26.181388 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:28:26.181388 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:28:26.181388 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:28:26.183043 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:28:26.183043 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:28:26.183043 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:28:26.183043 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:28:26.183043 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:28:26.183043 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:28:26.183043 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:28:26.183043 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a09478e-ae93-4bf9-b270-95cd88d88476 could not be found. Oct 27 03:28:26.183043 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:28:26.183043 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:28:26.183043 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:28:26.183043 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:28:26.183043 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:28:26.183043 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:28:26.183043 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:28:26.183043 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:28:26.183043 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a09478e-ae93-4bf9-b270-95cd88d88476 could not be found. Oct 27 03:28:26.183043 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:28:26.196618 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e2d0cec9-5153-4d6d-b9c5-528b6a7090de tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] Returning 404 to user: Instance 4a09478e-ae93-4bf9-b270-95cd88d88476 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:28:26.199812 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e2d0cec9-5153-4d6d-b9c5-528b6a7090de tempest-FloatingIPsAssociationTestJSON-606388594 tempest-FloatingIPsAssociationTestJSON-606388594-project] 10.222.0.20 "GET /compute/v2.1/servers/4a09478e-ae93-4bf9-b270-95cd88d88476" status: 404 len: 111 microversion: 2.1 time: 0.112891 Oct 27 03:28:26.200014 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1007/1990] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:28:26 2022] GET /compute/v2.1/servers/4a09478e-ae93-4bf9-b270-95cd88d88476 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:28:26.261493 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c967a664-7783-40f0-8425-5f7efca57cc7 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7dda1b6280>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:26.351389 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c967a664-7783-40f0-8425-5f7efca57cc7 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/images/787934da-f249-4af1-9590-fecf6bc5d90f" status: 200 len: 1413 microversion: 2.1 time: 0.094145 Oct 27 03:28:26.352134 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1008/1991] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:28:26 2022] GET /compute/v2.1/images/787934da-f249-4af1-9590-fecf6bc5d90f => generated 1413 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:26.778303 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8b41b6cd-5ec8-41eb-8a04-2e5dabd48464 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:26.783052 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8b41b6cd-5ec8-41eb-8a04-2e5dabd48464 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: a8925d29-d9e0-4dbb-a73d-09473255fa34] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:26.804863 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8b41b6cd-5ec8-41eb-8a04-2e5dabd48464 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:26.805391 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8b41b6cd-5ec8-41eb-8a04-2e5dabd48464 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:26.805884 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8b41b6cd-5ec8-41eb-8a04-2e5dabd48464 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:26.806665 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8b41b6cd-5ec8-41eb-8a04-2e5dabd48464 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:26.811773 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8b41b6cd-5ec8-41eb-8a04-2e5dabd48464 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:26.811773 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8b41b6cd-5ec8-41eb-8a04-2e5dabd48464 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:27.222429 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8b41b6cd-5ec8-41eb-8a04-2e5dabd48464 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:27.239852 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8b41b6cd-5ec8-41eb-8a04-2e5dabd48464 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34" status: 200 len: 1151 microversion: 2.1 time: 0.465503 Oct 27 03:28:27.243369 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1009/1992] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:28:26 2022] GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34 => generated 1151 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:28:27.368145 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-aba906ef-827e-48ae-9aa0-b58da19522ec tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7dda130b80>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:27.447787 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-aba906ef-827e-48ae-9aa0-b58da19522ec tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/images/787934da-f249-4af1-9590-fecf6bc5d90f" status: 200 len: 1413 microversion: 2.1 time: 0.083378 Oct 27 03:28:27.461746 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1010/1993] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:28:27 2022] GET /compute/v2.1/images/787934da-f249-4af1-9590-fecf6bc5d90f => generated 1413 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:27.659198 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-19f7c536-2cc2-415c-9474-05c4b8168b81 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 21161 microversion: 2.1 time: 3.216055 Oct 27 03:28:27.660922 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 984/1994] 10.222.0.20 () {58 vars in 1171 bytes} [Thu Oct 27 03:28:24 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 21161 bytes in 3220 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 03:28:27.723631 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-15d389be-d843-4f5a-bdbd-9bacdace1f93 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:27.750640 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-15d389be-d843-4f5a-bdbd-9bacdace1f93 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Searching by: {'deleted': False, 'project_id': 'cec0773722a6496381499feb8801a027'} {{(pid=121001) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 03:28:27.764552 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-15d389be-d843-4f5a-bdbd-9bacdace1f93 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:27.766678 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-15d389be-d843-4f5a-bdbd-9bacdace1f93 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:27.768050 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-15d389be-d843-4f5a-bdbd-9bacdace1f93 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:27.772855 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-15d389be-d843-4f5a-bdbd-9bacdace1f93 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:27.775269 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-15d389be-d843-4f5a-bdbd-9bacdace1f93 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:27.777451 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-15d389be-d843-4f5a-bdbd-9bacdace1f93 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:27.838028 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a7b0eca1-3ba6-43cd-acfc-0a3d49268bbb tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-958769521", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "6db28589-fbc1-4cf0-8e7f-bd8820657579"}]}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:28:27.855750 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-15d389be-d843-4f5a-bdbd-9bacdace1f93 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/detail?tenant_id=2c8510a519f14deea6f35a437419e161" status: 200 len: 15 microversion: 2.1 time: 0.140651 Oct 27 03:28:27.867169 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 985/1995] 10.222.0.20 () {58 vars in 1231 bytes} [Thu Oct 27 03:28:27 2022] GET /compute/v2.1/servers/detail?tenant_id=2c8510a519f14deea6f35a437419e161 => generated 15 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 27 03:28:27.873419 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1ad296b9-a617-432f-9cbb-93f5ce0030c0 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1095507023", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "1257014e-2ff1-4e8e-a591-63c86a5e0d4b"}], "block_device_mapping_v2": [{"uuid": "1f4934f1-02ab-46f5-a7e6-4fb299c4c605", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:28:27.928886 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-a7b0eca1-3ba6-43cd-acfc-0a3d49268bbb tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] validate_networks() for [('6db28589-fbc1-4cf0-8e7f-bd8820657579', None, None, None, None, None)] {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:28:27.970640 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.network.neutron [None req-1ad296b9-a617-432f-9cbb-93f5ce0030c0 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] validate_networks() for [('1257014e-2ff1-4e8e-a591-63c86a5e0d4b', None, None, None, None, None)] {{(pid=121001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:28:29.217003 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-1ad296b9-a617-432f-9cbb-93f5ce0030c0 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Flavor limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:28:29.217703 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-1ad296b9-a617-432f-9cbb-93f5ce0030c0 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Image limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:28:29.218278 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-1ad296b9-a617-432f-9cbb-93f5ce0030c0 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Flavor pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:28:29.219028 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-1ad296b9-a617-432f-9cbb-93f5ce0030c0 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Image pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:28:29.219539 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-1ad296b9-a617-432f-9cbb-93f5ce0030c0 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:28:29.232897 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1ad296b9-a617-432f-9cbb-93f5ce0030c0 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:29.234918 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1ad296b9-a617-432f-9cbb-93f5ce0030c0 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:29.239006 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1ad296b9-a617-432f-9cbb-93f5ce0030c0 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:29.240042 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1ad296b9-a617-432f-9cbb-93f5ce0030c0 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:29.242521 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1ad296b9-a617-432f-9cbb-93f5ce0030c0 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:29.243080 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1ad296b9-a617-432f-9cbb-93f5ce0030c0 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:29.295692 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-1ad296b9-a617-432f-9cbb-93f5ce0030c0 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Getting quotas for project 3b1cf79289db4d7883d93ec3fe908d66. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:28:29.314315 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-1ad296b9-a617-432f-9cbb-93f5ce0030c0 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Getting quotas for user ba3ce7f040d24c33bcf9b97d1ef25268 and project 3b1cf79289db4d7883d93ec3fe908d66. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:28:29.453318 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-a7b0eca1-3ba6-43cd-acfc-0a3d49268bbb tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:28:29.453848 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-a7b0eca1-3ba6-43cd-acfc-0a3d49268bbb tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:28:29.454463 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-a7b0eca1-3ba6-43cd-acfc-0a3d49268bbb tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:28:29.455110 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-a7b0eca1-3ba6-43cd-acfc-0a3d49268bbb tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:28:29.455662 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-a7b0eca1-3ba6-43cd-acfc-0a3d49268bbb tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:28:29.472968 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a7b0eca1-3ba6-43cd-acfc-0a3d49268bbb tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:29.475566 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a7b0eca1-3ba6-43cd-acfc-0a3d49268bbb tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:29.476327 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a7b0eca1-3ba6-43cd-acfc-0a3d49268bbb tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:29.480758 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a7b0eca1-3ba6-43cd-acfc-0a3d49268bbb tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:29.481634 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a7b0eca1-3ba6-43cd-acfc-0a3d49268bbb tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:29.482584 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a7b0eca1-3ba6-43cd-acfc-0a3d49268bbb tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:29.485178 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1ad296b9-a617-432f-9cbb-93f5ce0030c0 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Going to run 1 instances... {{(pid=121001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:28:29.491569 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1ad296b9-a617-432f-9cbb-93f5ce0030c0 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: d5e6f604-9466-45c6-86a8-885cfb393223] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1f4934f1-02ab-46f5-a7e6-4fb299c4c605',volume_size=None,volume_type=None)] {{(pid=121001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:28:29.533807 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-a7b0eca1-3ba6-43cd-acfc-0a3d49268bbb tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Getting quotas for project 16b0b534b9eb463aab0f13e838578da2. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:28:29.550796 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-a7b0eca1-3ba6-43cd-acfc-0a3d49268bbb tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Getting quotas for user 071401bed74d48fe8ae2dbdb98aa81cc and project 16b0b534b9eb463aab0f13e838578da2. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:28:29.589156 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a7b0eca1-3ba6-43cd-acfc-0a3d49268bbb tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Going to run 3 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:28:29.595412 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a7b0eca1-3ba6-43cd-acfc-0a3d49268bbb tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] [instance: a89c8f12-2492-4a0f-8887-acd62e510fd9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:28:29.764205 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a7b0eca1-3ba6-43cd-acfc-0a3d49268bbb tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] [instance: b3dd0fa3-e3b4-471c-b65b-0a190b7c4701] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=a89c8f12-2492-4a0f-8887-acd62e510fd9,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:28:29.954054 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a7b0eca1-3ba6-43cd-acfc-0a3d49268bbb tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] [instance: 2aa6c062-32e4-453d-abb5-a51d96c66e2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=b3dd0fa3-e3b4-471c-b65b-0a190b7c4701,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:28:30.395871 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1ad296b9-a617-432f-9cbb-93f5ce0030c0 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.526428 Oct 27 03:28:30.397081 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 986/1996] 10.222.0.20 () {62 vars in 1188 bytes} [Thu Oct 27 03:28:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 2529 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 27 03:28:30.416541 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0abf88ca-b0c7-4fdd-aafd-c182255c9326 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:30.439016 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0abf88ca-b0c7-4fdd-aafd-c182255c9326 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Searching by: {'tenant_id': '2c8510a519f14deea6f35a437419e161', 'deleted': False} {{(pid=121001) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 03:28:30.489379 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0abf88ca-b0c7-4fdd-aafd-c182255c9326 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:30.490954 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0abf88ca-b0c7-4fdd-aafd-c182255c9326 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:30.490954 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0abf88ca-b0c7-4fdd-aafd-c182255c9326 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:30.492417 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0abf88ca-b0c7-4fdd-aafd-c182255c9326 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:30.497984 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0abf88ca-b0c7-4fdd-aafd-c182255c9326 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:30.499136 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0abf88ca-b0c7-4fdd-aafd-c182255c9326 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:30.528793 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a7b0eca1-3ba6-43cd-acfc-0a3d49268bbb tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.849042 Oct 27 03:28:30.551664 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1011/1997] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:28:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 2877 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 03:28:30.570719 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b269a65e-32a9-4312-ab2f-2e9a294416ae tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:30.571776 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b269a65e-32a9-4312-ab2f-2e9a294416ae tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: a8925d29-d9e0-4dbb-a73d-09473255fa34] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:30.585127 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b269a65e-32a9-4312-ab2f-2e9a294416ae tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:30.586711 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b269a65e-32a9-4312-ab2f-2e9a294416ae tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:30.587481 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b269a65e-32a9-4312-ab2f-2e9a294416ae tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:30.588950 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b269a65e-32a9-4312-ab2f-2e9a294416ae tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:30.590072 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b269a65e-32a9-4312-ab2f-2e9a294416ae tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:30.590721 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b269a65e-32a9-4312-ab2f-2e9a294416ae tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:30.594396 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.multi_cell_list [None req-0abf88ca-b0c7-4fdd-aafd-c182255c9326 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=121001) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 03:28:30.801716 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0abf88ca-b0c7-4fdd-aafd-c182255c9326 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:30.803282 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0abf88ca-b0c7-4fdd-aafd-c182255c9326 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:30.805122 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0abf88ca-b0c7-4fdd-aafd-c182255c9326 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:31.191910 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0abf88ca-b0c7-4fdd-aafd-c182255c9326 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=2c8510a519f14deea6f35a437419e161" status: 200 len: 4824 microversion: 2.1 time: 0.792675 Oct 27 03:28:31.192700 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 987/1998] 10.222.0.20 () {58 vars in 1257 bytes} [Thu Oct 27 03:28:30 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=2c8510a519f14deea6f35a437419e161 => generated 4824 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:31.203954 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b85747e7-5d2c-4743-83ff-d588d118ce0a tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7dda56ee50>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:31.299174 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b85747e7-5d2c-4743-83ff-d588d118ce0a tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/images/787934da-f249-4af1-9590-fecf6bc5d90f" status: 200 len: 1413 microversion: 2.1 time: 0.105184 Oct 27 03:28:31.302999 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 988/1999] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:28:31 2022] GET /compute/v2.1/images/787934da-f249-4af1-9590-fecf6bc5d90f => generated 1413 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:31.319869 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f70e73d0-22b2-4a9c-a31a-4ae725bda93f tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:31.320499 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f70e73d0-22b2-4a9c-a31a-4ae725bda93f tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: d5e6f604-9466-45c6-86a8-885cfb393223] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:31.468675 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f70e73d0-22b2-4a9c-a31a-4ae725bda93f tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:31.477269 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f70e73d0-22b2-4a9c-a31a-4ae725bda93f tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:31.478782 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f70e73d0-22b2-4a9c-a31a-4ae725bda93f tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:31.489020 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f70e73d0-22b2-4a9c-a31a-4ae725bda93f tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223" status: 200 len: 1104 microversion: 2.25 time: 0.184874 Oct 27 03:28:31.490097 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 989/2000] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:28:31 2022] GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223 => generated 1104 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:28:31.495051 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-09d18ffb-7932-49af-bb75-8a01b67a4cca tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:31.508919 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-09d18ffb-7932-49af-bb75-8a01b67a4cca tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '071401bed74d48fe8ae2dbdb98aa81cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b0b534b9eb463aab0f13e838578da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:31.509959 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-09d18ffb-7932-49af-bb75-8a01b67a4cca tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Searching by: {'deleted': False, 'project_id': '16b0b534b9eb463aab0f13e838578da2'} {{(pid=121001) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 03:28:31.567287 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-09d18ffb-7932-49af-bb75-8a01b67a4cca tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:31.568002 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-09d18ffb-7932-49af-bb75-8a01b67a4cca tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:31.568650 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-09d18ffb-7932-49af-bb75-8a01b67a4cca tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:31.569573 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-09d18ffb-7932-49af-bb75-8a01b67a4cca tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:31.570513 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-09d18ffb-7932-49af-bb75-8a01b67a4cca tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:31.571263 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-09d18ffb-7932-49af-bb75-8a01b67a4cca tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:31.808623 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-09d18ffb-7932-49af-bb75-8a01b67a4cca tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 1015 microversion: 2.1 time: 0.316984 Oct 27 03:28:31.809490 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 990/2001] 10.222.0.20 () {58 vars in 1125 bytes} [Thu Oct 27 03:28:31 2022] GET /compute/v2.1/servers => generated 1015 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:31.814452 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6534b7ef-a605-474c-9b69-6fe1d88df263 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:31.834736 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-6534b7ef-a605-474c-9b69-6fe1d88df263 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Searching by: {'tenant_id': 'cec0773722a6496381499feb8801a027', 'deleted': False} {{(pid=121001) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 03:28:31.871470 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6534b7ef-a605-474c-9b69-6fe1d88df263 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:31.872209 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6534b7ef-a605-474c-9b69-6fe1d88df263 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:31.872834 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6534b7ef-a605-474c-9b69-6fe1d88df263 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:31.873813 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6534b7ef-a605-474c-9b69-6fe1d88df263 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:31.874639 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6534b7ef-a605-474c-9b69-6fe1d88df263 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:31.875249 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6534b7ef-a605-474c-9b69-6fe1d88df263 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:31.949134 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6534b7ef-a605-474c-9b69-6fe1d88df263 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=cec0773722a6496381499feb8801a027" status: 200 len: 15 microversion: 2.1 time: 0.138118 Oct 27 03:28:31.949739 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 991/2002] 10.222.0.20 () {58 vars in 1257 bytes} [Thu Oct 27 03:28:31 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=cec0773722a6496381499feb8801a027 => generated 15 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 03:28:31.979954 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0149f04d-3842-459b-895e-17658eb2b839 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:31.984445 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0149f04d-3842-459b-895e-17658eb2b839 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] [instance: 2aa6c062-32e4-453d-abb5-a51d96c66e2d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:32.083271 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0149f04d-3842-459b-895e-17658eb2b839 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '071401bed74d48fe8ae2dbdb98aa81cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b0b534b9eb463aab0f13e838578da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:32.095097 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0149f04d-3842-459b-895e-17658eb2b839 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] 10.222.0.20 "GET /compute/v2.1/servers/2aa6c062-32e4-453d-abb5-a51d96c66e2d" status: 200 len: 1222 microversion: 2.1 time: 0.129484 Oct 27 03:28:32.096438 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 992/2003] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:28:31 2022] GET /compute/v2.1/servers/2aa6c062-32e4-453d-abb5-a51d96c66e2d => generated 1222 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:32.103514 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e3f2ad23-c897-49de-aaea-f85c66b40c19 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:32.116288 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b269a65e-32a9-4312-ab2f-2e9a294416ae tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:32.119252 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e3f2ad23-c897-49de-aaea-f85c66b40c19 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.020892 Oct 27 03:28:32.126261 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 993/2004] 10.222.0.20 () {58 vars in 1189 bytes} [Thu Oct 27 03:28:32 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 03:28:32.135152 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b269a65e-32a9-4312-ab2f-2e9a294416ae tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34" status: 200 len: 1211 microversion: 2.1 time: 1.582057 Oct 27 03:28:32.137556 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1012/2005] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:28:30 2022] GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34 => generated 1211 bytes in 1584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:32.150009 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d7993349-974c-4e54-a74b-913a396d35c5 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:28:32.156756 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d7993349-974c-4e54-a74b-913a396d35c5 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] [instance: 339287fc-37b6-455d-96ab-08ab8e2c3e68] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:32.177252 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d7993349-974c-4e54-a74b-913a396d35c5 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:32.177850 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d7993349-974c-4e54-a74b-913a396d35c5 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:32.182539 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d7993349-974c-4e54-a74b-913a396d35c5 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:32.185729 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d7993349-974c-4e54-a74b-913a396d35c5 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:32.186970 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d7993349-974c-4e54-a74b-913a396d35c5 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:32.187447 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d7993349-974c-4e54-a74b-913a396d35c5 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:32.321068 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a990b270-ae7b-4265-89b5-b89049b851d4 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7ddecb5670>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:32.391576 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a990b270-ae7b-4265-89b5-b89049b851d4 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/images/787934da-f249-4af1-9590-fecf6bc5d90f" status: 200 len: 1413 microversion: 2.1 time: 0.075596 Oct 27 03:28:32.395565 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1013/2006] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:28:32 2022] GET /compute/v2.1/images/787934da-f249-4af1-9590-fecf6bc5d90f => generated 1413 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:32.525302 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-650a1089-13a7-464b-bfab-b59e84855a80 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:32.526743 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-650a1089-13a7-464b-bfab-b59e84855a80 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: d5e6f604-9466-45c6-86a8-885cfb393223] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:32.553183 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-650a1089-13a7-464b-bfab-b59e84855a80 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:32.554992 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-650a1089-13a7-464b-bfab-b59e84855a80 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:32.555547 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-650a1089-13a7-464b-bfab-b59e84855a80 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:32.557489 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-650a1089-13a7-464b-bfab-b59e84855a80 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:32.557988 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-650a1089-13a7-464b-bfab-b59e84855a80 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:32.559241 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-650a1089-13a7-464b-bfab-b59e84855a80 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:32.597287 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d7993349-974c-4e54-a74b-913a396d35c5 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68/action" status: 202 len: 0 microversion: 2.1 time: 0.451896 Oct 27 03:28:32.597992 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 994/2007] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:28:32 2022] POST /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68/action => generated 0 bytes in 455 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:28:32.610609 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7876dfb6-b7a6-4faa-8fb2-f3a2a02f2ddf tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:32.621599 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7876dfb6-b7a6-4faa-8fb2-f3a2a02f2ddf tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c13e05e253c94aadb1c089128ff35be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8510a519f14deea6f35a437419e161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:32.622837 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7876dfb6-b7a6-4faa-8fb2-f3a2a02f2ddf tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '2c8510a519f14deea6f35a437419e161'} {{(pid=121001) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 03:28:32.646752 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7876dfb6-b7a6-4faa-8fb2-f3a2a02f2ddf tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:32.647252 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7876dfb6-b7a6-4faa-8fb2-f3a2a02f2ddf tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:32.655359 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7876dfb6-b7a6-4faa-8fb2-f3a2a02f2ddf tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:32.656674 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7876dfb6-b7a6-4faa-8fb2-f3a2a02f2ddf tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:32.660875 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7876dfb6-b7a6-4faa-8fb2-f3a2a02f2ddf tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:32.662142 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7876dfb6-b7a6-4faa-8fb2-f3a2a02f2ddf tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:32.793208 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-650a1089-13a7-464b-bfab-b59e84855a80 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:32.819508 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-650a1089-13a7-464b-bfab-b59e84855a80 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:32.823945 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-650a1089-13a7-464b-bfab-b59e84855a80 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:32.832970 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-650a1089-13a7-464b-bfab-b59e84855a80 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223" status: 200 len: 1185 microversion: 2.25 time: 0.318577 Oct 27 03:28:32.836998 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1014/2008] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:28:32 2022] GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223 => generated 1185 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:28:32.939607 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.multi_cell_list [None req-7876dfb6-b7a6-4faa-8fb2-f3a2a02f2ddf tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121001) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 03:28:33.072747 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7876dfb6-b7a6-4faa-8fb2-f3a2a02f2ddf tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.467908 Oct 27 03:28:33.073359 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 995/2009] 10.222.0.20 () {58 vars in 1150 bytes} [Thu Oct 27 03:28:32 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:28:33.085712 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1f9ec89c-7b94-48eb-90fe-03121f2d7e17 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:28:33.088508 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1f9ec89c-7b94-48eb-90fe-03121f2d7e17 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] [instance: 339287fc-37b6-455d-96ab-08ab8e2c3e68] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:33.107242 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1f9ec89c-7b94-48eb-90fe-03121f2d7e17 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:33.111344 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1f9ec89c-7b94-48eb-90fe-03121f2d7e17 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:33.116134 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1f9ec89c-7b94-48eb-90fe-03121f2d7e17 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:33.123601 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1f9ec89c-7b94-48eb-90fe-03121f2d7e17 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:33.123601 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1f9ec89c-7b94-48eb-90fe-03121f2d7e17 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:33.124250 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-848cb6d1-14b0-48c3-8e6d-244bf5f29af7 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:33.124364 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1f9ec89c-7b94-48eb-90fe-03121f2d7e17 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:33.124464 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-848cb6d1-14b0-48c3-8e6d-244bf5f29af7 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] [instance: 2aa6c062-32e4-453d-abb5-a51d96c66e2d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:33.220317 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-848cb6d1-14b0-48c3-8e6d-244bf5f29af7 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '071401bed74d48fe8ae2dbdb98aa81cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b0b534b9eb463aab0f13e838578da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:33.230007 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-848cb6d1-14b0-48c3-8e6d-244bf5f29af7 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] 10.222.0.20 "GET /compute/v2.1/servers/2aa6c062-32e4-453d-abb5-a51d96c66e2d" status: 200 len: 1222 microversion: 2.1 time: 0.113250 Oct 27 03:28:33.231446 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 996/2010] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:28:33 2022] GET /compute/v2.1/servers/2aa6c062-32e4-453d-abb5-a51d96c66e2d => generated 1222 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:33.242201 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-334f7466-ddd6-4f09-9c35-6935df37bf17 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:33.245243 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-334f7466-ddd6-4f09-9c35-6935df37bf17 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: a8925d29-d9e0-4dbb-a73d-09473255fa34] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:33.254962 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-334f7466-ddd6-4f09-9c35-6935df37bf17 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:33.255878 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-334f7466-ddd6-4f09-9c35-6935df37bf17 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:33.256527 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-334f7466-ddd6-4f09-9c35-6935df37bf17 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:33.257788 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-334f7466-ddd6-4f09-9c35-6935df37bf17 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:33.258495 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-334f7466-ddd6-4f09-9c35-6935df37bf17 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:33.260889 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-334f7466-ddd6-4f09-9c35-6935df37bf17 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:33.623993 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-334f7466-ddd6-4f09-9c35-6935df37bf17 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:33.704099 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-334f7466-ddd6-4f09-9c35-6935df37bf17 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34" status: 200 len: 1211 microversion: 2.1 time: 0.470163 Oct 27 03:28:33.706267 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 997/2011] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:28:33 2022] GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34 => generated 1211 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:33.723173 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-42eaa1aa-a710-41a4-ab22-23e7c463171f tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7ddec60ee0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:33.752327 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1f9ec89c-7b94-48eb-90fe-03121f2d7e17 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68/action" status: 202 len: 0 microversion: 2.1 time: 0.670439 Oct 27 03:28:33.757657 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1015/2012] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:28:33 2022] POST /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68/action => generated 0 bytes in 672 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:28:33.763349 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b39e2fa5-f09c-4dba-b5c6-17c47aa6a871 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:33.764248 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b39e2fa5-f09c-4dba-b5c6-17c47aa6a871 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] [instance: 339287fc-37b6-455d-96ab-08ab8e2c3e68] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:33.801488 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b39e2fa5-f09c-4dba-b5c6-17c47aa6a871 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:33.805674 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b39e2fa5-f09c-4dba-b5c6-17c47aa6a871 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:33.809137 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b39e2fa5-f09c-4dba-b5c6-17c47aa6a871 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:33.822866 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b39e2fa5-f09c-4dba-b5c6-17c47aa6a871 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:33.823895 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b39e2fa5-f09c-4dba-b5c6-17c47aa6a871 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:33.824795 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b39e2fa5-f09c-4dba-b5c6-17c47aa6a871 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:33.853171 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-42eaa1aa-a710-41a4-ab22-23e7c463171f tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/images/787934da-f249-4af1-9590-fecf6bc5d90f" status: 200 len: 1422 microversion: 2.1 time: 0.136706 Oct 27 03:28:33.863177 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 998/2013] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:28:33 2022] GET /compute/v2.1/images/787934da-f249-4af1-9590-fecf6bc5d90f => generated 1422 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:33.899078 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5b03ba6f-15c2-4a91-97e2-80955349ccaf tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:33.902719 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5b03ba6f-15c2-4a91-97e2-80955349ccaf tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: d5e6f604-9466-45c6-86a8-885cfb393223] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:33.926142 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5b03ba6f-15c2-4a91-97e2-80955349ccaf tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:33.933334 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5b03ba6f-15c2-4a91-97e2-80955349ccaf tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:33.935242 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5b03ba6f-15c2-4a91-97e2-80955349ccaf tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:33.936266 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5b03ba6f-15c2-4a91-97e2-80955349ccaf tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:33.936968 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5b03ba6f-15c2-4a91-97e2-80955349ccaf tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:33.942230 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5b03ba6f-15c2-4a91-97e2-80955349ccaf tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:34.271237 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b39e2fa5-f09c-4dba-b5c6-17c47aa6a871 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68" status: 200 len: 1614 microversion: 2.1 time: 0.510148 Oct 27 03:28:34.274195 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1016/2014] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:28:33 2022] GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68 => generated 1614 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:34.286311 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5b03ba6f-15c2-4a91-97e2-80955349ccaf tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:34.299607 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5b03ba6f-15c2-4a91-97e2-80955349ccaf tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:34.302559 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5b03ba6f-15c2-4a91-97e2-80955349ccaf tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:34.308107 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5b03ba6f-15c2-4a91-97e2-80955349ccaf tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223" status: 200 len: 1233 microversion: 2.25 time: 0.441813 Oct 27 03:28:34.314444 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 999/2015] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:28:33 2022] GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223 => generated 1233 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:28:34.330993 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-db96ee54-480c-4d01-8a7e-adcfb4be831f tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:34.332553 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-db96ee54-480c-4d01-8a7e-adcfb4be831f tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] [instance: 2aa6c062-32e4-453d-abb5-a51d96c66e2d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:34.336906 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4ee882fd-0235-4bb3-b9d7-27b982ffd8a9 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7ddec5c790>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:34.430416 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4ee882fd-0235-4bb3-b9d7-27b982ffd8a9 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/images/787934da-f249-4af1-9590-fecf6bc5d90f" status: 200 len: 1422 microversion: 2.1 time: 0.124699 Oct 27 03:28:34.434255 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1017/2016] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:28:34 2022] GET /compute/v2.1/images/787934da-f249-4af1-9590-fecf6bc5d90f => generated 1422 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:34.449082 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-695d323f-d2f3-4aa9-83da-d48a4375f4dd tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:34.452733 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-695d323f-d2f3-4aa9-83da-d48a4375f4dd tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] [instance: 339287fc-37b6-455d-96ab-08ab8e2c3e68] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:34.468004 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-695d323f-d2f3-4aa9-83da-d48a4375f4dd tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:34.470206 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-695d323f-d2f3-4aa9-83da-d48a4375f4dd tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:34.471275 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-695d323f-d2f3-4aa9-83da-d48a4375f4dd tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:34.474162 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-695d323f-d2f3-4aa9-83da-d48a4375f4dd tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:34.475489 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-695d323f-d2f3-4aa9-83da-d48a4375f4dd tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:34.477595 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-695d323f-d2f3-4aa9-83da-d48a4375f4dd tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:34.591164 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-db96ee54-480c-4d01-8a7e-adcfb4be831f tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '071401bed74d48fe8ae2dbdb98aa81cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b0b534b9eb463aab0f13e838578da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:34.604488 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-db96ee54-480c-4d01-8a7e-adcfb4be831f tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] 10.222.0.20 "GET /compute/v2.1/servers/2aa6c062-32e4-453d-abb5-a51d96c66e2d" status: 200 len: 1222 microversion: 2.1 time: 0.288567 Oct 27 03:28:34.606330 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1000/2017] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:28:34 2022] GET /compute/v2.1/servers/2aa6c062-32e4-453d-abb5-a51d96c66e2d => generated 1222 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:34.678760 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8add2f20-ec0c-432f-8951-cf0798711e09 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-812326889", "imageRef": "787934da-f249-4af1-9590-fecf6bc5d90f", "flavorRef": "452", "networks": [{"uuid": "a487df35-1b16-4301-a7dc-3642f0ac024b"}]}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:28:34.799899 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.network.neutron [None req-8add2f20-ec0c-432f-8951-cf0798711e09 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] validate_networks() for [('a487df35-1b16-4301-a7dc-3642f0ac024b', None, None, None, None, None)] {{(pid=121001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:28:35.932466 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-8add2f20-ec0c-432f-8951-cf0798711e09 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Flavor limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:28:35.932466 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-8add2f20-ec0c-432f-8951-cf0798711e09 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Image limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:28:35.934340 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-8add2f20-ec0c-432f-8951-cf0798711e09 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Flavor pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:28:35.934950 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-8add2f20-ec0c-432f-8951-cf0798711e09 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Image pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:28:35.935556 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-8add2f20-ec0c-432f-8951-cf0798711e09 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:28:35.953327 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8add2f20-ec0c-432f-8951-cf0798711e09 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:35.954658 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8add2f20-ec0c-432f-8951-cf0798711e09 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:35.957472 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8add2f20-ec0c-432f-8951-cf0798711e09 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:35.967419 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8add2f20-ec0c-432f-8951-cf0798711e09 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:35.967419 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8add2f20-ec0c-432f-8951-cf0798711e09 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:35.967419 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8add2f20-ec0c-432f-8951-cf0798711e09 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:35.989192 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-695d323f-d2f3-4aa9-83da-d48a4375f4dd tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68" status: 200 len: 1614 microversion: 2.1 time: 1.551443 Oct 27 03:28:35.989797 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1018/2018] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:28:34 2022] GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68 => generated 1614 bytes in 1555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:36.016906 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6266db27-5069-4e65-9285-7d935486a295 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:36.022445 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6266db27-5069-4e65-9285-7d935486a295 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: a8925d29-d9e0-4dbb-a73d-09473255fa34] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:36.048870 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-8add2f20-ec0c-432f-8951-cf0798711e09 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Getting quotas for project ae78c307a1504172828e668f915a3677. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:28:36.065158 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-8add2f20-ec0c-432f-8951-cf0798711e09 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Getting quotas for user 1d6175f2ac39494f8cba3db225150d6c and project ae78c307a1504172828e668f915a3677. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:28:36.085295 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6266db27-5069-4e65-9285-7d935486a295 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:36.087247 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6266db27-5069-4e65-9285-7d935486a295 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:36.088567 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6266db27-5069-4e65-9285-7d935486a295 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:36.090876 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6266db27-5069-4e65-9285-7d935486a295 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:36.093708 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6266db27-5069-4e65-9285-7d935486a295 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:36.095662 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6266db27-5069-4e65-9285-7d935486a295 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:36.098856 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8add2f20-ec0c-432f-8951-cf0798711e09 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Going to run 1 instances... {{(pid=121001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:28:36.108241 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8add2f20-ec0c-432f-8951-cf0798711e09 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 1352bd75-bfe6-48e3-a47d-314c7f13f692] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='787934da-f249-4af1-9590-fecf6bc5d90f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:28:36.315551 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8add2f20-ec0c-432f-8951-cf0798711e09 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.640893 Oct 27 03:28:36.317168 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1001/2019] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:28:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1644 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 03:28:36.329147 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-31fbb67b-52c1-414b-8d69-61395dc377dc req-6c998666-a63c-498b-995b-155f72382700 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8925d29-d9e0-4dbb-a73d-09473255fa34", "tag": "dfa74d77-ff34-4f03-a07f-cf59ea6cd793"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:28:36.377806 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-31fbb67b-52c1-414b-8d69-61395dc377dc req-6c998666-a63c-498b-995b-155f72382700 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:36.379220 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-31fbb67b-52c1-414b-8d69-61395dc377dc req-6c998666-a63c-498b-995b-155f72382700 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:36.379878 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-31fbb67b-52c1-414b-8d69-61395dc377dc req-6c998666-a63c-498b-995b-155f72382700 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:36.397893 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-31fbb67b-52c1-414b-8d69-61395dc377dc req-6c998666-a63c-498b-995b-155f72382700 service nova] Creating event network-changed:dfa74d77-ff34-4f03-a07f-cf59ea6cd793 for instance a8925d29-d9e0-4dbb-a73d-09473255fa34 on n-h1-862769-1 Oct 27 03:28:36.411874 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-31fbb67b-52c1-414b-8d69-61395dc377dc req-6c998666-a63c-498b-995b-155f72382700 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092679 Oct 27 03:28:36.414363 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1002/2020] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:28:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:28:36.421536 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-df1fbb63-c031-4103-b018-34845ed6e98e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:36.429801 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-df1fbb63-c031-4103-b018-34845ed6e98e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: d5e6f604-9466-45c6-86a8-885cfb393223] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:36.441611 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-df1fbb63-c031-4103-b018-34845ed6e98e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:36.445019 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-df1fbb63-c031-4103-b018-34845ed6e98e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:36.445665 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-df1fbb63-c031-4103-b018-34845ed6e98e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:36.446819 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-df1fbb63-c031-4103-b018-34845ed6e98e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:36.447484 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-df1fbb63-c031-4103-b018-34845ed6e98e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:36.448091 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-df1fbb63-c031-4103-b018-34845ed6e98e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:36.584489 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-df1fbb63-c031-4103-b018-34845ed6e98e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:36.596855 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-6266db27-5069-4e65-9285-7d935486a295 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:36.616390 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-df1fbb63-c031-4103-b018-34845ed6e98e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:36.619123 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6266db27-5069-4e65-9285-7d935486a295 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34" status: 200 len: 1211 microversion: 2.1 time: 0.611674 Oct 27 03:28:36.622462 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-df1fbb63-c031-4103-b018-34845ed6e98e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:36.627276 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1019/2021] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:28:35 2022] GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34 => generated 1211 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:36.627426 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-df1fbb63-c031-4103-b018-34845ed6e98e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223" status: 200 len: 1251 microversion: 2.25 time: 0.209517 Oct 27 03:28:36.631244 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1003/2022] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:28:36 2022] GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223 => generated 1251 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:28:36.643978 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2f9cff05-0ffb-46ae-872e-7b9009aa8088 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:36.645287 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-2f9cff05-0ffb-46ae-872e-7b9009aa8088 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] [instance: 2aa6c062-32e4-453d-abb5-a51d96c66e2d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:36.649330 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4ef6e4f0-4db6-4bd4-9026-8af623d8a3d1 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:36.674396 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2f9cff05-0ffb-46ae-872e-7b9009aa8088 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:36.674651 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4ef6e4f0-4db6-4bd4-9026-8af623d8a3d1 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Searching by: {'host': 'n-h2-862769-1', 'deleted': False} {{(pid=121001) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 03:28:36.677261 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2f9cff05-0ffb-46ae-872e-7b9009aa8088 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:36.679201 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2f9cff05-0ffb-46ae-872e-7b9009aa8088 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:36.687439 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2f9cff05-0ffb-46ae-872e-7b9009aa8088 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:36.687439 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2f9cff05-0ffb-46ae-872e-7b9009aa8088 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:36.687439 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2f9cff05-0ffb-46ae-872e-7b9009aa8088 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:36.689773 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4ef6e4f0-4db6-4bd4-9026-8af623d8a3d1 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:36.690538 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4ef6e4f0-4db6-4bd4-9026-8af623d8a3d1 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:36.691757 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4ef6e4f0-4db6-4bd4-9026-8af623d8a3d1 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:36.693537 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4ef6e4f0-4db6-4bd4-9026-8af623d8a3d1 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:36.694253 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4ef6e4f0-4db6-4bd4-9026-8af623d8a3d1 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:36.694840 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4ef6e4f0-4db6-4bd4-9026-8af623d8a3d1 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:36.836990 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.multi_cell_list [None req-4ef6e4f0-4db6-4bd4-9026-8af623d8a3d1 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Listed batch of 6 results from cell out of 1000 limit. Returned 6 total so far. {{(pid=121001) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 03:28:36.904493 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4ef6e4f0-4db6-4bd4-9026-8af623d8a3d1 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] 10.222.0.20 "GET /compute/v2.1/servers?host=n-h2-862769-1&all_tenants=1" status: 200 len: 1983 microversion: 2.1 time: 0.270617 Oct 27 03:28:36.905941 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1004/2023] 10.222.0.20 () {58 vars in 1190 bytes} [Thu Oct 27 03:28:36 2022] GET /compute/v2.1/servers?host=n-h2-862769-1&all_tenants=1 => generated 1983 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:36.911675 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c5dd46d4-b0b5-44b8-80e5-a4c91defa7af tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:36.912512 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c5dd46d4-b0b5-44b8-80e5-a4c91defa7af tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 1352bd75-bfe6-48e3-a47d-314c7f13f692] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:36.921999 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2f9cff05-0ffb-46ae-872e-7b9009aa8088 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '071401bed74d48fe8ae2dbdb98aa81cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b0b534b9eb463aab0f13e838578da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:36.943122 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2f9cff05-0ffb-46ae-872e-7b9009aa8088 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] 10.222.0.20 "GET /compute/v2.1/servers/2aa6c062-32e4-453d-abb5-a51d96c66e2d" status: 200 len: 1218 microversion: 2.1 time: 0.311090 Oct 27 03:28:36.944902 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1020/2024] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:28:36 2022] GET /compute/v2.1/servers/2aa6c062-32e4-453d-abb5-a51d96c66e2d => generated 1218 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:36.958229 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f657acb6-1a85-4aa5-ac73-b7280fc91cfa tempest-ImagesMetadataTestJSON-351418215 tempest-ImagesMetadataTestJSON-351418215-project] Calling method '.version_select at 0x7f7dda1cd670>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:36.973951 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c5dd46d4-b0b5-44b8-80e5-a4c91defa7af tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:36.982254 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c5dd46d4-b0b5-44b8-80e5-a4c91defa7af tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/1352bd75-bfe6-48e3-a47d-314c7f13f692" status: 200 len: 1207 microversion: 2.1 time: 0.074638 Oct 27 03:28:36.985686 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1005/2025] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:28:36 2022] GET /compute/v2.1/servers/1352bd75-bfe6-48e3-a47d-314c7f13f692 => generated 1207 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:36.998234 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1c34bf36-643b-4053-98a8-fb1acb66ba97 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:37.008922 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1c34bf36-643b-4053-98a8-fb1acb66ba97 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=121001) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 03:28:37.034376 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1c34bf36-643b-4053-98a8-fb1acb66ba97 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:37.035664 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1c34bf36-643b-4053-98a8-fb1acb66ba97 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:37.037180 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1c34bf36-643b-4053-98a8-fb1acb66ba97 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:37.038221 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1c34bf36-643b-4053-98a8-fb1acb66ba97 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:37.039738 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1c34bf36-643b-4053-98a8-fb1acb66ba97 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:37.040779 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f657acb6-1a85-4aa5-ac73-b7280fc91cfa tempest-ImagesMetadataTestJSON-351418215 tempest-ImagesMetadataTestJSON-351418215-project] 10.222.0.20 "GET /compute/v2.1/images/38c19ef0-970c-412a-a200-458c2c0f5310" status: 200 len: 636 microversion: 2.1 time: 0.094011 Oct 27 03:28:37.041465 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1021/2026] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:28:36 2022] GET /compute/v2.1/images/38c19ef0-970c-412a-a200-458c2c0f5310 => generated 636 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:28:37.041957 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1c34bf36-643b-4053-98a8-fb1acb66ba97 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:37.069421 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-78e0fd74-cec5-4798-a098-1b1b1f314f5f tempest-ImagesMetadataTestJSON-351418215 tempest-ImagesMetadataTestJSON-351418215-project] Action: 'update_all', calling method: .version_select at 0x7f7dda1e13a0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:28:37.112111 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1c34bf36-643b-4053-98a8-fb1acb66ba97 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] 10.222.0.20 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.120985 Oct 27 03:28:37.122801 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1006/2027] 10.222.0.20 () {58 vars in 1196 bytes} [Thu Oct 27 03:28:36 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 03:28:37.132368 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-55102f0f-26bd-4411-b0d4-03860bdde02d tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:28:37.139898 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-55102f0f-26bd-4411-b0d4-03860bdde02d tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] [instance: 339287fc-37b6-455d-96ab-08ab8e2c3e68] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:37.161763 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-55102f0f-26bd-4411-b0d4-03860bdde02d tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:37.162295 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-55102f0f-26bd-4411-b0d4-03860bdde02d tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:37.162758 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-55102f0f-26bd-4411-b0d4-03860bdde02d tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:37.163457 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-55102f0f-26bd-4411-b0d4-03860bdde02d tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:37.163915 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-55102f0f-26bd-4411-b0d4-03860bdde02d tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:37.184570 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-55102f0f-26bd-4411-b0d4-03860bdde02d tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:37.197116 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-78e0fd74-cec5-4798-a098-1b1b1f314f5f tempest-ImagesMetadataTestJSON-351418215 tempest-ImagesMetadataTestJSON-351418215-project] Getting quotas for project 82cc9f48070a442db552098a12c0705e. Resources: dict_keys(['metadata_items']) {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:28:37.210149 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-78e0fd74-cec5-4798-a098-1b1b1f314f5f tempest-ImagesMetadataTestJSON-351418215 tempest-ImagesMetadataTestJSON-351418215-project] Getting quotas for user 790b3cd664d74806bf52d6360ac7763f and project 82cc9f48070a442db552098a12c0705e. Resources: dict_keys(['metadata_items']) {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:28:37.436907 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:28:37.631427 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-55102f0f-26bd-4411-b0d4-03860bdde02d tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68/action" status: 202 len: 0 microversion: 2.1 time: 0.506427 Oct 27 03:28:37.647538 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1007/2028] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:28:37 2022] POST /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68/action => generated 0 bytes in 508 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:28:37.647538 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-539044ee-7c69-45ca-9d20-c627d1797f23 req-781b7db9-a6a3-4dec-b2bb-e003a8810a4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49f0475c-d9eb-4ad0-9f88-322521def6c7", "name": "network-vif-unplugged", "status": "completed", "tag": "2e7b6414-960b-4793-94ae-d4e9bc9cb2a7"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:28:37.653058 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-539044ee-7c69-45ca-9d20-c627d1797f23 req-781b7db9-a6a3-4dec-b2bb-e003a8810a4d service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:37.654135 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-539044ee-7c69-45ca-9d20-c627d1797f23 req-781b7db9-a6a3-4dec-b2bb-e003a8810a4d service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:37.655046 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-539044ee-7c69-45ca-9d20-c627d1797f23 req-781b7db9-a6a3-4dec-b2bb-e003a8810a4d service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:37.678688 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-539044ee-7c69-45ca-9d20-c627d1797f23 req-781b7db9-a6a3-4dec-b2bb-e003a8810a4d service nova] Creating event network-vif-unplugged:2e7b6414-960b-4793-94ae-d4e9bc9cb2a7 for instance 49f0475c-d9eb-4ad0-9f88-322521def6c7 on n-h1-862769-1 Oct 27 03:28:37.683391 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-539044ee-7c69-45ca-9d20-c627d1797f23 req-781b7db9-a6a3-4dec-b2bb-e003a8810a4d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049712 Oct 27 03:28:37.684154 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1008/2029] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:28:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:28:37.690330 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2fc3c86f-d7e8-4df7-af2e-83ed7d8d458f tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:28:37.693344 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2fc3c86f-d7e8-4df7-af2e-83ed7d8d458f tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: 339287fc-37b6-455d-96ab-08ab8e2c3e68] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:37.700025 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2fc3c86f-d7e8-4df7-af2e-83ed7d8d458f tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:37.706865 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2fc3c86f-d7e8-4df7-af2e-83ed7d8d458f tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:37.706865 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2fc3c86f-d7e8-4df7-af2e-83ed7d8d458f tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:37.706865 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2fc3c86f-d7e8-4df7-af2e-83ed7d8d458f tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:37.706865 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2fc3c86f-d7e8-4df7-af2e-83ed7d8d458f tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:37.707243 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2fc3c86f-d7e8-4df7-af2e-83ed7d8d458f tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:37.884353 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-2fc3c86f-d7e8-4df7-af2e-83ed7d8d458f tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Flavor limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:28:37.885136 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-2fc3c86f-d7e8-4df7-af2e-83ed7d8d458f tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Image limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:28:37.885842 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-2fc3c86f-d7e8-4df7-af2e-83ed7d8d458f tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Flavor pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:28:37.886528 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-2fc3c86f-d7e8-4df7-af2e-83ed7d8d458f tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Image pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:28:37.887333 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-2fc3c86f-d7e8-4df7-af2e-83ed7d8d458f tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:28:37.931662 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-78e0fd74-cec5-4798-a098-1b1b1f314f5f tempest-ImagesMetadataTestJSON-351418215 tempest-ImagesMetadataTestJSON-351418215-project] 10.222.0.20 "PUT /compute/v2.1/images/38c19ef0-970c-412a-a200-458c2c0f5310/metadata" status: 200 len: 61 microversion: 2.1 time: 0.878776 Oct 27 03:28:37.936876 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1022/2030] 10.222.0.20 () {60 vars in 1280 bytes} [Thu Oct 27 03:28:37 2022] PUT /compute/v2.1/images/38c19ef0-970c-412a-a200-458c2c0f5310/metadata => generated 61 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 27 03:28:37.942181 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-76c70925-9c37-47f3-8b08-29278df11e08 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:37.954802 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-76c70925-9c37-47f3-8b08-29278df11e08 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: a8925d29-d9e0-4dbb-a73d-09473255fa34] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:37.961984 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-76c70925-9c37-47f3-8b08-29278df11e08 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:37.967592 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-76c70925-9c37-47f3-8b08-29278df11e08 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:37.968328 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-76c70925-9c37-47f3-8b08-29278df11e08 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:37.969301 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-76c70925-9c37-47f3-8b08-29278df11e08 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:37.971936 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-76c70925-9c37-47f3-8b08-29278df11e08 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:37.974317 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-76c70925-9c37-47f3-8b08-29278df11e08 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:38.300392 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2fc3c86f-d7e8-4df7-af2e-83ed7d8d458f tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: 339287fc-37b6-455d-96ab-08ab8e2c3e68] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:38.319804 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2fc3c86f-d7e8-4df7-af2e-83ed7d8d458f tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:38.320846 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2fc3c86f-d7e8-4df7-af2e-83ed7d8d458f tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:38.321520 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2fc3c86f-d7e8-4df7-af2e-83ed7d8d458f tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:38.322607 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2fc3c86f-d7e8-4df7-af2e-83ed7d8d458f tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:38.323298 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2fc3c86f-d7e8-4df7-af2e-83ed7d8d458f tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:38.324035 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2fc3c86f-d7e8-4df7-af2e-83ed7d8d458f tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:38.364099 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2fc3c86f-d7e8-4df7-af2e-83ed7d8d458f tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "POST /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68/action" status: 202 len: 1067 microversion: 2.1 time: 0.678750 Oct 27 03:28:38.365138 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1009/2031] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:28:37 2022] POST /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68/action => generated 1067 bytes in 681 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 27 03:28:38.371379 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ebf5c9ba-9c5d-4d02-b077-add8e6d93f4e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:38.372354 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ebf5c9ba-9c5d-4d02-b077-add8e6d93f4e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: d5e6f604-9466-45c6-86a8-885cfb393223] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:38.379603 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ebf5c9ba-9c5d-4d02-b077-add8e6d93f4e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:38.380450 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ebf5c9ba-9c5d-4d02-b077-add8e6d93f4e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:38.381127 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ebf5c9ba-9c5d-4d02-b077-add8e6d93f4e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:38.382126 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ebf5c9ba-9c5d-4d02-b077-add8e6d93f4e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:38.382810 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ebf5c9ba-9c5d-4d02-b077-add8e6d93f4e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:38.383634 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ebf5c9ba-9c5d-4d02-b077-add8e6d93f4e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:38.750184 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ebf5c9ba-9c5d-4d02-b077-add8e6d93f4e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:38.768851 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ebf5c9ba-9c5d-4d02-b077-add8e6d93f4e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:38.782469 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ebf5c9ba-9c5d-4d02-b077-add8e6d93f4e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:38.784548 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ebf5c9ba-9c5d-4d02-b077-add8e6d93f4e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223" status: 200 len: 1293 microversion: 2.25 time: 0.417440 Oct 27 03:28:38.792133 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1010/2032] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:28:38 2022] GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223 => generated 1293 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:28:38.797185 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0e49630c-70e3-44bd-a6b9-bbbb3911656d tempest-ImagesMetadataTestJSON-351418215 tempest-ImagesMetadataTestJSON-351418215-project] Calling method '.version_select at 0x7f7ddec60a60>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:38.966784 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-76c70925-9c37-47f3-8b08-29278df11e08 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:38.987422 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-76c70925-9c37-47f3-8b08-29278df11e08 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34" status: 200 len: 1211 microversion: 2.1 time: 1.049213 Oct 27 03:28:38.999326 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1023/2033] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:28:37 2022] GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34 => generated 1211 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:39.006899 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8117b5ea-52c1-4ee7-a63e-7611030509f6 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:39.025128 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8117b5ea-52c1-4ee7-a63e-7611030509f6 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] [instance: 2aa6c062-32e4-453d-abb5-a51d96c66e2d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:39.046870 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8117b5ea-52c1-4ee7-a63e-7611030509f6 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:39.047619 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8117b5ea-52c1-4ee7-a63e-7611030509f6 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:39.049024 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8117b5ea-52c1-4ee7-a63e-7611030509f6 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:39.053231 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8117b5ea-52c1-4ee7-a63e-7611030509f6 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:39.053733 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8117b5ea-52c1-4ee7-a63e-7611030509f6 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:39.056422 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8117b5ea-52c1-4ee7-a63e-7611030509f6 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:39.321561 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8117b5ea-52c1-4ee7-a63e-7611030509f6 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '071401bed74d48fe8ae2dbdb98aa81cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b0b534b9eb463aab0f13e838578da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:39.329271 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8117b5ea-52c1-4ee7-a63e-7611030509f6 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] 10.222.0.20 "GET /compute/v2.1/servers/2aa6c062-32e4-453d-abb5-a51d96c66e2d" status: 200 len: 1292 microversion: 2.1 time: 0.328375 Oct 27 03:28:39.329867 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1024/2034] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:28:38 2022] GET /compute/v2.1/servers/2aa6c062-32e4-453d-abb5-a51d96c66e2d => generated 1292 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:39.342593 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f1921eea-dbf4-4b7c-adc1-0b45181b7031 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:39.343646 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f1921eea-dbf4-4b7c-adc1-0b45181b7031 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 1352bd75-bfe6-48e3-a47d-314c7f13f692] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:39.356116 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f1921eea-dbf4-4b7c-adc1-0b45181b7031 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:39.359814 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f1921eea-dbf4-4b7c-adc1-0b45181b7031 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:39.360481 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f1921eea-dbf4-4b7c-adc1-0b45181b7031 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:39.361631 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f1921eea-dbf4-4b7c-adc1-0b45181b7031 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:39.364578 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f1921eea-dbf4-4b7c-adc1-0b45181b7031 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:39.365201 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f1921eea-dbf4-4b7c-adc1-0b45181b7031 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:39.407491 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0e49630c-70e3-44bd-a6b9-bbbb3911656d tempest-ImagesMetadataTestJSON-351418215 tempest-ImagesMetadataTestJSON-351418215-project] 10.222.0.20 "DELETE /compute/v2.1/images/38c19ef0-970c-412a-a200-458c2c0f5310/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.612911 Oct 27 03:28:39.412689 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1011/2035] 10.222.0.20 () {58 vars in 1296 bytes} [Thu Oct 27 03:28:38 2022] DELETE /compute/v2.1/images/38c19ef0-970c-412a-a200-458c2c0f5310/metadata/os_version => generated 0 bytes in 616 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:28:39.417626 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-fbb2d97b-7449-46c8-bcad-951134626b6d tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:39.418447 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-fbb2d97b-7449-46c8-bcad-951134626b6d tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: 339287fc-37b6-455d-96ab-08ab8e2c3e68] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:39.428498 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fbb2d97b-7449-46c8-bcad-951134626b6d tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:39.429371 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fbb2d97b-7449-46c8-bcad-951134626b6d tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:39.429921 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fbb2d97b-7449-46c8-bcad-951134626b6d tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:39.430938 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fbb2d97b-7449-46c8-bcad-951134626b6d tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:39.445095 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fbb2d97b-7449-46c8-bcad-951134626b6d tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:39.447313 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fbb2d97b-7449-46c8-bcad-951134626b6d tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:39.504642 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=4 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:28:39.619347 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f1921eea-dbf4-4b7c-adc1-0b45181b7031 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:39.622382 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=95,nova_cell1:INSERT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:28:39.633506 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f1921eea-dbf4-4b7c-adc1-0b45181b7031 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/1352bd75-bfe6-48e3-a47d-314c7f13f692" status: 200 len: 1259 microversion: 2.1 time: 0.300291 Oct 27 03:28:39.634734 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1025/2036] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:28:39 2022] GET /compute/v2.1/servers/1352bd75-bfe6-48e3-a47d-314c7f13f692 => generated 1259 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:39.645495 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0d332f42-3618-4e44-b869-23e02ea8e1e6 tempest-ImagesMetadataTestJSON-351418215 tempest-ImagesMetadataTestJSON-351418215-project] Calling method '.version_select at 0x7f7ddec38700>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:39.700770 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-fbb2d97b-7449-46c8-bcad-951134626b6d tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13e05e253c94aadb1c089128ff35be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8510a519f14deea6f35a437419e161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:39.702750 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0d332f42-3618-4e44-b869-23e02ea8e1e6 tempest-ImagesMetadataTestJSON-351418215 tempest-ImagesMetadataTestJSON-351418215-project] 10.222.0.20 "GET /compute/v2.1/images/38c19ef0-970c-412a-a200-458c2c0f5310/metadata" status: 200 len: 37 microversion: 2.1 time: 0.062344 Oct 27 03:28:39.711470 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-fbb2d97b-7449-46c8-bcad-951134626b6d tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68" status: 200 len: 1471 microversion: 2.1 time: 0.299515 Oct 27 03:28:39.712143 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1026/2037] 10.222.0.20 () {58 vars in 1260 bytes} [Thu Oct 27 03:28:39 2022] GET /compute/v2.1/images/38c19ef0-970c-412a-a200-458c2c0f5310/metadata => generated 37 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 03:28:39.724539 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2773faae-e3c8-4277-9038-6c22951eeb77 tempest-ImagesMetadataTestJSON-351418215 tempest-ImagesMetadataTestJSON-351418215-project] Action: 'update_all', calling method: .version_select at 0x7f7dda1cd670>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:28:39.743988 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1012/2038] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:28:39 2022] GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68 => generated 1471 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:39.809678 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-2773faae-e3c8-4277-9038-6c22951eeb77 tempest-ImagesMetadataTestJSON-351418215 tempest-ImagesMetadataTestJSON-351418215-project] Getting quotas for project 82cc9f48070a442db552098a12c0705e. Resources: dict_keys(['metadata_items']) {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:28:39.816144 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-2773faae-e3c8-4277-9038-6c22951eeb77 tempest-ImagesMetadataTestJSON-351418215 tempest-ImagesMetadataTestJSON-351418215-project] Getting quotas for user 790b3cd664d74806bf52d6360ac7763f and project 82cc9f48070a442db552098a12c0705e. Resources: dict_keys(['metadata_items']) {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:28:39.817193 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e85542f0-dea8-4a36-8ea8-7859aa1b7db3 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:39.818977 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e85542f0-dea8-4a36-8ea8-7859aa1b7db3 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: d5e6f604-9466-45c6-86a8-885cfb393223] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:39.829843 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e85542f0-dea8-4a36-8ea8-7859aa1b7db3 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:39.832550 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e85542f0-dea8-4a36-8ea8-7859aa1b7db3 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:39.833253 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e85542f0-dea8-4a36-8ea8-7859aa1b7db3 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:39.834258 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e85542f0-dea8-4a36-8ea8-7859aa1b7db3 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:39.836623 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e85542f0-dea8-4a36-8ea8-7859aa1b7db3 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:39.837570 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e85542f0-dea8-4a36-8ea8-7859aa1b7db3 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:40.295819 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2773faae-e3c8-4277-9038-6c22951eeb77 tempest-ImagesMetadataTestJSON-351418215 tempest-ImagesMetadataTestJSON-351418215-project] 10.222.0.20 "PUT /compute/v2.1/images/38c19ef0-970c-412a-a200-458c2c0f5310/metadata" status: 200 len: 61 microversion: 2.1 time: 0.582059 Oct 27 03:28:40.296431 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1027/2039] 10.222.0.20 () {60 vars in 1280 bytes} [Thu Oct 27 03:28:39 2022] PUT /compute/v2.1/images/38c19ef0-970c-412a-a200-458c2c0f5310/metadata => generated 61 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 03:28:40.301425 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f56c2317-3856-4ca4-a277-20771ae75c85 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:40.303375 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f56c2317-3856-4ca4-a277-20771ae75c85 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: a8925d29-d9e0-4dbb-a73d-09473255fa34] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:40.310568 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f56c2317-3856-4ca4-a277-20771ae75c85 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:40.311421 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f56c2317-3856-4ca4-a277-20771ae75c85 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:40.312052 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f56c2317-3856-4ca4-a277-20771ae75c85 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:40.312977 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f56c2317-3856-4ca4-a277-20771ae75c85 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:40.313665 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f56c2317-3856-4ca4-a277-20771ae75c85 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:40.314925 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f56c2317-3856-4ca4-a277-20771ae75c85 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:40.459668 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e85542f0-dea8-4a36-8ea8-7859aa1b7db3 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:40.466461 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e85542f0-dea8-4a36-8ea8-7859aa1b7db3 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:40.468040 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e85542f0-dea8-4a36-8ea8-7859aa1b7db3 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:40.469427 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e85542f0-dea8-4a36-8ea8-7859aa1b7db3 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223" status: 200 len: 1293 microversion: 2.25 time: 0.656527 Oct 27 03:28:40.486056 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1013/2040] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:28:39 2022] GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223 => generated 1293 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:28:40.486056 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-28e66b43-9612-4929-8efe-f9dbfbb8a348 tempest-ImagesMetadataTestJSON-351418215 tempest-ImagesMetadataTestJSON-351418215-project] Calling method '.version_select at 0x7f7dded48c10>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:40.538660 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-28e66b43-9612-4929-8efe-f9dbfbb8a348 tempest-ImagesMetadataTestJSON-351418215 tempest-ImagesMetadataTestJSON-351418215-project] 10.222.0.20 "GET /compute/v2.1/images/38c19ef0-970c-412a-a200-458c2c0f5310/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.067652 Oct 27 03:28:40.544629 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1014/2041] 10.222.0.20 () {58 vars in 1290 bytes} [Thu Oct 27 03:28:40 2022] GET /compute/v2.1/images/38c19ef0-970c-412a-a200-458c2c0f5310/metadata/os_distro => generated 33 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 03:28:40.545215 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f8b6bae8-e8a6-46c9-b436-7446ade1fafd tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:40.545859 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f8b6bae8-e8a6-46c9-b436-7446ade1fafd tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] [instance: 2aa6c062-32e4-453d-abb5-a51d96c66e2d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:40.549056 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:28:40.553595 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f8b6bae8-e8a6-46c9-b436-7446ade1fafd tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:40.554128 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f8b6bae8-e8a6-46c9-b436-7446ade1fafd tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:40.554580 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f8b6bae8-e8a6-46c9-b436-7446ade1fafd tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:40.555699 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f8b6bae8-e8a6-46c9-b436-7446ade1fafd tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:40.556169 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f8b6bae8-e8a6-46c9-b436-7446ade1fafd tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:40.556606 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f8b6bae8-e8a6-46c9-b436-7446ade1fafd tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:40.637279 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f8b6bae8-e8a6-46c9-b436-7446ade1fafd tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '071401bed74d48fe8ae2dbdb98aa81cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b0b534b9eb463aab0f13e838578da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:40.645442 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f8b6bae8-e8a6-46c9-b436-7446ade1fafd tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] 10.222.0.20 "GET /compute/v2.1/servers/2aa6c062-32e4-453d-abb5-a51d96c66e2d" status: 200 len: 1280 microversion: 2.1 time: 0.104818 Oct 27 03:28:40.646027 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1015/2042] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:28:40 2022] GET /compute/v2.1/servers/2aa6c062-32e4-453d-abb5-a51d96c66e2d => generated 1280 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:40.650855 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-710d79ca-6c7f-4920-813c-9920cc7219ad tempest-ImagesMetadataTestJSON-351418215 tempest-ImagesMetadataTestJSON-351418215-project] Action: 'update_all', calling method: .version_select at 0x7f7dded48b80>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:28:40.718694 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-710d79ca-6c7f-4920-813c-9920cc7219ad tempest-ImagesMetadataTestJSON-351418215 tempest-ImagesMetadataTestJSON-351418215-project] Getting quotas for project 82cc9f48070a442db552098a12c0705e. Resources: dict_keys(['metadata_items']) {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:28:40.724176 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-710d79ca-6c7f-4920-813c-9920cc7219ad tempest-ImagesMetadataTestJSON-351418215 tempest-ImagesMetadataTestJSON-351418215-project] Getting quotas for user 790b3cd664d74806bf52d6360ac7763f and project 82cc9f48070a442db552098a12c0705e. Resources: dict_keys(['metadata_items']) {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:28:40.951730 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-710d79ca-6c7f-4920-813c-9920cc7219ad tempest-ImagesMetadataTestJSON-351418215 tempest-ImagesMetadataTestJSON-351418215-project] 10.222.0.20 "PUT /compute/v2.1/images/38c19ef0-970c-412a-a200-458c2c0f5310/metadata" status: 200 len: 61 microversion: 2.1 time: 0.304573 Oct 27 03:28:40.952396 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1016/2043] 10.222.0.20 () {60 vars in 1280 bytes} [Thu Oct 27 03:28:40 2022] PUT /compute/v2.1/images/38c19ef0-970c-412a-a200-458c2c0f5310/metadata => generated 61 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 03:28:40.959289 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-270024f9-a8c9-4489-a54e-6cfd9687bb69 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:40.960989 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-270024f9-a8c9-4489-a54e-6cfd9687bb69 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 1352bd75-bfe6-48e3-a47d-314c7f13f692] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:40.981922 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-270024f9-a8c9-4489-a54e-6cfd9687bb69 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:40.981922 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-270024f9-a8c9-4489-a54e-6cfd9687bb69 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:40.981922 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-270024f9-a8c9-4489-a54e-6cfd9687bb69 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:40.981922 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-270024f9-a8c9-4489-a54e-6cfd9687bb69 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:40.983121 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-270024f9-a8c9-4489-a54e-6cfd9687bb69 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:40.983121 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-270024f9-a8c9-4489-a54e-6cfd9687bb69 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:41.046958 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-270024f9-a8c9-4489-a54e-6cfd9687bb69 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:41.054219 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f56c2317-3856-4ca4-a277-20771ae75c85 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:41.062463 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-270024f9-a8c9-4489-a54e-6cfd9687bb69 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/1352bd75-bfe6-48e3-a47d-314c7f13f692" status: 200 len: 1265 microversion: 2.1 time: 0.108051 Oct 27 03:28:41.068157 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f56c2317-3856-4ca4-a277-20771ae75c85 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34" status: 200 len: 1199 microversion: 2.1 time: 0.770252 Oct 27 03:28:41.069448 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1028/2044] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:28:40 2022] GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34 => generated 1199 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:41.071190 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1017/2045] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:28:40 2022] GET /compute/v2.1/servers/1352bd75-bfe6-48e3-a47d-314c7f13f692 => generated 1265 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:41.080237 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9a3e0765-a94c-40e6-a01f-82fff35a05bf tempest-ImagesMetadataTestJSON-351418215 tempest-ImagesMetadataTestJSON-351418215-project] Calling method '.version_select at 0x7f7ddecea9d0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:41.082725 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0c63d933-c123-45aa-a997-e9de0958bc3d tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:41.083573 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0c63d933-c123-45aa-a997-e9de0958bc3d tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: 339287fc-37b6-455d-96ab-08ab8e2c3e68] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:41.107688 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0c63d933-c123-45aa-a997-e9de0958bc3d tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:41.107688 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0c63d933-c123-45aa-a997-e9de0958bc3d tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:41.107982 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0c63d933-c123-45aa-a997-e9de0958bc3d tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:41.108782 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0c63d933-c123-45aa-a997-e9de0958bc3d tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:41.109377 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0c63d933-c123-45aa-a997-e9de0958bc3d tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:41.109669 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0c63d933-c123-45aa-a997-e9de0958bc3d tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:41.159199 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9a3e0765-a94c-40e6-a01f-82fff35a05bf tempest-ImagesMetadataTestJSON-351418215 tempest-ImagesMetadataTestJSON-351418215-project] 10.222.0.20 "GET /compute/v2.1/images/38c19ef0-970c-412a-a200-458c2c0f5310/metadata" status: 200 len: 61 microversion: 2.1 time: 0.086745 Oct 27 03:28:41.160368 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1018/2046] 10.222.0.20 () {58 vars in 1260 bytes} [Thu Oct 27 03:28:41 2022] GET /compute/v2.1/images/38c19ef0-970c-412a-a200-458c2c0f5310/metadata => generated 61 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 03:28:41.171374 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c6b196e5-3377-49ab-9f37-9f72bf4719d9 tempest-ImagesMetadataTestJSON-351418215 tempest-ImagesMetadataTestJSON-351418215-project] Action: 'update_all', calling method: .version_select at 0x7f7dded48ee0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:28:41.277915 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-c6b196e5-3377-49ab-9f37-9f72bf4719d9 tempest-ImagesMetadataTestJSON-351418215 tempest-ImagesMetadataTestJSON-351418215-project] Getting quotas for project 82cc9f48070a442db552098a12c0705e. Resources: dict_keys(['metadata_items']) {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:28:41.291644 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-c6b196e5-3377-49ab-9f37-9f72bf4719d9 tempest-ImagesMetadataTestJSON-351418215 tempest-ImagesMetadataTestJSON-351418215-project] Getting quotas for user 790b3cd664d74806bf52d6360ac7763f and project 82cc9f48070a442db552098a12c0705e. Resources: dict_keys(['metadata_items']) {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:28:41.520771 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c6b196e5-3377-49ab-9f37-9f72bf4719d9 tempest-ImagesMetadataTestJSON-351418215 tempest-ImagesMetadataTestJSON-351418215-project] 10.222.0.20 "PUT /compute/v2.1/images/38c19ef0-970c-412a-a200-458c2c0f5310/metadata" status: 200 len: 61 microversion: 2.1 time: 0.353810 Oct 27 03:28:41.523508 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1019/2047] 10.222.0.20 () {60 vars in 1280 bytes} [Thu Oct 27 03:28:41 2022] PUT /compute/v2.1/images/38c19ef0-970c-412a-a200-458c2c0f5310/metadata => generated 61 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 27 03:28:41.528615 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-bddc3f6d-65ca-44c0-b1f2-cc36ecd0b934 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:41.534824 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-bddc3f6d-65ca-44c0-b1f2-cc36ecd0b934 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '17b2717ace074a579d33c60964e6668a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3fc032a089f45efa4a66866a9c961c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:41.535655 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-bddc3f6d-65ca-44c0-b1f2-cc36ecd0b934 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Searching by: {'deleted': False, 'project_id': 'c3fc032a089f45efa4a66866a9c961c9'} {{(pid=121001) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 03:28:41.544081 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bddc3f6d-65ca-44c0-b1f2-cc36ecd0b934 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:41.547169 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bddc3f6d-65ca-44c0-b1f2-cc36ecd0b934 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:41.547169 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bddc3f6d-65ca-44c0-b1f2-cc36ecd0b934 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:41.547169 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bddc3f6d-65ca-44c0-b1f2-cc36ecd0b934 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:41.547169 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bddc3f6d-65ca-44c0-b1f2-cc36ecd0b934 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:41.547562 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bddc3f6d-65ca-44c0-b1f2-cc36ecd0b934 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:41.663030 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.multi_cell_list [None req-bddc3f6d-65ca-44c0-b1f2-cc36ecd0b934 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121001) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 03:28:41.790870 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-bddc3f6d-65ca-44c0-b1f2-cc36ecd0b934 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 339 microversion: 2.1 time: 0.265692 Oct 27 03:28:41.791117 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1020/2048] 10.222.0.20 () {58 vars in 1125 bytes} [Thu Oct 27 03:28:41 2022] GET /compute/v2.1/servers => generated 339 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:28:41.797555 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-aaf7d6a9-f61b-4172-abe4-e7562b77f89e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:41.798775 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-aaf7d6a9-f61b-4172-abe4-e7562b77f89e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: d5e6f604-9466-45c6-86a8-885cfb393223] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:41.807900 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aaf7d6a9-f61b-4172-abe4-e7562b77f89e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:41.810789 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aaf7d6a9-f61b-4172-abe4-e7562b77f89e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:41.810789 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aaf7d6a9-f61b-4172-abe4-e7562b77f89e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:41.810789 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aaf7d6a9-f61b-4172-abe4-e7562b77f89e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:41.810789 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aaf7d6a9-f61b-4172-abe4-e7562b77f89e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:41.811308 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aaf7d6a9-f61b-4172-abe4-e7562b77f89e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:42.145576 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-aaf7d6a9-f61b-4172-abe4-e7562b77f89e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:42.158545 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-aaf7d6a9-f61b-4172-abe4-e7562b77f89e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:42.160043 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-aaf7d6a9-f61b-4172-abe4-e7562b77f89e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:42.161198 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-aaf7d6a9-f61b-4172-abe4-e7562b77f89e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223" status: 200 len: 1293 microversion: 2.25 time: 0.369157 Oct 27 03:28:42.161756 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1021/2049] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:28:41 2022] GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223 => generated 1293 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:28:42.171593 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-98a5d013-1c11-49ea-8f8d-679d02079ee8 tempest-ImagesMetadataTestJSON-351418215 tempest-ImagesMetadataTestJSON-351418215-project] Action: 'update_all', calling method: .version_select at 0x7f7ddeceaee0>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:28:42.212244 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0c63d933-c123-45aa-a997-e9de0958bc3d tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13e05e253c94aadb1c089128ff35be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8510a519f14deea6f35a437419e161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:42.236467 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0c63d933-c123-45aa-a997-e9de0958bc3d tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68" status: 200 len: 1471 microversion: 2.1 time: 1.165299 Oct 27 03:28:42.238432 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1029/2050] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:28:41 2022] GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68 => generated 1471 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:42.243513 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-36d660f8-e9ef-4a48-97a4-84d93bdbc17f tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:42.244425 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-36d660f8-e9ef-4a48-97a4-84d93bdbc17f tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] [instance: 2aa6c062-32e4-453d-abb5-a51d96c66e2d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:42.260572 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-36d660f8-e9ef-4a48-97a4-84d93bdbc17f tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:42.261727 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-36d660f8-e9ef-4a48-97a4-84d93bdbc17f tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:42.262644 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-36d660f8-e9ef-4a48-97a4-84d93bdbc17f tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:42.263819 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-36d660f8-e9ef-4a48-97a4-84d93bdbc17f tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:42.264478 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-36d660f8-e9ef-4a48-97a4-84d93bdbc17f tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:42.265371 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-36d660f8-e9ef-4a48-97a4-84d93bdbc17f tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:42.294648 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-98a5d013-1c11-49ea-8f8d-679d02079ee8 tempest-ImagesMetadataTestJSON-351418215 tempest-ImagesMetadataTestJSON-351418215-project] Getting quotas for project 82cc9f48070a442db552098a12c0705e. Resources: dict_keys(['metadata_items']) {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:28:42.314263 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-98a5d013-1c11-49ea-8f8d-679d02079ee8 tempest-ImagesMetadataTestJSON-351418215 tempest-ImagesMetadataTestJSON-351418215-project] Getting quotas for user 790b3cd664d74806bf52d6360ac7763f and project 82cc9f48070a442db552098a12c0705e. Resources: dict_keys(['metadata_items']) {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:28:42.509267 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-36d660f8-e9ef-4a48-97a4-84d93bdbc17f tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '071401bed74d48fe8ae2dbdb98aa81cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b0b534b9eb463aab0f13e838578da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:42.519713 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-36d660f8-e9ef-4a48-97a4-84d93bdbc17f tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] 10.222.0.20 "GET /compute/v2.1/servers/2aa6c062-32e4-453d-abb5-a51d96c66e2d" status: 200 len: 1280 microversion: 2.1 time: 0.280003 Oct 27 03:28:42.523050 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1030/2051] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:28:42 2022] GET /compute/v2.1/servers/2aa6c062-32e4-453d-abb5-a51d96c66e2d => generated 1280 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:42.529667 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-bd31d342-44fa-46c3-a6ad-98bf84b49168 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:42.545317 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-bd31d342-44fa-46c3-a6ad-98bf84b49168 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '17b2717ace074a579d33c60964e6668a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3fc032a089f45efa4a66866a9c961c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:42.547706 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-bd31d342-44fa-46c3-a6ad-98bf84b49168 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Searching by: {'deleted': False, 'project_id': 'c3fc032a089f45efa4a66866a9c961c9'} {{(pid=121000) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 03:28:42.571305 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bd31d342-44fa-46c3-a6ad-98bf84b49168 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:42.572080 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bd31d342-44fa-46c3-a6ad-98bf84b49168 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:42.576038 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bd31d342-44fa-46c3-a6ad-98bf84b49168 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:42.577202 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bd31d342-44fa-46c3-a6ad-98bf84b49168 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:42.577851 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bd31d342-44fa-46c3-a6ad-98bf84b49168 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:42.578496 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bd31d342-44fa-46c3-a6ad-98bf84b49168 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:42.857505 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.multi_cell_list [None req-bd31d342-44fa-46c3-a6ad-98bf84b49168 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121000) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 03:28:43.028667 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-bd31d342-44fa-46c3-a6ad-98bf84b49168 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b2717ace074a579d33c60964e6668a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3fc032a089f45efa4a66866a9c961c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:43.037834 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-98a5d013-1c11-49ea-8f8d-679d02079ee8 tempest-ImagesMetadataTestJSON-351418215 tempest-ImagesMetadataTestJSON-351418215-project] 10.222.0.20 "PUT /compute/v2.1/images/38c19ef0-970c-412a-a200-458c2c0f5310/metadata" status: 200 len: 64 microversion: 2.1 time: 0.874812 Oct 27 03:28:43.038877 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1022/2052] 10.222.0.20 () {60 vars in 1280 bytes} [Thu Oct 27 03:28:42 2022] PUT /compute/v2.1/images/38c19ef0-970c-412a-a200-458c2c0f5310/metadata => generated 64 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 03:28:43.047080 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-cc8d51d3-6f85-4e47-8df4-2c37484b04a8 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:43.048093 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bd31d342-44fa-46c3-a6ad-98bf84b49168 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:43.048614 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bd31d342-44fa-46c3-a6ad-98bf84b49168 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:43.049417 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-cc8d51d3-6f85-4e47-8df4-2c37484b04a8 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 1352bd75-bfe6-48e3-a47d-314c7f13f692] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:43.051890 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bd31d342-44fa-46c3-a6ad-98bf84b49168 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:43.085372 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cc8d51d3-6f85-4e47-8df4-2c37484b04a8 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:43.088411 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cc8d51d3-6f85-4e47-8df4-2c37484b04a8 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:43.089126 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cc8d51d3-6f85-4e47-8df4-2c37484b04a8 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:43.093994 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cc8d51d3-6f85-4e47-8df4-2c37484b04a8 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:43.094541 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cc8d51d3-6f85-4e47-8df4-2c37484b04a8 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:43.094996 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cc8d51d3-6f85-4e47-8df4-2c37484b04a8 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:43.330589 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-cc8d51d3-6f85-4e47-8df4-2c37484b04a8 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:43.346537 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-cc8d51d3-6f85-4e47-8df4-2c37484b04a8 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/1352bd75-bfe6-48e3-a47d-314c7f13f692" status: 200 len: 1265 microversion: 2.1 time: 0.306162 Oct 27 03:28:43.352192 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1023/2053] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:28:43 2022] GET /compute/v2.1/servers/1352bd75-bfe6-48e3-a47d-314c7f13f692 => generated 1265 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:43.363755 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1c93657f-7022-4a8d-a736-bbb3672250e6 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:43.367048 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1c93657f-7022-4a8d-a736-bbb3672250e6 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: a8925d29-d9e0-4dbb-a73d-09473255fa34] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:43.396569 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1c93657f-7022-4a8d-a736-bbb3672250e6 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:43.397225 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1c93657f-7022-4a8d-a736-bbb3672250e6 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:43.397859 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1c93657f-7022-4a8d-a736-bbb3672250e6 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:43.403939 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1c93657f-7022-4a8d-a736-bbb3672250e6 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:43.404648 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1c93657f-7022-4a8d-a736-bbb3672250e6 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:43.405145 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1c93657f-7022-4a8d-a736-bbb3672250e6 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:43.854079 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1c93657f-7022-4a8d-a736-bbb3672250e6 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:43.864647 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1c93657f-7022-4a8d-a736-bbb3672250e6 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34" status: 200 len: 1199 microversion: 2.1 time: 0.510421 Oct 27 03:28:43.877436 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1024/2054] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:28:43 2022] GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34 => generated 1199 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:43.877436 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-deb65b0d-290e-4bdd-a622-5cc0e39a07d1 tempest-ImagesMetadataTestJSON-351418215 tempest-ImagesMetadataTestJSON-351418215-project] Calling method '.version_select at 0x7f7dda4da280>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:43.957459 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-deb65b0d-290e-4bdd-a622-5cc0e39a07d1 tempest-ImagesMetadataTestJSON-351418215 tempest-ImagesMetadataTestJSON-351418215-project] 10.222.0.20 "GET /compute/v2.1/images/38c19ef0-970c-412a-a200-458c2c0f5310/metadata" status: 200 len: 64 microversion: 2.1 time: 0.090355 Oct 27 03:28:43.958615 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1025/2055] 10.222.0.20 () {58 vars in 1260 bytes} [Thu Oct 27 03:28:43 2022] GET /compute/v2.1/images/38c19ef0-970c-412a-a200-458c2c0f5310/metadata => generated 64 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 03:28:43.968299 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c7cd705c-7543-4e7c-947a-88c26548c30a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:43.969801 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c7cd705c-7543-4e7c-947a-88c26548c30a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: d5e6f604-9466-45c6-86a8-885cfb393223] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:43.989484 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c7cd705c-7543-4e7c-947a-88c26548c30a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:43.989979 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c7cd705c-7543-4e7c-947a-88c26548c30a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:43.999914 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c7cd705c-7543-4e7c-947a-88c26548c30a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:44.000918 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c7cd705c-7543-4e7c-947a-88c26548c30a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:44.001410 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c7cd705c-7543-4e7c-947a-88c26548c30a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:44.001853 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c7cd705c-7543-4e7c-947a-88c26548c30a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:44.419715 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-bd31d342-44fa-46c3-a6ad-98bf84b49168 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] 10.222.0.20 "GET /compute/v2.1/servers/detail" status: 200 len: 1711 microversion: 2.1 time: 1.894003 Oct 27 03:28:44.424200 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1031/2056] 10.222.0.20 () {58 vars in 1146 bytes} [Thu Oct 27 03:28:42 2022] GET /compute/v2.1/servers/detail => generated 1711 bytes in 1900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:44.431464 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3e93dce5-3151-4b99-84d1-f0b37d5378ba tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:44.432473 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-3e93dce5-3151-4b99-84d1-f0b37d5378ba tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: 339287fc-37b6-455d-96ab-08ab8e2c3e68] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:44.452544 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3e93dce5-3151-4b99-84d1-f0b37d5378ba tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:44.453070 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3e93dce5-3151-4b99-84d1-f0b37d5378ba tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:44.453622 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3e93dce5-3151-4b99-84d1-f0b37d5378ba tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:44.457664 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3e93dce5-3151-4b99-84d1-f0b37d5378ba tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:44.460385 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3e93dce5-3151-4b99-84d1-f0b37d5378ba tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:44.461075 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3e93dce5-3151-4b99-84d1-f0b37d5378ba tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:44.557818 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c7cd705c-7543-4e7c-947a-88c26548c30a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:44.573498 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c7cd705c-7543-4e7c-947a-88c26548c30a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:44.578416 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c7cd705c-7543-4e7c-947a-88c26548c30a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:44.581036 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c7cd705c-7543-4e7c-947a-88c26548c30a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223" status: 200 len: 1293 microversion: 2.25 time: 0.620656 Oct 27 03:28:44.581836 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1026/2057] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:28:43 2022] GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223 => generated 1293 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:28:44.592012 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6ada05cb-cf9d-45e8-9599-02c2fdcfabdf tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:44.595899 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-6ada05cb-cf9d-45e8-9599-02c2fdcfabdf tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] [instance: 2aa6c062-32e4-453d-abb5-a51d96c66e2d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:44.607077 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6ada05cb-cf9d-45e8-9599-02c2fdcfabdf tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:44.616952 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6ada05cb-cf9d-45e8-9599-02c2fdcfabdf tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:44.617611 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6ada05cb-cf9d-45e8-9599-02c2fdcfabdf tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:44.618599 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6ada05cb-cf9d-45e8-9599-02c2fdcfabdf tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:44.619393 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6ada05cb-cf9d-45e8-9599-02c2fdcfabdf tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:44.620160 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6ada05cb-cf9d-45e8-9599-02c2fdcfabdf tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:44.977020 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6ada05cb-cf9d-45e8-9599-02c2fdcfabdf tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '071401bed74d48fe8ae2dbdb98aa81cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b0b534b9eb463aab0f13e838578da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:44.990396 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6ada05cb-cf9d-45e8-9599-02c2fdcfabdf tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] 10.222.0.20 "GET /compute/v2.1/servers/2aa6c062-32e4-453d-abb5-a51d96c66e2d" status: 200 len: 1322 microversion: 2.1 time: 0.402990 Oct 27 03:28:44.992011 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1027/2058] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:28:44 2022] GET /compute/v2.1/servers/2aa6c062-32e4-453d-abb5-a51d96c66e2d => generated 1322 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:45.008832 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-155002d7-ce3f-4d6f-b652-bc90f47a4dfa req-95f4c16c-a80e-4157-8b1c-6d09c3d1b2f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a89c8f12-2492-4a0f-8887-acd62e510fd9", "tag": "b726525d-fb99-4f78-925e-57e948366880"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:28:45.025968 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-155002d7-ce3f-4d6f-b652-bc90f47a4dfa req-95f4c16c-a80e-4157-8b1c-6d09c3d1b2f7 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:45.027285 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-155002d7-ce3f-4d6f-b652-bc90f47a4dfa req-95f4c16c-a80e-4157-8b1c-6d09c3d1b2f7 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:45.027967 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-155002d7-ce3f-4d6f-b652-bc90f47a4dfa req-95f4c16c-a80e-4157-8b1c-6d09c3d1b2f7 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:45.050543 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-155002d7-ce3f-4d6f-b652-bc90f47a4dfa req-95f4c16c-a80e-4157-8b1c-6d09c3d1b2f7 service nova] Creating event network-changed:b726525d-fb99-4f78-925e-57e948366880 for instance a89c8f12-2492-4a0f-8887-acd62e510fd9 on n-h1-862769-1 Oct 27 03:28:45.059324 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-155002d7-ce3f-4d6f-b652-bc90f47a4dfa req-95f4c16c-a80e-4157-8b1c-6d09c3d1b2f7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065498 Oct 27 03:28:45.060366 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1028/2059] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:28:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:28:45.071936 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-aeb0654c-8fc2-4151-9eb9-ed61f9b60a30 req-2e2b5c09-71bf-4d72-8b26-c1f96561d945 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5e6f604-9466-45c6-86a8-885cfb393223", "tag": "6b270560-e2de-41cb-9470-6571434ba8f2"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:28:45.087349 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-aeb0654c-8fc2-4151-9eb9-ed61f9b60a30 req-2e2b5c09-71bf-4d72-8b26-c1f96561d945 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:45.088772 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-aeb0654c-8fc2-4151-9eb9-ed61f9b60a30 req-2e2b5c09-71bf-4d72-8b26-c1f96561d945 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:45.089607 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-aeb0654c-8fc2-4151-9eb9-ed61f9b60a30 req-2e2b5c09-71bf-4d72-8b26-c1f96561d945 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:45.107893 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-aeb0654c-8fc2-4151-9eb9-ed61f9b60a30 req-2e2b5c09-71bf-4d72-8b26-c1f96561d945 service nova] Creating event network-changed:6b270560-e2de-41cb-9470-6571434ba8f2 for instance d5e6f604-9466-45c6-86a8-885cfb393223 on n-h1-862769-1 Oct 27 03:28:45.117597 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-aeb0654c-8fc2-4151-9eb9-ed61f9b60a30 req-2e2b5c09-71bf-4d72-8b26-c1f96561d945 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054498 Oct 27 03:28:45.121359 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1029/2060] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:28:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:28:45.137073 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-3e93dce5-3151-4b99-84d1-f0b37d5378ba tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13e05e253c94aadb1c089128ff35be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8510a519f14deea6f35a437419e161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:45.146865 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-de774885-1642-4701-a1c1-88f78436f786 tempest-ImagesMetadataTestJSON-351418215 tempest-ImagesMetadataTestJSON-351418215-project] Action: 'update_all', calling method: .version_select at 0x7f7dded2c160>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:28:45.155243 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3e93dce5-3151-4b99-84d1-f0b37d5378ba tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68" status: 200 len: 1471 microversion: 2.1 time: 0.728901 Oct 27 03:28:45.156111 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1032/2061] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:28:44 2022] GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68 => generated 1471 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:45.254707 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-de774885-1642-4701-a1c1-88f78436f786 tempest-ImagesMetadataTestJSON-351418215 tempest-ImagesMetadataTestJSON-351418215-project] Getting quotas for project 82cc9f48070a442db552098a12c0705e. Resources: dict_keys(['metadata_items']) {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:28:45.268693 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-de774885-1642-4701-a1c1-88f78436f786 tempest-ImagesMetadataTestJSON-351418215 tempest-ImagesMetadataTestJSON-351418215-project] Getting quotas for user 790b3cd664d74806bf52d6360ac7763f and project 82cc9f48070a442db552098a12c0705e. Resources: dict_keys(['metadata_items']) {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:28:45.545801 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-fa339e9e-ce58-461b-aafb-0a93872769f5 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:45.546463 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-fa339e9e-ce58-461b-aafb-0a93872769f5 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 1352bd75-bfe6-48e3-a47d-314c7f13f692] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:45.558377 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fa339e9e-ce58-461b-aafb-0a93872769f5 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:45.559269 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fa339e9e-ce58-461b-aafb-0a93872769f5 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:45.560233 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fa339e9e-ce58-461b-aafb-0a93872769f5 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:45.562076 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fa339e9e-ce58-461b-aafb-0a93872769f5 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:45.563506 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fa339e9e-ce58-461b-aafb-0a93872769f5 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:45.565187 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fa339e9e-ce58-461b-aafb-0a93872769f5 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:45.886598 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-de774885-1642-4701-a1c1-88f78436f786 tempest-ImagesMetadataTestJSON-351418215 tempest-ImagesMetadataTestJSON-351418215-project] 10.222.0.20 "PUT /compute/v2.1/images/38c19ef0-970c-412a-a200-458c2c0f5310/metadata" status: 200 len: 61 microversion: 2.1 time: 0.763155 Oct 27 03:28:45.887364 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1030/2062] 10.222.0.20 () {60 vars in 1280 bytes} [Thu Oct 27 03:28:45 2022] PUT /compute/v2.1/images/38c19ef0-970c-412a-a200-458c2c0f5310/metadata => generated 61 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 03:28:45.895706 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6ab5781b-0cf0-4ef3-b6b2-532634599cb4 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:45.930809 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6ab5781b-0cf0-4ef3-b6b2-532634599cb4 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.040929 Oct 27 03:28:45.930809 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1031/2063] 10.222.0.20 () {58 vars in 1137 bytes} [Thu Oct 27 03:28:45 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:28:46.063386 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-996c757d-a5e8-4ebc-a638-82b17a3f6e8a tempest-KeyPairsNegativeTestJSON-785011349 tempest-KeyPairsNegativeTestJSON-785011349-project] Action: 'create', calling method: .version_select at 0x7f7dded6daf0>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNVUnKq8/GZjMeEv7YZjOo7ktayPVTWww5egDM+yIVO7ssjZnL+1yK1elpINSgeA7KFDDI/81Bel/ao8Ho+MQLYx7uR9Xz1jcZpeMPpg9HFp3kd3gcavJWFFvGiKsx0A+Q=="}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:28:46.074653 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-996c757d-a5e8-4ebc-a638-82b17a3f6e8a tempest-KeyPairsNegativeTestJSON-785011349 tempest-KeyPairsNegativeTestJSON-785011349-project] Request method failure captured: Oct 27 03:28:46.074653 n-d-862769-1 devstack@n-api.service[121001]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 27 03:28:46.074653 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:28:46.074653 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:28:46.074653 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:28:46.074653 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 257 Oct 27 03:28:46.074653 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:28:46.074653 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:28:46.074653 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:28:46.074653 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:28:46.074653 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfrsKdLjc7w_hkfuxkTQAO0QUXuHQlYbncJzfUQA4OwHBBnhbkaNNsRmi93B67-KNb-RXWDHDVxekcDpZXQ88y-cBlihLpdjy86vLJzrYB3QCo4geob333E17exNNf0qHgNADSb2lSxiULZZbC7BvcOtfoF9u1g_4FAulhQWSJn_p5E Oct 27 03:28:46.074653 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:28:46.074653 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:28:46.074653 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:28:46.074653 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:28:46.074653 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:28:46.074653 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:28:46.074653 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 9aedac4560a949d496d6c36006b387c6 Oct 27 03:28:46.074653 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-785011349 Oct 27 03:28:46.074653 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:28:46.074653 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:28:46.076374 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9aedac4560a949d496d6c36006b387c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9aedac4560a949d496d6c36006b387c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9aedac4560a949d496d6c36006b387c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9aedac4560a949d496d6c36006b387c6"}]}] Oct 27 03:28:46.076374 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-KeyPairsNegativeTestJSON-785011349 Oct 27 03:28:46.076374 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 9aedac4560a949d496d6c36006b387c6 Oct 27 03:28:46.076374 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-785011349 Oct 27 03:28:46.076374 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-KeyPairsNegativeTestJSON-785011349-project Oct 27 03:28:46.076374 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:28:46.076374 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:28:46.076374 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: aba6e49374474d17b5e63709eb5fbb7b Oct 27 03:28:46.076374 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-KeyPairsNegativeTestJSON-785011349-project Oct 27 03:28:46.076374 n-d-862769-1 devstack@n-api.service[121001]: Oct 27 03:28:46.076374 n-d-862769-1 devstack@n-api.service[121001]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNVUnKq8/GZjMeEv7YZjOo7ktayPVTWww5egDM+yIVO7ssjZnL+1yK1elpINSgeA7KFDDI/81Bel/ao8Ho+MQLYx7uR9Xz1jcZpeMPpg9HFp3kd3gcavJWFFvGiKsx0A+Q=="}} Oct 27 03:28:46.077253 n-d-862769-1 devstack@n-api.service[121001]: method: Oct 27 03:28:46.077253 n-d-862769-1 devstack@n-api.service[121001]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 27 03:28:46.077253 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNVUnKq8/GZjMeEv7YZjOo7ktayPVTWww5egDM+yIVO7ssjZnL+1yK1elpINSgeA7KFDDI/81Bel/ao8Ho+MQLYx7uR9Xz1jcZpeMPpg9HFp3kd3gcavJWFFvGiKsx0A+Q=='}}} Oct 27 03:28:46.077253 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:28:46.077253 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:28:46.077253 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 27 03:28:46.077253 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 27 03:28:46.077253 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Oct 27 03:28:46.077253 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Oct 27 03:28:46.077253 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Oct 27 03:28:46.077253 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Oct 27 03:28:46.077253 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 27 03:28:46.077253 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:28:46.077253 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 27 03:28:46.077253 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:28:46.077253 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:28:46.077253 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 03:28:46.078544 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 03:28:46.078544 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 03:28:46.078544 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise error Oct 27 03:28:46.078544 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Oct 27 03:28:46.078544 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:28:46.078544 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Oct 27 03:28:46.078544 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Oct 27 03:28:46.078544 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Oct 27 03:28:46.078544 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi 'minLength': 1, Oct 27 03:28:46.078544 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 27 03:28:46.078544 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:28:46.078544 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Oct 27 03:28:46.078544 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Oct 27 03:28:46.078544 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:28:46.078544 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:28:46.078544 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:28:46.078544 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:28:46.078544 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:28:46.078544 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:28:46.078544 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:28:46.078544 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:28:46.078544 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:28:46.078544 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:28:46.080301 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:28:46.080301 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:28:46.080301 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:28:46.080301 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:28:46.080301 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 03:28:46.080301 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 03:28:46.080301 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 03:28:46.080301 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 03:28:46.080301 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 03:28:46.080301 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 03:28:46.080301 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 27 03:28:46.080301 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:28:46.080301 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:28:46.080301 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:28:46.080301 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:28:46.080301 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:28:46.080301 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:28:46.080301 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 03:28:46.080301 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 03:28:46.084154 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 27 03:28:46.084154 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:28:46.086706 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-996c757d-a5e8-4ebc-a638-82b17a3f6e8a tempest-KeyPairsNegativeTestJSON-785011349 tempest-KeyPairsNegativeTestJSON-785011349-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:28:46.091644 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-996c757d-a5e8-4ebc-a638-82b17a3f6e8a tempest-KeyPairsNegativeTestJSON-785011349 tempest-KeyPairsNegativeTestJSON-785011349-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.147399 Oct 27 03:28:46.091644 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1032/2064] 10.222.0.20 () {60 vars in 1159 bytes} [Thu Oct 27 03:28:45 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 159 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 03:28:46.095413 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-77f2da90-a37d-4a4e-8230-de51ce062886 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:46.097501 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-77f2da90-a37d-4a4e-8230-de51ce062886 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: a8925d29-d9e0-4dbb-a73d-09473255fa34] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:46.104708 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-77f2da90-a37d-4a4e-8230-de51ce062886 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:46.105209 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-77f2da90-a37d-4a4e-8230-de51ce062886 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:46.105856 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-77f2da90-a37d-4a4e-8230-de51ce062886 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:46.107718 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-77f2da90-a37d-4a4e-8230-de51ce062886 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:46.108400 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-77f2da90-a37d-4a4e-8230-de51ce062886 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:46.108992 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-77f2da90-a37d-4a4e-8230-de51ce062886 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:46.135278 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=96,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:28:46.359948 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-77f2da90-a37d-4a4e-8230-de51ce062886 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:46.373128 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-77f2da90-a37d-4a4e-8230-de51ce062886 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34" status: 200 len: 1199 microversion: 2.1 time: 0.282571 Oct 27 03:28:46.374117 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1033/2065] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:28:46 2022] GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34 => generated 1199 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:46.380241 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d9a286d9-1a0e-41ee-9b99-64ec34dce220 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:46.382024 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d9a286d9-1a0e-41ee-9b99-64ec34dce220 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: d5e6f604-9466-45c6-86a8-885cfb393223] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:46.390791 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d9a286d9-1a0e-41ee-9b99-64ec34dce220 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:46.392252 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d9a286d9-1a0e-41ee-9b99-64ec34dce220 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:46.393158 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d9a286d9-1a0e-41ee-9b99-64ec34dce220 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:46.395035 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d9a286d9-1a0e-41ee-9b99-64ec34dce220 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:46.395849 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d9a286d9-1a0e-41ee-9b99-64ec34dce220 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:46.396369 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d9a286d9-1a0e-41ee-9b99-64ec34dce220 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:46.570405 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d9a286d9-1a0e-41ee-9b99-64ec34dce220 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:46.584918 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d9a286d9-1a0e-41ee-9b99-64ec34dce220 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:46.584918 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d9a286d9-1a0e-41ee-9b99-64ec34dce220 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:46.585824 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d9a286d9-1a0e-41ee-9b99-64ec34dce220 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223" status: 200 len: 1293 microversion: 2.25 time: 0.209752 Oct 27 03:28:46.586874 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1034/2066] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:28:46 2022] GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223 => generated 1293 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:28:46.591758 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5cbd1e83-ba14-48ac-baf1-afff6cfaa827 tempest-ImagesMetadataTestJSON-351418215 tempest-ImagesMetadataTestJSON-351418215-project] Action: 'update', calling method: .version_select at 0x7f7dded40430>, body: {"meta": {"os_version": "alt"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:28:46.625831 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-fa339e9e-ce58-461b-aafb-0a93872769f5 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:46.652749 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-fa339e9e-ce58-461b-aafb-0a93872769f5 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/1352bd75-bfe6-48e3-a47d-314c7f13f692" status: 200 len: 1307 microversion: 2.1 time: 1.485646 Oct 27 03:28:46.657040 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1033/2067] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:28:45 2022] GET /compute/v2.1/servers/1352bd75-bfe6-48e3-a47d-314c7f13f692 => generated 1307 bytes in 1495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:46.663744 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-15d30197-d950-4c26-9421-8571488542ce tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:46.664730 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-15d30197-d950-4c26-9421-8571488542ce tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] [instance: 2aa6c062-32e4-453d-abb5-a51d96c66e2d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:46.671963 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=12 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:28:46.674950 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-15d30197-d950-4c26-9421-8571488542ce tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:46.674950 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-15d30197-d950-4c26-9421-8571488542ce tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:46.676308 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-15d30197-d950-4c26-9421-8571488542ce tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:46.677273 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-15d30197-d950-4c26-9421-8571488542ce tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:46.677970 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-15d30197-d950-4c26-9421-8571488542ce tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:46.678649 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-15d30197-d950-4c26-9421-8571488542ce tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:46.687595 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-5cbd1e83-ba14-48ac-baf1-afff6cfaa827 tempest-ImagesMetadataTestJSON-351418215 tempest-ImagesMetadataTestJSON-351418215-project] Getting quotas for project 82cc9f48070a442db552098a12c0705e. Resources: dict_keys(['metadata_items']) {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:28:46.703954 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-5cbd1e83-ba14-48ac-baf1-afff6cfaa827 tempest-ImagesMetadataTestJSON-351418215 tempest-ImagesMetadataTestJSON-351418215-project] Getting quotas for user 790b3cd664d74806bf52d6360ac7763f and project 82cc9f48070a442db552098a12c0705e. Resources: dict_keys(['metadata_items']) {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:28:47.165216 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5cbd1e83-ba14-48ac-baf1-afff6cfaa827 tempest-ImagesMetadataTestJSON-351418215 tempest-ImagesMetadataTestJSON-351418215-project] 10.222.0.20 "PUT /compute/v2.1/images/38c19ef0-970c-412a-a200-458c2c0f5310/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.577142 Oct 27 03:28:47.166249 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1035/2068] 10.222.0.20 () {60 vars in 1313 bytes} [Thu Oct 27 03:28:46 2022] PUT /compute/v2.1/images/38c19ef0-970c-412a-a200-458c2c0f5310/metadata/os_version => generated 31 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 03:28:47.180882 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-486dd42a-5853-4299-9531-7dcba32388d4 tempest-KeyPairsNegativeTestJSON-785011349 tempest-KeyPairsNegativeTestJSON-785011349-project] Action: 'create', calling method: .version_select at 0x7f7ddecea550>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-239577042", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:28:47.246339 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-486dd42a-5853-4299-9531-7dcba32388d4 tempest-KeyPairsNegativeTestJSON-785011349 tempest-KeyPairsNegativeTestJSON-785011349-project] Getting quotas for project 9aedac4560a949d496d6c36006b387c6. Resources: {'key_pairs'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:28:47.259126 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-486dd42a-5853-4299-9531-7dcba32388d4 tempest-KeyPairsNegativeTestJSON-785011349 tempest-KeyPairsNegativeTestJSON-785011349-project] Getting quotas for user aba6e49374474d17b5e63709eb5fbb7b and project 9aedac4560a949d496d6c36006b387c6. Resources: {'key_pairs'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:28:47.305716 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-486dd42a-5853-4299-9531-7dcba32388d4 tempest-KeyPairsNegativeTestJSON-785011349 tempest-KeyPairsNegativeTestJSON-785011349-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 27 03:28:47.325776 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-486dd42a-5853-4299-9531-7dcba32388d4 tempest-KeyPairsNegativeTestJSON-785011349 tempest-KeyPairsNegativeTestJSON-785011349-project] Request method failure captured: Oct 27 03:28:47.325776 n-d-862769-1 devstack@n-api.service[121001]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 27 03:28:47.325776 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:28:47.325776 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:28:47.325776 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:28:47.325776 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 2166 Oct 27 03:28:47.325776 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:28:47.325776 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:28:47.325776 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:28:47.325776 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:28:47.325776 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfrsKdLjc7w_hkfuxkTQAO0QUXuHQlYbncJzfUQA4OwHBBnhbkaNNsRmi93B67-KNb-RXWDHDVxekcDpZXQ88y-cBlihLpdjy86vLJzrYB3QCo4geob333E17exNNf0qHgNADSb2lSxiULZZbC7BvcOtfoF9u1g_4FAulhQWSJn_p5E Oct 27 03:28:47.325776 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:28:47.325776 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:28:47.325776 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:28:47.325776 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:28:47.325776 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:28:47.325776 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:28:47.325776 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 9aedac4560a949d496d6c36006b387c6 Oct 27 03:28:47.325776 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-785011349 Oct 27 03:28:47.325776 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:28:47.325776 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:28:47.325776 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9aedac4560a949d496d6c36006b387c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9aedac4560a949d496d6c36006b387c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9aedac4560a949d496d6c36006b387c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9aedac4560a949d496d6c36006b387c6"}]}] Oct 27 03:28:47.325776 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-KeyPairsNegativeTestJSON-785011349 Oct 27 03:28:47.325776 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 9aedac4560a949d496d6c36006b387c6 Oct 27 03:28:47.325776 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-785011349 Oct 27 03:28:47.325776 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-KeyPairsNegativeTestJSON-785011349-project Oct 27 03:28:47.325776 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:28:47.325776 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:28:47.325776 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: aba6e49374474d17b5e63709eb5fbb7b Oct 27 03:28:47.325776 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-KeyPairsNegativeTestJSON-785011349-project Oct 27 03:28:47.325776 n-d-862769-1 devstack@n-api.service[121001]: Oct 27 03:28:47.325776 n-d-862769-1 devstack@n-api.service[121001]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-239577042", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Oct 27 03:28:47.325776 n-d-862769-1 devstack@n-api.service[121001]: method: Oct 27 03:28:47.325776 n-d-862769-1 devstack@n-api.service[121001]: exception: Keypair data is invalid: failed to generate fingerprint Oct 27 03:28:47.328444 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-239577042', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Oct 27 03:28:47.328444 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:28:47.328444 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:28:47.328444 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 27 03:28:47.328444 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 27 03:28:47.328444 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Oct 27 03:28:47.328444 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Oct 27 03:28:47.328444 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Oct 27 03:28:47.328444 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:28:47.328444 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:28:47.328444 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:28:47.328444 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:28:47.328444 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 27 03:28:47.328444 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 27 03:28:47.328444 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 27 03:28:47.328444 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 27 03:28:47.328444 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 03:28:47.328444 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 03:28:47.328444 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 03:28:47.328444 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 03:28:47.328444 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 27 03:28:47.328444 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 27 03:28:47.328444 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 27 03:28:47.328444 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 27 03:28:47.328444 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 27 03:28:47.328444 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 27 03:28:47.328444 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 27 03:28:47.328444 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 27 03:28:47.328444 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 27 03:28:47.328444 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:28:47.328444 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:28:47.328444 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:28:47.328444 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:28:47.328444 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:28:47.328444 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:28:47.328444 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:28:47.328444 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:28:47.328444 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:28:47.328444 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:28:47.328444 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:28:47.328444 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:28:47.332015 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:28:47.332015 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:28:47.332015 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:28:47.332015 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:28:47.332015 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 27 03:28:47.332015 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 27 03:28:47.332015 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 27 03:28:47.332015 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 27 03:28:47.332015 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 27 03:28:47.332015 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:28:47.332015 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:28:47.332015 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:28:47.332015 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:28:47.332015 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:28:47.332015 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:28:47.332015 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:28:47.332015 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:28:47.332015 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 27 03:28:47.332015 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:28:47.335466 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-486dd42a-5853-4299-9531-7dcba32388d4 tempest-KeyPairsNegativeTestJSON-785011349 tempest-KeyPairsNegativeTestJSON-785011349-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:28:47.337116 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-486dd42a-5853-4299-9531-7dcba32388d4 tempest-KeyPairsNegativeTestJSON-785011349 tempest-KeyPairsNegativeTestJSON-785011349-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.169781 Oct 27 03:28:47.337959 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1036/2069] 10.222.0.20 () {60 vars in 1160 bytes} [Thu Oct 27 03:28:47 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 171 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 27 03:28:47.343035 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-69a8184c-211d-48e6-bc77-d0d79aa1d939 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:47.345776 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-69a8184c-211d-48e6-bc77-d0d79aa1d939 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: 339287fc-37b6-455d-96ab-08ab8e2c3e68] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:47.363478 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-69a8184c-211d-48e6-bc77-d0d79aa1d939 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:47.365644 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-69a8184c-211d-48e6-bc77-d0d79aa1d939 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:47.367216 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-69a8184c-211d-48e6-bc77-d0d79aa1d939 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:47.368996 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-69a8184c-211d-48e6-bc77-d0d79aa1d939 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:47.373500 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-69a8184c-211d-48e6-bc77-d0d79aa1d939 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:47.374399 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-69a8184c-211d-48e6-bc77-d0d79aa1d939 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:47.451074 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-15d30197-d950-4c26-9421-8571488542ce tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '071401bed74d48fe8ae2dbdb98aa81cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b0b534b9eb463aab0f13e838578da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:47.463398 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-15d30197-d950-4c26-9421-8571488542ce tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] 10.222.0.20 "GET /compute/v2.1/servers/2aa6c062-32e4-453d-abb5-a51d96c66e2d" status: 200 len: 1322 microversion: 2.1 time: 0.804982 Oct 27 03:28:47.478981 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1034/2070] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:28:46 2022] GET /compute/v2.1/servers/2aa6c062-32e4-453d-abb5-a51d96c66e2d => generated 1322 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:47.491564 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-98a110e6-3932-445b-87f0-b81e6c28a695 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:47.494380 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-98a110e6-3932-445b-87f0-b81e6c28a695 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] [instance: 0fb1f450-692f-4979-a489-c13ab4106607] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:47.506737 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-98a110e6-3932-445b-87f0-b81e6c28a695 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:47.509697 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-98a110e6-3932-445b-87f0-b81e6c28a695 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:47.509697 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-98a110e6-3932-445b-87f0-b81e6c28a695 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:47.512428 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-98a110e6-3932-445b-87f0-b81e6c28a695 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:47.514564 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-98a110e6-3932-445b-87f0-b81e6c28a695 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:47.515276 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-98a110e6-3932-445b-87f0-b81e6c28a695 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:47.609007 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-98a110e6-3932-445b-87f0-b81e6c28a695 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] [instance: 0fb1f450-692f-4979-a489-c13ab4106607] Going to try to terminate instance {{(pid=121000) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:28:47.745593 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-69a8184c-211d-48e6-bc77-d0d79aa1d939 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13e05e253c94aadb1c089128ff35be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8510a519f14deea6f35a437419e161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:47.754694 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-69a8184c-211d-48e6-bc77-d0d79aa1d939 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68" status: 200 len: 1471 microversion: 2.1 time: 0.415378 Oct 27 03:28:47.771223 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1037/2071] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:28:47 2022] GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68 => generated 1471 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:47.771223 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-58ddec8e-3411-4afd-ac11-493425e94ab4 tempest-ImagesMetadataTestJSON-351418215 tempest-ImagesMetadataTestJSON-351418215-project] Calling method '.version_select at 0x7f7dded5b820>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:47.833728 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-58ddec8e-3411-4afd-ac11-493425e94ab4 tempest-ImagesMetadataTestJSON-351418215 tempest-ImagesMetadataTestJSON-351418215-project] 10.222.0.20 "GET /compute/v2.1/images/38c19ef0-970c-412a-a200-458c2c0f5310/metadata" status: 200 len: 58 microversion: 2.1 time: 0.074271 Oct 27 03:28:47.840460 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1038/2072] 10.222.0.20 () {58 vars in 1260 bytes} [Thu Oct 27 03:28:47 2022] GET /compute/v2.1/images/38c19ef0-970c-412a-a200-458c2c0f5310/metadata => generated 58 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 03:28:47.847118 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0d98bdf0-bf2b-46a6-a2d8-4b0997a2795b tempest-KeyPairsNegativeTestJSON-785011349 tempest-KeyPairsNegativeTestJSON-785011349-project] Action: 'create', calling method: .version_select at 0x7f7dded2c790>, body: {"keypair": {"name": "tempest-keypair-1559641496", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFGi/JjW5pQDTPfnhT5wznpuMndR5qaEwBPWMIFRDMsGCTVyY+wFQGg50Odp47WLBToTkNXZOZbFwQ88vriHcPDCtxq9e1YIQNG0xUeKxlLKkaZjMhQ6y23LD11wIaOjgQ=="}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:28:47.874435 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-0d98bdf0-bf2b-46a6-a2d8-4b0997a2795b tempest-KeyPairsNegativeTestJSON-785011349 tempest-KeyPairsNegativeTestJSON-785011349-project] Getting quotas for project 9aedac4560a949d496d6c36006b387c6. Resources: {'key_pairs'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:28:47.882452 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-0d98bdf0-bf2b-46a6-a2d8-4b0997a2795b tempest-KeyPairsNegativeTestJSON-785011349 tempest-KeyPairsNegativeTestJSON-785011349-project] Getting quotas for user aba6e49374474d17b5e63709eb5fbb7b and project 9aedac4560a949d496d6c36006b387c6. Resources: {'key_pairs'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:28:48.005244 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-98a110e6-3932-445b-87f0-b81e6c28a695 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0fb1f450-692f-4979-a489-c13ab4106607" status: 204 len: 0 microversion: 2.1 time: 0.523526 Oct 27 03:28:48.005866 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0d98bdf0-bf2b-46a6-a2d8-4b0997a2795b tempest-KeyPairsNegativeTestJSON-785011349 tempest-KeyPairsNegativeTestJSON-785011349-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.163577 Oct 27 03:28:48.006537 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1039/2073] 10.222.0.20 () {60 vars in 1159 bytes} [Thu Oct 27 03:28:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:28:48.007130 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1035/2074] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:28:47 2022] DELETE /compute/v2.1/servers/0fb1f450-692f-4979-a489-c13ab4106607 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:28:48.011968 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-42601ecf-45aa-43be-bef5-464bb2d4dee2 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:48.013088 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-42601ecf-45aa-43be-bef5-464bb2d4dee2 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: a8925d29-d9e0-4dbb-a73d-09473255fa34] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:48.013620 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-62d06761-ddb7-4ba4-8d33-c628828df9c7 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:48.016056 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-62d06761-ddb7-4ba4-8d33-c628828df9c7 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: d5e6f604-9466-45c6-86a8-885cfb393223] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:48.030418 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-42601ecf-45aa-43be-bef5-464bb2d4dee2 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:48.031317 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-62d06761-ddb7-4ba4-8d33-c628828df9c7 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:48.034020 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-62d06761-ddb7-4ba4-8d33-c628828df9c7 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:48.034817 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-62d06761-ddb7-4ba4-8d33-c628828df9c7 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:48.035119 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-42601ecf-45aa-43be-bef5-464bb2d4dee2 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:48.035695 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-42601ecf-45aa-43be-bef5-464bb2d4dee2 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:48.037170 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-42601ecf-45aa-43be-bef5-464bb2d4dee2 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:48.038042 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-42601ecf-45aa-43be-bef5-464bb2d4dee2 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:48.042638 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-62d06761-ddb7-4ba4-8d33-c628828df9c7 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:48.042783 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-42601ecf-45aa-43be-bef5-464bb2d4dee2 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:48.043092 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-62d06761-ddb7-4ba4-8d33-c628828df9c7 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:48.043092 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-62d06761-ddb7-4ba4-8d33-c628828df9c7 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:48.336933 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-42601ecf-45aa-43be-bef5-464bb2d4dee2 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:48.346144 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-42601ecf-45aa-43be-bef5-464bb2d4dee2 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34" status: 200 len: 1199 microversion: 2.1 time: 0.338050 Oct 27 03:28:48.347504 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1040/2075] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:28:48 2022] GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34 => generated 1199 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:48.353970 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-eb59710c-82c8-49ad-9d73-9132df466017 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:48.354809 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-eb59710c-82c8-49ad-9d73-9132df466017 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 1352bd75-bfe6-48e3-a47d-314c7f13f692] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:48.363423 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eb59710c-82c8-49ad-9d73-9132df466017 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:48.364164 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eb59710c-82c8-49ad-9d73-9132df466017 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:48.364609 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eb59710c-82c8-49ad-9d73-9132df466017 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:48.365326 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eb59710c-82c8-49ad-9d73-9132df466017 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:48.365791 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eb59710c-82c8-49ad-9d73-9132df466017 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:48.366740 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eb59710c-82c8-49ad-9d73-9132df466017 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:48.452980 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-62d06761-ddb7-4ba4-8d33-c628828df9c7 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:48.470724 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-62d06761-ddb7-4ba4-8d33-c628828df9c7 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:48.475631 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-62d06761-ddb7-4ba4-8d33-c628828df9c7 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:48.475631 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-62d06761-ddb7-4ba4-8d33-c628828df9c7 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223" status: 200 len: 1281 microversion: 2.25 time: 0.465484 Oct 27 03:28:48.475631 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1036/2076] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:28:48 2022] GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223 => generated 1281 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:28:48.490257 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0d2f1b63-853d-4b3a-a22c-2fed76816900 tempest-ImagesMetadataTestJSON-351418215 tempest-ImagesMetadataTestJSON-351418215-project] Action: 'update_all', calling method: .version_select at 0x7f7dda075af0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:28:48.529278 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-eb59710c-82c8-49ad-9d73-9132df466017 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:48.545716 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-eb59710c-82c8-49ad-9d73-9132df466017 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/1352bd75-bfe6-48e3-a47d-314c7f13f692" status: 200 len: 1307 microversion: 2.1 time: 0.196939 Oct 27 03:28:48.546664 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1041/2077] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:28:48 2022] GET /compute/v2.1/servers/1352bd75-bfe6-48e3-a47d-314c7f13f692 => generated 1307 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:48.554357 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9f7a7d60-38c9-49ae-b26c-53b9be802366 tempest-KeyPairsNegativeTestJSON-785011349 tempest-KeyPairsNegativeTestJSON-785011349-project] Action: 'create', calling method: .version_select at 0x7f7ddec288b0>, body: {"keypair": {"name": "tempest-keypair-1559641496", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNT2ljIZsIN762i3VyxQb9A0Vv3Z92ZtRbWTJoeza4W6gphwKatq5I/oHmVsS6JOqWfqFdzoQTkhL+AfEpIBeS42QJ2EfMHu31RElmNMzMRcPRq44w2bfAmkbJz2eV3QyQ=="}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:28:48.560211 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-0d2f1b63-853d-4b3a-a22c-2fed76816900 tempest-ImagesMetadataTestJSON-351418215 tempest-ImagesMetadataTestJSON-351418215-project] Getting quotas for project 82cc9f48070a442db552098a12c0705e. Resources: dict_keys(['metadata_items']) {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:28:48.568639 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-0d2f1b63-853d-4b3a-a22c-2fed76816900 tempest-ImagesMetadataTestJSON-351418215 tempest-ImagesMetadataTestJSON-351418215-project] Getting quotas for user 790b3cd664d74806bf52d6360ac7763f and project 82cc9f48070a442db552098a12c0705e. Resources: dict_keys(['metadata_items']) {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:28:48.580617 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-9f7a7d60-38c9-49ae-b26c-53b9be802366 tempest-KeyPairsNegativeTestJSON-785011349 tempest-KeyPairsNegativeTestJSON-785011349-project] Getting quotas for project 9aedac4560a949d496d6c36006b387c6. Resources: {'key_pairs'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:28:48.580617 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-9f7a7d60-38c9-49ae-b26c-53b9be802366 tempest-KeyPairsNegativeTestJSON-785011349 tempest-KeyPairsNegativeTestJSON-785011349-project] Getting quotas for user aba6e49374474d17b5e63709eb5fbb7b and project 9aedac4560a949d496d6c36006b387c6. Resources: {'key_pairs'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:28:48.580617 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:28:48.622635 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-9f7a7d60-38c9-49ae-b26c-53b9be802366 tempest-KeyPairsNegativeTestJSON-785011349 tempest-KeyPairsNegativeTestJSON-785011349-project] HTTP exception thrown: Key pair 'tempest-keypair-1559641496' already exists. Oct 27 03:28:48.628066 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9f7a7d60-38c9-49ae-b26c-53b9be802366 tempest-KeyPairsNegativeTestJSON-785011349 tempest-KeyPairsNegativeTestJSON-785011349-project] Request method failure captured: Oct 27 03:28:48.628066 n-d-862769-1 devstack@n-api.service[121001]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 27 03:28:48.628066 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:28:48.628066 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:28:48.628066 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:28:48.628066 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 273 Oct 27 03:28:48.628066 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:28:48.628066 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:28:48.628066 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:28:48.628066 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:28:48.628066 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfrsKdLjc7w_hkfuxkTQAO0QUXuHQlYbncJzfUQA4OwHBBnhbkaNNsRmi93B67-KNb-RXWDHDVxekcDpZXQ88y-cBlihLpdjy86vLJzrYB3QCo4geob333E17exNNf0qHgNADSb2lSxiULZZbC7BvcOtfoF9u1g_4FAulhQWSJn_p5E Oct 27 03:28:48.628066 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:28:48.628066 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:28:48.628066 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:28:48.628066 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:28:48.628066 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:28:48.628066 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:28:48.628066 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 9aedac4560a949d496d6c36006b387c6 Oct 27 03:28:48.628066 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-785011349 Oct 27 03:28:48.628066 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:28:48.628066 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:28:48.628066 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9aedac4560a949d496d6c36006b387c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9aedac4560a949d496d6c36006b387c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9aedac4560a949d496d6c36006b387c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9aedac4560a949d496d6c36006b387c6"}]}] Oct 27 03:28:48.628066 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-KeyPairsNegativeTestJSON-785011349 Oct 27 03:28:48.628066 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 9aedac4560a949d496d6c36006b387c6 Oct 27 03:28:48.628066 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-785011349 Oct 27 03:28:48.628066 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-KeyPairsNegativeTestJSON-785011349-project Oct 27 03:28:48.628066 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:28:48.628066 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:28:48.628066 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: aba6e49374474d17b5e63709eb5fbb7b Oct 27 03:28:48.628066 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-KeyPairsNegativeTestJSON-785011349-project Oct 27 03:28:48.628066 n-d-862769-1 devstack@n-api.service[121001]: Oct 27 03:28:48.628066 n-d-862769-1 devstack@n-api.service[121001]: {"keypair": {"name": "tempest-keypair-1559641496", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNT2ljIZsIN762i3VyxQb9A0Vv3Z92ZtRbWTJoeza4W6gphwKatq5I/oHmVsS6JOqWfqFdzoQTkhL+AfEpIBeS42QJ2EfMHu31RElmNMzMRcPRq44w2bfAmkbJz2eV3QyQ=="}} Oct 27 03:28:48.628066 n-d-862769-1 devstack@n-api.service[121001]: method: Oct 27 03:28:48.628066 n-d-862769-1 devstack@n-api.service[121001]: exception: Key pair 'tempest-keypair-1559641496' already exists. Oct 27 03:28:48.628066 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-1559641496', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNT2ljIZsIN762i3VyxQb9A0Vv3Z92ZtRbWTJoeza4W6gphwKatq5I/oHmVsS6JOqWfqFdzoQTkhL+AfEpIBeS42QJ2EfMHu31RElmNMzMRcPRq44w2bfAmkbJz2eV3QyQ=='}}} Oct 27 03:28:48.628066 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:28:48.628066 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:28:48.628066 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 27 03:28:48.628066 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 27 03:28:48.628066 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 27 03:28:48.628066 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 27 03:28:48.628066 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 27 03:28:48.628066 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 27 03:28:48.628066 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 27 03:28:48.628066 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 27 03:28:48.628066 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 27 03:28:48.628066 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 27 03:28:48.628066 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 27 03:28:48.628066 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi result.read() Oct 27 03:28:48.628066 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 27 03:28:48.628066 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 27 03:28:48.628066 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 27 03:28:48.628066 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 27 03:28:48.628066 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 27 03:28:48.628066 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 27 03:28:48.628066 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 27 03:28:48.628066 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 27 03:28:48.628066 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'aba6e49374474d17b5e63709eb5fbb7b-tempest-keypair-1559641496' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 27 03:28:48.628066 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:28:48.633003 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 27 03:28:48.633003 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:28:48.633003 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:28:48.633003 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Oct 27 03:28:48.633003 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi kp.save(context.session) Oct 27 03:28:48.633003 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 27 03:28:48.633003 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi session.flush() Oct 27 03:28:48.633003 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 27 03:28:48.633003 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 27 03:28:48.633003 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 27 03:28:48.633003 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 27 03:28:48.633003 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 27 03:28:48.633003 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 27 03:28:48.633003 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 27 03:28:48.633003 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception Oct 27 03:28:48.633003 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 27 03:28:48.633003 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 27 03:28:48.633003 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 27 03:28:48.633003 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 27 03:28:48.633003 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 27 03:28:48.633003 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 27 03:28:48.633003 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 27 03:28:48.633003 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 27 03:28:48.633003 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 27 03:28:48.633003 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 27 03:28:48.633003 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 27 03:28:48.633003 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 27 03:28:48.633003 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 27 03:28:48.633003 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 27 03:28:48.633003 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 27 03:28:48.633003 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 27 03:28:48.633003 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 27 03:28:48.633003 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 27 03:28:48.633003 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 27 03:28:48.633003 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 27 03:28:48.633003 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 27 03:28:48.633003 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception Oct 27 03:28:48.633003 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 27 03:28:48.633003 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 27 03:28:48.633003 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 27 03:28:48.633003 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 27 03:28:48.633003 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 27 03:28:48.633003 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 27 03:28:48.633003 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 27 03:28:48.633003 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 27 03:28:48.633003 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 27 03:28:48.633003 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 27 03:28:48.633003 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 27 03:28:48.633003 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi result.read() Oct 27 03:28:48.633003 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 27 03:28:48.633003 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 27 03:28:48.633003 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 27 03:28:48.633003 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 27 03:28:48.633003 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 27 03:28:48.633003 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 27 03:28:48.633003 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 27 03:28:48.637468 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 27 03:28:48.637468 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'aba6e49374474d17b5e63709eb5fbb7b-tempest-keypair-1559641496' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 27 03:28:48.637468 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Oct 27 03:28:48.637468 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 27, 3, 28, 48, 594244), 'updated_at': None, 'name': 'tempest-keypair-1559641496', 'user_id': 'aba6e49374474d17b5e63709eb5fbb7b', 'fingerprint': 'd2:70:79:66:66:35:1f:c8:46:6b:4c:a8:23:df:05:a3', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNT2ljIZsIN762i3VyxQb9A0Vv3Z92ZtRbWTJoeza4W6gphwKatq5I/oHmVsS6JOqWfqFdzoQTkhL+AfEpIBeS42QJ2EfMHu31RElmNMzMRcPRq44w2bfAmkbJz2eV3QyQ==', 'type': 'ssh'}] Oct 27 03:28:48.637468 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 27 03:28:48.637468 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:28:48.637468 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:28:48.637468 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:28:48.637468 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:28:48.637468 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 27 03:28:48.637468 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 27 03:28:48.637468 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 27 03:28:48.637468 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 27 03:28:48.637468 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 03:28:48.637468 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 03:28:48.637468 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 03:28:48.637468 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 03:28:48.637468 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 27 03:28:48.637468 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 27 03:28:48.637468 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Oct 27 03:28:48.637468 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi keypair.create() Oct 27 03:28:48.637468 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 27 03:28:48.637468 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 27 03:28:48.637468 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Oct 27 03:28:48.637468 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self._create() Oct 27 03:28:48.637468 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Oct 27 03:28:48.637468 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Oct 27 03:28:48.637468 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Oct 27 03:28:48.637468 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Oct 27 03:28:48.637468 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 03:28:48.637468 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 03:28:48.637468 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Oct 27 03:28:48.637468 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Oct 27 03:28:48.637468 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-1559641496' already exists. Oct 27 03:28:48.637468 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:28:48.637468 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:28:48.637468 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:28:48.637468 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:28:48.637468 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:28:48.637468 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:28:48.637468 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:28:48.637468 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:28:48.637468 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:28:48.637468 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:28:48.637468 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:28:48.637468 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:28:48.637468 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:28:48.637468 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:28:48.637468 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:28:48.637468 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:28:48.637468 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 27 03:28:48.637468 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 27 03:28:48.637468 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Oct 27 03:28:48.637468 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Oct 27 03:28:48.637468 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-1559641496' already exists. Oct 27 03:28:48.642915 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:28:48.642915 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:28:48.642915 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:28:48.642915 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:28:48.642915 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:28:48.642915 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:28:48.642915 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:28:48.642915 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:28:48.642915 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-1559641496' already exists. Oct 27 03:28:48.642915 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:28:48.642915 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9f7a7d60-38c9-49ae-b26c-53b9be802366 tempest-KeyPairsNegativeTestJSON-785011349 tempest-KeyPairsNegativeTestJSON-785011349-project] Returning 409 to user: Key pair 'tempest-keypair-1559641496' already exists. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:28:48.644505 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9f7a7d60-38c9-49ae-b26c-53b9be802366 tempest-KeyPairsNegativeTestJSON-785011349 tempest-KeyPairsNegativeTestJSON-785011349-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.091774 Oct 27 03:28:48.645295 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1042/2078] 10.222.0.20 () {60 vars in 1159 bytes} [Thu Oct 27 03:28:48 2022] POST /compute/v2.1/os-keypairs => generated 105 bytes in 98 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 27 03:28:48.661085 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1975bf37-4ab2-46ee-a342-6ea1a37a608d tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:48.661085 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1975bf37-4ab2-46ee-a342-6ea1a37a608d tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] [instance: 0fb1f450-692f-4979-a489-c13ab4106607] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:48.669644 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1975bf37-4ab2-46ee-a342-6ea1a37a608d tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:48.670186 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1975bf37-4ab2-46ee-a342-6ea1a37a608d tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:48.670637 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1975bf37-4ab2-46ee-a342-6ea1a37a608d tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:48.671345 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1975bf37-4ab2-46ee-a342-6ea1a37a608d tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:48.671800 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1975bf37-4ab2-46ee-a342-6ea1a37a608d tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:48.672239 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1975bf37-4ab2-46ee-a342-6ea1a37a608d tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:48.825913 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1975bf37-4ab2-46ee-a342-6ea1a37a608d tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b2717ace074a579d33c60964e6668a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3fc032a089f45efa4a66866a9c961c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:48.834729 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1975bf37-4ab2-46ee-a342-6ea1a37a608d tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] 10.222.0.20 "GET /compute/v2.1/servers/0fb1f450-692f-4979-a489-c13ab4106607" status: 200 len: 1714 microversion: 2.1 time: 0.183887 Oct 27 03:28:48.843486 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1043/2079] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:28:48 2022] GET /compute/v2.1/servers/0fb1f450-692f-4979-a489-c13ab4106607 => generated 1714 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:48.850134 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-cc8ee38e-33be-4d96-b45f-43154101f6a9 req-4d521c4d-f574-4d5a-a46d-e2e98083330b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3dd0fa3-e3b4-471c-b65b-0a190b7c4701", "tag": "3d125c26-92dc-4d95-bb25-7ab8a7e32c49"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:28:48.860052 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-cc8ee38e-33be-4d96-b45f-43154101f6a9 req-4d521c4d-f574-4d5a-a46d-e2e98083330b service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:48.860571 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-cc8ee38e-33be-4d96-b45f-43154101f6a9 req-4d521c4d-f574-4d5a-a46d-e2e98083330b service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:48.861191 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-cc8ee38e-33be-4d96-b45f-43154101f6a9 req-4d521c4d-f574-4d5a-a46d-e2e98083330b service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:48.873390 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-cc8ee38e-33be-4d96-b45f-43154101f6a9 req-4d521c4d-f574-4d5a-a46d-e2e98083330b service nova] Creating event network-changed:3d125c26-92dc-4d95-bb25-7ab8a7e32c49 for instance b3dd0fa3-e3b4-471c-b65b-0a190b7c4701 on n-h2-862769-1 Oct 27 03:28:48.878447 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-cc8ee38e-33be-4d96-b45f-43154101f6a9 req-4d521c4d-f574-4d5a-a46d-e2e98083330b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033476 Oct 27 03:28:48.879343 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1044/2080] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:28:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:28:48.884436 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b971fa66-1a7b-42ed-80c6-70058a4fe681 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:48.885140 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b971fa66-1a7b-42ed-80c6-70058a4fe681 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] [instance: 2aa6c062-32e4-453d-abb5-a51d96c66e2d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:48.892352 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b971fa66-1a7b-42ed-80c6-70058a4fe681 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:48.892922 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b971fa66-1a7b-42ed-80c6-70058a4fe681 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:48.893435 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b971fa66-1a7b-42ed-80c6-70058a4fe681 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:48.894776 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b971fa66-1a7b-42ed-80c6-70058a4fe681 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:48.895298 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b971fa66-1a7b-42ed-80c6-70058a4fe681 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:48.895892 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b971fa66-1a7b-42ed-80c6-70058a4fe681 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:48.928809 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0d2f1b63-853d-4b3a-a22c-2fed76816900 tempest-ImagesMetadataTestJSON-351418215 tempest-ImagesMetadataTestJSON-351418215-project] 10.222.0.20 "PUT /compute/v2.1/images/38c19ef0-970c-412a-a200-458c2c0f5310/metadata" status: 200 len: 61 microversion: 2.1 time: 0.441615 Oct 27 03:28:48.928809 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1037/2081] 10.222.0.20 () {60 vars in 1280 bytes} [Thu Oct 27 03:28:48 2022] PUT /compute/v2.1/images/38c19ef0-970c-412a-a200-458c2c0f5310/metadata => generated 61 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 03:28:48.935305 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-eab4d5bc-8990-48ba-8191-2a417b3cdfec tempest-KeyPairsNegativeTestJSON-785011349 tempest-KeyPairsNegativeTestJSON-785011349-project] Calling method '.version_select at 0x7f7ddec5cc10>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:49.027326 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-eab4d5bc-8990-48ba-8191-2a417b3cdfec tempest-KeyPairsNegativeTestJSON-785011349 tempest-KeyPairsNegativeTestJSON-785011349-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1559641496" status: 202 len: 0 microversion: 2.1 time: 0.099025 Oct 27 03:28:49.035353 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1038/2082] 10.222.0.20 () {58 vars in 1221 bytes} [Thu Oct 27 03:28:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1559641496 => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:28:49.041781 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b8cd2aaf-5646-4f70-83ee-75d1cbc6afe8 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:49.043203 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b8cd2aaf-5646-4f70-83ee-75d1cbc6afe8 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: 339287fc-37b6-455d-96ab-08ab8e2c3e68] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:49.050415 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b8cd2aaf-5646-4f70-83ee-75d1cbc6afe8 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:49.050917 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b8cd2aaf-5646-4f70-83ee-75d1cbc6afe8 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:49.051826 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b8cd2aaf-5646-4f70-83ee-75d1cbc6afe8 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:49.052725 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b8cd2aaf-5646-4f70-83ee-75d1cbc6afe8 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:49.053396 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b8cd2aaf-5646-4f70-83ee-75d1cbc6afe8 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:49.054659 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b8cd2aaf-5646-4f70-83ee-75d1cbc6afe8 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:49.068179 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b971fa66-1a7b-42ed-80c6-70058a4fe681 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '071401bed74d48fe8ae2dbdb98aa81cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b0b534b9eb463aab0f13e838578da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:49.076074 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b971fa66-1a7b-42ed-80c6-70058a4fe681 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] 10.222.0.20 "GET /compute/v2.1/servers/2aa6c062-32e4-453d-abb5-a51d96c66e2d" status: 200 len: 1322 microversion: 2.1 time: 0.195476 Oct 27 03:28:49.077652 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1045/2083] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:28:48 2022] GET /compute/v2.1/servers/2aa6c062-32e4-453d-abb5-a51d96c66e2d => generated 1322 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:49.097868 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4891d580-a4b8-4180-85eb-dde47bf83912 tempest-ImagesMetadataTestJSON-351418215 tempest-ImagesMetadataTestJSON-351418215-project] Action: 'create', calling method: .version_select at 0x7f7dded484c0>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:28:49.230582 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-4891d580-a4b8-4180-85eb-dde47bf83912 tempest-ImagesMetadataTestJSON-351418215 tempest-ImagesMetadataTestJSON-351418215-project] Getting quotas for project 82cc9f48070a442db552098a12c0705e. Resources: dict_keys(['metadata_items']) {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:28:49.248542 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-4891d580-a4b8-4180-85eb-dde47bf83912 tempest-ImagesMetadataTestJSON-351418215 tempest-ImagesMetadataTestJSON-351418215-project] Getting quotas for user 790b3cd664d74806bf52d6360ac7763f and project 82cc9f48070a442db552098a12c0705e. Resources: dict_keys(['metadata_items']) {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:28:49.514635 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b8cd2aaf-5646-4f70-83ee-75d1cbc6afe8 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13e05e253c94aadb1c089128ff35be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8510a519f14deea6f35a437419e161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:49.527322 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b8cd2aaf-5646-4f70-83ee-75d1cbc6afe8 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68" status: 200 len: 1471 microversion: 2.1 time: 0.490257 Oct 27 03:28:49.529528 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1039/2084] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:28:49 2022] GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68 => generated 1471 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:49.564295 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2bcf58c7-8965-4890-9837-71ee25aa851a tempest-KeyPairsNegativeTestJSON-785011349 tempest-KeyPairsNegativeTestJSON-785011349-project] Action: 'create', calling method: .version_select at 0x7f7ddee065e0>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMTHj26FhqCsWs81yeSKZv38skB+mmhpoAWfESYeib4t0WKJwcn2rIYmNgFGod26MMsaWr0CPizgAMkQjgJpKaD8ue3hINkCDDQe5TafW7sVHZjO+4mO/uDdg2q8wUzTbA=="}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:28:49.579766 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2bcf58c7-8965-4890-9837-71ee25aa851a tempest-KeyPairsNegativeTestJSON-785011349 tempest-KeyPairsNegativeTestJSON-785011349-project] Request method failure captured: Oct 27 03:28:49.579766 n-d-862769-1 devstack@n-api.service[121000]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 27 03:28:49.579766 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:28:49.579766 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:28:49.579766 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:28:49.579766 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 247 Oct 27 03:28:49.579766 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:28:49.579766 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:28:49.579766 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:28:49.579766 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:28:49.579766 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfrsKdLjc7w_hkfuxkTQAO0QUXuHQlYbncJzfUQA4OwHBBnhbkaNNsRmi93B67-KNb-RXWDHDVxekcDpZXQ88y-cBlihLpdjy86vLJzrYB3QCo4geob333E17exNNf0qHgNADSb2lSxiULZZbC7BvcOtfoF9u1g_4FAulhQWSJn_p5E Oct 27 03:28:49.579766 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:28:49.579766 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:28:49.579766 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:28:49.579766 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:28:49.579766 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:28:49.579766 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:28:49.579766 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 9aedac4560a949d496d6c36006b387c6 Oct 27 03:28:49.579766 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-785011349 Oct 27 03:28:49.579766 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:28:49.579766 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:28:49.579766 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9aedac4560a949d496d6c36006b387c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9aedac4560a949d496d6c36006b387c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9aedac4560a949d496d6c36006b387c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9aedac4560a949d496d6c36006b387c6"}]}] Oct 27 03:28:49.579766 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-KeyPairsNegativeTestJSON-785011349 Oct 27 03:28:49.579766 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 9aedac4560a949d496d6c36006b387c6 Oct 27 03:28:49.579766 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-785011349 Oct 27 03:28:49.579766 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-KeyPairsNegativeTestJSON-785011349-project Oct 27 03:28:49.579766 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:28:49.579766 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:28:49.579766 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: aba6e49374474d17b5e63709eb5fbb7b Oct 27 03:28:49.579766 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-KeyPairsNegativeTestJSON-785011349-project Oct 27 03:28:49.579766 n-d-862769-1 devstack@n-api.service[121000]: Oct 27 03:28:49.579766 n-d-862769-1 devstack@n-api.service[121000]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMTHj26FhqCsWs81yeSKZv38skB+mmhpoAWfESYeib4t0WKJwcn2rIYmNgFGod26MMsaWr0CPizgAMkQjgJpKaD8ue3hINkCDDQe5TafW7sVHZjO+4mO/uDdg2q8wUzTbA=="}} Oct 27 03:28:49.579766 n-d-862769-1 devstack@n-api.service[121000]: method: Oct 27 03:28:49.579766 n-d-862769-1 devstack@n-api.service[121000]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 27 03:28:49.579766 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMTHj26FhqCsWs81yeSKZv38skB+mmhpoAWfESYeib4t0WKJwcn2rIYmNgFGod26MMsaWr0CPizgAMkQjgJpKaD8ue3hINkCDDQe5TafW7sVHZjO+4mO/uDdg2q8wUzTbA=='}}} Oct 27 03:28:49.579766 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:28:49.579766 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:28:49.579766 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 03:28:49.579766 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 03:28:49.579766 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 03:28:49.579766 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise error Oct 27 03:28:49.579766 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 27 03:28:49.579766 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:28:49.579766 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 27 03:28:49.579766 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 27 03:28:49.579766 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:28:49.579766 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 27 03:28:49.579766 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi '' Oct 27 03:28:49.579766 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:28:49.579766 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:28:49.579766 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:28:49.579766 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:28:49.579766 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:28:49.579766 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:28:49.579766 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:28:49.579766 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:28:49.579766 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:28:49.579766 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:28:49.579766 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:28:49.579766 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:28:49.579766 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:28:49.579766 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:28:49.579766 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 03:28:49.579766 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 03:28:49.586914 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 03:28:49.586914 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 03:28:49.586914 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 03:28:49.586914 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 03:28:49.586914 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 27 03:28:49.586914 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:28:49.586914 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:28:49.586914 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:28:49.586914 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:28:49.586914 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:28:49.586914 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:28:49.586914 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 03:28:49.586914 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 03:28:49.586914 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 27 03:28:49.586914 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:28:49.586914 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2bcf58c7-8965-4890-9837-71ee25aa851a tempest-KeyPairsNegativeTestJSON-785011349 tempest-KeyPairsNegativeTestJSON-785011349-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:28:49.589159 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2bcf58c7-8965-4890-9837-71ee25aa851a tempest-KeyPairsNegativeTestJSON-785011349 tempest-KeyPairsNegativeTestJSON-785011349-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.054417 Oct 27 03:28:49.589159 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1040/2085] 10.222.0.20 () {60 vars in 1159 bytes} [Thu Oct 27 03:28:49 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 59 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 03:28:49.600220 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e6149f07-378f-4e36-afe4-20ad960fde21 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:49.608361 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e6149f07-378f-4e36-afe4-20ad960fde21 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: a8925d29-d9e0-4dbb-a73d-09473255fa34] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:49.632445 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e6149f07-378f-4e36-afe4-20ad960fde21 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:49.632445 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e6149f07-378f-4e36-afe4-20ad960fde21 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:49.632445 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e6149f07-378f-4e36-afe4-20ad960fde21 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:49.632445 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e6149f07-378f-4e36-afe4-20ad960fde21 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:49.654652 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e6149f07-378f-4e36-afe4-20ad960fde21 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:49.655206 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e6149f07-378f-4e36-afe4-20ad960fde21 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:50.004150 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4891d580-a4b8-4180-85eb-dde47bf83912 tempest-ImagesMetadataTestJSON-351418215 tempest-ImagesMetadataTestJSON-351418215-project] 10.222.0.20 "POST /compute/v2.1/images/38c19ef0-970c-412a-a200-458c2c0f5310/metadata" status: 200 len: 85 microversion: 2.1 time: 0.908808 Oct 27 03:28:50.006334 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1046/2086] 10.222.0.20 () {60 vars in 1281 bytes} [Thu Oct 27 03:28:49 2022] POST /compute/v2.1/images/38c19ef0-970c-412a-a200-458c2c0f5310/metadata => generated 85 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 03:28:50.030824 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1b619665-1bc8-44ad-b402-1cef570fa5c3 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:50.031620 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1b619665-1bc8-44ad-b402-1cef570fa5c3 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: d5e6f604-9466-45c6-86a8-885cfb393223] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:50.058667 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1b619665-1bc8-44ad-b402-1cef570fa5c3 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:50.059469 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1b619665-1bc8-44ad-b402-1cef570fa5c3 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:50.060313 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1b619665-1bc8-44ad-b402-1cef570fa5c3 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:50.061838 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1b619665-1bc8-44ad-b402-1cef570fa5c3 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:50.062528 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1b619665-1bc8-44ad-b402-1cef570fa5c3 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:50.063140 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1b619665-1bc8-44ad-b402-1cef570fa5c3 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:50.069058 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e6149f07-378f-4e36-afe4-20ad960fde21 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:50.081919 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e6149f07-378f-4e36-afe4-20ad960fde21 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34" status: 200 len: 1199 microversion: 2.1 time: 0.491568 Oct 27 03:28:50.082822 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1041/2087] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:28:49 2022] GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34 => generated 1199 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:50.098838 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-56f4e83b-5fba-4883-86c9-e8ad9d3a9ae0 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:50.100533 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-56f4e83b-5fba-4883-86c9-e8ad9d3a9ae0 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 1352bd75-bfe6-48e3-a47d-314c7f13f692] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:50.118573 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-56f4e83b-5fba-4883-86c9-e8ad9d3a9ae0 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:50.123157 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-56f4e83b-5fba-4883-86c9-e8ad9d3a9ae0 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:50.123870 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-56f4e83b-5fba-4883-86c9-e8ad9d3a9ae0 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:50.124809 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-56f4e83b-5fba-4883-86c9-e8ad9d3a9ae0 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:50.125778 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-56f4e83b-5fba-4883-86c9-e8ad9d3a9ae0 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:50.127175 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-56f4e83b-5fba-4883-86c9-e8ad9d3a9ae0 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:50.381756 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1b619665-1bc8-44ad-b402-1cef570fa5c3 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:50.395589 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1b619665-1bc8-44ad-b402-1cef570fa5c3 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:50.397443 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1b619665-1bc8-44ad-b402-1cef570fa5c3 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:50.398915 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1b619665-1bc8-44ad-b402-1cef570fa5c3 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223" status: 200 len: 1281 microversion: 2.25 time: 0.387160 Oct 27 03:28:50.400072 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1047/2088] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:28:50 2022] GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223 => generated 1281 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:28:50.406408 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1e5b22d6-7a42-474f-bac9-aeda308c7a4c tempest-KeyPairsNegativeTestJSON-785011349 tempest-KeyPairsNegativeTestJSON-785011349-project] Action: 'create', calling method: .version_select at 0x7f7dded2ce50>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-982840584", "public_key": " "}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:28:50.433409 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-1e5b22d6-7a42-474f-bac9-aeda308c7a4c tempest-KeyPairsNegativeTestJSON-785011349 tempest-KeyPairsNegativeTestJSON-785011349-project] Getting quotas for project 9aedac4560a949d496d6c36006b387c6. Resources: {'key_pairs'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:28:50.440220 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-1e5b22d6-7a42-474f-bac9-aeda308c7a4c tempest-KeyPairsNegativeTestJSON-785011349 tempest-KeyPairsNegativeTestJSON-785011349-project] Getting quotas for user aba6e49374474d17b5e63709eb5fbb7b and project 9aedac4560a949d496d6c36006b387c6. Resources: {'key_pairs'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:28:50.508205 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-1e5b22d6-7a42-474f-bac9-aeda308c7a4c tempest-KeyPairsNegativeTestJSON-785011349 tempest-KeyPairsNegativeTestJSON-785011349-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 27 03:28:50.510847 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1e5b22d6-7a42-474f-bac9-aeda308c7a4c tempest-KeyPairsNegativeTestJSON-785011349 tempest-KeyPairsNegativeTestJSON-785011349-project] Request method failure captured: Oct 27 03:28:50.510847 n-d-862769-1 devstack@n-api.service[121001]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 27 03:28:50.510847 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:28:50.510847 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:28:50.510847 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:28:50.510847 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 94 Oct 27 03:28:50.510847 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:28:50.510847 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:28:50.510847 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:28:50.510847 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:28:50.510847 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfrsKdLjc7w_hkfuxkTQAO0QUXuHQlYbncJzfUQA4OwHBBnhbkaNNsRmi93B67-KNb-RXWDHDVxekcDpZXQ88y-cBlihLpdjy86vLJzrYB3QCo4geob333E17exNNf0qHgNADSb2lSxiULZZbC7BvcOtfoF9u1g_4FAulhQWSJn_p5E Oct 27 03:28:50.510847 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:28:50.510847 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:28:50.510847 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:28:50.510847 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:28:50.510847 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:28:50.510847 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:28:50.510847 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 9aedac4560a949d496d6c36006b387c6 Oct 27 03:28:50.510847 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-785011349 Oct 27 03:28:50.510847 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:28:50.510847 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:28:50.510847 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9aedac4560a949d496d6c36006b387c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9aedac4560a949d496d6c36006b387c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9aedac4560a949d496d6c36006b387c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9aedac4560a949d496d6c36006b387c6"}]}] Oct 27 03:28:50.510847 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-KeyPairsNegativeTestJSON-785011349 Oct 27 03:28:50.510847 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 9aedac4560a949d496d6c36006b387c6 Oct 27 03:28:50.510847 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-785011349 Oct 27 03:28:50.510847 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-KeyPairsNegativeTestJSON-785011349-project Oct 27 03:28:50.510847 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:28:50.510847 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:28:50.510847 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: aba6e49374474d17b5e63709eb5fbb7b Oct 27 03:28:50.510847 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-KeyPairsNegativeTestJSON-785011349-project Oct 27 03:28:50.510847 n-d-862769-1 devstack@n-api.service[121001]: Oct 27 03:28:50.510847 n-d-862769-1 devstack@n-api.service[121001]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-982840584", "public_key": " "}} Oct 27 03:28:50.510847 n-d-862769-1 devstack@n-api.service[121001]: method: Oct 27 03:28:50.510847 n-d-862769-1 devstack@n-api.service[121001]: exception: Keypair data is invalid: failed to generate fingerprint Oct 27 03:28:50.510847 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-982840584', 'public_key': ' '}}} Oct 27 03:28:50.510847 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:28:50.510847 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:28:50.510847 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 27 03:28:50.510847 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 27 03:28:50.510847 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Oct 27 03:28:50.510847 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Oct 27 03:28:50.510847 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Oct 27 03:28:50.510847 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:28:50.510847 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:28:50.510847 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:28:50.510847 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:28:50.510847 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 27 03:28:50.510847 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 27 03:28:50.510847 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 27 03:28:50.510847 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 27 03:28:50.510847 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 03:28:50.510847 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 03:28:50.510847 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 03:28:50.510847 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 03:28:50.510847 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 27 03:28:50.510847 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 27 03:28:50.510847 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 27 03:28:50.510847 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 27 03:28:50.510847 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 27 03:28:50.510847 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 27 03:28:50.510847 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 27 03:28:50.510847 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 27 03:28:50.510847 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 27 03:28:50.510847 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:28:50.510847 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:28:50.510847 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:28:50.515629 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:28:50.515629 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:28:50.515629 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:28:50.515629 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:28:50.515629 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:28:50.515629 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:28:50.515629 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:28:50.515629 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:28:50.515629 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:28:50.515629 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:28:50.515629 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:28:50.515629 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:28:50.515629 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:28:50.515629 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 27 03:28:50.515629 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 27 03:28:50.515629 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 27 03:28:50.515629 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 27 03:28:50.515629 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 27 03:28:50.515629 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:28:50.515629 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:28:50.515629 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:28:50.515629 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:28:50.515629 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:28:50.515629 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:28:50.515629 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:28:50.515629 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:28:50.515629 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 27 03:28:50.515629 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:28:50.515629 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1e5b22d6-7a42-474f-bac9-aeda308c7a4c tempest-KeyPairsNegativeTestJSON-785011349 tempest-KeyPairsNegativeTestJSON-785011349-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:28:50.515629 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1e5b22d6-7a42-474f-bac9-aeda308c7a4c tempest-KeyPairsNegativeTestJSON-785011349 tempest-KeyPairsNegativeTestJSON-785011349-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.111065 Oct 27 03:28:50.517701 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1048/2089] 10.222.0.20 () {60 vars in 1158 bytes} [Thu Oct 27 03:28:50 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 116 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 27 03:28:50.525069 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-1c971074-3cc5-4783-94c5-185cbc65c684 req-14b27d00-dc6b-4cfe-90c0-60352172e751 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a89c8f12-2492-4a0f-8887-acd62e510fd9", "name": "network-vif-plugged", "status": "completed", "tag": "b726525d-fb99-4f78-925e-57e948366880"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:28:50.546011 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-1c971074-3cc5-4783-94c5-185cbc65c684 req-14b27d00-dc6b-4cfe-90c0-60352172e751 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:50.546560 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-1c971074-3cc5-4783-94c5-185cbc65c684 req-14b27d00-dc6b-4cfe-90c0-60352172e751 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:50.547009 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-1c971074-3cc5-4783-94c5-185cbc65c684 req-14b27d00-dc6b-4cfe-90c0-60352172e751 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:50.560692 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-1c971074-3cc5-4783-94c5-185cbc65c684 req-14b27d00-dc6b-4cfe-90c0-60352172e751 service nova] Creating event network-vif-plugged:b726525d-fb99-4f78-925e-57e948366880 for instance a89c8f12-2492-4a0f-8887-acd62e510fd9 on n-h1-862769-1 Oct 27 03:28:50.566817 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-1c971074-3cc5-4783-94c5-185cbc65c684 req-14b27d00-dc6b-4cfe-90c0-60352172e751 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047193 Oct 27 03:28:50.567597 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1049/2090] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:28:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:28:50.573034 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-cb37d4d3-f9e1-48b0-a9f4-88c318abad2c tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:50.573541 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-cb37d4d3-f9e1-48b0-a9f4-88c318abad2c tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] [instance: 0fb1f450-692f-4979-a489-c13ab4106607] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:50.580237 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cb37d4d3-f9e1-48b0-a9f4-88c318abad2c tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:50.580998 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cb37d4d3-f9e1-48b0-a9f4-88c318abad2c tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:50.581673 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cb37d4d3-f9e1-48b0-a9f4-88c318abad2c tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:50.582610 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cb37d4d3-f9e1-48b0-a9f4-88c318abad2c tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:50.583249 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cb37d4d3-f9e1-48b0-a9f4-88c318abad2c tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:50.584076 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cb37d4d3-f9e1-48b0-a9f4-88c318abad2c tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:51.014818 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-cb37d4d3-f9e1-48b0-a9f4-88c318abad2c tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b2717ace074a579d33c60964e6668a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3fc032a089f45efa4a66866a9c961c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:51.028933 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-cb37d4d3-f9e1-48b0-a9f4-88c318abad2c tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] 10.222.0.20 "GET /compute/v2.1/servers/0fb1f450-692f-4979-a489-c13ab4106607" status: 200 len: 1714 microversion: 2.1 time: 0.460047 Oct 27 03:28:51.032146 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1050/2091] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:28:50 2022] GET /compute/v2.1/servers/0fb1f450-692f-4979-a489-c13ab4106607 => generated 1714 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:51.035451 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e8470f5b-adb7-4b65-861f-d336eac6d4fb tempest-ImagesMetadataTestJSON-351418215 tempest-ImagesMetadataTestJSON-351418215-project] Calling method '.version_select at 0x7f7dded91670>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:51.088381 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e8470f5b-adb7-4b65-861f-d336eac6d4fb tempest-ImagesMetadataTestJSON-351418215 tempest-ImagesMetadataTestJSON-351418215-project] 10.222.0.20 "GET /compute/v2.1/images/38c19ef0-970c-412a-a200-458c2c0f5310/metadata" status: 200 len: 85 microversion: 2.1 time: 0.057672 Oct 27 03:28:51.099124 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1051/2092] 10.222.0.20 () {58 vars in 1260 bytes} [Thu Oct 27 03:28:51 2022] GET /compute/v2.1/images/38c19ef0-970c-412a-a200-458c2c0f5310/metadata => generated 85 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 03:28:51.108306 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-04e24f65-3eb5-4fc9-80d6-09372fd51e5e tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:51.109542 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-04e24f65-3eb5-4fc9-80d6-09372fd51e5e tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] [instance: 2aa6c062-32e4-453d-abb5-a51d96c66e2d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:51.116383 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-04e24f65-3eb5-4fc9-80d6-09372fd51e5e tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:51.121499 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-04e24f65-3eb5-4fc9-80d6-09372fd51e5e tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:51.121499 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-04e24f65-3eb5-4fc9-80d6-09372fd51e5e tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:51.121499 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-04e24f65-3eb5-4fc9-80d6-09372fd51e5e tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:51.121499 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-04e24f65-3eb5-4fc9-80d6-09372fd51e5e tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:51.121499 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-04e24f65-3eb5-4fc9-80d6-09372fd51e5e tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:51.413910 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-04e24f65-3eb5-4fc9-80d6-09372fd51e5e tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '071401bed74d48fe8ae2dbdb98aa81cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b0b534b9eb463aab0f13e838578da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:51.428179 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-04e24f65-3eb5-4fc9-80d6-09372fd51e5e tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] 10.222.0.20 "GET /compute/v2.1/servers/2aa6c062-32e4-453d-abb5-a51d96c66e2d" status: 200 len: 1322 microversion: 2.1 time: 0.325813 Oct 27 03:28:51.429662 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1052/2093] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:28:51 2022] GET /compute/v2.1/servers/2aa6c062-32e4-453d-abb5-a51d96c66e2d => generated 1322 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:51.436827 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-cd62ae3c-c330-49cd-acf6-b06ce4dd6f08 tempest-KeyPairsNegativeTestJSON-785011349 tempest-KeyPairsNegativeTestJSON-785011349-project] Action: 'create', calling method: .version_select at 0x7f7dded2cdc0>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAyXS5I4x79tbyqKzF2BnFF3eHkz8Tx68HLYv5DloilUxVnufiy6QoQS29JJU3FOByxnhv3fwoDCMz41s3MpRHpQ1Onnj8NGL0nECOEXr480Tw4AL276jsNBlNi807pBaA=="}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:28:51.441746 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-cd62ae3c-c330-49cd-acf6-b06ce4dd6f08 tempest-KeyPairsNegativeTestJSON-785011349 tempest-KeyPairsNegativeTestJSON-785011349-project] Request method failure captured: Oct 27 03:28:51.441746 n-d-862769-1 devstack@n-api.service[121001]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 27 03:28:51.441746 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:28:51.441746 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:28:51.441746 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:28:51.441746 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 507 Oct 27 03:28:51.441746 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:28:51.441746 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:28:51.441746 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:28:51.441746 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:28:51.441746 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfrsKdLjc7w_hkfuxkTQAO0QUXuHQlYbncJzfUQA4OwHBBnhbkaNNsRmi93B67-KNb-RXWDHDVxekcDpZXQ88y-cBlihLpdjy86vLJzrYB3QCo4geob333E17exNNf0qHgNADSb2lSxiULZZbC7BvcOtfoF9u1g_4FAulhQWSJn_p5E Oct 27 03:28:51.441746 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:28:51.441746 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:28:51.441746 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:28:51.441746 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:28:51.441746 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:28:51.441746 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:28:51.441746 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 9aedac4560a949d496d6c36006b387c6 Oct 27 03:28:51.441746 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-785011349 Oct 27 03:28:51.441746 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:28:51.441746 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:28:51.441746 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9aedac4560a949d496d6c36006b387c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9aedac4560a949d496d6c36006b387c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9aedac4560a949d496d6c36006b387c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9aedac4560a949d496d6c36006b387c6"}]}] Oct 27 03:28:51.441746 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-KeyPairsNegativeTestJSON-785011349 Oct 27 03:28:51.441746 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 9aedac4560a949d496d6c36006b387c6 Oct 27 03:28:51.441746 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-785011349 Oct 27 03:28:51.441746 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-KeyPairsNegativeTestJSON-785011349-project Oct 27 03:28:51.441746 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:28:51.441746 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:28:51.441746 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: aba6e49374474d17b5e63709eb5fbb7b Oct 27 03:28:51.441746 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-KeyPairsNegativeTestJSON-785011349-project Oct 27 03:28:51.441746 n-d-862769-1 devstack@n-api.service[121001]: Oct 27 03:28:51.441746 n-d-862769-1 devstack@n-api.service[121001]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAyXS5I4x79tbyqKzF2BnFF3eHkz8Tx68HLYv5DloilUxVnufiy6QoQS29JJU3FOByxnhv3fwoDCMz41s3MpRHpQ1Onnj8NGL0nECOEXr480Tw4AL276jsNBlNi807pBaA=="}} Oct 27 03:28:51.441746 n-d-862769-1 devstack@n-api.service[121001]: method: Oct 27 03:28:51.441746 n-d-862769-1 devstack@n-api.service[121001]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 27 03:28:51.441746 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAyXS5I4x79tbyqKzF2BnFF3eHkz8Tx68HLYv5DloilUxVnufiy6QoQS29JJU3FOByxnhv3fwoDCMz41s3MpRHpQ1Onnj8NGL0nECOEXr480Tw4AL276jsNBlNi807pBaA=='}}} Oct 27 03:28:51.441746 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:28:51.441746 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:28:51.441746 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 03:28:51.441746 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 03:28:51.441746 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 03:28:51.441746 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise error Oct 27 03:28:51.441746 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 27 03:28:51.441746 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:28:51.441746 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 27 03:28:51.441746 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 27 03:28:51.441746 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:28:51.441746 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 27 03:28:51.441746 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Oct 27 03:28:51.445698 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:28:51.445698 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:28:51.445698 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:28:51.445698 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:28:51.445698 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:28:51.445698 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:28:51.445698 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:28:51.445698 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:28:51.445698 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:28:51.445698 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:28:51.445698 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:28:51.445698 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:28:51.445698 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:28:51.445698 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:28:51.445698 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 03:28:51.445698 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 03:28:51.445698 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 03:28:51.445698 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 03:28:51.445698 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 03:28:51.445698 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 03:28:51.445698 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 27 03:28:51.445698 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:28:51.445698 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:28:51.445698 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:28:51.445698 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:28:51.445698 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:28:51.445698 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:28:51.445698 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 03:28:51.445698 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 03:28:51.445698 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 27 03:28:51.445698 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:28:51.459342 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-cd62ae3c-c330-49cd-acf6-b06ce4dd6f08 tempest-KeyPairsNegativeTestJSON-785011349 tempest-KeyPairsNegativeTestJSON-785011349-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:28:51.459342 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-cd62ae3c-c330-49cd-acf6-b06ce4dd6f08 tempest-KeyPairsNegativeTestJSON-785011349 tempest-KeyPairsNegativeTestJSON-785011349-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.021028 Oct 27 03:28:51.459342 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1053/2094] 10.222.0.20 () {60 vars in 1159 bytes} [Thu Oct 27 03:28:51 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 03:28:51.463510 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5867094a-28c1-4fc0-b77c-d35015ad27b5 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:51.465072 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5867094a-28c1-4fc0-b77c-d35015ad27b5 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: 339287fc-37b6-455d-96ab-08ab8e2c3e68] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:51.474743 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5867094a-28c1-4fc0-b77c-d35015ad27b5 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:51.475632 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5867094a-28c1-4fc0-b77c-d35015ad27b5 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:51.476640 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5867094a-28c1-4fc0-b77c-d35015ad27b5 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:51.477612 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5867094a-28c1-4fc0-b77c-d35015ad27b5 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:51.478335 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5867094a-28c1-4fc0-b77c-d35015ad27b5 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:51.479109 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5867094a-28c1-4fc0-b77c-d35015ad27b5 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:51.565318 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=24 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:28:51.624990 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-56f4e83b-5fba-4883-86c9-e8ad9d3a9ae0 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:51.651469 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-56f4e83b-5fba-4883-86c9-e8ad9d3a9ae0 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/1352bd75-bfe6-48e3-a47d-314c7f13f692" status: 200 len: 1307 microversion: 2.1 time: 1.565286 Oct 27 03:28:51.658313 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1042/2095] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:28:50 2022] GET /compute/v2.1/servers/1352bd75-bfe6-48e3-a47d-314c7f13f692 => generated 1307 bytes in 1573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:51.681779 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-8ad6e5d4-7f43-4e79-a1a7-c51706d64261 req-678901df-b2fa-415c-a18d-dedcc6f84ac7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1352bd75-bfe6-48e3-a47d-314c7f13f692", "tag": "8ca76995-7735-4198-800f-a31ff3fd6a13"}, {"name": "network-changed", "server_uuid": "2aa6c062-32e4-453d-abb5-a51d96c66e2d", "tag": "af0e4888-29de-4d33-a94c-e1100b227c29"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:28:51.684256 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5867094a-28c1-4fc0-b77c-d35015ad27b5 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13e05e253c94aadb1c089128ff35be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8510a519f14deea6f35a437419e161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:51.699185 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-8ad6e5d4-7f43-4e79-a1a7-c51706d64261 req-678901df-b2fa-415c-a18d-dedcc6f84ac7 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:51.699903 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-8ad6e5d4-7f43-4e79-a1a7-c51706d64261 req-678901df-b2fa-415c-a18d-dedcc6f84ac7 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:51.700555 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-8ad6e5d4-7f43-4e79-a1a7-c51706d64261 req-678901df-b2fa-415c-a18d-dedcc6f84ac7 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:51.710229 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5867094a-28c1-4fc0-b77c-d35015ad27b5 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68" status: 200 len: 1471 microversion: 2.1 time: 0.255060 Oct 27 03:28:51.718535 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1054/2096] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:28:51 2022] GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68 => generated 1471 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:51.726196 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-768ff682-cd91-4dc9-8a36-d6215bf62f0d tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:51.727281 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-768ff682-cd91-4dc9-8a36-d6215bf62f0d tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: a8925d29-d9e0-4dbb-a73d-09473255fa34] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:51.735606 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-8ad6e5d4-7f43-4e79-a1a7-c51706d64261 req-678901df-b2fa-415c-a18d-dedcc6f84ac7 service nova] Creating event network-changed:8ca76995-7735-4198-800f-a31ff3fd6a13 for instance 1352bd75-bfe6-48e3-a47d-314c7f13f692 on n-h2-862769-1 Oct 27 03:28:51.737303 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-8ad6e5d4-7f43-4e79-a1a7-c51706d64261 req-678901df-b2fa-415c-a18d-dedcc6f84ac7 service nova] Creating event network-changed:af0e4888-29de-4d33-a94c-e1100b227c29 for instance 2aa6c062-32e4-453d-abb5-a51d96c66e2d on n-h1-862769-1 Oct 27 03:28:51.755882 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-768ff682-cd91-4dc9-8a36-d6215bf62f0d tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:51.757551 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-8ad6e5d4-7f43-4e79-a1a7-c51706d64261 req-678901df-b2fa-415c-a18d-dedcc6f84ac7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.081510 Oct 27 03:28:51.759447 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1043/2097] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:28:51 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:28:51.760566 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-768ff682-cd91-4dc9-8a36-d6215bf62f0d tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:51.761125 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-768ff682-cd91-4dc9-8a36-d6215bf62f0d tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:51.761860 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-768ff682-cd91-4dc9-8a36-d6215bf62f0d tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:51.762347 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-768ff682-cd91-4dc9-8a36-d6215bf62f0d tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:51.762775 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-768ff682-cd91-4dc9-8a36-d6215bf62f0d tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:51.773841 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7a5a6d81-8cf1-4a32-aded-5720635b347c tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:51.774833 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7a5a6d81-8cf1-4a32-aded-5720635b347c tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: d5e6f604-9466-45c6-86a8-885cfb393223] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:51.796301 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7a5a6d81-8cf1-4a32-aded-5720635b347c tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:51.796805 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7a5a6d81-8cf1-4a32-aded-5720635b347c tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:51.797244 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7a5a6d81-8cf1-4a32-aded-5720635b347c tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:51.797962 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7a5a6d81-8cf1-4a32-aded-5720635b347c tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:51.801887 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7a5a6d81-8cf1-4a32-aded-5720635b347c tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:51.802545 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7a5a6d81-8cf1-4a32-aded-5720635b347c tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:52.124305 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-768ff682-cd91-4dc9-8a36-d6215bf62f0d tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:52.153973 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-768ff682-cd91-4dc9-8a36-d6215bf62f0d tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34" status: 200 len: 1199 microversion: 2.1 time: 0.425859 Oct 27 03:28:52.173982 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1055/2098] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:28:51 2022] GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34 => generated 1199 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:52.200506 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7a5a6d81-8cf1-4a32-aded-5720635b347c tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:52.217739 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7a5a6d81-8cf1-4a32-aded-5720635b347c tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:52.219598 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a44a353c-8e52-4ecf-8bf8-0b6aebf7c8b7 tempest-KeyPairsNegativeTestJSON-785011349 tempest-KeyPairsNegativeTestJSON-785011349-project] Action: 'create', calling method: .version_select at 0x7f7dded2c790>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1392179981", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:28:52.221634 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7a5a6d81-8cf1-4a32-aded-5720635b347c tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:52.223476 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7a5a6d81-8cf1-4a32-aded-5720635b347c tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223" status: 200 len: 1281 microversion: 2.25 time: 0.455337 Oct 27 03:28:52.240239 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1044/2099] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:28:51 2022] GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223 => generated 1281 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:28:52.248082 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8978a53b-4a2c-4fc3-9b20-e6f9545c6c94 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:52.251076 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8978a53b-4a2c-4fc3-9b20-e6f9545c6c94 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] [instance: 0fb1f450-692f-4979-a489-c13ab4106607] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:52.263114 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8978a53b-4a2c-4fc3-9b20-e6f9545c6c94 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:52.265915 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=69 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:28:52.267178 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8978a53b-4a2c-4fc3-9b20-e6f9545c6c94 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:52.270473 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-a44a353c-8e52-4ecf-8bf8-0b6aebf7c8b7 tempest-KeyPairsNegativeTestJSON-785011349 tempest-KeyPairsNegativeTestJSON-785011349-project] Getting quotas for project 9aedac4560a949d496d6c36006b387c6. Resources: {'key_pairs'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:28:52.270830 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8978a53b-4a2c-4fc3-9b20-e6f9545c6c94 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:52.271351 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8978a53b-4a2c-4fc3-9b20-e6f9545c6c94 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:52.272020 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8978a53b-4a2c-4fc3-9b20-e6f9545c6c94 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:52.273947 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8978a53b-4a2c-4fc3-9b20-e6f9545c6c94 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:52.282270 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-a44a353c-8e52-4ecf-8bf8-0b6aebf7c8b7 tempest-KeyPairsNegativeTestJSON-785011349 tempest-KeyPairsNegativeTestJSON-785011349-project] Getting quotas for user aba6e49374474d17b5e63709eb5fbb7b and project 9aedac4560a949d496d6c36006b387c6. Resources: {'key_pairs'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:28:52.323085 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-a44a353c-8e52-4ecf-8bf8-0b6aebf7c8b7 tempest-KeyPairsNegativeTestJSON-785011349 tempest-KeyPairsNegativeTestJSON-785011349-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 27 03:28:52.327963 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a44a353c-8e52-4ecf-8bf8-0b6aebf7c8b7 tempest-KeyPairsNegativeTestJSON-785011349 tempest-KeyPairsNegativeTestJSON-785011349-project] Request method failure captured: Oct 27 03:28:52.327963 n-d-862769-1 devstack@n-api.service[121001]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 27 03:28:52.327963 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:28:52.327963 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:28:52.327963 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:28:52.327963 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 118 Oct 27 03:28:52.327963 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:28:52.327963 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:28:52.327963 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:28:52.327963 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:28:52.327963 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfrsKdLjc7w_hkfuxkTQAO0QUXuHQlYbncJzfUQA4OwHBBnhbkaNNsRmi93B67-KNb-RXWDHDVxekcDpZXQ88y-cBlihLpdjy86vLJzrYB3QCo4geob333E17exNNf0qHgNADSb2lSxiULZZbC7BvcOtfoF9u1g_4FAulhQWSJn_p5E Oct 27 03:28:52.327963 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:28:52.327963 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:28:52.327963 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:28:52.327963 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:28:52.327963 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:28:52.327963 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:28:52.327963 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 9aedac4560a949d496d6c36006b387c6 Oct 27 03:28:52.327963 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-785011349 Oct 27 03:28:52.327963 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:28:52.327963 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:28:52.327963 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9aedac4560a949d496d6c36006b387c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9aedac4560a949d496d6c36006b387c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9aedac4560a949d496d6c36006b387c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9aedac4560a949d496d6c36006b387c6"}]}] Oct 27 03:28:52.327963 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-KeyPairsNegativeTestJSON-785011349 Oct 27 03:28:52.327963 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 9aedac4560a949d496d6c36006b387c6 Oct 27 03:28:52.327963 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-785011349 Oct 27 03:28:52.327963 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-KeyPairsNegativeTestJSON-785011349-project Oct 27 03:28:52.327963 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:28:52.327963 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:28:52.327963 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: aba6e49374474d17b5e63709eb5fbb7b Oct 27 03:28:52.327963 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-KeyPairsNegativeTestJSON-785011349-project Oct 27 03:28:52.327963 n-d-862769-1 devstack@n-api.service[121001]: Oct 27 03:28:52.327963 n-d-862769-1 devstack@n-api.service[121001]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1392179981", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Oct 27 03:28:52.327963 n-d-862769-1 devstack@n-api.service[121001]: method: Oct 27 03:28:52.327963 n-d-862769-1 devstack@n-api.service[121001]: exception: Keypair data is invalid: failed to generate fingerprint Oct 27 03:28:52.327963 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1392179981', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Oct 27 03:28:52.327963 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:28:52.327963 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:28:52.327963 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 27 03:28:52.327963 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 27 03:28:52.327963 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Oct 27 03:28:52.327963 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Oct 27 03:28:52.327963 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Oct 27 03:28:52.327963 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Oct 27 03:28:52.327963 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Oct 27 03:28:52.327963 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Oct 27 03:28:52.327963 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Oct 27 03:28:52.327963 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:28:52.327963 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:28:52.327963 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:28:52.327963 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:28:52.327963 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 27 03:28:52.327963 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 27 03:28:52.327963 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 27 03:28:52.327963 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 27 03:28:52.327963 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 03:28:52.327963 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 03:28:52.327963 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 03:28:52.327963 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 03:28:52.327963 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 27 03:28:52.327963 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 27 03:28:52.327963 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 27 03:28:52.327963 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 27 03:28:52.327963 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 27 03:28:52.327963 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 27 03:28:52.333257 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 27 03:28:52.333257 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 27 03:28:52.333257 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 27 03:28:52.333257 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:28:52.333257 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:28:52.333257 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:28:52.333257 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:28:52.333257 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:28:52.333257 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:28:52.333257 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:28:52.333257 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:28:52.333257 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:28:52.333257 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:28:52.333257 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:28:52.333257 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:28:52.333257 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:28:52.333257 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:28:52.333257 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:28:52.333257 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:28:52.333257 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 27 03:28:52.333257 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 27 03:28:52.333257 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 27 03:28:52.333257 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 27 03:28:52.333257 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 27 03:28:52.333257 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:28:52.333257 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:28:52.333257 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:28:52.333257 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:28:52.333257 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:28:52.333257 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:28:52.333257 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:28:52.333257 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:28:52.333257 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 27 03:28:52.333257 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:28:52.342279 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a44a353c-8e52-4ecf-8bf8-0b6aebf7c8b7 tempest-KeyPairsNegativeTestJSON-785011349 tempest-KeyPairsNegativeTestJSON-785011349-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:28:52.344138 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a44a353c-8e52-4ecf-8bf8-0b6aebf7c8b7 tempest-KeyPairsNegativeTestJSON-785011349 tempest-KeyPairsNegativeTestJSON-785011349-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.168706 Oct 27 03:28:52.344920 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1056/2100] 10.222.0.20 () {60 vars in 1159 bytes} [Thu Oct 27 03:28:52 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 170 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 27 03:28:52.357006 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-86048274-b42c-4e6c-822e-762be3ddf2b5 tempest-KeyPairsNegativeTestJSON-785011349 tempest-KeyPairsNegativeTestJSON-785011349-project] Calling method '.version_select at 0x7f7dded5b0d0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:52.378348 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-86048274-b42c-4e6c-822e-762be3ddf2b5 tempest-KeyPairsNegativeTestJSON-785011349 tempest-KeyPairsNegativeTestJSON-785011349-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-88760094 not found for user aba6e49374474d17b5e63709eb5fbb7b Oct 27 03:28:52.380432 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-86048274-b42c-4e6c-822e-762be3ddf2b5 tempest-KeyPairsNegativeTestJSON-785011349 tempest-KeyPairsNegativeTestJSON-785011349-project] Request method failure captured: Oct 27 03:28:52.380432 n-d-862769-1 devstack@n-api.service[121001]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-88760094 HTTP/1.1 Oct 27 03:28:52.380432 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:28:52.380432 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:28:52.380432 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:28:52.380432 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:28:52.380432 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:28:52.380432 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:28:52.380432 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:28:52.380432 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:28:52.380432 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfrsKdLjc7w_hkfuxkTQAO0QUXuHQlYbncJzfUQA4OwHBBnhbkaNNsRmi93B67-KNb-RXWDHDVxekcDpZXQ88y-cBlihLpdjy86vLJzrYB3QCo4geob333E17exNNf0qHgNADSb2lSxiULZZbC7BvcOtfoF9u1g_4FAulhQWSJn_p5E Oct 27 03:28:52.380432 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:28:52.380432 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:28:52.380432 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:28:52.380432 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:28:52.380432 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:28:52.380432 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:28:52.380432 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 9aedac4560a949d496d6c36006b387c6 Oct 27 03:28:52.380432 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-785011349 Oct 27 03:28:52.380432 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:28:52.380432 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:28:52.380432 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9aedac4560a949d496d6c36006b387c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9aedac4560a949d496d6c36006b387c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9aedac4560a949d496d6c36006b387c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9aedac4560a949d496d6c36006b387c6"}]}] Oct 27 03:28:52.380432 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-KeyPairsNegativeTestJSON-785011349 Oct 27 03:28:52.380432 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 9aedac4560a949d496d6c36006b387c6 Oct 27 03:28:52.380432 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-785011349 Oct 27 03:28:52.380432 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-KeyPairsNegativeTestJSON-785011349-project Oct 27 03:28:52.380432 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:28:52.380432 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:28:52.380432 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: aba6e49374474d17b5e63709eb5fbb7b Oct 27 03:28:52.380432 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-KeyPairsNegativeTestJSON-785011349-project Oct 27 03:28:52.380432 n-d-862769-1 devstack@n-api.service[121001]: method: Oct 27 03:28:52.380432 n-d-862769-1 devstack@n-api.service[121001]: exception: Keypair tempest-keypair-non-existent-88760094 not found for user aba6e49374474d17b5e63709eb5fbb7b Oct 27 03:28:52.380432 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': 'tempest-keypair-non-existent-88760094'} Oct 27 03:28:52.380432 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:28:52.380432 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:28:52.380432 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Oct 27 03:28:52.380432 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Oct 27 03:28:52.380432 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 27 03:28:52.380432 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 27 03:28:52.380432 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 03:28:52.380432 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 03:28:52.380432 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 03:28:52.380432 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 03:28:52.380432 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 27 03:28:52.380432 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 27 03:28:52.380432 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6861, in delete_key_pair Oct 27 03:28:52.380432 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Oct 27 03:28:52.380432 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6882, in get_key_pair Oct 27 03:28:52.380432 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Oct 27 03:28:52.380432 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 03:28:52.380432 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 03:28:52.380432 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 27 03:28:52.380432 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 27 03:28:52.380432 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 27 03:28:52.380432 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 27 03:28:52.380432 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 03:28:52.380432 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 03:28:52.380432 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 27 03:28:52.380432 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 27 03:28:52.380432 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-88760094 not found for user aba6e49374474d17b5e63709eb5fbb7b Oct 27 03:28:52.380432 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:28:52.380432 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:28:52.386312 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:28:52.386312 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:28:52.386312 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:28:52.386312 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:28:52.386312 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:28:52.386312 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:28:52.386312 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:28:52.386312 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:28:52.386312 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 03:28:52.386312 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:28:52.386312 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:28:52.386312 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:28:52.386312 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Oct 27 03:28:52.386312 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self._delete(req, id) Oct 27 03:28:52.386312 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Oct 27 03:28:52.386312 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Oct 27 03:28:52.386312 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-88760094 not found for user aba6e49374474d17b5e63709eb5fbb7b Oct 27 03:28:52.386312 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:28:52.386312 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:28:52.386312 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:28:52.386312 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:28:52.386312 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:28:52.386312 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:28:52.386312 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:28:52.386312 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:28:52.386312 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-88760094 not found for user aba6e49374474d17b5e63709eb5fbb7b Oct 27 03:28:52.386312 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:28:52.391779 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-86048274-b42c-4e6c-822e-762be3ddf2b5 tempest-KeyPairsNegativeTestJSON-785011349 tempest-KeyPairsNegativeTestJSON-785011349-project] Returning 404 to user: Keypair tempest-keypair-non-existent-88760094 not found for user aba6e49374474d17b5e63709eb5fbb7b {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:28:52.393766 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-86048274-b42c-4e6c-822e-762be3ddf2b5 tempest-KeyPairsNegativeTestJSON-785011349 tempest-KeyPairsNegativeTestJSON-785011349-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-88760094" status: 404 len: 143 microversion: 2.1 time: 0.041985 Oct 27 03:28:52.395048 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1057/2101] 10.222.0.20 () {58 vars in 1254 bytes} [Thu Oct 27 03:28:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-88760094 => generated 143 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 03:28:52.458162 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d5726bc0-c37e-4b94-a238-56a443e5aff5 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:52.459155 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d5726bc0-c37e-4b94-a238-56a443e5aff5 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] [instance: 2aa6c062-32e4-453d-abb5-a51d96c66e2d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:52.491439 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d5726bc0-c37e-4b94-a238-56a443e5aff5 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:52.493133 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d5726bc0-c37e-4b94-a238-56a443e5aff5 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:52.500297 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d5726bc0-c37e-4b94-a238-56a443e5aff5 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:52.501796 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d5726bc0-c37e-4b94-a238-56a443e5aff5 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:52.506063 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d5726bc0-c37e-4b94-a238-56a443e5aff5 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:52.506764 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d5726bc0-c37e-4b94-a238-56a443e5aff5 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:52.565901 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8978a53b-4a2c-4fc3-9b20-e6f9545c6c94 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b2717ace074a579d33c60964e6668a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3fc032a089f45efa4a66866a9c961c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:52.569244 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:28:52.583687 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8978a53b-4a2c-4fc3-9b20-e6f9545c6c94 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] 10.222.0.20 "GET /compute/v2.1/servers/0fb1f450-692f-4979-a489-c13ab4106607" status: 200 len: 1714 microversion: 2.1 time: 0.337506 Oct 27 03:28:52.585746 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1045/2102] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:28:52 2022] GET /compute/v2.1/servers/0fb1f450-692f-4979-a489-c13ab4106607 => generated 1714 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:52.594881 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-b0f361a5-db23-4d46-8149-1a4eeea64ffc req-2ba55b73-de31-4fc3-aa71-e54d1b2e065f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8925d29-d9e0-4dbb-a73d-09473255fa34", "name": "network-vif-plugged", "status": "completed", "tag": "dfa74d77-ff34-4f03-a07f-cf59ea6cd793"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:28:52.618952 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-b0f361a5-db23-4d46-8149-1a4eeea64ffc req-2ba55b73-de31-4fc3-aa71-e54d1b2e065f service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:52.619793 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-b0f361a5-db23-4d46-8149-1a4eeea64ffc req-2ba55b73-de31-4fc3-aa71-e54d1b2e065f service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:52.620431 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-b0f361a5-db23-4d46-8149-1a4eeea64ffc req-2ba55b73-de31-4fc3-aa71-e54d1b2e065f service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:52.657111 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-b0f361a5-db23-4d46-8149-1a4eeea64ffc req-2ba55b73-de31-4fc3-aa71-e54d1b2e065f service nova] Creating event network-vif-plugged:dfa74d77-ff34-4f03-a07f-cf59ea6cd793 for instance a8925d29-d9e0-4dbb-a73d-09473255fa34 on n-h1-862769-1 Oct 27 03:28:52.667723 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-b0f361a5-db23-4d46-8149-1a4eeea64ffc req-2ba55b73-de31-4fc3-aa71-e54d1b2e065f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081119 Oct 27 03:28:52.668975 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1046/2103] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:28:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:28:52.688389 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0c887573-9262-4659-9c02-6505b1216cfb tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:52.689396 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0c887573-9262-4659-9c02-6505b1216cfb tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 1352bd75-bfe6-48e3-a47d-314c7f13f692] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:52.699954 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:28:52.705475 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0c887573-9262-4659-9c02-6505b1216cfb tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:52.708634 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0c887573-9262-4659-9c02-6505b1216cfb tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:52.714421 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0c887573-9262-4659-9c02-6505b1216cfb tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:52.714421 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0c887573-9262-4659-9c02-6505b1216cfb tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:52.714421 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0c887573-9262-4659-9c02-6505b1216cfb tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:52.714421 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0c887573-9262-4659-9c02-6505b1216cfb tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:52.753133 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d5726bc0-c37e-4b94-a238-56a443e5aff5 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '071401bed74d48fe8ae2dbdb98aa81cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b0b534b9eb463aab0f13e838578da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:52.768385 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d5726bc0-c37e-4b94-a238-56a443e5aff5 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] 10.222.0.20 "GET /compute/v2.1/servers/2aa6c062-32e4-453d-abb5-a51d96c66e2d" status: 200 len: 1322 microversion: 2.1 time: 0.313044 Oct 27 03:28:52.774085 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1058/2104] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:28:52 2022] GET /compute/v2.1/servers/2aa6c062-32e4-453d-abb5-a51d96c66e2d => generated 1322 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:52.785614 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a1decac5-9307-4173-9f77-e3e08b2fcf75 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:52.786764 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a1decac5-9307-4173-9f77-e3e08b2fcf75 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: 339287fc-37b6-455d-96ab-08ab8e2c3e68] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:52.813952 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a1decac5-9307-4173-9f77-e3e08b2fcf75 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:52.816773 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a1decac5-9307-4173-9f77-e3e08b2fcf75 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:52.820940 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a1decac5-9307-4173-9f77-e3e08b2fcf75 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:52.823103 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a1decac5-9307-4173-9f77-e3e08b2fcf75 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:52.824217 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a1decac5-9307-4173-9f77-e3e08b2fcf75 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:52.826343 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a1decac5-9307-4173-9f77-e3e08b2fcf75 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:53.092378 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0c887573-9262-4659-9c02-6505b1216cfb tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:53.116785 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0c887573-9262-4659-9c02-6505b1216cfb tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/1352bd75-bfe6-48e3-a47d-314c7f13f692" status: 200 len: 1307 microversion: 2.1 time: 0.433894 Oct 27 03:28:53.117685 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1047/2105] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:28:52 2022] GET /compute/v2.1/servers/1352bd75-bfe6-48e3-a47d-314c7f13f692 => generated 1307 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:53.125008 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a1decac5-9307-4173-9f77-e3e08b2fcf75 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13e05e253c94aadb1c089128ff35be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8510a519f14deea6f35a437419e161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:53.138263 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a1decac5-9307-4173-9f77-e3e08b2fcf75 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68" status: 200 len: 1471 microversion: 2.1 time: 0.365828 Oct 27 03:28:53.144798 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1059/2106] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:28:52 2022] GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68 => generated 1471 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:53.193319 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-76b19d69-f140-4327-a103-e600a2f04a12 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:53.195558 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-76b19d69-f140-4327-a103-e600a2f04a12 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: a8925d29-d9e0-4dbb-a73d-09473255fa34] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:53.232479 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-76b19d69-f140-4327-a103-e600a2f04a12 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:53.233229 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-76b19d69-f140-4327-a103-e600a2f04a12 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:53.234099 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-76b19d69-f140-4327-a103-e600a2f04a12 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:53.237247 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-76b19d69-f140-4327-a103-e600a2f04a12 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:53.239190 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-76b19d69-f140-4327-a103-e600a2f04a12 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:53.248347 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-76b19d69-f140-4327-a103-e600a2f04a12 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:53.273231 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6c7c9a91-57d1-4595-b803-ec40ec1c9eb4 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:53.274026 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-6c7c9a91-57d1-4595-b803-ec40ec1c9eb4 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: d5e6f604-9466-45c6-86a8-885cfb393223] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:53.292699 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6c7c9a91-57d1-4595-b803-ec40ec1c9eb4 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:53.302411 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6c7c9a91-57d1-4595-b803-ec40ec1c9eb4 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:53.304172 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6c7c9a91-57d1-4595-b803-ec40ec1c9eb4 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:53.307729 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6c7c9a91-57d1-4595-b803-ec40ec1c9eb4 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:53.309238 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6c7c9a91-57d1-4595-b803-ec40ec1c9eb4 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:53.309959 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6c7c9a91-57d1-4595-b803-ec40ec1c9eb4 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:53.802147 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6c7c9a91-57d1-4595-b803-ec40ec1c9eb4 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:53.821456 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6c7c9a91-57d1-4595-b803-ec40ec1c9eb4 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:53.825821 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6c7c9a91-57d1-4595-b803-ec40ec1c9eb4 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:53.830994 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6c7c9a91-57d1-4595-b803-ec40ec1c9eb4 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223" status: 200 len: 1281 microversion: 2.25 time: 0.562952 Oct 27 03:28:53.856767 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1060/2107] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:28:53 2022] GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223 => generated 1281 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:28:53.877109 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-fc79ed64-66b9-44b6-9626-a654f78863b6 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:53.877109 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-fc79ed64-66b9-44b6-9626-a654f78863b6 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] [instance: 0fb1f450-692f-4979-a489-c13ab4106607] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:53.884186 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fc79ed64-66b9-44b6-9626-a654f78863b6 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:53.885409 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fc79ed64-66b9-44b6-9626-a654f78863b6 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:53.886343 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fc79ed64-66b9-44b6-9626-a654f78863b6 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:53.887379 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fc79ed64-66b9-44b6-9626-a654f78863b6 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:53.888328 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fc79ed64-66b9-44b6-9626-a654f78863b6 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:53.889309 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fc79ed64-66b9-44b6-9626-a654f78863b6 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:54.161697 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-fc79ed64-66b9-44b6-9626-a654f78863b6 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b2717ace074a579d33c60964e6668a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3fc032a089f45efa4a66866a9c961c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:54.174822 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-fc79ed64-66b9-44b6-9626-a654f78863b6 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] 10.222.0.20 "GET /compute/v2.1/servers/0fb1f450-692f-4979-a489-c13ab4106607" status: 200 len: 1646 microversion: 2.1 time: 0.303400 Oct 27 03:28:54.176794 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1061/2108] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:28:53 2022] GET /compute/v2.1/servers/0fb1f450-692f-4979-a489-c13ab4106607 => generated 1646 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:54.204402 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-127a57b1-b44b-4a39-a3d5-b235a8f75f65 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:54.205087 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-127a57b1-b44b-4a39-a3d5-b235a8f75f65 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] [instance: 2aa6c062-32e4-453d-abb5-a51d96c66e2d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:54.211302 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-127a57b1-b44b-4a39-a3d5-b235a8f75f65 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:54.211937 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-127a57b1-b44b-4a39-a3d5-b235a8f75f65 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:54.212397 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-127a57b1-b44b-4a39-a3d5-b235a8f75f65 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:54.213870 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-127a57b1-b44b-4a39-a3d5-b235a8f75f65 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:54.214372 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-127a57b1-b44b-4a39-a3d5-b235a8f75f65 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:54.215407 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-127a57b1-b44b-4a39-a3d5-b235a8f75f65 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:54.243517 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=100 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:28:54.375348 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-76b19d69-f140-4327-a103-e600a2f04a12 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:54.401337 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-76b19d69-f140-4327-a103-e600a2f04a12 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34" status: 200 len: 1199 microversion: 2.1 time: 1.208156 Oct 27 03:28:54.417550 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1048/2109] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:28:53 2022] GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34 => generated 1199 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:54.421231 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d7197c9c-c7f8-4a85-a9c6-e70421491e71 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:54.421863 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d7197c9c-c7f8-4a85-a9c6-e70421491e71 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 1352bd75-bfe6-48e3-a47d-314c7f13f692] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:54.435807 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d7197c9c-c7f8-4a85-a9c6-e70421491e71 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:54.440713 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d7197c9c-c7f8-4a85-a9c6-e70421491e71 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:54.440713 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d7197c9c-c7f8-4a85-a9c6-e70421491e71 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:54.440713 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d7197c9c-c7f8-4a85-a9c6-e70421491e71 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:54.440713 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d7197c9c-c7f8-4a85-a9c6-e70421491e71 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:54.440713 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d7197c9c-c7f8-4a85-a9c6-e70421491e71 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:54.459208 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-127a57b1-b44b-4a39-a3d5-b235a8f75f65 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '071401bed74d48fe8ae2dbdb98aa81cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b0b534b9eb463aab0f13e838578da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:54.467858 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-127a57b1-b44b-4a39-a3d5-b235a8f75f65 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] 10.222.0.20 "GET /compute/v2.1/servers/2aa6c062-32e4-453d-abb5-a51d96c66e2d" status: 200 len: 1322 microversion: 2.1 time: 0.273415 Oct 27 03:28:54.469210 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1062/2110] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:28:54 2022] GET /compute/v2.1/servers/2aa6c062-32e4-453d-abb5-a51d96c66e2d => generated 1322 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:54.487053 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-56b4d862-92c4-418c-8801-fea803d67a94 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:54.488680 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-56b4d862-92c4-418c-8801-fea803d67a94 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: 339287fc-37b6-455d-96ab-08ab8e2c3e68] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:54.498108 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-56b4d862-92c4-418c-8801-fea803d67a94 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:54.498995 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-56b4d862-92c4-418c-8801-fea803d67a94 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:54.499619 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-56b4d862-92c4-418c-8801-fea803d67a94 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:54.500752 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-56b4d862-92c4-418c-8801-fea803d67a94 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:54.501508 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-56b4d862-92c4-418c-8801-fea803d67a94 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:54.502140 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-56b4d862-92c4-418c-8801-fea803d67a94 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:54.727082 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-56b4d862-92c4-418c-8801-fea803d67a94 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13e05e253c94aadb1c089128ff35be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8510a519f14deea6f35a437419e161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:54.729010 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d7197c9c-c7f8-4a85-a9c6-e70421491e71 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:54.736068 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-56b4d862-92c4-418c-8801-fea803d67a94 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68" status: 200 len: 1471 microversion: 2.1 time: 0.265173 Oct 27 03:28:54.740174 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1063/2111] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:28:54 2022] GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68 => generated 1471 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:54.743054 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-e3a36478-cdf7-4112-b466-d9c0b69fd62f req-b879e0ef-3618-47b9-b5e8-10005dab1f3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fb1f450-692f-4979-a489-c13ab4106607", "name": "network-vif-deleted", "tag": "d7f6f05f-8194-4764-bde0-8189fafed192"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:28:54.752164 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-e3a36478-cdf7-4112-b466-d9c0b69fd62f req-b879e0ef-3618-47b9-b5e8-10005dab1f3a service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:54.752352 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d7197c9c-c7f8-4a85-a9c6-e70421491e71 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/1352bd75-bfe6-48e3-a47d-314c7f13f692" status: 200 len: 1307 microversion: 2.1 time: 0.333724 Oct 27 03:28:54.752732 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-e3a36478-cdf7-4112-b466-d9c0b69fd62f req-b879e0ef-3618-47b9-b5e8-10005dab1f3a service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:54.753272 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-e3a36478-cdf7-4112-b466-d9c0b69fd62f req-b879e0ef-3618-47b9-b5e8-10005dab1f3a service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:54.762186 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1049/2112] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:28:54 2022] GET /compute/v2.1/servers/1352bd75-bfe6-48e3-a47d-314c7f13f692 => generated 1307 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:54.765057 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-e3a36478-cdf7-4112-b466-d9c0b69fd62f req-b879e0ef-3618-47b9-b5e8-10005dab1f3a service nova] Creating event network-vif-deleted:d7f6f05f-8194-4764-bde0-8189fafed192 for instance 0fb1f450-692f-4979-a489-c13ab4106607 on n-h2-862769-1 Oct 27 03:28:54.771367 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-e3a36478-cdf7-4112-b466-d9c0b69fd62f req-b879e0ef-3618-47b9-b5e8-10005dab1f3a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033315 Oct 27 03:28:54.772152 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1064/2113] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:28:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:28:54.862365 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-54f1a6c7-b234-49f2-98ee-b534c82c1ca6 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:54.863130 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-54f1a6c7-b234-49f2-98ee-b534c82c1ca6 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: d5e6f604-9466-45c6-86a8-885cfb393223] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:54.869106 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-54f1a6c7-b234-49f2-98ee-b534c82c1ca6 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:54.869789 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-54f1a6c7-b234-49f2-98ee-b534c82c1ca6 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:54.870504 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-54f1a6c7-b234-49f2-98ee-b534c82c1ca6 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:54.871458 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-54f1a6c7-b234-49f2-98ee-b534c82c1ca6 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:54.872124 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-54f1a6c7-b234-49f2-98ee-b534c82c1ca6 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:54.872780 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-54f1a6c7-b234-49f2-98ee-b534c82c1ca6 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:55.142021 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-54f1a6c7-b234-49f2-98ee-b534c82c1ca6 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:55.148637 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-54f1a6c7-b234-49f2-98ee-b534c82c1ca6 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:55.150126 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-54f1a6c7-b234-49f2-98ee-b534c82c1ca6 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:55.151265 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-54f1a6c7-b234-49f2-98ee-b534c82c1ca6 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223" status: 200 len: 1281 microversion: 2.25 time: 0.293092 Oct 27 03:28:55.151842 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1050/2114] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:28:54 2022] GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223 => generated 1281 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:28:55.205078 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-fc3e042a-f8e4-467f-921b-a7d66c45cac9 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:55.205784 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-fc3e042a-f8e4-467f-921b-a7d66c45cac9 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] [instance: 0fb1f450-692f-4979-a489-c13ab4106607] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:55.216849 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fc3e042a-f8e4-467f-921b-a7d66c45cac9 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:55.222339 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fc3e042a-f8e4-467f-921b-a7d66c45cac9 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:55.222339 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fc3e042a-f8e4-467f-921b-a7d66c45cac9 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:55.222339 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fc3e042a-f8e4-467f-921b-a7d66c45cac9 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:55.222339 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fc3e042a-f8e4-467f-921b-a7d66c45cac9 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:55.222339 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fc3e042a-f8e4-467f-921b-a7d66c45cac9 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:55.310633 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-fc3e042a-f8e4-467f-921b-a7d66c45cac9 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b2717ace074a579d33c60964e6668a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3fc032a089f45efa4a66866a9c961c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:55.319849 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-fc3e042a-f8e4-467f-921b-a7d66c45cac9 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] 10.222.0.20 "GET /compute/v2.1/servers/0fb1f450-692f-4979-a489-c13ab4106607" status: 200 len: 1362 microversion: 2.1 time: 0.118780 Oct 27 03:28:55.320994 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1065/2115] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:28:55 2022] GET /compute/v2.1/servers/0fb1f450-692f-4979-a489-c13ab4106607 => generated 1362 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:55.430455 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e1f08508-7c67-4543-b11a-730052c57062 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:55.431876 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e1f08508-7c67-4543-b11a-730052c57062 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: a8925d29-d9e0-4dbb-a73d-09473255fa34] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:55.441844 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e1f08508-7c67-4543-b11a-730052c57062 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:55.442695 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e1f08508-7c67-4543-b11a-730052c57062 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:55.443366 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e1f08508-7c67-4543-b11a-730052c57062 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:55.444173 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e1f08508-7c67-4543-b11a-730052c57062 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:55.444874 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e1f08508-7c67-4543-b11a-730052c57062 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:55.445376 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e1f08508-7c67-4543-b11a-730052c57062 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:55.494234 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-13b5da71-5558-4101-be44-bc1385ff7f33 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:55.495219 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-13b5da71-5558-4101-be44-bc1385ff7f33 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] [instance: 2aa6c062-32e4-453d-abb5-a51d96c66e2d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:55.502019 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-13b5da71-5558-4101-be44-bc1385ff7f33 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:55.502741 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-13b5da71-5558-4101-be44-bc1385ff7f33 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:55.504241 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-13b5da71-5558-4101-be44-bc1385ff7f33 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:55.505315 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-13b5da71-5558-4101-be44-bc1385ff7f33 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:55.506197 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-13b5da71-5558-4101-be44-bc1385ff7f33 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:55.506839 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-13b5da71-5558-4101-be44-bc1385ff7f33 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:55.732756 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-13b5da71-5558-4101-be44-bc1385ff7f33 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '071401bed74d48fe8ae2dbdb98aa81cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b0b534b9eb463aab0f13e838578da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:55.745004 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-13b5da71-5558-4101-be44-bc1385ff7f33 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] 10.222.0.20 "GET /compute/v2.1/servers/2aa6c062-32e4-453d-abb5-a51d96c66e2d" status: 200 len: 1322 microversion: 2.1 time: 0.255103 Oct 27 03:28:55.745592 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1066/2116] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:28:55 2022] GET /compute/v2.1/servers/2aa6c062-32e4-453d-abb5-a51d96c66e2d => generated 1322 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:28:55.773749 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7033dd6f-a6fc-444d-be03-751240a05f1a tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:55.774747 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7033dd6f-a6fc-444d-be03-751240a05f1a tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: 339287fc-37b6-455d-96ab-08ab8e2c3e68] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:55.782902 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7033dd6f-a6fc-444d-be03-751240a05f1a tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:55.783411 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7033dd6f-a6fc-444d-be03-751240a05f1a tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:55.783854 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7033dd6f-a6fc-444d-be03-751240a05f1a tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:55.786210 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7033dd6f-a6fc-444d-be03-751240a05f1a tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:55.786691 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7033dd6f-a6fc-444d-be03-751240a05f1a tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:55.787134 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7033dd6f-a6fc-444d-be03-751240a05f1a tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:55.805991 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e1f08508-7c67-4543-b11a-730052c57062 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:55.831482 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e1f08508-7c67-4543-b11a-730052c57062 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34" status: 200 len: 1199 microversion: 2.1 time: 0.406278 Oct 27 03:28:55.852205 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1051/2117] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:28:55 2022] GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34 => generated 1199 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:55.867328 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2b7ede6e-bdf9-4a49-8754-be812de6d66b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:55.867971 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-2b7ede6e-bdf9-4a49-8754-be812de6d66b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 1352bd75-bfe6-48e3-a47d-314c7f13f692] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:55.879551 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2b7ede6e-bdf9-4a49-8754-be812de6d66b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:55.880070 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2b7ede6e-bdf9-4a49-8754-be812de6d66b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:55.880966 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2b7ede6e-bdf9-4a49-8754-be812de6d66b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:55.881946 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2b7ede6e-bdf9-4a49-8754-be812de6d66b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:55.882439 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2b7ede6e-bdf9-4a49-8754-be812de6d66b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:55.884209 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2b7ede6e-bdf9-4a49-8754-be812de6d66b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:56.062499 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7033dd6f-a6fc-444d-be03-751240a05f1a tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13e05e253c94aadb1c089128ff35be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8510a519f14deea6f35a437419e161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:56.072215 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7033dd6f-a6fc-444d-be03-751240a05f1a tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68" status: 200 len: 1471 microversion: 2.1 time: 0.305209 Oct 27 03:28:56.075586 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1067/2118] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:28:55 2022] GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68 => generated 1471 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:56.139706 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2b7ede6e-bdf9-4a49-8754-be812de6d66b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:56.165104 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2b7ede6e-bdf9-4a49-8754-be812de6d66b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/1352bd75-bfe6-48e3-a47d-314c7f13f692" status: 200 len: 1307 microversion: 2.1 time: 0.311333 Oct 27 03:28:56.166742 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1052/2119] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:28:55 2022] GET /compute/v2.1/servers/1352bd75-bfe6-48e3-a47d-314c7f13f692 => generated 1307 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:56.179401 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1864d0df-3189-4e65-8785-37eabb8451d8 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:56.180488 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1864d0df-3189-4e65-8785-37eabb8451d8 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: d5e6f604-9466-45c6-86a8-885cfb393223] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:56.187230 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1864d0df-3189-4e65-8785-37eabb8451d8 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:56.188206 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1864d0df-3189-4e65-8785-37eabb8451d8 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:56.188935 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1864d0df-3189-4e65-8785-37eabb8451d8 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:56.190602 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1864d0df-3189-4e65-8785-37eabb8451d8 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:56.191287 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1864d0df-3189-4e65-8785-37eabb8451d8 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:56.191908 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1864d0df-3189-4e65-8785-37eabb8451d8 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:56.344414 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-37967b23-eb84-43f0-b0d4-47a314ce04a0 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:56.344781 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-37967b23-eb84-43f0-b0d4-47a314ce04a0 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] [instance: 0fb1f450-692f-4979-a489-c13ab4106607] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:56.349131 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1864d0df-3189-4e65-8785-37eabb8451d8 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:56.351895 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-37967b23-eb84-43f0-b0d4-47a314ce04a0 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:56.352403 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-37967b23-eb84-43f0-b0d4-47a314ce04a0 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:56.352856 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-37967b23-eb84-43f0-b0d4-47a314ce04a0 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:56.353611 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-37967b23-eb84-43f0-b0d4-47a314ce04a0 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:56.354068 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-37967b23-eb84-43f0-b0d4-47a314ce04a0 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:56.354532 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-37967b23-eb84-43f0-b0d4-47a314ce04a0 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:56.358024 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1864d0df-3189-4e65-8785-37eabb8451d8 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:56.360006 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1864d0df-3189-4e65-8785-37eabb8451d8 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:56.360999 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1864d0df-3189-4e65-8785-37eabb8451d8 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223" status: 200 len: 1281 microversion: 2.25 time: 0.188095 Oct 27 03:28:56.361557 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1068/2120] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:28:56 2022] GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223 => generated 1281 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:28:56.427780 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-37967b23-eb84-43f0-b0d4-47a314ce04a0 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b2717ace074a579d33c60964e6668a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3fc032a089f45efa4a66866a9c961c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:56.436529 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-37967b23-eb84-43f0-b0d4-47a314ce04a0 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] 10.222.0.20 "GET /compute/v2.1/servers/0fb1f450-692f-4979-a489-c13ab4106607" status: 200 len: 1362 microversion: 2.1 time: 0.096523 Oct 27 03:28:56.437128 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1053/2121] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:28:56 2022] GET /compute/v2.1/servers/0fb1f450-692f-4979-a489-c13ab4106607 => generated 1362 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:56.741528 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-eefd2764-da7c-4a50-994a-2a649504039d tempest-AbsoluteLimitsTestJSON-96757837 tempest-AbsoluteLimitsTestJSON-96757837-project] Calling method '.version_select at 0x7f7ddab94e50>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:56.754549 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eefd2764-da7c-4a50-994a-2a649504039d tempest-AbsoluteLimitsTestJSON-96757837 tempest-AbsoluteLimitsTestJSON-96757837-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:56.760674 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eefd2764-da7c-4a50-994a-2a649504039d tempest-AbsoluteLimitsTestJSON-96757837 tempest-AbsoluteLimitsTestJSON-96757837-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:56.760674 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eefd2764-da7c-4a50-994a-2a649504039d tempest-AbsoluteLimitsTestJSON-96757837 tempest-AbsoluteLimitsTestJSON-96757837-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:56.760674 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eefd2764-da7c-4a50-994a-2a649504039d tempest-AbsoluteLimitsTestJSON-96757837 tempest-AbsoluteLimitsTestJSON-96757837-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:56.760674 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eefd2764-da7c-4a50-994a-2a649504039d tempest-AbsoluteLimitsTestJSON-96757837 tempest-AbsoluteLimitsTestJSON-96757837-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:56.760674 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eefd2764-da7c-4a50-994a-2a649504039d tempest-AbsoluteLimitsTestJSON-96757837 tempest-AbsoluteLimitsTestJSON-96757837-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:56.775939 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-82e2a496-c4aa-4c03-b038-b06fa9d28f42 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:56.776570 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-82e2a496-c4aa-4c03-b038-b06fa9d28f42 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] [instance: 2aa6c062-32e4-453d-abb5-a51d96c66e2d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:56.783787 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-82e2a496-c4aa-4c03-b038-b06fa9d28f42 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:56.784413 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-82e2a496-c4aa-4c03-b038-b06fa9d28f42 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:56.784883 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-82e2a496-c4aa-4c03-b038-b06fa9d28f42 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:56.785610 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-82e2a496-c4aa-4c03-b038-b06fa9d28f42 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:56.786219 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-82e2a496-c4aa-4c03-b038-b06fa9d28f42 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:56.792973 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-82e2a496-c4aa-4c03-b038-b06fa9d28f42 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:56.793132 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-eefd2764-da7c-4a50-994a-2a649504039d tempest-AbsoluteLimitsTestJSON-96757837 tempest-AbsoluteLimitsTestJSON-96757837-project] 10.222.0.20 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.173500 Oct 27 03:28:56.793132 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1069/2122] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:28:56 2022] GET /compute/v2.1/limits => generated 511 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:28:56.859669 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1a06fac3-a3c8-4f0b-8128-cba5151af8d5 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:56.860378 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1a06fac3-a3c8-4f0b-8128-cba5151af8d5 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: a8925d29-d9e0-4dbb-a73d-09473255fa34] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:56.870323 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1a06fac3-a3c8-4f0b-8128-cba5151af8d5 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:56.871259 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1a06fac3-a3c8-4f0b-8128-cba5151af8d5 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:56.872102 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1a06fac3-a3c8-4f0b-8128-cba5151af8d5 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:56.873065 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1a06fac3-a3c8-4f0b-8128-cba5151af8d5 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:56.875535 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1a06fac3-a3c8-4f0b-8128-cba5151af8d5 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:56.876452 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1a06fac3-a3c8-4f0b-8128-cba5151af8d5 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:57.312262 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-82e2a496-c4aa-4c03-b038-b06fa9d28f42 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '071401bed74d48fe8ae2dbdb98aa81cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b0b534b9eb463aab0f13e838578da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:57.327721 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-82e2a496-c4aa-4c03-b038-b06fa9d28f42 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] 10.222.0.20 "GET /compute/v2.1/servers/2aa6c062-32e4-453d-abb5-a51d96c66e2d" status: 200 len: 1322 microversion: 2.1 time: 0.555097 Oct 27 03:28:57.328595 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1054/2123] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:28:56 2022] GET /compute/v2.1/servers/2aa6c062-32e4-453d-abb5-a51d96c66e2d => generated 1322 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:28:57.334235 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8cf37d66-205f-46ee-98d8-4d7296098686 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:57.335564 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8cf37d66-205f-46ee-98d8-4d7296098686 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: 339287fc-37b6-455d-96ab-08ab8e2c3e68] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:57.373059 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8cf37d66-205f-46ee-98d8-4d7296098686 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:57.373880 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8cf37d66-205f-46ee-98d8-4d7296098686 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:57.374585 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8cf37d66-205f-46ee-98d8-4d7296098686 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:57.375650 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8cf37d66-205f-46ee-98d8-4d7296098686 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:57.376311 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8cf37d66-205f-46ee-98d8-4d7296098686 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:57.376940 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8cf37d66-205f-46ee-98d8-4d7296098686 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:57.393341 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1a06fac3-a3c8-4f0b-8128-cba5151af8d5 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:57.412497 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1a06fac3-a3c8-4f0b-8128-cba5151af8d5 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34" status: 200 len: 1382 microversion: 2.1 time: 0.556725 Oct 27 03:28:57.413227 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1070/2124] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:28:56 2022] GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34 => generated 1382 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:28:57.423279 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-395e43a2-921f-405a-b70b-9eb5902a1e0b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:57.423916 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-395e43a2-921f-405a-b70b-9eb5902a1e0b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 1352bd75-bfe6-48e3-a47d-314c7f13f692] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:57.436589 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-395e43a2-921f-405a-b70b-9eb5902a1e0b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:57.437084 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-395e43a2-921f-405a-b70b-9eb5902a1e0b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:57.437527 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-395e43a2-921f-405a-b70b-9eb5902a1e0b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:57.438267 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-395e43a2-921f-405a-b70b-9eb5902a1e0b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:57.438906 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-395e43a2-921f-405a-b70b-9eb5902a1e0b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:57.439504 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-395e43a2-921f-405a-b70b-9eb5902a1e0b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:57.644960 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-395e43a2-921f-405a-b70b-9eb5902a1e0b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:57.657414 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-395e43a2-921f-405a-b70b-9eb5902a1e0b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/1352bd75-bfe6-48e3-a47d-314c7f13f692" status: 200 len: 1307 microversion: 2.1 time: 0.241560 Oct 27 03:28:57.670104 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1071/2125] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:28:57 2022] GET /compute/v2.1/servers/1352bd75-bfe6-48e3-a47d-314c7f13f692 => generated 1307 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:57.670104 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9df9eac8-b78d-4a26-a547-0063efca712f tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:57.670104 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-9df9eac8-b78d-4a26-a547-0063efca712f tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: d5e6f604-9466-45c6-86a8-885cfb393223] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:57.673552 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9df9eac8-b78d-4a26-a547-0063efca712f tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:57.675024 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9df9eac8-b78d-4a26-a547-0063efca712f tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:57.676302 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9df9eac8-b78d-4a26-a547-0063efca712f tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:57.679617 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9df9eac8-b78d-4a26-a547-0063efca712f tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:57.679617 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9df9eac8-b78d-4a26-a547-0063efca712f tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:57.679617 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9df9eac8-b78d-4a26-a547-0063efca712f tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:57.762848 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8cf37d66-205f-46ee-98d8-4d7296098686 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13e05e253c94aadb1c089128ff35be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8510a519f14deea6f35a437419e161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:57.772871 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8cf37d66-205f-46ee-98d8-4d7296098686 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68" status: 200 len: 1489 microversion: 2.1 time: 0.442469 Oct 27 03:28:57.786723 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1055/2126] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:28:57 2022] GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68 => generated 1489 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:57.918063 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9df9eac8-b78d-4a26-a547-0063efca712f tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:57.927774 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9df9eac8-b78d-4a26-a547-0063efca712f tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:57.931599 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9df9eac8-b78d-4a26-a547-0063efca712f tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:57.931599 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9df9eac8-b78d-4a26-a547-0063efca712f tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223" status: 200 len: 1281 microversion: 2.25 time: 0.271597 Oct 27 03:28:57.932367 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1072/2127] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:28:57 2022] GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223 => generated 1281 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:28:57.937375 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f05332c7-ec7e-4b3d-bd6b-ace424771603 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:57.938300 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f05332c7-ec7e-4b3d-bd6b-ace424771603 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] [instance: 0fb1f450-692f-4979-a489-c13ab4106607] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:57.945125 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f05332c7-ec7e-4b3d-bd6b-ace424771603 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:57.945837 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f05332c7-ec7e-4b3d-bd6b-ace424771603 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:57.946571 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f05332c7-ec7e-4b3d-bd6b-ace424771603 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:57.947472 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f05332c7-ec7e-4b3d-bd6b-ace424771603 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:57.948107 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f05332c7-ec7e-4b3d-bd6b-ace424771603 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:57.948876 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f05332c7-ec7e-4b3d-bd6b-ace424771603 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:57.994095 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f05332c7-ec7e-4b3d-bd6b-ace424771603 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:57.994876 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f05332c7-ec7e-4b3d-bd6b-ace424771603 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:57.995622 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f05332c7-ec7e-4b3d-bd6b-ace424771603 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:57.996291 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-f05332c7-ec7e-4b3d-bd6b-ace424771603 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lazy-loading 'fault' on Instance uuid 0fb1f450-692f-4979-a489-c13ab4106607 {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:28:58.047440 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4a22ced9-a2b0-4533-bbc6-82b2160b876d tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:58.048082 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4a22ced9-a2b0-4533-bbc6-82b2160b876d tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] [instance: a8925d29-d9e0-4dbb-a73d-09473255fa34] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:58.059656 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4a22ced9-a2b0-4533-bbc6-82b2160b876d tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:58.063475 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4a22ced9-a2b0-4533-bbc6-82b2160b876d tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:58.063475 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4a22ced9-a2b0-4533-bbc6-82b2160b876d tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:58.063475 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4a22ced9-a2b0-4533-bbc6-82b2160b876d tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:58.063475 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4a22ced9-a2b0-4533-bbc6-82b2160b876d tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:58.063475 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4a22ced9-a2b0-4533-bbc6-82b2160b876d tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:58.078808 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f05332c7-ec7e-4b3d-bd6b-ace424771603 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b2717ace074a579d33c60964e6668a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3fc032a089f45efa4a66866a9c961c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:58.088556 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f05332c7-ec7e-4b3d-bd6b-ace424771603 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] 10.222.0.20 "GET /compute/v2.1/servers/0fb1f450-692f-4979-a489-c13ab4106607" status: 200 len: 1367 microversion: 2.1 time: 0.154751 Oct 27 03:28:58.089229 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1073/2128] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:28:57 2022] GET /compute/v2.1/servers/0fb1f450-692f-4979-a489-c13ab4106607 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:58.094115 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-83588e4f-4018-4154-9b2d-b8f30b6d5733 req-d9819cb8-875c-453e-9e58-f7ddc7e13505 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2aa6c062-32e4-453d-abb5-a51d96c66e2d", "name": "network-vif-plugged", "status": "completed", "tag": "af0e4888-29de-4d33-a94c-e1100b227c29"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:28:58.109949 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-83588e4f-4018-4154-9b2d-b8f30b6d5733 req-d9819cb8-875c-453e-9e58-f7ddc7e13505 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:58.110473 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-83588e4f-4018-4154-9b2d-b8f30b6d5733 req-d9819cb8-875c-453e-9e58-f7ddc7e13505 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:58.111228 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-83588e4f-4018-4154-9b2d-b8f30b6d5733 req-d9819cb8-875c-453e-9e58-f7ddc7e13505 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:58.126565 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-83588e4f-4018-4154-9b2d-b8f30b6d5733 req-d9819cb8-875c-453e-9e58-f7ddc7e13505 service nova] Creating event network-vif-plugged:af0e4888-29de-4d33-a94c-e1100b227c29 for instance 2aa6c062-32e4-453d-abb5-a51d96c66e2d on n-h1-862769-1 Oct 27 03:28:58.131449 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-83588e4f-4018-4154-9b2d-b8f30b6d5733 req-d9819cb8-875c-453e-9e58-f7ddc7e13505 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040961 Oct 27 03:28:58.132057 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1074/2129] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:28:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:28:58.353208 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1bc719b6-634b-41be-86a3-7f0e1a43be38 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:58.353933 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1bc719b6-634b-41be-86a3-7f0e1a43be38 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] [instance: 2aa6c062-32e4-453d-abb5-a51d96c66e2d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:58.364496 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1bc719b6-634b-41be-86a3-7f0e1a43be38 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:58.365158 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1bc719b6-634b-41be-86a3-7f0e1a43be38 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:58.365672 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1bc719b6-634b-41be-86a3-7f0e1a43be38 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:58.366948 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1bc719b6-634b-41be-86a3-7f0e1a43be38 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:58.367490 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1bc719b6-634b-41be-86a3-7f0e1a43be38 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:58.368289 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1bc719b6-634b-41be-86a3-7f0e1a43be38 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:58.475370 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4a22ced9-a2b0-4533-bbc6-82b2160b876d tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34" status: 200 len: 1533 microversion: 2.1 time: 0.686251 Oct 27 03:28:58.476217 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1056/2130] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:28:57 2022] GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34 => generated 1533 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:58.500137 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b40131eb-28f3-40da-9722-4217ec3a1972 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:58.501210 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b40131eb-28f3-40da-9722-4217ec3a1972 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] [instance: a8925d29-d9e0-4dbb-a73d-09473255fa34] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:58.515578 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b40131eb-28f3-40da-9722-4217ec3a1972 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:58.516454 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b40131eb-28f3-40da-9722-4217ec3a1972 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:58.517227 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b40131eb-28f3-40da-9722-4217ec3a1972 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:58.518193 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b40131eb-28f3-40da-9722-4217ec3a1972 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:58.523146 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b40131eb-28f3-40da-9722-4217ec3a1972 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:58.523146 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b40131eb-28f3-40da-9722-4217ec3a1972 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:58.576543 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=28 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:28:58.627155 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1bc719b6-634b-41be-86a3-7f0e1a43be38 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '071401bed74d48fe8ae2dbdb98aa81cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b0b534b9eb463aab0f13e838578da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:58.644624 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1bc719b6-634b-41be-86a3-7f0e1a43be38 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] 10.222.0.20 "GET /compute/v2.1/servers/2aa6c062-32e4-453d-abb5-a51d96c66e2d" status: 200 len: 1322 microversion: 2.1 time: 0.291783 Oct 27 03:28:58.644624 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1075/2131] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:28:58 2022] GET /compute/v2.1/servers/2aa6c062-32e4-453d-abb5-a51d96c66e2d => generated 1322 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:28:58.685848 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-135c03f5-47dd-4024-aafe-fa78d52465c0 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:58.687368 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-135c03f5-47dd-4024-aafe-fa78d52465c0 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 1352bd75-bfe6-48e3-a47d-314c7f13f692] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:58.691876 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b40131eb-28f3-40da-9722-4217ec3a1972 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34" status: 200 len: 1533 microversion: 2.1 time: 0.197670 Oct 27 03:28:58.692475 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1057/2132] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:28:58 2022] GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34 => generated 1533 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:28:58.698191 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-135c03f5-47dd-4024-aafe-fa78d52465c0 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:58.698834 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-135c03f5-47dd-4024-aafe-fa78d52465c0 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:58.699502 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-135c03f5-47dd-4024-aafe-fa78d52465c0 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:58.700460 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-135c03f5-47dd-4024-aafe-fa78d52465c0 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:58.701171 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-135c03f5-47dd-4024-aafe-fa78d52465c0 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:58.701881 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-135c03f5-47dd-4024-aafe-fa78d52465c0 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:58.716611 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-558ca0ca-af57-4433-9b17-3ef0471970f5 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:58.720553 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-558ca0ca-af57-4433-9b17-3ef0471970f5 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:58.721265 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-558ca0ca-af57-4433-9b17-3ef0471970f5 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:58.721701 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-558ca0ca-af57-4433-9b17-3ef0471970f5 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:58.722700 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-558ca0ca-af57-4433-9b17-3ef0471970f5 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:58.723342 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-558ca0ca-af57-4433-9b17-3ef0471970f5 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:58.724025 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-558ca0ca-af57-4433-9b17-3ef0471970f5 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:58.757286 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-558ca0ca-af57-4433-9b17-3ef0471970f5 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.045734 Oct 27 03:28:58.758611 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1058/2133] 10.222.0.20 () {58 vars in 1176 bytes} [Thu Oct 27 03:28:58 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:28:58.775787 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0aa2fefe-88e1-46a7-a26d-8016971a69e2 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-862769-1", "block_migration": false, "disk_over_commit": false}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:28:58.778392 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0aa2fefe-88e1-46a7-a26d-8016971a69e2 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] [instance: a8925d29-d9e0-4dbb-a73d-09473255fa34] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:58.784751 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0aa2fefe-88e1-46a7-a26d-8016971a69e2 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:58.785361 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0aa2fefe-88e1-46a7-a26d-8016971a69e2 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:58.786016 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0aa2fefe-88e1-46a7-a26d-8016971a69e2 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:58.786965 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0aa2fefe-88e1-46a7-a26d-8016971a69e2 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:58.787700 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0aa2fefe-88e1-46a7-a26d-8016971a69e2 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:58.788212 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0aa2fefe-88e1-46a7-a26d-8016971a69e2 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:58.817736 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-0aa2fefe-88e1-46a7-a26d-8016971a69e2 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lazy-loading 'flavor' on Instance uuid a8925d29-d9e0-4dbb-a73d-09473255fa34 {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:28:58.830491 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0aa2fefe-88e1-46a7-a26d-8016971a69e2 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] [instance: a8925d29-d9e0-4dbb-a73d-09473255fa34] Going to try to live migrate instance to n-h2-862769-1 {{(pid=121000) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 27 03:28:58.875237 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-135c03f5-47dd-4024-aafe-fa78d52465c0 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:58.883504 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-135c03f5-47dd-4024-aafe-fa78d52465c0 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/1352bd75-bfe6-48e3-a47d-314c7f13f692" status: 200 len: 1307 microversion: 2.1 time: 0.205245 Oct 27 03:28:58.884213 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1076/2134] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:28:58 2022] GET /compute/v2.1/servers/1352bd75-bfe6-48e3-a47d-314c7f13f692 => generated 1307 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:28:58.888962 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9905bea7-6db0-4c53-84e3-9c659f0f3859 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:58.889323 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-9905bea7-6db0-4c53-84e3-9c659f0f3859 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: 339287fc-37b6-455d-96ab-08ab8e2c3e68] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:58.895153 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9905bea7-6db0-4c53-84e3-9c659f0f3859 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:58.895643 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9905bea7-6db0-4c53-84e3-9c659f0f3859 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:58.896087 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9905bea7-6db0-4c53-84e3-9c659f0f3859 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:58.896793 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9905bea7-6db0-4c53-84e3-9c659f0f3859 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:58.897339 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9905bea7-6db0-4c53-84e3-9c659f0f3859 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:58.897667 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9905bea7-6db0-4c53-84e3-9c659f0f3859 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:59.051895 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9905bea7-6db0-4c53-84e3-9c659f0f3859 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13e05e253c94aadb1c089128ff35be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8510a519f14deea6f35a437419e161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:59.060935 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9905bea7-6db0-4c53-84e3-9c659f0f3859 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68" status: 200 len: 1477 microversion: 2.1 time: 0.175656 Oct 27 03:28:59.061866 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1077/2135] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:28:58 2022] GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68 => generated 1477 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:59.069912 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ac9a76ef-cb66-4f23-ae32-457e0df203a6 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:59.070895 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ac9a76ef-cb66-4f23-ae32-457e0df203a6 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: d5e6f604-9466-45c6-86a8-885cfb393223] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:59.073240 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:28:59.078676 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ac9a76ef-cb66-4f23-ae32-457e0df203a6 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:59.081499 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ac9a76ef-cb66-4f23-ae32-457e0df203a6 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:59.082607 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ac9a76ef-cb66-4f23-ae32-457e0df203a6 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:59.084179 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ac9a76ef-cb66-4f23-ae32-457e0df203a6 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:59.085260 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ac9a76ef-cb66-4f23-ae32-457e0df203a6 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:59.085704 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ac9a76ef-cb66-4f23-ae32-457e0df203a6 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:59.231149 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ac9a76ef-cb66-4f23-ae32-457e0df203a6 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:59.240278 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ac9a76ef-cb66-4f23-ae32-457e0df203a6 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:59.241772 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ac9a76ef-cb66-4f23-ae32-457e0df203a6 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:59.243059 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ac9a76ef-cb66-4f23-ae32-457e0df203a6 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223" status: 200 len: 1281 microversion: 2.25 time: 0.179456 Oct 27 03:28:59.243682 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1078/2136] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:28:59 2022] GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223 => generated 1281 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:28:59.248532 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ea86e5e0-2644-423d-8021-2337e7255511 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:59.249163 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ea86e5e0-2644-423d-8021-2337e7255511 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] [instance: 0fb1f450-692f-4979-a489-c13ab4106607] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:59.255663 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ea86e5e0-2644-423d-8021-2337e7255511 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:59.256607 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ea86e5e0-2644-423d-8021-2337e7255511 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:59.257235 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ea86e5e0-2644-423d-8021-2337e7255511 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:59.258000 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ea86e5e0-2644-423d-8021-2337e7255511 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:59.259442 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ea86e5e0-2644-423d-8021-2337e7255511 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:59.259442 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ea86e5e0-2644-423d-8021-2337e7255511 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:59.300558 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ea86e5e0-2644-423d-8021-2337e7255511 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:59.301048 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ea86e5e0-2644-423d-8021-2337e7255511 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:59.301501 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ea86e5e0-2644-423d-8021-2337e7255511 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:59.302285 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-ea86e5e0-2644-423d-8021-2337e7255511 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lazy-loading 'fault' on Instance uuid 0fb1f450-692f-4979-a489-c13ab4106607 {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:28:59.343267 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ea86e5e0-2644-423d-8021-2337e7255511 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b2717ace074a579d33c60964e6668a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3fc032a089f45efa4a66866a9c961c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:28:59.352018 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ea86e5e0-2644-423d-8021-2337e7255511 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] 10.222.0.20 "GET /compute/v2.1/servers/0fb1f450-692f-4979-a489-c13ab4106607" status: 200 len: 1367 microversion: 2.1 time: 0.106948 Oct 27 03:28:59.352593 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1079/2137] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:28:59 2022] GET /compute/v2.1/servers/0fb1f450-692f-4979-a489-c13ab4106607 => generated 1367 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:28:59.670865 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3f497f3a-905f-4f51-8622-cab7148c20f8 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:28:59.671548 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3f497f3a-905f-4f51-8622-cab7148c20f8 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] [instance: 2aa6c062-32e4-453d-abb5-a51d96c66e2d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:28:59.689565 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3f497f3a-905f-4f51-8622-cab7148c20f8 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:59.690085 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3f497f3a-905f-4f51-8622-cab7148c20f8 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:59.691244 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3f497f3a-905f-4f51-8622-cab7148c20f8 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:59.691978 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3f497f3a-905f-4f51-8622-cab7148c20f8 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:28:59.692436 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3f497f3a-905f-4f51-8622-cab7148c20f8 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:28:59.692868 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3f497f3a-905f-4f51-8622-cab7148c20f8 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:28:59.726865 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=100 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:29:00.163527 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3f497f3a-905f-4f51-8622-cab7148c20f8 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '071401bed74d48fe8ae2dbdb98aa81cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b0b534b9eb463aab0f13e838578da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:00.176536 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3f497f3a-905f-4f51-8622-cab7148c20f8 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] 10.222.0.20 "GET /compute/v2.1/servers/2aa6c062-32e4-453d-abb5-a51d96c66e2d" status: 200 len: 1322 microversion: 2.1 time: 0.506986 Oct 27 03:29:00.177807 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1080/2138] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:28:59 2022] GET /compute/v2.1/servers/2aa6c062-32e4-453d-abb5-a51d96c66e2d => generated 1322 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:29:00.200485 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-de58a6d1-867a-4b1d-bda8-b6848ee073ff tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:00.203426 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-de58a6d1-867a-4b1d-bda8-b6848ee073ff tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 1352bd75-bfe6-48e3-a47d-314c7f13f692] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:00.219539 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-de58a6d1-867a-4b1d-bda8-b6848ee073ff tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:00.221379 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-de58a6d1-867a-4b1d-bda8-b6848ee073ff tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:00.222710 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-de58a6d1-867a-4b1d-bda8-b6848ee073ff tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:00.227421 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-de58a6d1-867a-4b1d-bda8-b6848ee073ff tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:00.227726 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-de58a6d1-867a-4b1d-bda8-b6848ee073ff tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:00.228890 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-de58a6d1-867a-4b1d-bda8-b6848ee073ff tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:00.521142 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-de58a6d1-867a-4b1d-bda8-b6848ee073ff tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:00.532637 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-de58a6d1-867a-4b1d-bda8-b6848ee073ff tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/1352bd75-bfe6-48e3-a47d-314c7f13f692" status: 200 len: 1307 microversion: 2.1 time: 0.353371 Oct 27 03:29:00.533252 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1081/2139] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:00 2022] GET /compute/v2.1/servers/1352bd75-bfe6-48e3-a47d-314c7f13f692 => generated 1307 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:00.540071 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-499af589-8b6f-4123-bfc0-d5fc8b2a46a3 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:00.540708 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-499af589-8b6f-4123-bfc0-d5fc8b2a46a3 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: 339287fc-37b6-455d-96ab-08ab8e2c3e68] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:00.555949 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-499af589-8b6f-4123-bfc0-d5fc8b2a46a3 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:00.556380 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-499af589-8b6f-4123-bfc0-d5fc8b2a46a3 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:00.556830 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-499af589-8b6f-4123-bfc0-d5fc8b2a46a3 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:00.559694 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-499af589-8b6f-4123-bfc0-d5fc8b2a46a3 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:00.560546 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-499af589-8b6f-4123-bfc0-d5fc8b2a46a3 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:00.566684 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-499af589-8b6f-4123-bfc0-d5fc8b2a46a3 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:00.789333 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-499af589-8b6f-4123-bfc0-d5fc8b2a46a3 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13e05e253c94aadb1c089128ff35be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8510a519f14deea6f35a437419e161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:00.797320 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-499af589-8b6f-4123-bfc0-d5fc8b2a46a3 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68" status: 200 len: 1477 microversion: 2.1 time: 0.263021 Oct 27 03:29:00.797909 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1082/2140] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:00 2022] GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68 => generated 1477 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:00.806477 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-91c8c989-fbff-4638-a897-0ed137e72cc5 req-6c7879f5-fa5f-4236-b237-740fac0c9f10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5e6f604-9466-45c6-86a8-885cfb393223", "name": "network-vif-plugged", "status": "completed", "tag": "6b270560-e2de-41cb-9470-6571434ba8f2"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:29:00.819488 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-91c8c989-fbff-4638-a897-0ed137e72cc5 req-6c7879f5-fa5f-4236-b237-740fac0c9f10 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:00.820225 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-91c8c989-fbff-4638-a897-0ed137e72cc5 req-6c7879f5-fa5f-4236-b237-740fac0c9f10 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:00.820768 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-91c8c989-fbff-4638-a897-0ed137e72cc5 req-6c7879f5-fa5f-4236-b237-740fac0c9f10 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:00.834679 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-91c8c989-fbff-4638-a897-0ed137e72cc5 req-6c7879f5-fa5f-4236-b237-740fac0c9f10 service nova] Creating event network-vif-plugged:6b270560-e2de-41cb-9470-6571434ba8f2 for instance d5e6f604-9466-45c6-86a8-885cfb393223 on n-h1-862769-1 Oct 27 03:29:00.839793 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-91c8c989-fbff-4638-a897-0ed137e72cc5 req-6c7879f5-fa5f-4236-b237-740fac0c9f10 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036769 Oct 27 03:29:00.840482 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1083/2141] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:29:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:29:00.846150 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-19a080ad-f13e-4c76-a428-44acab07820e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:00.846953 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-19a080ad-f13e-4c76-a428-44acab07820e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: d5e6f604-9466-45c6-86a8-885cfb393223] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:00.854060 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-19a080ad-f13e-4c76-a428-44acab07820e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:00.856841 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-19a080ad-f13e-4c76-a428-44acab07820e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:00.856841 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-19a080ad-f13e-4c76-a428-44acab07820e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:00.856841 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-19a080ad-f13e-4c76-a428-44acab07820e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:00.856841 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-19a080ad-f13e-4c76-a428-44acab07820e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:00.856841 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-19a080ad-f13e-4c76-a428-44acab07820e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:01.270287 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-19a080ad-f13e-4c76-a428-44acab07820e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:01.282020 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-19a080ad-f13e-4c76-a428-44acab07820e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:01.286404 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-19a080ad-f13e-4c76-a428-44acab07820e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:01.288247 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-19a080ad-f13e-4c76-a428-44acab07820e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223" status: 200 len: 1281 microversion: 2.25 time: 0.445946 Oct 27 03:29:01.288837 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1084/2142] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:29:00 2022] GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223 => generated 1281 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:29:01.294328 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4d6f29c3-0365-400c-93fe-a1ad11e3aff4 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:01.295310 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4d6f29c3-0365-400c-93fe-a1ad11e3aff4 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] [instance: 0fb1f450-692f-4979-a489-c13ab4106607] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:01.301870 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4d6f29c3-0365-400c-93fe-a1ad11e3aff4 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:01.302599 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4d6f29c3-0365-400c-93fe-a1ad11e3aff4 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:01.304413 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4d6f29c3-0365-400c-93fe-a1ad11e3aff4 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:01.304413 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4d6f29c3-0365-400c-93fe-a1ad11e3aff4 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:01.305225 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4d6f29c3-0365-400c-93fe-a1ad11e3aff4 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:01.305817 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4d6f29c3-0365-400c-93fe-a1ad11e3aff4 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:01.325213 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-4d6f29c3-0365-400c-93fe-a1ad11e3aff4 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] HTTP exception thrown: Instance 0fb1f450-692f-4979-a489-c13ab4106607 could not be found. Oct 27 03:29:01.327431 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4d6f29c3-0365-400c-93fe-a1ad11e3aff4 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Request method failure captured: Oct 27 03:29:01.327431 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/0fb1f450-692f-4979-a489-c13ab4106607 HTTP/1.1 Oct 27 03:29:01.327431 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:29:01.327431 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:29:01.327431 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:29:01.327431 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:29:01.327431 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:29:01.327431 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:29:01.327431 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:29:01.327431 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:29:01.327431 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfqZ31uQzO7O2wt-T_4ZjL_GHcidh0PhHNUEAeiAqrFeOI2iNsiAOBMW2B1tz0V87Z5W853bOXMyFEt58kzmWcDzLuerUEralCUEaY0__gxVZRZ4iAwqiaaANC1XjBRwaNVFihepC_HR6nyZoiLO5hV10Joy2BLgCxE0FJP_tXA5RA0 Oct 27 03:29:01.327431 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:29:01.327431 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:29:01.327431 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:29:01.327431 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:29:01.327431 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:29:01.327431 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:29:01.327431 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: c3fc032a089f45efa4a66866a9c961c9 Oct 27 03:29:01.327431 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServersTestManualDisk-881850799 Oct 27 03:29:01.327431 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:29:01.327431 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:29:01.327431 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c3fc032a089f45efa4a66866a9c961c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c3fc032a089f45efa4a66866a9c961c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c3fc032a089f45efa4a66866a9c961c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c3fc032a089f45efa4a66866a9c961c9"}]}] Oct 27 03:29:01.327431 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServersTestManualDisk-881850799 Oct 27 03:29:01.327431 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: c3fc032a089f45efa4a66866a9c961c9 Oct 27 03:29:01.327431 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServersTestManualDisk-881850799 Oct 27 03:29:01.327431 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServersTestManualDisk-881850799-project Oct 27 03:29:01.327431 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:29:01.327431 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:29:01.327431 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 17b2717ace074a579d33c60964e6668a Oct 27 03:29:01.327431 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServersTestManualDisk-881850799-project Oct 27 03:29:01.327431 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:29:01.327431 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 0fb1f450-692f-4979-a489-c13ab4106607 could not be found. Oct 27 03:29:01.327431 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '0fb1f450-692f-4979-a489-c13ab4106607'} Oct 27 03:29:01.327431 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:29:01.327431 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:29:01.327431 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:29:01.327431 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:29:01.327431 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:29:01.327431 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:29:01.327431 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:29:01.327431 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:29:01.327431 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:29:01.327431 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:29:01.327431 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fb1f450-692f-4979-a489-c13ab4106607 could not be found. Oct 27 03:29:01.327431 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:29:01.327431 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:29:01.327431 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:29:01.327431 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:29:01.327431 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:29:01.327431 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:29:01.327431 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:29:01.327431 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:29:01.327431 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:29:01.327431 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:29:01.327431 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:29:01.327431 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:29:01.327431 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:29:01.327431 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:29:01.327431 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:29:01.327431 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:29:01.327431 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fb1f450-692f-4979-a489-c13ab4106607 could not be found. Oct 27 03:29:01.327431 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:29:01.327431 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:29:01.327431 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:29:01.334726 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:29:01.334726 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:29:01.334726 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:29:01.334726 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:29:01.334726 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:29:01.334726 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fb1f450-692f-4979-a489-c13ab4106607 could not be found. Oct 27 03:29:01.334726 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:29:01.334726 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4d6f29c3-0365-400c-93fe-a1ad11e3aff4 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Returning 404 to user: Instance 0fb1f450-692f-4979-a489-c13ab4106607 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:29:01.334726 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4d6f29c3-0365-400c-93fe-a1ad11e3aff4 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] 10.222.0.20 "GET /compute/v2.1/servers/0fb1f450-692f-4979-a489-c13ab4106607" status: 404 len: 111 microversion: 2.1 time: 0.039340 Oct 27 03:29:01.334726 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1085/2143] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:01 2022] GET /compute/v2.1/servers/0fb1f450-692f-4979-a489-c13ab4106607 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:29:01.562823 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a545378f-b511-4f23-a39b-434791514190 tempest-AbsoluteLimitsNegativeTestJSON-1285679272 tempest-AbsoluteLimitsNegativeTestJSON-1285679272-project] Calling method '.version_select at 0x7f7dded2c8b0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:01.586554 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a545378f-b511-4f23-a39b-434791514190 tempest-AbsoluteLimitsNegativeTestJSON-1285679272 tempest-AbsoluteLimitsNegativeTestJSON-1285679272-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:01.587600 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a545378f-b511-4f23-a39b-434791514190 tempest-AbsoluteLimitsNegativeTestJSON-1285679272 tempest-AbsoluteLimitsNegativeTestJSON-1285679272-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:01.588243 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a545378f-b511-4f23-a39b-434791514190 tempest-AbsoluteLimitsNegativeTestJSON-1285679272 tempest-AbsoluteLimitsNegativeTestJSON-1285679272-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:01.589328 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a545378f-b511-4f23-a39b-434791514190 tempest-AbsoluteLimitsNegativeTestJSON-1285679272 tempest-AbsoluteLimitsNegativeTestJSON-1285679272-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:01.590008 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a545378f-b511-4f23-a39b-434791514190 tempest-AbsoluteLimitsNegativeTestJSON-1285679272 tempest-AbsoluteLimitsNegativeTestJSON-1285679272-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:01.590770 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a545378f-b511-4f23-a39b-434791514190 tempest-AbsoluteLimitsNegativeTestJSON-1285679272 tempest-AbsoluteLimitsNegativeTestJSON-1285679272-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:01.651443 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a545378f-b511-4f23-a39b-434791514190 tempest-AbsoluteLimitsNegativeTestJSON-1285679272 tempest-AbsoluteLimitsNegativeTestJSON-1285679272-project] 10.222.0.20 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.315561 Oct 27 03:29:01.659644 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1086/2144] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Oct 27 03:29:01 2022] GET /compute/v2.1/limits => generated 511 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:29:01.684940 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-765fd550-7b97-48f9-959e-26125f95d932 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:01.684940 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-765fd550-7b97-48f9-959e-26125f95d932 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] [instance: 2aa6c062-32e4-453d-abb5-a51d96c66e2d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:01.713465 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-765fd550-7b97-48f9-959e-26125f95d932 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:01.714430 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-765fd550-7b97-48f9-959e-26125f95d932 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:01.719958 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-765fd550-7b97-48f9-959e-26125f95d932 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:01.720901 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-765fd550-7b97-48f9-959e-26125f95d932 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:01.721829 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-765fd550-7b97-48f9-959e-26125f95d932 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:01.722487 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-765fd550-7b97-48f9-959e-26125f95d932 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:02.124022 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-765fd550-7b97-48f9-959e-26125f95d932 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '071401bed74d48fe8ae2dbdb98aa81cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b0b534b9eb463aab0f13e838578da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:02.134184 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-765fd550-7b97-48f9-959e-26125f95d932 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] 10.222.0.20 "GET /compute/v2.1/servers/2aa6c062-32e4-453d-abb5-a51d96c66e2d" status: 200 len: 1514 microversion: 2.1 time: 0.478363 Oct 27 03:29:02.135978 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1087/2145] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:01 2022] GET /compute/v2.1/servers/2aa6c062-32e4-453d-abb5-a51d96c66e2d => generated 1514 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:02.141041 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-66ed0aab-8415-49e8-a6aa-1f85673dbda3 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] Calling method '.version_select at 0x7f7ddee4aaf0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:02.222786 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-66ed0aab-8415-49e8-a6aa-1f85673dbda3 tempest-ServersTestManualDisk-881850799 tempest-ServersTestManualDisk-881850799-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1265828847" status: 202 len: 0 microversion: 2.1 time: 0.084899 Oct 27 03:29:02.224440 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1088/2146] 10.222.0.20 () {58 vars in 1221 bytes} [Thu Oct 27 03:29:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1265828847 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:29:02.232553 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1603cf99-7a86-44ec-81ce-b94a6e307602 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:02.233447 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1603cf99-7a86-44ec-81ce-b94a6e307602 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 1352bd75-bfe6-48e3-a47d-314c7f13f692] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:02.241976 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1603cf99-7a86-44ec-81ce-b94a6e307602 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:02.242990 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1603cf99-7a86-44ec-81ce-b94a6e307602 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:02.243663 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1603cf99-7a86-44ec-81ce-b94a6e307602 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:02.245387 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1603cf99-7a86-44ec-81ce-b94a6e307602 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:02.246221 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1603cf99-7a86-44ec-81ce-b94a6e307602 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:02.246962 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1603cf99-7a86-44ec-81ce-b94a6e307602 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:02.647946 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1603cf99-7a86-44ec-81ce-b94a6e307602 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:02.680535 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1603cf99-7a86-44ec-81ce-b94a6e307602 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/1352bd75-bfe6-48e3-a47d-314c7f13f692" status: 200 len: 1307 microversion: 2.1 time: 0.454665 Oct 27 03:29:02.692981 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1089/2147] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:02 2022] GET /compute/v2.1/servers/1352bd75-bfe6-48e3-a47d-314c7f13f692 => generated 1307 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:02.715311 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-574ef39c-8315-427f-8c0e-75c9f1a65807 tempest-AbsoluteLimitsNegativeTestJSON-1285679272 tempest-AbsoluteLimitsNegativeTestJSON-1285679272-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1643417437", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:29:02.786239 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.network.neutron [None req-574ef39c-8315-427f-8c0e-75c9f1a65807 tempest-AbsoluteLimitsNegativeTestJSON-1285679272 tempest-AbsoluteLimitsNegativeTestJSON-1285679272-project] validate_networks() for None {{(pid=121001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:29:03.242023 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-574ef39c-8315-427f-8c0e-75c9f1a65807 tempest-AbsoluteLimitsNegativeTestJSON-1285679272 tempest-AbsoluteLimitsNegativeTestJSON-1285679272-project] Getting quotas for project d3388bf820a843ca8a09898ef14093f2. Resources: dict_keys(['metadata_items']) {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:29:03.248478 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-574ef39c-8315-427f-8c0e-75c9f1a65807 tempest-AbsoluteLimitsNegativeTestJSON-1285679272 tempest-AbsoluteLimitsNegativeTestJSON-1285679272-project] Getting quotas for user fba9d6d7bae4487fbc1ea124661df8b3 and project d3388bf820a843ca8a09898ef14093f2. Resources: dict_keys(['metadata_items']) {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:29:03.263260 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-574ef39c-8315-427f-8c0e-75c9f1a65807 tempest-AbsoluteLimitsNegativeTestJSON-1285679272 tempest-AbsoluteLimitsNegativeTestJSON-1285679272-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Oct 27 03:29:03.268204 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-574ef39c-8315-427f-8c0e-75c9f1a65807 tempest-AbsoluteLimitsNegativeTestJSON-1285679272 tempest-AbsoluteLimitsNegativeTestJSON-1285679272-project] Request method failure captured: Oct 27 03:29:03.268204 n-d-862769-1 devstack@n-api.service[121001]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 03:29:03.268204 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:29:03.268204 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:29:03.268204 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:29:03.268204 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 1752 Oct 27 03:29:03.268204 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:29:03.268204 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:29:03.268204 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:29:03.268204 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:29:03.268204 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfr8DY9BUkCN4-CJwtqftoNeEDHAgho4As0KL71va7SKLipKJZ1QX50n_JBnnxvo2ph-JZTfgUhC-fNWliHm0l_ZRPTLGSyYjMp3F3YyKCGhO2y7ca6ppxu8yE3UETc2RBvFlQ3GNaC9CQrCjEqiobAHUZP-dXvDLRPCmXuaJxtvzcs Oct 27 03:29:03.268204 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:29:03.268204 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:29:03.268204 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:29:03.268204 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:29:03.268204 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:29:03.268204 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:29:03.268204 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: d3388bf820a843ca8a09898ef14093f2 Oct 27 03:29:03.268204 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-1285679272 Oct 27 03:29:03.268204 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:29:03.268204 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:29:03.268204 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d3388bf820a843ca8a09898ef14093f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d3388bf820a843ca8a09898ef14093f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d3388bf820a843ca8a09898ef14093f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d3388bf820a843ca8a09898ef14093f2"}]}] Oct 27 03:29:03.268204 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-1285679272 Oct 27 03:29:03.268204 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: d3388bf820a843ca8a09898ef14093f2 Oct 27 03:29:03.268204 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-1285679272 Oct 27 03:29:03.268204 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-1285679272-project Oct 27 03:29:03.268204 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:29:03.268204 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:29:03.268204 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: fba9d6d7bae4487fbc1ea124661df8b3 Oct 27 03:29:03.268204 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-1285679272-project Oct 27 03:29:03.268204 n-d-862769-1 devstack@n-api.service[121001]: Oct 27 03:29:03.268204 n-d-862769-1 devstack@n-api.service[121001]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1643417437", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Oct 27 03:29:03.268204 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:29:03.268204 n-d-862769-1 devstack@n-api.service[121001]: exception: Maximum number of metadata items exceeds 128 Oct 27 03:29:03.274231 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-1643417437', 'imageRef': 'c40fb871-5877-4b59-ab69-d9fd23b7a917', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Oct 27 03:29:03.274231 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:29:03.274231 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:29:03.274231 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Oct 27 03:29:03.274231 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Oct 27 03:29:03.274231 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 03:29:03.274231 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 03:29:03.274231 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Oct 27 03:29:03.274231 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Oct 27 03:29:03.274231 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Oct 27 03:29:03.274231 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Oct 27 03:29:03.274231 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Oct 27 03:29:03.274231 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Oct 27 03:29:03.274231 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Oct 27 03:29:03.274231 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:29:03.274231 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:29:03.274231 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:29:03.274231 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:29:03.274231 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 27 03:29:03.274231 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 27 03:29:03.274231 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 27 03:29:03.274231 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 27 03:29:03.274231 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 27 03:29:03.274231 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 27 03:29:03.274231 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Oct 27 03:29:03.274231 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Oct 27 03:29:03.274231 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Oct 27 03:29:03.274231 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Oct 27 03:29:03.274231 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Oct 27 03:29:03.274231 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:29:03.274231 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:29:03.274231 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:29:03.274231 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:29:03.274231 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:29:03.274231 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:29:03.274231 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:29:03.274231 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:29:03.274231 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:29:03.274231 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:29:03.274231 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:29:03.274231 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:29:03.274231 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:29:03.274231 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:29:03.274231 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:29:03.279196 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:29:03.279196 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 27 03:29:03.279196 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 27 03:29:03.279196 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 27 03:29:03.279196 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Oct 27 03:29:03.279196 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:29:03.279196 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:29:03.279196 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:29:03.279196 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:29:03.279196 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:29:03.279196 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:29:03.279196 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:29:03.279196 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:29:03.279196 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Oct 27 03:29:03.279196 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:29:03.281405 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-574ef39c-8315-427f-8c0e-75c9f1a65807 tempest-AbsoluteLimitsNegativeTestJSON-1285679272 tempest-AbsoluteLimitsNegativeTestJSON-1285679272-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:29:03.282521 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-574ef39c-8315-427f-8c0e-75c9f1a65807 tempest-AbsoluteLimitsNegativeTestJSON-1285679272 tempest-AbsoluteLimitsNegativeTestJSON-1285679272-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.588454 Oct 27 03:29:03.283716 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1090/2148] 10.222.0.20 () {60 vars in 1148 bytes} [Thu Oct 27 03:29:02 2022] POST /compute/v2.1/servers => generated 87 bytes in 590 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Oct 27 03:29:03.290582 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b3c85b4f-a7bd-473d-ae54-4d5d4e012268 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:03.291412 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b3c85b4f-a7bd-473d-ae54-4d5d4e012268 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: 339287fc-37b6-455d-96ab-08ab8e2c3e68] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:03.298543 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b3c85b4f-a7bd-473d-ae54-4d5d4e012268 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:03.299285 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b3c85b4f-a7bd-473d-ae54-4d5d4e012268 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:03.299896 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b3c85b4f-a7bd-473d-ae54-4d5d4e012268 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:03.301425 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b3c85b4f-a7bd-473d-ae54-4d5d4e012268 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:03.302073 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b3c85b4f-a7bd-473d-ae54-4d5d4e012268 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:03.305501 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b3c85b4f-a7bd-473d-ae54-4d5d4e012268 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:03.453380 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0aa2fefe-88e1-46a7-a26d-8016971a69e2 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34/action" status: 202 len: 0 microversion: 2.1 time: 4.681593 Oct 27 03:29:03.454308 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1059/2149] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:28:58 2022] POST /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34/action => generated 0 bytes in 4684 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:29:03.460426 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d573ad9a-e4b2-4457-bce2-0852456001e4 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:03.461522 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d573ad9a-e4b2-4457-bce2-0852456001e4 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] [instance: b3dd0fa3-e3b4-471c-b65b-0a190b7c4701] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:03.511229 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d573ad9a-e4b2-4457-bce2-0852456001e4 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:03.512482 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d573ad9a-e4b2-4457-bce2-0852456001e4 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:03.512623 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d573ad9a-e4b2-4457-bce2-0852456001e4 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:03.516606 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d573ad9a-e4b2-4457-bce2-0852456001e4 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:03.517373 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d573ad9a-e4b2-4457-bce2-0852456001e4 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:03.518572 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d573ad9a-e4b2-4457-bce2-0852456001e4 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:03.562853 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b3c85b4f-a7bd-473d-ae54-4d5d4e012268 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13e05e253c94aadb1c089128ff35be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8510a519f14deea6f35a437419e161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:03.582134 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b3c85b4f-a7bd-473d-ae54-4d5d4e012268 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68" status: 200 len: 1477 microversion: 2.1 time: 0.288578 Oct 27 03:29:03.593554 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1091/2150] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:03 2022] GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68 => generated 1477 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:03.624501 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4d49de0c-1ca4-4b21-8350-87f1c5f2cd24 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:03.626525 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4d49de0c-1ca4-4b21-8350-87f1c5f2cd24 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: d5e6f604-9466-45c6-86a8-885cfb393223] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:03.640885 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4d49de0c-1ca4-4b21-8350-87f1c5f2cd24 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:03.643531 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4d49de0c-1ca4-4b21-8350-87f1c5f2cd24 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:03.658760 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4d49de0c-1ca4-4b21-8350-87f1c5f2cd24 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:03.661619 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4d49de0c-1ca4-4b21-8350-87f1c5f2cd24 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:03.664977 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4d49de0c-1ca4-4b21-8350-87f1c5f2cd24 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:03.666326 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4d49de0c-1ca4-4b21-8350-87f1c5f2cd24 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:03.898206 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d573ad9a-e4b2-4457-bce2-0852456001e4 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '071401bed74d48fe8ae2dbdb98aa81cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b0b534b9eb463aab0f13e838578da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:03.911180 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d573ad9a-e4b2-4457-bce2-0852456001e4 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] 10.222.0.20 "GET /compute/v2.1/servers/b3dd0fa3-e3b4-471c-b65b-0a190b7c4701" status: 200 len: 1322 microversion: 2.1 time: 0.453402 Oct 27 03:29:03.912055 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1060/2151] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:03 2022] GET /compute/v2.1/servers/b3dd0fa3-e3b4-471c-b65b-0a190b7c4701 => generated 1322 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:03.927345 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-0eec5a09-974e-48b5-bb18-4310a1aab4e8 req-8eb9d47f-2769-4206-b9b9-7439698ed7d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1352bd75-bfe6-48e3-a47d-314c7f13f692", "name": "network-vif-plugged", "status": "completed", "tag": "8ca76995-7735-4198-800f-a31ff3fd6a13"}, {"server_uuid": "339287fc-37b6-455d-96ab-08ab8e2c3e68", "name": "network-vif-unplugged", "status": "completed", "tag": "b6134fcc-5cb7-4dad-a3b5-156ca229326d"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:29:03.941887 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-0eec5a09-974e-48b5-bb18-4310a1aab4e8 req-8eb9d47f-2769-4206-b9b9-7439698ed7d3 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:03.942648 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-0eec5a09-974e-48b5-bb18-4310a1aab4e8 req-8eb9d47f-2769-4206-b9b9-7439698ed7d3 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:03.943326 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-0eec5a09-974e-48b5-bb18-4310a1aab4e8 req-8eb9d47f-2769-4206-b9b9-7439698ed7d3 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:03.962769 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-0eec5a09-974e-48b5-bb18-4310a1aab4e8 req-8eb9d47f-2769-4206-b9b9-7439698ed7d3 service nova] Creating event network-vif-plugged:8ca76995-7735-4198-800f-a31ff3fd6a13 for instance 1352bd75-bfe6-48e3-a47d-314c7f13f692 on n-h2-862769-1 Oct 27 03:29:03.963558 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-0eec5a09-974e-48b5-bb18-4310a1aab4e8 req-8eb9d47f-2769-4206-b9b9-7439698ed7d3 service nova] Creating event network-vif-unplugged:b6134fcc-5cb7-4dad-a3b5-156ca229326d for instance 339287fc-37b6-455d-96ab-08ab8e2c3e68 on n-h2-862769-1 Oct 27 03:29:03.973259 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-0eec5a09-974e-48b5-bb18-4310a1aab4e8 req-8eb9d47f-2769-4206-b9b9-7439698ed7d3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.059143 Oct 27 03:29:03.975122 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1061/2152] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:29:03 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:29:03.984579 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1e85b785-25a2-4611-9fc2-7218297de2e8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:03.985711 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1e85b785-25a2-4611-9fc2-7218297de2e8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: a8925d29-d9e0-4dbb-a73d-09473255fa34] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:03.994831 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1e85b785-25a2-4611-9fc2-7218297de2e8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:03.994831 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1e85b785-25a2-4611-9fc2-7218297de2e8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:03.995575 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1e85b785-25a2-4611-9fc2-7218297de2e8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:03.996680 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1e85b785-25a2-4611-9fc2-7218297de2e8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:03.997605 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1e85b785-25a2-4611-9fc2-7218297de2e8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:04.016057 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1e85b785-25a2-4611-9fc2-7218297de2e8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:04.047285 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:29:04.073537 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4d49de0c-1ca4-4b21-8350-87f1c5f2cd24 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:04.089359 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4d49de0c-1ca4-4b21-8350-87f1c5f2cd24 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:04.092085 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4d49de0c-1ca4-4b21-8350-87f1c5f2cd24 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:04.093927 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4d49de0c-1ca4-4b21-8350-87f1c5f2cd24 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223" status: 200 len: 1477 microversion: 2.25 time: 0.498490 Oct 27 03:29:04.094752 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1092/2153] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:29:03 2022] GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223 => generated 1477 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:29:04.101134 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8a5b62e2-360e-4e27-af8b-767f95d01d80 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:04.102159 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8a5b62e2-360e-4e27-af8b-767f95d01d80 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 1352bd75-bfe6-48e3-a47d-314c7f13f692] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:04.123784 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8a5b62e2-360e-4e27-af8b-767f95d01d80 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:04.124314 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8a5b62e2-360e-4e27-af8b-767f95d01d80 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:04.124729 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8a5b62e2-360e-4e27-af8b-767f95d01d80 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:04.127183 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8a5b62e2-360e-4e27-af8b-767f95d01d80 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:04.127864 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8a5b62e2-360e-4e27-af8b-767f95d01d80 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:04.130781 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8a5b62e2-360e-4e27-af8b-767f95d01d80 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:04.408246 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8a5b62e2-360e-4e27-af8b-767f95d01d80 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:04.416583 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8a5b62e2-360e-4e27-af8b-767f95d01d80 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/1352bd75-bfe6-48e3-a47d-314c7f13f692" status: 200 len: 1307 microversion: 2.1 time: 0.320536 Oct 27 03:29:04.430526 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1093/2154] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:04 2022] GET /compute/v2.1/servers/1352bd75-bfe6-48e3-a47d-314c7f13f692 => generated 1307 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:04.593253 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1e85b785-25a2-4611-9fc2-7218297de2e8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:04.605463 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1e85b785-25a2-4611-9fc2-7218297de2e8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34" status: 200 len: 1392 microversion: 2.1 time: 0.626863 Oct 27 03:29:04.607226 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1062/2155] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:03 2022] GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34 => generated 1392 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:04.624875 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-dc8eca16-7be4-4e87-a6ac-a3fa4c1ac42a tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:04.625912 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-dc8eca16-7be4-4e87-a6ac-a3fa4c1ac42a tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: 339287fc-37b6-455d-96ab-08ab8e2c3e68] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:04.634027 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dc8eca16-7be4-4e87-a6ac-a3fa4c1ac42a tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:04.634970 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dc8eca16-7be4-4e87-a6ac-a3fa4c1ac42a tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:04.635588 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dc8eca16-7be4-4e87-a6ac-a3fa4c1ac42a tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:04.636510 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dc8eca16-7be4-4e87-a6ac-a3fa4c1ac42a tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:04.637161 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dc8eca16-7be4-4e87-a6ac-a3fa4c1ac42a tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:04.637763 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dc8eca16-7be4-4e87-a6ac-a3fa4c1ac42a tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:04.772706 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-bc2fc31c-b10e-4148-8a25-573fa94396fc tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:04.778045 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-bc2fc31c-b10e-4148-8a25-573fa94396fc tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] [instance: d5e6f604-9466-45c6-86a8-885cfb393223] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:04.783165 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bc2fc31c-b10e-4148-8a25-573fa94396fc tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:04.786613 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bc2fc31c-b10e-4148-8a25-573fa94396fc tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:04.786946 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bc2fc31c-b10e-4148-8a25-573fa94396fc tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:04.787695 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bc2fc31c-b10e-4148-8a25-573fa94396fc tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:04.788164 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bc2fc31c-b10e-4148-8a25-573fa94396fc tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:04.788598 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bc2fc31c-b10e-4148-8a25-573fa94396fc tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:05.458815 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-dc8eca16-7be4-4e87-a6ac-a3fa4c1ac42a tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13e05e253c94aadb1c089128ff35be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8510a519f14deea6f35a437419e161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:05.484368 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-dc8eca16-7be4-4e87-a6ac-a3fa4c1ac42a tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68" status: 200 len: 1477 microversion: 2.1 time: 0.871409 Oct 27 03:29:05.484828 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-bc2fc31c-b10e-4148-8a25-573fa94396fc tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lazy-loading 'services' on Instance uuid d5e6f604-9466-45c6-86a8-885cfb393223 {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:29:05.486518 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1063/2156] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:04 2022] GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68 => generated 1477 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:29:05.502838 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a02e793a-e671-4f25-803f-1a7e17ecd2d7 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:05.503965 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a02e793a-e671-4f25-803f-1a7e17ecd2d7 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] [instance: b3dd0fa3-e3b4-471c-b65b-0a190b7c4701] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:05.517670 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a02e793a-e671-4f25-803f-1a7e17ecd2d7 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:05.519545 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a02e793a-e671-4f25-803f-1a7e17ecd2d7 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:05.520957 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a02e793a-e671-4f25-803f-1a7e17ecd2d7 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:05.521724 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a02e793a-e671-4f25-803f-1a7e17ecd2d7 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:05.522751 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a02e793a-e671-4f25-803f-1a7e17ecd2d7 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:05.523375 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a02e793a-e671-4f25-803f-1a7e17ecd2d7 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:05.530962 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-bc2fc31c-b10e-4148-8a25-573fa94396fc tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223" status: 200 len: 1970 microversion: 2.25 time: 1.085977 Oct 27 03:29:05.530962 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1094/2157] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:29:04 2022] GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223 => generated 1970 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:29:05.545820 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-356ac785-131a-495c-8a0e-14e7caf13a18 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:05.546544 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-356ac785-131a-495c-8a0e-14e7caf13a18 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 1352bd75-bfe6-48e3-a47d-314c7f13f692] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:05.553708 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-356ac785-131a-495c-8a0e-14e7caf13a18 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:05.554531 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-356ac785-131a-495c-8a0e-14e7caf13a18 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:05.554980 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-356ac785-131a-495c-8a0e-14e7caf13a18 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:05.555707 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-356ac785-131a-495c-8a0e-14e7caf13a18 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:05.556169 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-356ac785-131a-495c-8a0e-14e7caf13a18 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:05.556637 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-356ac785-131a-495c-8a0e-14e7caf13a18 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:05.887595 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a02e793a-e671-4f25-803f-1a7e17ecd2d7 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '071401bed74d48fe8ae2dbdb98aa81cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b0b534b9eb463aab0f13e838578da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:05.897596 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a02e793a-e671-4f25-803f-1a7e17ecd2d7 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] 10.222.0.20 "GET /compute/v2.1/servers/b3dd0fa3-e3b4-471c-b65b-0a190b7c4701" status: 200 len: 1322 microversion: 2.1 time: 0.409346 Oct 27 03:29:05.906344 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1064/2158] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:05 2022] GET /compute/v2.1/servers/b3dd0fa3-e3b4-471c-b65b-0a190b7c4701 => generated 1322 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:05.906344 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7fc6f084-b06b-474d-9aa2-cd44990a456a tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:05.906344 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7fc6f084-b06b-474d-9aa2-cd44990a456a tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] [instance: d5e6f604-9466-45c6-86a8-885cfb393223] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:05.913244 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7fc6f084-b06b-474d-9aa2-cd44990a456a tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:05.914134 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7fc6f084-b06b-474d-9aa2-cd44990a456a tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:05.914527 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7fc6f084-b06b-474d-9aa2-cd44990a456a tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:05.915370 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7fc6f084-b06b-474d-9aa2-cd44990a456a tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:05.915903 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7fc6f084-b06b-474d-9aa2-cd44990a456a tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:05.916424 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7fc6f084-b06b-474d-9aa2-cd44990a456a tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:05.917495 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-356ac785-131a-495c-8a0e-14e7caf13a18 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:05.926745 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-356ac785-131a-495c-8a0e-14e7caf13a18 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/1352bd75-bfe6-48e3-a47d-314c7f13f692" status: 200 len: 1307 microversion: 2.1 time: 0.387517 Oct 27 03:29:05.927686 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1095/2159] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:05 2022] GET /compute/v2.1/servers/1352bd75-bfe6-48e3-a47d-314c7f13f692 => generated 1307 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:05.932701 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-cb1b1f6c-f652-4a11-8568-091faaebd7d4 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:05.933752 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-cb1b1f6c-f652-4a11-8568-091faaebd7d4 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: a8925d29-d9e0-4dbb-a73d-09473255fa34] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:05.942592 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cb1b1f6c-f652-4a11-8568-091faaebd7d4 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:05.943364 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cb1b1f6c-f652-4a11-8568-091faaebd7d4 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:05.943866 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cb1b1f6c-f652-4a11-8568-091faaebd7d4 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:05.944593 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cb1b1f6c-f652-4a11-8568-091faaebd7d4 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:05.945057 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cb1b1f6c-f652-4a11-8568-091faaebd7d4 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:05.945492 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cb1b1f6c-f652-4a11-8568-091faaebd7d4 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:06.187194 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-cb1b1f6c-f652-4a11-8568-091faaebd7d4 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:06.196758 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-cb1b1f6c-f652-4a11-8568-091faaebd7d4 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34" status: 200 len: 1392 microversion: 2.1 time: 0.267994 Oct 27 03:29:06.197356 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1096/2160] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:05 2022] GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34 => generated 1392 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:06.215324 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-2bf2b7c0-bd6b-442c-9f01-eb6b0075f865 req-572fe69e-f5e7-4456-bd34-2724740c0fdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3dd0fa3-e3b4-471c-b65b-0a190b7c4701", "name": "network-vif-plugged", "status": "completed", "tag": "3d125c26-92dc-4d95-bb25-7ab8a7e32c49"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:29:06.240654 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-2bf2b7c0-bd6b-442c-9f01-eb6b0075f865 req-572fe69e-f5e7-4456-bd34-2724740c0fdc service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:06.241619 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-2bf2b7c0-bd6b-442c-9f01-eb6b0075f865 req-572fe69e-f5e7-4456-bd34-2724740c0fdc service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:06.242347 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-2bf2b7c0-bd6b-442c-9f01-eb6b0075f865 req-572fe69e-f5e7-4456-bd34-2724740c0fdc service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:06.278834 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-2bf2b7c0-bd6b-442c-9f01-eb6b0075f865 req-572fe69e-f5e7-4456-bd34-2724740c0fdc service nova] Creating event network-vif-plugged:3d125c26-92dc-4d95-bb25-7ab8a7e32c49 for instance b3dd0fa3-e3b4-471c-b65b-0a190b7c4701 on n-h2-862769-1 Oct 27 03:29:06.301458 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-2bf2b7c0-bd6b-442c-9f01-eb6b0075f865 req-572fe69e-f5e7-4456-bd34-2724740c0fdc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096353 Oct 27 03:29:06.302829 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1097/2161] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:29:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:29:06.472028 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-7fc6f084-b06b-474d-9aa2-cd44990a456a tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lazy-loading 'services' on Instance uuid d5e6f604-9466-45c6-86a8-885cfb393223 {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:29:06.489952 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7fc6f084-b06b-474d-9aa2-cd44990a456a tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223" status: 200 len: 1970 microversion: 2.25 time: 0.589374 Oct 27 03:29:06.491795 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1065/2162] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:29:05 2022] GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223 => generated 1970 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:29:06.520945 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-767501f1-b7e8-458c-a851-5c77a0778649 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:06.523756 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-23440157-7ae9-48d2-b33b-28a60b4b2381 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:06.524960 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-767501f1-b7e8-458c-a851-5c77a0778649 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: 339287fc-37b6-455d-96ab-08ab8e2c3e68] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:06.528360 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-23440157-7ae9-48d2-b33b-28a60b4b2381 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:06.528998 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-23440157-7ae9-48d2-b33b-28a60b4b2381 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:06.529532 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-23440157-7ae9-48d2-b33b-28a60b4b2381 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:06.530404 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-23440157-7ae9-48d2-b33b-28a60b4b2381 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:06.531668 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-23440157-7ae9-48d2-b33b-28a60b4b2381 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:06.536579 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-23440157-7ae9-48d2-b33b-28a60b4b2381 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:06.550805 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-767501f1-b7e8-458c-a851-5c77a0778649 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:06.552070 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-767501f1-b7e8-458c-a851-5c77a0778649 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:06.553030 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-767501f1-b7e8-458c-a851-5c77a0778649 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:06.559828 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-767501f1-b7e8-458c-a851-5c77a0778649 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:06.562400 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-23440157-7ae9-48d2-b33b-28a60b4b2381 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.044529 Oct 27 03:29:06.563671 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-767501f1-b7e8-458c-a851-5c77a0778649 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:06.566448 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-767501f1-b7e8-458c-a851-5c77a0778649 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:06.571548 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1066/2163] 10.222.0.20 () {60 vars in 1217 bytes} [Thu Oct 27 03:29:06 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 03:29:06.576645 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e87a3c45-2aac-400f-a528-0f7b448b38d1 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-862769-1", "block_migration": "auto"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:29:06.579776 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e87a3c45-2aac-400f-a528-0f7b448b38d1 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] [instance: d5e6f604-9466-45c6-86a8-885cfb393223] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:06.588386 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e87a3c45-2aac-400f-a528-0f7b448b38d1 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:06.589166 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e87a3c45-2aac-400f-a528-0f7b448b38d1 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:06.589796 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e87a3c45-2aac-400f-a528-0f7b448b38d1 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:06.590735 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e87a3c45-2aac-400f-a528-0f7b448b38d1 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:06.591482 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e87a3c45-2aac-400f-a528-0f7b448b38d1 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:06.592255 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e87a3c45-2aac-400f-a528-0f7b448b38d1 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:06.674189 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-e87a3c45-2aac-400f-a528-0f7b448b38d1 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lazy-loading 'flavor' on Instance uuid d5e6f604-9466-45c6-86a8-885cfb393223 {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:29:06.709745 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e87a3c45-2aac-400f-a528-0f7b448b38d1 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] [instance: d5e6f604-9466-45c6-86a8-885cfb393223] Going to try to live migrate instance to n-h2-862769-1 {{(pid=121000) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 27 03:29:06.903199 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-767501f1-b7e8-458c-a851-5c77a0778649 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13e05e253c94aadb1c089128ff35be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8510a519f14deea6f35a437419e161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:06.923214 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-767501f1-b7e8-458c-a851-5c77a0778649 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68" status: 200 len: 1477 microversion: 2.1 time: 0.409637 Oct 27 03:29:06.943555 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1098/2164] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:06 2022] GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68 => generated 1477 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:06.956644 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-632fc2d5-4e61-4135-a39a-040794efa7e1 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:06.957576 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-632fc2d5-4e61-4135-a39a-040794efa7e1 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] [instance: b3dd0fa3-e3b4-471c-b65b-0a190b7c4701] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:06.967002 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-632fc2d5-4e61-4135-a39a-040794efa7e1 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:06.967692 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-632fc2d5-4e61-4135-a39a-040794efa7e1 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:06.968392 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-632fc2d5-4e61-4135-a39a-040794efa7e1 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:06.969484 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-632fc2d5-4e61-4135-a39a-040794efa7e1 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:06.970188 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-632fc2d5-4e61-4135-a39a-040794efa7e1 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:06.970802 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-632fc2d5-4e61-4135-a39a-040794efa7e1 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:07.263820 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-632fc2d5-4e61-4135-a39a-040794efa7e1 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '071401bed74d48fe8ae2dbdb98aa81cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b0b534b9eb463aab0f13e838578da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:07.281597 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-632fc2d5-4e61-4135-a39a-040794efa7e1 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] 10.222.0.20 "GET /compute/v2.1/servers/b3dd0fa3-e3b4-471c-b65b-0a190b7c4701" status: 200 len: 1322 microversion: 2.1 time: 0.335583 Oct 27 03:29:07.282966 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1099/2165] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:06 2022] GET /compute/v2.1/servers/b3dd0fa3-e3b4-471c-b65b-0a190b7c4701 => generated 1322 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:07.300166 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c4f6a71f-d0b5-4e93-ab4d-193b52e44afd tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:07.300813 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c4f6a71f-d0b5-4e93-ab4d-193b52e44afd tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 1352bd75-bfe6-48e3-a47d-314c7f13f692] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:07.327853 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c4f6a71f-d0b5-4e93-ab4d-193b52e44afd tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:07.333725 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c4f6a71f-d0b5-4e93-ab4d-193b52e44afd tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:07.336265 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c4f6a71f-d0b5-4e93-ab4d-193b52e44afd tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:07.337142 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c4f6a71f-d0b5-4e93-ab4d-193b52e44afd tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:07.337844 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c4f6a71f-d0b5-4e93-ab4d-193b52e44afd tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:07.344015 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c4f6a71f-d0b5-4e93-ab4d-193b52e44afd tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:08.002004 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c4f6a71f-d0b5-4e93-ab4d-193b52e44afd tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:08.026269 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c4f6a71f-d0b5-4e93-ab4d-193b52e44afd tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/1352bd75-bfe6-48e3-a47d-314c7f13f692" status: 200 len: 1485 microversion: 2.1 time: 0.735332 Oct 27 03:29:08.027153 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1100/2166] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:07 2022] GET /compute/v2.1/servers/1352bd75-bfe6-48e3-a47d-314c7f13f692 => generated 1485 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:08.040394 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2f182b93-bb38-41e8-bdf4-20e71543a621 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:08.044132 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2f182b93-bb38-41e8-bdf4-20e71543a621 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: a8925d29-d9e0-4dbb-a73d-09473255fa34] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:08.060710 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2f182b93-bb38-41e8-bdf4-20e71543a621 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:08.065613 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2f182b93-bb38-41e8-bdf4-20e71543a621 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:08.068165 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2f182b93-bb38-41e8-bdf4-20e71543a621 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:08.069475 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2f182b93-bb38-41e8-bdf4-20e71543a621 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:08.078943 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2f182b93-bb38-41e8-bdf4-20e71543a621 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:08.080198 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2f182b93-bb38-41e8-bdf4-20e71543a621 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:08.155175 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=100 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:29:08.395385 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2f182b93-bb38-41e8-bdf4-20e71543a621 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:08.408066 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2f182b93-bb38-41e8-bdf4-20e71543a621 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34" status: 200 len: 1392 microversion: 2.1 time: 0.378242 Oct 27 03:29:08.430487 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1101/2167] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:08 2022] GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34 => generated 1392 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:08.847734 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-bc019716-8b2e-4de7-ba4b-e29298b093ad tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Action: 'create', calling method: .version_select at 0x7f7ddee13310>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-6364152", "description": "tempest-description-1835208382"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:29:10.045545 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-bc019716-8b2e-4de7-ba4b-e29298b093ad tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 241 microversion: 2.1 time: 1.613364 Oct 27 03:29:10.046974 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1102/2168] 10.222.0.20 () {60 vars in 1180 bytes} [Thu Oct 27 03:29:08 2022] POST /compute/v2.1/os-security-groups => generated 241 bytes in 1616 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:29:10.052500 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-bee2f01c-da2d-4288-b651-2cf52dd4331a tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:10.053244 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-bee2f01c-da2d-4288-b651-2cf52dd4331a tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: 339287fc-37b6-455d-96ab-08ab8e2c3e68] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:10.068883 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bee2f01c-da2d-4288-b651-2cf52dd4331a tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:10.069730 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bee2f01c-da2d-4288-b651-2cf52dd4331a tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:10.070574 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bee2f01c-da2d-4288-b651-2cf52dd4331a tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:10.071567 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bee2f01c-da2d-4288-b651-2cf52dd4331a tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:10.072254 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bee2f01c-da2d-4288-b651-2cf52dd4331a tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:10.072904 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bee2f01c-da2d-4288-b651-2cf52dd4331a tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:10.717613 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-bee2f01c-da2d-4288-b651-2cf52dd4331a tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13e05e253c94aadb1c089128ff35be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8510a519f14deea6f35a437419e161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:10.736276 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-bee2f01c-da2d-4288-b651-2cf52dd4331a tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68" status: 200 len: 1477 microversion: 2.1 time: 0.685326 Oct 27 03:29:10.736915 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1103/2169] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:10 2022] GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68 => generated 1477 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:10.746178 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-42732904-edd7-426a-a292-8f1c98e19051 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:10.746933 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-42732904-edd7-426a-a292-8f1c98e19051 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 1352bd75-bfe6-48e3-a47d-314c7f13f692] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:10.759489 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-42732904-edd7-426a-a292-8f1c98e19051 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:10.763605 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-42732904-edd7-426a-a292-8f1c98e19051 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:10.764341 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-42732904-edd7-426a-a292-8f1c98e19051 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:10.765268 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-42732904-edd7-426a-a292-8f1c98e19051 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:10.766454 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-42732904-edd7-426a-a292-8f1c98e19051 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:10.767173 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-42732904-edd7-426a-a292-8f1c98e19051 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:10.824518 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-42732904-edd7-426a-a292-8f1c98e19051 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 1352bd75-bfe6-48e3-a47d-314c7f13f692] Going to try to terminate instance {{(pid=121001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:29:11.020682 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e87a3c45-2aac-400f-a528-0f7b448b38d1 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223/action" status: 202 len: 0 microversion: 2.25 time: 4.447052 Oct 27 03:29:11.026191 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1067/2170] 10.222.0.20 () {62 vars in 1319 bytes} [Thu Oct 27 03:29:06 2022] POST /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223/action => generated 0 bytes in 4454 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:29:11.037927 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4e14d6e1-4cc0-4ef2-bfb6-264069b25d05 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:11.039003 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4e14d6e1-4cc0-4ef2-bfb6-264069b25d05 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] [instance: b3dd0fa3-e3b4-471c-b65b-0a190b7c4701] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:11.048821 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4e14d6e1-4cc0-4ef2-bfb6-264069b25d05 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:11.049895 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4e14d6e1-4cc0-4ef2-bfb6-264069b25d05 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:11.051279 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4e14d6e1-4cc0-4ef2-bfb6-264069b25d05 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:11.052270 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4e14d6e1-4cc0-4ef2-bfb6-264069b25d05 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:11.052885 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4e14d6e1-4cc0-4ef2-bfb6-264069b25d05 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:11.053389 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4e14d6e1-4cc0-4ef2-bfb6-264069b25d05 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:11.255337 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-42732904-edd7-426a-a292-8f1c98e19051 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1352bd75-bfe6-48e3-a47d-314c7f13f692" status: 204 len: 0 microversion: 2.1 time: 0.514256 Oct 27 03:29:11.256443 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1104/2171] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:29:10 2022] DELETE /compute/v2.1/servers/1352bd75-bfe6-48e3-a47d-314c7f13f692 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:29:11.265741 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-bd8e0485-4acc-4fb9-a1a0-2b633a434fd6 req-0d974002-3590-4930-8867-0fe6ec389af1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "339287fc-37b6-455d-96ab-08ab8e2c3e68", "name": "network-vif-plugged", "status": "completed", "tag": "b6134fcc-5cb7-4dad-a3b5-156ca229326d"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:29:11.268489 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4e14d6e1-4cc0-4ef2-bfb6-264069b25d05 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '071401bed74d48fe8ae2dbdb98aa81cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b0b534b9eb463aab0f13e838578da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:11.273536 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-bd8e0485-4acc-4fb9-a1a0-2b633a434fd6 req-0d974002-3590-4930-8867-0fe6ec389af1 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:11.274264 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-bd8e0485-4acc-4fb9-a1a0-2b633a434fd6 req-0d974002-3590-4930-8867-0fe6ec389af1 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:11.274873 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-bd8e0485-4acc-4fb9-a1a0-2b633a434fd6 req-0d974002-3590-4930-8867-0fe6ec389af1 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:11.277561 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4e14d6e1-4cc0-4ef2-bfb6-264069b25d05 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] 10.222.0.20 "GET /compute/v2.1/servers/b3dd0fa3-e3b4-471c-b65b-0a190b7c4701" status: 200 len: 1515 microversion: 2.1 time: 0.249222 Oct 27 03:29:11.280966 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1068/2172] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:11 2022] GET /compute/v2.1/servers/b3dd0fa3-e3b4-471c-b65b-0a190b7c4701 => generated 1515 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:11.286774 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-86521d57-be9e-44b1-bc27-e49bb95900ba tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:11.291946 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-86521d57-be9e-44b1-bc27-e49bb95900ba tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: a8925d29-d9e0-4dbb-a73d-09473255fa34] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:11.298722 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-86521d57-be9e-44b1-bc27-e49bb95900ba tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:11.299980 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-86521d57-be9e-44b1-bc27-e49bb95900ba tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:11.299980 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-86521d57-be9e-44b1-bc27-e49bb95900ba tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:11.300902 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-86521d57-be9e-44b1-bc27-e49bb95900ba tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:11.301498 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-86521d57-be9e-44b1-bc27-e49bb95900ba tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:11.302051 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-86521d57-be9e-44b1-bc27-e49bb95900ba tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:11.307108 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-bd8e0485-4acc-4fb9-a1a0-2b633a434fd6 req-0d974002-3590-4930-8867-0fe6ec389af1 service nova] Creating event network-vif-plugged:b6134fcc-5cb7-4dad-a3b5-156ca229326d for instance 339287fc-37b6-455d-96ab-08ab8e2c3e68 on n-h2-862769-1 Oct 27 03:29:11.333902 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-bd8e0485-4acc-4fb9-a1a0-2b633a434fd6 req-0d974002-3590-4930-8867-0fe6ec389af1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075834 Oct 27 03:29:11.334789 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1105/2173] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:29:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:29:11.340117 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-92ed0ec4-bf57-4502-afe8-53048b5f78cb tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Action: 'create', calling method: .version_select at 0x7f7dda50ed30>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-418329361", "description": "tempest-description-1539694186"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:29:11.532939 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-86521d57-be9e-44b1-bc27-e49bb95900ba tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:11.546736 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-86521d57-be9e-44b1-bc27-e49bb95900ba tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34" status: 200 len: 1392 microversion: 2.1 time: 0.264104 Oct 27 03:29:11.547940 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1069/2174] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:11 2022] GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34 => generated 1392 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:11.555485 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-073c8d3b-67b0-4f8e-81e1-5a9e43b2b36a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:11.556283 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-073c8d3b-67b0-4f8e-81e1-5a9e43b2b36a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: d5e6f604-9466-45c6-86a8-885cfb393223] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:11.562734 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-073c8d3b-67b0-4f8e-81e1-5a9e43b2b36a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:11.574255 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-073c8d3b-67b0-4f8e-81e1-5a9e43b2b36a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:11.574255 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-073c8d3b-67b0-4f8e-81e1-5a9e43b2b36a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:11.574255 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-073c8d3b-67b0-4f8e-81e1-5a9e43b2b36a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:11.574255 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-073c8d3b-67b0-4f8e-81e1-5a9e43b2b36a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:11.574255 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-073c8d3b-67b0-4f8e-81e1-5a9e43b2b36a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:11.622788 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=4 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:29:11.818759 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-073c8d3b-67b0-4f8e-81e1-5a9e43b2b36a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:11.865141 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-073c8d3b-67b0-4f8e-81e1-5a9e43b2b36a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:11.877293 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-073c8d3b-67b0-4f8e-81e1-5a9e43b2b36a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:11.880397 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-073c8d3b-67b0-4f8e-81e1-5a9e43b2b36a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223" status: 200 len: 1487 microversion: 2.25 time: 0.331160 Oct 27 03:29:11.881207 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1070/2175] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:29:11 2022] GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223 => generated 1487 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:29:11.903996 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-32d3f19b-ded5-4ced-9619-5143badd200d tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:11.906932 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-32d3f19b-ded5-4ced-9619-5143badd200d tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 1352bd75-bfe6-48e3-a47d-314c7f13f692] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:11.923163 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-32d3f19b-ded5-4ced-9619-5143badd200d tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:11.925866 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-32d3f19b-ded5-4ced-9619-5143badd200d tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:11.925866 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-32d3f19b-ded5-4ced-9619-5143badd200d tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:11.926212 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-32d3f19b-ded5-4ced-9619-5143badd200d tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:11.927162 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-32d3f19b-ded5-4ced-9619-5143badd200d tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:11.927780 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-32d3f19b-ded5-4ced-9619-5143badd200d tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:12.128218 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-32d3f19b-ded5-4ced-9619-5143badd200d tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:12.140519 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-32d3f19b-ded5-4ced-9619-5143badd200d tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/1352bd75-bfe6-48e3-a47d-314c7f13f692" status: 200 len: 1491 microversion: 2.1 time: 0.249639 Oct 27 03:29:12.141243 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1071/2176] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:11 2022] GET /compute/v2.1/servers/1352bd75-bfe6-48e3-a47d-314c7f13f692 => generated 1491 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:12.162655 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4cab253f-941c-4e66-b9e4-4e1c9e9a3c2a tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:12.163234 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4cab253f-941c-4e66-b9e4-4e1c9e9a3c2a tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] [instance: a89c8f12-2492-4a0f-8887-acd62e510fd9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:12.182836 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4cab253f-941c-4e66-b9e4-4e1c9e9a3c2a tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:12.183663 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4cab253f-941c-4e66-b9e4-4e1c9e9a3c2a tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:12.184293 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4cab253f-941c-4e66-b9e4-4e1c9e9a3c2a tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:12.185736 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4cab253f-941c-4e66-b9e4-4e1c9e9a3c2a tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:12.186533 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4cab253f-941c-4e66-b9e4-4e1c9e9a3c2a tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:12.187179 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4cab253f-941c-4e66-b9e4-4e1c9e9a3c2a tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:12.404868 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4cab253f-941c-4e66-b9e4-4e1c9e9a3c2a tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '071401bed74d48fe8ae2dbdb98aa81cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b0b534b9eb463aab0f13e838578da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:12.419291 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4cab253f-941c-4e66-b9e4-4e1c9e9a3c2a tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] 10.222.0.20 "GET /compute/v2.1/servers/a89c8f12-2492-4a0f-8887-acd62e510fd9" status: 200 len: 1514 microversion: 2.1 time: 0.259733 Oct 27 03:29:12.421946 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1072/2177] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:12 2022] GET /compute/v2.1/servers/a89c8f12-2492-4a0f-8887-acd62e510fd9 => generated 1514 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:12.434817 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-57bb0710-beb8-412c-9ccc-b55eae2962bb tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:12.437034 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-57bb0710-beb8-412c-9ccc-b55eae2962bb tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: 339287fc-37b6-455d-96ab-08ab8e2c3e68] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:12.451820 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-57bb0710-beb8-412c-9ccc-b55eae2962bb tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:12.455940 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-57bb0710-beb8-412c-9ccc-b55eae2962bb tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:12.456969 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-57bb0710-beb8-412c-9ccc-b55eae2962bb tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:12.460883 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-57bb0710-beb8-412c-9ccc-b55eae2962bb tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:12.461720 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-57bb0710-beb8-412c-9ccc-b55eae2962bb tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:12.465250 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-57bb0710-beb8-412c-9ccc-b55eae2962bb tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:12.579340 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-92ed0ec4-bf57-4502-afe8-53048b5f78cb tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.243008 Oct 27 03:29:12.580587 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1106/2178] 10.222.0.20 () {60 vars in 1180 bytes} [Thu Oct 27 03:29:11 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:29:12.585966 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-beb38402-a07f-4a5e-8cd5-65b62e5d8a76 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:12.586872 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-beb38402-a07f-4a5e-8cd5-65b62e5d8a76 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] [instance: a89c8f12-2492-4a0f-8887-acd62e510fd9] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:12.626251 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-beb38402-a07f-4a5e-8cd5-65b62e5d8a76 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:12.626760 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-beb38402-a07f-4a5e-8cd5-65b62e5d8a76 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:12.628980 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-beb38402-a07f-4a5e-8cd5-65b62e5d8a76 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:12.629725 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-beb38402-a07f-4a5e-8cd5-65b62e5d8a76 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:12.638515 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-beb38402-a07f-4a5e-8cd5-65b62e5d8a76 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:12.640655 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-beb38402-a07f-4a5e-8cd5-65b62e5d8a76 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:12.727076 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-beb38402-a07f-4a5e-8cd5-65b62e5d8a76 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] [instance: a89c8f12-2492-4a0f-8887-acd62e510fd9] Going to try to terminate instance {{(pid=121001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:29:12.844958 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-57bb0710-beb8-412c-9ccc-b55eae2962bb tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13e05e253c94aadb1c089128ff35be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8510a519f14deea6f35a437419e161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:12.858049 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-57bb0710-beb8-412c-9ccc-b55eae2962bb tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68" status: 200 len: 1477 microversion: 2.1 time: 0.434418 Oct 27 03:29:12.858742 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1073/2179] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:12 2022] GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68 => generated 1477 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:12.874397 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5dffc01e-5f19-4c8b-8450-a11f01a2c233 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:12.877406 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5dffc01e-5f19-4c8b-8450-a11f01a2c233 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: a8925d29-d9e0-4dbb-a73d-09473255fa34] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:12.877406 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:29:12.886774 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5dffc01e-5f19-4c8b-8450-a11f01a2c233 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:12.887550 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5dffc01e-5f19-4c8b-8450-a11f01a2c233 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:12.888175 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5dffc01e-5f19-4c8b-8450-a11f01a2c233 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:12.889065 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5dffc01e-5f19-4c8b-8450-a11f01a2c233 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:12.889723 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5dffc01e-5f19-4c8b-8450-a11f01a2c233 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:12.890371 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5dffc01e-5f19-4c8b-8450-a11f01a2c233 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:13.204618 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-beb38402-a07f-4a5e-8cd5-65b62e5d8a76 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a89c8f12-2492-4a0f-8887-acd62e510fd9" status: 204 len: 0 microversion: 2.1 time: 0.622372 Oct 27 03:29:13.205245 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1107/2180] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:29:12 2022] DELETE /compute/v2.1/servers/a89c8f12-2492-4a0f-8887-acd62e510fd9 => generated 0 bytes in 624 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:29:13.212815 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3b075230-a4c8-4575-8441-79e86d204281 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1500529055", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": [{"uuid": "3fe4cef0-61ff-437b-9e39-483c02f13c8a"}]}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:29:13.259542 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=11 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:29:13.304358 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.network.neutron [None req-3b075230-a4c8-4575-8441-79e86d204281 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] validate_networks() for [('3fe4cef0-61ff-437b-9e39-483c02f13c8a', None, None, None, None, None)] {{(pid=121001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:29:13.343742 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5dffc01e-5f19-4c8b-8450-a11f01a2c233 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:13.353768 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5dffc01e-5f19-4c8b-8450-a11f01a2c233 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34" status: 200 len: 1392 microversion: 2.1 time: 0.493944 Oct 27 03:29:13.354609 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1074/2181] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:12 2022] GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34 => generated 1392 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:13.361832 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9a3893a6-3ec9-4cc5-9d60-822f619318a7 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:13.368719 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9a3893a6-3ec9-4cc5-9d60-822f619318a7 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: d5e6f604-9466-45c6-86a8-885cfb393223] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:13.403510 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9a3893a6-3ec9-4cc5-9d60-822f619318a7 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:13.404035 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9a3893a6-3ec9-4cc5-9d60-822f619318a7 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:13.404492 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9a3893a6-3ec9-4cc5-9d60-822f619318a7 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:13.405461 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9a3893a6-3ec9-4cc5-9d60-822f619318a7 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:13.408816 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9a3893a6-3ec9-4cc5-9d60-822f619318a7 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:13.409276 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9a3893a6-3ec9-4cc5-9d60-822f619318a7 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:13.715537 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9a3893a6-3ec9-4cc5-9d60-822f619318a7 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:13.726138 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9a3893a6-3ec9-4cc5-9d60-822f619318a7 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:13.736278 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9a3893a6-3ec9-4cc5-9d60-822f619318a7 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:13.743077 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9a3893a6-3ec9-4cc5-9d60-822f619318a7 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223" status: 200 len: 1487 microversion: 2.25 time: 0.384779 Oct 27 03:29:13.743077 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1075/2182] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:29:13 2022] GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223 => generated 1487 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:29:13.768440 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8d87a744-250a-475e-92e3-2821a8d9a411 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:13.775746 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8d87a744-250a-475e-92e3-2821a8d9a411 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 1352bd75-bfe6-48e3-a47d-314c7f13f692] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:13.792244 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8d87a744-250a-475e-92e3-2821a8d9a411 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:13.792579 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8d87a744-250a-475e-92e3-2821a8d9a411 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:13.793027 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8d87a744-250a-475e-92e3-2821a8d9a411 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:13.793753 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8d87a744-250a-475e-92e3-2821a8d9a411 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:13.794253 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8d87a744-250a-475e-92e3-2821a8d9a411 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:13.794687 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8d87a744-250a-475e-92e3-2821a8d9a411 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:14.073878 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8d87a744-250a-475e-92e3-2821a8d9a411 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:14.082340 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8d87a744-250a-475e-92e3-2821a8d9a411 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/1352bd75-bfe6-48e3-a47d-314c7f13f692" status: 200 len: 1491 microversion: 2.1 time: 0.319448 Oct 27 03:29:14.092637 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1076/2183] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:13 2022] GET /compute/v2.1/servers/1352bd75-bfe6-48e3-a47d-314c7f13f692 => generated 1491 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:14.098394 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3e78bda5-b9c3-4642-ba68-5705a3fe8289 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:14.099259 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-3e78bda5-b9c3-4642-ba68-5705a3fe8289 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] [instance: a89c8f12-2492-4a0f-8887-acd62e510fd9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:14.109176 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3e78bda5-b9c3-4642-ba68-5705a3fe8289 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:14.114874 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3e78bda5-b9c3-4642-ba68-5705a3fe8289 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:14.115585 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3e78bda5-b9c3-4642-ba68-5705a3fe8289 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:14.119806 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3e78bda5-b9c3-4642-ba68-5705a3fe8289 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:14.124283 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3e78bda5-b9c3-4642-ba68-5705a3fe8289 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:14.124738 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3e78bda5-b9c3-4642-ba68-5705a3fe8289 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:14.173874 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:29:14.600700 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-3b075230-a4c8-4575-8441-79e86d204281 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Flavor limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:29:14.601249 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-3b075230-a4c8-4575-8441-79e86d204281 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Image limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:29:14.601679 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-3b075230-a4c8-4575-8441-79e86d204281 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Flavor pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:29:14.602252 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-3b075230-a4c8-4575-8441-79e86d204281 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Image pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:29:14.602695 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-3b075230-a4c8-4575-8441-79e86d204281 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:29:14.624766 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3b075230-a4c8-4575-8441-79e86d204281 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:14.625208 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3b075230-a4c8-4575-8441-79e86d204281 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:14.625656 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3b075230-a4c8-4575-8441-79e86d204281 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:14.626430 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3b075230-a4c8-4575-8441-79e86d204281 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:14.626883 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3b075230-a4c8-4575-8441-79e86d204281 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:14.634594 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3b075230-a4c8-4575-8441-79e86d204281 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:14.705876 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-3b075230-a4c8-4575-8441-79e86d204281 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Getting quotas for project 92082c8718aa41bf96cd84d682d75954. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:29:14.714784 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-3b075230-a4c8-4575-8441-79e86d204281 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Getting quotas for user 421d14944da74570a53d620ea205449d and project 92082c8718aa41bf96cd84d682d75954. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:29:14.759806 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3b075230-a4c8-4575-8441-79e86d204281 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Going to run 1 instances... {{(pid=121001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:29:14.777738 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-3e78bda5-b9c3-4642-ba68-5705a3fe8289 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '071401bed74d48fe8ae2dbdb98aa81cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b0b534b9eb463aab0f13e838578da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:14.782697 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3b075230-a4c8-4575-8441-79e86d204281 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] [instance: 57cfac2f-cf21-44fa-881e-f1d3da2be9d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:29:14.793591 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3e78bda5-b9c3-4642-ba68-5705a3fe8289 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] 10.222.0.20 "GET /compute/v2.1/servers/a89c8f12-2492-4a0f-8887-acd62e510fd9" status: 200 len: 1520 microversion: 2.1 time: 0.699507 Oct 27 03:29:14.800573 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1077/2184] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:14 2022] GET /compute/v2.1/servers/a89c8f12-2492-4a0f-8887-acd62e510fd9 => generated 1520 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:14.823645 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-00cd5cff-c283-4c45-9626-b55e54e9a8fd tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:14.833815 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-00cd5cff-c283-4c45-9626-b55e54e9a8fd tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: 339287fc-37b6-455d-96ab-08ab8e2c3e68] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:14.864714 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-00cd5cff-c283-4c45-9626-b55e54e9a8fd tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:14.867248 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-00cd5cff-c283-4c45-9626-b55e54e9a8fd tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:14.869502 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-00cd5cff-c283-4c45-9626-b55e54e9a8fd tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:14.871195 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-00cd5cff-c283-4c45-9626-b55e54e9a8fd tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:14.872704 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-00cd5cff-c283-4c45-9626-b55e54e9a8fd tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:14.877410 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-00cd5cff-c283-4c45-9626-b55e54e9a8fd tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:15.085672 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3b075230-a4c8-4575-8441-79e86d204281 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.878491 Oct 27 03:29:15.097403 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1108/2185] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:29:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1892 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 03:29:15.111067 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-648212ea-9574-47d0-8fac-ddad15969b3b tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:15.114456 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-648212ea-9574-47d0-8fac-ddad15969b3b tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: a8925d29-d9e0-4dbb-a73d-09473255fa34] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:15.130097 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:29:15.135155 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-648212ea-9574-47d0-8fac-ddad15969b3b tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:15.135836 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-648212ea-9574-47d0-8fac-ddad15969b3b tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:15.137687 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-648212ea-9574-47d0-8fac-ddad15969b3b tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:15.139798 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-648212ea-9574-47d0-8fac-ddad15969b3b tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:15.141086 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-648212ea-9574-47d0-8fac-ddad15969b3b tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:15.142256 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-648212ea-9574-47d0-8fac-ddad15969b3b tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:15.452768 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-00cd5cff-c283-4c45-9626-b55e54e9a8fd tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13e05e253c94aadb1c089128ff35be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8510a519f14deea6f35a437419e161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:15.478277 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-00cd5cff-c283-4c45-9626-b55e54e9a8fd tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68" status: 200 len: 1463 microversion: 2.1 time: 0.676013 Oct 27 03:29:15.491168 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1078/2186] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:14 2022] GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68 => generated 1463 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:15.510188 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7a46d042-6fcd-4a1c-85df-2fb317c2e766 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:15.513319 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7a46d042-6fcd-4a1c-85df-2fb317c2e766 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: d5e6f604-9466-45c6-86a8-885cfb393223] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:15.539252 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7a46d042-6fcd-4a1c-85df-2fb317c2e766 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:15.540923 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7a46d042-6fcd-4a1c-85df-2fb317c2e766 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:15.542542 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7a46d042-6fcd-4a1c-85df-2fb317c2e766 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:15.547719 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7a46d042-6fcd-4a1c-85df-2fb317c2e766 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:15.548808 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7a46d042-6fcd-4a1c-85df-2fb317c2e766 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:15.550906 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7a46d042-6fcd-4a1c-85df-2fb317c2e766 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:15.872896 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-648212ea-9574-47d0-8fac-ddad15969b3b tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:15.885374 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-648212ea-9574-47d0-8fac-ddad15969b3b tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34" status: 200 len: 1392 microversion: 2.1 time: 0.786556 Oct 27 03:29:15.886101 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1109/2187] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:15 2022] GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34 => generated 1392 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:15.898749 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-0e962494-4660-45c7-a5a2-228e7f157752 req-d77637f5-c149-44c4-ac3d-fefa740f2a22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1352bd75-bfe6-48e3-a47d-314c7f13f692", "name": "network-vif-deleted", "tag": "8ca76995-7735-4198-800f-a31ff3fd6a13"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:29:15.936390 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-0e962494-4660-45c7-a5a2-228e7f157752 req-d77637f5-c149-44c4-ac3d-fefa740f2a22 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:15.936923 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-0e962494-4660-45c7-a5a2-228e7f157752 req-d77637f5-c149-44c4-ac3d-fefa740f2a22 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:15.937391 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-0e962494-4660-45c7-a5a2-228e7f157752 req-d77637f5-c149-44c4-ac3d-fefa740f2a22 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:15.981542 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-0e962494-4660-45c7-a5a2-228e7f157752 req-d77637f5-c149-44c4-ac3d-fefa740f2a22 service nova] Creating event network-vif-deleted:8ca76995-7735-4198-800f-a31ff3fd6a13 for instance 1352bd75-bfe6-48e3-a47d-314c7f13f692 on n-h2-862769-1 Oct 27 03:29:16.017170 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-0e962494-4660-45c7-a5a2-228e7f157752 req-d77637f5-c149-44c4-ac3d-fefa740f2a22 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128526 Oct 27 03:29:16.022339 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1110/2188] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:29:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:29:16.043651 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f525b2d8-f5a7-4ccb-96e2-e1b1f00ee903 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:16.046466 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f525b2d8-f5a7-4ccb-96e2-e1b1f00ee903 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] [instance: 57cfac2f-cf21-44fa-881e-f1d3da2be9d2] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:16.153533 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7a46d042-6fcd-4a1c-85df-2fb317c2e766 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:16.197325 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7a46d042-6fcd-4a1c-85df-2fb317c2e766 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:16.199676 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7a46d042-6fcd-4a1c-85df-2fb317c2e766 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:16.200943 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7a46d042-6fcd-4a1c-85df-2fb317c2e766 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223" status: 200 len: 1487 microversion: 2.25 time: 0.709943 Oct 27 03:29:16.210320 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1079/2189] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:29:15 2022] GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223 => generated 1487 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:29:16.234978 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c295a885-0124-49d6-bf15-3cf8dd72335a tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:16.236260 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c295a885-0124-49d6-bf15-3cf8dd72335a tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 1352bd75-bfe6-48e3-a47d-314c7f13f692] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:16.247741 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c295a885-0124-49d6-bf15-3cf8dd72335a tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:16.248259 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c295a885-0124-49d6-bf15-3cf8dd72335a tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:16.249784 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c295a885-0124-49d6-bf15-3cf8dd72335a tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:16.250818 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c295a885-0124-49d6-bf15-3cf8dd72335a tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:16.251330 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c295a885-0124-49d6-bf15-3cf8dd72335a tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:16.251771 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c295a885-0124-49d6-bf15-3cf8dd72335a tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:16.309184 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f525b2d8-f5a7-4ccb-96e2-e1b1f00ee903 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421d14944da74570a53d620ea205449d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92082c8718aa41bf96cd84d682d75954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:16.319851 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f525b2d8-f5a7-4ccb-96e2-e1b1f00ee903 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] 10.222.0.20 "GET /compute/v2.1/servers/57cfac2f-cf21-44fa-881e-f1d3da2be9d2" status: 200 len: 1216 microversion: 2.1 time: 0.293794 Oct 27 03:29:16.356205 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1111/2190] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:16 2022] GET /compute/v2.1/servers/57cfac2f-cf21-44fa-881e-f1d3da2be9d2 => generated 1216 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:16.374807 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-169ac856-6cf7-446c-ab06-4fe72292a31f tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:16.377258 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-169ac856-6cf7-446c-ab06-4fe72292a31f tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: 339287fc-37b6-455d-96ab-08ab8e2c3e68] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:16.397027 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-169ac856-6cf7-446c-ab06-4fe72292a31f tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:16.397619 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-169ac856-6cf7-446c-ab06-4fe72292a31f tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:16.398121 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-169ac856-6cf7-446c-ab06-4fe72292a31f tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:16.398873 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-169ac856-6cf7-446c-ab06-4fe72292a31f tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:16.399357 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-169ac856-6cf7-446c-ab06-4fe72292a31f tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:16.402733 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-169ac856-6cf7-446c-ab06-4fe72292a31f tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:16.424612 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c295a885-0124-49d6-bf15-3cf8dd72335a tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:16.425961 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c295a885-0124-49d6-bf15-3cf8dd72335a tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:16.426506 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c295a885-0124-49d6-bf15-3cf8dd72335a tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:16.426989 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-c295a885-0124-49d6-bf15-3cf8dd72335a tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lazy-loading 'fault' on Instance uuid 1352bd75-bfe6-48e3-a47d-314c7f13f692 {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:29:16.538118 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=4 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:29:16.733011 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c295a885-0124-49d6-bf15-3cf8dd72335a tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:16.746194 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c295a885-0124-49d6-bf15-3cf8dd72335a tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/1352bd75-bfe6-48e3-a47d-314c7f13f692" status: 200 len: 1297 microversion: 2.1 time: 0.533749 Oct 27 03:29:16.756425 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1080/2191] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:16 2022] GET /compute/v2.1/servers/1352bd75-bfe6-48e3-a47d-314c7f13f692 => generated 1297 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:16.771836 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6d6b3463-e4d4-45d2-93da-e9f16b678c4d tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:16.774289 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6d6b3463-e4d4-45d2-93da-e9f16b678c4d tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] [instance: a89c8f12-2492-4a0f-8887-acd62e510fd9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:16.797927 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6d6b3463-e4d4-45d2-93da-e9f16b678c4d tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:16.819908 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6d6b3463-e4d4-45d2-93da-e9f16b678c4d tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:16.821078 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6d6b3463-e4d4-45d2-93da-e9f16b678c4d tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:16.824576 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6d6b3463-e4d4-45d2-93da-e9f16b678c4d tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:16.828909 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-169ac856-6cf7-446c-ab06-4fe72292a31f tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13e05e253c94aadb1c089128ff35be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8510a519f14deea6f35a437419e161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:16.829796 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6d6b3463-e4d4-45d2-93da-e9f16b678c4d tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:16.831989 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6d6b3463-e4d4-45d2-93da-e9f16b678c4d tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:16.842393 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-169ac856-6cf7-446c-ab06-4fe72292a31f tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68" status: 200 len: 1463 microversion: 2.1 time: 0.484961 Oct 27 03:29:16.848030 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1112/2192] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:16 2022] GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68 => generated 1463 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:16.877970 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f056584f-8740-485f-9122-277ce659e3ec tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:29:16.882307 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f056584f-8740-485f-9122-277ce659e3ec tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: 339287fc-37b6-455d-96ab-08ab8e2c3e68] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:16.895361 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f056584f-8740-485f-9122-277ce659e3ec tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:16.898932 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f056584f-8740-485f-9122-277ce659e3ec tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:16.901562 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f056584f-8740-485f-9122-277ce659e3ec tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:16.904003 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f056584f-8740-485f-9122-277ce659e3ec tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:16.904703 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f056584f-8740-485f-9122-277ce659e3ec tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:16.905157 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f056584f-8740-485f-9122-277ce659e3ec tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:17.106797 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-f056584f-8740-485f-9122-277ce659e3ec tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Flavor limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:29:17.106797 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-f056584f-8740-485f-9122-277ce659e3ec tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Image limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:29:17.107289 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-f056584f-8740-485f-9122-277ce659e3ec tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Flavor pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:29:17.107580 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-f056584f-8740-485f-9122-277ce659e3ec tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Image pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:29:17.108433 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-f056584f-8740-485f-9122-277ce659e3ec tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:29:17.211767 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-6d6b3463-e4d4-45d2-93da-e9f16b678c4d tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '071401bed74d48fe8ae2dbdb98aa81cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b0b534b9eb463aab0f13e838578da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:17.225362 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6d6b3463-e4d4-45d2-93da-e9f16b678c4d tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] 10.222.0.20 "GET /compute/v2.1/servers/a89c8f12-2492-4a0f-8887-acd62e510fd9" status: 200 len: 1520 microversion: 2.1 time: 0.464236 Oct 27 03:29:17.228229 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1081/2193] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:16 2022] GET /compute/v2.1/servers/a89c8f12-2492-4a0f-8887-acd62e510fd9 => generated 1520 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:17.239978 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2002f56a-64b8-42ae-9d76-4bb834322217 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:17.239978 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-2002f56a-64b8-42ae-9d76-4bb834322217 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: a8925d29-d9e0-4dbb-a73d-09473255fa34] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:17.255030 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2002f56a-64b8-42ae-9d76-4bb834322217 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:17.255642 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2002f56a-64b8-42ae-9d76-4bb834322217 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:17.257015 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2002f56a-64b8-42ae-9d76-4bb834322217 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:17.260328 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2002f56a-64b8-42ae-9d76-4bb834322217 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:17.260907 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2002f56a-64b8-42ae-9d76-4bb834322217 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:17.261718 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2002f56a-64b8-42ae-9d76-4bb834322217 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:17.381274 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f056584f-8740-485f-9122-277ce659e3ec tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: 339287fc-37b6-455d-96ab-08ab8e2c3e68] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:17.401046 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f056584f-8740-485f-9122-277ce659e3ec tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:17.403020 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f056584f-8740-485f-9122-277ce659e3ec tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:17.403514 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f056584f-8740-485f-9122-277ce659e3ec tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:17.406602 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f056584f-8740-485f-9122-277ce659e3ec tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:17.406602 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f056584f-8740-485f-9122-277ce659e3ec tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:17.410116 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f056584f-8740-485f-9122-277ce659e3ec tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:17.511903 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f056584f-8740-485f-9122-277ce659e3ec tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "POST /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68/action" status: 202 len: 1067 microversion: 2.1 time: 0.638223 Oct 27 03:29:17.512571 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1113/2194] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:29:16 2022] POST /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68/action => generated 1067 bytes in 640 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 27 03:29:17.541886 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-18ba0936-e074-4c6c-b356-f52e2e831c4a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:17.545648 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-18ba0936-e074-4c6c-b356-f52e2e831c4a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: d5e6f604-9466-45c6-86a8-885cfb393223] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:17.562399 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-18ba0936-e074-4c6c-b356-f52e2e831c4a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:17.562900 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-18ba0936-e074-4c6c-b356-f52e2e831c4a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:17.563640 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-18ba0936-e074-4c6c-b356-f52e2e831c4a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:17.564661 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-18ba0936-e074-4c6c-b356-f52e2e831c4a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:17.565299 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-18ba0936-e074-4c6c-b356-f52e2e831c4a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:17.566469 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-18ba0936-e074-4c6c-b356-f52e2e831c4a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:17.810498 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2002f56a-64b8-42ae-9d76-4bb834322217 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:17.820410 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2002f56a-64b8-42ae-9d76-4bb834322217 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34" status: 200 len: 1392 microversion: 2.1 time: 0.590847 Oct 27 03:29:17.825123 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1082/2195] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:17 2022] GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34 => generated 1392 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:17.836741 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d2e6c8e4-70bf-4fd3-9b90-ee1715e61e51 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:17.838761 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d2e6c8e4-70bf-4fd3-9b90-ee1715e61e51 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] [instance: 57cfac2f-cf21-44fa-881e-f1d3da2be9d2] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:17.855512 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d2e6c8e4-70bf-4fd3-9b90-ee1715e61e51 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:17.869962 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d2e6c8e4-70bf-4fd3-9b90-ee1715e61e51 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:17.872247 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d2e6c8e4-70bf-4fd3-9b90-ee1715e61e51 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:17.873239 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d2e6c8e4-70bf-4fd3-9b90-ee1715e61e51 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:17.875932 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d2e6c8e4-70bf-4fd3-9b90-ee1715e61e51 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:17.877643 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d2e6c8e4-70bf-4fd3-9b90-ee1715e61e51 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:18.029744 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d2e6c8e4-70bf-4fd3-9b90-ee1715e61e51 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421d14944da74570a53d620ea205449d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92082c8718aa41bf96cd84d682d75954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:18.043596 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d2e6c8e4-70bf-4fd3-9b90-ee1715e61e51 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] 10.222.0.20 "GET /compute/v2.1/servers/57cfac2f-cf21-44fa-881e-f1d3da2be9d2" status: 200 len: 1212 microversion: 2.1 time: 0.217182 Oct 27 03:29:18.046523 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1083/2196] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:17 2022] GET /compute/v2.1/servers/57cfac2f-cf21-44fa-881e-f1d3da2be9d2 => generated 1212 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:18.057864 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a2a12713-bb21-4523-975d-cd5f60a113e9 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:18.067228 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a2a12713-bb21-4523-975d-cd5f60a113e9 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: 339287fc-37b6-455d-96ab-08ab8e2c3e68] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:18.076203 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a2a12713-bb21-4523-975d-cd5f60a113e9 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:18.081062 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a2a12713-bb21-4523-975d-cd5f60a113e9 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:18.081062 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a2a12713-bb21-4523-975d-cd5f60a113e9 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:18.081062 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a2a12713-bb21-4523-975d-cd5f60a113e9 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:18.081062 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a2a12713-bb21-4523-975d-cd5f60a113e9 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:18.081062 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a2a12713-bb21-4523-975d-cd5f60a113e9 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:18.246930 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-18ba0936-e074-4c6c-b356-f52e2e831c4a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:18.263883 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-18ba0936-e074-4c6c-b356-f52e2e831c4a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:18.267595 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-18ba0936-e074-4c6c-b356-f52e2e831c4a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:18.271500 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-18ba0936-e074-4c6c-b356-f52e2e831c4a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223" status: 200 len: 1487 microversion: 2.25 time: 0.757921 Oct 27 03:29:18.295120 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1114/2197] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:29:17 2022] GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223 => generated 1487 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:29:18.300911 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ca8d8daf-082a-4a3e-83ec-b16af1772a6b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:18.308645 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ca8d8daf-082a-4a3e-83ec-b16af1772a6b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 1352bd75-bfe6-48e3-a47d-314c7f13f692] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:18.323358 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ca8d8daf-082a-4a3e-83ec-b16af1772a6b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:18.324336 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ca8d8daf-082a-4a3e-83ec-b16af1772a6b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:18.324990 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ca8d8daf-082a-4a3e-83ec-b16af1772a6b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:18.325940 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ca8d8daf-082a-4a3e-83ec-b16af1772a6b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:18.326619 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ca8d8daf-082a-4a3e-83ec-b16af1772a6b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:18.327243 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ca8d8daf-082a-4a3e-83ec-b16af1772a6b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:18.384415 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-ca8d8daf-082a-4a3e-83ec-b16af1772a6b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] HTTP exception thrown: Instance 1352bd75-bfe6-48e3-a47d-314c7f13f692 could not be found. Oct 27 03:29:18.388286 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ca8d8daf-082a-4a3e-83ec-b16af1772a6b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Request method failure captured: Oct 27 03:29:18.388286 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/1352bd75-bfe6-48e3-a47d-314c7f13f692 HTTP/1.1 Oct 27 03:29:18.388286 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:29:18.388286 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:29:18.388286 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:29:18.388286 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:29:18.388286 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:29:18.388286 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:29:18.388286 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:29:18.388286 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:29:18.388286 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfnAX64GvSXX6j_FGiQQ9IlgyuvfbWxRMGJCqIz8aEuYqDW4EVaQTS_nCBHKSQ3Z4oltdJGbrb3LkQtsJQ-KBbiFsQn0s9yf9n4GDuUzW48O2MfgGJVpAyAl-5qhe5w5ten3MUUxjRyCo9okwgZpH2TZ6ggq8P48i5NICoqXVcmLAEk Oct 27 03:29:18.388286 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:29:18.388286 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:29:18.388286 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:29:18.388286 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:29:18.388286 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:29:18.388286 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:29:18.388286 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: ae78c307a1504172828e668f915a3677 Oct 27 03:29:18.388286 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ImagesTestJSON-2119984465 Oct 27 03:29:18.388286 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:29:18.388286 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:29:18.388286 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ae78c307a1504172828e668f915a3677"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ae78c307a1504172828e668f915a3677"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ae78c307a1504172828e668f915a3677"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ae78c307a1504172828e668f915a3677"}]}] Oct 27 03:29:18.388286 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ImagesTestJSON-2119984465 Oct 27 03:29:18.388286 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: ae78c307a1504172828e668f915a3677 Oct 27 03:29:18.388286 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ImagesTestJSON-2119984465 Oct 27 03:29:18.388286 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ImagesTestJSON-2119984465-project Oct 27 03:29:18.388286 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:29:18.388286 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:29:18.388286 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 1d6175f2ac39494f8cba3db225150d6c Oct 27 03:29:18.388286 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ImagesTestJSON-2119984465-project Oct 27 03:29:18.388286 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:29:18.388286 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 1352bd75-bfe6-48e3-a47d-314c7f13f692 could not be found. Oct 27 03:29:18.388286 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '1352bd75-bfe6-48e3-a47d-314c7f13f692'} Oct 27 03:29:18.388286 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:29:18.388286 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:29:18.388286 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:29:18.388286 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:29:18.388286 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:29:18.388286 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:29:18.388286 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:29:18.388286 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:29:18.388286 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:29:18.388286 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:29:18.388286 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1352bd75-bfe6-48e3-a47d-314c7f13f692 could not be found. Oct 27 03:29:18.388286 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:29:18.388286 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:29:18.388286 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:29:18.388286 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:29:18.388286 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:29:18.388286 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:29:18.388286 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:29:18.388286 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:29:18.388286 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:29:18.388286 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:29:18.388286 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:29:18.388286 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:29:18.388286 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:29:18.388286 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:29:18.388286 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:29:18.388286 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:29:18.388286 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1352bd75-bfe6-48e3-a47d-314c7f13f692 could not be found. Oct 27 03:29:18.388286 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:29:18.388286 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:29:18.388286 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:29:18.388286 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:29:18.392916 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:29:18.392916 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:29:18.392916 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:29:18.392916 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:29:18.392916 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1352bd75-bfe6-48e3-a47d-314c7f13f692 could not be found. Oct 27 03:29:18.392916 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:29:18.416639 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ca8d8daf-082a-4a3e-83ec-b16af1772a6b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Returning 404 to user: Instance 1352bd75-bfe6-48e3-a47d-314c7f13f692 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:29:18.419086 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ca8d8daf-082a-4a3e-83ec-b16af1772a6b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/1352bd75-bfe6-48e3-a47d-314c7f13f692" status: 404 len: 111 microversion: 2.1 time: 0.122664 Oct 27 03:29:18.423665 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1115/2198] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:18 2022] GET /compute/v2.1/servers/1352bd75-bfe6-48e3-a47d-314c7f13f692 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:29:18.431626 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-328c1e8d-0c01-494c-8c4a-53d91a3fdaf9 req-792961e2-ebae-463b-9d02-03da1f0f810b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a89c8f12-2492-4a0f-8887-acd62e510fd9", "name": "network-vif-deleted", "tag": "b726525d-fb99-4f78-925e-57e948366880"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:29:18.455439 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-328c1e8d-0c01-494c-8c4a-53d91a3fdaf9 req-792961e2-ebae-463b-9d02-03da1f0f810b service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:18.456190 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-328c1e8d-0c01-494c-8c4a-53d91a3fdaf9 req-792961e2-ebae-463b-9d02-03da1f0f810b service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:18.456926 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-328c1e8d-0c01-494c-8c4a-53d91a3fdaf9 req-792961e2-ebae-463b-9d02-03da1f0f810b service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:18.487346 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-328c1e8d-0c01-494c-8c4a-53d91a3fdaf9 req-792961e2-ebae-463b-9d02-03da1f0f810b service nova] Creating event network-vif-deleted:b726525d-fb99-4f78-925e-57e948366880 for instance a89c8f12-2492-4a0f-8887-acd62e510fd9 on n-h1-862769-1 Oct 27 03:29:18.521498 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-328c1e8d-0c01-494c-8c4a-53d91a3fdaf9 req-792961e2-ebae-463b-9d02-03da1f0f810b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096255 Oct 27 03:29:18.532549 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1116/2199] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:29:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:29:18.555668 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c66658db-1e50-4b0d-bda9-6981c56230fc tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:18.555668 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c66658db-1e50-4b0d-bda9-6981c56230fc tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] [instance: a89c8f12-2492-4a0f-8887-acd62e510fd9] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:18.557747 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a2a12713-bb21-4523-975d-cd5f60a113e9 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13e05e253c94aadb1c089128ff35be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8510a519f14deea6f35a437419e161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:18.568509 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c66658db-1e50-4b0d-bda9-6981c56230fc tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:18.568709 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a2a12713-bb21-4523-975d-cd5f60a113e9 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68" status: 200 len: 1472 microversion: 2.1 time: 0.514467 Oct 27 03:29:18.569629 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1084/2200] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:18 2022] GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68 => generated 1472 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:18.570412 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c66658db-1e50-4b0d-bda9-6981c56230fc tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:18.571119 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c66658db-1e50-4b0d-bda9-6981c56230fc tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:18.572309 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c66658db-1e50-4b0d-bda9-6981c56230fc tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:18.574521 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c66658db-1e50-4b0d-bda9-6981c56230fc tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:18.574762 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d119bae9-6470-4e5f-9fc5-d2cc2228783c tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7dda075940>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:18.575354 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c66658db-1e50-4b0d-bda9-6981c56230fc tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:18.690297 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c66658db-1e50-4b0d-bda9-6981c56230fc tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:18.691221 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c66658db-1e50-4b0d-bda9-6981c56230fc tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:18.691656 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c66658db-1e50-4b0d-bda9-6981c56230fc tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:18.692460 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-c66658db-1e50-4b0d-bda9-6981c56230fc tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lazy-loading 'fault' on Instance uuid a89c8f12-2492-4a0f-8887-acd62e510fd9 {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:29:18.849837 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c66658db-1e50-4b0d-bda9-6981c56230fc tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '071401bed74d48fe8ae2dbdb98aa81cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b0b534b9eb463aab0f13e838578da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:18.865003 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c66658db-1e50-4b0d-bda9-6981c56230fc tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] 10.222.0.20 "GET /compute/v2.1/servers/a89c8f12-2492-4a0f-8887-acd62e510fd9" status: 200 len: 1312 microversion: 2.1 time: 0.328118 Oct 27 03:29:18.865605 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1117/2201] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:18 2022] GET /compute/v2.1/servers/a89c8f12-2492-4a0f-8887-acd62e510fd9 => generated 1312 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:18.887191 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6d4e009b-5f9e-4e68-a680-6d6e17f54f20 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:18.889912 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-6d4e009b-5f9e-4e68-a680-6d6e17f54f20 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: a8925d29-d9e0-4dbb-a73d-09473255fa34] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:18.907800 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6d4e009b-5f9e-4e68-a680-6d6e17f54f20 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:18.910784 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6d4e009b-5f9e-4e68-a680-6d6e17f54f20 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:18.912923 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6d4e009b-5f9e-4e68-a680-6d6e17f54f20 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:18.915788 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6d4e009b-5f9e-4e68-a680-6d6e17f54f20 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:18.917954 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6d4e009b-5f9e-4e68-a680-6d6e17f54f20 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:18.918666 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6d4e009b-5f9e-4e68-a680-6d6e17f54f20 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:19.264933 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6d4e009b-5f9e-4e68-a680-6d6e17f54f20 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:19.267404 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:29:19.276388 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6d4e009b-5f9e-4e68-a680-6d6e17f54f20 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34" status: 200 len: 1392 microversion: 2.1 time: 0.409732 Oct 27 03:29:19.276979 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1118/2202] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:18 2022] GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34 => generated 1392 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:19.297357 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2fb787a0-5cfd-4b1e-a047-9b5e48ef3f40 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:19.298161 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2fb787a0-5cfd-4b1e-a047-9b5e48ef3f40 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] [instance: 57cfac2f-cf21-44fa-881e-f1d3da2be9d2] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:19.304631 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2fb787a0-5cfd-4b1e-a047-9b5e48ef3f40 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:19.305129 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2fb787a0-5cfd-4b1e-a047-9b5e48ef3f40 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:19.305567 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2fb787a0-5cfd-4b1e-a047-9b5e48ef3f40 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:19.306615 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2fb787a0-5cfd-4b1e-a047-9b5e48ef3f40 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:19.307261 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2fb787a0-5cfd-4b1e-a047-9b5e48ef3f40 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:19.307692 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2fb787a0-5cfd-4b1e-a047-9b5e48ef3f40 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:19.399701 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2fb787a0-5cfd-4b1e-a047-9b5e48ef3f40 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421d14944da74570a53d620ea205449d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92082c8718aa41bf96cd84d682d75954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:19.423856 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2fb787a0-5cfd-4b1e-a047-9b5e48ef3f40 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] 10.222.0.20 "GET /compute/v2.1/servers/57cfac2f-cf21-44fa-881e-f1d3da2be9d2" status: 200 len: 1268 microversion: 2.1 time: 0.130289 Oct 27 03:29:19.425242 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1119/2203] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:19 2022] GET /compute/v2.1/servers/57cfac2f-cf21-44fa-881e-f1d3da2be9d2 => generated 1268 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:19.434899 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c4be44f4-414c-48e0-9612-c9ca390db433 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:19.439428 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c4be44f4-414c-48e0-9612-c9ca390db433 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: d5e6f604-9466-45c6-86a8-885cfb393223] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:19.452198 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c4be44f4-414c-48e0-9612-c9ca390db433 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:19.452985 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c4be44f4-414c-48e0-9612-c9ca390db433 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:19.453599 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c4be44f4-414c-48e0-9612-c9ca390db433 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:19.458019 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c4be44f4-414c-48e0-9612-c9ca390db433 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:19.458720 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c4be44f4-414c-48e0-9612-c9ca390db433 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:19.459343 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c4be44f4-414c-48e0-9612-c9ca390db433 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:19.718806 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c4be44f4-414c-48e0-9612-c9ca390db433 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:19.746481 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c4be44f4-414c-48e0-9612-c9ca390db433 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:19.751362 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c4be44f4-414c-48e0-9612-c9ca390db433 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:19.752997 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c4be44f4-414c-48e0-9612-c9ca390db433 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223" status: 200 len: 1487 microversion: 2.25 time: 0.322071 Oct 27 03:29:19.755012 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1120/2204] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:29:19 2022] GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223 => generated 1487 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:29:19.766391 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2ebe7b2e-6b42-4e09-a85f-e00d068feb6e tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:19.802409 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2ebe7b2e-6b42-4e09-a85f-e00d068feb6e tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: 339287fc-37b6-455d-96ab-08ab8e2c3e68] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:19.822721 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2ebe7b2e-6b42-4e09-a85f-e00d068feb6e tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:19.823268 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2ebe7b2e-6b42-4e09-a85f-e00d068feb6e tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:19.824574 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2ebe7b2e-6b42-4e09-a85f-e00d068feb6e tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:19.825361 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2ebe7b2e-6b42-4e09-a85f-e00d068feb6e tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:19.825837 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2ebe7b2e-6b42-4e09-a85f-e00d068feb6e tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:19.826313 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2ebe7b2e-6b42-4e09-a85f-e00d068feb6e tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:20.307469 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2ebe7b2e-6b42-4e09-a85f-e00d068feb6e tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13e05e253c94aadb1c089128ff35be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8510a519f14deea6f35a437419e161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:20.318715 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2ebe7b2e-6b42-4e09-a85f-e00d068feb6e tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68" status: 200 len: 1472 microversion: 2.1 time: 0.556350 Oct 27 03:29:20.319564 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1121/2205] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:19 2022] GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68 => generated 1472 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:20.327148 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7078b36e-560f-467e-b275-e308c7aa2bd1 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:20.327979 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7078b36e-560f-467e-b275-e308c7aa2bd1 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] [instance: a89c8f12-2492-4a0f-8887-acd62e510fd9] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:20.351469 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7078b36e-560f-467e-b275-e308c7aa2bd1 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:20.352180 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7078b36e-560f-467e-b275-e308c7aa2bd1 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:20.360663 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7078b36e-560f-467e-b275-e308c7aa2bd1 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:20.361777 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7078b36e-560f-467e-b275-e308c7aa2bd1 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:20.362982 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7078b36e-560f-467e-b275-e308c7aa2bd1 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:20.363604 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7078b36e-560f-467e-b275-e308c7aa2bd1 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:20.383678 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-7078b36e-560f-467e-b275-e308c7aa2bd1 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] HTTP exception thrown: Instance a89c8f12-2492-4a0f-8887-acd62e510fd9 could not be found. Oct 27 03:29:20.387799 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7078b36e-560f-467e-b275-e308c7aa2bd1 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Request method failure captured: Oct 27 03:29:20.387799 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/a89c8f12-2492-4a0f-8887-acd62e510fd9 HTTP/1.1 Oct 27 03:29:20.387799 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:29:20.387799 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:29:20.387799 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:29:20.387799 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:29:20.387799 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:29:20.387799 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:29:20.387799 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:29:20.387799 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:29:20.387799 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfrb-edByRevFfuhULifqN92XaPnrz1y9TpvzJVFkI7uY8srOIeoiVbh_koOIlmW1qHemLxQzub1Kep0Hp_Be1wKqdeSKQBD4nXR03SL4r_wU3gh6unzCksFMO-TRc2CaC1FQUAgZM0MiZf4AV8a72xd56R6wjBT67zYw0kkAvZ-L-0 Oct 27 03:29:20.387799 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:29:20.387799 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:29:20.387799 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:29:20.387799 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:29:20.387799 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:29:20.387799 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:29:20.387799 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 16b0b534b9eb463aab0f13e838578da2 Oct 27 03:29:20.387799 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ListServersNegativeTestJSON-1232441805 Oct 27 03:29:20.387799 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:29:20.387799 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:29:20.387799 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/16b0b534b9eb463aab0f13e838578da2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/16b0b534b9eb463aab0f13e838578da2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/16b0b534b9eb463aab0f13e838578da2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_16b0b534b9eb463aab0f13e838578da2"}]}] Oct 27 03:29:20.387799 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ListServersNegativeTestJSON-1232441805 Oct 27 03:29:20.387799 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 16b0b534b9eb463aab0f13e838578da2 Oct 27 03:29:20.387799 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1232441805 Oct 27 03:29:20.387799 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ListServersNegativeTestJSON-1232441805-project Oct 27 03:29:20.387799 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:29:20.387799 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:29:20.387799 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 071401bed74d48fe8ae2dbdb98aa81cc Oct 27 03:29:20.387799 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ListServersNegativeTestJSON-1232441805-project Oct 27 03:29:20.387799 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:29:20.387799 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance a89c8f12-2492-4a0f-8887-acd62e510fd9 could not be found. Oct 27 03:29:20.387799 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': 'a89c8f12-2492-4a0f-8887-acd62e510fd9'} Oct 27 03:29:20.387799 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:29:20.387799 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:29:20.387799 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:29:20.387799 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:29:20.387799 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:29:20.387799 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:29:20.387799 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:29:20.387799 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:29:20.387799 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:29:20.387799 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:29:20.387799 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a89c8f12-2492-4a0f-8887-acd62e510fd9 could not be found. Oct 27 03:29:20.387799 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:29:20.387799 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:29:20.387799 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:29:20.387799 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:29:20.387799 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:29:20.387799 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:29:20.387799 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:29:20.387799 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:29:20.387799 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:29:20.387799 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:29:20.387799 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:29:20.387799 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:29:20.387799 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:29:20.387799 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:29:20.387799 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:29:20.387799 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:29:20.387799 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a89c8f12-2492-4a0f-8887-acd62e510fd9 could not be found. Oct 27 03:29:20.387799 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:29:20.387799 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:29:20.393164 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:29:20.393164 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:29:20.393164 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:29:20.393164 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:29:20.393164 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:29:20.393164 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:29:20.393164 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a89c8f12-2492-4a0f-8887-acd62e510fd9 could not be found. Oct 27 03:29:20.393164 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:29:20.397835 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7078b36e-560f-467e-b275-e308c7aa2bd1 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Returning 404 to user: Instance a89c8f12-2492-4a0f-8887-acd62e510fd9 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:29:20.399683 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7078b36e-560f-467e-b275-e308c7aa2bd1 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] 10.222.0.20 "GET /compute/v2.1/servers/a89c8f12-2492-4a0f-8887-acd62e510fd9" status: 404 len: 111 microversion: 2.1 time: 0.078952 Oct 27 03:29:20.400436 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1122/2206] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:20 2022] GET /compute/v2.1/servers/a89c8f12-2492-4a0f-8887-acd62e510fd9 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:29:20.412036 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-caa9ee93-611b-4b00-b2fd-f840685e465c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:20.412036 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-caa9ee93-611b-4b00-b2fd-f840685e465c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: a8925d29-d9e0-4dbb-a73d-09473255fa34] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:20.421819 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-caa9ee93-611b-4b00-b2fd-f840685e465c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:20.422539 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-caa9ee93-611b-4b00-b2fd-f840685e465c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:20.423140 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-caa9ee93-611b-4b00-b2fd-f840685e465c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:20.424165 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-caa9ee93-611b-4b00-b2fd-f840685e465c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:20.424795 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-caa9ee93-611b-4b00-b2fd-f840685e465c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:20.425596 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-caa9ee93-611b-4b00-b2fd-f840685e465c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:20.786848 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d119bae9-6470-4e5f-9fc5-d2cc2228783c tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "DELETE /compute/v2.1/images/787934da-f249-4af1-9590-fecf6bc5d90f" status: 204 len: 0 microversion: 2.1 time: 2.213474 Oct 27 03:29:20.787930 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1085/2207] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:18 2022] DELETE /compute/v2.1/images/787934da-f249-4af1-9590-fecf6bc5d90f => generated 0 bytes in 2218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:29:20.795596 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e3b88cb0-4306-4015-9d4e-3ceb1ab749fe tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:20.807094 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e3b88cb0-4306-4015-9d4e-3ceb1ab749fe tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '071401bed74d48fe8ae2dbdb98aa81cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b0b534b9eb463aab0f13e838578da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:20.812937 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e3b88cb0-4306-4015-9d4e-3ceb1ab749fe tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '16b0b534b9eb463aab0f13e838578da2'} {{(pid=121000) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 03:29:20.828943 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e3b88cb0-4306-4015-9d4e-3ceb1ab749fe tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:20.834299 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e3b88cb0-4306-4015-9d4e-3ceb1ab749fe tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:20.834826 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e3b88cb0-4306-4015-9d4e-3ceb1ab749fe tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:20.841767 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e3b88cb0-4306-4015-9d4e-3ceb1ab749fe tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:20.842346 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e3b88cb0-4306-4015-9d4e-3ceb1ab749fe tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:20.842904 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e3b88cb0-4306-4015-9d4e-3ceb1ab749fe tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:20.872211 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-caa9ee93-611b-4b00-b2fd-f840685e465c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:20.881362 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-caa9ee93-611b-4b00-b2fd-f840685e465c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34" status: 200 len: 1392 microversion: 2.1 time: 0.478631 Oct 27 03:29:20.884368 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1123/2208] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:20 2022] GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34 => generated 1392 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:20.889075 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c3969ac8-9313-49dd-a513-5126df7f328f tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:20.889707 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c3969ac8-9313-49dd-a513-5126df7f328f tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] [instance: 57cfac2f-cf21-44fa-881e-f1d3da2be9d2] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:20.902665 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c3969ac8-9313-49dd-a513-5126df7f328f tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:20.905196 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c3969ac8-9313-49dd-a513-5126df7f328f tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:20.905673 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c3969ac8-9313-49dd-a513-5126df7f328f tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:20.906725 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c3969ac8-9313-49dd-a513-5126df7f328f tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:20.907203 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c3969ac8-9313-49dd-a513-5126df7f328f tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:20.907642 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c3969ac8-9313-49dd-a513-5126df7f328f tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:20.967766 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e3b88cb0-4306-4015-9d4e-3ceb1ab749fe tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] 10.222.0.20 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.178428 Oct 27 03:29:20.968370 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1086/2209] 10.222.0.20 () {58 vars in 1230 bytes} [Thu Oct 27 03:29:20 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 03:29:21.033184 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c3969ac8-9313-49dd-a513-5126df7f328f tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421d14944da74570a53d620ea205449d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92082c8718aa41bf96cd84d682d75954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:21.041341 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c3969ac8-9313-49dd-a513-5126df7f328f tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] 10.222.0.20 "GET /compute/v2.1/servers/57cfac2f-cf21-44fa-881e-f1d3da2be9d2" status: 200 len: 1274 microversion: 2.1 time: 0.155820 Oct 27 03:29:21.042297 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1124/2210] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:20 2022] GET /compute/v2.1/servers/57cfac2f-cf21-44fa-881e-f1d3da2be9d2 => generated 1274 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:21.046990 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-532af1f1-b94e-4a64-96b6-0cddbb257820 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:21.047734 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-532af1f1-b94e-4a64-96b6-0cddbb257820 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: d5e6f604-9466-45c6-86a8-885cfb393223] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:21.060237 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-532af1f1-b94e-4a64-96b6-0cddbb257820 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:21.060927 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-532af1f1-b94e-4a64-96b6-0cddbb257820 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:21.064141 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-532af1f1-b94e-4a64-96b6-0cddbb257820 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:21.067687 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-532af1f1-b94e-4a64-96b6-0cddbb257820 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:21.069218 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-532af1f1-b94e-4a64-96b6-0cddbb257820 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:21.070576 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-532af1f1-b94e-4a64-96b6-0cddbb257820 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:21.214449 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d8ba02d8-dd6d-4f84-8c05-5a9277f13626 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Action: 'create', calling method: .version_select at 0x7f7ddee00280>, body: {"keypair": {"name": "tempest-keypair-1781272530", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKXWIC4RpdFQ2i/CYwZirwDRDpLK1ytETFVXU12FvO4lC9za6SeE6rnurkDxpgZyhxWr6fgbQGv1RigUeOs0IyFxXxb0BP6UV8+tUlCy3SYVBXvV64p+wcaSeLUx9s3Mpg=="}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:29:21.233890 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-d8ba02d8-dd6d-4f84-8c05-5a9277f13626 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Getting quotas for project 5514904d799d4f5dae454193e70d85f6. Resources: {'key_pairs'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:29:21.243364 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-d8ba02d8-dd6d-4f84-8c05-5a9277f13626 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Getting quotas for user 9ce351a48282492e8cd69b9a5a05f545 and project 5514904d799d4f5dae454193e70d85f6. Resources: {'key_pairs'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:29:21.363465 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d8ba02d8-dd6d-4f84-8c05-5a9277f13626 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.391845 Oct 27 03:29:21.364625 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1087/2211] 10.222.0.20 () {60 vars in 1159 bytes} [Thu Oct 27 03:29:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:29:21.370627 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-69c33c4a-34a1-44a2-b4c1-cbdda0f770e4 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:21.371460 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-69c33c4a-34a1-44a2-b4c1-cbdda0f770e4 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 49f0475c-d9eb-4ad0-9f88-322521def6c7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:21.379339 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-69c33c4a-34a1-44a2-b4c1-cbdda0f770e4 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:21.380321 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-69c33c4a-34a1-44a2-b4c1-cbdda0f770e4 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:21.381101 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-69c33c4a-34a1-44a2-b4c1-cbdda0f770e4 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:21.382199 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-69c33c4a-34a1-44a2-b4c1-cbdda0f770e4 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:21.382963 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-69c33c4a-34a1-44a2-b4c1-cbdda0f770e4 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:21.383738 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-69c33c4a-34a1-44a2-b4c1-cbdda0f770e4 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:21.408744 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-532af1f1-b94e-4a64-96b6-0cddbb257820 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:21.420961 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-532af1f1-b94e-4a64-96b6-0cddbb257820 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:21.422183 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-69c33c4a-34a1-44a2-b4c1-cbdda0f770e4 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 49f0475c-d9eb-4ad0-9f88-322521def6c7] Going to try to terminate instance {{(pid=121000) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:29:21.422807 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-532af1f1-b94e-4a64-96b6-0cddbb257820 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:21.426026 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-532af1f1-b94e-4a64-96b6-0cddbb257820 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223" status: 200 len: 1487 microversion: 2.25 time: 0.381878 Oct 27 03:29:21.450598 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1125/2212] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:29:21 2022] GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223 => generated 1487 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:29:21.468501 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-12433bd2-6eff-4c69-95db-b80bba0b70ba tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:21.481636 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-12433bd2-6eff-4c69-95db-b80bba0b70ba tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Request method failure captured: Oct 27 03:29:21.481636 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Oct 27 03:29:21.481636 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:29:21.481636 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:29:21.481636 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:29:21.481636 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:29:21.481636 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:29:21.481636 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:29:21.481636 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:29:21.481636 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:29:21.481636 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfrb-edByRevFfuhULifqN92XaPnrz1y9TpvzJVFkI7uY8srOIeoiVbh_koOIlmW1qHemLxQzub1Kep0Hp_Be1wKqdeSKQBD4nXR03SL4r_wU3gh6unzCksFMO-TRc2CaC1FQUAgZM0MiZf4AV8a72xd56R6wjBT67zYw0kkAvZ-L-0 Oct 27 03:29:21.481636 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:29:21.481636 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:29:21.481636 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:29:21.481636 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:29:21.481636 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:29:21.481636 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:29:21.481636 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 16b0b534b9eb463aab0f13e838578da2 Oct 27 03:29:21.481636 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ListServersNegativeTestJSON-1232441805 Oct 27 03:29:21.481636 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:29:21.481636 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:29:21.481636 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/16b0b534b9eb463aab0f13e838578da2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/16b0b534b9eb463aab0f13e838578da2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/16b0b534b9eb463aab0f13e838578da2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_16b0b534b9eb463aab0f13e838578da2"}]}] Oct 27 03:29:21.481636 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ListServersNegativeTestJSON-1232441805 Oct 27 03:29:21.481636 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 16b0b534b9eb463aab0f13e838578da2 Oct 27 03:29:21.481636 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1232441805 Oct 27 03:29:21.481636 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ListServersNegativeTestJSON-1232441805-project Oct 27 03:29:21.481636 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:29:21.481636 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:29:21.481636 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 071401bed74d48fe8ae2dbdb98aa81cc Oct 27 03:29:21.481636 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ListServersNegativeTestJSON-1232441805-project Oct 27 03:29:21.481636 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:29:21.481636 n-d-862769-1 devstack@n-api.service[121001]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 27 03:29:21.481636 n-d-862769-1 devstack@n-api.service[121001]: action_args: {} Oct 27 03:29:21.481636 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:29:21.481636 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:29:21.481636 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 03:29:21.481636 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 03:29:21.481636 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 03:29:21.481636 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise error Oct 27 03:29:21.481636 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Oct 27 03:29:21.481636 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:29:21.481636 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Oct 27 03:29:21.481636 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Oct 27 03:29:21.481636 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:29:21.481636 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 27 03:29:21.481636 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi '2011/01/01' Oct 27 03:29:21.481636 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:29:21.481636 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:29:21.481636 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:29:21.481636 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:29:21.481636 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:29:21.481636 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:29:21.481636 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:29:21.481636 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:29:21.481636 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:29:21.481636 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:29:21.481636 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 03:29:21.481636 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:29:21.481636 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 03:29:21.481636 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:29:21.481636 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 03:29:21.481636 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:29:21.481636 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 27 03:29:21.481636 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 27 03:29:21.481636 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 27 03:29:21.481636 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 03:29:21.488399 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 03:29:21.488399 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 03:29:21.488399 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 03:29:21.488399 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 27 03:29:21.488399 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:29:21.488399 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:29:21.488399 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:29:21.488399 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:29:21.488399 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:29:21.488399 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:29:21.488399 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 03:29:21.488399 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 03:29:21.488399 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 27 03:29:21.488399 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:29:21.493010 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-12433bd2-6eff-4c69-95db-b80bba0b70ba tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:29:21.494883 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-12433bd2-6eff-4c69-95db-b80bba0b70ba tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] 10.222.0.20 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.036414 Oct 27 03:29:21.496353 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1126/2213] 10.222.0.20 () {58 vars in 1182 bytes} [Thu Oct 27 03:29:21 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 03:29:21.503650 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9eb3108b-44c0-43c9-8888-7205cb8825f0 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:21.504551 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-9eb3108b-44c0-43c9-8888-7205cb8825f0 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: 339287fc-37b6-455d-96ab-08ab8e2c3e68] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:21.515809 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9eb3108b-44c0-43c9-8888-7205cb8825f0 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:21.516974 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9eb3108b-44c0-43c9-8888-7205cb8825f0 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:21.517705 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9eb3108b-44c0-43c9-8888-7205cb8825f0 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:21.518649 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9eb3108b-44c0-43c9-8888-7205cb8825f0 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:21.519755 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9eb3108b-44c0-43c9-8888-7205cb8825f0 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:21.520390 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9eb3108b-44c0-43c9-8888-7205cb8825f0 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:21.803910 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9eb3108b-44c0-43c9-8888-7205cb8825f0 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13e05e253c94aadb1c089128ff35be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8510a519f14deea6f35a437419e161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:21.813543 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9eb3108b-44c0-43c9-8888-7205cb8825f0 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68" status: 200 len: 1472 microversion: 2.1 time: 0.315131 Oct 27 03:29:21.822128 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1127/2214] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:21 2022] GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68 => generated 1472 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:21.833360 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-96db2ab0-93b6-4b75-b600-af3a4fcea3ce tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:21.845354 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-96db2ab0-93b6-4b75-b600-af3a4fcea3ce tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '071401bed74d48fe8ae2dbdb98aa81cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b0b534b9eb463aab0f13e838578da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:21.846307 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-96db2ab0-93b6-4b75-b600-af3a4fcea3ce tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Searching by: {'deleted': False, 'project_id': '16b0b534b9eb463aab0f13e838578da2'} {{(pid=121001) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 03:29:21.864229 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-96db2ab0-93b6-4b75-b600-af3a4fcea3ce tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:21.864822 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-96db2ab0-93b6-4b75-b600-af3a4fcea3ce tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:21.866488 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-96db2ab0-93b6-4b75-b600-af3a4fcea3ce tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:21.867543 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-69c33c4a-34a1-44a2-b4c1-cbdda0f770e4 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "DELETE /compute/v2.1/servers/49f0475c-d9eb-4ad0-9f88-322521def6c7" status: 204 len: 0 microversion: 2.1 time: 0.501384 Oct 27 03:29:21.868604 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-96db2ab0-93b6-4b75-b600-af3a4fcea3ce tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:21.869100 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-96db2ab0-93b6-4b75-b600-af3a4fcea3ce tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:21.871781 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-96db2ab0-93b6-4b75-b600-af3a4fcea3ce tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:21.890251 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1088/2215] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:29:21 2022] DELETE /compute/v2.1/servers/49f0475c-d9eb-4ad0-9f88-322521def6c7 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:29:21.913324 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-43e6a2b9-e8cc-4771-9779-1154e035ca54 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:21.914823 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-43e6a2b9-e8cc-4771-9779-1154e035ca54 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: a8925d29-d9e0-4dbb-a73d-09473255fa34] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:21.928963 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.multi_cell_list [None req-96db2ab0-93b6-4b75-b600-af3a4fcea3ce tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=121001) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 03:29:21.938589 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-43e6a2b9-e8cc-4771-9779-1154e035ca54 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:21.940242 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-43e6a2b9-e8cc-4771-9779-1154e035ca54 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:21.941381 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-43e6a2b9-e8cc-4771-9779-1154e035ca54 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:21.943712 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-43e6a2b9-e8cc-4771-9779-1154e035ca54 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:21.947869 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-43e6a2b9-e8cc-4771-9779-1154e035ca54 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:21.948320 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-43e6a2b9-e8cc-4771-9779-1154e035ca54 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:22.013763 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-96db2ab0-93b6-4b75-b600-af3a4fcea3ce tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.190227 Oct 27 03:29:22.014734 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1128/2216] 10.222.0.20 () {58 vars in 1125 bytes} [Thu Oct 27 03:29:21 2022] GET /compute/v2.1/servers => generated 681 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:29:22.038800 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4f09438d-f45f-4608-9275-158aad7540b0 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:22.048914 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4f09438d-f45f-4608-9275-158aad7540b0 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '071401bed74d48fe8ae2dbdb98aa81cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b0b534b9eb463aab0f13e838578da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:22.049410 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.compute.servers [None req-4f09438d-f45f-4608-9275-158aad7540b0 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Removing options 'limit' from query {{(pid=121001) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 27 03:29:22.050188 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4f09438d-f45f-4608-9275-158aad7540b0 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Searching by: {'deleted': False, 'project_id': '16b0b534b9eb463aab0f13e838578da2'} {{(pid=121001) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 03:29:22.066952 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4f09438d-f45f-4608-9275-158aad7540b0 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:22.067709 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4f09438d-f45f-4608-9275-158aad7540b0 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:22.068444 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4f09438d-f45f-4608-9275-158aad7540b0 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:22.095663 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4f09438d-f45f-4608-9275-158aad7540b0 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:22.095663 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4f09438d-f45f-4608-9275-158aad7540b0 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:22.095663 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4f09438d-f45f-4608-9275-158aad7540b0 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:22.134555 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.multi_cell_list [None req-4f09438d-f45f-4608-9275-158aad7540b0 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=121001) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 03:29:22.191474 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4f09438d-f45f-4608-9275-158aad7540b0 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] 10.222.0.20 "GET /compute/v2.1/servers?limit=102" status: 200 len: 681 microversion: 2.1 time: 0.153699 Oct 27 03:29:22.191474 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1129/2217] 10.222.0.20 () {58 vars in 1144 bytes} [Thu Oct 27 03:29:22 2022] GET /compute/v2.1/servers?limit=102 => generated 681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:29:22.191474 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-fd51b822-01f0-46c9-b3e4-80f873e3260a tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:22.191474 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-fd51b822-01f0-46c9-b3e4-80f873e3260a tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] [instance: 57cfac2f-cf21-44fa-881e-f1d3da2be9d2] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:22.195088 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fd51b822-01f0-46c9-b3e4-80f873e3260a tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:22.196025 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fd51b822-01f0-46c9-b3e4-80f873e3260a tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:22.196541 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fd51b822-01f0-46c9-b3e4-80f873e3260a tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:22.197307 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fd51b822-01f0-46c9-b3e4-80f873e3260a tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:22.197765 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fd51b822-01f0-46c9-b3e4-80f873e3260a tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:22.198235 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fd51b822-01f0-46c9-b3e4-80f873e3260a tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:22.277551 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-43e6a2b9-e8cc-4771-9779-1154e035ca54 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:22.287633 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-43e6a2b9-e8cc-4771-9779-1154e035ca54 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34" status: 200 len: 1392 microversion: 2.1 time: 0.380239 Oct 27 03:29:22.288463 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1089/2218] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:21 2022] GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34 => generated 1392 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:22.297787 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8aabec0c-d5a1-41f5-ac65-78f813e07ea5 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-198503240", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": [{"uuid": "a487df35-1b16-4301-a7dc-3642f0ac024b"}]}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:29:22.382575 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-8aabec0c-d5a1-41f5-ac65-78f813e07ea5 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] validate_networks() for [('a487df35-1b16-4301-a7dc-3642f0ac024b', None, None, None, None, None)] {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:29:22.575013 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-fd51b822-01f0-46c9-b3e4-80f873e3260a tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421d14944da74570a53d620ea205449d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92082c8718aa41bf96cd84d682d75954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:22.585174 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-fd51b822-01f0-46c9-b3e4-80f873e3260a tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] 10.222.0.20 "GET /compute/v2.1/servers/57cfac2f-cf21-44fa-881e-f1d3da2be9d2" status: 200 len: 1316 microversion: 2.1 time: 0.405059 Oct 27 03:29:22.591086 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1130/2219] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:22 2022] GET /compute/v2.1/servers/57cfac2f-cf21-44fa-881e-f1d3da2be9d2 => generated 1316 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:22.603039 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-62df8060-df77-43d9-8e2c-39a525e19a90 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:22.608210 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-62df8060-df77-43d9-8e2c-39a525e19a90 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Request method failure captured: Oct 27 03:29:22.608210 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Oct 27 03:29:22.608210 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:29:22.608210 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:29:22.608210 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:29:22.608210 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:29:22.608210 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:29:22.608210 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:29:22.608210 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:29:22.608210 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:29:22.608210 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfrb-edByRevFfuhULifqN92XaPnrz1y9TpvzJVFkI7uY8srOIeoiVbh_koOIlmW1qHemLxQzub1Kep0Hp_Be1wKqdeSKQBD4nXR03SL4r_wU3gh6unzCksFMO-TRc2CaC1FQUAgZM0MiZf4AV8a72xd56R6wjBT67zYw0kkAvZ-L-0 Oct 27 03:29:22.608210 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:29:22.608210 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:29:22.608210 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:29:22.608210 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:29:22.608210 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:29:22.608210 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:29:22.608210 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 16b0b534b9eb463aab0f13e838578da2 Oct 27 03:29:22.608210 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ListServersNegativeTestJSON-1232441805 Oct 27 03:29:22.608210 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:29:22.608210 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:29:22.608210 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/16b0b534b9eb463aab0f13e838578da2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/16b0b534b9eb463aab0f13e838578da2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/16b0b534b9eb463aab0f13e838578da2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_16b0b534b9eb463aab0f13e838578da2"}]}] Oct 27 03:29:22.608210 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ListServersNegativeTestJSON-1232441805 Oct 27 03:29:22.608210 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 16b0b534b9eb463aab0f13e838578da2 Oct 27 03:29:22.608210 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1232441805 Oct 27 03:29:22.608210 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ListServersNegativeTestJSON-1232441805-project Oct 27 03:29:22.608210 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:29:22.608210 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:29:22.608210 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 071401bed74d48fe8ae2dbdb98aa81cc Oct 27 03:29:22.608210 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ListServersNegativeTestJSON-1232441805-project Oct 27 03:29:22.608210 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:29:22.608210 n-d-862769-1 devstack@n-api.service[121001]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 27 03:29:22.608210 n-d-862769-1 devstack@n-api.service[121001]: action_args: {} Oct 27 03:29:22.608210 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:29:22.608210 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:29:22.608210 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 03:29:22.608210 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 03:29:22.608210 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 03:29:22.608210 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise error Oct 27 03:29:22.608210 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Oct 27 03:29:22.608210 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:29:22.608210 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 27 03:29:22.608210 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 27 03:29:22.608210 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 27 03:29:22.608210 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 27 03:29:22.608210 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 27 03:29:22.608210 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:29:22.608210 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 27 03:29:22.608210 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi '-1' Oct 27 03:29:22.608210 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:29:22.608210 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:29:22.608210 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:29:22.608210 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:29:22.608210 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:29:22.608210 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:29:22.608210 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:29:22.608210 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:29:22.608210 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:29:22.608210 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:29:22.608210 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 03:29:22.608210 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:29:22.608210 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 03:29:22.608210 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:29:22.608210 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 03:29:22.608210 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:29:22.608210 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 27 03:29:22.608210 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 27 03:29:22.608210 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 27 03:29:22.619940 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 03:29:22.619940 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 03:29:22.619940 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 03:29:22.619940 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 03:29:22.619940 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 27 03:29:22.619940 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:29:22.619940 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:29:22.619940 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:29:22.619940 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:29:22.619940 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:29:22.619940 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:29:22.619940 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 03:29:22.619940 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 03:29:22.619940 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 27 03:29:22.619940 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:29:22.619940 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-62df8060-df77-43d9-8e2c-39a525e19a90 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:29:22.619940 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-62df8060-df77-43d9-8e2c-39a525e19a90 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] 10.222.0.20 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.016784 Oct 27 03:29:22.619940 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1131/2220] 10.222.0.20 () {58 vars in 1142 bytes} [Thu Oct 27 03:29:22 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 03:29:22.619940 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-630dcd56-1a51-4c33-83fa-7294fc7c95e4 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:22.619940 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-630dcd56-1a51-4c33-83fa-7294fc7c95e4 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: d5e6f604-9466-45c6-86a8-885cfb393223] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:22.626660 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-630dcd56-1a51-4c33-83fa-7294fc7c95e4 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:22.629728 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-630dcd56-1a51-4c33-83fa-7294fc7c95e4 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:22.632657 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-630dcd56-1a51-4c33-83fa-7294fc7c95e4 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:22.632657 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-630dcd56-1a51-4c33-83fa-7294fc7c95e4 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:22.632657 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-630dcd56-1a51-4c33-83fa-7294fc7c95e4 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:22.632657 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-630dcd56-1a51-4c33-83fa-7294fc7c95e4 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:22.864740 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-630dcd56-1a51-4c33-83fa-7294fc7c95e4 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:22.876945 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-630dcd56-1a51-4c33-83fa-7294fc7c95e4 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:22.883025 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-630dcd56-1a51-4c33-83fa-7294fc7c95e4 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:22.891891 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-630dcd56-1a51-4c33-83fa-7294fc7c95e4 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223" status: 200 len: 1487 microversion: 2.25 time: 0.276549 Oct 27 03:29:22.893965 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1132/2221] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:29:22 2022] GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223 => generated 1487 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:29:22.905558 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-11f67441-8376-4722-9fa8-c83e090e21c1 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:22.918448 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-11f67441-8376-4722-9fa8-c83e090e21c1 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Request method failure captured: Oct 27 03:29:22.918448 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Oct 27 03:29:22.918448 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:29:22.918448 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:29:22.918448 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:29:22.918448 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:29:22.918448 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:29:22.918448 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:29:22.918448 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:29:22.918448 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:29:22.918448 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfrb-edByRevFfuhULifqN92XaPnrz1y9TpvzJVFkI7uY8srOIeoiVbh_koOIlmW1qHemLxQzub1Kep0Hp_Be1wKqdeSKQBD4nXR03SL4r_wU3gh6unzCksFMO-TRc2CaC1FQUAgZM0MiZf4AV8a72xd56R6wjBT67zYw0kkAvZ-L-0 Oct 27 03:29:22.918448 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:29:22.918448 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:29:22.918448 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:29:22.918448 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:29:22.918448 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:29:22.918448 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:29:22.918448 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 16b0b534b9eb463aab0f13e838578da2 Oct 27 03:29:22.918448 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ListServersNegativeTestJSON-1232441805 Oct 27 03:29:22.918448 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:29:22.918448 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:29:22.918448 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/16b0b534b9eb463aab0f13e838578da2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/16b0b534b9eb463aab0f13e838578da2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/16b0b534b9eb463aab0f13e838578da2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_16b0b534b9eb463aab0f13e838578da2"}]}] Oct 27 03:29:22.918448 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ListServersNegativeTestJSON-1232441805 Oct 27 03:29:22.918448 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 16b0b534b9eb463aab0f13e838578da2 Oct 27 03:29:22.918448 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1232441805 Oct 27 03:29:22.918448 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ListServersNegativeTestJSON-1232441805-project Oct 27 03:29:22.918448 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:29:22.918448 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:29:22.918448 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 071401bed74d48fe8ae2dbdb98aa81cc Oct 27 03:29:22.918448 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ListServersNegativeTestJSON-1232441805-project Oct 27 03:29:22.918448 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:29:22.918448 n-d-862769-1 devstack@n-api.service[121001]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 27 03:29:22.918448 n-d-862769-1 devstack@n-api.service[121001]: action_args: {} Oct 27 03:29:22.918448 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:29:22.918448 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:29:22.918448 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 03:29:22.918448 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 03:29:22.918448 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 03:29:22.918448 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise error Oct 27 03:29:22.918448 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Oct 27 03:29:22.918448 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:29:22.918448 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 27 03:29:22.918448 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 27 03:29:22.918448 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 27 03:29:22.918448 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 27 03:29:22.918448 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 27 03:29:22.918448 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:29:22.918448 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 27 03:29:22.918448 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi 'testing' Oct 27 03:29:22.918448 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:29:22.918448 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:29:22.918448 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:29:22.918448 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:29:22.918448 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:29:22.918448 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:29:22.918448 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:29:22.918448 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:29:22.918448 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:29:22.918448 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:29:22.918448 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 03:29:22.918448 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:29:22.918448 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 03:29:22.918448 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:29:22.918448 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 03:29:22.918448 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:29:22.918448 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 27 03:29:22.918448 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 27 03:29:22.918448 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 27 03:29:22.924304 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 03:29:22.924304 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 03:29:22.924304 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 03:29:22.924304 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 03:29:22.924304 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 27 03:29:22.924304 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:29:22.924304 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:29:22.924304 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:29:22.924304 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:29:22.924304 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:29:22.924304 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:29:22.924304 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 03:29:22.924304 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 03:29:22.924304 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 27 03:29:22.924304 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:29:22.924304 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-11f67441-8376-4722-9fa8-c83e090e21c1 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:29:22.924304 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-11f67441-8376-4722-9fa8-c83e090e21c1 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] 10.222.0.20 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.025023 Oct 27 03:29:22.926424 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1133/2222] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Oct 27 03:29:22 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 03:29:22.934686 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e5f6755c-c5d4-40f4-b6e8-2eb98f11b6fb tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:22.937383 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e5f6755c-c5d4-40f4-b6e8-2eb98f11b6fb tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: 339287fc-37b6-455d-96ab-08ab8e2c3e68] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:22.961363 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e5f6755c-c5d4-40f4-b6e8-2eb98f11b6fb tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:22.962482 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e5f6755c-c5d4-40f4-b6e8-2eb98f11b6fb tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:22.964681 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e5f6755c-c5d4-40f4-b6e8-2eb98f11b6fb tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:22.967423 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e5f6755c-c5d4-40f4-b6e8-2eb98f11b6fb tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:22.969288 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e5f6755c-c5d4-40f4-b6e8-2eb98f11b6fb tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:22.972771 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e5f6755c-c5d4-40f4-b6e8-2eb98f11b6fb tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:23.358254 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-8aabec0c-d5a1-41f5-ac65-78f813e07ea5 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:29:23.360673 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-8aabec0c-d5a1-41f5-ac65-78f813e07ea5 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:29:23.361509 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-8aabec0c-d5a1-41f5-ac65-78f813e07ea5 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:29:23.362796 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-8aabec0c-d5a1-41f5-ac65-78f813e07ea5 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:29:23.363805 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-8aabec0c-d5a1-41f5-ac65-78f813e07ea5 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:29:23.378497 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8aabec0c-d5a1-41f5-ac65-78f813e07ea5 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:23.379420 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8aabec0c-d5a1-41f5-ac65-78f813e07ea5 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:23.380299 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8aabec0c-d5a1-41f5-ac65-78f813e07ea5 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:23.382168 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8aabec0c-d5a1-41f5-ac65-78f813e07ea5 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:23.382832 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8aabec0c-d5a1-41f5-ac65-78f813e07ea5 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:23.384288 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8aabec0c-d5a1-41f5-ac65-78f813e07ea5 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:23.412982 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-8aabec0c-d5a1-41f5-ac65-78f813e07ea5 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Getting quotas for project ae78c307a1504172828e668f915a3677. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:29:23.420581 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-8aabec0c-d5a1-41f5-ac65-78f813e07ea5 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Getting quotas for user 1d6175f2ac39494f8cba3db225150d6c and project ae78c307a1504172828e668f915a3677. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:29:23.447901 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8aabec0c-d5a1-41f5-ac65-78f813e07ea5 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:29:23.452016 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8aabec0c-d5a1-41f5-ac65-78f813e07ea5 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:29:23.639913 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8aabec0c-d5a1-41f5-ac65-78f813e07ea5 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.343973 Oct 27 03:29:23.642744 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1090/2223] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:29:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1353 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 03:29:23.663352 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-29b15721-9c61-4f60-8789-1c57b0c9555a tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:23.684365 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-29b15721-9c61-4f60-8789-1c57b0c9555a tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '071401bed74d48fe8ae2dbdb98aa81cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b0b534b9eb463aab0f13e838578da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:23.684365 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-29b15721-9c61-4f60-8789-1c57b0c9555a tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '16b0b534b9eb463aab0f13e838578da2'} {{(pid=121000) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 03:29:23.721319 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.compute.servers [None req-29b15721-9c61-4f60-8789-1c57b0c9555a tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Flavor 'non_existing_flavor' could not be found {{(pid=121000) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Oct 27 03:29:23.722523 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-29b15721-9c61-4f60-8789-1c57b0c9555a tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] 10.222.0.20 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.070335 Oct 27 03:29:23.723123 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1091/2224] 10.222.0.20 () {58 vars in 1178 bytes} [Thu Oct 27 03:29:23 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 03:29:23.735380 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-133fe30b-9ac5-4106-a1c3-29ae835d5ac3 req-e611ae61-4f18-47ac-95ce-94a18d266d5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57cfac2f-cf21-44fa-881e-f1d3da2be9d2", "tag": "0bdacda3-4cd1-4742-9510-fd56a466a7b7"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:29:23.762513 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-133fe30b-9ac5-4106-a1c3-29ae835d5ac3 req-e611ae61-4f18-47ac-95ce-94a18d266d5e service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:23.764295 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-133fe30b-9ac5-4106-a1c3-29ae835d5ac3 req-e611ae61-4f18-47ac-95ce-94a18d266d5e service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:23.766295 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-133fe30b-9ac5-4106-a1c3-29ae835d5ac3 req-e611ae61-4f18-47ac-95ce-94a18d266d5e service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:23.807885 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-133fe30b-9ac5-4106-a1c3-29ae835d5ac3 req-e611ae61-4f18-47ac-95ce-94a18d266d5e service nova] Creating event network-changed:0bdacda3-4cd1-4742-9510-fd56a466a7b7 for instance 57cfac2f-cf21-44fa-881e-f1d3da2be9d2 on n-h2-862769-1 Oct 27 03:29:23.818857 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-133fe30b-9ac5-4106-a1c3-29ae835d5ac3 req-e611ae61-4f18-47ac-95ce-94a18d266d5e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093537 Oct 27 03:29:23.819500 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1092/2225] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:29:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:29:23.855945 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-230bdd20-6f9b-402e-b9ec-61eb357689e1 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:23.856779 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-230bdd20-6f9b-402e-b9ec-61eb357689e1 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: a8925d29-d9e0-4dbb-a73d-09473255fa34] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:23.876263 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-230bdd20-6f9b-402e-b9ec-61eb357689e1 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:23.880296 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e5f6755c-c5d4-40f4-b6e8-2eb98f11b6fb tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13e05e253c94aadb1c089128ff35be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8510a519f14deea6f35a437419e161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:23.881486 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-230bdd20-6f9b-402e-b9ec-61eb357689e1 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:23.883853 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-230bdd20-6f9b-402e-b9ec-61eb357689e1 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:23.885795 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-230bdd20-6f9b-402e-b9ec-61eb357689e1 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:23.886834 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-230bdd20-6f9b-402e-b9ec-61eb357689e1 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:23.888127 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-230bdd20-6f9b-402e-b9ec-61eb357689e1 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:23.908570 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e5f6755c-c5d4-40f4-b6e8-2eb98f11b6fb tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68" status: 200 len: 1472 microversion: 2.1 time: 0.978281 Oct 27 03:29:23.911009 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1134/2226] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:22 2022] GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68 => generated 1472 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:23.931998 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ae1507d5-0cc3-4ef4-907b-9ea2ec412f5d tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:23.935207 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ae1507d5-0cc3-4ef4-907b-9ea2ec412f5d tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] [instance: 57cfac2f-cf21-44fa-881e-f1d3da2be9d2] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:23.957432 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ae1507d5-0cc3-4ef4-907b-9ea2ec412f5d tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:23.958573 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ae1507d5-0cc3-4ef4-907b-9ea2ec412f5d tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:23.960731 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ae1507d5-0cc3-4ef4-907b-9ea2ec412f5d tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:23.963091 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ae1507d5-0cc3-4ef4-907b-9ea2ec412f5d tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:23.965841 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ae1507d5-0cc3-4ef4-907b-9ea2ec412f5d tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:23.968684 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ae1507d5-0cc3-4ef4-907b-9ea2ec412f5d tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:24.394756 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ae1507d5-0cc3-4ef4-907b-9ea2ec412f5d tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421d14944da74570a53d620ea205449d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92082c8718aa41bf96cd84d682d75954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:24.401587 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ae1507d5-0cc3-4ef4-907b-9ea2ec412f5d tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] 10.222.0.20 "GET /compute/v2.1/servers/57cfac2f-cf21-44fa-881e-f1d3da2be9d2" status: 200 len: 1316 microversion: 2.1 time: 0.488927 Oct 27 03:29:24.402105 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1135/2227] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:23 2022] GET /compute/v2.1/servers/57cfac2f-cf21-44fa-881e-f1d3da2be9d2 => generated 1316 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:24.414754 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-46f0aba0-6491-4543-9ce1-54fbbe01254b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:24.417681 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-46f0aba0-6491-4543-9ce1-54fbbe01254b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:24.430585 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-230bdd20-6f9b-402e-b9ec-61eb357689e1 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:24.441899 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-230bdd20-6f9b-402e-b9ec-61eb357689e1 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34" status: 200 len: 1392 microversion: 2.1 time: 0.616870 Oct 27 03:29:24.444886 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1093/2228] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:23 2022] GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34 => generated 1392 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:24.453689 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-dc2e274b-afff-4921-b861-cabee4baddd1 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:24.490508 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-dc2e274b-afff-4921-b861-cabee4baddd1 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '071401bed74d48fe8ae2dbdb98aa81cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b0b534b9eb463aab0f13e838578da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:24.493403 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-dc2e274b-afff-4921-b861-cabee4baddd1 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '16b0b534b9eb463aab0f13e838578da2'} {{(pid=121000) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 03:29:24.502828 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dc2e274b-afff-4921-b861-cabee4baddd1 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:24.504076 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dc2e274b-afff-4921-b861-cabee4baddd1 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:24.504913 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dc2e274b-afff-4921-b861-cabee4baddd1 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:24.506617 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dc2e274b-afff-4921-b861-cabee4baddd1 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:24.507553 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dc2e274b-afff-4921-b861-cabee4baddd1 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:24.508223 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dc2e274b-afff-4921-b861-cabee4baddd1 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:24.531113 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-46f0aba0-6491-4543-9ce1-54fbbe01254b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:24.546432 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-46f0aba0-6491-4543-9ce1-54fbbe01254b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c" status: 200 len: 1207 microversion: 2.1 time: 0.128555 Oct 27 03:29:24.564037 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1136/2229] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:24 2022] GET /compute/v2.1/servers/a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c => generated 1207 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:24.576487 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-fd8b38be-7784-4cb0-9f73-05ffbd1ab11e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:24.580569 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-fd8b38be-7784-4cb0-9f73-05ffbd1ab11e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: d5e6f604-9466-45c6-86a8-885cfb393223] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:24.594912 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fd8b38be-7784-4cb0-9f73-05ffbd1ab11e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:24.600796 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fd8b38be-7784-4cb0-9f73-05ffbd1ab11e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:24.601560 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fd8b38be-7784-4cb0-9f73-05ffbd1ab11e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:24.602796 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fd8b38be-7784-4cb0-9f73-05ffbd1ab11e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:24.603452 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fd8b38be-7784-4cb0-9f73-05ffbd1ab11e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:24.604092 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fd8b38be-7784-4cb0-9f73-05ffbd1ab11e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:24.775894 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-dc2e274b-afff-4921-b861-cabee4baddd1 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] 10.222.0.20 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.329392 Oct 27 03:29:24.777311 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1094/2230] 10.222.0.20 () {58 vars in 1174 bytes} [Thu Oct 27 03:29:24 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 03:29:24.792896 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-92a1bbdf-c86e-4ae8-b23e-f67b3e4486aa tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:24.801053 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-92a1bbdf-c86e-4ae8-b23e-f67b3e4486aa tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '071401bed74d48fe8ae2dbdb98aa81cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b0b534b9eb463aab0f13e838578da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:24.802796 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-92a1bbdf-c86e-4ae8-b23e-f67b3e4486aa tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '16b0b534b9eb463aab0f13e838578da2'} {{(pid=121000) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 03:29:24.810942 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-92a1bbdf-c86e-4ae8-b23e-f67b3e4486aa tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:24.811946 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-92a1bbdf-c86e-4ae8-b23e-f67b3e4486aa tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:24.813383 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-92a1bbdf-c86e-4ae8-b23e-f67b3e4486aa tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:24.814933 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-92a1bbdf-c86e-4ae8-b23e-f67b3e4486aa tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:24.815670 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-92a1bbdf-c86e-4ae8-b23e-f67b3e4486aa tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:24.817017 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-92a1bbdf-c86e-4ae8-b23e-f67b3e4486aa tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:24.927280 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-92a1bbdf-c86e-4ae8-b23e-f67b3e4486aa tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] 10.222.0.20 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.139304 Oct 27 03:29:24.928447 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1095/2231] 10.222.0.20 () {58 vars in 1184 bytes} [Thu Oct 27 03:29:24 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 27 03:29:24.939301 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-bfba7d0b-2fde-4950-b3ed-bfebfd7811d0 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:24.940354 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-bfba7d0b-2fde-4950-b3ed-bfebfd7811d0 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: 339287fc-37b6-455d-96ab-08ab8e2c3e68] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:24.950978 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bfba7d0b-2fde-4950-b3ed-bfebfd7811d0 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:24.952537 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bfba7d0b-2fde-4950-b3ed-bfebfd7811d0 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:24.953180 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bfba7d0b-2fde-4950-b3ed-bfebfd7811d0 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:24.955158 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bfba7d0b-2fde-4950-b3ed-bfebfd7811d0 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:24.955925 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bfba7d0b-2fde-4950-b3ed-bfebfd7811d0 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:24.956596 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bfba7d0b-2fde-4950-b3ed-bfebfd7811d0 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:25.133310 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-fd8b38be-7784-4cb0-9f73-05ffbd1ab11e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:25.141756 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-fd8b38be-7784-4cb0-9f73-05ffbd1ab11e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:25.144888 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-fd8b38be-7784-4cb0-9f73-05ffbd1ab11e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:25.146263 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-fd8b38be-7784-4cb0-9f73-05ffbd1ab11e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223" status: 200 len: 1487 microversion: 2.25 time: 0.573912 Oct 27 03:29:25.166027 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1137/2232] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:29:24 2022] GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223 => generated 1487 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:29:25.171558 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e219b735-995f-4739-96c5-40773d7905b6 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:25.182681 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e219b735-995f-4739-96c5-40773d7905b6 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '071401bed74d48fe8ae2dbdb98aa81cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b0b534b9eb463aab0f13e838578da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:25.183380 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e219b735-995f-4739-96c5-40773d7905b6 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Searching by: {'deleted': False, 'project_id': '16b0b534b9eb463aab0f13e838578da2'} {{(pid=121001) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 03:29:25.190368 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-bfba7d0b-2fde-4950-b3ed-bfebfd7811d0 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13e05e253c94aadb1c089128ff35be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8510a519f14deea6f35a437419e161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:25.195423 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e219b735-995f-4739-96c5-40773d7905b6 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:25.197255 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e219b735-995f-4739-96c5-40773d7905b6 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:25.198305 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e219b735-995f-4739-96c5-40773d7905b6 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:25.199819 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e219b735-995f-4739-96c5-40773d7905b6 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:25.202619 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e219b735-995f-4739-96c5-40773d7905b6 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:25.205828 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e219b735-995f-4739-96c5-40773d7905b6 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:25.208995 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-bfba7d0b-2fde-4950-b3ed-bfebfd7811d0 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68" status: 200 len: 1472 microversion: 2.1 time: 0.275834 Oct 27 03:29:25.212676 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1096/2233] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:24 2022] GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68 => generated 1472 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:25.274922 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.multi_cell_list [None req-e219b735-995f-4739-96c5-40773d7905b6 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=121001) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 03:29:25.322005 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e219b735-995f-4739-96c5-40773d7905b6 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '071401bed74d48fe8ae2dbdb98aa81cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b0b534b9eb463aab0f13e838578da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:25.329411 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e219b735-995f-4739-96c5-40773d7905b6 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:25.329911 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e219b735-995f-4739-96c5-40773d7905b6 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:25.330390 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e219b735-995f-4739-96c5-40773d7905b6 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:25.333748 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=100 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:29:25.433309 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-48872e29-1d8b-44bf-b4c6-3942e814c180 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:25.433898 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-48872e29-1d8b-44bf-b4c6-3942e814c180 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] [instance: 57cfac2f-cf21-44fa-881e-f1d3da2be9d2] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:25.463171 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-48872e29-1d8b-44bf-b4c6-3942e814c180 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:25.468332 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-48872e29-1d8b-44bf-b4c6-3942e814c180 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:25.468843 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-48872e29-1d8b-44bf-b4c6-3942e814c180 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:25.475522 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-48872e29-1d8b-44bf-b4c6-3942e814c180 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:25.481057 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-48872e29-1d8b-44bf-b4c6-3942e814c180 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:25.481566 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-48872e29-1d8b-44bf-b4c6-3942e814c180 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:25.981292 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e219b735-995f-4739-96c5-40773d7905b6 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] 10.222.0.20 "GET /compute/v2.1/servers/detail" status: 200 len: 3022 microversion: 2.1 time: 0.813417 Oct 27 03:29:25.982786 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1138/2234] 10.222.0.20 () {58 vars in 1146 bytes} [Thu Oct 27 03:29:25 2022] GET /compute/v2.1/servers/detail => generated 3022 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:25.990551 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3534d810-2758-44da-8210-d2c3c8015ce0 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:25.991529 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3534d810-2758-44da-8210-d2c3c8015ce0 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: a8925d29-d9e0-4dbb-a73d-09473255fa34] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:26.009789 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3534d810-2758-44da-8210-d2c3c8015ce0 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:26.011339 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3534d810-2758-44da-8210-d2c3c8015ce0 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:26.013455 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3534d810-2758-44da-8210-d2c3c8015ce0 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:26.015592 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3534d810-2758-44da-8210-d2c3c8015ce0 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:26.020868 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3534d810-2758-44da-8210-d2c3c8015ce0 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:26.024484 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3534d810-2758-44da-8210-d2c3c8015ce0 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:26.073571 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-48872e29-1d8b-44bf-b4c6-3942e814c180 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421d14944da74570a53d620ea205449d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92082c8718aa41bf96cd84d682d75954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:26.089177 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-48872e29-1d8b-44bf-b4c6-3942e814c180 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] 10.222.0.20 "GET /compute/v2.1/servers/57cfac2f-cf21-44fa-881e-f1d3da2be9d2" status: 200 len: 1316 microversion: 2.1 time: 0.661098 Oct 27 03:29:26.110178 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1097/2235] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:25 2022] GET /compute/v2.1/servers/57cfac2f-cf21-44fa-881e-f1d3da2be9d2 => generated 1316 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:26.134294 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1851b41c-5af1-413c-b714-4ef01caefcfc tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:26.135488 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1851b41c-5af1-413c-b714-4ef01caefcfc tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:26.150108 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1851b41c-5af1-413c-b714-4ef01caefcfc tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:26.152795 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1851b41c-5af1-413c-b714-4ef01caefcfc tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:26.154391 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1851b41c-5af1-413c-b714-4ef01caefcfc tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:26.157884 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1851b41c-5af1-413c-b714-4ef01caefcfc tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:26.160837 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1851b41c-5af1-413c-b714-4ef01caefcfc tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:26.161648 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1851b41c-5af1-413c-b714-4ef01caefcfc tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:26.205592 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:29:26.304901 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1851b41c-5af1-413c-b714-4ef01caefcfc tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:26.324835 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1851b41c-5af1-413c-b714-4ef01caefcfc tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c" status: 200 len: 1211 microversion: 2.1 time: 0.213264 Oct 27 03:29:26.337409 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1098/2236] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:26 2022] GET /compute/v2.1/servers/a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c => generated 1211 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:26.347454 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-bd904f2d-1091-4115-a5a2-d733d670ef2f req-6343f853-e1b4-4a9c-9dba-700d8a09239d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8925d29-d9e0-4dbb-a73d-09473255fa34", "name": "network-vif-unplugged", "status": "completed", "tag": "dfa74d77-ff34-4f03-a07f-cf59ea6cd793"}, {"name": "network-changed", "server_uuid": "a8925d29-d9e0-4dbb-a73d-09473255fa34", "tag": "dfa74d77-ff34-4f03-a07f-cf59ea6cd793"}, {"server_uuid": "49f0475c-d9eb-4ad0-9f88-322521def6c7", "name": "network-vif-deleted", "tag": "2e7b6414-960b-4793-94ae-d4e9bc9cb2a7"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:29:26.374707 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-bd904f2d-1091-4115-a5a2-d733d670ef2f req-6343f853-e1b4-4a9c-9dba-700d8a09239d service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:26.377822 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-bd904f2d-1091-4115-a5a2-d733d670ef2f req-6343f853-e1b4-4a9c-9dba-700d8a09239d service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:26.380798 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-bd904f2d-1091-4115-a5a2-d733d670ef2f req-6343f853-e1b4-4a9c-9dba-700d8a09239d service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:26.412220 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-bd904f2d-1091-4115-a5a2-d733d670ef2f req-6343f853-e1b4-4a9c-9dba-700d8a09239d service nova] Creating event network-vif-unplugged:dfa74d77-ff34-4f03-a07f-cf59ea6cd793 for instance a8925d29-d9e0-4dbb-a73d-09473255fa34 on n-h1-862769-1 Oct 27 03:29:26.412737 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-bd904f2d-1091-4115-a5a2-d733d670ef2f req-6343f853-e1b4-4a9c-9dba-700d8a09239d service nova] Creating event network-changed:dfa74d77-ff34-4f03-a07f-cf59ea6cd793 for instance a8925d29-d9e0-4dbb-a73d-09473255fa34 on n-h1-862769-1 Oct 27 03:29:26.413249 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-bd904f2d-1091-4115-a5a2-d733d670ef2f req-6343f853-e1b4-4a9c-9dba-700d8a09239d service nova] Creating event network-vif-deleted:2e7b6414-960b-4793-94ae-d4e9bc9cb2a7 for instance 49f0475c-d9eb-4ad0-9f88-322521def6c7 on n-h1-862769-1 Oct 27 03:29:26.424783 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-bd904f2d-1091-4115-a5a2-d733d670ef2f req-6343f853-e1b4-4a9c-9dba-700d8a09239d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 523 microversion: 2.1 time: 0.083725 Oct 27 03:29:26.429965 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1099/2237] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:29:26 2022] POST /compute/v2.1/os-server-external-events => generated 523 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:29:26.440188 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2556b6ce-ee23-4de9-b594-be55f0a8fe21 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:26.449692 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2556b6ce-ee23-4de9-b594-be55f0a8fe21 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '071401bed74d48fe8ae2dbdb98aa81cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b0b534b9eb463aab0f13e838578da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:26.461042 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2556b6ce-ee23-4de9-b594-be55f0a8fe21 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] 10.222.0.20 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.029127 Oct 27 03:29:26.468091 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1100/2238] 10.222.0.20 () {58 vars in 1178 bytes} [Thu Oct 27 03:29:26 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 03:29:26.495145 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-851fcc09-6a06-4858-8b17-6310e879341b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:26.498448 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-851fcc09-6a06-4858-8b17-6310e879341b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: d5e6f604-9466-45c6-86a8-885cfb393223] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:26.525292 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-851fcc09-6a06-4858-8b17-6310e879341b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:26.526726 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-851fcc09-6a06-4858-8b17-6310e879341b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:26.526726 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-851fcc09-6a06-4858-8b17-6310e879341b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:26.527360 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-851fcc09-6a06-4858-8b17-6310e879341b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:26.527820 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-851fcc09-6a06-4858-8b17-6310e879341b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:26.528249 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-851fcc09-6a06-4858-8b17-6310e879341b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:26.875889 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-851fcc09-6a06-4858-8b17-6310e879341b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:26.889045 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-851fcc09-6a06-4858-8b17-6310e879341b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:26.890543 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-851fcc09-6a06-4858-8b17-6310e879341b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:26.891755 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-851fcc09-6a06-4858-8b17-6310e879341b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223" status: 200 len: 1487 microversion: 2.25 time: 0.422590 Oct 27 03:29:26.892337 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1101/2239] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:29:26 2022] GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223 => generated 1487 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:29:26.920923 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0ab8401e-f2bc-4d4e-88f8-910e7ce2681f tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:26.921714 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0ab8401e-f2bc-4d4e-88f8-910e7ce2681f tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: 339287fc-37b6-455d-96ab-08ab8e2c3e68] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:26.942936 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0ab8401e-f2bc-4d4e-88f8-910e7ce2681f tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:26.943460 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0ab8401e-f2bc-4d4e-88f8-910e7ce2681f tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:26.945873 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0ab8401e-f2bc-4d4e-88f8-910e7ce2681f tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:26.947437 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3534d810-2758-44da-8210-d2c3c8015ce0 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:26.948496 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0ab8401e-f2bc-4d4e-88f8-910e7ce2681f tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:26.949002 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0ab8401e-f2bc-4d4e-88f8-910e7ce2681f tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:26.952095 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0ab8401e-f2bc-4d4e-88f8-910e7ce2681f tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:26.958802 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3534d810-2758-44da-8210-d2c3c8015ce0 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34" status: 200 len: 1392 microversion: 2.1 time: 0.973498 Oct 27 03:29:26.959498 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1139/2240] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:25 2022] GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34 => generated 1392 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:26.980809 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8e609dcb-40bb-4e2c-955b-cb9647e8b78e tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:27.000517 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8e609dcb-40bb-4e2c-955b-cb9647e8b78e tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '071401bed74d48fe8ae2dbdb98aa81cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b0b534b9eb463aab0f13e838578da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:27.000517 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8e609dcb-40bb-4e2c-955b-cb9647e8b78e tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Searching by: {'deleted': False, 'project_id': '16b0b534b9eb463aab0f13e838578da2'} {{(pid=121001) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 03:29:27.013440 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8e609dcb-40bb-4e2c-955b-cb9647e8b78e tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:27.016236 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8e609dcb-40bb-4e2c-955b-cb9647e8b78e tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:27.016980 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8e609dcb-40bb-4e2c-955b-cb9647e8b78e tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:27.018660 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8e609dcb-40bb-4e2c-955b-cb9647e8b78e tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:27.022814 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8e609dcb-40bb-4e2c-955b-cb9647e8b78e tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:27.022814 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8e609dcb-40bb-4e2c-955b-cb9647e8b78e tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:27.086172 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.multi_cell_list [None req-8e609dcb-40bb-4e2c-955b-cb9647e8b78e tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=121001) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 03:29:27.145024 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8e609dcb-40bb-4e2c-955b-cb9647e8b78e tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.181487 Oct 27 03:29:27.159359 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1140/2241] 10.222.0.20 () {58 vars in 1125 bytes} [Thu Oct 27 03:29:26 2022] GET /compute/v2.1/servers => generated 681 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:29:27.165285 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8872653e-100a-439f-9f82-3f94bb283a71 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:27.167119 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8872653e-100a-439f-9f82-3f94bb283a71 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] [instance: 57cfac2f-cf21-44fa-881e-f1d3da2be9d2] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:27.177553 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8872653e-100a-439f-9f82-3f94bb283a71 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:27.178712 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8872653e-100a-439f-9f82-3f94bb283a71 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:27.188113 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8872653e-100a-439f-9f82-3f94bb283a71 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:27.189902 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8872653e-100a-439f-9f82-3f94bb283a71 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:27.193426 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8872653e-100a-439f-9f82-3f94bb283a71 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:27.194201 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8872653e-100a-439f-9f82-3f94bb283a71 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:27.656625 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8872653e-100a-439f-9f82-3f94bb283a71 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421d14944da74570a53d620ea205449d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92082c8718aa41bf96cd84d682d75954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:27.676241 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8872653e-100a-439f-9f82-3f94bb283a71 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] 10.222.0.20 "GET /compute/v2.1/servers/57cfac2f-cf21-44fa-881e-f1d3da2be9d2" status: 200 len: 1316 microversion: 2.1 time: 0.517729 Oct 27 03:29:27.677000 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1141/2242] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:27 2022] GET /compute/v2.1/servers/57cfac2f-cf21-44fa-881e-f1d3da2be9d2 => generated 1316 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:27.687030 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3e4dee89-4ce2-45eb-87e1-53d6af2018c9 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:27.687797 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3e4dee89-4ce2-45eb-87e1-53d6af2018c9 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] [instance: a89c8f12-2492-4a0f-8887-acd62e510fd9] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:27.702941 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3e4dee89-4ce2-45eb-87e1-53d6af2018c9 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:27.705336 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3e4dee89-4ce2-45eb-87e1-53d6af2018c9 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:27.708018 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3e4dee89-4ce2-45eb-87e1-53d6af2018c9 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:27.709086 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3e4dee89-4ce2-45eb-87e1-53d6af2018c9 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:27.715118 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3e4dee89-4ce2-45eb-87e1-53d6af2018c9 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:27.715118 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3e4dee89-4ce2-45eb-87e1-53d6af2018c9 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:27.744562 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-3e4dee89-4ce2-45eb-87e1-53d6af2018c9 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] HTTP exception thrown: Instance a89c8f12-2492-4a0f-8887-acd62e510fd9 could not be found. Oct 27 03:29:27.746260 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3e4dee89-4ce2-45eb-87e1-53d6af2018c9 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Request method failure captured: Oct 27 03:29:27.746260 n-d-862769-1 devstack@n-api.service[121001]: request: DELETE /compute/v2.1/servers/a89c8f12-2492-4a0f-8887-acd62e510fd9 HTTP/1.1 Oct 27 03:29:27.746260 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:29:27.746260 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:29:27.746260 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:29:27.746260 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:29:27.746260 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:29:27.746260 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:29:27.746260 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:29:27.746260 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:29:27.746260 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfrb-edByRevFfuhULifqN92XaPnrz1y9TpvzJVFkI7uY8srOIeoiVbh_koOIlmW1qHemLxQzub1Kep0Hp_Be1wKqdeSKQBD4nXR03SL4r_wU3gh6unzCksFMO-TRc2CaC1FQUAgZM0MiZf4AV8a72xd56R6wjBT67zYw0kkAvZ-L-0 Oct 27 03:29:27.746260 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:29:27.746260 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:29:27.746260 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:29:27.746260 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:29:27.746260 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:29:27.746260 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:29:27.746260 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 16b0b534b9eb463aab0f13e838578da2 Oct 27 03:29:27.746260 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ListServersNegativeTestJSON-1232441805 Oct 27 03:29:27.746260 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:29:27.746260 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:29:27.746260 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/16b0b534b9eb463aab0f13e838578da2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/16b0b534b9eb463aab0f13e838578da2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/16b0b534b9eb463aab0f13e838578da2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_16b0b534b9eb463aab0f13e838578da2"}]}] Oct 27 03:29:27.746260 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ListServersNegativeTestJSON-1232441805 Oct 27 03:29:27.746260 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 16b0b534b9eb463aab0f13e838578da2 Oct 27 03:29:27.746260 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1232441805 Oct 27 03:29:27.746260 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ListServersNegativeTestJSON-1232441805-project Oct 27 03:29:27.746260 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:29:27.746260 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:29:27.746260 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 071401bed74d48fe8ae2dbdb98aa81cc Oct 27 03:29:27.746260 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ListServersNegativeTestJSON-1232441805-project Oct 27 03:29:27.746260 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:29:27.746260 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance a89c8f12-2492-4a0f-8887-acd62e510fd9 could not be found. Oct 27 03:29:27.746260 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': 'a89c8f12-2492-4a0f-8887-acd62e510fd9'} Oct 27 03:29:27.746260 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:29:27.746260 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:29:27.746260 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:29:27.746260 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:29:27.746260 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:29:27.746260 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:29:27.746260 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:29:27.746260 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:29:27.746260 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:29:27.746260 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:29:27.746260 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a89c8f12-2492-4a0f-8887-acd62e510fd9 could not be found. Oct 27 03:29:27.746260 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:29:27.746260 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:29:27.746260 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:29:27.746260 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:29:27.746260 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:29:27.746260 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:29:27.746260 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:29:27.746260 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:29:27.746260 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:29:27.746260 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:29:27.746260 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 03:29:27.746260 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 03:29:27.746260 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 03:29:27.746260 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 03:29:27.746260 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:29:27.746260 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:29:27.746260 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:29:27.746260 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:29:27.751677 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a89c8f12-2492-4a0f-8887-acd62e510fd9 could not be found. Oct 27 03:29:27.751677 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:29:27.751677 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:29:27.751677 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:29:27.751677 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:29:27.751677 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:29:27.751677 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:29:27.751677 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:29:27.751677 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:29:27.751677 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a89c8f12-2492-4a0f-8887-acd62e510fd9 could not be found. Oct 27 03:29:27.751677 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:29:27.754547 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3e4dee89-4ce2-45eb-87e1-53d6af2018c9 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Returning 404 to user: Instance a89c8f12-2492-4a0f-8887-acd62e510fd9 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:29:27.756043 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3e4dee89-4ce2-45eb-87e1-53d6af2018c9 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a89c8f12-2492-4a0f-8887-acd62e510fd9" status: 404 len: 111 microversion: 2.1 time: 0.077667 Oct 27 03:29:27.756802 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1142/2243] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:29:27 2022] DELETE /compute/v2.1/servers/a89c8f12-2492-4a0f-8887-acd62e510fd9 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:29:27.764084 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-79bd34ff-cde5-44d2-9069-74ca05b06e42 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:27.764960 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-79bd34ff-cde5-44d2-9069-74ca05b06e42 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:27.772594 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-79bd34ff-cde5-44d2-9069-74ca05b06e42 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:27.773456 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-79bd34ff-cde5-44d2-9069-74ca05b06e42 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:27.774355 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-79bd34ff-cde5-44d2-9069-74ca05b06e42 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:27.775256 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-79bd34ff-cde5-44d2-9069-74ca05b06e42 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:27.786753 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-79bd34ff-cde5-44d2-9069-74ca05b06e42 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:27.787466 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-79bd34ff-cde5-44d2-9069-74ca05b06e42 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:27.892312 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-79bd34ff-cde5-44d2-9069-74ca05b06e42 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:27.902595 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-79bd34ff-cde5-44d2-9069-74ca05b06e42 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c" status: 200 len: 1267 microversion: 2.1 time: 0.143628 Oct 27 03:29:27.906221 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1143/2244] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:27 2022] GET /compute/v2.1/servers/a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c => generated 1267 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:27.921873 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a689b199-e2ae-418f-bc85-2509eeb74fff tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:27.924630 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a689b199-e2ae-418f-bc85-2509eeb74fff tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] [instance: b3dd0fa3-e3b4-471c-b65b-0a190b7c4701] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:27.933529 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a689b199-e2ae-418f-bc85-2509eeb74fff tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:27.934396 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a689b199-e2ae-418f-bc85-2509eeb74fff tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:27.935041 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a689b199-e2ae-418f-bc85-2509eeb74fff tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:27.935947 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a689b199-e2ae-418f-bc85-2509eeb74fff tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:27.936633 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a689b199-e2ae-418f-bc85-2509eeb74fff tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:27.937235 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a689b199-e2ae-418f-bc85-2509eeb74fff tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:27.974290 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a689b199-e2ae-418f-bc85-2509eeb74fff tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] [instance: b3dd0fa3-e3b4-471c-b65b-0a190b7c4701] Going to try to terminate instance {{(pid=121001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:29:28.176992 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0ab8401e-f2bc-4d4e-88f8-910e7ce2681f tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13e05e253c94aadb1c089128ff35be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8510a519f14deea6f35a437419e161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:28.194789 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0ab8401e-f2bc-4d4e-88f8-910e7ce2681f tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68" status: 200 len: 1472 microversion: 2.1 time: 1.301224 Oct 27 03:29:28.207132 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1102/2245] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:26 2022] GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68 => generated 1472 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:28.229772 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8249aca2-a0a6-4356-95c3-8e1f03c10f91 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:28.230456 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8249aca2-a0a6-4356-95c3-8e1f03c10f91 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: d5e6f604-9466-45c6-86a8-885cfb393223] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:28.254257 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8249aca2-a0a6-4356-95c3-8e1f03c10f91 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:28.261445 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8249aca2-a0a6-4356-95c3-8e1f03c10f91 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:28.262072 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8249aca2-a0a6-4356-95c3-8e1f03c10f91 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:28.262862 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8249aca2-a0a6-4356-95c3-8e1f03c10f91 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:28.263399 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8249aca2-a0a6-4356-95c3-8e1f03c10f91 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:28.267337 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8249aca2-a0a6-4356-95c3-8e1f03c10f91 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:28.361824 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a689b199-e2ae-418f-bc85-2509eeb74fff tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b3dd0fa3-e3b4-471c-b65b-0a190b7c4701" status: 204 len: 0 microversion: 2.1 time: 0.450677 Oct 27 03:29:28.362094 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1144/2246] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:29:27 2022] DELETE /compute/v2.1/servers/b3dd0fa3-e3b4-471c-b65b-0a190b7c4701 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:29:28.371089 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9b6f22ce-d47d-4aa6-bc03-e0abf0d0aad0 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:28.373965 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-9b6f22ce-d47d-4aa6-bc03-e0abf0d0aad0 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: a8925d29-d9e0-4dbb-a73d-09473255fa34] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:28.389856 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9b6f22ce-d47d-4aa6-bc03-e0abf0d0aad0 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:28.390348 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9b6f22ce-d47d-4aa6-bc03-e0abf0d0aad0 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:28.391153 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9b6f22ce-d47d-4aa6-bc03-e0abf0d0aad0 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:28.392056 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9b6f22ce-d47d-4aa6-bc03-e0abf0d0aad0 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:28.392669 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9b6f22ce-d47d-4aa6-bc03-e0abf0d0aad0 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:28.393264 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9b6f22ce-d47d-4aa6-bc03-e0abf0d0aad0 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:28.733407 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9b6f22ce-d47d-4aa6-bc03-e0abf0d0aad0 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:28.742027 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9b6f22ce-d47d-4aa6-bc03-e0abf0d0aad0 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34" status: 200 len: 1392 microversion: 2.1 time: 0.377734 Oct 27 03:29:28.742668 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1145/2247] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:28 2022] GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34 => generated 1392 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:28.747251 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-162c13e2-054b-4ec8-a518-715179d51b0b tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:28.752009 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-162c13e2-054b-4ec8-a518-715179d51b0b tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] [instance: 2aa6c062-32e4-453d-abb5-a51d96c66e2d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:28.767456 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-162c13e2-054b-4ec8-a518-715179d51b0b tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:28.768159 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-162c13e2-054b-4ec8-a518-715179d51b0b tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:28.769404 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-162c13e2-054b-4ec8-a518-715179d51b0b tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:28.770380 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-162c13e2-054b-4ec8-a518-715179d51b0b tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:28.771045 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-162c13e2-054b-4ec8-a518-715179d51b0b tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:28.771668 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-162c13e2-054b-4ec8-a518-715179d51b0b tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:28.794229 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8249aca2-a0a6-4356-95c3-8e1f03c10f91 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:28.803089 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8249aca2-a0a6-4356-95c3-8e1f03c10f91 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:28.804863 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8249aca2-a0a6-4356-95c3-8e1f03c10f91 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:28.806312 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8249aca2-a0a6-4356-95c3-8e1f03c10f91 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223" status: 200 len: 1487 microversion: 2.25 time: 0.598169 Oct 27 03:29:28.807073 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1103/2248] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:29:28 2022] GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223 => generated 1487 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:29:28.819158 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4a1e74de-f39b-4277-b6ee-6f8a617ba19f tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:28.820081 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4a1e74de-f39b-4277-b6ee-6f8a617ba19f tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] [instance: 57cfac2f-cf21-44fa-881e-f1d3da2be9d2] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:28.835538 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4a1e74de-f39b-4277-b6ee-6f8a617ba19f tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:28.836049 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4a1e74de-f39b-4277-b6ee-6f8a617ba19f tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:28.836549 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4a1e74de-f39b-4277-b6ee-6f8a617ba19f tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:28.837491 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4a1e74de-f39b-4277-b6ee-6f8a617ba19f tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:28.837961 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4a1e74de-f39b-4277-b6ee-6f8a617ba19f tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:28.838622 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4a1e74de-f39b-4277-b6ee-6f8a617ba19f tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:28.848288 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-162c13e2-054b-4ec8-a518-715179d51b0b tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] [instance: 2aa6c062-32e4-453d-abb5-a51d96c66e2d] Going to try to terminate instance {{(pid=121001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:29:29.091399 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4a1e74de-f39b-4277-b6ee-6f8a617ba19f tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421d14944da74570a53d620ea205449d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92082c8718aa41bf96cd84d682d75954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:29.103875 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4a1e74de-f39b-4277-b6ee-6f8a617ba19f tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] 10.222.0.20 "GET /compute/v2.1/servers/57cfac2f-cf21-44fa-881e-f1d3da2be9d2" status: 200 len: 1316 microversion: 2.1 time: 0.294550 Oct 27 03:29:29.106371 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1104/2249] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:28 2022] GET /compute/v2.1/servers/57cfac2f-cf21-44fa-881e-f1d3da2be9d2 => generated 1316 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:29.113429 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9b4946a8-1f5d-44b9-87a3-42ba1a3f823b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:29.114645 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9b4946a8-1f5d-44b9-87a3-42ba1a3f823b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:29.123532 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9b4946a8-1f5d-44b9-87a3-42ba1a3f823b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:29.124597 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9b4946a8-1f5d-44b9-87a3-42ba1a3f823b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:29.125233 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9b4946a8-1f5d-44b9-87a3-42ba1a3f823b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:29.127242 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9b4946a8-1f5d-44b9-87a3-42ba1a3f823b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:29.127910 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9b4946a8-1f5d-44b9-87a3-42ba1a3f823b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:29.129256 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9b4946a8-1f5d-44b9-87a3-42ba1a3f823b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:29.233664 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9b4946a8-1f5d-44b9-87a3-42ba1a3f823b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:29.249233 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-162c13e2-054b-4ec8-a518-715179d51b0b tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2aa6c062-32e4-453d-abb5-a51d96c66e2d" status: 204 len: 0 microversion: 2.1 time: 0.505278 Oct 27 03:29:29.249842 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1146/2250] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:29:28 2022] DELETE /compute/v2.1/servers/2aa6c062-32e4-453d-abb5-a51d96c66e2d => generated 0 bytes in 507 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:29:29.250159 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9b4946a8-1f5d-44b9-87a3-42ba1a3f823b tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c" status: 200 len: 1265 microversion: 2.1 time: 0.142858 Oct 27 03:29:29.256981 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-39066157-b865-4704-a9e0-045da61833ca tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:29.258630 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-39066157-b865-4704-a9e0-045da61833ca tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: 339287fc-37b6-455d-96ab-08ab8e2c3e68] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:29.263146 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1105/2251] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:29 2022] GET /compute/v2.1/servers/a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:29.273909 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-19585e68-d199-4832-a1da-509cec3d4265 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:29.274633 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-19585e68-d199-4832-a1da-509cec3d4265 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] [instance: a89c8f12-2492-4a0f-8887-acd62e510fd9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:29.274896 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-39066157-b865-4704-a9e0-045da61833ca tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:29.275542 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-39066157-b865-4704-a9e0-045da61833ca tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:29.276125 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-39066157-b865-4704-a9e0-045da61833ca tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:29.276997 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-39066157-b865-4704-a9e0-045da61833ca tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:29.277535 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-39066157-b865-4704-a9e0-045da61833ca tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:29.278059 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-39066157-b865-4704-a9e0-045da61833ca tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:29.281055 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-19585e68-d199-4832-a1da-509cec3d4265 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:29.281607 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-19585e68-d199-4832-a1da-509cec3d4265 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:29.282511 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-19585e68-d199-4832-a1da-509cec3d4265 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:29.283701 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-19585e68-d199-4832-a1da-509cec3d4265 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:29.284651 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-19585e68-d199-4832-a1da-509cec3d4265 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:29.285248 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-19585e68-d199-4832-a1da-509cec3d4265 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:29.304630 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-19585e68-d199-4832-a1da-509cec3d4265 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] HTTP exception thrown: Instance a89c8f12-2492-4a0f-8887-acd62e510fd9 could not be found. Oct 27 03:29:29.307333 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-19585e68-d199-4832-a1da-509cec3d4265 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Request method failure captured: Oct 27 03:29:29.307333 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/a89c8f12-2492-4a0f-8887-acd62e510fd9 HTTP/1.1 Oct 27 03:29:29.307333 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:29:29.307333 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:29:29.307333 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:29:29.307333 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:29:29.307333 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:29:29.307333 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:29:29.307333 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:29:29.307333 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:29:29.307333 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfrb-edByRevFfuhULifqN92XaPnrz1y9TpvzJVFkI7uY8srOIeoiVbh_koOIlmW1qHemLxQzub1Kep0Hp_Be1wKqdeSKQBD4nXR03SL4r_wU3gh6unzCksFMO-TRc2CaC1FQUAgZM0MiZf4AV8a72xd56R6wjBT67zYw0kkAvZ-L-0 Oct 27 03:29:29.307333 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:29:29.307333 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:29:29.307333 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:29:29.307333 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:29:29.307333 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:29:29.307333 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:29:29.307333 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 16b0b534b9eb463aab0f13e838578da2 Oct 27 03:29:29.307333 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ListServersNegativeTestJSON-1232441805 Oct 27 03:29:29.307333 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:29:29.307333 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:29:29.307333 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/16b0b534b9eb463aab0f13e838578da2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/16b0b534b9eb463aab0f13e838578da2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/16b0b534b9eb463aab0f13e838578da2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_16b0b534b9eb463aab0f13e838578da2"}]}] Oct 27 03:29:29.307333 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ListServersNegativeTestJSON-1232441805 Oct 27 03:29:29.307333 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 16b0b534b9eb463aab0f13e838578da2 Oct 27 03:29:29.307333 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1232441805 Oct 27 03:29:29.307333 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ListServersNegativeTestJSON-1232441805-project Oct 27 03:29:29.307333 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:29:29.307333 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:29:29.307333 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 071401bed74d48fe8ae2dbdb98aa81cc Oct 27 03:29:29.307333 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ListServersNegativeTestJSON-1232441805-project Oct 27 03:29:29.307333 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:29:29.307333 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance a89c8f12-2492-4a0f-8887-acd62e510fd9 could not be found. Oct 27 03:29:29.307333 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': 'a89c8f12-2492-4a0f-8887-acd62e510fd9'} Oct 27 03:29:29.307333 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:29:29.307333 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:29:29.307333 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:29:29.307333 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:29:29.307333 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:29:29.307333 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:29:29.307333 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:29:29.307333 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:29:29.307333 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:29:29.307333 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:29:29.307333 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a89c8f12-2492-4a0f-8887-acd62e510fd9 could not be found. Oct 27 03:29:29.307333 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:29:29.307333 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:29:29.307333 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:29:29.307333 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:29:29.307333 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:29:29.307333 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:29:29.307333 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:29:29.307333 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:29:29.307333 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:29:29.307333 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:29:29.307333 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:29:29.307333 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:29:29.307333 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:29:29.307333 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:29:29.307333 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:29:29.307333 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:29:29.307333 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a89c8f12-2492-4a0f-8887-acd62e510fd9 could not be found. Oct 27 03:29:29.307333 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:29:29.307333 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:29:29.312990 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:29:29.312990 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:29:29.312990 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:29:29.312990 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:29:29.312990 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:29:29.312990 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:29:29.312990 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a89c8f12-2492-4a0f-8887-acd62e510fd9 could not be found. Oct 27 03:29:29.312990 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:29:29.314841 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-19585e68-d199-4832-a1da-509cec3d4265 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Returning 404 to user: Instance a89c8f12-2492-4a0f-8887-acd62e510fd9 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:29:29.316580 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-19585e68-d199-4832-a1da-509cec3d4265 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] 10.222.0.20 "GET /compute/v2.1/servers/a89c8f12-2492-4a0f-8887-acd62e510fd9" status: 404 len: 111 microversion: 2.1 time: 0.051774 Oct 27 03:29:29.317397 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1106/2252] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:29 2022] GET /compute/v2.1/servers/a89c8f12-2492-4a0f-8887-acd62e510fd9 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:29:29.328758 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c5294f2d-9581-430d-8202-cdcab68d193c tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:29.330358 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c5294f2d-9581-430d-8202-cdcab68d193c tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] [instance: b3dd0fa3-e3b4-471c-b65b-0a190b7c4701] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:29.338190 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c5294f2d-9581-430d-8202-cdcab68d193c tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:29.338691 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c5294f2d-9581-430d-8202-cdcab68d193c tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:29.339137 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c5294f2d-9581-430d-8202-cdcab68d193c tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:29.339840 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c5294f2d-9581-430d-8202-cdcab68d193c tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:29.340483 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c5294f2d-9581-430d-8202-cdcab68d193c tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:29.341301 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c5294f2d-9581-430d-8202-cdcab68d193c tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:29.573847 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c5294f2d-9581-430d-8202-cdcab68d193c tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '071401bed74d48fe8ae2dbdb98aa81cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b0b534b9eb463aab0f13e838578da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:29.577672 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-39066157-b865-4704-a9e0-045da61833ca tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13e05e253c94aadb1c089128ff35be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8510a519f14deea6f35a437419e161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:29.583227 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-39066157-b865-4704-a9e0-045da61833ca tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68" status: 200 len: 1472 microversion: 2.1 time: 0.331419 Oct 27 03:29:29.584139 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1147/2253] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:29 2022] GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68 => generated 1472 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:29.585415 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c5294f2d-9581-430d-8202-cdcab68d193c tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] 10.222.0.20 "GET /compute/v2.1/servers/b3dd0fa3-e3b4-471c-b65b-0a190b7c4701" status: 200 len: 1521 microversion: 2.1 time: 0.263318 Oct 27 03:29:29.585995 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1107/2254] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:29 2022] GET /compute/v2.1/servers/b3dd0fa3-e3b4-471c-b65b-0a190b7c4701 => generated 1521 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:29.776902 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d590b747-7e41-45b1-9664-04ad078f66d5 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:29.777597 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d590b747-7e41-45b1-9664-04ad078f66d5 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: a8925d29-d9e0-4dbb-a73d-09473255fa34] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:29.786587 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d590b747-7e41-45b1-9664-04ad078f66d5 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:29.787348 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d590b747-7e41-45b1-9664-04ad078f66d5 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:29.788040 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d590b747-7e41-45b1-9664-04ad078f66d5 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:29.789051 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d590b747-7e41-45b1-9664-04ad078f66d5 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:29.790028 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d590b747-7e41-45b1-9664-04ad078f66d5 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:29.790851 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d590b747-7e41-45b1-9664-04ad078f66d5 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:29.835668 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b3088dc9-a924-4be6-bcb6-6310f903f273 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:29.836450 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b3088dc9-a924-4be6-bcb6-6310f903f273 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: d5e6f604-9466-45c6-86a8-885cfb393223] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:29.854544 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b3088dc9-a924-4be6-bcb6-6310f903f273 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:29.857292 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b3088dc9-a924-4be6-bcb6-6310f903f273 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:29.864311 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b3088dc9-a924-4be6-bcb6-6310f903f273 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:29.866619 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b3088dc9-a924-4be6-bcb6-6310f903f273 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:29.876404 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b3088dc9-a924-4be6-bcb6-6310f903f273 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:29.882997 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b3088dc9-a924-4be6-bcb6-6310f903f273 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:30.472642 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b3088dc9-a924-4be6-bcb6-6310f903f273 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:30.486633 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b3088dc9-a924-4be6-bcb6-6310f903f273 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:30.488701 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b3088dc9-a924-4be6-bcb6-6310f903f273 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:30.506390 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b3088dc9-a924-4be6-bcb6-6310f903f273 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223" status: 200 len: 1487 microversion: 2.25 time: 0.658504 Oct 27 03:29:30.506390 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1108/2255] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:29:29 2022] GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223 => generated 1487 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:29:30.506390 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-a130886f-bca9-4b5e-9525-cdef48ee7297 req-b28cccad-700c-4020-b3d1-7bba331d7fc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57cfac2f-cf21-44fa-881e-f1d3da2be9d2", "name": "network-vif-plugged", "status": "completed", "tag": "0bdacda3-4cd1-4742-9510-fd56a466a7b7"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:29:30.524936 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-a130886f-bca9-4b5e-9525-cdef48ee7297 req-b28cccad-700c-4020-b3d1-7bba331d7fc2 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:30.526560 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-a130886f-bca9-4b5e-9525-cdef48ee7297 req-b28cccad-700c-4020-b3d1-7bba331d7fc2 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:30.529007 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-a130886f-bca9-4b5e-9525-cdef48ee7297 req-b28cccad-700c-4020-b3d1-7bba331d7fc2 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:30.558662 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-a130886f-bca9-4b5e-9525-cdef48ee7297 req-b28cccad-700c-4020-b3d1-7bba331d7fc2 service nova] Creating event network-vif-plugged:0bdacda3-4cd1-4742-9510-fd56a466a7b7 for instance 57cfac2f-cf21-44fa-881e-f1d3da2be9d2 on n-h2-862769-1 Oct 27 03:29:30.577466 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-a130886f-bca9-4b5e-9525-cdef48ee7297 req-b28cccad-700c-4020-b3d1-7bba331d7fc2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083729 Oct 27 03:29:30.585501 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1109/2256] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:29:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:29:30.596584 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-cc3ea40e-0e6b-4793-8643-81eaf2ec7bfe tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:30.599469 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-cc3ea40e-0e6b-4793-8643-81eaf2ec7bfe tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] [instance: 57cfac2f-cf21-44fa-881e-f1d3da2be9d2] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:30.607521 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:29:30.611278 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cc3ea40e-0e6b-4793-8643-81eaf2ec7bfe tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:30.612131 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cc3ea40e-0e6b-4793-8643-81eaf2ec7bfe tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:30.612834 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cc3ea40e-0e6b-4793-8643-81eaf2ec7bfe tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:30.615192 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cc3ea40e-0e6b-4793-8643-81eaf2ec7bfe tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:30.615921 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cc3ea40e-0e6b-4793-8643-81eaf2ec7bfe tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:30.617249 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cc3ea40e-0e6b-4793-8643-81eaf2ec7bfe tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:30.737981 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d590b747-7e41-45b1-9664-04ad078f66d5 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:30.750739 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d590b747-7e41-45b1-9664-04ad078f66d5 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34" status: 200 len: 1392 microversion: 2.1 time: 0.989404 Oct 27 03:29:30.755917 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1148/2257] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:29 2022] GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34 => generated 1392 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:30.773381 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9bd2c1a8-0dd7-41a7-b3ce-d36f3645248d tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:30.776007 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-9bd2c1a8-0dd7-41a7-b3ce-d36f3645248d tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:30.807101 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9bd2c1a8-0dd7-41a7-b3ce-d36f3645248d tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:30.811719 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9bd2c1a8-0dd7-41a7-b3ce-d36f3645248d tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:30.813977 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9bd2c1a8-0dd7-41a7-b3ce-d36f3645248d tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:30.816987 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9bd2c1a8-0dd7-41a7-b3ce-d36f3645248d tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:30.819130 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9bd2c1a8-0dd7-41a7-b3ce-d36f3645248d tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:30.824263 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9bd2c1a8-0dd7-41a7-b3ce-d36f3645248d tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:31.080857 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9bd2c1a8-0dd7-41a7-b3ce-d36f3645248d tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:31.091585 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-cc3ea40e-0e6b-4793-8643-81eaf2ec7bfe tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421d14944da74570a53d620ea205449d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92082c8718aa41bf96cd84d682d75954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:31.097745 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9bd2c1a8-0dd7-41a7-b3ce-d36f3645248d tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c" status: 200 len: 1307 microversion: 2.1 time: 0.338356 Oct 27 03:29:31.098864 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1149/2258] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:30 2022] GET /compute/v2.1/servers/a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c => generated 1307 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:31.103511 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-cc3ea40e-0e6b-4793-8643-81eaf2ec7bfe tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] 10.222.0.20 "GET /compute/v2.1/servers/57cfac2f-cf21-44fa-881e-f1d3da2be9d2" status: 200 len: 1316 microversion: 2.1 time: 0.513495 Oct 27 03:29:31.105954 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4cafe665-5e2a-4385-bbd5-b97f1d973d27 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:31.110424 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4cafe665-5e2a-4385-bbd5-b97f1d973d27 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] [instance: b3dd0fa3-e3b4-471c-b65b-0a190b7c4701] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:31.110559 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1110/2259] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:30 2022] GET /compute/v2.1/servers/57cfac2f-cf21-44fa-881e-f1d3da2be9d2 => generated 1316 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:31.113923 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:29:31.116604 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4cafe665-5e2a-4385-bbd5-b97f1d973d27 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:31.117502 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4cafe665-5e2a-4385-bbd5-b97f1d973d27 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:31.118240 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4cafe665-5e2a-4385-bbd5-b97f1d973d27 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:31.120371 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4cafe665-5e2a-4385-bbd5-b97f1d973d27 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:31.121091 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4cafe665-5e2a-4385-bbd5-b97f1d973d27 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:31.122483 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4cafe665-5e2a-4385-bbd5-b97f1d973d27 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:31.128316 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-05717a00-eb47-4b80-bf77-ed7f3bfe3524 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:31.128316 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-05717a00-eb47-4b80-bf77-ed7f3bfe3524 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: 339287fc-37b6-455d-96ab-08ab8e2c3e68] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:31.144839 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-05717a00-eb47-4b80-bf77-ed7f3bfe3524 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:31.148608 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-05717a00-eb47-4b80-bf77-ed7f3bfe3524 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:31.149342 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-05717a00-eb47-4b80-bf77-ed7f3bfe3524 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:31.150802 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-05717a00-eb47-4b80-bf77-ed7f3bfe3524 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:31.151446 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-05717a00-eb47-4b80-bf77-ed7f3bfe3524 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:31.154187 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-05717a00-eb47-4b80-bf77-ed7f3bfe3524 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:31.412282 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4cafe665-5e2a-4385-bbd5-b97f1d973d27 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '071401bed74d48fe8ae2dbdb98aa81cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b0b534b9eb463aab0f13e838578da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:31.440949 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4cafe665-5e2a-4385-bbd5-b97f1d973d27 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] 10.222.0.20 "GET /compute/v2.1/servers/b3dd0fa3-e3b4-471c-b65b-0a190b7c4701" status: 200 len: 1521 microversion: 2.1 time: 0.339439 Oct 27 03:29:31.444794 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1150/2260] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:31 2022] GET /compute/v2.1/servers/b3dd0fa3-e3b4-471c-b65b-0a190b7c4701 => generated 1521 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:31.580190 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5a8242b8-34c3-40cd-a13b-af1e539450d5 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Action: 'create', calling method: .version_select at 0x7f7ddb5dbaf0>, body: {"keypair": {"name": "tempest-keypair-1121307756", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJkWrOnQpqGgZCY24uK3GFu/dW5mkEQCCYZW8v6GD5iOISOCAb/hcc3Uo0PyDKSxcuqw+WTINZ0Znv3Gs+/M+agNX0xQO/DPyt7z0HKabeAjGEAf6hUwYPM1TeZxyO4y+Q=="}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:29:31.601372 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-05717a00-eb47-4b80-bf77-ed7f3bfe3524 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13e05e253c94aadb1c089128ff35be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8510a519f14deea6f35a437419e161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:31.618255 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-5a8242b8-34c3-40cd-a13b-af1e539450d5 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Getting quotas for project 3e9ede68f63747d59153a46412033856. Resources: {'key_pairs'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:29:31.621700 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-05717a00-eb47-4b80-bf77-ed7f3bfe3524 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68" status: 200 len: 1472 microversion: 2.1 time: 0.513813 Oct 27 03:29:31.628827 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-5a8242b8-34c3-40cd-a13b-af1e539450d5 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Getting quotas for user 94897f20beb94dbd8e7eff6ecba30026 and project 3e9ede68f63747d59153a46412033856. Resources: {'key_pairs'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:29:31.635540 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1111/2261] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:31 2022] GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68 => generated 1472 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:31.649621 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b75f6f71-8e2e-4822-a0c5-77f4e8f47a31 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:31.650728 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b75f6f71-8e2e-4822-a0c5-77f4e8f47a31 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: d5e6f604-9466-45c6-86a8-885cfb393223] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:31.657700 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b75f6f71-8e2e-4822-a0c5-77f4e8f47a31 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:31.658488 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b75f6f71-8e2e-4822-a0c5-77f4e8f47a31 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:31.659114 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b75f6f71-8e2e-4822-a0c5-77f4e8f47a31 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:31.660571 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b75f6f71-8e2e-4822-a0c5-77f4e8f47a31 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:31.661213 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b75f6f71-8e2e-4822-a0c5-77f4e8f47a31 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:31.661868 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b75f6f71-8e2e-4822-a0c5-77f4e8f47a31 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:31.754185 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5a8242b8-34c3-40cd-a13b-af1e539450d5 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.307366 Oct 27 03:29:31.756016 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1151/2262] 10.222.0.20 () {60 vars in 1159 bytes} [Thu Oct 27 03:29:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:29:31.786719 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0b870f65-6d43-4121-b663-55b9df68dd48 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:31.787721 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0b870f65-6d43-4121-b663-55b9df68dd48 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: a8925d29-d9e0-4dbb-a73d-09473255fa34] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:31.808021 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0b870f65-6d43-4121-b663-55b9df68dd48 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:31.808364 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0b870f65-6d43-4121-b663-55b9df68dd48 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:31.808819 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0b870f65-6d43-4121-b663-55b9df68dd48 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:31.809556 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0b870f65-6d43-4121-b663-55b9df68dd48 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:31.810028 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0b870f65-6d43-4121-b663-55b9df68dd48 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:31.810488 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0b870f65-6d43-4121-b663-55b9df68dd48 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:32.214105 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b75f6f71-8e2e-4822-a0c5-77f4e8f47a31 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:32.242814 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b75f6f71-8e2e-4822-a0c5-77f4e8f47a31 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:32.249267 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b75f6f71-8e2e-4822-a0c5-77f4e8f47a31 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:32.257638 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b75f6f71-8e2e-4822-a0c5-77f4e8f47a31 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223" status: 200 len: 1487 microversion: 2.25 time: 0.619146 Oct 27 03:29:32.266495 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1112/2263] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:29:31 2022] GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223 => generated 1487 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:29:32.276849 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0b870f65-6d43-4121-b663-55b9df68dd48 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:32.281415 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7dd068a8-d6fb-4f23-9fb0-0ba7aeb34fa1 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:32.284297 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7dd068a8-d6fb-4f23-9fb0-0ba7aeb34fa1 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:32.290846 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0b870f65-6d43-4121-b663-55b9df68dd48 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34" status: 200 len: 1392 microversion: 2.1 time: 0.510182 Oct 27 03:29:32.294765 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1152/2264] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:31 2022] GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34 => generated 1392 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:32.295319 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7dd068a8-d6fb-4f23-9fb0-0ba7aeb34fa1 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:32.295894 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7dd068a8-d6fb-4f23-9fb0-0ba7aeb34fa1 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:32.296350 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7dd068a8-d6fb-4f23-9fb0-0ba7aeb34fa1 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:32.297718 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7dd068a8-d6fb-4f23-9fb0-0ba7aeb34fa1 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:32.298326 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7dd068a8-d6fb-4f23-9fb0-0ba7aeb34fa1 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:32.298986 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7dd068a8-d6fb-4f23-9fb0-0ba7aeb34fa1 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:32.310330 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-40dff116-d6a1-413d-af6b-113615bbc35a tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:32.319337 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-40dff116-d6a1-413d-af6b-113615bbc35a tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] [instance: 57cfac2f-cf21-44fa-881e-f1d3da2be9d2] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:32.339296 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-40dff116-d6a1-413d-af6b-113615bbc35a tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:32.339843 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-40dff116-d6a1-413d-af6b-113615bbc35a tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:32.342737 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-40dff116-d6a1-413d-af6b-113615bbc35a tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:32.343537 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-40dff116-d6a1-413d-af6b-113615bbc35a tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:32.344021 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-40dff116-d6a1-413d-af6b-113615bbc35a tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:32.344461 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-40dff116-d6a1-413d-af6b-113615bbc35a tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:32.379772 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:29:32.785224 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-40dff116-d6a1-413d-af6b-113615bbc35a tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421d14944da74570a53d620ea205449d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92082c8718aa41bf96cd84d682d75954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:32.807373 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-40dff116-d6a1-413d-af6b-113615bbc35a tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] 10.222.0.20 "GET /compute/v2.1/servers/57cfac2f-cf21-44fa-881e-f1d3da2be9d2" status: 200 len: 1316 microversion: 2.1 time: 0.509271 Oct 27 03:29:32.817205 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1153/2265] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:32 2022] GET /compute/v2.1/servers/57cfac2f-cf21-44fa-881e-f1d3da2be9d2 => generated 1316 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:32.837251 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3608cc93-02ac-4458-98d3-1d2884f89bed tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:32.838232 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3608cc93-02ac-4458-98d3-1d2884f89bed tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] [instance: b3dd0fa3-e3b4-471c-b65b-0a190b7c4701] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:32.850358 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7dd068a8-d6fb-4f23-9fb0-0ba7aeb34fa1 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:32.858530 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3608cc93-02ac-4458-98d3-1d2884f89bed tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:32.860953 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7dd068a8-d6fb-4f23-9fb0-0ba7aeb34fa1 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c" status: 200 len: 1307 microversion: 2.1 time: 0.595693 Oct 27 03:29:32.861780 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3608cc93-02ac-4458-98d3-1d2884f89bed tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:32.863709 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3608cc93-02ac-4458-98d3-1d2884f89bed tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:32.864490 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1113/2266] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:32 2022] GET /compute/v2.1/servers/a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c => generated 1307 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:32.870956 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3608cc93-02ac-4458-98d3-1d2884f89bed tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:32.870956 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3608cc93-02ac-4458-98d3-1d2884f89bed tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:32.870956 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3608cc93-02ac-4458-98d3-1d2884f89bed tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:32.878130 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-70a6d200-e4a6-4a42-a220-232d8342abe8 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:32.881961 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-70a6d200-e4a6-4a42-a220-232d8342abe8 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: 339287fc-37b6-455d-96ab-08ab8e2c3e68] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:32.895721 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-70a6d200-e4a6-4a42-a220-232d8342abe8 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:32.896646 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-70a6d200-e4a6-4a42-a220-232d8342abe8 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:32.897347 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-70a6d200-e4a6-4a42-a220-232d8342abe8 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:32.898379 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-70a6d200-e4a6-4a42-a220-232d8342abe8 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:32.899127 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-70a6d200-e4a6-4a42-a220-232d8342abe8 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:32.901843 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-70a6d200-e4a6-4a42-a220-232d8342abe8 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:33.060474 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3608cc93-02ac-4458-98d3-1d2884f89bed tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '071401bed74d48fe8ae2dbdb98aa81cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b0b534b9eb463aab0f13e838578da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:33.073838 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3608cc93-02ac-4458-98d3-1d2884f89bed tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] 10.222.0.20 "GET /compute/v2.1/servers/b3dd0fa3-e3b4-471c-b65b-0a190b7c4701" status: 200 len: 1479 microversion: 2.1 time: 0.253362 Oct 27 03:29:33.077286 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1154/2267] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:32 2022] GET /compute/v2.1/servers/b3dd0fa3-e3b4-471c-b65b-0a190b7c4701 => generated 1479 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:33.094295 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-e95db32c-324b-497c-b2b9-d93d0ffa3c69 req-9d468bab-c8e2-4668-adb9-773b203edca4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3dd0fa3-e3b4-471c-b65b-0a190b7c4701", "name": "network-vif-deleted", "tag": "3d125c26-92dc-4d95-bb25-7ab8a7e32c49"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:29:33.136030 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-e95db32c-324b-497c-b2b9-d93d0ffa3c69 req-9d468bab-c8e2-4668-adb9-773b203edca4 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:33.137101 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-e95db32c-324b-497c-b2b9-d93d0ffa3c69 req-9d468bab-c8e2-4668-adb9-773b203edca4 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:33.137789 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-e95db32c-324b-497c-b2b9-d93d0ffa3c69 req-9d468bab-c8e2-4668-adb9-773b203edca4 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:33.167025 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-e95db32c-324b-497c-b2b9-d93d0ffa3c69 req-9d468bab-c8e2-4668-adb9-773b203edca4 service nova] Creating event network-vif-deleted:3d125c26-92dc-4d95-bb25-7ab8a7e32c49 for instance b3dd0fa3-e3b4-471c-b65b-0a190b7c4701 on n-h2-862769-1 Oct 27 03:29:33.174745 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-e95db32c-324b-497c-b2b9-d93d0ffa3c69 req-9d468bab-c8e2-4668-adb9-773b203edca4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091290 Oct 27 03:29:33.176892 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1155/2268] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:29:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:29:33.287379 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7692ff6c-af94-4dc1-92e4-9eb7ff682bbf tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:33.288223 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7692ff6c-af94-4dc1-92e4-9eb7ff682bbf tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: d5e6f604-9466-45c6-86a8-885cfb393223] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:33.303409 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7692ff6c-af94-4dc1-92e4-9eb7ff682bbf tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:33.304323 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7692ff6c-af94-4dc1-92e4-9eb7ff682bbf tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:33.317066 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7692ff6c-af94-4dc1-92e4-9eb7ff682bbf tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:33.317066 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7692ff6c-af94-4dc1-92e4-9eb7ff682bbf tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:33.317066 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7692ff6c-af94-4dc1-92e4-9eb7ff682bbf tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:33.317066 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7692ff6c-af94-4dc1-92e4-9eb7ff682bbf tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:33.403094 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-70a6d200-e4a6-4a42-a220-232d8342abe8 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13e05e253c94aadb1c089128ff35be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8510a519f14deea6f35a437419e161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:33.467351 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-70a6d200-e4a6-4a42-a220-232d8342abe8 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68" status: 200 len: 1472 microversion: 2.1 time: 0.601695 Oct 27 03:29:33.470811 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1114/2269] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:32 2022] GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68 => generated 1472 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:33.488128 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e092bd6b-3f70-46b8-a0f4-88daa5ee2cd5 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:33.488128 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e092bd6b-3f70-46b8-a0f4-88daa5ee2cd5 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: a8925d29-d9e0-4dbb-a73d-09473255fa34] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:33.497809 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=10 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:29:33.500374 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e092bd6b-3f70-46b8-a0f4-88daa5ee2cd5 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:33.501058 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e092bd6b-3f70-46b8-a0f4-88daa5ee2cd5 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:33.502555 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e092bd6b-3f70-46b8-a0f4-88daa5ee2cd5 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:33.503546 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e092bd6b-3f70-46b8-a0f4-88daa5ee2cd5 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:33.504399 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e092bd6b-3f70-46b8-a0f4-88daa5ee2cd5 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:33.505031 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e092bd6b-3f70-46b8-a0f4-88daa5ee2cd5 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:33.750112 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7692ff6c-af94-4dc1-92e4-9eb7ff682bbf tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:33.763870 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7692ff6c-af94-4dc1-92e4-9eb7ff682bbf tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:33.765984 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7692ff6c-af94-4dc1-92e4-9eb7ff682bbf tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:33.768130 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7692ff6c-af94-4dc1-92e4-9eb7ff682bbf tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223" status: 200 len: 1487 microversion: 2.25 time: 0.487923 Oct 27 03:29:33.769824 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1156/2270] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:29:33 2022] GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223 => generated 1487 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:29:33.845712 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7b379a75-f10c-49b5-a587-d0c8ea0f4eb6 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:33.847900 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7b379a75-f10c-49b5-a587-d0c8ea0f4eb6 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] [instance: 57cfac2f-cf21-44fa-881e-f1d3da2be9d2] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:33.878539 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7b379a75-f10c-49b5-a587-d0c8ea0f4eb6 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:33.882473 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7b379a75-f10c-49b5-a587-d0c8ea0f4eb6 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:33.884830 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7b379a75-f10c-49b5-a587-d0c8ea0f4eb6 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:33.887073 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7b379a75-f10c-49b5-a587-d0c8ea0f4eb6 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:33.888415 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7b379a75-f10c-49b5-a587-d0c8ea0f4eb6 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:33.894221 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7b379a75-f10c-49b5-a587-d0c8ea0f4eb6 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:34.223052 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7b379a75-f10c-49b5-a587-d0c8ea0f4eb6 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421d14944da74570a53d620ea205449d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92082c8718aa41bf96cd84d682d75954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:34.253786 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7b379a75-f10c-49b5-a587-d0c8ea0f4eb6 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] 10.222.0.20 "GET /compute/v2.1/servers/57cfac2f-cf21-44fa-881e-f1d3da2be9d2" status: 200 len: 1505 microversion: 2.1 time: 0.411685 Oct 27 03:29:34.256411 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1157/2271] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:33 2022] GET /compute/v2.1/servers/57cfac2f-cf21-44fa-881e-f1d3da2be9d2 => generated 1505 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:34.270254 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ade0ad11-d92b-4e23-bf8d-32512ce824b1 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:34.271427 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ade0ad11-d92b-4e23-bf8d-32512ce824b1 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:34.289714 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ade0ad11-d92b-4e23-bf8d-32512ce824b1 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:34.290981 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ade0ad11-d92b-4e23-bf8d-32512ce824b1 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:34.292015 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ade0ad11-d92b-4e23-bf8d-32512ce824b1 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:34.293461 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ade0ad11-d92b-4e23-bf8d-32512ce824b1 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:34.295187 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ade0ad11-d92b-4e23-bf8d-32512ce824b1 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:34.300107 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ade0ad11-d92b-4e23-bf8d-32512ce824b1 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:34.637721 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ade0ad11-d92b-4e23-bf8d-32512ce824b1 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:34.652041 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ade0ad11-d92b-4e23-bf8d-32512ce824b1 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c" status: 200 len: 1307 microversion: 2.1 time: 0.393669 Oct 27 03:29:34.653106 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1158/2272] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:34 2022] GET /compute/v2.1/servers/a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c => generated 1307 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:34.670663 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7135e32a-03c9-47d9-8087-49cf1d58da70 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:34.671664 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7135e32a-03c9-47d9-8087-49cf1d58da70 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] [instance: b3dd0fa3-e3b4-471c-b65b-0a190b7c4701] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:34.686157 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7135e32a-03c9-47d9-8087-49cf1d58da70 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:34.688332 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7135e32a-03c9-47d9-8087-49cf1d58da70 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:34.691463 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7135e32a-03c9-47d9-8087-49cf1d58da70 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:34.691463 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7135e32a-03c9-47d9-8087-49cf1d58da70 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:34.691463 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7135e32a-03c9-47d9-8087-49cf1d58da70 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:34.691974 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7135e32a-03c9-47d9-8087-49cf1d58da70 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:34.720281 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-7135e32a-03c9-47d9-8087-49cf1d58da70 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] HTTP exception thrown: Instance b3dd0fa3-e3b4-471c-b65b-0a190b7c4701 could not be found. Oct 27 03:29:34.720281 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7135e32a-03c9-47d9-8087-49cf1d58da70 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Request method failure captured: Oct 27 03:29:34.720281 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/b3dd0fa3-e3b4-471c-b65b-0a190b7c4701 HTTP/1.1 Oct 27 03:29:34.720281 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:29:34.720281 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:29:34.720281 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:29:34.720281 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:29:34.720281 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:29:34.720281 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:29:34.720281 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:29:34.720281 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:29:34.720281 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfrb-edByRevFfuhULifqN92XaPnrz1y9TpvzJVFkI7uY8srOIeoiVbh_koOIlmW1qHemLxQzub1Kep0Hp_Be1wKqdeSKQBD4nXR03SL4r_wU3gh6unzCksFMO-TRc2CaC1FQUAgZM0MiZf4AV8a72xd56R6wjBT67zYw0kkAvZ-L-0 Oct 27 03:29:34.720281 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:29:34.720281 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:29:34.720281 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:29:34.720281 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:29:34.720281 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:29:34.720281 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:29:34.720281 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 16b0b534b9eb463aab0f13e838578da2 Oct 27 03:29:34.720281 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ListServersNegativeTestJSON-1232441805 Oct 27 03:29:34.720281 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:29:34.720281 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:29:34.720281 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/16b0b534b9eb463aab0f13e838578da2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/16b0b534b9eb463aab0f13e838578da2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/16b0b534b9eb463aab0f13e838578da2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_16b0b534b9eb463aab0f13e838578da2"}]}] Oct 27 03:29:34.720281 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ListServersNegativeTestJSON-1232441805 Oct 27 03:29:34.720281 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 16b0b534b9eb463aab0f13e838578da2 Oct 27 03:29:34.720281 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1232441805 Oct 27 03:29:34.720281 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ListServersNegativeTestJSON-1232441805-project Oct 27 03:29:34.720281 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:29:34.720281 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:29:34.720281 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 071401bed74d48fe8ae2dbdb98aa81cc Oct 27 03:29:34.720281 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ListServersNegativeTestJSON-1232441805-project Oct 27 03:29:34.720281 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:29:34.720281 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance b3dd0fa3-e3b4-471c-b65b-0a190b7c4701 could not be found. Oct 27 03:29:34.720281 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': 'b3dd0fa3-e3b4-471c-b65b-0a190b7c4701'} Oct 27 03:29:34.720281 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:29:34.720281 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:29:34.720281 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:29:34.720281 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:29:34.720281 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:29:34.720281 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:29:34.720281 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:29:34.720281 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:29:34.720281 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:29:34.720281 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:29:34.720281 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3dd0fa3-e3b4-471c-b65b-0a190b7c4701 could not be found. Oct 27 03:29:34.720281 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:29:34.720281 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:29:34.720281 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:29:34.720281 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:29:34.720281 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:29:34.720281 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:29:34.720281 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:29:34.720281 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:29:34.720281 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:29:34.720281 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:29:34.720281 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:29:34.720281 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:29:34.720281 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:29:34.720281 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:29:34.720281 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:29:34.725574 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:29:34.725574 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3dd0fa3-e3b4-471c-b65b-0a190b7c4701 could not be found. Oct 27 03:29:34.725574 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:29:34.725574 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:29:34.725574 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:29:34.725574 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:29:34.725574 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:29:34.725574 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:29:34.725574 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:29:34.725574 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:29:34.725574 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3dd0fa3-e3b4-471c-b65b-0a190b7c4701 could not be found. Oct 27 03:29:34.725574 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:29:34.725574 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7135e32a-03c9-47d9-8087-49cf1d58da70 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Returning 404 to user: Instance b3dd0fa3-e3b4-471c-b65b-0a190b7c4701 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:29:34.725574 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7135e32a-03c9-47d9-8087-49cf1d58da70 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] 10.222.0.20 "GET /compute/v2.1/servers/b3dd0fa3-e3b4-471c-b65b-0a190b7c4701" status: 404 len: 111 microversion: 2.1 time: 0.067404 Oct 27 03:29:34.725574 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1159/2273] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:34 2022] GET /compute/v2.1/servers/b3dd0fa3-e3b4-471c-b65b-0a190b7c4701 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:29:34.728017 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f0f33069-e668-4ada-9e56-3f9d833ab26e tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-6364152"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:29:34.728608 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f0f33069-e668-4ada-9e56-3f9d833ab26e tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] [instance: 57cfac2f-cf21-44fa-881e-f1d3da2be9d2] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:34.738731 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f0f33069-e668-4ada-9e56-3f9d833ab26e tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:34.739234 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f0f33069-e668-4ada-9e56-3f9d833ab26e tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:34.739688 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f0f33069-e668-4ada-9e56-3f9d833ab26e tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:34.740402 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f0f33069-e668-4ada-9e56-3f9d833ab26e tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:34.740862 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f0f33069-e668-4ada-9e56-3f9d833ab26e tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:34.741296 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f0f33069-e668-4ada-9e56-3f9d833ab26e tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:34.783953 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e092bd6b-3f70-46b8-a0f4-88daa5ee2cd5 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:34.792182 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e092bd6b-3f70-46b8-a0f4-88daa5ee2cd5 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34" status: 200 len: 1392 microversion: 2.1 time: 1.317101 Oct 27 03:29:34.792692 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1115/2274] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:33 2022] GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34 => generated 1392 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:34.799354 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e967f7a6-b353-41a3-93ed-5a8fa9a5c848 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:34.801429 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e967f7a6-b353-41a3-93ed-5a8fa9a5c848 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: 339287fc-37b6-455d-96ab-08ab8e2c3e68] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:34.816614 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e967f7a6-b353-41a3-93ed-5a8fa9a5c848 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:34.820547 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e967f7a6-b353-41a3-93ed-5a8fa9a5c848 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:34.821194 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e967f7a6-b353-41a3-93ed-5a8fa9a5c848 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:34.823052 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e967f7a6-b353-41a3-93ed-5a8fa9a5c848 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:34.823703 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e967f7a6-b353-41a3-93ed-5a8fa9a5c848 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:34.824301 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e967f7a6-b353-41a3-93ed-5a8fa9a5c848 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:34.881058 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=8 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:29:34.965066 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.network.security_group_api [None req-f0f33069-e668-4ada-9e56-3f9d833ab26e tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Adding security group 66c3d870-3440-49f2-a399-c4af75eaee00 to port 0bdacda3-4cd1-4742-9510-fd56a466a7b7 Oct 27 03:29:35.249900 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e967f7a6-b353-41a3-93ed-5a8fa9a5c848 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13e05e253c94aadb1c089128ff35be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8510a519f14deea6f35a437419e161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:35.262506 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e967f7a6-b353-41a3-93ed-5a8fa9a5c848 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68" status: 200 len: 1472 microversion: 2.1 time: 0.468531 Oct 27 03:29:35.263462 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1116/2275] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:34 2022] GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68 => generated 1472 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:35.269528 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6696d5aa-858c-4ae7-bb84-38c60f663a04 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:35.270181 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6696d5aa-858c-4ae7-bb84-38c60f663a04 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] [instance: 2aa6c062-32e4-453d-abb5-a51d96c66e2d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:35.277785 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6696d5aa-858c-4ae7-bb84-38c60f663a04 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:35.278593 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6696d5aa-858c-4ae7-bb84-38c60f663a04 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:35.279215 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6696d5aa-858c-4ae7-bb84-38c60f663a04 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:35.280109 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6696d5aa-858c-4ae7-bb84-38c60f663a04 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:35.280848 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6696d5aa-858c-4ae7-bb84-38c60f663a04 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:35.281453 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6696d5aa-858c-4ae7-bb84-38c60f663a04 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:35.372488 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6696d5aa-858c-4ae7-bb84-38c60f663a04 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:35.372488 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6696d5aa-858c-4ae7-bb84-38c60f663a04 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:35.372488 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6696d5aa-858c-4ae7-bb84-38c60f663a04 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:35.372488 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-6696d5aa-858c-4ae7-bb84-38c60f663a04 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lazy-loading 'fault' on Instance uuid 2aa6c062-32e4-453d-abb5-a51d96c66e2d {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:29:35.515655 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f0f33069-e668-4ada-9e56-3f9d833ab26e tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] 10.222.0.20 "POST /compute/v2.1/servers/57cfac2f-cf21-44fa-881e-f1d3da2be9d2/action" status: 202 len: 0 microversion: 2.1 time: 0.792918 Oct 27 03:29:35.521342 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1160/2276] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:29:34 2022] POST /compute/v2.1/servers/57cfac2f-cf21-44fa-881e-f1d3da2be9d2/action => generated 0 bytes in 794 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:29:35.522122 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-85798ae1-a9eb-4889-b4c2-ab55d52ed8ef tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:35.522991 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-85798ae1-a9eb-4889-b4c2-ab55d52ed8ef tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: d5e6f604-9466-45c6-86a8-885cfb393223] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:35.541440 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-6696d5aa-858c-4ae7-bb84-38c60f663a04 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '071401bed74d48fe8ae2dbdb98aa81cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b0b534b9eb463aab0f13e838578da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:35.543324 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-85798ae1-a9eb-4889-b4c2-ab55d52ed8ef tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:35.544206 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-85798ae1-a9eb-4889-b4c2-ab55d52ed8ef tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:35.544371 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=100 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:29:35.544995 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-85798ae1-a9eb-4889-b4c2-ab55d52ed8ef tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:35.545970 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-85798ae1-a9eb-4889-b4c2-ab55d52ed8ef tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:35.546628 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-85798ae1-a9eb-4889-b4c2-ab55d52ed8ef tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:35.547252 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-85798ae1-a9eb-4889-b4c2-ab55d52ed8ef tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:35.557571 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6696d5aa-858c-4ae7-bb84-38c60f663a04 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] 10.222.0.20 "GET /compute/v2.1/servers/2aa6c062-32e4-453d-abb5-a51d96c66e2d" status: 200 len: 1312 microversion: 2.1 time: 0.290392 Oct 27 03:29:35.560334 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1117/2277] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:35 2022] GET /compute/v2.1/servers/2aa6c062-32e4-453d-abb5-a51d96c66e2d => generated 1312 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:35.577772 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-a51519fe-82b8-433a-bfbb-db3cdb8dac0e req-b61f1ce9-e833-42f4-97b0-494dc76c45b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2aa6c062-32e4-453d-abb5-a51d96c66e2d", "name": "network-vif-deleted", "tag": "af0e4888-29de-4d33-a94c-e1100b227c29"}, {"name": "network-changed", "server_uuid": "a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c", "tag": "f54df010-fe0a-4c01-88de-96c0e83bfd34"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:29:35.609254 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-a51519fe-82b8-433a-bfbb-db3cdb8dac0e req-b61f1ce9-e833-42f4-97b0-494dc76c45b2 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:35.609822 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-a51519fe-82b8-433a-bfbb-db3cdb8dac0e req-b61f1ce9-e833-42f4-97b0-494dc76c45b2 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:35.610293 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-a51519fe-82b8-433a-bfbb-db3cdb8dac0e req-b61f1ce9-e833-42f4-97b0-494dc76c45b2 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:35.642976 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-a51519fe-82b8-433a-bfbb-db3cdb8dac0e req-b61f1ce9-e833-42f4-97b0-494dc76c45b2 service nova] Creating event network-vif-deleted:af0e4888-29de-4d33-a94c-e1100b227c29 for instance 2aa6c062-32e4-453d-abb5-a51d96c66e2d on n-h1-862769-1 Oct 27 03:29:35.644613 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-a51519fe-82b8-433a-bfbb-db3cdb8dac0e req-b61f1ce9-e833-42f4-97b0-494dc76c45b2 service nova] Creating event network-changed:f54df010-fe0a-4c01-88de-96c0e83bfd34 for instance a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c on n-h2-862769-1 Oct 27 03:29:35.666752 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-a51519fe-82b8-433a-bfbb-db3cdb8dac0e req-b61f1ce9-e833-42f4-97b0-494dc76c45b2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.103092 Oct 27 03:29:35.671007 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1118/2278] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:29:35 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:29:35.688517 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a5117b42-1f48-43ec-983b-7af457ecd1e1 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-418329361"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:29:35.689922 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a5117b42-1f48-43ec-983b-7af457ecd1e1 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] [instance: 57cfac2f-cf21-44fa-881e-f1d3da2be9d2] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:35.697817 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a5117b42-1f48-43ec-983b-7af457ecd1e1 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:35.703215 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a5117b42-1f48-43ec-983b-7af457ecd1e1 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:35.703885 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a5117b42-1f48-43ec-983b-7af457ecd1e1 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:35.704847 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a5117b42-1f48-43ec-983b-7af457ecd1e1 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:35.705578 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a5117b42-1f48-43ec-983b-7af457ecd1e1 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:35.713196 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a5117b42-1f48-43ec-983b-7af457ecd1e1 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:35.786832 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-85798ae1-a9eb-4889-b4c2-ab55d52ed8ef tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:35.799105 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-85798ae1-a9eb-4889-b4c2-ab55d52ed8ef tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:35.800048 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-85798ae1-a9eb-4889-b4c2-ab55d52ed8ef tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:35.802521 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-85798ae1-a9eb-4889-b4c2-ab55d52ed8ef tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223" status: 200 len: 1487 microversion: 2.25 time: 0.283868 Oct 27 03:29:35.802521 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1161/2279] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:29:35 2022] GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223 => generated 1487 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:29:35.825601 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-edae3ebc-2542-4b91-b8bf-f8fa9ea80821 req-0e81dbf3-496a-43e3-8bc8-ddec77715614 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57cfac2f-cf21-44fa-881e-f1d3da2be9d2", "tag": "0bdacda3-4cd1-4742-9510-fd56a466a7b7"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:29:35.848541 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-edae3ebc-2542-4b91-b8bf-f8fa9ea80821 req-0e81dbf3-496a-43e3-8bc8-ddec77715614 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:35.851347 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-edae3ebc-2542-4b91-b8bf-f8fa9ea80821 req-0e81dbf3-496a-43e3-8bc8-ddec77715614 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:35.852825 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-edae3ebc-2542-4b91-b8bf-f8fa9ea80821 req-0e81dbf3-496a-43e3-8bc8-ddec77715614 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:35.870049 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-edae3ebc-2542-4b91-b8bf-f8fa9ea80821 req-0e81dbf3-496a-43e3-8bc8-ddec77715614 service nova] Creating event network-changed:0bdacda3-4cd1-4742-9510-fd56a466a7b7 for instance 57cfac2f-cf21-44fa-881e-f1d3da2be9d2 on n-h2-862769-1 Oct 27 03:29:35.884098 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-edae3ebc-2542-4b91-b8bf-f8fa9ea80821 req-0e81dbf3-496a-43e3-8bc8-ddec77715614 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065450 Oct 27 03:29:35.884708 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1162/2280] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:29:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:29:35.895447 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4ed11f06-f334-4fd9-b325-dd666303975a tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:35.896384 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4ed11f06-f334-4fd9-b325-dd666303975a tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:35.903809 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4ed11f06-f334-4fd9-b325-dd666303975a tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:35.904808 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4ed11f06-f334-4fd9-b325-dd666303975a tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:35.905455 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4ed11f06-f334-4fd9-b325-dd666303975a tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:35.920538 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4ed11f06-f334-4fd9-b325-dd666303975a tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:35.921252 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4ed11f06-f334-4fd9-b325-dd666303975a tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:35.922963 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4ed11f06-f334-4fd9-b325-dd666303975a tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:36.205078 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.network.security_group_api [None req-a5117b42-1f48-43ec-983b-7af457ecd1e1 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Adding security group 724550ee-a796-4ae0-8467-9b85fc89abfd to port 0bdacda3-4cd1-4742-9510-fd56a466a7b7 Oct 27 03:29:36.278532 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4ed11f06-f334-4fd9-b325-dd666303975a tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:36.291498 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4ed11f06-f334-4fd9-b325-dd666303975a tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c" status: 200 len: 1307 microversion: 2.1 time: 0.401199 Oct 27 03:29:36.292737 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1163/2281] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:35 2022] GET /compute/v2.1/servers/a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c => generated 1307 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:36.317468 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6f938c42-5e3e-45b5-bd41-6c1868eb664c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:36.318390 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-6f938c42-5e3e-45b5-bd41-6c1868eb664c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: a8925d29-d9e0-4dbb-a73d-09473255fa34] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:36.329468 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6f938c42-5e3e-45b5-bd41-6c1868eb664c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:36.329468 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6f938c42-5e3e-45b5-bd41-6c1868eb664c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:36.329468 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6f938c42-5e3e-45b5-bd41-6c1868eb664c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:36.329468 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6f938c42-5e3e-45b5-bd41-6c1868eb664c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:36.329468 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6f938c42-5e3e-45b5-bd41-6c1868eb664c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:36.331541 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6f938c42-5e3e-45b5-bd41-6c1868eb664c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:36.540247 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6f938c42-5e3e-45b5-bd41-6c1868eb664c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:36.552876 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6f938c42-5e3e-45b5-bd41-6c1868eb664c tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34" status: 200 len: 1392 microversion: 2.1 time: 0.241395 Oct 27 03:29:36.568108 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1164/2282] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:36 2022] GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34 => generated 1392 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:36.585915 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0ad47517-f1f3-4378-bdc9-d211c932c6ed tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:36.588223 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0ad47517-f1f3-4378-bdc9-d211c932c6ed tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: 339287fc-37b6-455d-96ab-08ab8e2c3e68] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:36.597401 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0ad47517-f1f3-4378-bdc9-d211c932c6ed tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:36.598184 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0ad47517-f1f3-4378-bdc9-d211c932c6ed tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:36.598864 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0ad47517-f1f3-4378-bdc9-d211c932c6ed tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:36.599816 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0ad47517-f1f3-4378-bdc9-d211c932c6ed tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:36.600795 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0ad47517-f1f3-4378-bdc9-d211c932c6ed tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:36.601451 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0ad47517-f1f3-4378-bdc9-d211c932c6ed tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:36.788988 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0ad47517-f1f3-4378-bdc9-d211c932c6ed tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13e05e253c94aadb1c089128ff35be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8510a519f14deea6f35a437419e161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:36.797190 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0ad47517-f1f3-4378-bdc9-d211c932c6ed tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68" status: 200 len: 1472 microversion: 2.1 time: 0.227804 Oct 27 03:29:36.798083 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1165/2283] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:36 2022] GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68 => generated 1472 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:36.803569 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f5796c98-eafc-4e45-b409-966137449274 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:36.804370 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f5796c98-eafc-4e45-b409-966137449274 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] [instance: 2aa6c062-32e4-453d-abb5-a51d96c66e2d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:36.811018 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f5796c98-eafc-4e45-b409-966137449274 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:36.811745 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f5796c98-eafc-4e45-b409-966137449274 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:36.812370 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f5796c98-eafc-4e45-b409-966137449274 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:36.813379 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f5796c98-eafc-4e45-b409-966137449274 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:36.814208 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f5796c98-eafc-4e45-b409-966137449274 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:36.815220 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f5796c98-eafc-4e45-b409-966137449274 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:36.831950 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-f5796c98-eafc-4e45-b409-966137449274 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] HTTP exception thrown: Instance 2aa6c062-32e4-453d-abb5-a51d96c66e2d could not be found. Oct 27 03:29:36.834367 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f5796c98-eafc-4e45-b409-966137449274 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Request method failure captured: Oct 27 03:29:36.834367 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/2aa6c062-32e4-453d-abb5-a51d96c66e2d HTTP/1.1 Oct 27 03:29:36.834367 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:29:36.834367 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:29:36.834367 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:29:36.834367 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:29:36.834367 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:29:36.834367 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:29:36.834367 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:29:36.834367 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:29:36.834367 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfrb-edByRevFfuhULifqN92XaPnrz1y9TpvzJVFkI7uY8srOIeoiVbh_koOIlmW1qHemLxQzub1Kep0Hp_Be1wKqdeSKQBD4nXR03SL4r_wU3gh6unzCksFMO-TRc2CaC1FQUAgZM0MiZf4AV8a72xd56R6wjBT67zYw0kkAvZ-L-0 Oct 27 03:29:36.834367 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:29:36.834367 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:29:36.834367 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:29:36.834367 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:29:36.834367 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:29:36.834367 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:29:36.834367 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 16b0b534b9eb463aab0f13e838578da2 Oct 27 03:29:36.834367 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ListServersNegativeTestJSON-1232441805 Oct 27 03:29:36.834367 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:29:36.834367 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:29:36.834367 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/16b0b534b9eb463aab0f13e838578da2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/16b0b534b9eb463aab0f13e838578da2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/16b0b534b9eb463aab0f13e838578da2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_16b0b534b9eb463aab0f13e838578da2"}]}] Oct 27 03:29:36.834367 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ListServersNegativeTestJSON-1232441805 Oct 27 03:29:36.834367 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 16b0b534b9eb463aab0f13e838578da2 Oct 27 03:29:36.834367 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1232441805 Oct 27 03:29:36.834367 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ListServersNegativeTestJSON-1232441805-project Oct 27 03:29:36.834367 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:29:36.834367 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:29:36.834367 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 071401bed74d48fe8ae2dbdb98aa81cc Oct 27 03:29:36.834367 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ListServersNegativeTestJSON-1232441805-project Oct 27 03:29:36.834367 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:29:36.834367 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 2aa6c062-32e4-453d-abb5-a51d96c66e2d could not be found. Oct 27 03:29:36.834367 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '2aa6c062-32e4-453d-abb5-a51d96c66e2d'} Oct 27 03:29:36.834367 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:29:36.834367 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:29:36.834367 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:29:36.834367 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:29:36.834367 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:29:36.834367 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:29:36.834367 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:29:36.834367 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:29:36.834367 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:29:36.834367 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:29:36.834367 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2aa6c062-32e4-453d-abb5-a51d96c66e2d could not be found. Oct 27 03:29:36.834367 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:29:36.834367 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:29:36.834367 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:29:36.834367 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:29:36.834367 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:29:36.834367 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:29:36.834367 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:29:36.834367 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:29:36.834367 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:29:36.834367 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:29:36.834367 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:29:36.834367 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:29:36.834367 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:29:36.834367 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:29:36.834367 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:29:36.834367 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:29:36.834367 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2aa6c062-32e4-453d-abb5-a51d96c66e2d could not be found. Oct 27 03:29:36.834367 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:29:36.834367 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:29:36.839339 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:29:36.839339 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:29:36.839339 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:29:36.839339 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:29:36.839339 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:29:36.839339 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:29:36.839339 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2aa6c062-32e4-453d-abb5-a51d96c66e2d could not be found. Oct 27 03:29:36.839339 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:29:36.841113 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f5796c98-eafc-4e45-b409-966137449274 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] Returning 404 to user: Instance 2aa6c062-32e4-453d-abb5-a51d96c66e2d could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:29:36.842449 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f5796c98-eafc-4e45-b409-966137449274 tempest-ListServersNegativeTestJSON-1232441805 tempest-ListServersNegativeTestJSON-1232441805-project] 10.222.0.20 "GET /compute/v2.1/servers/2aa6c062-32e4-453d-abb5-a51d96c66e2d" status: 404 len: 111 microversion: 2.1 time: 0.042831 Oct 27 03:29:36.843773 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1166/2284] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:36 2022] GET /compute/v2.1/servers/2aa6c062-32e4-453d-abb5-a51d96c66e2d => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:29:36.849199 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-054a3ee5-49bd-4e71-89ee-aa5095b83594 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:36.850117 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-054a3ee5-49bd-4e71-89ee-aa5095b83594 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: d5e6f604-9466-45c6-86a8-885cfb393223] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:36.856743 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-054a3ee5-49bd-4e71-89ee-aa5095b83594 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:36.857229 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-054a3ee5-49bd-4e71-89ee-aa5095b83594 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:36.857671 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-054a3ee5-49bd-4e71-89ee-aa5095b83594 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:36.858462 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-054a3ee5-49bd-4e71-89ee-aa5095b83594 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:36.858921 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-054a3ee5-49bd-4e71-89ee-aa5095b83594 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:36.859353 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-054a3ee5-49bd-4e71-89ee-aa5095b83594 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:37.054956 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=10 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:29:37.144882 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-054a3ee5-49bd-4e71-89ee-aa5095b83594 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:37.158656 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-054a3ee5-49bd-4e71-89ee-aa5095b83594 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:37.161887 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-054a3ee5-49bd-4e71-89ee-aa5095b83594 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:37.163506 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-054a3ee5-49bd-4e71-89ee-aa5095b83594 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223" status: 200 len: 1487 microversion: 2.25 time: 0.318601 Oct 27 03:29:37.164631 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1167/2285] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:29:36 2022] GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223 => generated 1487 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:29:37.319549 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ab6737a9-72b9-4998-b565-3dcf4b1f59cf tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:37.320936 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ab6737a9-72b9-4998-b565-3dcf4b1f59cf tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:37.336199 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ab6737a9-72b9-4998-b565-3dcf4b1f59cf tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:37.337220 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ab6737a9-72b9-4998-b565-3dcf4b1f59cf tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:37.339558 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ab6737a9-72b9-4998-b565-3dcf4b1f59cf tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:37.340420 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ab6737a9-72b9-4998-b565-3dcf4b1f59cf tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:37.341528 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ab6737a9-72b9-4998-b565-3dcf4b1f59cf tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:37.342162 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ab6737a9-72b9-4998-b565-3dcf4b1f59cf tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:37.436438 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a5117b42-1f48-43ec-983b-7af457ecd1e1 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] 10.222.0.20 "POST /compute/v2.1/servers/57cfac2f-cf21-44fa-881e-f1d3da2be9d2/action" status: 202 len: 0 microversion: 2.1 time: 1.763682 Oct 27 03:29:37.440475 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1119/2286] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:29:35 2022] POST /compute/v2.1/servers/57cfac2f-cf21-44fa-881e-f1d3da2be9d2/action => generated 0 bytes in 1771 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:29:37.449812 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9a46f284-cb18-4a7a-a490-e1382606cc46 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:37.450620 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9a46f284-cb18-4a7a-a490-e1382606cc46 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] [instance: 57cfac2f-cf21-44fa-881e-f1d3da2be9d2] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:37.465779 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9a46f284-cb18-4a7a-a490-e1382606cc46 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:37.466316 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9a46f284-cb18-4a7a-a490-e1382606cc46 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:37.466762 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9a46f284-cb18-4a7a-a490-e1382606cc46 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:37.467675 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9a46f284-cb18-4a7a-a490-e1382606cc46 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:37.468322 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9a46f284-cb18-4a7a-a490-e1382606cc46 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:37.468931 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9a46f284-cb18-4a7a-a490-e1382606cc46 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:37.748644 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ab6737a9-72b9-4998-b565-3dcf4b1f59cf tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:37.760578 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ab6737a9-72b9-4998-b565-3dcf4b1f59cf tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c" status: 200 len: 1307 microversion: 2.1 time: 0.446906 Oct 27 03:29:37.762172 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1168/2287] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:37 2022] GET /compute/v2.1/servers/a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c => generated 1307 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:29:37.784435 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9405d095-8815-40ba-9049-334d7ed2a6c2 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:37.786398 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-9405d095-8815-40ba-9049-334d7ed2a6c2 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: a8925d29-d9e0-4dbb-a73d-09473255fa34] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:37.794334 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9405d095-8815-40ba-9049-334d7ed2a6c2 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:37.795613 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9405d095-8815-40ba-9049-334d7ed2a6c2 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:37.796422 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9405d095-8815-40ba-9049-334d7ed2a6c2 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:37.797487 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9405d095-8815-40ba-9049-334d7ed2a6c2 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:37.798222 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9405d095-8815-40ba-9049-334d7ed2a6c2 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:37.798889 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9405d095-8815-40ba-9049-334d7ed2a6c2 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:38.105583 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9a46f284-cb18-4a7a-a490-e1382606cc46 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] 10.222.0.20 "GET /compute/v2.1/servers/57cfac2f-cf21-44fa-881e-f1d3da2be9d2/os-security-groups" status: 200 len: 1155 microversion: 2.1 time: 0.660244 Oct 27 03:29:38.106250 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1120/2288] 10.222.0.20 () {58 vars in 1293 bytes} [Thu Oct 27 03:29:37 2022] GET /compute/v2.1/servers/57cfac2f-cf21-44fa-881e-f1d3da2be9d2/os-security-groups => generated 1155 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:38.110963 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3aaeb3ed-7ec5-433e-9590-32c38edf9170 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:38.111562 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-3aaeb3ed-7ec5-433e-9590-32c38edf9170 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: 339287fc-37b6-455d-96ab-08ab8e2c3e68] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:38.126180 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3aaeb3ed-7ec5-433e-9590-32c38edf9170 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:38.126684 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3aaeb3ed-7ec5-433e-9590-32c38edf9170 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:38.127322 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3aaeb3ed-7ec5-433e-9590-32c38edf9170 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:38.131756 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3aaeb3ed-7ec5-433e-9590-32c38edf9170 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:38.131756 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3aaeb3ed-7ec5-433e-9590-32c38edf9170 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:38.131756 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3aaeb3ed-7ec5-433e-9590-32c38edf9170 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:38.315882 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9405d095-8815-40ba-9049-334d7ed2a6c2 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:38.330742 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9405d095-8815-40ba-9049-334d7ed2a6c2 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34" status: 200 len: 1392 microversion: 2.1 time: 0.566405 Oct 27 03:29:38.343311 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1169/2289] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:37 2022] GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34 => generated 1392 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:38.343311 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-84b1d2c2-b558-4276-ad74-dd1cd65d89c8 req-47e18600-1577-4902-8422-a79f0193bcca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57cfac2f-cf21-44fa-881e-f1d3da2be9d2", "tag": "0bdacda3-4cd1-4742-9510-fd56a466a7b7"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:29:38.357223 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-84b1d2c2-b558-4276-ad74-dd1cd65d89c8 req-47e18600-1577-4902-8422-a79f0193bcca service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:38.358177 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-84b1d2c2-b558-4276-ad74-dd1cd65d89c8 req-47e18600-1577-4902-8422-a79f0193bcca service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:38.360869 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-84b1d2c2-b558-4276-ad74-dd1cd65d89c8 req-47e18600-1577-4902-8422-a79f0193bcca service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:38.392507 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-84b1d2c2-b558-4276-ad74-dd1cd65d89c8 req-47e18600-1577-4902-8422-a79f0193bcca service nova] Creating event network-changed:0bdacda3-4cd1-4742-9510-fd56a466a7b7 for instance 57cfac2f-cf21-44fa-881e-f1d3da2be9d2 on n-h2-862769-1 Oct 27 03:29:38.405548 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-84b1d2c2-b558-4276-ad74-dd1cd65d89c8 req-47e18600-1577-4902-8422-a79f0193bcca service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069916 Oct 27 03:29:38.411125 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1170/2290] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:29:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:29:38.422838 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-05c85433-7c9e-434f-92ac-720f7559829b tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Action: 'create', calling method: .version_select at 0x7f7dda586160>, body: {"security_group": {"name": " tempest-securitygroup -299104866 ", "description": "tempest-description-1810374931"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:29:38.959221 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-3aaeb3ed-7ec5-433e-9590-32c38edf9170 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13e05e253c94aadb1c089128ff35be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8510a519f14deea6f35a437419e161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:38.974812 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3aaeb3ed-7ec5-433e-9590-32c38edf9170 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68" status: 200 len: 1472 microversion: 2.1 time: 0.867407 Oct 27 03:29:38.982670 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1121/2291] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:38 2022] GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68 => generated 1472 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:38.984439 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0179a1f7-9cde-4a16-86ca-c00bb7a070b1 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:38.985106 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0179a1f7-9cde-4a16-86ca-c00bb7a070b1 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: d5e6f604-9466-45c6-86a8-885cfb393223] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:38.994909 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0179a1f7-9cde-4a16-86ca-c00bb7a070b1 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:38.998583 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0179a1f7-9cde-4a16-86ca-c00bb7a070b1 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:39.006222 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0179a1f7-9cde-4a16-86ca-c00bb7a070b1 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:39.006222 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0179a1f7-9cde-4a16-86ca-c00bb7a070b1 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:39.006222 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0179a1f7-9cde-4a16-86ca-c00bb7a070b1 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:39.006222 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0179a1f7-9cde-4a16-86ca-c00bb7a070b1 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:39.300720 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0179a1f7-9cde-4a16-86ca-c00bb7a070b1 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:39.310865 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0179a1f7-9cde-4a16-86ca-c00bb7a070b1 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:39.312591 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0179a1f7-9cde-4a16-86ca-c00bb7a070b1 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:39.313784 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0179a1f7-9cde-4a16-86ca-c00bb7a070b1 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223" status: 200 len: 1487 microversion: 2.25 time: 0.336847 Oct 27 03:29:39.314462 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1122/2292] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:29:38 2022] GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223 => generated 1487 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:29:39.319943 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7cb19fae-61e9-4778-b9e3-9e00086a0644 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:39.320743 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7cb19fae-61e9-4778-b9e3-9e00086a0644 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:39.326692 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7cb19fae-61e9-4778-b9e3-9e00086a0644 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:39.327480 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7cb19fae-61e9-4778-b9e3-9e00086a0644 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:39.328195 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7cb19fae-61e9-4778-b9e3-9e00086a0644 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:39.329125 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7cb19fae-61e9-4778-b9e3-9e00086a0644 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:39.329750 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7cb19fae-61e9-4778-b9e3-9e00086a0644 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:39.329886 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-05c85433-7c9e-434f-92ac-720f7559829b tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 223 microversion: 2.1 time: 0.916654 Oct 27 03:29:39.330506 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7cb19fae-61e9-4778-b9e3-9e00086a0644 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:39.330755 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1171/2293] 10.222.0.20 () {60 vars in 1180 bytes} [Thu Oct 27 03:29:38 2022] POST /compute/v2.1/os-security-groups => generated 223 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:29:39.343860 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a610c28a-6b40-43f8-a8ca-b7b1f8b1e8fc tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Calling method '.version_select at 0x7f7dda0d6b80>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:39.520559 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a610c28a-6b40-43f8-a8ca-b7b1f8b1e8fc tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups/953ec5ed-1a7a-4bae-a84a-8ffc2b273955" status: 200 len: 223 microversion: 2.1 time: 0.180472 Oct 27 03:29:39.522465 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1172/2294] 10.222.0.20 () {58 vars in 1269 bytes} [Thu Oct 27 03:29:39 2022] GET /compute/v2.1/os-security-groups/953ec5ed-1a7a-4bae-a84a-8ffc2b273955 => generated 223 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:29:39.529292 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-36bc9451-b8b0-4860-a2dc-e6846b212bf3 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:39.530793 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-36bc9451-b8b0-4860-a2dc-e6846b212bf3 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: a8925d29-d9e0-4dbb-a73d-09473255fa34] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:39.568598 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-36bc9451-b8b0-4860-a2dc-e6846b212bf3 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:39.570434 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-36bc9451-b8b0-4860-a2dc-e6846b212bf3 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:39.572485 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-36bc9451-b8b0-4860-a2dc-e6846b212bf3 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:39.573531 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-36bc9451-b8b0-4860-a2dc-e6846b212bf3 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:39.576004 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-36bc9451-b8b0-4860-a2dc-e6846b212bf3 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:39.576844 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-36bc9451-b8b0-4860-a2dc-e6846b212bf3 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:39.795131 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7cb19fae-61e9-4778-b9e3-9e00086a0644 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:39.807699 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7cb19fae-61e9-4778-b9e3-9e00086a0644 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c" status: 200 len: 1307 microversion: 2.1 time: 0.490381 Oct 27 03:29:39.810350 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1123/2295] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:39 2022] GET /compute/v2.1/servers/a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c => generated 1307 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:39.819591 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-672c578f-26f6-4e5f-9fe2-60ab22fd0cb3 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1337710575", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3c58b3a5-6f00-4601-ab92-e31d99f01594"}], "security_groups": [{"name": "tempest-securitygroup--1865279232"}], "key_name": "tempest-keypair-1121307756", "user_data": "}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:29:40.013791 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-36bc9451-b8b0-4860-a2dc-e6846b212bf3 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:40.028812 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-36bc9451-b8b0-4860-a2dc-e6846b212bf3 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34" status: 200 len: 1382 microversion: 2.1 time: 0.503031 Oct 27 03:29:40.030422 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1173/2296] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:39 2022] GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34 => generated 1382 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:40.039095 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-98440601-ffe0-4061-a6fa-fef35774adf6 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Calling method '.version_select at 0x7f7ddedc4790>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:40.097609 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-672c578f-26f6-4e5f-9fe2-60ab22fd0cb3 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] validate_networks() for [('3c58b3a5-6f00-4601-ab92-e31d99f01594', None, None, None, None, None)] {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:29:40.610646 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-98440601-ffe0-4061-a6fa-fef35774adf6 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/953ec5ed-1a7a-4bae-a84a-8ffc2b273955" status: 202 len: 0 microversion: 2.1 time: 0.577266 Oct 27 03:29:40.615879 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1174/2297] 10.222.0.20 () {58 vars in 1272 bytes} [Thu Oct 27 03:29:40 2022] DELETE /compute/v2.1/os-security-groups/953ec5ed-1a7a-4bae-a84a-8ffc2b273955 => generated 0 bytes in 579 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:29:40.617397 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-451d9fe2-81b5-408e-9afa-e33fe340cccf tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:40.618467 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-451d9fe2-81b5-408e-9afa-e33fe340cccf tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: 339287fc-37b6-455d-96ab-08ab8e2c3e68] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:40.634474 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-451d9fe2-81b5-408e-9afa-e33fe340cccf tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:40.635294 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-451d9fe2-81b5-408e-9afa-e33fe340cccf tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:40.639109 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-451d9fe2-81b5-408e-9afa-e33fe340cccf tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:40.640105 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-451d9fe2-81b5-408e-9afa-e33fe340cccf tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:40.643530 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-451d9fe2-81b5-408e-9afa-e33fe340cccf tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:40.646063 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-451d9fe2-81b5-408e-9afa-e33fe340cccf tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:40.984601 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-672c578f-26f6-4e5f-9fe2-60ab22fd0cb3 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:29:40.985426 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-672c578f-26f6-4e5f-9fe2-60ab22fd0cb3 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:29:40.986142 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-672c578f-26f6-4e5f-9fe2-60ab22fd0cb3 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:29:40.986721 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-672c578f-26f6-4e5f-9fe2-60ab22fd0cb3 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:29:40.987379 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-672c578f-26f6-4e5f-9fe2-60ab22fd0cb3 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:29:41.015476 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-672c578f-26f6-4e5f-9fe2-60ab22fd0cb3 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:41.021647 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-672c578f-26f6-4e5f-9fe2-60ab22fd0cb3 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:41.022169 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-672c578f-26f6-4e5f-9fe2-60ab22fd0cb3 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:41.022996 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-672c578f-26f6-4e5f-9fe2-60ab22fd0cb3 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:41.023468 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-672c578f-26f6-4e5f-9fe2-60ab22fd0cb3 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:41.023899 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-672c578f-26f6-4e5f-9fe2-60ab22fd0cb3 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:41.034820 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-451d9fe2-81b5-408e-9afa-e33fe340cccf tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13e05e253c94aadb1c089128ff35be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8510a519f14deea6f35a437419e161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:41.048255 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-451d9fe2-81b5-408e-9afa-e33fe340cccf tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68" status: 200 len: 1472 microversion: 2.1 time: 0.435070 Oct 27 03:29:41.064933 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1175/2298] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:40 2022] GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68 => generated 1472 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:41.079364 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0e7850fc-64d0-4aac-9c7f-b8d482bb7124 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Calling method '.version_select at 0x7f7ddec604c0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:41.079977 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-672c578f-26f6-4e5f-9fe2-60ab22fd0cb3 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Getting quotas for project 3e9ede68f63747d59153a46412033856. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:29:41.091456 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0e7850fc-64d0-4aac-9c7f-b8d482bb7124 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:41.092104 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0e7850fc-64d0-4aac-9c7f-b8d482bb7124 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:41.092569 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0e7850fc-64d0-4aac-9c7f-b8d482bb7124 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:41.095692 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-672c578f-26f6-4e5f-9fe2-60ab22fd0cb3 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Getting quotas for user 94897f20beb94dbd8e7eff6ecba30026 and project 3e9ede68f63747d59153a46412033856. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:29:41.115429 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0e7850fc-64d0-4aac-9c7f-b8d482bb7124 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 3086 microversion: 2.1 time: 0.048401 Oct 27 03:29:41.126783 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1176/2299] 10.222.0.20 () {58 vars in 1143 bytes} [Thu Oct 27 03:29:41 2022] GET /compute/v2.1/os-migrations => generated 3086 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:41.131229 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-672c578f-26f6-4e5f-9fe2-60ab22fd0cb3 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:29:41.131998 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-672c578f-26f6-4e5f-9fe2-60ab22fd0cb3 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:29:41.142456 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c8fd9a48-bc57-4374-846a-35f5c234567d tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:41.143172 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c8fd9a48-bc57-4374-846a-35f5c234567d tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: d5e6f604-9466-45c6-86a8-885cfb393223] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:41.150635 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c8fd9a48-bc57-4374-846a-35f5c234567d tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:41.151187 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c8fd9a48-bc57-4374-846a-35f5c234567d tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:41.151634 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c8fd9a48-bc57-4374-846a-35f5c234567d tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:41.153515 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c8fd9a48-bc57-4374-846a-35f5c234567d tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:41.153979 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c8fd9a48-bc57-4374-846a-35f5c234567d tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:41.156165 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c8fd9a48-bc57-4374-846a-35f5c234567d tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:41.176125 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=100 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:29:41.328939 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-672c578f-26f6-4e5f-9fe2-60ab22fd0cb3 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.515837 Oct 27 03:29:41.330084 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1124/2300] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:29:39 2022] POST /compute/v2.1/servers => generated 409 bytes in 1518 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 03:29:41.334898 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1f0e4270-fdd7-46e3-8c4e-c94cee17ec2a tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Calling method '.version_select at 0x7f7ddb528430>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:41.364326 n-d-862769-1 devstack@n-api.service[121000]: DEBUG neutronclient.v2_0.client [None req-1f0e4270-fdd7-46e3-8c4e-c94cee17ec2a tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 953ec5ed-1a7a-4bae-a84a-8ffc2b273955 does not exist", "detail": ""}} {{(pid=121000) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 03:29:41.365480 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.security_group_api [None req-1f0e4270-fdd7-46e3-8c4e-c94cee17ec2a tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Neutron security group 953ec5ed-1a7a-4bae-a84a-8ffc2b273955 not found {{(pid=121000) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 27 03:29:41.367108 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-1f0e4270-fdd7-46e3-8c4e-c94cee17ec2a tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] HTTP exception thrown: Security group 953ec5ed-1a7a-4bae-a84a-8ffc2b273955 does not exist Oct 27 03:29:41.367108 n-d-862769-1 devstack@n-api.service[121000]: Neutron server returns request_ids: ['req-68c47033-3879-4e21-87bb-f3ef3974b83a'] Oct 27 03:29:41.383661 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1f0e4270-fdd7-46e3-8c4e-c94cee17ec2a tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Request method failure captured: Oct 27 03:29:41.383661 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/os-security-groups/953ec5ed-1a7a-4bae-a84a-8ffc2b273955 HTTP/1.1 Oct 27 03:29:41.383661 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:29:41.383661 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:29:41.383661 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:29:41.383661 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:29:41.383661 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:29:41.383661 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:29:41.383661 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:29:41.383661 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:29:41.383661 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfsDm0Py_zt25h362jzfO2BV3foI0uyhpjoORk0IBXpXJDIOp5L0sBs5ZGjH5wntvfF1YWko5rdp9M7xGcdJ8XvPLxOQRZn1LZea5O-2FHM2FJsNqsONwbzuZ-uFy7VwM4IakmeqODIMdeP73cGPmeJKxcyXnuTU87F5wWBu1IQyRCI Oct 27 03:29:41.383661 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:29:41.383661 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:29:41.383661 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:29:41.383661 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:29:41.383661 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:29:41.383661 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:29:41.383661 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 92082c8718aa41bf96cd84d682d75954 Oct 27 03:29:41.383661 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-SecurityGroupsTestJSON-1273178137 Oct 27 03:29:41.383661 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:29:41.383661 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:29:41.383661 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/92082c8718aa41bf96cd84d682d75954"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/92082c8718aa41bf96cd84d682d75954"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/92082c8718aa41bf96cd84d682d75954"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_92082c8718aa41bf96cd84d682d75954"}]}] Oct 27 03:29:41.383661 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-SecurityGroupsTestJSON-1273178137 Oct 27 03:29:41.383661 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 92082c8718aa41bf96cd84d682d75954 Oct 27 03:29:41.383661 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1273178137 Oct 27 03:29:41.383661 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-SecurityGroupsTestJSON-1273178137-project Oct 27 03:29:41.383661 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:29:41.383661 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:29:41.383661 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 421d14944da74570a53d620ea205449d Oct 27 03:29:41.383661 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-SecurityGroupsTestJSON-1273178137-project Oct 27 03:29:41.383661 n-d-862769-1 devstack@n-api.service[121000]: method: Oct 27 03:29:41.383661 n-d-862769-1 devstack@n-api.service[121000]: exception: Security group 953ec5ed-1a7a-4bae-a84a-8ffc2b273955 does not exist Oct 27 03:29:41.383661 n-d-862769-1 devstack@n-api.service[121000]: Neutron server returns request_ids: ['req-68c47033-3879-4e21-87bb-f3ef3974b83a'] Oct 27 03:29:41.383661 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '953ec5ed-1a7a-4bae-a84a-8ffc2b273955'} Oct 27 03:29:41.383661 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:29:41.383661 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:29:41.383661 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 27 03:29:41.383661 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 27 03:29:41.383661 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:29:41.383661 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:29:41.383661 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 27 03:29:41.383661 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 27 03:29:41.383661 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:29:41.383661 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:29:41.383661 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 27 03:29:41.383661 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 27 03:29:41.383661 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:29:41.383661 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:29:41.383661 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 03:29:41.383661 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 03:29:41.383661 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:29:41.383661 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:29:41.383661 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 03:29:41.383661 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 03:29:41.383661 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:29:41.383661 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:29:41.383661 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 03:29:41.383661 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 03:29:41.383661 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 03:29:41.383661 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 03:29:41.383661 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 953ec5ed-1a7a-4bae-a84a-8ffc2b273955 does not exist Oct 27 03:29:41.388901 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-68c47033-3879-4e21-87bb-f3ef3974b83a'] Oct 27 03:29:41.388901 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:29:41.388901 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:29:41.388901 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:29:41.388901 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:29:41.388901 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 27 03:29:41.388901 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 27 03:29:41.388901 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 27 03:29:41.388901 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 27 03:29:41.388901 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 953ec5ed-1a7a-4bae-a84a-8ffc2b273955 does not exist Oct 27 03:29:41.388901 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-68c47033-3879-4e21-87bb-f3ef3974b83a'] Oct 27 03:29:41.388901 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:29:41.388901 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:29:41.388901 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:29:41.388901 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:29:41.388901 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:29:41.388901 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:29:41.388901 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:29:41.388901 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:29:41.388901 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:29:41.388901 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:29:41.388901 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:29:41.388901 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:29:41.388901 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 27 03:29:41.388901 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 27 03:29:41.388901 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 953ec5ed-1a7a-4bae-a84a-8ffc2b273955 does not exist Oct 27 03:29:41.388901 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-68c47033-3879-4e21-87bb-f3ef3974b83a'] Oct 27 03:29:41.388901 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:29:41.388901 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:29:41.388901 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:29:41.388901 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:29:41.388901 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:29:41.388901 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:29:41.388901 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:29:41.388901 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:29:41.388901 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 953ec5ed-1a7a-4bae-a84a-8ffc2b273955 does not exist Oct 27 03:29:41.388901 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-68c47033-3879-4e21-87bb-f3ef3974b83a'] Oct 27 03:29:41.388901 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:29:41.388901 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1f0e4270-fdd7-46e3-8c4e-c94cee17ec2a tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Returning 404 to user: Security group 953ec5ed-1a7a-4bae-a84a-8ffc2b273955 does not exist Oct 27 03:29:41.388901 n-d-862769-1 devstack@n-api.service[121000]: Neutron server returns request_ids: ['req-68c47033-3879-4e21-87bb-f3ef3974b83a'] {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:29:41.388901 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1f0e4270-fdd7-46e3-8c4e-c94cee17ec2a tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups/953ec5ed-1a7a-4bae-a84a-8ffc2b273955" status: 404 len: 194 microversion: 2.1 time: 0.054116 Oct 27 03:29:41.388901 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1125/2301] 10.222.0.20 () {58 vars in 1269 bytes} [Thu Oct 27 03:29:41 2022] GET /compute/v2.1/os-security-groups/953ec5ed-1a7a-4bae-a84a-8ffc2b273955 => generated 194 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:29:41.398929 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-763fe55b-b33b-4b01-866b-3c0ad00a992d tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:41.399796 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-763fe55b-b33b-4b01-866b-3c0ad00a992d tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:41.412866 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-763fe55b-b33b-4b01-866b-3c0ad00a992d tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:41.413473 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-763fe55b-b33b-4b01-866b-3c0ad00a992d tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:41.414690 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-763fe55b-b33b-4b01-866b-3c0ad00a992d tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:41.416216 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-763fe55b-b33b-4b01-866b-3c0ad00a992d tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:41.417461 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-763fe55b-b33b-4b01-866b-3c0ad00a992d tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:41.419483 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-763fe55b-b33b-4b01-866b-3c0ad00a992d tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:41.509521 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c8fd9a48-bc57-4374-846a-35f5c234567d tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:41.530497 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c8fd9a48-bc57-4374-846a-35f5c234567d tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:41.536889 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c8fd9a48-bc57-4374-846a-35f5c234567d tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:41.539873 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c8fd9a48-bc57-4374-846a-35f5c234567d tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223" status: 200 len: 1487 microversion: 2.25 time: 0.415940 Oct 27 03:29:41.541556 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1177/2302] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:29:41 2022] GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223 => generated 1487 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:29:41.556137 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5555edc6-e91e-4ff5-852b-7df57db43800 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:41.556137 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5555edc6-e91e-4ff5-852b-7df57db43800 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] [instance: a8925d29-d9e0-4dbb-a73d-09473255fa34] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:41.575581 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5555edc6-e91e-4ff5-852b-7df57db43800 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:41.577343 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5555edc6-e91e-4ff5-852b-7df57db43800 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:41.578087 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5555edc6-e91e-4ff5-852b-7df57db43800 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:41.581056 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5555edc6-e91e-4ff5-852b-7df57db43800 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:41.581790 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5555edc6-e91e-4ff5-852b-7df57db43800 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:41.582608 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5555edc6-e91e-4ff5-852b-7df57db43800 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:41.666734 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=16 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:29:41.754766 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-763fe55b-b33b-4b01-866b-3c0ad00a992d tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:41.765409 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-763fe55b-b33b-4b01-866b-3c0ad00a992d tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c" status: 200 len: 1307 microversion: 2.1 time: 0.373798 Oct 27 03:29:41.766455 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1126/2303] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:41 2022] GET /compute/v2.1/servers/a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c => generated 1307 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:41.771900 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c34e297d-057a-46d0-b382-78f4af93d380 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:41.772986 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c34e297d-057a-46d0-b382-78f4af93d380 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:41.902258 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c34e297d-057a-46d0-b382-78f4af93d380 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:41.927226 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c34e297d-057a-46d0-b382-78f4af93d380 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1239 microversion: 2.1 time: 0.159573 Oct 27 03:29:41.927488 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5555edc6-e91e-4ff5-852b-7df57db43800 tempest-LiveMigrationTest-1446935643 tempest-LiveMigrationTest-1446935643-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34" status: 200 len: 1533 microversion: 2.1 time: 0.379949 Oct 27 03:29:41.928309 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1178/2304] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:41 2022] GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34 => generated 1533 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:41.938175 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-cc6870bd-d13a-497a-8611-73447b6dee9e tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Action: 'create', calling method: .version_select at 0x7f7dda0d89d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-615666460", "description": "tempest-description-1943685415"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:29:41.938411 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1127/2305] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:41 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1239 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:41.968378 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-58c064c3-c5f7-4a37-a63e-209fb398ab4a tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:41.968895 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-58c064c3-c5f7-4a37-a63e-209fb398ab4a tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: a8925d29-d9e0-4dbb-a73d-09473255fa34] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:41.987823 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-58c064c3-c5f7-4a37-a63e-209fb398ab4a tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:41.988337 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-58c064c3-c5f7-4a37-a63e-209fb398ab4a tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:41.988781 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-58c064c3-c5f7-4a37-a63e-209fb398ab4a tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:41.991440 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-58c064c3-c5f7-4a37-a63e-209fb398ab4a tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:41.992231 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-58c064c3-c5f7-4a37-a63e-209fb398ab4a tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:41.993404 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-58c064c3-c5f7-4a37-a63e-209fb398ab4a tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:42.056310 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-58c064c3-c5f7-4a37-a63e-209fb398ab4a tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: a8925d29-d9e0-4dbb-a73d-09473255fa34] Going to try to terminate instance {{(pid=121000) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:29:42.575120 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-58c064c3-c5f7-4a37-a63e-209fb398ab4a tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34" status: 204 len: 0 microversion: 2.1 time: 0.610597 Oct 27 03:29:42.576047 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1128/2306] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:29:41 2022] DELETE /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34 => generated 0 bytes in 612 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:29:42.582964 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-71af9094-96df-4f97-a746-6c5167d73b7d tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:42.583750 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-71af9094-96df-4f97-a746-6c5167d73b7d tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: 339287fc-37b6-455d-96ab-08ab8e2c3e68] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:42.587561 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-cc6870bd-d13a-497a-8611-73447b6dee9e tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.658100 Oct 27 03:29:42.588473 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1179/2307] 10.222.0.20 () {60 vars in 1180 bytes} [Thu Oct 27 03:29:41 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:29:42.589789 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-71af9094-96df-4f97-a746-6c5167d73b7d tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:42.590330 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-71af9094-96df-4f97-a746-6c5167d73b7d tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:42.590883 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-71af9094-96df-4f97-a746-6c5167d73b7d tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:42.591504 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-71af9094-96df-4f97-a746-6c5167d73b7d tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:42.591929 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-71af9094-96df-4f97-a746-6c5167d73b7d tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:42.592359 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-71af9094-96df-4f97-a746-6c5167d73b7d tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:42.593487 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-d2287def-f5e2-4c3d-a444-570a16d48c17 req-6c99cd82-08a3-42d4-b100-080da791195f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c", "name": "network-vif-plugged", "status": "completed", "tag": "f54df010-fe0a-4c01-88de-96c0e83bfd34"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:29:42.609925 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-d2287def-f5e2-4c3d-a444-570a16d48c17 req-6c99cd82-08a3-42d4-b100-080da791195f service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:42.610466 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-d2287def-f5e2-4c3d-a444-570a16d48c17 req-6c99cd82-08a3-42d4-b100-080da791195f service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:42.610986 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-d2287def-f5e2-4c3d-a444-570a16d48c17 req-6c99cd82-08a3-42d4-b100-080da791195f service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:42.632114 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-d2287def-f5e2-4c3d-a444-570a16d48c17 req-6c99cd82-08a3-42d4-b100-080da791195f service nova] Creating event network-vif-plugged:f54df010-fe0a-4c01-88de-96c0e83bfd34 for instance a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c on n-h2-862769-1 Oct 27 03:29:42.637586 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-d2287def-f5e2-4c3d-a444-570a16d48c17 req-6c99cd82-08a3-42d4-b100-080da791195f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047900 Oct 27 03:29:42.639086 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1180/2308] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:29:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:29:42.647102 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6dcaa8a5-40e7-49b6-959e-9454173bc4c3 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:42.652644 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-6dcaa8a5-40e7-49b6-959e-9454173bc4c3 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: d5e6f604-9466-45c6-86a8-885cfb393223] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:42.669167 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6dcaa8a5-40e7-49b6-959e-9454173bc4c3 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:42.669978 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6dcaa8a5-40e7-49b6-959e-9454173bc4c3 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:42.674310 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6dcaa8a5-40e7-49b6-959e-9454173bc4c3 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:42.675881 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6dcaa8a5-40e7-49b6-959e-9454173bc4c3 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:42.681275 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6dcaa8a5-40e7-49b6-959e-9454173bc4c3 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:42.681275 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6dcaa8a5-40e7-49b6-959e-9454173bc4c3 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:42.820188 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-71af9094-96df-4f97-a746-6c5167d73b7d tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13e05e253c94aadb1c089128ff35be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8510a519f14deea6f35a437419e161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:42.835026 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-71af9094-96df-4f97-a746-6c5167d73b7d tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68" status: 200 len: 1472 microversion: 2.1 time: 0.257442 Oct 27 03:29:42.845005 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1129/2309] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:42 2022] GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68 => generated 1472 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:42.845005 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-706c1545-6870-4681-a13a-956502bfa0d9 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:42.845005 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-706c1545-6870-4681-a13a-956502bfa0d9 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: a8925d29-d9e0-4dbb-a73d-09473255fa34] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:42.855753 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-706c1545-6870-4681-a13a-956502bfa0d9 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:42.856331 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-706c1545-6870-4681-a13a-956502bfa0d9 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:42.860934 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-706c1545-6870-4681-a13a-956502bfa0d9 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:42.862022 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-706c1545-6870-4681-a13a-956502bfa0d9 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:42.863627 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-706c1545-6870-4681-a13a-956502bfa0d9 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:42.864371 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-706c1545-6870-4681-a13a-956502bfa0d9 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:43.026510 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6dcaa8a5-40e7-49b6-959e-9454173bc4c3 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:43.040771 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6dcaa8a5-40e7-49b6-959e-9454173bc4c3 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:43.042796 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6dcaa8a5-40e7-49b6-959e-9454173bc4c3 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:43.058188 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6dcaa8a5-40e7-49b6-959e-9454173bc4c3 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223" status: 200 len: 1487 microversion: 2.25 time: 0.403453 Oct 27 03:29:43.058188 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1181/2310] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:29:42 2022] GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223 => generated 1487 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:29:43.058188 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-80842f5f-fb17-49e7-aacd-8b807de4deff tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Action: 'create', calling method: .version_select at 0x7f7dda070c10>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1404107215", "description": "tempest-description-1981045152"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:29:43.122658 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-706c1545-6870-4681-a13a-956502bfa0d9 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:43.131667 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-706c1545-6870-4681-a13a-956502bfa0d9 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34" status: 200 len: 1388 microversion: 2.1 time: 0.294863 Oct 27 03:29:43.132369 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1130/2311] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:42 2022] GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34 => generated 1388 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:43.140848 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e46c60e9-ad7a-46b6-9421-a409a298df58 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:43.141673 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e46c60e9-ad7a-46b6-9421-a409a298df58 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:43.149047 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e46c60e9-ad7a-46b6-9421-a409a298df58 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:43.149827 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e46c60e9-ad7a-46b6-9421-a409a298df58 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:43.150326 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e46c60e9-ad7a-46b6-9421-a409a298df58 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:43.155073 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e46c60e9-ad7a-46b6-9421-a409a298df58 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:43.155073 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e46c60e9-ad7a-46b6-9421-a409a298df58 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:43.155073 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e46c60e9-ad7a-46b6-9421-a409a298df58 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:43.322297 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e46c60e9-ad7a-46b6-9421-a409a298df58 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:43.332639 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e46c60e9-ad7a-46b6-9421-a409a298df58 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c" status: 200 len: 1307 microversion: 2.1 time: 0.198667 Oct 27 03:29:43.333900 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1131/2312] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:43 2022] GET /compute/v2.1/servers/a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c => generated 1307 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:43.344648 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-16a76ecf-ebd4-47c8-ab8a-5ecd226b77d0 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:43.345842 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-16a76ecf-ebd4-47c8-ab8a-5ecd226b77d0 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:43.358946 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-16a76ecf-ebd4-47c8-ab8a-5ecd226b77d0 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:43.360005 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-16a76ecf-ebd4-47c8-ab8a-5ecd226b77d0 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:43.360879 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-16a76ecf-ebd4-47c8-ab8a-5ecd226b77d0 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:43.361906 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-16a76ecf-ebd4-47c8-ab8a-5ecd226b77d0 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:43.363346 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-16a76ecf-ebd4-47c8-ab8a-5ecd226b77d0 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:43.364086 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-16a76ecf-ebd4-47c8-ab8a-5ecd226b77d0 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:43.599528 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-16a76ecf-ebd4-47c8-ab8a-5ecd226b77d0 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:43.611952 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-16a76ecf-ebd4-47c8-ab8a-5ecd226b77d0 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1243 microversion: 2.1 time: 0.276127 Oct 27 03:29:43.614788 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1132/2313] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:43 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1243 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:43.683084 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-80842f5f-fb17-49e7-aacd-8b807de4deff tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.637382 Oct 27 03:29:43.683695 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1182/2314] 10.222.0.20 () {60 vars in 1180 bytes} [Thu Oct 27 03:29:43 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:29:43.700447 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-039c2c65-b31f-4928-8a95-f9bf3ce8be6a tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Action: 'create', calling method: .version_select at 0x7f7dda1e11f0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1379562482", "description": "tempest-description-167582265"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:29:43.859937 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-686ba051-3423-4274-be18-a5a1bfa834c0 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:43.860565 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-686ba051-3423-4274-be18-a5a1bfa834c0 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: 339287fc-37b6-455d-96ab-08ab8e2c3e68] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:43.866808 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-686ba051-3423-4274-be18-a5a1bfa834c0 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:43.867297 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-686ba051-3423-4274-be18-a5a1bfa834c0 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:43.868060 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-686ba051-3423-4274-be18-a5a1bfa834c0 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:43.868426 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-686ba051-3423-4274-be18-a5a1bfa834c0 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:43.868918 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-686ba051-3423-4274-be18-a5a1bfa834c0 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:43.869612 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-686ba051-3423-4274-be18-a5a1bfa834c0 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:44.089166 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-686ba051-3423-4274-be18-a5a1bfa834c0 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13e05e253c94aadb1c089128ff35be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8510a519f14deea6f35a437419e161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:44.097540 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-686ba051-3423-4274-be18-a5a1bfa834c0 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68" status: 200 len: 1472 microversion: 2.1 time: 0.241910 Oct 27 03:29:44.118581 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1183/2315] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:43 2022] GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68 => generated 1472 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:29:44.125934 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f1400af4-ce88-461b-aa80-64ff90ac78ec tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:44.126877 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f1400af4-ce88-461b-aa80-64ff90ac78ec tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: d5e6f604-9466-45c6-86a8-885cfb393223] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:44.146848 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f1400af4-ce88-461b-aa80-64ff90ac78ec tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:44.147358 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f1400af4-ce88-461b-aa80-64ff90ac78ec tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:44.149324 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f1400af4-ce88-461b-aa80-64ff90ac78ec tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:44.155198 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f1400af4-ce88-461b-aa80-64ff90ac78ec tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:44.156163 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f1400af4-ce88-461b-aa80-64ff90ac78ec tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:44.156630 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f1400af4-ce88-461b-aa80-64ff90ac78ec tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:44.427403 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f1400af4-ce88-461b-aa80-64ff90ac78ec tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:44.436348 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f1400af4-ce88-461b-aa80-64ff90ac78ec tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:44.437861 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f1400af4-ce88-461b-aa80-64ff90ac78ec tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:44.439398 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f1400af4-ce88-461b-aa80-64ff90ac78ec tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223" status: 200 len: 1487 microversion: 2.25 time: 0.319692 Oct 27 03:29:44.439970 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1184/2316] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:29:44 2022] GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223 => generated 1487 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:29:44.458696 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-fd308c18-a9cf-4b9d-bfc6-840f79b6a5d8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:44.458696 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-fd308c18-a9cf-4b9d-bfc6-840f79b6a5d8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: a8925d29-d9e0-4dbb-a73d-09473255fa34] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:44.458696 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fd308c18-a9cf-4b9d-bfc6-840f79b6a5d8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:44.458696 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fd308c18-a9cf-4b9d-bfc6-840f79b6a5d8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:44.458696 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fd308c18-a9cf-4b9d-bfc6-840f79b6a5d8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:44.458696 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fd308c18-a9cf-4b9d-bfc6-840f79b6a5d8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:44.458696 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fd308c18-a9cf-4b9d-bfc6-840f79b6a5d8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:44.458696 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fd308c18-a9cf-4b9d-bfc6-840f79b6a5d8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:44.529335 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-039c2c65-b31f-4928-8a95-f9bf3ce8be6a tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.836618 Oct 27 03:29:44.539274 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1133/2317] 10.222.0.20 () {60 vars in 1180 bytes} [Thu Oct 27 03:29:43 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:29:44.539274 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e05413fd-0079-44ca-9382-f8e7049890a9 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:44.539274 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e05413fd-0079-44ca-9382-f8e7049890a9 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:44.544273 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e05413fd-0079-44ca-9382-f8e7049890a9 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:44.545288 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e05413fd-0079-44ca-9382-f8e7049890a9 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:44.546613 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e05413fd-0079-44ca-9382-f8e7049890a9 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:44.547782 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e05413fd-0079-44ca-9382-f8e7049890a9 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:44.549664 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e05413fd-0079-44ca-9382-f8e7049890a9 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:44.550842 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e05413fd-0079-44ca-9382-f8e7049890a9 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:44.692084 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-fd308c18-a9cf-4b9d-bfc6-840f79b6a5d8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:44.700456 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-fd308c18-a9cf-4b9d-bfc6-840f79b6a5d8 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34" status: 200 len: 1388 microversion: 2.1 time: 0.258532 Oct 27 03:29:44.710088 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1185/2318] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:44 2022] GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34 => generated 1388 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:44.710088 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-57da6603-5c3b-45c0-917c-45a500c3e18b tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Calling method '.version_select at 0x7f7ddb5db160>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:44.848149 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e05413fd-0079-44ca-9382-f8e7049890a9 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:44.858410 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e05413fd-0079-44ca-9382-f8e7049890a9 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c" status: 200 len: 1307 microversion: 2.1 time: 0.327253 Oct 27 03:29:44.878810 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1134/2319] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:44 2022] GET /compute/v2.1/servers/a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c => generated 1307 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:44.892184 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5a27b9f0-996c-4921-ab40-40abf31ac249 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:44.893571 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5a27b9f0-996c-4921-ab40-40abf31ac249 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:44.901930 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5a27b9f0-996c-4921-ab40-40abf31ac249 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:44.902836 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5a27b9f0-996c-4921-ab40-40abf31ac249 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:44.903511 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5a27b9f0-996c-4921-ab40-40abf31ac249 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:44.904811 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5a27b9f0-996c-4921-ab40-40abf31ac249 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:44.905650 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5a27b9f0-996c-4921-ab40-40abf31ac249 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:44.906322 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5a27b9f0-996c-4921-ab40-40abf31ac249 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:44.988068 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5a27b9f0-996c-4921-ab40-40abf31ac249 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:44.998592 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5a27b9f0-996c-4921-ab40-40abf31ac249 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1291 microversion: 2.1 time: 0.116513 Oct 27 03:29:45.017708 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1135/2320] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:44 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1291 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:45.099408 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-57da6603-5c3b-45c0-917c-45a500c3e18b tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups" status: 200 len: 1831 microversion: 2.1 time: 0.396293 Oct 27 03:29:45.100698 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1186/2321] 10.222.0.20 () {58 vars in 1158 bytes} [Thu Oct 27 03:29:44 2022] GET /compute/v2.1/os-security-groups => generated 1831 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:45.119805 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-579f5fd9-b175-4211-9c1c-5e52a4987c19 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Calling method '.version_select at 0x7f7ddae14700>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:45.125613 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-bd542438-3284-42eb-ade9-af1a6fb1e666 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:45.127036 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-bd542438-3284-42eb-ade9-af1a6fb1e666 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: 339287fc-37b6-455d-96ab-08ab8e2c3e68] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:45.134938 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bd542438-3284-42eb-ade9-af1a6fb1e666 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:45.135693 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bd542438-3284-42eb-ade9-af1a6fb1e666 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:45.136326 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bd542438-3284-42eb-ade9-af1a6fb1e666 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:45.137272 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bd542438-3284-42eb-ade9-af1a6fb1e666 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:45.137898 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bd542438-3284-42eb-ade9-af1a6fb1e666 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:45.138643 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bd542438-3284-42eb-ade9-af1a6fb1e666 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:45.394625 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-bd542438-3284-42eb-ade9-af1a6fb1e666 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13e05e253c94aadb1c089128ff35be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8510a519f14deea6f35a437419e161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:45.403079 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-bd542438-3284-42eb-ade9-af1a6fb1e666 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68" status: 200 len: 1472 microversion: 2.1 time: 0.281999 Oct 27 03:29:45.409983 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1187/2322] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:45 2022] GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68 => generated 1472 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:45.409983 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-86ab9db7-a003-4f28-955d-247d326300bf req-93b6fa00-a87f-49b7-8b0e-8501124738b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8925d29-d9e0-4dbb-a73d-09473255fa34", "name": "network-vif-deleted", "tag": "dfa74d77-ff34-4f03-a07f-cf59ea6cd793"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:29:45.418518 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-86ab9db7-a003-4f28-955d-247d326300bf req-93b6fa00-a87f-49b7-8b0e-8501124738b3 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:45.419021 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-86ab9db7-a003-4f28-955d-247d326300bf req-93b6fa00-a87f-49b7-8b0e-8501124738b3 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:45.419480 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-86ab9db7-a003-4f28-955d-247d326300bf req-93b6fa00-a87f-49b7-8b0e-8501124738b3 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:45.436354 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-86ab9db7-a003-4f28-955d-247d326300bf req-93b6fa00-a87f-49b7-8b0e-8501124738b3 service nova] Creating event network-vif-deleted:dfa74d77-ff34-4f03-a07f-cf59ea6cd793 for instance a8925d29-d9e0-4dbb-a73d-09473255fa34 on n-h2-862769-1 Oct 27 03:29:45.444135 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-86ab9db7-a003-4f28-955d-247d326300bf req-93b6fa00-a87f-49b7-8b0e-8501124738b3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039177 Oct 27 03:29:45.445261 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1188/2323] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:29:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:29:45.466619 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-fff081c6-e513-4330-b00d-8c890695fae5 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:45.467546 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-fff081c6-e513-4330-b00d-8c890695fae5 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: d5e6f604-9466-45c6-86a8-885cfb393223] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:45.478507 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fff081c6-e513-4330-b00d-8c890695fae5 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:45.479488 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fff081c6-e513-4330-b00d-8c890695fae5 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:45.479644 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fff081c6-e513-4330-b00d-8c890695fae5 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:45.480439 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fff081c6-e513-4330-b00d-8c890695fae5 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:45.480970 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fff081c6-e513-4330-b00d-8c890695fae5 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:45.481482 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fff081c6-e513-4330-b00d-8c890695fae5 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:45.694454 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-fff081c6-e513-4330-b00d-8c890695fae5 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:45.706922 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-fff081c6-e513-4330-b00d-8c890695fae5 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:45.710824 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-fff081c6-e513-4330-b00d-8c890695fae5 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:45.712355 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-fff081c6-e513-4330-b00d-8c890695fae5 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223" status: 200 len: 1487 microversion: 2.25 time: 0.251084 Oct 27 03:29:45.713550 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1189/2324] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:29:45 2022] GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223 => generated 1487 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:29:45.725468 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6bc4ad19-a53c-4488-80e2-f703a3389a4f tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:45.726117 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-6bc4ad19-a53c-4488-80e2-f703a3389a4f tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: a8925d29-d9e0-4dbb-a73d-09473255fa34] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:45.733703 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6bc4ad19-a53c-4488-80e2-f703a3389a4f tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:45.734275 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6bc4ad19-a53c-4488-80e2-f703a3389a4f tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:45.734970 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6bc4ad19-a53c-4488-80e2-f703a3389a4f tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:45.735710 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6bc4ad19-a53c-4488-80e2-f703a3389a4f tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:45.736486 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6bc4ad19-a53c-4488-80e2-f703a3389a4f tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:45.736974 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6bc4ad19-a53c-4488-80e2-f703a3389a4f tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:45.793156 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-579f5fd9-b175-4211-9c1c-5e52a4987c19 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/b483c715-7894-4fea-92c0-3f09c82e8bec" status: 202 len: 0 microversion: 2.1 time: 0.678771 Oct 27 03:29:45.793156 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1136/2325] 10.222.0.20 () {58 vars in 1272 bytes} [Thu Oct 27 03:29:45 2022] DELETE /compute/v2.1/os-security-groups/b483c715-7894-4fea-92c0-3f09c82e8bec => generated 0 bytes in 681 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:29:45.801522 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-941fa910-3ff2-4d18-bb4e-c0461d4ed44f tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Calling method '.version_select at 0x7f7ddabcf4c0>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:45.848711 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6bc4ad19-a53c-4488-80e2-f703a3389a4f tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:45.875337 n-d-862769-1 devstack@n-api.service[121000]: DEBUG neutronclient.v2_0.client [None req-941fa910-3ff2-4d18-bb4e-c0461d4ed44f tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b483c715-7894-4fea-92c0-3f09c82e8bec does not exist", "detail": ""}} {{(pid=121000) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 03:29:45.881541 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.security_group_api [None req-941fa910-3ff2-4d18-bb4e-c0461d4ed44f tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Neutron security group b483c715-7894-4fea-92c0-3f09c82e8bec not found {{(pid=121000) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 27 03:29:45.881541 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-941fa910-3ff2-4d18-bb4e-c0461d4ed44f tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] HTTP exception thrown: Security group b483c715-7894-4fea-92c0-3f09c82e8bec does not exist Oct 27 03:29:45.881541 n-d-862769-1 devstack@n-api.service[121000]: Neutron server returns request_ids: ['req-40be4dac-b611-4b7f-a728-3f8c1e93a063'] Oct 27 03:29:45.881541 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-941fa910-3ff2-4d18-bb4e-c0461d4ed44f tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Request method failure captured: Oct 27 03:29:45.881541 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/os-security-groups/b483c715-7894-4fea-92c0-3f09c82e8bec HTTP/1.1 Oct 27 03:29:45.881541 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:29:45.881541 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:29:45.881541 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:29:45.881541 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:29:45.881541 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:29:45.881541 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:29:45.881541 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:29:45.881541 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:29:45.881541 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfsDm0Py_zt25h362jzfO2BV3foI0uyhpjoORk0IBXpXJDIOp5L0sBs5ZGjH5wntvfF1YWko5rdp9M7xGcdJ8XvPLxOQRZn1LZea5O-2FHM2FJsNqsONwbzuZ-uFy7VwM4IakmeqODIMdeP73cGPmeJKxcyXnuTU87F5wWBu1IQyRCI Oct 27 03:29:45.881541 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:29:45.881541 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:29:45.881541 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:29:45.881541 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:29:45.881541 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:29:45.881541 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:29:45.881541 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 92082c8718aa41bf96cd84d682d75954 Oct 27 03:29:45.881541 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-SecurityGroupsTestJSON-1273178137 Oct 27 03:29:45.881541 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:29:45.881541 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:29:45.881541 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/92082c8718aa41bf96cd84d682d75954"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/92082c8718aa41bf96cd84d682d75954"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/92082c8718aa41bf96cd84d682d75954"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_92082c8718aa41bf96cd84d682d75954"}]}] Oct 27 03:29:45.881541 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-SecurityGroupsTestJSON-1273178137 Oct 27 03:29:45.881541 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 92082c8718aa41bf96cd84d682d75954 Oct 27 03:29:45.881541 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1273178137 Oct 27 03:29:45.881541 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-SecurityGroupsTestJSON-1273178137-project Oct 27 03:29:45.881541 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:29:45.881541 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:29:45.881541 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 421d14944da74570a53d620ea205449d Oct 27 03:29:45.881541 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-SecurityGroupsTestJSON-1273178137-project Oct 27 03:29:45.881541 n-d-862769-1 devstack@n-api.service[121000]: method: Oct 27 03:29:45.881541 n-d-862769-1 devstack@n-api.service[121000]: exception: Security group b483c715-7894-4fea-92c0-3f09c82e8bec does not exist Oct 27 03:29:45.881541 n-d-862769-1 devstack@n-api.service[121000]: Neutron server returns request_ids: ['req-40be4dac-b611-4b7f-a728-3f8c1e93a063'] Oct 27 03:29:45.881541 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': 'b483c715-7894-4fea-92c0-3f09c82e8bec'} Oct 27 03:29:45.881541 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:29:45.881541 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:29:45.881541 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 27 03:29:45.881541 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 27 03:29:45.881541 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:29:45.881541 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:29:45.881541 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 27 03:29:45.881541 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 27 03:29:45.881541 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:29:45.881541 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:29:45.881541 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 27 03:29:45.881541 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 27 03:29:45.881541 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:29:45.881541 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:29:45.881541 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 03:29:45.881541 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 03:29:45.881541 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:29:45.881541 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:29:45.881541 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 03:29:45.881541 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 03:29:45.881541 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:29:45.891448 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:29:45.891448 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 03:29:45.891448 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 03:29:45.891448 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 03:29:45.891448 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 03:29:45.891448 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b483c715-7894-4fea-92c0-3f09c82e8bec does not exist Oct 27 03:29:45.891448 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-40be4dac-b611-4b7f-a728-3f8c1e93a063'] Oct 27 03:29:45.891448 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:29:45.891448 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:29:45.891448 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:29:45.891448 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:29:45.891448 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 27 03:29:45.891448 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 27 03:29:45.891448 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 27 03:29:45.891448 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 27 03:29:45.891448 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b483c715-7894-4fea-92c0-3f09c82e8bec does not exist Oct 27 03:29:45.891448 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-40be4dac-b611-4b7f-a728-3f8c1e93a063'] Oct 27 03:29:45.891448 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:29:45.891448 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:29:45.891448 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:29:45.891448 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:29:45.891448 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:29:45.891448 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:29:45.891448 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:29:45.891448 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:29:45.891448 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:29:45.891448 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:29:45.891448 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:29:45.891448 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:29:45.891448 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 27 03:29:45.891448 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 27 03:29:45.891448 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b483c715-7894-4fea-92c0-3f09c82e8bec does not exist Oct 27 03:29:45.891448 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-40be4dac-b611-4b7f-a728-3f8c1e93a063'] Oct 27 03:29:45.891448 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:29:45.891448 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:29:45.891448 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:29:45.891448 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:29:45.891448 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:29:45.891448 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:29:45.891448 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:29:45.891448 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:29:45.891448 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b483c715-7894-4fea-92c0-3f09c82e8bec does not exist Oct 27 03:29:45.891448 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-40be4dac-b611-4b7f-a728-3f8c1e93a063'] Oct 27 03:29:45.891448 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:29:45.891448 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-941fa910-3ff2-4d18-bb4e-c0461d4ed44f tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Returning 404 to user: Security group b483c715-7894-4fea-92c0-3f09c82e8bec does not exist Oct 27 03:29:45.891448 n-d-862769-1 devstack@n-api.service[121000]: Neutron server returns request_ids: ['req-40be4dac-b611-4b7f-a728-3f8c1e93a063'] {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:29:45.891448 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-941fa910-3ff2-4d18-bb4e-c0461d4ed44f tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups/b483c715-7894-4fea-92c0-3f09c82e8bec" status: 404 len: 194 microversion: 2.1 time: 0.086835 Oct 27 03:29:45.891448 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1137/2326] 10.222.0.20 () {58 vars in 1269 bytes} [Thu Oct 27 03:29:45 2022] GET /compute/v2.1/os-security-groups/b483c715-7894-4fea-92c0-3f09c82e8bec => generated 194 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 03:29:45.915014 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4c266e97-4244-4185-bd64-36fc63b028a7 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:45.915204 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6bc4ad19-a53c-4488-80e2-f703a3389a4f tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34" status: 200 len: 1184 microversion: 2.1 time: 0.179090 Oct 27 03:29:45.915331 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4c266e97-4244-4185-bd64-36fc63b028a7 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:45.915443 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1190/2327] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:45 2022] GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34 => generated 1184 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:29:45.915554 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4c266e97-4244-4185-bd64-36fc63b028a7 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:45.915554 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4c266e97-4244-4185-bd64-36fc63b028a7 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:45.915554 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4c266e97-4244-4185-bd64-36fc63b028a7 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:45.915554 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4c266e97-4244-4185-bd64-36fc63b028a7 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:45.915554 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4c266e97-4244-4185-bd64-36fc63b028a7 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:45.915554 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4c266e97-4244-4185-bd64-36fc63b028a7 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:45.930175 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-48d778b7-668c-4cec-9164-2c414135e8ce tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Calling method '.version_select at 0x7f7dda0d61f0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:46.262386 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4c266e97-4244-4185-bd64-36fc63b028a7 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:46.271840 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4c266e97-4244-4185-bd64-36fc63b028a7 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c" status: 200 len: 1486 microversion: 2.1 time: 0.385999 Oct 27 03:29:46.271840 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1138/2328] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:45 2022] GET /compute/v2.1/servers/a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c => generated 1486 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:46.287432 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f94bb131-cb67-4311-8274-8d5eb476adb6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:46.288093 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f94bb131-cb67-4311-8274-8d5eb476adb6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:46.295587 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f94bb131-cb67-4311-8274-8d5eb476adb6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:46.304658 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f94bb131-cb67-4311-8274-8d5eb476adb6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:46.304658 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f94bb131-cb67-4311-8274-8d5eb476adb6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:46.304658 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f94bb131-cb67-4311-8274-8d5eb476adb6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:46.304658 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f94bb131-cb67-4311-8274-8d5eb476adb6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:46.304658 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f94bb131-cb67-4311-8274-8d5eb476adb6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:46.372309 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-48d778b7-668c-4cec-9164-2c414135e8ce tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/eb2271b0-0534-4d5d-a383-99722e76872c" status: 202 len: 0 microversion: 2.1 time: 0.454658 Oct 27 03:29:46.373318 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1191/2329] 10.222.0.20 () {58 vars in 1272 bytes} [Thu Oct 27 03:29:45 2022] DELETE /compute/v2.1/os-security-groups/eb2271b0-0534-4d5d-a383-99722e76872c => generated 0 bytes in 473 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:29:46.380976 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f94bb131-cb67-4311-8274-8d5eb476adb6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:46.384172 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-27bcf1f8-4f22-4436-bee4-843496563b77 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-346644726"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:29:46.391308 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:29:46.391668 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-27bcf1f8-4f22-4436-bee4-843496563b77 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:46.391996 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f94bb131-cb67-4311-8274-8d5eb476adb6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1309 microversion: 2.1 time: 0.110580 Oct 27 03:29:46.410199 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1139/2330] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:46 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1309 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:46.418367 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-27bcf1f8-4f22-4436-bee4-843496563b77 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:46.418905 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-27bcf1f8-4f22-4436-bee4-843496563b77 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:46.420747 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-27bcf1f8-4f22-4436-bee4-843496563b77 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:46.421899 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-27bcf1f8-4f22-4436-bee4-843496563b77 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:46.422708 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-27bcf1f8-4f22-4436-bee4-843496563b77 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:46.428545 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-27bcf1f8-4f22-4436-bee4-843496563b77 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:46.431413 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e7296fc0-656a-46a6-99c3-4ebd3473326e tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Calling method '.version_select at 0x7f7ddab9a550>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:46.547601 n-d-862769-1 devstack@n-api.service[121000]: DEBUG neutronclient.v2_0.client [None req-e7296fc0-656a-46a6-99c3-4ebd3473326e tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group eb2271b0-0534-4d5d-a383-99722e76872c does not exist", "detail": ""}} {{(pid=121000) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 03:29:46.548213 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.security_group_api [None req-e7296fc0-656a-46a6-99c3-4ebd3473326e tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Neutron security group eb2271b0-0534-4d5d-a383-99722e76872c not found {{(pid=121000) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 27 03:29:46.548739 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-e7296fc0-656a-46a6-99c3-4ebd3473326e tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] HTTP exception thrown: Security group eb2271b0-0534-4d5d-a383-99722e76872c does not exist Oct 27 03:29:46.548739 n-d-862769-1 devstack@n-api.service[121000]: Neutron server returns request_ids: ['req-e6028c0d-28b2-4200-add4-3d42c1e5042f'] Oct 27 03:29:46.550708 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e7296fc0-656a-46a6-99c3-4ebd3473326e tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Request method failure captured: Oct 27 03:29:46.550708 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/os-security-groups/eb2271b0-0534-4d5d-a383-99722e76872c HTTP/1.1 Oct 27 03:29:46.550708 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:29:46.550708 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:29:46.550708 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:29:46.550708 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:29:46.550708 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:29:46.550708 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:29:46.550708 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:29:46.550708 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:29:46.550708 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfsDm0Py_zt25h362jzfO2BV3foI0uyhpjoORk0IBXpXJDIOp5L0sBs5ZGjH5wntvfF1YWko5rdp9M7xGcdJ8XvPLxOQRZn1LZea5O-2FHM2FJsNqsONwbzuZ-uFy7VwM4IakmeqODIMdeP73cGPmeJKxcyXnuTU87F5wWBu1IQyRCI Oct 27 03:29:46.550708 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:29:46.550708 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:29:46.550708 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:29:46.550708 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:29:46.550708 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:29:46.550708 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:29:46.550708 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 92082c8718aa41bf96cd84d682d75954 Oct 27 03:29:46.550708 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-SecurityGroupsTestJSON-1273178137 Oct 27 03:29:46.550708 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:29:46.550708 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:29:46.550708 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/92082c8718aa41bf96cd84d682d75954"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/92082c8718aa41bf96cd84d682d75954"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/92082c8718aa41bf96cd84d682d75954"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_92082c8718aa41bf96cd84d682d75954"}]}] Oct 27 03:29:46.550708 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-SecurityGroupsTestJSON-1273178137 Oct 27 03:29:46.550708 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 92082c8718aa41bf96cd84d682d75954 Oct 27 03:29:46.550708 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1273178137 Oct 27 03:29:46.550708 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-SecurityGroupsTestJSON-1273178137-project Oct 27 03:29:46.550708 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:29:46.550708 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:29:46.550708 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 421d14944da74570a53d620ea205449d Oct 27 03:29:46.550708 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-SecurityGroupsTestJSON-1273178137-project Oct 27 03:29:46.550708 n-d-862769-1 devstack@n-api.service[121000]: method: Oct 27 03:29:46.550708 n-d-862769-1 devstack@n-api.service[121000]: exception: Security group eb2271b0-0534-4d5d-a383-99722e76872c does not exist Oct 27 03:29:46.550708 n-d-862769-1 devstack@n-api.service[121000]: Neutron server returns request_ids: ['req-e6028c0d-28b2-4200-add4-3d42c1e5042f'] Oct 27 03:29:46.550708 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': 'eb2271b0-0534-4d5d-a383-99722e76872c'} Oct 27 03:29:46.550708 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:29:46.550708 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:29:46.550708 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 27 03:29:46.550708 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 27 03:29:46.550708 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:29:46.550708 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:29:46.550708 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 27 03:29:46.550708 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 27 03:29:46.550708 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:29:46.550708 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:29:46.550708 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 27 03:29:46.550708 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 27 03:29:46.550708 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:29:46.550708 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:29:46.550708 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 03:29:46.550708 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 03:29:46.550708 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:29:46.550708 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:29:46.550708 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 03:29:46.550708 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 03:29:46.550708 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:29:46.550708 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:29:46.550708 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 03:29:46.550708 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 03:29:46.550708 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 03:29:46.550708 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 03:29:46.550708 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group eb2271b0-0534-4d5d-a383-99722e76872c does not exist Oct 27 03:29:46.561100 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e6028c0d-28b2-4200-add4-3d42c1e5042f'] Oct 27 03:29:46.561100 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:29:46.561100 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:29:46.561100 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:29:46.561100 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:29:46.561100 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 27 03:29:46.561100 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 27 03:29:46.561100 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 27 03:29:46.561100 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 27 03:29:46.561100 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group eb2271b0-0534-4d5d-a383-99722e76872c does not exist Oct 27 03:29:46.561100 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e6028c0d-28b2-4200-add4-3d42c1e5042f'] Oct 27 03:29:46.561100 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:29:46.561100 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:29:46.561100 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:29:46.561100 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:29:46.561100 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:29:46.561100 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:29:46.561100 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:29:46.561100 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:29:46.561100 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:29:46.561100 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:29:46.561100 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:29:46.561100 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:29:46.561100 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 27 03:29:46.561100 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 27 03:29:46.561100 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group eb2271b0-0534-4d5d-a383-99722e76872c does not exist Oct 27 03:29:46.561100 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e6028c0d-28b2-4200-add4-3d42c1e5042f'] Oct 27 03:29:46.561100 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:29:46.561100 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:29:46.561100 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:29:46.561100 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:29:46.561100 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:29:46.561100 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:29:46.561100 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:29:46.561100 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:29:46.561100 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group eb2271b0-0534-4d5d-a383-99722e76872c does not exist Oct 27 03:29:46.561100 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e6028c0d-28b2-4200-add4-3d42c1e5042f'] Oct 27 03:29:46.561100 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:29:46.573001 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e7296fc0-656a-46a6-99c3-4ebd3473326e tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Returning 404 to user: Security group eb2271b0-0534-4d5d-a383-99722e76872c does not exist Oct 27 03:29:46.573001 n-d-862769-1 devstack@n-api.service[121000]: Neutron server returns request_ids: ['req-e6028c0d-28b2-4200-add4-3d42c1e5042f'] {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:29:46.599850 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e7296fc0-656a-46a6-99c3-4ebd3473326e tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups/eb2271b0-0534-4d5d-a383-99722e76872c" status: 404 len: 194 microversion: 2.1 time: 0.163155 Oct 27 03:29:46.599850 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1140/2331] 10.222.0.20 () {58 vars in 1269 bytes} [Thu Oct 27 03:29:46 2022] GET /compute/v2.1/os-security-groups/eb2271b0-0534-4d5d-a383-99722e76872c => generated 194 bytes in 165 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:29:46.599850 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8ea5081a-8cfd-4af9-843c-16f18dfc20e2 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:46.599850 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8ea5081a-8cfd-4af9-843c-16f18dfc20e2 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: 339287fc-37b6-455d-96ab-08ab8e2c3e68] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:46.605375 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8ea5081a-8cfd-4af9-843c-16f18dfc20e2 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:46.606680 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8ea5081a-8cfd-4af9-843c-16f18dfc20e2 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:46.610449 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8ea5081a-8cfd-4af9-843c-16f18dfc20e2 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:46.613002 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8ea5081a-8cfd-4af9-843c-16f18dfc20e2 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:46.613568 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8ea5081a-8cfd-4af9-843c-16f18dfc20e2 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:46.614746 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8ea5081a-8cfd-4af9-843c-16f18dfc20e2 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:46.871362 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8ea5081a-8cfd-4af9-843c-16f18dfc20e2 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13e05e253c94aadb1c089128ff35be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8510a519f14deea6f35a437419e161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:46.880145 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8ea5081a-8cfd-4af9-843c-16f18dfc20e2 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68" status: 200 len: 1472 microversion: 2.1 time: 0.303145 Oct 27 03:29:46.881685 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1141/2332] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:46 2022] GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68 => generated 1472 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:46.889657 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a5df8ff6-d34e-41a8-90fa-84ae52b8d25f tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Calling method '.version_select at 0x7f7ddee4c160>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:47.337372 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-27bcf1f8-4f22-4436-bee4-843496563b77 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "POST /compute/v2.1/servers/a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c/action" status: 202 len: 0 microversion: 2.1 time: 0.961691 Oct 27 03:29:47.340609 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1192/2333] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:29:46 2022] POST /compute/v2.1/servers/a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c/action => generated 0 bytes in 966 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 27 03:29:47.347385 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ee20ce4f-e1c9-4e56-9286-9e10a7882b4f tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:47.349625 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ee20ce4f-e1c9-4e56-9286-9e10a7882b4f tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: d5e6f604-9466-45c6-86a8-885cfb393223] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:47.359960 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ee20ce4f-e1c9-4e56-9286-9e10a7882b4f tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:47.360895 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ee20ce4f-e1c9-4e56-9286-9e10a7882b4f tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:47.361790 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ee20ce4f-e1c9-4e56-9286-9e10a7882b4f tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:47.363882 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ee20ce4f-e1c9-4e56-9286-9e10a7882b4f tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:47.364687 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ee20ce4f-e1c9-4e56-9286-9e10a7882b4f tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:47.365534 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ee20ce4f-e1c9-4e56-9286-9e10a7882b4f tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:47.631590 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ee20ce4f-e1c9-4e56-9286-9e10a7882b4f tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:47.644978 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ee20ce4f-e1c9-4e56-9286-9e10a7882b4f tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:47.648300 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ee20ce4f-e1c9-4e56-9286-9e10a7882b4f tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:47.650164 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ee20ce4f-e1c9-4e56-9286-9e10a7882b4f tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223" status: 200 len: 1487 microversion: 2.25 time: 0.307799 Oct 27 03:29:47.651604 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1193/2334] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:29:47 2022] GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223 => generated 1487 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:29:47.656820 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-64296570-d0c5-4ede-8017-52799a1bdd47 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:47.658016 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-64296570-d0c5-4ede-8017-52799a1bdd47 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: a8925d29-d9e0-4dbb-a73d-09473255fa34] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:47.674107 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-64296570-d0c5-4ede-8017-52799a1bdd47 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:47.674973 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-64296570-d0c5-4ede-8017-52799a1bdd47 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:47.676151 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-64296570-d0c5-4ede-8017-52799a1bdd47 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:47.678343 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-64296570-d0c5-4ede-8017-52799a1bdd47 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:47.679892 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-64296570-d0c5-4ede-8017-52799a1bdd47 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:47.680860 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-64296570-d0c5-4ede-8017-52799a1bdd47 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:47.777287 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-64296570-d0c5-4ede-8017-52799a1bdd47 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:47.788285 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-64296570-d0c5-4ede-8017-52799a1bdd47 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34" status: 200 len: 1184 microversion: 2.1 time: 0.135360 Oct 27 03:29:47.790233 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1194/2335] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:47 2022] GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34 => generated 1184 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:47.795370 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a8ce857a-f8c0-4d8e-878b-6d8ac57c3dc0 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7dda0d6af0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:47.845064 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a8ce857a-f8c0-4d8e-878b-6d8ac57c3dc0 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/images/3c8ff4f0-cd8a-42f7-96ad-533eddceaec0" status: 200 len: 1413 microversion: 2.1 time: 0.053595 Oct 27 03:29:47.847912 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1195/2336] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:29:47 2022] GET /compute/v2.1/images/3c8ff4f0-cd8a-42f7-96ad-533eddceaec0 => generated 1413 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:47.852174 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f24a270d-8aaf-480f-86b2-74cb185bb6e4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:47.853011 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f24a270d-8aaf-480f-86b2-74cb185bb6e4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:47.859663 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f24a270d-8aaf-480f-86b2-74cb185bb6e4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:47.860165 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f24a270d-8aaf-480f-86b2-74cb185bb6e4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:47.860674 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f24a270d-8aaf-480f-86b2-74cb185bb6e4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:47.861451 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f24a270d-8aaf-480f-86b2-74cb185bb6e4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:47.861914 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f24a270d-8aaf-480f-86b2-74cb185bb6e4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:47.862440 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f24a270d-8aaf-480f-86b2-74cb185bb6e4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:47.882676 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a5df8ff6-d34e-41a8-90fa-84ae52b8d25f tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/a72e0c68-f0ae-44e7-9d88-e7d14a4148c4" status: 202 len: 0 microversion: 2.1 time: 0.998570 Oct 27 03:29:47.883270 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1142/2337] 10.222.0.20 () {58 vars in 1272 bytes} [Thu Oct 27 03:29:46 2022] DELETE /compute/v2.1/os-security-groups/a72e0c68-f0ae-44e7-9d88-e7d14a4148c4 => generated 0 bytes in 1000 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:29:47.888612 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5ff6f905-a8d1-42d9-b7fb-f20c5c27b63e tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7ddaac5700>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:47.984859 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5ff6f905-a8d1-42d9-b7fb-f20c5c27b63e tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/images/3c8ff4f0-cd8a-42f7-96ad-533eddceaec0" status: 200 len: 1413 microversion: 2.1 time: 0.100116 Oct 27 03:29:47.985753 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1143/2338] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:29:47 2022] GET /compute/v2.1/images/3c8ff4f0-cd8a-42f7-96ad-533eddceaec0 => generated 1413 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:47.994652 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-34c561b6-fa3e-4341-9029-89debcd8fab7 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Calling method '.version_select at 0x7f7ddab9a670>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:48.075885 n-d-862769-1 devstack@n-api.service[121000]: DEBUG neutronclient.v2_0.client [None req-34c561b6-fa3e-4341-9029-89debcd8fab7 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a72e0c68-f0ae-44e7-9d88-e7d14a4148c4 does not exist", "detail": ""}} {{(pid=121000) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 03:29:48.076765 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.security_group_api [None req-34c561b6-fa3e-4341-9029-89debcd8fab7 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Neutron security group a72e0c68-f0ae-44e7-9d88-e7d14a4148c4 not found {{(pid=121000) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 27 03:29:48.077700 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-34c561b6-fa3e-4341-9029-89debcd8fab7 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] HTTP exception thrown: Security group a72e0c68-f0ae-44e7-9d88-e7d14a4148c4 does not exist Oct 27 03:29:48.077700 n-d-862769-1 devstack@n-api.service[121000]: Neutron server returns request_ids: ['req-2cdb3ada-7f48-497a-b672-95dd0bba99fe'] Oct 27 03:29:48.080090 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-34c561b6-fa3e-4341-9029-89debcd8fab7 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Request method failure captured: Oct 27 03:29:48.080090 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/os-security-groups/a72e0c68-f0ae-44e7-9d88-e7d14a4148c4 HTTP/1.1 Oct 27 03:29:48.080090 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:29:48.080090 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:29:48.080090 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:29:48.080090 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:29:48.080090 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:29:48.080090 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:29:48.080090 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:29:48.080090 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:29:48.080090 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfsDm0Py_zt25h362jzfO2BV3foI0uyhpjoORk0IBXpXJDIOp5L0sBs5ZGjH5wntvfF1YWko5rdp9M7xGcdJ8XvPLxOQRZn1LZea5O-2FHM2FJsNqsONwbzuZ-uFy7VwM4IakmeqODIMdeP73cGPmeJKxcyXnuTU87F5wWBu1IQyRCI Oct 27 03:29:48.080090 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:29:48.080090 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:29:48.080090 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:29:48.080090 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:29:48.080090 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:29:48.080090 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:29:48.080090 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 92082c8718aa41bf96cd84d682d75954 Oct 27 03:29:48.080090 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-SecurityGroupsTestJSON-1273178137 Oct 27 03:29:48.080090 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:29:48.080090 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:29:48.080090 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/92082c8718aa41bf96cd84d682d75954"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/92082c8718aa41bf96cd84d682d75954"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/92082c8718aa41bf96cd84d682d75954"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_92082c8718aa41bf96cd84d682d75954"}]}] Oct 27 03:29:48.080090 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-SecurityGroupsTestJSON-1273178137 Oct 27 03:29:48.080090 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 92082c8718aa41bf96cd84d682d75954 Oct 27 03:29:48.080090 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1273178137 Oct 27 03:29:48.080090 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-SecurityGroupsTestJSON-1273178137-project Oct 27 03:29:48.080090 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:29:48.080090 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:29:48.080090 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 421d14944da74570a53d620ea205449d Oct 27 03:29:48.080090 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-SecurityGroupsTestJSON-1273178137-project Oct 27 03:29:48.080090 n-d-862769-1 devstack@n-api.service[121000]: method: Oct 27 03:29:48.080090 n-d-862769-1 devstack@n-api.service[121000]: exception: Security group a72e0c68-f0ae-44e7-9d88-e7d14a4148c4 does not exist Oct 27 03:29:48.080090 n-d-862769-1 devstack@n-api.service[121000]: Neutron server returns request_ids: ['req-2cdb3ada-7f48-497a-b672-95dd0bba99fe'] Oct 27 03:29:48.080090 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': 'a72e0c68-f0ae-44e7-9d88-e7d14a4148c4'} Oct 27 03:29:48.080090 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:29:48.080090 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:29:48.080090 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 27 03:29:48.080090 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 27 03:29:48.080090 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:29:48.080090 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:29:48.080090 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 27 03:29:48.080090 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 27 03:29:48.080090 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:29:48.080090 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:29:48.080090 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 27 03:29:48.080090 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 27 03:29:48.080090 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:29:48.080090 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:29:48.080090 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 03:29:48.080090 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 03:29:48.080090 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:29:48.080090 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:29:48.080090 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 03:29:48.080090 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 03:29:48.080090 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:29:48.080090 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:29:48.080090 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 03:29:48.080090 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 03:29:48.080090 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 03:29:48.080090 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 03:29:48.080090 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a72e0c68-f0ae-44e7-9d88-e7d14a4148c4 does not exist Oct 27 03:29:48.092274 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2cdb3ada-7f48-497a-b672-95dd0bba99fe'] Oct 27 03:29:48.092274 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:29:48.092274 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:29:48.092274 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:29:48.092274 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:29:48.092274 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 27 03:29:48.092274 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 27 03:29:48.092274 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 27 03:29:48.092274 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 27 03:29:48.092274 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a72e0c68-f0ae-44e7-9d88-e7d14a4148c4 does not exist Oct 27 03:29:48.092274 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2cdb3ada-7f48-497a-b672-95dd0bba99fe'] Oct 27 03:29:48.092274 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:29:48.092274 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:29:48.092274 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:29:48.092274 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:29:48.092274 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:29:48.092274 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:29:48.092274 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:29:48.092274 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:29:48.092274 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:29:48.092274 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:29:48.092274 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:29:48.092274 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:29:48.092274 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 27 03:29:48.092274 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 27 03:29:48.092274 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a72e0c68-f0ae-44e7-9d88-e7d14a4148c4 does not exist Oct 27 03:29:48.092274 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2cdb3ada-7f48-497a-b672-95dd0bba99fe'] Oct 27 03:29:48.092274 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:29:48.092274 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:29:48.092274 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:29:48.092274 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:29:48.092274 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:29:48.092274 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:29:48.092274 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:29:48.092274 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:29:48.092274 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a72e0c68-f0ae-44e7-9d88-e7d14a4148c4 does not exist Oct 27 03:29:48.092274 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2cdb3ada-7f48-497a-b672-95dd0bba99fe'] Oct 27 03:29:48.092274 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:29:48.092274 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-34c561b6-fa3e-4341-9029-89debcd8fab7 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Returning 404 to user: Security group a72e0c68-f0ae-44e7-9d88-e7d14a4148c4 does not exist Oct 27 03:29:48.092274 n-d-862769-1 devstack@n-api.service[121000]: Neutron server returns request_ids: ['req-2cdb3ada-7f48-497a-b672-95dd0bba99fe'] {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:29:48.092274 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-34c561b6-fa3e-4341-9029-89debcd8fab7 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups/a72e0c68-f0ae-44e7-9d88-e7d14a4148c4" status: 404 len: 194 microversion: 2.1 time: 0.091514 Oct 27 03:29:48.092274 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1144/2339] 10.222.0.20 () {58 vars in 1269 bytes} [Thu Oct 27 03:29:47 2022] GET /compute/v2.1/os-security-groups/a72e0c68-f0ae-44e7-9d88-e7d14a4148c4 => generated 194 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:29:48.101129 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1933a77f-2a3c-4f33-81ce-24c150b1556e tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:48.106078 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1933a77f-2a3c-4f33-81ce-24c150b1556e tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: 339287fc-37b6-455d-96ab-08ab8e2c3e68] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:48.121830 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1933a77f-2a3c-4f33-81ce-24c150b1556e tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:48.121830 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1933a77f-2a3c-4f33-81ce-24c150b1556e tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:48.124008 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1933a77f-2a3c-4f33-81ce-24c150b1556e tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:48.129185 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1933a77f-2a3c-4f33-81ce-24c150b1556e tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:48.130160 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1933a77f-2a3c-4f33-81ce-24c150b1556e tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:48.130784 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1933a77f-2a3c-4f33-81ce-24c150b1556e tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:48.421917 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f24a270d-8aaf-480f-86b2-74cb185bb6e4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:48.431871 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f24a270d-8aaf-480f-86b2-74cb185bb6e4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1365 microversion: 2.1 time: 0.584617 Oct 27 03:29:48.437603 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1196/2340] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:47 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1365 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:48.439278 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-912862ed-0558-46c1-aa0f-3bd3a4ef0107 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7dda0d6940>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:48.489775 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1933a77f-2a3c-4f33-81ce-24c150b1556e tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13e05e253c94aadb1c089128ff35be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8510a519f14deea6f35a437419e161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:48.507257 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1933a77f-2a3c-4f33-81ce-24c150b1556e tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68" status: 200 len: 1472 microversion: 2.1 time: 0.418484 Oct 27 03:29:48.512916 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1145/2341] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:48 2022] GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68 => generated 1472 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:48.527502 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-fd3ba919-111e-4126-8069-52f7e8a47eae tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Calling method '.version_select at 0x7f7ddab9a820>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:49.407901 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-fd3ba919-111e-4126-8069-52f7e8a47eae tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups" status: 200 len: 1155 microversion: 2.1 time: 0.465846 Oct 27 03:29:49.407901 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1146/2342] 10.222.0.20 () {58 vars in 1158 bytes} [Thu Oct 27 03:29:48 2022] GET /compute/v2.1/os-security-groups => generated 1155 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:49.407901 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5a6bd61a-3ba2-44f6-b9ce-ffd25c26a6f2 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:49.407901 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5a6bd61a-3ba2-44f6-b9ce-ffd25c26a6f2 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: d5e6f604-9466-45c6-86a8-885cfb393223] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:49.407901 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5a6bd61a-3ba2-44f6-b9ce-ffd25c26a6f2 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:49.407901 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5a6bd61a-3ba2-44f6-b9ce-ffd25c26a6f2 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:49.407901 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5a6bd61a-3ba2-44f6-b9ce-ffd25c26a6f2 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:49.407901 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5a6bd61a-3ba2-44f6-b9ce-ffd25c26a6f2 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:49.407901 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5a6bd61a-3ba2-44f6-b9ce-ffd25c26a6f2 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:49.407901 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5a6bd61a-3ba2-44f6-b9ce-ffd25c26a6f2 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:49.407901 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5a6bd61a-3ba2-44f6-b9ce-ffd25c26a6f2 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:49.407901 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5a6bd61a-3ba2-44f6-b9ce-ffd25c26a6f2 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:49.412252 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5a6bd61a-3ba2-44f6-b9ce-ffd25c26a6f2 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:49.412252 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5a6bd61a-3ba2-44f6-b9ce-ffd25c26a6f2 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223" status: 200 len: 1487 microversion: 2.25 time: 0.268063 Oct 27 03:29:49.412252 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1147/2343] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:29:48 2022] GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223 => generated 1487 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:29:49.412252 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-73576ee3-bfc2-4f3b-802b-b4a87ba8a277 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:49.412252 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-73576ee3-bfc2-4f3b-802b-b4a87ba8a277 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: a8925d29-d9e0-4dbb-a73d-09473255fa34] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:49.412252 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-73576ee3-bfc2-4f3b-802b-b4a87ba8a277 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:49.412252 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-73576ee3-bfc2-4f3b-802b-b4a87ba8a277 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:49.412252 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-73576ee3-bfc2-4f3b-802b-b4a87ba8a277 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:49.412252 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-73576ee3-bfc2-4f3b-802b-b4a87ba8a277 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:49.412252 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-73576ee3-bfc2-4f3b-802b-b4a87ba8a277 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:49.412252 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-73576ee3-bfc2-4f3b-802b-b4a87ba8a277 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:49.412252 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-73576ee3-bfc2-4f3b-802b-b4a87ba8a277 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:49.414457 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-73576ee3-bfc2-4f3b-802b-b4a87ba8a277 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34" status: 200 len: 1184 microversion: 2.1 time: 0.094464 Oct 27 03:29:49.414457 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1148/2344] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:49 2022] GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34 => generated 1184 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:49.414457 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ed8be1ba-d78f-4812-962c-bce457a58548 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Action: 'create', calling method: .version_select at 0x7f7ddb002a60>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1463773905", "description": "tempest-description-932195488"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:29:49.414644 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-912862ed-0558-46c1-aa0f-3bd3a4ef0107 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "DELETE /compute/v2.1/images/3c8ff4f0-cd8a-42f7-96ad-533eddceaec0" status: 204 len: 0 microversion: 2.1 time: 0.946105 Oct 27 03:29:49.414644 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1197/2345] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:48 2022] DELETE /compute/v2.1/images/3c8ff4f0-cd8a-42f7-96ad-533eddceaec0 => generated 0 bytes in 948 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:29:49.414644 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8b768572-47a4-4d28-818e-e32b88836b08 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7dda05d310>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:49.416803 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-8b768572-47a4-4d28-818e-e32b88836b08 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] HTTP exception thrown: Image not found. Oct 27 03:29:49.422122 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8b768572-47a4-4d28-818e-e32b88836b08 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Request method failure captured: Oct 27 03:29:49.422122 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/images/3c8ff4f0-cd8a-42f7-96ad-533eddceaec0 HTTP/1.1 Oct 27 03:29:49.422122 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:29:49.422122 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:29:49.422122 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:29:49.422122 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:29:49.422122 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:29:49.422122 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:29:49.422122 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:29:49.422122 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:29:49.422122 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfnAX64GvSXX6j_FGiQQ9IlgyuvfbWxRMGJCqIz8aEuYqDW4EVaQTS_nCBHKSQ3Z4oltdJGbrb3LkQtsJQ-KBbiFsQn0s9yf9n4GDuUzW48O2MfgGJVpAyAl-5qhe5w5ten3MUUxjRyCo9okwgZpH2TZ6ggq8P48i5NICoqXVcmLAEk Oct 27 03:29:49.422122 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:29:49.422122 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:29:49.422122 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:29:49.422122 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:29:49.422122 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:29:49.422122 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:29:49.422122 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: ae78c307a1504172828e668f915a3677 Oct 27 03:29:49.422122 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ImagesTestJSON-2119984465 Oct 27 03:29:49.422122 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:29:49.422122 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:29:49.422122 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ae78c307a1504172828e668f915a3677"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ae78c307a1504172828e668f915a3677"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ae78c307a1504172828e668f915a3677"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ae78c307a1504172828e668f915a3677"}]}] Oct 27 03:29:49.422122 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ImagesTestJSON-2119984465 Oct 27 03:29:49.422122 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: ae78c307a1504172828e668f915a3677 Oct 27 03:29:49.422122 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ImagesTestJSON-2119984465 Oct 27 03:29:49.422122 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ImagesTestJSON-2119984465-project Oct 27 03:29:49.422122 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:29:49.422122 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:29:49.422122 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 1d6175f2ac39494f8cba3db225150d6c Oct 27 03:29:49.422122 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ImagesTestJSON-2119984465-project Oct 27 03:29:49.422122 n-d-862769-1 devstack@n-api.service[121001]: method: Oct 27 03:29:49.422122 n-d-862769-1 devstack@n-api.service[121001]: exception: Image not found. Oct 27 03:29:49.422122 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '3c8ff4f0-cd8a-42f7-96ad-533eddceaec0'} Oct 27 03:29:49.422122 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:29:49.422122 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:29:49.422122 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 27 03:29:49.422122 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 27 03:29:49.422122 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 03:29:49.422122 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 03:29:49.422122 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 27 03:29:49.422122 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 27 03:29:49.422122 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 03:29:49.422122 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 03:29:49.422122 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 27 03:29:49.422122 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 27 03:29:49.422122 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 27 03:29:49.422122 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 27 03:29:49.422122 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 03:29:49.422122 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 03:29:49.422122 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 03:29:49.422122 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 03:29:49.422122 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 3c8ff4f0-cd8a-42f7-96ad-533eddceaec0 Oct 27 03:29:49.422122 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:29:49.422122 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:29:49.422122 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:29:49.422122 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:29:49.422122 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 27 03:29:49.422122 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 27 03:29:49.422122 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 27 03:29:49.422122 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 27 03:29:49.422122 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 27 03:29:49.422122 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 27 03:29:49.422122 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 27 03:29:49.422122 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 27 03:29:49.428297 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 27 03:29:49.428297 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 27 03:29:49.428297 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 03:29:49.428297 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 03:29:49.428297 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 27 03:29:49.428297 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 27 03:29:49.428297 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 03:29:49.428297 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 03:29:49.428297 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 27 03:29:49.428297 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 27 03:29:49.428297 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 27 03:29:49.428297 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 27 03:29:49.428297 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 03:29:49.428297 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 03:29:49.428297 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 03:29:49.428297 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 03:29:49.428297 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3c8ff4f0-cd8a-42f7-96ad-533eddceaec0 could not be found. Oct 27 03:29:49.428297 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:29:49.428297 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:29:49.428297 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:29:49.428297 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:29:49.428297 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:29:49.428297 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:29:49.428297 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:29:49.428297 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:29:49.428297 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:29:49.428297 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:29:49.428297 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:29:49.428297 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:29:49.428297 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 27 03:29:49.428297 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 27 03:29:49.428297 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 27 03:29:49.428297 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:29:49.428297 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:29:49.428297 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:29:49.428297 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:29:49.428297 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:29:49.428297 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:29:49.428297 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:29:49.428297 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:29:49.428297 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 27 03:29:49.428297 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:29:49.428297 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8b768572-47a4-4d28-818e-e32b88836b08 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Returning 404 to user: Image not found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:29:49.428297 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8b768572-47a4-4d28-818e-e32b88836b08 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/images/3c8ff4f0-cd8a-42f7-96ad-533eddceaec0" status: 404 len: 62 microversion: 2.1 time: 0.038354 Oct 27 03:29:49.428297 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1198/2346] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:29:49 2022] GET /compute/v2.1/images/3c8ff4f0-cd8a-42f7-96ad-533eddceaec0 => generated 62 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 03:29:49.434787 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e64ae7e8-0248-4e29-b70f-62d36257c861 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:49.434787 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e64ae7e8-0248-4e29-b70f-62d36257c861 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:49.440537 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e64ae7e8-0248-4e29-b70f-62d36257c861 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:49.441717 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e64ae7e8-0248-4e29-b70f-62d36257c861 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:49.442384 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e64ae7e8-0248-4e29-b70f-62d36257c861 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:49.443302 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e64ae7e8-0248-4e29-b70f-62d36257c861 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:49.444077 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e64ae7e8-0248-4e29-b70f-62d36257c861 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:49.444942 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e64ae7e8-0248-4e29-b70f-62d36257c861 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:49.614746 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e64ae7e8-0248-4e29-b70f-62d36257c861 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:49.636380 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e64ae7e8-0248-4e29-b70f-62d36257c861 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c" status: 200 len: 1504 microversion: 2.1 time: 0.205905 Oct 27 03:29:49.637911 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1199/2347] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:49 2022] GET /compute/v2.1/servers/a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c => generated 1504 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:49.645918 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-557cddbc-d905-432d-b19a-544f683d1385 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:49.646852 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-557cddbc-d905-432d-b19a-544f683d1385 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:49.656031 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-557cddbc-d905-432d-b19a-544f683d1385 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:49.656827 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-557cddbc-d905-432d-b19a-544f683d1385 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:49.658000 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-557cddbc-d905-432d-b19a-544f683d1385 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:49.660983 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-557cddbc-d905-432d-b19a-544f683d1385 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:49.661465 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-557cddbc-d905-432d-b19a-544f683d1385 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:49.661907 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-557cddbc-d905-432d-b19a-544f683d1385 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:49.887937 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-557cddbc-d905-432d-b19a-544f683d1385 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:49.911972 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-557cddbc-d905-432d-b19a-544f683d1385 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1365 microversion: 2.1 time: 0.271389 Oct 27 03:29:49.913214 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1200/2348] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:49 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1365 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:49.941242 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-50ada868-23b1-46bc-83b0-c4d5f2385dbf tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:49.942122 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-50ada868-23b1-46bc-83b0-c4d5f2385dbf tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: 339287fc-37b6-455d-96ab-08ab8e2c3e68] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:49.969208 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-50ada868-23b1-46bc-83b0-c4d5f2385dbf tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:49.971556 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-50ada868-23b1-46bc-83b0-c4d5f2385dbf tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:49.972057 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-50ada868-23b1-46bc-83b0-c4d5f2385dbf tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:49.978946 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-50ada868-23b1-46bc-83b0-c4d5f2385dbf tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:49.979571 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-50ada868-23b1-46bc-83b0-c4d5f2385dbf tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:49.981088 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-50ada868-23b1-46bc-83b0-c4d5f2385dbf tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:49.994511 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:29:50.203406 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ed8be1ba-d78f-4812-962c-bce457a58548 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.854401 Oct 27 03:29:50.204552 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1149/2349] 10.222.0.20 () {60 vars in 1180 bytes} [Thu Oct 27 03:29:49 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:29:50.210082 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-578a2dd5-0917-46fa-89bd-5b532f14e840 req-27d1b354-4480-4936-ba7c-033f4dcb3b7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed74f42b-af82-4808-bfc2-86110840fe86", "tag": "05464839-777e-4176-af2d-6086d6f9acaa"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:29:50.232108 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-578a2dd5-0917-46fa-89bd-5b532f14e840 req-27d1b354-4480-4936-ba7c-033f4dcb3b7c service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:50.235735 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-578a2dd5-0917-46fa-89bd-5b532f14e840 req-27d1b354-4480-4936-ba7c-033f4dcb3b7c service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:50.236354 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-578a2dd5-0917-46fa-89bd-5b532f14e840 req-27d1b354-4480-4936-ba7c-033f4dcb3b7c service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:50.263729 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-578a2dd5-0917-46fa-89bd-5b532f14e840 req-27d1b354-4480-4936-ba7c-033f4dcb3b7c service nova] Creating event network-changed:05464839-777e-4176-af2d-6086d6f9acaa for instance ed74f42b-af82-4808-bfc2-86110840fe86 on n-h1-862769-1 Oct 27 03:29:50.280678 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-578a2dd5-0917-46fa-89bd-5b532f14e840 req-27d1b354-4480-4936-ba7c-033f4dcb3b7c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074299 Oct 27 03:29:50.281802 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1150/2350] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:29:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:29:50.296296 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-72e4372c-5c0e-43b7-b979-5ac6f20320db tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Action: 'create', calling method: .version_select at 0x7f7ddaa919d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-319375254", "description": "tempest-description-505240085"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:29:50.322146 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-50ada868-23b1-46bc-83b0-c4d5f2385dbf tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13e05e253c94aadb1c089128ff35be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8510a519f14deea6f35a437419e161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:50.329724 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-50ada868-23b1-46bc-83b0-c4d5f2385dbf tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68" status: 200 len: 1472 microversion: 2.1 time: 0.414529 Oct 27 03:29:50.330367 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1201/2351] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:49 2022] GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68 => generated 1472 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:50.359646 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a962c6ce-d99c-4f27-b3a0-e8461cf940bd tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:50.360228 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a962c6ce-d99c-4f27-b3a0-e8461cf940bd tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: d5e6f604-9466-45c6-86a8-885cfb393223] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:50.371689 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a962c6ce-d99c-4f27-b3a0-e8461cf940bd tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:50.372140 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a962c6ce-d99c-4f27-b3a0-e8461cf940bd tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:50.377412 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a962c6ce-d99c-4f27-b3a0-e8461cf940bd tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:50.382189 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a962c6ce-d99c-4f27-b3a0-e8461cf940bd tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:50.383203 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a962c6ce-d99c-4f27-b3a0-e8461cf940bd tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:50.383927 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a962c6ce-d99c-4f27-b3a0-e8461cf940bd tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:50.689734 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a962c6ce-d99c-4f27-b3a0-e8461cf940bd tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:50.700259 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a962c6ce-d99c-4f27-b3a0-e8461cf940bd tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:50.702092 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a962c6ce-d99c-4f27-b3a0-e8461cf940bd tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:50.704267 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a962c6ce-d99c-4f27-b3a0-e8461cf940bd tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223" status: 200 len: 1487 microversion: 2.25 time: 0.355624 Oct 27 03:29:50.705008 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1202/2352] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:29:50 2022] GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223 => generated 1487 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:29:50.724697 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6ba9d628-f1f1-4f25-8b2a-d6b80193c521 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:50.725545 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-6ba9d628-f1f1-4f25-8b2a-d6b80193c521 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: a8925d29-d9e0-4dbb-a73d-09473255fa34] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:50.732506 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6ba9d628-f1f1-4f25-8b2a-d6b80193c521 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:50.733017 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6ba9d628-f1f1-4f25-8b2a-d6b80193c521 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:50.733508 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6ba9d628-f1f1-4f25-8b2a-d6b80193c521 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:50.734559 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6ba9d628-f1f1-4f25-8b2a-d6b80193c521 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:50.735116 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6ba9d628-f1f1-4f25-8b2a-d6b80193c521 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:50.735460 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6ba9d628-f1f1-4f25-8b2a-d6b80193c521 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:50.806925 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6ba9d628-f1f1-4f25-8b2a-d6b80193c521 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:50.814828 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6ba9d628-f1f1-4f25-8b2a-d6b80193c521 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34" status: 200 len: 1184 microversion: 2.1 time: 0.108635 Oct 27 03:29:50.815419 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1203/2353] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:50 2022] GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34 => generated 1184 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:50.819847 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f4e892e2-a329-4ec1-a361-726cb348f652 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:50.820459 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f4e892e2-a329-4ec1-a361-726cb348f652 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:50.826668 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f4e892e2-a329-4ec1-a361-726cb348f652 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:50.827186 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f4e892e2-a329-4ec1-a361-726cb348f652 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:50.827626 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f4e892e2-a329-4ec1-a361-726cb348f652 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:50.828318 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f4e892e2-a329-4ec1-a361-726cb348f652 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:50.828772 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f4e892e2-a329-4ec1-a361-726cb348f652 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:50.829198 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f4e892e2-a329-4ec1-a361-726cb348f652 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:50.978556 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f4e892e2-a329-4ec1-a361-726cb348f652 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:50.986168 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f4e892e2-a329-4ec1-a361-726cb348f652 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c" status: 200 len: 1504 microversion: 2.1 time: 0.169754 Oct 27 03:29:50.986741 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1204/2354] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:50 2022] GET /compute/v2.1/servers/a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c => generated 1504 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:50.991274 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d87cbf94-7359-420d-a80e-94cdd86229cc tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:50.991888 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d87cbf94-7359-420d-a80e-94cdd86229cc tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:50.997592 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d87cbf94-7359-420d-a80e-94cdd86229cc tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:50.998298 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d87cbf94-7359-420d-a80e-94cdd86229cc tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:50.998817 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d87cbf94-7359-420d-a80e-94cdd86229cc tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:50.999582 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d87cbf94-7359-420d-a80e-94cdd86229cc tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:51.000132 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d87cbf94-7359-420d-a80e-94cdd86229cc tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:51.000629 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d87cbf94-7359-420d-a80e-94cdd86229cc tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:51.060858 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:29:51.142492 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d87cbf94-7359-420d-a80e-94cdd86229cc tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:51.150354 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d87cbf94-7359-420d-a80e-94cdd86229cc tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1365 microversion: 2.1 time: 0.162620 Oct 27 03:29:51.150991 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1205/2355] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:50 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:51.356368 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f17b9d29-bc88-434b-85d8-6bdf846bba19 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:51.356993 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f17b9d29-bc88-434b-85d8-6bdf846bba19 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: 339287fc-37b6-455d-96ab-08ab8e2c3e68] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:51.359328 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:29:51.364956 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f17b9d29-bc88-434b-85d8-6bdf846bba19 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:51.365449 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f17b9d29-bc88-434b-85d8-6bdf846bba19 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:51.365902 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f17b9d29-bc88-434b-85d8-6bdf846bba19 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:51.366715 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f17b9d29-bc88-434b-85d8-6bdf846bba19 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:51.367182 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f17b9d29-bc88-434b-85d8-6bdf846bba19 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:51.367621 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f17b9d29-bc88-434b-85d8-6bdf846bba19 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:51.525988 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f17b9d29-bc88-434b-85d8-6bdf846bba19 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13e05e253c94aadb1c089128ff35be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8510a519f14deea6f35a437419e161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:51.535573 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f17b9d29-bc88-434b-85d8-6bdf846bba19 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68" status: 200 len: 1478 microversion: 2.1 time: 0.183222 Oct 27 03:29:51.536475 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1206/2356] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:51 2022] GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68 => generated 1478 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:29:51.604130 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-72e4372c-5c0e-43b7-b979-5ac6f20320db tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 1.318876 Oct 27 03:29:51.605390 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1151/2357] 10.222.0.20 () {60 vars in 1180 bytes} [Thu Oct 27 03:29:50 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:29:51.738471 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8ed09166-61d7-4e3c-a9af-dad1c663850b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:51.739308 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f223a86a-b92a-455a-bc58-fa8f62cf79b8 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1706464808", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": [{"uuid": "3fe4cef0-61ff-437b-9e39-483c02f13c8a"}]}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:29:51.741381 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8ed09166-61d7-4e3c-a9af-dad1c663850b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: d5e6f604-9466-45c6-86a8-885cfb393223] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:51.756896 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8ed09166-61d7-4e3c-a9af-dad1c663850b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:51.757533 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8ed09166-61d7-4e3c-a9af-dad1c663850b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:51.757979 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8ed09166-61d7-4e3c-a9af-dad1c663850b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:51.761941 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8ed09166-61d7-4e3c-a9af-dad1c663850b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:51.762662 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8ed09166-61d7-4e3c-a9af-dad1c663850b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:51.763303 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8ed09166-61d7-4e3c-a9af-dad1c663850b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:51.842112 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-f223a86a-b92a-455a-bc58-fa8f62cf79b8 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] validate_networks() for [('3fe4cef0-61ff-437b-9e39-483c02f13c8a', None, None, None, None, None)] {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:29:51.927214 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=8 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:29:52.140845 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8ed09166-61d7-4e3c-a9af-dad1c663850b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:52.156528 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8ed09166-61d7-4e3c-a9af-dad1c663850b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:52.159020 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8ed09166-61d7-4e3c-a9af-dad1c663850b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:52.162164 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8ed09166-61d7-4e3c-a9af-dad1c663850b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223" status: 200 len: 1487 microversion: 2.25 time: 0.432727 Oct 27 03:29:52.166166 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1207/2358] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:29:51 2022] GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223 => generated 1487 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:29:52.177247 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-338131c9-47ea-4907-8fa6-d7788c97f1cd tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:52.181212 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-338131c9-47ea-4907-8fa6-d7788c97f1cd tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: a8925d29-d9e0-4dbb-a73d-09473255fa34] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:52.197440 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-338131c9-47ea-4907-8fa6-d7788c97f1cd tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:52.198488 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-338131c9-47ea-4907-8fa6-d7788c97f1cd tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:52.199242 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-338131c9-47ea-4907-8fa6-d7788c97f1cd tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:52.200242 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-338131c9-47ea-4907-8fa6-d7788c97f1cd tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:52.200924 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-338131c9-47ea-4907-8fa6-d7788c97f1cd tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:52.201708 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-338131c9-47ea-4907-8fa6-d7788c97f1cd tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:52.447454 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-f223a86a-b92a-455a-bc58-fa8f62cf79b8 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:29:52.447960 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-f223a86a-b92a-455a-bc58-fa8f62cf79b8 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:29:52.448675 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-f223a86a-b92a-455a-bc58-fa8f62cf79b8 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:29:52.449104 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-f223a86a-b92a-455a-bc58-fa8f62cf79b8 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:29:52.449607 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-f223a86a-b92a-455a-bc58-fa8f62cf79b8 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:29:52.462518 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-338131c9-47ea-4907-8fa6-d7788c97f1cd tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:52.464393 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f223a86a-b92a-455a-bc58-fa8f62cf79b8 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:52.465525 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f223a86a-b92a-455a-bc58-fa8f62cf79b8 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:52.466205 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f223a86a-b92a-455a-bc58-fa8f62cf79b8 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:52.467655 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f223a86a-b92a-455a-bc58-fa8f62cf79b8 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:52.468644 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f223a86a-b92a-455a-bc58-fa8f62cf79b8 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:52.469306 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f223a86a-b92a-455a-bc58-fa8f62cf79b8 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:52.473874 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-338131c9-47ea-4907-8fa6-d7788c97f1cd tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34" status: 200 len: 1184 microversion: 2.1 time: 0.305924 Oct 27 03:29:52.490731 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1208/2359] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:52 2022] GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34 => generated 1184 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:52.490731 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8111e1c7-15a8-4b7d-b5df-95ab014afeb7 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:52.490731 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8111e1c7-15a8-4b7d-b5df-95ab014afeb7 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:52.490731 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8111e1c7-15a8-4b7d-b5df-95ab014afeb7 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:52.490731 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8111e1c7-15a8-4b7d-b5df-95ab014afeb7 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:52.491556 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8111e1c7-15a8-4b7d-b5df-95ab014afeb7 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:52.492644 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8111e1c7-15a8-4b7d-b5df-95ab014afeb7 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:52.493385 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8111e1c7-15a8-4b7d-b5df-95ab014afeb7 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:52.493931 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8111e1c7-15a8-4b7d-b5df-95ab014afeb7 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:52.514698 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-f223a86a-b92a-455a-bc58-fa8f62cf79b8 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Getting quotas for project 92082c8718aa41bf96cd84d682d75954. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:29:52.521744 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-f223a86a-b92a-455a-bc58-fa8f62cf79b8 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Getting quotas for user 421d14944da74570a53d620ea205449d and project 92082c8718aa41bf96cd84d682d75954. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:29:52.539449 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f223a86a-b92a-455a-bc58-fa8f62cf79b8 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:29:52.543033 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f223a86a-b92a-455a-bc58-fa8f62cf79b8 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] [instance: 04477d51-f600-483a-aec9-feb992cc6cf7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:29:52.614482 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:29:52.776509 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f223a86a-b92a-455a-bc58-fa8f62cf79b8 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.047121 Oct 27 03:29:52.792467 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1152/2360] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:29:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1064 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 03:29:52.806002 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-270601e8-226d-4ca6-b215-588dd75d6096 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:52.806930 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-270601e8-226d-4ca6-b215-588dd75d6096 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:52.821292 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-270601e8-226d-4ca6-b215-588dd75d6096 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:52.823805 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-270601e8-226d-4ca6-b215-588dd75d6096 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:52.825071 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-270601e8-226d-4ca6-b215-588dd75d6096 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:52.830270 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-270601e8-226d-4ca6-b215-588dd75d6096 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:52.830925 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-270601e8-226d-4ca6-b215-588dd75d6096 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:52.831540 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-270601e8-226d-4ca6-b215-588dd75d6096 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:53.185743 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8111e1c7-15a8-4b7d-b5df-95ab014afeb7 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:53.204996 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8111e1c7-15a8-4b7d-b5df-95ab014afeb7 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c" status: 200 len: 1504 microversion: 2.1 time: 0.727082 Oct 27 03:29:53.212682 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1209/2361] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:52 2022] GET /compute/v2.1/servers/a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c => generated 1504 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:53.217679 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-101f3610-849e-4bee-8595-8d02fe674ed8 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:53.218407 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-101f3610-849e-4bee-8595-8d02fe674ed8 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: 339287fc-37b6-455d-96ab-08ab8e2c3e68] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:53.222456 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-270601e8-226d-4ca6-b215-588dd75d6096 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:53.239795 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-270601e8-226d-4ca6-b215-588dd75d6096 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1365 microversion: 2.1 time: 0.444645 Oct 27 03:29:53.241908 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1153/2362] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:52 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1365 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:53.245662 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-101f3610-849e-4bee-8595-8d02fe674ed8 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:53.246448 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-101f3610-849e-4bee-8595-8d02fe674ed8 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:53.247127 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-101f3610-849e-4bee-8595-8d02fe674ed8 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:53.248751 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-101f3610-849e-4bee-8595-8d02fe674ed8 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:53.249501 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-101f3610-849e-4bee-8595-8d02fe674ed8 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:53.250634 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-101f3610-849e-4bee-8595-8d02fe674ed8 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:53.261637 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-6add00db-2a44-451f-a0b4-3c0e4e4db027 req-f14932fa-0622-443c-b861-aecfb2389fc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c", "name": "network-vif-plugged", "status": "completed", "tag": "f54df010-fe0a-4c01-88de-96c0e83bfd34"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:29:53.295339 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-6add00db-2a44-451f-a0b4-3c0e4e4db027 req-f14932fa-0622-443c-b861-aecfb2389fc2 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:53.299213 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-6add00db-2a44-451f-a0b4-3c0e4e4db027 req-f14932fa-0622-443c-b861-aecfb2389fc2 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:53.299885 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-6add00db-2a44-451f-a0b4-3c0e4e4db027 req-f14932fa-0622-443c-b861-aecfb2389fc2 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:53.347727 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-6add00db-2a44-451f-a0b4-3c0e4e4db027 req-f14932fa-0622-443c-b861-aecfb2389fc2 service nova] Creating event network-vif-plugged:f54df010-fe0a-4c01-88de-96c0e83bfd34 for instance a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c on n-h2-862769-1 Oct 27 03:29:53.354088 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-6add00db-2a44-451f-a0b4-3c0e4e4db027 req-f14932fa-0622-443c-b861-aecfb2389fc2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110626 Oct 27 03:29:53.356407 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1154/2363] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:29:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:29:53.362885 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-13806739-18c8-4b81-8c3f-dc05386d115d tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:53.363895 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-13806739-18c8-4b81-8c3f-dc05386d115d tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] [instance: 04477d51-f600-483a-aec9-feb992cc6cf7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:53.445861 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-13806739-18c8-4b81-8c3f-dc05386d115d tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421d14944da74570a53d620ea205449d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92082c8718aa41bf96cd84d682d75954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:53.464242 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-13806739-18c8-4b81-8c3f-dc05386d115d tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] 10.222.0.20 "GET /compute/v2.1/servers/04477d51-f600-483a-aec9-feb992cc6cf7" status: 200 len: 1216 microversion: 2.1 time: 0.100850 Oct 27 03:29:53.470923 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1155/2364] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:53 2022] GET /compute/v2.1/servers/04477d51-f600-483a-aec9-feb992cc6cf7 => generated 1216 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:53.480360 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7989c942-aed4-449e-8507-e19e88990f93 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:53.487726 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7989c942-aed4-449e-8507-e19e88990f93 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: d5e6f604-9466-45c6-86a8-885cfb393223] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:53.504546 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7989c942-aed4-449e-8507-e19e88990f93 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:53.507470 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7989c942-aed4-449e-8507-e19e88990f93 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:53.508136 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7989c942-aed4-449e-8507-e19e88990f93 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:53.511418 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7989c942-aed4-449e-8507-e19e88990f93 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:53.512259 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7989c942-aed4-449e-8507-e19e88990f93 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:53.512840 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7989c942-aed4-449e-8507-e19e88990f93 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:53.963020 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-101f3610-849e-4bee-8595-8d02fe674ed8 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13e05e253c94aadb1c089128ff35be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8510a519f14deea6f35a437419e161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:53.977640 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-101f3610-849e-4bee-8595-8d02fe674ed8 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68" status: 200 len: 1478 microversion: 2.1 time: 0.758655 Oct 27 03:29:53.978439 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1210/2365] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:53 2022] GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68 => generated 1478 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:53.981816 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7989c942-aed4-449e-8507-e19e88990f93 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:53.983500 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e5d11016-59eb-43c4-b6fe-dff8e6db5796 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:53.984773 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e5d11016-59eb-43c4-b6fe-dff8e6db5796 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: a8925d29-d9e0-4dbb-a73d-09473255fa34] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:53.992778 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e5d11016-59eb-43c4-b6fe-dff8e6db5796 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:53.993006 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7989c942-aed4-449e-8507-e19e88990f93 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:53.993650 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e5d11016-59eb-43c4-b6fe-dff8e6db5796 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:54.003850 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e5d11016-59eb-43c4-b6fe-dff8e6db5796 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:54.004091 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7989c942-aed4-449e-8507-e19e88990f93 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:54.004189 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e5d11016-59eb-43c4-b6fe-dff8e6db5796 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:54.004189 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e5d11016-59eb-43c4-b6fe-dff8e6db5796 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:54.004396 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7989c942-aed4-449e-8507-e19e88990f93 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223" status: 200 len: 1487 microversion: 2.25 time: 0.523902 Oct 27 03:29:54.004475 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e5d11016-59eb-43c4-b6fe-dff8e6db5796 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:54.004550 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1156/2366] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:29:53 2022] GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223 => generated 1487 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:29:54.114446 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e5d11016-59eb-43c4-b6fe-dff8e6db5796 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:54.126760 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e5d11016-59eb-43c4-b6fe-dff8e6db5796 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34" status: 200 len: 1184 microversion: 2.1 time: 0.145398 Oct 27 03:29:54.135491 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1211/2367] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:53 2022] GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34 => generated 1184 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:54.229006 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b3b20ffe-6d60-4db9-b578-5f2bd7ba5b18 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:54.236999 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b3b20ffe-6d60-4db9-b578-5f2bd7ba5b18 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:54.245542 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b3b20ffe-6d60-4db9-b578-5f2bd7ba5b18 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:54.246077 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b3b20ffe-6d60-4db9-b578-5f2bd7ba5b18 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:54.250222 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b3b20ffe-6d60-4db9-b578-5f2bd7ba5b18 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:54.252399 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b3b20ffe-6d60-4db9-b578-5f2bd7ba5b18 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:54.252923 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b3b20ffe-6d60-4db9-b578-5f2bd7ba5b18 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:54.253517 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b3b20ffe-6d60-4db9-b578-5f2bd7ba5b18 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:54.272639 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-24f326e1-d99e-4f1b-919e-128315b7777f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:54.272639 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-24f326e1-d99e-4f1b-919e-128315b7777f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:54.290218 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-24f326e1-d99e-4f1b-919e-128315b7777f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:54.292803 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-24f326e1-d99e-4f1b-919e-128315b7777f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:54.293523 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-24f326e1-d99e-4f1b-919e-128315b7777f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:54.296337 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-24f326e1-d99e-4f1b-919e-128315b7777f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:54.297095 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-24f326e1-d99e-4f1b-919e-128315b7777f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:54.304879 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-24f326e1-d99e-4f1b-919e-128315b7777f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:54.530747 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b3b20ffe-6d60-4db9-b578-5f2bd7ba5b18 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:54.541795 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b3b20ffe-6d60-4db9-b578-5f2bd7ba5b18 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c" status: 200 len: 1486 microversion: 2.1 time: 0.316579 Oct 27 03:29:54.551129 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1157/2368] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:54 2022] GET /compute/v2.1/servers/a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c => generated 1486 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:54.560911 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-89111d9a-aa8c-4369-8675-18ff876c370f tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:54.561551 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-89111d9a-aa8c-4369-8675-18ff876c370f tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] [instance: 04477d51-f600-483a-aec9-feb992cc6cf7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:54.571173 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-89111d9a-aa8c-4369-8675-18ff876c370f tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:54.571698 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-89111d9a-aa8c-4369-8675-18ff876c370f tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:54.572252 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-89111d9a-aa8c-4369-8675-18ff876c370f tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:54.573295 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-89111d9a-aa8c-4369-8675-18ff876c370f tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:54.573589 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-89111d9a-aa8c-4369-8675-18ff876c370f tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:54.574005 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-89111d9a-aa8c-4369-8675-18ff876c370f tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:54.690386 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-24f326e1-d99e-4f1b-919e-128315b7777f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:54.701575 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-24f326e1-d99e-4f1b-919e-128315b7777f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1365 microversion: 2.1 time: 0.436430 Oct 27 03:29:54.703561 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1212/2369] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:54 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1365 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:29:54.709789 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-630f3ae9-6423-458a-93c8-08fada991ca8 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:54.711602 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-630f3ae9-6423-458a-93c8-08fada991ca8 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:54.719402 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-630f3ae9-6423-458a-93c8-08fada991ca8 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:54.720154 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-630f3ae9-6423-458a-93c8-08fada991ca8 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:54.720819 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-630f3ae9-6423-458a-93c8-08fada991ca8 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:54.720956 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-89111d9a-aa8c-4369-8675-18ff876c370f tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421d14944da74570a53d620ea205449d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92082c8718aa41bf96cd84d682d75954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:54.721961 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-630f3ae9-6423-458a-93c8-08fada991ca8 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:54.723168 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-630f3ae9-6423-458a-93c8-08fada991ca8 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:54.724430 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-630f3ae9-6423-458a-93c8-08fada991ca8 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:54.731422 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-89111d9a-aa8c-4369-8675-18ff876c370f tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] 10.222.0.20 "GET /compute/v2.1/servers/04477d51-f600-483a-aec9-feb992cc6cf7" status: 200 len: 1220 microversion: 2.1 time: 0.177958 Oct 27 03:29:54.732692 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1158/2370] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:54 2022] GET /compute/v2.1/servers/04477d51-f600-483a-aec9-feb992cc6cf7 => generated 1220 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:54.760344 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-630f3ae9-6423-458a-93c8-08fada991ca8 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c] Going to try to terminate instance {{(pid=121001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:29:55.013782 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6b878a56-4a8a-4721-bd0e-0561dd7aabd6 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:55.014748 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6b878a56-4a8a-4721-bd0e-0561dd7aabd6 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: 339287fc-37b6-455d-96ab-08ab8e2c3e68] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:55.027204 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6b878a56-4a8a-4721-bd0e-0561dd7aabd6 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:55.027927 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6b878a56-4a8a-4721-bd0e-0561dd7aabd6 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:55.032328 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6b878a56-4a8a-4721-bd0e-0561dd7aabd6 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:55.033532 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6b878a56-4a8a-4721-bd0e-0561dd7aabd6 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:55.034378 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6b878a56-4a8a-4721-bd0e-0561dd7aabd6 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:55.036252 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6b878a56-4a8a-4721-bd0e-0561dd7aabd6 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:55.226954 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-630f3ae9-6423-458a-93c8-08fada991ca8 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c" status: 204 len: 0 microversion: 2.1 time: 0.521933 Oct 27 03:29:55.228144 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1213/2371] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:29:54 2022] DELETE /compute/v2.1/servers/a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c => generated 0 bytes in 524 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:29:55.234333 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8db8013e-f7f1-4e16-aaba-ca29011667c3 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:55.236077 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8db8013e-f7f1-4e16-aaba-ca29011667c3 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: d5e6f604-9466-45c6-86a8-885cfb393223] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:55.246969 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8db8013e-f7f1-4e16-aaba-ca29011667c3 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:55.247819 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8db8013e-f7f1-4e16-aaba-ca29011667c3 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:55.248427 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8db8013e-f7f1-4e16-aaba-ca29011667c3 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:55.249317 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8db8013e-f7f1-4e16-aaba-ca29011667c3 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:55.249956 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8db8013e-f7f1-4e16-aaba-ca29011667c3 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:55.250564 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8db8013e-f7f1-4e16-aaba-ca29011667c3 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:55.291098 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-6b878a56-4a8a-4721-bd0e-0561dd7aabd6 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13e05e253c94aadb1c089128ff35be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8510a519f14deea6f35a437419e161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:55.303185 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6b878a56-4a8a-4721-bd0e-0561dd7aabd6 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68" status: 200 len: 1478 microversion: 2.1 time: 0.295982 Oct 27 03:29:55.304303 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1159/2372] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:55 2022] GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68 => generated 1478 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:55.322881 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-908520e4-123d-4d97-9096-e715072955fe tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:55.324198 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-908520e4-123d-4d97-9096-e715072955fe tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: a8925d29-d9e0-4dbb-a73d-09473255fa34] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:55.339786 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-908520e4-123d-4d97-9096-e715072955fe tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:55.340617 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-908520e4-123d-4d97-9096-e715072955fe tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:55.341436 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-908520e4-123d-4d97-9096-e715072955fe tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:55.342227 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-908520e4-123d-4d97-9096-e715072955fe tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:55.351569 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-908520e4-123d-4d97-9096-e715072955fe tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:55.351569 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-908520e4-123d-4d97-9096-e715072955fe tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:55.457542 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-908520e4-123d-4d97-9096-e715072955fe tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:55.468790 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-908520e4-123d-4d97-9096-e715072955fe tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34" status: 200 len: 1184 microversion: 2.1 time: 0.163253 Oct 27 03:29:55.473405 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1160/2373] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:55 2022] GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34 => generated 1184 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:55.479653 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c39dac30-fa2a-4155-8000-8c8ab83af3a4 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7dda9b95e0>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:55.560057 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-c39dac30-fa2a-4155-8000-8c8ab83af3a4 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] HTTP exception thrown: Image not found. Oct 27 03:29:55.563408 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c39dac30-fa2a-4155-8000-8c8ab83af3a4 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Request method failure captured: Oct 27 03:29:55.563408 n-d-862769-1 devstack@n-api.service[121000]: request: DELETE /compute/v2.1/images/3c8ff4f0-cd8a-42f7-96ad-533eddceaec0 HTTP/1.1 Oct 27 03:29:55.563408 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:29:55.563408 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:29:55.563408 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:29:55.563408 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:29:55.563408 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:29:55.563408 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:29:55.563408 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:29:55.563408 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:29:55.563408 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfnAX64GvSXX6j_FGiQQ9IlgyuvfbWxRMGJCqIz8aEuYqDW4EVaQTS_nCBHKSQ3Z4oltdJGbrb3LkQtsJQ-KBbiFsQn0s9yf9n4GDuUzW48O2MfgGJVpAyAl-5qhe5w5ten3MUUxjRyCo9okwgZpH2TZ6ggq8P48i5NICoqXVcmLAEk Oct 27 03:29:55.563408 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:29:55.563408 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:29:55.563408 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:29:55.563408 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:29:55.563408 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:29:55.563408 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:29:55.563408 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: ae78c307a1504172828e668f915a3677 Oct 27 03:29:55.563408 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ImagesTestJSON-2119984465 Oct 27 03:29:55.563408 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:29:55.563408 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:29:55.563408 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ae78c307a1504172828e668f915a3677"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ae78c307a1504172828e668f915a3677"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ae78c307a1504172828e668f915a3677"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ae78c307a1504172828e668f915a3677"}]}] Oct 27 03:29:55.563408 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ImagesTestJSON-2119984465 Oct 27 03:29:55.563408 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: ae78c307a1504172828e668f915a3677 Oct 27 03:29:55.563408 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ImagesTestJSON-2119984465 Oct 27 03:29:55.563408 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ImagesTestJSON-2119984465-project Oct 27 03:29:55.563408 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:29:55.563408 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:29:55.563408 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 1d6175f2ac39494f8cba3db225150d6c Oct 27 03:29:55.563408 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ImagesTestJSON-2119984465-project Oct 27 03:29:55.563408 n-d-862769-1 devstack@n-api.service[121000]: method: Oct 27 03:29:55.563408 n-d-862769-1 devstack@n-api.service[121000]: exception: Image not found. Oct 27 03:29:55.563408 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '3c8ff4f0-cd8a-42f7-96ad-533eddceaec0'} Oct 27 03:29:55.563408 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:29:55.563408 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:29:55.563408 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 27 03:29:55.563408 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 27 03:29:55.563408 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 03:29:55.563408 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 03:29:55.563408 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 03:29:55.563408 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 03:29:55.563408 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 27 03:29:55.563408 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 27 03:29:55.563408 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 27 03:29:55.563408 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 27 03:29:55.563408 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 03:29:55.563408 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 03:29:55.563408 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 03:29:55.563408 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 03:29:55.563408 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 3c8ff4f0-cd8a-42f7-96ad-533eddceaec0 to delete Oct 27 03:29:55.563408 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:29:55.563408 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:29:55.563408 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:29:55.563408 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:29:55.563408 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 27 03:29:55.563408 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 27 03:29:55.563408 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 27 03:29:55.563408 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 27 03:29:55.563408 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 27 03:29:55.563408 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 27 03:29:55.563408 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3c8ff4f0-cd8a-42f7-96ad-533eddceaec0 could not be found. Oct 27 03:29:55.563408 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:29:55.563408 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:29:55.563408 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:29:55.563408 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:29:55.569993 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:29:55.569993 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:29:55.569993 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:29:55.569993 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:29:55.569993 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:29:55.569993 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:29:55.569993 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:29:55.569993 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:29:55.569993 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 27 03:29:55.569993 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 27 03:29:55.569993 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 27 03:29:55.569993 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:29:55.569993 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:29:55.569993 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:29:55.569993 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:29:55.569993 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:29:55.569993 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:29:55.569993 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:29:55.569993 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:29:55.569993 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 27 03:29:55.569993 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:29:55.569993 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c39dac30-fa2a-4155-8000-8c8ab83af3a4 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Returning 404 to user: Image not found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:29:55.569993 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c39dac30-fa2a-4155-8000-8c8ab83af3a4 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "DELETE /compute/v2.1/images/3c8ff4f0-cd8a-42f7-96ad-533eddceaec0" status: 404 len: 62 microversion: 2.1 time: 0.091033 Oct 27 03:29:55.569993 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1161/2374] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:55 2022] DELETE /compute/v2.1/images/3c8ff4f0-cd8a-42f7-96ad-533eddceaec0 => generated 62 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 03:29:55.576378 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-571c8831-ef6b-4fc1-ad00-92a1bb998f65 req-23305ff9-7ac8-47d1-a605-afb15d7365d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "339287fc-37b6-455d-96ab-08ab8e2c3e68", "name": "network-vif-unplugged", "status": "completed", "tag": "b6134fcc-5cb7-4dad-a3b5-156ca229326d"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:29:55.605912 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-571c8831-ef6b-4fc1-ad00-92a1bb998f65 req-23305ff9-7ac8-47d1-a605-afb15d7365d5 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:55.606872 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-571c8831-ef6b-4fc1-ad00-92a1bb998f65 req-23305ff9-7ac8-47d1-a605-afb15d7365d5 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:55.607457 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-571c8831-ef6b-4fc1-ad00-92a1bb998f65 req-23305ff9-7ac8-47d1-a605-afb15d7365d5 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:55.631854 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-571c8831-ef6b-4fc1-ad00-92a1bb998f65 req-23305ff9-7ac8-47d1-a605-afb15d7365d5 service nova] Creating event network-vif-unplugged:b6134fcc-5cb7-4dad-a3b5-156ca229326d for instance 339287fc-37b6-455d-96ab-08ab8e2c3e68 on n-h2-862769-1 Oct 27 03:29:55.644867 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-571c8831-ef6b-4fc1-ad00-92a1bb998f65 req-23305ff9-7ac8-47d1-a605-afb15d7365d5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072104 Oct 27 03:29:55.645486 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1162/2375] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:29:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:29:55.655953 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-33781925-1e05-4777-a863-2046e7a07c8a tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:55.656554 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-33781925-1e05-4777-a863-2046e7a07c8a tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:55.674076 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-33781925-1e05-4777-a863-2046e7a07c8a tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:55.674797 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-33781925-1e05-4777-a863-2046e7a07c8a tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:55.676703 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-33781925-1e05-4777-a863-2046e7a07c8a tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:55.677959 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-33781925-1e05-4777-a863-2046e7a07c8a tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:55.680713 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-33781925-1e05-4777-a863-2046e7a07c8a tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:55.681479 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-33781925-1e05-4777-a863-2046e7a07c8a tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:55.720736 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8db8013e-f7f1-4e16-aaba-ca29011667c3 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:55.737481 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-33781925-1e05-4777-a863-2046e7a07c8a tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c] Going to try to terminate instance {{(pid=121000) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:29:55.743032 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8db8013e-f7f1-4e16-aaba-ca29011667c3 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:55.748874 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8db8013e-f7f1-4e16-aaba-ca29011667c3 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:55.751828 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8db8013e-f7f1-4e16-aaba-ca29011667c3 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223" status: 200 len: 1487 microversion: 2.25 time: 0.522246 Oct 27 03:29:55.753618 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1214/2376] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:29:55 2022] GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223 => generated 1487 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:29:55.758958 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-53a66c53-3141-4220-b5f3-a9ddb2ca36d0 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:55.760515 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-53a66c53-3141-4220-b5f3-a9ddb2ca36d0 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:55.784318 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-53a66c53-3141-4220-b5f3-a9ddb2ca36d0 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:55.786211 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-53a66c53-3141-4220-b5f3-a9ddb2ca36d0 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:55.786826 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-53a66c53-3141-4220-b5f3-a9ddb2ca36d0 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:55.787891 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-53a66c53-3141-4220-b5f3-a9ddb2ca36d0 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:55.788763 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-53a66c53-3141-4220-b5f3-a9ddb2ca36d0 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:55.790065 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-53a66c53-3141-4220-b5f3-a9ddb2ca36d0 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:55.971313 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.compute.api [None req-33781925-1e05-4777-a863-2046e7a07c8a tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c] Instance is already in deleting state, ignoring this request Oct 27 03:29:55.972259 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-33781925-1e05-4777-a863-2046e7a07c8a tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c" status: 204 len: 0 microversion: 2.1 time: 0.325603 Oct 27 03:29:55.973390 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1163/2377] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:29:55 2022] DELETE /compute/v2.1/servers/a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:29:55.988979 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9e4af960-a0fb-4f26-9727-5f4ac1f22150 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:55.989615 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9e4af960-a0fb-4f26-9727-5f4ac1f22150 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] [instance: 04477d51-f600-483a-aec9-feb992cc6cf7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:56.008508 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9e4af960-a0fb-4f26-9727-5f4ac1f22150 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:56.009018 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9e4af960-a0fb-4f26-9727-5f4ac1f22150 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:56.009459 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9e4af960-a0fb-4f26-9727-5f4ac1f22150 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:56.019742 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9e4af960-a0fb-4f26-9727-5f4ac1f22150 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:56.020452 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9e4af960-a0fb-4f26-9727-5f4ac1f22150 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:56.021493 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9e4af960-a0fb-4f26-9727-5f4ac1f22150 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:56.086675 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-53a66c53-3141-4220-b5f3-a9ddb2ca36d0 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:56.103045 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-53a66c53-3141-4220-b5f3-a9ddb2ca36d0 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1365 microversion: 2.1 time: 0.346247 Oct 27 03:29:56.106155 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1215/2378] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:55 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1365 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:56.112036 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-12e0e7c6-5f34-4ab5-aae4-3c77d5a5a049 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:56.113103 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-12e0e7c6-5f34-4ab5-aae4-3c77d5a5a049 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:56.131578 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-12e0e7c6-5f34-4ab5-aae4-3c77d5a5a049 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:56.146892 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-12e0e7c6-5f34-4ab5-aae4-3c77d5a5a049 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:56.149255 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-12e0e7c6-5f34-4ab5-aae4-3c77d5a5a049 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:56.149255 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-12e0e7c6-5f34-4ab5-aae4-3c77d5a5a049 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:56.149255 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-12e0e7c6-5f34-4ab5-aae4-3c77d5a5a049 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:56.149255 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-12e0e7c6-5f34-4ab5-aae4-3c77d5a5a049 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:56.153801 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:29:56.230789 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9e4af960-a0fb-4f26-9727-5f4ac1f22150 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421d14944da74570a53d620ea205449d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92082c8718aa41bf96cd84d682d75954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:56.240608 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9e4af960-a0fb-4f26-9727-5f4ac1f22150 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] 10.222.0.20 "GET /compute/v2.1/servers/04477d51-f600-483a-aec9-feb992cc6cf7" status: 200 len: 1268 microversion: 2.1 time: 0.263331 Oct 27 03:29:56.254487 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1164/2379] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:55 2022] GET /compute/v2.1/servers/04477d51-f600-483a-aec9-feb992cc6cf7 => generated 1268 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:56.328741 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-bf54397c-18eb-44db-83ad-2bbe9e350771 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:56.329372 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-bf54397c-18eb-44db-83ad-2bbe9e350771 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: 339287fc-37b6-455d-96ab-08ab8e2c3e68] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:56.337408 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bf54397c-18eb-44db-83ad-2bbe9e350771 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:56.337849 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bf54397c-18eb-44db-83ad-2bbe9e350771 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:56.342448 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bf54397c-18eb-44db-83ad-2bbe9e350771 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:56.343277 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bf54397c-18eb-44db-83ad-2bbe9e350771 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:56.343758 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bf54397c-18eb-44db-83ad-2bbe9e350771 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:56.346621 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bf54397c-18eb-44db-83ad-2bbe9e350771 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:56.477500 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-12e0e7c6-5f34-4ab5-aae4-3c77d5a5a049 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:56.499055 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-12e0e7c6-5f34-4ab5-aae4-3c77d5a5a049 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c" status: 200 len: 1492 microversion: 2.1 time: 0.390709 Oct 27 03:29:56.513123 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1216/2380] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:56 2022] GET /compute/v2.1/servers/a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c => generated 1492 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:56.518063 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f3c53c19-d5b5-41b9-98ea-b9fdb030f8e9 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:56.518749 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f3c53c19-d5b5-41b9-98ea-b9fdb030f8e9 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: a8925d29-d9e0-4dbb-a73d-09473255fa34] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:56.530197 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f3c53c19-d5b5-41b9-98ea-b9fdb030f8e9 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:56.531191 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f3c53c19-d5b5-41b9-98ea-b9fdb030f8e9 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:56.531652 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f3c53c19-d5b5-41b9-98ea-b9fdb030f8e9 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:56.532382 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f3c53c19-d5b5-41b9-98ea-b9fdb030f8e9 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:56.537284 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f3c53c19-d5b5-41b9-98ea-b9fdb030f8e9 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:56.537556 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f3c53c19-d5b5-41b9-98ea-b9fdb030f8e9 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:56.667951 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-bf54397c-18eb-44db-83ad-2bbe9e350771 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13e05e253c94aadb1c089128ff35be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8510a519f14deea6f35a437419e161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:56.681365 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-bf54397c-18eb-44db-83ad-2bbe9e350771 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68" status: 200 len: 1478 microversion: 2.1 time: 0.356248 Oct 27 03:29:56.694710 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1165/2381] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:56 2022] GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68 => generated 1478 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:29:56.783667 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0225b86d-a87f-40d8-868b-42e5c8e658e9 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:56.785042 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0225b86d-a87f-40d8-868b-42e5c8e658e9 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: d5e6f604-9466-45c6-86a8-885cfb393223] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:56.798397 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0225b86d-a87f-40d8-868b-42e5c8e658e9 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:56.802190 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0225b86d-a87f-40d8-868b-42e5c8e658e9 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:56.803821 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0225b86d-a87f-40d8-868b-42e5c8e658e9 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:56.807298 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0225b86d-a87f-40d8-868b-42e5c8e658e9 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:56.811380 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0225b86d-a87f-40d8-868b-42e5c8e658e9 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:56.812118 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0225b86d-a87f-40d8-868b-42e5c8e658e9 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:56.972661 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f3c53c19-d5b5-41b9-98ea-b9fdb030f8e9 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:56.984959 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f3c53c19-d5b5-41b9-98ea-b9fdb030f8e9 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34" status: 200 len: 1184 microversion: 2.1 time: 0.470634 Oct 27 03:29:56.986655 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1217/2382] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:56 2022] GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34 => generated 1184 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:57.131870 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-000295cc-e5c3-4c85-94fe-3896a6687449 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:57.132948 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-000295cc-e5c3-4c85-94fe-3896a6687449 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:57.143508 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-000295cc-e5c3-4c85-94fe-3896a6687449 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:57.145025 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-000295cc-e5c3-4c85-94fe-3896a6687449 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:57.147784 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-000295cc-e5c3-4c85-94fe-3896a6687449 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:57.148847 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-000295cc-e5c3-4c85-94fe-3896a6687449 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:57.149456 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-000295cc-e5c3-4c85-94fe-3896a6687449 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:57.152024 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-000295cc-e5c3-4c85-94fe-3896a6687449 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:57.421749 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-000295cc-e5c3-4c85-94fe-3896a6687449 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:57.438472 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-000295cc-e5c3-4c85-94fe-3896a6687449 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1365 microversion: 2.1 time: 0.310655 Oct 27 03:29:57.451115 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1218/2383] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:57 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1365 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:57.467237 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-cc87f48b-4137-43cb-9e42-6fd9bbbb66eb tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:57.469787 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-cc87f48b-4137-43cb-9e42-6fd9bbbb66eb tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] [instance: 04477d51-f600-483a-aec9-feb992cc6cf7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:57.484072 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cc87f48b-4137-43cb-9e42-6fd9bbbb66eb tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:57.484811 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cc87f48b-4137-43cb-9e42-6fd9bbbb66eb tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:57.485404 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cc87f48b-4137-43cb-9e42-6fd9bbbb66eb tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:57.497566 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cc87f48b-4137-43cb-9e42-6fd9bbbb66eb tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:57.500500 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cc87f48b-4137-43cb-9e42-6fd9bbbb66eb tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:57.500964 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cc87f48b-4137-43cb-9e42-6fd9bbbb66eb tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:57.712552 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-cc87f48b-4137-43cb-9e42-6fd9bbbb66eb tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421d14944da74570a53d620ea205449d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92082c8718aa41bf96cd84d682d75954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:57.721077 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-cc87f48b-4137-43cb-9e42-6fd9bbbb66eb tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] 10.222.0.20 "GET /compute/v2.1/servers/04477d51-f600-483a-aec9-feb992cc6cf7" status: 200 len: 1274 microversion: 2.1 time: 0.268317 Oct 27 03:29:57.725253 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1219/2384] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:57 2022] GET /compute/v2.1/servers/04477d51-f600-483a-aec9-feb992cc6cf7 => generated 1274 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:57.757699 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c81736f4-6262-4d01-9439-1acaf3424c0f tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:57.758387 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c81736f4-6262-4d01-9439-1acaf3424c0f tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:57.782402 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c81736f4-6262-4d01-9439-1acaf3424c0f tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:57.783171 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c81736f4-6262-4d01-9439-1acaf3424c0f tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:57.783618 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c81736f4-6262-4d01-9439-1acaf3424c0f tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:57.784378 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c81736f4-6262-4d01-9439-1acaf3424c0f tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:57.784839 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c81736f4-6262-4d01-9439-1acaf3424c0f tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:57.785274 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c81736f4-6262-4d01-9439-1acaf3424c0f tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:58.099365 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c81736f4-6262-4d01-9439-1acaf3424c0f tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:58.107186 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c81736f4-6262-4d01-9439-1acaf3424c0f tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c" status: 200 len: 1492 microversion: 2.1 time: 0.361874 Oct 27 03:29:58.107770 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1220/2385] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:57 2022] GET /compute/v2.1/servers/a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c => generated 1492 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:58.115409 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0225b86d-a87f-40d8-868b-42e5c8e658e9 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:58.118681 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:29:58.125080 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ab9931c4-1fa4-4a17-bee7-e9881f7d16fd tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:58.125904 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ab9931c4-1fa4-4a17-bee7-e9881f7d16fd tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: 339287fc-37b6-455d-96ab-08ab8e2c3e68] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:58.132205 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0225b86d-a87f-40d8-868b-42e5c8e658e9 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:58.134939 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0225b86d-a87f-40d8-868b-42e5c8e658e9 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:58.138018 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0225b86d-a87f-40d8-868b-42e5c8e658e9 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223" status: 200 len: 1487 microversion: 2.25 time: 1.358720 Oct 27 03:29:58.140222 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ab9931c4-1fa4-4a17-bee7-e9881f7d16fd tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:58.140945 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ab9931c4-1fa4-4a17-bee7-e9881f7d16fd tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:58.141373 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1166/2386] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:29:56 2022] GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223 => generated 1487 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:29:58.144538 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ab9931c4-1fa4-4a17-bee7-e9881f7d16fd tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:58.145549 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ab9931c4-1fa4-4a17-bee7-e9881f7d16fd tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:58.146271 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ab9931c4-1fa4-4a17-bee7-e9881f7d16fd tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:58.151963 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ab9931c4-1fa4-4a17-bee7-e9881f7d16fd tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:58.152984 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-eaeb20d7-9304-4907-981b-86d7e8acba56 req-f6e628bb-3fc5-48c7-a1e6-d0cdb154fa2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "339287fc-37b6-455d-96ab-08ab8e2c3e68", "name": "network-vif-plugged", "status": "completed", "tag": "b6134fcc-5cb7-4dad-a3b5-156ca229326d"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:29:58.188311 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-eaeb20d7-9304-4907-981b-86d7e8acba56 req-f6e628bb-3fc5-48c7-a1e6-d0cdb154fa2b service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:58.188311 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-eaeb20d7-9304-4907-981b-86d7e8acba56 req-f6e628bb-3fc5-48c7-a1e6-d0cdb154fa2b service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:58.188311 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-eaeb20d7-9304-4907-981b-86d7e8acba56 req-f6e628bb-3fc5-48c7-a1e6-d0cdb154fa2b service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:58.225998 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-eaeb20d7-9304-4907-981b-86d7e8acba56 req-f6e628bb-3fc5-48c7-a1e6-d0cdb154fa2b service nova] Creating event network-vif-plugged:b6134fcc-5cb7-4dad-a3b5-156ca229326d for instance 339287fc-37b6-455d-96ab-08ab8e2c3e68 on n-h2-862769-1 Oct 27 03:29:58.231955 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-eaeb20d7-9304-4907-981b-86d7e8acba56 req-f6e628bb-3fc5-48c7-a1e6-d0cdb154fa2b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089294 Oct 27 03:29:58.234859 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1167/2387] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:29:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:29:58.241342 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c5162fec-4e69-4ac5-be34-2cea00ec6376 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:58.242407 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c5162fec-4e69-4ac5-be34-2cea00ec6376 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: a8925d29-d9e0-4dbb-a73d-09473255fa34] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:58.249122 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c5162fec-4e69-4ac5-be34-2cea00ec6376 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:58.250328 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c5162fec-4e69-4ac5-be34-2cea00ec6376 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:58.250994 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c5162fec-4e69-4ac5-be34-2cea00ec6376 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:58.251931 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c5162fec-4e69-4ac5-be34-2cea00ec6376 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:58.252626 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c5162fec-4e69-4ac5-be34-2cea00ec6376 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:58.253310 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c5162fec-4e69-4ac5-be34-2cea00ec6376 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:58.323908 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c5162fec-4e69-4ac5-be34-2cea00ec6376 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:58.324702 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c5162fec-4e69-4ac5-be34-2cea00ec6376 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:58.325414 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c5162fec-4e69-4ac5-be34-2cea00ec6376 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:58.326223 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-c5162fec-4e69-4ac5-be34-2cea00ec6376 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lazy-loading 'fault' on Instance uuid a8925d29-d9e0-4dbb-a73d-09473255fa34 {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:29:58.625524 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c5162fec-4e69-4ac5-be34-2cea00ec6376 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:58.632678 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c5162fec-4e69-4ac5-be34-2cea00ec6376 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34" status: 200 len: 1143 microversion: 2.1 time: 0.396349 Oct 27 03:29:58.635975 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1168/2388] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:58 2022] GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34 => generated 1143 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:58.652275 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-af7ebaa6-d56e-440d-80eb-80edfc756fae tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:58.653125 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-af7ebaa6-d56e-440d-80eb-80edfc756fae tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:58.672597 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-af7ebaa6-d56e-440d-80eb-80edfc756fae tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:58.674537 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-af7ebaa6-d56e-440d-80eb-80edfc756fae tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:58.676723 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-af7ebaa6-d56e-440d-80eb-80edfc756fae tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:58.680094 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-af7ebaa6-d56e-440d-80eb-80edfc756fae tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:58.680094 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-af7ebaa6-d56e-440d-80eb-80edfc756fae tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:58.680569 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-af7ebaa6-d56e-440d-80eb-80edfc756fae tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:58.682521 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ab9931c4-1fa4-4a17-bee7-e9881f7d16fd tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13e05e253c94aadb1c089128ff35be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8510a519f14deea6f35a437419e161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:58.690444 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ab9931c4-1fa4-4a17-bee7-e9881f7d16fd tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68" status: 200 len: 1478 microversion: 2.1 time: 0.576015 Oct 27 03:29:58.704924 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1221/2389] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:58 2022] GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68 => generated 1478 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:58.748613 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a795df86-8302-4f20-bc57-a9dcec5872ca tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:58.749239 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a795df86-8302-4f20-bc57-a9dcec5872ca tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] [instance: 04477d51-f600-483a-aec9-feb992cc6cf7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:58.757540 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a795df86-8302-4f20-bc57-a9dcec5872ca tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:58.758052 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a795df86-8302-4f20-bc57-a9dcec5872ca tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:58.758500 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a795df86-8302-4f20-bc57-a9dcec5872ca tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:58.759765 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a795df86-8302-4f20-bc57-a9dcec5872ca tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:58.760612 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a795df86-8302-4f20-bc57-a9dcec5872ca tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:58.761669 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a795df86-8302-4f20-bc57-a9dcec5872ca tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:58.854642 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a795df86-8302-4f20-bc57-a9dcec5872ca tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421d14944da74570a53d620ea205449d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92082c8718aa41bf96cd84d682d75954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:58.873563 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a795df86-8302-4f20-bc57-a9dcec5872ca tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] 10.222.0.20 "GET /compute/v2.1/servers/04477d51-f600-483a-aec9-feb992cc6cf7" status: 200 len: 1274 microversion: 2.1 time: 0.121445 Oct 27 03:29:58.873563 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1222/2390] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:58 2022] GET /compute/v2.1/servers/04477d51-f600-483a-aec9-feb992cc6cf7 => generated 1274 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:59.140141 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1bd7cdf4-2dd2-4df2-b46b-a053d2f1e892 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:59.140779 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1bd7cdf4-2dd2-4df2-b46b-a053d2f1e892 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:59.156240 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1bd7cdf4-2dd2-4df2-b46b-a053d2f1e892 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:59.156738 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1bd7cdf4-2dd2-4df2-b46b-a053d2f1e892 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:59.157182 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1bd7cdf4-2dd2-4df2-b46b-a053d2f1e892 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:59.158197 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1bd7cdf4-2dd2-4df2-b46b-a053d2f1e892 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:59.158659 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1bd7cdf4-2dd2-4df2-b46b-a053d2f1e892 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:59.159103 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1bd7cdf4-2dd2-4df2-b46b-a053d2f1e892 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:59.306779 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1bd7cdf4-2dd2-4df2-b46b-a053d2f1e892 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:59.323724 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1bd7cdf4-2dd2-4df2-b46b-a053d2f1e892 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c" status: 200 len: 1450 microversion: 2.1 time: 0.194148 Oct 27 03:29:59.327798 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1223/2391] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:59 2022] GET /compute/v2.1/servers/a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c => generated 1450 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:59.346008 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ad7349aa-220f-4bbe-86c9-5895ef1c3edf tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:59.346008 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ad7349aa-220f-4bbe-86c9-5895ef1c3edf tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: d5e6f604-9466-45c6-86a8-885cfb393223] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:59.358614 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ad7349aa-220f-4bbe-86c9-5895ef1c3edf tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:59.358614 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ad7349aa-220f-4bbe-86c9-5895ef1c3edf tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:59.358614 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ad7349aa-220f-4bbe-86c9-5895ef1c3edf tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:59.358614 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ad7349aa-220f-4bbe-86c9-5895ef1c3edf tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:59.358614 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ad7349aa-220f-4bbe-86c9-5895ef1c3edf tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:59.359018 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ad7349aa-220f-4bbe-86c9-5895ef1c3edf tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:59.396337 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-af7ebaa6-d56e-440d-80eb-80edfc756fae tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:59.405783 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-af7ebaa6-d56e-440d-80eb-80edfc756fae tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1365 microversion: 2.1 time: 0.764604 Oct 27 03:29:59.422986 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1169/2392] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:58 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1365 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:29:59.442979 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-345d79a3-b89b-42c5-801f-17b335107012 req-4008724e-51a0-467e-b974-3fd32021f8a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c", "name": "network-vif-deleted", "tag": "f54df010-fe0a-4c01-88de-96c0e83bfd34"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:29:59.483634 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-345d79a3-b89b-42c5-801f-17b335107012 req-4008724e-51a0-467e-b974-3fd32021f8a2 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:59.484759 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-345d79a3-b89b-42c5-801f-17b335107012 req-4008724e-51a0-467e-b974-3fd32021f8a2 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:59.485421 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-345d79a3-b89b-42c5-801f-17b335107012 req-4008724e-51a0-467e-b974-3fd32021f8a2 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:59.509837 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-345d79a3-b89b-42c5-801f-17b335107012 req-4008724e-51a0-467e-b974-3fd32021f8a2 service nova] Creating event network-vif-deleted:f54df010-fe0a-4c01-88de-96c0e83bfd34 for instance a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c on n-h2-862769-1 Oct 27 03:29:59.519950 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-345d79a3-b89b-42c5-801f-17b335107012 req-4008724e-51a0-467e-b974-3fd32021f8a2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094823 Oct 27 03:29:59.521713 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1170/2393] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:29:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:29:59.666522 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-bba6c0ae-94aa-4a13-b529-8390cc0ce5bb tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:59.667245 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-bba6c0ae-94aa-4a13-b529-8390cc0ce5bb tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: a8925d29-d9e0-4dbb-a73d-09473255fa34] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:59.685560 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bba6c0ae-94aa-4a13-b529-8390cc0ce5bb tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:59.687386 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bba6c0ae-94aa-4a13-b529-8390cc0ce5bb tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:59.692684 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bba6c0ae-94aa-4a13-b529-8390cc0ce5bb tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:59.692684 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bba6c0ae-94aa-4a13-b529-8390cc0ce5bb tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:59.692684 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bba6c0ae-94aa-4a13-b529-8390cc0ce5bb tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:59.692684 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bba6c0ae-94aa-4a13-b529-8390cc0ce5bb tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:59.715464 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ad7349aa-220f-4bbe-86c9-5895ef1c3edf tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:59.730492 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ad7349aa-220f-4bbe-86c9-5895ef1c3edf tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:59.735800 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ad7349aa-220f-4bbe-86c9-5895ef1c3edf tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:29:59.742530 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ad7349aa-220f-4bbe-86c9-5895ef1c3edf tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223" status: 200 len: 1487 microversion: 2.25 time: 0.412302 Oct 27 03:29:59.758070 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1224/2394] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:29:59 2022] GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223 => generated 1487 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:29:59.758070 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-61f06c36-3d82-4728-80b2-1b3442641906 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:59.758725 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-61f06c36-3d82-4728-80b2-1b3442641906 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: 339287fc-37b6-455d-96ab-08ab8e2c3e68] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:59.758943 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-bba6c0ae-94aa-4a13-b529-8390cc0ce5bb tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] HTTP exception thrown: Instance a8925d29-d9e0-4dbb-a73d-09473255fa34 could not be found. Oct 27 03:29:59.772875 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-bba6c0ae-94aa-4a13-b529-8390cc0ce5bb tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Request method failure captured: Oct 27 03:29:59.772875 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34 HTTP/1.1 Oct 27 03:29:59.772875 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:29:59.772875 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:29:59.772875 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:29:59.772875 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:29:59.772875 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:29:59.772875 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:29:59.772875 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:29:59.772875 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:29:59.772875 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWflpDYfIGjZv42nta44cUKr4gfgFkHcAeVM8yamczRS9hHsDVo2rsQnCdKSUZqn3ZmcXBvUrwb61kAyQ6DVfG99X5r7udSMUTUj-TX444bEUorFGQKwimw1hyhYRTrQq-ZUKWv2S3u5J0WvKPFUznz1pJqOrfpEn__pIwU22_EAMjAc Oct 27 03:29:59.772875 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:29:59.772875 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:29:59.772875 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:29:59.772875 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:29:59.772875 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:29:59.772875 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:29:59.772875 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: aaee7e66f16e4ed5b49394311bd2803a Oct 27 03:29:59.772875 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-LiveMigrationTest-428698375 Oct 27 03:29:59.772875 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:29:59.772875 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:29:59.772875 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aaee7e66f16e4ed5b49394311bd2803a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/aaee7e66f16e4ed5b49394311bd2803a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aaee7e66f16e4ed5b49394311bd2803a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_aaee7e66f16e4ed5b49394311bd2803a"}]}] Oct 27 03:29:59.772875 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-LiveMigrationTest-428698375 Oct 27 03:29:59.772875 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: aaee7e66f16e4ed5b49394311bd2803a Oct 27 03:29:59.772875 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-LiveMigrationTest-428698375 Oct 27 03:29:59.772875 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-LiveMigrationTest-428698375-project Oct 27 03:29:59.772875 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:29:59.772875 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:29:59.772875 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 8c93886c5818439690564c2299a4f3ee Oct 27 03:29:59.772875 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-LiveMigrationTest-428698375-project Oct 27 03:29:59.772875 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:29:59.772875 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance a8925d29-d9e0-4dbb-a73d-09473255fa34 could not be found. Oct 27 03:29:59.772875 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': 'a8925d29-d9e0-4dbb-a73d-09473255fa34'} Oct 27 03:29:59.772875 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:29:59.772875 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:29:59.772875 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:29:59.772875 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:29:59.772875 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:29:59.772875 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:29:59.772875 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:29:59.772875 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:29:59.772875 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:29:59.772875 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:29:59.772875 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8925d29-d9e0-4dbb-a73d-09473255fa34 could not be found. Oct 27 03:29:59.772875 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:29:59.772875 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:29:59.772875 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:29:59.772875 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:29:59.772875 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:29:59.772875 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:29:59.772875 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:29:59.772875 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:29:59.772875 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:29:59.772875 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:29:59.772875 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:29:59.772875 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:29:59.772875 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:29:59.772875 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:29:59.772875 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:29:59.772875 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:29:59.772875 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8925d29-d9e0-4dbb-a73d-09473255fa34 could not be found. Oct 27 03:29:59.772875 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:29:59.772875 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:29:59.772875 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:29:59.778443 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:29:59.778443 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:29:59.778443 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:29:59.778443 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:29:59.778443 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:29:59.778443 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8925d29-d9e0-4dbb-a73d-09473255fa34 could not be found. Oct 27 03:29:59.778443 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:29:59.779308 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-61f06c36-3d82-4728-80b2-1b3442641906 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:59.779308 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-61f06c36-3d82-4728-80b2-1b3442641906 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:59.779308 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-61f06c36-3d82-4728-80b2-1b3442641906 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:59.779943 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-61f06c36-3d82-4728-80b2-1b3442641906 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:59.780260 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-61f06c36-3d82-4728-80b2-1b3442641906 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:59.781952 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-61f06c36-3d82-4728-80b2-1b3442641906 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:59.785560 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-bba6c0ae-94aa-4a13-b529-8390cc0ce5bb tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Returning 404 to user: Instance a8925d29-d9e0-4dbb-a73d-09473255fa34 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:29:59.789686 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-bba6c0ae-94aa-4a13-b529-8390cc0ce5bb tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34" status: 404 len: 111 microversion: 2.1 time: 0.127781 Oct 27 03:29:59.791533 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1171/2395] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:59 2022] GET /compute/v2.1/servers/a8925d29-d9e0-4dbb-a73d-09473255fa34 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 03:29:59.899689 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3734fc3d-83e4-4c2d-8412-1967fee7c1f7 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:29:59.900987 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-3734fc3d-83e4-4c2d-8412-1967fee7c1f7 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] [instance: 04477d51-f600-483a-aec9-feb992cc6cf7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:29:59.918630 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3734fc3d-83e4-4c2d-8412-1967fee7c1f7 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:59.919667 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3734fc3d-83e4-4c2d-8412-1967fee7c1f7 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:59.920310 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3734fc3d-83e4-4c2d-8412-1967fee7c1f7 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:29:59.921228 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3734fc3d-83e4-4c2d-8412-1967fee7c1f7 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:29:59.921850 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3734fc3d-83e4-4c2d-8412-1967fee7c1f7 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:29:59.923239 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3734fc3d-83e4-4c2d-8412-1967fee7c1f7 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:00.391261 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-3734fc3d-83e4-4c2d-8412-1967fee7c1f7 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421d14944da74570a53d620ea205449d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92082c8718aa41bf96cd84d682d75954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:00.398564 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3734fc3d-83e4-4c2d-8412-1967fee7c1f7 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] 10.222.0.20 "GET /compute/v2.1/servers/04477d51-f600-483a-aec9-feb992cc6cf7" status: 200 len: 1274 microversion: 2.1 time: 0.502641 Oct 27 03:30:00.400316 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1172/2396] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:59 2022] GET /compute/v2.1/servers/04477d51-f600-483a-aec9-feb992cc6cf7 => generated 1274 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:00.405684 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5fbf47ee-1162-43a2-8806-e190a3ab6185 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:00.406437 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5fbf47ee-1162-43a2-8806-e190a3ab6185 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:00.420921 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5fbf47ee-1162-43a2-8806-e190a3ab6185 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:00.421878 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5fbf47ee-1162-43a2-8806-e190a3ab6185 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:00.422793 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5fbf47ee-1162-43a2-8806-e190a3ab6185 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:00.424280 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5fbf47ee-1162-43a2-8806-e190a3ab6185 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:00.426122 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5fbf47ee-1162-43a2-8806-e190a3ab6185 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:00.426829 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5fbf47ee-1162-43a2-8806-e190a3ab6185 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:00.485941 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5fbf47ee-1162-43a2-8806-e190a3ab6185 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:00.487591 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5fbf47ee-1162-43a2-8806-e190a3ab6185 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:00.488414 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5fbf47ee-1162-43a2-8806-e190a3ab6185 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:00.495817 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-5fbf47ee-1162-43a2-8806-e190a3ab6185 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lazy-loading 'fault' on Instance uuid a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:30:00.536941 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-61f06c36-3d82-4728-80b2-1b3442641906 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13e05e253c94aadb1c089128ff35be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8510a519f14deea6f35a437419e161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:00.548147 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-61f06c36-3d82-4728-80b2-1b3442641906 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68" status: 200 len: 1478 microversion: 2.1 time: 0.801059 Oct 27 03:30:00.574876 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1225/2397] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:29:59 2022] GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68 => generated 1478 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:00.574876 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0a2e50ef-f739-4ab4-85b3-267a041d28e4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:00.574876 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0a2e50ef-f739-4ab4-85b3-267a041d28e4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:00.588993 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0a2e50ef-f739-4ab4-85b3-267a041d28e4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:00.592903 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0a2e50ef-f739-4ab4-85b3-267a041d28e4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:00.594753 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0a2e50ef-f739-4ab4-85b3-267a041d28e4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:00.595482 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0a2e50ef-f739-4ab4-85b3-267a041d28e4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:00.597758 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0a2e50ef-f739-4ab4-85b3-267a041d28e4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:00.598734 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0a2e50ef-f739-4ab4-85b3-267a041d28e4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:00.911300 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5fbf47ee-1162-43a2-8806-e190a3ab6185 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6175f2ac39494f8cba3db225150d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae78c307a1504172828e668f915a3677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:00.932887 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5fbf47ee-1162-43a2-8806-e190a3ab6185 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c" status: 200 len: 1297 microversion: 2.1 time: 0.519644 Oct 27 03:30:00.932887 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1173/2398] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:00 2022] GET /compute/v2.1/servers/a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c => generated 1297 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:00.934714 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-9dbc8024-41cc-49ba-9958-223973547dde req-4f3b9034-3a38-4c8c-9dd7-cec405c1298b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed74f42b-af82-4808-bfc2-86110840fe86", "name": "network-vif-plugged", "status": "completed", "tag": "05464839-777e-4176-af2d-6086d6f9acaa"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:30:00.956621 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-9dbc8024-41cc-49ba-9958-223973547dde req-4f3b9034-3a38-4c8c-9dd7-cec405c1298b service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:00.961521 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-9dbc8024-41cc-49ba-9958-223973547dde req-4f3b9034-3a38-4c8c-9dd7-cec405c1298b service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:00.963102 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-9dbc8024-41cc-49ba-9958-223973547dde req-4f3b9034-3a38-4c8c-9dd7-cec405c1298b service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:01.007879 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-9dbc8024-41cc-49ba-9958-223973547dde req-4f3b9034-3a38-4c8c-9dd7-cec405c1298b service nova] Creating event network-vif-plugged:05464839-777e-4176-af2d-6086d6f9acaa for instance ed74f42b-af82-4808-bfc2-86110840fe86 on n-h1-862769-1 Oct 27 03:30:01.025740 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-9dbc8024-41cc-49ba-9958-223973547dde req-4f3b9034-3a38-4c8c-9dd7-cec405c1298b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098271 Oct 27 03:30:01.031956 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1174/2399] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:30:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:30:01.046241 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c1f01a93-3759-4bfa-bb52-092833050b27 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:01.047840 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c1f01a93-3759-4bfa-bb52-092833050b27 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: d5e6f604-9466-45c6-86a8-885cfb393223] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:01.062181 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c1f01a93-3759-4bfa-bb52-092833050b27 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:01.063062 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c1f01a93-3759-4bfa-bb52-092833050b27 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:01.063062 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c1f01a93-3759-4bfa-bb52-092833050b27 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:01.074375 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c1f01a93-3759-4bfa-bb52-092833050b27 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:01.074893 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c1f01a93-3759-4bfa-bb52-092833050b27 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:01.075384 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c1f01a93-3759-4bfa-bb52-092833050b27 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:01.353150 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0a2e50ef-f739-4ab4-85b3-267a041d28e4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:01.364882 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0a2e50ef-f739-4ab4-85b3-267a041d28e4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1365 microversion: 2.1 time: 0.804717 Oct 27 03:30:01.365480 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1226/2400] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:00 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1365 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:01.424680 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-915b37bc-a1e0-473f-a80e-99d64d2e7dee tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:01.426983 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-915b37bc-a1e0-473f-a80e-99d64d2e7dee tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] [instance: 04477d51-f600-483a-aec9-feb992cc6cf7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:01.442863 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-915b37bc-a1e0-473f-a80e-99d64d2e7dee tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:01.443809 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-915b37bc-a1e0-473f-a80e-99d64d2e7dee tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:01.445208 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-915b37bc-a1e0-473f-a80e-99d64d2e7dee tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:01.448017 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-915b37bc-a1e0-473f-a80e-99d64d2e7dee tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:01.450190 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-915b37bc-a1e0-473f-a80e-99d64d2e7dee tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:01.450844 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-915b37bc-a1e0-473f-a80e-99d64d2e7dee tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:01.651016 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c1f01a93-3759-4bfa-bb52-092833050b27 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:01.674641 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c1f01a93-3759-4bfa-bb52-092833050b27 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:01.680026 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c1f01a93-3759-4bfa-bb52-092833050b27 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:01.681722 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c1f01a93-3759-4bfa-bb52-092833050b27 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223" status: 200 len: 1487 microversion: 2.25 time: 0.646829 Oct 27 03:30:01.686211 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1175/2401] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:30:01 2022] GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223 => generated 1487 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:30:01.698580 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f5470d82-3922-4d5c-9cf8-2026a50d0ae6 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:01.699454 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f5470d82-3922-4d5c-9cf8-2026a50d0ae6 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: 339287fc-37b6-455d-96ab-08ab8e2c3e68] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:01.726374 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f5470d82-3922-4d5c-9cf8-2026a50d0ae6 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:01.726374 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f5470d82-3922-4d5c-9cf8-2026a50d0ae6 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:01.727805 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f5470d82-3922-4d5c-9cf8-2026a50d0ae6 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:01.730306 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f5470d82-3922-4d5c-9cf8-2026a50d0ae6 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:01.731140 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f5470d82-3922-4d5c-9cf8-2026a50d0ae6 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:01.735127 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f5470d82-3922-4d5c-9cf8-2026a50d0ae6 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:01.831055 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-915b37bc-a1e0-473f-a80e-99d64d2e7dee tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421d14944da74570a53d620ea205449d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92082c8718aa41bf96cd84d682d75954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:01.859612 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-915b37bc-a1e0-473f-a80e-99d64d2e7dee tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] 10.222.0.20 "GET /compute/v2.1/servers/04477d51-f600-483a-aec9-feb992cc6cf7" status: 200 len: 1316 microversion: 2.1 time: 0.438682 Oct 27 03:30:01.864282 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1227/2402] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:01 2022] GET /compute/v2.1/servers/04477d51-f600-483a-aec9-feb992cc6cf7 => generated 1316 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:30:01.955628 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c104fbf8-4ff9-47f2-b820-c60f84350d29 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:01.957265 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c104fbf8-4ff9-47f2-b820-c60f84350d29 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:01.999552 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c104fbf8-4ff9-47f2-b820-c60f84350d29 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:02.000070 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c104fbf8-4ff9-47f2-b820-c60f84350d29 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:02.000528 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c104fbf8-4ff9-47f2-b820-c60f84350d29 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:02.001239 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c104fbf8-4ff9-47f2-b820-c60f84350d29 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:02.001704 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c104fbf8-4ff9-47f2-b820-c60f84350d29 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:02.015378 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c104fbf8-4ff9-47f2-b820-c60f84350d29 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:02.070505 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-c104fbf8-4ff9-47f2-b820-c60f84350d29 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] HTTP exception thrown: Instance a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c could not be found. Oct 27 03:30:02.078675 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c104fbf8-4ff9-47f2-b820-c60f84350d29 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Request method failure captured: Oct 27 03:30:02.078675 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c HTTP/1.1 Oct 27 03:30:02.078675 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:30:02.078675 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:30:02.078675 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:30:02.078675 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:30:02.078675 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:30:02.078675 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:30:02.078675 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:30:02.078675 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:30:02.078675 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfnAX64GvSXX6j_FGiQQ9IlgyuvfbWxRMGJCqIz8aEuYqDW4EVaQTS_nCBHKSQ3Z4oltdJGbrb3LkQtsJQ-KBbiFsQn0s9yf9n4GDuUzW48O2MfgGJVpAyAl-5qhe5w5ten3MUUxjRyCo9okwgZpH2TZ6ggq8P48i5NICoqXVcmLAEk Oct 27 03:30:02.078675 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:30:02.078675 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:30:02.078675 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:30:02.078675 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:30:02.078675 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:30:02.078675 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:30:02.078675 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: ae78c307a1504172828e668f915a3677 Oct 27 03:30:02.078675 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ImagesTestJSON-2119984465 Oct 27 03:30:02.078675 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:30:02.078675 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:30:02.078675 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ae78c307a1504172828e668f915a3677"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ae78c307a1504172828e668f915a3677"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ae78c307a1504172828e668f915a3677"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ae78c307a1504172828e668f915a3677"}]}] Oct 27 03:30:02.078675 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ImagesTestJSON-2119984465 Oct 27 03:30:02.078675 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: ae78c307a1504172828e668f915a3677 Oct 27 03:30:02.078675 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ImagesTestJSON-2119984465 Oct 27 03:30:02.078675 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ImagesTestJSON-2119984465-project Oct 27 03:30:02.078675 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:30:02.078675 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:30:02.078675 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 1d6175f2ac39494f8cba3db225150d6c Oct 27 03:30:02.078675 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ImagesTestJSON-2119984465-project Oct 27 03:30:02.078675 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:30:02.078675 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c could not be found. Oct 27 03:30:02.078675 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': 'a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c'} Oct 27 03:30:02.078675 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:30:02.078675 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:02.078675 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:30:02.078675 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:30:02.078675 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:30:02.078675 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:30:02.078675 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:30:02.078675 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:30:02.078675 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:30:02.078675 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:30:02.078675 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c could not be found. Oct 27 03:30:02.078675 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:02.078675 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:30:02.078675 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:02.078675 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:02.078675 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:30:02.078675 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:30:02.078675 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:30:02.078675 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:30:02.078675 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:30:02.078675 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:30:02.078675 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:30:02.078675 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:30:02.078675 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:30:02.078675 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:30:02.078675 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:30:02.078675 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:30:02.078675 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c could not be found. Oct 27 03:30:02.078675 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:02.078675 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:30:02.078675 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:02.078675 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:02.083499 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:30:02.083499 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:30:02.083499 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:30:02.083499 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:30:02.083499 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c could not be found. Oct 27 03:30:02.083499 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:02.084867 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c104fbf8-4ff9-47f2-b820-c60f84350d29 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Returning 404 to user: Instance a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:30:02.094121 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c104fbf8-4ff9-47f2-b820-c60f84350d29 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c" status: 404 len: 111 microversion: 2.1 time: 0.141294 Oct 27 03:30:02.094121 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1228/2403] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:01 2022] GET /compute/v2.1/servers/a2d3c4f4-ecc2-4dc3-b000-c1c3bedf671c => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 03:30:02.103855 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-642d6003-01b7-4a46-b6b6-ffc46031efd3 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:02.104648 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-642d6003-01b7-4a46-b6b6-ffc46031efd3 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 1352bd75-bfe6-48e3-a47d-314c7f13f692] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:02.113393 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-642d6003-01b7-4a46-b6b6-ffc46031efd3 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:02.114240 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-642d6003-01b7-4a46-b6b6-ffc46031efd3 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:02.114889 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-642d6003-01b7-4a46-b6b6-ffc46031efd3 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:02.116735 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-642d6003-01b7-4a46-b6b6-ffc46031efd3 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:02.117906 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-642d6003-01b7-4a46-b6b6-ffc46031efd3 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:02.118730 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-642d6003-01b7-4a46-b6b6-ffc46031efd3 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:02.147999 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-642d6003-01b7-4a46-b6b6-ffc46031efd3 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] HTTP exception thrown: Instance 1352bd75-bfe6-48e3-a47d-314c7f13f692 could not be found. Oct 27 03:30:02.155061 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-642d6003-01b7-4a46-b6b6-ffc46031efd3 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Request method failure captured: Oct 27 03:30:02.155061 n-d-862769-1 devstack@n-api.service[121001]: request: DELETE /compute/v2.1/servers/1352bd75-bfe6-48e3-a47d-314c7f13f692 HTTP/1.1 Oct 27 03:30:02.155061 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:30:02.155061 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:30:02.155061 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:30:02.155061 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:30:02.155061 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:30:02.155061 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:30:02.155061 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:30:02.155061 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:30:02.155061 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfnAX64GvSXX6j_FGiQQ9IlgyuvfbWxRMGJCqIz8aEuYqDW4EVaQTS_nCBHKSQ3Z4oltdJGbrb3LkQtsJQ-KBbiFsQn0s9yf9n4GDuUzW48O2MfgGJVpAyAl-5qhe5w5ten3MUUxjRyCo9okwgZpH2TZ6ggq8P48i5NICoqXVcmLAEk Oct 27 03:30:02.155061 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:30:02.155061 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:30:02.155061 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:30:02.155061 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:30:02.155061 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:30:02.155061 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:30:02.155061 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: ae78c307a1504172828e668f915a3677 Oct 27 03:30:02.155061 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ImagesTestJSON-2119984465 Oct 27 03:30:02.155061 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:30:02.155061 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:30:02.155061 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ae78c307a1504172828e668f915a3677"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ae78c307a1504172828e668f915a3677"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ae78c307a1504172828e668f915a3677"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ae78c307a1504172828e668f915a3677"}]}] Oct 27 03:30:02.155061 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ImagesTestJSON-2119984465 Oct 27 03:30:02.155061 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: ae78c307a1504172828e668f915a3677 Oct 27 03:30:02.155061 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ImagesTestJSON-2119984465 Oct 27 03:30:02.155061 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ImagesTestJSON-2119984465-project Oct 27 03:30:02.155061 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:30:02.155061 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:30:02.155061 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 1d6175f2ac39494f8cba3db225150d6c Oct 27 03:30:02.155061 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ImagesTestJSON-2119984465-project Oct 27 03:30:02.155061 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:30:02.155061 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 1352bd75-bfe6-48e3-a47d-314c7f13f692 could not be found. Oct 27 03:30:02.155061 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '1352bd75-bfe6-48e3-a47d-314c7f13f692'} Oct 27 03:30:02.155061 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:30:02.155061 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:02.155061 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:30:02.155061 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:30:02.155061 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:30:02.155061 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:30:02.155061 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:30:02.155061 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:30:02.155061 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:30:02.155061 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:30:02.155061 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1352bd75-bfe6-48e3-a47d-314c7f13f692 could not be found. Oct 27 03:30:02.155061 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:02.155061 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:30:02.155061 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:02.155061 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:02.155061 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:30:02.155061 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:30:02.155061 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:30:02.155061 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:30:02.155061 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:30:02.155061 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:30:02.155061 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 03:30:02.155061 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 03:30:02.155061 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 03:30:02.155061 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 03:30:02.155061 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:30:02.155061 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:30:02.155061 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:30:02.155061 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:30:02.155061 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1352bd75-bfe6-48e3-a47d-314c7f13f692 could not be found. Oct 27 03:30:02.159370 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:02.159370 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:30:02.159370 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:02.159370 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:02.159370 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:30:02.159370 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:30:02.159370 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:30:02.159370 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:30:02.159370 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1352bd75-bfe6-48e3-a47d-314c7f13f692 could not be found. Oct 27 03:30:02.159370 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:02.161314 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-642d6003-01b7-4a46-b6b6-ffc46031efd3 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Returning 404 to user: Instance 1352bd75-bfe6-48e3-a47d-314c7f13f692 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:30:02.163762 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-642d6003-01b7-4a46-b6b6-ffc46031efd3 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1352bd75-bfe6-48e3-a47d-314c7f13f692" status: 404 len: 111 microversion: 2.1 time: 0.066736 Oct 27 03:30:02.165131 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1229/2404] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:30:02 2022] DELETE /compute/v2.1/servers/1352bd75-bfe6-48e3-a47d-314c7f13f692 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 03:30:02.179331 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-95c20a43-356d-4660-b4f1-5fc487d65e07 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:02.183215 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-95c20a43-356d-4660-b4f1-5fc487d65e07 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 1352bd75-bfe6-48e3-a47d-314c7f13f692] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:02.207825 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-95c20a43-356d-4660-b4f1-5fc487d65e07 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:02.210722 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-95c20a43-356d-4660-b4f1-5fc487d65e07 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:02.211344 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-95c20a43-356d-4660-b4f1-5fc487d65e07 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:02.212290 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-95c20a43-356d-4660-b4f1-5fc487d65e07 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:02.212941 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-95c20a43-356d-4660-b4f1-5fc487d65e07 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:02.216866 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-95c20a43-356d-4660-b4f1-5fc487d65e07 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:02.280325 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-95c20a43-356d-4660-b4f1-5fc487d65e07 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] HTTP exception thrown: Instance 1352bd75-bfe6-48e3-a47d-314c7f13f692 could not be found. Oct 27 03:30:02.286130 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-95c20a43-356d-4660-b4f1-5fc487d65e07 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Request method failure captured: Oct 27 03:30:02.286130 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/1352bd75-bfe6-48e3-a47d-314c7f13f692 HTTP/1.1 Oct 27 03:30:02.286130 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:30:02.286130 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:30:02.286130 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:30:02.286130 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:30:02.286130 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:30:02.286130 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:30:02.286130 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:30:02.286130 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:30:02.286130 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfnAX64GvSXX6j_FGiQQ9IlgyuvfbWxRMGJCqIz8aEuYqDW4EVaQTS_nCBHKSQ3Z4oltdJGbrb3LkQtsJQ-KBbiFsQn0s9yf9n4GDuUzW48O2MfgGJVpAyAl-5qhe5w5ten3MUUxjRyCo9okwgZpH2TZ6ggq8P48i5NICoqXVcmLAEk Oct 27 03:30:02.286130 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:30:02.286130 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:30:02.286130 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:30:02.286130 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:30:02.286130 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:30:02.286130 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:30:02.286130 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: ae78c307a1504172828e668f915a3677 Oct 27 03:30:02.286130 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ImagesTestJSON-2119984465 Oct 27 03:30:02.286130 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:30:02.286130 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:30:02.286130 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ae78c307a1504172828e668f915a3677"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ae78c307a1504172828e668f915a3677"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ae78c307a1504172828e668f915a3677"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ae78c307a1504172828e668f915a3677"}]}] Oct 27 03:30:02.286130 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ImagesTestJSON-2119984465 Oct 27 03:30:02.286130 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: ae78c307a1504172828e668f915a3677 Oct 27 03:30:02.286130 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ImagesTestJSON-2119984465 Oct 27 03:30:02.286130 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ImagesTestJSON-2119984465-project Oct 27 03:30:02.286130 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:30:02.286130 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:30:02.286130 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 1d6175f2ac39494f8cba3db225150d6c Oct 27 03:30:02.286130 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ImagesTestJSON-2119984465-project Oct 27 03:30:02.286130 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:30:02.286130 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 1352bd75-bfe6-48e3-a47d-314c7f13f692 could not be found. Oct 27 03:30:02.286130 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '1352bd75-bfe6-48e3-a47d-314c7f13f692'} Oct 27 03:30:02.286130 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:30:02.286130 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:02.286130 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:30:02.286130 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:30:02.286130 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:30:02.286130 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:30:02.286130 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:30:02.286130 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:30:02.286130 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:30:02.286130 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:30:02.286130 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1352bd75-bfe6-48e3-a47d-314c7f13f692 could not be found. Oct 27 03:30:02.286130 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:02.286130 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:30:02.286130 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:02.286130 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:02.286130 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:30:02.286130 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:30:02.286130 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:30:02.286130 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:30:02.286130 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:30:02.286130 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:30:02.286130 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:30:02.286130 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:30:02.286130 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:30:02.286130 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:30:02.286130 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:30:02.286130 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:30:02.286130 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1352bd75-bfe6-48e3-a47d-314c7f13f692 could not be found. Oct 27 03:30:02.286130 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:02.286130 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:30:02.286130 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:02.286130 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:02.291062 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:30:02.291062 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:30:02.291062 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:30:02.291062 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:30:02.291062 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1352bd75-bfe6-48e3-a47d-314c7f13f692 could not be found. Oct 27 03:30:02.291062 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:02.291062 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-95c20a43-356d-4660-b4f1-5fc487d65e07 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Returning 404 to user: Instance 1352bd75-bfe6-48e3-a47d-314c7f13f692 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:30:02.294116 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-95c20a43-356d-4660-b4f1-5fc487d65e07 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/1352bd75-bfe6-48e3-a47d-314c7f13f692" status: 404 len: 111 microversion: 2.1 time: 0.123095 Oct 27 03:30:02.296332 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1230/2405] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:02 2022] GET /compute/v2.1/servers/1352bd75-bfe6-48e3-a47d-314c7f13f692 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:30:02.306305 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4c5f7add-2aab-4a9c-ab81-652b231c1372 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7ddab16c10>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:02.340219 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-4c5f7add-2aab-4a9c-ab81-652b231c1372 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] HTTP exception thrown: Image not found. Oct 27 03:30:02.344703 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4c5f7add-2aab-4a9c-ab81-652b231c1372 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Request method failure captured: Oct 27 03:30:02.344703 n-d-862769-1 devstack@n-api.service[121001]: request: DELETE /compute/v2.1/images/787934da-f249-4af1-9590-fecf6bc5d90f HTTP/1.1 Oct 27 03:30:02.344703 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:30:02.344703 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:30:02.344703 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:30:02.344703 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:30:02.344703 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:30:02.344703 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:30:02.344703 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:30:02.344703 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:30:02.344703 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfnAX64GvSXX6j_FGiQQ9IlgyuvfbWxRMGJCqIz8aEuYqDW4EVaQTS_nCBHKSQ3Z4oltdJGbrb3LkQtsJQ-KBbiFsQn0s9yf9n4GDuUzW48O2MfgGJVpAyAl-5qhe5w5ten3MUUxjRyCo9okwgZpH2TZ6ggq8P48i5NICoqXVcmLAEk Oct 27 03:30:02.344703 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:30:02.344703 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:30:02.344703 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:30:02.344703 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:30:02.344703 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:30:02.344703 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:30:02.344703 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: ae78c307a1504172828e668f915a3677 Oct 27 03:30:02.344703 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ImagesTestJSON-2119984465 Oct 27 03:30:02.344703 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:30:02.344703 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:30:02.344703 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ae78c307a1504172828e668f915a3677"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ae78c307a1504172828e668f915a3677"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ae78c307a1504172828e668f915a3677"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ae78c307a1504172828e668f915a3677"}]}] Oct 27 03:30:02.344703 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ImagesTestJSON-2119984465 Oct 27 03:30:02.344703 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: ae78c307a1504172828e668f915a3677 Oct 27 03:30:02.344703 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ImagesTestJSON-2119984465 Oct 27 03:30:02.344703 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ImagesTestJSON-2119984465-project Oct 27 03:30:02.344703 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:30:02.344703 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:30:02.344703 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 1d6175f2ac39494f8cba3db225150d6c Oct 27 03:30:02.344703 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ImagesTestJSON-2119984465-project Oct 27 03:30:02.344703 n-d-862769-1 devstack@n-api.service[121001]: method: Oct 27 03:30:02.344703 n-d-862769-1 devstack@n-api.service[121001]: exception: Image not found. Oct 27 03:30:02.344703 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '787934da-f249-4af1-9590-fecf6bc5d90f'} Oct 27 03:30:02.344703 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:30:02.344703 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:02.344703 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 27 03:30:02.344703 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 27 03:30:02.344703 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 03:30:02.344703 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 03:30:02.344703 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 03:30:02.344703 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 03:30:02.344703 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 27 03:30:02.344703 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 27 03:30:02.344703 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 27 03:30:02.344703 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 27 03:30:02.344703 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 03:30:02.344703 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 03:30:02.344703 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 03:30:02.344703 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 03:30:02.344703 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 787934da-f249-4af1-9590-fecf6bc5d90f to delete Oct 27 03:30:02.344703 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:02.344703 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:30:02.344703 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:02.344703 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:02.344703 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 27 03:30:02.344703 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 27 03:30:02.344703 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 27 03:30:02.344703 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 27 03:30:02.344703 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 27 03:30:02.344703 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 27 03:30:02.344703 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 787934da-f249-4af1-9590-fecf6bc5d90f could not be found. Oct 27 03:30:02.344703 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:02.344703 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:30:02.344703 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:02.344703 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:02.359603 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:30:02.359603 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:30:02.359603 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:30:02.359603 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:30:02.359603 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:30:02.359603 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:30:02.359603 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:30:02.359603 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:30:02.359603 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 27 03:30:02.359603 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 27 03:30:02.359603 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 27 03:30:02.359603 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:02.359603 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:30:02.359603 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:02.359603 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:02.359603 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:30:02.359603 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:30:02.359603 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:30:02.359603 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:30:02.359603 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 27 03:30:02.359603 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:02.359603 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4c5f7add-2aab-4a9c-ab81-652b231c1372 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Returning 404 to user: Image not found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:30:02.359603 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4c5f7add-2aab-4a9c-ab81-652b231c1372 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "DELETE /compute/v2.1/images/787934da-f249-4af1-9590-fecf6bc5d90f" status: 404 len: 62 microversion: 2.1 time: 0.047724 Oct 27 03:30:02.359603 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1231/2406] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:02 2022] DELETE /compute/v2.1/images/787934da-f249-4af1-9590-fecf6bc5d90f => generated 62 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 27 03:30:02.376940 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f5470d82-3922-4d5c-9cf8-2026a50d0ae6 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13e05e253c94aadb1c089128ff35be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8510a519f14deea6f35a437419e161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:02.393348 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f5470d82-3922-4d5c-9cf8-2026a50d0ae6 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68" status: 200 len: 1463 microversion: 2.1 time: 0.704515 Oct 27 03:30:02.394578 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1176/2407] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:01 2022] GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68 => generated 1463 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:02.404974 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-45f991c3-dc0b-424e-b660-317e51d98313 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:02.408208 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-45f991c3-dc0b-424e-b660-317e51d98313 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 49f0475c-d9eb-4ad0-9f88-322521def6c7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:02.445023 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-45f991c3-dc0b-424e-b660-317e51d98313 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:02.451838 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-45f991c3-dc0b-424e-b660-317e51d98313 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:02.453292 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-45f991c3-dc0b-424e-b660-317e51d98313 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:02.456585 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-45f991c3-dc0b-424e-b660-317e51d98313 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:02.459660 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-45f991c3-dc0b-424e-b660-317e51d98313 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:02.463218 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-45f991c3-dc0b-424e-b660-317e51d98313 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:02.502390 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-bf99cc64-b036-4778-acba-e156673abe12 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-93070942", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": [{"uuid": "fa9b6ffb-ca88-4b13-b9ae-05763aa7fc68"}]}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:30:02.511479 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:30:02.515681 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-45f991c3-dc0b-424e-b660-317e51d98313 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] HTTP exception thrown: Instance 49f0475c-d9eb-4ad0-9f88-322521def6c7 could not be found. Oct 27 03:30:02.530339 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-45f991c3-dc0b-424e-b660-317e51d98313 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Request method failure captured: Oct 27 03:30:02.530339 n-d-862769-1 devstack@n-api.service[121000]: request: DELETE /compute/v2.1/servers/49f0475c-d9eb-4ad0-9f88-322521def6c7 HTTP/1.1 Oct 27 03:30:02.530339 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:30:02.530339 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:30:02.530339 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:30:02.530339 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:30:02.530339 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:30:02.530339 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:30:02.530339 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:30:02.530339 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:30:02.530339 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfnAX64GvSXX6j_FGiQQ9IlgyuvfbWxRMGJCqIz8aEuYqDW4EVaQTS_nCBHKSQ3Z4oltdJGbrb3LkQtsJQ-KBbiFsQn0s9yf9n4GDuUzW48O2MfgGJVpAyAl-5qhe5w5ten3MUUxjRyCo9okwgZpH2TZ6ggq8P48i5NICoqXVcmLAEk Oct 27 03:30:02.530339 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:30:02.530339 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:30:02.530339 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:30:02.530339 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:30:02.530339 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:30:02.530339 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:30:02.530339 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: ae78c307a1504172828e668f915a3677 Oct 27 03:30:02.530339 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ImagesTestJSON-2119984465 Oct 27 03:30:02.530339 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:30:02.530339 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:30:02.530339 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ae78c307a1504172828e668f915a3677"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ae78c307a1504172828e668f915a3677"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ae78c307a1504172828e668f915a3677"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ae78c307a1504172828e668f915a3677"}]}] Oct 27 03:30:02.530339 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ImagesTestJSON-2119984465 Oct 27 03:30:02.530339 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: ae78c307a1504172828e668f915a3677 Oct 27 03:30:02.530339 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ImagesTestJSON-2119984465 Oct 27 03:30:02.530339 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ImagesTestJSON-2119984465-project Oct 27 03:30:02.530339 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:30:02.530339 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:30:02.530339 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 1d6175f2ac39494f8cba3db225150d6c Oct 27 03:30:02.530339 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ImagesTestJSON-2119984465-project Oct 27 03:30:02.530339 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:30:02.530339 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 49f0475c-d9eb-4ad0-9f88-322521def6c7 could not be found. Oct 27 03:30:02.530339 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '49f0475c-d9eb-4ad0-9f88-322521def6c7'} Oct 27 03:30:02.530339 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:30:02.530339 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:02.530339 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:30:02.530339 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:30:02.530339 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:30:02.530339 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:30:02.530339 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:30:02.530339 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:30:02.530339 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:30:02.530339 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:30:02.530339 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49f0475c-d9eb-4ad0-9f88-322521def6c7 could not be found. Oct 27 03:30:02.530339 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:02.530339 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:30:02.530339 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:02.530339 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:02.530339 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:30:02.530339 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:30:02.530339 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:30:02.530339 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:30:02.530339 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:30:02.530339 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:30:02.530339 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 03:30:02.530339 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 03:30:02.530339 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 03:30:02.530339 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 03:30:02.530339 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:30:02.530339 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:30:02.530339 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:30:02.530339 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:30:02.530339 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49f0475c-d9eb-4ad0-9f88-322521def6c7 could not be found. Oct 27 03:30:02.533744 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:02.533744 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:30:02.533744 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:02.533744 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:02.533744 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:30:02.533744 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:30:02.533744 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:30:02.533744 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:30:02.533744 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49f0475c-d9eb-4ad0-9f88-322521def6c7 could not be found. Oct 27 03:30:02.533744 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:02.533744 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-45f991c3-dc0b-424e-b660-317e51d98313 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Returning 404 to user: Instance 49f0475c-d9eb-4ad0-9f88-322521def6c7 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:30:02.537687 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-45f991c3-dc0b-424e-b660-317e51d98313 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "DELETE /compute/v2.1/servers/49f0475c-d9eb-4ad0-9f88-322521def6c7" status: 404 len: 111 microversion: 2.1 time: 0.141344 Oct 27 03:30:02.540416 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1177/2408] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:30:02 2022] DELETE /compute/v2.1/servers/49f0475c-d9eb-4ad0-9f88-322521def6c7 => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:30:02.551909 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-fdfc77c1-40f1-46a7-ac65-4fc1b706071e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:02.553476 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-fdfc77c1-40f1-46a7-ac65-4fc1b706071e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:02.568920 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fdfc77c1-40f1-46a7-ac65-4fc1b706071e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:02.570581 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fdfc77c1-40f1-46a7-ac65-4fc1b706071e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:02.573689 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fdfc77c1-40f1-46a7-ac65-4fc1b706071e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:02.578252 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fdfc77c1-40f1-46a7-ac65-4fc1b706071e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:02.579006 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fdfc77c1-40f1-46a7-ac65-4fc1b706071e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:02.579796 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fdfc77c1-40f1-46a7-ac65-4fc1b706071e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:02.580373 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.network.neutron [None req-bf99cc64-b036-4778-acba-e156673abe12 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] validate_networks() for [('fa9b6ffb-ca88-4b13-b9ae-05763aa7fc68', None, None, None, None, None)] {{(pid=121001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:30:02.957215 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-fdfc77c1-40f1-46a7-ac65-4fc1b706071e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:02.977177 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-fdfc77c1-40f1-46a7-ac65-4fc1b706071e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1365 microversion: 2.1 time: 0.435590 Oct 27 03:30:02.978076 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1178/2409] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:02 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1365 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:02.997968 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-066e6bcb-cd43-41eb-b6bd-437487dafab4 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:30:03.007386 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-066e6bcb-cd43-41eb-b6bd-437487dafab4 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] [instance: 339287fc-37b6-455d-96ab-08ab8e2c3e68] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:03.029289 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-066e6bcb-cd43-41eb-b6bd-437487dafab4 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:03.039727 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-066e6bcb-cd43-41eb-b6bd-437487dafab4 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:03.040294 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-066e6bcb-cd43-41eb-b6bd-437487dafab4 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:03.041846 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-066e6bcb-cd43-41eb-b6bd-437487dafab4 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:03.046493 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-066e6bcb-cd43-41eb-b6bd-437487dafab4 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:03.046493 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-066e6bcb-cd43-41eb-b6bd-437487dafab4 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:03.235530 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-bf99cc64-b036-4778-acba-e156673abe12 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Flavor limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:30:03.236044 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-bf99cc64-b036-4778-acba-e156673abe12 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Image limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:30:03.236570 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-bf99cc64-b036-4778-acba-e156673abe12 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Flavor pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:30:03.237064 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-bf99cc64-b036-4778-acba-e156673abe12 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Image pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:30:03.237845 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-bf99cc64-b036-4778-acba-e156673abe12 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:30:03.253368 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bf99cc64-b036-4778-acba-e156673abe12 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:03.254674 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bf99cc64-b036-4778-acba-e156673abe12 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:03.258513 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bf99cc64-b036-4778-acba-e156673abe12 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:03.259546 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bf99cc64-b036-4778-acba-e156673abe12 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:03.260223 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bf99cc64-b036-4778-acba-e156673abe12 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:03.260841 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bf99cc64-b036-4778-acba-e156673abe12 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:03.309675 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-bf99cc64-b036-4778-acba-e156673abe12 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Getting quotas for project 561891c49901486c9d7651688f88b0eb. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:30:03.324847 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-bf99cc64-b036-4778-acba-e156673abe12 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Getting quotas for user c3e64f7f0501454fa8474aa61c9a8c5b and project 561891c49901486c9d7651688f88b0eb. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:30:03.352626 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-bf99cc64-b036-4778-acba-e156673abe12 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Going to run 1 instances... {{(pid=121001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:30:03.356628 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-bf99cc64-b036-4778-acba-e156673abe12 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] [instance: ba3e02bc-d621-49e5-8e81-0d33828d816f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:30:03.453725 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=8 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:30:03.597542 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-bf99cc64-b036-4778-acba-e156673abe12 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.245538 Oct 27 03:30:03.598421 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1232/2410] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:30:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1248 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 03:30:03.605688 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-eabdfbef-6e2c-4669-bcae-05868e57315a tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:03.610113 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-eabdfbef-6e2c-4669-bcae-05868e57315a tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 49f0475c-d9eb-4ad0-9f88-322521def6c7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:03.623345 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eabdfbef-6e2c-4669-bcae-05868e57315a tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:03.625920 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eabdfbef-6e2c-4669-bcae-05868e57315a tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:03.626995 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eabdfbef-6e2c-4669-bcae-05868e57315a tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:03.631527 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eabdfbef-6e2c-4669-bcae-05868e57315a tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:03.632470 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eabdfbef-6e2c-4669-bcae-05868e57315a tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:03.639397 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eabdfbef-6e2c-4669-bcae-05868e57315a tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:03.657933 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-eabdfbef-6e2c-4669-bcae-05868e57315a tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] HTTP exception thrown: Instance 49f0475c-d9eb-4ad0-9f88-322521def6c7 could not be found. Oct 27 03:30:03.659845 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-eabdfbef-6e2c-4669-bcae-05868e57315a tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Request method failure captured: Oct 27 03:30:03.659845 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/49f0475c-d9eb-4ad0-9f88-322521def6c7 HTTP/1.1 Oct 27 03:30:03.659845 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:30:03.659845 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:30:03.659845 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:30:03.659845 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:30:03.659845 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:30:03.659845 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:30:03.659845 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:30:03.659845 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:30:03.659845 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfnAX64GvSXX6j_FGiQQ9IlgyuvfbWxRMGJCqIz8aEuYqDW4EVaQTS_nCBHKSQ3Z4oltdJGbrb3LkQtsJQ-KBbiFsQn0s9yf9n4GDuUzW48O2MfgGJVpAyAl-5qhe5w5ten3MUUxjRyCo9okwgZpH2TZ6ggq8P48i5NICoqXVcmLAEk Oct 27 03:30:03.659845 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:30:03.659845 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:30:03.659845 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:30:03.659845 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:30:03.659845 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:30:03.659845 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:30:03.659845 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: ae78c307a1504172828e668f915a3677 Oct 27 03:30:03.659845 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ImagesTestJSON-2119984465 Oct 27 03:30:03.659845 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:30:03.659845 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:30:03.659845 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ae78c307a1504172828e668f915a3677"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ae78c307a1504172828e668f915a3677"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ae78c307a1504172828e668f915a3677"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ae78c307a1504172828e668f915a3677"}]}] Oct 27 03:30:03.659845 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ImagesTestJSON-2119984465 Oct 27 03:30:03.659845 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: ae78c307a1504172828e668f915a3677 Oct 27 03:30:03.659845 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ImagesTestJSON-2119984465 Oct 27 03:30:03.659845 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ImagesTestJSON-2119984465-project Oct 27 03:30:03.659845 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:30:03.659845 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:30:03.659845 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 1d6175f2ac39494f8cba3db225150d6c Oct 27 03:30:03.659845 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ImagesTestJSON-2119984465-project Oct 27 03:30:03.659845 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:30:03.659845 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 49f0475c-d9eb-4ad0-9f88-322521def6c7 could not be found. Oct 27 03:30:03.659845 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '49f0475c-d9eb-4ad0-9f88-322521def6c7'} Oct 27 03:30:03.659845 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:30:03.659845 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:03.659845 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:30:03.659845 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:30:03.659845 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:30:03.659845 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:30:03.659845 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:30:03.659845 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:30:03.659845 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:30:03.659845 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:30:03.659845 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49f0475c-d9eb-4ad0-9f88-322521def6c7 could not be found. Oct 27 03:30:03.659845 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:03.659845 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:30:03.659845 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:03.659845 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:03.659845 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:30:03.659845 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:30:03.659845 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:30:03.659845 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:30:03.659845 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:30:03.659845 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:30:03.659845 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:30:03.659845 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:30:03.659845 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:30:03.659845 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:30:03.659845 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:30:03.659845 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:30:03.659845 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49f0475c-d9eb-4ad0-9f88-322521def6c7 could not be found. Oct 27 03:30:03.659845 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:03.659845 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:30:03.659845 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:03.659845 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:03.666712 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:30:03.666712 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:30:03.666712 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:30:03.666712 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:30:03.666712 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49f0475c-d9eb-4ad0-9f88-322521def6c7 could not be found. Oct 27 03:30:03.666712 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:03.666712 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-eabdfbef-6e2c-4669-bcae-05868e57315a tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Returning 404 to user: Instance 49f0475c-d9eb-4ad0-9f88-322521def6c7 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:30:03.667087 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-066e6bcb-cd43-41eb-b6bd-437487dafab4 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68/action" status: 202 len: 0 microversion: 2.1 time: 0.681329 Oct 27 03:30:03.667087 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1179/2411] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:30:02 2022] POST /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68/action => generated 0 bytes in 683 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:30:03.667208 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-eabdfbef-6e2c-4669-bcae-05868e57315a tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/49f0475c-d9eb-4ad0-9f88-322521def6c7" status: 404 len: 111 microversion: 2.1 time: 0.062118 Oct 27 03:30:03.667208 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1233/2412] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:03 2022] GET /compute/v2.1/servers/49f0475c-d9eb-4ad0-9f88-322521def6c7 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:30:03.668106 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0e320b18-b77d-43e7-9ff9-f18e05f2a7ea tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:03.668710 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0e320b18-b77d-43e7-9ff9-f18e05f2a7ea tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: d5e6f604-9466-45c6-86a8-885cfb393223] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:03.673789 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f99194b9-073d-4728-a326-ead23af5bcdd tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:03.674668 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f99194b9-073d-4728-a326-ead23af5bcdd tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] [instance: 04477d51-f600-483a-aec9-feb992cc6cf7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:03.683118 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f99194b9-073d-4728-a326-ead23af5bcdd tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:03.684006 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f99194b9-073d-4728-a326-ead23af5bcdd tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:03.685527 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f99194b9-073d-4728-a326-ead23af5bcdd tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:03.686482 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f99194b9-073d-4728-a326-ead23af5bcdd tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:03.687873 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0e320b18-b77d-43e7-9ff9-f18e05f2a7ea tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:03.696672 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f99194b9-073d-4728-a326-ead23af5bcdd tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:03.696672 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f99194b9-073d-4728-a326-ead23af5bcdd tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:03.696891 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0e320b18-b77d-43e7-9ff9-f18e05f2a7ea tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:03.696891 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0e320b18-b77d-43e7-9ff9-f18e05f2a7ea tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:03.696891 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0e320b18-b77d-43e7-9ff9-f18e05f2a7ea tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:03.696891 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0e320b18-b77d-43e7-9ff9-f18e05f2a7ea tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:03.696891 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0e320b18-b77d-43e7-9ff9-f18e05f2a7ea tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:03.924014 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0e320b18-b77d-43e7-9ff9-f18e05f2a7ea tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:03.924396 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f99194b9-073d-4728-a326-ead23af5bcdd tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421d14944da74570a53d620ea205449d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92082c8718aa41bf96cd84d682d75954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:03.936701 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f99194b9-073d-4728-a326-ead23af5bcdd tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] 10.222.0.20 "GET /compute/v2.1/servers/04477d51-f600-483a-aec9-feb992cc6cf7" status: 200 len: 1316 microversion: 2.1 time: 0.273041 Oct 27 03:30:03.936827 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0e320b18-b77d-43e7-9ff9-f18e05f2a7ea tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:03.938672 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0e320b18-b77d-43e7-9ff9-f18e05f2a7ea tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:03.944691 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0e320b18-b77d-43e7-9ff9-f18e05f2a7ea tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223" status: 200 len: 1487 microversion: 2.25 time: 0.277514 Oct 27 03:30:03.944781 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1234/2413] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:03 2022] GET /compute/v2.1/servers/04477d51-f600-483a-aec9-feb992cc6cf7 => generated 1316 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:03.952107 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1180/2414] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:30:03 2022] GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223 => generated 1487 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:30:03.953550 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d7ca3fcc-b93e-46d0-a0ef-e6dea4e4cd05 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:03.955592 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d7ca3fcc-b93e-46d0-a0ef-e6dea4e4cd05 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] [instance: ba3e02bc-d621-49e5-8e81-0d33828d816f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:03.983132 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1fe4ad8a-d0b0-422f-ac3e-e1c6b4f3d7c5 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:03.984288 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1fe4ad8a-d0b0-422f-ac3e-e1c6b4f3d7c5 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] [instance: 339287fc-37b6-455d-96ab-08ab8e2c3e68] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:03.992058 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1fe4ad8a-d0b0-422f-ac3e-e1c6b4f3d7c5 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:03.992805 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1fe4ad8a-d0b0-422f-ac3e-e1c6b4f3d7c5 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:03.993387 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1fe4ad8a-d0b0-422f-ac3e-e1c6b4f3d7c5 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:03.994278 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1fe4ad8a-d0b0-422f-ac3e-e1c6b4f3d7c5 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:03.996851 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1fe4ad8a-d0b0-422f-ac3e-e1c6b4f3d7c5 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:03.998140 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1fe4ad8a-d0b0-422f-ac3e-e1c6b4f3d7c5 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:04.027935 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d7ca3fcc-b93e-46d0-a0ef-e6dea4e4cd05 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e64f7f0501454fa8474aa61c9a8c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561891c49901486c9d7651688f88b0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:04.040196 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d7ca3fcc-b93e-46d0-a0ef-e6dea4e4cd05 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] 10.222.0.20 "GET /compute/v2.1/servers/ba3e02bc-d621-49e5-8e81-0d33828d816f" status: 200 len: 1223 microversion: 2.1 time: 0.093904 Oct 27 03:30:04.043635 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1235/2415] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:03 2022] GET /compute/v2.1/servers/ba3e02bc-d621-49e5-8e81-0d33828d816f => generated 1223 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:04.063824 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3719b2e1-46b6-4bd3-adf2-2ae688129f68 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7dda050430>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:04.092817 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-3719b2e1-46b6-4bd3-adf2-2ae688129f68 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] HTTP exception thrown: Image not found. Oct 27 03:30:04.094787 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1fe4ad8a-d0b0-422f-ac3e-e1c6b4f3d7c5 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:04.096446 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1fe4ad8a-d0b0-422f-ac3e-e1c6b4f3d7c5 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:04.097531 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3719b2e1-46b6-4bd3-adf2-2ae688129f68 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Request method failure captured: Oct 27 03:30:04.097531 n-d-862769-1 devstack@n-api.service[121001]: request: DELETE /compute/v2.1/images/83da6741-8184-4eb0-a871-04737ab02803 HTTP/1.1 Oct 27 03:30:04.097531 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:30:04.097531 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:30:04.097531 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:30:04.097531 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:30:04.097531 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:30:04.097531 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:30:04.097531 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:30:04.097531 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:30:04.097531 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfnAX64GvSXX6j_FGiQQ9IlgyuvfbWxRMGJCqIz8aEuYqDW4EVaQTS_nCBHKSQ3Z4oltdJGbrb3LkQtsJQ-KBbiFsQn0s9yf9n4GDuUzW48O2MfgGJVpAyAl-5qhe5w5ten3MUUxjRyCo9okwgZpH2TZ6ggq8P48i5NICoqXVcmLAEk Oct 27 03:30:04.097531 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:30:04.097531 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:30:04.097531 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:30:04.097531 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:30:04.097531 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:30:04.097531 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:30:04.097531 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: ae78c307a1504172828e668f915a3677 Oct 27 03:30:04.097531 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ImagesTestJSON-2119984465 Oct 27 03:30:04.097531 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:30:04.097531 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:30:04.097531 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ae78c307a1504172828e668f915a3677"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ae78c307a1504172828e668f915a3677"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ae78c307a1504172828e668f915a3677"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ae78c307a1504172828e668f915a3677"}]}] Oct 27 03:30:04.097531 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ImagesTestJSON-2119984465 Oct 27 03:30:04.097531 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: ae78c307a1504172828e668f915a3677 Oct 27 03:30:04.097531 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ImagesTestJSON-2119984465 Oct 27 03:30:04.097531 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ImagesTestJSON-2119984465-project Oct 27 03:30:04.097531 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:30:04.097531 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:30:04.097531 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 1d6175f2ac39494f8cba3db225150d6c Oct 27 03:30:04.097531 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ImagesTestJSON-2119984465-project Oct 27 03:30:04.097531 n-d-862769-1 devstack@n-api.service[121001]: method: Oct 27 03:30:04.097531 n-d-862769-1 devstack@n-api.service[121001]: exception: Image not found. Oct 27 03:30:04.097531 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '83da6741-8184-4eb0-a871-04737ab02803'} Oct 27 03:30:04.097531 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:30:04.097531 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:04.097531 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 27 03:30:04.097531 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 27 03:30:04.097531 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 03:30:04.097531 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 03:30:04.097531 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 03:30:04.097531 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 03:30:04.097531 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 27 03:30:04.097531 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 27 03:30:04.097531 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 27 03:30:04.097531 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 27 03:30:04.097531 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 03:30:04.097531 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 03:30:04.097531 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 03:30:04.097531 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 03:30:04.097531 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 83da6741-8184-4eb0-a871-04737ab02803 to delete Oct 27 03:30:04.097531 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:04.097531 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:30:04.097531 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:04.097531 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:04.097531 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 27 03:30:04.097531 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 27 03:30:04.097531 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 27 03:30:04.097531 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 27 03:30:04.097531 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 27 03:30:04.097531 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 27 03:30:04.097531 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 83da6741-8184-4eb0-a871-04737ab02803 could not be found. Oct 27 03:30:04.097531 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:04.097531 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:30:04.097531 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:04.097531 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:04.101564 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:30:04.101564 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:30:04.101564 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:30:04.101564 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:30:04.101564 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:30:04.101564 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:30:04.101564 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:30:04.101564 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:30:04.101564 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 27 03:30:04.101564 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 27 03:30:04.101564 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 27 03:30:04.101564 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:04.101564 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:30:04.101564 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:04.101564 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:04.101564 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:30:04.101564 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:30:04.101564 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:30:04.101564 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:30:04.101564 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 27 03:30:04.101564 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:04.103399 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1fe4ad8a-d0b0-422f-ac3e-e1c6b4f3d7c5 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:04.104264 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3719b2e1-46b6-4bd3-adf2-2ae688129f68 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Returning 404 to user: Image not found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:30:04.104921 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-1fe4ad8a-d0b0-422f-ac3e-e1c6b4f3d7c5 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Lazy-loading 'fault' on Instance uuid 339287fc-37b6-455d-96ab-08ab8e2c3e68 {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:30:04.105524 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3719b2e1-46b6-4bd3-adf2-2ae688129f68 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "DELETE /compute/v2.1/images/83da6741-8184-4eb0-a871-04737ab02803" status: 404 len: 62 microversion: 2.1 time: 0.062899 Oct 27 03:30:04.106462 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1236/2416] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:04 2022] DELETE /compute/v2.1/images/83da6741-8184-4eb0-a871-04737ab02803 => generated 62 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 03:30:04.122254 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7989d35a-4ae0-4c14-b884-6d25cefb6bf6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:04.123979 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7989d35a-4ae0-4c14-b884-6d25cefb6bf6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:04.131720 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7989d35a-4ae0-4c14-b884-6d25cefb6bf6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:04.132651 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7989d35a-4ae0-4c14-b884-6d25cefb6bf6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:04.133337 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7989d35a-4ae0-4c14-b884-6d25cefb6bf6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:04.135139 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7989d35a-4ae0-4c14-b884-6d25cefb6bf6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:04.135786 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7989d35a-4ae0-4c14-b884-6d25cefb6bf6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:04.136377 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7989d35a-4ae0-4c14-b884-6d25cefb6bf6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:04.375840 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1fe4ad8a-d0b0-422f-ac3e-e1c6b4f3d7c5 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68" status: 200 len: 1597 microversion: 2.1 time: 0.410669 Oct 27 03:30:04.377724 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1181/2417] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:03 2022] GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68 => generated 1597 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:04.389458 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7989d35a-4ae0-4c14-b884-6d25cefb6bf6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:04.390011 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-b253bc34-2df7-4b0c-ba59-2b912626c6e0 req-c8015eff-010f-4131-8192-0177c2415446 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04477d51-f600-483a-aec9-feb992cc6cf7", "tag": "5bbab630-1088-4a87-96b5-3098b0dbf41f"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:30:04.399278 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7989d35a-4ae0-4c14-b884-6d25cefb6bf6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1551 microversion: 2.1 time: 0.291365 Oct 27 03:30:04.413245 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-b253bc34-2df7-4b0c-ba59-2b912626c6e0 req-c8015eff-010f-4131-8192-0177c2415446 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:04.414067 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-b253bc34-2df7-4b0c-ba59-2b912626c6e0 req-c8015eff-010f-4131-8192-0177c2415446 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:04.414979 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1237/2418] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:04 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1551 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:04.420219 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-b253bc34-2df7-4b0c-ba59-2b912626c6e0 req-c8015eff-010f-4131-8192-0177c2415446 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:04.426344 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-67eb234e-a56c-4916-8e5f-0646e073f286 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:04.427075 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-67eb234e-a56c-4916-8e5f-0646e073f286 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 2be00171-65ea-411a-b2d8-86b4e42d5de9] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:04.434109 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-67eb234e-a56c-4916-8e5f-0646e073f286 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:04.434789 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-67eb234e-a56c-4916-8e5f-0646e073f286 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:04.435727 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-67eb234e-a56c-4916-8e5f-0646e073f286 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:04.436601 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-67eb234e-a56c-4916-8e5f-0646e073f286 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:04.438147 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-67eb234e-a56c-4916-8e5f-0646e073f286 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:04.438760 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-67eb234e-a56c-4916-8e5f-0646e073f286 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:04.455129 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-67eb234e-a56c-4916-8e5f-0646e073f286 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] HTTP exception thrown: Instance 2be00171-65ea-411a-b2d8-86b4e42d5de9 could not be found. Oct 27 03:30:04.455674 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-b253bc34-2df7-4b0c-ba59-2b912626c6e0 req-c8015eff-010f-4131-8192-0177c2415446 service nova] Creating event network-changed:5bbab630-1088-4a87-96b5-3098b0dbf41f for instance 04477d51-f600-483a-aec9-feb992cc6cf7 on n-h1-862769-1 Oct 27 03:30:04.457965 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-67eb234e-a56c-4916-8e5f-0646e073f286 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Request method failure captured: Oct 27 03:30:04.457965 n-d-862769-1 devstack@n-api.service[121001]: request: DELETE /compute/v2.1/servers/2be00171-65ea-411a-b2d8-86b4e42d5de9 HTTP/1.1 Oct 27 03:30:04.457965 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:30:04.457965 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:30:04.457965 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:30:04.457965 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:30:04.457965 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:30:04.457965 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:30:04.457965 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:30:04.457965 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:30:04.457965 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfnAX64GvSXX6j_FGiQQ9IlgyuvfbWxRMGJCqIz8aEuYqDW4EVaQTS_nCBHKSQ3Z4oltdJGbrb3LkQtsJQ-KBbiFsQn0s9yf9n4GDuUzW48O2MfgGJVpAyAl-5qhe5w5ten3MUUxjRyCo9okwgZpH2TZ6ggq8P48i5NICoqXVcmLAEk Oct 27 03:30:04.457965 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:30:04.457965 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:30:04.457965 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:30:04.457965 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:30:04.457965 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:30:04.457965 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:30:04.457965 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: ae78c307a1504172828e668f915a3677 Oct 27 03:30:04.457965 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ImagesTestJSON-2119984465 Oct 27 03:30:04.457965 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:30:04.457965 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:30:04.457965 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ae78c307a1504172828e668f915a3677"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ae78c307a1504172828e668f915a3677"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ae78c307a1504172828e668f915a3677"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ae78c307a1504172828e668f915a3677"}]}] Oct 27 03:30:04.457965 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ImagesTestJSON-2119984465 Oct 27 03:30:04.457965 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: ae78c307a1504172828e668f915a3677 Oct 27 03:30:04.457965 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ImagesTestJSON-2119984465 Oct 27 03:30:04.457965 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ImagesTestJSON-2119984465-project Oct 27 03:30:04.457965 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:30:04.457965 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:30:04.457965 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 1d6175f2ac39494f8cba3db225150d6c Oct 27 03:30:04.457965 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ImagesTestJSON-2119984465-project Oct 27 03:30:04.457965 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:30:04.457965 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 2be00171-65ea-411a-b2d8-86b4e42d5de9 could not be found. Oct 27 03:30:04.457965 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '2be00171-65ea-411a-b2d8-86b4e42d5de9'} Oct 27 03:30:04.457965 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:30:04.457965 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:04.457965 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:30:04.457965 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:30:04.457965 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:30:04.457965 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:30:04.457965 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:30:04.457965 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:30:04.457965 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:30:04.457965 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:30:04.457965 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2be00171-65ea-411a-b2d8-86b4e42d5de9 could not be found. Oct 27 03:30:04.457965 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:04.457965 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:30:04.457965 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:04.457965 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:04.457965 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:30:04.457965 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:30:04.457965 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:30:04.457965 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:30:04.457965 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:30:04.457965 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:30:04.457965 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 03:30:04.457965 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 03:30:04.457965 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 03:30:04.457965 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 03:30:04.457965 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:30:04.457965 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:30:04.457965 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:30:04.457965 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:30:04.457965 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2be00171-65ea-411a-b2d8-86b4e42d5de9 could not be found. Oct 27 03:30:04.461795 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:04.461795 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:30:04.461795 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:04.461795 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:04.461795 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:30:04.461795 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:30:04.461795 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:30:04.461795 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:30:04.461795 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2be00171-65ea-411a-b2d8-86b4e42d5de9 could not be found. Oct 27 03:30:04.461795 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:04.463730 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-67eb234e-a56c-4916-8e5f-0646e073f286 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Returning 404 to user: Instance 2be00171-65ea-411a-b2d8-86b4e42d5de9 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:30:04.464823 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-67eb234e-a56c-4916-8e5f-0646e073f286 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2be00171-65ea-411a-b2d8-86b4e42d5de9" status: 404 len: 111 microversion: 2.1 time: 0.048730 Oct 27 03:30:04.466209 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1238/2419] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:30:04 2022] DELETE /compute/v2.1/servers/2be00171-65ea-411a-b2d8-86b4e42d5de9 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:30:04.473574 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-612fdba3-6b1c-4fe2-a5d6-0a54d1f7c14b tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:30:04.476576 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-612fdba3-6b1c-4fe2-a5d6-0a54d1f7c14b tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] [instance: 339287fc-37b6-455d-96ab-08ab8e2c3e68] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:04.483965 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-612fdba3-6b1c-4fe2-a5d6-0a54d1f7c14b tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:04.484716 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-612fdba3-6b1c-4fe2-a5d6-0a54d1f7c14b tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:04.485320 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-612fdba3-6b1c-4fe2-a5d6-0a54d1f7c14b tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:04.487043 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-612fdba3-6b1c-4fe2-a5d6-0a54d1f7c14b tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:04.487167 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-b253bc34-2df7-4b0c-ba59-2b912626c6e0 req-c8015eff-010f-4131-8192-0177c2415446 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106914 Oct 27 03:30:04.487853 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-612fdba3-6b1c-4fe2-a5d6-0a54d1f7c14b tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:04.491847 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1182/2420] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:30:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:30:04.491987 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-612fdba3-6b1c-4fe2-a5d6-0a54d1f7c14b tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:04.505668 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8168566a-71e7-480e-8c4b-a68836b87ef6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:04.506303 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8168566a-71e7-480e-8c4b-a68836b87ef6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:04.522542 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8168566a-71e7-480e-8c4b-a68836b87ef6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:04.532100 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=100 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:30:04.532253 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8168566a-71e7-480e-8c4b-a68836b87ef6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:04.532253 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8168566a-71e7-480e-8c4b-a68836b87ef6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:04.532253 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8168566a-71e7-480e-8c4b-a68836b87ef6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:04.532253 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8168566a-71e7-480e-8c4b-a68836b87ef6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:04.532253 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8168566a-71e7-480e-8c4b-a68836b87ef6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:04.779941 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8168566a-71e7-480e-8c4b-a68836b87ef6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.289544 Oct 27 03:30:04.781517 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1183/2421] 10.222.0.20 () {58 vars in 1275 bytes} [Thu Oct 27 03:30:04 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86/os-interface => generated 284 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:30:04.788561 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-17a54270-c234-4ce8-a904-60e0855be0a7 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:04.789180 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-17a54270-c234-4ce8-a904-60e0855be0a7 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 2be00171-65ea-411a-b2d8-86b4e42d5de9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:04.804508 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-17a54270-c234-4ce8-a904-60e0855be0a7 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:04.807245 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-17a54270-c234-4ce8-a904-60e0855be0a7 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:04.807999 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-17a54270-c234-4ce8-a904-60e0855be0a7 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:04.808791 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-17a54270-c234-4ce8-a904-60e0855be0a7 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:04.811404 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-17a54270-c234-4ce8-a904-60e0855be0a7 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:04.811887 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-17a54270-c234-4ce8-a904-60e0855be0a7 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:04.859660 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-17a54270-c234-4ce8-a904-60e0855be0a7 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] HTTP exception thrown: Instance 2be00171-65ea-411a-b2d8-86b4e42d5de9 could not be found. Oct 27 03:30:04.863195 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-17a54270-c234-4ce8-a904-60e0855be0a7 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Request method failure captured: Oct 27 03:30:04.863195 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/2be00171-65ea-411a-b2d8-86b4e42d5de9 HTTP/1.1 Oct 27 03:30:04.863195 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:30:04.863195 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:30:04.863195 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:30:04.863195 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:30:04.863195 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:30:04.863195 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:30:04.863195 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:30:04.863195 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:30:04.863195 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfnAX64GvSXX6j_FGiQQ9IlgyuvfbWxRMGJCqIz8aEuYqDW4EVaQTS_nCBHKSQ3Z4oltdJGbrb3LkQtsJQ-KBbiFsQn0s9yf9n4GDuUzW48O2MfgGJVpAyAl-5qhe5w5ten3MUUxjRyCo9okwgZpH2TZ6ggq8P48i5NICoqXVcmLAEk Oct 27 03:30:04.863195 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:30:04.863195 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:30:04.863195 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:30:04.863195 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:30:04.863195 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:30:04.863195 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:30:04.863195 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: ae78c307a1504172828e668f915a3677 Oct 27 03:30:04.863195 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ImagesTestJSON-2119984465 Oct 27 03:30:04.863195 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:30:04.863195 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:30:04.863195 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ae78c307a1504172828e668f915a3677"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ae78c307a1504172828e668f915a3677"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ae78c307a1504172828e668f915a3677"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ae78c307a1504172828e668f915a3677"}]}] Oct 27 03:30:04.863195 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ImagesTestJSON-2119984465 Oct 27 03:30:04.863195 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: ae78c307a1504172828e668f915a3677 Oct 27 03:30:04.863195 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ImagesTestJSON-2119984465 Oct 27 03:30:04.863195 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ImagesTestJSON-2119984465-project Oct 27 03:30:04.863195 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:30:04.863195 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:30:04.863195 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 1d6175f2ac39494f8cba3db225150d6c Oct 27 03:30:04.863195 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ImagesTestJSON-2119984465-project Oct 27 03:30:04.863195 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:30:04.863195 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 2be00171-65ea-411a-b2d8-86b4e42d5de9 could not be found. Oct 27 03:30:04.863195 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '2be00171-65ea-411a-b2d8-86b4e42d5de9'} Oct 27 03:30:04.863195 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:30:04.863195 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:04.863195 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:30:04.863195 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:30:04.863195 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:30:04.863195 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:30:04.863195 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:30:04.863195 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:30:04.863195 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:30:04.863195 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:30:04.863195 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2be00171-65ea-411a-b2d8-86b4e42d5de9 could not be found. Oct 27 03:30:04.863195 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:04.863195 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:30:04.863195 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:04.863195 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:04.863195 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:30:04.863195 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:30:04.863195 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:30:04.863195 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:30:04.863195 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:30:04.863195 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:30:04.863195 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:30:04.863195 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:30:04.863195 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:30:04.863195 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:30:04.863195 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:30:04.863195 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:30:04.863195 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2be00171-65ea-411a-b2d8-86b4e42d5de9 could not be found. Oct 27 03:30:04.863195 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:04.863195 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:30:04.863195 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:04.863195 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:04.866878 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:30:04.866878 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:30:04.866878 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:30:04.866878 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:30:04.866878 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2be00171-65ea-411a-b2d8-86b4e42d5de9 could not be found. Oct 27 03:30:04.866878 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:04.866878 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-17a54270-c234-4ce8-a904-60e0855be0a7 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Returning 404 to user: Instance 2be00171-65ea-411a-b2d8-86b4e42d5de9 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:30:04.867840 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-17a54270-c234-4ce8-a904-60e0855be0a7 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/2be00171-65ea-411a-b2d8-86b4e42d5de9" status: 404 len: 111 microversion: 2.1 time: 0.084802 Oct 27 03:30:04.875032 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1184/2422] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:04 2022] GET /compute/v2.1/servers/2be00171-65ea-411a-b2d8-86b4e42d5de9 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:30:04.890108 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-10050aeb-a5b4-4d2b-8ab2-316f3b6a12c3 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7ddaa61670>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:04.923165 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-10050aeb-a5b4-4d2b-8ab2-316f3b6a12c3 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] HTTP exception thrown: Image not found. Oct 27 03:30:04.925809 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-10050aeb-a5b4-4d2b-8ab2-316f3b6a12c3 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Request method failure captured: Oct 27 03:30:04.925809 n-d-862769-1 devstack@n-api.service[121000]: request: DELETE /compute/v2.1/images/7115c53b-83c1-4282-b3b3-cadb0c0b6d70 HTTP/1.1 Oct 27 03:30:04.925809 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:30:04.925809 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:30:04.925809 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:30:04.925809 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:30:04.925809 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:30:04.925809 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:30:04.925809 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:30:04.925809 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:30:04.925809 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfnAX64GvSXX6j_FGiQQ9IlgyuvfbWxRMGJCqIz8aEuYqDW4EVaQTS_nCBHKSQ3Z4oltdJGbrb3LkQtsJQ-KBbiFsQn0s9yf9n4GDuUzW48O2MfgGJVpAyAl-5qhe5w5ten3MUUxjRyCo9okwgZpH2TZ6ggq8P48i5NICoqXVcmLAEk Oct 27 03:30:04.925809 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:30:04.925809 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:30:04.925809 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:30:04.925809 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:30:04.925809 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:30:04.925809 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:30:04.925809 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: ae78c307a1504172828e668f915a3677 Oct 27 03:30:04.925809 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ImagesTestJSON-2119984465 Oct 27 03:30:04.925809 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:30:04.925809 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:30:04.925809 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ae78c307a1504172828e668f915a3677"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ae78c307a1504172828e668f915a3677"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ae78c307a1504172828e668f915a3677"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ae78c307a1504172828e668f915a3677"}]}] Oct 27 03:30:04.925809 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ImagesTestJSON-2119984465 Oct 27 03:30:04.925809 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: ae78c307a1504172828e668f915a3677 Oct 27 03:30:04.925809 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ImagesTestJSON-2119984465 Oct 27 03:30:04.925809 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ImagesTestJSON-2119984465-project Oct 27 03:30:04.925809 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:30:04.925809 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:30:04.925809 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 1d6175f2ac39494f8cba3db225150d6c Oct 27 03:30:04.925809 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ImagesTestJSON-2119984465-project Oct 27 03:30:04.925809 n-d-862769-1 devstack@n-api.service[121000]: method: Oct 27 03:30:04.925809 n-d-862769-1 devstack@n-api.service[121000]: exception: Image not found. Oct 27 03:30:04.925809 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '7115c53b-83c1-4282-b3b3-cadb0c0b6d70'} Oct 27 03:30:04.925809 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:30:04.925809 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:04.925809 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 27 03:30:04.925809 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 27 03:30:04.925809 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 03:30:04.925809 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 03:30:04.925809 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 03:30:04.925809 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 03:30:04.925809 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 27 03:30:04.925809 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 27 03:30:04.925809 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 27 03:30:04.925809 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 27 03:30:04.925809 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 03:30:04.925809 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 03:30:04.925809 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 03:30:04.925809 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 03:30:04.925809 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 7115c53b-83c1-4282-b3b3-cadb0c0b6d70 to delete Oct 27 03:30:04.925809 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:04.925809 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:30:04.925809 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:04.925809 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:04.925809 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 27 03:30:04.925809 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 27 03:30:04.925809 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 27 03:30:04.925809 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 27 03:30:04.925809 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 27 03:30:04.925809 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 27 03:30:04.925809 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7115c53b-83c1-4282-b3b3-cadb0c0b6d70 could not be found. Oct 27 03:30:04.925809 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:04.925809 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:30:04.925809 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:04.925809 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:04.929763 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:30:04.929763 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:30:04.929763 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:30:04.929763 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:30:04.929763 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:30:04.929763 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:30:04.929763 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:30:04.929763 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:30:04.929763 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 27 03:30:04.929763 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 27 03:30:04.929763 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 27 03:30:04.929763 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:04.929763 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:30:04.929763 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:04.929763 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:04.929763 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:30:04.929763 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:30:04.929763 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:30:04.929763 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:30:04.929763 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 27 03:30:04.929763 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:04.929763 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-10050aeb-a5b4-4d2b-8ab2-316f3b6a12c3 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Returning 404 to user: Image not found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:30:04.929763 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-10050aeb-a5b4-4d2b-8ab2-316f3b6a12c3 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "DELETE /compute/v2.1/images/7115c53b-83c1-4282-b3b3-cadb0c0b6d70" status: 404 len: 62 microversion: 2.1 time: 0.051031 Oct 27 03:30:04.929763 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1185/2423] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:04 2022] DELETE /compute/v2.1/images/7115c53b-83c1-4282-b3b3-cadb0c0b6d70 => generated 62 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 03:30:04.937694 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-25eb8df0-2e8c-4d9c-a188-a714dfd6e9f9 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:04.938399 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-25eb8df0-2e8c-4d9c-a188-a714dfd6e9f9 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 33d5c62a-898f-441b-a1a1-3cb12836755d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:04.948899 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-25eb8df0-2e8c-4d9c-a188-a714dfd6e9f9 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:04.949661 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-25eb8df0-2e8c-4d9c-a188-a714dfd6e9f9 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:04.950367 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-25eb8df0-2e8c-4d9c-a188-a714dfd6e9f9 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:04.951749 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-25eb8df0-2e8c-4d9c-a188-a714dfd6e9f9 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:04.952338 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-25eb8df0-2e8c-4d9c-a188-a714dfd6e9f9 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:04.952899 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-25eb8df0-2e8c-4d9c-a188-a714dfd6e9f9 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:04.955778 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-612fdba3-6b1c-4fe2-a5d6-0a54d1f7c14b tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68/action" status: 202 len: 0 microversion: 2.1 time: 0.487809 Oct 27 03:30:04.957810 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1239/2424] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:30:04 2022] POST /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68/action => generated 0 bytes in 491 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:30:04.972534 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b9bc8686-05d6-4be5-9aeb-bbb6dfc57e28 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:04.973793 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b9bc8686-05d6-4be5-9aeb-bbb6dfc57e28 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] [instance: 339287fc-37b6-455d-96ab-08ab8e2c3e68] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:04.974761 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-25eb8df0-2e8c-4d9c-a188-a714dfd6e9f9 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] HTTP exception thrown: Instance 33d5c62a-898f-441b-a1a1-3cb12836755d could not be found. Oct 27 03:30:04.976776 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-25eb8df0-2e8c-4d9c-a188-a714dfd6e9f9 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Request method failure captured: Oct 27 03:30:04.976776 n-d-862769-1 devstack@n-api.service[121000]: request: DELETE /compute/v2.1/servers/33d5c62a-898f-441b-a1a1-3cb12836755d HTTP/1.1 Oct 27 03:30:04.976776 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:30:04.976776 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:30:04.976776 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:30:04.976776 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:30:04.976776 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:30:04.976776 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:30:04.976776 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:30:04.976776 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:30:04.976776 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfnAX64GvSXX6j_FGiQQ9IlgyuvfbWxRMGJCqIz8aEuYqDW4EVaQTS_nCBHKSQ3Z4oltdJGbrb3LkQtsJQ-KBbiFsQn0s9yf9n4GDuUzW48O2MfgGJVpAyAl-5qhe5w5ten3MUUxjRyCo9okwgZpH2TZ6ggq8P48i5NICoqXVcmLAEk Oct 27 03:30:04.976776 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:30:04.976776 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:30:04.976776 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:30:04.976776 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:30:04.976776 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:30:04.976776 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:30:04.976776 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: ae78c307a1504172828e668f915a3677 Oct 27 03:30:04.976776 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ImagesTestJSON-2119984465 Oct 27 03:30:04.976776 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:30:04.976776 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:30:04.976776 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ae78c307a1504172828e668f915a3677"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ae78c307a1504172828e668f915a3677"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ae78c307a1504172828e668f915a3677"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ae78c307a1504172828e668f915a3677"}]}] Oct 27 03:30:04.976776 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ImagesTestJSON-2119984465 Oct 27 03:30:04.976776 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: ae78c307a1504172828e668f915a3677 Oct 27 03:30:04.976776 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ImagesTestJSON-2119984465 Oct 27 03:30:04.976776 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ImagesTestJSON-2119984465-project Oct 27 03:30:04.976776 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:30:04.976776 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:30:04.976776 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 1d6175f2ac39494f8cba3db225150d6c Oct 27 03:30:04.976776 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ImagesTestJSON-2119984465-project Oct 27 03:30:04.976776 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:30:04.976776 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 33d5c62a-898f-441b-a1a1-3cb12836755d could not be found. Oct 27 03:30:04.976776 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '33d5c62a-898f-441b-a1a1-3cb12836755d'} Oct 27 03:30:04.976776 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:30:04.976776 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:04.976776 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:30:04.976776 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:30:04.976776 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:30:04.976776 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:30:04.976776 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:30:04.976776 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:30:04.976776 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:30:04.976776 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:30:04.976776 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33d5c62a-898f-441b-a1a1-3cb12836755d could not be found. Oct 27 03:30:04.976776 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:04.976776 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:30:04.976776 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:04.976776 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:04.976776 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:30:04.976776 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:30:04.976776 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:30:04.976776 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:30:04.976776 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:30:04.976776 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:30:04.976776 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 03:30:04.976776 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 03:30:04.976776 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 03:30:04.976776 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 03:30:04.976776 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:30:04.976776 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:30:04.976776 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:30:04.976776 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:30:04.976776 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33d5c62a-898f-441b-a1a1-3cb12836755d could not be found. Oct 27 03:30:04.980248 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:04.980248 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:30:04.980248 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:04.980248 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:04.980248 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:30:04.980248 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:30:04.980248 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:30:04.980248 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:30:04.980248 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33d5c62a-898f-441b-a1a1-3cb12836755d could not be found. Oct 27 03:30:04.980248 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:04.980248 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-25eb8df0-2e8c-4d9c-a188-a714dfd6e9f9 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Returning 404 to user: Instance 33d5c62a-898f-441b-a1a1-3cb12836755d could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:30:04.980248 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-25eb8df0-2e8c-4d9c-a188-a714dfd6e9f9 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "DELETE /compute/v2.1/servers/33d5c62a-898f-441b-a1a1-3cb12836755d" status: 404 len: 111 microversion: 2.1 time: 0.046765 Oct 27 03:30:04.980248 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1186/2425] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:30:04 2022] DELETE /compute/v2.1/servers/33d5c62a-898f-441b-a1a1-3cb12836755d => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 03:30:04.986824 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-230dac77-5829-4d34-95b9-c267eaf8662f tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:04.987875 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-230dac77-5829-4d34-95b9-c267eaf8662f tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] [instance: 04477d51-f600-483a-aec9-feb992cc6cf7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:04.988823 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b9bc8686-05d6-4be5-9aeb-bbb6dfc57e28 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:04.994573 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-230dac77-5829-4d34-95b9-c267eaf8662f tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:04.995257 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-230dac77-5829-4d34-95b9-c267eaf8662f tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:04.995666 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b9bc8686-05d6-4be5-9aeb-bbb6dfc57e28 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:04.995967 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-230dac77-5829-4d34-95b9-c267eaf8662f tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:04.996460 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b9bc8686-05d6-4be5-9aeb-bbb6dfc57e28 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:04.997058 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-230dac77-5829-4d34-95b9-c267eaf8662f tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:04.997508 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b9bc8686-05d6-4be5-9aeb-bbb6dfc57e28 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:04.997933 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-230dac77-5829-4d34-95b9-c267eaf8662f tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:04.998317 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b9bc8686-05d6-4be5-9aeb-bbb6dfc57e28 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:04.999739 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-230dac77-5829-4d34-95b9-c267eaf8662f tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:05.011493 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b9bc8686-05d6-4be5-9aeb-bbb6dfc57e28 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:05.057273 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:30:05.242925 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b9bc8686-05d6-4be5-9aeb-bbb6dfc57e28 tempest-ServersAdminTestJSON-1738074599 tempest-ServersAdminTestJSON-1738074599-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68" status: 200 len: 1614 microversion: 2.1 time: 0.274106 Oct 27 03:30:05.244651 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1240/2426] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:04 2022] GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68 => generated 1614 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:05.249535 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-30b73110-7df8-431f-a705-f285911510aa tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:05.250441 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-30b73110-7df8-431f-a705-f285911510aa tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: d5e6f604-9466-45c6-86a8-885cfb393223] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:05.267844 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-30b73110-7df8-431f-a705-f285911510aa tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:05.268713 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-30b73110-7df8-431f-a705-f285911510aa tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:05.269406 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-30b73110-7df8-431f-a705-f285911510aa tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:05.270529 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-30b73110-7df8-431f-a705-f285911510aa tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:05.271221 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-30b73110-7df8-431f-a705-f285911510aa tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:05.271873 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-30b73110-7df8-431f-a705-f285911510aa tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:05.394694 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-230dac77-5829-4d34-95b9-c267eaf8662f tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421d14944da74570a53d620ea205449d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92082c8718aa41bf96cd84d682d75954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:05.403873 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-230dac77-5829-4d34-95b9-c267eaf8662f tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] 10.222.0.20 "GET /compute/v2.1/servers/04477d51-f600-483a-aec9-feb992cc6cf7" status: 200 len: 1316 microversion: 2.1 time: 0.422905 Oct 27 03:30:05.406237 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1187/2427] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:04 2022] GET /compute/v2.1/servers/04477d51-f600-483a-aec9-feb992cc6cf7 => generated 1316 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:05.413183 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-20e8f589-f914-42b2-9514-fa1abc3c02e5 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:05.418415 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-20e8f589-f914-42b2-9514-fa1abc3c02e5 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 33d5c62a-898f-441b-a1a1-3cb12836755d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:05.438082 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-20e8f589-f914-42b2-9514-fa1abc3c02e5 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:05.438670 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-20e8f589-f914-42b2-9514-fa1abc3c02e5 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:05.439130 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-20e8f589-f914-42b2-9514-fa1abc3c02e5 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:05.439888 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-20e8f589-f914-42b2-9514-fa1abc3c02e5 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:05.440347 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-20e8f589-f914-42b2-9514-fa1abc3c02e5 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:05.441349 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-20e8f589-f914-42b2-9514-fa1abc3c02e5 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:05.484089 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-20e8f589-f914-42b2-9514-fa1abc3c02e5 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] HTTP exception thrown: Instance 33d5c62a-898f-441b-a1a1-3cb12836755d could not be found. Oct 27 03:30:05.490076 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-20e8f589-f914-42b2-9514-fa1abc3c02e5 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Request method failure captured: Oct 27 03:30:05.490076 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/33d5c62a-898f-441b-a1a1-3cb12836755d HTTP/1.1 Oct 27 03:30:05.490076 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:30:05.490076 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:30:05.490076 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:30:05.490076 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:30:05.490076 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:30:05.490076 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:30:05.490076 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:30:05.490076 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:30:05.490076 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfnAX64GvSXX6j_FGiQQ9IlgyuvfbWxRMGJCqIz8aEuYqDW4EVaQTS_nCBHKSQ3Z4oltdJGbrb3LkQtsJQ-KBbiFsQn0s9yf9n4GDuUzW48O2MfgGJVpAyAl-5qhe5w5ten3MUUxjRyCo9okwgZpH2TZ6ggq8P48i5NICoqXVcmLAEk Oct 27 03:30:05.490076 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:30:05.490076 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:30:05.490076 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:30:05.490076 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:30:05.490076 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:30:05.490076 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:30:05.490076 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: ae78c307a1504172828e668f915a3677 Oct 27 03:30:05.490076 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ImagesTestJSON-2119984465 Oct 27 03:30:05.490076 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:30:05.490076 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:30:05.490076 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ae78c307a1504172828e668f915a3677"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ae78c307a1504172828e668f915a3677"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ae78c307a1504172828e668f915a3677"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ae78c307a1504172828e668f915a3677"}]}] Oct 27 03:30:05.490076 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ImagesTestJSON-2119984465 Oct 27 03:30:05.490076 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: ae78c307a1504172828e668f915a3677 Oct 27 03:30:05.490076 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ImagesTestJSON-2119984465 Oct 27 03:30:05.490076 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ImagesTestJSON-2119984465-project Oct 27 03:30:05.490076 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:30:05.490076 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:30:05.490076 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 1d6175f2ac39494f8cba3db225150d6c Oct 27 03:30:05.490076 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ImagesTestJSON-2119984465-project Oct 27 03:30:05.490076 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:30:05.490076 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 33d5c62a-898f-441b-a1a1-3cb12836755d could not be found. Oct 27 03:30:05.490076 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '33d5c62a-898f-441b-a1a1-3cb12836755d'} Oct 27 03:30:05.490076 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:30:05.490076 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:05.490076 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:30:05.490076 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:30:05.490076 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:30:05.490076 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:30:05.490076 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:30:05.490076 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:30:05.490076 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:30:05.490076 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:30:05.490076 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33d5c62a-898f-441b-a1a1-3cb12836755d could not be found. Oct 27 03:30:05.490076 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:05.490076 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:30:05.490076 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:05.490076 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:05.490076 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:30:05.490076 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:30:05.490076 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:30:05.490076 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:30:05.490076 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:30:05.490076 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:30:05.490076 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:30:05.490076 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:30:05.490076 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:30:05.490076 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:30:05.490076 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:30:05.490076 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:30:05.490076 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33d5c62a-898f-441b-a1a1-3cb12836755d could not be found. Oct 27 03:30:05.490076 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:05.490076 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:30:05.490076 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:05.490076 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:05.494001 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:30:05.494001 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:30:05.494001 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:30:05.494001 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:30:05.494001 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33d5c62a-898f-441b-a1a1-3cb12836755d could not be found. Oct 27 03:30:05.494001 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:05.495652 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-20e8f589-f914-42b2-9514-fa1abc3c02e5 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Returning 404 to user: Instance 33d5c62a-898f-441b-a1a1-3cb12836755d could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:30:05.497103 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-20e8f589-f914-42b2-9514-fa1abc3c02e5 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/33d5c62a-898f-441b-a1a1-3cb12836755d" status: 404 len: 111 microversion: 2.1 time: 0.089864 Oct 27 03:30:05.498240 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1188/2428] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:05 2022] GET /compute/v2.1/servers/33d5c62a-898f-441b-a1a1-3cb12836755d => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:30:05.509407 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-34b95457-3189-4526-8154-119c2df73164 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:05.511732 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-34b95457-3189-4526-8154-119c2df73164 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] [instance: ba3e02bc-d621-49e5-8e81-0d33828d816f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:05.528385 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-34b95457-3189-4526-8154-119c2df73164 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:05.531048 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-34b95457-3189-4526-8154-119c2df73164 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:05.531696 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-34b95457-3189-4526-8154-119c2df73164 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:05.535608 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-30b73110-7df8-431f-a705-f285911510aa tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:05.547714 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-30b73110-7df8-431f-a705-f285911510aa tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:05.548440 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-34b95457-3189-4526-8154-119c2df73164 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:05.549139 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-34b95457-3189-4526-8154-119c2df73164 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:05.549739 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-34b95457-3189-4526-8154-119c2df73164 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:05.555306 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-30b73110-7df8-431f-a705-f285911510aa tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:05.559279 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-30b73110-7df8-431f-a705-f285911510aa tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223" status: 200 len: 1487 microversion: 2.25 time: 0.311307 Oct 27 03:30:05.560462 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1241/2429] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:30:05 2022] GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223 => generated 1487 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:30:05.575626 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1fbb4a7c-c066-48d2-9c9d-5b1b599601e0 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:05.575846 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1fbb4a7c-c066-48d2-9c9d-5b1b599601e0 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: c214e6ec-8d3d-4cef-85fc-7c2bfe01b972] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:05.634497 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1fbb4a7c-c066-48d2-9c9d-5b1b599601e0 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:05.638794 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1fbb4a7c-c066-48d2-9c9d-5b1b599601e0 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:05.639351 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1fbb4a7c-c066-48d2-9c9d-5b1b599601e0 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:05.640188 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1fbb4a7c-c066-48d2-9c9d-5b1b599601e0 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:05.640808 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1fbb4a7c-c066-48d2-9c9d-5b1b599601e0 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:05.641336 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1fbb4a7c-c066-48d2-9c9d-5b1b599601e0 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:05.709088 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1fbb4a7c-c066-48d2-9c9d-5b1b599601e0 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: c214e6ec-8d3d-4cef-85fc-7c2bfe01b972] Going to try to terminate instance {{(pid=121001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:30:05.814975 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-34b95457-3189-4526-8154-119c2df73164 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e64f7f0501454fa8474aa61c9a8c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561891c49901486c9d7651688f88b0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:05.826962 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-34b95457-3189-4526-8154-119c2df73164 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] 10.222.0.20 "GET /compute/v2.1/servers/ba3e02bc-d621-49e5-8e81-0d33828d816f" status: 200 len: 1227 microversion: 2.1 time: 0.326143 Oct 27 03:30:05.838069 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1189/2430] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:05 2022] GET /compute/v2.1/servers/ba3e02bc-d621-49e5-8e81-0d33828d816f => generated 1227 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:05.838874 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-df8430f9-eb6b-4f21-83b3-113f6a6996b2 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '.version_select at 0x7f7ddaa61e50>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:05.876938 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-df8430f9-eb6b-4f21-83b3-113f6a6996b2 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] HTTP exception thrown: Image not found. Oct 27 03:30:05.878884 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-df8430f9-eb6b-4f21-83b3-113f6a6996b2 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Request method failure captured: Oct 27 03:30:05.878884 n-d-862769-1 devstack@n-api.service[121000]: request: DELETE /compute/v2.1/images/d07d1961-c000-42bf-b042-6a2852956faf HTTP/1.1 Oct 27 03:30:05.878884 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:30:05.878884 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:30:05.878884 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:30:05.878884 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:30:05.878884 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:30:05.878884 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:30:05.878884 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:30:05.878884 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:30:05.878884 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfnAX64GvSXX6j_FGiQQ9IlgyuvfbWxRMGJCqIz8aEuYqDW4EVaQTS_nCBHKSQ3Z4oltdJGbrb3LkQtsJQ-KBbiFsQn0s9yf9n4GDuUzW48O2MfgGJVpAyAl-5qhe5w5ten3MUUxjRyCo9okwgZpH2TZ6ggq8P48i5NICoqXVcmLAEk Oct 27 03:30:05.878884 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:30:05.878884 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:30:05.878884 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:30:05.878884 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:30:05.878884 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:30:05.878884 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:30:05.878884 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: ae78c307a1504172828e668f915a3677 Oct 27 03:30:05.878884 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ImagesTestJSON-2119984465 Oct 27 03:30:05.878884 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:30:05.878884 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:30:05.878884 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ae78c307a1504172828e668f915a3677"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ae78c307a1504172828e668f915a3677"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ae78c307a1504172828e668f915a3677"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ae78c307a1504172828e668f915a3677"}]}] Oct 27 03:30:05.878884 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ImagesTestJSON-2119984465 Oct 27 03:30:05.878884 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: ae78c307a1504172828e668f915a3677 Oct 27 03:30:05.878884 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ImagesTestJSON-2119984465 Oct 27 03:30:05.878884 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ImagesTestJSON-2119984465-project Oct 27 03:30:05.878884 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:30:05.878884 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:30:05.878884 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 1d6175f2ac39494f8cba3db225150d6c Oct 27 03:30:05.878884 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ImagesTestJSON-2119984465-project Oct 27 03:30:05.878884 n-d-862769-1 devstack@n-api.service[121000]: method: Oct 27 03:30:05.878884 n-d-862769-1 devstack@n-api.service[121000]: exception: Image not found. Oct 27 03:30:05.878884 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': 'd07d1961-c000-42bf-b042-6a2852956faf'} Oct 27 03:30:05.878884 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:30:05.878884 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:05.878884 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 27 03:30:05.878884 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 27 03:30:05.878884 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 03:30:05.878884 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 03:30:05.878884 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 03:30:05.878884 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 03:30:05.878884 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 27 03:30:05.878884 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 27 03:30:05.878884 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 27 03:30:05.878884 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 27 03:30:05.878884 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 03:30:05.878884 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 03:30:05.878884 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 03:30:05.878884 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 03:30:05.878884 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image d07d1961-c000-42bf-b042-6a2852956faf to delete Oct 27 03:30:05.878884 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:05.878884 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:30:05.878884 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:05.878884 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:05.878884 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 27 03:30:05.878884 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 27 03:30:05.878884 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 27 03:30:05.878884 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 27 03:30:05.878884 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 27 03:30:05.878884 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 27 03:30:05.878884 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d07d1961-c000-42bf-b042-6a2852956faf could not be found. Oct 27 03:30:05.878884 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:05.878884 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:30:05.878884 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:05.878884 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:05.883179 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:30:05.883179 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:30:05.883179 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:30:05.883179 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:30:05.883179 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:30:05.883179 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:30:05.883179 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:30:05.883179 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:30:05.883179 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 27 03:30:05.883179 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 27 03:30:05.883179 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 27 03:30:05.883179 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:05.883179 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:30:05.883179 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:05.883179 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:05.883179 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:30:05.883179 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:30:05.883179 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:30:05.883179 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:30:05.883179 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 27 03:30:05.883179 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:05.883179 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-df8430f9-eb6b-4f21-83b3-113f6a6996b2 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Returning 404 to user: Image not found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:30:05.883179 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-df8430f9-eb6b-4f21-83b3-113f6a6996b2 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "DELETE /compute/v2.1/images/d07d1961-c000-42bf-b042-6a2852956faf" status: 404 len: 62 microversion: 2.1 time: 0.048562 Oct 27 03:30:05.885553 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1190/2431] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:05 2022] DELETE /compute/v2.1/images/d07d1961-c000-42bf-b042-6a2852956faf => generated 62 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 03:30:05.893105 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-474641f5-6ace-4d24-a99b-fe4af5b47094 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:05.894222 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-474641f5-6ace-4d24-a99b-fe4af5b47094 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 521ddedc-cff2-4c42-a737-9590906b07a6] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:05.915167 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-474641f5-6ace-4d24-a99b-fe4af5b47094 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:05.915902 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-474641f5-6ace-4d24-a99b-fe4af5b47094 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:05.916492 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-474641f5-6ace-4d24-a99b-fe4af5b47094 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:05.917403 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-474641f5-6ace-4d24-a99b-fe4af5b47094 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:05.918053 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-474641f5-6ace-4d24-a99b-fe4af5b47094 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:05.918828 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-474641f5-6ace-4d24-a99b-fe4af5b47094 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:05.947032 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-474641f5-6ace-4d24-a99b-fe4af5b47094 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] HTTP exception thrown: Instance 521ddedc-cff2-4c42-a737-9590906b07a6 could not be found. Oct 27 03:30:05.948743 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-474641f5-6ace-4d24-a99b-fe4af5b47094 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Request method failure captured: Oct 27 03:30:05.948743 n-d-862769-1 devstack@n-api.service[121000]: request: DELETE /compute/v2.1/servers/521ddedc-cff2-4c42-a737-9590906b07a6 HTTP/1.1 Oct 27 03:30:05.948743 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:30:05.948743 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:30:05.948743 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:30:05.948743 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:30:05.948743 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:30:05.948743 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:30:05.948743 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:30:05.948743 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:30:05.948743 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfnAX64GvSXX6j_FGiQQ9IlgyuvfbWxRMGJCqIz8aEuYqDW4EVaQTS_nCBHKSQ3Z4oltdJGbrb3LkQtsJQ-KBbiFsQn0s9yf9n4GDuUzW48O2MfgGJVpAyAl-5qhe5w5ten3MUUxjRyCo9okwgZpH2TZ6ggq8P48i5NICoqXVcmLAEk Oct 27 03:30:05.948743 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:30:05.948743 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:30:05.948743 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:30:05.948743 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:30:05.948743 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:30:05.948743 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:30:05.948743 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: ae78c307a1504172828e668f915a3677 Oct 27 03:30:05.948743 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ImagesTestJSON-2119984465 Oct 27 03:30:05.948743 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:30:05.948743 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:30:05.948743 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ae78c307a1504172828e668f915a3677"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ae78c307a1504172828e668f915a3677"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ae78c307a1504172828e668f915a3677"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ae78c307a1504172828e668f915a3677"}]}] Oct 27 03:30:05.948743 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ImagesTestJSON-2119984465 Oct 27 03:30:05.948743 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: ae78c307a1504172828e668f915a3677 Oct 27 03:30:05.948743 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ImagesTestJSON-2119984465 Oct 27 03:30:05.948743 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ImagesTestJSON-2119984465-project Oct 27 03:30:05.948743 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:30:05.948743 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:30:05.948743 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 1d6175f2ac39494f8cba3db225150d6c Oct 27 03:30:05.948743 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ImagesTestJSON-2119984465-project Oct 27 03:30:05.948743 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:30:05.948743 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 521ddedc-cff2-4c42-a737-9590906b07a6 could not be found. Oct 27 03:30:05.948743 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '521ddedc-cff2-4c42-a737-9590906b07a6'} Oct 27 03:30:05.948743 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:30:05.948743 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:05.948743 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:30:05.948743 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:30:05.948743 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:30:05.948743 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:30:05.948743 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:30:05.948743 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:30:05.948743 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:30:05.948743 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:30:05.948743 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 521ddedc-cff2-4c42-a737-9590906b07a6 could not be found. Oct 27 03:30:05.948743 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:05.948743 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:30:05.948743 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:05.948743 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:05.948743 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:30:05.948743 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:30:05.948743 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:30:05.948743 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:30:05.948743 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:30:05.948743 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:30:05.948743 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 03:30:05.948743 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 03:30:05.948743 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 03:30:05.948743 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 03:30:05.948743 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:30:05.948743 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:30:05.948743 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:30:05.948743 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:30:05.948743 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 521ddedc-cff2-4c42-a737-9590906b07a6 could not be found. Oct 27 03:30:05.951948 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:05.951948 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:30:05.951948 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:05.951948 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:05.951948 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:30:05.951948 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:30:05.951948 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:30:05.951948 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:30:05.951948 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 521ddedc-cff2-4c42-a737-9590906b07a6 could not be found. Oct 27 03:30:05.951948 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:05.951948 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-474641f5-6ace-4d24-a99b-fe4af5b47094 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Returning 404 to user: Instance 521ddedc-cff2-4c42-a737-9590906b07a6 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:30:05.951948 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-474641f5-6ace-4d24-a99b-fe4af5b47094 tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "DELETE /compute/v2.1/servers/521ddedc-cff2-4c42-a737-9590906b07a6" status: 404 len: 111 microversion: 2.1 time: 0.061911 Oct 27 03:30:05.953985 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1191/2432] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:30:05 2022] DELETE /compute/v2.1/servers/521ddedc-cff2-4c42-a737-9590906b07a6 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:30:05.959420 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6c45f822-e18b-4e3f-a8d2-38930d59b20f tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:05.960042 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6c45f822-e18b-4e3f-a8d2-38930d59b20f tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] [instance: 521ddedc-cff2-4c42-a737-9590906b07a6] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:05.967112 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6c45f822-e18b-4e3f-a8d2-38930d59b20f tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:05.967870 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6c45f822-e18b-4e3f-a8d2-38930d59b20f tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:05.968316 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6c45f822-e18b-4e3f-a8d2-38930d59b20f tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:05.969467 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6c45f822-e18b-4e3f-a8d2-38930d59b20f tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:05.969927 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6c45f822-e18b-4e3f-a8d2-38930d59b20f tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:05.970389 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6c45f822-e18b-4e3f-a8d2-38930d59b20f tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:06.003783 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-6c45f822-e18b-4e3f-a8d2-38930d59b20f tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] HTTP exception thrown: Instance 521ddedc-cff2-4c42-a737-9590906b07a6 could not be found. Oct 27 03:30:06.005328 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6c45f822-e18b-4e3f-a8d2-38930d59b20f tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Request method failure captured: Oct 27 03:30:06.005328 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/521ddedc-cff2-4c42-a737-9590906b07a6 HTTP/1.1 Oct 27 03:30:06.005328 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:30:06.005328 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:30:06.005328 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:30:06.005328 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:30:06.005328 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:30:06.005328 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:30:06.005328 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:30:06.005328 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:30:06.005328 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfnAX64GvSXX6j_FGiQQ9IlgyuvfbWxRMGJCqIz8aEuYqDW4EVaQTS_nCBHKSQ3Z4oltdJGbrb3LkQtsJQ-KBbiFsQn0s9yf9n4GDuUzW48O2MfgGJVpAyAl-5qhe5w5ten3MUUxjRyCo9okwgZpH2TZ6ggq8P48i5NICoqXVcmLAEk Oct 27 03:30:06.005328 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:30:06.005328 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:30:06.005328 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:30:06.005328 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:30:06.005328 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:30:06.005328 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:30:06.005328 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: ae78c307a1504172828e668f915a3677 Oct 27 03:30:06.005328 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ImagesTestJSON-2119984465 Oct 27 03:30:06.005328 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:30:06.005328 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:30:06.005328 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ae78c307a1504172828e668f915a3677"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ae78c307a1504172828e668f915a3677"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ae78c307a1504172828e668f915a3677"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ae78c307a1504172828e668f915a3677"}]}] Oct 27 03:30:06.005328 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ImagesTestJSON-2119984465 Oct 27 03:30:06.005328 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: ae78c307a1504172828e668f915a3677 Oct 27 03:30:06.005328 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ImagesTestJSON-2119984465 Oct 27 03:30:06.005328 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ImagesTestJSON-2119984465-project Oct 27 03:30:06.005328 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:30:06.005328 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:30:06.005328 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 1d6175f2ac39494f8cba3db225150d6c Oct 27 03:30:06.005328 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ImagesTestJSON-2119984465-project Oct 27 03:30:06.005328 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:30:06.005328 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 521ddedc-cff2-4c42-a737-9590906b07a6 could not be found. Oct 27 03:30:06.005328 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '521ddedc-cff2-4c42-a737-9590906b07a6'} Oct 27 03:30:06.005328 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:30:06.005328 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:06.005328 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:30:06.005328 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:30:06.005328 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:30:06.005328 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:30:06.005328 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:30:06.005328 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:30:06.005328 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:30:06.005328 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:30:06.005328 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 521ddedc-cff2-4c42-a737-9590906b07a6 could not be found. Oct 27 03:30:06.005328 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:06.005328 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:30:06.005328 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:06.005328 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:06.005328 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:30:06.005328 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:30:06.005328 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:30:06.005328 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:30:06.005328 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:30:06.005328 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:30:06.005328 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:30:06.005328 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:30:06.005328 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:30:06.005328 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:30:06.005328 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:30:06.005328 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:30:06.005328 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 521ddedc-cff2-4c42-a737-9590906b07a6 could not be found. Oct 27 03:30:06.005328 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:06.005328 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:30:06.005328 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:06.005328 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:06.008938 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:30:06.008938 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:30:06.008938 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:30:06.008938 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:30:06.008938 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 521ddedc-cff2-4c42-a737-9590906b07a6 could not be found. Oct 27 03:30:06.008938 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:06.008938 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6c45f822-e18b-4e3f-a8d2-38930d59b20f tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] Returning 404 to user: Instance 521ddedc-cff2-4c42-a737-9590906b07a6 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:30:06.008938 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6c45f822-e18b-4e3f-a8d2-38930d59b20f tempest-ImagesTestJSON-2119984465 tempest-ImagesTestJSON-2119984465-project] 10.222.0.20 "GET /compute/v2.1/servers/521ddedc-cff2-4c42-a737-9590906b07a6" status: 404 len: 111 microversion: 2.1 time: 0.052873 Oct 27 03:30:06.010394 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1192/2433] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:05 2022] GET /compute/v2.1/servers/521ddedc-cff2-4c42-a737-9590906b07a6 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:30:06.332011 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1fbb4a7c-c066-48d2-9c9d-5b1b599601e0 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c214e6ec-8d3d-4cef-85fc-7c2bfe01b972" status: 204 len: 0 microversion: 2.1 time: 0.769514 Oct 27 03:30:06.338223 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1242/2434] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:30:05 2022] DELETE /compute/v2.1/servers/c214e6ec-8d3d-4cef-85fc-7c2bfe01b972 => generated 0 bytes in 777 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:30:06.347429 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-bccfe3f0-0ba3-4244-b214-dbe900fa1ff6 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:06.348277 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-bccfe3f0-0ba3-4244-b214-dbe900fa1ff6 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: c214e6ec-8d3d-4cef-85fc-7c2bfe01b972] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:06.362022 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bccfe3f0-0ba3-4244-b214-dbe900fa1ff6 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:06.362980 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bccfe3f0-0ba3-4244-b214-dbe900fa1ff6 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:06.363653 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bccfe3f0-0ba3-4244-b214-dbe900fa1ff6 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:06.364617 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bccfe3f0-0ba3-4244-b214-dbe900fa1ff6 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:06.366452 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bccfe3f0-0ba3-4244-b214-dbe900fa1ff6 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:06.367114 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bccfe3f0-0ba3-4244-b214-dbe900fa1ff6 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:06.436995 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7f76b44b-484b-4611-b428-325f6611c4a3 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:06.437711 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7f76b44b-484b-4611-b428-325f6611c4a3 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] [instance: 04477d51-f600-483a-aec9-feb992cc6cf7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:06.462450 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7f76b44b-484b-4611-b428-325f6611c4a3 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:06.463363 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7f76b44b-484b-4611-b428-325f6611c4a3 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:06.464709 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7f76b44b-484b-4611-b428-325f6611c4a3 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:06.467381 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7f76b44b-484b-4611-b428-325f6611c4a3 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:06.468028 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7f76b44b-484b-4611-b428-325f6611c4a3 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:06.469120 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7f76b44b-484b-4611-b428-325f6611c4a3 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:06.791548 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7f76b44b-484b-4611-b428-325f6611c4a3 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421d14944da74570a53d620ea205449d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92082c8718aa41bf96cd84d682d75954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:06.801754 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7f76b44b-484b-4611-b428-325f6611c4a3 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] 10.222.0.20 "GET /compute/v2.1/servers/04477d51-f600-483a-aec9-feb992cc6cf7" status: 200 len: 1316 microversion: 2.1 time: 0.368969 Oct 27 03:30:06.814587 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1243/2435] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:06 2022] GET /compute/v2.1/servers/04477d51-f600-483a-aec9-feb992cc6cf7 => generated 1316 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:06.823879 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a817821e-8fb6-4bd5-b5e9-ade6904ab0c0 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:06.824921 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a817821e-8fb6-4bd5-b5e9-ade6904ab0c0 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: d5e6f604-9466-45c6-86a8-885cfb393223] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:06.827179 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:30:06.833506 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a817821e-8fb6-4bd5-b5e9-ade6904ab0c0 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:06.834300 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a817821e-8fb6-4bd5-b5e9-ade6904ab0c0 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:06.842268 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a817821e-8fb6-4bd5-b5e9-ade6904ab0c0 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:06.842268 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a817821e-8fb6-4bd5-b5e9-ade6904ab0c0 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:06.842268 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a817821e-8fb6-4bd5-b5e9-ade6904ab0c0 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:06.842268 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a817821e-8fb6-4bd5-b5e9-ade6904ab0c0 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:07.008714 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a817821e-8fb6-4bd5-b5e9-ade6904ab0c0 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:07.019432 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a817821e-8fb6-4bd5-b5e9-ade6904ab0c0 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:07.021339 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a817821e-8fb6-4bd5-b5e9-ade6904ab0c0 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:07.022869 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a817821e-8fb6-4bd5-b5e9-ade6904ab0c0 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223" status: 200 len: 1487 microversion: 2.25 time: 0.206311 Oct 27 03:30:07.023869 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1244/2436] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:30:06 2022] GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223 => generated 1487 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:30:07.029694 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c6e7d71e-1ca0-4cf9-90b6-ef16ca94f92a tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:07.030605 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c6e7d71e-1ca0-4cf9-90b6-ef16ca94f92a tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] [instance: ba3e02bc-d621-49e5-8e81-0d33828d816f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:07.039955 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c6e7d71e-1ca0-4cf9-90b6-ef16ca94f92a tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:07.044464 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c6e7d71e-1ca0-4cf9-90b6-ef16ca94f92a tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:07.045260 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c6e7d71e-1ca0-4cf9-90b6-ef16ca94f92a tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:07.046248 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c6e7d71e-1ca0-4cf9-90b6-ef16ca94f92a tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:07.046867 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c6e7d71e-1ca0-4cf9-90b6-ef16ca94f92a tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:07.047447 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c6e7d71e-1ca0-4cf9-90b6-ef16ca94f92a tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:07.123086 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c6e7d71e-1ca0-4cf9-90b6-ef16ca94f92a tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e64f7f0501454fa8474aa61c9a8c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561891c49901486c9d7651688f88b0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:07.132013 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c6e7d71e-1ca0-4cf9-90b6-ef16ca94f92a tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] 10.222.0.20 "GET /compute/v2.1/servers/ba3e02bc-d621-49e5-8e81-0d33828d816f" status: 200 len: 1219 microversion: 2.1 time: 0.106693 Oct 27 03:30:07.132597 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1245/2437] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:07 2022] GET /compute/v2.1/servers/ba3e02bc-d621-49e5-8e81-0d33828d816f => generated 1219 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:07.137656 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-da768431-39d9-42bc-b460-a4b2a9307ea3 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:07.138531 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-da768431-39d9-42bc-b460-a4b2a9307ea3 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: 543fdf60-10ec-4a25-a9d0-30c386efb104] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:07.144811 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-da768431-39d9-42bc-b460-a4b2a9307ea3 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:07.145554 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-da768431-39d9-42bc-b460-a4b2a9307ea3 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:07.146240 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-da768431-39d9-42bc-b460-a4b2a9307ea3 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:07.147189 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-da768431-39d9-42bc-b460-a4b2a9307ea3 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:07.148983 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-da768431-39d9-42bc-b460-a4b2a9307ea3 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:07.149424 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-da768431-39d9-42bc-b460-a4b2a9307ea3 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:07.195712 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-da768431-39d9-42bc-b460-a4b2a9307ea3 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: 543fdf60-10ec-4a25-a9d0-30c386efb104] Going to try to terminate instance {{(pid=121001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:30:07.381060 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-bccfe3f0-0ba3-4244-b214-dbe900fa1ff6 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13e05e253c94aadb1c089128ff35be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8510a519f14deea6f35a437419e161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:07.393985 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-bccfe3f0-0ba3-4244-b214-dbe900fa1ff6 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "GET /compute/v2.1/servers/c214e6ec-8d3d-4cef-85fc-7c2bfe01b972" status: 200 len: 1468 microversion: 2.1 time: 1.050856 Oct 27 03:30:07.395560 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1193/2438] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:06 2022] GET /compute/v2.1/servers/c214e6ec-8d3d-4cef-85fc-7c2bfe01b972 => generated 1468 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:07.703611 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-da768431-39d9-42bc-b460-a4b2a9307ea3 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "DELETE /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104" status: 204 len: 0 microversion: 2.1 time: 0.568944 Oct 27 03:30:07.705518 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1246/2439] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:30:07 2022] DELETE /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:30:07.713874 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-45d26dd5-2581-443d-a33c-84b69e50a9dc tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:07.715794 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-45d26dd5-2581-443d-a33c-84b69e50a9dc tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: 543fdf60-10ec-4a25-a9d0-30c386efb104] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:07.722484 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-45d26dd5-2581-443d-a33c-84b69e50a9dc tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:07.728077 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-45d26dd5-2581-443d-a33c-84b69e50a9dc tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:07.728849 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-45d26dd5-2581-443d-a33c-84b69e50a9dc tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:07.732185 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-45d26dd5-2581-443d-a33c-84b69e50a9dc tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:07.732733 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-45d26dd5-2581-443d-a33c-84b69e50a9dc tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:07.733194 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-45d26dd5-2581-443d-a33c-84b69e50a9dc tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:07.835909 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-94df5226-1b8c-4161-891e-84186e81400d tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:07.837397 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-94df5226-1b8c-4161-891e-84186e81400d tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] [instance: 04477d51-f600-483a-aec9-feb992cc6cf7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:07.849418 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-94df5226-1b8c-4161-891e-84186e81400d tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:07.850584 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-94df5226-1b8c-4161-891e-84186e81400d tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:07.856288 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-94df5226-1b8c-4161-891e-84186e81400d tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:07.856288 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-94df5226-1b8c-4161-891e-84186e81400d tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:07.856288 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-94df5226-1b8c-4161-891e-84186e81400d tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:07.856288 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-94df5226-1b8c-4161-891e-84186e81400d tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:08.085962 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-94df5226-1b8c-4161-891e-84186e81400d tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421d14944da74570a53d620ea205449d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92082c8718aa41bf96cd84d682d75954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:08.098774 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-94df5226-1b8c-4161-891e-84186e81400d tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] 10.222.0.20 "GET /compute/v2.1/servers/04477d51-f600-483a-aec9-feb992cc6cf7" status: 200 len: 1316 microversion: 2.1 time: 0.267470 Oct 27 03:30:08.109365 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1247/2440] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:07 2022] GET /compute/v2.1/servers/04477d51-f600-483a-aec9-feb992cc6cf7 => generated 1316 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:08.115154 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-527e7d1a-ab51-49c7-9fd1-1042dd0cf3c1 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:08.118895 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-527e7d1a-ab51-49c7-9fd1-1042dd0cf3c1 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: d5e6f604-9466-45c6-86a8-885cfb393223] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:08.126887 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-527e7d1a-ab51-49c7-9fd1-1042dd0cf3c1 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:08.127394 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-527e7d1a-ab51-49c7-9fd1-1042dd0cf3c1 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:08.128494 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-527e7d1a-ab51-49c7-9fd1-1042dd0cf3c1 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:08.129127 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-527e7d1a-ab51-49c7-9fd1-1042dd0cf3c1 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:08.129595 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-527e7d1a-ab51-49c7-9fd1-1042dd0cf3c1 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:08.130053 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-527e7d1a-ab51-49c7-9fd1-1042dd0cf3c1 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:08.331062 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-45d26dd5-2581-443d-a33c-84b69e50a9dc tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:08.343508 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-45d26dd5-2581-443d-a33c-84b69e50a9dc tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104" status: 200 len: 1668 microversion: 2.1 time: 0.632327 Oct 27 03:30:08.344348 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1194/2441] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:07 2022] GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104 => generated 1668 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:08.371570 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-527e7d1a-ab51-49c7-9fd1-1042dd0cf3c1 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:08.386397 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-527e7d1a-ab51-49c7-9fd1-1042dd0cf3c1 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:08.388165 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-527e7d1a-ab51-49c7-9fd1-1042dd0cf3c1 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:08.389834 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-527e7d1a-ab51-49c7-9fd1-1042dd0cf3c1 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223" status: 200 len: 1487 microversion: 2.25 time: 0.278482 Oct 27 03:30:08.390860 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1248/2442] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:30:08 2022] GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223 => generated 1487 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:30:08.399771 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-76ee00e9-5d86-4f94-af98-81d0e71b6628 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:08.402717 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-76ee00e9-5d86-4f94-af98-81d0e71b6628 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] [instance: ba3e02bc-d621-49e5-8e81-0d33828d816f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:08.428126 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4142d903-3758-48ce-a0d5-3e07bdfc25c8 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:08.428126 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4142d903-3758-48ce-a0d5-3e07bdfc25c8 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: c214e6ec-8d3d-4cef-85fc-7c2bfe01b972] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:08.428767 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-76ee00e9-5d86-4f94-af98-81d0e71b6628 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:08.428767 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-76ee00e9-5d86-4f94-af98-81d0e71b6628 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:08.428767 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-76ee00e9-5d86-4f94-af98-81d0e71b6628 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:08.428767 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-76ee00e9-5d86-4f94-af98-81d0e71b6628 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:08.428767 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-76ee00e9-5d86-4f94-af98-81d0e71b6628 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:08.429631 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-76ee00e9-5d86-4f94-af98-81d0e71b6628 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:08.441973 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4142d903-3758-48ce-a0d5-3e07bdfc25c8 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:08.442538 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4142d903-3758-48ce-a0d5-3e07bdfc25c8 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:08.442993 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4142d903-3758-48ce-a0d5-3e07bdfc25c8 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:08.443733 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4142d903-3758-48ce-a0d5-3e07bdfc25c8 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:08.444197 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4142d903-3758-48ce-a0d5-3e07bdfc25c8 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:08.444630 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4142d903-3758-48ce-a0d5-3e07bdfc25c8 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:08.679926 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-76ee00e9-5d86-4f94-af98-81d0e71b6628 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e64f7f0501454fa8474aa61c9a8c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561891c49901486c9d7651688f88b0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:08.703581 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4142d903-3758-48ce-a0d5-3e07bdfc25c8 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13e05e253c94aadb1c089128ff35be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8510a519f14deea6f35a437419e161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:08.708075 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-76ee00e9-5d86-4f94-af98-81d0e71b6628 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] 10.222.0.20 "GET /compute/v2.1/servers/ba3e02bc-d621-49e5-8e81-0d33828d816f" status: 200 len: 1275 microversion: 2.1 time: 0.328296 Oct 27 03:30:08.713102 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1195/2443] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:08 2022] GET /compute/v2.1/servers/ba3e02bc-d621-49e5-8e81-0d33828d816f => generated 1275 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:08.722297 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-c5ad1920-f60a-43c3-839f-bf3c55d66f4a req-494d0a9b-3bfa-4a47-8e14-0a728182ed48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed74f42b-af82-4808-bfc2-86110840fe86", "tag": "05464839-777e-4176-af2d-6086d6f9acaa"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:30:08.734741 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4142d903-3758-48ce-a0d5-3e07bdfc25c8 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "GET /compute/v2.1/servers/c214e6ec-8d3d-4cef-85fc-7c2bfe01b972" status: 200 len: 1468 microversion: 2.1 time: 0.315305 Oct 27 03:30:08.735583 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1249/2444] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:08 2022] GET /compute/v2.1/servers/c214e6ec-8d3d-4cef-85fc-7c2bfe01b972 => generated 1468 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:30:08.751970 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-c5ad1920-f60a-43c3-839f-bf3c55d66f4a req-494d0a9b-3bfa-4a47-8e14-0a728182ed48 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:08.752553 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-c5ad1920-f60a-43c3-839f-bf3c55d66f4a req-494d0a9b-3bfa-4a47-8e14-0a728182ed48 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:08.753144 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-c5ad1920-f60a-43c3-839f-bf3c55d66f4a req-494d0a9b-3bfa-4a47-8e14-0a728182ed48 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:08.772316 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-c5ad1920-f60a-43c3-839f-bf3c55d66f4a req-494d0a9b-3bfa-4a47-8e14-0a728182ed48 service nova] Creating event network-changed:05464839-777e-4176-af2d-6086d6f9acaa for instance ed74f42b-af82-4808-bfc2-86110840fe86 on n-h1-862769-1 Oct 27 03:30:08.779264 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-c5ad1920-f60a-43c3-839f-bf3c55d66f4a req-494d0a9b-3bfa-4a47-8e14-0a728182ed48 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067810 Oct 27 03:30:08.781135 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1196/2445] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:30:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:30:09.146306 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-85040f8e-6533-41d9-bd93-01255f86a716 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:09.146948 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-85040f8e-6533-41d9-bd93-01255f86a716 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] [instance: 04477d51-f600-483a-aec9-feb992cc6cf7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:09.162158 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-85040f8e-6533-41d9-bd93-01255f86a716 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:09.162669 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-85040f8e-6533-41d9-bd93-01255f86a716 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:09.163634 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-85040f8e-6533-41d9-bd93-01255f86a716 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:09.163839 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-85040f8e-6533-41d9-bd93-01255f86a716 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:09.164302 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-85040f8e-6533-41d9-bd93-01255f86a716 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:09.164991 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-85040f8e-6533-41d9-bd93-01255f86a716 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:09.370148 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-25675b79-ece0-4d34-9b69-5b12a4cb11e9 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:09.372376 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-25675b79-ece0-4d34-9b69-5b12a4cb11e9 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: 543fdf60-10ec-4a25-a9d0-30c386efb104] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:09.383906 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-25675b79-ece0-4d34-9b69-5b12a4cb11e9 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:09.384864 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-25675b79-ece0-4d34-9b69-5b12a4cb11e9 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:09.385315 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-25675b79-ece0-4d34-9b69-5b12a4cb11e9 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:09.386280 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-25675b79-ece0-4d34-9b69-5b12a4cb11e9 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:09.387239 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-25675b79-ece0-4d34-9b69-5b12a4cb11e9 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:09.387675 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-25675b79-ece0-4d34-9b69-5b12a4cb11e9 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:09.441797 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-85040f8e-6533-41d9-bd93-01255f86a716 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421d14944da74570a53d620ea205449d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92082c8718aa41bf96cd84d682d75954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:09.450410 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-85040f8e-6533-41d9-bd93-01255f86a716 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] 10.222.0.20 "GET /compute/v2.1/servers/04477d51-f600-483a-aec9-feb992cc6cf7" status: 200 len: 1316 microversion: 2.1 time: 0.322665 Oct 27 03:30:09.450953 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1250/2446] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:09 2022] GET /compute/v2.1/servers/04477d51-f600-483a-aec9-feb992cc6cf7 => generated 1316 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:09.455891 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f7672077-d992-4306-9c33-08b55b5d536b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:09.457277 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f7672077-d992-4306-9c33-08b55b5d536b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: d5e6f604-9466-45c6-86a8-885cfb393223] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:09.469945 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f7672077-d992-4306-9c33-08b55b5d536b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:09.470492 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f7672077-d992-4306-9c33-08b55b5d536b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:09.471285 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f7672077-d992-4306-9c33-08b55b5d536b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:09.472055 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f7672077-d992-4306-9c33-08b55b5d536b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:09.472524 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f7672077-d992-4306-9c33-08b55b5d536b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:09.473521 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f7672077-d992-4306-9c33-08b55b5d536b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:09.508011 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=93,nova_cell1:UPDATE=4 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:30:09.780016 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f7672077-d992-4306-9c33-08b55b5d536b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:09.797661 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f7672077-d992-4306-9c33-08b55b5d536b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:09.799290 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f7672077-d992-4306-9c33-08b55b5d536b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:09.801349 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f7672077-d992-4306-9c33-08b55b5d536b tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223" status: 200 len: 1487 microversion: 2.25 time: 0.349144 Oct 27 03:30:09.802447 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1251/2447] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:30:09 2022] GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223 => generated 1487 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:30:09.807080 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-201d0d21-bbb7-4a74-a4da-c55f1e3a8aad tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:09.807793 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-201d0d21-bbb7-4a74-a4da-c55f1e3a8aad tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] [instance: ba3e02bc-d621-49e5-8e81-0d33828d816f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:09.815014 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-201d0d21-bbb7-4a74-a4da-c55f1e3a8aad tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:09.819083 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-201d0d21-bbb7-4a74-a4da-c55f1e3a8aad tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:09.819083 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-201d0d21-bbb7-4a74-a4da-c55f1e3a8aad tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:09.819083 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-201d0d21-bbb7-4a74-a4da-c55f1e3a8aad tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:09.819083 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-201d0d21-bbb7-4a74-a4da-c55f1e3a8aad tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:09.819083 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-201d0d21-bbb7-4a74-a4da-c55f1e3a8aad tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:09.934831 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-201d0d21-bbb7-4a74-a4da-c55f1e3a8aad tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e64f7f0501454fa8474aa61c9a8c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561891c49901486c9d7651688f88b0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:09.945714 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-201d0d21-bbb7-4a74-a4da-c55f1e3a8aad tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] 10.222.0.20 "GET /compute/v2.1/servers/ba3e02bc-d621-49e5-8e81-0d33828d816f" status: 200 len: 1283 microversion: 2.1 time: 0.142157 Oct 27 03:30:09.961095 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1252/2448] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:09 2022] GET /compute/v2.1/servers/ba3e02bc-d621-49e5-8e81-0d33828d816f => generated 1283 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:09.961095 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-77ac4545-c690-4929-affd-9373c1635d55 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:09.961095 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-77ac4545-c690-4929-affd-9373c1635d55 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: c214e6ec-8d3d-4cef-85fc-7c2bfe01b972] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:09.970644 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-77ac4545-c690-4929-affd-9373c1635d55 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:09.970644 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-77ac4545-c690-4929-affd-9373c1635d55 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:09.974221 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-77ac4545-c690-4929-affd-9373c1635d55 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:09.974593 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-77ac4545-c690-4929-affd-9373c1635d55 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:09.977559 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-77ac4545-c690-4929-affd-9373c1635d55 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:09.978057 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-77ac4545-c690-4929-affd-9373c1635d55 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:10.179226 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-77ac4545-c690-4929-affd-9373c1635d55 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13e05e253c94aadb1c089128ff35be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8510a519f14deea6f35a437419e161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:10.198976 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-25675b79-ece0-4d34-9b69-5b12a4cb11e9 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:10.212571 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-77ac4545-c690-4929-affd-9373c1635d55 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "GET /compute/v2.1/servers/c214e6ec-8d3d-4cef-85fc-7c2bfe01b972" status: 200 len: 1468 microversion: 2.1 time: 0.264911 Oct 27 03:30:10.213136 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1253/2449] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:09 2022] GET /compute/v2.1/servers/c214e6ec-8d3d-4cef-85fc-7c2bfe01b972 => generated 1468 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:10.221474 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-25675b79-ece0-4d34-9b69-5b12a4cb11e9 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104" status: 200 len: 1668 microversion: 2.1 time: 0.856550 Oct 27 03:30:10.225835 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1197/2450] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:09 2022] GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104 => generated 1668 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:30:10.342898 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-d52a5f22-e9c4-4549-8bec-4b8a93a5bd56 req-95addb51-f165-4b09-8d62-d7dece9c3dcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04477d51-f600-483a-aec9-feb992cc6cf7", "name": "network-vif-plugged", "status": "completed", "tag": "5bbab630-1088-4a87-96b5-3098b0dbf41f"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:30:10.365643 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-d52a5f22-e9c4-4549-8bec-4b8a93a5bd56 req-95addb51-f165-4b09-8d62-d7dece9c3dcc service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:10.367615 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-d52a5f22-e9c4-4549-8bec-4b8a93a5bd56 req-95addb51-f165-4b09-8d62-d7dece9c3dcc service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:10.368072 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-d52a5f22-e9c4-4549-8bec-4b8a93a5bd56 req-95addb51-f165-4b09-8d62-d7dece9c3dcc service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:10.386960 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-d52a5f22-e9c4-4549-8bec-4b8a93a5bd56 req-95addb51-f165-4b09-8d62-d7dece9c3dcc service nova] Creating event network-vif-plugged:5bbab630-1088-4a87-96b5-3098b0dbf41f for instance 04477d51-f600-483a-aec9-feb992cc6cf7 on n-h1-862769-1 Oct 27 03:30:10.392931 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-d52a5f22-e9c4-4549-8bec-4b8a93a5bd56 req-95addb51-f165-4b09-8d62-d7dece9c3dcc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054008 Oct 27 03:30:10.399001 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1254/2451] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:30:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:30:10.477632 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0ac53957-caea-4635-8bb4-f09e59ae3e53 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:10.478472 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0ac53957-caea-4635-8bb4-f09e59ae3e53 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] [instance: 04477d51-f600-483a-aec9-feb992cc6cf7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:10.485555 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0ac53957-caea-4635-8bb4-f09e59ae3e53 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:10.486406 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0ac53957-caea-4635-8bb4-f09e59ae3e53 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:10.487033 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0ac53957-caea-4635-8bb4-f09e59ae3e53 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:10.488040 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0ac53957-caea-4635-8bb4-f09e59ae3e53 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:10.488831 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0ac53957-caea-4635-8bb4-f09e59ae3e53 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:10.489460 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0ac53957-caea-4635-8bb4-f09e59ae3e53 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:10.833893 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ce59bd88-b821-433a-afbf-5b9c7b56c50d tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:10.835106 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ce59bd88-b821-433a-afbf-5b9c7b56c50d tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: d5e6f604-9466-45c6-86a8-885cfb393223] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:10.842022 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ce59bd88-b821-433a-afbf-5b9c7b56c50d tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:10.842533 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ce59bd88-b821-433a-afbf-5b9c7b56c50d tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:10.843390 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ce59bd88-b821-433a-afbf-5b9c7b56c50d tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:10.843675 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ce59bd88-b821-433a-afbf-5b9c7b56c50d tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:10.845481 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ce59bd88-b821-433a-afbf-5b9c7b56c50d tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:10.845481 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ce59bd88-b821-433a-afbf-5b9c7b56c50d tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:10.905476 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0ac53957-caea-4635-8bb4-f09e59ae3e53 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421d14944da74570a53d620ea205449d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92082c8718aa41bf96cd84d682d75954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:10.915051 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0ac53957-caea-4635-8bb4-f09e59ae3e53 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] 10.222.0.20 "GET /compute/v2.1/servers/04477d51-f600-483a-aec9-feb992cc6cf7" status: 200 len: 1316 microversion: 2.1 time: 0.441476 Oct 27 03:30:10.915806 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1198/2452] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:10 2022] GET /compute/v2.1/servers/04477d51-f600-483a-aec9-feb992cc6cf7 => generated 1316 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:30:10.927500 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-bd08c404-fe18-4df4-bf6a-fb2ea8894032 req-4355bfc1-d7c6-4b5a-adef-35224dfecff8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5e6f604-9466-45c6-86a8-885cfb393223", "name": "network-vif-unplugged", "status": "completed", "tag": "6b270560-e2de-41cb-9470-6571434ba8f2"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:30:10.941133 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-bd08c404-fe18-4df4-bf6a-fb2ea8894032 req-4355bfc1-d7c6-4b5a-adef-35224dfecff8 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:10.941865 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-bd08c404-fe18-4df4-bf6a-fb2ea8894032 req-4355bfc1-d7c6-4b5a-adef-35224dfecff8 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:10.942681 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-bd08c404-fe18-4df4-bf6a-fb2ea8894032 req-4355bfc1-d7c6-4b5a-adef-35224dfecff8 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:10.962091 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-bd08c404-fe18-4df4-bf6a-fb2ea8894032 req-4355bfc1-d7c6-4b5a-adef-35224dfecff8 service nova] Creating event network-vif-unplugged:6b270560-e2de-41cb-9470-6571434ba8f2 for instance d5e6f604-9466-45c6-86a8-885cfb393223 on n-h1-862769-1 Oct 27 03:30:10.970276 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-bd08c404-fe18-4df4-bf6a-fb2ea8894032 req-4355bfc1-d7c6-4b5a-adef-35224dfecff8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052966 Oct 27 03:30:10.971646 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1199/2453] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:30:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:30:10.982778 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-eb5e8efb-4fdc-4e4e-9c91-c17c56bd22d9 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:10.984070 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-eb5e8efb-4fdc-4e4e-9c91-c17c56bd22d9 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] [instance: ba3e02bc-d621-49e5-8e81-0d33828d816f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:10.995243 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=97 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:30:10.997999 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eb5e8efb-4fdc-4e4e-9c91-c17c56bd22d9 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:10.998798 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eb5e8efb-4fdc-4e4e-9c91-c17c56bd22d9 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:10.999624 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eb5e8efb-4fdc-4e4e-9c91-c17c56bd22d9 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:11.000576 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eb5e8efb-4fdc-4e4e-9c91-c17c56bd22d9 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:11.001261 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eb5e8efb-4fdc-4e4e-9c91-c17c56bd22d9 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:11.001894 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eb5e8efb-4fdc-4e4e-9c91-c17c56bd22d9 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:11.092539 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ce59bd88-b821-433a-afbf-5b9c7b56c50d tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:11.103667 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ce59bd88-b821-433a-afbf-5b9c7b56c50d tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:11.106631 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ce59bd88-b821-433a-afbf-5b9c7b56c50d tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:11.107876 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ce59bd88-b821-433a-afbf-5b9c7b56c50d tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223" status: 200 len: 1487 microversion: 2.25 time: 0.281004 Oct 27 03:30:11.108463 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1255/2454] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:30:10 2022] GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223 => generated 1487 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:30:11.243157 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c88f079c-e1f8-40f2-8b35-4f6c6ce2d6a6 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:11.244613 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c88f079c-e1f8-40f2-8b35-4f6c6ce2d6a6 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: c214e6ec-8d3d-4cef-85fc-7c2bfe01b972] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:11.260670 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c88f079c-e1f8-40f2-8b35-4f6c6ce2d6a6 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:11.266684 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c88f079c-e1f8-40f2-8b35-4f6c6ce2d6a6 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:11.267304 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c88f079c-e1f8-40f2-8b35-4f6c6ce2d6a6 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:11.268160 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c88f079c-e1f8-40f2-8b35-4f6c6ce2d6a6 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:11.268940 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c88f079c-e1f8-40f2-8b35-4f6c6ce2d6a6 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:11.270328 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c88f079c-e1f8-40f2-8b35-4f6c6ce2d6a6 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:11.419279 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-eb5e8efb-4fdc-4e4e-9c91-c17c56bd22d9 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e64f7f0501454fa8474aa61c9a8c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561891c49901486c9d7651688f88b0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:11.438348 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-eb5e8efb-4fdc-4e4e-9c91-c17c56bd22d9 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] 10.222.0.20 "GET /compute/v2.1/servers/ba3e02bc-d621-49e5-8e81-0d33828d816f" status: 200 len: 1323 microversion: 2.1 time: 0.456998 Oct 27 03:30:11.443357 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1200/2455] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:10 2022] GET /compute/v2.1/servers/ba3e02bc-d621-49e5-8e81-0d33828d816f => generated 1323 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:30:11.453395 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8be3ea30-5803-4464-98b4-3fcc3cdfcd14 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:11.454431 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8be3ea30-5803-4464-98b4-3fcc3cdfcd14 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: 543fdf60-10ec-4a25-a9d0-30c386efb104] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:11.470078 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8be3ea30-5803-4464-98b4-3fcc3cdfcd14 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:11.470805 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8be3ea30-5803-4464-98b4-3fcc3cdfcd14 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:11.471402 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8be3ea30-5803-4464-98b4-3fcc3cdfcd14 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:11.472304 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8be3ea30-5803-4464-98b4-3fcc3cdfcd14 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:11.480122 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8be3ea30-5803-4464-98b4-3fcc3cdfcd14 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:11.480122 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8be3ea30-5803-4464-98b4-3fcc3cdfcd14 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:11.547264 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c88f079c-e1f8-40f2-8b35-4f6c6ce2d6a6 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13e05e253c94aadb1c089128ff35be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8510a519f14deea6f35a437419e161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:11.566498 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c88f079c-e1f8-40f2-8b35-4f6c6ce2d6a6 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "GET /compute/v2.1/servers/c214e6ec-8d3d-4cef-85fc-7c2bfe01b972" status: 200 len: 1426 microversion: 2.1 time: 0.332040 Oct 27 03:30:11.572628 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1256/2456] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:11 2022] GET /compute/v2.1/servers/c214e6ec-8d3d-4cef-85fc-7c2bfe01b972 => generated 1426 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:11.781347 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8be3ea30-5803-4464-98b4-3fcc3cdfcd14 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:11.794427 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8be3ea30-5803-4464-98b4-3fcc3cdfcd14 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104" status: 200 len: 1600 microversion: 2.1 time: 0.349655 Oct 27 03:30:11.798501 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1201/2457] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:11 2022] GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104 => generated 1600 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:11.944428 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d7a4b124-e5bd-4f89-81b8-7fefd584fcd6 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:11.945242 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d7a4b124-e5bd-4f89-81b8-7fefd584fcd6 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] [instance: 04477d51-f600-483a-aec9-feb992cc6cf7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:11.962999 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d7a4b124-e5bd-4f89-81b8-7fefd584fcd6 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:11.984648 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d7a4b124-e5bd-4f89-81b8-7fefd584fcd6 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:11.992783 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d7a4b124-e5bd-4f89-81b8-7fefd584fcd6 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:11.993743 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d7a4b124-e5bd-4f89-81b8-7fefd584fcd6 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:11.994495 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d7a4b124-e5bd-4f89-81b8-7fefd584fcd6 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:11.994942 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d7a4b124-e5bd-4f89-81b8-7fefd584fcd6 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:12.146468 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d108dae2-2a66-42cd-9060-4b0683922b70 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:12.148996 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d108dae2-2a66-42cd-9060-4b0683922b70 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: d5e6f604-9466-45c6-86a8-885cfb393223] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:12.168152 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d108dae2-2a66-42cd-9060-4b0683922b70 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:12.174597 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d108dae2-2a66-42cd-9060-4b0683922b70 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:12.175152 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d108dae2-2a66-42cd-9060-4b0683922b70 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:12.177310 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d108dae2-2a66-42cd-9060-4b0683922b70 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:12.178005 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d108dae2-2a66-42cd-9060-4b0683922b70 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:12.179294 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d108dae2-2a66-42cd-9060-4b0683922b70 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:12.307382 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d7a4b124-e5bd-4f89-81b8-7fefd584fcd6 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421d14944da74570a53d620ea205449d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92082c8718aa41bf96cd84d682d75954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:12.317068 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d7a4b124-e5bd-4f89-81b8-7fefd584fcd6 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] 10.222.0.20 "GET /compute/v2.1/servers/04477d51-f600-483a-aec9-feb992cc6cf7" status: 200 len: 1316 microversion: 2.1 time: 0.376677 Oct 27 03:30:12.318218 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1257/2458] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:11 2022] GET /compute/v2.1/servers/04477d51-f600-483a-aec9-feb992cc6cf7 => generated 1316 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:12.473724 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e3bba44f-e6c9-4a6b-88c4-d3a8b526a523 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:12.477823 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e3bba44f-e6c9-4a6b-88c4-d3a8b526a523 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] [instance: ba3e02bc-d621-49e5-8e81-0d33828d816f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:12.539929 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e3bba44f-e6c9-4a6b-88c4-d3a8b526a523 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:12.541280 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e3bba44f-e6c9-4a6b-88c4-d3a8b526a523 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:12.541936 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e3bba44f-e6c9-4a6b-88c4-d3a8b526a523 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:12.542909 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e3bba44f-e6c9-4a6b-88c4-d3a8b526a523 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:12.543812 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e3bba44f-e6c9-4a6b-88c4-d3a8b526a523 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:12.548243 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e3bba44f-e6c9-4a6b-88c4-d3a8b526a523 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:12.720542 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d108dae2-2a66-42cd-9060-4b0683922b70 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:12.731938 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d108dae2-2a66-42cd-9060-4b0683922b70 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:12.735823 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d108dae2-2a66-42cd-9060-4b0683922b70 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:12.740886 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d108dae2-2a66-42cd-9060-4b0683922b70 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223" status: 200 len: 1487 microversion: 2.25 time: 0.610661 Oct 27 03:30:12.754688 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1202/2459] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:30:12 2022] GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223 => generated 1487 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:30:12.768953 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d62d7a08-bcf4-4ed1-8da9-9865d037cd3a tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:12.769644 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d62d7a08-bcf4-4ed1-8da9-9865d037cd3a tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: c214e6ec-8d3d-4cef-85fc-7c2bfe01b972] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:12.776947 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d62d7a08-bcf4-4ed1-8da9-9865d037cd3a tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:12.777667 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d62d7a08-bcf4-4ed1-8da9-9865d037cd3a tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:12.778438 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d62d7a08-bcf4-4ed1-8da9-9865d037cd3a tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:12.779230 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d62d7a08-bcf4-4ed1-8da9-9865d037cd3a tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:12.783473 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d62d7a08-bcf4-4ed1-8da9-9865d037cd3a tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:12.783473 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d62d7a08-bcf4-4ed1-8da9-9865d037cd3a tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:12.820552 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d62d7a08-bcf4-4ed1-8da9-9865d037cd3a tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:12.821051 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d62d7a08-bcf4-4ed1-8da9-9865d037cd3a tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:12.821531 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d62d7a08-bcf4-4ed1-8da9-9865d037cd3a tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:12.822235 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-d62d7a08-bcf4-4ed1-8da9-9865d037cd3a tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lazy-loading 'fault' on Instance uuid c214e6ec-8d3d-4cef-85fc-7c2bfe01b972 {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:30:12.918624 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e3bba44f-e6c9-4a6b-88c4-d3a8b526a523 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e64f7f0501454fa8474aa61c9a8c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561891c49901486c9d7651688f88b0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:12.928150 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e3bba44f-e6c9-4a6b-88c4-d3a8b526a523 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] 10.222.0.20 "GET /compute/v2.1/servers/ba3e02bc-d621-49e5-8e81-0d33828d816f" status: 200 len: 1323 microversion: 2.1 time: 0.463048 Oct 27 03:30:12.931952 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1258/2460] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:12 2022] GET /compute/v2.1/servers/ba3e02bc-d621-49e5-8e81-0d33828d816f => generated 1323 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:30:12.938961 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-67063908-dfb1-4669-ab32-fe10deb01632 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:12.939999 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-67063908-dfb1-4669-ab32-fe10deb01632 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: 543fdf60-10ec-4a25-a9d0-30c386efb104] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:12.953734 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-67063908-dfb1-4669-ab32-fe10deb01632 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:12.954588 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-67063908-dfb1-4669-ab32-fe10deb01632 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:12.955226 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-67063908-dfb1-4669-ab32-fe10deb01632 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:12.956051 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-67063908-dfb1-4669-ab32-fe10deb01632 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:12.956677 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-67063908-dfb1-4669-ab32-fe10deb01632 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:12.957153 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-67063908-dfb1-4669-ab32-fe10deb01632 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:13.134362 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-67063908-dfb1-4669-ab32-fe10deb01632 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:13.151852 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-67063908-dfb1-4669-ab32-fe10deb01632 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104" status: 200 len: 1600 microversion: 2.1 time: 0.217762 Oct 27 03:30:13.169041 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1259/2461] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:12 2022] GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104 => generated 1600 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:13.180590 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-68d3d180-5b5e-4cfb-aa78-3f0b4ba2f5b5 req-a138891e-1371-4eb0-8824-427d53364c1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba3e02bc-d621-49e5-8e81-0d33828d816f", "tag": "c4245fca-d73e-4082-8c2c-d2a10511c5ee"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:30:13.198365 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-68d3d180-5b5e-4cfb-aa78-3f0b4ba2f5b5 req-a138891e-1371-4eb0-8824-427d53364c1d service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:13.205556 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-68d3d180-5b5e-4cfb-aa78-3f0b4ba2f5b5 req-a138891e-1371-4eb0-8824-427d53364c1d service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:13.208564 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-68d3d180-5b5e-4cfb-aa78-3f0b4ba2f5b5 req-a138891e-1371-4eb0-8824-427d53364c1d service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:13.221425 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-68d3d180-5b5e-4cfb-aa78-3f0b4ba2f5b5 req-a138891e-1371-4eb0-8824-427d53364c1d service nova] Creating event network-changed:c4245fca-d73e-4082-8c2c-d2a10511c5ee for instance ba3e02bc-d621-49e5-8e81-0d33828d816f on n-h2-862769-1 Oct 27 03:30:13.226962 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-68d3d180-5b5e-4cfb-aa78-3f0b4ba2f5b5 req-a138891e-1371-4eb0-8824-427d53364c1d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058331 Oct 27 03:30:13.229043 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1260/2462] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:30:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:30:13.286899 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-b0894529-6760-49de-9351-65e8bd32709b req-87cefe04-70b5-4fd8-8095-c4ee1934cb6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c214e6ec-8d3d-4cef-85fc-7c2bfe01b972", "name": "network-vif-deleted", "tag": "3602da80-5480-49d6-95b5-bdca0e2792ca"}, {"name": "network-changed", "server_uuid": "d5e6f604-9466-45c6-86a8-885cfb393223", "tag": "6b270560-e2de-41cb-9470-6571434ba8f2"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:30:13.300785 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:30:13.304193 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-b0894529-6760-49de-9351-65e8bd32709b req-87cefe04-70b5-4fd8-8095-c4ee1934cb6f service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:13.304845 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-b0894529-6760-49de-9351-65e8bd32709b req-87cefe04-70b5-4fd8-8095-c4ee1934cb6f service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:13.306092 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-b0894529-6760-49de-9351-65e8bd32709b req-87cefe04-70b5-4fd8-8095-c4ee1934cb6f service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:13.320988 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d62d7a08-bcf4-4ed1-8da9-9865d037cd3a tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13e05e253c94aadb1c089128ff35be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8510a519f14deea6f35a437419e161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:13.328997 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-b0894529-6760-49de-9351-65e8bd32709b req-87cefe04-70b5-4fd8-8095-c4ee1934cb6f service nova] Creating event network-vif-deleted:3602da80-5480-49d6-95b5-bdca0e2792ca for instance c214e6ec-8d3d-4cef-85fc-7c2bfe01b972 on n-h2-862769-1 Oct 27 03:30:13.329877 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-b0894529-6760-49de-9351-65e8bd32709b req-87cefe04-70b5-4fd8-8095-c4ee1934cb6f service nova] Creating event network-changed:6b270560-e2de-41cb-9470-6571434ba8f2 for instance d5e6f604-9466-45c6-86a8-885cfb393223 on n-h1-862769-1 Oct 27 03:30:13.331202 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d62d7a08-bcf4-4ed1-8da9-9865d037cd3a tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "GET /compute/v2.1/servers/c214e6ec-8d3d-4cef-85fc-7c2bfe01b972" status: 200 len: 1302 microversion: 2.1 time: 0.575370 Oct 27 03:30:13.332768 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1203/2463] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:12 2022] GET /compute/v2.1/servers/c214e6ec-8d3d-4cef-85fc-7c2bfe01b972 => generated 1302 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:13.352727 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a54b5caf-d426-405f-809e-2a24c9493b5f tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:13.354900 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a54b5caf-d426-405f-809e-2a24c9493b5f tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] [instance: 04477d51-f600-483a-aec9-feb992cc6cf7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:13.355649 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-b0894529-6760-49de-9351-65e8bd32709b req-87cefe04-70b5-4fd8-8095-c4ee1934cb6f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.076249 Oct 27 03:30:13.356613 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1261/2464] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:30:13 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:30:13.371475 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a54b5caf-d426-405f-809e-2a24c9493b5f tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:13.372283 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a54b5caf-d426-405f-809e-2a24c9493b5f tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:13.372947 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a54b5caf-d426-405f-809e-2a24c9493b5f tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:13.374213 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a54b5caf-d426-405f-809e-2a24c9493b5f tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:13.375661 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a54b5caf-d426-405f-809e-2a24c9493b5f tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:13.376373 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a54b5caf-d426-405f-809e-2a24c9493b5f tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:13.759122 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a54b5caf-d426-405f-809e-2a24c9493b5f tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421d14944da74570a53d620ea205449d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92082c8718aa41bf96cd84d682d75954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:13.773919 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f6c7b06e-96be-486a-b1fc-a288130b38d6 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:13.774159 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a54b5caf-d426-405f-809e-2a24c9493b5f tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] 10.222.0.20 "GET /compute/v2.1/servers/04477d51-f600-483a-aec9-feb992cc6cf7" status: 200 len: 1504 microversion: 2.1 time: 0.435986 Oct 27 03:30:13.774819 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f6c7b06e-96be-486a-b1fc-a288130b38d6 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: d5e6f604-9466-45c6-86a8-885cfb393223] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:13.775003 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1204/2465] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:13 2022] GET /compute/v2.1/servers/04477d51-f600-483a-aec9-feb992cc6cf7 => generated 1504 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:13.793087 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f6c7b06e-96be-486a-b1fc-a288130b38d6 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:13.793586 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f6c7b06e-96be-486a-b1fc-a288130b38d6 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:13.803083 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f6c7b06e-96be-486a-b1fc-a288130b38d6 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:13.803083 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f6c7b06e-96be-486a-b1fc-a288130b38d6 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:13.803083 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f6c7b06e-96be-486a-b1fc-a288130b38d6 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:13.803083 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f6c7b06e-96be-486a-b1fc-a288130b38d6 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:13.810163 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-25e57ce7-c2e2-42ea-a5e7-ba1d166124be tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1463773905"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:30:13.810728 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-25e57ce7-c2e2-42ea-a5e7-ba1d166124be tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] [instance: 04477d51-f600-483a-aec9-feb992cc6cf7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:13.819654 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-25e57ce7-c2e2-42ea-a5e7-ba1d166124be tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:13.820144 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-25e57ce7-c2e2-42ea-a5e7-ba1d166124be tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:13.820579 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-25e57ce7-c2e2-42ea-a5e7-ba1d166124be tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:13.821300 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-25e57ce7-c2e2-42ea-a5e7-ba1d166124be tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:13.822007 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-25e57ce7-c2e2-42ea-a5e7-ba1d166124be tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:13.829304 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-25e57ce7-c2e2-42ea-a5e7-ba1d166124be tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:14.034440 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=8 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:30:14.615950 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.network.security_group_api [None req-25e57ce7-c2e2-42ea-a5e7-ba1d166124be tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Adding security group 9c3c1208-d0fd-42fc-8007-73f03701f25e to port 5bbab630-1088-4a87-96b5-3098b0dbf41f Oct 27 03:30:14.664650 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f6c7b06e-96be-486a-b1fc-a288130b38d6 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:14.683254 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f6c7b06e-96be-486a-b1fc-a288130b38d6 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:14.691932 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f6c7b06e-96be-486a-b1fc-a288130b38d6 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:14.694486 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f6c7b06e-96be-486a-b1fc-a288130b38d6 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223" status: 200 len: 1487 microversion: 2.25 time: 0.924769 Oct 27 03:30:14.695714 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1262/2466] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:30:13 2022] GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223 => generated 1487 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:30:14.703911 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d0c89f73-a55f-491b-a596-b5c7ea13e277 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:14.704748 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d0c89f73-a55f-491b-a596-b5c7ea13e277 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] [instance: ba3e02bc-d621-49e5-8e81-0d33828d816f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:14.714784 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d0c89f73-a55f-491b-a596-b5c7ea13e277 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:14.715654 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d0c89f73-a55f-491b-a596-b5c7ea13e277 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:14.716260 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d0c89f73-a55f-491b-a596-b5c7ea13e277 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:14.726493 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d0c89f73-a55f-491b-a596-b5c7ea13e277 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:14.729856 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d0c89f73-a55f-491b-a596-b5c7ea13e277 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:14.730539 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d0c89f73-a55f-491b-a596-b5c7ea13e277 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:15.035400 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d0c89f73-a55f-491b-a596-b5c7ea13e277 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e64f7f0501454fa8474aa61c9a8c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561891c49901486c9d7651688f88b0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:15.046955 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d0c89f73-a55f-491b-a596-b5c7ea13e277 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] 10.222.0.20 "GET /compute/v2.1/servers/ba3e02bc-d621-49e5-8e81-0d33828d816f" status: 200 len: 1323 microversion: 2.1 time: 0.349207 Oct 27 03:30:15.053922 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1263/2467] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:14 2022] GET /compute/v2.1/servers/ba3e02bc-d621-49e5-8e81-0d33828d816f => generated 1323 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:15.063615 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2aab8eb8-249f-4939-9a6a-16e7450bf6c5 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:15.067500 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2aab8eb8-249f-4939-9a6a-16e7450bf6c5 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: 543fdf60-10ec-4a25-a9d0-30c386efb104] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:15.075054 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2aab8eb8-249f-4939-9a6a-16e7450bf6c5 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:15.075790 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2aab8eb8-249f-4939-9a6a-16e7450bf6c5 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:15.076380 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2aab8eb8-249f-4939-9a6a-16e7450bf6c5 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:15.077253 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2aab8eb8-249f-4939-9a6a-16e7450bf6c5 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:15.077861 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2aab8eb8-249f-4939-9a6a-16e7450bf6c5 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:15.078527 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2aab8eb8-249f-4939-9a6a-16e7450bf6c5 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:15.136314 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2aab8eb8-249f-4939-9a6a-16e7450bf6c5 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:15.137263 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2aab8eb8-249f-4939-9a6a-16e7450bf6c5 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:15.138436 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2aab8eb8-249f-4939-9a6a-16e7450bf6c5 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:15.139054 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-2aab8eb8-249f-4939-9a6a-16e7450bf6c5 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lazy-loading 'fault' on Instance uuid 543fdf60-10ec-4a25-a9d0-30c386efb104 {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:30:15.218856 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2aab8eb8-249f-4939-9a6a-16e7450bf6c5 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:15.229583 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2aab8eb8-249f-4939-9a6a-16e7450bf6c5 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104" status: 200 len: 1324 microversion: 2.1 time: 0.174170 Oct 27 03:30:15.230942 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1264/2468] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:15 2022] GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104 => generated 1324 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:15.236252 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-90cc3651-2a5f-4bb4-af49-9b0c7dbdefdb tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:15.239814 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-90cc3651-2a5f-4bb4-af49-9b0c7dbdefdb tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: c214e6ec-8d3d-4cef-85fc-7c2bfe01b972] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:15.244991 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-90cc3651-2a5f-4bb4-af49-9b0c7dbdefdb tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:15.245506 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-90cc3651-2a5f-4bb4-af49-9b0c7dbdefdb tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:15.245947 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-90cc3651-2a5f-4bb4-af49-9b0c7dbdefdb tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:15.246750 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-90cc3651-2a5f-4bb4-af49-9b0c7dbdefdb tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:15.247463 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-90cc3651-2a5f-4bb4-af49-9b0c7dbdefdb tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:15.247897 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-90cc3651-2a5f-4bb4-af49-9b0c7dbdefdb tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:15.279483 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-90cc3651-2a5f-4bb4-af49-9b0c7dbdefdb tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] HTTP exception thrown: Instance c214e6ec-8d3d-4cef-85fc-7c2bfe01b972 could not be found. Oct 27 03:30:15.283324 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-90cc3651-2a5f-4bb4-af49-9b0c7dbdefdb tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Request method failure captured: Oct 27 03:30:15.283324 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/c214e6ec-8d3d-4cef-85fc-7c2bfe01b972 HTTP/1.1 Oct 27 03:30:15.283324 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:30:15.283324 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:30:15.283324 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:30:15.283324 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:30:15.283324 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:30:15.283324 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:30:15.283324 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:30:15.283324 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:30:15.283324 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfqe_f6klSBWxgHJhrkMKU1jjTutLzdS5yP5cVaJx7CD4SpsaA9eFzNBelj8Df37AqQIauKmTdjEzxZfV-SkZsp-fdTJEBQmTQbH47veq0MyVE5xHm_0xRuqrKEixJ6MNqSyPaMFYb1G1FwqsXy7fj3afl8K-QHetdJvpDiWZ49aVxw Oct 27 03:30:15.283324 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:30:15.283324 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:30:15.283324 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:30:15.283324 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:30:15.283324 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:30:15.283324 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:30:15.283324 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 2c8510a519f14deea6f35a437419e161 Oct 27 03:30:15.283324 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServersAdminTestJSON-1349869830 Oct 27 03:30:15.283324 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:30:15.283324 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:30:15.283324 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c8510a519f14deea6f35a437419e161"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2c8510a519f14deea6f35a437419e161"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c8510a519f14deea6f35a437419e161"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2c8510a519f14deea6f35a437419e161"}]}] Oct 27 03:30:15.283324 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServersAdminTestJSON-1349869830 Oct 27 03:30:15.283324 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 2c8510a519f14deea6f35a437419e161 Oct 27 03:30:15.283324 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServersAdminTestJSON-1349869830 Oct 27 03:30:15.283324 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServersAdminTestJSON-1349869830-project Oct 27 03:30:15.283324 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:30:15.283324 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:30:15.283324 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: c13e05e253c94aadb1c089128ff35be5 Oct 27 03:30:15.283324 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServersAdminTestJSON-1349869830-project Oct 27 03:30:15.283324 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:30:15.283324 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance c214e6ec-8d3d-4cef-85fc-7c2bfe01b972 could not be found. Oct 27 03:30:15.283324 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': 'c214e6ec-8d3d-4cef-85fc-7c2bfe01b972'} Oct 27 03:30:15.283324 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:30:15.283324 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:15.283324 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:30:15.283324 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:30:15.283324 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:30:15.283324 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:30:15.283324 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:30:15.283324 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:30:15.283324 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:30:15.283324 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:30:15.283324 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c214e6ec-8d3d-4cef-85fc-7c2bfe01b972 could not be found. Oct 27 03:30:15.283324 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:15.283324 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:30:15.283324 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:15.283324 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:15.283324 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:30:15.283324 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:30:15.283324 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:30:15.283324 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:30:15.283324 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:30:15.283324 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:30:15.283324 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:30:15.283324 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:30:15.283324 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:30:15.283324 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:30:15.283324 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:30:15.283324 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:30:15.283324 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c214e6ec-8d3d-4cef-85fc-7c2bfe01b972 could not be found. Oct 27 03:30:15.283324 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:15.283324 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:30:15.283324 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:15.287346 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:15.287346 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:30:15.287346 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:30:15.287346 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:30:15.287346 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:30:15.287346 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c214e6ec-8d3d-4cef-85fc-7c2bfe01b972 could not be found. Oct 27 03:30:15.287346 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:15.290097 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-90cc3651-2a5f-4bb4-af49-9b0c7dbdefdb tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Returning 404 to user: Instance c214e6ec-8d3d-4cef-85fc-7c2bfe01b972 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:30:15.291540 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-90cc3651-2a5f-4bb4-af49-9b0c7dbdefdb tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "GET /compute/v2.1/servers/c214e6ec-8d3d-4cef-85fc-7c2bfe01b972" status: 404 len: 111 microversion: 2.1 time: 0.059495 Oct 27 03:30:15.294832 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1265/2469] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:15 2022] GET /compute/v2.1/servers/c214e6ec-8d3d-4cef-85fc-7c2bfe01b972 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:30:15.318197 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0958fb4f-8bc8-4068-924d-755984fbcd2a tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:15.318831 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0958fb4f-8bc8-4068-924d-755984fbcd2a tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: 62224107-28c3-40c7-b4d3-13881d1c8d65] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:15.327925 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0958fb4f-8bc8-4068-924d-755984fbcd2a tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:15.328714 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0958fb4f-8bc8-4068-924d-755984fbcd2a tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:15.329372 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0958fb4f-8bc8-4068-924d-755984fbcd2a tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:15.330351 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0958fb4f-8bc8-4068-924d-755984fbcd2a tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:15.332219 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0958fb4f-8bc8-4068-924d-755984fbcd2a tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:15.332844 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0958fb4f-8bc8-4068-924d-755984fbcd2a tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:15.398912 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0958fb4f-8bc8-4068-924d-755984fbcd2a tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: 62224107-28c3-40c7-b4d3-13881d1c8d65] Going to try to terminate instance {{(pid=121001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:30:15.777514 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-25e57ce7-c2e2-42ea-a5e7-ba1d166124be tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] 10.222.0.20 "POST /compute/v2.1/servers/04477d51-f600-483a-aec9-feb992cc6cf7/action" status: 202 len: 0 microversion: 2.1 time: 1.970693 Oct 27 03:30:15.777946 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1205/2470] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:30:13 2022] POST /compute/v2.1/servers/04477d51-f600-483a-aec9-feb992cc6cf7/action => generated 0 bytes in 1972 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:30:15.782935 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-949be9bf-110a-44fe-a4de-6ca04af8209f req-cf43f89a-61ff-4e7c-ae60-511c78f9d30f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "543fdf60-10ec-4a25-a9d0-30c386efb104", "name": "network-vif-deleted", "tag": "d7e171e9-cc70-4509-97bd-e3890c3c8411"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:30:15.814931 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-949be9bf-110a-44fe-a4de-6ca04af8209f req-cf43f89a-61ff-4e7c-ae60-511c78f9d30f service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:15.816638 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-949be9bf-110a-44fe-a4de-6ca04af8209f req-cf43f89a-61ff-4e7c-ae60-511c78f9d30f service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:15.817101 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-949be9bf-110a-44fe-a4de-6ca04af8209f req-cf43f89a-61ff-4e7c-ae60-511c78f9d30f service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:15.832838 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-949be9bf-110a-44fe-a4de-6ca04af8209f req-cf43f89a-61ff-4e7c-ae60-511c78f9d30f service nova] Creating event network-vif-deleted:d7e171e9-cc70-4509-97bd-e3890c3c8411 for instance 543fdf60-10ec-4a25-a9d0-30c386efb104 on n-h1-862769-1 Oct 27 03:30:15.837998 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-949be9bf-110a-44fe-a4de-6ca04af8209f req-cf43f89a-61ff-4e7c-ae60-511c78f9d30f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059083 Oct 27 03:30:15.839118 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1206/2471] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:30:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:30:15.844811 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8a7bb9dc-1ab1-46fb-b746-0451bffc7740 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:15.845713 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8a7bb9dc-1ab1-46fb-b746-0451bffc7740 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: d5e6f604-9466-45c6-86a8-885cfb393223] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:15.852896 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8a7bb9dc-1ab1-46fb-b746-0451bffc7740 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:15.853379 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8a7bb9dc-1ab1-46fb-b746-0451bffc7740 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:15.855894 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8a7bb9dc-1ab1-46fb-b746-0451bffc7740 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:15.856637 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8a7bb9dc-1ab1-46fb-b746-0451bffc7740 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:15.859151 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8a7bb9dc-1ab1-46fb-b746-0451bffc7740 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:15.859824 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8a7bb9dc-1ab1-46fb-b746-0451bffc7740 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:15.989501 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0958fb4f-8bc8-4068-924d-755984fbcd2a tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "DELETE /compute/v2.1/servers/62224107-28c3-40c7-b4d3-13881d1c8d65" status: 204 len: 0 microversion: 2.1 time: 0.686188 Oct 27 03:30:15.993263 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1266/2472] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:30:15 2022] DELETE /compute/v2.1/servers/62224107-28c3-40c7-b4d3-13881d1c8d65 => generated 0 bytes in 692 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:30:15.997985 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5119eb87-2b3a-4605-b9bf-5cde3e04d787 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Calling method '.version_select at 0x7f7ddab7a280>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:16.148933 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8a7bb9dc-1ab1-46fb-b746-0451bffc7740 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:16.154729 n-d-862769-1 devstack@n-api.service[121001]: DEBUG neutronclient.v2_0.client [None req-5119eb87-2b3a-4605-b9bf-5cde3e04d787 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 9c3c1208-d0fd-42fc-8007-73f03701f25e in use.", "detail": ""}} {{(pid=121001) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 03:30:16.156461 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-5119eb87-2b3a-4605-b9bf-5cde3e04d787 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] HTTP exception thrown: Security Group 9c3c1208-d0fd-42fc-8007-73f03701f25e in use. Oct 27 03:30:16.156461 n-d-862769-1 devstack@n-api.service[121001]: Neutron server returns request_ids: ['req-05f56dee-4b14-435a-8da1-417a47c4ae7b'] Oct 27 03:30:16.161586 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5119eb87-2b3a-4605-b9bf-5cde3e04d787 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Request method failure captured: Oct 27 03:30:16.161586 n-d-862769-1 devstack@n-api.service[121001]: request: DELETE /compute/v2.1/os-security-groups/9c3c1208-d0fd-42fc-8007-73f03701f25e HTTP/1.1 Oct 27 03:30:16.161586 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:30:16.161586 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:30:16.161586 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:30:16.161586 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:30:16.161586 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:30:16.161586 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:30:16.161586 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:30:16.161586 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:30:16.161586 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfsDm0Py_zt25h362jzfO2BV3foI0uyhpjoORk0IBXpXJDIOp5L0sBs5ZGjH5wntvfF1YWko5rdp9M7xGcdJ8XvPLxOQRZn1LZea5O-2FHM2FJsNqsONwbzuZ-uFy7VwM4IakmeqODIMdeP73cGPmeJKxcyXnuTU87F5wWBu1IQyRCI Oct 27 03:30:16.161586 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:30:16.161586 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:30:16.161586 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:30:16.161586 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:30:16.161586 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:30:16.161586 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:30:16.161586 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 92082c8718aa41bf96cd84d682d75954 Oct 27 03:30:16.161586 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-SecurityGroupsTestJSON-1273178137 Oct 27 03:30:16.161586 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:30:16.161586 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:30:16.161586 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/92082c8718aa41bf96cd84d682d75954"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/92082c8718aa41bf96cd84d682d75954"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/92082c8718aa41bf96cd84d682d75954"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_92082c8718aa41bf96cd84d682d75954"}]}] Oct 27 03:30:16.161586 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-SecurityGroupsTestJSON-1273178137 Oct 27 03:30:16.161586 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 92082c8718aa41bf96cd84d682d75954 Oct 27 03:30:16.161586 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1273178137 Oct 27 03:30:16.161586 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-SecurityGroupsTestJSON-1273178137-project Oct 27 03:30:16.161586 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:30:16.161586 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:30:16.161586 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 421d14944da74570a53d620ea205449d Oct 27 03:30:16.161586 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-SecurityGroupsTestJSON-1273178137-project Oct 27 03:30:16.161586 n-d-862769-1 devstack@n-api.service[121001]: method: Oct 27 03:30:16.161586 n-d-862769-1 devstack@n-api.service[121001]: exception: Security Group 9c3c1208-d0fd-42fc-8007-73f03701f25e in use. Oct 27 03:30:16.161586 n-d-862769-1 devstack@n-api.service[121001]: Neutron server returns request_ids: ['req-05f56dee-4b14-435a-8da1-417a47c4ae7b'] Oct 27 03:30:16.161586 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '9c3c1208-d0fd-42fc-8007-73f03701f25e'} Oct 27 03:30:16.161586 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:30:16.161586 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:16.161586 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 27 03:30:16.161586 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 27 03:30:16.161586 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:30:16.161586 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:30:16.161586 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 27 03:30:16.161586 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 27 03:30:16.161586 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:30:16.161586 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:30:16.161586 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 27 03:30:16.161586 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 27 03:30:16.161586 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:30:16.161586 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:30:16.161586 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 03:30:16.161586 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 03:30:16.161586 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:30:16.161586 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:30:16.161586 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 03:30:16.161586 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 03:30:16.161586 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:30:16.161586 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:30:16.161586 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 03:30:16.161586 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 03:30:16.161586 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 03:30:16.161586 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 03:30:16.161586 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 9c3c1208-d0fd-42fc-8007-73f03701f25e in use. Oct 27 03:30:16.181916 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-05f56dee-4b14-435a-8da1-417a47c4ae7b'] Oct 27 03:30:16.181916 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:16.181916 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:30:16.181916 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:16.181916 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:16.181916 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 27 03:30:16.181916 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 27 03:30:16.181916 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 27 03:30:16.181916 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 27 03:30:16.181916 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 9c3c1208-d0fd-42fc-8007-73f03701f25e in use. Oct 27 03:30:16.181916 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-05f56dee-4b14-435a-8da1-417a47c4ae7b'] Oct 27 03:30:16.181916 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:16.181916 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:30:16.181916 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:16.181916 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:16.181916 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:30:16.181916 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:30:16.181916 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:30:16.181916 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:30:16.181916 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:30:16.181916 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:30:16.181916 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:30:16.181916 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:30:16.181916 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 27 03:30:16.181916 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 27 03:30:16.181916 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 9c3c1208-d0fd-42fc-8007-73f03701f25e in use. Oct 27 03:30:16.181916 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-05f56dee-4b14-435a-8da1-417a47c4ae7b'] Oct 27 03:30:16.181916 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:16.181916 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:30:16.181916 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:16.181916 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:16.181916 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:30:16.181916 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:30:16.181916 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:30:16.181916 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:30:16.181916 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 9c3c1208-d0fd-42fc-8007-73f03701f25e in use. Oct 27 03:30:16.181916 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-05f56dee-4b14-435a-8da1-417a47c4ae7b'] Oct 27 03:30:16.181916 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:16.192546 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8a7bb9dc-1ab1-46fb-b746-0451bffc7740 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:16.192822 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5119eb87-2b3a-4605-b9bf-5cde3e04d787 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Returning 400 to user: Security Group 9c3c1208-d0fd-42fc-8007-73f03701f25e in use. Oct 27 03:30:16.192822 n-d-862769-1 devstack@n-api.service[121001]: Neutron server returns request_ids: ['req-05f56dee-4b14-435a-8da1-417a47c4ae7b'] {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:30:16.192822 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5119eb87-2b3a-4605-b9bf-5cde3e04d787 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/9c3c1208-d0fd-42fc-8007-73f03701f25e" status: 400 len: 185 microversion: 2.1 time: 0.172223 Oct 27 03:30:16.193033 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8a7bb9dc-1ab1-46fb-b746-0451bffc7740 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:16.193112 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1267/2473] 10.222.0.20 () {58 vars in 1272 bytes} [Thu Oct 27 03:30:15 2022] DELETE /compute/v2.1/os-security-groups/9c3c1208-d0fd-42fc-8007-73f03701f25e => generated 185 bytes in 173 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 03:30:16.193180 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8a7bb9dc-1ab1-46fb-b746-0451bffc7740 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223" status: 200 len: 1487 microversion: 2.25 time: 0.325110 Oct 27 03:30:16.193180 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1207/2474] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:30:15 2022] GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223 => generated 1487 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:30:16.193180 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a39bd685-6ad1-4a9c-8833-57d44f185130 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:16.193180 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a39bd685-6ad1-4a9c-8833-57d44f185130 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] [instance: ba3e02bc-d621-49e5-8e81-0d33828d816f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:16.193180 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a39bd685-6ad1-4a9c-8833-57d44f185130 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:16.193180 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a39bd685-6ad1-4a9c-8833-57d44f185130 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:16.193180 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a39bd685-6ad1-4a9c-8833-57d44f185130 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:16.193180 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a39bd685-6ad1-4a9c-8833-57d44f185130 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:16.193180 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a39bd685-6ad1-4a9c-8833-57d44f185130 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:16.193180 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a39bd685-6ad1-4a9c-8833-57d44f185130 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:16.202746 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a498f5ba-a6d3-4182-93ad-3d973fc2c9c4 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:16.588111 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a498f5ba-a6d3-4182-93ad-3d973fc2c9c4 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: 62224107-28c3-40c7-b4d3-13881d1c8d65] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:16.588111 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a498f5ba-a6d3-4182-93ad-3d973fc2c9c4 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:16.588111 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a498f5ba-a6d3-4182-93ad-3d973fc2c9c4 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:16.588111 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a498f5ba-a6d3-4182-93ad-3d973fc2c9c4 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:16.588111 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a498f5ba-a6d3-4182-93ad-3d973fc2c9c4 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:16.588111 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a498f5ba-a6d3-4182-93ad-3d973fc2c9c4 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:16.588111 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a498f5ba-a6d3-4182-93ad-3d973fc2c9c4 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:16.589530 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a39bd685-6ad1-4a9c-8833-57d44f185130 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e64f7f0501454fa8474aa61c9a8c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561891c49901486c9d7651688f88b0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:16.589530 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a39bd685-6ad1-4a9c-8833-57d44f185130 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] 10.222.0.20 "GET /compute/v2.1/servers/ba3e02bc-d621-49e5-8e81-0d33828d816f" status: 200 len: 1323 microversion: 2.1 time: 0.216047 Oct 27 03:30:16.589530 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1208/2475] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:16 2022] GET /compute/v2.1/servers/ba3e02bc-d621-49e5-8e81-0d33828d816f => generated 1323 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:16.589979 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a498f5ba-a6d3-4182-93ad-3d973fc2c9c4 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13e05e253c94aadb1c089128ff35be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8510a519f14deea6f35a437419e161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:16.595172 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d1ccabd0-b4ac-41c8-8ae5-71f94dfb217e tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:30:16.595172 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d1ccabd0-b4ac-41c8-8ae5-71f94dfb217e tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] [instance: 04477d51-f600-483a-aec9-feb992cc6cf7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:16.595453 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a498f5ba-a6d3-4182-93ad-3d973fc2c9c4 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "GET /compute/v2.1/servers/62224107-28c3-40c7-b4d3-13881d1c8d65" status: 200 len: 1469 microversion: 2.1 time: 0.237614 Oct 27 03:30:16.595453 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1268/2476] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:16 2022] GET /compute/v2.1/servers/62224107-28c3-40c7-b4d3-13881d1c8d65 => generated 1469 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:16.595675 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d1ccabd0-b4ac-41c8-8ae5-71f94dfb217e tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:16.595675 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d1ccabd0-b4ac-41c8-8ae5-71f94dfb217e tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:16.595675 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d1ccabd0-b4ac-41c8-8ae5-71f94dfb217e tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:16.595675 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d1ccabd0-b4ac-41c8-8ae5-71f94dfb217e tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:16.595675 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d1ccabd0-b4ac-41c8-8ae5-71f94dfb217e tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:16.595675 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d1ccabd0-b4ac-41c8-8ae5-71f94dfb217e tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:16.596339 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8b785233-f64d-45db-92e7-3da1a87995eb tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:16.596339 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8b785233-f64d-45db-92e7-3da1a87995eb tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: 543fdf60-10ec-4a25-a9d0-30c386efb104] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:16.596494 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=100 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:30:16.596589 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8b785233-f64d-45db-92e7-3da1a87995eb tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:16.596589 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8b785233-f64d-45db-92e7-3da1a87995eb tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:16.596589 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8b785233-f64d-45db-92e7-3da1a87995eb tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:16.596589 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8b785233-f64d-45db-92e7-3da1a87995eb tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:16.596589 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8b785233-f64d-45db-92e7-3da1a87995eb tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:16.596589 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8b785233-f64d-45db-92e7-3da1a87995eb tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:16.596589 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-8b785233-f64d-45db-92e7-3da1a87995eb tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] HTTP exception thrown: Instance 543fdf60-10ec-4a25-a9d0-30c386efb104 could not be found. Oct 27 03:30:16.596589 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8b785233-f64d-45db-92e7-3da1a87995eb tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Request method failure captured: Oct 27 03:30:16.596589 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104 HTTP/1.1 Oct 27 03:30:16.596589 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:30:16.596589 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:30:16.596589 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:30:16.596589 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:30:16.596589 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:30:16.596589 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:30:16.596589 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:30:16.596589 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:30:16.596589 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWflpDYfIGjZv42nta44cUKr4gfgFkHcAeVM8yamczRS9hHsDVo2rsQnCdKSUZqn3ZmcXBvUrwb61kAyQ6DVfG99X5r7udSMUTUj-TX444bEUorFGQKwimw1hyhYRTrQq-ZUKWv2S3u5J0WvKPFUznz1pJqOrfpEn__pIwU22_EAMjAc Oct 27 03:30:16.596589 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:30:16.596589 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:30:16.596589 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:30:16.596589 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:30:16.596589 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:30:16.596589 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:30:16.596589 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: aaee7e66f16e4ed5b49394311bd2803a Oct 27 03:30:16.596589 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-LiveMigrationTest-428698375 Oct 27 03:30:16.596589 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:30:16.596589 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:30:16.596589 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aaee7e66f16e4ed5b49394311bd2803a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/aaee7e66f16e4ed5b49394311bd2803a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aaee7e66f16e4ed5b49394311bd2803a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_aaee7e66f16e4ed5b49394311bd2803a"}]}] Oct 27 03:30:16.596589 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-LiveMigrationTest-428698375 Oct 27 03:30:16.596589 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: aaee7e66f16e4ed5b49394311bd2803a Oct 27 03:30:16.596589 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-LiveMigrationTest-428698375 Oct 27 03:30:16.596589 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-LiveMigrationTest-428698375-project Oct 27 03:30:16.596589 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:30:16.596589 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:30:16.596589 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 8c93886c5818439690564c2299a4f3ee Oct 27 03:30:16.596589 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-LiveMigrationTest-428698375-project Oct 27 03:30:16.596589 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:30:16.596589 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 543fdf60-10ec-4a25-a9d0-30c386efb104 could not be found. Oct 27 03:30:16.601014 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '543fdf60-10ec-4a25-a9d0-30c386efb104'} Oct 27 03:30:16.601014 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:30:16.601014 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:16.601014 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:30:16.601014 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:30:16.601014 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:30:16.601014 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:30:16.601014 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:30:16.601014 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:30:16.601014 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:30:16.601014 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:30:16.601014 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 543fdf60-10ec-4a25-a9d0-30c386efb104 could not be found. Oct 27 03:30:16.601014 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:16.601014 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:30:16.601014 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:16.601014 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:16.601014 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:30:16.601014 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:30:16.601014 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:30:16.601014 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:30:16.601014 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:30:16.601014 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:30:16.601014 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:30:16.601014 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:30:16.601014 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:30:16.601014 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:30:16.601014 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:30:16.601014 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:30:16.601014 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 543fdf60-10ec-4a25-a9d0-30c386efb104 could not be found. Oct 27 03:30:16.601014 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:16.601014 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:30:16.601014 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:16.601014 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:16.601014 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:30:16.601014 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:30:16.601014 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:30:16.601014 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:30:16.601014 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 543fdf60-10ec-4a25-a9d0-30c386efb104 could not be found. Oct 27 03:30:16.601014 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:16.601014 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8b785233-f64d-45db-92e7-3da1a87995eb tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Returning 404 to user: Instance 543fdf60-10ec-4a25-a9d0-30c386efb104 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:30:16.601014 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8b785233-f64d-45db-92e7-3da1a87995eb tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104" status: 404 len: 111 microversion: 2.1 time: 0.076481 Oct 27 03:30:16.601014 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1269/2477] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:16 2022] GET /compute/v2.1/servers/543fdf60-10ec-4a25-a9d0-30c386efb104 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:30:16.601014 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-259a9a84-9ebf-4ad6-af5f-1dcb8dd6adaf tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '.version_select at 0x7f7dd9fe2d30>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:16.653418 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-259a9a84-9ebf-4ad6-af5f-1dcb8dd6adaf tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1102074251" status: 202 len: 0 microversion: 2.1 time: 0.153502 Oct 27 03:30:16.654141 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1270/2478] 10.222.0.20 () {58 vars in 1221 bytes} [Thu Oct 27 03:30:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1102074251 => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:30:16.809904 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d1ccabd0-b4ac-41c8-8ae5-71f94dfb217e tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] 10.222.0.20 "POST /compute/v2.1/servers/04477d51-f600-483a-aec9-feb992cc6cf7/action" status: 202 len: 0 microversion: 2.1 time: 0.423875 Oct 27 03:30:16.810615 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1209/2479] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:30:16 2022] POST /compute/v2.1/servers/04477d51-f600-483a-aec9-feb992cc6cf7/action => generated 0 bytes in 425 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:30:16.819291 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b59e6e4d-94b4-44e2-bd18-dcbb2df22b04 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:16.819917 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b59e6e4d-94b4-44e2-bd18-dcbb2df22b04 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] [instance: 04477d51-f600-483a-aec9-feb992cc6cf7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:16.826709 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b59e6e4d-94b4-44e2-bd18-dcbb2df22b04 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:16.829835 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b59e6e4d-94b4-44e2-bd18-dcbb2df22b04 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:16.829835 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b59e6e4d-94b4-44e2-bd18-dcbb2df22b04 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:16.829835 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b59e6e4d-94b4-44e2-bd18-dcbb2df22b04 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:16.829835 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b59e6e4d-94b4-44e2-bd18-dcbb2df22b04 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:16.829835 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b59e6e4d-94b4-44e2-bd18-dcbb2df22b04 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:16.850156 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:30:16.997607 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b59e6e4d-94b4-44e2-bd18-dcbb2df22b04 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421d14944da74570a53d620ea205449d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92082c8718aa41bf96cd84d682d75954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:17.008603 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b59e6e4d-94b4-44e2-bd18-dcbb2df22b04 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] 10.222.0.20 "GET /compute/v2.1/servers/04477d51-f600-483a-aec9-feb992cc6cf7" status: 200 len: 1575 microversion: 2.1 time: 0.193538 Oct 27 03:30:17.009366 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1271/2480] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:16 2022] GET /compute/v2.1/servers/04477d51-f600-483a-aec9-feb992cc6cf7 => generated 1575 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:17.204764 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4d82e5e6-5c75-4704-a949-b47c30b581a1 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:17.207137 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4d82e5e6-5c75-4704-a949-b47c30b581a1 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: d5e6f604-9466-45c6-86a8-885cfb393223] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:17.227344 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4d82e5e6-5c75-4704-a949-b47c30b581a1 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:17.228278 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4d82e5e6-5c75-4704-a949-b47c30b581a1 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:17.228836 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4d82e5e6-5c75-4704-a949-b47c30b581a1 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:17.230567 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4d82e5e6-5c75-4704-a949-b47c30b581a1 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:17.231162 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4d82e5e6-5c75-4704-a949-b47c30b581a1 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:17.231709 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4d82e5e6-5c75-4704-a949-b47c30b581a1 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:17.406789 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-45ff2ecc-0f25-4995-a8b6-791b0515bbbb tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:17.408775 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-45ff2ecc-0f25-4995-a8b6-791b0515bbbb tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] [instance: ba3e02bc-d621-49e5-8e81-0d33828d816f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:17.425902 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-45ff2ecc-0f25-4995-a8b6-791b0515bbbb tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:17.426744 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-45ff2ecc-0f25-4995-a8b6-791b0515bbbb tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:17.427750 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-45ff2ecc-0f25-4995-a8b6-791b0515bbbb tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:17.430685 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-45ff2ecc-0f25-4995-a8b6-791b0515bbbb tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:17.431438 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-45ff2ecc-0f25-4995-a8b6-791b0515bbbb tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:17.436322 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-45ff2ecc-0f25-4995-a8b6-791b0515bbbb tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:17.473158 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4d82e5e6-5c75-4704-a949-b47c30b581a1 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:17.483146 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4d82e5e6-5c75-4704-a949-b47c30b581a1 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:17.484944 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4d82e5e6-5c75-4704-a949-b47c30b581a1 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:17.486409 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4d82e5e6-5c75-4704-a949-b47c30b581a1 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223" status: 200 len: 1487 microversion: 2.25 time: 0.293681 Oct 27 03:30:17.489623 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1210/2481] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:30:17 2022] GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223 => generated 1487 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:30:17.494777 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-fca6c534-ea97-4440-b389-d3cc82f39e51 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:17.495627 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-fca6c534-ea97-4440-b389-d3cc82f39e51 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: 62224107-28c3-40c7-b4d3-13881d1c8d65] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:17.504220 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fca6c534-ea97-4440-b389-d3cc82f39e51 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:17.504220 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fca6c534-ea97-4440-b389-d3cc82f39e51 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:17.504984 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fca6c534-ea97-4440-b389-d3cc82f39e51 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:17.506529 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fca6c534-ea97-4440-b389-d3cc82f39e51 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:17.507344 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fca6c534-ea97-4440-b389-d3cc82f39e51 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:17.508165 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fca6c534-ea97-4440-b389-d3cc82f39e51 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:17.907810 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-45ff2ecc-0f25-4995-a8b6-791b0515bbbb tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e64f7f0501454fa8474aa61c9a8c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561891c49901486c9d7651688f88b0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:17.920394 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-45ff2ecc-0f25-4995-a8b6-791b0515bbbb tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] 10.222.0.20 "GET /compute/v2.1/servers/ba3e02bc-d621-49e5-8e81-0d33828d816f" status: 200 len: 1323 microversion: 2.1 time: 0.517351 Oct 27 03:30:17.939515 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1272/2482] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:17 2022] GET /compute/v2.1/servers/ba3e02bc-d621-49e5-8e81-0d33828d816f => generated 1323 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:17.967614 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-baf4e406-e1f2-44ab-abcb-36a5bf3c7648 req-9b5e595b-31ac-44f8-bf2a-57fece13eee0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04477d51-f600-483a-aec9-feb992cc6cf7", "tag": "5bbab630-1088-4a87-96b5-3098b0dbf41f"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:30:18.006956 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-baf4e406-e1f2-44ab-abcb-36a5bf3c7648 req-9b5e595b-31ac-44f8-bf2a-57fece13eee0 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:18.009748 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-baf4e406-e1f2-44ab-abcb-36a5bf3c7648 req-9b5e595b-31ac-44f8-bf2a-57fece13eee0 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:18.015542 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-baf4e406-e1f2-44ab-abcb-36a5bf3c7648 req-9b5e595b-31ac-44f8-bf2a-57fece13eee0 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:18.041901 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-baf4e406-e1f2-44ab-abcb-36a5bf3c7648 req-9b5e595b-31ac-44f8-bf2a-57fece13eee0 service nova] Creating event network-changed:5bbab630-1088-4a87-96b5-3098b0dbf41f for instance 04477d51-f600-483a-aec9-feb992cc6cf7 on n-h1-862769-1 Oct 27 03:30:18.059426 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-baf4e406-e1f2-44ab-abcb-36a5bf3c7648 req-9b5e595b-31ac-44f8-bf2a-57fece13eee0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115269 Oct 27 03:30:18.060720 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1273/2483] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:30:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:30:18.074202 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f5f91048-6c84-4c56-87c9-d25709925078 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:18.074937 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f5f91048-6c84-4c56-87c9-d25709925078 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] [instance: 04477d51-f600-483a-aec9-feb992cc6cf7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:18.090424 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f5f91048-6c84-4c56-87c9-d25709925078 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:18.091178 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f5f91048-6c84-4c56-87c9-d25709925078 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:18.091840 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f5f91048-6c84-4c56-87c9-d25709925078 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:18.092723 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f5f91048-6c84-4c56-87c9-d25709925078 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:18.093489 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f5f91048-6c84-4c56-87c9-d25709925078 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:18.094098 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f5f91048-6c84-4c56-87c9-d25709925078 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:18.157551 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-fca6c534-ea97-4440-b389-d3cc82f39e51 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13e05e253c94aadb1c089128ff35be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8510a519f14deea6f35a437419e161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:18.172792 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-fca6c534-ea97-4440-b389-d3cc82f39e51 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "GET /compute/v2.1/servers/62224107-28c3-40c7-b4d3-13881d1c8d65" status: 200 len: 1469 microversion: 2.1 time: 0.681742 Oct 27 03:30:18.181227 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1211/2484] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:17 2022] GET /compute/v2.1/servers/62224107-28c3-40c7-b4d3-13881d1c8d65 => generated 1469 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:18.521844 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c1c7f608-115a-4ced-9977-748d22421e1e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:18.522532 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c1c7f608-115a-4ced-9977-748d22421e1e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: d5e6f604-9466-45c6-86a8-885cfb393223] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:18.538624 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c1c7f608-115a-4ced-9977-748d22421e1e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:18.539744 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c1c7f608-115a-4ced-9977-748d22421e1e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:18.563935 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c1c7f608-115a-4ced-9977-748d22421e1e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:18.567438 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c1c7f608-115a-4ced-9977-748d22421e1e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:18.567438 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c1c7f608-115a-4ced-9977-748d22421e1e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:18.568929 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c1c7f608-115a-4ced-9977-748d22421e1e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:18.893465 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f5f91048-6c84-4c56-87c9-d25709925078 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421d14944da74570a53d620ea205449d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92082c8718aa41bf96cd84d682d75954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:18.901429 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f5f91048-6c84-4c56-87c9-d25709925078 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] 10.222.0.20 "GET /compute/v2.1/servers/04477d51-f600-483a-aec9-feb992cc6cf7" status: 200 len: 1575 microversion: 2.1 time: 0.839286 Oct 27 03:30:18.904440 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1274/2485] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:18 2022] GET /compute/v2.1/servers/04477d51-f600-483a-aec9-feb992cc6cf7 => generated 1575 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:18.920354 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3654a011-d177-41bd-be10-db46114143e5 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:18.920354 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3654a011-d177-41bd-be10-db46114143e5 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: a52fed88-50f8-4dea-b83d-6878adccb024] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:18.934103 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3654a011-d177-41bd-be10-db46114143e5 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:18.934732 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3654a011-d177-41bd-be10-db46114143e5 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:18.935291 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3654a011-d177-41bd-be10-db46114143e5 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:18.936104 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3654a011-d177-41bd-be10-db46114143e5 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:18.939002 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3654a011-d177-41bd-be10-db46114143e5 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:18.943092 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3654a011-d177-41bd-be10-db46114143e5 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:19.006008 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3654a011-d177-41bd-be10-db46114143e5 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: a52fed88-50f8-4dea-b83d-6878adccb024] Going to try to terminate instance {{(pid=121001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:30:19.144616 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c1c7f608-115a-4ced-9977-748d22421e1e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:19.166303 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c1c7f608-115a-4ced-9977-748d22421e1e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:19.168222 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c1c7f608-115a-4ced-9977-748d22421e1e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:19.169648 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c1c7f608-115a-4ced-9977-748d22421e1e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223" status: 200 len: 1487 microversion: 2.25 time: 0.653538 Oct 27 03:30:19.170760 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1212/2486] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:30:18 2022] GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223 => generated 1487 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:30:19.176022 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e886c4ce-e7cd-4740-abf2-48f51f367469 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:19.176797 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e886c4ce-e7cd-4740-abf2-48f51f367469 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] [instance: ba3e02bc-d621-49e5-8e81-0d33828d816f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:19.192317 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e886c4ce-e7cd-4740-abf2-48f51f367469 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:19.193685 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e886c4ce-e7cd-4740-abf2-48f51f367469 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:19.194360 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e886c4ce-e7cd-4740-abf2-48f51f367469 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:19.195272 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e886c4ce-e7cd-4740-abf2-48f51f367469 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:19.195905 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e886c4ce-e7cd-4740-abf2-48f51f367469 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:19.198593 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e886c4ce-e7cd-4740-abf2-48f51f367469 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:19.506625 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3654a011-d177-41bd-be10-db46114143e5 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a52fed88-50f8-4dea-b83d-6878adccb024" status: 204 len: 0 microversion: 2.1 time: 0.599443 Oct 27 03:30:19.508355 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1275/2487] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:30:18 2022] DELETE /compute/v2.1/servers/a52fed88-50f8-4dea-b83d-6878adccb024 => generated 0 bytes in 603 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:30:19.518215 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-19f235fe-6779-4a70-9011-51f7b7e7388a tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:19.525894 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-19f235fe-6779-4a70-9011-51f7b7e7388a tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: 62224107-28c3-40c7-b4d3-13881d1c8d65] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:19.536709 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-19f235fe-6779-4a70-9011-51f7b7e7388a tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:19.537440 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-19f235fe-6779-4a70-9011-51f7b7e7388a tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:19.543064 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-19f235fe-6779-4a70-9011-51f7b7e7388a tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:19.544796 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-19f235fe-6779-4a70-9011-51f7b7e7388a tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:19.546976 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-19f235fe-6779-4a70-9011-51f7b7e7388a tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:19.547702 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-19f235fe-6779-4a70-9011-51f7b7e7388a tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:19.582312 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e886c4ce-e7cd-4740-abf2-48f51f367469 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e64f7f0501454fa8474aa61c9a8c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561891c49901486c9d7651688f88b0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:19.590857 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e886c4ce-e7cd-4740-abf2-48f51f367469 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] 10.222.0.20 "GET /compute/v2.1/servers/ba3e02bc-d621-49e5-8e81-0d33828d816f" status: 200 len: 1323 microversion: 2.1 time: 0.418798 Oct 27 03:30:19.591464 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1213/2488] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:19 2022] GET /compute/v2.1/servers/ba3e02bc-d621-49e5-8e81-0d33828d816f => generated 1323 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:19.600138 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5ade8f73-1b4f-46ca-9e08-be40ebb1aa74 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:19.608643 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5ade8f73-1b4f-46ca-9e08-be40ebb1aa74 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: a52fed88-50f8-4dea-b83d-6878adccb024] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:19.622674 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5ade8f73-1b4f-46ca-9e08-be40ebb1aa74 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:19.623190 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5ade8f73-1b4f-46ca-9e08-be40ebb1aa74 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:19.623635 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5ade8f73-1b4f-46ca-9e08-be40ebb1aa74 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:19.624380 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5ade8f73-1b4f-46ca-9e08-be40ebb1aa74 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:19.624863 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5ade8f73-1b4f-46ca-9e08-be40ebb1aa74 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:19.625293 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5ade8f73-1b4f-46ca-9e08-be40ebb1aa74 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:19.705504 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-19f235fe-6779-4a70-9011-51f7b7e7388a tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13e05e253c94aadb1c089128ff35be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8510a519f14deea6f35a437419e161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:19.717927 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-19f235fe-6779-4a70-9011-51f7b7e7388a tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "GET /compute/v2.1/servers/62224107-28c3-40c7-b4d3-13881d1c8d65" status: 200 len: 1427 microversion: 2.1 time: 0.204568 Oct 27 03:30:19.727488 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1276/2489] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:19 2022] GET /compute/v2.1/servers/62224107-28c3-40c7-b4d3-13881d1c8d65 => generated 1427 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:19.738586 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-182e759f-a45e-4f18-b110-95656e9b6528 req-a1f25c3c-d9b9-4a33-8ab3-4962b958591c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62224107-28c3-40c7-b4d3-13881d1c8d65", "name": "network-vif-deleted", "tag": "e0db0ab6-e281-48a5-9ee5-abbdbaf11989"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:30:19.752287 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-182e759f-a45e-4f18-b110-95656e9b6528 req-a1f25c3c-d9b9-4a33-8ab3-4962b958591c service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:19.752287 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-182e759f-a45e-4f18-b110-95656e9b6528 req-a1f25c3c-d9b9-4a33-8ab3-4962b958591c service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:19.752287 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-182e759f-a45e-4f18-b110-95656e9b6528 req-a1f25c3c-d9b9-4a33-8ab3-4962b958591c service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:19.765738 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-182e759f-a45e-4f18-b110-95656e9b6528 req-a1f25c3c-d9b9-4a33-8ab3-4962b958591c service nova] Creating event network-vif-deleted:e0db0ab6-e281-48a5-9ee5-abbdbaf11989 for instance 62224107-28c3-40c7-b4d3-13881d1c8d65 on n-h2-862769-1 Oct 27 03:30:19.775003 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-182e759f-a45e-4f18-b110-95656e9b6528 req-a1f25c3c-d9b9-4a33-8ab3-4962b958591c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044372 Oct 27 03:30:19.776311 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1277/2490] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:30:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:30:19.787924 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b4e8f948-555e-450f-a763-325beea7509f tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-773390588", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "ee7576d4-5073-447b-9a38-5501bc5728dc"}], "security_groups": [{"name": "tempest-securitygroup--2058805567"}], "key_name": "tempest-keypair-1781272530", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "92d559f2-351e-4819-b4d9-601e78ff174e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:30:19.936481 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.network.neutron [None req-b4e8f948-555e-450f-a763-325beea7509f tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] validate_networks() for [('ee7576d4-5073-447b-9a38-5501bc5728dc', None, None, None, None, None)] {{(pid=121001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:30:19.949778 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5ade8f73-1b4f-46ca-9e08-be40ebb1aa74 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:19.963629 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5ade8f73-1b4f-46ca-9e08-be40ebb1aa74 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/a52fed88-50f8-4dea-b83d-6878adccb024" status: 200 len: 1486 microversion: 2.1 time: 0.367824 Oct 27 03:30:19.965935 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1214/2491] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:19 2022] GET /compute/v2.1/servers/a52fed88-50f8-4dea-b83d-6878adccb024 => generated 1486 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:19.973125 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c44fae5d-c082-4844-844c-c29249f043f1 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:19.973762 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c44fae5d-c082-4844-844c-c29249f043f1 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] [instance: 04477d51-f600-483a-aec9-feb992cc6cf7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:19.990848 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c44fae5d-c082-4844-844c-c29249f043f1 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:19.993315 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c44fae5d-c082-4844-844c-c29249f043f1 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:19.995542 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c44fae5d-c082-4844-844c-c29249f043f1 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:19.999627 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c44fae5d-c082-4844-844c-c29249f043f1 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:20.000301 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c44fae5d-c082-4844-844c-c29249f043f1 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:20.000921 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c44fae5d-c082-4844-844c-c29249f043f1 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:20.330186 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c44fae5d-c082-4844-844c-c29249f043f1 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421d14944da74570a53d620ea205449d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92082c8718aa41bf96cd84d682d75954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:20.339471 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c44fae5d-c082-4844-844c-c29249f043f1 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] 10.222.0.20 "GET /compute/v2.1/servers/04477d51-f600-483a-aec9-feb992cc6cf7" status: 200 len: 1580 microversion: 2.1 time: 0.370032 Oct 27 03:30:20.352586 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1215/2492] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:19 2022] GET /compute/v2.1/servers/04477d51-f600-483a-aec9-feb992cc6cf7 => generated 1580 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:20.381326 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-aea1e5af-feea-414b-beac-35d7558f5570 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:20.383984 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-aea1e5af-feea-414b-beac-35d7558f5570 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: d5e6f604-9466-45c6-86a8-885cfb393223] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:20.392116 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aea1e5af-feea-414b-beac-35d7558f5570 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:20.392637 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aea1e5af-feea-414b-beac-35d7558f5570 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:20.393170 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aea1e5af-feea-414b-beac-35d7558f5570 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:20.393957 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aea1e5af-feea-414b-beac-35d7558f5570 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:20.394492 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aea1e5af-feea-414b-beac-35d7558f5570 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:20.394932 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aea1e5af-feea-414b-beac-35d7558f5570 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:20.757965 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-aea1e5af-feea-414b-beac-35d7558f5570 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:20.766824 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-aea1e5af-feea-414b-beac-35d7558f5570 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:20.768922 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-aea1e5af-feea-414b-beac-35d7558f5570 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:20.770456 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-aea1e5af-feea-414b-beac-35d7558f5570 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223" status: 200 len: 1487 microversion: 2.25 time: 0.414754 Oct 27 03:30:20.786560 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1216/2493] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:30:20 2022] GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223 => generated 1487 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:30:20.802883 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-faeb78d1-440b-4cc0-b507-3cf2c325f383 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:20.803882 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-faeb78d1-440b-4cc0-b507-3cf2c325f383 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] [instance: ba3e02bc-d621-49e5-8e81-0d33828d816f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:20.811073 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-faeb78d1-440b-4cc0-b507-3cf2c325f383 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:20.811826 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-faeb78d1-440b-4cc0-b507-3cf2c325f383 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:20.812489 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-faeb78d1-440b-4cc0-b507-3cf2c325f383 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:20.813518 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-faeb78d1-440b-4cc0-b507-3cf2c325f383 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:20.814231 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-faeb78d1-440b-4cc0-b507-3cf2c325f383 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:20.814890 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-faeb78d1-440b-4cc0-b507-3cf2c325f383 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:20.839836 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-b4e8f948-555e-450f-a763-325beea7509f tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Getting quotas for project 5514904d799d4f5dae454193e70d85f6. Resources: dict_keys(['metadata_items']) {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:30:20.848235 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-b4e8f948-555e-450f-a763-325beea7509f tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Getting quotas for user 9ce351a48282492e8cd69b9a5a05f545 and project 5514904d799d4f5dae454193e70d85f6. Resources: dict_keys(['metadata_items']) {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:30:20.878600 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-b4e8f948-555e-450f-a763-325beea7509f tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Flavor limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:30:20.879501 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-b4e8f948-555e-450f-a763-325beea7509f tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Image limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:30:20.880172 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-b4e8f948-555e-450f-a763-325beea7509f tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Flavor pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:30:20.880758 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-b4e8f948-555e-450f-a763-325beea7509f tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Image pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:30:20.881757 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-b4e8f948-555e-450f-a763-325beea7509f tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:30:20.887053 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:30:20.893128 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b4e8f948-555e-450f-a763-325beea7509f tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:20.893913 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b4e8f948-555e-450f-a763-325beea7509f tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:20.894411 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b4e8f948-555e-450f-a763-325beea7509f tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:20.895154 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b4e8f948-555e-450f-a763-325beea7509f tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:20.896279 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b4e8f948-555e-450f-a763-325beea7509f tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:20.896726 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b4e8f948-555e-450f-a763-325beea7509f tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:20.926547 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-b4e8f948-555e-450f-a763-325beea7509f tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Getting quotas for project 5514904d799d4f5dae454193e70d85f6. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:30:20.932911 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-b4e8f948-555e-450f-a763-325beea7509f tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Getting quotas for user 9ce351a48282492e8cd69b9a5a05f545 and project 5514904d799d4f5dae454193e70d85f6. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:30:21.009249 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b4e8f948-555e-450f-a763-325beea7509f tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Going to run 1 instances... {{(pid=121001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:30:21.012747 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b4e8f948-555e-450f-a763-325beea7509f tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] [instance: 2023265c-1a97-4ed8-8af7-f83077e4bfa5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='92d559f2-351e-4819-b4d9-601e78ff174e',volume_size=None,volume_type=None)] {{(pid=121001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:30:21.117320 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-faeb78d1-440b-4cc0-b507-3cf2c325f383 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e64f7f0501454fa8474aa61c9a8c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561891c49901486c9d7651688f88b0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:21.125686 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-faeb78d1-440b-4cc0-b507-3cf2c325f383 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] 10.222.0.20 "GET /compute/v2.1/servers/ba3e02bc-d621-49e5-8e81-0d33828d816f" status: 200 len: 1323 microversion: 2.1 time: 0.337654 Oct 27 03:30:21.126309 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1217/2494] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:20 2022] GET /compute/v2.1/servers/ba3e02bc-d621-49e5-8e81-0d33828d816f => generated 1323 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:21.131847 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-079aa7cd-1dc6-47e6-adac-90bbb5e1347c tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:21.132571 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-079aa7cd-1dc6-47e6-adac-90bbb5e1347c tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: 62224107-28c3-40c7-b4d3-13881d1c8d65] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:21.145181 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-079aa7cd-1dc6-47e6-adac-90bbb5e1347c tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:21.145181 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-079aa7cd-1dc6-47e6-adac-90bbb5e1347c tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:21.145181 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-079aa7cd-1dc6-47e6-adac-90bbb5e1347c tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:21.145181 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-079aa7cd-1dc6-47e6-adac-90bbb5e1347c tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:21.145181 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-079aa7cd-1dc6-47e6-adac-90bbb5e1347c tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:21.145181 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-079aa7cd-1dc6-47e6-adac-90bbb5e1347c tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:21.183451 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-079aa7cd-1dc6-47e6-adac-90bbb5e1347c tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:21.183947 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-079aa7cd-1dc6-47e6-adac-90bbb5e1347c tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:21.184387 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-079aa7cd-1dc6-47e6-adac-90bbb5e1347c tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:21.184847 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-079aa7cd-1dc6-47e6-adac-90bbb5e1347c tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lazy-loading 'fault' on Instance uuid 62224107-28c3-40c7-b4d3-13881d1c8d65 {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:30:21.240179 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-079aa7cd-1dc6-47e6-adac-90bbb5e1347c tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13e05e253c94aadb1c089128ff35be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8510a519f14deea6f35a437419e161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:21.252074 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-079aa7cd-1dc6-47e6-adac-90bbb5e1347c tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "GET /compute/v2.1/servers/62224107-28c3-40c7-b4d3-13881d1c8d65" status: 200 len: 1303 microversion: 2.1 time: 0.124344 Oct 27 03:30:21.266237 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1218/2495] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:21 2022] GET /compute/v2.1/servers/62224107-28c3-40c7-b4d3-13881d1c8d65 => generated 1303 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:21.266237 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-5d8a1002-a670-46b9-aef9-5308fde236d1 req-66e4f7c3-92ba-4a6c-8667-b0b6f3ba7a34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba3e02bc-d621-49e5-8e81-0d33828d816f", "name": "network-vif-plugged", "status": "completed", "tag": "c4245fca-d73e-4082-8c2c-d2a10511c5ee"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:30:21.277754 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-5d8a1002-a670-46b9-aef9-5308fde236d1 req-66e4f7c3-92ba-4a6c-8667-b0b6f3ba7a34 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:21.279797 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-5d8a1002-a670-46b9-aef9-5308fde236d1 req-66e4f7c3-92ba-4a6c-8667-b0b6f3ba7a34 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:21.279797 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-5d8a1002-a670-46b9-aef9-5308fde236d1 req-66e4f7c3-92ba-4a6c-8667-b0b6f3ba7a34 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:21.291612 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-5d8a1002-a670-46b9-aef9-5308fde236d1 req-66e4f7c3-92ba-4a6c-8667-b0b6f3ba7a34 service nova] Creating event network-vif-plugged:c4245fca-d73e-4082-8c2c-d2a10511c5ee for instance ba3e02bc-d621-49e5-8e81-0d33828d816f on n-h2-862769-1 Oct 27 03:30:21.296395 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-5d8a1002-a670-46b9-aef9-5308fde236d1 req-66e4f7c3-92ba-4a6c-8667-b0b6f3ba7a34 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036625 Oct 27 03:30:21.297003 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1219/2496] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:30:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:30:21.303138 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-79bd9c87-8e87-47f7-b9eb-fc3468171496 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:21.303435 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-79bd9c87-8e87-47f7-b9eb-fc3468171496 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: a52fed88-50f8-4dea-b83d-6878adccb024] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:21.309651 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-79bd9c87-8e87-47f7-b9eb-fc3468171496 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:21.310403 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-79bd9c87-8e87-47f7-b9eb-fc3468171496 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:21.310848 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-79bd9c87-8e87-47f7-b9eb-fc3468171496 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:21.311575 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-79bd9c87-8e87-47f7-b9eb-fc3468171496 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:21.312023 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-79bd9c87-8e87-47f7-b9eb-fc3468171496 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:21.312449 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-79bd9c87-8e87-47f7-b9eb-fc3468171496 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:21.446263 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-79bd9c87-8e87-47f7-b9eb-fc3468171496 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:21.456960 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-79bd9c87-8e87-47f7-b9eb-fc3468171496 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/a52fed88-50f8-4dea-b83d-6878adccb024" status: 200 len: 1444 microversion: 2.1 time: 0.158109 Oct 27 03:30:21.458208 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1220/2497] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:21 2022] GET /compute/v2.1/servers/a52fed88-50f8-4dea-b83d-6878adccb024 => generated 1444 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:21.471141 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a1864dc4-c614-489d-be03-e57779d91f56 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:21.472191 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a1864dc4-c614-489d-be03-e57779d91f56 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] [instance: 04477d51-f600-483a-aec9-feb992cc6cf7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:21.485422 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a1864dc4-c614-489d-be03-e57779d91f56 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:21.486068 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a1864dc4-c614-489d-be03-e57779d91f56 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:21.486606 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a1864dc4-c614-489d-be03-e57779d91f56 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:21.487592 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a1864dc4-c614-489d-be03-e57779d91f56 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:21.488150 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a1864dc4-c614-489d-be03-e57779d91f56 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:21.488690 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a1864dc4-c614-489d-be03-e57779d91f56 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:21.642761 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a1864dc4-c614-489d-be03-e57779d91f56 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421d14944da74570a53d620ea205449d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92082c8718aa41bf96cd84d682d75954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:21.652008 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a1864dc4-c614-489d-be03-e57779d91f56 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] 10.222.0.20 "GET /compute/v2.1/servers/04477d51-f600-483a-aec9-feb992cc6cf7" status: 200 len: 1573 microversion: 2.1 time: 0.192499 Oct 27 03:30:21.652670 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1221/2498] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:21 2022] GET /compute/v2.1/servers/04477d51-f600-483a-aec9-feb992cc6cf7 => generated 1573 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:21.665119 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-7a9d4a03-58af-455f-90ed-40c937ea13b6 req-31b0761e-1316-49e2-b5aa-73b77ca7f382 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a52fed88-50f8-4dea-b83d-6878adccb024", "name": "network-vif-deleted", "tag": "7caf6b22-42ec-4a60-b619-9a8f7eecc633"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:30:21.675998 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-7a9d4a03-58af-455f-90ed-40c937ea13b6 req-31b0761e-1316-49e2-b5aa-73b77ca7f382 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:21.676752 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-7a9d4a03-58af-455f-90ed-40c937ea13b6 req-31b0761e-1316-49e2-b5aa-73b77ca7f382 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:21.677194 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-7a9d4a03-58af-455f-90ed-40c937ea13b6 req-31b0761e-1316-49e2-b5aa-73b77ca7f382 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:21.687351 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b4e8f948-555e-450f-a763-325beea7509f tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.908452 Oct 27 03:30:21.688011 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1278/2499] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:30:19 2022] POST /compute/v2.1/servers => generated 407 bytes in 1911 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 03:30:21.694904 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2358f6ff-22fb-4714-b548-6aaf851e36c7 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-319375254"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:30:21.695847 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2358f6ff-22fb-4714-b548-6aaf851e36c7 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] [instance: 04477d51-f600-483a-aec9-feb992cc6cf7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:21.698566 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-7a9d4a03-58af-455f-90ed-40c937ea13b6 req-31b0761e-1316-49e2-b5aa-73b77ca7f382 service nova] Creating event network-vif-deleted:7caf6b22-42ec-4a60-b619-9a8f7eecc633 for instance a52fed88-50f8-4dea-b83d-6878adccb024 on n-h1-862769-1 Oct 27 03:30:21.703959 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2358f6ff-22fb-4714-b548-6aaf851e36c7 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:21.704671 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2358f6ff-22fb-4714-b548-6aaf851e36c7 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:21.705432 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2358f6ff-22fb-4714-b548-6aaf851e36c7 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:21.706938 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2358f6ff-22fb-4714-b548-6aaf851e36c7 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:21.707720 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2358f6ff-22fb-4714-b548-6aaf851e36c7 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:21.708432 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2358f6ff-22fb-4714-b548-6aaf851e36c7 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:21.714476 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-7a9d4a03-58af-455f-90ed-40c937ea13b6 req-31b0761e-1316-49e2-b5aa-73b77ca7f382 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043819 Oct 27 03:30:21.715650 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1222/2500] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:30:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:30:21.725329 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6f9ff755-7831-4dd2-bacd-cda10091ba0e tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:21.734480 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6f9ff755-7831-4dd2-bacd-cda10091ba0e tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] [instance: 2023265c-1a97-4ed8-8af7-f83077e4bfa5] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:21.878987 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-6f9ff755-7831-4dd2-bacd-cda10091ba0e tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce351a48282492e8cd69b9a5a05f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5514904d799d4f5dae454193e70d85f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:21.890294 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6f9ff755-7831-4dd2-bacd-cda10091ba0e tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] 10.222.0.20 "GET /compute/v2.1/servers/2023265c-1a97-4ed8-8af7-f83077e4bfa5" status: 200 len: 1121 microversion: 2.1 time: 0.172894 Oct 27 03:30:21.905664 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1223/2501] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:21 2022] GET /compute/v2.1/servers/2023265c-1a97-4ed8-8af7-f83077e4bfa5 => generated 1121 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:21.913012 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3c01cb3d-cb67-4499-8220-630fd69184f3 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:21.913012 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-3c01cb3d-cb67-4499-8220-630fd69184f3 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: d5e6f604-9466-45c6-86a8-885cfb393223] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:21.915958 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.network.security_group_api [None req-2358f6ff-22fb-4714-b548-6aaf851e36c7 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Adding security group 362204bb-f331-489e-bb41-766f010c5078 to port 5bbab630-1088-4a87-96b5-3098b0dbf41f Oct 27 03:30:21.918309 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3c01cb3d-cb67-4499-8220-630fd69184f3 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:21.918814 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3c01cb3d-cb67-4499-8220-630fd69184f3 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:21.919265 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3c01cb3d-cb67-4499-8220-630fd69184f3 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:21.920218 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3c01cb3d-cb67-4499-8220-630fd69184f3 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:21.920693 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3c01cb3d-cb67-4499-8220-630fd69184f3 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:21.921810 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3c01cb3d-cb67-4499-8220-630fd69184f3 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:22.081412 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-3c01cb3d-cb67-4499-8220-630fd69184f3 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:22.092395 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-3c01cb3d-cb67-4499-8220-630fd69184f3 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:22.094090 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-3c01cb3d-cb67-4499-8220-630fd69184f3 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:22.097092 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3c01cb3d-cb67-4499-8220-630fd69184f3 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223" status: 200 len: 1487 microversion: 2.25 time: 0.189571 Oct 27 03:30:22.098238 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1224/2502] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:30:21 2022] GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223 => generated 1487 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:30:22.151744 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-cb1146c5-48d9-48f9-83d9-9322a2f238e7 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:22.152577 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-cb1146c5-48d9-48f9-83d9-9322a2f238e7 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] [instance: ba3e02bc-d621-49e5-8e81-0d33828d816f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:22.159566 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cb1146c5-48d9-48f9-83d9-9322a2f238e7 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:22.160653 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cb1146c5-48d9-48f9-83d9-9322a2f238e7 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:22.160653 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cb1146c5-48d9-48f9-83d9-9322a2f238e7 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:22.161197 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cb1146c5-48d9-48f9-83d9-9322a2f238e7 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:22.161673 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cb1146c5-48d9-48f9-83d9-9322a2f238e7 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:22.162890 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cb1146c5-48d9-48f9-83d9-9322a2f238e7 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:22.336323 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-cb1146c5-48d9-48f9-83d9-9322a2f238e7 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e64f7f0501454fa8474aa61c9a8c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561891c49901486c9d7651688f88b0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:22.345266 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-cb1146c5-48d9-48f9-83d9-9322a2f238e7 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] 10.222.0.20 "GET /compute/v2.1/servers/ba3e02bc-d621-49e5-8e81-0d33828d816f" status: 200 len: 1323 microversion: 2.1 time: 0.197324 Oct 27 03:30:22.346021 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1225/2503] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:22 2022] GET /compute/v2.1/servers/ba3e02bc-d621-49e5-8e81-0d33828d816f => generated 1323 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:30:22.362043 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-79edce73-ceb7-4629-80a0-ee4a62b89f54 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:22.363303 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-79edce73-ceb7-4629-80a0-ee4a62b89f54 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: 62224107-28c3-40c7-b4d3-13881d1c8d65] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:22.369446 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-79edce73-ceb7-4629-80a0-ee4a62b89f54 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:22.370024 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-79edce73-ceb7-4629-80a0-ee4a62b89f54 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:22.370763 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-79edce73-ceb7-4629-80a0-ee4a62b89f54 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:22.371718 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-79edce73-ceb7-4629-80a0-ee4a62b89f54 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:22.372375 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-79edce73-ceb7-4629-80a0-ee4a62b89f54 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:22.372866 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-79edce73-ceb7-4629-80a0-ee4a62b89f54 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:22.387080 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-79edce73-ceb7-4629-80a0-ee4a62b89f54 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] HTTP exception thrown: Instance 62224107-28c3-40c7-b4d3-13881d1c8d65 could not be found. Oct 27 03:30:22.388773 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-79edce73-ceb7-4629-80a0-ee4a62b89f54 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Request method failure captured: Oct 27 03:30:22.388773 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/62224107-28c3-40c7-b4d3-13881d1c8d65 HTTP/1.1 Oct 27 03:30:22.388773 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:30:22.388773 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:30:22.388773 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:30:22.388773 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:30:22.388773 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:30:22.388773 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:30:22.388773 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:30:22.388773 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:30:22.388773 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfqe_f6klSBWxgHJhrkMKU1jjTutLzdS5yP5cVaJx7CD4SpsaA9eFzNBelj8Df37AqQIauKmTdjEzxZfV-SkZsp-fdTJEBQmTQbH47veq0MyVE5xHm_0xRuqrKEixJ6MNqSyPaMFYb1G1FwqsXy7fj3afl8K-QHetdJvpDiWZ49aVxw Oct 27 03:30:22.388773 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:30:22.388773 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:30:22.388773 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:30:22.388773 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:30:22.388773 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:30:22.388773 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:30:22.388773 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 2c8510a519f14deea6f35a437419e161 Oct 27 03:30:22.388773 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ServersAdminTestJSON-1349869830 Oct 27 03:30:22.388773 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:30:22.388773 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:30:22.388773 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c8510a519f14deea6f35a437419e161"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2c8510a519f14deea6f35a437419e161"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c8510a519f14deea6f35a437419e161"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2c8510a519f14deea6f35a437419e161"}]}] Oct 27 03:30:22.388773 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ServersAdminTestJSON-1349869830 Oct 27 03:30:22.388773 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 2c8510a519f14deea6f35a437419e161 Oct 27 03:30:22.388773 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ServersAdminTestJSON-1349869830 Oct 27 03:30:22.388773 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ServersAdminTestJSON-1349869830-project Oct 27 03:30:22.388773 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:30:22.388773 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:30:22.388773 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: c13e05e253c94aadb1c089128ff35be5 Oct 27 03:30:22.388773 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ServersAdminTestJSON-1349869830-project Oct 27 03:30:22.388773 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:30:22.388773 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 62224107-28c3-40c7-b4d3-13881d1c8d65 could not be found. Oct 27 03:30:22.388773 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '62224107-28c3-40c7-b4d3-13881d1c8d65'} Oct 27 03:30:22.388773 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:30:22.388773 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:22.388773 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:30:22.388773 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:30:22.388773 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:30:22.388773 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:30:22.388773 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:30:22.388773 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:30:22.388773 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:30:22.388773 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:30:22.388773 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62224107-28c3-40c7-b4d3-13881d1c8d65 could not be found. Oct 27 03:30:22.388773 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:22.388773 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:30:22.388773 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:22.388773 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:22.388773 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:30:22.388773 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:30:22.388773 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:30:22.388773 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:30:22.388773 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:30:22.388773 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:30:22.388773 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:30:22.388773 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:30:22.388773 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:30:22.388773 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:30:22.388773 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:30:22.388773 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:30:22.388773 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62224107-28c3-40c7-b4d3-13881d1c8d65 could not be found. Oct 27 03:30:22.388773 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:22.388773 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:30:22.388773 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:22.393107 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:22.393107 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:30:22.393107 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:30:22.393107 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:30:22.393107 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:30:22.393107 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62224107-28c3-40c7-b4d3-13881d1c8d65 could not be found. Oct 27 03:30:22.393107 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:22.393107 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-79edce73-ceb7-4629-80a0-ee4a62b89f54 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Returning 404 to user: Instance 62224107-28c3-40c7-b4d3-13881d1c8d65 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:30:22.393107 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-79edce73-ceb7-4629-80a0-ee4a62b89f54 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "GET /compute/v2.1/servers/62224107-28c3-40c7-b4d3-13881d1c8d65" status: 404 len: 111 microversion: 2.1 time: 0.042154 Oct 27 03:30:22.394008 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1226/2504] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:22 2022] GET /compute/v2.1/servers/62224107-28c3-40c7-b4d3-13881d1c8d65 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:30:22.398624 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c802ef97-8458-40d9-b280-67fa1d760441 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:22.399123 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c802ef97-8458-40d9-b280-67fa1d760441 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: 339287fc-37b6-455d-96ab-08ab8e2c3e68] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:22.405313 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c802ef97-8458-40d9-b280-67fa1d760441 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:22.405880 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c802ef97-8458-40d9-b280-67fa1d760441 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:22.406383 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c802ef97-8458-40d9-b280-67fa1d760441 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:22.407087 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c802ef97-8458-40d9-b280-67fa1d760441 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:22.407564 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c802ef97-8458-40d9-b280-67fa1d760441 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:22.407975 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c802ef97-8458-40d9-b280-67fa1d760441 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:22.416773 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2358f6ff-22fb-4714-b548-6aaf851e36c7 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] 10.222.0.20 "POST /compute/v2.1/servers/04477d51-f600-483a-aec9-feb992cc6cf7/action" status: 202 len: 0 microversion: 2.1 time: 0.727331 Oct 27 03:30:22.417735 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1279/2505] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:30:21 2022] POST /compute/v2.1/servers/04477d51-f600-483a-aec9-feb992cc6cf7/action => generated 0 bytes in 729 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:30:22.429545 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-2236b060-6bae-4140-ace8-59bb4c1e414c req-196aac80-04ee-49bd-bcb4-a823c373d1ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04477d51-f600-483a-aec9-feb992cc6cf7", "tag": "5bbab630-1088-4a87-96b5-3098b0dbf41f"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:30:22.442938 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:30:22.455164 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c802ef97-8458-40d9-b280-67fa1d760441 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: 339287fc-37b6-455d-96ab-08ab8e2c3e68] Going to try to terminate instance {{(pid=121000) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:30:22.462065 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-2236b060-6bae-4140-ace8-59bb4c1e414c req-196aac80-04ee-49bd-bcb4-a823c373d1ea service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:22.462592 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-2236b060-6bae-4140-ace8-59bb4c1e414c req-196aac80-04ee-49bd-bcb4-a823c373d1ea service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:22.463842 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-2236b060-6bae-4140-ace8-59bb4c1e414c req-196aac80-04ee-49bd-bcb4-a823c373d1ea service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:22.480141 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-2236b060-6bae-4140-ace8-59bb4c1e414c req-196aac80-04ee-49bd-bcb4-a823c373d1ea service nova] Creating event network-changed:5bbab630-1088-4a87-96b5-3098b0dbf41f for instance 04477d51-f600-483a-aec9-feb992cc6cf7 on n-h1-862769-1 Oct 27 03:30:22.489942 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-2236b060-6bae-4140-ace8-59bb4c1e414c req-196aac80-04ee-49bd-bcb4-a823c373d1ea service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063504 Oct 27 03:30:22.490653 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1280/2506] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:30:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:30:22.513651 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-cd3f7340-d6fe-46a0-8b05-be155a6a6c80 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Calling method '.version_select at 0x7f7ddec22790>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:22.737704 n-d-862769-1 devstack@n-api.service[121001]: DEBUG neutronclient.v2_0.client [None req-cd3f7340-d6fe-46a0-8b05-be155a6a6c80 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 362204bb-f331-489e-bb41-766f010c5078 in use.", "detail": ""}} {{(pid=121001) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 03:30:22.742871 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-cd3f7340-d6fe-46a0-8b05-be155a6a6c80 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] HTTP exception thrown: Security Group 362204bb-f331-489e-bb41-766f010c5078 in use. Oct 27 03:30:22.742871 n-d-862769-1 devstack@n-api.service[121001]: Neutron server returns request_ids: ['req-4b6780d5-90ac-4ab8-bdd5-aea4a245b4e1'] Oct 27 03:30:22.742871 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-cd3f7340-d6fe-46a0-8b05-be155a6a6c80 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Request method failure captured: Oct 27 03:30:22.742871 n-d-862769-1 devstack@n-api.service[121001]: request: DELETE /compute/v2.1/os-security-groups/362204bb-f331-489e-bb41-766f010c5078 HTTP/1.1 Oct 27 03:30:22.742871 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:30:22.742871 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:30:22.742871 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:30:22.742871 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:30:22.742871 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:30:22.742871 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:30:22.742871 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:30:22.742871 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:30:22.742871 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfsDm0Py_zt25h362jzfO2BV3foI0uyhpjoORk0IBXpXJDIOp5L0sBs5ZGjH5wntvfF1YWko5rdp9M7xGcdJ8XvPLxOQRZn1LZea5O-2FHM2FJsNqsONwbzuZ-uFy7VwM4IakmeqODIMdeP73cGPmeJKxcyXnuTU87F5wWBu1IQyRCI Oct 27 03:30:22.742871 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:30:22.742871 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:30:22.742871 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:30:22.742871 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:30:22.742871 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:30:22.742871 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:30:22.742871 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 92082c8718aa41bf96cd84d682d75954 Oct 27 03:30:22.742871 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-SecurityGroupsTestJSON-1273178137 Oct 27 03:30:22.742871 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:30:22.742871 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:30:22.742871 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/92082c8718aa41bf96cd84d682d75954"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/92082c8718aa41bf96cd84d682d75954"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/92082c8718aa41bf96cd84d682d75954"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_92082c8718aa41bf96cd84d682d75954"}]}] Oct 27 03:30:22.742871 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-SecurityGroupsTestJSON-1273178137 Oct 27 03:30:22.742871 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 92082c8718aa41bf96cd84d682d75954 Oct 27 03:30:22.742871 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1273178137 Oct 27 03:30:22.742871 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-SecurityGroupsTestJSON-1273178137-project Oct 27 03:30:22.742871 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:30:22.742871 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:30:22.742871 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 421d14944da74570a53d620ea205449d Oct 27 03:30:22.742871 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-SecurityGroupsTestJSON-1273178137-project Oct 27 03:30:22.742871 n-d-862769-1 devstack@n-api.service[121001]: method: Oct 27 03:30:22.742871 n-d-862769-1 devstack@n-api.service[121001]: exception: Security Group 362204bb-f331-489e-bb41-766f010c5078 in use. Oct 27 03:30:22.742871 n-d-862769-1 devstack@n-api.service[121001]: Neutron server returns request_ids: ['req-4b6780d5-90ac-4ab8-bdd5-aea4a245b4e1'] Oct 27 03:30:22.742871 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '362204bb-f331-489e-bb41-766f010c5078'} Oct 27 03:30:22.742871 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:30:22.742871 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:22.742871 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 27 03:30:22.742871 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 27 03:30:22.742871 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:30:22.742871 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:30:22.742871 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 27 03:30:22.742871 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 27 03:30:22.742871 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:30:22.742871 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:30:22.742871 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 27 03:30:22.742871 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 27 03:30:22.742871 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:30:22.742871 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:30:22.742871 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 03:30:22.742871 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 03:30:22.742871 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:30:22.742871 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:30:22.742871 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 03:30:22.742871 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 03:30:22.742871 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:30:22.742871 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:30:22.742871 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 03:30:22.742871 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 03:30:22.746980 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 03:30:22.746980 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 03:30:22.746980 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 362204bb-f331-489e-bb41-766f010c5078 in use. Oct 27 03:30:22.746980 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4b6780d5-90ac-4ab8-bdd5-aea4a245b4e1'] Oct 27 03:30:22.746980 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:22.746980 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:30:22.746980 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:22.746980 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:22.746980 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 27 03:30:22.746980 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 27 03:30:22.746980 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 27 03:30:22.746980 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 27 03:30:22.746980 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 362204bb-f331-489e-bb41-766f010c5078 in use. Oct 27 03:30:22.746980 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4b6780d5-90ac-4ab8-bdd5-aea4a245b4e1'] Oct 27 03:30:22.746980 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:22.746980 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:30:22.746980 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:22.746980 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:22.746980 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:30:22.746980 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:30:22.746980 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:30:22.746980 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:30:22.746980 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:30:22.746980 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:30:22.746980 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:30:22.746980 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:30:22.746980 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 27 03:30:22.746980 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 27 03:30:22.746980 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 362204bb-f331-489e-bb41-766f010c5078 in use. Oct 27 03:30:22.746980 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4b6780d5-90ac-4ab8-bdd5-aea4a245b4e1'] Oct 27 03:30:22.746980 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:22.746980 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:30:22.746980 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:22.746980 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:22.746980 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:30:22.746980 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:30:22.746980 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:30:22.746980 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:30:22.746980 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 362204bb-f331-489e-bb41-766f010c5078 in use. Oct 27 03:30:22.746980 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4b6780d5-90ac-4ab8-bdd5-aea4a245b4e1'] Oct 27 03:30:22.746980 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:22.746980 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-cd3f7340-d6fe-46a0-8b05-be155a6a6c80 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Returning 400 to user: Security Group 362204bb-f331-489e-bb41-766f010c5078 in use. Oct 27 03:30:22.746980 n-d-862769-1 devstack@n-api.service[121001]: Neutron server returns request_ids: ['req-4b6780d5-90ac-4ab8-bdd5-aea4a245b4e1'] {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:30:22.746980 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-cd3f7340-d6fe-46a0-8b05-be155a6a6c80 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/362204bb-f331-489e-bb41-766f010c5078" status: 400 len: 185 microversion: 2.1 time: 0.248692 Oct 27 03:30:22.746980 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1281/2507] 10.222.0.20 () {58 vars in 1272 bytes} [Thu Oct 27 03:30:22 2022] DELETE /compute/v2.1/os-security-groups/362204bb-f331-489e-bb41-766f010c5078 => generated 185 bytes in 253 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 03:30:22.751278 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-313638a5-ff1c-49b4-8bd1-13380c61d7df tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:22.751687 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-313638a5-ff1c-49b4-8bd1-13380c61d7df tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: a52fed88-50f8-4dea-b83d-6878adccb024] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:22.773428 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-313638a5-ff1c-49b4-8bd1-13380c61d7df tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:22.773933 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-313638a5-ff1c-49b4-8bd1-13380c61d7df tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:22.788740 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-313638a5-ff1c-49b4-8bd1-13380c61d7df tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:22.792700 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-313638a5-ff1c-49b4-8bd1-13380c61d7df tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:22.793408 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-313638a5-ff1c-49b4-8bd1-13380c61d7df tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:22.794645 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-313638a5-ff1c-49b4-8bd1-13380c61d7df tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:22.872455 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-313638a5-ff1c-49b4-8bd1-13380c61d7df tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:22.872955 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-313638a5-ff1c-49b4-8bd1-13380c61d7df tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:22.873536 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-313638a5-ff1c-49b4-8bd1-13380c61d7df tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:22.874213 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-313638a5-ff1c-49b4-8bd1-13380c61d7df tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lazy-loading 'fault' on Instance uuid a52fed88-50f8-4dea-b83d-6878adccb024 {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:30:22.957383 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c802ef97-8458-40d9-b280-67fa1d760441 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "DELETE /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68" status: 204 len: 0 microversion: 2.1 time: 0.561428 Oct 27 03:30:22.957987 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1227/2508] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:30:22 2022] DELETE /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:30:22.969165 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c812b69d-acfb-4b63-868b-82a971520cd5 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:22.969886 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c812b69d-acfb-4b63-868b-82a971520cd5 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] [instance: 04477d51-f600-483a-aec9-feb992cc6cf7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:22.989319 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c812b69d-acfb-4b63-868b-82a971520cd5 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:22.989621 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c812b69d-acfb-4b63-868b-82a971520cd5 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:22.990247 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c812b69d-acfb-4b63-868b-82a971520cd5 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:22.992053 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c812b69d-acfb-4b63-868b-82a971520cd5 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:22.992808 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c812b69d-acfb-4b63-868b-82a971520cd5 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:22.993142 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c812b69d-acfb-4b63-868b-82a971520cd5 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:23.035377 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c812b69d-acfb-4b63-868b-82a971520cd5 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] [instance: 04477d51-f600-483a-aec9-feb992cc6cf7] Going to try to terminate instance {{(pid=121000) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:30:23.241325 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-313638a5-ff1c-49b4-8bd1-13380c61d7df tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:23.248467 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-313638a5-ff1c-49b4-8bd1-13380c61d7df tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/a52fed88-50f8-4dea-b83d-6878adccb024" status: 200 len: 1301 microversion: 2.1 time: 0.501321 Oct 27 03:30:23.249225 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1282/2509] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:22 2022] GET /compute/v2.1/servers/a52fed88-50f8-4dea-b83d-6878adccb024 => generated 1301 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:23.384729 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5f9d8b33-266d-4235-9b02-9caefcfc357d tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1096476387", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:30:23.438756 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.network.neutron [None req-5f9d8b33-266d-4235-9b02-9caefcfc357d tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] validate_networks() for None {{(pid=121001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:30:23.618775 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c812b69d-acfb-4b63-868b-82a971520cd5 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] 10.222.0.20 "DELETE /compute/v2.1/servers/04477d51-f600-483a-aec9-feb992cc6cf7" status: 204 len: 0 microversion: 2.1 time: 0.658934 Oct 27 03:30:23.619444 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1228/2510] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:30:22 2022] DELETE /compute/v2.1/servers/04477d51-f600-483a-aec9-feb992cc6cf7 => generated 0 bytes in 661 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:30:23.625538 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e399d17f-3b0f-4ee6-a4d0-c6777547450d tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:23.626291 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e399d17f-3b0f-4ee6-a4d0-c6777547450d tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] [instance: 2023265c-1a97-4ed8-8af7-f83077e4bfa5] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:23.634984 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e399d17f-3b0f-4ee6-a4d0-c6777547450d tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:23.635481 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e399d17f-3b0f-4ee6-a4d0-c6777547450d tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:23.635943 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e399d17f-3b0f-4ee6-a4d0-c6777547450d tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:23.636638 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e399d17f-3b0f-4ee6-a4d0-c6777547450d tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:23.637122 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e399d17f-3b0f-4ee6-a4d0-c6777547450d tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:23.637552 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e399d17f-3b0f-4ee6-a4d0-c6777547450d tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:23.644202 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-5f9d8b33-266d-4235-9b02-9caefcfc357d tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Flavor limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:30:23.645591 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-5f9d8b33-266d-4235-9b02-9caefcfc357d tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Image limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:30:23.645591 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-5f9d8b33-266d-4235-9b02-9caefcfc357d tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Flavor pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:30:23.645591 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-5f9d8b33-266d-4235-9b02-9caefcfc357d tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Image pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:30:23.646186 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-5f9d8b33-266d-4235-9b02-9caefcfc357d tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:30:23.655277 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5f9d8b33-266d-4235-9b02-9caefcfc357d tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:23.655762 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5f9d8b33-266d-4235-9b02-9caefcfc357d tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:23.656196 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5f9d8b33-266d-4235-9b02-9caefcfc357d tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:23.656921 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5f9d8b33-266d-4235-9b02-9caefcfc357d tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:23.657552 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5f9d8b33-266d-4235-9b02-9caefcfc357d tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:23.657978 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5f9d8b33-266d-4235-9b02-9caefcfc357d tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:23.676532 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-5f9d8b33-266d-4235-9b02-9caefcfc357d tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Getting quotas for project ccd0392257a0419dbfa569c8816ece2b. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:30:23.681894 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-5f9d8b33-266d-4235-9b02-9caefcfc357d tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Getting quotas for user 42cd1938c86a4f389a2ec0fba9beff36 and project ccd0392257a0419dbfa569c8816ece2b. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:30:23.694741 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5f9d8b33-266d-4235-9b02-9caefcfc357d tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Going to run 1 instances... {{(pid=121001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:30:23.696999 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5f9d8b33-266d-4235-9b02-9caefcfc357d tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] [instance: b0c6560f-ade1-4ae6-905e-ad488f4c3b51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:30:23.706795 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e399d17f-3b0f-4ee6-a4d0-c6777547450d tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce351a48282492e8cd69b9a5a05f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5514904d799d4f5dae454193e70d85f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:23.714978 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e399d17f-3b0f-4ee6-a4d0-c6777547450d tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] 10.222.0.20 "GET /compute/v2.1/servers/2023265c-1a97-4ed8-8af7-f83077e4bfa5" status: 200 len: 1171 microversion: 2.1 time: 0.094443 Oct 27 03:30:23.725374 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1229/2511] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:23 2022] GET /compute/v2.1/servers/2023265c-1a97-4ed8-8af7-f83077e4bfa5 => generated 1171 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:23.725374 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-10f87d46-d88c-4aa3-a166-4f03f768bb5e tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:23.725374 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-10f87d46-d88c-4aa3-a166-4f03f768bb5e tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: 339287fc-37b6-455d-96ab-08ab8e2c3e68] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:23.730894 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-10f87d46-d88c-4aa3-a166-4f03f768bb5e tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:23.731439 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-10f87d46-d88c-4aa3-a166-4f03f768bb5e tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:23.732286 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-10f87d46-d88c-4aa3-a166-4f03f768bb5e tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:23.733165 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-10f87d46-d88c-4aa3-a166-4f03f768bb5e tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:23.733768 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-10f87d46-d88c-4aa3-a166-4f03f768bb5e tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:23.734243 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-10f87d46-d88c-4aa3-a166-4f03f768bb5e tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:23.821945 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5f9d8b33-266d-4235-9b02-9caefcfc357d tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.571457 Oct 27 03:30:23.822641 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1283/2512] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:30:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 03:30:23.827308 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-dec4e6f5-885f-4af2-88d6-0f4e913ede92 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:23.832964 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-dec4e6f5-885f-4af2-88d6-0f4e913ede92 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: d5e6f604-9466-45c6-86a8-885cfb393223] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:23.834303 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dec4e6f5-885f-4af2-88d6-0f4e913ede92 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:23.834969 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dec4e6f5-885f-4af2-88d6-0f4e913ede92 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:23.835401 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dec4e6f5-885f-4af2-88d6-0f4e913ede92 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:23.836269 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dec4e6f5-885f-4af2-88d6-0f4e913ede92 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:23.836723 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dec4e6f5-885f-4af2-88d6-0f4e913ede92 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:23.837145 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dec4e6f5-885f-4af2-88d6-0f4e913ede92 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:23.883670 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-10f87d46-d88c-4aa3-a166-4f03f768bb5e tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13e05e253c94aadb1c089128ff35be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8510a519f14deea6f35a437419e161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:23.897105 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-10f87d46-d88c-4aa3-a166-4f03f768bb5e tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68" status: 200 len: 1469 microversion: 2.1 time: 0.180512 Oct 27 03:30:23.897926 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1230/2513] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:23 2022] GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68 => generated 1469 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:23.903188 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c6f26377-cfd4-4c5b-8c11-4ea325e3235d tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:23.903521 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c6f26377-cfd4-4c5b-8c11-4ea325e3235d tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] [instance: ba3e02bc-d621-49e5-8e81-0d33828d816f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:23.910665 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c6f26377-cfd4-4c5b-8c11-4ea325e3235d tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:23.911153 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c6f26377-cfd4-4c5b-8c11-4ea325e3235d tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:23.911600 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c6f26377-cfd4-4c5b-8c11-4ea325e3235d tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:23.912313 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c6f26377-cfd4-4c5b-8c11-4ea325e3235d tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:23.914928 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c6f26377-cfd4-4c5b-8c11-4ea325e3235d tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:23.914928 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c6f26377-cfd4-4c5b-8c11-4ea325e3235d tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:23.989220 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-dec4e6f5-885f-4af2-88d6-0f4e913ede92 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:24.004411 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-dec4e6f5-885f-4af2-88d6-0f4e913ede92 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:24.005923 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-dec4e6f5-885f-4af2-88d6-0f4e913ede92 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:24.007177 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-dec4e6f5-885f-4af2-88d6-0f4e913ede92 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223" status: 200 len: 1487 microversion: 2.25 time: 0.183527 Oct 27 03:30:24.007732 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1284/2514] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:30:23 2022] GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223 => generated 1487 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:30:24.023268 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a2d0fa5a-7eb1-4755-a747-455e37bec4c1 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:24.027012 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a2d0fa5a-7eb1-4755-a747-455e37bec4c1 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] [instance: 04477d51-f600-483a-aec9-feb992cc6cf7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:24.033937 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a2d0fa5a-7eb1-4755-a747-455e37bec4c1 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:24.035144 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a2d0fa5a-7eb1-4755-a747-455e37bec4c1 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:24.035783 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a2d0fa5a-7eb1-4755-a747-455e37bec4c1 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:24.036588 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a2d0fa5a-7eb1-4755-a747-455e37bec4c1 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:24.037230 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a2d0fa5a-7eb1-4755-a747-455e37bec4c1 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:24.037667 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a2d0fa5a-7eb1-4755-a747-455e37bec4c1 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:24.107592 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c6f26377-cfd4-4c5b-8c11-4ea325e3235d tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e64f7f0501454fa8474aa61c9a8c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561891c49901486c9d7651688f88b0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:24.116478 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c6f26377-cfd4-4c5b-8c11-4ea325e3235d tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] 10.222.0.20 "GET /compute/v2.1/servers/ba3e02bc-d621-49e5-8e81-0d33828d816f" status: 200 len: 1520 microversion: 2.1 time: 0.217188 Oct 27 03:30:24.117440 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1231/2515] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:23 2022] GET /compute/v2.1/servers/ba3e02bc-d621-49e5-8e81-0d33828d816f => generated 1520 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:24.122762 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6392cdb7-bef3-4e63-af11-849c4f8120a1 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:24.123542 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6392cdb7-bef3-4e63-af11-849c4f8120a1 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] [instance: b0c6560f-ade1-4ae6-905e-ad488f4c3b51] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:24.192302 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-6392cdb7-bef3-4e63-af11-849c4f8120a1 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cd1938c86a4f389a2ec0fba9beff36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd0392257a0419dbfa569c8816ece2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:24.199888 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6392cdb7-bef3-4e63-af11-849c4f8120a1 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] 10.222.0.20 "GET /compute/v2.1/servers/b0c6560f-ade1-4ae6-905e-ad488f4c3b51" status: 200 len: 1217 microversion: 2.1 time: 0.081017 Oct 27 03:30:24.206957 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1232/2516] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:24 2022] GET /compute/v2.1/servers/b0c6560f-ade1-4ae6-905e-ad488f4c3b51 => generated 1217 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:24.212384 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-036b9185-a1e9-4c64-a2a6-0eda92c42b94 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:24.213623 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-036b9185-a1e9-4c64-a2a6-0eda92c42b94 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] [instance: ba3e02bc-d621-49e5-8e81-0d33828d816f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:24.220136 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-036b9185-a1e9-4c64-a2a6-0eda92c42b94 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:24.220640 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-036b9185-a1e9-4c64-a2a6-0eda92c42b94 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:24.221087 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-036b9185-a1e9-4c64-a2a6-0eda92c42b94 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:24.222402 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-036b9185-a1e9-4c64-a2a6-0eda92c42b94 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:24.222869 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-036b9185-a1e9-4c64-a2a6-0eda92c42b94 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:24.223307 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-036b9185-a1e9-4c64-a2a6-0eda92c42b94 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:24.250641 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a2d0fa5a-7eb1-4755-a747-455e37bec4c1 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421d14944da74570a53d620ea205449d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92082c8718aa41bf96cd84d682d75954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:24.251128 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-036b9185-a1e9-4c64-a2a6-0eda92c42b94 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] HTTP exception thrown: Instance is not a member of specified network Oct 27 03:30:24.258727 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a2d0fa5a-7eb1-4755-a747-455e37bec4c1 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] 10.222.0.20 "GET /compute/v2.1/servers/04477d51-f600-483a-aec9-feb992cc6cf7" status: 200 len: 1647 microversion: 2.1 time: 0.243939 Oct 27 03:30:24.259536 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1285/2517] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:24 2022] GET /compute/v2.1/servers/04477d51-f600-483a-aec9-feb992cc6cf7 => generated 1647 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:24.259873 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-036b9185-a1e9-4c64-a2a6-0eda92c42b94 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Request method failure captured: Oct 27 03:30:24.259873 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/ba3e02bc-d621-49e5-8e81-0d33828d816f/ips/invalid HTTP/1.1 Oct 27 03:30:24.259873 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:30:24.259873 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:30:24.259873 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:30:24.259873 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:30:24.259873 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:30:24.259873 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:30:24.259873 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:30:24.259873 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:30:24.259873 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfs6dOxiCwUy1YeuqkkBeJZvU6IOok0wlgx7U5glXh8BkugpZvpPhk7CB8YcGlAcSxjz24lBx4SXLw8P0YKTw_jr3AcfEsDkm2DGlMLoZj9oU2ekFEQqaDiRlXLm8wFvaTxrjQX68ly-cZVGlGdXdCnortY0dhH0h5-Gl28G9y_zvyk Oct 27 03:30:24.259873 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:30:24.259873 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:30:24.259873 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:30:24.259873 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:30:24.259873 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:30:24.259873 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:30:24.259873 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 561891c49901486c9d7651688f88b0eb Oct 27 03:30:24.259873 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1729127104 Oct 27 03:30:24.259873 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:30:24.259873 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:30:24.259873 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/561891c49901486c9d7651688f88b0eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/561891c49901486c9d7651688f88b0eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/561891c49901486c9d7651688f88b0eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_561891c49901486c9d7651688f88b0eb"}]}] Oct 27 03:30:24.259873 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1729127104 Oct 27 03:30:24.259873 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 561891c49901486c9d7651688f88b0eb Oct 27 03:30:24.259873 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1729127104 Oct 27 03:30:24.259873 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ServerAddressesNegativeTestJSON-1729127104-project Oct 27 03:30:24.259873 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:30:24.259873 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:30:24.259873 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: c3e64f7f0501454fa8474aa61c9a8c5b Oct 27 03:30:24.259873 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1729127104-project Oct 27 03:30:24.259873 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:30:24.259873 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance is not a member of specified network Oct 27 03:30:24.259873 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'server_id': 'ba3e02bc-d621-49e5-8e81-0d33828d816f', 'id': 'invalid'} Oct 27 03:30:24.259873 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:30:24.259873 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:24.259873 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:30:24.259873 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:30:24.259873 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:30:24.259873 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:30:24.259873 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:30:24.259873 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:30:24.259873 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Oct 27 03:30:24.259873 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 27 03:30:24.259873 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Oct 27 03:30:24.259873 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:24.259873 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:30:24.259873 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:24.259873 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:24.259873 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:30:24.259873 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:30:24.259873 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:30:24.259873 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:30:24.259873 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Oct 27 03:30:24.259873 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:24.262808 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-036b9185-a1e9-4c64-a2a6-0eda92c42b94 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Returning 404 to user: Instance is not a member of specified network {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:30:24.262808 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-036b9185-a1e9-4c64-a2a6-0eda92c42b94 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] 10.222.0.20 "GET /compute/v2.1/servers/ba3e02bc-d621-49e5-8e81-0d33828d816f/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.053095 Oct 27 03:30:24.262808 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1233/2518] 10.222.0.20 () {58 vars in 1272 bytes} [Thu Oct 27 03:30:24 2022] GET /compute/v2.1/servers/ba3e02bc-d621-49e5-8e81-0d33828d816f/ips/invalid => generated 91 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 03:30:24.282164 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-15e88c0c-26a1-4cad-83d1-282d702d56c5 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:24.282660 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-15e88c0c-26a1-4cad-83d1-282d702d56c5 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Failed to fetch instance by id 999 {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 27 03:30:24.283177 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-15e88c0c-26a1-4cad-83d1-282d702d56c5 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] HTTP exception thrown: Instance 999 could not be found. Oct 27 03:30:24.285200 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ea224c23-a646-471d-9819-4c7927eb97e9 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:24.285788 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-15e88c0c-26a1-4cad-83d1-282d702d56c5 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Request method failure captured: Oct 27 03:30:24.285788 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Oct 27 03:30:24.285788 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:30:24.285788 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:30:24.285788 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:30:24.285788 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:30:24.285788 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:30:24.285788 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:30:24.285788 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:30:24.285788 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:30:24.285788 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfs6dOxiCwUy1YeuqkkBeJZvU6IOok0wlgx7U5glXh8BkugpZvpPhk7CB8YcGlAcSxjz24lBx4SXLw8P0YKTw_jr3AcfEsDkm2DGlMLoZj9oU2ekFEQqaDiRlXLm8wFvaTxrjQX68ly-cZVGlGdXdCnortY0dhH0h5-Gl28G9y_zvyk Oct 27 03:30:24.285788 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:30:24.285788 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:30:24.285788 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:30:24.285788 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:30:24.285788 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:30:24.285788 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:30:24.285788 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 561891c49901486c9d7651688f88b0eb Oct 27 03:30:24.285788 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1729127104 Oct 27 03:30:24.285788 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:30:24.285788 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:30:24.285788 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/561891c49901486c9d7651688f88b0eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/561891c49901486c9d7651688f88b0eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/561891c49901486c9d7651688f88b0eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_561891c49901486c9d7651688f88b0eb"}]}] Oct 27 03:30:24.285788 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1729127104 Oct 27 03:30:24.285788 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 561891c49901486c9d7651688f88b0eb Oct 27 03:30:24.285788 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1729127104 Oct 27 03:30:24.285788 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServerAddressesNegativeTestJSON-1729127104-project Oct 27 03:30:24.285788 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:30:24.285788 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:30:24.285788 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: c3e64f7f0501454fa8474aa61c9a8c5b Oct 27 03:30:24.285788 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1729127104-project Oct 27 03:30:24.285788 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:30:24.285788 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 999 could not be found. Oct 27 03:30:24.285788 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'server_id': '999'} Oct 27 03:30:24.285788 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:30:24.285788 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:24.285788 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:30:24.285788 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:30:24.285788 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 27 03:30:24.285788 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 27 03:30:24.285788 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 27 03:30:24.285788 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:24.285788 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:30:24.285788 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:24.285788 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:24.285788 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:30:24.285788 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:30:24.285788 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:30:24.285788 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:30:24.285788 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:30:24.285788 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:30:24.285788 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Oct 27 03:30:24.285788 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Oct 27 03:30:24.285788 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:30:24.285788 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:30:24.285788 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 27 03:30:24.285788 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:24.285788 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:30:24.285788 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:24.285788 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:24.285788 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:30:24.285788 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:30:24.285788 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:30:24.285788 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:30:24.285788 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 27 03:30:24.285788 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:24.289237 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ea224c23-a646-471d-9819-4c7927eb97e9 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: a52fed88-50f8-4dea-b83d-6878adccb024] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:24.289311 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-15e88c0c-26a1-4cad-83d1-282d702d56c5 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Returning 404 to user: Instance 999 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:30:24.291531 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-15e88c0c-26a1-4cad-83d1-282d702d56c5 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] 10.222.0.20 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.019197 Oct 27 03:30:24.292656 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1286/2519] 10.222.0.20 () {58 vars in 1149 bytes} [Thu Oct 27 03:30:24 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 03:30:24.296170 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ea224c23-a646-471d-9819-4c7927eb97e9 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:24.296782 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ea224c23-a646-471d-9819-4c7927eb97e9 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:24.297349 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ea224c23-a646-471d-9819-4c7927eb97e9 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:24.298610 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ea224c23-a646-471d-9819-4c7927eb97e9 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:24.299181 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ea224c23-a646-471d-9819-4c7927eb97e9 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:24.299737 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ea224c23-a646-471d-9819-4c7927eb97e9 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:24.302592 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-897d6ae9-18b2-44ca-b9ab-1b7462a9b4a7 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:24.303281 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-897d6ae9-18b2-44ca-b9ab-1b7462a9b4a7 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] [instance: ba3e02bc-d621-49e5-8e81-0d33828d816f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:24.310085 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-897d6ae9-18b2-44ca-b9ab-1b7462a9b4a7 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:24.310803 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-897d6ae9-18b2-44ca-b9ab-1b7462a9b4a7 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:24.311245 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-897d6ae9-18b2-44ca-b9ab-1b7462a9b4a7 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:24.311948 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-897d6ae9-18b2-44ca-b9ab-1b7462a9b4a7 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:24.312559 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-897d6ae9-18b2-44ca-b9ab-1b7462a9b4a7 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:24.312987 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-897d6ae9-18b2-44ca-b9ab-1b7462a9b4a7 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:24.316413 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-ea224c23-a646-471d-9819-4c7927eb97e9 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] HTTP exception thrown: Instance a52fed88-50f8-4dea-b83d-6878adccb024 could not be found. Oct 27 03:30:24.317967 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ea224c23-a646-471d-9819-4c7927eb97e9 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Request method failure captured: Oct 27 03:30:24.317967 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/a52fed88-50f8-4dea-b83d-6878adccb024 HTTP/1.1 Oct 27 03:30:24.317967 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:30:24.317967 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:30:24.317967 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:30:24.317967 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:30:24.317967 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:30:24.317967 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:30:24.317967 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:30:24.317967 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:30:24.317967 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWflpDYfIGjZv42nta44cUKr4gfgFkHcAeVM8yamczRS9hHsDVo2rsQnCdKSUZqn3ZmcXBvUrwb61kAyQ6DVfG99X5r7udSMUTUj-TX444bEUorFGQKwimw1hyhYRTrQq-ZUKWv2S3u5J0WvKPFUznz1pJqOrfpEn__pIwU22_EAMjAc Oct 27 03:30:24.317967 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:30:24.317967 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:30:24.317967 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:30:24.317967 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:30:24.317967 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:30:24.317967 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:30:24.317967 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: aaee7e66f16e4ed5b49394311bd2803a Oct 27 03:30:24.317967 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-LiveMigrationTest-428698375 Oct 27 03:30:24.317967 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:30:24.317967 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:30:24.317967 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aaee7e66f16e4ed5b49394311bd2803a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/aaee7e66f16e4ed5b49394311bd2803a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aaee7e66f16e4ed5b49394311bd2803a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_aaee7e66f16e4ed5b49394311bd2803a"}]}] Oct 27 03:30:24.317967 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-LiveMigrationTest-428698375 Oct 27 03:30:24.317967 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: aaee7e66f16e4ed5b49394311bd2803a Oct 27 03:30:24.317967 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-LiveMigrationTest-428698375 Oct 27 03:30:24.317967 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-LiveMigrationTest-428698375-project Oct 27 03:30:24.317967 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:30:24.317967 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:30:24.317967 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 8c93886c5818439690564c2299a4f3ee Oct 27 03:30:24.317967 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-LiveMigrationTest-428698375-project Oct 27 03:30:24.317967 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:30:24.317967 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance a52fed88-50f8-4dea-b83d-6878adccb024 could not be found. Oct 27 03:30:24.317967 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': 'a52fed88-50f8-4dea-b83d-6878adccb024'} Oct 27 03:30:24.317967 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:30:24.317967 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:24.317967 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:30:24.317967 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:30:24.317967 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:30:24.317967 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:30:24.317967 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:30:24.317967 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:30:24.317967 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:30:24.317967 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:30:24.317967 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a52fed88-50f8-4dea-b83d-6878adccb024 could not be found. Oct 27 03:30:24.317967 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:24.317967 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:30:24.317967 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:24.317967 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:24.317967 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:30:24.317967 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:30:24.317967 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:30:24.317967 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:30:24.317967 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:30:24.317967 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:30:24.317967 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:30:24.317967 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:30:24.317967 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:30:24.317967 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:30:24.317967 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:30:24.317967 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:30:24.317967 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a52fed88-50f8-4dea-b83d-6878adccb024 could not be found. Oct 27 03:30:24.317967 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:24.317967 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:30:24.317967 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:24.321865 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:24.321865 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:30:24.321865 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:30:24.321865 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:30:24.321865 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:30:24.321865 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a52fed88-50f8-4dea-b83d-6878adccb024 could not be found. Oct 27 03:30:24.321865 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:24.321865 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ea224c23-a646-471d-9819-4c7927eb97e9 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Returning 404 to user: Instance a52fed88-50f8-4dea-b83d-6878adccb024 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:30:24.321865 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ea224c23-a646-471d-9819-4c7927eb97e9 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/a52fed88-50f8-4dea-b83d-6878adccb024" status: 404 len: 111 microversion: 2.1 time: 0.043511 Oct 27 03:30:24.321865 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1234/2520] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:24 2022] GET /compute/v2.1/servers/a52fed88-50f8-4dea-b83d-6878adccb024 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:30:24.334145 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7bbe7f7c-2d25-4786-83d1-cf3a8383b402 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:24.334749 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7bbe7f7c-2d25-4786-83d1-cf3a8383b402 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: da3360d3-ca0b-4077-af3e-92731700dada] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:24.340798 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7bbe7f7c-2d25-4786-83d1-cf3a8383b402 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:24.341298 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7bbe7f7c-2d25-4786-83d1-cf3a8383b402 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:24.342017 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7bbe7f7c-2d25-4786-83d1-cf3a8383b402 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:24.342763 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7bbe7f7c-2d25-4786-83d1-cf3a8383b402 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:24.343230 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7bbe7f7c-2d25-4786-83d1-cf3a8383b402 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:24.343805 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7bbe7f7c-2d25-4786-83d1-cf3a8383b402 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:24.345940 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-897d6ae9-18b2-44ca-b9ab-1b7462a9b4a7 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] [instance: ba3e02bc-d621-49e5-8e81-0d33828d816f] Going to try to terminate instance {{(pid=121001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:30:24.370341 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7bbe7f7c-2d25-4786-83d1-cf3a8383b402 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: da3360d3-ca0b-4077-af3e-92731700dada] Going to try to terminate instance {{(pid=121000) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:30:24.760403 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7bbe7f7c-2d25-4786-83d1-cf3a8383b402 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "DELETE /compute/v2.1/servers/da3360d3-ca0b-4077-af3e-92731700dada" status: 204 len: 0 microversion: 2.1 time: 0.430143 Oct 27 03:30:24.762340 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-897d6ae9-18b2-44ca-b9ab-1b7462a9b4a7 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ba3e02bc-d621-49e5-8e81-0d33828d816f" status: 204 len: 0 microversion: 2.1 time: 0.464595 Oct 27 03:30:24.765587 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1235/2521] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:30:24 2022] DELETE /compute/v2.1/servers/da3360d3-ca0b-4077-af3e-92731700dada => generated 0 bytes in 434 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 03:30:24.769009 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1287/2522] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:30:24 2022] DELETE /compute/v2.1/servers/ba3e02bc-d621-49e5-8e81-0d33828d816f => generated 0 bytes in 472 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:30:24.771056 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c615971d-0c1e-4589-9b06-aba5f31e43e0 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:24.773502 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c615971d-0c1e-4589-9b06-aba5f31e43e0 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] [instance: 2023265c-1a97-4ed8-8af7-f83077e4bfa5] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:24.781261 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c615971d-0c1e-4589-9b06-aba5f31e43e0 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:24.782010 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c615971d-0c1e-4589-9b06-aba5f31e43e0 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:24.782582 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c615971d-0c1e-4589-9b06-aba5f31e43e0 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:24.783631 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c615971d-0c1e-4589-9b06-aba5f31e43e0 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:24.784342 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c615971d-0c1e-4589-9b06-aba5f31e43e0 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:24.785161 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c615971d-0c1e-4589-9b06-aba5f31e43e0 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:24.790643 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-98354455-0822-4b36-aad3-12103042b5ce tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:24.791724 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-98354455-0822-4b36-aad3-12103042b5ce tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: da3360d3-ca0b-4077-af3e-92731700dada] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:24.801787 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-98354455-0822-4b36-aad3-12103042b5ce tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:24.802820 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-98354455-0822-4b36-aad3-12103042b5ce tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:24.804274 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-98354455-0822-4b36-aad3-12103042b5ce tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:24.806071 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-98354455-0822-4b36-aad3-12103042b5ce tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:24.808808 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-98354455-0822-4b36-aad3-12103042b5ce tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:24.810707 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-98354455-0822-4b36-aad3-12103042b5ce tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:24.878897 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c615971d-0c1e-4589-9b06-aba5f31e43e0 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce351a48282492e8cd69b9a5a05f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5514904d799d4f5dae454193e70d85f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:24.888238 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c615971d-0c1e-4589-9b06-aba5f31e43e0 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] 10.222.0.20 "GET /compute/v2.1/servers/2023265c-1a97-4ed8-8af7-f83077e4bfa5" status: 200 len: 1163 microversion: 2.1 time: 0.123343 Oct 27 03:30:24.902058 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1236/2523] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:24 2022] GET /compute/v2.1/servers/2023265c-1a97-4ed8-8af7-f83077e4bfa5 => generated 1163 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:24.902058 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-424d57cc-310e-4cd1-b81c-0dbeec02bca5 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:24.902058 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-424d57cc-310e-4cd1-b81c-0dbeec02bca5 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] [instance: ba3e02bc-d621-49e5-8e81-0d33828d816f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:24.902058 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:30:24.902058 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-424d57cc-310e-4cd1-b81c-0dbeec02bca5 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:24.902058 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-424d57cc-310e-4cd1-b81c-0dbeec02bca5 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:24.902058 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-424d57cc-310e-4cd1-b81c-0dbeec02bca5 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:24.902702 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-424d57cc-310e-4cd1-b81c-0dbeec02bca5 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:24.903487 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-424d57cc-310e-4cd1-b81c-0dbeec02bca5 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:24.904114 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-424d57cc-310e-4cd1-b81c-0dbeec02bca5 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:24.988984 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-98354455-0822-4b36-aad3-12103042b5ce tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:24.997353 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-98354455-0822-4b36-aad3-12103042b5ce tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/da3360d3-ca0b-4077-af3e-92731700dada" status: 200 len: 1499 microversion: 2.1 time: 0.226540 Oct 27 03:30:25.004866 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1288/2524] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:24 2022] GET /compute/v2.1/servers/da3360d3-ca0b-4077-af3e-92731700dada => generated 1499 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:25.004866 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a228d07c-f7d8-43d6-9ce0-ba50a0e66ed4 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:25.004866 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a228d07c-f7d8-43d6-9ce0-ba50a0e66ed4 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: 339287fc-37b6-455d-96ab-08ab8e2c3e68] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:25.009594 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a228d07c-f7d8-43d6-9ce0-ba50a0e66ed4 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:25.010265 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a228d07c-f7d8-43d6-9ce0-ba50a0e66ed4 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:25.010716 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a228d07c-f7d8-43d6-9ce0-ba50a0e66ed4 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:25.011412 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a228d07c-f7d8-43d6-9ce0-ba50a0e66ed4 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:25.011869 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a228d07c-f7d8-43d6-9ce0-ba50a0e66ed4 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:25.012297 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a228d07c-f7d8-43d6-9ce0-ba50a0e66ed4 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:25.069553 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-424d57cc-310e-4cd1-b81c-0dbeec02bca5 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e64f7f0501454fa8474aa61c9a8c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561891c49901486c9d7651688f88b0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:25.077588 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-424d57cc-310e-4cd1-b81c-0dbeec02bca5 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] 10.222.0.20 "GET /compute/v2.1/servers/ba3e02bc-d621-49e5-8e81-0d33828d816f" status: 200 len: 1526 microversion: 2.1 time: 0.187513 Oct 27 03:30:25.078292 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1237/2525] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:24 2022] GET /compute/v2.1/servers/ba3e02bc-d621-49e5-8e81-0d33828d816f => generated 1526 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:25.084745 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9dd469b4-915f-42e7-b05d-6ff9bd4a7082 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:25.085412 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9dd469b4-915f-42e7-b05d-6ff9bd4a7082 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: d5e6f604-9466-45c6-86a8-885cfb393223] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:25.092103 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9dd469b4-915f-42e7-b05d-6ff9bd4a7082 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:25.093879 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9dd469b4-915f-42e7-b05d-6ff9bd4a7082 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:25.094507 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9dd469b4-915f-42e7-b05d-6ff9bd4a7082 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:25.095308 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9dd469b4-915f-42e7-b05d-6ff9bd4a7082 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:25.095779 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9dd469b4-915f-42e7-b05d-6ff9bd4a7082 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:25.096216 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9dd469b4-915f-42e7-b05d-6ff9bd4a7082 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:25.187667 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a228d07c-f7d8-43d6-9ce0-ba50a0e66ed4 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13e05e253c94aadb1c089128ff35be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8510a519f14deea6f35a437419e161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:25.198578 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a228d07c-f7d8-43d6-9ce0-ba50a0e66ed4 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68" status: 200 len: 1469 microversion: 2.1 time: 0.199471 Oct 27 03:30:25.199167 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1289/2526] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:24 2022] GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68 => generated 1469 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:25.228294 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-053cb7f8-60be-4eea-a09d-eddd24e6e8cd tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:25.228929 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-053cb7f8-60be-4eea-a09d-eddd24e6e8cd tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] [instance: b0c6560f-ade1-4ae6-905e-ad488f4c3b51] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:25.290716 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-053cb7f8-60be-4eea-a09d-eddd24e6e8cd tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cd1938c86a4f389a2ec0fba9beff36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd0392257a0419dbfa569c8816ece2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:25.297971 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-053cb7f8-60be-4eea-a09d-eddd24e6e8cd tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] 10.222.0.20 "GET /compute/v2.1/servers/b0c6560f-ade1-4ae6-905e-ad488f4c3b51" status: 200 len: 1217 microversion: 2.1 time: 0.076112 Oct 27 03:30:25.298593 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1290/2527] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:25 2022] GET /compute/v2.1/servers/b0c6560f-ade1-4ae6-905e-ad488f4c3b51 => generated 1217 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:25.312254 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-aebc74e7-01d1-4088-b3d6-c532c676e393 req-ad0fd9d9-e890-4886-ae66-36a78c15c836 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "339287fc-37b6-455d-96ab-08ab8e2c3e68", "name": "network-vif-deleted", "tag": "b6134fcc-5cb7-4dad-a3b5-156ca229326d"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:30:25.324055 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-aebc74e7-01d1-4088-b3d6-c532c676e393 req-ad0fd9d9-e890-4886-ae66-36a78c15c836 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:25.324828 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-aebc74e7-01d1-4088-b3d6-c532c676e393 req-ad0fd9d9-e890-4886-ae66-36a78c15c836 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:25.325485 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-aebc74e7-01d1-4088-b3d6-c532c676e393 req-ad0fd9d9-e890-4886-ae66-36a78c15c836 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:25.330086 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:30:25.337316 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-aebc74e7-01d1-4088-b3d6-c532c676e393 req-ad0fd9d9-e890-4886-ae66-36a78c15c836 service nova] Creating event network-vif-deleted:b6134fcc-5cb7-4dad-a3b5-156ca229326d for instance 339287fc-37b6-455d-96ab-08ab8e2c3e68 on n-h2-862769-1 Oct 27 03:30:25.343126 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-aebc74e7-01d1-4088-b3d6-c532c676e393 req-ad0fd9d9-e890-4886-ae66-36a78c15c836 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043116 Oct 27 03:30:25.345013 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1291/2528] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:30:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:30:25.351833 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6a8204e6-cce2-47a2-a6a7-0a6ace6c3ed1 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:25.352780 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-6a8204e6-cce2-47a2-a6a7-0a6ace6c3ed1 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] [instance: 04477d51-f600-483a-aec9-feb992cc6cf7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:25.359611 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6a8204e6-cce2-47a2-a6a7-0a6ace6c3ed1 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:25.360280 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6a8204e6-cce2-47a2-a6a7-0a6ace6c3ed1 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:25.360732 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6a8204e6-cce2-47a2-a6a7-0a6ace6c3ed1 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:25.361466 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6a8204e6-cce2-47a2-a6a7-0a6ace6c3ed1 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:25.361906 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6a8204e6-cce2-47a2-a6a7-0a6ace6c3ed1 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:25.362949 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6a8204e6-cce2-47a2-a6a7-0a6ace6c3ed1 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:25.380419 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9dd469b4-915f-42e7-b05d-6ff9bd4a7082 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:25.390793 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9dd469b4-915f-42e7-b05d-6ff9bd4a7082 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:25.392689 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9dd469b4-915f-42e7-b05d-6ff9bd4a7082 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:25.394558 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9dd469b4-915f-42e7-b05d-6ff9bd4a7082 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223" status: 200 len: 1487 microversion: 2.25 time: 0.315151 Oct 27 03:30:25.396042 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1238/2529] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:30:25 2022] GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223 => generated 1487 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:30:25.536276 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6a8204e6-cce2-47a2-a6a7-0a6ace6c3ed1 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421d14944da74570a53d620ea205449d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92082c8718aa41bf96cd84d682d75954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:25.544072 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6a8204e6-cce2-47a2-a6a7-0a6ace6c3ed1 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] 10.222.0.20 "GET /compute/v2.1/servers/04477d51-f600-483a-aec9-feb992cc6cf7" status: 200 len: 1647 microversion: 2.1 time: 0.197813 Oct 27 03:30:25.544646 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1292/2530] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:25 2022] GET /compute/v2.1/servers/04477d51-f600-483a-aec9-feb992cc6cf7 => generated 1647 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:25.916778 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7a9930e5-d473-4eb7-bb0e-0c4bbba3eaa1 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:25.917628 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7a9930e5-d473-4eb7-bb0e-0c4bbba3eaa1 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] [instance: 2023265c-1a97-4ed8-8af7-f83077e4bfa5] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:25.925566 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7a9930e5-d473-4eb7-bb0e-0c4bbba3eaa1 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:25.926078 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7a9930e5-d473-4eb7-bb0e-0c4bbba3eaa1 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:25.926634 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7a9930e5-d473-4eb7-bb0e-0c4bbba3eaa1 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:25.927450 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7a9930e5-d473-4eb7-bb0e-0c4bbba3eaa1 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:25.927906 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7a9930e5-d473-4eb7-bb0e-0c4bbba3eaa1 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:25.928336 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7a9930e5-d473-4eb7-bb0e-0c4bbba3eaa1 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:26.021958 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a22db69c-905a-420f-883d-e4308d8a4308 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:26.022607 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a22db69c-905a-420f-883d-e4308d8a4308 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: da3360d3-ca0b-4077-af3e-92731700dada] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:26.028426 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7a9930e5-d473-4eb7-bb0e-0c4bbba3eaa1 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce351a48282492e8cd69b9a5a05f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5514904d799d4f5dae454193e70d85f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:26.030132 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a22db69c-905a-420f-883d-e4308d8a4308 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:26.030778 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a22db69c-905a-420f-883d-e4308d8a4308 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:26.031364 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a22db69c-905a-420f-883d-e4308d8a4308 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:26.032411 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a22db69c-905a-420f-883d-e4308d8a4308 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:26.033007 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a22db69c-905a-420f-883d-e4308d8a4308 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:26.033850 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a22db69c-905a-420f-883d-e4308d8a4308 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:26.039558 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7a9930e5-d473-4eb7-bb0e-0c4bbba3eaa1 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] 10.222.0.20 "GET /compute/v2.1/servers/2023265c-1a97-4ed8-8af7-f83077e4bfa5" status: 200 len: 1219 microversion: 2.1 time: 0.127711 Oct 27 03:30:26.050322 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1239/2531] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:25 2022] GET /compute/v2.1/servers/2023265c-1a97-4ed8-8af7-f83077e4bfa5 => generated 1219 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:26.103367 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7788028a-c783-407c-8c6f-4555e4810619 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:26.104103 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7788028a-c783-407c-8c6f-4555e4810619 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] [instance: ba3e02bc-d621-49e5-8e81-0d33828d816f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:26.111726 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7788028a-c783-407c-8c6f-4555e4810619 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:26.113766 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7788028a-c783-407c-8c6f-4555e4810619 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:26.113766 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7788028a-c783-407c-8c6f-4555e4810619 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:26.114330 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7788028a-c783-407c-8c6f-4555e4810619 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:26.114807 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7788028a-c783-407c-8c6f-4555e4810619 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:26.115298 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7788028a-c783-407c-8c6f-4555e4810619 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:26.345166 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a22db69c-905a-420f-883d-e4308d8a4308 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:26.363599 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a22db69c-905a-420f-883d-e4308d8a4308 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/da3360d3-ca0b-4077-af3e-92731700dada" status: 200 len: 1499 microversion: 2.1 time: 0.346465 Oct 27 03:30:26.364495 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1293/2532] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:26 2022] GET /compute/v2.1/servers/da3360d3-ca0b-4077-af3e-92731700dada => generated 1499 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:30:26.369566 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0f72bb20-ee8b-4b5a-8c71-b0a37a3b7fc6 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:26.370647 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0f72bb20-ee8b-4b5a-8c71-b0a37a3b7fc6 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: 339287fc-37b6-455d-96ab-08ab8e2c3e68] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:26.377057 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0f72bb20-ee8b-4b5a-8c71-b0a37a3b7fc6 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:26.377958 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0f72bb20-ee8b-4b5a-8c71-b0a37a3b7fc6 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:26.378808 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0f72bb20-ee8b-4b5a-8c71-b0a37a3b7fc6 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:26.379756 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0f72bb20-ee8b-4b5a-8c71-b0a37a3b7fc6 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:26.380484 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0f72bb20-ee8b-4b5a-8c71-b0a37a3b7fc6 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:26.381117 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0f72bb20-ee8b-4b5a-8c71-b0a37a3b7fc6 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:26.449884 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0f72bb20-ee8b-4b5a-8c71-b0a37a3b7fc6 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:26.451188 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0f72bb20-ee8b-4b5a-8c71-b0a37a3b7fc6 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:26.451843 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0f72bb20-ee8b-4b5a-8c71-b0a37a3b7fc6 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:26.459329 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-0f72bb20-ee8b-4b5a-8c71-b0a37a3b7fc6 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lazy-loading 'fault' on Instance uuid 339287fc-37b6-455d-96ab-08ab8e2c3e68 {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:30:26.558300 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7788028a-c783-407c-8c6f-4555e4810619 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e64f7f0501454fa8474aa61c9a8c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561891c49901486c9d7651688f88b0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:26.562342 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0f72bb20-ee8b-4b5a-8c71-b0a37a3b7fc6 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13e05e253c94aadb1c089128ff35be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8510a519f14deea6f35a437419e161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:26.571892 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0f72bb20-ee8b-4b5a-8c71-b0a37a3b7fc6 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68" status: 200 len: 1304 microversion: 2.1 time: 0.206221 Oct 27 03:30:26.572610 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1294/2533] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:26 2022] GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68 => generated 1304 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:26.574399 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7788028a-c783-407c-8c6f-4555e4810619 tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] 10.222.0.20 "GET /compute/v2.1/servers/ba3e02bc-d621-49e5-8e81-0d33828d816f" status: 200 len: 1526 microversion: 2.1 time: 0.476274 Oct 27 03:30:26.575175 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1240/2534] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:26 2022] GET /compute/v2.1/servers/ba3e02bc-d621-49e5-8e81-0d33828d816f => generated 1526 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:26.582464 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5a7024ce-59ed-4bed-bf1f-319062670c93 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:26.583521 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5a7024ce-59ed-4bed-bf1f-319062670c93 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] [instance: b0c6560f-ade1-4ae6-905e-ad488f4c3b51] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:26.595098 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5a7024ce-59ed-4bed-bf1f-319062670c93 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:26.596444 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5a7024ce-59ed-4bed-bf1f-319062670c93 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:26.597166 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5a7024ce-59ed-4bed-bf1f-319062670c93 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:26.597997 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5a7024ce-59ed-4bed-bf1f-319062670c93 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:26.598146 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-36d91785-5842-45c6-9e1b-c7fd00f08d08 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:26.598667 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5a7024ce-59ed-4bed-bf1f-319062670c93 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:26.598927 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-36d91785-5842-45c6-9e1b-c7fd00f08d08 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: d5e6f604-9466-45c6-86a8-885cfb393223] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:26.599427 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5a7024ce-59ed-4bed-bf1f-319062670c93 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:26.605354 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-36d91785-5842-45c6-9e1b-c7fd00f08d08 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:26.606127 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-36d91785-5842-45c6-9e1b-c7fd00f08d08 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:26.607339 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-36d91785-5842-45c6-9e1b-c7fd00f08d08 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:26.608067 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-36d91785-5842-45c6-9e1b-c7fd00f08d08 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:26.608531 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-36d91785-5842-45c6-9e1b-c7fd00f08d08 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:26.609368 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-36d91785-5842-45c6-9e1b-c7fd00f08d08 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:26.617136 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:30:26.703245 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5a7024ce-59ed-4bed-bf1f-319062670c93 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cd1938c86a4f389a2ec0fba9beff36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd0392257a0419dbfa569c8816ece2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:26.719413 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5a7024ce-59ed-4bed-bf1f-319062670c93 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] 10.222.0.20 "GET /compute/v2.1/servers/b0c6560f-ade1-4ae6-905e-ad488f4c3b51" status: 200 len: 1213 microversion: 2.1 time: 0.142844 Oct 27 03:30:26.721084 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1295/2535] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:26 2022] GET /compute/v2.1/servers/b0c6560f-ade1-4ae6-905e-ad488f4c3b51 => generated 1213 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:26.750305 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-122738d9-fc16-41e6-8a9c-13538534763e tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:26.751040 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-122738d9-fc16-41e6-8a9c-13538534763e tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] [instance: 04477d51-f600-483a-aec9-feb992cc6cf7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:26.765247 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-122738d9-fc16-41e6-8a9c-13538534763e tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:26.765768 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-122738d9-fc16-41e6-8a9c-13538534763e tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:26.766241 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-122738d9-fc16-41e6-8a9c-13538534763e tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:26.766985 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-122738d9-fc16-41e6-8a9c-13538534763e tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:26.767618 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-122738d9-fc16-41e6-8a9c-13538534763e tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:26.768068 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-122738d9-fc16-41e6-8a9c-13538534763e tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:26.820381 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-36d91785-5842-45c6-9e1b-c7fd00f08d08 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:26.830447 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-36d91785-5842-45c6-9e1b-c7fd00f08d08 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:26.835781 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-36d91785-5842-45c6-9e1b-c7fd00f08d08 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:26.839313 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-36d91785-5842-45c6-9e1b-c7fd00f08d08 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223" status: 200 len: 1487 microversion: 2.25 time: 0.259430 Oct 27 03:30:26.839313 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1241/2536] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:30:26 2022] GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223 => generated 1487 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:30:26.843684 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-122738d9-fc16-41e6-8a9c-13538534763e tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:26.844373 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-122738d9-fc16-41e6-8a9c-13538534763e tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:26.844881 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-122738d9-fc16-41e6-8a9c-13538534763e tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:26.845468 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-122738d9-fc16-41e6-8a9c-13538534763e tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lazy-loading 'fault' on Instance uuid 04477d51-f600-483a-aec9-feb992cc6cf7 {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:30:26.906148 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-122738d9-fc16-41e6-8a9c-13538534763e tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421d14944da74570a53d620ea205449d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92082c8718aa41bf96cd84d682d75954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:26.920598 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-122738d9-fc16-41e6-8a9c-13538534763e tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] 10.222.0.20 "GET /compute/v2.1/servers/04477d51-f600-483a-aec9-feb992cc6cf7" status: 200 len: 1306 microversion: 2.1 time: 0.181884 Oct 27 03:30:26.921190 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1296/2537] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:26 2022] GET /compute/v2.1/servers/04477d51-f600-483a-aec9-feb992cc6cf7 => generated 1306 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:27.076738 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3d5ec239-3eb3-485e-a057-2e7d68fda280 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:27.077342 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-3d5ec239-3eb3-485e-a057-2e7d68fda280 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] [instance: 2023265c-1a97-4ed8-8af7-f83077e4bfa5] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:27.106087 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3d5ec239-3eb3-485e-a057-2e7d68fda280 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:27.106678 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3d5ec239-3eb3-485e-a057-2e7d68fda280 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:27.107121 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3d5ec239-3eb3-485e-a057-2e7d68fda280 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:27.108354 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3d5ec239-3eb3-485e-a057-2e7d68fda280 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:27.111074 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3d5ec239-3eb3-485e-a057-2e7d68fda280 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:27.111424 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3d5ec239-3eb3-485e-a057-2e7d68fda280 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:27.125975 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-6c2c9509-dfca-417a-82b1-4256b43e64a6 req-8fb364e7-dbe6-487b-968a-427e736f4e92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba3e02bc-d621-49e5-8e81-0d33828d816f", "name": "network-vif-deleted", "tag": "c4245fca-d73e-4082-8c2c-d2a10511c5ee"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:30:27.137435 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-6c2c9509-dfca-417a-82b1-4256b43e64a6 req-8fb364e7-dbe6-487b-968a-427e736f4e92 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:27.138301 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-6c2c9509-dfca-417a-82b1-4256b43e64a6 req-8fb364e7-dbe6-487b-968a-427e736f4e92 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:27.139070 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-6c2c9509-dfca-417a-82b1-4256b43e64a6 req-8fb364e7-dbe6-487b-968a-427e736f4e92 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:27.156105 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-6c2c9509-dfca-417a-82b1-4256b43e64a6 req-8fb364e7-dbe6-487b-968a-427e736f4e92 service nova] Creating event network-vif-deleted:c4245fca-d73e-4082-8c2c-d2a10511c5ee for instance ba3e02bc-d621-49e5-8e81-0d33828d816f on n-h2-862769-1 Oct 27 03:30:27.163819 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-6c2c9509-dfca-417a-82b1-4256b43e64a6 req-8fb364e7-dbe6-487b-968a-427e736f4e92 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041394 Oct 27 03:30:27.169486 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1297/2538] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:30:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:30:27.319933 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-3d5ec239-3eb3-485e-a057-2e7d68fda280 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce351a48282492e8cd69b9a5a05f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5514904d799d4f5dae454193e70d85f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:27.328126 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3d5ec239-3eb3-485e-a057-2e7d68fda280 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] 10.222.0.20 "GET /compute/v2.1/servers/2023265c-1a97-4ed8-8af7-f83077e4bfa5" status: 200 len: 1227 microversion: 2.1 time: 0.261185 Oct 27 03:30:27.329155 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1242/2539] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:27 2022] GET /compute/v2.1/servers/2023265c-1a97-4ed8-8af7-f83077e4bfa5 => generated 1227 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:27.389387 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-797a2e23-3ef0-47d6-8973-a58896b79763 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:27.390437 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-1c1d719b-c824-46be-af9f-10b8a4cea76e req-5ee31074-f68d-4292-a555-4b44e1fc4c5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04477d51-f600-483a-aec9-feb992cc6cf7", "name": "network-vif-deleted", "tag": "5bbab630-1088-4a87-96b5-3098b0dbf41f"}, {"server_uuid": "da3360d3-ca0b-4077-af3e-92731700dada", "name": "network-vif-deleted", "tag": "83172e3e-d564-4455-bfff-b4d4868ccf0d"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:30:27.390570 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-797a2e23-3ef0-47d6-8973-a58896b79763 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: da3360d3-ca0b-4077-af3e-92731700dada] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:27.401436 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-797a2e23-3ef0-47d6-8973-a58896b79763 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:27.407134 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-797a2e23-3ef0-47d6-8973-a58896b79763 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:27.407134 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-797a2e23-3ef0-47d6-8973-a58896b79763 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:27.407134 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-797a2e23-3ef0-47d6-8973-a58896b79763 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:27.407483 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-1c1d719b-c824-46be-af9f-10b8a4cea76e req-5ee31074-f68d-4292-a555-4b44e1fc4c5d service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:27.407584 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-797a2e23-3ef0-47d6-8973-a58896b79763 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:27.407689 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-1c1d719b-c824-46be-af9f-10b8a4cea76e req-5ee31074-f68d-4292-a555-4b44e1fc4c5d service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:27.407772 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-797a2e23-3ef0-47d6-8973-a58896b79763 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:27.407851 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-1c1d719b-c824-46be-af9f-10b8a4cea76e req-5ee31074-f68d-4292-a555-4b44e1fc4c5d service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:27.424311 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-1c1d719b-c824-46be-af9f-10b8a4cea76e req-5ee31074-f68d-4292-a555-4b44e1fc4c5d service nova] Creating event network-vif-deleted:5bbab630-1088-4a87-96b5-3098b0dbf41f for instance 04477d51-f600-483a-aec9-feb992cc6cf7 on n-h1-862769-1 Oct 27 03:30:27.425612 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-1c1d719b-c824-46be-af9f-10b8a4cea76e req-5ee31074-f68d-4292-a555-4b44e1fc4c5d service nova] Creating event network-vif-deleted:83172e3e-d564-4455-bfff-b4d4868ccf0d for instance da3360d3-ca0b-4077-af3e-92731700dada on n-h1-862769-1 Oct 27 03:30:27.432287 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-1c1d719b-c824-46be-af9f-10b8a4cea76e req-5ee31074-f68d-4292-a555-4b44e1fc4c5d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.046914 Oct 27 03:30:27.436706 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1243/2540] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:30:27 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:30:27.451950 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-797a2e23-3ef0-47d6-8973-a58896b79763 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:27.452727 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-797a2e23-3ef0-47d6-8973-a58896b79763 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:27.453179 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-797a2e23-3ef0-47d6-8973-a58896b79763 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:27.453671 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-797a2e23-3ef0-47d6-8973-a58896b79763 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lazy-loading 'fault' on Instance uuid da3360d3-ca0b-4077-af3e-92731700dada {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:30:27.507054 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-797a2e23-3ef0-47d6-8973-a58896b79763 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:27.518090 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-797a2e23-3ef0-47d6-8973-a58896b79763 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/da3360d3-ca0b-4077-af3e-92731700dada" status: 200 len: 1300 microversion: 2.1 time: 0.135123 Oct 27 03:30:27.518740 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1298/2541] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:27 2022] GET /compute/v2.1/servers/da3360d3-ca0b-4077-af3e-92731700dada => generated 1300 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:27.606988 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-74f4d9b5-4d7a-47ba-8f85-d079de9d31da tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:27.609110 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b31ae729-05b6-4969-90fd-89e5b4a9fdeb tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:27.610333 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-74f4d9b5-4d7a-47ba-8f85-d079de9d31da tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] [instance: ba3e02bc-d621-49e5-8e81-0d33828d816f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:27.614869 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b31ae729-05b6-4969-90fd-89e5b4a9fdeb tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: 339287fc-37b6-455d-96ab-08ab8e2c3e68] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:27.627253 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-74f4d9b5-4d7a-47ba-8f85-d079de9d31da tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:27.627975 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-74f4d9b5-4d7a-47ba-8f85-d079de9d31da tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:27.628578 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-74f4d9b5-4d7a-47ba-8f85-d079de9d31da tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:27.629611 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b31ae729-05b6-4969-90fd-89e5b4a9fdeb tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:27.630545 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-74f4d9b5-4d7a-47ba-8f85-d079de9d31da tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:27.630990 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-74f4d9b5-4d7a-47ba-8f85-d079de9d31da tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:27.631430 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-74f4d9b5-4d7a-47ba-8f85-d079de9d31da tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:27.634850 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b31ae729-05b6-4969-90fd-89e5b4a9fdeb tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:27.635277 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b31ae729-05b6-4969-90fd-89e5b4a9fdeb tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:27.636039 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b31ae729-05b6-4969-90fd-89e5b4a9fdeb tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:27.636634 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b31ae729-05b6-4969-90fd-89e5b4a9fdeb tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:27.637239 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b31ae729-05b6-4969-90fd-89e5b4a9fdeb tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:27.702442 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b31ae729-05b6-4969-90fd-89e5b4a9fdeb tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:27.703253 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b31ae729-05b6-4969-90fd-89e5b4a9fdeb tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:27.703688 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b31ae729-05b6-4969-90fd-89e5b4a9fdeb tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:27.704114 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-74f4d9b5-4d7a-47ba-8f85-d079de9d31da tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:27.704620 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-b31ae729-05b6-4969-90fd-89e5b4a9fdeb tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lazy-loading 'fault' on Instance uuid 339287fc-37b6-455d-96ab-08ab8e2c3e68 {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:30:27.704737 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-74f4d9b5-4d7a-47ba-8f85-d079de9d31da tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:27.705202 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-74f4d9b5-4d7a-47ba-8f85-d079de9d31da tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:27.705702 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-74f4d9b5-4d7a-47ba-8f85-d079de9d31da tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Lazy-loading 'fault' on Instance uuid ba3e02bc-d621-49e5-8e81-0d33828d816f {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:30:27.837173 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-74f4d9b5-4d7a-47ba-8f85-d079de9d31da tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e64f7f0501454fa8474aa61c9a8c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561891c49901486c9d7651688f88b0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:27.851537 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-74f4d9b5-4d7a-47ba-8f85-d079de9d31da tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] 10.222.0.20 "GET /compute/v2.1/servers/ba3e02bc-d621-49e5-8e81-0d33828d816f" status: 200 len: 1313 microversion: 2.1 time: 0.255935 Oct 27 03:30:27.854520 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1299/2542] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:27 2022] GET /compute/v2.1/servers/ba3e02bc-d621-49e5-8e81-0d33828d816f => generated 1313 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:27.865578 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1bb9b177-3a76-4823-9d37-219fd6c4ab2c tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:27.866543 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1bb9b177-3a76-4823-9d37-219fd6c4ab2c tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] [instance: b0c6560f-ade1-4ae6-905e-ad488f4c3b51] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:27.877396 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1bb9b177-3a76-4823-9d37-219fd6c4ab2c tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:27.878185 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1bb9b177-3a76-4823-9d37-219fd6c4ab2c tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:27.878801 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1bb9b177-3a76-4823-9d37-219fd6c4ab2c tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:27.880040 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1bb9b177-3a76-4823-9d37-219fd6c4ab2c tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:27.880719 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1bb9b177-3a76-4823-9d37-219fd6c4ab2c tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:27.881292 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1bb9b177-3a76-4823-9d37-219fd6c4ab2c tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:27.983729 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1bb9b177-3a76-4823-9d37-219fd6c4ab2c tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cd1938c86a4f389a2ec0fba9beff36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd0392257a0419dbfa569c8816ece2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:27.994278 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1bb9b177-3a76-4823-9d37-219fd6c4ab2c tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] 10.222.0.20 "GET /compute/v2.1/servers/b0c6560f-ade1-4ae6-905e-ad488f4c3b51" status: 200 len: 1213 microversion: 2.1 time: 0.138050 Oct 27 03:30:27.995782 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1300/2543] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:27 2022] GET /compute/v2.1/servers/b0c6560f-ade1-4ae6-905e-ad488f4c3b51 => generated 1213 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:28.004438 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ce386435-d563-4269-a343-dbc353706f01 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:28.006597 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ce386435-d563-4269-a343-dbc353706f01 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: d5e6f604-9466-45c6-86a8-885cfb393223] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:28.022710 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ce386435-d563-4269-a343-dbc353706f01 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:28.024319 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ce386435-d563-4269-a343-dbc353706f01 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:28.025662 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ce386435-d563-4269-a343-dbc353706f01 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:28.027550 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ce386435-d563-4269-a343-dbc353706f01 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:28.029540 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ce386435-d563-4269-a343-dbc353706f01 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:28.030596 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ce386435-d563-4269-a343-dbc353706f01 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:28.235744 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b31ae729-05b6-4969-90fd-89e5b4a9fdeb tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13e05e253c94aadb1c089128ff35be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8510a519f14deea6f35a437419e161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:28.250697 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b31ae729-05b6-4969-90fd-89e5b4a9fdeb tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68" status: 200 len: 1304 microversion: 2.1 time: 0.658936 Oct 27 03:30:28.266822 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1244/2544] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:27 2022] GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68 => generated 1304 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:28.276805 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5249c2c4-e800-42ba-a56c-d35a01b9621c tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:28.277800 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5249c2c4-e800-42ba-a56c-d35a01b9621c tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] [instance: 04477d51-f600-483a-aec9-feb992cc6cf7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:28.286344 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5249c2c4-e800-42ba-a56c-d35a01b9621c tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:28.287263 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5249c2c4-e800-42ba-a56c-d35a01b9621c tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:28.287892 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5249c2c4-e800-42ba-a56c-d35a01b9621c tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:28.289491 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5249c2c4-e800-42ba-a56c-d35a01b9621c tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:28.290215 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5249c2c4-e800-42ba-a56c-d35a01b9621c tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:28.290862 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5249c2c4-e800-42ba-a56c-d35a01b9621c tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:28.312877 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-5249c2c4-e800-42ba-a56c-d35a01b9621c tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] HTTP exception thrown: Instance 04477d51-f600-483a-aec9-feb992cc6cf7 could not be found. Oct 27 03:30:28.315117 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5249c2c4-e800-42ba-a56c-d35a01b9621c tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Request method failure captured: Oct 27 03:30:28.315117 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/04477d51-f600-483a-aec9-feb992cc6cf7 HTTP/1.1 Oct 27 03:30:28.315117 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:30:28.315117 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:30:28.315117 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:30:28.315117 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:30:28.315117 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:30:28.315117 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:30:28.315117 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:30:28.315117 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:30:28.315117 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfsDm0Py_zt25h362jzfO2BV3foI0uyhpjoORk0IBXpXJDIOp5L0sBs5ZGjH5wntvfF1YWko5rdp9M7xGcdJ8XvPLxOQRZn1LZea5O-2FHM2FJsNqsONwbzuZ-uFy7VwM4IakmeqODIMdeP73cGPmeJKxcyXnuTU87F5wWBu1IQyRCI Oct 27 03:30:28.315117 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:30:28.315117 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:30:28.315117 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:30:28.315117 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:30:28.315117 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:30:28.315117 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:30:28.315117 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 92082c8718aa41bf96cd84d682d75954 Oct 27 03:30:28.315117 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-SecurityGroupsTestJSON-1273178137 Oct 27 03:30:28.315117 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:30:28.315117 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:30:28.315117 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/92082c8718aa41bf96cd84d682d75954"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/92082c8718aa41bf96cd84d682d75954"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/92082c8718aa41bf96cd84d682d75954"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_92082c8718aa41bf96cd84d682d75954"}]}] Oct 27 03:30:28.315117 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-SecurityGroupsTestJSON-1273178137 Oct 27 03:30:28.315117 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 92082c8718aa41bf96cd84d682d75954 Oct 27 03:30:28.315117 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1273178137 Oct 27 03:30:28.315117 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-SecurityGroupsTestJSON-1273178137-project Oct 27 03:30:28.315117 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:30:28.315117 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:30:28.315117 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 421d14944da74570a53d620ea205449d Oct 27 03:30:28.315117 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-SecurityGroupsTestJSON-1273178137-project Oct 27 03:30:28.315117 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:30:28.315117 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 04477d51-f600-483a-aec9-feb992cc6cf7 could not be found. Oct 27 03:30:28.315117 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '04477d51-f600-483a-aec9-feb992cc6cf7'} Oct 27 03:30:28.315117 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:30:28.315117 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:28.315117 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:30:28.315117 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:30:28.315117 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:30:28.315117 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:30:28.315117 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:30:28.315117 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:30:28.315117 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:30:28.315117 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:30:28.315117 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04477d51-f600-483a-aec9-feb992cc6cf7 could not be found. Oct 27 03:30:28.315117 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:28.315117 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:30:28.315117 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:28.315117 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:28.315117 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:30:28.315117 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:30:28.315117 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:30:28.315117 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:30:28.315117 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:30:28.315117 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:30:28.315117 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:30:28.315117 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:30:28.315117 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:30:28.315117 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:30:28.315117 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:30:28.315117 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:30:28.315117 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04477d51-f600-483a-aec9-feb992cc6cf7 could not be found. Oct 27 03:30:28.315117 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:28.315117 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:30:28.315117 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:28.320543 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:28.320543 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:30:28.320543 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:30:28.320543 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:30:28.320543 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:30:28.320543 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04477d51-f600-483a-aec9-feb992cc6cf7 could not be found. Oct 27 03:30:28.320543 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:28.322300 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5249c2c4-e800-42ba-a56c-d35a01b9621c tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Returning 404 to user: Instance 04477d51-f600-483a-aec9-feb992cc6cf7 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:30:28.323784 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5249c2c4-e800-42ba-a56c-d35a01b9621c tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] 10.222.0.20 "GET /compute/v2.1/servers/04477d51-f600-483a-aec9-feb992cc6cf7" status: 404 len: 111 microversion: 2.1 time: 0.055680 Oct 27 03:30:28.325770 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1245/2545] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:28 2022] GET /compute/v2.1/servers/04477d51-f600-483a-aec9-feb992cc6cf7 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:30:28.361733 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ce386435-d563-4269-a343-dbc353706f01 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:28.363784 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ecfc3fcb-2b9c-4ce8-8a30-b069701f23e6 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Calling method '.version_select at 0x7f7dda03c670>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:28.379529 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ce386435-d563-4269-a343-dbc353706f01 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:28.383220 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ce386435-d563-4269-a343-dbc353706f01 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:28.397401 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ce386435-d563-4269-a343-dbc353706f01 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223" status: 200 len: 1477 microversion: 2.25 time: 0.387632 Oct 27 03:30:28.406949 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1301/2546] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:30:27 2022] GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223 => generated 1477 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:30:28.416287 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e4bfa8f3-40ef-4776-ba27-03f545e39437 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:28.417469 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e4bfa8f3-40ef-4776-ba27-03f545e39437 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] [instance: 2023265c-1a97-4ed8-8af7-f83077e4bfa5] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:28.430917 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e4bfa8f3-40ef-4776-ba27-03f545e39437 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:28.431812 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e4bfa8f3-40ef-4776-ba27-03f545e39437 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:28.432762 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e4bfa8f3-40ef-4776-ba27-03f545e39437 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:28.434134 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e4bfa8f3-40ef-4776-ba27-03f545e39437 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:28.434802 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e4bfa8f3-40ef-4776-ba27-03f545e39437 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:28.435432 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e4bfa8f3-40ef-4776-ba27-03f545e39437 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:28.546161 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e4bfa8f3-40ef-4776-ba27-03f545e39437 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce351a48282492e8cd69b9a5a05f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5514904d799d4f5dae454193e70d85f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:28.559439 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e4bfa8f3-40ef-4776-ba27-03f545e39437 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] 10.222.0.20 "GET /compute/v2.1/servers/2023265c-1a97-4ed8-8af7-f83077e4bfa5" status: 200 len: 1237 microversion: 2.1 time: 0.148633 Oct 27 03:30:28.560382 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1302/2547] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:28 2022] GET /compute/v2.1/servers/2023265c-1a97-4ed8-8af7-f83077e4bfa5 => generated 1237 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:28.565932 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-05c6e3be-23ad-4262-b006-7fa6fbebc519 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Calling method '.version_select at 0x7f7ddede7940>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:28.569591 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-05c6e3be-23ad-4262-b006-7fa6fbebc519 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:28.570100 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-05c6e3be-23ad-4262-b006-7fa6fbebc519 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:28.571398 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-05c6e3be-23ad-4262-b006-7fa6fbebc519 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:28.583209 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-05c6e3be-23ad-4262-b006-7fa6fbebc519 tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 2364 microversion: 2.25 time: 0.021339 Oct 27 03:30:28.584175 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1303/2548] 10.222.0.20 () {60 vars in 1184 bytes} [Thu Oct 27 03:30:28 2022] GET /compute/v2.1/os-migrations => generated 2364 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:30:28.589463 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-284e0f9d-307c-41ec-ad3f-9357e1dc3e24 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:28.590457 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-284e0f9d-307c-41ec-ad3f-9357e1dc3e24 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: da3360d3-ca0b-4077-af3e-92731700dada] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:28.600400 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-284e0f9d-307c-41ec-ad3f-9357e1dc3e24 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:28.600980 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-284e0f9d-307c-41ec-ad3f-9357e1dc3e24 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:28.601640 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-284e0f9d-307c-41ec-ad3f-9357e1dc3e24 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:28.602431 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-284e0f9d-307c-41ec-ad3f-9357e1dc3e24 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:28.603013 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-284e0f9d-307c-41ec-ad3f-9357e1dc3e24 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:28.603714 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-284e0f9d-307c-41ec-ad3f-9357e1dc3e24 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:28.676803 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-284e0f9d-307c-41ec-ad3f-9357e1dc3e24 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:28.677227 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-284e0f9d-307c-41ec-ad3f-9357e1dc3e24 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:28.677667 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-284e0f9d-307c-41ec-ad3f-9357e1dc3e24 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:28.678327 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-284e0f9d-307c-41ec-ad3f-9357e1dc3e24 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lazy-loading 'fault' on Instance uuid da3360d3-ca0b-4077-af3e-92731700dada {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:30:28.727191 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-284e0f9d-307c-41ec-ad3f-9357e1dc3e24 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c93886c5818439690564c2299a4f3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee7e66f16e4ed5b49394311bd2803a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:28.740165 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-284e0f9d-307c-41ec-ad3f-9357e1dc3e24 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/da3360d3-ca0b-4077-af3e-92731700dada" status: 200 len: 1300 microversion: 2.1 time: 0.154365 Oct 27 03:30:28.754647 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1304/2549] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:28 2022] GET /compute/v2.1/servers/da3360d3-ca0b-4077-af3e-92731700dada => generated 1300 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:28.763525 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-03b78a0f-f110-4b75-9dc7-7cb1427759bd tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:28.764832 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-03b78a0f-f110-4b75-9dc7-7cb1427759bd tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] [instance: d5e6f604-9466-45c6-86a8-885cfb393223] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:28.772825 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-03b78a0f-f110-4b75-9dc7-7cb1427759bd tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:28.774844 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-03b78a0f-f110-4b75-9dc7-7cb1427759bd tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:28.775574 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-03b78a0f-f110-4b75-9dc7-7cb1427759bd tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:28.776665 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-03b78a0f-f110-4b75-9dc7-7cb1427759bd tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:28.779044 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-03b78a0f-f110-4b75-9dc7-7cb1427759bd tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:28.779721 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-03b78a0f-f110-4b75-9dc7-7cb1427759bd tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:29.017525 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-03b78a0f-f110-4b75-9dc7-7cb1427759bd tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] Lazy-loading 'services' on Instance uuid d5e6f604-9466-45c6-86a8-885cfb393223 {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:30:29.047435 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-03b78a0f-f110-4b75-9dc7-7cb1427759bd tempest-LiveAutoBlockMigrationV225Test-1658920940 tempest-LiveAutoBlockMigrationV225Test-1658920940-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223" status: 200 len: 1970 microversion: 2.25 time: 0.291049 Oct 27 03:30:29.063944 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1305/2550] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:30:28 2022] GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223 => generated 1970 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:30:29.063944 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-581bddd1-ce7a-43dd-962d-e85516e8ab9b tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:29.063944 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-581bddd1-ce7a-43dd-962d-e85516e8ab9b tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] [instance: ba3e02bc-d621-49e5-8e81-0d33828d816f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:29.076746 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-581bddd1-ce7a-43dd-962d-e85516e8ab9b tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:29.077626 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-581bddd1-ce7a-43dd-962d-e85516e8ab9b tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:29.087839 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-581bddd1-ce7a-43dd-962d-e85516e8ab9b tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:29.093336 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-581bddd1-ce7a-43dd-962d-e85516e8ab9b tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:29.093336 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-581bddd1-ce7a-43dd-962d-e85516e8ab9b tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:29.093856 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-581bddd1-ce7a-43dd-962d-e85516e8ab9b tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:29.107040 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ecfc3fcb-2b9c-4ce8-8a30-b069701f23e6 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/9c3c1208-d0fd-42fc-8007-73f03701f25e" status: 202 len: 0 microversion: 2.1 time: 0.761087 Oct 27 03:30:29.111332 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1246/2551] 10.222.0.20 () {58 vars in 1272 bytes} [Thu Oct 27 03:30:28 2022] DELETE /compute/v2.1/os-security-groups/9c3c1208-d0fd-42fc-8007-73f03701f25e => generated 0 bytes in 771 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:30:29.124691 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-cd08619f-f127-44e2-bc53-69108a37e8a7 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:29.125324 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-cd08619f-f127-44e2-bc53-69108a37e8a7 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] [instance: b0c6560f-ade1-4ae6-905e-ad488f4c3b51] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:29.141468 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cd08619f-f127-44e2-bc53-69108a37e8a7 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:29.141970 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cd08619f-f127-44e2-bc53-69108a37e8a7 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:29.142591 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cd08619f-f127-44e2-bc53-69108a37e8a7 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:29.145236 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cd08619f-f127-44e2-bc53-69108a37e8a7 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:29.145980 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cd08619f-f127-44e2-bc53-69108a37e8a7 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:29.147383 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cd08619f-f127-44e2-bc53-69108a37e8a7 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:29.179850 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-581bddd1-ce7a-43dd-962d-e85516e8ab9b tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:29.180162 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-581bddd1-ce7a-43dd-962d-e85516e8ab9b tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:29.182813 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-581bddd1-ce7a-43dd-962d-e85516e8ab9b tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:29.183506 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-581bddd1-ce7a-43dd-962d-e85516e8ab9b tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Lazy-loading 'fault' on Instance uuid ba3e02bc-d621-49e5-8e81-0d33828d816f {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:30:29.281624 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-581bddd1-ce7a-43dd-962d-e85516e8ab9b tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e64f7f0501454fa8474aa61c9a8c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561891c49901486c9d7651688f88b0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:29.295585 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-581bddd1-ce7a-43dd-962d-e85516e8ab9b tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] 10.222.0.20 "GET /compute/v2.1/servers/ba3e02bc-d621-49e5-8e81-0d33828d816f" status: 200 len: 1313 microversion: 2.1 time: 0.244072 Oct 27 03:30:29.309625 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-cd08619f-f127-44e2-bc53-69108a37e8a7 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cd1938c86a4f389a2ec0fba9beff36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd0392257a0419dbfa569c8816ece2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:29.327170 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-cd08619f-f127-44e2-bc53-69108a37e8a7 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] 10.222.0.20 "GET /compute/v2.1/servers/b0c6560f-ade1-4ae6-905e-ad488f4c3b51" status: 200 len: 1277 microversion: 2.1 time: 0.193865 Oct 27 03:30:29.327265 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1306/2552] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:29 2022] GET /compute/v2.1/servers/ba3e02bc-d621-49e5-8e81-0d33828d816f => generated 1313 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:29.327339 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1247/2553] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:29 2022] GET /compute/v2.1/servers/b0c6560f-ade1-4ae6-905e-ad488f4c3b51 => generated 1277 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:29.327405 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-63d3e153-3930-4117-bff5-c68bb520cd31 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:29.330778 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-63d3e153-3930-4117-bff5-c68bb520cd31 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: d5e6f604-9466-45c6-86a8-885cfb393223] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:29.338293 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a93534f1-217d-404d-856d-c588b7e514ee tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Calling method '.version_select at 0x7f7ddb002a60>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:29.344499 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:30:29.347788 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-63d3e153-3930-4117-bff5-c68bb520cd31 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:29.350358 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-63d3e153-3930-4117-bff5-c68bb520cd31 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:29.350955 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-63d3e153-3930-4117-bff5-c68bb520cd31 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:29.352506 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-63d3e153-3930-4117-bff5-c68bb520cd31 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:29.353143 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-63d3e153-3930-4117-bff5-c68bb520cd31 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:29.353730 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-63d3e153-3930-4117-bff5-c68bb520cd31 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:29.391960 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=100 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:30:29.409747 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-63d3e153-3930-4117-bff5-c68bb520cd31 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: d5e6f604-9466-45c6-86a8-885cfb393223] Going to try to terminate instance {{(pid=121001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:30:29.825303 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-63d3e153-3930-4117-bff5-c68bb520cd31 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223" status: 204 len: 0 microversion: 2.25 time: 0.511899 Oct 27 03:30:29.828848 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1307/2554] 10.222.0.20 () {60 vars in 1280 bytes} [Thu Oct 27 03:30:29 2022] DELETE /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 03:30:29.834244 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-23c54469-0f4f-4061-939d-b4c7ceb0ae65 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:29.840605 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-23c54469-0f4f-4061-939d-b4c7ceb0ae65 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] [instance: 339287fc-37b6-455d-96ab-08ab8e2c3e68] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:29.854138 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-23c54469-0f4f-4061-939d-b4c7ceb0ae65 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:29.854636 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-23c54469-0f4f-4061-939d-b4c7ceb0ae65 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:29.855074 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-23c54469-0f4f-4061-939d-b4c7ceb0ae65 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:29.855783 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-23c54469-0f4f-4061-939d-b4c7ceb0ae65 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:29.857319 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-23c54469-0f4f-4061-939d-b4c7ceb0ae65 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:29.859535 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-23c54469-0f4f-4061-939d-b4c7ceb0ae65 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:29.890603 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-23c54469-0f4f-4061-939d-b4c7ceb0ae65 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] HTTP exception thrown: Instance 339287fc-37b6-455d-96ab-08ab8e2c3e68 could not be found. Oct 27 03:30:29.892663 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-23c54469-0f4f-4061-939d-b4c7ceb0ae65 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Request method failure captured: Oct 27 03:30:29.892663 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68 HTTP/1.1 Oct 27 03:30:29.892663 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:30:29.892663 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:30:29.892663 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:30:29.892663 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:30:29.892663 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:30:29.892663 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:30:29.892663 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:30:29.892663 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:30:29.892663 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfqe_f6klSBWxgHJhrkMKU1jjTutLzdS5yP5cVaJx7CD4SpsaA9eFzNBelj8Df37AqQIauKmTdjEzxZfV-SkZsp-fdTJEBQmTQbH47veq0MyVE5xHm_0xRuqrKEixJ6MNqSyPaMFYb1G1FwqsXy7fj3afl8K-QHetdJvpDiWZ49aVxw Oct 27 03:30:29.892663 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:30:29.892663 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:30:29.892663 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:30:29.892663 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:30:29.892663 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:30:29.892663 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:30:29.892663 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 2c8510a519f14deea6f35a437419e161 Oct 27 03:30:29.892663 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServersAdminTestJSON-1349869830 Oct 27 03:30:29.892663 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:30:29.892663 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:30:29.892663 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c8510a519f14deea6f35a437419e161"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2c8510a519f14deea6f35a437419e161"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c8510a519f14deea6f35a437419e161"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2c8510a519f14deea6f35a437419e161"}]}] Oct 27 03:30:29.892663 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServersAdminTestJSON-1349869830 Oct 27 03:30:29.892663 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 2c8510a519f14deea6f35a437419e161 Oct 27 03:30:29.892663 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServersAdminTestJSON-1349869830 Oct 27 03:30:29.892663 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServersAdminTestJSON-1349869830-project Oct 27 03:30:29.892663 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:30:29.892663 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:30:29.892663 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: c13e05e253c94aadb1c089128ff35be5 Oct 27 03:30:29.892663 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServersAdminTestJSON-1349869830-project Oct 27 03:30:29.892663 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:30:29.892663 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 339287fc-37b6-455d-96ab-08ab8e2c3e68 could not be found. Oct 27 03:30:29.892663 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '339287fc-37b6-455d-96ab-08ab8e2c3e68'} Oct 27 03:30:29.892663 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:30:29.892663 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:29.892663 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:30:29.892663 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:30:29.892663 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:30:29.892663 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:30:29.892663 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:30:29.892663 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:30:29.892663 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:30:29.892663 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:30:29.892663 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 339287fc-37b6-455d-96ab-08ab8e2c3e68 could not be found. Oct 27 03:30:29.892663 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:29.892663 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:30:29.892663 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:29.892663 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:29.892663 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:30:29.892663 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:30:29.892663 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:30:29.892663 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:30:29.892663 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:30:29.892663 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:30:29.892663 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:30:29.892663 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:30:29.892663 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:30:29.892663 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:30:29.892663 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:30:29.892663 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:30:29.892663 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 339287fc-37b6-455d-96ab-08ab8e2c3e68 could not be found. Oct 27 03:30:29.892663 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:29.892663 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:30:29.892663 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:29.897478 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:29.897478 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:30:29.897478 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:30:29.897478 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:30:29.897478 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:30:29.897478 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 339287fc-37b6-455d-96ab-08ab8e2c3e68 could not be found. Oct 27 03:30:29.897478 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:29.897478 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-23c54469-0f4f-4061-939d-b4c7ceb0ae65 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] Returning 404 to user: Instance 339287fc-37b6-455d-96ab-08ab8e2c3e68 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:30:29.898440 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-23c54469-0f4f-4061-939d-b4c7ceb0ae65 tempest-ServersAdminTestJSON-1349869830 tempest-ServersAdminTestJSON-1349869830-project] 10.222.0.20 "GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68" status: 404 len: 111 microversion: 2.1 time: 0.066575 Oct 27 03:30:29.900950 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1308/2555] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:29 2022] GET /compute/v2.1/servers/339287fc-37b6-455d-96ab-08ab8e2c3e68 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:30:29.907990 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7e6d3b8a-0eda-466c-87c4-223d53f80555 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:29.908870 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7e6d3b8a-0eda-466c-87c4-223d53f80555 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] [instance: 2023265c-1a97-4ed8-8af7-f83077e4bfa5] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:29.919170 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7e6d3b8a-0eda-466c-87c4-223d53f80555 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:29.920085 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7e6d3b8a-0eda-466c-87c4-223d53f80555 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:29.920527 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7e6d3b8a-0eda-466c-87c4-223d53f80555 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:29.922123 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7e6d3b8a-0eda-466c-87c4-223d53f80555 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:29.922580 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7e6d3b8a-0eda-466c-87c4-223d53f80555 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:29.923512 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7e6d3b8a-0eda-466c-87c4-223d53f80555 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:29.948826 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a93534f1-217d-404d-856d-c588b7e514ee tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/362204bb-f331-489e-bb41-766f010c5078" status: 202 len: 0 microversion: 2.1 time: 0.633769 Oct 27 03:30:29.952114 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1248/2556] 10.222.0.20 () {58 vars in 1272 bytes} [Thu Oct 27 03:30:29 2022] DELETE /compute/v2.1/os-security-groups/362204bb-f331-489e-bb41-766f010c5078 => generated 0 bytes in 638 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:30:29.971109 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-11f86d18-686e-4ee8-ba1f-caa3310a1fb4 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:29.971109 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-11f86d18-686e-4ee8-ba1f-caa3310a1fb4 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] [instance: da3360d3-ca0b-4077-af3e-92731700dada] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:29.976659 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-11f86d18-686e-4ee8-ba1f-caa3310a1fb4 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:29.982155 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-11f86d18-686e-4ee8-ba1f-caa3310a1fb4 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:29.984678 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-11f86d18-686e-4ee8-ba1f-caa3310a1fb4 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:29.985668 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-11f86d18-686e-4ee8-ba1f-caa3310a1fb4 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:29.986445 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-11f86d18-686e-4ee8-ba1f-caa3310a1fb4 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:29.987650 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-11f86d18-686e-4ee8-ba1f-caa3310a1fb4 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:30.023459 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-11f86d18-686e-4ee8-ba1f-caa3310a1fb4 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] HTTP exception thrown: Instance da3360d3-ca0b-4077-af3e-92731700dada could not be found. Oct 27 03:30:30.028314 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-11f86d18-686e-4ee8-ba1f-caa3310a1fb4 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Request method failure captured: Oct 27 03:30:30.028314 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/da3360d3-ca0b-4077-af3e-92731700dada HTTP/1.1 Oct 27 03:30:30.028314 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:30:30.028314 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:30:30.028314 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:30:30.028314 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:30:30.028314 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:30:30.028314 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:30:30.028314 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:30:30.028314 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:30:30.028314 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWflpDYfIGjZv42nta44cUKr4gfgFkHcAeVM8yamczRS9hHsDVo2rsQnCdKSUZqn3ZmcXBvUrwb61kAyQ6DVfG99X5r7udSMUTUj-TX444bEUorFGQKwimw1hyhYRTrQq-ZUKWv2S3u5J0WvKPFUznz1pJqOrfpEn__pIwU22_EAMjAc Oct 27 03:30:30.028314 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:30:30.028314 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:30:30.028314 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:30:30.028314 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:30:30.028314 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:30:30.028314 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:30:30.028314 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: aaee7e66f16e4ed5b49394311bd2803a Oct 27 03:30:30.028314 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-LiveMigrationTest-428698375 Oct 27 03:30:30.028314 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:30:30.028314 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:30:30.028314 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aaee7e66f16e4ed5b49394311bd2803a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/aaee7e66f16e4ed5b49394311bd2803a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aaee7e66f16e4ed5b49394311bd2803a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_aaee7e66f16e4ed5b49394311bd2803a"}]}] Oct 27 03:30:30.028314 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-LiveMigrationTest-428698375 Oct 27 03:30:30.028314 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: aaee7e66f16e4ed5b49394311bd2803a Oct 27 03:30:30.028314 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-LiveMigrationTest-428698375 Oct 27 03:30:30.028314 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-LiveMigrationTest-428698375-project Oct 27 03:30:30.028314 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:30:30.028314 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:30:30.028314 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 8c93886c5818439690564c2299a4f3ee Oct 27 03:30:30.028314 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-LiveMigrationTest-428698375-project Oct 27 03:30:30.028314 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:30:30.028314 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance da3360d3-ca0b-4077-af3e-92731700dada could not be found. Oct 27 03:30:30.028314 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': 'da3360d3-ca0b-4077-af3e-92731700dada'} Oct 27 03:30:30.028314 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:30:30.028314 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:30.028314 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:30:30.028314 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:30:30.028314 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:30:30.028314 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:30:30.028314 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:30:30.028314 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:30:30.028314 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:30:30.028314 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:30:30.028314 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da3360d3-ca0b-4077-af3e-92731700dada could not be found. Oct 27 03:30:30.028314 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:30.028314 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:30:30.028314 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:30.028314 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:30.028314 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:30:30.028314 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:30:30.028314 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:30:30.028314 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:30:30.028314 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:30:30.028314 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:30:30.028314 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:30:30.028314 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:30:30.028314 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:30:30.028314 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:30:30.028314 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:30:30.028314 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:30:30.028314 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da3360d3-ca0b-4077-af3e-92731700dada could not be found. Oct 27 03:30:30.028314 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:30.028314 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:30:30.028314 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:30.038535 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:30.038535 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:30:30.038535 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:30:30.038535 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:30:30.038535 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:30:30.038535 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da3360d3-ca0b-4077-af3e-92731700dada could not be found. Oct 27 03:30:30.038535 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:30.038535 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-11f86d18-686e-4ee8-ba1f-caa3310a1fb4 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] Returning 404 to user: Instance da3360d3-ca0b-4077-af3e-92731700dada could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:30:30.038535 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-11f86d18-686e-4ee8-ba1f-caa3310a1fb4 tempest-LiveMigrationTest-428698375 tempest-LiveMigrationTest-428698375-project] 10.222.0.20 "GET /compute/v2.1/servers/da3360d3-ca0b-4077-af3e-92731700dada" status: 404 len: 111 microversion: 2.1 time: 0.076124 Oct 27 03:30:30.043436 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1249/2557] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:29 2022] GET /compute/v2.1/servers/da3360d3-ca0b-4077-af3e-92731700dada => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:30:30.067913 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-07275033-3b9f-4a63-ac01-0a33c170fded tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:30.071546 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-07275033-3b9f-4a63-ac01-0a33c170fded tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: d5e6f604-9466-45c6-86a8-885cfb393223] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:30.089121 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-07275033-3b9f-4a63-ac01-0a33c170fded tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:30.091671 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-07275033-3b9f-4a63-ac01-0a33c170fded tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:30.093403 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-07275033-3b9f-4a63-ac01-0a33c170fded tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:30.094861 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-07275033-3b9f-4a63-ac01-0a33c170fded tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:30.095593 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-07275033-3b9f-4a63-ac01-0a33c170fded tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:30.099748 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-07275033-3b9f-4a63-ac01-0a33c170fded tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:30.289087 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7e6d3b8a-0eda-466c-87c4-223d53f80555 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce351a48282492e8cd69b9a5a05f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5514904d799d4f5dae454193e70d85f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:30.304422 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7e6d3b8a-0eda-466c-87c4-223d53f80555 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] 10.222.0.20 "GET /compute/v2.1/servers/2023265c-1a97-4ed8-8af7-f83077e4bfa5" status: 200 len: 1305 microversion: 2.1 time: 0.401847 Oct 27 03:30:30.305589 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1309/2558] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:29 2022] GET /compute/v2.1/servers/2023265c-1a97-4ed8-8af7-f83077e4bfa5 => generated 1305 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:30.310618 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-bc7baaeb-1532-46cd-a94e-f262fb0173b6 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Action: 'create', calling method: .version_select at 0x7f7dd9fa15e0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1816312157", "description": "tempest-description-1822760454"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:30:30.719668 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-07275033-3b9f-4a63-ac01-0a33c170fded tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:30.739339 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-07275033-3b9f-4a63-ac01-0a33c170fded tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:30.752607 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-07275033-3b9f-4a63-ac01-0a33c170fded tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:30.752607 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-07275033-3b9f-4a63-ac01-0a33c170fded tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223" status: 200 len: 1483 microversion: 2.25 time: 0.697085 Oct 27 03:30:30.752607 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1250/2559] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:30:30 2022] GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223 => generated 1483 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:30:30.758240 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3e006a70-3286-445c-8f7d-40bb020e20ca tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:30.758683 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-3e006a70-3286-445c-8f7d-40bb020e20ca tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] [instance: ba3e02bc-d621-49e5-8e81-0d33828d816f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:30.766791 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3e006a70-3286-445c-8f7d-40bb020e20ca tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:30.767305 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3e006a70-3286-445c-8f7d-40bb020e20ca tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:30.774569 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3e006a70-3286-445c-8f7d-40bb020e20ca tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:30.775424 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3e006a70-3286-445c-8f7d-40bb020e20ca tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:30.775918 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3e006a70-3286-445c-8f7d-40bb020e20ca tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:30.776376 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3e006a70-3286-445c-8f7d-40bb020e20ca tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:30.816423 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-3e006a70-3286-445c-8f7d-40bb020e20ca tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] HTTP exception thrown: Instance ba3e02bc-d621-49e5-8e81-0d33828d816f could not be found. Oct 27 03:30:30.824007 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3e006a70-3286-445c-8f7d-40bb020e20ca tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Request method failure captured: Oct 27 03:30:30.824007 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/ba3e02bc-d621-49e5-8e81-0d33828d816f HTTP/1.1 Oct 27 03:30:30.824007 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:30:30.824007 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:30:30.824007 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:30:30.824007 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:30:30.824007 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:30:30.824007 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:30:30.824007 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:30:30.824007 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:30:30.824007 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfs6dOxiCwUy1YeuqkkBeJZvU6IOok0wlgx7U5glXh8BkugpZvpPhk7CB8YcGlAcSxjz24lBx4SXLw8P0YKTw_jr3AcfEsDkm2DGlMLoZj9oU2ekFEQqaDiRlXLm8wFvaTxrjQX68ly-cZVGlGdXdCnortY0dhH0h5-Gl28G9y_zvyk Oct 27 03:30:30.824007 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:30:30.824007 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:30:30.824007 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:30:30.824007 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:30:30.824007 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:30:30.824007 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:30:30.824007 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 561891c49901486c9d7651688f88b0eb Oct 27 03:30:30.824007 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1729127104 Oct 27 03:30:30.824007 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:30:30.824007 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:30:30.824007 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/561891c49901486c9d7651688f88b0eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/561891c49901486c9d7651688f88b0eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/561891c49901486c9d7651688f88b0eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_561891c49901486c9d7651688f88b0eb"}]}] Oct 27 03:30:30.824007 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1729127104 Oct 27 03:30:30.824007 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 561891c49901486c9d7651688f88b0eb Oct 27 03:30:30.824007 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1729127104 Oct 27 03:30:30.824007 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ServerAddressesNegativeTestJSON-1729127104-project Oct 27 03:30:30.824007 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:30:30.824007 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:30:30.824007 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: c3e64f7f0501454fa8474aa61c9a8c5b Oct 27 03:30:30.824007 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1729127104-project Oct 27 03:30:30.824007 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:30:30.824007 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance ba3e02bc-d621-49e5-8e81-0d33828d816f could not be found. Oct 27 03:30:30.824007 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': 'ba3e02bc-d621-49e5-8e81-0d33828d816f'} Oct 27 03:30:30.824007 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:30:30.824007 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:30.824007 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:30:30.824007 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:30:30.824007 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:30:30.824007 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:30:30.824007 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:30:30.824007 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:30:30.824007 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:30:30.824007 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:30:30.824007 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba3e02bc-d621-49e5-8e81-0d33828d816f could not be found. Oct 27 03:30:30.824007 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:30.824007 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:30:30.824007 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:30.824007 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:30.824007 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:30:30.824007 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:30:30.824007 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:30:30.824007 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:30:30.824007 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:30:30.824007 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:30:30.824007 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:30:30.824007 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:30:30.824007 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:30:30.824007 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:30:30.824007 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:30:30.824007 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:30:30.824007 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba3e02bc-d621-49e5-8e81-0d33828d816f could not be found. Oct 27 03:30:30.824007 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:30.824007 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:30:30.833138 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:30.833138 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:30.833138 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:30:30.833138 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:30:30.833138 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:30:30.833138 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:30:30.833138 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba3e02bc-d621-49e5-8e81-0d33828d816f could not be found. Oct 27 03:30:30.833138 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:30.833138 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3e006a70-3286-445c-8f7d-40bb020e20ca tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] Returning 404 to user: Instance ba3e02bc-d621-49e5-8e81-0d33828d816f could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:30:30.833138 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3e006a70-3286-445c-8f7d-40bb020e20ca tempest-ServerAddressesNegativeTestJSON-1729127104 tempest-ServerAddressesNegativeTestJSON-1729127104-project] 10.222.0.20 "GET /compute/v2.1/servers/ba3e02bc-d621-49e5-8e81-0d33828d816f" status: 404 len: 111 microversion: 2.1 time: 0.082459 Oct 27 03:30:30.833138 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1251/2560] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:30 2022] GET /compute/v2.1/servers/ba3e02bc-d621-49e5-8e81-0d33828d816f => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:30:30.846369 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f7fd7891-56a9-44ef-abbc-03a87ad54c87 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:30.848155 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f7fd7891-56a9-44ef-abbc-03a87ad54c87 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] [instance: b0c6560f-ade1-4ae6-905e-ad488f4c3b51] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:30.862955 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f7fd7891-56a9-44ef-abbc-03a87ad54c87 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:30.863832 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f7fd7891-56a9-44ef-abbc-03a87ad54c87 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:30.865968 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f7fd7891-56a9-44ef-abbc-03a87ad54c87 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:30.867121 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f7fd7891-56a9-44ef-abbc-03a87ad54c87 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:30.868177 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f7fd7891-56a9-44ef-abbc-03a87ad54c87 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:30.869071 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f7fd7891-56a9-44ef-abbc-03a87ad54c87 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:31.114831 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f7fd7891-56a9-44ef-abbc-03a87ad54c87 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cd1938c86a4f389a2ec0fba9beff36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd0392257a0419dbfa569c8816ece2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:31.126766 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-bc7baaeb-1532-46cd-a94e-f262fb0173b6 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.819540 Oct 27 03:30:31.127226 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1310/2561] 10.222.0.20 () {60 vars in 1180 bytes} [Thu Oct 27 03:30:30 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:30:31.146174 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f7fd7891-56a9-44ef-abbc-03a87ad54c87 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] 10.222.0.20 "GET /compute/v2.1/servers/b0c6560f-ade1-4ae6-905e-ad488f4c3b51" status: 200 len: 1275 microversion: 2.1 time: 0.293392 Oct 27 03:30:31.146174 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1252/2562] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:30 2022] GET /compute/v2.1/servers/b0c6560f-ade1-4ae6-905e-ad488f4c3b51 => generated 1275 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:31.146378 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1c403de8-219a-4638-902b-e052719598c2 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Action: 'update', calling method: .version_select at 0x7f7dd9fe2f70>, body: {"security_group": {"name": "tempest-sg-hth-1423561656", "description": "tempest-description-hth-856681718"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:30:31.333720 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1207e2d6-c75c-4150-b0a8-df25d2891a65 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:31.334469 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1207e2d6-c75c-4150-b0a8-df25d2891a65 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] [instance: 2023265c-1a97-4ed8-8af7-f83077e4bfa5] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:31.347624 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1207e2d6-c75c-4150-b0a8-df25d2891a65 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:31.348370 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1207e2d6-c75c-4150-b0a8-df25d2891a65 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:31.348964 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1207e2d6-c75c-4150-b0a8-df25d2891a65 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:31.349883 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1207e2d6-c75c-4150-b0a8-df25d2891a65 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:31.350825 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1207e2d6-c75c-4150-b0a8-df25d2891a65 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:31.354606 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1207e2d6-c75c-4150-b0a8-df25d2891a65 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:31.849922 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1c403de8-219a-4638-902b-e052719598c2 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] 10.222.0.20 "PUT /compute/v2.1/os-security-groups/5558a44f-d00f-47ca-a49d-a1a835a8343f" status: 200 len: 217 microversion: 2.1 time: 0.712687 Oct 27 03:30:31.850705 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1311/2563] 10.222.0.20 () {60 vars in 1290 bytes} [Thu Oct 27 03:30:31 2022] PUT /compute/v2.1/os-security-groups/5558a44f-d00f-47ca-a49d-a1a835a8343f => generated 217 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:30:31.867704 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a81a27f6-2bea-4494-b7df-052821a4108e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:31.871225 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a81a27f6-2bea-4494-b7df-052821a4108e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: d5e6f604-9466-45c6-86a8-885cfb393223] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:31.877011 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1207e2d6-c75c-4150-b0a8-df25d2891a65 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce351a48282492e8cd69b9a5a05f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5514904d799d4f5dae454193e70d85f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:31.894405 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1207e2d6-c75c-4150-b0a8-df25d2891a65 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] 10.222.0.20 "GET /compute/v2.1/servers/2023265c-1a97-4ed8-8af7-f83077e4bfa5" status: 200 len: 1305 microversion: 2.1 time: 0.566509 Oct 27 03:30:31.912193 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1253/2564] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:31 2022] GET /compute/v2.1/servers/2023265c-1a97-4ed8-8af7-f83077e4bfa5 => generated 1305 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:30:31.923455 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a81a27f6-2bea-4494-b7df-052821a4108e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:31.925555 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a81a27f6-2bea-4494-b7df-052821a4108e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:31.927862 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a81a27f6-2bea-4494-b7df-052821a4108e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:31.928823 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a81a27f6-2bea-4494-b7df-052821a4108e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:31.929393 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-16dfd3e9-0798-4728-9fe7-51bd0ec9f741 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Calling method '.version_select at 0x7f7dda97e430>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:31.931931 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a81a27f6-2bea-4494-b7df-052821a4108e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:31.933919 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a81a27f6-2bea-4494-b7df-052821a4108e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:32.131184 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a81a27f6-2bea-4494-b7df-052821a4108e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:32.154301 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a81a27f6-2bea-4494-b7df-052821a4108e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:32.156451 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a81a27f6-2bea-4494-b7df-052821a4108e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:32.158742 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a81a27f6-2bea-4494-b7df-052821a4108e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223" status: 200 len: 1441 microversion: 2.25 time: 0.296579 Oct 27 03:30:32.161144 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-16dfd3e9-0798-4728-9fe7-51bd0ec9f741 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups/5558a44f-d00f-47ca-a49d-a1a835a8343f" status: 200 len: 217 microversion: 2.1 time: 0.247523 Oct 27 03:30:32.164863 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1312/2565] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:30:31 2022] GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223 => generated 1441 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:30:32.172546 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1254/2566] 10.222.0.20 () {58 vars in 1269 bytes} [Thu Oct 27 03:30:31 2022] GET /compute/v2.1/os-security-groups/5558a44f-d00f-47ca-a49d-a1a835a8343f => generated 217 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:30:32.173550 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-aa9c9af3-67cc-40cf-8bc0-70d65dfded13 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:32.175758 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-aa9c9af3-67cc-40cf-8bc0-70d65dfded13 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] [instance: b0c6560f-ade1-4ae6-905e-ad488f4c3b51] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:32.183785 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-6369a80c-8aef-4c55-a003-cb792920a983 req-e4fa0e9c-13ad-4408-bc7f-887f332f2a6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5e6f604-9466-45c6-86a8-885cfb393223", "name": "network-vif-deleted", "tag": "6b270560-e2de-41cb-9470-6571434ba8f2"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:30:32.208986 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aa9c9af3-67cc-40cf-8bc0-70d65dfded13 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:32.209745 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aa9c9af3-67cc-40cf-8bc0-70d65dfded13 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:32.210525 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aa9c9af3-67cc-40cf-8bc0-70d65dfded13 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:32.211456 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aa9c9af3-67cc-40cf-8bc0-70d65dfded13 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:32.212983 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aa9c9af3-67cc-40cf-8bc0-70d65dfded13 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:32.213090 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-6369a80c-8aef-4c55-a003-cb792920a983 req-e4fa0e9c-13ad-4408-bc7f-887f332f2a6e service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:32.213090 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-6369a80c-8aef-4c55-a003-cb792920a983 req-e4fa0e9c-13ad-4408-bc7f-887f332f2a6e service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:32.213430 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-6369a80c-8aef-4c55-a003-cb792920a983 req-e4fa0e9c-13ad-4408-bc7f-887f332f2a6e service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:32.222983 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aa9c9af3-67cc-40cf-8bc0-70d65dfded13 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:32.250402 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-6369a80c-8aef-4c55-a003-cb792920a983 req-e4fa0e9c-13ad-4408-bc7f-887f332f2a6e service nova] Creating event network-vif-deleted:6b270560-e2de-41cb-9470-6571434ba8f2 for instance d5e6f604-9466-45c6-86a8-885cfb393223 on n-h2-862769-1 Oct 27 03:30:32.267269 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-6369a80c-8aef-4c55-a003-cb792920a983 req-e4fa0e9c-13ad-4408-bc7f-887f332f2a6e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093239 Oct 27 03:30:32.280365 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1255/2567] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:30:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:30:32.289839 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a85cb983-cfd3-41d7-af34-93b7f72b5ddb tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Calling method '.version_select at 0x7f7dda7a2310>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:32.399766 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-aa9c9af3-67cc-40cf-8bc0-70d65dfded13 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cd1938c86a4f389a2ec0fba9beff36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd0392257a0419dbfa569c8816ece2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:32.423206 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-aa9c9af3-67cc-40cf-8bc0-70d65dfded13 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] 10.222.0.20 "GET /compute/v2.1/servers/b0c6560f-ade1-4ae6-905e-ad488f4c3b51" status: 200 len: 1275 microversion: 2.1 time: 0.256948 Oct 27 03:30:32.423796 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1313/2568] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:32 2022] GET /compute/v2.1/servers/b0c6560f-ade1-4ae6-905e-ad488f4c3b51 => generated 1275 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:32.923778 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7d45e535-90f8-4873-94b6-4036c9c6662c tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:32.925007 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7d45e535-90f8-4873-94b6-4036c9c6662c tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] [instance: 2023265c-1a97-4ed8-8af7-f83077e4bfa5] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:32.959502 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7d45e535-90f8-4873-94b6-4036c9c6662c tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:32.963585 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7d45e535-90f8-4873-94b6-4036c9c6662c tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:32.964903 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7d45e535-90f8-4873-94b6-4036c9c6662c tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:32.968771 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7d45e535-90f8-4873-94b6-4036c9c6662c tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:32.969255 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7d45e535-90f8-4873-94b6-4036c9c6662c tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:32.969695 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7d45e535-90f8-4873-94b6-4036c9c6662c tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:33.392396 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7d45e535-90f8-4873-94b6-4036c9c6662c tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce351a48282492e8cd69b9a5a05f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5514904d799d4f5dae454193e70d85f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:33.405620 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7d45e535-90f8-4873-94b6-4036c9c6662c tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] 10.222.0.20 "GET /compute/v2.1/servers/2023265c-1a97-4ed8-8af7-f83077e4bfa5" status: 200 len: 1305 microversion: 2.1 time: 0.483802 Oct 27 03:30:33.430816 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1314/2569] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:32 2022] GET /compute/v2.1/servers/2023265c-1a97-4ed8-8af7-f83077e4bfa5 => generated 1305 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:33.449038 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a73bab36-f8b6-41cf-9686-aa7c8590ae8f tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:33.449975 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a73bab36-f8b6-41cf-9686-aa7c8590ae8f tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: d5e6f604-9466-45c6-86a8-885cfb393223] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:33.462498 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a73bab36-f8b6-41cf-9686-aa7c8590ae8f tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:33.463260 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a73bab36-f8b6-41cf-9686-aa7c8590ae8f tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:33.463884 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a73bab36-f8b6-41cf-9686-aa7c8590ae8f tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:33.464762 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a73bab36-f8b6-41cf-9686-aa7c8590ae8f tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:33.465373 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a73bab36-f8b6-41cf-9686-aa7c8590ae8f tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:33.465957 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a73bab36-f8b6-41cf-9686-aa7c8590ae8f tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:33.599823 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a73bab36-f8b6-41cf-9686-aa7c8590ae8f tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:33.617067 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a73bab36-f8b6-41cf-9686-aa7c8590ae8f tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:33.619252 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a73bab36-f8b6-41cf-9686-aa7c8590ae8f tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:33.620989 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a73bab36-f8b6-41cf-9686-aa7c8590ae8f tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223" status: 200 len: 1266 microversion: 2.25 time: 0.191183 Oct 27 03:30:33.622050 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1315/2570] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:30:33 2022] GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223 => generated 1266 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:30:33.635572 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-047e4aac-99e8-4888-9eae-30b86ed5217f tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:33.636473 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-047e4aac-99e8-4888-9eae-30b86ed5217f tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] [instance: b0c6560f-ade1-4ae6-905e-ad488f4c3b51] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:33.644851 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-047e4aac-99e8-4888-9eae-30b86ed5217f tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:33.645899 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-047e4aac-99e8-4888-9eae-30b86ed5217f tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:33.646547 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-047e4aac-99e8-4888-9eae-30b86ed5217f tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:33.647422 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-047e4aac-99e8-4888-9eae-30b86ed5217f tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:33.648727 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-047e4aac-99e8-4888-9eae-30b86ed5217f tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:33.649760 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-047e4aac-99e8-4888-9eae-30b86ed5217f tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:33.683505 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=4 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:30:33.910263 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a85cb983-cfd3-41d7-af34-93b7f72b5ddb tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/5558a44f-d00f-47ca-a49d-a1a835a8343f" status: 202 len: 0 microversion: 2.1 time: 1.626946 Oct 27 03:30:33.916380 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1256/2571] 10.222.0.20 () {58 vars in 1272 bytes} [Thu Oct 27 03:30:32 2022] DELETE /compute/v2.1/os-security-groups/5558a44f-d00f-47ca-a49d-a1a835a8343f => generated 0 bytes in 1635 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:30:33.923864 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-cfce370d-2586-489a-8269-e0301176ee28 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:33.929046 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-cfce370d-2586-489a-8269-e0301176ee28 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] [instance: 04477d51-f600-483a-aec9-feb992cc6cf7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:33.951510 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cfce370d-2586-489a-8269-e0301176ee28 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:33.952024 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cfce370d-2586-489a-8269-e0301176ee28 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:33.959127 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cfce370d-2586-489a-8269-e0301176ee28 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:33.960715 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cfce370d-2586-489a-8269-e0301176ee28 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:33.961462 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cfce370d-2586-489a-8269-e0301176ee28 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:33.962112 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cfce370d-2586-489a-8269-e0301176ee28 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:33.996964 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-cfce370d-2586-489a-8269-e0301176ee28 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] HTTP exception thrown: Instance 04477d51-f600-483a-aec9-feb992cc6cf7 could not be found. Oct 27 03:30:34.011513 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-cfce370d-2586-489a-8269-e0301176ee28 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Request method failure captured: Oct 27 03:30:34.011513 n-d-862769-1 devstack@n-api.service[121000]: request: DELETE /compute/v2.1/servers/04477d51-f600-483a-aec9-feb992cc6cf7 HTTP/1.1 Oct 27 03:30:34.011513 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:30:34.011513 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:30:34.011513 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:30:34.011513 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:30:34.011513 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:30:34.011513 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:30:34.011513 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:30:34.011513 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:30:34.011513 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfsDm0Py_zt25h362jzfO2BV3foI0uyhpjoORk0IBXpXJDIOp5L0sBs5ZGjH5wntvfF1YWko5rdp9M7xGcdJ8XvPLxOQRZn1LZea5O-2FHM2FJsNqsONwbzuZ-uFy7VwM4IakmeqODIMdeP73cGPmeJKxcyXnuTU87F5wWBu1IQyRCI Oct 27 03:30:34.011513 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:30:34.011513 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:30:34.011513 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:30:34.011513 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:30:34.011513 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:30:34.011513 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:30:34.011513 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 92082c8718aa41bf96cd84d682d75954 Oct 27 03:30:34.011513 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-SecurityGroupsTestJSON-1273178137 Oct 27 03:30:34.011513 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:30:34.011513 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:30:34.011513 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/92082c8718aa41bf96cd84d682d75954"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/92082c8718aa41bf96cd84d682d75954"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/92082c8718aa41bf96cd84d682d75954"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_92082c8718aa41bf96cd84d682d75954"}]}] Oct 27 03:30:34.011513 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-SecurityGroupsTestJSON-1273178137 Oct 27 03:30:34.011513 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 92082c8718aa41bf96cd84d682d75954 Oct 27 03:30:34.011513 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1273178137 Oct 27 03:30:34.011513 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-SecurityGroupsTestJSON-1273178137-project Oct 27 03:30:34.011513 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:30:34.011513 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:30:34.011513 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 421d14944da74570a53d620ea205449d Oct 27 03:30:34.011513 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-SecurityGroupsTestJSON-1273178137-project Oct 27 03:30:34.011513 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:30:34.011513 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 04477d51-f600-483a-aec9-feb992cc6cf7 could not be found. Oct 27 03:30:34.011513 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '04477d51-f600-483a-aec9-feb992cc6cf7'} Oct 27 03:30:34.011513 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:30:34.011513 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:34.011513 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:30:34.011513 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:30:34.011513 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:30:34.011513 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:30:34.011513 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:30:34.011513 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:30:34.011513 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:30:34.011513 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:30:34.011513 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04477d51-f600-483a-aec9-feb992cc6cf7 could not be found. Oct 27 03:30:34.011513 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:34.011513 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:30:34.011513 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:34.011513 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:34.011513 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:30:34.011513 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:30:34.011513 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:30:34.011513 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:30:34.011513 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:30:34.011513 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:30:34.011513 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 03:30:34.011513 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 03:30:34.011513 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 03:30:34.011513 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 03:30:34.011513 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:30:34.011513 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:30:34.011513 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:30:34.011513 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:30:34.015481 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04477d51-f600-483a-aec9-feb992cc6cf7 could not be found. Oct 27 03:30:34.015481 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:34.015481 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:30:34.015481 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:34.015481 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:34.015481 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:30:34.015481 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:30:34.015481 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:30:34.015481 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:30:34.015481 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04477d51-f600-483a-aec9-feb992cc6cf7 could not be found. Oct 27 03:30:34.015481 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:34.017791 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-cfce370d-2586-489a-8269-e0301176ee28 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Returning 404 to user: Instance 04477d51-f600-483a-aec9-feb992cc6cf7 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:30:34.060244 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-cfce370d-2586-489a-8269-e0301176ee28 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] 10.222.0.20 "DELETE /compute/v2.1/servers/04477d51-f600-483a-aec9-feb992cc6cf7" status: 404 len: 111 microversion: 2.1 time: 0.140961 Oct 27 03:30:34.070449 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1257/2572] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:30:33 2022] DELETE /compute/v2.1/servers/04477d51-f600-483a-aec9-feb992cc6cf7 => generated 111 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:30:34.078117 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-6d52e2c0-a7a9-46c8-988c-6bf595465274 req-ce64a91f-d71a-4300-8bce-cf2213885a14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2023265c-1a97-4ed8-8af7-f83077e4bfa5", "tag": "d7f2255f-3f7c-496f-a704-dc240ed9e307"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:30:34.103312 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-6d52e2c0-a7a9-46c8-988c-6bf595465274 req-ce64a91f-d71a-4300-8bce-cf2213885a14 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:34.104124 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-6d52e2c0-a7a9-46c8-988c-6bf595465274 req-ce64a91f-d71a-4300-8bce-cf2213885a14 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:34.104770 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-6d52e2c0-a7a9-46c8-988c-6bf595465274 req-ce64a91f-d71a-4300-8bce-cf2213885a14 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:34.123047 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-6d52e2c0-a7a9-46c8-988c-6bf595465274 req-ce64a91f-d71a-4300-8bce-cf2213885a14 service nova] Creating event network-changed:d7f2255f-3f7c-496f-a704-dc240ed9e307 for instance 2023265c-1a97-4ed8-8af7-f83077e4bfa5 on n-h2-862769-1 Oct 27 03:30:34.132168 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-6d52e2c0-a7a9-46c8-988c-6bf595465274 req-ce64a91f-d71a-4300-8bce-cf2213885a14 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058951 Oct 27 03:30:34.133547 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1258/2573] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:30:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:30:34.140750 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-775300b6-4cf1-493f-94c1-6418161fea13 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:34.141856 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-775300b6-4cf1-493f-94c1-6418161fea13 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] [instance: 04477d51-f600-483a-aec9-feb992cc6cf7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:34.151574 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-775300b6-4cf1-493f-94c1-6418161fea13 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:34.152305 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-775300b6-4cf1-493f-94c1-6418161fea13 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:34.152956 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-775300b6-4cf1-493f-94c1-6418161fea13 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:34.153885 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-775300b6-4cf1-493f-94c1-6418161fea13 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:34.154605 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-775300b6-4cf1-493f-94c1-6418161fea13 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:34.155257 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-775300b6-4cf1-493f-94c1-6418161fea13 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:34.170856 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-775300b6-4cf1-493f-94c1-6418161fea13 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] HTTP exception thrown: Instance 04477d51-f600-483a-aec9-feb992cc6cf7 could not be found. Oct 27 03:30:34.175972 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-775300b6-4cf1-493f-94c1-6418161fea13 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Request method failure captured: Oct 27 03:30:34.175972 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/04477d51-f600-483a-aec9-feb992cc6cf7 HTTP/1.1 Oct 27 03:30:34.175972 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:30:34.175972 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:30:34.175972 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:30:34.175972 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:30:34.175972 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:30:34.175972 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:30:34.175972 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:30:34.175972 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:30:34.175972 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfsDm0Py_zt25h362jzfO2BV3foI0uyhpjoORk0IBXpXJDIOp5L0sBs5ZGjH5wntvfF1YWko5rdp9M7xGcdJ8XvPLxOQRZn1LZea5O-2FHM2FJsNqsONwbzuZ-uFy7VwM4IakmeqODIMdeP73cGPmeJKxcyXnuTU87F5wWBu1IQyRCI Oct 27 03:30:34.175972 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:30:34.175972 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:30:34.175972 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:30:34.175972 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:30:34.175972 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:30:34.175972 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:30:34.175972 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 92082c8718aa41bf96cd84d682d75954 Oct 27 03:30:34.175972 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-SecurityGroupsTestJSON-1273178137 Oct 27 03:30:34.175972 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:30:34.175972 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:30:34.175972 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/92082c8718aa41bf96cd84d682d75954"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/92082c8718aa41bf96cd84d682d75954"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/92082c8718aa41bf96cd84d682d75954"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_92082c8718aa41bf96cd84d682d75954"}]}] Oct 27 03:30:34.175972 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-SecurityGroupsTestJSON-1273178137 Oct 27 03:30:34.175972 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 92082c8718aa41bf96cd84d682d75954 Oct 27 03:30:34.175972 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1273178137 Oct 27 03:30:34.175972 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-SecurityGroupsTestJSON-1273178137-project Oct 27 03:30:34.175972 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:30:34.175972 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:30:34.175972 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 421d14944da74570a53d620ea205449d Oct 27 03:30:34.175972 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-SecurityGroupsTestJSON-1273178137-project Oct 27 03:30:34.175972 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:30:34.175972 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 04477d51-f600-483a-aec9-feb992cc6cf7 could not be found. Oct 27 03:30:34.175972 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '04477d51-f600-483a-aec9-feb992cc6cf7'} Oct 27 03:30:34.175972 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:30:34.175972 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:34.175972 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:30:34.175972 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:30:34.175972 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:30:34.175972 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:30:34.175972 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:30:34.175972 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:30:34.175972 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:30:34.175972 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:30:34.175972 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04477d51-f600-483a-aec9-feb992cc6cf7 could not be found. Oct 27 03:30:34.175972 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:34.175972 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:30:34.175972 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:34.175972 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:34.175972 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:30:34.175972 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:30:34.175972 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:30:34.175972 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:30:34.175972 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:30:34.175972 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:30:34.175972 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:30:34.175972 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:30:34.175972 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:30:34.175972 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:30:34.175972 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:30:34.175972 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:30:34.175972 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04477d51-f600-483a-aec9-feb992cc6cf7 could not be found. Oct 27 03:30:34.175972 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:34.175972 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:30:34.175972 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:34.179457 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:34.179457 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:30:34.179457 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:30:34.179457 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:30:34.179457 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:30:34.179457 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04477d51-f600-483a-aec9-feb992cc6cf7 could not be found. Oct 27 03:30:34.179457 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:34.181534 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-775300b6-4cf1-493f-94c1-6418161fea13 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Returning 404 to user: Instance 04477d51-f600-483a-aec9-feb992cc6cf7 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:30:34.182992 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-775300b6-4cf1-493f-94c1-6418161fea13 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] 10.222.0.20 "GET /compute/v2.1/servers/04477d51-f600-483a-aec9-feb992cc6cf7" status: 404 len: 111 microversion: 2.1 time: 0.048074 Oct 27 03:30:34.184090 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1259/2574] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:34 2022] GET /compute/v2.1/servers/04477d51-f600-483a-aec9-feb992cc6cf7 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:30:34.198300 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-004dc4f9-6466-4c2c-9cd8-3169f626711a tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Calling method '.version_select at 0x7f7ddece8ca0>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:34.219248 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=4 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:30:34.392269 n-d-862769-1 devstack@n-api.service[121000]: DEBUG neutronclient.v2_0.client [None req-004dc4f9-6466-4c2c-9cd8-3169f626711a tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 362204bb-f331-489e-bb41-766f010c5078 does not exist", "detail": ""}} {{(pid=121000) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 03:30:34.393046 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.security_group_api [None req-004dc4f9-6466-4c2c-9cd8-3169f626711a tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Neutron security group 362204bb-f331-489e-bb41-766f010c5078 not found {{(pid=121000) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 27 03:30:34.394745 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-004dc4f9-6466-4c2c-9cd8-3169f626711a tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] HTTP exception thrown: Security group 362204bb-f331-489e-bb41-766f010c5078 does not exist Oct 27 03:30:34.394745 n-d-862769-1 devstack@n-api.service[121000]: Neutron server returns request_ids: ['req-60c9bfa9-6750-4ff6-822c-367a28bd4bec'] Oct 27 03:30:34.397641 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-004dc4f9-6466-4c2c-9cd8-3169f626711a tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Request method failure captured: Oct 27 03:30:34.397641 n-d-862769-1 devstack@n-api.service[121000]: request: DELETE /compute/v2.1/os-security-groups/362204bb-f331-489e-bb41-766f010c5078 HTTP/1.1 Oct 27 03:30:34.397641 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:30:34.397641 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:30:34.397641 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:30:34.397641 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:30:34.397641 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:30:34.397641 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:30:34.397641 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:30:34.397641 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:30:34.397641 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfsDm0Py_zt25h362jzfO2BV3foI0uyhpjoORk0IBXpXJDIOp5L0sBs5ZGjH5wntvfF1YWko5rdp9M7xGcdJ8XvPLxOQRZn1LZea5O-2FHM2FJsNqsONwbzuZ-uFy7VwM4IakmeqODIMdeP73cGPmeJKxcyXnuTU87F5wWBu1IQyRCI Oct 27 03:30:34.397641 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:30:34.397641 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:30:34.397641 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:30:34.397641 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:30:34.397641 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:30:34.397641 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:30:34.397641 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 92082c8718aa41bf96cd84d682d75954 Oct 27 03:30:34.397641 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-SecurityGroupsTestJSON-1273178137 Oct 27 03:30:34.397641 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:30:34.397641 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:30:34.397641 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/92082c8718aa41bf96cd84d682d75954"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/92082c8718aa41bf96cd84d682d75954"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/92082c8718aa41bf96cd84d682d75954"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_92082c8718aa41bf96cd84d682d75954"}]}] Oct 27 03:30:34.397641 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-SecurityGroupsTestJSON-1273178137 Oct 27 03:30:34.397641 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 92082c8718aa41bf96cd84d682d75954 Oct 27 03:30:34.397641 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1273178137 Oct 27 03:30:34.397641 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-SecurityGroupsTestJSON-1273178137-project Oct 27 03:30:34.397641 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:30:34.397641 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:30:34.397641 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 421d14944da74570a53d620ea205449d Oct 27 03:30:34.397641 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-SecurityGroupsTestJSON-1273178137-project Oct 27 03:30:34.397641 n-d-862769-1 devstack@n-api.service[121000]: method: Oct 27 03:30:34.397641 n-d-862769-1 devstack@n-api.service[121000]: exception: Security group 362204bb-f331-489e-bb41-766f010c5078 does not exist Oct 27 03:30:34.397641 n-d-862769-1 devstack@n-api.service[121000]: Neutron server returns request_ids: ['req-60c9bfa9-6750-4ff6-822c-367a28bd4bec'] Oct 27 03:30:34.397641 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '362204bb-f331-489e-bb41-766f010c5078'} Oct 27 03:30:34.397641 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:30:34.397641 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:34.397641 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 27 03:30:34.397641 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 27 03:30:34.397641 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:30:34.397641 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:30:34.397641 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 27 03:30:34.397641 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 27 03:30:34.397641 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:30:34.397641 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:30:34.397641 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 27 03:30:34.397641 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 27 03:30:34.397641 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:30:34.397641 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:30:34.397641 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 03:30:34.397641 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 03:30:34.397641 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:30:34.397641 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:30:34.397641 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 03:30:34.397641 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 03:30:34.397641 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:30:34.397641 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:30:34.397641 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 03:30:34.397641 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 03:30:34.397641 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 03:30:34.397641 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 03:30:34.397641 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 362204bb-f331-489e-bb41-766f010c5078 does not exist Oct 27 03:30:34.400927 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-60c9bfa9-6750-4ff6-822c-367a28bd4bec'] Oct 27 03:30:34.400927 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:34.400927 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:30:34.400927 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:34.400927 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:34.400927 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 27 03:30:34.400927 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 27 03:30:34.400927 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 27 03:30:34.400927 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 27 03:30:34.400927 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 362204bb-f331-489e-bb41-766f010c5078 does not exist Oct 27 03:30:34.400927 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-60c9bfa9-6750-4ff6-822c-367a28bd4bec'] Oct 27 03:30:34.400927 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:34.400927 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:30:34.400927 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:34.400927 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:34.400927 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:30:34.400927 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:30:34.400927 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:30:34.400927 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:30:34.400927 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:30:34.400927 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:30:34.400927 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:30:34.400927 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:30:34.400927 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 27 03:30:34.400927 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 27 03:30:34.400927 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 362204bb-f331-489e-bb41-766f010c5078 does not exist Oct 27 03:30:34.400927 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-60c9bfa9-6750-4ff6-822c-367a28bd4bec'] Oct 27 03:30:34.400927 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:34.400927 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:30:34.400927 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:34.400927 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:34.400927 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:30:34.400927 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:30:34.400927 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:30:34.400927 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:30:34.400927 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 362204bb-f331-489e-bb41-766f010c5078 does not exist Oct 27 03:30:34.400927 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-60c9bfa9-6750-4ff6-822c-367a28bd4bec'] Oct 27 03:30:34.400927 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:34.405661 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-004dc4f9-6466-4c2c-9cd8-3169f626711a tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Returning 404 to user: Security group 362204bb-f331-489e-bb41-766f010c5078 does not exist Oct 27 03:30:34.405661 n-d-862769-1 devstack@n-api.service[121000]: Neutron server returns request_ids: ['req-60c9bfa9-6750-4ff6-822c-367a28bd4bec'] {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:30:34.407524 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-004dc4f9-6466-4c2c-9cd8-3169f626711a tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/362204bb-f331-489e-bb41-766f010c5078" status: 404 len: 194 microversion: 2.1 time: 0.215608 Oct 27 03:30:34.409076 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1260/2575] 10.222.0.20 () {58 vars in 1272 bytes} [Thu Oct 27 03:30:34 2022] DELETE /compute/v2.1/os-security-groups/362204bb-f331-489e-bb41-766f010c5078 => generated 194 bytes in 218 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:30:34.419563 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5c75c8ae-8867-4495-a015-a743750a3762 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Calling method '.version_select at 0x7f7dda275430>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:34.602096 n-d-862769-1 devstack@n-api.service[121000]: DEBUG neutronclient.v2_0.client [None req-5c75c8ae-8867-4495-a015-a743750a3762 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9c3c1208-d0fd-42fc-8007-73f03701f25e does not exist", "detail": ""}} {{(pid=121000) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 03:30:34.602751 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.security_group_api [None req-5c75c8ae-8867-4495-a015-a743750a3762 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Neutron security group 9c3c1208-d0fd-42fc-8007-73f03701f25e not found {{(pid=121000) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 27 03:30:34.603329 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-5c75c8ae-8867-4495-a015-a743750a3762 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] HTTP exception thrown: Security group 9c3c1208-d0fd-42fc-8007-73f03701f25e does not exist Oct 27 03:30:34.603329 n-d-862769-1 devstack@n-api.service[121000]: Neutron server returns request_ids: ['req-f0389412-4fbf-40ff-ab71-320bea44f2da'] Oct 27 03:30:34.605205 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5c75c8ae-8867-4495-a015-a743750a3762 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Request method failure captured: Oct 27 03:30:34.605205 n-d-862769-1 devstack@n-api.service[121000]: request: DELETE /compute/v2.1/os-security-groups/9c3c1208-d0fd-42fc-8007-73f03701f25e HTTP/1.1 Oct 27 03:30:34.605205 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:30:34.605205 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:30:34.605205 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:30:34.605205 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:30:34.605205 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:30:34.605205 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:30:34.605205 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:30:34.605205 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:30:34.605205 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfsDm0Py_zt25h362jzfO2BV3foI0uyhpjoORk0IBXpXJDIOp5L0sBs5ZGjH5wntvfF1YWko5rdp9M7xGcdJ8XvPLxOQRZn1LZea5O-2FHM2FJsNqsONwbzuZ-uFy7VwM4IakmeqODIMdeP73cGPmeJKxcyXnuTU87F5wWBu1IQyRCI Oct 27 03:30:34.605205 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:30:34.605205 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:30:34.605205 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:30:34.605205 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:30:34.605205 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:30:34.605205 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:30:34.605205 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 92082c8718aa41bf96cd84d682d75954 Oct 27 03:30:34.605205 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-SecurityGroupsTestJSON-1273178137 Oct 27 03:30:34.605205 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:30:34.605205 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:30:34.605205 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/92082c8718aa41bf96cd84d682d75954"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/92082c8718aa41bf96cd84d682d75954"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/92082c8718aa41bf96cd84d682d75954"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_92082c8718aa41bf96cd84d682d75954"}]}] Oct 27 03:30:34.605205 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-SecurityGroupsTestJSON-1273178137 Oct 27 03:30:34.605205 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 92082c8718aa41bf96cd84d682d75954 Oct 27 03:30:34.605205 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1273178137 Oct 27 03:30:34.605205 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-SecurityGroupsTestJSON-1273178137-project Oct 27 03:30:34.605205 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:30:34.605205 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:30:34.605205 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 421d14944da74570a53d620ea205449d Oct 27 03:30:34.605205 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-SecurityGroupsTestJSON-1273178137-project Oct 27 03:30:34.605205 n-d-862769-1 devstack@n-api.service[121000]: method: Oct 27 03:30:34.605205 n-d-862769-1 devstack@n-api.service[121000]: exception: Security group 9c3c1208-d0fd-42fc-8007-73f03701f25e does not exist Oct 27 03:30:34.605205 n-d-862769-1 devstack@n-api.service[121000]: Neutron server returns request_ids: ['req-f0389412-4fbf-40ff-ab71-320bea44f2da'] Oct 27 03:30:34.605205 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '9c3c1208-d0fd-42fc-8007-73f03701f25e'} Oct 27 03:30:34.605205 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:30:34.605205 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:34.605205 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 27 03:30:34.605205 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 27 03:30:34.605205 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:30:34.605205 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:30:34.605205 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 27 03:30:34.605205 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 27 03:30:34.605205 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:30:34.605205 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:30:34.605205 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 27 03:30:34.605205 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 27 03:30:34.605205 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:30:34.605205 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:30:34.605205 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 03:30:34.605205 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 03:30:34.605205 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:30:34.605205 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:30:34.605205 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 03:30:34.605205 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 03:30:34.605205 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:30:34.605205 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:30:34.605205 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 03:30:34.605205 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 03:30:34.605205 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 03:30:34.605205 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 03:30:34.605205 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9c3c1208-d0fd-42fc-8007-73f03701f25e does not exist Oct 27 03:30:34.617813 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f0389412-4fbf-40ff-ab71-320bea44f2da'] Oct 27 03:30:34.617813 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:34.617813 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:30:34.617813 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:34.617813 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:34.617813 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 27 03:30:34.617813 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 27 03:30:34.617813 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 27 03:30:34.617813 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 27 03:30:34.617813 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9c3c1208-d0fd-42fc-8007-73f03701f25e does not exist Oct 27 03:30:34.617813 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f0389412-4fbf-40ff-ab71-320bea44f2da'] Oct 27 03:30:34.617813 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:34.617813 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:30:34.617813 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:34.617813 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:34.617813 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:30:34.617813 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:30:34.617813 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:30:34.617813 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:30:34.617813 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:30:34.617813 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:30:34.617813 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:30:34.617813 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:30:34.617813 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 27 03:30:34.617813 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 27 03:30:34.617813 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9c3c1208-d0fd-42fc-8007-73f03701f25e does not exist Oct 27 03:30:34.617813 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f0389412-4fbf-40ff-ab71-320bea44f2da'] Oct 27 03:30:34.617813 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:34.617813 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:30:34.617813 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:34.617813 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:34.617813 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:30:34.617813 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:30:34.617813 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:30:34.617813 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:30:34.617813 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9c3c1208-d0fd-42fc-8007-73f03701f25e does not exist Oct 27 03:30:34.617813 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f0389412-4fbf-40ff-ab71-320bea44f2da'] Oct 27 03:30:34.617813 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:30:34.617813 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5c75c8ae-8867-4495-a015-a743750a3762 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Returning 404 to user: Security group 9c3c1208-d0fd-42fc-8007-73f03701f25e does not exist Oct 27 03:30:34.617813 n-d-862769-1 devstack@n-api.service[121000]: Neutron server returns request_ids: ['req-f0389412-4fbf-40ff-ab71-320bea44f2da'] {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:30:34.617813 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5c75c8ae-8867-4495-a015-a743750a3762 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/9c3c1208-d0fd-42fc-8007-73f03701f25e" status: 404 len: 194 microversion: 2.1 time: 0.192189 Oct 27 03:30:34.617813 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1261/2576] 10.222.0.20 () {58 vars in 1272 bytes} [Thu Oct 27 03:30:34 2022] DELETE /compute/v2.1/os-security-groups/9c3c1208-d0fd-42fc-8007-73f03701f25e => generated 194 bytes in 194 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:30:34.625037 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c1bfa6a2-f258-4b73-9653-e8a2a582d0e8 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:34.625881 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c1bfa6a2-f258-4b73-9653-e8a2a582d0e8 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] [instance: 2023265c-1a97-4ed8-8af7-f83077e4bfa5] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:34.632271 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-047e4aac-99e8-4888-9eae-30b86ed5217f tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cd1938c86a4f389a2ec0fba9beff36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd0392257a0419dbfa569c8816ece2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:34.645795 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c1bfa6a2-f258-4b73-9653-e8a2a582d0e8 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:34.646498 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c1bfa6a2-f258-4b73-9653-e8a2a582d0e8 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:34.647706 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-047e4aac-99e8-4888-9eae-30b86ed5217f tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] 10.222.0.20 "GET /compute/v2.1/servers/b0c6560f-ade1-4ae6-905e-ad488f4c3b51" status: 200 len: 1317 microversion: 2.1 time: 1.024175 Oct 27 03:30:34.647828 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c1bfa6a2-f258-4b73-9653-e8a2a582d0e8 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:34.648052 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1316/2577] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:33 2022] GET /compute/v2.1/servers/b0c6560f-ade1-4ae6-905e-ad488f4c3b51 => generated 1317 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:34.648475 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c1bfa6a2-f258-4b73-9653-e8a2a582d0e8 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:34.649749 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c1bfa6a2-f258-4b73-9653-e8a2a582d0e8 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:34.651184 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c1bfa6a2-f258-4b73-9653-e8a2a582d0e8 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:34.667949 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8d0be2a2-4dcf-4f2b-89a8-9a6ecb933c9c tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Calling method '.version_select at 0x7f7dda002b80>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:34.725149 n-d-862769-1 devstack@n-api.service[121001]: DEBUG neutronclient.v2_0.client [None req-8d0be2a2-4dcf-4f2b-89a8-9a6ecb933c9c tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a72e0c68-f0ae-44e7-9d88-e7d14a4148c4 does not exist", "detail": ""}} {{(pid=121001) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 03:30:34.725149 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.network.security_group_api [None req-8d0be2a2-4dcf-4f2b-89a8-9a6ecb933c9c tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Neutron security group a72e0c68-f0ae-44e7-9d88-e7d14a4148c4 not found {{(pid=121001) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 27 03:30:34.725149 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-8d0be2a2-4dcf-4f2b-89a8-9a6ecb933c9c tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] HTTP exception thrown: Security group a72e0c68-f0ae-44e7-9d88-e7d14a4148c4 does not exist Oct 27 03:30:34.725149 n-d-862769-1 devstack@n-api.service[121001]: Neutron server returns request_ids: ['req-5b1f16bd-13ac-4a24-b5db-6bc4af50ff63'] Oct 27 03:30:34.727076 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8d0be2a2-4dcf-4f2b-89a8-9a6ecb933c9c tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Request method failure captured: Oct 27 03:30:34.727076 n-d-862769-1 devstack@n-api.service[121001]: request: DELETE /compute/v2.1/os-security-groups/a72e0c68-f0ae-44e7-9d88-e7d14a4148c4 HTTP/1.1 Oct 27 03:30:34.727076 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:30:34.727076 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:30:34.727076 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:30:34.727076 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:30:34.727076 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:30:34.727076 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:30:34.727076 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:30:34.727076 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:30:34.727076 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfsDm0Py_zt25h362jzfO2BV3foI0uyhpjoORk0IBXpXJDIOp5L0sBs5ZGjH5wntvfF1YWko5rdp9M7xGcdJ8XvPLxOQRZn1LZea5O-2FHM2FJsNqsONwbzuZ-uFy7VwM4IakmeqODIMdeP73cGPmeJKxcyXnuTU87F5wWBu1IQyRCI Oct 27 03:30:34.727076 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:30:34.727076 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:30:34.727076 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:30:34.727076 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:30:34.727076 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:30:34.727076 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:30:34.727076 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 92082c8718aa41bf96cd84d682d75954 Oct 27 03:30:34.727076 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-SecurityGroupsTestJSON-1273178137 Oct 27 03:30:34.727076 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:30:34.727076 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:30:34.727076 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/92082c8718aa41bf96cd84d682d75954"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/92082c8718aa41bf96cd84d682d75954"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/92082c8718aa41bf96cd84d682d75954"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_92082c8718aa41bf96cd84d682d75954"}]}] Oct 27 03:30:34.727076 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-SecurityGroupsTestJSON-1273178137 Oct 27 03:30:34.727076 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 92082c8718aa41bf96cd84d682d75954 Oct 27 03:30:34.727076 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1273178137 Oct 27 03:30:34.727076 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-SecurityGroupsTestJSON-1273178137-project Oct 27 03:30:34.727076 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:30:34.727076 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:30:34.727076 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 421d14944da74570a53d620ea205449d Oct 27 03:30:34.727076 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-SecurityGroupsTestJSON-1273178137-project Oct 27 03:30:34.727076 n-d-862769-1 devstack@n-api.service[121001]: method: Oct 27 03:30:34.727076 n-d-862769-1 devstack@n-api.service[121001]: exception: Security group a72e0c68-f0ae-44e7-9d88-e7d14a4148c4 does not exist Oct 27 03:30:34.727076 n-d-862769-1 devstack@n-api.service[121001]: Neutron server returns request_ids: ['req-5b1f16bd-13ac-4a24-b5db-6bc4af50ff63'] Oct 27 03:30:34.727076 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': 'a72e0c68-f0ae-44e7-9d88-e7d14a4148c4'} Oct 27 03:30:34.727076 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:30:34.727076 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:34.727076 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 27 03:30:34.727076 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 27 03:30:34.727076 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:30:34.727076 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:30:34.727076 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 27 03:30:34.727076 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 27 03:30:34.727076 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:30:34.727076 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:30:34.727076 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 27 03:30:34.727076 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 27 03:30:34.727076 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:30:34.727076 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:30:34.727076 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 03:30:34.727076 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 03:30:34.727076 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:30:34.727076 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:30:34.727076 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 03:30:34.727076 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 03:30:34.727076 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:30:34.727076 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:30:34.727076 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 03:30:34.727076 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 03:30:34.727076 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 03:30:34.727076 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 03:30:34.727076 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a72e0c68-f0ae-44e7-9d88-e7d14a4148c4 does not exist Oct 27 03:30:34.730788 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5b1f16bd-13ac-4a24-b5db-6bc4af50ff63'] Oct 27 03:30:34.730788 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:34.730788 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:30:34.730788 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:34.730788 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:34.730788 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 27 03:30:34.730788 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 27 03:30:34.730788 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 27 03:30:34.730788 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 27 03:30:34.730788 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a72e0c68-f0ae-44e7-9d88-e7d14a4148c4 does not exist Oct 27 03:30:34.730788 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5b1f16bd-13ac-4a24-b5db-6bc4af50ff63'] Oct 27 03:30:34.730788 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:34.730788 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:30:34.730788 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:34.730788 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:34.730788 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:30:34.730788 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:30:34.730788 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:30:34.730788 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:30:34.730788 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:30:34.730788 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:30:34.730788 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:30:34.730788 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:30:34.730788 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 27 03:30:34.730788 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 27 03:30:34.730788 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a72e0c68-f0ae-44e7-9d88-e7d14a4148c4 does not exist Oct 27 03:30:34.730788 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5b1f16bd-13ac-4a24-b5db-6bc4af50ff63'] Oct 27 03:30:34.730788 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:34.730788 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:30:34.730788 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:34.730788 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:34.730788 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:30:34.730788 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:30:34.730788 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:30:34.730788 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:30:34.730788 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a72e0c68-f0ae-44e7-9d88-e7d14a4148c4 does not exist Oct 27 03:30:34.730788 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5b1f16bd-13ac-4a24-b5db-6bc4af50ff63'] Oct 27 03:30:34.730788 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:34.733877 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8d0be2a2-4dcf-4f2b-89a8-9a6ecb933c9c tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Returning 404 to user: Security group a72e0c68-f0ae-44e7-9d88-e7d14a4148c4 does not exist Oct 27 03:30:34.733877 n-d-862769-1 devstack@n-api.service[121001]: Neutron server returns request_ids: ['req-5b1f16bd-13ac-4a24-b5db-6bc4af50ff63'] {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:30:34.735046 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8d0be2a2-4dcf-4f2b-89a8-9a6ecb933c9c tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/a72e0c68-f0ae-44e7-9d88-e7d14a4148c4" status: 404 len: 194 microversion: 2.1 time: 0.085615 Oct 27 03:30:34.739666 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1317/2578] 10.222.0.20 () {58 vars in 1272 bytes} [Thu Oct 27 03:30:34 2022] DELETE /compute/v2.1/os-security-groups/a72e0c68-f0ae-44e7-9d88-e7d14a4148c4 => generated 194 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:30:34.750981 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d7dbcf59-c455-4144-91d3-596bfdcf06fd tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:34.756339 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d7dbcf59-c455-4144-91d3-596bfdcf06fd tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: d5e6f604-9466-45c6-86a8-885cfb393223] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:34.770719 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d7dbcf59-c455-4144-91d3-596bfdcf06fd tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:34.771288 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d7dbcf59-c455-4144-91d3-596bfdcf06fd tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:34.771731 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d7dbcf59-c455-4144-91d3-596bfdcf06fd tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:34.786549 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d7dbcf59-c455-4144-91d3-596bfdcf06fd tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:34.788457 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d7dbcf59-c455-4144-91d3-596bfdcf06fd tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:34.790535 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d7dbcf59-c455-4144-91d3-596bfdcf06fd tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:34.956955 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d7dbcf59-c455-4144-91d3-596bfdcf06fd tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:34.990715 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d7dbcf59-c455-4144-91d3-596bfdcf06fd tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:34.992615 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d7dbcf59-c455-4144-91d3-596bfdcf06fd tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:34.994955 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d7dbcf59-c455-4144-91d3-596bfdcf06fd tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223" status: 200 len: 1266 microversion: 2.25 time: 0.253142 Oct 27 03:30:35.003973 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1318/2579] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:30:34 2022] GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223 => generated 1266 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:30:35.009942 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ea05a65b-640c-4ca3-997f-88774719d87d tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Calling method '.version_select at 0x7f7dd9fd3d30>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:35.130127 n-d-862769-1 devstack@n-api.service[121001]: DEBUG neutronclient.v2_0.client [None req-ea05a65b-640c-4ca3-997f-88774719d87d tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group eb2271b0-0534-4d5d-a383-99722e76872c does not exist", "detail": ""}} {{(pid=121001) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 03:30:35.131507 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.network.security_group_api [None req-ea05a65b-640c-4ca3-997f-88774719d87d tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Neutron security group eb2271b0-0534-4d5d-a383-99722e76872c not found {{(pid=121001) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 27 03:30:35.132352 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-ea05a65b-640c-4ca3-997f-88774719d87d tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] HTTP exception thrown: Security group eb2271b0-0534-4d5d-a383-99722e76872c does not exist Oct 27 03:30:35.132352 n-d-862769-1 devstack@n-api.service[121001]: Neutron server returns request_ids: ['req-5028e1a2-bab2-446c-8779-430c4432c6b1'] Oct 27 03:30:35.135150 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ea05a65b-640c-4ca3-997f-88774719d87d tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Request method failure captured: Oct 27 03:30:35.135150 n-d-862769-1 devstack@n-api.service[121001]: request: DELETE /compute/v2.1/os-security-groups/eb2271b0-0534-4d5d-a383-99722e76872c HTTP/1.1 Oct 27 03:30:35.135150 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:30:35.135150 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:30:35.135150 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:30:35.135150 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:30:35.135150 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:30:35.135150 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:30:35.135150 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:30:35.135150 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:30:35.135150 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfsDm0Py_zt25h362jzfO2BV3foI0uyhpjoORk0IBXpXJDIOp5L0sBs5ZGjH5wntvfF1YWko5rdp9M7xGcdJ8XvPLxOQRZn1LZea5O-2FHM2FJsNqsONwbzuZ-uFy7VwM4IakmeqODIMdeP73cGPmeJKxcyXnuTU87F5wWBu1IQyRCI Oct 27 03:30:35.135150 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:30:35.135150 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:30:35.135150 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:30:35.135150 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:30:35.135150 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:30:35.135150 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:30:35.135150 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 92082c8718aa41bf96cd84d682d75954 Oct 27 03:30:35.135150 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-SecurityGroupsTestJSON-1273178137 Oct 27 03:30:35.135150 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:30:35.135150 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:30:35.135150 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/92082c8718aa41bf96cd84d682d75954"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/92082c8718aa41bf96cd84d682d75954"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/92082c8718aa41bf96cd84d682d75954"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_92082c8718aa41bf96cd84d682d75954"}]}] Oct 27 03:30:35.135150 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-SecurityGroupsTestJSON-1273178137 Oct 27 03:30:35.135150 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 92082c8718aa41bf96cd84d682d75954 Oct 27 03:30:35.135150 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1273178137 Oct 27 03:30:35.135150 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-SecurityGroupsTestJSON-1273178137-project Oct 27 03:30:35.135150 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:30:35.135150 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:30:35.135150 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 421d14944da74570a53d620ea205449d Oct 27 03:30:35.135150 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-SecurityGroupsTestJSON-1273178137-project Oct 27 03:30:35.135150 n-d-862769-1 devstack@n-api.service[121001]: method: Oct 27 03:30:35.135150 n-d-862769-1 devstack@n-api.service[121001]: exception: Security group eb2271b0-0534-4d5d-a383-99722e76872c does not exist Oct 27 03:30:35.135150 n-d-862769-1 devstack@n-api.service[121001]: Neutron server returns request_ids: ['req-5028e1a2-bab2-446c-8779-430c4432c6b1'] Oct 27 03:30:35.135150 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': 'eb2271b0-0534-4d5d-a383-99722e76872c'} Oct 27 03:30:35.135150 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:30:35.135150 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:35.135150 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 27 03:30:35.135150 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 27 03:30:35.135150 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:30:35.135150 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:30:35.135150 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 27 03:30:35.135150 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 27 03:30:35.135150 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:30:35.135150 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:30:35.135150 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 27 03:30:35.135150 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 27 03:30:35.135150 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:30:35.135150 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:30:35.135150 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 03:30:35.135150 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 03:30:35.135150 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:30:35.135150 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:30:35.135150 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 03:30:35.135150 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 03:30:35.135150 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:30:35.135150 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:30:35.135150 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 03:30:35.135150 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 03:30:35.135150 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 03:30:35.135150 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 03:30:35.135150 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group eb2271b0-0534-4d5d-a383-99722e76872c does not exist Oct 27 03:30:35.143601 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5028e1a2-bab2-446c-8779-430c4432c6b1'] Oct 27 03:30:35.143601 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:35.143601 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:30:35.143601 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:35.143601 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:35.143601 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 27 03:30:35.143601 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 27 03:30:35.143601 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 27 03:30:35.143601 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 27 03:30:35.143601 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group eb2271b0-0534-4d5d-a383-99722e76872c does not exist Oct 27 03:30:35.143601 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5028e1a2-bab2-446c-8779-430c4432c6b1'] Oct 27 03:30:35.143601 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:35.143601 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:30:35.143601 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:35.143601 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:35.143601 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:30:35.143601 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:30:35.143601 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:30:35.143601 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:30:35.143601 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:30:35.143601 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:30:35.143601 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:30:35.143601 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:30:35.143601 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 27 03:30:35.143601 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 27 03:30:35.143601 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group eb2271b0-0534-4d5d-a383-99722e76872c does not exist Oct 27 03:30:35.143601 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5028e1a2-bab2-446c-8779-430c4432c6b1'] Oct 27 03:30:35.143601 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:35.143601 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:30:35.143601 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:35.143601 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:35.143601 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:30:35.143601 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:30:35.143601 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:30:35.143601 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:30:35.143601 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group eb2271b0-0534-4d5d-a383-99722e76872c does not exist Oct 27 03:30:35.143601 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5028e1a2-bab2-446c-8779-430c4432c6b1'] Oct 27 03:30:35.143601 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:35.143601 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ea05a65b-640c-4ca3-997f-88774719d87d tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Returning 404 to user: Security group eb2271b0-0534-4d5d-a383-99722e76872c does not exist Oct 27 03:30:35.143601 n-d-862769-1 devstack@n-api.service[121001]: Neutron server returns request_ids: ['req-5028e1a2-bab2-446c-8779-430c4432c6b1'] {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:30:35.143601 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ea05a65b-640c-4ca3-997f-88774719d87d tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/eb2271b0-0534-4d5d-a383-99722e76872c" status: 404 len: 194 microversion: 2.1 time: 0.134638 Oct 27 03:30:35.143601 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1319/2580] 10.222.0.20 () {58 vars in 1272 bytes} [Thu Oct 27 03:30:35 2022] DELETE /compute/v2.1/os-security-groups/eb2271b0-0534-4d5d-a383-99722e76872c => generated 194 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:30:35.150996 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a995c515-65be-4bb5-8e8c-4814842e75a6 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Calling method '.version_select at 0x7f7dd9fb20d0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:35.253243 n-d-862769-1 devstack@n-api.service[121001]: DEBUG neutronclient.v2_0.client [None req-a995c515-65be-4bb5-8e8c-4814842e75a6 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b483c715-7894-4fea-92c0-3f09c82e8bec does not exist", "detail": ""}} {{(pid=121001) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 03:30:35.253853 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.network.security_group_api [None req-a995c515-65be-4bb5-8e8c-4814842e75a6 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Neutron security group b483c715-7894-4fea-92c0-3f09c82e8bec not found {{(pid=121001) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 27 03:30:35.254406 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-a995c515-65be-4bb5-8e8c-4814842e75a6 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] HTTP exception thrown: Security group b483c715-7894-4fea-92c0-3f09c82e8bec does not exist Oct 27 03:30:35.254406 n-d-862769-1 devstack@n-api.service[121001]: Neutron server returns request_ids: ['req-329d71ad-cb1e-402b-af93-1831e2293f4a'] Oct 27 03:30:35.256534 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a995c515-65be-4bb5-8e8c-4814842e75a6 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Request method failure captured: Oct 27 03:30:35.256534 n-d-862769-1 devstack@n-api.service[121001]: request: DELETE /compute/v2.1/os-security-groups/b483c715-7894-4fea-92c0-3f09c82e8bec HTTP/1.1 Oct 27 03:30:35.256534 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:30:35.256534 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:30:35.256534 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:30:35.256534 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:30:35.256534 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:30:35.256534 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:30:35.256534 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:30:35.256534 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:30:35.256534 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfsDm0Py_zt25h362jzfO2BV3foI0uyhpjoORk0IBXpXJDIOp5L0sBs5ZGjH5wntvfF1YWko5rdp9M7xGcdJ8XvPLxOQRZn1LZea5O-2FHM2FJsNqsONwbzuZ-uFy7VwM4IakmeqODIMdeP73cGPmeJKxcyXnuTU87F5wWBu1IQyRCI Oct 27 03:30:35.256534 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:30:35.256534 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:30:35.256534 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:30:35.256534 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:30:35.256534 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:30:35.256534 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:30:35.256534 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 92082c8718aa41bf96cd84d682d75954 Oct 27 03:30:35.256534 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-SecurityGroupsTestJSON-1273178137 Oct 27 03:30:35.256534 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:30:35.256534 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:30:35.256534 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/92082c8718aa41bf96cd84d682d75954"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/92082c8718aa41bf96cd84d682d75954"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/92082c8718aa41bf96cd84d682d75954"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_92082c8718aa41bf96cd84d682d75954"}]}] Oct 27 03:30:35.256534 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-SecurityGroupsTestJSON-1273178137 Oct 27 03:30:35.256534 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 92082c8718aa41bf96cd84d682d75954 Oct 27 03:30:35.256534 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1273178137 Oct 27 03:30:35.256534 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-SecurityGroupsTestJSON-1273178137-project Oct 27 03:30:35.256534 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:30:35.256534 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:30:35.256534 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 421d14944da74570a53d620ea205449d Oct 27 03:30:35.256534 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-SecurityGroupsTestJSON-1273178137-project Oct 27 03:30:35.256534 n-d-862769-1 devstack@n-api.service[121001]: method: Oct 27 03:30:35.256534 n-d-862769-1 devstack@n-api.service[121001]: exception: Security group b483c715-7894-4fea-92c0-3f09c82e8bec does not exist Oct 27 03:30:35.256534 n-d-862769-1 devstack@n-api.service[121001]: Neutron server returns request_ids: ['req-329d71ad-cb1e-402b-af93-1831e2293f4a'] Oct 27 03:30:35.256534 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': 'b483c715-7894-4fea-92c0-3f09c82e8bec'} Oct 27 03:30:35.256534 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:30:35.256534 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:35.256534 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 27 03:30:35.256534 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 27 03:30:35.256534 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:30:35.256534 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:30:35.256534 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 27 03:30:35.256534 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 27 03:30:35.256534 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:30:35.256534 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:30:35.256534 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 27 03:30:35.256534 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 27 03:30:35.256534 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:30:35.256534 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:30:35.256534 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 03:30:35.256534 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 03:30:35.256534 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:30:35.256534 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:30:35.256534 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 03:30:35.256534 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 03:30:35.256534 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:30:35.256534 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:30:35.256534 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 03:30:35.256534 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 03:30:35.256534 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 03:30:35.256534 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 03:30:35.256534 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b483c715-7894-4fea-92c0-3f09c82e8bec does not exist Oct 27 03:30:35.260798 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-329d71ad-cb1e-402b-af93-1831e2293f4a'] Oct 27 03:30:35.260798 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:35.260798 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:30:35.260798 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:35.260798 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:35.260798 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 27 03:30:35.260798 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 27 03:30:35.260798 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 27 03:30:35.260798 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 27 03:30:35.260798 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b483c715-7894-4fea-92c0-3f09c82e8bec does not exist Oct 27 03:30:35.260798 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-329d71ad-cb1e-402b-af93-1831e2293f4a'] Oct 27 03:30:35.260798 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:35.260798 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:30:35.260798 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:35.260798 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:35.260798 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:30:35.260798 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:30:35.260798 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:30:35.260798 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:30:35.260798 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:30:35.260798 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:30:35.260798 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:30:35.260798 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:30:35.260798 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 27 03:30:35.260798 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 27 03:30:35.260798 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b483c715-7894-4fea-92c0-3f09c82e8bec does not exist Oct 27 03:30:35.260798 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-329d71ad-cb1e-402b-af93-1831e2293f4a'] Oct 27 03:30:35.260798 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:35.260798 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:30:35.260798 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:35.260798 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:35.260798 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:30:35.260798 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:30:35.260798 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:30:35.260798 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:30:35.260798 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b483c715-7894-4fea-92c0-3f09c82e8bec does not exist Oct 27 03:30:35.260798 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-329d71ad-cb1e-402b-af93-1831e2293f4a'] Oct 27 03:30:35.260798 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:35.265420 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a995c515-65be-4bb5-8e8c-4814842e75a6 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Returning 404 to user: Security group b483c715-7894-4fea-92c0-3f09c82e8bec does not exist Oct 27 03:30:35.265420 n-d-862769-1 devstack@n-api.service[121001]: Neutron server returns request_ids: ['req-329d71ad-cb1e-402b-af93-1831e2293f4a'] {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:30:35.276886 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a995c515-65be-4bb5-8e8c-4814842e75a6 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/b483c715-7894-4fea-92c0-3f09c82e8bec" status: 404 len: 194 microversion: 2.1 time: 0.119735 Oct 27 03:30:35.276886 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1320/2581] 10.222.0.20 () {58 vars in 1272 bytes} [Thu Oct 27 03:30:35 2022] DELETE /compute/v2.1/os-security-groups/b483c715-7894-4fea-92c0-3f09c82e8bec => generated 194 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:30:35.289925 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e515317e-d29f-40ca-be13-6c94f3fc21ce tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Calling method '.version_select at 0x7f7dd9fb2ca0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:35.300147 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=18 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:30:35.398012 n-d-862769-1 devstack@n-api.service[121001]: DEBUG neutronclient.v2_0.client [None req-e515317e-d29f-40ca-be13-6c94f3fc21ce tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 953ec5ed-1a7a-4bae-a84a-8ffc2b273955 does not exist", "detail": ""}} {{(pid=121001) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 03:30:35.398934 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.network.security_group_api [None req-e515317e-d29f-40ca-be13-6c94f3fc21ce tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Neutron security group 953ec5ed-1a7a-4bae-a84a-8ffc2b273955 not found {{(pid=121001) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 27 03:30:35.399705 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-e515317e-d29f-40ca-be13-6c94f3fc21ce tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] HTTP exception thrown: Security group 953ec5ed-1a7a-4bae-a84a-8ffc2b273955 does not exist Oct 27 03:30:35.399705 n-d-862769-1 devstack@n-api.service[121001]: Neutron server returns request_ids: ['req-57786bfb-9241-4a8c-acd7-a747f3c11b50'] Oct 27 03:30:35.401845 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e515317e-d29f-40ca-be13-6c94f3fc21ce tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Request method failure captured: Oct 27 03:30:35.401845 n-d-862769-1 devstack@n-api.service[121001]: request: DELETE /compute/v2.1/os-security-groups/953ec5ed-1a7a-4bae-a84a-8ffc2b273955 HTTP/1.1 Oct 27 03:30:35.401845 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:30:35.401845 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:30:35.401845 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:30:35.401845 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:30:35.401845 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:30:35.401845 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:30:35.401845 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:30:35.401845 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:30:35.401845 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfsDm0Py_zt25h362jzfO2BV3foI0uyhpjoORk0IBXpXJDIOp5L0sBs5ZGjH5wntvfF1YWko5rdp9M7xGcdJ8XvPLxOQRZn1LZea5O-2FHM2FJsNqsONwbzuZ-uFy7VwM4IakmeqODIMdeP73cGPmeJKxcyXnuTU87F5wWBu1IQyRCI Oct 27 03:30:35.401845 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:30:35.401845 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:30:35.401845 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:30:35.401845 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:30:35.401845 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:30:35.401845 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:30:35.401845 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 92082c8718aa41bf96cd84d682d75954 Oct 27 03:30:35.401845 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-SecurityGroupsTestJSON-1273178137 Oct 27 03:30:35.401845 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:30:35.401845 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:30:35.401845 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/92082c8718aa41bf96cd84d682d75954"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/92082c8718aa41bf96cd84d682d75954"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/92082c8718aa41bf96cd84d682d75954"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_92082c8718aa41bf96cd84d682d75954"}]}] Oct 27 03:30:35.401845 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-SecurityGroupsTestJSON-1273178137 Oct 27 03:30:35.401845 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 92082c8718aa41bf96cd84d682d75954 Oct 27 03:30:35.401845 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1273178137 Oct 27 03:30:35.401845 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-SecurityGroupsTestJSON-1273178137-project Oct 27 03:30:35.401845 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:30:35.401845 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:30:35.401845 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 421d14944da74570a53d620ea205449d Oct 27 03:30:35.401845 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-SecurityGroupsTestJSON-1273178137-project Oct 27 03:30:35.401845 n-d-862769-1 devstack@n-api.service[121001]: method: Oct 27 03:30:35.401845 n-d-862769-1 devstack@n-api.service[121001]: exception: Security group 953ec5ed-1a7a-4bae-a84a-8ffc2b273955 does not exist Oct 27 03:30:35.401845 n-d-862769-1 devstack@n-api.service[121001]: Neutron server returns request_ids: ['req-57786bfb-9241-4a8c-acd7-a747f3c11b50'] Oct 27 03:30:35.401845 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '953ec5ed-1a7a-4bae-a84a-8ffc2b273955'} Oct 27 03:30:35.401845 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:30:35.401845 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:35.401845 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 27 03:30:35.401845 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 27 03:30:35.401845 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:30:35.401845 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:30:35.401845 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 27 03:30:35.401845 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 27 03:30:35.401845 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:30:35.401845 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:30:35.401845 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 27 03:30:35.401845 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 27 03:30:35.401845 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:30:35.401845 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:30:35.401845 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 03:30:35.401845 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 03:30:35.401845 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:30:35.401845 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:30:35.401845 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 03:30:35.401845 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 03:30:35.401845 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:30:35.401845 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:30:35.401845 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 03:30:35.401845 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 03:30:35.401845 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 03:30:35.401845 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 03:30:35.401845 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 953ec5ed-1a7a-4bae-a84a-8ffc2b273955 does not exist Oct 27 03:30:35.414733 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-57786bfb-9241-4a8c-acd7-a747f3c11b50'] Oct 27 03:30:35.414733 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:35.414733 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:30:35.414733 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:35.414733 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:35.414733 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 27 03:30:35.414733 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 27 03:30:35.414733 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 27 03:30:35.414733 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 27 03:30:35.414733 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 953ec5ed-1a7a-4bae-a84a-8ffc2b273955 does not exist Oct 27 03:30:35.414733 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-57786bfb-9241-4a8c-acd7-a747f3c11b50'] Oct 27 03:30:35.414733 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:35.414733 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:30:35.414733 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:35.414733 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:35.414733 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:30:35.414733 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:30:35.414733 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:30:35.414733 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:30:35.414733 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:30:35.414733 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:30:35.414733 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:30:35.414733 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:30:35.414733 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 27 03:30:35.414733 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 27 03:30:35.414733 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 953ec5ed-1a7a-4bae-a84a-8ffc2b273955 does not exist Oct 27 03:30:35.414733 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-57786bfb-9241-4a8c-acd7-a747f3c11b50'] Oct 27 03:30:35.414733 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:35.414733 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:30:35.414733 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:35.414733 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:35.414733 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:30:35.414733 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:30:35.414733 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:30:35.414733 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:30:35.414733 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 953ec5ed-1a7a-4bae-a84a-8ffc2b273955 does not exist Oct 27 03:30:35.414733 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-57786bfb-9241-4a8c-acd7-a747f3c11b50'] Oct 27 03:30:35.414733 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:35.414733 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e515317e-d29f-40ca-be13-6c94f3fc21ce tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Returning 404 to user: Security group 953ec5ed-1a7a-4bae-a84a-8ffc2b273955 does not exist Oct 27 03:30:35.414733 n-d-862769-1 devstack@n-api.service[121001]: Neutron server returns request_ids: ['req-57786bfb-9241-4a8c-acd7-a747f3c11b50'] {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:30:35.414733 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e515317e-d29f-40ca-be13-6c94f3fc21ce tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/953ec5ed-1a7a-4bae-a84a-8ffc2b273955" status: 404 len: 194 microversion: 2.1 time: 0.123763 Oct 27 03:30:35.414733 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1321/2582] 10.222.0.20 () {58 vars in 1272 bytes} [Thu Oct 27 03:30:35 2022] DELETE /compute/v2.1/os-security-groups/953ec5ed-1a7a-4bae-a84a-8ffc2b273955 => generated 194 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:30:35.418009 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c1bfa6a2-f258-4b73-9653-e8a2a582d0e8 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce351a48282492e8cd69b9a5a05f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5514904d799d4f5dae454193e70d85f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:35.422761 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-af861c2c-5d49-435f-9eae-1cd1bc3b8065 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:35.429043 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-af861c2c-5d49-435f-9eae-1cd1bc3b8065 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] [instance: 57cfac2f-cf21-44fa-881e-f1d3da2be9d2] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:35.430643 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c1bfa6a2-f258-4b73-9653-e8a2a582d0e8 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] 10.222.0.20 "GET /compute/v2.1/servers/2023265c-1a97-4ed8-8af7-f83077e4bfa5" status: 200 len: 1305 microversion: 2.1 time: 0.820926 Oct 27 03:30:35.431426 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1262/2583] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:34 2022] GET /compute/v2.1/servers/2023265c-1a97-4ed8-8af7-f83077e4bfa5 => generated 1305 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:35.453156 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-af861c2c-5d49-435f-9eae-1cd1bc3b8065 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:35.453731 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-af861c2c-5d49-435f-9eae-1cd1bc3b8065 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:35.456225 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-af861c2c-5d49-435f-9eae-1cd1bc3b8065 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:35.457613 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-af861c2c-5d49-435f-9eae-1cd1bc3b8065 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:35.459392 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-af861c2c-5d49-435f-9eae-1cd1bc3b8065 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:35.460048 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-af861c2c-5d49-435f-9eae-1cd1bc3b8065 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:35.541723 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-af861c2c-5d49-435f-9eae-1cd1bc3b8065 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] [instance: 57cfac2f-cf21-44fa-881e-f1d3da2be9d2] Going to try to terminate instance {{(pid=121001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:30:35.673651 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-49f2aea6-1391-4b58-a444-0f89318be4d0 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:35.674293 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-49f2aea6-1391-4b58-a444-0f89318be4d0 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] [instance: b0c6560f-ade1-4ae6-905e-ad488f4c3b51] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:35.696210 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-49f2aea6-1391-4b58-a444-0f89318be4d0 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:35.701144 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-49f2aea6-1391-4b58-a444-0f89318be4d0 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:35.703622 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-49f2aea6-1391-4b58-a444-0f89318be4d0 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:35.703622 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-49f2aea6-1391-4b58-a444-0f89318be4d0 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:35.704086 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-49f2aea6-1391-4b58-a444-0f89318be4d0 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:35.704734 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-49f2aea6-1391-4b58-a444-0f89318be4d0 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:35.937145 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-af861c2c-5d49-435f-9eae-1cd1bc3b8065 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] 10.222.0.20 "DELETE /compute/v2.1/servers/57cfac2f-cf21-44fa-881e-f1d3da2be9d2" status: 204 len: 0 microversion: 2.1 time: 0.525908 Oct 27 03:30:35.939263 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1322/2584] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:30:35 2022] DELETE /compute/v2.1/servers/57cfac2f-cf21-44fa-881e-f1d3da2be9d2 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:30:35.951289 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1e24b4ce-a4d6-4e0b-9e0c-ad95796f8dc1 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:35.952031 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1e24b4ce-a4d6-4e0b-9e0c-ad95796f8dc1 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] [instance: 57cfac2f-cf21-44fa-881e-f1d3da2be9d2] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:35.967372 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1e24b4ce-a4d6-4e0b-9e0c-ad95796f8dc1 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:35.978000 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1e24b4ce-a4d6-4e0b-9e0c-ad95796f8dc1 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:35.984207 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1e24b4ce-a4d6-4e0b-9e0c-ad95796f8dc1 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:35.984888 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1e24b4ce-a4d6-4e0b-9e0c-ad95796f8dc1 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:35.985602 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1e24b4ce-a4d6-4e0b-9e0c-ad95796f8dc1 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:35.986699 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1e24b4ce-a4d6-4e0b-9e0c-ad95796f8dc1 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:36.598826 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1e24b4ce-a4d6-4e0b-9e0c-ad95796f8dc1 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421d14944da74570a53d620ea205449d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92082c8718aa41bf96cd84d682d75954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:36.618675 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1e24b4ce-a4d6-4e0b-9e0c-ad95796f8dc1 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] 10.222.0.20 "GET /compute/v2.1/servers/57cfac2f-cf21-44fa-881e-f1d3da2be9d2" status: 200 len: 1645 microversion: 2.1 time: 0.663204 Oct 27 03:30:36.618675 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1323/2585] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:35 2022] GET /compute/v2.1/servers/57cfac2f-cf21-44fa-881e-f1d3da2be9d2 => generated 1645 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:30:36.635011 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-09620015-d81f-41ca-9b46-a7242e5d7854 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:36.645119 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-09620015-d81f-41ca-9b46-a7242e5d7854 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: d5e6f604-9466-45c6-86a8-885cfb393223] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:36.665250 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-09620015-d81f-41ca-9b46-a7242e5d7854 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:36.665751 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-09620015-d81f-41ca-9b46-a7242e5d7854 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:36.666224 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-09620015-d81f-41ca-9b46-a7242e5d7854 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:36.666931 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-09620015-d81f-41ca-9b46-a7242e5d7854 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:36.675247 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-09620015-d81f-41ca-9b46-a7242e5d7854 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:36.676033 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-09620015-d81f-41ca-9b46-a7242e5d7854 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:36.819944 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-49f2aea6-1391-4b58-a444-0f89318be4d0 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cd1938c86a4f389a2ec0fba9beff36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd0392257a0419dbfa569c8816ece2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:36.832970 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-49f2aea6-1391-4b58-a444-0f89318be4d0 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] 10.222.0.20 "GET /compute/v2.1/servers/b0c6560f-ade1-4ae6-905e-ad488f4c3b51" status: 200 len: 1317 microversion: 2.1 time: 1.159996 Oct 27 03:30:36.834631 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1263/2586] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:35 2022] GET /compute/v2.1/servers/b0c6560f-ade1-4ae6-905e-ad488f4c3b51 => generated 1317 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:30:36.853818 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-55595897-7d3c-41ca-8a2c-6d0dbb0366d1 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:36.854847 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-55595897-7d3c-41ca-8a2c-6d0dbb0366d1 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] [instance: 2023265c-1a97-4ed8-8af7-f83077e4bfa5] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:36.861894 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-55595897-7d3c-41ca-8a2c-6d0dbb0366d1 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:36.863373 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-55595897-7d3c-41ca-8a2c-6d0dbb0366d1 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:36.864073 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-55595897-7d3c-41ca-8a2c-6d0dbb0366d1 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:36.866812 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-55595897-7d3c-41ca-8a2c-6d0dbb0366d1 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:36.867534 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-55595897-7d3c-41ca-8a2c-6d0dbb0366d1 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:36.868072 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-55595897-7d3c-41ca-8a2c-6d0dbb0366d1 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:36.962308 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-09620015-d81f-41ca-9b46-a7242e5d7854 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:36.973512 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-09620015-d81f-41ca-9b46-a7242e5d7854 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:36.977970 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-09620015-d81f-41ca-9b46-a7242e5d7854 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:36.979443 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-09620015-d81f-41ca-9b46-a7242e5d7854 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223" status: 200 len: 1266 microversion: 2.25 time: 0.357770 Oct 27 03:30:36.985016 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1324/2587] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:30:36 2022] GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223 => generated 1266 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:30:37.599307 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-55595897-7d3c-41ca-8a2c-6d0dbb0366d1 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce351a48282492e8cd69b9a5a05f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5514904d799d4f5dae454193e70d85f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:37.609894 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-55595897-7d3c-41ca-8a2c-6d0dbb0366d1 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] 10.222.0.20 "GET /compute/v2.1/servers/2023265c-1a97-4ed8-8af7-f83077e4bfa5" status: 200 len: 1305 microversion: 2.1 time: 0.771933 Oct 27 03:30:37.615212 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1264/2588] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:36 2022] GET /compute/v2.1/servers/2023265c-1a97-4ed8-8af7-f83077e4bfa5 => generated 1305 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:37.641853 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1e726e1f-6a44-47eb-a3eb-29819bbc3d0a tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:37.642803 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1e726e1f-6a44-47eb-a3eb-29819bbc3d0a tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] [instance: 57cfac2f-cf21-44fa-881e-f1d3da2be9d2] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:37.660338 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1e726e1f-6a44-47eb-a3eb-29819bbc3d0a tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:37.660841 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1e726e1f-6a44-47eb-a3eb-29819bbc3d0a tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:37.661287 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1e726e1f-6a44-47eb-a3eb-29819bbc3d0a tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:37.662010 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1e726e1f-6a44-47eb-a3eb-29819bbc3d0a tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:37.662488 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1e726e1f-6a44-47eb-a3eb-29819bbc3d0a tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:37.662922 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1e726e1f-6a44-47eb-a3eb-29819bbc3d0a tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:37.861248 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3dd32d19-5597-4453-ac47-b54cf6d14a12 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:37.862851 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-3dd32d19-5597-4453-ac47-b54cf6d14a12 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] [instance: b0c6560f-ade1-4ae6-905e-ad488f4c3b51] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:37.874344 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3dd32d19-5597-4453-ac47-b54cf6d14a12 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:37.880083 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3dd32d19-5597-4453-ac47-b54cf6d14a12 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:37.880711 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3dd32d19-5597-4453-ac47-b54cf6d14a12 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:37.885690 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3dd32d19-5597-4453-ac47-b54cf6d14a12 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:37.886481 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3dd32d19-5597-4453-ac47-b54cf6d14a12 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:37.892215 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3dd32d19-5597-4453-ac47-b54cf6d14a12 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:38.533247 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1e726e1f-6a44-47eb-a3eb-29819bbc3d0a tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421d14944da74570a53d620ea205449d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92082c8718aa41bf96cd84d682d75954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:38.552187 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1e726e1f-6a44-47eb-a3eb-29819bbc3d0a tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] 10.222.0.20 "GET /compute/v2.1/servers/57cfac2f-cf21-44fa-881e-f1d3da2be9d2" status: 200 len: 1645 microversion: 2.1 time: 0.914695 Oct 27 03:30:38.560056 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1325/2589] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:37 2022] GET /compute/v2.1/servers/57cfac2f-cf21-44fa-881e-f1d3da2be9d2 => generated 1645 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:38.572682 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c6b74180-a8e5-4892-b62f-d8aaba237417 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:38.574151 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c6b74180-a8e5-4892-b62f-d8aaba237417 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: d5e6f604-9466-45c6-86a8-885cfb393223] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:38.600522 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c6b74180-a8e5-4892-b62f-d8aaba237417 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:38.603147 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c6b74180-a8e5-4892-b62f-d8aaba237417 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:38.604830 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c6b74180-a8e5-4892-b62f-d8aaba237417 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:38.606575 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c6b74180-a8e5-4892-b62f-d8aaba237417 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:38.607196 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c6b74180-a8e5-4892-b62f-d8aaba237417 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:38.607947 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c6b74180-a8e5-4892-b62f-d8aaba237417 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:38.796810 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c6b74180-a8e5-4892-b62f-d8aaba237417 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:38.816112 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c6b74180-a8e5-4892-b62f-d8aaba237417 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:38.816112 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c6b74180-a8e5-4892-b62f-d8aaba237417 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:38.820648 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c6b74180-a8e5-4892-b62f-d8aaba237417 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223" status: 200 len: 1266 microversion: 2.25 time: 0.254840 Oct 27 03:30:38.821853 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1326/2590] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:30:38 2022] GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223 => generated 1266 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:30:38.842306 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a0c7b21a-50af-4321-a8b8-05ac0b2e2161 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:38.843228 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a0c7b21a-50af-4321-a8b8-05ac0b2e2161 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] [instance: 2023265c-1a97-4ed8-8af7-f83077e4bfa5] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:38.852184 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a0c7b21a-50af-4321-a8b8-05ac0b2e2161 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:38.853168 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a0c7b21a-50af-4321-a8b8-05ac0b2e2161 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:38.855491 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a0c7b21a-50af-4321-a8b8-05ac0b2e2161 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:38.856456 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a0c7b21a-50af-4321-a8b8-05ac0b2e2161 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:38.857103 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a0c7b21a-50af-4321-a8b8-05ac0b2e2161 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:38.861294 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a0c7b21a-50af-4321-a8b8-05ac0b2e2161 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:38.901536 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:30:39.303820 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-3dd32d19-5597-4453-ac47-b54cf6d14a12 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cd1938c86a4f389a2ec0fba9beff36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd0392257a0419dbfa569c8816ece2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:39.335259 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3dd32d19-5597-4453-ac47-b54cf6d14a12 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] 10.222.0.20 "GET /compute/v2.1/servers/b0c6560f-ade1-4ae6-905e-ad488f4c3b51" status: 200 len: 1317 microversion: 2.1 time: 1.477993 Oct 27 03:30:39.336207 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1265/2591] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:37 2022] GET /compute/v2.1/servers/b0c6560f-ade1-4ae6-905e-ad488f4c3b51 => generated 1317 bytes in 1480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:30:39.341986 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-2de2328b-c956-4380-9381-8c54a0e4c62f req-b7bb0b5f-2983-478f-b2c1-8707e9bd6a77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0c6560f-ade1-4ae6-905e-ad488f4c3b51", "tag": "374bf7dd-46fc-42a5-a069-b8b5708a33a0"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:30:39.365604 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-2de2328b-c956-4380-9381-8c54a0e4c62f req-b7bb0b5f-2983-478f-b2c1-8707e9bd6a77 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:39.365604 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-2de2328b-c956-4380-9381-8c54a0e4c62f req-b7bb0b5f-2983-478f-b2c1-8707e9bd6a77 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:39.365604 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-2de2328b-c956-4380-9381-8c54a0e4c62f req-b7bb0b5f-2983-478f-b2c1-8707e9bd6a77 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:39.384026 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a0c7b21a-50af-4321-a8b8-05ac0b2e2161 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce351a48282492e8cd69b9a5a05f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5514904d799d4f5dae454193e70d85f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:39.392427 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a0c7b21a-50af-4321-a8b8-05ac0b2e2161 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] 10.222.0.20 "GET /compute/v2.1/servers/2023265c-1a97-4ed8-8af7-f83077e4bfa5" status: 200 len: 1305 microversion: 2.1 time: 0.568774 Oct 27 03:30:39.394702 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1327/2592] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:38 2022] GET /compute/v2.1/servers/2023265c-1a97-4ed8-8af7-f83077e4bfa5 => generated 1305 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:39.398677 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-2de2328b-c956-4380-9381-8c54a0e4c62f req-b7bb0b5f-2983-478f-b2c1-8707e9bd6a77 service nova] Creating event network-changed:374bf7dd-46fc-42a5-a069-b8b5708a33a0 for instance b0c6560f-ade1-4ae6-905e-ad488f4c3b51 on n-h2-862769-1 Oct 27 03:30:39.410966 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-2de2328b-c956-4380-9381-8c54a0e4c62f req-b7bb0b5f-2983-478f-b2c1-8707e9bd6a77 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072329 Oct 27 03:30:39.414382 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1266/2593] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:30:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:30:39.425129 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-8b488e5f-2913-43fa-a5ef-8041376ec7d8 req-8b01de55-ddc9-4f44-b544-a291e6e9ac20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57cfac2f-cf21-44fa-881e-f1d3da2be9d2", "name": "network-vif-deleted", "tag": "0bdacda3-4cd1-4742-9510-fd56a466a7b7"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:30:39.446242 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-8b488e5f-2913-43fa-a5ef-8041376ec7d8 req-8b01de55-ddc9-4f44-b544-a291e6e9ac20 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:39.446873 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-8b488e5f-2913-43fa-a5ef-8041376ec7d8 req-8b01de55-ddc9-4f44-b544-a291e6e9ac20 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:39.447336 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-8b488e5f-2913-43fa-a5ef-8041376ec7d8 req-8b01de55-ddc9-4f44-b544-a291e6e9ac20 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:39.483435 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-8b488e5f-2913-43fa-a5ef-8041376ec7d8 req-8b01de55-ddc9-4f44-b544-a291e6e9ac20 service nova] Creating event network-vif-deleted:0bdacda3-4cd1-4742-9510-fd56a466a7b7 for instance 57cfac2f-cf21-44fa-881e-f1d3da2be9d2 on n-h2-862769-1 Oct 27 03:30:39.498801 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-8b488e5f-2913-43fa-a5ef-8041376ec7d8 req-8b01de55-ddc9-4f44-b544-a291e6e9ac20 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077165 Oct 27 03:30:39.503593 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1328/2594] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:30:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:30:39.598687 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-146fced2-30cc-40cd-a029-41f558c0b804 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:39.599727 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-146fced2-30cc-40cd-a029-41f558c0b804 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] [instance: 57cfac2f-cf21-44fa-881e-f1d3da2be9d2] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:39.626121 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-146fced2-30cc-40cd-a029-41f558c0b804 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:39.635942 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-146fced2-30cc-40cd-a029-41f558c0b804 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:39.636558 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-146fced2-30cc-40cd-a029-41f558c0b804 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:39.650308 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-146fced2-30cc-40cd-a029-41f558c0b804 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:39.651076 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-146fced2-30cc-40cd-a029-41f558c0b804 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:39.652392 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-146fced2-30cc-40cd-a029-41f558c0b804 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:39.858841 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b7abbf13-901c-4eeb-b63b-e73eab144a0f tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:39.860204 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b7abbf13-901c-4eeb-b63b-e73eab144a0f tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: d5e6f604-9466-45c6-86a8-885cfb393223] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:39.879298 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b7abbf13-901c-4eeb-b63b-e73eab144a0f tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:39.901299 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b7abbf13-901c-4eeb-b63b-e73eab144a0f tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:39.902345 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b7abbf13-901c-4eeb-b63b-e73eab144a0f tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:39.903297 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b7abbf13-901c-4eeb-b63b-e73eab144a0f tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:39.914456 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b7abbf13-901c-4eeb-b63b-e73eab144a0f tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:39.914930 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b7abbf13-901c-4eeb-b63b-e73eab144a0f tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:40.148202 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-146fced2-30cc-40cd-a029-41f558c0b804 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421d14944da74570a53d620ea205449d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92082c8718aa41bf96cd84d682d75954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:40.170283 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-146fced2-30cc-40cd-a029-41f558c0b804 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] 10.222.0.20 "GET /compute/v2.1/servers/57cfac2f-cf21-44fa-881e-f1d3da2be9d2" status: 200 len: 1301 microversion: 2.1 time: 0.587731 Oct 27 03:30:40.183669 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1267/2595] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:39 2022] GET /compute/v2.1/servers/57cfac2f-cf21-44fa-881e-f1d3da2be9d2 => generated 1301 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:40.296112 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b7abbf13-901c-4eeb-b63b-e73eab144a0f tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:40.309551 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b7abbf13-901c-4eeb-b63b-e73eab144a0f tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:40.313453 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b7abbf13-901c-4eeb-b63b-e73eab144a0f tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:40.318246 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b7abbf13-901c-4eeb-b63b-e73eab144a0f tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223" status: 200 len: 1266 microversion: 2.25 time: 0.468523 Oct 27 03:30:40.319353 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1329/2596] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:30:39 2022] GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223 => generated 1266 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:30:40.366943 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4c1cefe1-18a5-4ecb-a056-07f7796365cb tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:40.368891 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4c1cefe1-18a5-4ecb-a056-07f7796365cb tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] [instance: b0c6560f-ade1-4ae6-905e-ad488f4c3b51] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:40.383567 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4c1cefe1-18a5-4ecb-a056-07f7796365cb tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:40.384328 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4c1cefe1-18a5-4ecb-a056-07f7796365cb tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:40.384903 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4c1cefe1-18a5-4ecb-a056-07f7796365cb tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:40.388829 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4c1cefe1-18a5-4ecb-a056-07f7796365cb tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:40.390293 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4c1cefe1-18a5-4ecb-a056-07f7796365cb tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:40.392480 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4c1cefe1-18a5-4ecb-a056-07f7796365cb tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:40.426306 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ce22c09a-16bb-4d72-beed-a4f379f1b6ef tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:40.428128 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ce22c09a-16bb-4d72-beed-a4f379f1b6ef tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] [instance: 2023265c-1a97-4ed8-8af7-f83077e4bfa5] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:40.446811 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ce22c09a-16bb-4d72-beed-a4f379f1b6ef tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:40.448815 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ce22c09a-16bb-4d72-beed-a4f379f1b6ef tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:40.452930 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ce22c09a-16bb-4d72-beed-a4f379f1b6ef tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:40.467233 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ce22c09a-16bb-4d72-beed-a4f379f1b6ef tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:40.468206 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ce22c09a-16bb-4d72-beed-a4f379f1b6ef tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:40.470804 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ce22c09a-16bb-4d72-beed-a4f379f1b6ef tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:40.806191 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ce22c09a-16bb-4d72-beed-a4f379f1b6ef tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce351a48282492e8cd69b9a5a05f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5514904d799d4f5dae454193e70d85f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:40.820016 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ce22c09a-16bb-4d72-beed-a4f379f1b6ef tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] 10.222.0.20 "GET /compute/v2.1/servers/2023265c-1a97-4ed8-8af7-f83077e4bfa5" status: 200 len: 1305 microversion: 2.1 time: 0.395473 Oct 27 03:30:40.823381 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1330/2597] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:40 2022] GET /compute/v2.1/servers/2023265c-1a97-4ed8-8af7-f83077e4bfa5 => generated 1305 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:30:41.109550 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4c1cefe1-18a5-4ecb-a056-07f7796365cb tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cd1938c86a4f389a2ec0fba9beff36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd0392257a0419dbfa569c8816ece2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:41.120744 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4c1cefe1-18a5-4ecb-a056-07f7796365cb tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] 10.222.0.20 "GET /compute/v2.1/servers/b0c6560f-ade1-4ae6-905e-ad488f4c3b51" status: 200 len: 1317 microversion: 2.1 time: 0.761431 Oct 27 03:30:41.127207 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1268/2598] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:40 2022] GET /compute/v2.1/servers/b0c6560f-ade1-4ae6-905e-ad488f4c3b51 => generated 1317 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:41.200788 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-54088774-7a99-4ba7-b785-92de0fd73968 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:41.201475 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-54088774-7a99-4ba7-b785-92de0fd73968 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] [instance: 57cfac2f-cf21-44fa-881e-f1d3da2be9d2] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:41.215004 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-54088774-7a99-4ba7-b785-92de0fd73968 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:41.215923 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-54088774-7a99-4ba7-b785-92de0fd73968 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:41.216378 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-54088774-7a99-4ba7-b785-92de0fd73968 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:41.221431 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-54088774-7a99-4ba7-b785-92de0fd73968 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:41.222114 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-54088774-7a99-4ba7-b785-92de0fd73968 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:41.222580 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-54088774-7a99-4ba7-b785-92de0fd73968 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:41.254810 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-54088774-7a99-4ba7-b785-92de0fd73968 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] HTTP exception thrown: Instance 57cfac2f-cf21-44fa-881e-f1d3da2be9d2 could not be found. Oct 27 03:30:41.260798 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-54088774-7a99-4ba7-b785-92de0fd73968 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Request method failure captured: Oct 27 03:30:41.260798 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/57cfac2f-cf21-44fa-881e-f1d3da2be9d2 HTTP/1.1 Oct 27 03:30:41.260798 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:30:41.260798 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:30:41.260798 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:30:41.260798 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:30:41.260798 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:30:41.260798 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:30:41.260798 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:30:41.260798 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:30:41.260798 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfsDm0Py_zt25h362jzfO2BV3foI0uyhpjoORk0IBXpXJDIOp5L0sBs5ZGjH5wntvfF1YWko5rdp9M7xGcdJ8XvPLxOQRZn1LZea5O-2FHM2FJsNqsONwbzuZ-uFy7VwM4IakmeqODIMdeP73cGPmeJKxcyXnuTU87F5wWBu1IQyRCI Oct 27 03:30:41.260798 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:30:41.260798 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:30:41.260798 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:30:41.260798 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:30:41.260798 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:30:41.260798 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:30:41.260798 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 92082c8718aa41bf96cd84d682d75954 Oct 27 03:30:41.260798 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-SecurityGroupsTestJSON-1273178137 Oct 27 03:30:41.260798 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:30:41.260798 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:30:41.260798 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/92082c8718aa41bf96cd84d682d75954"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/92082c8718aa41bf96cd84d682d75954"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/92082c8718aa41bf96cd84d682d75954"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_92082c8718aa41bf96cd84d682d75954"}]}] Oct 27 03:30:41.260798 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-SecurityGroupsTestJSON-1273178137 Oct 27 03:30:41.260798 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 92082c8718aa41bf96cd84d682d75954 Oct 27 03:30:41.260798 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1273178137 Oct 27 03:30:41.260798 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-SecurityGroupsTestJSON-1273178137-project Oct 27 03:30:41.260798 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:30:41.260798 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:30:41.260798 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 421d14944da74570a53d620ea205449d Oct 27 03:30:41.260798 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-SecurityGroupsTestJSON-1273178137-project Oct 27 03:30:41.260798 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:30:41.260798 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 57cfac2f-cf21-44fa-881e-f1d3da2be9d2 could not be found. Oct 27 03:30:41.260798 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '57cfac2f-cf21-44fa-881e-f1d3da2be9d2'} Oct 27 03:30:41.260798 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:30:41.260798 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:41.260798 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:30:41.260798 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:30:41.260798 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:30:41.260798 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:30:41.260798 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:30:41.260798 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:30:41.260798 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:30:41.260798 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:30:41.260798 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57cfac2f-cf21-44fa-881e-f1d3da2be9d2 could not be found. Oct 27 03:30:41.260798 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:41.260798 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:30:41.260798 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:41.260798 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:41.260798 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:30:41.260798 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:30:41.260798 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:30:41.260798 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:30:41.260798 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:30:41.260798 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:30:41.260798 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:30:41.260798 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:30:41.260798 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:30:41.260798 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:30:41.260798 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:30:41.260798 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:30:41.260798 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57cfac2f-cf21-44fa-881e-f1d3da2be9d2 could not be found. Oct 27 03:30:41.260798 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:41.260798 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:30:41.260798 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:41.264990 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:41.264990 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:30:41.264990 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:30:41.264990 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:30:41.264990 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:30:41.264990 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57cfac2f-cf21-44fa-881e-f1d3da2be9d2 could not be found. Oct 27 03:30:41.264990 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:41.264990 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-54088774-7a99-4ba7-b785-92de0fd73968 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Returning 404 to user: Instance 57cfac2f-cf21-44fa-881e-f1d3da2be9d2 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:30:41.264990 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-54088774-7a99-4ba7-b785-92de0fd73968 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] 10.222.0.20 "GET /compute/v2.1/servers/57cfac2f-cf21-44fa-881e-f1d3da2be9d2" status: 404 len: 111 microversion: 2.1 time: 0.068363 Oct 27 03:30:41.275757 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-975b60da-de7b-4ed1-8381-ad7ddf2ec260 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Calling method '.version_select at 0x7f7dda27f8b0>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:41.280766 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1331/2599] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:41 2022] GET /compute/v2.1/servers/57cfac2f-cf21-44fa-881e-f1d3da2be9d2 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:30:41.346942 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ceccf681-7bc3-49a1-a53b-4947cdd4866e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:41.347726 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ceccf681-7bc3-49a1-a53b-4947cdd4866e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: d5e6f604-9466-45c6-86a8-885cfb393223] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:41.356055 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ceccf681-7bc3-49a1-a53b-4947cdd4866e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:41.358260 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ceccf681-7bc3-49a1-a53b-4947cdd4866e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:41.358719 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ceccf681-7bc3-49a1-a53b-4947cdd4866e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:41.361608 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ceccf681-7bc3-49a1-a53b-4947cdd4866e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:41.362651 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ceccf681-7bc3-49a1-a53b-4947cdd4866e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:41.363093 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ceccf681-7bc3-49a1-a53b-4947cdd4866e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:41.561366 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ceccf681-7bc3-49a1-a53b-4947cdd4866e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:41.572840 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ceccf681-7bc3-49a1-a53b-4947cdd4866e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:41.574665 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ceccf681-7bc3-49a1-a53b-4947cdd4866e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:41.580511 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ceccf681-7bc3-49a1-a53b-4947cdd4866e tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223" status: 200 len: 1266 microversion: 2.25 time: 0.233644 Oct 27 03:30:41.600995 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1332/2600] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:30:41 2022] GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223 => generated 1266 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:30:41.845917 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-bbc1df03-1803-4877-8102-59a08370e358 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:41.848279 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-bbc1df03-1803-4877-8102-59a08370e358 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] [instance: 2023265c-1a97-4ed8-8af7-f83077e4bfa5] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:41.860707 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bbc1df03-1803-4877-8102-59a08370e358 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:41.861266 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bbc1df03-1803-4877-8102-59a08370e358 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:41.861654 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bbc1df03-1803-4877-8102-59a08370e358 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:41.863263 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bbc1df03-1803-4877-8102-59a08370e358 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:41.864257 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bbc1df03-1803-4877-8102-59a08370e358 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:41.865595 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bbc1df03-1803-4877-8102-59a08370e358 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:41.987276 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-975b60da-de7b-4ed1-8381-ad7ddf2ec260 tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/724550ee-a796-4ae0-8467-9b85fc89abfd" status: 202 len: 0 microversion: 2.1 time: 0.715531 Oct 27 03:30:41.987911 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1269/2601] 10.222.0.20 () {58 vars in 1272 bytes} [Thu Oct 27 03:30:41 2022] DELETE /compute/v2.1/os-security-groups/724550ee-a796-4ae0-8467-9b85fc89abfd => generated 0 bytes in 717 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:30:41.995916 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-81ac88f8-1409-4e8d-90bd-b118ad964b1f tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] Calling method '.version_select at 0x7f7dda27faf0>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:42.160381 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-bbc1df03-1803-4877-8102-59a08370e358 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce351a48282492e8cd69b9a5a05f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5514904d799d4f5dae454193e70d85f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:42.168909 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-bbc1df03-1803-4877-8102-59a08370e358 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] 10.222.0.20 "GET /compute/v2.1/servers/2023265c-1a97-4ed8-8af7-f83077e4bfa5" status: 200 len: 1305 microversion: 2.1 time: 0.327969 Oct 27 03:30:42.169974 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1333/2602] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:41 2022] GET /compute/v2.1/servers/2023265c-1a97-4ed8-8af7-f83077e4bfa5 => generated 1305 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:42.175085 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-24e467cc-2203-4d4b-ba73-da11e1c4ac8d tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:42.175923 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-24e467cc-2203-4d4b-ba73-da11e1c4ac8d tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] [instance: b0c6560f-ade1-4ae6-905e-ad488f4c3b51] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:42.196393 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-24e467cc-2203-4d4b-ba73-da11e1c4ac8d tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:42.197235 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-24e467cc-2203-4d4b-ba73-da11e1c4ac8d tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:42.198514 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-24e467cc-2203-4d4b-ba73-da11e1c4ac8d tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:42.199473 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-24e467cc-2203-4d4b-ba73-da11e1c4ac8d tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:42.202840 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-24e467cc-2203-4d4b-ba73-da11e1c4ac8d tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:42.204104 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-24e467cc-2203-4d4b-ba73-da11e1c4ac8d tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:42.800207 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-24e467cc-2203-4d4b-ba73-da11e1c4ac8d tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cd1938c86a4f389a2ec0fba9beff36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd0392257a0419dbfa569c8816ece2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:42.808013 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-24e467cc-2203-4d4b-ba73-da11e1c4ac8d tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] 10.222.0.20 "GET /compute/v2.1/servers/b0c6560f-ade1-4ae6-905e-ad488f4c3b51" status: 200 len: 1317 microversion: 2.1 time: 0.636774 Oct 27 03:30:42.810885 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1334/2603] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:42 2022] GET /compute/v2.1/servers/b0c6560f-ade1-4ae6-905e-ad488f4c3b51 => generated 1317 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:42.827159 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b72eab9f-3239-4d1a-8232-eed420c281e7 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:42.840023 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b72eab9f-3239-4d1a-8232-eed420c281e7 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: d5e6f604-9466-45c6-86a8-885cfb393223] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:42.855270 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b72eab9f-3239-4d1a-8232-eed420c281e7 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:42.856020 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b72eab9f-3239-4d1a-8232-eed420c281e7 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:42.856691 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b72eab9f-3239-4d1a-8232-eed420c281e7 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:42.859052 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b72eab9f-3239-4d1a-8232-eed420c281e7 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:42.859760 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b72eab9f-3239-4d1a-8232-eed420c281e7 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:42.861175 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b72eab9f-3239-4d1a-8232-eed420c281e7 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:42.981631 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b72eab9f-3239-4d1a-8232-eed420c281e7 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:42.982197 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b72eab9f-3239-4d1a-8232-eed420c281e7 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:42.982861 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b72eab9f-3239-4d1a-8232-eed420c281e7 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:42.983486 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-b72eab9f-3239-4d1a-8232-eed420c281e7 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lazy-loading 'fault' on Instance uuid d5e6f604-9466-45c6-86a8-885cfb393223 {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:30:43.179953 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b72eab9f-3239-4d1a-8232-eed420c281e7 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:43.192912 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b72eab9f-3239-4d1a-8232-eed420c281e7 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:43.196382 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b72eab9f-3239-4d1a-8232-eed420c281e7 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:43.197971 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b72eab9f-3239-4d1a-8232-eed420c281e7 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223" status: 200 len: 1194 microversion: 2.25 time: 0.384022 Oct 27 03:30:43.199021 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1335/2604] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:30:42 2022] GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223 => generated 1194 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:30:43.203939 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4e7f4a46-b87d-4a86-b7d2-ff836a0bb44e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:43.205190 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4e7f4a46-b87d-4a86-b7d2-ff836a0bb44e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:43.219577 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4e7f4a46-b87d-4a86-b7d2-ff836a0bb44e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:43.220334 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4e7f4a46-b87d-4a86-b7d2-ff836a0bb44e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:43.220986 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4e7f4a46-b87d-4a86-b7d2-ff836a0bb44e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:43.222634 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4e7f4a46-b87d-4a86-b7d2-ff836a0bb44e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:43.223253 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4e7f4a46-b87d-4a86-b7d2-ff836a0bb44e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:43.224317 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4e7f4a46-b87d-4a86-b7d2-ff836a0bb44e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:43.542411 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4e7f4a46-b87d-4a86-b7d2-ff836a0bb44e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:43.556465 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4e7f4a46-b87d-4a86-b7d2-ff836a0bb44e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1669 microversion: 2.1 time: 0.356178 Oct 27 03:30:43.557393 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1336/2605] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:43 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1669 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:43.562418 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-092377bd-df08-4003-842c-36d3693a167b tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:43.571198 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-092377bd-df08-4003-842c-36d3693a167b tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] [instance: 2023265c-1a97-4ed8-8af7-f83077e4bfa5] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:43.578089 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-092377bd-df08-4003-842c-36d3693a167b tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:43.578593 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-092377bd-df08-4003-842c-36d3693a167b tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:43.579042 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-092377bd-df08-4003-842c-36d3693a167b tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:43.586317 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-092377bd-df08-4003-842c-36d3693a167b tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:43.586993 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-092377bd-df08-4003-842c-36d3693a167b tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:43.587625 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-092377bd-df08-4003-842c-36d3693a167b tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:43.869161 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-092377bd-df08-4003-842c-36d3693a167b tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce351a48282492e8cd69b9a5a05f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5514904d799d4f5dae454193e70d85f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:43.883136 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-092377bd-df08-4003-842c-36d3693a167b tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] 10.222.0.20 "GET /compute/v2.1/servers/2023265c-1a97-4ed8-8af7-f83077e4bfa5" status: 200 len: 1305 microversion: 2.1 time: 0.324338 Oct 27 03:30:43.884417 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1337/2606] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:43 2022] GET /compute/v2.1/servers/2023265c-1a97-4ed8-8af7-f83077e4bfa5 => generated 1305 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:43.897901 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-bbfa2fbf-6964-4777-b469-ece63ce898ad tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:43.898920 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-bbfa2fbf-6964-4777-b469-ece63ce898ad tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:43.945385 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bbfa2fbf-6964-4777-b469-ece63ce898ad tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:43.948997 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bbfa2fbf-6964-4777-b469-ece63ce898ad tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:43.950125 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bbfa2fbf-6964-4777-b469-ece63ce898ad tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:43.952090 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bbfa2fbf-6964-4777-b469-ece63ce898ad tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:43.962244 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bbfa2fbf-6964-4777-b469-ece63ce898ad tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:43.963001 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bbfa2fbf-6964-4777-b469-ece63ce898ad tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:44.316600 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-81ac88f8-1409-4e8d-90bd-b118ad964b1f tempest-SecurityGroupsTestJSON-1273178137 tempest-SecurityGroupsTestJSON-1273178137-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/66c3d870-3440-49f2-a399-c4af75eaee00" status: 202 len: 0 microversion: 2.1 time: 2.324401 Oct 27 03:30:44.318561 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1270/2607] 10.222.0.20 () {58 vars in 1272 bytes} [Thu Oct 27 03:30:41 2022] DELETE /compute/v2.1/os-security-groups/66c3d870-3440-49f2-a399-c4af75eaee00 => generated 0 bytes in 2327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:30:44.324596 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-93d8eef4-6c80-4b66-b43e-38ce170542c0 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:44.325478 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-93d8eef4-6c80-4b66-b43e-38ce170542c0 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] [instance: b0c6560f-ade1-4ae6-905e-ad488f4c3b51] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:44.343317 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-93d8eef4-6c80-4b66-b43e-38ce170542c0 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:44.350929 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-93d8eef4-6c80-4b66-b43e-38ce170542c0 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:44.352604 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-93d8eef4-6c80-4b66-b43e-38ce170542c0 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:44.353617 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-93d8eef4-6c80-4b66-b43e-38ce170542c0 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:44.354505 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-93d8eef4-6c80-4b66-b43e-38ce170542c0 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:44.355167 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-93d8eef4-6c80-4b66-b43e-38ce170542c0 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:44.388357 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=100 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:30:44.972472 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-bbfa2fbf-6964-4777-b469-ece63ce898ad tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:45.009152 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-bbfa2fbf-6964-4777-b469-ece63ce898ad tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1669 microversion: 2.1 time: 1.121649 Oct 27 03:30:45.011026 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1338/2608] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:43 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1669 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:45.018101 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-77201b0a-d976-4b5e-b2ab-8ca29b7f7a61 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:45.020466 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-77201b0a-d976-4b5e-b2ab-8ca29b7f7a61 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: d5e6f604-9466-45c6-86a8-885cfb393223] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:45.032995 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-77201b0a-d976-4b5e-b2ab-8ca29b7f7a61 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:45.036485 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-77201b0a-d976-4b5e-b2ab-8ca29b7f7a61 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:45.036987 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-77201b0a-d976-4b5e-b2ab-8ca29b7f7a61 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:45.044129 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-77201b0a-d976-4b5e-b2ab-8ca29b7f7a61 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:45.064733 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-77201b0a-d976-4b5e-b2ab-8ca29b7f7a61 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:45.065243 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-77201b0a-d976-4b5e-b2ab-8ca29b7f7a61 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:45.136293 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-77201b0a-d976-4b5e-b2ab-8ca29b7f7a61 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] HTTP exception thrown: Instance d5e6f604-9466-45c6-86a8-885cfb393223 could not be found. Oct 27 03:30:45.138814 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-77201b0a-d976-4b5e-b2ab-8ca29b7f7a61 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Request method failure captured: Oct 27 03:30:45.138814 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223 HTTP/1.1 Oct 27 03:30:45.138814 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:30:45.138814 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:30:45.138814 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:30:45.138814 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:30:45.138814 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:30:45.138814 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:30:45.138814 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:30:45.138814 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:30:45.138814 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfmcLXVlJ87-MXRKNjaUe19vVKJ2Fj8yaQ4rCyjuqMOIWaDFGGZrDqnfADuZ1nCyoKEw6vBAg8i8V0kozCLM9CScZxoLwwhXYPlf5Ev3YUWB_OJVYaHs5Zsx7HPVT0Hxr2x3sAFXtd4C3YaCfjKiqLn19y4TRBms2l6d5FjlOxJyEHo Oct 27 03:30:45.138814 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:30:45.138814 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:30:45.138814 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:30:45.138814 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:30:45.138814 n-d-862769-1 devstack@n-api.service[121001]: X-Openstack-Nova-Api-Version: 2.25 Oct 27 03:30:45.138814 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:30:45.138814 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:30:45.138814 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 3b1cf79289db4d7883d93ec3fe908d66 Oct 27 03:30:45.138814 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1617781299 Oct 27 03:30:45.138814 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:30:45.138814 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:30:45.138814 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3b1cf79289db4d7883d93ec3fe908d66"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3b1cf79289db4d7883d93ec3fe908d66"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3b1cf79289db4d7883d93ec3fe908d66"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3b1cf79289db4d7883d93ec3fe908d66"}]}] Oct 27 03:30:45.138814 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1617781299 Oct 27 03:30:45.138814 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 3b1cf79289db4d7883d93ec3fe908d66 Oct 27 03:30:45.138814 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1617781299 Oct 27 03:30:45.138814 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-LiveAutoBlockMigrationV225Test-1617781299-project Oct 27 03:30:45.138814 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:30:45.138814 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:30:45.138814 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: ba3ce7f040d24c33bcf9b97d1ef25268 Oct 27 03:30:45.138814 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1617781299-project Oct 27 03:30:45.138814 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:30:45.138814 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance d5e6f604-9466-45c6-86a8-885cfb393223 could not be found. Oct 27 03:30:45.138814 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': 'd5e6f604-9466-45c6-86a8-885cfb393223'} Oct 27 03:30:45.138814 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:30:45.138814 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:45.138814 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:30:45.138814 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:30:45.138814 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:30:45.138814 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:30:45.138814 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:30:45.138814 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:30:45.138814 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:30:45.138814 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:30:45.138814 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5e6f604-9466-45c6-86a8-885cfb393223 could not be found. Oct 27 03:30:45.138814 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:45.138814 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:30:45.138814 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:45.138814 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:45.138814 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:30:45.138814 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:30:45.138814 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:30:45.138814 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:30:45.138814 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:30:45.138814 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:30:45.138814 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:30:45.138814 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:30:45.138814 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:30:45.138814 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:30:45.138814 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:30:45.138814 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:30:45.138814 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5e6f604-9466-45c6-86a8-885cfb393223 could not be found. Oct 27 03:30:45.138814 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:45.142852 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:30:45.142852 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:45.142852 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:45.142852 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:30:45.142852 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:30:45.142852 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:30:45.142852 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:30:45.142852 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5e6f604-9466-45c6-86a8-885cfb393223 could not be found. Oct 27 03:30:45.142852 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:45.145862 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-77201b0a-d976-4b5e-b2ab-8ca29b7f7a61 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Returning 404 to user: Instance d5e6f604-9466-45c6-86a8-885cfb393223 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:30:45.146869 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-77201b0a-d976-4b5e-b2ab-8ca29b7f7a61 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223" status: 404 len: 111 microversion: 2.25 time: 0.134386 Oct 27 03:30:45.154071 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1339/2609] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:30:45 2022] GET /compute/v2.1/servers/d5e6f604-9466-45c6-86a8-885cfb393223 => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 03:30:45.170960 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-66490ed5-6872-4f23-8335-10f3df3a4ffb tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:45.195932 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-66490ed5-6872-4f23-8335-10f3df3a4ffb tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] [instance: 2023265c-1a97-4ed8-8af7-f83077e4bfa5] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:45.200224 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-66490ed5-6872-4f23-8335-10f3df3a4ffb tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:45.200730 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-66490ed5-6872-4f23-8335-10f3df3a4ffb tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:45.201299 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-66490ed5-6872-4f23-8335-10f3df3a4ffb tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:45.207477 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-66490ed5-6872-4f23-8335-10f3df3a4ffb tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:45.207976 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-66490ed5-6872-4f23-8335-10f3df3a4ffb tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:45.208484 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-66490ed5-6872-4f23-8335-10f3df3a4ffb tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:45.237272 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-93d8eef4-6c80-4b66-b43e-38ce170542c0 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cd1938c86a4f389a2ec0fba9beff36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd0392257a0419dbfa569c8816ece2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:45.249464 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-93d8eef4-6c80-4b66-b43e-38ce170542c0 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] 10.222.0.20 "GET /compute/v2.1/servers/b0c6560f-ade1-4ae6-905e-ad488f4c3b51" status: 200 len: 1317 microversion: 2.1 time: 0.929556 Oct 27 03:30:45.290387 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1271/2610] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:44 2022] GET /compute/v2.1/servers/b0c6560f-ade1-4ae6-905e-ad488f4c3b51 => generated 1317 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:45.313738 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-31e07463-2691-4c84-9015-d073d9632ab5 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:45.315883 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-31e07463-2691-4c84-9015-d073d9632ab5 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:45.338805 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-31e07463-2691-4c84-9015-d073d9632ab5 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:45.339406 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-31e07463-2691-4c84-9015-d073d9632ab5 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:45.342232 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-31e07463-2691-4c84-9015-d073d9632ab5 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:45.343062 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-31e07463-2691-4c84-9015-d073d9632ab5 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:45.345237 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-31e07463-2691-4c84-9015-d073d9632ab5 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:45.346719 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-31e07463-2691-4c84-9015-d073d9632ab5 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:45.693418 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-31e07463-2691-4c84-9015-d073d9632ab5 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:45.706690 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-31e07463-2691-4c84-9015-d073d9632ab5 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1669 microversion: 2.1 time: 0.412754 Oct 27 03:30:45.709067 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1272/2611] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:45 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1669 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:45.736633 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1d984060-efe0-4659-8614-65c16614fad6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-843180812"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:30:45.740425 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1d984060-efe0-4659-8614-65c16614fad6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:45.756371 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1d984060-efe0-4659-8614-65c16614fad6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:45.757956 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1d984060-efe0-4659-8614-65c16614fad6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:45.759959 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1d984060-efe0-4659-8614-65c16614fad6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:45.763415 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1d984060-efe0-4659-8614-65c16614fad6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:45.765532 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1d984060-efe0-4659-8614-65c16614fad6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:45.766176 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1d984060-efe0-4659-8614-65c16614fad6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:45.982935 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-66490ed5-6872-4f23-8335-10f3df3a4ffb tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce351a48282492e8cd69b9a5a05f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5514904d799d4f5dae454193e70d85f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:45.991714 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-66490ed5-6872-4f23-8335-10f3df3a4ffb tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] 10.222.0.20 "GET /compute/v2.1/servers/2023265c-1a97-4ed8-8af7-f83077e4bfa5" status: 200 len: 1293 microversion: 2.1 time: 0.826446 Oct 27 03:30:45.992311 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1340/2612] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:45 2022] GET /compute/v2.1/servers/2023265c-1a97-4ed8-8af7-f83077e4bfa5 => generated 1293 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:46.294459 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-fec4d445-18d7-4bd9-9670-076cd5e88d0f tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:46.295239 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-fec4d445-18d7-4bd9-9670-076cd5e88d0f tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] [instance: b0c6560f-ade1-4ae6-905e-ad488f4c3b51] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:46.320860 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fec4d445-18d7-4bd9-9670-076cd5e88d0f tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:46.325501 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fec4d445-18d7-4bd9-9670-076cd5e88d0f tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:46.326158 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fec4d445-18d7-4bd9-9670-076cd5e88d0f tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:46.326938 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fec4d445-18d7-4bd9-9670-076cd5e88d0f tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:46.327405 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fec4d445-18d7-4bd9-9670-076cd5e88d0f tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:46.331383 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fec4d445-18d7-4bd9-9670-076cd5e88d0f tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:46.486757 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1d984060-efe0-4659-8614-65c16614fad6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "POST /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86/action" status: 202 len: 0 microversion: 2.1 time: 0.754856 Oct 27 03:30:46.488349 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1273/2613] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:30:45 2022] POST /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86/action => generated 0 bytes in 757 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 27 03:30:46.502070 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-364a71a3-c29c-422d-9f22-74770f49dae0 req-fcfbe778-4b5e-4b5e-ad90-1053d907c523 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0c6560f-ade1-4ae6-905e-ad488f4c3b51", "name": "network-vif-plugged", "status": "completed", "tag": "374bf7dd-46fc-42a5-a069-b8b5708a33a0"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:30:46.526809 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-364a71a3-c29c-422d-9f22-74770f49dae0 req-fcfbe778-4b5e-4b5e-ad90-1053d907c523 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:46.530676 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-364a71a3-c29c-422d-9f22-74770f49dae0 req-fcfbe778-4b5e-4b5e-ad90-1053d907c523 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:46.531334 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-364a71a3-c29c-422d-9f22-74770f49dae0 req-fcfbe778-4b5e-4b5e-ad90-1053d907c523 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:46.583648 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-364a71a3-c29c-422d-9f22-74770f49dae0 req-fcfbe778-4b5e-4b5e-ad90-1053d907c523 service nova] Creating event network-vif-plugged:374bf7dd-46fc-42a5-a069-b8b5708a33a0 for instance b0c6560f-ade1-4ae6-905e-ad488f4c3b51 on n-h2-862769-1 Oct 27 03:30:46.605344 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-364a71a3-c29c-422d-9f22-74770f49dae0 req-fcfbe778-4b5e-4b5e-ad90-1053d907c523 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115241 Oct 27 03:30:46.609310 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1274/2614] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:30:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:30:47.029305 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2ee774a6-4323-4376-a0b2-6b0341a2e7ca tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:47.030129 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-2ee774a6-4323-4376-a0b2-6b0341a2e7ca tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] [instance: 2023265c-1a97-4ed8-8af7-f83077e4bfa5] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:47.044003 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2ee774a6-4323-4376-a0b2-6b0341a2e7ca tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:47.044508 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2ee774a6-4323-4376-a0b2-6b0341a2e7ca tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:47.049400 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-fec4d445-18d7-4bd9-9670-076cd5e88d0f tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cd1938c86a4f389a2ec0fba9beff36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd0392257a0419dbfa569c8816ece2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:47.054330 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2ee774a6-4323-4376-a0b2-6b0341a2e7ca tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:47.057112 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2ee774a6-4323-4376-a0b2-6b0341a2e7ca tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:47.057609 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2ee774a6-4323-4376-a0b2-6b0341a2e7ca tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:47.058078 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2ee774a6-4323-4376-a0b2-6b0341a2e7ca tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:47.062548 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-fec4d445-18d7-4bd9-9670-076cd5e88d0f tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] 10.222.0.20 "GET /compute/v2.1/servers/b0c6560f-ade1-4ae6-905e-ad488f4c3b51" status: 200 len: 1317 microversion: 2.1 time: 0.769809 Oct 27 03:30:47.066077 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1341/2615] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:46 2022] GET /compute/v2.1/servers/b0c6560f-ade1-4ae6-905e-ad488f4c3b51 => generated 1317 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:47.377361 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2ee774a6-4323-4376-a0b2-6b0341a2e7ca tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce351a48282492e8cd69b9a5a05f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5514904d799d4f5dae454193e70d85f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:47.387485 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2ee774a6-4323-4376-a0b2-6b0341a2e7ca tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] 10.222.0.20 "GET /compute/v2.1/servers/2023265c-1a97-4ed8-8af7-f83077e4bfa5" status: 200 len: 1293 microversion: 2.1 time: 0.365517 Oct 27 03:30:47.393573 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1275/2616] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:47 2022] GET /compute/v2.1/servers/2023265c-1a97-4ed8-8af7-f83077e4bfa5 => generated 1293 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:30:48.092233 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6aff65db-1200-4884-a4c1-795f80a9d0cf tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:48.093367 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-6aff65db-1200-4884-a4c1-795f80a9d0cf tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] [instance: b0c6560f-ade1-4ae6-905e-ad488f4c3b51] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:48.108514 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6aff65db-1200-4884-a4c1-795f80a9d0cf tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:48.109018 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6aff65db-1200-4884-a4c1-795f80a9d0cf tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:48.109469 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6aff65db-1200-4884-a4c1-795f80a9d0cf tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:48.110227 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6aff65db-1200-4884-a4c1-795f80a9d0cf tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:48.110689 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6aff65db-1200-4884-a4c1-795f80a9d0cf tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:48.111125 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6aff65db-1200-4884-a4c1-795f80a9d0cf tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:48.420619 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ac5b63ab-fe47-4096-920f-58a0828b1680 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:48.421361 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ac5b63ab-fe47-4096-920f-58a0828b1680 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] [instance: 2023265c-1a97-4ed8-8af7-f83077e4bfa5] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:48.434367 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ac5b63ab-fe47-4096-920f-58a0828b1680 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:48.440923 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ac5b63ab-fe47-4096-920f-58a0828b1680 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:48.440923 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ac5b63ab-fe47-4096-920f-58a0828b1680 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:48.440923 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ac5b63ab-fe47-4096-920f-58a0828b1680 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:48.440923 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ac5b63ab-fe47-4096-920f-58a0828b1680 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:48.440923 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ac5b63ab-fe47-4096-920f-58a0828b1680 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:48.831694 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ac5b63ab-fe47-4096-920f-58a0828b1680 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce351a48282492e8cd69b9a5a05f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5514904d799d4f5dae454193e70d85f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:48.841923 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ac5b63ab-fe47-4096-920f-58a0828b1680 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] 10.222.0.20 "GET /compute/v2.1/servers/2023265c-1a97-4ed8-8af7-f83077e4bfa5" status: 200 len: 1293 microversion: 2.1 time: 0.425781 Oct 27 03:30:48.844806 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1276/2617] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:48 2022] GET /compute/v2.1/servers/2023265c-1a97-4ed8-8af7-f83077e4bfa5 => generated 1293 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:49.147721 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6aff65db-1200-4884-a4c1-795f80a9d0cf tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cd1938c86a4f389a2ec0fba9beff36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd0392257a0419dbfa569c8816ece2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:49.163203 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6aff65db-1200-4884-a4c1-795f80a9d0cf tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] 10.222.0.20 "GET /compute/v2.1/servers/b0c6560f-ade1-4ae6-905e-ad488f4c3b51" status: 200 len: 1317 microversion: 2.1 time: 1.074801 Oct 27 03:30:49.192732 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1342/2618] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:48 2022] GET /compute/v2.1/servers/b0c6560f-ade1-4ae6-905e-ad488f4c3b51 => generated 1317 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:49.873310 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c3c09e81-0f6e-40a5-a591-734f47592ec2 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:49.880661 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c3c09e81-0f6e-40a5-a591-734f47592ec2 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] [instance: 2023265c-1a97-4ed8-8af7-f83077e4bfa5] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:49.896362 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c3c09e81-0f6e-40a5-a591-734f47592ec2 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:49.897953 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c3c09e81-0f6e-40a5-a591-734f47592ec2 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:49.900706 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c3c09e81-0f6e-40a5-a591-734f47592ec2 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:49.905931 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c3c09e81-0f6e-40a5-a591-734f47592ec2 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:49.914374 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c3c09e81-0f6e-40a5-a591-734f47592ec2 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:49.914374 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c3c09e81-0f6e-40a5-a591-734f47592ec2 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:50.194537 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-478507c7-739e-442f-a44a-8b83a7f4084e tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:50.195170 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-478507c7-739e-442f-a44a-8b83a7f4084e tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] [instance: b0c6560f-ade1-4ae6-905e-ad488f4c3b51] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:50.202849 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-478507c7-739e-442f-a44a-8b83a7f4084e tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:50.204411 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-478507c7-739e-442f-a44a-8b83a7f4084e tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:50.205353 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-478507c7-739e-442f-a44a-8b83a7f4084e tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:50.207129 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-478507c7-739e-442f-a44a-8b83a7f4084e tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:50.207810 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-478507c7-739e-442f-a44a-8b83a7f4084e tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:50.208467 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-478507c7-739e-442f-a44a-8b83a7f4084e tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:50.307014 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c3c09e81-0f6e-40a5-a591-734f47592ec2 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce351a48282492e8cd69b9a5a05f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5514904d799d4f5dae454193e70d85f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:50.335103 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c3c09e81-0f6e-40a5-a591-734f47592ec2 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] 10.222.0.20 "GET /compute/v2.1/servers/2023265c-1a97-4ed8-8af7-f83077e4bfa5" status: 200 len: 1293 microversion: 2.1 time: 0.467683 Oct 27 03:30:50.335753 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1277/2619] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:49 2022] GET /compute/v2.1/servers/2023265c-1a97-4ed8-8af7-f83077e4bfa5 => generated 1293 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:51.032804 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-478507c7-739e-442f-a44a-8b83a7f4084e tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cd1938c86a4f389a2ec0fba9beff36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd0392257a0419dbfa569c8816ece2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:51.051426 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-478507c7-739e-442f-a44a-8b83a7f4084e tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] 10.222.0.20 "GET /compute/v2.1/servers/b0c6560f-ade1-4ae6-905e-ad488f4c3b51" status: 200 len: 1466 microversion: 2.1 time: 0.864015 Oct 27 03:30:51.067485 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1343/2620] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:50 2022] GET /compute/v2.1/servers/b0c6560f-ade1-4ae6-905e-ad488f4c3b51 => generated 1466 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:51.069034 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-cab2a1d6-c792-4d96-81f7-37278622746a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:51.069470 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-cab2a1d6-c792-4d96-81f7-37278622746a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:51.084078 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-643a37da-514b-4b44-b5a8-f6d8f35ee064 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-1182747600", "metadata": {"image_type": "test"}}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:30:51.085090 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cab2a1d6-c792-4d96-81f7-37278622746a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:51.085597 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cab2a1d6-c792-4d96-81f7-37278622746a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:51.086061 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cab2a1d6-c792-4d96-81f7-37278622746a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:51.090471 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-643a37da-514b-4b44-b5a8-f6d8f35ee064 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] [instance: b0c6560f-ade1-4ae6-905e-ad488f4c3b51] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:51.090872 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cab2a1d6-c792-4d96-81f7-37278622746a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:51.090872 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cab2a1d6-c792-4d96-81f7-37278622746a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:51.090872 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cab2a1d6-c792-4d96-81f7-37278622746a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:51.109778 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-643a37da-514b-4b44-b5a8-f6d8f35ee064 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:51.110323 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-643a37da-514b-4b44-b5a8-f6d8f35ee064 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:51.110766 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-643a37da-514b-4b44-b5a8-f6d8f35ee064 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:51.119283 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-643a37da-514b-4b44-b5a8-f6d8f35ee064 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:51.119283 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-643a37da-514b-4b44-b5a8-f6d8f35ee064 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:51.119283 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-643a37da-514b-4b44-b5a8-f6d8f35ee064 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:51.192268 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-cab2a1d6-c792-4d96-81f7-37278622746a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f] Going to try to terminate instance {{(pid=121000) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:30:51.240073 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-643a37da-514b-4b44-b5a8-f6d8f35ee064 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Getting quotas for project ccd0392257a0419dbfa569c8816ece2b. Resources: dict_keys(['metadata_items']) {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:30:51.253989 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-643a37da-514b-4b44-b5a8-f6d8f35ee064 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Getting quotas for user 42cd1938c86a4f389a2ec0fba9beff36 and project ccd0392257a0419dbfa569c8816ece2b. Resources: dict_keys(['metadata_items']) {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:30:51.717390 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-cab2a1d6-c792-4d96-81f7-37278622746a tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "DELETE /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f" status: 204 len: 0 microversion: 2.25 time: 0.651786 Oct 27 03:30:51.718815 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1278/2621] 10.222.0.20 () {60 vars in 1280 bytes} [Thu Oct 27 03:30:51 2022] DELETE /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f => generated 0 bytes in 654 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 03:30:51.729451 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6999df25-1e83-44aa-a4f9-a1ca4f7e9de0 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:51.730215 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6999df25-1e83-44aa-a4f9-a1ca4f7e9de0 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] [instance: 2023265c-1a97-4ed8-8af7-f83077e4bfa5] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:51.749360 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6999df25-1e83-44aa-a4f9-a1ca4f7e9de0 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:51.750165 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6999df25-1e83-44aa-a4f9-a1ca4f7e9de0 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:51.757870 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6999df25-1e83-44aa-a4f9-a1ca4f7e9de0 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:51.757870 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6999df25-1e83-44aa-a4f9-a1ca4f7e9de0 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:51.757870 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6999df25-1e83-44aa-a4f9-a1ca4f7e9de0 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:51.757870 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6999df25-1e83-44aa-a4f9-a1ca4f7e9de0 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:51.782796 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=100 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:30:51.995654 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-643a37da-514b-4b44-b5a8-f6d8f35ee064 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] 10.222.0.20 "POST /compute/v2.1/servers/b0c6560f-ade1-4ae6-905e-ad488f4c3b51/action" status: 202 len: 0 microversion: 2.1 time: 0.915928 Oct 27 03:30:52.010304 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1344/2622] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:30:51 2022] POST /compute/v2.1/servers/b0c6560f-ade1-4ae6-905e-ad488f4c3b51/action => generated 0 bytes in 931 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 27 03:30:52.016542 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-16b875f0-e7a8-4091-b986-204b757d66ab tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:52.042498 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-16b875f0-e7a8-4091-b986-204b757d66ab tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:52.051891 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-16b875f0-e7a8-4091-b986-204b757d66ab tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:52.061470 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-16b875f0-e7a8-4091-b986-204b757d66ab tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:52.062216 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-16b875f0-e7a8-4091-b986-204b757d66ab tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:52.063152 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-16b875f0-e7a8-4091-b986-204b757d66ab tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:52.064488 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-16b875f0-e7a8-4091-b986-204b757d66ab tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:52.069364 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-16b875f0-e7a8-4091-b986-204b757d66ab tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:52.478975 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-6999df25-1e83-44aa-a4f9-a1ca4f7e9de0 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce351a48282492e8cd69b9a5a05f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5514904d799d4f5dae454193e70d85f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:52.492139 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6999df25-1e83-44aa-a4f9-a1ca4f7e9de0 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] 10.222.0.20 "GET /compute/v2.1/servers/2023265c-1a97-4ed8-8af7-f83077e4bfa5" status: 200 len: 1293 microversion: 2.1 time: 0.769362 Oct 27 03:30:52.495334 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1279/2623] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:51 2022] GET /compute/v2.1/servers/2023265c-1a97-4ed8-8af7-f83077e4bfa5 => generated 1293 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:52.517424 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b008ed6b-8b19-4bb7-86d7-8369d4f1594b tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Calling method '.version_select at 0x7f7ddec7c280>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:52.644592 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b008ed6b-8b19-4bb7-86d7-8369d4f1594b tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] 10.222.0.20 "GET /compute/v2.1/images/1a2e38d2-514f-48c2-b314-d5c9f52051f1" status: 200 len: 1424 microversion: 2.1 time: 0.133053 Oct 27 03:30:52.650127 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1280/2624] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:30:52 2022] GET /compute/v2.1/images/1a2e38d2-514f-48c2-b314-d5c9f52051f1 => generated 1424 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:53.521007 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-61745e7f-7657-45f5-b736-96694b2e3498 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:53.521668 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-61745e7f-7657-45f5-b736-96694b2e3498 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] [instance: 2023265c-1a97-4ed8-8af7-f83077e4bfa5] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:53.538692 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-61745e7f-7657-45f5-b736-96694b2e3498 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:53.539201 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-61745e7f-7657-45f5-b736-96694b2e3498 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:53.539649 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-61745e7f-7657-45f5-b736-96694b2e3498 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:53.540374 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-61745e7f-7657-45f5-b736-96694b2e3498 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:53.540844 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-61745e7f-7657-45f5-b736-96694b2e3498 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:53.541281 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-61745e7f-7657-45f5-b736-96694b2e3498 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:54.457017 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-16b875f0-e7a8-4091-b986-204b757d66ab tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:54.471865 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-16b875f0-e7a8-4091-b986-204b757d66ab tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:54.477428 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-16b875f0-e7a8-4091-b986-204b757d66ab tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:54.479941 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-16b875f0-e7a8-4091-b986-204b757d66ab tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f" status: 200 len: 1731 microversion: 2.25 time: 2.468058 Oct 27 03:30:54.482486 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1345/2625] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:30:52 2022] GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f => generated 1731 bytes in 2471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:30:54.494333 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2636e329-dbf3-4bd2-8e56-ef0fc87f76f2 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Calling method '.version_select at 0x7f7dd9fb28b0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:54.588082 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2636e329-dbf3-4bd2-8e56-ef0fc87f76f2 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] 10.222.0.20 "GET /compute/v2.1/images/1a2e38d2-514f-48c2-b314-d5c9f52051f1" status: 200 len: 1424 microversion: 2.1 time: 0.104123 Oct 27 03:30:54.588719 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1346/2626] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:30:54 2022] GET /compute/v2.1/images/1a2e38d2-514f-48c2-b314-d5c9f52051f1 => generated 1424 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:55.021514 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-61745e7f-7657-45f5-b736-96694b2e3498 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce351a48282492e8cd69b9a5a05f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5514904d799d4f5dae454193e70d85f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:55.036031 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-61745e7f-7657-45f5-b736-96694b2e3498 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] 10.222.0.20 "GET /compute/v2.1/servers/2023265c-1a97-4ed8-8af7-f83077e4bfa5" status: 200 len: 1293 microversion: 2.1 time: 1.518579 Oct 27 03:30:55.036888 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1281/2627] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:53 2022] GET /compute/v2.1/servers/2023265c-1a97-4ed8-8af7-f83077e4bfa5 => generated 1293 bytes in 1520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:55.512381 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-afe9e60b-9fb0-4f71-b8ab-f34de31af4b6 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:55.513642 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-afe9e60b-9fb0-4f71-b8ab-f34de31af4b6 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:55.528425 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-afe9e60b-9fb0-4f71-b8ab-f34de31af4b6 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:55.528932 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-afe9e60b-9fb0-4f71-b8ab-f34de31af4b6 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:55.529377 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-afe9e60b-9fb0-4f71-b8ab-f34de31af4b6 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:55.533473 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-afe9e60b-9fb0-4f71-b8ab-f34de31af4b6 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:55.534312 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-afe9e60b-9fb0-4f71-b8ab-f34de31af4b6 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:55.538101 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-afe9e60b-9fb0-4f71-b8ab-f34de31af4b6 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:55.605529 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ad85e02d-0f8c-45f1-b2b3-64ac96becf44 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Calling method '.version_select at 0x7f7ddc9c9670>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:56.244033 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ad85e02d-0f8c-45f1-b2b3-64ac96becf44 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] 10.222.0.20 "GET /compute/v2.1/images/1a2e38d2-514f-48c2-b314-d5c9f52051f1" status: 200 len: 1424 microversion: 2.1 time: 0.642812 Oct 27 03:30:56.245411 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1282/2628] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:30:55 2022] GET /compute/v2.1/images/1a2e38d2-514f-48c2-b314-d5c9f52051f1 => generated 1424 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:30:56.255731 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7e40b3e9-ace1-4293-9086-d1b7fc8fa055 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:56.267920 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7e40b3e9-ace1-4293-9086-d1b7fc8fa055 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] [instance: 2023265c-1a97-4ed8-8af7-f83077e4bfa5] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:56.274409 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:30:56.299135 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7e40b3e9-ace1-4293-9086-d1b7fc8fa055 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:56.301069 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7e40b3e9-ace1-4293-9086-d1b7fc8fa055 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:56.303342 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7e40b3e9-ace1-4293-9086-d1b7fc8fa055 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:56.307512 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7e40b3e9-ace1-4293-9086-d1b7fc8fa055 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:56.307512 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7e40b3e9-ace1-4293-9086-d1b7fc8fa055 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:56.307512 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7e40b3e9-ace1-4293-9086-d1b7fc8fa055 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:56.417792 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-afe9e60b-9fb0-4f71-b8ab-f34de31af4b6 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:56.439761 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-afe9e60b-9fb0-4f71-b8ab-f34de31af4b6 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:56.444196 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-afe9e60b-9fb0-4f71-b8ab-f34de31af4b6 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:56.454403 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-afe9e60b-9fb0-4f71-b8ab-f34de31af4b6 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f" status: 200 len: 1663 microversion: 2.25 time: 0.947098 Oct 27 03:30:56.455046 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1347/2629] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:30:55 2022] GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f => generated 1663 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:30:56.716784 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-1c03a7c8-6cdb-407f-8d3c-7d2a24fdc12f req-bdf67ac4-ba71-4ac4-b554-9b9cae85f30d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f", "name": "network-vif-deleted", "tag": "43cfec0a-97df-4480-8645-66f623cb4eaa"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:30:56.749489 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-1c03a7c8-6cdb-407f-8d3c-7d2a24fdc12f req-bdf67ac4-ba71-4ac4-b554-9b9cae85f30d service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:56.749988 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-1c03a7c8-6cdb-407f-8d3c-7d2a24fdc12f req-bdf67ac4-ba71-4ac4-b554-9b9cae85f30d service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:56.750500 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-1c03a7c8-6cdb-407f-8d3c-7d2a24fdc12f req-bdf67ac4-ba71-4ac4-b554-9b9cae85f30d service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:56.792785 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7e40b3e9-ace1-4293-9086-d1b7fc8fa055 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce351a48282492e8cd69b9a5a05f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5514904d799d4f5dae454193e70d85f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:56.805520 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7e40b3e9-ace1-4293-9086-d1b7fc8fa055 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] 10.222.0.20 "GET /compute/v2.1/servers/2023265c-1a97-4ed8-8af7-f83077e4bfa5" status: 200 len: 1293 microversion: 2.1 time: 0.557117 Oct 27 03:30:56.807361 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1283/2630] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:56 2022] GET /compute/v2.1/servers/2023265c-1a97-4ed8-8af7-f83077e4bfa5 => generated 1293 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:56.825367 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-1c03a7c8-6cdb-407f-8d3c-7d2a24fdc12f req-bdf67ac4-ba71-4ac4-b554-9b9cae85f30d service nova] Creating event network-vif-deleted:43cfec0a-97df-4480-8645-66f623cb4eaa for instance 09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f on n-h2-862769-1 Oct 27 03:30:56.832058 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-1c03a7c8-6cdb-407f-8d3c-7d2a24fdc12f req-bdf67ac4-ba71-4ac4-b554-9b9cae85f30d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118984 Oct 27 03:30:56.833236 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1348/2631] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:30:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:30:57.260603 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5691ca87-8aec-423b-aec8-0c46e0061cf0 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Calling method '.version_select at 0x7f7ddaac3af0>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:57.483284 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-eebe7cf4-0be2-471d-8811-13ad8a606f00 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:57.484406 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-eebe7cf4-0be2-471d-8811-13ad8a606f00 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:57.496882 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eebe7cf4-0be2-471d-8811-13ad8a606f00 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:57.500097 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eebe7cf4-0be2-471d-8811-13ad8a606f00 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:57.504308 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eebe7cf4-0be2-471d-8811-13ad8a606f00 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:57.505359 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eebe7cf4-0be2-471d-8811-13ad8a606f00 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:57.509600 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eebe7cf4-0be2-471d-8811-13ad8a606f00 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:57.516594 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eebe7cf4-0be2-471d-8811-13ad8a606f00 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:57.627243 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eebe7cf4-0be2-471d-8811-13ad8a606f00 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:57.630349 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eebe7cf4-0be2-471d-8811-13ad8a606f00 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:57.631083 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eebe7cf4-0be2-471d-8811-13ad8a606f00 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:57.632890 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-eebe7cf4-0be2-471d-8811-13ad8a606f00 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lazy-loading 'fault' on Instance uuid 09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:30:58.466664 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-eebe7cf4-0be2-471d-8811-13ad8a606f00 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:58.476944 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-eebe7cf4-0be2-471d-8811-13ad8a606f00 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:58.484229 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-eebe7cf4-0be2-471d-8811-13ad8a606f00 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:58.489539 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-eebe7cf4-0be2-471d-8811-13ad8a606f00 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f" status: 200 len: 1374 microversion: 2.25 time: 1.012010 Oct 27 03:30:58.492678 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1349/2632] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:30:57 2022] GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f => generated 1374 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:30:58.515997 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-ab5d313c-974c-428b-888d-3c302cb853e7 req-c1dbfe04-cffe-4e30-8c5f-a4dbb7372778 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed74f42b-af82-4808-bfc2-86110840fe86", "name": "network-vif-plugged", "status": "completed", "tag": "05464839-777e-4176-af2d-6086d6f9acaa"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:30:58.554228 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-ab5d313c-974c-428b-888d-3c302cb853e7 req-c1dbfe04-cffe-4e30-8c5f-a4dbb7372778 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:58.554933 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-ab5d313c-974c-428b-888d-3c302cb853e7 req-c1dbfe04-cffe-4e30-8c5f-a4dbb7372778 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:58.555456 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-ab5d313c-974c-428b-888d-3c302cb853e7 req-c1dbfe04-cffe-4e30-8c5f-a4dbb7372778 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:58.608529 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-ab5d313c-974c-428b-888d-3c302cb853e7 req-c1dbfe04-cffe-4e30-8c5f-a4dbb7372778 service nova] Creating event network-vif-plugged:05464839-777e-4176-af2d-6086d6f9acaa for instance ed74f42b-af82-4808-bfc2-86110840fe86 on n-h1-862769-1 Oct 27 03:30:58.628689 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-ab5d313c-974c-428b-888d-3c302cb853e7 req-c1dbfe04-cffe-4e30-8c5f-a4dbb7372778 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133880 Oct 27 03:30:58.635986 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1350/2633] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:30:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:30:58.670613 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-78ad286f-7c60-4941-be0c-d9a20fc42b03 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:58.672000 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-78ad286f-7c60-4941-be0c-d9a20fc42b03 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] [instance: 2023265c-1a97-4ed8-8af7-f83077e4bfa5] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:58.705016 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-78ad286f-7c60-4941-be0c-d9a20fc42b03 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:58.708725 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-78ad286f-7c60-4941-be0c-d9a20fc42b03 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:58.716071 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-78ad286f-7c60-4941-be0c-d9a20fc42b03 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:58.716799 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-78ad286f-7c60-4941-be0c-d9a20fc42b03 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:58.721614 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-78ad286f-7c60-4941-be0c-d9a20fc42b03 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:58.722185 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-78ad286f-7c60-4941-be0c-d9a20fc42b03 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:59.550292 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-78ad286f-7c60-4941-be0c-d9a20fc42b03 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce351a48282492e8cd69b9a5a05f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5514904d799d4f5dae454193e70d85f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:30:59.561249 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-78ad286f-7c60-4941-be0c-d9a20fc42b03 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] 10.222.0.20 "GET /compute/v2.1/servers/2023265c-1a97-4ed8-8af7-f83077e4bfa5" status: 200 len: 1293 microversion: 2.1 time: 0.923830 Oct 27 03:30:59.561862 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1351/2634] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:30:58 2022] GET /compute/v2.1/servers/2023265c-1a97-4ed8-8af7-f83077e4bfa5 => generated 1293 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:30:59.578607 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-47186402-0127-4dc7-9c07-a03b7dd29cd5 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:59.579247 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-47186402-0127-4dc7-9c07-a03b7dd29cd5 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:30:59.601950 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:30:59.603885 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-47186402-0127-4dc7-9c07-a03b7dd29cd5 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:59.609295 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-47186402-0127-4dc7-9c07-a03b7dd29cd5 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:59.609984 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-47186402-0127-4dc7-9c07-a03b7dd29cd5 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:59.611359 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-47186402-0127-4dc7-9c07-a03b7dd29cd5 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:30:59.616071 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-47186402-0127-4dc7-9c07-a03b7dd29cd5 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:30:59.616733 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-47186402-0127-4dc7-9c07-a03b7dd29cd5 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:30:59.665426 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-47186402-0127-4dc7-9c07-a03b7dd29cd5 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] HTTP exception thrown: Instance 09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f could not be found. Oct 27 03:30:59.674094 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-47186402-0127-4dc7-9c07-a03b7dd29cd5 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Request method failure captured: Oct 27 03:30:59.674094 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f HTTP/1.1 Oct 27 03:30:59.674094 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:30:59.674094 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:30:59.674094 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:30:59.674094 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:30:59.674094 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:30:59.674094 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:30:59.674094 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:30:59.674094 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:30:59.674094 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfmcLXVlJ87-MXRKNjaUe19vVKJ2Fj8yaQ4rCyjuqMOIWaDFGGZrDqnfADuZ1nCyoKEw6vBAg8i8V0kozCLM9CScZxoLwwhXYPlf5Ev3YUWB_OJVYaHs5Zsx7HPVT0Hxr2x3sAFXtd4C3YaCfjKiqLn19y4TRBms2l6d5FjlOxJyEHo Oct 27 03:30:59.674094 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:30:59.674094 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:30:59.674094 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:30:59.674094 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:30:59.674094 n-d-862769-1 devstack@n-api.service[121001]: X-Openstack-Nova-Api-Version: 2.25 Oct 27 03:30:59.674094 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:30:59.674094 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:30:59.674094 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 3b1cf79289db4d7883d93ec3fe908d66 Oct 27 03:30:59.674094 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1617781299 Oct 27 03:30:59.674094 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:30:59.674094 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:30:59.674094 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3b1cf79289db4d7883d93ec3fe908d66"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3b1cf79289db4d7883d93ec3fe908d66"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3b1cf79289db4d7883d93ec3fe908d66"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3b1cf79289db4d7883d93ec3fe908d66"}]}] Oct 27 03:30:59.674094 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1617781299 Oct 27 03:30:59.674094 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 3b1cf79289db4d7883d93ec3fe908d66 Oct 27 03:30:59.674094 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1617781299 Oct 27 03:30:59.674094 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-LiveAutoBlockMigrationV225Test-1617781299-project Oct 27 03:30:59.674094 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:30:59.674094 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:30:59.674094 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: ba3ce7f040d24c33bcf9b97d1ef25268 Oct 27 03:30:59.674094 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1617781299-project Oct 27 03:30:59.674094 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:30:59.674094 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f could not be found. Oct 27 03:30:59.674094 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f'} Oct 27 03:30:59.674094 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:30:59.674094 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:59.674094 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:30:59.674094 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:30:59.674094 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:30:59.674094 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:30:59.674094 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:30:59.674094 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:30:59.674094 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:30:59.674094 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:30:59.674094 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f could not be found. Oct 27 03:30:59.674094 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:59.674094 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:30:59.674094 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:59.674094 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:59.674094 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:30:59.674094 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:30:59.674094 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:30:59.674094 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:30:59.674094 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:30:59.674094 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:30:59.674094 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:30:59.674094 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:30:59.674094 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:30:59.674094 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:30:59.674094 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:30:59.674094 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:30:59.674094 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f could not be found. Oct 27 03:30:59.674094 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:59.678512 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:30:59.678512 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:59.678512 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:30:59.678512 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:30:59.678512 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:30:59.678512 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:30:59.678512 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:30:59.678512 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f could not be found. Oct 27 03:30:59.678512 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:30:59.682827 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-47186402-0127-4dc7-9c07-a03b7dd29cd5 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Returning 404 to user: Instance 09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:30:59.691095 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-47186402-0127-4dc7-9c07-a03b7dd29cd5 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f" status: 404 len: 111 microversion: 2.25 time: 0.126170 Oct 27 03:30:59.693262 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1352/2635] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:30:59 2022] GET /compute/v2.1/servers/09f6be2c-4ec4-4a3c-bf6f-3cfdd945ec3f => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 03:30:59.711191 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-43708e34-0690-4656-a18f-d6a307c857ef tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '.version_select at 0x7f7dd9fe2160>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:30:59.835084 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-43708e34-0690-4656-a18f-d6a307c857ef tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-311856655" status: 204 len: 0 microversion: 2.25 time: 0.135680 Oct 27 03:30:59.836299 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1353/2636] 10.222.0.20 () {60 vars in 1259 bytes} [Thu Oct 27 03:30:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-311856655 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 03:31:00.590676 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5a87d41e-a5cc-4bcc-929c-ae75313f4989 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:00.591316 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5a87d41e-a5cc-4bcc-929c-ae75313f4989 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] [instance: 2023265c-1a97-4ed8-8af7-f83077e4bfa5] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:31:00.616714 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5a87d41e-a5cc-4bcc-929c-ae75313f4989 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:00.620134 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5a87d41e-a5cc-4bcc-929c-ae75313f4989 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:00.624377 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5a87d41e-a5cc-4bcc-929c-ae75313f4989 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:00.625493 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5a87d41e-a5cc-4bcc-929c-ae75313f4989 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:00.630498 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5a87d41e-a5cc-4bcc-929c-ae75313f4989 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:00.633628 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5a87d41e-a5cc-4bcc-929c-ae75313f4989 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:02.279973 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5a87d41e-a5cc-4bcc-929c-ae75313f4989 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce351a48282492e8cd69b9a5a05f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5514904d799d4f5dae454193e70d85f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:31:02.289082 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5a87d41e-a5cc-4bcc-929c-ae75313f4989 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] 10.222.0.20 "GET /compute/v2.1/servers/2023265c-1a97-4ed8-8af7-f83077e4bfa5" status: 200 len: 1293 microversion: 2.1 time: 1.703139 Oct 27 03:31:02.289676 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1354/2637] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:31:00 2022] GET /compute/v2.1/servers/2023265c-1a97-4ed8-8af7-f83077e4bfa5 => generated 1293 bytes in 1704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:31:02.314332 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-fac37e85-12ac-4482-83fc-a63841136c2f req-6b4b8a20-00c0-4c54-b85d-2f7b8d3d1974 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2023265c-1a97-4ed8-8af7-f83077e4bfa5", "name": "network-vif-plugged", "status": "completed", "tag": "d7f2255f-3f7c-496f-a704-dc240ed9e307"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:31:02.388473 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-fac37e85-12ac-4482-83fc-a63841136c2f req-6b4b8a20-00c0-4c54-b85d-2f7b8d3d1974 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:02.390120 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-fac37e85-12ac-4482-83fc-a63841136c2f req-6b4b8a20-00c0-4c54-b85d-2f7b8d3d1974 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:02.390751 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-fac37e85-12ac-4482-83fc-a63841136c2f req-6b4b8a20-00c0-4c54-b85d-2f7b8d3d1974 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:02.432218 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-fac37e85-12ac-4482-83fc-a63841136c2f req-6b4b8a20-00c0-4c54-b85d-2f7b8d3d1974 service nova] Creating event network-vif-plugged:d7f2255f-3f7c-496f-a704-dc240ed9e307 for instance 2023265c-1a97-4ed8-8af7-f83077e4bfa5 on n-h2-862769-1 Oct 27 03:31:02.451787 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-fac37e85-12ac-4482-83fc-a63841136c2f req-6b4b8a20-00c0-4c54-b85d-2f7b8d3d1974 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148546 Oct 27 03:31:02.467094 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1355/2638] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:31:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:31:02.949322 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6a675b90-0893-4704-85ee-16a1895b99b0 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:02.953684 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-6a675b90-0893-4704-85ee-16a1895b99b0 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 8559e641-f41e-4b21-88b1-56d57ded5ce6] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:31:02.957300 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6a675b90-0893-4704-85ee-16a1895b99b0 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:02.958010 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6a675b90-0893-4704-85ee-16a1895b99b0 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:02.958474 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6a675b90-0893-4704-85ee-16a1895b99b0 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:02.959352 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6a675b90-0893-4704-85ee-16a1895b99b0 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:02.959971 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6a675b90-0893-4704-85ee-16a1895b99b0 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:02.960711 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6a675b90-0893-4704-85ee-16a1895b99b0 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:03.008330 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-6a675b90-0893-4704-85ee-16a1895b99b0 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 8559e641-f41e-4b21-88b1-56d57ded5ce6] Going to try to terminate instance {{(pid=121001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:31:03.391140 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6a675b90-0893-4704-85ee-16a1895b99b0 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8559e641-f41e-4b21-88b1-56d57ded5ce6" status: 204 len: 0 microversion: 2.25 time: 0.446298 Oct 27 03:31:03.392413 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1356/2639] 10.222.0.20 () {60 vars in 1280 bytes} [Thu Oct 27 03:31:02 2022] DELETE /compute/v2.1/servers/8559e641-f41e-4b21-88b1-56d57ded5ce6 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 27 03:31:03.398495 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-aa7168a1-ecbf-4af0-81fd-67ad823e425d tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:03.399424 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-aa7168a1-ecbf-4af0-81fd-67ad823e425d tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] [instance: 2023265c-1a97-4ed8-8af7-f83077e4bfa5] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:31:03.415137 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aa7168a1-ecbf-4af0-81fd-67ad823e425d tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:03.418312 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aa7168a1-ecbf-4af0-81fd-67ad823e425d tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:03.420736 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aa7168a1-ecbf-4af0-81fd-67ad823e425d tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:03.421684 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aa7168a1-ecbf-4af0-81fd-67ad823e425d tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:03.423998 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aa7168a1-ecbf-4af0-81fd-67ad823e425d tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:03.425280 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aa7168a1-ecbf-4af0-81fd-67ad823e425d tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:03.819305 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-aa7168a1-ecbf-4af0-81fd-67ad823e425d tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce351a48282492e8cd69b9a5a05f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5514904d799d4f5dae454193e70d85f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:31:03.828138 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-aa7168a1-ecbf-4af0-81fd-67ad823e425d tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] 10.222.0.20 "GET /compute/v2.1/servers/2023265c-1a97-4ed8-8af7-f83077e4bfa5" status: 200 len: 1293 microversion: 2.1 time: 0.434069 Oct 27 03:31:03.829199 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1357/2640] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:31:03 2022] GET /compute/v2.1/servers/2023265c-1a97-4ed8-8af7-f83077e4bfa5 => generated 1293 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:31:03.845185 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-72353a8b-c1fc-4c16-9b38-f33d525b20fb tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:03.845889 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-72353a8b-c1fc-4c16-9b38-f33d525b20fb tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 8559e641-f41e-4b21-88b1-56d57ded5ce6] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:31:03.863725 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-72353a8b-c1fc-4c16-9b38-f33d525b20fb tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:03.863725 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-72353a8b-c1fc-4c16-9b38-f33d525b20fb tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:03.863725 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-72353a8b-c1fc-4c16-9b38-f33d525b20fb tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:03.863725 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-72353a8b-c1fc-4c16-9b38-f33d525b20fb tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:03.863725 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-72353a8b-c1fc-4c16-9b38-f33d525b20fb tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:03.866962 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-72353a8b-c1fc-4c16-9b38-f33d525b20fb tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:04.265980 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-72353a8b-c1fc-4c16-9b38-f33d525b20fb tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:31:04.277382 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-72353a8b-c1fc-4c16-9b38-f33d525b20fb tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:31:04.279488 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-72353a8b-c1fc-4c16-9b38-f33d525b20fb tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:31:04.291536 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-72353a8b-c1fc-4c16-9b38-f33d525b20fb tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/8559e641-f41e-4b21-88b1-56d57ded5ce6" status: 200 len: 1548 microversion: 2.25 time: 0.461189 Oct 27 03:31:04.294712 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1358/2641] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:31:03 2022] GET /compute/v2.1/servers/8559e641-f41e-4b21-88b1-56d57ded5ce6 => generated 1548 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:31:04.499954 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-cc5804f9-5335-4329-be46-92047455a4b5 req-3fb40eff-30d1-4bc5-8d75-f137903d6c4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0c6560f-ade1-4ae6-905e-ad488f4c3b51", "name": "network-vif-plugged", "status": "completed", "tag": "374bf7dd-46fc-42a5-a069-b8b5708a33a0"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:31:04.549853 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-cc5804f9-5335-4329-be46-92047455a4b5 req-3fb40eff-30d1-4bc5-8d75-f137903d6c4e service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:04.559661 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-cc5804f9-5335-4329-be46-92047455a4b5 req-3fb40eff-30d1-4bc5-8d75-f137903d6c4e service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:04.559661 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-cc5804f9-5335-4329-be46-92047455a4b5 req-3fb40eff-30d1-4bc5-8d75-f137903d6c4e service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:04.622916 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-cc5804f9-5335-4329-be46-92047455a4b5 req-3fb40eff-30d1-4bc5-8d75-f137903d6c4e service nova] Creating event network-vif-plugged:374bf7dd-46fc-42a5-a069-b8b5708a33a0 for instance b0c6560f-ade1-4ae6-905e-ad488f4c3b51 on n-h2-862769-1 Oct 27 03:31:04.643701 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-cc5804f9-5335-4329-be46-92047455a4b5 req-3fb40eff-30d1-4bc5-8d75-f137903d6c4e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146567 Oct 27 03:31:04.644809 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1359/2642] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:31:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:31:04.860941 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-af24ed89-3f0e-47a9-8085-722ce83145f0 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:04.861897 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-af24ed89-3f0e-47a9-8085-722ce83145f0 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] [instance: 2023265c-1a97-4ed8-8af7-f83077e4bfa5] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:31:04.887933 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-af24ed89-3f0e-47a9-8085-722ce83145f0 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:04.890590 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-af24ed89-3f0e-47a9-8085-722ce83145f0 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:04.895539 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-af24ed89-3f0e-47a9-8085-722ce83145f0 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:04.897776 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-af24ed89-3f0e-47a9-8085-722ce83145f0 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:04.903972 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-af24ed89-3f0e-47a9-8085-722ce83145f0 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:04.916864 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-af24ed89-3f0e-47a9-8085-722ce83145f0 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:05.283108 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-af24ed89-3f0e-47a9-8085-722ce83145f0 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce351a48282492e8cd69b9a5a05f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5514904d799d4f5dae454193e70d85f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:31:05.295644 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-af24ed89-3f0e-47a9-8085-722ce83145f0 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] 10.222.0.20 "GET /compute/v2.1/servers/2023265c-1a97-4ed8-8af7-f83077e4bfa5" status: 200 len: 1293 microversion: 2.1 time: 0.439690 Oct 27 03:31:05.310105 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1360/2643] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:31:04 2022] GET /compute/v2.1/servers/2023265c-1a97-4ed8-8af7-f83077e4bfa5 => generated 1293 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:31:05.341810 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-aea9fd22-2593-4ffd-a246-865d9cc3f5ba tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:05.352993 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-aea9fd22-2593-4ffd-a246-865d9cc3f5ba tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 8559e641-f41e-4b21-88b1-56d57ded5ce6] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:31:05.411582 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aea9fd22-2593-4ffd-a246-865d9cc3f5ba tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:05.412083 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aea9fd22-2593-4ffd-a246-865d9cc3f5ba tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:05.413328 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aea9fd22-2593-4ffd-a246-865d9cc3f5ba tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:05.414853 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aea9fd22-2593-4ffd-a246-865d9cc3f5ba tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:05.416809 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aea9fd22-2593-4ffd-a246-865d9cc3f5ba tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:05.418762 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aea9fd22-2593-4ffd-a246-865d9cc3f5ba tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:05.854602 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-aea9fd22-2593-4ffd-a246-865d9cc3f5ba tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:31:05.868371 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-aea9fd22-2593-4ffd-a246-865d9cc3f5ba tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:31:05.873338 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-aea9fd22-2593-4ffd-a246-865d9cc3f5ba tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:31:05.874593 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-aea9fd22-2593-4ffd-a246-865d9cc3f5ba tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/8559e641-f41e-4b21-88b1-56d57ded5ce6" status: 200 len: 1548 microversion: 2.25 time: 0.552657 Oct 27 03:31:05.875650 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1361/2644] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:31:05 2022] GET /compute/v2.1/servers/8559e641-f41e-4b21-88b1-56d57ded5ce6 => generated 1548 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:31:06.161513 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-968c285f-d3a2-406d-a71f-429387b12a16 tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] Action: 'update', calling method: .version_select at 0x7f7dd9f8be50>, body: {"quota_set": {"ram": "5120"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:31:06.457962 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-968c285f-d3a2-406d-a71f-429387b12a16 tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:06.464706 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-968c285f-d3a2-406d-a71f-429387b12a16 tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:06.468181 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-968c285f-d3a2-406d-a71f-429387b12a16 tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:06.473673 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-968c285f-d3a2-406d-a71f-429387b12a16 tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:06.481893 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-968c285f-d3a2-406d-a71f-429387b12a16 tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:06.481893 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-968c285f-d3a2-406d-a71f-429387b12a16 tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:06.546626 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:31:06.800191 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-968c285f-d3a2-406d-a71f-429387b12a16 tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/a270e2227807437c882f38d60d53fcdc" status: 200 len: 148 microversion: 2.57 time: 0.923287 Oct 27 03:31:06.801875 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:31:06.810578 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1362/2645] 10.222.0.20 () {62 vars in 1303 bytes} [Thu Oct 27 03:31:05 2022] PUT /compute/v2.1/os-quota-sets/a270e2227807437c882f38d60d53fcdc => generated 148 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 03:31:06.844421 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-938088cf-b1ae-41a4-b99b-0a44810145ed tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:06.853503 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-938088cf-b1ae-41a4-b99b-0a44810145ed tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] [instance: 2023265c-1a97-4ed8-8af7-f83077e4bfa5] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:31:06.870227 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-938088cf-b1ae-41a4-b99b-0a44810145ed tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:06.870779 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-938088cf-b1ae-41a4-b99b-0a44810145ed tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:06.871218 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-938088cf-b1ae-41a4-b99b-0a44810145ed tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:06.873041 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-938088cf-b1ae-41a4-b99b-0a44810145ed tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:06.873663 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-938088cf-b1ae-41a4-b99b-0a44810145ed tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:06.874281 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-938088cf-b1ae-41a4-b99b-0a44810145ed tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:07.461504 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-938088cf-b1ae-41a4-b99b-0a44810145ed tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce351a48282492e8cd69b9a5a05f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5514904d799d4f5dae454193e70d85f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:31:07.471022 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-938088cf-b1ae-41a4-b99b-0a44810145ed tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] 10.222.0.20 "GET /compute/v2.1/servers/2023265c-1a97-4ed8-8af7-f83077e4bfa5" status: 200 len: 1485 microversion: 2.1 time: 0.656814 Oct 27 03:31:07.487401 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1363/2646] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:31:06 2022] GET /compute/v2.1/servers/2023265c-1a97-4ed8-8af7-f83077e4bfa5 => generated 1485 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:31:07.501654 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8479b5a3-36ea-4291-a876-0ee31c5c4cb0 tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] Calling method '.version_select at 0x7f7dd9fa19d0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:08.053421 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8479b5a3-36ea-4291-a876-0ee31c5c4cb0 tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:08.055275 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8479b5a3-36ea-4291-a876-0ee31c5c4cb0 tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:08.056351 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8479b5a3-36ea-4291-a876-0ee31c5c4cb0 tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:08.059168 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8479b5a3-36ea-4291-a876-0ee31c5c4cb0 tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:08.059880 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8479b5a3-36ea-4291-a876-0ee31c5c4cb0 tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:08.060534 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8479b5a3-36ea-4291-a876-0ee31c5c4cb0 tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:08.103870 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8479b5a3-36ea-4291-a876-0ee31c5c4cb0 tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/a270e2227807437c882f38d60d53fcdc/detail" status: 200 len: 463 microversion: 2.57 time: 0.614138 Oct 27 03:31:08.116679 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1364/2647] 10.222.0.20 () {60 vars in 1304 bytes} [Thu Oct 27 03:31:07 2022] GET /compute/v2.1/os-quota-sets/a270e2227807437c882f38d60d53fcdc/detail => generated 463 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 03:31:08.127922 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f91a5243-bf70-42e8-905f-dab7ca0158c7 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:08.128827 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f91a5243-bf70-42e8-905f-dab7ca0158c7 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 8559e641-f41e-4b21-88b1-56d57ded5ce6] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:31:08.138918 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f91a5243-bf70-42e8-905f-dab7ca0158c7 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:08.139566 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f91a5243-bf70-42e8-905f-dab7ca0158c7 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:08.140156 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f91a5243-bf70-42e8-905f-dab7ca0158c7 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:08.141113 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f91a5243-bf70-42e8-905f-dab7ca0158c7 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:08.141663 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f91a5243-bf70-42e8-905f-dab7ca0158c7 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:08.142276 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f91a5243-bf70-42e8-905f-dab7ca0158c7 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:08.172583 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:31:08.466662 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f91a5243-bf70-42e8-905f-dab7ca0158c7 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:31:08.480740 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f91a5243-bf70-42e8-905f-dab7ca0158c7 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:31:08.490494 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f91a5243-bf70-42e8-905f-dab7ca0158c7 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:31:08.499916 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f91a5243-bf70-42e8-905f-dab7ca0158c7 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/8559e641-f41e-4b21-88b1-56d57ded5ce6" status: 200 len: 1506 microversion: 2.25 time: 0.378521 Oct 27 03:31:08.500563 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1365/2648] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:31:08 2022] GET /compute/v2.1/servers/8559e641-f41e-4b21-88b1-56d57ded5ce6 => generated 1506 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:31:08.545245 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-03503736-6057-4b13-b729-b00d208808c3 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:08.545881 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-03503736-6057-4b13-b729-b00d208808c3 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] [instance: 2023265c-1a97-4ed8-8af7-f83077e4bfa5] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:31:08.585036 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-03503736-6057-4b13-b729-b00d208808c3 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:08.585542 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-03503736-6057-4b13-b729-b00d208808c3 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:08.585995 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-03503736-6057-4b13-b729-b00d208808c3 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:08.586744 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-03503736-6057-4b13-b729-b00d208808c3 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:08.587207 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-03503736-6057-4b13-b729-b00d208808c3 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:08.587642 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-03503736-6057-4b13-b729-b00d208808c3 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:09.157216 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-03503736-6057-4b13-b729-b00d208808c3 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] 10.222.0.20 "GET /compute/v2.1/servers/2023265c-1a97-4ed8-8af7-f83077e4bfa5/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.631679 Oct 27 03:31:09.157882 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1366/2649] 10.222.0.20 () {58 vars in 1275 bytes} [Thu Oct 27 03:31:08 2022] GET /compute/v2.1/servers/2023265c-1a97-4ed8-8af7-f83077e4bfa5/os-interface => generated 285 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:31:09.168538 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-db9c5293-240d-4f6f-928a-443515d513b6 req-502a2021-a7c7-409d-ad47-150cc640f349 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8559e641-f41e-4b21-88b1-56d57ded5ce6", "name": "network-vif-deleted", "tag": "959f9b77-f7a5-423f-9c4f-1a5a89ebede9"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:31:09.209289 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-db9c5293-240d-4f6f-928a-443515d513b6 req-502a2021-a7c7-409d-ad47-150cc640f349 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:09.209721 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-db9c5293-240d-4f6f-928a-443515d513b6 req-502a2021-a7c7-409d-ad47-150cc640f349 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:09.216493 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-db9c5293-240d-4f6f-928a-443515d513b6 req-502a2021-a7c7-409d-ad47-150cc640f349 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:09.241337 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-db9c5293-240d-4f6f-928a-443515d513b6 req-502a2021-a7c7-409d-ad47-150cc640f349 service nova] Creating event network-vif-deleted:959f9b77-f7a5-423f-9c4f-1a5a89ebede9 for instance 8559e641-f41e-4b21-88b1-56d57ded5ce6 on n-h1-862769-1 Oct 27 03:31:09.247403 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-db9c5293-240d-4f6f-928a-443515d513b6 req-502a2021-a7c7-409d-ad47-150cc640f349 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087682 Oct 27 03:31:09.252638 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1367/2650] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:31:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:31:09.259055 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-38d77480-1a95-4493-9687-aadb5c77f829 tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] Action: 'update', calling method: .version_select at 0x7f7dd9f910d0>, body: {"quota_set": {"ram": "2048"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:31:09.391336 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-38d77480-1a95-4493-9687-aadb5c77f829 tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:09.392182 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-38d77480-1a95-4493-9687-aadb5c77f829 tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:09.392838 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-38d77480-1a95-4493-9687-aadb5c77f829 tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:09.394841 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-38d77480-1a95-4493-9687-aadb5c77f829 tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:09.395523 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-38d77480-1a95-4493-9687-aadb5c77f829 tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:09.396289 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-38d77480-1a95-4493-9687-aadb5c77f829 tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:09.461600 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-38d77480-1a95-4493-9687-aadb5c77f829 tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:09.462279 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-38d77480-1a95-4493-9687-aadb5c77f829 tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:09.463167 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-38d77480-1a95-4493-9687-aadb5c77f829 tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:09.464123 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-38d77480-1a95-4493-9687-aadb5c77f829 tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:09.464817 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-38d77480-1a95-4493-9687-aadb5c77f829 tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:09.466281 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-38d77480-1a95-4493-9687-aadb5c77f829 tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:09.760508 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-38d77480-1a95-4493-9687-aadb5c77f829 tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/a270e2227807437c882f38d60d53fcdc?user_id=55e9346cddfc414ca368940e6b1bbc2a" status: 200 len: 148 microversion: 2.57 time: 0.490801 Oct 27 03:31:09.773429 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1368/2651] 10.222.0.20 () {62 vars in 1384 bytes} [Thu Oct 27 03:31:09 2022] PUT /compute/v2.1/os-quota-sets/a270e2227807437c882f38d60d53fcdc?user_id=55e9346cddfc414ca368940e6b1bbc2a => generated 148 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 03:31:09.801904 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d12a09fd-ce68-4038-ade1-2cc9e39ad936 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:09.808264 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d12a09fd-ce68-4038-ade1-2cc9e39ad936 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 8559e641-f41e-4b21-88b1-56d57ded5ce6] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:31:09.843326 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d12a09fd-ce68-4038-ade1-2cc9e39ad936 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:09.846051 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d12a09fd-ce68-4038-ade1-2cc9e39ad936 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:09.849465 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d12a09fd-ce68-4038-ade1-2cc9e39ad936 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:09.854990 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d12a09fd-ce68-4038-ade1-2cc9e39ad936 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:09.856656 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d12a09fd-ce68-4038-ade1-2cc9e39ad936 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:09.861051 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d12a09fd-ce68-4038-ade1-2cc9e39ad936 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:09.881996 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-d12a09fd-ce68-4038-ade1-2cc9e39ad936 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] HTTP exception thrown: Instance 8559e641-f41e-4b21-88b1-56d57ded5ce6 could not be found. Oct 27 03:31:09.884113 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d12a09fd-ce68-4038-ade1-2cc9e39ad936 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Request method failure captured: Oct 27 03:31:09.884113 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/8559e641-f41e-4b21-88b1-56d57ded5ce6 HTTP/1.1 Oct 27 03:31:09.884113 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:31:09.884113 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:31:09.884113 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:31:09.884113 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:31:09.884113 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:31:09.884113 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:31:09.884113 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:31:09.884113 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:31:09.884113 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfmcLXVlJ87-MXRKNjaUe19vVKJ2Fj8yaQ4rCyjuqMOIWaDFGGZrDqnfADuZ1nCyoKEw6vBAg8i8V0kozCLM9CScZxoLwwhXYPlf5Ev3YUWB_OJVYaHs5Zsx7HPVT0Hxr2x3sAFXtd4C3YaCfjKiqLn19y4TRBms2l6d5FjlOxJyEHo Oct 27 03:31:09.884113 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:31:09.884113 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:31:09.884113 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:31:09.884113 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:31:09.884113 n-d-862769-1 devstack@n-api.service[121001]: X-Openstack-Nova-Api-Version: 2.25 Oct 27 03:31:09.884113 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:31:09.884113 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:31:09.884113 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 3b1cf79289db4d7883d93ec3fe908d66 Oct 27 03:31:09.884113 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1617781299 Oct 27 03:31:09.884113 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:31:09.884113 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:31:09.884113 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3b1cf79289db4d7883d93ec3fe908d66"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3b1cf79289db4d7883d93ec3fe908d66"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3b1cf79289db4d7883d93ec3fe908d66"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3b1cf79289db4d7883d93ec3fe908d66"}]}] Oct 27 03:31:09.884113 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1617781299 Oct 27 03:31:09.884113 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 3b1cf79289db4d7883d93ec3fe908d66 Oct 27 03:31:09.884113 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1617781299 Oct 27 03:31:09.884113 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-LiveAutoBlockMigrationV225Test-1617781299-project Oct 27 03:31:09.884113 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:31:09.884113 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:31:09.884113 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: ba3ce7f040d24c33bcf9b97d1ef25268 Oct 27 03:31:09.884113 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1617781299-project Oct 27 03:31:09.884113 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:31:09.884113 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 8559e641-f41e-4b21-88b1-56d57ded5ce6 could not be found. Oct 27 03:31:09.884113 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '8559e641-f41e-4b21-88b1-56d57ded5ce6'} Oct 27 03:31:09.884113 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:31:09.884113 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:31:09.884113 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:31:09.884113 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:31:09.884113 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:31:09.884113 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:31:09.884113 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:31:09.884113 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:31:09.884113 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:31:09.884113 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:31:09.884113 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8559e641-f41e-4b21-88b1-56d57ded5ce6 could not be found. Oct 27 03:31:09.884113 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:31:09.884113 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:31:09.884113 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:31:09.884113 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:31:09.884113 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:31:09.884113 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:31:09.884113 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:31:09.884113 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:31:09.884113 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:31:09.884113 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:31:09.884113 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:31:09.884113 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:31:09.884113 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:31:09.884113 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:31:09.884113 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:31:09.884113 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:31:09.884113 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8559e641-f41e-4b21-88b1-56d57ded5ce6 could not be found. Oct 27 03:31:09.884113 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:31:09.887891 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:31:09.887891 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:31:09.887891 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:31:09.887891 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:31:09.887891 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:31:09.887891 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:31:09.887891 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:31:09.887891 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8559e641-f41e-4b21-88b1-56d57ded5ce6 could not be found. Oct 27 03:31:09.887891 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:31:09.889818 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d12a09fd-ce68-4038-ade1-2cc9e39ad936 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Returning 404 to user: Instance 8559e641-f41e-4b21-88b1-56d57ded5ce6 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:31:09.890979 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d12a09fd-ce68-4038-ade1-2cc9e39ad936 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/8559e641-f41e-4b21-88b1-56d57ded5ce6" status: 404 len: 111 microversion: 2.25 time: 0.116282 Oct 27 03:31:09.906662 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1369/2652] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:31:09 2022] GET /compute/v2.1/servers/8559e641-f41e-4b21-88b1-56d57ded5ce6 => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 03:31:09.916738 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-db6cc6f9-6e91-4649-90db-df08856ca6e9 tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] Calling method '.version_select at 0x7f7dd9f91c10>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:10.119956 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-db6cc6f9-6e91-4649-90db-df08856ca6e9 tempest-QuotasAdminTestV257-1013110060 tempest-QuotasAdminTestV257-1013110060-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/a270e2227807437c882f38d60d53fcdc?user_id=55e9346cddfc414ca368940e6b1bbc2a" status: 200 len: 190 microversion: 2.57 time: 0.206338 Oct 27 03:31:10.120538 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1370/2653] 10.222.0.20 () {60 vars in 1364 bytes} [Thu Oct 27 03:31:09 2022] GET /compute/v2.1/os-quota-sets/a270e2227807437c882f38d60d53fcdc?user_id=55e9346cddfc414ca368940e6b1bbc2a => generated 190 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 03:31:10.144580 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0bb68fdf-3156-4059-b6de-f39125c3f697 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:10.145120 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0bb68fdf-3156-4059-b6de-f39125c3f697 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 87ad30f8-b432-45dc-82ff-aed508afddd7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:31:10.167400 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0bb68fdf-3156-4059-b6de-f39125c3f697 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:10.169606 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0bb68fdf-3156-4059-b6de-f39125c3f697 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:10.170853 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0bb68fdf-3156-4059-b6de-f39125c3f697 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:10.172088 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0bb68fdf-3156-4059-b6de-f39125c3f697 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:10.178980 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0bb68fdf-3156-4059-b6de-f39125c3f697 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:10.180656 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0bb68fdf-3156-4059-b6de-f39125c3f697 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:10.260819 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0bb68fdf-3156-4059-b6de-f39125c3f697 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 87ad30f8-b432-45dc-82ff-aed508afddd7] Going to try to terminate instance {{(pid=121001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:31:10.624535 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0bb68fdf-3156-4059-b6de-f39125c3f697 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "DELETE /compute/v2.1/servers/87ad30f8-b432-45dc-82ff-aed508afddd7" status: 204 len: 0 microversion: 2.25 time: 0.494649 Oct 27 03:31:10.625127 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1371/2654] 10.222.0.20 () {60 vars in 1280 bytes} [Thu Oct 27 03:31:10 2022] DELETE /compute/v2.1/servers/87ad30f8-b432-45dc-82ff-aed508afddd7 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 03:31:10.652133 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-58cd15c9-3122-4d1a-a95c-63ab3bd1fcaf tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:10.653136 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-58cd15c9-3122-4d1a-a95c-63ab3bd1fcaf tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 87ad30f8-b432-45dc-82ff-aed508afddd7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:31:10.661960 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-58cd15c9-3122-4d1a-a95c-63ab3bd1fcaf tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:10.662708 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-58cd15c9-3122-4d1a-a95c-63ab3bd1fcaf tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:10.663304 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-58cd15c9-3122-4d1a-a95c-63ab3bd1fcaf tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:10.665468 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-58cd15c9-3122-4d1a-a95c-63ab3bd1fcaf tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:10.666127 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-58cd15c9-3122-4d1a-a95c-63ab3bd1fcaf tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:10.666869 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-58cd15c9-3122-4d1a-a95c-63ab3bd1fcaf tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:11.538229 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-58cd15c9-3122-4d1a-a95c-63ab3bd1fcaf tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:31:11.553765 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-58cd15c9-3122-4d1a-a95c-63ab3bd1fcaf tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:31:11.558404 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-58cd15c9-3122-4d1a-a95c-63ab3bd1fcaf tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3ce7f040d24c33bcf9b97d1ef25268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1cf79289db4d7883d93ec3fe908d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:31:11.560332 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-58cd15c9-3122-4d1a-a95c-63ab3bd1fcaf tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/87ad30f8-b432-45dc-82ff-aed508afddd7" status: 200 len: 1565 microversion: 2.25 time: 0.922755 Oct 27 03:31:11.562571 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1372/2655] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:31:10 2022] GET /compute/v2.1/servers/87ad30f8-b432-45dc-82ff-aed508afddd7 => generated 1565 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:31:12.899864 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-71778f60-4afc-46e5-8c08-4a2bea1f0d5d tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1263800951", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:31:19.482669 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=9 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:31:20.085367 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=26 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:31:21.545468 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:31:21.918382 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5691ca87-8aec-423b-aec8-0c46e0061cf0 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] 10.222.0.20 "GET /compute/v2.1/images/1a2e38d2-514f-48c2-b314-d5c9f52051f1" status: 200 len: 1424 microversion: 2.1 time: 24.661450 Oct 27 03:31:21.931466 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.network.neutron [None req-71778f60-4afc-46e5-8c08-4a2bea1f0d5d tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] validate_networks() for [('e0ec55c0-c84d-4137-b98d-abccae35dfd4', None, None, None, None, None)] {{(pid=121001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:31:21.931552 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1284/2656] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:30:57 2022] GET /compute/v2.1/images/1a2e38d2-514f-48c2-b314-d5c9f52051f1 => generated 1424 bytes in 24664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:31:21.935562 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c6794dbd-6b38-446a-9dbf-19644e087e30 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:21.941265 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c6794dbd-6b38-446a-9dbf-19644e087e30 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] [instance: 87ad30f8-b432-45dc-82ff-aed508afddd7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:31:21.981453 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c6794dbd-6b38-446a-9dbf-19644e087e30 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:21.983861 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c6794dbd-6b38-446a-9dbf-19644e087e30 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:21.989274 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c6794dbd-6b38-446a-9dbf-19644e087e30 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:21.989274 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c6794dbd-6b38-446a-9dbf-19644e087e30 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:21.989274 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c6794dbd-6b38-446a-9dbf-19644e087e30 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:21.989274 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c6794dbd-6b38-446a-9dbf-19644e087e30 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:22.026473 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-c6794dbd-6b38-446a-9dbf-19644e087e30 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] HTTP exception thrown: Instance 87ad30f8-b432-45dc-82ff-aed508afddd7 could not be found. Oct 27 03:31:22.031746 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c6794dbd-6b38-446a-9dbf-19644e087e30 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Request method failure captured: Oct 27 03:31:22.031746 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/87ad30f8-b432-45dc-82ff-aed508afddd7 HTTP/1.1 Oct 27 03:31:22.031746 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:31:22.031746 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:31:22.031746 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:31:22.031746 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:31:22.031746 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:31:22.031746 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:31:22.031746 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:31:22.031746 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:31:22.031746 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfmcLXVlJ87-MXRKNjaUe19vVKJ2Fj8yaQ4rCyjuqMOIWaDFGGZrDqnfADuZ1nCyoKEw6vBAg8i8V0kozCLM9CScZxoLwwhXYPlf5Ev3YUWB_OJVYaHs5Zsx7HPVT0Hxr2x3sAFXtd4C3YaCfjKiqLn19y4TRBms2l6d5FjlOxJyEHo Oct 27 03:31:22.031746 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:31:22.031746 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:31:22.031746 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:31:22.031746 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:31:22.031746 n-d-862769-1 devstack@n-api.service[121000]: X-Openstack-Nova-Api-Version: 2.25 Oct 27 03:31:22.031746 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:31:22.031746 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:31:22.031746 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 3b1cf79289db4d7883d93ec3fe908d66 Oct 27 03:31:22.031746 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1617781299 Oct 27 03:31:22.031746 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:31:22.031746 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:31:22.031746 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3b1cf79289db4d7883d93ec3fe908d66"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3b1cf79289db4d7883d93ec3fe908d66"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3b1cf79289db4d7883d93ec3fe908d66"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3b1cf79289db4d7883d93ec3fe908d66"}]}] Oct 27 03:31:22.031746 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1617781299 Oct 27 03:31:22.031746 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 3b1cf79289db4d7883d93ec3fe908d66 Oct 27 03:31:22.031746 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1617781299 Oct 27 03:31:22.031746 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-LiveAutoBlockMigrationV225Test-1617781299-project Oct 27 03:31:22.031746 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:31:22.031746 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:31:22.031746 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: ba3ce7f040d24c33bcf9b97d1ef25268 Oct 27 03:31:22.031746 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1617781299-project Oct 27 03:31:22.031746 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:31:22.031746 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 87ad30f8-b432-45dc-82ff-aed508afddd7 could not be found. Oct 27 03:31:22.031746 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '87ad30f8-b432-45dc-82ff-aed508afddd7'} Oct 27 03:31:22.031746 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:31:22.031746 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:31:22.031746 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:31:22.031746 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:31:22.031746 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:31:22.031746 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:31:22.031746 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:31:22.031746 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:31:22.031746 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:31:22.031746 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:31:22.031746 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87ad30f8-b432-45dc-82ff-aed508afddd7 could not be found. Oct 27 03:31:22.031746 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:31:22.031746 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:31:22.031746 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:31:22.031746 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:31:22.031746 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:31:22.031746 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:31:22.031746 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:31:22.031746 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:31:22.031746 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:31:22.031746 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:31:22.031746 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:31:22.031746 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:31:22.031746 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:31:22.031746 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:31:22.031746 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:31:22.031746 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:31:22.031746 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87ad30f8-b432-45dc-82ff-aed508afddd7 could not be found. Oct 27 03:31:22.031746 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:31:22.036743 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:31:22.036743 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:31:22.036743 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:31:22.036743 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:31:22.036743 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:31:22.036743 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:31:22.036743 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:31:22.036743 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87ad30f8-b432-45dc-82ff-aed508afddd7 could not be found. Oct 27 03:31:22.036743 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:31:22.038070 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c6794dbd-6b38-446a-9dbf-19644e087e30 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] Returning 404 to user: Instance 87ad30f8-b432-45dc-82ff-aed508afddd7 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:31:22.042585 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c6794dbd-6b38-446a-9dbf-19644e087e30 tempest-LiveAutoBlockMigrationV225Test-1617781299 tempest-LiveAutoBlockMigrationV225Test-1617781299-project] 10.222.0.20 "GET /compute/v2.1/servers/87ad30f8-b432-45dc-82ff-aed508afddd7" status: 404 len: 111 microversion: 2.25 time: 0.120621 Oct 27 03:31:22.043860 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1285/2657] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:31:21 2022] GET /compute/v2.1/servers/87ad30f8-b432-45dc-82ff-aed508afddd7 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 03:31:22.688842 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-b45a2830-44d7-4564-9792-897a602a5b08 req-38c2b40c-0e25-4852-b5c2-af78177b3842 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87ad30f8-b432-45dc-82ff-aed508afddd7", "name": "network-vif-deleted", "tag": "e564d375-d22d-4aff-a377-d7085a068b58"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:31:22.708888 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-b45a2830-44d7-4564-9792-897a602a5b08 req-38c2b40c-0e25-4852-b5c2-af78177b3842 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:22.710861 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-b45a2830-44d7-4564-9792-897a602a5b08 req-38c2b40c-0e25-4852-b5c2-af78177b3842 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:22.711314 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-b45a2830-44d7-4564-9792-897a602a5b08 req-38c2b40c-0e25-4852-b5c2-af78177b3842 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:22.743364 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-b45a2830-44d7-4564-9792-897a602a5b08 req-38c2b40c-0e25-4852-b5c2-af78177b3842 service nova] Creating event network-vif-deleted:e564d375-d22d-4aff-a377-d7085a068b58 for instance 87ad30f8-b432-45dc-82ff-aed508afddd7 on n-h1-862769-1 Oct 27 03:31:22.757157 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-b45a2830-44d7-4564-9792-897a602a5b08 req-38c2b40c-0e25-4852-b5c2-af78177b3842 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.711405 Oct 27 03:31:22.758370 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1286/2658] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:31:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:31:22.813128 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7be96bee-5246-4dda-900f-128ddf999047 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:22.814271 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7be96bee-5246-4dda-900f-128ddf999047 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] [instance: 2023265c-1a97-4ed8-8af7-f83077e4bfa5] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:31:22.822518 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7be96bee-5246-4dda-900f-128ddf999047 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:22.823251 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7be96bee-5246-4dda-900f-128ddf999047 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:22.823872 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7be96bee-5246-4dda-900f-128ddf999047 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:22.824767 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7be96bee-5246-4dda-900f-128ddf999047 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:22.825404 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7be96bee-5246-4dda-900f-128ddf999047 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:22.826074 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7be96bee-5246-4dda-900f-128ddf999047 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:22.935196 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:31:23.541138 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-71778f60-4afc-46e5-8c08-4a2bea1f0d5d tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Flavor limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:31:23.542089 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-71778f60-4afc-46e5-8c08-4a2bea1f0d5d tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Image limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:31:23.542957 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-71778f60-4afc-46e5-8c08-4a2bea1f0d5d tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Flavor pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:31:23.543563 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-71778f60-4afc-46e5-8c08-4a2bea1f0d5d tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Image pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:31:23.546287 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-71778f60-4afc-46e5-8c08-4a2bea1f0d5d tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:31:23.562876 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-71778f60-4afc-46e5-8c08-4a2bea1f0d5d tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:23.564037 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-71778f60-4afc-46e5-8c08-4a2bea1f0d5d tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:23.564640 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-71778f60-4afc-46e5-8c08-4a2bea1f0d5d tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:23.566886 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-71778f60-4afc-46e5-8c08-4a2bea1f0d5d tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:23.571990 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-71778f60-4afc-46e5-8c08-4a2bea1f0d5d tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:23.571990 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-71778f60-4afc-46e5-8c08-4a2bea1f0d5d tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:23.598502 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-71778f60-4afc-46e5-8c08-4a2bea1f0d5d tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Getting quotas for project 20d87abf835a4104b40056b9eec2d6b6. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:31:23.608322 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-71778f60-4afc-46e5-8c08-4a2bea1f0d5d tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Getting quotas for user 0533917bc5aa4e23802a43b1eb534bd0 and project 20d87abf835a4104b40056b9eec2d6b6. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:31:23.630783 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-71778f60-4afc-46e5-8c08-4a2bea1f0d5d tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Going to run 1 instances... {{(pid=121001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:31:23.634547 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-71778f60-4afc-46e5-8c08-4a2bea1f0d5d tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] [instance: 0c726bb2-8fea-4b2d-9e57-a585032c3155] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:31:23.808354 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-71778f60-4afc-46e5-8c08-4a2bea1f0d5d tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 11.631771 Oct 27 03:31:23.820924 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1373/2659] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:31:12 2022] POST /compute/v2.1/servers => generated 383 bytes in 11644 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 03:31:23.969808 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-4943fd9b-1c53-4c22-85c1-d930cb95b01a req-3ed2594b-d7c0-4985-b582-4e67ff77087e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2023265c-1a97-4ed8-8af7-f83077e4bfa5", "tag": "d7f2255f-3f7c-496f-a704-dc240ed9e307"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:31:23.988787 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-4943fd9b-1c53-4c22-85c1-d930cb95b01a req-3ed2594b-d7c0-4985-b582-4e67ff77087e service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:23.989619 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-4943fd9b-1c53-4c22-85c1-d930cb95b01a req-3ed2594b-d7c0-4985-b582-4e67ff77087e service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:23.990291 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-4943fd9b-1c53-4c22-85c1-d930cb95b01a req-3ed2594b-d7c0-4985-b582-4e67ff77087e service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:24.003507 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-4943fd9b-1c53-4c22-85c1-d930cb95b01a req-3ed2594b-d7c0-4985-b582-4e67ff77087e service nova] Creating event network-changed:d7f2255f-3f7c-496f-a704-dc240ed9e307 for instance 2023265c-1a97-4ed8-8af7-f83077e4bfa5 on n-h2-862769-1 Oct 27 03:31:24.017627 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-4943fd9b-1c53-4c22-85c1-d930cb95b01a req-3ed2594b-d7c0-4985-b582-4e67ff77087e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.195035 Oct 27 03:31:24.028447 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1374/2660] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:31:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:31:24.042260 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-20b225de-c177-4c12-849b-33bfcaac8d9b tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:24.043317 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-20b225de-c177-4c12-849b-33bfcaac8d9b tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:31:24.055570 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-20b225de-c177-4c12-849b-33bfcaac8d9b tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:24.059058 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-20b225de-c177-4c12-849b-33bfcaac8d9b tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:24.063534 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-20b225de-c177-4c12-849b-33bfcaac8d9b tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:24.068072 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-20b225de-c177-4c12-849b-33bfcaac8d9b tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:24.073083 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-20b225de-c177-4c12-849b-33bfcaac8d9b tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:24.074829 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-20b225de-c177-4c12-849b-33bfcaac8d9b tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:24.241084 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7be96bee-5246-4dda-900f-128ddf999047 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce351a48282492e8cd69b9a5a05f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5514904d799d4f5dae454193e70d85f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:31:24.271454 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7be96bee-5246-4dda-900f-128ddf999047 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] 10.222.0.20 "GET /compute/v2.1/servers/2023265c-1a97-4ed8-8af7-f83077e4bfa5" status: 200 len: 1485 microversion: 2.1 time: 1.507910 Oct 27 03:31:24.271454 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1287/2661] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:31:22 2022] GET /compute/v2.1/servers/2023265c-1a97-4ed8-8af7-f83077e4bfa5 => generated 1485 bytes in 1510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:31:24.648573 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-20b225de-c177-4c12-849b-33bfcaac8d9b tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:31:24.657156 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-15b3ea16-de47-42be-ae39-fd97c908ae20 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-2099365845", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:31:24.678090 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-20b225de-c177-4c12-849b-33bfcaac8d9b tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1669 microversion: 2.1 time: 0.640971 Oct 27 03:31:24.698174 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1375/2662] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:31:24 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1669 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:31:24.719507 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2f0b5880-ed0b-4571-aeac-d8e0ddf246d1 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Calling method '.version_select at 0x7f7dd9fe2040>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:24.862374 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-15b3ea16-de47-42be-ae39-fd97c908ae20 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] validate_networks() for None {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:31:24.886287 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2f0b5880-ed0b-4571-aeac-d8e0ddf246d1 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] 10.222.0.20 "GET /compute/v2.1/images/1a2e38d2-514f-48c2-b314-d5c9f52051f1" status: 200 len: 1433 microversion: 2.1 time: 0.186869 Oct 27 03:31:24.888726 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1376/2663] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:31:24 2022] GET /compute/v2.1/images/1a2e38d2-514f-48c2-b314-d5c9f52051f1 => generated 1433 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:31:24.893617 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2d9dad7e-ff60-4119-8aac-eb1501046429 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:24.904019 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2d9dad7e-ff60-4119-8aac-eb1501046429 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] [instance: 0c726bb2-8fea-4b2d-9e57-a585032c3155] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:31:25.037783 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2d9dad7e-ff60-4119-8aac-eb1501046429 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533917bc5aa4e23802a43b1eb534bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d87abf835a4104b40056b9eec2d6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:31:25.047637 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2d9dad7e-ff60-4119-8aac-eb1501046429 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] 10.222.0.20 "GET /compute/v2.1/servers/0c726bb2-8fea-4b2d-9e57-a585032c3155" status: 200 len: 1214 microversion: 2.1 time: 0.157644 Oct 27 03:31:25.050851 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1377/2664] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:31:24 2022] GET /compute/v2.1/servers/0c726bb2-8fea-4b2d-9e57-a585032c3155 => generated 1214 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:31:25.237646 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-85d97252-84e8-4ab4-9413-feb500da4632 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-1173714037", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": [{"uuid": "fc7d626a-757e-4c32-8292-f756bc2a23c9"}]}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:31:25.381075 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.network.neutron [None req-85d97252-84e8-4ab4-9413-feb500da4632 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] validate_networks() for [('fc7d626a-757e-4c32-8292-f756bc2a23c9', None, None, None, None, None)] {{(pid=121001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:31:25.921027 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-15b3ea16-de47-42be-ae39-fd97c908ae20 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:31:25.922092 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-15b3ea16-de47-42be-ae39-fd97c908ae20 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:31:25.922875 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-15b3ea16-de47-42be-ae39-fd97c908ae20 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:31:25.923608 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-15b3ea16-de47-42be-ae39-fd97c908ae20 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:31:25.924248 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-15b3ea16-de47-42be-ae39-fd97c908ae20 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:31:25.954641 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-15b3ea16-de47-42be-ae39-fd97c908ae20 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:25.956245 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-15b3ea16-de47-42be-ae39-fd97c908ae20 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:25.956908 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-15b3ea16-de47-42be-ae39-fd97c908ae20 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:25.960561 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-15b3ea16-de47-42be-ae39-fd97c908ae20 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:25.961291 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-15b3ea16-de47-42be-ae39-fd97c908ae20 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:25.978235 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-15b3ea16-de47-42be-ae39-fd97c908ae20 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:26.099583 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-15b3ea16-de47-42be-ae39-fd97c908ae20 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Getting quotas for project 7e1c2fc2755040e4b6fcf82534d67e1c. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:31:26.126690 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-15b3ea16-de47-42be-ae39-fd97c908ae20 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Getting quotas for user 46a1244a7e994427a6ff0625743956e3 and project 7e1c2fc2755040e4b6fcf82534d67e1c. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:31:26.177696 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-15b3ea16-de47-42be-ae39-fd97c908ae20 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:31:26.181537 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-15b3ea16-de47-42be-ae39-fd97c908ae20 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] [instance: 284c90a7-3cda-4d66-a8e1-646f27c28138] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:31:26.415052 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-15b3ea16-de47-42be-ae39-fd97c908ae20 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.144492 Oct 27 03:31:26.419242 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1288/2665] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:31:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 2149 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 03:31:26.431826 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-86e793ac-d6f4-42e4-9f77-3b8fe3f6e49f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-1932698017"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:31:26.434887 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-86e793ac-d6f4-42e4-9f77-3b8fe3f6e49f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:31:26.457460 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-86e793ac-d6f4-42e4-9f77-3b8fe3f6e49f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:26.458240 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-86e793ac-d6f4-42e4-9f77-3b8fe3f6e49f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:26.462680 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-86e793ac-d6f4-42e4-9f77-3b8fe3f6e49f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:26.462911 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-86e793ac-d6f4-42e4-9f77-3b8fe3f6e49f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:26.463543 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-86e793ac-d6f4-42e4-9f77-3b8fe3f6e49f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:26.464301 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-86e793ac-d6f4-42e4-9f77-3b8fe3f6e49f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:26.480438 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-85d97252-84e8-4ab4-9413-feb500da4632 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Flavor limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:31:26.481499 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-85d97252-84e8-4ab4-9413-feb500da4632 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Image limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:31:26.482583 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-85d97252-84e8-4ab4-9413-feb500da4632 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Flavor pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:31:26.483102 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-85d97252-84e8-4ab4-9413-feb500da4632 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Image pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:31:26.483700 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-85d97252-84e8-4ab4-9413-feb500da4632 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:31:26.630805 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-85d97252-84e8-4ab4-9413-feb500da4632 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:26.630805 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-85d97252-84e8-4ab4-9413-feb500da4632 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:26.630805 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-85d97252-84e8-4ab4-9413-feb500da4632 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:26.630805 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-85d97252-84e8-4ab4-9413-feb500da4632 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:26.630805 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-85d97252-84e8-4ab4-9413-feb500da4632 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:26.630805 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-85d97252-84e8-4ab4-9413-feb500da4632 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:26.689374 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-85d97252-84e8-4ab4-9413-feb500da4632 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Getting quotas for project 9ebe1ca8678d43c38731d15b0bf99cfa. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:31:26.704290 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-85d97252-84e8-4ab4-9413-feb500da4632 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Getting quotas for user 4ba8b60cf1164a388f626b0708556775 and project 9ebe1ca8678d43c38731d15b0bf99cfa. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:31:26.739760 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-85d97252-84e8-4ab4-9413-feb500da4632 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Going to run 1 instances... {{(pid=121001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:31:26.742907 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-85d97252-84e8-4ab4-9413-feb500da4632 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] [instance: 0d06aebf-d50e-4bdf-90ec-d64b1f1de254] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:31:26.934338 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-85d97252-84e8-4ab4-9413-feb500da4632 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.882765 Oct 27 03:31:26.937602 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1378/2666] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:31:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1888 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 03:31:26.949686 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a27d5606-a64b-45eb-89bd-48a1a8f24fa6 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Calling method '.version_select at 0x7f7dd9fe2e50>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:27.076246 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a27d5606-a64b-45eb-89bd-48a1a8f24fa6 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] 10.222.0.20 "GET /compute/v2.1/images/1a2e38d2-514f-48c2-b314-d5c9f52051f1" status: 200 len: 1433 microversion: 2.1 time: 0.135492 Oct 27 03:31:27.083442 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1379/2667] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:31:26 2022] GET /compute/v2.1/images/1a2e38d2-514f-48c2-b314-d5c9f52051f1 => generated 1433 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:31:27.089048 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-39cfe33f-659f-4a83-b9a3-89fbfbbbe31c tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:27.095626 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-39cfe33f-659f-4a83-b9a3-89fbfbbbe31c tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] [instance: 0c726bb2-8fea-4b2d-9e57-a585032c3155] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:31:27.125525 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-39cfe33f-659f-4a83-b9a3-89fbfbbbe31c tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:27.126294 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-39cfe33f-659f-4a83-b9a3-89fbfbbbe31c tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:27.126996 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-39cfe33f-659f-4a83-b9a3-89fbfbbbe31c tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:27.128097 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-39cfe33f-659f-4a83-b9a3-89fbfbbbe31c tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:27.128960 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-39cfe33f-659f-4a83-b9a3-89fbfbbbe31c tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:27.129615 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-39cfe33f-659f-4a83-b9a3-89fbfbbbe31c tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:27.320707 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-39cfe33f-659f-4a83-b9a3-89fbfbbbe31c tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533917bc5aa4e23802a43b1eb534bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d87abf835a4104b40056b9eec2d6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:31:27.331126 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-39cfe33f-659f-4a83-b9a3-89fbfbbbe31c tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] 10.222.0.20 "GET /compute/v2.1/servers/0c726bb2-8fea-4b2d-9e57-a585032c3155" status: 200 len: 1210 microversion: 2.1 time: 0.245578 Oct 27 03:31:27.336039 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1380/2668] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:31:27 2022] GET /compute/v2.1/servers/0c726bb2-8fea-4b2d-9e57-a585032c3155 => generated 1210 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:31:27.350323 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f9b2ce58-8906-4701-8f83-c00b25f73de0 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:27.350958 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f9b2ce58-8906-4701-8f83-c00b25f73de0 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] [instance: 284c90a7-3cda-4d66-a8e1-646f27c28138] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:31:27.368440 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-86e793ac-d6f4-42e4-9f77-3b8fe3f6e49f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "POST /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86/action" status: 202 len: 0 microversion: 2.1 time: 0.947555 Oct 27 03:31:27.370226 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1289/2669] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:31:26 2022] POST /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86/action => generated 0 bytes in 950 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 27 03:31:27.583970 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-bb494f5e-26eb-4d55-bb14-bf640a321182 req-bce00038-9386-426c-9064-bb7808439c0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed74f42b-af82-4808-bfc2-86110840fe86", "name": "network-vif-unplugged", "status": "completed", "tag": "05464839-777e-4176-af2d-6086d6f9acaa"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:31:27.621469 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-bb494f5e-26eb-4d55-bb14-bf640a321182 req-bce00038-9386-426c-9064-bb7808439c0b service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:27.621966 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-bb494f5e-26eb-4d55-bb14-bf640a321182 req-bce00038-9386-426c-9064-bb7808439c0b service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:27.622440 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-bb494f5e-26eb-4d55-bb14-bf640a321182 req-bce00038-9386-426c-9064-bb7808439c0b service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:27.707988 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f9b2ce58-8906-4701-8f83-c00b25f73de0 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a1244a7e994427a6ff0625743956e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e1c2fc2755040e4b6fcf82534d67e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:31:27.713310 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-bb494f5e-26eb-4d55-bb14-bf640a321182 req-bce00038-9386-426c-9064-bb7808439c0b service nova] Creating event network-vif-unplugged:05464839-777e-4176-af2d-6086d6f9acaa for instance ed74f42b-af82-4808-bfc2-86110840fe86 on n-h1-862769-1 Oct 27 03:31:27.717456 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f9b2ce58-8906-4701-8f83-c00b25f73de0 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] 10.222.0.20 "GET /compute/v2.1/servers/284c90a7-3cda-4d66-a8e1-646f27c28138" status: 200 len: 1214 microversion: 2.1 time: 0.380150 Oct 27 03:31:27.721061 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1381/2670] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:31:27 2022] GET /compute/v2.1/servers/284c90a7-3cda-4d66-a8e1-646f27c28138 => generated 1214 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:31:27.738927 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-bb494f5e-26eb-4d55-bb14-bf640a321182 req-bce00038-9386-426c-9064-bb7808439c0b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.365116 Oct 27 03:31:27.741418 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1290/2671] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:31:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:31:27.751738 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-41922408-d31b-4eba-9dd0-647f7e81bb7f tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:27.751738 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-41922408-d31b-4eba-9dd0-647f7e81bb7f tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] [instance: b0c6560f-ade1-4ae6-905e-ad488f4c3b51] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:31:27.753943 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e5fda5f9-af10-4633-8869-ff383cb9f5ae tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:27.754778 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e5fda5f9-af10-4633-8869-ff383cb9f5ae tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] [instance: 0d06aebf-d50e-4bdf-90ec-d64b1f1de254] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:31:27.769129 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-41922408-d31b-4eba-9dd0-647f7e81bb7f tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:27.772714 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-41922408-d31b-4eba-9dd0-647f7e81bb7f tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:27.772714 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-41922408-d31b-4eba-9dd0-647f7e81bb7f tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:27.772714 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-41922408-d31b-4eba-9dd0-647f7e81bb7f tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:27.772714 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-41922408-d31b-4eba-9dd0-647f7e81bb7f tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:27.772714 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-41922408-d31b-4eba-9dd0-647f7e81bb7f tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:27.952187 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e5fda5f9-af10-4633-8869-ff383cb9f5ae tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba8b60cf1164a388f626b0708556775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe1ca8678d43c38731d15b0bf99cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:31:27.975942 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e5fda5f9-af10-4633-8869-ff383cb9f5ae tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] 10.222.0.20 "GET /compute/v2.1/servers/0d06aebf-d50e-4bdf-90ec-d64b1f1de254" status: 200 len: 1217 microversion: 2.1 time: 0.244168 Oct 27 03:31:27.977135 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1382/2672] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:31:27 2022] GET /compute/v2.1/servers/0d06aebf-d50e-4bdf-90ec-d64b1f1de254 => generated 1217 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:31:28.367010 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-527f48ca-8e46-4f9f-82d0-0d39968e25df tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:28.374473 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-527f48ca-8e46-4f9f-82d0-0d39968e25df tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] [instance: 0c726bb2-8fea-4b2d-9e57-a585032c3155] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:31:28.386940 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-527f48ca-8e46-4f9f-82d0-0d39968e25df tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:28.387808 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-527f48ca-8e46-4f9f-82d0-0d39968e25df tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:28.388473 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-527f48ca-8e46-4f9f-82d0-0d39968e25df tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:28.389711 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-527f48ca-8e46-4f9f-82d0-0d39968e25df tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:28.390416 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-527f48ca-8e46-4f9f-82d0-0d39968e25df tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:28.394613 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-527f48ca-8e46-4f9f-82d0-0d39968e25df tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:28.585121 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-527f48ca-8e46-4f9f-82d0-0d39968e25df tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533917bc5aa4e23802a43b1eb534bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d87abf835a4104b40056b9eec2d6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:31:28.601315 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-527f48ca-8e46-4f9f-82d0-0d39968e25df tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] 10.222.0.20 "GET /compute/v2.1/servers/0c726bb2-8fea-4b2d-9e57-a585032c3155" status: 200 len: 1266 microversion: 2.1 time: 0.239345 Oct 27 03:31:28.615837 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1383/2673] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:31:28 2022] GET /compute/v2.1/servers/0c726bb2-8fea-4b2d-9e57-a585032c3155 => generated 1266 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:31:28.753087 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-aa7e5f3d-7225-43b1-bd02-688fdf901df5 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:28.755931 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-aa7e5f3d-7225-43b1-bd02-688fdf901df5 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] [instance: 284c90a7-3cda-4d66-a8e1-646f27c28138] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:31:28.767800 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aa7e5f3d-7225-43b1-bd02-688fdf901df5 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:28.775030 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aa7e5f3d-7225-43b1-bd02-688fdf901df5 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:28.775550 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aa7e5f3d-7225-43b1-bd02-688fdf901df5 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:28.776386 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aa7e5f3d-7225-43b1-bd02-688fdf901df5 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:28.777009 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aa7e5f3d-7225-43b1-bd02-688fdf901df5 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:28.777551 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aa7e5f3d-7225-43b1-bd02-688fdf901df5 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:28.908832 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-aa7e5f3d-7225-43b1-bd02-688fdf901df5 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a1244a7e994427a6ff0625743956e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e1c2fc2755040e4b6fcf82534d67e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:31:28.923287 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-aa7e5f3d-7225-43b1-bd02-688fdf901df5 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] 10.222.0.20 "GET /compute/v2.1/servers/284c90a7-3cda-4d66-a8e1-646f27c28138" status: 200 len: 1218 microversion: 2.1 time: 0.176885 Oct 27 03:31:28.924493 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1384/2674] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:31:28 2022] GET /compute/v2.1/servers/284c90a7-3cda-4d66-a8e1-646f27c28138 => generated 1218 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:31:29.013594 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1ff11be5-ebbf-42e1-b05b-8479a9160168 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:29.014496 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1ff11be5-ebbf-42e1-b05b-8479a9160168 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] [instance: 0d06aebf-d50e-4bdf-90ec-d64b1f1de254] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:31:29.137270 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1ff11be5-ebbf-42e1-b05b-8479a9160168 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba8b60cf1164a388f626b0708556775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe1ca8678d43c38731d15b0bf99cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:31:29.147639 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1ff11be5-ebbf-42e1-b05b-8479a9160168 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] 10.222.0.20 "GET /compute/v2.1/servers/0d06aebf-d50e-4bdf-90ec-d64b1f1de254" status: 200 len: 1217 microversion: 2.1 time: 0.139827 Oct 27 03:31:29.160924 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1385/2675] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:31:29 2022] GET /compute/v2.1/servers/0d06aebf-d50e-4bdf-90ec-d64b1f1de254 => generated 1217 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:31:29.181383 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-41922408-d31b-4eba-9dd0-647f7e81bb7f tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cd1938c86a4f389a2ec0fba9beff36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd0392257a0419dbfa569c8816ece2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:31:29.197666 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-41922408-d31b-4eba-9dd0-647f7e81bb7f tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] 10.222.0.20 "GET /compute/v2.1/servers/b0c6560f-ade1-4ae6-905e-ad488f4c3b51" status: 200 len: 1466 microversion: 2.1 time: 1.454678 Oct 27 03:31:29.200037 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1291/2676] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:31:27 2022] GET /compute/v2.1/servers/b0c6560f-ade1-4ae6-905e-ad488f4c3b51 => generated 1466 bytes in 1458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:31:29.239598 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-99e1eb74-5aa1-44cb-b401-3bc9c53e8c07 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Calling method '.version_select at 0x7f7dd9f7eaf0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:29.351174 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-99e1eb74-5aa1-44cb-b401-3bc9c53e8c07 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] 10.222.0.20 "GET /compute/v2.1/images/c40fb871-5877-4b59-ab69-d9fd23b7a917" status: 200 len: 784 microversion: 2.1 time: 0.120598 Oct 27 03:31:29.352525 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1386/2677] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:31:29 2022] GET /compute/v2.1/images/c40fb871-5877-4b59-ab69-d9fd23b7a917 => generated 784 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:31:29.370809 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-64e1640e-ded1-43f5-9bd9-b6b0feb87f8d tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:29.403842 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-64e1640e-ded1-43f5-9bd9-b6b0feb87f8d tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.039297 Oct 27 03:31:29.406853 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1292/2678] 10.222.0.20 () {58 vars in 1137 bytes} [Thu Oct 27 03:31:29 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:31:29.432389 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-97b9b39b-caa8-4e9c-b126-982a1c43888f tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Calling method '.version_select at 0x7f7dd9fb2700>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:29.642637 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b8d572a4-fcc8-4d91-aef9-3dfb7ffa3727 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:29.643650 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b8d572a4-fcc8-4d91-aef9-3dfb7ffa3727 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] [instance: 0c726bb2-8fea-4b2d-9e57-a585032c3155] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:31:29.669313 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b8d572a4-fcc8-4d91-aef9-3dfb7ffa3727 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:29.672342 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b8d572a4-fcc8-4d91-aef9-3dfb7ffa3727 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:29.673080 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b8d572a4-fcc8-4d91-aef9-3dfb7ffa3727 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:29.675649 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b8d572a4-fcc8-4d91-aef9-3dfb7ffa3727 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:29.677870 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b8d572a4-fcc8-4d91-aef9-3dfb7ffa3727 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:29.680668 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b8d572a4-fcc8-4d91-aef9-3dfb7ffa3727 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:29.974169 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b8d572a4-fcc8-4d91-aef9-3dfb7ffa3727 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533917bc5aa4e23802a43b1eb534bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d87abf835a4104b40056b9eec2d6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:31:30.003297 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b8d572a4-fcc8-4d91-aef9-3dfb7ffa3727 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] 10.222.0.20 "GET /compute/v2.1/servers/0c726bb2-8fea-4b2d-9e57-a585032c3155" status: 200 len: 1272 microversion: 2.1 time: 0.364131 Oct 27 03:31:30.010417 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1293/2679] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:31:29 2022] GET /compute/v2.1/servers/0c726bb2-8fea-4b2d-9e57-a585032c3155 => generated 1272 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:31:30.045796 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-ae025e98-7f4a-4cd1-aff6-4f9fd81a4329 req-e5a361ac-67f6-41a8-9ab7-fd86c9dcf1b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0c6560f-ade1-4ae6-905e-ad488f4c3b51", "name": "network-vif-unplugged", "status": "completed", "tag": "374bf7dd-46fc-42a5-a069-b8b5708a33a0"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:31:30.091202 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-ae025e98-7f4a-4cd1-aff6-4f9fd81a4329 req-e5a361ac-67f6-41a8-9ab7-fd86c9dcf1b4 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:30.111661 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-ae025e98-7f4a-4cd1-aff6-4f9fd81a4329 req-e5a361ac-67f6-41a8-9ab7-fd86c9dcf1b4 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:30.113167 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-ae025e98-7f4a-4cd1-aff6-4f9fd81a4329 req-e5a361ac-67f6-41a8-9ab7-fd86c9dcf1b4 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:30.152750 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-ae025e98-7f4a-4cd1-aff6-4f9fd81a4329 req-e5a361ac-67f6-41a8-9ab7-fd86c9dcf1b4 service nova] Creating event network-vif-unplugged:374bf7dd-46fc-42a5-a069-b8b5708a33a0 for instance b0c6560f-ade1-4ae6-905e-ad488f4c3b51 on n-h2-862769-1 Oct 27 03:31:30.194256 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-ae025e98-7f4a-4cd1-aff6-4f9fd81a4329 req-e5a361ac-67f6-41a8-9ab7-fd86c9dcf1b4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.178291 Oct 27 03:31:30.202607 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1294/2680] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:31:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:31:30.218680 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9642b5c7-2604-46a4-bd23-f59d125d9414 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:30.222433 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9642b5c7-2604-46a4-bd23-f59d125d9414 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] [instance: 284c90a7-3cda-4d66-a8e1-646f27c28138] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:31:30.238343 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9642b5c7-2604-46a4-bd23-f59d125d9414 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:30.238858 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9642b5c7-2604-46a4-bd23-f59d125d9414 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:30.239307 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9642b5c7-2604-46a4-bd23-f59d125d9414 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:30.242820 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9642b5c7-2604-46a4-bd23-f59d125d9414 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:30.243311 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9642b5c7-2604-46a4-bd23-f59d125d9414 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:30.243759 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9642b5c7-2604-46a4-bd23-f59d125d9414 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:30.388964 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9642b5c7-2604-46a4-bd23-f59d125d9414 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a1244a7e994427a6ff0625743956e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e1c2fc2755040e4b6fcf82534d67e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:31:30.400395 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9642b5c7-2604-46a4-bd23-f59d125d9414 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] 10.222.0.20 "GET /compute/v2.1/servers/284c90a7-3cda-4d66-a8e1-646f27c28138" status: 200 len: 1266 microversion: 2.1 time: 0.196410 Oct 27 03:31:30.420457 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1295/2681] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:31:30 2022] GET /compute/v2.1/servers/284c90a7-3cda-4d66-a8e1-646f27c28138 => generated 1266 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:31:30.462626 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-497fe0ca-bc23-4305-a2b2-9125370fb9dc tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:30.465754 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-497fe0ca-bc23-4305-a2b2-9125370fb9dc tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] [instance: 0d06aebf-d50e-4bdf-90ec-d64b1f1de254] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:31:30.493174 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-497fe0ca-bc23-4305-a2b2-9125370fb9dc tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:30.497207 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-497fe0ca-bc23-4305-a2b2-9125370fb9dc tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:30.497680 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-497fe0ca-bc23-4305-a2b2-9125370fb9dc tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:30.509211 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-497fe0ca-bc23-4305-a2b2-9125370fb9dc tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:30.511859 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-497fe0ca-bc23-4305-a2b2-9125370fb9dc tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:30.512932 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-497fe0ca-bc23-4305-a2b2-9125370fb9dc tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:30.939661 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-497fe0ca-bc23-4305-a2b2-9125370fb9dc tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba8b60cf1164a388f626b0708556775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe1ca8678d43c38731d15b0bf99cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:31:30.960976 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-497fe0ca-bc23-4305-a2b2-9125370fb9dc tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] 10.222.0.20 "GET /compute/v2.1/servers/0d06aebf-d50e-4bdf-90ec-d64b1f1de254" status: 200 len: 1213 microversion: 2.1 time: 0.539178 Oct 27 03:31:30.985518 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1296/2682] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:31:30 2022] GET /compute/v2.1/servers/0d06aebf-d50e-4bdf-90ec-d64b1f1de254 => generated 1213 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:31:31.041019 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-94e4e561-8fc1-414f-ad52-b4e6d86c1345 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:31.041648 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-94e4e561-8fc1-414f-ad52-b4e6d86c1345 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] [instance: 0c726bb2-8fea-4b2d-9e57-a585032c3155] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:31:31.075669 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-94e4e561-8fc1-414f-ad52-b4e6d86c1345 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:31.076142 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-94e4e561-8fc1-414f-ad52-b4e6d86c1345 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:31.076699 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-94e4e561-8fc1-414f-ad52-b4e6d86c1345 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:31.087716 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-94e4e561-8fc1-414f-ad52-b4e6d86c1345 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:31.089726 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-94e4e561-8fc1-414f-ad52-b4e6d86c1345 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:31.090093 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-94e4e561-8fc1-414f-ad52-b4e6d86c1345 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:31.451147 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-94e4e561-8fc1-414f-ad52-b4e6d86c1345 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533917bc5aa4e23802a43b1eb534bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d87abf835a4104b40056b9eec2d6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:31:31.467269 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-94e4e561-8fc1-414f-ad52-b4e6d86c1345 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] 10.222.0.20 "GET /compute/v2.1/servers/0c726bb2-8fea-4b2d-9e57-a585032c3155" status: 200 len: 1272 microversion: 2.1 time: 0.431074 Oct 27 03:31:31.471548 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1297/2683] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:31:31 2022] GET /compute/v2.1/servers/0c726bb2-8fea-4b2d-9e57-a585032c3155 => generated 1272 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:31:31.480289 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e68b4739-8bbb-44cb-afc4-37e2e8e2f54c tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:31.483215 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e68b4739-8bbb-44cb-afc4-37e2e8e2f54c tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] [instance: 284c90a7-3cda-4d66-a8e1-646f27c28138] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:31:31.508189 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e68b4739-8bbb-44cb-afc4-37e2e8e2f54c tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:31.514760 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e68b4739-8bbb-44cb-afc4-37e2e8e2f54c tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:31.515387 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e68b4739-8bbb-44cb-afc4-37e2e8e2f54c tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:31.516283 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e68b4739-8bbb-44cb-afc4-37e2e8e2f54c tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:31.516961 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e68b4739-8bbb-44cb-afc4-37e2e8e2f54c tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:31.520410 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e68b4739-8bbb-44cb-afc4-37e2e8e2f54c tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:31.813287 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e68b4739-8bbb-44cb-afc4-37e2e8e2f54c tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a1244a7e994427a6ff0625743956e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e1c2fc2755040e4b6fcf82534d67e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:31:31.830966 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e68b4739-8bbb-44cb-afc4-37e2e8e2f54c tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] 10.222.0.20 "GET /compute/v2.1/servers/284c90a7-3cda-4d66-a8e1-646f27c28138" status: 200 len: 1272 microversion: 2.1 time: 0.349559 Oct 27 03:31:31.842130 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1298/2684] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:31:31 2022] GET /compute/v2.1/servers/284c90a7-3cda-4d66-a8e1-646f27c28138 => generated 1272 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:31:32.000187 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-cc87a896-2eb0-405a-81ad-9e9c58307bd4 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:32.001017 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-cc87a896-2eb0-405a-81ad-9e9c58307bd4 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] [instance: 0d06aebf-d50e-4bdf-90ec-d64b1f1de254] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:31:32.025470 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cc87a896-2eb0-405a-81ad-9e9c58307bd4 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:32.028603 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cc87a896-2eb0-405a-81ad-9e9c58307bd4 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:32.029251 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cc87a896-2eb0-405a-81ad-9e9c58307bd4 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:32.030237 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cc87a896-2eb0-405a-81ad-9e9c58307bd4 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:32.032669 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cc87a896-2eb0-405a-81ad-9e9c58307bd4 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:32.038308 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cc87a896-2eb0-405a-81ad-9e9c58307bd4 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:32.087539 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-97b9b39b-caa8-4e9c-b126-982a1c43888f tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] 10.222.0.20 "DELETE /compute/v2.1/images/1a2e38d2-514f-48c2-b314-d5c9f52051f1" status: 204 len: 0 microversion: 2.1 time: 2.671676 Oct 27 03:31:32.092517 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1387/2685] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:31:29 2022] DELETE /compute/v2.1/images/1a2e38d2-514f-48c2-b314-d5c9f52051f1 => generated 0 bytes in 2674 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:31:32.098227 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-140a882e-7af6-44be-8c87-775de2317e08 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Calling method '.version_select at 0x7f7dd9f54a60>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:32.208208 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-140a882e-7af6-44be-8c87-775de2317e08 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] HTTP exception thrown: Image not found. Oct 27 03:31:32.218704 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-140a882e-7af6-44be-8c87-775de2317e08 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Request method failure captured: Oct 27 03:31:32.218704 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/images/1a2e38d2-514f-48c2-b314-d5c9f52051f1 HTTP/1.1 Oct 27 03:31:32.218704 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:31:32.218704 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:31:32.218704 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:31:32.218704 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:31:32.218704 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:31:32.218704 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:31:32.218704 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:31:32.218704 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:31:32.218704 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWftOev-xo07r_KXTI-kaMtPTG2vIw_t-RbHr-Jab33WZMwPajQzQaTrATg5SuBKvzsta_WG55w1J4TRjaaH5s7iZZ99eq9w8fDBVbUlrwYcAdtZSzY1_1zS-dCpbmif-sfCsz4n8YukWQdgPj7GzIplE7tljIccMw4AXx27syA13xc4 Oct 27 03:31:32.218704 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:31:32.218704 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:31:32.218704 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:31:32.218704 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:31:32.218704 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:31:32.218704 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:31:32.218704 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: ccd0392257a0419dbfa569c8816ece2b Oct 27 03:31:32.218704 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ImagesOneServerTestJSON-1466754268 Oct 27 03:31:32.218704 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:31:32.218704 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:31:32.218704 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ccd0392257a0419dbfa569c8816ece2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ccd0392257a0419dbfa569c8816ece2b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ccd0392257a0419dbfa569c8816ece2b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ccd0392257a0419dbfa569c8816ece2b"}]}] Oct 27 03:31:32.218704 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ImagesOneServerTestJSON-1466754268 Oct 27 03:31:32.218704 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: ccd0392257a0419dbfa569c8816ece2b Oct 27 03:31:32.218704 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1466754268 Oct 27 03:31:32.218704 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ImagesOneServerTestJSON-1466754268-project Oct 27 03:31:32.218704 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:31:32.218704 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:31:32.218704 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 42cd1938c86a4f389a2ec0fba9beff36 Oct 27 03:31:32.218704 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ImagesOneServerTestJSON-1466754268-project Oct 27 03:31:32.218704 n-d-862769-1 devstack@n-api.service[121001]: method: Oct 27 03:31:32.218704 n-d-862769-1 devstack@n-api.service[121001]: exception: Image not found. Oct 27 03:31:32.218704 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '1a2e38d2-514f-48c2-b314-d5c9f52051f1'} Oct 27 03:31:32.218704 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:31:32.218704 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:31:32.218704 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 27 03:31:32.218704 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 27 03:31:32.218704 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 03:31:32.218704 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 03:31:32.218704 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 27 03:31:32.218704 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 27 03:31:32.218704 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 03:31:32.218704 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 03:31:32.218704 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 27 03:31:32.218704 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 27 03:31:32.218704 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 27 03:31:32.218704 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 27 03:31:32.218704 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 03:31:32.218704 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 03:31:32.218704 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 03:31:32.218704 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 03:31:32.218704 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 1a2e38d2-514f-48c2-b314-d5c9f52051f1 Oct 27 03:31:32.218704 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:31:32.218704 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:31:32.218704 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:31:32.218704 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:31:32.218704 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 27 03:31:32.218704 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 27 03:31:32.218704 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 27 03:31:32.218704 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 27 03:31:32.218704 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 27 03:31:32.218704 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 27 03:31:32.218704 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 27 03:31:32.227737 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 27 03:31:32.227737 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 27 03:31:32.227737 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 27 03:31:32.227737 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 03:31:32.227737 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 03:31:32.227737 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 27 03:31:32.227737 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 27 03:31:32.227737 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 03:31:32.227737 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 03:31:32.227737 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 27 03:31:32.227737 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 27 03:31:32.227737 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 27 03:31:32.227737 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 27 03:31:32.227737 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 03:31:32.227737 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 03:31:32.227737 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 03:31:32.227737 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 03:31:32.227737 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1a2e38d2-514f-48c2-b314-d5c9f52051f1 could not be found. Oct 27 03:31:32.227737 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:31:32.227737 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:31:32.227737 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:31:32.227737 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:31:32.227737 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:31:32.227737 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:31:32.227737 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:31:32.227737 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:31:32.227737 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:31:32.227737 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:31:32.227737 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:31:32.227737 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:31:32.227737 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 27 03:31:32.227737 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 27 03:31:32.227737 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 27 03:31:32.227737 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:31:32.227737 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:31:32.227737 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:31:32.227737 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:31:32.227737 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:31:32.227737 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:31:32.227737 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:31:32.227737 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:31:32.227737 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 27 03:31:32.227737 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:31:32.248258 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-140a882e-7af6-44be-8c87-775de2317e08 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Returning 404 to user: Image not found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:31:32.255152 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-140a882e-7af6-44be-8c87-775de2317e08 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] 10.222.0.20 "GET /compute/v2.1/images/1a2e38d2-514f-48c2-b314-d5c9f52051f1" status: 404 len: 62 microversion: 2.1 time: 0.161261 Oct 27 03:31:32.258723 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1388/2686] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:31:32 2022] GET /compute/v2.1/images/1a2e38d2-514f-48c2-b314-d5c9f52051f1 => generated 62 bytes in 165 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 03:31:32.298307 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-950b869d-f6c5-45be-b9ab-264031c7e6e5 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-170589708"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:31:32.314451 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-950b869d-f6c5-45be-b9ab-264031c7e6e5 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] [instance: b0c6560f-ade1-4ae6-905e-ad488f4c3b51] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:31:32.365184 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-950b869d-f6c5-45be-b9ab-264031c7e6e5 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:32.378311 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-950b869d-f6c5-45be-b9ab-264031c7e6e5 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:32.381404 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-950b869d-f6c5-45be-b9ab-264031c7e6e5 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:32.385464 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-950b869d-f6c5-45be-b9ab-264031c7e6e5 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:32.386202 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-950b869d-f6c5-45be-b9ab-264031c7e6e5 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:32.393435 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-950b869d-f6c5-45be-b9ab-264031c7e6e5 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:33.084024 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-cc87a896-2eb0-405a-81ad-9e9c58307bd4 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba8b60cf1164a388f626b0708556775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe1ca8678d43c38731d15b0bf99cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:31:33.102561 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-cc87a896-2eb0-405a-81ad-9e9c58307bd4 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] 10.222.0.20 "GET /compute/v2.1/servers/0d06aebf-d50e-4bdf-90ec-d64b1f1de254" status: 200 len: 1277 microversion: 2.1 time: 1.106200 Oct 27 03:31:33.104222 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1299/2687] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:31:31 2022] GET /compute/v2.1/servers/0d06aebf-d50e-4bdf-90ec-d64b1f1de254 => generated 1277 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:31:33.122634 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a5fcf9eb-1d44-4ad3-af11-7cdc3fb886f7 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:33.126386 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a5fcf9eb-1d44-4ad3-af11-7cdc3fb886f7 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] [instance: 0c726bb2-8fea-4b2d-9e57-a585032c3155] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:31:33.155837 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a5fcf9eb-1d44-4ad3-af11-7cdc3fb886f7 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:33.156272 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a5fcf9eb-1d44-4ad3-af11-7cdc3fb886f7 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:33.158476 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a5fcf9eb-1d44-4ad3-af11-7cdc3fb886f7 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:33.164055 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a5fcf9eb-1d44-4ad3-af11-7cdc3fb886f7 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:33.166013 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a5fcf9eb-1d44-4ad3-af11-7cdc3fb886f7 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:33.166955 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a5fcf9eb-1d44-4ad3-af11-7cdc3fb886f7 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:33.405967 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-950b869d-f6c5-45be-b9ab-264031c7e6e5 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] 10.222.0.20 "POST /compute/v2.1/servers/b0c6560f-ade1-4ae6-905e-ad488f4c3b51/action" status: 202 len: 0 microversion: 2.1 time: 1.130138 Oct 27 03:31:33.415373 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1389/2688] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:31:32 2022] POST /compute/v2.1/servers/b0c6560f-ade1-4ae6-905e-ad488f4c3b51/action => generated 0 bytes in 1150 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 27 03:31:33.432683 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ddaf919e-8204-479b-9fdf-8d4d9a2749eb tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:33.435577 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ddaf919e-8204-479b-9fdf-8d4d9a2749eb tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] [instance: 284c90a7-3cda-4d66-a8e1-646f27c28138] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:31:33.466994 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ddaf919e-8204-479b-9fdf-8d4d9a2749eb tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:33.467913 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ddaf919e-8204-479b-9fdf-8d4d9a2749eb tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:33.469118 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ddaf919e-8204-479b-9fdf-8d4d9a2749eb tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:33.471136 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ddaf919e-8204-479b-9fdf-8d4d9a2749eb tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:33.473194 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ddaf919e-8204-479b-9fdf-8d4d9a2749eb tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:33.473903 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ddaf919e-8204-479b-9fdf-8d4d9a2749eb tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:33.852853 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a5fcf9eb-1d44-4ad3-af11-7cdc3fb886f7 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533917bc5aa4e23802a43b1eb534bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d87abf835a4104b40056b9eec2d6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:31:33.881951 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a5fcf9eb-1d44-4ad3-af11-7cdc3fb886f7 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] 10.222.0.20 "GET /compute/v2.1/servers/0c726bb2-8fea-4b2d-9e57-a585032c3155" status: 200 len: 1272 microversion: 2.1 time: 0.771640 Oct 27 03:31:33.890318 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1300/2689] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:31:33 2022] GET /compute/v2.1/servers/0c726bb2-8fea-4b2d-9e57-a585032c3155 => generated 1272 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:31:33.902957 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5e6d60be-8b63-445a-a52b-9cead2d75b04 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Calling method '.version_select at 0x7f7dd9e3cc10>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:33.988950 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ddaf919e-8204-479b-9fdf-8d4d9a2749eb tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a1244a7e994427a6ff0625743956e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e1c2fc2755040e4b6fcf82534d67e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:31:33.998376 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ddaf919e-8204-479b-9fdf-8d4d9a2749eb tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] 10.222.0.20 "GET /compute/v2.1/servers/284c90a7-3cda-4d66-a8e1-646f27c28138" status: 200 len: 1272 microversion: 2.1 time: 0.578588 Oct 27 03:31:34.004069 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5e6d60be-8b63-445a-a52b-9cead2d75b04 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] 10.222.0.20 "GET /compute/v2.1/images/d74029bb-b8f5-4730-a824-852c528f0876" status: 200 len: 1428 microversion: 2.1 time: 0.116435 Oct 27 03:31:34.013920 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1301/2690] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:31:33 2022] GET /compute/v2.1/images/d74029bb-b8f5-4730-a824-852c528f0876 => generated 1428 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:31:34.017806 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1390/2691] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:31:33 2022] GET /compute/v2.1/servers/284c90a7-3cda-4d66-a8e1-646f27c28138 => generated 1272 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:31:34.154122 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-65c804b6-ce83-487f-877e-e0d4ddfafd4d tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:34.185097 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-65c804b6-ce83-487f-877e-e0d4ddfafd4d tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] [instance: 0d06aebf-d50e-4bdf-90ec-d64b1f1de254] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:31:34.275205 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-65c804b6-ce83-487f-877e-e0d4ddfafd4d tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:34.275205 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-65c804b6-ce83-487f-877e-e0d4ddfafd4d tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:34.275205 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-65c804b6-ce83-487f-877e-e0d4ddfafd4d tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:34.275205 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-65c804b6-ce83-487f-877e-e0d4ddfafd4d tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:34.275205 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-65c804b6-ce83-487f-877e-e0d4ddfafd4d tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:34.275205 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-65c804b6-ce83-487f-877e-e0d4ddfafd4d tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:34.923071 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9f3eca4d-0acc-49b4-9b14-19a2cc906732 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:34.924922 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-9f3eca4d-0acc-49b4-9b14-19a2cc906732 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] [instance: 0c726bb2-8fea-4b2d-9e57-a585032c3155] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:31:34.981931 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9f3eca4d-0acc-49b4-9b14-19a2cc906732 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:34.999141 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9f3eca4d-0acc-49b4-9b14-19a2cc906732 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:34.999141 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9f3eca4d-0acc-49b4-9b14-19a2cc906732 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:35.006749 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9f3eca4d-0acc-49b4-9b14-19a2cc906732 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:35.011148 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9f3eca4d-0acc-49b4-9b14-19a2cc906732 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:35.011612 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9f3eca4d-0acc-49b4-9b14-19a2cc906732 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:35.706930 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-65c804b6-ce83-487f-877e-e0d4ddfafd4d tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba8b60cf1164a388f626b0708556775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe1ca8678d43c38731d15b0bf99cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:31:35.720493 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-65c804b6-ce83-487f-877e-e0d4ddfafd4d tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] 10.222.0.20 "GET /compute/v2.1/servers/0d06aebf-d50e-4bdf-90ec-d64b1f1de254" status: 200 len: 1317 microversion: 2.1 time: 1.586041 Oct 27 03:31:35.724612 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1302/2692] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:31:34 2022] GET /compute/v2.1/servers/0d06aebf-d50e-4bdf-90ec-d64b1f1de254 => generated 1317 bytes in 1592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:31:35.733257 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c578c11e-fcfc-4819-b038-1b7ff3fdefc9 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Calling method '.version_select at 0x7f7ddec28af0>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:35.879011 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9f3eca4d-0acc-49b4-9b14-19a2cc906732 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533917bc5aa4e23802a43b1eb534bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d87abf835a4104b40056b9eec2d6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:31:35.892016 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9f3eca4d-0acc-49b4-9b14-19a2cc906732 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] 10.222.0.20 "GET /compute/v2.1/servers/0c726bb2-8fea-4b2d-9e57-a585032c3155" status: 200 len: 1314 microversion: 2.1 time: 0.975496 Oct 27 03:31:35.898075 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1391/2693] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:31:34 2022] GET /compute/v2.1/servers/0c726bb2-8fea-4b2d-9e57-a585032c3155 => generated 1314 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:31:35.910691 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-979b706c-4591-4878-a9f7-cd493afc5f9b tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:35.911327 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-979b706c-4591-4878-a9f7-cd493afc5f9b tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] [instance: 284c90a7-3cda-4d66-a8e1-646f27c28138] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:31:35.940990 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-979b706c-4591-4878-a9f7-cd493afc5f9b tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:35.951355 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-979b706c-4591-4878-a9f7-cd493afc5f9b tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:35.959585 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-979b706c-4591-4878-a9f7-cd493afc5f9b tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:35.961497 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-979b706c-4591-4878-a9f7-cd493afc5f9b tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:35.965845 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-979b706c-4591-4878-a9f7-cd493afc5f9b tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:35.967103 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-979b706c-4591-4878-a9f7-cd493afc5f9b tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:36.030391 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:31:36.156129 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=6 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:31:36.171389 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-979b706c-4591-4878-a9f7-cd493afc5f9b tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a1244a7e994427a6ff0625743956e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e1c2fc2755040e4b6fcf82534d67e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:31:36.181047 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-979b706c-4591-4878-a9f7-cd493afc5f9b tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] 10.222.0.20 "GET /compute/v2.1/servers/284c90a7-3cda-4d66-a8e1-646f27c28138" status: 200 len: 1272 microversion: 2.1 time: 0.287300 Oct 27 03:31:36.203193 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1392/2694] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:31:35 2022] GET /compute/v2.1/servers/284c90a7-3cda-4d66-a8e1-646f27c28138 => generated 1272 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:31:36.239455 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-442199d3-7184-4ba6-9445-5db60eacb7cd req-db94b329-a6da-48fe-9536-40317bd3270b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed74f42b-af82-4808-bfc2-86110840fe86", "name": "network-vif-plugged", "status": "completed", "tag": "05464839-777e-4176-af2d-6086d6f9acaa"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:31:36.281899 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-442199d3-7184-4ba6-9445-5db60eacb7cd req-db94b329-a6da-48fe-9536-40317bd3270b service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:36.282702 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-442199d3-7184-4ba6-9445-5db60eacb7cd req-db94b329-a6da-48fe-9536-40317bd3270b service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:36.284790 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-442199d3-7184-4ba6-9445-5db60eacb7cd req-db94b329-a6da-48fe-9536-40317bd3270b service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:36.316307 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-442199d3-7184-4ba6-9445-5db60eacb7cd req-db94b329-a6da-48fe-9536-40317bd3270b service nova] Creating event network-vif-plugged:05464839-777e-4176-af2d-6086d6f9acaa for instance ed74f42b-af82-4808-bfc2-86110840fe86 on n-h1-862769-1 Oct 27 03:31:36.329680 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-442199d3-7184-4ba6-9445-5db60eacb7cd req-db94b329-a6da-48fe-9536-40317bd3270b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093959 Oct 27 03:31:36.333643 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1393/2695] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:31:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:31:36.746847 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8e0c6770-b960-4288-bf63-34ddac72419a tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:36.751254 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8e0c6770-b960-4288-bf63-34ddac72419a tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] [instance: 0d06aebf-d50e-4bdf-90ec-d64b1f1de254] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:31:36.751254 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=4 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:31:36.761024 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8e0c6770-b960-4288-bf63-34ddac72419a tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:36.764549 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8e0c6770-b960-4288-bf63-34ddac72419a tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:36.765642 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8e0c6770-b960-4288-bf63-34ddac72419a tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:36.768294 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8e0c6770-b960-4288-bf63-34ddac72419a tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:36.769051 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8e0c6770-b960-4288-bf63-34ddac72419a tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:36.770986 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8e0c6770-b960-4288-bf63-34ddac72419a tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:37.330330 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8e0c6770-b960-4288-bf63-34ddac72419a tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba8b60cf1164a388f626b0708556775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe1ca8678d43c38731d15b0bf99cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:31:37.346833 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8e0c6770-b960-4288-bf63-34ddac72419a tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] 10.222.0.20 "GET /compute/v2.1/servers/0d06aebf-d50e-4bdf-90ec-d64b1f1de254" status: 200 len: 1317 microversion: 2.1 time: 0.604662 Oct 27 03:31:37.366693 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1394/2696] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:31:36 2022] GET /compute/v2.1/servers/0d06aebf-d50e-4bdf-90ec-d64b1f1de254 => generated 1317 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:31:37.381927 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-95020d10-61c5-4647-bdd9-2c09cf0c3420 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:37.389998 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-95020d10-61c5-4647-bdd9-2c09cf0c3420 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] [instance: 0c726bb2-8fea-4b2d-9e57-a585032c3155] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:31:37.396758 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-95020d10-61c5-4647-bdd9-2c09cf0c3420 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:37.398519 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-95020d10-61c5-4647-bdd9-2c09cf0c3420 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:37.401997 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-95020d10-61c5-4647-bdd9-2c09cf0c3420 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:37.403087 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-95020d10-61c5-4647-bdd9-2c09cf0c3420 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:37.403667 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-95020d10-61c5-4647-bdd9-2c09cf0c3420 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:37.404159 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-95020d10-61c5-4647-bdd9-2c09cf0c3420 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:37.966198 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-95020d10-61c5-4647-bdd9-2c09cf0c3420 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533917bc5aa4e23802a43b1eb534bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d87abf835a4104b40056b9eec2d6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:31:37.981024 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-95020d10-61c5-4647-bdd9-2c09cf0c3420 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] 10.222.0.20 "GET /compute/v2.1/servers/0c726bb2-8fea-4b2d-9e57-a585032c3155" status: 200 len: 1314 microversion: 2.1 time: 0.612748 Oct 27 03:31:37.986606 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1395/2697] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:31:37 2022] GET /compute/v2.1/servers/0c726bb2-8fea-4b2d-9e57-a585032c3155 => generated 1314 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:31:37.997150 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d067f569-bfb6-4ddf-b59e-ec71c3496e95 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:38.001646 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d067f569-bfb6-4ddf-b59e-ec71c3496e95 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] [instance: 284c90a7-3cda-4d66-a8e1-646f27c28138] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:31:38.015622 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d067f569-bfb6-4ddf-b59e-ec71c3496e95 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:38.017791 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d067f569-bfb6-4ddf-b59e-ec71c3496e95 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:38.019136 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d067f569-bfb6-4ddf-b59e-ec71c3496e95 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:38.023117 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d067f569-bfb6-4ddf-b59e-ec71c3496e95 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:38.023879 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d067f569-bfb6-4ddf-b59e-ec71c3496e95 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:38.024556 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d067f569-bfb6-4ddf-b59e-ec71c3496e95 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:38.204054 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d067f569-bfb6-4ddf-b59e-ec71c3496e95 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a1244a7e994427a6ff0625743956e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e1c2fc2755040e4b6fcf82534d67e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:31:38.219223 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d067f569-bfb6-4ddf-b59e-ec71c3496e95 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] 10.222.0.20 "GET /compute/v2.1/servers/284c90a7-3cda-4d66-a8e1-646f27c28138" status: 200 len: 1272 microversion: 2.1 time: 0.231713 Oct 27 03:31:38.240409 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1396/2698] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:31:37 2022] GET /compute/v2.1/servers/284c90a7-3cda-4d66-a8e1-646f27c28138 => generated 1272 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:31:38.298597 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-4934e07c-50a8-4edb-95b5-dd8fac1a2330 req-9ae5bfa7-72e7-4497-bb66-9644e01943a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d06aebf-d50e-4bdf-90ec-d64b1f1de254", "tag": "de9653b5-3102-4eac-b7bf-d89662d9f8a8"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:31:38.327355 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-4934e07c-50a8-4edb-95b5-dd8fac1a2330 req-9ae5bfa7-72e7-4497-bb66-9644e01943a7 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:38.327355 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-4934e07c-50a8-4edb-95b5-dd8fac1a2330 req-9ae5bfa7-72e7-4497-bb66-9644e01943a7 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:38.327355 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-4934e07c-50a8-4edb-95b5-dd8fac1a2330 req-9ae5bfa7-72e7-4497-bb66-9644e01943a7 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:38.392484 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-4934e07c-50a8-4edb-95b5-dd8fac1a2330 req-9ae5bfa7-72e7-4497-bb66-9644e01943a7 service nova] Creating event network-changed:de9653b5-3102-4eac-b7bf-d89662d9f8a8 for instance 0d06aebf-d50e-4bdf-90ec-d64b1f1de254 on n-h1-862769-1 Oct 27 03:31:38.399909 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-4934e07c-50a8-4edb-95b5-dd8fac1a2330 req-9ae5bfa7-72e7-4497-bb66-9644e01943a7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111887 Oct 27 03:31:38.410934 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1397/2699] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:31:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 27 03:31:38.416922 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-176c62a5-ccfb-48d1-b2e4-31d946e70712 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:38.417649 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-176c62a5-ccfb-48d1-b2e4-31d946e70712 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] [instance: 0d06aebf-d50e-4bdf-90ec-d64b1f1de254] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:31:38.435881 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-176c62a5-ccfb-48d1-b2e4-31d946e70712 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:38.436404 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-176c62a5-ccfb-48d1-b2e4-31d946e70712 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:38.436852 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-176c62a5-ccfb-48d1-b2e4-31d946e70712 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:38.437581 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-176c62a5-ccfb-48d1-b2e4-31d946e70712 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:38.438054 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-176c62a5-ccfb-48d1-b2e4-31d946e70712 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:38.438487 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-176c62a5-ccfb-48d1-b2e4-31d946e70712 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:38.985451 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-176c62a5-ccfb-48d1-b2e4-31d946e70712 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba8b60cf1164a388f626b0708556775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe1ca8678d43c38731d15b0bf99cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:31:38.999470 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-176c62a5-ccfb-48d1-b2e4-31d946e70712 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] 10.222.0.20 "GET /compute/v2.1/servers/0d06aebf-d50e-4bdf-90ec-d64b1f1de254" status: 200 len: 1317 microversion: 2.1 time: 0.587115 Oct 27 03:31:39.004866 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1398/2700] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:31:38 2022] GET /compute/v2.1/servers/0d06aebf-d50e-4bdf-90ec-d64b1f1de254 => generated 1317 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:31:39.013477 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-64f376da-11a4-4508-9503-7be32e74c778 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:39.018513 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-64f376da-11a4-4508-9503-7be32e74c778 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] [instance: 0c726bb2-8fea-4b2d-9e57-a585032c3155] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:31:39.036397 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-64f376da-11a4-4508-9503-7be32e74c778 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:39.039679 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-64f376da-11a4-4508-9503-7be32e74c778 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:39.040348 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-64f376da-11a4-4508-9503-7be32e74c778 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:39.042703 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-64f376da-11a4-4508-9503-7be32e74c778 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:39.043517 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-64f376da-11a4-4508-9503-7be32e74c778 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:39.048003 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-64f376da-11a4-4508-9503-7be32e74c778 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:39.142115 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=20 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:31:39.609251 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-64f376da-11a4-4508-9503-7be32e74c778 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533917bc5aa4e23802a43b1eb534bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d87abf835a4104b40056b9eec2d6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:31:39.632365 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-64f376da-11a4-4508-9503-7be32e74c778 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] 10.222.0.20 "GET /compute/v2.1/servers/0c726bb2-8fea-4b2d-9e57-a585032c3155" status: 200 len: 1314 microversion: 2.1 time: 0.620712 Oct 27 03:31:39.635850 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1399/2701] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:31:39 2022] GET /compute/v2.1/servers/0c726bb2-8fea-4b2d-9e57-a585032c3155 => generated 1314 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:31:39.661970 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-cc4be31d-3c42-4a81-9466-59a66dedb84e tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:39.665096 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-cc4be31d-3c42-4a81-9466-59a66dedb84e tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] [instance: 284c90a7-3cda-4d66-a8e1-646f27c28138] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:31:39.700476 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cc4be31d-3c42-4a81-9466-59a66dedb84e tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:39.701480 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cc4be31d-3c42-4a81-9466-59a66dedb84e tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:39.702016 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cc4be31d-3c42-4a81-9466-59a66dedb84e tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:39.702865 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cc4be31d-3c42-4a81-9466-59a66dedb84e tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:39.707019 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cc4be31d-3c42-4a81-9466-59a66dedb84e tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:39.707509 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cc4be31d-3c42-4a81-9466-59a66dedb84e tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:39.808284 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:31:40.166453 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-cc4be31d-3c42-4a81-9466-59a66dedb84e tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a1244a7e994427a6ff0625743956e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e1c2fc2755040e4b6fcf82534d67e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:31:40.174741 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-cc4be31d-3c42-4a81-9466-59a66dedb84e tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] 10.222.0.20 "GET /compute/v2.1/servers/284c90a7-3cda-4d66-a8e1-646f27c28138" status: 200 len: 1314 microversion: 2.1 time: 0.535713 Oct 27 03:31:40.175361 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1400/2702] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:31:39 2022] GET /compute/v2.1/servers/284c90a7-3cda-4d66-a8e1-646f27c28138 => generated 1314 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:31:40.215308 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-44768cfe-256a-43aa-aa34-6742c278dd0a req-a11ea8fe-432e-463c-a116-00f4502887f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0c6560f-ade1-4ae6-905e-ad488f4c3b51", "name": "network-vif-plugged", "status": "completed", "tag": "374bf7dd-46fc-42a5-a069-b8b5708a33a0"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:31:40.250316 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-44768cfe-256a-43aa-aa34-6742c278dd0a req-a11ea8fe-432e-463c-a116-00f4502887f2 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:40.250731 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-44768cfe-256a-43aa-aa34-6742c278dd0a req-a11ea8fe-432e-463c-a116-00f4502887f2 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:40.251175 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-44768cfe-256a-43aa-aa34-6742c278dd0a req-a11ea8fe-432e-463c-a116-00f4502887f2 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:40.292854 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-44768cfe-256a-43aa-aa34-6742c278dd0a req-a11ea8fe-432e-463c-a116-00f4502887f2 service nova] Creating event network-vif-plugged:374bf7dd-46fc-42a5-a069-b8b5708a33a0 for instance b0c6560f-ade1-4ae6-905e-ad488f4c3b51 on n-h2-862769-1 Oct 27 03:31:40.309794 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-44768cfe-256a-43aa-aa34-6742c278dd0a req-a11ea8fe-432e-463c-a116-00f4502887f2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103114 Oct 27 03:31:40.310904 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1401/2703] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:31:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:31:40.316606 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b509518a-64ab-414b-8f01-f88f96e8c3bb tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:40.317503 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b509518a-64ab-414b-8f01-f88f96e8c3bb tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] [instance: 0d06aebf-d50e-4bdf-90ec-d64b1f1de254] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:31:40.335316 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b509518a-64ab-414b-8f01-f88f96e8c3bb tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:40.335809 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b509518a-64ab-414b-8f01-f88f96e8c3bb tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:40.336248 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b509518a-64ab-414b-8f01-f88f96e8c3bb tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:40.336959 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b509518a-64ab-414b-8f01-f88f96e8c3bb tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:40.337413 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b509518a-64ab-414b-8f01-f88f96e8c3bb tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:40.337841 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b509518a-64ab-414b-8f01-f88f96e8c3bb tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:40.634185 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b509518a-64ab-414b-8f01-f88f96e8c3bb tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba8b60cf1164a388f626b0708556775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe1ca8678d43c38731d15b0bf99cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:31:40.644380 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b509518a-64ab-414b-8f01-f88f96e8c3bb tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] 10.222.0.20 "GET /compute/v2.1/servers/0d06aebf-d50e-4bdf-90ec-d64b1f1de254" status: 200 len: 1317 microversion: 2.1 time: 0.332280 Oct 27 03:31:40.649435 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1402/2704] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:31:40 2022] GET /compute/v2.1/servers/0d06aebf-d50e-4bdf-90ec-d64b1f1de254 => generated 1317 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:31:40.667103 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-65d59570-2034-4507-9204-5340e867180f tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:40.668118 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-65d59570-2034-4507-9204-5340e867180f tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] [instance: 0c726bb2-8fea-4b2d-9e57-a585032c3155] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:31:40.683003 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-65d59570-2034-4507-9204-5340e867180f tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:40.684265 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-65d59570-2034-4507-9204-5340e867180f tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:40.685251 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-65d59570-2034-4507-9204-5340e867180f tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:40.686009 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-65d59570-2034-4507-9204-5340e867180f tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:40.686499 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-65d59570-2034-4507-9204-5340e867180f tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:40.688199 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-65d59570-2034-4507-9204-5340e867180f tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:40.976301 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-65d59570-2034-4507-9204-5340e867180f tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533917bc5aa4e23802a43b1eb534bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d87abf835a4104b40056b9eec2d6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:31:40.997770 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-65d59570-2034-4507-9204-5340e867180f tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] 10.222.0.20 "GET /compute/v2.1/servers/0c726bb2-8fea-4b2d-9e57-a585032c3155" status: 200 len: 1314 microversion: 2.1 time: 0.331696 Oct 27 03:31:40.997770 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1403/2705] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:31:40 2022] GET /compute/v2.1/servers/0c726bb2-8fea-4b2d-9e57-a585032c3155 => generated 1314 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:31:40.997770 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-f474d4bb-6d22-4e40-ae0c-310bac5178bf req-78fc1dd4-1b08-4e82-b1c1-d1e171833cff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c726bb2-8fea-4b2d-9e57-a585032c3155", "tag": "89b1e705-64ca-4db0-94f7-a3663d1afe3e"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:31:41.025187 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-f474d4bb-6d22-4e40-ae0c-310bac5178bf req-78fc1dd4-1b08-4e82-b1c1-d1e171833cff service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:41.026642 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-f474d4bb-6d22-4e40-ae0c-310bac5178bf req-78fc1dd4-1b08-4e82-b1c1-d1e171833cff service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:41.027307 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-f474d4bb-6d22-4e40-ae0c-310bac5178bf req-78fc1dd4-1b08-4e82-b1c1-d1e171833cff service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:41.046206 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-f474d4bb-6d22-4e40-ae0c-310bac5178bf req-78fc1dd4-1b08-4e82-b1c1-d1e171833cff service nova] Creating event network-changed:89b1e705-64ca-4db0-94f7-a3663d1afe3e for instance 0c726bb2-8fea-4b2d-9e57-a585032c3155 on n-h1-862769-1 Oct 27 03:31:41.209196 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-f474d4bb-6d22-4e40-ae0c-310bac5178bf req-78fc1dd4-1b08-4e82-b1c1-d1e171833cff service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063871 Oct 27 03:31:41.209196 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1404/2706] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:31:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:31:41.209196 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-387df9bf-bc7c-4d22-9da2-918b9c8bb246 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:41.209196 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-387df9bf-bc7c-4d22-9da2-918b9c8bb246 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] [instance: 284c90a7-3cda-4d66-a8e1-646f27c28138] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:31:41.213190 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-387df9bf-bc7c-4d22-9da2-918b9c8bb246 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:41.214361 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-387df9bf-bc7c-4d22-9da2-918b9c8bb246 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:41.214843 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-387df9bf-bc7c-4d22-9da2-918b9c8bb246 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:41.215584 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-387df9bf-bc7c-4d22-9da2-918b9c8bb246 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:41.216091 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-387df9bf-bc7c-4d22-9da2-918b9c8bb246 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:41.216535 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-387df9bf-bc7c-4d22-9da2-918b9c8bb246 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:41.397188 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-387df9bf-bc7c-4d22-9da2-918b9c8bb246 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a1244a7e994427a6ff0625743956e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e1c2fc2755040e4b6fcf82534d67e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:31:41.409421 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-387df9bf-bc7c-4d22-9da2-918b9c8bb246 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] 10.222.0.20 "GET /compute/v2.1/servers/284c90a7-3cda-4d66-a8e1-646f27c28138" status: 200 len: 1314 microversion: 2.1 time: 0.213406 Oct 27 03:31:41.428470 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1405/2707] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:31:41 2022] GET /compute/v2.1/servers/284c90a7-3cda-4d66-a8e1-646f27c28138 => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:31:41.677798 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-25e0224b-b6dc-4bf9-bb44-5fe92ad8f10c tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:41.680032 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-25e0224b-b6dc-4bf9-bb44-5fe92ad8f10c tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] [instance: 0d06aebf-d50e-4bdf-90ec-d64b1f1de254] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:31:41.688828 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-25e0224b-b6dc-4bf9-bb44-5fe92ad8f10c tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:41.690161 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-25e0224b-b6dc-4bf9-bb44-5fe92ad8f10c tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:41.690927 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-25e0224b-b6dc-4bf9-bb44-5fe92ad8f10c tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:41.692012 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-25e0224b-b6dc-4bf9-bb44-5fe92ad8f10c tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:41.692841 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-25e0224b-b6dc-4bf9-bb44-5fe92ad8f10c tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:41.693628 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-25e0224b-b6dc-4bf9-bb44-5fe92ad8f10c tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:42.235729 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-25e0224b-b6dc-4bf9-bb44-5fe92ad8f10c tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba8b60cf1164a388f626b0708556775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe1ca8678d43c38731d15b0bf99cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:31:42.253792 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-25e0224b-b6dc-4bf9-bb44-5fe92ad8f10c tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] 10.222.0.20 "GET /compute/v2.1/servers/0d06aebf-d50e-4bdf-90ec-d64b1f1de254" status: 200 len: 1317 microversion: 2.1 time: 0.583940 Oct 27 03:31:42.258450 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1406/2708] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:31:41 2022] GET /compute/v2.1/servers/0d06aebf-d50e-4bdf-90ec-d64b1f1de254 => generated 1317 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:31:42.263221 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-fbdf2e56-7df2-4453-82a7-2797c2d09b52 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:42.272979 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-fbdf2e56-7df2-4453-82a7-2797c2d09b52 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] [instance: 0c726bb2-8fea-4b2d-9e57-a585032c3155] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:31:42.292123 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fbdf2e56-7df2-4453-82a7-2797c2d09b52 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:42.292524 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fbdf2e56-7df2-4453-82a7-2797c2d09b52 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:42.292974 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fbdf2e56-7df2-4453-82a7-2797c2d09b52 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:42.293711 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fbdf2e56-7df2-4453-82a7-2797c2d09b52 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:42.294286 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fbdf2e56-7df2-4453-82a7-2797c2d09b52 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:42.294720 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fbdf2e56-7df2-4453-82a7-2797c2d09b52 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:42.821716 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-fbdf2e56-7df2-4453-82a7-2797c2d09b52 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533917bc5aa4e23802a43b1eb534bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d87abf835a4104b40056b9eec2d6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:31:42.833878 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-fbdf2e56-7df2-4453-82a7-2797c2d09b52 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] 10.222.0.20 "GET /compute/v2.1/servers/0c726bb2-8fea-4b2d-9e57-a585032c3155" status: 200 len: 1314 microversion: 2.1 time: 0.570596 Oct 27 03:31:42.834616 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1407/2709] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:31:42 2022] GET /compute/v2.1/servers/0c726bb2-8fea-4b2d-9e57-a585032c3155 => generated 1314 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:31:42.843412 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5f5c211b-0a40-4569-9a64-a15a3e3c2eb8 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:42.844057 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5f5c211b-0a40-4569-9a64-a15a3e3c2eb8 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] [instance: 284c90a7-3cda-4d66-a8e1-646f27c28138] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:31:42.863774 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5f5c211b-0a40-4569-9a64-a15a3e3c2eb8 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:42.864282 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5f5c211b-0a40-4569-9a64-a15a3e3c2eb8 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:42.866610 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5f5c211b-0a40-4569-9a64-a15a3e3c2eb8 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:42.866610 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5f5c211b-0a40-4569-9a64-a15a3e3c2eb8 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:42.866610 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5f5c211b-0a40-4569-9a64-a15a3e3c2eb8 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:42.866610 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5f5c211b-0a40-4569-9a64-a15a3e3c2eb8 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:43.171127 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5f5c211b-0a40-4569-9a64-a15a3e3c2eb8 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a1244a7e994427a6ff0625743956e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e1c2fc2755040e4b6fcf82534d67e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:31:43.183332 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5f5c211b-0a40-4569-9a64-a15a3e3c2eb8 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] 10.222.0.20 "GET /compute/v2.1/servers/284c90a7-3cda-4d66-a8e1-646f27c28138" status: 200 len: 1314 microversion: 2.1 time: 0.347549 Oct 27 03:31:43.201921 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1408/2710] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:31:42 2022] GET /compute/v2.1/servers/284c90a7-3cda-4d66-a8e1-646f27c28138 => generated 1314 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:31:43.212579 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-57b3fae4-c700-4a98-adff-b8f9f262a73f req-1d22c51b-8caa-4027-af06-0de1cc1b126b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "284c90a7-3cda-4d66-a8e1-646f27c28138", "tag": "3b2156fe-5b18-411d-a0ba-841df8590a4e"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:31:43.255258 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-57b3fae4-c700-4a98-adff-b8f9f262a73f req-1d22c51b-8caa-4027-af06-0de1cc1b126b service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:43.256353 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-57b3fae4-c700-4a98-adff-b8f9f262a73f req-1d22c51b-8caa-4027-af06-0de1cc1b126b service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:43.257006 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-57b3fae4-c700-4a98-adff-b8f9f262a73f req-1d22c51b-8caa-4027-af06-0de1cc1b126b service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:43.283456 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-57b3fae4-c700-4a98-adff-b8f9f262a73f req-1d22c51b-8caa-4027-af06-0de1cc1b126b service nova] Creating event network-changed:3b2156fe-5b18-411d-a0ba-841df8590a4e for instance 284c90a7-3cda-4d66-a8e1-646f27c28138 on n-h1-862769-1 Oct 27 03:31:43.298624 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-57b3fae4-c700-4a98-adff-b8f9f262a73f req-1d22c51b-8caa-4027-af06-0de1cc1b126b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097226 Oct 27 03:31:43.300028 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1409/2711] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:31:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:31:43.320155 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7147c888-f444-4f17-9093-177773e6764f tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:43.320631 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7147c888-f444-4f17-9093-177773e6764f tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] [instance: 0d06aebf-d50e-4bdf-90ec-d64b1f1de254] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:31:43.338137 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:31:43.339969 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7147c888-f444-4f17-9093-177773e6764f tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:43.340735 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7147c888-f444-4f17-9093-177773e6764f tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:43.344964 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7147c888-f444-4f17-9093-177773e6764f tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:43.345806 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7147c888-f444-4f17-9093-177773e6764f tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:43.347828 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7147c888-f444-4f17-9093-177773e6764f tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:43.347828 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7147c888-f444-4f17-9093-177773e6764f tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:43.616269 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7147c888-f444-4f17-9093-177773e6764f tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba8b60cf1164a388f626b0708556775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe1ca8678d43c38731d15b0bf99cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:31:43.628490 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7147c888-f444-4f17-9093-177773e6764f tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] 10.222.0.20 "GET /compute/v2.1/servers/0d06aebf-d50e-4bdf-90ec-d64b1f1de254" status: 200 len: 1317 microversion: 2.1 time: 0.323910 Oct 27 03:31:43.630943 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1410/2712] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:31:43 2022] GET /compute/v2.1/servers/0d06aebf-d50e-4bdf-90ec-d64b1f1de254 => generated 1317 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:31:43.857246 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1cd0d97d-44ff-47c7-918e-444743624528 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:43.858712 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1cd0d97d-44ff-47c7-918e-444743624528 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] [instance: 0c726bb2-8fea-4b2d-9e57-a585032c3155] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:31:43.873116 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1cd0d97d-44ff-47c7-918e-444743624528 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:43.873914 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1cd0d97d-44ff-47c7-918e-444743624528 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:43.874594 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1cd0d97d-44ff-47c7-918e-444743624528 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:43.875523 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1cd0d97d-44ff-47c7-918e-444743624528 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:43.876192 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1cd0d97d-44ff-47c7-918e-444743624528 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:43.876828 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1cd0d97d-44ff-47c7-918e-444743624528 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:44.240252 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:31:44.314109 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1cd0d97d-44ff-47c7-918e-444743624528 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533917bc5aa4e23802a43b1eb534bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d87abf835a4104b40056b9eec2d6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:31:44.330770 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1cd0d97d-44ff-47c7-918e-444743624528 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] 10.222.0.20 "GET /compute/v2.1/servers/0c726bb2-8fea-4b2d-9e57-a585032c3155" status: 200 len: 1314 microversion: 2.1 time: 0.477292 Oct 27 03:31:44.344021 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1411/2713] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:31:43 2022] GET /compute/v2.1/servers/0c726bb2-8fea-4b2d-9e57-a585032c3155 => generated 1314 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:31:44.344021 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3a4c28ca-cb8f-4873-936d-3a1bf34b79a1 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:44.344021 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3a4c28ca-cb8f-4873-936d-3a1bf34b79a1 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] [instance: 284c90a7-3cda-4d66-a8e1-646f27c28138] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:31:44.357550 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3a4c28ca-cb8f-4873-936d-3a1bf34b79a1 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:44.358545 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3a4c28ca-cb8f-4873-936d-3a1bf34b79a1 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:44.359321 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3a4c28ca-cb8f-4873-936d-3a1bf34b79a1 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:44.360398 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3a4c28ca-cb8f-4873-936d-3a1bf34b79a1 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:44.361081 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3a4c28ca-cb8f-4873-936d-3a1bf34b79a1 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:44.362329 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3a4c28ca-cb8f-4873-936d-3a1bf34b79a1 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:44.609412 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3a4c28ca-cb8f-4873-936d-3a1bf34b79a1 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a1244a7e994427a6ff0625743956e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e1c2fc2755040e4b6fcf82534d67e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:31:44.619590 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3a4c28ca-cb8f-4873-936d-3a1bf34b79a1 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] 10.222.0.20 "GET /compute/v2.1/servers/284c90a7-3cda-4d66-a8e1-646f27c28138" status: 200 len: 1314 microversion: 2.1 time: 0.285617 Oct 27 03:31:44.622120 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1412/2714] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:31:44 2022] GET /compute/v2.1/servers/284c90a7-3cda-4d66-a8e1-646f27c28138 => generated 1314 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:31:44.656543 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0c0730e2-c002-45b3-bb5d-5ac868b2814c tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:44.657324 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0c0730e2-c002-45b3-bb5d-5ac868b2814c tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] [instance: 0d06aebf-d50e-4bdf-90ec-d64b1f1de254] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:31:44.670884 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0c0730e2-c002-45b3-bb5d-5ac868b2814c tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:44.671390 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0c0730e2-c002-45b3-bb5d-5ac868b2814c tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:44.674548 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0c0730e2-c002-45b3-bb5d-5ac868b2814c tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:44.674548 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0c0730e2-c002-45b3-bb5d-5ac868b2814c tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:44.674548 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0c0730e2-c002-45b3-bb5d-5ac868b2814c tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:44.674548 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0c0730e2-c002-45b3-bb5d-5ac868b2814c tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:45.037022 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0c0730e2-c002-45b3-bb5d-5ac868b2814c tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba8b60cf1164a388f626b0708556775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe1ca8678d43c38731d15b0bf99cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:31:45.047439 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0c0730e2-c002-45b3-bb5d-5ac868b2814c tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] 10.222.0.20 "GET /compute/v2.1/servers/0d06aebf-d50e-4bdf-90ec-d64b1f1de254" status: 200 len: 1317 microversion: 2.1 time: 0.394759 Oct 27 03:31:45.048050 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1413/2715] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:31:44 2022] GET /compute/v2.1/servers/0d06aebf-d50e-4bdf-90ec-d64b1f1de254 => generated 1317 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:31:45.356359 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4087fec6-d790-42ef-a0b2-36e63c6f423b tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:45.357184 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4087fec6-d790-42ef-a0b2-36e63c6f423b tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] [instance: 0c726bb2-8fea-4b2d-9e57-a585032c3155] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:31:45.381774 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4087fec6-d790-42ef-a0b2-36e63c6f423b tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:45.382615 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4087fec6-d790-42ef-a0b2-36e63c6f423b tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:45.383218 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4087fec6-d790-42ef-a0b2-36e63c6f423b tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:45.384002 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4087fec6-d790-42ef-a0b2-36e63c6f423b tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:45.394721 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4087fec6-d790-42ef-a0b2-36e63c6f423b tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:45.397703 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4087fec6-d790-42ef-a0b2-36e63c6f423b tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:45.713138 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:31:45.731937 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4087fec6-d790-42ef-a0b2-36e63c6f423b tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533917bc5aa4e23802a43b1eb534bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d87abf835a4104b40056b9eec2d6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:31:45.743555 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4087fec6-d790-42ef-a0b2-36e63c6f423b tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] 10.222.0.20 "GET /compute/v2.1/servers/0c726bb2-8fea-4b2d-9e57-a585032c3155" status: 200 len: 1314 microversion: 2.1 time: 0.391071 Oct 27 03:31:45.764810 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1414/2716] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:31:45 2022] GET /compute/v2.1/servers/0c726bb2-8fea-4b2d-9e57-a585032c3155 => generated 1314 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:31:45.773543 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2885303e-b4d6-426d-b82a-0968459dfe7d tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:45.774774 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2885303e-b4d6-426d-b82a-0968459dfe7d tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] [instance: 284c90a7-3cda-4d66-a8e1-646f27c28138] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:31:45.783832 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2885303e-b4d6-426d-b82a-0968459dfe7d tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:45.785517 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2885303e-b4d6-426d-b82a-0968459dfe7d tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:45.786454 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2885303e-b4d6-426d-b82a-0968459dfe7d tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:45.787434 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2885303e-b4d6-426d-b82a-0968459dfe7d tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:45.789203 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2885303e-b4d6-426d-b82a-0968459dfe7d tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:45.789875 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2885303e-b4d6-426d-b82a-0968459dfe7d tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:46.044011 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2885303e-b4d6-426d-b82a-0968459dfe7d tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a1244a7e994427a6ff0625743956e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e1c2fc2755040e4b6fcf82534d67e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:31:46.056026 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2885303e-b4d6-426d-b82a-0968459dfe7d tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] 10.222.0.20 "GET /compute/v2.1/servers/284c90a7-3cda-4d66-a8e1-646f27c28138" status: 200 len: 1314 microversion: 2.1 time: 0.287895 Oct 27 03:31:46.057649 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1415/2717] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:31:45 2022] GET /compute/v2.1/servers/284c90a7-3cda-4d66-a8e1-646f27c28138 => generated 1314 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:31:46.065359 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-464864a0-3067-40eb-a756-60aaebb46d59 req-27496fe4-361f-4677-b254-fd6cfba4edd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d06aebf-d50e-4bdf-90ec-d64b1f1de254", "name": "network-vif-plugged", "status": "completed", "tag": "de9653b5-3102-4eac-b7bf-d89662d9f8a8"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:31:46.080068 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-464864a0-3067-40eb-a756-60aaebb46d59 req-27496fe4-361f-4677-b254-fd6cfba4edd6 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:46.080068 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-464864a0-3067-40eb-a756-60aaebb46d59 req-27496fe4-361f-4677-b254-fd6cfba4edd6 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:46.080068 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-464864a0-3067-40eb-a756-60aaebb46d59 req-27496fe4-361f-4677-b254-fd6cfba4edd6 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:46.095567 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-464864a0-3067-40eb-a756-60aaebb46d59 req-27496fe4-361f-4677-b254-fd6cfba4edd6 service nova] Creating event network-vif-plugged:de9653b5-3102-4eac-b7bf-d89662d9f8a8 for instance 0d06aebf-d50e-4bdf-90ec-d64b1f1de254 on n-h1-862769-1 Oct 27 03:31:46.106433 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-464864a0-3067-40eb-a756-60aaebb46d59 req-27496fe4-361f-4677-b254-fd6cfba4edd6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044518 Oct 27 03:31:46.116109 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1416/2718] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:31:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:31:46.159619 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4ed4d020-3474-409e-897c-f438a3efd432 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:46.160683 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4ed4d020-3474-409e-897c-f438a3efd432 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] [instance: 0d06aebf-d50e-4bdf-90ec-d64b1f1de254] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:31:46.185877 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4ed4d020-3474-409e-897c-f438a3efd432 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:46.186412 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4ed4d020-3474-409e-897c-f438a3efd432 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:46.186994 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4ed4d020-3474-409e-897c-f438a3efd432 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:46.187711 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4ed4d020-3474-409e-897c-f438a3efd432 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:46.188179 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4ed4d020-3474-409e-897c-f438a3efd432 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:46.188669 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4ed4d020-3474-409e-897c-f438a3efd432 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:46.573230 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4ed4d020-3474-409e-897c-f438a3efd432 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba8b60cf1164a388f626b0708556775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe1ca8678d43c38731d15b0bf99cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:31:46.583599 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4ed4d020-3474-409e-897c-f438a3efd432 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] 10.222.0.20 "GET /compute/v2.1/servers/0d06aebf-d50e-4bdf-90ec-d64b1f1de254" status: 200 len: 1317 microversion: 2.1 time: 0.455764 Oct 27 03:31:46.584769 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1417/2719] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:31:46 2022] GET /compute/v2.1/servers/0d06aebf-d50e-4bdf-90ec-d64b1f1de254 => generated 1317 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:31:46.772829 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b93193da-dd56-4b03-8903-c2d8464ce17b tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:46.773472 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b93193da-dd56-4b03-8903-c2d8464ce17b tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] [instance: 0c726bb2-8fea-4b2d-9e57-a585032c3155] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:31:46.786174 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b93193da-dd56-4b03-8903-c2d8464ce17b tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:46.786512 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b93193da-dd56-4b03-8903-c2d8464ce17b tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:46.786986 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b93193da-dd56-4b03-8903-c2d8464ce17b tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:46.787875 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b93193da-dd56-4b03-8903-c2d8464ce17b tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:46.788417 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b93193da-dd56-4b03-8903-c2d8464ce17b tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:46.788788 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b93193da-dd56-4b03-8903-c2d8464ce17b tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:47.014188 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b93193da-dd56-4b03-8903-c2d8464ce17b tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533917bc5aa4e23802a43b1eb534bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d87abf835a4104b40056b9eec2d6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:31:47.024805 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b93193da-dd56-4b03-8903-c2d8464ce17b tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] 10.222.0.20 "GET /compute/v2.1/servers/0c726bb2-8fea-4b2d-9e57-a585032c3155" status: 200 len: 1314 microversion: 2.1 time: 0.255595 Oct 27 03:31:47.038137 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1418/2720] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:31:46 2022] GET /compute/v2.1/servers/0c726bb2-8fea-4b2d-9e57-a585032c3155 => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:31:47.093083 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1f942d2f-bc8c-493b-9f8d-64d0158eb773 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:47.094182 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1f942d2f-bc8c-493b-9f8d-64d0158eb773 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] [instance: 284c90a7-3cda-4d66-a8e1-646f27c28138] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:31:47.107828 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1f942d2f-bc8c-493b-9f8d-64d0158eb773 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:47.108455 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1f942d2f-bc8c-493b-9f8d-64d0158eb773 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:47.114734 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1f942d2f-bc8c-493b-9f8d-64d0158eb773 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:47.115510 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1f942d2f-bc8c-493b-9f8d-64d0158eb773 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:47.116220 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1f942d2f-bc8c-493b-9f8d-64d0158eb773 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:47.116711 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1f942d2f-bc8c-493b-9f8d-64d0158eb773 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:47.330843 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1f942d2f-bc8c-493b-9f8d-64d0158eb773 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a1244a7e994427a6ff0625743956e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e1c2fc2755040e4b6fcf82534d67e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:31:47.336195 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=100 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:31:47.343362 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1f942d2f-bc8c-493b-9f8d-64d0158eb773 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] 10.222.0.20 "GET /compute/v2.1/servers/284c90a7-3cda-4d66-a8e1-646f27c28138" status: 200 len: 1314 microversion: 2.1 time: 0.257680 Oct 27 03:31:47.356370 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1419/2721] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:31:47 2022] GET /compute/v2.1/servers/284c90a7-3cda-4d66-a8e1-646f27c28138 => generated 1314 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:31:47.624458 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ceea19ba-f01d-4b65-bdc6-06f7f9851801 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:47.625253 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ceea19ba-f01d-4b65-bdc6-06f7f9851801 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] [instance: 0d06aebf-d50e-4bdf-90ec-d64b1f1de254] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:31:47.632928 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ceea19ba-f01d-4b65-bdc6-06f7f9851801 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:47.633465 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ceea19ba-f01d-4b65-bdc6-06f7f9851801 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:47.633910 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ceea19ba-f01d-4b65-bdc6-06f7f9851801 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:47.634750 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ceea19ba-f01d-4b65-bdc6-06f7f9851801 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:47.635200 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ceea19ba-f01d-4b65-bdc6-06f7f9851801 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:47.635631 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ceea19ba-f01d-4b65-bdc6-06f7f9851801 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:47.895383 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ceea19ba-f01d-4b65-bdc6-06f7f9851801 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba8b60cf1164a388f626b0708556775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe1ca8678d43c38731d15b0bf99cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:31:47.904464 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ceea19ba-f01d-4b65-bdc6-06f7f9851801 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] 10.222.0.20 "GET /compute/v2.1/servers/0d06aebf-d50e-4bdf-90ec-d64b1f1de254" status: 200 len: 1317 microversion: 2.1 time: 0.294987 Oct 27 03:31:47.920809 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1420/2722] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:31:47 2022] GET /compute/v2.1/servers/0d06aebf-d50e-4bdf-90ec-d64b1f1de254 => generated 1317 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:31:48.048750 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-255c60e8-6062-455a-9d8d-9761dc51ea72 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:48.051749 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-255c60e8-6062-455a-9d8d-9761dc51ea72 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] [instance: 0c726bb2-8fea-4b2d-9e57-a585032c3155] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:31:48.070644 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-255c60e8-6062-455a-9d8d-9761dc51ea72 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:48.070855 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-255c60e8-6062-455a-9d8d-9761dc51ea72 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:48.071246 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-255c60e8-6062-455a-9d8d-9761dc51ea72 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:48.071979 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-255c60e8-6062-455a-9d8d-9761dc51ea72 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:48.072429 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-255c60e8-6062-455a-9d8d-9761dc51ea72 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:48.072864 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-255c60e8-6062-455a-9d8d-9761dc51ea72 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:48.424967 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-255c60e8-6062-455a-9d8d-9761dc51ea72 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533917bc5aa4e23802a43b1eb534bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d87abf835a4104b40056b9eec2d6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:31:48.436647 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-255c60e8-6062-455a-9d8d-9761dc51ea72 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] 10.222.0.20 "GET /compute/v2.1/servers/0c726bb2-8fea-4b2d-9e57-a585032c3155" status: 200 len: 1314 microversion: 2.1 time: 0.391324 Oct 27 03:31:48.453757 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1421/2723] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:31:48 2022] GET /compute/v2.1/servers/0c726bb2-8fea-4b2d-9e57-a585032c3155 => generated 1314 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:31:48.469730 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-f8be7700-3efd-4daa-b73e-e414a90e0348 req-c8e0cd3b-baa6-4b91-90af-300a6f107885 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "284c90a7-3cda-4d66-a8e1-646f27c28138", "name": "network-vif-plugged", "status": "completed", "tag": "3b2156fe-5b18-411d-a0ba-841df8590a4e"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:31:48.495181 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-f8be7700-3efd-4daa-b73e-e414a90e0348 req-c8e0cd3b-baa6-4b91-90af-300a6f107885 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:48.495913 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-f8be7700-3efd-4daa-b73e-e414a90e0348 req-c8e0cd3b-baa6-4b91-90af-300a6f107885 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:48.496521 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-f8be7700-3efd-4daa-b73e-e414a90e0348 req-c8e0cd3b-baa6-4b91-90af-300a6f107885 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:48.548548 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-f8be7700-3efd-4daa-b73e-e414a90e0348 req-c8e0cd3b-baa6-4b91-90af-300a6f107885 service nova] Creating event network-vif-plugged:3b2156fe-5b18-411d-a0ba-841df8590a4e for instance 284c90a7-3cda-4d66-a8e1-646f27c28138 on n-h1-862769-1 Oct 27 03:31:48.563171 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-f8be7700-3efd-4daa-b73e-e414a90e0348 req-c8e0cd3b-baa6-4b91-90af-300a6f107885 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107511 Oct 27 03:31:48.568118 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1422/2724] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:31:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:31:48.581060 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9292cfd8-0e61-453a-b244-fa9841e05326 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:48.583216 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-9292cfd8-0e61-453a-b244-fa9841e05326 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] [instance: 284c90a7-3cda-4d66-a8e1-646f27c28138] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:31:48.599767 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9292cfd8-0e61-453a-b244-fa9841e05326 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:48.603609 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9292cfd8-0e61-453a-b244-fa9841e05326 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:48.605103 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9292cfd8-0e61-453a-b244-fa9841e05326 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:48.610428 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9292cfd8-0e61-453a-b244-fa9841e05326 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:48.611153 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9292cfd8-0e61-453a-b244-fa9841e05326 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:48.611780 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9292cfd8-0e61-453a-b244-fa9841e05326 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:48.895828 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9292cfd8-0e61-453a-b244-fa9841e05326 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a1244a7e994427a6ff0625743956e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e1c2fc2755040e4b6fcf82534d67e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:31:48.907777 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9292cfd8-0e61-453a-b244-fa9841e05326 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] 10.222.0.20 "GET /compute/v2.1/servers/284c90a7-3cda-4d66-a8e1-646f27c28138" status: 200 len: 1314 microversion: 2.1 time: 0.337899 Oct 27 03:31:48.908657 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1423/2725] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:31:48 2022] GET /compute/v2.1/servers/284c90a7-3cda-4d66-a8e1-646f27c28138 => generated 1314 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:31:48.929522 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ac73c3e4-bf61-4112-92f5-e4e9f1252bb0 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:48.930224 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ac73c3e4-bf61-4112-92f5-e4e9f1252bb0 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] [instance: 0d06aebf-d50e-4bdf-90ec-d64b1f1de254] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:31:48.945525 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ac73c3e4-bf61-4112-92f5-e4e9f1252bb0 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:48.946733 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ac73c3e4-bf61-4112-92f5-e4e9f1252bb0 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:48.947185 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ac73c3e4-bf61-4112-92f5-e4e9f1252bb0 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:48.947914 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ac73c3e4-bf61-4112-92f5-e4e9f1252bb0 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:48.948367 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ac73c3e4-bf61-4112-92f5-e4e9f1252bb0 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:48.948799 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ac73c3e4-bf61-4112-92f5-e4e9f1252bb0 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:49.213605 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ac73c3e4-bf61-4112-92f5-e4e9f1252bb0 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba8b60cf1164a388f626b0708556775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe1ca8678d43c38731d15b0bf99cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:31:49.222813 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ac73c3e4-bf61-4112-92f5-e4e9f1252bb0 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] 10.222.0.20 "GET /compute/v2.1/servers/0d06aebf-d50e-4bdf-90ec-d64b1f1de254" status: 200 len: 1504 microversion: 2.1 time: 0.297539 Oct 27 03:31:49.238136 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1424/2726] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:31:48 2022] GET /compute/v2.1/servers/0d06aebf-d50e-4bdf-90ec-d64b1f1de254 => generated 1504 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:31:49.253173 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-29e9f766-8919-418b-9517-e98bb6658555 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:49.253770 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-29e9f766-8919-418b-9517-e98bb6658555 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] [instance: 0d06aebf-d50e-4bdf-90ec-d64b1f1de254] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:31:49.268910 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-29e9f766-8919-418b-9517-e98bb6658555 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:49.269727 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-29e9f766-8919-418b-9517-e98bb6658555 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:49.270222 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-29e9f766-8919-418b-9517-e98bb6658555 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:49.270967 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-29e9f766-8919-418b-9517-e98bb6658555 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:49.274091 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-29e9f766-8919-418b-9517-e98bb6658555 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:49.274653 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-29e9f766-8919-418b-9517-e98bb6658555 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:49.370905 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-29e9f766-8919-418b-9517-e98bb6658555 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '4ba8b60cf1164a388f626b0708556775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe1ca8678d43c38731d15b0bf99cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:31:49.371906 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-29e9f766-8919-418b-9517-e98bb6658555 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] 10.222.0.20 "GET /compute/v2.1/servers/0d06aebf-d50e-4bdf-90ec-d64b1f1de254/os-instance-actions/req-85d97252-84e8-4ab4-9413-feb500da4632" status: 200 len: 313 microversion: 2.1 time: 0.124769 Oct 27 03:31:49.382693 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1425/2727] 10.222.0.20 () {58 vars in 1419 bytes} [Thu Oct 27 03:31:49 2022] GET /compute/v2.1/servers/0d06aebf-d50e-4bdf-90ec-d64b1f1de254/os-instance-actions/req-85d97252-84e8-4ab4-9413-feb500da4632 => generated 313 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:31:49.392318 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2eaf3139-d402-4b52-b8fb-0a57ba5c0701 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:31:49.396367 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2eaf3139-d402-4b52-b8fb-0a57ba5c0701 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] [instance: 0d06aebf-d50e-4bdf-90ec-d64b1f1de254] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:31:49.412187 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2eaf3139-d402-4b52-b8fb-0a57ba5c0701 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:49.412757 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2eaf3139-d402-4b52-b8fb-0a57ba5c0701 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:49.413452 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2eaf3139-d402-4b52-b8fb-0a57ba5c0701 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:49.414220 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2eaf3139-d402-4b52-b8fb-0a57ba5c0701 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:49.414692 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2eaf3139-d402-4b52-b8fb-0a57ba5c0701 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:49.415332 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2eaf3139-d402-4b52-b8fb-0a57ba5c0701 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:49.758501 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2eaf3139-d402-4b52-b8fb-0a57ba5c0701 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] 10.222.0.20 "POST /compute/v2.1/servers/0d06aebf-d50e-4bdf-90ec-d64b1f1de254/action" status: 202 len: 0 microversion: 2.1 time: 0.371374 Oct 27 03:31:49.759174 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1426/2728] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:31:49 2022] POST /compute/v2.1/servers/0d06aebf-d50e-4bdf-90ec-d64b1f1de254/action => generated 0 bytes in 374 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:31:49.797473 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-563d5d8f-62b3-463b-aa71-c28bd78dff83 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:49.799443 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-563d5d8f-62b3-463b-aa71-c28bd78dff83 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] [instance: 0c726bb2-8fea-4b2d-9e57-a585032c3155] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:31:49.833739 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-563d5d8f-62b3-463b-aa71-c28bd78dff83 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:49.837629 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-563d5d8f-62b3-463b-aa71-c28bd78dff83 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:49.838263 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-563d5d8f-62b3-463b-aa71-c28bd78dff83 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:49.840362 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-563d5d8f-62b3-463b-aa71-c28bd78dff83 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:49.840362 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-563d5d8f-62b3-463b-aa71-c28bd78dff83 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:49.840941 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-563d5d8f-62b3-463b-aa71-c28bd78dff83 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:50.227806 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-563d5d8f-62b3-463b-aa71-c28bd78dff83 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533917bc5aa4e23802a43b1eb534bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d87abf835a4104b40056b9eec2d6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:31:50.245820 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-563d5d8f-62b3-463b-aa71-c28bd78dff83 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] 10.222.0.20 "GET /compute/v2.1/servers/0c726bb2-8fea-4b2d-9e57-a585032c3155" status: 200 len: 1314 microversion: 2.1 time: 0.477498 Oct 27 03:31:50.245820 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1427/2729] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:31:49 2022] GET /compute/v2.1/servers/0c726bb2-8fea-4b2d-9e57-a585032c3155 => generated 1314 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:31:50.245820 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8a5d662a-fcb2-4d93-b36c-2d8bf9233b75 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:50.248191 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8a5d662a-fcb2-4d93-b36c-2d8bf9233b75 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] [instance: 0d06aebf-d50e-4bdf-90ec-d64b1f1de254] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:31:50.255208 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8a5d662a-fcb2-4d93-b36c-2d8bf9233b75 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:50.255787 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8a5d662a-fcb2-4d93-b36c-2d8bf9233b75 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:50.256335 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8a5d662a-fcb2-4d93-b36c-2d8bf9233b75 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:50.257212 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8a5d662a-fcb2-4d93-b36c-2d8bf9233b75 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:50.257998 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8a5d662a-fcb2-4d93-b36c-2d8bf9233b75 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:50.258305 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8a5d662a-fcb2-4d93-b36c-2d8bf9233b75 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:50.545402 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8a5d662a-fcb2-4d93-b36c-2d8bf9233b75 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba8b60cf1164a388f626b0708556775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe1ca8678d43c38731d15b0bf99cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:31:50.560681 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8a5d662a-fcb2-4d93-b36c-2d8bf9233b75 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] 10.222.0.20 "GET /compute/v2.1/servers/0d06aebf-d50e-4bdf-90ec-d64b1f1de254" status: 200 len: 1506 microversion: 2.1 time: 0.319670 Oct 27 03:31:50.562480 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1428/2730] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:31:50 2022] GET /compute/v2.1/servers/0d06aebf-d50e-4bdf-90ec-d64b1f1de254 => generated 1506 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:31:50.572014 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6d5299af-2aad-4aee-9b8d-5941e047ca44 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:50.574365 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-6d5299af-2aad-4aee-9b8d-5941e047ca44 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] [instance: 284c90a7-3cda-4d66-a8e1-646f27c28138] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:31:50.591352 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6d5299af-2aad-4aee-9b8d-5941e047ca44 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:50.591847 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6d5299af-2aad-4aee-9b8d-5941e047ca44 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:50.592292 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6d5299af-2aad-4aee-9b8d-5941e047ca44 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:50.593014 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6d5299af-2aad-4aee-9b8d-5941e047ca44 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:50.593466 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6d5299af-2aad-4aee-9b8d-5941e047ca44 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:50.593892 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6d5299af-2aad-4aee-9b8d-5941e047ca44 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:50.950776 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6d5299af-2aad-4aee-9b8d-5941e047ca44 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a1244a7e994427a6ff0625743956e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e1c2fc2755040e4b6fcf82534d67e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:31:50.959327 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6d5299af-2aad-4aee-9b8d-5941e047ca44 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] 10.222.0.20 "GET /compute/v2.1/servers/284c90a7-3cda-4d66-a8e1-646f27c28138" status: 200 len: 1464 microversion: 2.1 time: 0.395770 Oct 27 03:31:50.966408 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1429/2731] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:31:50 2022] GET /compute/v2.1/servers/284c90a7-3cda-4d66-a8e1-646f27c28138 => generated 1464 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:31:51.103983 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a8a79c0f-86fa-497f-8928-cf9aafd46b8f tempest-TenantUsagesTestJSON-135243214 tempest-TenantUsagesTestJSON-135243214-project-admin] Calling method '.version_select at 0x7f7dd9fb25e0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:51.117891 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a8a79c0f-86fa-497f-8928-cf9aafd46b8f tempest-TenantUsagesTestJSON-135243214 tempest-TenantUsagesTestJSON-135243214-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:51.118417 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a8a79c0f-86fa-497f-8928-cf9aafd46b8f tempest-TenantUsagesTestJSON-135243214 tempest-TenantUsagesTestJSON-135243214-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:51.118857 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a8a79c0f-86fa-497f-8928-cf9aafd46b8f tempest-TenantUsagesTestJSON-135243214 tempest-TenantUsagesTestJSON-135243214-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:51.148979 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a8a79c0f-86fa-497f-8928-cf9aafd46b8f tempest-TenantUsagesTestJSON-135243214 tempest-TenantUsagesTestJSON-135243214-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:51.149659 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a8a79c0f-86fa-497f-8928-cf9aafd46b8f tempest-TenantUsagesTestJSON-135243214 tempest-TenantUsagesTestJSON-135243214-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:51.150641 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a8a79c0f-86fa-497f-8928-cf9aafd46b8f tempest-TenantUsagesTestJSON-135243214 tempest-TenantUsagesTestJSON-135243214-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:51.185376 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a8a79c0f-86fa-497f-8928-cf9aafd46b8f tempest-TenantUsagesTestJSON-135243214 tempest-TenantUsagesTestJSON-135243214-project-admin] 10.222.0.20 "GET /compute/v2.1/os-simple-tenant-usage/7e1c2fc2755040e4b6fcf82534d67e1c?start=2022-10-26T03%3A31%3A50.981440&end=2022-10-28T03%3A31%3A50.981440" status: 200 len: 700 microversion: 2.1 time: 0.198646 Oct 27 03:31:51.186767 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1430/2732] 10.222.0.20 () {58 vars in 1412 bytes} [Thu Oct 27 03:31:50 2022] GET /compute/v2.1/os-simple-tenant-usage/7e1c2fc2755040e4b6fcf82534d67e1c?start=2022-10-26T03%3A31%3A50.981440&end=2022-10-28T03%3A31%3A50.981440 => generated 700 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:31:51.208876 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-eabe35fc-6ac2-4f52-b3b1-e668944ba1e8 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Calling method '.version_select at 0x7f7dda058700>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:51.233539 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eabe35fc-6ac2-4f52-b3b1-e668944ba1e8 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:51.235321 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eabe35fc-6ac2-4f52-b3b1-e668944ba1e8 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:51.235853 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eabe35fc-6ac2-4f52-b3b1-e668944ba1e8 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:51.273302 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eabe35fc-6ac2-4f52-b3b1-e668944ba1e8 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:51.279099 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eabe35fc-6ac2-4f52-b3b1-e668944ba1e8 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:51.279599 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eabe35fc-6ac2-4f52-b3b1-e668944ba1e8 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:51.320083 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-eabe35fc-6ac2-4f52-b3b1-e668944ba1e8 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] 10.222.0.20 "GET /compute/v2.1/os-simple-tenant-usage/7e1c2fc2755040e4b6fcf82534d67e1c?start=2022-10-26T03%3A31%3A50.981440&end=2022-10-28T03%3A31%3A50.981440" status: 200 len: 695 microversion: 2.1 time: 0.118147 Oct 27 03:31:51.330664 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1431/2733] 10.222.0.20 () {58 vars in 1412 bytes} [Thu Oct 27 03:31:51 2022] GET /compute/v2.1/os-simple-tenant-usage/7e1c2fc2755040e4b6fcf82534d67e1c?start=2022-10-26T03%3A31%3A50.981440&end=2022-10-28T03%3A31%3A50.981440 => generated 695 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:31:51.330664 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-81aa42a4-3c0e-40cb-9d47-f9f110129796 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:51.330664 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-81aa42a4-3c0e-40cb-9d47-f9f110129796 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] [instance: 0c726bb2-8fea-4b2d-9e57-a585032c3155] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:31:51.337560 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-81aa42a4-3c0e-40cb-9d47-f9f110129796 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:51.337998 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-81aa42a4-3c0e-40cb-9d47-f9f110129796 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:51.338543 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-81aa42a4-3c0e-40cb-9d47-f9f110129796 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:51.342729 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-81aa42a4-3c0e-40cb-9d47-f9f110129796 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:51.343218 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-81aa42a4-3c0e-40cb-9d47-f9f110129796 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:51.343646 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-81aa42a4-3c0e-40cb-9d47-f9f110129796 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:51.499412 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-81aa42a4-3c0e-40cb-9d47-f9f110129796 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533917bc5aa4e23802a43b1eb534bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d87abf835a4104b40056b9eec2d6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:31:51.509674 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-81aa42a4-3c0e-40cb-9d47-f9f110129796 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] 10.222.0.20 "GET /compute/v2.1/servers/0c726bb2-8fea-4b2d-9e57-a585032c3155" status: 200 len: 1314 microversion: 2.1 time: 0.185503 Oct 27 03:31:51.530974 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1432/2734] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:31:51 2022] GET /compute/v2.1/servers/0c726bb2-8fea-4b2d-9e57-a585032c3155 => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:31:51.530974 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5400d033-9bcc-470e-b1aa-91b457143bde tempest-TenantUsagesTestJSON-135243214 tempest-TenantUsagesTestJSON-135243214-project-admin] Calling method '.version_select at 0x7f7dda04c9d0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:51.540072 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5400d033-9bcc-470e-b1aa-91b457143bde tempest-TenantUsagesTestJSON-135243214 tempest-TenantUsagesTestJSON-135243214-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:51.540469 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5400d033-9bcc-470e-b1aa-91b457143bde tempest-TenantUsagesTestJSON-135243214 tempest-TenantUsagesTestJSON-135243214-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:51.540929 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5400d033-9bcc-470e-b1aa-91b457143bde tempest-TenantUsagesTestJSON-135243214 tempest-TenantUsagesTestJSON-135243214-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:51.557970 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5400d033-9bcc-470e-b1aa-91b457143bde tempest-TenantUsagesTestJSON-135243214 tempest-TenantUsagesTestJSON-135243214-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:51.558493 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5400d033-9bcc-470e-b1aa-91b457143bde tempest-TenantUsagesTestJSON-135243214 tempest-TenantUsagesTestJSON-135243214-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:51.558935 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5400d033-9bcc-470e-b1aa-91b457143bde tempest-TenantUsagesTestJSON-135243214 tempest-TenantUsagesTestJSON-135243214-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:51.885321 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5400d033-9bcc-470e-b1aa-91b457143bde tempest-TenantUsagesTestJSON-135243214 tempest-TenantUsagesTestJSON-135243214-project-admin] 10.222.0.20 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-26T03%3A31%3A50.981440&end=2022-10-28T03%3A31%3A50.981440&detailed=1" status: 200 len: 29923 microversion: 2.1 time: 0.359143 Oct 27 03:31:51.904094 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1433/2735] 10.222.0.20 () {58 vars in 1335 bytes} [Thu Oct 27 03:31:51 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-26T03%3A31%3A50.981440&end=2022-10-28T03%3A31%3A50.981440&detailed=1 => generated 29923 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 03:31:51.928074 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2610da63-87d2-402f-a3ea-fc58a01687ee tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:51.929224 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2610da63-87d2-402f-a3ea-fc58a01687ee tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] [instance: 0d06aebf-d50e-4bdf-90ec-d64b1f1de254] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:31:51.945561 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2610da63-87d2-402f-a3ea-fc58a01687ee tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:51.946157 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2610da63-87d2-402f-a3ea-fc58a01687ee tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:51.946877 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2610da63-87d2-402f-a3ea-fc58a01687ee tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:51.947697 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2610da63-87d2-402f-a3ea-fc58a01687ee tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:51.948324 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2610da63-87d2-402f-a3ea-fc58a01687ee tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:51.948777 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2610da63-87d2-402f-a3ea-fc58a01687ee tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:52.258815 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2610da63-87d2-402f-a3ea-fc58a01687ee tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba8b60cf1164a388f626b0708556775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe1ca8678d43c38731d15b0bf99cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:31:52.268799 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2610da63-87d2-402f-a3ea-fc58a01687ee tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] 10.222.0.20 "GET /compute/v2.1/servers/0d06aebf-d50e-4bdf-90ec-d64b1f1de254" status: 200 len: 1506 microversion: 2.1 time: 0.363494 Oct 27 03:31:52.282389 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1434/2736] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:31:51 2022] GET /compute/v2.1/servers/0d06aebf-d50e-4bdf-90ec-d64b1f1de254 => generated 1506 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:31:52.282389 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-a36d2c63-3855-4ba3-a1cd-e4cc5b2f3cd5 req-dc742875-7a90-4d2f-a5ef-3e7026c6659c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c726bb2-8fea-4b2d-9e57-a585032c3155", "name": "network-vif-plugged", "status": "completed", "tag": "89b1e705-64ca-4db0-94f7-a3663d1afe3e"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:31:52.287824 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-a36d2c63-3855-4ba3-a1cd-e4cc5b2f3cd5 req-dc742875-7a90-4d2f-a5ef-3e7026c6659c service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:52.288256 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-a36d2c63-3855-4ba3-a1cd-e4cc5b2f3cd5 req-dc742875-7a90-4d2f-a5ef-3e7026c6659c service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:52.288698 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-a36d2c63-3855-4ba3-a1cd-e4cc5b2f3cd5 req-dc742875-7a90-4d2f-a5ef-3e7026c6659c service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:52.301644 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-a36d2c63-3855-4ba3-a1cd-e4cc5b2f3cd5 req-dc742875-7a90-4d2f-a5ef-3e7026c6659c service nova] Creating event network-vif-plugged:89b1e705-64ca-4db0-94f7-a3663d1afe3e for instance 0c726bb2-8fea-4b2d-9e57-a585032c3155 on n-h1-862769-1 Oct 27 03:31:52.312929 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-a36d2c63-3855-4ba3-a1cd-e4cc5b2f3cd5 req-dc742875-7a90-4d2f-a5ef-3e7026c6659c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040180 Oct 27 03:31:52.316477 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1435/2737] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:31:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:31:52.338978 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2c16af6c-4f8c-4cd9-abd6-f5ff03941923 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:52.339625 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2c16af6c-4f8c-4cd9-abd6-f5ff03941923 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] [instance: 284c90a7-3cda-4d66-a8e1-646f27c28138] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:31:52.379428 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2c16af6c-4f8c-4cd9-abd6-f5ff03941923 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:52.379941 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2c16af6c-4f8c-4cd9-abd6-f5ff03941923 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:52.380390 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2c16af6c-4f8c-4cd9-abd6-f5ff03941923 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:52.381121 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2c16af6c-4f8c-4cd9-abd6-f5ff03941923 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:52.381601 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2c16af6c-4f8c-4cd9-abd6-f5ff03941923 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:52.382068 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2c16af6c-4f8c-4cd9-abd6-f5ff03941923 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:52.465945 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2c16af6c-4f8c-4cd9-abd6-f5ff03941923 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] [instance: 284c90a7-3cda-4d66-a8e1-646f27c28138] Going to try to terminate instance {{(pid=121001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:31:53.338321 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2c16af6c-4f8c-4cd9-abd6-f5ff03941923 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] 10.222.0.20 "DELETE /compute/v2.1/servers/284c90a7-3cda-4d66-a8e1-646f27c28138" status: 204 len: 0 microversion: 2.1 time: 1.015273 Oct 27 03:31:53.338321 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1436/2738] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:31:52 2022] DELETE /compute/v2.1/servers/284c90a7-3cda-4d66-a8e1-646f27c28138 => generated 0 bytes in 1017 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:31:53.339681 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5d315cdc-d1e0-4765-9406-5666e659fa0e tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:53.340410 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5d315cdc-d1e0-4765-9406-5666e659fa0e tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] [instance: 0c726bb2-8fea-4b2d-9e57-a585032c3155] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:31:53.348161 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5d315cdc-d1e0-4765-9406-5666e659fa0e tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:53.348666 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5d315cdc-d1e0-4765-9406-5666e659fa0e tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:53.349123 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5d315cdc-d1e0-4765-9406-5666e659fa0e tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:53.350115 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5d315cdc-d1e0-4765-9406-5666e659fa0e tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:53.350589 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5d315cdc-d1e0-4765-9406-5666e659fa0e tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:53.351025 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5d315cdc-d1e0-4765-9406-5666e659fa0e tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:53.357690 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:31:53.521544 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5d315cdc-d1e0-4765-9406-5666e659fa0e tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533917bc5aa4e23802a43b1eb534bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d87abf835a4104b40056b9eec2d6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:31:53.530717 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5d315cdc-d1e0-4765-9406-5666e659fa0e tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] 10.222.0.20 "GET /compute/v2.1/servers/0c726bb2-8fea-4b2d-9e57-a585032c3155" status: 200 len: 1314 microversion: 2.1 time: 0.195284 Oct 27 03:31:53.531315 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1437/2739] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:31:53 2022] GET /compute/v2.1/servers/0c726bb2-8fea-4b2d-9e57-a585032c3155 => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:31:53.536726 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7dc4017d-c939-4e12-9ef3-2352346213f5 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:53.537327 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7dc4017d-c939-4e12-9ef3-2352346213f5 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] [instance: 0d06aebf-d50e-4bdf-90ec-d64b1f1de254] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:31:53.543272 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7dc4017d-c939-4e12-9ef3-2352346213f5 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:53.543761 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7dc4017d-c939-4e12-9ef3-2352346213f5 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:53.544207 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7dc4017d-c939-4e12-9ef3-2352346213f5 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:53.544908 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7dc4017d-c939-4e12-9ef3-2352346213f5 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:53.545371 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7dc4017d-c939-4e12-9ef3-2352346213f5 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:53.545798 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7dc4017d-c939-4e12-9ef3-2352346213f5 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:53.680728 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7dc4017d-c939-4e12-9ef3-2352346213f5 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba8b60cf1164a388f626b0708556775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe1ca8678d43c38731d15b0bf99cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:31:53.688286 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7dc4017d-c939-4e12-9ef3-2352346213f5 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] 10.222.0.20 "GET /compute/v2.1/servers/0d06aebf-d50e-4bdf-90ec-d64b1f1de254" status: 200 len: 1504 microversion: 2.1 time: 0.156009 Oct 27 03:31:53.688846 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1438/2740] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:31:53 2022] GET /compute/v2.1/servers/0d06aebf-d50e-4bdf-90ec-d64b1f1de254 => generated 1504 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:31:53.693879 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-09b4fcc3-36d5-412e-b109-9997656c32a0 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:53.694537 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-09b4fcc3-36d5-412e-b109-9997656c32a0 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] [instance: 284c90a7-3cda-4d66-a8e1-646f27c28138] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:31:53.700106 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-09b4fcc3-36d5-412e-b109-9997656c32a0 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:53.700635 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-09b4fcc3-36d5-412e-b109-9997656c32a0 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:53.701135 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-09b4fcc3-36d5-412e-b109-9997656c32a0 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:53.702100 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-09b4fcc3-36d5-412e-b109-9997656c32a0 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:53.702420 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-09b4fcc3-36d5-412e-b109-9997656c32a0 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:53.702846 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-09b4fcc3-36d5-412e-b109-9997656c32a0 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:53.843015 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-09b4fcc3-36d5-412e-b109-9997656c32a0 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a1244a7e994427a6ff0625743956e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e1c2fc2755040e4b6fcf82534d67e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:31:53.851616 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-09b4fcc3-36d5-412e-b109-9997656c32a0 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] 10.222.0.20 "GET /compute/v2.1/servers/284c90a7-3cda-4d66-a8e1-646f27c28138" status: 200 len: 1470 microversion: 2.1 time: 0.161812 Oct 27 03:31:53.852531 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1439/2741] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:31:53 2022] GET /compute/v2.1/servers/284c90a7-3cda-4d66-a8e1-646f27c28138 => generated 1470 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:31:53.857580 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3a2defd9-f9c4-4233-93a4-b010415006af tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Calling method '.version_select at 0x7f7dd9eb55e0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:53.858345 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3a2defd9-f9c4-4233-93a4-b010415006af tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] [instance: 0d06aebf-d50e-4bdf-90ec-d64b1f1de254] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:31:53.865250 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3a2defd9-f9c4-4233-93a4-b010415006af tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:53.865775 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3a2defd9-f9c4-4233-93a4-b010415006af tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:53.866261 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3a2defd9-f9c4-4233-93a4-b010415006af tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:53.866972 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3a2defd9-f9c4-4233-93a4-b010415006af tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:53.867433 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3a2defd9-f9c4-4233-93a4-b010415006af tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:53.867901 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3a2defd9-f9c4-4233-93a4-b010415006af tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:53.901005 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3a2defd9-f9c4-4233-93a4-b010415006af tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] 10.222.0.20 "GET /compute/v2.1/servers/0d06aebf-d50e-4bdf-90ec-d64b1f1de254/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.047563 Oct 27 03:31:53.901494 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1440/2742] 10.222.0.20 () {58 vars in 1296 bytes} [Thu Oct 27 03:31:53 2022] GET /compute/v2.1/servers/0d06aebf-d50e-4bdf-90ec-d64b1f1de254/os-instance-actions => generated 611 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:31:53.915333 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c28bfb87-05b0-4755-bf47-21c2947a2abc tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:53.915831 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c28bfb87-05b0-4755-bf47-21c2947a2abc tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] [instance: 0d06aebf-d50e-4bdf-90ec-d64b1f1de254] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:31:53.921779 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c28bfb87-05b0-4755-bf47-21c2947a2abc tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:53.922293 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c28bfb87-05b0-4755-bf47-21c2947a2abc tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:53.922762 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c28bfb87-05b0-4755-bf47-21c2947a2abc tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:53.923443 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c28bfb87-05b0-4755-bf47-21c2947a2abc tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:53.923929 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c28bfb87-05b0-4755-bf47-21c2947a2abc tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:53.924353 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c28bfb87-05b0-4755-bf47-21c2947a2abc tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:53.952567 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c28bfb87-05b0-4755-bf47-21c2947a2abc tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] [instance: 0d06aebf-d50e-4bdf-90ec-d64b1f1de254] Going to try to terminate instance {{(pid=121001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:31:54.655479 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c28bfb87-05b0-4755-bf47-21c2947a2abc tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0d06aebf-d50e-4bdf-90ec-d64b1f1de254" status: 204 len: 0 microversion: 2.1 time: 0.743936 Oct 27 03:31:54.656146 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1441/2743] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:31:53 2022] DELETE /compute/v2.1/servers/0d06aebf-d50e-4bdf-90ec-d64b1f1de254 => generated 0 bytes in 746 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 03:31:54.663868 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-44679471-e9a7-449e-8560-1f73166adee1 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:54.665544 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-44679471-e9a7-449e-8560-1f73166adee1 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] [instance: 0c726bb2-8fea-4b2d-9e57-a585032c3155] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:31:54.681281 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-44679471-e9a7-449e-8560-1f73166adee1 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:54.681814 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-44679471-e9a7-449e-8560-1f73166adee1 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:54.682282 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-44679471-e9a7-449e-8560-1f73166adee1 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:54.689805 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-44679471-e9a7-449e-8560-1f73166adee1 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:54.690447 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-44679471-e9a7-449e-8560-1f73166adee1 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:54.690813 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-44679471-e9a7-449e-8560-1f73166adee1 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:54.989439 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-44679471-e9a7-449e-8560-1f73166adee1 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533917bc5aa4e23802a43b1eb534bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d87abf835a4104b40056b9eec2d6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:31:55.004826 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-44679471-e9a7-449e-8560-1f73166adee1 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] 10.222.0.20 "GET /compute/v2.1/servers/0c726bb2-8fea-4b2d-9e57-a585032c3155" status: 200 len: 1500 microversion: 2.1 time: 0.347047 Oct 27 03:31:55.005620 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1442/2744] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:31:54 2022] GET /compute/v2.1/servers/0c726bb2-8fea-4b2d-9e57-a585032c3155 => generated 1500 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:31:55.032691 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ac1248a4-adec-4dac-a9e1-c78f6cc83c0b tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:55.035073 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ac1248a4-adec-4dac-a9e1-c78f6cc83c0b tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] [instance: 0d06aebf-d50e-4bdf-90ec-d64b1f1de254] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:31:55.044745 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ac1248a4-adec-4dac-a9e1-c78f6cc83c0b tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:55.045442 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ac1248a4-adec-4dac-a9e1-c78f6cc83c0b tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:55.045995 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ac1248a4-adec-4dac-a9e1-c78f6cc83c0b tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:55.046903 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ac1248a4-adec-4dac-a9e1-c78f6cc83c0b tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:55.047458 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ac1248a4-adec-4dac-a9e1-c78f6cc83c0b tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:55.048401 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ac1248a4-adec-4dac-a9e1-c78f6cc83c0b tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:55.224617 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ac1248a4-adec-4dac-a9e1-c78f6cc83c0b tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba8b60cf1164a388f626b0708556775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe1ca8678d43c38731d15b0bf99cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:31:55.233690 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ac1248a4-adec-4dac-a9e1-c78f6cc83c0b tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] 10.222.0.20 "GET /compute/v2.1/servers/0d06aebf-d50e-4bdf-90ec-d64b1f1de254" status: 200 len: 1510 microversion: 2.1 time: 0.212136 Oct 27 03:31:55.234741 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1443/2745] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:31:55 2022] GET /compute/v2.1/servers/0d06aebf-d50e-4bdf-90ec-d64b1f1de254 => generated 1510 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:31:55.245013 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-addf098a-2e25-4d3d-86a6-ca0430672db3 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:55.245651 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-addf098a-2e25-4d3d-86a6-ca0430672db3 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] [instance: 284c90a7-3cda-4d66-a8e1-646f27c28138] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:31:55.256685 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-addf098a-2e25-4d3d-86a6-ca0430672db3 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:55.261328 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-addf098a-2e25-4d3d-86a6-ca0430672db3 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:55.261328 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-addf098a-2e25-4d3d-86a6-ca0430672db3 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:55.261328 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-addf098a-2e25-4d3d-86a6-ca0430672db3 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:55.261328 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-addf098a-2e25-4d3d-86a6-ca0430672db3 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:55.261328 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-addf098a-2e25-4d3d-86a6-ca0430672db3 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:55.459532 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-addf098a-2e25-4d3d-86a6-ca0430672db3 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a1244a7e994427a6ff0625743956e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e1c2fc2755040e4b6fcf82534d67e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:31:55.473396 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-addf098a-2e25-4d3d-86a6-ca0430672db3 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] 10.222.0.20 "GET /compute/v2.1/servers/284c90a7-3cda-4d66-a8e1-646f27c28138" status: 200 len: 1470 microversion: 2.1 time: 0.237505 Oct 27 03:31:55.489275 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1444/2746] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:31:55 2022] GET /compute/v2.1/servers/284c90a7-3cda-4d66-a8e1-646f27c28138 => generated 1470 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:31:55.492242 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c0f40581-9f2f-45f7-8005-51c17915fa2d tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:31:55.499493 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c0f40581-9f2f-45f7-8005-51c17915fa2d tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] [instance: 0c726bb2-8fea-4b2d-9e57-a585032c3155] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:31:55.506083 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c0f40581-9f2f-45f7-8005-51c17915fa2d tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:55.506768 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c0f40581-9f2f-45f7-8005-51c17915fa2d tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:55.507152 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c0f40581-9f2f-45f7-8005-51c17915fa2d tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:55.507970 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c0f40581-9f2f-45f7-8005-51c17915fa2d tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:55.508440 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c0f40581-9f2f-45f7-8005-51c17915fa2d tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:55.508875 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c0f40581-9f2f-45f7-8005-51c17915fa2d tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:55.561353 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-c0f40581-9f2f-45f7-8005-51c17915fa2d tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lazy-loading 'flavor' on Instance uuid 0c726bb2-8fea-4b2d-9e57-a585032c3155 {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:31:55.562272 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c578c11e-fcfc-4819-b038-1b7ff3fdefc9 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] 10.222.0.20 "GET /compute/v2.1/images/d74029bb-b8f5-4730-a824-852c528f0876" status: 200 len: 1428 microversion: 2.1 time: 19.829077 Oct 27 03:31:55.562272 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1303/2747] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:31:35 2022] GET /compute/v2.1/images/d74029bb-b8f5-4730-a824-852c528f0876 => generated 1428 bytes in 19830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:31:55.787769 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-211045f4-acf3-4386-bb96-c743b7f3642b tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Action: 'create', calling method: .version_select at 0x7f7dd9e574c0>, body: {"keypair": {"name": "tempest-keypair-1412192483", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBrZMB0Wyl7y36iqMskn+3Bx7SA71qqqAY1+JQWYad6wC1qWhbn9xNVLgK32SKK9DNCFBtQeDimaE355HHFbRqGB0Q2bkSIxqUgVgGNFh9/kLR9/LmHvXbOeHrfovQYz4Q=="}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:31:55.805139 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-211045f4-acf3-4386-bb96-c743b7f3642b tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Getting quotas for project f5ee48e200624711b629a12b20c7d282. Resources: {'key_pairs'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:31:55.810363 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-211045f4-acf3-4386-bb96-c743b7f3642b tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Getting quotas for user ed44bf20b3464a53a3e3f6c9cd61cde3 and project f5ee48e200624711b629a12b20c7d282. Resources: {'key_pairs'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:31:55.824063 n-d-862769-1 devstack@n-api.service[121000]: ERROR oslo.messaging._drivers.impl_rabbit [None req-211045f4-acf3-4386-bb96-c743b7f3642b tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] [bc5cc820-22d4-4c61-b33e-040cb7304259] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 27 03:31:55.934687 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c0f40581-9f2f-45f7-8005-51c17915fa2d tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] 10.222.0.20 "POST /compute/v2.1/servers/0c726bb2-8fea-4b2d-9e57-a585032c3155/action" status: 200 len: 32 microversion: 2.1 time: 0.458950 Oct 27 03:31:55.935638 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1445/2748] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:31:55 2022] POST /compute/v2.1/servers/0c726bb2-8fea-4b2d-9e57-a585032c3155/action => generated 32 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 03:31:55.947916 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-49dea9f9-9dca-4e2f-96fb-b9d060ae08e8 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:55.949194 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-49dea9f9-9dca-4e2f-96fb-b9d060ae08e8 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] [instance: 0c726bb2-8fea-4b2d-9e57-a585032c3155] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:31:55.956645 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-49dea9f9-9dca-4e2f-96fb-b9d060ae08e8 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:55.957171 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-49dea9f9-9dca-4e2f-96fb-b9d060ae08e8 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:55.957706 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-49dea9f9-9dca-4e2f-96fb-b9d060ae08e8 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:55.958460 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-49dea9f9-9dca-4e2f-96fb-b9d060ae08e8 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:55.958923 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-49dea9f9-9dca-4e2f-96fb-b9d060ae08e8 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:55.959354 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-49dea9f9-9dca-4e2f-96fb-b9d060ae08e8 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:56.124603 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-49dea9f9-9dca-4e2f-96fb-b9d060ae08e8 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533917bc5aa4e23802a43b1eb534bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d87abf835a4104b40056b9eec2d6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:31:56.134559 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-49dea9f9-9dca-4e2f-96fb-b9d060ae08e8 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] 10.222.0.20 "GET /compute/v2.1/servers/0c726bb2-8fea-4b2d-9e57-a585032c3155" status: 200 len: 1506 microversion: 2.1 time: 0.192964 Oct 27 03:31:56.135305 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1446/2749] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:31:55 2022] GET /compute/v2.1/servers/0c726bb2-8fea-4b2d-9e57-a585032c3155 => generated 1506 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:31:56.260061 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3df78bba-5c3c-4255-9361-0570a8826ebc tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:56.260602 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3df78bba-5c3c-4255-9361-0570a8826ebc tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] [instance: 0d06aebf-d50e-4bdf-90ec-d64b1f1de254] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:31:56.266573 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3df78bba-5c3c-4255-9361-0570a8826ebc tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:56.267143 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3df78bba-5c3c-4255-9361-0570a8826ebc tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:56.269692 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3df78bba-5c3c-4255-9361-0570a8826ebc tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:56.269692 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3df78bba-5c3c-4255-9361-0570a8826ebc tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:56.269692 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3df78bba-5c3c-4255-9361-0570a8826ebc tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:56.269692 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3df78bba-5c3c-4255-9361-0570a8826ebc tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:56.419552 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3df78bba-5c3c-4255-9361-0570a8826ebc tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba8b60cf1164a388f626b0708556775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe1ca8678d43c38731d15b0bf99cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:31:56.427739 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3df78bba-5c3c-4255-9361-0570a8826ebc tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] 10.222.0.20 "GET /compute/v2.1/servers/0d06aebf-d50e-4bdf-90ec-d64b1f1de254" status: 200 len: 1510 microversion: 2.1 time: 0.171599 Oct 27 03:31:56.428815 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1447/2750] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:31:56 2022] GET /compute/v2.1/servers/0d06aebf-d50e-4bdf-90ec-d64b1f1de254 => generated 1510 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:31:56.496816 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3efad990-955c-4887-98ac-9ddca0d46fc0 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:56.497436 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3efad990-955c-4887-98ac-9ddca0d46fc0 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] [instance: 284c90a7-3cda-4d66-a8e1-646f27c28138] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:31:56.503983 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3efad990-955c-4887-98ac-9ddca0d46fc0 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:56.504468 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3efad990-955c-4887-98ac-9ddca0d46fc0 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:56.505185 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3efad990-955c-4887-98ac-9ddca0d46fc0 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:56.505672 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3efad990-955c-4887-98ac-9ddca0d46fc0 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:56.506179 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3efad990-955c-4887-98ac-9ddca0d46fc0 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:56.506880 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3efad990-955c-4887-98ac-9ddca0d46fc0 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:56.692437 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3efad990-955c-4887-98ac-9ddca0d46fc0 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a1244a7e994427a6ff0625743956e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e1c2fc2755040e4b6fcf82534d67e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:31:56.707667 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3efad990-955c-4887-98ac-9ddca0d46fc0 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] 10.222.0.20 "GET /compute/v2.1/servers/284c90a7-3cda-4d66-a8e1-646f27c28138" status: 200 len: 1470 microversion: 2.1 time: 0.214671 Oct 27 03:31:56.708923 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1448/2751] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:31:56 2022] GET /compute/v2.1/servers/284c90a7-3cda-4d66-a8e1-646f27c28138 => generated 1470 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:31:56.733431 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b6c6f215-6a0d-4ad6-b25e-0813f934d2dd tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Calling method '.version_select at 0x7f7dd9ee70d0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:56.816721 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b6c6f215-6a0d-4ad6-b25e-0813f934d2dd tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] 10.222.0.20 "GET /compute/v2.1/images/d74029bb-b8f5-4730-a824-852c528f0876" status: 200 len: 1428 microversion: 2.1 time: 0.106477 Oct 27 03:31:56.818592 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1449/2752] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:31:56 2022] GET /compute/v2.1/images/d74029bb-b8f5-4730-a824-852c528f0876 => generated 1428 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:31:56.834839 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-53177c06-e1be-476e-bdca-bbdbcbc330f0 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:56.836115 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-53177c06-e1be-476e-bdca-bbdbcbc330f0 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:31:56.840512 n-d-862769-1 devstack@n-api.service[121000]: INFO oslo.messaging._drivers.impl_rabbit [None req-211045f4-acf3-4386-bb96-c743b7f3642b tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] [bc5cc820-22d4-4c61-b33e-040cb7304259] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 59462. Oct 27 03:31:56.844121 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-53177c06-e1be-476e-bdca-bbdbcbc330f0 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:56.844783 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-53177c06-e1be-476e-bdca-bbdbcbc330f0 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:56.845396 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-53177c06-e1be-476e-bdca-bbdbcbc330f0 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:56.846372 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-53177c06-e1be-476e-bdca-bbdbcbc330f0 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:56.847102 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-53177c06-e1be-476e-bdca-bbdbcbc330f0 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:56.847679 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-53177c06-e1be-476e-bdca-bbdbcbc330f0 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:56.949310 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-211045f4-acf3-4386-bb96-c743b7f3642b tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.351883 Oct 27 03:31:56.950050 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1304/2753] 10.222.0.20 () {60 vars in 1159 bytes} [Thu Oct 27 03:31:55 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:31:57.157668 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-cb616b32-dd92-4d22-8744-333672e19e82 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:57.159193 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-cb616b32-dd92-4d22-8744-333672e19e82 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] [instance: 0c726bb2-8fea-4b2d-9e57-a585032c3155] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:31:57.176636 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cb616b32-dd92-4d22-8744-333672e19e82 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:57.189100 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cb616b32-dd92-4d22-8744-333672e19e82 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:57.192013 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cb616b32-dd92-4d22-8744-333672e19e82 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:57.195327 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cb616b32-dd92-4d22-8744-333672e19e82 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:57.199596 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cb616b32-dd92-4d22-8744-333672e19e82 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:57.200970 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cb616b32-dd92-4d22-8744-333672e19e82 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:57.304917 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-53177c06-e1be-476e-bdca-bbdbcbc330f0 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:31:57.338830 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-53177c06-e1be-476e-bdca-bbdbcbc330f0 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1682 microversion: 2.1 time: 0.517841 Oct 27 03:31:57.346333 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1450/2754] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:31:56 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1682 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:31:57.463296 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0f531db5-a378-4754-a743-4f42e4839895 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:57.465359 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0f531db5-a378-4754-a743-4f42e4839895 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] [instance: 0d06aebf-d50e-4bdf-90ec-d64b1f1de254] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:31:57.482319 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0f531db5-a378-4754-a743-4f42e4839895 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:57.483845 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0f531db5-a378-4754-a743-4f42e4839895 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:57.484447 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0f531db5-a378-4754-a743-4f42e4839895 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:57.489126 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0f531db5-a378-4754-a743-4f42e4839895 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:57.490710 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0f531db5-a378-4754-a743-4f42e4839895 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:57.498626 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0f531db5-a378-4754-a743-4f42e4839895 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:57.498626 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:31:57.831600 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0f531db5-a378-4754-a743-4f42e4839895 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba8b60cf1164a388f626b0708556775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe1ca8678d43c38731d15b0bf99cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:31:57.839949 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0f531db5-a378-4754-a743-4f42e4839895 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] 10.222.0.20 "GET /compute/v2.1/servers/0d06aebf-d50e-4bdf-90ec-d64b1f1de254" status: 200 len: 1510 microversion: 2.1 time: 0.391951 Oct 27 03:31:57.843588 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1451/2755] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:31:57 2022] GET /compute/v2.1/servers/0d06aebf-d50e-4bdf-90ec-d64b1f1de254 => generated 1510 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:31:57.848443 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-47144356-2f16-4381-ab18-8ab916078788 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:57.856240 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-47144356-2f16-4381-ab18-8ab916078788 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] [instance: 284c90a7-3cda-4d66-a8e1-646f27c28138] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:31:57.869122 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-47144356-2f16-4381-ab18-8ab916078788 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:57.869950 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-47144356-2f16-4381-ab18-8ab916078788 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:57.875761 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-47144356-2f16-4381-ab18-8ab916078788 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:57.875761 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-47144356-2f16-4381-ab18-8ab916078788 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:57.875761 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-47144356-2f16-4381-ab18-8ab916078788 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:57.875761 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-47144356-2f16-4381-ab18-8ab916078788 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:58.031409 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-47144356-2f16-4381-ab18-8ab916078788 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a1244a7e994427a6ff0625743956e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e1c2fc2755040e4b6fcf82534d67e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:31:58.040950 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-47144356-2f16-4381-ab18-8ab916078788 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] 10.222.0.20 "GET /compute/v2.1/servers/284c90a7-3cda-4d66-a8e1-646f27c28138" status: 200 len: 1428 microversion: 2.1 time: 0.196175 Oct 27 03:31:58.046946 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1452/2756] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:31:57 2022] GET /compute/v2.1/servers/284c90a7-3cda-4d66-a8e1-646f27c28138 => generated 1428 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:31:58.059300 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-aeae906b-e8f3-49c0-8932-f9bdc561cdcf tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Calling method '.version_select at 0x7f7dd9ee79d0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:58.143649 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-aeae906b-e8f3-49c0-8932-f9bdc561cdcf tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] 10.222.0.20 "GET /compute/v2.1/images/d74029bb-b8f5-4730-a824-852c528f0876" status: 200 len: 1428 microversion: 2.1 time: 0.095394 Oct 27 03:31:58.144335 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1453/2757] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:31:58 2022] GET /compute/v2.1/images/d74029bb-b8f5-4730-a824-852c528f0876 => generated 1428 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:31:58.175500 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-cb616b32-dd92-4d22-8744-333672e19e82 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533917bc5aa4e23802a43b1eb534bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d87abf835a4104b40056b9eec2d6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:31:58.196627 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-318ea661-3a21-4871-9c79-f51bd893dcfb req-a5caca4b-683d-4236-bf0a-ffa4a14625cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "284c90a7-3cda-4d66-a8e1-646f27c28138", "name": "network-vif-deleted", "tag": "3b2156fe-5b18-411d-a0ba-841df8590a4e"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:31:58.202278 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-cb616b32-dd92-4d22-8744-333672e19e82 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] 10.222.0.20 "GET /compute/v2.1/servers/0c726bb2-8fea-4b2d-9e57-a585032c3155" status: 200 len: 1506 microversion: 2.1 time: 1.049111 Oct 27 03:31:58.213415 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1305/2758] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:31:57 2022] GET /compute/v2.1/servers/0c726bb2-8fea-4b2d-9e57-a585032c3155 => generated 1506 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:31:58.215246 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-318ea661-3a21-4871-9c79-f51bd893dcfb req-a5caca4b-683d-4236-bf0a-ffa4a14625cd service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:58.216062 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-318ea661-3a21-4871-9c79-f51bd893dcfb req-a5caca4b-683d-4236-bf0a-ffa4a14625cd service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:58.219050 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-318ea661-3a21-4871-9c79-f51bd893dcfb req-a5caca4b-683d-4236-bf0a-ffa4a14625cd service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:58.244713 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-318ea661-3a21-4871-9c79-f51bd893dcfb req-a5caca4b-683d-4236-bf0a-ffa4a14625cd service nova] Creating event network-vif-deleted:3b2156fe-5b18-411d-a0ba-841df8590a4e for instance 284c90a7-3cda-4d66-a8e1-646f27c28138 on n-h1-862769-1 Oct 27 03:31:58.245070 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-318ea661-3a21-4871-9c79-f51bd893dcfb req-a5caca4b-683d-4236-bf0a-ffa4a14625cd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051825 Oct 27 03:31:58.246103 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1454/2759] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:31:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:31:58.369788 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-786016e0-fce6-4999-b426-dfd46ee89d82 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:58.371564 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-786016e0-fce6-4999-b426-dfd46ee89d82 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:31:58.378791 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-786016e0-fce6-4999-b426-dfd46ee89d82 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:58.379526 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-786016e0-fce6-4999-b426-dfd46ee89d82 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:58.380555 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-786016e0-fce6-4999-b426-dfd46ee89d82 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:58.381477 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-786016e0-fce6-4999-b426-dfd46ee89d82 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:58.382255 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-786016e0-fce6-4999-b426-dfd46ee89d82 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:58.382846 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-786016e0-fce6-4999-b426-dfd46ee89d82 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:58.810804 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-786016e0-fce6-4999-b426-dfd46ee89d82 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:31:58.824908 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-786016e0-fce6-4999-b426-dfd46ee89d82 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1669 microversion: 2.1 time: 0.459905 Oct 27 03:31:58.831067 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1306/2760] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:31:58 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1669 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:31:58.859627 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7c522205-1887-4c7c-81aa-2a29a6d2aecb tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-1797158225"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:31:58.863165 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7c522205-1887-4c7c-81aa-2a29a6d2aecb tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:31:58.875110 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1171b9ec-d8dd-45ca-b985-a98f2c014ac0 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:58.875747 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1171b9ec-d8dd-45ca-b985-a98f2c014ac0 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] [instance: 0d06aebf-d50e-4bdf-90ec-d64b1f1de254] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:31:58.881447 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7c522205-1887-4c7c-81aa-2a29a6d2aecb tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:58.884224 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7c522205-1887-4c7c-81aa-2a29a6d2aecb tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:58.886340 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7c522205-1887-4c7c-81aa-2a29a6d2aecb tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:58.887346 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7c522205-1887-4c7c-81aa-2a29a6d2aecb tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:58.889490 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7c522205-1887-4c7c-81aa-2a29a6d2aecb tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:58.890165 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7c522205-1887-4c7c-81aa-2a29a6d2aecb tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:58.893371 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1171b9ec-d8dd-45ca-b985-a98f2c014ac0 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:58.893891 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1171b9ec-d8dd-45ca-b985-a98f2c014ac0 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:58.902561 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1171b9ec-d8dd-45ca-b985-a98f2c014ac0 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:58.903585 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1171b9ec-d8dd-45ca-b985-a98f2c014ac0 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:58.904084 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1171b9ec-d8dd-45ca-b985-a98f2c014ac0 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:58.904533 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1171b9ec-d8dd-45ca-b985-a98f2c014ac0 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:59.364907 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1171b9ec-d8dd-45ca-b985-a98f2c014ac0 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba8b60cf1164a388f626b0708556775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe1ca8678d43c38731d15b0bf99cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:31:59.380195 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1171b9ec-d8dd-45ca-b985-a98f2c014ac0 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] 10.222.0.20 "GET /compute/v2.1/servers/0d06aebf-d50e-4bdf-90ec-d64b1f1de254" status: 200 len: 1510 microversion: 2.1 time: 0.515210 Oct 27 03:31:59.381379 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1307/2761] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:31:58 2022] GET /compute/v2.1/servers/0d06aebf-d50e-4bdf-90ec-d64b1f1de254 => generated 1510 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:31:59.564985 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7c522205-1887-4c7c-81aa-2a29a6d2aecb tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "POST /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86/action" status: 202 len: 0 microversion: 2.1 time: 0.708393 Oct 27 03:31:59.579790 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1455/2762] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:31:58 2022] POST /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86/action => generated 0 bytes in 725 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 27 03:31:59.591228 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9d713544-1077-4f23-a928-a5dec1a15440 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:59.594219 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-9d713544-1077-4f23-a928-a5dec1a15440 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] [instance: 284c90a7-3cda-4d66-a8e1-646f27c28138] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:31:59.603859 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:31:59.606567 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9d713544-1077-4f23-a928-a5dec1a15440 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:59.607241 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9d713544-1077-4f23-a928-a5dec1a15440 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:59.607841 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9d713544-1077-4f23-a928-a5dec1a15440 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:59.608721 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9d713544-1077-4f23-a928-a5dec1a15440 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:59.609390 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9d713544-1077-4f23-a928-a5dec1a15440 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:59.610245 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9d713544-1077-4f23-a928-a5dec1a15440 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:59.656634 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9fde4ea7-ea28-44f5-aaec-f81a2898120e tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] Action: 'update', calling method: .version_select at 0x7f7dda27f700>, body: {"quota_set": {"ram": "5120"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:31:59.676972 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9d713544-1077-4f23-a928-a5dec1a15440 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:59.682677 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9d713544-1077-4f23-a928-a5dec1a15440 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:59.683506 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9d713544-1077-4f23-a928-a5dec1a15440 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:59.683995 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-9d713544-1077-4f23-a928-a5dec1a15440 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Lazy-loading 'fault' on Instance uuid 284c90a7-3cda-4d66-a8e1-646f27c28138 {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:31:59.756153 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9fde4ea7-ea28-44f5-aaec-f81a2898120e tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:59.766808 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9fde4ea7-ea28-44f5-aaec-f81a2898120e tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:59.767330 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9fde4ea7-ea28-44f5-aaec-f81a2898120e tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:59.768174 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9fde4ea7-ea28-44f5-aaec-f81a2898120e tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:59.768663 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9fde4ea7-ea28-44f5-aaec-f81a2898120e tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:59.769102 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9fde4ea7-ea28-44f5-aaec-f81a2898120e tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:59.787281 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9d713544-1077-4f23-a928-a5dec1a15440 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a1244a7e994427a6ff0625743956e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e1c2fc2755040e4b6fcf82534d67e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:31:59.800063 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9d713544-1077-4f23-a928-a5dec1a15440 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] 10.222.0.20 "GET /compute/v2.1/servers/284c90a7-3cda-4d66-a8e1-646f27c28138" status: 200 len: 1304 microversion: 2.1 time: 0.215149 Oct 27 03:31:59.800669 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1456/2763] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:31:59 2022] GET /compute/v2.1/servers/284c90a7-3cda-4d66-a8e1-646f27c28138 => generated 1304 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:31:59.815685 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-495138fb-db76-43d0-b58f-f0b5a887a87a tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Calling method '.version_select at 0x7f7dda0d83a0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:59.882882 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-495138fb-db76-43d0-b58f-f0b5a887a87a tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] 10.222.0.20 "GET /compute/v2.1/images/d74029bb-b8f5-4730-a824-852c528f0876" status: 200 len: 1428 microversion: 2.1 time: 0.081134 Oct 27 03:31:59.891438 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1457/2764] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:31:59 2022] GET /compute/v2.1/images/d74029bb-b8f5-4730-a824-852c528f0876 => generated 1428 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:31:59.897834 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f6d504ce-d9c2-4dd5-b3a6-073195058f15 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:31:59.898422 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f6d504ce-d9c2-4dd5-b3a6-073195058f15 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] [instance: 0c726bb2-8fea-4b2d-9e57-a585032c3155] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:31:59.905218 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f6d504ce-d9c2-4dd5-b3a6-073195058f15 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:59.905714 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f6d504ce-d9c2-4dd5-b3a6-073195058f15 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:59.906201 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f6d504ce-d9c2-4dd5-b3a6-073195058f15 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:31:59.906912 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f6d504ce-d9c2-4dd5-b3a6-073195058f15 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:31:59.907378 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f6d504ce-d9c2-4dd5-b3a6-073195058f15 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:31:59.907806 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f6d504ce-d9c2-4dd5-b3a6-073195058f15 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:00.005128 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9fde4ea7-ea28-44f5-aaec-f81a2898120e tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/2fb7e30be426453ea5ed12eea8228a1e" status: 200 len: 240 microversion: 2.36 time: 0.622286 Oct 27 03:32:00.006410 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1308/2765] 10.222.0.20 () {62 vars in 1303 bytes} [Thu Oct 27 03:31:59 2022] PUT /compute/v2.1/os-quota-sets/2fb7e30be426453ea5ed12eea8228a1e => generated 240 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 03:32:00.016401 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a28cec53-1a8b-4ac9-a91c-c0329768c68f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:00.017029 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a28cec53-1a8b-4ac9-a91c-c0329768c68f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:00.036225 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a28cec53-1a8b-4ac9-a91c-c0329768c68f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:00.036758 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a28cec53-1a8b-4ac9-a91c-c0329768c68f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:00.037220 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a28cec53-1a8b-4ac9-a91c-c0329768c68f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:00.038290 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a28cec53-1a8b-4ac9-a91c-c0329768c68f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:00.038709 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a28cec53-1a8b-4ac9-a91c-c0329768c68f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:00.046063 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a28cec53-1a8b-4ac9-a91c-c0329768c68f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:00.132975 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f6d504ce-d9c2-4dd5-b3a6-073195058f15 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533917bc5aa4e23802a43b1eb534bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d87abf835a4104b40056b9eec2d6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:00.149624 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f6d504ce-d9c2-4dd5-b3a6-073195058f15 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] 10.222.0.20 "GET /compute/v2.1/servers/0c726bb2-8fea-4b2d-9e57-a585032c3155" status: 200 len: 1506 microversion: 2.1 time: 0.255640 Oct 27 03:32:00.169091 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1458/2766] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:31:59 2022] GET /compute/v2.1/servers/0c726bb2-8fea-4b2d-9e57-a585032c3155 => generated 1506 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:00.181555 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d655bfde-7668-417c-8613-f13cc2400dfd tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] Calling method '.version_select at 0x7f7dda0d8820>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:00.272052 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a28cec53-1a8b-4ac9-a91c-c0329768c68f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:00.281902 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a28cec53-1a8b-4ac9-a91c-c0329768c68f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1679 microversion: 2.1 time: 0.272646 Oct 27 03:32:00.284469 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1309/2767] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:00 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1679 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:00.293273 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-e09a18db-bbe6-4e86-8ab8-a064cf7b23b5 req-f686f518-b623-4d7a-a9d7-2e872d885b3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d06aebf-d50e-4bdf-90ec-d64b1f1de254", "name": "network-vif-deleted", "tag": "de9653b5-3102-4eac-b7bf-d89662d9f8a8"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:32:00.304835 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-e09a18db-bbe6-4e86-8ab8-a064cf7b23b5 req-f686f518-b623-4d7a-a9d7-2e872d885b3b service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:00.305708 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-e09a18db-bbe6-4e86-8ab8-a064cf7b23b5 req-f686f518-b623-4d7a-a9d7-2e872d885b3b service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:00.306367 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-e09a18db-bbe6-4e86-8ab8-a064cf7b23b5 req-f686f518-b623-4d7a-a9d7-2e872d885b3b service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:00.312552 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d655bfde-7668-417c-8613-f13cc2400dfd tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:00.314062 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d655bfde-7668-417c-8613-f13cc2400dfd tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:00.315387 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d655bfde-7668-417c-8613-f13cc2400dfd tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:00.316415 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d655bfde-7668-417c-8613-f13cc2400dfd tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:00.317090 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d655bfde-7668-417c-8613-f13cc2400dfd tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:00.318249 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d655bfde-7668-417c-8613-f13cc2400dfd tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:00.319976 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-e09a18db-bbe6-4e86-8ab8-a064cf7b23b5 req-f686f518-b623-4d7a-a9d7-2e872d885b3b service nova] Creating event network-vif-deleted:de9653b5-3102-4eac-b7bf-d89662d9f8a8 for instance 0d06aebf-d50e-4bdf-90ec-d64b1f1de254 on n-h1-862769-1 Oct 27 03:32:00.325245 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-e09a18db-bbe6-4e86-8ab8-a064cf7b23b5 req-f686f518-b623-4d7a-a9d7-2e872d885b3b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035615 Oct 27 03:32:00.333914 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1310/2768] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:32:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:32:00.350151 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d655bfde-7668-417c-8613-f13cc2400dfd tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/2fb7e30be426453ea5ed12eea8228a1e/detail" status: 200 len: 672 microversion: 2.36 time: 0.179623 Oct 27 03:32:00.351449 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1459/2769] 10.222.0.20 () {60 vars in 1304 bytes} [Thu Oct 27 03:32:00 2022] GET /compute/v2.1/os-quota-sets/2fb7e30be426453ea5ed12eea8228a1e/detail => generated 672 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 03:32:00.408857 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7ce8aa7d-dba1-43ad-a9a5-742d775e92d6 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:00.413578 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7ce8aa7d-dba1-43ad-a9a5-742d775e92d6 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] [instance: 0d06aebf-d50e-4bdf-90ec-d64b1f1de254] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:00.424310 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7ce8aa7d-dba1-43ad-a9a5-742d775e92d6 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:00.427275 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7ce8aa7d-dba1-43ad-a9a5-742d775e92d6 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:00.434196 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7ce8aa7d-dba1-43ad-a9a5-742d775e92d6 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:00.436544 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7ce8aa7d-dba1-43ad-a9a5-742d775e92d6 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:00.436544 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7ce8aa7d-dba1-43ad-a9a5-742d775e92d6 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:00.437119 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7ce8aa7d-dba1-43ad-a9a5-742d775e92d6 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:00.479278 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7ce8aa7d-dba1-43ad-a9a5-742d775e92d6 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:00.480468 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7ce8aa7d-dba1-43ad-a9a5-742d775e92d6 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:00.481422 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7ce8aa7d-dba1-43ad-a9a5-742d775e92d6 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:00.482085 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-7ce8aa7d-dba1-43ad-a9a5-742d775e92d6 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lazy-loading 'fault' on Instance uuid 0d06aebf-d50e-4bdf-90ec-d64b1f1de254 {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:32:00.537835 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7ce8aa7d-dba1-43ad-a9a5-742d775e92d6 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba8b60cf1164a388f626b0708556775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe1ca8678d43c38731d15b0bf99cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:00.546605 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7ce8aa7d-dba1-43ad-a9a5-742d775e92d6 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] 10.222.0.20 "GET /compute/v2.1/servers/0d06aebf-d50e-4bdf-90ec-d64b1f1de254" status: 200 len: 1307 microversion: 2.1 time: 0.143038 Oct 27 03:32:00.547351 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1311/2770] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:00 2022] GET /compute/v2.1/servers/0d06aebf-d50e-4bdf-90ec-d64b1f1de254 => generated 1307 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:00.650629 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7c680b39-b184-407d-8fea-e3db0f132957 tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] Action: 'update', calling method: .version_select at 0x7f7dda586af0>, body: {"quota_set": {"ram": "2048"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:32:00.748379 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7c680b39-b184-407d-8fea-e3db0f132957 tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:00.749154 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7c680b39-b184-407d-8fea-e3db0f132957 tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:00.749599 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7c680b39-b184-407d-8fea-e3db0f132957 tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:00.750974 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7c680b39-b184-407d-8fea-e3db0f132957 tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:00.758187 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7c680b39-b184-407d-8fea-e3db0f132957 tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:00.758187 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7c680b39-b184-407d-8fea-e3db0f132957 tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:00.792733 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7c680b39-b184-407d-8fea-e3db0f132957 tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:00.793242 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7c680b39-b184-407d-8fea-e3db0f132957 tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:00.793673 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7c680b39-b184-407d-8fea-e3db0f132957 tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:00.794447 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7c680b39-b184-407d-8fea-e3db0f132957 tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:00.794900 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7c680b39-b184-407d-8fea-e3db0f132957 tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:00.795322 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7c680b39-b184-407d-8fea-e3db0f132957 tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:00.825868 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-330a5390-7ba1-469e-83bb-cb89871b3844 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:00.826671 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-330a5390-7ba1-469e-83bb-cb89871b3844 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] [instance: 284c90a7-3cda-4d66-a8e1-646f27c28138] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:00.834209 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-330a5390-7ba1-469e-83bb-cb89871b3844 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:00.834898 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-330a5390-7ba1-469e-83bb-cb89871b3844 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:00.835476 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-330a5390-7ba1-469e-83bb-cb89871b3844 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:00.836344 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-330a5390-7ba1-469e-83bb-cb89871b3844 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:00.837574 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-330a5390-7ba1-469e-83bb-cb89871b3844 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:00.838303 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-330a5390-7ba1-469e-83bb-cb89871b3844 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:00.853311 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-330a5390-7ba1-469e-83bb-cb89871b3844 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] HTTP exception thrown: Instance 284c90a7-3cda-4d66-a8e1-646f27c28138 could not be found. Oct 27 03:32:00.855006 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-330a5390-7ba1-469e-83bb-cb89871b3844 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Request method failure captured: Oct 27 03:32:00.855006 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/284c90a7-3cda-4d66-a8e1-646f27c28138 HTTP/1.1 Oct 27 03:32:00.855006 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:32:00.855006 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:32:00.855006 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:32:00.855006 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:32:00.855006 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:32:00.855006 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:32:00.855006 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:32:00.855006 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:32:00.855006 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfuHgXs-pzsT0IHaaaHX5ASgk8-bIDhfCbeZBHtv_FNS70_VrStVmAbrvN9LIMutvKCzakp6IHl4PCCLH4fa4kw0DSa49AZHFA6cY_ZdgWt49lBxfLjstVtD6PyIIXg5B3USlEO2iAVkU6qbEWuiy-TAK7B56g5ogW0yctpycnWhRfU Oct 27 03:32:00.855006 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:32:00.855006 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:32:00.855006 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:32:00.855006 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:32:00.855006 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:32:00.855006 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:32:00.855006 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 7e1c2fc2755040e4b6fcf82534d67e1c Oct 27 03:32:00.855006 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-TenantUsagesTestJSON-596653146 Oct 27 03:32:00.855006 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:32:00.855006 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:32:00.855006 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e1c2fc2755040e4b6fcf82534d67e1c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7e1c2fc2755040e4b6fcf82534d67e1c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e1c2fc2755040e4b6fcf82534d67e1c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7e1c2fc2755040e4b6fcf82534d67e1c"}]}] Oct 27 03:32:00.855006 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-TenantUsagesTestJSON-596653146 Oct 27 03:32:00.855006 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 7e1c2fc2755040e4b6fcf82534d67e1c Oct 27 03:32:00.855006 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-TenantUsagesTestJSON-596653146 Oct 27 03:32:00.855006 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-TenantUsagesTestJSON-596653146-project Oct 27 03:32:00.855006 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:32:00.855006 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:32:00.855006 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 46a1244a7e994427a6ff0625743956e3 Oct 27 03:32:00.855006 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-TenantUsagesTestJSON-596653146-project Oct 27 03:32:00.855006 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:32:00.855006 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 284c90a7-3cda-4d66-a8e1-646f27c28138 could not be found. Oct 27 03:32:00.855006 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '284c90a7-3cda-4d66-a8e1-646f27c28138'} Oct 27 03:32:00.855006 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:32:00.855006 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:32:00.855006 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:32:00.855006 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:32:00.855006 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:32:00.855006 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:32:00.855006 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:32:00.855006 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:32:00.855006 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:32:00.855006 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:32:00.855006 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 284c90a7-3cda-4d66-a8e1-646f27c28138 could not be found. Oct 27 03:32:00.855006 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:32:00.855006 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:32:00.855006 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:32:00.855006 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:32:00.855006 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:32:00.855006 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:32:00.855006 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:32:00.855006 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:32:00.855006 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:32:00.855006 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:32:00.855006 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:32:00.855006 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:32:00.855006 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:32:00.855006 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:32:00.855006 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:32:00.855006 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:32:00.855006 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 284c90a7-3cda-4d66-a8e1-646f27c28138 could not be found. Oct 27 03:32:00.855006 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:32:00.855006 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:32:00.855006 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:32:00.860620 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:32:00.860620 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:32:00.860620 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:32:00.860620 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:32:00.860620 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:32:00.860620 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 284c90a7-3cda-4d66-a8e1-646f27c28138 could not be found. Oct 27 03:32:00.860620 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:32:00.860620 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-330a5390-7ba1-469e-83bb-cb89871b3844 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] Returning 404 to user: Instance 284c90a7-3cda-4d66-a8e1-646f27c28138 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:32:00.860620 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-330a5390-7ba1-469e-83bb-cb89871b3844 tempest-TenantUsagesTestJSON-596653146 tempest-TenantUsagesTestJSON-596653146-project] 10.222.0.20 "GET /compute/v2.1/servers/284c90a7-3cda-4d66-a8e1-646f27c28138" status: 404 len: 111 microversion: 2.1 time: 0.034661 Oct 27 03:32:00.860620 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1312/2771] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:00 2022] GET /compute/v2.1/servers/284c90a7-3cda-4d66-a8e1-646f27c28138 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 03:32:00.899368 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5916f22e-eb65-4f08-a569-4f1ad4dcbb04 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Calling method '.version_select at 0x7f7dda180ee0>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:00.952418 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5916f22e-eb65-4f08-a569-4f1ad4dcbb04 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] 10.222.0.20 "GET /compute/v2.1/images/d74029bb-b8f5-4730-a824-852c528f0876" status: 200 len: 1428 microversion: 2.1 time: 0.056882 Oct 27 03:32:00.961956 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1313/2772] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:32:00 2022] GET /compute/v2.1/images/d74029bb-b8f5-4730-a824-852c528f0876 => generated 1428 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:01.176334 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f5258c0d-1aa3-4762-9375-bacdc26fdabb tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:01.177445 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f5258c0d-1aa3-4762-9375-bacdc26fdabb tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] [instance: 0c726bb2-8fea-4b2d-9e57-a585032c3155] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:01.205928 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f5258c0d-1aa3-4762-9375-bacdc26fdabb tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:01.207193 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f5258c0d-1aa3-4762-9375-bacdc26fdabb tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:01.207980 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f5258c0d-1aa3-4762-9375-bacdc26fdabb tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:01.209077 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f5258c0d-1aa3-4762-9375-bacdc26fdabb tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:01.209755 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f5258c0d-1aa3-4762-9375-bacdc26fdabb tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:01.210498 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f5258c0d-1aa3-4762-9375-bacdc26fdabb tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:01.220473 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7c680b39-b184-407d-8fea-e3db0f132957 tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/2fb7e30be426453ea5ed12eea8228a1e?user_id=027f4bd05226471ebe0fc946da3b5d78" status: 200 len: 240 microversion: 2.36 time: 0.573870 Oct 27 03:32:01.223418 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1460/2773] 10.222.0.20 () {62 vars in 1384 bytes} [Thu Oct 27 03:32:00 2022] PUT /compute/v2.1/os-quota-sets/2fb7e30be426453ea5ed12eea8228a1e?user_id=027f4bd05226471ebe0fc946da3b5d78 => generated 240 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 03:32:01.235267 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f130243f-df42-437a-9355-70541fc7f23b tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] Calling method '.version_select at 0x7f7dda070dc0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:01.373616 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f130243f-df42-437a-9355-70541fc7f23b tempest-QuotasAdminTestV236-1554281465 tempest-QuotasAdminTestV236-1554281465-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/2fb7e30be426453ea5ed12eea8228a1e?user_id=027f4bd05226471ebe0fc946da3b5d78" status: 200 len: 282 microversion: 2.36 time: 0.143043 Oct 27 03:32:01.374548 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1461/2774] 10.222.0.20 () {60 vars in 1364 bytes} [Thu Oct 27 03:32:01 2022] GET /compute/v2.1/os-quota-sets/2fb7e30be426453ea5ed12eea8228a1e?user_id=027f4bd05226471ebe0fc946da3b5d78 => generated 282 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 03:32:01.396025 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-73329c30-840a-4738-a1c1-17bfcd62f848 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:01.397796 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-73329c30-840a-4738-a1c1-17bfcd62f848 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:01.416347 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-73329c30-840a-4738-a1c1-17bfcd62f848 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:01.416347 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-73329c30-840a-4738-a1c1-17bfcd62f848 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:01.418962 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-73329c30-840a-4738-a1c1-17bfcd62f848 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:01.421684 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-73329c30-840a-4738-a1c1-17bfcd62f848 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:01.424882 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-73329c30-840a-4738-a1c1-17bfcd62f848 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:01.425464 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-73329c30-840a-4738-a1c1-17bfcd62f848 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:01.525655 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f5258c0d-1aa3-4762-9375-bacdc26fdabb tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533917bc5aa4e23802a43b1eb534bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d87abf835a4104b40056b9eec2d6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:01.536903 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f5258c0d-1aa3-4762-9375-bacdc26fdabb tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] 10.222.0.20 "GET /compute/v2.1/servers/0c726bb2-8fea-4b2d-9e57-a585032c3155" status: 200 len: 1506 microversion: 2.1 time: 0.367327 Oct 27 03:32:01.554823 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1314/2775] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:01 2022] GET /compute/v2.1/servers/0c726bb2-8fea-4b2d-9e57-a585032c3155 => generated 1506 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:32:01.560009 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-7188f63d-ca94-4177-9baa-ae20f983ae67 req-cb3641f4-e1ee-420f-9fd3-b0fb9d7ad3b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed74f42b-af82-4808-bfc2-86110840fe86", "name": "network-vif-unplugged", "status": "completed", "tag": "05464839-777e-4176-af2d-6086d6f9acaa"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:32:01.575092 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-7188f63d-ca94-4177-9baa-ae20f983ae67 req-cb3641f4-e1ee-420f-9fd3-b0fb9d7ad3b1 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:01.575861 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-7188f63d-ca94-4177-9baa-ae20f983ae67 req-cb3641f4-e1ee-420f-9fd3-b0fb9d7ad3b1 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:01.576466 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-7188f63d-ca94-4177-9baa-ae20f983ae67 req-cb3641f4-e1ee-420f-9fd3-b0fb9d7ad3b1 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:01.589077 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-7188f63d-ca94-4177-9baa-ae20f983ae67 req-cb3641f4-e1ee-420f-9fd3-b0fb9d7ad3b1 service nova] Creating event network-vif-unplugged:05464839-777e-4176-af2d-6086d6f9acaa for instance ed74f42b-af82-4808-bfc2-86110840fe86 on n-h1-862769-1 Oct 27 03:32:01.595268 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-7188f63d-ca94-4177-9baa-ae20f983ae67 req-cb3641f4-e1ee-420f-9fd3-b0fb9d7ad3b1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038814 Oct 27 03:32:01.597016 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1315/2776] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:32:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:32:01.603745 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-bc4ac413-7073-4b21-8d62-0d5d1f49a9a3 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:01.604635 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-bc4ac413-7073-4b21-8d62-0d5d1f49a9a3 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] [instance: 0d06aebf-d50e-4bdf-90ec-d64b1f1de254] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:01.611295 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bc4ac413-7073-4b21-8d62-0d5d1f49a9a3 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:01.612662 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bc4ac413-7073-4b21-8d62-0d5d1f49a9a3 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:01.613490 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bc4ac413-7073-4b21-8d62-0d5d1f49a9a3 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:01.614256 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bc4ac413-7073-4b21-8d62-0d5d1f49a9a3 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:01.614891 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bc4ac413-7073-4b21-8d62-0d5d1f49a9a3 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:01.615576 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bc4ac413-7073-4b21-8d62-0d5d1f49a9a3 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:01.633510 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-bc4ac413-7073-4b21-8d62-0d5d1f49a9a3 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] HTTP exception thrown: Instance 0d06aebf-d50e-4bdf-90ec-d64b1f1de254 could not be found. Oct 27 03:32:01.635317 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-bc4ac413-7073-4b21-8d62-0d5d1f49a9a3 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Request method failure captured: Oct 27 03:32:01.635317 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/0d06aebf-d50e-4bdf-90ec-d64b1f1de254 HTTP/1.1 Oct 27 03:32:01.635317 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:32:01.635317 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:32:01.635317 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:32:01.635317 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:32:01.635317 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:32:01.635317 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:32:01.635317 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:32:01.635317 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:32:01.635317 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfuMRPORDeiseDs_iVzLtPTiPmF1CkTvWeA65qMIHQi1sFi2FXxlFUR2qv6pTwAavKHf7P1fVPb0hnqJ24pJAb9ETB2iN2LoAQ6BFSRqHHY1yc7SbWr-OinyGtNlZG_JTIxOH87ggny9GGnlaW0iGEWvXGqAL6irdaw-bObw66G0K_0 Oct 27 03:32:01.635317 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:32:01.635317 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:32:01.635317 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:32:01.635317 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:32:01.635317 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:32:01.635317 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:32:01.635317 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 9ebe1ca8678d43c38731d15b0bf99cfa Oct 27 03:32:01.635317 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-InstanceActionsTestJSON-1033488451 Oct 27 03:32:01.635317 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:32:01.635317 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:32:01.635317 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9ebe1ca8678d43c38731d15b0bf99cfa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9ebe1ca8678d43c38731d15b0bf99cfa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9ebe1ca8678d43c38731d15b0bf99cfa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9ebe1ca8678d43c38731d15b0bf99cfa"}]}] Oct 27 03:32:01.635317 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-InstanceActionsTestJSON-1033488451 Oct 27 03:32:01.635317 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 9ebe1ca8678d43c38731d15b0bf99cfa Oct 27 03:32:01.635317 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-InstanceActionsTestJSON-1033488451 Oct 27 03:32:01.635317 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-InstanceActionsTestJSON-1033488451-project Oct 27 03:32:01.635317 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:32:01.635317 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:32:01.635317 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 4ba8b60cf1164a388f626b0708556775 Oct 27 03:32:01.635317 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-InstanceActionsTestJSON-1033488451-project Oct 27 03:32:01.635317 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:32:01.635317 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 0d06aebf-d50e-4bdf-90ec-d64b1f1de254 could not be found. Oct 27 03:32:01.635317 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '0d06aebf-d50e-4bdf-90ec-d64b1f1de254'} Oct 27 03:32:01.635317 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:32:01.635317 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:32:01.635317 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:32:01.635317 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:32:01.635317 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:32:01.635317 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:32:01.635317 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:32:01.635317 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:32:01.635317 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:32:01.635317 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:32:01.635317 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d06aebf-d50e-4bdf-90ec-d64b1f1de254 could not be found. Oct 27 03:32:01.635317 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:32:01.635317 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:32:01.635317 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:32:01.635317 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:32:01.635317 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:32:01.635317 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:32:01.635317 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:32:01.635317 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:32:01.635317 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:32:01.635317 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:32:01.635317 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:32:01.635317 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:32:01.635317 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:32:01.635317 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:32:01.635317 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:32:01.635317 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:32:01.635317 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d06aebf-d50e-4bdf-90ec-d64b1f1de254 could not be found. Oct 27 03:32:01.635317 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:32:01.635317 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:32:01.635317 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:32:01.639085 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:32:01.639085 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:32:01.639085 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:32:01.639085 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:32:01.639085 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:32:01.639085 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d06aebf-d50e-4bdf-90ec-d64b1f1de254 could not be found. Oct 27 03:32:01.639085 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:32:01.639085 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-bc4ac413-7073-4b21-8d62-0d5d1f49a9a3 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] Returning 404 to user: Instance 0d06aebf-d50e-4bdf-90ec-d64b1f1de254 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:32:01.639085 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-bc4ac413-7073-4b21-8d62-0d5d1f49a9a3 tempest-InstanceActionsTestJSON-1033488451 tempest-InstanceActionsTestJSON-1033488451-project] 10.222.0.20 "GET /compute/v2.1/servers/0d06aebf-d50e-4bdf-90ec-d64b1f1de254" status: 404 len: 111 microversion: 2.1 time: 0.038362 Oct 27 03:32:01.639085 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1316/2777] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:01 2022] GET /compute/v2.1/servers/0d06aebf-d50e-4bdf-90ec-d64b1f1de254 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:32:01.687354 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-73329c30-840a-4738-a1c1-17bfcd62f848 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:01.695971 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-73329c30-840a-4738-a1c1-17bfcd62f848 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1679 microversion: 2.1 time: 0.320044 Oct 27 03:32:01.704118 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1462/2778] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:01 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1679 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:01.970949 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a40cf27e-91da-419d-8142-06cc7ec09a00 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Calling method '.version_select at 0x7f7dda180820>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:02.069535 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a40cf27e-91da-419d-8142-06cc7ec09a00 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] 10.222.0.20 "GET /compute/v2.1/images/d74029bb-b8f5-4730-a824-852c528f0876" status: 200 len: 1428 microversion: 2.1 time: 0.104516 Oct 27 03:32:02.072156 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1317/2779] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:32:01 2022] GET /compute/v2.1/images/d74029bb-b8f5-4730-a824-852c528f0876 => generated 1428 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:02.567806 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2ec251e2-93e6-411d-8481-6146bb3483d5 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:02.570571 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6faf1196-411d-45d5-974d-3a20f78b06b3 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-296921610", "imageRef": "3a18128f-7d8d-4b7b-9509-7f8fb14274b3", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "de14fb93-e8a7-48f6-92f3-d1d304a0ce06"}], "security_groups": [{"name": "tempest-securitygroup--636484883"}], "key_name": "tempest-keypair-1412192483", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:32:02.571772 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2ec251e2-93e6-411d-8481-6146bb3483d5 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] [instance: 0c726bb2-8fea-4b2d-9e57-a585032c3155] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:02.591557 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2ec251e2-93e6-411d-8481-6146bb3483d5 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:02.592094 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2ec251e2-93e6-411d-8481-6146bb3483d5 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:02.592562 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2ec251e2-93e6-411d-8481-6146bb3483d5 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:02.593324 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2ec251e2-93e6-411d-8481-6146bb3483d5 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:02.593796 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2ec251e2-93e6-411d-8481-6146bb3483d5 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:02.594274 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2ec251e2-93e6-411d-8481-6146bb3483d5 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:02.801526 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-6faf1196-411d-45d5-974d-3a20f78b06b3 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] validate_networks() for [('de14fb93-e8a7-48f6-92f3-d1d304a0ce06', None, None, None, None, None)] {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:32:02.843550 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2ec251e2-93e6-411d-8481-6146bb3483d5 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533917bc5aa4e23802a43b1eb534bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d87abf835a4104b40056b9eec2d6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:02.857700 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2ec251e2-93e6-411d-8481-6146bb3483d5 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] 10.222.0.20 "GET /compute/v2.1/servers/0c726bb2-8fea-4b2d-9e57-a585032c3155" status: 200 len: 1506 microversion: 2.1 time: 0.298230 Oct 27 03:32:02.859115 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1463/2780] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:02 2022] GET /compute/v2.1/servers/0c726bb2-8fea-4b2d-9e57-a585032c3155 => generated 1506 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:02.871621 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c2145b75-f2c7-4cc7-8312-e2be09c15123 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:02.874588 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c2145b75-f2c7-4cc7-8312-e2be09c15123 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:02.886731 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c2145b75-f2c7-4cc7-8312-e2be09c15123 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:02.888033 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c2145b75-f2c7-4cc7-8312-e2be09c15123 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:02.889092 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c2145b75-f2c7-4cc7-8312-e2be09c15123 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:02.889986 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c2145b75-f2c7-4cc7-8312-e2be09c15123 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:02.890675 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c2145b75-f2c7-4cc7-8312-e2be09c15123 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:02.891272 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c2145b75-f2c7-4cc7-8312-e2be09c15123 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:03.087657 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c2145b75-f2c7-4cc7-8312-e2be09c15123 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:03.100398 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c2145b75-f2c7-4cc7-8312-e2be09c15123 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1687 microversion: 2.1 time: 0.233259 Oct 27 03:32:03.110949 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1464/2781] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:02 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1687 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:03.110949 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9c6e105b-0ba3-4a57-a597-ee140daebd90 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Calling method '.version_select at 0x7f7dd9f91af0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:03.213854 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9c6e105b-0ba3-4a57-a597-ee140daebd90 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] 10.222.0.20 "GET /compute/v2.1/images/d74029bb-b8f5-4730-a824-852c528f0876" status: 200 len: 1428 microversion: 2.1 time: 0.111791 Oct 27 03:32:03.215194 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1465/2782] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:32:03 2022] GET /compute/v2.1/images/d74029bb-b8f5-4730-a824-852c528f0876 => generated 1428 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:03.890355 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-668a61bc-8b9d-4f20-b8f0-8ba1799219aa tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:03.893589 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-668a61bc-8b9d-4f20-b8f0-8ba1799219aa tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] [instance: 0c726bb2-8fea-4b2d-9e57-a585032c3155] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:03.922841 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-668a61bc-8b9d-4f20-b8f0-8ba1799219aa tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:03.926444 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-668a61bc-8b9d-4f20-b8f0-8ba1799219aa tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:03.927974 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-668a61bc-8b9d-4f20-b8f0-8ba1799219aa tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:03.930999 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-668a61bc-8b9d-4f20-b8f0-8ba1799219aa tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:03.931726 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-668a61bc-8b9d-4f20-b8f0-8ba1799219aa tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:03.932333 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-668a61bc-8b9d-4f20-b8f0-8ba1799219aa tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:04.433724 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-6faf1196-411d-45d5-974d-3a20f78b06b3 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:32:04.434786 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-6faf1196-411d-45d5-974d-3a20f78b06b3 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:32:04.435494 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-6faf1196-411d-45d5-974d-3a20f78b06b3 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:32:04.436101 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-6faf1196-411d-45d5-974d-3a20f78b06b3 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:32:04.436724 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-6faf1196-411d-45d5-974d-3a20f78b06b3 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:32:04.451732 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6faf1196-411d-45d5-974d-3a20f78b06b3 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:04.452774 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6faf1196-411d-45d5-974d-3a20f78b06b3 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:04.453436 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6faf1196-411d-45d5-974d-3a20f78b06b3 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:04.454625 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6faf1196-411d-45d5-974d-3a20f78b06b3 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:04.456019 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6faf1196-411d-45d5-974d-3a20f78b06b3 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:04.456692 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6faf1196-411d-45d5-974d-3a20f78b06b3 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:04.482168 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-6faf1196-411d-45d5-974d-3a20f78b06b3 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Getting quotas for project f5ee48e200624711b629a12b20c7d282. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:32:04.489657 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-6faf1196-411d-45d5-974d-3a20f78b06b3 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Getting quotas for user ed44bf20b3464a53a3e3f6c9cd61cde3 and project f5ee48e200624711b629a12b20c7d282. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:32:04.506628 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6faf1196-411d-45d5-974d-3a20f78b06b3 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:32:04.509760 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6faf1196-411d-45d5-974d-3a20f78b06b3 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] [instance: f3d23d8e-a80a-425c-a0a3-9e448853a94b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3a18128f-7d8d-4b7b-9509-7f8fb14274b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:32:04.513860 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-668a61bc-8b9d-4f20-b8f0-8ba1799219aa tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533917bc5aa4e23802a43b1eb534bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d87abf835a4104b40056b9eec2d6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:04.531045 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-668a61bc-8b9d-4f20-b8f0-8ba1799219aa tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] 10.222.0.20 "GET /compute/v2.1/servers/0c726bb2-8fea-4b2d-9e57-a585032c3155" status: 200 len: 1506 microversion: 2.1 time: 0.649885 Oct 27 03:32:04.542338 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1466/2783] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:03 2022] GET /compute/v2.1/servers/0c726bb2-8fea-4b2d-9e57-a585032c3155 => generated 1506 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:04.551282 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-99ef273d-728b-4bb2-a4d2-8f11b04013bb tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:04.551282 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-99ef273d-728b-4bb2-a4d2-8f11b04013bb tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:04.562458 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-99ef273d-728b-4bb2-a4d2-8f11b04013bb tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:04.567873 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-99ef273d-728b-4bb2-a4d2-8f11b04013bb tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:04.574442 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-99ef273d-728b-4bb2-a4d2-8f11b04013bb tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:04.575512 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-99ef273d-728b-4bb2-a4d2-8f11b04013bb tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:04.582670 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-99ef273d-728b-4bb2-a4d2-8f11b04013bb tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:04.583523 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-99ef273d-728b-4bb2-a4d2-8f11b04013bb tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:04.672759 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6faf1196-411d-45d5-974d-3a20f78b06b3 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.111519 Oct 27 03:32:04.681775 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1318/2784] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:32:02 2022] POST /compute/v2.1/servers => generated 405 bytes in 2121 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 03:32:04.691388 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d7df18ee-f6d6-4c6b-90b5-416101c1527b tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Calling method '.version_select at 0x7f7ddaa880d0>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:04.860828 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d7df18ee-f6d6-4c6b-90b5-416101c1527b tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] 10.222.0.20 "GET /compute/v2.1/images/d74029bb-b8f5-4730-a824-852c528f0876" status: 200 len: 1428 microversion: 2.1 time: 0.177026 Oct 27 03:32:04.862917 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1319/2785] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:32:04 2022] GET /compute/v2.1/images/d74029bb-b8f5-4730-a824-852c528f0876 => generated 1428 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:04.887933 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3ea1e4c4-cbfd-4e04-8c44-b14470d90406 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:04.888983 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-3ea1e4c4-cbfd-4e04-8c44-b14470d90406 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] [instance: f3d23d8e-a80a-425c-a0a3-9e448853a94b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:05.063882 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-99ef273d-728b-4bb2-a4d2-8f11b04013bb tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:05.075248 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-99ef273d-728b-4bb2-a4d2-8f11b04013bb tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1682 microversion: 2.1 time: 0.532737 Oct 27 03:32:05.086769 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1467/2786] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:04 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1682 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:05.458255 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-3ea1e4c4-cbfd-4e04-8c44-b14470d90406 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed44bf20b3464a53a3e3f6c9cd61cde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ee48e200624711b629a12b20c7d282', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:05.475281 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3ea1e4c4-cbfd-4e04-8c44-b14470d90406 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d23d8e-a80a-425c-a0a3-9e448853a94b" status: 200 len: 1245 microversion: 2.1 time: 0.608782 Oct 27 03:32:05.480856 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1320/2787] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:04 2022] GET /compute/v2.1/servers/f3d23d8e-a80a-425c-a0a3-9e448853a94b => generated 1245 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:05.559868 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5e3f3502-537f-4f1d-a25b-b91b14bfa35a tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:05.569363 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5e3f3502-537f-4f1d-a25b-b91b14bfa35a tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] [instance: 0c726bb2-8fea-4b2d-9e57-a585032c3155] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:05.569897 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-03ec876a-16e4-433e-91cd-35643db38755 req-ecb866f1-ef50-4ce1-b4db-d461919c4043 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed74f42b-af82-4808-bfc2-86110840fe86", "name": "network-vif-plugged", "status": "completed", "tag": "05464839-777e-4176-af2d-6086d6f9acaa"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:32:05.577269 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5e3f3502-537f-4f1d-a25b-b91b14bfa35a tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:05.578211 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5e3f3502-537f-4f1d-a25b-b91b14bfa35a tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:05.581555 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5e3f3502-537f-4f1d-a25b-b91b14bfa35a tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:05.584158 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5e3f3502-537f-4f1d-a25b-b91b14bfa35a tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:05.590062 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5e3f3502-537f-4f1d-a25b-b91b14bfa35a tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:05.593319 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5e3f3502-537f-4f1d-a25b-b91b14bfa35a tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:05.598233 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-03ec876a-16e4-433e-91cd-35643db38755 req-ecb866f1-ef50-4ce1-b4db-d461919c4043 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:05.600107 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-03ec876a-16e4-433e-91cd-35643db38755 req-ecb866f1-ef50-4ce1-b4db-d461919c4043 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:05.601132 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-03ec876a-16e4-433e-91cd-35643db38755 req-ecb866f1-ef50-4ce1-b4db-d461919c4043 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:05.640593 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-03ec876a-16e4-433e-91cd-35643db38755 req-ecb866f1-ef50-4ce1-b4db-d461919c4043 service nova] Creating event network-vif-plugged:05464839-777e-4176-af2d-6086d6f9acaa for instance ed74f42b-af82-4808-bfc2-86110840fe86 on n-h1-862769-1 Oct 27 03:32:05.660374 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-03ec876a-16e4-433e-91cd-35643db38755 req-ecb866f1-ef50-4ce1-b4db-d461919c4043 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099156 Oct 27 03:32:05.665145 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1321/2788] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:32:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:32:05.881500 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1b04597d-37d8-480a-9f72-c4559f6be094 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Calling method '.version_select at 0x7f7dda27f700>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:05.906967 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5e3f3502-537f-4f1d-a25b-b91b14bfa35a tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533917bc5aa4e23802a43b1eb534bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d87abf835a4104b40056b9eec2d6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:05.917802 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5e3f3502-537f-4f1d-a25b-b91b14bfa35a tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] 10.222.0.20 "GET /compute/v2.1/servers/0c726bb2-8fea-4b2d-9e57-a585032c3155" status: 200 len: 1506 microversion: 2.1 time: 0.362972 Oct 27 03:32:05.936325 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1468/2789] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:05 2022] GET /compute/v2.1/servers/0c726bb2-8fea-4b2d-9e57-a585032c3155 => generated 1506 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:06.108766 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f84e4e4b-1f44-40a4-bdb8-3fba8f3d94da tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:06.109307 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f84e4e4b-1f44-40a4-bdb8-3fba8f3d94da tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:06.116272 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f84e4e4b-1f44-40a4-bdb8-3fba8f3d94da tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:06.116833 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f84e4e4b-1f44-40a4-bdb8-3fba8f3d94da tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:06.117770 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f84e4e4b-1f44-40a4-bdb8-3fba8f3d94da tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:06.118925 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f84e4e4b-1f44-40a4-bdb8-3fba8f3d94da tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:06.119596 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f84e4e4b-1f44-40a4-bdb8-3fba8f3d94da tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:06.120515 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f84e4e4b-1f44-40a4-bdb8-3fba8f3d94da tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:06.356505 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f84e4e4b-1f44-40a4-bdb8-3fba8f3d94da tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:06.369994 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f84e4e4b-1f44-40a4-bdb8-3fba8f3d94da tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1682 microversion: 2.1 time: 0.264580 Oct 27 03:32:06.371774 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1469/2790] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:06 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1682 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:06.508676 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-92630e0f-3eeb-4dc7-be5b-bfeca9cf6f4e tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:06.509964 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-92630e0f-3eeb-4dc7-be5b-bfeca9cf6f4e tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] [instance: f3d23d8e-a80a-425c-a0a3-9e448853a94b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:06.691849 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-92630e0f-3eeb-4dc7-be5b-bfeca9cf6f4e tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed44bf20b3464a53a3e3f6c9cd61cde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ee48e200624711b629a12b20c7d282', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:06.705501 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-92630e0f-3eeb-4dc7-be5b-bfeca9cf6f4e tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d23d8e-a80a-425c-a0a3-9e448853a94b" status: 200 len: 1245 microversion: 2.1 time: 0.204835 Oct 27 03:32:06.709682 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1470/2791] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:06 2022] GET /compute/v2.1/servers/f3d23d8e-a80a-425c-a0a3-9e448853a94b => generated 1245 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:32:06.946197 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e3bff272-5270-4cef-8149-22e7c1d585ae tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:06.947027 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e3bff272-5270-4cef-8149-22e7c1d585ae tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] [instance: 0c726bb2-8fea-4b2d-9e57-a585032c3155] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:06.966412 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e3bff272-5270-4cef-8149-22e7c1d585ae tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:06.969975 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e3bff272-5270-4cef-8149-22e7c1d585ae tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:06.969975 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e3bff272-5270-4cef-8149-22e7c1d585ae tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:06.974800 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e3bff272-5270-4cef-8149-22e7c1d585ae tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:06.977399 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e3bff272-5270-4cef-8149-22e7c1d585ae tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:06.978246 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e3bff272-5270-4cef-8149-22e7c1d585ae tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:07.455970 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e3bff272-5270-4cef-8149-22e7c1d585ae tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533917bc5aa4e23802a43b1eb534bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d87abf835a4104b40056b9eec2d6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:07.455970 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e3bff272-5270-4cef-8149-22e7c1d585ae tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] 10.222.0.20 "GET /compute/v2.1/servers/0c726bb2-8fea-4b2d-9e57-a585032c3155" status: 200 len: 1506 microversion: 2.1 time: 0.432988 Oct 27 03:32:07.455970 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1471/2792] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:06 2022] GET /compute/v2.1/servers/0c726bb2-8fea-4b2d-9e57-a585032c3155 => generated 1506 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:07.455970 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2476bc1a-9b23-44d5-bfe9-e7df39cf4f9a tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:07.455970 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2476bc1a-9b23-44d5-bfe9-e7df39cf4f9a tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:07.455970 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2476bc1a-9b23-44d5-bfe9-e7df39cf4f9a tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:07.455970 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2476bc1a-9b23-44d5-bfe9-e7df39cf4f9a tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:07.455970 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2476bc1a-9b23-44d5-bfe9-e7df39cf4f9a tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:07.455970 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2476bc1a-9b23-44d5-bfe9-e7df39cf4f9a tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:07.455970 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2476bc1a-9b23-44d5-bfe9-e7df39cf4f9a tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:07.455970 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2476bc1a-9b23-44d5-bfe9-e7df39cf4f9a tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:07.585542 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2476bc1a-9b23-44d5-bfe9-e7df39cf4f9a tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:07.588367 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:32:07.596602 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2476bc1a-9b23-44d5-bfe9-e7df39cf4f9a tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1682 microversion: 2.1 time: 0.202778 Oct 27 03:32:07.597308 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1472/2793] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:07 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1682 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:07.737777 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d904befd-d90f-4681-98ca-214964c5964c tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:07.738778 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d904befd-d90f-4681-98ca-214964c5964c tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] [instance: f3d23d8e-a80a-425c-a0a3-9e448853a94b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:07.745491 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d904befd-d90f-4681-98ca-214964c5964c tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:07.757691 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d904befd-d90f-4681-98ca-214964c5964c tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:07.757691 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d904befd-d90f-4681-98ca-214964c5964c tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:07.757691 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d904befd-d90f-4681-98ca-214964c5964c tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:07.757691 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d904befd-d90f-4681-98ca-214964c5964c tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:07.757691 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d904befd-d90f-4681-98ca-214964c5964c tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:07.869310 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d904befd-d90f-4681-98ca-214964c5964c tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed44bf20b3464a53a3e3f6c9cd61cde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ee48e200624711b629a12b20c7d282', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:07.895178 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d904befd-d90f-4681-98ca-214964c5964c tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d23d8e-a80a-425c-a0a3-9e448853a94b" status: 200 len: 1249 microversion: 2.1 time: 0.160602 Oct 27 03:32:07.899667 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1473/2794] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:07 2022] GET /compute/v2.1/servers/f3d23d8e-a80a-425c-a0a3-9e448853a94b => generated 1249 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:32:08.400979 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8c33b065-234a-4d41-9496-f8053aa815f1 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:08.401838 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8c33b065-234a-4d41-9496-f8053aa815f1 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] [instance: 0c726bb2-8fea-4b2d-9e57-a585032c3155] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:08.412442 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8c33b065-234a-4d41-9496-f8053aa815f1 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:08.413360 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8c33b065-234a-4d41-9496-f8053aa815f1 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:08.416011 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8c33b065-234a-4d41-9496-f8053aa815f1 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:08.416011 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8c33b065-234a-4d41-9496-f8053aa815f1 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:08.416011 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8c33b065-234a-4d41-9496-f8053aa815f1 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:08.416440 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8c33b065-234a-4d41-9496-f8053aa815f1 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:09.019459 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8c33b065-234a-4d41-9496-f8053aa815f1 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533917bc5aa4e23802a43b1eb534bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d87abf835a4104b40056b9eec2d6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:09.033092 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8c33b065-234a-4d41-9496-f8053aa815f1 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] 10.222.0.20 "GET /compute/v2.1/servers/0c726bb2-8fea-4b2d-9e57-a585032c3155" status: 200 len: 1506 microversion: 2.1 time: 0.635963 Oct 27 03:32:09.035016 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1474/2795] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:08 2022] GET /compute/v2.1/servers/0c726bb2-8fea-4b2d-9e57-a585032c3155 => generated 1506 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:32:09.840381 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-84c050c3-0204-4753-b072-1aed62e39671 tempest-FlavorsV2TestJSON-1772232390 tempest-FlavorsV2TestJSON-1772232390-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:09.875203 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-84c050c3-0204-4753-b072-1aed62e39671 tempest-FlavorsV2TestJSON-1772232390 tempest-FlavorsV2TestJSON-1772232390-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.833706 Oct 27 03:32:09.880839 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1475/2796] 10.222.0.20 () {58 vars in 1137 bytes} [Thu Oct 27 03:32:09 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:32:09.904721 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-25a3788b-aae9-4e28-a368-42f104a7a6e5 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:09.905643 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-25a3788b-aae9-4e28-a368-42f104a7a6e5 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:09.926987 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-25a3788b-aae9-4e28-a368-42f104a7a6e5 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:09.927494 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-25a3788b-aae9-4e28-a368-42f104a7a6e5 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:09.927942 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-25a3788b-aae9-4e28-a368-42f104a7a6e5 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:09.934129 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-25a3788b-aae9-4e28-a368-42f104a7a6e5 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:09.934734 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-25a3788b-aae9-4e28-a368-42f104a7a6e5 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:09.935197 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-25a3788b-aae9-4e28-a368-42f104a7a6e5 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:10.232754 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-25a3788b-aae9-4e28-a368-42f104a7a6e5 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:10.248274 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-25a3788b-aae9-4e28-a368-42f104a7a6e5 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1682 microversion: 2.1 time: 0.365629 Oct 27 03:32:10.255102 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1476/2797] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:09 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1682 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:10.272541 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1fc5e439-5fce-4c9d-8d9e-95dc57a530a4 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:10.273393 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1fc5e439-5fce-4c9d-8d9e-95dc57a530a4 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] [instance: f3d23d8e-a80a-425c-a0a3-9e448853a94b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:10.300671 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1fc5e439-5fce-4c9d-8d9e-95dc57a530a4 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:10.301191 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1fc5e439-5fce-4c9d-8d9e-95dc57a530a4 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:10.301647 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1fc5e439-5fce-4c9d-8d9e-95dc57a530a4 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:10.302510 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1fc5e439-5fce-4c9d-8d9e-95dc57a530a4 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:10.314162 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1fc5e439-5fce-4c9d-8d9e-95dc57a530a4 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:10.314162 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1fc5e439-5fce-4c9d-8d9e-95dc57a530a4 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:10.469833 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1fc5e439-5fce-4c9d-8d9e-95dc57a530a4 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed44bf20b3464a53a3e3f6c9cd61cde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ee48e200624711b629a12b20c7d282', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:10.483657 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1fc5e439-5fce-4c9d-8d9e-95dc57a530a4 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d23d8e-a80a-425c-a0a3-9e448853a94b" status: 200 len: 1303 microversion: 2.1 time: 0.225828 Oct 27 03:32:10.499075 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1477/2798] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:10 2022] GET /compute/v2.1/servers/f3d23d8e-a80a-425c-a0a3-9e448853a94b => generated 1303 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:10.507746 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4f13b342-9ff2-4105-8e90-bc6e423e8e54 tempest-FlavorsV2TestJSON-1772232390 tempest-FlavorsV2TestJSON-1772232390-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:10.569593 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4f13b342-9ff2-4105-8e90-bc6e423e8e54 tempest-FlavorsV2TestJSON-1772232390 tempest-FlavorsV2TestJSON-1772232390-project] 10.222.0.20 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.068720 Oct 27 03:32:10.570737 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1478/2799] 10.222.0.20 () {58 vars in 1125 bytes} [Thu Oct 27 03:32:10 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:10.575880 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f82303c4-3b04-48ca-867a-065bfeba033c tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:10.577506 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f82303c4-3b04-48ca-867a-065bfeba033c tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] [instance: 0c726bb2-8fea-4b2d-9e57-a585032c3155] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:10.584726 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f82303c4-3b04-48ca-867a-065bfeba033c tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:10.585557 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f82303c4-3b04-48ca-867a-065bfeba033c tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:10.600443 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f82303c4-3b04-48ca-867a-065bfeba033c tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:10.602951 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f82303c4-3b04-48ca-867a-065bfeba033c tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:10.617556 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f82303c4-3b04-48ca-867a-065bfeba033c tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:10.618010 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f82303c4-3b04-48ca-867a-065bfeba033c tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:10.821563 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=13 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:32:11.043249 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f82303c4-3b04-48ca-867a-065bfeba033c tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533917bc5aa4e23802a43b1eb534bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d87abf835a4104b40056b9eec2d6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:11.057742 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f82303c4-3b04-48ca-867a-065bfeba033c tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] 10.222.0.20 "GET /compute/v2.1/servers/0c726bb2-8fea-4b2d-9e57-a585032c3155" status: 200 len: 1506 microversion: 2.1 time: 0.485649 Oct 27 03:32:11.061780 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1479/2800] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:10 2022] GET /compute/v2.1/servers/0c726bb2-8fea-4b2d-9e57-a585032c3155 => generated 1506 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:11.069125 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8f0d3e69-8c51-4366-bdb8-91021e1b4c2a tempest-FlavorsV2TestJSON-1772232390 tempest-FlavorsV2TestJSON-1772232390-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:11.093170 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8f0d3e69-8c51-4366-bdb8-91021e1b4c2a tempest-FlavorsV2TestJSON-1772232390 tempest-FlavorsV2TestJSON-1772232390-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.028372 Oct 27 03:32:11.096472 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1480/2801] 10.222.0.20 () {58 vars in 1137 bytes} [Thu Oct 27 03:32:11 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:32:11.116496 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8296d9dd-aacf-4973-846c-84520b06cebe tempest-FlavorsV2TestJSON-1772232390 tempest-FlavorsV2TestJSON-1772232390-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:11.139825 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8296d9dd-aacf-4973-846c-84520b06cebe tempest-FlavorsV2TestJSON-1772232390 tempest-FlavorsV2TestJSON-1772232390-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.027283 Oct 27 03:32:11.151212 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1481/2802] 10.222.0.20 () {58 vars in 1137 bytes} [Thu Oct 27 03:32:11 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:32:11.156522 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-fbef7160-ef8d-4e61-a168-c44cd1204506 tempest-FlavorsV2TestJSON-1772232390 tempest-FlavorsV2TestJSON-1772232390-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:11.199051 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-fbef7160-ef8d-4e61-a168-c44cd1204506 tempest-FlavorsV2TestJSON-1772232390 tempest-FlavorsV2TestJSON-1772232390-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.046371 Oct 27 03:32:11.213331 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1482/2803] 10.222.0.20 () {58 vars in 1165 bytes} [Thu Oct 27 03:32:11 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:11.219527 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-44e95960-e6c4-44b4-95be-4db173a3205f tempest-FlavorsV2TestJSON-1772232390 tempest-FlavorsV2TestJSON-1772232390-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:11.235448 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-44e95960-e6c4-44b4-95be-4db173a3205f tempest-FlavorsV2TestJSON-1772232390 tempest-FlavorsV2TestJSON-1772232390-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.020588 Oct 27 03:32:11.236972 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1483/2804] 10.222.0.20 () {58 vars in 1137 bytes} [Thu Oct 27 03:32:11 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:32:11.251645 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-71b9b12a-866a-4d00-aefa-5fd23b5fa04c tempest-FlavorsV2TestJSON-1772232390 tempest-FlavorsV2TestJSON-1772232390-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:11.287069 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-71b9b12a-866a-4d00-aefa-5fd23b5fa04c tempest-FlavorsV2TestJSON-1772232390 tempest-FlavorsV2TestJSON-1772232390-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.040585 Oct 27 03:32:11.301179 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1484/2805] 10.222.0.20 () {58 vars in 1169 bytes} [Thu Oct 27 03:32:11 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:11.307884 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1ee83275-9fc0-4d7c-90f2-7a4a6235a6a0 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:11.308786 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1ee83275-9fc0-4d7c-90f2-7a4a6235a6a0 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:11.317293 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1ee83275-9fc0-4d7c-90f2-7a4a6235a6a0 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:11.318142 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1ee83275-9fc0-4d7c-90f2-7a4a6235a6a0 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:11.318826 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1ee83275-9fc0-4d7c-90f2-7a4a6235a6a0 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:11.319741 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1ee83275-9fc0-4d7c-90f2-7a4a6235a6a0 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:11.320379 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1ee83275-9fc0-4d7c-90f2-7a4a6235a6a0 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:11.321786 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1ee83275-9fc0-4d7c-90f2-7a4a6235a6a0 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:11.640429 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1ee83275-9fc0-4d7c-90f2-7a4a6235a6a0 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:11.654098 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1ee83275-9fc0-4d7c-90f2-7a4a6235a6a0 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1682 microversion: 2.1 time: 0.351193 Oct 27 03:32:11.655333 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1485/2806] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:11 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1682 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:11.665962 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2c7a1e68-aab9-4b29-9532-381c7f25a98d tempest-FlavorsV2TestJSON-1772232390 tempest-FlavorsV2TestJSON-1772232390-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:11.696825 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2c7a1e68-aab9-4b29-9532-381c7f25a98d tempest-FlavorsV2TestJSON-1772232390 tempest-FlavorsV2TestJSON-1772232390-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.038062 Oct 27 03:32:11.708702 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1486/2807] 10.222.0.20 () {58 vars in 1161 bytes} [Thu Oct 27 03:32:11 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:32:11.720188 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-bfa4732c-6ac2-46b4-a21e-9347b9937c73 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:11.723073 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-bfa4732c-6ac2-46b4-a21e-9347b9937c73 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] [instance: f3d23d8e-a80a-425c-a0a3-9e448853a94b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:11.738025 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bfa4732c-6ac2-46b4-a21e-9347b9937c73 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:11.742359 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bfa4732c-6ac2-46b4-a21e-9347b9937c73 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:11.743169 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bfa4732c-6ac2-46b4-a21e-9347b9937c73 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:11.744139 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bfa4732c-6ac2-46b4-a21e-9347b9937c73 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:11.744810 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bfa4732c-6ac2-46b4-a21e-9347b9937c73 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:11.745477 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bfa4732c-6ac2-46b4-a21e-9347b9937c73 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:12.282468 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-bfa4732c-6ac2-46b4-a21e-9347b9937c73 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed44bf20b3464a53a3e3f6c9cd61cde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ee48e200624711b629a12b20c7d282', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:12.292218 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-bfa4732c-6ac2-46b4-a21e-9347b9937c73 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d23d8e-a80a-425c-a0a3-9e448853a94b" status: 200 len: 1370 microversion: 2.1 time: 0.580781 Oct 27 03:32:12.311517 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1487/2808] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:11 2022] GET /compute/v2.1/servers/f3d23d8e-a80a-425c-a0a3-9e448853a94b => generated 1370 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:12.338845 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8d7e6ff1-677b-412a-a4d1-a40809f7f76c tempest-FlavorsV2TestJSON-1772232390 tempest-FlavorsV2TestJSON-1772232390-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:12.351002 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8d7e6ff1-677b-412a-a4d1-a40809f7f76c tempest-FlavorsV2TestJSON-1772232390 tempest-FlavorsV2TestJSON-1772232390-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.038162 Oct 27 03:32:12.352266 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1488/2809] 10.222.0.20 () {58 vars in 1137 bytes} [Thu Oct 27 03:32:12 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:32:12.357753 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6119ceee-9f61-4dc3-b35e-b3d24baa5562 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:12.359182 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-6119ceee-9f61-4dc3-b35e-b3d24baa5562 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] [instance: 0c726bb2-8fea-4b2d-9e57-a585032c3155] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:12.366537 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6119ceee-9f61-4dc3-b35e-b3d24baa5562 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:12.367405 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6119ceee-9f61-4dc3-b35e-b3d24baa5562 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:12.368133 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6119ceee-9f61-4dc3-b35e-b3d24baa5562 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:12.369390 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6119ceee-9f61-4dc3-b35e-b3d24baa5562 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:12.370179 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6119ceee-9f61-4dc3-b35e-b3d24baa5562 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:12.370851 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6119ceee-9f61-4dc3-b35e-b3d24baa5562 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:12.585133 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6119ceee-9f61-4dc3-b35e-b3d24baa5562 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533917bc5aa4e23802a43b1eb534bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d87abf835a4104b40056b9eec2d6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:12.595867 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6119ceee-9f61-4dc3-b35e-b3d24baa5562 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] 10.222.0.20 "GET /compute/v2.1/servers/0c726bb2-8fea-4b2d-9e57-a585032c3155" status: 200 len: 1506 microversion: 2.1 time: 0.240630 Oct 27 03:32:12.596741 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1489/2810] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:12 2022] GET /compute/v2.1/servers/0c726bb2-8fea-4b2d-9e57-a585032c3155 => generated 1506 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:12.606785 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4d7b9c5c-1aaa-43df-8a53-c8c7bdab7201 tempest-FlavorsV2TestJSON-1772232390 tempest-FlavorsV2TestJSON-1772232390-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:12.655002 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4d7b9c5c-1aaa-43df-8a53-c8c7bdab7201 tempest-FlavorsV2TestJSON-1772232390 tempest-FlavorsV2TestJSON-1772232390-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.053561 Oct 27 03:32:12.656318 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1490/2811] 10.222.0.20 () {58 vars in 1167 bytes} [Thu Oct 27 03:32:12 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:12.675584 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-59c4d2ac-da99-4400-909e-a57ce47ad92d tempest-FlavorsV2TestJSON-1772232390 tempest-FlavorsV2TestJSON-1772232390-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:12.681694 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:32:12.686013 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-59c4d2ac-da99-4400-909e-a57ce47ad92d tempest-FlavorsV2TestJSON-1772232390 tempest-FlavorsV2TestJSON-1772232390-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014655 Oct 27 03:32:12.686931 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1491/2812] 10.222.0.20 () {58 vars in 1137 bytes} [Thu Oct 27 03:32:12 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:32:12.695258 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-539018f4-1f86-4d2b-a04c-11b499bde29b tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:12.696439 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-539018f4-1f86-4d2b-a04c-11b499bde29b tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:12.709927 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-539018f4-1f86-4d2b-a04c-11b499bde29b tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:12.711054 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-539018f4-1f86-4d2b-a04c-11b499bde29b tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:12.711660 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-539018f4-1f86-4d2b-a04c-11b499bde29b tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:12.712596 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-539018f4-1f86-4d2b-a04c-11b499bde29b tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:12.713224 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-539018f4-1f86-4d2b-a04c-11b499bde29b tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:12.713810 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-539018f4-1f86-4d2b-a04c-11b499bde29b tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:13.051753 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-539018f4-1f86-4d2b-a04c-11b499bde29b tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:13.060313 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-539018f4-1f86-4d2b-a04c-11b499bde29b tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1682 microversion: 2.1 time: 0.371560 Oct 27 03:32:13.089591 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1492/2813] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:12 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1682 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:13.094923 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ed9459e3-df2b-4043-a4e2-65b0cec70ef5 tempest-FlavorsV2TestJSON-1772232390 tempest-FlavorsV2TestJSON-1772232390-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:13.119470 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ed9459e3-df2b-4043-a4e2-65b0cec70ef5 tempest-FlavorsV2TestJSON-1772232390 tempest-FlavorsV2TestJSON-1772232390-project] 10.222.0.20 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.028568 Oct 27 03:32:13.131693 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1493/2814] 10.222.0.20 () {58 vars in 1144 bytes} [Thu Oct 27 03:32:13 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:13.136619 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9278245a-4d67-4bbe-bf34-854cd89985e7 tempest-FlavorsV2TestJSON-1772232390 tempest-FlavorsV2TestJSON-1772232390-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:13.146399 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9278245a-4d67-4bbe-bf34-854cd89985e7 tempest-FlavorsV2TestJSON-1772232390 tempest-FlavorsV2TestJSON-1772232390-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013441 Oct 27 03:32:13.147529 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1494/2815] 10.222.0.20 () {58 vars in 1137 bytes} [Thu Oct 27 03:32:13 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:32:13.163894 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-45228410-efb6-4344-a650-d6fb231b98df tempest-FlavorsV2TestJSON-1772232390 tempest-FlavorsV2TestJSON-1772232390-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:13.207003 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-45228410-efb6-4344-a650-d6fb231b98df tempest-FlavorsV2TestJSON-1772232390 tempest-FlavorsV2TestJSON-1772232390-project] 10.222.0.20 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.046689 Oct 27 03:32:13.222413 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1495/2816] 10.222.0.20 () {58 vars in 1148 bytes} [Thu Oct 27 03:32:13 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:13.234167 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-bbbdefa6-0294-4afd-853a-098fd13d2d4f tempest-FlavorsV2TestJSON-1772232390 tempest-FlavorsV2TestJSON-1772232390-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:13.245438 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-bbbdefa6-0294-4afd-853a-098fd13d2d4f tempest-FlavorsV2TestJSON-1772232390 tempest-FlavorsV2TestJSON-1772232390-project] 10.222.0.20 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.021792 Oct 27 03:32:13.255940 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1496/2817] 10.222.0.20 () {58 vars in 1140 bytes} [Thu Oct 27 03:32:13 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:32:13.263236 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-378a4b06-e727-4fe9-ba1f-25b3d21345c8 tempest-FlavorsV2TestJSON-1772232390 tempest-FlavorsV2TestJSON-1772232390-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:13.276682 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-378a4b06-e727-4fe9-ba1f-25b3d21345c8 tempest-FlavorsV2TestJSON-1772232390 tempest-FlavorsV2TestJSON-1772232390-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.019553 Oct 27 03:32:13.277948 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1497/2818] 10.222.0.20 () {58 vars in 1137 bytes} [Thu Oct 27 03:32:13 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:32:13.291460 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c5ca5c7c-4dda-4adf-8db0-295a5b978209 tempest-FlavorsV2TestJSON-1772232390 tempest-FlavorsV2TestJSON-1772232390-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:13.324785 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c5ca5c7c-4dda-4adf-8db0-295a5b978209 tempest-FlavorsV2TestJSON-1772232390 tempest-FlavorsV2TestJSON-1772232390-project] 10.222.0.20 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.034949 Oct 27 03:32:13.324975 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1498/2819] 10.222.0.20 () {58 vars in 1146 bytes} [Thu Oct 27 03:32:13 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:13.351645 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-aa656a30-8e76-440c-a5d4-dd127e3741e1 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:13.352326 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-aa656a30-8e76-440c-a5d4-dd127e3741e1 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] [instance: f3d23d8e-a80a-425c-a0a3-9e448853a94b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:13.367631 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aa656a30-8e76-440c-a5d4-dd127e3741e1 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:13.378600 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aa656a30-8e76-440c-a5d4-dd127e3741e1 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:13.378600 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aa656a30-8e76-440c-a5d4-dd127e3741e1 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:13.378600 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aa656a30-8e76-440c-a5d4-dd127e3741e1 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:13.378600 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aa656a30-8e76-440c-a5d4-dd127e3741e1 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:13.378600 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aa656a30-8e76-440c-a5d4-dd127e3741e1 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:13.607207 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-aa656a30-8e76-440c-a5d4-dd127e3741e1 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed44bf20b3464a53a3e3f6c9cd61cde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ee48e200624711b629a12b20c7d282', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:13.620744 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-aa656a30-8e76-440c-a5d4-dd127e3741e1 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d23d8e-a80a-425c-a0a3-9e448853a94b" status: 200 len: 1370 microversion: 2.1 time: 0.277322 Oct 27 03:32:13.638059 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1499/2820] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:13 2022] GET /compute/v2.1/servers/f3d23d8e-a80a-425c-a0a3-9e448853a94b => generated 1370 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:13.646307 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-28246cf6-9e26-412c-b6a3-9cdfe32a7b7d tempest-FlavorsV2TestJSON-1772232390 tempest-FlavorsV2TestJSON-1772232390-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:13.681742 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-28246cf6-9e26-412c-b6a3-9cdfe32a7b7d tempest-FlavorsV2TestJSON-1772232390 tempest-FlavorsV2TestJSON-1772232390-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.050872 Oct 27 03:32:13.683058 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1500/2821] 10.222.0.20 () {58 vars in 1146 bytes} [Thu Oct 27 03:32:13 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:13.690295 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8a437d32-6d3f-4a37-9f3d-aac38f486f82 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:13.690923 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8a437d32-6d3f-4a37-9f3d-aac38f486f82 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] [instance: 0c726bb2-8fea-4b2d-9e57-a585032c3155] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:13.702571 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8a437d32-6d3f-4a37-9f3d-aac38f486f82 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:13.703084 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8a437d32-6d3f-4a37-9f3d-aac38f486f82 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:13.703532 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8a437d32-6d3f-4a37-9f3d-aac38f486f82 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:13.704419 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8a437d32-6d3f-4a37-9f3d-aac38f486f82 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:13.704930 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8a437d32-6d3f-4a37-9f3d-aac38f486f82 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:13.705349 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8a437d32-6d3f-4a37-9f3d-aac38f486f82 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:13.867234 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8a437d32-6d3f-4a37-9f3d-aac38f486f82 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533917bc5aa4e23802a43b1eb534bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d87abf835a4104b40056b9eec2d6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:13.876677 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8a437d32-6d3f-4a37-9f3d-aac38f486f82 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] 10.222.0.20 "GET /compute/v2.1/servers/0c726bb2-8fea-4b2d-9e57-a585032c3155" status: 200 len: 1506 microversion: 2.1 time: 0.192553 Oct 27 03:32:13.877713 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1501/2822] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:13 2022] GET /compute/v2.1/servers/0c726bb2-8fea-4b2d-9e57-a585032c3155 => generated 1506 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:13.882754 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e51f100f-9d70-4775-bc96-e109b7a3a156 tempest-FlavorsV2TestJSON-1772232390 tempest-FlavorsV2TestJSON-1772232390-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:13.891295 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e51f100f-9d70-4775-bc96-e109b7a3a156 tempest-FlavorsV2TestJSON-1772232390 tempest-FlavorsV2TestJSON-1772232390-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012354 Oct 27 03:32:13.893393 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1502/2823] 10.222.0.20 () {58 vars in 1137 bytes} [Thu Oct 27 03:32:13 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:32:14.042972 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-dc73192e-987d-4412-b2e1-a61ca021d722 req-0a77e933-2a95-4f55-b66d-435b8f639f9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3d23d8e-a80a-425c-a0a3-9e448853a94b", "tag": "aa192bf0-ce03-4098-8949-343a75b75ddb"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:32:14.065512 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-dc73192e-987d-4412-b2e1-a61ca021d722 req-0a77e933-2a95-4f55-b66d-435b8f639f9d service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:14.066944 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-dc73192e-987d-4412-b2e1-a61ca021d722 req-0a77e933-2a95-4f55-b66d-435b8f639f9d service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:14.069852 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-dc73192e-987d-4412-b2e1-a61ca021d722 req-0a77e933-2a95-4f55-b66d-435b8f639f9d service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:14.091801 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-dc73192e-987d-4412-b2e1-a61ca021d722 req-0a77e933-2a95-4f55-b66d-435b8f639f9d service nova] Creating event network-changed:aa192bf0-ce03-4098-8949-343a75b75ddb for instance f3d23d8e-a80a-425c-a0a3-9e448853a94b on n-h2-862769-1 Oct 27 03:32:14.103347 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-dc73192e-987d-4412-b2e1-a61ca021d722 req-0a77e933-2a95-4f55-b66d-435b8f639f9d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067071 Oct 27 03:32:14.105474 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1503/2824] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:32:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:32:14.124184 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-743f9673-937d-4737-92e1-4f465d1075bc tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:14.125844 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-743f9673-937d-4737-92e1-4f465d1075bc tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:14.135192 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-743f9673-937d-4737-92e1-4f465d1075bc tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:14.136879 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-743f9673-937d-4737-92e1-4f465d1075bc tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:14.138202 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-743f9673-937d-4737-92e1-4f465d1075bc tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:14.139710 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-743f9673-937d-4737-92e1-4f465d1075bc tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:14.140609 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-743f9673-937d-4737-92e1-4f465d1075bc tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:14.141868 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-743f9673-937d-4737-92e1-4f465d1075bc tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:14.398925 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-743f9673-937d-4737-92e1-4f465d1075bc tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:14.414950 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-743f9673-937d-4737-92e1-4f465d1075bc tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1682 microversion: 2.1 time: 0.307355 Oct 27 03:32:14.420332 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1504/2825] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:14 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1682 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:14.472458 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=4 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:32:14.652428 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9ccf2b18-4cd7-4f13-b54f-6cfcf14d9b05 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:14.653225 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-9ccf2b18-4cd7-4f13-b54f-6cfcf14d9b05 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] [instance: f3d23d8e-a80a-425c-a0a3-9e448853a94b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:14.685321 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9ccf2b18-4cd7-4f13-b54f-6cfcf14d9b05 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:14.686757 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9ccf2b18-4cd7-4f13-b54f-6cfcf14d9b05 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:14.688207 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9ccf2b18-4cd7-4f13-b54f-6cfcf14d9b05 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:14.689698 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9ccf2b18-4cd7-4f13-b54f-6cfcf14d9b05 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:14.690922 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9ccf2b18-4cd7-4f13-b54f-6cfcf14d9b05 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:14.691546 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9ccf2b18-4cd7-4f13-b54f-6cfcf14d9b05 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:15.099799 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9ccf2b18-4cd7-4f13-b54f-6cfcf14d9b05 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed44bf20b3464a53a3e3f6c9cd61cde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ee48e200624711b629a12b20c7d282', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:15.114468 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9ccf2b18-4cd7-4f13-b54f-6cfcf14d9b05 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d23d8e-a80a-425c-a0a3-9e448853a94b" status: 200 len: 1370 microversion: 2.1 time: 0.466628 Oct 27 03:32:15.122538 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1505/2826] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:14 2022] GET /compute/v2.1/servers/f3d23d8e-a80a-425c-a0a3-9e448853a94b => generated 1370 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:32:15.133775 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1b29122c-279f-49e8-81e2-166daa320976 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:15.134447 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1b29122c-279f-49e8-81e2-166daa320976 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] [instance: 0c726bb2-8fea-4b2d-9e57-a585032c3155] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:15.148771 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1b29122c-279f-49e8-81e2-166daa320976 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:15.149291 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1b29122c-279f-49e8-81e2-166daa320976 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:15.149742 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1b29122c-279f-49e8-81e2-166daa320976 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:15.150493 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1b29122c-279f-49e8-81e2-166daa320976 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:15.150959 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1b29122c-279f-49e8-81e2-166daa320976 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:15.151401 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1b29122c-279f-49e8-81e2-166daa320976 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:15.448002 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1b29122c-279f-49e8-81e2-166daa320976 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533917bc5aa4e23802a43b1eb534bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d87abf835a4104b40056b9eec2d6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:15.464754 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1b29122c-279f-49e8-81e2-166daa320976 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] 10.222.0.20 "GET /compute/v2.1/servers/0c726bb2-8fea-4b2d-9e57-a585032c3155" status: 200 len: 1506 microversion: 2.1 time: 0.340890 Oct 27 03:32:15.465545 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1506/2827] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:15 2022] GET /compute/v2.1/servers/0c726bb2-8fea-4b2d-9e57-a585032c3155 => generated 1506 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:15.473095 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3d006b80-9e3e-4aea-9349-33ccc6aa4a4b tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:15.473730 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3d006b80-9e3e-4aea-9349-33ccc6aa4a4b tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:15.481155 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=20 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:32:15.495228 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3d006b80-9e3e-4aea-9349-33ccc6aa4a4b tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:15.495741 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3d006b80-9e3e-4aea-9349-33ccc6aa4a4b tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:15.496199 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3d006b80-9e3e-4aea-9349-33ccc6aa4a4b tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:15.499674 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3d006b80-9e3e-4aea-9349-33ccc6aa4a4b tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:15.500165 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3d006b80-9e3e-4aea-9349-33ccc6aa4a4b tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:15.500627 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3d006b80-9e3e-4aea-9349-33ccc6aa4a4b tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:15.609333 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=5 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:32:15.612179 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=52 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:32:15.858630 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3d006b80-9e3e-4aea-9349-33ccc6aa4a4b tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:15.872936 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3d006b80-9e3e-4aea-9349-33ccc6aa4a4b tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1682 microversion: 2.1 time: 0.406393 Oct 27 03:32:15.900305 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1507/2828] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:15 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1682 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:16.150542 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d37b1e48-362c-4768-b2d8-09dec77dbd0c tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:16.151722 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d37b1e48-362c-4768-b2d8-09dec77dbd0c tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] [instance: f3d23d8e-a80a-425c-a0a3-9e448853a94b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:16.166374 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d37b1e48-362c-4768-b2d8-09dec77dbd0c tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:16.167327 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d37b1e48-362c-4768-b2d8-09dec77dbd0c tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:16.169404 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d37b1e48-362c-4768-b2d8-09dec77dbd0c tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:16.170671 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d37b1e48-362c-4768-b2d8-09dec77dbd0c tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:16.173274 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d37b1e48-362c-4768-b2d8-09dec77dbd0c tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:16.175939 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d37b1e48-362c-4768-b2d8-09dec77dbd0c tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:16.592768 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1b04597d-37d8-480a-9f72-c4559f6be094 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] 10.222.0.20 "GET /compute/v2.1/images/d74029bb-b8f5-4730-a824-852c528f0876" status: 200 len: 1437 microversion: 2.1 time: 10.716975 Oct 27 03:32:16.593806 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1322/2829] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:32:05 2022] GET /compute/v2.1/images/d74029bb-b8f5-4730-a824-852c528f0876 => generated 1437 bytes in 10720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:16.609571 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d486de9f-b0ff-4d9d-a9bd-b33ecf3239de tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:16.613130 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d486de9f-b0ff-4d9d-a9bd-b33ecf3239de tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] [instance: 0c726bb2-8fea-4b2d-9e57-a585032c3155] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:16.652415 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d37b1e48-362c-4768-b2d8-09dec77dbd0c tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed44bf20b3464a53a3e3f6c9cd61cde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ee48e200624711b629a12b20c7d282', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:16.671783 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d37b1e48-362c-4768-b2d8-09dec77dbd0c tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d23d8e-a80a-425c-a0a3-9e448853a94b" status: 200 len: 1370 microversion: 2.1 time: 0.524436 Oct 27 03:32:16.674203 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1508/2830] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:16 2022] GET /compute/v2.1/servers/f3d23d8e-a80a-425c-a0a3-9e448853a94b => generated 1370 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:16.686880 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9221852a-327a-492c-b1c3-1854b9a60d7e tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Calling method '.version_select at 0x7f7ddedc4ca0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:16.689353 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d486de9f-b0ff-4d9d-a9bd-b33ecf3239de tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:16.697242 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d486de9f-b0ff-4d9d-a9bd-b33ecf3239de tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:16.697242 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d486de9f-b0ff-4d9d-a9bd-b33ecf3239de tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:16.699194 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=20 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:32:16.706923 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d486de9f-b0ff-4d9d-a9bd-b33ecf3239de tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:16.710969 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d486de9f-b0ff-4d9d-a9bd-b33ecf3239de tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:16.710969 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d486de9f-b0ff-4d9d-a9bd-b33ecf3239de tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:17.262601 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d486de9f-b0ff-4d9d-a9bd-b33ecf3239de tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533917bc5aa4e23802a43b1eb534bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d87abf835a4104b40056b9eec2d6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:17.283903 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d486de9f-b0ff-4d9d-a9bd-b33ecf3239de tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] 10.222.0.20 "GET /compute/v2.1/servers/0c726bb2-8fea-4b2d-9e57-a585032c3155" status: 200 len: 1506 microversion: 2.1 time: 0.681336 Oct 27 03:32:17.295792 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1323/2831] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:16 2022] GET /compute/v2.1/servers/0c726bb2-8fea-4b2d-9e57-a585032c3155 => generated 1506 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:17.305552 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6860c07e-d706-4eb3-ba97-c97fb1bea813 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:17.312943 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6860c07e-d706-4eb3-ba97-c97fb1bea813 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:17.327167 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6860c07e-d706-4eb3-ba97-c97fb1bea813 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:17.329411 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6860c07e-d706-4eb3-ba97-c97fb1bea813 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:17.329411 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6860c07e-d706-4eb3-ba97-c97fb1bea813 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:17.329411 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6860c07e-d706-4eb3-ba97-c97fb1bea813 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:17.332687 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6860c07e-d706-4eb3-ba97-c97fb1bea813 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:17.333234 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6860c07e-d706-4eb3-ba97-c97fb1bea813 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:18.030888 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-6860c07e-d706-4eb3-ba97-c97fb1bea813 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:18.050959 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6860c07e-d706-4eb3-ba97-c97fb1bea813 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1682 microversion: 2.1 time: 0.752085 Oct 27 03:32:18.054237 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1324/2832] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:17 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1682 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:18.101269 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b44cf016-eac2-462f-a06c-5cc4b092f1e9 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:18.105776 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b44cf016-eac2-462f-a06c-5cc4b092f1e9 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] [instance: f3d23d8e-a80a-425c-a0a3-9e448853a94b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:18.131764 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b44cf016-eac2-462f-a06c-5cc4b092f1e9 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:18.132279 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b44cf016-eac2-462f-a06c-5cc4b092f1e9 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:18.132729 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b44cf016-eac2-462f-a06c-5cc4b092f1e9 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:18.137559 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b44cf016-eac2-462f-a06c-5cc4b092f1e9 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:18.137559 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b44cf016-eac2-462f-a06c-5cc4b092f1e9 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:18.144722 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b44cf016-eac2-462f-a06c-5cc4b092f1e9 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:18.791878 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b44cf016-eac2-462f-a06c-5cc4b092f1e9 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed44bf20b3464a53a3e3f6c9cd61cde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ee48e200624711b629a12b20c7d282', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:18.800273 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b44cf016-eac2-462f-a06c-5cc4b092f1e9 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d23d8e-a80a-425c-a0a3-9e448853a94b" status: 200 len: 1370 microversion: 2.1 time: 0.736818 Oct 27 03:32:18.801052 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1325/2833] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:18 2022] GET /compute/v2.1/servers/f3d23d8e-a80a-425c-a0a3-9e448853a94b => generated 1370 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:18.805962 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0da95206-d2de-47cd-b984-586a00043dd0 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:18.806787 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0da95206-d2de-47cd-b984-586a00043dd0 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] [instance: 0c726bb2-8fea-4b2d-9e57-a585032c3155] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:18.815810 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0da95206-d2de-47cd-b984-586a00043dd0 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:18.818096 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0da95206-d2de-47cd-b984-586a00043dd0 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:18.829858 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0da95206-d2de-47cd-b984-586a00043dd0 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:18.830922 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0da95206-d2de-47cd-b984-586a00043dd0 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:18.831271 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0da95206-d2de-47cd-b984-586a00043dd0 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:18.831694 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0da95206-d2de-47cd-b984-586a00043dd0 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:18.999966 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0da95206-d2de-47cd-b984-586a00043dd0 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533917bc5aa4e23802a43b1eb534bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d87abf835a4104b40056b9eec2d6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:19.009522 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0da95206-d2de-47cd-b984-586a00043dd0 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] 10.222.0.20 "GET /compute/v2.1/servers/0c726bb2-8fea-4b2d-9e57-a585032c3155" status: 200 len: 1506 microversion: 2.1 time: 0.207147 Oct 27 03:32:19.010372 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1326/2834] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:18 2022] GET /compute/v2.1/servers/0c726bb2-8fea-4b2d-9e57-a585032c3155 => generated 1506 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:19.082810 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1602cefe-3c1e-44b5-b0ee-1b7a4388d209 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:19.082810 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1602cefe-3c1e-44b5-b0ee-1b7a4388d209 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:19.085113 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1602cefe-3c1e-44b5-b0ee-1b7a4388d209 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:19.085606 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1602cefe-3c1e-44b5-b0ee-1b7a4388d209 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:19.086416 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1602cefe-3c1e-44b5-b0ee-1b7a4388d209 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:19.086787 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1602cefe-3c1e-44b5-b0ee-1b7a4388d209 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:19.087251 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1602cefe-3c1e-44b5-b0ee-1b7a4388d209 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:19.087679 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1602cefe-3c1e-44b5-b0ee-1b7a4388d209 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:19.238725 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1602cefe-3c1e-44b5-b0ee-1b7a4388d209 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:19.247862 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1602cefe-3c1e-44b5-b0ee-1b7a4388d209 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1682 microversion: 2.1 time: 0.173744 Oct 27 03:32:19.248458 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1327/2835] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:19 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1682 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:32:19.831880 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-83426fbc-93aa-4a73-a50a-2547783f145c tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:19.832808 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-83426fbc-93aa-4a73-a50a-2547783f145c tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] [instance: f3d23d8e-a80a-425c-a0a3-9e448853a94b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:19.873371 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-83426fbc-93aa-4a73-a50a-2547783f145c tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:19.877865 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-83426fbc-93aa-4a73-a50a-2547783f145c tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:19.877865 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-83426fbc-93aa-4a73-a50a-2547783f145c tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:19.878442 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-83426fbc-93aa-4a73-a50a-2547783f145c tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:19.879451 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-83426fbc-93aa-4a73-a50a-2547783f145c tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:19.880440 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-83426fbc-93aa-4a73-a50a-2547783f145c tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:20.715307 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-83426fbc-93aa-4a73-a50a-2547783f145c tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed44bf20b3464a53a3e3f6c9cd61cde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ee48e200624711b629a12b20c7d282', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:20.735157 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-83426fbc-93aa-4a73-a50a-2547783f145c tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d23d8e-a80a-425c-a0a3-9e448853a94b" status: 200 len: 1370 microversion: 2.1 time: 0.909057 Oct 27 03:32:20.741450 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1328/2836] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:19 2022] GET /compute/v2.1/servers/f3d23d8e-a80a-425c-a0a3-9e448853a94b => generated 1370 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:20.746508 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ca71f0b8-482b-4b00-bace-379032ec2250 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:20.747140 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ca71f0b8-482b-4b00-bace-379032ec2250 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] [instance: 0c726bb2-8fea-4b2d-9e57-a585032c3155] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:20.782252 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ca71f0b8-482b-4b00-bace-379032ec2250 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:20.785056 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ca71f0b8-482b-4b00-bace-379032ec2250 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:20.785615 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ca71f0b8-482b-4b00-bace-379032ec2250 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:20.786851 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ca71f0b8-482b-4b00-bace-379032ec2250 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:20.787343 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ca71f0b8-482b-4b00-bace-379032ec2250 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:20.787776 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ca71f0b8-482b-4b00-bace-379032ec2250 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:22.008300 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ca71f0b8-482b-4b00-bace-379032ec2250 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533917bc5aa4e23802a43b1eb534bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d87abf835a4104b40056b9eec2d6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:22.019916 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ca71f0b8-482b-4b00-bace-379032ec2250 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] 10.222.0.20 "GET /compute/v2.1/servers/0c726bb2-8fea-4b2d-9e57-a585032c3155" status: 200 len: 1506 microversion: 2.1 time: 1.277091 Oct 27 03:32:22.032188 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1329/2837] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:20 2022] GET /compute/v2.1/servers/0c726bb2-8fea-4b2d-9e57-a585032c3155 => generated 1506 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:22.040475 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5d30f7d1-639c-42bc-975c-4e724e57cfe8 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:22.041111 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5d30f7d1-639c-42bc-975c-4e724e57cfe8 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:22.066955 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5d30f7d1-639c-42bc-975c-4e724e57cfe8 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:22.067520 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5d30f7d1-639c-42bc-975c-4e724e57cfe8 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:22.068068 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5d30f7d1-639c-42bc-975c-4e724e57cfe8 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:22.068838 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5d30f7d1-639c-42bc-975c-4e724e57cfe8 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:22.069280 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5d30f7d1-639c-42bc-975c-4e724e57cfe8 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:22.075218 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5d30f7d1-639c-42bc-975c-4e724e57cfe8 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:22.728621 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5d30f7d1-639c-42bc-975c-4e724e57cfe8 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:22.739769 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5d30f7d1-639c-42bc-975c-4e724e57cfe8 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1682 microversion: 2.1 time: 0.706128 Oct 27 03:32:22.743406 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1330/2838] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:22 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1682 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:22.753578 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ac43f79b-5015-42f5-b7b2-bb5ee58a4079 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:22.766652 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ac43f79b-5015-42f5-b7b2-bb5ee58a4079 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] [instance: f3d23d8e-a80a-425c-a0a3-9e448853a94b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:22.786531 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ac43f79b-5015-42f5-b7b2-bb5ee58a4079 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:22.787267 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ac43f79b-5015-42f5-b7b2-bb5ee58a4079 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:22.787872 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ac43f79b-5015-42f5-b7b2-bb5ee58a4079 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:22.788804 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ac43f79b-5015-42f5-b7b2-bb5ee58a4079 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:22.789451 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ac43f79b-5015-42f5-b7b2-bb5ee58a4079 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:22.790062 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ac43f79b-5015-42f5-b7b2-bb5ee58a4079 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:23.157517 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ac43f79b-5015-42f5-b7b2-bb5ee58a4079 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed44bf20b3464a53a3e3f6c9cd61cde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ee48e200624711b629a12b20c7d282', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:23.172280 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ac43f79b-5015-42f5-b7b2-bb5ee58a4079 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d23d8e-a80a-425c-a0a3-9e448853a94b" status: 200 len: 1370 microversion: 2.1 time: 0.427430 Oct 27 03:32:23.199295 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1331/2839] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:22 2022] GET /compute/v2.1/servers/f3d23d8e-a80a-425c-a0a3-9e448853a94b => generated 1370 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:23.213957 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-bf96db15-bb3e-4fdc-847a-2a2f7df44ef6 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:23.214627 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-bf96db15-bb3e-4fdc-847a-2a2f7df44ef6 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] [instance: 0c726bb2-8fea-4b2d-9e57-a585032c3155] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:23.233798 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bf96db15-bb3e-4fdc-847a-2a2f7df44ef6 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:23.236546 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bf96db15-bb3e-4fdc-847a-2a2f7df44ef6 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:23.237167 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bf96db15-bb3e-4fdc-847a-2a2f7df44ef6 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:23.238126 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bf96db15-bb3e-4fdc-847a-2a2f7df44ef6 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:23.238606 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bf96db15-bb3e-4fdc-847a-2a2f7df44ef6 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:23.239057 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bf96db15-bb3e-4fdc-847a-2a2f7df44ef6 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:24.016784 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-bf96db15-bb3e-4fdc-847a-2a2f7df44ef6 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533917bc5aa4e23802a43b1eb534bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d87abf835a4104b40056b9eec2d6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:24.040599 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-bf96db15-bb3e-4fdc-847a-2a2f7df44ef6 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] 10.222.0.20 "GET /compute/v2.1/servers/0c726bb2-8fea-4b2d-9e57-a585032c3155" status: 200 len: 1506 microversion: 2.1 time: 0.838238 Oct 27 03:32:24.043247 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1332/2840] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:23 2022] GET /compute/v2.1/servers/0c726bb2-8fea-4b2d-9e57-a585032c3155 => generated 1506 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:24.084845 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5b4daa6e-c5d5-489f-9531-0fda999860de tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:24.091112 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5b4daa6e-c5d5-489f-9531-0fda999860de tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:24.114679 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5b4daa6e-c5d5-489f-9531-0fda999860de tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:24.115193 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5b4daa6e-c5d5-489f-9531-0fda999860de tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:24.115891 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5b4daa6e-c5d5-489f-9531-0fda999860de tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:24.116859 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5b4daa6e-c5d5-489f-9531-0fda999860de tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:24.117330 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5b4daa6e-c5d5-489f-9531-0fda999860de tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:24.117769 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5b4daa6e-c5d5-489f-9531-0fda999860de tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:24.763887 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5b4daa6e-c5d5-489f-9531-0fda999860de tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:24.780307 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5b4daa6e-c5d5-489f-9531-0fda999860de tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1682 microversion: 2.1 time: 0.715705 Oct 27 03:32:24.781422 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1333/2841] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:24 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1682 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:24.787425 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-853e5413-27eb-4154-afbd-2d585435e6d3 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:24.799573 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-853e5413-27eb-4154-afbd-2d585435e6d3 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] [instance: f3d23d8e-a80a-425c-a0a3-9e448853a94b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:24.819087 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-853e5413-27eb-4154-afbd-2d585435e6d3 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:24.826960 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-853e5413-27eb-4154-afbd-2d585435e6d3 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:24.826960 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-853e5413-27eb-4154-afbd-2d585435e6d3 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:24.827850 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-853e5413-27eb-4154-afbd-2d585435e6d3 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:24.828472 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-853e5413-27eb-4154-afbd-2d585435e6d3 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:24.829166 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-853e5413-27eb-4154-afbd-2d585435e6d3 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:25.279226 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-853e5413-27eb-4154-afbd-2d585435e6d3 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed44bf20b3464a53a3e3f6c9cd61cde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ee48e200624711b629a12b20c7d282', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:25.292944 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-853e5413-27eb-4154-afbd-2d585435e6d3 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d23d8e-a80a-425c-a0a3-9e448853a94b" status: 200 len: 1370 microversion: 2.1 time: 0.510000 Oct 27 03:32:25.293576 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1334/2842] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:24 2022] GET /compute/v2.1/servers/f3d23d8e-a80a-425c-a0a3-9e448853a94b => generated 1370 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:25.328844 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9d3c37fc-8f7f-4693-bffa-ad9c1f7b8a32 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:25.329529 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9d3c37fc-8f7f-4693-bffa-ad9c1f7b8a32 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] [instance: 0c726bb2-8fea-4b2d-9e57-a585032c3155] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:25.336301 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9d3c37fc-8f7f-4693-bffa-ad9c1f7b8a32 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:25.337035 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9d3c37fc-8f7f-4693-bffa-ad9c1f7b8a32 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:25.347444 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9d3c37fc-8f7f-4693-bffa-ad9c1f7b8a32 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:25.348622 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9d3c37fc-8f7f-4693-bffa-ad9c1f7b8a32 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:25.349301 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9d3c37fc-8f7f-4693-bffa-ad9c1f7b8a32 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:25.349929 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9d3c37fc-8f7f-4693-bffa-ad9c1f7b8a32 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:26.041449 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9d3c37fc-8f7f-4693-bffa-ad9c1f7b8a32 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533917bc5aa4e23802a43b1eb534bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d87abf835a4104b40056b9eec2d6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:26.057149 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9d3c37fc-8f7f-4693-bffa-ad9c1f7b8a32 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] 10.222.0.20 "GET /compute/v2.1/servers/0c726bb2-8fea-4b2d-9e57-a585032c3155" status: 200 len: 1506 microversion: 2.1 time: 0.749558 Oct 27 03:32:26.057951 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1335/2843] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:25 2022] GET /compute/v2.1/servers/0c726bb2-8fea-4b2d-9e57-a585032c3155 => generated 1506 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:26.080613 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-723dfb92-fc0d-420c-af02-a9030d5a0de3 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:26.090022 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-723dfb92-fc0d-420c-af02-a9030d5a0de3 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:26.112953 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-723dfb92-fc0d-420c-af02-a9030d5a0de3 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:26.118280 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-723dfb92-fc0d-420c-af02-a9030d5a0de3 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:26.121396 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-723dfb92-fc0d-420c-af02-a9030d5a0de3 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:26.122210 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-723dfb92-fc0d-420c-af02-a9030d5a0de3 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:26.122695 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-723dfb92-fc0d-420c-af02-a9030d5a0de3 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:26.123132 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-723dfb92-fc0d-420c-af02-a9030d5a0de3 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:26.156044 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=35 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:32:26.664911 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=99 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:32:27.098976 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-723dfb92-fc0d-420c-af02-a9030d5a0de3 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:27.115891 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-723dfb92-fc0d-420c-af02-a9030d5a0de3 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1682 microversion: 2.1 time: 1.046685 Oct 27 03:32:27.117594 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1336/2844] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:26 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1682 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:27.122434 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-de8a2c02-2a69-40df-8019-8a926bc694f0 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:27.128310 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-de8a2c02-2a69-40df-8019-8a926bc694f0 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] [instance: f3d23d8e-a80a-425c-a0a3-9e448853a94b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:27.162198 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-de8a2c02-2a69-40df-8019-8a926bc694f0 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:27.162949 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-de8a2c02-2a69-40df-8019-8a926bc694f0 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:27.163572 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-de8a2c02-2a69-40df-8019-8a926bc694f0 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:27.165140 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-de8a2c02-2a69-40df-8019-8a926bc694f0 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:27.166448 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-de8a2c02-2a69-40df-8019-8a926bc694f0 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:27.167062 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-de8a2c02-2a69-40df-8019-8a926bc694f0 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:27.847482 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-de8a2c02-2a69-40df-8019-8a926bc694f0 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed44bf20b3464a53a3e3f6c9cd61cde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ee48e200624711b629a12b20c7d282', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:27.856741 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-de8a2c02-2a69-40df-8019-8a926bc694f0 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d23d8e-a80a-425c-a0a3-9e448853a94b" status: 200 len: 1370 microversion: 2.1 time: 0.737937 Oct 27 03:32:27.889337 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1337/2845] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:27 2022] GET /compute/v2.1/servers/f3d23d8e-a80a-425c-a0a3-9e448853a94b => generated 1370 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:27.897900 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2f4c1abb-75da-445d-9152-c1853efff70e tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:27.899421 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-2f4c1abb-75da-445d-9152-c1853efff70e tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] [instance: 0c726bb2-8fea-4b2d-9e57-a585032c3155] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:27.917690 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2f4c1abb-75da-445d-9152-c1853efff70e tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:27.918953 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2f4c1abb-75da-445d-9152-c1853efff70e tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:27.921039 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2f4c1abb-75da-445d-9152-c1853efff70e tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:27.929383 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2f4c1abb-75da-445d-9152-c1853efff70e tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:27.930616 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2f4c1abb-75da-445d-9152-c1853efff70e tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:27.932746 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2f4c1abb-75da-445d-9152-c1853efff70e tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:28.366814 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2f4c1abb-75da-445d-9152-c1853efff70e tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533917bc5aa4e23802a43b1eb534bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d87abf835a4104b40056b9eec2d6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:28.398947 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9221852a-327a-492c-b1c3-1854b9a60d7e tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] 10.222.0.20 "GET /compute/v2.1/images/d74029bb-b8f5-4730-a824-852c528f0876" status: 200 len: 1437 microversion: 2.1 time: 11.723138 Oct 27 03:32:28.403730 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1509/2846] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:32:16 2022] GET /compute/v2.1/images/d74029bb-b8f5-4730-a824-852c528f0876 => generated 1437 bytes in 11726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:28.403878 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2f4c1abb-75da-445d-9152-c1853efff70e tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] 10.222.0.20 "GET /compute/v2.1/servers/0c726bb2-8fea-4b2d-9e57-a585032c3155" status: 200 len: 1486 microversion: 2.1 time: 0.509298 Oct 27 03:32:28.403878 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1338/2847] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:27 2022] GET /compute/v2.1/servers/0c726bb2-8fea-4b2d-9e57-a585032c3155 => generated 1486 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:28.430289 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-92de38f7-b2cc-4fac-b1c2-1f9e2e0aa981 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:28.432182 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-92de38f7-b2cc-4fac-b1c2-1f9e2e0aa981 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] [instance: b0c6560f-ade1-4ae6-905e-ad488f4c3b51] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:28.444144 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b2c7144f-2692-4bcd-9cc7-0a3b5f25430b tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:28.444144 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b2c7144f-2692-4bcd-9cc7-0a3b5f25430b tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:28.457385 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-92de38f7-b2cc-4fac-b1c2-1f9e2e0aa981 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:28.458803 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-92de38f7-b2cc-4fac-b1c2-1f9e2e0aa981 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:28.468874 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-92de38f7-b2cc-4fac-b1c2-1f9e2e0aa981 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:28.489994 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b2c7144f-2692-4bcd-9cc7-0a3b5f25430b tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:28.500915 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-92de38f7-b2cc-4fac-b1c2-1f9e2e0aa981 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:28.502600 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b2c7144f-2692-4bcd-9cc7-0a3b5f25430b tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:28.504709 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b2c7144f-2692-4bcd-9cc7-0a3b5f25430b tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:28.510795 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-92de38f7-b2cc-4fac-b1c2-1f9e2e0aa981 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:28.511009 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b2c7144f-2692-4bcd-9cc7-0a3b5f25430b tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:28.513894 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-92de38f7-b2cc-4fac-b1c2-1f9e2e0aa981 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:28.514087 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b2c7144f-2692-4bcd-9cc7-0a3b5f25430b tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:28.516337 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b2c7144f-2692-4bcd-9cc7-0a3b5f25430b tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:28.567086 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=100 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:32:29.053199 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-92de38f7-b2cc-4fac-b1c2-1f9e2e0aa981 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cd1938c86a4f389a2ec0fba9beff36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd0392257a0419dbfa569c8816ece2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:29.069406 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-92de38f7-b2cc-4fac-b1c2-1f9e2e0aa981 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] 10.222.0.20 "GET /compute/v2.1/servers/b0c6560f-ade1-4ae6-905e-ad488f4c3b51" status: 200 len: 1479 microversion: 2.1 time: 0.658017 Oct 27 03:32:29.072317 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1339/2848] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:28 2022] GET /compute/v2.1/servers/b0c6560f-ade1-4ae6-905e-ad488f4c3b51 => generated 1479 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:29.105004 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c1bda658-3efd-4617-8c5b-4ca87ea7396e tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1210232502", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:32:29.367590 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b2c7144f-2692-4bcd-9cc7-0a3b5f25430b tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:29.383098 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b2c7144f-2692-4bcd-9cc7-0a3b5f25430b tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1682 microversion: 2.1 time: 0.981402 Oct 27 03:32:29.398219 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1510/2849] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:28 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1682 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:29.412634 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ac82245e-7acf-42ba-9c0b-bb9fbf0178e7 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:29.418072 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ac82245e-7acf-42ba-9c0b-bb9fbf0178e7 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] [instance: f3d23d8e-a80a-425c-a0a3-9e448853a94b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:29.436485 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ac82245e-7acf-42ba-9c0b-bb9fbf0178e7 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:29.437052 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ac82245e-7acf-42ba-9c0b-bb9fbf0178e7 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:29.437603 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ac82245e-7acf-42ba-9c0b-bb9fbf0178e7 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:29.438789 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ac82245e-7acf-42ba-9c0b-bb9fbf0178e7 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:29.440677 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ac82245e-7acf-42ba-9c0b-bb9fbf0178e7 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:29.442015 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ac82245e-7acf-42ba-9c0b-bb9fbf0178e7 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:30.005802 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ac82245e-7acf-42ba-9c0b-bb9fbf0178e7 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed44bf20b3464a53a3e3f6c9cd61cde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ee48e200624711b629a12b20c7d282', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:30.019635 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ac82245e-7acf-42ba-9c0b-bb9fbf0178e7 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d23d8e-a80a-425c-a0a3-9e448853a94b" status: 200 len: 1370 microversion: 2.1 time: 0.616707 Oct 27 03:32:30.021306 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1511/2850] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:29 2022] GET /compute/v2.1/servers/f3d23d8e-a80a-425c-a0a3-9e448853a94b => generated 1370 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:30.096751 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d94f0644-ca94-4829-aa4e-5d4a4543141c tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:30.096751 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d94f0644-ca94-4829-aa4e-5d4a4543141c tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] [instance: b0c6560f-ade1-4ae6-905e-ad488f4c3b51] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:30.107624 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d94f0644-ca94-4829-aa4e-5d4a4543141c tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:30.108143 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d94f0644-ca94-4829-aa4e-5d4a4543141c tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:30.108591 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d94f0644-ca94-4829-aa4e-5d4a4543141c tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:30.109584 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d94f0644-ca94-4829-aa4e-5d4a4543141c tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:30.129565 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d94f0644-ca94-4829-aa4e-5d4a4543141c tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:30.130533 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d94f0644-ca94-4829-aa4e-5d4a4543141c tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:30.887427 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d94f0644-ca94-4829-aa4e-5d4a4543141c tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cd1938c86a4f389a2ec0fba9beff36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd0392257a0419dbfa569c8816ece2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:30.903211 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d94f0644-ca94-4829-aa4e-5d4a4543141c tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] 10.222.0.20 "GET /compute/v2.1/servers/b0c6560f-ade1-4ae6-905e-ad488f4c3b51" status: 200 len: 1466 microversion: 2.1 time: 0.813878 Oct 27 03:32:30.934280 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1512/2851] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:30 2022] GET /compute/v2.1/servers/b0c6560f-ade1-4ae6-905e-ad488f4c3b51 => generated 1466 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:30.953358 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d617746c-9cda-498a-ae57-d6753ea49090 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:30.954002 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d617746c-9cda-498a-ae57-d6753ea49090 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:30.979671 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d617746c-9cda-498a-ae57-d6753ea49090 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:30.980178 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d617746c-9cda-498a-ae57-d6753ea49090 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:30.980647 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d617746c-9cda-498a-ae57-d6753ea49090 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:30.992291 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d617746c-9cda-498a-ae57-d6753ea49090 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:30.992835 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d617746c-9cda-498a-ae57-d6753ea49090 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:30.993298 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d617746c-9cda-498a-ae57-d6753ea49090 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:31.503069 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d617746c-9cda-498a-ae57-d6753ea49090 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:31.510760 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d617746c-9cda-498a-ae57-d6753ea49090 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1669 microversion: 2.1 time: 0.575269 Oct 27 03:32:31.522461 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1513/2852] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:30 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1669 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:31.527504 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-463d43e4-f268-486a-8746-f400881182e2 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Calling method '.version_select at 0x7f7dda5860d0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:34.964909 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-c1bda658-3efd-4617-8c5b-4ca87ea7396e tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] validate_networks() for [('e0ec55c0-c84d-4137-b98d-abccae35dfd4', None, None, None, None, None)] {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:32:35.505523 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-463d43e4-f268-486a-8746-f400881182e2 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] 10.222.0.20 "DELETE /compute/v2.1/images/d74029bb-b8f5-4730-a824-852c528f0876" status: 204 len: 0 microversion: 2.1 time: 3.981768 Oct 27 03:32:35.506123 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1514/2853] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:31 2022] DELETE /compute/v2.1/images/d74029bb-b8f5-4730-a824-852c528f0876 => generated 0 bytes in 3983 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:32:35.511025 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-82966e23-b72c-42e3-b7ee-97df11199d85 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:35.511650 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-82966e23-b72c-42e3-b7ee-97df11199d85 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] [instance: f3d23d8e-a80a-425c-a0a3-9e448853a94b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:35.531085 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-82966e23-b72c-42e3-b7ee-97df11199d85 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:35.537083 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-82966e23-b72c-42e3-b7ee-97df11199d85 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:35.537566 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-82966e23-b72c-42e3-b7ee-97df11199d85 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:35.540523 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-82966e23-b72c-42e3-b7ee-97df11199d85 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:35.541272 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-82966e23-b72c-42e3-b7ee-97df11199d85 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:35.541889 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-82966e23-b72c-42e3-b7ee-97df11199d85 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:35.610585 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-c1bda658-3efd-4617-8c5b-4ca87ea7396e tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:32:35.611635 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-c1bda658-3efd-4617-8c5b-4ca87ea7396e tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:32:35.612119 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-c1bda658-3efd-4617-8c5b-4ca87ea7396e tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:32:35.612534 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-c1bda658-3efd-4617-8c5b-4ca87ea7396e tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:32:35.612950 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-c1bda658-3efd-4617-8c5b-4ca87ea7396e tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:32:35.632977 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c1bda658-3efd-4617-8c5b-4ca87ea7396e tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:35.638187 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c1bda658-3efd-4617-8c5b-4ca87ea7396e tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:35.638690 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c1bda658-3efd-4617-8c5b-4ca87ea7396e tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:35.639590 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c1bda658-3efd-4617-8c5b-4ca87ea7396e tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:35.640627 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c1bda658-3efd-4617-8c5b-4ca87ea7396e tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:35.641240 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c1bda658-3efd-4617-8c5b-4ca87ea7396e tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:35.680287 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-c1bda658-3efd-4617-8c5b-4ca87ea7396e tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Getting quotas for project 20d87abf835a4104b40056b9eec2d6b6. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:32:35.688872 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-c1bda658-3efd-4617-8c5b-4ca87ea7396e tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Getting quotas for user 0533917bc5aa4e23802a43b1eb534bd0 and project 20d87abf835a4104b40056b9eec2d6b6. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:32:35.716631 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c1bda658-3efd-4617-8c5b-4ca87ea7396e tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:32:35.719948 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c1bda658-3efd-4617-8c5b-4ca87ea7396e tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] [instance: 2e1b6a2e-8acc-4c77-b551-4a623893ebaf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:32:35.925287 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-82966e23-b72c-42e3-b7ee-97df11199d85 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed44bf20b3464a53a3e3f6c9cd61cde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ee48e200624711b629a12b20c7d282', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:35.936246 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-82966e23-b72c-42e3-b7ee-97df11199d85 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d23d8e-a80a-425c-a0a3-9e448853a94b" status: 200 len: 1370 microversion: 2.1 time: 0.429032 Oct 27 03:32:35.958585 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1515/2854] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:35 2022] GET /compute/v2.1/servers/f3d23d8e-a80a-425c-a0a3-9e448853a94b => generated 1370 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:35.958585 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-00e8efe5-43a6-4ed9-99f7-d84f36865429 req-fb0cb8fe-95f5-465b-ac71-4926f26d4fe8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0c6560f-ade1-4ae6-905e-ad488f4c3b51", "name": "network-vif-unplugged", "status": "completed", "tag": "374bf7dd-46fc-42a5-a069-b8b5708a33a0"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:32:35.959282 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-00e8efe5-43a6-4ed9-99f7-d84f36865429 req-fb0cb8fe-95f5-465b-ac71-4926f26d4fe8 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:35.959549 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-00e8efe5-43a6-4ed9-99f7-d84f36865429 req-fb0cb8fe-95f5-465b-ac71-4926f26d4fe8 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:35.960001 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-00e8efe5-43a6-4ed9-99f7-d84f36865429 req-fb0cb8fe-95f5-465b-ac71-4926f26d4fe8 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:35.973724 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c1bda658-3efd-4617-8c5b-4ca87ea7396e tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 6.900465 Oct 27 03:32:35.980374 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-00e8efe5-43a6-4ed9-99f7-d84f36865429 req-fb0cb8fe-95f5-465b-ac71-4926f26d4fe8 service nova] Creating event network-vif-unplugged:374bf7dd-46fc-42a5-a069-b8b5708a33a0 for instance b0c6560f-ade1-4ae6-905e-ad488f4c3b51 on n-h2-862769-1 Oct 27 03:32:35.983495 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1340/2855] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:32:29 2022] POST /compute/v2.1/servers => generated 383 bytes in 6911 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 03:32:35.995449 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-00e8efe5-43a6-4ed9-99f7-d84f36865429 req-fb0cb8fe-95f5-465b-ac71-4926f26d4fe8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050443 Oct 27 03:32:36.001246 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1516/2856] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:32:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:32:36.214370 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9d460441-4605-4ae1-adb7-e5cd2abb518b tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-396066129", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": [{"uuid": "f7118995-d5b5-4e8a-ac91-af3c690d2d89"}]}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:32:36.266601 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e56e2a8a-473f-4133-a3ef-74249758edd9 tempest-FloatingIPDetailsNegativeTestJSON-374632067 tempest-FloatingIPDetailsNegativeTestJSON-374632067-project] Calling method '.version_select at 0x7f7dd9e9aee0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:36.306856 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-9d460441-4605-4ae1-adb7-e5cd2abb518b tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] validate_networks() for [('f7118995-d5b5-4e8a-ac91-af3c690d2d89', None, None, None, None, None)] {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:32:36.336480 n-d-862769-1 devstack@n-api.service[121001]: DEBUG neutronclient.v2_0.client [None req-e56e2a8a-473f-4133-a3ef-74249758edd9 tempest-FloatingIPDetailsNegativeTestJSON-374632067 tempest-FloatingIPDetailsNegativeTestJSON-374632067-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 8b104d54-0d11-463e-bb81-bb96e535e919 could not be found", "detail": ""}} {{(pid=121001) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 03:32:36.337195 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-e56e2a8a-473f-4133-a3ef-74249758edd9 tempest-FloatingIPDetailsNegativeTestJSON-374632067 tempest-FloatingIPDetailsNegativeTestJSON-374632067-project] HTTP exception thrown: Floating IP not found for ID 8b104d54-0d11-463e-bb81-bb96e535e919 Oct 27 03:32:36.340229 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e56e2a8a-473f-4133-a3ef-74249758edd9 tempest-FloatingIPDetailsNegativeTestJSON-374632067 tempest-FloatingIPDetailsNegativeTestJSON-374632067-project] Request method failure captured: Oct 27 03:32:36.340229 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/os-floating-ips/8b104d54-0d11-463e-bb81-bb96e535e919 HTTP/1.1 Oct 27 03:32:36.340229 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:32:36.340229 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:32:36.340229 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:32:36.340229 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:32:36.340229 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:32:36.340229 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:32:36.340229 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:32:36.340229 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:32:36.340229 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfvQ4IVI8Ldb3KnPGDizk5ZqvWsXuBA-QfFiBc5qhjeT3hpG8zq6HpXLEqBxskBfTQ7BlQBm3kRG_RaLoIqzBdH4QFsthZ9FTnqWqyNDKH0UHxIPdclvs9HauXQAeHrvEgFKiTdnsw_MRjqt1nCleMJt6o88tqfRwBVsWFHlQ6Pj3MI Oct 27 03:32:36.340229 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:32:36.340229 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:32:36.340229 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:32:36.340229 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:32:36.340229 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:32:36.340229 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:32:36.340229 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: f710dd9fc15b46578dd67cdfb4bb121e Oct 27 03:32:36.340229 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-374632067 Oct 27 03:32:36.340229 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:32:36.340229 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:32:36.340229 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f710dd9fc15b46578dd67cdfb4bb121e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f710dd9fc15b46578dd67cdfb4bb121e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f710dd9fc15b46578dd67cdfb4bb121e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f710dd9fc15b46578dd67cdfb4bb121e"}]}] Oct 27 03:32:36.340229 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-374632067 Oct 27 03:32:36.340229 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: f710dd9fc15b46578dd67cdfb4bb121e Oct 27 03:32:36.340229 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-374632067 Oct 27 03:32:36.340229 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-374632067-project Oct 27 03:32:36.340229 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:32:36.340229 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:32:36.340229 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 90cf87b409a94da385c0dc9b39884665 Oct 27 03:32:36.340229 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-374632067-project Oct 27 03:32:36.340229 n-d-862769-1 devstack@n-api.service[121001]: method: Oct 27 03:32:36.340229 n-d-862769-1 devstack@n-api.service[121001]: exception: Floating IP not found for ID 8b104d54-0d11-463e-bb81-bb96e535e919 Oct 27 03:32:36.340229 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '8b104d54-0d11-463e-bb81-bb96e535e919'} Oct 27 03:32:36.340229 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:32:36.340229 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:32:36.340229 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 27 03:32:36.340229 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 27 03:32:36.340229 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:32:36.340229 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:32:36.340229 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 27 03:32:36.340229 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 27 03:32:36.340229 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:32:36.340229 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:32:36.340229 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 27 03:32:36.340229 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 27 03:32:36.340229 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:32:36.340229 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:32:36.340229 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 03:32:36.340229 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 03:32:36.340229 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:32:36.340229 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:32:36.340229 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 03:32:36.340229 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 03:32:36.340229 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:32:36.340229 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:32:36.340229 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 03:32:36.340229 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 03:32:36.340229 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 03:32:36.340229 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 03:32:36.340229 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 8b104d54-0d11-463e-bb81-bb96e535e919 could not be found Oct 27 03:32:36.340229 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2eb79ae9-b4a8-47d5-872b-01100897b936'] Oct 27 03:32:36.344130 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:32:36.344130 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:32:36.344130 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:32:36.344130 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:32:36.344130 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 27 03:32:36.344130 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 27 03:32:36.344130 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 27 03:32:36.344130 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 27 03:32:36.344130 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 8b104d54-0d11-463e-bb81-bb96e535e919. Oct 27 03:32:36.344130 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:32:36.344130 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:32:36.344130 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:32:36.344130 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:32:36.344130 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:32:36.344130 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:32:36.344130 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:32:36.344130 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:32:36.344130 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:32:36.344130 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:32:36.344130 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:32:36.344130 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:32:36.344130 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 27 03:32:36.344130 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 27 03:32:36.344130 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 8b104d54-0d11-463e-bb81-bb96e535e919 Oct 27 03:32:36.344130 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:32:36.344130 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:32:36.344130 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:32:36.344130 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:32:36.344130 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:32:36.344130 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:32:36.344130 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:32:36.344130 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:32:36.344130 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 8b104d54-0d11-463e-bb81-bb96e535e919 Oct 27 03:32:36.344130 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:32:36.344130 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e56e2a8a-473f-4133-a3ef-74249758edd9 tempest-FloatingIPDetailsNegativeTestJSON-374632067 tempest-FloatingIPDetailsNegativeTestJSON-374632067-project] Returning 404 to user: Floating IP not found for ID 8b104d54-0d11-463e-bb81-bb96e535e919 {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:32:36.344130 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e56e2a8a-473f-4133-a3ef-74249758edd9 tempest-FloatingIPDetailsNegativeTestJSON-374632067 tempest-FloatingIPDetailsNegativeTestJSON-374632067-project] 10.222.0.20 "GET /compute/v2.1/os-floating-ips/8b104d54-0d11-463e-bb81-bb96e535e919" status: 404 len: 111 microversion: 2.1 time: 0.342088 Oct 27 03:32:36.347716 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1517/2857] 10.222.0.20 () {58 vars in 1260 bytes} [Thu Oct 27 03:32:35 2022] GET /compute/v2.1/os-floating-ips/8b104d54-0d11-463e-bb81-bb96e535e919 => generated 111 bytes in 349 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:32:36.351694 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3b472aa1-49de-4973-939d-9c31a9238d05 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:36.352443 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3b472aa1-49de-4973-939d-9c31a9238d05 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:36.379843 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3b472aa1-49de-4973-939d-9c31a9238d05 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:36.380360 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3b472aa1-49de-4973-939d-9c31a9238d05 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:36.380814 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3b472aa1-49de-4973-939d-9c31a9238d05 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:36.381552 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3b472aa1-49de-4973-939d-9c31a9238d05 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:36.382024 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3b472aa1-49de-4973-939d-9c31a9238d05 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:36.382560 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3b472aa1-49de-4973-939d-9c31a9238d05 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:36.825582 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3b472aa1-49de-4973-939d-9c31a9238d05 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:36.839212 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3b472aa1-49de-4973-939d-9c31a9238d05 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1669 microversion: 2.1 time: 0.490667 Oct 27 03:32:36.839815 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1518/2858] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:36 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1669 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:36.857371 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0a3691cf-13f9-47ab-952f-48e1306e7922 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Calling method '.version_select at 0x7f7dded2c790>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:36.895045 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-0a3691cf-13f9-47ab-952f-48e1306e7922 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] HTTP exception thrown: Image not found. Oct 27 03:32:36.900604 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0a3691cf-13f9-47ab-952f-48e1306e7922 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Request method failure captured: Oct 27 03:32:36.900604 n-d-862769-1 devstack@n-api.service[121001]: request: DELETE /compute/v2.1/images/1a2e38d2-514f-48c2-b314-d5c9f52051f1 HTTP/1.1 Oct 27 03:32:36.900604 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:32:36.900604 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:32:36.900604 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:32:36.900604 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:32:36.900604 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:32:36.900604 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:32:36.900604 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:32:36.900604 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:32:36.900604 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWftOev-xo07r_KXTI-kaMtPTG2vIw_t-RbHr-Jab33WZMwPajQzQaTrATg5SuBKvzsta_WG55w1J4TRjaaH5s7iZZ99eq9w8fDBVbUlrwYcAdtZSzY1_1zS-dCpbmif-sfCsz4n8YukWQdgPj7GzIplE7tljIccMw4AXx27syA13xc4 Oct 27 03:32:36.900604 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:32:36.900604 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:32:36.900604 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:32:36.900604 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:32:36.900604 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:32:36.900604 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:32:36.900604 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: ccd0392257a0419dbfa569c8816ece2b Oct 27 03:32:36.900604 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ImagesOneServerTestJSON-1466754268 Oct 27 03:32:36.900604 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:32:36.900604 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:32:36.900604 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ccd0392257a0419dbfa569c8816ece2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ccd0392257a0419dbfa569c8816ece2b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ccd0392257a0419dbfa569c8816ece2b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ccd0392257a0419dbfa569c8816ece2b"}]}] Oct 27 03:32:36.900604 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ImagesOneServerTestJSON-1466754268 Oct 27 03:32:36.900604 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: ccd0392257a0419dbfa569c8816ece2b Oct 27 03:32:36.900604 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1466754268 Oct 27 03:32:36.900604 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ImagesOneServerTestJSON-1466754268-project Oct 27 03:32:36.900604 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:32:36.900604 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:32:36.900604 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 42cd1938c86a4f389a2ec0fba9beff36 Oct 27 03:32:36.900604 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ImagesOneServerTestJSON-1466754268-project Oct 27 03:32:36.900604 n-d-862769-1 devstack@n-api.service[121001]: method: Oct 27 03:32:36.900604 n-d-862769-1 devstack@n-api.service[121001]: exception: Image not found. Oct 27 03:32:36.900604 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '1a2e38d2-514f-48c2-b314-d5c9f52051f1'} Oct 27 03:32:36.900604 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:32:36.900604 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:32:36.900604 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 27 03:32:36.900604 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 27 03:32:36.900604 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 03:32:36.900604 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 03:32:36.900604 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 03:32:36.900604 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 03:32:36.900604 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 27 03:32:36.900604 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 27 03:32:36.900604 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 27 03:32:36.900604 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 27 03:32:36.900604 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 03:32:36.900604 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 03:32:36.900604 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 03:32:36.900604 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 03:32:36.900604 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 1a2e38d2-514f-48c2-b314-d5c9f52051f1 to delete Oct 27 03:32:36.900604 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:32:36.900604 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:32:36.900604 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:32:36.900604 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:32:36.900604 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 27 03:32:36.900604 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 27 03:32:36.900604 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 27 03:32:36.900604 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 27 03:32:36.900604 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 27 03:32:36.900604 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 27 03:32:36.900604 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1a2e38d2-514f-48c2-b314-d5c9f52051f1 could not be found. Oct 27 03:32:36.900604 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:32:36.900604 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:32:36.900604 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:32:36.900604 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:32:36.904798 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:32:36.904798 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:32:36.904798 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:32:36.904798 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:32:36.904798 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:32:36.904798 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:32:36.904798 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:32:36.904798 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:32:36.904798 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 27 03:32:36.904798 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 27 03:32:36.904798 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 27 03:32:36.904798 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:32:36.904798 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:32:36.904798 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:32:36.904798 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:32:36.904798 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:32:36.904798 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:32:36.904798 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:32:36.904798 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:32:36.904798 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 27 03:32:36.904798 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:32:36.904798 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0a3691cf-13f9-47ab-952f-48e1306e7922 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Returning 404 to user: Image not found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:32:36.906285 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0a3691cf-13f9-47ab-952f-48e1306e7922 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] 10.222.0.20 "DELETE /compute/v2.1/images/1a2e38d2-514f-48c2-b314-d5c9f52051f1" status: 404 len: 62 microversion: 2.1 time: 0.062981 Oct 27 03:32:36.906285 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1519/2859] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:36 2022] DELETE /compute/v2.1/images/1a2e38d2-514f-48c2-b314-d5c9f52051f1 => generated 62 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 03:32:36.955705 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-9d460441-4605-4ae1-adb7-e5cd2abb518b tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:32:36.956138 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-9d460441-4605-4ae1-adb7-e5cd2abb518b tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:32:36.956624 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-9d460441-4605-4ae1-adb7-e5cd2abb518b tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:32:36.960722 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-9d460441-4605-4ae1-adb7-e5cd2abb518b tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:32:36.960944 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-9d460441-4605-4ae1-adb7-e5cd2abb518b tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:32:36.973996 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9d460441-4605-4ae1-adb7-e5cd2abb518b tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:36.975307 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9d460441-4605-4ae1-adb7-e5cd2abb518b tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:36.975935 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9d460441-4605-4ae1-adb7-e5cd2abb518b tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:36.976843 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9d460441-4605-4ae1-adb7-e5cd2abb518b tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:36.977473 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9d460441-4605-4ae1-adb7-e5cd2abb518b tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:36.978112 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9d460441-4605-4ae1-adb7-e5cd2abb518b tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:36.995994 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e47d0232-2523-4619-a99d-94c793f81e5f tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-783326765", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": [{"uuid": "d42fbee3-269c-4178-914c-e3bb573fc8b1"}]}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:32:37.009302 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-9d460441-4605-4ae1-adb7-e5cd2abb518b tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Getting quotas for project da001b5c2a244160b5b5aa053eb318fd. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:32:37.016766 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-9d460441-4605-4ae1-adb7-e5cd2abb518b tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Getting quotas for user f8f391fe67b54a91a9519b3cde83f86c and project da001b5c2a244160b5b5aa053eb318fd. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:32:37.034567 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9d460441-4605-4ae1-adb7-e5cd2abb518b tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:32:37.044481 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9d460441-4605-4ae1-adb7-e5cd2abb518b tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] [instance: bd1342fc-5bea-4391-a55e-b18610ded64b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:32:37.096165 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.network.neutron [None req-e47d0232-2523-4619-a99d-94c793f81e5f tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] validate_networks() for [('d42fbee3-269c-4178-914c-e3bb573fc8b1', None, None, None, None, None)] {{(pid=121001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:32:37.319254 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9d460441-4605-4ae1-adb7-e5cd2abb518b tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.334340 Oct 27 03:32:37.321243 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1341/2860] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:32:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1337 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 03:32:37.333170 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-22ee8b90-baf2-4e96-b73b-b90e5f75ad9a tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:37.334008 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-22ee8b90-baf2-4e96-b73b-b90e5f75ad9a tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] [instance: 2e1b6a2e-8acc-4c77-b551-4a623893ebaf] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:37.341095 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-22ee8b90-baf2-4e96-b73b-b90e5f75ad9a tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:37.341960 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-22ee8b90-baf2-4e96-b73b-b90e5f75ad9a tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:37.342419 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-22ee8b90-baf2-4e96-b73b-b90e5f75ad9a tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:37.343132 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-22ee8b90-baf2-4e96-b73b-b90e5f75ad9a tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:37.343590 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-22ee8b90-baf2-4e96-b73b-b90e5f75ad9a tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:37.344018 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-22ee8b90-baf2-4e96-b73b-b90e5f75ad9a tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:37.529687 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-22ee8b90-baf2-4e96-b73b-b90e5f75ad9a tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533917bc5aa4e23802a43b1eb534bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d87abf835a4104b40056b9eec2d6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:37.550969 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-22ee8b90-baf2-4e96-b73b-b90e5f75ad9a tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] 10.222.0.20 "GET /compute/v2.1/servers/2e1b6a2e-8acc-4c77-b551-4a623893ebaf" status: 200 len: 1218 microversion: 2.1 time: 0.228215 Oct 27 03:32:37.552174 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1342/2861] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:37 2022] GET /compute/v2.1/servers/2e1b6a2e-8acc-4c77-b551-4a623893ebaf => generated 1218 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:37.568658 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0fa999dc-4508-455b-8c36-5750f312cfda tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:37.600044 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0fa999dc-4508-455b-8c36-5750f312cfda tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9ce351a48282492e8cd69b9a5a05f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5514904d799d4f5dae454193e70d85f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:37.601604 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0fa999dc-4508-455b-8c36-5750f312cfda tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Searching by: {'deleted': False, 'project_id': '5514904d799d4f5dae454193e70d85f6'} {{(pid=121000) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 03:32:37.611072 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0fa999dc-4508-455b-8c36-5750f312cfda tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:37.611072 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0fa999dc-4508-455b-8c36-5750f312cfda tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:37.611258 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0fa999dc-4508-455b-8c36-5750f312cfda tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:37.611916 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0fa999dc-4508-455b-8c36-5750f312cfda tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:37.612437 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0fa999dc-4508-455b-8c36-5750f312cfda tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:37.612797 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0fa999dc-4508-455b-8c36-5750f312cfda tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:37.708974 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.multi_cell_list [None req-0fa999dc-4508-455b-8c36-5750f312cfda tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121000) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 03:32:37.789448 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0fa999dc-4508-455b-8c36-5750f312cfda tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.235591 Oct 27 03:32:37.793163 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1343/2862] 10.222.0.20 () {58 vars in 1125 bytes} [Thu Oct 27 03:32:37 2022] GET /compute/v2.1/servers => generated 343 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:32:37.806817 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-23bc77ea-6220-4a00-a7d4-3cbd15bfcd4a tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:37.807873 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-23bc77ea-6220-4a00-a7d4-3cbd15bfcd4a tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] [instance: b0c6560f-ade1-4ae6-905e-ad488f4c3b51] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:37.833642 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-23bc77ea-6220-4a00-a7d4-3cbd15bfcd4a tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:37.835215 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-23bc77ea-6220-4a00-a7d4-3cbd15bfcd4a tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:37.835907 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-23bc77ea-6220-4a00-a7d4-3cbd15bfcd4a tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:37.839884 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-23bc77ea-6220-4a00-a7d4-3cbd15bfcd4a tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:37.841516 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-23bc77ea-6220-4a00-a7d4-3cbd15bfcd4a tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:37.843004 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-23bc77ea-6220-4a00-a7d4-3cbd15bfcd4a tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:37.944966 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-23bc77ea-6220-4a00-a7d4-3cbd15bfcd4a tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] [instance: b0c6560f-ade1-4ae6-905e-ad488f4c3b51] Going to try to terminate instance {{(pid=121000) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:32:38.392230 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-e47d0232-2523-4619-a99d-94c793f81e5f tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Flavor limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:32:38.393255 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-e47d0232-2523-4619-a99d-94c793f81e5f tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Image limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:32:38.393754 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-e47d0232-2523-4619-a99d-94c793f81e5f tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Flavor pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:32:38.394581 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-e47d0232-2523-4619-a99d-94c793f81e5f tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Image pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:32:38.395021 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-e47d0232-2523-4619-a99d-94c793f81e5f tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:32:38.411877 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-23bc77ea-6220-4a00-a7d4-3cbd15bfcd4a tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b0c6560f-ade1-4ae6-905e-ad488f4c3b51" status: 204 len: 0 microversion: 2.1 time: 0.616917 Oct 27 03:32:38.412474 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1344/2863] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:32:37 2022] DELETE /compute/v2.1/servers/b0c6560f-ade1-4ae6-905e-ad488f4c3b51 => generated 0 bytes in 619 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:32:38.418816 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3f218521-7b7f-40c5-8d2e-630fe391cf30 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:38.419813 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-3f218521-7b7f-40c5-8d2e-630fe391cf30 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] [instance: f3d23d8e-a80a-425c-a0a3-9e448853a94b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:38.431110 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e47d0232-2523-4619-a99d-94c793f81e5f tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:38.434678 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e47d0232-2523-4619-a99d-94c793f81e5f tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:38.435370 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e47d0232-2523-4619-a99d-94c793f81e5f tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:38.436036 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e47d0232-2523-4619-a99d-94c793f81e5f tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:38.442484 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e47d0232-2523-4619-a99d-94c793f81e5f tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:38.442966 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e47d0232-2523-4619-a99d-94c793f81e5f tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:38.447267 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3f218521-7b7f-40c5-8d2e-630fe391cf30 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:38.447998 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3f218521-7b7f-40c5-8d2e-630fe391cf30 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:38.454579 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3f218521-7b7f-40c5-8d2e-630fe391cf30 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:38.454579 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3f218521-7b7f-40c5-8d2e-630fe391cf30 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:38.454579 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3f218521-7b7f-40c5-8d2e-630fe391cf30 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:38.454579 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3f218521-7b7f-40c5-8d2e-630fe391cf30 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:38.500620 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-e47d0232-2523-4619-a99d-94c793f81e5f tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Getting quotas for project dd32721d34bc40679303d6f47daae25c. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:32:38.523283 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-e47d0232-2523-4619-a99d-94c793f81e5f tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Getting quotas for user cd284264ddc64d58baee15e337d5fcc6 and project dd32721d34bc40679303d6f47daae25c. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:32:38.572661 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e47d0232-2523-4619-a99d-94c793f81e5f tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Going to run 1 instances... {{(pid=121001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:32:38.583856 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e47d0232-2523-4619-a99d-94c793f81e5f tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] [instance: 0e0220c0-997d-4f48-9ac2-550d2ba017ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:32:38.775418 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e47d0232-2523-4619-a99d-94c793f81e5f tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.868171 Oct 27 03:32:38.784656 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1520/2864] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:32:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1878 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 03:32:38.802342 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d337e6f0-13a0-46c1-bf3c-2478e50b9739 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:38.804736 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d337e6f0-13a0-46c1-bf3c-2478e50b9739 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] [instance: bd1342fc-5bea-4391-a55e-b18610ded64b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:38.851661 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-3f218521-7b7f-40c5-8d2e-630fe391cf30 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed44bf20b3464a53a3e3f6c9cd61cde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ee48e200624711b629a12b20c7d282', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:38.862964 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3f218521-7b7f-40c5-8d2e-630fe391cf30 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d23d8e-a80a-425c-a0a3-9e448853a94b" status: 200 len: 1370 microversion: 2.1 time: 0.448606 Oct 27 03:32:38.877536 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1345/2865] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:38 2022] GET /compute/v2.1/servers/f3d23d8e-a80a-425c-a0a3-9e448853a94b => generated 1370 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:38.887684 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e94865e9-65b0-4e35-a7da-d61842dbd2ca tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:38.901705 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e94865e9-65b0-4e35-a7da-d61842dbd2ca tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9ce351a48282492e8cd69b9a5a05f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5514904d799d4f5dae454193e70d85f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:38.903025 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e94865e9-65b0-4e35-a7da-d61842dbd2ca tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Searching by: {'deleted': False, 'project_id': '5514904d799d4f5dae454193e70d85f6'} {{(pid=121000) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 03:32:38.909047 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e94865e9-65b0-4e35-a7da-d61842dbd2ca tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:38.909753 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e94865e9-65b0-4e35-a7da-d61842dbd2ca tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:38.910380 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e94865e9-65b0-4e35-a7da-d61842dbd2ca tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:38.911564 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e94865e9-65b0-4e35-a7da-d61842dbd2ca tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:38.912258 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e94865e9-65b0-4e35-a7da-d61842dbd2ca tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:38.912864 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e94865e9-65b0-4e35-a7da-d61842dbd2ca tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:38.945245 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.multi_cell_list [None req-e94865e9-65b0-4e35-a7da-d61842dbd2ca tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121000) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 03:32:38.988352 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e94865e9-65b0-4e35-a7da-d61842dbd2ca tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce351a48282492e8cd69b9a5a05f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5514904d799d4f5dae454193e70d85f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:39.000347 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e94865e9-65b0-4e35-a7da-d61842dbd2ca tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:39.000347 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e94865e9-65b0-4e35-a7da-d61842dbd2ca tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:39.000347 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e94865e9-65b0-4e35-a7da-d61842dbd2ca tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:39.034792 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d337e6f0-13a0-46c1-bf3c-2478e50b9739 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f391fe67b54a91a9519b3cde83f86c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da001b5c2a244160b5b5aa053eb318fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:39.058447 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d337e6f0-13a0-46c1-bf3c-2478e50b9739 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1342fc-5bea-4391-a55e-b18610ded64b" status: 200 len: 1216 microversion: 2.1 time: 0.267189 Oct 27 03:32:39.058447 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1521/2866] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:38 2022] GET /compute/v2.1/servers/bd1342fc-5bea-4391-a55e-b18610ded64b => generated 1216 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:39.088622 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-5a84eadd-ca78-4a01-9c34-c04ff8337c9a req-4859e472-9b47-412b-8259-d8477a0781e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed74f42b-af82-4808-bfc2-86110840fe86", "name": "network-vif-unplugged", "status": "completed", "tag": "05464839-777e-4176-af2d-6086d6f9acaa"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:32:39.106914 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-5a84eadd-ca78-4a01-9c34-c04ff8337c9a req-4859e472-9b47-412b-8259-d8477a0781e9 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:39.107487 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-5a84eadd-ca78-4a01-9c34-c04ff8337c9a req-4859e472-9b47-412b-8259-d8477a0781e9 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:39.108007 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-5a84eadd-ca78-4a01-9c34-c04ff8337c9a req-4859e472-9b47-412b-8259-d8477a0781e9 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:39.126104 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-5a84eadd-ca78-4a01-9c34-c04ff8337c9a req-4859e472-9b47-412b-8259-d8477a0781e9 service nova] Creating event network-vif-unplugged:05464839-777e-4176-af2d-6086d6f9acaa for instance ed74f42b-af82-4808-bfc2-86110840fe86 on n-h1-862769-1 Oct 27 03:32:39.139721 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-5a84eadd-ca78-4a01-9c34-c04ff8337c9a req-4859e472-9b47-412b-8259-d8477a0781e9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063967 Oct 27 03:32:39.167322 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1522/2867] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:32:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:32:39.184599 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-743ca3e6-3f87-45d3-a0d3-8e10d2287e6c tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:39.185882 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-743ca3e6-3f87-45d3-a0d3-8e10d2287e6c tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] [instance: b0c6560f-ade1-4ae6-905e-ad488f4c3b51] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:39.207105 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-743ca3e6-3f87-45d3-a0d3-8e10d2287e6c tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:39.208025 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-743ca3e6-3f87-45d3-a0d3-8e10d2287e6c tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:39.208698 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-743ca3e6-3f87-45d3-a0d3-8e10d2287e6c tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:39.209745 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-743ca3e6-3f87-45d3-a0d3-8e10d2287e6c tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:39.210630 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-743ca3e6-3f87-45d3-a0d3-8e10d2287e6c tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:39.211336 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-743ca3e6-3f87-45d3-a0d3-8e10d2287e6c tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:39.675625 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-743ca3e6-3f87-45d3-a0d3-8e10d2287e6c tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cd1938c86a4f389a2ec0fba9beff36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd0392257a0419dbfa569c8816ece2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:39.681421 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-743ca3e6-3f87-45d3-a0d3-8e10d2287e6c tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] 10.222.0.20 "GET /compute/v2.1/servers/b0c6560f-ade1-4ae6-905e-ad488f4c3b51" status: 200 len: 1472 microversion: 2.1 time: 0.512625 Oct 27 03:32:39.681921 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1523/2868] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:39 2022] GET /compute/v2.1/servers/b0c6560f-ade1-4ae6-905e-ad488f4c3b51 => generated 1472 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:39.696654 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c5c5a779-9211-49de-a071-4aa4e97bb149 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:39.709990 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c5c5a779-9211-49de-a071-4aa4e97bb149 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] [instance: 2e1b6a2e-8acc-4c77-b551-4a623893ebaf] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:39.725500 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c5c5a779-9211-49de-a071-4aa4e97bb149 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:39.726331 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c5c5a779-9211-49de-a071-4aa4e97bb149 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:39.726962 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c5c5a779-9211-49de-a071-4aa4e97bb149 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:39.729441 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c5c5a779-9211-49de-a071-4aa4e97bb149 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:39.730157 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c5c5a779-9211-49de-a071-4aa4e97bb149 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:39.734291 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c5c5a779-9211-49de-a071-4aa4e97bb149 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:39.850771 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e94865e9-65b0-4e35-a7da-d61842dbd2ca tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] 10.222.0.20 "GET /compute/v2.1/servers/detail" status: 200 len: 1606 microversion: 2.1 time: 0.971974 Oct 27 03:32:39.851379 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1346/2869] 10.222.0.20 () {58 vars in 1146 bytes} [Thu Oct 27 03:32:38 2022] GET /compute/v2.1/servers/detail => generated 1606 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:39.857112 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3196e0b0-1abc-4ae5-8515-a5bc96e71185 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:39.857974 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-3196e0b0-1abc-4ae5-8515-a5bc96e71185 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] [instance: 0e0220c0-997d-4f48-9ac2-550d2ba017ca] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:39.892816 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c5c5a779-9211-49de-a071-4aa4e97bb149 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533917bc5aa4e23802a43b1eb534bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d87abf835a4104b40056b9eec2d6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:39.902192 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c5c5a779-9211-49de-a071-4aa4e97bb149 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] 10.222.0.20 "GET /compute/v2.1/servers/2e1b6a2e-8acc-4c77-b551-4a623893ebaf" status: 200 len: 1272 microversion: 2.1 time: 0.213843 Oct 27 03:32:39.914854 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1524/2870] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:39 2022] GET /compute/v2.1/servers/2e1b6a2e-8acc-4c77-b551-4a623893ebaf => generated 1272 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:39.934631 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f09f28cb-fa7d-4ddb-aa40-bb747a6cea07 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:39.964927 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f09f28cb-fa7d-4ddb-aa40-bb747a6cea07 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.024807 Oct 27 03:32:39.965981 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1525/2871] 10.222.0.20 () {58 vars in 1137 bytes} [Thu Oct 27 03:32:39 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:32:39.981573 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-12368279-7c5f-4041-be21-8a99798565ff tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:39.982274 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-12368279-7c5f-4041-be21-8a99798565ff tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] [instance: f3d23d8e-a80a-425c-a0a3-9e448853a94b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:40.012980 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-12368279-7c5f-4041-be21-8a99798565ff tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:40.017764 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-12368279-7c5f-4041-be21-8a99798565ff tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:40.017764 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-12368279-7c5f-4041-be21-8a99798565ff tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:40.017764 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-12368279-7c5f-4041-be21-8a99798565ff tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:40.017764 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-12368279-7c5f-4041-be21-8a99798565ff tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:40.017764 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-12368279-7c5f-4041-be21-8a99798565ff tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:40.033780 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-3196e0b0-1abc-4ae5-8515-a5bc96e71185 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd284264ddc64d58baee15e337d5fcc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd32721d34bc40679303d6f47daae25c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:40.056288 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3196e0b0-1abc-4ae5-8515-a5bc96e71185 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] 10.222.0.20 "GET /compute/v2.1/servers/0e0220c0-997d-4f48-9ac2-550d2ba017ca" status: 200 len: 1231 microversion: 2.1 time: 0.192341 Oct 27 03:32:40.063056 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1347/2872] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:39 2022] GET /compute/v2.1/servers/0e0220c0-997d-4f48-9ac2-550d2ba017ca => generated 1231 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:40.086792 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-989bafd5-2240-4b04-8436-c83f77693b44 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:40.092825 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-989bafd5-2240-4b04-8436-c83f77693b44 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] [instance: bd1342fc-5bea-4391-a55e-b18610ded64b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:40.110858 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-989bafd5-2240-4b04-8436-c83f77693b44 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:40.111663 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-989bafd5-2240-4b04-8436-c83f77693b44 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:40.114518 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-989bafd5-2240-4b04-8436-c83f77693b44 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:40.122315 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-989bafd5-2240-4b04-8436-c83f77693b44 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:40.124320 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-989bafd5-2240-4b04-8436-c83f77693b44 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:40.129135 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-989bafd5-2240-4b04-8436-c83f77693b44 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:40.344242 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-989bafd5-2240-4b04-8436-c83f77693b44 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f391fe67b54a91a9519b3cde83f86c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da001b5c2a244160b5b5aa053eb318fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:40.354264 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-989bafd5-2240-4b04-8436-c83f77693b44 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1342fc-5bea-4391-a55e-b18610ded64b" status: 200 len: 1212 microversion: 2.1 time: 0.269653 Oct 27 03:32:40.360471 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1348/2873] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:40 2022] GET /compute/v2.1/servers/bd1342fc-5bea-4391-a55e-b18610ded64b => generated 1212 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:40.368905 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b0b8f229-39b7-4140-9038-717bbce640f1 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:40.369543 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b0b8f229-39b7-4140-9038-717bbce640f1 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] [instance: 2023265c-1a97-4ed8-8af7-f83077e4bfa5] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:40.390479 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b0b8f229-39b7-4140-9038-717bbce640f1 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:40.392878 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b0b8f229-39b7-4140-9038-717bbce640f1 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:40.393604 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b0b8f229-39b7-4140-9038-717bbce640f1 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:40.396161 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b0b8f229-39b7-4140-9038-717bbce640f1 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:40.397169 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b0b8f229-39b7-4140-9038-717bbce640f1 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:40.398938 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b0b8f229-39b7-4140-9038-717bbce640f1 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:40.461370 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b0b8f229-39b7-4140-9038-717bbce640f1 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] [instance: 2023265c-1a97-4ed8-8af7-f83077e4bfa5] Going to try to terminate instance {{(pid=121000) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:32:40.622950 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-12368279-7c5f-4041-be21-8a99798565ff tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed44bf20b3464a53a3e3f6c9cd61cde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ee48e200624711b629a12b20c7d282', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:40.633310 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-12368279-7c5f-4041-be21-8a99798565ff tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d23d8e-a80a-425c-a0a3-9e448853a94b" status: 200 len: 1370 microversion: 2.1 time: 0.666217 Oct 27 03:32:40.636678 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1526/2874] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:39 2022] GET /compute/v2.1/servers/f3d23d8e-a80a-425c-a0a3-9e448853a94b => generated 1370 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:40.645440 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-081d65dc-6e7b-4fad-adf4-752e2fb46248 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:40.648834 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-081d65dc-6e7b-4fad-adf4-752e2fb46248 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:40.669037 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-081d65dc-6e7b-4fad-adf4-752e2fb46248 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:40.669440 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-081d65dc-6e7b-4fad-adf4-752e2fb46248 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:40.669890 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-081d65dc-6e7b-4fad-adf4-752e2fb46248 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:40.670640 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-081d65dc-6e7b-4fad-adf4-752e2fb46248 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:40.674533 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-081d65dc-6e7b-4fad-adf4-752e2fb46248 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:40.675299 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-081d65dc-6e7b-4fad-adf4-752e2fb46248 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:40.977378 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b0b8f229-39b7-4140-9038-717bbce640f1 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2023265c-1a97-4ed8-8af7-f83077e4bfa5" status: 204 len: 0 microversion: 2.1 time: 0.614820 Oct 27 03:32:40.977990 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1349/2875] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:32:40 2022] DELETE /compute/v2.1/servers/2023265c-1a97-4ed8-8af7-f83077e4bfa5 => generated 0 bytes in 617 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:32:40.984902 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b7ee8f34-cc6c-4e84-9886-8edb4d955140 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:40.993046 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b7ee8f34-cc6c-4e84-9886-8edb4d955140 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] [instance: b0c6560f-ade1-4ae6-905e-ad488f4c3b51] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:40.996262 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:32:41.000105 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b7ee8f34-cc6c-4e84-9886-8edb4d955140 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:41.000607 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b7ee8f34-cc6c-4e84-9886-8edb4d955140 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:41.001052 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b7ee8f34-cc6c-4e84-9886-8edb4d955140 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:41.001874 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b7ee8f34-cc6c-4e84-9886-8edb4d955140 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:41.007593 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b7ee8f34-cc6c-4e84-9886-8edb4d955140 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:41.007593 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b7ee8f34-cc6c-4e84-9886-8edb4d955140 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:41.595323 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-081d65dc-6e7b-4fad-adf4-752e2fb46248 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:41.606651 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-081d65dc-6e7b-4fad-adf4-752e2fb46248 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1669 microversion: 2.1 time: 0.968606 Oct 27 03:32:41.607802 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1527/2876] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:40 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1669 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:41.613724 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-51e8414c-d609-4e91-952e-c079932d88de tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:41.614636 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-51e8414c-d609-4e91-952e-c079932d88de tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] [instance: 2e1b6a2e-8acc-4c77-b551-4a623893ebaf] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:41.624733 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-51e8414c-d609-4e91-952e-c079932d88de tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:41.625571 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-51e8414c-d609-4e91-952e-c079932d88de tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:41.626865 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-51e8414c-d609-4e91-952e-c079932d88de tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:41.627805 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-51e8414c-d609-4e91-952e-c079932d88de tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:41.628506 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-51e8414c-d609-4e91-952e-c079932d88de tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:41.630225 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-51e8414c-d609-4e91-952e-c079932d88de tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:41.641878 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b7ee8f34-cc6c-4e84-9886-8edb4d955140 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cd1938c86a4f389a2ec0fba9beff36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd0392257a0419dbfa569c8816ece2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:41.654229 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b7ee8f34-cc6c-4e84-9886-8edb4d955140 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] 10.222.0.20 "GET /compute/v2.1/servers/b0c6560f-ade1-4ae6-905e-ad488f4c3b51" status: 200 len: 1472 microversion: 2.1 time: 0.672603 Oct 27 03:32:41.655352 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1350/2877] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:40 2022] GET /compute/v2.1/servers/b0c6560f-ade1-4ae6-905e-ad488f4c3b51 => generated 1472 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:41.664440 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-312d464e-fd2f-4906-a14d-3e497e94b1e6 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:41.671604 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-312d464e-fd2f-4906-a14d-3e497e94b1e6 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] [instance: 2023265c-1a97-4ed8-8af7-f83077e4bfa5] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:41.682699 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-312d464e-fd2f-4906-a14d-3e497e94b1e6 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:41.683437 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-312d464e-fd2f-4906-a14d-3e497e94b1e6 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:41.683882 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-312d464e-fd2f-4906-a14d-3e497e94b1e6 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:41.692007 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-312d464e-fd2f-4906-a14d-3e497e94b1e6 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:41.692826 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-312d464e-fd2f-4906-a14d-3e497e94b1e6 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:41.693691 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-312d464e-fd2f-4906-a14d-3e497e94b1e6 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:41.746910 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-51e8414c-d609-4e91-952e-c079932d88de tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533917bc5aa4e23802a43b1eb534bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d87abf835a4104b40056b9eec2d6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:41.759774 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-51e8414c-d609-4e91-952e-c079932d88de tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] 10.222.0.20 "GET /compute/v2.1/servers/2e1b6a2e-8acc-4c77-b551-4a623893ebaf" status: 200 len: 1272 microversion: 2.1 time: 0.150591 Oct 27 03:32:41.760953 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1528/2878] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:41 2022] GET /compute/v2.1/servers/2e1b6a2e-8acc-4c77-b551-4a623893ebaf => generated 1272 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:41.766111 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-79dc55c8-514d-4a48-aa04-04b2d53b4d3d tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:41.767065 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-79dc55c8-514d-4a48-aa04-04b2d53b4d3d tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] [instance: 0e0220c0-997d-4f48-9ac2-550d2ba017ca] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:41.781724 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-79dc55c8-514d-4a48-aa04-04b2d53b4d3d tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:41.782552 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-79dc55c8-514d-4a48-aa04-04b2d53b4d3d tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:41.783572 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-79dc55c8-514d-4a48-aa04-04b2d53b4d3d tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:41.784543 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-79dc55c8-514d-4a48-aa04-04b2d53b4d3d tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:41.785883 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-79dc55c8-514d-4a48-aa04-04b2d53b4d3d tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:41.787193 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-79dc55c8-514d-4a48-aa04-04b2d53b4d3d tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:41.912590 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-79dc55c8-514d-4a48-aa04-04b2d53b4d3d tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd284264ddc64d58baee15e337d5fcc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd32721d34bc40679303d6f47daae25c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:41.923894 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-79dc55c8-514d-4a48-aa04-04b2d53b4d3d tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] 10.222.0.20 "GET /compute/v2.1/servers/0e0220c0-997d-4f48-9ac2-550d2ba017ca" status: 200 len: 1235 microversion: 2.1 time: 0.161551 Oct 27 03:32:41.936505 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1529/2879] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:41 2022] GET /compute/v2.1/servers/0e0220c0-997d-4f48-9ac2-550d2ba017ca => generated 1235 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:41.940755 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d9083a7d-19e2-4958-82fb-483dc349be23 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:41.942371 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d9083a7d-19e2-4958-82fb-483dc349be23 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] [instance: bd1342fc-5bea-4391-a55e-b18610ded64b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:41.951868 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d9083a7d-19e2-4958-82fb-483dc349be23 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:41.951868 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d9083a7d-19e2-4958-82fb-483dc349be23 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:41.951868 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d9083a7d-19e2-4958-82fb-483dc349be23 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:41.951868 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d9083a7d-19e2-4958-82fb-483dc349be23 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:41.951868 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d9083a7d-19e2-4958-82fb-483dc349be23 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:41.952719 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d9083a7d-19e2-4958-82fb-483dc349be23 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:42.049798 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-312d464e-fd2f-4906-a14d-3e497e94b1e6 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce351a48282492e8cd69b9a5a05f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5514904d799d4f5dae454193e70d85f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:42.080401 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-312d464e-fd2f-4906-a14d-3e497e94b1e6 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] 10.222.0.20 "GET /compute/v2.1/servers/2023265c-1a97-4ed8-8af7-f83077e4bfa5" status: 200 len: 1609 microversion: 2.1 time: 0.423129 Oct 27 03:32:42.085684 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1351/2880] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:41 2022] GET /compute/v2.1/servers/2023265c-1a97-4ed8-8af7-f83077e4bfa5 => generated 1609 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:42.099559 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-187961d9-8149-4ea0-9ca9-e11a2522b7a5 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:42.101668 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-187961d9-8149-4ea0-9ca9-e11a2522b7a5 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:42.115091 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-187961d9-8149-4ea0-9ca9-e11a2522b7a5 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:42.116196 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-187961d9-8149-4ea0-9ca9-e11a2522b7a5 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:42.117942 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-187961d9-8149-4ea0-9ca9-e11a2522b7a5 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:42.123462 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-187961d9-8149-4ea0-9ca9-e11a2522b7a5 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:42.127772 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-187961d9-8149-4ea0-9ca9-e11a2522b7a5 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:42.139656 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-187961d9-8149-4ea0-9ca9-e11a2522b7a5 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:42.162175 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d9083a7d-19e2-4958-82fb-483dc349be23 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f391fe67b54a91a9519b3cde83f86c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da001b5c2a244160b5b5aa053eb318fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:42.172239 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d9083a7d-19e2-4958-82fb-483dc349be23 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1342fc-5bea-4391-a55e-b18610ded64b" status: 200 len: 1274 microversion: 2.1 time: 0.246562 Oct 27 03:32:42.178972 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1530/2881] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:41 2022] GET /compute/v2.1/servers/bd1342fc-5bea-4391-a55e-b18610ded64b => generated 1274 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:42.187047 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ad59f8c5-c4fa-4fc1-812f-07e075722850 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:42.190623 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ad59f8c5-c4fa-4fc1-812f-07e075722850 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] [instance: f3d23d8e-a80a-425c-a0a3-9e448853a94b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:42.206497 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ad59f8c5-c4fa-4fc1-812f-07e075722850 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:42.208914 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ad59f8c5-c4fa-4fc1-812f-07e075722850 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:42.209612 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ad59f8c5-c4fa-4fc1-812f-07e075722850 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:42.214785 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ad59f8c5-c4fa-4fc1-812f-07e075722850 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:42.216689 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ad59f8c5-c4fa-4fc1-812f-07e075722850 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:42.217984 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ad59f8c5-c4fa-4fc1-812f-07e075722850 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:42.650847 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ad59f8c5-c4fa-4fc1-812f-07e075722850 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed44bf20b3464a53a3e3f6c9cd61cde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ee48e200624711b629a12b20c7d282', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:42.660911 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-187961d9-8149-4ea0-9ca9-e11a2522b7a5 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:42.666963 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ad59f8c5-c4fa-4fc1-812f-07e075722850 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d23d8e-a80a-425c-a0a3-9e448853a94b" status: 200 len: 1370 microversion: 2.1 time: 0.482777 Oct 27 03:32:42.667626 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1531/2882] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:42 2022] GET /compute/v2.1/servers/f3d23d8e-a80a-425c-a0a3-9e448853a94b => generated 1370 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:42.687855 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-84751542-b5f1-4ff6-8f72-71b74ab3c196 req-94af44de-ad01-4029-9551-7efc7e61ef0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0c6560f-ade1-4ae6-905e-ad488f4c3b51", "name": "network-vif-deleted", "tag": "374bf7dd-46fc-42a5-a069-b8b5708a33a0"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:32:42.696817 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-187961d9-8149-4ea0-9ca9-e11a2522b7a5 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1669 microversion: 2.1 time: 0.609455 Oct 27 03:32:42.704305 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-84751542-b5f1-4ff6-8f72-71b74ab3c196 req-94af44de-ad01-4029-9551-7efc7e61ef0e service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:42.705388 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-84751542-b5f1-4ff6-8f72-71b74ab3c196 req-94af44de-ad01-4029-9551-7efc7e61ef0e service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:42.705826 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-84751542-b5f1-4ff6-8f72-71b74ab3c196 req-94af44de-ad01-4029-9551-7efc7e61ef0e service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:42.709299 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1352/2883] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:42 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1669 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:42.713661 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ee94ac84-ac30-4a5d-8337-9539a3488c02 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:42.717966 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ee94ac84-ac30-4a5d-8337-9539a3488c02 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] [instance: b0c6560f-ade1-4ae6-905e-ad488f4c3b51] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:42.732087 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ee94ac84-ac30-4a5d-8337-9539a3488c02 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:42.739375 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ee94ac84-ac30-4a5d-8337-9539a3488c02 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:42.741517 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ee94ac84-ac30-4a5d-8337-9539a3488c02 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:42.742300 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ee94ac84-ac30-4a5d-8337-9539a3488c02 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:42.744525 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ee94ac84-ac30-4a5d-8337-9539a3488c02 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:42.746237 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-84751542-b5f1-4ff6-8f72-71b74ab3c196 req-94af44de-ad01-4029-9551-7efc7e61ef0e service nova] Creating event network-vif-deleted:374bf7dd-46fc-42a5-a069-b8b5708a33a0 for instance b0c6560f-ade1-4ae6-905e-ad488f4c3b51 on n-h2-862769-1 Oct 27 03:32:42.746808 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ee94ac84-ac30-4a5d-8337-9539a3488c02 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:42.758841 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-84751542-b5f1-4ff6-8f72-71b74ab3c196 req-94af44de-ad01-4029-9551-7efc7e61ef0e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089936 Oct 27 03:32:42.759628 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1532/2884] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:32:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:32:42.787362 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-12bcab8c-df7b-4eca-be95-a76321521e6f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:42.788154 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-12bcab8c-df7b-4eca-be95-a76321521e6f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:42.804960 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-12bcab8c-df7b-4eca-be95-a76321521e6f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:42.813196 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-12bcab8c-df7b-4eca-be95-a76321521e6f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:42.813672 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-12bcab8c-df7b-4eca-be95-a76321521e6f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:42.814919 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-12bcab8c-df7b-4eca-be95-a76321521e6f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:42.815040 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-12bcab8c-df7b-4eca-be95-a76321521e6f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:42.815395 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-12bcab8c-df7b-4eca-be95-a76321521e6f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:42.858051 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ee94ac84-ac30-4a5d-8337-9539a3488c02 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:42.863150 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ee94ac84-ac30-4a5d-8337-9539a3488c02 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:42.863910 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ee94ac84-ac30-4a5d-8337-9539a3488c02 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:42.864579 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-ee94ac84-ac30-4a5d-8337-9539a3488c02 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lazy-loading 'fault' on Instance uuid b0c6560f-ade1-4ae6-905e-ad488f4c3b51 {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:32:42.955389 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ee94ac84-ac30-4a5d-8337-9539a3488c02 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cd1938c86a4f389a2ec0fba9beff36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd0392257a0419dbfa569c8816ece2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:42.959650 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:32:42.966264 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ee94ac84-ac30-4a5d-8337-9539a3488c02 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] 10.222.0.20 "GET /compute/v2.1/servers/b0c6560f-ade1-4ae6-905e-ad488f4c3b51" status: 200 len: 1307 microversion: 2.1 time: 0.258676 Oct 27 03:32:42.974299 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1353/2885] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:42 2022] GET /compute/v2.1/servers/b0c6560f-ade1-4ae6-905e-ad488f4c3b51 => generated 1307 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:42.976470 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-bcf661e3-9f89-479c-acd3-1260bb29eade tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:42.977814 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-bcf661e3-9f89-479c-acd3-1260bb29eade tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] [instance: 2e1b6a2e-8acc-4c77-b551-4a623893ebaf] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:42.989533 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bcf661e3-9f89-479c-acd3-1260bb29eade tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:42.990309 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bcf661e3-9f89-479c-acd3-1260bb29eade tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:42.990955 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bcf661e3-9f89-479c-acd3-1260bb29eade tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:42.992030 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bcf661e3-9f89-479c-acd3-1260bb29eade tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:42.992762 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bcf661e3-9f89-479c-acd3-1260bb29eade tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:42.993396 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bcf661e3-9f89-479c-acd3-1260bb29eade tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:43.240781 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-12bcab8c-df7b-4eca-be95-a76321521e6f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:43.266439 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-12bcab8c-df7b-4eca-be95-a76321521e6f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1669 microversion: 2.1 time: 0.504562 Oct 27 03:32:43.271828 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1533/2886] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:42 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1669 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:43.286596 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-7a9d97e7-aace-44c5-bba8-cabeb033ff4b req-e46310f1-0c66-4a97-8742-50b2d7dd827d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3d23d8e-a80a-425c-a0a3-9e448853a94b", "name": "network-vif-plugged", "status": "completed", "tag": "aa192bf0-ce03-4098-8949-343a75b75ddb"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:32:43.334597 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-7a9d97e7-aace-44c5-bba8-cabeb033ff4b req-e46310f1-0c66-4a97-8742-50b2d7dd827d service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:43.335405 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-7a9d97e7-aace-44c5-bba8-cabeb033ff4b req-e46310f1-0c66-4a97-8742-50b2d7dd827d service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:43.336440 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-7a9d97e7-aace-44c5-bba8-cabeb033ff4b req-e46310f1-0c66-4a97-8742-50b2d7dd827d service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:43.357961 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=100 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:32:43.363669 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-7a9d97e7-aace-44c5-bba8-cabeb033ff4b req-e46310f1-0c66-4a97-8742-50b2d7dd827d service nova] Creating event network-vif-plugged:aa192bf0-ce03-4098-8949-343a75b75ddb for instance f3d23d8e-a80a-425c-a0a3-9e448853a94b on n-h2-862769-1 Oct 27 03:32:43.367343 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-bcf661e3-9f89-479c-acd3-1260bb29eade tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533917bc5aa4e23802a43b1eb534bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d87abf835a4104b40056b9eec2d6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:43.371297 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-7a9d97e7-aace-44c5-bba8-cabeb033ff4b req-e46310f1-0c66-4a97-8742-50b2d7dd827d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097864 Oct 27 03:32:43.372474 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1534/2887] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:32:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:32:43.385761 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-66480529-4fba-4014-8b57-38da567e7f19 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:43.386676 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-bcf661e3-9f89-479c-acd3-1260bb29eade tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] 10.222.0.20 "GET /compute/v2.1/servers/2e1b6a2e-8acc-4c77-b551-4a623893ebaf" status: 200 len: 1314 microversion: 2.1 time: 0.418249 Oct 27 03:32:43.387008 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-66480529-4fba-4014-8b57-38da567e7f19 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] [instance: 0e0220c0-997d-4f48-9ac2-550d2ba017ca] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:43.387972 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1354/2888] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:42 2022] GET /compute/v2.1/servers/2e1b6a2e-8acc-4c77-b551-4a623893ebaf => generated 1314 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:43.401300 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3ee611fa-0873-496c-bf02-9b40f6aa365e tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:43.402782 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-3ee611fa-0873-496c-bf02-9b40f6aa365e tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] [instance: 2023265c-1a97-4ed8-8af7-f83077e4bfa5] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:43.413206 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3ee611fa-0873-496c-bf02-9b40f6aa365e tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:43.417654 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3ee611fa-0873-496c-bf02-9b40f6aa365e tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:43.418253 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-66480529-4fba-4014-8b57-38da567e7f19 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:43.418545 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3ee611fa-0873-496c-bf02-9b40f6aa365e tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:43.419122 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-66480529-4fba-4014-8b57-38da567e7f19 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:43.419613 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3ee611fa-0873-496c-bf02-9b40f6aa365e tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:43.420187 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3ee611fa-0873-496c-bf02-9b40f6aa365e tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:43.420632 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3ee611fa-0873-496c-bf02-9b40f6aa365e tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:43.422379 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-66480529-4fba-4014-8b57-38da567e7f19 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:43.423520 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-66480529-4fba-4014-8b57-38da567e7f19 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:43.424276 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-66480529-4fba-4014-8b57-38da567e7f19 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:43.426368 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-66480529-4fba-4014-8b57-38da567e7f19 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:43.691353 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-66480529-4fba-4014-8b57-38da567e7f19 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd284264ddc64d58baee15e337d5fcc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd32721d34bc40679303d6f47daae25c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:43.700225 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-66480529-4fba-4014-8b57-38da567e7f19 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] 10.222.0.20 "GET /compute/v2.1/servers/0e0220c0-997d-4f48-9ac2-550d2ba017ca" status: 200 len: 1283 microversion: 2.1 time: 0.320630 Oct 27 03:32:43.714692 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1535/2889] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:43 2022] GET /compute/v2.1/servers/0e0220c0-997d-4f48-9ac2-550d2ba017ca => generated 1283 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:43.721163 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4bf715b5-0e63-44e4-a2bd-a777ca01d4ed tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:43.721163 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4bf715b5-0e63-44e4-a2bd-a777ca01d4ed tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] [instance: bd1342fc-5bea-4391-a55e-b18610ded64b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:43.733554 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4bf715b5-0e63-44e4-a2bd-a777ca01d4ed tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:43.734106 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4bf715b5-0e63-44e4-a2bd-a777ca01d4ed tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:43.734584 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4bf715b5-0e63-44e4-a2bd-a777ca01d4ed tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:43.735329 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4bf715b5-0e63-44e4-a2bd-a777ca01d4ed tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:43.736703 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4bf715b5-0e63-44e4-a2bd-a777ca01d4ed tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:43.736703 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4bf715b5-0e63-44e4-a2bd-a777ca01d4ed tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:43.847803 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4bf715b5-0e63-44e4-a2bd-a777ca01d4ed tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f391fe67b54a91a9519b3cde83f86c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da001b5c2a244160b5b5aa053eb318fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:43.857602 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4bf715b5-0e63-44e4-a2bd-a777ca01d4ed tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1342fc-5bea-4391-a55e-b18610ded64b" status: 200 len: 1274 microversion: 2.1 time: 0.141910 Oct 27 03:32:43.859260 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1536/2890] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:43 2022] GET /compute/v2.1/servers/bd1342fc-5bea-4391-a55e-b18610ded64b => generated 1274 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:43.866438 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-82e8f00d-0b5b-4e45-8239-c53d7a29f60d tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:32:43.870499 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-82e8f00d-0b5b-4e45-8239-c53d7a29f60d tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:43.894474 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-82e8f00d-0b5b-4e45-8239-c53d7a29f60d tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:43.895006 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-82e8f00d-0b5b-4e45-8239-c53d7a29f60d tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:43.895536 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-82e8f00d-0b5b-4e45-8239-c53d7a29f60d tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:43.896290 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-82e8f00d-0b5b-4e45-8239-c53d7a29f60d tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:43.896758 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-82e8f00d-0b5b-4e45-8239-c53d7a29f60d tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:43.897211 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-82e8f00d-0b5b-4e45-8239-c53d7a29f60d tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:44.235058 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-3ee611fa-0873-496c-bf02-9b40f6aa365e tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce351a48282492e8cd69b9a5a05f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5514904d799d4f5dae454193e70d85f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:44.246534 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-82e8f00d-0b5b-4e45-8239-c53d7a29f60d tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "POST /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86/action" status: 202 len: 0 microversion: 2.1 time: 0.385791 Oct 27 03:32:44.255626 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1537/2891] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:32:43 2022] POST /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86/action => generated 0 bytes in 387 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:32:44.272416 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3ee611fa-0873-496c-bf02-9b40f6aa365e tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] 10.222.0.20 "GET /compute/v2.1/servers/2023265c-1a97-4ed8-8af7-f83077e4bfa5" status: 200 len: 1609 microversion: 2.1 time: 0.882163 Oct 27 03:32:44.274174 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1355/2892] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:43 2022] GET /compute/v2.1/servers/2023265c-1a97-4ed8-8af7-f83077e4bfa5 => generated 1609 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:44.274937 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5064b568-798e-4205-8f19-ef19eec9adbe tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:44.276521 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5064b568-798e-4205-8f19-ef19eec9adbe tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] [instance: f3d23d8e-a80a-425c-a0a3-9e448853a94b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:44.285483 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c2963c17-1dbc-4141-a909-780c30e3e7b3 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:44.290963 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c2963c17-1dbc-4141-a909-780c30e3e7b3 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] [instance: b0c6560f-ade1-4ae6-905e-ad488f4c3b51] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:44.297963 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5064b568-798e-4205-8f19-ef19eec9adbe tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:44.298543 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5064b568-798e-4205-8f19-ef19eec9adbe tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:44.298994 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5064b568-798e-4205-8f19-ef19eec9adbe tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:44.299736 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5064b568-798e-4205-8f19-ef19eec9adbe tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:44.300206 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5064b568-798e-4205-8f19-ef19eec9adbe tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:44.308443 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c2963c17-1dbc-4141-a909-780c30e3e7b3 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:44.308901 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5064b568-798e-4205-8f19-ef19eec9adbe tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:44.319320 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c2963c17-1dbc-4141-a909-780c30e3e7b3 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:44.319320 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c2963c17-1dbc-4141-a909-780c30e3e7b3 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:44.319320 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c2963c17-1dbc-4141-a909-780c30e3e7b3 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:44.319320 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c2963c17-1dbc-4141-a909-780c30e3e7b3 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:44.319320 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c2963c17-1dbc-4141-a909-780c30e3e7b3 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:44.390009 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-c2963c17-1dbc-4141-a909-780c30e3e7b3 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] HTTP exception thrown: Instance b0c6560f-ade1-4ae6-905e-ad488f4c3b51 could not be found. Oct 27 03:32:44.399505 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c2963c17-1dbc-4141-a909-780c30e3e7b3 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Request method failure captured: Oct 27 03:32:44.399505 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/b0c6560f-ade1-4ae6-905e-ad488f4c3b51 HTTP/1.1 Oct 27 03:32:44.399505 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:32:44.399505 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:32:44.399505 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:32:44.399505 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:32:44.399505 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:32:44.399505 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:32:44.399505 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:32:44.399505 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:32:44.399505 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWftOev-xo07r_KXTI-kaMtPTG2vIw_t-RbHr-Jab33WZMwPajQzQaTrATg5SuBKvzsta_WG55w1J4TRjaaH5s7iZZ99eq9w8fDBVbUlrwYcAdtZSzY1_1zS-dCpbmif-sfCsz4n8YukWQdgPj7GzIplE7tljIccMw4AXx27syA13xc4 Oct 27 03:32:44.399505 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:32:44.399505 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:32:44.399505 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:32:44.399505 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:32:44.399505 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:32:44.399505 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:32:44.399505 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: ccd0392257a0419dbfa569c8816ece2b Oct 27 03:32:44.399505 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ImagesOneServerTestJSON-1466754268 Oct 27 03:32:44.399505 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:32:44.399505 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:32:44.399505 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ccd0392257a0419dbfa569c8816ece2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ccd0392257a0419dbfa569c8816ece2b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ccd0392257a0419dbfa569c8816ece2b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ccd0392257a0419dbfa569c8816ece2b"}]}] Oct 27 03:32:44.399505 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ImagesOneServerTestJSON-1466754268 Oct 27 03:32:44.399505 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: ccd0392257a0419dbfa569c8816ece2b Oct 27 03:32:44.399505 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1466754268 Oct 27 03:32:44.399505 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ImagesOneServerTestJSON-1466754268-project Oct 27 03:32:44.399505 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:32:44.399505 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:32:44.399505 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 42cd1938c86a4f389a2ec0fba9beff36 Oct 27 03:32:44.399505 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ImagesOneServerTestJSON-1466754268-project Oct 27 03:32:44.399505 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:32:44.399505 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance b0c6560f-ade1-4ae6-905e-ad488f4c3b51 could not be found. Oct 27 03:32:44.399505 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': 'b0c6560f-ade1-4ae6-905e-ad488f4c3b51'} Oct 27 03:32:44.399505 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:32:44.399505 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:32:44.399505 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:32:44.399505 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:32:44.399505 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:32:44.399505 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:32:44.399505 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:32:44.399505 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:32:44.399505 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:32:44.399505 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:32:44.399505 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0c6560f-ade1-4ae6-905e-ad488f4c3b51 could not be found. Oct 27 03:32:44.399505 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:32:44.399505 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:32:44.399505 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:32:44.399505 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:32:44.399505 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:32:44.399505 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:32:44.399505 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:32:44.399505 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:32:44.399505 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:32:44.399505 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:32:44.399505 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:32:44.399505 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:32:44.399505 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:32:44.399505 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:32:44.399505 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:32:44.399505 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:32:44.399505 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0c6560f-ade1-4ae6-905e-ad488f4c3b51 could not be found. Oct 27 03:32:44.399505 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:32:44.399505 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:32:44.399505 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:32:44.404162 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:32:44.404162 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:32:44.404162 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:32:44.404162 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:32:44.404162 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:32:44.404162 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0c6560f-ade1-4ae6-905e-ad488f4c3b51 could not be found. Oct 27 03:32:44.404162 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:32:44.404162 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c2963c17-1dbc-4141-a909-780c30e3e7b3 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] Returning 404 to user: Instance b0c6560f-ade1-4ae6-905e-ad488f4c3b51 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:32:44.404162 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c2963c17-1dbc-4141-a909-780c30e3e7b3 tempest-ImagesOneServerTestJSON-1466754268 tempest-ImagesOneServerTestJSON-1466754268-project] 10.222.0.20 "GET /compute/v2.1/servers/b0c6560f-ade1-4ae6-905e-ad488f4c3b51" status: 404 len: 111 microversion: 2.1 time: 0.125348 Oct 27 03:32:44.415100 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1356/2893] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:44 2022] GET /compute/v2.1/servers/b0c6560f-ade1-4ae6-905e-ad488f4c3b51 => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:32:44.435671 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-af3ca879-ebe3-4d61-a592-61f24f0e4711 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:44.439388 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-af3ca879-ebe3-4d61-a592-61f24f0e4711 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:44.460994 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-af3ca879-ebe3-4d61-a592-61f24f0e4711 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:44.465865 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-af3ca879-ebe3-4d61-a592-61f24f0e4711 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:44.466685 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-af3ca879-ebe3-4d61-a592-61f24f0e4711 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:44.467461 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-af3ca879-ebe3-4d61-a592-61f24f0e4711 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:44.467942 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-af3ca879-ebe3-4d61-a592-61f24f0e4711 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:44.468806 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-af3ca879-ebe3-4d61-a592-61f24f0e4711 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:44.916579 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5064b568-798e-4205-8f19-ef19eec9adbe tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed44bf20b3464a53a3e3f6c9cd61cde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ee48e200624711b629a12b20c7d282', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:44.933300 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5064b568-798e-4205-8f19-ef19eec9adbe tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d23d8e-a80a-425c-a0a3-9e448853a94b" status: 200 len: 1370 microversion: 2.1 time: 0.676215 Oct 27 03:32:44.934389 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1538/2894] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:44 2022] GET /compute/v2.1/servers/f3d23d8e-a80a-425c-a0a3-9e448853a94b => generated 1370 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:44.941534 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ed334ae4-8990-4d8f-b4f7-d37c65d25ee9 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:44.942907 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ed334ae4-8990-4d8f-b4f7-d37c65d25ee9 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] [instance: 2e1b6a2e-8acc-4c77-b551-4a623893ebaf] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:44.951678 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-af3ca879-ebe3-4d61-a592-61f24f0e4711 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:44.953195 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ed334ae4-8990-4d8f-b4f7-d37c65d25ee9 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:44.954387 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ed334ae4-8990-4d8f-b4f7-d37c65d25ee9 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:44.955643 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ed334ae4-8990-4d8f-b4f7-d37c65d25ee9 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:44.956761 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ed334ae4-8990-4d8f-b4f7-d37c65d25ee9 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:44.962120 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-af3ca879-ebe3-4d61-a592-61f24f0e4711 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1671 microversion: 2.1 time: 0.544667 Oct 27 03:32:44.966467 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ed334ae4-8990-4d8f-b4f7-d37c65d25ee9 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:44.975747 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ed334ae4-8990-4d8f-b4f7-d37c65d25ee9 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:44.977870 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1357/2895] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:44 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1671 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:44.982875 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-423e4705-7173-4d7d-887e-9fca85f30868 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:44.983520 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-423e4705-7173-4d7d-887e-9fca85f30868 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] [instance: 0e0220c0-997d-4f48-9ac2-550d2ba017ca] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:45.002169 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-423e4705-7173-4d7d-887e-9fca85f30868 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:45.002685 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-423e4705-7173-4d7d-887e-9fca85f30868 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:45.003136 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-423e4705-7173-4d7d-887e-9fca85f30868 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:45.005206 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-423e4705-7173-4d7d-887e-9fca85f30868 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:45.005206 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-423e4705-7173-4d7d-887e-9fca85f30868 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:45.005206 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-423e4705-7173-4d7d-887e-9fca85f30868 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:45.173721 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-423e4705-7173-4d7d-887e-9fca85f30868 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd284264ddc64d58baee15e337d5fcc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd32721d34bc40679303d6f47daae25c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:45.207364 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-423e4705-7173-4d7d-887e-9fca85f30868 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] 10.222.0.20 "GET /compute/v2.1/servers/0e0220c0-997d-4f48-9ac2-550d2ba017ca" status: 200 len: 1301 microversion: 2.1 time: 0.228191 Oct 27 03:32:45.213598 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1358/2896] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:44 2022] GET /compute/v2.1/servers/0e0220c0-997d-4f48-9ac2-550d2ba017ca => generated 1301 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:45.221586 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-fb29390c-dcb2-4167-8ca7-45b3e9b3bb90 req-29701bc5-97ff-4a0d-9f52-0b45e6d7d8e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e1b6a2e-8acc-4c77-b551-4a623893ebaf", "tag": "6dd46327-1f2e-4081-b38e-032153dc5835"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:32:45.239450 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-fb29390c-dcb2-4167-8ca7-45b3e9b3bb90 req-29701bc5-97ff-4a0d-9f52-0b45e6d7d8e6 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:45.240024 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-fb29390c-dcb2-4167-8ca7-45b3e9b3bb90 req-29701bc5-97ff-4a0d-9f52-0b45e6d7d8e6 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:45.240379 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-fb29390c-dcb2-4167-8ca7-45b3e9b3bb90 req-29701bc5-97ff-4a0d-9f52-0b45e6d7d8e6 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:45.253293 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-fb29390c-dcb2-4167-8ca7-45b3e9b3bb90 req-29701bc5-97ff-4a0d-9f52-0b45e6d7d8e6 service nova] Creating event network-changed:6dd46327-1f2e-4081-b38e-032153dc5835 for instance 2e1b6a2e-8acc-4c77-b551-4a623893ebaf on n-h1-862769-1 Oct 27 03:32:45.261573 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-fb29390c-dcb2-4167-8ca7-45b3e9b3bb90 req-29701bc5-97ff-4a0d-9f52-0b45e6d7d8e6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045287 Oct 27 03:32:45.263127 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1359/2897] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:32:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:32:45.271307 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3a3783f0-2355-4766-bce4-7cb9dff00651 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:45.272626 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-3a3783f0-2355-4766-bce4-7cb9dff00651 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] [instance: bd1342fc-5bea-4391-a55e-b18610ded64b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:45.284468 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3a3783f0-2355-4766-bce4-7cb9dff00651 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:45.285190 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3a3783f0-2355-4766-bce4-7cb9dff00651 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:45.286133 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3a3783f0-2355-4766-bce4-7cb9dff00651 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:45.288041 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3a3783f0-2355-4766-bce4-7cb9dff00651 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:45.288773 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3a3783f0-2355-4766-bce4-7cb9dff00651 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:45.289432 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3a3783f0-2355-4766-bce4-7cb9dff00651 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:45.747176 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-3a3783f0-2355-4766-bce4-7cb9dff00651 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f391fe67b54a91a9519b3cde83f86c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da001b5c2a244160b5b5aa053eb318fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:45.760273 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3a3783f0-2355-4766-bce4-7cb9dff00651 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1342fc-5bea-4391-a55e-b18610ded64b" status: 200 len: 1316 microversion: 2.1 time: 0.495488 Oct 27 03:32:45.760956 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1360/2898] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:45 2022] GET /compute/v2.1/servers/bd1342fc-5bea-4391-a55e-b18610ded64b => generated 1316 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:45.767555 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0da74d22-b6b2-4e21-80ca-829aea545181 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:45.768568 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0da74d22-b6b2-4e21-80ca-829aea545181 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] [instance: 2023265c-1a97-4ed8-8af7-f83077e4bfa5] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:45.776477 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0da74d22-b6b2-4e21-80ca-829aea545181 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:45.777219 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0da74d22-b6b2-4e21-80ca-829aea545181 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:45.777933 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0da74d22-b6b2-4e21-80ca-829aea545181 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:45.778894 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0da74d22-b6b2-4e21-80ca-829aea545181 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:45.779524 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0da74d22-b6b2-4e21-80ca-829aea545181 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:45.780118 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0da74d22-b6b2-4e21-80ca-829aea545181 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:45.787657 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ed334ae4-8990-4d8f-b4f7-d37c65d25ee9 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533917bc5aa4e23802a43b1eb534bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d87abf835a4104b40056b9eec2d6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:45.827226 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ed334ae4-8990-4d8f-b4f7-d37c65d25ee9 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] 10.222.0.20 "GET /compute/v2.1/servers/2e1b6a2e-8acc-4c77-b551-4a623893ebaf" status: 200 len: 1314 microversion: 2.1 time: 0.891194 Oct 27 03:32:45.831904 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1539/2899] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:44 2022] GET /compute/v2.1/servers/2e1b6a2e-8acc-4c77-b551-4a623893ebaf => generated 1314 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:45.960399 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6280e504-c170-425e-9949-d1dae48580d4 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:45.962848 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-6280e504-c170-425e-9949-d1dae48580d4 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] [instance: f3d23d8e-a80a-425c-a0a3-9e448853a94b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:45.972898 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6280e504-c170-425e-9949-d1dae48580d4 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:45.973698 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6280e504-c170-425e-9949-d1dae48580d4 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:45.974725 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6280e504-c170-425e-9949-d1dae48580d4 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:45.975751 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6280e504-c170-425e-9949-d1dae48580d4 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:45.976591 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6280e504-c170-425e-9949-d1dae48580d4 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:45.977244 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6280e504-c170-425e-9949-d1dae48580d4 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:45.984480 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0da74d22-b6b2-4e21-80ca-829aea545181 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce351a48282492e8cd69b9a5a05f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5514904d799d4f5dae454193e70d85f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:45.999310 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0da74d22-b6b2-4e21-80ca-829aea545181 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] 10.222.0.20 "GET /compute/v2.1/servers/2023265c-1a97-4ed8-8af7-f83077e4bfa5" status: 200 len: 1541 microversion: 2.1 time: 0.236724 Oct 27 03:32:46.003770 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1361/2900] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:45 2022] GET /compute/v2.1/servers/2023265c-1a97-4ed8-8af7-f83077e4bfa5 => generated 1541 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:46.019056 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-354f51af-7f06-4d42-87e4-ddabd6baeec8 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:46.021376 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-354f51af-7f06-4d42-87e4-ddabd6baeec8 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:46.043116 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-354f51af-7f06-4d42-87e4-ddabd6baeec8 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:46.043644 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-354f51af-7f06-4d42-87e4-ddabd6baeec8 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:46.044107 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-354f51af-7f06-4d42-87e4-ddabd6baeec8 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:46.045077 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-354f51af-7f06-4d42-87e4-ddabd6baeec8 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:46.045560 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-354f51af-7f06-4d42-87e4-ddabd6baeec8 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:46.045934 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-354f51af-7f06-4d42-87e4-ddabd6baeec8 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:46.558295 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-354f51af-7f06-4d42-87e4-ddabd6baeec8 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:46.567050 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-354f51af-7f06-4d42-87e4-ddabd6baeec8 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1671 microversion: 2.1 time: 0.562116 Oct 27 03:32:46.567740 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1362/2901] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:46 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1671 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:46.572979 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0c568993-5255-4bf0-865e-bdc5f7e44bd6 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:46.573830 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0c568993-5255-4bf0-865e-bdc5f7e44bd6 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] [instance: 0e0220c0-997d-4f48-9ac2-550d2ba017ca] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:46.581272 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0c568993-5255-4bf0-865e-bdc5f7e44bd6 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:46.582006 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0c568993-5255-4bf0-865e-bdc5f7e44bd6 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:46.582626 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0c568993-5255-4bf0-865e-bdc5f7e44bd6 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:46.583593 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0c568993-5255-4bf0-865e-bdc5f7e44bd6 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:46.584199 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0c568993-5255-4bf0-865e-bdc5f7e44bd6 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:46.585509 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0c568993-5255-4bf0-865e-bdc5f7e44bd6 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:46.758956 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0c568993-5255-4bf0-865e-bdc5f7e44bd6 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd284264ddc64d58baee15e337d5fcc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd32721d34bc40679303d6f47daae25c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:46.786915 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0c568993-5255-4bf0-865e-bdc5f7e44bd6 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] 10.222.0.20 "GET /compute/v2.1/servers/0e0220c0-997d-4f48-9ac2-550d2ba017ca" status: 200 len: 1289 microversion: 2.1 time: 0.205782 Oct 27 03:32:46.790547 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1363/2902] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:46 2022] GET /compute/v2.1/servers/0e0220c0-997d-4f48-9ac2-550d2ba017ca => generated 1289 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:46.805434 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0192bda2-27b3-4593-bed4-bef9161b984e tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:46.806107 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0192bda2-27b3-4593-bed4-bef9161b984e tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] [instance: bd1342fc-5bea-4391-a55e-b18610ded64b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:46.823348 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0192bda2-27b3-4593-bed4-bef9161b984e tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:46.824282 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0192bda2-27b3-4593-bed4-bef9161b984e tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:46.828061 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0192bda2-27b3-4593-bed4-bef9161b984e tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:46.828252 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6280e504-c170-425e-9949-d1dae48580d4 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed44bf20b3464a53a3e3f6c9cd61cde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ee48e200624711b629a12b20c7d282', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:46.829207 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0192bda2-27b3-4593-bed4-bef9161b984e tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:46.832111 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0192bda2-27b3-4593-bed4-bef9161b984e tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:46.832702 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0192bda2-27b3-4593-bed4-bef9161b984e tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:46.856706 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6280e504-c170-425e-9949-d1dae48580d4 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d23d8e-a80a-425c-a0a3-9e448853a94b" status: 200 len: 1556 microversion: 2.1 time: 0.896401 Oct 27 03:32:46.856706 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1540/2903] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:45 2022] GET /compute/v2.1/servers/f3d23d8e-a80a-425c-a0a3-9e448853a94b => generated 1556 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:32:46.875279 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6b1b5ed1-80b3-49e0-83e7-bf7345233917 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:46.879029 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-6b1b5ed1-80b3-49e0-83e7-bf7345233917 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] [instance: 2e1b6a2e-8acc-4c77-b551-4a623893ebaf] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:46.893941 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6b1b5ed1-80b3-49e0-83e7-bf7345233917 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:46.893941 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6b1b5ed1-80b3-49e0-83e7-bf7345233917 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:46.893941 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6b1b5ed1-80b3-49e0-83e7-bf7345233917 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:46.893941 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6b1b5ed1-80b3-49e0-83e7-bf7345233917 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:46.893941 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6b1b5ed1-80b3-49e0-83e7-bf7345233917 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:46.895317 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6b1b5ed1-80b3-49e0-83e7-bf7345233917 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:47.085445 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0192bda2-27b3-4593-bed4-bef9161b984e tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f391fe67b54a91a9519b3cde83f86c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da001b5c2a244160b5b5aa053eb318fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:47.095696 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0192bda2-27b3-4593-bed4-bef9161b984e tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1342fc-5bea-4391-a55e-b18610ded64b" status: 200 len: 1316 microversion: 2.1 time: 0.304098 Oct 27 03:32:47.096921 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1364/2904] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:46 2022] GET /compute/v2.1/servers/bd1342fc-5bea-4391-a55e-b18610ded64b => generated 1316 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:47.101972 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7efa1c4e-c34b-4d7f-9189-bdd470236d22 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:47.102725 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7efa1c4e-c34b-4d7f-9189-bdd470236d22 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] [instance: f3d23d8e-a80a-425c-a0a3-9e448853a94b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:47.141360 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7efa1c4e-c34b-4d7f-9189-bdd470236d22 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:47.142524 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7efa1c4e-c34b-4d7f-9189-bdd470236d22 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:47.143318 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7efa1c4e-c34b-4d7f-9189-bdd470236d22 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:47.144153 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7efa1c4e-c34b-4d7f-9189-bdd470236d22 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:47.144726 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7efa1c4e-c34b-4d7f-9189-bdd470236d22 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:47.145262 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7efa1c4e-c34b-4d7f-9189-bdd470236d22 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:47.315739 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7efa1c4e-c34b-4d7f-9189-bdd470236d22 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d23d8e-a80a-425c-a0a3-9e448853a94b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.217483 Oct 27 03:32:47.326198 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1365/2905] 10.222.0.20 () {58 vars in 1275 bytes} [Thu Oct 27 03:32:47 2022] GET /compute/v2.1/servers/f3d23d8e-a80a-425c-a0a3-9e448853a94b/os-interface => generated 284 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:32:47.331445 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-32e2d085-b5c5-45ec-9c77-059bb226ad05 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:47.332362 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-32e2d085-b5c5-45ec-9c77-059bb226ad05 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] [instance: 2023265c-1a97-4ed8-8af7-f83077e4bfa5] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:47.344128 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-32e2d085-b5c5-45ec-9c77-059bb226ad05 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:47.344974 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-32e2d085-b5c5-45ec-9c77-059bb226ad05 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:47.346305 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-32e2d085-b5c5-45ec-9c77-059bb226ad05 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:47.347284 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-32e2d085-b5c5-45ec-9c77-059bb226ad05 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:47.348879 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-32e2d085-b5c5-45ec-9c77-059bb226ad05 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:47.349549 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-32e2d085-b5c5-45ec-9c77-059bb226ad05 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:47.467967 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-32e2d085-b5c5-45ec-9c77-059bb226ad05 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce351a48282492e8cd69b9a5a05f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5514904d799d4f5dae454193e70d85f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:47.480276 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-32e2d085-b5c5-45ec-9c77-059bb226ad05 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] 10.222.0.20 "GET /compute/v2.1/servers/2023265c-1a97-4ed8-8af7-f83077e4bfa5" status: 200 len: 1252 microversion: 2.1 time: 0.151924 Oct 27 03:32:47.481354 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1366/2906] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:47 2022] GET /compute/v2.1/servers/2023265c-1a97-4ed8-8af7-f83077e4bfa5 => generated 1252 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:47.495760 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-cff236d5-44c4-4c17-a7f0-352e1b3fa3c4 req-ed858788-65b3-4375-9e20-3b9ff41f6af9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd1342fc-5bea-4391-a55e-b18610ded64b", "tag": "23d29ca1-e2ea-4097-8339-3278dc4fb9c2"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:32:47.524234 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-cff236d5-44c4-4c17-a7f0-352e1b3fa3c4 req-ed858788-65b3-4375-9e20-3b9ff41f6af9 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:47.526899 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-cff236d5-44c4-4c17-a7f0-352e1b3fa3c4 req-ed858788-65b3-4375-9e20-3b9ff41f6af9 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:47.529590 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-cff236d5-44c4-4c17-a7f0-352e1b3fa3c4 req-ed858788-65b3-4375-9e20-3b9ff41f6af9 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:47.552681 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-cff236d5-44c4-4c17-a7f0-352e1b3fa3c4 req-ed858788-65b3-4375-9e20-3b9ff41f6af9 service nova] Creating event network-changed:23d29ca1-e2ea-4097-8339-3278dc4fb9c2 for instance bd1342fc-5bea-4391-a55e-b18610ded64b on n-h1-862769-1 Oct 27 03:32:47.565293 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-cff236d5-44c4-4c17-a7f0-352e1b3fa3c4 req-ed858788-65b3-4375-9e20-3b9ff41f6af9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077527 Oct 27 03:32:47.567441 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1367/2907] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:32:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:32:47.577258 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-d8988289-8b24-48bc-a503-507df729763d req-46851940-99a9-4fa8-b3dc-d04e48994198 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2023265c-1a97-4ed8-8af7-f83077e4bfa5", "name": "network-vif-deleted", "tag": "d7f2255f-3f7c-496f-a704-dc240ed9e307"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:32:47.600910 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-d8988289-8b24-48bc-a503-507df729763d req-46851940-99a9-4fa8-b3dc-d04e48994198 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:47.601397 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-d8988289-8b24-48bc-a503-507df729763d req-46851940-99a9-4fa8-b3dc-d04e48994198 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:47.601839 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-d8988289-8b24-48bc-a503-507df729763d req-46851940-99a9-4fa8-b3dc-d04e48994198 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:47.625028 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-d8988289-8b24-48bc-a503-507df729763d req-46851940-99a9-4fa8-b3dc-d04e48994198 service nova] Creating event network-vif-deleted:d7f2255f-3f7c-496f-a704-dc240ed9e307 for instance 2023265c-1a97-4ed8-8af7-f83077e4bfa5 on n-h2-862769-1 Oct 27 03:32:47.632094 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-d8988289-8b24-48bc-a503-507df729763d req-46851940-99a9-4fa8-b3dc-d04e48994198 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059551 Oct 27 03:32:47.633530 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1368/2908] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:32:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:32:47.634652 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6b1b5ed1-80b3-49e0-83e7-bf7345233917 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533917bc5aa4e23802a43b1eb534bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d87abf835a4104b40056b9eec2d6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:47.640859 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2437ae19-d7be-40b6-b1b5-c366410d1e1c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:47.641390 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-2437ae19-d7be-40b6-b1b5-c366410d1e1c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:47.648376 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2437ae19-d7be-40b6-b1b5-c366410d1e1c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:47.649008 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2437ae19-d7be-40b6-b1b5-c366410d1e1c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:47.649505 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2437ae19-d7be-40b6-b1b5-c366410d1e1c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:47.650450 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2437ae19-d7be-40b6-b1b5-c366410d1e1c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:47.650901 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6b1b5ed1-80b3-49e0-83e7-bf7345233917 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] 10.222.0.20 "GET /compute/v2.1/servers/2e1b6a2e-8acc-4c77-b551-4a623893ebaf" status: 200 len: 1314 microversion: 2.1 time: 0.790965 Oct 27 03:32:47.651021 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2437ae19-d7be-40b6-b1b5-c366410d1e1c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:47.651386 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2437ae19-d7be-40b6-b1b5-c366410d1e1c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:47.651519 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1541/2909] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:46 2022] GET /compute/v2.1/servers/2e1b6a2e-8acc-4c77-b551-4a623893ebaf => generated 1314 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:47.815111 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-cf9fa27e-cfd2-4db5-8020-27378b6a9f7f tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:47.817930 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-cf9fa27e-cfd2-4db5-8020-27378b6a9f7f tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] [instance: 0e0220c0-997d-4f48-9ac2-550d2ba017ca] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:47.825098 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cf9fa27e-cfd2-4db5-8020-27378b6a9f7f tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:47.825825 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cf9fa27e-cfd2-4db5-8020-27378b6a9f7f tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:47.826536 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cf9fa27e-cfd2-4db5-8020-27378b6a9f7f tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:47.827426 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cf9fa27e-cfd2-4db5-8020-27378b6a9f7f tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:47.829448 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cf9fa27e-cfd2-4db5-8020-27378b6a9f7f tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:47.832452 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cf9fa27e-cfd2-4db5-8020-27378b6a9f7f tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:48.108268 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2437ae19-d7be-40b6-b1b5-c366410d1e1c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:48.121264 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2437ae19-d7be-40b6-b1b5-c366410d1e1c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1671 microversion: 2.1 time: 0.485249 Oct 27 03:32:48.134059 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1369/2910] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:47 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1671 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:48.134059 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e6ce8568-39f7-44e5-9bac-24c29d021a45 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:48.134059 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e6ce8568-39f7-44e5-9bac-24c29d021a45 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] [instance: bd1342fc-5bea-4391-a55e-b18610ded64b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:48.142688 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e6ce8568-39f7-44e5-9bac-24c29d021a45 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:48.142688 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e6ce8568-39f7-44e5-9bac-24c29d021a45 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:48.142688 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e6ce8568-39f7-44e5-9bac-24c29d021a45 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:48.142688 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e6ce8568-39f7-44e5-9bac-24c29d021a45 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:48.152848 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e6ce8568-39f7-44e5-9bac-24c29d021a45 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:48.154676 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e6ce8568-39f7-44e5-9bac-24c29d021a45 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:48.463808 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:32:48.701048 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-cf9fa27e-cfd2-4db5-8020-27378b6a9f7f tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd284264ddc64d58baee15e337d5fcc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd32721d34bc40679303d6f47daae25c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:48.716211 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-cf9fa27e-cfd2-4db5-8020-27378b6a9f7f tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] 10.222.0.20 "GET /compute/v2.1/servers/0e0220c0-997d-4f48-9ac2-550d2ba017ca" status: 200 len: 1331 microversion: 2.1 time: 0.906072 Oct 27 03:32:48.718437 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1542/2911] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:47 2022] GET /compute/v2.1/servers/0e0220c0-997d-4f48-9ac2-550d2ba017ca => generated 1331 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:48.724453 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9b68a546-8430-4250-94d8-b4809ab87a9a tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:48.725348 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-9b68a546-8430-4250-94d8-b4809ab87a9a tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] [instance: 2023265c-1a97-4ed8-8af7-f83077e4bfa5] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:48.735104 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9b68a546-8430-4250-94d8-b4809ab87a9a tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:48.736661 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9b68a546-8430-4250-94d8-b4809ab87a9a tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:48.741405 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9b68a546-8430-4250-94d8-b4809ab87a9a tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:48.741405 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9b68a546-8430-4250-94d8-b4809ab87a9a tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:48.741405 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9b68a546-8430-4250-94d8-b4809ab87a9a tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:48.741405 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9b68a546-8430-4250-94d8-b4809ab87a9a tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:48.901982 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9b68a546-8430-4250-94d8-b4809ab87a9a tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce351a48282492e8cd69b9a5a05f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5514904d799d4f5dae454193e70d85f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:48.927012 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9b68a546-8430-4250-94d8-b4809ab87a9a tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] 10.222.0.20 "GET /compute/v2.1/servers/2023265c-1a97-4ed8-8af7-f83077e4bfa5" status: 200 len: 1252 microversion: 2.1 time: 0.205923 Oct 27 03:32:48.928804 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=8 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:32:48.929509 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1543/2912] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:48 2022] GET /compute/v2.1/servers/2023265c-1a97-4ed8-8af7-f83077e4bfa5 => generated 1252 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:48.946527 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e6ce8568-39f7-44e5-9bac-24c29d021a45 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f391fe67b54a91a9519b3cde83f86c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da001b5c2a244160b5b5aa053eb318fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:48.951797 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7185b538-02b2-4eda-bfd6-f0d395cf1e92 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:48.954306 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7185b538-02b2-4eda-bfd6-f0d395cf1e92 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] [instance: 2e1b6a2e-8acc-4c77-b551-4a623893ebaf] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:48.963338 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e6ce8568-39f7-44e5-9bac-24c29d021a45 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1342fc-5bea-4391-a55e-b18610ded64b" status: 200 len: 1316 microversion: 2.1 time: 0.839041 Oct 27 03:32:48.964250 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1370/2913] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:48 2022] GET /compute/v2.1/servers/bd1342fc-5bea-4391-a55e-b18610ded64b => generated 1316 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:48.967574 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7185b538-02b2-4eda-bfd6-f0d395cf1e92 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:48.969244 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7185b538-02b2-4eda-bfd6-f0d395cf1e92 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:48.969919 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7185b538-02b2-4eda-bfd6-f0d395cf1e92 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:48.970928 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7185b538-02b2-4eda-bfd6-f0d395cf1e92 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:48.972228 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7185b538-02b2-4eda-bfd6-f0d395cf1e92 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:48.972939 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7185b538-02b2-4eda-bfd6-f0d395cf1e92 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:49.047177 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=8 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:32:49.149139 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-67cba444-4e4e-45b3-b656-042287ffc357 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:49.150315 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-67cba444-4e4e-45b3-b656-042287ffc357 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:49.156578 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-67cba444-4e4e-45b3-b656-042287ffc357 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:49.157298 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-67cba444-4e4e-45b3-b656-042287ffc357 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:49.161389 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-67cba444-4e4e-45b3-b656-042287ffc357 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:49.161389 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-67cba444-4e4e-45b3-b656-042287ffc357 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:49.161389 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-67cba444-4e4e-45b3-b656-042287ffc357 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:49.161389 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-67cba444-4e4e-45b3-b656-042287ffc357 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:49.486557 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-67cba444-4e4e-45b3-b656-042287ffc357 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:49.499644 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-67cba444-4e4e-45b3-b656-042287ffc357 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1669 microversion: 2.1 time: 0.354254 Oct 27 03:32:49.500337 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1371/2914] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:49 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1669 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:32:49.530425 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7be258d4-620c-4a08-a107-f2712c49eda9 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:32:49.533699 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7be258d4-620c-4a08-a107-f2712c49eda9 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:49.541331 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7be258d4-620c-4a08-a107-f2712c49eda9 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:49.542323 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7be258d4-620c-4a08-a107-f2712c49eda9 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:49.542932 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7be258d4-620c-4a08-a107-f2712c49eda9 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:49.543840 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7be258d4-620c-4a08-a107-f2712c49eda9 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:49.544463 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7be258d4-620c-4a08-a107-f2712c49eda9 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:49.545060 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7be258d4-620c-4a08-a107-f2712c49eda9 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:49.635589 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7be258d4-620c-4a08-a107-f2712c49eda9 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "POST /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86/action" status: 200 len: 322 microversion: 2.1 time: 0.108996 Oct 27 03:32:49.641287 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1372/2915] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:32:49 2022] POST /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86/action => generated 322 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:32:49.647799 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4fda8b1a-69b2-45fa-a887-55e7ac1b3acc tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:49.649940 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4fda8b1a-69b2-45fa-a887-55e7ac1b3acc tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:49.669781 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4fda8b1a-69b2-45fa-a887-55e7ac1b3acc tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:49.670363 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4fda8b1a-69b2-45fa-a887-55e7ac1b3acc tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:49.670824 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4fda8b1a-69b2-45fa-a887-55e7ac1b3acc tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:49.673541 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4fda8b1a-69b2-45fa-a887-55e7ac1b3acc tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:49.674112 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4fda8b1a-69b2-45fa-a887-55e7ac1b3acc tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:49.678770 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4fda8b1a-69b2-45fa-a887-55e7ac1b3acc tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:49.819055 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7185b538-02b2-4eda-bfd6-f0d395cf1e92 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533917bc5aa4e23802a43b1eb534bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d87abf835a4104b40056b9eec2d6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:49.846395 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7185b538-02b2-4eda-bfd6-f0d395cf1e92 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] 10.222.0.20 "GET /compute/v2.1/servers/2e1b6a2e-8acc-4c77-b551-4a623893ebaf" status: 200 len: 1314 microversion: 2.1 time: 0.914793 Oct 27 03:32:49.847018 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1544/2916] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:48 2022] GET /compute/v2.1/servers/2e1b6a2e-8acc-4c77-b551-4a623893ebaf => generated 1314 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:49.852403 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c98492be-5623-4c7c-8632-fae4f71ef5e1 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:49.853034 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c98492be-5623-4c7c-8632-fae4f71ef5e1 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] [instance: 0e0220c0-997d-4f48-9ac2-550d2ba017ca] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:49.871994 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c98492be-5623-4c7c-8632-fae4f71ef5e1 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:49.875955 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c98492be-5623-4c7c-8632-fae4f71ef5e1 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:49.875955 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c98492be-5623-4c7c-8632-fae4f71ef5e1 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:49.875955 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c98492be-5623-4c7c-8632-fae4f71ef5e1 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:49.875955 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c98492be-5623-4c7c-8632-fae4f71ef5e1 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:49.875955 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c98492be-5623-4c7c-8632-fae4f71ef5e1 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:49.948165 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4fda8b1a-69b2-45fa-a887-55e7ac1b3acc tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:49.952011 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=100 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:32:49.957449 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4fda8b1a-69b2-45fa-a887-55e7ac1b3acc tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1669 microversion: 2.1 time: 0.314070 Oct 27 03:32:49.958678 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1373/2917] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:49 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1669 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:49.963695 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7fb25c70-968d-4180-b469-928c9f7b6813 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:49.964583 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7fb25c70-968d-4180-b469-928c9f7b6813 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] [instance: 2023265c-1a97-4ed8-8af7-f83077e4bfa5] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:49.980078 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7fb25c70-968d-4180-b469-928c9f7b6813 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:49.980822 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7fb25c70-968d-4180-b469-928c9f7b6813 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:49.981309 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7fb25c70-968d-4180-b469-928c9f7b6813 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:49.982311 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7fb25c70-968d-4180-b469-928c9f7b6813 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:49.982856 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7fb25c70-968d-4180-b469-928c9f7b6813 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:49.983365 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7fb25c70-968d-4180-b469-928c9f7b6813 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:50.042217 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=16 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:32:50.105173 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7fb25c70-968d-4180-b469-928c9f7b6813 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce351a48282492e8cd69b9a5a05f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5514904d799d4f5dae454193e70d85f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:50.113237 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7fb25c70-968d-4180-b469-928c9f7b6813 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] 10.222.0.20 "GET /compute/v2.1/servers/2023265c-1a97-4ed8-8af7-f83077e4bfa5" status: 200 len: 1252 microversion: 2.1 time: 0.153287 Oct 27 03:32:50.130521 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1374/2918] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:49 2022] GET /compute/v2.1/servers/2023265c-1a97-4ed8-8af7-f83077e4bfa5 => generated 1252 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:50.136223 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1c73f986-9385-45f9-aceb-ed42962fd765 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:50.142884 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1c73f986-9385-45f9-aceb-ed42962fd765 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:50.150679 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1c73f986-9385-45f9-aceb-ed42962fd765 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:50.151882 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1c73f986-9385-45f9-aceb-ed42962fd765 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:50.154481 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1c73f986-9385-45f9-aceb-ed42962fd765 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:50.155421 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1c73f986-9385-45f9-aceb-ed42962fd765 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:50.158475 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1c73f986-9385-45f9-aceb-ed42962fd765 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:50.159104 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1c73f986-9385-45f9-aceb-ed42962fd765 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:50.531951 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1c73f986-9385-45f9-aceb-ed42962fd765 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:50.538057 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c98492be-5623-4c7c-8632-fae4f71ef5e1 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd284264ddc64d58baee15e337d5fcc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd32721d34bc40679303d6f47daae25c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:50.543733 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1c73f986-9385-45f9-aceb-ed42962fd765 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1669 microversion: 2.1 time: 0.411486 Oct 27 03:32:50.545346 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1375/2919] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:50 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1669 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:50.551131 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-daefb6c4-68c7-4d39-a022-b6d6d309ea06 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:50.552040 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-daefb6c4-68c7-4d39-a022-b6d6d309ea06 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] [instance: bd1342fc-5bea-4391-a55e-b18610ded64b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:50.559509 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-daefb6c4-68c7-4d39-a022-b6d6d309ea06 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:50.560594 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-daefb6c4-68c7-4d39-a022-b6d6d309ea06 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:50.560744 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c98492be-5623-4c7c-8632-fae4f71ef5e1 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] 10.222.0.20 "GET /compute/v2.1/servers/0e0220c0-997d-4f48-9ac2-550d2ba017ca" status: 200 len: 1331 microversion: 2.1 time: 0.712513 Oct 27 03:32:50.561298 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1545/2920] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:49 2022] GET /compute/v2.1/servers/0e0220c0-997d-4f48-9ac2-550d2ba017ca => generated 1331 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:50.575918 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-daefb6c4-68c7-4d39-a022-b6d6d309ea06 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:50.576818 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-daefb6c4-68c7-4d39-a022-b6d6d309ea06 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:50.577383 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-daefb6c4-68c7-4d39-a022-b6d6d309ea06 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:50.577839 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-daefb6c4-68c7-4d39-a022-b6d6d309ea06 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:50.589952 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-de66641e-9e74-426f-b069-8c13629a6769 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:50.600448 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-de66641e-9e74-426f-b069-8c13629a6769 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:50.608086 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-de66641e-9e74-426f-b069-8c13629a6769 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:50.609071 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-de66641e-9e74-426f-b069-8c13629a6769 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:50.612683 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-de66641e-9e74-426f-b069-8c13629a6769 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:50.613671 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-de66641e-9e74-426f-b069-8c13629a6769 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:50.616896 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-de66641e-9e74-426f-b069-8c13629a6769 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:50.617553 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-de66641e-9e74-426f-b069-8c13629a6769 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:50.824619 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-daefb6c4-68c7-4d39-a022-b6d6d309ea06 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f391fe67b54a91a9519b3cde83f86c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da001b5c2a244160b5b5aa053eb318fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:50.837453 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-daefb6c4-68c7-4d39-a022-b6d6d309ea06 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1342fc-5bea-4391-a55e-b18610ded64b" status: 200 len: 1316 microversion: 2.1 time: 0.290513 Oct 27 03:32:50.838068 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1376/2921] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:50 2022] GET /compute/v2.1/servers/bd1342fc-5bea-4391-a55e-b18610ded64b => generated 1316 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:50.873335 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5b45bec5-fcee-4b17-a7df-3f20b8c4ee4f tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:50.874423 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5b45bec5-fcee-4b17-a7df-3f20b8c4ee4f tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] [instance: 2e1b6a2e-8acc-4c77-b551-4a623893ebaf] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:50.884158 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5b45bec5-fcee-4b17-a7df-3f20b8c4ee4f tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:50.885071 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5b45bec5-fcee-4b17-a7df-3f20b8c4ee4f tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:50.885815 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5b45bec5-fcee-4b17-a7df-3f20b8c4ee4f tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:50.886880 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5b45bec5-fcee-4b17-a7df-3f20b8c4ee4f tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:50.887653 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5b45bec5-fcee-4b17-a7df-3f20b8c4ee4f tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:50.888476 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5b45bec5-fcee-4b17-a7df-3f20b8c4ee4f tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:51.066246 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5b45bec5-fcee-4b17-a7df-3f20b8c4ee4f tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533917bc5aa4e23802a43b1eb534bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d87abf835a4104b40056b9eec2d6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:51.077860 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5b45bec5-fcee-4b17-a7df-3f20b8c4ee4f tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] 10.222.0.20 "GET /compute/v2.1/servers/2e1b6a2e-8acc-4c77-b551-4a623893ebaf" status: 200 len: 1314 microversion: 2.1 time: 0.209766 Oct 27 03:32:51.079477 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1377/2922] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:50 2022] GET /compute/v2.1/servers/2e1b6a2e-8acc-4c77-b551-4a623893ebaf => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:51.138853 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1ae34f13-50a1-467c-9ea9-0e2881fc90d2 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:51.139660 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1ae34f13-50a1-467c-9ea9-0e2881fc90d2 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] [instance: 2023265c-1a97-4ed8-8af7-f83077e4bfa5] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:51.151153 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1ae34f13-50a1-467c-9ea9-0e2881fc90d2 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:51.151889 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1ae34f13-50a1-467c-9ea9-0e2881fc90d2 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:51.152863 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1ae34f13-50a1-467c-9ea9-0e2881fc90d2 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:51.153689 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1ae34f13-50a1-467c-9ea9-0e2881fc90d2 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:51.157640 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1ae34f13-50a1-467c-9ea9-0e2881fc90d2 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:51.158378 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1ae34f13-50a1-467c-9ea9-0e2881fc90d2 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:51.171072 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-de66641e-9e74-426f-b069-8c13629a6769 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:51.186940 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-de66641e-9e74-426f-b069-8c13629a6769 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1669 microversion: 2.1 time: 0.619983 Oct 27 03:32:51.188698 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1546/2923] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:50 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1669 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:51.230558 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-04544eb5-f8cc-44e1-a897-0b0f883306c4 req-5c1ed03e-a32f-45e0-8be5-88e3748cb38c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e0220c0-997d-4f48-9ac2-550d2ba017ca", "tag": "08007cb1-7b3e-491c-aa88-e844f91f01cf"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:32:51.252089 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-04544eb5-f8cc-44e1-a897-0b0f883306c4 req-5c1ed03e-a32f-45e0-8be5-88e3748cb38c service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:51.252889 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-04544eb5-f8cc-44e1-a897-0b0f883306c4 req-5c1ed03e-a32f-45e0-8be5-88e3748cb38c service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:51.253636 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-04544eb5-f8cc-44e1-a897-0b0f883306c4 req-5c1ed03e-a32f-45e0-8be5-88e3748cb38c service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:51.279143 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-04544eb5-f8cc-44e1-a897-0b0f883306c4 req-5c1ed03e-a32f-45e0-8be5-88e3748cb38c service nova] Creating event network-changed:08007cb1-7b3e-491c-aa88-e844f91f01cf for instance 0e0220c0-997d-4f48-9ac2-550d2ba017ca on n-h2-862769-1 Oct 27 03:32:51.287453 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-04544eb5-f8cc-44e1-a897-0b0f883306c4 req-5c1ed03e-a32f-45e0-8be5-88e3748cb38c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096633 Oct 27 03:32:51.288795 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1547/2924] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:32:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:32:51.296418 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e6a654ea-2545-4ff6-9c1d-89013baef032 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:51.297478 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e6a654ea-2545-4ff6-9c1d-89013baef032 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:51.305507 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e6a654ea-2545-4ff6-9c1d-89013baef032 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:51.306437 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e6a654ea-2545-4ff6-9c1d-89013baef032 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:51.307075 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e6a654ea-2545-4ff6-9c1d-89013baef032 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:51.308023 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e6a654ea-2545-4ff6-9c1d-89013baef032 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:51.308925 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e6a654ea-2545-4ff6-9c1d-89013baef032 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:51.309519 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e6a654ea-2545-4ff6-9c1d-89013baef032 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:51.333267 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1ae34f13-50a1-467c-9ea9-0e2881fc90d2 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce351a48282492e8cd69b9a5a05f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5514904d799d4f5dae454193e70d85f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:51.347866 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1ae34f13-50a1-467c-9ea9-0e2881fc90d2 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] 10.222.0.20 "GET /compute/v2.1/servers/2023265c-1a97-4ed8-8af7-f83077e4bfa5" status: 200 len: 1252 microversion: 2.1 time: 0.207293 Oct 27 03:32:51.349046 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1378/2925] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:51 2022] GET /compute/v2.1/servers/2023265c-1a97-4ed8-8af7-f83077e4bfa5 => generated 1252 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:51.591154 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b093f276-0a78-498c-8d50-080cbe06f6eb tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:51.592109 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b093f276-0a78-498c-8d50-080cbe06f6eb tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] [instance: 0e0220c0-997d-4f48-9ac2-550d2ba017ca] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:51.603152 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b093f276-0a78-498c-8d50-080cbe06f6eb tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:51.610548 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b093f276-0a78-498c-8d50-080cbe06f6eb tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:51.610548 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b093f276-0a78-498c-8d50-080cbe06f6eb tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:51.610548 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b093f276-0a78-498c-8d50-080cbe06f6eb tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:51.610548 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b093f276-0a78-498c-8d50-080cbe06f6eb tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:51.610548 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b093f276-0a78-498c-8d50-080cbe06f6eb tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:51.713626 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e6a654ea-2545-4ff6-9c1d-89013baef032 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:51.732995 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e6a654ea-2545-4ff6-9c1d-89013baef032 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1669 microversion: 2.1 time: 0.440552 Oct 27 03:32:51.737860 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1548/2926] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:51 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1669 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:51.865047 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-dbc694fd-14ab-4236-b97c-72c7ade2b563 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:51.865047 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-dbc694fd-14ab-4236-b97c-72c7ade2b563 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] [instance: bd1342fc-5bea-4391-a55e-b18610ded64b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:51.870721 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dbc694fd-14ab-4236-b97c-72c7ade2b563 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:51.874185 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dbc694fd-14ab-4236-b97c-72c7ade2b563 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:51.875701 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dbc694fd-14ab-4236-b97c-72c7ade2b563 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:51.878426 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dbc694fd-14ab-4236-b97c-72c7ade2b563 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:51.878426 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dbc694fd-14ab-4236-b97c-72c7ade2b563 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:51.878814 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dbc694fd-14ab-4236-b97c-72c7ade2b563 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:52.040635 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b093f276-0a78-498c-8d50-080cbe06f6eb tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd284264ddc64d58baee15e337d5fcc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd32721d34bc40679303d6f47daae25c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:52.049623 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b093f276-0a78-498c-8d50-080cbe06f6eb tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] 10.222.0.20 "GET /compute/v2.1/servers/0e0220c0-997d-4f48-9ac2-550d2ba017ca" status: 200 len: 1331 microversion: 2.1 time: 0.463292 Oct 27 03:32:52.055585 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1379/2927] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:51 2022] GET /compute/v2.1/servers/0e0220c0-997d-4f48-9ac2-550d2ba017ca => generated 1331 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:52.071357 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5d2e4ab5-dc93-4d8c-978b-cde500fc0ca7 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2100272167", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": [{"uuid": "3c58b3a5-6f00-4601-ab92-e31d99f01594"}]}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:32:52.192893 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-5d2e4ab5-dc93-4d8c-978b-cde500fc0ca7 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] validate_networks() for [('3c58b3a5-6f00-4601-ab92-e31d99f01594', None, None, None, None, None)] {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:32:52.441684 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-dbc694fd-14ab-4236-b97c-72c7ade2b563 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f391fe67b54a91a9519b3cde83f86c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da001b5c2a244160b5b5aa053eb318fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:52.450584 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-dbc694fd-14ab-4236-b97c-72c7ade2b563 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1342fc-5bea-4391-a55e-b18610ded64b" status: 200 len: 1316 microversion: 2.1 time: 0.594458 Oct 27 03:32:52.451933 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1549/2928] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:51 2022] GET /compute/v2.1/servers/bd1342fc-5bea-4391-a55e-b18610ded64b => generated 1316 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:52.457953 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-980da5ed-3d33-4335-9578-8ad1a7d15ab0 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:52.458647 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-980da5ed-3d33-4335-9578-8ad1a7d15ab0 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] [instance: 2e1b6a2e-8acc-4c77-b551-4a623893ebaf] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:52.475792 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-980da5ed-3d33-4335-9578-8ad1a7d15ab0 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:52.476431 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-980da5ed-3d33-4335-9578-8ad1a7d15ab0 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:52.477265 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-980da5ed-3d33-4335-9578-8ad1a7d15ab0 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:52.478087 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-980da5ed-3d33-4335-9578-8ad1a7d15ab0 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:52.478620 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-980da5ed-3d33-4335-9578-8ad1a7d15ab0 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:52.484135 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-980da5ed-3d33-4335-9578-8ad1a7d15ab0 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:52.761803 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-980da5ed-3d33-4335-9578-8ad1a7d15ab0 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533917bc5aa4e23802a43b1eb534bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d87abf835a4104b40056b9eec2d6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:52.773169 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-980da5ed-3d33-4335-9578-8ad1a7d15ab0 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] 10.222.0.20 "GET /compute/v2.1/servers/2e1b6a2e-8acc-4c77-b551-4a623893ebaf" status: 200 len: 1314 microversion: 2.1 time: 0.320020 Oct 27 03:32:52.774715 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1550/2929] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:52 2022] GET /compute/v2.1/servers/2e1b6a2e-8acc-4c77-b551-4a623893ebaf => generated 1314 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:53.041076 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9f9c8212-4310-4c6e-9576-7b29da5d3e10 tempest-ImagesDeleteNegativeTestJSON-1329628709 tempest-ImagesDeleteNegativeTestJSON-1329628709-project] 10.222.0.20 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.265253 Oct 27 03:32:53.042168 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1551/2930] 10.222.0.20 () {58 vars in 1128 bytes} [Thu Oct 27 03:32:52 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 27 03:32:53.047092 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-06f8f703-5cc8-4649-ad68-61678041be20 req-74487e53-47ff-4393-acb1-5113245e4438 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e1b6a2e-8acc-4c77-b551-4a623893ebaf", "name": "network-vif-plugged", "status": "completed", "tag": "6dd46327-1f2e-4081-b38e-032153dc5835"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:32:53.062992 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-5d2e4ab5-dc93-4d8c-978b-cde500fc0ca7 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:32:53.063614 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-5d2e4ab5-dc93-4d8c-978b-cde500fc0ca7 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:32:53.063947 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-5d2e4ab5-dc93-4d8c-978b-cde500fc0ca7 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:32:53.064375 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-5d2e4ab5-dc93-4d8c-978b-cde500fc0ca7 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:32:53.064800 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-5d2e4ab5-dc93-4d8c-978b-cde500fc0ca7 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:32:53.073743 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-06f8f703-5cc8-4649-ad68-61678041be20 req-74487e53-47ff-4393-acb1-5113245e4438 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:53.074276 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-06f8f703-5cc8-4649-ad68-61678041be20 req-74487e53-47ff-4393-acb1-5113245e4438 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:53.074716 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-06f8f703-5cc8-4649-ad68-61678041be20 req-74487e53-47ff-4393-acb1-5113245e4438 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:53.080781 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5d2e4ab5-dc93-4d8c-978b-cde500fc0ca7 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:53.081528 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5d2e4ab5-dc93-4d8c-978b-cde500fc0ca7 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:53.081899 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:32:53.082644 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5d2e4ab5-dc93-4d8c-978b-cde500fc0ca7 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:53.083621 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5d2e4ab5-dc93-4d8c-978b-cde500fc0ca7 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:53.084326 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5d2e4ab5-dc93-4d8c-978b-cde500fc0ca7 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:53.084961 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5d2e4ab5-dc93-4d8c-978b-cde500fc0ca7 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:53.105268 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-06f8f703-5cc8-4649-ad68-61678041be20 req-74487e53-47ff-4393-acb1-5113245e4438 service nova] Creating event network-vif-plugged:6dd46327-1f2e-4081-b38e-032153dc5835 for instance 2e1b6a2e-8acc-4c77-b551-4a623893ebaf on n-h1-862769-1 Oct 27 03:32:53.116614 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-5d2e4ab5-dc93-4d8c-978b-cde500fc0ca7 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Getting quotas for project 3e9ede68f63747d59153a46412033856. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:32:53.117036 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-06f8f703-5cc8-4649-ad68-61678041be20 req-74487e53-47ff-4393-acb1-5113245e4438 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073456 Oct 27 03:32:53.120272 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1552/2931] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:32:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:32:53.131370 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-5d2e4ab5-dc93-4d8c-978b-cde500fc0ca7 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Getting quotas for user 94897f20beb94dbd8e7eff6ecba30026 and project 3e9ede68f63747d59153a46412033856. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:32:53.132435 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9583bb3a-68c1-4bf1-8fb8-e89257fff506 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:53.134558 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-9583bb3a-68c1-4bf1-8fb8-e89257fff506 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] [instance: 2023265c-1a97-4ed8-8af7-f83077e4bfa5] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:53.147800 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9583bb3a-68c1-4bf1-8fb8-e89257fff506 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:53.149303 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9583bb3a-68c1-4bf1-8fb8-e89257fff506 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:53.149951 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9583bb3a-68c1-4bf1-8fb8-e89257fff506 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:53.151030 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9583bb3a-68c1-4bf1-8fb8-e89257fff506 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:53.152132 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9583bb3a-68c1-4bf1-8fb8-e89257fff506 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:53.152800 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9583bb3a-68c1-4bf1-8fb8-e89257fff506 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:53.154817 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5d2e4ab5-dc93-4d8c-978b-cde500fc0ca7 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:32:53.159909 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5d2e4ab5-dc93-4d8c-978b-cde500fc0ca7 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: d70ad817-aab3-419c-85ab-b458bb9d8d26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:32:53.271422 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9583bb3a-68c1-4bf1-8fb8-e89257fff506 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce351a48282492e8cd69b9a5a05f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5514904d799d4f5dae454193e70d85f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:53.290686 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9583bb3a-68c1-4bf1-8fb8-e89257fff506 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] 10.222.0.20 "GET /compute/v2.1/servers/2023265c-1a97-4ed8-8af7-f83077e4bfa5" status: 200 len: 1252 microversion: 2.1 time: 0.168543 Oct 27 03:32:53.291875 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1553/2932] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:53 2022] GET /compute/v2.1/servers/2023265c-1a97-4ed8-8af7-f83077e4bfa5 => generated 1252 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:53.301171 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2a1e8a83-ddee-46a4-b1d1-428d06253336 tempest-ImagesDeleteNegativeTestJSON-1329628709 tempest-ImagesDeleteNegativeTestJSON-1329628709-project] Calling method '.version_select at 0x7f7dda4eb1f0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:53.346304 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-2a1e8a83-ddee-46a4-b1d1-428d06253336 tempest-ImagesDeleteNegativeTestJSON-1329628709 tempest-ImagesDeleteNegativeTestJSON-1329628709-project] HTTP exception thrown: Image not found. Oct 27 03:32:53.348293 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2a1e8a83-ddee-46a4-b1d1-428d06253336 tempest-ImagesDeleteNegativeTestJSON-1329628709 tempest-ImagesDeleteNegativeTestJSON-1329628709-project] Request method failure captured: Oct 27 03:32:53.348293 n-d-862769-1 devstack@n-api.service[121001]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Oct 27 03:32:53.348293 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:32:53.348293 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:32:53.348293 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:32:53.348293 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:32:53.348293 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:32:53.348293 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:32:53.348293 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:32:53.348293 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:32:53.348293 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfvjYylFcNSZ0vkpNYFTWoIQeDV5NdBz2rpJ-WSmBiZIKXES0oaVb-G2KnSjK0ovwrtMX_17DDwyMFU0rAGFoKOwvjXxVwM92X59kR_Y47Wejs06P3fQbIknU_JMueKcL5BQNBCVS9q3axTx_dEv8nXPxIiprZugvrpni0TdqJLsLAE Oct 27 03:32:53.348293 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:32:53.348293 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:32:53.348293 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:32:53.348293 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:32:53.348293 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:32:53.348293 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:32:53.348293 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 70e4000d770f4a2faadfe358ac12d8c8 Oct 27 03:32:53.348293 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1329628709 Oct 27 03:32:53.348293 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:32:53.348293 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:32:53.348293 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/70e4000d770f4a2faadfe358ac12d8c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/70e4000d770f4a2faadfe358ac12d8c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/70e4000d770f4a2faadfe358ac12d8c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_70e4000d770f4a2faadfe358ac12d8c8"}]}] Oct 27 03:32:53.348293 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1329628709 Oct 27 03:32:53.348293 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 70e4000d770f4a2faadfe358ac12d8c8 Oct 27 03:32:53.348293 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1329628709 Oct 27 03:32:53.348293 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ImagesDeleteNegativeTestJSON-1329628709-project Oct 27 03:32:53.348293 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:32:53.348293 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:32:53.348293 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: f49b3fec8ed549ce89cba8b043c3c414 Oct 27 03:32:53.348293 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1329628709-project Oct 27 03:32:53.348293 n-d-862769-1 devstack@n-api.service[121001]: method: Oct 27 03:32:53.348293 n-d-862769-1 devstack@n-api.service[121001]: exception: Image not found. Oct 27 03:32:53.348293 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '-1'} Oct 27 03:32:53.348293 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:32:53.348293 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:32:53.348293 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 27 03:32:53.348293 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 27 03:32:53.348293 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 03:32:53.348293 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 03:32:53.348293 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 03:32:53.348293 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 03:32:53.348293 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 27 03:32:53.348293 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 27 03:32:53.348293 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 27 03:32:53.348293 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 27 03:32:53.348293 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 03:32:53.348293 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 03:32:53.348293 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 03:32:53.348293 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 03:32:53.348293 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Oct 27 03:32:53.348293 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:32:53.348293 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:32:53.348293 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:32:53.348293 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:32:53.348293 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 27 03:32:53.348293 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 27 03:32:53.348293 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 27 03:32:53.348293 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 27 03:32:53.348293 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 27 03:32:53.348293 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 27 03:32:53.348293 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Oct 27 03:32:53.348293 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:32:53.348293 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:32:53.348293 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:32:53.348293 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:32:53.352790 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:32:53.352790 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:32:53.352790 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:32:53.352790 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:32:53.352790 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:32:53.352790 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:32:53.352790 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:32:53.352790 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:32:53.352790 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 27 03:32:53.352790 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 27 03:32:53.352790 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 27 03:32:53.352790 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:32:53.352790 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:32:53.352790 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:32:53.352790 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:32:53.352790 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:32:53.352790 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:32:53.352790 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:32:53.352790 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:32:53.352790 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 27 03:32:53.352790 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:32:53.352790 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2a1e8a83-ddee-46a4-b1d1-428d06253336 tempest-ImagesDeleteNegativeTestJSON-1329628709 tempest-ImagesDeleteNegativeTestJSON-1329628709-project] Returning 404 to user: Image not found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:32:53.352790 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2a1e8a83-ddee-46a4-b1d1-428d06253336 tempest-ImagesDeleteNegativeTestJSON-1329628709 tempest-ImagesDeleteNegativeTestJSON-1329628709-project] 10.222.0.20 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.056715 Oct 27 03:32:53.352790 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1554/2933] 10.222.0.20 () {58 vars in 1134 bytes} [Thu Oct 27 03:32:53 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 03:32:53.358291 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-33d6b01c-1bad-4b45-ab6e-8ec384f7bf8b tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:53.359005 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-33d6b01c-1bad-4b45-ab6e-8ec384f7bf8b tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] [instance: 0e0220c0-997d-4f48-9ac2-550d2ba017ca] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:53.388176 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-33d6b01c-1bad-4b45-ab6e-8ec384f7bf8b tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:53.389023 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-33d6b01c-1bad-4b45-ab6e-8ec384f7bf8b tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:53.389646 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-33d6b01c-1bad-4b45-ab6e-8ec384f7bf8b tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:53.390962 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-33d6b01c-1bad-4b45-ab6e-8ec384f7bf8b tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:53.393770 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-33d6b01c-1bad-4b45-ab6e-8ec384f7bf8b tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:53.394546 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-33d6b01c-1bad-4b45-ab6e-8ec384f7bf8b tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:53.423769 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5d2e4ab5-dc93-4d8c-978b-cde500fc0ca7 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.366788 Oct 27 03:32:53.432333 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1380/2934] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:32:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1370 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 03:32:53.445112 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-8a2628e8-8d21-4a27-903f-fdf6881be454 req-fc45137d-27b6-4512-8eb4-4617b1969522 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3d23d8e-a80a-425c-a0a3-9e448853a94b", "tag": "aa192bf0-ce03-4098-8949-343a75b75ddb"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:32:53.494610 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-8a2628e8-8d21-4a27-903f-fdf6881be454 req-fc45137d-27b6-4512-8eb4-4617b1969522 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:53.495429 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-8a2628e8-8d21-4a27-903f-fdf6881be454 req-fc45137d-27b6-4512-8eb4-4617b1969522 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:53.496590 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-8a2628e8-8d21-4a27-903f-fdf6881be454 req-fc45137d-27b6-4512-8eb4-4617b1969522 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:53.524458 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-8a2628e8-8d21-4a27-903f-fdf6881be454 req-fc45137d-27b6-4512-8eb4-4617b1969522 service nova] Creating event network-changed:aa192bf0-ce03-4098-8949-343a75b75ddb for instance f3d23d8e-a80a-425c-a0a3-9e448853a94b on n-h2-862769-1 Oct 27 03:32:53.545897 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-8a2628e8-8d21-4a27-903f-fdf6881be454 req-fc45137d-27b6-4512-8eb4-4617b1969522 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107921 Oct 27 03:32:53.547757 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1381/2935] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:32:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:32:53.556675 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c26bc3f6-0597-4d77-a4ff-0a2c9f61d4f6 tempest-ImagesDeleteNegativeTestJSON-1329628709 tempest-ImagesDeleteNegativeTestJSON-1329628709-project] Calling method '.version_select at 0x7f7dd9d994c0>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:53.607759 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-c26bc3f6-0597-4d77-a4ff-0a2c9f61d4f6 tempest-ImagesDeleteNegativeTestJSON-1329628709 tempest-ImagesDeleteNegativeTestJSON-1329628709-project] HTTP exception thrown: Image not found. Oct 27 03:32:53.610691 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c26bc3f6-0597-4d77-a4ff-0a2c9f61d4f6 tempest-ImagesDeleteNegativeTestJSON-1329628709 tempest-ImagesDeleteNegativeTestJSON-1329628709-project] Request method failure captured: Oct 27 03:32:53.610691 n-d-862769-1 devstack@n-api.service[121000]: request: DELETE /compute/v2.1/images/9fe327b6-03d4-4b17-b0ce-1edb4efa9afj HTTP/1.1 Oct 27 03:32:53.610691 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:32:53.610691 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:32:53.610691 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:32:53.610691 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:32:53.610691 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:32:53.610691 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:32:53.610691 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:32:53.610691 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:32:53.610691 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfvjYylFcNSZ0vkpNYFTWoIQeDV5NdBz2rpJ-WSmBiZIKXES0oaVb-G2KnSjK0ovwrtMX_17DDwyMFU0rAGFoKOwvjXxVwM92X59kR_Y47Wejs06P3fQbIknU_JMueKcL5BQNBCVS9q3axTx_dEv8nXPxIiprZugvrpni0TdqJLsLAE Oct 27 03:32:53.610691 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:32:53.610691 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:32:53.610691 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:32:53.610691 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:32:53.610691 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:32:53.610691 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:32:53.610691 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 70e4000d770f4a2faadfe358ac12d8c8 Oct 27 03:32:53.610691 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1329628709 Oct 27 03:32:53.610691 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:32:53.610691 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:32:53.610691 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/70e4000d770f4a2faadfe358ac12d8c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/70e4000d770f4a2faadfe358ac12d8c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/70e4000d770f4a2faadfe358ac12d8c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_70e4000d770f4a2faadfe358ac12d8c8"}]}] Oct 27 03:32:53.610691 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1329628709 Oct 27 03:32:53.610691 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 70e4000d770f4a2faadfe358ac12d8c8 Oct 27 03:32:53.610691 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1329628709 Oct 27 03:32:53.610691 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ImagesDeleteNegativeTestJSON-1329628709-project Oct 27 03:32:53.610691 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:32:53.610691 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:32:53.610691 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: f49b3fec8ed549ce89cba8b043c3c414 Oct 27 03:32:53.610691 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1329628709-project Oct 27 03:32:53.610691 n-d-862769-1 devstack@n-api.service[121000]: method: Oct 27 03:32:53.610691 n-d-862769-1 devstack@n-api.service[121000]: exception: Image not found. Oct 27 03:32:53.610691 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '9fe327b6-03d4-4b17-b0ce-1edb4efa9afj'} Oct 27 03:32:53.610691 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:32:53.610691 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:32:53.610691 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 27 03:32:53.610691 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 27 03:32:53.610691 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 03:32:53.610691 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 03:32:53.610691 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 03:32:53.610691 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 03:32:53.610691 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 27 03:32:53.610691 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 27 03:32:53.610691 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 27 03:32:53.610691 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 27 03:32:53.610691 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 03:32:53.610691 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 03:32:53.610691 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 03:32:53.610691 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 03:32:53.610691 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 9fe327b6-03d4-4b17-b0ce-1edb4efa9afj to delete Oct 27 03:32:53.610691 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:32:53.610691 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:32:53.610691 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:32:53.610691 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:32:53.610691 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 27 03:32:53.610691 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 27 03:32:53.610691 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 27 03:32:53.610691 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 27 03:32:53.610691 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 27 03:32:53.610691 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 27 03:32:53.610691 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9fe327b6-03d4-4b17-b0ce-1edb4efa9afj could not be found. Oct 27 03:32:53.610691 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:32:53.610691 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:32:53.610691 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:32:53.614492 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:32:53.614492 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:32:53.614492 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:32:53.614492 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:32:53.614492 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:32:53.614492 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:32:53.614492 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:32:53.614492 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:32:53.614492 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:32:53.614492 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 27 03:32:53.614492 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 27 03:32:53.614492 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 27 03:32:53.614492 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:32:53.614492 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:32:53.614492 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:32:53.614492 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:32:53.614492 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:32:53.614492 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:32:53.614492 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:32:53.614492 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:32:53.614492 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 27 03:32:53.614492 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:32:53.617962 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c26bc3f6-0597-4d77-a4ff-0a2c9f61d4f6 tempest-ImagesDeleteNegativeTestJSON-1329628709 tempest-ImagesDeleteNegativeTestJSON-1329628709-project] Returning 404 to user: Image not found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:32:53.619497 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c26bc3f6-0597-4d77-a4ff-0a2c9f61d4f6 tempest-ImagesDeleteNegativeTestJSON-1329628709 tempest-ImagesDeleteNegativeTestJSON-1329628709-project] 10.222.0.20 "DELETE /compute/v2.1/images/9fe327b6-03d4-4b17-b0ce-1edb4efa9afj" status: 404 len: 62 microversion: 2.1 time: 0.068395 Oct 27 03:32:53.620260 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1382/2936] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:53 2022] DELETE /compute/v2.1/images/9fe327b6-03d4-4b17-b0ce-1edb4efa9afj => generated 62 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 03:32:53.630536 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-01c15f11-00c7-4c3c-b2f3-fdd012c15c26 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:53.631511 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-01c15f11-00c7-4c3c-b2f3-fdd012c15c26 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: d70ad817-aab3-419c-85ab-b458bb9d8d26] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:53.745505 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-33d6b01c-1bad-4b45-ab6e-8ec384f7bf8b tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd284264ddc64d58baee15e337d5fcc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd32721d34bc40679303d6f47daae25c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:53.757447 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-33d6b01c-1bad-4b45-ab6e-8ec384f7bf8b tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] 10.222.0.20 "GET /compute/v2.1/servers/0e0220c0-997d-4f48-9ac2-550d2ba017ca" status: 200 len: 1331 microversion: 2.1 time: 0.405455 Oct 27 03:32:53.764292 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1555/2937] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:53 2022] GET /compute/v2.1/servers/0e0220c0-997d-4f48-9ac2-550d2ba017ca => generated 1331 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:53.777181 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-74857485-47c6-40cd-8651-edf7bb1ec075 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:53.777181 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-74857485-47c6-40cd-8651-edf7bb1ec075 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] [instance: bd1342fc-5bea-4391-a55e-b18610ded64b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:53.788718 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:32:53.791812 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-74857485-47c6-40cd-8651-edf7bb1ec075 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:53.792346 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-74857485-47c6-40cd-8651-edf7bb1ec075 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:53.792807 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-74857485-47c6-40cd-8651-edf7bb1ec075 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:53.798520 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-74857485-47c6-40cd-8651-edf7bb1ec075 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:53.799240 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-74857485-47c6-40cd-8651-edf7bb1ec075 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:53.799544 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-74857485-47c6-40cd-8651-edf7bb1ec075 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:53.905451 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-01c15f11-00c7-4c3c-b2f3-fdd012c15c26 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:53.913429 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-01c15f11-00c7-4c3c-b2f3-fdd012c15c26 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/d70ad817-aab3-419c-85ab-b458bb9d8d26" status: 200 len: 1215 microversion: 2.1 time: 0.291931 Oct 27 03:32:53.914012 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1383/2938] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:53 2022] GET /compute/v2.1/servers/d70ad817-aab3-419c-85ab-b458bb9d8d26 => generated 1215 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:53.927159 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4ea85602-ac14-4622-a7da-85b30581f499 tempest-ImagesDeleteNegativeTestJSON-1329628709 tempest-ImagesDeleteNegativeTestJSON-1329628709-project] Calling method '.version_select at 0x7f7dd9d99310>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:53.952414 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-4ea85602-ac14-4622-a7da-85b30581f499 tempest-ImagesDeleteNegativeTestJSON-1329628709 tempest-ImagesDeleteNegativeTestJSON-1329628709-project] HTTP exception thrown: Image not found. Oct 27 03:32:53.955795 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4ea85602-ac14-4622-a7da-85b30581f499 tempest-ImagesDeleteNegativeTestJSON-1329628709 tempest-ImagesDeleteNegativeTestJSON-1329628709-project] Request method failure captured: Oct 27 03:32:53.955795 n-d-862769-1 devstack@n-api.service[121000]: request: DELETE /compute/v2.1/images/b181414d-776f-4ff2-b59e-1d68feabf02c1 HTTP/1.1 Oct 27 03:32:53.955795 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:32:53.955795 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:32:53.955795 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:32:53.955795 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:32:53.955795 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:32:53.955795 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:32:53.955795 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:32:53.955795 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:32:53.955795 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfvjYylFcNSZ0vkpNYFTWoIQeDV5NdBz2rpJ-WSmBiZIKXES0oaVb-G2KnSjK0ovwrtMX_17DDwyMFU0rAGFoKOwvjXxVwM92X59kR_Y47Wejs06P3fQbIknU_JMueKcL5BQNBCVS9q3axTx_dEv8nXPxIiprZugvrpni0TdqJLsLAE Oct 27 03:32:53.955795 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:32:53.955795 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:32:53.955795 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:32:53.955795 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:32:53.955795 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:32:53.955795 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:32:53.955795 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 70e4000d770f4a2faadfe358ac12d8c8 Oct 27 03:32:53.955795 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1329628709 Oct 27 03:32:53.955795 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:32:53.955795 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:32:53.955795 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/70e4000d770f4a2faadfe358ac12d8c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/70e4000d770f4a2faadfe358ac12d8c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/70e4000d770f4a2faadfe358ac12d8c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_70e4000d770f4a2faadfe358ac12d8c8"}]}] Oct 27 03:32:53.955795 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1329628709 Oct 27 03:32:53.955795 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 70e4000d770f4a2faadfe358ac12d8c8 Oct 27 03:32:53.955795 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1329628709 Oct 27 03:32:53.955795 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ImagesDeleteNegativeTestJSON-1329628709-project Oct 27 03:32:53.955795 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:32:53.955795 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:32:53.955795 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: f49b3fec8ed549ce89cba8b043c3c414 Oct 27 03:32:53.955795 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1329628709-project Oct 27 03:32:53.955795 n-d-862769-1 devstack@n-api.service[121000]: method: Oct 27 03:32:53.955795 n-d-862769-1 devstack@n-api.service[121000]: exception: Image not found. Oct 27 03:32:53.955795 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': 'b181414d-776f-4ff2-b59e-1d68feabf02c1'} Oct 27 03:32:53.955795 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:32:53.955795 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:32:53.955795 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 27 03:32:53.955795 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 27 03:32:53.955795 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 03:32:53.955795 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 03:32:53.955795 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 03:32:53.955795 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 03:32:53.955795 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 27 03:32:53.955795 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 27 03:32:53.955795 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 27 03:32:53.955795 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 27 03:32:53.955795 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 03:32:53.955795 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 03:32:53.955795 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 03:32:53.955795 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 03:32:53.955795 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image b181414d-776f-4ff2-b59e-1d68feabf02c1 to delete Oct 27 03:32:53.955795 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:32:53.955795 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:32:53.955795 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:32:53.955795 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:32:53.955795 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 27 03:32:53.955795 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 27 03:32:53.955795 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 27 03:32:53.955795 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 27 03:32:53.955795 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 27 03:32:53.955795 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 27 03:32:53.955795 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b181414d-776f-4ff2-b59e-1d68feabf02c1 could not be found. Oct 27 03:32:53.955795 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:32:53.955795 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:32:53.955795 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:32:53.965197 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:32:53.965197 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:32:53.965197 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:32:53.965197 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:32:53.965197 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:32:53.965197 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:32:53.965197 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:32:53.965197 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:32:53.965197 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:32:53.965197 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 27 03:32:53.965197 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 27 03:32:53.965197 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 27 03:32:53.965197 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:32:53.965197 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:32:53.965197 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:32:53.965197 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:32:53.965197 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:32:53.965197 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:32:53.965197 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:32:53.965197 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:32:53.965197 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 27 03:32:53.965197 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:32:53.965197 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4ea85602-ac14-4622-a7da-85b30581f499 tempest-ImagesDeleteNegativeTestJSON-1329628709 tempest-ImagesDeleteNegativeTestJSON-1329628709-project] Returning 404 to user: Image not found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:32:53.965197 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4ea85602-ac14-4622-a7da-85b30581f499 tempest-ImagesDeleteNegativeTestJSON-1329628709 tempest-ImagesDeleteNegativeTestJSON-1329628709-project] 10.222.0.20 "DELETE /compute/v2.1/images/b181414d-776f-4ff2-b59e-1d68feabf02c1" status: 404 len: 62 microversion: 2.1 time: 0.039428 Oct 27 03:32:53.965197 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1384/2939] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:32:53 2022] DELETE /compute/v2.1/images/b181414d-776f-4ff2-b59e-1d68feabf02c1 => generated 62 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 03:32:53.976071 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-642e2bba-2edc-463b-ac6b-32c84219d427 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:53.979177 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-642e2bba-2edc-463b-ac6b-32c84219d427 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] [instance: 2e1b6a2e-8acc-4c77-b551-4a623893ebaf] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:54.005101 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-642e2bba-2edc-463b-ac6b-32c84219d427 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:54.005887 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-642e2bba-2edc-463b-ac6b-32c84219d427 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:54.006512 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-642e2bba-2edc-463b-ac6b-32c84219d427 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:54.007405 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-642e2bba-2edc-463b-ac6b-32c84219d427 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:54.007859 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-642e2bba-2edc-463b-ac6b-32c84219d427 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:54.008284 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-642e2bba-2edc-463b-ac6b-32c84219d427 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:54.273312 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-74857485-47c6-40cd-8651-edf7bb1ec075 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f391fe67b54a91a9519b3cde83f86c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da001b5c2a244160b5b5aa053eb318fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:54.282732 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-74857485-47c6-40cd-8651-edf7bb1ec075 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1342fc-5bea-4391-a55e-b18610ded64b" status: 200 len: 1316 microversion: 2.1 time: 0.517207 Oct 27 03:32:54.286377 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1556/2940] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:53 2022] GET /compute/v2.1/servers/bd1342fc-5bea-4391-a55e-b18610ded64b => generated 1316 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:54.310701 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-80a27de6-1afd-4f21-9687-653e7ce9f87a tempest-ImagesDeleteNegativeTestJSON-1329628709 tempest-ImagesDeleteNegativeTestJSON-1329628709-project] Calling method '.version_select at 0x7f7dda4eb700>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:54.375777 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-80a27de6-1afd-4f21-9687-653e7ce9f87a tempest-ImagesDeleteNegativeTestJSON-1329628709 tempest-ImagesDeleteNegativeTestJSON-1329628709-project] HTTP exception thrown: Image not found. Oct 27 03:32:54.378387 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-80a27de6-1afd-4f21-9687-653e7ce9f87a tempest-ImagesDeleteNegativeTestJSON-1329628709 tempest-ImagesDeleteNegativeTestJSON-1329628709-project] Request method failure captured: Oct 27 03:32:54.378387 n-d-862769-1 devstack@n-api.service[121001]: request: DELETE /compute/v2.1/images/tempest-invalid-1661287401 HTTP/1.1 Oct 27 03:32:54.378387 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:32:54.378387 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:32:54.378387 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:32:54.378387 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:32:54.378387 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:32:54.378387 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:32:54.378387 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:32:54.378387 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:32:54.378387 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfvjYylFcNSZ0vkpNYFTWoIQeDV5NdBz2rpJ-WSmBiZIKXES0oaVb-G2KnSjK0ovwrtMX_17DDwyMFU0rAGFoKOwvjXxVwM92X59kR_Y47Wejs06P3fQbIknU_JMueKcL5BQNBCVS9q3axTx_dEv8nXPxIiprZugvrpni0TdqJLsLAE Oct 27 03:32:54.378387 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:32:54.378387 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:32:54.378387 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:32:54.378387 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:32:54.378387 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:32:54.378387 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:32:54.378387 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 70e4000d770f4a2faadfe358ac12d8c8 Oct 27 03:32:54.378387 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1329628709 Oct 27 03:32:54.378387 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:32:54.378387 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:32:54.378387 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/70e4000d770f4a2faadfe358ac12d8c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/70e4000d770f4a2faadfe358ac12d8c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/70e4000d770f4a2faadfe358ac12d8c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_70e4000d770f4a2faadfe358ac12d8c8"}]}] Oct 27 03:32:54.378387 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1329628709 Oct 27 03:32:54.378387 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 70e4000d770f4a2faadfe358ac12d8c8 Oct 27 03:32:54.378387 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1329628709 Oct 27 03:32:54.378387 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ImagesDeleteNegativeTestJSON-1329628709-project Oct 27 03:32:54.378387 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:32:54.378387 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:32:54.378387 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: f49b3fec8ed549ce89cba8b043c3c414 Oct 27 03:32:54.378387 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1329628709-project Oct 27 03:32:54.378387 n-d-862769-1 devstack@n-api.service[121001]: method: Oct 27 03:32:54.378387 n-d-862769-1 devstack@n-api.service[121001]: exception: Image not found. Oct 27 03:32:54.378387 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': 'tempest-invalid-1661287401'} Oct 27 03:32:54.378387 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:32:54.378387 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:32:54.378387 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 27 03:32:54.378387 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 27 03:32:54.378387 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 03:32:54.378387 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 03:32:54.378387 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 03:32:54.378387 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 03:32:54.378387 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 27 03:32:54.378387 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 27 03:32:54.378387 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 27 03:32:54.378387 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 27 03:32:54.378387 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 03:32:54.378387 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 03:32:54.378387 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 03:32:54.378387 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 03:32:54.378387 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-1661287401 to delete Oct 27 03:32:54.378387 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:32:54.378387 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:32:54.378387 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:32:54.378387 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:32:54.378387 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 27 03:32:54.378387 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 27 03:32:54.378387 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 27 03:32:54.378387 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 27 03:32:54.378387 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 27 03:32:54.378387 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 27 03:32:54.378387 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-1661287401 could not be found. Oct 27 03:32:54.378387 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:32:54.378387 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:32:54.378387 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:32:54.378387 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:32:54.383023 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:32:54.383023 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:32:54.383023 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:32:54.383023 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:32:54.383023 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:32:54.383023 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:32:54.383023 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:32:54.383023 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:32:54.383023 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 27 03:32:54.383023 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 27 03:32:54.383023 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 27 03:32:54.383023 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:32:54.383023 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:32:54.383023 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:32:54.383023 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:32:54.383023 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:32:54.383023 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:32:54.383023 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:32:54.383023 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:32:54.383023 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 27 03:32:54.383023 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:32:54.385449 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-80a27de6-1afd-4f21-9687-653e7ce9f87a tempest-ImagesDeleteNegativeTestJSON-1329628709 tempest-ImagesDeleteNegativeTestJSON-1329628709-project] Returning 404 to user: Image not found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:32:54.387051 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-80a27de6-1afd-4f21-9687-653e7ce9f87a tempest-ImagesDeleteNegativeTestJSON-1329628709 tempest-ImagesDeleteNegativeTestJSON-1329628709-project] 10.222.0.20 "DELETE /compute/v2.1/images/tempest-invalid-1661287401" status: 404 len: 62 microversion: 2.1 time: 0.098717 Oct 27 03:32:54.387801 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1557/2941] 10.222.0.20 () {58 vars in 1206 bytes} [Thu Oct 27 03:32:54 2022] DELETE /compute/v2.1/images/tempest-invalid-1661287401 => generated 62 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 03:32:54.399067 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-feaa7381-a8f9-41fb-8a5e-418ad4930fb8 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:54.404939 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-feaa7381-a8f9-41fb-8a5e-418ad4930fb8 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] [instance: 2023265c-1a97-4ed8-8af7-f83077e4bfa5] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:54.426195 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-feaa7381-a8f9-41fb-8a5e-418ad4930fb8 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:54.427845 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-feaa7381-a8f9-41fb-8a5e-418ad4930fb8 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:54.429153 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-feaa7381-a8f9-41fb-8a5e-418ad4930fb8 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:54.429999 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-feaa7381-a8f9-41fb-8a5e-418ad4930fb8 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:54.430503 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-feaa7381-a8f9-41fb-8a5e-418ad4930fb8 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:54.430947 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-feaa7381-a8f9-41fb-8a5e-418ad4930fb8 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:54.478863 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-feaa7381-a8f9-41fb-8a5e-418ad4930fb8 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:54.479636 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-feaa7381-a8f9-41fb-8a5e-418ad4930fb8 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:54.480283 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-feaa7381-a8f9-41fb-8a5e-418ad4930fb8 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:54.480951 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-feaa7381-a8f9-41fb-8a5e-418ad4930fb8 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lazy-loading 'fault' on Instance uuid 2023265c-1a97-4ed8-8af7-f83077e4bfa5 {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:32:54.548955 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-feaa7381-a8f9-41fb-8a5e-418ad4930fb8 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce351a48282492e8cd69b9a5a05f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5514904d799d4f5dae454193e70d85f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:54.558483 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-feaa7381-a8f9-41fb-8a5e-418ad4930fb8 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] 10.222.0.20 "GET /compute/v2.1/servers/2023265c-1a97-4ed8-8af7-f83077e4bfa5" status: 200 len: 1257 microversion: 2.1 time: 0.169192 Oct 27 03:32:54.559082 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1558/2942] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:54 2022] GET /compute/v2.1/servers/2023265c-1a97-4ed8-8af7-f83077e4bfa5 => generated 1257 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:54.574794 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-960d4a8a-0d96-4627-89f1-6765defc2773 tempest-ImagesDeleteNegativeTestJSON-1329628709 tempest-ImagesDeleteNegativeTestJSON-1329628709-project] Calling method '.version_select at 0x7f7dd9f91820>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:54.612179 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-960d4a8a-0d96-4627-89f1-6765defc2773 tempest-ImagesDeleteNegativeTestJSON-1329628709 tempest-ImagesDeleteNegativeTestJSON-1329628709-project] HTTP exception thrown: Image not found. Oct 27 03:32:54.625290 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-960d4a8a-0d96-4627-89f1-6765defc2773 tempest-ImagesDeleteNegativeTestJSON-1329628709 tempest-ImagesDeleteNegativeTestJSON-1329628709-project] Request method failure captured: Oct 27 03:32:54.625290 n-d-862769-1 devstack@n-api.service[121001]: request: DELETE /compute/v2.1/images/892a05e5-e443-4bac-a12a-597a91a61121 HTTP/1.1 Oct 27 03:32:54.625290 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:32:54.625290 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:32:54.625290 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:32:54.625290 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:32:54.625290 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:32:54.625290 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:32:54.625290 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:32:54.625290 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:32:54.625290 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfvjYylFcNSZ0vkpNYFTWoIQeDV5NdBz2rpJ-WSmBiZIKXES0oaVb-G2KnSjK0ovwrtMX_17DDwyMFU0rAGFoKOwvjXxVwM92X59kR_Y47Wejs06P3fQbIknU_JMueKcL5BQNBCVS9q3axTx_dEv8nXPxIiprZugvrpni0TdqJLsLAE Oct 27 03:32:54.625290 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:32:54.625290 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:32:54.625290 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:32:54.625290 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:32:54.625290 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:32:54.625290 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:32:54.625290 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 70e4000d770f4a2faadfe358ac12d8c8 Oct 27 03:32:54.625290 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1329628709 Oct 27 03:32:54.625290 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:32:54.625290 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:32:54.625290 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/70e4000d770f4a2faadfe358ac12d8c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/70e4000d770f4a2faadfe358ac12d8c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/70e4000d770f4a2faadfe358ac12d8c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_70e4000d770f4a2faadfe358ac12d8c8"}]}] Oct 27 03:32:54.625290 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1329628709 Oct 27 03:32:54.625290 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 70e4000d770f4a2faadfe358ac12d8c8 Oct 27 03:32:54.625290 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1329628709 Oct 27 03:32:54.625290 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ImagesDeleteNegativeTestJSON-1329628709-project Oct 27 03:32:54.625290 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:32:54.625290 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:32:54.625290 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: f49b3fec8ed549ce89cba8b043c3c414 Oct 27 03:32:54.625290 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1329628709-project Oct 27 03:32:54.625290 n-d-862769-1 devstack@n-api.service[121001]: method: Oct 27 03:32:54.625290 n-d-862769-1 devstack@n-api.service[121001]: exception: Image not found. Oct 27 03:32:54.625290 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '892a05e5-e443-4bac-a12a-597a91a61121'} Oct 27 03:32:54.625290 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:32:54.625290 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:32:54.625290 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 27 03:32:54.625290 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 27 03:32:54.625290 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 03:32:54.625290 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 03:32:54.625290 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 03:32:54.625290 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 03:32:54.625290 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 27 03:32:54.625290 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 27 03:32:54.625290 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 27 03:32:54.625290 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 27 03:32:54.625290 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 03:32:54.625290 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 03:32:54.625290 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 03:32:54.625290 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 03:32:54.625290 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 892a05e5-e443-4bac-a12a-597a91a61121 to delete Oct 27 03:32:54.625290 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:32:54.625290 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:32:54.625290 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:32:54.625290 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:32:54.625290 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 27 03:32:54.625290 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 27 03:32:54.625290 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 27 03:32:54.625290 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 27 03:32:54.625290 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 27 03:32:54.625290 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 27 03:32:54.625290 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 892a05e5-e443-4bac-a12a-597a91a61121 could not be found. Oct 27 03:32:54.625290 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:32:54.625290 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:32:54.625290 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:32:54.630092 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:32:54.630092 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:32:54.630092 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:32:54.630092 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:32:54.630092 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:32:54.630092 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:32:54.630092 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:32:54.630092 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:32:54.630092 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:32:54.630092 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 27 03:32:54.630092 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 27 03:32:54.630092 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 27 03:32:54.630092 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:32:54.630092 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:32:54.630092 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:32:54.630092 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:32:54.630092 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:32:54.630092 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:32:54.630092 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:32:54.630092 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:32:54.630092 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 27 03:32:54.630092 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:32:54.633237 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-960d4a8a-0d96-4627-89f1-6765defc2773 tempest-ImagesDeleteNegativeTestJSON-1329628709 tempest-ImagesDeleteNegativeTestJSON-1329628709-project] Returning 404 to user: Image not found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:32:54.634543 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-960d4a8a-0d96-4627-89f1-6765defc2773 tempest-ImagesDeleteNegativeTestJSON-1329628709 tempest-ImagesDeleteNegativeTestJSON-1329628709-project] 10.222.0.20 "DELETE /compute/v2.1/images/892a05e5-e443-4bac-a12a-597a91a61121" status: 404 len: 62 microversion: 2.1 time: 0.070578 Oct 27 03:32:54.635594 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1559/2943] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:54 2022] DELETE /compute/v2.1/images/892a05e5-e443-4bac-a12a-597a91a61121 => generated 62 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 03:32:54.781694 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-15fb321a-52c5-47bb-af3b-088acd835eb2 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:54.783834 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-15fb321a-52c5-47bb-af3b-088acd835eb2 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] [instance: 0e0220c0-997d-4f48-9ac2-550d2ba017ca] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:54.792766 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-15fb321a-52c5-47bb-af3b-088acd835eb2 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:54.795335 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-15fb321a-52c5-47bb-af3b-088acd835eb2 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:54.796031 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-15fb321a-52c5-47bb-af3b-088acd835eb2 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:54.800528 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-15fb321a-52c5-47bb-af3b-088acd835eb2 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:54.801333 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-15fb321a-52c5-47bb-af3b-088acd835eb2 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:54.801994 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-15fb321a-52c5-47bb-af3b-088acd835eb2 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:54.834863 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-642e2bba-2edc-463b-ac6b-32c84219d427 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533917bc5aa4e23802a43b1eb534bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d87abf835a4104b40056b9eec2d6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:54.846961 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-642e2bba-2edc-463b-ac6b-32c84219d427 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] 10.222.0.20 "GET /compute/v2.1/servers/2e1b6a2e-8acc-4c77-b551-4a623893ebaf" status: 200 len: 1314 microversion: 2.1 time: 0.885473 Oct 27 03:32:54.848345 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1385/2944] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:53 2022] GET /compute/v2.1/servers/2e1b6a2e-8acc-4c77-b551-4a623893ebaf => generated 1314 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:54.939714 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2905371f-79af-453c-bcf3-3f41c0dae8ee tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:54.940352 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-2905371f-79af-453c-bcf3-3f41c0dae8ee tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: d70ad817-aab3-419c-85ab-b458bb9d8d26] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:54.949658 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2905371f-79af-453c-bcf3-3f41c0dae8ee tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:54.950430 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2905371f-79af-453c-bcf3-3f41c0dae8ee tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:54.952341 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2905371f-79af-453c-bcf3-3f41c0dae8ee tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:54.953677 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2905371f-79af-453c-bcf3-3f41c0dae8ee tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:54.955503 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2905371f-79af-453c-bcf3-3f41c0dae8ee tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:54.959805 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2905371f-79af-453c-bcf3-3f41c0dae8ee tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:55.045342 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-15fb321a-52c5-47bb-af3b-088acd835eb2 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd284264ddc64d58baee15e337d5fcc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd32721d34bc40679303d6f47daae25c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:55.059759 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-15fb321a-52c5-47bb-af3b-088acd835eb2 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] 10.222.0.20 "GET /compute/v2.1/servers/0e0220c0-997d-4f48-9ac2-550d2ba017ca" status: 200 len: 1331 microversion: 2.1 time: 0.282638 Oct 27 03:32:55.063234 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1560/2945] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:54 2022] GET /compute/v2.1/servers/0e0220c0-997d-4f48-9ac2-550d2ba017ca => generated 1331 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:55.330088 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a87f6578-609b-4e36-9913-4fe840fc4372 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:55.330088 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a87f6578-609b-4e36-9913-4fe840fc4372 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] [instance: bd1342fc-5bea-4391-a55e-b18610ded64b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:55.333146 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a87f6578-609b-4e36-9913-4fe840fc4372 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:55.334660 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a87f6578-609b-4e36-9913-4fe840fc4372 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:55.335767 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a87f6578-609b-4e36-9913-4fe840fc4372 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:55.336693 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a87f6578-609b-4e36-9913-4fe840fc4372 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:55.337345 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a87f6578-609b-4e36-9913-4fe840fc4372 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:55.338001 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a87f6578-609b-4e36-9913-4fe840fc4372 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:55.702955 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a87f6578-609b-4e36-9913-4fe840fc4372 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f391fe67b54a91a9519b3cde83f86c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da001b5c2a244160b5b5aa053eb318fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:55.729268 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a87f6578-609b-4e36-9913-4fe840fc4372 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1342fc-5bea-4391-a55e-b18610ded64b" status: 200 len: 1316 microversion: 2.1 time: 0.420338 Oct 27 03:32:55.740265 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1561/2946] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:55 2022] GET /compute/v2.1/servers/bd1342fc-5bea-4391-a55e-b18610ded64b => generated 1316 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:32:55.758928 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-96884c1f-1fa4-4e7a-884d-d53c11c02e71 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:55.761852 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-96884c1f-1fa4-4e7a-884d-d53c11c02e71 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] [instance: 2023265c-1a97-4ed8-8af7-f83077e4bfa5] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:55.770163 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2905371f-79af-453c-bcf3-3f41c0dae8ee tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:55.773967 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-96884c1f-1fa4-4e7a-884d-d53c11c02e71 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:55.777180 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-96884c1f-1fa4-4e7a-884d-d53c11c02e71 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:55.779185 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-96884c1f-1fa4-4e7a-884d-d53c11c02e71 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:55.780325 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-96884c1f-1fa4-4e7a-884d-d53c11c02e71 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:55.783724 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2905371f-79af-453c-bcf3-3f41c0dae8ee tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/d70ad817-aab3-419c-85ab-b458bb9d8d26" status: 200 len: 1219 microversion: 2.1 time: 0.847941 Oct 27 03:32:55.783939 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-96884c1f-1fa4-4e7a-884d-d53c11c02e71 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:55.784741 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-96884c1f-1fa4-4e7a-884d-d53c11c02e71 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:55.785577 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1386/2947] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:54 2022] GET /compute/v2.1/servers/d70ad817-aab3-419c-85ab-b458bb9d8d26 => generated 1219 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:32:55.853630 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-96884c1f-1fa4-4e7a-884d-d53c11c02e71 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] HTTP exception thrown: Instance 2023265c-1a97-4ed8-8af7-f83077e4bfa5 could not be found. Oct 27 03:32:55.855272 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-96884c1f-1fa4-4e7a-884d-d53c11c02e71 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Request method failure captured: Oct 27 03:32:55.855272 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/2023265c-1a97-4ed8-8af7-f83077e4bfa5 HTTP/1.1 Oct 27 03:32:55.855272 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:32:55.855272 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:32:55.855272 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:32:55.855272 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:32:55.855272 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:32:55.855272 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:32:55.855272 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:32:55.855272 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:32:55.855272 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfsQQK0lc0FV_Nlrw9NiSLlnxZeh6o6XZm1aTQlnKi_BxKSQ-u1Cgqwqhn2_yd9dLjMbvhKxIeg6qDDDT-I7Wdoi8V2gtWKTikYW70cYC0bABBnFyHa-zSVq47CH7kHqgt4jWHflC9OBm3ecSLT5evKuids7D3hVzHp3ITAWC9FkG0k Oct 27 03:32:55.855272 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:32:55.855272 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:32:55.855272 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:32:55.855272 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:32:55.855272 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:32:55.855272 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:32:55.855272 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 5514904d799d4f5dae454193e70d85f6 Oct 27 03:32:55.855272 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServersTestBootFromVolume-610993046 Oct 27 03:32:55.855272 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:32:55.855272 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:32:55.855272 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5514904d799d4f5dae454193e70d85f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5514904d799d4f5dae454193e70d85f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5514904d799d4f5dae454193e70d85f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5514904d799d4f5dae454193e70d85f6"}]}] Oct 27 03:32:55.855272 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServersTestBootFromVolume-610993046 Oct 27 03:32:55.855272 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 5514904d799d4f5dae454193e70d85f6 Oct 27 03:32:55.855272 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServersTestBootFromVolume-610993046 Oct 27 03:32:55.855272 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServersTestBootFromVolume-610993046-project Oct 27 03:32:55.855272 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:32:55.855272 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:32:55.855272 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 9ce351a48282492e8cd69b9a5a05f545 Oct 27 03:32:55.855272 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServersTestBootFromVolume-610993046-project Oct 27 03:32:55.855272 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:32:55.855272 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 2023265c-1a97-4ed8-8af7-f83077e4bfa5 could not be found. Oct 27 03:32:55.855272 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '2023265c-1a97-4ed8-8af7-f83077e4bfa5'} Oct 27 03:32:55.855272 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:32:55.855272 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:32:55.855272 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:32:55.855272 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:32:55.855272 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:32:55.855272 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:32:55.855272 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:32:55.855272 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:32:55.855272 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:32:55.855272 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:32:55.855272 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2023265c-1a97-4ed8-8af7-f83077e4bfa5 could not be found. Oct 27 03:32:55.855272 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:32:55.855272 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:32:55.855272 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:32:55.855272 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:32:55.855272 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:32:55.855272 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:32:55.855272 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:32:55.855272 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:32:55.855272 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:32:55.855272 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:32:55.855272 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:32:55.855272 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:32:55.855272 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:32:55.855272 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:32:55.855272 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:32:55.855272 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:32:55.855272 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2023265c-1a97-4ed8-8af7-f83077e4bfa5 could not be found. Oct 27 03:32:55.855272 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:32:55.855272 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:32:55.855272 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:32:55.860025 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:32:55.860025 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:32:55.860025 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:32:55.860025 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:32:55.860025 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:32:55.860025 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2023265c-1a97-4ed8-8af7-f83077e4bfa5 could not be found. Oct 27 03:32:55.860025 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:32:55.860025 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-96884c1f-1fa4-4e7a-884d-d53c11c02e71 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Returning 404 to user: Instance 2023265c-1a97-4ed8-8af7-f83077e4bfa5 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:32:55.860025 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-96884c1f-1fa4-4e7a-884d-d53c11c02e71 tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] 10.222.0.20 "GET /compute/v2.1/servers/2023265c-1a97-4ed8-8af7-f83077e4bfa5" status: 404 len: 111 microversion: 2.1 time: 0.114193 Oct 27 03:32:55.863563 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1562/2948] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:55 2022] GET /compute/v2.1/servers/2023265c-1a97-4ed8-8af7-f83077e4bfa5 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:32:55.869794 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c28f43a4-e37c-43b0-8e14-c784ab6edb7f tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] Calling method '.version_select at 0x7f7ddec7cd30>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:55.876521 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6784857d-7ae1-4bec-9c82-8b4915d4864f tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:55.877150 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-6784857d-7ae1-4bec-9c82-8b4915d4864f tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] [instance: 2e1b6a2e-8acc-4c77-b551-4a623893ebaf] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:55.906424 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6784857d-7ae1-4bec-9c82-8b4915d4864f tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:55.907260 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6784857d-7ae1-4bec-9c82-8b4915d4864f tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:55.913485 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6784857d-7ae1-4bec-9c82-8b4915d4864f tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:55.913485 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6784857d-7ae1-4bec-9c82-8b4915d4864f tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:55.913485 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6784857d-7ae1-4bec-9c82-8b4915d4864f tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:55.913485 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6784857d-7ae1-4bec-9c82-8b4915d4864f tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:56.035029 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c28f43a4-e37c-43b0-8e14-c784ab6edb7f tempest-ServersTestBootFromVolume-610993046 tempest-ServersTestBootFromVolume-610993046-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1781272530" status: 202 len: 0 microversion: 2.1 time: 0.171573 Oct 27 03:32:56.036283 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1387/2949] 10.222.0.20 () {58 vars in 1221 bytes} [Thu Oct 27 03:32:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1781272530 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:32:56.050303 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-3614651f-3dfd-4b98-b4a7-de3de434c3d4 req-e4eeb71d-74ae-4d68-b082-9e9b77d68737 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd1342fc-5bea-4391-a55e-b18610ded64b", "name": "network-vif-plugged", "status": "completed", "tag": "23d29ca1-e2ea-4097-8339-3278dc4fb9c2"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:32:56.071467 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-3614651f-3dfd-4b98-b4a7-de3de434c3d4 req-e4eeb71d-74ae-4d68-b082-9e9b77d68737 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:56.082216 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-3614651f-3dfd-4b98-b4a7-de3de434c3d4 req-e4eeb71d-74ae-4d68-b082-9e9b77d68737 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:56.082711 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-3614651f-3dfd-4b98-b4a7-de3de434c3d4 req-e4eeb71d-74ae-4d68-b082-9e9b77d68737 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:56.095459 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-3614651f-3dfd-4b98-b4a7-de3de434c3d4 req-e4eeb71d-74ae-4d68-b082-9e9b77d68737 service nova] Creating event network-vif-plugged:23d29ca1-e2ea-4097-8339-3278dc4fb9c2 for instance bd1342fc-5bea-4391-a55e-b18610ded64b on n-h1-862769-1 Oct 27 03:32:56.101072 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-3614651f-3dfd-4b98-b4a7-de3de434c3d4 req-e4eeb71d-74ae-4d68-b082-9e9b77d68737 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063121 Oct 27 03:32:56.102452 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1388/2950] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:32:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:32:56.112138 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-cb05686b-b453-4c26-8bef-ad639dc76d06 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:56.113168 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-cb05686b-b453-4c26-8bef-ad639dc76d06 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] [instance: 0e0220c0-997d-4f48-9ac2-550d2ba017ca] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:56.137331 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cb05686b-b453-4c26-8bef-ad639dc76d06 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:56.138389 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cb05686b-b453-4c26-8bef-ad639dc76d06 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:56.139141 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cb05686b-b453-4c26-8bef-ad639dc76d06 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:56.140152 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cb05686b-b453-4c26-8bef-ad639dc76d06 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:56.140861 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cb05686b-b453-4c26-8bef-ad639dc76d06 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:56.141522 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cb05686b-b453-4c26-8bef-ad639dc76d06 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:56.531187 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6784857d-7ae1-4bec-9c82-8b4915d4864f tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533917bc5aa4e23802a43b1eb534bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d87abf835a4104b40056b9eec2d6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:56.546768 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-cb05686b-b453-4c26-8bef-ad639dc76d06 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd284264ddc64d58baee15e337d5fcc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd32721d34bc40679303d6f47daae25c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:56.547147 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6784857d-7ae1-4bec-9c82-8b4915d4864f tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] 10.222.0.20 "GET /compute/v2.1/servers/2e1b6a2e-8acc-4c77-b551-4a623893ebaf" status: 200 len: 1500 microversion: 2.1 time: 0.674731 Oct 27 03:32:56.547748 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1563/2951] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:55 2022] GET /compute/v2.1/servers/2e1b6a2e-8acc-4c77-b551-4a623893ebaf => generated 1500 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:56.576341 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-cf31fef7-2a3f-4639-acea-c2b939531de0 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:32:56.585099 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-cf31fef7-2a3f-4639-acea-c2b939531de0 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] [instance: 2e1b6a2e-8acc-4c77-b551-4a623893ebaf] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:56.596614 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-cb05686b-b453-4c26-8bef-ad639dc76d06 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] 10.222.0.20 "GET /compute/v2.1/servers/0e0220c0-997d-4f48-9ac2-550d2ba017ca" status: 200 len: 1331 microversion: 2.1 time: 0.491005 Oct 27 03:32:56.614825 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cf31fef7-2a3f-4639-acea-c2b939531de0 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:56.619264 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1389/2952] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:56 2022] GET /compute/v2.1/servers/0e0220c0-997d-4f48-9ac2-550d2ba017ca => generated 1331 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:56.620316 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cf31fef7-2a3f-4639-acea-c2b939531de0 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:56.620978 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cf31fef7-2a3f-4639-acea-c2b939531de0 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:56.622671 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cf31fef7-2a3f-4639-acea-c2b939531de0 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:56.623320 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cf31fef7-2a3f-4639-acea-c2b939531de0 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:56.623907 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cf31fef7-2a3f-4639-acea-c2b939531de0 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:56.660218 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-cf31fef7-2a3f-4639-acea-c2b939531de0 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lazy-loading 'flavor' on Instance uuid 2e1b6a2e-8acc-4c77-b551-4a623893ebaf {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:32:56.757557 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3d8d0029-3b15-4c9b-916b-612dde37c1b3 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:56.758353 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-3d8d0029-3b15-4c9b-916b-612dde37c1b3 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] [instance: bd1342fc-5bea-4391-a55e-b18610ded64b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:56.791248 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3d8d0029-3b15-4c9b-916b-612dde37c1b3 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:56.794688 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3d8d0029-3b15-4c9b-916b-612dde37c1b3 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:56.795365 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3d8d0029-3b15-4c9b-916b-612dde37c1b3 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:56.799928 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3d8d0029-3b15-4c9b-916b-612dde37c1b3 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:56.800597 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3d8d0029-3b15-4c9b-916b-612dde37c1b3 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:56.802876 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3d8d0029-3b15-4c9b-916b-612dde37c1b3 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:57.147044 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-3d8d0029-3b15-4c9b-916b-612dde37c1b3 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f391fe67b54a91a9519b3cde83f86c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da001b5c2a244160b5b5aa053eb318fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:57.158130 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3d8d0029-3b15-4c9b-916b-612dde37c1b3 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1342fc-5bea-4391-a55e-b18610ded64b" status: 200 len: 1316 microversion: 2.1 time: 0.402011 Oct 27 03:32:57.159669 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1390/2953] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:56 2022] GET /compute/v2.1/servers/bd1342fc-5bea-4391-a55e-b18610ded64b => generated 1316 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:57.168773 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7b84e52b-dac8-45c0-85fc-2e1fee966b53 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:57.169408 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7b84e52b-dac8-45c0-85fc-2e1fee966b53 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: d70ad817-aab3-419c-85ab-b458bb9d8d26] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:57.179550 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7b84e52b-dac8-45c0-85fc-2e1fee966b53 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:57.199228 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7b84e52b-dac8-45c0-85fc-2e1fee966b53 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:57.199935 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7b84e52b-dac8-45c0-85fc-2e1fee966b53 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:57.202375 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7b84e52b-dac8-45c0-85fc-2e1fee966b53 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:57.204775 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-cf31fef7-2a3f-4639-acea-c2b939531de0 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] 10.222.0.20 "POST /compute/v2.1/servers/2e1b6a2e-8acc-4c77-b551-4a623893ebaf/action" status: 200 len: 32 microversion: 2.1 time: 0.631417 Oct 27 03:32:57.205972 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7b84e52b-dac8-45c0-85fc-2e1fee966b53 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:57.207373 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7b84e52b-dac8-45c0-85fc-2e1fee966b53 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:57.210558 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1564/2954] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:32:56 2022] POST /compute/v2.1/servers/2e1b6a2e-8acc-4c77-b551-4a623893ebaf/action => generated 32 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 27 03:32:57.222133 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-05d08008-00c5-430f-8dff-56aea2408066 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:57.224596 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-05d08008-00c5-430f-8dff-56aea2408066 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] [instance: 2e1b6a2e-8acc-4c77-b551-4a623893ebaf] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:57.233193 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-05d08008-00c5-430f-8dff-56aea2408066 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:57.236332 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-05d08008-00c5-430f-8dff-56aea2408066 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:57.239773 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-05d08008-00c5-430f-8dff-56aea2408066 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:57.240825 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-05d08008-00c5-430f-8dff-56aea2408066 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:57.242371 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-05d08008-00c5-430f-8dff-56aea2408066 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:57.249272 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-05d08008-00c5-430f-8dff-56aea2408066 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:57.360222 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7b84e52b-dac8-45c0-85fc-2e1fee966b53 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:57.374711 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7b84e52b-dac8-45c0-85fc-2e1fee966b53 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/d70ad817-aab3-419c-85ab-b458bb9d8d26" status: 200 len: 1285 microversion: 2.1 time: 0.213853 Oct 27 03:32:57.388167 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1391/2955] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:57 2022] GET /compute/v2.1/servers/d70ad817-aab3-419c-85ab-b458bb9d8d26 => generated 1285 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:57.610562 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-05d08008-00c5-430f-8dff-56aea2408066 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533917bc5aa4e23802a43b1eb534bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d87abf835a4104b40056b9eec2d6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:57.621024 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-05d08008-00c5-430f-8dff-56aea2408066 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] 10.222.0.20 "GET /compute/v2.1/servers/2e1b6a2e-8acc-4c77-b551-4a623893ebaf" status: 200 len: 1506 microversion: 2.1 time: 0.405923 Oct 27 03:32:57.627227 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c9608304-e1f3-4667-b3c4-d8037fb17225 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:57.628099 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c9608304-e1f3-4667-b3c4-d8037fb17225 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] [instance: 0e0220c0-997d-4f48-9ac2-550d2ba017ca] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:57.631450 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:32:57.640524 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1565/2956] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:57 2022] GET /compute/v2.1/servers/2e1b6a2e-8acc-4c77-b551-4a623893ebaf => generated 1506 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:57.643669 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c9608304-e1f3-4667-b3c4-d8037fb17225 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:57.646147 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c9608304-e1f3-4667-b3c4-d8037fb17225 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:57.664986 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c9608304-e1f3-4667-b3c4-d8037fb17225 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:57.668445 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c9608304-e1f3-4667-b3c4-d8037fb17225 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:57.669127 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c9608304-e1f3-4667-b3c4-d8037fb17225 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:57.672112 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c9608304-e1f3-4667-b3c4-d8037fb17225 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:58.120481 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-7a1fb981-3c8d-42c9-a8d9-795460d8122c req-7e1a4f9c-f71d-4eda-b9db-c6309a94cae4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e0220c0-997d-4f48-9ac2-550d2ba017ca", "name": "network-vif-plugged", "status": "completed", "tag": "08007cb1-7b3e-491c-aa88-e844f91f01cf"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:32:58.140137 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-7a1fb981-3c8d-42c9-a8d9-795460d8122c req-7e1a4f9c-f71d-4eda-b9db-c6309a94cae4 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:58.140629 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-7a1fb981-3c8d-42c9-a8d9-795460d8122c req-7e1a4f9c-f71d-4eda-b9db-c6309a94cae4 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:58.143703 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-7a1fb981-3c8d-42c9-a8d9-795460d8122c req-7e1a4f9c-f71d-4eda-b9db-c6309a94cae4 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:58.175743 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-7a1fb981-3c8d-42c9-a8d9-795460d8122c req-7e1a4f9c-f71d-4eda-b9db-c6309a94cae4 service nova] Creating event network-vif-plugged:08007cb1-7b3e-491c-aa88-e844f91f01cf for instance 0e0220c0-997d-4f48-9ac2-550d2ba017ca on n-h2-862769-1 Oct 27 03:32:58.211011 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-7a1fb981-3c8d-42c9-a8d9-795460d8122c req-7e1a4f9c-f71d-4eda-b9db-c6309a94cae4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095898 Oct 27 03:32:58.215582 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1566/2957] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:32:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:32:58.224596 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-97af70c7-6874-4f33-8446-556a96471ecf tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:58.225665 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-97af70c7-6874-4f33-8446-556a96471ecf tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] [instance: bd1342fc-5bea-4391-a55e-b18610ded64b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:58.242816 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-97af70c7-6874-4f33-8446-556a96471ecf tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:58.244508 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-97af70c7-6874-4f33-8446-556a96471ecf tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:58.244508 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-97af70c7-6874-4f33-8446-556a96471ecf tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:58.250357 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-97af70c7-6874-4f33-8446-556a96471ecf tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:58.251324 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-97af70c7-6874-4f33-8446-556a96471ecf tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:58.251995 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-97af70c7-6874-4f33-8446-556a96471ecf tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:58.324493 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c9608304-e1f3-4667-b3c4-d8037fb17225 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd284264ddc64d58baee15e337d5fcc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd32721d34bc40679303d6f47daae25c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:58.336151 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c9608304-e1f3-4667-b3c4-d8037fb17225 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] 10.222.0.20 "GET /compute/v2.1/servers/0e0220c0-997d-4f48-9ac2-550d2ba017ca" status: 200 len: 1331 microversion: 2.1 time: 0.713198 Oct 27 03:32:58.340066 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1392/2958] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:57 2022] GET /compute/v2.1/servers/0e0220c0-997d-4f48-9ac2-550d2ba017ca => generated 1331 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:32:58.401746 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4fb55962-9425-4660-b3df-95e563d8b671 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:58.402419 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4fb55962-9425-4660-b3df-95e563d8b671 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: d70ad817-aab3-419c-85ab-b458bb9d8d26] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:58.415782 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4fb55962-9425-4660-b3df-95e563d8b671 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:58.418938 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4fb55962-9425-4660-b3df-95e563d8b671 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:58.420499 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4fb55962-9425-4660-b3df-95e563d8b671 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:58.422819 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4fb55962-9425-4660-b3df-95e563d8b671 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:58.426416 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4fb55962-9425-4660-b3df-95e563d8b671 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:58.439068 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4fb55962-9425-4660-b3df-95e563d8b671 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:58.740843 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-97af70c7-6874-4f33-8446-556a96471ecf tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f391fe67b54a91a9519b3cde83f86c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da001b5c2a244160b5b5aa053eb318fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:58.766600 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-97af70c7-6874-4f33-8446-556a96471ecf tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1342fc-5bea-4391-a55e-b18610ded64b" status: 200 len: 1503 microversion: 2.1 time: 0.553010 Oct 27 03:32:58.769385 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1567/2959] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:58 2022] GET /compute/v2.1/servers/bd1342fc-5bea-4391-a55e-b18610ded64b => generated 1503 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:58.774694 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-257d36ba-19b0-48f3-a16c-3b1cc3b5348e tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:58.775528 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-257d36ba-19b0-48f3-a16c-3b1cc3b5348e tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] [instance: 2e1b6a2e-8acc-4c77-b551-4a623893ebaf] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:58.784938 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-257d36ba-19b0-48f3-a16c-3b1cc3b5348e tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:58.785650 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-257d36ba-19b0-48f3-a16c-3b1cc3b5348e tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:58.786534 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-257d36ba-19b0-48f3-a16c-3b1cc3b5348e tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:58.788655 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-257d36ba-19b0-48f3-a16c-3b1cc3b5348e tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:58.789344 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-257d36ba-19b0-48f3-a16c-3b1cc3b5348e tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:58.789982 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-257d36ba-19b0-48f3-a16c-3b1cc3b5348e tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:58.957846 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4fb55962-9425-4660-b3df-95e563d8b671 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:58.979803 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4fb55962-9425-4660-b3df-95e563d8b671 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/d70ad817-aab3-419c-85ab-b458bb9d8d26" status: 200 len: 1315 microversion: 2.1 time: 0.582775 Oct 27 03:32:58.981932 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1393/2960] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:58 2022] GET /compute/v2.1/servers/d70ad817-aab3-419c-85ab-b458bb9d8d26 => generated 1315 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:32:59.002438 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7c47fd20-0f42-4111-bd7c-b0a1d7cddc05 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:59.003198 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7c47fd20-0f42-4111-bd7c-b0a1d7cddc05 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] [instance: bd1342fc-5bea-4391-a55e-b18610ded64b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:59.019969 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7c47fd20-0f42-4111-bd7c-b0a1d7cddc05 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:59.027073 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7c47fd20-0f42-4111-bd7c-b0a1d7cddc05 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:59.027073 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7c47fd20-0f42-4111-bd7c-b0a1d7cddc05 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:59.028597 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7c47fd20-0f42-4111-bd7c-b0a1d7cddc05 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:59.031586 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7c47fd20-0f42-4111-bd7c-b0a1d7cddc05 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:59.034139 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7c47fd20-0f42-4111-bd7c-b0a1d7cddc05 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:59.116403 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7c47fd20-0f42-4111-bd7c-b0a1d7cddc05 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1342fc-5bea-4391-a55e-b18610ded64b/ips" status: 200 len: 107 microversion: 2.1 time: 0.131735 Oct 27 03:32:59.120950 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1394/2961] 10.222.0.20 () {58 vars in 1248 bytes} [Thu Oct 27 03:32:58 2022] GET /compute/v2.1/servers/bd1342fc-5bea-4391-a55e-b18610ded64b/ips => generated 107 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:32:59.133426 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-69ce24a2-5a08-4508-90eb-f567a76e4e6f tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:59.133945 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-69ce24a2-5a08-4508-90eb-f567a76e4e6f tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] [instance: bd1342fc-5bea-4391-a55e-b18610ded64b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:59.151107 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-69ce24a2-5a08-4508-90eb-f567a76e4e6f tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:59.154625 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-69ce24a2-5a08-4508-90eb-f567a76e4e6f tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:59.159129 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-69ce24a2-5a08-4508-90eb-f567a76e4e6f tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:59.159129 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-69ce24a2-5a08-4508-90eb-f567a76e4e6f tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:59.159129 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-69ce24a2-5a08-4508-90eb-f567a76e4e6f tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:59.159129 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-69ce24a2-5a08-4508-90eb-f567a76e4e6f tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:59.184468 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-257d36ba-19b0-48f3-a16c-3b1cc3b5348e tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533917bc5aa4e23802a43b1eb534bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d87abf835a4104b40056b9eec2d6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:59.197200 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-257d36ba-19b0-48f3-a16c-3b1cc3b5348e tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] 10.222.0.20 "GET /compute/v2.1/servers/2e1b6a2e-8acc-4c77-b551-4a623893ebaf" status: 200 len: 1506 microversion: 2.1 time: 0.427495 Oct 27 03:32:59.203799 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1568/2962] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:58 2022] GET /compute/v2.1/servers/2e1b6a2e-8acc-4c77-b551-4a623893ebaf => generated 1506 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:32:59.242876 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-69ce24a2-5a08-4508-90eb-f567a76e4e6f tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1342fc-5bea-4391-a55e-b18610ded64b/ips" status: 200 len: 107 microversion: 2.1 time: 0.116250 Oct 27 03:32:59.243843 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1395/2963] 10.222.0.20 () {58 vars in 1248 bytes} [Thu Oct 27 03:32:59 2022] GET /compute/v2.1/servers/bd1342fc-5bea-4391-a55e-b18610ded64b/ips => generated 107 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:32:59.257005 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-996d3409-db56-4e2c-ade0-bd0cd6449eb5 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:59.258158 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-996d3409-db56-4e2c-ade0-bd0cd6449eb5 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] [instance: bd1342fc-5bea-4391-a55e-b18610ded64b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:59.269576 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-996d3409-db56-4e2c-ade0-bd0cd6449eb5 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:59.272171 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-996d3409-db56-4e2c-ade0-bd0cd6449eb5 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:59.272662 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-996d3409-db56-4e2c-ade0-bd0cd6449eb5 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:59.273410 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-996d3409-db56-4e2c-ade0-bd0cd6449eb5 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:59.273882 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-996d3409-db56-4e2c-ade0-bd0cd6449eb5 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:59.274353 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-996d3409-db56-4e2c-ade0-bd0cd6449eb5 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:59.311807 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-996d3409-db56-4e2c-ade0-bd0cd6449eb5 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1342fc-5bea-4391-a55e-b18610ded64b/ips/tempest-ServerAddressesTestJSON-89070937-network" status: 200 len: 92 microversion: 2.1 time: 0.058621 Oct 27 03:32:59.313153 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1569/2964] 10.222.0.20 () {58 vars in 1395 bytes} [Thu Oct 27 03:32:59 2022] GET /compute/v2.1/servers/bd1342fc-5bea-4391-a55e-b18610ded64b/ips/tempest-ServerAddressesTestJSON-89070937-network => generated 92 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 03:32:59.336371 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c05b25ff-82ec-49c7-b663-abdc2509cc3d tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:59.338162 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c05b25ff-82ec-49c7-b663-abdc2509cc3d tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] [instance: bd1342fc-5bea-4391-a55e-b18610ded64b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:59.352695 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c05b25ff-82ec-49c7-b663-abdc2509cc3d tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:59.353452 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c05b25ff-82ec-49c7-b663-abdc2509cc3d tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:59.354241 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c05b25ff-82ec-49c7-b663-abdc2509cc3d tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:59.355214 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c05b25ff-82ec-49c7-b663-abdc2509cc3d tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:59.355890 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c05b25ff-82ec-49c7-b663-abdc2509cc3d tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:59.356532 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c05b25ff-82ec-49c7-b663-abdc2509cc3d tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:59.363179 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a9483f2b-6d29-4c0f-b1b6-2e809ee93a0f tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:59.363821 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a9483f2b-6d29-4c0f-b1b6-2e809ee93a0f tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] [instance: 0e0220c0-997d-4f48-9ac2-550d2ba017ca] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:59.371595 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a9483f2b-6d29-4c0f-b1b6-2e809ee93a0f tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:59.372096 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a9483f2b-6d29-4c0f-b1b6-2e809ee93a0f tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:59.372557 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a9483f2b-6d29-4c0f-b1b6-2e809ee93a0f tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:59.373282 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a9483f2b-6d29-4c0f-b1b6-2e809ee93a0f tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:59.373836 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a9483f2b-6d29-4c0f-b1b6-2e809ee93a0f tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:59.379881 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a9483f2b-6d29-4c0f-b1b6-2e809ee93a0f tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:59.421265 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c05b25ff-82ec-49c7-b663-abdc2509cc3d tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] [instance: bd1342fc-5bea-4391-a55e-b18610ded64b] Going to try to terminate instance {{(pid=121000) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:32:59.447355 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=100 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:32:59.628176 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a9483f2b-6d29-4c0f-b1b6-2e809ee93a0f tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd284264ddc64d58baee15e337d5fcc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd32721d34bc40679303d6f47daae25c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:32:59.652298 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a9483f2b-6d29-4c0f-b1b6-2e809ee93a0f tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] 10.222.0.20 "GET /compute/v2.1/servers/0e0220c0-997d-4f48-9ac2-550d2ba017ca" status: 200 len: 1331 microversion: 2.1 time: 0.289298 Oct 27 03:32:59.653698 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1570/2965] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:59 2022] GET /compute/v2.1/servers/0e0220c0-997d-4f48-9ac2-550d2ba017ca => generated 1331 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:32:59.746970 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c05b25ff-82ec-49c7-b663-abdc2509cc3d tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] 10.222.0.20 "DELETE /compute/v2.1/servers/bd1342fc-5bea-4391-a55e-b18610ded64b" status: 204 len: 0 microversion: 2.1 time: 0.424862 Oct 27 03:32:59.750903 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1396/2966] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:32:59 2022] DELETE /compute/v2.1/servers/bd1342fc-5bea-4391-a55e-b18610ded64b => generated 0 bytes in 427 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:32:59.756916 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-de87c097-4b0c-4274-a8d9-33fda80275d8 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:32:59.757549 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-de87c097-4b0c-4274-a8d9-33fda80275d8 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] [instance: bd1342fc-5bea-4391-a55e-b18610ded64b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:32:59.766380 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-de87c097-4b0c-4274-a8d9-33fda80275d8 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:59.771913 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-de87c097-4b0c-4274-a8d9-33fda80275d8 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:59.772439 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-de87c097-4b0c-4274-a8d9-33fda80275d8 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:32:59.773419 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-de87c097-4b0c-4274-a8d9-33fda80275d8 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:32:59.773900 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-de87c097-4b0c-4274-a8d9-33fda80275d8 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:32:59.778667 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-de87c097-4b0c-4274-a8d9-33fda80275d8 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:00.005110 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e165aa37-1db9-446f-b143-37b3eb6efab6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:00.005832 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e165aa37-1db9-446f-b143-37b3eb6efab6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: d70ad817-aab3-419c-85ab-b458bb9d8d26] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:00.015222 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e165aa37-1db9-446f-b143-37b3eb6efab6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:00.015396 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-de87c097-4b0c-4274-a8d9-33fda80275d8 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f391fe67b54a91a9519b3cde83f86c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da001b5c2a244160b5b5aa053eb318fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:00.015730 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e165aa37-1db9-446f-b143-37b3eb6efab6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:00.016176 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e165aa37-1db9-446f-b143-37b3eb6efab6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:00.017517 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e165aa37-1db9-446f-b143-37b3eb6efab6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:00.017908 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e165aa37-1db9-446f-b143-37b3eb6efab6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:00.019533 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:33:00.024911 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-de87c097-4b0c-4274-a8d9-33fda80275d8 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1342fc-5bea-4391-a55e-b18610ded64b" status: 200 len: 1509 microversion: 2.1 time: 0.272894 Oct 27 03:33:00.025828 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1571/2967] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:59 2022] GET /compute/v2.1/servers/bd1342fc-5bea-4391-a55e-b18610ded64b => generated 1509 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:33:00.041502 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e165aa37-1db9-446f-b143-37b3eb6efab6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:00.227067 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ec1e543e-5672-4eb5-90f5-f4da3113c23a tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:00.231884 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ec1e543e-5672-4eb5-90f5-f4da3113c23a tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] [instance: 2e1b6a2e-8acc-4c77-b551-4a623893ebaf] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:00.234849 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ec1e543e-5672-4eb5-90f5-f4da3113c23a tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:00.235779 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ec1e543e-5672-4eb5-90f5-f4da3113c23a tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:00.236443 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ec1e543e-5672-4eb5-90f5-f4da3113c23a tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:00.237476 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ec1e543e-5672-4eb5-90f5-f4da3113c23a tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:00.238183 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ec1e543e-5672-4eb5-90f5-f4da3113c23a tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:00.238832 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ec1e543e-5672-4eb5-90f5-f4da3113c23a tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:00.492446 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ec1e543e-5672-4eb5-90f5-f4da3113c23a tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533917bc5aa4e23802a43b1eb534bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d87abf835a4104b40056b9eec2d6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:00.503765 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ec1e543e-5672-4eb5-90f5-f4da3113c23a tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] 10.222.0.20 "GET /compute/v2.1/servers/2e1b6a2e-8acc-4c77-b551-4a623893ebaf" status: 200 len: 1506 microversion: 2.1 time: 0.280471 Oct 27 03:33:00.504687 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1572/2968] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:00 2022] GET /compute/v2.1/servers/2e1b6a2e-8acc-4c77-b551-4a623893ebaf => generated 1506 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:33:00.521247 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e165aa37-1db9-446f-b143-37b3eb6efab6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:00.530592 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e165aa37-1db9-446f-b143-37b3eb6efab6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/d70ad817-aab3-419c-85ab-b458bb9d8d26" status: 200 len: 1315 microversion: 2.1 time: 0.529619 Oct 27 03:33:00.531195 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1397/2969] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:32:59 2022] GET /compute/v2.1/servers/d70ad817-aab3-419c-85ab-b458bb9d8d26 => generated 1315 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:33:00.679958 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2e007092-ab5a-485a-bb5a-2df7bc1478fe tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:00.680732 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2e007092-ab5a-485a-bb5a-2df7bc1478fe tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] [instance: 0e0220c0-997d-4f48-9ac2-550d2ba017ca] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:00.700576 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2e007092-ab5a-485a-bb5a-2df7bc1478fe tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:00.701103 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2e007092-ab5a-485a-bb5a-2df7bc1478fe tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:00.701558 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2e007092-ab5a-485a-bb5a-2df7bc1478fe tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:00.720969 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2e007092-ab5a-485a-bb5a-2df7bc1478fe tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:00.723091 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2e007092-ab5a-485a-bb5a-2df7bc1478fe tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:00.724338 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2e007092-ab5a-485a-bb5a-2df7bc1478fe tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:00.948729 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2e007092-ab5a-485a-bb5a-2df7bc1478fe tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd284264ddc64d58baee15e337d5fcc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd32721d34bc40679303d6f47daae25c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:00.964268 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2e007092-ab5a-485a-bb5a-2df7bc1478fe tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] 10.222.0.20 "GET /compute/v2.1/servers/0e0220c0-997d-4f48-9ac2-550d2ba017ca" status: 200 len: 1535 microversion: 2.1 time: 0.288179 Oct 27 03:33:00.965733 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1573/2970] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:00 2022] GET /compute/v2.1/servers/0e0220c0-997d-4f48-9ac2-550d2ba017ca => generated 1535 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:33:00.994970 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ff5f4bb1-f92f-472b-b8bb-5aae960a76cb tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Action: 'create', calling method: .version_select at 0x7f7dda180b80>, body: {"pool": "dd6710e4-668a-450b-b911-5422d980e3de"} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:33:01.049633 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-943235aa-fb32-471c-bed1-fe2bca7db2bb tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:01.050402 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-943235aa-fb32-471c-bed1-fe2bca7db2bb tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] [instance: bd1342fc-5bea-4391-a55e-b18610ded64b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:01.056969 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-943235aa-fb32-471c-bed1-fe2bca7db2bb tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:01.057792 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-943235aa-fb32-471c-bed1-fe2bca7db2bb tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:01.058542 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-943235aa-fb32-471c-bed1-fe2bca7db2bb tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:01.059511 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-943235aa-fb32-471c-bed1-fe2bca7db2bb tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:01.060253 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-943235aa-fb32-471c-bed1-fe2bca7db2bb tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:01.061064 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-943235aa-fb32-471c-bed1-fe2bca7db2bb tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:01.222325 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-943235aa-fb32-471c-bed1-fe2bca7db2bb tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f391fe67b54a91a9519b3cde83f86c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da001b5c2a244160b5b5aa053eb318fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:01.231396 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-943235aa-fb32-471c-bed1-fe2bca7db2bb tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1342fc-5bea-4391-a55e-b18610ded64b" status: 200 len: 1509 microversion: 2.1 time: 0.186748 Oct 27 03:33:01.232237 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1574/2971] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:01 2022] GET /compute/v2.1/servers/bd1342fc-5bea-4391-a55e-b18610ded64b => generated 1509 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:33:01.527867 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3a2247b2-9255-483e-a507-440403eeaa43 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:01.530441 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3a2247b2-9255-483e-a507-440403eeaa43 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] [instance: 2e1b6a2e-8acc-4c77-b551-4a623893ebaf] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:01.536208 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3a2247b2-9255-483e-a507-440403eeaa43 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:01.537075 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3a2247b2-9255-483e-a507-440403eeaa43 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:01.537598 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3a2247b2-9255-483e-a507-440403eeaa43 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:01.538617 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3a2247b2-9255-483e-a507-440403eeaa43 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:01.539310 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3a2247b2-9255-483e-a507-440403eeaa43 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:01.539825 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3a2247b2-9255-483e-a507-440403eeaa43 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:01.744449 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3a2247b2-9255-483e-a507-440403eeaa43 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533917bc5aa4e23802a43b1eb534bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d87abf835a4104b40056b9eec2d6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:01.758673 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3a2247b2-9255-483e-a507-440403eeaa43 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] 10.222.0.20 "GET /compute/v2.1/servers/2e1b6a2e-8acc-4c77-b551-4a623893ebaf" status: 200 len: 1506 microversion: 2.1 time: 0.234290 Oct 27 03:33:01.759696 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1575/2972] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:01 2022] GET /compute/v2.1/servers/2e1b6a2e-8acc-4c77-b551-4a623893ebaf => generated 1506 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:33:01.765642 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c64b7f5f-1068-48b7-88d1-577e1cae560a tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:01.766616 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c64b7f5f-1068-48b7-88d1-577e1cae560a tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: d70ad817-aab3-419c-85ab-b458bb9d8d26] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:01.774007 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c64b7f5f-1068-48b7-88d1-577e1cae560a tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:01.774984 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c64b7f5f-1068-48b7-88d1-577e1cae560a tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:01.775824 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c64b7f5f-1068-48b7-88d1-577e1cae560a tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:01.776557 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c64b7f5f-1068-48b7-88d1-577e1cae560a tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:01.777022 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c64b7f5f-1068-48b7-88d1-577e1cae560a tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:01.777654 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c64b7f5f-1068-48b7-88d1-577e1cae560a tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:01.978768 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c64b7f5f-1068-48b7-88d1-577e1cae560a tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:01.993568 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c64b7f5f-1068-48b7-88d1-577e1cae560a tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/d70ad817-aab3-419c-85ab-b458bb9d8d26" status: 200 len: 1315 microversion: 2.1 time: 0.232314 Oct 27 03:33:01.996837 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1576/2973] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:01 2022] GET /compute/v2.1/servers/d70ad817-aab3-419c-85ab-b458bb9d8d26 => generated 1315 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:33:02.019422 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-0d48ed69-0ffc-4bd8-991b-6a92067f96cb req-18bf0ea8-b43f-4a27-8719-e62639db13b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd1342fc-5bea-4391-a55e-b18610ded64b", "name": "network-vif-deleted", "tag": "23d29ca1-e2ea-4097-8339-3278dc4fb9c2"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:33:02.032117 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-0d48ed69-0ffc-4bd8-991b-6a92067f96cb req-18bf0ea8-b43f-4a27-8719-e62639db13b5 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:02.033630 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-0d48ed69-0ffc-4bd8-991b-6a92067f96cb req-18bf0ea8-b43f-4a27-8719-e62639db13b5 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:02.034099 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-0d48ed69-0ffc-4bd8-991b-6a92067f96cb req-18bf0ea8-b43f-4a27-8719-e62639db13b5 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:02.051525 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-0d48ed69-0ffc-4bd8-991b-6a92067f96cb req-18bf0ea8-b43f-4a27-8719-e62639db13b5 service nova] Creating event network-vif-deleted:23d29ca1-e2ea-4097-8339-3278dc4fb9c2 for instance bd1342fc-5bea-4391-a55e-b18610ded64b on n-h1-862769-1 Oct 27 03:33:02.056795 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-0d48ed69-0ffc-4bd8-991b-6a92067f96cb req-18bf0ea8-b43f-4a27-8719-e62639db13b5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044135 Oct 27 03:33:02.057418 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1577/2974] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:33:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:33:02.256886 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e9b21d74-8048-45e9-af3f-2d81a8a36cd9 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:02.257769 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e9b21d74-8048-45e9-af3f-2d81a8a36cd9 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] [instance: bd1342fc-5bea-4391-a55e-b18610ded64b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:02.264327 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e9b21d74-8048-45e9-af3f-2d81a8a36cd9 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:02.264829 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e9b21d74-8048-45e9-af3f-2d81a8a36cd9 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:02.265267 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e9b21d74-8048-45e9-af3f-2d81a8a36cd9 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:02.265976 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e9b21d74-8048-45e9-af3f-2d81a8a36cd9 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:02.266458 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e9b21d74-8048-45e9-af3f-2d81a8a36cd9 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:02.267440 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e9b21d74-8048-45e9-af3f-2d81a8a36cd9 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:02.341757 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e9b21d74-8048-45e9-af3f-2d81a8a36cd9 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f391fe67b54a91a9519b3cde83f86c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da001b5c2a244160b5b5aa053eb318fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:02.353827 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e9b21d74-8048-45e9-af3f-2d81a8a36cd9 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1342fc-5bea-4391-a55e-b18610ded64b" status: 200 len: 1301 microversion: 2.1 time: 0.101696 Oct 27 03:33:02.355123 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1578/2975] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:02 2022] GET /compute/v2.1/servers/bd1342fc-5bea-4391-a55e-b18610ded64b => generated 1301 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:33:02.787313 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-13e2a628-fabb-47bd-b168-89e12d16d47c tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:02.788789 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-13e2a628-fabb-47bd-b168-89e12d16d47c tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] [instance: 2e1b6a2e-8acc-4c77-b551-4a623893ebaf] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:02.822052 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-13e2a628-fabb-47bd-b168-89e12d16d47c tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:02.825095 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-13e2a628-fabb-47bd-b168-89e12d16d47c tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:02.826971 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-13e2a628-fabb-47bd-b168-89e12d16d47c tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:02.828010 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-13e2a628-fabb-47bd-b168-89e12d16d47c tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:02.828798 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-13e2a628-fabb-47bd-b168-89e12d16d47c tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:02.830769 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-13e2a628-fabb-47bd-b168-89e12d16d47c tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:02.986497 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-13e2a628-fabb-47bd-b168-89e12d16d47c tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533917bc5aa4e23802a43b1eb534bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d87abf835a4104b40056b9eec2d6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:02.996058 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-13e2a628-fabb-47bd-b168-89e12d16d47c tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] 10.222.0.20 "GET /compute/v2.1/servers/2e1b6a2e-8acc-4c77-b551-4a623893ebaf" status: 200 len: 1506 microversion: 2.1 time: 0.213488 Oct 27 03:33:02.996303 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1579/2976] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:02 2022] GET /compute/v2.1/servers/2e1b6a2e-8acc-4c77-b551-4a623893ebaf => generated 1506 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:33:03.016100 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-2089a49d-f9bd-44d1-b728-a3bd492ee1f3 req-b824ddf3-47ef-4d73-923f-e04e77724096 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d70ad817-aab3-419c-85ab-b458bb9d8d26", "tag": "c70fed81-8427-44e7-9315-905828e6c445"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:33:03.032543 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-2089a49d-f9bd-44d1-b728-a3bd492ee1f3 req-b824ddf3-47ef-4d73-923f-e04e77724096 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:03.033240 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-2089a49d-f9bd-44d1-b728-a3bd492ee1f3 req-b824ddf3-47ef-4d73-923f-e04e77724096 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:03.033706 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-2089a49d-f9bd-44d1-b728-a3bd492ee1f3 req-b824ddf3-47ef-4d73-923f-e04e77724096 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:03.045857 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-2089a49d-f9bd-44d1-b728-a3bd492ee1f3 req-b824ddf3-47ef-4d73-923f-e04e77724096 service nova] Creating event network-changed:c70fed81-8427-44e7-9315-905828e6c445 for instance d70ad817-aab3-419c-85ab-b458bb9d8d26 on n-h2-862769-1 Oct 27 03:33:03.052209 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-2089a49d-f9bd-44d1-b728-a3bd492ee1f3 req-b824ddf3-47ef-4d73-923f-e04e77724096 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051512 Oct 27 03:33:03.053476 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1580/2977] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:33:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:33:03.059547 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2969cf79-3a33-4418-8d11-3481f9aa5453 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:03.060708 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2969cf79-3a33-4418-8d11-3481f9aa5453 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: d70ad817-aab3-419c-85ab-b458bb9d8d26] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:03.068410 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2969cf79-3a33-4418-8d11-3481f9aa5453 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:03.069462 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2969cf79-3a33-4418-8d11-3481f9aa5453 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:03.070248 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2969cf79-3a33-4418-8d11-3481f9aa5453 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:03.071430 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2969cf79-3a33-4418-8d11-3481f9aa5453 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:03.072125 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2969cf79-3a33-4418-8d11-3481f9aa5453 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:03.073406 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2969cf79-3a33-4418-8d11-3481f9aa5453 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:03.096821 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:33:03.281517 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2969cf79-3a33-4418-8d11-3481f9aa5453 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:03.302786 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2969cf79-3a33-4418-8d11-3481f9aa5453 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/d70ad817-aab3-419c-85ab-b458bb9d8d26" status: 200 len: 1315 microversion: 2.1 time: 0.247461 Oct 27 03:33:03.304473 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1581/2978] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:03 2022] GET /compute/v2.1/servers/d70ad817-aab3-419c-85ab-b458bb9d8d26 => generated 1315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:33:03.385207 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7a442c72-f7d3-4d77-9004-e8f3934e86dd tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:03.387231 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7a442c72-f7d3-4d77-9004-e8f3934e86dd tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] [instance: bd1342fc-5bea-4391-a55e-b18610ded64b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:03.397160 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7a442c72-f7d3-4d77-9004-e8f3934e86dd tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:03.398185 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7a442c72-f7d3-4d77-9004-e8f3934e86dd tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:03.403138 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7a442c72-f7d3-4d77-9004-e8f3934e86dd tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:03.403138 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7a442c72-f7d3-4d77-9004-e8f3934e86dd tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:03.403138 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7a442c72-f7d3-4d77-9004-e8f3934e86dd tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:03.403138 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7a442c72-f7d3-4d77-9004-e8f3934e86dd tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:03.477267 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7a442c72-f7d3-4d77-9004-e8f3934e86dd tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:03.477763 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7a442c72-f7d3-4d77-9004-e8f3934e86dd tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:03.479096 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7a442c72-f7d3-4d77-9004-e8f3934e86dd tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:03.479835 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-7a442c72-f7d3-4d77-9004-e8f3934e86dd tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Lazy-loading 'fault' on Instance uuid bd1342fc-5bea-4391-a55e-b18610ded64b {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:33:03.553687 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7a442c72-f7d3-4d77-9004-e8f3934e86dd tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f391fe67b54a91a9519b3cde83f86c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da001b5c2a244160b5b5aa053eb318fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:03.569838 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7a442c72-f7d3-4d77-9004-e8f3934e86dd tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1342fc-5bea-4391-a55e-b18610ded64b" status: 200 len: 1306 microversion: 2.1 time: 0.193980 Oct 27 03:33:03.582135 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1582/2979] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:03 2022] GET /compute/v2.1/servers/bd1342fc-5bea-4391-a55e-b18610ded64b => generated 1306 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:33:03.909841 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=8 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:33:04.020979 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-75ebdcb9-3213-43ee-8fbe-441b98b19e31 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:04.022540 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-75ebdcb9-3213-43ee-8fbe-441b98b19e31 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] [instance: 2e1b6a2e-8acc-4c77-b551-4a623893ebaf] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:04.030193 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-75ebdcb9-3213-43ee-8fbe-441b98b19e31 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:04.030924 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-75ebdcb9-3213-43ee-8fbe-441b98b19e31 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:04.031833 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-75ebdcb9-3213-43ee-8fbe-441b98b19e31 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:04.033121 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-75ebdcb9-3213-43ee-8fbe-441b98b19e31 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:04.033574 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-75ebdcb9-3213-43ee-8fbe-441b98b19e31 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:04.034006 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-75ebdcb9-3213-43ee-8fbe-441b98b19e31 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:04.417614 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-75ebdcb9-3213-43ee-8fbe-441b98b19e31 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533917bc5aa4e23802a43b1eb534bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d87abf835a4104b40056b9eec2d6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:04.426245 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-75ebdcb9-3213-43ee-8fbe-441b98b19e31 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] 10.222.0.20 "GET /compute/v2.1/servers/2e1b6a2e-8acc-4c77-b551-4a623893ebaf" status: 200 len: 1506 microversion: 2.1 time: 0.410020 Oct 27 03:33:04.430435 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1583/2980] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:04 2022] GET /compute/v2.1/servers/2e1b6a2e-8acc-4c77-b551-4a623893ebaf => generated 1506 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:33:04.435428 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6cb42362-c397-4e2c-9453-6bd1c7dd5bf9 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:04.436048 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-6cb42362-c397-4e2c-9453-6bd1c7dd5bf9 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: d70ad817-aab3-419c-85ab-b458bb9d8d26] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:04.448848 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6cb42362-c397-4e2c-9453-6bd1c7dd5bf9 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:04.449540 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6cb42362-c397-4e2c-9453-6bd1c7dd5bf9 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:04.450327 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6cb42362-c397-4e2c-9453-6bd1c7dd5bf9 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:04.451234 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6cb42362-c397-4e2c-9453-6bd1c7dd5bf9 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:04.451854 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6cb42362-c397-4e2c-9453-6bd1c7dd5bf9 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:04.452504 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6cb42362-c397-4e2c-9453-6bd1c7dd5bf9 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:04.717533 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6cb42362-c397-4e2c-9453-6bd1c7dd5bf9 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:04.733371 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6cb42362-c397-4e2c-9453-6bd1c7dd5bf9 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/d70ad817-aab3-419c-85ab-b458bb9d8d26" status: 200 len: 1315 microversion: 2.1 time: 0.301613 Oct 27 03:33:04.738577 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1584/2981] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:04 2022] GET /compute/v2.1/servers/d70ad817-aab3-419c-85ab-b458bb9d8d26 => generated 1315 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:33:04.765057 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5f3eb229-4e80-43d5-98fb-eec482be8085 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:04.765829 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5f3eb229-4e80-43d5-98fb-eec482be8085 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] [instance: bd1342fc-5bea-4391-a55e-b18610ded64b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:04.772647 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5f3eb229-4e80-43d5-98fb-eec482be8085 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:04.794113 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5f3eb229-4e80-43d5-98fb-eec482be8085 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:04.799812 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5f3eb229-4e80-43d5-98fb-eec482be8085 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:04.800894 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5f3eb229-4e80-43d5-98fb-eec482be8085 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:04.801246 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5f3eb229-4e80-43d5-98fb-eec482be8085 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:04.801692 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5f3eb229-4e80-43d5-98fb-eec482be8085 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:04.852172 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-5f3eb229-4e80-43d5-98fb-eec482be8085 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] HTTP exception thrown: Instance bd1342fc-5bea-4391-a55e-b18610ded64b could not be found. Oct 27 03:33:04.857235 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5f3eb229-4e80-43d5-98fb-eec482be8085 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Request method failure captured: Oct 27 03:33:04.857235 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/bd1342fc-5bea-4391-a55e-b18610ded64b HTTP/1.1 Oct 27 03:33:04.857235 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:33:04.857235 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:33:04.857235 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:33:04.857235 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:33:04.857235 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:33:04.857235 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:33:04.857235 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:33:04.857235 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:33:04.857235 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfvQqySEyTsPNjeTXenTHMRk6TbAbJe_RXum0MVQM9NzAPBDYPI7YBiLRXI1-cvV-CByESS1mcgscfZq1aq1ryf6bxPifrFWi8AJb0JyV2vs1LVFgJkP0j-Fv-9hLg3Jer-676Mmt3m7GcDAhv3H2il4UPOtVZqcLh_Wbxa2UhQS040 Oct 27 03:33:04.857235 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:33:04.857235 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:33:04.857235 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:33:04.857235 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:33:04.857235 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:33:04.857235 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:33:04.857235 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: da001b5c2a244160b5b5aa053eb318fd Oct 27 03:33:04.857235 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServerAddressesTestJSON-660213859 Oct 27 03:33:04.857235 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:33:04.857235 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:33:04.857235 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/da001b5c2a244160b5b5aa053eb318fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/da001b5c2a244160b5b5aa053eb318fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/da001b5c2a244160b5b5aa053eb318fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_da001b5c2a244160b5b5aa053eb318fd"}]}] Oct 27 03:33:04.857235 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServerAddressesTestJSON-660213859 Oct 27 03:33:04.857235 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: da001b5c2a244160b5b5aa053eb318fd Oct 27 03:33:04.857235 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServerAddressesTestJSON-660213859 Oct 27 03:33:04.857235 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServerAddressesTestJSON-660213859-project Oct 27 03:33:04.857235 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:33:04.857235 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:33:04.857235 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: f8f391fe67b54a91a9519b3cde83f86c Oct 27 03:33:04.857235 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServerAddressesTestJSON-660213859-project Oct 27 03:33:04.857235 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:33:04.857235 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance bd1342fc-5bea-4391-a55e-b18610ded64b could not be found. Oct 27 03:33:04.857235 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': 'bd1342fc-5bea-4391-a55e-b18610ded64b'} Oct 27 03:33:04.857235 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:33:04.857235 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:33:04.857235 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:33:04.857235 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:33:04.857235 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:33:04.857235 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:33:04.857235 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:33:04.857235 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:33:04.857235 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:33:04.857235 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:33:04.857235 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd1342fc-5bea-4391-a55e-b18610ded64b could not be found. Oct 27 03:33:04.857235 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:33:04.857235 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:33:04.857235 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:33:04.857235 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:33:04.857235 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:33:04.857235 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:33:04.857235 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:33:04.857235 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:33:04.857235 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:33:04.857235 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:33:04.857235 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:33:04.857235 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:33:04.857235 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:33:04.857235 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:33:04.857235 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:33:04.857235 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:33:04.857235 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd1342fc-5bea-4391-a55e-b18610ded64b could not be found. Oct 27 03:33:04.857235 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:33:04.857235 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:33:04.857235 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:33:04.862603 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:33:04.862603 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:33:04.862603 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:33:04.862603 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:33:04.862603 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:33:04.862603 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd1342fc-5bea-4391-a55e-b18610ded64b could not be found. Oct 27 03:33:04.862603 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:33:04.864038 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5f3eb229-4e80-43d5-98fb-eec482be8085 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] Returning 404 to user: Instance bd1342fc-5bea-4391-a55e-b18610ded64b could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:33:04.865654 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5f3eb229-4e80-43d5-98fb-eec482be8085 tempest-ServerAddressesTestJSON-660213859 tempest-ServerAddressesTestJSON-660213859-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1342fc-5bea-4391-a55e-b18610ded64b" status: 404 len: 111 microversion: 2.1 time: 0.111503 Oct 27 03:33:04.866785 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1585/2982] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:04 2022] GET /compute/v2.1/servers/bd1342fc-5bea-4391-a55e-b18610ded64b => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:33:05.454761 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0752557a-75cc-41ea-a456-7259a71056ba tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:05.455393 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0752557a-75cc-41ea-a456-7259a71056ba tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] [instance: 2e1b6a2e-8acc-4c77-b551-4a623893ebaf] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:05.468571 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0752557a-75cc-41ea-a456-7259a71056ba tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:05.469151 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0752557a-75cc-41ea-a456-7259a71056ba tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:05.469649 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0752557a-75cc-41ea-a456-7259a71056ba tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:05.475924 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0752557a-75cc-41ea-a456-7259a71056ba tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:05.476420 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0752557a-75cc-41ea-a456-7259a71056ba tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:05.479269 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0752557a-75cc-41ea-a456-7259a71056ba tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:06.006582 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0752557a-75cc-41ea-a456-7259a71056ba tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533917bc5aa4e23802a43b1eb534bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d87abf835a4104b40056b9eec2d6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:06.014283 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0752557a-75cc-41ea-a456-7259a71056ba tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] 10.222.0.20 "GET /compute/v2.1/servers/2e1b6a2e-8acc-4c77-b551-4a623893ebaf" status: 200 len: 1506 microversion: 2.1 time: 0.565682 Oct 27 03:33:06.040470 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1586/2983] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:05 2022] GET /compute/v2.1/servers/2e1b6a2e-8acc-4c77-b551-4a623893ebaf => generated 1506 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:33:06.063577 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-11cbba9b-d6ae-4f42-a00b-191ff8d5abc4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:06.065880 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-11cbba9b-d6ae-4f42-a00b-191ff8d5abc4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: d70ad817-aab3-419c-85ab-b458bb9d8d26] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:06.078269 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-11cbba9b-d6ae-4f42-a00b-191ff8d5abc4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:06.079011 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-11cbba9b-d6ae-4f42-a00b-191ff8d5abc4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:06.081943 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-11cbba9b-d6ae-4f42-a00b-191ff8d5abc4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:06.082956 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-11cbba9b-d6ae-4f42-a00b-191ff8d5abc4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:06.083448 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-11cbba9b-d6ae-4f42-a00b-191ff8d5abc4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:06.083967 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-11cbba9b-d6ae-4f42-a00b-191ff8d5abc4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:06.332368 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ff5f4bb1-f92f-472b-b8bb-5aae960a76cb tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 5.342123 Oct 27 03:33:06.332995 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1398/2984] 10.222.0.20 () {60 vars in 1170 bytes} [Thu Oct 27 03:33:00 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 5344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:33:06.346676 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-254d44f7-2908-4d82-a39d-9cd3f49531bf tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.6.55"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:33:06.350087 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-254d44f7-2908-4d82-a39d-9cd3f49531bf tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] [instance: 0e0220c0-997d-4f48-9ac2-550d2ba017ca] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:06.365235 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-254d44f7-2908-4d82-a39d-9cd3f49531bf tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:06.366150 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-254d44f7-2908-4d82-a39d-9cd3f49531bf tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:06.366150 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-254d44f7-2908-4d82-a39d-9cd3f49531bf tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:06.366993 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-254d44f7-2908-4d82-a39d-9cd3f49531bf tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:06.367257 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-254d44f7-2908-4d82-a39d-9cd3f49531bf tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:06.367672 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-254d44f7-2908-4d82-a39d-9cd3f49531bf tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:06.411032 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-254d44f7-2908-4d82-a39d-9cd3f49531bf tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Acquiring lock "refresh_cache-0e0220c0-997d-4f48-9ac2-550d2ba017ca" {{(pid=121000) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 27 03:33:06.411718 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-254d44f7-2908-4d82-a39d-9cd3f49531bf tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Acquired lock "refresh_cache-0e0220c0-997d-4f48-9ac2-550d2ba017ca" {{(pid=121000) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 27 03:33:06.509840 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-11cbba9b-d6ae-4f42-a00b-191ff8d5abc4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:06.535517 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-11cbba9b-d6ae-4f42-a00b-191ff8d5abc4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/d70ad817-aab3-419c-85ab-b458bb9d8d26" status: 200 len: 1315 microversion: 2.1 time: 0.484747 Oct 27 03:33:06.539181 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1587/2985] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:06 2022] GET /compute/v2.1/servers/d70ad817-aab3-419c-85ab-b458bb9d8d26 => generated 1315 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:33:07.043248 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d8726524-230d-45a4-8d62-309c97bbab5c tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:07.044080 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d8726524-230d-45a4-8d62-309c97bbab5c tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] [instance: 2e1b6a2e-8acc-4c77-b551-4a623893ebaf] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:07.069733 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d8726524-230d-45a4-8d62-309c97bbab5c tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:07.080906 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d8726524-230d-45a4-8d62-309c97bbab5c tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:07.080906 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d8726524-230d-45a4-8d62-309c97bbab5c tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:07.092051 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d8726524-230d-45a4-8d62-309c97bbab5c tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:07.092775 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d8726524-230d-45a4-8d62-309c97bbab5c tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:07.105633 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d8726524-230d-45a4-8d62-309c97bbab5c tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:07.639169 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d8726524-230d-45a4-8d62-309c97bbab5c tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533917bc5aa4e23802a43b1eb534bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d87abf835a4104b40056b9eec2d6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:07.670139 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d8726524-230d-45a4-8d62-309c97bbab5c tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] 10.222.0.20 "GET /compute/v2.1/servers/2e1b6a2e-8acc-4c77-b551-4a623893ebaf" status: 200 len: 1506 microversion: 2.1 time: 0.627854 Oct 27 03:33:07.682066 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1588/2986] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:07 2022] GET /compute/v2.1/servers/2e1b6a2e-8acc-4c77-b551-4a623893ebaf => generated 1506 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:33:07.690234 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-afd97cf7-747f-4867-a0c7-697f276a10fd tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:07.691074 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-afd97cf7-747f-4867-a0c7-697f276a10fd tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: d70ad817-aab3-419c-85ab-b458bb9d8d26] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:07.706299 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-afd97cf7-747f-4867-a0c7-697f276a10fd tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:07.706941 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-afd97cf7-747f-4867-a0c7-697f276a10fd tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:07.707598 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-afd97cf7-747f-4867-a0c7-697f276a10fd tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:07.709156 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-afd97cf7-747f-4867-a0c7-697f276a10fd tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:07.710341 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-afd97cf7-747f-4867-a0c7-697f276a10fd tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:07.711733 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-afd97cf7-747f-4867-a0c7-697f276a10fd tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:08.348774 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-afd97cf7-747f-4867-a0c7-697f276a10fd tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:08.362243 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-afd97cf7-747f-4867-a0c7-697f276a10fd tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/d70ad817-aab3-419c-85ab-b458bb9d8d26" status: 200 len: 1315 microversion: 2.1 time: 0.689749 Oct 27 03:33:08.374635 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1589/2987] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:07 2022] GET /compute/v2.1/servers/d70ad817-aab3-419c-85ab-b458bb9d8d26 => generated 1315 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:33:08.696740 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-37674e44-d8e4-4a92-aa03-2c419ef908be tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:08.697993 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-37674e44-d8e4-4a92-aa03-2c419ef908be tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] [instance: 2e1b6a2e-8acc-4c77-b551-4a623893ebaf] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:08.720082 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-37674e44-d8e4-4a92-aa03-2c419ef908be tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:08.720883 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-37674e44-d8e4-4a92-aa03-2c419ef908be tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:08.721511 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-37674e44-d8e4-4a92-aa03-2c419ef908be tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:08.722448 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-37674e44-d8e4-4a92-aa03-2c419ef908be tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:08.723073 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-37674e44-d8e4-4a92-aa03-2c419ef908be tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:08.723672 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-37674e44-d8e4-4a92-aa03-2c419ef908be tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:08.728867 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=100 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:33:09.636762 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-37674e44-d8e4-4a92-aa03-2c419ef908be tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533917bc5aa4e23802a43b1eb534bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d87abf835a4104b40056b9eec2d6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:09.667349 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-37674e44-d8e4-4a92-aa03-2c419ef908be tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] 10.222.0.20 "GET /compute/v2.1/servers/2e1b6a2e-8acc-4c77-b551-4a623893ebaf" status: 200 len: 1506 microversion: 2.1 time: 0.973631 Oct 27 03:33:09.669710 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1590/2988] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:08 2022] GET /compute/v2.1/servers/2e1b6a2e-8acc-4c77-b551-4a623893ebaf => generated 1506 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:33:09.683438 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-91a97dc5-7a2f-4cce-b0f6-51e6a5e5b2f2 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:09.690656 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-91a97dc5-7a2f-4cce-b0f6-51e6a5e5b2f2 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: d70ad817-aab3-419c-85ab-b458bb9d8d26] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:09.706236 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-91a97dc5-7a2f-4cce-b0f6-51e6a5e5b2f2 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:09.709041 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-91a97dc5-7a2f-4cce-b0f6-51e6a5e5b2f2 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:09.710306 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-91a97dc5-7a2f-4cce-b0f6-51e6a5e5b2f2 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:09.712629 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-91a97dc5-7a2f-4cce-b0f6-51e6a5e5b2f2 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:09.715382 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-91a97dc5-7a2f-4cce-b0f6-51e6a5e5b2f2 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:09.716935 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-91a97dc5-7a2f-4cce-b0f6-51e6a5e5b2f2 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:09.811462 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-254d44f7-2908-4d82-a39d-9cd3f49531bf tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] [instance: 0e0220c0-997d-4f48-9ac2-550d2ba017ca] Building network info cache for instance {{(pid=121000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 27 03:33:10.286265 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-91a97dc5-7a2f-4cce-b0f6-51e6a5e5b2f2 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:10.304834 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-91a97dc5-7a2f-4cce-b0f6-51e6a5e5b2f2 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/d70ad817-aab3-419c-85ab-b458bb9d8d26" status: 200 len: 1315 microversion: 2.1 time: 0.633752 Oct 27 03:33:10.305441 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1591/2989] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:09 2022] GET /compute/v2.1/servers/d70ad817-aab3-419c-85ab-b458bb9d8d26 => generated 1315 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:33:10.310144 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-1e703b29-0a3b-4aae-a133-ed1846131da5 req-ce0dd94a-59ce-497a-91b5-f03d415058fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e0220c0-997d-4f48-9ac2-550d2ba017ca", "tag": "08007cb1-7b3e-491c-aa88-e844f91f01cf"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:33:10.330697 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-1e703b29-0a3b-4aae-a133-ed1846131da5 req-ce0dd94a-59ce-497a-91b5-f03d415058fe service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:10.331434 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-1e703b29-0a3b-4aae-a133-ed1846131da5 req-ce0dd94a-59ce-497a-91b5-f03d415058fe service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:10.332094 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-1e703b29-0a3b-4aae-a133-ed1846131da5 req-ce0dd94a-59ce-497a-91b5-f03d415058fe service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:10.344515 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-1e703b29-0a3b-4aae-a133-ed1846131da5 req-ce0dd94a-59ce-497a-91b5-f03d415058fe service nova] Creating event network-changed:08007cb1-7b3e-491c-aa88-e844f91f01cf for instance 0e0220c0-997d-4f48-9ac2-550d2ba017ca on n-h2-862769-1 Oct 27 03:33:10.350791 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-1e703b29-0a3b-4aae-a133-ed1846131da5 req-ce0dd94a-59ce-497a-91b5-f03d415058fe service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043865 Oct 27 03:33:10.351922 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1592/2990] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:33:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:33:10.694134 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-16de7fc3-2b55-4252-aa0c-150df93ced75 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:10.694968 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-16de7fc3-2b55-4252-aa0c-150df93ced75 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] [instance: 2e1b6a2e-8acc-4c77-b551-4a623893ebaf] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:10.707194 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-16de7fc3-2b55-4252-aa0c-150df93ced75 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:10.718834 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-16de7fc3-2b55-4252-aa0c-150df93ced75 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:10.719301 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-16de7fc3-2b55-4252-aa0c-150df93ced75 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:10.720090 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-16de7fc3-2b55-4252-aa0c-150df93ced75 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:10.720553 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-16de7fc3-2b55-4252-aa0c-150df93ced75 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:10.720987 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-16de7fc3-2b55-4252-aa0c-150df93ced75 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:11.002477 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-254d44f7-2908-4d82-a39d-9cd3f49531bf tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] [instance: 0e0220c0-997d-4f48-9ac2-550d2ba017ca] Updating instance_info_cache with network_info: [{"id": "08007cb1-7b3e-491c-aa88-e844f91f01cf", "address": "fa:16:3e:58:c7:e5", "network": {"id": "d42fbee3-269c-4178-914c-e3bb573fc8b1", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1421675179-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.6.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "dd32721d34bc40679303d6f47daae25c", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap08007cb1-7b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=121000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 27 03:33:11.117623 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-254d44f7-2908-4d82-a39d-9cd3f49531bf tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Releasing lock "refresh_cache-0e0220c0-997d-4f48-9ac2-550d2ba017ca" {{(pid=121000) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 27 03:33:11.118854 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-254d44f7-2908-4d82-a39d-9cd3f49531bf tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] 10.222.0.20 "POST /compute/v2.1/servers/0e0220c0-997d-4f48-9ac2-550d2ba017ca/action" status: 202 len: 0 microversion: 2.1 time: 4.777280 Oct 27 03:33:11.120034 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1399/2991] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:33:06 2022] POST /compute/v2.1/servers/0e0220c0-997d-4f48-9ac2-550d2ba017ca/action => generated 0 bytes in 4779 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Oct 27 03:33:11.125806 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-856590db-c4e1-461c-bf75-f75430c60c0b req-ab3fcb8b-7681-4cde-b5cf-2f64d7d04d2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d70ad817-aab3-419c-85ab-b458bb9d8d26", "name": "network-vif-plugged", "status": "completed", "tag": "c70fed81-8427-44e7-9315-905828e6c445"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:33:11.159499 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-856590db-c4e1-461c-bf75-f75430c60c0b req-ab3fcb8b-7681-4cde-b5cf-2f64d7d04d2f service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:11.160605 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-856590db-c4e1-461c-bf75-f75430c60c0b req-ab3fcb8b-7681-4cde-b5cf-2f64d7d04d2f service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:11.162288 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-856590db-c4e1-461c-bf75-f75430c60c0b req-ab3fcb8b-7681-4cde-b5cf-2f64d7d04d2f service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:11.183548 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-856590db-c4e1-461c-bf75-f75430c60c0b req-ab3fcb8b-7681-4cde-b5cf-2f64d7d04d2f service nova] Creating event network-vif-plugged:c70fed81-8427-44e7-9315-905828e6c445 for instance d70ad817-aab3-419c-85ab-b458bb9d8d26 on n-h2-862769-1 Oct 27 03:33:11.207799 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-856590db-c4e1-461c-bf75-f75430c60c0b req-ab3fcb8b-7681-4cde-b5cf-2f64d7d04d2f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075980 Oct 27 03:33:11.214316 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1400/2992] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:33:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:33:11.239533 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7ef32e8b-538e-4ed0-8d7f-83c3ed23f50d tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Action: 'create', calling method: .version_select at 0x7f7dd9dc7790>, body: {"pool": "dd6710e4-668a-450b-b911-5422d980e3de"} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:33:11.313567 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-16de7fc3-2b55-4252-aa0c-150df93ced75 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533917bc5aa4e23802a43b1eb534bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d87abf835a4104b40056b9eec2d6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:11.325856 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-16de7fc3-2b55-4252-aa0c-150df93ced75 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] 10.222.0.20 "GET /compute/v2.1/servers/2e1b6a2e-8acc-4c77-b551-4a623893ebaf" status: 200 len: 1506 microversion: 2.1 time: 0.636131 Oct 27 03:33:11.326483 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1593/2993] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:10 2022] GET /compute/v2.1/servers/2e1b6a2e-8acc-4c77-b551-4a623893ebaf => generated 1506 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:33:11.339166 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f3240341-68b9-4944-b41d-af75dadf176e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:11.340242 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f3240341-68b9-4944-b41d-af75dadf176e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: d70ad817-aab3-419c-85ab-b458bb9d8d26] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:11.356633 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f3240341-68b9-4944-b41d-af75dadf176e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:11.357489 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f3240341-68b9-4944-b41d-af75dadf176e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:11.362652 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f3240341-68b9-4944-b41d-af75dadf176e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:11.362652 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f3240341-68b9-4944-b41d-af75dadf176e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:11.362652 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f3240341-68b9-4944-b41d-af75dadf176e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:11.362652 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f3240341-68b9-4944-b41d-af75dadf176e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:11.758388 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f3240341-68b9-4944-b41d-af75dadf176e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:11.769102 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f3240341-68b9-4944-b41d-af75dadf176e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/d70ad817-aab3-419c-85ab-b458bb9d8d26" status: 200 len: 1315 microversion: 2.1 time: 0.438248 Oct 27 03:33:11.784615 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1594/2994] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:11 2022] GET /compute/v2.1/servers/d70ad817-aab3-419c-85ab-b458bb9d8d26 => generated 1315 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:33:12.353681 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0fcb1fbd-ddf4-4682-96a4-3282cb1bd978 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:12.354536 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0fcb1fbd-ddf4-4682-96a4-3282cb1bd978 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] [instance: 2e1b6a2e-8acc-4c77-b551-4a623893ebaf] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:12.362350 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0fcb1fbd-ddf4-4682-96a4-3282cb1bd978 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:12.363616 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0fcb1fbd-ddf4-4682-96a4-3282cb1bd978 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:12.364261 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0fcb1fbd-ddf4-4682-96a4-3282cb1bd978 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:12.365207 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0fcb1fbd-ddf4-4682-96a4-3282cb1bd978 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:12.366347 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0fcb1fbd-ddf4-4682-96a4-3282cb1bd978 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:12.366955 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0fcb1fbd-ddf4-4682-96a4-3282cb1bd978 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:12.959262 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0fcb1fbd-ddf4-4682-96a4-3282cb1bd978 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533917bc5aa4e23802a43b1eb534bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d87abf835a4104b40056b9eec2d6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:12.978892 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0fcb1fbd-ddf4-4682-96a4-3282cb1bd978 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] 10.222.0.20 "GET /compute/v2.1/servers/2e1b6a2e-8acc-4c77-b551-4a623893ebaf" status: 200 len: 1506 microversion: 2.1 time: 0.630097 Oct 27 03:33:12.984477 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1595/2995] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:12 2022] GET /compute/v2.1/servers/2e1b6a2e-8acc-4c77-b551-4a623893ebaf => generated 1506 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:33:12.996808 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-22c88d18-4462-416e-955e-e1440a1e5567 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:12.997870 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-22c88d18-4462-416e-955e-e1440a1e5567 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: d70ad817-aab3-419c-85ab-b458bb9d8d26] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:13.012147 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-22c88d18-4462-416e-955e-e1440a1e5567 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:13.012747 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-22c88d18-4462-416e-955e-e1440a1e5567 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:13.013413 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-22c88d18-4462-416e-955e-e1440a1e5567 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:13.014336 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-22c88d18-4462-416e-955e-e1440a1e5567 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:13.018526 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-22c88d18-4462-416e-955e-e1440a1e5567 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:13.018526 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-22c88d18-4462-416e-955e-e1440a1e5567 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:13.439905 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-22c88d18-4462-416e-955e-e1440a1e5567 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:13.451017 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-22c88d18-4462-416e-955e-e1440a1e5567 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/d70ad817-aab3-419c-85ab-b458bb9d8d26" status: 200 len: 1315 microversion: 2.1 time: 0.464139 Oct 27 03:33:13.453151 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1596/2996] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:12 2022] GET /compute/v2.1/servers/d70ad817-aab3-419c-85ab-b458bb9d8d26 => generated 1315 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:33:14.006382 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-636df358-1f70-41ce-9899-b921fe24c24c tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:14.009046 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-636df358-1f70-41ce-9899-b921fe24c24c tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] [instance: 2e1b6a2e-8acc-4c77-b551-4a623893ebaf] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:14.035843 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-636df358-1f70-41ce-9899-b921fe24c24c tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:14.036598 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-636df358-1f70-41ce-9899-b921fe24c24c tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:14.037526 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-636df358-1f70-41ce-9899-b921fe24c24c tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:14.039359 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-636df358-1f70-41ce-9899-b921fe24c24c tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:14.041433 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-636df358-1f70-41ce-9899-b921fe24c24c tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:14.042432 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-636df358-1f70-41ce-9899-b921fe24c24c tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:14.540897 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-636df358-1f70-41ce-9899-b921fe24c24c tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533917bc5aa4e23802a43b1eb534bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d87abf835a4104b40056b9eec2d6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:14.560460 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-636df358-1f70-41ce-9899-b921fe24c24c tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] 10.222.0.20 "GET /compute/v2.1/servers/2e1b6a2e-8acc-4c77-b551-4a623893ebaf" status: 200 len: 1506 microversion: 2.1 time: 0.557683 Oct 27 03:33:14.561732 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1597/2997] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:13 2022] GET /compute/v2.1/servers/2e1b6a2e-8acc-4c77-b551-4a623893ebaf => generated 1506 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:33:14.570257 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3cab3824-c9dd-434f-ba3a-b301cb438ac0 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:14.573105 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3cab3824-c9dd-434f-ba3a-b301cb438ac0 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: d70ad817-aab3-419c-85ab-b458bb9d8d26] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:14.592902 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3cab3824-c9dd-434f-ba3a-b301cb438ac0 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:14.596577 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3cab3824-c9dd-434f-ba3a-b301cb438ac0 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:14.597795 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3cab3824-c9dd-434f-ba3a-b301cb438ac0 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:14.599250 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3cab3824-c9dd-434f-ba3a-b301cb438ac0 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:14.600688 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3cab3824-c9dd-434f-ba3a-b301cb438ac0 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:14.602319 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3cab3824-c9dd-434f-ba3a-b301cb438ac0 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:14.919226 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3cab3824-c9dd-434f-ba3a-b301cb438ac0 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:14.929094 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3cab3824-c9dd-434f-ba3a-b301cb438ac0 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/d70ad817-aab3-419c-85ab-b458bb9d8d26" status: 200 len: 1502 microversion: 2.1 time: 0.365691 Oct 27 03:33:14.935137 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1598/2998] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:14 2022] GET /compute/v2.1/servers/d70ad817-aab3-419c-85ab-b458bb9d8d26 => generated 1502 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:33:14.962354 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8e91e2f8-8d71-40d5-894e-cc49937bb7bb tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:33:14.972552 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8e91e2f8-8d71-40d5-894e-cc49937bb7bb tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:14.973144 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8e91e2f8-8d71-40d5-894e-cc49937bb7bb tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:14.973674 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8e91e2f8-8d71-40d5-894e-cc49937bb7bb tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:15.038992 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8e91e2f8-8d71-40d5-894e-cc49937bb7bb tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: d70ad817-aab3-419c-85ab-b458bb9d8d26] Going to try to stop instance {{(pid=121001) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 27 03:33:15.313089 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8e91e2f8-8d71-40d5-894e-cc49937bb7bb tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "POST /compute/v2.1/servers/d70ad817-aab3-419c-85ab-b458bb9d8d26/action" status: 202 len: 0 microversion: 2.1 time: 0.356106 Oct 27 03:33:15.314721 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1599/2999] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:33:14 2022] POST /compute/v2.1/servers/d70ad817-aab3-419c-85ab-b458bb9d8d26/action => generated 0 bytes in 359 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 03:33:15.347662 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-44eb04a8-c80e-40d5-acf5-c82620f0cb22 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:15.348844 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-44eb04a8-c80e-40d5-acf5-c82620f0cb22 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: d70ad817-aab3-419c-85ab-b458bb9d8d26] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:15.360846 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-44eb04a8-c80e-40d5-acf5-c82620f0cb22 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:15.361692 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-44eb04a8-c80e-40d5-acf5-c82620f0cb22 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:15.373982 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-44eb04a8-c80e-40d5-acf5-c82620f0cb22 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:15.379453 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-44eb04a8-c80e-40d5-acf5-c82620f0cb22 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:15.379453 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-44eb04a8-c80e-40d5-acf5-c82620f0cb22 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:15.379453 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-44eb04a8-c80e-40d5-acf5-c82620f0cb22 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:15.699523 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-44eb04a8-c80e-40d5-acf5-c82620f0cb22 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:15.753735 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-44eb04a8-c80e-40d5-acf5-c82620f0cb22 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/d70ad817-aab3-419c-85ab-b458bb9d8d26" status: 200 len: 1512 microversion: 2.1 time: 0.422395 Oct 27 03:33:15.756459 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1600/3000] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:15 2022] GET /compute/v2.1/servers/d70ad817-aab3-419c-85ab-b458bb9d8d26 => generated 1512 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:33:15.770562 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d48e03a2-dba2-4241-a844-50cb109453a0 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:15.770562 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d48e03a2-dba2-4241-a844-50cb109453a0 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] [instance: 2e1b6a2e-8acc-4c77-b551-4a623893ebaf] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:15.791306 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d48e03a2-dba2-4241-a844-50cb109453a0 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:15.793276 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d48e03a2-dba2-4241-a844-50cb109453a0 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:15.793276 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d48e03a2-dba2-4241-a844-50cb109453a0 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:15.797657 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d48e03a2-dba2-4241-a844-50cb109453a0 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:15.802826 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d48e03a2-dba2-4241-a844-50cb109453a0 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:15.803529 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d48e03a2-dba2-4241-a844-50cb109453a0 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:16.413499 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d48e03a2-dba2-4241-a844-50cb109453a0 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533917bc5aa4e23802a43b1eb534bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d87abf835a4104b40056b9eec2d6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:16.430943 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d48e03a2-dba2-4241-a844-50cb109453a0 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] 10.222.0.20 "GET /compute/v2.1/servers/2e1b6a2e-8acc-4c77-b551-4a623893ebaf" status: 200 len: 1506 microversion: 2.1 time: 0.672054 Oct 27 03:33:16.432192 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1601/3001] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:15 2022] GET /compute/v2.1/servers/2e1b6a2e-8acc-4c77-b551-4a623893ebaf => generated 1506 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:33:16.444400 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7ef32e8b-538e-4ed0-8d7f-83c3ed23f50d tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.228678 Oct 27 03:33:16.447643 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1401/3002] 10.222.0.20 () {60 vars in 1170 bytes} [Thu Oct 27 03:33:11 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:33:16.462568 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-039a8899-3ab3-4345-807a-16814b0f724e tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.6.161"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:33:16.465766 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-039a8899-3ab3-4345-807a-16814b0f724e tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] [instance: 0e0220c0-997d-4f48-9ac2-550d2ba017ca] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:16.473515 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-039a8899-3ab3-4345-807a-16814b0f724e tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:16.474793 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-039a8899-3ab3-4345-807a-16814b0f724e tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:16.475566 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-039a8899-3ab3-4345-807a-16814b0f724e tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:16.476445 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-039a8899-3ab3-4345-807a-16814b0f724e tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:16.477072 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-039a8899-3ab3-4345-807a-16814b0f724e tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:16.477504 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-039a8899-3ab3-4345-807a-16814b0f724e tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:16.528115 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-039a8899-3ab3-4345-807a-16814b0f724e tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Acquiring lock "refresh_cache-0e0220c0-997d-4f48-9ac2-550d2ba017ca" {{(pid=121000) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 27 03:33:16.528600 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-039a8899-3ab3-4345-807a-16814b0f724e tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Acquired lock "refresh_cache-0e0220c0-997d-4f48-9ac2-550d2ba017ca" {{(pid=121000) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 27 03:33:17.016290 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e242b512-e01c-4dbd-96ed-e046cc41752a tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-1498281938", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": [{"uuid": "24cb1124-08e4-4c78-9e8d-d3d323a3aaf0"}]}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:33:17.104087 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.network.neutron [None req-e242b512-e01c-4dbd-96ed-e046cc41752a tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] validate_networks() for [('24cb1124-08e4-4c78-9e8d-d3d323a3aaf0', None, None, None, None, None)] {{(pid=121001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:33:17.710658 n-d-862769-1 devstack@n-api.service[121000]: DEBUG neutronclient.v2_0.client [None req-039a8899-3ab3-4345-807a-16814b0f724e tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.6.161 (f3ffee0b-8e55-44a9-86fa-ac67f88c6c2a) with port 08007cb1-7b3e-491c-aa88-e844f91f01cf using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network dd6710e4-668a-450b-b911-5422d980e3de.", "detail": ""}} {{(pid=121000) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 03:33:17.711962 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-039a8899-3ab3-4345-807a-16814b0f724e tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Releasing lock "refresh_cache-0e0220c0-997d-4f48-9ac2-550d2ba017ca" {{(pid=121000) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 27 03:33:17.713646 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-039a8899-3ab3-4345-807a-16814b0f724e tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] HTTP exception thrown: Cannot associate floating IP 172.25.6.161 (f3ffee0b-8e55-44a9-86fa-ac67f88c6c2a) with port 08007cb1-7b3e-491c-aa88-e844f91f01cf using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network dd6710e4-668a-450b-b911-5422d980e3de. Oct 27 03:33:17.713646 n-d-862769-1 devstack@n-api.service[121000]: Neutron server returns request_ids: ['req-ae87e389-874c-444d-8153-c121792555dd'] Oct 27 03:33:17.716740 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-039a8899-3ab3-4345-807a-16814b0f724e tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Request method failure captured: Oct 27 03:33:17.716740 n-d-862769-1 devstack@n-api.service[121000]: request: POST /compute/v2.1/servers/0e0220c0-997d-4f48-9ac2-550d2ba017ca/action HTTP/1.1 Oct 27 03:33:17.716740 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:33:17.716740 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:33:17.716740 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:33:17.716740 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 46 Oct 27 03:33:17.716740 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:33:17.716740 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:33:17.716740 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:33:17.716740 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:33:17.716740 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfvTi1_-5V6JBmPcX6PFqM0rlmKZ_gL2Lz7wpuf3oQeWYf0tOxeYivwLykVGXkJ281xjux70z92WlsBnNpgUI-13-heXmdooe2GtxEBib8IEt5J-bM2_pz-uJTM4fhpgK_2HRD9iLxNAvKZQOQ6NcqYQkc2X-yXWbr9qzjZYeWtrq4w Oct 27 03:33:17.716740 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:33:17.716740 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:33:17.716740 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:33:17.716740 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:33:17.716740 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:33:17.716740 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:33:17.716740 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: dd32721d34bc40679303d6f47daae25c Oct 27 03:33:17.716740 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 Oct 27 03:33:17.716740 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:33:17.716740 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:33:17.716740 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dd32721d34bc40679303d6f47daae25c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dd32721d34bc40679303d6f47daae25c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dd32721d34bc40679303d6f47daae25c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dd32721d34bc40679303d6f47daae25c"}]}] Oct 27 03:33:17.716740 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 Oct 27 03:33:17.716740 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: dd32721d34bc40679303d6f47daae25c Oct 27 03:33:17.716740 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 Oct 27 03:33:17.716740 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project Oct 27 03:33:17.716740 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:33:17.716740 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:33:17.716740 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: cd284264ddc64d58baee15e337d5fcc6 Oct 27 03:33:17.716740 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project Oct 27 03:33:17.716740 n-d-862769-1 devstack@n-api.service[121000]: Oct 27 03:33:17.716740 n-d-862769-1 devstack@n-api.service[121000]: {"addFloatingIp": {"address": "172.25.6.161"}} Oct 27 03:33:17.716740 n-d-862769-1 devstack@n-api.service[121000]: method: Oct 27 03:33:17.716740 n-d-862769-1 devstack@n-api.service[121000]: exception: Cannot associate floating IP 172.25.6.161 (f3ffee0b-8e55-44a9-86fa-ac67f88c6c2a) with port 08007cb1-7b3e-491c-aa88-e844f91f01cf using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network dd6710e4-668a-450b-b911-5422d980e3de. Oct 27 03:33:17.716740 n-d-862769-1 devstack@n-api.service[121000]: Neutron server returns request_ids: ['req-ae87e389-874c-444d-8153-c121792555dd'] Oct 27 03:33:17.716740 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '0e0220c0-997d-4f48-9ac2-550d2ba017ca', 'body': {'addFloatingIp': {'address': '172.25.6.161'}}} Oct 27 03:33:17.716740 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:33:17.716740 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:33:17.716740 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Oct 27 03:33:17.716740 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Oct 27 03:33:17.716740 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:33:17.716740 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:33:17.716740 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Oct 27 03:33:17.716740 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Oct 27 03:33:17.716740 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:33:17.716740 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:33:17.716740 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Oct 27 03:33:17.716740 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Oct 27 03:33:17.716740 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:33:17.716740 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:33:17.716740 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Oct 27 03:33:17.716740 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Oct 27 03:33:17.716740 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:33:17.716740 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:33:17.716740 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 03:33:17.716740 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 03:33:17.716740 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:33:17.716740 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:33:17.716740 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 03:33:17.716740 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 03:33:17.723201 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:33:17.723201 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:33:17.723201 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 03:33:17.723201 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 03:33:17.723201 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 03:33:17.723201 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 03:33:17.723201 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.6.161 (f3ffee0b-8e55-44a9-86fa-ac67f88c6c2a) with port 08007cb1-7b3e-491c-aa88-e844f91f01cf using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network dd6710e4-668a-450b-b911-5422d980e3de. Oct 27 03:33:17.723201 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ae87e389-874c-444d-8153-c121792555dd'] Oct 27 03:33:17.723201 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:33:17.723201 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:33:17.723201 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:33:17.723201 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:33:17.723201 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 27 03:33:17.723201 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 27 03:33:17.723201 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 27 03:33:17.723201 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 27 03:33:17.723201 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Oct 27 03:33:17.723201 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Oct 27 03:33:17.723201 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.6.161 (f3ffee0b-8e55-44a9-86fa-ac67f88c6c2a) with port 08007cb1-7b3e-491c-aa88-e844f91f01cf using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network dd6710e4-668a-450b-b911-5422d980e3de. Oct 27 03:33:17.723201 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ae87e389-874c-444d-8153-c121792555dd'] Oct 27 03:33:17.723201 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:33:17.723201 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:33:17.723201 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:33:17.723201 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:33:17.723201 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:33:17.723201 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:33:17.723201 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:33:17.723201 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:33:17.723201 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:33:17.723201 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:33:17.723201 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:33:17.723201 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:33:17.723201 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:33:17.723201 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:33:17.723201 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Oct 27 03:33:17.723201 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Oct 27 03:33:17.723201 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.6.161 (f3ffee0b-8e55-44a9-86fa-ac67f88c6c2a) with port 08007cb1-7b3e-491c-aa88-e844f91f01cf using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network dd6710e4-668a-450b-b911-5422d980e3de. Oct 27 03:33:17.723201 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ae87e389-874c-444d-8153-c121792555dd'] Oct 27 03:33:17.723201 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:33:17.723201 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:33:17.723201 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:33:17.723201 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:33:17.723201 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:33:17.723201 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:33:17.723201 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:33:17.723201 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:33:17.723201 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.6.161 (f3ffee0b-8e55-44a9-86fa-ac67f88c6c2a) with port 08007cb1-7b3e-491c-aa88-e844f91f01cf using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network dd6710e4-668a-450b-b911-5422d980e3de. Oct 27 03:33:17.723201 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ae87e389-874c-444d-8153-c121792555dd'] Oct 27 03:33:17.723201 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:33:17.729948 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-039a8899-3ab3-4345-807a-16814b0f724e tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Returning 400 to user: Cannot associate floating IP 172.25.6.161 (f3ffee0b-8e55-44a9-86fa-ac67f88c6c2a) with port 08007cb1-7b3e-491c-aa88-e844f91f01cf using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network dd6710e4-668a-450b-b911-5422d980e3de. Oct 27 03:33:17.729948 n-d-862769-1 devstack@n-api.service[121000]: Neutron server returns request_ids: ['req-ae87e389-874c-444d-8153-c121792555dd'] {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:33:17.730999 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-039a8899-3ab3-4345-807a-16814b0f724e tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] 10.222.0.20 "POST /compute/v2.1/servers/0e0220c0-997d-4f48-9ac2-550d2ba017ca/action" status: 400 len: 381 microversion: 2.1 time: 1.273707 Oct 27 03:33:17.731687 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1402/3003] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:33:16 2022] POST /compute/v2.1/servers/0e0220c0-997d-4f48-9ac2-550d2ba017ca/action => generated 381 bytes in 1275 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 03:33:17.743817 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0a9547d9-17ca-4ff9-a519-ef3c8f81356f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:17.743817 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0a9547d9-17ca-4ff9-a519-ef3c8f81356f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: d70ad817-aab3-419c-85ab-b458bb9d8d26] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:17.752000 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0a9547d9-17ca-4ff9-a519-ef3c8f81356f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:17.752997 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0a9547d9-17ca-4ff9-a519-ef3c8f81356f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:17.753720 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0a9547d9-17ca-4ff9-a519-ef3c8f81356f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:17.754641 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0a9547d9-17ca-4ff9-a519-ef3c8f81356f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:17.755491 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0a9547d9-17ca-4ff9-a519-ef3c8f81356f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:17.756735 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0a9547d9-17ca-4ff9-a519-ef3c8f81356f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:18.048646 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0a9547d9-17ca-4ff9-a519-ef3c8f81356f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:18.057307 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0a9547d9-17ca-4ff9-a519-ef3c8f81356f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/d70ad817-aab3-419c-85ab-b458bb9d8d26" status: 200 len: 1512 microversion: 2.1 time: 0.324122 Oct 27 03:33:18.058532 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1403/3004] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:17 2022] GET /compute/v2.1/servers/d70ad817-aab3-419c-85ab-b458bb9d8d26 => generated 1512 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:33:18.064147 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9e2fa7f0-a1e3-4206-8169-f03ae07c3143 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:18.065014 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9e2fa7f0-a1e3-4206-8169-f03ae07c3143 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] [instance: 2e1b6a2e-8acc-4c77-b551-4a623893ebaf] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:18.071478 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9e2fa7f0-a1e3-4206-8169-f03ae07c3143 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:18.072131 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9e2fa7f0-a1e3-4206-8169-f03ae07c3143 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:18.072744 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9e2fa7f0-a1e3-4206-8169-f03ae07c3143 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:18.073671 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9e2fa7f0-a1e3-4206-8169-f03ae07c3143 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:18.074354 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9e2fa7f0-a1e3-4206-8169-f03ae07c3143 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:18.074947 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9e2fa7f0-a1e3-4206-8169-f03ae07c3143 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:18.231362 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-e242b512-e01c-4dbd-96ed-e046cc41752a tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Flavor limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:33:18.231841 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-e242b512-e01c-4dbd-96ed-e046cc41752a tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Image limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:33:18.232255 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-e242b512-e01c-4dbd-96ed-e046cc41752a tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Flavor pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:33:18.232669 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-e242b512-e01c-4dbd-96ed-e046cc41752a tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Image pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:33:18.233085 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-e242b512-e01c-4dbd-96ed-e046cc41752a tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:33:18.249021 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e242b512-e01c-4dbd-96ed-e046cc41752a tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:18.250148 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e242b512-e01c-4dbd-96ed-e046cc41752a tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:18.250814 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e242b512-e01c-4dbd-96ed-e046cc41752a tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:18.256301 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e242b512-e01c-4dbd-96ed-e046cc41752a tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:18.256301 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e242b512-e01c-4dbd-96ed-e046cc41752a tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:18.256301 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e242b512-e01c-4dbd-96ed-e046cc41752a tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:18.263994 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9e2fa7f0-a1e3-4206-8169-f03ae07c3143 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533917bc5aa4e23802a43b1eb534bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d87abf835a4104b40056b9eec2d6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:18.274001 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9e2fa7f0-a1e3-4206-8169-f03ae07c3143 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] 10.222.0.20 "GET /compute/v2.1/servers/2e1b6a2e-8acc-4c77-b551-4a623893ebaf" status: 200 len: 1506 microversion: 2.1 time: 0.214073 Oct 27 03:33:18.275157 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1404/3005] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:18 2022] GET /compute/v2.1/servers/2e1b6a2e-8acc-4c77-b551-4a623893ebaf => generated 1506 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:33:18.279631 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-e242b512-e01c-4dbd-96ed-e046cc41752a tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Getting quotas for project d2c1020a13864ca8b5199427528d650d. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:33:18.280803 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2ed0b34d-a173-485e-8e8b-e83ac7d4e608 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Calling method '.version_select at 0x7f7ddec7c820>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:18.286749 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-e242b512-e01c-4dbd-96ed-e046cc41752a tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Getting quotas for user 45f7471db101458fa692a73173bb42a1 and project d2c1020a13864ca8b5199427528d650d. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:33:18.292702 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=100 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:33:18.312559 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e242b512-e01c-4dbd-96ed-e046cc41752a tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Going to run 1 instances... {{(pid=121001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:33:18.316054 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e242b512-e01c-4dbd-96ed-e046cc41752a tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] [instance: e42cf1fc-e9c5-42f3-be93-ad7c3730e19c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:33:18.499782 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e242b512-e01c-4dbd-96ed-e046cc41752a tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.065861 Oct 27 03:33:18.508030 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1602/3006] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:33:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 2069 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 03:33:18.515460 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8949cb3e-bbe1-467e-a720-ea01eb4fc2ec tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:18.516356 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8949cb3e-bbe1-467e-a720-ea01eb4fc2ec tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] [instance: e42cf1fc-e9c5-42f3-be93-ad7c3730e19c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:18.585696 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8949cb3e-bbe1-467e-a720-ea01eb4fc2ec tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f7471db101458fa692a73173bb42a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c1020a13864ca8b5199427528d650d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:18.596011 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8949cb3e-bbe1-467e-a720-ea01eb4fc2ec tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] 10.222.0.20 "GET /compute/v2.1/servers/e42cf1fc-e9c5-42f3-be93-ad7c3730e19c" status: 200 len: 1216 microversion: 2.1 time: 0.084389 Oct 27 03:33:18.607203 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1603/3007] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:18 2022] GET /compute/v2.1/servers/e42cf1fc-e9c5-42f3-be93-ad7c3730e19c => generated 1216 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:33:19.080894 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4ca77702-5cc8-40ed-b2e8-ea64b0e48967 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:19.081789 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4ca77702-5cc8-40ed-b2e8-ea64b0e48967 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: d70ad817-aab3-419c-85ab-b458bb9d8d26] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:19.091483 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4ca77702-5cc8-40ed-b2e8-ea64b0e48967 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:19.096387 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4ca77702-5cc8-40ed-b2e8-ea64b0e48967 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:19.097065 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4ca77702-5cc8-40ed-b2e8-ea64b0e48967 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:19.101507 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4ca77702-5cc8-40ed-b2e8-ea64b0e48967 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:19.102665 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4ca77702-5cc8-40ed-b2e8-ea64b0e48967 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:19.104393 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4ca77702-5cc8-40ed-b2e8-ea64b0e48967 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:19.720551 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4ca77702-5cc8-40ed-b2e8-ea64b0e48967 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:19.736388 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4ca77702-5cc8-40ed-b2e8-ea64b0e48967 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/d70ad817-aab3-419c-85ab-b458bb9d8d26" status: 200 len: 1512 microversion: 2.1 time: 0.658163 Oct 27 03:33:19.738705 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1604/3008] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:19 2022] GET /compute/v2.1/servers/d70ad817-aab3-419c-85ab-b458bb9d8d26 => generated 1512 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:33:19.744305 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0be9a256-5c5b-468c-a1f9-187a17bdfd44 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:19.745227 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0be9a256-5c5b-468c-a1f9-187a17bdfd44 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] [instance: 2e1b6a2e-8acc-4c77-b551-4a623893ebaf] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:19.754016 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0be9a256-5c5b-468c-a1f9-187a17bdfd44 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:19.755366 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0be9a256-5c5b-468c-a1f9-187a17bdfd44 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:19.757165 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0be9a256-5c5b-468c-a1f9-187a17bdfd44 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:19.759824 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0be9a256-5c5b-468c-a1f9-187a17bdfd44 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:19.760308 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0be9a256-5c5b-468c-a1f9-187a17bdfd44 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:19.760744 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0be9a256-5c5b-468c-a1f9-187a17bdfd44 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:20.052331 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2ed0b34d-a173-485e-8e8b-e83ac7d4e608 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/f3ffee0b-8e55-44a9-86fa-ac67f88c6c2a" status: 202 len: 0 microversion: 2.1 time: 1.775932 Oct 27 03:33:20.053765 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1405/3009] 10.222.0.20 () {58 vars in 1263 bytes} [Thu Oct 27 03:33:18 2022] DELETE /compute/v2.1/os-floating-ips/f3ffee0b-8e55-44a9-86fa-ac67f88c6c2a => generated 0 bytes in 1778 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:33:20.058519 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f4418fcd-e6e9-4a93-9a8c-4c36425e6512 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:20.059315 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f4418fcd-e6e9-4a93-9a8c-4c36425e6512 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] [instance: e42cf1fc-e9c5-42f3-be93-ad7c3730e19c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:20.151705 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f4418fcd-e6e9-4a93-9a8c-4c36425e6512 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f7471db101458fa692a73173bb42a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c1020a13864ca8b5199427528d650d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:20.160232 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f4418fcd-e6e9-4a93-9a8c-4c36425e6512 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] 10.222.0.20 "GET /compute/v2.1/servers/e42cf1fc-e9c5-42f3-be93-ad7c3730e19c" status: 200 len: 1216 microversion: 2.1 time: 0.105217 Oct 27 03:33:20.165177 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1406/3010] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:20 2022] GET /compute/v2.1/servers/e42cf1fc-e9c5-42f3-be93-ad7c3730e19c => generated 1216 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:33:20.172273 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e4049fce-e44f-4768-b525-24e4228ea3f1 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.6.55"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:33:20.371809 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0be9a256-5c5b-468c-a1f9-187a17bdfd44 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533917bc5aa4e23802a43b1eb534bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d87abf835a4104b40056b9eec2d6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:20.392373 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0be9a256-5c5b-468c-a1f9-187a17bdfd44 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] 10.222.0.20 "GET /compute/v2.1/servers/2e1b6a2e-8acc-4c77-b551-4a623893ebaf" status: 200 len: 1506 microversion: 2.1 time: 0.650056 Oct 27 03:33:20.393654 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1605/3011] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:19 2022] GET /compute/v2.1/servers/2e1b6a2e-8acc-4c77-b551-4a623893ebaf => generated 1506 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:33:20.566845 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e4049fce-e44f-4768-b525-24e4228ea3f1 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] [instance: 0e0220c0-997d-4f48-9ac2-550d2ba017ca] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:20.572950 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e4049fce-e44f-4768-b525-24e4228ea3f1 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:20.573446 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e4049fce-e44f-4768-b525-24e4228ea3f1 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:20.573883 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e4049fce-e44f-4768-b525-24e4228ea3f1 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:20.574647 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e4049fce-e44f-4768-b525-24e4228ea3f1 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:20.575279 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e4049fce-e44f-4768-b525-24e4228ea3f1 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:20.579962 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e4049fce-e44f-4768-b525-24e4228ea3f1 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:20.764709 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e05e9773-ca3a-422e-80ac-2739fc813af4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:20.765465 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e05e9773-ca3a-422e-80ac-2739fc813af4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: d70ad817-aab3-419c-85ab-b458bb9d8d26] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:20.793949 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e05e9773-ca3a-422e-80ac-2739fc813af4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:20.796189 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e05e9773-ca3a-422e-80ac-2739fc813af4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:20.798901 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e05e9773-ca3a-422e-80ac-2739fc813af4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:20.805562 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e05e9773-ca3a-422e-80ac-2739fc813af4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:20.808111 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e05e9773-ca3a-422e-80ac-2739fc813af4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:20.808698 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e05e9773-ca3a-422e-80ac-2739fc813af4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:21.167940 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e4049fce-e44f-4768-b525-24e4228ea3f1 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Acquiring lock "refresh_cache-0e0220c0-997d-4f48-9ac2-550d2ba017ca" {{(pid=121000) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 27 03:33:21.168357 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e4049fce-e44f-4768-b525-24e4228ea3f1 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Acquired lock "refresh_cache-0e0220c0-997d-4f48-9ac2-550d2ba017ca" {{(pid=121000) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 27 03:33:21.606076 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e05e9773-ca3a-422e-80ac-2739fc813af4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:21.634166 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e05e9773-ca3a-422e-80ac-2739fc813af4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/d70ad817-aab3-419c-85ab-b458bb9d8d26" status: 200 len: 1512 microversion: 2.1 time: 0.868071 Oct 27 03:33:21.637331 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1606/3012] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:20 2022] GET /compute/v2.1/servers/d70ad817-aab3-419c-85ab-b458bb9d8d26 => generated 1512 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:33:21.643824 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d745951e-0dba-417c-9e03-64654c24bb18 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:21.644679 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d745951e-0dba-417c-9e03-64654c24bb18 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] [instance: e42cf1fc-e9c5-42f3-be93-ad7c3730e19c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:21.653722 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d745951e-0dba-417c-9e03-64654c24bb18 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:21.654369 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d745951e-0dba-417c-9e03-64654c24bb18 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:21.654972 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d745951e-0dba-417c-9e03-64654c24bb18 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:21.656029 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d745951e-0dba-417c-9e03-64654c24bb18 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:21.656963 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d745951e-0dba-417c-9e03-64654c24bb18 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:21.657735 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d745951e-0dba-417c-9e03-64654c24bb18 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:22.498366 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d745951e-0dba-417c-9e03-64654c24bb18 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f7471db101458fa692a73173bb42a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c1020a13864ca8b5199427528d650d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:22.522638 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d745951e-0dba-417c-9e03-64654c24bb18 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] 10.222.0.20 "GET /compute/v2.1/servers/e42cf1fc-e9c5-42f3-be93-ad7c3730e19c" status: 200 len: 1268 microversion: 2.1 time: 0.880892 Oct 27 03:33:22.533586 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1607/3013] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:21 2022] GET /compute/v2.1/servers/e42cf1fc-e9c5-42f3-be93-ad7c3730e19c => generated 1268 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:33:22.547154 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2916fd3b-111b-4974-b22e-8f9316045825 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:22.548260 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2916fd3b-111b-4974-b22e-8f9316045825 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] [instance: 2e1b6a2e-8acc-4c77-b551-4a623893ebaf] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:22.561980 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2916fd3b-111b-4974-b22e-8f9316045825 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:22.564667 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2916fd3b-111b-4974-b22e-8f9316045825 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:22.567520 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2916fd3b-111b-4974-b22e-8f9316045825 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:22.568522 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2916fd3b-111b-4974-b22e-8f9316045825 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:22.569150 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2916fd3b-111b-4974-b22e-8f9316045825 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:22.570692 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2916fd3b-111b-4974-b22e-8f9316045825 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:22.671707 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:33:23.347052 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2916fd3b-111b-4974-b22e-8f9316045825 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533917bc5aa4e23802a43b1eb534bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d87abf835a4104b40056b9eec2d6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:23.359305 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2916fd3b-111b-4974-b22e-8f9316045825 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] 10.222.0.20 "GET /compute/v2.1/servers/2e1b6a2e-8acc-4c77-b551-4a623893ebaf" status: 200 len: 1506 microversion: 2.1 time: 0.819562 Oct 27 03:33:23.359903 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1608/3014] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:22 2022] GET /compute/v2.1/servers/2e1b6a2e-8acc-4c77-b551-4a623893ebaf => generated 1506 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:33:23.369959 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-bc7161b3-906d-4aa8-b6d6-1c7e07477070 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:23.372617 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-bc7161b3-906d-4aa8-b6d6-1c7e07477070 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: d70ad817-aab3-419c-85ab-b458bb9d8d26] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:23.383536 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bc7161b3-906d-4aa8-b6d6-1c7e07477070 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:23.396502 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bc7161b3-906d-4aa8-b6d6-1c7e07477070 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:23.396502 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bc7161b3-906d-4aa8-b6d6-1c7e07477070 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:23.396502 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bc7161b3-906d-4aa8-b6d6-1c7e07477070 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:23.396502 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bc7161b3-906d-4aa8-b6d6-1c7e07477070 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:23.396502 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bc7161b3-906d-4aa8-b6d6-1c7e07477070 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:23.703845 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-e4049fce-e44f-4768-b525-24e4228ea3f1 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] [instance: 0e0220c0-997d-4f48-9ac2-550d2ba017ca] Building network info cache for instance {{(pid=121000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 27 03:33:23.962217 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-bc7161b3-906d-4aa8-b6d6-1c7e07477070 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:23.976806 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-bc7161b3-906d-4aa8-b6d6-1c7e07477070 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/d70ad817-aab3-419c-85ab-b458bb9d8d26" status: 200 len: 1512 microversion: 2.1 time: 0.613071 Oct 27 03:33:23.977724 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1609/3015] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:23 2022] GET /compute/v2.1/servers/d70ad817-aab3-419c-85ab-b458bb9d8d26 => generated 1512 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:33:23.995218 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-594ed7fe-bcf6-44e1-942c-5f59dc0ca02e tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:23.996079 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-594ed7fe-bcf6-44e1-942c-5f59dc0ca02e tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] [instance: e42cf1fc-e9c5-42f3-be93-ad7c3730e19c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:24.007173 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-594ed7fe-bcf6-44e1-942c-5f59dc0ca02e tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:24.007987 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-594ed7fe-bcf6-44e1-942c-5f59dc0ca02e tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:24.008436 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-594ed7fe-bcf6-44e1-942c-5f59dc0ca02e tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:24.009179 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-594ed7fe-bcf6-44e1-942c-5f59dc0ca02e tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:24.009632 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-594ed7fe-bcf6-44e1-942c-5f59dc0ca02e tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:24.010075 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-594ed7fe-bcf6-44e1-942c-5f59dc0ca02e tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:24.211448 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-594ed7fe-bcf6-44e1-942c-5f59dc0ca02e tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f7471db101458fa692a73173bb42a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c1020a13864ca8b5199427528d650d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:24.221793 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-594ed7fe-bcf6-44e1-942c-5f59dc0ca02e tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] 10.222.0.20 "GET /compute/v2.1/servers/e42cf1fc-e9c5-42f3-be93-ad7c3730e19c" status: 200 len: 1274 microversion: 2.1 time: 0.240757 Oct 27 03:33:24.223090 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1610/3016] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:23 2022] GET /compute/v2.1/servers/e42cf1fc-e9c5-42f3-be93-ad7c3730e19c => generated 1274 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:33:24.229408 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-5d011bd7-15a4-46ca-8da9-43ef5a1b4c2f req-0eacfbbe-c859-45c2-bed6-ff12c47fc5c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e0220c0-997d-4f48-9ac2-550d2ba017ca", "tag": "08007cb1-7b3e-491c-aa88-e844f91f01cf"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:33:24.241584 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-5d011bd7-15a4-46ca-8da9-43ef5a1b4c2f req-0eacfbbe-c859-45c2-bed6-ff12c47fc5c7 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:24.242325 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-5d011bd7-15a4-46ca-8da9-43ef5a1b4c2f req-0eacfbbe-c859-45c2-bed6-ff12c47fc5c7 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:24.243778 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-5d011bd7-15a4-46ca-8da9-43ef5a1b4c2f req-0eacfbbe-c859-45c2-bed6-ff12c47fc5c7 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:24.283935 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-5d011bd7-15a4-46ca-8da9-43ef5a1b4c2f req-0eacfbbe-c859-45c2-bed6-ff12c47fc5c7 service nova] Creating event network-changed:08007cb1-7b3e-491c-aa88-e844f91f01cf for instance 0e0220c0-997d-4f48-9ac2-550d2ba017ca on n-h2-862769-1 Oct 27 03:33:24.291867 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-5d011bd7-15a4-46ca-8da9-43ef5a1b4c2f req-0eacfbbe-c859-45c2-bed6-ff12c47fc5c7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067340 Oct 27 03:33:24.295192 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1611/3017] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:33:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:33:24.302531 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d97e8a77-e2af-4784-8adc-95de9bdd2222 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "61fac555-36b3-4313-b02d-6080d6124f2b"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:33:24.305025 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d97e8a77-e2af-4784-8adc-95de9bdd2222 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] [instance: f3d23d8e-a80a-425c-a0a3-9e448853a94b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:24.311829 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d97e8a77-e2af-4784-8adc-95de9bdd2222 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:24.313930 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d97e8a77-e2af-4784-8adc-95de9bdd2222 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:24.314604 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d97e8a77-e2af-4784-8adc-95de9bdd2222 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:24.315692 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d97e8a77-e2af-4784-8adc-95de9bdd2222 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:24.316316 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d97e8a77-e2af-4784-8adc-95de9bdd2222 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:24.316955 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d97e8a77-e2af-4784-8adc-95de9bdd2222 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:25.434243 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d97e8a77-e2af-4784-8adc-95de9bdd2222 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] 10.222.0.20 "POST /compute/v2.1/servers/f3d23d8e-a80a-425c-a0a3-9e448853a94b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.136362 Oct 27 03:33:25.436433 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1612/3018] 10.222.0.20 () {60 vars in 1323 bytes} [Thu Oct 27 03:33:24 2022] POST /compute/v2.1/servers/f3d23d8e-a80a-425c-a0a3-9e448853a94b/os-volume_attachments => generated 194 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:33:25.456032 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-cd77375a-6fa4-4300-b865-f7fe162e1273 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:25.460083 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-cd77375a-6fa4-4300-b865-f7fe162e1273 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] [instance: 2e1b6a2e-8acc-4c77-b551-4a623893ebaf] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:25.479602 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cd77375a-6fa4-4300-b865-f7fe162e1273 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:25.491843 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cd77375a-6fa4-4300-b865-f7fe162e1273 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:25.495053 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cd77375a-6fa4-4300-b865-f7fe162e1273 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:25.497310 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cd77375a-6fa4-4300-b865-f7fe162e1273 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:25.499573 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cd77375a-6fa4-4300-b865-f7fe162e1273 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:25.500288 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cd77375a-6fa4-4300-b865-f7fe162e1273 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:25.982261 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-cd77375a-6fa4-4300-b865-f7fe162e1273 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533917bc5aa4e23802a43b1eb534bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d87abf835a4104b40056b9eec2d6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:25.998061 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-cd77375a-6fa4-4300-b865-f7fe162e1273 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] 10.222.0.20 "GET /compute/v2.1/servers/2e1b6a2e-8acc-4c77-b551-4a623893ebaf" status: 200 len: 1506 microversion: 2.1 time: 0.557288 Oct 27 03:33:25.998951 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1613/3019] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:25 2022] GET /compute/v2.1/servers/2e1b6a2e-8acc-4c77-b551-4a623893ebaf => generated 1506 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:33:26.015280 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a86a26ff-3e68-49df-af27-1178678eaa28 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:26.020382 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a86a26ff-3e68-49df-af27-1178678eaa28 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: d70ad817-aab3-419c-85ab-b458bb9d8d26] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:26.046492 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a86a26ff-3e68-49df-af27-1178678eaa28 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:26.048513 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-e4049fce-e44f-4768-b525-24e4228ea3f1 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] [instance: 0e0220c0-997d-4f48-9ac2-550d2ba017ca] Updating instance_info_cache with network_info: [{"id": "08007cb1-7b3e-491c-aa88-e844f91f01cf", "address": "fa:16:3e:58:c7:e5", "network": {"id": "d42fbee3-269c-4178-914c-e3bb573fc8b1", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1421675179-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "dd32721d34bc40679303d6f47daae25c", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap08007cb1-7b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=121000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 27 03:33:26.049012 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a86a26ff-3e68-49df-af27-1178678eaa28 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:26.049684 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a86a26ff-3e68-49df-af27-1178678eaa28 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:26.050494 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a86a26ff-3e68-49df-af27-1178678eaa28 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:26.050975 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a86a26ff-3e68-49df-af27-1178678eaa28 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:26.051418 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a86a26ff-3e68-49df-af27-1178678eaa28 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:26.153143 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e4049fce-e44f-4768-b525-24e4228ea3f1 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Releasing lock "refresh_cache-0e0220c0-997d-4f48-9ac2-550d2ba017ca" {{(pid=121000) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 27 03:33:26.154436 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e4049fce-e44f-4768-b525-24e4228ea3f1 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] 10.222.0.20 "POST /compute/v2.1/servers/0e0220c0-997d-4f48-9ac2-550d2ba017ca/action" status: 202 len: 0 microversion: 2.1 time: 5.987625 Oct 27 03:33:26.155942 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1407/3020] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:33:20 2022] POST /compute/v2.1/servers/0e0220c0-997d-4f48-9ac2-550d2ba017ca/action => generated 0 bytes in 5990 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 27 03:33:26.172612 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-51ad87f3-6257-4af6-94c2-25296eb5fc68 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:26.176263 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-51ad87f3-6257-4af6-94c2-25296eb5fc68 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] [instance: e42cf1fc-e9c5-42f3-be93-ad7c3730e19c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:26.219352 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-51ad87f3-6257-4af6-94c2-25296eb5fc68 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:26.221762 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-51ad87f3-6257-4af6-94c2-25296eb5fc68 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:26.222470 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-51ad87f3-6257-4af6-94c2-25296eb5fc68 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:26.226991 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-51ad87f3-6257-4af6-94c2-25296eb5fc68 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:26.230054 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-51ad87f3-6257-4af6-94c2-25296eb5fc68 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:26.231596 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-51ad87f3-6257-4af6-94c2-25296eb5fc68 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:26.572975 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-51ad87f3-6257-4af6-94c2-25296eb5fc68 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f7471db101458fa692a73173bb42a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c1020a13864ca8b5199427528d650d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:26.583350 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-51ad87f3-6257-4af6-94c2-25296eb5fc68 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] 10.222.0.20 "GET /compute/v2.1/servers/e42cf1fc-e9c5-42f3-be93-ad7c3730e19c" status: 200 len: 1316 microversion: 2.1 time: 0.424406 Oct 27 03:33:26.601685 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1408/3021] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:26 2022] GET /compute/v2.1/servers/e42cf1fc-e9c5-42f3-be93-ad7c3730e19c => generated 1316 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:33:26.622150 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9e3cad31-ec99-4278-993f-bc2dac8590bf tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Calling method '.version_select at 0x7f7dd9dd7d30>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:28.103284 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a86a26ff-3e68-49df-af27-1178678eaa28 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:28.115765 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a86a26ff-3e68-49df-af27-1178678eaa28 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/d70ad817-aab3-419c-85ab-b458bb9d8d26" status: 200 len: 1512 microversion: 2.1 time: 2.112751 Oct 27 03:33:28.130060 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1614/3022] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:26 2022] GET /compute/v2.1/servers/d70ad817-aab3-419c-85ab-b458bb9d8d26 => generated 1512 bytes in 2114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:33:28.148054 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-07d632cc-4f28-429a-a4d4-eb048f28716a tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:28.148054 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-07d632cc-4f28-429a-a4d4-eb048f28716a tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] [instance: 2e1b6a2e-8acc-4c77-b551-4a623893ebaf] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:28.164363 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-07d632cc-4f28-429a-a4d4-eb048f28716a tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:28.164882 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-07d632cc-4f28-429a-a4d4-eb048f28716a tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:28.168106 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-07d632cc-4f28-429a-a4d4-eb048f28716a tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:28.171151 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-07d632cc-4f28-429a-a4d4-eb048f28716a tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:28.171706 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-07d632cc-4f28-429a-a4d4-eb048f28716a tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:28.172171 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-07d632cc-4f28-429a-a4d4-eb048f28716a tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:28.280934 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:33:28.595304 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=8 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:33:29.150525 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-07d632cc-4f28-429a-a4d4-eb048f28716a tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533917bc5aa4e23802a43b1eb534bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d87abf835a4104b40056b9eec2d6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:29.168922 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-07d632cc-4f28-429a-a4d4-eb048f28716a tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] 10.222.0.20 "GET /compute/v2.1/servers/2e1b6a2e-8acc-4c77-b551-4a623893ebaf" status: 200 len: 1486 microversion: 2.1 time: 1.045446 Oct 27 03:33:29.169870 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1615/3023] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:28 2022] GET /compute/v2.1/servers/2e1b6a2e-8acc-4c77-b551-4a623893ebaf => generated 1486 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:33:29.193689 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-94483e98-99e7-4bb2-9899-2d58551986ef tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:29.194675 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-94483e98-99e7-4bb2-9899-2d58551986ef tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] [instance: e42cf1fc-e9c5-42f3-be93-ad7c3730e19c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:29.222397 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-94483e98-99e7-4bb2-9899-2d58551986ef tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:29.223081 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-94483e98-99e7-4bb2-9899-2d58551986ef tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:29.223743 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-94483e98-99e7-4bb2-9899-2d58551986ef tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:29.224634 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-94483e98-99e7-4bb2-9899-2d58551986ef tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:29.227702 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-94483e98-99e7-4bb2-9899-2d58551986ef tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:29.228401 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-94483e98-99e7-4bb2-9899-2d58551986ef tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:30.087438 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-94483e98-99e7-4bb2-9899-2d58551986ef tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f7471db101458fa692a73173bb42a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c1020a13864ca8b5199427528d650d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:30.100958 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-94483e98-99e7-4bb2-9899-2d58551986ef tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] 10.222.0.20 "GET /compute/v2.1/servers/e42cf1fc-e9c5-42f3-be93-ad7c3730e19c" status: 200 len: 1316 microversion: 2.1 time: 0.925926 Oct 27 03:33:30.112121 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1616/3024] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:29 2022] GET /compute/v2.1/servers/e42cf1fc-e9c5-42f3-be93-ad7c3730e19c => generated 1316 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:33:30.129091 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0ed53b08-e204-4ed8-ba72-e367fca1e257 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:30.130027 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0ed53b08-e204-4ed8-ba72-e367fca1e257 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: d70ad817-aab3-419c-85ab-b458bb9d8d26] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:30.155315 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0ed53b08-e204-4ed8-ba72-e367fca1e257 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:30.161724 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0ed53b08-e204-4ed8-ba72-e367fca1e257 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:30.161724 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0ed53b08-e204-4ed8-ba72-e367fca1e257 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:30.161724 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0ed53b08-e204-4ed8-ba72-e367fca1e257 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:30.162803 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:33:30.163249 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0ed53b08-e204-4ed8-ba72-e367fca1e257 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:30.163249 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0ed53b08-e204-4ed8-ba72-e367fca1e257 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:30.171692 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9e3cad31-ec99-4278-993f-bc2dac8590bf tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/227ccfa1-ed8f-4c77-94a7-4d5d53b9b44a" status: 202 len: 0 microversion: 2.1 time: 3.554830 Oct 27 03:33:30.178256 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1409/3025] 10.222.0.20 () {58 vars in 1263 bytes} [Thu Oct 27 03:33:26 2022] DELETE /compute/v2.1/os-floating-ips/227ccfa1-ed8f-4c77-94a7-4d5d53b9b44a => generated 0 bytes in 3557 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:33:30.186751 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-dce07268-d716-44b7-9725-3dc90368c6db tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:33:30.190451 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-dce07268-d716-44b7-9725-3dc90368c6db tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] [instance: 2e1b6a2e-8acc-4c77-b551-4a623893ebaf] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:30.190451 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:33:30.220351 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dce07268-d716-44b7-9725-3dc90368c6db tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:30.221869 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dce07268-d716-44b7-9725-3dc90368c6db tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:30.222769 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dce07268-d716-44b7-9725-3dc90368c6db tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:30.227713 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dce07268-d716-44b7-9725-3dc90368c6db tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:30.230723 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dce07268-d716-44b7-9725-3dc90368c6db tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:30.231558 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dce07268-d716-44b7-9725-3dc90368c6db tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:30.301473 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=3,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:33:30.586385 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-dce07268-d716-44b7-9725-3dc90368c6db tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] 10.222.0.20 "POST /compute/v2.1/servers/2e1b6a2e-8acc-4c77-b551-4a623893ebaf/action" status: 202 len: 0 microversion: 2.1 time: 0.411254 Oct 27 03:33:30.591883 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1410/3026] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:33:30 2022] POST /compute/v2.1/servers/2e1b6a2e-8acc-4c77-b551-4a623893ebaf/action => generated 0 bytes in 414 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:33:30.596325 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-43cb1b51-73d0-40b6-b8da-cb07270437f7 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:33:30.607356 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-43cb1b51-73d0-40b6-b8da-cb07270437f7 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Request method failure captured: Oct 27 03:33:30.607356 n-d-862769-1 devstack@n-api.service[121000]: request: POST /compute/v2.1/servers/0e0220c0-997d-4f48-9ac2-550d2ba017ca/action HTTP/1.1 Oct 27 03:33:30.607356 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:33:30.607356 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:33:30.607356 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:33:30.607356 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 34 Oct 27 03:33:30.607356 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:33:30.607356 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:33:30.607356 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:33:30.607356 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:33:30.607356 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfvTi1_-5V6JBmPcX6PFqM0rlmKZ_gL2Lz7wpuf3oQeWYf0tOxeYivwLykVGXkJ281xjux70z92WlsBnNpgUI-13-heXmdooe2GtxEBib8IEt5J-bM2_pz-uJTM4fhpgK_2HRD9iLxNAvKZQOQ6NcqYQkc2X-yXWbr9qzjZYeWtrq4w Oct 27 03:33:30.607356 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:33:30.607356 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:33:30.607356 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:33:30.607356 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:33:30.607356 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:33:30.607356 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:33:30.607356 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: dd32721d34bc40679303d6f47daae25c Oct 27 03:33:30.607356 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 Oct 27 03:33:30.607356 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:33:30.607356 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:33:30.607356 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dd32721d34bc40679303d6f47daae25c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dd32721d34bc40679303d6f47daae25c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dd32721d34bc40679303d6f47daae25c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dd32721d34bc40679303d6f47daae25c"}]}] Oct 27 03:33:30.607356 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 Oct 27 03:33:30.607356 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: dd32721d34bc40679303d6f47daae25c Oct 27 03:33:30.607356 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 Oct 27 03:33:30.607356 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project Oct 27 03:33:30.607356 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:33:30.607356 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:33:30.607356 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: cd284264ddc64d58baee15e337d5fcc6 Oct 27 03:33:30.607356 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project Oct 27 03:33:30.607356 n-d-862769-1 devstack@n-api.service[121000]: Oct 27 03:33:30.607356 n-d-862769-1 devstack@n-api.service[121000]: {"addFloatingIp": {"address": ""}} Oct 27 03:33:30.607356 n-d-862769-1 devstack@n-api.service[121000]: method: Oct 27 03:33:30.607356 n-d-862769-1 devstack@n-api.service[121000]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 27 03:33:30.607356 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '0e0220c0-997d-4f48-9ac2-550d2ba017ca', 'body': {'addFloatingIp': {'address': ''}}} Oct 27 03:33:30.607356 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:33:30.607356 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:33:30.607356 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 03:33:30.607356 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 03:33:30.607356 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 03:33:30.607356 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise error Oct 27 03:33:30.607356 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Oct 27 03:33:30.607356 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:33:30.607356 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Oct 27 03:33:30.607356 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Oct 27 03:33:30.607356 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:33:30.607356 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Oct 27 03:33:30.607356 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi '' Oct 27 03:33:30.607356 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:33:30.607356 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:33:30.607356 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:33:30.607356 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:33:30.607356 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:33:30.607356 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:33:30.607356 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:33:30.607356 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:33:30.607356 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:33:30.607356 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:33:30.607356 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:33:30.607356 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:33:30.607356 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 03:33:30.607356 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 03:33:30.607356 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 03:33:30.607356 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 03:33:30.607356 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 03:33:30.613968 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 03:33:30.613968 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 27 03:33:30.613968 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:33:30.613968 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:33:30.613968 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:33:30.613968 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:33:30.613968 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:33:30.613968 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:33:30.613968 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 03:33:30.613968 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 03:33:30.613968 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 27 03:33:30.613968 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:33:30.613968 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-43cb1b51-73d0-40b6-b8da-cb07270437f7 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:33:30.614823 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-43cb1b51-73d0-40b6-b8da-cb07270437f7 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] 10.222.0.20 "POST /compute/v2.1/servers/0e0220c0-997d-4f48-9ac2-550d2ba017ca/action" status: 400 len: 142 microversion: 2.1 time: 0.025514 Oct 27 03:33:30.616261 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1411/3027] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:33:30 2022] POST /compute/v2.1/servers/0e0220c0-997d-4f48-9ac2-550d2ba017ca/action => generated 142 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 03:33:30.627338 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-0f03c11c-e764-4e85-9d12-f19558793548 req-1a398ed0-ed2c-4d67-b0e3-2738f5b9c1d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e42cf1fc-e9c5-42f3-be93-ad7c3730e19c", "tag": "6ceaf5e7-fa70-4309-8220-84d78208e8e4"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:33:30.652550 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-0f03c11c-e764-4e85-9d12-f19558793548 req-1a398ed0-ed2c-4d67-b0e3-2738f5b9c1d1 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:30.653403 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-0f03c11c-e764-4e85-9d12-f19558793548 req-1a398ed0-ed2c-4d67-b0e3-2738f5b9c1d1 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:30.654190 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-0f03c11c-e764-4e85-9d12-f19558793548 req-1a398ed0-ed2c-4d67-b0e3-2738f5b9c1d1 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:30.668305 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-0f03c11c-e764-4e85-9d12-f19558793548 req-1a398ed0-ed2c-4d67-b0e3-2738f5b9c1d1 service nova] Creating event network-changed:6ceaf5e7-fa70-4309-8220-84d78208e8e4 for instance e42cf1fc-e9c5-42f3-be93-ad7c3730e19c on n-h1-862769-1 Oct 27 03:33:30.677021 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-0f03c11c-e764-4e85-9d12-f19558793548 req-1a398ed0-ed2c-4d67-b0e3-2738f5b9c1d1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059010 Oct 27 03:33:30.679074 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1412/3028] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:33:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:33:30.685327 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1747d855-c82f-4786-a024-994c4f905deb tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:30.686403 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1747d855-c82f-4786-a024-994c4f905deb tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] [instance: 2e1b6a2e-8acc-4c77-b551-4a623893ebaf] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:30.699160 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1747d855-c82f-4786-a024-994c4f905deb tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:30.700774 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1747d855-c82f-4786-a024-994c4f905deb tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:30.701562 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0ed53b08-e204-4ed8-ba72-e367fca1e257 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:30.702555 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1747d855-c82f-4786-a024-994c4f905deb tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:30.705949 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1747d855-c82f-4786-a024-994c4f905deb tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:30.706711 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1747d855-c82f-4786-a024-994c4f905deb tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:30.707399 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1747d855-c82f-4786-a024-994c4f905deb tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:30.712502 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0ed53b08-e204-4ed8-ba72-e367fca1e257 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/d70ad817-aab3-419c-85ab-b458bb9d8d26" status: 200 len: 1512 microversion: 2.1 time: 0.599206 Oct 27 03:33:30.718966 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1617/3029] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:30 2022] GET /compute/v2.1/servers/d70ad817-aab3-419c-85ab-b458bb9d8d26 => generated 1512 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:33:30.730098 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d98a5135-e8a3-4514-85ec-f44312755e24 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:33:30.740764 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d98a5135-e8a3-4514-85ec-f44312755e24 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] [instance: 0e0220c0-997d-4f48-9ac2-550d2ba017ca] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:30.765993 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d98a5135-e8a3-4514-85ec-f44312755e24 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:30.767576 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d98a5135-e8a3-4514-85ec-f44312755e24 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:30.768260 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d98a5135-e8a3-4514-85ec-f44312755e24 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:30.770079 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d98a5135-e8a3-4514-85ec-f44312755e24 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:30.770832 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d98a5135-e8a3-4514-85ec-f44312755e24 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:30.772756 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d98a5135-e8a3-4514-85ec-f44312755e24 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:30.826114 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d98a5135-e8a3-4514-85ec-f44312755e24 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Acquiring lock "refresh_cache-0e0220c0-997d-4f48-9ac2-550d2ba017ca" {{(pid=121001) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 27 03:33:30.826539 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d98a5135-e8a3-4514-85ec-f44312755e24 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Acquired lock "refresh_cache-0e0220c0-997d-4f48-9ac2-550d2ba017ca" {{(pid=121001) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 27 03:33:31.245770 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d98a5135-e8a3-4514-85ec-f44312755e24 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Releasing lock "refresh_cache-0e0220c0-997d-4f48-9ac2-550d2ba017ca" {{(pid=121001) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 27 03:33:31.247166 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-d98a5135-e8a3-4514-85ec-f44312755e24 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] HTTP exception thrown: floating IP not found Oct 27 03:33:31.249104 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d98a5135-e8a3-4514-85ec-f44312755e24 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Request method failure captured: Oct 27 03:33:31.249104 n-d-862769-1 devstack@n-api.service[121001]: request: POST /compute/v2.1/servers/0e0220c0-997d-4f48-9ac2-550d2ba017ca/action HTTP/1.1 Oct 27 03:33:31.249104 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:33:31.249104 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:33:31.249104 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:33:31.249104 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 41 Oct 27 03:33:31.249104 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:33:31.249104 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:33:31.249104 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:33:31.249104 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:33:31.249104 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfvTi1_-5V6JBmPcX6PFqM0rlmKZ_gL2Lz7wpuf3oQeWYf0tOxeYivwLykVGXkJ281xjux70z92WlsBnNpgUI-13-heXmdooe2GtxEBib8IEt5J-bM2_pz-uJTM4fhpgK_2HRD9iLxNAvKZQOQ6NcqYQkc2X-yXWbr9qzjZYeWtrq4w Oct 27 03:33:31.249104 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:33:31.249104 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:33:31.249104 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:33:31.249104 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:33:31.249104 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:33:31.249104 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:33:31.249104 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: dd32721d34bc40679303d6f47daae25c Oct 27 03:33:31.249104 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 Oct 27 03:33:31.249104 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:33:31.249104 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:33:31.249104 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dd32721d34bc40679303d6f47daae25c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dd32721d34bc40679303d6f47daae25c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dd32721d34bc40679303d6f47daae25c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dd32721d34bc40679303d6f47daae25c"}]}] Oct 27 03:33:31.249104 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 Oct 27 03:33:31.249104 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: dd32721d34bc40679303d6f47daae25c Oct 27 03:33:31.249104 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 Oct 27 03:33:31.249104 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project Oct 27 03:33:31.249104 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:33:31.249104 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:33:31.249104 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: cd284264ddc64d58baee15e337d5fcc6 Oct 27 03:33:31.249104 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project Oct 27 03:33:31.249104 n-d-862769-1 devstack@n-api.service[121001]: Oct 27 03:33:31.249104 n-d-862769-1 devstack@n-api.service[121001]: {"addFloatingIp": {"address": "0.0.0.0"}} Oct 27 03:33:31.249104 n-d-862769-1 devstack@n-api.service[121001]: method: Oct 27 03:33:31.249104 n-d-862769-1 devstack@n-api.service[121001]: exception: floating IP not found Oct 27 03:33:31.249104 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '0e0220c0-997d-4f48-9ac2-550d2ba017ca', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Oct 27 03:33:31.249104 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:33:31.249104 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:33:31.249104 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 27 03:33:31.249104 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 27 03:33:31.249104 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 27 03:33:31.249104 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 27 03:33:31.249104 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Oct 27 03:33:31.249104 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Oct 27 03:33:31.249104 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 27 03:33:31.249104 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 27 03:33:31.249104 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 27 03:33:31.249104 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:33:31.249104 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:33:31.249104 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:33:31.249104 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:33:31.249104 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:33:31.249104 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:33:31.249104 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:33:31.249104 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:33:31.249104 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:33:31.249104 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:33:31.249104 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:33:31.249104 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:33:31.249104 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:33:31.249104 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:33:31.249104 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Oct 27 03:33:31.249104 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 27 03:33:31.249104 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Oct 27 03:33:31.249104 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:33:31.253752 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:33:31.253752 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:33:31.253752 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:33:31.253752 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:33:31.253752 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:33:31.253752 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:33:31.253752 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:33:31.253752 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Oct 27 03:33:31.253752 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:33:31.255949 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d98a5135-e8a3-4514-85ec-f44312755e24 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Returning 404 to user: floating IP not found {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:33:31.257435 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d98a5135-e8a3-4514-85ec-f44312755e24 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] 10.222.0.20 "POST /compute/v2.1/servers/0e0220c0-997d-4f48-9ac2-550d2ba017ca/action" status: 404 len: 67 microversion: 2.1 time: 0.536241 Oct 27 03:33:31.258249 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1618/3030] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:33:30 2022] POST /compute/v2.1/servers/0e0220c0-997d-4f48-9ac2-550d2ba017ca/action => generated 67 bytes in 539 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 03:33:31.273596 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-04ad47e1-294e-495b-9944-455e995f193e tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:31.275913 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-04ad47e1-294e-495b-9944-455e995f193e tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] [instance: e42cf1fc-e9c5-42f3-be93-ad7c3730e19c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:31.295447 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-04ad47e1-294e-495b-9944-455e995f193e tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:31.304023 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-04ad47e1-294e-495b-9944-455e995f193e tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:31.306730 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-04ad47e1-294e-495b-9944-455e995f193e tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:31.308293 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-04ad47e1-294e-495b-9944-455e995f193e tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:31.313008 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-04ad47e1-294e-495b-9944-455e995f193e tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:31.315327 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-04ad47e1-294e-495b-9944-455e995f193e tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:31.535217 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1747d855-c82f-4786-a024-994c4f905deb tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533917bc5aa4e23802a43b1eb534bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d87abf835a4104b40056b9eec2d6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:31.546936 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1747d855-c82f-4786-a024-994c4f905deb tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] 10.222.0.20 "GET /compute/v2.1/servers/2e1b6a2e-8acc-4c77-b551-4a623893ebaf" status: 200 len: 1494 microversion: 2.1 time: 0.865740 Oct 27 03:33:31.551150 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1413/3031] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:30 2022] GET /compute/v2.1/servers/2e1b6a2e-8acc-4c77-b551-4a623893ebaf => generated 1494 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:33:31.561114 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5ac9d6e4-80f4-485b-94d2-26a0f2295739 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:33:31.672915 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-5ac9d6e4-80f4-485b-94d2-26a0f2295739 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Oct 27 03:33:31.674761 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5ac9d6e4-80f4-485b-94d2-26a0f2295739 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Request method failure captured: Oct 27 03:33:31.674761 n-d-862769-1 devstack@n-api.service[121000]: request: POST /compute/v2.1/servers/0e0220c0-997d-4f48-9ac2-550d2ba017ca/action HTTP/1.1 Oct 27 03:33:31.674761 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:33:31.674761 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:33:31.674761 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:33:31.674761 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 44 Oct 27 03:33:31.674761 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:33:31.674761 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:33:31.674761 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:33:31.674761 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:33:31.674761 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfvTi1_-5V6JBmPcX6PFqM0rlmKZ_gL2Lz7wpuf3oQeWYf0tOxeYivwLykVGXkJ281xjux70z92WlsBnNpgUI-13-heXmdooe2GtxEBib8IEt5J-bM2_pz-uJTM4fhpgK_2HRD9iLxNAvKZQOQ6NcqYQkc2X-yXWbr9qzjZYeWtrq4w Oct 27 03:33:31.674761 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:33:31.674761 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:33:31.674761 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:33:31.674761 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:33:31.674761 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:33:31.674761 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:33:31.674761 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: dd32721d34bc40679303d6f47daae25c Oct 27 03:33:31.674761 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 Oct 27 03:33:31.674761 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:33:31.674761 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:33:31.674761 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dd32721d34bc40679303d6f47daae25c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dd32721d34bc40679303d6f47daae25c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dd32721d34bc40679303d6f47daae25c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dd32721d34bc40679303d6f47daae25c"}]}] Oct 27 03:33:31.674761 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 Oct 27 03:33:31.674761 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: dd32721d34bc40679303d6f47daae25c Oct 27 03:33:31.674761 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 Oct 27 03:33:31.674761 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project Oct 27 03:33:31.674761 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:33:31.674761 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:33:31.674761 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: cd284264ddc64d58baee15e337d5fcc6 Oct 27 03:33:31.674761 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project Oct 27 03:33:31.674761 n-d-862769-1 devstack@n-api.service[121000]: Oct 27 03:33:31.674761 n-d-862769-1 devstack@n-api.service[121000]: {"removeFloatingIp": {"address": "0.0.0.0"}} Oct 27 03:33:31.674761 n-d-862769-1 devstack@n-api.service[121000]: method: Oct 27 03:33:31.674761 n-d-862769-1 devstack@n-api.service[121000]: exception: Floating IP not found for address 0.0.0.0. Oct 27 03:33:31.674761 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '0e0220c0-997d-4f48-9ac2-550d2ba017ca', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Oct 27 03:33:31.674761 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:33:31.674761 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:33:31.674761 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Oct 27 03:33:31.674761 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Oct 27 03:33:31.674761 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Oct 27 03:33:31.674761 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Oct 27 03:33:31.674761 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 27 03:33:31.674761 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 27 03:33:31.674761 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 27 03:33:31.674761 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:33:31.674761 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:33:31.674761 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:33:31.674761 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:33:31.674761 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:33:31.674761 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:33:31.674761 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:33:31.674761 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:33:31.674761 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:33:31.674761 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:33:31.674761 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:33:31.674761 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:33:31.674761 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:33:31.674761 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:33:31.674761 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Oct 27 03:33:31.674761 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Oct 27 03:33:31.674761 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Oct 27 03:33:31.674761 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Oct 27 03:33:31.679229 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Oct 27 03:33:31.679229 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:33:31.679229 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:33:31.679229 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:33:31.679229 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:33:31.679229 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:33:31.679229 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:33:31.679229 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:33:31.679229 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:33:31.679229 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Oct 27 03:33:31.679229 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:33:31.679229 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5ac9d6e4-80f4-485b-94d2-26a0f2295739 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:33:31.679229 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5ac9d6e4-80f4-485b-94d2-26a0f2295739 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] 10.222.0.20 "POST /compute/v2.1/servers/0e0220c0-997d-4f48-9ac2-550d2ba017ca/action" status: 404 len: 88 microversion: 2.1 time: 0.124106 Oct 27 03:33:31.679229 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1414/3032] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:33:31 2022] POST /compute/v2.1/servers/0e0220c0-997d-4f48-9ac2-550d2ba017ca/action => generated 88 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 03:33:31.690337 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d56468c1-2652-4912-882a-80754a5822eb tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:31.691310 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d56468c1-2652-4912-882a-80754a5822eb tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] [instance: 0e0220c0-997d-4f48-9ac2-550d2ba017ca] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:31.711633 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d56468c1-2652-4912-882a-80754a5822eb tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:31.712927 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d56468c1-2652-4912-882a-80754a5822eb tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:31.715085 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d56468c1-2652-4912-882a-80754a5822eb tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:31.717266 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d56468c1-2652-4912-882a-80754a5822eb tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:31.720203 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d56468c1-2652-4912-882a-80754a5822eb tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:31.722047 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d56468c1-2652-4912-882a-80754a5822eb tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:31.787050 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d56468c1-2652-4912-882a-80754a5822eb tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] [instance: 0e0220c0-997d-4f48-9ac2-550d2ba017ca] Going to try to terminate instance {{(pid=121000) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:33:31.871545 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-04ad47e1-294e-495b-9944-455e995f193e tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f7471db101458fa692a73173bb42a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c1020a13864ca8b5199427528d650d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:31.882810 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-04ad47e1-294e-495b-9944-455e995f193e tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] 10.222.0.20 "GET /compute/v2.1/servers/e42cf1fc-e9c5-42f3-be93-ad7c3730e19c" status: 200 len: 1316 microversion: 2.1 time: 0.622643 Oct 27 03:33:31.887164 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1619/3033] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:31 2022] GET /compute/v2.1/servers/e42cf1fc-e9c5-42f3-be93-ad7c3730e19c => generated 1316 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:33:31.919623 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-afd4ac2f-ce76-44b3-8596-9e0138892f20 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:31.922713 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-afd4ac2f-ce76-44b3-8596-9e0138892f20 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: d70ad817-aab3-419c-85ab-b458bb9d8d26] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:31.936282 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-afd4ac2f-ce76-44b3-8596-9e0138892f20 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:31.940148 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-afd4ac2f-ce76-44b3-8596-9e0138892f20 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:31.946679 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-afd4ac2f-ce76-44b3-8596-9e0138892f20 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:31.946679 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-afd4ac2f-ce76-44b3-8596-9e0138892f20 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:31.946679 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-afd4ac2f-ce76-44b3-8596-9e0138892f20 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:31.946679 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-afd4ac2f-ce76-44b3-8596-9e0138892f20 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:32.281250 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d56468c1-2652-4912-882a-80754a5822eb tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0e0220c0-997d-4f48-9ac2-550d2ba017ca" status: 204 len: 0 microversion: 2.1 time: 0.596774 Oct 27 03:33:32.282411 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1415/3034] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:33:31 2022] DELETE /compute/v2.1/servers/0e0220c0-997d-4f48-9ac2-550d2ba017ca => generated 0 bytes in 599 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:33:32.294499 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5d97fb5e-03ac-4990-9850-2e8a55cc4c59 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:32.295988 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5d97fb5e-03ac-4990-9850-2e8a55cc4c59 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] [instance: 0e0220c0-997d-4f48-9ac2-550d2ba017ca] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:32.321659 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5d97fb5e-03ac-4990-9850-2e8a55cc4c59 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:32.323914 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5d97fb5e-03ac-4990-9850-2e8a55cc4c59 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:32.328550 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5d97fb5e-03ac-4990-9850-2e8a55cc4c59 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:32.329732 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5d97fb5e-03ac-4990-9850-2e8a55cc4c59 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:32.332003 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5d97fb5e-03ac-4990-9850-2e8a55cc4c59 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:32.333667 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5d97fb5e-03ac-4990-9850-2e8a55cc4c59 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:32.522969 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-afd4ac2f-ce76-44b3-8596-9e0138892f20 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:32.534283 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-afd4ac2f-ce76-44b3-8596-9e0138892f20 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/d70ad817-aab3-419c-85ab-b458bb9d8d26" status: 200 len: 1512 microversion: 2.1 time: 0.632046 Oct 27 03:33:32.536976 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1620/3035] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:31 2022] GET /compute/v2.1/servers/d70ad817-aab3-419c-85ab-b458bb9d8d26 => generated 1512 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:33:32.577958 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-cc4332af-22f7-4c71-a877-7e5d8bc85557 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:32.578813 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-cc4332af-22f7-4c71-a877-7e5d8bc85557 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] [instance: 2e1b6a2e-8acc-4c77-b551-4a623893ebaf] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:32.592980 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cc4332af-22f7-4c71-a877-7e5d8bc85557 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:32.593486 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cc4332af-22f7-4c71-a877-7e5d8bc85557 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:32.600128 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cc4332af-22f7-4c71-a877-7e5d8bc85557 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:32.604113 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cc4332af-22f7-4c71-a877-7e5d8bc85557 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:32.604113 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cc4332af-22f7-4c71-a877-7e5d8bc85557 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:32.604113 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cc4332af-22f7-4c71-a877-7e5d8bc85557 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:32.879335 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5d97fb5e-03ac-4990-9850-2e8a55cc4c59 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd284264ddc64d58baee15e337d5fcc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd32721d34bc40679303d6f47daae25c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:32.896010 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5d97fb5e-03ac-4990-9850-2e8a55cc4c59 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] 10.222.0.20 "GET /compute/v2.1/servers/0e0220c0-997d-4f48-9ac2-550d2ba017ca" status: 200 len: 1541 microversion: 2.1 time: 0.609120 Oct 27 03:33:32.900995 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1416/3036] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:32 2022] GET /compute/v2.1/servers/0e0220c0-997d-4f48-9ac2-550d2ba017ca => generated 1541 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:33:32.917750 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-97b60be3-78ee-4212-b316-ddf5a9eb3bf5 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:32.918587 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-97b60be3-78ee-4212-b316-ddf5a9eb3bf5 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] [instance: e42cf1fc-e9c5-42f3-be93-ad7c3730e19c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:32.938740 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-97b60be3-78ee-4212-b316-ddf5a9eb3bf5 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:32.945077 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-97b60be3-78ee-4212-b316-ddf5a9eb3bf5 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:32.945718 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-97b60be3-78ee-4212-b316-ddf5a9eb3bf5 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:32.947419 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-97b60be3-78ee-4212-b316-ddf5a9eb3bf5 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:32.947904 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-97b60be3-78ee-4212-b316-ddf5a9eb3bf5 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:32.948345 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-97b60be3-78ee-4212-b316-ddf5a9eb3bf5 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:33.372343 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-cc4332af-22f7-4c71-a877-7e5d8bc85557 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533917bc5aa4e23802a43b1eb534bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d87abf835a4104b40056b9eec2d6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:33.384433 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-cc4332af-22f7-4c71-a877-7e5d8bc85557 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] 10.222.0.20 "GET /compute/v2.1/servers/2e1b6a2e-8acc-4c77-b551-4a623893ebaf" status: 200 len: 1494 microversion: 2.1 time: 0.810289 Oct 27 03:33:33.385746 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1621/3037] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:32 2022] GET /compute/v2.1/servers/2e1b6a2e-8acc-4c77-b551-4a623893ebaf => generated 1494 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:33:33.568977 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-fbf18c29-e494-4cbd-bb7d-18ab5411f0a4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:33.569686 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-fbf18c29-e494-4cbd-bb7d-18ab5411f0a4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: d70ad817-aab3-419c-85ab-b458bb9d8d26] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:33.571784 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-97b60be3-78ee-4212-b316-ddf5a9eb3bf5 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f7471db101458fa692a73173bb42a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c1020a13864ca8b5199427528d650d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:33.588406 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-97b60be3-78ee-4212-b316-ddf5a9eb3bf5 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] 10.222.0.20 "GET /compute/v2.1/servers/e42cf1fc-e9c5-42f3-be93-ad7c3730e19c" status: 200 len: 1316 microversion: 2.1 time: 0.676975 Oct 27 03:33:33.591091 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fbf18c29-e494-4cbd-bb7d-18ab5411f0a4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:33.597265 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fbf18c29-e494-4cbd-bb7d-18ab5411f0a4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:33.597902 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fbf18c29-e494-4cbd-bb7d-18ab5411f0a4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:33.598832 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fbf18c29-e494-4cbd-bb7d-18ab5411f0a4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:33.600254 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1417/3038] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:32 2022] GET /compute/v2.1/servers/e42cf1fc-e9c5-42f3-be93-ad7c3730e19c => generated 1316 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:33:33.601948 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fbf18c29-e494-4cbd-bb7d-18ab5411f0a4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:33.602627 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fbf18c29-e494-4cbd-bb7d-18ab5411f0a4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:33.925609 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9e2306e1-3184-4cd7-b37d-9f8abbae1d0e tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:33.927068 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9e2306e1-3184-4cd7-b37d-9f8abbae1d0e tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] [instance: 0e0220c0-997d-4f48-9ac2-550d2ba017ca] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:33.944487 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9e2306e1-3184-4cd7-b37d-9f8abbae1d0e tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:33.945003 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9e2306e1-3184-4cd7-b37d-9f8abbae1d0e tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:33.945666 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9e2306e1-3184-4cd7-b37d-9f8abbae1d0e tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:33.946614 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9e2306e1-3184-4cd7-b37d-9f8abbae1d0e tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:33.949781 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9e2306e1-3184-4cd7-b37d-9f8abbae1d0e tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:33.950501 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9e2306e1-3184-4cd7-b37d-9f8abbae1d0e tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:34.209875 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-fbf18c29-e494-4cbd-bb7d-18ab5411f0a4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:34.245341 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-fbf18c29-e494-4cbd-bb7d-18ab5411f0a4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/d70ad817-aab3-419c-85ab-b458bb9d8d26" status: 200 len: 1512 microversion: 2.1 time: 0.677709 Oct 27 03:33:34.247417 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1622/3039] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:33 2022] GET /compute/v2.1/servers/d70ad817-aab3-419c-85ab-b458bb9d8d26 => generated 1512 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:33:34.421487 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d9d7d8ff-9794-4503-af80-8e6f37b60846 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:34.422545 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d9d7d8ff-9794-4503-af80-8e6f37b60846 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] [instance: 2e1b6a2e-8acc-4c77-b551-4a623893ebaf] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:34.440289 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d9d7d8ff-9794-4503-af80-8e6f37b60846 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:34.441249 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d9d7d8ff-9794-4503-af80-8e6f37b60846 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:34.444060 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d9d7d8ff-9794-4503-af80-8e6f37b60846 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:34.448577 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d9d7d8ff-9794-4503-af80-8e6f37b60846 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:34.450098 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d9d7d8ff-9794-4503-af80-8e6f37b60846 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:34.459269 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d9d7d8ff-9794-4503-af80-8e6f37b60846 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:34.712086 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9e2306e1-3184-4cd7-b37d-9f8abbae1d0e tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd284264ddc64d58baee15e337d5fcc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd32721d34bc40679303d6f47daae25c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:34.721300 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9e2306e1-3184-4cd7-b37d-9f8abbae1d0e tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] 10.222.0.20 "GET /compute/v2.1/servers/0e0220c0-997d-4f48-9ac2-550d2ba017ca" status: 200 len: 1541 microversion: 2.1 time: 0.800720 Oct 27 03:33:34.728229 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1418/3040] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:33 2022] GET /compute/v2.1/servers/0e0220c0-997d-4f48-9ac2-550d2ba017ca => generated 1541 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:33:34.733950 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-26e3547c-ae31-4f06-babb-04201e378678 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:34.740950 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-26e3547c-ae31-4f06-babb-04201e378678 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] [instance: e42cf1fc-e9c5-42f3-be93-ad7c3730e19c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:34.754254 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-26e3547c-ae31-4f06-babb-04201e378678 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:34.754680 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-26e3547c-ae31-4f06-babb-04201e378678 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:34.755123 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-26e3547c-ae31-4f06-babb-04201e378678 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:34.755841 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-26e3547c-ae31-4f06-babb-04201e378678 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:34.756291 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-26e3547c-ae31-4f06-babb-04201e378678 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:34.758713 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-26e3547c-ae31-4f06-babb-04201e378678 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:34.923587 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d9d7d8ff-9794-4503-af80-8e6f37b60846 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533917bc5aa4e23802a43b1eb534bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d87abf835a4104b40056b9eec2d6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:34.932595 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d9d7d8ff-9794-4503-af80-8e6f37b60846 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] 10.222.0.20 "GET /compute/v2.1/servers/2e1b6a2e-8acc-4c77-b551-4a623893ebaf" status: 200 len: 1494 microversion: 2.1 time: 0.515234 Oct 27 03:33:34.937606 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1623/3041] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:34 2022] GET /compute/v2.1/servers/2e1b6a2e-8acc-4c77-b551-4a623893ebaf => generated 1494 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:33:35.271345 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1466ef45-f168-4b58-804e-dcd119c46e9d tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:35.271345 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1466ef45-f168-4b58-804e-dcd119c46e9d tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: d70ad817-aab3-419c-85ab-b458bb9d8d26] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:35.287629 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1466ef45-f168-4b58-804e-dcd119c46e9d tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:35.291777 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1466ef45-f168-4b58-804e-dcd119c46e9d tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:35.299090 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1466ef45-f168-4b58-804e-dcd119c46e9d tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:35.300035 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1466ef45-f168-4b58-804e-dcd119c46e9d tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:35.303576 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1466ef45-f168-4b58-804e-dcd119c46e9d tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:35.303576 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1466ef45-f168-4b58-804e-dcd119c46e9d tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:35.362588 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:33:35.369491 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-26e3547c-ae31-4f06-babb-04201e378678 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f7471db101458fa692a73173bb42a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c1020a13864ca8b5199427528d650d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:35.396195 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-26e3547c-ae31-4f06-babb-04201e378678 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] 10.222.0.20 "GET /compute/v2.1/servers/e42cf1fc-e9c5-42f3-be93-ad7c3730e19c" status: 200 len: 1316 microversion: 2.1 time: 0.664191 Oct 27 03:33:35.398584 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1419/3042] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:34 2022] GET /compute/v2.1/servers/e42cf1fc-e9c5-42f3-be93-ad7c3730e19c => generated 1316 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:33:35.760924 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d093bd13-b117-4972-87cc-077227ebcd05 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:35.761731 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d093bd13-b117-4972-87cc-077227ebcd05 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] [instance: 0e0220c0-997d-4f48-9ac2-550d2ba017ca] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:35.778505 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d093bd13-b117-4972-87cc-077227ebcd05 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:35.779009 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d093bd13-b117-4972-87cc-077227ebcd05 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:35.779456 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d093bd13-b117-4972-87cc-077227ebcd05 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:35.780183 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d093bd13-b117-4972-87cc-077227ebcd05 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:35.780640 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d093bd13-b117-4972-87cc-077227ebcd05 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:35.781069 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d093bd13-b117-4972-87cc-077227ebcd05 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:36.864342 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d093bd13-b117-4972-87cc-077227ebcd05 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd284264ddc64d58baee15e337d5fcc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd32721d34bc40679303d6f47daae25c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:36.881828 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1466ef45-f168-4b58-804e-dcd119c46e9d tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:36.882781 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d093bd13-b117-4972-87cc-077227ebcd05 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] 10.222.0.20 "GET /compute/v2.1/servers/0e0220c0-997d-4f48-9ac2-550d2ba017ca" status: 200 len: 1541 microversion: 2.1 time: 1.124259 Oct 27 03:33:36.886880 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1420/3043] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:35 2022] GET /compute/v2.1/servers/0e0220c0-997d-4f48-9ac2-550d2ba017ca => generated 1541 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:33:36.893203 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1466ef45-f168-4b58-804e-dcd119c46e9d tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/d70ad817-aab3-419c-85ab-b458bb9d8d26" status: 200 len: 1512 microversion: 2.1 time: 1.628543 Oct 27 03:33:36.897641 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1624/3044] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:35 2022] GET /compute/v2.1/servers/d70ad817-aab3-419c-85ab-b458bb9d8d26 => generated 1512 bytes in 1633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:33:36.910602 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-95e85994-f53d-4800-834d-14e51ad424ed tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:36.911409 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-95e85994-f53d-4800-834d-14e51ad424ed tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] [instance: 2e1b6a2e-8acc-4c77-b551-4a623893ebaf] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:36.912146 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-43a18118-4a8d-4ea2-ae41-e31425805543 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:36.913052 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-43a18118-4a8d-4ea2-ae41-e31425805543 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] [instance: e42cf1fc-e9c5-42f3-be93-ad7c3730e19c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:36.936080 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-95e85994-f53d-4800-834d-14e51ad424ed tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:36.936750 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-95e85994-f53d-4800-834d-14e51ad424ed tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:36.938975 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-95e85994-f53d-4800-834d-14e51ad424ed tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:36.939759 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-95e85994-f53d-4800-834d-14e51ad424ed tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:36.940244 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-95e85994-f53d-4800-834d-14e51ad424ed tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:36.940689 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-95e85994-f53d-4800-834d-14e51ad424ed tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:36.956201 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-43a18118-4a8d-4ea2-ae41-e31425805543 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:36.956720 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-43a18118-4a8d-4ea2-ae41-e31425805543 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:36.957177 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-43a18118-4a8d-4ea2-ae41-e31425805543 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:36.957911 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-43a18118-4a8d-4ea2-ae41-e31425805543 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:36.958437 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-43a18118-4a8d-4ea2-ae41-e31425805543 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:36.958882 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-43a18118-4a8d-4ea2-ae41-e31425805543 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:37.488735 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-43a18118-4a8d-4ea2-ae41-e31425805543 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f7471db101458fa692a73173bb42a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c1020a13864ca8b5199427528d650d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:37.504163 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-43a18118-4a8d-4ea2-ae41-e31425805543 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] 10.222.0.20 "GET /compute/v2.1/servers/e42cf1fc-e9c5-42f3-be93-ad7c3730e19c" status: 200 len: 1316 microversion: 2.1 time: 0.605134 Oct 27 03:33:37.505427 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1625/3045] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:36 2022] GET /compute/v2.1/servers/e42cf1fc-e9c5-42f3-be93-ad7c3730e19c => generated 1316 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:33:37.772601 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-95e85994-f53d-4800-834d-14e51ad424ed tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533917bc5aa4e23802a43b1eb534bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d87abf835a4104b40056b9eec2d6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:37.776700 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-95e85994-f53d-4800-834d-14e51ad424ed tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] 10.222.0.20 "GET /compute/v2.1/servers/2e1b6a2e-8acc-4c77-b551-4a623893ebaf" status: 200 len: 1500 microversion: 2.1 time: 0.881535 Oct 27 03:33:37.778710 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1421/3046] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:36 2022] GET /compute/v2.1/servers/2e1b6a2e-8acc-4c77-b551-4a623893ebaf => generated 1500 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:33:37.818171 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7367f642-f867-4b56-bcce-cca758204c59 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:37.818975 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7367f642-f867-4b56-bcce-cca758204c59 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] [instance: 2e1b6a2e-8acc-4c77-b551-4a623893ebaf] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:37.833697 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7367f642-f867-4b56-bcce-cca758204c59 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:37.839043 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7367f642-f867-4b56-bcce-cca758204c59 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:37.842078 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7367f642-f867-4b56-bcce-cca758204c59 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:37.845902 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7367f642-f867-4b56-bcce-cca758204c59 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:37.848516 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7367f642-f867-4b56-bcce-cca758204c59 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:37.850606 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7367f642-f867-4b56-bcce-cca758204c59 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:37.925814 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c8f2773f-7a05-4348-ba6a-7931ba277971 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:37.927317 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c8f2773f-7a05-4348-ba6a-7931ba277971 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] [instance: 0e0220c0-997d-4f48-9ac2-550d2ba017ca] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:37.938624 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c8f2773f-7a05-4348-ba6a-7931ba277971 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:37.942000 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c8f2773f-7a05-4348-ba6a-7931ba277971 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:37.946146 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c8f2773f-7a05-4348-ba6a-7931ba277971 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:37.946146 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c8f2773f-7a05-4348-ba6a-7931ba277971 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:37.946146 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c8f2773f-7a05-4348-ba6a-7931ba277971 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:37.946146 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c8f2773f-7a05-4348-ba6a-7931ba277971 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:37.946500 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7367f642-f867-4b56-bcce-cca758204c59 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] [instance: 2e1b6a2e-8acc-4c77-b551-4a623893ebaf] Going to try to terminate instance {{(pid=121001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:33:38.099515 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c8f2773f-7a05-4348-ba6a-7931ba277971 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd284264ddc64d58baee15e337d5fcc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd32721d34bc40679303d6f47daae25c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:38.114066 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c8f2773f-7a05-4348-ba6a-7931ba277971 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] 10.222.0.20 "GET /compute/v2.1/servers/0e0220c0-997d-4f48-9ac2-550d2ba017ca" status: 200 len: 1499 microversion: 2.1 time: 0.193708 Oct 27 03:33:38.114651 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1422/3047] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:37 2022] GET /compute/v2.1/servers/0e0220c0-997d-4f48-9ac2-550d2ba017ca => generated 1499 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:33:38.122500 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2de90f65-b2ab-4f75-a4c1-41f65e2f7243 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:38.124077 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-2de90f65-b2ab-4f75-a4c1-41f65e2f7243 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: d70ad817-aab3-419c-85ab-b458bb9d8d26] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:38.136865 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2de90f65-b2ab-4f75-a4c1-41f65e2f7243 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:38.139056 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2de90f65-b2ab-4f75-a4c1-41f65e2f7243 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:38.139653 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2de90f65-b2ab-4f75-a4c1-41f65e2f7243 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:38.140401 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2de90f65-b2ab-4f75-a4c1-41f65e2f7243 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:38.140862 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2de90f65-b2ab-4f75-a4c1-41f65e2f7243 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:38.142089 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2de90f65-b2ab-4f75-a4c1-41f65e2f7243 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:38.465032 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2de90f65-b2ab-4f75-a4c1-41f65e2f7243 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:38.466768 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7367f642-f867-4b56-bcce-cca758204c59 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2e1b6a2e-8acc-4c77-b551-4a623893ebaf" status: 204 len: 0 microversion: 2.1 time: 0.657542 Oct 27 03:33:38.467660 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1626/3048] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:33:37 2022] DELETE /compute/v2.1/servers/2e1b6a2e-8acc-4c77-b551-4a623893ebaf => generated 0 bytes in 659 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:33:38.474631 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-8390634e-91a1-4ab6-9688-813e7ae35a83 req-988d4227-26c7-410e-afb8-27aaaea09503 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e0220c0-997d-4f48-9ac2-550d2ba017ca", "name": "network-vif-deleted", "tag": "08007cb1-7b3e-491c-aa88-e844f91f01cf"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:33:38.487743 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2de90f65-b2ab-4f75-a4c1-41f65e2f7243 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/d70ad817-aab3-419c-85ab-b458bb9d8d26" status: 200 len: 1512 microversion: 2.1 time: 0.370875 Oct 27 03:33:38.488257 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-8390634e-91a1-4ab6-9688-813e7ae35a83 req-988d4227-26c7-410e-afb8-27aaaea09503 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:38.488763 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1423/3049] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:38 2022] GET /compute/v2.1/servers/d70ad817-aab3-419c-85ab-b458bb9d8d26 => generated 1512 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:33:38.503184 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-8390634e-91a1-4ab6-9688-813e7ae35a83 req-988d4227-26c7-410e-afb8-27aaaea09503 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:38.503830 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-8390634e-91a1-4ab6-9688-813e7ae35a83 req-988d4227-26c7-410e-afb8-27aaaea09503 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:38.520109 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-8390634e-91a1-4ab6-9688-813e7ae35a83 req-988d4227-26c7-410e-afb8-27aaaea09503 service nova] Creating event network-vif-deleted:08007cb1-7b3e-491c-aa88-e844f91f01cf for instance 0e0220c0-997d-4f48-9ac2-550d2ba017ca on n-h2-862769-1 Oct 27 03:33:38.527328 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-8390634e-91a1-4ab6-9688-813e7ae35a83 req-988d4227-26c7-410e-afb8-27aaaea09503 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058008 Oct 27 03:33:38.527934 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1627/3050] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:33:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:33:38.534277 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0efe016e-1d2f-46e4-9c44-df346c505cf0 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:38.535230 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0efe016e-1d2f-46e4-9c44-df346c505cf0 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] [instance: 2e1b6a2e-8acc-4c77-b551-4a623893ebaf] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:38.542251 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0efe016e-1d2f-46e4-9c44-df346c505cf0 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:38.542969 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0efe016e-1d2f-46e4-9c44-df346c505cf0 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:38.543598 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0efe016e-1d2f-46e4-9c44-df346c505cf0 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:38.544542 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0efe016e-1d2f-46e4-9c44-df346c505cf0 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:38.545145 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0efe016e-1d2f-46e4-9c44-df346c505cf0 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:38.545751 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0efe016e-1d2f-46e4-9c44-df346c505cf0 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:38.722557 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4bb23210-5f0a-465f-abc5-58a4758185f6 tempest-ServerGroup264TestJSON-1677488168 tempest-ServerGroup264TestJSON-1677488168-project] Action: 'create', calling method: .version_select at 0x7f7dd9e3faf0>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:33:38.756326 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-4bb23210-5f0a-465f-abc5-58a4758185f6 tempest-ServerGroup264TestJSON-1677488168 tempest-ServerGroup264TestJSON-1677488168-project] Getting quotas for project 5fbe72eaad79489ba74b04819eaf8d64. Resources: {'server_groups'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:33:38.766330 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-4bb23210-5f0a-465f-abc5-58a4758185f6 tempest-ServerGroup264TestJSON-1677488168 tempest-ServerGroup264TestJSON-1677488168-project] Getting quotas for user 3bab1bbeb309491e94394b1137e9f3bd and project 5fbe72eaad79489ba74b04819eaf8d64. Resources: {'server_groups'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:33:38.780087 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0efe016e-1d2f-46e4-9c44-df346c505cf0 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533917bc5aa4e23802a43b1eb534bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d87abf835a4104b40056b9eec2d6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:38.792350 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0efe016e-1d2f-46e4-9c44-df346c505cf0 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] 10.222.0.20 "GET /compute/v2.1/servers/2e1b6a2e-8acc-4c77-b551-4a623893ebaf" status: 200 len: 1506 microversion: 2.1 time: 0.262813 Oct 27 03:33:38.798214 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1628/3051] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:38 2022] GET /compute/v2.1/servers/2e1b6a2e-8acc-4c77-b551-4a623893ebaf => generated 1506 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:33:38.813898 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9df02bf1-c3ee-41dd-b62b-10b8e1486298 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:38.814823 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-9df02bf1-c3ee-41dd-b62b-10b8e1486298 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] [instance: e42cf1fc-e9c5-42f3-be93-ad7c3730e19c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:38.824375 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9df02bf1-c3ee-41dd-b62b-10b8e1486298 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:38.824375 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9df02bf1-c3ee-41dd-b62b-10b8e1486298 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:38.824375 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9df02bf1-c3ee-41dd-b62b-10b8e1486298 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:38.824842 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9df02bf1-c3ee-41dd-b62b-10b8e1486298 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:38.825031 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9df02bf1-c3ee-41dd-b62b-10b8e1486298 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:38.825464 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9df02bf1-c3ee-41dd-b62b-10b8e1486298 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:38.945424 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-4bb23210-5f0a-465f-abc5-58a4758185f6 tempest-ServerGroup264TestJSON-1677488168 tempest-ServerGroup264TestJSON-1677488168-project] Getting quotas for project 5fbe72eaad79489ba74b04819eaf8d64. Resources: {'server_groups'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:33:38.981011 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-4bb23210-5f0a-465f-abc5-58a4758185f6 tempest-ServerGroup264TestJSON-1677488168 tempest-ServerGroup264TestJSON-1677488168-project] Getting quotas for user 3bab1bbeb309491e94394b1137e9f3bd and project 5fbe72eaad79489ba74b04819eaf8d64. Resources: {'server_groups'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:33:39.017384 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4bb23210-5f0a-465f-abc5-58a4758185f6 tempest-ServerGroup264TestJSON-1677488168 tempest-ServerGroup264TestJSON-1677488168-project] 10.222.0.20 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.524211 Oct 27 03:33:39.019087 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1424/3052] 10.222.0.20 () {62 vars in 1214 bytes} [Thu Oct 27 03:33:38 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 03:33:39.026083 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-327154d1-675c-4806-b59d-655f701b21b4 req-d39ac5bb-d076-4feb-b5ec-7f88da8d42ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e42cf1fc-e9c5-42f3-be93-ad7c3730e19c", "name": "network-vif-plugged", "status": "completed", "tag": "6ceaf5e7-fa70-4309-8220-84d78208e8e4"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:33:39.040618 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-327154d1-675c-4806-b59d-655f701b21b4 req-d39ac5bb-d076-4feb-b5ec-7f88da8d42ae service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:39.042225 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-327154d1-675c-4806-b59d-655f701b21b4 req-d39ac5bb-d076-4feb-b5ec-7f88da8d42ae service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:39.042690 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-327154d1-675c-4806-b59d-655f701b21b4 req-d39ac5bb-d076-4feb-b5ec-7f88da8d42ae service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:39.078220 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-327154d1-675c-4806-b59d-655f701b21b4 req-d39ac5bb-d076-4feb-b5ec-7f88da8d42ae service nova] Creating event network-vif-plugged:6ceaf5e7-fa70-4309-8220-84d78208e8e4 for instance e42cf1fc-e9c5-42f3-be93-ad7c3730e19c on n-h1-862769-1 Oct 27 03:33:39.108430 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-327154d1-675c-4806-b59d-655f701b21b4 req-d39ac5bb-d076-4feb-b5ec-7f88da8d42ae service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087249 Oct 27 03:33:39.114708 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1425/3053] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:33:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:33:39.122930 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-27adb2a2-ba26-4655-8f55-37b9ca369d7b tempest-ServerGroup264TestJSON-1677488168 tempest-ServerGroup264TestJSON-1677488168-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:39.169104 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-27adb2a2-ba26-4655-8f55-37b9ca369d7b tempest-ServerGroup264TestJSON-1677488168 tempest-ServerGroup264TestJSON-1677488168-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.050904 Oct 27 03:33:39.178124 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1426/3054] 10.222.0.20 () {60 vars in 1193 bytes} [Thu Oct 27 03:33:39 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 03:33:39.188131 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-080a9af0-0a05-4285-b17e-472e91da5be9 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:39.191051 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-080a9af0-0a05-4285-b17e-472e91da5be9 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] [instance: 0e0220c0-997d-4f48-9ac2-550d2ba017ca] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:39.213803 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-080a9af0-0a05-4285-b17e-472e91da5be9 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:39.214778 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-080a9af0-0a05-4285-b17e-472e91da5be9 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:39.216105 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-080a9af0-0a05-4285-b17e-472e91da5be9 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:39.217685 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-080a9af0-0a05-4285-b17e-472e91da5be9 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:39.221872 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-080a9af0-0a05-4285-b17e-472e91da5be9 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:39.222669 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-080a9af0-0a05-4285-b17e-472e91da5be9 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:39.253412 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9df02bf1-c3ee-41dd-b62b-10b8e1486298 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f7471db101458fa692a73173bb42a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c1020a13864ca8b5199427528d650d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:39.270220 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9df02bf1-c3ee-41dd-b62b-10b8e1486298 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] 10.222.0.20 "GET /compute/v2.1/servers/e42cf1fc-e9c5-42f3-be93-ad7c3730e19c" status: 200 len: 1316 microversion: 2.1 time: 0.468398 Oct 27 03:33:39.271076 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1629/3055] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:38 2022] GET /compute/v2.1/servers/e42cf1fc-e9c5-42f3-be93-ad7c3730e19c => generated 1316 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:33:39.299064 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-080a9af0-0a05-4285-b17e-472e91da5be9 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:39.299775 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-080a9af0-0a05-4285-b17e-472e91da5be9 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:39.300406 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-080a9af0-0a05-4285-b17e-472e91da5be9 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:39.301030 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-080a9af0-0a05-4285-b17e-472e91da5be9 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lazy-loading 'fault' on Instance uuid 0e0220c0-997d-4f48-9ac2-550d2ba017ca {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:33:39.322996 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8f09966e-bdfc-403a-acdb-1f8edc50e047 tempest-ServerGroup264TestJSON-1677488168 tempest-ServerGroup264TestJSON-1677488168-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:39.359168 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8f09966e-bdfc-403a-acdb-1f8edc50e047 tempest-ServerGroup264TestJSON-1677488168 tempest-ServerGroup264TestJSON-1677488168-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups/80218c41-44c3-47d3-9099-3f3df0a5ea26" status: 200 len: 235 microversion: 2.64 time: 0.048663 Oct 27 03:33:39.363062 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1630/3056] 10.222.0.20 () {60 vars in 1304 bytes} [Thu Oct 27 03:33:39 2022] GET /compute/v2.1/os-server-groups/80218c41-44c3-47d3-9099-3f3df0a5ea26 => generated 235 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 03:33:39.381578 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-46b939ca-a327-45c3-8c6c-478a110be88a tempest-ServerGroup264TestJSON-1677488168 tempest-ServerGroup264TestJSON-1677488168-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:39.419189 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-080a9af0-0a05-4285-b17e-472e91da5be9 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd284264ddc64d58baee15e337d5fcc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd32721d34bc40679303d6f47daae25c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:39.430883 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-080a9af0-0a05-4285-b17e-472e91da5be9 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] 10.222.0.20 "GET /compute/v2.1/servers/0e0220c0-997d-4f48-9ac2-550d2ba017ca" status: 200 len: 1321 microversion: 2.1 time: 0.251128 Oct 27 03:33:39.444813 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1427/3057] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:39 2022] GET /compute/v2.1/servers/0e0220c0-997d-4f48-9ac2-550d2ba017ca => generated 1321 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:33:39.509330 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-46b939ca-a327-45c3-8c6c-478a110be88a tempest-ServerGroup264TestJSON-1677488168 tempest-ServerGroup264TestJSON-1677488168-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/80218c41-44c3-47d3-9099-3f3df0a5ea26" status: 204 len: 0 microversion: 2.64 time: 0.130270 Oct 27 03:33:39.517304 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1631/3058] 10.222.0.20 () {60 vars in 1307 bytes} [Thu Oct 27 03:33:39 2022] DELETE /compute/v2.1/os-server-groups/80218c41-44c3-47d3-9099-3f3df0a5ea26 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 03:33:39.519697 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ed68aeb9-0d8d-43aa-98d6-a918389049b6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:39.520590 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ed68aeb9-0d8d-43aa-98d6-a918389049b6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: d70ad817-aab3-419c-85ab-b458bb9d8d26] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:39.528791 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ed68aeb9-0d8d-43aa-98d6-a918389049b6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:39.529628 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ed68aeb9-0d8d-43aa-98d6-a918389049b6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:39.530404 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ed68aeb9-0d8d-43aa-98d6-a918389049b6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:39.531141 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ed68aeb9-0d8d-43aa-98d6-a918389049b6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:39.531608 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ed68aeb9-0d8d-43aa-98d6-a918389049b6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:39.531723 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-12e980da-4976-4fb3-b59a-bda81991e59b tempest-ServerGroup264TestJSON-1677488168 tempest-ServerGroup264TestJSON-1677488168-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:39.532099 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ed68aeb9-0d8d-43aa-98d6-a918389049b6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:39.545575 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-12e980da-4976-4fb3-b59a-bda81991e59b tempest-ServerGroup264TestJSON-1677488168 tempest-ServerGroup264TestJSON-1677488168-project] HTTP exception thrown: Instance group 80218c41-44c3-47d3-9099-3f3df0a5ea26 could not be found. Oct 27 03:33:39.553434 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-12e980da-4976-4fb3-b59a-bda81991e59b tempest-ServerGroup264TestJSON-1677488168 tempest-ServerGroup264TestJSON-1677488168-project] Request method failure captured: Oct 27 03:33:39.553434 n-d-862769-1 devstack@n-api.service[121001]: request: DELETE /compute/v2.1/os-server-groups/80218c41-44c3-47d3-9099-3f3df0a5ea26 HTTP/1.1 Oct 27 03:33:39.553434 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:33:39.553434 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:33:39.553434 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:33:39.553434 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:33:39.553434 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:33:39.553434 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:33:39.553434 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:33:39.553434 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:33:39.553434 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfwRFPj5W4YTT239u7MaQI304XD00oqUxvWBO9kQuHrBL4Dqo5OD_X2g2rypvj7TssE8cPbcPjO7R6Jpgh9NHDv5kitysTt3EVZwDNPqBFIB8m7hPLL70UjZc9CxsrEan1ePtQgbLJ2kuAyIZtuYd5e8FXj57HMfrC8Zkvri6A5B6mc Oct 27 03:33:39.553434 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:33:39.553434 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:33:39.553434 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:33:39.553434 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:33:39.553434 n-d-862769-1 devstack@n-api.service[121001]: X-Openstack-Nova-Api-Version: 2.64 Oct 27 03:33:39.553434 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:33:39.553434 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:33:39.553434 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 5fbe72eaad79489ba74b04819eaf8d64 Oct 27 03:33:39.553434 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServerGroup264TestJSON-1677488168 Oct 27 03:33:39.553434 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:33:39.553434 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:33:39.553434 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5fbe72eaad79489ba74b04819eaf8d64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5fbe72eaad79489ba74b04819eaf8d64"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5fbe72eaad79489ba74b04819eaf8d64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5fbe72eaad79489ba74b04819eaf8d64"}]}] Oct 27 03:33:39.553434 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServerGroup264TestJSON-1677488168 Oct 27 03:33:39.553434 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 5fbe72eaad79489ba74b04819eaf8d64 Oct 27 03:33:39.553434 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServerGroup264TestJSON-1677488168 Oct 27 03:33:39.553434 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServerGroup264TestJSON-1677488168-project Oct 27 03:33:39.553434 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:33:39.553434 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:33:39.553434 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 3bab1bbeb309491e94394b1137e9f3bd Oct 27 03:33:39.553434 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServerGroup264TestJSON-1677488168-project Oct 27 03:33:39.553434 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:33:39.553434 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance group 80218c41-44c3-47d3-9099-3f3df0a5ea26 could not be found. Oct 27 03:33:39.553434 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '80218c41-44c3-47d3-9099-3f3df0a5ea26'} Oct 27 03:33:39.553434 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:33:39.553434 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:33:39.553434 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 27 03:33:39.553434 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 27 03:33:39.553434 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 03:33:39.553434 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 03:33:39.553434 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 27 03:33:39.553434 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 27 03:33:39.553434 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 03:33:39.553434 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 03:33:39.553434 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 27 03:33:39.553434 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 27 03:33:39.553434 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 80218c41-44c3-47d3-9099-3f3df0a5ea26 could not be found. Oct 27 03:33:39.553434 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:33:39.553434 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:33:39.553434 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:33:39.553434 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:33:39.553434 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:33:39.553434 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:33:39.553434 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:33:39.553434 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:33:39.553434 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:33:39.553434 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:33:39.553434 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 27 03:33:39.553434 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:33:39.553434 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 80218c41-44c3-47d3-9099-3f3df0a5ea26 could not be found. Oct 27 03:33:39.553434 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:33:39.553434 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:33:39.553434 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:33:39.553434 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:33:39.557661 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:33:39.557661 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:33:39.557661 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:33:39.557661 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:33:39.557661 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 80218c41-44c3-47d3-9099-3f3df0a5ea26 could not be found. Oct 27 03:33:39.557661 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:33:39.564653 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-12e980da-4976-4fb3-b59a-bda81991e59b tempest-ServerGroup264TestJSON-1677488168 tempest-ServerGroup264TestJSON-1677488168-project] Returning 404 to user: Instance group 80218c41-44c3-47d3-9099-3f3df0a5ea26 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:33:39.567065 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-12e980da-4976-4fb3-b59a-bda81991e59b tempest-ServerGroup264TestJSON-1677488168 tempest-ServerGroup264TestJSON-1677488168-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/80218c41-44c3-47d3-9099-3f3df0a5ea26" status: 404 len: 117 microversion: 2.64 time: 0.048006 Oct 27 03:33:39.568424 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1632/3059] 10.222.0.20 () {60 vars in 1307 bytes} [Thu Oct 27 03:33:39 2022] DELETE /compute/v2.1/os-server-groups/80218c41-44c3-47d3-9099-3f3df0a5ea26 => generated 117 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 03:33:39.821476 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-97b9ea06-7f04-49b0-be70-abd4b3507159 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:39.822468 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-97b9ea06-7f04-49b0-be70-abd4b3507159 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] [instance: 2e1b6a2e-8acc-4c77-b551-4a623893ebaf] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:39.840070 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-97b9ea06-7f04-49b0-be70-abd4b3507159 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:39.843060 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-97b9ea06-7f04-49b0-be70-abd4b3507159 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:39.844609 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-97b9ea06-7f04-49b0-be70-abd4b3507159 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:39.845600 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-97b9ea06-7f04-49b0-be70-abd4b3507159 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:39.848111 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-97b9ea06-7f04-49b0-be70-abd4b3507159 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:39.849184 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-97b9ea06-7f04-49b0-be70-abd4b3507159 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:40.026974 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ed68aeb9-0d8d-43aa-98d6-a918389049b6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:40.037908 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ed68aeb9-0d8d-43aa-98d6-a918389049b6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/d70ad817-aab3-419c-85ab-b458bb9d8d26" status: 200 len: 1512 microversion: 2.1 time: 0.526633 Oct 27 03:33:40.045017 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1428/3060] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:39 2022] GET /compute/v2.1/servers/d70ad817-aab3-419c-85ab-b458bb9d8d26 => generated 1512 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:33:40.299177 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-bb84bf3f-7508-435a-a60e-d76cdc568b9c tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:40.299840 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-bb84bf3f-7508-435a-a60e-d76cdc568b9c tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] [instance: e42cf1fc-e9c5-42f3-be93-ad7c3730e19c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:40.317083 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bb84bf3f-7508-435a-a60e-d76cdc568b9c tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:40.317959 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bb84bf3f-7508-435a-a60e-d76cdc568b9c tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:40.320263 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bb84bf3f-7508-435a-a60e-d76cdc568b9c tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:40.322259 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bb84bf3f-7508-435a-a60e-d76cdc568b9c tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:40.323848 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bb84bf3f-7508-435a-a60e-d76cdc568b9c tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:40.325160 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bb84bf3f-7508-435a-a60e-d76cdc568b9c tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:40.353529 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:33:40.356124 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-97b9ea06-7f04-49b0-be70-abd4b3507159 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533917bc5aa4e23802a43b1eb534bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d87abf835a4104b40056b9eec2d6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:40.367602 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-97b9ea06-7f04-49b0-be70-abd4b3507159 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] 10.222.0.20 "GET /compute/v2.1/servers/2e1b6a2e-8acc-4c77-b551-4a623893ebaf" status: 200 len: 1506 microversion: 2.1 time: 0.550404 Oct 27 03:33:40.370592 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1633/3061] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:39 2022] GET /compute/v2.1/servers/2e1b6a2e-8acc-4c77-b551-4a623893ebaf => generated 1506 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:33:40.457131 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-450802f0-066a-431b-a207-114dfa0f6e9f tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:40.457759 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-450802f0-066a-431b-a207-114dfa0f6e9f tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] [instance: 0e0220c0-997d-4f48-9ac2-550d2ba017ca] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:40.499273 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-450802f0-066a-431b-a207-114dfa0f6e9f tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:40.499791 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-450802f0-066a-431b-a207-114dfa0f6e9f tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:40.500244 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-450802f0-066a-431b-a207-114dfa0f6e9f tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:40.503141 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-450802f0-066a-431b-a207-114dfa0f6e9f tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:40.503637 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-450802f0-066a-431b-a207-114dfa0f6e9f tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:40.504084 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-450802f0-066a-431b-a207-114dfa0f6e9f tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:40.548280 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-450802f0-066a-431b-a207-114dfa0f6e9f tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] HTTP exception thrown: Instance 0e0220c0-997d-4f48-9ac2-550d2ba017ca could not be found. Oct 27 03:33:40.550024 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-450802f0-066a-431b-a207-114dfa0f6e9f tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Request method failure captured: Oct 27 03:33:40.550024 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/0e0220c0-997d-4f48-9ac2-550d2ba017ca HTTP/1.1 Oct 27 03:33:40.550024 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:33:40.550024 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:33:40.550024 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:33:40.550024 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:33:40.550024 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:33:40.550024 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:33:40.550024 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:33:40.550024 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:33:40.550024 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfvTi1_-5V6JBmPcX6PFqM0rlmKZ_gL2Lz7wpuf3oQeWYf0tOxeYivwLykVGXkJ281xjux70z92WlsBnNpgUI-13-heXmdooe2GtxEBib8IEt5J-bM2_pz-uJTM4fhpgK_2HRD9iLxNAvKZQOQ6NcqYQkc2X-yXWbr9qzjZYeWtrq4w Oct 27 03:33:40.550024 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:33:40.550024 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:33:40.550024 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:33:40.550024 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:33:40.550024 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:33:40.550024 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:33:40.550024 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: dd32721d34bc40679303d6f47daae25c Oct 27 03:33:40.550024 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 Oct 27 03:33:40.550024 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:33:40.550024 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:33:40.550024 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dd32721d34bc40679303d6f47daae25c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dd32721d34bc40679303d6f47daae25c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dd32721d34bc40679303d6f47daae25c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dd32721d34bc40679303d6f47daae25c"}]}] Oct 27 03:33:40.550024 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 Oct 27 03:33:40.550024 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: dd32721d34bc40679303d6f47daae25c Oct 27 03:33:40.550024 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 Oct 27 03:33:40.550024 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project Oct 27 03:33:40.550024 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:33:40.550024 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:33:40.550024 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: cd284264ddc64d58baee15e337d5fcc6 Oct 27 03:33:40.550024 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project Oct 27 03:33:40.550024 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:33:40.550024 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 0e0220c0-997d-4f48-9ac2-550d2ba017ca could not be found. Oct 27 03:33:40.550024 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '0e0220c0-997d-4f48-9ac2-550d2ba017ca'} Oct 27 03:33:40.550024 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:33:40.550024 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:33:40.550024 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:33:40.550024 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:33:40.550024 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:33:40.550024 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:33:40.550024 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:33:40.550024 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:33:40.550024 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:33:40.550024 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:33:40.550024 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e0220c0-997d-4f48-9ac2-550d2ba017ca could not be found. Oct 27 03:33:40.550024 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:33:40.550024 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:33:40.550024 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:33:40.550024 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:33:40.550024 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:33:40.550024 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:33:40.550024 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:33:40.550024 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:33:40.550024 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:33:40.550024 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:33:40.550024 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:33:40.550024 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:33:40.550024 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:33:40.550024 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:33:40.550024 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:33:40.550024 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:33:40.550024 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e0220c0-997d-4f48-9ac2-550d2ba017ca could not be found. Oct 27 03:33:40.550024 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:33:40.553969 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:33:40.553969 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:33:40.553969 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:33:40.553969 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:33:40.553969 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:33:40.553969 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:33:40.553969 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:33:40.553969 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e0220c0-997d-4f48-9ac2-550d2ba017ca could not be found. Oct 27 03:33:40.553969 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:33:40.561748 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-450802f0-066a-431b-a207-114dfa0f6e9f tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] Returning 404 to user: Instance 0e0220c0-997d-4f48-9ac2-550d2ba017ca could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:33:40.561748 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-450802f0-066a-431b-a207-114dfa0f6e9f tempest-FloatingIPsAssociationNegativeTestJSON-1285348851 tempest-FloatingIPsAssociationNegativeTestJSON-1285348851-project] 10.222.0.20 "GET /compute/v2.1/servers/0e0220c0-997d-4f48-9ac2-550d2ba017ca" status: 404 len: 111 microversion: 2.1 time: 0.105830 Oct 27 03:33:40.562590 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1634/3062] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:40 2022] GET /compute/v2.1/servers/0e0220c0-997d-4f48-9ac2-550d2ba017ca => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:33:40.762775 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-bb84bf3f-7508-435a-a60e-d76cdc568b9c tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f7471db101458fa692a73173bb42a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c1020a13864ca8b5199427528d650d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:40.773835 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-bb84bf3f-7508-435a-a60e-d76cdc568b9c tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] 10.222.0.20 "GET /compute/v2.1/servers/e42cf1fc-e9c5-42f3-be93-ad7c3730e19c" status: 200 len: 1316 microversion: 2.1 time: 0.479408 Oct 27 03:33:40.790100 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1429/3063] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:40 2022] GET /compute/v2.1/servers/e42cf1fc-e9c5-42f3-be93-ad7c3730e19c => generated 1316 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:33:40.932706 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-67108fdd-ef9d-457c-a232-51d7405f00aa tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-719056341", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": [{"uuid": "32a5f0d7-a81f-43f8-a62a-3ac219506f92"}, {"uuid": "a0ec8905-4958-4bcd-8f1d-41c8ea26ca8a"}, {"uuid": "32a5f0d7-a81f-43f8-a62a-3ac219506f92"}]}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:33:41.025723 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.network.neutron [None req-67108fdd-ef9d-457c-a232-51d7405f00aa tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] validate_networks() for [('32a5f0d7-a81f-43f8-a62a-3ac219506f92', None, None, None, None, None), ('a0ec8905-4958-4bcd-8f1d-41c8ea26ca8a', None, None, None, None, None), ('32a5f0d7-a81f-43f8-a62a-3ac219506f92', None, None, None, None, None)] {{(pid=121001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:33:41.068537 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-be141003-09c7-4b59-82cc-cb198b267b00 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:41.070809 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-be141003-09c7-4b59-82cc-cb198b267b00 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: d70ad817-aab3-419c-85ab-b458bb9d8d26] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:41.081229 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-be141003-09c7-4b59-82cc-cb198b267b00 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:41.081737 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-be141003-09c7-4b59-82cc-cb198b267b00 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:41.082239 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-be141003-09c7-4b59-82cc-cb198b267b00 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:41.085019 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-be141003-09c7-4b59-82cc-cb198b267b00 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:41.085495 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-be141003-09c7-4b59-82cc-cb198b267b00 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:41.085937 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-be141003-09c7-4b59-82cc-cb198b267b00 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:41.723455 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-be141003-09c7-4b59-82cc-cb198b267b00 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:41.736156 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-be141003-09c7-4b59-82cc-cb198b267b00 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/d70ad817-aab3-419c-85ab-b458bb9d8d26" status: 200 len: 1512 microversion: 2.1 time: 0.671802 Oct 27 03:33:41.737579 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1430/3064] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:41 2022] GET /compute/v2.1/servers/d70ad817-aab3-419c-85ab-b458bb9d8d26 => generated 1512 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:33:41.744896 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4e3fd2af-8402-48da-b54d-d23e64bb5c40 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:41.751634 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4e3fd2af-8402-48da-b54d-d23e64bb5c40 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] [instance: 2e1b6a2e-8acc-4c77-b551-4a623893ebaf] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:41.769166 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4e3fd2af-8402-48da-b54d-d23e64bb5c40 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:41.778053 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4e3fd2af-8402-48da-b54d-d23e64bb5c40 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:41.779711 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4e3fd2af-8402-48da-b54d-d23e64bb5c40 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:41.780728 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4e3fd2af-8402-48da-b54d-d23e64bb5c40 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:41.781432 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4e3fd2af-8402-48da-b54d-d23e64bb5c40 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:41.782179 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4e3fd2af-8402-48da-b54d-d23e64bb5c40 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:42.424864 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4e3fd2af-8402-48da-b54d-d23e64bb5c40 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533917bc5aa4e23802a43b1eb534bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d87abf835a4104b40056b9eec2d6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:42.443166 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4e3fd2af-8402-48da-b54d-d23e64bb5c40 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] 10.222.0.20 "GET /compute/v2.1/servers/2e1b6a2e-8acc-4c77-b551-4a623893ebaf" status: 200 len: 1506 microversion: 2.1 time: 0.697488 Oct 27 03:33:42.443670 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1431/3065] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:41 2022] GET /compute/v2.1/servers/2e1b6a2e-8acc-4c77-b551-4a623893ebaf => generated 1506 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:33:42.453282 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7ebf86d4-c5bc-40c1-a5fb-8cbe709ba101 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:42.458844 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7ebf86d4-c5bc-40c1-a5fb-8cbe709ba101 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] [instance: e42cf1fc-e9c5-42f3-be93-ad7c3730e19c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:42.472019 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7ebf86d4-c5bc-40c1-a5fb-8cbe709ba101 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:42.474700 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7ebf86d4-c5bc-40c1-a5fb-8cbe709ba101 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:42.475355 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7ebf86d4-c5bc-40c1-a5fb-8cbe709ba101 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:42.480943 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7ebf86d4-c5bc-40c1-a5fb-8cbe709ba101 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:42.481710 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7ebf86d4-c5bc-40c1-a5fb-8cbe709ba101 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:42.482471 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7ebf86d4-c5bc-40c1-a5fb-8cbe709ba101 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:42.868974 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7ebf86d4-c5bc-40c1-a5fb-8cbe709ba101 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f7471db101458fa692a73173bb42a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c1020a13864ca8b5199427528d650d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:42.885751 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7ebf86d4-c5bc-40c1-a5fb-8cbe709ba101 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] 10.222.0.20 "GET /compute/v2.1/servers/e42cf1fc-e9c5-42f3-be93-ad7c3730e19c" status: 200 len: 1316 microversion: 2.1 time: 0.436389 Oct 27 03:33:42.886931 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1432/3066] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:42 2022] GET /compute/v2.1/servers/e42cf1fc-e9c5-42f3-be93-ad7c3730e19c => generated 1316 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:33:42.906478 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f82e0a91-4a11-4324-8dda-d476291c8ae1 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:42.908167 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f82e0a91-4a11-4324-8dda-d476291c8ae1 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: d70ad817-aab3-419c-85ab-b458bb9d8d26] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:42.914804 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f82e0a91-4a11-4324-8dda-d476291c8ae1 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:42.915458 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f82e0a91-4a11-4324-8dda-d476291c8ae1 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:42.917820 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f82e0a91-4a11-4324-8dda-d476291c8ae1 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:42.919061 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f82e0a91-4a11-4324-8dda-d476291c8ae1 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:42.919643 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f82e0a91-4a11-4324-8dda-d476291c8ae1 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:42.921790 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f82e0a91-4a11-4324-8dda-d476291c8ae1 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:42.983961 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-67108fdd-ef9d-457c-a232-51d7405f00aa tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Flavor limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:33:42.984983 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-67108fdd-ef9d-457c-a232-51d7405f00aa tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Image limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:33:42.985616 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-67108fdd-ef9d-457c-a232-51d7405f00aa tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Flavor pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:33:42.986265 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-67108fdd-ef9d-457c-a232-51d7405f00aa tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Image pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:33:42.996606 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-67108fdd-ef9d-457c-a232-51d7405f00aa tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:33:42.998816 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-67108fdd-ef9d-457c-a232-51d7405f00aa tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:42.999507 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-67108fdd-ef9d-457c-a232-51d7405f00aa tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:43.000120 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-67108fdd-ef9d-457c-a232-51d7405f00aa tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:43.001077 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-67108fdd-ef9d-457c-a232-51d7405f00aa tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:43.001611 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-67108fdd-ef9d-457c-a232-51d7405f00aa tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:43.002338 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-67108fdd-ef9d-457c-a232-51d7405f00aa tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:43.026991 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-67108fdd-ef9d-457c-a232-51d7405f00aa tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Getting quotas for project 2057593072c14804ab70fe4bdea2c17c. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:33:43.035308 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-67108fdd-ef9d-457c-a232-51d7405f00aa tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Getting quotas for user 881f054c84d04ceaa17a5817816022d4 and project 2057593072c14804ab70fe4bdea2c17c. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:33:43.069356 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-67108fdd-ef9d-457c-a232-51d7405f00aa tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Going to run 1 instances... {{(pid=121001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:33:43.074014 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-67108fdd-ef9d-457c-a232-51d7405f00aa tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] [instance: 38693017-3b6f-434c-976f-a9733156a115] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:33:43.173390 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:33:43.318674 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-67108fdd-ef9d-457c-a232-51d7405f00aa tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.390114 Oct 27 03:33:43.320014 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1635/3067] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:33:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 2392 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 03:33:43.336329 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-72ff8fe1-cf1a-4f4a-aa44-f6e5c62d6d54 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:43.337253 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-72ff8fe1-cf1a-4f4a-aa44-f6e5c62d6d54 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] [instance: 38693017-3b6f-434c-976f-a9733156a115] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:43.484037 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-72ff8fe1-cf1a-4f4a-aa44-f6e5c62d6d54 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881f054c84d04ceaa17a5817816022d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2057593072c14804ab70fe4bdea2c17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:43.495795 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-72ff8fe1-cf1a-4f4a-aa44-f6e5c62d6d54 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] 10.222.0.20 "GET /compute/v2.1/servers/38693017-3b6f-434c-976f-a9733156a115" status: 200 len: 1212 microversion: 2.1 time: 0.166785 Oct 27 03:33:43.507376 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1636/3068] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:43 2022] GET /compute/v2.1/servers/38693017-3b6f-434c-976f-a9733156a115 => generated 1212 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:33:43.522184 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-780ed589-e253-462b-801d-966e22f1f7c8 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:43.526615 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-780ed589-e253-462b-801d-966e22f1f7c8 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] [instance: 2e1b6a2e-8acc-4c77-b551-4a623893ebaf] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:43.546775 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-780ed589-e253-462b-801d-966e22f1f7c8 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:43.549004 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-780ed589-e253-462b-801d-966e22f1f7c8 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:43.549722 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-780ed589-e253-462b-801d-966e22f1f7c8 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:43.551583 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-780ed589-e253-462b-801d-966e22f1f7c8 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:43.553934 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-780ed589-e253-462b-801d-966e22f1f7c8 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:43.556801 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-780ed589-e253-462b-801d-966e22f1f7c8 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:43.675355 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f82e0a91-4a11-4324-8dda-d476291c8ae1 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:43.685204 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f82e0a91-4a11-4324-8dda-d476291c8ae1 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/d70ad817-aab3-419c-85ab-b458bb9d8d26" status: 200 len: 1512 microversion: 2.1 time: 0.795546 Oct 27 03:33:43.698225 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1433/3069] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:42 2022] GET /compute/v2.1/servers/d70ad817-aab3-419c-85ab-b458bb9d8d26 => generated 1512 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:33:43.913956 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0e2ed7bc-ca2a-46f5-8c17-344e044b9e62 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:43.914941 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0e2ed7bc-ca2a-46f5-8c17-344e044b9e62 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] [instance: e42cf1fc-e9c5-42f3-be93-ad7c3730e19c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:43.929439 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0e2ed7bc-ca2a-46f5-8c17-344e044b9e62 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:43.933672 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0e2ed7bc-ca2a-46f5-8c17-344e044b9e62 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:43.937606 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0e2ed7bc-ca2a-46f5-8c17-344e044b9e62 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:43.942997 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0e2ed7bc-ca2a-46f5-8c17-344e044b9e62 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:43.943526 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0e2ed7bc-ca2a-46f5-8c17-344e044b9e62 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:43.943989 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0e2ed7bc-ca2a-46f5-8c17-344e044b9e62 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:44.389782 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-780ed589-e253-462b-801d-966e22f1f7c8 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533917bc5aa4e23802a43b1eb534bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d87abf835a4104b40056b9eec2d6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:44.408376 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-780ed589-e253-462b-801d-966e22f1f7c8 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] 10.222.0.20 "GET /compute/v2.1/servers/2e1b6a2e-8acc-4c77-b551-4a623893ebaf" status: 200 len: 1464 microversion: 2.1 time: 0.898060 Oct 27 03:33:44.410534 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1637/3070] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:43 2022] GET /compute/v2.1/servers/2e1b6a2e-8acc-4c77-b551-4a623893ebaf => generated 1464 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:33:44.425329 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-118394dc-1e92-4f2e-b6e5-939aaa9ae613 req-199d1a92-7e5a-4234-a9cd-0fc89f49338f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e1b6a2e-8acc-4c77-b551-4a623893ebaf", "name": "network-vif-deleted", "tag": "6dd46327-1f2e-4081-b38e-032153dc5835"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:33:44.452586 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-118394dc-1e92-4f2e-b6e5-939aaa9ae613 req-199d1a92-7e5a-4234-a9cd-0fc89f49338f service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:44.471950 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-118394dc-1e92-4f2e-b6e5-939aaa9ae613 req-199d1a92-7e5a-4234-a9cd-0fc89f49338f service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:44.473555 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-118394dc-1e92-4f2e-b6e5-939aaa9ae613 req-199d1a92-7e5a-4234-a9cd-0fc89f49338f service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:44.520973 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-118394dc-1e92-4f2e-b6e5-939aaa9ae613 req-199d1a92-7e5a-4234-a9cd-0fc89f49338f service nova] Creating event network-vif-deleted:6dd46327-1f2e-4081-b38e-032153dc5835 for instance 2e1b6a2e-8acc-4c77-b551-4a623893ebaf on n-h1-862769-1 Oct 27 03:33:44.539328 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-118394dc-1e92-4f2e-b6e5-939aaa9ae613 req-199d1a92-7e5a-4234-a9cd-0fc89f49338f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124794 Oct 27 03:33:44.539976 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1638/3071] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:33:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:33:44.566735 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0e2ed7bc-ca2a-46f5-8c17-344e044b9e62 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f7471db101458fa692a73173bb42a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c1020a13864ca8b5199427528d650d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:44.581088 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0e2ed7bc-ca2a-46f5-8c17-344e044b9e62 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] 10.222.0.20 "GET /compute/v2.1/servers/e42cf1fc-e9c5-42f3-be93-ad7c3730e19c" status: 200 len: 1504 microversion: 2.1 time: 0.671255 Oct 27 03:33:44.588923 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1434/3072] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:43 2022] GET /compute/v2.1/servers/e42cf1fc-e9c5-42f3-be93-ad7c3730e19c => generated 1504 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:33:44.595310 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-149dbdd9-966a-4896-bae0-78b6596c00f5 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:44.596050 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-149dbdd9-966a-4896-bae0-78b6596c00f5 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] [instance: 38693017-3b6f-434c-976f-a9733156a115] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:44.612099 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c83f56ce-85d9-49b3-ac04-9fb86c24138b tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:44.613230 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c83f56ce-85d9-49b3-ac04-9fb86c24138b tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] [instance: e42cf1fc-e9c5-42f3-be93-ad7c3730e19c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:44.630227 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c83f56ce-85d9-49b3-ac04-9fb86c24138b tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:44.631740 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c83f56ce-85d9-49b3-ac04-9fb86c24138b tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:44.632204 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c83f56ce-85d9-49b3-ac04-9fb86c24138b tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:44.632968 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c83f56ce-85d9-49b3-ac04-9fb86c24138b tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:44.633437 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c83f56ce-85d9-49b3-ac04-9fb86c24138b tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:44.633875 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c83f56ce-85d9-49b3-ac04-9fb86c24138b tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:44.700433 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c83f56ce-85d9-49b3-ac04-9fb86c24138b tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] [instance: e42cf1fc-e9c5-42f3-be93-ad7c3730e19c] Going to try to terminate instance {{(pid=121000) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:33:44.767081 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-149dbdd9-966a-4896-bae0-78b6596c00f5 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881f054c84d04ceaa17a5817816022d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2057593072c14804ab70fe4bdea2c17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:44.776851 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-149dbdd9-966a-4896-bae0-78b6596c00f5 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] 10.222.0.20 "GET /compute/v2.1/servers/38693017-3b6f-434c-976f-a9733156a115" status: 200 len: 1212 microversion: 2.1 time: 0.234107 Oct 27 03:33:44.780686 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1639/3073] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:44 2022] GET /compute/v2.1/servers/38693017-3b6f-434c-976f-a9733156a115 => generated 1212 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:33:44.787238 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-06919e21-d668-40ff-b448-80064415c337 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:44.792399 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-06919e21-d668-40ff-b448-80064415c337 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: d70ad817-aab3-419c-85ab-b458bb9d8d26] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:44.822995 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-06919e21-d668-40ff-b448-80064415c337 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:44.822995 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-06919e21-d668-40ff-b448-80064415c337 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:44.822995 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-06919e21-d668-40ff-b448-80064415c337 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:44.826540 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-06919e21-d668-40ff-b448-80064415c337 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:44.830244 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-06919e21-d668-40ff-b448-80064415c337 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:44.832051 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-06919e21-d668-40ff-b448-80064415c337 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:45.262387 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c83f56ce-85d9-49b3-ac04-9fb86c24138b tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e42cf1fc-e9c5-42f3-be93-ad7c3730e19c" status: 204 len: 0 microversion: 2.1 time: 0.654152 Oct 27 03:33:45.263581 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1435/3074] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:33:44 2022] DELETE /compute/v2.1/servers/e42cf1fc-e9c5-42f3-be93-ad7c3730e19c => generated 0 bytes in 657 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:33:45.273514 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f77a3b79-7072-4da4-b7e0-736486e84eac tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:45.273514 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f77a3b79-7072-4da4-b7e0-736486e84eac tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] [instance: e42cf1fc-e9c5-42f3-be93-ad7c3730e19c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:45.290149 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f77a3b79-7072-4da4-b7e0-736486e84eac tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:45.297896 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f77a3b79-7072-4da4-b7e0-736486e84eac tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:45.299289 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f77a3b79-7072-4da4-b7e0-736486e84eac tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:45.300078 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f77a3b79-7072-4da4-b7e0-736486e84eac tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:45.307112 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f77a3b79-7072-4da4-b7e0-736486e84eac tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:45.308606 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f77a3b79-7072-4da4-b7e0-736486e84eac tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:45.331533 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-06919e21-d668-40ff-b448-80064415c337 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:45.340939 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-06919e21-d668-40ff-b448-80064415c337 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/d70ad817-aab3-419c-85ab-b458bb9d8d26" status: 200 len: 1512 microversion: 2.1 time: 0.558847 Oct 27 03:33:45.346254 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1640/3075] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:44 2022] GET /compute/v2.1/servers/d70ad817-aab3-419c-85ab-b458bb9d8d26 => generated 1512 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:33:45.355694 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-678b3c4a-b87a-4fd6-a388-a2b764643b64 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:45.363654 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-678b3c4a-b87a-4fd6-a388-a2b764643b64 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] [instance: f3d23d8e-a80a-425c-a0a3-9e448853a94b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:45.381030 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-678b3c4a-b87a-4fd6-a388-a2b764643b64 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:45.381545 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-678b3c4a-b87a-4fd6-a388-a2b764643b64 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:45.382073 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-678b3c4a-b87a-4fd6-a388-a2b764643b64 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:45.385928 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-678b3c4a-b87a-4fd6-a388-a2b764643b64 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:45.386754 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-678b3c4a-b87a-4fd6-a388-a2b764643b64 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:45.387243 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-678b3c4a-b87a-4fd6-a388-a2b764643b64 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:45.503085 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-678b3c4a-b87a-4fd6-a388-a2b764643b64 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d23d8e-a80a-425c-a0a3-9e448853a94b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.155407 Oct 27 03:33:45.515725 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1641/3076] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 27 03:33:45 2022] GET /compute/v2.1/servers/f3d23d8e-a80a-425c-a0a3-9e448853a94b/os-volume_attachments => generated 197 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:33:45.526345 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-cddc6a60-20a5-449c-b147-a6d3c6047e22 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:45.529378 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-cddc6a60-20a5-449c-b147-a6d3c6047e22 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] [instance: 2e1b6a2e-8acc-4c77-b551-4a623893ebaf] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:45.560020 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cddc6a60-20a5-449c-b147-a6d3c6047e22 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:45.563952 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cddc6a60-20a5-449c-b147-a6d3c6047e22 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:45.564722 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cddc6a60-20a5-449c-b147-a6d3c6047e22 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:45.566995 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cddc6a60-20a5-449c-b147-a6d3c6047e22 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:45.571556 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cddc6a60-20a5-449c-b147-a6d3c6047e22 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:45.573876 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cddc6a60-20a5-449c-b147-a6d3c6047e22 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:45.666762 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cddc6a60-20a5-449c-b147-a6d3c6047e22 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:45.668226 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cddc6a60-20a5-449c-b147-a6d3c6047e22 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:45.668896 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cddc6a60-20a5-449c-b147-a6d3c6047e22 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:45.670982 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-cddc6a60-20a5-449c-b147-a6d3c6047e22 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lazy-loading 'fault' on Instance uuid 2e1b6a2e-8acc-4c77-b551-4a623893ebaf {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:33:45.767714 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f77a3b79-7072-4da4-b7e0-736486e84eac tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f7471db101458fa692a73173bb42a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c1020a13864ca8b5199427528d650d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:45.777181 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f77a3b79-7072-4da4-b7e0-736486e84eac tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] 10.222.0.20 "GET /compute/v2.1/servers/e42cf1fc-e9c5-42f3-be93-ad7c3730e19c" status: 200 len: 1510 microversion: 2.1 time: 0.509212 Oct 27 03:33:45.782784 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1436/3077] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:45 2022] GET /compute/v2.1/servers/e42cf1fc-e9c5-42f3-be93-ad7c3730e19c => generated 1510 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:33:45.787967 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7027d6c1-7a34-405d-a0b0-f0be8a30eff1 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:45.788476 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7027d6c1-7a34-405d-a0b0-f0be8a30eff1 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] [instance: f3d23d8e-a80a-425c-a0a3-9e448853a94b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:45.811123 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7027d6c1-7a34-405d-a0b0-f0be8a30eff1 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:45.815119 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7027d6c1-7a34-405d-a0b0-f0be8a30eff1 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:45.815675 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7027d6c1-7a34-405d-a0b0-f0be8a30eff1 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:45.828044 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7027d6c1-7a34-405d-a0b0-f0be8a30eff1 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:45.829498 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7027d6c1-7a34-405d-a0b0-f0be8a30eff1 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:45.830350 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7027d6c1-7a34-405d-a0b0-f0be8a30eff1 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:46.008189 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-7027d6c1-7a34-405d-a0b0-f0be8a30eff1 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lazy-loading 'services' on Instance uuid f3d23d8e-a80a-425c-a0a3-9e448853a94b {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:33:46.237126 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-cddc6a60-20a5-449c-b147-a6d3c6047e22 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533917bc5aa4e23802a43b1eb534bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d87abf835a4104b40056b9eec2d6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:46.244255 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-cddc6a60-20a5-449c-b147-a6d3c6047e22 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] 10.222.0.20 "GET /compute/v2.1/servers/2e1b6a2e-8acc-4c77-b551-4a623893ebaf" status: 200 len: 1304 microversion: 2.1 time: 0.727005 Oct 27 03:33:46.245015 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1642/3078] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:45 2022] GET /compute/v2.1/servers/2e1b6a2e-8acc-4c77-b551-4a623893ebaf => generated 1304 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:33:46.263922 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-80cef311-20a4-4260-8f1a-fc77c892d4fa tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:46.263922 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-80cef311-20a4-4260-8f1a-fc77c892d4fa tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] [instance: 38693017-3b6f-434c-976f-a9733156a115] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:46.288645 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-80cef311-20a4-4260-8f1a-fc77c892d4fa tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:46.289142 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-80cef311-20a4-4260-8f1a-fc77c892d4fa tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:46.289587 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-80cef311-20a4-4260-8f1a-fc77c892d4fa tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:46.295678 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-80cef311-20a4-4260-8f1a-fc77c892d4fa tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:46.297785 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-80cef311-20a4-4260-8f1a-fc77c892d4fa tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:46.298573 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-80cef311-20a4-4260-8f1a-fc77c892d4fa tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:46.314697 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7027d6c1-7a34-405d-a0b0-f0be8a30eff1 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f3d23d8e-a80a-425c-a0a3-9e448853a94b/os-volume_attachments/61fac555-36b3-4313-b02d-6080d6124f2b" status: 202 len: 0 microversion: 2.1 time: 0.530532 Oct 27 03:33:46.315484 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1437/3079] 10.222.0.20 () {58 vars in 1416 bytes} [Thu Oct 27 03:33:45 2022] DELETE /compute/v2.1/servers/f3d23d8e-a80a-425c-a0a3-9e448853a94b/os-volume_attachments/61fac555-36b3-4313-b02d-6080d6124f2b => generated 0 bytes in 532 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:33:46.370667 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-78b318b0-9c6f-4922-985c-76241e02ff55 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:46.371429 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-78b318b0-9c6f-4922-985c-76241e02ff55 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: d70ad817-aab3-419c-85ab-b458bb9d8d26] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:46.381141 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-78b318b0-9c6f-4922-985c-76241e02ff55 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:46.386596 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-78b318b0-9c6f-4922-985c-76241e02ff55 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:46.387431 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-78b318b0-9c6f-4922-985c-76241e02ff55 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:46.388354 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-78b318b0-9c6f-4922-985c-76241e02ff55 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:46.390913 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-78b318b0-9c6f-4922-985c-76241e02ff55 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:46.392482 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-78b318b0-9c6f-4922-985c-76241e02ff55 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:46.568996 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-80cef311-20a4-4260-8f1a-fc77c892d4fa tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881f054c84d04ceaa17a5817816022d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2057593072c14804ab70fe4bdea2c17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:46.584587 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-80cef311-20a4-4260-8f1a-fc77c892d4fa tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] 10.222.0.20 "GET /compute/v2.1/servers/38693017-3b6f-434c-976f-a9733156a115" status: 200 len: 1264 microversion: 2.1 time: 0.332081 Oct 27 03:33:46.586308 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1643/3080] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:46 2022] GET /compute/v2.1/servers/38693017-3b6f-434c-976f-a9733156a115 => generated 1264 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:33:46.632724 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-78b318b0-9c6f-4922-985c-76241e02ff55 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:46.643522 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-78b318b0-9c6f-4922-985c-76241e02ff55 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/d70ad817-aab3-419c-85ab-b458bb9d8d26" status: 200 len: 1489 microversion: 2.1 time: 0.278103 Oct 27 03:33:46.662356 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1438/3081] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:46 2022] GET /compute/v2.1/servers/d70ad817-aab3-419c-85ab-b458bb9d8d26 => generated 1489 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:33:46.679802 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2dee294c-0e99-4535-8810-f6bd9868cbbf tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:33:46.682430 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2dee294c-0e99-4535-8810-f6bd9868cbbf tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:46.691850 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2dee294c-0e99-4535-8810-f6bd9868cbbf tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:46.692605 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2dee294c-0e99-4535-8810-f6bd9868cbbf tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:46.693110 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2dee294c-0e99-4535-8810-f6bd9868cbbf tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:46.694614 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2dee294c-0e99-4535-8810-f6bd9868cbbf tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:46.694614 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2dee294c-0e99-4535-8810-f6bd9868cbbf tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:46.695295 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2dee294c-0e99-4535-8810-f6bd9868cbbf tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:46.768896 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2dee294c-0e99-4535-8810-f6bd9868cbbf tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "POST /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86/action" status: 200 len: 159 microversion: 2.1 time: 0.093417 Oct 27 03:33:46.769548 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1644/3082] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:33:46 2022] POST /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86/action => generated 159 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:33:46.779356 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-43f06930-6a1d-4f0d-a524-64abefc0fc37 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:46.780031 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-43f06930-6a1d-4f0d-a524-64abefc0fc37 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:46.786862 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-43f06930-6a1d-4f0d-a524-64abefc0fc37 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:46.787878 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-43f06930-6a1d-4f0d-a524-64abefc0fc37 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:46.788645 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-43f06930-6a1d-4f0d-a524-64abefc0fc37 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:46.790167 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-43f06930-6a1d-4f0d-a524-64abefc0fc37 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:46.790167 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-43f06930-6a1d-4f0d-a524-64abefc0fc37 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:46.790985 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-43f06930-6a1d-4f0d-a524-64abefc0fc37 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:46.801954 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7c001e4a-39b6-495e-a9f5-eb8d6c87f449 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:46.802697 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7c001e4a-39b6-495e-a9f5-eb8d6c87f449 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] [instance: e42cf1fc-e9c5-42f3-be93-ad7c3730e19c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:46.822202 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7c001e4a-39b6-495e-a9f5-eb8d6c87f449 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:46.822649 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7c001e4a-39b6-495e-a9f5-eb8d6c87f449 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:46.823093 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7c001e4a-39b6-495e-a9f5-eb8d6c87f449 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:46.823807 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7c001e4a-39b6-495e-a9f5-eb8d6c87f449 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:46.824265 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7c001e4a-39b6-495e-a9f5-eb8d6c87f449 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:46.824693 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7c001e4a-39b6-495e-a9f5-eb8d6c87f449 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:47.336747 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7c001e4a-39b6-495e-a9f5-eb8d6c87f449 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f7471db101458fa692a73173bb42a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c1020a13864ca8b5199427528d650d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:47.347802 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7c001e4a-39b6-495e-a9f5-eb8d6c87f449 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] 10.222.0.20 "GET /compute/v2.1/servers/e42cf1fc-e9c5-42f3-be93-ad7c3730e19c" status: 200 len: 1510 microversion: 2.1 time: 0.550570 Oct 27 03:33:47.370210 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1645/3083] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:46 2022] GET /compute/v2.1/servers/e42cf1fc-e9c5-42f3-be93-ad7c3730e19c => generated 1510 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:33:47.375369 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c03d0c5f-83a3-4b30-9003-9b734ef1239f tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:47.376041 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c03d0c5f-83a3-4b30-9003-9b734ef1239f tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] [instance: 2e1b6a2e-8acc-4c77-b551-4a623893ebaf] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:47.396816 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c03d0c5f-83a3-4b30-9003-9b734ef1239f tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:47.398096 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c03d0c5f-83a3-4b30-9003-9b734ef1239f tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:47.398096 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c03d0c5f-83a3-4b30-9003-9b734ef1239f tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:47.399011 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c03d0c5f-83a3-4b30-9003-9b734ef1239f tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:47.399635 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c03d0c5f-83a3-4b30-9003-9b734ef1239f tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:47.400230 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c03d0c5f-83a3-4b30-9003-9b734ef1239f tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:47.421821 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-c03d0c5f-83a3-4b30-9003-9b734ef1239f tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] HTTP exception thrown: Instance 2e1b6a2e-8acc-4c77-b551-4a623893ebaf could not be found. Oct 27 03:33:47.423878 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c03d0c5f-83a3-4b30-9003-9b734ef1239f tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Request method failure captured: Oct 27 03:33:47.423878 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/2e1b6a2e-8acc-4c77-b551-4a623893ebaf HTTP/1.1 Oct 27 03:33:47.423878 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:33:47.423878 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:33:47.423878 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:33:47.423878 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:33:47.423878 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:33:47.423878 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:33:47.423878 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:33:47.423878 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:33:47.423878 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWft_NLC_KkorfscNahbMwaT8EeN-6Ki2Fcp1Q3mDiwz70j8D5SCYx6D1B1ml9gJqyJ3fFQUyB7mtC0weTKfmOV_3otzJB5R960cgtM-MRQSpsurbvd5K6QzwNjhv1otFQ4Iht_uxlxa-wnzb82ESFILvxmZ1Ni45m2pNHzO2jS7NoQw Oct 27 03:33:47.423878 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:33:47.423878 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:33:47.423878 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:33:47.423878 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:33:47.423878 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:33:47.423878 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:33:47.423878 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 20d87abf835a4104b40056b9eec2d6b6 Oct 27 03:33:47.423878 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServerRescueTestJSON-1794458924 Oct 27 03:33:47.423878 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:33:47.423878 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:33:47.423878 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/20d87abf835a4104b40056b9eec2d6b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/20d87abf835a4104b40056b9eec2d6b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/20d87abf835a4104b40056b9eec2d6b6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_20d87abf835a4104b40056b9eec2d6b6"}]}] Oct 27 03:33:47.423878 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServerRescueTestJSON-1794458924 Oct 27 03:33:47.423878 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 20d87abf835a4104b40056b9eec2d6b6 Oct 27 03:33:47.423878 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServerRescueTestJSON-1794458924 Oct 27 03:33:47.423878 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServerRescueTestJSON-1794458924-project Oct 27 03:33:47.423878 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:33:47.423878 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:33:47.423878 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 0533917bc5aa4e23802a43b1eb534bd0 Oct 27 03:33:47.423878 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServerRescueTestJSON-1794458924-project Oct 27 03:33:47.423878 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:33:47.423878 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 2e1b6a2e-8acc-4c77-b551-4a623893ebaf could not be found. Oct 27 03:33:47.423878 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '2e1b6a2e-8acc-4c77-b551-4a623893ebaf'} Oct 27 03:33:47.423878 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:33:47.423878 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:33:47.423878 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:33:47.423878 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:33:47.423878 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:33:47.423878 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:33:47.423878 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:33:47.423878 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:33:47.423878 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:33:47.423878 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:33:47.423878 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e1b6a2e-8acc-4c77-b551-4a623893ebaf could not be found. Oct 27 03:33:47.423878 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:33:47.423878 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:33:47.423878 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:33:47.423878 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:33:47.423878 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:33:47.423878 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:33:47.423878 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:33:47.423878 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:33:47.423878 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:33:47.423878 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:33:47.423878 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:33:47.423878 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:33:47.423878 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:33:47.423878 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:33:47.423878 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:33:47.423878 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:33:47.423878 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e1b6a2e-8acc-4c77-b551-4a623893ebaf could not be found. Oct 27 03:33:47.423878 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:33:47.423878 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:33:47.423878 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:33:47.431663 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:33:47.431663 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:33:47.431663 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:33:47.431663 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:33:47.431663 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:33:47.431663 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e1b6a2e-8acc-4c77-b551-4a623893ebaf could not be found. Oct 27 03:33:47.431663 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:33:47.431663 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c03d0c5f-83a3-4b30-9003-9b734ef1239f tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Returning 404 to user: Instance 2e1b6a2e-8acc-4c77-b551-4a623893ebaf could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:33:47.431663 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c03d0c5f-83a3-4b30-9003-9b734ef1239f tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] 10.222.0.20 "GET /compute/v2.1/servers/2e1b6a2e-8acc-4c77-b551-4a623893ebaf" status: 404 len: 111 microversion: 2.1 time: 0.054062 Oct 27 03:33:47.431663 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1646/3084] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:47 2022] GET /compute/v2.1/servers/2e1b6a2e-8acc-4c77-b551-4a623893ebaf => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:33:47.438801 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-72101913-c644-4e03-aa10-b4458b8eb622 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:47.439532 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-72101913-c644-4e03-aa10-b4458b8eb622 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] [instance: 0c726bb2-8fea-4b2d-9e57-a585032c3155] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:47.447188 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-72101913-c644-4e03-aa10-b4458b8eb622 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:47.448017 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-72101913-c644-4e03-aa10-b4458b8eb622 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:47.448637 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-72101913-c644-4e03-aa10-b4458b8eb622 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:47.450773 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-72101913-c644-4e03-aa10-b4458b8eb622 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:47.451411 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-72101913-c644-4e03-aa10-b4458b8eb622 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:47.452449 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-72101913-c644-4e03-aa10-b4458b8eb622 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:47.522405 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-72101913-c644-4e03-aa10-b4458b8eb622 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] [instance: 0c726bb2-8fea-4b2d-9e57-a585032c3155] Going to try to terminate instance {{(pid=121001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:33:47.538289 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:33:47.660574 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-43f06930-6a1d-4f0d-a524-64abefc0fc37 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:47.674905 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-43f06930-6a1d-4f0d-a524-64abefc0fc37 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1669 microversion: 2.1 time: 0.899308 Oct 27 03:33:47.680457 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1439/3085] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:46 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1669 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:33:47.704928 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-57815165-31c3-418e-9526-670f9ea958c8 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:47.705590 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-57815165-31c3-418e-9526-670f9ea958c8 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] [instance: 38693017-3b6f-434c-976f-a9733156a115] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:47.727279 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-57815165-31c3-418e-9526-670f9ea958c8 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:47.727780 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-57815165-31c3-418e-9526-670f9ea958c8 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:47.728225 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-57815165-31c3-418e-9526-670f9ea958c8 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:47.728945 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-57815165-31c3-418e-9526-670f9ea958c8 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:47.729400 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-57815165-31c3-418e-9526-670f9ea958c8 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:47.729831 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-57815165-31c3-418e-9526-670f9ea958c8 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:47.994027 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-72101913-c644-4e03-aa10-b4458b8eb622 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0c726bb2-8fea-4b2d-9e57-a585032c3155" status: 204 len: 0 microversion: 2.1 time: 0.559482 Oct 27 03:33:47.995626 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1647/3086] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:33:47 2022] DELETE /compute/v2.1/servers/0c726bb2-8fea-4b2d-9e57-a585032c3155 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:33:48.005608 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4d146d49-6de4-4805-981d-84780c292d31 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:48.006377 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4d146d49-6de4-4805-981d-84780c292d31 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:48.037516 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4d146d49-6de4-4805-981d-84780c292d31 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:48.043577 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4d146d49-6de4-4805-981d-84780c292d31 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:48.044153 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4d146d49-6de4-4805-981d-84780c292d31 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:48.044937 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4d146d49-6de4-4805-981d-84780c292d31 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:48.045432 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4d146d49-6de4-4805-981d-84780c292d31 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:48.045881 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4d146d49-6de4-4805-981d-84780c292d31 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:48.315176 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-57815165-31c3-418e-9526-670f9ea958c8 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881f054c84d04ceaa17a5817816022d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2057593072c14804ab70fe4bdea2c17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:48.320905 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-57815165-31c3-418e-9526-670f9ea958c8 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] 10.222.0.20 "GET /compute/v2.1/servers/38693017-3b6f-434c-976f-a9733156a115" status: 200 len: 1270 microversion: 2.1 time: 0.635771 Oct 27 03:33:48.334067 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1440/3087] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:47 2022] GET /compute/v2.1/servers/38693017-3b6f-434c-976f-a9733156a115 => generated 1270 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:33:48.334067 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-018c469e-3f8a-41c9-af56-5ba0a6ed1a16 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:48.334067 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-018c469e-3f8a-41c9-af56-5ba0a6ed1a16 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] [instance: 0c726bb2-8fea-4b2d-9e57-a585032c3155] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:48.356576 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-018c469e-3f8a-41c9-af56-5ba0a6ed1a16 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:48.357930 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-018c469e-3f8a-41c9-af56-5ba0a6ed1a16 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:48.360630 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-018c469e-3f8a-41c9-af56-5ba0a6ed1a16 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:48.362881 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-018c469e-3f8a-41c9-af56-5ba0a6ed1a16 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:48.365005 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-018c469e-3f8a-41c9-af56-5ba0a6ed1a16 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:48.366259 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-018c469e-3f8a-41c9-af56-5ba0a6ed1a16 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:48.659789 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4d146d49-6de4-4805-981d-84780c292d31 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:48.677794 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4d146d49-6de4-4805-981d-84780c292d31 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1669 microversion: 2.1 time: 0.674288 Oct 27 03:33:48.683985 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1648/3088] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:47 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1669 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:33:48.688869 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c9142197-9014-4b0f-ae39-e97b153f41bf tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:48.696463 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c9142197-9014-4b0f-ae39-e97b153f41bf tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] [instance: e42cf1fc-e9c5-42f3-be93-ad7c3730e19c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:48.731667 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c9142197-9014-4b0f-ae39-e97b153f41bf tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:48.732178 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c9142197-9014-4b0f-ae39-e97b153f41bf tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:48.732628 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c9142197-9014-4b0f-ae39-e97b153f41bf tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:48.733901 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c9142197-9014-4b0f-ae39-e97b153f41bf tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:48.734453 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c9142197-9014-4b0f-ae39-e97b153f41bf tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:48.735253 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c9142197-9014-4b0f-ae39-e97b153f41bf tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:48.884050 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-018c469e-3f8a-41c9-af56-5ba0a6ed1a16 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533917bc5aa4e23802a43b1eb534bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d87abf835a4104b40056b9eec2d6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:48.897727 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-018c469e-3f8a-41c9-af56-5ba0a6ed1a16 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] 10.222.0.20 "GET /compute/v2.1/servers/0c726bb2-8fea-4b2d-9e57-a585032c3155" status: 200 len: 1492 microversion: 2.1 time: 0.572493 Oct 27 03:33:48.899158 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1441/3089] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:48 2022] GET /compute/v2.1/servers/0c726bb2-8fea-4b2d-9e57-a585032c3155 => generated 1492 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:33:48.908654 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5a2e312a-ba36-4018-85c4-2b84bdba0f94 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:48.909398 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5a2e312a-ba36-4018-85c4-2b84bdba0f94 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:48.918565 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:INSERT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:33:48.939679 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5a2e312a-ba36-4018-85c4-2b84bdba0f94 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:48.941235 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5a2e312a-ba36-4018-85c4-2b84bdba0f94 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:48.941985 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5a2e312a-ba36-4018-85c4-2b84bdba0f94 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:48.942980 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5a2e312a-ba36-4018-85c4-2b84bdba0f94 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:48.943553 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5a2e312a-ba36-4018-85c4-2b84bdba0f94 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:48.944194 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5a2e312a-ba36-4018-85c4-2b84bdba0f94 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:49.091174 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c9142197-9014-4b0f-ae39-e97b153f41bf tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f7471db101458fa692a73173bb42a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c1020a13864ca8b5199427528d650d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:49.105514 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c9142197-9014-4b0f-ae39-e97b153f41bf tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] 10.222.0.20 "GET /compute/v2.1/servers/e42cf1fc-e9c5-42f3-be93-ad7c3730e19c" status: 200 len: 1510 microversion: 2.1 time: 0.420328 Oct 27 03:33:49.106135 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1649/3090] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:48 2022] GET /compute/v2.1/servers/e42cf1fc-e9c5-42f3-be93-ad7c3730e19c => generated 1510 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:33:49.356016 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c4119e66-d99b-49bd-aac1-1a49e069ea3e tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:49.369736 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c4119e66-d99b-49bd-aac1-1a49e069ea3e tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] [instance: 38693017-3b6f-434c-976f-a9733156a115] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:49.382756 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c4119e66-d99b-49bd-aac1-1a49e069ea3e tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:49.383430 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c4119e66-d99b-49bd-aac1-1a49e069ea3e tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:49.383993 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c4119e66-d99b-49bd-aac1-1a49e069ea3e tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:49.384831 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c4119e66-d99b-49bd-aac1-1a49e069ea3e tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:49.385405 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c4119e66-d99b-49bd-aac1-1a49e069ea3e tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:49.385942 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c4119e66-d99b-49bd-aac1-1a49e069ea3e tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:49.517194 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=8 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:33:49.614533 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c4119e66-d99b-49bd-aac1-1a49e069ea3e tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881f054c84d04ceaa17a5817816022d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2057593072c14804ab70fe4bdea2c17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:49.626818 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c4119e66-d99b-49bd-aac1-1a49e069ea3e tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] 10.222.0.20 "GET /compute/v2.1/servers/38693017-3b6f-434c-976f-a9733156a115" status: 200 len: 1270 microversion: 2.1 time: 0.277081 Oct 27 03:33:49.628061 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1650/3091] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:49 2022] GET /compute/v2.1/servers/38693017-3b6f-434c-976f-a9733156a115 => generated 1270 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:33:49.652176 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-fee0c7fd-4d8f-413e-99f7-a8a881020a20 req-49216d66-29e0-45ac-8d3e-3fc2761ee349 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e42cf1fc-e9c5-42f3-be93-ad7c3730e19c", "name": "network-vif-deleted", "tag": "6ceaf5e7-fa70-4309-8220-84d78208e8e4"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:33:49.679762 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-fee0c7fd-4d8f-413e-99f7-a8a881020a20 req-49216d66-29e0-45ac-8d3e-3fc2761ee349 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:49.684375 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-fee0c7fd-4d8f-413e-99f7-a8a881020a20 req-49216d66-29e0-45ac-8d3e-3fc2761ee349 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:49.686289 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-fee0c7fd-4d8f-413e-99f7-a8a881020a20 req-49216d66-29e0-45ac-8d3e-3fc2761ee349 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:49.711603 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-fee0c7fd-4d8f-413e-99f7-a8a881020a20 req-49216d66-29e0-45ac-8d3e-3fc2761ee349 service nova] Creating event network-vif-deleted:6ceaf5e7-fa70-4309-8220-84d78208e8e4 for instance e42cf1fc-e9c5-42f3-be93-ad7c3730e19c on n-h1-862769-1 Oct 27 03:33:49.726481 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-fee0c7fd-4d8f-413e-99f7-a8a881020a20 req-49216d66-29e0-45ac-8d3e-3fc2761ee349 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079534 Oct 27 03:33:49.747797 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1651/3092] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:33:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:33:49.926974 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-abdfc9da-12ad-43fa-8534-6d88033fed88 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:49.927748 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-abdfc9da-12ad-43fa-8534-6d88033fed88 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] [instance: 0c726bb2-8fea-4b2d-9e57-a585032c3155] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:49.943830 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-abdfc9da-12ad-43fa-8534-6d88033fed88 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:49.944349 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-abdfc9da-12ad-43fa-8534-6d88033fed88 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:49.944796 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-abdfc9da-12ad-43fa-8534-6d88033fed88 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:49.967767 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-abdfc9da-12ad-43fa-8534-6d88033fed88 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:49.968395 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-abdfc9da-12ad-43fa-8534-6d88033fed88 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:49.968858 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-abdfc9da-12ad-43fa-8534-6d88033fed88 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:50.034658 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5a2e312a-ba36-4018-85c4-2b84bdba0f94 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:50.049174 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5a2e312a-ba36-4018-85c4-2b84bdba0f94 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1669 microversion: 2.1 time: 1.148282 Oct 27 03:33:50.049769 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1442/3093] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:48 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1669 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:33:50.081970 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a3911320-3adb-4b40-861b-2bfcbb1e1153 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:50.082927 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a3911320-3adb-4b40-861b-2bfcbb1e1153 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:50.093807 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a3911320-3adb-4b40-861b-2bfcbb1e1153 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:50.094676 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a3911320-3adb-4b40-861b-2bfcbb1e1153 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:50.095355 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a3911320-3adb-4b40-861b-2bfcbb1e1153 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:50.096305 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a3911320-3adb-4b40-861b-2bfcbb1e1153 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:50.096976 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a3911320-3adb-4b40-861b-2bfcbb1e1153 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:50.097612 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a3911320-3adb-4b40-861b-2bfcbb1e1153 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:50.129891 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:33:50.289463 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-abdfc9da-12ad-43fa-8534-6d88033fed88 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533917bc5aa4e23802a43b1eb534bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d87abf835a4104b40056b9eec2d6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:50.303496 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-abdfc9da-12ad-43fa-8534-6d88033fed88 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] 10.222.0.20 "GET /compute/v2.1/servers/0c726bb2-8fea-4b2d-9e57-a585032c3155" status: 200 len: 1492 microversion: 2.1 time: 0.379795 Oct 27 03:33:50.304120 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1652/3094] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:49 2022] GET /compute/v2.1/servers/0c726bb2-8fea-4b2d-9e57-a585032c3155 => generated 1492 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:33:50.317823 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d7e522bd-cf27-4175-8fe0-2a64dad0d8ca tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:50.318490 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d7e522bd-cf27-4175-8fe0-2a64dad0d8ca tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] [instance: e42cf1fc-e9c5-42f3-be93-ad7c3730e19c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:50.349543 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d7e522bd-cf27-4175-8fe0-2a64dad0d8ca tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:50.350151 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d7e522bd-cf27-4175-8fe0-2a64dad0d8ca tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:50.354113 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d7e522bd-cf27-4175-8fe0-2a64dad0d8ca tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:50.354113 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d7e522bd-cf27-4175-8fe0-2a64dad0d8ca tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:50.354113 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d7e522bd-cf27-4175-8fe0-2a64dad0d8ca tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:50.354113 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d7e522bd-cf27-4175-8fe0-2a64dad0d8ca tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:50.689724 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d7e522bd-cf27-4175-8fe0-2a64dad0d8ca tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f7471db101458fa692a73173bb42a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c1020a13864ca8b5199427528d650d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:50.702535 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d7e522bd-cf27-4175-8fe0-2a64dad0d8ca tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] 10.222.0.20 "GET /compute/v2.1/servers/e42cf1fc-e9c5-42f3-be93-ad7c3730e19c" status: 200 len: 1301 microversion: 2.1 time: 0.389488 Oct 27 03:33:50.703187 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1653/3095] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:50 2022] GET /compute/v2.1/servers/e42cf1fc-e9c5-42f3-be93-ad7c3730e19c => generated 1301 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:33:50.711197 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-48210c48-3207-4352-85c2-3b6818a2e52a tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:50.718244 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-48210c48-3207-4352-85c2-3b6818a2e52a tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] [instance: 38693017-3b6f-434c-976f-a9733156a115] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:50.732889 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-48210c48-3207-4352-85c2-3b6818a2e52a tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:50.732889 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-48210c48-3207-4352-85c2-3b6818a2e52a tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:50.732889 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-48210c48-3207-4352-85c2-3b6818a2e52a tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:50.732889 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-48210c48-3207-4352-85c2-3b6818a2e52a tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:50.732889 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-48210c48-3207-4352-85c2-3b6818a2e52a tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:50.738577 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-48210c48-3207-4352-85c2-3b6818a2e52a tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:50.866747 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a3911320-3adb-4b40-861b-2bfcbb1e1153 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:50.875235 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a3911320-3adb-4b40-861b-2bfcbb1e1153 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1669 microversion: 2.1 time: 0.803672 Oct 27 03:33:50.886815 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1443/3096] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:50 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1669 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:33:51.142467 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8bbbec04-73e2-4c9d-9360-d2dfe3f2fdc7 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-249537710", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": [{"uuid": "3c58b3a5-6f00-4601-ab92-e31d99f01594"}]}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:33:51.147048 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-48210c48-3207-4352-85c2-3b6818a2e52a tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881f054c84d04ceaa17a5817816022d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2057593072c14804ab70fe4bdea2c17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:51.154821 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-48210c48-3207-4352-85c2-3b6818a2e52a tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] 10.222.0.20 "GET /compute/v2.1/servers/38693017-3b6f-434c-976f-a9733156a115" status: 200 len: 1312 microversion: 2.1 time: 0.450360 Oct 27 03:33:51.158237 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1654/3097] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:50 2022] GET /compute/v2.1/servers/38693017-3b6f-434c-976f-a9733156a115 => generated 1312 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:33:51.256075 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-8bbbec04-73e2-4c9d-9360-d2dfe3f2fdc7 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] validate_networks() for [('3c58b3a5-6f00-4601-ab92-e31d99f01594', None, None, None, None, None)] {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:33:51.331539 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3b5762f0-f9be-4be2-94ae-ec20f57d7b5a tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:51.332130 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3b5762f0-f9be-4be2-94ae-ec20f57d7b5a tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] [instance: 0c726bb2-8fea-4b2d-9e57-a585032c3155] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:51.341964 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3b5762f0-f9be-4be2-94ae-ec20f57d7b5a tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:51.342485 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3b5762f0-f9be-4be2-94ae-ec20f57d7b5a tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:51.342931 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3b5762f0-f9be-4be2-94ae-ec20f57d7b5a tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:51.343643 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3b5762f0-f9be-4be2-94ae-ec20f57d7b5a tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:51.344119 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3b5762f0-f9be-4be2-94ae-ec20f57d7b5a tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:51.355770 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3b5762f0-f9be-4be2-94ae-ec20f57d7b5a tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:51.723408 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3b5762f0-f9be-4be2-94ae-ec20f57d7b5a tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533917bc5aa4e23802a43b1eb534bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d87abf835a4104b40056b9eec2d6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:51.743118 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3b5762f0-f9be-4be2-94ae-ec20f57d7b5a tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] 10.222.0.20 "GET /compute/v2.1/servers/0c726bb2-8fea-4b2d-9e57-a585032c3155" status: 200 len: 1492 microversion: 2.1 time: 0.414949 Oct 27 03:33:51.761872 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1655/3098] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:51 2022] GET /compute/v2.1/servers/0c726bb2-8fea-4b2d-9e57-a585032c3155 => generated 1492 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:33:51.766942 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8d62eb0c-31ae-461d-a939-1e6f3eeb8aa7 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:51.767613 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8d62eb0c-31ae-461d-a939-1e6f3eeb8aa7 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] [instance: e42cf1fc-e9c5-42f3-be93-ad7c3730e19c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:51.794391 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8d62eb0c-31ae-461d-a939-1e6f3eeb8aa7 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:51.794888 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8d62eb0c-31ae-461d-a939-1e6f3eeb8aa7 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:51.795332 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8d62eb0c-31ae-461d-a939-1e6f3eeb8aa7 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:51.796051 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8d62eb0c-31ae-461d-a939-1e6f3eeb8aa7 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:51.796510 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8d62eb0c-31ae-461d-a939-1e6f3eeb8aa7 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:51.796936 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8d62eb0c-31ae-461d-a939-1e6f3eeb8aa7 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:51.829215 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-8d62eb0c-31ae-461d-a939-1e6f3eeb8aa7 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] HTTP exception thrown: Instance e42cf1fc-e9c5-42f3-be93-ad7c3730e19c could not be found. Oct 27 03:33:51.831168 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8d62eb0c-31ae-461d-a939-1e6f3eeb8aa7 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Request method failure captured: Oct 27 03:33:51.831168 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/e42cf1fc-e9c5-42f3-be93-ad7c3730e19c HTTP/1.1 Oct 27 03:33:51.831168 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:33:51.831168 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:33:51.831168 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:33:51.831168 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:33:51.831168 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:33:51.831168 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:33:51.831168 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:33:51.831168 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:33:51.831168 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfv75dG4xVUVJiy0xNGaLpTTEfVOAs-58lUPKlHMSmBE82k9X7hUdrBjfpqr54BRPG8S5CYiZd3ltAjmh1OGeeC4oRjNjZ7scL5c40yYW_0Bj5gjmFqG_qQNVgIq8W25tNwkcKf1smcjdSzmOr6ppvt5Lhv4R-bSCKmFjGC0yQwaiFY Oct 27 03:33:51.831168 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:33:51.831168 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:33:51.831168 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:33:51.831168 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:33:51.831168 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:33:51.831168 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:33:51.831168 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: d2c1020a13864ca8b5199427528d650d Oct 27 03:33:51.831168 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ImagesNegativeTestJSON-1176283008 Oct 27 03:33:51.831168 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:33:51.831168 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:33:51.831168 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d2c1020a13864ca8b5199427528d650d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d2c1020a13864ca8b5199427528d650d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d2c1020a13864ca8b5199427528d650d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d2c1020a13864ca8b5199427528d650d"}]}] Oct 27 03:33:51.831168 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ImagesNegativeTestJSON-1176283008 Oct 27 03:33:51.831168 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: d2c1020a13864ca8b5199427528d650d Oct 27 03:33:51.831168 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1176283008 Oct 27 03:33:51.831168 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ImagesNegativeTestJSON-1176283008-project Oct 27 03:33:51.831168 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:33:51.831168 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:33:51.831168 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 45f7471db101458fa692a73173bb42a1 Oct 27 03:33:51.831168 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ImagesNegativeTestJSON-1176283008-project Oct 27 03:33:51.831168 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:33:51.831168 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance e42cf1fc-e9c5-42f3-be93-ad7c3730e19c could not be found. Oct 27 03:33:51.831168 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': 'e42cf1fc-e9c5-42f3-be93-ad7c3730e19c'} Oct 27 03:33:51.831168 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:33:51.831168 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:33:51.831168 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:33:51.831168 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:33:51.831168 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:33:51.831168 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:33:51.831168 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:33:51.831168 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:33:51.831168 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:33:51.831168 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:33:51.831168 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e42cf1fc-e9c5-42f3-be93-ad7c3730e19c could not be found. Oct 27 03:33:51.831168 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:33:51.831168 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:33:51.831168 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:33:51.831168 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:33:51.831168 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:33:51.831168 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:33:51.831168 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:33:51.831168 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:33:51.831168 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:33:51.831168 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:33:51.831168 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:33:51.831168 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:33:51.831168 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:33:51.831168 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:33:51.831168 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:33:51.831168 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:33:51.831168 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e42cf1fc-e9c5-42f3-be93-ad7c3730e19c could not be found. Oct 27 03:33:51.831168 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:33:51.831168 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:33:51.831168 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:33:51.836387 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:33:51.836387 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:33:51.836387 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:33:51.836387 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:33:51.836387 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:33:51.836387 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e42cf1fc-e9c5-42f3-be93-ad7c3730e19c could not be found. Oct 27 03:33:51.836387 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:33:51.837709 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8d62eb0c-31ae-461d-a939-1e6f3eeb8aa7 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Returning 404 to user: Instance e42cf1fc-e9c5-42f3-be93-ad7c3730e19c could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:33:51.838854 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8d62eb0c-31ae-461d-a939-1e6f3eeb8aa7 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] 10.222.0.20 "GET /compute/v2.1/servers/e42cf1fc-e9c5-42f3-be93-ad7c3730e19c" status: 404 len: 111 microversion: 2.1 time: 0.075833 Oct 27 03:33:51.839588 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1656/3099] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:51 2022] GET /compute/v2.1/servers/e42cf1fc-e9c5-42f3-be93-ad7c3730e19c => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:33:51.856179 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b4401ccb-1a9c-4117-8379-7e87c23cdc90 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-941781852", "metadata": {"image_type": "test"}}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:33:51.859256 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b4401ccb-1a9c-4117-8379-7e87c23cdc90 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] [instance: e42cf1fc-e9c5-42f3-be93-ad7c3730e19c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:51.874668 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b4401ccb-1a9c-4117-8379-7e87c23cdc90 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:51.876068 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b4401ccb-1a9c-4117-8379-7e87c23cdc90 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:51.876688 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b4401ccb-1a9c-4117-8379-7e87c23cdc90 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:51.877553 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b4401ccb-1a9c-4117-8379-7e87c23cdc90 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:51.878499 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b4401ccb-1a9c-4117-8379-7e87c23cdc90 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:51.880915 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b4401ccb-1a9c-4117-8379-7e87c23cdc90 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:51.920385 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-b4401ccb-1a9c-4117-8379-7e87c23cdc90 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] HTTP exception thrown: Instance e42cf1fc-e9c5-42f3-be93-ad7c3730e19c could not be found. Oct 27 03:33:51.922852 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b4401ccb-1a9c-4117-8379-7e87c23cdc90 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Request method failure captured: Oct 27 03:33:51.922852 n-d-862769-1 devstack@n-api.service[121001]: request: POST /compute/v2.1/servers/e42cf1fc-e9c5-42f3-be93-ad7c3730e19c/action HTTP/1.1 Oct 27 03:33:51.922852 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:33:51.922852 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:33:51.922852 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:33:51.922852 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 111 Oct 27 03:33:51.922852 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:33:51.922852 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:33:51.922852 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:33:51.922852 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:33:51.922852 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfv75dG4xVUVJiy0xNGaLpTTEfVOAs-58lUPKlHMSmBE82k9X7hUdrBjfpqr54BRPG8S5CYiZd3ltAjmh1OGeeC4oRjNjZ7scL5c40yYW_0Bj5gjmFqG_qQNVgIq8W25tNwkcKf1smcjdSzmOr6ppvt5Lhv4R-bSCKmFjGC0yQwaiFY Oct 27 03:33:51.922852 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:33:51.922852 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:33:51.922852 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:33:51.922852 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:33:51.922852 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:33:51.922852 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:33:51.922852 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: d2c1020a13864ca8b5199427528d650d Oct 27 03:33:51.922852 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ImagesNegativeTestJSON-1176283008 Oct 27 03:33:51.922852 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:33:51.922852 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:33:51.922852 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d2c1020a13864ca8b5199427528d650d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d2c1020a13864ca8b5199427528d650d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d2c1020a13864ca8b5199427528d650d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d2c1020a13864ca8b5199427528d650d"}]}] Oct 27 03:33:51.922852 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ImagesNegativeTestJSON-1176283008 Oct 27 03:33:51.922852 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: d2c1020a13864ca8b5199427528d650d Oct 27 03:33:51.922852 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1176283008 Oct 27 03:33:51.922852 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ImagesNegativeTestJSON-1176283008-project Oct 27 03:33:51.922852 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:33:51.922852 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:33:51.922852 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 45f7471db101458fa692a73173bb42a1 Oct 27 03:33:51.922852 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ImagesNegativeTestJSON-1176283008-project Oct 27 03:33:51.922852 n-d-862769-1 devstack@n-api.service[121001]: Oct 27 03:33:51.922852 n-d-862769-1 devstack@n-api.service[121001]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-941781852", "metadata": {"image_type": "test"}}} Oct 27 03:33:51.922852 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:33:51.922852 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance e42cf1fc-e9c5-42f3-be93-ad7c3730e19c could not be found. Oct 27 03:33:51.922852 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': 'e42cf1fc-e9c5-42f3-be93-ad7c3730e19c', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-941781852', 'metadata': {'image_type': 'test'}}}} Oct 27 03:33:51.922852 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:33:51.922852 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:33:51.922852 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:33:51.922852 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:33:51.922852 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:33:51.922852 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:33:51.922852 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:33:51.922852 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:33:51.922852 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:33:51.922852 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:33:51.922852 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e42cf1fc-e9c5-42f3-be93-ad7c3730e19c could not be found. Oct 27 03:33:51.922852 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:33:51.922852 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:33:51.922852 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:33:51.922852 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:33:51.922852 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:33:51.922852 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:33:51.922852 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:33:51.922852 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:33:51.922852 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:33:51.922852 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:33:51.922852 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:33:51.922852 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:33:51.922852 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:33:51.922852 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:33:51.922852 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 27 03:33:51.922852 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 27 03:33:51.926575 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:33:51.926575 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:33:51.926575 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:33:51.926575 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:33:51.926575 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e42cf1fc-e9c5-42f3-be93-ad7c3730e19c could not be found. Oct 27 03:33:51.926575 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:33:51.926575 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:33:51.926575 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:33:51.926575 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:33:51.926575 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:33:51.926575 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:33:51.926575 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:33:51.926575 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:33:51.926575 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e42cf1fc-e9c5-42f3-be93-ad7c3730e19c could not be found. Oct 27 03:33:51.926575 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:33:51.928808 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b4401ccb-1a9c-4117-8379-7e87c23cdc90 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Returning 404 to user: Instance e42cf1fc-e9c5-42f3-be93-ad7c3730e19c could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:33:51.929876 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b4401ccb-1a9c-4117-8379-7e87c23cdc90 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] 10.222.0.20 "POST /compute/v2.1/servers/e42cf1fc-e9c5-42f3-be93-ad7c3730e19c/action" status: 404 len: 111 microversion: 2.1 time: 0.078684 Oct 27 03:33:51.930673 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1657/3100] 10.222.0.20 () {60 vars in 1279 bytes} [Thu Oct 27 03:33:51 2022] POST /compute/v2.1/servers/e42cf1fc-e9c5-42f3-be93-ad7c3730e19c/action => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:33:51.944929 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-fdca3941-1e17-4ad3-9cb4-8302e7900c36 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1816569850", "metadata": {"image_type": "test"}}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:33:51.948493 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-fdca3941-1e17-4ad3-9cb4-8302e7900c36 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Failed to fetch instance by id tempest-invalid-940749111 {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 27 03:33:51.949247 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-fdca3941-1e17-4ad3-9cb4-8302e7900c36 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] HTTP exception thrown: Instance tempest-invalid-940749111 could not be found. Oct 27 03:33:51.951062 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-fdca3941-1e17-4ad3-9cb4-8302e7900c36 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Request method failure captured: Oct 27 03:33:51.951062 n-d-862769-1 devstack@n-api.service[121001]: request: POST /compute/v2.1/servers/tempest-invalid-940749111/action HTTP/1.1 Oct 27 03:33:51.951062 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:33:51.951062 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:33:51.951062 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:33:51.951062 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 112 Oct 27 03:33:51.951062 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:33:51.951062 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:33:51.951062 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:33:51.951062 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:33:51.951062 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfv75dG4xVUVJiy0xNGaLpTTEfVOAs-58lUPKlHMSmBE82k9X7hUdrBjfpqr54BRPG8S5CYiZd3ltAjmh1OGeeC4oRjNjZ7scL5c40yYW_0Bj5gjmFqG_qQNVgIq8W25tNwkcKf1smcjdSzmOr6ppvt5Lhv4R-bSCKmFjGC0yQwaiFY Oct 27 03:33:51.951062 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:33:51.951062 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:33:51.951062 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:33:51.951062 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:33:51.951062 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:33:51.951062 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:33:51.951062 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: d2c1020a13864ca8b5199427528d650d Oct 27 03:33:51.951062 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ImagesNegativeTestJSON-1176283008 Oct 27 03:33:51.951062 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:33:51.951062 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:33:51.951062 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d2c1020a13864ca8b5199427528d650d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d2c1020a13864ca8b5199427528d650d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d2c1020a13864ca8b5199427528d650d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d2c1020a13864ca8b5199427528d650d"}]}] Oct 27 03:33:51.951062 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ImagesNegativeTestJSON-1176283008 Oct 27 03:33:51.951062 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: d2c1020a13864ca8b5199427528d650d Oct 27 03:33:51.951062 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1176283008 Oct 27 03:33:51.951062 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ImagesNegativeTestJSON-1176283008-project Oct 27 03:33:51.951062 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:33:51.951062 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:33:51.951062 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 45f7471db101458fa692a73173bb42a1 Oct 27 03:33:51.951062 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ImagesNegativeTestJSON-1176283008-project Oct 27 03:33:51.951062 n-d-862769-1 devstack@n-api.service[121001]: Oct 27 03:33:51.951062 n-d-862769-1 devstack@n-api.service[121001]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1816569850", "metadata": {"image_type": "test"}}} Oct 27 03:33:51.951062 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:33:51.951062 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance tempest-invalid-940749111 could not be found. Oct 27 03:33:51.951062 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': 'tempest-invalid-940749111', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1816569850', 'metadata': {'image_type': 'test'}}}} Oct 27 03:33:51.951062 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:33:51.951062 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:33:51.951062 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:33:51.951062 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:33:51.951062 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 27 03:33:51.951062 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 27 03:33:51.951062 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-940749111 could not be found. Oct 27 03:33:51.951062 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:33:51.951062 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:33:51.951062 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:33:51.951062 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:33:51.951062 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:33:51.951062 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:33:51.951062 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:33:51.951062 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:33:51.951062 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:33:51.951062 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:33:51.951062 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:33:51.951062 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:33:51.951062 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:33:51.951062 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:33:51.951062 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 27 03:33:51.951062 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 27 03:33:51.951062 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:33:51.951062 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:33:51.951062 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:33:51.951062 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:33:51.951062 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-940749111 could not be found. Oct 27 03:33:51.954877 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:33:51.954877 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:33:51.954877 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:33:51.954877 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:33:51.954877 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:33:51.954877 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:33:51.954877 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:33:51.954877 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:33:51.954877 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-940749111 could not be found. Oct 27 03:33:51.954877 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:33:51.958144 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-fdca3941-1e17-4ad3-9cb4-8302e7900c36 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Returning 404 to user: Instance tempest-invalid-940749111 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:33:51.959257 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-fdca3941-1e17-4ad3-9cb4-8302e7900c36 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] 10.222.0.20 "POST /compute/v2.1/servers/tempest-invalid-940749111/action" status: 404 len: 100 microversion: 2.1 time: 0.019807 Oct 27 03:33:51.960360 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1658/3101] 10.222.0.20 () {60 vars in 1246 bytes} [Thu Oct 27 03:33:51 2022] POST /compute/v2.1/servers/tempest-invalid-940749111/action => generated 100 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:33:51.970952 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2658c1c3-c779-4f96-8c76-2567b6e2ab5a tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-292232411"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:33:51.979587 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2658c1c3-c779-4f96-8c76-2567b6e2ab5a tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 27 03:33:51.981679 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-2658c1c3-c779-4f96-8c76-2567b6e2ab5a tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 27 03:33:51.983799 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2658c1c3-c779-4f96-8c76-2567b6e2ab5a tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Request method failure captured: Oct 27 03:33:51.983799 n-d-862769-1 devstack@n-api.service[121001]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 27 03:33:51.983799 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:33:51.983799 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:33:51.983799 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:33:51.983799 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 56 Oct 27 03:33:51.983799 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:33:51.983799 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:33:51.983799 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:33:51.983799 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:33:51.983799 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfv75dG4xVUVJiy0xNGaLpTTEfVOAs-58lUPKlHMSmBE82k9X7hUdrBjfpqr54BRPG8S5CYiZd3ltAjmh1OGeeC4oRjNjZ7scL5c40yYW_0Bj5gjmFqG_qQNVgIq8W25tNwkcKf1smcjdSzmOr6ppvt5Lhv4R-bSCKmFjGC0yQwaiFY Oct 27 03:33:51.983799 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:33:51.983799 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:33:51.983799 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:33:51.983799 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:33:51.983799 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:33:51.983799 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:33:51.983799 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: d2c1020a13864ca8b5199427528d650d Oct 27 03:33:51.983799 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ImagesNegativeTestJSON-1176283008 Oct 27 03:33:51.983799 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:33:51.983799 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:33:51.983799 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d2c1020a13864ca8b5199427528d650d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d2c1020a13864ca8b5199427528d650d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d2c1020a13864ca8b5199427528d650d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d2c1020a13864ca8b5199427528d650d"}]}] Oct 27 03:33:51.983799 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ImagesNegativeTestJSON-1176283008 Oct 27 03:33:51.983799 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: d2c1020a13864ca8b5199427528d650d Oct 27 03:33:51.983799 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1176283008 Oct 27 03:33:51.983799 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ImagesNegativeTestJSON-1176283008-project Oct 27 03:33:51.983799 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:33:51.983799 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:33:51.983799 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 45f7471db101458fa692a73173bb42a1 Oct 27 03:33:51.983799 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ImagesNegativeTestJSON-1176283008-project Oct 27 03:33:51.983799 n-d-862769-1 devstack@n-api.service[121001]: Oct 27 03:33:51.983799 n-d-862769-1 devstack@n-api.service[121001]: {"createImage": {"name": "tempest-test-snap-292232411"}} Oct 27 03:33:51.983799 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:33:51.983799 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 27 03:33:51.983799 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-292232411'}}} Oct 27 03:33:51.983799 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:33:51.983799 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:33:51.983799 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:33:51.983799 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:33:51.983799 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 27 03:33:51.983799 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 27 03:33:51.983799 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 27 03:33:51.983799 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:33:51.983799 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:33:51.983799 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:33:51.983799 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:33:51.983799 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:33:51.983799 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:33:51.983799 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:33:51.983799 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:33:51.983799 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:33:51.983799 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:33:51.983799 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:33:51.983799 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:33:51.983799 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:33:51.983799 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:33:51.983799 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 27 03:33:51.983799 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 27 03:33:51.983799 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:33:51.983799 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:33:51.983799 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:33:51.983799 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:33:51.983799 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 27 03:33:51.983799 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:33:51.988270 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:33:51.988270 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:33:51.988270 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:33:51.988270 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:33:51.988270 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:33:51.988270 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:33:51.988270 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:33:51.988270 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 27 03:33:51.988270 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:33:51.990322 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2658c1c3-c779-4f96-8c76-2567b6e2ab5a tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:33:51.991421 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2658c1c3-c779-4f96-8c76-2567b6e2ab5a tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] 10.222.0.20 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.026079 Oct 27 03:33:51.992544 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1659/3102] 10.222.0.20 () {60 vars in 1275 bytes} [Thu Oct 27 03:33:51 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 03:33:52.004020 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f56ddf80-3741-4e97-865f-c4b871952eee tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1654821627"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:33:52.012486 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f56ddf80-3741-4e97-865f-c4b871952eee tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 27 03:33:52.013243 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-f56ddf80-3741-4e97-865f-c4b871952eee tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 27 03:33:52.015143 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f56ddf80-3741-4e97-865f-c4b871952eee tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Request method failure captured: Oct 27 03:33:52.015143 n-d-862769-1 devstack@n-api.service[121001]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 27 03:33:52.015143 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:33:52.015143 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:33:52.015143 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:33:52.015143 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 57 Oct 27 03:33:52.015143 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:33:52.015143 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:33:52.015143 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:33:52.015143 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:33:52.015143 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfv75dG4xVUVJiy0xNGaLpTTEfVOAs-58lUPKlHMSmBE82k9X7hUdrBjfpqr54BRPG8S5CYiZd3ltAjmh1OGeeC4oRjNjZ7scL5c40yYW_0Bj5gjmFqG_qQNVgIq8W25tNwkcKf1smcjdSzmOr6ppvt5Lhv4R-bSCKmFjGC0yQwaiFY Oct 27 03:33:52.015143 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:33:52.015143 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:33:52.015143 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:33:52.015143 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:33:52.015143 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:33:52.015143 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:33:52.015143 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: d2c1020a13864ca8b5199427528d650d Oct 27 03:33:52.015143 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ImagesNegativeTestJSON-1176283008 Oct 27 03:33:52.015143 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:33:52.015143 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:33:52.015143 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d2c1020a13864ca8b5199427528d650d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d2c1020a13864ca8b5199427528d650d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d2c1020a13864ca8b5199427528d650d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d2c1020a13864ca8b5199427528d650d"}]}] Oct 27 03:33:52.015143 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ImagesNegativeTestJSON-1176283008 Oct 27 03:33:52.015143 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: d2c1020a13864ca8b5199427528d650d Oct 27 03:33:52.015143 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1176283008 Oct 27 03:33:52.015143 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ImagesNegativeTestJSON-1176283008-project Oct 27 03:33:52.015143 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:33:52.015143 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:33:52.015143 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 45f7471db101458fa692a73173bb42a1 Oct 27 03:33:52.015143 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ImagesNegativeTestJSON-1176283008-project Oct 27 03:33:52.015143 n-d-862769-1 devstack@n-api.service[121001]: Oct 27 03:33:52.015143 n-d-862769-1 devstack@n-api.service[121001]: {"createImage": {"name": "tempest-test-snap-1654821627"}} Oct 27 03:33:52.015143 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:33:52.015143 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 27 03:33:52.015143 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1654821627'}}} Oct 27 03:33:52.015143 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:33:52.015143 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:33:52.015143 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:33:52.015143 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:33:52.015143 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 27 03:33:52.015143 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 27 03:33:52.015143 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 27 03:33:52.015143 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:33:52.015143 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:33:52.015143 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:33:52.015143 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:33:52.015143 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:33:52.015143 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:33:52.015143 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:33:52.015143 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:33:52.015143 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:33:52.015143 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:33:52.015143 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:33:52.015143 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:33:52.015143 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:33:52.015143 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:33:52.015143 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 27 03:33:52.015143 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 27 03:33:52.015143 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:33:52.015143 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:33:52.015143 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:33:52.015143 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:33:52.015143 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 27 03:33:52.015143 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:33:52.019004 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:33:52.019004 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:33:52.019004 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:33:52.019004 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:33:52.019004 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:33:52.019004 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:33:52.019004 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:33:52.019004 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 27 03:33:52.019004 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:33:52.025828 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f56ddf80-3741-4e97-865f-c4b871952eee tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:33:52.027182 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f56ddf80-3741-4e97-865f-c4b871952eee tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] 10.222.0.20 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.027764 Oct 27 03:33:52.028283 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1660/3103] 10.222.0.20 () {60 vars in 1281 bytes} [Thu Oct 27 03:33:51 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:33:52.040942 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d4894ebd-3367-4d36-8b4c-66c44639d66d tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:52.041712 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d4894ebd-3367-4d36-8b4c-66c44639d66d tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] [instance: e42cf1fc-e9c5-42f3-be93-ad7c3730e19c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:52.066837 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d4894ebd-3367-4d36-8b4c-66c44639d66d tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:52.067701 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d4894ebd-3367-4d36-8b4c-66c44639d66d tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:52.068356 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d4894ebd-3367-4d36-8b4c-66c44639d66d tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:52.069288 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d4894ebd-3367-4d36-8b4c-66c44639d66d tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:52.069955 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d4894ebd-3367-4d36-8b4c-66c44639d66d tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:52.070644 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d4894ebd-3367-4d36-8b4c-66c44639d66d tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:52.093476 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-d4894ebd-3367-4d36-8b4c-66c44639d66d tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] HTTP exception thrown: Instance e42cf1fc-e9c5-42f3-be93-ad7c3730e19c could not be found. Oct 27 03:33:52.096268 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d4894ebd-3367-4d36-8b4c-66c44639d66d tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Request method failure captured: Oct 27 03:33:52.096268 n-d-862769-1 devstack@n-api.service[121001]: request: DELETE /compute/v2.1/servers/e42cf1fc-e9c5-42f3-be93-ad7c3730e19c HTTP/1.1 Oct 27 03:33:52.096268 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:33:52.096268 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:33:52.096268 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:33:52.096268 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:33:52.096268 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:33:52.096268 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:33:52.096268 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:33:52.096268 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:33:52.096268 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfv75dG4xVUVJiy0xNGaLpTTEfVOAs-58lUPKlHMSmBE82k9X7hUdrBjfpqr54BRPG8S5CYiZd3ltAjmh1OGeeC4oRjNjZ7scL5c40yYW_0Bj5gjmFqG_qQNVgIq8W25tNwkcKf1smcjdSzmOr6ppvt5Lhv4R-bSCKmFjGC0yQwaiFY Oct 27 03:33:52.096268 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:33:52.096268 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:33:52.096268 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:33:52.096268 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:33:52.096268 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:33:52.096268 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:33:52.096268 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: d2c1020a13864ca8b5199427528d650d Oct 27 03:33:52.096268 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ImagesNegativeTestJSON-1176283008 Oct 27 03:33:52.096268 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:33:52.096268 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:33:52.096268 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d2c1020a13864ca8b5199427528d650d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d2c1020a13864ca8b5199427528d650d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d2c1020a13864ca8b5199427528d650d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d2c1020a13864ca8b5199427528d650d"}]}] Oct 27 03:33:52.096268 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ImagesNegativeTestJSON-1176283008 Oct 27 03:33:52.096268 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: d2c1020a13864ca8b5199427528d650d Oct 27 03:33:52.096268 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1176283008 Oct 27 03:33:52.096268 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ImagesNegativeTestJSON-1176283008-project Oct 27 03:33:52.096268 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:33:52.096268 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:33:52.096268 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 45f7471db101458fa692a73173bb42a1 Oct 27 03:33:52.096268 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ImagesNegativeTestJSON-1176283008-project Oct 27 03:33:52.096268 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:33:52.096268 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance e42cf1fc-e9c5-42f3-be93-ad7c3730e19c could not be found. Oct 27 03:33:52.096268 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': 'e42cf1fc-e9c5-42f3-be93-ad7c3730e19c'} Oct 27 03:33:52.096268 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:33:52.096268 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:33:52.096268 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:33:52.096268 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:33:52.096268 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:33:52.096268 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:33:52.096268 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:33:52.096268 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:33:52.096268 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:33:52.096268 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:33:52.096268 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e42cf1fc-e9c5-42f3-be93-ad7c3730e19c could not be found. Oct 27 03:33:52.096268 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:33:52.096268 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:33:52.096268 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:33:52.096268 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:33:52.096268 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:33:52.096268 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:33:52.096268 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:33:52.096268 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:33:52.096268 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:33:52.096268 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:33:52.096268 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 03:33:52.096268 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 03:33:52.096268 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 03:33:52.096268 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 03:33:52.096268 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:33:52.096268 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:33:52.096268 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:33:52.096268 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:33:52.100020 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e42cf1fc-e9c5-42f3-be93-ad7c3730e19c could not be found. Oct 27 03:33:52.100020 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:33:52.100020 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:33:52.100020 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:33:52.100020 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:33:52.100020 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:33:52.100020 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:33:52.100020 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:33:52.100020 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:33:52.100020 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e42cf1fc-e9c5-42f3-be93-ad7c3730e19c could not be found. Oct 27 03:33:52.100020 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:33:52.104305 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d4894ebd-3367-4d36-8b4c-66c44639d66d tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Returning 404 to user: Instance e42cf1fc-e9c5-42f3-be93-ad7c3730e19c could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:33:52.105437 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d4894ebd-3367-4d36-8b4c-66c44639d66d tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e42cf1fc-e9c5-42f3-be93-ad7c3730e19c" status: 404 len: 111 microversion: 2.1 time: 0.070410 Oct 27 03:33:52.106906 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1661/3104] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:33:52 2022] DELETE /compute/v2.1/servers/e42cf1fc-e9c5-42f3-be93-ad7c3730e19c => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:33:52.116774 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-bd4b06ca-379c-4886-8408-6f8b889aad98 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:52.121854 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-bd4b06ca-379c-4886-8408-6f8b889aad98 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] [instance: e42cf1fc-e9c5-42f3-be93-ad7c3730e19c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:52.134725 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bd4b06ca-379c-4886-8408-6f8b889aad98 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:52.135691 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bd4b06ca-379c-4886-8408-6f8b889aad98 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:52.136362 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bd4b06ca-379c-4886-8408-6f8b889aad98 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:52.139528 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bd4b06ca-379c-4886-8408-6f8b889aad98 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:52.140231 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bd4b06ca-379c-4886-8408-6f8b889aad98 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:52.149920 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bd4b06ca-379c-4886-8408-6f8b889aad98 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:52.173490 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-bd4b06ca-379c-4886-8408-6f8b889aad98 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] HTTP exception thrown: Instance e42cf1fc-e9c5-42f3-be93-ad7c3730e19c could not be found. Oct 27 03:33:52.177220 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-bd4b06ca-379c-4886-8408-6f8b889aad98 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Request method failure captured: Oct 27 03:33:52.177220 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/e42cf1fc-e9c5-42f3-be93-ad7c3730e19c HTTP/1.1 Oct 27 03:33:52.177220 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:33:52.177220 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:33:52.177220 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:33:52.177220 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:33:52.177220 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:33:52.177220 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:33:52.177220 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:33:52.177220 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:33:52.177220 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfv75dG4xVUVJiy0xNGaLpTTEfVOAs-58lUPKlHMSmBE82k9X7hUdrBjfpqr54BRPG8S5CYiZd3ltAjmh1OGeeC4oRjNjZ7scL5c40yYW_0Bj5gjmFqG_qQNVgIq8W25tNwkcKf1smcjdSzmOr6ppvt5Lhv4R-bSCKmFjGC0yQwaiFY Oct 27 03:33:52.177220 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:33:52.177220 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:33:52.177220 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:33:52.177220 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:33:52.177220 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:33:52.177220 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:33:52.177220 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: d2c1020a13864ca8b5199427528d650d Oct 27 03:33:52.177220 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ImagesNegativeTestJSON-1176283008 Oct 27 03:33:52.177220 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:33:52.177220 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:33:52.177220 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d2c1020a13864ca8b5199427528d650d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d2c1020a13864ca8b5199427528d650d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d2c1020a13864ca8b5199427528d650d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d2c1020a13864ca8b5199427528d650d"}]}] Oct 27 03:33:52.177220 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ImagesNegativeTestJSON-1176283008 Oct 27 03:33:52.177220 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: d2c1020a13864ca8b5199427528d650d Oct 27 03:33:52.177220 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1176283008 Oct 27 03:33:52.177220 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ImagesNegativeTestJSON-1176283008-project Oct 27 03:33:52.177220 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:33:52.177220 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:33:52.177220 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 45f7471db101458fa692a73173bb42a1 Oct 27 03:33:52.177220 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ImagesNegativeTestJSON-1176283008-project Oct 27 03:33:52.177220 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:33:52.177220 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance e42cf1fc-e9c5-42f3-be93-ad7c3730e19c could not be found. Oct 27 03:33:52.177220 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': 'e42cf1fc-e9c5-42f3-be93-ad7c3730e19c'} Oct 27 03:33:52.177220 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:33:52.177220 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:33:52.177220 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:33:52.177220 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:33:52.177220 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:33:52.177220 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:33:52.177220 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:33:52.177220 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:33:52.177220 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:33:52.177220 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:33:52.177220 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e42cf1fc-e9c5-42f3-be93-ad7c3730e19c could not be found. Oct 27 03:33:52.177220 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:33:52.177220 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:33:52.177220 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:33:52.177220 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:33:52.177220 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:33:52.177220 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:33:52.177220 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:33:52.177220 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:33:52.177220 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:33:52.177220 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:33:52.177220 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:33:52.177220 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:33:52.177220 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:33:52.177220 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:33:52.177220 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:33:52.177220 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:33:52.177220 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e42cf1fc-e9c5-42f3-be93-ad7c3730e19c could not be found. Oct 27 03:33:52.177220 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:33:52.177220 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:33:52.177220 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:33:52.181216 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:33:52.181216 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:33:52.181216 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:33:52.181216 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:33:52.181216 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:33:52.181216 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e42cf1fc-e9c5-42f3-be93-ad7c3730e19c could not be found. Oct 27 03:33:52.181216 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:33:52.193003 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-bd4b06ca-379c-4886-8408-6f8b889aad98 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] Returning 404 to user: Instance e42cf1fc-e9c5-42f3-be93-ad7c3730e19c could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:33:52.197372 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-bd4b06ca-379c-4886-8408-6f8b889aad98 tempest-ImagesNegativeTestJSON-1176283008 tempest-ImagesNegativeTestJSON-1176283008-project] 10.222.0.20 "GET /compute/v2.1/servers/e42cf1fc-e9c5-42f3-be93-ad7c3730e19c" status: 404 len: 111 microversion: 2.1 time: 0.084455 Oct 27 03:33:52.198526 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1662/3105] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:52 2022] GET /compute/v2.1/servers/e42cf1fc-e9c5-42f3-be93-ad7c3730e19c => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:33:52.204230 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-01865f6a-44f5-4f1f-9c41-75335609c1d2 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:52.205097 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-01865f6a-44f5-4f1f-9c41-75335609c1d2 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] [instance: 38693017-3b6f-434c-976f-a9733156a115] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:52.217055 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-01865f6a-44f5-4f1f-9c41-75335609c1d2 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:52.223353 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-01865f6a-44f5-4f1f-9c41-75335609c1d2 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:52.224049 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-01865f6a-44f5-4f1f-9c41-75335609c1d2 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:52.225055 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-01865f6a-44f5-4f1f-9c41-75335609c1d2 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:52.225718 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-01865f6a-44f5-4f1f-9c41-75335609c1d2 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:52.226397 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-01865f6a-44f5-4f1f-9c41-75335609c1d2 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:52.654328 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-01865f6a-44f5-4f1f-9c41-75335609c1d2 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881f054c84d04ceaa17a5817816022d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2057593072c14804ab70fe4bdea2c17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:52.667948 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-01865f6a-44f5-4f1f-9c41-75335609c1d2 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] 10.222.0.20 "GET /compute/v2.1/servers/38693017-3b6f-434c-976f-a9733156a115" status: 200 len: 1312 microversion: 2.1 time: 0.466271 Oct 27 03:33:52.669221 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1663/3106] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:52 2022] GET /compute/v2.1/servers/38693017-3b6f-434c-976f-a9733156a115 => generated 1312 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:33:52.778917 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1eb997ec-68ad-4b50-a30a-53f1a4aaf740 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:52.780860 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1eb997ec-68ad-4b50-a30a-53f1a4aaf740 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] [instance: 0c726bb2-8fea-4b2d-9e57-a585032c3155] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:52.803518 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1eb997ec-68ad-4b50-a30a-53f1a4aaf740 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:52.804677 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1eb997ec-68ad-4b50-a30a-53f1a4aaf740 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:52.807195 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1eb997ec-68ad-4b50-a30a-53f1a4aaf740 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:52.810006 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1eb997ec-68ad-4b50-a30a-53f1a4aaf740 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:52.811910 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1eb997ec-68ad-4b50-a30a-53f1a4aaf740 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:52.814628 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1eb997ec-68ad-4b50-a30a-53f1a4aaf740 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:53.015873 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:33:53.416283 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1eb997ec-68ad-4b50-a30a-53f1a4aaf740 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533917bc5aa4e23802a43b1eb534bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d87abf835a4104b40056b9eec2d6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:53.425597 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1eb997ec-68ad-4b50-a30a-53f1a4aaf740 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] 10.222.0.20 "GET /compute/v2.1/servers/0c726bb2-8fea-4b2d-9e57-a585032c3155" status: 200 len: 1492 microversion: 2.1 time: 0.656245 Oct 27 03:33:53.426767 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1664/3107] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:52 2022] GET /compute/v2.1/servers/0c726bb2-8fea-4b2d-9e57-a585032c3155 => generated 1492 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:33:53.463437 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-8bbbec04-73e2-4c9d-9360-d2dfe3f2fdc7 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:33:53.463951 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-8bbbec04-73e2-4c9d-9360-d2dfe3f2fdc7 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:33:53.464520 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-8bbbec04-73e2-4c9d-9360-d2dfe3f2fdc7 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:33:53.465021 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-8bbbec04-73e2-4c9d-9360-d2dfe3f2fdc7 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:33:53.470449 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-8bbbec04-73e2-4c9d-9360-d2dfe3f2fdc7 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:33:53.494745 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8bbbec04-73e2-4c9d-9360-d2dfe3f2fdc7 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:53.498700 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8bbbec04-73e2-4c9d-9360-d2dfe3f2fdc7 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:53.499386 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8bbbec04-73e2-4c9d-9360-d2dfe3f2fdc7 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:53.506007 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8bbbec04-73e2-4c9d-9360-d2dfe3f2fdc7 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:53.506805 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8bbbec04-73e2-4c9d-9360-d2dfe3f2fdc7 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:53.507451 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8bbbec04-73e2-4c9d-9360-d2dfe3f2fdc7 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:53.541177 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-8bbbec04-73e2-4c9d-9360-d2dfe3f2fdc7 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Getting quotas for project 3e9ede68f63747d59153a46412033856. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:33:53.552282 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-8bbbec04-73e2-4c9d-9360-d2dfe3f2fdc7 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Getting quotas for user 94897f20beb94dbd8e7eff6ecba30026 and project 3e9ede68f63747d59153a46412033856. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:33:53.584620 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8bbbec04-73e2-4c9d-9360-d2dfe3f2fdc7 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:33:53.588061 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8bbbec04-73e2-4c9d-9360-d2dfe3f2fdc7 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: 8184dc7a-d6db-4374-ace1-f26377f26187] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:33:53.616239 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-879f969d-ea47-4d1b-95f7-e22828b5803e req-abcf6580-8947-4f84-b816-b78a49717926 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c726bb2-8fea-4b2d-9e57-a585032c3155", "name": "network-vif-deleted", "tag": "89b1e705-64ca-4db0-94f7-a3663d1afe3e"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:33:53.644250 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-879f969d-ea47-4d1b-95f7-e22828b5803e req-abcf6580-8947-4f84-b816-b78a49717926 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:53.646766 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-879f969d-ea47-4d1b-95f7-e22828b5803e req-abcf6580-8947-4f84-b816-b78a49717926 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:53.647282 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-879f969d-ea47-4d1b-95f7-e22828b5803e req-abcf6580-8947-4f84-b816-b78a49717926 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:53.676780 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-879f969d-ea47-4d1b-95f7-e22828b5803e req-abcf6580-8947-4f84-b816-b78a49717926 service nova] Creating event network-vif-deleted:89b1e705-64ca-4db0-94f7-a3663d1afe3e for instance 0c726bb2-8fea-4b2d-9e57-a585032c3155 on n-h1-862769-1 Oct 27 03:33:53.685309 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-879f969d-ea47-4d1b-95f7-e22828b5803e req-abcf6580-8947-4f84-b816-b78a49717926 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073365 Oct 27 03:33:53.687847 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1665/3108] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:33:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:33:53.696984 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-337630a8-0a27-4adf-b0c7-f6c9fa67f053 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:53.697781 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-337630a8-0a27-4adf-b0c7-f6c9fa67f053 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] [instance: 38693017-3b6f-434c-976f-a9733156a115] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:53.711427 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-337630a8-0a27-4adf-b0c7-f6c9fa67f053 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:53.711427 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-337630a8-0a27-4adf-b0c7-f6c9fa67f053 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:53.711735 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-337630a8-0a27-4adf-b0c7-f6c9fa67f053 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:53.712281 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-337630a8-0a27-4adf-b0c7-f6c9fa67f053 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:53.712901 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-337630a8-0a27-4adf-b0c7-f6c9fa67f053 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:53.713239 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-337630a8-0a27-4adf-b0c7-f6c9fa67f053 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:53.810250 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8bbbec04-73e2-4c9d-9360-d2dfe3f2fdc7 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.671961 Oct 27 03:33:53.824334 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1444/3109] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:33:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 2684 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 03:33:53.837440 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-72d15e39-24de-4e4f-bfae-6b3e02fe2cd3 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:53.839640 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-72d15e39-24de-4e4f-bfae-6b3e02fe2cd3 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: 8184dc7a-d6db-4374-ace1-f26377f26187] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:54.015127 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-72d15e39-24de-4e4f-bfae-6b3e02fe2cd3 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:54.027358 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-72d15e39-24de-4e4f-bfae-6b3e02fe2cd3 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/8184dc7a-d6db-4374-ace1-f26377f26187" status: 200 len: 1214 microversion: 2.1 time: 0.200347 Oct 27 03:33:54.028634 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1445/3110] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:53 2022] GET /compute/v2.1/servers/8184dc7a-d6db-4374-ace1-f26377f26187 => generated 1214 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:33:54.458468 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b580f029-d756-46f0-935f-f0891d2179f0 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:54.459622 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b580f029-d756-46f0-935f-f0891d2179f0 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] [instance: 0c726bb2-8fea-4b2d-9e57-a585032c3155] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:54.471589 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b580f029-d756-46f0-935f-f0891d2179f0 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:54.472306 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b580f029-d756-46f0-935f-f0891d2179f0 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:54.472616 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b580f029-d756-46f0-935f-f0891d2179f0 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:54.478378 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b580f029-d756-46f0-935f-f0891d2179f0 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:54.478854 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b580f029-d756-46f0-935f-f0891d2179f0 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:54.479514 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b580f029-d756-46f0-935f-f0891d2179f0 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:54.496236 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-337630a8-0a27-4adf-b0c7-f6c9fa67f053 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881f054c84d04ceaa17a5817816022d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2057593072c14804ab70fe4bdea2c17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:54.508741 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-337630a8-0a27-4adf-b0c7-f6c9fa67f053 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] 10.222.0.20 "GET /compute/v2.1/servers/38693017-3b6f-434c-976f-a9733156a115" status: 200 len: 1333 microversion: 2.1 time: 0.818015 Oct 27 03:33:54.532508 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1666/3111] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:53 2022] GET /compute/v2.1/servers/38693017-3b6f-434c-976f-a9733156a115 => generated 1333 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:33:54.551775 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b580f029-d756-46f0-935f-f0891d2179f0 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:54.552276 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b580f029-d756-46f0-935f-f0891d2179f0 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:54.556333 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b580f029-d756-46f0-935f-f0891d2179f0 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:54.557069 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-b580f029-d756-46f0-935f-f0891d2179f0 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lazy-loading 'fault' on Instance uuid 0c726bb2-8fea-4b2d-9e57-a585032c3155 {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:33:54.806007 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b580f029-d756-46f0-935f-f0891d2179f0 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0533917bc5aa4e23802a43b1eb534bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d87abf835a4104b40056b9eec2d6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:54.830884 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b580f029-d756-46f0-935f-f0891d2179f0 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] 10.222.0.20 "GET /compute/v2.1/servers/0c726bb2-8fea-4b2d-9e57-a585032c3155" status: 200 len: 1304 microversion: 2.1 time: 0.381775 Oct 27 03:33:54.836710 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1446/3112] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:54 2022] GET /compute/v2.1/servers/0c726bb2-8fea-4b2d-9e57-a585032c3155 => generated 1304 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:33:55.071549 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1938a1f3-d0a1-4455-84c2-8abe2c46e648 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:55.073418 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1938a1f3-d0a1-4455-84c2-8abe2c46e648 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: 8184dc7a-d6db-4374-ace1-f26377f26187] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:55.095782 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=10 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:33:55.469989 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1938a1f3-d0a1-4455-84c2-8abe2c46e648 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:55.504550 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1938a1f3-d0a1-4455-84c2-8abe2c46e648 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/8184dc7a-d6db-4374-ace1-f26377f26187" status: 200 len: 1214 microversion: 2.1 time: 0.451502 Oct 27 03:33:55.521104 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1667/3113] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:55 2022] GET /compute/v2.1/servers/8184dc7a-d6db-4374-ace1-f26377f26187 => generated 1214 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:33:55.540132 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d85d033b-ba45-4ded-8e11-12a0b75609ce tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:55.540934 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d85d033b-ba45-4ded-8e11-12a0b75609ce tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] [instance: 38693017-3b6f-434c-976f-a9733156a115] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:55.556963 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d85d033b-ba45-4ded-8e11-12a0b75609ce tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:55.559042 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d85d033b-ba45-4ded-8e11-12a0b75609ce tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:55.560442 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d85d033b-ba45-4ded-8e11-12a0b75609ce tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:55.561489 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d85d033b-ba45-4ded-8e11-12a0b75609ce tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:55.562205 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d85d033b-ba45-4ded-8e11-12a0b75609ce tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:55.569462 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d85d033b-ba45-4ded-8e11-12a0b75609ce tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:55.841921 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d85d033b-ba45-4ded-8e11-12a0b75609ce tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881f054c84d04ceaa17a5817816022d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2057593072c14804ab70fe4bdea2c17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:55.853438 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d85d033b-ba45-4ded-8e11-12a0b75609ce tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] 10.222.0.20 "GET /compute/v2.1/servers/38693017-3b6f-434c-976f-a9733156a115" status: 200 len: 1333 microversion: 2.1 time: 0.319068 Oct 27 03:33:55.855164 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1447/3114] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:55 2022] GET /compute/v2.1/servers/38693017-3b6f-434c-976f-a9733156a115 => generated 1333 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:33:55.872701 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-94e15e97-e8b8-4aa1-8f09-12d3f65877c2 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:55.873555 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-94e15e97-e8b8-4aa1-8f09-12d3f65877c2 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] [instance: 0c726bb2-8fea-4b2d-9e57-a585032c3155] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:55.894509 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-94e15e97-e8b8-4aa1-8f09-12d3f65877c2 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:55.895941 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-94e15e97-e8b8-4aa1-8f09-12d3f65877c2 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:55.896428 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-94e15e97-e8b8-4aa1-8f09-12d3f65877c2 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:55.897205 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-94e15e97-e8b8-4aa1-8f09-12d3f65877c2 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:55.897668 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-94e15e97-e8b8-4aa1-8f09-12d3f65877c2 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:55.901506 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-94e15e97-e8b8-4aa1-8f09-12d3f65877c2 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:55.935070 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-94e15e97-e8b8-4aa1-8f09-12d3f65877c2 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] HTTP exception thrown: Instance 0c726bb2-8fea-4b2d-9e57-a585032c3155 could not be found. Oct 27 03:33:55.937998 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-94e15e97-e8b8-4aa1-8f09-12d3f65877c2 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Request method failure captured: Oct 27 03:33:55.937998 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/0c726bb2-8fea-4b2d-9e57-a585032c3155 HTTP/1.1 Oct 27 03:33:55.937998 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:33:55.937998 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:33:55.937998 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:33:55.937998 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:33:55.937998 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:33:55.937998 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:33:55.937998 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:33:55.937998 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:33:55.937998 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWft_NLC_KkorfscNahbMwaT8EeN-6Ki2Fcp1Q3mDiwz70j8D5SCYx6D1B1ml9gJqyJ3fFQUyB7mtC0weTKfmOV_3otzJB5R960cgtM-MRQSpsurbvd5K6QzwNjhv1otFQ4Iht_uxlxa-wnzb82ESFILvxmZ1Ni45m2pNHzO2jS7NoQw Oct 27 03:33:55.937998 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:33:55.937998 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:33:55.937998 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:33:55.937998 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:33:55.937998 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:33:55.937998 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:33:55.937998 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 20d87abf835a4104b40056b9eec2d6b6 Oct 27 03:33:55.937998 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServerRescueTestJSON-1794458924 Oct 27 03:33:55.937998 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:33:55.937998 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:33:55.937998 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/20d87abf835a4104b40056b9eec2d6b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/20d87abf835a4104b40056b9eec2d6b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/20d87abf835a4104b40056b9eec2d6b6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_20d87abf835a4104b40056b9eec2d6b6"}]}] Oct 27 03:33:55.937998 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServerRescueTestJSON-1794458924 Oct 27 03:33:55.937998 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 20d87abf835a4104b40056b9eec2d6b6 Oct 27 03:33:55.937998 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServerRescueTestJSON-1794458924 Oct 27 03:33:55.937998 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServerRescueTestJSON-1794458924-project Oct 27 03:33:55.937998 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:33:55.937998 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:33:55.937998 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 0533917bc5aa4e23802a43b1eb534bd0 Oct 27 03:33:55.937998 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServerRescueTestJSON-1794458924-project Oct 27 03:33:55.937998 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:33:55.937998 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 0c726bb2-8fea-4b2d-9e57-a585032c3155 could not be found. Oct 27 03:33:55.937998 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '0c726bb2-8fea-4b2d-9e57-a585032c3155'} Oct 27 03:33:55.937998 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:33:55.937998 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:33:55.937998 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:33:55.937998 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:33:55.937998 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:33:55.937998 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:33:55.937998 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:33:55.937998 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:33:55.937998 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:33:55.937998 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:33:55.937998 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c726bb2-8fea-4b2d-9e57-a585032c3155 could not be found. Oct 27 03:33:55.937998 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:33:55.937998 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:33:55.937998 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:33:55.937998 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:33:55.937998 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:33:55.937998 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:33:55.937998 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:33:55.937998 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:33:55.937998 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:33:55.937998 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:33:55.937998 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:33:55.937998 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:33:55.937998 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:33:55.937998 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:33:55.937998 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:33:55.937998 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:33:55.937998 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c726bb2-8fea-4b2d-9e57-a585032c3155 could not be found. Oct 27 03:33:55.937998 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:33:55.937998 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:33:55.937998 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:33:55.943486 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:33:55.943486 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:33:55.943486 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:33:55.943486 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:33:55.943486 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:33:55.943486 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c726bb2-8fea-4b2d-9e57-a585032c3155 could not be found. Oct 27 03:33:55.943486 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:33:55.946501 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-94e15e97-e8b8-4aa1-8f09-12d3f65877c2 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] Returning 404 to user: Instance 0c726bb2-8fea-4b2d-9e57-a585032c3155 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:33:55.947609 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-94e15e97-e8b8-4aa1-8f09-12d3f65877c2 tempest-ServerRescueTestJSON-1794458924 tempest-ServerRescueTestJSON-1794458924-project] 10.222.0.20 "GET /compute/v2.1/servers/0c726bb2-8fea-4b2d-9e57-a585032c3155" status: 404 len: 111 microversion: 2.1 time: 0.088181 Oct 27 03:33:55.948629 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1668/3115] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:55 2022] GET /compute/v2.1/servers/0c726bb2-8fea-4b2d-9e57-a585032c3155 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:33:56.532531 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ba70abb9-17c2-4474-9e9e-ff15d8678462 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:56.534293 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ba70abb9-17c2-4474-9e9e-ff15d8678462 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: 8184dc7a-d6db-4374-ace1-f26377f26187] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:56.565390 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ba70abb9-17c2-4474-9e9e-ff15d8678462 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:56.579510 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ba70abb9-17c2-4474-9e9e-ff15d8678462 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:56.581695 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ba70abb9-17c2-4474-9e9e-ff15d8678462 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:56.592823 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ba70abb9-17c2-4474-9e9e-ff15d8678462 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:56.593684 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ba70abb9-17c2-4474-9e9e-ff15d8678462 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:56.595048 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ba70abb9-17c2-4474-9e9e-ff15d8678462 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:56.720497 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-557f895d-a024-4fed-ab4b-3076344d6008 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:56.726951 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-557f895d-a024-4fed-ab4b-3076344d6008 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] [instance: f3d23d8e-a80a-425c-a0a3-9e448853a94b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:56.743302 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-557f895d-a024-4fed-ab4b-3076344d6008 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:56.755000 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-557f895d-a024-4fed-ab4b-3076344d6008 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:56.755784 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-557f895d-a024-4fed-ab4b-3076344d6008 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:56.756758 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-557f895d-a024-4fed-ab4b-3076344d6008 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:56.757407 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-557f895d-a024-4fed-ab4b-3076344d6008 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:56.758186 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-557f895d-a024-4fed-ab4b-3076344d6008 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:56.816492 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-557f895d-a024-4fed-ab4b-3076344d6008 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d23d8e-a80a-425c-a0a3-9e448853a94b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.099926 Oct 27 03:33:56.817962 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1669/3116] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 27 03:33:56 2022] GET /compute/v2.1/servers/f3d23d8e-a80a-425c-a0a3-9e448853a94b/os-volume_attachments => generated 25 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 03:33:56.896477 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-87cec52a-fbd8-4acc-8ac0-09c8768a31af tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:56.897240 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-87cec52a-fbd8-4acc-8ac0-09c8768a31af tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] [instance: 38693017-3b6f-434c-976f-a9733156a115] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:56.919351 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-87cec52a-fbd8-4acc-8ac0-09c8768a31af tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:56.919861 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-87cec52a-fbd8-4acc-8ac0-09c8768a31af tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:56.920329 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-87cec52a-fbd8-4acc-8ac0-09c8768a31af tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:56.921036 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-87cec52a-fbd8-4acc-8ac0-09c8768a31af tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:56.928023 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-87cec52a-fbd8-4acc-8ac0-09c8768a31af tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:56.928486 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-87cec52a-fbd8-4acc-8ac0-09c8768a31af tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:56.957111 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ba70abb9-17c2-4474-9e9e-ff15d8678462 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:56.969017 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ba70abb9-17c2-4474-9e9e-ff15d8678462 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/8184dc7a-d6db-4374-ace1-f26377f26187" status: 200 len: 1266 microversion: 2.1 time: 0.440438 Oct 27 03:33:56.969664 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1448/3117] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:56 2022] GET /compute/v2.1/servers/8184dc7a-d6db-4374-ace1-f26377f26187 => generated 1266 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:33:56.977798 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b974b088-dfbe-422c-9dac-d90e13e6428c tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:56.980485 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b974b088-dfbe-422c-9dac-d90e13e6428c tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] [instance: f3d23d8e-a80a-425c-a0a3-9e448853a94b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:57.003371 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b974b088-dfbe-422c-9dac-d90e13e6428c tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:57.004347 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b974b088-dfbe-422c-9dac-d90e13e6428c tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:57.004994 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b974b088-dfbe-422c-9dac-d90e13e6428c tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:57.005934 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b974b088-dfbe-422c-9dac-d90e13e6428c tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:57.010874 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b974b088-dfbe-422c-9dac-d90e13e6428c tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:57.011771 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b974b088-dfbe-422c-9dac-d90e13e6428c tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:57.065489 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b974b088-dfbe-422c-9dac-d90e13e6428c tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d23d8e-a80a-425c-a0a3-9e448853a94b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.092953 Oct 27 03:33:57.073640 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1449/3118] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 27 03:33:56 2022] GET /compute/v2.1/servers/f3d23d8e-a80a-425c-a0a3-9e448853a94b/os-volume_attachments => generated 25 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 03:33:57.171547 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ee39a327-6973-4be5-bd96-977a84b3acc2 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:57.173152 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ee39a327-6973-4be5-bd96-977a84b3acc2 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] [instance: f3d23d8e-a80a-425c-a0a3-9e448853a94b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:57.186837 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ee39a327-6973-4be5-bd96-977a84b3acc2 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:57.189703 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ee39a327-6973-4be5-bd96-977a84b3acc2 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:57.191574 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ee39a327-6973-4be5-bd96-977a84b3acc2 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:57.194089 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ee39a327-6973-4be5-bd96-977a84b3acc2 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:57.197284 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ee39a327-6973-4be5-bd96-977a84b3acc2 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:57.198170 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ee39a327-6973-4be5-bd96-977a84b3acc2 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:57.268512 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ee39a327-6973-4be5-bd96-977a84b3acc2 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] [instance: f3d23d8e-a80a-425c-a0a3-9e448853a94b] Going to try to terminate instance {{(pid=121000) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:33:57.573577 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-87cec52a-fbd8-4acc-8ac0-09c8768a31af tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881f054c84d04ceaa17a5817816022d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2057593072c14804ab70fe4bdea2c17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:57.602765 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-87cec52a-fbd8-4acc-8ac0-09c8768a31af tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] 10.222.0.20 "GET /compute/v2.1/servers/38693017-3b6f-434c-976f-a9733156a115" status: 200 len: 1354 microversion: 2.1 time: 0.720646 Oct 27 03:33:57.612507 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1670/3119] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:56 2022] GET /compute/v2.1/servers/38693017-3b6f-434c-976f-a9733156a115 => generated 1354 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:33:57.771027 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ee39a327-6973-4be5-bd96-977a84b3acc2 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f3d23d8e-a80a-425c-a0a3-9e448853a94b" status: 204 len: 0 microversion: 2.1 time: 0.603175 Oct 27 03:33:57.774333 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1450/3120] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:33:57 2022] DELETE /compute/v2.1/servers/f3d23d8e-a80a-425c-a0a3-9e448853a94b => generated 0 bytes in 608 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:33:57.783516 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-fd8e7148-d7b8-40d0-b8c0-373571f4f8e1 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:57.784168 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-fd8e7148-d7b8-40d0-b8c0-373571f4f8e1 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] [instance: f3d23d8e-a80a-425c-a0a3-9e448853a94b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:57.795378 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fd8e7148-d7b8-40d0-b8c0-373571f4f8e1 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:57.795877 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fd8e7148-d7b8-40d0-b8c0-373571f4f8e1 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:57.803996 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fd8e7148-d7b8-40d0-b8c0-373571f4f8e1 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:57.805024 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fd8e7148-d7b8-40d0-b8c0-373571f4f8e1 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:57.805732 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fd8e7148-d7b8-40d0-b8c0-373571f4f8e1 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:57.807407 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fd8e7148-d7b8-40d0-b8c0-373571f4f8e1 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:57.850928 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:33:57.994437 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d0962319-af7d-4741-9ac5-9c0a7ec6f8bf tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:57.995566 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d0962319-af7d-4741-9ac5-9c0a7ec6f8bf tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: 8184dc7a-d6db-4374-ace1-f26377f26187] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:58.013591 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d0962319-af7d-4741-9ac5-9c0a7ec6f8bf tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:58.014393 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d0962319-af7d-4741-9ac5-9c0a7ec6f8bf tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:58.014930 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d0962319-af7d-4741-9ac5-9c0a7ec6f8bf tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:58.019616 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d0962319-af7d-4741-9ac5-9c0a7ec6f8bf tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:58.020629 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d0962319-af7d-4741-9ac5-9c0a7ec6f8bf tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:58.021265 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d0962319-af7d-4741-9ac5-9c0a7ec6f8bf tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:58.262725 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-fd8e7148-d7b8-40d0-b8c0-373571f4f8e1 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed44bf20b3464a53a3e3f6c9cd61cde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ee48e200624711b629a12b20c7d282', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:58.278299 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-fd8e7148-d7b8-40d0-b8c0-373571f4f8e1 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d23d8e-a80a-425c-a0a3-9e448853a94b" status: 200 len: 1680 microversion: 2.1 time: 0.499206 Oct 27 03:33:58.279366 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1671/3121] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:57 2022] GET /compute/v2.1/servers/f3d23d8e-a80a-425c-a0a3-9e448853a94b => generated 1680 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:33:58.357851 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d0962319-af7d-4741-9ac5-9c0a7ec6f8bf tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:58.366361 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d0962319-af7d-4741-9ac5-9c0a7ec6f8bf tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/8184dc7a-d6db-4374-ace1-f26377f26187" status: 200 len: 1272 microversion: 2.1 time: 0.377519 Oct 27 03:33:58.371574 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1451/3122] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:57 2022] GET /compute/v2.1/servers/8184dc7a-d6db-4374-ace1-f26377f26187 => generated 1272 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:33:58.637029 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-fe1d412f-6406-427e-ba00-9550dd783a80 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:58.640605 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-fe1d412f-6406-427e-ba00-9550dd783a80 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] [instance: 38693017-3b6f-434c-976f-a9733156a115] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:58.648502 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fe1d412f-6406-427e-ba00-9550dd783a80 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:58.652588 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fe1d412f-6406-427e-ba00-9550dd783a80 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:58.653049 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fe1d412f-6406-427e-ba00-9550dd783a80 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:58.653789 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fe1d412f-6406-427e-ba00-9550dd783a80 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:58.654283 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fe1d412f-6406-427e-ba00-9550dd783a80 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:58.654721 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fe1d412f-6406-427e-ba00-9550dd783a80 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:59.196528 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-fe1d412f-6406-427e-ba00-9550dd783a80 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881f054c84d04ceaa17a5817816022d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2057593072c14804ab70fe4bdea2c17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:59.204892 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-fe1d412f-6406-427e-ba00-9550dd783a80 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] 10.222.0.20 "GET /compute/v2.1/servers/38693017-3b6f-434c-976f-a9733156a115" status: 200 len: 1354 microversion: 2.1 time: 0.571869 Oct 27 03:33:59.205488 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1672/3123] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:58 2022] GET /compute/v2.1/servers/38693017-3b6f-434c-976f-a9733156a115 => generated 1354 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:33:59.307879 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2f6b761c-dafa-4a06-95ee-2d725757d88b tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:59.313113 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-2f6b761c-dafa-4a06-95ee-2d725757d88b tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] [instance: f3d23d8e-a80a-425c-a0a3-9e448853a94b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:59.329095 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2f6b761c-dafa-4a06-95ee-2d725757d88b tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:59.329605 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2f6b761c-dafa-4a06-95ee-2d725757d88b tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:59.330097 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2f6b761c-dafa-4a06-95ee-2d725757d88b tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:59.330850 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2f6b761c-dafa-4a06-95ee-2d725757d88b tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:59.331325 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2f6b761c-dafa-4a06-95ee-2d725757d88b tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:59.334953 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2f6b761c-dafa-4a06-95ee-2d725757d88b tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:59.399773 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-54a70f70-1dcb-4cfc-9f71-d14483595ea8 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:33:59.404062 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-54a70f70-1dcb-4cfc-9f71-d14483595ea8 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: 8184dc7a-d6db-4374-ace1-f26377f26187] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:33:59.407711 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-54a70f70-1dcb-4cfc-9f71-d14483595ea8 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:59.408587 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-54a70f70-1dcb-4cfc-9f71-d14483595ea8 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:59.409059 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-54a70f70-1dcb-4cfc-9f71-d14483595ea8 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:59.409795 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-54a70f70-1dcb-4cfc-9f71-d14483595ea8 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:33:59.410310 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-54a70f70-1dcb-4cfc-9f71-d14483595ea8 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:33:59.411215 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-54a70f70-1dcb-4cfc-9f71-d14483595ea8 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:33:59.607239 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-54a70f70-1dcb-4cfc-9f71-d14483595ea8 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:59.619778 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-54a70f70-1dcb-4cfc-9f71-d14483595ea8 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/8184dc7a-d6db-4374-ace1-f26377f26187" status: 200 len: 1272 microversion: 2.1 time: 0.223873 Oct 27 03:33:59.620488 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1673/3124] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:59 2022] GET /compute/v2.1/servers/8184dc7a-d6db-4374-ace1-f26377f26187 => generated 1272 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:33:59.888955 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2f6b761c-dafa-4a06-95ee-2d725757d88b tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed44bf20b3464a53a3e3f6c9cd61cde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ee48e200624711b629a12b20c7d282', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:33:59.903549 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2f6b761c-dafa-4a06-95ee-2d725757d88b tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d23d8e-a80a-425c-a0a3-9e448853a94b" status: 200 len: 1680 microversion: 2.1 time: 0.600680 Oct 27 03:33:59.905031 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1452/3125] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:33:59 2022] GET /compute/v2.1/servers/f3d23d8e-a80a-425c-a0a3-9e448853a94b => generated 1680 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:00.230554 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-617af03e-395d-46d2-b100-6d7f4fadea49 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:00.231172 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-617af03e-395d-46d2-b100-6d7f4fadea49 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] [instance: 38693017-3b6f-434c-976f-a9733156a115] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:00.241071 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-617af03e-395d-46d2-b100-6d7f4fadea49 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:00.241824 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-617af03e-395d-46d2-b100-6d7f4fadea49 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:00.242663 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-617af03e-395d-46d2-b100-6d7f4fadea49 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:00.243699 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-617af03e-395d-46d2-b100-6d7f4fadea49 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:00.246062 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-565bed1b-addb-440a-a921-5cdb0458dcf0 req-08ae436e-cf73-48ac-97e3-65e903f461fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38693017-3b6f-434c-976f-a9733156a115", "tag": "473d6bda-acfa-4fd9-be94-64718ac6a5b8"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:34:00.256737 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-617af03e-395d-46d2-b100-6d7f4fadea49 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:00.259356 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-565bed1b-addb-440a-a921-5cdb0458dcf0 req-08ae436e-cf73-48ac-97e3-65e903f461fc service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:00.259812 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-617af03e-395d-46d2-b100-6d7f4fadea49 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:00.259929 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-565bed1b-addb-440a-a921-5cdb0458dcf0 req-08ae436e-cf73-48ac-97e3-65e903f461fc service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:00.260335 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-565bed1b-addb-440a-a921-5cdb0458dcf0 req-08ae436e-cf73-48ac-97e3-65e903f461fc service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:00.274002 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-565bed1b-addb-440a-a921-5cdb0458dcf0 req-08ae436e-cf73-48ac-97e3-65e903f461fc service nova] Creating event network-changed:473d6bda-acfa-4fd9-be94-64718ac6a5b8 for instance 38693017-3b6f-434c-976f-a9733156a115 on n-h2-862769-1 Oct 27 03:34:00.280538 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-565bed1b-addb-440a-a921-5cdb0458dcf0 req-08ae436e-cf73-48ac-97e3-65e903f461fc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038723 Oct 27 03:34:00.281753 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1453/3126] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:34:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:34:00.645511 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5720e7b2-23fa-42a5-aeab-82c72a073f70 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:00.647366 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5720e7b2-23fa-42a5-aeab-82c72a073f70 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: 8184dc7a-d6db-4374-ace1-f26377f26187] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:00.660910 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5720e7b2-23fa-42a5-aeab-82c72a073f70 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:00.660910 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5720e7b2-23fa-42a5-aeab-82c72a073f70 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:00.660910 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5720e7b2-23fa-42a5-aeab-82c72a073f70 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:00.660910 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5720e7b2-23fa-42a5-aeab-82c72a073f70 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:00.660910 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5720e7b2-23fa-42a5-aeab-82c72a073f70 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:00.670516 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5720e7b2-23fa-42a5-aeab-82c72a073f70 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:00.941565 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-617af03e-395d-46d2-b100-6d7f4fadea49 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881f054c84d04ceaa17a5817816022d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2057593072c14804ab70fe4bdea2c17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:00.961900 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-617af03e-395d-46d2-b100-6d7f4fadea49 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] 10.222.0.20 "GET /compute/v2.1/servers/38693017-3b6f-434c-976f-a9733156a115" status: 200 len: 1354 microversion: 2.1 time: 0.735109 Oct 27 03:34:00.966638 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1674/3127] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:00 2022] GET /compute/v2.1/servers/38693017-3b6f-434c-976f-a9733156a115 => generated 1354 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:00.980934 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5f5fd4c8-495a-43b6-b565-42ff92859cc6 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:00.982890 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5f5fd4c8-495a-43b6-b565-42ff92859cc6 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] [instance: f3d23d8e-a80a-425c-a0a3-9e448853a94b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:00.991646 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5f5fd4c8-495a-43b6-b565-42ff92859cc6 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:00.992156 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5f5fd4c8-495a-43b6-b565-42ff92859cc6 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:00.992964 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5f5fd4c8-495a-43b6-b565-42ff92859cc6 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:00.993700 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5f5fd4c8-495a-43b6-b565-42ff92859cc6 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:00.994540 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5f5fd4c8-495a-43b6-b565-42ff92859cc6 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:00.994786 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5f5fd4c8-495a-43b6-b565-42ff92859cc6 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:01.206426 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5720e7b2-23fa-42a5-aeab-82c72a073f70 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:01.216140 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5720e7b2-23fa-42a5-aeab-82c72a073f70 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/8184dc7a-d6db-4374-ace1-f26377f26187" status: 200 len: 1314 microversion: 2.1 time: 0.575688 Oct 27 03:34:01.217521 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1454/3128] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:00 2022] GET /compute/v2.1/servers/8184dc7a-d6db-4374-ace1-f26377f26187 => generated 1314 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:01.370353 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5f5fd4c8-495a-43b6-b565-42ff92859cc6 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed44bf20b3464a53a3e3f6c9cd61cde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ee48e200624711b629a12b20c7d282', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:01.382642 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5f5fd4c8-495a-43b6-b565-42ff92859cc6 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d23d8e-a80a-425c-a0a3-9e448853a94b" status: 200 len: 1680 microversion: 2.1 time: 0.414537 Oct 27 03:34:01.383850 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1675/3129] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:00 2022] GET /compute/v2.1/servers/f3d23d8e-a80a-425c-a0a3-9e448853a94b => generated 1680 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:01.991402 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-cfffaae1-8973-451c-baea-9ec14ca3f7fe tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:01.992778 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-cfffaae1-8973-451c-baea-9ec14ca3f7fe tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] [instance: 38693017-3b6f-434c-976f-a9733156a115] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:02.001693 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cfffaae1-8973-451c-baea-9ec14ca3f7fe tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:02.002414 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cfffaae1-8973-451c-baea-9ec14ca3f7fe tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:02.002965 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cfffaae1-8973-451c-baea-9ec14ca3f7fe tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:02.003822 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cfffaae1-8973-451c-baea-9ec14ca3f7fe tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:02.004778 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cfffaae1-8973-451c-baea-9ec14ca3f7fe tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:02.005774 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cfffaae1-8973-451c-baea-9ec14ca3f7fe tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:02.244903 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0410f64b-7c72-4931-80fa-44b73ce9437b tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:02.244903 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0410f64b-7c72-4931-80fa-44b73ce9437b tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: 8184dc7a-d6db-4374-ace1-f26377f26187] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:02.256651 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0410f64b-7c72-4931-80fa-44b73ce9437b tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:02.257162 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0410f64b-7c72-4931-80fa-44b73ce9437b tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:02.257624 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0410f64b-7c72-4931-80fa-44b73ce9437b tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:02.258630 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0410f64b-7c72-4931-80fa-44b73ce9437b tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:02.259253 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0410f64b-7c72-4931-80fa-44b73ce9437b tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:02.259700 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0410f64b-7c72-4931-80fa-44b73ce9437b tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:02.758018 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-cfffaae1-8973-451c-baea-9ec14ca3f7fe tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881f054c84d04ceaa17a5817816022d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2057593072c14804ab70fe4bdea2c17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:02.775184 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-cfffaae1-8973-451c-baea-9ec14ca3f7fe tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] 10.222.0.20 "GET /compute/v2.1/servers/38693017-3b6f-434c-976f-a9733156a115" status: 200 len: 1354 microversion: 2.1 time: 0.787596 Oct 27 03:34:02.776956 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1455/3130] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:01 2022] GET /compute/v2.1/servers/38693017-3b6f-434c-976f-a9733156a115 => generated 1354 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:02.783807 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f606c3df-fc39-41c6-8acd-9c054cb03fa4 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:02.784666 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f606c3df-fc39-41c6-8acd-9c054cb03fa4 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] [instance: f3d23d8e-a80a-425c-a0a3-9e448853a94b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:02.793670 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f606c3df-fc39-41c6-8acd-9c054cb03fa4 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:02.794581 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f606c3df-fc39-41c6-8acd-9c054cb03fa4 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:02.795253 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f606c3df-fc39-41c6-8acd-9c054cb03fa4 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:02.797376 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f606c3df-fc39-41c6-8acd-9c054cb03fa4 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:02.798077 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f606c3df-fc39-41c6-8acd-9c054cb03fa4 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:02.798703 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f606c3df-fc39-41c6-8acd-9c054cb03fa4 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:02.915148 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f606c3df-fc39-41c6-8acd-9c054cb03fa4 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed44bf20b3464a53a3e3f6c9cd61cde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ee48e200624711b629a12b20c7d282', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:02.942491 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f606c3df-fc39-41c6-8acd-9c054cb03fa4 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d23d8e-a80a-425c-a0a3-9e448853a94b" status: 200 len: 1613 microversion: 2.1 time: 0.164174 Oct 27 03:34:02.943315 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1456/3131] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:02 2022] GET /compute/v2.1/servers/f3d23d8e-a80a-425c-a0a3-9e448853a94b => generated 1613 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:03.324630 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0410f64b-7c72-4931-80fa-44b73ce9437b tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:03.333750 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0410f64b-7c72-4931-80fa-44b73ce9437b tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/8184dc7a-d6db-4374-ace1-f26377f26187" status: 200 len: 1314 microversion: 2.1 time: 1.096764 Oct 27 03:34:03.344706 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1676/3132] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:02 2022] GET /compute/v2.1/servers/8184dc7a-d6db-4374-ace1-f26377f26187 => generated 1314 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:34:03.479635 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-83ccd93b-d8cc-4703-8896-f6fe58836dae req-886bc36d-059a-4fd8-ab9d-0c7e84024335 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3d23d8e-a80a-425c-a0a3-9e448853a94b", "name": "network-vif-deleted", "tag": "aa192bf0-ce03-4098-8949-343a75b75ddb"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:34:03.493684 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-83ccd93b-d8cc-4703-8896-f6fe58836dae req-886bc36d-059a-4fd8-ab9d-0c7e84024335 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:03.494250 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-83ccd93b-d8cc-4703-8896-f6fe58836dae req-886bc36d-059a-4fd8-ab9d-0c7e84024335 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:03.494688 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-83ccd93b-d8cc-4703-8896-f6fe58836dae req-886bc36d-059a-4fd8-ab9d-0c7e84024335 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:03.509417 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-83ccd93b-d8cc-4703-8896-f6fe58836dae req-886bc36d-059a-4fd8-ab9d-0c7e84024335 service nova] Creating event network-vif-deleted:aa192bf0-ce03-4098-8949-343a75b75ddb for instance f3d23d8e-a80a-425c-a0a3-9e448853a94b on n-h2-862769-1 Oct 27 03:34:03.518112 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-83ccd93b-d8cc-4703-8896-f6fe58836dae req-886bc36d-059a-4fd8-ab9d-0c7e84024335 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043164 Oct 27 03:34:03.519117 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1457/3133] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:34:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:34:03.799656 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a3cbc495-f155-47a8-8df6-9daeed4abc5d tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:03.800502 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a3cbc495-f155-47a8-8df6-9daeed4abc5d tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] [instance: 38693017-3b6f-434c-976f-a9733156a115] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:03.820106 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a3cbc495-f155-47a8-8df6-9daeed4abc5d tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:03.820878 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a3cbc495-f155-47a8-8df6-9daeed4abc5d tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:03.821500 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a3cbc495-f155-47a8-8df6-9daeed4abc5d tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:03.822423 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a3cbc495-f155-47a8-8df6-9daeed4abc5d tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:03.823052 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a3cbc495-f155-47a8-8df6-9daeed4abc5d tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:03.823651 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a3cbc495-f155-47a8-8df6-9daeed4abc5d tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:03.966095 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:34:03.970468 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f008e7c3-ed3f-4e88-816c-9e656288fc49 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:03.974479 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f008e7c3-ed3f-4e88-816c-9e656288fc49 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] [instance: f3d23d8e-a80a-425c-a0a3-9e448853a94b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:03.982953 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f008e7c3-ed3f-4e88-816c-9e656288fc49 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:03.994891 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f008e7c3-ed3f-4e88-816c-9e656288fc49 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:03.995687 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f008e7c3-ed3f-4e88-816c-9e656288fc49 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:03.997452 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f008e7c3-ed3f-4e88-816c-9e656288fc49 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:03.998500 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f008e7c3-ed3f-4e88-816c-9e656288fc49 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:03.999273 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f008e7c3-ed3f-4e88-816c-9e656288fc49 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:04.034721 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=8 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:34:04.191485 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f008e7c3-ed3f-4e88-816c-9e656288fc49 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed44bf20b3464a53a3e3f6c9cd61cde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ee48e200624711b629a12b20c7d282', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:04.216268 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f008e7c3-ed3f-4e88-816c-9e656288fc49 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d23d8e-a80a-425c-a0a3-9e448853a94b" status: 200 len: 1326 microversion: 2.1 time: 0.239162 Oct 27 03:34:04.224919 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1458/3134] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:03 2022] GET /compute/v2.1/servers/f3d23d8e-a80a-425c-a0a3-9e448853a94b => generated 1326 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:04.294292 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a3cbc495-f155-47a8-8df6-9daeed4abc5d tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881f054c84d04ceaa17a5817816022d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2057593072c14804ab70fe4bdea2c17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:04.319548 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a3cbc495-f155-47a8-8df6-9daeed4abc5d tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] 10.222.0.20 "GET /compute/v2.1/servers/38693017-3b6f-434c-976f-a9733156a115" status: 200 len: 1354 microversion: 2.1 time: 0.524742 Oct 27 03:34:04.333460 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1677/3135] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:03 2022] GET /compute/v2.1/servers/38693017-3b6f-434c-976f-a9733156a115 => generated 1354 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:04.372719 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-58af798e-e4f7-48ba-90aa-c2fdc5a9ef85 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:04.373512 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-58af798e-e4f7-48ba-90aa-c2fdc5a9ef85 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: 8184dc7a-d6db-4374-ace1-f26377f26187] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:04.384868 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-58af798e-e4f7-48ba-90aa-c2fdc5a9ef85 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:04.392493 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-58af798e-e4f7-48ba-90aa-c2fdc5a9ef85 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:04.393965 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-58af798e-e4f7-48ba-90aa-c2fdc5a9ef85 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:04.395070 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-58af798e-e4f7-48ba-90aa-c2fdc5a9ef85 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:04.395818 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-58af798e-e4f7-48ba-90aa-c2fdc5a9ef85 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:04.396271 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-58af798e-e4f7-48ba-90aa-c2fdc5a9ef85 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:04.595939 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-24e29a50-86fb-458a-8374-3761a5e5f37c req-a81cc756-8a8f-49d4-8f23-1f19f90b1db8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8184dc7a-d6db-4374-ace1-f26377f26187", "tag": "a77a3d1b-554a-4133-b6bc-00f0b2a88101"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:34:04.638676 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-24e29a50-86fb-458a-8374-3761a5e5f37c req-a81cc756-8a8f-49d4-8f23-1f19f90b1db8 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:04.640405 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-24e29a50-86fb-458a-8374-3761a5e5f37c req-a81cc756-8a8f-49d4-8f23-1f19f90b1db8 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:04.642158 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-24e29a50-86fb-458a-8374-3761a5e5f37c req-a81cc756-8a8f-49d4-8f23-1f19f90b1db8 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:04.665236 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-24e29a50-86fb-458a-8374-3761a5e5f37c req-a81cc756-8a8f-49d4-8f23-1f19f90b1db8 service nova] Creating event network-changed:a77a3d1b-554a-4133-b6bc-00f0b2a88101 for instance 8184dc7a-d6db-4374-ace1-f26377f26187 on n-h1-862769-1 Oct 27 03:34:04.672156 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-24e29a50-86fb-458a-8374-3761a5e5f37c req-a81cc756-8a8f-49d4-8f23-1f19f90b1db8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080246 Oct 27 03:34:04.676025 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1678/3136] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:34:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:34:05.007769 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-58af798e-e4f7-48ba-90aa-c2fdc5a9ef85 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:05.021089 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-58af798e-e4f7-48ba-90aa-c2fdc5a9ef85 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/8184dc7a-d6db-4374-ace1-f26377f26187" status: 200 len: 1314 microversion: 2.1 time: 0.654041 Oct 27 03:34:05.026447 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1459/3137] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:04 2022] GET /compute/v2.1/servers/8184dc7a-d6db-4374-ace1-f26377f26187 => generated 1314 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:05.246621 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f96d3674-609d-40e5-9685-d5e4cd15c14b tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:05.247702 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f96d3674-609d-40e5-9685-d5e4cd15c14b tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] [instance: f3d23d8e-a80a-425c-a0a3-9e448853a94b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:05.272013 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f96d3674-609d-40e5-9685-d5e4cd15c14b tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:05.275217 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f96d3674-609d-40e5-9685-d5e4cd15c14b tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:05.277654 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f96d3674-609d-40e5-9685-d5e4cd15c14b tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:05.282597 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f96d3674-609d-40e5-9685-d5e4cd15c14b tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:05.283202 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f96d3674-609d-40e5-9685-d5e4cd15c14b tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:05.283737 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f96d3674-609d-40e5-9685-d5e4cd15c14b tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:05.341916 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-f96d3674-609d-40e5-9685-d5e4cd15c14b tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] HTTP exception thrown: Instance f3d23d8e-a80a-425c-a0a3-9e448853a94b could not be found. Oct 27 03:34:05.364583 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f96d3674-609d-40e5-9685-d5e4cd15c14b tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Request method failure captured: Oct 27 03:34:05.364583 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/f3d23d8e-a80a-425c-a0a3-9e448853a94b HTTP/1.1 Oct 27 03:34:05.364583 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:34:05.364583 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:34:05.364583 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:34:05.364583 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:34:05.364583 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:34:05.364583 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:34:05.364583 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:34:05.364583 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:34:05.364583 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfty7iMoXX0OKMtw3NGNBL19yV0L6hiETTK-LvwAOTcUXFZpotk2WfJjGMCKsnDn3tM3JbgHvxggYNGIupU9QItCM4P_tVgLT5lP28wLDgxacZJDsClEOVTxyt_nwUagPTtLKQvv9ZuzaDBjCvkjxjA8rwRpQ1Nrc_ffXrHXW4NOn9A Oct 27 03:34:05.364583 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:34:05.364583 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:34:05.364583 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:34:05.364583 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:34:05.364583 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:34:05.364583 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:34:05.364583 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: f5ee48e200624711b629a12b20c7d282 Oct 27 03:34:05.364583 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-2107793769 Oct 27 03:34:05.364583 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:34:05.364583 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:34:05.364583 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f5ee48e200624711b629a12b20c7d282"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f5ee48e200624711b629a12b20c7d282"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f5ee48e200624711b629a12b20c7d282"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f5ee48e200624711b629a12b20c7d282"}]}] Oct 27 03:34:05.364583 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-2107793769 Oct 27 03:34:05.364583 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: f5ee48e200624711b629a12b20c7d282 Oct 27 03:34:05.364583 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-2107793769 Oct 27 03:34:05.364583 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-AttachSCSIVolumeTestJSON-2107793769-project Oct 27 03:34:05.364583 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:34:05.364583 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:34:05.364583 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: ed44bf20b3464a53a3e3f6c9cd61cde3 Oct 27 03:34:05.364583 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-2107793769-project Oct 27 03:34:05.364583 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:34:05.364583 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance f3d23d8e-a80a-425c-a0a3-9e448853a94b could not be found. Oct 27 03:34:05.364583 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': 'f3d23d8e-a80a-425c-a0a3-9e448853a94b'} Oct 27 03:34:05.364583 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:34:05.364583 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:34:05.364583 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:34:05.364583 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:34:05.364583 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:34:05.364583 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:34:05.364583 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:34:05.364583 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:34:05.364583 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:34:05.364583 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:34:05.364583 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3d23d8e-a80a-425c-a0a3-9e448853a94b could not be found. Oct 27 03:34:05.364583 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:34:05.364583 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:34:05.364583 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:34:05.364583 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:34:05.364583 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:34:05.364583 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:34:05.364583 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:34:05.364583 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:34:05.364583 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:34:05.364583 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:34:05.364583 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:34:05.364583 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:34:05.364583 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:34:05.364583 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:34:05.364583 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:34:05.364583 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:34:05.364583 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3d23d8e-a80a-425c-a0a3-9e448853a94b could not be found. Oct 27 03:34:05.364583 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:34:05.364583 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:34:05.364583 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:34:05.370858 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:34:05.370858 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:34:05.370858 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:34:05.370858 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:34:05.370858 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:34:05.370858 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3d23d8e-a80a-425c-a0a3-9e448853a94b could not be found. Oct 27 03:34:05.370858 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:34:05.373094 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b3839152-9c3e-4668-a024-e19d0e79aeae tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:05.373934 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b3839152-9c3e-4668-a024-e19d0e79aeae tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] [instance: 38693017-3b6f-434c-976f-a9733156a115] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:05.374913 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f96d3674-609d-40e5-9685-d5e4cd15c14b tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Returning 404 to user: Instance f3d23d8e-a80a-425c-a0a3-9e448853a94b could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:34:05.384000 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f96d3674-609d-40e5-9685-d5e4cd15c14b tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d23d8e-a80a-425c-a0a3-9e448853a94b" status: 404 len: 111 microversion: 2.1 time: 0.139224 Oct 27 03:34:05.392629 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b3839152-9c3e-4668-a024-e19d0e79aeae tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:05.393154 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b3839152-9c3e-4668-a024-e19d0e79aeae tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:05.393613 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b3839152-9c3e-4668-a024-e19d0e79aeae tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:05.394569 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b3839152-9c3e-4668-a024-e19d0e79aeae tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:05.395212 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b3839152-9c3e-4668-a024-e19d0e79aeae tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:05.395612 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1679/3138] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:05 2022] GET /compute/v2.1/servers/f3d23d8e-a80a-425c-a0a3-9e448853a94b => generated 111 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:34:05.396021 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b3839152-9c3e-4668-a024-e19d0e79aeae tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:05.413235 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1df53b4a-7c2b-4ab5-8fcb-63b37930c7e8 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Calling method '.version_select at 0x7f7dded40430>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:05.456222 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:34:05.549734 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1df53b4a-7c2b-4ab5-8fcb-63b37930c7e8 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1412192483" status: 202 len: 0 microversion: 2.1 time: 0.152445 Oct 27 03:34:05.550727 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1680/3139] 10.222.0.20 () {58 vars in 1221 bytes} [Thu Oct 27 03:34:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1412192483 => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:34:05.556974 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-8c4a1b18-52d7-40f6-9854-17f201f6e23b req-064271f5-253a-4167-b544-4a32cc00ebaf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38693017-3b6f-434c-976f-a9733156a115", "tag": "02930e69-9216-45da-b6d0-4ed8f060b164"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:34:05.570385 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-8c4a1b18-52d7-40f6-9854-17f201f6e23b req-064271f5-253a-4167-b544-4a32cc00ebaf service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:05.571256 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-8c4a1b18-52d7-40f6-9854-17f201f6e23b req-064271f5-253a-4167-b544-4a32cc00ebaf service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:05.571922 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-8c4a1b18-52d7-40f6-9854-17f201f6e23b req-064271f5-253a-4167-b544-4a32cc00ebaf service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:05.592978 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-8c4a1b18-52d7-40f6-9854-17f201f6e23b req-064271f5-253a-4167-b544-4a32cc00ebaf service nova] Creating event network-changed:02930e69-9216-45da-b6d0-4ed8f060b164 for instance 38693017-3b6f-434c-976f-a9733156a115 on n-h2-862769-1 Oct 27 03:34:05.599231 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-8c4a1b18-52d7-40f6-9854-17f201f6e23b req-064271f5-253a-4167-b544-4a32cc00ebaf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047052 Oct 27 03:34:05.600165 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1681/3140] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:34:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:34:06.053803 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d12f184c-a32c-4af2-87f5-d250cb842e6f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:06.054905 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d12f184c-a32c-4af2-87f5-d250cb842e6f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: 8184dc7a-d6db-4374-ace1-f26377f26187] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:06.062423 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:34:06.073384 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d12f184c-a32c-4af2-87f5-d250cb842e6f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:06.075181 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d12f184c-a32c-4af2-87f5-d250cb842e6f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:06.075839 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d12f184c-a32c-4af2-87f5-d250cb842e6f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:06.076976 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d12f184c-a32c-4af2-87f5-d250cb842e6f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:06.078802 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d12f184c-a32c-4af2-87f5-d250cb842e6f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:06.079476 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d12f184c-a32c-4af2-87f5-d250cb842e6f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:06.150819 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b3839152-9c3e-4668-a024-e19d0e79aeae tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881f054c84d04ceaa17a5817816022d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2057593072c14804ab70fe4bdea2c17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:06.169005 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b3839152-9c3e-4668-a024-e19d0e79aeae tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] 10.222.0.20 "GET /compute/v2.1/servers/38693017-3b6f-434c-976f-a9733156a115" status: 200 len: 1354 microversion: 2.1 time: 0.814189 Oct 27 03:34:06.170817 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1460/3141] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:05 2022] GET /compute/v2.1/servers/38693017-3b6f-434c-976f-a9733156a115 => generated 1354 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:07.200595 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-32eae5cf-6b0c-47b8-bb97-88417e84c1d6 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:07.201941 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-32eae5cf-6b0c-47b8-bb97-88417e84c1d6 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] [instance: 38693017-3b6f-434c-976f-a9733156a115] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:07.222576 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-32eae5cf-6b0c-47b8-bb97-88417e84c1d6 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:07.223921 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-32eae5cf-6b0c-47b8-bb97-88417e84c1d6 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:07.224465 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-32eae5cf-6b0c-47b8-bb97-88417e84c1d6 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:07.225652 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-32eae5cf-6b0c-47b8-bb97-88417e84c1d6 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:07.230941 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-32eae5cf-6b0c-47b8-bb97-88417e84c1d6 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:07.231437 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-32eae5cf-6b0c-47b8-bb97-88417e84c1d6 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:07.235284 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:34:07.775061 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d12f184c-a32c-4af2-87f5-d250cb842e6f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:07.784425 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d12f184c-a32c-4af2-87f5-d250cb842e6f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/8184dc7a-d6db-4374-ace1-f26377f26187" status: 200 len: 1314 microversion: 2.1 time: 1.736289 Oct 27 03:34:07.785012 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1682/3142] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:06 2022] GET /compute/v2.1/servers/8184dc7a-d6db-4374-ace1-f26377f26187 => generated 1314 bytes in 1738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:34:07.951910 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-32eae5cf-6b0c-47b8-bb97-88417e84c1d6 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881f054c84d04ceaa17a5817816022d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2057593072c14804ab70fe4bdea2c17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:07.960747 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-32eae5cf-6b0c-47b8-bb97-88417e84c1d6 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] 10.222.0.20 "GET /compute/v2.1/servers/38693017-3b6f-434c-976f-a9733156a115" status: 200 len: 1354 microversion: 2.1 time: 0.764072 Oct 27 03:34:07.982183 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1461/3143] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:07 2022] GET /compute/v2.1/servers/38693017-3b6f-434c-976f-a9733156a115 => generated 1354 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:08.485939 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-08d1393b-3593-4780-8f1b-fb15cc12a75c req-93e4a4c6-4128-4865-9791-8289575dfa49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38693017-3b6f-434c-976f-a9733156a115", "tag": "b1d5b054-3345-4a5e-a5cd-e36b2aad8574"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:34:08.534219 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-08d1393b-3593-4780-8f1b-fb15cc12a75c req-93e4a4c6-4128-4865-9791-8289575dfa49 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:08.535189 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-08d1393b-3593-4780-8f1b-fb15cc12a75c req-93e4a4c6-4128-4865-9791-8289575dfa49 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:08.535673 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-08d1393b-3593-4780-8f1b-fb15cc12a75c req-93e4a4c6-4128-4865-9791-8289575dfa49 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:08.568614 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-08d1393b-3593-4780-8f1b-fb15cc12a75c req-93e4a4c6-4128-4865-9791-8289575dfa49 service nova] Creating event network-changed:b1d5b054-3345-4a5e-a5cd-e36b2aad8574 for instance 38693017-3b6f-434c-976f-a9733156a115 on n-h2-862769-1 Oct 27 03:34:08.583493 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-08d1393b-3593-4780-8f1b-fb15cc12a75c req-93e4a4c6-4128-4865-9791-8289575dfa49 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106928 Oct 27 03:34:08.584146 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1683/3144] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:34:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:34:08.812394 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5193b209-2e7c-48eb-a3ac-b96c0ac440e5 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:08.813186 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5193b209-2e7c-48eb-a3ac-b96c0ac440e5 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: 8184dc7a-d6db-4374-ace1-f26377f26187] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:08.834283 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5193b209-2e7c-48eb-a3ac-b96c0ac440e5 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:08.844434 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5193b209-2e7c-48eb-a3ac-b96c0ac440e5 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:08.845187 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5193b209-2e7c-48eb-a3ac-b96c0ac440e5 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:08.846745 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5193b209-2e7c-48eb-a3ac-b96c0ac440e5 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:08.847583 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5193b209-2e7c-48eb-a3ac-b96c0ac440e5 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:08.848277 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5193b209-2e7c-48eb-a3ac-b96c0ac440e5 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:08.992044 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-eae4dd5d-5d2b-40c1-b1bc-cc04564f137f tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:08.993701 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-eae4dd5d-5d2b-40c1-b1bc-cc04564f137f tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] [instance: 38693017-3b6f-434c-976f-a9733156a115] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:09.008724 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eae4dd5d-5d2b-40c1-b1bc-cc04564f137f tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:09.009391 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eae4dd5d-5d2b-40c1-b1bc-cc04564f137f tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:09.009942 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eae4dd5d-5d2b-40c1-b1bc-cc04564f137f tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:09.010936 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eae4dd5d-5d2b-40c1-b1bc-cc04564f137f tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:09.011596 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eae4dd5d-5d2b-40c1-b1bc-cc04564f137f tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:09.012610 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eae4dd5d-5d2b-40c1-b1bc-cc04564f137f tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:09.319854 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5193b209-2e7c-48eb-a3ac-b96c0ac440e5 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:09.329572 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5193b209-2e7c-48eb-a3ac-b96c0ac440e5 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/8184dc7a-d6db-4374-ace1-f26377f26187" status: 200 len: 1314 microversion: 2.1 time: 0.523450 Oct 27 03:34:09.332753 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1462/3145] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:08 2022] GET /compute/v2.1/servers/8184dc7a-d6db-4374-ace1-f26377f26187 => generated 1314 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:34:09.384213 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-eae4dd5d-5d2b-40c1-b1bc-cc04564f137f tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881f054c84d04ceaa17a5817816022d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2057593072c14804ab70fe4bdea2c17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:09.395433 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-eae4dd5d-5d2b-40c1-b1bc-cc04564f137f tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] 10.222.0.20 "GET /compute/v2.1/servers/38693017-3b6f-434c-976f-a9733156a115" status: 200 len: 1354 microversion: 2.1 time: 0.408517 Oct 27 03:34:09.397776 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1684/3146] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:08 2022] GET /compute/v2.1/servers/38693017-3b6f-434c-976f-a9733156a115 => generated 1354 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:34:10.361487 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a3f0d640-ddd6-4809-8c00-733a225588a7 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:10.367359 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a3f0d640-ddd6-4809-8c00-733a225588a7 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: 8184dc7a-d6db-4374-ace1-f26377f26187] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:10.384445 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a3f0d640-ddd6-4809-8c00-733a225588a7 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:10.385689 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a3f0d640-ddd6-4809-8c00-733a225588a7 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:10.386419 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a3f0d640-ddd6-4809-8c00-733a225588a7 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:10.387334 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a3f0d640-ddd6-4809-8c00-733a225588a7 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:10.388291 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a3f0d640-ddd6-4809-8c00-733a225588a7 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:10.388910 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a3f0d640-ddd6-4809-8c00-733a225588a7 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:10.438567 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-54200e21-4711-4c78-9286-99f8ecf979c2 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:10.441252 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-54200e21-4711-4c78-9286-99f8ecf979c2 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] [instance: 38693017-3b6f-434c-976f-a9733156a115] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:10.472759 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-54200e21-4711-4c78-9286-99f8ecf979c2 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:10.474521 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-54200e21-4711-4c78-9286-99f8ecf979c2 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:10.477963 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-54200e21-4711-4c78-9286-99f8ecf979c2 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:10.482429 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-54200e21-4711-4c78-9286-99f8ecf979c2 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:10.482429 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-54200e21-4711-4c78-9286-99f8ecf979c2 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:10.483432 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-54200e21-4711-4c78-9286-99f8ecf979c2 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:10.916197 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a3f0d640-ddd6-4809-8c00-733a225588a7 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:10.928718 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a3f0d640-ddd6-4809-8c00-733a225588a7 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/8184dc7a-d6db-4374-ace1-f26377f26187" status: 200 len: 1314 microversion: 2.1 time: 0.573037 Oct 27 03:34:10.931258 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1463/3147] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:10 2022] GET /compute/v2.1/servers/8184dc7a-d6db-4374-ace1-f26377f26187 => generated 1314 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:11.249555 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e6e2d2e8-9858-4ea6-8c45-e6ba8caeab46 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7dda275670>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:11.301343 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e6e2d2e8-9858-4ea6-8c45-e6ba8caeab46 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images/2261c57f-bc36-4b55-abf7-8c041551a14b" status: 200 len: 662 microversion: 2.1 time: 0.057106 Oct 27 03:34:11.311589 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1464/3148] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:34:11 2022] GET /compute/v2.1/images/2261c57f-bc36-4b55-abf7-8c041551a14b => generated 662 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:34:11.319216 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c00a8003-dd46-4557-929a-352c8951f1e8 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7dda7a2820>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:11.433403 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c00a8003-dd46-4557-929a-352c8951f1e8 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images/2261c57f-bc36-4b55-abf7-8c041551a14b" status: 200 len: 662 microversion: 2.1 time: 0.120322 Oct 27 03:34:11.434085 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1465/3149] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:34:11 2022] GET /compute/v2.1/images/2261c57f-bc36-4b55-abf7-8c041551a14b => generated 662 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:34:11.923650 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-54200e21-4711-4c78-9286-99f8ecf979c2 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881f054c84d04ceaa17a5817816022d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2057593072c14804ab70fe4bdea2c17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:11.932675 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-54200e21-4711-4c78-9286-99f8ecf979c2 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] 10.222.0.20 "GET /compute/v2.1/servers/38693017-3b6f-434c-976f-a9733156a115" status: 200 len: 1354 microversion: 2.1 time: 1.515640 Oct 27 03:34:11.939239 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1685/3150] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:10 2022] GET /compute/v2.1/servers/38693017-3b6f-434c-976f-a9733156a115 => generated 1354 bytes in 1523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:11.955508 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a062975b-067d-4bfc-bdf7-edb687fef4e5 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:11.956276 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a062975b-067d-4bfc-bdf7-edb687fef4e5 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: 8184dc7a-d6db-4374-ace1-f26377f26187] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:11.965177 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a062975b-067d-4bfc-bdf7-edb687fef4e5 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:11.971131 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a062975b-067d-4bfc-bdf7-edb687fef4e5 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:11.977830 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a062975b-067d-4bfc-bdf7-edb687fef4e5 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:11.979349 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a062975b-067d-4bfc-bdf7-edb687fef4e5 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:11.981620 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a062975b-067d-4bfc-bdf7-edb687fef4e5 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:11.982216 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a062975b-067d-4bfc-bdf7-edb687fef4e5 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:12.468776 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a062975b-067d-4bfc-bdf7-edb687fef4e5 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:12.480323 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a062975b-067d-4bfc-bdf7-edb687fef4e5 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/8184dc7a-d6db-4374-ace1-f26377f26187" status: 200 len: 1314 microversion: 2.1 time: 0.529412 Oct 27 03:34:12.480940 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1466/3151] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:11 2022] GET /compute/v2.1/servers/8184dc7a-d6db-4374-ace1-f26377f26187 => generated 1314 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:12.977856 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-670a933e-68f9-4549-85de-fb182c82e5b9 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:12.978667 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-670a933e-68f9-4549-85de-fb182c82e5b9 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] [instance: 38693017-3b6f-434c-976f-a9733156a115] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:12.996575 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-670a933e-68f9-4549-85de-fb182c82e5b9 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:12.997492 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-670a933e-68f9-4549-85de-fb182c82e5b9 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:13.001689 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-670a933e-68f9-4549-85de-fb182c82e5b9 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:13.002406 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-670a933e-68f9-4549-85de-fb182c82e5b9 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:13.006028 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-670a933e-68f9-4549-85de-fb182c82e5b9 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:13.006883 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-670a933e-68f9-4549-85de-fb182c82e5b9 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:13.294809 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-670a933e-68f9-4549-85de-fb182c82e5b9 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881f054c84d04ceaa17a5817816022d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2057593072c14804ab70fe4bdea2c17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:13.308688 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-670a933e-68f9-4549-85de-fb182c82e5b9 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] 10.222.0.20 "GET /compute/v2.1/servers/38693017-3b6f-434c-976f-a9733156a115" status: 200 len: 1354 microversion: 2.1 time: 0.343951 Oct 27 03:34:13.333922 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1686/3152] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:12 2022] GET /compute/v2.1/servers/38693017-3b6f-434c-976f-a9733156a115 => generated 1354 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:13.503875 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3c820e54-29e3-4d25-8cef-ac5cab042f05 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:13.505076 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3c820e54-29e3-4d25-8cef-ac5cab042f05 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: 8184dc7a-d6db-4374-ace1-f26377f26187] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:13.520008 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3c820e54-29e3-4d25-8cef-ac5cab042f05 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:13.520519 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3c820e54-29e3-4d25-8cef-ac5cab042f05 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:13.524580 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3c820e54-29e3-4d25-8cef-ac5cab042f05 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:13.525421 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3c820e54-29e3-4d25-8cef-ac5cab042f05 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:13.525904 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3c820e54-29e3-4d25-8cef-ac5cab042f05 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:13.526376 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3c820e54-29e3-4d25-8cef-ac5cab042f05 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:13.805574 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a1c0eec3-af1f-4754-b6d6-caa7eb0fc582 tempest-SecurityGroupRulesTestJSON-368356497 tempest-SecurityGroupRulesTestJSON-368356497-project] Action: 'create', calling method: .version_select at 0x7f7ddecc1af0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-211215685", "description": "tempest-description-1434059531"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:34:14.049794 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3c820e54-29e3-4d25-8cef-ac5cab042f05 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:14.055972 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3c820e54-29e3-4d25-8cef-ac5cab042f05 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/8184dc7a-d6db-4374-ace1-f26377f26187" status: 200 len: 1314 microversion: 2.1 time: 0.556063 Oct 27 03:34:14.060209 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1687/3153] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:13 2022] GET /compute/v2.1/servers/8184dc7a-d6db-4374-ace1-f26377f26187 => generated 1314 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:34:14.078955 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-45f3bf7c-c01f-448c-b9cc-6d225520293b tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7ddec28160>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:14.173534 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-45f3bf7c-c01f-448c-b9cc-6d225520293b tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images/47c7e3fd-1e67-44a9-a6bc-bfb91826cc73" status: 200 len: 661 microversion: 2.1 time: 0.101745 Oct 27 03:34:14.173534 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1688/3154] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:34:14 2022] GET /compute/v2.1/images/47c7e3fd-1e67-44a9-a6bc-bfb91826cc73 => generated 661 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:34:14.180181 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-cc691d02-12af-4024-a344-63eb5368879c tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7ddecea9d0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:14.342300 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-cc691d02-12af-4024-a344-63eb5368879c tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images/47c7e3fd-1e67-44a9-a6bc-bfb91826cc73" status: 200 len: 661 microversion: 2.1 time: 0.155475 Oct 27 03:34:14.353496 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1689/3155] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:34:14 2022] GET /compute/v2.1/images/47c7e3fd-1e67-44a9-a6bc-bfb91826cc73 => generated 661 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:34:14.374249 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-61d98a09-28f4-4f01-bc05-1ea41578fb29 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:14.379695 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-61d98a09-28f4-4f01-bc05-1ea41578fb29 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] [instance: 38693017-3b6f-434c-976f-a9733156a115] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:14.408565 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-61d98a09-28f4-4f01-bc05-1ea41578fb29 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:14.412950 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-61d98a09-28f4-4f01-bc05-1ea41578fb29 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:14.415279 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-61d98a09-28f4-4f01-bc05-1ea41578fb29 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:14.419940 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-61d98a09-28f4-4f01-bc05-1ea41578fb29 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:14.430475 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-61d98a09-28f4-4f01-bc05-1ea41578fb29 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:14.435483 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-61d98a09-28f4-4f01-bc05-1ea41578fb29 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:14.650759 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a1c0eec3-af1f-4754-b6d6-caa7eb0fc582 tempest-SecurityGroupRulesTestJSON-368356497 tempest-SecurityGroupRulesTestJSON-368356497-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.322927 Oct 27 03:34:14.651391 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1467/3156] 10.222.0.20 () {60 vars in 1180 bytes} [Thu Oct 27 03:34:13 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:34:14.666230 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-96225941-ce32-4cc1-95e0-d8eca619f14d tempest-SecurityGroupRulesTestJSON-368356497 tempest-SecurityGroupRulesTestJSON-368356497-project] Action: 'create', calling method: .version_select at 0x7f7dd9d9e430>, body: {"security_group_rule": {"parent_group_id": "f5aeb47e-db8a-48f6-ab49-12b2e5bff490", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:34:15.070083 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-61d98a09-28f4-4f01-bc05-1ea41578fb29 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881f054c84d04ceaa17a5817816022d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2057593072c14804ab70fe4bdea2c17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:15.081705 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-61d98a09-28f4-4f01-bc05-1ea41578fb29 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] 10.222.0.20 "GET /compute/v2.1/servers/38693017-3b6f-434c-976f-a9733156a115" status: 200 len: 1354 microversion: 2.1 time: 0.733514 Oct 27 03:34:15.082531 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1690/3157] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:14 2022] GET /compute/v2.1/servers/38693017-3b6f-434c-976f-a9733156a115 => generated 1354 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:15.097083 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-13022402-d186-4414-a278-07a3fc910ef9 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:15.097716 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-13022402-d186-4414-a278-07a3fc910ef9 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: 8184dc7a-d6db-4374-ace1-f26377f26187] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:15.122148 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-13022402-d186-4414-a278-07a3fc910ef9 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:15.122148 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-13022402-d186-4414-a278-07a3fc910ef9 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:15.122148 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-13022402-d186-4414-a278-07a3fc910ef9 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:15.122148 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-13022402-d186-4414-a278-07a3fc910ef9 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:15.122148 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-13022402-d186-4414-a278-07a3fc910ef9 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:15.125204 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-13022402-d186-4414-a278-07a3fc910ef9 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:15.419299 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-13022402-d186-4414-a278-07a3fc910ef9 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:15.429429 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-13022402-d186-4414-a278-07a3fc910ef9 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/8184dc7a-d6db-4374-ace1-f26377f26187" status: 200 len: 1314 microversion: 2.1 time: 0.345819 Oct 27 03:34:15.430260 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1691/3158] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:15 2022] GET /compute/v2.1/servers/8184dc7a-d6db-4374-ace1-f26377f26187 => generated 1314 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:15.693838 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-96225941-ce32-4cc1-95e0-d8eca619f14d tempest-SecurityGroupRulesTestJSON-368356497 tempest-SecurityGroupRulesTestJSON-368356497-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.031059 Oct 27 03:34:15.697716 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1468/3159] 10.222.0.20 () {60 vars in 1195 bytes} [Thu Oct 27 03:34:14 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:34:15.709361 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1a1548aa-f51a-4bb0-88d9-03c029d2d7c9 tempest-SecurityGroupRulesTestJSON-368356497 tempest-SecurityGroupRulesTestJSON-368356497-project] Action: 'create', calling method: .version_select at 0x7f7dded48430>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1704881109", "description": "tempest-description-674509971"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:34:16.105191 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5241da7d-91f7-424c-b7b8-614a6d37b8c1 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:16.105826 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5241da7d-91f7-424c-b7b8-614a6d37b8c1 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] [instance: 38693017-3b6f-434c-976f-a9733156a115] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:16.123919 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5241da7d-91f7-424c-b7b8-614a6d37b8c1 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:16.124432 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5241da7d-91f7-424c-b7b8-614a6d37b8c1 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:16.124891 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5241da7d-91f7-424c-b7b8-614a6d37b8c1 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:16.125656 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5241da7d-91f7-424c-b7b8-614a6d37b8c1 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:16.126149 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5241da7d-91f7-424c-b7b8-614a6d37b8c1 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:16.126584 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5241da7d-91f7-424c-b7b8-614a6d37b8c1 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:16.629822 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1a1548aa-f51a-4bb0-88d9-03c029d2d7c9 tempest-SecurityGroupRulesTestJSON-368356497 tempest-SecurityGroupRulesTestJSON-368356497-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.924770 Oct 27 03:34:16.631533 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1692/3160] 10.222.0.20 () {60 vars in 1180 bytes} [Thu Oct 27 03:34:15 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:34:16.636749 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-57acc002-e548-4a5a-aceb-d9481eb2a5b5 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:16.637763 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-57acc002-e548-4a5a-aceb-d9481eb2a5b5 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: 8184dc7a-d6db-4374-ace1-f26377f26187] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:16.656018 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-57acc002-e548-4a5a-aceb-d9481eb2a5b5 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:16.659843 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-57acc002-e548-4a5a-aceb-d9481eb2a5b5 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:16.660580 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-57acc002-e548-4a5a-aceb-d9481eb2a5b5 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:16.662338 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-57acc002-e548-4a5a-aceb-d9481eb2a5b5 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:16.663293 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-57acc002-e548-4a5a-aceb-d9481eb2a5b5 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:16.665066 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-57acc002-e548-4a5a-aceb-d9481eb2a5b5 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:16.865282 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5241da7d-91f7-424c-b7b8-614a6d37b8c1 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881f054c84d04ceaa17a5817816022d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2057593072c14804ab70fe4bdea2c17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:16.876350 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5241da7d-91f7-424c-b7b8-614a6d37b8c1 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] 10.222.0.20 "GET /compute/v2.1/servers/38693017-3b6f-434c-976f-a9733156a115" status: 200 len: 1354 microversion: 2.1 time: 0.771067 Oct 27 03:34:16.881303 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1469/3161] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:16 2022] GET /compute/v2.1/servers/38693017-3b6f-434c-976f-a9733156a115 => generated 1354 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:34:16.897562 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d33cb3d1-88df-48a0-9d3f-edcf01c19aef tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7dd9dd73a0>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:16.998839 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d33cb3d1-88df-48a0-9d3f-edcf01c19aef tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images/b7eaf408-cb44-41a2-b999-ceba1600304d" status: 200 len: 662 microversion: 2.1 time: 0.116038 Oct 27 03:34:17.011768 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1470/3162] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:34:16 2022] GET /compute/v2.1/images/b7eaf408-cb44-41a2-b999-ceba1600304d => generated 662 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:34:17.028538 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9089ba34-be5d-49ba-a71c-baf63e315774 tempest-SecurityGroupRulesTestJSON-368356497 tempest-SecurityGroupRulesTestJSON-368356497-project] Action: 'create', calling method: .version_select at 0x7f7ddee4cb80>, body: {"security_group_rule": {"parent_group_id": "50635a2c-5963-4fbc-ba2a-2cbc95080281", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:34:17.254793 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-57acc002-e548-4a5a-aceb-d9481eb2a5b5 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:17.264962 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-57acc002-e548-4a5a-aceb-d9481eb2a5b5 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/8184dc7a-d6db-4374-ace1-f26377f26187" status: 200 len: 1314 microversion: 2.1 time: 0.631985 Oct 27 03:34:17.265730 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1693/3163] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:16 2022] GET /compute/v2.1/servers/8184dc7a-d6db-4374-ace1-f26377f26187 => generated 1314 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:17.280707 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ccd35669-137e-4c39-960c-369bd364251c tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7ddac9d9d0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:17.406023 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ccd35669-137e-4c39-960c-369bd364251c tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images/b7eaf408-cb44-41a2-b999-ceba1600304d" status: 200 len: 662 microversion: 2.1 time: 0.136519 Oct 27 03:34:17.426205 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1694/3164] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:34:17 2022] GET /compute/v2.1/images/b7eaf408-cb44-41a2-b999-ceba1600304d => generated 662 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:34:17.553541 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1c917e98-0d53-4f99-b609-8cd3d21b2b20 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-470548780", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": [{"uuid": "3e243dad-2440-4c27-8cb3-49b848becdd2"}]}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:34:17.667128 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.network.neutron [None req-1c917e98-0d53-4f99-b609-8cd3d21b2b20 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] validate_networks() for [('3e243dad-2440-4c27-8cb3-49b848becdd2', None, None, None, None, None)] {{(pid=121001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:34:18.214250 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9089ba34-be5d-49ba-a71c-baf63e315774 tempest-SecurityGroupRulesTestJSON-368356497 tempest-SecurityGroupRulesTestJSON-368356497-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 1.200442 Oct 27 03:34:18.215847 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1471/3165] 10.222.0.20 () {60 vars in 1195 bytes} [Thu Oct 27 03:34:17 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:34:18.237710 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-cbf9f14f-cb82-4d57-bc6f-09d3eb0a1a9c tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1521358598", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:34:18.332683 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-cbf9f14f-cb82-4d57-bc6f-09d3eb0a1a9c tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] validate_networks() for None {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:34:18.441286 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-1c917e98-0d53-4f99-b609-8cd3d21b2b20 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Flavor limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:34:18.441760 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-1c917e98-0d53-4f99-b609-8cd3d21b2b20 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Image limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:34:18.442336 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-1c917e98-0d53-4f99-b609-8cd3d21b2b20 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Flavor pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:34:18.442763 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-1c917e98-0d53-4f99-b609-8cd3d21b2b20 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Image pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:34:18.443196 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-1c917e98-0d53-4f99-b609-8cd3d21b2b20 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:34:18.468878 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1c917e98-0d53-4f99-b609-8cd3d21b2b20 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:18.472815 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1c917e98-0d53-4f99-b609-8cd3d21b2b20 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:18.473832 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1c917e98-0d53-4f99-b609-8cd3d21b2b20 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:18.475103 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1c917e98-0d53-4f99-b609-8cd3d21b2b20 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:18.475828 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1c917e98-0d53-4f99-b609-8cd3d21b2b20 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:18.477042 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1c917e98-0d53-4f99-b609-8cd3d21b2b20 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:18.500767 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-1c917e98-0d53-4f99-b609-8cd3d21b2b20 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Getting quotas for project dbbc26f2331d47e5863e8dbf1952906c. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:34:18.507201 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-1c917e98-0d53-4f99-b609-8cd3d21b2b20 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Getting quotas for user fcff40b520f749f2b4bca5eed0923504 and project dbbc26f2331d47e5863e8dbf1952906c. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:34:18.534929 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1c917e98-0d53-4f99-b609-8cd3d21b2b20 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Going to run 1 instances... {{(pid=121001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:34:18.538600 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1c917e98-0d53-4f99-b609-8cd3d21b2b20 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] [instance: 53d360ec-9026-453d-a4a5-39a5f684b2c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:34:18.692771 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1c917e98-0d53-4f99-b609-8cd3d21b2b20 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.265305 Oct 27 03:34:18.694252 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1695/3166] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:34:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1267 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 03:34:18.708320 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6d2d1447-2b9c-4f85-b0fe-96456dd9345a tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:18.710138 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-6d2d1447-2b9c-4f85-b0fe-96456dd9345a tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] [instance: 38693017-3b6f-434c-976f-a9733156a115] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:18.717667 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6d2d1447-2b9c-4f85-b0fe-96456dd9345a tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:18.718876 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6d2d1447-2b9c-4f85-b0fe-96456dd9345a tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:18.719587 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6d2d1447-2b9c-4f85-b0fe-96456dd9345a tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:18.720538 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6d2d1447-2b9c-4f85-b0fe-96456dd9345a tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:18.721256 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6d2d1447-2b9c-4f85-b0fe-96456dd9345a tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:18.721927 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6d2d1447-2b9c-4f85-b0fe-96456dd9345a tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:18.782509 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=100 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:34:18.959878 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6d2d1447-2b9c-4f85-b0fe-96456dd9345a tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881f054c84d04ceaa17a5817816022d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2057593072c14804ab70fe4bdea2c17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:18.969378 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6d2d1447-2b9c-4f85-b0fe-96456dd9345a tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] 10.222.0.20 "GET /compute/v2.1/servers/38693017-3b6f-434c-976f-a9733156a115" status: 200 len: 1354 microversion: 2.1 time: 0.266690 Oct 27 03:34:18.971094 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1696/3167] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:18 2022] GET /compute/v2.1/servers/38693017-3b6f-434c-976f-a9733156a115 => generated 1354 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:18.976752 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-4f8af143-24fa-45b5-9e16-77002f419702 req-35e7d6d3-d850-474b-8374-01d3de968be9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8184dc7a-d6db-4374-ace1-f26377f26187", "name": "network-vif-plugged", "status": "completed", "tag": "a77a3d1b-554a-4133-b6bc-00f0b2a88101"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:34:18.983001 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-cbf9f14f-cb82-4d57-bc6f-09d3eb0a1a9c tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:34:18.987148 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-cbf9f14f-cb82-4d57-bc6f-09d3eb0a1a9c tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:34:18.987148 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-cbf9f14f-cb82-4d57-bc6f-09d3eb0a1a9c tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:34:18.987148 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-cbf9f14f-cb82-4d57-bc6f-09d3eb0a1a9c tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:34:18.987148 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-cbf9f14f-cb82-4d57-bc6f-09d3eb0a1a9c tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:34:18.989507 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-4f8af143-24fa-45b5-9e16-77002f419702 req-35e7d6d3-d850-474b-8374-01d3de968be9 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:18.990529 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-4f8af143-24fa-45b5-9e16-77002f419702 req-35e7d6d3-d850-474b-8374-01d3de968be9 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:18.991284 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-4f8af143-24fa-45b5-9e16-77002f419702 req-35e7d6d3-d850-474b-8374-01d3de968be9 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:19.011121 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-4f8af143-24fa-45b5-9e16-77002f419702 req-35e7d6d3-d850-474b-8374-01d3de968be9 service nova] Creating event network-vif-plugged:a77a3d1b-554a-4133-b6bc-00f0b2a88101 for instance 8184dc7a-d6db-4374-ace1-f26377f26187 on n-h1-862769-1 Oct 27 03:34:19.033389 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cbf9f14f-cb82-4d57-bc6f-09d3eb0a1a9c tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:19.033389 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cbf9f14f-cb82-4d57-bc6f-09d3eb0a1a9c tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:19.033389 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cbf9f14f-cb82-4d57-bc6f-09d3eb0a1a9c tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:19.033389 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cbf9f14f-cb82-4d57-bc6f-09d3eb0a1a9c tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:19.033389 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cbf9f14f-cb82-4d57-bc6f-09d3eb0a1a9c tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:19.033389 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cbf9f14f-cb82-4d57-bc6f-09d3eb0a1a9c tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:19.034715 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-4f8af143-24fa-45b5-9e16-77002f419702 req-35e7d6d3-d850-474b-8374-01d3de968be9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055628 Oct 27 03:34:19.034715 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1697/3168] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:34:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:34:19.049396 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c2676ba2-a575-4aa2-a808-79dc0816b72d tempest-SecurityGroupRulesTestJSON-368356497 tempest-SecurityGroupRulesTestJSON-368356497-project] Action: 'create', calling method: .version_select at 0x7f7ddecea5e0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-61417570", "description": "tempest-description-873987625"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:34:19.129465 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-cbf9f14f-cb82-4d57-bc6f-09d3eb0a1a9c tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Getting quotas for project 98d371ab6648425eac2cf1702f2789dc. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:34:19.140556 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-cbf9f14f-cb82-4d57-bc6f-09d3eb0a1a9c tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Getting quotas for user ae7845f6759c4dcabcc1516a72484174 and project 98d371ab6648425eac2cf1702f2789dc. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:34:19.183648 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-cbf9f14f-cb82-4d57-bc6f-09d3eb0a1a9c tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:34:19.189823 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-cbf9f14f-cb82-4d57-bc6f-09d3eb0a1a9c tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] [instance: f50da5a9-2bb6-4735-93c3-d73ece0964f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:34:19.378849 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-cbf9f14f-cb82-4d57-bc6f-09d3eb0a1a9c tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.161737 Oct 27 03:34:19.387078 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1472/3169] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:34:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1170 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 03:34:19.403528 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-852a96fc-4049-4b60-9c63-14847965c412 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:19.405080 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-852a96fc-4049-4b60-9c63-14847965c412 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: 8184dc7a-d6db-4374-ace1-f26377f26187] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:19.418246 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-852a96fc-4049-4b60-9c63-14847965c412 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:19.418691 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-852a96fc-4049-4b60-9c63-14847965c412 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:19.419145 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-852a96fc-4049-4b60-9c63-14847965c412 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:19.419878 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-852a96fc-4049-4b60-9c63-14847965c412 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:19.428432 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-852a96fc-4049-4b60-9c63-14847965c412 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:19.429808 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-852a96fc-4049-4b60-9c63-14847965c412 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:19.577159 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c2676ba2-a575-4aa2-a808-79dc0816b72d tempest-SecurityGroupRulesTestJSON-368356497 tempest-SecurityGroupRulesTestJSON-368356497-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 245 microversion: 2.1 time: 0.541641 Oct 27 03:34:19.587512 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1698/3170] 10.222.0.20 () {60 vars in 1180 bytes} [Thu Oct 27 03:34:19 2022] POST /compute/v2.1/os-security-groups => generated 245 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:34:19.593051 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7a952d19-183b-4cc5-8a19-be322925b7b3 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:19.595324 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7a952d19-183b-4cc5-8a19-be322925b7b3 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] [instance: 53d360ec-9026-453d-a4a5-39a5f684b2c3] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:19.789443 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7a952d19-183b-4cc5-8a19-be322925b7b3 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcff40b520f749f2b4bca5eed0923504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbc26f2331d47e5863e8dbf1952906c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:19.799142 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7a952d19-183b-4cc5-8a19-be322925b7b3 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] 10.222.0.20 "GET /compute/v2.1/servers/53d360ec-9026-453d-a4a5-39a5f684b2c3" status: 200 len: 1215 microversion: 2.1 time: 0.208106 Oct 27 03:34:19.799142 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1699/3171] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:19 2022] GET /compute/v2.1/servers/53d360ec-9026-453d-a4a5-39a5f684b2c3 => generated 1215 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:19.832621 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2c976624-9aa8-4a00-9973-315171ada0b2 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1299065021", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:34:19.988380 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.network.neutron [None req-2c976624-9aa8-4a00-9973-315171ada0b2 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] validate_networks() for None {{(pid=121001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:34:20.367497 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-852a96fc-4049-4b60-9c63-14847965c412 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:20.384628 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-852a96fc-4049-4b60-9c63-14847965c412 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/8184dc7a-d6db-4374-ace1-f26377f26187" status: 200 len: 1314 microversion: 2.1 time: 0.994050 Oct 27 03:34:20.387186 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1473/3172] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:19 2022] GET /compute/v2.1/servers/8184dc7a-d6db-4374-ace1-f26377f26187 => generated 1314 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:20.403678 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e1350ae0-0851-4efd-84b9-0c1bfccc78d1 tempest-SecurityGroupRulesTestJSON-368356497 tempest-SecurityGroupRulesTestJSON-368356497-project] Action: 'create', calling method: .version_select at 0x7f7dda97e700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1596645", "description": "tempest-description-874265653"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:34:20.461160 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-2c976624-9aa8-4a00-9973-315171ada0b2 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Flavor limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:34:20.462663 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-2c976624-9aa8-4a00-9973-315171ada0b2 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Image limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:34:20.462663 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-2c976624-9aa8-4a00-9973-315171ada0b2 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Flavor pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:34:20.463250 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-2c976624-9aa8-4a00-9973-315171ada0b2 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Image pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:34:20.463683 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-2c976624-9aa8-4a00-9973-315171ada0b2 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:34:20.474664 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2c976624-9aa8-4a00-9973-315171ada0b2 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:20.475393 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2c976624-9aa8-4a00-9973-315171ada0b2 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:20.475996 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2c976624-9aa8-4a00-9973-315171ada0b2 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:20.476893 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2c976624-9aa8-4a00-9973-315171ada0b2 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:20.477718 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2c976624-9aa8-4a00-9973-315171ada0b2 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:20.478337 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2c976624-9aa8-4a00-9973-315171ada0b2 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:20.508340 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-2c976624-9aa8-4a00-9973-315171ada0b2 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Getting quotas for project 98d371ab6648425eac2cf1702f2789dc. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:34:20.512411 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-2c976624-9aa8-4a00-9973-315171ada0b2 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Getting quotas for user ae7845f6759c4dcabcc1516a72484174 and project 98d371ab6648425eac2cf1702f2789dc. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:34:20.526288 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2c976624-9aa8-4a00-9973-315171ada0b2 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Going to run 1 instances... {{(pid=121001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:34:20.534227 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2c976624-9aa8-4a00-9973-315171ada0b2 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] [instance: 004575c6-51ce-48d9-b7a6-d50f9afdb0a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:34:20.782388 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2c976624-9aa8-4a00-9973-315171ada0b2 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.966372 Oct 27 03:34:20.783442 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1700/3173] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:34:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 985 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 03:34:20.810193 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f7c76dba-30ac-46c3-9e08-5b4ad5fafa9e tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:20.813997 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f7c76dba-30ac-46c3-9e08-5b4ad5fafa9e tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] [instance: 38693017-3b6f-434c-976f-a9733156a115] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:20.825451 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f7c76dba-30ac-46c3-9e08-5b4ad5fafa9e tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:20.825451 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f7c76dba-30ac-46c3-9e08-5b4ad5fafa9e tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:20.825451 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f7c76dba-30ac-46c3-9e08-5b4ad5fafa9e tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:20.826646 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f7c76dba-30ac-46c3-9e08-5b4ad5fafa9e tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:20.827900 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f7c76dba-30ac-46c3-9e08-5b4ad5fafa9e tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:20.830067 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f7c76dba-30ac-46c3-9e08-5b4ad5fafa9e tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:21.142831 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f7c76dba-30ac-46c3-9e08-5b4ad5fafa9e tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881f054c84d04ceaa17a5817816022d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2057593072c14804ab70fe4bdea2c17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:21.154972 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f7c76dba-30ac-46c3-9e08-5b4ad5fafa9e tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] 10.222.0.20 "GET /compute/v2.1/servers/38693017-3b6f-434c-976f-a9733156a115" status: 200 len: 1354 microversion: 2.1 time: 0.369528 Oct 27 03:34:21.159741 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1701/3174] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:20 2022] GET /compute/v2.1/servers/38693017-3b6f-434c-976f-a9733156a115 => generated 1354 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:21.171426 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d745f119-12ad-4c76-9296-e5a5b8a885ba tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:21.175076 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d745f119-12ad-4c76-9296-e5a5b8a885ba tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] [instance: f3d23d8e-a80a-425c-a0a3-9e448853a94b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:21.202478 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d745f119-12ad-4c76-9296-e5a5b8a885ba tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:21.203972 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d745f119-12ad-4c76-9296-e5a5b8a885ba tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:21.208345 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d745f119-12ad-4c76-9296-e5a5b8a885ba tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:21.210294 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d745f119-12ad-4c76-9296-e5a5b8a885ba tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:21.210998 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d745f119-12ad-4c76-9296-e5a5b8a885ba tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:21.213675 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d745f119-12ad-4c76-9296-e5a5b8a885ba tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:21.252923 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-d745f119-12ad-4c76-9296-e5a5b8a885ba tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] HTTP exception thrown: Instance f3d23d8e-a80a-425c-a0a3-9e448853a94b could not be found. Oct 27 03:34:21.255600 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d745f119-12ad-4c76-9296-e5a5b8a885ba tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Request method failure captured: Oct 27 03:34:21.255600 n-d-862769-1 devstack@n-api.service[121001]: request: DELETE /compute/v2.1/servers/f3d23d8e-a80a-425c-a0a3-9e448853a94b HTTP/1.1 Oct 27 03:34:21.255600 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:34:21.255600 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:34:21.255600 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:34:21.255600 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:34:21.255600 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:34:21.255600 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:34:21.255600 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:34:21.255600 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:34:21.255600 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfty7iMoXX0OKMtw3NGNBL19yV0L6hiETTK-LvwAOTcUXFZpotk2WfJjGMCKsnDn3tM3JbgHvxggYNGIupU9QItCM4P_tVgLT5lP28wLDgxacZJDsClEOVTxyt_nwUagPTtLKQvv9ZuzaDBjCvkjxjA8rwRpQ1Nrc_ffXrHXW4NOn9A Oct 27 03:34:21.255600 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:34:21.255600 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:34:21.255600 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:34:21.255600 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:34:21.255600 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:34:21.255600 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:34:21.255600 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: f5ee48e200624711b629a12b20c7d282 Oct 27 03:34:21.255600 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-2107793769 Oct 27 03:34:21.255600 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:34:21.255600 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:34:21.255600 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f5ee48e200624711b629a12b20c7d282"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f5ee48e200624711b629a12b20c7d282"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f5ee48e200624711b629a12b20c7d282"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f5ee48e200624711b629a12b20c7d282"}]}] Oct 27 03:34:21.255600 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-2107793769 Oct 27 03:34:21.255600 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: f5ee48e200624711b629a12b20c7d282 Oct 27 03:34:21.255600 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-2107793769 Oct 27 03:34:21.255600 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-AttachSCSIVolumeTestJSON-2107793769-project Oct 27 03:34:21.255600 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:34:21.255600 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:34:21.255600 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: ed44bf20b3464a53a3e3f6c9cd61cde3 Oct 27 03:34:21.255600 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-2107793769-project Oct 27 03:34:21.255600 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:34:21.255600 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance f3d23d8e-a80a-425c-a0a3-9e448853a94b could not be found. Oct 27 03:34:21.255600 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': 'f3d23d8e-a80a-425c-a0a3-9e448853a94b'} Oct 27 03:34:21.255600 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:34:21.255600 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:34:21.255600 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:34:21.255600 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:34:21.255600 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:34:21.255600 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:34:21.255600 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:34:21.255600 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:34:21.255600 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:34:21.255600 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:34:21.255600 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3d23d8e-a80a-425c-a0a3-9e448853a94b could not be found. Oct 27 03:34:21.255600 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:34:21.255600 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:34:21.255600 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:34:21.255600 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:34:21.255600 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:34:21.255600 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:34:21.255600 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:34:21.255600 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:34:21.255600 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:34:21.255600 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:34:21.255600 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 03:34:21.255600 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 03:34:21.255600 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 03:34:21.255600 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 03:34:21.255600 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:34:21.255600 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:34:21.255600 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:34:21.255600 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:34:21.267704 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3d23d8e-a80a-425c-a0a3-9e448853a94b could not be found. Oct 27 03:34:21.267704 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:34:21.267704 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:34:21.267704 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:34:21.267704 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:34:21.267704 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:34:21.267704 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:34:21.267704 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:34:21.267704 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:34:21.267704 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3d23d8e-a80a-425c-a0a3-9e448853a94b could not be found. Oct 27 03:34:21.267704 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:34:21.267704 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d745f119-12ad-4c76-9296-e5a5b8a885ba tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Returning 404 to user: Instance f3d23d8e-a80a-425c-a0a3-9e448853a94b could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:34:21.267704 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d745f119-12ad-4c76-9296-e5a5b8a885ba tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f3d23d8e-a80a-425c-a0a3-9e448853a94b" status: 404 len: 111 microversion: 2.1 time: 0.099485 Oct 27 03:34:21.270398 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1702/3175] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:34:21 2022] DELETE /compute/v2.1/servers/f3d23d8e-a80a-425c-a0a3-9e448853a94b => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:34:21.282022 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e99f1a0d-a497-4b92-9f02-b58f7ed26364 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:21.285922 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e99f1a0d-a497-4b92-9f02-b58f7ed26364 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] [instance: 004575c6-51ce-48d9-b7a6-d50f9afdb0a0] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:21.291656 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e1350ae0-0851-4efd-84b9-0c1bfccc78d1 tempest-SecurityGroupRulesTestJSON-368356497 tempest-SecurityGroupRulesTestJSON-368356497-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.901867 Oct 27 03:34:21.293019 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1474/3176] 10.222.0.20 () {60 vars in 1180 bytes} [Thu Oct 27 03:34:20 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:34:21.305272 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b536b27c-e412-4f33-bc70-2a05b57a9ace tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:21.313639 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b536b27c-e412-4f33-bc70-2a05b57a9ace tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] [instance: 53d360ec-9026-453d-a4a5-39a5f684b2c3] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:21.313639 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:34:21.329663 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b536b27c-e412-4f33-bc70-2a05b57a9ace tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:21.332962 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b536b27c-e412-4f33-bc70-2a05b57a9ace tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:21.333524 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b536b27c-e412-4f33-bc70-2a05b57a9ace tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:21.334597 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b536b27c-e412-4f33-bc70-2a05b57a9ace tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:21.336406 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b536b27c-e412-4f33-bc70-2a05b57a9ace tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:21.337812 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b536b27c-e412-4f33-bc70-2a05b57a9ace tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:21.417003 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e99f1a0d-a497-4b92-9f02-b58f7ed26364 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae7845f6759c4dcabcc1516a72484174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d371ab6648425eac2cf1702f2789dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:21.426872 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e99f1a0d-a497-4b92-9f02-b58f7ed26364 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/servers/004575c6-51ce-48d9-b7a6-d50f9afdb0a0" status: 200 len: 1218 microversion: 2.1 time: 0.155093 Oct 27 03:34:21.435773 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1703/3177] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:21 2022] GET /compute/v2.1/servers/004575c6-51ce-48d9-b7a6-d50f9afdb0a0 => generated 1218 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:21.450090 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-37eff5cc-0e5e-4fd2-8a62-db6a1ba0d751 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:21.451451 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-37eff5cc-0e5e-4fd2-8a62-db6a1ba0d751 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] [instance: f3d23d8e-a80a-425c-a0a3-9e448853a94b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:21.464042 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-37eff5cc-0e5e-4fd2-8a62-db6a1ba0d751 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:21.464773 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-37eff5cc-0e5e-4fd2-8a62-db6a1ba0d751 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:21.465376 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-37eff5cc-0e5e-4fd2-8a62-db6a1ba0d751 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:21.466482 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-37eff5cc-0e5e-4fd2-8a62-db6a1ba0d751 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:21.467121 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-37eff5cc-0e5e-4fd2-8a62-db6a1ba0d751 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:21.469879 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-37eff5cc-0e5e-4fd2-8a62-db6a1ba0d751 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:21.516932 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-37eff5cc-0e5e-4fd2-8a62-db6a1ba0d751 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] HTTP exception thrown: Instance f3d23d8e-a80a-425c-a0a3-9e448853a94b could not be found. Oct 27 03:34:21.520591 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-37eff5cc-0e5e-4fd2-8a62-db6a1ba0d751 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Request method failure captured: Oct 27 03:34:21.520591 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/f3d23d8e-a80a-425c-a0a3-9e448853a94b HTTP/1.1 Oct 27 03:34:21.520591 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:34:21.520591 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:34:21.520591 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:34:21.520591 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:34:21.520591 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:34:21.520591 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:34:21.520591 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:34:21.520591 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:34:21.520591 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfty7iMoXX0OKMtw3NGNBL19yV0L6hiETTK-LvwAOTcUXFZpotk2WfJjGMCKsnDn3tM3JbgHvxggYNGIupU9QItCM4P_tVgLT5lP28wLDgxacZJDsClEOVTxyt_nwUagPTtLKQvv9ZuzaDBjCvkjxjA8rwRpQ1Nrc_ffXrHXW4NOn9A Oct 27 03:34:21.520591 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:34:21.520591 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:34:21.520591 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:34:21.520591 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:34:21.520591 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:34:21.520591 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:34:21.520591 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: f5ee48e200624711b629a12b20c7d282 Oct 27 03:34:21.520591 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-2107793769 Oct 27 03:34:21.520591 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:34:21.520591 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:34:21.520591 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f5ee48e200624711b629a12b20c7d282"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f5ee48e200624711b629a12b20c7d282"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f5ee48e200624711b629a12b20c7d282"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f5ee48e200624711b629a12b20c7d282"}]}] Oct 27 03:34:21.520591 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-2107793769 Oct 27 03:34:21.520591 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: f5ee48e200624711b629a12b20c7d282 Oct 27 03:34:21.520591 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-2107793769 Oct 27 03:34:21.520591 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-AttachSCSIVolumeTestJSON-2107793769-project Oct 27 03:34:21.520591 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:34:21.520591 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:34:21.520591 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: ed44bf20b3464a53a3e3f6c9cd61cde3 Oct 27 03:34:21.520591 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-2107793769-project Oct 27 03:34:21.520591 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:34:21.520591 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance f3d23d8e-a80a-425c-a0a3-9e448853a94b could not be found. Oct 27 03:34:21.520591 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': 'f3d23d8e-a80a-425c-a0a3-9e448853a94b'} Oct 27 03:34:21.520591 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:34:21.520591 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:34:21.520591 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:34:21.520591 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:34:21.520591 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:34:21.520591 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:34:21.520591 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:34:21.520591 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:34:21.520591 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:34:21.520591 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:34:21.520591 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3d23d8e-a80a-425c-a0a3-9e448853a94b could not be found. Oct 27 03:34:21.520591 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:34:21.520591 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:34:21.520591 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:34:21.520591 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:34:21.520591 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:34:21.520591 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:34:21.520591 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:34:21.520591 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:34:21.520591 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:34:21.520591 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:34:21.520591 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:34:21.520591 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:34:21.520591 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:34:21.520591 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:34:21.520591 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:34:21.520591 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:34:21.520591 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3d23d8e-a80a-425c-a0a3-9e448853a94b could not be found. Oct 27 03:34:21.520591 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:34:21.520591 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:34:21.520591 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:34:21.525427 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:34:21.525427 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:34:21.525427 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:34:21.525427 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:34:21.525427 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:34:21.525427 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3d23d8e-a80a-425c-a0a3-9e448853a94b could not be found. Oct 27 03:34:21.525427 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:34:21.535422 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-37eff5cc-0e5e-4fd2-8a62-db6a1ba0d751 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] Returning 404 to user: Instance f3d23d8e-a80a-425c-a0a3-9e448853a94b could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:34:21.536505 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-37eff5cc-0e5e-4fd2-8a62-db6a1ba0d751 tempest-AttachSCSIVolumeTestJSON-2107793769 tempest-AttachSCSIVolumeTestJSON-2107793769-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d23d8e-a80a-425c-a0a3-9e448853a94b" status: 404 len: 111 microversion: 2.1 time: 0.099733 Oct 27 03:34:21.539801 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1704/3178] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:21 2022] GET /compute/v2.1/servers/f3d23d8e-a80a-425c-a0a3-9e448853a94b => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:34:21.554492 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a748f18f-6a91-4da1-82be-83312cf43dfe tempest-SecurityGroupRulesTestJSON-368356497 tempest-SecurityGroupRulesTestJSON-368356497-project] Action: 'create', calling method: .version_select at 0x7f7dda598160>, body: {"security_group_rule": {"parent_group_id": "a518857e-a931-4799-99e8-3f8f4169e762", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "45d70c96-1ec2-410a-a2a2-16aae7562133"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:34:21.626100 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b536b27c-e412-4f33-bc70-2a05b57a9ace tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcff40b520f749f2b4bca5eed0923504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbc26f2331d47e5863e8dbf1952906c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:21.642659 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b536b27c-e412-4f33-bc70-2a05b57a9ace tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] 10.222.0.20 "GET /compute/v2.1/servers/53d360ec-9026-453d-a4a5-39a5f684b2c3" status: 200 len: 1211 microversion: 2.1 time: 0.341657 Oct 27 03:34:21.644184 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1475/3179] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:21 2022] GET /compute/v2.1/servers/53d360ec-9026-453d-a4a5-39a5f684b2c3 => generated 1211 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:21.675954 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1c3bbf3b-0ebb-402c-a456-090183d9d6ea tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:21.676660 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1c3bbf3b-0ebb-402c-a456-090183d9d6ea tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: 8184dc7a-d6db-4374-ace1-f26377f26187] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:21.701448 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1c3bbf3b-0ebb-402c-a456-090183d9d6ea tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:21.702290 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1c3bbf3b-0ebb-402c-a456-090183d9d6ea tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:21.703651 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1c3bbf3b-0ebb-402c-a456-090183d9d6ea tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:21.704560 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1c3bbf3b-0ebb-402c-a456-090183d9d6ea tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:21.705145 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1c3bbf3b-0ebb-402c-a456-090183d9d6ea tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:21.705457 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1c3bbf3b-0ebb-402c-a456-090183d9d6ea tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:22.151851 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1c3bbf3b-0ebb-402c-a456-090183d9d6ea tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:22.160654 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1c3bbf3b-0ebb-402c-a456-090183d9d6ea tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/8184dc7a-d6db-4374-ace1-f26377f26187" status: 200 len: 1500 microversion: 2.1 time: 0.499916 Oct 27 03:34:22.161293 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1476/3180] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:21 2022] GET /compute/v2.1/servers/8184dc7a-d6db-4374-ace1-f26377f26187 => generated 1500 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:22.184502 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-776ffebe-6984-44b4-8831-d92d8bb3aed3 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:22.184502 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-776ffebe-6984-44b4-8831-d92d8bb3aed3 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] [instance: 38693017-3b6f-434c-976f-a9733156a115] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:22.195626 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-776ffebe-6984-44b4-8831-d92d8bb3aed3 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:22.199534 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-776ffebe-6984-44b4-8831-d92d8bb3aed3 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:22.203773 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-776ffebe-6984-44b4-8831-d92d8bb3aed3 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:22.210679 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-776ffebe-6984-44b4-8831-d92d8bb3aed3 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:22.212189 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-776ffebe-6984-44b4-8831-d92d8bb3aed3 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:22.213145 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-776ffebe-6984-44b4-8831-d92d8bb3aed3 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:22.807766 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-776ffebe-6984-44b4-8831-d92d8bb3aed3 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881f054c84d04ceaa17a5817816022d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2057593072c14804ab70fe4bdea2c17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:22.823198 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-776ffebe-6984-44b4-8831-d92d8bb3aed3 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] 10.222.0.20 "GET /compute/v2.1/servers/38693017-3b6f-434c-976f-a9733156a115" status: 200 len: 1354 microversion: 2.1 time: 0.643568 Oct 27 03:34:22.824210 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1477/3181] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:22 2022] GET /compute/v2.1/servers/38693017-3b6f-434c-976f-a9733156a115 => generated 1354 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:22.835631 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-907df6e0-c212-4155-8e46-9ff8bfc56a29 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:34:22.842716 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-907df6e0-c212-4155-8e46-9ff8bfc56a29 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: 8184dc7a-d6db-4374-ace1-f26377f26187] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:22.846821 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a748f18f-6a91-4da1-82be-83312cf43dfe tempest-SecurityGroupRulesTestJSON-368356497 tempest-SecurityGroupRulesTestJSON-368356497-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 328 microversion: 2.1 time: 1.306937 Oct 27 03:34:22.850765 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1705/3182] 10.222.0.20 () {60 vars in 1195 bytes} [Thu Oct 27 03:34:21 2022] POST /compute/v2.1/os-security-group-rules => generated 328 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:34:22.866767 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b00e1036-436d-4886-b932-b340782d94e7 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:22.868642 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b00e1036-436d-4886-b932-b340782d94e7 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] [instance: 004575c6-51ce-48d9-b7a6-d50f9afdb0a0] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:22.899326 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-907df6e0-c212-4155-8e46-9ff8bfc56a29 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:22.899853 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-907df6e0-c212-4155-8e46-9ff8bfc56a29 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:22.903755 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-907df6e0-c212-4155-8e46-9ff8bfc56a29 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:22.904929 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b00e1036-436d-4886-b932-b340782d94e7 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:22.905438 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b00e1036-436d-4886-b932-b340782d94e7 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:22.905889 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b00e1036-436d-4886-b932-b340782d94e7 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:22.908252 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-907df6e0-c212-4155-8e46-9ff8bfc56a29 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:22.908851 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-907df6e0-c212-4155-8e46-9ff8bfc56a29 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:22.909270 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-907df6e0-c212-4155-8e46-9ff8bfc56a29 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:22.912781 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b00e1036-436d-4886-b932-b340782d94e7 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:22.913564 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b00e1036-436d-4886-b932-b340782d94e7 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:22.914016 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b00e1036-436d-4886-b932-b340782d94e7 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:23.098249 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b00e1036-436d-4886-b932-b340782d94e7 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae7845f6759c4dcabcc1516a72484174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d371ab6648425eac2cf1702f2789dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:23.115646 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b00e1036-436d-4886-b932-b340782d94e7 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/servers/004575c6-51ce-48d9-b7a6-d50f9afdb0a0" status: 200 len: 1214 microversion: 2.1 time: 0.256076 Oct 27 03:34:23.117581 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1706/3183] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:22 2022] GET /compute/v2.1/servers/004575c6-51ce-48d9-b7a6-d50f9afdb0a0 => generated 1214 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:23.128124 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a636e4cb-3e09-40a4-8976-d69ae02b8ee8 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:23.133524 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a636e4cb-3e09-40a4-8976-d69ae02b8ee8 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] [instance: 53d360ec-9026-453d-a4a5-39a5f684b2c3] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:23.145759 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a636e4cb-3e09-40a4-8976-d69ae02b8ee8 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:23.146300 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a636e4cb-3e09-40a4-8976-d69ae02b8ee8 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:23.148855 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a636e4cb-3e09-40a4-8976-d69ae02b8ee8 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:23.150356 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a636e4cb-3e09-40a4-8976-d69ae02b8ee8 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:23.158938 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a636e4cb-3e09-40a4-8976-d69ae02b8ee8 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:23.159596 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a636e4cb-3e09-40a4-8976-d69ae02b8ee8 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:23.250738 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-907df6e0-c212-4155-8e46-9ff8bfc56a29 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "POST /compute/v2.1/servers/8184dc7a-d6db-4374-ace1-f26377f26187/action" status: 200 len: 14 microversion: 2.1 time: 0.424731 Oct 27 03:34:23.251783 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1478/3184] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:34:22 2022] POST /compute/v2.1/servers/8184dc7a-d6db-4374-ace1-f26377f26187/action => generated 14 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 03:34:23.257499 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8b420e32-dcc4-4a20-beb9-ee7e12f3bf5e tempest-SecurityGroupRulesTestJSON-368356497 tempest-SecurityGroupRulesTestJSON-368356497-project] Action: 'create', calling method: .version_select at 0x7f7dd9e43940>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1389601383", "description": "tempest-description-268822496"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:34:23.529767 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a636e4cb-3e09-40a4-8976-d69ae02b8ee8 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcff40b520f749f2b4bca5eed0923504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbc26f2331d47e5863e8dbf1952906c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:23.544195 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a636e4cb-3e09-40a4-8976-d69ae02b8ee8 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] 10.222.0.20 "GET /compute/v2.1/servers/53d360ec-9026-453d-a4a5-39a5f684b2c3" status: 200 len: 1273 microversion: 2.1 time: 0.421449 Oct 27 03:34:23.545100 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1707/3185] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:23 2022] GET /compute/v2.1/servers/53d360ec-9026-453d-a4a5-39a5f684b2c3 => generated 1273 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:23.561136 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-2105e7fa-2b47-409b-9be8-31a16409f8cc req-fc0e31dd-0b48-4726-9120-daf21bff55eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38693017-3b6f-434c-976f-a9733156a115", "name": "network-vif-plugged", "status": "completed", "tag": "473d6bda-acfa-4fd9-be94-64718ac6a5b8"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:34:23.583935 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-2105e7fa-2b47-409b-9be8-31a16409f8cc req-fc0e31dd-0b48-4726-9120-daf21bff55eb service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:23.585004 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-2105e7fa-2b47-409b-9be8-31a16409f8cc req-fc0e31dd-0b48-4726-9120-daf21bff55eb service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:23.585836 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-2105e7fa-2b47-409b-9be8-31a16409f8cc req-fc0e31dd-0b48-4726-9120-daf21bff55eb service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:23.600048 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-2105e7fa-2b47-409b-9be8-31a16409f8cc req-fc0e31dd-0b48-4726-9120-daf21bff55eb service nova] Creating event network-vif-plugged:473d6bda-acfa-4fd9-be94-64718ac6a5b8 for instance 38693017-3b6f-434c-976f-a9733156a115 on n-h2-862769-1 Oct 27 03:34:23.608077 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-2105e7fa-2b47-409b-9be8-31a16409f8cc req-fc0e31dd-0b48-4726-9120-daf21bff55eb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059892 Oct 27 03:34:23.609217 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1708/3186] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:34:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:34:23.850338 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1acf861b-1cdd-4d57-a922-3dda13a89004 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:23.851404 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1acf861b-1cdd-4d57-a922-3dda13a89004 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] [instance: 38693017-3b6f-434c-976f-a9733156a115] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:23.879065 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1acf861b-1cdd-4d57-a922-3dda13a89004 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:23.887812 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1acf861b-1cdd-4d57-a922-3dda13a89004 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:23.888466 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1acf861b-1cdd-4d57-a922-3dda13a89004 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:23.889310 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1acf861b-1cdd-4d57-a922-3dda13a89004 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:23.889987 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1acf861b-1cdd-4d57-a922-3dda13a89004 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:23.890560 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1acf861b-1cdd-4d57-a922-3dda13a89004 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:25.082774 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1acf861b-1cdd-4d57-a922-3dda13a89004 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881f054c84d04ceaa17a5817816022d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2057593072c14804ab70fe4bdea2c17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:25.096417 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1acf861b-1cdd-4d57-a922-3dda13a89004 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] 10.222.0.20 "GET /compute/v2.1/servers/38693017-3b6f-434c-976f-a9733156a115" status: 200 len: 1354 microversion: 2.1 time: 1.253882 Oct 27 03:34:25.110429 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1709/3187] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:23 2022] GET /compute/v2.1/servers/38693017-3b6f-434c-976f-a9733156a115 => generated 1354 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:25.115416 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-551f68ea-5376-4d54-99ef-057761b26c28 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:25.116733 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-551f68ea-5376-4d54-99ef-057761b26c28 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] [instance: 004575c6-51ce-48d9-b7a6-d50f9afdb0a0] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:25.123602 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-551f68ea-5376-4d54-99ef-057761b26c28 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:25.124105 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-551f68ea-5376-4d54-99ef-057761b26c28 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:25.124556 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-551f68ea-5376-4d54-99ef-057761b26c28 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:25.125860 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-551f68ea-5376-4d54-99ef-057761b26c28 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:25.126357 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-551f68ea-5376-4d54-99ef-057761b26c28 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:25.126790 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-551f68ea-5376-4d54-99ef-057761b26c28 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:25.435812 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-551f68ea-5376-4d54-99ef-057761b26c28 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae7845f6759c4dcabcc1516a72484174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d371ab6648425eac2cf1702f2789dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:25.447716 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-551f68ea-5376-4d54-99ef-057761b26c28 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/servers/004575c6-51ce-48d9-b7a6-d50f9afdb0a0" status: 200 len: 1276 microversion: 2.1 time: 0.335964 Oct 27 03:34:25.457847 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1710/3188] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:25 2022] GET /compute/v2.1/servers/004575c6-51ce-48d9-b7a6-d50f9afdb0a0 => generated 1276 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:25.457847 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c86903d9-319b-477e-8f2a-17a303feefee tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:34:25.458887 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c86903d9-319b-477e-8f2a-17a303feefee tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: 8184dc7a-d6db-4374-ace1-f26377f26187] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:25.469644 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c86903d9-319b-477e-8f2a-17a303feefee tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:25.470177 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c86903d9-319b-477e-8f2a-17a303feefee tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:25.470626 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c86903d9-319b-477e-8f2a-17a303feefee tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:25.471377 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c86903d9-319b-477e-8f2a-17a303feefee tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:25.471833 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c86903d9-319b-477e-8f2a-17a303feefee tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:25.472262 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c86903d9-319b-477e-8f2a-17a303feefee tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:25.530906 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c86903d9-319b-477e-8f2a-17a303feefee tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "POST /compute/v2.1/servers/8184dc7a-d6db-4374-ace1-f26377f26187/action" status: 200 len: 14 microversion: 2.1 time: 0.081304 Oct 27 03:34:25.532013 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1711/3189] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:34:25 2022] POST /compute/v2.1/servers/8184dc7a-d6db-4374-ace1-f26377f26187/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 03:34:25.541409 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-df4b7df5-469e-499d-916a-107ac242496c tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:25.543556 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-df4b7df5-469e-499d-916a-107ac242496c tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] [instance: 53d360ec-9026-453d-a4a5-39a5f684b2c3] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:25.554190 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-df4b7df5-469e-499d-916a-107ac242496c tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:25.554970 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-df4b7df5-469e-499d-916a-107ac242496c tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:25.555966 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-df4b7df5-469e-499d-916a-107ac242496c tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:25.556899 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-df4b7df5-469e-499d-916a-107ac242496c tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:25.558486 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-df4b7df5-469e-499d-916a-107ac242496c tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:25.560234 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-df4b7df5-469e-499d-916a-107ac242496c tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:25.749257 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-df4b7df5-469e-499d-916a-107ac242496c tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcff40b520f749f2b4bca5eed0923504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbc26f2331d47e5863e8dbf1952906c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:25.767670 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-df4b7df5-469e-499d-916a-107ac242496c tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] 10.222.0.20 "GET /compute/v2.1/servers/53d360ec-9026-453d-a4a5-39a5f684b2c3" status: 200 len: 1273 microversion: 2.1 time: 0.226183 Oct 27 03:34:25.770719 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1712/3190] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:25 2022] GET /compute/v2.1/servers/53d360ec-9026-453d-a4a5-39a5f684b2c3 => generated 1273 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:25.783325 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-c0a84eb5-c5db-4ebc-972a-a18c616d41ae req-7f8a4d25-9403-4f64-8cc3-8fbbec6edd4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38693017-3b6f-434c-976f-a9733156a115", "name": "network-vif-plugged", "status": "completed", "tag": "b1d5b054-3345-4a5e-a5cd-e36b2aad8574"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:34:25.810467 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-c0a84eb5-c5db-4ebc-972a-a18c616d41ae req-7f8a4d25-9403-4f64-8cc3-8fbbec6edd4d service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:25.810974 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-c0a84eb5-c5db-4ebc-972a-a18c616d41ae req-7f8a4d25-9403-4f64-8cc3-8fbbec6edd4d service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:25.813590 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-c0a84eb5-c5db-4ebc-972a-a18c616d41ae req-7f8a4d25-9403-4f64-8cc3-8fbbec6edd4d service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:25.854782 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-c0a84eb5-c5db-4ebc-972a-a18c616d41ae req-7f8a4d25-9403-4f64-8cc3-8fbbec6edd4d service nova] Creating event network-vif-plugged:b1d5b054-3345-4a5e-a5cd-e36b2aad8574 for instance 38693017-3b6f-434c-976f-a9733156a115 on n-h2-862769-1 Oct 27 03:34:25.872242 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-c0a84eb5-c5db-4ebc-972a-a18c616d41ae req-7f8a4d25-9403-4f64-8cc3-8fbbec6edd4d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098521 Oct 27 03:34:25.876261 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1713/3191] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:34:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:34:26.120350 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8babddcd-48d0-4c88-a6fb-23cc6aae05e2 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:26.121234 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8babddcd-48d0-4c88-a6fb-23cc6aae05e2 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] [instance: 38693017-3b6f-434c-976f-a9733156a115] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:26.135629 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8babddcd-48d0-4c88-a6fb-23cc6aae05e2 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:26.136154 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8babddcd-48d0-4c88-a6fb-23cc6aae05e2 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:26.136611 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8babddcd-48d0-4c88-a6fb-23cc6aae05e2 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:26.137342 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8babddcd-48d0-4c88-a6fb-23cc6aae05e2 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:26.137805 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8babddcd-48d0-4c88-a6fb-23cc6aae05e2 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:26.144772 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8babddcd-48d0-4c88-a6fb-23cc6aae05e2 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:26.207214 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8b420e32-dcc4-4a20-beb9-ee7e12f3bf5e tempest-SecurityGroupRulesTestJSON-368356497 tempest-SecurityGroupRulesTestJSON-368356497-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 2.953919 Oct 27 03:34:26.218378 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1479/3192] 10.222.0.20 () {60 vars in 1180 bytes} [Thu Oct 27 03:34:23 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 2966 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:34:26.225346 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-bc6ed33b-b380-4294-a40c-a46a2734699c tempest-SecurityGroupRulesTestJSON-368356497 tempest-SecurityGroupRulesTestJSON-368356497-project] Action: 'create', calling method: .version_select at 0x7f7dda97e1f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1011562057", "description": "tempest-description-1850653856"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:34:26.559758 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8babddcd-48d0-4c88-a6fb-23cc6aae05e2 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881f054c84d04ceaa17a5817816022d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2057593072c14804ab70fe4bdea2c17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:26.576719 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8babddcd-48d0-4c88-a6fb-23cc6aae05e2 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] 10.222.0.20 "GET /compute/v2.1/servers/38693017-3b6f-434c-976f-a9733156a115" status: 200 len: 1354 microversion: 2.1 time: 0.456006 Oct 27 03:34:26.587661 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1714/3193] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:26 2022] GET /compute/v2.1/servers/38693017-3b6f-434c-976f-a9733156a115 => generated 1354 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:26.591740 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c6f53b23-b962-41ea-9a26-6598170a6e00 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:26.595717 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c6f53b23-b962-41ea-9a26-6598170a6e00 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] [instance: 004575c6-51ce-48d9-b7a6-d50f9afdb0a0] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:26.603234 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c6f53b23-b962-41ea-9a26-6598170a6e00 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:26.603962 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c6f53b23-b962-41ea-9a26-6598170a6e00 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:26.604616 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c6f53b23-b962-41ea-9a26-6598170a6e00 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:26.605519 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c6f53b23-b962-41ea-9a26-6598170a6e00 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:26.605979 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c6f53b23-b962-41ea-9a26-6598170a6e00 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:26.606663 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c6f53b23-b962-41ea-9a26-6598170a6e00 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:26.727919 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c6f53b23-b962-41ea-9a26-6598170a6e00 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae7845f6759c4dcabcc1516a72484174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d371ab6648425eac2cf1702f2789dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:26.750753 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c6f53b23-b962-41ea-9a26-6598170a6e00 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/servers/004575c6-51ce-48d9-b7a6-d50f9afdb0a0" status: 200 len: 1276 microversion: 2.1 time: 0.169545 Oct 27 03:34:26.752131 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1715/3194] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:26 2022] GET /compute/v2.1/servers/004575c6-51ce-48d9-b7a6-d50f9afdb0a0 => generated 1276 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:26.762410 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7458cc8a-de9e-43e0-941a-7c996c7f9c89 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:34:26.767958 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7458cc8a-de9e-43e0-941a-7c996c7f9c89 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: 8184dc7a-d6db-4374-ace1-f26377f26187] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:26.776407 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7458cc8a-de9e-43e0-941a-7c996c7f9c89 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:26.777888 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7458cc8a-de9e-43e0-941a-7c996c7f9c89 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:26.778822 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7458cc8a-de9e-43e0-941a-7c996c7f9c89 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:26.779851 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7458cc8a-de9e-43e0-941a-7c996c7f9c89 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:26.780583 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7458cc8a-de9e-43e0-941a-7c996c7f9c89 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:26.781459 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7458cc8a-de9e-43e0-941a-7c996c7f9c89 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:26.867930 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7458cc8a-de9e-43e0-941a-7c996c7f9c89 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "POST /compute/v2.1/servers/8184dc7a-d6db-4374-ace1-f26377f26187/action" status: 200 len: 14 microversion: 2.1 time: 0.114166 Oct 27 03:34:26.868831 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1716/3195] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:34:26 2022] POST /compute/v2.1/servers/8184dc7a-d6db-4374-ace1-f26377f26187/action => generated 14 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 03:34:26.880538 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a2ff1b24-71f6-4089-8adb-0fe17ca77645 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:26.882086 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a2ff1b24-71f6-4089-8adb-0fe17ca77645 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] [instance: 53d360ec-9026-453d-a4a5-39a5f684b2c3] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:26.898308 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a2ff1b24-71f6-4089-8adb-0fe17ca77645 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:26.899357 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a2ff1b24-71f6-4089-8adb-0fe17ca77645 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:26.900386 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a2ff1b24-71f6-4089-8adb-0fe17ca77645 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:26.901908 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a2ff1b24-71f6-4089-8adb-0fe17ca77645 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:26.903344 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a2ff1b24-71f6-4089-8adb-0fe17ca77645 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:26.903909 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a2ff1b24-71f6-4089-8adb-0fe17ca77645 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:27.150018 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-bc6ed33b-b380-4294-a40c-a46a2734699c tempest-SecurityGroupRulesTestJSON-368356497 tempest-SecurityGroupRulesTestJSON-368356497-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.929454 Oct 27 03:34:27.152232 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1480/3196] 10.222.0.20 () {60 vars in 1180 bytes} [Thu Oct 27 03:34:26 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:34:27.174456 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-69d0f1bb-2034-4e69-855e-01247a53ac57 tempest-SecurityGroupRulesTestJSON-368356497 tempest-SecurityGroupRulesTestJSON-368356497-project] Action: 'create', calling method: .version_select at 0x7f7ddecc1af0>, body: {"security_group_rule": {"parent_group_id": "7478599b-0ef0-46a2-ba0b-7ff47b8ce841", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "cf6ce325-db4a-4904-84a7-5b5c717c254d"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:34:27.326195 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a2ff1b24-71f6-4089-8adb-0fe17ca77645 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcff40b520f749f2b4bca5eed0923504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbc26f2331d47e5863e8dbf1952906c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:27.334541 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a2ff1b24-71f6-4089-8adb-0fe17ca77645 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] 10.222.0.20 "GET /compute/v2.1/servers/53d360ec-9026-453d-a4a5-39a5f684b2c3" status: 200 len: 1315 microversion: 2.1 time: 0.463475 Oct 27 03:34:27.335139 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1717/3197] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:26 2022] GET /compute/v2.1/servers/53d360ec-9026-453d-a4a5-39a5f684b2c3 => generated 1315 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:27.611183 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9bffb18c-28cc-4e27-821a-d1172e6de3f5 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:27.612197 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-9bffb18c-28cc-4e27-821a-d1172e6de3f5 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] [instance: 38693017-3b6f-434c-976f-a9733156a115] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:27.621255 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9bffb18c-28cc-4e27-821a-d1172e6de3f5 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:27.622117 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9bffb18c-28cc-4e27-821a-d1172e6de3f5 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:27.622880 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9bffb18c-28cc-4e27-821a-d1172e6de3f5 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:27.623943 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9bffb18c-28cc-4e27-821a-d1172e6de3f5 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:27.624687 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9bffb18c-28cc-4e27-821a-d1172e6de3f5 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:27.625816 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9bffb18c-28cc-4e27-821a-d1172e6de3f5 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:28.301226 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9bffb18c-28cc-4e27-821a-d1172e6de3f5 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881f054c84d04ceaa17a5817816022d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2057593072c14804ab70fe4bdea2c17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:28.314291 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9bffb18c-28cc-4e27-821a-d1172e6de3f5 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] 10.222.0.20 "GET /compute/v2.1/servers/38693017-3b6f-434c-976f-a9733156a115" status: 200 len: 1354 microversion: 2.1 time: 0.714205 Oct 27 03:34:28.315385 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1718/3198] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:27 2022] GET /compute/v2.1/servers/38693017-3b6f-434c-976f-a9733156a115 => generated 1354 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:28.320424 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0c797543-35f0-4adf-8380-8045af1d5ab7 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:28.321053 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0c797543-35f0-4adf-8380-8045af1d5ab7 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] [instance: 004575c6-51ce-48d9-b7a6-d50f9afdb0a0] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:28.341882 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0c797543-35f0-4adf-8380-8045af1d5ab7 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:28.345621 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0c797543-35f0-4adf-8380-8045af1d5ab7 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:28.346391 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0c797543-35f0-4adf-8380-8045af1d5ab7 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:28.347145 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0c797543-35f0-4adf-8380-8045af1d5ab7 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:28.347610 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0c797543-35f0-4adf-8380-8045af1d5ab7 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:28.348045 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0c797543-35f0-4adf-8380-8045af1d5ab7 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:28.879468 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0c797543-35f0-4adf-8380-8045af1d5ab7 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae7845f6759c4dcabcc1516a72484174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d371ab6648425eac2cf1702f2789dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:28.894807 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0c797543-35f0-4adf-8380-8045af1d5ab7 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/servers/004575c6-51ce-48d9-b7a6-d50f9afdb0a0" status: 200 len: 1318 microversion: 2.1 time: 0.578044 Oct 27 03:34:28.896682 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1719/3199] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:28 2022] GET /compute/v2.1/servers/004575c6-51ce-48d9-b7a6-d50f9afdb0a0 => generated 1318 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:28.904308 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-585f5347-da01-4899-a90a-c01bb5d726b1 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:34:28.909152 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-585f5347-da01-4899-a90a-c01bb5d726b1 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: 8184dc7a-d6db-4374-ace1-f26377f26187] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:28.916662 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:34:28.920203 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-585f5347-da01-4899-a90a-c01bb5d726b1 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:28.921863 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-585f5347-da01-4899-a90a-c01bb5d726b1 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:28.922672 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-585f5347-da01-4899-a90a-c01bb5d726b1 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:28.925359 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-585f5347-da01-4899-a90a-c01bb5d726b1 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:28.925359 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-585f5347-da01-4899-a90a-c01bb5d726b1 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:28.925359 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-585f5347-da01-4899-a90a-c01bb5d726b1 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:28.988998 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-585f5347-da01-4899-a90a-c01bb5d726b1 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "POST /compute/v2.1/servers/8184dc7a-d6db-4374-ace1-f26377f26187/action" status: 200 len: 14 microversion: 2.1 time: 0.089881 Oct 27 03:34:28.990124 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1720/3200] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:34:28 2022] POST /compute/v2.1/servers/8184dc7a-d6db-4374-ace1-f26377f26187/action => generated 14 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 03:34:28.996263 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-327d6e78-e124-48c2-892d-9119cf011e5e req-8b69e057-abd1-425e-8aaa-ce3336fe3b11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38693017-3b6f-434c-976f-a9733156a115", "name": "network-vif-plugged", "status": "completed", "tag": "02930e69-9216-45da-b6d0-4ed8f060b164"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:34:29.017301 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-327d6e78-e124-48c2-892d-9119cf011e5e req-8b69e057-abd1-425e-8aaa-ce3336fe3b11 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:29.018139 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-327d6e78-e124-48c2-892d-9119cf011e5e req-8b69e057-abd1-425e-8aaa-ce3336fe3b11 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:29.018726 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-327d6e78-e124-48c2-892d-9119cf011e5e req-8b69e057-abd1-425e-8aaa-ce3336fe3b11 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:29.044308 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-327d6e78-e124-48c2-892d-9119cf011e5e req-8b69e057-abd1-425e-8aaa-ce3336fe3b11 service nova] Creating event network-vif-plugged:02930e69-9216-45da-b6d0-4ed8f060b164 for instance 38693017-3b6f-434c-976f-a9733156a115 on n-h2-862769-1 Oct 27 03:34:29.052534 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-327d6e78-e124-48c2-892d-9119cf011e5e req-8b69e057-abd1-425e-8aaa-ce3336fe3b11 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060398 Oct 27 03:34:29.053943 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1721/3201] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:34:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:34:29.061480 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e53be822-1d81-441c-b7b9-066519e134d7 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:29.066230 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e53be822-1d81-441c-b7b9-066519e134d7 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] [instance: 53d360ec-9026-453d-a4a5-39a5f684b2c3] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:29.077902 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e53be822-1d81-441c-b7b9-066519e134d7 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:29.077902 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e53be822-1d81-441c-b7b9-066519e134d7 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:29.078883 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e53be822-1d81-441c-b7b9-066519e134d7 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:29.079955 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e53be822-1d81-441c-b7b9-066519e134d7 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:29.080624 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e53be822-1d81-441c-b7b9-066519e134d7 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:29.082170 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e53be822-1d81-441c-b7b9-066519e134d7 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:29.107387 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:34:29.154773 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=6 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:34:29.532168 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-69d0f1bb-2034-4e69-855e-01247a53ac57 tempest-SecurityGroupRulesTestJSON-368356497 tempest-SecurityGroupRulesTestJSON-368356497-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 2.365048 Oct 27 03:34:29.532168 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1481/3202] 10.222.0.20 () {60 vars in 1195 bytes} [Thu Oct 27 03:34:27 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 2368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:34:29.535001 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-043928a2-ba36-4a58-b345-099f04d4d0a3 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:29.535736 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-043928a2-ba36-4a58-b345-099f04d4d0a3 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] [instance: 38693017-3b6f-434c-976f-a9733156a115] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:29.549122 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-043928a2-ba36-4a58-b345-099f04d4d0a3 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:29.549863 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-043928a2-ba36-4a58-b345-099f04d4d0a3 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:29.550517 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-043928a2-ba36-4a58-b345-099f04d4d0a3 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:29.559269 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-043928a2-ba36-4a58-b345-099f04d4d0a3 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:29.575250 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-043928a2-ba36-4a58-b345-099f04d4d0a3 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:29.575980 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-043928a2-ba36-4a58-b345-099f04d4d0a3 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:29.758692 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e53be822-1d81-441c-b7b9-066519e134d7 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcff40b520f749f2b4bca5eed0923504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbc26f2331d47e5863e8dbf1952906c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:29.762392 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=100 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:34:29.778390 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e53be822-1d81-441c-b7b9-066519e134d7 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] 10.222.0.20 "GET /compute/v2.1/servers/53d360ec-9026-453d-a4a5-39a5f684b2c3" status: 200 len: 1315 microversion: 2.1 time: 0.714637 Oct 27 03:34:29.779065 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1722/3203] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:29 2022] GET /compute/v2.1/servers/53d360ec-9026-453d-a4a5-39a5f684b2c3 => generated 1315 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:29.912592 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0a5b3cfb-caeb-4574-a22d-78eef13a610b tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-545255875", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": [{"uuid": "0f1ea857-e60a-4a6e-a6c9-70bfd2dd2db8"}]}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:34:30.002080 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.network.neutron [None req-0a5b3cfb-caeb-4574-a22d-78eef13a610b tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] validate_networks() for [('0f1ea857-e60a-4a6e-a6c9-70bfd2dd2db8', None, None, None, None, None)] {{(pid=121001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:34:30.142900 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-043928a2-ba36-4a58-b345-099f04d4d0a3 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881f054c84d04ceaa17a5817816022d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2057593072c14804ab70fe4bdea2c17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:30.164415 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-043928a2-ba36-4a58-b345-099f04d4d0a3 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] 10.222.0.20 "GET /compute/v2.1/servers/38693017-3b6f-434c-976f-a9733156a115" status: 200 len: 1354 microversion: 2.1 time: 0.633579 Oct 27 03:34:30.209639 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1482/3204] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:29 2022] GET /compute/v2.1/servers/38693017-3b6f-434c-976f-a9733156a115 => generated 1354 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:30.216075 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-aed7050e-8d14-41b8-9b71-18f3e70d9880 tempest-SecurityGroupRulesTestJSON-368356497 tempest-SecurityGroupRulesTestJSON-368356497-project] Calling method '.version_select at 0x7f7ddecc1430>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:30.491076 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=4 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:34:30.845910 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-aed7050e-8d14-41b8-9b71-18f3e70d9880 tempest-SecurityGroupRulesTestJSON-368356497 tempest-SecurityGroupRulesTestJSON-368356497-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/cf6ce325-db4a-4904-84a7-5b5c717c254d" status: 202 len: 0 microversion: 2.1 time: 0.627163 Oct 27 03:34:30.845910 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1483/3205] 10.222.0.20 () {58 vars in 1272 bytes} [Thu Oct 27 03:34:30 2022] DELETE /compute/v2.1/os-security-groups/cf6ce325-db4a-4904-84a7-5b5c717c254d => generated 0 bytes in 629 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:34:30.845910 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-93284d1d-02ef-47f6-a19d-b4fca35a1bf1 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:30.846620 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-93284d1d-02ef-47f6-a19d-b4fca35a1bf1 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] [instance: 004575c6-51ce-48d9-b7a6-d50f9afdb0a0] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:30.861364 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-93284d1d-02ef-47f6-a19d-b4fca35a1bf1 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:30.861909 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-93284d1d-02ef-47f6-a19d-b4fca35a1bf1 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:30.862557 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-93284d1d-02ef-47f6-a19d-b4fca35a1bf1 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:30.863318 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-93284d1d-02ef-47f6-a19d-b4fca35a1bf1 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:30.863644 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-93284d1d-02ef-47f6-a19d-b4fca35a1bf1 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:30.864085 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-93284d1d-02ef-47f6-a19d-b4fca35a1bf1 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:31.351922 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-0a5b3cfb-caeb-4574-a22d-78eef13a610b tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Flavor limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:34:31.352452 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-0a5b3cfb-caeb-4574-a22d-78eef13a610b tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Image limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:34:31.352811 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-0a5b3cfb-caeb-4574-a22d-78eef13a610b tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Flavor pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:34:31.353222 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-0a5b3cfb-caeb-4574-a22d-78eef13a610b tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Image pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:34:31.353819 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-0a5b3cfb-caeb-4574-a22d-78eef13a610b tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:34:31.372986 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0a5b3cfb-caeb-4574-a22d-78eef13a610b tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:31.373484 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0a5b3cfb-caeb-4574-a22d-78eef13a610b tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:31.373917 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0a5b3cfb-caeb-4574-a22d-78eef13a610b tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:31.379312 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0a5b3cfb-caeb-4574-a22d-78eef13a610b tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:31.380017 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0a5b3cfb-caeb-4574-a22d-78eef13a610b tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:31.380616 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0a5b3cfb-caeb-4574-a22d-78eef13a610b tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:31.445460 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-0a5b3cfb-caeb-4574-a22d-78eef13a610b tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Getting quotas for project 8bb5d291069d4329a90123e327fe9c59. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:34:31.460147 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-0a5b3cfb-caeb-4574-a22d-78eef13a610b tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Getting quotas for user f9c32b7626594ff888970c7f3227bb20 and project 8bb5d291069d4329a90123e327fe9c59. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:34:31.494253 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0a5b3cfb-caeb-4574-a22d-78eef13a610b tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Going to run 1 instances... {{(pid=121001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:34:31.503128 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0a5b3cfb-caeb-4574-a22d-78eef13a610b tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:34:31.567356 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-93284d1d-02ef-47f6-a19d-b4fca35a1bf1 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae7845f6759c4dcabcc1516a72484174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d371ab6648425eac2cf1702f2789dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:31.579792 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-93284d1d-02ef-47f6-a19d-b4fca35a1bf1 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/servers/004575c6-51ce-48d9-b7a6-d50f9afdb0a0" status: 200 len: 1318 microversion: 2.1 time: 0.738858 Oct 27 03:34:31.584594 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1484/3206] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:30 2022] GET /compute/v2.1/servers/004575c6-51ce-48d9-b7a6-d50f9afdb0a0 => generated 1318 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:31.597346 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1a2f7011-f155-4ef4-842a-d91f31c4b7f2 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:34:31.605396 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1a2f7011-f155-4ef4-842a-d91f31c4b7f2 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: 8184dc7a-d6db-4374-ace1-f26377f26187] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:31.616492 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1a2f7011-f155-4ef4-842a-d91f31c4b7f2 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:31.617237 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1a2f7011-f155-4ef4-842a-d91f31c4b7f2 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:31.618021 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1a2f7011-f155-4ef4-842a-d91f31c4b7f2 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:31.618975 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1a2f7011-f155-4ef4-842a-d91f31c4b7f2 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:31.619747 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1a2f7011-f155-4ef4-842a-d91f31c4b7f2 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:31.621579 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1a2f7011-f155-4ef4-842a-d91f31c4b7f2 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:31.703538 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0a5b3cfb-caeb-4574-a22d-78eef13a610b tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.921912 Oct 27 03:34:31.705071 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1723/3207] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:34:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1926 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 03:34:31.736153 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-555f5e5b-39b4-4776-9d59-260b29709eac tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:31.739044 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-555f5e5b-39b4-4776-9d59-260b29709eac tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] [instance: 53d360ec-9026-453d-a4a5-39a5f684b2c3] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:31.789574 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-555f5e5b-39b4-4776-9d59-260b29709eac tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:31.790049 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-555f5e5b-39b4-4776-9d59-260b29709eac tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:31.790501 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-555f5e5b-39b4-4776-9d59-260b29709eac tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:31.798996 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-555f5e5b-39b4-4776-9d59-260b29709eac tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:31.801074 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-555f5e5b-39b4-4776-9d59-260b29709eac tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:31.801561 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1a2f7011-f155-4ef4-842a-d91f31c4b7f2 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "POST /compute/v2.1/servers/8184dc7a-d6db-4374-ace1-f26377f26187/action" status: 200 len: 14 microversion: 2.1 time: 0.212700 Oct 27 03:34:31.804827 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-555f5e5b-39b4-4776-9d59-260b29709eac tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:31.807236 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1485/3208] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:34:31 2022] POST /compute/v2.1/servers/8184dc7a-d6db-4374-ace1-f26377f26187/action => generated 14 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 03:34:31.821167 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-053bd3e8-52c8-4727-bac1-0494a8ecc948 tempest-SecurityGroupRulesTestJSON-368356497 tempest-SecurityGroupRulesTestJSON-368356497-project] Calling method '.version_select at 0x7f7dd9d7ee50>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:32.399999 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-555f5e5b-39b4-4776-9d59-260b29709eac tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcff40b520f749f2b4bca5eed0923504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbc26f2331d47e5863e8dbf1952906c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:32.415436 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-555f5e5b-39b4-4776-9d59-260b29709eac tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] 10.222.0.20 "GET /compute/v2.1/servers/53d360ec-9026-453d-a4a5-39a5f684b2c3" status: 200 len: 1315 microversion: 2.1 time: 0.705986 Oct 27 03:34:32.421017 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1724/3209] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:31 2022] GET /compute/v2.1/servers/53d360ec-9026-453d-a4a5-39a5f684b2c3 => generated 1315 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:32.432111 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-e5edd424-b230-4d60-b993-e82e6d4c5992 req-a3605227-dfb7-49be-a6b2-58de38d5ce05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53d360ec-9026-453d-a4a5-39a5f684b2c3", "tag": "9b78254a-b82d-4931-b6bc-b7eb6c9e37ad"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:34:32.509429 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-e5edd424-b230-4d60-b993-e82e6d4c5992 req-a3605227-dfb7-49be-a6b2-58de38d5ce05 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:32.511857 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-e5edd424-b230-4d60-b993-e82e6d4c5992 req-a3605227-dfb7-49be-a6b2-58de38d5ce05 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:32.513537 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-e5edd424-b230-4d60-b993-e82e6d4c5992 req-a3605227-dfb7-49be-a6b2-58de38d5ce05 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:32.554944 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-e5edd424-b230-4d60-b993-e82e6d4c5992 req-a3605227-dfb7-49be-a6b2-58de38d5ce05 service nova] Creating event network-changed:9b78254a-b82d-4931-b6bc-b7eb6c9e37ad for instance 53d360ec-9026-453d-a4a5-39a5f684b2c3 on n-h1-862769-1 Oct 27 03:34:32.568204 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-e5edd424-b230-4d60-b993-e82e6d4c5992 req-a3605227-dfb7-49be-a6b2-58de38d5ce05 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142196 Oct 27 03:34:32.569257 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1725/3210] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:34:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:34:32.581865 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ea7c31f7-f2cb-4bfa-b54f-2d4a6dba7ed7 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:32.583023 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ea7c31f7-f2cb-4bfa-b54f-2d4a6dba7ed7 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] [instance: 38693017-3b6f-434c-976f-a9733156a115] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:32.595423 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ea7c31f7-f2cb-4bfa-b54f-2d4a6dba7ed7 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:32.596821 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ea7c31f7-f2cb-4bfa-b54f-2d4a6dba7ed7 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:32.597470 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ea7c31f7-f2cb-4bfa-b54f-2d4a6dba7ed7 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:32.598430 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ea7c31f7-f2cb-4bfa-b54f-2d4a6dba7ed7 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:32.599046 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ea7c31f7-f2cb-4bfa-b54f-2d4a6dba7ed7 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:32.599821 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ea7c31f7-f2cb-4bfa-b54f-2d4a6dba7ed7 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:32.796152 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-053bd3e8-52c8-4727-bac1-0494a8ecc948 tempest-SecurityGroupRulesTestJSON-368356497 tempest-SecurityGroupRulesTestJSON-368356497-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups/7478599b-0ef0-46a2-ba0b-7ff47b8ce841" status: 200 len: 247 microversion: 2.1 time: 0.987411 Oct 27 03:34:32.797487 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1486/3211] 10.222.0.20 () {58 vars in 1269 bytes} [Thu Oct 27 03:34:31 2022] GET /compute/v2.1/os-security-groups/7478599b-0ef0-46a2-ba0b-7ff47b8ce841 => generated 247 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:34:32.805185 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-c6bc165b-d73d-4c7b-b8f1-54567bfdb475 req-6d6994af-55f0-4ba2-9a82-428ef493bb77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f50da5a9-2bb6-4735-93c3-d73ece0964f3", "tag": "271e155b-8765-4519-870e-105aa22f7ae9"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:34:32.849433 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-c6bc165b-d73d-4c7b-b8f1-54567bfdb475 req-6d6994af-55f0-4ba2-9a82-428ef493bb77 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:32.852432 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-c6bc165b-d73d-4c7b-b8f1-54567bfdb475 req-6d6994af-55f0-4ba2-9a82-428ef493bb77 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:32.853058 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-c6bc165b-d73d-4c7b-b8f1-54567bfdb475 req-6d6994af-55f0-4ba2-9a82-428ef493bb77 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:32.889630 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-c6bc165b-d73d-4c7b-b8f1-54567bfdb475 req-6d6994af-55f0-4ba2-9a82-428ef493bb77 service nova] Creating event network-changed:271e155b-8765-4519-870e-105aa22f7ae9 for instance f50da5a9-2bb6-4735-93c3-d73ece0964f3 on n-h1-862769-1 Oct 27 03:34:32.898559 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-c6bc165b-d73d-4c7b-b8f1-54567bfdb475 req-6d6994af-55f0-4ba2-9a82-428ef493bb77 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099091 Oct 27 03:34:32.899683 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1487/3212] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:34:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:34:32.917007 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-46697af1-f18d-44c1-aa49-f6839d5a26b0 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:32.917824 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-46697af1-f18d-44c1-aa49-f6839d5a26b0 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:33.101434 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ea7c31f7-f2cb-4bfa-b54f-2d4a6dba7ed7 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881f054c84d04ceaa17a5817816022d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2057593072c14804ab70fe4bdea2c17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:33.111115 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ea7c31f7-f2cb-4bfa-b54f-2d4a6dba7ed7 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] 10.222.0.20 "GET /compute/v2.1/servers/38693017-3b6f-434c-976f-a9733156a115" status: 200 len: 1803 microversion: 2.1 time: 0.539361 Oct 27 03:34:33.120185 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1726/3213] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:32 2022] GET /compute/v2.1/servers/38693017-3b6f-434c-976f-a9733156a115 => generated 1803 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:33.138298 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5d0fc4eb-b024-4afd-a5af-d16950ecc16c tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:33.139290 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5d0fc4eb-b024-4afd-a5af-d16950ecc16c tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] [instance: 004575c6-51ce-48d9-b7a6-d50f9afdb0a0] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:33.148713 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5d0fc4eb-b024-4afd-a5af-d16950ecc16c tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:33.149292 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5d0fc4eb-b024-4afd-a5af-d16950ecc16c tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:33.159229 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5d0fc4eb-b024-4afd-a5af-d16950ecc16c tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:33.160186 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5d0fc4eb-b024-4afd-a5af-d16950ecc16c tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:33.160788 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5d0fc4eb-b024-4afd-a5af-d16950ecc16c tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:33.161452 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5d0fc4eb-b024-4afd-a5af-d16950ecc16c tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:33.180880 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-46697af1-f18d-44c1-aa49-f6839d5a26b0 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:33.196636 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-46697af1-f18d-44c1-aa49-f6839d5a26b0 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1216 microversion: 2.1 time: 0.295293 Oct 27 03:34:33.198256 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1488/3214] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:32 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1216 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:33.214784 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-27124f11-4a9d-46ba-a321-3dd0219413fe tempest-SecurityGroupRulesTestJSON-368356497 tempest-SecurityGroupRulesTestJSON-368356497-project] Action: 'create', calling method: .version_select at 0x7f7ddb0021f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-405113148", "description": "tempest-description-2132925516"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:34:33.422919 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5d0fc4eb-b024-4afd-a5af-d16950ecc16c tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae7845f6759c4dcabcc1516a72484174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d371ab6648425eac2cf1702f2789dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:33.445392 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5d0fc4eb-b024-4afd-a5af-d16950ecc16c tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/servers/004575c6-51ce-48d9-b7a6-d50f9afdb0a0" status: 200 len: 1318 microversion: 2.1 time: 0.323739 Oct 27 03:34:33.450015 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1727/3215] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:33 2022] GET /compute/v2.1/servers/004575c6-51ce-48d9-b7a6-d50f9afdb0a0 => generated 1318 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:33.647270 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-82ece43d-a2f1-4d27-a202-811d6d60a9f5 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:34:33.648173 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-82ece43d-a2f1-4d27-a202-811d6d60a9f5 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: 8184dc7a-d6db-4374-ace1-f26377f26187] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:33.667512 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-82ece43d-a2f1-4d27-a202-811d6d60a9f5 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:33.669864 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-82ece43d-a2f1-4d27-a202-811d6d60a9f5 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:33.675706 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-82ece43d-a2f1-4d27-a202-811d6d60a9f5 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:33.676508 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-82ece43d-a2f1-4d27-a202-811d6d60a9f5 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:33.676986 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-82ece43d-a2f1-4d27-a202-811d6d60a9f5 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:33.679934 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-82ece43d-a2f1-4d27-a202-811d6d60a9f5 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:33.995249 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-27124f11-4a9d-46ba-a321-3dd0219413fe tempest-SecurityGroupRulesTestJSON-368356497 tempest-SecurityGroupRulesTestJSON-368356497-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.791957 Oct 27 03:34:33.996377 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1489/3216] 10.222.0.20 () {60 vars in 1180 bytes} [Thu Oct 27 03:34:33 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:34:34.012384 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-531025fc-a104-4e13-b3cf-dbeb05c1383f tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:34.014190 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-531025fc-a104-4e13-b3cf-dbeb05c1383f tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] [instance: 38693017-3b6f-434c-976f-a9733156a115] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:34.039995 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-531025fc-a104-4e13-b3cf-dbeb05c1383f tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:34.043700 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-531025fc-a104-4e13-b3cf-dbeb05c1383f tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:34.046086 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-531025fc-a104-4e13-b3cf-dbeb05c1383f tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:34.048107 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-531025fc-a104-4e13-b3cf-dbeb05c1383f tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:34.049111 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-531025fc-a104-4e13-b3cf-dbeb05c1383f tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:34.050093 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-531025fc-a104-4e13-b3cf-dbeb05c1383f tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:34.111579 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-531025fc-a104-4e13-b3cf-dbeb05c1383f tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] 10.222.0.20 "GET /compute/v2.1/servers/38693017-3b6f-434c-976f-a9733156a115/ips" status: 200 len: 217 microversion: 2.1 time: 0.113107 Oct 27 03:34:34.119066 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1490/3217] 10.222.0.20 () {58 vars in 1248 bytes} [Thu Oct 27 03:34:33 2022] GET /compute/v2.1/servers/38693017-3b6f-434c-976f-a9733156a115/ips => generated 217 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:34:34.142939 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3a3eac1d-6c28-4919-8258-e0cf6fec4f70 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:34.143923 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-3a3eac1d-6c28-4919-8258-e0cf6fec4f70 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] [instance: 53d360ec-9026-453d-a4a5-39a5f684b2c3] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:34.152605 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3a3eac1d-6c28-4919-8258-e0cf6fec4f70 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:34.153475 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3a3eac1d-6c28-4919-8258-e0cf6fec4f70 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:34.155599 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3a3eac1d-6c28-4919-8258-e0cf6fec4f70 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:34.157084 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3a3eac1d-6c28-4919-8258-e0cf6fec4f70 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:34.158014 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3a3eac1d-6c28-4919-8258-e0cf6fec4f70 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:34.158893 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3a3eac1d-6c28-4919-8258-e0cf6fec4f70 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:34.332926 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-82ece43d-a2f1-4d27-a202-811d6d60a9f5 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "POST /compute/v2.1/servers/8184dc7a-d6db-4374-ace1-f26377f26187/action" status: 200 len: 8207 microversion: 2.1 time: 0.878743 Oct 27 03:34:34.332926 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1728/3218] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:34:33 2022] POST /compute/v2.1/servers/8184dc7a-d6db-4374-ace1-f26377f26187/action => generated 8207 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:34.337022 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-50a7a75c-d080-4521-8048-78af52f9d780 tempest-SecurityGroupRulesTestJSON-368356497 tempest-SecurityGroupRulesTestJSON-368356497-project] Action: 'create', calling method: .version_select at 0x7f7ddac48c10>, body: {"security_group_rule": {"parent_group_id": "1478f862-b3dc-44fd-9739-16089e8bd80c", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:34:34.429627 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-3a3eac1d-6c28-4919-8258-e0cf6fec4f70 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcff40b520f749f2b4bca5eed0923504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbc26f2331d47e5863e8dbf1952906c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:34.440892 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3a3eac1d-6c28-4919-8258-e0cf6fec4f70 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] 10.222.0.20 "GET /compute/v2.1/servers/53d360ec-9026-453d-a4a5-39a5f684b2c3" status: 200 len: 1315 microversion: 2.1 time: 0.318732 Oct 27 03:34:34.445333 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1491/3219] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:34 2022] GET /compute/v2.1/servers/53d360ec-9026-453d-a4a5-39a5f684b2c3 => generated 1315 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:34.451065 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0e7b3928-5054-421c-ab00-a7e44ce38c24 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:34.452074 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0e7b3928-5054-421c-ab00-a7e44ce38c24 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] [instance: 38693017-3b6f-434c-976f-a9733156a115] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:34.472475 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0e7b3928-5054-421c-ab00-a7e44ce38c24 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:34.476098 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0e7b3928-5054-421c-ab00-a7e44ce38c24 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:34.476722 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0e7b3928-5054-421c-ab00-a7e44ce38c24 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:34.477503 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0e7b3928-5054-421c-ab00-a7e44ce38c24 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:34.477986 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0e7b3928-5054-421c-ab00-a7e44ce38c24 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:34.478455 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0e7b3928-5054-421c-ab00-a7e44ce38c24 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:34.577416 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0e7b3928-5054-421c-ab00-a7e44ce38c24 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] [instance: 38693017-3b6f-434c-976f-a9733156a115] Going to try to terminate instance {{(pid=121000) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:34:34.777651 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:34:34.988078 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0e7b3928-5054-421c-ab00-a7e44ce38c24 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] 10.222.0.20 "DELETE /compute/v2.1/servers/38693017-3b6f-434c-976f-a9733156a115" status: 204 len: 0 microversion: 2.1 time: 0.540884 Oct 27 03:34:34.992122 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1492/3220] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:34:34 2022] DELETE /compute/v2.1/servers/38693017-3b6f-434c-976f-a9733156a115 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:34:35.001969 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9313fa52-bdb4-46b2-8df1-05f3e8439325 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:35.001969 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9313fa52-bdb4-46b2-8df1-05f3e8439325 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:35.015376 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9313fa52-bdb4-46b2-8df1-05f3e8439325 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:35.018270 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9313fa52-bdb4-46b2-8df1-05f3e8439325 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:35.020433 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9313fa52-bdb4-46b2-8df1-05f3e8439325 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:35.022773 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9313fa52-bdb4-46b2-8df1-05f3e8439325 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:35.026295 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9313fa52-bdb4-46b2-8df1-05f3e8439325 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:35.026950 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9313fa52-bdb4-46b2-8df1-05f3e8439325 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:35.153042 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-50a7a75c-d080-4521-8048-78af52f9d780 tempest-SecurityGroupRulesTestJSON-368356497 tempest-SecurityGroupRulesTestJSON-368356497-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.820146 Oct 27 03:34:35.154508 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1729/3221] 10.222.0.20 () {60 vars in 1195 bytes} [Thu Oct 27 03:34:34 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:34:35.160456 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-555c6694-5d04-476e-be5f-1c7771e8fce0 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:35.161882 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-555c6694-5d04-476e-be5f-1c7771e8fce0 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:35.175790 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-555c6694-5d04-476e-be5f-1c7771e8fce0 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:35.176288 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-555c6694-5d04-476e-be5f-1c7771e8fce0 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:35.176743 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-555c6694-5d04-476e-be5f-1c7771e8fce0 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:35.183323 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-555c6694-5d04-476e-be5f-1c7771e8fce0 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:35.184496 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-555c6694-5d04-476e-be5f-1c7771e8fce0 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:35.189839 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-555c6694-5d04-476e-be5f-1c7771e8fce0 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:35.230490 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9313fa52-bdb4-46b2-8df1-05f3e8439325 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:35.242181 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9313fa52-bdb4-46b2-8df1-05f3e8439325 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1268 microversion: 2.1 time: 0.247905 Oct 27 03:34:35.242794 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1493/3222] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:34 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1268 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:35.261561 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3ca7d204-8bb0-4505-9970-02bf62c2f7e8 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:35.261561 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-3ca7d204-8bb0-4505-9970-02bf62c2f7e8 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] [instance: 004575c6-51ce-48d9-b7a6-d50f9afdb0a0] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:35.266415 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3ca7d204-8bb0-4505-9970-02bf62c2f7e8 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:35.267123 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3ca7d204-8bb0-4505-9970-02bf62c2f7e8 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:35.267747 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3ca7d204-8bb0-4505-9970-02bf62c2f7e8 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:35.268697 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3ca7d204-8bb0-4505-9970-02bf62c2f7e8 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:35.269337 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3ca7d204-8bb0-4505-9970-02bf62c2f7e8 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:35.269940 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3ca7d204-8bb0-4505-9970-02bf62c2f7e8 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:35.657061 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-555c6694-5d04-476e-be5f-1c7771e8fce0 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:35.671826 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-555c6694-5d04-476e-be5f-1c7771e8fce0 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1669 microversion: 2.1 time: 0.516188 Oct 27 03:34:35.705581 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1730/3223] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:35 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1669 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:35.711840 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-25ca3a4f-64c0-48e1-812c-e7749bd7f5d0 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:35.712855 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-25ca3a4f-64c0-48e1-812c-e7749bd7f5d0 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] [instance: 38693017-3b6f-434c-976f-a9733156a115] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:35.736258 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-25ca3a4f-64c0-48e1-812c-e7749bd7f5d0 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:35.737328 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-25ca3a4f-64c0-48e1-812c-e7749bd7f5d0 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:35.737962 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-25ca3a4f-64c0-48e1-812c-e7749bd7f5d0 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:35.738908 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-25ca3a4f-64c0-48e1-812c-e7749bd7f5d0 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:35.748359 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-25ca3a4f-64c0-48e1-812c-e7749bd7f5d0 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:35.749196 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-25ca3a4f-64c0-48e1-812c-e7749bd7f5d0 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:35.987806 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-3ca7d204-8bb0-4505-9970-02bf62c2f7e8 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae7845f6759c4dcabcc1516a72484174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d371ab6648425eac2cf1702f2789dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:35.997083 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3ca7d204-8bb0-4505-9970-02bf62c2f7e8 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/servers/004575c6-51ce-48d9-b7a6-d50f9afdb0a0" status: 200 len: 1318 microversion: 2.1 time: 0.753123 Oct 27 03:34:35.998052 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1494/3224] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:35 2022] GET /compute/v2.1/servers/004575c6-51ce-48d9-b7a6-d50f9afdb0a0 => generated 1318 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:36.004048 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-3943f14f-dd03-479f-9afa-c33ec73f9038 req-c35525f5-fec2-4a46-be2e-07f87dfc721f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "004575c6-51ce-48d9-b7a6-d50f9afdb0a0", "tag": "5deebc19-88cc-4f7e-98b2-66507a85ce83"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:34:36.016025 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-3943f14f-dd03-479f-9afa-c33ec73f9038 req-c35525f5-fec2-4a46-be2e-07f87dfc721f service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:36.016591 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-3943f14f-dd03-479f-9afa-c33ec73f9038 req-c35525f5-fec2-4a46-be2e-07f87dfc721f service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:36.017316 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-3943f14f-dd03-479f-9afa-c33ec73f9038 req-c35525f5-fec2-4a46-be2e-07f87dfc721f service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:36.030934 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-3943f14f-dd03-479f-9afa-c33ec73f9038 req-c35525f5-fec2-4a46-be2e-07f87dfc721f service nova] Creating event network-changed:5deebc19-88cc-4f7e-98b2-66507a85ce83 for instance 004575c6-51ce-48d9-b7a6-d50f9afdb0a0 on n-h1-862769-1 Oct 27 03:34:36.036603 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-3943f14f-dd03-479f-9afa-c33ec73f9038 req-c35525f5-fec2-4a46-be2e-07f87dfc721f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037278 Oct 27 03:34:36.037291 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1495/3225] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:34:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:34:36.043333 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5fa46cd5-e53d-44d6-b4e7-efc34684d99d tempest-SecurityGroupRulesTestJSON-368356497 tempest-SecurityGroupRulesTestJSON-368356497-project] Action: 'create', calling method: .version_select at 0x7f7dd9e43940>, body: {"security_group_rule": {"parent_group_id": "1478f862-b3dc-44fd-9739-16089e8bd80c", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:34:36.338467 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-25ca3a4f-64c0-48e1-812c-e7749bd7f5d0 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881f054c84d04ceaa17a5817816022d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2057593072c14804ab70fe4bdea2c17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:36.348064 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-25ca3a4f-64c0-48e1-812c-e7749bd7f5d0 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] 10.222.0.20 "GET /compute/v2.1/servers/38693017-3b6f-434c-976f-a9733156a115" status: 200 len: 1809 microversion: 2.1 time: 0.640987 Oct 27 03:34:36.349264 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1731/3226] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:35 2022] GET /compute/v2.1/servers/38693017-3b6f-434c-976f-a9733156a115 => generated 1809 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:36.355067 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-bfb463c2-0432-4816-a98a-ab1b08200a62 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:36.355896 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-bfb463c2-0432-4816-a98a-ab1b08200a62 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] [instance: 53d360ec-9026-453d-a4a5-39a5f684b2c3] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:36.362705 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bfb463c2-0432-4816-a98a-ab1b08200a62 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:36.363964 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bfb463c2-0432-4816-a98a-ab1b08200a62 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:36.364619 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bfb463c2-0432-4816-a98a-ab1b08200a62 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:36.365545 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bfb463c2-0432-4816-a98a-ab1b08200a62 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:36.366242 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bfb463c2-0432-4816-a98a-ab1b08200a62 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:36.366797 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bfb463c2-0432-4816-a98a-ab1b08200a62 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:36.620539 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-bfb463c2-0432-4816-a98a-ab1b08200a62 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcff40b520f749f2b4bca5eed0923504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbc26f2331d47e5863e8dbf1952906c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:36.637023 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-bfb463c2-0432-4816-a98a-ab1b08200a62 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] 10.222.0.20 "GET /compute/v2.1/servers/53d360ec-9026-453d-a4a5-39a5f684b2c3" status: 200 len: 1315 microversion: 2.1 time: 0.285992 Oct 27 03:34:36.637620 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1732/3227] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:36 2022] GET /compute/v2.1/servers/53d360ec-9026-453d-a4a5-39a5f684b2c3 => generated 1315 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:36.643051 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a57a4c47-6591-4180-8aec-d84205763cfa tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:36.644666 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a57a4c47-6591-4180-8aec-d84205763cfa tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:36.652656 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a57a4c47-6591-4180-8aec-d84205763cfa tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:36.653090 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a57a4c47-6591-4180-8aec-d84205763cfa tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:36.653598 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a57a4c47-6591-4180-8aec-d84205763cfa tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:36.658079 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a57a4c47-6591-4180-8aec-d84205763cfa tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:36.658079 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a57a4c47-6591-4180-8aec-d84205763cfa tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:36.658079 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a57a4c47-6591-4180-8aec-d84205763cfa tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:36.728492 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5fa46cd5-e53d-44d6-b4e7-efc34684d99d tempest-SecurityGroupRulesTestJSON-368356497 tempest-SecurityGroupRulesTestJSON-368356497-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.689962 Oct 27 03:34:36.729448 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1496/3228] 10.222.0.20 () {60 vars in 1195 bytes} [Thu Oct 27 03:34:36 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:34:36.742502 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7f0e2014-597a-46fa-890f-d3bc5ee217d9 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Action: 'create', calling method: .version_select at 0x7f7ddecc11f0>, body: {"keypair": {"name": "tempest-keypair-501150173", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNOTlUbNnS2iJiMMc9OeZVqTNa8Nu8nCI9BsRu772eO2g0ls2Kvno5WD7VSwvfCp/T/uLCwzdjcneeieC4cw0D+WEHHsrNjtCJd+R3Iai1thXdV60HGREu2/6+B/rOfEfA=="}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:34:36.793329 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-7f0e2014-597a-46fa-890f-d3bc5ee217d9 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Getting quotas for project 296abb4b5dde441da95f4d09089f348e. Resources: {'key_pairs'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:34:36.808688 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-7f0e2014-597a-46fa-890f-d3bc5ee217d9 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Getting quotas for user 0d9053ce63864308b29190f9f51bd85f and project 296abb4b5dde441da95f4d09089f348e. Resources: {'key_pairs'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:34:36.922721 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7f0e2014-597a-46fa-890f-d3bc5ee217d9 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.42 time: 0.191547 Oct 27 03:34:36.925185 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1497/3229] 10.222.0.20 () {62 vars in 1200 bytes} [Thu Oct 27 03:34:36 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 194 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 27 03:34:36.931005 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-131c3fe2-f44a-4e4d-af23-a73314cefe89 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:36.933767 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-131c3fe2-f44a-4e4d-af23-a73314cefe89 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:36.949882 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-131c3fe2-f44a-4e4d-af23-a73314cefe89 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:36.953515 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-131c3fe2-f44a-4e4d-af23-a73314cefe89 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:36.953515 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-131c3fe2-f44a-4e4d-af23-a73314cefe89 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:36.953515 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-131c3fe2-f44a-4e4d-af23-a73314cefe89 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:36.957438 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-131c3fe2-f44a-4e4d-af23-a73314cefe89 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:36.958305 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-131c3fe2-f44a-4e4d-af23-a73314cefe89 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:37.232682 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-131c3fe2-f44a-4e4d-af23-a73314cefe89 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:37.246809 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-131c3fe2-f44a-4e4d-af23-a73314cefe89 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1286 microversion: 2.1 time: 0.320266 Oct 27 03:34:37.248222 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1498/3230] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:36 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1286 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:37.254504 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-315d7279-ffea-4f3c-88a3-ddd2d21f819f tempest-SecurityGroupRulesTestJSON-368356497 tempest-SecurityGroupRulesTestJSON-368356497-project] Calling method '.version_select at 0x7f7dda275310>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:37.321860 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a57a4c47-6591-4180-8aec-d84205763cfa tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:37.331456 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a57a4c47-6591-4180-8aec-d84205763cfa tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1669 microversion: 2.1 time: 0.692562 Oct 27 03:34:37.332057 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1733/3231] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:36 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1669 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:37.339687 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d5fd7b51-efe1-44f8-993e-d603d0bcbb02 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:37.340954 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d5fd7b51-efe1-44f8-993e-d603d0bcbb02 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] [instance: 004575c6-51ce-48d9-b7a6-d50f9afdb0a0] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:37.368761 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d5fd7b51-efe1-44f8-993e-d603d0bcbb02 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:37.369502 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d5fd7b51-efe1-44f8-993e-d603d0bcbb02 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:37.370849 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d5fd7b51-efe1-44f8-993e-d603d0bcbb02 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:37.371918 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d5fd7b51-efe1-44f8-993e-d603d0bcbb02 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:37.373100 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d5fd7b51-efe1-44f8-993e-d603d0bcbb02 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:37.375047 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d5fd7b51-efe1-44f8-993e-d603d0bcbb02 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:37.484543 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-315d7279-ffea-4f3c-88a3-ddd2d21f819f tempest-SecurityGroupRulesTestJSON-368356497 tempest-SecurityGroupRulesTestJSON-368356497-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups/1478f862-b3dc-44fd-9739-16089e8bd80c" status: 200 len: 664 microversion: 2.1 time: 0.234160 Oct 27 03:34:37.487140 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1499/3232] 10.222.0.20 () {58 vars in 1269 bytes} [Thu Oct 27 03:34:37 2022] GET /compute/v2.1/os-security-groups/1478f862-b3dc-44fd-9739-16089e8bd80c => generated 664 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:34:37.508281 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-17b3a5d4-8dd6-45eb-bd69-da63f37f3e9b tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:37.509688 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-17b3a5d4-8dd6-45eb-bd69-da63f37f3e9b tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:37.532921 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-17b3a5d4-8dd6-45eb-bd69-da63f37f3e9b tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:37.534483 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-17b3a5d4-8dd6-45eb-bd69-da63f37f3e9b tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:37.535386 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-17b3a5d4-8dd6-45eb-bd69-da63f37f3e9b tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:37.538268 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-17b3a5d4-8dd6-45eb-bd69-da63f37f3e9b tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:37.539742 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-17b3a5d4-8dd6-45eb-bd69-da63f37f3e9b tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:37.540363 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-17b3a5d4-8dd6-45eb-bd69-da63f37f3e9b tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:37.920178 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d5fd7b51-efe1-44f8-993e-d603d0bcbb02 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae7845f6759c4dcabcc1516a72484174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d371ab6648425eac2cf1702f2789dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:37.951320 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d5fd7b51-efe1-44f8-993e-d603d0bcbb02 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/servers/004575c6-51ce-48d9-b7a6-d50f9afdb0a0" status: 200 len: 1318 microversion: 2.1 time: 0.597449 Oct 27 03:34:37.951320 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1734/3233] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:37 2022] GET /compute/v2.1/servers/004575c6-51ce-48d9-b7a6-d50f9afdb0a0 => generated 1318 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:37.951320 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d544f79c-3c8e-4c26-8c60-a1009f12e429 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:37.951320 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d544f79c-3c8e-4c26-8c60-a1009f12e429 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] [instance: 38693017-3b6f-434c-976f-a9733156a115] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:37.967651 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d544f79c-3c8e-4c26-8c60-a1009f12e429 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:37.967651 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d544f79c-3c8e-4c26-8c60-a1009f12e429 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:37.967651 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d544f79c-3c8e-4c26-8c60-a1009f12e429 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:37.967651 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d544f79c-3c8e-4c26-8c60-a1009f12e429 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:37.967651 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d544f79c-3c8e-4c26-8c60-a1009f12e429 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:37.967651 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d544f79c-3c8e-4c26-8c60-a1009f12e429 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:37.968468 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-17b3a5d4-8dd6-45eb-bd69-da63f37f3e9b tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:37.989105 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-17b3a5d4-8dd6-45eb-bd69-da63f37f3e9b tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1669 microversion: 2.1 time: 0.500524 Oct 27 03:34:37.996831 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1500/3234] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:37 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1669 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:38.004270 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4f9d8173-5873-47c1-8eaa-cb1a40582bba tempest-SecurityGroupRulesTestJSON-368356497 tempest-SecurityGroupRulesTestJSON-368356497-project] Calling method '.version_select at 0x7f7ddb207dc0>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:38.425234 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d544f79c-3c8e-4c26-8c60-a1009f12e429 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881f054c84d04ceaa17a5817816022d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2057593072c14804ab70fe4bdea2c17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:38.442455 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d544f79c-3c8e-4c26-8c60-a1009f12e429 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] 10.222.0.20 "GET /compute/v2.1/servers/38693017-3b6f-434c-976f-a9733156a115" status: 200 len: 1809 microversion: 2.1 time: 0.506613 Oct 27 03:34:38.443062 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1735/3235] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:37 2022] GET /compute/v2.1/servers/38693017-3b6f-434c-976f-a9733156a115 => generated 1809 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:38.466194 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ed1d1b48-8dc2-4ddb-8b24-198dbd2ba3f6 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:38.470767 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ed1d1b48-8dc2-4ddb-8b24-198dbd2ba3f6 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] [instance: 53d360ec-9026-453d-a4a5-39a5f684b2c3] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:38.491572 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ed1d1b48-8dc2-4ddb-8b24-198dbd2ba3f6 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:38.492488 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ed1d1b48-8dc2-4ddb-8b24-198dbd2ba3f6 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:38.493112 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ed1d1b48-8dc2-4ddb-8b24-198dbd2ba3f6 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:38.494065 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ed1d1b48-8dc2-4ddb-8b24-198dbd2ba3f6 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:38.498417 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ed1d1b48-8dc2-4ddb-8b24-198dbd2ba3f6 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:38.499048 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ed1d1b48-8dc2-4ddb-8b24-198dbd2ba3f6 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:39.012244 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ed1d1b48-8dc2-4ddb-8b24-198dbd2ba3f6 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcff40b520f749f2b4bca5eed0923504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbc26f2331d47e5863e8dbf1952906c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:39.020760 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ed1d1b48-8dc2-4ddb-8b24-198dbd2ba3f6 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] 10.222.0.20 "GET /compute/v2.1/servers/53d360ec-9026-453d-a4a5-39a5f684b2c3" status: 200 len: 1315 microversion: 2.1 time: 0.574400 Oct 27 03:34:39.021624 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1736/3236] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:38 2022] GET /compute/v2.1/servers/53d360ec-9026-453d-a4a5-39a5f684b2c3 => generated 1315 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:39.035093 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-92ba7b4d-ea98-4a4d-8361-4a0f17e6be56 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:39.035876 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-92ba7b4d-ea98-4a4d-8361-4a0f17e6be56 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:39.048838 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-92ba7b4d-ea98-4a4d-8361-4a0f17e6be56 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:39.049370 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-92ba7b4d-ea98-4a4d-8361-4a0f17e6be56 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:39.049786 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-92ba7b4d-ea98-4a4d-8361-4a0f17e6be56 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:39.050743 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-92ba7b4d-ea98-4a4d-8361-4a0f17e6be56 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:39.053251 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-92ba7b4d-ea98-4a4d-8361-4a0f17e6be56 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:39.054213 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-92ba7b4d-ea98-4a4d-8361-4a0f17e6be56 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:39.065424 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4f9d8173-5873-47c1-8eaa-cb1a40582bba tempest-SecurityGroupRulesTestJSON-368356497 tempest-SecurityGroupRulesTestJSON-368356497-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-group-rules/39eba1b8-fd4f-422e-a6f0-8b95d994bc4e" status: 202 len: 0 microversion: 2.1 time: 1.067089 Oct 27 03:34:39.066608 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1501/3237] 10.222.0.20 () {58 vars in 1287 bytes} [Thu Oct 27 03:34:37 2022] DELETE /compute/v2.1/os-security-group-rules/39eba1b8-fd4f-422e-a6f0-8b95d994bc4e => generated 0 bytes in 1069 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:34:39.076454 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-956c2727-accb-4357-b1f6-22288c03fb19 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:39.077086 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-956c2727-accb-4357-b1f6-22288c03fb19 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:39.092636 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-956c2727-accb-4357-b1f6-22288c03fb19 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:39.095642 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-956c2727-accb-4357-b1f6-22288c03fb19 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:39.096361 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-956c2727-accb-4357-b1f6-22288c03fb19 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:39.097373 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-956c2727-accb-4357-b1f6-22288c03fb19 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:39.108800 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-956c2727-accb-4357-b1f6-22288c03fb19 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:39.112556 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-956c2727-accb-4357-b1f6-22288c03fb19 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:39.362240 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-956c2727-accb-4357-b1f6-22288c03fb19 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:39.374256 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-956c2727-accb-4357-b1f6-22288c03fb19 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1316 microversion: 2.1 time: 0.306510 Oct 27 03:34:39.390408 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1502/3238] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:39 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1316 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:39.390408 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-4dabd7c5-c8e9-49e2-b06a-f1633a1e0305 req-e68c1585-48a1-4623-980f-cea139d3ca1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38693017-3b6f-434c-976f-a9733156a115", "name": "network-vif-deleted", "tag": "473d6bda-acfa-4fd9-be94-64718ac6a5b8"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:34:39.394294 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-4dabd7c5-c8e9-49e2-b06a-f1633a1e0305 req-e68c1585-48a1-4623-980f-cea139d3ca1c service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:39.394507 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-4dabd7c5-c8e9-49e2-b06a-f1633a1e0305 req-e68c1585-48a1-4623-980f-cea139d3ca1c service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:39.395007 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-4dabd7c5-c8e9-49e2-b06a-f1633a1e0305 req-e68c1585-48a1-4623-980f-cea139d3ca1c service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:39.411306 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-4dabd7c5-c8e9-49e2-b06a-f1633a1e0305 req-e68c1585-48a1-4623-980f-cea139d3ca1c service nova] Creating event network-vif-deleted:473d6bda-acfa-4fd9-be94-64718ac6a5b8 for instance 38693017-3b6f-434c-976f-a9733156a115 on n-h2-862769-1 Oct 27 03:34:39.419109 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-4dabd7c5-c8e9-49e2-b06a-f1633a1e0305 req-e68c1585-48a1-4623-980f-cea139d3ca1c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041910 Oct 27 03:34:39.420440 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1503/3239] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:34:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:34:39.429276 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-06ef3877-7b14-4b64-81ff-c92954f2a61c tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:39.431200 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-06ef3877-7b14-4b64-81ff-c92954f2a61c tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] [instance: 004575c6-51ce-48d9-b7a6-d50f9afdb0a0] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:39.441613 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-06ef3877-7b14-4b64-81ff-c92954f2a61c tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:39.442562 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-06ef3877-7b14-4b64-81ff-c92954f2a61c tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:39.443179 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-06ef3877-7b14-4b64-81ff-c92954f2a61c tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:39.444812 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-06ef3877-7b14-4b64-81ff-c92954f2a61c tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:39.445475 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-06ef3877-7b14-4b64-81ff-c92954f2a61c tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:39.446191 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-06ef3877-7b14-4b64-81ff-c92954f2a61c tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:39.563782 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-92ba7b4d-ea98-4a4d-8361-4a0f17e6be56 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:39.576552 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-92ba7b4d-ea98-4a4d-8361-4a0f17e6be56 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1669 microversion: 2.1 time: 0.553463 Oct 27 03:34:39.590066 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1737/3240] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:39 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1669 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:39.590300 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-514ce1b1-4396-4b2c-a790-7d557749a1c9 tempest-SecurityGroupRulesTestJSON-368356497 tempest-SecurityGroupRulesTestJSON-368356497-project] Calling method '.version_select at 0x7f7dd9fb2820>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:39.664521 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-06ef3877-7b14-4b64-81ff-c92954f2a61c tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae7845f6759c4dcabcc1516a72484174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d371ab6648425eac2cf1702f2789dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:39.675570 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-06ef3877-7b14-4b64-81ff-c92954f2a61c tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/servers/004575c6-51ce-48d9-b7a6-d50f9afdb0a0" status: 200 len: 1318 microversion: 2.1 time: 0.252520 Oct 27 03:34:39.678055 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1504/3241] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:39 2022] GET /compute/v2.1/servers/004575c6-51ce-48d9-b7a6-d50f9afdb0a0 => generated 1318 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:39.687953 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0afc7567-2965-4896-97d6-4a952e482643 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:39.687953 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0afc7567-2965-4896-97d6-4a952e482643 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] [instance: 38693017-3b6f-434c-976f-a9733156a115] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:39.696984 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0afc7567-2965-4896-97d6-4a952e482643 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:39.698084 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0afc7567-2965-4896-97d6-4a952e482643 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:39.698982 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0afc7567-2965-4896-97d6-4a952e482643 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:39.700238 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0afc7567-2965-4896-97d6-4a952e482643 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:39.701077 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0afc7567-2965-4896-97d6-4a952e482643 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:39.701930 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0afc7567-2965-4896-97d6-4a952e482643 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:39.947064 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0afc7567-2965-4896-97d6-4a952e482643 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881f054c84d04ceaa17a5817816022d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2057593072c14804ab70fe4bdea2c17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:39.967609 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0afc7567-2965-4896-97d6-4a952e482643 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] 10.222.0.20 "GET /compute/v2.1/servers/38693017-3b6f-434c-976f-a9733156a115" status: 200 len: 1673 microversion: 2.1 time: 0.287405 Oct 27 03:34:39.971444 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1505/3242] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:39 2022] GET /compute/v2.1/servers/38693017-3b6f-434c-976f-a9733156a115 => generated 1673 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:39.983118 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-97e878f4-3956-473e-9146-a417e9244ff4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:34:39.988372 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-97e878f4-3956-473e-9146-a417e9244ff4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:39.997996 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-97e878f4-3956-473e-9146-a417e9244ff4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:39.998993 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-97e878f4-3956-473e-9146-a417e9244ff4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:40.000866 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-97e878f4-3956-473e-9146-a417e9244ff4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:40.002109 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-97e878f4-3956-473e-9146-a417e9244ff4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:40.003331 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-97e878f4-3956-473e-9146-a417e9244ff4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:40.004195 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-97e878f4-3956-473e-9146-a417e9244ff4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:40.254657 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-97e878f4-3956-473e-9146-a417e9244ff4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Locking {{(pid=121000) lock /opt/stack/nova/nova/compute/api.py:4845}} Oct 27 03:34:40.443450 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-97e878f4-3956-473e-9146-a417e9244ff4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "POST /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86/action" status: 202 len: 0 microversion: 2.1 time: 0.470584 Oct 27 03:34:40.444301 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1506/3243] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:34:39 2022] POST /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86/action => generated 0 bytes in 472 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:34:40.449700 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-16cda4e8-a945-446f-888d-cdbda8715eef tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:40.451664 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-16cda4e8-a945-446f-888d-cdbda8715eef tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] [instance: 53d360ec-9026-453d-a4a5-39a5f684b2c3] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:40.465522 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-16cda4e8-a945-446f-888d-cdbda8715eef tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:40.466829 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-16cda4e8-a945-446f-888d-cdbda8715eef tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:40.466829 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-16cda4e8-a945-446f-888d-cdbda8715eef tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:40.467347 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-16cda4e8-a945-446f-888d-cdbda8715eef tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:40.467843 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-16cda4e8-a945-446f-888d-cdbda8715eef tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:40.468320 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-16cda4e8-a945-446f-888d-cdbda8715eef tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:40.772886 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-16cda4e8-a945-446f-888d-cdbda8715eef tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcff40b520f749f2b4bca5eed0923504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbc26f2331d47e5863e8dbf1952906c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:40.791195 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-16cda4e8-a945-446f-888d-cdbda8715eef tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] 10.222.0.20 "GET /compute/v2.1/servers/53d360ec-9026-453d-a4a5-39a5f684b2c3" status: 200 len: 1315 microversion: 2.1 time: 0.345544 Oct 27 03:34:40.806585 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1507/3244] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:40 2022] GET /compute/v2.1/servers/53d360ec-9026-453d-a4a5-39a5f684b2c3 => generated 1315 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:40.813188 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f11540f8-0472-4d10-8038-fc1de9abf153 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:40.814215 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f11540f8-0472-4d10-8038-fc1de9abf153 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:40.820739 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f11540f8-0472-4d10-8038-fc1de9abf153 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:40.821794 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f11540f8-0472-4d10-8038-fc1de9abf153 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:40.822507 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f11540f8-0472-4d10-8038-fc1de9abf153 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:40.823461 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f11540f8-0472-4d10-8038-fc1de9abf153 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:40.824170 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f11540f8-0472-4d10-8038-fc1de9abf153 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:40.824709 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f11540f8-0472-4d10-8038-fc1de9abf153 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:40.865994 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-514ce1b1-4396-4b2c-a790-7d557749a1c9 tempest-SecurityGroupRulesTestJSON-368356497 tempest-SecurityGroupRulesTestJSON-368356497-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/1478f862-b3dc-44fd-9739-16089e8bd80c" status: 202 len: 0 microversion: 2.1 time: 1.279460 Oct 27 03:34:40.866722 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1738/3245] 10.222.0.20 () {58 vars in 1272 bytes} [Thu Oct 27 03:34:39 2022] DELETE /compute/v2.1/os-security-groups/1478f862-b3dc-44fd-9739-16089e8bd80c => generated 0 bytes in 1289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:34:40.871878 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-181fe3a8-0067-4d81-b237-8d6e680ef876 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:40.872874 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-181fe3a8-0067-4d81-b237-8d6e680ef876 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:40.894643 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-181fe3a8-0067-4d81-b237-8d6e680ef876 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:40.896176 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-181fe3a8-0067-4d81-b237-8d6e680ef876 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:40.896840 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-181fe3a8-0067-4d81-b237-8d6e680ef876 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:40.897740 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-181fe3a8-0067-4d81-b237-8d6e680ef876 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:40.898399 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-181fe3a8-0067-4d81-b237-8d6e680ef876 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:40.898996 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-181fe3a8-0067-4d81-b237-8d6e680ef876 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:41.096766 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f11540f8-0472-4d10-8038-fc1de9abf153 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:41.108037 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f11540f8-0472-4d10-8038-fc1de9abf153 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1316 microversion: 2.1 time: 0.299904 Oct 27 03:34:41.109206 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1508/3246] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:40 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1316 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:41.125051 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-d39a34c9-5e52-4d9d-bf09-a7fba25cbf30 req-7fc7618d-770f-4c31-b048-8a7d14c57d84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53d360ec-9026-453d-a4a5-39a5f684b2c3", "name": "network-vif-plugged", "status": "completed", "tag": "9b78254a-b82d-4931-b6bc-b7eb6c9e37ad"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:34:41.135272 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-d39a34c9-5e52-4d9d-bf09-a7fba25cbf30 req-7fc7618d-770f-4c31-b048-8a7d14c57d84 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:41.136103 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-d39a34c9-5e52-4d9d-bf09-a7fba25cbf30 req-7fc7618d-770f-4c31-b048-8a7d14c57d84 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:41.136736 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-d39a34c9-5e52-4d9d-bf09-a7fba25cbf30 req-7fc7618d-770f-4c31-b048-8a7d14c57d84 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:41.150820 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-d39a34c9-5e52-4d9d-bf09-a7fba25cbf30 req-7fc7618d-770f-4c31-b048-8a7d14c57d84 service nova] Creating event network-vif-plugged:9b78254a-b82d-4931-b6bc-b7eb6c9e37ad for instance 53d360ec-9026-453d-a4a5-39a5f684b2c3 on n-h1-862769-1 Oct 27 03:34:41.157239 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-d39a34c9-5e52-4d9d-bf09-a7fba25cbf30 req-7fc7618d-770f-4c31-b048-8a7d14c57d84 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046824 Oct 27 03:34:41.158555 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1509/3247] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:34:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:34:41.174293 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-87134770-f427-4799-92a8-b70a726651f7 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:41.180230 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-87134770-f427-4799-92a8-b70a726651f7 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] [instance: 004575c6-51ce-48d9-b7a6-d50f9afdb0a0] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:41.196621 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-87134770-f427-4799-92a8-b70a726651f7 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:41.197392 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-87134770-f427-4799-92a8-b70a726651f7 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:41.198079 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-87134770-f427-4799-92a8-b70a726651f7 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:41.199055 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-87134770-f427-4799-92a8-b70a726651f7 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:41.199730 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-87134770-f427-4799-92a8-b70a726651f7 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:41.200345 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-87134770-f427-4799-92a8-b70a726651f7 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:41.410618 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-181fe3a8-0067-4d81-b237-8d6e680ef876 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:41.421328 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-181fe3a8-0067-4d81-b237-8d6e680ef876 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1669 microversion: 2.1 time: 0.553632 Oct 27 03:34:41.443600 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1739/3248] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:40 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1669 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:41.450727 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-09c9d09d-0192-499c-a101-906095a426d0 tempest-SecurityGroupRulesTestJSON-368356497 tempest-SecurityGroupRulesTestJSON-368356497-project] Calling method '.version_select at 0x7f7ddaadd700>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:41.457401 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:34:41.484871 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=22 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:34:41.507473 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-87134770-f427-4799-92a8-b70a726651f7 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae7845f6759c4dcabcc1516a72484174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d371ab6648425eac2cf1702f2789dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:41.515658 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-87134770-f427-4799-92a8-b70a726651f7 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/servers/004575c6-51ce-48d9-b7a6-d50f9afdb0a0" status: 200 len: 1318 microversion: 2.1 time: 0.355584 Oct 27 03:34:41.516248 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1510/3249] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:41 2022] GET /compute/v2.1/servers/004575c6-51ce-48d9-b7a6-d50f9afdb0a0 => generated 1318 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:41.520983 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ef9c2f2f-7580-4dcf-a750-a16c3bba20d7 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:41.521703 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ef9c2f2f-7580-4dcf-a750-a16c3bba20d7 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] [instance: 38693017-3b6f-434c-976f-a9733156a115] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:41.527639 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ef9c2f2f-7580-4dcf-a750-a16c3bba20d7 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:41.528121 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ef9c2f2f-7580-4dcf-a750-a16c3bba20d7 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:41.528796 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ef9c2f2f-7580-4dcf-a750-a16c3bba20d7 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:41.529727 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ef9c2f2f-7580-4dcf-a750-a16c3bba20d7 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:41.530426 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ef9c2f2f-7580-4dcf-a750-a16c3bba20d7 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:41.530979 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ef9c2f2f-7580-4dcf-a750-a16c3bba20d7 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:41.570782 n-d-862769-1 devstack@n-api.service[121001]: DEBUG neutronclient.v2_0.client [None req-09c9d09d-0192-499c-a101-906095a426d0 tempest-SecurityGroupRulesTestJSON-368356497 tempest-SecurityGroupRulesTestJSON-368356497-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group cf6ce325-db4a-4904-84a7-5b5c717c254d does not exist", "detail": ""}} {{(pid=121001) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 03:34:41.572203 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.network.security_group_api [None req-09c9d09d-0192-499c-a101-906095a426d0 tempest-SecurityGroupRulesTestJSON-368356497 tempest-SecurityGroupRulesTestJSON-368356497-project] Neutron security group cf6ce325-db4a-4904-84a7-5b5c717c254d not found {{(pid=121001) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 27 03:34:41.573122 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-09c9d09d-0192-499c-a101-906095a426d0 tempest-SecurityGroupRulesTestJSON-368356497 tempest-SecurityGroupRulesTestJSON-368356497-project] HTTP exception thrown: Security group cf6ce325-db4a-4904-84a7-5b5c717c254d does not exist Oct 27 03:34:41.573122 n-d-862769-1 devstack@n-api.service[121001]: Neutron server returns request_ids: ['req-ac9457e3-c7ad-467a-b246-d86ce4a5a9ac'] Oct 27 03:34:41.580860 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-09c9d09d-0192-499c-a101-906095a426d0 tempest-SecurityGroupRulesTestJSON-368356497 tempest-SecurityGroupRulesTestJSON-368356497-project] Request method failure captured: Oct 27 03:34:41.580860 n-d-862769-1 devstack@n-api.service[121001]: request: DELETE /compute/v2.1/os-security-groups/cf6ce325-db4a-4904-84a7-5b5c717c254d HTTP/1.1 Oct 27 03:34:41.580860 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:34:41.580860 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:34:41.580860 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:34:41.580860 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:34:41.580860 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:34:41.580860 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:34:41.580860 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:34:41.580860 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:34:41.580860 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfw1sfzaKKSmOIqBTXR6xfqXMwakrN_qVbgLo3Wc1ozhzb4kNdLy0CmSLKLFswzGvSAwI4N3SbqK13QB7WpP8erNitEtYW96tvFiZB1kQxPKwcrW1UQR4HtDIaPMuSdF6LIvOYoDWjjTS4z-D8gHDpmJONn6wyWCs-1ITg3KM6F1OZ4 Oct 27 03:34:41.580860 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:34:41.580860 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:34:41.580860 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:34:41.580860 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:34:41.580860 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:34:41.580860 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:34:41.580860 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 1073b41a231e4e68be36732b22fcc154 Oct 27 03:34:41.580860 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-368356497 Oct 27 03:34:41.580860 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:34:41.580860 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:34:41.580860 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1073b41a231e4e68be36732b22fcc154"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1073b41a231e4e68be36732b22fcc154"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1073b41a231e4e68be36732b22fcc154"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1073b41a231e4e68be36732b22fcc154"}]}] Oct 27 03:34:41.580860 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-SecurityGroupRulesTestJSON-368356497 Oct 27 03:34:41.580860 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 1073b41a231e4e68be36732b22fcc154 Oct 27 03:34:41.580860 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-368356497 Oct 27 03:34:41.580860 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-SecurityGroupRulesTestJSON-368356497-project Oct 27 03:34:41.580860 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:34:41.580860 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:34:41.580860 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: bab3c739ff0749488193af39cb7ced21 Oct 27 03:34:41.580860 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-SecurityGroupRulesTestJSON-368356497-project Oct 27 03:34:41.580860 n-d-862769-1 devstack@n-api.service[121001]: method: Oct 27 03:34:41.580860 n-d-862769-1 devstack@n-api.service[121001]: exception: Security group cf6ce325-db4a-4904-84a7-5b5c717c254d does not exist Oct 27 03:34:41.580860 n-d-862769-1 devstack@n-api.service[121001]: Neutron server returns request_ids: ['req-ac9457e3-c7ad-467a-b246-d86ce4a5a9ac'] Oct 27 03:34:41.580860 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': 'cf6ce325-db4a-4904-84a7-5b5c717c254d'} Oct 27 03:34:41.580860 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:34:41.580860 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:34:41.580860 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 27 03:34:41.580860 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 27 03:34:41.580860 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:34:41.580860 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:34:41.580860 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 27 03:34:41.580860 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 27 03:34:41.580860 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:34:41.580860 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:34:41.580860 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 27 03:34:41.580860 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 27 03:34:41.580860 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:34:41.580860 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:34:41.580860 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 03:34:41.580860 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 03:34:41.580860 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:34:41.580860 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:34:41.580860 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 03:34:41.580860 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 03:34:41.580860 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:34:41.580860 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:34:41.580860 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 03:34:41.580860 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 03:34:41.580860 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 03:34:41.580860 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 03:34:41.580860 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group cf6ce325-db4a-4904-84a7-5b5c717c254d does not exist Oct 27 03:34:41.592715 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ac9457e3-c7ad-467a-b246-d86ce4a5a9ac'] Oct 27 03:34:41.592715 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:34:41.592715 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:34:41.592715 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:34:41.592715 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:34:41.592715 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 27 03:34:41.592715 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 27 03:34:41.592715 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 27 03:34:41.592715 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 27 03:34:41.592715 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group cf6ce325-db4a-4904-84a7-5b5c717c254d does not exist Oct 27 03:34:41.592715 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ac9457e3-c7ad-467a-b246-d86ce4a5a9ac'] Oct 27 03:34:41.592715 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:34:41.592715 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:34:41.592715 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:34:41.592715 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:34:41.592715 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:34:41.592715 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:34:41.592715 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:34:41.592715 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:34:41.592715 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:34:41.592715 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:34:41.592715 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:34:41.592715 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:34:41.592715 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 27 03:34:41.592715 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 27 03:34:41.592715 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group cf6ce325-db4a-4904-84a7-5b5c717c254d does not exist Oct 27 03:34:41.592715 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ac9457e3-c7ad-467a-b246-d86ce4a5a9ac'] Oct 27 03:34:41.592715 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:34:41.592715 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:34:41.592715 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:34:41.592715 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:34:41.592715 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:34:41.592715 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:34:41.592715 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:34:41.592715 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:34:41.592715 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group cf6ce325-db4a-4904-84a7-5b5c717c254d does not exist Oct 27 03:34:41.592715 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ac9457e3-c7ad-467a-b246-d86ce4a5a9ac'] Oct 27 03:34:41.592715 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:34:41.592715 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-09c9d09d-0192-499c-a101-906095a426d0 tempest-SecurityGroupRulesTestJSON-368356497 tempest-SecurityGroupRulesTestJSON-368356497-project] Returning 404 to user: Security group cf6ce325-db4a-4904-84a7-5b5c717c254d does not exist Oct 27 03:34:41.592715 n-d-862769-1 devstack@n-api.service[121001]: Neutron server returns request_ids: ['req-ac9457e3-c7ad-467a-b246-d86ce4a5a9ac'] {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:34:41.592715 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-09c9d09d-0192-499c-a101-906095a426d0 tempest-SecurityGroupRulesTestJSON-368356497 tempest-SecurityGroupRulesTestJSON-368356497-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/cf6ce325-db4a-4904-84a7-5b5c717c254d" status: 404 len: 194 microversion: 2.1 time: 0.145459 Oct 27 03:34:41.592715 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1740/3250] 10.222.0.20 () {58 vars in 1272 bytes} [Thu Oct 27 03:34:41 2022] DELETE /compute/v2.1/os-security-groups/cf6ce325-db4a-4904-84a7-5b5c717c254d => generated 194 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:34:41.601182 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9a2a02f6-f803-427f-906b-4c391e2aa293 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:34:41.611203 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9a2a02f6-f803-427f-906b-4c391e2aa293 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:41.612427 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9a2a02f6-f803-427f-906b-4c391e2aa293 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:41.613176 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9a2a02f6-f803-427f-906b-4c391e2aa293 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:41.642263 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-9a2a02f6-f803-427f-906b-4c391e2aa293 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] HTTP exception thrown: Instance ed74f42b-af82-4808-bfc2-86110840fe86 is locked Oct 27 03:34:41.644856 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9a2a02f6-f803-427f-906b-4c391e2aa293 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Request method failure captured: Oct 27 03:34:41.644856 n-d-862769-1 devstack@n-api.service[121001]: request: POST /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86/action HTTP/1.1 Oct 27 03:34:41.644856 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:34:41.644856 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:34:41.644856 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:34:41.644856 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 15 Oct 27 03:34:41.644856 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:34:41.644856 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:34:41.644856 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:34:41.644856 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:34:41.644856 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfsa_BAeMB3RnYvkmJQwjLzdAXRwOtmdTc4q-U2TyHH4sY2pC7-yKXDlPkKgdlBzGRlepw8PNzs2kNd86HTPJPZkHZ4DJy78RLBBzCNtKZaBrkpRAbSZW5Gv7329yxsJiAdDbJaiPVC-uHRtJPx_KALbDnjOM5yyEW86DSYN-HLC8ok Oct 27 03:34:41.644856 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:34:41.644856 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:34:41.644856 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:34:41.644856 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:34:41.644856 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:34:41.644856 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:34:41.644856 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 3e9ede68f63747d59153a46412033856 Oct 27 03:34:41.644856 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServerActionsTestJSON-24656121 Oct 27 03:34:41.644856 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:34:41.644856 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:34:41.644856 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3e9ede68f63747d59153a46412033856"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3e9ede68f63747d59153a46412033856"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3e9ede68f63747d59153a46412033856"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3e9ede68f63747d59153a46412033856"}]}] Oct 27 03:34:41.644856 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServerActionsTestJSON-24656121 Oct 27 03:34:41.644856 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 3e9ede68f63747d59153a46412033856 Oct 27 03:34:41.644856 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServerActionsTestJSON-24656121 Oct 27 03:34:41.644856 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServerActionsTestJSON-24656121-project Oct 27 03:34:41.644856 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:34:41.644856 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:34:41.644856 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 94897f20beb94dbd8e7eff6ecba30026 Oct 27 03:34:41.644856 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServerActionsTestJSON-24656121-project Oct 27 03:34:41.644856 n-d-862769-1 devstack@n-api.service[121001]: Oct 27 03:34:41.644856 n-d-862769-1 devstack@n-api.service[121001]: {"os-stop": {}} Oct 27 03:34:41.644856 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:34:41.644856 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance ed74f42b-af82-4808-bfc2-86110840fe86 is locked Oct 27 03:34:41.644856 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': 'ed74f42b-af82-4808-bfc2-86110840fe86', 'body': {'os-stop': {}}} Oct 27 03:34:41.644856 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:34:41.644856 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:34:41.644856 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1449, in _stop_server Oct 27 03:34:41.644856 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Oct 27 03:34:41.644856 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Oct 27 03:34:41.644856 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Oct 27 03:34:41.644856 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance ed74f42b-af82-4808-bfc2-86110840fe86 is locked Oct 27 03:34:41.644856 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:34:41.644856 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:34:41.644856 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:34:41.644856 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:34:41.644856 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:34:41.644856 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:34:41.644856 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:34:41.644856 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:34:41.644856 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:34:41.644856 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:34:41.644856 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1451, in _stop_server Oct 27 03:34:41.644856 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Oct 27 03:34:41.644856 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance ed74f42b-af82-4808-bfc2-86110840fe86 is locked Oct 27 03:34:41.644856 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:34:41.644856 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:34:41.644856 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:34:41.644856 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:34:41.644856 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:34:41.644856 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:34:41.644856 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:34:41.644856 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:34:41.644856 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed74f42b-af82-4808-bfc2-86110840fe86 is locked Oct 27 03:34:41.644856 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:34:41.651274 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9a2a02f6-f803-427f-906b-4c391e2aa293 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Returning 409 to user: Instance ed74f42b-af82-4808-bfc2-86110840fe86 is locked {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:34:41.652361 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9a2a02f6-f803-427f-906b-4c391e2aa293 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "POST /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86/action" status: 409 len: 107 microversion: 2.1 time: 0.059856 Oct 27 03:34:41.663850 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1741/3251] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:34:41 2022] POST /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86/action => generated 107 bytes in 66 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 27 03:34:41.664358 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-2d2bcd7f-4a02-44b9-b7a6-2152a5413f1d req-f2c4b3cd-87ad-4e6f-8056-9c2373d60a61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38693017-3b6f-434c-976f-a9733156a115", "name": "network-vif-deleted", "tag": "b1d5b054-3345-4a5e-a5cd-e36b2aad8574"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:34:41.676853 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-2d2bcd7f-4a02-44b9-b7a6-2152a5413f1d req-f2c4b3cd-87ad-4e6f-8056-9c2373d60a61 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:41.677698 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-2d2bcd7f-4a02-44b9-b7a6-2152a5413f1d req-f2c4b3cd-87ad-4e6f-8056-9c2373d60a61 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:41.678454 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-2d2bcd7f-4a02-44b9-b7a6-2152a5413f1d req-f2c4b3cd-87ad-4e6f-8056-9c2373d60a61 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:41.692173 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-2d2bcd7f-4a02-44b9-b7a6-2152a5413f1d req-f2c4b3cd-87ad-4e6f-8056-9c2373d60a61 service nova] Creating event network-vif-deleted:b1d5b054-3345-4a5e-a5cd-e36b2aad8574 for instance 38693017-3b6f-434c-976f-a9733156a115 on n-h2-862769-1 Oct 27 03:34:41.698853 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-2d2bcd7f-4a02-44b9-b7a6-2152a5413f1d req-f2c4b3cd-87ad-4e6f-8056-9c2373d60a61 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039346 Oct 27 03:34:41.700013 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1742/3252] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:34:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:34:41.706729 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8140beae-88ef-4d19-9e17-346421b4a101 tempest-SecurityGroupRulesTestJSON-368356497 tempest-SecurityGroupRulesTestJSON-368356497-project] Calling method '.version_select at 0x7f7ddac489d0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:41.732098 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ef9c2f2f-7580-4dcf-a750-a16c3bba20d7 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881f054c84d04ceaa17a5817816022d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2057593072c14804ab70fe4bdea2c17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:41.742282 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ef9c2f2f-7580-4dcf-a750-a16c3bba20d7 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] 10.222.0.20 "GET /compute/v2.1/servers/38693017-3b6f-434c-976f-a9733156a115" status: 200 len: 1652 microversion: 2.1 time: 0.224710 Oct 27 03:34:41.743185 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1511/3253] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:41 2022] GET /compute/v2.1/servers/38693017-3b6f-434c-976f-a9733156a115 => generated 1652 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:41.756901 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-59f66a4a-1d6f-4677-86cf-0bf93c719a14 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:34:41.758437 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-59f66a4a-1d6f-4677-86cf-0bf93c719a14 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:41.766121 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-59f66a4a-1d6f-4677-86cf-0bf93c719a14 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:41.766636 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-59f66a4a-1d6f-4677-86cf-0bf93c719a14 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:41.767216 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-59f66a4a-1d6f-4677-86cf-0bf93c719a14 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:41.767796 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-59f66a4a-1d6f-4677-86cf-0bf93c719a14 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:41.768258 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-59f66a4a-1d6f-4677-86cf-0bf93c719a14 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:41.768696 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-59f66a4a-1d6f-4677-86cf-0bf93c719a14 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:41.789256 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:34:41.980371 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-59f66a4a-1d6f-4677-86cf-0bf93c719a14 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Unlocking {{(pid=121000) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 27 03:34:42.173010 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-59f66a4a-1d6f-4677-86cf-0bf93c719a14 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "POST /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86/action" status: 202 len: 0 microversion: 2.1 time: 0.424530 Oct 27 03:34:42.173010 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1512/3254] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:34:41 2022] POST /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86/action => generated 0 bytes in 426 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:34:42.174718 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-144f3c7c-223b-4043-876b-8497ac4bf527 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-372079024", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "9ed2e292-bff8-4a9e-89c7-0a7192e56848"}, {"port": "40696ddf-b935-4016-95dc-a4e42979795f", "tag": "port-1"}, {"port": "3eb3290d-51f2-4707-9c45-ff4cde5ca958", "tag": "port-2"}, {"uuid": "ece288f4-7e4c-4ab1-84b8-5be1cff486d1", "tag": "net-1"}, {"uuid": "ece288f4-7e4c-4ab1-84b8-5be1cff486d1"}, {"uuid": "d7b1f5fb-6e9b-47b9-80f5-4225161c452f", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "d7b1f5fb-6e9b-47b9-80f5-4225161c452f", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "88856a87-5f76-4146-ab9e-2dae0ca5c184", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "fe3b5449-d820-4c7c-8a30-57720b9e6de0", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "2ed74b62-33ef-4afa-a92f-0fb3e658ea9c", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1329332511"}], "key_name": "tempest-keypair-501150173", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:34:42.312708 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-144f3c7c-223b-4043-876b-8497ac4bf527 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] validate_networks() for [('9ed2e292-bff8-4a9e-89c7-0a7192e56848', None, None, None, None, None), (None, None, '40696ddf-b935-4016-95dc-a4e42979795f', None, None, None), (None, None, '3eb3290d-51f2-4707-9c45-ff4cde5ca958', None, None, None), ('ece288f4-7e4c-4ab1-84b8-5be1cff486d1', None, None, None, None, None), ('ece288f4-7e4c-4ab1-84b8-5be1cff486d1', None, None, None, None, None), ('d7b1f5fb-6e9b-47b9-80f5-4225161c452f', '10.2.2.100', None, None, None, None), ('d7b1f5fb-6e9b-47b9-80f5-4225161c452f', '10.2.2.200', None, None, None, None)] {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:34:42.588442 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8140beae-88ef-4d19-9e17-346421b4a101 tempest-SecurityGroupRulesTestJSON-368356497 tempest-SecurityGroupRulesTestJSON-368356497-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/7478599b-0ef0-46a2-ba0b-7ff47b8ce841" status: 202 len: 0 microversion: 2.1 time: 0.881495 Oct 27 03:34:42.593912 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1743/3255] 10.222.0.20 () {58 vars in 1272 bytes} [Thu Oct 27 03:34:41 2022] DELETE /compute/v2.1/os-security-groups/7478599b-0ef0-46a2-ba0b-7ff47b8ce841 => generated 0 bytes in 893 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:34:42.619075 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4e85a88c-c11b-4b43-ac29-f10ad1bf03df tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:42.621714 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4e85a88c-c11b-4b43-ac29-f10ad1bf03df tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] [instance: 53d360ec-9026-453d-a4a5-39a5f684b2c3] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:42.636858 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4e85a88c-c11b-4b43-ac29-f10ad1bf03df tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:42.638123 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4e85a88c-c11b-4b43-ac29-f10ad1bf03df tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:42.638787 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4e85a88c-c11b-4b43-ac29-f10ad1bf03df tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:42.639725 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4e85a88c-c11b-4b43-ac29-f10ad1bf03df tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:42.641380 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4e85a88c-c11b-4b43-ac29-f10ad1bf03df tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:42.642515 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4e85a88c-c11b-4b43-ac29-f10ad1bf03df tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:42.923363 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4e85a88c-c11b-4b43-ac29-f10ad1bf03df tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcff40b520f749f2b4bca5eed0923504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbc26f2331d47e5863e8dbf1952906c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:42.931801 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4e85a88c-c11b-4b43-ac29-f10ad1bf03df tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] 10.222.0.20 "GET /compute/v2.1/servers/53d360ec-9026-453d-a4a5-39a5f684b2c3" status: 200 len: 1315 microversion: 2.1 time: 0.336452 Oct 27 03:34:42.936583 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1744/3256] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:42 2022] GET /compute/v2.1/servers/53d360ec-9026-453d-a4a5-39a5f684b2c3 => generated 1315 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:42.947808 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1e51a6a6-1874-4478-a7ce-90019e03696e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:42.950149 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1e51a6a6-1874-4478-a7ce-90019e03696e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:42.956755 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1e51a6a6-1874-4478-a7ce-90019e03696e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:42.957579 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1e51a6a6-1874-4478-a7ce-90019e03696e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:42.958134 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1e51a6a6-1874-4478-a7ce-90019e03696e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:42.964630 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1e51a6a6-1874-4478-a7ce-90019e03696e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:42.965277 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1e51a6a6-1874-4478-a7ce-90019e03696e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:42.965878 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1e51a6a6-1874-4478-a7ce-90019e03696e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:43.214305 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1e51a6a6-1874-4478-a7ce-90019e03696e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:43.228519 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1e51a6a6-1874-4478-a7ce-90019e03696e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1316 microversion: 2.1 time: 0.289505 Oct 27 03:34:43.229121 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1745/3257] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:42 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1316 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:43.235859 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-fc12ce30-cc1f-4b29-ba1d-dafb8983238b tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:34:43.244846 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fc12ce30-cc1f-4b29-ba1d-dafb8983238b tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:43.248113 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fc12ce30-cc1f-4b29-ba1d-dafb8983238b tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:43.248113 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fc12ce30-cc1f-4b29-ba1d-dafb8983238b tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:43.249681 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=100 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:34:43.271526 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-fc12ce30-cc1f-4b29-ba1d-dafb8983238b tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Going to try to stop instance {{(pid=121001) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 27 03:34:43.516612 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-fc12ce30-cc1f-4b29-ba1d-dafb8983238b tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "POST /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86/action" status: 202 len: 0 microversion: 2.1 time: 0.285078 Oct 27 03:34:43.520620 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1746/3258] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:34:43 2022] POST /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86/action => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:34:43.523411 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-eaa3fc01-b13b-42d6-87da-bb994e0194d2 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:43.524120 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-eaa3fc01-b13b-42d6-87da-bb994e0194d2 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] [instance: 004575c6-51ce-48d9-b7a6-d50f9afdb0a0] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:43.532285 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eaa3fc01-b13b-42d6-87da-bb994e0194d2 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:43.532930 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eaa3fc01-b13b-42d6-87da-bb994e0194d2 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:43.533371 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eaa3fc01-b13b-42d6-87da-bb994e0194d2 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:43.534164 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eaa3fc01-b13b-42d6-87da-bb994e0194d2 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:43.534679 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eaa3fc01-b13b-42d6-87da-bb994e0194d2 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:43.535325 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eaa3fc01-b13b-42d6-87da-bb994e0194d2 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:43.674931 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-eaa3fc01-b13b-42d6-87da-bb994e0194d2 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae7845f6759c4dcabcc1516a72484174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d371ab6648425eac2cf1702f2789dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:43.684606 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-eaa3fc01-b13b-42d6-87da-bb994e0194d2 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/servers/004575c6-51ce-48d9-b7a6-d50f9afdb0a0" status: 200 len: 1318 microversion: 2.1 time: 0.165902 Oct 27 03:34:43.685590 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1747/3259] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:43 2022] GET /compute/v2.1/servers/004575c6-51ce-48d9-b7a6-d50f9afdb0a0 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:43.690567 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8ea9800c-9c6b-4cf7-a192-4525cade35f8 tempest-SecurityGroupRulesTestJSON-368356497 tempest-SecurityGroupRulesTestJSON-368356497-project] Calling method '.version_select at 0x7f7dda54e160>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:43.958054 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8ea9800c-9c6b-4cf7-a192-4525cade35f8 tempest-SecurityGroupRulesTestJSON-368356497 tempest-SecurityGroupRulesTestJSON-368356497-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/45d70c96-1ec2-410a-a2a2-16aae7562133" status: 202 len: 0 microversion: 2.1 time: 0.271116 Oct 27 03:34:43.958834 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1748/3260] 10.222.0.20 () {58 vars in 1272 bytes} [Thu Oct 27 03:34:43 2022] DELETE /compute/v2.1/os-security-groups/45d70c96-1ec2-410a-a2a2-16aae7562133 => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:34:43.963732 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-82442902-a9eb-472f-b534-29192a9aad0e tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:43.964367 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-82442902-a9eb-472f-b534-29192a9aad0e tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] [instance: 38693017-3b6f-434c-976f-a9733156a115] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:43.970756 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-82442902-a9eb-472f-b534-29192a9aad0e tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:43.971258 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-82442902-a9eb-472f-b534-29192a9aad0e tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:43.971715 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-82442902-a9eb-472f-b534-29192a9aad0e tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:43.972437 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-82442902-a9eb-472f-b534-29192a9aad0e tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:43.973335 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-82442902-a9eb-472f-b534-29192a9aad0e tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:43.974254 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-82442902-a9eb-472f-b534-29192a9aad0e tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:43.989558 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-82442902-a9eb-472f-b534-29192a9aad0e tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] HTTP exception thrown: Instance 38693017-3b6f-434c-976f-a9733156a115 could not be found. Oct 27 03:34:43.991338 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-82442902-a9eb-472f-b534-29192a9aad0e tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Request method failure captured: Oct 27 03:34:43.991338 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/38693017-3b6f-434c-976f-a9733156a115 HTTP/1.1 Oct 27 03:34:43.991338 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:34:43.991338 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:34:43.991338 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:34:43.991338 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:34:43.991338 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:34:43.991338 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:34:43.991338 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:34:43.991338 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:34:43.991338 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfwOWA1Mstb05mKjlVTTupe8YH9xrCf5f9L9Cychzb-w58cm7Umv8orXhO3n_av1vEBdRM_JzsuN71tTo5mU4bcMgJUicRJX-U2IA0MbsE24CxaW8npw75W0q7d1gJRSnDxKQJKYsgopXJhS0nx9kmDtcpnoCVJn5M9CIhzppuqGVC4 Oct 27 03:34:43.991338 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:34:43.991338 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:34:43.991338 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:34:43.991338 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:34:43.991338 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:34:43.991338 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:34:43.991338 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 2057593072c14804ab70fe4bdea2c17c Oct 27 03:34:43.991338 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServersTestMultiNic-1635442954 Oct 27 03:34:43.991338 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:34:43.991338 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:34:43.991338 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2057593072c14804ab70fe4bdea2c17c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2057593072c14804ab70fe4bdea2c17c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2057593072c14804ab70fe4bdea2c17c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2057593072c14804ab70fe4bdea2c17c"}]}] Oct 27 03:34:43.991338 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServersTestMultiNic-1635442954 Oct 27 03:34:43.991338 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 2057593072c14804ab70fe4bdea2c17c Oct 27 03:34:43.991338 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServersTestMultiNic-1635442954 Oct 27 03:34:43.991338 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServersTestMultiNic-1635442954-project Oct 27 03:34:43.991338 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:34:43.991338 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:34:43.991338 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 881f054c84d04ceaa17a5817816022d4 Oct 27 03:34:43.991338 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServersTestMultiNic-1635442954-project Oct 27 03:34:43.991338 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:34:43.991338 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 38693017-3b6f-434c-976f-a9733156a115 could not be found. Oct 27 03:34:43.991338 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '38693017-3b6f-434c-976f-a9733156a115'} Oct 27 03:34:43.991338 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:34:43.991338 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:34:43.991338 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:34:43.991338 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:34:43.991338 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:34:43.991338 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:34:43.991338 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:34:43.991338 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:34:43.991338 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:34:43.991338 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:34:43.991338 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38693017-3b6f-434c-976f-a9733156a115 could not be found. Oct 27 03:34:43.991338 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:34:43.991338 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:34:43.991338 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:34:43.991338 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:34:43.991338 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:34:43.991338 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:34:43.991338 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:34:43.991338 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:34:43.991338 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:34:43.991338 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:34:43.991338 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:34:43.991338 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:34:43.991338 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:34:43.991338 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:34:43.991338 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:34:43.991338 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:34:43.991338 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38693017-3b6f-434c-976f-a9733156a115 could not be found. Oct 27 03:34:43.991338 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:34:43.991338 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:34:43.991338 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:34:43.996265 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:34:43.996265 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:34:43.996265 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:34:43.996265 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:34:43.996265 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:34:43.996265 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38693017-3b6f-434c-976f-a9733156a115 could not be found. Oct 27 03:34:43.996265 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:34:43.996265 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-82442902-a9eb-472f-b534-29192a9aad0e tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Returning 404 to user: Instance 38693017-3b6f-434c-976f-a9733156a115 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:34:43.996265 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-82442902-a9eb-472f-b534-29192a9aad0e tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] 10.222.0.20 "GET /compute/v2.1/servers/38693017-3b6f-434c-976f-a9733156a115" status: 404 len: 111 microversion: 2.1 time: 0.032770 Oct 27 03:34:43.996265 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1749/3261] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:43 2022] GET /compute/v2.1/servers/38693017-3b6f-434c-976f-a9733156a115 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:34:43.997817 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-11fc097b-0db7-4e89-b8a7-a8d7c1583f08 req-96ce580b-9b25-4498-8736-98084b67d0c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f50da5a9-2bb6-4735-93c3-d73ece0964f3", "name": "network-vif-plugged", "status": "completed", "tag": "271e155b-8765-4519-870e-105aa22f7ae9"}, {"server_uuid": "38693017-3b6f-434c-976f-a9733156a115", "name": "network-vif-unplugged", "status": "completed", "tag": "02930e69-9216-45da-b6d0-4ed8f060b164"}, {"server_uuid": "004575c6-51ce-48d9-b7a6-d50f9afdb0a0", "name": "network-vif-plugged", "status": "completed", "tag": "5deebc19-88cc-4f7e-98b2-66507a85ce83"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:34:44.011910 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-11fc097b-0db7-4e89-b8a7-a8d7c1583f08 req-96ce580b-9b25-4498-8736-98084b67d0c5 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:44.011910 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-11fc097b-0db7-4e89-b8a7-a8d7c1583f08 req-96ce580b-9b25-4498-8736-98084b67d0c5 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:44.011910 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-11fc097b-0db7-4e89-b8a7-a8d7c1583f08 req-96ce580b-9b25-4498-8736-98084b67d0c5 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:44.027323 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-11fc097b-0db7-4e89-b8a7-a8d7c1583f08 req-96ce580b-9b25-4498-8736-98084b67d0c5 service nova] Creating event network-vif-plugged:271e155b-8765-4519-870e-105aa22f7ae9 for instance f50da5a9-2bb6-4735-93c3-d73ece0964f3 on n-h1-862769-1 Oct 27 03:34:44.027758 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-11fc097b-0db7-4e89-b8a7-a8d7c1583f08 req-96ce580b-9b25-4498-8736-98084b67d0c5 service nova] Creating event network-vif-unplugged:02930e69-9216-45da-b6d0-4ed8f060b164 for instance 38693017-3b6f-434c-976f-a9733156a115 on n-h2-862769-1 Oct 27 03:34:44.028265 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-11fc097b-0db7-4e89-b8a7-a8d7c1583f08 req-96ce580b-9b25-4498-8736-98084b67d0c5 service nova] Creating event network-vif-plugged:5deebc19-88cc-4f7e-98b2-66507a85ce83 for instance 004575c6-51ce-48d9-b7a6-d50f9afdb0a0 on n-h1-862769-1 Oct 27 03:34:44.043863 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-11fc097b-0db7-4e89-b8a7-a8d7c1583f08 req-96ce580b-9b25-4498-8736-98084b67d0c5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.049162 Oct 27 03:34:44.044683 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1750/3262] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:34:43 2022] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:34:44.057222 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-abac2958-eebd-4af1-a1f0-00af6047d6c7 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:44.058703 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-abac2958-eebd-4af1-a1f0-00af6047d6c7 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:44.067689 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-abac2958-eebd-4af1-a1f0-00af6047d6c7 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:44.068614 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-abac2958-eebd-4af1-a1f0-00af6047d6c7 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:44.069224 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-abac2958-eebd-4af1-a1f0-00af6047d6c7 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:44.071822 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-abac2958-eebd-4af1-a1f0-00af6047d6c7 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:44.072587 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-abac2958-eebd-4af1-a1f0-00af6047d6c7 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:44.074092 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-abac2958-eebd-4af1-a1f0-00af6047d6c7 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:44.366598 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-abac2958-eebd-4af1-a1f0-00af6047d6c7 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:44.377265 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-abac2958-eebd-4af1-a1f0-00af6047d6c7 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1679 microversion: 2.1 time: 0.330366 Oct 27 03:34:44.378497 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1751/3263] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:44 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1679 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:44.383655 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-134c78e3-0854-4a11-8e96-9a230c4b27ce req-f8408c18-cdec-4cc6-b000-8c4f25fd2fab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38693017-3b6f-434c-976f-a9733156a115", "name": "network-vif-deleted", "tag": "02930e69-9216-45da-b6d0-4ed8f060b164"}, {"name": "network-changed", "server_uuid": "376ac459-e31f-4727-9e34-535f055ac20d", "tag": "e825dd69-54a1-4411-addc-e78fd04434d2"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:34:44.394917 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-134c78e3-0854-4a11-8e96-9a230c4b27ce req-f8408c18-cdec-4cc6-b000-8c4f25fd2fab service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:44.395784 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-134c78e3-0854-4a11-8e96-9a230c4b27ce req-f8408c18-cdec-4cc6-b000-8c4f25fd2fab service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:44.396697 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-134c78e3-0854-4a11-8e96-9a230c4b27ce req-f8408c18-cdec-4cc6-b000-8c4f25fd2fab service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:44.410819 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-134c78e3-0854-4a11-8e96-9a230c4b27ce req-f8408c18-cdec-4cc6-b000-8c4f25fd2fab service nova] Creating event network-vif-deleted:02930e69-9216-45da-b6d0-4ed8f060b164 for instance 38693017-3b6f-434c-976f-a9733156a115 on n-h2-862769-1 Oct 27 03:34:44.411437 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-134c78e3-0854-4a11-8e96-9a230c4b27ce req-f8408c18-cdec-4cc6-b000-8c4f25fd2fab service nova] Creating event network-changed:e825dd69-54a1-4411-addc-e78fd04434d2 for instance 376ac459-e31f-4727-9e34-535f055ac20d on n-h2-862769-1 Oct 27 03:34:44.418720 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-134c78e3-0854-4a11-8e96-9a230c4b27ce req-f8408c18-cdec-4cc6-b000-8c4f25fd2fab service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.038833 Oct 27 03:34:44.419419 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1752/3264] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:34:44 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:34:44.426378 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ee45f409-9c31-4025-91a7-f17df2f59ea4 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:44.427348 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ee45f409-9c31-4025-91a7-f17df2f59ea4 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] [instance: 53d360ec-9026-453d-a4a5-39a5f684b2c3] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:44.435600 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ee45f409-9c31-4025-91a7-f17df2f59ea4 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:44.436090 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ee45f409-9c31-4025-91a7-f17df2f59ea4 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:44.436538 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ee45f409-9c31-4025-91a7-f17df2f59ea4 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:44.438016 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ee45f409-9c31-4025-91a7-f17df2f59ea4 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:44.438689 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ee45f409-9c31-4025-91a7-f17df2f59ea4 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:44.440700 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ee45f409-9c31-4025-91a7-f17df2f59ea4 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:45.092881 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ee45f409-9c31-4025-91a7-f17df2f59ea4 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcff40b520f749f2b4bca5eed0923504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbc26f2331d47e5863e8dbf1952906c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:45.105890 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ee45f409-9c31-4025-91a7-f17df2f59ea4 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] 10.222.0.20 "GET /compute/v2.1/servers/53d360ec-9026-453d-a4a5-39a5f684b2c3" status: 200 len: 1503 microversion: 2.1 time: 0.684754 Oct 27 03:34:45.107697 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1753/3265] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:44 2022] GET /compute/v2.1/servers/53d360ec-9026-453d-a4a5-39a5f684b2c3 => generated 1503 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:45.113767 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-cc22c96b-6e0e-4025-a433-5bdc7c813aa2 tempest-SecurityGroupRulesTestJSON-368356497 tempest-SecurityGroupRulesTestJSON-368356497-project] Calling method '.version_select at 0x7f7ddec58940>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:45.235839 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-144f3c7c-223b-4043-876b-8497ac4bf527 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:34:45.236440 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-144f3c7c-223b-4043-876b-8497ac4bf527 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:34:45.237112 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-144f3c7c-223b-4043-876b-8497ac4bf527 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:34:45.237735 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-144f3c7c-223b-4043-876b-8497ac4bf527 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:34:45.238361 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-144f3c7c-223b-4043-876b-8497ac4bf527 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:34:45.248714 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-144f3c7c-223b-4043-876b-8497ac4bf527 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:45.249500 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-144f3c7c-223b-4043-876b-8497ac4bf527 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:45.250323 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-144f3c7c-223b-4043-876b-8497ac4bf527 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:45.252424 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-144f3c7c-223b-4043-876b-8497ac4bf527 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:45.252424 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-144f3c7c-223b-4043-876b-8497ac4bf527 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:45.252855 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-144f3c7c-223b-4043-876b-8497ac4bf527 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:45.279290 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-144f3c7c-223b-4043-876b-8497ac4bf527 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Getting quotas for project 296abb4b5dde441da95f4d09089f348e. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:34:45.286287 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-144f3c7c-223b-4043-876b-8497ac4bf527 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Getting quotas for user 0d9053ce63864308b29190f9f51bd85f and project 296abb4b5dde441da95f4d09089f348e. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:34:45.497391 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-144f3c7c-223b-4043-876b-8497ac4bf527 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:34:45.501352 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-144f3c7c-223b-4043-876b-8497ac4bf527 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] [instance: 8c8a2cbb-4acf-4a6b-b684-567617bb930d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='88856a87-5f76-4146-ab9e-2dae0ca5c184',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='fe3b5449-d820-4c7c-8a30-57720b9e6de0',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2ed74b62-33ef-4afa-a92f-0fb3e658ea9c',volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:34:45.794359 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-cc22c96b-6e0e-4025-a433-5bdc7c813aa2 tempest-SecurityGroupRulesTestJSON-368356497 tempest-SecurityGroupRulesTestJSON-368356497-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/a518857e-a931-4799-99e8-3f8f4169e762" status: 202 len: 0 microversion: 2.1 time: 0.684831 Oct 27 03:34:45.798927 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1754/3266] 10.222.0.20 () {58 vars in 1272 bytes} [Thu Oct 27 03:34:45 2022] DELETE /compute/v2.1/os-security-groups/a518857e-a931-4799-99e8-3f8f4169e762 => generated 0 bytes in 690 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:34:45.825801 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b840713e-1abd-4b2a-9635-ea395241c1bf tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:45.826508 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b840713e-1abd-4b2a-9635-ea395241c1bf tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:45.833642 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b840713e-1abd-4b2a-9635-ea395241c1bf tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:45.839431 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b840713e-1abd-4b2a-9635-ea395241c1bf tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:45.839431 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b840713e-1abd-4b2a-9635-ea395241c1bf tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:45.839431 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b840713e-1abd-4b2a-9635-ea395241c1bf tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:45.839431 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b840713e-1abd-4b2a-9635-ea395241c1bf tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:45.839431 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b840713e-1abd-4b2a-9635-ea395241c1bf tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:46.111037 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b840713e-1abd-4b2a-9635-ea395241c1bf tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:46.120028 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b840713e-1abd-4b2a-9635-ea395241c1bf tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1316 microversion: 2.1 time: 0.319363 Oct 27 03:34:46.120594 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1755/3267] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:45 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1316 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:46.130683 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c8921fdd-39e1-4f59-9728-28ad45211d6f tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:46.131631 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c8921fdd-39e1-4f59-9728-28ad45211d6f tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] [instance: 004575c6-51ce-48d9-b7a6-d50f9afdb0a0] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:46.147868 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c8921fdd-39e1-4f59-9728-28ad45211d6f tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:46.149127 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c8921fdd-39e1-4f59-9728-28ad45211d6f tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:46.149585 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c8921fdd-39e1-4f59-9728-28ad45211d6f tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:46.150385 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c8921fdd-39e1-4f59-9728-28ad45211d6f tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:46.150847 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c8921fdd-39e1-4f59-9728-28ad45211d6f tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:46.151279 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c8921fdd-39e1-4f59-9728-28ad45211d6f tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:46.345809 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c8921fdd-39e1-4f59-9728-28ad45211d6f tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae7845f6759c4dcabcc1516a72484174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d371ab6648425eac2cf1702f2789dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:46.353626 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c8921fdd-39e1-4f59-9728-28ad45211d6f tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/servers/004575c6-51ce-48d9-b7a6-d50f9afdb0a0" status: 200 len: 1468 microversion: 2.1 time: 0.228795 Oct 27 03:34:46.354226 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1756/3268] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:46 2022] GET /compute/v2.1/servers/004575c6-51ce-48d9-b7a6-d50f9afdb0a0 => generated 1468 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:46.365906 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-904cead2-e774-45be-9ce3-aa983655081c tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:46.365906 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-904cead2-e774-45be-9ce3-aa983655081c tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] [instance: 53d360ec-9026-453d-a4a5-39a5f684b2c3] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:46.371431 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-904cead2-e774-45be-9ce3-aa983655081c tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:46.371937 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-904cead2-e774-45be-9ce3-aa983655081c tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:46.372522 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-904cead2-e774-45be-9ce3-aa983655081c tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:46.373352 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-904cead2-e774-45be-9ce3-aa983655081c tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:46.373890 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-904cead2-e774-45be-9ce3-aa983655081c tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:46.374371 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-904cead2-e774-45be-9ce3-aa983655081c tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:46.528204 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-904cead2-e774-45be-9ce3-aa983655081c tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] 10.222.0.20 "DELETE /compute/v2.1/servers/53d360ec-9026-453d-a4a5-39a5f684b2c3/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.172856 Oct 27 03:34:46.536531 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1757/3269] 10.222.0.20 () {58 vars in 1296 bytes} [Thu Oct 27 03:34:46 2022] DELETE /compute/v2.1/servers/53d360ec-9026-453d-a4a5-39a5f684b2c3/os-server-password => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:34:46.542258 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-981e0ce3-cd56-4db9-8943-cfc4172cc961 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:46.542964 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-981e0ce3-cd56-4db9-8943-cfc4172cc961 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:46.565661 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-981e0ce3-cd56-4db9-8943-cfc4172cc961 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:46.566096 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-981e0ce3-cd56-4db9-8943-cfc4172cc961 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:46.566524 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-981e0ce3-cd56-4db9-8943-cfc4172cc961 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:46.567245 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-981e0ce3-cd56-4db9-8943-cfc4172cc961 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:46.567706 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-981e0ce3-cd56-4db9-8943-cfc4172cc961 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:46.568320 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-981e0ce3-cd56-4db9-8943-cfc4172cc961 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:46.749461 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-144f3c7c-223b-4043-876b-8497ac4bf527 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 4.578566 Oct 27 03:34:46.755000 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1513/3270] 10.222.0.20 () {62 vars in 1189 bytes} [Thu Oct 27 03:34:42 2022] POST /compute/v2.1/servers => generated 406 bytes in 4585 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 27 03:34:46.760268 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a8b84083-ea4b-4445-81f2-a9079705b90f tempest-SecurityGroupRulesTestJSON-368356497 tempest-SecurityGroupRulesTestJSON-368356497-project] Calling method '.version_select at 0x7f7dd9dd7040>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:46.846451 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-981e0ce3-cd56-4db9-8943-cfc4172cc961 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:46.855160 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-981e0ce3-cd56-4db9-8943-cfc4172cc961 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1679 microversion: 2.1 time: 0.319650 Oct 27 03:34:46.858005 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1758/3271] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:46 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1679 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:46.863169 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2e0a9302-c0a1-4b69-8239-2a5570ab78e8 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:46.871976 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2e0a9302-c0a1-4b69-8239-2a5570ab78e8 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] [instance: f50da5a9-2bb6-4735-93c3-d73ece0964f3] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:46.882018 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2e0a9302-c0a1-4b69-8239-2a5570ab78e8 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:46.887912 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2e0a9302-c0a1-4b69-8239-2a5570ab78e8 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:46.893677 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2e0a9302-c0a1-4b69-8239-2a5570ab78e8 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:46.893677 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2e0a9302-c0a1-4b69-8239-2a5570ab78e8 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:46.893677 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2e0a9302-c0a1-4b69-8239-2a5570ab78e8 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:46.893677 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2e0a9302-c0a1-4b69-8239-2a5570ab78e8 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:47.123943 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2e0a9302-c0a1-4b69-8239-2a5570ab78e8 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae7845f6759c4dcabcc1516a72484174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d371ab6648425eac2cf1702f2789dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:47.136938 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2e0a9302-c0a1-4b69-8239-2a5570ab78e8 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/servers/f50da5a9-2bb6-4735-93c3-d73ece0964f3" status: 200 len: 1467 microversion: 2.1 time: 0.277386 Oct 27 03:34:47.138395 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1759/3272] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:46 2022] GET /compute/v2.1/servers/f50da5a9-2bb6-4735-93c3-d73ece0964f3 => generated 1467 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:47.144725 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-dc531d2e-6d9e-45ed-b144-7c70e71935f4 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:47.145325 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-dc531d2e-6d9e-45ed-b144-7c70e71935f4 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] [instance: 53d360ec-9026-453d-a4a5-39a5f684b2c3] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:47.162403 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a8b84083-ea4b-4445-81f2-a9079705b90f tempest-SecurityGroupRulesTestJSON-368356497 tempest-SecurityGroupRulesTestJSON-368356497-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/50635a2c-5963-4fbc-ba2a-2cbc95080281" status: 202 len: 0 microversion: 2.1 time: 0.406135 Oct 27 03:34:47.167034 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1514/3273] 10.222.0.20 () {58 vars in 1272 bytes} [Thu Oct 27 03:34:46 2022] DELETE /compute/v2.1/os-security-groups/50635a2c-5963-4fbc-ba2a-2cbc95080281 => generated 0 bytes in 411 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:34:47.167436 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dc531d2e-6d9e-45ed-b144-7c70e71935f4 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:47.172452 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dc531d2e-6d9e-45ed-b144-7c70e71935f4 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:47.172452 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dc531d2e-6d9e-45ed-b144-7c70e71935f4 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:47.172452 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dc531d2e-6d9e-45ed-b144-7c70e71935f4 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:47.172452 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dc531d2e-6d9e-45ed-b144-7c70e71935f4 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:47.172452 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dc531d2e-6d9e-45ed-b144-7c70e71935f4 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:47.177924 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-daa20b22-b57a-4917-894f-a7ac6e35c552 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:47.193511 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-daa20b22-b57a-4917-894f-a7ac6e35c552 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] [instance: 8c8a2cbb-4acf-4a6b-b684-567617bb930d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:47.268300 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-daa20b22-b57a-4917-894f-a7ac6e35c552 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:47.278026 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-dc531d2e-6d9e-45ed-b144-7c70e71935f4 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] 10.222.0.20 "GET /compute/v2.1/servers/53d360ec-9026-453d-a4a5-39a5f684b2c3/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.138369 Oct 27 03:34:47.278745 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1760/3274] 10.222.0.20 () {58 vars in 1293 bytes} [Thu Oct 27 03:34:47 2022] GET /compute/v2.1/servers/53d360ec-9026-453d-a4a5-39a5f684b2c3/os-server-password => generated 16 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 03:34:47.279935 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-daa20b22-b57a-4917-894f-a7ac6e35c552 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:47.281762 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-daa20b22-b57a-4917-894f-a7ac6e35c552 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:47.284543 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-daa20b22-b57a-4917-894f-a7ac6e35c552 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d" status: 200 len: 1284 microversion: 2.42 time: 0.115971 Oct 27 03:34:47.285671 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1515/3275] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:34:47 2022] GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d => generated 1284 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:34:47.290969 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-39576a74-e2e2-4df8-baeb-8aeef452edef tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:47.291901 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-45463eb3-b12c-4ca3-9e91-15496fc7d52e tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-886573111"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:34:47.294521 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-45463eb3-b12c-4ca3-9e91-15496fc7d52e tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] [instance: f50da5a9-2bb6-4735-93c3-d73ece0964f3] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:47.302943 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-45463eb3-b12c-4ca3-9e91-15496fc7d52e tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:47.303686 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-45463eb3-b12c-4ca3-9e91-15496fc7d52e tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:47.304381 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-45463eb3-b12c-4ca3-9e91-15496fc7d52e tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:47.305339 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-45463eb3-b12c-4ca3-9e91-15496fc7d52e tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:47.306147 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-39576a74-e2e2-4df8-baeb-8aeef452edef tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:47.306485 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-45463eb3-b12c-4ca3-9e91-15496fc7d52e tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:47.307136 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-45463eb3-b12c-4ca3-9e91-15496fc7d52e tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:47.330159 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-39576a74-e2e2-4df8-baeb-8aeef452edef tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:47.330668 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-39576a74-e2e2-4df8-baeb-8aeef452edef tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:47.331121 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-39576a74-e2e2-4df8-baeb-8aeef452edef tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:47.331848 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-39576a74-e2e2-4df8-baeb-8aeef452edef tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:47.332322 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-39576a74-e2e2-4df8-baeb-8aeef452edef tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:47.332769 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-39576a74-e2e2-4df8-baeb-8aeef452edef tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:47.658876 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-39576a74-e2e2-4df8-baeb-8aeef452edef tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:47.668117 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-39576a74-e2e2-4df8-baeb-8aeef452edef tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1316 microversion: 2.1 time: 0.387990 Oct 27 03:34:47.668906 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1761/3276] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:47 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1316 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:47.674472 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6c14b4c0-1c6e-41bb-8095-1a06128e86c4 tempest-SecurityGroupRulesTestJSON-368356497 tempest-SecurityGroupRulesTestJSON-368356497-project] Calling method '.version_select at 0x7f7ddaf1d550>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:47.798816 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-45463eb3-b12c-4ca3-9e91-15496fc7d52e tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "POST /compute/v2.1/servers/f50da5a9-2bb6-4735-93c3-d73ece0964f3/action" status: 202 len: 0 microversion: 2.1 time: 0.509166 Oct 27 03:34:47.800535 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1516/3277] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:34:47 2022] POST /compute/v2.1/servers/f50da5a9-2bb6-4735-93c3-d73ece0964f3/action => generated 0 bytes in 514 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 27 03:34:47.808439 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9c56d205-b9ff-420d-9466-d690d97a39d9 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:47.809350 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9c56d205-b9ff-420d-9466-d690d97a39d9 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] [instance: 53d360ec-9026-453d-a4a5-39a5f684b2c3] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:47.816810 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:34:47.820521 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9c56d205-b9ff-420d-9466-d690d97a39d9 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:47.821537 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9c56d205-b9ff-420d-9466-d690d97a39d9 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:47.822212 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9c56d205-b9ff-420d-9466-d690d97a39d9 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:47.823152 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9c56d205-b9ff-420d-9466-d690d97a39d9 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:47.824239 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9c56d205-b9ff-420d-9466-d690d97a39d9 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:47.825043 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9c56d205-b9ff-420d-9466-d690d97a39d9 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:47.877173 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9c56d205-b9ff-420d-9466-d690d97a39d9 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] [instance: 53d360ec-9026-453d-a4a5-39a5f684b2c3] Going to try to terminate instance {{(pid=121000) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:34:48.043127 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6c14b4c0-1c6e-41bb-8095-1a06128e86c4 tempest-SecurityGroupRulesTestJSON-368356497 tempest-SecurityGroupRulesTestJSON-368356497-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/f5aeb47e-db8a-48f6-ab49-12b2e5bff490" status: 202 len: 0 microversion: 2.1 time: 0.372946 Oct 27 03:34:48.043714 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1762/3278] 10.222.0.20 () {58 vars in 1272 bytes} [Thu Oct 27 03:34:47 2022] DELETE /compute/v2.1/os-security-groups/f5aeb47e-db8a-48f6-ab49-12b2e5bff490 => generated 0 bytes in 374 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:34:48.049445 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-38b7b43a-6ba0-412f-b2ac-6daf54258764 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7dda495ee0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:48.123527 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-38b7b43a-6ba0-412f-b2ac-6daf54258764 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images/5c03b8cf-4b2d-476c-8831-4866eeff9434" status: 200 len: 1454 microversion: 2.1 time: 0.077902 Oct 27 03:34:48.129172 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1763/3279] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:34:48 2022] GET /compute/v2.1/images/5c03b8cf-4b2d-476c-8831-4866eeff9434 => generated 1454 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:48.137692 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-bc577cec-71b7-408f-832c-91947957588d tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:48.138368 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-bc577cec-71b7-408f-832c-91947957588d tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:48.147516 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bc577cec-71b7-408f-832c-91947957588d tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:48.148650 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bc577cec-71b7-408f-832c-91947957588d tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:48.149100 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bc577cec-71b7-408f-832c-91947957588d tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:48.149825 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bc577cec-71b7-408f-832c-91947957588d tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:48.150313 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bc577cec-71b7-408f-832c-91947957588d tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:48.150746 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bc577cec-71b7-408f-832c-91947957588d tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:48.215295 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9c56d205-b9ff-420d-9466-d690d97a39d9 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] 10.222.0.20 "DELETE /compute/v2.1/servers/53d360ec-9026-453d-a4a5-39a5f684b2c3" status: 204 len: 0 microversion: 2.1 time: 0.413014 Oct 27 03:34:48.216017 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1517/3280] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:34:47 2022] DELETE /compute/v2.1/servers/53d360ec-9026-453d-a4a5-39a5f684b2c3 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:34:48.377534 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2af8fc08-a2d0-4f7b-aa0f-c66c480a1716 tempest-ImagesMetadataNegativeTestJSON-176704492 tempest-ImagesMetadataNegativeTestJSON-176704492-project] Calling method '.version_select at 0x7f7dda275940>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:48.403334 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-2af8fc08-a2d0-4f7b-aa0f-c66c480a1716 tempest-ImagesMetadataNegativeTestJSON-176704492 tempest-ImagesMetadataNegativeTestJSON-176704492-project] HTTP exception thrown: Image not found. Oct 27 03:34:48.410929 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2af8fc08-a2d0-4f7b-aa0f-c66c480a1716 tempest-ImagesMetadataNegativeTestJSON-176704492 tempest-ImagesMetadataNegativeTestJSON-176704492-project] Request method failure captured: Oct 27 03:34:48.410929 n-d-862769-1 devstack@n-api.service[121000]: request: DELETE /compute/v2.1/images/c1a55250-d832-4d96-aa97-75a82e4d5a1b/metadata/os_distro HTTP/1.1 Oct 27 03:34:48.410929 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:34:48.410929 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:34:48.410929 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:34:48.410929 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:34:48.410929 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:34:48.410929 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:34:48.410929 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:34:48.410929 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:34:48.410929 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfxX36MSkR8MeZoq1me2vfL28Hx4jYNN1oqEWh2vdjT8zRiDmjnoZpyeOD27C_xNf_DWqb_-CBq5fImZLEACsIalbWWZZ27_fcw5XobN_Gu1_EmID5fK1XeLfi-W7k4qeafYp-Cf3WKFVh1gfsRbHI_0PTFjme4fwQGxEYoyOajWrPg Oct 27 03:34:48.410929 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:34:48.410929 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:34:48.410929 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:34:48.410929 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:34:48.410929 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:34:48.410929 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:34:48.410929 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 876747742e6a4efea6b788a8e8cf800c Oct 27 03:34:48.410929 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-176704492 Oct 27 03:34:48.410929 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:34:48.410929 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:34:48.410929 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/876747742e6a4efea6b788a8e8cf800c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/876747742e6a4efea6b788a8e8cf800c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/876747742e6a4efea6b788a8e8cf800c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_876747742e6a4efea6b788a8e8cf800c"}]}] Oct 27 03:34:48.410929 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-176704492 Oct 27 03:34:48.410929 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 876747742e6a4efea6b788a8e8cf800c Oct 27 03:34:48.410929 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-176704492 Oct 27 03:34:48.410929 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ImagesMetadataNegativeTestJSON-176704492-project Oct 27 03:34:48.410929 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:34:48.410929 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:34:48.410929 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: dd22f08cc08e4e1283dd2e3ffc9190f2 Oct 27 03:34:48.410929 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-176704492-project Oct 27 03:34:48.410929 n-d-862769-1 devstack@n-api.service[121000]: method: Oct 27 03:34:48.410929 n-d-862769-1 devstack@n-api.service[121000]: exception: Image not found. Oct 27 03:34:48.410929 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'image_id': 'c1a55250-d832-4d96-aa97-75a82e4d5a1b', 'id': 'os_distro'} Oct 27 03:34:48.410929 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:34:48.410929 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:34:48.410929 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 27 03:34:48.410929 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 27 03:34:48.410929 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 03:34:48.410929 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 03:34:48.410929 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 27 03:34:48.410929 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 27 03:34:48.410929 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 03:34:48.410929 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 03:34:48.410929 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 27 03:34:48.410929 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 27 03:34:48.410929 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 27 03:34:48.410929 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 27 03:34:48.410929 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 03:34:48.410929 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 03:34:48.410929 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 03:34:48.410929 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 03:34:48.410929 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID c1a55250-d832-4d96-aa97-75a82e4d5a1b Oct 27 03:34:48.410929 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:34:48.410929 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:34:48.410929 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:34:48.410929 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:34:48.410929 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 27 03:34:48.410929 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 27 03:34:48.410929 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 27 03:34:48.410929 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 27 03:34:48.410929 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 27 03:34:48.410929 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 27 03:34:48.421154 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 27 03:34:48.421154 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 27 03:34:48.421154 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 27 03:34:48.421154 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 27 03:34:48.421154 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 03:34:48.421154 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 03:34:48.421154 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 27 03:34:48.421154 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 27 03:34:48.421154 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 03:34:48.421154 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 03:34:48.421154 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 27 03:34:48.421154 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 27 03:34:48.421154 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 27 03:34:48.421154 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 27 03:34:48.421154 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 03:34:48.421154 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 03:34:48.421154 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 03:34:48.421154 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 03:34:48.421154 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c1a55250-d832-4d96-aa97-75a82e4d5a1b could not be found. Oct 27 03:34:48.421154 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:34:48.421154 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:34:48.421154 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:34:48.421154 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:34:48.421154 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:34:48.421154 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:34:48.421154 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:34:48.421154 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:34:48.421154 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:34:48.421154 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:34:48.421154 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:34:48.421154 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:34:48.421154 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Oct 27 03:34:48.421154 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 27 03:34:48.421154 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 27 03:34:48.421154 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 27 03:34:48.421154 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 27 03:34:48.421154 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:34:48.421154 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:34:48.421154 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:34:48.421154 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:34:48.421154 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:34:48.421154 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:34:48.421154 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:34:48.421154 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:34:48.421154 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 27 03:34:48.421154 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:34:48.421154 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2af8fc08-a2d0-4f7b-aa0f-c66c480a1716 tempest-ImagesMetadataNegativeTestJSON-176704492 tempest-ImagesMetadataNegativeTestJSON-176704492-project] Returning 404 to user: Image not found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:34:48.421154 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2af8fc08-a2d0-4f7b-aa0f-c66c480a1716 tempest-ImagesMetadataNegativeTestJSON-176704492 tempest-ImagesMetadataNegativeTestJSON-176704492-project] 10.222.0.20 "DELETE /compute/v2.1/images/c1a55250-d832-4d96-aa97-75a82e4d5a1b/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.197427 Oct 27 03:34:48.421154 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1518/3281] 10.222.0.20 () {58 vars in 1293 bytes} [Thu Oct 27 03:34:48 2022] DELETE /compute/v2.1/images/c1a55250-d832-4d96-aa97-75a82e4d5a1b/metadata/os_distro => generated 62 bytes in 199 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 03:34:48.428490 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b32572f3-d987-4f97-8708-c8bfe90ee430 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:48.428490 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b32572f3-d987-4f97-8708-c8bfe90ee430 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] [instance: 53d360ec-9026-453d-a4a5-39a5f684b2c3] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:48.431987 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b32572f3-d987-4f97-8708-c8bfe90ee430 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:48.432496 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b32572f3-d987-4f97-8708-c8bfe90ee430 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:48.433157 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b32572f3-d987-4f97-8708-c8bfe90ee430 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:48.434163 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b32572f3-d987-4f97-8708-c8bfe90ee430 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:48.434848 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b32572f3-d987-4f97-8708-c8bfe90ee430 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:48.435450 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b32572f3-d987-4f97-8708-c8bfe90ee430 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:48.467057 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-bc577cec-71b7-408f-832c-91947957588d tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:48.476204 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-bc577cec-71b7-408f-832c-91947957588d tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1679 microversion: 2.1 time: 0.344415 Oct 27 03:34:48.477165 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1764/3282] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:48 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1679 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:48.482282 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f6b818ae-cca1-4b8e-b641-0ea52e1f7bfb tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:48.483067 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f6b818ae-cca1-4b8e-b641-0ea52e1f7bfb tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] [instance: 8c8a2cbb-4acf-4a6b-b684-567617bb930d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:48.607585 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f6b818ae-cca1-4b8e-b641-0ea52e1f7bfb tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:48.615742 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f6b818ae-cca1-4b8e-b641-0ea52e1f7bfb tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:48.617545 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f6b818ae-cca1-4b8e-b641-0ea52e1f7bfb tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:48.618922 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f6b818ae-cca1-4b8e-b641-0ea52e1f7bfb tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d" status: 200 len: 1284 microversion: 2.42 time: 0.140748 Oct 27 03:34:48.620187 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1765/3283] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:34:48 2022] GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d => generated 1284 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:34:48.626328 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-10c536fa-1aeb-4bad-80d9-5ee388206d5a tempest-ImagesMetadataNegativeTestJSON-176704492 tempest-ImagesMetadataNegativeTestJSON-176704492-project] Calling method '.version_select at 0x7f7ddec3f1f0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:48.654401 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-10c536fa-1aeb-4bad-80d9-5ee388206d5a tempest-ImagesMetadataNegativeTestJSON-176704492 tempest-ImagesMetadataNegativeTestJSON-176704492-project] HTTP exception thrown: Image not found. Oct 27 03:34:48.657055 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-10c536fa-1aeb-4bad-80d9-5ee388206d5a tempest-ImagesMetadataNegativeTestJSON-176704492 tempest-ImagesMetadataNegativeTestJSON-176704492-project] Request method failure captured: Oct 27 03:34:48.657055 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/images/b0589d94-e8c3-4c53-8096-eaa402dffde4/metadata/os_version HTTP/1.1 Oct 27 03:34:48.657055 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:34:48.657055 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:34:48.657055 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:34:48.657055 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:34:48.657055 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:34:48.657055 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:34:48.657055 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:34:48.657055 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:34:48.657055 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfxX36MSkR8MeZoq1me2vfL28Hx4jYNN1oqEWh2vdjT8zRiDmjnoZpyeOD27C_xNf_DWqb_-CBq5fImZLEACsIalbWWZZ27_fcw5XobN_Gu1_EmID5fK1XeLfi-W7k4qeafYp-Cf3WKFVh1gfsRbHI_0PTFjme4fwQGxEYoyOajWrPg Oct 27 03:34:48.657055 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:34:48.657055 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:34:48.657055 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:34:48.657055 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:34:48.657055 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:34:48.657055 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:34:48.657055 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 876747742e6a4efea6b788a8e8cf800c Oct 27 03:34:48.657055 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-176704492 Oct 27 03:34:48.657055 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:34:48.657055 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:34:48.657055 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/876747742e6a4efea6b788a8e8cf800c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/876747742e6a4efea6b788a8e8cf800c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/876747742e6a4efea6b788a8e8cf800c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_876747742e6a4efea6b788a8e8cf800c"}]}] Oct 27 03:34:48.657055 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-176704492 Oct 27 03:34:48.657055 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 876747742e6a4efea6b788a8e8cf800c Oct 27 03:34:48.657055 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-176704492 Oct 27 03:34:48.657055 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ImagesMetadataNegativeTestJSON-176704492-project Oct 27 03:34:48.657055 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:34:48.657055 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:34:48.657055 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: dd22f08cc08e4e1283dd2e3ffc9190f2 Oct 27 03:34:48.657055 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-176704492-project Oct 27 03:34:48.657055 n-d-862769-1 devstack@n-api.service[121001]: method: Oct 27 03:34:48.657055 n-d-862769-1 devstack@n-api.service[121001]: exception: Image not found. Oct 27 03:34:48.657055 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'image_id': 'b0589d94-e8c3-4c53-8096-eaa402dffde4', 'id': 'os_version'} Oct 27 03:34:48.657055 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:34:48.657055 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:34:48.657055 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 27 03:34:48.657055 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 27 03:34:48.657055 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 03:34:48.657055 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 03:34:48.657055 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 27 03:34:48.657055 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 27 03:34:48.657055 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 03:34:48.657055 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 03:34:48.657055 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 27 03:34:48.657055 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 27 03:34:48.657055 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 27 03:34:48.657055 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 27 03:34:48.657055 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 03:34:48.657055 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 03:34:48.657055 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 03:34:48.657055 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 03:34:48.657055 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID b0589d94-e8c3-4c53-8096-eaa402dffde4 Oct 27 03:34:48.657055 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:34:48.657055 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:34:48.657055 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:34:48.657055 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:34:48.657055 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 27 03:34:48.657055 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 27 03:34:48.657055 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 27 03:34:48.657055 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 27 03:34:48.657055 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 27 03:34:48.657055 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 27 03:34:48.664809 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 27 03:34:48.664809 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 27 03:34:48.664809 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 27 03:34:48.664809 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 27 03:34:48.664809 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 03:34:48.664809 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 03:34:48.664809 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 27 03:34:48.664809 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 27 03:34:48.664809 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 03:34:48.664809 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 03:34:48.664809 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 27 03:34:48.664809 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 27 03:34:48.664809 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 27 03:34:48.664809 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 27 03:34:48.664809 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 03:34:48.664809 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 03:34:48.664809 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 03:34:48.664809 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 03:34:48.664809 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b0589d94-e8c3-4c53-8096-eaa402dffde4 could not be found. Oct 27 03:34:48.664809 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:34:48.664809 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:34:48.664809 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:34:48.664809 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:34:48.664809 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:34:48.664809 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:34:48.664809 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:34:48.664809 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:34:48.664809 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:34:48.664809 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:34:48.664809 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:34:48.664809 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:34:48.664809 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Oct 27 03:34:48.664809 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 27 03:34:48.664809 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 27 03:34:48.664809 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 27 03:34:48.664809 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 27 03:34:48.664809 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:34:48.664809 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:34:48.664809 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:34:48.664809 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:34:48.664809 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:34:48.664809 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:34:48.664809 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:34:48.664809 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:34:48.664809 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 27 03:34:48.664809 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:34:48.664809 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-10c536fa-1aeb-4bad-80d9-5ee388206d5a tempest-ImagesMetadataNegativeTestJSON-176704492 tempest-ImagesMetadataNegativeTestJSON-176704492-project] Returning 404 to user: Image not found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:34:48.664809 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-10c536fa-1aeb-4bad-80d9-5ee388206d5a tempest-ImagesMetadataNegativeTestJSON-176704492 tempest-ImagesMetadataNegativeTestJSON-176704492-project] 10.222.0.20 "GET /compute/v2.1/images/b0589d94-e8c3-4c53-8096-eaa402dffde4/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.037246 Oct 27 03:34:48.664809 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1766/3284] 10.222.0.20 () {58 vars in 1293 bytes} [Thu Oct 27 03:34:48 2022] GET /compute/v2.1/images/b0589d94-e8c3-4c53-8096-eaa402dffde4/metadata/os_version => generated 62 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 03:34:48.674438 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-45961c16-c885-4755-9605-96bd097e9dce tempest-ImagesMetadataNegativeTestJSON-176704492 tempest-ImagesMetadataNegativeTestJSON-176704492-project] Calling method '.version_select at 0x7f7dded2a4c0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:48.698277 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-45961c16-c885-4755-9605-96bd097e9dce tempest-ImagesMetadataNegativeTestJSON-176704492 tempest-ImagesMetadataNegativeTestJSON-176704492-project] HTTP exception thrown: Image not found. Oct 27 03:34:48.698660 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b32572f3-d987-4f97-8708-c8bfe90ee430 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcff40b520f749f2b4bca5eed0923504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbc26f2331d47e5863e8dbf1952906c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:48.702329 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-45961c16-c885-4755-9605-96bd097e9dce tempest-ImagesMetadataNegativeTestJSON-176704492 tempest-ImagesMetadataNegativeTestJSON-176704492-project] Request method failure captured: Oct 27 03:34:48.702329 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/images/aa8abea0-7278-4876-ac96-aad5872ca04f/metadata HTTP/1.1 Oct 27 03:34:48.702329 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:34:48.702329 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:34:48.702329 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:34:48.702329 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:34:48.702329 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:34:48.702329 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:34:48.702329 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:34:48.702329 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:34:48.702329 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfxX36MSkR8MeZoq1me2vfL28Hx4jYNN1oqEWh2vdjT8zRiDmjnoZpyeOD27C_xNf_DWqb_-CBq5fImZLEACsIalbWWZZ27_fcw5XobN_Gu1_EmID5fK1XeLfi-W7k4qeafYp-Cf3WKFVh1gfsRbHI_0PTFjme4fwQGxEYoyOajWrPg Oct 27 03:34:48.702329 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:34:48.702329 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:34:48.702329 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:34:48.702329 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:34:48.702329 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:34:48.702329 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:34:48.702329 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 876747742e6a4efea6b788a8e8cf800c Oct 27 03:34:48.702329 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-176704492 Oct 27 03:34:48.702329 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:34:48.702329 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:34:48.702329 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/876747742e6a4efea6b788a8e8cf800c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/876747742e6a4efea6b788a8e8cf800c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/876747742e6a4efea6b788a8e8cf800c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_876747742e6a4efea6b788a8e8cf800c"}]}] Oct 27 03:34:48.702329 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-176704492 Oct 27 03:34:48.702329 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 876747742e6a4efea6b788a8e8cf800c Oct 27 03:34:48.702329 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-176704492 Oct 27 03:34:48.702329 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ImagesMetadataNegativeTestJSON-176704492-project Oct 27 03:34:48.702329 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:34:48.702329 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:34:48.702329 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: dd22f08cc08e4e1283dd2e3ffc9190f2 Oct 27 03:34:48.702329 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-176704492-project Oct 27 03:34:48.702329 n-d-862769-1 devstack@n-api.service[121001]: method: Oct 27 03:34:48.702329 n-d-862769-1 devstack@n-api.service[121001]: exception: Image not found. Oct 27 03:34:48.702329 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'image_id': 'aa8abea0-7278-4876-ac96-aad5872ca04f'} Oct 27 03:34:48.702329 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:34:48.702329 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:34:48.702329 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 27 03:34:48.702329 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 27 03:34:48.702329 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 03:34:48.702329 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 03:34:48.702329 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 27 03:34:48.702329 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 27 03:34:48.702329 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 03:34:48.702329 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 03:34:48.702329 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 27 03:34:48.702329 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 27 03:34:48.702329 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 27 03:34:48.702329 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 27 03:34:48.702329 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 03:34:48.702329 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 03:34:48.702329 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 03:34:48.702329 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 03:34:48.702329 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID aa8abea0-7278-4876-ac96-aad5872ca04f Oct 27 03:34:48.702329 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:34:48.702329 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:34:48.702329 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:34:48.702329 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:34:48.702329 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 27 03:34:48.702329 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 27 03:34:48.702329 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 27 03:34:48.702329 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 27 03:34:48.702329 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 27 03:34:48.702329 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 27 03:34:48.708853 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 27 03:34:48.708853 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 27 03:34:48.708853 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 27 03:34:48.708853 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 27 03:34:48.708853 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 03:34:48.708853 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 03:34:48.708853 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 27 03:34:48.708853 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 27 03:34:48.708853 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 03:34:48.708853 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 03:34:48.708853 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 27 03:34:48.708853 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 27 03:34:48.708853 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 27 03:34:48.708853 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 27 03:34:48.708853 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 03:34:48.708853 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 03:34:48.708853 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 03:34:48.708853 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 03:34:48.708853 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image aa8abea0-7278-4876-ac96-aad5872ca04f could not be found. Oct 27 03:34:48.708853 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:34:48.708853 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:34:48.708853 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:34:48.708853 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:34:48.708853 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:34:48.708853 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:34:48.708853 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:34:48.708853 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:34:48.708853 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:34:48.708853 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:34:48.708853 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:34:48.708853 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:34:48.708853 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Oct 27 03:34:48.708853 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 27 03:34:48.708853 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 27 03:34:48.708853 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 27 03:34:48.708853 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 27 03:34:48.708853 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:34:48.708853 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:34:48.708853 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:34:48.708853 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:34:48.708853 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:34:48.708853 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:34:48.708853 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:34:48.708853 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:34:48.708853 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 27 03:34:48.708853 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:34:48.708853 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-45961c16-c885-4755-9605-96bd097e9dce tempest-ImagesMetadataNegativeTestJSON-176704492 tempest-ImagesMetadataNegativeTestJSON-176704492-project] Returning 404 to user: Image not found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:34:48.708853 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-45961c16-c885-4755-9605-96bd097e9dce tempest-ImagesMetadataNegativeTestJSON-176704492 tempest-ImagesMetadataNegativeTestJSON-176704492-project] 10.222.0.20 "GET /compute/v2.1/images/aa8abea0-7278-4876-ac96-aad5872ca04f/metadata" status: 404 len: 62 microversion: 2.1 time: 0.036115 Oct 27 03:34:48.708853 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1767/3285] 10.222.0.20 () {58 vars in 1260 bytes} [Thu Oct 27 03:34:48 2022] GET /compute/v2.1/images/aa8abea0-7278-4876-ac96-aad5872ca04f/metadata => generated 62 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 03:34:48.725459 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4cf0fdc8-ed07-4cd0-b752-2c350401786c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:48.725459 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4cf0fdc8-ed07-4cd0-b752-2c350401786c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:48.725801 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b32572f3-d987-4f97-8708-c8bfe90ee430 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] 10.222.0.20 "GET /compute/v2.1/servers/53d360ec-9026-453d-a4a5-39a5f684b2c3" status: 200 len: 1509 microversion: 2.1 time: 0.294124 Oct 27 03:34:48.725801 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1519/3286] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:48 2022] GET /compute/v2.1/servers/53d360ec-9026-453d-a4a5-39a5f684b2c3 => generated 1509 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:48.725801 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7d70af81-0f43-4958-a354-10f3dde5c66a tempest-ImagesMetadataNegativeTestJSON-176704492 tempest-ImagesMetadataNegativeTestJSON-176704492-project] Action: 'update_all', calling method: .version_select at 0x7f7dda7a2820>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:34:48.737071 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4cf0fdc8-ed07-4cd0-b752-2c350401786c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:48.737719 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4cf0fdc8-ed07-4cd0-b752-2c350401786c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:48.738245 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4cf0fdc8-ed07-4cd0-b752-2c350401786c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:48.739047 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4cf0fdc8-ed07-4cd0-b752-2c350401786c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:48.739504 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4cf0fdc8-ed07-4cd0-b752-2c350401786c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:48.740035 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4cf0fdc8-ed07-4cd0-b752-2c350401786c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:48.756492 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-7d70af81-0f43-4958-a354-10f3dde5c66a tempest-ImagesMetadataNegativeTestJSON-176704492 tempest-ImagesMetadataNegativeTestJSON-176704492-project] HTTP exception thrown: Image not found. Oct 27 03:34:48.758964 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7d70af81-0f43-4958-a354-10f3dde5c66a tempest-ImagesMetadataNegativeTestJSON-176704492 tempest-ImagesMetadataNegativeTestJSON-176704492-project] Request method failure captured: Oct 27 03:34:48.758964 n-d-862769-1 devstack@n-api.service[121000]: request: PUT /compute/v2.1/images/0c551bc6-3c75-49f7-8825-192e3437fcd7/metadata HTTP/1.1 Oct 27 03:34:48.758964 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:34:48.758964 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:34:48.758964 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:34:48.758964 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 57 Oct 27 03:34:48.758964 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:34:48.758964 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:34:48.758964 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:34:48.758964 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:34:48.758964 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfxX36MSkR8MeZoq1me2vfL28Hx4jYNN1oqEWh2vdjT8zRiDmjnoZpyeOD27C_xNf_DWqb_-CBq5fImZLEACsIalbWWZZ27_fcw5XobN_Gu1_EmID5fK1XeLfi-W7k4qeafYp-Cf3WKFVh1gfsRbHI_0PTFjme4fwQGxEYoyOajWrPg Oct 27 03:34:48.758964 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:34:48.758964 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:34:48.758964 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:34:48.758964 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:34:48.758964 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:34:48.758964 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:34:48.758964 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 876747742e6a4efea6b788a8e8cf800c Oct 27 03:34:48.758964 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-176704492 Oct 27 03:34:48.758964 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:34:48.758964 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:34:48.758964 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/876747742e6a4efea6b788a8e8cf800c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/876747742e6a4efea6b788a8e8cf800c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/876747742e6a4efea6b788a8e8cf800c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_876747742e6a4efea6b788a8e8cf800c"}]}] Oct 27 03:34:48.758964 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-176704492 Oct 27 03:34:48.758964 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 876747742e6a4efea6b788a8e8cf800c Oct 27 03:34:48.758964 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-176704492 Oct 27 03:34:48.758964 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ImagesMetadataNegativeTestJSON-176704492-project Oct 27 03:34:48.758964 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:34:48.758964 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:34:48.758964 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: dd22f08cc08e4e1283dd2e3ffc9190f2 Oct 27 03:34:48.758964 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-176704492-project Oct 27 03:34:48.758964 n-d-862769-1 devstack@n-api.service[121000]: Oct 27 03:34:48.758964 n-d-862769-1 devstack@n-api.service[121000]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 27 03:34:48.758964 n-d-862769-1 devstack@n-api.service[121000]: method: Oct 27 03:34:48.758964 n-d-862769-1 devstack@n-api.service[121000]: exception: Image not found. Oct 27 03:34:48.758964 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'image_id': '0c551bc6-3c75-49f7-8825-192e3437fcd7', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 27 03:34:48.758964 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:34:48.758964 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:34:48.758964 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 27 03:34:48.758964 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 27 03:34:48.758964 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 03:34:48.758964 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 03:34:48.758964 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 27 03:34:48.758964 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 27 03:34:48.758964 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 03:34:48.758964 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 03:34:48.758964 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 27 03:34:48.758964 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 27 03:34:48.758964 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 27 03:34:48.758964 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 27 03:34:48.758964 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 03:34:48.758964 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 03:34:48.758964 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 03:34:48.758964 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 03:34:48.758964 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 0c551bc6-3c75-49f7-8825-192e3437fcd7 Oct 27 03:34:48.758964 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:34:48.758964 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:34:48.758964 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:34:48.758964 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:34:48.758964 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 27 03:34:48.758964 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 27 03:34:48.758964 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 27 03:34:48.758964 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 27 03:34:48.758964 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 27 03:34:48.758964 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 27 03:34:48.763127 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 27 03:34:48.763127 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 27 03:34:48.763127 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 27 03:34:48.763127 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 27 03:34:48.763127 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 03:34:48.763127 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 03:34:48.763127 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 27 03:34:48.763127 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 27 03:34:48.763127 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 03:34:48.763127 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 03:34:48.763127 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 27 03:34:48.763127 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 27 03:34:48.763127 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 27 03:34:48.763127 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 27 03:34:48.763127 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 03:34:48.763127 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 03:34:48.763127 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 03:34:48.763127 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 03:34:48.763127 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0c551bc6-3c75-49f7-8825-192e3437fcd7 could not be found. Oct 27 03:34:48.763127 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:34:48.763127 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:34:48.763127 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:34:48.763127 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:34:48.763127 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:34:48.763127 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:34:48.763127 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:34:48.763127 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:34:48.763127 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:34:48.763127 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:34:48.763127 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:34:48.763127 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:34:48.763127 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:34:48.763127 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:34:48.763127 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Oct 27 03:34:48.763127 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 27 03:34:48.763127 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 27 03:34:48.763127 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 27 03:34:48.763127 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 27 03:34:48.763127 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:34:48.763127 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:34:48.763127 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:34:48.763127 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:34:48.763127 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:34:48.763127 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:34:48.763127 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:34:48.763127 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:34:48.763127 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 27 03:34:48.763127 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:34:48.769264 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7d70af81-0f43-4958-a354-10f3dde5c66a tempest-ImagesMetadataNegativeTestJSON-176704492 tempest-ImagesMetadataNegativeTestJSON-176704492-project] Returning 404 to user: Image not found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:34:48.770351 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7d70af81-0f43-4958-a354-10f3dde5c66a tempest-ImagesMetadataNegativeTestJSON-176704492 tempest-ImagesMetadataNegativeTestJSON-176704492-project] 10.222.0.20 "PUT /compute/v2.1/images/0c551bc6-3c75-49f7-8825-192e3437fcd7/metadata" status: 404 len: 62 microversion: 2.1 time: 0.057389 Oct 27 03:34:48.771093 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1520/3287] 10.222.0.20 () {60 vars in 1280 bytes} [Thu Oct 27 03:34:48 2022] PUT /compute/v2.1/images/0c551bc6-3c75-49f7-8825-192e3437fcd7/metadata => generated 62 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 03:34:48.781316 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-cf92a45a-88a6-4e03-9747-109ab6e10587 tempest-ImagesMetadataNegativeTestJSON-176704492 tempest-ImagesMetadataNegativeTestJSON-176704492-project] Action: 'update', calling method: .version_select at 0x7f7ddaeef430>, body: {"meta": {"os_distro": "alt"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:34:48.810430 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-cf92a45a-88a6-4e03-9747-109ab6e10587 tempest-ImagesMetadataNegativeTestJSON-176704492 tempest-ImagesMetadataNegativeTestJSON-176704492-project] HTTP exception thrown: Image not found. Oct 27 03:34:48.813224 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-cf92a45a-88a6-4e03-9747-109ab6e10587 tempest-ImagesMetadataNegativeTestJSON-176704492 tempest-ImagesMetadataNegativeTestJSON-176704492-project] Request method failure captured: Oct 27 03:34:48.813224 n-d-862769-1 devstack@n-api.service[121000]: request: PUT /compute/v2.1/images/6d60d5cb-94ae-46c0-a13a-8ed363685513/metadata/os_distro HTTP/1.1 Oct 27 03:34:48.813224 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:34:48.813224 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:34:48.813224 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:34:48.813224 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 30 Oct 27 03:34:48.813224 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:34:48.813224 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:34:48.813224 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:34:48.813224 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:34:48.813224 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfxX36MSkR8MeZoq1me2vfL28Hx4jYNN1oqEWh2vdjT8zRiDmjnoZpyeOD27C_xNf_DWqb_-CBq5fImZLEACsIalbWWZZ27_fcw5XobN_Gu1_EmID5fK1XeLfi-W7k4qeafYp-Cf3WKFVh1gfsRbHI_0PTFjme4fwQGxEYoyOajWrPg Oct 27 03:34:48.813224 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:34:48.813224 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:34:48.813224 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:34:48.813224 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:34:48.813224 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:34:48.813224 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:34:48.813224 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 876747742e6a4efea6b788a8e8cf800c Oct 27 03:34:48.813224 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-176704492 Oct 27 03:34:48.813224 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:34:48.813224 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:34:48.813224 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/876747742e6a4efea6b788a8e8cf800c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/876747742e6a4efea6b788a8e8cf800c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/876747742e6a4efea6b788a8e8cf800c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_876747742e6a4efea6b788a8e8cf800c"}]}] Oct 27 03:34:48.813224 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-176704492 Oct 27 03:34:48.813224 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 876747742e6a4efea6b788a8e8cf800c Oct 27 03:34:48.813224 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-176704492 Oct 27 03:34:48.813224 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ImagesMetadataNegativeTestJSON-176704492-project Oct 27 03:34:48.813224 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:34:48.813224 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:34:48.813224 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: dd22f08cc08e4e1283dd2e3ffc9190f2 Oct 27 03:34:48.813224 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-176704492-project Oct 27 03:34:48.813224 n-d-862769-1 devstack@n-api.service[121000]: Oct 27 03:34:48.813224 n-d-862769-1 devstack@n-api.service[121000]: {"meta": {"os_distro": "alt"}} Oct 27 03:34:48.813224 n-d-862769-1 devstack@n-api.service[121000]: method: Oct 27 03:34:48.813224 n-d-862769-1 devstack@n-api.service[121000]: exception: Image not found. Oct 27 03:34:48.813224 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'image_id': '6d60d5cb-94ae-46c0-a13a-8ed363685513', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Oct 27 03:34:48.813224 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:34:48.813224 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:34:48.813224 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 27 03:34:48.813224 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 27 03:34:48.813224 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 03:34:48.813224 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 03:34:48.813224 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 27 03:34:48.813224 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 27 03:34:48.813224 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 03:34:48.813224 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 03:34:48.813224 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 27 03:34:48.813224 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 27 03:34:48.813224 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 27 03:34:48.813224 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 27 03:34:48.813224 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 03:34:48.813224 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 03:34:48.813224 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 03:34:48.813224 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 03:34:48.813224 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 6d60d5cb-94ae-46c0-a13a-8ed363685513 Oct 27 03:34:48.813224 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:34:48.813224 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:34:48.813224 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:34:48.813224 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:34:48.813224 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 27 03:34:48.813224 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 27 03:34:48.813224 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 27 03:34:48.813224 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 27 03:34:48.813224 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 27 03:34:48.813224 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 27 03:34:48.817979 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 27 03:34:48.817979 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 27 03:34:48.817979 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 27 03:34:48.817979 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 27 03:34:48.817979 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 03:34:48.817979 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 03:34:48.817979 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 27 03:34:48.817979 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 27 03:34:48.817979 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 03:34:48.817979 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 03:34:48.817979 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 27 03:34:48.817979 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 27 03:34:48.817979 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 27 03:34:48.817979 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 27 03:34:48.817979 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 03:34:48.817979 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 03:34:48.817979 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 03:34:48.817979 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 03:34:48.817979 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6d60d5cb-94ae-46c0-a13a-8ed363685513 could not be found. Oct 27 03:34:48.817979 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:34:48.817979 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:34:48.817979 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:34:48.817979 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:34:48.817979 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:34:48.817979 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:34:48.817979 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:34:48.817979 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:34:48.817979 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:34:48.817979 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:34:48.817979 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:34:48.817979 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:34:48.817979 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:34:48.817979 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:34:48.817979 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Oct 27 03:34:48.817979 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 27 03:34:48.817979 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 27 03:34:48.817979 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 27 03:34:48.817979 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 27 03:34:48.817979 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:34:48.817979 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:34:48.817979 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:34:48.817979 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:34:48.817979 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:34:48.817979 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:34:48.817979 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:34:48.817979 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:34:48.817979 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 27 03:34:48.817979 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:34:48.817979 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-cf92a45a-88a6-4e03-9747-109ab6e10587 tempest-ImagesMetadataNegativeTestJSON-176704492 tempest-ImagesMetadataNegativeTestJSON-176704492-project] Returning 404 to user: Image not found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:34:48.817979 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-cf92a45a-88a6-4e03-9747-109ab6e10587 tempest-ImagesMetadataNegativeTestJSON-176704492 tempest-ImagesMetadataNegativeTestJSON-176704492-project] 10.222.0.20 "PUT /compute/v2.1/images/6d60d5cb-94ae-46c0-a13a-8ed363685513/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.037775 Oct 27 03:34:48.821662 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1521/3288] 10.222.0.20 () {60 vars in 1310 bytes} [Thu Oct 27 03:34:48 2022] PUT /compute/v2.1/images/6d60d5cb-94ae-46c0-a13a-8ed363685513/metadata/os_distro => generated 62 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 03:34:48.826575 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4c465763-4b96-447c-b464-9dedf9e8e143 tempest-ImagesMetadataNegativeTestJSON-176704492 tempest-ImagesMetadataNegativeTestJSON-176704492-project] Action: 'create', calling method: .version_select at 0x7f7dda7a2c10>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:34:48.856859 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-4c465763-4b96-447c-b464-9dedf9e8e143 tempest-ImagesMetadataNegativeTestJSON-176704492 tempest-ImagesMetadataNegativeTestJSON-176704492-project] HTTP exception thrown: Image not found. Oct 27 03:34:48.859858 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4c465763-4b96-447c-b464-9dedf9e8e143 tempest-ImagesMetadataNegativeTestJSON-176704492 tempest-ImagesMetadataNegativeTestJSON-176704492-project] Request method failure captured: Oct 27 03:34:48.859858 n-d-862769-1 devstack@n-api.service[121000]: request: POST /compute/v2.1/images/d085d645-df37-43e0-b1a0-7d4e32c31ca9/metadata HTTP/1.1 Oct 27 03:34:48.859858 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:34:48.859858 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:34:48.859858 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:34:48.859858 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 57 Oct 27 03:34:48.859858 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:34:48.859858 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:34:48.859858 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:34:48.859858 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:34:48.859858 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfxX36MSkR8MeZoq1me2vfL28Hx4jYNN1oqEWh2vdjT8zRiDmjnoZpyeOD27C_xNf_DWqb_-CBq5fImZLEACsIalbWWZZ27_fcw5XobN_Gu1_EmID5fK1XeLfi-W7k4qeafYp-Cf3WKFVh1gfsRbHI_0PTFjme4fwQGxEYoyOajWrPg Oct 27 03:34:48.859858 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:34:48.859858 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:34:48.859858 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:34:48.859858 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:34:48.859858 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:34:48.859858 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:34:48.859858 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 876747742e6a4efea6b788a8e8cf800c Oct 27 03:34:48.859858 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-176704492 Oct 27 03:34:48.859858 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:34:48.859858 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:34:48.859858 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/876747742e6a4efea6b788a8e8cf800c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/876747742e6a4efea6b788a8e8cf800c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/876747742e6a4efea6b788a8e8cf800c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_876747742e6a4efea6b788a8e8cf800c"}]}] Oct 27 03:34:48.859858 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-176704492 Oct 27 03:34:48.859858 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 876747742e6a4efea6b788a8e8cf800c Oct 27 03:34:48.859858 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-176704492 Oct 27 03:34:48.859858 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ImagesMetadataNegativeTestJSON-176704492-project Oct 27 03:34:48.859858 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:34:48.859858 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:34:48.859858 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: dd22f08cc08e4e1283dd2e3ffc9190f2 Oct 27 03:34:48.859858 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-176704492-project Oct 27 03:34:48.859858 n-d-862769-1 devstack@n-api.service[121000]: Oct 27 03:34:48.859858 n-d-862769-1 devstack@n-api.service[121000]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 27 03:34:48.859858 n-d-862769-1 devstack@n-api.service[121000]: method: Oct 27 03:34:48.859858 n-d-862769-1 devstack@n-api.service[121000]: exception: Image not found. Oct 27 03:34:48.859858 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'image_id': 'd085d645-df37-43e0-b1a0-7d4e32c31ca9', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 27 03:34:48.859858 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:34:48.859858 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:34:48.859858 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 27 03:34:48.859858 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 27 03:34:48.859858 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 03:34:48.859858 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 03:34:48.859858 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 27 03:34:48.859858 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 27 03:34:48.859858 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 03:34:48.859858 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 03:34:48.859858 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 27 03:34:48.859858 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 27 03:34:48.859858 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 27 03:34:48.859858 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 27 03:34:48.859858 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 03:34:48.859858 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 03:34:48.859858 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 03:34:48.859858 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 03:34:48.859858 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID d085d645-df37-43e0-b1a0-7d4e32c31ca9 Oct 27 03:34:48.859858 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:34:48.859858 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:34:48.859858 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:34:48.859858 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:34:48.859858 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 27 03:34:48.859858 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 27 03:34:48.859858 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 27 03:34:48.859858 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 27 03:34:48.859858 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 27 03:34:48.859858 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 27 03:34:48.870383 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 27 03:34:48.870383 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 27 03:34:48.870383 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 27 03:34:48.870383 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 27 03:34:48.870383 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 03:34:48.870383 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 03:34:48.870383 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 27 03:34:48.870383 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 27 03:34:48.870383 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 03:34:48.870383 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 03:34:48.870383 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 27 03:34:48.870383 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 27 03:34:48.870383 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 27 03:34:48.870383 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 27 03:34:48.870383 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 03:34:48.870383 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 03:34:48.870383 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 03:34:48.870383 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 03:34:48.870383 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d085d645-df37-43e0-b1a0-7d4e32c31ca9 could not be found. Oct 27 03:34:48.870383 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:34:48.870383 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:34:48.870383 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:34:48.870383 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:34:48.870383 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:34:48.870383 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:34:48.870383 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:34:48.870383 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:34:48.870383 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:34:48.870383 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:34:48.870383 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:34:48.870383 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:34:48.870383 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:34:48.870383 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:34:48.870383 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Oct 27 03:34:48.870383 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 27 03:34:48.870383 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 27 03:34:48.870383 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 27 03:34:48.870383 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 27 03:34:48.870383 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:34:48.870383 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:34:48.870383 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:34:48.870383 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:34:48.870383 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:34:48.870383 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:34:48.870383 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:34:48.870383 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:34:48.870383 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 27 03:34:48.870383 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:34:48.870383 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4c465763-4b96-447c-b464-9dedf9e8e143 tempest-ImagesMetadataNegativeTestJSON-176704492 tempest-ImagesMetadataNegativeTestJSON-176704492-project] Returning 404 to user: Image not found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:34:48.870383 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4c465763-4b96-447c-b464-9dedf9e8e143 tempest-ImagesMetadataNegativeTestJSON-176704492 tempest-ImagesMetadataNegativeTestJSON-176704492-project] 10.222.0.20 "POST /compute/v2.1/images/d085d645-df37-43e0-b1a0-7d4e32c31ca9/metadata" status: 404 len: 62 microversion: 2.1 time: 0.039011 Oct 27 03:34:48.870383 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1522/3289] 10.222.0.20 () {60 vars in 1281 bytes} [Thu Oct 27 03:34:48 2022] POST /compute/v2.1/images/d085d645-df37-43e0-b1a0-7d4e32c31ca9/metadata => generated 62 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 03:34:48.972898 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4cf0fdc8-ed07-4cd0-b752-2c350401786c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:48.984676 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4cf0fdc8-ed07-4cd0-b752-2c350401786c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1316 microversion: 2.1 time: 0.278862 Oct 27 03:34:49.001664 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1768/3290] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:48 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1316 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:49.159472 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2bc91706-e860-458b-934a-61fe814b3f78 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7dda03c550>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:49.229167 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2bc91706-e860-458b-934a-61fe814b3f78 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images/5c03b8cf-4b2d-476c-8831-4866eeff9434" status: 200 len: 1454 microversion: 2.1 time: 0.086355 Oct 27 03:34:49.241152 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1523/3291] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:34:49 2022] GET /compute/v2.1/images/5c03b8cf-4b2d-476c-8831-4866eeff9434 => generated 1454 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:49.492342 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-e1f86823-442d-4232-b9cd-90fbd76d9338 req-53bd1062-52d0-451e-ab80-4e52dd1def37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "376ac459-e31f-4727-9e34-535f055ac20d", "name": "network-vif-plugged", "status": "completed", "tag": "e825dd69-54a1-4411-addc-e78fd04434d2"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:34:49.501529 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-fbd6d0a7-d994-4ccc-9bf7-dfd564c60ca1 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:49.502585 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-fbd6d0a7-d994-4ccc-9bf7-dfd564c60ca1 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:49.513421 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-e1f86823-442d-4232-b9cd-90fbd76d9338 req-53bd1062-52d0-451e-ab80-4e52dd1def37 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:49.513895 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fbd6d0a7-d994-4ccc-9bf7-dfd564c60ca1 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:49.514231 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-e1f86823-442d-4232-b9cd-90fbd76d9338 req-53bd1062-52d0-451e-ab80-4e52dd1def37 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:49.514685 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-e1f86823-442d-4232-b9cd-90fbd76d9338 req-53bd1062-52d0-451e-ab80-4e52dd1def37 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:49.517721 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fbd6d0a7-d994-4ccc-9bf7-dfd564c60ca1 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:49.518412 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fbd6d0a7-d994-4ccc-9bf7-dfd564c60ca1 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:49.519159 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fbd6d0a7-d994-4ccc-9bf7-dfd564c60ca1 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:49.521626 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fbd6d0a7-d994-4ccc-9bf7-dfd564c60ca1 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:49.522850 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fbd6d0a7-d994-4ccc-9bf7-dfd564c60ca1 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:49.540517 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-e1f86823-442d-4232-b9cd-90fbd76d9338 req-53bd1062-52d0-451e-ab80-4e52dd1def37 service nova] Creating event network-vif-plugged:e825dd69-54a1-4411-addc-e78fd04434d2 for instance 376ac459-e31f-4727-9e34-535f055ac20d on n-h2-862769-1 Oct 27 03:34:49.548722 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-e1f86823-442d-4232-b9cd-90fbd76d9338 req-53bd1062-52d0-451e-ab80-4e52dd1def37 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059905 Oct 27 03:34:49.550577 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1769/3292] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:34:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:34:49.650271 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-03e2421f-6d4b-4491-8db5-00b3a8c5083e tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:49.651255 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-03e2421f-6d4b-4491-8db5-00b3a8c5083e tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] [instance: 8c8a2cbb-4acf-4a6b-b684-567617bb930d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:49.665234 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-03e2421f-6d4b-4491-8db5-00b3a8c5083e tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:49.665789 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-03e2421f-6d4b-4491-8db5-00b3a8c5083e tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:49.668304 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-03e2421f-6d4b-4491-8db5-00b3a8c5083e tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:49.670151 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-03e2421f-6d4b-4491-8db5-00b3a8c5083e tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:49.670826 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-03e2421f-6d4b-4491-8db5-00b3a8c5083e tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:49.671418 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-03e2421f-6d4b-4491-8db5-00b3a8c5083e tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:49.830175 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=5 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:34:49.978705 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-03e2421f-6d4b-4491-8db5-00b3a8c5083e tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:49.990583 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-03e2421f-6d4b-4491-8db5-00b3a8c5083e tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:49.992157 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-03e2421f-6d4b-4491-8db5-00b3a8c5083e tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:49.993755 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-03e2421f-6d4b-4491-8db5-00b3a8c5083e tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d" status: 200 len: 1574 microversion: 2.42 time: 0.350644 Oct 27 03:34:49.994749 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1770/3293] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:34:49 2022] GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d => generated 1574 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:34:50.020300 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-bdb117ac-112a-4ee0-b2ba-9dee821e1bb7 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:50.022883 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-bdb117ac-112a-4ee0-b2ba-9dee821e1bb7 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] [instance: 53d360ec-9026-453d-a4a5-39a5f684b2c3] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:50.034380 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bdb117ac-112a-4ee0-b2ba-9dee821e1bb7 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:50.042803 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bdb117ac-112a-4ee0-b2ba-9dee821e1bb7 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:50.043632 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bdb117ac-112a-4ee0-b2ba-9dee821e1bb7 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:50.044500 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bdb117ac-112a-4ee0-b2ba-9dee821e1bb7 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:50.045089 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bdb117ac-112a-4ee0-b2ba-9dee821e1bb7 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:50.045991 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bdb117ac-112a-4ee0-b2ba-9dee821e1bb7 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:50.075982 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-fbd6d0a7-d994-4ccc-9bf7-dfd564c60ca1 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:50.088593 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-fbd6d0a7-d994-4ccc-9bf7-dfd564c60ca1 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1679 microversion: 2.1 time: 0.592567 Oct 27 03:34:50.092730 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1524/3294] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:49 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1679 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:50.104475 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-93a76674-aeb8-41d9-a587-1b1b6e5ca9fc tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:50.105178 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-93a76674-aeb8-41d9-a587-1b1b6e5ca9fc tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:50.122203 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-93a76674-aeb8-41d9-a587-1b1b6e5ca9fc tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:50.122868 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-93a76674-aeb8-41d9-a587-1b1b6e5ca9fc tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:50.123340 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-93a76674-aeb8-41d9-a587-1b1b6e5ca9fc tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:50.124979 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-93a76674-aeb8-41d9-a587-1b1b6e5ca9fc tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:50.125459 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-93a76674-aeb8-41d9-a587-1b1b6e5ca9fc tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:50.125904 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-93a76674-aeb8-41d9-a587-1b1b6e5ca9fc tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:50.315179 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-bdb117ac-112a-4ee0-b2ba-9dee821e1bb7 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcff40b520f749f2b4bca5eed0923504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbc26f2331d47e5863e8dbf1952906c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:50.323152 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-bdb117ac-112a-4ee0-b2ba-9dee821e1bb7 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] 10.222.0.20 "GET /compute/v2.1/servers/53d360ec-9026-453d-a4a5-39a5f684b2c3" status: 200 len: 1509 microversion: 2.1 time: 0.327301 Oct 27 03:34:50.324397 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1771/3295] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:49 2022] GET /compute/v2.1/servers/53d360ec-9026-453d-a4a5-39a5f684b2c3 => generated 1509 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:50.329482 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ddf93b86-18f7-4ca7-9385-daf0e4aecb5e tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7dda4955e0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:50.412438 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ddf93b86-18f7-4ca7-9385-daf0e4aecb5e tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images/5c03b8cf-4b2d-476c-8831-4866eeff9434" status: 200 len: 1454 microversion: 2.1 time: 0.086763 Oct 27 03:34:50.421938 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1772/3296] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:34:50 2022] GET /compute/v2.1/images/5c03b8cf-4b2d-476c-8831-4866eeff9434 => generated 1454 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:50.600099 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-93a76674-aeb8-41d9-a587-1b1b6e5ca9fc tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:50.622517 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-93a76674-aeb8-41d9-a587-1b1b6e5ca9fc tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1316 microversion: 2.1 time: 0.528348 Oct 27 03:34:50.623192 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1525/3297] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:50 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1316 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:51.030096 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e6d7184d-62af-4e61-9558-c1cb1816a728 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:51.043822 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e6d7184d-62af-4e61-9558-c1cb1816a728 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] [instance: 8c8a2cbb-4acf-4a6b-b684-567617bb930d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:51.052427 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:34:51.056815 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e6d7184d-62af-4e61-9558-c1cb1816a728 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:51.067373 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e6d7184d-62af-4e61-9558-c1cb1816a728 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:51.072964 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e6d7184d-62af-4e61-9558-c1cb1816a728 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:51.072964 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e6d7184d-62af-4e61-9558-c1cb1816a728 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:51.072964 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e6d7184d-62af-4e61-9558-c1cb1816a728 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:51.072964 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e6d7184d-62af-4e61-9558-c1cb1816a728 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:51.116499 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e2927b08-ed3f-4ca2-9818-ce88179fabc3 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:51.118536 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e2927b08-ed3f-4ca2-9818-ce88179fabc3 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:51.132503 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e2927b08-ed3f-4ca2-9818-ce88179fabc3 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:51.133105 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e2927b08-ed3f-4ca2-9818-ce88179fabc3 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:51.134530 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e2927b08-ed3f-4ca2-9818-ce88179fabc3 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:51.135284 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e2927b08-ed3f-4ca2-9818-ce88179fabc3 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:51.135757 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e2927b08-ed3f-4ca2-9818-ce88179fabc3 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:51.136189 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e2927b08-ed3f-4ca2-9818-ce88179fabc3 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:51.369661 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e6d7184d-62af-4e61-9558-c1cb1816a728 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:51.392980 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e6d7184d-62af-4e61-9558-c1cb1816a728 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:51.396591 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e6d7184d-62af-4e61-9558-c1cb1816a728 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:51.400005 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e6d7184d-62af-4e61-9558-c1cb1816a728 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d" status: 200 len: 1582 microversion: 2.42 time: 0.381969 Oct 27 03:34:51.403918 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1773/3298] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:34:51 2022] GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d => generated 1582 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:34:51.428385 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ec5a7d91-0f78-4b2a-8927-104f26f4dddb tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:51.433890 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ec5a7d91-0f78-4b2a-8927-104f26f4dddb tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] [instance: 53d360ec-9026-453d-a4a5-39a5f684b2c3] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:51.436679 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ec5a7d91-0f78-4b2a-8927-104f26f4dddb tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:51.440066 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ec5a7d91-0f78-4b2a-8927-104f26f4dddb tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:51.441215 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ec5a7d91-0f78-4b2a-8927-104f26f4dddb tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:51.443431 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ec5a7d91-0f78-4b2a-8927-104f26f4dddb tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:51.444222 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ec5a7d91-0f78-4b2a-8927-104f26f4dddb tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:51.445647 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ec5a7d91-0f78-4b2a-8927-104f26f4dddb tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:51.626955 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ec5a7d91-0f78-4b2a-8927-104f26f4dddb tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcff40b520f749f2b4bca5eed0923504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbc26f2331d47e5863e8dbf1952906c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:51.645551 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ec5a7d91-0f78-4b2a-8927-104f26f4dddb tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] 10.222.0.20 "GET /compute/v2.1/servers/53d360ec-9026-453d-a4a5-39a5f684b2c3" status: 200 len: 1467 microversion: 2.1 time: 0.240388 Oct 27 03:34:51.646560 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1774/3299] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:51 2022] GET /compute/v2.1/servers/53d360ec-9026-453d-a4a5-39a5f684b2c3 => generated 1467 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:51.663399 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-2cf6a192-fa0b-4fbd-b906-cb3b137ea4a2 req-35ce1e20-73d0-4a59-8d65-2a6989d75b7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53d360ec-9026-453d-a4a5-39a5f684b2c3", "name": "network-vif-deleted", "tag": "9b78254a-b82d-4931-b6bc-b7eb6c9e37ad"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:34:51.707863 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-2cf6a192-fa0b-4fbd-b906-cb3b137ea4a2 req-35ce1e20-73d0-4a59-8d65-2a6989d75b7d service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:51.708364 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-2cf6a192-fa0b-4fbd-b906-cb3b137ea4a2 req-35ce1e20-73d0-4a59-8d65-2a6989d75b7d service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:51.708809 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-2cf6a192-fa0b-4fbd-b906-cb3b137ea4a2 req-35ce1e20-73d0-4a59-8d65-2a6989d75b7d service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:51.715004 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e2927b08-ed3f-4ca2-9818-ce88179fabc3 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:51.732045 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e2927b08-ed3f-4ca2-9818-ce88179fabc3 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1679 microversion: 2.1 time: 0.619036 Oct 27 03:34:51.732045 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1526/3300] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:51 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1679 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:34:51.771822 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4b0e5076-911d-415c-8b1b-721543baac56 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7ddece8040>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:51.774839 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-2cf6a192-fa0b-4fbd-b906-cb3b137ea4a2 req-35ce1e20-73d0-4a59-8d65-2a6989d75b7d service nova] Creating event network-vif-deleted:9b78254a-b82d-4931-b6bc-b7eb6c9e37ad for instance 53d360ec-9026-453d-a4a5-39a5f684b2c3 on n-h1-862769-1 Oct 27 03:34:51.806536 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-2cf6a192-fa0b-4fbd-b906-cb3b137ea4a2 req-35ce1e20-73d0-4a59-8d65-2a6989d75b7d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155080 Oct 27 03:34:51.807842 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1775/3301] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:34:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:34:51.819312 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8be2c48a-039f-4dd5-9949-634a7f57d156 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:51.821667 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8be2c48a-039f-4dd5-9949-634a7f57d156 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:51.835794 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8be2c48a-039f-4dd5-9949-634a7f57d156 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:51.841092 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8be2c48a-039f-4dd5-9949-634a7f57d156 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:51.841092 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8be2c48a-039f-4dd5-9949-634a7f57d156 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:51.841092 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8be2c48a-039f-4dd5-9949-634a7f57d156 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:51.841092 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8be2c48a-039f-4dd5-9949-634a7f57d156 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:51.841092 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8be2c48a-039f-4dd5-9949-634a7f57d156 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:51.896589 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4b0e5076-911d-415c-8b1b-721543baac56 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images/5c03b8cf-4b2d-476c-8831-4866eeff9434" status: 200 len: 1454 microversion: 2.1 time: 0.140648 Oct 27 03:34:51.898443 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1527/3302] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:34:51 2022] GET /compute/v2.1/images/5c03b8cf-4b2d-476c-8831-4866eeff9434 => generated 1454 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:51.912145 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1158fe3a-b341-4463-b100-336f5d9cd878 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1799080348", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": [{"uuid": "91b94399-8d53-4404-9008-b6c04463b3f2"}, {"uuid": "637b2a72-3148-4d91-a91a-71da7ac75bd2"}]}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:34:52.018911 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-1158fe3a-b341-4463-b100-336f5d9cd878 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] validate_networks() for [('91b94399-8d53-4404-9008-b6c04463b3f2', None, None, None, None, None), ('637b2a72-3148-4d91-a91a-71da7ac75bd2', None, None, None, None, None)] {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:34:52.500429 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8be2c48a-039f-4dd5-9949-634a7f57d156 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:52.508681 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8be2c48a-039f-4dd5-9949-634a7f57d156 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1505 microversion: 2.1 time: 0.699468 Oct 27 03:34:52.512616 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1776/3303] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:51 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1505 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:52.522400 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-89d7caab-5428-499f-a778-2e8700f6edce tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:52.528475 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-89d7caab-5428-499f-a778-2e8700f6edce tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] [instance: 8c8a2cbb-4acf-4a6b-b684-567617bb930d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:52.542647 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-89d7caab-5428-499f-a778-2e8700f6edce tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:52.561426 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-89d7caab-5428-499f-a778-2e8700f6edce tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:52.562472 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-89d7caab-5428-499f-a778-2e8700f6edce tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:52.564489 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-89d7caab-5428-499f-a778-2e8700f6edce tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:52.566909 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-89d7caab-5428-499f-a778-2e8700f6edce tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:52.570694 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-89d7caab-5428-499f-a778-2e8700f6edce tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:52.839606 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-89d7caab-5428-499f-a778-2e8700f6edce tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:52.853800 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-89d7caab-5428-499f-a778-2e8700f6edce tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:52.858818 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-89d7caab-5428-499f-a778-2e8700f6edce tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:52.862323 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-89d7caab-5428-499f-a778-2e8700f6edce tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d" status: 200 len: 1592 microversion: 2.42 time: 0.348356 Oct 27 03:34:52.863142 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1777/3304] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:34:52 2022] GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d => generated 1592 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:34:52.872736 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-63b36eb8-42f1-4176-93f4-04ed5e584bed tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:52.876037 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-63b36eb8-42f1-4176-93f4-04ed5e584bed tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] [instance: 53d360ec-9026-453d-a4a5-39a5f684b2c3] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:52.901758 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-63b36eb8-42f1-4176-93f4-04ed5e584bed tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:52.902296 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-63b36eb8-42f1-4176-93f4-04ed5e584bed tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:52.902742 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-63b36eb8-42f1-4176-93f4-04ed5e584bed tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:52.903482 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-63b36eb8-42f1-4176-93f4-04ed5e584bed tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:52.903929 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-63b36eb8-42f1-4176-93f4-04ed5e584bed tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:52.904363 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-63b36eb8-42f1-4176-93f4-04ed5e584bed tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:53.031823 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-63b36eb8-42f1-4176-93f4-04ed5e584bed tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:53.032329 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-63b36eb8-42f1-4176-93f4-04ed5e584bed tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:53.032774 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-63b36eb8-42f1-4176-93f4-04ed5e584bed tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:53.033236 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-63b36eb8-42f1-4176-93f4-04ed5e584bed tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Lazy-loading 'fault' on Instance uuid 53d360ec-9026-453d-a4a5-39a5f684b2c3 {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:34:53.148286 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-63b36eb8-42f1-4176-93f4-04ed5e584bed tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcff40b520f749f2b4bca5eed0923504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbc26f2331d47e5863e8dbf1952906c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:53.159735 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-63b36eb8-42f1-4176-93f4-04ed5e584bed tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] 10.222.0.20 "GET /compute/v2.1/servers/53d360ec-9026-453d-a4a5-39a5f684b2c3" status: 200 len: 1305 microversion: 2.1 time: 0.293098 Oct 27 03:34:53.162880 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1778/3305] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:52 2022] GET /compute/v2.1/servers/53d360ec-9026-453d-a4a5-39a5f684b2c3 => generated 1305 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:53.174606 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-02637bfe-b9ab-426e-af1b-eca6b6247b1e req-d103f402-12fa-4ee0-ba5f-46350092b252 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f50da5a9-2bb6-4735-93c3-d73ece0964f3", "name": "network-vif-plugged", "status": "completed", "tag": "271e155b-8765-4519-870e-105aa22f7ae9"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:34:53.199252 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-02637bfe-b9ab-426e-af1b-eca6b6247b1e req-d103f402-12fa-4ee0-ba5f-46350092b252 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:53.203236 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-02637bfe-b9ab-426e-af1b-eca6b6247b1e req-d103f402-12fa-4ee0-ba5f-46350092b252 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:53.204968 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-02637bfe-b9ab-426e-af1b-eca6b6247b1e req-d103f402-12fa-4ee0-ba5f-46350092b252 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:53.222357 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-02637bfe-b9ab-426e-af1b-eca6b6247b1e req-d103f402-12fa-4ee0-ba5f-46350092b252 service nova] Creating event network-vif-plugged:271e155b-8765-4519-870e-105aa22f7ae9 for instance f50da5a9-2bb6-4735-93c3-d73ece0964f3 on n-h1-862769-1 Oct 27 03:34:53.236141 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-02637bfe-b9ab-426e-af1b-eca6b6247b1e req-d103f402-12fa-4ee0-ba5f-46350092b252 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074357 Oct 27 03:34:53.238624 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1779/3306] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:34:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:34:53.261016 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-bed4b3b5-8bb5-4c64-a9dc-3bd328c50902 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:53.267088 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-bed4b3b5-8bb5-4c64-a9dc-3bd328c50902 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:53.281727 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bed4b3b5-8bb5-4c64-a9dc-3bd328c50902 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:53.282601 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bed4b3b5-8bb5-4c64-a9dc-3bd328c50902 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:53.283448 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bed4b3b5-8bb5-4c64-a9dc-3bd328c50902 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:53.286944 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bed4b3b5-8bb5-4c64-a9dc-3bd328c50902 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:53.287709 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bed4b3b5-8bb5-4c64-a9dc-3bd328c50902 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:53.288379 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bed4b3b5-8bb5-4c64-a9dc-3bd328c50902 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:54.174739 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-bed4b3b5-8bb5-4c64-a9dc-3bd328c50902 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:54.191000 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-bed4b3b5-8bb5-4c64-a9dc-3bd328c50902 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1679 microversion: 2.1 time: 0.945919 Oct 27 03:34:54.194270 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1780/3307] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:53 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1679 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:54.201729 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-69e813eb-8d5a-48f3-b1db-031d07592819 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-773441881", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": [{"uuid": "0f1ea857-e60a-4a6e-a6c9-70bfd2dd2db8"}]}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:34:54.337789 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.network.neutron [None req-69e813eb-8d5a-48f3-b1db-031d07592819 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] validate_networks() for [('0f1ea857-e60a-4a6e-a6c9-70bfd2dd2db8', None, None, None, None, None)] {{(pid=121001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:34:54.518472 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-1158fe3a-b341-4463-b100-336f5d9cd878 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:34:54.519610 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-1158fe3a-b341-4463-b100-336f5d9cd878 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:34:54.520566 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-1158fe3a-b341-4463-b100-336f5d9cd878 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:34:54.521212 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-1158fe3a-b341-4463-b100-336f5d9cd878 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:34:54.521862 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-1158fe3a-b341-4463-b100-336f5d9cd878 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:34:54.548045 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1158fe3a-b341-4463-b100-336f5d9cd878 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:54.548772 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1158fe3a-b341-4463-b100-336f5d9cd878 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:54.550905 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1158fe3a-b341-4463-b100-336f5d9cd878 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:54.552759 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1158fe3a-b341-4463-b100-336f5d9cd878 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:54.555790 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1158fe3a-b341-4463-b100-336f5d9cd878 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:54.556459 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1158fe3a-b341-4463-b100-336f5d9cd878 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:54.615828 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-1158fe3a-b341-4463-b100-336f5d9cd878 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Getting quotas for project 2057593072c14804ab70fe4bdea2c17c. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:34:54.625492 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-1158fe3a-b341-4463-b100-336f5d9cd878 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Getting quotas for user 881f054c84d04ceaa17a5817816022d4 and project 2057593072c14804ab70fe4bdea2c17c. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:34:54.645395 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1158fe3a-b341-4463-b100-336f5d9cd878 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:34:54.652125 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1158fe3a-b341-4463-b100-336f5d9cd878 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] [instance: 2410110f-fee8-4669-be8c-5137af8f074f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:34:54.814673 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1158fe3a-b341-4463-b100-336f5d9cd878 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.907508 Oct 27 03:34:54.823921 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1528/3308] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:34:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 2919 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 03:34:54.834379 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5788f93c-a0b4-4457-82cd-6a14038e2ead tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7dda03cca0>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:54.923047 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5788f93c-a0b4-4457-82cd-6a14038e2ead tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images/5c03b8cf-4b2d-476c-8831-4866eeff9434" status: 200 len: 1454 microversion: 2.1 time: 0.097717 Oct 27 03:34:54.924900 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1529/3309] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:34:54 2022] GET /compute/v2.1/images/5c03b8cf-4b2d-476c-8831-4866eeff9434 => generated 1454 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:54.946733 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-84d0c111-3eaa-4a95-a9b9-c5a23c666b6c tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:54.948176 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-84d0c111-3eaa-4a95-a9b9-c5a23c666b6c tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] [instance: 8c8a2cbb-4acf-4a6b-b684-567617bb930d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:54.964079 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-84d0c111-3eaa-4a95-a9b9-c5a23c666b6c tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:54.964909 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-84d0c111-3eaa-4a95-a9b9-c5a23c666b6c tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:54.965544 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-84d0c111-3eaa-4a95-a9b9-c5a23c666b6c tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:54.971145 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-84d0c111-3eaa-4a95-a9b9-c5a23c666b6c tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:54.973132 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-84d0c111-3eaa-4a95-a9b9-c5a23c666b6c tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:54.973808 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-84d0c111-3eaa-4a95-a9b9-c5a23c666b6c tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:55.543321 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-69e813eb-8d5a-48f3-b1db-031d07592819 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Flavor limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:34:55.543800 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-69e813eb-8d5a-48f3-b1db-031d07592819 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Image limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:34:55.544225 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-69e813eb-8d5a-48f3-b1db-031d07592819 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Flavor pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:34:55.544645 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-69e813eb-8d5a-48f3-b1db-031d07592819 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Image pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:34:55.545255 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-69e813eb-8d5a-48f3-b1db-031d07592819 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:34:55.562857 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-69e813eb-8d5a-48f3-b1db-031d07592819 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:55.566171 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-69e813eb-8d5a-48f3-b1db-031d07592819 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:55.566171 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-69e813eb-8d5a-48f3-b1db-031d07592819 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:55.566171 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-69e813eb-8d5a-48f3-b1db-031d07592819 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:55.566171 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-69e813eb-8d5a-48f3-b1db-031d07592819 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:55.568781 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-69e813eb-8d5a-48f3-b1db-031d07592819 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:55.620969 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-69e813eb-8d5a-48f3-b1db-031d07592819 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Getting quotas for project 8bb5d291069d4329a90123e327fe9c59. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:34:55.630026 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-84d0c111-3eaa-4a95-a9b9-c5a23c666b6c tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:55.640215 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-84d0c111-3eaa-4a95-a9b9-c5a23c666b6c tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:55.650796 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-69e813eb-8d5a-48f3-b1db-031d07592819 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Getting quotas for user f9c32b7626594ff888970c7f3227bb20 and project 8bb5d291069d4329a90123e327fe9c59. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:34:55.669839 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-84d0c111-3eaa-4a95-a9b9-c5a23c666b6c tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:55.669839 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-84d0c111-3eaa-4a95-a9b9-c5a23c666b6c tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d" status: 200 len: 1660 microversion: 2.42 time: 0.738248 Oct 27 03:34:55.677181 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1530/3310] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:34:54 2022] GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d => generated 1660 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:34:55.682168 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8e2fb26c-5c0f-4456-8f4f-c1c328cb9783 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:55.682802 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8e2fb26c-5c0f-4456-8f4f-c1c328cb9783 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] [instance: 53d360ec-9026-453d-a4a5-39a5f684b2c3] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:55.696861 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-69e813eb-8d5a-48f3-b1db-031d07592819 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Going to run 1 instances... {{(pid=121001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:34:55.706154 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-69e813eb-8d5a-48f3-b1db-031d07592819 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 35a0ac1a-379f-456e-a3d7-81f888daebbf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:34:55.731259 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8e2fb26c-5c0f-4456-8f4f-c1c328cb9783 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:55.731789 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8e2fb26c-5c0f-4456-8f4f-c1c328cb9783 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:55.732228 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8e2fb26c-5c0f-4456-8f4f-c1c328cb9783 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:55.741328 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8e2fb26c-5c0f-4456-8f4f-c1c328cb9783 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:55.744587 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8e2fb26c-5c0f-4456-8f4f-c1c328cb9783 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:55.744694 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8e2fb26c-5c0f-4456-8f4f-c1c328cb9783 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:55.810222 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-8e2fb26c-5c0f-4456-8f4f-c1c328cb9783 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] HTTP exception thrown: Instance 53d360ec-9026-453d-a4a5-39a5f684b2c3 could not be found. Oct 27 03:34:55.815785 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8e2fb26c-5c0f-4456-8f4f-c1c328cb9783 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Request method failure captured: Oct 27 03:34:55.815785 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/53d360ec-9026-453d-a4a5-39a5f684b2c3 HTTP/1.1 Oct 27 03:34:55.815785 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:34:55.815785 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:34:55.815785 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:34:55.815785 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:34:55.815785 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:34:55.815785 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:34:55.815785 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:34:55.815785 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:34:55.815785 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfw5Hg9Dn80XtuPZ0SUgRG9GIDWS3m6hq4adw_IRnpMuB7IFI-XVZzVmZn3Jztjbd9AMyUklffe6AyBGnN0xhKpwhnMNmpSsvsriT1FW2bt9_waQmem8rPe1OJMWC9DNfibaNmG8M8uH6LqOjp0i6hFTOwV4xTReezE7DSw6hTLZt90 Oct 27 03:34:55.815785 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:34:55.815785 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:34:55.815785 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:34:55.815785 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:34:55.815785 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:34:55.815785 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:34:55.815785 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: dbbc26f2331d47e5863e8dbf1952906c Oct 27 03:34:55.815785 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ServerPasswordTestJSON-1909556064 Oct 27 03:34:55.815785 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:34:55.815785 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:34:55.815785 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dbbc26f2331d47e5863e8dbf1952906c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dbbc26f2331d47e5863e8dbf1952906c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dbbc26f2331d47e5863e8dbf1952906c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dbbc26f2331d47e5863e8dbf1952906c"}]}] Oct 27 03:34:55.815785 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ServerPasswordTestJSON-1909556064 Oct 27 03:34:55.815785 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: dbbc26f2331d47e5863e8dbf1952906c Oct 27 03:34:55.815785 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ServerPasswordTestJSON-1909556064 Oct 27 03:34:55.815785 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ServerPasswordTestJSON-1909556064-project Oct 27 03:34:55.815785 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:34:55.815785 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:34:55.815785 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: fcff40b520f749f2b4bca5eed0923504 Oct 27 03:34:55.815785 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ServerPasswordTestJSON-1909556064-project Oct 27 03:34:55.815785 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:34:55.815785 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 53d360ec-9026-453d-a4a5-39a5f684b2c3 could not be found. Oct 27 03:34:55.815785 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '53d360ec-9026-453d-a4a5-39a5f684b2c3'} Oct 27 03:34:55.815785 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:34:55.815785 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:34:55.815785 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:34:55.815785 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:34:55.815785 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:34:55.815785 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:34:55.815785 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:34:55.815785 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:34:55.815785 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:34:55.815785 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:34:55.815785 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53d360ec-9026-453d-a4a5-39a5f684b2c3 could not be found. Oct 27 03:34:55.815785 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:34:55.815785 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:34:55.815785 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:34:55.815785 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:34:55.815785 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:34:55.815785 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:34:55.815785 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:34:55.815785 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:34:55.815785 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:34:55.815785 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:34:55.815785 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:34:55.815785 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:34:55.815785 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:34:55.815785 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:34:55.815785 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:34:55.815785 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:34:55.815785 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53d360ec-9026-453d-a4a5-39a5f684b2c3 could not be found. Oct 27 03:34:55.815785 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:34:55.815785 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:34:55.815785 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:34:55.820998 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:34:55.820998 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:34:55.820998 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:34:55.820998 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:34:55.820998 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:34:55.820998 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53d360ec-9026-453d-a4a5-39a5f684b2c3 could not be found. Oct 27 03:34:55.820998 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:34:55.820998 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8e2fb26c-5c0f-4456-8f4f-c1c328cb9783 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] Returning 404 to user: Instance 53d360ec-9026-453d-a4a5-39a5f684b2c3 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:34:55.820998 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8e2fb26c-5c0f-4456-8f4f-c1c328cb9783 tempest-ServerPasswordTestJSON-1909556064 tempest-ServerPasswordTestJSON-1909556064-project] 10.222.0.20 "GET /compute/v2.1/servers/53d360ec-9026-453d-a4a5-39a5f684b2c3" status: 404 len: 111 microversion: 2.1 time: 0.140001 Oct 27 03:34:55.823741 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1531/3311] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:55 2022] GET /compute/v2.1/servers/53d360ec-9026-453d-a4a5-39a5f684b2c3 => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:34:55.837824 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e8c49c8a-2435-4034-92b5-09668e6fd257 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:55.839071 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e8c49c8a-2435-4034-92b5-09668e6fd257 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] [instance: 2410110f-fee8-4669-be8c-5137af8f074f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:55.886009 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-69e813eb-8d5a-48f3-b1db-031d07592819 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.689803 Oct 27 03:34:55.915651 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1781/3312] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:34:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1721 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 03:34:55.942773 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c1989297-357c-4e75-b35f-3ef6576eb990 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:55.943415 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c1989297-357c-4e75-b35f-3ef6576eb990 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:55.986015 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c1989297-357c-4e75-b35f-3ef6576eb990 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:55.986015 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c1989297-357c-4e75-b35f-3ef6576eb990 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:55.986015 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c1989297-357c-4e75-b35f-3ef6576eb990 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:55.986015 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c1989297-357c-4e75-b35f-3ef6576eb990 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:55.987893 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c1989297-357c-4e75-b35f-3ef6576eb990 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:55.989086 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c1989297-357c-4e75-b35f-3ef6576eb990 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:56.024239 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e8c49c8a-2435-4034-92b5-09668e6fd257 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881f054c84d04ceaa17a5817816022d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2057593072c14804ab70fe4bdea2c17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:56.034385 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e8c49c8a-2435-4034-92b5-09668e6fd257 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] 10.222.0.20 "GET /compute/v2.1/servers/2410110f-fee8-4669-be8c-5137af8f074f" status: 200 len: 1213 microversion: 2.1 time: 0.207550 Oct 27 03:34:56.056280 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1532/3313] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:55 2022] GET /compute/v2.1/servers/2410110f-fee8-4669-be8c-5137af8f074f => generated 1213 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:56.095444 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4c4e9854-3fa0-4427-a5d7-def2820f717a tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:56.096279 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4c4e9854-3fa0-4427-a5d7-def2820f717a tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 35a0ac1a-379f-456e-a3d7-81f888daebbf] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:56.219038 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4c4e9854-3fa0-4427-a5d7-def2820f717a tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:56.227137 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4c4e9854-3fa0-4427-a5d7-def2820f717a tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/35a0ac1a-379f-456e-a3d7-81f888daebbf" status: 200 len: 1216 microversion: 2.1 time: 0.169619 Oct 27 03:34:56.230513 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1533/3314] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:56 2022] GET /compute/v2.1/servers/35a0ac1a-379f-456e-a3d7-81f888daebbf => generated 1216 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:56.239473 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-091e6c54-0323-4a8f-bb9d-fcfd9c38a4f0 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7dda0fd9d0>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:56.310858 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-091e6c54-0323-4a8f-bb9d-fcfd9c38a4f0 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images/5c03b8cf-4b2d-476c-8831-4866eeff9434" status: 200 len: 1454 microversion: 2.1 time: 0.078784 Oct 27 03:34:56.311538 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1534/3315] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:34:56 2022] GET /compute/v2.1/images/5c03b8cf-4b2d-476c-8831-4866eeff9434 => generated 1454 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:56.706020 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c910ad5b-0b63-4811-802b-8099af616b30 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:56.709048 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c910ad5b-0b63-4811-802b-8099af616b30 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] [instance: 8c8a2cbb-4acf-4a6b-b684-567617bb930d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:56.731066 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c910ad5b-0b63-4811-802b-8099af616b30 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:56.732541 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c910ad5b-0b63-4811-802b-8099af616b30 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:56.736384 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c910ad5b-0b63-4811-802b-8099af616b30 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:56.739777 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c910ad5b-0b63-4811-802b-8099af616b30 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:56.741716 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c910ad5b-0b63-4811-802b-8099af616b30 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:56.743866 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c910ad5b-0b63-4811-802b-8099af616b30 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:57.062463 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c1989297-357c-4e75-b35f-3ef6576eb990 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:57.082496 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c1989297-357c-4e75-b35f-3ef6576eb990 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1679 microversion: 2.1 time: 1.165575 Oct 27 03:34:57.086895 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1782/3316] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:55 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1679 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:57.107496 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f79b65f1-0fb4-4971-a02c-64aad99e39bb tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:57.111331 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f79b65f1-0fb4-4971-a02c-64aad99e39bb tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] [instance: 2410110f-fee8-4669-be8c-5137af8f074f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:57.133519 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f79b65f1-0fb4-4971-a02c-64aad99e39bb tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:57.135186 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f79b65f1-0fb4-4971-a02c-64aad99e39bb tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:57.135897 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f79b65f1-0fb4-4971-a02c-64aad99e39bb tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:57.137408 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f79b65f1-0fb4-4971-a02c-64aad99e39bb tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:57.138330 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f79b65f1-0fb4-4971-a02c-64aad99e39bb tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:57.139107 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f79b65f1-0fb4-4971-a02c-64aad99e39bb tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:57.307349 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f79b65f1-0fb4-4971-a02c-64aad99e39bb tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881f054c84d04ceaa17a5817816022d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2057593072c14804ab70fe4bdea2c17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:57.320447 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f79b65f1-0fb4-4971-a02c-64aad99e39bb tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] 10.222.0.20 "GET /compute/v2.1/servers/2410110f-fee8-4669-be8c-5137af8f074f" status: 200 len: 1209 microversion: 2.1 time: 0.233210 Oct 27 03:34:57.327300 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c910ad5b-0b63-4811-802b-8099af616b30 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:57.344270 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1783/3317] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:57 2022] GET /compute/v2.1/servers/2410110f-fee8-4669-be8c-5137af8f074f => generated 1209 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:57.352737 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9835d462-e351-4721-87b9-c05763aaba16 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:57.353370 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-9835d462-e351-4721-87b9-c05763aaba16 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 35a0ac1a-379f-456e-a3d7-81f888daebbf] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:57.414896 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c910ad5b-0b63-4811-802b-8099af616b30 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:57.419043 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c910ad5b-0b63-4811-802b-8099af616b30 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:57.426293 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c910ad5b-0b63-4811-802b-8099af616b30 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d" status: 200 len: 1707 microversion: 2.42 time: 0.725732 Oct 27 03:34:57.431484 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1535/3318] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:34:56 2022] GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d => generated 1707 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:34:57.474308 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5d4c4bf3-5bee-4abe-919d-989f0e4d90a8 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7dda275a60>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:57.561435 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5d4c4bf3-5bee-4abe-919d-989f0e4d90a8 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images/5c03b8cf-4b2d-476c-8831-4866eeff9434" status: 200 len: 1454 microversion: 2.1 time: 0.127378 Oct 27 03:34:57.568388 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1536/3319] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:34:57 2022] GET /compute/v2.1/images/5c03b8cf-4b2d-476c-8831-4866eeff9434 => generated 1454 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:57.900813 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9835d462-e351-4721-87b9-c05763aaba16 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:57.909863 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9835d462-e351-4721-87b9-c05763aaba16 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/35a0ac1a-379f-456e-a3d7-81f888daebbf" status: 200 len: 1216 microversion: 2.1 time: 0.564332 Oct 27 03:34:57.911047 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1784/3320] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:57 2022] GET /compute/v2.1/servers/35a0ac1a-379f-456e-a3d7-81f888daebbf => generated 1216 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:58.111390 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-248eb858-9f99-43e7-959b-36a39480eaae tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:58.113392 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-248eb858-9f99-43e7-959b-36a39480eaae tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:58.130182 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-248eb858-9f99-43e7-959b-36a39480eaae tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:58.131383 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-248eb858-9f99-43e7-959b-36a39480eaae tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:58.133269 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-248eb858-9f99-43e7-959b-36a39480eaae tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:58.136095 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-248eb858-9f99-43e7-959b-36a39480eaae tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:58.137353 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-248eb858-9f99-43e7-959b-36a39480eaae tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:58.138468 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-248eb858-9f99-43e7-959b-36a39480eaae tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:58.356218 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6f62d268-3b5d-4fc9-a850-5f8f8657d08c tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:58.357566 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-6f62d268-3b5d-4fc9-a850-5f8f8657d08c tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] [instance: 2410110f-fee8-4669-be8c-5137af8f074f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:58.370236 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6f62d268-3b5d-4fc9-a850-5f8f8657d08c tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:58.371068 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6f62d268-3b5d-4fc9-a850-5f8f8657d08c tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:58.372461 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6f62d268-3b5d-4fc9-a850-5f8f8657d08c tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:58.373394 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6f62d268-3b5d-4fc9-a850-5f8f8657d08c tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:58.380984 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6f62d268-3b5d-4fc9-a850-5f8f8657d08c tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:58.381823 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6f62d268-3b5d-4fc9-a850-5f8f8657d08c tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:58.571033 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6f62d268-3b5d-4fc9-a850-5f8f8657d08c tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881f054c84d04ceaa17a5817816022d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2057593072c14804ab70fe4bdea2c17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:58.586832 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6f62d268-3b5d-4fc9-a850-5f8f8657d08c tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] 10.222.0.20 "GET /compute/v2.1/servers/2410110f-fee8-4669-be8c-5137af8f074f" status: 200 len: 1273 microversion: 2.1 time: 0.234795 Oct 27 03:34:58.587475 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1785/3321] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:58 2022] GET /compute/v2.1/servers/2410110f-fee8-4669-be8c-5137af8f074f => generated 1273 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:58.602226 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-cb0b8f99-777e-492d-8004-1c1d1bed6d0f tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:58.603080 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-cb0b8f99-777e-492d-8004-1c1d1bed6d0f tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] [instance: 8c8a2cbb-4acf-4a6b-b684-567617bb930d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:58.621553 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cb0b8f99-777e-492d-8004-1c1d1bed6d0f tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:58.625761 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cb0b8f99-777e-492d-8004-1c1d1bed6d0f tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:58.626697 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cb0b8f99-777e-492d-8004-1c1d1bed6d0f tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:58.627603 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cb0b8f99-777e-492d-8004-1c1d1bed6d0f tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:58.628252 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cb0b8f99-777e-492d-8004-1c1d1bed6d0f tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:58.628850 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cb0b8f99-777e-492d-8004-1c1d1bed6d0f tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:59.474857 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-248eb858-9f99-43e7-959b-36a39480eaae tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:59.486509 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-248eb858-9f99-43e7-959b-36a39480eaae tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1679 microversion: 2.1 time: 1.381413 Oct 27 03:34:59.497384 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1537/3322] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:58 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1679 bytes in 1393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:59.513751 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e6026a07-08aa-4b91-ab85-85147e65b2d0 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7dd9dd7040>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:59.648100 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e6026a07-08aa-4b91-ab85-85147e65b2d0 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images/5c03b8cf-4b2d-476c-8831-4866eeff9434" status: 200 len: 1454 microversion: 2.1 time: 0.149109 Oct 27 03:34:59.649012 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1538/3323] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:34:59 2022] GET /compute/v2.1/images/5c03b8cf-4b2d-476c-8831-4866eeff9434 => generated 1454 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:59.663129 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-01d7a494-8c12-4805-87af-2b87c3aba521 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:59.665979 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-01d7a494-8c12-4805-87af-2b87c3aba521 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 35a0ac1a-379f-456e-a3d7-81f888daebbf] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:59.681757 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-01d7a494-8c12-4805-87af-2b87c3aba521 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:59.682803 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-01d7a494-8c12-4805-87af-2b87c3aba521 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:59.684393 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-01d7a494-8c12-4805-87af-2b87c3aba521 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:59.687146 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-01d7a494-8c12-4805-87af-2b87c3aba521 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:59.688318 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-01d7a494-8c12-4805-87af-2b87c3aba521 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:59.689664 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-01d7a494-8c12-4805-87af-2b87c3aba521 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:59.873921 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-01d7a494-8c12-4805-87af-2b87c3aba521 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:34:59.878679 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=4,nova_cell1:UPDATE=6 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:34:59.886902 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-01d7a494-8c12-4805-87af-2b87c3aba521 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/35a0ac1a-379f-456e-a3d7-81f888daebbf" status: 200 len: 1276 microversion: 2.1 time: 0.236177 Oct 27 03:34:59.895517 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1539/3324] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:59 2022] GET /compute/v2.1/servers/35a0ac1a-379f-456e-a3d7-81f888daebbf => generated 1276 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:34:59.902824 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-50f99b8a-833a-48a0-bf90-3ff3efa8c0f0 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:34:59.910580 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-50f99b8a-833a-48a0-bf90-3ff3efa8c0f0 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] [instance: 2410110f-fee8-4669-be8c-5137af8f074f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:34:59.926240 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-50f99b8a-833a-48a0-bf90-3ff3efa8c0f0 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:59.927200 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-50f99b8a-833a-48a0-bf90-3ff3efa8c0f0 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:59.936003 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-50f99b8a-833a-48a0-bf90-3ff3efa8c0f0 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:34:59.936003 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-50f99b8a-833a-48a0-bf90-3ff3efa8c0f0 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:34:59.936003 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-50f99b8a-833a-48a0-bf90-3ff3efa8c0f0 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:34:59.936003 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-50f99b8a-833a-48a0-bf90-3ff3efa8c0f0 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:00.200726 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-50f99b8a-833a-48a0-bf90-3ff3efa8c0f0 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881f054c84d04ceaa17a5817816022d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2057593072c14804ab70fe4bdea2c17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:00.221297 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-50f99b8a-833a-48a0-bf90-3ff3efa8c0f0 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] 10.222.0.20 "GET /compute/v2.1/servers/2410110f-fee8-4669-be8c-5137af8f074f" status: 200 len: 1271 microversion: 2.1 time: 0.324377 Oct 27 03:35:00.225916 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1540/3325] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:34:59 2022] GET /compute/v2.1/servers/2410110f-fee8-4669-be8c-5137af8f074f => generated 1271 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:00.526891 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6976e0e3-c572-4ea5-ac14-3c8619a95a6a tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:00.527853 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6976e0e3-c572-4ea5-ac14-3c8619a95a6a tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:00.559704 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6976e0e3-c572-4ea5-ac14-3c8619a95a6a tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:00.560322 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6976e0e3-c572-4ea5-ac14-3c8619a95a6a tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:00.568045 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6976e0e3-c572-4ea5-ac14-3c8619a95a6a tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:00.576380 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6976e0e3-c572-4ea5-ac14-3c8619a95a6a tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:00.580976 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6976e0e3-c572-4ea5-ac14-3c8619a95a6a tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:00.584362 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6976e0e3-c572-4ea5-ac14-3c8619a95a6a tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:01.052004 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-cb0b8f99-777e-492d-8004-1c1d1bed6d0f tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:01.072462 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-cb0b8f99-777e-492d-8004-1c1d1bed6d0f tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:01.094507 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-cb0b8f99-777e-492d-8004-1c1d1bed6d0f tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:01.094507 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-cb0b8f99-777e-492d-8004-1c1d1bed6d0f tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d" status: 200 len: 1707 microversion: 2.42 time: 2.502750 Oct 27 03:35:01.094507 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1786/3326] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:34:58 2022] GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d => generated 1707 bytes in 2504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:35:01.109553 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6b52b7b0-ebef-4c45-aa43-760fccd1b3e4 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7dd9e95550>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:01.198716 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6b52b7b0-ebef-4c45-aa43-760fccd1b3e4 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images/5c03b8cf-4b2d-476c-8831-4866eeff9434" status: 200 len: 1454 microversion: 2.1 time: 0.105457 Oct 27 03:35:01.199387 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1787/3327] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:35:01 2022] GET /compute/v2.1/images/5c03b8cf-4b2d-476c-8831-4866eeff9434 => generated 1454 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:01.210588 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6aa884d2-dc25-4dfd-8fe0-82fc9df01309 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:01.211743 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-6aa884d2-dc25-4dfd-8fe0-82fc9df01309 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 35a0ac1a-379f-456e-a3d7-81f888daebbf] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:01.230194 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6aa884d2-dc25-4dfd-8fe0-82fc9df01309 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:01.233161 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6aa884d2-dc25-4dfd-8fe0-82fc9df01309 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:01.233930 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6aa884d2-dc25-4dfd-8fe0-82fc9df01309 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:01.238545 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6aa884d2-dc25-4dfd-8fe0-82fc9df01309 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:01.239346 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6aa884d2-dc25-4dfd-8fe0-82fc9df01309 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:01.240051 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6aa884d2-dc25-4dfd-8fe0-82fc9df01309 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:01.582101 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6aa884d2-dc25-4dfd-8fe0-82fc9df01309 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:01.595522 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6aa884d2-dc25-4dfd-8fe0-82fc9df01309 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/35a0ac1a-379f-456e-a3d7-81f888daebbf" status: 200 len: 1274 microversion: 2.1 time: 0.393998 Oct 27 03:35:01.597369 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1788/3328] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:01 2022] GET /compute/v2.1/servers/35a0ac1a-379f-456e-a3d7-81f888daebbf => generated 1274 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:01.617870 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0f8b0701-c5dc-4824-b29d-23fa69b490f9 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:01.619172 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0f8b0701-c5dc-4824-b29d-23fa69b490f9 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] [instance: 2410110f-fee8-4669-be8c-5137af8f074f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:01.634764 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0f8b0701-c5dc-4824-b29d-23fa69b490f9 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:01.636199 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0f8b0701-c5dc-4824-b29d-23fa69b490f9 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:01.636663 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0f8b0701-c5dc-4824-b29d-23fa69b490f9 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:01.639998 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0f8b0701-c5dc-4824-b29d-23fa69b490f9 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:01.640909 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0f8b0701-c5dc-4824-b29d-23fa69b490f9 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:01.641356 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0f8b0701-c5dc-4824-b29d-23fa69b490f9 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:01.696834 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-6976e0e3-c572-4ea5-ac14-3c8619a95a6a tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:01.707940 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6976e0e3-c572-4ea5-ac14-3c8619a95a6a tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1656 microversion: 2.1 time: 1.189373 Oct 27 03:35:01.716384 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1541/3329] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:00 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1656 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:01.746180 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7ead6979-2b3c-4299-a8ce-72c6714b0d20 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:35:01.771180 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7ead6979-2b3c-4299-a8ce-72c6714b0d20 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:01.774359 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7ead6979-2b3c-4299-a8ce-72c6714b0d20 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:01.777183 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7ead6979-2b3c-4299-a8ce-72c6714b0d20 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:01.986891 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7ead6979-2b3c-4299-a8ce-72c6714b0d20 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Going to try to start instance {{(pid=121000) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 27 03:35:02.258843 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7ead6979-2b3c-4299-a8ce-72c6714b0d20 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "POST /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86/action" status: 202 len: 0 microversion: 2.1 time: 0.516802 Oct 27 03:35:02.259874 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1542/3330] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:35:01 2022] POST /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86/action => generated 0 bytes in 519 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:35:02.285307 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7386ac2c-057c-472f-a7f7-1aadc54529ee tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:02.290429 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7386ac2c-057c-472f-a7f7-1aadc54529ee tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] [instance: 8c8a2cbb-4acf-4a6b-b684-567617bb930d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:02.308069 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7386ac2c-057c-472f-a7f7-1aadc54529ee tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:02.315187 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7386ac2c-057c-472f-a7f7-1aadc54529ee tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:02.318656 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7386ac2c-057c-472f-a7f7-1aadc54529ee tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:02.319954 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7386ac2c-057c-472f-a7f7-1aadc54529ee tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:02.320639 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7386ac2c-057c-472f-a7f7-1aadc54529ee tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:02.321445 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7386ac2c-057c-472f-a7f7-1aadc54529ee tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:02.431419 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0f8b0701-c5dc-4824-b29d-23fa69b490f9 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881f054c84d04ceaa17a5817816022d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2057593072c14804ab70fe4bdea2c17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:02.445765 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0f8b0701-c5dc-4824-b29d-23fa69b490f9 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] 10.222.0.20 "GET /compute/v2.1/servers/2410110f-fee8-4669-be8c-5137af8f074f" status: 200 len: 1271 microversion: 2.1 time: 0.844815 Oct 27 03:35:02.448421 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1789/3331] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:01 2022] GET /compute/v2.1/servers/2410110f-fee8-4669-be8c-5137af8f074f => generated 1271 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:02.466714 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-241a4a67-1fb2-483d-8ee6-cb8adbe7ee9a tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7dd9f6c8b0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:02.547632 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-241a4a67-1fb2-483d-8ee6-cb8adbe7ee9a tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images/5c03b8cf-4b2d-476c-8831-4866eeff9434" status: 200 len: 1454 microversion: 2.1 time: 0.097882 Oct 27 03:35:02.548527 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1790/3332] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:35:02 2022] GET /compute/v2.1/images/5c03b8cf-4b2d-476c-8831-4866eeff9434 => generated 1454 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:02.564122 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-bd7bd7a2-7191-46fb-a7b4-04fdd1ef7d49 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:02.565253 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-bd7bd7a2-7191-46fb-a7b4-04fdd1ef7d49 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:02.582882 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bd7bd7a2-7191-46fb-a7b4-04fdd1ef7d49 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:02.587182 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bd7bd7a2-7191-46fb-a7b4-04fdd1ef7d49 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:02.590238 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bd7bd7a2-7191-46fb-a7b4-04fdd1ef7d49 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:02.590238 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bd7bd7a2-7191-46fb-a7b4-04fdd1ef7d49 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:02.590238 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bd7bd7a2-7191-46fb-a7b4-04fdd1ef7d49 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:02.592945 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bd7bd7a2-7191-46fb-a7b4-04fdd1ef7d49 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:03.035165 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-bd7bd7a2-7191-46fb-a7b4-04fdd1ef7d49 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:03.048698 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-bd7bd7a2-7191-46fb-a7b4-04fdd1ef7d49 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1665 microversion: 2.1 time: 0.495482 Oct 27 03:35:03.051805 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1791/3333] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:02 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1665 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:03.068749 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e0bb606d-3502-4c7a-83a6-034a34b14568 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:03.069881 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e0bb606d-3502-4c7a-83a6-034a34b14568 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 35a0ac1a-379f-456e-a3d7-81f888daebbf] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:03.082552 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e0bb606d-3502-4c7a-83a6-034a34b14568 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:03.083220 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e0bb606d-3502-4c7a-83a6-034a34b14568 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:03.085720 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e0bb606d-3502-4c7a-83a6-034a34b14568 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:03.088241 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e0bb606d-3502-4c7a-83a6-034a34b14568 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:03.093773 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e0bb606d-3502-4c7a-83a6-034a34b14568 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:03.097458 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e0bb606d-3502-4c7a-83a6-034a34b14568 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:03.336558 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e0bb606d-3502-4c7a-83a6-034a34b14568 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:03.341001 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=100 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:35:03.352989 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e0bb606d-3502-4c7a-83a6-034a34b14568 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/35a0ac1a-379f-456e-a3d7-81f888daebbf" status: 200 len: 1274 microversion: 2.1 time: 0.294707 Oct 27 03:35:03.369805 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1792/3334] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:03 2022] GET /compute/v2.1/servers/35a0ac1a-379f-456e-a3d7-81f888daebbf => generated 1274 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:03.474667 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b2acd1ed-5cb4-4134-8531-a1f68502e831 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:03.475737 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b2acd1ed-5cb4-4134-8531-a1f68502e831 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] [instance: 2410110f-fee8-4669-be8c-5137af8f074f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:03.487481 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b2acd1ed-5cb4-4134-8531-a1f68502e831 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:03.488247 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b2acd1ed-5cb4-4134-8531-a1f68502e831 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:03.488926 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b2acd1ed-5cb4-4134-8531-a1f68502e831 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:03.489825 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b2acd1ed-5cb4-4134-8531-a1f68502e831 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:03.490474 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b2acd1ed-5cb4-4134-8531-a1f68502e831 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:03.491724 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b2acd1ed-5cb4-4134-8531-a1f68502e831 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:04.244165 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7386ac2c-057c-472f-a7f7-1aadc54529ee tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:04.261755 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7386ac2c-057c-472f-a7f7-1aadc54529ee tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:04.270539 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7386ac2c-057c-472f-a7f7-1aadc54529ee tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:04.273217 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7386ac2c-057c-472f-a7f7-1aadc54529ee tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d" status: 200 len: 1754 microversion: 2.42 time: 1.997556 Oct 27 03:35:04.274924 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1543/3335] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:35:02 2022] GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d => generated 1754 bytes in 2011 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:35:04.281289 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-073e6c96-dbae-4fc5-ad9e-c63eeaee48ab tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7dda03cdc0>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:04.351821 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-073e6c96-dbae-4fc5-ad9e-c63eeaee48ab tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images/5c03b8cf-4b2d-476c-8831-4866eeff9434" status: 200 len: 1454 microversion: 2.1 time: 0.073637 Oct 27 03:35:04.356087 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1544/3336] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:35:04 2022] GET /compute/v2.1/images/5c03b8cf-4b2d-476c-8831-4866eeff9434 => generated 1454 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:04.366178 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b1aab1f7-d156-4f1d-b58e-b37e468c10d8 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:04.369131 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b1aab1f7-d156-4f1d-b58e-b37e468c10d8 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:04.379625 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b1aab1f7-d156-4f1d-b58e-b37e468c10d8 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:04.380526 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b1aab1f7-d156-4f1d-b58e-b37e468c10d8 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:04.381180 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b1aab1f7-d156-4f1d-b58e-b37e468c10d8 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:04.382435 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b1aab1f7-d156-4f1d-b58e-b37e468c10d8 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:04.383372 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b1aab1f7-d156-4f1d-b58e-b37e468c10d8 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:04.384012 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b1aab1f7-d156-4f1d-b58e-b37e468c10d8 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:04.591993 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=4 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:35:04.649419 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b2acd1ed-5cb4-4134-8531-a1f68502e831 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881f054c84d04ceaa17a5817816022d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2057593072c14804ab70fe4bdea2c17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:04.664071 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b2acd1ed-5cb4-4134-8531-a1f68502e831 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] 10.222.0.20 "GET /compute/v2.1/servers/2410110f-fee8-4669-be8c-5137af8f074f" status: 200 len: 1313 microversion: 2.1 time: 1.194134 Oct 27 03:35:04.664821 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1793/3337] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:03 2022] GET /compute/v2.1/servers/2410110f-fee8-4669-be8c-5137af8f074f => generated 1313 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:04.692934 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9cd7dc1c-5c40-410d-a1ec-178b4bc06bc4 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:04.693591 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-9cd7dc1c-5c40-410d-a1ec-178b4bc06bc4 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 35a0ac1a-379f-456e-a3d7-81f888daebbf] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:04.711807 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9cd7dc1c-5c40-410d-a1ec-178b4bc06bc4 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:04.712602 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9cd7dc1c-5c40-410d-a1ec-178b4bc06bc4 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:04.712779 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9cd7dc1c-5c40-410d-a1ec-178b4bc06bc4 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:04.715148 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9cd7dc1c-5c40-410d-a1ec-178b4bc06bc4 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:04.717780 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9cd7dc1c-5c40-410d-a1ec-178b4bc06bc4 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:04.719268 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9cd7dc1c-5c40-410d-a1ec-178b4bc06bc4 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:05.420549 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b1aab1f7-d156-4f1d-b58e-b37e468c10d8 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:05.433278 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b1aab1f7-d156-4f1d-b58e-b37e468c10d8 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1665 microversion: 2.1 time: 1.075863 Oct 27 03:35:05.436393 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1545/3338] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:04 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1665 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:05.455309 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-004d807e-f531-4aed-8f71-dbb25687cb64 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:05.456263 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-004d807e-f531-4aed-8f71-dbb25687cb64 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] [instance: 8c8a2cbb-4acf-4a6b-b684-567617bb930d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:05.465776 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-004d807e-f531-4aed-8f71-dbb25687cb64 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:05.466547 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-004d807e-f531-4aed-8f71-dbb25687cb64 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:05.468236 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-004d807e-f531-4aed-8f71-dbb25687cb64 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:05.469766 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-004d807e-f531-4aed-8f71-dbb25687cb64 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:05.473222 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-004d807e-f531-4aed-8f71-dbb25687cb64 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:05.474083 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-004d807e-f531-4aed-8f71-dbb25687cb64 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:05.601023 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:35:05.822445 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9cd7dc1c-5c40-410d-a1ec-178b4bc06bc4 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:05.831045 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9cd7dc1c-5c40-410d-a1ec-178b4bc06bc4 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/35a0ac1a-379f-456e-a3d7-81f888daebbf" status: 200 len: 1316 microversion: 2.1 time: 1.165023 Oct 27 03:35:05.831637 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1794/3339] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:04 2022] GET /compute/v2.1/servers/35a0ac1a-379f-456e-a3d7-81f888daebbf => generated 1316 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:05.842801 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5faad228-f299-4f6c-8d4f-3aa0a9798020 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7dd9f8b160>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:05.961513 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5faad228-f299-4f6c-8d4f-3aa0a9798020 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images/5c03b8cf-4b2d-476c-8831-4866eeff9434" status: 200 len: 1454 microversion: 2.1 time: 0.122399 Oct 27 03:35:05.962021 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1795/3340] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:35:05 2022] GET /compute/v2.1/images/5c03b8cf-4b2d-476c-8831-4866eeff9434 => generated 1454 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:05.974815 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5ec9697e-d544-48bb-93a1-d7d8d660dfd8 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:05.985034 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5ec9697e-d544-48bb-93a1-d7d8d660dfd8 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] [instance: 2410110f-fee8-4669-be8c-5137af8f074f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:06.009507 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5ec9697e-d544-48bb-93a1-d7d8d660dfd8 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:06.017628 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5ec9697e-d544-48bb-93a1-d7d8d660dfd8 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:06.022241 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5ec9697e-d544-48bb-93a1-d7d8d660dfd8 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:06.022241 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5ec9697e-d544-48bb-93a1-d7d8d660dfd8 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:06.022241 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5ec9697e-d544-48bb-93a1-d7d8d660dfd8 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:06.029511 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5ec9697e-d544-48bb-93a1-d7d8d660dfd8 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:06.226962 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=24 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:35:06.274090 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-004d807e-f531-4aed-8f71-dbb25687cb64 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:06.301037 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-004d807e-f531-4aed-8f71-dbb25687cb64 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:06.305409 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-004d807e-f531-4aed-8f71-dbb25687cb64 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:06.311546 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-004d807e-f531-4aed-8f71-dbb25687cb64 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d" status: 200 len: 1801 microversion: 2.42 time: 0.871914 Oct 27 03:35:06.312420 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1546/3341] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:35:05 2022] GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d => generated 1801 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:35:06.464097 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9240e9c5-df14-4503-95b4-c0ea0d780f62 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:06.485875 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9240e9c5-df14-4503-95b4-c0ea0d780f62 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:06.485875 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9240e9c5-df14-4503-95b4-c0ea0d780f62 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:06.485875 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9240e9c5-df14-4503-95b4-c0ea0d780f62 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:06.485875 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9240e9c5-df14-4503-95b4-c0ea0d780f62 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:06.485875 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9240e9c5-df14-4503-95b4-c0ea0d780f62 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:06.485875 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9240e9c5-df14-4503-95b4-c0ea0d780f62 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:06.485875 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9240e9c5-df14-4503-95b4-c0ea0d780f62 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:06.819979 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5ec9697e-d544-48bb-93a1-d7d8d660dfd8 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881f054c84d04ceaa17a5817816022d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2057593072c14804ab70fe4bdea2c17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:06.841325 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5ec9697e-d544-48bb-93a1-d7d8d660dfd8 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] 10.222.0.20 "GET /compute/v2.1/servers/2410110f-fee8-4669-be8c-5137af8f074f" status: 200 len: 1313 microversion: 2.1 time: 0.868273 Oct 27 03:35:06.842429 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1796/3342] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:05 2022] GET /compute/v2.1/servers/2410110f-fee8-4669-be8c-5137af8f074f => generated 1313 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:06.854642 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2acabc05-d5c6-48c2-8c2e-4c2fe040cbfd tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:06.867466 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2acabc05-d5c6-48c2-8c2e-4c2fe040cbfd tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 35a0ac1a-379f-456e-a3d7-81f888daebbf] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:06.884909 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2acabc05-d5c6-48c2-8c2e-4c2fe040cbfd tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:06.886919 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2acabc05-d5c6-48c2-8c2e-4c2fe040cbfd tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:06.887555 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2acabc05-d5c6-48c2-8c2e-4c2fe040cbfd tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:06.889966 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2acabc05-d5c6-48c2-8c2e-4c2fe040cbfd tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:06.892406 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2acabc05-d5c6-48c2-8c2e-4c2fe040cbfd tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:06.895046 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2acabc05-d5c6-48c2-8c2e-4c2fe040cbfd tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:07.286883 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9240e9c5-df14-4503-95b4-c0ea0d780f62 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:07.300254 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9240e9c5-df14-4503-95b4-c0ea0d780f62 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1665 microversion: 2.1 time: 0.839154 Oct 27 03:35:07.303799 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1547/3343] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:06 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1665 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:07.314755 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d8d3f6dc-efd2-42ea-88b0-5be7a7db34ac tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7dda03c0d0>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:07.408455 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d8d3f6dc-efd2-42ea-88b0-5be7a7db34ac tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images/5c03b8cf-4b2d-476c-8831-4866eeff9434" status: 200 len: 1454 microversion: 2.1 time: 0.102988 Oct 27 03:35:07.410347 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1548/3344] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:35:07 2022] GET /compute/v2.1/images/5c03b8cf-4b2d-476c-8831-4866eeff9434 => generated 1454 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:07.422442 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7f600b7f-bec0-4e07-931f-02c0d9c3151f tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:07.422442 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7f600b7f-bec0-4e07-931f-02c0d9c3151f tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] [instance: 8c8a2cbb-4acf-4a6b-b684-567617bb930d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:07.436105 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7f600b7f-bec0-4e07-931f-02c0d9c3151f tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:07.436648 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7f600b7f-bec0-4e07-931f-02c0d9c3151f tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:07.437106 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7f600b7f-bec0-4e07-931f-02c0d9c3151f tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:07.437811 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7f600b7f-bec0-4e07-931f-02c0d9c3151f tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:07.438295 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7f600b7f-bec0-4e07-931f-02c0d9c3151f tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:07.443965 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7f600b7f-bec0-4e07-931f-02c0d9c3151f tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:07.909699 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=10 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:35:08.524933 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2acabc05-d5c6-48c2-8c2e-4c2fe040cbfd tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:08.534703 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2acabc05-d5c6-48c2-8c2e-4c2fe040cbfd tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/35a0ac1a-379f-456e-a3d7-81f888daebbf" status: 200 len: 1316 microversion: 2.1 time: 1.683645 Oct 27 03:35:08.555348 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1797/3345] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:06 2022] GET /compute/v2.1/servers/35a0ac1a-379f-456e-a3d7-81f888daebbf => generated 1316 bytes in 1705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:08.563590 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-06d24890-411f-4710-aef0-61e6039a9973 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:08.564512 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-06d24890-411f-4710-aef0-61e6039a9973 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] [instance: 2410110f-fee8-4669-be8c-5137af8f074f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:08.573741 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-06d24890-411f-4710-aef0-61e6039a9973 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:08.575028 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-06d24890-411f-4710-aef0-61e6039a9973 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:08.575679 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-06d24890-411f-4710-aef0-61e6039a9973 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:08.577071 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-06d24890-411f-4710-aef0-61e6039a9973 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:08.578891 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-06d24890-411f-4710-aef0-61e6039a9973 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:08.579499 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-06d24890-411f-4710-aef0-61e6039a9973 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:08.664803 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7f600b7f-bec0-4e07-931f-02c0d9c3151f tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:08.675072 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7f600b7f-bec0-4e07-931f-02c0d9c3151f tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:08.676528 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7f600b7f-bec0-4e07-931f-02c0d9c3151f tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:08.677730 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7f600b7f-bec0-4e07-931f-02c0d9c3151f tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d" status: 200 len: 1801 microversion: 2.42 time: 1.266426 Oct 27 03:35:08.696495 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1549/3346] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:35:07 2022] GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d => generated 1801 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:35:08.713489 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8a7dbb24-7f0c-4b97-bfcf-a486f39e808b tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:08.721238 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8a7dbb24-7f0c-4b97-bfcf-a486f39e808b tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:08.743411 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8a7dbb24-7f0c-4b97-bfcf-a486f39e808b tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:08.743921 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8a7dbb24-7f0c-4b97-bfcf-a486f39e808b tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:08.744373 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8a7dbb24-7f0c-4b97-bfcf-a486f39e808b tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:08.745104 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8a7dbb24-7f0c-4b97-bfcf-a486f39e808b tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:08.745568 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8a7dbb24-7f0c-4b97-bfcf-a486f39e808b tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:08.745997 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8a7dbb24-7f0c-4b97-bfcf-a486f39e808b tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:09.446887 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8a7dbb24-7f0c-4b97-bfcf-a486f39e808b tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:09.454776 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8a7dbb24-7f0c-4b97-bfcf-a486f39e808b tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1669 microversion: 2.1 time: 0.757085 Oct 27 03:35:09.455374 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1550/3347] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:08 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1669 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:09.832585 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0e9f1f2d-c1f4-4ef1-8a22-9f25e62d71fb tempest-AZV2TestJSON-1201168941 tempest-AZV2TestJSON-1201168941-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:09.844699 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0e9f1f2d-c1f4-4ef1-8a22-9f25e62d71fb tempest-AZV2TestJSON-1201168941 tempest-AZV2TestJSON-1201168941-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:09.845328 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0e9f1f2d-c1f4-4ef1-8a22-9f25e62d71fb tempest-AZV2TestJSON-1201168941 tempest-AZV2TestJSON-1201168941-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:09.845792 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0e9f1f2d-c1f4-4ef1-8a22-9f25e62d71fb tempest-AZV2TestJSON-1201168941 tempest-AZV2TestJSON-1201168941-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:09.846694 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0e9f1f2d-c1f4-4ef1-8a22-9f25e62d71fb tempest-AZV2TestJSON-1201168941 tempest-AZV2TestJSON-1201168941-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:09.850814 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0e9f1f2d-c1f4-4ef1-8a22-9f25e62d71fb tempest-AZV2TestJSON-1201168941 tempest-AZV2TestJSON-1201168941-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:09.851375 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0e9f1f2d-c1f4-4ef1-8a22-9f25e62d71fb tempest-AZV2TestJSON-1201168941 tempest-AZV2TestJSON-1201168941-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:09.938404 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0e9f1f2d-c1f4-4ef1-8a22-9f25e62d71fb tempest-AZV2TestJSON-1201168941 tempest-AZV2TestJSON-1201168941-project] 10.222.0.20 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.481760 Oct 27 03:35:09.948974 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1551/3348] 10.222.0.20 () {58 vars in 1164 bytes} [Thu Oct 27 03:35:09 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 03:35:09.971489 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ddf6b321-f26a-48dd-b68b-2b667eca6d98 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7ddb178dc0>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:10.109305 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ddf6b321-f26a-48dd-b68b-2b667eca6d98 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images/5c03b8cf-4b2d-476c-8831-4866eeff9434" status: 200 len: 1454 microversion: 2.1 time: 0.158416 Oct 27 03:35:10.111987 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1552/3349] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:35:09 2022] GET /compute/v2.1/images/5c03b8cf-4b2d-476c-8831-4866eeff9434 => generated 1454 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:10.122349 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1c1a3a14-e8b6-4698-b74d-f81d475fff5e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:10.130708 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1c1a3a14-e8b6-4698-b74d-f81d475fff5e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:10.157206 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1c1a3a14-e8b6-4698-b74d-f81d475fff5e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:10.158581 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1c1a3a14-e8b6-4698-b74d-f81d475fff5e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:10.159492 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1c1a3a14-e8b6-4698-b74d-f81d475fff5e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:10.162558 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1c1a3a14-e8b6-4698-b74d-f81d475fff5e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:10.163230 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1c1a3a14-e8b6-4698-b74d-f81d475fff5e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:10.164208 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1c1a3a14-e8b6-4698-b74d-f81d475fff5e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:10.808126 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-06d24890-411f-4710-aef0-61e6039a9973 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881f054c84d04ceaa17a5817816022d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2057593072c14804ab70fe4bdea2c17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:10.821730 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-06d24890-411f-4710-aef0-61e6039a9973 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] 10.222.0.20 "GET /compute/v2.1/servers/2410110f-fee8-4669-be8c-5137af8f074f" status: 200 len: 1334 microversion: 2.1 time: 2.264943 Oct 27 03:35:10.822424 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1798/3350] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:08 2022] GET /compute/v2.1/servers/2410110f-fee8-4669-be8c-5137af8f074f => generated 1334 bytes in 2266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:10.839905 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-82ad2fdc-0a58-4bac-ad2d-54de2d5f928e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:10.840749 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-82ad2fdc-0a58-4bac-ad2d-54de2d5f928e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 35a0ac1a-379f-456e-a3d7-81f888daebbf] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:10.860817 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-82ad2fdc-0a58-4bac-ad2d-54de2d5f928e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:10.861691 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-82ad2fdc-0a58-4bac-ad2d-54de2d5f928e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:10.862382 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-82ad2fdc-0a58-4bac-ad2d-54de2d5f928e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:10.869293 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-82ad2fdc-0a58-4bac-ad2d-54de2d5f928e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:10.870318 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-82ad2fdc-0a58-4bac-ad2d-54de2d5f928e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:10.872909 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-82ad2fdc-0a58-4bac-ad2d-54de2d5f928e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:11.308758 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1c1a3a14-e8b6-4698-b74d-f81d475fff5e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:11.328557 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1c1a3a14-e8b6-4698-b74d-f81d475fff5e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1669 microversion: 2.1 time: 1.209741 Oct 27 03:35:11.328557 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1553/3351] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:10 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1669 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:11.333447 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0d746f39-72b2-4e2b-bfaa-7e1c45b7a9ab tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:11.334103 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0d746f39-72b2-4e2b-bfaa-7e1c45b7a9ab tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] [instance: 8c8a2cbb-4acf-4a6b-b684-567617bb930d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:11.349750 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0d746f39-72b2-4e2b-bfaa-7e1c45b7a9ab tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:11.353943 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0d746f39-72b2-4e2b-bfaa-7e1c45b7a9ab tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:11.354447 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0d746f39-72b2-4e2b-bfaa-7e1c45b7a9ab tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:11.355291 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0d746f39-72b2-4e2b-bfaa-7e1c45b7a9ab tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:11.355765 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0d746f39-72b2-4e2b-bfaa-7e1c45b7a9ab tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:11.356281 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0d746f39-72b2-4e2b-bfaa-7e1c45b7a9ab tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:11.553194 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-82ad2fdc-0a58-4bac-ad2d-54de2d5f928e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:11.570784 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-82ad2fdc-0a58-4bac-ad2d-54de2d5f928e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/35a0ac1a-379f-456e-a3d7-81f888daebbf" status: 200 len: 1316 microversion: 2.1 time: 0.737270 Oct 27 03:35:11.571444 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1799/3352] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:10 2022] GET /compute/v2.1/servers/35a0ac1a-379f-456e-a3d7-81f888daebbf => generated 1316 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:11.578412 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-1e9c7949-318c-474b-bf25-bac395d0b953 req-605aba4c-69c0-4e12-bbf0-ef6c820437c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35a0ac1a-379f-456e-a3d7-81f888daebbf", "tag": "9e03ed18-4c77-4669-8c1e-f8e715e9ff37"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:35:11.616128 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-1e9c7949-318c-474b-bf25-bac395d0b953 req-605aba4c-69c0-4e12-bbf0-ef6c820437c6 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:11.618498 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-1e9c7949-318c-474b-bf25-bac395d0b953 req-605aba4c-69c0-4e12-bbf0-ef6c820437c6 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:11.619130 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-1e9c7949-318c-474b-bf25-bac395d0b953 req-605aba4c-69c0-4e12-bbf0-ef6c820437c6 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:11.668268 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-1e9c7949-318c-474b-bf25-bac395d0b953 req-605aba4c-69c0-4e12-bbf0-ef6c820437c6 service nova] Creating event network-changed:9e03ed18-4c77-4669-8c1e-f8e715e9ff37 for instance 35a0ac1a-379f-456e-a3d7-81f888daebbf on n-h2-862769-1 Oct 27 03:35:11.687950 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-1e9c7949-318c-474b-bf25-bac395d0b953 req-605aba4c-69c0-4e12-bbf0-ef6c820437c6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111275 Oct 27 03:35:11.688811 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1800/3353] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:35:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:35:11.706457 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f1c63acd-3b91-4d49-a91c-57c4cd9a01d3 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7dd9f8bf70>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:11.800969 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f1c63acd-3b91-4d49-a91c-57c4cd9a01d3 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images/5c03b8cf-4b2d-476c-8831-4866eeff9434" status: 200 len: 1454 microversion: 2.1 time: 0.109689 Oct 27 03:35:11.801809 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1801/3354] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:35:11 2022] GET /compute/v2.1/images/5c03b8cf-4b2d-476c-8831-4866eeff9434 => generated 1454 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:11.813053 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-568e040c-9b81-4666-adb7-39d9e57b9b0f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:35:11.814621 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-568e040c-9b81-4666-adb7-39d9e57b9b0f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:11.830928 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-568e040c-9b81-4666-adb7-39d9e57b9b0f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:11.835937 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-568e040c-9b81-4666-adb7-39d9e57b9b0f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:11.836595 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-568e040c-9b81-4666-adb7-39d9e57b9b0f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:11.843412 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-568e040c-9b81-4666-adb7-39d9e57b9b0f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:11.843412 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-568e040c-9b81-4666-adb7-39d9e57b9b0f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:11.843412 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-568e040c-9b81-4666-adb7-39d9e57b9b0f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:12.036635 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-568e040c-9b81-4666-adb7-39d9e57b9b0f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Unlocking {{(pid=121001) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 27 03:35:12.048690 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0d746f39-72b2-4e2b-bfaa-7e1c45b7a9ab tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:12.073420 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0d746f39-72b2-4e2b-bfaa-7e1c45b7a9ab tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:12.080099 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0d746f39-72b2-4e2b-bfaa-7e1c45b7a9ab tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:12.083969 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0d746f39-72b2-4e2b-bfaa-7e1c45b7a9ab tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d" status: 200 len: 1848 microversion: 2.42 time: 0.757407 Oct 27 03:35:12.104184 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1554/3355] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:35:11 2022] GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d => generated 1848 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:35:12.137810 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-06c9b964-70a3-4bb7-8369-b247df26c4fd tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:12.145686 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-06c9b964-70a3-4bb7-8369-b247df26c4fd tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] [instance: 2410110f-fee8-4669-be8c-5137af8f074f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:12.161520 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-06c9b964-70a3-4bb7-8369-b247df26c4fd tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:12.162089 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-06c9b964-70a3-4bb7-8369-b247df26c4fd tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:12.162548 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-06c9b964-70a3-4bb7-8369-b247df26c4fd tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:12.167331 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-06c9b964-70a3-4bb7-8369-b247df26c4fd tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:12.167331 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-06c9b964-70a3-4bb7-8369-b247df26c4fd tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:12.167331 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-06c9b964-70a3-4bb7-8369-b247df26c4fd tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:12.317499 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-568e040c-9b81-4666-adb7-39d9e57b9b0f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "POST /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86/action" status: 202 len: 0 microversion: 2.1 time: 0.513748 Oct 27 03:35:12.323349 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1802/3356] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:35:11 2022] POST /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86/action => generated 0 bytes in 515 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:35:12.332993 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7d2eda90-32c8-4ebe-a931-01a29936affe tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:12.332993 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7d2eda90-32c8-4ebe-a931-01a29936affe tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:12.353154 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7d2eda90-32c8-4ebe-a931-01a29936affe tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:12.362755 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7d2eda90-32c8-4ebe-a931-01a29936affe tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:12.363521 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7d2eda90-32c8-4ebe-a931-01a29936affe tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:12.364777 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7d2eda90-32c8-4ebe-a931-01a29936affe tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:12.366278 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7d2eda90-32c8-4ebe-a931-01a29936affe tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:12.366904 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7d2eda90-32c8-4ebe-a931-01a29936affe tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:13.300133 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-06c9b964-70a3-4bb7-8369-b247df26c4fd tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881f054c84d04ceaa17a5817816022d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2057593072c14804ab70fe4bdea2c17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:13.342843 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-06c9b964-70a3-4bb7-8369-b247df26c4fd tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] 10.222.0.20 "GET /compute/v2.1/servers/2410110f-fee8-4669-be8c-5137af8f074f" status: 200 len: 1334 microversion: 2.1 time: 1.236007 Oct 27 03:35:13.375832 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1555/3357] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:12 2022] GET /compute/v2.1/servers/2410110f-fee8-4669-be8c-5137af8f074f => generated 1334 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:13.385158 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-ab7083d7-d1c5-4bee-bb9a-d5d448c31595 req-591ad48f-396f-4ff6-bb81-4f42322ee030 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2410110f-fee8-4669-be8c-5137af8f074f", "tag": "80bf1ae1-da89-411d-b5d2-492e7e79f4c6"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:35:13.407950 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-ab7083d7-d1c5-4bee-bb9a-d5d448c31595 req-591ad48f-396f-4ff6-bb81-4f42322ee030 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:13.408793 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-ab7083d7-d1c5-4bee-bb9a-d5d448c31595 req-591ad48f-396f-4ff6-bb81-4f42322ee030 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:13.409466 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-ab7083d7-d1c5-4bee-bb9a-d5d448c31595 req-591ad48f-396f-4ff6-bb81-4f42322ee030 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:13.444016 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-ab7083d7-d1c5-4bee-bb9a-d5d448c31595 req-591ad48f-396f-4ff6-bb81-4f42322ee030 service nova] Creating event network-changed:80bf1ae1-da89-411d-b5d2-492e7e79f4c6 for instance 2410110f-fee8-4669-be8c-5137af8f074f on n-h2-862769-1 Oct 27 03:35:13.452715 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-ab7083d7-d1c5-4bee-bb9a-d5d448c31595 req-591ad48f-396f-4ff6-bb81-4f42322ee030 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074396 Oct 27 03:35:13.453956 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1556/3358] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:35:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:35:13.484785 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-43a90303-9ffd-48b2-aa36-4b81153ec2b9 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:13.486508 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-43a90303-9ffd-48b2-aa36-4b81153ec2b9 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 35a0ac1a-379f-456e-a3d7-81f888daebbf] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:13.495814 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-43a90303-9ffd-48b2-aa36-4b81153ec2b9 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:13.496538 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-43a90303-9ffd-48b2-aa36-4b81153ec2b9 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:13.497222 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-43a90303-9ffd-48b2-aa36-4b81153ec2b9 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:13.498790 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-43a90303-9ffd-48b2-aa36-4b81153ec2b9 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:13.500025 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-43a90303-9ffd-48b2-aa36-4b81153ec2b9 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:13.500632 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-43a90303-9ffd-48b2-aa36-4b81153ec2b9 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:13.774535 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7d2eda90-32c8-4ebe-a931-01a29936affe tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:13.791245 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7d2eda90-32c8-4ebe-a931-01a29936affe tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1669 microversion: 2.1 time: 1.464486 Oct 27 03:35:13.794311 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1803/3359] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:12 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1669 bytes in 1470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:13.809138 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-03dcf5c3-366d-475a-aec2-bb95b3a7c7ac tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7dda54ec10>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:13.918198 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-03dcf5c3-366d-475a-aec2-bb95b3a7c7ac tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images/5c03b8cf-4b2d-476c-8831-4866eeff9434" status: 200 len: 1454 microversion: 2.1 time: 0.120917 Oct 27 03:35:13.919412 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1804/3360] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:35:13 2022] GET /compute/v2.1/images/5c03b8cf-4b2d-476c-8831-4866eeff9434 => generated 1454 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:13.933825 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6ddec8a4-c213-4d1f-8789-10d9fdd3dad5 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:13.936094 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-6ddec8a4-c213-4d1f-8789-10d9fdd3dad5 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] [instance: 8c8a2cbb-4acf-4a6b-b684-567617bb930d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:13.950148 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6ddec8a4-c213-4d1f-8789-10d9fdd3dad5 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:13.951715 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6ddec8a4-c213-4d1f-8789-10d9fdd3dad5 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:13.952424 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6ddec8a4-c213-4d1f-8789-10d9fdd3dad5 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:13.953476 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6ddec8a4-c213-4d1f-8789-10d9fdd3dad5 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:13.954310 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6ddec8a4-c213-4d1f-8789-10d9fdd3dad5 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:13.954925 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6ddec8a4-c213-4d1f-8789-10d9fdd3dad5 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:15.283917 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-43a90303-9ffd-48b2-aa36-4b81153ec2b9 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:15.295211 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-43a90303-9ffd-48b2-aa36-4b81153ec2b9 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/35a0ac1a-379f-456e-a3d7-81f888daebbf" status: 200 len: 1316 microversion: 2.1 time: 1.838958 Oct 27 03:35:15.297789 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1557/3361] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:13 2022] GET /compute/v2.1/servers/35a0ac1a-379f-456e-a3d7-81f888daebbf => generated 1316 bytes in 1843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:15.315450 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-cebdba36-bc08-4009-8fc8-b3dff94fae2c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:15.316330 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-cebdba36-bc08-4009-8fc8-b3dff94fae2c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:15.325513 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cebdba36-bc08-4009-8fc8-b3dff94fae2c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:15.337199 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cebdba36-bc08-4009-8fc8-b3dff94fae2c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:15.338263 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cebdba36-bc08-4009-8fc8-b3dff94fae2c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:15.339455 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cebdba36-bc08-4009-8fc8-b3dff94fae2c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:15.340158 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cebdba36-bc08-4009-8fc8-b3dff94fae2c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:15.340841 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cebdba36-bc08-4009-8fc8-b3dff94fae2c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:15.764722 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6ddec8a4-c213-4d1f-8789-10d9fdd3dad5 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:15.775332 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6ddec8a4-c213-4d1f-8789-10d9fdd3dad5 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:15.776768 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6ddec8a4-c213-4d1f-8789-10d9fdd3dad5 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:15.777939 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6ddec8a4-c213-4d1f-8789-10d9fdd3dad5 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d" status: 200 len: 1848 microversion: 2.42 time: 1.857440 Oct 27 03:35:15.818934 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1805/3362] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:35:13 2022] GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d => generated 1848 bytes in 1899 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:35:15.863183 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a191eb3a-73d8-44d9-961a-eba770ecc612 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:15.869200 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a191eb3a-73d8-44d9-961a-eba770ecc612 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] [instance: 2410110f-fee8-4669-be8c-5137af8f074f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:15.897511 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a191eb3a-73d8-44d9-961a-eba770ecc612 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:15.898753 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a191eb3a-73d8-44d9-961a-eba770ecc612 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:15.900602 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a191eb3a-73d8-44d9-961a-eba770ecc612 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:15.901868 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a191eb3a-73d8-44d9-961a-eba770ecc612 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:15.908123 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a191eb3a-73d8-44d9-961a-eba770ecc612 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:15.908648 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a191eb3a-73d8-44d9-961a-eba770ecc612 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:16.483628 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-cebdba36-bc08-4009-8fc8-b3dff94fae2c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:16.483628 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-cebdba36-bc08-4009-8fc8-b3dff94fae2c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1669 microversion: 2.1 time: 1.018112 Oct 27 03:35:16.483628 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1558/3363] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:15 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1669 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:16.483628 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6a36bbfb-8e05-477d-9d55-8dc785ad0246 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7dda97e940>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:16.483628 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6a36bbfb-8e05-477d-9d55-8dc785ad0246 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images/5c03b8cf-4b2d-476c-8831-4866eeff9434" status: 200 len: 1454 microversion: 2.1 time: 0.132539 Oct 27 03:35:16.489298 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1559/3364] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:35:16 2022] GET /compute/v2.1/images/5c03b8cf-4b2d-476c-8831-4866eeff9434 => generated 1454 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:16.519581 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f972b2cf-47fe-4d39-91f7-4aa818702248 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:16.520239 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f972b2cf-47fe-4d39-91f7-4aa818702248 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 35a0ac1a-379f-456e-a3d7-81f888daebbf] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:16.555632 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f972b2cf-47fe-4d39-91f7-4aa818702248 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:16.556157 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f972b2cf-47fe-4d39-91f7-4aa818702248 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:16.556743 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f972b2cf-47fe-4d39-91f7-4aa818702248 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:16.563936 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f972b2cf-47fe-4d39-91f7-4aa818702248 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:16.566824 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f972b2cf-47fe-4d39-91f7-4aa818702248 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:16.571875 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f972b2cf-47fe-4d39-91f7-4aa818702248 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:16.793477 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a191eb3a-73d8-44d9-961a-eba770ecc612 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881f054c84d04ceaa17a5817816022d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2057593072c14804ab70fe4bdea2c17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:16.805317 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a191eb3a-73d8-44d9-961a-eba770ecc612 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] 10.222.0.20 "GET /compute/v2.1/servers/2410110f-fee8-4669-be8c-5137af8f074f" status: 200 len: 1334 microversion: 2.1 time: 0.960803 Oct 27 03:35:16.809841 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1806/3365] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:15 2022] GET /compute/v2.1/servers/2410110f-fee8-4669-be8c-5137af8f074f => generated 1334 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:16.826788 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-61d015e3-6c33-4c69-9add-4c27547954e7 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:16.835098 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-61d015e3-6c33-4c69-9add-4c27547954e7 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:16.855314 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-61d015e3-6c33-4c69-9add-4c27547954e7 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:16.867562 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-61d015e3-6c33-4c69-9add-4c27547954e7 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:16.873771 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-61d015e3-6c33-4c69-9add-4c27547954e7 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:16.873771 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-61d015e3-6c33-4c69-9add-4c27547954e7 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:16.873771 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-61d015e3-6c33-4c69-9add-4c27547954e7 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:16.873771 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-61d015e3-6c33-4c69-9add-4c27547954e7 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:17.474941 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f972b2cf-47fe-4d39-91f7-4aa818702248 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:17.477645 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:35:17.491894 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f972b2cf-47fe-4d39-91f7-4aa818702248 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/35a0ac1a-379f-456e-a3d7-81f888daebbf" status: 200 len: 1316 microversion: 2.1 time: 1.001404 Oct 27 03:35:17.493627 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1560/3366] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:16 2022] GET /compute/v2.1/servers/35a0ac1a-379f-456e-a3d7-81f888daebbf => generated 1316 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:17.513616 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-2802bfad-30de-46af-a01e-e94548991a8f req-8627e649-08f7-400f-9ae1-776b684ea119 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2410110f-fee8-4669-be8c-5137af8f074f", "tag": "988e6fdf-022d-4ca6-a640-5e81822be074"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:35:17.534286 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-2802bfad-30de-46af-a01e-e94548991a8f req-8627e649-08f7-400f-9ae1-776b684ea119 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:17.536481 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-2802bfad-30de-46af-a01e-e94548991a8f req-8627e649-08f7-400f-9ae1-776b684ea119 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:17.537180 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-2802bfad-30de-46af-a01e-e94548991a8f req-8627e649-08f7-400f-9ae1-776b684ea119 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:17.566216 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-2802bfad-30de-46af-a01e-e94548991a8f req-8627e649-08f7-400f-9ae1-776b684ea119 service nova] Creating event network-changed:988e6fdf-022d-4ca6-a640-5e81822be074 for instance 2410110f-fee8-4669-be8c-5137af8f074f on n-h2-862769-1 Oct 27 03:35:17.579839 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-2802bfad-30de-46af-a01e-e94548991a8f req-8627e649-08f7-400f-9ae1-776b684ea119 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084743 Oct 27 03:35:17.581218 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1561/3367] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:35:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:35:17.593027 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6419f567-9b5e-41f4-b05a-b129d8eadcf1 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:17.601548 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6419f567-9b5e-41f4-b05a-b129d8eadcf1 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] [instance: 8c8a2cbb-4acf-4a6b-b684-567617bb930d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:17.607917 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6419f567-9b5e-41f4-b05a-b129d8eadcf1 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:17.610686 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6419f567-9b5e-41f4-b05a-b129d8eadcf1 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:17.611451 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6419f567-9b5e-41f4-b05a-b129d8eadcf1 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:17.613580 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6419f567-9b5e-41f4-b05a-b129d8eadcf1 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:17.615223 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6419f567-9b5e-41f4-b05a-b129d8eadcf1 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:17.615863 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6419f567-9b5e-41f4-b05a-b129d8eadcf1 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:18.070112 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-61d015e3-6c33-4c69-9add-4c27547954e7 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:18.086446 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-61d015e3-6c33-4c69-9add-4c27547954e7 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1669 microversion: 2.1 time: 1.273603 Oct 27 03:35:18.091279 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1807/3368] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:16 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1669 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:18.112135 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ae35fbc4-0f1f-4ef3-9e83-f24c5bb4aecf tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7dd9e95280>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:18.196293 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ae35fbc4-0f1f-4ef3-9e83-f24c5bb4aecf tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images/5c03b8cf-4b2d-476c-8831-4866eeff9434" status: 200 len: 1454 microversion: 2.1 time: 0.103374 Oct 27 03:35:18.198582 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1808/3369] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:35:18 2022] GET /compute/v2.1/images/5c03b8cf-4b2d-476c-8831-4866eeff9434 => generated 1454 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:18.214151 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-acdfb495-904a-4604-8d66-19cf332b1f17 req-f2609e41-d7fd-4b8e-8e96-b58258d16ded service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35a0ac1a-379f-456e-a3d7-81f888daebbf", "name": "network-vif-plugged", "status": "completed", "tag": "9e03ed18-4c77-4669-8c1e-f8e715e9ff37"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:35:18.227429 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-acdfb495-904a-4604-8d66-19cf332b1f17 req-f2609e41-d7fd-4b8e-8e96-b58258d16ded service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:18.228167 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-acdfb495-904a-4604-8d66-19cf332b1f17 req-f2609e41-d7fd-4b8e-8e96-b58258d16ded service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:18.228850 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-acdfb495-904a-4604-8d66-19cf332b1f17 req-f2609e41-d7fd-4b8e-8e96-b58258d16ded service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:18.260607 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-acdfb495-904a-4604-8d66-19cf332b1f17 req-f2609e41-d7fd-4b8e-8e96-b58258d16ded service nova] Creating event network-vif-plugged:9e03ed18-4c77-4669-8c1e-f8e715e9ff37 for instance 35a0ac1a-379f-456e-a3d7-81f888daebbf on n-h2-862769-1 Oct 27 03:35:18.269813 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-acdfb495-904a-4604-8d66-19cf332b1f17 req-f2609e41-d7fd-4b8e-8e96-b58258d16ded service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068130 Oct 27 03:35:18.275678 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1809/3370] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:35:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:35:18.282741 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5e880414-f3e1-4d28-af1b-dcad073befaa tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:18.284197 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5e880414-f3e1-4d28-af1b-dcad073befaa tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] [instance: 2410110f-fee8-4669-be8c-5137af8f074f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:18.292173 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5e880414-f3e1-4d28-af1b-dcad073befaa tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:18.293025 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5e880414-f3e1-4d28-af1b-dcad073befaa tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:18.293950 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5e880414-f3e1-4d28-af1b-dcad073befaa tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:18.295644 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5e880414-f3e1-4d28-af1b-dcad073befaa tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:18.297078 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5e880414-f3e1-4d28-af1b-dcad073befaa tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:18.297836 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5e880414-f3e1-4d28-af1b-dcad073befaa tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:18.432642 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-6419f567-9b5e-41f4-b05a-b129d8eadcf1 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:18.443836 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-6419f567-9b5e-41f4-b05a-b129d8eadcf1 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:18.458230 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-6419f567-9b5e-41f4-b05a-b129d8eadcf1 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:18.458230 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6419f567-9b5e-41f4-b05a-b129d8eadcf1 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d" status: 200 len: 1848 microversion: 2.42 time: 0.863147 Oct 27 03:35:18.458230 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1562/3371] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:35:17 2022] GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d => generated 1848 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:35:18.469765 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c535e502-d316-45fb-89d3-a6e33a2e2fb2 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:35:18.469765 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c535e502-d316-45fb-89d3-a6e33a2e2fb2 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:18.486016 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c535e502-d316-45fb-89d3-a6e33a2e2fb2 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:18.486016 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c535e502-d316-45fb-89d3-a6e33a2e2fb2 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:18.486016 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c535e502-d316-45fb-89d3-a6e33a2e2fb2 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:18.486016 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c535e502-d316-45fb-89d3-a6e33a2e2fb2 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:18.486016 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c535e502-d316-45fb-89d3-a6e33a2e2fb2 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:18.486016 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c535e502-d316-45fb-89d3-a6e33a2e2fb2 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:18.729583 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5e880414-f3e1-4d28-af1b-dcad073befaa tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881f054c84d04ceaa17a5817816022d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2057593072c14804ab70fe4bdea2c17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:18.747642 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5e880414-f3e1-4d28-af1b-dcad073befaa tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] 10.222.0.20 "GET /compute/v2.1/servers/2410110f-fee8-4669-be8c-5137af8f074f" status: 200 len: 1334 microversion: 2.1 time: 0.470314 Oct 27 03:35:18.763006 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1810/3372] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:18 2022] GET /compute/v2.1/servers/2410110f-fee8-4669-be8c-5137af8f074f => generated 1334 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:18.763006 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e729152f-6564-4e62-991c-7b693d18e128 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:18.763006 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e729152f-6564-4e62-991c-7b693d18e128 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 35a0ac1a-379f-456e-a3d7-81f888daebbf] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:18.763733 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e729152f-6564-4e62-991c-7b693d18e128 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:18.764304 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e729152f-6564-4e62-991c-7b693d18e128 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:18.766962 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e729152f-6564-4e62-991c-7b693d18e128 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:18.767596 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e729152f-6564-4e62-991c-7b693d18e128 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:18.768013 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e729152f-6564-4e62-991c-7b693d18e128 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:18.769190 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e729152f-6564-4e62-991c-7b693d18e128 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:18.806653 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c535e502-d316-45fb-89d3-a6e33a2e2fb2 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "POST /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86/action" status: 202 len: 0 microversion: 2.1 time: 0.358240 Oct 27 03:35:18.811164 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1563/3373] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:35:18 2022] POST /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86/action => generated 0 bytes in 363 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:35:18.816447 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6cd8b054-52c5-43f6-8aac-099ca7628d65 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:18.824674 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6cd8b054-52c5-43f6-8aac-099ca7628d65 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:18.838924 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6cd8b054-52c5-43f6-8aac-099ca7628d65 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:18.846845 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6cd8b054-52c5-43f6-8aac-099ca7628d65 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:18.847577 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6cd8b054-52c5-43f6-8aac-099ca7628d65 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:18.848508 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6cd8b054-52c5-43f6-8aac-099ca7628d65 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:18.849137 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6cd8b054-52c5-43f6-8aac-099ca7628d65 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:18.849743 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6cd8b054-52c5-43f6-8aac-099ca7628d65 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:19.112358 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e729152f-6564-4e62-991c-7b693d18e128 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:19.121878 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e729152f-6564-4e62-991c-7b693d18e128 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/35a0ac1a-379f-456e-a3d7-81f888daebbf" status: 200 len: 1316 microversion: 2.1 time: 0.371069 Oct 27 03:35:19.127267 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1811/3374] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:18 2022] GET /compute/v2.1/servers/35a0ac1a-379f-456e-a3d7-81f888daebbf => generated 1316 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:19.216031 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7f60b7fd-71f6-47bb-a8d1-9beff2c9a2a8 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7dded2a8b0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:19.309018 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7f60b7fd-71f6-47bb-a8d1-9beff2c9a2a8 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images/5c03b8cf-4b2d-476c-8831-4866eeff9434" status: 200 len: 1454 microversion: 2.1 time: 0.099390 Oct 27 03:35:19.326725 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1812/3375] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:35:19 2022] GET /compute/v2.1/images/5c03b8cf-4b2d-476c-8831-4866eeff9434 => generated 1454 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:19.417118 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-6cd8b054-52c5-43f6-8aac-099ca7628d65 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:19.431452 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6cd8b054-52c5-43f6-8aac-099ca7628d65 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1674 microversion: 2.1 time: 0.616820 Oct 27 03:35:19.432401 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1564/3376] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:18 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1674 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:19.477921 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b44060fe-bf59-48dc-9113-2173306a2b80 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:19.479903 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b44060fe-bf59-48dc-9113-2173306a2b80 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] [instance: 8c8a2cbb-4acf-4a6b-b684-567617bb930d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:19.501017 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b44060fe-bf59-48dc-9113-2173306a2b80 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:19.502855 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b44060fe-bf59-48dc-9113-2173306a2b80 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:19.502855 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b44060fe-bf59-48dc-9113-2173306a2b80 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:19.502855 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b44060fe-bf59-48dc-9113-2173306a2b80 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:19.503207 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b44060fe-bf59-48dc-9113-2173306a2b80 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:19.503628 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b44060fe-bf59-48dc-9113-2173306a2b80 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:19.551322 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:35:19.774136 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f3a4ef6a-9768-4946-9326-00cc193f0ae7 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:19.774774 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f3a4ef6a-9768-4946-9326-00cc193f0ae7 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] [instance: 2410110f-fee8-4669-be8c-5137af8f074f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:19.776783 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:35:19.800263 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f3a4ef6a-9768-4946-9326-00cc193f0ae7 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:19.800795 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f3a4ef6a-9768-4946-9326-00cc193f0ae7 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:19.801250 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f3a4ef6a-9768-4946-9326-00cc193f0ae7 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:19.801996 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f3a4ef6a-9768-4946-9326-00cc193f0ae7 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:19.803716 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f3a4ef6a-9768-4946-9326-00cc193f0ae7 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:19.806756 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f3a4ef6a-9768-4946-9326-00cc193f0ae7 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:19.872640 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:35:20.165122 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b44060fe-bf59-48dc-9113-2173306a2b80 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:20.177392 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b44060fe-bf59-48dc-9113-2173306a2b80 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:20.196117 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b44060fe-bf59-48dc-9113-2173306a2b80 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:20.198443 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b44060fe-bf59-48dc-9113-2173306a2b80 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d" status: 200 len: 1869 microversion: 2.42 time: 0.724838 Oct 27 03:35:20.201719 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1813/3377] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:35:19 2022] GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d => generated 1869 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:35:20.213196 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-652324ba-6f83-49c2-a88a-f38993bfbb19 req-b9c16d0f-d39e-4ffc-bb48-151159610f95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c8a2cbb-4acf-4a6b-b684-567617bb930d", "tag": "3a1ccaa7-51b5-4235-87d4-b3c14e28f77b"}, {"name": "network-changed", "server_uuid": "8c8a2cbb-4acf-4a6b-b684-567617bb930d", "tag": "40696ddf-b935-4016-95dc-a4e42979795f"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:35:20.255774 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-652324ba-6f83-49c2-a88a-f38993bfbb19 req-b9c16d0f-d39e-4ffc-bb48-151159610f95 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:20.258665 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-652324ba-6f83-49c2-a88a-f38993bfbb19 req-b9c16d0f-d39e-4ffc-bb48-151159610f95 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:20.259343 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-652324ba-6f83-49c2-a88a-f38993bfbb19 req-b9c16d0f-d39e-4ffc-bb48-151159610f95 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:20.335910 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-652324ba-6f83-49c2-a88a-f38993bfbb19 req-b9c16d0f-d39e-4ffc-bb48-151159610f95 service nova] Creating event network-changed:3a1ccaa7-51b5-4235-87d4-b3c14e28f77b for instance 8c8a2cbb-4acf-4a6b-b684-567617bb930d on n-h2-862769-1 Oct 27 03:35:20.341815 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-652324ba-6f83-49c2-a88a-f38993bfbb19 req-b9c16d0f-d39e-4ffc-bb48-151159610f95 service nova] Creating event network-changed:40696ddf-b935-4016-95dc-a4e42979795f for instance 8c8a2cbb-4acf-4a6b-b684-567617bb930d on n-h2-862769-1 Oct 27 03:35:20.348179 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-652324ba-6f83-49c2-a88a-f38993bfbb19 req-b9c16d0f-d39e-4ffc-bb48-151159610f95 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.144404 Oct 27 03:35:20.349306 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1814/3378] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:35:20 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:35:20.356176 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-eca48b9a-07fb-4a1a-934a-04d84a8d2102 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:20.366911 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-eca48b9a-07fb-4a1a-934a-04d84a8d2102 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 35a0ac1a-379f-456e-a3d7-81f888daebbf] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:20.377420 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eca48b9a-07fb-4a1a-934a-04d84a8d2102 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:20.377930 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eca48b9a-07fb-4a1a-934a-04d84a8d2102 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:20.378414 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eca48b9a-07fb-4a1a-934a-04d84a8d2102 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:20.387404 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eca48b9a-07fb-4a1a-934a-04d84a8d2102 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:20.387916 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eca48b9a-07fb-4a1a-934a-04d84a8d2102 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:20.388371 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eca48b9a-07fb-4a1a-934a-04d84a8d2102 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:20.759095 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-eca48b9a-07fb-4a1a-934a-04d84a8d2102 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:20.775908 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-eca48b9a-07fb-4a1a-934a-04d84a8d2102 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/35a0ac1a-379f-456e-a3d7-81f888daebbf" status: 200 len: 1505 microversion: 2.1 time: 0.425345 Oct 27 03:35:20.798975 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1815/3379] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:20 2022] GET /compute/v2.1/servers/35a0ac1a-379f-456e-a3d7-81f888daebbf => generated 1505 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:20.814448 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-18c0dea0-44fd-469b-b3a1-b15a7850ca07 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7ddec58e50>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:20.933913 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-18c0dea0-44fd-469b-b3a1-b15a7850ca07 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images/5c03b8cf-4b2d-476c-8831-4866eeff9434" status: 200 len: 1454 microversion: 2.1 time: 0.133150 Oct 27 03:35:20.935057 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1816/3380] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:35:20 2022] GET /compute/v2.1/images/5c03b8cf-4b2d-476c-8831-4866eeff9434 => generated 1454 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:20.938382 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f3a4ef6a-9768-4946-9326-00cc193f0ae7 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881f054c84d04ceaa17a5817816022d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2057593072c14804ab70fe4bdea2c17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:20.942501 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5d13af06-b265-4c67-9280-ffb153926a66 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:20.973388 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5d13af06-b265-4c67-9280-ffb153926a66 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:20.973857 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f3a4ef6a-9768-4946-9326-00cc193f0ae7 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] 10.222.0.20 "GET /compute/v2.1/servers/2410110f-fee8-4669-be8c-5137af8f074f" status: 200 len: 1334 microversion: 2.1 time: 1.187531 Oct 27 03:35:20.973857 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1565/3381] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:19 2022] GET /compute/v2.1/servers/2410110f-fee8-4669-be8c-5137af8f074f => generated 1334 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:20.973857 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9482e7f3-104a-4624-9fb0-eb89860db7df tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:20.973857 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9482e7f3-104a-4624-9fb0-eb89860db7df tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 35a0ac1a-379f-456e-a3d7-81f888daebbf] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:20.980508 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5d13af06-b265-4c67-9280-ffb153926a66 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:20.981341 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5d13af06-b265-4c67-9280-ffb153926a66 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:20.981877 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5d13af06-b265-4c67-9280-ffb153926a66 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:20.982679 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5d13af06-b265-4c67-9280-ffb153926a66 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:20.983156 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5d13af06-b265-4c67-9280-ffb153926a66 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:20.987180 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5d13af06-b265-4c67-9280-ffb153926a66 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:21.004005 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9482e7f3-104a-4624-9fb0-eb89860db7df tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:21.004519 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9482e7f3-104a-4624-9fb0-eb89860db7df tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:21.004973 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9482e7f3-104a-4624-9fb0-eb89860db7df tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:21.005885 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9482e7f3-104a-4624-9fb0-eb89860db7df tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:21.011718 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9482e7f3-104a-4624-9fb0-eb89860db7df tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:21.012227 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9482e7f3-104a-4624-9fb0-eb89860db7df tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:21.082146 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9482e7f3-104a-4624-9fb0-eb89860db7df tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 35a0ac1a-379f-456e-a3d7-81f888daebbf] Going to try to terminate instance {{(pid=121000) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:35:21.484043 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9482e7f3-104a-4624-9fb0-eb89860db7df tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "DELETE /compute/v2.1/servers/35a0ac1a-379f-456e-a3d7-81f888daebbf" status: 204 len: 0 microversion: 2.1 time: 0.519112 Oct 27 03:35:21.484980 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1566/3382] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:35:20 2022] DELETE /compute/v2.1/servers/35a0ac1a-379f-456e-a3d7-81f888daebbf => generated 0 bytes in 521 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:35:21.493462 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1b911ec7-13ef-44de-bdfd-1d5a62a02dd3 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:21.494350 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1b911ec7-13ef-44de-bdfd-1d5a62a02dd3 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] [instance: 8c8a2cbb-4acf-4a6b-b684-567617bb930d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:21.511164 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1b911ec7-13ef-44de-bdfd-1d5a62a02dd3 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:21.511671 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1b911ec7-13ef-44de-bdfd-1d5a62a02dd3 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:21.512129 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1b911ec7-13ef-44de-bdfd-1d5a62a02dd3 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:21.522966 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1b911ec7-13ef-44de-bdfd-1d5a62a02dd3 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:21.525665 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1b911ec7-13ef-44de-bdfd-1d5a62a02dd3 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:21.526190 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1b911ec7-13ef-44de-bdfd-1d5a62a02dd3 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:21.680292 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5d13af06-b265-4c67-9280-ffb153926a66 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:21.693699 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5d13af06-b265-4c67-9280-ffb153926a66 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1654 microversion: 2.1 time: 0.755997 Oct 27 03:35:21.694592 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1817/3383] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:20 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1654 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:21.706356 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d0dea753-69a0-4530-bbee-46c0fb86a3e7 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:21.707326 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d0dea753-69a0-4530-bbee-46c0fb86a3e7 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 35a0ac1a-379f-456e-a3d7-81f888daebbf] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:21.723029 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d0dea753-69a0-4530-bbee-46c0fb86a3e7 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:21.723543 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d0dea753-69a0-4530-bbee-46c0fb86a3e7 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:21.724004 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d0dea753-69a0-4530-bbee-46c0fb86a3e7 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:21.724726 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d0dea753-69a0-4530-bbee-46c0fb86a3e7 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:21.725188 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d0dea753-69a0-4530-bbee-46c0fb86a3e7 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:21.725622 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d0dea753-69a0-4530-bbee-46c0fb86a3e7 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:22.025436 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1b911ec7-13ef-44de-bdfd-1d5a62a02dd3 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:22.037840 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1b911ec7-13ef-44de-bdfd-1d5a62a02dd3 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:22.039924 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1b911ec7-13ef-44de-bdfd-1d5a62a02dd3 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:22.042020 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1b911ec7-13ef-44de-bdfd-1d5a62a02dd3 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d" status: 200 len: 1869 microversion: 2.42 time: 0.555463 Oct 27 03:35:22.043273 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1567/3384] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:35:21 2022] GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d => generated 1869 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:35:22.083662 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-bd45dd6a-7ccd-48d8-954b-5fb9b6c7274c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:35:22.084245 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-bd45dd6a-7ccd-48d8-954b-5fb9b6c7274c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:22.090693 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bd45dd6a-7ccd-48d8-954b-5fb9b6c7274c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:22.091233 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bd45dd6a-7ccd-48d8-954b-5fb9b6c7274c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:22.091676 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bd45dd6a-7ccd-48d8-954b-5fb9b6c7274c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:22.102231 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bd45dd6a-7ccd-48d8-954b-5fb9b6c7274c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:22.102910 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bd45dd6a-7ccd-48d8-954b-5fb9b6c7274c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:22.103528 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bd45dd6a-7ccd-48d8-954b-5fb9b6c7274c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:22.421439 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-bd45dd6a-7ccd-48d8-954b-5fb9b6c7274c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "POST /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86/action" status: 202 len: 0 microversion: 2.1 time: 0.375559 Oct 27 03:35:22.425421 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1568/3385] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:35:22 2022] POST /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86/action => generated 0 bytes in 378 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:35:22.435822 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d0dea753-69a0-4530-bbee-46c0fb86a3e7 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:22.439832 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2bb642a9-4db4-491f-b76b-89c947280245 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7ddec880d0>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:22.447842 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d0dea753-69a0-4530-bbee-46c0fb86a3e7 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/35a0ac1a-379f-456e-a3d7-81f888daebbf" status: 200 len: 1511 microversion: 2.1 time: 0.749496 Oct 27 03:35:22.449556 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1818/3386] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:21 2022] GET /compute/v2.1/servers/35a0ac1a-379f-456e-a3d7-81f888daebbf => generated 1511 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:22.569248 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2bb642a9-4db4-491f-b76b-89c947280245 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images/5c03b8cf-4b2d-476c-8831-4866eeff9434" status: 200 len: 1454 microversion: 2.1 time: 0.141025 Oct 27 03:35:22.570503 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1569/3387] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:35:22 2022] GET /compute/v2.1/images/5c03b8cf-4b2d-476c-8831-4866eeff9434 => generated 1454 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:22.588450 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-accb9a32-a6e3-4ce0-904a-761582310872 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:22.593815 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-accb9a32-a6e3-4ce0-904a-761582310872 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] [instance: 2410110f-fee8-4669-be8c-5137af8f074f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:22.613806 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-accb9a32-a6e3-4ce0-904a-761582310872 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:22.616774 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-accb9a32-a6e3-4ce0-904a-761582310872 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:22.618700 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-accb9a32-a6e3-4ce0-904a-761582310872 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:22.622087 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-accb9a32-a6e3-4ce0-904a-761582310872 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:22.628455 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-accb9a32-a6e3-4ce0-904a-761582310872 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:22.629113 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-accb9a32-a6e3-4ce0-904a-761582310872 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:22.768504 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-13613b5e-4266-4c2b-8d09-3bd6a67c0312 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-58046158", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": [{"uuid": "ee40dc00-9956-4077-969f-dfdca68cbee6"}]}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:35:22.804039 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:35:22.949295 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.network.neutron [None req-13613b5e-4266-4c2b-8d09-3bd6a67c0312 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] validate_networks() for [('ee40dc00-9956-4077-969f-dfdca68cbee6', None, None, None, None, None)] {{(pid=121001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:35:23.120025 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-accb9a32-a6e3-4ce0-904a-761582310872 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881f054c84d04ceaa17a5817816022d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2057593072c14804ab70fe4bdea2c17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:23.134921 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-accb9a32-a6e3-4ce0-904a-761582310872 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] 10.222.0.20 "GET /compute/v2.1/servers/2410110f-fee8-4669-be8c-5137af8f074f" status: 200 len: 1334 microversion: 2.1 time: 0.563304 Oct 27 03:35:23.146606 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1570/3388] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:22 2022] GET /compute/v2.1/servers/2410110f-fee8-4669-be8c-5137af8f074f => generated 1334 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:23.156232 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e07cf844-db12-4928-8f42-3c8b3cd8c012 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:23.161593 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e07cf844-db12-4928-8f42-3c8b3cd8c012 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:23.180328 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e07cf844-db12-4928-8f42-3c8b3cd8c012 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:23.184074 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e07cf844-db12-4928-8f42-3c8b3cd8c012 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:23.184579 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e07cf844-db12-4928-8f42-3c8b3cd8c012 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:23.191828 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e07cf844-db12-4928-8f42-3c8b3cd8c012 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:23.192886 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e07cf844-db12-4928-8f42-3c8b3cd8c012 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:23.193706 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e07cf844-db12-4928-8f42-3c8b3cd8c012 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:23.472327 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e07cf844-db12-4928-8f42-3c8b3cd8c012 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:23.488489 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e07cf844-db12-4928-8f42-3c8b3cd8c012 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1669 microversion: 2.1 time: 0.335626 Oct 27 03:35:23.503701 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1571/3389] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:23 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1669 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:23.519334 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8f723703-c259-46a1-b941-48db421f04d2 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:23.520043 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8f723703-c259-46a1-b941-48db421f04d2 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] [instance: 8c8a2cbb-4acf-4a6b-b684-567617bb930d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:23.535953 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8f723703-c259-46a1-b941-48db421f04d2 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:23.536462 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8f723703-c259-46a1-b941-48db421f04d2 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:23.536910 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8f723703-c259-46a1-b941-48db421f04d2 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:23.537778 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8f723703-c259-46a1-b941-48db421f04d2 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:23.541457 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8f723703-c259-46a1-b941-48db421f04d2 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:23.541907 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8f723703-c259-46a1-b941-48db421f04d2 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:25.228912 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8f723703-c259-46a1-b941-48db421f04d2 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:25.254100 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8f723703-c259-46a1-b941-48db421f04d2 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:25.254100 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8f723703-c259-46a1-b941-48db421f04d2 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:25.254100 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8f723703-c259-46a1-b941-48db421f04d2 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d" status: 200 len: 1890 microversion: 2.42 time: 1.746625 Oct 27 03:35:25.254100 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1572/3390] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:35:23 2022] GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d => generated 1890 bytes in 1748 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:35:25.266408 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e96c2c54-72aa-44b5-a56c-bb862251d2bd tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:25.267361 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e96c2c54-72aa-44b5-a56c-bb862251d2bd tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 35a0ac1a-379f-456e-a3d7-81f888daebbf] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:25.284395 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e96c2c54-72aa-44b5-a56c-bb862251d2bd tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:25.285229 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e96c2c54-72aa-44b5-a56c-bb862251d2bd tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:25.285978 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e96c2c54-72aa-44b5-a56c-bb862251d2bd tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:25.286961 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e96c2c54-72aa-44b5-a56c-bb862251d2bd tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:25.287645 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e96c2c54-72aa-44b5-a56c-bb862251d2bd tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:25.291330 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e96c2c54-72aa-44b5-a56c-bb862251d2bd tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:25.675642 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-13613b5e-4266-4c2b-8d09-3bd6a67c0312 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Flavor limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:35:25.676111 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-13613b5e-4266-4c2b-8d09-3bd6a67c0312 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Image limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:35:25.676572 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-13613b5e-4266-4c2b-8d09-3bd6a67c0312 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Flavor pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:35:25.676996 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-13613b5e-4266-4c2b-8d09-3bd6a67c0312 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Image pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:35:25.677424 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-13613b5e-4266-4c2b-8d09-3bd6a67c0312 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:35:25.700882 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-13613b5e-4266-4c2b-8d09-3bd6a67c0312 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:25.706775 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-13613b5e-4266-4c2b-8d09-3bd6a67c0312 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:25.707328 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-13613b5e-4266-4c2b-8d09-3bd6a67c0312 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:25.708171 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-13613b5e-4266-4c2b-8d09-3bd6a67c0312 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:25.708663 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-13613b5e-4266-4c2b-8d09-3bd6a67c0312 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:25.709113 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-13613b5e-4266-4c2b-8d09-3bd6a67c0312 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:25.809610 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-13613b5e-4266-4c2b-8d09-3bd6a67c0312 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Getting quotas for project 2e58f30136ed4a4d9bff48e9b4cde5a8. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:35:25.830075 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e96c2c54-72aa-44b5-a56c-bb862251d2bd tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:25.844450 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e96c2c54-72aa-44b5-a56c-bb862251d2bd tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/35a0ac1a-379f-456e-a3d7-81f888daebbf" status: 200 len: 1511 microversion: 2.1 time: 0.588108 Oct 27 03:35:25.846900 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1573/3391] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:25 2022] GET /compute/v2.1/servers/35a0ac1a-379f-456e-a3d7-81f888daebbf => generated 1511 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:25.852418 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-13613b5e-4266-4c2b-8d09-3bd6a67c0312 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Getting quotas for user 5c36bef85ac34b4983a79e03c56965c5 and project 2e58f30136ed4a4d9bff48e9b4cde5a8. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:35:25.855992 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8a3e2195-a06e-4f67-97fd-1a23a77a0143 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:25.860497 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8a3e2195-a06e-4f67-97fd-1a23a77a0143 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:25.871112 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8a3e2195-a06e-4f67-97fd-1a23a77a0143 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:25.872154 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8a3e2195-a06e-4f67-97fd-1a23a77a0143 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:25.872739 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8a3e2195-a06e-4f67-97fd-1a23a77a0143 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:25.873790 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8a3e2195-a06e-4f67-97fd-1a23a77a0143 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:25.874464 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8a3e2195-a06e-4f67-97fd-1a23a77a0143 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:25.875039 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8a3e2195-a06e-4f67-97fd-1a23a77a0143 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:25.875535 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-13613b5e-4266-4c2b-8d09-3bd6a67c0312 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Going to run 1 instances... {{(pid=121001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:35:25.878169 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-13613b5e-4266-4c2b-8d09-3bd6a67c0312 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] [instance: 09065cd4-8246-49ee-80fe-b4f1c11b468d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:35:26.081224 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-13613b5e-4266-4c2b-8d09-3bd6a67c0312 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.630355 Oct 27 03:35:26.084612 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1819/3392] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:35:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 3634 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 03:35:26.096464 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-691da810-83c1-42db-afbc-48fd1494abf3 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7dd9de0af0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:26.251326 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-691da810-83c1-42db-afbc-48fd1494abf3 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images/5c03b8cf-4b2d-476c-8831-4866eeff9434" status: 200 len: 1454 microversion: 2.1 time: 0.151512 Oct 27 03:35:26.253576 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1820/3393] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:35:26 2022] GET /compute/v2.1/images/5c03b8cf-4b2d-476c-8831-4866eeff9434 => generated 1454 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:26.273815 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2ead0cde-04ed-4bb6-bf27-85cb32447068 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:26.274495 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2ead0cde-04ed-4bb6-bf27-85cb32447068 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] [instance: 2410110f-fee8-4669-be8c-5137af8f074f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:26.297419 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2ead0cde-04ed-4bb6-bf27-85cb32447068 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:26.300249 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2ead0cde-04ed-4bb6-bf27-85cb32447068 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:26.300716 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2ead0cde-04ed-4bb6-bf27-85cb32447068 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:26.307880 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2ead0cde-04ed-4bb6-bf27-85cb32447068 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:26.308390 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2ead0cde-04ed-4bb6-bf27-85cb32447068 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:26.308845 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2ead0cde-04ed-4bb6-bf27-85cb32447068 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:26.337440 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8a3e2195-a06e-4f67-97fd-1a23a77a0143 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:26.351168 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8a3e2195-a06e-4f67-97fd-1a23a77a0143 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1669 microversion: 2.1 time: 0.502212 Oct 27 03:35:26.355353 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1574/3394] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:25 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1669 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:26.358560 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-5386e853-1a21-4cc2-93bb-23df0ad2787a req-c89d777e-f165-46bf-afc0-e146658fcb63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c8a2cbb-4acf-4a6b-b684-567617bb930d", "tag": "3eb3290d-51f2-4707-9c45-ff4cde5ca958"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:35:26.373082 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-5386e853-1a21-4cc2-93bb-23df0ad2787a req-c89d777e-f165-46bf-afc0-e146658fcb63 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:26.376317 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-5386e853-1a21-4cc2-93bb-23df0ad2787a req-c89d777e-f165-46bf-afc0-e146658fcb63 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:26.377053 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-5386e853-1a21-4cc2-93bb-23df0ad2787a req-c89d777e-f165-46bf-afc0-e146658fcb63 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:26.392652 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-5386e853-1a21-4cc2-93bb-23df0ad2787a req-c89d777e-f165-46bf-afc0-e146658fcb63 service nova] Creating event network-changed:3eb3290d-51f2-4707-9c45-ff4cde5ca958 for instance 8c8a2cbb-4acf-4a6b-b684-567617bb930d on n-h2-862769-1 Oct 27 03:35:26.398681 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-5386e853-1a21-4cc2-93bb-23df0ad2787a req-c89d777e-f165-46bf-afc0-e146658fcb63 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045054 Oct 27 03:35:26.399913 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1575/3395] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:35:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:35:26.412851 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-51c0cc8c-e40b-4cde-8dd1-3c2ee1b385e2 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:26.414443 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-51c0cc8c-e40b-4cde-8dd1-3c2ee1b385e2 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] [instance: 09065cd4-8246-49ee-80fe-b4f1c11b468d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:26.586722 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-51c0cc8c-e40b-4cde-8dd1-3c2ee1b385e2 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c36bef85ac34b4983a79e03c56965c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e58f30136ed4a4d9bff48e9b4cde5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:26.603267 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-51c0cc8c-e40b-4cde-8dd1-3c2ee1b385e2 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] 10.222.0.20 "GET /compute/v2.1/servers/09065cd4-8246-49ee-80fe-b4f1c11b468d" status: 200 len: 1223 microversion: 2.1 time: 0.195804 Oct 27 03:35:26.604413 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1576/3396] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:26 2022] GET /compute/v2.1/servers/09065cd4-8246-49ee-80fe-b4f1c11b468d => generated 1223 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:26.613831 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-d7e77c8b-9393-4d8d-9efa-bbb3f3245d87 req-e0db486c-7031-4f0c-bfba-a0fbeb16cc62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35a0ac1a-379f-456e-a3d7-81f888daebbf", "name": "network-vif-deleted", "tag": "9e03ed18-4c77-4669-8c1e-f8e715e9ff37"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:35:26.634062 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-d7e77c8b-9393-4d8d-9efa-bbb3f3245d87 req-e0db486c-7031-4f0c-bfba-a0fbeb16cc62 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:26.634828 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-d7e77c8b-9393-4d8d-9efa-bbb3f3245d87 req-e0db486c-7031-4f0c-bfba-a0fbeb16cc62 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:26.647641 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-d7e77c8b-9393-4d8d-9efa-bbb3f3245d87 req-e0db486c-7031-4f0c-bfba-a0fbeb16cc62 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:26.652375 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:35:26.662350 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-d7e77c8b-9393-4d8d-9efa-bbb3f3245d87 req-e0db486c-7031-4f0c-bfba-a0fbeb16cc62 service nova] Creating event network-vif-deleted:9e03ed18-4c77-4669-8c1e-f8e715e9ff37 for instance 35a0ac1a-379f-456e-a3d7-81f888daebbf on n-h2-862769-1 Oct 27 03:35:26.668942 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-d7e77c8b-9393-4d8d-9efa-bbb3f3245d87 req-e0db486c-7031-4f0c-bfba-a0fbeb16cc62 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063119 Oct 27 03:35:26.670913 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1577/3397] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:35:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:35:26.692554 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-fd8cc947-f6e5-4c4b-8c9b-a2fbcfc49aca tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:26.693393 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-fd8cc947-f6e5-4c4b-8c9b-a2fbcfc49aca tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] [instance: 8c8a2cbb-4acf-4a6b-b684-567617bb930d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:26.701497 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fd8cc947-f6e5-4c4b-8c9b-a2fbcfc49aca tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:26.702938 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fd8cc947-f6e5-4c4b-8c9b-a2fbcfc49aca tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:26.703593 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fd8cc947-f6e5-4c4b-8c9b-a2fbcfc49aca tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:26.704453 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fd8cc947-f6e5-4c4b-8c9b-a2fbcfc49aca tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:26.705037 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fd8cc947-f6e5-4c4b-8c9b-a2fbcfc49aca tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:26.705580 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fd8cc947-f6e5-4c4b-8c9b-a2fbcfc49aca tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:27.171476 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-fd8cc947-f6e5-4c4b-8c9b-a2fbcfc49aca tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:27.182602 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-fd8cc947-f6e5-4c4b-8c9b-a2fbcfc49aca tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:27.184588 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-fd8cc947-f6e5-4c4b-8c9b-a2fbcfc49aca tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:27.186889 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-fd8cc947-f6e5-4c4b-8c9b-a2fbcfc49aca tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d" status: 200 len: 1890 microversion: 2.42 time: 0.513918 Oct 27 03:35:27.199575 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1578/3398] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:35:26 2022] GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d => generated 1890 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:35:27.212429 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-83472016-f6bf-4fb9-9fe5-8890947214e6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:27.213126 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-83472016-f6bf-4fb9-9fe5-8890947214e6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:27.220008 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-83472016-f6bf-4fb9-9fe5-8890947214e6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:27.220805 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-83472016-f6bf-4fb9-9fe5-8890947214e6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:27.220928 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-83472016-f6bf-4fb9-9fe5-8890947214e6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:27.221807 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-83472016-f6bf-4fb9-9fe5-8890947214e6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:27.222202 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-83472016-f6bf-4fb9-9fe5-8890947214e6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:27.222647 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-83472016-f6bf-4fb9-9fe5-8890947214e6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:27.291268 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2ead0cde-04ed-4bb6-bf27-85cb32447068 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881f054c84d04ceaa17a5817816022d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2057593072c14804ab70fe4bdea2c17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:27.299995 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2ead0cde-04ed-4bb6-bf27-85cb32447068 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] 10.222.0.20 "GET /compute/v2.1/servers/2410110f-fee8-4669-be8c-5137af8f074f" status: 200 len: 1334 microversion: 2.1 time: 1.045329 Oct 27 03:35:27.300584 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1821/3399] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:26 2022] GET /compute/v2.1/servers/2410110f-fee8-4669-be8c-5137af8f074f => generated 1334 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:27.312236 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-521770b0-27c1-42ca-b875-a19a9a46554c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:27.313153 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-521770b0-27c1-42ca-b875-a19a9a46554c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 35a0ac1a-379f-456e-a3d7-81f888daebbf] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:27.327344 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-521770b0-27c1-42ca-b875-a19a9a46554c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:27.328253 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-521770b0-27c1-42ca-b875-a19a9a46554c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:27.328717 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-521770b0-27c1-42ca-b875-a19a9a46554c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:27.329464 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-521770b0-27c1-42ca-b875-a19a9a46554c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:27.329946 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-521770b0-27c1-42ca-b875-a19a9a46554c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:27.330417 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-521770b0-27c1-42ca-b875-a19a9a46554c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:27.401051 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-521770b0-27c1-42ca-b875-a19a9a46554c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:27.401821 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-521770b0-27c1-42ca-b875-a19a9a46554c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:27.402515 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-521770b0-27c1-42ca-b875-a19a9a46554c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:27.403257 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-521770b0-27c1-42ca-b875-a19a9a46554c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lazy-loading 'fault' on Instance uuid 35a0ac1a-379f-456e-a3d7-81f888daebbf {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:35:27.602420 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-83472016-f6bf-4fb9-9fe5-8890947214e6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:27.611450 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-521770b0-27c1-42ca-b875-a19a9a46554c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:27.636864 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-521770b0-27c1-42ca-b875-a19a9a46554c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/35a0ac1a-379f-456e-a3d7-81f888daebbf" status: 200 len: 1306 microversion: 2.1 time: 0.329318 Oct 27 03:35:27.641660 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-83472016-f6bf-4fb9-9fe5-8890947214e6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1669 microversion: 2.1 time: 0.440561 Oct 27 03:35:27.647469 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1822/3400] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:27 2022] GET /compute/v2.1/servers/35a0ac1a-379f-456e-a3d7-81f888daebbf => generated 1306 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:27.649163 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1579/3401] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:27 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1669 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:27.654637 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7045e2f3-ee02-46ec-a488-5914014e2d22 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7dda5989d0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:27.659349 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c630727c-4395-419a-bc1d-b74df38f88db tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:27.677584 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c630727c-4395-419a-bc1d-b74df38f88db tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] [instance: 09065cd4-8246-49ee-80fe-b4f1c11b468d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:27.727888 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7045e2f3-ee02-46ec-a488-5914014e2d22 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images/5c03b8cf-4b2d-476c-8831-4866eeff9434" status: 200 len: 1463 microversion: 2.1 time: 0.078913 Oct 27 03:35:27.729115 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1823/3402] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:35:27 2022] GET /compute/v2.1/images/5c03b8cf-4b2d-476c-8831-4866eeff9434 => generated 1463 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:27.734068 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e638c231-bf67-430c-af40-c78e0b0fd63f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:27.734984 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e638c231-bf67-430c-af40-c78e0b0fd63f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:27.741749 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e638c231-bf67-430c-af40-c78e0b0fd63f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:27.742685 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e638c231-bf67-430c-af40-c78e0b0fd63f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:27.743825 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e638c231-bf67-430c-af40-c78e0b0fd63f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:27.744996 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e638c231-bf67-430c-af40-c78e0b0fd63f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:27.745710 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e638c231-bf67-430c-af40-c78e0b0fd63f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:27.746441 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e638c231-bf67-430c-af40-c78e0b0fd63f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:27.782927 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c630727c-4395-419a-bc1d-b74df38f88db tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c36bef85ac34b4983a79e03c56965c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e58f30136ed4a4d9bff48e9b4cde5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:27.792631 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c630727c-4395-419a-bc1d-b74df38f88db tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] 10.222.0.20 "GET /compute/v2.1/servers/09065cd4-8246-49ee-80fe-b4f1c11b468d" status: 200 len: 1223 microversion: 2.1 time: 0.141656 Oct 27 03:35:27.807168 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1580/3403] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:27 2022] GET /compute/v2.1/servers/09065cd4-8246-49ee-80fe-b4f1c11b468d => generated 1223 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:27.815158 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9e6ac048-a13a-40ca-8238-f7e4c63c0404 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7dda8cf310>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:27.899775 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9e6ac048-a13a-40ca-8238-f7e4c63c0404 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images/5c03b8cf-4b2d-476c-8831-4866eeff9434" status: 200 len: 1463 microversion: 2.1 time: 0.090467 Oct 27 03:35:27.900773 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1581/3404] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:35:27 2022] GET /compute/v2.1/images/5c03b8cf-4b2d-476c-8831-4866eeff9434 => generated 1463 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:27.917601 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-55c5b57d-456d-458a-b7a8-64a3abe0e479 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:27.923989 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-55c5b57d-456d-458a-b7a8-64a3abe0e479 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] [instance: f50da5a9-2bb6-4735-93c3-d73ece0964f3] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:27.926782 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-55c5b57d-456d-458a-b7a8-64a3abe0e479 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:27.927505 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-55c5b57d-456d-458a-b7a8-64a3abe0e479 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:27.928031 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-55c5b57d-456d-458a-b7a8-64a3abe0e479 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:27.928888 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-55c5b57d-456d-458a-b7a8-64a3abe0e479 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:27.929430 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-55c5b57d-456d-458a-b7a8-64a3abe0e479 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:27.929934 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-55c5b57d-456d-458a-b7a8-64a3abe0e479 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:28.223626 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-55c5b57d-456d-458a-b7a8-64a3abe0e479 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae7845f6759c4dcabcc1516a72484174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d371ab6648425eac2cf1702f2789dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:28.235846 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-55c5b57d-456d-458a-b7a8-64a3abe0e479 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/servers/f50da5a9-2bb6-4735-93c3-d73ece0964f3" status: 200 len: 1467 microversion: 2.1 time: 0.324191 Oct 27 03:35:28.236795 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1582/3405] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:27 2022] GET /compute/v2.1/servers/f50da5a9-2bb6-4735-93c3-d73ece0964f3 => generated 1467 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:28.242942 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-93ba5c94-1293-4f79-8a19-4b5ba627da59 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:28.244293 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-93ba5c94-1293-4f79-8a19-4b5ba627da59 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] [instance: 8c8a2cbb-4acf-4a6b-b684-567617bb930d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:28.254134 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-93ba5c94-1293-4f79-8a19-4b5ba627da59 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:28.254919 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-93ba5c94-1293-4f79-8a19-4b5ba627da59 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:28.255571 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-93ba5c94-1293-4f79-8a19-4b5ba627da59 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:28.256661 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-93ba5c94-1293-4f79-8a19-4b5ba627da59 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:28.257777 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-93ba5c94-1293-4f79-8a19-4b5ba627da59 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:28.258575 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-93ba5c94-1293-4f79-8a19-4b5ba627da59 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:28.391076 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e638c231-bf67-430c-af40-c78e0b0fd63f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:28.400983 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e638c231-bf67-430c-af40-c78e0b0fd63f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1669 microversion: 2.1 time: 0.670518 Oct 27 03:35:28.416529 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1824/3406] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:27 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1669 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:28.424405 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-77d1f216-303d-4bdb-8e98-0c1af6ee8d2e tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-998030355"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:35:28.426954 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-77d1f216-303d-4bdb-8e98-0c1af6ee8d2e tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] [instance: 004575c6-51ce-48d9-b7a6-d50f9afdb0a0] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:28.450145 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-77d1f216-303d-4bdb-8e98-0c1af6ee8d2e tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:28.450842 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-77d1f216-303d-4bdb-8e98-0c1af6ee8d2e tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:28.451452 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-77d1f216-303d-4bdb-8e98-0c1af6ee8d2e tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:28.452933 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-77d1f216-303d-4bdb-8e98-0c1af6ee8d2e tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:28.453557 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-77d1f216-303d-4bdb-8e98-0c1af6ee8d2e tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:28.456725 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-77d1f216-303d-4bdb-8e98-0c1af6ee8d2e tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:28.540624 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-93ba5c94-1293-4f79-8a19-4b5ba627da59 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:28.556630 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-93ba5c94-1293-4f79-8a19-4b5ba627da59 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:28.558511 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-93ba5c94-1293-4f79-8a19-4b5ba627da59 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:28.560588 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-93ba5c94-1293-4f79-8a19-4b5ba627da59 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d" status: 200 len: 1890 microversion: 2.42 time: 0.322017 Oct 27 03:35:28.563741 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1583/3407] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:35:28 2022] GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d => generated 1890 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:35:28.567760 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-95f75bdf-bbe3-4b78-ab54-6fd34a88368f tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:28.568750 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-95f75bdf-bbe3-4b78-ab54-6fd34a88368f tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] [instance: 2410110f-fee8-4669-be8c-5137af8f074f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:28.576598 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-95f75bdf-bbe3-4b78-ab54-6fd34a88368f tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:28.577499 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-95f75bdf-bbe3-4b78-ab54-6fd34a88368f tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:28.578144 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-95f75bdf-bbe3-4b78-ab54-6fd34a88368f tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:28.579034 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-95f75bdf-bbe3-4b78-ab54-6fd34a88368f tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:28.580133 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-95f75bdf-bbe3-4b78-ab54-6fd34a88368f tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:28.580807 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-95f75bdf-bbe3-4b78-ab54-6fd34a88368f tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:28.751197 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-95f75bdf-bbe3-4b78-ab54-6fd34a88368f tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881f054c84d04ceaa17a5817816022d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2057593072c14804ab70fe4bdea2c17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:28.771882 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-95f75bdf-bbe3-4b78-ab54-6fd34a88368f tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] 10.222.0.20 "GET /compute/v2.1/servers/2410110f-fee8-4669-be8c-5137af8f074f" status: 200 len: 1334 microversion: 2.1 time: 0.207430 Oct 27 03:35:28.776190 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1584/3408] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:28 2022] GET /compute/v2.1/servers/2410110f-fee8-4669-be8c-5137af8f074f => generated 1334 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:28.785494 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-dbc56adf-8fff-4402-8055-652358575c5a tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:28.792703 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-dbc56adf-8fff-4402-8055-652358575c5a tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:28.803218 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dbc56adf-8fff-4402-8055-652358575c5a tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:28.804027 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dbc56adf-8fff-4402-8055-652358575c5a tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:28.804629 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dbc56adf-8fff-4402-8055-652358575c5a tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:28.821661 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dbc56adf-8fff-4402-8055-652358575c5a tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:28.822505 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dbc56adf-8fff-4402-8055-652358575c5a tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:28.823139 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dbc56adf-8fff-4402-8055-652358575c5a tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:29.039384 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-77d1f216-303d-4bdb-8e98-0c1af6ee8d2e tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "POST /compute/v2.1/servers/004575c6-51ce-48d9-b7a6-d50f9afdb0a0/action" status: 202 len: 0 microversion: 2.1 time: 0.620664 Oct 27 03:35:29.041878 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1825/3409] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:35:28 2022] POST /compute/v2.1/servers/004575c6-51ce-48d9-b7a6-d50f9afdb0a0/action => generated 0 bytes in 624 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 27 03:35:29.044638 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-dbc56adf-8fff-4402-8055-652358575c5a tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:29.051711 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5cddcfee-d233-4962-862b-c99fec155648 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:29.053463 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5cddcfee-d233-4962-862b-c99fec155648 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 35a0ac1a-379f-456e-a3d7-81f888daebbf] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:29.055721 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-dbc56adf-8fff-4402-8055-652358575c5a tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1669 microversion: 2.1 time: 0.277961 Oct 27 03:35:29.066936 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1585/3410] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:28 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1669 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:29.076001 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5cddcfee-d233-4962-862b-c99fec155648 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:29.076554 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5cddcfee-d233-4962-862b-c99fec155648 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:29.077973 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5cddcfee-d233-4962-862b-c99fec155648 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:29.080116 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5cddcfee-d233-4962-862b-c99fec155648 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:29.081512 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-723d135b-db19-456d-94fc-f9cfa239114d tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:29.085234 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5cddcfee-d233-4962-862b-c99fec155648 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:29.085234 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5cddcfee-d233-4962-862b-c99fec155648 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:29.086464 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-723d135b-db19-456d-94fc-f9cfa239114d tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] [instance: 09065cd4-8246-49ee-80fe-b4f1c11b468d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:29.094639 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-723d135b-db19-456d-94fc-f9cfa239114d tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:29.097938 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-723d135b-db19-456d-94fc-f9cfa239114d tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:29.098649 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-723d135b-db19-456d-94fc-f9cfa239114d tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:29.100811 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-723d135b-db19-456d-94fc-f9cfa239114d tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:29.101372 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-5cddcfee-d233-4962-862b-c99fec155648 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] HTTP exception thrown: Instance 35a0ac1a-379f-456e-a3d7-81f888daebbf could not be found. Oct 27 03:35:29.101641 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-723d135b-db19-456d-94fc-f9cfa239114d tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:29.103222 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-723d135b-db19-456d-94fc-f9cfa239114d tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:29.103375 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5cddcfee-d233-4962-862b-c99fec155648 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Request method failure captured: Oct 27 03:35:29.103375 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/35a0ac1a-379f-456e-a3d7-81f888daebbf HTTP/1.1 Oct 27 03:35:29.103375 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:35:29.103375 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:35:29.103375 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:35:29.103375 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:35:29.103375 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:35:29.103375 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:35:29.103375 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:35:29.103375 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:35:29.103375 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfxF6ut9nM9a9AcpKLO7IgCu-akAJ2YJGjrI9C8NUveA8uObV2XgQIQvsIxuWjvLl9meIEqpfGwZYr8MTX_PAGoiJsNUPXh5ERSce5cPYQYCCFPL0HtTb-E11C_2kfWy1wRps1tClRNvtj8zAqCGRhs1x-Uvl0zISdfHepXmvWX31Us Oct 27 03:35:29.103375 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:35:29.103375 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:35:29.103375 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:35:29.103375 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:35:29.103375 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:35:29.103375 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:35:29.103375 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 8bb5d291069d4329a90123e327fe9c59 Oct 27 03:35:29.103375 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:35:29.103375 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:35:29.103375 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:35:29.103375 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8bb5d291069d4329a90123e327fe9c59"}]}] Oct 27 03:35:29.103375 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:35:29.103375 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 8bb5d291069d4329a90123e327fe9c59 Oct 27 03:35:29.103375 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:35:29.103375 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServersNegativeTestJSON-4378389-project Oct 27 03:35:29.103375 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:35:29.103375 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:35:29.103375 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: f9c32b7626594ff888970c7f3227bb20 Oct 27 03:35:29.103375 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServersNegativeTestJSON-4378389-project Oct 27 03:35:29.103375 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:35:29.103375 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 35a0ac1a-379f-456e-a3d7-81f888daebbf could not be found. Oct 27 03:35:29.103375 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '35a0ac1a-379f-456e-a3d7-81f888daebbf'} Oct 27 03:35:29.103375 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:35:29.103375 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:35:29.103375 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:35:29.103375 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:35:29.103375 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:35:29.103375 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:35:29.103375 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:35:29.103375 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:35:29.103375 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:35:29.103375 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:35:29.103375 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35a0ac1a-379f-456e-a3d7-81f888daebbf could not be found. Oct 27 03:35:29.103375 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:35:29.103375 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:35:29.103375 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:35:29.103375 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:35:29.103375 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:35:29.103375 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:35:29.103375 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:35:29.103375 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:35:29.103375 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:35:29.103375 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:35:29.103375 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:35:29.103375 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:35:29.103375 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:35:29.103375 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:35:29.103375 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:35:29.103375 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:35:29.103375 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35a0ac1a-379f-456e-a3d7-81f888daebbf could not be found. Oct 27 03:35:29.103375 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:35:29.103375 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:35:29.103375 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:35:29.109347 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:35:29.109347 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:35:29.109347 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:35:29.109347 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:35:29.109347 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:35:29.109347 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35a0ac1a-379f-456e-a3d7-81f888daebbf could not be found. Oct 27 03:35:29.109347 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:35:29.109347 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5cddcfee-d233-4962-862b-c99fec155648 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Returning 404 to user: Instance 35a0ac1a-379f-456e-a3d7-81f888daebbf could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:35:29.109347 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5cddcfee-d233-4962-862b-c99fec155648 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/35a0ac1a-379f-456e-a3d7-81f888daebbf" status: 404 len: 111 microversion: 2.1 time: 0.061635 Oct 27 03:35:29.112539 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1826/3411] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:29 2022] GET /compute/v2.1/servers/35a0ac1a-379f-456e-a3d7-81f888daebbf => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:35:29.128073 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8cb8e708-54f8-4b89-bbd5-185ead281dbc tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7dd9fa19d0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:29.183810 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8cb8e708-54f8-4b89-bbd5-185ead281dbc tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images/42320033-6276-453e-b35d-504a52d80d70" status: 200 len: 1454 microversion: 2.1 time: 0.065347 Oct 27 03:35:29.192065 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1827/3412] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:35:29 2022] GET /compute/v2.1/images/42320033-6276-453e-b35d-504a52d80d70 => generated 1454 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:29.196583 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-723d135b-db19-456d-94fc-f9cfa239114d tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c36bef85ac34b4983a79e03c56965c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e58f30136ed4a4d9bff48e9b4cde5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:29.197026 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-009f94a4-99b9-452a-a44d-60903afb9f62 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:29.200764 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-009f94a4-99b9-452a-a44d-60903afb9f62 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:29.215919 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-723d135b-db19-456d-94fc-f9cfa239114d tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] 10.222.0.20 "GET /compute/v2.1/servers/09065cd4-8246-49ee-80fe-b4f1c11b468d" status: 200 len: 1275 microversion: 2.1 time: 0.147071 Oct 27 03:35:29.227913 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-009f94a4-99b9-452a-a44d-60903afb9f62 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:29.228664 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-009f94a4-99b9-452a-a44d-60903afb9f62 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:29.229251 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-009f94a4-99b9-452a-a44d-60903afb9f62 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:29.230354 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-009f94a4-99b9-452a-a44d-60903afb9f62 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:29.230958 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-009f94a4-99b9-452a-a44d-60903afb9f62 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:29.231544 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-009f94a4-99b9-452a-a44d-60903afb9f62 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:29.235053 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1586/3413] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:29 2022] GET /compute/v2.1/servers/09065cd4-8246-49ee-80fe-b4f1c11b468d => generated 1275 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:29.240370 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-db6ca5fc-8d27-43cf-bede-26676bbb2c2e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:29.241893 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-db6ca5fc-8d27-43cf-bede-26676bbb2c2e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:29.251187 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-db6ca5fc-8d27-43cf-bede-26676bbb2c2e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:29.252154 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-db6ca5fc-8d27-43cf-bede-26676bbb2c2e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:29.252849 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-db6ca5fc-8d27-43cf-bede-26676bbb2c2e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:29.253862 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-db6ca5fc-8d27-43cf-bede-26676bbb2c2e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:29.254570 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-db6ca5fc-8d27-43cf-bede-26676bbb2c2e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:29.255257 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-db6ca5fc-8d27-43cf-bede-26676bbb2c2e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:29.429580 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-db6ca5fc-8d27-43cf-bede-26676bbb2c2e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:29.438023 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-db6ca5fc-8d27-43cf-bede-26676bbb2c2e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1505 microversion: 2.1 time: 0.201414 Oct 27 03:35:29.439208 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1587/3414] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:29 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1505 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:29.444360 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-47fc1f87-0d65-4bef-bd97-6adee9dc0e49 req-a445a2a1-91a6-4d2e-9b4a-f593aa5f459e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c8a2cbb-4acf-4a6b-b684-567617bb930d", "tag": "05efbe65-e414-4934-8f17-a13f864d1dab"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:35:29.459423 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-47fc1f87-0d65-4bef-bd97-6adee9dc0e49 req-a445a2a1-91a6-4d2e-9b4a-f593aa5f459e service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:29.460153 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-47fc1f87-0d65-4bef-bd97-6adee9dc0e49 req-a445a2a1-91a6-4d2e-9b4a-f593aa5f459e service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:29.460744 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-47fc1f87-0d65-4bef-bd97-6adee9dc0e49 req-a445a2a1-91a6-4d2e-9b4a-f593aa5f459e service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:29.495561 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-47fc1f87-0d65-4bef-bd97-6adee9dc0e49 req-a445a2a1-91a6-4d2e-9b4a-f593aa5f459e service nova] Creating event network-changed:05efbe65-e414-4934-8f17-a13f864d1dab for instance 8c8a2cbb-4acf-4a6b-b684-567617bb930d on n-h2-862769-1 Oct 27 03:35:29.505147 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-47fc1f87-0d65-4bef-bd97-6adee9dc0e49 req-a445a2a1-91a6-4d2e-9b4a-f593aa5f459e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064517 Oct 27 03:35:29.509653 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1588/3415] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:35:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:35:29.596487 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3fc4f6e9-0a95-4400-be6a-5fe31c00a7b6 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": [{"uuid": "0f1ea857-e60a-4a6e-a6c9-70bfd2dd2db8"}]}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:35:29.601635 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3fc4f6e9-0a95-4400-be6a-5fe31c00a7b6 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Request method failure captured: Oct 27 03:35:29.601635 n-d-862769-1 devstack@n-api.service[121000]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 03:35:29.601635 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:35:29.601635 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:35:29.601635 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:35:29.601635 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 163 Oct 27 03:35:29.601635 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:35:29.601635 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:35:29.601635 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:35:29.601635 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:35:29.601635 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfxF6ut9nM9a9AcpKLO7IgCu-akAJ2YJGjrI9C8NUveA8uObV2XgQIQvsIxuWjvLl9meIEqpfGwZYr8MTX_PAGoiJsNUPXh5ERSce5cPYQYCCFPL0HtTb-E11C_2kfWy1wRps1tClRNvtj8zAqCGRhs1x-Uvl0zISdfHepXmvWX31Us Oct 27 03:35:29.601635 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:35:29.601635 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:35:29.601635 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:35:29.601635 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:35:29.601635 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:35:29.601635 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:35:29.601635 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 8bb5d291069d4329a90123e327fe9c59 Oct 27 03:35:29.601635 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:35:29.601635 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:35:29.601635 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:35:29.601635 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8bb5d291069d4329a90123e327fe9c59"}]}] Oct 27 03:35:29.601635 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:35:29.601635 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 8bb5d291069d4329a90123e327fe9c59 Oct 27 03:35:29.601635 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:35:29.601635 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ServersNegativeTestJSON-4378389-project Oct 27 03:35:29.601635 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:35:29.601635 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:35:29.601635 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: f9c32b7626594ff888970c7f3227bb20 Oct 27 03:35:29.601635 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ServersNegativeTestJSON-4378389-project Oct 27 03:35:29.601635 n-d-862769-1 devstack@n-api.service[121000]: Oct 27 03:35:29.601635 n-d-862769-1 devstack@n-api.service[121000]: {"server": {"name": 12345, "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": [{"uuid": "0f1ea857-e60a-4a6e-a6c9-70bfd2dd2db8"}]}} Oct 27 03:35:29.601635 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:35:29.601635 n-d-862769-1 devstack@n-api.service[121000]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 27 03:35:29.601635 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'body': {'server': {'name': 12345, 'imageRef': 'c40fb871-5877-4b59-ab69-d9fd23b7a917', 'flavorRef': '452', 'networks': [{'uuid': '0f1ea857-e60a-4a6e-a6c9-70bfd2dd2db8'}]}}} Oct 27 03:35:29.601635 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:35:29.601635 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:35:29.601635 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 03:35:29.601635 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 03:35:29.601635 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 03:35:29.601635 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise error Oct 27 03:35:29.601635 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Oct 27 03:35:29.601635 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:35:29.601635 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Oct 27 03:35:29.601635 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 27 03:35:29.601635 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:35:29.601635 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 27 03:35:29.601635 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi 12345 Oct 27 03:35:29.601635 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:35:29.601635 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:35:29.601635 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:35:29.601635 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:35:29.601635 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:35:29.601635 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:35:29.601635 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:35:29.601635 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:35:29.601635 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:35:29.601635 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:35:29.601635 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:35:29.601635 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:35:29.601635 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 03:35:29.601635 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 03:35:29.601635 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 03:35:29.601635 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 03:35:29.601635 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 03:35:29.609418 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 03:35:29.609418 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 27 03:35:29.609418 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:35:29.609418 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:35:29.609418 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:35:29.609418 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:35:29.609418 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:35:29.609418 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:35:29.609418 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 03:35:29.609418 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 03:35:29.609418 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 27 03:35:29.609418 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:35:29.613009 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3fc4f6e9-0a95-4400-be6a-5fe31c00a7b6 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:35:29.614808 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3fc4f6e9-0a95-4400-be6a-5fe31c00a7b6 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.025152 Oct 27 03:35:29.620715 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1589/3416] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:35:29 2022] POST /compute/v2.1/servers => generated 127 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 03:35:29.643872 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c5716366-35cc-47dd-afa9-a802ad31fce3 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:29.644702 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c5716366-35cc-47dd-afa9-a802ad31fce3 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] [instance: 8c8a2cbb-4acf-4a6b-b684-567617bb930d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:29.655721 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c5716366-35cc-47dd-afa9-a802ad31fce3 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:29.659803 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c5716366-35cc-47dd-afa9-a802ad31fce3 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:29.660804 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c5716366-35cc-47dd-afa9-a802ad31fce3 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:29.661586 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c5716366-35cc-47dd-afa9-a802ad31fce3 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:29.662170 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c5716366-35cc-47dd-afa9-a802ad31fce3 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:29.662639 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c5716366-35cc-47dd-afa9-a802ad31fce3 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:30.126540 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-009f94a4-99b9-452a-a44d-60903afb9f62 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:30.129515 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c5716366-35cc-47dd-afa9-a802ad31fce3 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:30.139923 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c5716366-35cc-47dd-afa9-a802ad31fce3 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:30.142601 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-009f94a4-99b9-452a-a44d-60903afb9f62 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1669 microversion: 2.1 time: 0.949110 Oct 27 03:35:30.160912 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1828/3417] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:29 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1669 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:30.164031 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c5716366-35cc-47dd-afa9-a802ad31fce3 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:30.167757 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c5716366-35cc-47dd-afa9-a802ad31fce3 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d" status: 200 len: 1878 microversion: 2.42 time: 0.544513 Oct 27 03:35:30.175214 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7475426f-3cd2-42f3-a45a-1a4817ada741 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:30.178817 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1590/3418] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:35:29 2022] GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d => generated 1878 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:35:30.183058 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7475426f-3cd2-42f3-a45a-1a4817ada741 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:30.184192 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9428ae3e-9084-418f-91cd-38aa2c441d35 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:30.185019 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9428ae3e-9084-418f-91cd-38aa2c441d35 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] [instance: 2410110f-fee8-4669-be8c-5137af8f074f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:30.196328 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9428ae3e-9084-418f-91cd-38aa2c441d35 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:30.202426 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9428ae3e-9084-418f-91cd-38aa2c441d35 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:30.203130 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9428ae3e-9084-418f-91cd-38aa2c441d35 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:30.203886 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9428ae3e-9084-418f-91cd-38aa2c441d35 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:30.204358 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9428ae3e-9084-418f-91cd-38aa2c441d35 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:30.204980 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9428ae3e-9084-418f-91cd-38aa2c441d35 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:30.212838 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7475426f-3cd2-42f3-a45a-1a4817ada741 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:30.214691 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7475426f-3cd2-42f3-a45a-1a4817ada741 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:30.219695 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7475426f-3cd2-42f3-a45a-1a4817ada741 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:30.219695 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7475426f-3cd2-42f3-a45a-1a4817ada741 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:30.219695 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7475426f-3cd2-42f3-a45a-1a4817ada741 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:30.219695 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7475426f-3cd2-42f3-a45a-1a4817ada741 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:30.509727 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9428ae3e-9084-418f-91cd-38aa2c441d35 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881f054c84d04ceaa17a5817816022d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2057593072c14804ab70fe4bdea2c17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:30.525320 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9428ae3e-9084-418f-91cd-38aa2c441d35 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] 10.222.0.20 "GET /compute/v2.1/servers/2410110f-fee8-4669-be8c-5137af8f074f" status: 200 len: 1334 microversion: 2.1 time: 0.344664 Oct 27 03:35:30.526423 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1591/3419] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:30 2022] GET /compute/v2.1/servers/2410110f-fee8-4669-be8c-5137af8f074f => generated 1334 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:30.543144 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-693fad2f-cbf6-4655-b5ed-95dba3039d48 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7dda03c940>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:30.618499 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-693fad2f-cbf6-4655-b5ed-95dba3039d48 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images/42320033-6276-453e-b35d-504a52d80d70" status: 200 len: 1454 microversion: 2.1 time: 0.088366 Oct 27 03:35:30.629042 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1592/3420] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:35:30 2022] GET /compute/v2.1/images/42320033-6276-453e-b35d-504a52d80d70 => generated 1454 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:30.636506 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3044ae9e-6b89-4d44-9656-8d2a7e97f48f tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:30.637814 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-3044ae9e-6b89-4d44-9656-8d2a7e97f48f tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] [instance: 09065cd4-8246-49ee-80fe-b4f1c11b468d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:30.652270 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3044ae9e-6b89-4d44-9656-8d2a7e97f48f tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:30.653367 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3044ae9e-6b89-4d44-9656-8d2a7e97f48f tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:30.654543 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3044ae9e-6b89-4d44-9656-8d2a7e97f48f tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:30.656812 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3044ae9e-6b89-4d44-9656-8d2a7e97f48f tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:30.657539 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3044ae9e-6b89-4d44-9656-8d2a7e97f48f tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:30.658634 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3044ae9e-6b89-4d44-9656-8d2a7e97f48f tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:30.797522 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7475426f-3cd2-42f3-a45a-1a4817ada741 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:30.811000 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-3044ae9e-6b89-4d44-9656-8d2a7e97f48f tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c36bef85ac34b4983a79e03c56965c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e58f30136ed4a4d9bff48e9b4cde5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:30.832854 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7475426f-3cd2-42f3-a45a-1a4817ada741 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1505 microversion: 2.1 time: 0.669020 Oct 27 03:35:30.847397 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3044ae9e-6b89-4d44-9656-8d2a7e97f48f tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] 10.222.0.20 "GET /compute/v2.1/servers/09065cd4-8246-49ee-80fe-b4f1c11b468d" status: 200 len: 1281 microversion: 2.1 time: 0.216643 Oct 27 03:35:30.847998 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1829/3421] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:30 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1505 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:30.858872 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1593/3422] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:30 2022] GET /compute/v2.1/servers/09065cd4-8246-49ee-80fe-b4f1c11b468d => generated 1281 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:30.864987 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ce40f1bd-7529-4fc4-a719-6659fd441b53 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:30.868236 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-ca11fb95-4d69-45e5-8088-39980d272431 req-7b75ca54-5168-483e-86a8-632de7ce84d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2410110f-fee8-4669-be8c-5137af8f074f", "name": "network-vif-plugged", "status": "completed", "tag": "988e6fdf-022d-4ca6-a640-5e81822be074"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:35:30.870439 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ce40f1bd-7529-4fc4-a719-6659fd441b53 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:30.923917 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ce40f1bd-7529-4fc4-a719-6659fd441b53 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:30.924476 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ce40f1bd-7529-4fc4-a719-6659fd441b53 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:30.926453 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-ca11fb95-4d69-45e5-8088-39980d272431 req-7b75ca54-5168-483e-86a8-632de7ce84d4 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:30.926862 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ce40f1bd-7529-4fc4-a719-6659fd441b53 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:30.927478 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-ca11fb95-4d69-45e5-8088-39980d272431 req-7b75ca54-5168-483e-86a8-632de7ce84d4 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:30.928113 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-ca11fb95-4d69-45e5-8088-39980d272431 req-7b75ca54-5168-483e-86a8-632de7ce84d4 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:30.929236 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ce40f1bd-7529-4fc4-a719-6659fd441b53 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:30.930046 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ce40f1bd-7529-4fc4-a719-6659fd441b53 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:30.930508 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ce40f1bd-7529-4fc4-a719-6659fd441b53 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:30.963778 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-ca11fb95-4d69-45e5-8088-39980d272431 req-7b75ca54-5168-483e-86a8-632de7ce84d4 service nova] Creating event network-vif-plugged:988e6fdf-022d-4ca6-a640-5e81822be074 for instance 2410110f-fee8-4669-be8c-5137af8f074f on n-h2-862769-1 Oct 27 03:35:30.977388 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-ca11fb95-4d69-45e5-8088-39980d272431 req-7b75ca54-5168-483e-86a8-632de7ce84d4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127792 Oct 27 03:35:30.978015 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1830/3423] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:35:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:35:31.210773 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-89c69812-3b76-4d9d-b772-a19210f9f6d6 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:31.211407 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-89c69812-3b76-4d9d-b772-a19210f9f6d6 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] [instance: 8c8a2cbb-4acf-4a6b-b684-567617bb930d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:31.224826 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-89c69812-3b76-4d9d-b772-a19210f9f6d6 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:31.225326 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-89c69812-3b76-4d9d-b772-a19210f9f6d6 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:31.227782 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-89c69812-3b76-4d9d-b772-a19210f9f6d6 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:31.227782 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-89c69812-3b76-4d9d-b772-a19210f9f6d6 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:31.227782 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-89c69812-3b76-4d9d-b772-a19210f9f6d6 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:31.227782 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-89c69812-3b76-4d9d-b772-a19210f9f6d6 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:31.549867 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ce40f1bd-7529-4fc4-a719-6659fd441b53 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:31.563674 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ce40f1bd-7529-4fc4-a719-6659fd441b53 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1505 microversion: 2.1 time: 0.703338 Oct 27 03:35:31.564286 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1594/3424] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:30 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1505 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:31.577439 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1933fc10-6524-4a87-b71e-bc76281e03d4 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:31.578502 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1933fc10-6524-4a87-b71e-bc76281e03d4 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] [instance: 2410110f-fee8-4669-be8c-5137af8f074f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:31.593465 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1933fc10-6524-4a87-b71e-bc76281e03d4 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:31.593465 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1933fc10-6524-4a87-b71e-bc76281e03d4 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:31.593465 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1933fc10-6524-4a87-b71e-bc76281e03d4 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:31.593465 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1933fc10-6524-4a87-b71e-bc76281e03d4 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:31.594099 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1933fc10-6524-4a87-b71e-bc76281e03d4 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:31.594099 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1933fc10-6524-4a87-b71e-bc76281e03d4 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:31.691065 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-89c69812-3b76-4d9d-b772-a19210f9f6d6 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:31.703092 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-89c69812-3b76-4d9d-b772-a19210f9f6d6 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:31.710865 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-89c69812-3b76-4d9d-b772-a19210f9f6d6 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:31.715299 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-89c69812-3b76-4d9d-b772-a19210f9f6d6 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d" status: 200 len: 1878 microversion: 2.42 time: 0.508544 Oct 27 03:35:31.717114 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1831/3425] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:35:31 2022] GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d => generated 1878 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:35:31.728566 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-066fcff7-6a94-4f83-bbf9-0c448272d617 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7dd9e29e50>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:31.805770 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-066fcff7-6a94-4f83-bbf9-0c448272d617 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images/42320033-6276-453e-b35d-504a52d80d70" status: 200 len: 1454 microversion: 2.1 time: 0.085930 Oct 27 03:35:31.814542 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1832/3426] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:35:31 2022] GET /compute/v2.1/images/42320033-6276-453e-b35d-504a52d80d70 => generated 1454 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:31.886935 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d1647d69-b788-4ed3-9b19-238745141c49 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:31.887944 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d1647d69-b788-4ed3-9b19-238745141c49 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] [instance: 09065cd4-8246-49ee-80fe-b4f1c11b468d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:31.903616 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d1647d69-b788-4ed3-9b19-238745141c49 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:31.904772 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d1647d69-b788-4ed3-9b19-238745141c49 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:31.909204 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d1647d69-b788-4ed3-9b19-238745141c49 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:31.912947 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d1647d69-b788-4ed3-9b19-238745141c49 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:31.916691 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d1647d69-b788-4ed3-9b19-238745141c49 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:31.917140 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1933fc10-6524-4a87-b71e-bc76281e03d4 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881f054c84d04ceaa17a5817816022d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2057593072c14804ab70fe4bdea2c17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:31.917759 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d1647d69-b788-4ed3-9b19-238745141c49 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:31.926113 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1933fc10-6524-4a87-b71e-bc76281e03d4 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] 10.222.0.20 "GET /compute/v2.1/servers/2410110f-fee8-4669-be8c-5137af8f074f" status: 200 len: 1334 microversion: 2.1 time: 0.360476 Oct 27 03:35:31.926938 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1595/3427] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:31 2022] GET /compute/v2.1/servers/2410110f-fee8-4669-be8c-5137af8f074f => generated 1334 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:32.077331 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d1647d69-b788-4ed3-9b19-238745141c49 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c36bef85ac34b4983a79e03c56965c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e58f30136ed4a4d9bff48e9b4cde5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:32.086959 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d1647d69-b788-4ed3-9b19-238745141c49 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] 10.222.0.20 "GET /compute/v2.1/servers/09065cd4-8246-49ee-80fe-b4f1c11b468d" status: 200 len: 1281 microversion: 2.1 time: 0.205769 Oct 27 03:35:32.088292 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1833/3428] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:31 2022] GET /compute/v2.1/servers/09065cd4-8246-49ee-80fe-b4f1c11b468d => generated 1281 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:35:32.508639 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-edc02471-8509-4ed9-a90c-7f9ae69b49a8 req-79883103-2802-4ce9-8ca7-a8d3704ce22d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c8a2cbb-4acf-4a6b-b684-567617bb930d", "tag": "2e9b0521-8b60-4153-8c0a-3a8fbe3a87fe"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:35:32.521926 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-edc02471-8509-4ed9-a90c-7f9ae69b49a8 req-79883103-2802-4ce9-8ca7-a8d3704ce22d service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:32.522990 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-edc02471-8509-4ed9-a90c-7f9ae69b49a8 req-79883103-2802-4ce9-8ca7-a8d3704ce22d service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:32.523626 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-edc02471-8509-4ed9-a90c-7f9ae69b49a8 req-79883103-2802-4ce9-8ca7-a8d3704ce22d service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:32.537803 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-edc02471-8509-4ed9-a90c-7f9ae69b49a8 req-79883103-2802-4ce9-8ca7-a8d3704ce22d service nova] Creating event network-changed:2e9b0521-8b60-4153-8c0a-3a8fbe3a87fe for instance 8c8a2cbb-4acf-4a6b-b684-567617bb930d on n-h2-862769-1 Oct 27 03:35:32.543782 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-edc02471-8509-4ed9-a90c-7f9ae69b49a8 req-79883103-2802-4ce9-8ca7-a8d3704ce22d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041858 Oct 27 03:35:32.548396 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1596/3429] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:35:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:35:32.744439 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5269e524-ae65-4c8a-bcbc-7b2fce654ebc tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:32.745037 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5269e524-ae65-4c8a-bcbc-7b2fce654ebc tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] [instance: 8c8a2cbb-4acf-4a6b-b684-567617bb930d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:32.758911 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5269e524-ae65-4c8a-bcbc-7b2fce654ebc tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:32.762649 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5269e524-ae65-4c8a-bcbc-7b2fce654ebc tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:32.768004 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5269e524-ae65-4c8a-bcbc-7b2fce654ebc tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:32.769453 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5269e524-ae65-4c8a-bcbc-7b2fce654ebc tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:32.772377 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5269e524-ae65-4c8a-bcbc-7b2fce654ebc tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:32.773018 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5269e524-ae65-4c8a-bcbc-7b2fce654ebc tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:32.824112 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f064bde4-6e07-4c56-9e41-63d738919580 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7dda960280>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:32.911413 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f064bde4-6e07-4c56-9e41-63d738919580 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images/42320033-6276-453e-b35d-504a52d80d70" status: 200 len: 1454 microversion: 2.1 time: 0.088701 Oct 27 03:35:32.911413 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1597/3430] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:35:32 2022] GET /compute/v2.1/images/42320033-6276-453e-b35d-504a52d80d70 => generated 1454 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:35:32.953427 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1e3e05fb-adb1-4ebd-8595-d0d1d70f7b12 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:32.954220 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1e3e05fb-adb1-4ebd-8595-d0d1d70f7b12 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] [instance: 2410110f-fee8-4669-be8c-5137af8f074f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:32.965896 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1e3e05fb-adb1-4ebd-8595-d0d1d70f7b12 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:32.979301 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1e3e05fb-adb1-4ebd-8595-d0d1d70f7b12 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:32.984420 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1e3e05fb-adb1-4ebd-8595-d0d1d70f7b12 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:32.984420 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1e3e05fb-adb1-4ebd-8595-d0d1d70f7b12 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:32.985133 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1e3e05fb-adb1-4ebd-8595-d0d1d70f7b12 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:32.985968 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1e3e05fb-adb1-4ebd-8595-d0d1d70f7b12 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:33.531136 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5269e524-ae65-4c8a-bcbc-7b2fce654ebc tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:33.566290 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5269e524-ae65-4c8a-bcbc-7b2fce654ebc tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:33.568302 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5269e524-ae65-4c8a-bcbc-7b2fce654ebc tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:33.569690 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5269e524-ae65-4c8a-bcbc-7b2fce654ebc tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d" status: 200 len: 1878 microversion: 2.42 time: 0.830355 Oct 27 03:35:33.574317 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1834/3431] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:35:32 2022] GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d => generated 1878 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:35:33.582639 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-d265823a-b3bf-49cf-9458-2e9a32417f59 req-7eb7933d-386e-4531-b264-9051555fe6a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f50da5a9-2bb6-4735-93c3-d73ece0964f3", "name": "network-vif-unplugged", "status": "completed", "tag": "271e155b-8765-4519-870e-105aa22f7ae9"}, {"server_uuid": "2410110f-fee8-4669-be8c-5137af8f074f", "name": "network-vif-plugged", "status": "completed", "tag": "80bf1ae1-da89-411d-b5d2-492e7e79f4c6"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:35:33.615354 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-d265823a-b3bf-49cf-9458-2e9a32417f59 req-7eb7933d-386e-4531-b264-9051555fe6a0 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:33.629488 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-d265823a-b3bf-49cf-9458-2e9a32417f59 req-7eb7933d-386e-4531-b264-9051555fe6a0 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:33.639603 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1e3e05fb-adb1-4ebd-8595-d0d1d70f7b12 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881f054c84d04ceaa17a5817816022d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2057593072c14804ab70fe4bdea2c17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:33.646584 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-d265823a-b3bf-49cf-9458-2e9a32417f59 req-7eb7933d-386e-4531-b264-9051555fe6a0 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:33.648316 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1e3e05fb-adb1-4ebd-8595-d0d1d70f7b12 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] 10.222.0.20 "GET /compute/v2.1/servers/2410110f-fee8-4669-be8c-5137af8f074f" status: 200 len: 1334 microversion: 2.1 time: 0.703064 Oct 27 03:35:33.674290 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1598/3432] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:32 2022] GET /compute/v2.1/servers/2410110f-fee8-4669-be8c-5137af8f074f => generated 1334 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:33.698567 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f77eaa9d-239b-4bf2-8f35-a0f825b6eb88 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:33.699805 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f77eaa9d-239b-4bf2-8f35-a0f825b6eb88 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] [instance: 09065cd4-8246-49ee-80fe-b4f1c11b468d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:33.712313 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-d265823a-b3bf-49cf-9458-2e9a32417f59 req-7eb7933d-386e-4531-b264-9051555fe6a0 service nova] Creating event network-vif-unplugged:271e155b-8765-4519-870e-105aa22f7ae9 for instance f50da5a9-2bb6-4735-93c3-d73ece0964f3 on n-h1-862769-1 Oct 27 03:35:33.715448 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-d265823a-b3bf-49cf-9458-2e9a32417f59 req-7eb7933d-386e-4531-b264-9051555fe6a0 service nova] Creating event network-vif-plugged:80bf1ae1-da89-411d-b5d2-492e7e79f4c6 for instance 2410110f-fee8-4669-be8c-5137af8f074f on n-h2-862769-1 Oct 27 03:35:33.717028 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f77eaa9d-239b-4bf2-8f35-a0f825b6eb88 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:33.718989 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f77eaa9d-239b-4bf2-8f35-a0f825b6eb88 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:33.721869 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f77eaa9d-239b-4bf2-8f35-a0f825b6eb88 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:33.723367 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f77eaa9d-239b-4bf2-8f35-a0f825b6eb88 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:33.727183 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f77eaa9d-239b-4bf2-8f35-a0f825b6eb88 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:33.727913 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f77eaa9d-239b-4bf2-8f35-a0f825b6eb88 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:33.743696 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-d265823a-b3bf-49cf-9458-2e9a32417f59 req-7eb7933d-386e-4531-b264-9051555fe6a0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.161623 Oct 27 03:35:33.746132 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1835/3433] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:35:33 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:35:33.928068 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-67415695-f67a-4f36-a511-dfda5e3099d1 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7dd9f6c670>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:34.005377 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-67415695-f67a-4f36-a511-dfda5e3099d1 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images/42320033-6276-453e-b35d-504a52d80d70" status: 200 len: 1454 microversion: 2.1 time: 0.083063 Oct 27 03:35:34.013639 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1836/3434] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:35:33 2022] GET /compute/v2.1/images/42320033-6276-453e-b35d-504a52d80d70 => generated 1454 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:34.549592 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f77eaa9d-239b-4bf2-8f35-a0f825b6eb88 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c36bef85ac34b4983a79e03c56965c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e58f30136ed4a4d9bff48e9b4cde5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:34.565691 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f77eaa9d-239b-4bf2-8f35-a0f825b6eb88 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] 10.222.0.20 "GET /compute/v2.1/servers/09065cd4-8246-49ee-80fe-b4f1c11b468d" status: 200 len: 1323 microversion: 2.1 time: 0.887122 Oct 27 03:35:34.565691 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1599/3435] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:33 2022] GET /compute/v2.1/servers/09065cd4-8246-49ee-80fe-b4f1c11b468d => generated 1323 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:34.602606 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a8f76e49-2b31-48b9-9150-d8d43ac1ee65 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:34.603421 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a8f76e49-2b31-48b9-9150-d8d43ac1ee65 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] [instance: 8c8a2cbb-4acf-4a6b-b684-567617bb930d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:34.622447 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a8f76e49-2b31-48b9-9150-d8d43ac1ee65 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:34.622939 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a8f76e49-2b31-48b9-9150-d8d43ac1ee65 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:34.624409 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a8f76e49-2b31-48b9-9150-d8d43ac1ee65 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:34.624686 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a8f76e49-2b31-48b9-9150-d8d43ac1ee65 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:34.625131 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a8f76e49-2b31-48b9-9150-d8d43ac1ee65 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:34.625560 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a8f76e49-2b31-48b9-9150-d8d43ac1ee65 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:34.688125 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e18bb330-cb1a-4701-90f0-5c809c4de099 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:34.688822 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e18bb330-cb1a-4701-90f0-5c809c4de099 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] [instance: 2410110f-fee8-4669-be8c-5137af8f074f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:34.699016 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e18bb330-cb1a-4701-90f0-5c809c4de099 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:34.699016 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e18bb330-cb1a-4701-90f0-5c809c4de099 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:34.699016 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e18bb330-cb1a-4701-90f0-5c809c4de099 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:34.699016 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e18bb330-cb1a-4701-90f0-5c809c4de099 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:34.699016 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e18bb330-cb1a-4701-90f0-5c809c4de099 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:34.699016 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e18bb330-cb1a-4701-90f0-5c809c4de099 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:35.343814 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e18bb330-cb1a-4701-90f0-5c809c4de099 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881f054c84d04ceaa17a5817816022d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2057593072c14804ab70fe4bdea2c17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:35.348959 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=100 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:35:35.357448 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e18bb330-cb1a-4701-90f0-5c809c4de099 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] 10.222.0.20 "GET /compute/v2.1/servers/2410110f-fee8-4669-be8c-5137af8f074f" status: 200 len: 1334 microversion: 2.1 time: 0.679055 Oct 27 03:35:35.371474 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1600/3436] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:34 2022] GET /compute/v2.1/servers/2410110f-fee8-4669-be8c-5137af8f074f => generated 1334 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:35:35.376735 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-09a40f64-be7b-4969-a9b3-c7cc4b18fc02 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7ddabcf310>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:35.497393 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a8f76e49-2b31-48b9-9150-d8d43ac1ee65 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:35.502859 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:35:35.512677 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-09a40f64-be7b-4969-a9b3-c7cc4b18fc02 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images/42320033-6276-453e-b35d-504a52d80d70" status: 200 len: 1454 microversion: 2.1 time: 0.138707 Oct 27 03:35:35.521036 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1601/3437] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:35:35 2022] GET /compute/v2.1/images/42320033-6276-453e-b35d-504a52d80d70 => generated 1454 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:35.539105 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a8f76e49-2b31-48b9-9150-d8d43ac1ee65 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:35.541333 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a8f76e49-2b31-48b9-9150-d8d43ac1ee65 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:35.542778 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a8f76e49-2b31-48b9-9150-d8d43ac1ee65 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d" status: 200 len: 1878 microversion: 2.42 time: 0.944102 Oct 27 03:35:35.544056 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1837/3438] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:35:34 2022] GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d => generated 1878 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:35:35.609625 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3cb6fe6e-4f33-497a-92d0-e7d85436ee77 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:35.612879 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-3cb6fe6e-4f33-497a-92d0-e7d85436ee77 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] [instance: 09065cd4-8246-49ee-80fe-b4f1c11b468d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:35.655875 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3cb6fe6e-4f33-497a-92d0-e7d85436ee77 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:35.658543 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3cb6fe6e-4f33-497a-92d0-e7d85436ee77 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:35.659951 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3cb6fe6e-4f33-497a-92d0-e7d85436ee77 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:35.662356 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3cb6fe6e-4f33-497a-92d0-e7d85436ee77 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:35.663455 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3cb6fe6e-4f33-497a-92d0-e7d85436ee77 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:35.664136 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3cb6fe6e-4f33-497a-92d0-e7d85436ee77 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:35.770126 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-84d2eb1d-41b2-4a20-8ebe-fbcf4a048591 req-a645a3b8-31f4-4ab0-b5dc-332d800458db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "004575c6-51ce-48d9-b7a6-d50f9afdb0a0", "name": "network-vif-plugged", "status": "completed", "tag": "5deebc19-88cc-4f7e-98b2-66507a85ce83"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:35:35.786109 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:35:35.793620 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-84d2eb1d-41b2-4a20-8ebe-fbcf4a048591 req-a645a3b8-31f4-4ab0-b5dc-332d800458db service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:35.794371 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-84d2eb1d-41b2-4a20-8ebe-fbcf4a048591 req-a645a3b8-31f4-4ab0-b5dc-332d800458db service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:35.794926 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-84d2eb1d-41b2-4a20-8ebe-fbcf4a048591 req-a645a3b8-31f4-4ab0-b5dc-332d800458db service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:35.825587 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-84d2eb1d-41b2-4a20-8ebe-fbcf4a048591 req-a645a3b8-31f4-4ab0-b5dc-332d800458db service nova] Creating event network-vif-plugged:5deebc19-88cc-4f7e-98b2-66507a85ce83 for instance 004575c6-51ce-48d9-b7a6-d50f9afdb0a0 on n-h1-862769-1 Oct 27 03:35:35.836228 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-84d2eb1d-41b2-4a20-8ebe-fbcf4a048591 req-a645a3b8-31f4-4ab0-b5dc-332d800458db service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071992 Oct 27 03:35:35.841813 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1838/3439] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:35:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:35:36.100146 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=6 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:35:36.106996 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-617bca25-5ca4-478b-a335-0d6ca6533c2f req-bf4967ec-f697-4937-afc1-cb69bbdffd95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09065cd4-8246-49ee-80fe-b4f1c11b468d", "tag": "ab56b8a0-7a58-4598-868b-6205446a5b4c"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:35:36.137256 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-617bca25-5ca4-478b-a335-0d6ca6533c2f req-bf4967ec-f697-4937-afc1-cb69bbdffd95 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:36.156350 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-617bca25-5ca4-478b-a335-0d6ca6533c2f req-bf4967ec-f697-4937-afc1-cb69bbdffd95 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:36.158086 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-617bca25-5ca4-478b-a335-0d6ca6533c2f req-bf4967ec-f697-4937-afc1-cb69bbdffd95 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:36.209187 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-617bca25-5ca4-478b-a335-0d6ca6533c2f req-bf4967ec-f697-4937-afc1-cb69bbdffd95 service nova] Creating event network-changed:ab56b8a0-7a58-4598-868b-6205446a5b4c for instance 09065cd4-8246-49ee-80fe-b4f1c11b468d on n-h1-862769-1 Oct 27 03:35:36.224681 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-617bca25-5ca4-478b-a335-0d6ca6533c2f req-bf4967ec-f697-4937-afc1-cb69bbdffd95 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125203 Oct 27 03:35:36.230794 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1839/3440] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:35:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:35:36.290941 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-3cb6fe6e-4f33-497a-92d0-e7d85436ee77 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c36bef85ac34b4983a79e03c56965c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e58f30136ed4a4d9bff48e9b4cde5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:36.300101 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3cb6fe6e-4f33-497a-92d0-e7d85436ee77 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] 10.222.0.20 "GET /compute/v2.1/servers/09065cd4-8246-49ee-80fe-b4f1c11b468d" status: 200 len: 1323 microversion: 2.1 time: 0.712674 Oct 27 03:35:36.314877 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1602/3441] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:35 2022] GET /compute/v2.1/servers/09065cd4-8246-49ee-80fe-b4f1c11b468d => generated 1323 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:36.388718 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c27783b3-3b82-4782-86ed-ebf2db2e0b42 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:36.389644 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c27783b3-3b82-4782-86ed-ebf2db2e0b42 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] [instance: 2410110f-fee8-4669-be8c-5137af8f074f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:36.410205 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c27783b3-3b82-4782-86ed-ebf2db2e0b42 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:36.418297 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c27783b3-3b82-4782-86ed-ebf2db2e0b42 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:36.419626 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c27783b3-3b82-4782-86ed-ebf2db2e0b42 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:36.421181 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c27783b3-3b82-4782-86ed-ebf2db2e0b42 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:36.421896 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c27783b3-3b82-4782-86ed-ebf2db2e0b42 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:36.422829 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c27783b3-3b82-4782-86ed-ebf2db2e0b42 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:36.538338 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1b2b1e7a-43a5-458d-8ecf-ad284b6fe8fa tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7ddade8a60>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:36.666399 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1b2b1e7a-43a5-458d-8ecf-ad284b6fe8fa tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images/42320033-6276-453e-b35d-504a52d80d70" status: 200 len: 1454 microversion: 2.1 time: 0.133522 Oct 27 03:35:36.678165 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1603/3442] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:35:36 2022] GET /compute/v2.1/images/42320033-6276-453e-b35d-504a52d80d70 => generated 1454 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:36.694092 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1fcf794c-3520-49c8-82e2-f05705aa6fde tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:36.698904 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1fcf794c-3520-49c8-82e2-f05705aa6fde tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] [instance: 8c8a2cbb-4acf-4a6b-b684-567617bb930d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:36.719729 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1fcf794c-3520-49c8-82e2-f05705aa6fde tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:36.723873 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1fcf794c-3520-49c8-82e2-f05705aa6fde tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:36.724250 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1fcf794c-3520-49c8-82e2-f05705aa6fde tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:36.725194 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1fcf794c-3520-49c8-82e2-f05705aa6fde tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:36.725820 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1fcf794c-3520-49c8-82e2-f05705aa6fde tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:36.728466 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1fcf794c-3520-49c8-82e2-f05705aa6fde tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:37.055185 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c27783b3-3b82-4782-86ed-ebf2db2e0b42 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881f054c84d04ceaa17a5817816022d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2057593072c14804ab70fe4bdea2c17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:37.067743 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c27783b3-3b82-4782-86ed-ebf2db2e0b42 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] 10.222.0.20 "GET /compute/v2.1/servers/2410110f-fee8-4669-be8c-5137af8f074f" status: 200 len: 1668 microversion: 2.1 time: 0.683335 Oct 27 03:35:37.068342 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1840/3443] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:36 2022] GET /compute/v2.1/servers/2410110f-fee8-4669-be8c-5137af8f074f => generated 1668 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:37.082759 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-8257ff7e-4d04-4966-a816-900ef60a2e90 req-6accb2a3-1613-4e32-8e09-eb4d57ddf260 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c8a2cbb-4acf-4a6b-b684-567617bb930d", "tag": "be4d3f04-e26e-4f91-8a8f-ac908acaa7cc"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:35:37.112953 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-8257ff7e-4d04-4966-a816-900ef60a2e90 req-6accb2a3-1613-4e32-8e09-eb4d57ddf260 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:37.113808 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-8257ff7e-4d04-4966-a816-900ef60a2e90 req-6accb2a3-1613-4e32-8e09-eb4d57ddf260 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:37.114478 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-8257ff7e-4d04-4966-a816-900ef60a2e90 req-6accb2a3-1613-4e32-8e09-eb4d57ddf260 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:37.145522 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-8257ff7e-4d04-4966-a816-900ef60a2e90 req-6accb2a3-1613-4e32-8e09-eb4d57ddf260 service nova] Creating event network-changed:be4d3f04-e26e-4f91-8a8f-ac908acaa7cc for instance 8c8a2cbb-4acf-4a6b-b684-567617bb930d on n-h2-862769-1 Oct 27 03:35:37.151002 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-8257ff7e-4d04-4966-a816-900ef60a2e90 req-6accb2a3-1613-4e32-8e09-eb4d57ddf260 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081475 Oct 27 03:35:37.152442 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1841/3444] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:35:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:35:37.169739 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5ef57747-6333-477a-a5cc-1e9686c79cb6 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2014963628", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "b085e1df-3891-411e-8965-e9ecb41ac5a4", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "0f1ea857-e60a-4a6e-a6c9-70bfd2dd2db8"}]}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:35:37.381725 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-5ef57747-6333-477a-a5cc-1e9686c79cb6 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] HTTP exception thrown: Block Device b085e1df-3891-411e-8965-e9ecb41ac5a4 is not bootable. Oct 27 03:35:37.396446 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5ef57747-6333-477a-a5cc-1e9686c79cb6 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Request method failure captured: Oct 27 03:35:37.396446 n-d-862769-1 devstack@n-api.service[121001]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 03:35:37.396446 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:35:37.396446 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:35:37.396446 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:35:37.396446 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 358 Oct 27 03:35:37.396446 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:35:37.396446 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:35:37.396446 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:35:37.396446 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:35:37.396446 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfxF6ut9nM9a9AcpKLO7IgCu-akAJ2YJGjrI9C8NUveA8uObV2XgQIQvsIxuWjvLl9meIEqpfGwZYr8MTX_PAGoiJsNUPXh5ERSce5cPYQYCCFPL0HtTb-E11C_2kfWy1wRps1tClRNvtj8zAqCGRhs1x-Uvl0zISdfHepXmvWX31Us Oct 27 03:35:37.396446 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:35:37.396446 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:35:37.396446 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:35:37.396446 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:35:37.396446 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:35:37.396446 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:35:37.396446 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 8bb5d291069d4329a90123e327fe9c59 Oct 27 03:35:37.396446 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:35:37.396446 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:35:37.396446 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:35:37.396446 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8bb5d291069d4329a90123e327fe9c59"}]}] Oct 27 03:35:37.396446 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:35:37.396446 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 8bb5d291069d4329a90123e327fe9c59 Oct 27 03:35:37.396446 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:35:37.396446 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServersNegativeTestJSON-4378389-project Oct 27 03:35:37.396446 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:35:37.396446 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:35:37.396446 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: f9c32b7626594ff888970c7f3227bb20 Oct 27 03:35:37.396446 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServersNegativeTestJSON-4378389-project Oct 27 03:35:37.396446 n-d-862769-1 devstack@n-api.service[121001]: Oct 27 03:35:37.396446 n-d-862769-1 devstack@n-api.service[121001]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2014963628", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "b085e1df-3891-411e-8965-e9ecb41ac5a4", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "0f1ea857-e60a-4a6e-a6c9-70bfd2dd2db8"}]}} Oct 27 03:35:37.396446 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:35:37.396446 n-d-862769-1 devstack@n-api.service[121001]: exception: Block Device b085e1df-3891-411e-8965-e9ecb41ac5a4 is not bootable. Oct 27 03:35:37.396446 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2014963628', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': 'b085e1df-3891-411e-8965-e9ecb41ac5a4'}], 'networks': [{'uuid': '0f1ea857-e60a-4a6e-a6c9-70bfd2dd2db8'}]}}} Oct 27 03:35:37.396446 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:35:37.396446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:35:37.396446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 27 03:35:37.396446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 27 03:35:37.396446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 27 03:35:37.396446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 27 03:35:37.396446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Oct 27 03:35:37.396446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Oct 27 03:35:37.396446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Oct 27 03:35:37.396446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Oct 27 03:35:37.396446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device b085e1df-3891-411e-8965-e9ecb41ac5a4 is not bootable. Oct 27 03:35:37.396446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:35:37.396446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:35:37.396446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:35:37.396446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:35:37.396446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:35:37.396446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:35:37.396446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:35:37.396446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:35:37.396446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:35:37.396446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:35:37.396446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:35:37.396446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:35:37.396446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:35:37.404385 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:35:37.404385 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:35:37.404385 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:35:37.404385 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 27 03:35:37.404385 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 27 03:35:37.404385 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 27 03:35:37.404385 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device b085e1df-3891-411e-8965-e9ecb41ac5a4 is not bootable. Oct 27 03:35:37.404385 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:35:37.404385 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:35:37.404385 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:35:37.404385 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:35:37.404385 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:35:37.404385 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:35:37.404385 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:35:37.404385 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:35:37.404385 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device b085e1df-3891-411e-8965-e9ecb41ac5a4 is not bootable. Oct 27 03:35:37.404385 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:35:37.404385 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5ef57747-6333-477a-a5cc-1e9686c79cb6 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Returning 400 to user: Block Device b085e1df-3891-411e-8965-e9ecb41ac5a4 is not bootable. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:35:37.405784 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1fcf794c-3520-49c8-82e2-f05705aa6fde tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:37.407226 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5ef57747-6333-477a-a5cc-1e9686c79cb6 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.247589 Oct 27 03:35:37.407226 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1842/3445] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:35:37 2022] POST /compute/v2.1/servers => generated 110 bytes in 254 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 03:35:37.426119 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1fcf794c-3520-49c8-82e2-f05705aa6fde tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:37.429220 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1fcf794c-3520-49c8-82e2-f05705aa6fde tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:37.432028 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1fcf794c-3520-49c8-82e2-f05705aa6fde tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d" status: 200 len: 1878 microversion: 2.42 time: 0.752532 Oct 27 03:35:37.434630 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1604/3446] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:35:36 2022] GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d => generated 1878 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:35:37.441225 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2a8ebd4a-1774-46c3-8f19-c9b7c7ac51ae tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:37.443376 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2a8ebd4a-1774-46c3-8f19-c9b7c7ac51ae tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] [instance: 2410110f-fee8-4669-be8c-5137af8f074f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:37.446220 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1c14797d-2ea9-497c-9d48-f2df1f4e09ff tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:37.450905 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2a8ebd4a-1774-46c3-8f19-c9b7c7ac51ae tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:37.451533 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1c14797d-2ea9-497c-9d48-f2df1f4e09ff tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] [instance: 09065cd4-8246-49ee-80fe-b4f1c11b468d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:37.452449 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2a8ebd4a-1774-46c3-8f19-c9b7c7ac51ae tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:37.453092 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2a8ebd4a-1774-46c3-8f19-c9b7c7ac51ae tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:37.454013 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2a8ebd4a-1774-46c3-8f19-c9b7c7ac51ae tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:37.454788 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2a8ebd4a-1774-46c3-8f19-c9b7c7ac51ae tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:37.455420 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2a8ebd4a-1774-46c3-8f19-c9b7c7ac51ae tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:37.467820 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1c14797d-2ea9-497c-9d48-f2df1f4e09ff tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:37.468531 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1c14797d-2ea9-497c-9d48-f2df1f4e09ff tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:37.471722 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1c14797d-2ea9-497c-9d48-f2df1f4e09ff tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:37.472806 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1c14797d-2ea9-497c-9d48-f2df1f4e09ff tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:37.473452 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1c14797d-2ea9-497c-9d48-f2df1f4e09ff tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:37.476222 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1c14797d-2ea9-497c-9d48-f2df1f4e09ff tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:37.517044 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2a8ebd4a-1774-46c3-8f19-c9b7c7ac51ae tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] 10.222.0.20 "GET /compute/v2.1/servers/2410110f-fee8-4669-be8c-5137af8f074f/ips" status: 200 len: 178 microversion: 2.1 time: 0.100629 Oct 27 03:35:37.526136 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1843/3447] 10.222.0.20 () {58 vars in 1248 bytes} [Thu Oct 27 03:35:37 2022] GET /compute/v2.1/servers/2410110f-fee8-4669-be8c-5137af8f074f/ips => generated 178 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:35:37.535519 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-946b3abd-aaa3-4186-891c-9b7259f8cdbb tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:37.538660 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-946b3abd-aaa3-4186-891c-9b7259f8cdbb tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:37.560161 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-946b3abd-aaa3-4186-891c-9b7259f8cdbb tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:37.567310 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-946b3abd-aaa3-4186-891c-9b7259f8cdbb tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:37.568088 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-946b3abd-aaa3-4186-891c-9b7259f8cdbb tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:37.572048 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-946b3abd-aaa3-4186-891c-9b7259f8cdbb tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:37.576409 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-946b3abd-aaa3-4186-891c-9b7259f8cdbb tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:37.577106 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-946b3abd-aaa3-4186-891c-9b7259f8cdbb tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:37.802374 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=4 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:35:38.005704 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1c14797d-2ea9-497c-9d48-f2df1f4e09ff tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c36bef85ac34b4983a79e03c56965c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e58f30136ed4a4d9bff48e9b4cde5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:38.021139 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1c14797d-2ea9-497c-9d48-f2df1f4e09ff tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] 10.222.0.20 "GET /compute/v2.1/servers/09065cd4-8246-49ee-80fe-b4f1c11b468d" status: 200 len: 1323 microversion: 2.1 time: 0.577271 Oct 27 03:35:38.040353 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1605/3448] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:37 2022] GET /compute/v2.1/servers/09065cd4-8246-49ee-80fe-b4f1c11b468d => generated 1323 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:38.054323 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c2e84f12-6bd6-475c-b453-4f418650d497 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:38.054916 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c2e84f12-6bd6-475c-b453-4f418650d497 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] [instance: 2410110f-fee8-4669-be8c-5137af8f074f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:38.067089 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c2e84f12-6bd6-475c-b453-4f418650d497 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:38.081262 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c2e84f12-6bd6-475c-b453-4f418650d497 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:38.081262 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c2e84f12-6bd6-475c-b453-4f418650d497 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:38.081262 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c2e84f12-6bd6-475c-b453-4f418650d497 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:38.081262 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c2e84f12-6bd6-475c-b453-4f418650d497 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:38.081262 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c2e84f12-6bd6-475c-b453-4f418650d497 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:38.126431 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c2e84f12-6bd6-475c-b453-4f418650d497 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] [instance: 2410110f-fee8-4669-be8c-5137af8f074f] Going to try to terminate instance {{(pid=121000) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:35:38.366715 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-946b3abd-aaa3-4186-891c-9b7259f8cdbb tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:38.375558 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-946b3abd-aaa3-4186-891c-9b7259f8cdbb tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1505 microversion: 2.1 time: 0.845926 Oct 27 03:35:38.379745 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1844/3449] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:37 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1505 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:38.391639 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ca962409-834f-43f5-902b-be375f593484 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7dd9fa14c0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:38.454957 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ca962409-834f-43f5-902b-be375f593484 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images/42320033-6276-453e-b35d-504a52d80d70" status: 200 len: 1454 microversion: 2.1 time: 0.073167 Oct 27 03:35:38.456235 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1845/3450] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:35:38 2022] GET /compute/v2.1/images/42320033-6276-453e-b35d-504a52d80d70 => generated 1454 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:38.591610 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c2e84f12-6bd6-475c-b453-4f418650d497 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2410110f-fee8-4669-be8c-5137af8f074f" status: 204 len: 0 microversion: 2.1 time: 0.555870 Oct 27 03:35:38.593118 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1606/3451] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:35:38 2022] DELETE /compute/v2.1/servers/2410110f-fee8-4669-be8c-5137af8f074f => generated 0 bytes in 558 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:35:38.603101 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b4a1a7f5-52c9-4f0c-85e4-cbfd546b5907 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:38.603101 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b4a1a7f5-52c9-4f0c-85e4-cbfd546b5907 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:38.613065 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5a81cedc-f30b-4c4d-85d8-5e5621dbf0a9 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Action: 'create', calling method: .version_select at 0x7f7dd9f6c8b0>, body: {"keypair": {"name": "tempest-keypair-1529526182", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHskivCcS0knHWFqYr6YFY9FxKERdx2x2ftD9NCowdzqPSpStNdG286iS5YmSKdC8TpkZ8L/HQWY+IknbYRPhVTOfo6GwgK1e34DqSdlXsJsxztAVipaIK1n/0nDsk6w5g=="}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:35:38.636724 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b4a1a7f5-52c9-4f0c-85e4-cbfd546b5907 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:38.637197 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-5a81cedc-f30b-4c4d-85d8-5e5621dbf0a9 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Getting quotas for project e3a1ba64cf9c47d5bdae52477338099e. Resources: {'key_pairs'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:35:38.637403 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b4a1a7f5-52c9-4f0c-85e4-cbfd546b5907 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:38.638065 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b4a1a7f5-52c9-4f0c-85e4-cbfd546b5907 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:38.639019 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b4a1a7f5-52c9-4f0c-85e4-cbfd546b5907 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:38.640711 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b4a1a7f5-52c9-4f0c-85e4-cbfd546b5907 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:38.641275 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b4a1a7f5-52c9-4f0c-85e4-cbfd546b5907 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:38.644715 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-5a81cedc-f30b-4c4d-85d8-5e5621dbf0a9 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Getting quotas for user 8d5d3f1bf1af4cd6884297b207597fcc and project e3a1ba64cf9c47d5bdae52477338099e. Resources: {'key_pairs'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:35:38.766583 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5a81cedc-f30b-4c4d-85d8-5e5621dbf0a9 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.308922 Oct 27 03:35:38.767690 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1846/3452] 10.222.0.20 () {60 vars in 1159 bytes} [Thu Oct 27 03:35:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:35:38.773663 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-cddc149a-a57a-4f92-8d35-2cb42a1c4133 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:38.778097 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-cddc149a-a57a-4f92-8d35-2cb42a1c4133 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] [instance: 8c8a2cbb-4acf-4a6b-b684-567617bb930d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:38.802186 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cddc149a-a57a-4f92-8d35-2cb42a1c4133 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:38.806597 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cddc149a-a57a-4f92-8d35-2cb42a1c4133 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:38.807324 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cddc149a-a57a-4f92-8d35-2cb42a1c4133 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:38.809597 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cddc149a-a57a-4f92-8d35-2cb42a1c4133 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:38.810330 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cddc149a-a57a-4f92-8d35-2cb42a1c4133 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:38.815135 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cddc149a-a57a-4f92-8d35-2cb42a1c4133 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:39.567871 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b4a1a7f5-52c9-4f0c-85e4-cbfd546b5907 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:39.585963 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b4a1a7f5-52c9-4f0c-85e4-cbfd546b5907 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1505 microversion: 2.1 time: 0.991389 Oct 27 03:35:39.592056 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1607/3453] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:38 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1505 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:39.614280 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ee251a5c-de81-404c-b38f-75152875a4ba tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:39.616110 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ee251a5c-de81-404c-b38f-75152875a4ba tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] [instance: 2410110f-fee8-4669-be8c-5137af8f074f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:39.636016 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ee251a5c-de81-404c-b38f-75152875a4ba tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:39.636525 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ee251a5c-de81-404c-b38f-75152875a4ba tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:39.636974 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ee251a5c-de81-404c-b38f-75152875a4ba tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:39.637706 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ee251a5c-de81-404c-b38f-75152875a4ba tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:39.644120 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ee251a5c-de81-404c-b38f-75152875a4ba tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:39.644659 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ee251a5c-de81-404c-b38f-75152875a4ba tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:39.695026 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-cddc149a-a57a-4f92-8d35-2cb42a1c4133 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:39.720906 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-cddc149a-a57a-4f92-8d35-2cb42a1c4133 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:39.725994 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-cddc149a-a57a-4f92-8d35-2cb42a1c4133 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:39.746254 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-cddc149a-a57a-4f92-8d35-2cb42a1c4133 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d" status: 200 len: 1878 microversion: 2.42 time: 0.958660 Oct 27 03:35:39.751178 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1847/3454] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:35:38 2022] GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d => generated 1878 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:35:39.761399 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3c8d1b98-23dd-418d-ad3b-d5af582359e0 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:39.765528 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3c8d1b98-23dd-418d-ad3b-d5af582359e0 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] [instance: 09065cd4-8246-49ee-80fe-b4f1c11b468d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:39.777562 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3c8d1b98-23dd-418d-ad3b-d5af582359e0 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:39.779801 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3c8d1b98-23dd-418d-ad3b-d5af582359e0 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:39.781014 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3c8d1b98-23dd-418d-ad3b-d5af582359e0 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:39.781927 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3c8d1b98-23dd-418d-ad3b-d5af582359e0 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:39.783691 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3c8d1b98-23dd-418d-ad3b-d5af582359e0 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:39.783691 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3c8d1b98-23dd-418d-ad3b-d5af582359e0 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:39.986570 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ee251a5c-de81-404c-b38f-75152875a4ba tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881f054c84d04ceaa17a5817816022d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2057593072c14804ab70fe4bdea2c17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:39.998789 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ee251a5c-de81-404c-b38f-75152875a4ba tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] 10.222.0.20 "GET /compute/v2.1/servers/2410110f-fee8-4669-be8c-5137af8f074f" status: 200 len: 1674 microversion: 2.1 time: 0.403476 Oct 27 03:35:39.999784 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1608/3455] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:39 2022] GET /compute/v2.1/servers/2410110f-fee8-4669-be8c-5137af8f074f => generated 1674 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:40.010049 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c73676a8-afd5-4296-8818-f8a9687563c8 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7ddaa913a0>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:40.102502 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c73676a8-afd5-4296-8818-f8a9687563c8 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images/42320033-6276-453e-b35d-504a52d80d70" status: 200 len: 1454 microversion: 2.1 time: 0.101254 Oct 27 03:35:40.103457 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1609/3456] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:35:40 2022] GET /compute/v2.1/images/42320033-6276-453e-b35d-504a52d80d70 => generated 1454 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:40.274121 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3c8d1b98-23dd-418d-ad3b-d5af582359e0 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c36bef85ac34b4983a79e03c56965c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e58f30136ed4a4d9bff48e9b4cde5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:40.284395 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3c8d1b98-23dd-418d-ad3b-d5af582359e0 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] 10.222.0.20 "GET /compute/v2.1/servers/09065cd4-8246-49ee-80fe-b4f1c11b468d" status: 200 len: 1323 microversion: 2.1 time: 0.531758 Oct 27 03:35:40.288273 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1848/3457] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:39 2022] GET /compute/v2.1/servers/09065cd4-8246-49ee-80fe-b4f1c11b468d => generated 1323 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:40.571361 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-8c8b5b52-0779-4d5c-bc5b-bae3731e5044 req-92c5f3b7-e4ad-49eb-9eb3-24c4531b5ac4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c8a2cbb-4acf-4a6b-b684-567617bb930d", "tag": "67feebc0-6f53-4380-af0b-a0f8be99846e"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:35:40.637459 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-8c8b5b52-0779-4d5c-bc5b-bae3731e5044 req-92c5f3b7-e4ad-49eb-9eb3-24c4531b5ac4 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:40.639031 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-8c8b5b52-0779-4d5c-bc5b-bae3731e5044 req-92c5f3b7-e4ad-49eb-9eb3-24c4531b5ac4 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:40.641843 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-8c8b5b52-0779-4d5c-bc5b-bae3731e5044 req-92c5f3b7-e4ad-49eb-9eb3-24c4531b5ac4 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:40.687441 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-8c8b5b52-0779-4d5c-bc5b-bae3731e5044 req-92c5f3b7-e4ad-49eb-9eb3-24c4531b5ac4 service nova] Creating event network-changed:67feebc0-6f53-4380-af0b-a0f8be99846e for instance 8c8a2cbb-4acf-4a6b-b684-567617bb930d on n-h2-862769-1 Oct 27 03:35:40.695130 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-8c8b5b52-0779-4d5c-bc5b-bae3731e5044 req-92c5f3b7-e4ad-49eb-9eb3-24c4531b5ac4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129834 Oct 27 03:35:40.702373 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1610/3458] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:35:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:35:40.758466 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1bb7ec4e-95c6-43a6-a76b-0abb82162a2b tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:40.759825 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1bb7ec4e-95c6-43a6-a76b-0abb82162a2b tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] [instance: 8c8a2cbb-4acf-4a6b-b684-567617bb930d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:40.778450 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1bb7ec4e-95c6-43a6-a76b-0abb82162a2b tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:40.779133 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1bb7ec4e-95c6-43a6-a76b-0abb82162a2b tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:40.779725 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1bb7ec4e-95c6-43a6-a76b-0abb82162a2b tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:40.783745 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1bb7ec4e-95c6-43a6-a76b-0abb82162a2b tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:40.784362 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1bb7ec4e-95c6-43a6-a76b-0abb82162a2b tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:40.785052 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1bb7ec4e-95c6-43a6-a76b-0abb82162a2b tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:41.040315 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c33df9f1-1237-4492-9162-4026d4f45756 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:41.041612 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c33df9f1-1237-4492-9162-4026d4f45756 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] [instance: 2410110f-fee8-4669-be8c-5137af8f074f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:41.053914 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c33df9f1-1237-4492-9162-4026d4f45756 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:41.058249 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c33df9f1-1237-4492-9162-4026d4f45756 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:41.058249 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c33df9f1-1237-4492-9162-4026d4f45756 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:41.058249 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c33df9f1-1237-4492-9162-4026d4f45756 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:41.058249 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c33df9f1-1237-4492-9162-4026d4f45756 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:41.058249 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c33df9f1-1237-4492-9162-4026d4f45756 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:41.804110 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c33df9f1-1237-4492-9162-4026d4f45756 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881f054c84d04ceaa17a5817816022d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2057593072c14804ab70fe4bdea2c17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:41.821192 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c33df9f1-1237-4492-9162-4026d4f45756 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] 10.222.0.20 "GET /compute/v2.1/servers/2410110f-fee8-4669-be8c-5137af8f074f" status: 200 len: 1674 microversion: 2.1 time: 0.797498 Oct 27 03:35:41.835659 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1611/3459] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:41 2022] GET /compute/v2.1/servers/2410110f-fee8-4669-be8c-5137af8f074f => generated 1674 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:41.848163 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-fe236f22-1ce2-411e-929d-9d8a4a1f2701 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7ddb528af0>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:41.941061 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-fe236f22-1ce2-411e-929d-9d8a4a1f2701 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images/42320033-6276-453e-b35d-504a52d80d70" status: 200 len: 1454 microversion: 2.1 time: 0.098341 Oct 27 03:35:41.962121 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1612/3460] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:35:41 2022] GET /compute/v2.1/images/42320033-6276-453e-b35d-504a52d80d70 => generated 1454 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:41.984294 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9f91575c-5461-4c10-84e5-11829f624929 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:41.985043 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9f91575c-5461-4c10-84e5-11829f624929 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] [instance: 09065cd4-8246-49ee-80fe-b4f1c11b468d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:42.016776 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9f91575c-5461-4c10-84e5-11829f624929 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:42.017289 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9f91575c-5461-4c10-84e5-11829f624929 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:42.023503 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9f91575c-5461-4c10-84e5-11829f624929 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:42.024370 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9f91575c-5461-4c10-84e5-11829f624929 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:42.024854 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9f91575c-5461-4c10-84e5-11829f624929 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:42.025295 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9f91575c-5461-4c10-84e5-11829f624929 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:42.316483 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1bb7ec4e-95c6-43a6-a76b-0abb82162a2b tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:42.344452 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1bb7ec4e-95c6-43a6-a76b-0abb82162a2b tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:42.355826 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1bb7ec4e-95c6-43a6-a76b-0abb82162a2b tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:42.366380 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1bb7ec4e-95c6-43a6-a76b-0abb82162a2b tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d" status: 200 len: 1878 microversion: 2.42 time: 1.615640 Oct 27 03:35:42.374077 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1849/3461] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:35:40 2022] GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d => generated 1878 bytes in 1623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:35:42.405976 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-ab214254-958e-41ab-a720-830be6829ce2 req-7750e0bc-f50b-46a1-9610-19968dfa8816 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2410110f-fee8-4669-be8c-5137af8f074f", "name": "network-vif-deleted", "tag": "80bf1ae1-da89-411d-b5d2-492e7e79f4c6"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:35:42.451082 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-ab214254-958e-41ab-a720-830be6829ce2 req-7750e0bc-f50b-46a1-9610-19968dfa8816 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:42.451702 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-ab214254-958e-41ab-a720-830be6829ce2 req-7750e0bc-f50b-46a1-9610-19968dfa8816 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:42.452126 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-ab214254-958e-41ab-a720-830be6829ce2 req-7750e0bc-f50b-46a1-9610-19968dfa8816 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:42.497305 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-ab214254-958e-41ab-a720-830be6829ce2 req-7750e0bc-f50b-46a1-9610-19968dfa8816 service nova] Creating event network-vif-deleted:80bf1ae1-da89-411d-b5d2-492e7e79f4c6 for instance 2410110f-fee8-4669-be8c-5137af8f074f on n-h2-862769-1 Oct 27 03:35:42.512302 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-ab214254-958e-41ab-a720-830be6829ce2 req-7750e0bc-f50b-46a1-9610-19968dfa8816 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136718 Oct 27 03:35:42.515792 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1850/3462] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:35:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:35:42.583922 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9f91575c-5461-4c10-84e5-11829f624929 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c36bef85ac34b4983a79e03c56965c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e58f30136ed4a4d9bff48e9b4cde5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:42.598674 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9f91575c-5461-4c10-84e5-11829f624929 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] 10.222.0.20 "GET /compute/v2.1/servers/09065cd4-8246-49ee-80fe-b4f1c11b468d" status: 200 len: 1323 microversion: 2.1 time: 0.627823 Oct 27 03:35:42.610894 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1613/3463] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:41 2022] GET /compute/v2.1/servers/09065cd4-8246-49ee-80fe-b4f1c11b468d => generated 1323 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:42.851606 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f5a158ab-d7e2-44d7-8dc2-bbcb67c70c4f tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:42.852331 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f5a158ab-d7e2-44d7-8dc2-bbcb67c70c4f tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] [instance: 2410110f-fee8-4669-be8c-5137af8f074f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:42.869869 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f5a158ab-d7e2-44d7-8dc2-bbcb67c70c4f tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:42.872058 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f5a158ab-d7e2-44d7-8dc2-bbcb67c70c4f tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:42.874663 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f5a158ab-d7e2-44d7-8dc2-bbcb67c70c4f tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:42.883506 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f5a158ab-d7e2-44d7-8dc2-bbcb67c70c4f tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:42.884364 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f5a158ab-d7e2-44d7-8dc2-bbcb67c70c4f tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:42.885287 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f5a158ab-d7e2-44d7-8dc2-bbcb67c70c4f tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:42.957348 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1e9d0757-aae8-4975-b87c-b06815d01d75 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7ddafa9d30>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:43.048363 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1e9d0757-aae8-4975-b87c-b06815d01d75 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images/42320033-6276-453e-b35d-504a52d80d70" status: 200 len: 1454 microversion: 2.1 time: 0.094776 Oct 27 03:35:43.049618 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1614/3464] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:35:42 2022] GET /compute/v2.1/images/42320033-6276-453e-b35d-504a52d80d70 => generated 1454 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:43.342848 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6ffa399d-c839-4040-8822-ed7c2201dc85 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Action: 'create', calling method: .version_select at 0x7f7ddaa61550>, body: {"keypair": {"name": "tempest-keypair-56934881", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDumLmoAA9xmt/DaW6nGNXB0ELN9KbmOaHCi95qQ9PRIDgT46ISewCOepOOwrOKRyRuSYcqihHZUzBw4klQE0wxkGY6a8IIfOp7ggCUTKVKuU7FizQQtUdFnehize1DrkQ=="}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:35:43.380134 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-6ffa399d-c839-4040-8822-ed7c2201dc85 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Getting quotas for project 229dcb63bc41444391544883b576ce2e. Resources: {'key_pairs'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:35:43.394059 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:35:43.395208 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-6ffa399d-c839-4040-8822-ed7c2201dc85 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Getting quotas for user 18036411a99e4634bfbaeae24b9f254d and project 229dcb63bc41444391544883b576ce2e. Resources: {'key_pairs'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:35:43.519069 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6ffa399d-c839-4040-8822-ed7c2201dc85 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.386542 Oct 27 03:35:43.519721 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1615/3465] 10.222.0.20 () {60 vars in 1159 bytes} [Thu Oct 27 03:35:43 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:35:43.524799 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f80e82a2-fb5b-4491-aa1b-78a68b1e1954 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:43.526473 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f80e82a2-fb5b-4491-aa1b-78a68b1e1954 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] [instance: 8c8a2cbb-4acf-4a6b-b684-567617bb930d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:43.542370 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f80e82a2-fb5b-4491-aa1b-78a68b1e1954 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:43.543164 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f80e82a2-fb5b-4491-aa1b-78a68b1e1954 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:43.549357 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f80e82a2-fb5b-4491-aa1b-78a68b1e1954 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:43.549357 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f80e82a2-fb5b-4491-aa1b-78a68b1e1954 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:43.549357 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f80e82a2-fb5b-4491-aa1b-78a68b1e1954 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:43.549357 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f80e82a2-fb5b-4491-aa1b-78a68b1e1954 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:43.693272 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f5a158ab-d7e2-44d7-8dc2-bbcb67c70c4f tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881f054c84d04ceaa17a5817816022d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2057593072c14804ab70fe4bdea2c17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:43.710448 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f5a158ab-d7e2-44d7-8dc2-bbcb67c70c4f tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] 10.222.0.20 "GET /compute/v2.1/servers/2410110f-fee8-4669-be8c-5137af8f074f" status: 200 len: 1453 microversion: 2.1 time: 0.858792 Oct 27 03:35:43.711647 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1851/3466] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:42 2022] GET /compute/v2.1/servers/2410110f-fee8-4669-be8c-5137af8f074f => generated 1453 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:43.720970 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3159bdfb-5824-4517-b9b0-ed687b59c5c8 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:43.722910 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3159bdfb-5824-4517-b9b0-ed687b59c5c8 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] [instance: 09065cd4-8246-49ee-80fe-b4f1c11b468d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:43.767612 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3159bdfb-5824-4517-b9b0-ed687b59c5c8 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:43.768401 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3159bdfb-5824-4517-b9b0-ed687b59c5c8 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:43.769864 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3159bdfb-5824-4517-b9b0-ed687b59c5c8 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:43.774181 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3159bdfb-5824-4517-b9b0-ed687b59c5c8 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:43.775133 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3159bdfb-5824-4517-b9b0-ed687b59c5c8 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:43.777431 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3159bdfb-5824-4517-b9b0-ed687b59c5c8 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:43.977032 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f80e82a2-fb5b-4491-aa1b-78a68b1e1954 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:43.988519 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f80e82a2-fb5b-4491-aa1b-78a68b1e1954 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:43.990244 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f80e82a2-fb5b-4491-aa1b-78a68b1e1954 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:43.991445 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f80e82a2-fb5b-4491-aa1b-78a68b1e1954 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d" status: 200 len: 1878 microversion: 2.42 time: 0.470695 Oct 27 03:35:43.995607 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1616/3467] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:35:43 2022] GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d => generated 1878 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:35:44.003179 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-97cadb2f-34e6-4005-b073-4fe8c8f56822 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-366867709", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "destination_type": "local"}, {"source_type": "volume", "uuid": "1251a665-cc05-4ac3-b6b2-7de810d79501", "destination_type": "invalid"}], "networks": [{"uuid": "0f1ea857-e60a-4a6e-a6c9-70bfd2dd2db8"}]}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:35:44.008527 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-97cadb2f-34e6-4005-b073-4fe8c8f56822 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Request method failure captured: Oct 27 03:35:44.008527 n-d-862769-1 devstack@n-api.service[121000]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 03:35:44.008527 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:35:44.008527 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:35:44.008527 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:35:44.008527 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 494 Oct 27 03:35:44.008527 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:35:44.008527 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:35:44.008527 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:35:44.008527 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:35:44.008527 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfxF6ut9nM9a9AcpKLO7IgCu-akAJ2YJGjrI9C8NUveA8uObV2XgQIQvsIxuWjvLl9meIEqpfGwZYr8MTX_PAGoiJsNUPXh5ERSce5cPYQYCCFPL0HtTb-E11C_2kfWy1wRps1tClRNvtj8zAqCGRhs1x-Uvl0zISdfHepXmvWX31Us Oct 27 03:35:44.008527 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:35:44.008527 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:35:44.008527 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:35:44.008527 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:35:44.008527 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:35:44.008527 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:35:44.008527 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 8bb5d291069d4329a90123e327fe9c59 Oct 27 03:35:44.008527 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:35:44.008527 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:35:44.008527 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:35:44.008527 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8bb5d291069d4329a90123e327fe9c59"}]}] Oct 27 03:35:44.008527 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:35:44.008527 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 8bb5d291069d4329a90123e327fe9c59 Oct 27 03:35:44.008527 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:35:44.008527 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ServersNegativeTestJSON-4378389-project Oct 27 03:35:44.008527 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:35:44.008527 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:35:44.008527 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: f9c32b7626594ff888970c7f3227bb20 Oct 27 03:35:44.008527 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ServersNegativeTestJSON-4378389-project Oct 27 03:35:44.008527 n-d-862769-1 devstack@n-api.service[121000]: Oct 27 03:35:44.008527 n-d-862769-1 devstack@n-api.service[121000]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-366867709", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "destination_type": "local"}, {"source_type": "volume", "uuid": "1251a665-cc05-4ac3-b6b2-7de810d79501", "destination_type": "invalid"}], "networks": [{"uuid": "0f1ea857-e60a-4a6e-a6c9-70bfd2dd2db8"}]}} Oct 27 03:35:44.008527 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:35:44.008527 n-d-862769-1 devstack@n-api.service[121000]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 27 03:35:44.008527 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-366867709', 'imageRef': 'c40fb871-5877-4b59-ab69-d9fd23b7a917', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': 'c40fb871-5877-4b59-ab69-d9fd23b7a917', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '1251a665-cc05-4ac3-b6b2-7de810d79501', 'destination_type': 'invalid'}], 'networks': [{'uuid': '0f1ea857-e60a-4a6e-a6c9-70bfd2dd2db8'}]}}} Oct 27 03:35:44.008527 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:35:44.008527 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:35:44.008527 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 03:35:44.008527 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 03:35:44.008527 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 03:35:44.008527 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise error Oct 27 03:35:44.008527 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Oct 27 03:35:44.008527 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:35:44.008527 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Oct 27 03:35:44.008527 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Oct 27 03:35:44.008527 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:35:44.008527 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Oct 27 03:35:44.008527 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi 'invalid' Oct 27 03:35:44.008527 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:35:44.008527 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:35:44.008527 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:35:44.008527 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:35:44.008527 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:35:44.008527 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:35:44.008527 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:35:44.008527 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:35:44.008527 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:35:44.008527 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:35:44.018802 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:35:44.018802 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:35:44.018802 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 03:35:44.018802 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 03:35:44.018802 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 03:35:44.018802 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 03:35:44.018802 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 03:35:44.018802 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 03:35:44.018802 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 27 03:35:44.018802 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:35:44.018802 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:35:44.018802 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:35:44.018802 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:35:44.018802 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:35:44.018802 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:35:44.018802 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 03:35:44.018802 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 03:35:44.018802 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 27 03:35:44.018802 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:35:44.018802 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-97cadb2f-34e6-4005-b073-4fe8c8f56822 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:35:44.018802 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-97cadb2f-34e6-4005-b073-4fe8c8f56822 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.012248 Oct 27 03:35:44.018802 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1617/3468] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:35:43 2022] POST /compute/v2.1/servers => generated 155 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 27 03:35:44.024531 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6c2a005c-dc7d-4fc3-a359-a1145c4b5514 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:44.025492 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6c2a005c-dc7d-4fc3-a359-a1145c4b5514 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:44.033674 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6c2a005c-dc7d-4fc3-a359-a1145c4b5514 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:44.034300 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6c2a005c-dc7d-4fc3-a359-a1145c4b5514 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:44.035335 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6c2a005c-dc7d-4fc3-a359-a1145c4b5514 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:44.036293 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6c2a005c-dc7d-4fc3-a359-a1145c4b5514 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:44.037039 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6c2a005c-dc7d-4fc3-a359-a1145c4b5514 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:44.037786 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6c2a005c-dc7d-4fc3-a359-a1145c4b5514 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:44.258254 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3159bdfb-5824-4517-b9b0-ed687b59c5c8 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c36bef85ac34b4983a79e03c56965c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e58f30136ed4a4d9bff48e9b4cde5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:44.289837 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3159bdfb-5824-4517-b9b0-ed687b59c5c8 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] 10.222.0.20 "GET /compute/v2.1/servers/09065cd4-8246-49ee-80fe-b4f1c11b468d" status: 200 len: 1323 microversion: 2.1 time: 0.573958 Oct 27 03:35:44.308156 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1852/3469] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:43 2022] GET /compute/v2.1/servers/09065cd4-8246-49ee-80fe-b4f1c11b468d => generated 1323 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:44.320980 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b1e977f1-8e7b-4aac-b617-bc9ad86a55e3 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7ddab3de50>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:44.415135 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-6c2a005c-dc7d-4fc3-a359-a1145c4b5514 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:44.429138 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b1e977f1-8e7b-4aac-b617-bc9ad86a55e3 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images/42320033-6276-453e-b35d-504a52d80d70" status: 200 len: 1454 microversion: 2.1 time: 0.119641 Oct 27 03:35:44.433680 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1853/3470] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:35:44 2022] GET /compute/v2.1/images/42320033-6276-453e-b35d-504a52d80d70 => generated 1454 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:44.444685 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6c2a005c-dc7d-4fc3-a359-a1145c4b5514 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1505 microversion: 2.1 time: 0.428326 Oct 27 03:35:44.468738 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1618/3471] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:44 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1505 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:44.474653 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a9caf5e4-9932-4a88-a6df-4ddf36b8780d tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:44.475687 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a9caf5e4-9932-4a88-a6df-4ddf36b8780d tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:44.487878 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a9caf5e4-9932-4a88-a6df-4ddf36b8780d tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:44.487878 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a9caf5e4-9932-4a88-a6df-4ddf36b8780d tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:44.488931 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a9caf5e4-9932-4a88-a6df-4ddf36b8780d tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:44.490922 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a9caf5e4-9932-4a88-a6df-4ddf36b8780d tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:44.491701 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a9caf5e4-9932-4a88-a6df-4ddf36b8780d tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:44.492371 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a9caf5e4-9932-4a88-a6df-4ddf36b8780d tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:44.582770 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-2c025416-ffe2-491e-bd26-cdf5030b5ff7 req-6fcf1b99-f20e-4fad-b11f-cbc072c1b3ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2410110f-fee8-4669-be8c-5137af8f074f", "name": "network-vif-deleted", "tag": "988e6fdf-022d-4ca6-a640-5e81822be074"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:35:44.597949 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-2c025416-ffe2-491e-bd26-cdf5030b5ff7 req-6fcf1b99-f20e-4fad-b11f-cbc072c1b3ed service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:44.598580 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-2c025416-ffe2-491e-bd26-cdf5030b5ff7 req-6fcf1b99-f20e-4fad-b11f-cbc072c1b3ed service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:44.599025 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-2c025416-ffe2-491e-bd26-cdf5030b5ff7 req-6fcf1b99-f20e-4fad-b11f-cbc072c1b3ed service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:44.614364 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-2c025416-ffe2-491e-bd26-cdf5030b5ff7 req-6fcf1b99-f20e-4fad-b11f-cbc072c1b3ed service nova] Creating event network-vif-deleted:988e6fdf-022d-4ca6-a640-5e81822be074 for instance 2410110f-fee8-4669-be8c-5137af8f074f on n-h2-862769-1 Oct 27 03:35:44.620924 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-2c025416-ffe2-491e-bd26-cdf5030b5ff7 req-6fcf1b99-f20e-4fad-b11f-cbc072c1b3ed service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043898 Oct 27 03:35:44.622666 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1619/3472] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:35:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:35:44.753817 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b4a164ff-54b4-4150-8b47-68da5efbdc43 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:44.768335 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b4a164ff-54b4-4150-8b47-68da5efbdc43 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] [instance: 2410110f-fee8-4669-be8c-5137af8f074f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:44.805652 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b4a164ff-54b4-4150-8b47-68da5efbdc43 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:44.806503 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b4a164ff-54b4-4150-8b47-68da5efbdc43 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:44.807129 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b4a164ff-54b4-4150-8b47-68da5efbdc43 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:44.811493 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b4a164ff-54b4-4150-8b47-68da5efbdc43 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:44.811493 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b4a164ff-54b4-4150-8b47-68da5efbdc43 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:44.818623 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b4a164ff-54b4-4150-8b47-68da5efbdc43 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:44.968011 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b4a164ff-54b4-4150-8b47-68da5efbdc43 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:44.969259 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b4a164ff-54b4-4150-8b47-68da5efbdc43 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:44.973708 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b4a164ff-54b4-4150-8b47-68da5efbdc43 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:44.979787 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-b4a164ff-54b4-4150-8b47-68da5efbdc43 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lazy-loading 'fault' on Instance uuid 2410110f-fee8-4669-be8c-5137af8f074f {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:35:45.031828 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a9caf5e4-9932-4a88-a6df-4ddf36b8780d tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:45.045815 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a9caf5e4-9932-4a88-a6df-4ddf36b8780d tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1505 microversion: 2.1 time: 0.575471 Oct 27 03:35:45.047498 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1854/3473] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:44 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1505 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:45.052622 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f5958e65-b5fb-4a51-945a-83e30cb895d9 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:45.057684 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f5958e65-b5fb-4a51-945a-83e30cb895d9 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] [instance: 8c8a2cbb-4acf-4a6b-b684-567617bb930d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:45.069698 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f5958e65-b5fb-4a51-945a-83e30cb895d9 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:45.078172 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f5958e65-b5fb-4a51-945a-83e30cb895d9 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:45.079031 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f5958e65-b5fb-4a51-945a-83e30cb895d9 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:45.079900 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f5958e65-b5fb-4a51-945a-83e30cb895d9 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:45.080626 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f5958e65-b5fb-4a51-945a-83e30cb895d9 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:45.080807 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f5958e65-b5fb-4a51-945a-83e30cb895d9 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:45.114344 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b4a164ff-54b4-4150-8b47-68da5efbdc43 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881f054c84d04ceaa17a5817816022d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2057593072c14804ab70fe4bdea2c17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:45.127069 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b4a164ff-54b4-4150-8b47-68da5efbdc43 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] 10.222.0.20 "GET /compute/v2.1/servers/2410110f-fee8-4669-be8c-5137af8f074f" status: 200 len: 1303 microversion: 2.1 time: 0.387700 Oct 27 03:35:45.143340 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1620/3474] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:44 2022] GET /compute/v2.1/servers/2410110f-fee8-4669-be8c-5137af8f074f => generated 1303 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:45.165706 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2fcc205c-3860-4edc-b72f-317700d567ef tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1428072993", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "0f1ea857-e60a-4a6e-a6c9-70bfd2dd2db8"}]}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:35:45.173756 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2fcc205c-3860-4edc-b72f-317700d567ef tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Request method failure captured: Oct 27 03:35:45.173756 n-d-862769-1 devstack@n-api.service[121000]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 03:35:45.173756 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:35:45.173756 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:35:45.173756 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:35:45.173756 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 492 Oct 27 03:35:45.173756 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:35:45.173756 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:35:45.173756 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:35:45.173756 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:35:45.173756 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfxF6ut9nM9a9AcpKLO7IgCu-akAJ2YJGjrI9C8NUveA8uObV2XgQIQvsIxuWjvLl9meIEqpfGwZYr8MTX_PAGoiJsNUPXh5ERSce5cPYQYCCFPL0HtTb-E11C_2kfWy1wRps1tClRNvtj8zAqCGRhs1x-Uvl0zISdfHepXmvWX31Us Oct 27 03:35:45.173756 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:35:45.173756 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:35:45.173756 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:35:45.173756 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:35:45.173756 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:35:45.173756 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:35:45.173756 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 8bb5d291069d4329a90123e327fe9c59 Oct 27 03:35:45.173756 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:35:45.173756 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:35:45.173756 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:35:45.173756 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8bb5d291069d4329a90123e327fe9c59"}]}] Oct 27 03:35:45.173756 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:35:45.173756 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 8bb5d291069d4329a90123e327fe9c59 Oct 27 03:35:45.173756 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:35:45.173756 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ServersNegativeTestJSON-4378389-project Oct 27 03:35:45.173756 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:35:45.173756 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:35:45.173756 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: f9c32b7626594ff888970c7f3227bb20 Oct 27 03:35:45.173756 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ServersNegativeTestJSON-4378389-project Oct 27 03:35:45.173756 n-d-862769-1 devstack@n-api.service[121000]: Oct 27 03:35:45.173756 n-d-862769-1 devstack@n-api.service[121000]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1428072993", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "0f1ea857-e60a-4a6e-a6c9-70bfd2dd2db8"}]}} Oct 27 03:35:45.173756 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:35:45.173756 n-d-862769-1 devstack@n-api.service[121000]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 27 03:35:45.173756 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1428072993', 'imageRef': 'c40fb871-5877-4b59-ab69-d9fd23b7a917', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '0f1ea857-e60a-4a6e-a6c9-70bfd2dd2db8'}]}}} Oct 27 03:35:45.173756 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:35:45.173756 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:35:45.173756 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 03:35:45.173756 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 03:35:45.173756 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 03:35:45.173756 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise error Oct 27 03:35:45.173756 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 27 03:35:45.173756 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:35:45.173756 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Oct 27 03:35:45.173756 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Oct 27 03:35:45.173756 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:35:45.173756 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Oct 27 03:35:45.173756 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Oct 27 03:35:45.176938 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:35:45.176938 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:35:45.176938 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:35:45.176938 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:35:45.176938 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:35:45.176938 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:35:45.176938 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:35:45.176938 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:35:45.176938 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:35:45.176938 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:35:45.176938 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:35:45.176938 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:35:45.176938 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 03:35:45.176938 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 03:35:45.176938 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 03:35:45.176938 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 03:35:45.176938 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 03:35:45.176938 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 03:35:45.176938 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 27 03:35:45.176938 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:35:45.176938 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:35:45.176938 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:35:45.176938 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:35:45.176938 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:35:45.176938 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:35:45.176938 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 03:35:45.176938 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 03:35:45.176938 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 27 03:35:45.176938 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:35:45.176938 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2fcc205c-3860-4edc-b72f-317700d567ef tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:35:45.176938 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2fcc205c-3860-4edc-b72f-317700d567ef tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.014779 Oct 27 03:35:45.185674 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1621/3475] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:35:45 2022] POST /compute/v2.1/servers => generated 624 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 27 03:35:45.200578 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-17870028-43af-41b1-8245-0807933fb06c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:45.201388 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-17870028-43af-41b1-8245-0807933fb06c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:45.218243 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-17870028-43af-41b1-8245-0807933fb06c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:45.222692 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-17870028-43af-41b1-8245-0807933fb06c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:45.222692 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-17870028-43af-41b1-8245-0807933fb06c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:45.222692 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-17870028-43af-41b1-8245-0807933fb06c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:45.222692 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-17870028-43af-41b1-8245-0807933fb06c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:45.222692 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-17870028-43af-41b1-8245-0807933fb06c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:45.604403 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-17870028-43af-41b1-8245-0807933fb06c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:45.617852 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-17870028-43af-41b1-8245-0807933fb06c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1505 microversion: 2.1 time: 0.429589 Oct 27 03:35:45.631842 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1622/3476] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:45 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1505 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:45.639205 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f5958e65-b5fb-4a51-945a-83e30cb895d9 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:45.658993 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-feb056f5-0102-4598-8574-3dd5c8673e7a req-672e1449-6498-4158-9959-95db695a46cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09065cd4-8246-49ee-80fe-b4f1c11b468d", "name": "network-vif-plugged", "status": "completed", "tag": "ab56b8a0-7a58-4598-868b-6205446a5b4c"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:35:45.661671 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f5958e65-b5fb-4a51-945a-83e30cb895d9 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:45.665017 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f5958e65-b5fb-4a51-945a-83e30cb895d9 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:45.671522 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f5958e65-b5fb-4a51-945a-83e30cb895d9 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d" status: 200 len: 1878 microversion: 2.42 time: 0.622642 Oct 27 03:35:45.672749 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1855/3477] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:35:45 2022] GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d => generated 1878 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:35:45.676733 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-feb056f5-0102-4598-8574-3dd5c8673e7a req-672e1449-6498-4158-9959-95db695a46cb service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:45.677489 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-feb056f5-0102-4598-8574-3dd5c8673e7a req-672e1449-6498-4158-9959-95db695a46cb service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:45.678305 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-feb056f5-0102-4598-8574-3dd5c8673e7a req-672e1449-6498-4158-9959-95db695a46cb service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:45.691064 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4726d680-9f58-4a41-8ce7-4416beb97c25 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:45.691867 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4726d680-9f58-4a41-8ce7-4416beb97c25 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] [instance: 09065cd4-8246-49ee-80fe-b4f1c11b468d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:45.692199 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-feb056f5-0102-4598-8574-3dd5c8673e7a req-672e1449-6498-4158-9959-95db695a46cb service nova] Creating event network-vif-plugged:ab56b8a0-7a58-4598-868b-6205446a5b4c for instance 09065cd4-8246-49ee-80fe-b4f1c11b468d on n-h1-862769-1 Oct 27 03:35:45.698616 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4726d680-9f58-4a41-8ce7-4416beb97c25 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:45.699235 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4726d680-9f58-4a41-8ce7-4416beb97c25 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:45.699756 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4726d680-9f58-4a41-8ce7-4416beb97c25 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:45.700559 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4726d680-9f58-4a41-8ce7-4416beb97c25 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:45.701115 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4726d680-9f58-4a41-8ce7-4416beb97c25 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:45.702263 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4726d680-9f58-4a41-8ce7-4416beb97c25 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:45.702819 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-feb056f5-0102-4598-8574-3dd5c8673e7a req-672e1449-6498-4158-9959-95db695a46cb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068375 Oct 27 03:35:45.703664 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1623/3478] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:35:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:35:45.712383 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6c4d9665-a062-45fe-aa62-d57430251aad tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7dda7a2940>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:45.808116 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6c4d9665-a062-45fe-aa62-d57430251aad tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images/42320033-6276-453e-b35d-504a52d80d70" status: 200 len: 1454 microversion: 2.1 time: 0.094604 Oct 27 03:35:45.822956 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1624/3479] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:35:45 2022] GET /compute/v2.1/images/42320033-6276-453e-b35d-504a52d80d70 => generated 1454 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:45.833034 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-bb9a0f18-2cee-421f-9d9e-ad2f77a24537 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:45.834159 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-bb9a0f18-2cee-421f-9d9e-ad2f77a24537 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:45.841033 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bb9a0f18-2cee-421f-9d9e-ad2f77a24537 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:45.841962 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bb9a0f18-2cee-421f-9d9e-ad2f77a24537 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:45.843178 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bb9a0f18-2cee-421f-9d9e-ad2f77a24537 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:45.844102 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bb9a0f18-2cee-421f-9d9e-ad2f77a24537 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:45.844811 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bb9a0f18-2cee-421f-9d9e-ad2f77a24537 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:45.845430 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bb9a0f18-2cee-421f-9d9e-ad2f77a24537 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:46.057408 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-bb9a0f18-2cee-421f-9d9e-ad2f77a24537 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:46.067307 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-bb9a0f18-2cee-421f-9d9e-ad2f77a24537 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1505 microversion: 2.1 time: 0.242729 Oct 27 03:35:46.068494 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1625/3480] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:45 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1505 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:46.075291 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-732c1468-4ed5-42b0-8639-4b06b1c2401a tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "880352c6-c25b-488b-9d00-69909301fabb"}], "security_groups": [{"name": "tempest-securitygroup--746132926"}], "key_name": "tempest-keypair-1529526182", "user_data": "}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:35:46.185159 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4726d680-9f58-4a41-8ce7-4416beb97c25 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c36bef85ac34b4983a79e03c56965c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e58f30136ed4a4d9bff48e9b4cde5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:46.209538 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4726d680-9f58-4a41-8ce7-4416beb97c25 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] 10.222.0.20 "GET /compute/v2.1/servers/09065cd4-8246-49ee-80fe-b4f1c11b468d" status: 200 len: 1323 microversion: 2.1 time: 0.535068 Oct 27 03:35:46.210380 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1856/3481] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:45 2022] GET /compute/v2.1/servers/09065cd4-8246-49ee-80fe-b4f1c11b468d => generated 1323 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:46.243132 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4525662c-4672-4c06-8bf6-ac3492fba5e0 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:46.243961 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4525662c-4672-4c06-8bf6-ac3492fba5e0 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] [instance: 2410110f-fee8-4669-be8c-5137af8f074f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:46.271315 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4525662c-4672-4c06-8bf6-ac3492fba5e0 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:46.271804 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4525662c-4672-4c06-8bf6-ac3492fba5e0 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:46.272436 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4525662c-4672-4c06-8bf6-ac3492fba5e0 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:46.273379 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4525662c-4672-4c06-8bf6-ac3492fba5e0 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:46.274058 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4525662c-4672-4c06-8bf6-ac3492fba5e0 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:46.274695 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4525662c-4672-4c06-8bf6-ac3492fba5e0 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:46.307526 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-732c1468-4ed5-42b0-8639-4b06b1c2401a tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] validate_networks() for [('880352c6-c25b-488b-9d00-69909301fabb', None, None, None, None, None)] {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:35:46.317104 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-4525662c-4672-4c06-8bf6-ac3492fba5e0 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] HTTP exception thrown: Instance 2410110f-fee8-4669-be8c-5137af8f074f could not be found. Oct 27 03:35:46.321784 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4525662c-4672-4c06-8bf6-ac3492fba5e0 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Request method failure captured: Oct 27 03:35:46.321784 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/2410110f-fee8-4669-be8c-5137af8f074f HTTP/1.1 Oct 27 03:35:46.321784 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:35:46.321784 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:35:46.321784 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:35:46.321784 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:35:46.321784 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:35:46.321784 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:35:46.321784 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:35:46.321784 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:35:46.321784 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfwOWA1Mstb05mKjlVTTupe8YH9xrCf5f9L9Cychzb-w58cm7Umv8orXhO3n_av1vEBdRM_JzsuN71tTo5mU4bcMgJUicRJX-U2IA0MbsE24CxaW8npw75W0q7d1gJRSnDxKQJKYsgopXJhS0nx9kmDtcpnoCVJn5M9CIhzppuqGVC4 Oct 27 03:35:46.321784 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:35:46.321784 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:35:46.321784 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:35:46.321784 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:35:46.321784 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:35:46.321784 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:35:46.321784 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 2057593072c14804ab70fe4bdea2c17c Oct 27 03:35:46.321784 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServersTestMultiNic-1635442954 Oct 27 03:35:46.321784 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:35:46.321784 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:35:46.321784 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2057593072c14804ab70fe4bdea2c17c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2057593072c14804ab70fe4bdea2c17c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2057593072c14804ab70fe4bdea2c17c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2057593072c14804ab70fe4bdea2c17c"}]}] Oct 27 03:35:46.321784 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServersTestMultiNic-1635442954 Oct 27 03:35:46.321784 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 2057593072c14804ab70fe4bdea2c17c Oct 27 03:35:46.321784 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServersTestMultiNic-1635442954 Oct 27 03:35:46.321784 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServersTestMultiNic-1635442954-project Oct 27 03:35:46.321784 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:35:46.321784 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:35:46.321784 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 881f054c84d04ceaa17a5817816022d4 Oct 27 03:35:46.321784 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServersTestMultiNic-1635442954-project Oct 27 03:35:46.321784 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:35:46.321784 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 2410110f-fee8-4669-be8c-5137af8f074f could not be found. Oct 27 03:35:46.321784 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '2410110f-fee8-4669-be8c-5137af8f074f'} Oct 27 03:35:46.321784 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:35:46.321784 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:35:46.321784 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:35:46.321784 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:35:46.321784 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:35:46.321784 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:35:46.321784 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:35:46.321784 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:35:46.321784 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:35:46.321784 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:35:46.321784 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2410110f-fee8-4669-be8c-5137af8f074f could not be found. Oct 27 03:35:46.321784 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:35:46.321784 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:35:46.321784 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:35:46.321784 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:35:46.321784 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:35:46.321784 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:35:46.321784 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:35:46.321784 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:35:46.321784 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:35:46.321784 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:35:46.321784 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:35:46.321784 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:35:46.321784 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:35:46.321784 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:35:46.321784 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:35:46.321784 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:35:46.321784 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2410110f-fee8-4669-be8c-5137af8f074f could not be found. Oct 27 03:35:46.321784 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:35:46.321784 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:35:46.321784 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:35:46.327486 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:35:46.327486 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:35:46.327486 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:35:46.327486 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:35:46.327486 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:35:46.327486 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2410110f-fee8-4669-be8c-5137af8f074f could not be found. Oct 27 03:35:46.327486 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:35:46.329457 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4525662c-4672-4c06-8bf6-ac3492fba5e0 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Returning 404 to user: Instance 2410110f-fee8-4669-be8c-5137af8f074f could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:35:46.330595 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4525662c-4672-4c06-8bf6-ac3492fba5e0 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] 10.222.0.20 "GET /compute/v2.1/servers/2410110f-fee8-4669-be8c-5137af8f074f" status: 404 len: 111 microversion: 2.1 time: 0.105543 Oct 27 03:35:46.331706 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1857/3482] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:46 2022] GET /compute/v2.1/servers/2410110f-fee8-4669-be8c-5137af8f074f => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:35:46.337131 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d704c2d4-4ebe-4600-a633-527d4b6ac2c6 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": [{"uuid": "0f1ea857-e60a-4a6e-a6c9-70bfd2dd2db8"}]}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:35:46.341599 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d704c2d4-4ebe-4600-a633-527d4b6ac2c6 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Request method failure captured: Oct 27 03:35:46.341599 n-d-862769-1 devstack@n-api.service[121001]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 03:35:46.341599 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:35:46.341599 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:35:46.341599 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:35:46.341599 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 416 Oct 27 03:35:46.341599 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:35:46.341599 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:35:46.341599 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:35:46.341599 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:35:46.341599 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfxF6ut9nM9a9AcpKLO7IgCu-akAJ2YJGjrI9C8NUveA8uObV2XgQIQvsIxuWjvLl9meIEqpfGwZYr8MTX_PAGoiJsNUPXh5ERSce5cPYQYCCFPL0HtTb-E11C_2kfWy1wRps1tClRNvtj8zAqCGRhs1x-Uvl0zISdfHepXmvWX31Us Oct 27 03:35:46.341599 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:35:46.341599 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:35:46.341599 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:35:46.341599 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:35:46.341599 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:35:46.341599 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:35:46.341599 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 8bb5d291069d4329a90123e327fe9c59 Oct 27 03:35:46.341599 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:35:46.341599 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:35:46.341599 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:35:46.341599 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8bb5d291069d4329a90123e327fe9c59"}]}] Oct 27 03:35:46.341599 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:35:46.341599 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 8bb5d291069d4329a90123e327fe9c59 Oct 27 03:35:46.341599 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:35:46.341599 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServersNegativeTestJSON-4378389-project Oct 27 03:35:46.341599 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:35:46.341599 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:35:46.341599 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: f9c32b7626594ff888970c7f3227bb20 Oct 27 03:35:46.341599 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServersNegativeTestJSON-4378389-project Oct 27 03:35:46.341599 n-d-862769-1 devstack@n-api.service[121001]: Oct 27 03:35:46.341599 n-d-862769-1 devstack@n-api.service[121001]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": [{"uuid": "0f1ea857-e60a-4a6e-a6c9-70bfd2dd2db8"}]}} Oct 27 03:35:46.341599 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:35:46.341599 n-d-862769-1 devstack@n-api.service[121001]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 27 03:35:46.341599 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': 'c40fb871-5877-4b59-ab69-d9fd23b7a917', 'flavorRef': '452', 'networks': [{'uuid': '0f1ea857-e60a-4a6e-a6c9-70bfd2dd2db8'}]}}} Oct 27 03:35:46.341599 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:35:46.341599 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:35:46.341599 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 03:35:46.341599 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 03:35:46.341599 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 03:35:46.341599 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise error Oct 27 03:35:46.341599 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 27 03:35:46.341599 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:35:46.341599 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 27 03:35:46.341599 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 27 03:35:46.341599 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:35:46.341599 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 27 03:35:46.341599 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 27 03:35:46.341599 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:35:46.341599 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:35:46.341599 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:35:46.346900 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:35:46.346900 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:35:46.346900 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:35:46.346900 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:35:46.346900 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:35:46.346900 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:35:46.346900 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:35:46.346900 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:35:46.346900 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:35:46.346900 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 03:35:46.346900 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 03:35:46.346900 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 03:35:46.346900 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 03:35:46.346900 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 03:35:46.346900 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 03:35:46.346900 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 27 03:35:46.346900 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:35:46.346900 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:35:46.346900 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:35:46.346900 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:35:46.346900 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:35:46.346900 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:35:46.346900 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 03:35:46.346900 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 03:35:46.346900 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 27 03:35:46.346900 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:35:46.346900 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d704c2d4-4ebe-4600-a633-527d4b6ac2c6 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:35:46.349896 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d704c2d4-4ebe-4600-a633-527d4b6ac2c6 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.010722 Oct 27 03:35:46.352393 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1858/3483] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:35:46 2022] POST /compute/v2.1/servers => generated 619 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 03:35:46.364149 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4b9cbdc7-92e2-4666-b0c8-5052ea1b0b09 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:46.364785 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4b9cbdc7-92e2-4666-b0c8-5052ea1b0b09 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:46.376130 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4b9cbdc7-92e2-4666-b0c8-5052ea1b0b09 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:46.377385 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4b9cbdc7-92e2-4666-b0c8-5052ea1b0b09 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:46.377824 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4b9cbdc7-92e2-4666-b0c8-5052ea1b0b09 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:46.378851 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4b9cbdc7-92e2-4666-b0c8-5052ea1b0b09 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:46.379536 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4b9cbdc7-92e2-4666-b0c8-5052ea1b0b09 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:46.380180 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4b9cbdc7-92e2-4666-b0c8-5052ea1b0b09 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:46.871444 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4b9cbdc7-92e2-4666-b0c8-5052ea1b0b09 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:46.880630 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4b9cbdc7-92e2-4666-b0c8-5052ea1b0b09 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1505 microversion: 2.1 time: 0.523913 Oct 27 03:35:46.896507 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1859/3484] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:46 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1505 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:46.913872 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-20d3ad75-052c-489b-ae68-dbe2acc0ab58 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:46.915167 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-20d3ad75-052c-489b-ae68-dbe2acc0ab58 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] [instance: 8c8a2cbb-4acf-4a6b-b684-567617bb930d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:46.926065 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-20d3ad75-052c-489b-ae68-dbe2acc0ab58 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:46.926972 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-20d3ad75-052c-489b-ae68-dbe2acc0ab58 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:46.927632 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-20d3ad75-052c-489b-ae68-dbe2acc0ab58 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:46.928567 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-20d3ad75-052c-489b-ae68-dbe2acc0ab58 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:46.929265 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-20d3ad75-052c-489b-ae68-dbe2acc0ab58 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:46.929957 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-20d3ad75-052c-489b-ae68-dbe2acc0ab58 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:47.893114 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-20d3ad75-052c-489b-ae68-dbe2acc0ab58 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:47.924765 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-20d3ad75-052c-489b-ae68-dbe2acc0ab58 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:47.928614 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-20d3ad75-052c-489b-ae68-dbe2acc0ab58 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:47.937349 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-20d3ad75-052c-489b-ae68-dbe2acc0ab58 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d" status: 200 len: 1878 microversion: 2.42 time: 1.027043 Oct 27 03:35:47.940559 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1860/3485] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:35:46 2022] GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d => generated 1878 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:35:47.945962 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c72f6bd0-d074-46b1-83b0-305280329635 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7dd9e00e50>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:48.040037 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c72f6bd0-d074-46b1-83b0-305280329635 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images/42320033-6276-453e-b35d-504a52d80d70" status: 200 len: 1454 microversion: 2.1 time: 0.097713 Oct 27 03:35:48.040742 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1861/3486] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:35:47 2022] GET /compute/v2.1/images/42320033-6276-453e-b35d-504a52d80d70 => generated 1454 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:48.054385 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-bfd5d06c-732d-4c27-8bda-1e518dc869e1 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:48.055323 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-bfd5d06c-732d-4c27-8bda-1e518dc869e1 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:48.067923 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bfd5d06c-732d-4c27-8bda-1e518dc869e1 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:48.070709 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bfd5d06c-732d-4c27-8bda-1e518dc869e1 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:48.071431 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bfd5d06c-732d-4c27-8bda-1e518dc869e1 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:48.073278 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bfd5d06c-732d-4c27-8bda-1e518dc869e1 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:48.073918 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bfd5d06c-732d-4c27-8bda-1e518dc869e1 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:48.074638 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bfd5d06c-732d-4c27-8bda-1e518dc869e1 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:48.145039 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-732c1468-4ed5-42b0-8639-4b06b1c2401a tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:35:48.146012 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-732c1468-4ed5-42b0-8639-4b06b1c2401a tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:35:48.146694 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-732c1468-4ed5-42b0-8639-4b06b1c2401a tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:35:48.147397 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-732c1468-4ed5-42b0-8639-4b06b1c2401a tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:35:48.147993 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-732c1468-4ed5-42b0-8639-4b06b1c2401a tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:35:48.158512 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-732c1468-4ed5-42b0-8639-4b06b1c2401a tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:48.159371 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-732c1468-4ed5-42b0-8639-4b06b1c2401a tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:48.160019 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-732c1468-4ed5-42b0-8639-4b06b1c2401a tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:48.161097 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-732c1468-4ed5-42b0-8639-4b06b1c2401a tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:48.161725 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-732c1468-4ed5-42b0-8639-4b06b1c2401a tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:48.162356 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-732c1468-4ed5-42b0-8639-4b06b1c2401a tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:48.188161 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-732c1468-4ed5-42b0-8639-4b06b1c2401a tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Getting quotas for project e3a1ba64cf9c47d5bdae52477338099e. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:35:48.194693 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-732c1468-4ed5-42b0-8639-4b06b1c2401a tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Getting quotas for user 8d5d3f1bf1af4cd6884297b207597fcc and project e3a1ba64cf9c47d5bdae52477338099e. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:35:48.212897 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-732c1468-4ed5-42b0-8639-4b06b1c2401a tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:35:48.218830 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-732c1468-4ed5-42b0-8639-4b06b1c2401a tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] [instance: 2a1bda43-af44-432d-8992-94473a5f8b5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:35:48.424361 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-732c1468-4ed5-42b0-8639-4b06b1c2401a tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.353652 Oct 27 03:35:48.432493 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1626/3487] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:35:46 2022] POST /compute/v2.1/servers => generated 408 bytes in 2363 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 03:35:48.458454 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4d0ef3e2-ccc6-4fbf-8e1f-2826bea1e831 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:48.463884 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4d0ef3e2-ccc6-4fbf-8e1f-2826bea1e831 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] [instance: 09065cd4-8246-49ee-80fe-b4f1c11b468d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:48.479650 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4d0ef3e2-ccc6-4fbf-8e1f-2826bea1e831 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:48.480601 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4d0ef3e2-ccc6-4fbf-8e1f-2826bea1e831 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:48.481410 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4d0ef3e2-ccc6-4fbf-8e1f-2826bea1e831 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:48.483095 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4d0ef3e2-ccc6-4fbf-8e1f-2826bea1e831 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:48.483732 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4d0ef3e2-ccc6-4fbf-8e1f-2826bea1e831 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:48.484347 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4d0ef3e2-ccc6-4fbf-8e1f-2826bea1e831 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:48.496483 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:35:48.588099 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-bfd5d06c-732d-4c27-8bda-1e518dc869e1 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:48.600982 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-bfd5d06c-732d-4c27-8bda-1e518dc869e1 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1505 microversion: 2.1 time: 0.558284 Oct 27 03:35:48.603583 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1862/3488] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:48 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1505 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:48.640227 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6e71f1df-4474-4e3e-8795-af6d58b936c1 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:48.640227 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-6e71f1df-4474-4e3e-8795-af6d58b936c1 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] [instance: 2a1bda43-af44-432d-8992-94473a5f8b5d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:48.661014 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=4 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:35:48.779671 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6e71f1df-4474-4e3e-8795-af6d58b936c1 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d5d3f1bf1af4cd6884297b207597fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a1ba64cf9c47d5bdae52477338099e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:48.787844 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6e71f1df-4474-4e3e-8795-af6d58b936c1 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] 10.222.0.20 "GET /compute/v2.1/servers/2a1bda43-af44-432d-8992-94473a5f8b5d" status: 200 len: 1226 microversion: 2.1 time: 0.182763 Oct 27 03:35:48.791120 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1863/3489] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:48 2022] GET /compute/v2.1/servers/2a1bda43-af44-432d-8992-94473a5f8b5d => generated 1226 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:48.816332 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-65ac7d04-c057-4a53-862b-927271ab2fc1 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-243538418", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": -1, "networks": [{"uuid": "0f1ea857-e60a-4a6e-a6c9-70bfd2dd2db8"}]}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:35:48.858570 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-65ac7d04-c057-4a53-862b-927271ab2fc1 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] HTTP exception thrown: Flavor -1 could not be found. Oct 27 03:35:48.864064 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-65ac7d04-c057-4a53-862b-927271ab2fc1 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Request method failure captured: Oct 27 03:35:48.864064 n-d-862769-1 devstack@n-api.service[121001]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 03:35:48.864064 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:35:48.864064 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:35:48.864064 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:35:48.864064 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 205 Oct 27 03:35:48.864064 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:35:48.864064 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:35:48.864064 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:35:48.864064 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:35:48.864064 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfxF6ut9nM9a9AcpKLO7IgCu-akAJ2YJGjrI9C8NUveA8uObV2XgQIQvsIxuWjvLl9meIEqpfGwZYr8MTX_PAGoiJsNUPXh5ERSce5cPYQYCCFPL0HtTb-E11C_2kfWy1wRps1tClRNvtj8zAqCGRhs1x-Uvl0zISdfHepXmvWX31Us Oct 27 03:35:48.864064 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:35:48.864064 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:35:48.864064 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:35:48.864064 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:35:48.864064 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:35:48.864064 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:35:48.864064 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 8bb5d291069d4329a90123e327fe9c59 Oct 27 03:35:48.864064 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:35:48.864064 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:35:48.864064 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:35:48.864064 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8bb5d291069d4329a90123e327fe9c59"}]}] Oct 27 03:35:48.864064 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:35:48.864064 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 8bb5d291069d4329a90123e327fe9c59 Oct 27 03:35:48.864064 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:35:48.864064 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServersNegativeTestJSON-4378389-project Oct 27 03:35:48.864064 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:35:48.864064 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:35:48.864064 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: f9c32b7626594ff888970c7f3227bb20 Oct 27 03:35:48.864064 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServersNegativeTestJSON-4378389-project Oct 27 03:35:48.864064 n-d-862769-1 devstack@n-api.service[121001]: Oct 27 03:35:48.864064 n-d-862769-1 devstack@n-api.service[121001]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-243538418", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": -1, "networks": [{"uuid": "0f1ea857-e60a-4a6e-a6c9-70bfd2dd2db8"}]}} Oct 27 03:35:48.864064 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:35:48.864064 n-d-862769-1 devstack@n-api.service[121001]: exception: Flavor -1 could not be found. Oct 27 03:35:48.864064 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-243538418', 'imageRef': 'c40fb871-5877-4b59-ab69-d9fd23b7a917', 'flavorRef': -1, 'networks': [{'uuid': '0f1ea857-e60a-4a6e-a6c9-70bfd2dd2db8'}]}}} Oct 27 03:35:48.864064 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:35:48.864064 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:35:48.864064 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 27 03:35:48.864064 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 27 03:35:48.864064 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 27 03:35:48.864064 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 27 03:35:48.864064 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 03:35:48.864064 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 03:35:48.864064 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 27 03:35:48.864064 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 27 03:35:48.864064 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 27 03:35:48.864064 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:35:48.864064 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 27 03:35:48.864064 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 27 03:35:48.864064 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Oct 27 03:35:48.864064 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:35:48.864064 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:35:48.864064 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:35:48.864064 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:35:48.864064 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:35:48.864064 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:35:48.864064 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:35:48.864064 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:35:48.864064 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:35:48.864064 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:35:48.864064 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:35:48.864064 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:35:48.875390 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:35:48.875390 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:35:48.875390 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:35:48.875390 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:35:48.875390 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 27 03:35:48.875390 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 27 03:35:48.875390 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 27 03:35:48.875390 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Oct 27 03:35:48.875390 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:35:48.875390 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:35:48.875390 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:35:48.875390 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:35:48.875390 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:35:48.875390 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:35:48.875390 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:35:48.875390 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:35:48.875390 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Oct 27 03:35:48.875390 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:35:48.875390 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-65ac7d04-c057-4a53-862b-927271ab2fc1 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:35:48.875390 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-65ac7d04-c057-4a53-862b-927271ab2fc1 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.075001 Oct 27 03:35:48.875390 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1864/3490] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:35:48 2022] POST /compute/v2.1/servers => generated 73 bytes in 81 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 27 03:35:48.879646 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:35:48.885359 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8783efaf-e0f3-44ee-9179-623c54afb026 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:48.885998 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8783efaf-e0f3-44ee-9179-623c54afb026 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:48.892486 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8783efaf-e0f3-44ee-9179-623c54afb026 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:48.892990 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8783efaf-e0f3-44ee-9179-623c54afb026 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:48.893441 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8783efaf-e0f3-44ee-9179-623c54afb026 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:48.894181 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8783efaf-e0f3-44ee-9179-623c54afb026 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:48.894908 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8783efaf-e0f3-44ee-9179-623c54afb026 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:48.895402 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8783efaf-e0f3-44ee-9179-623c54afb026 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:49.113266 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4d0ef3e2-ccc6-4fbf-8e1f-2826bea1e831 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c36bef85ac34b4983a79e03c56965c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e58f30136ed4a4d9bff48e9b4cde5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:49.122352 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4d0ef3e2-ccc6-4fbf-8e1f-2826bea1e831 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] 10.222.0.20 "GET /compute/v2.1/servers/09065cd4-8246-49ee-80fe-b4f1c11b468d" status: 200 len: 1520 microversion: 2.1 time: 0.688526 Oct 27 03:35:49.123340 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1627/3491] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:48 2022] GET /compute/v2.1/servers/09065cd4-8246-49ee-80fe-b4f1c11b468d => generated 1520 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:49.156579 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9defcad1-d914-4084-9c37-b15756afcb57 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:49.161921 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9defcad1-d914-4084-9c37-b15756afcb57 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] [instance: 8c8a2cbb-4acf-4a6b-b684-567617bb930d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:49.195221 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9defcad1-d914-4084-9c37-b15756afcb57 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:49.195790 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9defcad1-d914-4084-9c37-b15756afcb57 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:49.196256 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9defcad1-d914-4084-9c37-b15756afcb57 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:49.197747 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9defcad1-d914-4084-9c37-b15756afcb57 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:49.205491 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9defcad1-d914-4084-9c37-b15756afcb57 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:49.205633 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9defcad1-d914-4084-9c37-b15756afcb57 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:49.335985 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8783efaf-e0f3-44ee-9179-623c54afb026 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:49.349022 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8783efaf-e0f3-44ee-9179-623c54afb026 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1505 microversion: 2.1 time: 0.474710 Oct 27 03:35:49.350417 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1865/3492] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:48 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1505 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:49.356061 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1cabaec6-dca3-4958-b7c5-773cbcaa2033 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7dd9de0a60>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:49.501374 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1cabaec6-dca3-4958-b7c5-773cbcaa2033 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images/42320033-6276-453e-b35d-504a52d80d70" status: 200 len: 1454 microversion: 2.1 time: 0.137170 Oct 27 03:35:49.502420 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1866/3493] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:35:49 2022] GET /compute/v2.1/images/42320033-6276-453e-b35d-504a52d80d70 => generated 1454 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:49.507851 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3e82c095-8341-4bb0-b7ae-54020b8cb812 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:49.508489 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3e82c095-8341-4bb0-b7ae-54020b8cb812 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] [instance: 09065cd4-8246-49ee-80fe-b4f1c11b468d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:49.517964 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3e82c095-8341-4bb0-b7ae-54020b8cb812 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:49.518490 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3e82c095-8341-4bb0-b7ae-54020b8cb812 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:49.518934 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3e82c095-8341-4bb0-b7ae-54020b8cb812 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:49.519656 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3e82c095-8341-4bb0-b7ae-54020b8cb812 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:49.520223 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3e82c095-8341-4bb0-b7ae-54020b8cb812 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:49.520560 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3e82c095-8341-4bb0-b7ae-54020b8cb812 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:49.520678 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9defcad1-d914-4084-9c37-b15756afcb57 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:49.526310 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=100 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:35:49.539864 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9defcad1-d914-4084-9c37-b15756afcb57 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:49.547354 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9defcad1-d914-4084-9c37-b15756afcb57 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:49.548787 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9defcad1-d914-4084-9c37-b15756afcb57 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d" status: 200 len: 1878 microversion: 2.42 time: 0.424391 Oct 27 03:35:49.549392 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1628/3494] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:35:49 2022] GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d => generated 1878 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:35:49.575995 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3eae43ad-9490-4e4d-8c04-dd230d2a8aca tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:49.582228 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-3eae43ad-9490-4e4d-8c04-dd230d2a8aca tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:49.596703 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3eae43ad-9490-4e4d-8c04-dd230d2a8aca tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:49.597468 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3eae43ad-9490-4e4d-8c04-dd230d2a8aca tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:49.598129 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3eae43ad-9490-4e4d-8c04-dd230d2a8aca tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:49.600279 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3eae43ad-9490-4e4d-8c04-dd230d2a8aca tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:49.602624 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3eae43ad-9490-4e4d-8c04-dd230d2a8aca tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:49.603393 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3eae43ad-9490-4e4d-8c04-dd230d2a8aca tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:49.797955 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-3eae43ad-9490-4e4d-8c04-dd230d2a8aca tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:49.807470 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3eae43ad-9490-4e4d-8c04-dd230d2a8aca tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1505 microversion: 2.1 time: 0.235386 Oct 27 03:35:49.808846 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1629/3495] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:49 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1505 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:49.814976 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e5d8c7eb-a4be-4d83-a1da-189461928532 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:49.815612 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e5d8c7eb-a4be-4d83-a1da-189461928532 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] [instance: 2a1bda43-af44-432d-8992-94473a5f8b5d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:49.916956 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e5d8c7eb-a4be-4d83-a1da-189461928532 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d5d3f1bf1af4cd6884297b207597fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a1ba64cf9c47d5bdae52477338099e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:49.927460 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e5d8c7eb-a4be-4d83-a1da-189461928532 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] 10.222.0.20 "GET /compute/v2.1/servers/2a1bda43-af44-432d-8992-94473a5f8b5d" status: 200 len: 1226 microversion: 2.1 time: 0.117158 Oct 27 03:35:49.929923 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1630/3496] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:49 2022] GET /compute/v2.1/servers/2a1bda43-af44-432d-8992-94473a5f8b5d => generated 1226 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:49.936627 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-593c1fd2-d3fe-4027-8522-ab9222557ff4 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-462586287", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "0f1ea857-e60a-4a6e-a6c9-70bfd2dd2db8"}]}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:35:49.941306 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-593c1fd2-d3fe-4027-8522-ab9222557ff4 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Request method failure captured: Oct 27 03:35:49.941306 n-d-862769-1 devstack@n-api.service[121000]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 03:35:49.941306 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:35:49.941306 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:35:49.941306 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:35:49.941306 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 172 Oct 27 03:35:49.941306 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:35:49.941306 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:35:49.941306 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:35:49.941306 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:35:49.941306 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfxF6ut9nM9a9AcpKLO7IgCu-akAJ2YJGjrI9C8NUveA8uObV2XgQIQvsIxuWjvLl9meIEqpfGwZYr8MTX_PAGoiJsNUPXh5ERSce5cPYQYCCFPL0HtTb-E11C_2kfWy1wRps1tClRNvtj8zAqCGRhs1x-Uvl0zISdfHepXmvWX31Us Oct 27 03:35:49.941306 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:35:49.941306 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:35:49.941306 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:35:49.941306 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:35:49.941306 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:35:49.941306 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:35:49.941306 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 8bb5d291069d4329a90123e327fe9c59 Oct 27 03:35:49.941306 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:35:49.941306 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:35:49.941306 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:35:49.941306 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8bb5d291069d4329a90123e327fe9c59"}]}] Oct 27 03:35:49.941306 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:35:49.941306 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 8bb5d291069d4329a90123e327fe9c59 Oct 27 03:35:49.941306 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:35:49.941306 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ServersNegativeTestJSON-4378389-project Oct 27 03:35:49.941306 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:35:49.941306 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:35:49.941306 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: f9c32b7626594ff888970c7f3227bb20 Oct 27 03:35:49.941306 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ServersNegativeTestJSON-4378389-project Oct 27 03:35:49.941306 n-d-862769-1 devstack@n-api.service[121000]: Oct 27 03:35:49.941306 n-d-862769-1 devstack@n-api.service[121000]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-462586287", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "0f1ea857-e60a-4a6e-a6c9-70bfd2dd2db8"}]}} Oct 27 03:35:49.941306 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:35:49.941306 n-d-862769-1 devstack@n-api.service[121000]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 27 03:35:49.941306 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-462586287', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '0f1ea857-e60a-4a6e-a6c9-70bfd2dd2db8'}]}}} Oct 27 03:35:49.941306 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:35:49.941306 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:35:49.941306 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 03:35:49.941306 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 03:35:49.941306 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 03:35:49.941306 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise error Oct 27 03:35:49.941306 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Oct 27 03:35:49.941306 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:35:49.941306 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Oct 27 03:35:49.941306 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Oct 27 03:35:49.941306 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Oct 27 03:35:49.941306 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:35:49.941306 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 27 03:35:49.941306 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi -1 Oct 27 03:35:49.941306 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:35:49.941306 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:35:49.941306 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:35:49.941306 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:35:49.941306 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:35:49.941306 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:35:49.941306 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:35:49.941306 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:35:49.941306 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:35:49.941306 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:35:49.941306 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:35:49.941306 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:35:49.941306 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 03:35:49.941306 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 03:35:49.941306 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 03:35:49.941306 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 03:35:49.945953 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 03:35:49.945953 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 03:35:49.945953 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 27 03:35:49.945953 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:35:49.945953 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:35:49.945953 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:35:49.945953 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:35:49.945953 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:35:49.945953 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:35:49.945953 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 03:35:49.945953 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 03:35:49.945953 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 27 03:35:49.945953 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:35:49.945953 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-593c1fd2-d3fe-4027-8522-ab9222557ff4 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:35:49.945953 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-593c1fd2-d3fe-4027-8522-ab9222557ff4 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.011344 Oct 27 03:35:49.947238 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1631/3497] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:35:49 2022] POST /compute/v2.1/servers => generated 145 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 03:35:49.956207 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-17c4e024-7725-4bac-a800-0ee5cd7e8d9b tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:49.957495 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-17c4e024-7725-4bac-a800-0ee5cd7e8d9b tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:49.965393 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-17c4e024-7725-4bac-a800-0ee5cd7e8d9b tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:49.968751 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-17c4e024-7725-4bac-a800-0ee5cd7e8d9b tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:49.968751 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-17c4e024-7725-4bac-a800-0ee5cd7e8d9b tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:49.968751 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-17c4e024-7725-4bac-a800-0ee5cd7e8d9b tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:49.968751 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-17c4e024-7725-4bac-a800-0ee5cd7e8d9b tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:49.968751 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-17c4e024-7725-4bac-a800-0ee5cd7e8d9b tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:50.141167 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-17c4e024-7725-4bac-a800-0ee5cd7e8d9b tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:50.150420 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-17c4e024-7725-4bac-a800-0ee5cd7e8d9b tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1505 microversion: 2.1 time: 0.201990 Oct 27 03:35:50.151474 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1632/3498] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:49 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1505 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:50.188815 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9011e5fd-f39c-44de-a6a6-fd9df134c5d0 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:50.189442 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9011e5fd-f39c-44de-a6a6-fd9df134c5d0 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:50.213772 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9011e5fd-f39c-44de-a6a6-fd9df134c5d0 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:50.214411 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9011e5fd-f39c-44de-a6a6-fd9df134c5d0 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:50.214872 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9011e5fd-f39c-44de-a6a6-fd9df134c5d0 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:50.215610 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9011e5fd-f39c-44de-a6a6-fd9df134c5d0 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:50.217575 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9011e5fd-f39c-44de-a6a6-fd9df134c5d0 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:50.217575 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9011e5fd-f39c-44de-a6a6-fd9df134c5d0 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:50.409689 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3e82c095-8341-4bb0-b7ae-54020b8cb812 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c36bef85ac34b4983a79e03c56965c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e58f30136ed4a4d9bff48e9b4cde5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:50.427116 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3e82c095-8341-4bb0-b7ae-54020b8cb812 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] 10.222.0.20 "GET /compute/v2.1/servers/09065cd4-8246-49ee-80fe-b4f1c11b468d" status: 200 len: 1520 microversion: 2.1 time: 0.923504 Oct 27 03:35:50.428259 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1867/3499] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:49 2022] GET /compute/v2.1/servers/09065cd4-8246-49ee-80fe-b4f1c11b468d => generated 1520 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:50.455931 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a6ecafff-9551-4f74-bd7c-77ddbc838d96 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:35:50.459980 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a6ecafff-9551-4f74-bd7c-77ddbc838d96 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:50.470220 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a6ecafff-9551-4f74-bd7c-77ddbc838d96 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:50.471893 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a6ecafff-9551-4f74-bd7c-77ddbc838d96 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:50.472609 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a6ecafff-9551-4f74-bd7c-77ddbc838d96 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:50.473688 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a6ecafff-9551-4f74-bd7c-77ddbc838d96 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:50.474283 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a6ecafff-9551-4f74-bd7c-77ddbc838d96 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:50.475079 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a6ecafff-9551-4f74-bd7c-77ddbc838d96 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:50.512113 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9011e5fd-f39c-44de-a6a6-fd9df134c5d0 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:50.521210 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9011e5fd-f39c-44de-a6a6-fd9df134c5d0 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1505 microversion: 2.1 time: 0.337326 Oct 27 03:35:50.538504 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1633/3500] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:50 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1505 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:50.552991 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-022e5741-d788-4de2-aed4-271912293909 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2075177614", "metadata": {"": ""}}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:35:50.561532 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-022e5741-d788-4de2-aed4-271912293909 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Request method failure captured: Oct 27 03:35:50.561532 n-d-862769-1 devstack@n-api.service[121000]: request: POST /compute/v2.1/servers/09065cd4-8246-49ee-80fe-b4f1c11b468d/action HTTP/1.1 Oct 27 03:35:50.561532 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:35:50.561532 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:35:50.561532 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:35:50.561532 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 107 Oct 27 03:35:50.561532 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:35:50.561532 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:35:50.561532 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:35:50.561532 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:35:50.561532 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfx5Hbc6ITbdSRFtS1-RYRPTs8xU2lFAIvTX0CRBjp8hijBP6KjJjfK-rUuEjncsIe7o_mkFNeieFkwqoNyxVxCVqSYWPgHA26VD6r86MpHHV_eFwebptw3rA_gpbw5SDVw15ZqeHqKSf2NQXZk1XM_suSoUNVero4I26u6VER7fLwA Oct 27 03:35:50.561532 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:35:50.561532 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:35:50.561532 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:35:50.561532 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:35:50.561532 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:35:50.561532 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:35:50.561532 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 2e58f30136ed4a4d9bff48e9b4cde5a8 Oct 27 03:35:50.561532 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-597177073 Oct 27 03:35:50.561532 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:35:50.561532 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:35:50.561532 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2e58f30136ed4a4d9bff48e9b4cde5a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2e58f30136ed4a4d9bff48e9b4cde5a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2e58f30136ed4a4d9bff48e9b4cde5a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2e58f30136ed4a4d9bff48e9b4cde5a8"}]}] Oct 27 03:35:50.561532 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-597177073 Oct 27 03:35:50.561532 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 2e58f30136ed4a4d9bff48e9b4cde5a8 Oct 27 03:35:50.561532 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-597177073 Oct 27 03:35:50.561532 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ImagesOneServerNegativeTestJSON-597177073-project Oct 27 03:35:50.561532 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:35:50.561532 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:35:50.561532 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 5c36bef85ac34b4983a79e03c56965c5 Oct 27 03:35:50.561532 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-597177073-project Oct 27 03:35:50.561532 n-d-862769-1 devstack@n-api.service[121000]: Oct 27 03:35:50.561532 n-d-862769-1 devstack@n-api.service[121000]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2075177614", "metadata": {"": ""}}} Oct 27 03:35:50.561532 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:35:50.561532 n-d-862769-1 devstack@n-api.service[121000]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 03:35:50.561532 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '09065cd4-8246-49ee-80fe-b4f1c11b468d', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-2075177614', 'metadata': {'': ''}}}} Oct 27 03:35:50.561532 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:35:50.561532 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:35:50.561532 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 03:35:50.561532 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 03:35:50.561532 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 03:35:50.561532 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise error Oct 27 03:35:50.561532 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 03:35:50.561532 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:35:50.561532 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 27 03:35:50.561532 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 27 03:35:50.561532 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 27 03:35:50.561532 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 27 03:35:50.561532 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 27 03:35:50.561532 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:35:50.561532 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 27 03:35:50.561532 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi {'': ''} Oct 27 03:35:50.561532 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:35:50.561532 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:35:50.561532 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:35:50.561532 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:35:50.561532 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:35:50.561532 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:35:50.561532 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:35:50.561532 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:35:50.561532 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:35:50.561532 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:35:50.561532 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:35:50.561532 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:35:50.561532 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 03:35:50.565760 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 03:35:50.565760 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 03:35:50.565760 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 03:35:50.565760 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 03:35:50.565760 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 03:35:50.565760 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 03:35:50.565760 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:35:50.565760 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:35:50.565760 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:35:50.565760 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:35:50.565760 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:35:50.565760 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:35:50.565760 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 03:35:50.565760 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 03:35:50.565760 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 03:35:50.565760 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:35:50.565760 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-022e5741-d788-4de2-aed4-271912293909 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:35:50.565760 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-022e5741-d788-4de2-aed4-271912293909 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] 10.222.0.20 "POST /compute/v2.1/servers/09065cd4-8246-49ee-80fe-b4f1c11b468d/action" status: 400 len: 170 microversion: 2.1 time: 0.020630 Oct 27 03:35:50.570872 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1634/3501] 10.222.0.20 () {60 vars in 1279 bytes} [Thu Oct 27 03:35:50 2022] POST /compute/v2.1/servers/09065cd4-8246-49ee-80fe-b4f1c11b468d/action => generated 170 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 03:35:50.576226 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0b38077c-d8e8-4f17-91fc-521624546cea tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7ddab9a820>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:50.710754 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0b38077c-d8e8-4f17-91fc-521624546cea tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images/42320033-6276-453e-b35d-504a52d80d70" status: 200 len: 1454 microversion: 2.1 time: 0.136036 Oct 27 03:35:50.711866 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1635/3502] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:35:50 2022] GET /compute/v2.1/images/42320033-6276-453e-b35d-504a52d80d70 => generated 1454 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:50.724462 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4ec74e36-a36b-457e-b554-ac854219e5d4 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:50.724462 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4ec74e36-a36b-457e-b554-ac854219e5d4 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] [instance: 09065cd4-8246-49ee-80fe-b4f1c11b468d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:50.743284 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4ec74e36-a36b-457e-b554-ac854219e5d4 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:50.802651 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4ec74e36-a36b-457e-b554-ac854219e5d4 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:50.802651 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4ec74e36-a36b-457e-b554-ac854219e5d4 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:50.802651 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4ec74e36-a36b-457e-b554-ac854219e5d4 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:50.802651 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4ec74e36-a36b-457e-b554-ac854219e5d4 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:50.802651 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4ec74e36-a36b-457e-b554-ac854219e5d4 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:50.903732 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4ec74e36-a36b-457e-b554-ac854219e5d4 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c36bef85ac34b4983a79e03c56965c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e58f30136ed4a4d9bff48e9b4cde5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:50.922862 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4ec74e36-a36b-457e-b554-ac854219e5d4 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] 10.222.0.20 "GET /compute/v2.1/servers/09065cd4-8246-49ee-80fe-b4f1c11b468d" status: 200 len: 1520 microversion: 2.1 time: 0.208791 Oct 27 03:35:50.923454 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1636/3503] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:50 2022] GET /compute/v2.1/servers/09065cd4-8246-49ee-80fe-b4f1c11b468d => generated 1520 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:50.932994 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0dc906f2-1b31-49d5-8494-a6f5d9485b20 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:50.933857 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0dc906f2-1b31-49d5-8494-a6f5d9485b20 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] [instance: 8c8a2cbb-4acf-4a6b-b684-567617bb930d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:50.942389 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0dc906f2-1b31-49d5-8494-a6f5d9485b20 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:50.943247 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0dc906f2-1b31-49d5-8494-a6f5d9485b20 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:50.944024 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0dc906f2-1b31-49d5-8494-a6f5d9485b20 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:50.944992 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0dc906f2-1b31-49d5-8494-a6f5d9485b20 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:50.945612 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0dc906f2-1b31-49d5-8494-a6f5d9485b20 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:50.946237 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0dc906f2-1b31-49d5-8494-a6f5d9485b20 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:51.147202 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a6ecafff-9551-4f74-bd7c-77ddbc838d96 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "POST /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86/action" status: 202 len: 0 microversion: 2.1 time: 0.701767 Oct 27 03:35:51.154426 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1868/3504] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:35:50 2022] POST /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86/action => generated 0 bytes in 725 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:35:51.172278 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-59444d9e-26fa-4a9f-8b0f-71f102b24add tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-555048884", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:35:51.177612 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-59444d9e-26fa-4a9f-8b0f-71f102b24add tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 27 03:35:51.186491 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-59444d9e-26fa-4a9f-8b0f-71f102b24add tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Request method failure captured: Oct 27 03:35:51.186491 n-d-862769-1 devstack@n-api.service[121001]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 03:35:51.186491 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:35:51.186491 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:35:51.186491 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:35:51.186491 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 215 Oct 27 03:35:51.186491 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:35:51.186491 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:35:51.186491 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:35:51.186491 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:35:51.186491 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfxF6ut9nM9a9AcpKLO7IgCu-akAJ2YJGjrI9C8NUveA8uObV2XgQIQvsIxuWjvLl9meIEqpfGwZYr8MTX_PAGoiJsNUPXh5ERSce5cPYQYCCFPL0HtTb-E11C_2kfWy1wRps1tClRNvtj8zAqCGRhs1x-Uvl0zISdfHepXmvWX31Us Oct 27 03:35:51.186491 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:35:51.186491 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:35:51.186491 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:35:51.186491 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:35:51.186491 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:35:51.186491 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:35:51.186491 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 8bb5d291069d4329a90123e327fe9c59 Oct 27 03:35:51.186491 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:35:51.186491 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:35:51.186491 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:35:51.186491 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8bb5d291069d4329a90123e327fe9c59"}]}] Oct 27 03:35:51.186491 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:35:51.186491 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 8bb5d291069d4329a90123e327fe9c59 Oct 27 03:35:51.186491 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:35:51.186491 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServersNegativeTestJSON-4378389-project Oct 27 03:35:51.186491 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:35:51.186491 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:35:51.186491 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: f9c32b7626594ff888970c7f3227bb20 Oct 27 03:35:51.186491 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServersNegativeTestJSON-4378389-project Oct 27 03:35:51.186491 n-d-862769-1 devstack@n-api.service[121001]: Oct 27 03:35:51.186491 n-d-862769-1 devstack@n-api.service[121001]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-555048884", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Oct 27 03:35:51.186491 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:35:51.186491 n-d-862769-1 devstack@n-api.service[121001]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 27 03:35:51.186491 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-555048884', 'imageRef': 'c40fb871-5877-4b59-ab69-d9fd23b7a917', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Oct 27 03:35:51.186491 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:35:51.186491 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:35:51.186491 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:35:51.186491 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:35:51.186491 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:35:51.186491 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:35:51.186491 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:35:51.186491 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:35:51.186491 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:35:51.186491 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:35:51.186491 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:35:51.186491 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:35:51.186491 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:35:51.186491 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:35:51.186491 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 27 03:35:51.186491 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Oct 27 03:35:51.186491 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Oct 27 03:35:51.186491 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Oct 27 03:35:51.186491 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Oct 27 03:35:51.186491 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Oct 27 03:35:51.186491 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self._validate_network_id( Oct 27 03:35:51.186491 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Oct 27 03:35:51.186491 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 27 03:35:51.186491 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 27 03:35:51.186491 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:35:51.186491 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:35:51.186491 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:35:51.193605 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:35:51.193605 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:35:51.193605 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:35:51.193605 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:35:51.193605 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:35:51.193605 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 27 03:35:51.193605 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:35:51.193605 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-59444d9e-26fa-4a9f-8b0f-71f102b24add tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:35:51.194988 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-59444d9e-26fa-4a9f-8b0f-71f102b24add tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.038583 Oct 27 03:35:51.196273 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1869/3505] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:35:51 2022] POST /compute/v2.1/servers => generated 123 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 03:35:51.202835 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0dc906f2-1b31-49d5-8494-a6f5d9485b20 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:51.210125 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-bf5d9ebb-7923-4df7-a429-5007ef0d9401 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:51.216734 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-bf5d9ebb-7923-4df7-a429-5007ef0d9401 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] [instance: 09065cd4-8246-49ee-80fe-b4f1c11b468d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:51.217964 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0dc906f2-1b31-49d5-8494-a6f5d9485b20 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:51.222829 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0dc906f2-1b31-49d5-8494-a6f5d9485b20 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:51.223205 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0dc906f2-1b31-49d5-8494-a6f5d9485b20 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d" status: 200 len: 1878 microversion: 2.42 time: 0.293956 Oct 27 03:35:51.224066 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1637/3506] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:35:50 2022] GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d => generated 1878 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:35:51.228921 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bf5d9ebb-7923-4df7-a429-5007ef0d9401 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:51.229489 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bf5d9ebb-7923-4df7-a429-5007ef0d9401 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:51.230028 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bf5d9ebb-7923-4df7-a429-5007ef0d9401 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:51.230830 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bf5d9ebb-7923-4df7-a429-5007ef0d9401 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:51.231357 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bf5d9ebb-7923-4df7-a429-5007ef0d9401 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:51.232019 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bf5d9ebb-7923-4df7-a429-5007ef0d9401 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:51.234387 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-dcda8157-3824-4630-850c-9f24f0d94cd2 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:51.235227 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-dcda8157-3824-4630-850c-9f24f0d94cd2 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] [instance: 2a1bda43-af44-432d-8992-94473a5f8b5d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:51.243153 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dcda8157-3824-4630-850c-9f24f0d94cd2 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:51.245798 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dcda8157-3824-4630-850c-9f24f0d94cd2 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:51.245798 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dcda8157-3824-4630-850c-9f24f0d94cd2 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:51.245798 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dcda8157-3824-4630-850c-9f24f0d94cd2 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:51.245798 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dcda8157-3824-4630-850c-9f24f0d94cd2 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:51.245798 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dcda8157-3824-4630-850c-9f24f0d94cd2 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:51.416740 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-dcda8157-3824-4630-850c-9f24f0d94cd2 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d5d3f1bf1af4cd6884297b207597fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a1ba64cf9c47d5bdae52477338099e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:51.443286 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-dcda8157-3824-4630-850c-9f24f0d94cd2 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] 10.222.0.20 "GET /compute/v2.1/servers/2a1bda43-af44-432d-8992-94473a5f8b5d" status: 200 len: 1278 microversion: 2.1 time: 0.205550 Oct 27 03:35:51.443286 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1638/3507] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:51 2022] GET /compute/v2.1/servers/2a1bda43-af44-432d-8992-94473a5f8b5d => generated 1278 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:51.443286 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-46087590-26c1-4772-a000-4aa92a6e310e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:51.443286 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-46087590-26c1-4772-a000-4aa92a6e310e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:51.453802 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-46087590-26c1-4772-a000-4aa92a6e310e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:51.454347 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-46087590-26c1-4772-a000-4aa92a6e310e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:51.454784 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-46087590-26c1-4772-a000-4aa92a6e310e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:51.455510 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-46087590-26c1-4772-a000-4aa92a6e310e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:51.455970 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-46087590-26c1-4772-a000-4aa92a6e310e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:51.456407 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-46087590-26c1-4772-a000-4aa92a6e310e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:51.613740 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-bf5d9ebb-7923-4df7-a429-5007ef0d9401 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c36bef85ac34b4983a79e03c56965c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e58f30136ed4a4d9bff48e9b4cde5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:51.626219 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-bf5d9ebb-7923-4df7-a429-5007ef0d9401 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] 10.222.0.20 "GET /compute/v2.1/servers/09065cd4-8246-49ee-80fe-b4f1c11b468d" status: 200 len: 1520 microversion: 2.1 time: 0.424679 Oct 27 03:35:51.627586 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1870/3508] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:51 2022] GET /compute/v2.1/servers/09065cd4-8246-49ee-80fe-b4f1c11b468d => generated 1520 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:51.632698 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e323889d-3b41-41ad-9848-32b7e82122ab tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:51.645137 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e323889d-3b41-41ad-9848-32b7e82122ab tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:51.651594 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e323889d-3b41-41ad-9848-32b7e82122ab tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:51.652160 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e323889d-3b41-41ad-9848-32b7e82122ab tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:51.652810 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e323889d-3b41-41ad-9848-32b7e82122ab tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:51.653698 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e323889d-3b41-41ad-9848-32b7e82122ab tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:51.654340 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e323889d-3b41-41ad-9848-32b7e82122ab tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:51.657875 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e323889d-3b41-41ad-9848-32b7e82122ab tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:51.811956 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-46087590-26c1-4772-a000-4aa92a6e310e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:51.823266 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-46087590-26c1-4772-a000-4aa92a6e310e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1671 microversion: 2.1 time: 0.389708 Oct 27 03:35:51.824591 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1639/3509] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:51 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1671 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:51.830774 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1cad0467-b071-47b1-bd84-26c776be0e8c tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-837115934", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "015ce8ac-7a6f-4fac-a9b8-c0d16c24afe3"}], "security_groups": [{"name": "tempest-securitygroup--574465379"}], "key_name": "tempest-keypair-56934881", "user_data": "}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:35:52.028271 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e323889d-3b41-41ad-9848-32b7e82122ab tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:52.035762 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-1cad0467-b071-47b1-bd84-26c776be0e8c tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] validate_networks() for [('015ce8ac-7a6f-4fac-a9b8-c0d16c24afe3', None, None, None, None, None)] {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:35:52.041874 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e323889d-3b41-41ad-9848-32b7e82122ab tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1505 microversion: 2.1 time: 0.412880 Oct 27 03:35:52.052451 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1871/3510] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:51 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1505 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:52.066014 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8b78d0c9-a45a-4de1-a381-d748019c4e3d tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-268426726", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:35:52.070143 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8b78d0c9-a45a-4de1-a381-d748019c4e3d tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Request method failure captured: Oct 27 03:35:52.070143 n-d-862769-1 devstack@n-api.service[121001]: request: POST /compute/v2.1/servers/09065cd4-8246-49ee-80fe-b4f1c11b468d/action HTTP/1.1 Oct 27 03:35:52.070143 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:35:52.070143 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:35:52.070143 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:35:52.070143 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 618 Oct 27 03:35:52.070143 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:35:52.070143 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:35:52.070143 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:35:52.070143 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:35:52.070143 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfx5Hbc6ITbdSRFtS1-RYRPTs8xU2lFAIvTX0CRBjp8hijBP6KjJjfK-rUuEjncsIe7o_mkFNeieFkwqoNyxVxCVqSYWPgHA26VD6r86MpHHV_eFwebptw3rA_gpbw5SDVw15ZqeHqKSf2NQXZk1XM_suSoUNVero4I26u6VER7fLwA Oct 27 03:35:52.070143 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:35:52.070143 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:35:52.070143 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:35:52.070143 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:35:52.070143 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:35:52.070143 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:35:52.070143 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 2e58f30136ed4a4d9bff48e9b4cde5a8 Oct 27 03:35:52.070143 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-597177073 Oct 27 03:35:52.070143 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:35:52.070143 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:35:52.070143 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2e58f30136ed4a4d9bff48e9b4cde5a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2e58f30136ed4a4d9bff48e9b4cde5a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2e58f30136ed4a4d9bff48e9b4cde5a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2e58f30136ed4a4d9bff48e9b4cde5a8"}]}] Oct 27 03:35:52.070143 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-597177073 Oct 27 03:35:52.070143 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 2e58f30136ed4a4d9bff48e9b4cde5a8 Oct 27 03:35:52.070143 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-597177073 Oct 27 03:35:52.070143 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ImagesOneServerNegativeTestJSON-597177073-project Oct 27 03:35:52.070143 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:35:52.070143 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:35:52.070143 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 5c36bef85ac34b4983a79e03c56965c5 Oct 27 03:35:52.070143 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-597177073-project Oct 27 03:35:52.070143 n-d-862769-1 devstack@n-api.service[121001]: Oct 27 03:35:52.070143 n-d-862769-1 devstack@n-api.service[121001]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-268426726", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Oct 27 03:35:52.070143 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:35:52.070143 n-d-862769-1 devstack@n-api.service[121001]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 03:35:52.070143 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '09065cd4-8246-49ee-80fe-b4f1c11b468d', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-268426726', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Oct 27 03:35:52.070143 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:35:52.070143 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:35:52.070143 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 03:35:52.070143 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 03:35:52.070143 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 03:35:52.070143 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise error Oct 27 03:35:52.073062 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 03:35:52.073062 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:35:52.073062 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 27 03:35:52.073062 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 27 03:35:52.073062 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 27 03:35:52.073062 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 27 03:35:52.073062 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 27 03:35:52.073062 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:35:52.073062 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 27 03:35:52.073062 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Oct 27 03:35:52.073062 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:35:52.073062 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:35:52.073062 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:35:52.073062 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:35:52.073062 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:35:52.073062 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:35:52.073062 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:35:52.073062 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:35:52.073062 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:35:52.073062 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:35:52.073062 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:35:52.073062 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:35:52.073062 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 03:35:52.073062 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 03:35:52.073062 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 03:35:52.073062 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 03:35:52.073062 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 03:35:52.073062 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 03:35:52.073062 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 03:35:52.073062 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:35:52.073062 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:35:52.073062 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:35:52.073062 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:35:52.073062 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:35:52.073062 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:35:52.073062 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 03:35:52.073062 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 03:35:52.073062 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 03:35:52.073062 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:35:52.077421 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8b78d0c9-a45a-4de1-a381-d748019c4e3d tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:35:52.078497 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8b78d0c9-a45a-4de1-a381-d748019c4e3d tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] 10.222.0.20 "POST /compute/v2.1/servers/09065cd4-8246-49ee-80fe-b4f1c11b468d/action" status: 400 len: 938 microversion: 2.1 time: 0.019323 Oct 27 03:35:52.079395 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1872/3511] 10.222.0.20 () {60 vars in 1279 bytes} [Thu Oct 27 03:35:52 2022] POST /compute/v2.1/servers/09065cd4-8246-49ee-80fe-b4f1c11b468d/action => generated 938 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 03:35:52.084440 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-69904502-1866-4cec-85a1-2d6ee8e44bc2 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7dd9da25e0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:52.171539 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-69904502-1866-4cec-85a1-2d6ee8e44bc2 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images/42320033-6276-453e-b35d-504a52d80d70" status: 200 len: 1454 microversion: 2.1 time: 0.090795 Oct 27 03:35:52.173072 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1873/3512] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:35:52 2022] GET /compute/v2.1/images/42320033-6276-453e-b35d-504a52d80d70 => generated 1454 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:52.190094 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-536503c9-ced5-40c8-9373-7d0b086c5f23 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:52.190728 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-536503c9-ced5-40c8-9373-7d0b086c5f23 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:52.197189 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-536503c9-ced5-40c8-9373-7d0b086c5f23 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:52.197692 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-536503c9-ced5-40c8-9373-7d0b086c5f23 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:52.198167 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-536503c9-ced5-40c8-9373-7d0b086c5f23 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:52.198879 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-536503c9-ced5-40c8-9373-7d0b086c5f23 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:52.199334 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-536503c9-ced5-40c8-9373-7d0b086c5f23 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:52.199765 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-536503c9-ced5-40c8-9373-7d0b086c5f23 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:52.533888 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-536503c9-ced5-40c8-9373-7d0b086c5f23 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:52.543157 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-536503c9-ced5-40c8-9373-7d0b086c5f23 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1505 microversion: 2.1 time: 0.369020 Oct 27 03:35:52.546951 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1874/3513] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:52 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1505 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:52.557291 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ff438a10-331d-411c-bbaa-cd9283701ce2 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:52.558304 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ff438a10-331d-411c-bbaa-cd9283701ce2 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] [instance: 09065cd4-8246-49ee-80fe-b4f1c11b468d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:52.571988 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ff438a10-331d-411c-bbaa-cd9283701ce2 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:52.577660 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ff438a10-331d-411c-bbaa-cd9283701ce2 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:52.578522 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ff438a10-331d-411c-bbaa-cd9283701ce2 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:52.579503 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ff438a10-331d-411c-bbaa-cd9283701ce2 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:52.580190 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ff438a10-331d-411c-bbaa-cd9283701ce2 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:52.580854 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ff438a10-331d-411c-bbaa-cd9283701ce2 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:52.883761 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ff438a10-331d-411c-bbaa-cd9283701ce2 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c36bef85ac34b4983a79e03c56965c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e58f30136ed4a4d9bff48e9b4cde5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:52.895961 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ff438a10-331d-411c-bbaa-cd9283701ce2 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] 10.222.0.20 "GET /compute/v2.1/servers/09065cd4-8246-49ee-80fe-b4f1c11b468d" status: 200 len: 1520 microversion: 2.1 time: 0.347601 Oct 27 03:35:52.915794 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1875/3514] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:52 2022] GET /compute/v2.1/servers/09065cd4-8246-49ee-80fe-b4f1c11b468d => generated 1520 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:52.931227 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ccaff7a5-f6f6-4482-9e63-f75e8afae01f tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:52.933757 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ccaff7a5-f6f6-4482-9e63-f75e8afae01f tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] [instance: 2410110f-fee8-4669-be8c-5137af8f074f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:52.946779 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ccaff7a5-f6f6-4482-9e63-f75e8afae01f tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:52.947743 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ccaff7a5-f6f6-4482-9e63-f75e8afae01f tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:52.948994 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ccaff7a5-f6f6-4482-9e63-f75e8afae01f tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:52.951032 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ccaff7a5-f6f6-4482-9e63-f75e8afae01f tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:52.952138 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ccaff7a5-f6f6-4482-9e63-f75e8afae01f tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:52.955720 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ccaff7a5-f6f6-4482-9e63-f75e8afae01f tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:52.983992 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-ccaff7a5-f6f6-4482-9e63-f75e8afae01f tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] HTTP exception thrown: Instance 2410110f-fee8-4669-be8c-5137af8f074f could not be found. Oct 27 03:35:52.985979 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ccaff7a5-f6f6-4482-9e63-f75e8afae01f tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Request method failure captured: Oct 27 03:35:52.985979 n-d-862769-1 devstack@n-api.service[121001]: request: DELETE /compute/v2.1/servers/2410110f-fee8-4669-be8c-5137af8f074f HTTP/1.1 Oct 27 03:35:52.985979 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:35:52.985979 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:35:52.985979 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:35:52.985979 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:35:52.985979 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:35:52.985979 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:35:52.985979 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:35:52.985979 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:35:52.985979 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfwOWA1Mstb05mKjlVTTupe8YH9xrCf5f9L9Cychzb-w58cm7Umv8orXhO3n_av1vEBdRM_JzsuN71tTo5mU4bcMgJUicRJX-U2IA0MbsE24CxaW8npw75W0q7d1gJRSnDxKQJKYsgopXJhS0nx9kmDtcpnoCVJn5M9CIhzppuqGVC4 Oct 27 03:35:52.985979 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:35:52.985979 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:35:52.985979 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:35:52.985979 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:35:52.985979 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:35:52.985979 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:35:52.985979 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 2057593072c14804ab70fe4bdea2c17c Oct 27 03:35:52.985979 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServersTestMultiNic-1635442954 Oct 27 03:35:52.985979 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:35:52.985979 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:35:52.985979 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2057593072c14804ab70fe4bdea2c17c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2057593072c14804ab70fe4bdea2c17c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2057593072c14804ab70fe4bdea2c17c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2057593072c14804ab70fe4bdea2c17c"}]}] Oct 27 03:35:52.985979 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServersTestMultiNic-1635442954 Oct 27 03:35:52.985979 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 2057593072c14804ab70fe4bdea2c17c Oct 27 03:35:52.985979 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServersTestMultiNic-1635442954 Oct 27 03:35:52.985979 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServersTestMultiNic-1635442954-project Oct 27 03:35:52.985979 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:35:52.985979 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:35:52.985979 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 881f054c84d04ceaa17a5817816022d4 Oct 27 03:35:52.985979 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServersTestMultiNic-1635442954-project Oct 27 03:35:52.985979 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:35:52.985979 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 2410110f-fee8-4669-be8c-5137af8f074f could not be found. Oct 27 03:35:52.985979 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '2410110f-fee8-4669-be8c-5137af8f074f'} Oct 27 03:35:52.985979 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:35:52.985979 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:35:52.985979 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:35:52.985979 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:35:52.985979 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:35:52.985979 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:35:52.985979 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:35:52.985979 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:35:52.985979 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:35:52.985979 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:35:52.985979 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2410110f-fee8-4669-be8c-5137af8f074f could not be found. Oct 27 03:35:52.985979 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:35:52.985979 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:35:52.985979 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:35:52.985979 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:35:52.985979 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:35:52.985979 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:35:52.985979 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:35:52.985979 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:35:52.985979 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:35:52.985979 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:35:52.985979 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 03:35:52.985979 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 03:35:52.985979 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 03:35:52.985979 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 03:35:52.985979 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:35:52.985979 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:35:52.985979 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:35:52.985979 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:35:52.990143 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2410110f-fee8-4669-be8c-5137af8f074f could not be found. Oct 27 03:35:52.990143 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:35:52.990143 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:35:52.990143 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:35:52.990143 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:35:52.990143 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:35:52.990143 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:35:52.990143 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:35:52.990143 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:35:52.990143 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2410110f-fee8-4669-be8c-5137af8f074f could not be found. Oct 27 03:35:52.990143 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:35:52.992297 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ccaff7a5-f6f6-4482-9e63-f75e8afae01f tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Returning 404 to user: Instance 2410110f-fee8-4669-be8c-5137af8f074f could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:35:52.993873 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ccaff7a5-f6f6-4482-9e63-f75e8afae01f tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2410110f-fee8-4669-be8c-5137af8f074f" status: 404 len: 111 microversion: 2.1 time: 0.070011 Oct 27 03:35:52.998787 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1876/3515] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:35:52 2022] DELETE /compute/v2.1/servers/2410110f-fee8-4669-be8c-5137af8f074f => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:35:53.005171 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7e64e65e-a0a1-40f1-8c8f-0dfa551c6cd8 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:53.006136 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7e64e65e-a0a1-40f1-8c8f-0dfa551c6cd8 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] [instance: 8c8a2cbb-4acf-4a6b-b684-567617bb930d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:53.016852 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7e64e65e-a0a1-40f1-8c8f-0dfa551c6cd8 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:53.017874 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7e64e65e-a0a1-40f1-8c8f-0dfa551c6cd8 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:53.018592 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7e64e65e-a0a1-40f1-8c8f-0dfa551c6cd8 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:53.019533 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7e64e65e-a0a1-40f1-8c8f-0dfa551c6cd8 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:53.020214 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7e64e65e-a0a1-40f1-8c8f-0dfa551c6cd8 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:53.020886 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7e64e65e-a0a1-40f1-8c8f-0dfa551c6cd8 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:53.229042 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-1cad0467-b071-47b1-bd84-26c776be0e8c tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:35:53.229633 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-1cad0467-b071-47b1-bd84-26c776be0e8c tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:35:53.230406 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-1cad0467-b071-47b1-bd84-26c776be0e8c tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:35:53.231846 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-1cad0467-b071-47b1-bd84-26c776be0e8c tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:35:53.232507 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-1cad0467-b071-47b1-bd84-26c776be0e8c tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:35:53.246329 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1cad0467-b071-47b1-bd84-26c776be0e8c tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:53.250517 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1cad0467-b071-47b1-bd84-26c776be0e8c tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:53.250517 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1cad0467-b071-47b1-bd84-26c776be0e8c tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:53.250517 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1cad0467-b071-47b1-bd84-26c776be0e8c tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:53.250517 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1cad0467-b071-47b1-bd84-26c776be0e8c tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:53.250517 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1cad0467-b071-47b1-bd84-26c776be0e8c tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:53.251077 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7e64e65e-a0a1-40f1-8c8f-0dfa551c6cd8 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:53.273175 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7e64e65e-a0a1-40f1-8c8f-0dfa551c6cd8 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:53.275075 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7e64e65e-a0a1-40f1-8c8f-0dfa551c6cd8 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:53.278189 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7e64e65e-a0a1-40f1-8c8f-0dfa551c6cd8 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d" status: 200 len: 1878 microversion: 2.42 time: 0.277716 Oct 27 03:35:53.279595 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-1cad0467-b071-47b1-bd84-26c776be0e8c tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Getting quotas for project 229dcb63bc41444391544883b576ce2e. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:35:53.282337 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1877/3516] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:35:52 2022] GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d => generated 1878 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:35:53.287477 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-1cad0467-b071-47b1-bd84-26c776be0e8c tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Getting quotas for user 18036411a99e4634bfbaeae24b9f254d and project 229dcb63bc41444391544883b576ce2e. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:35:53.290790 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2540e754-6cce-4442-ba85-3d32a65d18d3 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:53.292066 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2540e754-6cce-4442-ba85-3d32a65d18d3 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] [instance: 2a1bda43-af44-432d-8992-94473a5f8b5d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:53.300722 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2540e754-6cce-4442-ba85-3d32a65d18d3 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:53.301644 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2540e754-6cce-4442-ba85-3d32a65d18d3 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:53.302684 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2540e754-6cce-4442-ba85-3d32a65d18d3 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:53.303700 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2540e754-6cce-4442-ba85-3d32a65d18d3 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:53.304686 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2540e754-6cce-4442-ba85-3d32a65d18d3 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:53.304909 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1cad0467-b071-47b1-bd84-26c776be0e8c tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:35:53.305660 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2540e754-6cce-4442-ba85-3d32a65d18d3 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:53.307470 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1cad0467-b071-47b1-bd84-26c776be0e8c tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: c5c50ae8-6217-4650-8420-291847e21ace] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:35:53.399362 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2540e754-6cce-4442-ba85-3d32a65d18d3 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d5d3f1bf1af4cd6884297b207597fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a1ba64cf9c47d5bdae52477338099e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:53.408873 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2540e754-6cce-4442-ba85-3d32a65d18d3 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] 10.222.0.20 "GET /compute/v2.1/servers/2a1bda43-af44-432d-8992-94473a5f8b5d" status: 200 len: 1284 microversion: 2.1 time: 0.125220 Oct 27 03:35:53.409475 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1878/3517] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:53 2022] GET /compute/v2.1/servers/2a1bda43-af44-432d-8992-94473a5f8b5d => generated 1284 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:53.452248 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1cad0467-b071-47b1-bd84-26c776be0e8c tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.626148 Oct 27 03:35:53.453483 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1640/3518] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:35:51 2022] POST /compute/v2.1/servers => generated 401 bytes in 1628 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 03:35:53.459190 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b90db584-903d-4fa4-8f42-d1f3e005ee4d tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-621132400", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "key_name": "tempest-key-1876630866", "networks": [{"uuid": "0f1ea857-e60a-4a6e-a6c9-70bfd2dd2db8"}]}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:35:53.463399 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c73da49a-3237-49ce-86ab-a7798c53c6d4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:53.466447 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c73da49a-3237-49ce-86ab-a7798c53c6d4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:53.483772 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c73da49a-3237-49ce-86ab-a7798c53c6d4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:53.485792 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c73da49a-3237-49ce-86ab-a7798c53c6d4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:53.486461 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c73da49a-3237-49ce-86ab-a7798c53c6d4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:53.487412 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c73da49a-3237-49ce-86ab-a7798c53c6d4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:53.490464 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c73da49a-3237-49ce-86ab-a7798c53c6d4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:53.491145 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c73da49a-3237-49ce-86ab-a7798c53c6d4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:53.569751 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.network.neutron [None req-b90db584-903d-4fa4-8f42-d1f3e005ee4d tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] validate_networks() for [('0f1ea857-e60a-4a6e-a6c9-70bfd2dd2db8', None, None, None, None, None)] {{(pid=121001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:35:53.789314 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c73da49a-3237-49ce-86ab-a7798c53c6d4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:53.808525 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c73da49a-3237-49ce-86ab-a7798c53c6d4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1676 microversion: 2.1 time: 0.353661 Oct 27 03:35:53.809762 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1641/3519] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:53 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1676 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:53.814352 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e9b62573-f5b7-4358-971a-de6e9b0224d9 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:53.814981 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e9b62573-f5b7-4358-971a-de6e9b0224d9 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] [instance: 09065cd4-8246-49ee-80fe-b4f1c11b468d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:53.826797 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e9b62573-f5b7-4358-971a-de6e9b0224d9 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:53.828771 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e9b62573-f5b7-4358-971a-de6e9b0224d9 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:53.830341 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e9b62573-f5b7-4358-971a-de6e9b0224d9 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:53.831868 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e9b62573-f5b7-4358-971a-de6e9b0224d9 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:53.838692 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e9b62573-f5b7-4358-971a-de6e9b0224d9 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:53.839390 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e9b62573-f5b7-4358-971a-de6e9b0224d9 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:53.945682 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-b90db584-903d-4fa4-8f42-d1f3e005ee4d tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] HTTP exception thrown: Invalid key_name provided. Oct 27 03:35:53.948012 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b90db584-903d-4fa4-8f42-d1f3e005ee4d tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Request method failure captured: Oct 27 03:35:53.948012 n-d-862769-1 devstack@n-api.service[121001]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 03:35:53.948012 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:35:53.948012 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:35:53.948012 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:35:53.948012 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 246 Oct 27 03:35:53.948012 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:35:53.948012 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:35:53.948012 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:35:53.948012 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:35:53.948012 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfxF6ut9nM9a9AcpKLO7IgCu-akAJ2YJGjrI9C8NUveA8uObV2XgQIQvsIxuWjvLl9meIEqpfGwZYr8MTX_PAGoiJsNUPXh5ERSce5cPYQYCCFPL0HtTb-E11C_2kfWy1wRps1tClRNvtj8zAqCGRhs1x-Uvl0zISdfHepXmvWX31Us Oct 27 03:35:53.948012 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:35:53.948012 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:35:53.948012 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:35:53.948012 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:35:53.948012 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:35:53.948012 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:35:53.948012 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 8bb5d291069d4329a90123e327fe9c59 Oct 27 03:35:53.948012 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:35:53.948012 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:35:53.948012 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:35:53.948012 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8bb5d291069d4329a90123e327fe9c59"}]}] Oct 27 03:35:53.948012 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:35:53.948012 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 8bb5d291069d4329a90123e327fe9c59 Oct 27 03:35:53.948012 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:35:53.948012 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServersNegativeTestJSON-4378389-project Oct 27 03:35:53.948012 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:35:53.948012 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:35:53.948012 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: f9c32b7626594ff888970c7f3227bb20 Oct 27 03:35:53.948012 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServersNegativeTestJSON-4378389-project Oct 27 03:35:53.948012 n-d-862769-1 devstack@n-api.service[121001]: Oct 27 03:35:53.948012 n-d-862769-1 devstack@n-api.service[121001]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-621132400", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "key_name": "tempest-key-1876630866", "networks": [{"uuid": "0f1ea857-e60a-4a6e-a6c9-70bfd2dd2db8"}]}} Oct 27 03:35:53.948012 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:35:53.948012 n-d-862769-1 devstack@n-api.service[121001]: exception: Invalid key_name provided. Oct 27 03:35:53.948012 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-621132400', 'imageRef': 'c40fb871-5877-4b59-ab69-d9fd23b7a917', 'flavorRef': '452', 'key_name': 'tempest-key-1876630866', 'networks': [{'uuid': '0f1ea857-e60a-4a6e-a6c9-70bfd2dd2db8'}]}}} Oct 27 03:35:53.948012 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:35:53.948012 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:35:53.948012 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 27 03:35:53.948012 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 27 03:35:53.948012 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 27 03:35:53.948012 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 27 03:35:53.948012 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 27 03:35:53.948012 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 27 03:35:53.948012 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Oct 27 03:35:53.948012 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Oct 27 03:35:53.948012 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 03:35:53.948012 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 03:35:53.948012 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 27 03:35:53.948012 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 27 03:35:53.948012 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 27 03:35:53.948012 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 27 03:35:53.948012 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 03:35:53.948012 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 03:35:53.948012 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 27 03:35:53.948012 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 27 03:35:53.948012 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-1876630866 not found for user f9c32b7626594ff888970c7f3227bb20 Oct 27 03:35:53.948012 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:35:53.948012 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:35:53.948012 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:35:53.948012 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:35:53.948012 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:35:53.953611 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:35:53.953611 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:35:53.953611 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:35:53.953611 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:35:53.953611 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:35:53.953611 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:35:53.953611 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:35:53.953611 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:35:53.953611 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:35:53.953611 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:35:53.953611 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:35:53.953611 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 27 03:35:53.953611 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Oct 27 03:35:53.953611 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 27 03:35:53.953611 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Oct 27 03:35:53.953611 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:35:53.953611 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:35:53.953611 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:35:53.953611 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:35:53.953611 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:35:53.953611 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:35:53.953611 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:35:53.953611 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:35:53.953611 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Oct 27 03:35:53.953611 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:35:53.953611 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b90db584-903d-4fa4-8f42-d1f3e005ee4d tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Returning 400 to user: Invalid key_name provided. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:35:53.956424 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b90db584-903d-4fa4-8f42-d1f3e005ee4d tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.528272 Oct 27 03:35:53.963090 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1879/3520] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:35:53 2022] POST /compute/v2.1/servers => generated 70 bytes in 553 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 27 03:35:53.968734 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2c7f2ceb-7357-4cd5-8ed7-a09119382989 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:53.969473 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2c7f2ceb-7357-4cd5-8ed7-a09119382989 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] [instance: 2410110f-fee8-4669-be8c-5137af8f074f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:53.976327 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2c7f2ceb-7357-4cd5-8ed7-a09119382989 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:53.977274 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2c7f2ceb-7357-4cd5-8ed7-a09119382989 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:53.978610 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2c7f2ceb-7357-4cd5-8ed7-a09119382989 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:53.979435 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2c7f2ceb-7357-4cd5-8ed7-a09119382989 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:53.979999 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2c7f2ceb-7357-4cd5-8ed7-a09119382989 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:53.980718 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2c7f2ceb-7357-4cd5-8ed7-a09119382989 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:53.995860 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-2c7f2ceb-7357-4cd5-8ed7-a09119382989 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] HTTP exception thrown: Instance 2410110f-fee8-4669-be8c-5137af8f074f could not be found. Oct 27 03:35:53.997853 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2c7f2ceb-7357-4cd5-8ed7-a09119382989 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Request method failure captured: Oct 27 03:35:53.997853 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/2410110f-fee8-4669-be8c-5137af8f074f HTTP/1.1 Oct 27 03:35:53.997853 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:35:53.997853 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:35:53.997853 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:35:53.997853 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:35:53.997853 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:35:53.997853 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:35:53.997853 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:35:53.997853 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:35:53.997853 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfwOWA1Mstb05mKjlVTTupe8YH9xrCf5f9L9Cychzb-w58cm7Umv8orXhO3n_av1vEBdRM_JzsuN71tTo5mU4bcMgJUicRJX-U2IA0MbsE24CxaW8npw75W0q7d1gJRSnDxKQJKYsgopXJhS0nx9kmDtcpnoCVJn5M9CIhzppuqGVC4 Oct 27 03:35:53.997853 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:35:53.997853 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:35:53.997853 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:35:53.997853 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:35:53.997853 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:35:53.997853 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:35:53.997853 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 2057593072c14804ab70fe4bdea2c17c Oct 27 03:35:53.997853 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServersTestMultiNic-1635442954 Oct 27 03:35:53.997853 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:35:53.997853 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:35:53.997853 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2057593072c14804ab70fe4bdea2c17c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2057593072c14804ab70fe4bdea2c17c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2057593072c14804ab70fe4bdea2c17c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2057593072c14804ab70fe4bdea2c17c"}]}] Oct 27 03:35:53.997853 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServersTestMultiNic-1635442954 Oct 27 03:35:53.997853 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 2057593072c14804ab70fe4bdea2c17c Oct 27 03:35:53.997853 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServersTestMultiNic-1635442954 Oct 27 03:35:53.997853 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServersTestMultiNic-1635442954-project Oct 27 03:35:53.997853 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:35:53.997853 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:35:53.997853 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 881f054c84d04ceaa17a5817816022d4 Oct 27 03:35:53.997853 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServersTestMultiNic-1635442954-project Oct 27 03:35:53.997853 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:35:53.997853 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 2410110f-fee8-4669-be8c-5137af8f074f could not be found. Oct 27 03:35:53.997853 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '2410110f-fee8-4669-be8c-5137af8f074f'} Oct 27 03:35:53.997853 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:35:53.997853 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:35:53.997853 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:35:53.997853 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:35:53.997853 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:35:53.997853 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:35:53.997853 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:35:53.997853 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:35:53.997853 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:35:53.997853 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:35:53.997853 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2410110f-fee8-4669-be8c-5137af8f074f could not be found. Oct 27 03:35:53.997853 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:35:53.997853 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:35:53.997853 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:35:53.997853 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:35:53.997853 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:35:53.997853 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:35:53.997853 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:35:53.997853 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:35:53.997853 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:35:53.997853 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:35:53.997853 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:35:53.997853 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:35:53.997853 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:35:53.997853 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:35:53.997853 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:35:53.997853 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:35:53.997853 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2410110f-fee8-4669-be8c-5137af8f074f could not be found. Oct 27 03:35:53.997853 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:35:53.997853 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:35:53.997853 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:35:54.002263 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:35:54.002263 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:35:54.002263 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:35:54.002263 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:35:54.002263 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:35:54.002263 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2410110f-fee8-4669-be8c-5137af8f074f could not be found. Oct 27 03:35:54.002263 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:35:54.004415 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2c7f2ceb-7357-4cd5-8ed7-a09119382989 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Returning 404 to user: Instance 2410110f-fee8-4669-be8c-5137af8f074f could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:35:54.005560 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2c7f2ceb-7357-4cd5-8ed7-a09119382989 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] 10.222.0.20 "GET /compute/v2.1/servers/2410110f-fee8-4669-be8c-5137af8f074f" status: 404 len: 111 microversion: 2.1 time: 0.041474 Oct 27 03:35:54.009445 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1880/3521] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:53 2022] GET /compute/v2.1/servers/2410110f-fee8-4669-be8c-5137af8f074f => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:35:54.014885 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1e3673f7-77ec-44cc-b95b-a5bb2e69ecc6 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7dd9f6c8b0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:54.075802 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1e3673f7-77ec-44cc-b95b-a5bb2e69ecc6 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images/42320033-6276-453e-b35d-504a52d80d70" status: 200 len: 1454 microversion: 2.1 time: 0.064888 Oct 27 03:35:54.077321 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1881/3522] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:35:54 2022] GET /compute/v2.1/images/42320033-6276-453e-b35d-504a52d80d70 => generated 1454 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:54.082403 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0e42a2dc-746f-45b2-b7e6-401281601aca tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:54.083141 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0e42a2dc-746f-45b2-b7e6-401281601aca tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: c5c50ae8-6217-4650-8420-291847e21ace] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:54.126261 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e9b62573-f5b7-4358-971a-de6e9b0224d9 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c36bef85ac34b4983a79e03c56965c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e58f30136ed4a4d9bff48e9b4cde5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:54.141442 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e9b62573-f5b7-4358-971a-de6e9b0224d9 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] 10.222.0.20 "GET /compute/v2.1/servers/09065cd4-8246-49ee-80fe-b4f1c11b468d" status: 200 len: 1520 microversion: 2.1 time: 0.330089 Oct 27 03:35:54.142697 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1642/3523] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:53 2022] GET /compute/v2.1/servers/09065cd4-8246-49ee-80fe-b4f1c11b468d => generated 1520 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:54.148448 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c4690b10-9d2c-4a7b-887c-adb8d2e133a9 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:54.149074 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c4690b10-9d2c-4a7b-887c-adb8d2e133a9 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:54.157067 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c4690b10-9d2c-4a7b-887c-adb8d2e133a9 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:54.158131 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c4690b10-9d2c-4a7b-887c-adb8d2e133a9 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:54.158772 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c4690b10-9d2c-4a7b-887c-adb8d2e133a9 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:54.159481 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c4690b10-9d2c-4a7b-887c-adb8d2e133a9 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:54.177263 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c4690b10-9d2c-4a7b-887c-adb8d2e133a9 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:54.177263 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c4690b10-9d2c-4a7b-887c-adb8d2e133a9 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:54.185205 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0e42a2dc-746f-45b2-b7e6-401281601aca tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18036411a99e4634bfbaeae24b9f254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229dcb63bc41444391544883b576ce2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:54.197328 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0e42a2dc-746f-45b2-b7e6-401281601aca tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/c5c50ae8-6217-4650-8420-291847e21ace" status: 200 len: 1239 microversion: 2.1 time: 0.117971 Oct 27 03:35:54.198738 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1882/3524] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:54 2022] GET /compute/v2.1/servers/c5c50ae8-6217-4650-8420-291847e21ace => generated 1239 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:54.204727 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7a4b8ad2-b00a-4d58-a9e1-13e3561040c6 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:54.205457 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7a4b8ad2-b00a-4d58-a9e1-13e3561040c6 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] [instance: 38693017-3b6f-434c-976f-a9733156a115] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:54.213922 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7a4b8ad2-b00a-4d58-a9e1-13e3561040c6 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:54.215306 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7a4b8ad2-b00a-4d58-a9e1-13e3561040c6 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:54.216067 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7a4b8ad2-b00a-4d58-a9e1-13e3561040c6 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:54.217718 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7a4b8ad2-b00a-4d58-a9e1-13e3561040c6 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:54.218532 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7a4b8ad2-b00a-4d58-a9e1-13e3561040c6 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:54.219295 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7a4b8ad2-b00a-4d58-a9e1-13e3561040c6 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:54.248829 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-7a4b8ad2-b00a-4d58-a9e1-13e3561040c6 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] HTTP exception thrown: Instance 38693017-3b6f-434c-976f-a9733156a115 could not be found. Oct 27 03:35:54.250634 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7a4b8ad2-b00a-4d58-a9e1-13e3561040c6 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Request method failure captured: Oct 27 03:35:54.250634 n-d-862769-1 devstack@n-api.service[121001]: request: DELETE /compute/v2.1/servers/38693017-3b6f-434c-976f-a9733156a115 HTTP/1.1 Oct 27 03:35:54.250634 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:35:54.250634 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:35:54.250634 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:35:54.250634 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:35:54.250634 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:35:54.250634 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:35:54.250634 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:35:54.250634 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:35:54.250634 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfwOWA1Mstb05mKjlVTTupe8YH9xrCf5f9L9Cychzb-w58cm7Umv8orXhO3n_av1vEBdRM_JzsuN71tTo5mU4bcMgJUicRJX-U2IA0MbsE24CxaW8npw75W0q7d1gJRSnDxKQJKYsgopXJhS0nx9kmDtcpnoCVJn5M9CIhzppuqGVC4 Oct 27 03:35:54.250634 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:35:54.250634 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:35:54.250634 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:35:54.250634 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:35:54.250634 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:35:54.250634 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:35:54.250634 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 2057593072c14804ab70fe4bdea2c17c Oct 27 03:35:54.250634 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServersTestMultiNic-1635442954 Oct 27 03:35:54.250634 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:35:54.250634 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:35:54.250634 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2057593072c14804ab70fe4bdea2c17c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2057593072c14804ab70fe4bdea2c17c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2057593072c14804ab70fe4bdea2c17c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2057593072c14804ab70fe4bdea2c17c"}]}] Oct 27 03:35:54.250634 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServersTestMultiNic-1635442954 Oct 27 03:35:54.250634 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 2057593072c14804ab70fe4bdea2c17c Oct 27 03:35:54.250634 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServersTestMultiNic-1635442954 Oct 27 03:35:54.250634 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServersTestMultiNic-1635442954-project Oct 27 03:35:54.250634 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:35:54.250634 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:35:54.250634 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 881f054c84d04ceaa17a5817816022d4 Oct 27 03:35:54.250634 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServersTestMultiNic-1635442954-project Oct 27 03:35:54.250634 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:35:54.250634 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 38693017-3b6f-434c-976f-a9733156a115 could not be found. Oct 27 03:35:54.250634 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '38693017-3b6f-434c-976f-a9733156a115'} Oct 27 03:35:54.250634 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:35:54.250634 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:35:54.250634 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:35:54.250634 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:35:54.250634 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:35:54.250634 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:35:54.250634 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:35:54.250634 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:35:54.250634 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:35:54.250634 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:35:54.250634 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38693017-3b6f-434c-976f-a9733156a115 could not be found. Oct 27 03:35:54.250634 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:35:54.250634 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:35:54.250634 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:35:54.250634 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:35:54.250634 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:35:54.250634 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:35:54.250634 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:35:54.250634 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:35:54.250634 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:35:54.250634 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:35:54.250634 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 03:35:54.250634 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 03:35:54.250634 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 03:35:54.250634 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 03:35:54.250634 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:35:54.250634 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:35:54.250634 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:35:54.250634 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:35:54.255037 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38693017-3b6f-434c-976f-a9733156a115 could not be found. Oct 27 03:35:54.255037 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:35:54.255037 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:35:54.255037 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:35:54.255037 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:35:54.255037 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:35:54.255037 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:35:54.255037 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:35:54.255037 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:35:54.255037 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38693017-3b6f-434c-976f-a9733156a115 could not be found. Oct 27 03:35:54.255037 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:35:54.255037 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7a4b8ad2-b00a-4d58-a9e1-13e3561040c6 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Returning 404 to user: Instance 38693017-3b6f-434c-976f-a9733156a115 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:35:54.255037 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7a4b8ad2-b00a-4d58-a9e1-13e3561040c6 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] 10.222.0.20 "DELETE /compute/v2.1/servers/38693017-3b6f-434c-976f-a9733156a115" status: 404 len: 111 microversion: 2.1 time: 0.052347 Oct 27 03:35:54.255037 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1883/3525] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:35:54 2022] DELETE /compute/v2.1/servers/38693017-3b6f-434c-976f-a9733156a115 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:35:54.258958 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7d2f3a0a-0fb2-476a-8b30-21be98803cb2 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:35:54.266612 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7d2f3a0a-0fb2-476a-8b30-21be98803cb2 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Request method failure captured: Oct 27 03:35:54.266612 n-d-862769-1 devstack@n-api.service[121001]: request: POST /compute/v2.1/servers/09065cd4-8246-49ee-80fe-b4f1c11b468d/action HTTP/1.1 Oct 27 03:35:54.266612 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:35:54.266612 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:35:54.266612 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:35:54.266612 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 285 Oct 27 03:35:54.266612 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:35:54.266612 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:35:54.266612 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:35:54.266612 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:35:54.266612 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfx5Hbc6ITbdSRFtS1-RYRPTs8xU2lFAIvTX0CRBjp8hijBP6KjJjfK-rUuEjncsIe7o_mkFNeieFkwqoNyxVxCVqSYWPgHA26VD6r86MpHHV_eFwebptw3rA_gpbw5SDVw15ZqeHqKSf2NQXZk1XM_suSoUNVero4I26u6VER7fLwA Oct 27 03:35:54.266612 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:35:54.266612 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:35:54.266612 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:35:54.266612 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:35:54.266612 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:35:54.266612 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:35:54.266612 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 2e58f30136ed4a4d9bff48e9b4cde5a8 Oct 27 03:35:54.266612 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-597177073 Oct 27 03:35:54.266612 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:35:54.266612 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:35:54.266612 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2e58f30136ed4a4d9bff48e9b4cde5a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2e58f30136ed4a4d9bff48e9b4cde5a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2e58f30136ed4a4d9bff48e9b4cde5a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2e58f30136ed4a4d9bff48e9b4cde5a8"}]}] Oct 27 03:35:54.266612 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-597177073 Oct 27 03:35:54.266612 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 2e58f30136ed4a4d9bff48e9b4cde5a8 Oct 27 03:35:54.266612 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-597177073 Oct 27 03:35:54.266612 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ImagesOneServerNegativeTestJSON-597177073-project Oct 27 03:35:54.266612 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:35:54.266612 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:35:54.266612 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 5c36bef85ac34b4983a79e03c56965c5 Oct 27 03:35:54.266612 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-597177073-project Oct 27 03:35:54.266612 n-d-862769-1 devstack@n-api.service[121001]: Oct 27 03:35:54.266612 n-d-862769-1 devstack@n-api.service[121001]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 27 03:35:54.266612 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:35:54.266612 n-d-862769-1 devstack@n-api.service[121001]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 27 03:35:54.266612 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '09065cd4-8246-49ee-80fe-b4f1c11b468d', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 27 03:35:54.266612 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:35:54.266612 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:35:54.266612 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 03:35:54.266612 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 03:35:54.266612 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 03:35:54.266612 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise error Oct 27 03:35:54.266612 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 27 03:35:54.266612 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:35:54.266612 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Oct 27 03:35:54.266612 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 27 03:35:54.266612 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:35:54.266612 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 27 03:35:54.266612 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 27 03:35:54.266612 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:35:54.266612 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:35:54.266612 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:35:54.266612 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:35:54.274503 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:35:54.274503 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:35:54.274503 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:35:54.274503 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:35:54.274503 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:35:54.274503 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:35:54.274503 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:35:54.274503 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:35:54.274503 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 03:35:54.274503 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 03:35:54.274503 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 03:35:54.274503 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 03:35:54.274503 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 03:35:54.274503 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 03:35:54.274503 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 27 03:35:54.274503 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:35:54.274503 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:35:54.274503 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:35:54.274503 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:35:54.274503 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:35:54.274503 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:35:54.274503 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 03:35:54.274503 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 03:35:54.274503 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 27 03:35:54.274503 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:35:54.274503 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7d2f3a0a-0fb2-476a-8b30-21be98803cb2 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:35:54.274503 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7d2f3a0a-0fb2-476a-8b30-21be98803cb2 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] 10.222.0.20 "POST /compute/v2.1/servers/09065cd4-8246-49ee-80fe-b4f1c11b468d/action" status: 400 len: 619 microversion: 2.1 time: 0.014452 Oct 27 03:35:54.274503 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1884/3526] 10.222.0.20 () {60 vars in 1279 bytes} [Thu Oct 27 03:35:54 2022] POST /compute/v2.1/servers/09065cd4-8246-49ee-80fe-b4f1c11b468d/action => generated 619 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 03:35:54.276893 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-22913f88-a5a7-4ea8-97f1-35e3b6614d28 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:54.276893 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-22913f88-a5a7-4ea8-97f1-35e3b6614d28 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] [instance: 38693017-3b6f-434c-976f-a9733156a115] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:54.284747 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-22913f88-a5a7-4ea8-97f1-35e3b6614d28 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:54.285289 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-22913f88-a5a7-4ea8-97f1-35e3b6614d28 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:54.286006 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-22913f88-a5a7-4ea8-97f1-35e3b6614d28 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:54.286540 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-22913f88-a5a7-4ea8-97f1-35e3b6614d28 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:54.287020 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-22913f88-a5a7-4ea8-97f1-35e3b6614d28 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:54.287492 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-22913f88-a5a7-4ea8-97f1-35e3b6614d28 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:54.311490 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-22913f88-a5a7-4ea8-97f1-35e3b6614d28 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] HTTP exception thrown: Instance 38693017-3b6f-434c-976f-a9733156a115 could not be found. Oct 27 03:35:54.314722 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-22913f88-a5a7-4ea8-97f1-35e3b6614d28 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Request method failure captured: Oct 27 03:35:54.314722 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/38693017-3b6f-434c-976f-a9733156a115 HTTP/1.1 Oct 27 03:35:54.314722 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:35:54.314722 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:35:54.314722 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:35:54.314722 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:35:54.314722 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:35:54.314722 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:35:54.314722 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:35:54.314722 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:35:54.314722 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfwOWA1Mstb05mKjlVTTupe8YH9xrCf5f9L9Cychzb-w58cm7Umv8orXhO3n_av1vEBdRM_JzsuN71tTo5mU4bcMgJUicRJX-U2IA0MbsE24CxaW8npw75W0q7d1gJRSnDxKQJKYsgopXJhS0nx9kmDtcpnoCVJn5M9CIhzppuqGVC4 Oct 27 03:35:54.314722 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:35:54.314722 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:35:54.314722 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:35:54.314722 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:35:54.314722 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:35:54.314722 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:35:54.314722 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 2057593072c14804ab70fe4bdea2c17c Oct 27 03:35:54.314722 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServersTestMultiNic-1635442954 Oct 27 03:35:54.314722 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:35:54.314722 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:35:54.314722 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2057593072c14804ab70fe4bdea2c17c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2057593072c14804ab70fe4bdea2c17c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2057593072c14804ab70fe4bdea2c17c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2057593072c14804ab70fe4bdea2c17c"}]}] Oct 27 03:35:54.314722 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServersTestMultiNic-1635442954 Oct 27 03:35:54.314722 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 2057593072c14804ab70fe4bdea2c17c Oct 27 03:35:54.314722 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServersTestMultiNic-1635442954 Oct 27 03:35:54.314722 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServersTestMultiNic-1635442954-project Oct 27 03:35:54.314722 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:35:54.314722 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:35:54.314722 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 881f054c84d04ceaa17a5817816022d4 Oct 27 03:35:54.314722 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServersTestMultiNic-1635442954-project Oct 27 03:35:54.314722 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:35:54.314722 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 38693017-3b6f-434c-976f-a9733156a115 could not be found. Oct 27 03:35:54.314722 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '38693017-3b6f-434c-976f-a9733156a115'} Oct 27 03:35:54.314722 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:35:54.314722 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:35:54.314722 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:35:54.314722 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:35:54.314722 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:35:54.314722 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:35:54.314722 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:35:54.314722 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:35:54.314722 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:35:54.314722 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:35:54.314722 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38693017-3b6f-434c-976f-a9733156a115 could not be found. Oct 27 03:35:54.314722 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:35:54.314722 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:35:54.314722 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:35:54.314722 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:35:54.314722 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:35:54.314722 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:35:54.314722 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:35:54.314722 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:35:54.314722 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:35:54.314722 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:35:54.314722 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:35:54.314722 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:35:54.314722 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:35:54.314722 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:35:54.314722 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:35:54.314722 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:35:54.314722 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38693017-3b6f-434c-976f-a9733156a115 could not be found. Oct 27 03:35:54.314722 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:35:54.314722 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:35:54.314722 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:35:54.319563 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:35:54.319563 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:35:54.319563 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:35:54.319563 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:35:54.319563 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:35:54.319563 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38693017-3b6f-434c-976f-a9733156a115 could not be found. Oct 27 03:35:54.319563 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:35:54.319563 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-22913f88-a5a7-4ea8-97f1-35e3b6614d28 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] Returning 404 to user: Instance 38693017-3b6f-434c-976f-a9733156a115 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:35:54.319563 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-22913f88-a5a7-4ea8-97f1-35e3b6614d28 tempest-ServersTestMultiNic-1635442954 tempest-ServersTestMultiNic-1635442954-project] 10.222.0.20 "GET /compute/v2.1/servers/38693017-3b6f-434c-976f-a9733156a115" status: 404 len: 111 microversion: 2.1 time: 0.044549 Oct 27 03:35:54.320516 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1885/3527] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:54 2022] GET /compute/v2.1/servers/38693017-3b6f-434c-976f-a9733156a115 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:35:54.338137 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2cc59d10-b97b-41d9-9dab-ef1da7772c7d tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:54.343440 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2cc59d10-b97b-41d9-9dab-ef1da7772c7d tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] [instance: 09065cd4-8246-49ee-80fe-b4f1c11b468d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:54.352336 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2cc59d10-b97b-41d9-9dab-ef1da7772c7d tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:54.353102 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2cc59d10-b97b-41d9-9dab-ef1da7772c7d tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:54.353745 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2cc59d10-b97b-41d9-9dab-ef1da7772c7d tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:54.354661 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2cc59d10-b97b-41d9-9dab-ef1da7772c7d tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:54.355336 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2cc59d10-b97b-41d9-9dab-ef1da7772c7d tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:54.355950 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2cc59d10-b97b-41d9-9dab-ef1da7772c7d tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:54.506987 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c4690b10-9d2c-4a7b-887c-adb8d2e133a9 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:54.519294 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c4690b10-9d2c-4a7b-887c-adb8d2e133a9 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1505 microversion: 2.1 time: 0.372792 Oct 27 03:35:54.553714 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1643/3528] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:54 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1505 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:54.559094 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-19d57c53-0e51-42b9-aef1-68fb0c6bc02d tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:54.564727 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-19d57c53-0e51-42b9-aef1-68fb0c6bc02d tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] [instance: 8c8a2cbb-4acf-4a6b-b684-567617bb930d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:54.578071 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-19d57c53-0e51-42b9-aef1-68fb0c6bc02d tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:54.582400 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-19d57c53-0e51-42b9-aef1-68fb0c6bc02d tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:54.583204 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-19d57c53-0e51-42b9-aef1-68fb0c6bc02d tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:54.583941 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-19d57c53-0e51-42b9-aef1-68fb0c6bc02d tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:54.584413 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-19d57c53-0e51-42b9-aef1-68fb0c6bc02d tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:54.584846 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-19d57c53-0e51-42b9-aef1-68fb0c6bc02d tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:54.690487 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2cc59d10-b97b-41d9-9dab-ef1da7772c7d tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c36bef85ac34b4983a79e03c56965c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e58f30136ed4a4d9bff48e9b4cde5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:54.703555 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2cc59d10-b97b-41d9-9dab-ef1da7772c7d tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] 10.222.0.20 "GET /compute/v2.1/servers/09065cd4-8246-49ee-80fe-b4f1c11b468d" status: 200 len: 1520 microversion: 2.1 time: 0.382199 Oct 27 03:35:54.714434 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1886/3529] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:54 2022] GET /compute/v2.1/servers/09065cd4-8246-49ee-80fe-b4f1c11b468d => generated 1520 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:54.730399 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a9f88e1e-e48e-425c-b5de-2cbedcee0a3e tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:54.731265 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a9f88e1e-e48e-425c-b5de-2cbedcee0a3e tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] [instance: 2a1bda43-af44-432d-8992-94473a5f8b5d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:54.738941 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a9f88e1e-e48e-425c-b5de-2cbedcee0a3e tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:54.739642 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a9f88e1e-e48e-425c-b5de-2cbedcee0a3e tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:54.740324 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a9f88e1e-e48e-425c-b5de-2cbedcee0a3e tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:54.741239 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a9f88e1e-e48e-425c-b5de-2cbedcee0a3e tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:54.741874 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a9f88e1e-e48e-425c-b5de-2cbedcee0a3e tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:54.742508 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a9f88e1e-e48e-425c-b5de-2cbedcee0a3e tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:54.972775 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a9f88e1e-e48e-425c-b5de-2cbedcee0a3e tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d5d3f1bf1af4cd6884297b207597fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a1ba64cf9c47d5bdae52477338099e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:54.985626 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a9f88e1e-e48e-425c-b5de-2cbedcee0a3e tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] 10.222.0.20 "GET /compute/v2.1/servers/2a1bda43-af44-432d-8992-94473a5f8b5d" status: 200 len: 1351 microversion: 2.1 time: 0.269486 Oct 27 03:35:54.991407 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1887/3530] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:54 2022] GET /compute/v2.1/servers/2a1bda43-af44-432d-8992-94473a5f8b5d => generated 1351 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:55.003247 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8ed1550e-77e3-489c-bfce-1dcb9ee5c6de tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:55.006405 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8ed1550e-77e3-489c-bfce-1dcb9ee5c6de tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:55.015579 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8ed1550e-77e3-489c-bfce-1dcb9ee5c6de tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:55.023430 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8ed1550e-77e3-489c-bfce-1dcb9ee5c6de tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:55.023560 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8ed1550e-77e3-489c-bfce-1dcb9ee5c6de tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:55.024370 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8ed1550e-77e3-489c-bfce-1dcb9ee5c6de tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:55.024911 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8ed1550e-77e3-489c-bfce-1dcb9ee5c6de tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:55.025422 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8ed1550e-77e3-489c-bfce-1dcb9ee5c6de tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:55.248731 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-19d57c53-0e51-42b9-aef1-68fb0c6bc02d tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:55.263555 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-19d57c53-0e51-42b9-aef1-68fb0c6bc02d tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:55.265076 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-19d57c53-0e51-42b9-aef1-68fb0c6bc02d tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:55.267682 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-19d57c53-0e51-42b9-aef1-68fb0c6bc02d tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d" status: 200 len: 1878 microversion: 2.42 time: 0.711050 Oct 27 03:35:55.268947 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1644/3531] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:35:54 2022] GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d => generated 1878 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:35:55.285231 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d0e19523-d591-45ec-a5c4-b0905c16f4d1 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:55.287104 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d0e19523-d591-45ec-a5c4-b0905c16f4d1 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] [instance: 09065cd4-8246-49ee-80fe-b4f1c11b468d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:55.299938 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d0e19523-d591-45ec-a5c4-b0905c16f4d1 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:55.300999 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d0e19523-d591-45ec-a5c4-b0905c16f4d1 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:55.301985 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d0e19523-d591-45ec-a5c4-b0905c16f4d1 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:55.302871 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d0e19523-d591-45ec-a5c4-b0905c16f4d1 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:55.303973 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d0e19523-d591-45ec-a5c4-b0905c16f4d1 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:55.304475 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d0e19523-d591-45ec-a5c4-b0905c16f4d1 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:55.318620 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8ed1550e-77e3-489c-bfce-1dcb9ee5c6de tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:55.329251 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8ed1550e-77e3-489c-bfce-1dcb9ee5c6de tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1505 microversion: 2.1 time: 0.336308 Oct 27 03:35:55.347525 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1888/3532] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:54 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1505 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:55.365551 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-850452c5-cced-4265-adff-23b13ad7169c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:55.370307 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-850452c5-cced-4265-adff-23b13ad7169c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:55.379443 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-850452c5-cced-4265-adff-23b13ad7169c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:55.382695 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-850452c5-cced-4265-adff-23b13ad7169c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:55.383372 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-850452c5-cced-4265-adff-23b13ad7169c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:55.384267 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-850452c5-cced-4265-adff-23b13ad7169c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:55.388335 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-850452c5-cced-4265-adff-23b13ad7169c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:55.389044 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-850452c5-cced-4265-adff-23b13ad7169c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:55.576875 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d0e19523-d591-45ec-a5c4-b0905c16f4d1 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c36bef85ac34b4983a79e03c56965c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e58f30136ed4a4d9bff48e9b4cde5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:55.587733 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d0e19523-d591-45ec-a5c4-b0905c16f4d1 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] 10.222.0.20 "GET /compute/v2.1/servers/09065cd4-8246-49ee-80fe-b4f1c11b468d" status: 200 len: 1520 microversion: 2.1 time: 0.311995 Oct 27 03:35:55.588340 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1645/3533] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:55 2022] GET /compute/v2.1/servers/09065cd4-8246-49ee-80fe-b4f1c11b468d => generated 1520 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:55.605303 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-aba2bc06-0f81-4c8e-9e53-24a1e092f059 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7ddb4dd040>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:55.700424 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-aba2bc06-0f81-4c8e-9e53-24a1e092f059 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images/42320033-6276-453e-b35d-504a52d80d70" status: 200 len: 1454 microversion: 2.1 time: 0.110945 Oct 27 03:35:55.702214 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1646/3534] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:35:55 2022] GET /compute/v2.1/images/42320033-6276-453e-b35d-504a52d80d70 => generated 1454 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:55.706979 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c5f5ca0b-119c-4338-a5e1-a27fa75cb30d tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:55.707787 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c5f5ca0b-119c-4338-a5e1-a27fa75cb30d tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: c5c50ae8-6217-4650-8420-291847e21ace] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:55.714348 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c5f5ca0b-119c-4338-a5e1-a27fa75cb30d tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:55.715073 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c5f5ca0b-119c-4338-a5e1-a27fa75cb30d tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:55.715674 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c5f5ca0b-119c-4338-a5e1-a27fa75cb30d tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:55.716646 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c5f5ca0b-119c-4338-a5e1-a27fa75cb30d tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:55.717998 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c5f5ca0b-119c-4338-a5e1-a27fa75cb30d tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:55.718629 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c5f5ca0b-119c-4338-a5e1-a27fa75cb30d tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:55.725278 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-850452c5-cced-4265-adff-23b13ad7169c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:55.739748 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-850452c5-cced-4265-adff-23b13ad7169c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1669 microversion: 2.1 time: 0.390700 Oct 27 03:35:55.742530 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1889/3535] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:55 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1669 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:55.768387 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0d61a89b-3341-479e-b0c3-4a6a74eb1f25 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-648824948", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "0f1ea857-e60a-4a6e-a6c9-70bfd2dd2db8"}]}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:35:55.879694 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c5f5ca0b-119c-4338-a5e1-a27fa75cb30d tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18036411a99e4634bfbaeae24b9f254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229dcb63bc41444391544883b576ce2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:55.888159 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c5f5ca0b-119c-4338-a5e1-a27fa75cb30d tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/c5c50ae8-6217-4650-8420-291847e21ace" status: 200 len: 1291 microversion: 2.1 time: 0.184670 Oct 27 03:35:55.891471 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1647/3536] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:55 2022] GET /compute/v2.1/servers/c5c50ae8-6217-4650-8420-291847e21ace => generated 1291 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:55.901168 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-fd0f01e8-4080-46e1-8a46-960dc1e163ab tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-616361641"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:35:55.905798 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-fd0f01e8-4080-46e1-8a46-960dc1e163ab tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] [instance: 09065cd4-8246-49ee-80fe-b4f1c11b468d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:55.914979 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fd0f01e8-4080-46e1-8a46-960dc1e163ab tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:55.915787 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fd0f01e8-4080-46e1-8a46-960dc1e163ab tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:55.918647 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fd0f01e8-4080-46e1-8a46-960dc1e163ab tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:55.920743 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fd0f01e8-4080-46e1-8a46-960dc1e163ab tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:55.922533 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fd0f01e8-4080-46e1-8a46-960dc1e163ab tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:55.928006 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fd0f01e8-4080-46e1-8a46-960dc1e163ab tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:55.986783 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.network.security_group_api [None req-0d61a89b-3341-479e-b0c3-4a6a74eb1f25 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Neutron security group does_not_exist not found {{(pid=121001) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Oct 27 03:35:55.987399 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-0d61a89b-3341-479e-b0c3-4a6a74eb1f25 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Oct 27 03:35:55.997233 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0d61a89b-3341-479e-b0c3-4a6a74eb1f25 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Request method failure captured: Oct 27 03:35:55.997233 n-d-862769-1 devstack@n-api.service[121001]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 03:35:55.997233 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:35:55.997233 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:35:55.997233 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:35:55.997233 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 257 Oct 27 03:35:55.997233 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:35:55.997233 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:35:55.997233 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:35:55.997233 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:35:55.997233 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfxF6ut9nM9a9AcpKLO7IgCu-akAJ2YJGjrI9C8NUveA8uObV2XgQIQvsIxuWjvLl9meIEqpfGwZYr8MTX_PAGoiJsNUPXh5ERSce5cPYQYCCFPL0HtTb-E11C_2kfWy1wRps1tClRNvtj8zAqCGRhs1x-Uvl0zISdfHepXmvWX31Us Oct 27 03:35:55.997233 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:35:55.997233 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:35:55.997233 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:35:55.997233 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:35:55.997233 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:35:55.997233 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:35:55.997233 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 8bb5d291069d4329a90123e327fe9c59 Oct 27 03:35:55.997233 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:35:55.997233 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:35:55.997233 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:35:55.997233 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8bb5d291069d4329a90123e327fe9c59"}]}] Oct 27 03:35:55.997233 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:35:55.997233 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 8bb5d291069d4329a90123e327fe9c59 Oct 27 03:35:55.997233 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:35:55.997233 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServersNegativeTestJSON-4378389-project Oct 27 03:35:55.997233 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:35:55.997233 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:35:55.997233 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: f9c32b7626594ff888970c7f3227bb20 Oct 27 03:35:55.997233 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServersNegativeTestJSON-4378389-project Oct 27 03:35:55.997233 n-d-862769-1 devstack@n-api.service[121001]: Oct 27 03:35:55.997233 n-d-862769-1 devstack@n-api.service[121001]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-648824948", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "0f1ea857-e60a-4a6e-a6c9-70bfd2dd2db8"}]}} Oct 27 03:35:55.997233 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:35:55.997233 n-d-862769-1 devstack@n-api.service[121001]: exception: Unable to find security_group with name or id 'does_not_exist' Oct 27 03:35:55.997233 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-648824948', 'imageRef': 'c40fb871-5877-4b59-ab69-d9fd23b7a917', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '0f1ea857-e60a-4a6e-a6c9-70bfd2dd2db8'}]}}} Oct 27 03:35:55.997233 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:35:55.997233 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:35:55.997233 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Oct 27 03:35:55.997233 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Oct 27 03:35:55.997233 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:35:55.997233 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:35:55.997233 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Oct 27 03:35:55.997233 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 27 03:35:55.997233 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Oct 27 03:35:55.997233 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:35:55.997233 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:35:55.997233 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:35:55.997233 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:35:55.997233 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Oct 27 03:35:55.997233 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Oct 27 03:35:55.997233 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:35:55.997233 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:35:55.997233 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Oct 27 03:35:55.997233 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 27 03:35:55.997233 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Oct 27 03:35:55.997233 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:35:55.997233 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:35:55.997233 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:35:55.997233 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:35:55.997233 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Oct 27 03:35:55.997233 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Oct 27 03:35:56.001383 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Oct 27 03:35:56.001383 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Oct 27 03:35:56.001383 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Oct 27 03:35:56.001383 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Oct 27 03:35:56.001383 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:35:56.001383 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:35:56.001383 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Oct 27 03:35:56.001383 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Oct 27 03:35:56.001383 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Oct 27 03:35:56.001383 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:35:56.001383 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:35:56.001383 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:35:56.001383 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:35:56.001383 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 27 03:35:56.001383 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 27 03:35:56.001383 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 27 03:35:56.001383 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 27 03:35:56.001383 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 27 03:35:56.001383 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 27 03:35:56.001383 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Oct 27 03:35:56.001383 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Oct 27 03:35:56.001383 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Oct 27 03:35:56.001383 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Oct 27 03:35:56.001383 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Oct 27 03:35:56.001383 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 27 03:35:56.001383 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Oct 27 03:35:56.001383 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:35:56.001383 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:35:56.001383 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:35:56.001383 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:35:56.001383 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:35:56.001383 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:35:56.001383 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:35:56.001383 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:35:56.001383 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:35:56.001383 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:35:56.001383 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:35:56.001383 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:35:56.001383 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:35:56.001383 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:35:56.001383 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:35:56.001383 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:35:56.001383 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 27 03:35:56.001383 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 27 03:35:56.001383 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 27 03:35:56.001383 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Oct 27 03:35:56.001383 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:35:56.001383 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:35:56.001383 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:35:56.001383 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:35:56.001383 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:35:56.001383 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:35:56.001383 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:35:56.001383 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:35:56.001383 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Oct 27 03:35:56.001383 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:35:56.013353 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0d61a89b-3341-479e-b0c3-4a6a74eb1f25 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:35:56.017153 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0d61a89b-3341-479e-b0c3-4a6a74eb1f25 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.267127 Oct 27 03:35:56.018383 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1890/3537] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:35:55 2022] POST /compute/v2.1/servers => generated 106 bytes in 275 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 03:35:56.024764 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c9f0d39d-1357-43ba-87a3-d767f1e5eb79 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:56.037287 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c9f0d39d-1357-43ba-87a3-d767f1e5eb79 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] [instance: 2a1bda43-af44-432d-8992-94473a5f8b5d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:56.052343 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c9f0d39d-1357-43ba-87a3-d767f1e5eb79 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:56.052343 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c9f0d39d-1357-43ba-87a3-d767f1e5eb79 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:56.052343 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c9f0d39d-1357-43ba-87a3-d767f1e5eb79 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:56.052343 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c9f0d39d-1357-43ba-87a3-d767f1e5eb79 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:56.052343 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c9f0d39d-1357-43ba-87a3-d767f1e5eb79 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:56.052343 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c9f0d39d-1357-43ba-87a3-d767f1e5eb79 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:56.354836 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c9f0d39d-1357-43ba-87a3-d767f1e5eb79 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d5d3f1bf1af4cd6884297b207597fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a1ba64cf9c47d5bdae52477338099e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:56.378406 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c9f0d39d-1357-43ba-87a3-d767f1e5eb79 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] 10.222.0.20 "GET /compute/v2.1/servers/2a1bda43-af44-432d-8992-94473a5f8b5d" status: 200 len: 1351 microversion: 2.1 time: 0.358321 Oct 27 03:35:56.384489 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1891/3538] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:56 2022] GET /compute/v2.1/servers/2a1bda43-af44-432d-8992-94473a5f8b5d => generated 1351 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:56.393360 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-aae577ce-e4ac-43ea-a6c6-9f9f3134cff2 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:56.394794 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-aae577ce-e4ac-43ea-a6c6-9f9f3134cff2 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:56.414781 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aae577ce-e4ac-43ea-a6c6-9f9f3134cff2 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:56.415326 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aae577ce-e4ac-43ea-a6c6-9f9f3134cff2 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:56.415788 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aae577ce-e4ac-43ea-a6c6-9f9f3134cff2 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:56.417287 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aae577ce-e4ac-43ea-a6c6-9f9f3134cff2 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:56.417772 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aae577ce-e4ac-43ea-a6c6-9f9f3134cff2 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:56.418435 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aae577ce-e4ac-43ea-a6c6-9f9f3134cff2 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:56.577294 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=100 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:35:56.709452 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-aae577ce-e4ac-43ea-a6c6-9f9f3134cff2 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:56.721674 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-aae577ce-e4ac-43ea-a6c6-9f9f3134cff2 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1505 microversion: 2.1 time: 0.335477 Oct 27 03:35:56.744712 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1892/3539] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:56 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1505 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:56.753581 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-77be5392-d089-4dc3-8aff-ae8928e5d833 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:56.754195 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-77be5392-d089-4dc3-8aff-ae8928e5d833 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] [instance: 8c8a2cbb-4acf-4a6b-b684-567617bb930d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:56.763453 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-77be5392-d089-4dc3-8aff-ae8928e5d833 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:56.764240 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-77be5392-d089-4dc3-8aff-ae8928e5d833 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:56.764865 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-77be5392-d089-4dc3-8aff-ae8928e5d833 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:56.766158 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-77be5392-d089-4dc3-8aff-ae8928e5d833 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:56.766775 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-77be5392-d089-4dc3-8aff-ae8928e5d833 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:56.773178 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-77be5392-d089-4dc3-8aff-ae8928e5d833 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:56.793605 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:35:56.809651 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-fd0f01e8-4080-46e1-8a46-960dc1e163ab tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] 10.222.0.20 "POST /compute/v2.1/servers/09065cd4-8246-49ee-80fe-b4f1c11b468d/action" status: 202 len: 0 microversion: 2.1 time: 0.916702 Oct 27 03:35:56.810361 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1648/3540] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:35:55 2022] POST /compute/v2.1/servers/09065cd4-8246-49ee-80fe-b4f1c11b468d/action => generated 0 bytes in 918 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 27 03:35:56.829805 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-354033a7-7887-41bf-8e8b-6f688e695f37 req-4d8e9788-24bb-4923-ac10-2dd17d0f1182 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a1bda43-af44-432d-8992-94473a5f8b5d", "tag": "492e855b-93ee-4a3f-9bb2-1fef411f1a2c"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:35:56.876875 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-354033a7-7887-41bf-8e8b-6f688e695f37 req-4d8e9788-24bb-4923-ac10-2dd17d0f1182 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:56.877351 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-354033a7-7887-41bf-8e8b-6f688e695f37 req-4d8e9788-24bb-4923-ac10-2dd17d0f1182 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:56.877787 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-354033a7-7887-41bf-8e8b-6f688e695f37 req-4d8e9788-24bb-4923-ac10-2dd17d0f1182 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:56.900069 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-354033a7-7887-41bf-8e8b-6f688e695f37 req-4d8e9788-24bb-4923-ac10-2dd17d0f1182 service nova] Creating event network-changed:492e855b-93ee-4a3f-9bb2-1fef411f1a2c for instance 2a1bda43-af44-432d-8992-94473a5f8b5d on n-h2-862769-1 Oct 27 03:35:56.913476 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-354033a7-7887-41bf-8e8b-6f688e695f37 req-4d8e9788-24bb-4923-ac10-2dd17d0f1182 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101643 Oct 27 03:35:56.923298 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1649/3541] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:35:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:35:56.932544 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-90811ad6-2ea9-4c43-85d3-e62bf6b111c9 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7ddaa88820>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:57.034932 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-90811ad6-2ea9-4c43-85d3-e62bf6b111c9 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images/42320033-6276-453e-b35d-504a52d80d70" status: 200 len: 1454 microversion: 2.1 time: 0.109938 Oct 27 03:35:57.045537 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1650/3542] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:35:56 2022] GET /compute/v2.1/images/42320033-6276-453e-b35d-504a52d80d70 => generated 1454 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:57.054611 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-99fe7825-9955-44a8-9037-867478ffe631 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:57.058941 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-99fe7825-9955-44a8-9037-867478ffe631 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:57.071130 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-99fe7825-9955-44a8-9037-867478ffe631 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:57.074781 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-99fe7825-9955-44a8-9037-867478ffe631 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:57.075481 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-99fe7825-9955-44a8-9037-867478ffe631 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:57.077240 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-99fe7825-9955-44a8-9037-867478ffe631 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:57.078604 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-99fe7825-9955-44a8-9037-867478ffe631 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:57.081766 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-99fe7825-9955-44a8-9037-867478ffe631 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:57.584720 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-99fe7825-9955-44a8-9037-867478ffe631 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:57.600828 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-99fe7825-9955-44a8-9037-867478ffe631 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1505 microversion: 2.1 time: 0.553713 Oct 27 03:35:57.601592 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1651/3543] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:57 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1505 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:57.610231 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e99ab365-66fe-474d-a698-8714620e60b3 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1613250498"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:35:57.613090 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e99ab365-66fe-474d-a698-8714620e60b3 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] [instance: 09065cd4-8246-49ee-80fe-b4f1c11b468d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:57.620487 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:35:57.628684 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e99ab365-66fe-474d-a698-8714620e60b3 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:57.638800 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e99ab365-66fe-474d-a698-8714620e60b3 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:57.638800 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e99ab365-66fe-474d-a698-8714620e60b3 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:57.638800 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e99ab365-66fe-474d-a698-8714620e60b3 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:57.638800 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e99ab365-66fe-474d-a698-8714620e60b3 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:57.638800 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e99ab365-66fe-474d-a698-8714620e60b3 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:57.706093 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-e99ab365-66fe-474d-a698-8714620e60b3 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] HTTP exception thrown: Cannot 'createImage' instance 09065cd4-8246-49ee-80fe-b4f1c11b468d while it is in task_state image_snapshot Oct 27 03:35:57.708201 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e99ab365-66fe-474d-a698-8714620e60b3 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Request method failure captured: Oct 27 03:35:57.708201 n-d-862769-1 devstack@n-api.service[121000]: request: POST /compute/v2.1/servers/09065cd4-8246-49ee-80fe-b4f1c11b468d/action HTTP/1.1 Oct 27 03:35:57.708201 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:35:57.708201 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:35:57.708201 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:35:57.708201 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 85 Oct 27 03:35:57.708201 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:35:57.708201 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:35:57.708201 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:35:57.708201 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:35:57.708201 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfx5Hbc6ITbdSRFtS1-RYRPTs8xU2lFAIvTX0CRBjp8hijBP6KjJjfK-rUuEjncsIe7o_mkFNeieFkwqoNyxVxCVqSYWPgHA26VD6r86MpHHV_eFwebptw3rA_gpbw5SDVw15ZqeHqKSf2NQXZk1XM_suSoUNVero4I26u6VER7fLwA Oct 27 03:35:57.708201 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:35:57.708201 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:35:57.708201 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:35:57.708201 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:35:57.708201 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:35:57.708201 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:35:57.708201 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 2e58f30136ed4a4d9bff48e9b4cde5a8 Oct 27 03:35:57.708201 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-597177073 Oct 27 03:35:57.708201 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:35:57.708201 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:35:57.708201 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2e58f30136ed4a4d9bff48e9b4cde5a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2e58f30136ed4a4d9bff48e9b4cde5a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2e58f30136ed4a4d9bff48e9b4cde5a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2e58f30136ed4a4d9bff48e9b4cde5a8"}]}] Oct 27 03:35:57.708201 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-597177073 Oct 27 03:35:57.708201 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 2e58f30136ed4a4d9bff48e9b4cde5a8 Oct 27 03:35:57.708201 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-597177073 Oct 27 03:35:57.708201 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ImagesOneServerNegativeTestJSON-597177073-project Oct 27 03:35:57.708201 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:35:57.708201 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:35:57.708201 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 5c36bef85ac34b4983a79e03c56965c5 Oct 27 03:35:57.708201 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-597177073-project Oct 27 03:35:57.708201 n-d-862769-1 devstack@n-api.service[121000]: Oct 27 03:35:57.708201 n-d-862769-1 devstack@n-api.service[121000]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1613250498"}} Oct 27 03:35:57.708201 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:35:57.708201 n-d-862769-1 devstack@n-api.service[121000]: exception: Cannot 'createImage' instance 09065cd4-8246-49ee-80fe-b4f1c11b468d while it is in task_state image_snapshot Oct 27 03:35:57.708201 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '09065cd4-8246-49ee-80fe-b4f1c11b468d', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1613250498'}}} Oct 27 03:35:57.708201 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:35:57.708201 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:35:57.708201 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Oct 27 03:35:57.708201 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Oct 27 03:35:57.708201 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Oct 27 03:35:57.708201 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 27 03:35:57.708201 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 09065cd4-8246-49ee-80fe-b4f1c11b468d in task_state image_snapshot. Cannot snapshot while the instance is in this state. Oct 27 03:35:57.708201 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:35:57.708201 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:35:57.708201 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:35:57.708201 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:35:57.708201 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:35:57.708201 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:35:57.708201 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:35:57.708201 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:35:57.708201 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:35:57.708201 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:35:57.708201 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:35:57.708201 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:35:57.708201 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:35:57.708201 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:35:57.708201 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Oct 27 03:35:57.708201 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 27 03:35:57.708201 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 27 03:35:57.708201 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 27 03:35:57.708201 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 09065cd4-8246-49ee-80fe-b4f1c11b468d while it is in task_state image_snapshot Oct 27 03:35:57.712223 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:35:57.712223 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:35:57.712223 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:35:57.712223 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:35:57.712223 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:35:57.712223 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:35:57.712223 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:35:57.712223 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:35:57.712223 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 09065cd4-8246-49ee-80fe-b4f1c11b468d while it is in task_state image_snapshot Oct 27 03:35:57.712223 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:35:57.713130 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-77be5392-d089-4dc3-8aff-ae8928e5d833 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:57.714870 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e99ab365-66fe-474d-a698-8714620e60b3 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Returning 409 to user: Cannot 'createImage' instance 09065cd4-8246-49ee-80fe-b4f1c11b468d while it is in task_state image_snapshot {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:35:57.716651 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e99ab365-66fe-474d-a698-8714620e60b3 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] 10.222.0.20 "POST /compute/v2.1/servers/09065cd4-8246-49ee-80fe-b4f1c11b468d/action" status: 409 len: 159 microversion: 2.1 time: 0.113827 Oct 27 03:35:57.717982 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1652/3544] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:35:57 2022] POST /compute/v2.1/servers/09065cd4-8246-49ee-80fe-b4f1c11b468d/action => generated 159 bytes in 115 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 27 03:35:57.722797 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-97197bdc-8cec-465e-b1f7-defd49077fd1 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:57.723738 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-97197bdc-8cec-465e-b1f7-defd49077fd1 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: c5c50ae8-6217-4650-8420-291847e21ace] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:57.728101 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-77be5392-d089-4dc3-8aff-ae8928e5d833 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:57.730328 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-77be5392-d089-4dc3-8aff-ae8928e5d833 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:57.735263 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-77be5392-d089-4dc3-8aff-ae8928e5d833 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d" status: 200 len: 1878 microversion: 2.42 time: 0.989086 Oct 27 03:35:57.735468 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-97197bdc-8cec-465e-b1f7-defd49077fd1 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:57.735854 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1893/3545] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:35:56 2022] GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d => generated 1878 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:35:57.735996 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-97197bdc-8cec-465e-b1f7-defd49077fd1 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:57.736303 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-97197bdc-8cec-465e-b1f7-defd49077fd1 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:57.737030 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-97197bdc-8cec-465e-b1f7-defd49077fd1 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:57.737556 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-97197bdc-8cec-465e-b1f7-defd49077fd1 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:57.737990 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-97197bdc-8cec-465e-b1f7-defd49077fd1 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:57.746937 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3f12e5b5-0bfa-48cb-a59f-45739dec614f tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:57.748929 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3f12e5b5-0bfa-48cb-a59f-45739dec614f tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] [instance: 2a1bda43-af44-432d-8992-94473a5f8b5d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:57.762153 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3f12e5b5-0bfa-48cb-a59f-45739dec614f tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:57.764199 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3f12e5b5-0bfa-48cb-a59f-45739dec614f tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:57.765333 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3f12e5b5-0bfa-48cb-a59f-45739dec614f tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:57.767062 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3f12e5b5-0bfa-48cb-a59f-45739dec614f tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:57.769740 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3f12e5b5-0bfa-48cb-a59f-45739dec614f tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:57.770596 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3f12e5b5-0bfa-48cb-a59f-45739dec614f tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:57.867836 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-97197bdc-8cec-465e-b1f7-defd49077fd1 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18036411a99e4634bfbaeae24b9f254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229dcb63bc41444391544883b576ce2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:57.880954 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-97197bdc-8cec-465e-b1f7-defd49077fd1 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/c5c50ae8-6217-4650-8420-291847e21ace" status: 200 len: 1297 microversion: 2.1 time: 0.157164 Oct 27 03:35:57.881663 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1653/3546] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:57 2022] GET /compute/v2.1/servers/c5c50ae8-6217-4650-8420-291847e21ace => generated 1297 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:57.889107 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8b2e448d-2bce-40ee-80c8-d4a0f57139fe tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:57.889618 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8b2e448d-2bce-40ee-80c8-d4a0f57139fe tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 7053eb43-3b62-45b6-820f-53b24d5b68fd] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:57.896826 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-8b2e448d-2bce-40ee-80c8-d4a0f57139fe tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] HTTP exception thrown: Instance 7053eb43-3b62-45b6-820f-53b24d5b68fd could not be found. Oct 27 03:35:57.901834 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8b2e448d-2bce-40ee-80c8-d4a0f57139fe tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Request method failure captured: Oct 27 03:35:57.901834 n-d-862769-1 devstack@n-api.service[121000]: request: DELETE /compute/v2.1/servers/7053eb43-3b62-45b6-820f-53b24d5b68fd HTTP/1.1 Oct 27 03:35:57.901834 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:35:57.901834 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:35:57.901834 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:35:57.901834 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:35:57.901834 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:35:57.901834 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:35:57.901834 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:35:57.901834 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:35:57.901834 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfxF6ut9nM9a9AcpKLO7IgCu-akAJ2YJGjrI9C8NUveA8uObV2XgQIQvsIxuWjvLl9meIEqpfGwZYr8MTX_PAGoiJsNUPXh5ERSce5cPYQYCCFPL0HtTb-E11C_2kfWy1wRps1tClRNvtj8zAqCGRhs1x-Uvl0zISdfHepXmvWX31Us Oct 27 03:35:57.901834 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:35:57.901834 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:35:57.901834 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:35:57.901834 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:35:57.901834 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:35:57.901834 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:35:57.901834 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 8bb5d291069d4329a90123e327fe9c59 Oct 27 03:35:57.901834 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:35:57.901834 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:35:57.901834 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:35:57.901834 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8bb5d291069d4329a90123e327fe9c59"}]}] Oct 27 03:35:57.901834 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:35:57.901834 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 8bb5d291069d4329a90123e327fe9c59 Oct 27 03:35:57.901834 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:35:57.901834 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ServersNegativeTestJSON-4378389-project Oct 27 03:35:57.901834 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:35:57.901834 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:35:57.901834 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: f9c32b7626594ff888970c7f3227bb20 Oct 27 03:35:57.901834 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ServersNegativeTestJSON-4378389-project Oct 27 03:35:57.901834 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:35:57.901834 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 7053eb43-3b62-45b6-820f-53b24d5b68fd could not be found. Oct 27 03:35:57.901834 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '7053eb43-3b62-45b6-820f-53b24d5b68fd'} Oct 27 03:35:57.901834 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:35:57.901834 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:35:57.901834 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:35:57.901834 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:35:57.901834 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:35:57.901834 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:35:57.901834 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 03:35:57.901834 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 03:35:57.901834 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7053eb43-3b62-45b6-820f-53b24d5b68fd could not be found. Oct 27 03:35:57.901834 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:35:57.901834 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:35:57.901834 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:35:57.901834 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:35:57.901834 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:35:57.901834 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:35:57.901834 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:35:57.901834 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:35:57.901834 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:35:57.901834 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:35:57.901834 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 03:35:57.901834 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 03:35:57.901834 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 03:35:57.901834 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 03:35:57.901834 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:35:57.901834 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:35:57.901834 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:35:57.901834 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:35:57.901834 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7053eb43-3b62-45b6-820f-53b24d5b68fd could not be found. Oct 27 03:35:57.901834 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:35:57.901834 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:35:57.901834 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:35:57.906867 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:35:57.906867 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:35:57.906867 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:35:57.906867 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:35:57.906867 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:35:57.906867 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7053eb43-3b62-45b6-820f-53b24d5b68fd could not be found. Oct 27 03:35:57.906867 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:35:57.909202 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8b2e448d-2bce-40ee-80c8-d4a0f57139fe tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Returning 404 to user: Instance 7053eb43-3b62-45b6-820f-53b24d5b68fd could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:35:57.910375 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8b2e448d-2bce-40ee-80c8-d4a0f57139fe tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7053eb43-3b62-45b6-820f-53b24d5b68fd" status: 404 len: 111 microversion: 2.1 time: 0.027669 Oct 27 03:35:57.915036 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1654/3547] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:35:57 2022] DELETE /compute/v2.1/servers/7053eb43-3b62-45b6-820f-53b24d5b68fd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:35:57.920675 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e353172e-57b8-480c-bdd6-d412763c37fe tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Calling method '.version_select at 0x7f7dda9b9e50>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:58.076238 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3f12e5b5-0bfa-48cb-a59f-45739dec614f tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d5d3f1bf1af4cd6884297b207597fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a1ba64cf9c47d5bdae52477338099e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:58.087226 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3f12e5b5-0bfa-48cb-a59f-45739dec614f tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] 10.222.0.20 "GET /compute/v2.1/servers/2a1bda43-af44-432d-8992-94473a5f8b5d" status: 200 len: 1351 microversion: 2.1 time: 0.348849 Oct 27 03:35:58.088632 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1894/3548] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:57 2022] GET /compute/v2.1/servers/2a1bda43-af44-432d-8992-94473a5f8b5d => generated 1351 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:58.097908 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-96932077-f5c0-4216-b83c-1170641faecb tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:58.101225 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-96932077-f5c0-4216-b83c-1170641faecb tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:58.139770 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-96932077-f5c0-4216-b83c-1170641faecb tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:58.147393 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-96932077-f5c0-4216-b83c-1170641faecb tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:58.147393 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-96932077-f5c0-4216-b83c-1170641faecb tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:58.148959 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-96932077-f5c0-4216-b83c-1170641faecb tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:58.153686 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-96932077-f5c0-4216-b83c-1170641faecb tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:58.159013 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-96932077-f5c0-4216-b83c-1170641faecb tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:58.311135 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e353172e-57b8-480c-bdd6-d412763c37fe tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] 10.222.0.20 "DELETE /compute/v2.1/images/f2f752a5-ebaf-4a15-b2d9-ee7cf10cc793" status: 204 len: 0 microversion: 2.1 time: 0.394343 Oct 27 03:35:58.313081 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1655/3549] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:57 2022] DELETE /compute/v2.1/images/f2f752a5-ebaf-4a15-b2d9-ee7cf10cc793 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:35:58.319853 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-32db4371-eedc-4e96-b1e7-f141a6d2cf39 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7ddaa91670>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:58.384731 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-32db4371-eedc-4e96-b1e7-f141a6d2cf39 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images/42320033-6276-453e-b35d-504a52d80d70" status: 200 len: 1454 microversion: 2.1 time: 0.070078 Oct 27 03:35:58.385492 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1656/3550] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:35:58 2022] GET /compute/v2.1/images/42320033-6276-453e-b35d-504a52d80d70 => generated 1454 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:58.399449 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2c278ed7-aa22-4172-9a41-dad0d52fd196 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:58.399449 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-2c278ed7-aa22-4172-9a41-dad0d52fd196 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] [instance: 09065cd4-8246-49ee-80fe-b4f1c11b468d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:58.407997 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2c278ed7-aa22-4172-9a41-dad0d52fd196 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:58.408731 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2c278ed7-aa22-4172-9a41-dad0d52fd196 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:58.409240 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2c278ed7-aa22-4172-9a41-dad0d52fd196 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:58.410373 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2c278ed7-aa22-4172-9a41-dad0d52fd196 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:58.410842 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2c278ed7-aa22-4172-9a41-dad0d52fd196 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:58.411366 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2c278ed7-aa22-4172-9a41-dad0d52fd196 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:58.531235 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-96932077-f5c0-4216-b83c-1170641faecb tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:58.542338 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-96932077-f5c0-4216-b83c-1170641faecb tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1505 microversion: 2.1 time: 0.450368 Oct 27 03:35:58.555705 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1895/3551] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:58 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1505 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:58.569708 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9fbee810-ecaf-422f-a1d0-f4ba190a49ec tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:58.571338 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-9fbee810-ecaf-422f-a1d0-f4ba190a49ec tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:58.578498 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9fbee810-ecaf-422f-a1d0-f4ba190a49ec tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:58.579479 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9fbee810-ecaf-422f-a1d0-f4ba190a49ec tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:58.579935 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9fbee810-ecaf-422f-a1d0-f4ba190a49ec tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:58.580725 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9fbee810-ecaf-422f-a1d0-f4ba190a49ec tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:58.581198 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9fbee810-ecaf-422f-a1d0-f4ba190a49ec tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:58.581634 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9fbee810-ecaf-422f-a1d0-f4ba190a49ec tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:58.752863 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9fbee810-ecaf-422f-a1d0-f4ba190a49ec tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:58.764488 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9fbee810-ecaf-422f-a1d0-f4ba190a49ec tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1505 microversion: 2.1 time: 0.198597 Oct 27 03:35:58.765678 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1896/3552] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:58 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1505 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:58.770695 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-19d5f08f-dd74-4e9e-a5a3-001607b3aae3 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:58.785364 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-19d5f08f-dd74-4e9e-a5a3-001607b3aae3 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] [instance: 8c8a2cbb-4acf-4a6b-b684-567617bb930d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:58.798198 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-19d5f08f-dd74-4e9e-a5a3-001607b3aae3 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:58.799837 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-19d5f08f-dd74-4e9e-a5a3-001607b3aae3 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:58.804212 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-19d5f08f-dd74-4e9e-a5a3-001607b3aae3 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:58.805212 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-19d5f08f-dd74-4e9e-a5a3-001607b3aae3 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:58.807174 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-19d5f08f-dd74-4e9e-a5a3-001607b3aae3 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:58.807826 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-19d5f08f-dd74-4e9e-a5a3-001607b3aae3 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:59.085266 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2c278ed7-aa22-4172-9a41-dad0d52fd196 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c36bef85ac34b4983a79e03c56965c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e58f30136ed4a4d9bff48e9b4cde5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:59.098237 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2c278ed7-aa22-4172-9a41-dad0d52fd196 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] 10.222.0.20 "GET /compute/v2.1/servers/09065cd4-8246-49ee-80fe-b4f1c11b468d" status: 200 len: 1538 microversion: 2.1 time: 0.710513 Oct 27 03:35:59.108666 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-19d5f08f-dd74-4e9e-a5a3-001607b3aae3 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:59.118434 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-19d5f08f-dd74-4e9e-a5a3-001607b3aae3 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:59.119890 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-19d5f08f-dd74-4e9e-a5a3-001607b3aae3 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:59.121075 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-19d5f08f-dd74-4e9e-a5a3-001607b3aae3 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d" status: 200 len: 1878 microversion: 2.42 time: 0.354253 Oct 27 03:35:59.128008 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1657/3553] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:58 2022] GET /compute/v2.1/servers/09065cd4-8246-49ee-80fe-b4f1c11b468d => generated 1538 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:59.129555 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1897/3554] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:35:58 2022] GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d => generated 1878 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:35:59.134376 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-63f317a3-5c9f-4716-9fbf-d2a031e59b86 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:59.135230 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-63f317a3-5c9f-4716-9fbf-d2a031e59b86 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: c5c50ae8-6217-4650-8420-291847e21ace] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:59.148582 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-63f317a3-5c9f-4716-9fbf-d2a031e59b86 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:59.149382 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-63f317a3-5c9f-4716-9fbf-d2a031e59b86 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:59.149532 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-63f317a3-5c9f-4716-9fbf-d2a031e59b86 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:59.150172 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-63f317a3-5c9f-4716-9fbf-d2a031e59b86 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:59.150635 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-63f317a3-5c9f-4716-9fbf-d2a031e59b86 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:59.151067 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-63f317a3-5c9f-4716-9fbf-d2a031e59b86 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:59.152973 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-928e258a-b085-48af-8b98-63fcc6d1174a tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:59.156004 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-928e258a-b085-48af-8b98-63fcc6d1174a tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Failed to fetch instance by id 9223372036854775808 {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 27 03:35:59.156857 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-928e258a-b085-48af-8b98-63fcc6d1174a tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Oct 27 03:35:59.159299 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-928e258a-b085-48af-8b98-63fcc6d1174a tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Request method failure captured: Oct 27 03:35:59.159299 n-d-862769-1 devstack@n-api.service[121000]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Oct 27 03:35:59.159299 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:35:59.159299 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:35:59.159299 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:35:59.159299 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:35:59.159299 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:35:59.159299 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:35:59.159299 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:35:59.159299 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:35:59.159299 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfxF6ut9nM9a9AcpKLO7IgCu-akAJ2YJGjrI9C8NUveA8uObV2XgQIQvsIxuWjvLl9meIEqpfGwZYr8MTX_PAGoiJsNUPXh5ERSce5cPYQYCCFPL0HtTb-E11C_2kfWy1wRps1tClRNvtj8zAqCGRhs1x-Uvl0zISdfHepXmvWX31Us Oct 27 03:35:59.159299 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:35:59.159299 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:35:59.159299 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:35:59.159299 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:35:59.159299 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:35:59.159299 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:35:59.159299 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 8bb5d291069d4329a90123e327fe9c59 Oct 27 03:35:59.159299 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:35:59.159299 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:35:59.159299 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:35:59.159299 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8bb5d291069d4329a90123e327fe9c59"}]}] Oct 27 03:35:59.159299 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:35:59.159299 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 8bb5d291069d4329a90123e327fe9c59 Oct 27 03:35:59.159299 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:35:59.159299 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ServersNegativeTestJSON-4378389-project Oct 27 03:35:59.159299 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:35:59.159299 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:35:59.159299 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: f9c32b7626594ff888970c7f3227bb20 Oct 27 03:35:59.159299 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ServersNegativeTestJSON-4378389-project Oct 27 03:35:59.159299 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:35:59.159299 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 9223372036854775808 could not be found. Oct 27 03:35:59.159299 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '9223372036854775808'} Oct 27 03:35:59.159299 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:35:59.159299 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:35:59.159299 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:35:59.159299 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:35:59.159299 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 27 03:35:59.159299 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 27 03:35:59.159299 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Oct 27 03:35:59.159299 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:35:59.159299 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:35:59.159299 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:35:59.159299 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:35:59.159299 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:35:59.159299 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:35:59.159299 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:35:59.159299 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:35:59.159299 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:35:59.159299 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:35:59.159299 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 03:35:59.159299 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 03:35:59.159299 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 03:35:59.159299 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 03:35:59.159299 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:35:59.159299 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:35:59.159299 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:35:59.159299 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:35:59.159299 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Oct 27 03:35:59.159299 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:35:59.159299 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:35:59.159299 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:35:59.159299 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:35:59.159299 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:35:59.163964 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:35:59.163964 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:35:59.163964 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:35:59.163964 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Oct 27 03:35:59.163964 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:35:59.166168 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-928e258a-b085-48af-8b98-63fcc6d1174a tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:35:59.170437 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-928e258a-b085-48af-8b98-63fcc6d1174a tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.038092 Oct 27 03:35:59.170437 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1658/3555] 10.222.0.20 () {58 vars in 1188 bytes} [Thu Oct 27 03:35:59 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 03:35:59.173899 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-826aa620-50ed-4568-b576-533b264f7a51 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:59.174730 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-826aa620-50ed-4568-b576-533b264f7a51 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] [instance: 2a1bda43-af44-432d-8992-94473a5f8b5d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:59.192743 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-826aa620-50ed-4568-b576-533b264f7a51 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:59.194396 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-826aa620-50ed-4568-b576-533b264f7a51 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:59.195139 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-826aa620-50ed-4568-b576-533b264f7a51 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:59.199306 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-826aa620-50ed-4568-b576-533b264f7a51 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:59.199306 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-826aa620-50ed-4568-b576-533b264f7a51 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:59.199306 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-826aa620-50ed-4568-b576-533b264f7a51 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:59.426892 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-63f317a3-5c9f-4716-9fbf-d2a031e59b86 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18036411a99e4634bfbaeae24b9f254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229dcb63bc41444391544883b576ce2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:59.439476 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-63f317a3-5c9f-4716-9fbf-d2a031e59b86 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/c5c50ae8-6217-4650-8420-291847e21ace" status: 200 len: 1364 microversion: 2.1 time: 0.308613 Oct 27 03:35:59.452191 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1898/3556] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:59 2022] GET /compute/v2.1/servers/c5c50ae8-6217-4650-8420-291847e21ace => generated 1364 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:59.464547 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-68fd1c6f-ade3-4ad0-9eac-d116284046c9 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:59.465433 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-68fd1c6f-ade3-4ad0-9eac-d116284046c9 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:59.482089 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-68fd1c6f-ade3-4ad0-9eac-d116284046c9 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:59.486872 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-68fd1c6f-ade3-4ad0-9eac-d116284046c9 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:59.486872 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-68fd1c6f-ade3-4ad0-9eac-d116284046c9 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:59.486872 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-68fd1c6f-ade3-4ad0-9eac-d116284046c9 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:59.486872 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-68fd1c6f-ade3-4ad0-9eac-d116284046c9 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:59.486872 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-68fd1c6f-ade3-4ad0-9eac-d116284046c9 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:59.501016 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-826aa620-50ed-4568-b576-533b264f7a51 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d5d3f1bf1af4cd6884297b207597fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a1ba64cf9c47d5bdae52477338099e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:59.509024 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-826aa620-50ed-4568-b576-533b264f7a51 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] 10.222.0.20 "GET /compute/v2.1/servers/2a1bda43-af44-432d-8992-94473a5f8b5d" status: 200 len: 1351 microversion: 2.1 time: 0.340059 Oct 27 03:35:59.509602 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1659/3557] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:59 2022] GET /compute/v2.1/servers/2a1bda43-af44-432d-8992-94473a5f8b5d => generated 1351 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:59.514415 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d0544000-b62b-4913-9361-3c7b2870f086 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7ddae14700>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:59.571770 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d0544000-b62b-4913-9361-3c7b2870f086 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images/42320033-6276-453e-b35d-504a52d80d70" status: 200 len: 1463 microversion: 2.1 time: 0.060750 Oct 27 03:35:59.572769 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1660/3558] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:35:59 2022] GET /compute/v2.1/images/42320033-6276-453e-b35d-504a52d80d70 => generated 1463 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:59.589025 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-548b4de1-936c-4829-b030-79920b70d051 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7dda97e940>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:59.645226 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-548b4de1-936c-4829-b030-79920b70d051 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images/42320033-6276-453e-b35d-504a52d80d70" status: 200 len: 1463 microversion: 2.1 time: 0.061800 Oct 27 03:35:59.656175 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1661/3559] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:35:59 2022] GET /compute/v2.1/images/42320033-6276-453e-b35d-504a52d80d70 => generated 1463 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:59.661243 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2b589336-67de-4c2e-8487-df21a09b2009 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:59.661885 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-2b589336-67de-4c2e-8487-df21a09b2009 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] [instance: 004575c6-51ce-48d9-b7a6-d50f9afdb0a0] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:59.676079 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2b589336-67de-4c2e-8487-df21a09b2009 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:59.677170 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2b589336-67de-4c2e-8487-df21a09b2009 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:59.678521 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2b589336-67de-4c2e-8487-df21a09b2009 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:59.680593 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2b589336-67de-4c2e-8487-df21a09b2009 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:59.682776 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2b589336-67de-4c2e-8487-df21a09b2009 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:59.683257 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2b589336-67de-4c2e-8487-df21a09b2009 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:59.756317 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-68fd1c6f-ade3-4ad0-9eac-d116284046c9 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:59.766590 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-68fd1c6f-ade3-4ad0-9eac-d116284046c9 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1505 microversion: 2.1 time: 0.313118 Oct 27 03:35:59.767182 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1899/3560] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:59 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1505 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:59.794127 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-30a14bb9-26f5-4704-a80d-a55d55384dbc tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:35:59.795906 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-30a14bb9-26f5-4704-a80d-a55d55384dbc tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:35:59.802584 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-30a14bb9-26f5-4704-a80d-a55d55384dbc tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:59.805547 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-30a14bb9-26f5-4704-a80d-a55d55384dbc tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:59.805547 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-30a14bb9-26f5-4704-a80d-a55d55384dbc tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:59.805737 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-30a14bb9-26f5-4704-a80d-a55d55384dbc tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:35:59.806255 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-30a14bb9-26f5-4704-a80d-a55d55384dbc tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:35:59.806694 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-30a14bb9-26f5-4704-a80d-a55d55384dbc tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:35:59.956029 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2b589336-67de-4c2e-8487-df21a09b2009 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae7845f6759c4dcabcc1516a72484174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d371ab6648425eac2cf1702f2789dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:35:59.965904 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2b589336-67de-4c2e-8487-df21a09b2009 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/servers/004575c6-51ce-48d9-b7a6-d50f9afdb0a0" status: 200 len: 1468 microversion: 2.1 time: 0.308614 Oct 27 03:35:59.981991 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1662/3561] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:59 2022] GET /compute/v2.1/servers/004575c6-51ce-48d9-b7a6-d50f9afdb0a0 => generated 1468 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:35:59.999238 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-176b54d6-c30b-43a0-8a8a-77d75b9d3b75 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-515815332"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:36:00.000365 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-30a14bb9-26f5-4704-a80d-a55d55384dbc tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:00.002875 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-176b54d6-c30b-43a0-8a8a-77d75b9d3b75 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] [instance: f50da5a9-2bb6-4735-93c3-d73ece0964f3] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:00.010146 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-176b54d6-c30b-43a0-8a8a-77d75b9d3b75 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:00.010877 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-176b54d6-c30b-43a0-8a8a-77d75b9d3b75 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:00.012815 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-176b54d6-c30b-43a0-8a8a-77d75b9d3b75 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:00.014473 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-176b54d6-c30b-43a0-8a8a-77d75b9d3b75 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:00.015281 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-176b54d6-c30b-43a0-8a8a-77d75b9d3b75 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:00.015579 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-30a14bb9-26f5-4704-a80d-a55d55384dbc tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1505 microversion: 2.1 time: 0.225439 Oct 27 03:36:00.019180 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1900/3562] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:35:59 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1505 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:36:00.019306 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-176b54d6-c30b-43a0-8a8a-77d75b9d3b75 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:00.048842 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-eae9ab4c-cc45-400a-920f-e1a730d1dd9e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:00.049341 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-eae9ab4c-cc45-400a-920f-e1a730d1dd9e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Failed to fetch instance by id -1 {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 27 03:36:00.049873 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-eae9ab4c-cc45-400a-920f-e1a730d1dd9e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] HTTP exception thrown: Instance -1 could not be found. Oct 27 03:36:00.054720 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-eae9ab4c-cc45-400a-920f-e1a730d1dd9e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Request method failure captured: Oct 27 03:36:00.054720 n-d-862769-1 devstack@n-api.service[121001]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Oct 27 03:36:00.054720 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:36:00.054720 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:36:00.054720 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:36:00.054720 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:36:00.054720 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:36:00.054720 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:36:00.054720 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:36:00.054720 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:36:00.054720 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfxF6ut9nM9a9AcpKLO7IgCu-akAJ2YJGjrI9C8NUveA8uObV2XgQIQvsIxuWjvLl9meIEqpfGwZYr8MTX_PAGoiJsNUPXh5ERSce5cPYQYCCFPL0HtTb-E11C_2kfWy1wRps1tClRNvtj8zAqCGRhs1x-Uvl0zISdfHepXmvWX31Us Oct 27 03:36:00.054720 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:36:00.054720 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:36:00.054720 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:36:00.054720 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:36:00.054720 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:36:00.054720 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:36:00.054720 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 8bb5d291069d4329a90123e327fe9c59 Oct 27 03:36:00.054720 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:36:00.054720 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:36:00.054720 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:36:00.054720 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8bb5d291069d4329a90123e327fe9c59"}]}] Oct 27 03:36:00.054720 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:36:00.054720 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 8bb5d291069d4329a90123e327fe9c59 Oct 27 03:36:00.054720 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:36:00.054720 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServersNegativeTestJSON-4378389-project Oct 27 03:36:00.054720 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:36:00.054720 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:36:00.054720 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: f9c32b7626594ff888970c7f3227bb20 Oct 27 03:36:00.054720 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServersNegativeTestJSON-4378389-project Oct 27 03:36:00.054720 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:36:00.054720 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance -1 could not be found. Oct 27 03:36:00.054720 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '-1'} Oct 27 03:36:00.054720 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:36:00.054720 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:36:00.054720 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:36:00.054720 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:36:00.054720 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 27 03:36:00.054720 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 27 03:36:00.054720 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Oct 27 03:36:00.054720 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:00.054720 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:36:00.054720 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:00.054720 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:36:00.054720 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:36:00.054720 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:36:00.054720 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:36:00.054720 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:36:00.054720 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:36:00.054720 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:36:00.054720 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 03:36:00.054720 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 03:36:00.054720 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 03:36:00.054720 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 03:36:00.054720 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:36:00.054720 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:36:00.054720 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:36:00.054720 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:36:00.054720 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Oct 27 03:36:00.054720 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:00.054720 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:36:00.054720 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:00.054720 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:36:00.054720 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:36:00.054720 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:36:00.061520 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:36:00.061520 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:36:00.061520 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Oct 27 03:36:00.061520 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:00.061520 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-eae9ab4c-cc45-400a-920f-e1a730d1dd9e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Returning 404 to user: Instance -1 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:36:00.061520 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-eae9ab4c-cc45-400a-920f-e1a730d1dd9e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.008828 Oct 27 03:36:00.061520 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1901/3563] 10.222.0.20 () {58 vars in 1137 bytes} [Thu Oct 27 03:36:00 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 03:36:00.066629 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4071c0db-69c7-4a88-92f9-600a7a259c92 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:00.067256 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4071c0db-69c7-4a88-92f9-600a7a259c92 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:00.075312 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4071c0db-69c7-4a88-92f9-600a7a259c92 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:00.075820 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4071c0db-69c7-4a88-92f9-600a7a259c92 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:00.076806 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4071c0db-69c7-4a88-92f9-600a7a259c92 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:00.077519 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4071c0db-69c7-4a88-92f9-600a7a259c92 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:00.078624 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4071c0db-69c7-4a88-92f9-600a7a259c92 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:00.079265 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4071c0db-69c7-4a88-92f9-600a7a259c92 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:00.318870 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4071c0db-69c7-4a88-92f9-600a7a259c92 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:00.329239 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4071c0db-69c7-4a88-92f9-600a7a259c92 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1505 microversion: 2.1 time: 0.266399 Oct 27 03:36:00.330226 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1902/3564] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:00 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1505 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:00.335846 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-dfdf5864-e904-4d23-8a5f-aa3f9cba5388 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:00.336475 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-dfdf5864-e904-4d23-8a5f-aa3f9cba5388 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] [instance: 09065cd4-8246-49ee-80fe-b4f1c11b468d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:00.345090 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dfdf5864-e904-4d23-8a5f-aa3f9cba5388 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:00.350822 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dfdf5864-e904-4d23-8a5f-aa3f9cba5388 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:00.351381 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dfdf5864-e904-4d23-8a5f-aa3f9cba5388 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:00.352184 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dfdf5864-e904-4d23-8a5f-aa3f9cba5388 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:00.352656 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dfdf5864-e904-4d23-8a5f-aa3f9cba5388 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:00.353425 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dfdf5864-e904-4d23-8a5f-aa3f9cba5388 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:00.593702 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-dfdf5864-e904-4d23-8a5f-aa3f9cba5388 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c36bef85ac34b4983a79e03c56965c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e58f30136ed4a4d9bff48e9b4cde5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:00.613411 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-dfdf5864-e904-4d23-8a5f-aa3f9cba5388 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] 10.222.0.20 "GET /compute/v2.1/servers/09065cd4-8246-49ee-80fe-b4f1c11b468d" status: 200 len: 1533 microversion: 2.1 time: 0.281734 Oct 27 03:36:00.614697 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1903/3565] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:00 2022] GET /compute/v2.1/servers/09065cd4-8246-49ee-80fe-b4f1c11b468d => generated 1533 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:00.619651 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7d707fee-dc00-4d18-b06f-b560d1cf44d5 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:00.624626 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7d707fee-dc00-4d18-b06f-b560d1cf44d5 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] [instance: 8c8a2cbb-4acf-4a6b-b684-567617bb930d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:00.637982 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7d707fee-dc00-4d18-b06f-b560d1cf44d5 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:00.637982 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7d707fee-dc00-4d18-b06f-b560d1cf44d5 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:00.637982 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7d707fee-dc00-4d18-b06f-b560d1cf44d5 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:00.637982 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7d707fee-dc00-4d18-b06f-b560d1cf44d5 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:00.637982 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7d707fee-dc00-4d18-b06f-b560d1cf44d5 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:00.637982 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7d707fee-dc00-4d18-b06f-b560d1cf44d5 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:00.662473 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-176b54d6-c30b-43a0-8a8a-77d75b9d3b75 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "POST /compute/v2.1/servers/f50da5a9-2bb6-4735-93c3-d73ece0964f3/action" status: 202 len: 0 microversion: 2.1 time: 0.671156 Oct 27 03:36:00.694355 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1663/3566] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:35:59 2022] POST /compute/v2.1/servers/f50da5a9-2bb6-4735-93c3-d73ece0964f3/action => generated 0 bytes in 704 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 27 03:36:00.708051 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-714163fc-c7ba-4cff-a8c1-436f0312ceeb tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:00.708806 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-714163fc-c7ba-4cff-a8c1-436f0312ceeb tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:00.723835 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-714163fc-c7ba-4cff-a8c1-436f0312ceeb tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:00.724385 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-714163fc-c7ba-4cff-a8c1-436f0312ceeb tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:00.724838 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-714163fc-c7ba-4cff-a8c1-436f0312ceeb tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:00.729915 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-714163fc-c7ba-4cff-a8c1-436f0312ceeb tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:00.730744 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-714163fc-c7ba-4cff-a8c1-436f0312ceeb tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:00.731202 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-714163fc-c7ba-4cff-a8c1-436f0312ceeb tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:00.998676 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7d707fee-dc00-4d18-b06f-b560d1cf44d5 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:01.009791 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7d707fee-dc00-4d18-b06f-b560d1cf44d5 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:01.012148 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7d707fee-dc00-4d18-b06f-b560d1cf44d5 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:01.013764 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7d707fee-dc00-4d18-b06f-b560d1cf44d5 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d" status: 200 len: 1878 microversion: 2.42 time: 0.397915 Oct 27 03:36:01.030737 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1904/3567] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:36:00 2022] GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d => generated 1878 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:36:01.040250 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b1a449f5-d126-4932-a110-722ecd40ef3e tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:01.041126 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b1a449f5-d126-4932-a110-722ecd40ef3e tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: c5c50ae8-6217-4650-8420-291847e21ace] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:01.047997 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b1a449f5-d126-4932-a110-722ecd40ef3e tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:01.050147 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b1a449f5-d126-4932-a110-722ecd40ef3e tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:01.050147 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b1a449f5-d126-4932-a110-722ecd40ef3e tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:01.050147 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b1a449f5-d126-4932-a110-722ecd40ef3e tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:01.050905 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b1a449f5-d126-4932-a110-722ecd40ef3e tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:01.051545 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b1a449f5-d126-4932-a110-722ecd40ef3e tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:01.129915 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-714163fc-c7ba-4cff-a8c1-436f0312ceeb tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:01.143850 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-714163fc-c7ba-4cff-a8c1-436f0312ceeb tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1505 microversion: 2.1 time: 0.445341 Oct 27 03:36:01.156818 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1664/3568] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:00 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1505 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:01.174738 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7977265b-093b-47fe-8d0f-fdc5f1753c20 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:01.175640 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7977265b-093b-47fe-8d0f-fdc5f1753c20 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] [instance: 2a1bda43-af44-432d-8992-94473a5f8b5d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:01.185053 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7977265b-093b-47fe-8d0f-fdc5f1753c20 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:01.185960 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7977265b-093b-47fe-8d0f-fdc5f1753c20 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:01.187168 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7977265b-093b-47fe-8d0f-fdc5f1753c20 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:01.188770 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7977265b-093b-47fe-8d0f-fdc5f1753c20 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:01.189586 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7977265b-093b-47fe-8d0f-fdc5f1753c20 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:01.190307 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7977265b-093b-47fe-8d0f-fdc5f1753c20 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:01.340181 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b1a449f5-d126-4932-a110-722ecd40ef3e tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18036411a99e4634bfbaeae24b9f254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229dcb63bc41444391544883b576ce2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:01.358009 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b1a449f5-d126-4932-a110-722ecd40ef3e tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/c5c50ae8-6217-4650-8420-291847e21ace" status: 200 len: 1364 microversion: 2.1 time: 0.325414 Oct 27 03:36:01.359903 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1905/3569] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:01 2022] GET /compute/v2.1/servers/c5c50ae8-6217-4650-8420-291847e21ace => generated 1364 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:01.365989 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ccb743bc-9f4c-4fc0-86dd-a0102e2996f2 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7dd9de0a60>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:01.436848 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ccb743bc-9f4c-4fc0-86dd-a0102e2996f2 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images/81186aa0-7ea8-487e-9c34-69f89a3830e6" status: 200 len: 1454 microversion: 2.1 time: 0.075223 Oct 27 03:36:01.437126 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1906/3570] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:36:01 2022] GET /compute/v2.1/images/81186aa0-7ea8-487e-9c34-69f89a3830e6 => generated 1454 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:01.447490 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-ba949eb5-20df-4559-86c7-5f002d473724 req-f9858176-1715-4647-b773-2d8593cadf62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5c50ae8-6217-4650-8420-291847e21ace", "tag": "72613a85-f4ba-4f66-8e4c-034d84cc97e5"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:36:01.453590 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7977265b-093b-47fe-8d0f-fdc5f1753c20 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d5d3f1bf1af4cd6884297b207597fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a1ba64cf9c47d5bdae52477338099e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:01.461826 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-ba949eb5-20df-4559-86c7-5f002d473724 req-f9858176-1715-4647-b773-2d8593cadf62 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:01.462565 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-ba949eb5-20df-4559-86c7-5f002d473724 req-f9858176-1715-4647-b773-2d8593cadf62 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:01.463246 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-ba949eb5-20df-4559-86c7-5f002d473724 req-f9858176-1715-4647-b773-2d8593cadf62 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:01.470097 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7977265b-093b-47fe-8d0f-fdc5f1753c20 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] 10.222.0.20 "GET /compute/v2.1/servers/2a1bda43-af44-432d-8992-94473a5f8b5d" status: 200 len: 1351 microversion: 2.1 time: 0.309165 Oct 27 03:36:01.471235 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1665/3571] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:01 2022] GET /compute/v2.1/servers/2a1bda43-af44-432d-8992-94473a5f8b5d => generated 1351 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:01.476141 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-46455be7-b25c-436b-a0f2-3fb7febb234a tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:36:01.479389 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-46455be7-b25c-436b-a0f2-3fb7febb234a tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: d63ed403-5bee-497c-a63d-76d43506d28b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:01.494741 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-46455be7-b25c-436b-a0f2-3fb7febb234a tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] HTTP exception thrown: Instance d63ed403-5bee-497c-a63d-76d43506d28b could not be found. Oct 27 03:36:01.501241 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-ba949eb5-20df-4559-86c7-5f002d473724 req-f9858176-1715-4647-b773-2d8593cadf62 service nova] Creating event network-changed:72613a85-f4ba-4f66-8e4c-034d84cc97e5 for instance c5c50ae8-6217-4650-8420-291847e21ace on n-h1-862769-1 Oct 27 03:36:01.502068 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-ba949eb5-20df-4559-86c7-5f002d473724 req-f9858176-1715-4647-b773-2d8593cadf62 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063056 Oct 27 03:36:01.502330 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-46455be7-b25c-436b-a0f2-3fb7febb234a tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Request method failure captured: Oct 27 03:36:01.502330 n-d-862769-1 devstack@n-api.service[121000]: request: POST /compute/v2.1/servers/d63ed403-5bee-497c-a63d-76d43506d28b/action HTTP/1.1 Oct 27 03:36:01.502330 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:36:01.502330 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:36:01.502330 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:36:01.502330 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 19 Oct 27 03:36:01.502330 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:36:01.502330 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:36:01.502330 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:36:01.502330 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:36:01.502330 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfxF6ut9nM9a9AcpKLO7IgCu-akAJ2YJGjrI9C8NUveA8uObV2XgQIQvsIxuWjvLl9meIEqpfGwZYr8MTX_PAGoiJsNUPXh5ERSce5cPYQYCCFPL0HtTb-E11C_2kfWy1wRps1tClRNvtj8zAqCGRhs1x-Uvl0zISdfHepXmvWX31Us Oct 27 03:36:01.502330 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:36:01.502330 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:36:01.502330 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:36:01.502330 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:36:01.502330 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:36:01.502330 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:36:01.502330 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 8bb5d291069d4329a90123e327fe9c59 Oct 27 03:36:01.502330 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:36:01.502330 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:36:01.502330 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:36:01.502330 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8bb5d291069d4329a90123e327fe9c59"}]}] Oct 27 03:36:01.502330 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:36:01.502330 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 8bb5d291069d4329a90123e327fe9c59 Oct 27 03:36:01.502330 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:36:01.502330 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ServersNegativeTestJSON-4378389-project Oct 27 03:36:01.502330 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:36:01.502330 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:36:01.502330 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: f9c32b7626594ff888970c7f3227bb20 Oct 27 03:36:01.502330 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ServersNegativeTestJSON-4378389-project Oct 27 03:36:01.502330 n-d-862769-1 devstack@n-api.service[121000]: Oct 27 03:36:01.502330 n-d-862769-1 devstack@n-api.service[121000]: {"forceDelete": {}} Oct 27 03:36:01.502330 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:36:01.502330 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance d63ed403-5bee-497c-a63d-76d43506d28b could not be found. Oct 27 03:36:01.502330 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': 'd63ed403-5bee-497c-a63d-76d43506d28b', 'body': {'forceDelete': {}}} Oct 27 03:36:01.502330 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:36:01.502330 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:36:01.502330 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:36:01.502330 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:36:01.502330 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:36:01.502330 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:36:01.502330 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 03:36:01.502330 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 03:36:01.502330 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d63ed403-5bee-497c-a63d-76d43506d28b could not be found. Oct 27 03:36:01.502330 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:36:01.502330 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:36:01.502330 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:36:01.502330 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:36:01.502330 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:36:01.502330 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:36:01.502330 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:36:01.502330 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:36:01.502330 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:36:01.502330 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:36:01.502330 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Oct 27 03:36:01.502330 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 27 03:36:01.502330 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:36:01.502330 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:36:01.502330 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d63ed403-5bee-497c-a63d-76d43506d28b could not be found. Oct 27 03:36:01.502330 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:36:01.502330 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:36:01.502330 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:36:01.502330 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:36:01.502330 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:36:01.502330 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:36:01.506614 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:36:01.506614 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:36:01.506614 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d63ed403-5bee-497c-a63d-76d43506d28b could not be found. Oct 27 03:36:01.506614 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:36:01.506889 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1907/3572] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:36:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:36:01.506980 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-46455be7-b25c-436b-a0f2-3fb7febb234a tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Returning 404 to user: Instance d63ed403-5bee-497c-a63d-76d43506d28b could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:36:01.506980 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-46455be7-b25c-436b-a0f2-3fb7febb234a tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "POST /compute/v2.1/servers/d63ed403-5bee-497c-a63d-76d43506d28b/action" status: 404 len: 111 microversion: 2.1 time: 0.031473 Oct 27 03:36:01.506980 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1666/3573] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:36:01 2022] POST /compute/v2.1/servers/d63ed403-5bee-497c-a63d-76d43506d28b/action => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:36:01.512931 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3041ab09-a8a3-44f1-8f6f-b9de21d0a64f tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:01.514379 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3041ab09-a8a3-44f1-8f6f-b9de21d0a64f tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:01.523065 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3041ab09-a8a3-44f1-8f6f-b9de21d0a64f tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:01.523560 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3041ab09-a8a3-44f1-8f6f-b9de21d0a64f tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:01.524434 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3041ab09-a8a3-44f1-8f6f-b9de21d0a64f tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:01.532037 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3041ab09-a8a3-44f1-8f6f-b9de21d0a64f tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:01.532037 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3041ab09-a8a3-44f1-8f6f-b9de21d0a64f tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:01.532037 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3041ab09-a8a3-44f1-8f6f-b9de21d0a64f tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:01.646111 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-cde5f075-861c-4ccb-8527-2fb17c66d092 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:01.646992 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-cde5f075-861c-4ccb-8527-2fb17c66d092 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] [instance: 09065cd4-8246-49ee-80fe-b4f1c11b468d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:01.654969 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cde5f075-861c-4ccb-8527-2fb17c66d092 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:01.655784 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cde5f075-861c-4ccb-8527-2fb17c66d092 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:01.656332 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cde5f075-861c-4ccb-8527-2fb17c66d092 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:01.657451 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cde5f075-861c-4ccb-8527-2fb17c66d092 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:01.658028 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cde5f075-861c-4ccb-8527-2fb17c66d092 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:01.658591 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cde5f075-861c-4ccb-8527-2fb17c66d092 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:01.750958 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3041ab09-a8a3-44f1-8f6f-b9de21d0a64f tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:01.759227 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3041ab09-a8a3-44f1-8f6f-b9de21d0a64f tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1505 microversion: 2.1 time: 0.250381 Oct 27 03:36:01.760166 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1908/3574] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:01 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1505 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:01.786642 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-28f0842e-4f9e-4ae8-810f-002ee11b5728 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:01.787284 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-28f0842e-4f9e-4ae8-810f-002ee11b5728 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:01.801393 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-28f0842e-4f9e-4ae8-810f-002ee11b5728 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:01.801393 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-28f0842e-4f9e-4ae8-810f-002ee11b5728 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:01.801393 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-28f0842e-4f9e-4ae8-810f-002ee11b5728 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:01.801393 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-28f0842e-4f9e-4ae8-810f-002ee11b5728 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:01.801779 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-28f0842e-4f9e-4ae8-810f-002ee11b5728 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:01.802778 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-28f0842e-4f9e-4ae8-810f-002ee11b5728 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:01.903294 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-cde5f075-861c-4ccb-8527-2fb17c66d092 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c36bef85ac34b4983a79e03c56965c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e58f30136ed4a4d9bff48e9b4cde5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:01.911840 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-cde5f075-861c-4ccb-8527-2fb17c66d092 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] 10.222.0.20 "GET /compute/v2.1/servers/09065cd4-8246-49ee-80fe-b4f1c11b468d" status: 200 len: 1520 microversion: 2.1 time: 0.270520 Oct 27 03:36:01.912434 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1667/3575] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:01 2022] GET /compute/v2.1/servers/09065cd4-8246-49ee-80fe-b4f1c11b468d => generated 1520 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:36:01.936700 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1549492e-7b78-4ee6-baac-6f8d0c1e6b91 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:01.937460 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1549492e-7b78-4ee6-baac-6f8d0c1e6b91 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] [instance: 09065cd4-8246-49ee-80fe-b4f1c11b468d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:01.944384 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1549492e-7b78-4ee6-baac-6f8d0c1e6b91 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:01.945157 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1549492e-7b78-4ee6-baac-6f8d0c1e6b91 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:01.945614 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1549492e-7b78-4ee6-baac-6f8d0c1e6b91 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:01.946363 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1549492e-7b78-4ee6-baac-6f8d0c1e6b91 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:01.946922 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1549492e-7b78-4ee6-baac-6f8d0c1e6b91 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:01.947985 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1549492e-7b78-4ee6-baac-6f8d0c1e6b91 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:01.960218 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-28f0842e-4f9e-4ae8-810f-002ee11b5728 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:01.971234 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-28f0842e-4f9e-4ae8-810f-002ee11b5728 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1505 microversion: 2.1 time: 0.190070 Oct 27 03:36:01.972131 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1909/3576] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:01 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1505 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:36:01.977196 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1549492e-7b78-4ee6-baac-6f8d0c1e6b91 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] [instance: 09065cd4-8246-49ee-80fe-b4f1c11b468d] Going to try to terminate instance {{(pid=121000) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:36:01.996370 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-71edfa99-b311-48b4-9573-980578ac63d9 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:36:01.999339 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-71edfa99-b311-48b4-9573-980578ac63d9 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 582d8d92-b24d-4505-99e4-7f129c592928] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:02.004955 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-71edfa99-b311-48b4-9573-980578ac63d9 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] HTTP exception thrown: Instance 582d8d92-b24d-4505-99e4-7f129c592928 could not be found. Oct 27 03:36:02.013399 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-71edfa99-b311-48b4-9573-980578ac63d9 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Request method failure captured: Oct 27 03:36:02.013399 n-d-862769-1 devstack@n-api.service[121001]: request: POST /compute/v2.1/servers/582d8d92-b24d-4505-99e4-7f129c592928/action HTTP/1.1 Oct 27 03:36:02.013399 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:36:02.013399 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:36:02.013399 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:36:02.013399 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 39 Oct 27 03:36:02.013399 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:36:02.013399 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:36:02.013399 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:36:02.013399 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:36:02.013399 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfxF6ut9nM9a9AcpKLO7IgCu-akAJ2YJGjrI9C8NUveA8uObV2XgQIQvsIxuWjvLl9meIEqpfGwZYr8MTX_PAGoiJsNUPXh5ERSce5cPYQYCCFPL0HtTb-E11C_2kfWy1wRps1tClRNvtj8zAqCGRhs1x-Uvl0zISdfHepXmvWX31Us Oct 27 03:36:02.013399 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:36:02.013399 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:36:02.013399 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:36:02.013399 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:36:02.013399 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:36:02.013399 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:36:02.013399 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 8bb5d291069d4329a90123e327fe9c59 Oct 27 03:36:02.013399 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:36:02.013399 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:36:02.013399 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:36:02.013399 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8bb5d291069d4329a90123e327fe9c59"}]}] Oct 27 03:36:02.013399 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:36:02.013399 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 8bb5d291069d4329a90123e327fe9c59 Oct 27 03:36:02.013399 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:36:02.013399 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServersNegativeTestJSON-4378389-project Oct 27 03:36:02.013399 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:36:02.013399 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:36:02.013399 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: f9c32b7626594ff888970c7f3227bb20 Oct 27 03:36:02.013399 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServersNegativeTestJSON-4378389-project Oct 27 03:36:02.013399 n-d-862769-1 devstack@n-api.service[121001]: Oct 27 03:36:02.013399 n-d-862769-1 devstack@n-api.service[121001]: {"os-getConsoleOutput": {"length": 10}} Oct 27 03:36:02.013399 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:36:02.013399 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 582d8d92-b24d-4505-99e4-7f129c592928 could not be found. Oct 27 03:36:02.013399 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '582d8d92-b24d-4505-99e4-7f129c592928', 'body': {'os-getConsoleOutput': {'length': 10}}} Oct 27 03:36:02.013399 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:36:02.013399 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:36:02.013399 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:36:02.013399 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:36:02.013399 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:36:02.013399 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:36:02.013399 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 03:36:02.013399 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 03:36:02.013399 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 582d8d92-b24d-4505-99e4-7f129c592928 could not be found. Oct 27 03:36:02.013399 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:02.013399 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:36:02.013399 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:02.013399 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:36:02.013399 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:36:02.013399 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:36:02.013399 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:36:02.013399 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:36:02.013399 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:36:02.013399 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:36:02.013399 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:36:02.013399 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:36:02.013399 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Oct 27 03:36:02.013399 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 27 03:36:02.013399 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:36:02.013399 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:36:02.013399 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 582d8d92-b24d-4505-99e4-7f129c592928 could not be found. Oct 27 03:36:02.013399 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:02.013399 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:36:02.013399 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:02.013399 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:36:02.019249 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:36:02.019249 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:36:02.019249 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:36:02.019249 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:36:02.019249 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 582d8d92-b24d-4505-99e4-7f129c592928 could not be found. Oct 27 03:36:02.019249 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:02.020566 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-71edfa99-b311-48b4-9573-980578ac63d9 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Returning 404 to user: Instance 582d8d92-b24d-4505-99e4-7f129c592928 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:36:02.021471 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-71edfa99-b311-48b4-9573-980578ac63d9 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "POST /compute/v2.1/servers/582d8d92-b24d-4505-99e4-7f129c592928/action" status: 404 len: 111 microversion: 2.1 time: 0.029455 Oct 27 03:36:02.022084 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1910/3577] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:36:01 2022] POST /compute/v2.1/servers/582d8d92-b24d-4505-99e4-7f129c592928/action => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 03:36:02.032856 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7514718c-58ec-474c-a5a7-b9377a024bf7 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:02.035197 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7514718c-58ec-474c-a5a7-b9377a024bf7 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:02.043424 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7514718c-58ec-474c-a5a7-b9377a024bf7 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:02.043928 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7514718c-58ec-474c-a5a7-b9377a024bf7 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:02.044378 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7514718c-58ec-474c-a5a7-b9377a024bf7 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:02.045128 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7514718c-58ec-474c-a5a7-b9377a024bf7 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:02.045585 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7514718c-58ec-474c-a5a7-b9377a024bf7 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:02.047018 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7514718c-58ec-474c-a5a7-b9377a024bf7 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:02.184906 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7514718c-58ec-474c-a5a7-b9377a024bf7 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:02.193766 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7514718c-58ec-474c-a5a7-b9377a024bf7 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1505 microversion: 2.1 time: 0.167288 Oct 27 03:36:02.194724 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1911/3578] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:02 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1505 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:36:02.205734 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-cb2e5918-654c-406a-90aa-e692639c31cd tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:02.206398 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-cb2e5918-654c-406a-90aa-e692639c31cd tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] [instance: 8c8a2cbb-4acf-4a6b-b684-567617bb930d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:02.212935 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cb2e5918-654c-406a-90aa-e692639c31cd tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:02.213677 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cb2e5918-654c-406a-90aa-e692639c31cd tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:02.214325 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cb2e5918-654c-406a-90aa-e692639c31cd tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:02.215215 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cb2e5918-654c-406a-90aa-e692639c31cd tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:02.215836 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cb2e5918-654c-406a-90aa-e692639c31cd tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:02.216431 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cb2e5918-654c-406a-90aa-e692639c31cd tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:02.294292 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1549492e-7b78-4ee6-baac-6f8d0c1e6b91 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] 10.222.0.20 "DELETE /compute/v2.1/servers/09065cd4-8246-49ee-80fe-b4f1c11b468d" status: 204 len: 0 microversion: 2.1 time: 0.362331 Oct 27 03:36:02.295634 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1668/3579] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:36:01 2022] DELETE /compute/v2.1/servers/09065cd4-8246-49ee-80fe-b4f1c11b468d => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:36:02.303912 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b5e4c256-be10-44c3-b4cd-7055a64689f7 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:02.303912 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b5e4c256-be10-44c3-b4cd-7055a64689f7 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:02.309818 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b5e4c256-be10-44c3-b4cd-7055a64689f7 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:02.310528 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b5e4c256-be10-44c3-b4cd-7055a64689f7 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:02.311691 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b5e4c256-be10-44c3-b4cd-7055a64689f7 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:02.313377 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b5e4c256-be10-44c3-b4cd-7055a64689f7 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:02.314168 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b5e4c256-be10-44c3-b4cd-7055a64689f7 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:02.314796 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b5e4c256-be10-44c3-b4cd-7055a64689f7 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:02.486262 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-cb2e5918-654c-406a-90aa-e692639c31cd tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:02.495546 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b5e4c256-be10-44c3-b4cd-7055a64689f7 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:02.501085 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-cb2e5918-654c-406a-90aa-e692639c31cd tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:02.502696 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-cb2e5918-654c-406a-90aa-e692639c31cd tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:02.504195 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-cb2e5918-654c-406a-90aa-e692639c31cd tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d" status: 200 len: 1878 microversion: 2.42 time: 0.303153 Oct 27 03:36:02.514127 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1912/3580] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:36:02 2022] GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d => generated 1878 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:36:02.514127 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4d727136-0335-4b11-a365-c4af662de947 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:02.514127 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4d727136-0335-4b11-a365-c4af662de947 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] [instance: 09065cd4-8246-49ee-80fe-b4f1c11b468d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:02.522507 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b5e4c256-be10-44c3-b4cd-7055a64689f7 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1505 microversion: 2.1 time: 0.222587 Oct 27 03:36:02.522713 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4d727136-0335-4b11-a365-c4af662de947 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:02.522713 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4d727136-0335-4b11-a365-c4af662de947 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:02.522975 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1669/3581] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:02 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1505 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:02.523083 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4d727136-0335-4b11-a365-c4af662de947 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:02.523083 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4d727136-0335-4b11-a365-c4af662de947 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:02.523083 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4d727136-0335-4b11-a365-c4af662de947 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:02.523581 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4d727136-0335-4b11-a365-c4af662de947 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:02.527059 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d701caa4-46a1-44fd-8e13-0f0cf8cd7e6b tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:02.528094 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d701caa4-46a1-44fd-8e13-0f0cf8cd7e6b tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: c5c50ae8-6217-4650-8420-291847e21ace] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:02.536817 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d701caa4-46a1-44fd-8e13-0f0cf8cd7e6b tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:02.538000 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d701caa4-46a1-44fd-8e13-0f0cf8cd7e6b tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:02.538808 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d701caa4-46a1-44fd-8e13-0f0cf8cd7e6b tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:02.540279 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d701caa4-46a1-44fd-8e13-0f0cf8cd7e6b tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:02.541189 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d701caa4-46a1-44fd-8e13-0f0cf8cd7e6b tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:02.541857 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d701caa4-46a1-44fd-8e13-0f0cf8cd7e6b tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:02.578838 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:36:02.738572 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d701caa4-46a1-44fd-8e13-0f0cf8cd7e6b tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18036411a99e4634bfbaeae24b9f254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229dcb63bc41444391544883b576ce2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:02.749758 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4d727136-0335-4b11-a365-c4af662de947 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c36bef85ac34b4983a79e03c56965c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e58f30136ed4a4d9bff48e9b4cde5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:02.752181 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=100 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:36:02.757097 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d701caa4-46a1-44fd-8e13-0f0cf8cd7e6b tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/c5c50ae8-6217-4650-8420-291847e21ace" status: 200 len: 1364 microversion: 2.1 time: 0.235131 Oct 27 03:36:02.760233 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4d727136-0335-4b11-a365-c4af662de947 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] 10.222.0.20 "GET /compute/v2.1/servers/09065cd4-8246-49ee-80fe-b4f1c11b468d" status: 200 len: 1526 microversion: 2.1 time: 0.253473 Oct 27 03:36:02.760820 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1913/3582] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:02 2022] GET /compute/v2.1/servers/09065cd4-8246-49ee-80fe-b4f1c11b468d => generated 1526 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:02.794389 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1670/3583] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:02 2022] GET /compute/v2.1/servers/c5c50ae8-6217-4650-8420-291847e21ace => generated 1364 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:02.794507 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f6b76320-0049-474c-bec1-fb37803fa8e7 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7dd9d839d0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:02.794607 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-36a8ea62-3e0a-4e6e-802e-28b2de2c8e1e tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:02.794607 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-36a8ea62-3e0a-4e6e-802e-28b2de2c8e1e tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] [instance: 2a1bda43-af44-432d-8992-94473a5f8b5d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:02.795784 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-36a8ea62-3e0a-4e6e-802e-28b2de2c8e1e tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:02.796313 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-36a8ea62-3e0a-4e6e-802e-28b2de2c8e1e tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:02.796758 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-36a8ea62-3e0a-4e6e-802e-28b2de2c8e1e tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:02.797674 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-36a8ea62-3e0a-4e6e-802e-28b2de2c8e1e tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:02.798493 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-36a8ea62-3e0a-4e6e-802e-28b2de2c8e1e tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:02.799129 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-36a8ea62-3e0a-4e6e-802e-28b2de2c8e1e tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:02.856048 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f6b76320-0049-474c-bec1-fb37803fa8e7 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images/81186aa0-7ea8-487e-9c34-69f89a3830e6" status: 200 len: 1454 microversion: 2.1 time: 0.092869 Oct 27 03:36:02.856875 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1914/3584] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:36:02 2022] GET /compute/v2.1/images/81186aa0-7ea8-487e-9c34-69f89a3830e6 => generated 1454 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:02.863664 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b7cc358f-b144-4b6b-a5d0-a3cdea0977e5 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:02.865133 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b7cc358f-b144-4b6b-a5d0-a3cdea0977e5 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 24b00f49-8397-4c66-8cdb-542cb635e3c2] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:02.878151 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-b7cc358f-b144-4b6b-a5d0-a3cdea0977e5 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] HTTP exception thrown: Instance 24b00f49-8397-4c66-8cdb-542cb635e3c2 could not be found. Oct 27 03:36:02.880453 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b7cc358f-b144-4b6b-a5d0-a3cdea0977e5 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Request method failure captured: Oct 27 03:36:02.880453 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/24b00f49-8397-4c66-8cdb-542cb635e3c2 HTTP/1.1 Oct 27 03:36:02.880453 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:36:02.880453 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:36:02.880453 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:36:02.880453 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:36:02.880453 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:36:02.880453 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:36:02.880453 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:36:02.880453 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:36:02.880453 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfxF6ut9nM9a9AcpKLO7IgCu-akAJ2YJGjrI9C8NUveA8uObV2XgQIQvsIxuWjvLl9meIEqpfGwZYr8MTX_PAGoiJsNUPXh5ERSce5cPYQYCCFPL0HtTb-E11C_2kfWy1wRps1tClRNvtj8zAqCGRhs1x-Uvl0zISdfHepXmvWX31Us Oct 27 03:36:02.880453 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:36:02.880453 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:36:02.880453 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:36:02.880453 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:36:02.880453 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:36:02.880453 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:36:02.880453 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 8bb5d291069d4329a90123e327fe9c59 Oct 27 03:36:02.880453 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:36:02.880453 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:36:02.880453 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:36:02.880453 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8bb5d291069d4329a90123e327fe9c59"}]}] Oct 27 03:36:02.880453 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:36:02.880453 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 8bb5d291069d4329a90123e327fe9c59 Oct 27 03:36:02.880453 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:36:02.880453 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServersNegativeTestJSON-4378389-project Oct 27 03:36:02.880453 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:36:02.880453 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:36:02.880453 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: f9c32b7626594ff888970c7f3227bb20 Oct 27 03:36:02.880453 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServersNegativeTestJSON-4378389-project Oct 27 03:36:02.880453 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:36:02.880453 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 24b00f49-8397-4c66-8cdb-542cb635e3c2 could not be found. Oct 27 03:36:02.880453 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '24b00f49-8397-4c66-8cdb-542cb635e3c2'} Oct 27 03:36:02.880453 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:36:02.880453 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:36:02.880453 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:36:02.880453 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:36:02.880453 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:36:02.880453 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:36:02.880453 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 03:36:02.880453 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 03:36:02.880453 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24b00f49-8397-4c66-8cdb-542cb635e3c2 could not be found. Oct 27 03:36:02.880453 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:02.880453 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:36:02.880453 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:02.880453 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:36:02.880453 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:36:02.880453 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:36:02.880453 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:36:02.880453 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:36:02.880453 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:36:02.880453 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:36:02.880453 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:36:02.880453 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:36:02.880453 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:36:02.880453 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:36:02.880453 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:36:02.880453 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:36:02.880453 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24b00f49-8397-4c66-8cdb-542cb635e3c2 could not be found. Oct 27 03:36:02.880453 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:02.880453 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:36:02.880453 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:02.880453 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:36:02.880453 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:36:02.892914 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:36:02.892914 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:36:02.892914 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:36:02.892914 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24b00f49-8397-4c66-8cdb-542cb635e3c2 could not be found. Oct 27 03:36:02.892914 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:02.892914 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b7cc358f-b144-4b6b-a5d0-a3cdea0977e5 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Returning 404 to user: Instance 24b00f49-8397-4c66-8cdb-542cb635e3c2 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:36:02.892914 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b7cc358f-b144-4b6b-a5d0-a3cdea0977e5 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/24b00f49-8397-4c66-8cdb-542cb635e3c2" status: 404 len: 111 microversion: 2.1 time: 0.025289 Oct 27 03:36:02.892914 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1915/3585] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:02 2022] GET /compute/v2.1/servers/24b00f49-8397-4c66-8cdb-542cb635e3c2 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:36:02.899020 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-fb9803d4-418d-4a4f-a05d-94734a5b5f58 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:02.933225 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-fb9803d4-418d-4a4f-a05d-94734a5b5f58 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:02.933225 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fb9803d4-418d-4a4f-a05d-94734a5b5f58 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:02.933225 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fb9803d4-418d-4a4f-a05d-94734a5b5f58 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:02.933225 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fb9803d4-418d-4a4f-a05d-94734a5b5f58 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:02.933225 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fb9803d4-418d-4a4f-a05d-94734a5b5f58 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:02.933225 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fb9803d4-418d-4a4f-a05d-94734a5b5f58 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:02.933225 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fb9803d4-418d-4a4f-a05d-94734a5b5f58 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:02.969407 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-36a8ea62-3e0a-4e6e-802e-28b2de2c8e1e tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d5d3f1bf1af4cd6884297b207597fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a1ba64cf9c47d5bdae52477338099e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:02.977235 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-36a8ea62-3e0a-4e6e-802e-28b2de2c8e1e tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] 10.222.0.20 "GET /compute/v2.1/servers/2a1bda43-af44-432d-8992-94473a5f8b5d" status: 200 len: 1351 microversion: 2.1 time: 0.200216 Oct 27 03:36:02.978812 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1671/3586] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:02 2022] GET /compute/v2.1/servers/2a1bda43-af44-432d-8992-94473a5f8b5d => generated 1351 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:02.982906 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-1c82266b-cebd-4900-83ef-4558e7c1a5ba req-ad66a9de-f5f4-4484-ac3f-7fd13d3132b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "004575c6-51ce-48d9-b7a6-d50f9afdb0a0", "name": "network-vif-unplugged", "status": "completed", "tag": "5deebc19-88cc-4f7e-98b2-66507a85ce83"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:36:02.992333 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-1c82266b-cebd-4900-83ef-4558e7c1a5ba req-ad66a9de-f5f4-4484-ac3f-7fd13d3132b4 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:02.992813 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-1c82266b-cebd-4900-83ef-4558e7c1a5ba req-ad66a9de-f5f4-4484-ac3f-7fd13d3132b4 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:02.993244 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-1c82266b-cebd-4900-83ef-4558e7c1a5ba req-ad66a9de-f5f4-4484-ac3f-7fd13d3132b4 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:03.004652 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-1c82266b-cebd-4900-83ef-4558e7c1a5ba req-ad66a9de-f5f4-4484-ac3f-7fd13d3132b4 service nova] Creating event network-vif-unplugged:5deebc19-88cc-4f7e-98b2-66507a85ce83 for instance 004575c6-51ce-48d9-b7a6-d50f9afdb0a0 on n-h1-862769-1 Oct 27 03:36:03.010057 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-1c82266b-cebd-4900-83ef-4558e7c1a5ba req-ad66a9de-f5f4-4484-ac3f-7fd13d3132b4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030875 Oct 27 03:36:03.010687 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1672/3587] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:36:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:36:03.071516 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-fb9803d4-418d-4a4f-a05d-94734a5b5f58 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:03.080365 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-fb9803d4-418d-4a4f-a05d-94734a5b5f58 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1505 microversion: 2.1 time: 0.188870 Oct 27 03:36:03.084744 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1916/3588] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:02 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1505 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:03.105695 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-be1a8a14-9119-4926-8b3b-8e7093f1141c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:03.106439 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-be1a8a14-9119-4926-8b3b-8e7093f1141c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:03.113814 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-be1a8a14-9119-4926-8b3b-8e7093f1141c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:03.114663 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-be1a8a14-9119-4926-8b3b-8e7093f1141c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:03.115216 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-be1a8a14-9119-4926-8b3b-8e7093f1141c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:03.115990 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-be1a8a14-9119-4926-8b3b-8e7093f1141c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:03.116455 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-be1a8a14-9119-4926-8b3b-8e7093f1141c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:03.116881 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-be1a8a14-9119-4926-8b3b-8e7093f1141c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:03.264869 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=4 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:36:03.298317 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=18 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:36:03.309772 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-be1a8a14-9119-4926-8b3b-8e7093f1141c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:03.321403 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-be1a8a14-9119-4926-8b3b-8e7093f1141c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1505 microversion: 2.1 time: 0.219916 Oct 27 03:36:03.322822 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1673/3589] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:03 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1505 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:03.491264 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-84739e6f-7218-4320-9e2b-cd49508d5670 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1736772463", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "0f1ea857-e60a-4a6e-a6c9-70bfd2dd2db8"}]}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:36:03.521377 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-84739e6f-7218-4320-9e2b-cd49508d5670 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Request method failure captured: Oct 27 03:36:03.521377 n-d-862769-1 devstack@n-api.service[121001]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 03:36:03.521377 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:36:03.521377 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:36:03.521377 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:36:03.521377 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 238 Oct 27 03:36:03.521377 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:36:03.521377 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:36:03.521377 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:36:03.521377 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:36:03.521377 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfxF6ut9nM9a9AcpKLO7IgCu-akAJ2YJGjrI9C8NUveA8uObV2XgQIQvsIxuWjvLl9meIEqpfGwZYr8MTX_PAGoiJsNUPXh5ERSce5cPYQYCCFPL0HtTb-E11C_2kfWy1wRps1tClRNvtj8zAqCGRhs1x-Uvl0zISdfHepXmvWX31Us Oct 27 03:36:03.521377 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:36:03.521377 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:36:03.521377 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:36:03.521377 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:36:03.521377 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:36:03.521377 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:36:03.521377 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 8bb5d291069d4329a90123e327fe9c59 Oct 27 03:36:03.521377 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:36:03.521377 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:36:03.521377 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:36:03.521377 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8bb5d291069d4329a90123e327fe9c59"}]}] Oct 27 03:36:03.521377 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:36:03.521377 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 8bb5d291069d4329a90123e327fe9c59 Oct 27 03:36:03.521377 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:36:03.521377 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServersNegativeTestJSON-4378389-project Oct 27 03:36:03.521377 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:36:03.521377 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:36:03.521377 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: f9c32b7626594ff888970c7f3227bb20 Oct 27 03:36:03.521377 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServersNegativeTestJSON-4378389-project Oct 27 03:36:03.521377 n-d-862769-1 devstack@n-api.service[121001]: Oct 27 03:36:03.521377 n-d-862769-1 devstack@n-api.service[121001]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1736772463", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "0f1ea857-e60a-4a6e-a6c9-70bfd2dd2db8"}]}} Oct 27 03:36:03.521377 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:36:03.521377 n-d-862769-1 devstack@n-api.service[121001]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 27 03:36:03.521377 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1736772463', 'imageRef': 'c40fb871-5877-4b59-ab69-d9fd23b7a917', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '0f1ea857-e60a-4a6e-a6c9-70bfd2dd2db8'}]}}} Oct 27 03:36:03.521377 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:36:03.521377 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:36:03.521377 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 27 03:36:03.521377 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 27 03:36:03.521377 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Oct 27 03:36:03.521377 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Oct 27 03:36:03.521377 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Oct 27 03:36:03.521377 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 27 03:36:03.521377 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Oct 27 03:36:03.521377 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Oct 27 03:36:03.521377 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Oct 27 03:36:03.521377 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:03.521377 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 27 03:36:03.521377 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:03.521377 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:36:03.521377 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 03:36:03.521377 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 03:36:03.521377 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 03:36:03.521377 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise error Oct 27 03:36:03.521377 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Oct 27 03:36:03.521377 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:03.521377 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Oct 27 03:36:03.521377 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Oct 27 03:36:03.521377 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:03.521377 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 27 03:36:03.521377 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Oct 27 03:36:03.521377 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:03.521377 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:36:03.521377 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:03.521377 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:36:03.532218 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:36:03.532218 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:36:03.532218 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:36:03.532218 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:36:03.532218 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:36:03.532218 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:36:03.532218 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:36:03.532218 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:36:03.532218 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 03:36:03.532218 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 03:36:03.532218 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 03:36:03.532218 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 03:36:03.532218 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 03:36:03.532218 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 03:36:03.532218 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 27 03:36:03.532218 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:03.532218 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:36:03.532218 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:03.532218 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:36:03.532218 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:36:03.532218 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:36:03.532218 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 03:36:03.532218 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 03:36:03.532218 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 27 03:36:03.532218 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:03.539571 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8f55c0f7-31e8-45f6-95a6-e0c995f943f8 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:03.539571 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8f55c0f7-31e8-45f6-95a6-e0c995f943f8 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] [instance: 8c8a2cbb-4acf-4a6b-b684-567617bb930d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:03.542545 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-84739e6f-7218-4320-9e2b-cd49508d5670 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:36:03.544132 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8f55c0f7-31e8-45f6-95a6-e0c995f943f8 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:03.544653 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8f55c0f7-31e8-45f6-95a6-e0c995f943f8 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:03.545109 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8f55c0f7-31e8-45f6-95a6-e0c995f943f8 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:03.545258 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-84739e6f-7218-4320-9e2b-cd49508d5670 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.061170 Oct 27 03:36:03.546164 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8f55c0f7-31e8-45f6-95a6-e0c995f943f8 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:03.546795 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8f55c0f7-31e8-45f6-95a6-e0c995f943f8 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:03.547050 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1917/3590] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:36:03 2022] POST /compute/v2.1/servers => generated 139 bytes in 65 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 03:36:03.547688 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8f55c0f7-31e8-45f6-95a6-e0c995f943f8 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:03.558508 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-80fb3b48-7f5a-4be4-90b0-7ea3ef795766 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:03.559344 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-80fb3b48-7f5a-4be4-90b0-7ea3ef795766 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:03.566962 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-80fb3b48-7f5a-4be4-90b0-7ea3ef795766 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:03.567464 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-80fb3b48-7f5a-4be4-90b0-7ea3ef795766 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:03.567915 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-80fb3b48-7f5a-4be4-90b0-7ea3ef795766 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:03.568628 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-80fb3b48-7f5a-4be4-90b0-7ea3ef795766 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:03.569094 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-80fb3b48-7f5a-4be4-90b0-7ea3ef795766 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:03.569539 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-80fb3b48-7f5a-4be4-90b0-7ea3ef795766 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:03.707522 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-80fb3b48-7f5a-4be4-90b0-7ea3ef795766 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:03.717600 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-80fb3b48-7f5a-4be4-90b0-7ea3ef795766 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1505 microversion: 2.1 time: 0.163328 Oct 27 03:36:03.718425 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1918/3591] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:03 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1505 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:03.743313 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7a59ea76-7b85-4186-a15d-246fb4af6cd4 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:03.744045 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7a59ea76-7b85-4186-a15d-246fb4af6cd4 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:03.747318 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8f55c0f7-31e8-45f6-95a6-e0c995f943f8 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:03.751316 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7a59ea76-7b85-4186-a15d-246fb4af6cd4 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:03.751818 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7a59ea76-7b85-4186-a15d-246fb4af6cd4 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:03.752265 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7a59ea76-7b85-4186-a15d-246fb4af6cd4 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:03.753016 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7a59ea76-7b85-4186-a15d-246fb4af6cd4 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:03.753606 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7a59ea76-7b85-4186-a15d-246fb4af6cd4 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:03.753938 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7a59ea76-7b85-4186-a15d-246fb4af6cd4 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:03.759649 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8f55c0f7-31e8-45f6-95a6-e0c995f943f8 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:03.761212 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8f55c0f7-31e8-45f6-95a6-e0c995f943f8 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:03.762452 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8f55c0f7-31e8-45f6-95a6-e0c995f943f8 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d" status: 200 len: 1878 microversion: 2.42 time: 0.229946 Oct 27 03:36:03.763193 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1674/3592] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:36:03 2022] GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d => generated 1878 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:36:03.781342 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b90e84c4-f8d3-4594-9034-a796f0abca11 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:03.781967 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b90e84c4-f8d3-4594-9034-a796f0abca11 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: c5c50ae8-6217-4650-8420-291847e21ace] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:03.787954 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b90e84c4-f8d3-4594-9034-a796f0abca11 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:03.788446 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b90e84c4-f8d3-4594-9034-a796f0abca11 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:03.789124 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b90e84c4-f8d3-4594-9034-a796f0abca11 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:03.790128 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b90e84c4-f8d3-4594-9034-a796f0abca11 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:03.790596 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b90e84c4-f8d3-4594-9034-a796f0abca11 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:03.791030 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b90e84c4-f8d3-4594-9034-a796f0abca11 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:03.914506 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7a59ea76-7b85-4186-a15d-246fb4af6cd4 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:03.922892 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7a59ea76-7b85-4186-a15d-246fb4af6cd4 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1505 microversion: 2.1 time: 0.183543 Oct 27 03:36:03.930607 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1919/3593] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:03 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1505 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:03.936446 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-103f7eee-4053-4d30-8117-c0497a66a117 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:03.937065 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-103f7eee-4053-4d30-8117-c0497a66a117 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] [instance: 09065cd4-8246-49ee-80fe-b4f1c11b468d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:03.942927 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b90e84c4-f8d3-4594-9034-a796f0abca11 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18036411a99e4634bfbaeae24b9f254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229dcb63bc41444391544883b576ce2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:03.945084 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-103f7eee-4053-4d30-8117-c0497a66a117 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:03.945579 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-103f7eee-4053-4d30-8117-c0497a66a117 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:03.946185 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-103f7eee-4053-4d30-8117-c0497a66a117 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:03.946759 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-103f7eee-4053-4d30-8117-c0497a66a117 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:03.947216 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-103f7eee-4053-4d30-8117-c0497a66a117 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:03.947663 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-103f7eee-4053-4d30-8117-c0497a66a117 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:03.954093 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b90e84c4-f8d3-4594-9034-a796f0abca11 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/c5c50ae8-6217-4650-8420-291847e21ace" status: 200 len: 1364 microversion: 2.1 time: 0.176739 Oct 27 03:36:03.954701 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1675/3594] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:03 2022] GET /compute/v2.1/servers/c5c50ae8-6217-4650-8420-291847e21ace => generated 1364 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:03.971887 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-04f69861-775b-4529-81de-f1e8eabd1fe3 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7ddaa91f70>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:04.020505 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-04f69861-775b-4529-81de-f1e8eabd1fe3 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images/81186aa0-7ea8-487e-9c34-69f89a3830e6" status: 200 len: 1454 microversion: 2.1 time: 0.060236 Oct 27 03:36:04.021105 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1676/3595] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:36:03 2022] GET /compute/v2.1/images/81186aa0-7ea8-487e-9c34-69f89a3830e6 => generated 1454 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:04.029955 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ff3452f3-57e4-41cb-8002-6b6499066450 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:04.035018 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ff3452f3-57e4-41cb-8002-6b6499066450 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] [instance: 2a1bda43-af44-432d-8992-94473a5f8b5d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:04.036814 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ff3452f3-57e4-41cb-8002-6b6499066450 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:04.037310 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ff3452f3-57e4-41cb-8002-6b6499066450 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:04.037751 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ff3452f3-57e4-41cb-8002-6b6499066450 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:04.038487 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ff3452f3-57e4-41cb-8002-6b6499066450 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:04.038946 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ff3452f3-57e4-41cb-8002-6b6499066450 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:04.039380 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ff3452f3-57e4-41cb-8002-6b6499066450 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:04.098292 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-103f7eee-4053-4d30-8117-c0497a66a117 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c36bef85ac34b4983a79e03c56965c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e58f30136ed4a4d9bff48e9b4cde5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:04.106495 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-103f7eee-4053-4d30-8117-c0497a66a117 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] 10.222.0.20 "GET /compute/v2.1/servers/09065cd4-8246-49ee-80fe-b4f1c11b468d" status: 200 len: 1526 microversion: 2.1 time: 0.181999 Oct 27 03:36:04.107096 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1920/3596] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:03 2022] GET /compute/v2.1/servers/09065cd4-8246-49ee-80fe-b4f1c11b468d => generated 1526 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:04.112533 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-fb58b79b-f739-4c57-805d-fa26aeef6d8c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-530900251", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "0f1ea857-e60a-4a6e-a6c9-70bfd2dd2db8"}]}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:36:04.116928 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-fb58b79b-f739-4c57-805d-fa26aeef6d8c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Request method failure captured: Oct 27 03:36:04.116928 n-d-862769-1 devstack@n-api.service[121001]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 03:36:04.116928 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:36:04.116928 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:36:04.116928 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:36:04.116928 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 234 Oct 27 03:36:04.116928 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:36:04.116928 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:36:04.116928 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:36:04.116928 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:36:04.116928 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfxF6ut9nM9a9AcpKLO7IgCu-akAJ2YJGjrI9C8NUveA8uObV2XgQIQvsIxuWjvLl9meIEqpfGwZYr8MTX_PAGoiJsNUPXh5ERSce5cPYQYCCFPL0HtTb-E11C_2kfWy1wRps1tClRNvtj8zAqCGRhs1x-Uvl0zISdfHepXmvWX31Us Oct 27 03:36:04.116928 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:36:04.116928 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:36:04.116928 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:36:04.116928 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:36:04.116928 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:36:04.116928 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:36:04.116928 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 8bb5d291069d4329a90123e327fe9c59 Oct 27 03:36:04.116928 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:36:04.116928 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:36:04.116928 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:36:04.116928 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8bb5d291069d4329a90123e327fe9c59"}]}] Oct 27 03:36:04.116928 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:36:04.116928 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 8bb5d291069d4329a90123e327fe9c59 Oct 27 03:36:04.116928 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:36:04.116928 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServersNegativeTestJSON-4378389-project Oct 27 03:36:04.116928 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:36:04.116928 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:36:04.116928 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: f9c32b7626594ff888970c7f3227bb20 Oct 27 03:36:04.116928 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServersNegativeTestJSON-4378389-project Oct 27 03:36:04.116928 n-d-862769-1 devstack@n-api.service[121001]: Oct 27 03:36:04.116928 n-d-862769-1 devstack@n-api.service[121001]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-530900251", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "0f1ea857-e60a-4a6e-a6c9-70bfd2dd2db8"}]}} Oct 27 03:36:04.116928 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:36:04.116928 n-d-862769-1 devstack@n-api.service[121001]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 27 03:36:04.116928 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-530900251', 'imageRef': 'c40fb871-5877-4b59-ab69-d9fd23b7a917', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '0f1ea857-e60a-4a6e-a6c9-70bfd2dd2db8'}]}}} Oct 27 03:36:04.116928 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:36:04.116928 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:36:04.116928 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 27 03:36:04.116928 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 27 03:36:04.116928 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Oct 27 03:36:04.116928 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Oct 27 03:36:04.116928 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Oct 27 03:36:04.116928 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 27 03:36:04.116928 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Oct 27 03:36:04.116928 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Oct 27 03:36:04.116928 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Oct 27 03:36:04.116928 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:04.116928 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 27 03:36:04.116928 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:04.116928 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:36:04.116928 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 03:36:04.116928 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 03:36:04.116928 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 03:36:04.116928 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise error Oct 27 03:36:04.116928 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Oct 27 03:36:04.116928 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:04.116928 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Oct 27 03:36:04.116928 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Oct 27 03:36:04.116928 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:04.116928 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 27 03:36:04.116928 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi 'notvalid' Oct 27 03:36:04.116928 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:04.116928 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:36:04.116928 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:04.116928 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:36:04.121774 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:36:04.121774 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:36:04.121774 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:36:04.121774 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:36:04.121774 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:36:04.121774 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:36:04.121774 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:36:04.121774 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:36:04.121774 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 03:36:04.121774 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 03:36:04.121774 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 03:36:04.121774 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 03:36:04.121774 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 03:36:04.121774 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 03:36:04.121774 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 27 03:36:04.121774 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:04.121774 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:36:04.121774 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:04.121774 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:36:04.121774 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:36:04.121774 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:36:04.121774 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 03:36:04.121774 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 03:36:04.121774 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 27 03:36:04.121774 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:04.124281 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-fb58b79b-f739-4c57-805d-fa26aeef6d8c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:36:04.125146 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-fb58b79b-f739-4c57-805d-fa26aeef6d8c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.016384 Oct 27 03:36:04.125697 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1921/3597] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:36:04 2022] POST /compute/v2.1/servers => generated 133 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 03:36:04.134131 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-afd1758f-d9c5-4aa5-92ea-49c673d4659d tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:04.134956 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-afd1758f-d9c5-4aa5-92ea-49c673d4659d tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:04.143045 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-afd1758f-d9c5-4aa5-92ea-49c673d4659d tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:04.143539 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-afd1758f-d9c5-4aa5-92ea-49c673d4659d tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:04.143987 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-afd1758f-d9c5-4aa5-92ea-49c673d4659d tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:04.144695 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-afd1758f-d9c5-4aa5-92ea-49c673d4659d tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:04.145330 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-afd1758f-d9c5-4aa5-92ea-49c673d4659d tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:04.145762 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-afd1758f-d9c5-4aa5-92ea-49c673d4659d tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:04.188981 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ff3452f3-57e4-41cb-8002-6b6499066450 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d5d3f1bf1af4cd6884297b207597fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a1ba64cf9c47d5bdae52477338099e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:04.198827 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=4 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:36:04.202768 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ff3452f3-57e4-41cb-8002-6b6499066450 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] 10.222.0.20 "GET /compute/v2.1/servers/2a1bda43-af44-432d-8992-94473a5f8b5d" status: 200 len: 1351 microversion: 2.1 time: 0.179434 Oct 27 03:36:04.203587 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1677/3598] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:04 2022] GET /compute/v2.1/servers/2a1bda43-af44-432d-8992-94473a5f8b5d => generated 1351 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:04.303102 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-afd1758f-d9c5-4aa5-92ea-49c673d4659d tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:04.312050 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-afd1758f-d9c5-4aa5-92ea-49c673d4659d tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1505 microversion: 2.1 time: 0.182037 Oct 27 03:36:04.312626 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1922/3599] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:04 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1505 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:36:04.336895 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9d7460a9-1a1f-4cea-b2f5-af5d55467045 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:04.337629 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9d7460a9-1a1f-4cea-b2f5-af5d55467045 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:04.345113 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9d7460a9-1a1f-4cea-b2f5-af5d55467045 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:04.349401 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9d7460a9-1a1f-4cea-b2f5-af5d55467045 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:04.349401 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9d7460a9-1a1f-4cea-b2f5-af5d55467045 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:04.349401 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9d7460a9-1a1f-4cea-b2f5-af5d55467045 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:04.349401 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9d7460a9-1a1f-4cea-b2f5-af5d55467045 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:04.349401 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9d7460a9-1a1f-4cea-b2f5-af5d55467045 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:04.506965 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9d7460a9-1a1f-4cea-b2f5-af5d55467045 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:04.516114 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9d7460a9-1a1f-4cea-b2f5-af5d55467045 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1505 microversion: 2.1 time: 0.183144 Oct 27 03:36:04.517394 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1678/3600] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:04 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1505 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:04.555124 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4d5e050f-1a4d-455f-b519-e1b20039416f tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:36:04.555669 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4d5e050f-1a4d-455f-b519-e1b20039416f tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 99e593d0-c4ef-471e-ada3-dc1f2e909df5] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:04.558334 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=100 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:36:04.562777 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-4d5e050f-1a4d-455f-b519-e1b20039416f tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] HTTP exception thrown: Instance 99e593d0-c4ef-471e-ada3-dc1f2e909df5 could not be found. Oct 27 03:36:04.568118 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4d5e050f-1a4d-455f-b519-e1b20039416f tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Request method failure captured: Oct 27 03:36:04.568118 n-d-862769-1 devstack@n-api.service[121001]: request: POST /compute/v2.1/servers/99e593d0-c4ef-471e-ada3-dc1f2e909df5/action HTTP/1.1 Oct 27 03:36:04.568118 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:36:04.568118 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:36:04.568118 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:36:04.568118 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 13 Oct 27 03:36:04.568118 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:36:04.568118 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:36:04.568118 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:36:04.568118 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:36:04.568118 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfxF6ut9nM9a9AcpKLO7IgCu-akAJ2YJGjrI9C8NUveA8uObV2XgQIQvsIxuWjvLl9meIEqpfGwZYr8MTX_PAGoiJsNUPXh5ERSce5cPYQYCCFPL0HtTb-E11C_2kfWy1wRps1tClRNvtj8zAqCGRhs1x-Uvl0zISdfHepXmvWX31Us Oct 27 03:36:04.568118 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:36:04.568118 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:36:04.568118 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:36:04.568118 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:36:04.568118 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:36:04.568118 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:36:04.568118 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 8bb5d291069d4329a90123e327fe9c59 Oct 27 03:36:04.568118 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:36:04.568118 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:36:04.568118 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:36:04.568118 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8bb5d291069d4329a90123e327fe9c59"}]}] Oct 27 03:36:04.568118 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:36:04.568118 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 8bb5d291069d4329a90123e327fe9c59 Oct 27 03:36:04.568118 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:36:04.568118 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServersNegativeTestJSON-4378389-project Oct 27 03:36:04.568118 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:36:04.568118 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:36:04.568118 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: f9c32b7626594ff888970c7f3227bb20 Oct 27 03:36:04.568118 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServersNegativeTestJSON-4378389-project Oct 27 03:36:04.568118 n-d-862769-1 devstack@n-api.service[121001]: Oct 27 03:36:04.568118 n-d-862769-1 devstack@n-api.service[121001]: {"pause": {}} Oct 27 03:36:04.568118 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:36:04.568118 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 99e593d0-c4ef-471e-ada3-dc1f2e909df5 could not be found. Oct 27 03:36:04.568118 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '99e593d0-c4ef-471e-ada3-dc1f2e909df5', 'body': {'pause': {}}} Oct 27 03:36:04.568118 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:36:04.568118 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:36:04.568118 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:36:04.568118 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:36:04.568118 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:36:04.568118 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:36:04.568118 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 03:36:04.568118 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 03:36:04.568118 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99e593d0-c4ef-471e-ada3-dc1f2e909df5 could not be found. Oct 27 03:36:04.568118 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:04.568118 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:36:04.568118 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:04.568118 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:36:04.568118 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:36:04.568118 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:36:04.568118 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:36:04.568118 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:36:04.568118 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:36:04.568118 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:36:04.568118 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Oct 27 03:36:04.568118 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 27 03:36:04.568118 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:36:04.568118 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:36:04.568118 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99e593d0-c4ef-471e-ada3-dc1f2e909df5 could not be found. Oct 27 03:36:04.568118 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:04.568118 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:36:04.568118 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:04.568118 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:36:04.568118 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:36:04.568118 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:36:04.583457 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:36:04.583457 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:36:04.583457 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99e593d0-c4ef-471e-ada3-dc1f2e909df5 could not be found. Oct 27 03:36:04.583457 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:04.583457 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4d5e050f-1a4d-455f-b519-e1b20039416f tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Returning 404 to user: Instance 99e593d0-c4ef-471e-ada3-dc1f2e909df5 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:36:04.583457 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4d5e050f-1a4d-455f-b519-e1b20039416f tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "POST /compute/v2.1/servers/99e593d0-c4ef-471e-ada3-dc1f2e909df5/action" status: 404 len: 111 microversion: 2.1 time: 0.018657 Oct 27 03:36:04.583457 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1923/3601] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:36:04 2022] POST /compute/v2.1/servers/99e593d0-c4ef-471e-ada3-dc1f2e909df5/action => generated 111 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:36:04.584010 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a5cdd352-bf72-4c45-a567-c33706455cf6 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:04.584010 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a5cdd352-bf72-4c45-a567-c33706455cf6 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:04.586409 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a5cdd352-bf72-4c45-a567-c33706455cf6 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:04.586906 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a5cdd352-bf72-4c45-a567-c33706455cf6 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:04.587349 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a5cdd352-bf72-4c45-a567-c33706455cf6 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:04.588054 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a5cdd352-bf72-4c45-a567-c33706455cf6 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:04.588515 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a5cdd352-bf72-4c45-a567-c33706455cf6 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:04.588948 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a5cdd352-bf72-4c45-a567-c33706455cf6 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:04.730973 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a5cdd352-bf72-4c45-a567-c33706455cf6 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:04.739936 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a5cdd352-bf72-4c45-a567-c33706455cf6 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1505 microversion: 2.1 time: 0.165309 Oct 27 03:36:04.740534 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1679/3602] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:04 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1505 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:04.764655 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-91524789-79fa-42f1-97fa-358e7d01da40 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:04.765347 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-91524789-79fa-42f1-97fa-358e7d01da40 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:04.772565 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-91524789-79fa-42f1-97fa-358e7d01da40 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:04.773291 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-91524789-79fa-42f1-97fa-358e7d01da40 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:04.773930 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-91524789-79fa-42f1-97fa-358e7d01da40 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:04.774874 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-91524789-79fa-42f1-97fa-358e7d01da40 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:04.775513 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-91524789-79fa-42f1-97fa-358e7d01da40 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:04.776211 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-91524789-79fa-42f1-97fa-358e7d01da40 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:04.792960 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-909de2b3-2af6-4416-a1e9-0d0fd1d6bc5b tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:04.793781 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-909de2b3-2af6-4416-a1e9-0d0fd1d6bc5b tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] [instance: 8c8a2cbb-4acf-4a6b-b684-567617bb930d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:04.804454 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-909de2b3-2af6-4416-a1e9-0d0fd1d6bc5b tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:04.809954 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-909de2b3-2af6-4416-a1e9-0d0fd1d6bc5b tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:04.809954 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-909de2b3-2af6-4416-a1e9-0d0fd1d6bc5b tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:04.809954 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-909de2b3-2af6-4416-a1e9-0d0fd1d6bc5b tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:04.809954 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-909de2b3-2af6-4416-a1e9-0d0fd1d6bc5b tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:04.811786 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-909de2b3-2af6-4416-a1e9-0d0fd1d6bc5b tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:04.957664 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-91524789-79fa-42f1-97fa-358e7d01da40 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:04.975077 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-91524789-79fa-42f1-97fa-358e7d01da40 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1505 microversion: 2.1 time: 0.215299 Oct 27 03:36:04.976154 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1924/3603] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:04 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1505 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:04.980901 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-fb98416c-79f2-40f8-b1ee-d3f7999d227b tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:04.985015 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-fb98416c-79f2-40f8-b1ee-d3f7999d227b tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: c5c50ae8-6217-4650-8420-291847e21ace] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:04.991431 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fb98416c-79f2-40f8-b1ee-d3f7999d227b tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:04.992012 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fb98416c-79f2-40f8-b1ee-d3f7999d227b tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:04.992375 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fb98416c-79f2-40f8-b1ee-d3f7999d227b tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:04.993105 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fb98416c-79f2-40f8-b1ee-d3f7999d227b tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:04.993562 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fb98416c-79f2-40f8-b1ee-d3f7999d227b tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:04.993986 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fb98416c-79f2-40f8-b1ee-d3f7999d227b tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:05.118215 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-909de2b3-2af6-4416-a1e9-0d0fd1d6bc5b tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:05.140585 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-909de2b3-2af6-4416-a1e9-0d0fd1d6bc5b tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:05.142540 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-909de2b3-2af6-4416-a1e9-0d0fd1d6bc5b tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:05.143749 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-909de2b3-2af6-4416-a1e9-0d0fd1d6bc5b tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d" status: 200 len: 1878 microversion: 2.42 time: 0.357477 Oct 27 03:36:05.144327 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1680/3604] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:36:04 2022] GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d => generated 1878 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:36:05.194901 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9573e689-c433-46a9-a992-a602f476c01e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:36:05.195916 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9573e689-c433-46a9-a992-a602f476c01e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:05.204427 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9573e689-c433-46a9-a992-a602f476c01e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:05.205155 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9573e689-c433-46a9-a992-a602f476c01e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:05.205825 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9573e689-c433-46a9-a992-a602f476c01e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:05.206758 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9573e689-c433-46a9-a992-a602f476c01e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:05.207374 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9573e689-c433-46a9-a992-a602f476c01e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:05.207961 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9573e689-c433-46a9-a992-a602f476c01e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:05.221148 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-fb98416c-79f2-40f8-b1ee-d3f7999d227b tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18036411a99e4634bfbaeae24b9f254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229dcb63bc41444391544883b576ce2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:05.233785 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-fb98416c-79f2-40f8-b1ee-d3f7999d227b tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/c5c50ae8-6217-4650-8420-291847e21ace" status: 200 len: 1364 microversion: 2.1 time: 0.253147 Oct 27 03:36:05.234947 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1925/3605] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:04 2022] GET /compute/v2.1/servers/c5c50ae8-6217-4650-8420-291847e21ace => generated 1364 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:05.243631 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-08842022-776a-4fde-9d38-e82815258fd7 req-8427cc7e-8849-4531-a057-424af9b7cba8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a1bda43-af44-432d-8992-94473a5f8b5d", "name": "network-vif-plugged", "status": "completed", "tag": "492e855b-93ee-4a3f-9bb2-1fef411f1a2c"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:36:05.263315 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-08842022-776a-4fde-9d38-e82815258fd7 req-8427cc7e-8849-4531-a057-424af9b7cba8 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:05.263828 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-08842022-776a-4fde-9d38-e82815258fd7 req-8427cc7e-8849-4531-a057-424af9b7cba8 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:05.264269 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-08842022-776a-4fde-9d38-e82815258fd7 req-8427cc7e-8849-4531-a057-424af9b7cba8 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:05.288170 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-08842022-776a-4fde-9d38-e82815258fd7 req-8427cc7e-8849-4531-a057-424af9b7cba8 service nova] Creating event network-vif-plugged:492e855b-93ee-4a3f-9bb2-1fef411f1a2c for instance 2a1bda43-af44-432d-8992-94473a5f8b5d on n-h2-862769-1 Oct 27 03:36:05.304893 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-08842022-776a-4fde-9d38-e82815258fd7 req-8427cc7e-8849-4531-a057-424af9b7cba8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068308 Oct 27 03:36:05.305513 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1926/3606] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:36:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:36:05.311620 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ca9b2f67-39a4-4e23-b5dd-ed929a2169f0 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7dd9d76f70>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:05.375756 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ca9b2f67-39a4-4e23-b5dd-ed929a2169f0 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images/81186aa0-7ea8-487e-9c34-69f89a3830e6" status: 200 len: 1454 microversion: 2.1 time: 0.068811 Oct 27 03:36:05.376796 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1927/3607] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:36:05 2022] GET /compute/v2.1/images/81186aa0-7ea8-487e-9c34-69f89a3830e6 => generated 1454 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:05.382006 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c18b0474-4292-4c18-90fb-9dff7e51cb14 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:05.382941 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c18b0474-4292-4c18-90fb-9dff7e51cb14 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] [instance: 09065cd4-8246-49ee-80fe-b4f1c11b468d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:05.389586 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c18b0474-4292-4c18-90fb-9dff7e51cb14 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:05.390362 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c18b0474-4292-4c18-90fb-9dff7e51cb14 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:05.390999 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c18b0474-4292-4c18-90fb-9dff7e51cb14 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:05.392273 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c18b0474-4292-4c18-90fb-9dff7e51cb14 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:05.392896 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c18b0474-4292-4c18-90fb-9dff7e51cb14 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:05.393490 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c18b0474-4292-4c18-90fb-9dff7e51cb14 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:05.478219 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9573e689-c433-46a9-a992-a602f476c01e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "POST /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d/action" status: 202 len: 0 microversion: 2.1 time: 0.298378 Oct 27 03:36:05.478826 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1681/3608] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:36:05 2022] POST /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d/action => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:36:05.492058 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-23feb9b1-f04d-4c45-8dfb-ca4b811bbc2b tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:05.492882 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-23feb9b1-f04d-4c45-8dfb-ca4b811bbc2b tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] [instance: 2a1bda43-af44-432d-8992-94473a5f8b5d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:05.499766 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-23feb9b1-f04d-4c45-8dfb-ca4b811bbc2b tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:05.500583 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-23feb9b1-f04d-4c45-8dfb-ca4b811bbc2b tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:05.501250 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-23feb9b1-f04d-4c45-8dfb-ca4b811bbc2b tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:05.502237 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-23feb9b1-f04d-4c45-8dfb-ca4b811bbc2b tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:05.502896 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-23feb9b1-f04d-4c45-8dfb-ca4b811bbc2b tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:05.503522 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-23feb9b1-f04d-4c45-8dfb-ca4b811bbc2b tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:05.772708 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c18b0474-4292-4c18-90fb-9dff7e51cb14 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c36bef85ac34b4983a79e03c56965c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e58f30136ed4a4d9bff48e9b4cde5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:05.796467 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c18b0474-4292-4c18-90fb-9dff7e51cb14 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] 10.222.0.20 "GET /compute/v2.1/servers/09065cd4-8246-49ee-80fe-b4f1c11b468d" status: 200 len: 1526 microversion: 2.1 time: 0.418320 Oct 27 03:36:05.797166 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1928/3609] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:05 2022] GET /compute/v2.1/servers/09065cd4-8246-49ee-80fe-b4f1c11b468d => generated 1526 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:05.810268 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e4c29f6b-090b-466a-b029-f8d1de4050f4 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:05.810268 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e4c29f6b-090b-466a-b029-f8d1de4050f4 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:05.822144 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e4c29f6b-090b-466a-b029-f8d1de4050f4 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:05.822720 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e4c29f6b-090b-466a-b029-f8d1de4050f4 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:05.823755 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e4c29f6b-090b-466a-b029-f8d1de4050f4 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:05.825282 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e4c29f6b-090b-466a-b029-f8d1de4050f4 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:05.825768 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e4c29f6b-090b-466a-b029-f8d1de4050f4 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:05.826307 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e4c29f6b-090b-466a-b029-f8d1de4050f4 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:05.906208 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-23feb9b1-f04d-4c45-8dfb-ca4b811bbc2b tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d5d3f1bf1af4cd6884297b207597fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a1ba64cf9c47d5bdae52477338099e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:05.928411 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-23feb9b1-f04d-4c45-8dfb-ca4b811bbc2b tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] 10.222.0.20 "GET /compute/v2.1/servers/2a1bda43-af44-432d-8992-94473a5f8b5d" status: 200 len: 1351 microversion: 2.1 time: 0.447217 Oct 27 03:36:05.930289 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1682/3610] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:05 2022] GET /compute/v2.1/servers/2a1bda43-af44-432d-8992-94473a5f8b5d => generated 1351 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:06.071809 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e4c29f6b-090b-466a-b029-f8d1de4050f4 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:06.094253 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e4c29f6b-090b-466a-b029-f8d1de4050f4 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1510 microversion: 2.1 time: 0.293128 Oct 27 03:36:06.099113 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1929/3611] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:05 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1510 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:06.176239 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-cf326799-b1f2-45b9-b51f-f9acea8d2be6 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:06.176873 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-cf326799-b1f2-45b9-b51f-f9acea8d2be6 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] [instance: 8c8a2cbb-4acf-4a6b-b684-567617bb930d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:06.190757 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cf326799-b1f2-45b9-b51f-f9acea8d2be6 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:06.190757 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cf326799-b1f2-45b9-b51f-f9acea8d2be6 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:06.190757 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cf326799-b1f2-45b9-b51f-f9acea8d2be6 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:06.191067 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cf326799-b1f2-45b9-b51f-f9acea8d2be6 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:06.191345 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cf326799-b1f2-45b9-b51f-f9acea8d2be6 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:06.192028 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cf326799-b1f2-45b9-b51f-f9acea8d2be6 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:06.260247 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4c6c5785-3e7e-4d39-843b-bdd4376a6d69 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:06.262456 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4c6c5785-3e7e-4d39-843b-bdd4376a6d69 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: c5c50ae8-6217-4650-8420-291847e21ace] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:06.282313 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4c6c5785-3e7e-4d39-843b-bdd4376a6d69 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:06.285959 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4c6c5785-3e7e-4d39-843b-bdd4376a6d69 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:06.286744 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4c6c5785-3e7e-4d39-843b-bdd4376a6d69 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:06.295115 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4c6c5785-3e7e-4d39-843b-bdd4376a6d69 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:06.295115 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4c6c5785-3e7e-4d39-843b-bdd4376a6d69 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:06.295115 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4c6c5785-3e7e-4d39-843b-bdd4376a6d69 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:06.443164 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-cf326799-b1f2-45b9-b51f-f9acea8d2be6 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:06.455399 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-cf326799-b1f2-45b9-b51f-f9acea8d2be6 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:06.457114 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-cf326799-b1f2-45b9-b51f-f9acea8d2be6 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:06.458604 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-cf326799-b1f2-45b9-b51f-f9acea8d2be6 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d" status: 200 len: 1878 microversion: 2.42 time: 0.286849 Oct 27 03:36:06.459181 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1683/3612] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:36:06 2022] GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d => generated 1878 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:36:06.464205 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-c6a38a35-e1fa-4f7d-92f0-bcc8ed5a4dbb req-f3e94fe8-8b28-4f0d-8ffe-1065b9d4ff7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09065cd4-8246-49ee-80fe-b4f1c11b468d", "name": "network-vif-deleted", "tag": "ab56b8a0-7a58-4598-868b-6205446a5b4c"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:36:06.474689 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-c6a38a35-e1fa-4f7d-92f0-bcc8ed5a4dbb req-f3e94fe8-8b28-4f0d-8ffe-1065b9d4ff7f service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:06.475485 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-c6a38a35-e1fa-4f7d-92f0-bcc8ed5a4dbb req-f3e94fe8-8b28-4f0d-8ffe-1065b9d4ff7f service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:06.476100 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-c6a38a35-e1fa-4f7d-92f0-bcc8ed5a4dbb req-f3e94fe8-8b28-4f0d-8ffe-1065b9d4ff7f service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:06.488409 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-c6a38a35-e1fa-4f7d-92f0-bcc8ed5a4dbb req-f3e94fe8-8b28-4f0d-8ffe-1065b9d4ff7f service nova] Creating event network-vif-deleted:ab56b8a0-7a58-4598-868b-6205446a5b4c for instance 09065cd4-8246-49ee-80fe-b4f1c11b468d on n-h1-862769-1 Oct 27 03:36:06.495800 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-c6a38a35-e1fa-4f7d-92f0-bcc8ed5a4dbb req-f3e94fe8-8b28-4f0d-8ffe-1065b9d4ff7f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035160 Oct 27 03:36:06.496449 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1684/3613] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:36:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:36:06.510668 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4e2b7912-5dda-481c-9374-e01f28c8f030 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7ddabcf040>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:06.544257 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4c6c5785-3e7e-4d39-843b-bdd4376a6d69 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18036411a99e4634bfbaeae24b9f254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229dcb63bc41444391544883b576ce2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:06.567122 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4c6c5785-3e7e-4d39-843b-bdd4376a6d69 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/c5c50ae8-6217-4650-8420-291847e21ace" status: 200 len: 1364 microversion: 2.1 time: 0.298824 Oct 27 03:36:06.567122 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1930/3614] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:06 2022] GET /compute/v2.1/servers/c5c50ae8-6217-4650-8420-291847e21ace => generated 1364 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:06.595861 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4e2b7912-5dda-481c-9374-e01f28c8f030 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images/81186aa0-7ea8-487e-9c34-69f89a3830e6" status: 200 len: 1454 microversion: 2.1 time: 0.098035 Oct 27 03:36:06.605941 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1685/3615] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:36:06 2022] GET /compute/v2.1/images/81186aa0-7ea8-487e-9c34-69f89a3830e6 => generated 1454 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:06.824912 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ae657b5b-8bc4-4b68-8f88-ac10383889a7 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:06.825492 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ae657b5b-8bc4-4b68-8f88-ac10383889a7 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] [instance: 09065cd4-8246-49ee-80fe-b4f1c11b468d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:06.832883 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ae657b5b-8bc4-4b68-8f88-ac10383889a7 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:06.847758 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ae657b5b-8bc4-4b68-8f88-ac10383889a7 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:06.847758 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ae657b5b-8bc4-4b68-8f88-ac10383889a7 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:06.847758 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ae657b5b-8bc4-4b68-8f88-ac10383889a7 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:06.847758 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ae657b5b-8bc4-4b68-8f88-ac10383889a7 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:06.847758 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ae657b5b-8bc4-4b68-8f88-ac10383889a7 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:06.876412 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ae657b5b-8bc4-4b68-8f88-ac10383889a7 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:06.876919 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ae657b5b-8bc4-4b68-8f88-ac10383889a7 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:06.877563 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ae657b5b-8bc4-4b68-8f88-ac10383889a7 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:06.878185 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-ae657b5b-8bc4-4b68-8f88-ac10383889a7 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lazy-loading 'fault' on Instance uuid 09065cd4-8246-49ee-80fe-b4f1c11b468d {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:36:06.953265 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b3bbfff2-37c5-4cbd-ab5a-112ba73e2a90 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:06.954405 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b3bbfff2-37c5-4cbd-ab5a-112ba73e2a90 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] [instance: 2a1bda43-af44-432d-8992-94473a5f8b5d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:06.969921 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b3bbfff2-37c5-4cbd-ab5a-112ba73e2a90 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:06.972869 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b3bbfff2-37c5-4cbd-ab5a-112ba73e2a90 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:06.973600 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b3bbfff2-37c5-4cbd-ab5a-112ba73e2a90 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:06.976595 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b3bbfff2-37c5-4cbd-ab5a-112ba73e2a90 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:06.977758 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b3bbfff2-37c5-4cbd-ab5a-112ba73e2a90 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:06.978249 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b3bbfff2-37c5-4cbd-ab5a-112ba73e2a90 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:07.144062 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b3bbfff2-37c5-4cbd-ab5a-112ba73e2a90 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d5d3f1bf1af4cd6884297b207597fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a1ba64cf9c47d5bdae52477338099e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:07.152930 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b3bbfff2-37c5-4cbd-ab5a-112ba73e2a90 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] 10.222.0.20 "GET /compute/v2.1/servers/2a1bda43-af44-432d-8992-94473a5f8b5d" status: 200 len: 1351 microversion: 2.1 time: 0.204788 Oct 27 03:36:07.155526 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1686/3616] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:06 2022] GET /compute/v2.1/servers/2a1bda43-af44-432d-8992-94473a5f8b5d => generated 1351 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:36:07.160776 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-782774e9-2d8f-4ccf-a61c-86a5bec3212d tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:07.161575 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-782774e9-2d8f-4ccf-a61c-86a5bec3212d tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:07.170658 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-782774e9-2d8f-4ccf-a61c-86a5bec3212d tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:07.171418 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-782774e9-2d8f-4ccf-a61c-86a5bec3212d tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:07.172054 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-782774e9-2d8f-4ccf-a61c-86a5bec3212d tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:07.173594 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-782774e9-2d8f-4ccf-a61c-86a5bec3212d tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:07.173756 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ae657b5b-8bc4-4b68-8f88-ac10383889a7 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c36bef85ac34b4983a79e03c56965c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e58f30136ed4a4d9bff48e9b4cde5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:07.174449 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-782774e9-2d8f-4ccf-a61c-86a5bec3212d tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:07.180397 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-782774e9-2d8f-4ccf-a61c-86a5bec3212d tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:07.186255 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ae657b5b-8bc4-4b68-8f88-ac10383889a7 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] 10.222.0.20 "GET /compute/v2.1/servers/09065cd4-8246-49ee-80fe-b4f1c11b468d" status: 200 len: 1313 microversion: 2.1 time: 0.365134 Oct 27 03:36:07.187180 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1931/3617] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:06 2022] GET /compute/v2.1/servers/09065cd4-8246-49ee-80fe-b4f1c11b468d => generated 1313 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:07.339469 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-782774e9-2d8f-4ccf-a61c-86a5bec3212d tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:07.386211 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-782774e9-2d8f-4ccf-a61c-86a5bec3212d tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1490 microversion: 2.1 time: 0.229082 Oct 27 03:36:07.386889 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1687/3618] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:07 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1490 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:07.413208 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-cdb554e4-7efb-436a-9843-ca87e956191b tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:36:07.413761 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-cdb554e4-7efb-436a-9843-ca87e956191b tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:07.420536 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cdb554e4-7efb-436a-9843-ca87e956191b tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:07.421197 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cdb554e4-7efb-436a-9843-ca87e956191b tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:07.421454 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cdb554e4-7efb-436a-9843-ca87e956191b tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:07.422177 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cdb554e4-7efb-436a-9843-ca87e956191b tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:07.422634 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cdb554e4-7efb-436a-9843-ca87e956191b tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:07.423064 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cdb554e4-7efb-436a-9843-ca87e956191b tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:07.459058 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-cdb554e4-7efb-436a-9843-ca87e956191b tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] HTTP exception thrown: Cannot 'pause' instance 376ac459-e31f-4727-9e34-535f055ac20d while it is in vm_state paused Oct 27 03:36:07.460733 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-cdb554e4-7efb-436a-9843-ca87e956191b tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Request method failure captured: Oct 27 03:36:07.460733 n-d-862769-1 devstack@n-api.service[121001]: request: POST /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d/action HTTP/1.1 Oct 27 03:36:07.460733 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:36:07.460733 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:36:07.460733 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:36:07.460733 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 13 Oct 27 03:36:07.460733 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:36:07.460733 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:36:07.460733 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:36:07.460733 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:36:07.460733 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfxF6ut9nM9a9AcpKLO7IgCu-akAJ2YJGjrI9C8NUveA8uObV2XgQIQvsIxuWjvLl9meIEqpfGwZYr8MTX_PAGoiJsNUPXh5ERSce5cPYQYCCFPL0HtTb-E11C_2kfWy1wRps1tClRNvtj8zAqCGRhs1x-Uvl0zISdfHepXmvWX31Us Oct 27 03:36:07.460733 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:36:07.460733 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:36:07.460733 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:36:07.460733 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:36:07.460733 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:36:07.460733 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:36:07.460733 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 8bb5d291069d4329a90123e327fe9c59 Oct 27 03:36:07.460733 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:36:07.460733 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:36:07.460733 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:36:07.460733 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8bb5d291069d4329a90123e327fe9c59"}]}] Oct 27 03:36:07.460733 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:36:07.460733 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 8bb5d291069d4329a90123e327fe9c59 Oct 27 03:36:07.460733 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:36:07.460733 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServersNegativeTestJSON-4378389-project Oct 27 03:36:07.460733 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:36:07.460733 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:36:07.460733 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: f9c32b7626594ff888970c7f3227bb20 Oct 27 03:36:07.460733 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServersNegativeTestJSON-4378389-project Oct 27 03:36:07.460733 n-d-862769-1 devstack@n-api.service[121001]: Oct 27 03:36:07.460733 n-d-862769-1 devstack@n-api.service[121001]: {"pause": {}} Oct 27 03:36:07.460733 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:36:07.460733 n-d-862769-1 devstack@n-api.service[121001]: exception: Cannot 'pause' instance 376ac459-e31f-4727-9e34-535f055ac20d while it is in vm_state paused Oct 27 03:36:07.460733 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '376ac459-e31f-4727-9e34-535f055ac20d', 'body': {'pause': {}}} Oct 27 03:36:07.460733 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:36:07.460733 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:36:07.460733 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Oct 27 03:36:07.460733 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Oct 27 03:36:07.460733 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 03:36:07.460733 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 03:36:07.460733 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 27 03:36:07.460733 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 27 03:36:07.460733 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 376ac459-e31f-4727-9e34-535f055ac20d in vm_state paused. Cannot pause while the instance is in this state. Oct 27 03:36:07.460733 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:07.460733 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:36:07.460733 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:07.460733 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:36:07.460733 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:36:07.460733 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:36:07.460733 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:36:07.460733 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:36:07.460733 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:36:07.460733 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:36:07.460733 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Oct 27 03:36:07.460733 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 27 03:36:07.460733 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 27 03:36:07.460733 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 27 03:36:07.460733 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 376ac459-e31f-4727-9e34-535f055ac20d while it is in vm_state paused Oct 27 03:36:07.460733 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:07.460733 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:36:07.460733 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:07.460733 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:36:07.460733 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:36:07.466099 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:36:07.466099 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:36:07.466099 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:36:07.466099 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 376ac459-e31f-4727-9e34-535f055ac20d while it is in vm_state paused Oct 27 03:36:07.466099 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:07.466099 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-cdb554e4-7efb-436a-9843-ca87e956191b tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Returning 409 to user: Cannot 'pause' instance 376ac459-e31f-4727-9e34-535f055ac20d while it is in vm_state paused {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:36:07.466099 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-cdb554e4-7efb-436a-9843-ca87e956191b tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "POST /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d/action" status: 409 len: 143 microversion: 2.1 time: 0.053107 Oct 27 03:36:07.466099 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1932/3619] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:36:07 2022] POST /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d/action => generated 143 bytes in 54 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 27 03:36:07.472062 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c34491fb-7ef3-4b66-bfcf-469977edd1d0 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:36:07.473140 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c34491fb-7ef3-4b66-bfcf-469977edd1d0 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:07.479911 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c34491fb-7ef3-4b66-bfcf-469977edd1d0 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:07.480442 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c34491fb-7ef3-4b66-bfcf-469977edd1d0 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:07.480882 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c34491fb-7ef3-4b66-bfcf-469977edd1d0 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:07.481606 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c34491fb-7ef3-4b66-bfcf-469977edd1d0 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:07.482087 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c34491fb-7ef3-4b66-bfcf-469977edd1d0 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:07.482551 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c34491fb-7ef3-4b66-bfcf-469977edd1d0 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:07.486300 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a981173e-3f1c-42a9-8bf7-ef69c6b6dbd1 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:07.487660 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a981173e-3f1c-42a9-8bf7-ef69c6b6dbd1 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] [instance: 8c8a2cbb-4acf-4a6b-b684-567617bb930d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:07.497288 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a981173e-3f1c-42a9-8bf7-ef69c6b6dbd1 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:07.497872 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a981173e-3f1c-42a9-8bf7-ef69c6b6dbd1 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:07.498834 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a981173e-3f1c-42a9-8bf7-ef69c6b6dbd1 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:07.500163 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a981173e-3f1c-42a9-8bf7-ef69c6b6dbd1 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:07.500746 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a981173e-3f1c-42a9-8bf7-ef69c6b6dbd1 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:07.501259 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a981173e-3f1c-42a9-8bf7-ef69c6b6dbd1 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:07.538009 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:36:07.734175 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c34491fb-7ef3-4b66-bfcf-469977edd1d0 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "POST /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d/action" status: 202 len: 0 microversion: 2.1 time: 0.265346 Oct 27 03:36:07.735804 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1688/3620] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:36:07 2022] POST /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d/action => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 03:36:07.748909 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-43979ad9-5efb-4341-a30c-b075f4f1abb3 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:07.752633 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-43979ad9-5efb-4341-a30c-b075f4f1abb3 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: c5c50ae8-6217-4650-8420-291847e21ace] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:07.784508 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-43979ad9-5efb-4341-a30c-b075f4f1abb3 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:07.788264 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-43979ad9-5efb-4341-a30c-b075f4f1abb3 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:07.790213 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-43979ad9-5efb-4341-a30c-b075f4f1abb3 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:07.801992 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-43979ad9-5efb-4341-a30c-b075f4f1abb3 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:07.802774 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-43979ad9-5efb-4341-a30c-b075f4f1abb3 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:07.804046 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-43979ad9-5efb-4341-a30c-b075f4f1abb3 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:07.807430 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a981173e-3f1c-42a9-8bf7-ef69c6b6dbd1 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:07.823948 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a981173e-3f1c-42a9-8bf7-ef69c6b6dbd1 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:07.828967 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a981173e-3f1c-42a9-8bf7-ef69c6b6dbd1 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:07.832463 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a981173e-3f1c-42a9-8bf7-ef69c6b6dbd1 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d" status: 200 len: 1878 microversion: 2.42 time: 0.349147 Oct 27 03:36:07.834666 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1933/3621] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:36:07 2022] GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d => generated 1878 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:36:07.850228 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-05a2b79c-6ce0-4212-87e4-e642a5c0cc8d tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7dd9d511f0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:07.914492 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-05a2b79c-6ce0-4212-87e4-e642a5c0cc8d tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images/81186aa0-7ea8-487e-9c34-69f89a3830e6" status: 200 len: 1454 microversion: 2.1 time: 0.078026 Oct 27 03:36:07.923651 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1934/3622] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:36:07 2022] GET /compute/v2.1/images/81186aa0-7ea8-487e-9c34-69f89a3830e6 => generated 1454 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:07.929035 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b8405360-c095-46a1-b49f-bce66674a691 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:07.929819 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b8405360-c095-46a1-b49f-bce66674a691 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:07.959871 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b8405360-c095-46a1-b49f-bce66674a691 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:07.960582 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b8405360-c095-46a1-b49f-bce66674a691 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:07.961033 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b8405360-c095-46a1-b49f-bce66674a691 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:07.961870 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b8405360-c095-46a1-b49f-bce66674a691 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:07.963476 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b8405360-c095-46a1-b49f-bce66674a691 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:07.964051 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b8405360-c095-46a1-b49f-bce66674a691 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:08.043846 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-43979ad9-5efb-4341-a30c-b075f4f1abb3 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18036411a99e4634bfbaeae24b9f254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229dcb63bc41444391544883b576ce2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:08.056980 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-43979ad9-5efb-4341-a30c-b075f4f1abb3 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/c5c50ae8-6217-4650-8420-291847e21ace" status: 200 len: 1364 microversion: 2.1 time: 0.319439 Oct 27 03:36:08.058109 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1689/3623] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:07 2022] GET /compute/v2.1/servers/c5c50ae8-6217-4650-8420-291847e21ace => generated 1364 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:08.073356 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-4b3c66df-b262-4a5d-bd51-e38cc3d43c73 req-859a44aa-b350-4b3e-998d-5d1d6ca48066 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f50da5a9-2bb6-4735-93c3-d73ece0964f3", "name": "network-vif-plugged", "status": "completed", "tag": "271e155b-8765-4519-870e-105aa22f7ae9"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:36:08.094505 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-4b3c66df-b262-4a5d-bd51-e38cc3d43c73 req-859a44aa-b350-4b3e-998d-5d1d6ca48066 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:08.095090 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-4b3c66df-b262-4a5d-bd51-e38cc3d43c73 req-859a44aa-b350-4b3e-998d-5d1d6ca48066 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:08.095575 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-4b3c66df-b262-4a5d-bd51-e38cc3d43c73 req-859a44aa-b350-4b3e-998d-5d1d6ca48066 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:08.109700 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-4b3c66df-b262-4a5d-bd51-e38cc3d43c73 req-859a44aa-b350-4b3e-998d-5d1d6ca48066 service nova] Creating event network-vif-plugged:271e155b-8765-4519-870e-105aa22f7ae9 for instance f50da5a9-2bb6-4735-93c3-d73ece0964f3 on n-h1-862769-1 Oct 27 03:36:08.119246 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-4b3c66df-b262-4a5d-bd51-e38cc3d43c73 req-859a44aa-b350-4b3e-998d-5d1d6ca48066 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059746 Oct 27 03:36:08.120154 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1690/3624] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:36:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:36:08.178955 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-734aa903-44d6-4849-ab26-c09efcdd61f3 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:08.180074 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-734aa903-44d6-4849-ab26-c09efcdd61f3 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] [instance: 2a1bda43-af44-432d-8992-94473a5f8b5d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:08.192399 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-734aa903-44d6-4849-ab26-c09efcdd61f3 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:08.193521 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-734aa903-44d6-4849-ab26-c09efcdd61f3 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:08.194290 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-734aa903-44d6-4849-ab26-c09efcdd61f3 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:08.195290 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-734aa903-44d6-4849-ab26-c09efcdd61f3 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:08.195975 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-734aa903-44d6-4849-ab26-c09efcdd61f3 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:08.197318 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-734aa903-44d6-4849-ab26-c09efcdd61f3 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:08.330709 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b8405360-c095-46a1-b49f-bce66674a691 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:08.342473 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b8405360-c095-46a1-b49f-bce66674a691 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1497 microversion: 2.1 time: 0.417477 Oct 27 03:36:08.348080 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1935/3625] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:07 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1497 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:08.368335 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2b47deb4-9bd8-406f-ae17-5e624ead18da tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:08.369024 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2b47deb4-9bd8-406f-ae17-5e624ead18da tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] [instance: 09065cd4-8246-49ee-80fe-b4f1c11b468d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:08.377998 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2b47deb4-9bd8-406f-ae17-5e624ead18da tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:08.381476 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2b47deb4-9bd8-406f-ae17-5e624ead18da tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:08.382207 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2b47deb4-9bd8-406f-ae17-5e624ead18da tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:08.384993 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2b47deb4-9bd8-406f-ae17-5e624ead18da tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:08.387515 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2b47deb4-9bd8-406f-ae17-5e624ead18da tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:08.387966 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2b47deb4-9bd8-406f-ae17-5e624ead18da tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:08.395156 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-734aa903-44d6-4849-ab26-c09efcdd61f3 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d5d3f1bf1af4cd6884297b207597fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a1ba64cf9c47d5bdae52477338099e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:08.410133 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-734aa903-44d6-4849-ab26-c09efcdd61f3 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] 10.222.0.20 "GET /compute/v2.1/servers/2a1bda43-af44-432d-8992-94473a5f8b5d" status: 200 len: 1541 microversion: 2.1 time: 0.235330 Oct 27 03:36:08.411199 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1691/3626] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:08 2022] GET /compute/v2.1/servers/2a1bda43-af44-432d-8992-94473a5f8b5d => generated 1541 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:08.414675 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-2b47deb4-9bd8-406f-ae17-5e624ead18da tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] HTTP exception thrown: Instance 09065cd4-8246-49ee-80fe-b4f1c11b468d could not be found. Oct 27 03:36:08.416461 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2b47deb4-9bd8-406f-ae17-5e624ead18da tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Request method failure captured: Oct 27 03:36:08.416461 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/09065cd4-8246-49ee-80fe-b4f1c11b468d HTTP/1.1 Oct 27 03:36:08.416461 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:36:08.416461 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:36:08.416461 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:36:08.416461 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:36:08.416461 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:36:08.416461 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:36:08.416461 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:36:08.416461 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:36:08.416461 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfx5Hbc6ITbdSRFtS1-RYRPTs8xU2lFAIvTX0CRBjp8hijBP6KjJjfK-rUuEjncsIe7o_mkFNeieFkwqoNyxVxCVqSYWPgHA26VD6r86MpHHV_eFwebptw3rA_gpbw5SDVw15ZqeHqKSf2NQXZk1XM_suSoUNVero4I26u6VER7fLwA Oct 27 03:36:08.416461 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:36:08.416461 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:36:08.416461 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:36:08.416461 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:36:08.416461 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:36:08.416461 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:36:08.416461 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 2e58f30136ed4a4d9bff48e9b4cde5a8 Oct 27 03:36:08.416461 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-597177073 Oct 27 03:36:08.416461 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:36:08.416461 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:36:08.416461 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2e58f30136ed4a4d9bff48e9b4cde5a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2e58f30136ed4a4d9bff48e9b4cde5a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2e58f30136ed4a4d9bff48e9b4cde5a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2e58f30136ed4a4d9bff48e9b4cde5a8"}]}] Oct 27 03:36:08.416461 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-597177073 Oct 27 03:36:08.416461 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 2e58f30136ed4a4d9bff48e9b4cde5a8 Oct 27 03:36:08.416461 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-597177073 Oct 27 03:36:08.416461 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ImagesOneServerNegativeTestJSON-597177073-project Oct 27 03:36:08.416461 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:36:08.416461 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:36:08.416461 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 5c36bef85ac34b4983a79e03c56965c5 Oct 27 03:36:08.416461 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-597177073-project Oct 27 03:36:08.416461 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:36:08.416461 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 09065cd4-8246-49ee-80fe-b4f1c11b468d could not be found. Oct 27 03:36:08.416461 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '09065cd4-8246-49ee-80fe-b4f1c11b468d'} Oct 27 03:36:08.416461 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:36:08.416461 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:36:08.416461 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:36:08.416461 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:36:08.416461 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:36:08.416461 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:36:08.416461 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:36:08.416461 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:36:08.416461 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:36:08.416461 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:36:08.416461 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09065cd4-8246-49ee-80fe-b4f1c11b468d could not be found. Oct 27 03:36:08.416461 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:08.416461 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:36:08.416461 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:08.416461 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:36:08.416461 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:36:08.416461 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:36:08.416461 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:36:08.416461 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:36:08.416461 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:36:08.416461 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:36:08.416461 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:36:08.416461 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:36:08.416461 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:36:08.416461 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:36:08.416461 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:36:08.416461 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:36:08.416461 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09065cd4-8246-49ee-80fe-b4f1c11b468d could not be found. Oct 27 03:36:08.416461 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:08.416461 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:36:08.421179 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:08.421179 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:36:08.421179 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:36:08.421179 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:36:08.421179 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:36:08.421179 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:36:08.421179 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09065cd4-8246-49ee-80fe-b4f1c11b468d could not be found. Oct 27 03:36:08.421179 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:08.425450 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2b47deb4-9bd8-406f-ae17-5e624ead18da tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Returning 404 to user: Instance 09065cd4-8246-49ee-80fe-b4f1c11b468d could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:36:08.426567 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2b47deb4-9bd8-406f-ae17-5e624ead18da tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] 10.222.0.20 "GET /compute/v2.1/servers/09065cd4-8246-49ee-80fe-b4f1c11b468d" status: 404 len: 111 microversion: 2.1 time: 0.077275 Oct 27 03:36:08.427330 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1936/3627] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:08 2022] GET /compute/v2.1/servers/09065cd4-8246-49ee-80fe-b4f1c11b468d => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:36:08.451616 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9433ab4f-638a-4c02-be6c-0d6e2a4fa10b tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Action: 'create', calling method: .version_select at 0x7f7dd9d55430>, body: {"keypair": {"name": "tempest-keypair-757146510", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDWnGB+bhhlMzPdZ3/f8qgYfloYTGXpX+yv8BzAMqwgSqXEsdD/YdWqIW+CapogccLYEpdW+rwgRj51z8XDMPCG2qyr69kIKWTz7MNtveGvaYm5mleKOpflvDDARV9vRyw=="}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:36:08.453037 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-288fbe62-93bf-480c-9fa9-595f659b2a6e tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:08.468117 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-288fbe62-93bf-480c-9fa9-595f659b2a6e tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] [instance: 2a1bda43-af44-432d-8992-94473a5f8b5d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:08.481347 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-288fbe62-93bf-480c-9fa9-595f659b2a6e tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:08.482150 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-288fbe62-93bf-480c-9fa9-595f659b2a6e tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:08.483321 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-288fbe62-93bf-480c-9fa9-595f659b2a6e tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:08.484817 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-288fbe62-93bf-480c-9fa9-595f659b2a6e tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:08.485212 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-9433ab4f-638a-4c02-be6c-0d6e2a4fa10b tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Getting quotas for project 2e58f30136ed4a4d9bff48e9b4cde5a8. Resources: {'key_pairs'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:36:08.485674 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-288fbe62-93bf-480c-9fa9-595f659b2a6e tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:08.487614 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-288fbe62-93bf-480c-9fa9-595f659b2a6e tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:08.500638 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-9433ab4f-638a-4c02-be6c-0d6e2a4fa10b tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Getting quotas for user 5c36bef85ac34b4983a79e03c56965c5 and project 2e58f30136ed4a4d9bff48e9b4cde5a8. Resources: {'key_pairs'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:36:08.599211 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-288fbe62-93bf-480c-9fa9-595f659b2a6e tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] 10.222.0.20 "GET /compute/v2.1/servers/2a1bda43-af44-432d-8992-94473a5f8b5d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.160980 Oct 27 03:36:08.599811 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1692/3628] 10.222.0.20 () {58 vars in 1275 bytes} [Thu Oct 27 03:36:08 2022] GET /compute/v2.1/servers/2a1bda43-af44-432d-8992-94473a5f8b5d/os-interface => generated 284 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:36:08.639286 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9433ab4f-638a-4c02-be6c-0d6e2a4fa10b tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.198221 Oct 27 03:36:08.640191 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1937/3629] 10.222.0.20 () {60 vars in 1159 bytes} [Thu Oct 27 03:36:08 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:36:08.863403 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-408ef75e-1207-45c2-8a43-394de5b734f2 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:08.863949 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-408ef75e-1207-45c2-8a43-394de5b734f2 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] [instance: 8c8a2cbb-4acf-4a6b-b684-567617bb930d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:08.881624 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-408ef75e-1207-45c2-8a43-394de5b734f2 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:08.883436 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-408ef75e-1207-45c2-8a43-394de5b734f2 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:08.883900 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-408ef75e-1207-45c2-8a43-394de5b734f2 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:08.884634 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-408ef75e-1207-45c2-8a43-394de5b734f2 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:08.885099 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-408ef75e-1207-45c2-8a43-394de5b734f2 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:08.890018 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-408ef75e-1207-45c2-8a43-394de5b734f2 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:08.933912 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c2c492ef-8f4d-4831-8626-ea8dcf31e397 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7dd9d51b80>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:09.022824 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c2c492ef-8f4d-4831-8626-ea8dcf31e397 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images/81186aa0-7ea8-487e-9c34-69f89a3830e6" status: 200 len: 1454 microversion: 2.1 time: 0.095089 Oct 27 03:36:09.023632 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1938/3630] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:36:08 2022] GET /compute/v2.1/images/81186aa0-7ea8-487e-9c34-69f89a3830e6 => generated 1454 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:36:09.081162 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4204eb05-1cee-40d9-85c1-781684b314cd tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:09.081798 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4204eb05-1cee-40d9-85c1-781684b314cd tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: c5c50ae8-6217-4650-8420-291847e21ace] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:09.097679 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4204eb05-1cee-40d9-85c1-781684b314cd tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:09.100091 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4204eb05-1cee-40d9-85c1-781684b314cd tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:09.100838 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4204eb05-1cee-40d9-85c1-781684b314cd tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:09.103265 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4204eb05-1cee-40d9-85c1-781684b314cd tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:09.105198 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4204eb05-1cee-40d9-85c1-781684b314cd tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:09.106208 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4204eb05-1cee-40d9-85c1-781684b314cd tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:09.356993 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4204eb05-1cee-40d9-85c1-781684b314cd tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18036411a99e4634bfbaeae24b9f254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229dcb63bc41444391544883b576ce2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:09.382773 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4204eb05-1cee-40d9-85c1-781684b314cd tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/c5c50ae8-6217-4650-8420-291847e21ace" status: 200 len: 1364 microversion: 2.1 time: 0.291281 Oct 27 03:36:09.385861 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1939/3631] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:09 2022] GET /compute/v2.1/servers/c5c50ae8-6217-4650-8420-291847e21ace => generated 1364 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:36:09.401570 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-536f01c9-0048-497f-9536-91225a27d3ad tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:09.403246 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-536f01c9-0048-497f-9536-91225a27d3ad tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:09.412311 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-536f01c9-0048-497f-9536-91225a27d3ad tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:09.413232 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-536f01c9-0048-497f-9536-91225a27d3ad tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:09.413883 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-536f01c9-0048-497f-9536-91225a27d3ad tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:09.415159 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-536f01c9-0048-497f-9536-91225a27d3ad tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:09.416277 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-536f01c9-0048-497f-9536-91225a27d3ad tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:09.417255 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-536f01c9-0048-497f-9536-91225a27d3ad tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:09.688416 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-536f01c9-0048-497f-9536-91225a27d3ad tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:09.690689 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=100 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:36:09.698393 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-536f01c9-0048-497f-9536-91225a27d3ad tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1505 microversion: 2.1 time: 0.304013 Oct 27 03:36:09.702102 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1940/3632] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:09 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1505 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:09.749875 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e5b10c1c-fdba-463e-b6db-af6471821f19 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:09.750567 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e5b10c1c-fdba-463e-b6db-af6471821f19 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:09.752573 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-408ef75e-1207-45c2-8a43-394de5b734f2 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:09.769557 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-408ef75e-1207-45c2-8a43-394de5b734f2 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:09.774563 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-408ef75e-1207-45c2-8a43-394de5b734f2 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:09.774563 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-408ef75e-1207-45c2-8a43-394de5b734f2 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d" status: 200 len: 1878 microversion: 2.42 time: 0.914641 Oct 27 03:36:09.778092 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1693/3633] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:36:08 2022] GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d => generated 1878 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:36:09.780350 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e5b10c1c-fdba-463e-b6db-af6471821f19 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:09.781064 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e5b10c1c-fdba-463e-b6db-af6471821f19 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:09.781686 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e5b10c1c-fdba-463e-b6db-af6471821f19 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:09.782612 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e5b10c1c-fdba-463e-b6db-af6471821f19 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:09.783327 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e5b10c1c-fdba-463e-b6db-af6471821f19 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:09.784584 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e5b10c1c-fdba-463e-b6db-af6471821f19 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:10.039595 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-619b5960-e234-48cf-a362-18e212d60980 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7ddabcf430>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:10.058550 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e5b10c1c-fdba-463e-b6db-af6471821f19 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:10.071505 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e5b10c1c-fdba-463e-b6db-af6471821f19 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1505 microversion: 2.1 time: 0.341882 Oct 27 03:36:10.072606 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1941/3634] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:09 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1505 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:36:10.099933 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0b65c65d-df0e-4c73-890e-c5cf503aaa66 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:36:10.102636 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0b65c65d-df0e-4c73-890e-c5cf503aaa66 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 35a0ac1a-379f-456e-a3d7-81f888daebbf] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:10.125441 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0b65c65d-df0e-4c73-890e-c5cf503aaa66 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:10.126160 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0b65c65d-df0e-4c73-890e-c5cf503aaa66 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:10.126560 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0b65c65d-df0e-4c73-890e-c5cf503aaa66 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:10.128476 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0b65c65d-df0e-4c73-890e-c5cf503aaa66 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:10.128967 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0b65c65d-df0e-4c73-890e-c5cf503aaa66 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:10.129414 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0b65c65d-df0e-4c73-890e-c5cf503aaa66 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:10.145764 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-619b5960-e234-48cf-a362-18e212d60980 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images/81186aa0-7ea8-487e-9c34-69f89a3830e6" status: 200 len: 1454 microversion: 2.1 time: 0.110571 Oct 27 03:36:10.148479 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1694/3635] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:36:10 2022] GET /compute/v2.1/images/81186aa0-7ea8-487e-9c34-69f89a3830e6 => generated 1454 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:10.158991 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-0b65c65d-df0e-4c73-890e-c5cf503aaa66 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] HTTP exception thrown: Instance 35a0ac1a-379f-456e-a3d7-81f888daebbf could not be found. Oct 27 03:36:10.161106 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0b65c65d-df0e-4c73-890e-c5cf503aaa66 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Request method failure captured: Oct 27 03:36:10.161106 n-d-862769-1 devstack@n-api.service[121001]: request: POST /compute/v2.1/servers/35a0ac1a-379f-456e-a3d7-81f888daebbf/action HTTP/1.1 Oct 27 03:36:10.161106 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:36:10.161106 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:36:10.161106 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:36:10.161106 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 28 Oct 27 03:36:10.161106 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:36:10.161106 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:36:10.161106 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:36:10.161106 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:36:10.161106 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfxF6ut9nM9a9AcpKLO7IgCu-akAJ2YJGjrI9C8NUveA8uObV2XgQIQvsIxuWjvLl9meIEqpfGwZYr8MTX_PAGoiJsNUPXh5ERSce5cPYQYCCFPL0HtTb-E11C_2kfWy1wRps1tClRNvtj8zAqCGRhs1x-Uvl0zISdfHepXmvWX31Us Oct 27 03:36:10.161106 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:36:10.161106 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:36:10.161106 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:36:10.161106 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:36:10.161106 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:36:10.161106 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:36:10.161106 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 8bb5d291069d4329a90123e327fe9c59 Oct 27 03:36:10.161106 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:36:10.161106 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:36:10.161106 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:36:10.161106 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8bb5d291069d4329a90123e327fe9c59"}]}] Oct 27 03:36:10.161106 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:36:10.161106 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 8bb5d291069d4329a90123e327fe9c59 Oct 27 03:36:10.161106 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:36:10.161106 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServersNegativeTestJSON-4378389-project Oct 27 03:36:10.161106 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:36:10.161106 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:36:10.161106 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: f9c32b7626594ff888970c7f3227bb20 Oct 27 03:36:10.161106 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServersNegativeTestJSON-4378389-project Oct 27 03:36:10.161106 n-d-862769-1 devstack@n-api.service[121001]: Oct 27 03:36:10.161106 n-d-862769-1 devstack@n-api.service[121001]: {"reboot": {"type": "SOFT"}} Oct 27 03:36:10.161106 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:36:10.161106 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 35a0ac1a-379f-456e-a3d7-81f888daebbf could not be found. Oct 27 03:36:10.161106 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '35a0ac1a-379f-456e-a3d7-81f888daebbf', 'body': {'reboot': {'type': 'SOFT'}}} Oct 27 03:36:10.161106 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:36:10.161106 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:36:10.161106 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:36:10.161106 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:36:10.161106 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:36:10.161106 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:36:10.161106 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:36:10.161106 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:36:10.161106 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:36:10.161106 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:36:10.161106 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35a0ac1a-379f-456e-a3d7-81f888daebbf could not be found. Oct 27 03:36:10.161106 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:10.161106 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:36:10.161106 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:10.161106 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:36:10.161106 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:36:10.161106 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:36:10.161106 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:36:10.161106 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:36:10.161106 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:36:10.161106 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:36:10.161106 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:36:10.161106 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:36:10.161106 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 27 03:36:10.161106 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 27 03:36:10.161106 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:36:10.161106 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:36:10.161106 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:36:10.161106 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:36:10.165871 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35a0ac1a-379f-456e-a3d7-81f888daebbf could not be found. Oct 27 03:36:10.165871 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:10.165871 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:36:10.165871 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:10.165871 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:36:10.165871 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:36:10.165871 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:36:10.165871 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:36:10.165871 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:36:10.165871 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35a0ac1a-379f-456e-a3d7-81f888daebbf could not be found. Oct 27 03:36:10.165871 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:10.168394 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0b65c65d-df0e-4c73-890e-c5cf503aaa66 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Returning 404 to user: Instance 35a0ac1a-379f-456e-a3d7-81f888daebbf could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:36:10.169552 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0b65c65d-df0e-4c73-890e-c5cf503aaa66 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "POST /compute/v2.1/servers/35a0ac1a-379f-456e-a3d7-81f888daebbf/action" status: 404 len: 111 microversion: 2.1 time: 0.074204 Oct 27 03:36:10.170965 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1942/3636] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:36:10 2022] POST /compute/v2.1/servers/35a0ac1a-379f-456e-a3d7-81f888daebbf/action => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:36:10.179921 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c452e048-42bb-4eb4-9d9f-6a9f39f34146 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:10.180840 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c452e048-42bb-4eb4-9d9f-6a9f39f34146 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:10.203137 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c452e048-42bb-4eb4-9d9f-6a9f39f34146 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:10.203137 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c452e048-42bb-4eb4-9d9f-6a9f39f34146 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:10.203137 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c452e048-42bb-4eb4-9d9f-6a9f39f34146 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:10.203503 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-968db6d5-a7e5-4ff6-a498-083b09249ca0 req-43a8b7a2-93fc-41ab-a30e-77f177872e94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5c50ae8-6217-4650-8420-291847e21ace", "name": "network-vif-plugged", "status": "completed", "tag": "72613a85-f4ba-4f66-8e4c-034d84cc97e5"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:36:10.203634 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c452e048-42bb-4eb4-9d9f-6a9f39f34146 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:10.203917 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c452e048-42bb-4eb4-9d9f-6a9f39f34146 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:10.204417 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c452e048-42bb-4eb4-9d9f-6a9f39f34146 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:10.235094 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-968db6d5-a7e5-4ff6-a498-083b09249ca0 req-43a8b7a2-93fc-41ab-a30e-77f177872e94 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:10.238975 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-968db6d5-a7e5-4ff6-a498-083b09249ca0 req-43a8b7a2-93fc-41ab-a30e-77f177872e94 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:10.241997 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-968db6d5-a7e5-4ff6-a498-083b09249ca0 req-43a8b7a2-93fc-41ab-a30e-77f177872e94 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:10.263364 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-968db6d5-a7e5-4ff6-a498-083b09249ca0 req-43a8b7a2-93fc-41ab-a30e-77f177872e94 service nova] Creating event network-vif-plugged:72613a85-f4ba-4f66-8e4c-034d84cc97e5 for instance c5c50ae8-6217-4650-8420-291847e21ace on n-h1-862769-1 Oct 27 03:36:10.286633 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-968db6d5-a7e5-4ff6-a498-083b09249ca0 req-43a8b7a2-93fc-41ab-a30e-77f177872e94 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091019 Oct 27 03:36:10.287547 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1943/3637] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:36:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:36:10.397650 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-44b748a9-495e-4382-a588-20ad03ef6a90 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:10.397979 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-44b748a9-495e-4382-a588-20ad03ef6a90 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: c5c50ae8-6217-4650-8420-291847e21ace] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:10.416900 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-44b748a9-495e-4382-a588-20ad03ef6a90 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:10.417582 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-44b748a9-495e-4382-a588-20ad03ef6a90 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:10.417841 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-44b748a9-495e-4382-a588-20ad03ef6a90 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:10.418586 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-44b748a9-495e-4382-a588-20ad03ef6a90 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:10.419041 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-44b748a9-495e-4382-a588-20ad03ef6a90 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:10.419473 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-44b748a9-495e-4382-a588-20ad03ef6a90 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:10.637847 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c452e048-42bb-4eb4-9d9f-6a9f39f34146 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:10.650819 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c452e048-42bb-4eb4-9d9f-6a9f39f34146 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1505 microversion: 2.1 time: 0.475632 Oct 27 03:36:10.651423 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1695/3638] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:10 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1505 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:10.679612 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-cadb7cb6-312e-4c8e-98b6-c626f5e8841a tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:10.680238 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-cadb7cb6-312e-4c8e-98b6-c626f5e8841a tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:10.694849 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cadb7cb6-312e-4c8e-98b6-c626f5e8841a tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:10.695346 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cadb7cb6-312e-4c8e-98b6-c626f5e8841a tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:10.695790 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cadb7cb6-312e-4c8e-98b6-c626f5e8841a tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:10.696504 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cadb7cb6-312e-4c8e-98b6-c626f5e8841a tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:10.696961 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cadb7cb6-312e-4c8e-98b6-c626f5e8841a tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:10.697390 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cadb7cb6-312e-4c8e-98b6-c626f5e8841a tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:10.734542 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-44b748a9-495e-4382-a588-20ad03ef6a90 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18036411a99e4634bfbaeae24b9f254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229dcb63bc41444391544883b576ce2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:10.742409 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-44b748a9-495e-4382-a588-20ad03ef6a90 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/c5c50ae8-6217-4650-8420-291847e21ace" status: 200 len: 1364 microversion: 2.1 time: 0.349275 Oct 27 03:36:10.742998 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1944/3639] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:10 2022] GET /compute/v2.1/servers/c5c50ae8-6217-4650-8420-291847e21ace => generated 1364 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:36:10.805322 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c70643a2-7a66-4568-9422-fcdc2d33bab5 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:10.806276 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c70643a2-7a66-4568-9422-fcdc2d33bab5 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] [instance: 8c8a2cbb-4acf-4a6b-b684-567617bb930d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:10.817317 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c70643a2-7a66-4568-9422-fcdc2d33bab5 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:10.818017 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c70643a2-7a66-4568-9422-fcdc2d33bab5 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:10.819307 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c70643a2-7a66-4568-9422-fcdc2d33bab5 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:10.820235 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c70643a2-7a66-4568-9422-fcdc2d33bab5 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:10.822073 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c70643a2-7a66-4568-9422-fcdc2d33bab5 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:10.825676 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c70643a2-7a66-4568-9422-fcdc2d33bab5 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:11.027735 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-cadb7cb6-312e-4c8e-98b6-c626f5e8841a tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:11.037702 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-cadb7cb6-312e-4c8e-98b6-c626f5e8841a tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1505 microversion: 2.1 time: 0.361898 Oct 27 03:36:11.038340 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1696/3640] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:10 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1505 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:36:11.065307 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ed314504-52f5-41e7-af62-2defdcd3e81a tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:36:11.067960 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ed314504-52f5-41e7-af62-2defdcd3e81a tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: ff189157-d9fd-45e0-8bb8-cdccfad48cc8] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:11.074474 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-ed314504-52f5-41e7-af62-2defdcd3e81a tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] HTTP exception thrown: Instance ff189157-d9fd-45e0-8bb8-cdccfad48cc8 could not be found. Oct 27 03:36:11.076439 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ed314504-52f5-41e7-af62-2defdcd3e81a tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Request method failure captured: Oct 27 03:36:11.076439 n-d-862769-1 devstack@n-api.service[121000]: request: POST /compute/v2.1/servers/ff189157-d9fd-45e0-8bb8-cdccfad48cc8/action HTTP/1.1 Oct 27 03:36:11.076439 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:36:11.076439 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:36:11.076439 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:36:11.076439 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 28 Oct 27 03:36:11.076439 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:36:11.076439 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:36:11.076439 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:36:11.076439 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:36:11.076439 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfxF6ut9nM9a9AcpKLO7IgCu-akAJ2YJGjrI9C8NUveA8uObV2XgQIQvsIxuWjvLl9meIEqpfGwZYr8MTX_PAGoiJsNUPXh5ERSce5cPYQYCCFPL0HtTb-E11C_2kfWy1wRps1tClRNvtj8zAqCGRhs1x-Uvl0zISdfHepXmvWX31Us Oct 27 03:36:11.076439 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:36:11.076439 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:36:11.076439 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:36:11.076439 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:36:11.076439 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:36:11.076439 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:36:11.076439 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 8bb5d291069d4329a90123e327fe9c59 Oct 27 03:36:11.076439 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:36:11.076439 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:36:11.076439 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:36:11.076439 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8bb5d291069d4329a90123e327fe9c59"}]}] Oct 27 03:36:11.076439 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:36:11.076439 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 8bb5d291069d4329a90123e327fe9c59 Oct 27 03:36:11.076439 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:36:11.076439 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ServersNegativeTestJSON-4378389-project Oct 27 03:36:11.076439 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:36:11.076439 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:36:11.076439 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: f9c32b7626594ff888970c7f3227bb20 Oct 27 03:36:11.076439 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ServersNegativeTestJSON-4378389-project Oct 27 03:36:11.076439 n-d-862769-1 devstack@n-api.service[121000]: Oct 27 03:36:11.076439 n-d-862769-1 devstack@n-api.service[121000]: {"reboot": {"type": "SOFT"}} Oct 27 03:36:11.076439 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:36:11.076439 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance ff189157-d9fd-45e0-8bb8-cdccfad48cc8 could not be found. Oct 27 03:36:11.076439 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': 'ff189157-d9fd-45e0-8bb8-cdccfad48cc8', 'body': {'reboot': {'type': 'SOFT'}}} Oct 27 03:36:11.076439 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:36:11.076439 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:36:11.076439 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:36:11.076439 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:36:11.076439 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:36:11.076439 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:36:11.076439 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 03:36:11.076439 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 03:36:11.076439 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff189157-d9fd-45e0-8bb8-cdccfad48cc8 could not be found. Oct 27 03:36:11.076439 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:36:11.076439 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:36:11.076439 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:36:11.076439 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:36:11.076439 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:36:11.076439 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:36:11.076439 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:36:11.076439 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:36:11.076439 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:36:11.076439 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:36:11.076439 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:36:11.076439 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:36:11.076439 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 27 03:36:11.076439 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 27 03:36:11.076439 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:36:11.076439 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:36:11.076439 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:36:11.076439 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:36:11.076439 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff189157-d9fd-45e0-8bb8-cdccfad48cc8 could not be found. Oct 27 03:36:11.076439 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:36:11.081781 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:36:11.081781 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:36:11.081781 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:36:11.081781 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:36:11.081781 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:36:11.081781 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:36:11.081781 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:36:11.081781 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff189157-d9fd-45e0-8bb8-cdccfad48cc8 could not be found. Oct 27 03:36:11.081781 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:36:11.088230 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ed314504-52f5-41e7-af62-2defdcd3e81a tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Returning 404 to user: Instance ff189157-d9fd-45e0-8bb8-cdccfad48cc8 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:36:11.088230 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ed314504-52f5-41e7-af62-2defdcd3e81a tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "POST /compute/v2.1/servers/ff189157-d9fd-45e0-8bb8-cdccfad48cc8/action" status: 404 len: 111 microversion: 2.1 time: 0.024472 Oct 27 03:36:11.088932 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1697/3641] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:36:11 2022] POST /compute/v2.1/servers/ff189157-d9fd-45e0-8bb8-cdccfad48cc8/action => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:36:11.094624 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d29b9435-0419-48a0-82df-ef5639cf0b5c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:11.095949 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d29b9435-0419-48a0-82df-ef5639cf0b5c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:11.103713 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d29b9435-0419-48a0-82df-ef5639cf0b5c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:11.104585 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d29b9435-0419-48a0-82df-ef5639cf0b5c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:11.105255 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d29b9435-0419-48a0-82df-ef5639cf0b5c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:11.106266 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d29b9435-0419-48a0-82df-ef5639cf0b5c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:11.106953 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d29b9435-0419-48a0-82df-ef5639cf0b5c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:11.108359 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d29b9435-0419-48a0-82df-ef5639cf0b5c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:11.135138 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c70643a2-7a66-4568-9422-fcdc2d33bab5 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:11.147655 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c70643a2-7a66-4568-9422-fcdc2d33bab5 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:11.149116 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c70643a2-7a66-4568-9422-fcdc2d33bab5 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:11.150356 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c70643a2-7a66-4568-9422-fcdc2d33bab5 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d" status: 200 len: 1878 microversion: 2.42 time: 0.349474 Oct 27 03:36:11.153364 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1945/3642] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:36:10 2022] GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d => generated 1878 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:36:11.167607 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-313de7a7-c087-42db-b44a-67926653190a tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7dd9d83dc0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:11.243120 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-313de7a7-c087-42db-b44a-67926653190a tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images/81186aa0-7ea8-487e-9c34-69f89a3830e6" status: 200 len: 1454 microversion: 2.1 time: 0.079807 Oct 27 03:36:11.244030 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1946/3643] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:36:11 2022] GET /compute/v2.1/images/81186aa0-7ea8-487e-9c34-69f89a3830e6 => generated 1454 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:11.509463 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d29b9435-0419-48a0-82df-ef5639cf0b5c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:11.518588 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d29b9435-0419-48a0-82df-ef5639cf0b5c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1505 microversion: 2.1 time: 0.428389 Oct 27 03:36:11.525746 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1698/3644] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:11 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1505 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:11.557082 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0bd0ce13-bc8d-48a8-8937-d01ac47dae64 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:11.557693 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0bd0ce13-bc8d-48a8-8937-d01ac47dae64 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:11.564833 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0bd0ce13-bc8d-48a8-8937-d01ac47dae64 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:11.565337 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0bd0ce13-bc8d-48a8-8937-d01ac47dae64 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:11.565787 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0bd0ce13-bc8d-48a8-8937-d01ac47dae64 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:11.566562 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0bd0ce13-bc8d-48a8-8937-d01ac47dae64 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:11.567027 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0bd0ce13-bc8d-48a8-8937-d01ac47dae64 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:11.567463 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0bd0ce13-bc8d-48a8-8937-d01ac47dae64 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:11.625912 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-143ee2d0-3a11-415e-bcf6-ff5f836d1b14 req-318510ce-cdbf-4672-8f20-683105b0f1d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a1bda43-af44-432d-8992-94473a5f8b5d", "tag": "492e855b-93ee-4a3f-9bb2-1fef411f1a2c"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:36:11.647881 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-143ee2d0-3a11-415e-bcf6-ff5f836d1b14 req-318510ce-cdbf-4672-8f20-683105b0f1d1 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:11.650967 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-143ee2d0-3a11-415e-bcf6-ff5f836d1b14 req-318510ce-cdbf-4672-8f20-683105b0f1d1 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:11.653410 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-143ee2d0-3a11-415e-bcf6-ff5f836d1b14 req-318510ce-cdbf-4672-8f20-683105b0f1d1 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:11.681923 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-143ee2d0-3a11-415e-bcf6-ff5f836d1b14 req-318510ce-cdbf-4672-8f20-683105b0f1d1 service nova] Creating event network-changed:492e855b-93ee-4a3f-9bb2-1fef411f1a2c for instance 2a1bda43-af44-432d-8992-94473a5f8b5d on n-h2-862769-1 Oct 27 03:36:11.689600 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-143ee2d0-3a11-415e-bcf6-ff5f836d1b14 req-318510ce-cdbf-4672-8f20-683105b0f1d1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068051 Oct 27 03:36:11.690914 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1699/3645] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:36:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:36:11.771322 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-60c4644a-f293-41f8-990c-51b72d2d2f12 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:11.772367 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-60c4644a-f293-41f8-990c-51b72d2d2f12 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: c5c50ae8-6217-4650-8420-291847e21ace] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:11.790415 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-60c4644a-f293-41f8-990c-51b72d2d2f12 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:11.792939 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-60c4644a-f293-41f8-990c-51b72d2d2f12 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:11.796977 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-60c4644a-f293-41f8-990c-51b72d2d2f12 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:11.796977 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-60c4644a-f293-41f8-990c-51b72d2d2f12 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:11.796977 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-60c4644a-f293-41f8-990c-51b72d2d2f12 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:11.796977 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-60c4644a-f293-41f8-990c-51b72d2d2f12 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:11.801925 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0bd0ce13-bc8d-48a8-8937-d01ac47dae64 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:11.813792 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0bd0ce13-bc8d-48a8-8937-d01ac47dae64 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1505 microversion: 2.1 time: 0.258651 Oct 27 03:36:11.818246 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1947/3646] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:11 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1505 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:11.844111 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6a0bf64c-86fc-4c37-8d4d-ec2320e6c500 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:36:11.849147 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-6a0bf64c-86fc-4c37-8d4d-ec2320e6c500 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 35a0ac1a-379f-456e-a3d7-81f888daebbf] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:11.870745 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6a0bf64c-86fc-4c37-8d4d-ec2320e6c500 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:11.871530 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6a0bf64c-86fc-4c37-8d4d-ec2320e6c500 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:11.872102 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6a0bf64c-86fc-4c37-8d4d-ec2320e6c500 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:11.874066 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6a0bf64c-86fc-4c37-8d4d-ec2320e6c500 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:11.874698 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6a0bf64c-86fc-4c37-8d4d-ec2320e6c500 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:11.875650 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6a0bf64c-86fc-4c37-8d4d-ec2320e6c500 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:11.916516 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-6a0bf64c-86fc-4c37-8d4d-ec2320e6c500 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] HTTP exception thrown: Instance 35a0ac1a-379f-456e-a3d7-81f888daebbf could not be found. Oct 27 03:36:11.918831 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6a0bf64c-86fc-4c37-8d4d-ec2320e6c500 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Request method failure captured: Oct 27 03:36:11.918831 n-d-862769-1 devstack@n-api.service[121001]: request: POST /compute/v2.1/servers/35a0ac1a-379f-456e-a3d7-81f888daebbf/action HTTP/1.1 Oct 27 03:36:11.918831 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:36:11.918831 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:36:11.918831 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:36:11.918831 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 65 Oct 27 03:36:11.918831 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:36:11.918831 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:36:11.918831 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:36:11.918831 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:36:11.918831 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfxF6ut9nM9a9AcpKLO7IgCu-akAJ2YJGjrI9C8NUveA8uObV2XgQIQvsIxuWjvLl9meIEqpfGwZYr8MTX_PAGoiJsNUPXh5ERSce5cPYQYCCFPL0HtTb-E11C_2kfWy1wRps1tClRNvtj8zAqCGRhs1x-Uvl0zISdfHepXmvWX31Us Oct 27 03:36:11.918831 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:36:11.918831 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:36:11.918831 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:36:11.918831 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:36:11.918831 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:36:11.918831 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:36:11.918831 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 8bb5d291069d4329a90123e327fe9c59 Oct 27 03:36:11.918831 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:36:11.918831 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:36:11.918831 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:36:11.918831 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8bb5d291069d4329a90123e327fe9c59"}]}] Oct 27 03:36:11.918831 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:36:11.918831 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 8bb5d291069d4329a90123e327fe9c59 Oct 27 03:36:11.918831 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:36:11.918831 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServersNegativeTestJSON-4378389-project Oct 27 03:36:11.918831 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:36:11.918831 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:36:11.918831 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: f9c32b7626594ff888970c7f3227bb20 Oct 27 03:36:11.918831 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServersNegativeTestJSON-4378389-project Oct 27 03:36:11.918831 n-d-862769-1 devstack@n-api.service[121001]: Oct 27 03:36:11.918831 n-d-862769-1 devstack@n-api.service[121001]: {"rebuild": {"imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917"}} Oct 27 03:36:11.918831 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:36:11.918831 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 35a0ac1a-379f-456e-a3d7-81f888daebbf could not be found. Oct 27 03:36:11.918831 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '35a0ac1a-379f-456e-a3d7-81f888daebbf', 'body': {'rebuild': {'imageRef': 'c40fb871-5877-4b59-ab69-d9fd23b7a917'}}} Oct 27 03:36:11.918831 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:36:11.918831 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:36:11.918831 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:36:11.918831 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:36:11.918831 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:36:11.918831 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:36:11.918831 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:36:11.918831 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:36:11.918831 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:36:11.918831 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:36:11.918831 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35a0ac1a-379f-456e-a3d7-81f888daebbf could not be found. Oct 27 03:36:11.918831 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:11.918831 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:36:11.918831 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:11.918831 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:36:11.918831 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:36:11.918831 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:36:11.918831 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:36:11.918831 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:36:11.918831 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:36:11.918831 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:36:11.918831 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:36:11.918831 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:36:11.918831 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:36:11.918831 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:36:11.918831 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:36:11.918831 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:36:11.918831 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 27 03:36:11.918831 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 27 03:36:11.923116 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 27 03:36:11.923116 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:36:11.923116 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:36:11.923116 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:36:11.923116 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:36:11.923116 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35a0ac1a-379f-456e-a3d7-81f888daebbf could not be found. Oct 27 03:36:11.923116 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:11.923116 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:36:11.923116 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:11.923116 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:36:11.923116 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:36:11.923116 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:36:11.923116 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:36:11.923116 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:36:11.923116 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35a0ac1a-379f-456e-a3d7-81f888daebbf could not be found. Oct 27 03:36:11.923116 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:11.925967 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6a0bf64c-86fc-4c37-8d4d-ec2320e6c500 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Returning 404 to user: Instance 35a0ac1a-379f-456e-a3d7-81f888daebbf could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:36:11.927373 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6a0bf64c-86fc-4c37-8d4d-ec2320e6c500 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "POST /compute/v2.1/servers/35a0ac1a-379f-456e-a3d7-81f888daebbf/action" status: 404 len: 111 microversion: 2.1 time: 0.088302 Oct 27 03:36:11.928511 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1948/3647] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:36:11 2022] POST /compute/v2.1/servers/35a0ac1a-379f-456e-a3d7-81f888daebbf/action => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:36:11.939956 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5824e18e-3258-4958-a1fb-d61c116c6ae0 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:11.945540 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5824e18e-3258-4958-a1fb-d61c116c6ae0 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:11.961414 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5824e18e-3258-4958-a1fb-d61c116c6ae0 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:11.966682 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5824e18e-3258-4958-a1fb-d61c116c6ae0 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:11.967506 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5824e18e-3258-4958-a1fb-d61c116c6ae0 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:11.968689 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5824e18e-3258-4958-a1fb-d61c116c6ae0 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:11.970827 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5824e18e-3258-4958-a1fb-d61c116c6ae0 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:11.972667 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5824e18e-3258-4958-a1fb-d61c116c6ae0 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:12.406128 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-60c4644a-f293-41f8-990c-51b72d2d2f12 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18036411a99e4634bfbaeae24b9f254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229dcb63bc41444391544883b576ce2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:12.428000 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-60c4644a-f293-41f8-990c-51b72d2d2f12 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/c5c50ae8-6217-4650-8420-291847e21ace" status: 200 len: 1364 microversion: 2.1 time: 0.662728 Oct 27 03:36:12.455423 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1700/3648] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:11 2022] GET /compute/v2.1/servers/c5c50ae8-6217-4650-8420-291847e21ace => generated 1364 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:36:12.462585 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e76c0bc4-f266-4a33-98a8-a94eadcc081a tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:12.467277 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e76c0bc4-f266-4a33-98a8-a94eadcc081a tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] [instance: 8c8a2cbb-4acf-4a6b-b684-567617bb930d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:12.484995 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e76c0bc4-f266-4a33-98a8-a94eadcc081a tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:12.485815 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e76c0bc4-f266-4a33-98a8-a94eadcc081a tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:12.486475 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e76c0bc4-f266-4a33-98a8-a94eadcc081a tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:12.487426 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e76c0bc4-f266-4a33-98a8-a94eadcc081a tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:12.488101 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e76c0bc4-f266-4a33-98a8-a94eadcc081a tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:12.489027 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e76c0bc4-f266-4a33-98a8-a94eadcc081a tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:13.048452 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5824e18e-3258-4958-a1fb-d61c116c6ae0 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:13.063297 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5824e18e-3258-4958-a1fb-d61c116c6ae0 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1505 microversion: 2.1 time: 1.125772 Oct 27 03:36:13.064662 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1949/3649] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:11 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1505 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:13.069505 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3602e884-8210-4af8-88f5-c9c4405761bd tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7dd9d51b80>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:13.144601 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3602e884-8210-4af8-88f5-c9c4405761bd tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images/81186aa0-7ea8-487e-9c34-69f89a3830e6" status: 200 len: 1454 microversion: 2.1 time: 0.078467 Oct 27 03:36:13.147291 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1950/3650] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:36:13 2022] GET /compute/v2.1/images/81186aa0-7ea8-487e-9c34-69f89a3830e6 => generated 1454 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:13.152777 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3fd58e73-97eb-4d14-b7a9-24b27a8725bf tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:13.153662 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3fd58e73-97eb-4d14-b7a9-24b27a8725bf tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:13.161815 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3fd58e73-97eb-4d14-b7a9-24b27a8725bf tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:13.163140 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3fd58e73-97eb-4d14-b7a9-24b27a8725bf tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:13.163815 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3fd58e73-97eb-4d14-b7a9-24b27a8725bf tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:13.167581 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3fd58e73-97eb-4d14-b7a9-24b27a8725bf tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:13.168298 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3fd58e73-97eb-4d14-b7a9-24b27a8725bf tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:13.179676 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3fd58e73-97eb-4d14-b7a9-24b27a8725bf tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:13.308633 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e76c0bc4-f266-4a33-98a8-a94eadcc081a tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:13.320649 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e76c0bc4-f266-4a33-98a8-a94eadcc081a tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:13.328380 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e76c0bc4-f266-4a33-98a8-a94eadcc081a tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:13.336289 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e76c0bc4-f266-4a33-98a8-a94eadcc081a tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d" status: 200 len: 1878 microversion: 2.42 time: 0.879251 Oct 27 03:36:13.337194 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1701/3651] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:36:12 2022] GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d => generated 1878 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:36:13.463422 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f398636e-8240-4c56-9bd7-c96a53e2b63c tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:13.464133 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f398636e-8240-4c56-9bd7-c96a53e2b63c tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: c5c50ae8-6217-4650-8420-291847e21ace] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:13.473787 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f398636e-8240-4c56-9bd7-c96a53e2b63c tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:13.478630 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f398636e-8240-4c56-9bd7-c96a53e2b63c tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:13.478630 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f398636e-8240-4c56-9bd7-c96a53e2b63c tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:13.478630 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f398636e-8240-4c56-9bd7-c96a53e2b63c tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:13.480621 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f398636e-8240-4c56-9bd7-c96a53e2b63c tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:13.481366 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f398636e-8240-4c56-9bd7-c96a53e2b63c tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:13.694088 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3fd58e73-97eb-4d14-b7a9-24b27a8725bf tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:13.709078 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3fd58e73-97eb-4d14-b7a9-24b27a8725bf tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1505 microversion: 2.1 time: 0.560473 Oct 27 03:36:13.722175 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1951/3652] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:13 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1505 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:13.736128 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-67bc7602-2685-4e11-9f1d-7ceba1d069e3 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:36:13.739189 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-67bc7602-2685-4e11-9f1d-7ceba1d069e3 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 332cfc62-af54-420e-a9a4-6437b4e0a0bd] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:13.751524 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-67bc7602-2685-4e11-9f1d-7ceba1d069e3 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] HTTP exception thrown: Instance 332cfc62-af54-420e-a9a4-6437b4e0a0bd could not be found. Oct 27 03:36:13.754720 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-67bc7602-2685-4e11-9f1d-7ceba1d069e3 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Request method failure captured: Oct 27 03:36:13.754720 n-d-862769-1 devstack@n-api.service[121001]: request: POST /compute/v2.1/servers/332cfc62-af54-420e-a9a4-6437b4e0a0bd/action HTTP/1.1 Oct 27 03:36:13.754720 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:36:13.754720 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:36:13.754720 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:36:13.754720 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 65 Oct 27 03:36:13.754720 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:36:13.754720 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:36:13.754720 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:36:13.754720 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:36:13.754720 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfxF6ut9nM9a9AcpKLO7IgCu-akAJ2YJGjrI9C8NUveA8uObV2XgQIQvsIxuWjvLl9meIEqpfGwZYr8MTX_PAGoiJsNUPXh5ERSce5cPYQYCCFPL0HtTb-E11C_2kfWy1wRps1tClRNvtj8zAqCGRhs1x-Uvl0zISdfHepXmvWX31Us Oct 27 03:36:13.754720 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:36:13.754720 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:36:13.754720 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:36:13.754720 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:36:13.754720 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:36:13.754720 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:36:13.754720 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 8bb5d291069d4329a90123e327fe9c59 Oct 27 03:36:13.754720 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:36:13.754720 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:36:13.754720 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:36:13.754720 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8bb5d291069d4329a90123e327fe9c59"}]}] Oct 27 03:36:13.754720 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:36:13.754720 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 8bb5d291069d4329a90123e327fe9c59 Oct 27 03:36:13.754720 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:36:13.754720 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServersNegativeTestJSON-4378389-project Oct 27 03:36:13.754720 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:36:13.754720 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:36:13.754720 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: f9c32b7626594ff888970c7f3227bb20 Oct 27 03:36:13.754720 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServersNegativeTestJSON-4378389-project Oct 27 03:36:13.754720 n-d-862769-1 devstack@n-api.service[121001]: Oct 27 03:36:13.754720 n-d-862769-1 devstack@n-api.service[121001]: {"rebuild": {"imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917"}} Oct 27 03:36:13.754720 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:36:13.754720 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 332cfc62-af54-420e-a9a4-6437b4e0a0bd could not be found. Oct 27 03:36:13.754720 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '332cfc62-af54-420e-a9a4-6437b4e0a0bd', 'body': {'rebuild': {'imageRef': 'c40fb871-5877-4b59-ab69-d9fd23b7a917'}}} Oct 27 03:36:13.754720 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:36:13.754720 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:36:13.754720 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:36:13.754720 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:36:13.754720 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:36:13.754720 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:36:13.754720 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 03:36:13.754720 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 03:36:13.754720 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 332cfc62-af54-420e-a9a4-6437b4e0a0bd could not be found. Oct 27 03:36:13.754720 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:13.754720 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:36:13.754720 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:13.754720 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:36:13.754720 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:36:13.754720 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:36:13.754720 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:36:13.754720 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:36:13.754720 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:36:13.754720 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:36:13.754720 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:36:13.754720 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:36:13.754720 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:36:13.754720 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:36:13.754720 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:36:13.754720 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:36:13.754720 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 27 03:36:13.754720 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 27 03:36:13.754720 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 27 03:36:13.754720 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:36:13.764155 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:36:13.764155 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:36:13.764155 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:36:13.764155 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 332cfc62-af54-420e-a9a4-6437b4e0a0bd could not be found. Oct 27 03:36:13.764155 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:13.764155 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:36:13.764155 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:13.764155 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:36:13.764155 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:36:13.764155 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:36:13.764155 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:36:13.764155 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:36:13.764155 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 332cfc62-af54-420e-a9a4-6437b4e0a0bd could not be found. Oct 27 03:36:13.764155 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:13.764155 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-67bc7602-2685-4e11-9f1d-7ceba1d069e3 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Returning 404 to user: Instance 332cfc62-af54-420e-a9a4-6437b4e0a0bd could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:36:13.764155 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-67bc7602-2685-4e11-9f1d-7ceba1d069e3 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "POST /compute/v2.1/servers/332cfc62-af54-420e-a9a4-6437b4e0a0bd/action" status: 404 len: 111 microversion: 2.1 time: 0.024991 Oct 27 03:36:13.764155 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1952/3653] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:36:13 2022] POST /compute/v2.1/servers/332cfc62-af54-420e-a9a4-6437b4e0a0bd/action => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 03:36:13.767173 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f398636e-8240-4c56-9bd7-c96a53e2b63c tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18036411a99e4634bfbaeae24b9f254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229dcb63bc41444391544883b576ce2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:13.774316 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2256d86e-4e18-444d-8286-cfbbcc9ff931 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:13.775613 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2256d86e-4e18-444d-8286-cfbbcc9ff931 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:13.780849 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f398636e-8240-4c56-9bd7-c96a53e2b63c tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/c5c50ae8-6217-4650-8420-291847e21ace" status: 200 len: 1553 microversion: 2.1 time: 0.321319 Oct 27 03:36:13.781831 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1702/3654] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:13 2022] GET /compute/v2.1/servers/c5c50ae8-6217-4650-8420-291847e21ace => generated 1553 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:13.813532 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2256d86e-4e18-444d-8286-cfbbcc9ff931 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:13.814106 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2256d86e-4e18-444d-8286-cfbbcc9ff931 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:13.814689 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2256d86e-4e18-444d-8286-cfbbcc9ff931 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:13.815409 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2256d86e-4e18-444d-8286-cfbbcc9ff931 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:13.815872 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2256d86e-4e18-444d-8286-cfbbcc9ff931 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:13.816302 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2256d86e-4e18-444d-8286-cfbbcc9ff931 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:13.818169 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-16149041-c08f-417f-aa34-67e5badab639 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:13.819126 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-16149041-c08f-417f-aa34-67e5badab639 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: c5c50ae8-6217-4650-8420-291847e21ace] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:13.831916 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-16149041-c08f-417f-aa34-67e5badab639 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:13.832777 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-16149041-c08f-417f-aa34-67e5badab639 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:13.833463 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-16149041-c08f-417f-aa34-67e5badab639 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:13.834557 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-16149041-c08f-417f-aa34-67e5badab639 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:13.835362 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-16149041-c08f-417f-aa34-67e5badab639 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:13.838617 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-16149041-c08f-417f-aa34-67e5badab639 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:14.061762 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-16149041-c08f-417f-aa34-67e5badab639 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/c5c50ae8-6217-4650-8420-291847e21ace/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.244063 Oct 27 03:36:14.063581 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1703/3655] 10.222.0.20 () {58 vars in 1275 bytes} [Thu Oct 27 03:36:13 2022] GET /compute/v2.1/servers/c5c50ae8-6217-4650-8420-291847e21ace/os-interface => generated 284 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:36:14.169430 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-665bf2c9-d117-47ab-9a54-9d5e1f53ab33 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7ddeda1940>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:14.311632 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-665bf2c9-d117-47ab-9a54-9d5e1f53ab33 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images/81186aa0-7ea8-487e-9c34-69f89a3830e6" status: 200 len: 1454 microversion: 2.1 time: 0.154197 Oct 27 03:36:14.312541 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1704/3656] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:36:14 2022] GET /compute/v2.1/images/81186aa0-7ea8-487e-9c34-69f89a3830e6 => generated 1454 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:14.366099 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c1a2e271-1c86-469b-874b-520519a7b21a tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:14.367003 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c1a2e271-1c86-469b-874b-520519a7b21a tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] [instance: 8c8a2cbb-4acf-4a6b-b684-567617bb930d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:14.391544 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c1a2e271-1c86-469b-874b-520519a7b21a tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:14.392090 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c1a2e271-1c86-469b-874b-520519a7b21a tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:14.392610 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c1a2e271-1c86-469b-874b-520519a7b21a tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:14.396564 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c1a2e271-1c86-469b-874b-520519a7b21a tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:14.400537 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c1a2e271-1c86-469b-874b-520519a7b21a tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:14.401054 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c1a2e271-1c86-469b-874b-520519a7b21a tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:14.704011 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2256d86e-4e18-444d-8286-cfbbcc9ff931 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:14.720422 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2256d86e-4e18-444d-8286-cfbbcc9ff931 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1505 microversion: 2.1 time: 0.953479 Oct 27 03:36:14.724554 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1953/3657] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:13 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1505 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:14.753803 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-02346a8f-f57c-4efd-bb8b-fb03c0bb6599 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:14.755007 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-02346a8f-f57c-4efd-bb8b-fb03c0bb6599 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:14.782832 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-02346a8f-f57c-4efd-bb8b-fb03c0bb6599 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:14.786657 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-02346a8f-f57c-4efd-bb8b-fb03c0bb6599 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:14.791248 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-02346a8f-f57c-4efd-bb8b-fb03c0bb6599 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:14.794206 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-02346a8f-f57c-4efd-bb8b-fb03c0bb6599 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:14.798553 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-02346a8f-f57c-4efd-bb8b-fb03c0bb6599 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:14.802859 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-02346a8f-f57c-4efd-bb8b-fb03c0bb6599 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:15.063099 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c1a2e271-1c86-469b-874b-520519a7b21a tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:15.081124 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c1a2e271-1c86-469b-874b-520519a7b21a tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:15.085145 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c1a2e271-1c86-469b-874b-520519a7b21a tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:15.088600 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c1a2e271-1c86-469b-874b-520519a7b21a tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d" status: 200 len: 1878 microversion: 2.42 time: 0.727397 Oct 27 03:36:15.097810 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1705/3658] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:36:14 2022] GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d => generated 1878 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:36:15.327684 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8ff2f414-6149-4b6d-bdc8-ad603e21aeba tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7ddee06d30>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:15.446308 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8ff2f414-6149-4b6d-bdc8-ad603e21aeba tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images/81186aa0-7ea8-487e-9c34-69f89a3830e6" status: 200 len: 1454 microversion: 2.1 time: 0.122514 Oct 27 03:36:15.450070 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1706/3659] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:36:15 2022] GET /compute/v2.1/images/81186aa0-7ea8-487e-9c34-69f89a3830e6 => generated 1454 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:15.857683 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-02346a8f-f57c-4efd-bb8b-fb03c0bb6599 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:15.866625 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-02346a8f-f57c-4efd-bb8b-fb03c0bb6599 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1505 microversion: 2.1 time: 1.118473 Oct 27 03:36:15.875417 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1954/3660] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:14 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1505 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:15.897416 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1fcf39a8-2c02-4efe-965b-65f24fc59ebf tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:36:15.898481 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1fcf39a8-2c02-4efe-965b-65f24fc59ebf tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 3d3f7636-e682-4a33-a6df-088eaf176b3a] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:15.909547 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-1fcf39a8-2c02-4efe-965b-65f24fc59ebf tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] HTTP exception thrown: Instance 3d3f7636-e682-4a33-a6df-088eaf176b3a could not be found. Oct 27 03:36:15.922983 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1fcf39a8-2c02-4efe-965b-65f24fc59ebf tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Request method failure captured: Oct 27 03:36:15.922983 n-d-862769-1 devstack@n-api.service[121000]: request: POST /compute/v2.1/servers/3d3f7636-e682-4a33-a6df-088eaf176b3a/action HTTP/1.1 Oct 27 03:36:15.922983 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:36:15.922983 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:36:15.922983 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:36:15.922983 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 15 Oct 27 03:36:15.922983 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:36:15.922983 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:36:15.922983 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:36:15.922983 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:36:15.922983 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfxF6ut9nM9a9AcpKLO7IgCu-akAJ2YJGjrI9C8NUveA8uObV2XgQIQvsIxuWjvLl9meIEqpfGwZYr8MTX_PAGoiJsNUPXh5ERSce5cPYQYCCFPL0HtTb-E11C_2kfWy1wRps1tClRNvtj8zAqCGRhs1x-Uvl0zISdfHepXmvWX31Us Oct 27 03:36:15.922983 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:36:15.922983 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:36:15.922983 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:36:15.922983 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:36:15.922983 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:36:15.922983 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:36:15.922983 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 8bb5d291069d4329a90123e327fe9c59 Oct 27 03:36:15.922983 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:36:15.922983 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:36:15.922983 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:36:15.922983 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8bb5d291069d4329a90123e327fe9c59"}]}] Oct 27 03:36:15.922983 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:36:15.922983 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 8bb5d291069d4329a90123e327fe9c59 Oct 27 03:36:15.922983 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:36:15.922983 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ServersNegativeTestJSON-4378389-project Oct 27 03:36:15.922983 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:36:15.922983 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:36:15.922983 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: f9c32b7626594ff888970c7f3227bb20 Oct 27 03:36:15.922983 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ServersNegativeTestJSON-4378389-project Oct 27 03:36:15.922983 n-d-862769-1 devstack@n-api.service[121000]: Oct 27 03:36:15.922983 n-d-862769-1 devstack@n-api.service[121000]: {"restore": {}} Oct 27 03:36:15.922983 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:36:15.922983 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 3d3f7636-e682-4a33-a6df-088eaf176b3a could not be found. Oct 27 03:36:15.922983 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '3d3f7636-e682-4a33-a6df-088eaf176b3a', 'body': {'restore': {}}} Oct 27 03:36:15.922983 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:36:15.922983 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:36:15.922983 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:36:15.922983 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:36:15.922983 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:36:15.922983 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:36:15.922983 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 03:36:15.922983 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 03:36:15.922983 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d3f7636-e682-4a33-a6df-088eaf176b3a could not be found. Oct 27 03:36:15.922983 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:36:15.922983 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:36:15.922983 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:36:15.922983 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:36:15.922983 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:36:15.922983 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:36:15.922983 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:36:15.922983 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:36:15.922983 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:36:15.922983 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:36:15.922983 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Oct 27 03:36:15.922983 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 27 03:36:15.922983 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:36:15.922983 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:36:15.922983 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d3f7636-e682-4a33-a6df-088eaf176b3a could not be found. Oct 27 03:36:15.922983 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:36:15.922983 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:36:15.922983 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:36:15.922983 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:36:15.922983 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:36:15.922983 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:36:15.928676 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:36:15.928676 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:36:15.928676 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d3f7636-e682-4a33-a6df-088eaf176b3a could not be found. Oct 27 03:36:15.928676 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:36:15.928676 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1fcf39a8-2c02-4efe-965b-65f24fc59ebf tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Returning 404 to user: Instance 3d3f7636-e682-4a33-a6df-088eaf176b3a could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:36:15.928676 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1fcf39a8-2c02-4efe-965b-65f24fc59ebf tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "POST /compute/v2.1/servers/3d3f7636-e682-4a33-a6df-088eaf176b3a/action" status: 404 len: 111 microversion: 2.1 time: 0.028041 Oct 27 03:36:15.928676 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1707/3661] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:36:15 2022] POST /compute/v2.1/servers/3d3f7636-e682-4a33-a6df-088eaf176b3a/action => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:36:15.933970 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c995ceab-13d1-4ee8-9a3e-0b54518d89ac tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:15.934762 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c995ceab-13d1-4ee8-9a3e-0b54518d89ac tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:15.945843 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c995ceab-13d1-4ee8-9a3e-0b54518d89ac tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:15.946515 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c995ceab-13d1-4ee8-9a3e-0b54518d89ac tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:15.947269 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c995ceab-13d1-4ee8-9a3e-0b54518d89ac tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:15.948208 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c995ceab-13d1-4ee8-9a3e-0b54518d89ac tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:15.949762 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c995ceab-13d1-4ee8-9a3e-0b54518d89ac tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:15.950474 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c995ceab-13d1-4ee8-9a3e-0b54518d89ac tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:16.045349 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ecefa252-c204-4ee1-8855-8883fbb8f9a9 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-523453782", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:36:16.149999 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-ecefa252-c204-4ee1-8855-8883fbb8f9a9 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] validate_networks() for [('ee40dc00-9956-4077-969f-dfdca68cbee6', None, None, None, None, None)] {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:36:16.321544 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c995ceab-13d1-4ee8-9a3e-0b54518d89ac tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:16.333305 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c995ceab-13d1-4ee8-9a3e-0b54518d89ac tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1505 microversion: 2.1 time: 0.403241 Oct 27 03:36:16.335942 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1955/3662] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:15 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1505 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:16.340843 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a9d9c85f-398f-4a58-9316-37c2477ee54f tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:16.341770 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a9d9c85f-398f-4a58-9316-37c2477ee54f tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] [instance: 8c8a2cbb-4acf-4a6b-b684-567617bb930d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:16.348309 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a9d9c85f-398f-4a58-9316-37c2477ee54f tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:16.349085 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a9d9c85f-398f-4a58-9316-37c2477ee54f tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:16.349738 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a9d9c85f-398f-4a58-9316-37c2477ee54f tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:16.352063 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a9d9c85f-398f-4a58-9316-37c2477ee54f tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:16.352792 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a9d9c85f-398f-4a58-9316-37c2477ee54f tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:16.353445 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a9d9c85f-398f-4a58-9316-37c2477ee54f tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:16.745353 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a9d9c85f-398f-4a58-9316-37c2477ee54f tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:16.759669 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a9d9c85f-398f-4a58-9316-37c2477ee54f tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:16.766155 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a9d9c85f-398f-4a58-9316-37c2477ee54f tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:16.770682 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a9d9c85f-398f-4a58-9316-37c2477ee54f tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d" status: 200 len: 1878 microversion: 2.42 time: 0.432915 Oct 27 03:36:16.771663 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1956/3663] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:36:16 2022] GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d => generated 1878 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:36:16.779065 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-82813e65-78c9-45cb-b988-56130b23e449 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:16.783924 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-82813e65-78c9-45cb-b988-56130b23e449 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:16.803086 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-82813e65-78c9-45cb-b988-56130b23e449 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:16.804626 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-82813e65-78c9-45cb-b988-56130b23e449 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:16.806575 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-82813e65-78c9-45cb-b988-56130b23e449 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:16.808879 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-82813e65-78c9-45cb-b988-56130b23e449 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:16.811344 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-82813e65-78c9-45cb-b988-56130b23e449 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:16.814579 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-82813e65-78c9-45cb-b988-56130b23e449 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:17.123778 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-82813e65-78c9-45cb-b988-56130b23e449 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:17.142159 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-82813e65-78c9-45cb-b988-56130b23e449 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1505 microversion: 2.1 time: 0.367962 Oct 27 03:36:17.142943 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1957/3664] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:16 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1505 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:17.160617 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-010d8795-7158-486d-a243-458abd1d638a tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7dd9d161f0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:17.243317 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-010d8795-7158-486d-a243-458abd1d638a tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images/81186aa0-7ea8-487e-9c34-69f89a3830e6" status: 200 len: 1454 microversion: 2.1 time: 0.098343 Oct 27 03:36:17.244260 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1958/3665] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:36:17 2022] GET /compute/v2.1/images/81186aa0-7ea8-487e-9c34-69f89a3830e6 => generated 1454 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:17.250418 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0f0ec4f3-107e-40a8-bda5-4b74262667fc tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:36:17.251555 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0f0ec4f3-107e-40a8-bda5-4b74262667fc tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:17.258710 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0f0ec4f3-107e-40a8-bda5-4b74262667fc tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:17.259568 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0f0ec4f3-107e-40a8-bda5-4b74262667fc tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:17.260387 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0f0ec4f3-107e-40a8-bda5-4b74262667fc tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:17.261736 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0f0ec4f3-107e-40a8-bda5-4b74262667fc tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:17.262504 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0f0ec4f3-107e-40a8-bda5-4b74262667fc tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:17.263261 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0f0ec4f3-107e-40a8-bda5-4b74262667fc tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:17.303082 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-0f0ec4f3-107e-40a8-bda5-4b74262667fc tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] HTTP exception thrown: Cannot 'restore' instance 376ac459-e31f-4727-9e34-535f055ac20d while it is in vm_state active Oct 27 03:36:17.305368 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0f0ec4f3-107e-40a8-bda5-4b74262667fc tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Request method failure captured: Oct 27 03:36:17.305368 n-d-862769-1 devstack@n-api.service[121001]: request: POST /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d/action HTTP/1.1 Oct 27 03:36:17.305368 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:36:17.305368 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:36:17.305368 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:36:17.305368 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 15 Oct 27 03:36:17.305368 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:36:17.305368 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:36:17.305368 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:36:17.305368 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:36:17.305368 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfxF6ut9nM9a9AcpKLO7IgCu-akAJ2YJGjrI9C8NUveA8uObV2XgQIQvsIxuWjvLl9meIEqpfGwZYr8MTX_PAGoiJsNUPXh5ERSce5cPYQYCCFPL0HtTb-E11C_2kfWy1wRps1tClRNvtj8zAqCGRhs1x-Uvl0zISdfHepXmvWX31Us Oct 27 03:36:17.305368 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:36:17.305368 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:36:17.305368 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:36:17.305368 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:36:17.305368 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:36:17.305368 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:36:17.305368 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 8bb5d291069d4329a90123e327fe9c59 Oct 27 03:36:17.305368 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:36:17.305368 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:36:17.305368 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:36:17.305368 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8bb5d291069d4329a90123e327fe9c59"}]}] Oct 27 03:36:17.305368 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:36:17.305368 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 8bb5d291069d4329a90123e327fe9c59 Oct 27 03:36:17.305368 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:36:17.305368 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServersNegativeTestJSON-4378389-project Oct 27 03:36:17.305368 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:36:17.305368 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:36:17.305368 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: f9c32b7626594ff888970c7f3227bb20 Oct 27 03:36:17.305368 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServersNegativeTestJSON-4378389-project Oct 27 03:36:17.305368 n-d-862769-1 devstack@n-api.service[121001]: Oct 27 03:36:17.305368 n-d-862769-1 devstack@n-api.service[121001]: {"restore": {}} Oct 27 03:36:17.305368 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:36:17.305368 n-d-862769-1 devstack@n-api.service[121001]: exception: Cannot 'restore' instance 376ac459-e31f-4727-9e34-535f055ac20d while it is in vm_state active Oct 27 03:36:17.305368 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '376ac459-e31f-4727-9e34-535f055ac20d', 'body': {'restore': {}}} Oct 27 03:36:17.305368 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:36:17.305368 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:36:17.305368 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Oct 27 03:36:17.305368 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Oct 27 03:36:17.305368 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 03:36:17.305368 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 03:36:17.305368 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 27 03:36:17.305368 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 27 03:36:17.305368 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 376ac459-e31f-4727-9e34-535f055ac20d in vm_state active. Cannot restore while the instance is in this state. Oct 27 03:36:17.305368 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:17.305368 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:36:17.305368 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:17.305368 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:36:17.305368 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:36:17.305368 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:36:17.305368 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:36:17.305368 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:36:17.305368 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:36:17.305368 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:36:17.305368 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Oct 27 03:36:17.305368 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 27 03:36:17.305368 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 27 03:36:17.305368 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 27 03:36:17.305368 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 376ac459-e31f-4727-9e34-535f055ac20d while it is in vm_state active Oct 27 03:36:17.305368 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:17.305368 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:36:17.305368 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:17.305368 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:36:17.305368 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:36:17.333606 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:36:17.333606 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:36:17.333606 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:36:17.333606 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 376ac459-e31f-4727-9e34-535f055ac20d while it is in vm_state active Oct 27 03:36:17.333606 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:17.333606 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0f0ec4f3-107e-40a8-bda5-4b74262667fc tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Returning 409 to user: Cannot 'restore' instance 376ac459-e31f-4727-9e34-535f055ac20d while it is in vm_state active {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:36:17.333606 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0f0ec4f3-107e-40a8-bda5-4b74262667fc tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "POST /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d/action" status: 409 len: 145 microversion: 2.1 time: 0.063297 Oct 27 03:36:17.333606 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1959/3666] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:36:17 2022] POST /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d/action => generated 145 bytes in 66 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 27 03:36:17.347621 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d69471ee-15a8-423c-9e39-acfca68da91a tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:17.350000 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d69471ee-15a8-423c-9e39-acfca68da91a tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:17.358829 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d69471ee-15a8-423c-9e39-acfca68da91a tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:17.360306 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d69471ee-15a8-423c-9e39-acfca68da91a tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:17.360960 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d69471ee-15a8-423c-9e39-acfca68da91a tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:17.362548 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d69471ee-15a8-423c-9e39-acfca68da91a tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:17.363184 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d69471ee-15a8-423c-9e39-acfca68da91a tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:17.363779 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d69471ee-15a8-423c-9e39-acfca68da91a tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:17.611078 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d69471ee-15a8-423c-9e39-acfca68da91a tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:17.622408 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d69471ee-15a8-423c-9e39-acfca68da91a tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1505 microversion: 2.1 time: 0.283271 Oct 27 03:36:17.627212 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1960/3667] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:17 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1505 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:17.657625 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6e890f53-1280-48c7-90e3-0c8f2e7a7d6e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:17.658282 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-6e890f53-1280-48c7-90e3-0c8f2e7a7d6e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:17.676029 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6e890f53-1280-48c7-90e3-0c8f2e7a7d6e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:17.676449 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6e890f53-1280-48c7-90e3-0c8f2e7a7d6e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:17.676912 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6e890f53-1280-48c7-90e3-0c8f2e7a7d6e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:17.680542 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6e890f53-1280-48c7-90e3-0c8f2e7a7d6e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:17.681024 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6e890f53-1280-48c7-90e3-0c8f2e7a7d6e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:17.681463 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6e890f53-1280-48c7-90e3-0c8f2e7a7d6e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:17.828213 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-ecefa252-c204-4ee1-8855-8883fbb8f9a9 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:36:17.829581 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-ecefa252-c204-4ee1-8855-8883fbb8f9a9 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:36:17.830310 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-ecefa252-c204-4ee1-8855-8883fbb8f9a9 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:36:17.830913 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-ecefa252-c204-4ee1-8855-8883fbb8f9a9 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:36:17.831546 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-ecefa252-c204-4ee1-8855-8883fbb8f9a9 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:36:17.851078 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:36:17.860817 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ecefa252-c204-4ee1-8855-8883fbb8f9a9 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:17.867670 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ecefa252-c204-4ee1-8855-8883fbb8f9a9 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:17.867670 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ecefa252-c204-4ee1-8855-8883fbb8f9a9 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:17.867670 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ecefa252-c204-4ee1-8855-8883fbb8f9a9 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:17.867670 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ecefa252-c204-4ee1-8855-8883fbb8f9a9 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:17.867670 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ecefa252-c204-4ee1-8855-8883fbb8f9a9 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:17.914585 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-ecefa252-c204-4ee1-8855-8883fbb8f9a9 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Getting quotas for project 2e58f30136ed4a4d9bff48e9b4cde5a8. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:36:17.930239 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-ecefa252-c204-4ee1-8855-8883fbb8f9a9 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Getting quotas for user 5c36bef85ac34b4983a79e03c56965c5 and project 2e58f30136ed4a4d9bff48e9b4cde5a8. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:36:17.970701 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6e890f53-1280-48c7-90e3-0c8f2e7a7d6e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:17.979493 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ecefa252-c204-4ee1-8855-8883fbb8f9a9 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:36:17.981044 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6e890f53-1280-48c7-90e3-0c8f2e7a7d6e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1505 microversion: 2.1 time: 0.330105 Oct 27 03:36:17.983625 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ecefa252-c204-4ee1-8855-8883fbb8f9a9 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] [instance: 96c8ef8e-9790-4cd5-9a62-a6778b7bf02c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:36:17.984369 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1961/3668] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:17 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1505 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:36:18.004177 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-aca179e7-522c-4205-a603-e9d75ca8d59e tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:18.005058 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-aca179e7-522c-4205-a603-e9d75ca8d59e tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] [instance: 8c8a2cbb-4acf-4a6b-b684-567617bb930d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:18.023715 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aca179e7-522c-4205-a603-e9d75ca8d59e tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:18.026924 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aca179e7-522c-4205-a603-e9d75ca8d59e tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:18.030182 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aca179e7-522c-4205-a603-e9d75ca8d59e tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:18.033300 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aca179e7-522c-4205-a603-e9d75ca8d59e tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:18.033981 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aca179e7-522c-4205-a603-e9d75ca8d59e tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:18.034713 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aca179e7-522c-4205-a603-e9d75ca8d59e tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:18.179374 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ecefa252-c204-4ee1-8855-8883fbb8f9a9 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.138415 Oct 27 03:36:18.181303 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1708/3669] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:36:16 2022] POST /compute/v2.1/servers => generated 383 bytes in 2141 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 03:36:18.189101 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-c56f630c-9994-4448-9dbf-639a68824ad9 req-37350535-38a3-4932-b1b0-58d570738174 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5c50ae8-6217-4650-8420-291847e21ace", "tag": "72613a85-f4ba-4f66-8e4c-034d84cc97e5"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:36:18.208543 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-c56f630c-9994-4448-9dbf-639a68824ad9 req-37350535-38a3-4932-b1b0-58d570738174 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:18.209320 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-c56f630c-9994-4448-9dbf-639a68824ad9 req-37350535-38a3-4932-b1b0-58d570738174 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:18.209951 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-c56f630c-9994-4448-9dbf-639a68824ad9 req-37350535-38a3-4932-b1b0-58d570738174 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:18.258487 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-c56f630c-9994-4448-9dbf-639a68824ad9 req-37350535-38a3-4932-b1b0-58d570738174 service nova] Creating event network-changed:72613a85-f4ba-4f66-8e4c-034d84cc97e5 for instance c5c50ae8-6217-4650-8420-291847e21ace on n-h1-862769-1 Oct 27 03:36:18.276614 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-c56f630c-9994-4448-9dbf-639a68824ad9 req-37350535-38a3-4932-b1b0-58d570738174 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090839 Oct 27 03:36:18.279475 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1709/3670] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:36:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:36:18.304605 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8ebd8799-03b0-4e9f-893f-4f3fe59ce092 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:36:18.307482 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8ebd8799-03b0-4e9f-893f-4f3fe59ce092 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 1d1f1fc9-c77b-4781-95bc-3fc7d06bcc88] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:18.318050 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-8ebd8799-03b0-4e9f-893f-4f3fe59ce092 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] HTTP exception thrown: Instance 1d1f1fc9-c77b-4781-95bc-3fc7d06bcc88 could not be found. Oct 27 03:36:18.340989 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8ebd8799-03b0-4e9f-893f-4f3fe59ce092 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Request method failure captured: Oct 27 03:36:18.340989 n-d-862769-1 devstack@n-api.service[121000]: request: POST /compute/v2.1/servers/1d1f1fc9-c77b-4781-95bc-3fc7d06bcc88/action HTTP/1.1 Oct 27 03:36:18.340989 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:36:18.340989 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:36:18.340989 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:36:18.340989 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 14 Oct 27 03:36:18.340989 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:36:18.340989 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:36:18.340989 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:36:18.340989 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:36:18.340989 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfxF6ut9nM9a9AcpKLO7IgCu-akAJ2YJGjrI9C8NUveA8uObV2XgQIQvsIxuWjvLl9meIEqpfGwZYr8MTX_PAGoiJsNUPXh5ERSce5cPYQYCCFPL0HtTb-E11C_2kfWy1wRps1tClRNvtj8zAqCGRhs1x-Uvl0zISdfHepXmvWX31Us Oct 27 03:36:18.340989 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:36:18.340989 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:36:18.340989 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:36:18.340989 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:36:18.340989 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:36:18.340989 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:36:18.340989 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 8bb5d291069d4329a90123e327fe9c59 Oct 27 03:36:18.340989 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:36:18.340989 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:36:18.340989 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:36:18.340989 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8bb5d291069d4329a90123e327fe9c59"}]}] Oct 27 03:36:18.340989 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:36:18.340989 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 8bb5d291069d4329a90123e327fe9c59 Oct 27 03:36:18.340989 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:36:18.340989 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ServersNegativeTestJSON-4378389-project Oct 27 03:36:18.340989 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:36:18.340989 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:36:18.340989 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: f9c32b7626594ff888970c7f3227bb20 Oct 27 03:36:18.340989 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ServersNegativeTestJSON-4378389-project Oct 27 03:36:18.340989 n-d-862769-1 devstack@n-api.service[121000]: Oct 27 03:36:18.340989 n-d-862769-1 devstack@n-api.service[121000]: {"resume": {}} Oct 27 03:36:18.340989 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:36:18.340989 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 1d1f1fc9-c77b-4781-95bc-3fc7d06bcc88 could not be found. Oct 27 03:36:18.340989 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '1d1f1fc9-c77b-4781-95bc-3fc7d06bcc88', 'body': {'resume': {}}} Oct 27 03:36:18.340989 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:36:18.340989 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:36:18.340989 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:36:18.340989 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:36:18.340989 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:36:18.340989 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:36:18.340989 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 03:36:18.340989 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 03:36:18.340989 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d1f1fc9-c77b-4781-95bc-3fc7d06bcc88 could not be found. Oct 27 03:36:18.340989 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:36:18.340989 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:36:18.340989 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:36:18.340989 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:36:18.340989 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:36:18.340989 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:36:18.340989 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:36:18.340989 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:36:18.340989 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:36:18.340989 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:36:18.340989 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Oct 27 03:36:18.340989 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 27 03:36:18.340989 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:36:18.340989 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:36:18.340989 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d1f1fc9-c77b-4781-95bc-3fc7d06bcc88 could not be found. Oct 27 03:36:18.340989 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:36:18.340989 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:36:18.340989 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:36:18.340989 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:36:18.340989 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:36:18.340989 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:36:18.346647 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:36:18.346647 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:36:18.346647 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d1f1fc9-c77b-4781-95bc-3fc7d06bcc88 could not be found. Oct 27 03:36:18.346647 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:36:18.351943 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8ebd8799-03b0-4e9f-893f-4f3fe59ce092 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Returning 404 to user: Instance 1d1f1fc9-c77b-4781-95bc-3fc7d06bcc88 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:36:18.353044 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8ebd8799-03b0-4e9f-893f-4f3fe59ce092 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "POST /compute/v2.1/servers/1d1f1fc9-c77b-4781-95bc-3fc7d06bcc88/action" status: 404 len: 111 microversion: 2.1 time: 0.070485 Oct 27 03:36:18.355893 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1710/3671] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:36:18 2022] POST /compute/v2.1/servers/1d1f1fc9-c77b-4781-95bc-3fc7d06bcc88/action => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:36:18.364329 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b28799e4-7b6d-45c0-b4ce-b92b1a3bd15f tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:18.368596 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b28799e4-7b6d-45c0-b4ce-b92b1a3bd15f tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] [instance: 96c8ef8e-9790-4cd5-9a62-a6778b7bf02c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:18.507241 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b28799e4-7b6d-45c0-b4ce-b92b1a3bd15f tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c36bef85ac34b4983a79e03c56965c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e58f30136ed4a4d9bff48e9b4cde5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:18.515332 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b28799e4-7b6d-45c0-b4ce-b92b1a3bd15f tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] 10.222.0.20 "GET /compute/v2.1/servers/96c8ef8e-9790-4cd5-9a62-a6778b7bf02c" status: 200 len: 1224 microversion: 2.1 time: 0.158113 Oct 27 03:36:18.527059 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=4 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:36:18.527675 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1711/3672] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:18 2022] GET /compute/v2.1/servers/96c8ef8e-9790-4cd5-9a62-a6778b7bf02c => generated 1224 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:18.540957 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-178adcc5-334e-4feb-af25-0753c6dcb684 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7ddee32e50>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:18.567640 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-aca179e7-522c-4205-a603-e9d75ca8d59e tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:18.581992 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-aca179e7-522c-4205-a603-e9d75ca8d59e tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:18.590006 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-aca179e7-522c-4205-a603-e9d75ca8d59e tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:18.591267 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-aca179e7-522c-4205-a603-e9d75ca8d59e tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d" status: 200 len: 1878 microversion: 2.42 time: 0.605941 Oct 27 03:36:18.592381 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1962/3673] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:36:17 2022] GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d => generated 1878 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:36:18.606460 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-202190ba-bec6-4052-9783-7129f7d8f3d8 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:18.607591 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-202190ba-bec6-4052-9783-7129f7d8f3d8 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:18.624401 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-202190ba-bec6-4052-9783-7129f7d8f3d8 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:18.627848 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-202190ba-bec6-4052-9783-7129f7d8f3d8 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:18.628499 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-202190ba-bec6-4052-9783-7129f7d8f3d8 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:18.629394 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-202190ba-bec6-4052-9783-7129f7d8f3d8 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:18.630831 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-202190ba-bec6-4052-9783-7129f7d8f3d8 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:18.638786 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-202190ba-bec6-4052-9783-7129f7d8f3d8 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:18.652318 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-178adcc5-334e-4feb-af25-0753c6dcb684 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images/81186aa0-7ea8-487e-9c34-69f89a3830e6" status: 200 len: 1454 microversion: 2.1 time: 0.123489 Oct 27 03:36:18.653499 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1712/3674] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:36:18 2022] GET /compute/v2.1/images/81186aa0-7ea8-487e-9c34-69f89a3830e6 => generated 1454 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:19.228748 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-202190ba-bec6-4052-9783-7129f7d8f3d8 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:19.231197 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=100 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:36:19.238431 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-202190ba-bec6-4052-9783-7129f7d8f3d8 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1505 microversion: 2.1 time: 0.644795 Oct 27 03:36:19.264933 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1963/3675] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:18 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1505 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:19.270421 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9e9f130b-d715-46d7-90e5-208ddc87a9d6 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:19.271674 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9e9f130b-d715-46d7-90e5-208ddc87a9d6 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:19.283656 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9e9f130b-d715-46d7-90e5-208ddc87a9d6 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:19.285490 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9e9f130b-d715-46d7-90e5-208ddc87a9d6 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:19.285490 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9e9f130b-d715-46d7-90e5-208ddc87a9d6 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:19.285490 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9e9f130b-d715-46d7-90e5-208ddc87a9d6 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:19.288705 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9e9f130b-d715-46d7-90e5-208ddc87a9d6 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:19.289160 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9e9f130b-d715-46d7-90e5-208ddc87a9d6 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:19.543370 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b6ab3aa5-3c72-4ef4-8d88-03e72b68f740 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:19.543992 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b6ab3aa5-3c72-4ef4-8d88-03e72b68f740 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] [instance: 96c8ef8e-9790-4cd5-9a62-a6778b7bf02c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:19.561976 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b6ab3aa5-3c72-4ef4-8d88-03e72b68f740 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:19.563389 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b6ab3aa5-3c72-4ef4-8d88-03e72b68f740 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:19.563611 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b6ab3aa5-3c72-4ef4-8d88-03e72b68f740 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:19.564698 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b6ab3aa5-3c72-4ef4-8d88-03e72b68f740 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:19.567338 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b6ab3aa5-3c72-4ef4-8d88-03e72b68f740 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:19.574109 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b6ab3aa5-3c72-4ef4-8d88-03e72b68f740 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:19.667970 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9e9f130b-d715-46d7-90e5-208ddc87a9d6 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:19.680933 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9e9f130b-d715-46d7-90e5-208ddc87a9d6 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1505 microversion: 2.1 time: 0.414093 Oct 27 03:36:19.697836 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1713/3676] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:19 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1505 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:19.704855 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b6ab3aa5-3c72-4ef4-8d88-03e72b68f740 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c36bef85ac34b4983a79e03c56965c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e58f30136ed4a4d9bff48e9b4cde5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:19.711591 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f1acd3d5-e75f-4981-8339-dc71013958b3 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:19.713855 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f1acd3d5-e75f-4981-8339-dc71013958b3 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] [instance: 8c8a2cbb-4acf-4a6b-b684-567617bb930d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:19.720225 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b6ab3aa5-3c72-4ef4-8d88-03e72b68f740 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] 10.222.0.20 "GET /compute/v2.1/servers/96c8ef8e-9790-4cd5-9a62-a6778b7bf02c" status: 200 len: 1228 microversion: 2.1 time: 0.182769 Oct 27 03:36:19.721280 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1964/3677] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:19 2022] GET /compute/v2.1/servers/96c8ef8e-9790-4cd5-9a62-a6778b7bf02c => generated 1228 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:19.739194 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b5fa1f2b-2751-4407-be37-41f7e968afe7 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7dd9d0bf70>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:19.742994 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f1acd3d5-e75f-4981-8339-dc71013958b3 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:19.744769 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f1acd3d5-e75f-4981-8339-dc71013958b3 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:19.746328 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f1acd3d5-e75f-4981-8339-dc71013958b3 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:19.747151 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f1acd3d5-e75f-4981-8339-dc71013958b3 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:19.748898 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f1acd3d5-e75f-4981-8339-dc71013958b3 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:19.749428 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f1acd3d5-e75f-4981-8339-dc71013958b3 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:19.836795 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b5fa1f2b-2751-4407-be37-41f7e968afe7 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images/81186aa0-7ea8-487e-9c34-69f89a3830e6" status: 200 len: 1454 microversion: 2.1 time: 0.114249 Oct 27 03:36:19.844853 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1965/3678] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:36:19 2022] GET /compute/v2.1/images/81186aa0-7ea8-487e-9c34-69f89a3830e6 => generated 1454 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:19.861340 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ad447644-10db-4827-8299-b1cbd4007212 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:36:19.865423 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ad447644-10db-4827-8299-b1cbd4007212 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:19.877500 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ad447644-10db-4827-8299-b1cbd4007212 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:19.881921 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ad447644-10db-4827-8299-b1cbd4007212 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:19.883571 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ad447644-10db-4827-8299-b1cbd4007212 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:19.886342 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ad447644-10db-4827-8299-b1cbd4007212 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:19.889470 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ad447644-10db-4827-8299-b1cbd4007212 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:19.893164 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ad447644-10db-4827-8299-b1cbd4007212 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:19.956413 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-ad447644-10db-4827-8299-b1cbd4007212 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] HTTP exception thrown: Cannot 'resume' instance 376ac459-e31f-4727-9e34-535f055ac20d while it is in vm_state active Oct 27 03:36:19.963197 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ad447644-10db-4827-8299-b1cbd4007212 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Request method failure captured: Oct 27 03:36:19.963197 n-d-862769-1 devstack@n-api.service[121001]: request: POST /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d/action HTTP/1.1 Oct 27 03:36:19.963197 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:36:19.963197 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:36:19.963197 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:36:19.963197 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 14 Oct 27 03:36:19.963197 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:36:19.963197 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:36:19.963197 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:36:19.963197 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:36:19.963197 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfxF6ut9nM9a9AcpKLO7IgCu-akAJ2YJGjrI9C8NUveA8uObV2XgQIQvsIxuWjvLl9meIEqpfGwZYr8MTX_PAGoiJsNUPXh5ERSce5cPYQYCCFPL0HtTb-E11C_2kfWy1wRps1tClRNvtj8zAqCGRhs1x-Uvl0zISdfHepXmvWX31Us Oct 27 03:36:19.963197 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:36:19.963197 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:36:19.963197 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:36:19.963197 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:36:19.963197 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:36:19.963197 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:36:19.963197 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 8bb5d291069d4329a90123e327fe9c59 Oct 27 03:36:19.963197 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:36:19.963197 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:36:19.963197 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:36:19.963197 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8bb5d291069d4329a90123e327fe9c59"}]}] Oct 27 03:36:19.963197 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:36:19.963197 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 8bb5d291069d4329a90123e327fe9c59 Oct 27 03:36:19.963197 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:36:19.963197 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServersNegativeTestJSON-4378389-project Oct 27 03:36:19.963197 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:36:19.963197 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:36:19.963197 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: f9c32b7626594ff888970c7f3227bb20 Oct 27 03:36:19.963197 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServersNegativeTestJSON-4378389-project Oct 27 03:36:19.963197 n-d-862769-1 devstack@n-api.service[121001]: Oct 27 03:36:19.963197 n-d-862769-1 devstack@n-api.service[121001]: {"resume": {}} Oct 27 03:36:19.963197 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:36:19.963197 n-d-862769-1 devstack@n-api.service[121001]: exception: Cannot 'resume' instance 376ac459-e31f-4727-9e34-535f055ac20d while it is in vm_state active Oct 27 03:36:19.963197 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '376ac459-e31f-4727-9e34-535f055ac20d', 'body': {'resume': {}}} Oct 27 03:36:19.963197 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:36:19.963197 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:36:19.963197 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Oct 27 03:36:19.963197 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Oct 27 03:36:19.963197 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 03:36:19.963197 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 03:36:19.963197 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 27 03:36:19.963197 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 27 03:36:19.963197 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 27 03:36:19.963197 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 27 03:36:19.963197 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 376ac459-e31f-4727-9e34-535f055ac20d in vm_state active. Cannot resume while the instance is in this state. Oct 27 03:36:19.963197 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:19.963197 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:36:19.963197 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:19.963197 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:36:19.963197 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:36:19.963197 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:36:19.963197 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:36:19.963197 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:36:19.963197 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:36:19.963197 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:36:19.963197 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Oct 27 03:36:19.963197 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 27 03:36:19.963197 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 27 03:36:19.963197 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 27 03:36:19.963197 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 376ac459-e31f-4727-9e34-535f055ac20d while it is in vm_state active Oct 27 03:36:19.963197 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:19.963197 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:36:19.963197 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:19.970425 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:36:19.970425 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:36:19.970425 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:36:19.970425 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:36:19.970425 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:36:19.970425 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 376ac459-e31f-4727-9e34-535f055ac20d while it is in vm_state active Oct 27 03:36:19.970425 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:19.970425 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ad447644-10db-4827-8299-b1cbd4007212 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Returning 409 to user: Cannot 'resume' instance 376ac459-e31f-4727-9e34-535f055ac20d while it is in vm_state active {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:36:19.970425 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ad447644-10db-4827-8299-b1cbd4007212 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "POST /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d/action" status: 409 len: 144 microversion: 2.1 time: 0.117625 Oct 27 03:36:19.970425 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1966/3679] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:36:19 2022] POST /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d/action => generated 144 bytes in 125 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 27 03:36:19.979300 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-baeaa73b-75ad-4f02-a3a3-7d3cb3a92b61 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:19.979967 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-baeaa73b-75ad-4f02-a3a3-7d3cb3a92b61 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:19.996056 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-baeaa73b-75ad-4f02-a3a3-7d3cb3a92b61 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:19.998843 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-baeaa73b-75ad-4f02-a3a3-7d3cb3a92b61 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:19.999197 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-baeaa73b-75ad-4f02-a3a3-7d3cb3a92b61 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:20.000108 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-baeaa73b-75ad-4f02-a3a3-7d3cb3a92b61 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:20.002800 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-baeaa73b-75ad-4f02-a3a3-7d3cb3a92b61 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:20.003211 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-baeaa73b-75ad-4f02-a3a3-7d3cb3a92b61 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:20.287995 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-baeaa73b-75ad-4f02-a3a3-7d3cb3a92b61 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:20.299393 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-baeaa73b-75ad-4f02-a3a3-7d3cb3a92b61 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1505 microversion: 2.1 time: 0.326121 Oct 27 03:36:20.301013 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1967/3680] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:19 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1505 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:20.334979 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d13183d4-1684-4199-b06e-62067908fbda tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:20.335631 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d13183d4-1684-4199-b06e-62067908fbda tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:20.338192 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f1acd3d5-e75f-4981-8339-dc71013958b3 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:20.365892 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d13183d4-1684-4199-b06e-62067908fbda tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:20.366927 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d13183d4-1684-4199-b06e-62067908fbda tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:20.367599 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d13183d4-1684-4199-b06e-62067908fbda tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:20.371288 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d13183d4-1684-4199-b06e-62067908fbda tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:20.372310 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d13183d4-1684-4199-b06e-62067908fbda tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:20.374201 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d13183d4-1684-4199-b06e-62067908fbda tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:20.377029 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f1acd3d5-e75f-4981-8339-dc71013958b3 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:20.387448 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f1acd3d5-e75f-4981-8339-dc71013958b3 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:20.393798 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f1acd3d5-e75f-4981-8339-dc71013958b3 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d" status: 200 len: 1878 microversion: 2.42 time: 0.690274 Oct 27 03:36:20.394731 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1714/3681] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:36:19 2022] GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d => generated 1878 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:36:20.659053 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d13183d4-1684-4199-b06e-62067908fbda tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:20.672686 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d13183d4-1684-4199-b06e-62067908fbda tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1505 microversion: 2.1 time: 0.350283 Oct 27 03:36:20.673268 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1968/3682] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:20 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1505 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:20.748188 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-049cb01e-b7b7-435e-b5bb-03c40f19404d tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:20.748830 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-049cb01e-b7b7-435e-b5bb-03c40f19404d tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] [instance: 96c8ef8e-9790-4cd5-9a62-a6778b7bf02c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:20.764992 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-049cb01e-b7b7-435e-b5bb-03c40f19404d tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:20.768435 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-049cb01e-b7b7-435e-b5bb-03c40f19404d tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:20.769916 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-049cb01e-b7b7-435e-b5bb-03c40f19404d tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:20.772130 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-049cb01e-b7b7-435e-b5bb-03c40f19404d tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:20.772915 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-049cb01e-b7b7-435e-b5bb-03c40f19404d tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:20.782248 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-049cb01e-b7b7-435e-b5bb-03c40f19404d tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:20.858885 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-392b21a6-4f7b-451c-af19-3ab70ec34709 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7dd9d55430>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:20.993464 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-392b21a6-4f7b-451c-af19-3ab70ec34709 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images/81186aa0-7ea8-487e-9c34-69f89a3830e6" status: 200 len: 1454 microversion: 2.1 time: 0.137672 Oct 27 03:36:20.994713 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1969/3683] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:36:20 2022] GET /compute/v2.1/images/81186aa0-7ea8-487e-9c34-69f89a3830e6 => generated 1454 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:36:21.012012 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-937e451c-8029-44cc-9fad-66820f39e815 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": [{"uuid": "0f1ea857-e60a-4a6e-a6c9-70bfd2dd2db8"}]}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:36:21.024624 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-937e451c-8029-44cc-9fad-66820f39e815 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Request method failure captured: Oct 27 03:36:21.024624 n-d-862769-1 devstack@n-api.service[121001]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 03:36:21.024624 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:36:21.024624 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:36:21.024624 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:36:21.024624 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 160 Oct 27 03:36:21.024624 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:36:21.024624 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:36:21.024624 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:36:21.024624 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:36:21.024624 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfxF6ut9nM9a9AcpKLO7IgCu-akAJ2YJGjrI9C8NUveA8uObV2XgQIQvsIxuWjvLl9meIEqpfGwZYr8MTX_PAGoiJsNUPXh5ERSce5cPYQYCCFPL0HtTb-E11C_2kfWy1wRps1tClRNvtj8zAqCGRhs1x-Uvl0zISdfHepXmvWX31Us Oct 27 03:36:21.024624 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:36:21.024624 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:36:21.024624 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:36:21.024624 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:36:21.024624 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:36:21.024624 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:36:21.024624 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 8bb5d291069d4329a90123e327fe9c59 Oct 27 03:36:21.024624 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:36:21.024624 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:36:21.024624 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:36:21.024624 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8bb5d291069d4329a90123e327fe9c59"}]}] Oct 27 03:36:21.024624 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:36:21.024624 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 8bb5d291069d4329a90123e327fe9c59 Oct 27 03:36:21.024624 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:36:21.024624 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServersNegativeTestJSON-4378389-project Oct 27 03:36:21.024624 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:36:21.024624 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:36:21.024624 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: f9c32b7626594ff888970c7f3227bb20 Oct 27 03:36:21.024624 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServersNegativeTestJSON-4378389-project Oct 27 03:36:21.024624 n-d-862769-1 devstack@n-api.service[121001]: Oct 27 03:36:21.024624 n-d-862769-1 devstack@n-api.service[121001]: {"server": {"name": "", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": [{"uuid": "0f1ea857-e60a-4a6e-a6c9-70bfd2dd2db8"}]}} Oct 27 03:36:21.024624 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:36:21.024624 n-d-862769-1 devstack@n-api.service[121001]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 27 03:36:21.024624 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'body': {'server': {'name': '', 'imageRef': 'c40fb871-5877-4b59-ab69-d9fd23b7a917', 'flavorRef': '452', 'networks': [{'uuid': '0f1ea857-e60a-4a6e-a6c9-70bfd2dd2db8'}]}}} Oct 27 03:36:21.024624 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:36:21.024624 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:36:21.024624 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 03:36:21.024624 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 03:36:21.024624 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 03:36:21.024624 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise error Oct 27 03:36:21.024624 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 27 03:36:21.024624 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:21.024624 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 27 03:36:21.024624 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 27 03:36:21.024624 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:21.024624 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 27 03:36:21.024624 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi '' Oct 27 03:36:21.024624 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:21.024624 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:36:21.024624 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:21.024624 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:36:21.024624 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:36:21.024624 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:36:21.024624 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:36:21.024624 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:36:21.024624 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:36:21.024624 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:36:21.024624 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:36:21.024624 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:36:21.024624 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 03:36:21.024624 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 03:36:21.024624 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 03:36:21.024624 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 03:36:21.024624 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 03:36:21.031008 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 03:36:21.031008 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 27 03:36:21.031008 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:21.031008 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:36:21.031008 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:21.031008 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:36:21.031008 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:36:21.031008 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:36:21.031008 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 03:36:21.031008 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 03:36:21.031008 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 27 03:36:21.031008 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:21.041967 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-937e451c-8029-44cc-9fad-66820f39e815 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:36:21.046015 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-937e451c-8029-44cc-9fad-66820f39e815 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.049283 Oct 27 03:36:21.048846 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1970/3684] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:36:20 2022] POST /compute/v2.1/servers => generated 108 bytes in 53 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 03:36:21.062586 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b7090288-ccce-45c2-b816-0721dd3d8729 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:21.063922 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b7090288-ccce-45c2-b816-0721dd3d8729 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:21.074649 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b7090288-ccce-45c2-b816-0721dd3d8729 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:21.075463 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b7090288-ccce-45c2-b816-0721dd3d8729 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:21.076119 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b7090288-ccce-45c2-b816-0721dd3d8729 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:21.077013 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b7090288-ccce-45c2-b816-0721dd3d8729 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:21.077653 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b7090288-ccce-45c2-b816-0721dd3d8729 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:21.078299 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b7090288-ccce-45c2-b816-0721dd3d8729 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:21.439902 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-049cb01e-b7b7-435e-b5bb-03c40f19404d tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c36bef85ac34b4983a79e03c56965c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e58f30136ed4a4d9bff48e9b4cde5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:21.452090 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-049cb01e-b7b7-435e-b5bb-03c40f19404d tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] 10.222.0.20 "GET /compute/v2.1/servers/96c8ef8e-9790-4cd5-9a62-a6778b7bf02c" status: 200 len: 1276 microversion: 2.1 time: 0.708614 Oct 27 03:36:21.454774 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1715/3685] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:20 2022] GET /compute/v2.1/servers/96c8ef8e-9790-4cd5-9a62-a6778b7bf02c => generated 1276 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:21.465860 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1c6d4ab9-989c-49fb-8b43-2c4a89aa9ba1 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:21.468931 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1c6d4ab9-989c-49fb-8b43-2c4a89aa9ba1 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] [instance: 8c8a2cbb-4acf-4a6b-b684-567617bb930d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:21.493025 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1c6d4ab9-989c-49fb-8b43-2c4a89aa9ba1 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:21.500732 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1c6d4ab9-989c-49fb-8b43-2c4a89aa9ba1 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:21.506213 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1c6d4ab9-989c-49fb-8b43-2c4a89aa9ba1 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:21.506213 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1c6d4ab9-989c-49fb-8b43-2c4a89aa9ba1 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:21.506213 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1c6d4ab9-989c-49fb-8b43-2c4a89aa9ba1 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:21.506213 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1c6d4ab9-989c-49fb-8b43-2c4a89aa9ba1 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:21.556996 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:36:21.985156 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1c6d4ab9-989c-49fb-8b43-2c4a89aa9ba1 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:21.996462 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1c6d4ab9-989c-49fb-8b43-2c4a89aa9ba1 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:21.998074 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1c6d4ab9-989c-49fb-8b43-2c4a89aa9ba1 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:22.005808 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1c6d4ab9-989c-49fb-8b43-2c4a89aa9ba1 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d" status: 200 len: 1878 microversion: 2.42 time: 0.546554 Oct 27 03:36:22.007507 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1716/3686] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:36:21 2022] GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d => generated 1878 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:36:22.018673 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3690bf59-f6a1-47cd-8f37-82ed4b197e97 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7ddec435e0>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:22.082810 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3690bf59-f6a1-47cd-8f37-82ed4b197e97 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images/81186aa0-7ea8-487e-9c34-69f89a3830e6" status: 200 len: 1454 microversion: 2.1 time: 0.074199 Oct 27 03:36:22.091767 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1717/3687] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:36:22 2022] GET /compute/v2.1/images/81186aa0-7ea8-487e-9c34-69f89a3830e6 => generated 1454 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:22.166998 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b7090288-ccce-45c2-b816-0721dd3d8729 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:22.183093 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b7090288-ccce-45c2-b816-0721dd3d8729 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1505 microversion: 2.1 time: 1.127612 Oct 27 03:36:22.187255 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1971/3688] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:21 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1505 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:22.211095 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5eecfdb8-0974-4081-bb52-ba575f5015a7 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:22.211968 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5eecfdb8-0974-4081-bb52-ba575f5015a7 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:22.218410 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5eecfdb8-0974-4081-bb52-ba575f5015a7 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:22.219240 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5eecfdb8-0974-4081-bb52-ba575f5015a7 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:22.219906 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5eecfdb8-0974-4081-bb52-ba575f5015a7 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:22.220852 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5eecfdb8-0974-4081-bb52-ba575f5015a7 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:22.221595 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5eecfdb8-0974-4081-bb52-ba575f5015a7 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:22.222297 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5eecfdb8-0974-4081-bb52-ba575f5015a7 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:22.386123 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5eecfdb8-0974-4081-bb52-ba575f5015a7 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:22.396276 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5eecfdb8-0974-4081-bb52-ba575f5015a7 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1505 microversion: 2.1 time: 0.189352 Oct 27 03:36:22.412043 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1718/3689] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:22 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1505 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:22.422613 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-96218f41-3691-4585-b124-d039792fe48d tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:36:22.423303 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-96218f41-3691-4585-b124-d039792fe48d tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: e8432a15-509f-42ce-aa03-424d1000b978] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:22.431020 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-96218f41-3691-4585-b124-d039792fe48d tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] HTTP exception thrown: Instance e8432a15-509f-42ce-aa03-424d1000b978 could not be found. Oct 27 03:36:22.434409 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-96218f41-3691-4585-b124-d039792fe48d tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Request method failure captured: Oct 27 03:36:22.434409 n-d-862769-1 devstack@n-api.service[121001]: request: POST /compute/v2.1/servers/e8432a15-509f-42ce-aa03-424d1000b978/action HTTP/1.1 Oct 27 03:36:22.434409 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:36:22.434409 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:36:22.434409 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:36:22.434409 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 14 Oct 27 03:36:22.434409 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:36:22.434409 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:36:22.434409 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:36:22.434409 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:36:22.434409 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfxF6ut9nM9a9AcpKLO7IgCu-akAJ2YJGjrI9C8NUveA8uObV2XgQIQvsIxuWjvLl9meIEqpfGwZYr8MTX_PAGoiJsNUPXh5ERSce5cPYQYCCFPL0HtTb-E11C_2kfWy1wRps1tClRNvtj8zAqCGRhs1x-Uvl0zISdfHepXmvWX31Us Oct 27 03:36:22.434409 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:36:22.434409 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:36:22.434409 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:36:22.434409 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:36:22.434409 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:36:22.434409 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:36:22.434409 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 8bb5d291069d4329a90123e327fe9c59 Oct 27 03:36:22.434409 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:36:22.434409 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:36:22.434409 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:36:22.434409 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8bb5d291069d4329a90123e327fe9c59"}]}] Oct 27 03:36:22.434409 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:36:22.434409 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 8bb5d291069d4329a90123e327fe9c59 Oct 27 03:36:22.434409 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:36:22.434409 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServersNegativeTestJSON-4378389-project Oct 27 03:36:22.434409 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:36:22.434409 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:36:22.434409 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: f9c32b7626594ff888970c7f3227bb20 Oct 27 03:36:22.434409 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServersNegativeTestJSON-4378389-project Oct 27 03:36:22.434409 n-d-862769-1 devstack@n-api.service[121001]: Oct 27 03:36:22.434409 n-d-862769-1 devstack@n-api.service[121001]: {"shelve": {}} Oct 27 03:36:22.434409 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:36:22.434409 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance e8432a15-509f-42ce-aa03-424d1000b978 could not be found. Oct 27 03:36:22.434409 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': 'e8432a15-509f-42ce-aa03-424d1000b978', 'body': {'shelve': {}}} Oct 27 03:36:22.434409 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:36:22.434409 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:36:22.434409 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:36:22.434409 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:36:22.434409 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:36:22.434409 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:36:22.434409 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 03:36:22.434409 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 03:36:22.434409 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8432a15-509f-42ce-aa03-424d1000b978 could not be found. Oct 27 03:36:22.434409 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:22.434409 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:36:22.434409 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:22.434409 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:36:22.434409 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:36:22.434409 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:36:22.434409 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:36:22.434409 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:36:22.434409 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:36:22.434409 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:36:22.434409 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Oct 27 03:36:22.434409 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 27 03:36:22.434409 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:36:22.434409 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:36:22.434409 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8432a15-509f-42ce-aa03-424d1000b978 could not be found. Oct 27 03:36:22.434409 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:22.434409 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:36:22.434409 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:22.434409 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:36:22.434409 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:36:22.434409 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:36:22.440109 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:36:22.440109 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:36:22.440109 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8432a15-509f-42ce-aa03-424d1000b978 could not be found. Oct 27 03:36:22.440109 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:22.441740 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-96218f41-3691-4585-b124-d039792fe48d tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Returning 404 to user: Instance e8432a15-509f-42ce-aa03-424d1000b978 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:36:22.443159 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-96218f41-3691-4585-b124-d039792fe48d tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "POST /compute/v2.1/servers/e8432a15-509f-42ce-aa03-424d1000b978/action" status: 404 len: 111 microversion: 2.1 time: 0.025666 Oct 27 03:36:22.453685 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d1927f25-38ce-4230-8851-7a0b9ed2b3ee tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:22.455068 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d1927f25-38ce-4230-8851-7a0b9ed2b3ee tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:22.458551 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1972/3690] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:36:22 2022] POST /compute/v2.1/servers/e8432a15-509f-42ce-aa03-424d1000b978/action => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:36:22.462662 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d1927f25-38ce-4230-8851-7a0b9ed2b3ee tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:22.463637 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d1927f25-38ce-4230-8851-7a0b9ed2b3ee tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:22.464354 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d1927f25-38ce-4230-8851-7a0b9ed2b3ee tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:22.465345 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d1927f25-38ce-4230-8851-7a0b9ed2b3ee tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:22.466088 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d1927f25-38ce-4230-8851-7a0b9ed2b3ee tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:22.466797 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d1927f25-38ce-4230-8851-7a0b9ed2b3ee tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:22.483328 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-84b3e407-d112-4e5d-b90a-7f5572531faa tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:22.484674 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-84b3e407-d112-4e5d-b90a-7f5572531faa tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] [instance: 96c8ef8e-9790-4cd5-9a62-a6778b7bf02c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:22.503760 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-84b3e407-d112-4e5d-b90a-7f5572531faa tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:22.506256 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-84b3e407-d112-4e5d-b90a-7f5572531faa tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:22.507017 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-84b3e407-d112-4e5d-b90a-7f5572531faa tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:22.508285 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-84b3e407-d112-4e5d-b90a-7f5572531faa tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:22.509078 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-84b3e407-d112-4e5d-b90a-7f5572531faa tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:22.512733 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-84b3e407-d112-4e5d-b90a-7f5572531faa tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:22.696005 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d1927f25-38ce-4230-8851-7a0b9ed2b3ee tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:22.707937 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d1927f25-38ce-4230-8851-7a0b9ed2b3ee tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1505 microversion: 2.1 time: 0.259242 Oct 27 03:36:22.708887 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1719/3691] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:22 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1505 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:22.735878 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-762088bb-2309-4b00-9ec6-3ef0cd494116 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:22.736913 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-762088bb-2309-4b00-9ec6-3ef0cd494116 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:22.743789 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-762088bb-2309-4b00-9ec6-3ef0cd494116 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:22.744820 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-762088bb-2309-4b00-9ec6-3ef0cd494116 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:22.745518 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-762088bb-2309-4b00-9ec6-3ef0cd494116 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:22.746496 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-762088bb-2309-4b00-9ec6-3ef0cd494116 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:22.747181 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-762088bb-2309-4b00-9ec6-3ef0cd494116 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:22.748399 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-762088bb-2309-4b00-9ec6-3ef0cd494116 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:22.779803 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-84b3e407-d112-4e5d-b90a-7f5572531faa tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c36bef85ac34b4983a79e03c56965c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e58f30136ed4a4d9bff48e9b4cde5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:22.819383 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-84b3e407-d112-4e5d-b90a-7f5572531faa tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] 10.222.0.20 "GET /compute/v2.1/servers/96c8ef8e-9790-4cd5-9a62-a6778b7bf02c" status: 200 len: 1282 microversion: 2.1 time: 0.341464 Oct 27 03:36:22.822105 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1973/3692] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:22 2022] GET /compute/v2.1/servers/96c8ef8e-9790-4cd5-9a62-a6778b7bf02c => generated 1282 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:36:22.958165 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-762088bb-2309-4b00-9ec6-3ef0cd494116 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:22.987352 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-762088bb-2309-4b00-9ec6-3ef0cd494116 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1505 microversion: 2.1 time: 0.255930 Oct 27 03:36:23.011252 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1720/3693] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:22 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1505 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:23.019778 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f6cf134d-5791-45f8-835f-e9d2d0663ca6 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:36:23.020250 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f6cf134d-5791-45f8-835f-e9d2d0663ca6 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:23.031774 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f6cf134d-5791-45f8-835f-e9d2d0663ca6 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:23.032283 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f6cf134d-5791-45f8-835f-e9d2d0663ca6 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:23.032729 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f6cf134d-5791-45f8-835f-e9d2d0663ca6 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:23.038496 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-00591b48-a8af-497a-89ef-6f58a39e4bca tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:23.039378 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-00591b48-a8af-497a-89ef-6f58a39e4bca tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] [instance: 8c8a2cbb-4acf-4a6b-b684-567617bb930d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:23.041631 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f6cf134d-5791-45f8-835f-e9d2d0663ca6 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:23.042909 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f6cf134d-5791-45f8-835f-e9d2d0663ca6 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:23.044203 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f6cf134d-5791-45f8-835f-e9d2d0663ca6 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:23.062351 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-00591b48-a8af-497a-89ef-6f58a39e4bca tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:23.063228 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-00591b48-a8af-497a-89ef-6f58a39e4bca tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:23.063789 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-00591b48-a8af-497a-89ef-6f58a39e4bca tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:23.064709 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-00591b48-a8af-497a-89ef-6f58a39e4bca tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:23.065398 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-00591b48-a8af-497a-89ef-6f58a39e4bca tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:23.066051 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-00591b48-a8af-497a-89ef-6f58a39e4bca tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:23.123605 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-f6cf134d-5791-45f8-835f-e9d2d0663ca6 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lazy-loading 'flavor' on Instance uuid 376ac459-e31f-4727-9e34-535f055ac20d {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:36:23.469123 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-00591b48-a8af-497a-89ef-6f58a39e4bca tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:23.481274 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-00591b48-a8af-497a-89ef-6f58a39e4bca tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:23.483299 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-00591b48-a8af-497a-89ef-6f58a39e4bca tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:23.484751 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-00591b48-a8af-497a-89ef-6f58a39e4bca tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d" status: 200 len: 1878 microversion: 2.42 time: 0.451771 Oct 27 03:36:23.499343 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1721/3694] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:36:23 2022] GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d => generated 1878 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:36:23.515197 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2331c511-402c-4fcb-9d01-d1f46b3cecbc tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7ddeda1790>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:23.800780 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f6cf134d-5791-45f8-835f-e9d2d0663ca6 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "POST /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d/action" status: 202 len: 0 microversion: 2.1 time: 0.785859 Oct 27 03:36:23.805026 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1974/3695] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:36:23 2022] POST /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d/action => generated 0 bytes in 791 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:36:23.819029 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5874c76c-9f11-40c6-8733-abadfcb41190 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:23.821483 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5874c76c-9f11-40c6-8733-abadfcb41190 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:23.839752 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5874c76c-9f11-40c6-8733-abadfcb41190 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:23.840684 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5874c76c-9f11-40c6-8733-abadfcb41190 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:23.845010 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5874c76c-9f11-40c6-8733-abadfcb41190 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:23.846389 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5874c76c-9f11-40c6-8733-abadfcb41190 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:23.847142 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5874c76c-9f11-40c6-8733-abadfcb41190 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:23.847364 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5874c76c-9f11-40c6-8733-abadfcb41190 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:23.878946 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2331c511-402c-4fcb-9d01-d1f46b3cecbc tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images/81186aa0-7ea8-487e-9c34-69f89a3830e6" status: 200 len: 1454 microversion: 2.1 time: 0.367913 Oct 27 03:36:23.881527 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1722/3696] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:36:23 2022] GET /compute/v2.1/images/81186aa0-7ea8-487e-9c34-69f89a3830e6 => generated 1454 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:23.891650 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-563f2535-491a-4df4-8278-8d4b5294c00c tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:23.899679 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-563f2535-491a-4df4-8278-8d4b5294c00c tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] [instance: 96c8ef8e-9790-4cd5-9a62-a6778b7bf02c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:23.916548 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-563f2535-491a-4df4-8278-8d4b5294c00c tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:23.920559 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-563f2535-491a-4df4-8278-8d4b5294c00c tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:23.921709 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-563f2535-491a-4df4-8278-8d4b5294c00c tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:23.926468 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-563f2535-491a-4df4-8278-8d4b5294c00c tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:23.927415 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-563f2535-491a-4df4-8278-8d4b5294c00c tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:23.931372 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-563f2535-491a-4df4-8278-8d4b5294c00c tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:24.177690 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-563f2535-491a-4df4-8278-8d4b5294c00c tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c36bef85ac34b4983a79e03c56965c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e58f30136ed4a4d9bff48e9b4cde5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:24.191597 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-563f2535-491a-4df4-8278-8d4b5294c00c tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] 10.222.0.20 "GET /compute/v2.1/servers/96c8ef8e-9790-4cd5-9a62-a6778b7bf02c" status: 200 len: 1324 microversion: 2.1 time: 0.306716 Oct 27 03:36:24.192831 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1723/3697] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:23 2022] GET /compute/v2.1/servers/96c8ef8e-9790-4cd5-9a62-a6778b7bf02c => generated 1324 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:24.202358 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-6a37522e-a79a-4a26-b56e-54dfa0c87cbd req-778a8eec-ce05-45d3-9863-a6917a7e3384 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c8a2cbb-4acf-4a6b-b684-567617bb930d", "name": "network-vif-plugged", "status": "completed", "tag": "05efbe65-e414-4934-8f17-a13f864d1dab"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:36:24.232964 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-6a37522e-a79a-4a26-b56e-54dfa0c87cbd req-778a8eec-ce05-45d3-9863-a6917a7e3384 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:24.238313 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-6a37522e-a79a-4a26-b56e-54dfa0c87cbd req-778a8eec-ce05-45d3-9863-a6917a7e3384 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:24.238313 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-6a37522e-a79a-4a26-b56e-54dfa0c87cbd req-778a8eec-ce05-45d3-9863-a6917a7e3384 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:24.256635 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-6a37522e-a79a-4a26-b56e-54dfa0c87cbd req-778a8eec-ce05-45d3-9863-a6917a7e3384 service nova] Creating event network-vif-plugged:05efbe65-e414-4934-8f17-a13f864d1dab for instance 8c8a2cbb-4acf-4a6b-b684-567617bb930d on n-h2-862769-1 Oct 27 03:36:24.262446 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5874c76c-9f11-40c6-8733-abadfcb41190 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:24.266614 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-6a37522e-a79a-4a26-b56e-54dfa0c87cbd req-778a8eec-ce05-45d3-9863-a6917a7e3384 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072016 Oct 27 03:36:24.268307 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1724/3698] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:36:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:36:24.280630 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5874c76c-9f11-40c6-8733-abadfcb41190 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1511 microversion: 2.1 time: 0.466761 Oct 27 03:36:24.281297 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1975/3699] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:23 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1511 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:24.521713 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-fb1512be-a078-4d78-abea-c8c2329db309 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:24.523325 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-fb1512be-a078-4d78-abea-c8c2329db309 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] [instance: 8c8a2cbb-4acf-4a6b-b684-567617bb930d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:24.535513 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fb1512be-a078-4d78-abea-c8c2329db309 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:24.536455 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fb1512be-a078-4d78-abea-c8c2329db309 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:24.537118 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fb1512be-a078-4d78-abea-c8c2329db309 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:24.538313 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fb1512be-a078-4d78-abea-c8c2329db309 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:24.539191 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fb1512be-a078-4d78-abea-c8c2329db309 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:24.541346 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fb1512be-a078-4d78-abea-c8c2329db309 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:24.963072 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-fb1512be-a078-4d78-abea-c8c2329db309 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:24.963072 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-fb1512be-a078-4d78-abea-c8c2329db309 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:24.963072 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-fb1512be-a078-4d78-abea-c8c2329db309 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:24.963072 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-fb1512be-a078-4d78-abea-c8c2329db309 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d" status: 200 len: 1878 microversion: 2.42 time: 0.320356 Oct 27 03:36:24.963072 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1725/3700] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:36:24 2022] GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d => generated 1878 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:36:24.963934 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-319b1c5b-0a44-4500-a507-d76679fcd86e tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7dd9d161f0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:24.963934 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-319b1c5b-0a44-4500-a507-d76679fcd86e tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images/81186aa0-7ea8-487e-9c34-69f89a3830e6" status: 200 len: 1454 microversion: 2.1 time: 0.062593 Oct 27 03:36:24.963934 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1976/3701] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:36:24 2022] GET /compute/v2.1/images/81186aa0-7ea8-487e-9c34-69f89a3830e6 => generated 1454 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:25.219903 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-243f7e8b-b494-4d41-a239-96a93c96f4c6 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:25.222015 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-243f7e8b-b494-4d41-a239-96a93c96f4c6 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] [instance: 96c8ef8e-9790-4cd5-9a62-a6778b7bf02c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:25.233448 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-243f7e8b-b494-4d41-a239-96a93c96f4c6 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:25.234321 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-243f7e8b-b494-4d41-a239-96a93c96f4c6 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:25.235478 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-243f7e8b-b494-4d41-a239-96a93c96f4c6 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:25.236941 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-243f7e8b-b494-4d41-a239-96a93c96f4c6 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:25.238364 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-243f7e8b-b494-4d41-a239-96a93c96f4c6 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:25.239468 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-243f7e8b-b494-4d41-a239-96a93c96f4c6 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:25.312773 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8046096c-2fc5-480a-a2e3-9e7defb4fcff tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:25.315222 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8046096c-2fc5-480a-a2e3-9e7defb4fcff tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:25.322086 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:36:25.337231 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8046096c-2fc5-480a-a2e3-9e7defb4fcff tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:25.338196 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8046096c-2fc5-480a-a2e3-9e7defb4fcff tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:25.339164 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8046096c-2fc5-480a-a2e3-9e7defb4fcff tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:25.340523 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8046096c-2fc5-480a-a2e3-9e7defb4fcff tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:25.340999 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8046096c-2fc5-480a-a2e3-9e7defb4fcff tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:25.341475 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8046096c-2fc5-480a-a2e3-9e7defb4fcff tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:25.452069 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-243f7e8b-b494-4d41-a239-96a93c96f4c6 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c36bef85ac34b4983a79e03c56965c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e58f30136ed4a4d9bff48e9b4cde5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:25.461344 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-243f7e8b-b494-4d41-a239-96a93c96f4c6 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] 10.222.0.20 "GET /compute/v2.1/servers/96c8ef8e-9790-4cd5-9a62-a6778b7bf02c" status: 200 len: 1324 microversion: 2.1 time: 0.245658 Oct 27 03:36:25.475920 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1726/3702] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:25 2022] GET /compute/v2.1/servers/96c8ef8e-9790-4cd5-9a62-a6778b7bf02c => generated 1324 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:25.594815 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-e8076268-9175-4f7d-9f0b-359ed8eef044 req-f0d80fef-c7d5-4c49-9919-984533efbe62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96c8ef8e-9790-4cd5-9a62-a6778b7bf02c", "tag": "5fa8e579-0ecc-4468-b878-97bf0608962b"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:36:25.608357 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-e8076268-9175-4f7d-9f0b-359ed8eef044 req-f0d80fef-c7d5-4c49-9919-984533efbe62 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:25.609053 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-e8076268-9175-4f7d-9f0b-359ed8eef044 req-f0d80fef-c7d5-4c49-9919-984533efbe62 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:25.609755 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-e8076268-9175-4f7d-9f0b-359ed8eef044 req-f0d80fef-c7d5-4c49-9919-984533efbe62 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:25.624341 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-e8076268-9175-4f7d-9f0b-359ed8eef044 req-f0d80fef-c7d5-4c49-9919-984533efbe62 service nova] Creating event network-changed:5fa8e579-0ecc-4468-b878-97bf0608962b for instance 96c8ef8e-9790-4cd5-9a62-a6778b7bf02c on n-h1-862769-1 Oct 27 03:36:25.643954 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-e8076268-9175-4f7d-9f0b-359ed8eef044 req-f0d80fef-c7d5-4c49-9919-984533efbe62 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.166326 Oct 27 03:36:25.644796 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1727/3703] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:36:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:36:25.741720 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8046096c-2fc5-480a-a2e3-9e7defb4fcff tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:25.752690 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8046096c-2fc5-480a-a2e3-9e7defb4fcff tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1511 microversion: 2.1 time: 0.447711 Oct 27 03:36:25.754206 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1977/3704] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:25 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1511 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:25.863177 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b81e9d66-f71d-48b5-bb3b-ec9ddae0af81 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:25.864143 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b81e9d66-f71d-48b5-bb3b-ec9ddae0af81 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] [instance: 8c8a2cbb-4acf-4a6b-b684-567617bb930d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:25.871507 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b81e9d66-f71d-48b5-bb3b-ec9ddae0af81 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:25.873467 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b81e9d66-f71d-48b5-bb3b-ec9ddae0af81 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:25.873467 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b81e9d66-f71d-48b5-bb3b-ec9ddae0af81 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:25.873742 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b81e9d66-f71d-48b5-bb3b-ec9ddae0af81 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:25.874524 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b81e9d66-f71d-48b5-bb3b-ec9ddae0af81 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:25.875128 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b81e9d66-f71d-48b5-bb3b-ec9ddae0af81 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:25.971103 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-cc0e61a8-ac7f-408d-9a65-0dc6eacf8722 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7dd9d16040>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:26.041342 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-cc0e61a8-ac7f-408d-9a65-0dc6eacf8722 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images/81186aa0-7ea8-487e-9c34-69f89a3830e6" status: 200 len: 1454 microversion: 2.1 time: 0.067581 Oct 27 03:36:26.041342 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1978/3705] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:36:25 2022] GET /compute/v2.1/images/81186aa0-7ea8-487e-9c34-69f89a3830e6 => generated 1454 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:36:26.185353 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b81e9d66-f71d-48b5-bb3b-ec9ddae0af81 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:26.202833 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b81e9d66-f71d-48b5-bb3b-ec9ddae0af81 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:26.205402 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b81e9d66-f71d-48b5-bb3b-ec9ddae0af81 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:26.206901 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b81e9d66-f71d-48b5-bb3b-ec9ddae0af81 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d" status: 200 len: 1878 microversion: 2.42 time: 0.349743 Oct 27 03:36:26.208188 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1728/3706] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:36:25 2022] GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d => generated 1878 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:36:26.490191 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f040903b-1766-4f6c-b303-46a760ab0cb9 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:26.491216 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f040903b-1766-4f6c-b303-46a760ab0cb9 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] [instance: 96c8ef8e-9790-4cd5-9a62-a6778b7bf02c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:26.524415 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f040903b-1766-4f6c-b303-46a760ab0cb9 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:26.540282 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f040903b-1766-4f6c-b303-46a760ab0cb9 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:26.550190 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-6f7b16fd-8f15-4222-a5dc-1910cdad9289 req-79d7ac5b-6815-4d60-8b78-81a833c6ad55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c8a2cbb-4acf-4a6b-b684-567617bb930d", "name": "network-vif-plugged", "status": "completed", "tag": "67feebc0-6f53-4380-af0b-a0f8be99846e"}, {"server_uuid": "8c8a2cbb-4acf-4a6b-b684-567617bb930d", "name": "network-vif-plugged", "status": "completed", "tag": "3a1ccaa7-51b5-4235-87d4-b3c14e28f77b"}, {"server_uuid": "8c8a2cbb-4acf-4a6b-b684-567617bb930d", "name": "network-vif-plugged", "status": "completed", "tag": "3eb3290d-51f2-4707-9c45-ff4cde5ca958"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:36:26.556392 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f040903b-1766-4f6c-b303-46a760ab0cb9 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:26.560873 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f040903b-1766-4f6c-b303-46a760ab0cb9 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:26.561417 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f040903b-1766-4f6c-b303-46a760ab0cb9 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:26.563779 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f040903b-1766-4f6c-b303-46a760ab0cb9 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:26.578503 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-6f7b16fd-8f15-4222-a5dc-1910cdad9289 req-79d7ac5b-6815-4d60-8b78-81a833c6ad55 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:26.579413 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-6f7b16fd-8f15-4222-a5dc-1910cdad9289 req-79d7ac5b-6815-4d60-8b78-81a833c6ad55 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:26.581524 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-6f7b16fd-8f15-4222-a5dc-1910cdad9289 req-79d7ac5b-6815-4d60-8b78-81a833c6ad55 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:26.615901 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-6f7b16fd-8f15-4222-a5dc-1910cdad9289 req-79d7ac5b-6815-4d60-8b78-81a833c6ad55 service nova] Creating event network-vif-plugged:67feebc0-6f53-4380-af0b-a0f8be99846e for instance 8c8a2cbb-4acf-4a6b-b684-567617bb930d on n-h2-862769-1 Oct 27 03:36:26.616744 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-6f7b16fd-8f15-4222-a5dc-1910cdad9289 req-79d7ac5b-6815-4d60-8b78-81a833c6ad55 service nova] Creating event network-vif-plugged:3a1ccaa7-51b5-4235-87d4-b3c14e28f77b for instance 8c8a2cbb-4acf-4a6b-b684-567617bb930d on n-h2-862769-1 Oct 27 03:36:26.618221 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-6f7b16fd-8f15-4222-a5dc-1910cdad9289 req-79d7ac5b-6815-4d60-8b78-81a833c6ad55 service nova] Creating event network-vif-plugged:3eb3290d-51f2-4707-9c45-ff4cde5ca958 for instance 8c8a2cbb-4acf-4a6b-b684-567617bb930d on n-h2-862769-1 Oct 27 03:36:26.633768 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-6f7b16fd-8f15-4222-a5dc-1910cdad9289 req-79d7ac5b-6815-4d60-8b78-81a833c6ad55 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.249807 Oct 27 03:36:26.639734 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1979/3707] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:36:26 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:36:26.779181 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-13900181-dfed-430b-84a4-72d61f43be26 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:26.780346 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-13900181-dfed-430b-84a4-72d61f43be26 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:26.789428 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-13900181-dfed-430b-84a4-72d61f43be26 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:26.793695 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-13900181-dfed-430b-84a4-72d61f43be26 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:26.794497 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-13900181-dfed-430b-84a4-72d61f43be26 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:26.796667 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-13900181-dfed-430b-84a4-72d61f43be26 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:26.800051 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-13900181-dfed-430b-84a4-72d61f43be26 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:26.800707 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-13900181-dfed-430b-84a4-72d61f43be26 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:26.806290 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f040903b-1766-4f6c-b303-46a760ab0cb9 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c36bef85ac34b4983a79e03c56965c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e58f30136ed4a4d9bff48e9b4cde5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:26.822546 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f040903b-1766-4f6c-b303-46a760ab0cb9 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] 10.222.0.20 "GET /compute/v2.1/servers/96c8ef8e-9790-4cd5-9a62-a6778b7bf02c" status: 200 len: 1324 microversion: 2.1 time: 0.336114 Oct 27 03:36:26.826350 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1729/3708] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:26 2022] GET /compute/v2.1/servers/96c8ef8e-9790-4cd5-9a62-a6778b7bf02c => generated 1324 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:36:27.050443 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e9455282-4a7b-44e6-8105-ec93abb4a929 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7ddec5cca0>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:27.120549 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e9455282-4a7b-44e6-8105-ec93abb4a929 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images/81186aa0-7ea8-487e-9c34-69f89a3830e6" status: 200 len: 1454 microversion: 2.1 time: 0.073787 Oct 27 03:36:27.121611 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1730/3709] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:36:27 2022] GET /compute/v2.1/images/81186aa0-7ea8-487e-9c34-69f89a3830e6 => generated 1454 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:27.199745 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-13900181-dfed-430b-84a4-72d61f43be26 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:27.211882 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-13900181-dfed-430b-84a4-72d61f43be26 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1511 microversion: 2.1 time: 0.437406 Oct 27 03:36:27.217923 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1980/3710] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:26 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1511 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:27.234603 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0036287e-3c06-4866-8271-cd80345aad2f tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:27.235494 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0036287e-3c06-4866-8271-cd80345aad2f tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] [instance: 8c8a2cbb-4acf-4a6b-b684-567617bb930d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:27.252622 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0036287e-3c06-4866-8271-cd80345aad2f tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:27.253388 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0036287e-3c06-4866-8271-cd80345aad2f tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:27.256587 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0036287e-3c06-4866-8271-cd80345aad2f tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:27.256587 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0036287e-3c06-4866-8271-cd80345aad2f tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:27.256587 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0036287e-3c06-4866-8271-cd80345aad2f tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:27.256587 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0036287e-3c06-4866-8271-cd80345aad2f tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:27.561398 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0036287e-3c06-4866-8271-cd80345aad2f tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:27.574087 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0036287e-3c06-4866-8271-cd80345aad2f tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:27.575879 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0036287e-3c06-4866-8271-cd80345aad2f tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:27.577129 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0036287e-3c06-4866-8271-cd80345aad2f tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d" status: 200 len: 1878 microversion: 2.42 time: 0.347090 Oct 27 03:36:27.579198 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1731/3711] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:36:27 2022] GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d => generated 1878 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:36:27.849019 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7b247e2a-0183-4d8a-b8b2-e3ccf5d74205 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:27.850062 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7b247e2a-0183-4d8a-b8b2-e3ccf5d74205 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] [instance: 96c8ef8e-9790-4cd5-9a62-a6778b7bf02c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:27.857013 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7b247e2a-0183-4d8a-b8b2-e3ccf5d74205 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:27.857752 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7b247e2a-0183-4d8a-b8b2-e3ccf5d74205 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:27.860005 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7b247e2a-0183-4d8a-b8b2-e3ccf5d74205 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:27.860005 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7b247e2a-0183-4d8a-b8b2-e3ccf5d74205 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:27.860734 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7b247e2a-0183-4d8a-b8b2-e3ccf5d74205 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:27.861392 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7b247e2a-0183-4d8a-b8b2-e3ccf5d74205 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:28.138066 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d4445a55-8827-48f0-9d8e-4ac340e05325 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7ddec43160>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:28.159432 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:36:28.213812 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d4445a55-8827-48f0-9d8e-4ac340e05325 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images/81186aa0-7ea8-487e-9c34-69f89a3830e6" status: 200 len: 1454 microversion: 2.1 time: 0.080819 Oct 27 03:36:28.218895 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1732/3712] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:36:28 2022] GET /compute/v2.1/images/81186aa0-7ea8-487e-9c34-69f89a3830e6 => generated 1454 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:36:28.248445 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-741d58a2-553a-4401-b217-c871c56988bb tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:28.249453 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-741d58a2-553a-4401-b217-c871c56988bb tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:28.271298 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-741d58a2-553a-4401-b217-c871c56988bb tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:28.274850 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-741d58a2-553a-4401-b217-c871c56988bb tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:28.284512 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-741d58a2-553a-4401-b217-c871c56988bb tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:28.284512 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-741d58a2-553a-4401-b217-c871c56988bb tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:28.284512 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-741d58a2-553a-4401-b217-c871c56988bb tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:28.284512 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-741d58a2-553a-4401-b217-c871c56988bb tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:28.318623 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7b247e2a-0183-4d8a-b8b2-e3ccf5d74205 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c36bef85ac34b4983a79e03c56965c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e58f30136ed4a4d9bff48e9b4cde5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:28.333007 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7b247e2a-0183-4d8a-b8b2-e3ccf5d74205 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] 10.222.0.20 "GET /compute/v2.1/servers/96c8ef8e-9790-4cd5-9a62-a6778b7bf02c" status: 200 len: 1324 microversion: 2.1 time: 0.484640 Oct 27 03:36:28.345310 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1981/3713] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:27 2022] GET /compute/v2.1/servers/96c8ef8e-9790-4cd5-9a62-a6778b7bf02c => generated 1324 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:28.471092 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-741d58a2-553a-4401-b217-c871c56988bb tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:28.480282 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-741d58a2-553a-4401-b217-c871c56988bb tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1511 microversion: 2.1 time: 0.237969 Oct 27 03:36:28.483243 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1733/3714] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:28 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1511 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:28.609683 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5426ec64-87fb-4676-8b02-e87aa41516e7 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:28.616809 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5426ec64-87fb-4676-8b02-e87aa41516e7 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] [instance: 8c8a2cbb-4acf-4a6b-b684-567617bb930d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:28.625264 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5426ec64-87fb-4676-8b02-e87aa41516e7 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:28.626187 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5426ec64-87fb-4676-8b02-e87aa41516e7 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:28.626857 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5426ec64-87fb-4676-8b02-e87aa41516e7 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:28.628359 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5426ec64-87fb-4676-8b02-e87aa41516e7 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:28.629073 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5426ec64-87fb-4676-8b02-e87aa41516e7 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:28.629805 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5426ec64-87fb-4676-8b02-e87aa41516e7 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:28.699437 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-160c3f58-4e48-4164-bdbb-8b56cacb3591 req-ec5868f4-9d17-482e-8b60-806cc23492ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c8a2cbb-4acf-4a6b-b684-567617bb930d", "name": "network-vif-plugged", "status": "completed", "tag": "2e9b0521-8b60-4153-8c0a-3a8fbe3a87fe"}, {"server_uuid": "8c8a2cbb-4acf-4a6b-b684-567617bb930d", "name": "network-vif-plugged", "status": "completed", "tag": "40696ddf-b935-4016-95dc-a4e42979795f"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:36:28.713747 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=8 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:36:28.727006 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-160c3f58-4e48-4164-bdbb-8b56cacb3591 req-ec5868f4-9d17-482e-8b60-806cc23492ae service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:28.728334 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-160c3f58-4e48-4164-bdbb-8b56cacb3591 req-ec5868f4-9d17-482e-8b60-806cc23492ae service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:28.729005 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-160c3f58-4e48-4164-bdbb-8b56cacb3591 req-ec5868f4-9d17-482e-8b60-806cc23492ae service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:28.762261 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-160c3f58-4e48-4164-bdbb-8b56cacb3591 req-ec5868f4-9d17-482e-8b60-806cc23492ae service nova] Creating event network-vif-plugged:2e9b0521-8b60-4153-8c0a-3a8fbe3a87fe for instance 8c8a2cbb-4acf-4a6b-b684-567617bb930d on n-h2-862769-1 Oct 27 03:36:28.763228 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-160c3f58-4e48-4164-bdbb-8b56cacb3591 req-ec5868f4-9d17-482e-8b60-806cc23492ae service nova] Creating event network-vif-plugged:40696ddf-b935-4016-95dc-a4e42979795f for instance 8c8a2cbb-4acf-4a6b-b684-567617bb930d on n-h2-862769-1 Oct 27 03:36:28.772696 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-160c3f58-4e48-4164-bdbb-8b56cacb3591 req-ec5868f4-9d17-482e-8b60-806cc23492ae service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.074434 Oct 27 03:36:28.773604 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1734/3715] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:36:28 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:36:29.112399 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5426ec64-87fb-4676-8b02-e87aa41516e7 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:29.140805 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5426ec64-87fb-4676-8b02-e87aa41516e7 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:29.145014 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5426ec64-87fb-4676-8b02-e87aa41516e7 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:29.146309 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5426ec64-87fb-4676-8b02-e87aa41516e7 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d" status: 200 len: 1878 microversion: 2.42 time: 0.541980 Oct 27 03:36:29.149040 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1982/3716] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:36:28 2022] GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d => generated 1878 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:36:29.233639 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-488d0ab9-91cb-4991-82dc-c65def3acc20 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7ddedefc10>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:29.298791 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-488d0ab9-91cb-4991-82dc-c65def3acc20 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images/81186aa0-7ea8-487e-9c34-69f89a3830e6" status: 200 len: 1454 microversion: 2.1 time: 0.069639 Oct 27 03:36:29.300919 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1735/3717] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:36:29 2022] GET /compute/v2.1/images/81186aa0-7ea8-487e-9c34-69f89a3830e6 => generated 1454 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:29.359821 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-eacfaecd-6bc7-4a2b-8ee7-c6882b3da33b tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:29.360655 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-eacfaecd-6bc7-4a2b-8ee7-c6882b3da33b tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] [instance: 96c8ef8e-9790-4cd5-9a62-a6778b7bf02c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:29.370904 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eacfaecd-6bc7-4a2b-8ee7-c6882b3da33b tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:29.387846 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eacfaecd-6bc7-4a2b-8ee7-c6882b3da33b tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:29.390753 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eacfaecd-6bc7-4a2b-8ee7-c6882b3da33b tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:29.393617 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eacfaecd-6bc7-4a2b-8ee7-c6882b3da33b tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:29.397717 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eacfaecd-6bc7-4a2b-8ee7-c6882b3da33b tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:29.400633 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eacfaecd-6bc7-4a2b-8ee7-c6882b3da33b tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:29.506799 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e42eb188-81e8-4456-88ab-8e89aa7b2f46 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:29.507826 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e42eb188-81e8-4456-88ab-8e89aa7b2f46 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:29.532476 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e42eb188-81e8-4456-88ab-8e89aa7b2f46 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:29.532986 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e42eb188-81e8-4456-88ab-8e89aa7b2f46 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:29.533436 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e42eb188-81e8-4456-88ab-8e89aa7b2f46 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:29.534261 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e42eb188-81e8-4456-88ab-8e89aa7b2f46 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:29.534741 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e42eb188-81e8-4456-88ab-8e89aa7b2f46 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:29.535181 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e42eb188-81e8-4456-88ab-8e89aa7b2f46 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:29.754526 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e42eb188-81e8-4456-88ab-8e89aa7b2f46 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:29.764531 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e42eb188-81e8-4456-88ab-8e89aa7b2f46 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1511 microversion: 2.1 time: 0.261597 Oct 27 03:36:29.766106 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1736/3718] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:29 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1511 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:36:29.808118 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-eacfaecd-6bc7-4a2b-8ee7-c6882b3da33b tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c36bef85ac34b4983a79e03c56965c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e58f30136ed4a4d9bff48e9b4cde5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:29.820263 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-eacfaecd-6bc7-4a2b-8ee7-c6882b3da33b tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] 10.222.0.20 "GET /compute/v2.1/servers/96c8ef8e-9790-4cd5-9a62-a6778b7bf02c" status: 200 len: 1324 microversion: 2.1 time: 0.466053 Oct 27 03:36:29.824938 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1983/3719] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:29 2022] GET /compute/v2.1/servers/96c8ef8e-9790-4cd5-9a62-a6778b7bf02c => generated 1324 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:30.178464 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-78787809-cc4a-4116-ab4d-809f7b04e65f tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:30.179247 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-78787809-cc4a-4116-ab4d-809f7b04e65f tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] [instance: 8c8a2cbb-4acf-4a6b-b684-567617bb930d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:30.186484 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-78787809-cc4a-4116-ab4d-809f7b04e65f tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:30.187214 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-78787809-cc4a-4116-ab4d-809f7b04e65f tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:30.189670 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-78787809-cc4a-4116-ab4d-809f7b04e65f tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:30.190648 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-78787809-cc4a-4116-ab4d-809f7b04e65f tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:30.191125 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-78787809-cc4a-4116-ab4d-809f7b04e65f tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:30.191559 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-78787809-cc4a-4116-ab4d-809f7b04e65f tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:30.315878 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7778cb44-cd84-4f18-b2a8-7777ccca422f tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7dd9d0b430>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:30.385998 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7778cb44-cd84-4f18-b2a8-7777ccca422f tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images/81186aa0-7ea8-487e-9c34-69f89a3830e6" status: 200 len: 1454 microversion: 2.1 time: 0.074442 Oct 27 03:36:30.395760 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1984/3720] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:36:30 2022] GET /compute/v2.1/images/81186aa0-7ea8-487e-9c34-69f89a3830e6 => generated 1454 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:36:30.446350 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-78787809-cc4a-4116-ab4d-809f7b04e65f tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:30.463872 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-78787809-cc4a-4116-ab4d-809f7b04e65f tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:30.465486 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-78787809-cc4a-4116-ab4d-809f7b04e65f tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:30.467561 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-78787809-cc4a-4116-ab4d-809f7b04e65f tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d" status: 200 len: 1878 microversion: 2.42 time: 0.294632 Oct 27 03:36:30.468306 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1737/3721] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:36:30 2022] GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d => generated 1878 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:36:30.796839 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0c8d4415-411a-40fe-9487-abd28d49f036 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:30.798399 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0c8d4415-411a-40fe-9487-abd28d49f036 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:30.801708 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-5577c732-5932-488d-9b78-c714f537f310 req-0d637e76-f19b-4c4a-8996-bbfe7cf8da42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c8a2cbb-4acf-4a6b-b684-567617bb930d", "name": "network-vif-plugged", "status": "completed", "tag": "be4d3f04-e26e-4f91-8a8f-ac908acaa7cc"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:36:30.806255 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0c8d4415-411a-40fe-9487-abd28d49f036 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:30.806969 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0c8d4415-411a-40fe-9487-abd28d49f036 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:30.807538 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0c8d4415-411a-40fe-9487-abd28d49f036 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:30.808488 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0c8d4415-411a-40fe-9487-abd28d49f036 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:30.809247 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0c8d4415-411a-40fe-9487-abd28d49f036 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:30.809950 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0c8d4415-411a-40fe-9487-abd28d49f036 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:30.812522 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-5577c732-5932-488d-9b78-c714f537f310 req-0d637e76-f19b-4c4a-8996-bbfe7cf8da42 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:30.817397 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-5577c732-5932-488d-9b78-c714f537f310 req-0d637e76-f19b-4c4a-8996-bbfe7cf8da42 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:30.817397 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-5577c732-5932-488d-9b78-c714f537f310 req-0d637e76-f19b-4c4a-8996-bbfe7cf8da42 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:30.834116 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-5577c732-5932-488d-9b78-c714f537f310 req-0d637e76-f19b-4c4a-8996-bbfe7cf8da42 service nova] Creating event network-vif-plugged:be4d3f04-e26e-4f91-8a8f-ac908acaa7cc for instance 8c8a2cbb-4acf-4a6b-b684-567617bb930d on n-h2-862769-1 Oct 27 03:36:30.840607 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-5577c732-5932-488d-9b78-c714f537f310 req-0d637e76-f19b-4c4a-8996-bbfe7cf8da42 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042437 Oct 27 03:36:30.842911 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1738/3722] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:36:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:36:30.850906 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b4f0e9a5-a98f-48d2-97a9-d00d344fbd3b tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:30.851823 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b4f0e9a5-a98f-48d2-97a9-d00d344fbd3b tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] [instance: 96c8ef8e-9790-4cd5-9a62-a6778b7bf02c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:30.859004 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b4f0e9a5-a98f-48d2-97a9-d00d344fbd3b tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:30.860178 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b4f0e9a5-a98f-48d2-97a9-d00d344fbd3b tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:30.860809 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b4f0e9a5-a98f-48d2-97a9-d00d344fbd3b tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:30.861742 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b4f0e9a5-a98f-48d2-97a9-d00d344fbd3b tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:30.862474 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b4f0e9a5-a98f-48d2-97a9-d00d344fbd3b tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:30.863204 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b4f0e9a5-a98f-48d2-97a9-d00d344fbd3b tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:31.015580 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0c8d4415-411a-40fe-9487-abd28d49f036 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:31.027044 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0c8d4415-411a-40fe-9487-abd28d49f036 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1511 microversion: 2.1 time: 0.242050 Oct 27 03:36:31.029778 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1985/3723] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:30 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1511 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:31.141312 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b4f0e9a5-a98f-48d2-97a9-d00d344fbd3b tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c36bef85ac34b4983a79e03c56965c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e58f30136ed4a4d9bff48e9b4cde5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:31.151330 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b4f0e9a5-a98f-48d2-97a9-d00d344fbd3b tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] 10.222.0.20 "GET /compute/v2.1/servers/96c8ef8e-9790-4cd5-9a62-a6778b7bf02c" status: 200 len: 1324 microversion: 2.1 time: 0.305780 Oct 27 03:36:31.159792 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1739/3724] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:30 2022] GET /compute/v2.1/servers/96c8ef8e-9790-4cd5-9a62-a6778b7bf02c => generated 1324 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:31.402375 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d6b3cf20-5b42-4040-b8c4-988d3e3edfd7 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7dd9ca7e50>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:31.470545 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d6b3cf20-5b42-4040-b8c4-988d3e3edfd7 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images/81186aa0-7ea8-487e-9c34-69f89a3830e6" status: 200 len: 1454 microversion: 2.1 time: 0.068728 Oct 27 03:36:31.470545 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1986/3725] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:36:31 2022] GET /compute/v2.1/images/81186aa0-7ea8-487e-9c34-69f89a3830e6 => generated 1454 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:31.499990 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9a2b43b2-d2b3-4f30-a6c3-5760902f7b00 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:31.501316 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9a2b43b2-d2b3-4f30-a6c3-5760902f7b00 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] [instance: 8c8a2cbb-4acf-4a6b-b684-567617bb930d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:31.524396 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9a2b43b2-d2b3-4f30-a6c3-5760902f7b00 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:31.524396 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9a2b43b2-d2b3-4f30-a6c3-5760902f7b00 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:31.524396 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9a2b43b2-d2b3-4f30-a6c3-5760902f7b00 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:31.524396 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9a2b43b2-d2b3-4f30-a6c3-5760902f7b00 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:31.524396 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9a2b43b2-d2b3-4f30-a6c3-5760902f7b00 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:31.524396 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9a2b43b2-d2b3-4f30-a6c3-5760902f7b00 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:31.722210 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9a2b43b2-d2b3-4f30-a6c3-5760902f7b00 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:31.723819 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=100 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:36:31.731755 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9a2b43b2-d2b3-4f30-a6c3-5760902f7b00 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:31.733729 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9a2b43b2-d2b3-4f30-a6c3-5760902f7b00 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:31.734955 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9a2b43b2-d2b3-4f30-a6c3-5760902f7b00 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d" status: 200 len: 1878 microversion: 2.42 time: 0.239723 Oct 27 03:36:31.735811 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1740/3726] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:36:31 2022] GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d => generated 1878 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:36:31.781343 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2c7be956-371b-4125-a8c3-1a670dc6f679 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:31.781971 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2c7be956-371b-4125-a8c3-1a670dc6f679 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:31.789152 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2c7be956-371b-4125-a8c3-1a670dc6f679 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:31.789646 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2c7be956-371b-4125-a8c3-1a670dc6f679 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:31.790611 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2c7be956-371b-4125-a8c3-1a670dc6f679 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:31.791676 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2c7be956-371b-4125-a8c3-1a670dc6f679 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:31.792139 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2c7be956-371b-4125-a8c3-1a670dc6f679 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:31.792566 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2c7be956-371b-4125-a8c3-1a670dc6f679 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:31.813175 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:36:31.962792 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2c7be956-371b-4125-a8c3-1a670dc6f679 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:31.976949 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2c7be956-371b-4125-a8c3-1a670dc6f679 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1669 microversion: 2.1 time: 0.199276 Oct 27 03:36:31.978792 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1987/3727] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:31 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1669 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:32.001305 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4577218e-2357-411c-8a72-a2056ea58b7d tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:32.001917 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4577218e-2357-411c-8a72-a2056ea58b7d tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:32.008564 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4577218e-2357-411c-8a72-a2056ea58b7d tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:32.009058 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4577218e-2357-411c-8a72-a2056ea58b7d tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:32.009683 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4577218e-2357-411c-8a72-a2056ea58b7d tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:32.010436 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4577218e-2357-411c-8a72-a2056ea58b7d tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:32.010977 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4577218e-2357-411c-8a72-a2056ea58b7d tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:32.011418 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4577218e-2357-411c-8a72-a2056ea58b7d tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:32.053184 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b5d11170-fe8e-4a00-a900-ce30ab591fe1 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:32.054010 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b5d11170-fe8e-4a00-a900-ce30ab591fe1 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:32.060742 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b5d11170-fe8e-4a00-a900-ce30ab591fe1 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:32.061324 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b5d11170-fe8e-4a00-a900-ce30ab591fe1 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:32.061842 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b5d11170-fe8e-4a00-a900-ce30ab591fe1 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:32.062654 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b5d11170-fe8e-4a00-a900-ce30ab591fe1 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:32.063185 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b5d11170-fe8e-4a00-a900-ce30ab591fe1 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:32.063737 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b5d11170-fe8e-4a00-a900-ce30ab591fe1 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:32.175285 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4577218e-2357-411c-8a72-a2056ea58b7d tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:32.192590 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4577218e-2357-411c-8a72-a2056ea58b7d tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1669 microversion: 2.1 time: 0.195169 Oct 27 03:36:32.197724 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1741/3728] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:31 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1669 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:32.205251 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c62d9e0a-7398-4432-b561-80837e47b4f6 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:32.208642 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c62d9e0a-7398-4432-b561-80837e47b4f6 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] [instance: 96c8ef8e-9790-4cd5-9a62-a6778b7bf02c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:32.219275 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c62d9e0a-7398-4432-b561-80837e47b4f6 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:32.220228 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c62d9e0a-7398-4432-b561-80837e47b4f6 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:32.220751 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c62d9e0a-7398-4432-b561-80837e47b4f6 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:32.221545 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c62d9e0a-7398-4432-b561-80837e47b4f6 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:32.222260 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c62d9e0a-7398-4432-b561-80837e47b4f6 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:32.222691 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c62d9e0a-7398-4432-b561-80837e47b4f6 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:32.234176 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b5d11170-fe8e-4a00-a900-ce30ab591fe1 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:32.250683 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b5d11170-fe8e-4a00-a900-ce30ab591fe1 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1511 microversion: 2.1 time: 0.201242 Oct 27 03:36:32.251229 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1988/3729] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:32 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1511 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:36:32.260986 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f0d1c2dc-bc58-4a44-bd98-681e050fb503 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:32.260986 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f0d1c2dc-bc58-4a44-bd98-681e050fb503 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:32.266669 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f0d1c2dc-bc58-4a44-bd98-681e050fb503 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:32.267169 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f0d1c2dc-bc58-4a44-bd98-681e050fb503 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:32.267621 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f0d1c2dc-bc58-4a44-bd98-681e050fb503 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:32.268359 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f0d1c2dc-bc58-4a44-bd98-681e050fb503 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:32.268800 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f0d1c2dc-bc58-4a44-bd98-681e050fb503 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:32.269229 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f0d1c2dc-bc58-4a44-bd98-681e050fb503 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:32.473486 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f0d1c2dc-bc58-4a44-bd98-681e050fb503 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:32.503694 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c62d9e0a-7398-4432-b561-80837e47b4f6 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c36bef85ac34b4983a79e03c56965c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e58f30136ed4a4d9bff48e9b4cde5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:32.506049 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f0d1c2dc-bc58-4a44-bd98-681e050fb503 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1669 microversion: 2.1 time: 0.252363 Oct 27 03:36:32.518325 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c62d9e0a-7398-4432-b561-80837e47b4f6 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] 10.222.0.20 "GET /compute/v2.1/servers/96c8ef8e-9790-4cd5-9a62-a6778b7bf02c" status: 200 len: 1324 microversion: 2.1 time: 0.316425 Oct 27 03:36:32.518325 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1742/3730] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:32 2022] GET /compute/v2.1/servers/96c8ef8e-9790-4cd5-9a62-a6778b7bf02c => generated 1324 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:32.519137 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1989/3731] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:32 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1669 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:32.522096 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a50e3ac8-58a8-4f38-b086-71f5e5cbebc9 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7ddeda1700>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:32.538694 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2f8c56d3-a527-4e3f-b6be-39ea5d1dc109 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:32.543923 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2f8c56d3-a527-4e3f-b6be-39ea5d1dc109 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:32.548311 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2f8c56d3-a527-4e3f-b6be-39ea5d1dc109 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:32.549307 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2f8c56d3-a527-4e3f-b6be-39ea5d1dc109 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:32.550001 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2f8c56d3-a527-4e3f-b6be-39ea5d1dc109 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:32.550973 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2f8c56d3-a527-4e3f-b6be-39ea5d1dc109 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:32.551669 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2f8c56d3-a527-4e3f-b6be-39ea5d1dc109 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:32.552329 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2f8c56d3-a527-4e3f-b6be-39ea5d1dc109 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:32.593441 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a50e3ac8-58a8-4f38-b086-71f5e5cbebc9 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images/81186aa0-7ea8-487e-9c34-69f89a3830e6" status: 200 len: 1463 microversion: 2.1 time: 0.075870 Oct 27 03:36:32.594752 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1743/3732] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:36:32 2022] GET /compute/v2.1/images/81186aa0-7ea8-487e-9c34-69f89a3830e6 => generated 1463 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:32.633185 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6b9d5ce7-6b26-47a6-ae18-71f391f3e1b1 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7ddeda1550>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:32.701883 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6b9d5ce7-6b26-47a6-ae18-71f391f3e1b1 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images/81186aa0-7ea8-487e-9c34-69f89a3830e6" status: 200 len: 1463 microversion: 2.1 time: 0.089341 Oct 27 03:36:32.703365 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1744/3733] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:36:32 2022] GET /compute/v2.1/images/81186aa0-7ea8-487e-9c34-69f89a3830e6 => generated 1463 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:32.720383 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9ab0cfa1-1e55-4630-93ce-e5792c414802 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:32.721596 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9ab0cfa1-1e55-4630-93ce-e5792c414802 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] [instance: f50da5a9-2bb6-4735-93c3-d73ece0964f3] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:32.731476 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9ab0cfa1-1e55-4630-93ce-e5792c414802 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:32.732461 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9ab0cfa1-1e55-4630-93ce-e5792c414802 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:32.733477 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9ab0cfa1-1e55-4630-93ce-e5792c414802 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:32.735018 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9ab0cfa1-1e55-4630-93ce-e5792c414802 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:32.736008 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9ab0cfa1-1e55-4630-93ce-e5792c414802 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:32.737148 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9ab0cfa1-1e55-4630-93ce-e5792c414802 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:32.779230 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2f8c56d3-a527-4e3f-b6be-39ea5d1dc109 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:32.793495 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2f8c56d3-a527-4e3f-b6be-39ea5d1dc109 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1669 microversion: 2.1 time: 0.264616 Oct 27 03:36:32.794119 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1990/3734] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:32 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1669 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:36:32.800643 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9935ea1c-08c0-4a3b-b4e0-7e89893ece0b tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:32.801266 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-9935ea1c-08c0-4a3b-b4e0-7e89893ece0b tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] [instance: 8c8a2cbb-4acf-4a6b-b684-567617bb930d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:32.811248 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9935ea1c-08c0-4a3b-b4e0-7e89893ece0b tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:32.811960 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9935ea1c-08c0-4a3b-b4e0-7e89893ece0b tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:32.812657 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9935ea1c-08c0-4a3b-b4e0-7e89893ece0b tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:32.813533 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9935ea1c-08c0-4a3b-b4e0-7e89893ece0b tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:32.814342 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9935ea1c-08c0-4a3b-b4e0-7e89893ece0b tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:32.814960 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9935ea1c-08c0-4a3b-b4e0-7e89893ece0b tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:33.032556 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9ab0cfa1-1e55-4630-93ce-e5792c414802 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae7845f6759c4dcabcc1516a72484174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d371ab6648425eac2cf1702f2789dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:33.056015 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9ab0cfa1-1e55-4630-93ce-e5792c414802 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/servers/f50da5a9-2bb6-4735-93c3-d73ece0964f3" status: 200 len: 1467 microversion: 2.1 time: 0.331208 Oct 27 03:36:33.056015 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1745/3735] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:32 2022] GET /compute/v2.1/servers/f50da5a9-2bb6-4735-93c3-d73ece0964f3 => generated 1467 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:33.056015 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-1b01e9c6-5bd9-447c-b8c6-dfe8649bb9f1 req-e4bcdbc8-7e7e-4210-afe7-65a0884484bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96c8ef8e-9790-4cd5-9a62-a6778b7bf02c", "name": "network-vif-plugged", "status": "completed", "tag": "5fa8e579-0ecc-4468-b878-97bf0608962b"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:36:33.068053 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-1b01e9c6-5bd9-447c-b8c6-dfe8649bb9f1 req-e4bcdbc8-7e7e-4210-afe7-65a0884484bb service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:33.068537 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-1b01e9c6-5bd9-447c-b8c6-dfe8649bb9f1 req-e4bcdbc8-7e7e-4210-afe7-65a0884484bb service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:33.069524 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-1b01e9c6-5bd9-447c-b8c6-dfe8649bb9f1 req-e4bcdbc8-7e7e-4210-afe7-65a0884484bb service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:33.083402 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-1b01e9c6-5bd9-447c-b8c6-dfe8649bb9f1 req-e4bcdbc8-7e7e-4210-afe7-65a0884484bb service nova] Creating event network-vif-plugged:5fa8e579-0ecc-4468-b878-97bf0608962b for instance 96c8ef8e-9790-4cd5-9a62-a6778b7bf02c on n-h1-862769-1 Oct 27 03:36:33.087703 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9935ea1c-08c0-4a3b-b4e0-7e89893ece0b tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:33.091601 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-1b01e9c6-5bd9-447c-b8c6-dfe8649bb9f1 req-e4bcdbc8-7e7e-4210-afe7-65a0884484bb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042141 Oct 27 03:36:33.092275 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1746/3736] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:36:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:36:33.097914 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-557cfc7f-200a-4551-bebc-d11d6cb38e0a tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1241959496", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": [{"uuid": "3c58b3a5-6f00-4601-ab92-e31d99f01594"}]}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:36:33.099189 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9935ea1c-08c0-4a3b-b4e0-7e89893ece0b tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:33.100741 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9935ea1c-08c0-4a3b-b4e0-7e89893ece0b tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:33.102228 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9935ea1c-08c0-4a3b-b4e0-7e89893ece0b tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d" status: 200 len: 1878 microversion: 2.42 time: 0.307012 Oct 27 03:36:33.118430 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1991/3737] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:36:32 2022] GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d => generated 1878 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:36:33.128305 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-97fc3960-d487-4afb-b1bf-1ab48fa01bef tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7dd9d519d0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:33.235532 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-557cfc7f-200a-4551-bebc-d11d6cb38e0a tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] validate_networks() for [('3c58b3a5-6f00-4601-ab92-e31d99f01594', None, None, None, None, None)] {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:36:33.292216 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-97fc3960-d487-4afb-b1bf-1ab48fa01bef tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images?changes-since=2022-10-27T03%3A34%3A14Z" status: 200 len: 2373 microversion: 2.1 time: 0.169764 Oct 27 03:36:33.306989 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1992/3738] 10.222.0.20 () {58 vars in 1199 bytes} [Thu Oct 27 03:36:33 2022] GET /compute/v2.1/images?changes-since=2022-10-27T03%3A34%3A14Z => generated 2373 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:33.317857 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e3f57937-3db2-4984-b36f-59ed1aba11ed tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:33.319298 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e3f57937-3db2-4984-b36f-59ed1aba11ed tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:33.326632 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e3f57937-3db2-4984-b36f-59ed1aba11ed tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:33.327198 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e3f57937-3db2-4984-b36f-59ed1aba11ed tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:33.332010 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e3f57937-3db2-4984-b36f-59ed1aba11ed tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:33.332010 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e3f57937-3db2-4984-b36f-59ed1aba11ed tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:33.332010 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e3f57937-3db2-4984-b36f-59ed1aba11ed tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:33.332010 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e3f57937-3db2-4984-b36f-59ed1aba11ed tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:33.505301 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e3f57937-3db2-4984-b36f-59ed1aba11ed tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:33.516491 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e3f57937-3db2-4984-b36f-59ed1aba11ed tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1511 microversion: 2.1 time: 0.207399 Oct 27 03:36:33.517550 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1993/3739] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:33 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1511 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:33.522591 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-583aa3d7-6dd7-43d1-83df-88e1654eb596 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7dd9d16a60>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:33.612612 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-583aa3d7-6dd7-43d1-83df-88e1654eb596 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1484856438" status: 200 len: 485 microversion: 2.1 time: 0.093854 Oct 27 03:36:33.616679 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1994/3740] 10.222.0.20 () {58 vars in 1231 bytes} [Thu Oct 27 03:36:33 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1484856438 => generated 485 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:36:33.626593 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1e307c78-fad9-49c9-a5e8-23fdd5f035db tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:33.626593 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1e307c78-fad9-49c9-a5e8-23fdd5f035db tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] [instance: 96c8ef8e-9790-4cd5-9a62-a6778b7bf02c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:33.641287 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1e307c78-fad9-49c9-a5e8-23fdd5f035db tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:33.642053 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1e307c78-fad9-49c9-a5e8-23fdd5f035db tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:33.642813 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1e307c78-fad9-49c9-a5e8-23fdd5f035db tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:33.643531 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1e307c78-fad9-49c9-a5e8-23fdd5f035db tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:33.645134 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1e307c78-fad9-49c9-a5e8-23fdd5f035db tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:33.649795 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1e307c78-fad9-49c9-a5e8-23fdd5f035db tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:33.801955 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-557cfc7f-200a-4551-bebc-d11d6cb38e0a tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:36:33.801955 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-557cfc7f-200a-4551-bebc-d11d6cb38e0a tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:36:33.801955 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-557cfc7f-200a-4551-bebc-d11d6cb38e0a tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:36:33.801955 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-557cfc7f-200a-4551-bebc-d11d6cb38e0a tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:36:33.801955 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-557cfc7f-200a-4551-bebc-d11d6cb38e0a tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:36:33.810334 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-557cfc7f-200a-4551-bebc-d11d6cb38e0a tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:33.810836 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-557cfc7f-200a-4551-bebc-d11d6cb38e0a tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:33.811363 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-557cfc7f-200a-4551-bebc-d11d6cb38e0a tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:33.812054 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-557cfc7f-200a-4551-bebc-d11d6cb38e0a tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:33.812532 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-557cfc7f-200a-4551-bebc-d11d6cb38e0a tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:33.813196 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-557cfc7f-200a-4551-bebc-d11d6cb38e0a tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:33.827644 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1e307c78-fad9-49c9-a5e8-23fdd5f035db tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c36bef85ac34b4983a79e03c56965c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e58f30136ed4a4d9bff48e9b4cde5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:33.858354 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1e307c78-fad9-49c9-a5e8-23fdd5f035db tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] 10.222.0.20 "GET /compute/v2.1/servers/96c8ef8e-9790-4cd5-9a62-a6778b7bf02c" status: 200 len: 1324 microversion: 2.1 time: 0.240363 Oct 27 03:36:33.860545 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-557cfc7f-200a-4551-bebc-d11d6cb38e0a tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Getting quotas for project 3e9ede68f63747d59153a46412033856. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:36:33.868342 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1995/3741] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:33 2022] GET /compute/v2.1/servers/96c8ef8e-9790-4cd5-9a62-a6778b7bf02c => generated 1324 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:33.881715 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-557cfc7f-200a-4551-bebc-d11d6cb38e0a tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Getting quotas for user 94897f20beb94dbd8e7eff6ecba30026 and project 3e9ede68f63747d59153a46412033856. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:36:33.885574 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2608b9c3-8ebc-4bfa-b034-9a249290cf3e tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7dd9d16700>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:33.906146 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-557cfc7f-200a-4551-bebc-d11d6cb38e0a tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:36:33.923775 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-557cfc7f-200a-4551-bebc-d11d6cb38e0a tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: dbb1b9d1-38ff-42da-9e74-91f686f88047] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:36:34.005078 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2608b9c3-8ebc-4bfa-b034-9a249290cf3e tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images?server=f50da5a9-2bb6-4735-93c3-d73ece0964f3" status: 200 len: 956 microversion: 2.1 time: 0.135030 Oct 27 03:36:34.006205 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1996/3742] 10.222.0.20 () {58 vars in 1209 bytes} [Thu Oct 27 03:36:33 2022] GET /compute/v2.1/images?server=f50da5a9-2bb6-4735-93c3-d73ece0964f3 => generated 956 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:36:34.021329 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1be8f875-6f93-4f4e-8f2e-72b6ce441373 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7dd9d834c0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:34.062614 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-557cfc7f-200a-4551-bebc-d11d6cb38e0a tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.966371 Oct 27 03:36:34.063214 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1747/3743] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:36:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 970 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 03:36:34.075637 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-313e9563-faf5-49d6-be6f-21797cdb6274 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:34.077045 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-313e9563-faf5-49d6-be6f-21797cdb6274 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: dbb1b9d1-38ff-42da-9e74-91f686f88047] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:34.099685 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1be8f875-6f93-4f4e-8f2e-72b6ce441373 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.20%2Fcompute%2Fv2.1%2Fservers%2F004575c6-51ce-48d9-b7a6-d50f9afdb0a0" status: 200 len: 484 microversion: 2.1 time: 0.082094 Oct 27 03:36:34.117207 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1997/3744] 10.222.0.20 () {58 vars in 1317 bytes} [Thu Oct 27 03:36:34 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.20%2Fcompute%2Fv2.1%2Fservers%2F004575c6-51ce-48d9-b7a6-d50f9afdb0a0 => generated 484 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:36:34.129887 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-67746f93-3ae1-41fd-b501-f5a9c2a1999b tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7dd9ce3dc0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:34.146886 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-313e9563-faf5-49d6-be6f-21797cdb6274 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:34.158300 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-313e9563-faf5-49d6-be6f-21797cdb6274 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/dbb1b9d1-38ff-42da-9e74-91f686f88047" status: 200 len: 1215 microversion: 2.1 time: 0.087606 Oct 27 03:36:34.159532 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1748/3745] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:34 2022] GET /compute/v2.1/servers/dbb1b9d1-38ff-42da-9e74-91f686f88047 => generated 1215 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:36:34.167094 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7a474b82-c12d-4a0d-9f61-b8f4c19f3d7e tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:34.167982 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7a474b82-c12d-4a0d-9f61-b8f4c19f3d7e tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] [instance: 8c8a2cbb-4acf-4a6b-b684-567617bb930d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:34.175221 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7a474b82-c12d-4a0d-9f61-b8f4c19f3d7e tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:34.175948 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7a474b82-c12d-4a0d-9f61-b8f4c19f3d7e tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:34.176708 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7a474b82-c12d-4a0d-9f61-b8f4c19f3d7e tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:34.177582 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7a474b82-c12d-4a0d-9f61-b8f4c19f3d7e tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:34.178228 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7a474b82-c12d-4a0d-9f61-b8f4c19f3d7e tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:34.178837 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7a474b82-c12d-4a0d-9f61-b8f4c19f3d7e tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:34.222771 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-67746f93-3ae1-41fd-b501-f5a9c2a1999b tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.20%2Fcompute%2Fservers%2F004575c6-51ce-48d9-b7a6-d50f9afdb0a0" status: 200 len: 484 microversion: 2.1 time: 0.097314 Oct 27 03:36:34.231791 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1998/3746] 10.222.0.20 () {58 vars in 1303 bytes} [Thu Oct 27 03:36:34 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.20%2Fcompute%2Fservers%2F004575c6-51ce-48d9-b7a6-d50f9afdb0a0 => generated 484 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:36:34.238573 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-883c6c9f-39b9-41de-94d4-6ab3d3735569 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7dd9d16940>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:34.399120 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-883c6c9f-39b9-41de-94d4-6ab3d3735569 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3279 microversion: 2.1 time: 0.165050 Oct 27 03:36:34.400145 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 1999/3747] 10.222.0.20 () {58 vars in 1149 bytes} [Thu Oct 27 03:36:34 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3279 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:34.419701 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6f20fa72-cd2a-4dfd-9f3f-ff0f128bab7e tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7dd9ca7310>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:34.481448 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7a474b82-c12d-4a0d-9f61-b8f4c19f3d7e tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:34.493199 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7a474b82-c12d-4a0d-9f61-b8f4c19f3d7e tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:34.494912 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7a474b82-c12d-4a0d-9f61-b8f4c19f3d7e tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:34.496196 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7a474b82-c12d-4a0d-9f61-b8f4c19f3d7e tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d" status: 200 len: 2836 microversion: 2.42 time: 0.335536 Oct 27 03:36:34.497086 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1749/3748] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:36:34 2022] GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d => generated 2836 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:36:34.526441 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9ff81d14-c615-46d8-931c-3134a7f77d7a tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:34.527562 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9ff81d14-c615-46d8-931c-3134a7f77d7a tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] [instance: 8c8a2cbb-4acf-4a6b-b684-567617bb930d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:34.542473 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9ff81d14-c615-46d8-931c-3134a7f77d7a tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:34.542473 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9ff81d14-c615-46d8-931c-3134a7f77d7a tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:34.542473 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9ff81d14-c615-46d8-931c-3134a7f77d7a tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:34.542473 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9ff81d14-c615-46d8-931c-3134a7f77d7a tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:34.542473 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9ff81d14-c615-46d8-931c-3134a7f77d7a tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:34.542473 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9ff81d14-c615-46d8-931c-3134a7f77d7a tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:34.569117 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6f20fa72-cd2a-4dfd-9f3f-ff0f128bab7e tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1428 microversion: 2.1 time: 0.157885 Oct 27 03:36:34.571201 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2000/3749] 10.222.0.20 () {58 vars in 1149 bytes} [Thu Oct 27 03:36:34 2022] GET /compute/v2.1/images?type=snapshot => generated 1428 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:34.583460 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6c6740dc-8315-478d-a980-2144c20562f6 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:34.584105 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-6c6740dc-8315-478d-a980-2144c20562f6 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:34.593944 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6c6740dc-8315-478d-a980-2144c20562f6 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:34.594637 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6c6740dc-8315-478d-a980-2144c20562f6 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:34.595094 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6c6740dc-8315-478d-a980-2144c20562f6 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:34.595881 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6c6740dc-8315-478d-a980-2144c20562f6 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:34.596253 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6c6740dc-8315-478d-a980-2144c20562f6 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:34.596684 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6c6740dc-8315-478d-a980-2144c20562f6 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:34.765488 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9ff81d14-c615-46d8-931c-3134a7f77d7a tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.243244 Oct 27 03:36:34.766380 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1750/3750] 10.222.0.20 () {60 vars in 1316 bytes} [Thu Oct 27 03:36:34 2022] GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d/os-interface => generated 1831 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:36:34.784968 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1b00cae1-3635-475c-9537-92d208d72520 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7ddee3dc10>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:34.849659 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1b00cae1-3635-475c-9537-92d208d72520 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images?limit=1" status: 200 len: 621 microversion: 2.1 time: 0.071290 Oct 27 03:36:34.854793 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1751/3751] 10.222.0.20 () {58 vars in 1137 bytes} [Thu Oct 27 03:36:34 2022] GET /compute/v2.1/images?limit=1 => generated 621 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:36:34.869463 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c23c3589-a315-4d72-b3f5-c8a232afa6e2 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7ddecc8e50>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:35.001795 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c23c3589-a315-4d72-b3f5-c8a232afa6e2 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images/detail?changes-since=2022-10-27T03%3A34%3A09Z" status: 200 len: 6332 microversion: 2.1 time: 0.137542 Oct 27 03:36:35.002739 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1752/3752] 10.222.0.20 () {58 vars in 1220 bytes} [Thu Oct 27 03:36:34 2022] GET /compute/v2.1/images/detail?changes-since=2022-10-27T03%3A34%3A09Z => generated 6332 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:35.021683 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6c6740dc-8315-478d-a980-2144c20562f6 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:35.031732 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a04acb19-06c3-42d4-85f9-9753915b21d2 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:35.031732 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a04acb19-06c3-42d4-85f9-9753915b21d2 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] [instance: 96c8ef8e-9790-4cd5-9a62-a6778b7bf02c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:35.031732 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:36:35.033236 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a04acb19-06c3-42d4-85f9-9753915b21d2 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:35.033910 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a04acb19-06c3-42d4-85f9-9753915b21d2 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:35.034830 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a04acb19-06c3-42d4-85f9-9753915b21d2 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:35.036020 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a04acb19-06c3-42d4-85f9-9753915b21d2 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:35.036649 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a04acb19-06c3-42d4-85f9-9753915b21d2 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:35.037249 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a04acb19-06c3-42d4-85f9-9753915b21d2 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:35.037900 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6c6740dc-8315-478d-a980-2144c20562f6 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1511 microversion: 2.1 time: 0.463800 Oct 27 03:36:35.038754 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2001/3753] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:34 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1511 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:35.051746 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-dcd6a9ba-2219-4814-8d8b-40980ad2beec tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7dd9d6c3a0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:35.145573 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-dcd6a9ba-2219-4814-8d8b-40980ad2beec tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1484856438" status: 200 len: 665 microversion: 2.1 time: 0.101583 Oct 27 03:36:35.157337 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2002/3754] 10.222.0.20 () {58 vars in 1252 bytes} [Thu Oct 27 03:36:35 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1484856438 => generated 665 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:36:35.166439 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2f46d3ce-8c63-417d-b0ef-4c68c3879cb8 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7dd9d16670>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:35.269581 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a04acb19-06c3-42d4-85f9-9753915b21d2 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c36bef85ac34b4983a79e03c56965c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e58f30136ed4a4d9bff48e9b4cde5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:35.277369 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a04acb19-06c3-42d4-85f9-9753915b21d2 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] 10.222.0.20 "GET /compute/v2.1/servers/96c8ef8e-9790-4cd5-9a62-a6778b7bf02c" status: 200 len: 1520 microversion: 2.1 time: 0.257691 Oct 27 03:36:35.279728 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1753/3755] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:35 2022] GET /compute/v2.1/servers/96c8ef8e-9790-4cd5-9a62-a6778b7bf02c => generated 1520 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:35.283402 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2f46d3ce-8c63-417d-b0ef-4c68c3879cb8 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.20%2Fcompute%2Fv2.1%2Fservers%2F004575c6-51ce-48d9-b7a6-d50f9afdb0a0" status: 200 len: 1466 microversion: 2.1 time: 0.124476 Oct 27 03:36:35.286679 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2003/3756] 10.222.0.20 () {58 vars in 1338 bytes} [Thu Oct 27 03:36:35 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.20%2Fcompute%2Fv2.1%2Fservers%2F004575c6-51ce-48d9-b7a6-d50f9afdb0a0 => generated 1466 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:35.293869 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5611ae1b-68cf-4aab-b5f0-aec50af516ea tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:35.295755 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5611ae1b-68cf-4aab-b5f0-aec50af516ea tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: dbb1b9d1-38ff-42da-9e74-91f686f88047] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:35.304817 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-76286e8b-6eb9-4b9a-9747-6eb7e3bde077 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7dd9d16f70>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:35.381113 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5611ae1b-68cf-4aab-b5f0-aec50af516ea tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:35.394449 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5611ae1b-68cf-4aab-b5f0-aec50af516ea tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/dbb1b9d1-38ff-42da-9e74-91f686f88047" status: 200 len: 1215 microversion: 2.1 time: 0.106659 Oct 27 03:36:35.395297 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1754/3757] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:35 2022] GET /compute/v2.1/servers/dbb1b9d1-38ff-42da-9e74-91f686f88047 => generated 1215 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:35.410242 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6bc8a647-bbe7-4b65-94fa-b8588211449b tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:35.411223 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6bc8a647-bbe7-4b65-94fa-b8588211449b tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] [instance: 96c8ef8e-9790-4cd5-9a62-a6778b7bf02c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:35.418021 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6bc8a647-bbe7-4b65-94fa-b8588211449b tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:35.418603 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6bc8a647-bbe7-4b65-94fa-b8588211449b tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:35.419048 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6bc8a647-bbe7-4b65-94fa-b8588211449b tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:35.420299 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6bc8a647-bbe7-4b65-94fa-b8588211449b tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:35.420758 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6bc8a647-bbe7-4b65-94fa-b8588211449b tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:35.421184 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6bc8a647-bbe7-4b65-94fa-b8588211449b tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:35.439337 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-76286e8b-6eb9-4b9a-9747-6eb7e3bde077 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.20%2Fcompute%2Fservers%2F004575c6-51ce-48d9-b7a6-d50f9afdb0a0" status: 200 len: 1466 microversion: 2.1 time: 0.142245 Oct 27 03:36:35.441391 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2004/3758] 10.222.0.20 () {58 vars in 1324 bytes} [Thu Oct 27 03:36:35 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.20%2Fcompute%2Fservers%2F004575c6-51ce-48d9-b7a6-d50f9afdb0a0 => generated 1466 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:36:35.457330 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-da438f0a-b574-4113-8030-b4a2ce050e46 req-6c5ab5ec-af22-4cc0-81da-ee435019b642 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f50da5a9-2bb6-4735-93c3-d73ece0964f3", "name": "network-vif-unplugged", "status": "completed", "tag": "271e155b-8765-4519-870e-105aa22f7ae9"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:36:35.481327 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-da438f0a-b574-4113-8030-b4a2ce050e46 req-6c5ab5ec-af22-4cc0-81da-ee435019b642 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:35.485687 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-da438f0a-b574-4113-8030-b4a2ce050e46 req-6c5ab5ec-af22-4cc0-81da-ee435019b642 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:35.485687 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-da438f0a-b574-4113-8030-b4a2ce050e46 req-6c5ab5ec-af22-4cc0-81da-ee435019b642 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:35.502691 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-da438f0a-b574-4113-8030-b4a2ce050e46 req-6c5ab5ec-af22-4cc0-81da-ee435019b642 service nova] Creating event network-vif-unplugged:271e155b-8765-4519-870e-105aa22f7ae9 for instance f50da5a9-2bb6-4735-93c3-d73ece0964f3 on n-h1-862769-1 Oct 27 03:36:35.510458 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-da438f0a-b574-4113-8030-b4a2ce050e46 req-6c5ab5ec-af22-4cc0-81da-ee435019b642 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067794 Oct 27 03:36:35.511466 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2005/3759] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:36:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:36:35.518953 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5beb04ea-87ad-4b7d-810e-eb127ec06cf8 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7dd9cac160>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:35.615018 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-6bc8a647-bbe7-4b65-94fa-b8588211449b tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c36bef85ac34b4983a79e03c56965c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e58f30136ed4a4d9bff48e9b4cde5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:35.638774 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6bc8a647-bbe7-4b65-94fa-b8588211449b tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] 10.222.0.20 "GET /compute/v2.1/servers/96c8ef8e-9790-4cd5-9a62-a6778b7bf02c" status: 200 len: 1520 microversion: 2.1 time: 0.237772 Oct 27 03:36:35.639840 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1755/3760] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:35 2022] GET /compute/v2.1/servers/96c8ef8e-9790-4cd5-9a62-a6778b7bf02c => generated 1520 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:35.665890 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9dab1cc4-20bb-4ecd-bfa8-9eecd7d1604e tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1659703457"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:36:35.668359 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9dab1cc4-20bb-4ecd-bfa8-9eecd7d1604e tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] [instance: 96c8ef8e-9790-4cd5-9a62-a6778b7bf02c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:35.671448 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5beb04ea-87ad-4b7d-810e-eb127ec06cf8 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7107 microversion: 2.1 time: 0.157649 Oct 27 03:36:35.672699 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2006/3761] 10.222.0.20 () {58 vars in 1170 bytes} [Thu Oct 27 03:36:35 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7107 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:35.675130 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9dab1cc4-20bb-4ecd-bfa8-9eecd7d1604e tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:35.675634 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9dab1cc4-20bb-4ecd-bfa8-9eecd7d1604e tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:35.676080 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9dab1cc4-20bb-4ecd-bfa8-9eecd7d1604e tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:35.676796 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9dab1cc4-20bb-4ecd-bfa8-9eecd7d1604e tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:35.677266 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9dab1cc4-20bb-4ecd-bfa8-9eecd7d1604e tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:35.677694 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9dab1cc4-20bb-4ecd-bfa8-9eecd7d1604e tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:35.693696 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-fd82170e-b1be-4442-afe3-3c208791f2f7 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7dd9ca7790>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:35.788850 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-fd82170e-b1be-4442-afe3-3c208791f2f7 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4374 microversion: 2.1 time: 0.098177 Oct 27 03:36:35.790622 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2007/3762] 10.222.0.20 () {58 vars in 1170 bytes} [Thu Oct 27 03:36:35 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4374 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:36:35.816773 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-571f02f9-adcf-4852-8ab3-ca9e80dc50ce tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7dd9cacca0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:36.092478 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-571f02f9-adcf-4852-8ab3-ca9e80dc50ce tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images/c40fb871-5877-4b59-ab69-d9fd23b7a917" status: 200 len: 784 microversion: 2.1 time: 0.279586 Oct 27 03:36:36.096144 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2008/3763] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:36:35 2022] GET /compute/v2.1/images/c40fb871-5877-4b59-ab69-d9fd23b7a917 => generated 784 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:36:36.112176 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7a80d965-9ebf-4ab1-8c4e-3d3d386f17ed tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:36.113204 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7a80d965-9ebf-4ab1-8c4e-3d3d386f17ed tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:36.119866 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7a80d965-9ebf-4ab1-8c4e-3d3d386f17ed tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:36.120730 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7a80d965-9ebf-4ab1-8c4e-3d3d386f17ed tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:36.121457 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7a80d965-9ebf-4ab1-8c4e-3d3d386f17ed tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:36.122990 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7a80d965-9ebf-4ab1-8c4e-3d3d386f17ed tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:36.123719 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7a80d965-9ebf-4ab1-8c4e-3d3d386f17ed tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:36.124223 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7a80d965-9ebf-4ab1-8c4e-3d3d386f17ed tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:36.267408 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9dab1cc4-20bb-4ecd-bfa8-9eecd7d1604e tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] 10.222.0.20 "POST /compute/v2.1/servers/96c8ef8e-9790-4cd5-9a62-a6778b7bf02c/action" status: 202 len: 0 microversion: 2.1 time: 0.606290 Oct 27 03:36:36.270813 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1756/3764] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:36:35 2022] POST /compute/v2.1/servers/96c8ef8e-9790-4cd5-9a62-a6778b7bf02c/action => generated 0 bytes in 611 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 27 03:36:36.290430 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c20a1ed8-a239-48ce-ba16-ef24e0370869 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7dda0a0d30>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:36.349039 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7a80d965-9ebf-4ab1-8c4e-3d3d386f17ed tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:36.356568 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c20a1ed8-a239-48ce-ba16-ef24e0370869 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1610 microversion: 2.1 time: 0.082599 Oct 27 03:36:36.357771 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1757/3765] 10.222.0.20 () {58 vars in 1158 bytes} [Thu Oct 27 03:36:36 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1610 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:36.361383 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7a80d965-9ebf-4ab1-8c4e-3d3d386f17ed tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1511 microversion: 2.1 time: 0.253307 Oct 27 03:36:36.361981 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2009/3766] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:36 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1511 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:36.375045 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-00fc857b-f463-45d9-a244-5c2453686f44 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7dd9d169d0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:36.380473 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6dad6e86-0a79-4963-8fee-602a8555bcc6 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Calling method '.version_select at 0x7f7ddee309d0>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:37.956231 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-00fc857b-f463-45d9-a244-5c2453686f44 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "DELETE /compute/v2.1/images/81186aa0-7ea8-487e-9c34-69f89a3830e6" status: 204 len: 0 microversion: 2.1 time: 1.586186 Oct 27 03:36:37.957227 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2010/3767] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:36 2022] DELETE /compute/v2.1/images/81186aa0-7ea8-487e-9c34-69f89a3830e6 => generated 0 bytes in 1588 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:36:37.962309 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-69ca475c-2838-4e1c-a87d-5db006b4e29f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:37.963280 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-69ca475c-2838-4e1c-a87d-5db006b4e29f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: dbb1b9d1-38ff-42da-9e74-91f686f88047] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:37.983535 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-69ca475c-2838-4e1c-a87d-5db006b4e29f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:37.984086 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-69ca475c-2838-4e1c-a87d-5db006b4e29f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:37.984614 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-69ca475c-2838-4e1c-a87d-5db006b4e29f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:37.986982 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-69ca475c-2838-4e1c-a87d-5db006b4e29f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:37.989464 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-69ca475c-2838-4e1c-a87d-5db006b4e29f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:37.990288 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-69ca475c-2838-4e1c-a87d-5db006b4e29f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:38.144843 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-69ca475c-2838-4e1c-a87d-5db006b4e29f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:38.154741 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-69ca475c-2838-4e1c-a87d-5db006b4e29f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/dbb1b9d1-38ff-42da-9e74-91f686f88047" status: 200 len: 1273 microversion: 2.1 time: 0.195621 Oct 27 03:36:38.160055 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2011/3768] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:37 2022] GET /compute/v2.1/servers/dbb1b9d1-38ff-42da-9e74-91f686f88047 => generated 1273 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:38.160208 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-5477e494-5afb-4574-8d98-debc402ddbf1 req-b7003f76-7414-484f-9b3a-531e4a8660f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c8a2cbb-4acf-4a6b-b684-567617bb930d", "tag": "3a1ccaa7-51b5-4235-87d4-b3c14e28f77b"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:36:38.177457 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-5477e494-5afb-4574-8d98-debc402ddbf1 req-b7003f76-7414-484f-9b3a-531e4a8660f5 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:38.178255 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-5477e494-5afb-4574-8d98-debc402ddbf1 req-b7003f76-7414-484f-9b3a-531e4a8660f5 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:38.178956 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-5477e494-5afb-4574-8d98-debc402ddbf1 req-b7003f76-7414-484f-9b3a-531e4a8660f5 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:38.217016 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-5477e494-5afb-4574-8d98-debc402ddbf1 req-b7003f76-7414-484f-9b3a-531e4a8660f5 service nova] Creating event network-changed:3a1ccaa7-51b5-4235-87d4-b3c14e28f77b for instance 8c8a2cbb-4acf-4a6b-b684-567617bb930d on n-h2-862769-1 Oct 27 03:36:38.226719 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-5477e494-5afb-4574-8d98-debc402ddbf1 req-b7003f76-7414-484f-9b3a-531e4a8660f5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069589 Oct 27 03:36:38.227639 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2012/3769] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:36:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:36:38.240505 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9d84be55-7193-4d56-acab-9e930cc12bf5 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:38.240505 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-9d84be55-7193-4d56-acab-9e930cc12bf5 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:38.243810 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9d84be55-7193-4d56-acab-9e930cc12bf5 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:38.244314 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9d84be55-7193-4d56-acab-9e930cc12bf5 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:38.244952 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9d84be55-7193-4d56-acab-9e930cc12bf5 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:38.245806 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9d84be55-7193-4d56-acab-9e930cc12bf5 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:38.246505 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9d84be55-7193-4d56-acab-9e930cc12bf5 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:38.251432 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9d84be55-7193-4d56-acab-9e930cc12bf5 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:38.288222 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6dad6e86-0a79-4963-8fee-602a8555bcc6 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] 10.222.0.20 "DELETE /compute/v2.1/images/fcedaa19-2a7b-40b5-bc2a-b874c4fb9bdb" status: 204 len: 0 microversion: 2.1 time: 1.929042 Oct 27 03:36:38.289498 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1758/3770] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:36 2022] DELETE /compute/v2.1/images/fcedaa19-2a7b-40b5-bc2a-b874c4fb9bdb => generated 0 bytes in 1931 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:36:38.301835 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a3b37f0e-1d4e-4bb4-aa81-43c36fe0047f tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7ddecc8040>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:38.995292 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9d84be55-7193-4d56-acab-9e930cc12bf5 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:39.013163 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9d84be55-7193-4d56-acab-9e930cc12bf5 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1511 microversion: 2.1 time: 0.783805 Oct 27 03:36:39.019436 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2013/3771] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:38 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1511 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:39.031898 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-72eab3a6-6e88-4a2d-b979-5eb4b56c314a tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Calling method '.version_select at 0x7f7dd9d16ee0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:39.836533 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a3b37f0e-1d4e-4bb4-aa81-43c36fe0047f tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "DELETE /compute/v2.1/images/42320033-6276-453e-b35d-504a52d80d70" status: 204 len: 0 microversion: 2.1 time: 1.541003 Oct 27 03:36:39.837519 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1759/3772] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:38 2022] DELETE /compute/v2.1/images/42320033-6276-453e-b35d-504a52d80d70 => generated 0 bytes in 1547 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:36:39.855251 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-bd157c78-818d-4a99-9355-8e34903b50ed tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:39.856306 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-bd157c78-818d-4a99-9355-8e34903b50ed tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: dbb1b9d1-38ff-42da-9e74-91f686f88047] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:39.872665 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bd157c78-818d-4a99-9355-8e34903b50ed tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:39.872665 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bd157c78-818d-4a99-9355-8e34903b50ed tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:39.872665 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bd157c78-818d-4a99-9355-8e34903b50ed tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:39.873390 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bd157c78-818d-4a99-9355-8e34903b50ed tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:39.873852 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bd157c78-818d-4a99-9355-8e34903b50ed tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:39.876128 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-72eab3a6-6e88-4a2d-b979-5eb4b56c314a tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] HTTP exception thrown: Image not found. Oct 27 03:36:39.878248 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-72eab3a6-6e88-4a2d-b979-5eb4b56c314a tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Request method failure captured: Oct 27 03:36:39.878248 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/images/fcedaa19-2a7b-40b5-bc2a-b874c4fb9bdb HTTP/1.1 Oct 27 03:36:39.878248 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:36:39.878248 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:36:39.878248 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:36:39.878248 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:36:39.878248 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:36:39.878248 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:36:39.878248 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:36:39.878248 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:36:39.878248 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfx5Hbc6ITbdSRFtS1-RYRPTs8xU2lFAIvTX0CRBjp8hijBP6KjJjfK-rUuEjncsIe7o_mkFNeieFkwqoNyxVxCVqSYWPgHA26VD6r86MpHHV_eFwebptw3rA_gpbw5SDVw15ZqeHqKSf2NQXZk1XM_suSoUNVero4I26u6VER7fLwA Oct 27 03:36:39.878248 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:36:39.878248 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:36:39.878248 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:36:39.878248 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:36:39.878248 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:36:39.878248 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:36:39.878248 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 2e58f30136ed4a4d9bff48e9b4cde5a8 Oct 27 03:36:39.878248 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-597177073 Oct 27 03:36:39.878248 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:36:39.878248 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:36:39.878248 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2e58f30136ed4a4d9bff48e9b4cde5a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2e58f30136ed4a4d9bff48e9b4cde5a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2e58f30136ed4a4d9bff48e9b4cde5a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2e58f30136ed4a4d9bff48e9b4cde5a8"}]}] Oct 27 03:36:39.878248 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-597177073 Oct 27 03:36:39.878248 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 2e58f30136ed4a4d9bff48e9b4cde5a8 Oct 27 03:36:39.878248 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-597177073 Oct 27 03:36:39.878248 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ImagesOneServerNegativeTestJSON-597177073-project Oct 27 03:36:39.878248 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:36:39.878248 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:36:39.878248 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 5c36bef85ac34b4983a79e03c56965c5 Oct 27 03:36:39.878248 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-597177073-project Oct 27 03:36:39.878248 n-d-862769-1 devstack@n-api.service[121001]: method: Oct 27 03:36:39.878248 n-d-862769-1 devstack@n-api.service[121001]: exception: Image not found. Oct 27 03:36:39.878248 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': 'fcedaa19-2a7b-40b5-bc2a-b874c4fb9bdb'} Oct 27 03:36:39.878248 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:36:39.878248 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:36:39.878248 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 27 03:36:39.878248 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 27 03:36:39.878248 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 03:36:39.878248 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 03:36:39.878248 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 27 03:36:39.878248 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 27 03:36:39.878248 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 03:36:39.878248 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 03:36:39.878248 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 27 03:36:39.878248 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 27 03:36:39.878248 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 27 03:36:39.878248 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 27 03:36:39.878248 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 03:36:39.878248 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 03:36:39.878248 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 03:36:39.878248 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 03:36:39.878248 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID fcedaa19-2a7b-40b5-bc2a-b874c4fb9bdb Oct 27 03:36:39.878248 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:39.878248 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:36:39.878248 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:39.878248 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:36:39.878248 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 27 03:36:39.878248 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 27 03:36:39.878248 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 27 03:36:39.878248 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 27 03:36:39.878248 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 27 03:36:39.878248 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 27 03:36:39.878248 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 27 03:36:39.883839 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 27 03:36:39.883839 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 27 03:36:39.883839 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 27 03:36:39.883839 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 03:36:39.883839 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 03:36:39.883839 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 27 03:36:39.883839 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 27 03:36:39.883839 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 03:36:39.883839 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 03:36:39.883839 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 27 03:36:39.883839 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 27 03:36:39.883839 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 27 03:36:39.883839 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 27 03:36:39.883839 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 03:36:39.883839 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 03:36:39.883839 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 03:36:39.883839 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 03:36:39.883839 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image fcedaa19-2a7b-40b5-bc2a-b874c4fb9bdb could not be found. Oct 27 03:36:39.883839 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:39.883839 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:36:39.883839 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:39.883839 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:36:39.883839 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:36:39.883839 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:36:39.883839 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:36:39.883839 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:36:39.883839 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:36:39.883839 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:36:39.883839 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:36:39.883839 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:36:39.883839 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 27 03:36:39.883839 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 27 03:36:39.883839 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 27 03:36:39.883839 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:39.883839 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:36:39.883839 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:39.883839 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:36:39.883839 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:36:39.883839 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:36:39.883839 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:36:39.883839 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:36:39.883839 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 27 03:36:39.883839 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:39.883839 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-72eab3a6-6e88-4a2d-b979-5eb4b56c314a tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Returning 404 to user: Image not found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:36:39.883839 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-72eab3a6-6e88-4a2d-b979-5eb4b56c314a tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] 10.222.0.20 "GET /compute/v2.1/images/fcedaa19-2a7b-40b5-bc2a-b874c4fb9bdb" status: 404 len: 62 microversion: 2.1 time: 0.858992 Oct 27 03:36:39.883839 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2014/3773] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Oct 27 03:36:39 2022] GET /compute/v2.1/images/fcedaa19-2a7b-40b5-bc2a-b874c4fb9bdb => generated 62 bytes in 860 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 03:36:39.892614 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bd157c78-818d-4a99-9355-8e34903b50ed tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:39.962304 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-e76c56e6-4876-49ae-88f5-cf95de247e20 req-03798249-9aee-47ef-b739-9c0c79c543fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbb1b9d1-38ff-42da-9e74-91f686f88047", "tag": "6005c662-3d62-4cfd-8135-e32257e5003f"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:36:39.978914 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-e76c56e6-4876-49ae-88f5-cf95de247e20 req-03798249-9aee-47ef-b739-9c0c79c543fd service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:39.979488 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-e76c56e6-4876-49ae-88f5-cf95de247e20 req-03798249-9aee-47ef-b739-9c0c79c543fd service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:39.980013 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-e76c56e6-4876-49ae-88f5-cf95de247e20 req-03798249-9aee-47ef-b739-9c0c79c543fd service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:39.996491 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-e76c56e6-4876-49ae-88f5-cf95de247e20 req-03798249-9aee-47ef-b739-9c0c79c543fd service nova] Creating event network-changed:6005c662-3d62-4cfd-8135-e32257e5003f for instance dbb1b9d1-38ff-42da-9e74-91f686f88047 on n-h2-862769-1 Oct 27 03:36:40.001830 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-e76c56e6-4876-49ae-88f5-cf95de247e20 req-03798249-9aee-47ef-b739-9c0c79c543fd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120170 Oct 27 03:36:40.002346 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2015/3774] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:36:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:36:40.007960 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-57aa5ea7-32f2-43fd-b60b-29bbba27ad5e tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7dd9d16940>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:40.149069 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-bd157c78-818d-4a99-9355-8e34903b50ed tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:40.157247 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-bd157c78-818d-4a99-9355-8e34903b50ed tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/dbb1b9d1-38ff-42da-9e74-91f686f88047" status: 200 len: 1315 microversion: 2.1 time: 0.315640 Oct 27 03:36:40.157872 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1760/3775] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:39 2022] GET /compute/v2.1/servers/dbb1b9d1-38ff-42da-9e74-91f686f88047 => generated 1315 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:40.166948 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e43d0fb8-496b-40ed-ae52-1d40efd2cd14 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:40.168554 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e43d0fb8-496b-40ed-ae52-1d40efd2cd14 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] [instance: 96c8ef8e-9790-4cd5-9a62-a6778b7bf02c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:40.183432 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e43d0fb8-496b-40ed-ae52-1d40efd2cd14 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:40.194252 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e43d0fb8-496b-40ed-ae52-1d40efd2cd14 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:40.194252 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e43d0fb8-496b-40ed-ae52-1d40efd2cd14 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:40.194252 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e43d0fb8-496b-40ed-ae52-1d40efd2cd14 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:40.194252 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e43d0fb8-496b-40ed-ae52-1d40efd2cd14 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:40.194252 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e43d0fb8-496b-40ed-ae52-1d40efd2cd14 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:40.361480 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e43d0fb8-496b-40ed-ae52-1d40efd2cd14 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c36bef85ac34b4983a79e03c56965c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e58f30136ed4a4d9bff48e9b4cde5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:40.368842 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e43d0fb8-496b-40ed-ae52-1d40efd2cd14 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] 10.222.0.20 "GET /compute/v2.1/servers/96c8ef8e-9790-4cd5-9a62-a6778b7bf02c" status: 200 len: 1533 microversion: 2.1 time: 0.207155 Oct 27 03:36:40.369435 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1761/3776] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:40 2022] GET /compute/v2.1/servers/96c8ef8e-9790-4cd5-9a62-a6778b7bf02c => generated 1533 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:40.374733 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a6a037d5-b273-4219-a3af-80503fa725ab tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:40.375354 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a6a037d5-b273-4219-a3af-80503fa725ab tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:40.381144 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a6a037d5-b273-4219-a3af-80503fa725ab tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:40.381644 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a6a037d5-b273-4219-a3af-80503fa725ab tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:40.382114 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a6a037d5-b273-4219-a3af-80503fa725ab tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:40.383005 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a6a037d5-b273-4219-a3af-80503fa725ab tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:40.383467 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a6a037d5-b273-4219-a3af-80503fa725ab tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:40.384092 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a6a037d5-b273-4219-a3af-80503fa725ab tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:40.528214 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a6a037d5-b273-4219-a3af-80503fa725ab tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:40.536538 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a6a037d5-b273-4219-a3af-80503fa725ab tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1532 microversion: 2.1 time: 0.166036 Oct 27 03:36:40.548083 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1762/3777] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:40 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1532 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:41.001750 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-57aa5ea7-32f2-43fd-b60b-29bbba27ad5e tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "DELETE /compute/v2.1/images/5c03b8cf-4b2d-476c-8831-4866eeff9434" status: 204 len: 0 microversion: 2.1 time: 0.998054 Oct 27 03:36:41.002359 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2016/3778] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:40 2022] DELETE /compute/v2.1/images/5c03b8cf-4b2d-476c-8831-4866eeff9434 => generated 0 bytes in 999 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:36:41.010361 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ecae94e5-8608-4c71-aa60-868047a557df tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:41.010847 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ecae94e5-8608-4c71-aa60-868047a557df tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] [instance: 004575c6-51ce-48d9-b7a6-d50f9afdb0a0] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:41.018116 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ecae94e5-8608-4c71-aa60-868047a557df tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:41.018878 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ecae94e5-8608-4c71-aa60-868047a557df tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:41.019323 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ecae94e5-8608-4c71-aa60-868047a557df tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:41.020037 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ecae94e5-8608-4c71-aa60-868047a557df tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:41.020494 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ecae94e5-8608-4c71-aa60-868047a557df tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:41.020921 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ecae94e5-8608-4c71-aa60-868047a557df tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:41.050652 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ecae94e5-8608-4c71-aa60-868047a557df tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] [instance: 004575c6-51ce-48d9-b7a6-d50f9afdb0a0] Going to try to terminate instance {{(pid=121000) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:36:41.181088 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-55e6108f-935f-4d8d-8cbb-efacb89b2100 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:41.182269 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-55e6108f-935f-4d8d-8cbb-efacb89b2100 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: dbb1b9d1-38ff-42da-9e74-91f686f88047] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:41.191116 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-55e6108f-935f-4d8d-8cbb-efacb89b2100 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:41.191606 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-55e6108f-935f-4d8d-8cbb-efacb89b2100 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:41.192256 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-55e6108f-935f-4d8d-8cbb-efacb89b2100 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:41.192961 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-55e6108f-935f-4d8d-8cbb-efacb89b2100 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:41.193779 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-55e6108f-935f-4d8d-8cbb-efacb89b2100 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:41.194194 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-55e6108f-935f-4d8d-8cbb-efacb89b2100 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:41.347586 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ecae94e5-8608-4c71-aa60-868047a557df tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "DELETE /compute/v2.1/servers/004575c6-51ce-48d9-b7a6-d50f9afdb0a0" status: 204 len: 0 microversion: 2.1 time: 0.340882 Oct 27 03:36:41.348475 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1763/3779] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:36:41 2022] DELETE /compute/v2.1/servers/004575c6-51ce-48d9-b7a6-d50f9afdb0a0 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:36:41.354534 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-0b0dc8d7-315f-4e96-a48d-147efa146861 req-9866cfe9-1e4c-4ead-a7b7-b45958afc041 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96c8ef8e-9790-4cd5-9a62-a6778b7bf02c", "name": "network-vif-plugged", "status": "completed", "tag": "5fa8e579-0ecc-4468-b878-97bf0608962b"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:36:41.364818 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-0b0dc8d7-315f-4e96-a48d-147efa146861 req-9866cfe9-1e4c-4ead-a7b7-b45958afc041 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:41.365301 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-0b0dc8d7-315f-4e96-a48d-147efa146861 req-9866cfe9-1e4c-4ead-a7b7-b45958afc041 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:41.365816 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-0b0dc8d7-315f-4e96-a48d-147efa146861 req-9866cfe9-1e4c-4ead-a7b7-b45958afc041 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:41.368515 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-55e6108f-935f-4d8d-8cbb-efacb89b2100 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:41.378055 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-55e6108f-935f-4d8d-8cbb-efacb89b2100 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/dbb1b9d1-38ff-42da-9e74-91f686f88047" status: 200 len: 1315 microversion: 2.1 time: 0.201582 Oct 27 03:36:41.378969 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2017/3780] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:41 2022] GET /compute/v2.1/servers/dbb1b9d1-38ff-42da-9e74-91f686f88047 => generated 1315 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:36:41.383381 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-0b0dc8d7-315f-4e96-a48d-147efa146861 req-9866cfe9-1e4c-4ead-a7b7-b45958afc041 service nova] Creating event network-vif-plugged:5fa8e579-0ecc-4468-b878-97bf0608962b for instance 96c8ef8e-9790-4cd5-9a62-a6778b7bf02c on n-h1-862769-1 Oct 27 03:36:41.383831 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5a6ef124-74c0-4aa0-b2e1-22b8116aec7f tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:41.384446 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5a6ef124-74c0-4aa0-b2e1-22b8116aec7f tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] [instance: 004575c6-51ce-48d9-b7a6-d50f9afdb0a0] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:41.391924 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5a6ef124-74c0-4aa0-b2e1-22b8116aec7f tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:41.392549 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5a6ef124-74c0-4aa0-b2e1-22b8116aec7f tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:41.393189 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5a6ef124-74c0-4aa0-b2e1-22b8116aec7f tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:41.394157 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5a6ef124-74c0-4aa0-b2e1-22b8116aec7f tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:41.394626 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5a6ef124-74c0-4aa0-b2e1-22b8116aec7f tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:41.395267 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5a6ef124-74c0-4aa0-b2e1-22b8116aec7f tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:41.395722 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-0b0dc8d7-315f-4e96-a48d-147efa146861 req-9866cfe9-1e4c-4ead-a7b7-b45958afc041 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046017 Oct 27 03:36:41.396341 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1764/3781] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:36:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:36:41.401623 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-dd6b7d77-6f2f-457e-b31a-ee69e941273d tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:41.402354 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-dd6b7d77-6f2f-457e-b31a-ee69e941273d tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] [instance: 96c8ef8e-9790-4cd5-9a62-a6778b7bf02c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:41.422209 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dd6b7d77-6f2f-457e-b31a-ee69e941273d tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:41.423276 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dd6b7d77-6f2f-457e-b31a-ee69e941273d tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:41.423971 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dd6b7d77-6f2f-457e-b31a-ee69e941273d tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:41.425062 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dd6b7d77-6f2f-457e-b31a-ee69e941273d tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:41.425720 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dd6b7d77-6f2f-457e-b31a-ee69e941273d tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:41.426936 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dd6b7d77-6f2f-457e-b31a-ee69e941273d tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:41.581065 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-dd6b7d77-6f2f-457e-b31a-ee69e941273d tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c36bef85ac34b4983a79e03c56965c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e58f30136ed4a4d9bff48e9b4cde5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:41.582083 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5a6ef124-74c0-4aa0-b2e1-22b8116aec7f tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae7845f6759c4dcabcc1516a72484174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d371ab6648425eac2cf1702f2789dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:41.588002 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:36:41.590886 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-dd6b7d77-6f2f-457e-b31a-ee69e941273d tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] 10.222.0.20 "GET /compute/v2.1/servers/96c8ef8e-9790-4cd5-9a62-a6778b7bf02c" status: 200 len: 1520 microversion: 2.1 time: 0.193393 Oct 27 03:36:41.593208 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5a6ef124-74c0-4aa0-b2e1-22b8116aec7f tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/servers/004575c6-51ce-48d9-b7a6-d50f9afdb0a0" status: 200 len: 1474 microversion: 2.1 time: 0.212184 Oct 27 03:36:41.594139 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1765/3782] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:41 2022] GET /compute/v2.1/servers/96c8ef8e-9790-4cd5-9a62-a6778b7bf02c => generated 1520 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:41.599150 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2018/3783] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:41 2022] GET /compute/v2.1/servers/004575c6-51ce-48d9-b7a6-d50f9afdb0a0 => generated 1474 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:41.608551 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-18f5147a-a09b-415d-b608-955be48c712e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:41.608551 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-18f5147a-a09b-415d-b608-955be48c712e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:41.614266 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-18f5147a-a09b-415d-b608-955be48c712e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:41.614826 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-18f5147a-a09b-415d-b608-955be48c712e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:41.616680 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-18f5147a-a09b-415d-b608-955be48c712e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:41.616680 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-18f5147a-a09b-415d-b608-955be48c712e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:41.616680 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-18f5147a-a09b-415d-b608-955be48c712e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:41.616946 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-18f5147a-a09b-415d-b608-955be48c712e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:41.639920 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f6fb2d43-df2d-4bdd-bf9e-8fdfb2cfa185 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:41.640494 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f6fb2d43-df2d-4bdd-bf9e-8fdfb2cfa185 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] [instance: 96c8ef8e-9790-4cd5-9a62-a6778b7bf02c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:41.648932 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f6fb2d43-df2d-4bdd-bf9e-8fdfb2cfa185 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:41.651922 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f6fb2d43-df2d-4bdd-bf9e-8fdfb2cfa185 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:41.652531 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f6fb2d43-df2d-4bdd-bf9e-8fdfb2cfa185 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:41.653978 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f6fb2d43-df2d-4bdd-bf9e-8fdfb2cfa185 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:41.654725 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f6fb2d43-df2d-4bdd-bf9e-8fdfb2cfa185 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:41.655319 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f6fb2d43-df2d-4bdd-bf9e-8fdfb2cfa185 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:41.685486 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f6fb2d43-df2d-4bdd-bf9e-8fdfb2cfa185 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] [instance: 96c8ef8e-9790-4cd5-9a62-a6778b7bf02c] Going to try to terminate instance {{(pid=121001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:36:41.914197 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-18f5147a-a09b-415d-b608-955be48c712e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:41.933674 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-18f5147a-a09b-415d-b608-955be48c712e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1532 microversion: 2.1 time: 0.337196 Oct 27 03:36:41.934423 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1766/3784] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:41 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1532 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:42.020133 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f6fb2d43-df2d-4bdd-bf9e-8fdfb2cfa185 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] 10.222.0.20 "DELETE /compute/v2.1/servers/96c8ef8e-9790-4cd5-9a62-a6778b7bf02c" status: 204 len: 0 microversion: 2.1 time: 0.384040 Oct 27 03:36:42.024415 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2019/3785] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:36:41 2022] DELETE /compute/v2.1/servers/96c8ef8e-9790-4cd5-9a62-a6778b7bf02c => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:36:42.031316 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-543a13df-c3b3-48a1-a702-5cccf4302723 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:42.031316 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-543a13df-c3b3-48a1-a702-5cccf4302723 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] [instance: 96c8ef8e-9790-4cd5-9a62-a6778b7bf02c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:42.038370 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-543a13df-c3b3-48a1-a702-5cccf4302723 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:42.038942 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-543a13df-c3b3-48a1-a702-5cccf4302723 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:42.039453 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-543a13df-c3b3-48a1-a702-5cccf4302723 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:42.040631 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-543a13df-c3b3-48a1-a702-5cccf4302723 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:42.041358 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-543a13df-c3b3-48a1-a702-5cccf4302723 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:42.041867 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-543a13df-c3b3-48a1-a702-5cccf4302723 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:42.307337 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-543a13df-c3b3-48a1-a702-5cccf4302723 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c36bef85ac34b4983a79e03c56965c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e58f30136ed4a4d9bff48e9b4cde5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:42.316132 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-543a13df-c3b3-48a1-a702-5cccf4302723 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] 10.222.0.20 "GET /compute/v2.1/servers/96c8ef8e-9790-4cd5-9a62-a6778b7bf02c" status: 200 len: 1526 microversion: 2.1 time: 0.290455 Oct 27 03:36:42.317470 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1767/3786] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:42 2022] GET /compute/v2.1/servers/96c8ef8e-9790-4cd5-9a62-a6778b7bf02c => generated 1526 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:36:42.401591 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-28ef3b61-536d-4088-99ef-c8f7829ea614 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:42.402354 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-28ef3b61-536d-4088-99ef-c8f7829ea614 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: dbb1b9d1-38ff-42da-9e74-91f686f88047] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:42.410506 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-28ef3b61-536d-4088-99ef-c8f7829ea614 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:42.410987 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-28ef3b61-536d-4088-99ef-c8f7829ea614 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:42.411425 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-28ef3b61-536d-4088-99ef-c8f7829ea614 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:42.412118 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-28ef3b61-536d-4088-99ef-c8f7829ea614 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:42.412572 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-28ef3b61-536d-4088-99ef-c8f7829ea614 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:42.413011 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-28ef3b61-536d-4088-99ef-c8f7829ea614 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:42.444338 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:36:42.592820 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-28ef3b61-536d-4088-99ef-c8f7829ea614 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:42.601018 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-28ef3b61-536d-4088-99ef-c8f7829ea614 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/dbb1b9d1-38ff-42da-9e74-91f686f88047" status: 200 len: 1315 microversion: 2.1 time: 0.203467 Oct 27 03:36:42.601622 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2020/3787] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:42 2022] GET /compute/v2.1/servers/dbb1b9d1-38ff-42da-9e74-91f686f88047 => generated 1315 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:42.640259 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-310058a2-ca83-4e12-88b9-bca9a7dce042 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:42.641168 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-310058a2-ca83-4e12-88b9-bca9a7dce042 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] [instance: 004575c6-51ce-48d9-b7a6-d50f9afdb0a0] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:42.648360 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-310058a2-ca83-4e12-88b9-bca9a7dce042 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:42.648862 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-310058a2-ca83-4e12-88b9-bca9a7dce042 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:42.649302 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-310058a2-ca83-4e12-88b9-bca9a7dce042 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:42.650004 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-310058a2-ca83-4e12-88b9-bca9a7dce042 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:42.650493 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-310058a2-ca83-4e12-88b9-bca9a7dce042 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:42.650927 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-310058a2-ca83-4e12-88b9-bca9a7dce042 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:42.809119 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-310058a2-ca83-4e12-88b9-bca9a7dce042 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae7845f6759c4dcabcc1516a72484174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d371ab6648425eac2cf1702f2789dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:42.817709 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-310058a2-ca83-4e12-88b9-bca9a7dce042 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/servers/004575c6-51ce-48d9-b7a6-d50f9afdb0a0" status: 200 len: 1474 microversion: 2.1 time: 0.182028 Oct 27 03:36:42.818324 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1768/3788] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:42 2022] GET /compute/v2.1/servers/004575c6-51ce-48d9-b7a6-d50f9afdb0a0 => generated 1474 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:43.111254 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9bed1af7-69e7-4106-baf6-5cc777c6ceb1 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:43.111254 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-9bed1af7-69e7-4106-baf6-5cc777c6ceb1 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:43.111254 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9bed1af7-69e7-4106-baf6-5cc777c6ceb1 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:43.111254 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9bed1af7-69e7-4106-baf6-5cc777c6ceb1 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:43.111254 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9bed1af7-69e7-4106-baf6-5cc777c6ceb1 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:43.111254 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9bed1af7-69e7-4106-baf6-5cc777c6ceb1 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:43.111254 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9bed1af7-69e7-4106-baf6-5cc777c6ceb1 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:43.111254 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9bed1af7-69e7-4106-baf6-5cc777c6ceb1 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:43.179638 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9bed1af7-69e7-4106-baf6-5cc777c6ceb1 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:43.188573 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9bed1af7-69e7-4106-baf6-5cc777c6ceb1 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1527 microversion: 2.1 time: 0.233445 Oct 27 03:36:43.198159 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2021/3789] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:42 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1527 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:43.341874 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a0f8113d-6774-41d3-8173-982f2b4a8f08 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:43.343468 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a0f8113d-6774-41d3-8173-982f2b4a8f08 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] [instance: 96c8ef8e-9790-4cd5-9a62-a6778b7bf02c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:43.352399 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a0f8113d-6774-41d3-8173-982f2b4a8f08 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:43.353082 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a0f8113d-6774-41d3-8173-982f2b4a8f08 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:43.353528 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a0f8113d-6774-41d3-8173-982f2b4a8f08 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:43.354266 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a0f8113d-6774-41d3-8173-982f2b4a8f08 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:43.355587 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a0f8113d-6774-41d3-8173-982f2b4a8f08 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:43.356457 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a0f8113d-6774-41d3-8173-982f2b4a8f08 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:43.413146 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-e92e157a-d7d8-48f1-aeb6-3040dbda4e6c req-418248d3-0ba5-4383-b0ba-b9a2a6d543b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96c8ef8e-9790-4cd5-9a62-a6778b7bf02c", "name": "network-vif-unplugged", "status": "completed", "tag": "5fa8e579-0ecc-4468-b878-97bf0608962b"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:36:43.428322 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-e92e157a-d7d8-48f1-aeb6-3040dbda4e6c req-418248d3-0ba5-4383-b0ba-b9a2a6d543b1 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:43.429387 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-e92e157a-d7d8-48f1-aeb6-3040dbda4e6c req-418248d3-0ba5-4383-b0ba-b9a2a6d543b1 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:43.430217 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-e92e157a-d7d8-48f1-aeb6-3040dbda4e6c req-418248d3-0ba5-4383-b0ba-b9a2a6d543b1 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:43.443010 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-e92e157a-d7d8-48f1-aeb6-3040dbda4e6c req-418248d3-0ba5-4383-b0ba-b9a2a6d543b1 service nova] Creating event network-vif-unplugged:5fa8e579-0ecc-4468-b878-97bf0608962b for instance 96c8ef8e-9790-4cd5-9a62-a6778b7bf02c on n-h1-862769-1 Oct 27 03:36:43.452847 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-e92e157a-d7d8-48f1-aeb6-3040dbda4e6c req-418248d3-0ba5-4383-b0ba-b9a2a6d543b1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045181 Oct 27 03:36:43.453913 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2022/3790] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:36:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:36:43.538483 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a0f8113d-6774-41d3-8173-982f2b4a8f08 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c36bef85ac34b4983a79e03c56965c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e58f30136ed4a4d9bff48e9b4cde5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:43.544226 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a0f8113d-6774-41d3-8173-982f2b4a8f08 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] 10.222.0.20 "GET /compute/v2.1/servers/96c8ef8e-9790-4cd5-9a62-a6778b7bf02c" status: 200 len: 1526 microversion: 2.1 time: 0.207125 Oct 27 03:36:43.545898 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1769/3791] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:43 2022] GET /compute/v2.1/servers/96c8ef8e-9790-4cd5-9a62-a6778b7bf02c => generated 1526 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:43.633461 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-446200c7-35ab-4ab2-a79e-3c71262e89c2 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:43.633461 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-446200c7-35ab-4ab2-a79e-3c71262e89c2 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: dbb1b9d1-38ff-42da-9e74-91f686f88047] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:43.633461 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-446200c7-35ab-4ab2-a79e-3c71262e89c2 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:43.633765 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-446200c7-35ab-4ab2-a79e-3c71262e89c2 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:43.634231 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-446200c7-35ab-4ab2-a79e-3c71262e89c2 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:43.635080 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-446200c7-35ab-4ab2-a79e-3c71262e89c2 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:43.635544 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-446200c7-35ab-4ab2-a79e-3c71262e89c2 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:43.636188 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-446200c7-35ab-4ab2-a79e-3c71262e89c2 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:43.842972 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e2e0da38-b9ac-4f1b-89da-73de826bf3e0 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:43.843749 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e2e0da38-b9ac-4f1b-89da-73de826bf3e0 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] [instance: 004575c6-51ce-48d9-b7a6-d50f9afdb0a0] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:43.845860 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:36:43.854012 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e2e0da38-b9ac-4f1b-89da-73de826bf3e0 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:43.857399 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e2e0da38-b9ac-4f1b-89da-73de826bf3e0 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:43.861875 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e2e0da38-b9ac-4f1b-89da-73de826bf3e0 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:43.862799 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e2e0da38-b9ac-4f1b-89da-73de826bf3e0 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:43.863297 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e2e0da38-b9ac-4f1b-89da-73de826bf3e0 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:43.863748 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e2e0da38-b9ac-4f1b-89da-73de826bf3e0 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:44.266228 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-446200c7-35ab-4ab2-a79e-3c71262e89c2 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:44.278008 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-446200c7-35ab-4ab2-a79e-3c71262e89c2 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/dbb1b9d1-38ff-42da-9e74-91f686f88047" status: 200 len: 1315 microversion: 2.1 time: 0.655712 Oct 27 03:36:44.278008 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2023/3792] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:43 2022] GET /compute/v2.1/servers/dbb1b9d1-38ff-42da-9e74-91f686f88047 => generated 1315 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:44.287460 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e2e0da38-b9ac-4f1b-89da-73de826bf3e0 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae7845f6759c4dcabcc1516a72484174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d371ab6648425eac2cf1702f2789dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:44.291524 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-460b2c5e-4664-45d9-ac67-ccaacb9e9df8 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:44.292355 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-460b2c5e-4664-45d9-ac67-ccaacb9e9df8 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:44.300182 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-460b2c5e-4664-45d9-ac67-ccaacb9e9df8 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:44.300681 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-460b2c5e-4664-45d9-ac67-ccaacb9e9df8 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:44.301126 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-460b2c5e-4664-45d9-ac67-ccaacb9e9df8 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:44.301286 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e2e0da38-b9ac-4f1b-89da-73de826bf3e0 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/servers/004575c6-51ce-48d9-b7a6-d50f9afdb0a0" status: 200 len: 1474 microversion: 2.1 time: 0.464020 Oct 27 03:36:44.302165 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1770/3793] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:43 2022] GET /compute/v2.1/servers/004575c6-51ce-48d9-b7a6-d50f9afdb0a0 => generated 1474 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:36:44.314272 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-460b2c5e-4664-45d9-ac67-ccaacb9e9df8 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:44.316383 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-460b2c5e-4664-45d9-ac67-ccaacb9e9df8 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:44.317018 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-460b2c5e-4664-45d9-ac67-ccaacb9e9df8 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:44.447652 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-0cc9b3cd-a70c-4d4a-8c62-ba11b64609ea req-22d64f16-483b-4c01-a20d-4f4bf0bef2d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "004575c6-51ce-48d9-b7a6-d50f9afdb0a0", "name": "network-vif-deleted", "tag": "5deebc19-88cc-4f7e-98b2-66507a85ce83"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:36:44.480402 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-0cc9b3cd-a70c-4d4a-8c62-ba11b64609ea req-22d64f16-483b-4c01-a20d-4f4bf0bef2d5 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:44.480900 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-0cc9b3cd-a70c-4d4a-8c62-ba11b64609ea req-22d64f16-483b-4c01-a20d-4f4bf0bef2d5 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:44.481339 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-0cc9b3cd-a70c-4d4a-8c62-ba11b64609ea req-22d64f16-483b-4c01-a20d-4f4bf0bef2d5 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:44.526021 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-0cc9b3cd-a70c-4d4a-8c62-ba11b64609ea req-22d64f16-483b-4c01-a20d-4f4bf0bef2d5 service nova] Creating event network-vif-deleted:5deebc19-88cc-4f7e-98b2-66507a85ce83 for instance 004575c6-51ce-48d9-b7a6-d50f9afdb0a0 on n-h1-862769-1 Oct 27 03:36:44.537150 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-0cc9b3cd-a70c-4d4a-8c62-ba11b64609ea req-22d64f16-483b-4c01-a20d-4f4bf0bef2d5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092953 Oct 27 03:36:44.537781 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1771/3794] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:36:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:36:44.549641 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-460b2c5e-4664-45d9-ac67-ccaacb9e9df8 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:44.561397 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-460b2c5e-4664-45d9-ac67-ccaacb9e9df8 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1527 microversion: 2.1 time: 0.283314 Oct 27 03:36:44.572170 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-173f0217-80a6-4c57-b964-2557da6628c9 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:44.573483 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-173f0217-80a6-4c57-b964-2557da6628c9 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] [instance: 96c8ef8e-9790-4cd5-9a62-a6778b7bf02c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:44.574808 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2024/3795] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:44 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1527 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:44.592140 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-173f0217-80a6-4c57-b964-2557da6628c9 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:44.592140 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-173f0217-80a6-4c57-b964-2557da6628c9 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:44.592140 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-173f0217-80a6-4c57-b964-2557da6628c9 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:44.592140 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-173f0217-80a6-4c57-b964-2557da6628c9 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:44.594216 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-173f0217-80a6-4c57-b964-2557da6628c9 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:44.595079 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-173f0217-80a6-4c57-b964-2557da6628c9 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:44.881684 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-173f0217-80a6-4c57-b964-2557da6628c9 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c36bef85ac34b4983a79e03c56965c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e58f30136ed4a4d9bff48e9b4cde5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:44.898550 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-173f0217-80a6-4c57-b964-2557da6628c9 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] 10.222.0.20 "GET /compute/v2.1/servers/96c8ef8e-9790-4cd5-9a62-a6778b7bf02c" status: 200 len: 1526 microversion: 2.1 time: 0.325240 Oct 27 03:36:44.906088 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1772/3796] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:44 2022] GET /compute/v2.1/servers/96c8ef8e-9790-4cd5-9a62-a6778b7bf02c => generated 1526 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:36:45.305717 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3630bf51-ed1b-46de-81d4-e0962d0d0e85 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:45.308239 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3630bf51-ed1b-46de-81d4-e0962d0d0e85 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: dbb1b9d1-38ff-42da-9e74-91f686f88047] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:45.317807 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3630bf51-ed1b-46de-81d4-e0962d0d0e85 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:45.318864 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3630bf51-ed1b-46de-81d4-e0962d0d0e85 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:45.319789 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3630bf51-ed1b-46de-81d4-e0962d0d0e85 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:45.320712 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3630bf51-ed1b-46de-81d4-e0962d0d0e85 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:45.321507 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3630bf51-ed1b-46de-81d4-e0962d0d0e85 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:45.322313 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3630bf51-ed1b-46de-81d4-e0962d0d0e85 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:45.330330 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f4bb4f48-e525-478d-af0d-ee32f61cbd14 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:45.331049 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f4bb4f48-e525-478d-af0d-ee32f61cbd14 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] [instance: 004575c6-51ce-48d9-b7a6-d50f9afdb0a0] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:45.342743 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f4bb4f48-e525-478d-af0d-ee32f61cbd14 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:45.345610 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f4bb4f48-e525-478d-af0d-ee32f61cbd14 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:45.346322 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f4bb4f48-e525-478d-af0d-ee32f61cbd14 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:45.347015 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f4bb4f48-e525-478d-af0d-ee32f61cbd14 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:45.349408 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f4bb4f48-e525-478d-af0d-ee32f61cbd14 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:45.349926 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f4bb4f48-e525-478d-af0d-ee32f61cbd14 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:45.398465 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=10 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:36:45.423780 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f4bb4f48-e525-478d-af0d-ee32f61cbd14 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:45.424416 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f4bb4f48-e525-478d-af0d-ee32f61cbd14 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:45.428009 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f4bb4f48-e525-478d-af0d-ee32f61cbd14 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:45.430120 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-f4bb4f48-e525-478d-af0d-ee32f61cbd14 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lazy-loading 'fault' on Instance uuid 004575c6-51ce-48d9-b7a6-d50f9afdb0a0 {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:36:45.509060 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f4bb4f48-e525-478d-af0d-ee32f61cbd14 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae7845f6759c4dcabcc1516a72484174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d371ab6648425eac2cf1702f2789dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:45.522408 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f4bb4f48-e525-478d-af0d-ee32f61cbd14 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/servers/004575c6-51ce-48d9-b7a6-d50f9afdb0a0" status: 200 len: 1308 microversion: 2.1 time: 0.196116 Oct 27 03:36:45.526065 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1773/3797] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:45 2022] GET /compute/v2.1/servers/004575c6-51ce-48d9-b7a6-d50f9afdb0a0 => generated 1308 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:45.540050 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-f9b113fa-1f0d-4363-9fb7-394d515e5622 req-d83b9c33-b804-4305-8eef-ee7ea3f58606 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "376ac459-e31f-4727-9e34-535f055ac20d", "name": "network-vif-plugged", "status": "completed", "tag": "e825dd69-54a1-4411-addc-e78fd04434d2"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:36:45.579200 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3630bf51-ed1b-46de-81d4-e0962d0d0e85 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:45.590556 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3630bf51-ed1b-46de-81d4-e0962d0d0e85 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/dbb1b9d1-38ff-42da-9e74-91f686f88047" status: 200 len: 1315 microversion: 2.1 time: 0.288913 Oct 27 03:36:45.596960 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2025/3798] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:45 2022] GET /compute/v2.1/servers/dbb1b9d1-38ff-42da-9e74-91f686f88047 => generated 1315 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:45.609422 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-f9b113fa-1f0d-4363-9fb7-394d515e5622 req-d83b9c33-b804-4305-8eef-ee7ea3f58606 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:45.609905 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-f9b113fa-1f0d-4363-9fb7-394d515e5622 req-d83b9c33-b804-4305-8eef-ee7ea3f58606 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:45.610449 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-f9b113fa-1f0d-4363-9fb7-394d515e5622 req-d83b9c33-b804-4305-8eef-ee7ea3f58606 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:45.612379 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f6368f76-e749-4c19-ad72-c540e87551d4 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:45.613074 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f6368f76-e749-4c19-ad72-c540e87551d4 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:45.629940 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f6368f76-e749-4c19-ad72-c540e87551d4 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:45.634786 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f6368f76-e749-4c19-ad72-c540e87551d4 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:45.634786 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f6368f76-e749-4c19-ad72-c540e87551d4 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:45.634786 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f6368f76-e749-4c19-ad72-c540e87551d4 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:45.634786 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f6368f76-e749-4c19-ad72-c540e87551d4 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:45.634786 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f6368f76-e749-4c19-ad72-c540e87551d4 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:45.653027 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-f9b113fa-1f0d-4363-9fb7-394d515e5622 req-d83b9c33-b804-4305-8eef-ee7ea3f58606 service nova] Creating event network-vif-plugged:e825dd69-54a1-4411-addc-e78fd04434d2 for instance 376ac459-e31f-4727-9e34-535f055ac20d on n-h2-862769-1 Oct 27 03:36:45.666135 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-f9b113fa-1f0d-4363-9fb7-394d515e5622 req-d83b9c33-b804-4305-8eef-ee7ea3f58606 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140734 Oct 27 03:36:45.669812 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1774/3799] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:36:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:36:45.852821 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f6368f76-e749-4c19-ad72-c540e87551d4 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:45.868418 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f6368f76-e749-4c19-ad72-c540e87551d4 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1527 microversion: 2.1 time: 0.270138 Oct 27 03:36:45.882083 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2026/3800] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:45 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1527 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:45.925623 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1ef563e7-e4d5-4ee4-9733-a85768d3cd55 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:45.926444 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1ef563e7-e4d5-4ee4-9733-a85768d3cd55 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] [instance: 96c8ef8e-9790-4cd5-9a62-a6778b7bf02c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:45.940673 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1ef563e7-e4d5-4ee4-9733-a85768d3cd55 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:45.941181 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1ef563e7-e4d5-4ee4-9733-a85768d3cd55 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:45.941632 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1ef563e7-e4d5-4ee4-9733-a85768d3cd55 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:45.942482 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1ef563e7-e4d5-4ee4-9733-a85768d3cd55 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:45.943704 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1ef563e7-e4d5-4ee4-9733-a85768d3cd55 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:45.944334 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1ef563e7-e4d5-4ee4-9733-a85768d3cd55 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:46.035879 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1ef563e7-e4d5-4ee4-9733-a85768d3cd55 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c36bef85ac34b4983a79e03c56965c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e58f30136ed4a4d9bff48e9b4cde5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:46.045754 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1ef563e7-e4d5-4ee4-9733-a85768d3cd55 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] 10.222.0.20 "GET /compute/v2.1/servers/96c8ef8e-9790-4cd5-9a62-a6778b7bf02c" status: 200 len: 1484 microversion: 2.1 time: 0.125502 Oct 27 03:36:46.047138 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1775/3801] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:45 2022] GET /compute/v2.1/servers/96c8ef8e-9790-4cd5-9a62-a6778b7bf02c => generated 1484 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:46.559465 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-93c0e72a-6a94-478d-820b-ac86341493a9 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:46.572044 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-93c0e72a-6a94-478d-820b-ac86341493a9 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] [instance: 004575c6-51ce-48d9-b7a6-d50f9afdb0a0] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:46.572488 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-814383d8-8cfc-4247-bb4c-f8ae5b8ebd0d req-1359bb6a-35e3-464a-944b-0222e67e742a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96c8ef8e-9790-4cd5-9a62-a6778b7bf02c", "name": "network-vif-deleted", "tag": "5fa8e579-0ecc-4468-b878-97bf0608962b"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:36:46.592658 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-93c0e72a-6a94-478d-820b-ac86341493a9 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:46.595658 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-93c0e72a-6a94-478d-820b-ac86341493a9 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:46.596372 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-93c0e72a-6a94-478d-820b-ac86341493a9 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:46.598623 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-93c0e72a-6a94-478d-820b-ac86341493a9 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:46.600079 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-814383d8-8cfc-4247-bb4c-f8ae5b8ebd0d req-1359bb6a-35e3-464a-944b-0222e67e742a service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:46.600573 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-814383d8-8cfc-4247-bb4c-f8ae5b8ebd0d req-1359bb6a-35e3-464a-944b-0222e67e742a service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:46.600895 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-93c0e72a-6a94-478d-820b-ac86341493a9 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:46.601429 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-93c0e72a-6a94-478d-820b-ac86341493a9 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:46.602374 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-814383d8-8cfc-4247-bb4c-f8ae5b8ebd0d req-1359bb6a-35e3-464a-944b-0222e67e742a service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:46.629792 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-814383d8-8cfc-4247-bb4c-f8ae5b8ebd0d req-1359bb6a-35e3-464a-944b-0222e67e742a service nova] Creating event network-vif-deleted:5fa8e579-0ecc-4468-b878-97bf0608962b for instance 96c8ef8e-9790-4cd5-9a62-a6778b7bf02c on n-h1-862769-1 Oct 27 03:36:46.636714 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-814383d8-8cfc-4247-bb4c-f8ae5b8ebd0d req-1359bb6a-35e3-464a-944b-0222e67e742a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071274 Oct 27 03:36:46.642525 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-93c0e72a-6a94-478d-820b-ac86341493a9 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] HTTP exception thrown: Instance 004575c6-51ce-48d9-b7a6-d50f9afdb0a0 could not be found. Oct 27 03:36:46.644189 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1776/3802] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:36:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:36:46.647717 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-93c0e72a-6a94-478d-820b-ac86341493a9 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Request method failure captured: Oct 27 03:36:46.647717 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/004575c6-51ce-48d9-b7a6-d50f9afdb0a0 HTTP/1.1 Oct 27 03:36:46.647717 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:36:46.647717 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:36:46.647717 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:36:46.647717 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:36:46.647717 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:36:46.647717 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:36:46.647717 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:36:46.647717 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:36:46.647717 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfwwmpiSeYbqY1HFz8dGnrpgQKgSn1A-XXvLCWSYnFNXRTdg-U9nT4bXxikihcs0niMRC8vhmZmEA6qlrKlxGAhIBPyO4oKNSKuZwvpy5x4EGTHCvKp4bxCW3yXLBUdsGJZwCx1hZiUFkpb29DrAp508nsBnbFJHk1ligQz5XKRoPy0 Oct 27 03:36:46.647717 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:36:46.647717 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:36:46.647717 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:36:46.647717 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:36:46.647717 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:36:46.647717 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:36:46.647717 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 98d371ab6648425eac2cf1702f2789dc Oct 27 03:36:46.647717 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ListImageFiltersTestJSON-1162809373 Oct 27 03:36:46.647717 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:36:46.647717 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:36:46.647717 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/98d371ab6648425eac2cf1702f2789dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/98d371ab6648425eac2cf1702f2789dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/98d371ab6648425eac2cf1702f2789dc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_98d371ab6648425eac2cf1702f2789dc"}]}] Oct 27 03:36:46.647717 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ListImageFiltersTestJSON-1162809373 Oct 27 03:36:46.647717 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 98d371ab6648425eac2cf1702f2789dc Oct 27 03:36:46.647717 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1162809373 Oct 27 03:36:46.647717 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ListImageFiltersTestJSON-1162809373-project Oct 27 03:36:46.647717 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:36:46.647717 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:36:46.647717 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: ae7845f6759c4dcabcc1516a72484174 Oct 27 03:36:46.647717 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ListImageFiltersTestJSON-1162809373-project Oct 27 03:36:46.647717 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:36:46.647717 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 004575c6-51ce-48d9-b7a6-d50f9afdb0a0 could not be found. Oct 27 03:36:46.647717 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '004575c6-51ce-48d9-b7a6-d50f9afdb0a0'} Oct 27 03:36:46.647717 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:36:46.647717 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:36:46.647717 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:36:46.647717 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:36:46.647717 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:36:46.647717 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:36:46.647717 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:36:46.647717 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:36:46.647717 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:36:46.647717 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:36:46.647717 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 004575c6-51ce-48d9-b7a6-d50f9afdb0a0 could not be found. Oct 27 03:36:46.647717 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:46.647717 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:36:46.647717 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:46.647717 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:36:46.647717 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:36:46.647717 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:36:46.647717 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:36:46.647717 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:36:46.647717 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:36:46.647717 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:36:46.647717 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:36:46.647717 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:36:46.647717 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:36:46.647717 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:36:46.647717 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:36:46.647717 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:36:46.647717 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 004575c6-51ce-48d9-b7a6-d50f9afdb0a0 could not be found. Oct 27 03:36:46.647717 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:46.647717 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:36:46.647717 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:46.653945 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:36:46.653945 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:36:46.653945 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:36:46.653945 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:36:46.653945 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:36:46.653945 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 004575c6-51ce-48d9-b7a6-d50f9afdb0a0 could not be found. Oct 27 03:36:46.653945 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:46.657316 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6b7b8109-fbd4-4998-8d05-7060b5348a35 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:46.657415 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-93c0e72a-6a94-478d-820b-ac86341493a9 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Returning 404 to user: Instance 004575c6-51ce-48d9-b7a6-d50f9afdb0a0 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:36:46.657515 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6b7b8109-fbd4-4998-8d05-7060b5348a35 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: dbb1b9d1-38ff-42da-9e74-91f686f88047] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:46.657612 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-93c0e72a-6a94-478d-820b-ac86341493a9 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/servers/004575c6-51ce-48d9-b7a6-d50f9afdb0a0" status: 404 len: 111 microversion: 2.1 time: 0.101684 Oct 27 03:36:46.657612 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2027/3803] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:46 2022] GET /compute/v2.1/servers/004575c6-51ce-48d9-b7a6-d50f9afdb0a0 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:36:46.663794 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6b7b8109-fbd4-4998-8d05-7060b5348a35 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:46.664322 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6b7b8109-fbd4-4998-8d05-7060b5348a35 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:46.665896 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6b7b8109-fbd4-4998-8d05-7060b5348a35 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:46.670138 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6b7b8109-fbd4-4998-8d05-7060b5348a35 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:46.670138 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6b7b8109-fbd4-4998-8d05-7060b5348a35 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:46.670138 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6b7b8109-fbd4-4998-8d05-7060b5348a35 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:46.674269 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-66ed20d2-6bba-46d7-bd76-5c2d8bc4e3b9 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:46.679625 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-66ed20d2-6bba-46d7-bd76-5c2d8bc4e3b9 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] [instance: f50da5a9-2bb6-4735-93c3-d73ece0964f3] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:46.698702 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-66ed20d2-6bba-46d7-bd76-5c2d8bc4e3b9 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:46.699308 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-66ed20d2-6bba-46d7-bd76-5c2d8bc4e3b9 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:46.699953 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-66ed20d2-6bba-46d7-bd76-5c2d8bc4e3b9 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:46.700833 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-66ed20d2-6bba-46d7-bd76-5c2d8bc4e3b9 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:46.701294 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-66ed20d2-6bba-46d7-bd76-5c2d8bc4e3b9 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:46.701727 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-66ed20d2-6bba-46d7-bd76-5c2d8bc4e3b9 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:46.749858 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-66ed20d2-6bba-46d7-bd76-5c2d8bc4e3b9 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] [instance: f50da5a9-2bb6-4735-93c3-d73ece0964f3] Going to try to terminate instance {{(pid=121001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:36:46.941862 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-6b7b8109-fbd4-4998-8d05-7060b5348a35 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:46.951873 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6b7b8109-fbd4-4998-8d05-7060b5348a35 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/dbb1b9d1-38ff-42da-9e74-91f686f88047" status: 200 len: 1315 microversion: 2.1 time: 0.305807 Oct 27 03:36:46.953464 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1777/3804] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:46 2022] GET /compute/v2.1/servers/dbb1b9d1-38ff-42da-9e74-91f686f88047 => generated 1315 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:46.959763 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-51c98814-7cc8-4c9a-9469-bdf6e47e24fc tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:46.960929 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-51c98814-7cc8-4c9a-9469-bdf6e47e24fc tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:46.973562 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-51c98814-7cc8-4c9a-9469-bdf6e47e24fc tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:46.980172 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-51c98814-7cc8-4c9a-9469-bdf6e47e24fc tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:46.980916 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-51c98814-7cc8-4c9a-9469-bdf6e47e24fc tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:46.982890 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-51c98814-7cc8-4c9a-9469-bdf6e47e24fc tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:46.983685 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-51c98814-7cc8-4c9a-9469-bdf6e47e24fc tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:46.984364 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-51c98814-7cc8-4c9a-9469-bdf6e47e24fc tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:47.163065 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-66ed20d2-6bba-46d7-bd76-5c2d8bc4e3b9 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f50da5a9-2bb6-4735-93c3-d73ece0964f3" status: 204 len: 0 microversion: 2.1 time: 0.501860 Oct 27 03:36:47.164628 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2028/3805] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:36:46 2022] DELETE /compute/v2.1/servers/f50da5a9-2bb6-4735-93c3-d73ece0964f3 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:36:47.186936 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b9eb7d5f-d2fb-402d-8284-e448e939f581 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:47.188079 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b9eb7d5f-d2fb-402d-8284-e448e939f581 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] [instance: 96c8ef8e-9790-4cd5-9a62-a6778b7bf02c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:47.207826 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b9eb7d5f-d2fb-402d-8284-e448e939f581 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:47.208626 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b9eb7d5f-d2fb-402d-8284-e448e939f581 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:47.210700 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b9eb7d5f-d2fb-402d-8284-e448e939f581 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:47.212857 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b9eb7d5f-d2fb-402d-8284-e448e939f581 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:47.214022 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-51c98814-7cc8-4c9a-9469-bdf6e47e24fc tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:47.224440 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b9eb7d5f-d2fb-402d-8284-e448e939f581 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:47.224941 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b9eb7d5f-d2fb-402d-8284-e448e939f581 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:47.229339 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-51c98814-7cc8-4c9a-9469-bdf6e47e24fc tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1527 microversion: 2.1 time: 0.274126 Oct 27 03:36:47.230314 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1778/3806] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:46 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1527 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:47.253682 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-df57e527-a030-4751-a159-29d46ab2e680 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:47.254673 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-df57e527-a030-4751-a159-29d46ab2e680 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] [instance: f50da5a9-2bb6-4735-93c3-d73ece0964f3] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:47.261816 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-df57e527-a030-4751-a159-29d46ab2e680 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:47.263797 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-df57e527-a030-4751-a159-29d46ab2e680 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:47.264416 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-df57e527-a030-4751-a159-29d46ab2e680 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:47.265593 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-df57e527-a030-4751-a159-29d46ab2e680 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:47.267202 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-df57e527-a030-4751-a159-29d46ab2e680 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:47.267805 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-df57e527-a030-4751-a159-29d46ab2e680 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:47.301685 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b9eb7d5f-d2fb-402d-8284-e448e939f581 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:47.302214 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b9eb7d5f-d2fb-402d-8284-e448e939f581 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:47.304413 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b9eb7d5f-d2fb-402d-8284-e448e939f581 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:47.304899 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-b9eb7d5f-d2fb-402d-8284-e448e939f581 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lazy-loading 'fault' on Instance uuid 96c8ef8e-9790-4cd5-9a62-a6778b7bf02c {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:36:47.371113 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b9eb7d5f-d2fb-402d-8284-e448e939f581 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c36bef85ac34b4983a79e03c56965c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e58f30136ed4a4d9bff48e9b4cde5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:47.384321 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b9eb7d5f-d2fb-402d-8284-e448e939f581 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] 10.222.0.20 "GET /compute/v2.1/servers/96c8ef8e-9790-4cd5-9a62-a6778b7bf02c" status: 200 len: 1314 microversion: 2.1 time: 0.216399 Oct 27 03:36:47.394684 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2029/3807] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:47 2022] GET /compute/v2.1/servers/96c8ef8e-9790-4cd5-9a62-a6778b7bf02c => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:47.452499 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f308dcd1-a69c-4bce-9d96-ff936ea4c25c tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:47.454618 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f308dcd1-a69c-4bce-9d96-ff936ea4c25c tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] [instance: 2a1bda43-af44-432d-8992-94473a5f8b5d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:47.465699 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f308dcd1-a69c-4bce-9d96-ff936ea4c25c tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:47.470309 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f308dcd1-a69c-4bce-9d96-ff936ea4c25c tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:47.471727 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f308dcd1-a69c-4bce-9d96-ff936ea4c25c tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:47.474563 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f308dcd1-a69c-4bce-9d96-ff936ea4c25c tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:47.475237 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f308dcd1-a69c-4bce-9d96-ff936ea4c25c tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:47.475892 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f308dcd1-a69c-4bce-9d96-ff936ea4c25c tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:47.496289 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-df57e527-a030-4751-a159-29d46ab2e680 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae7845f6759c4dcabcc1516a72484174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d371ab6648425eac2cf1702f2789dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:47.509571 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-df57e527-a030-4751-a159-29d46ab2e680 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/servers/f50da5a9-2bb6-4735-93c3-d73ece0964f3" status: 200 len: 1473 microversion: 2.1 time: 0.276226 Oct 27 03:36:47.511947 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1779/3808] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:47 2022] GET /compute/v2.1/servers/f50da5a9-2bb6-4735-93c3-d73ece0964f3 => generated 1473 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:47.513330 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f308dcd1-a69c-4bce-9d96-ff936ea4c25c tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] [instance: 2a1bda43-af44-432d-8992-94473a5f8b5d] Going to try to terminate instance {{(pid=121001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:36:47.685431 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-f475e072-07de-47de-8f94-e47e1b1dfd2d req-3baff604-6157-41e1-9eb3-f9e7371ef761 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbb1b9d1-38ff-42da-9e74-91f686f88047", "name": "network-vif-plugged", "status": "completed", "tag": "6005c662-3d62-4cfd-8135-e32257e5003f"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:36:47.702086 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-f475e072-07de-47de-8f94-e47e1b1dfd2d req-3baff604-6157-41e1-9eb3-f9e7371ef761 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:47.704316 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-f475e072-07de-47de-8f94-e47e1b1dfd2d req-3baff604-6157-41e1-9eb3-f9e7371ef761 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:47.706335 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-f475e072-07de-47de-8f94-e47e1b1dfd2d req-3baff604-6157-41e1-9eb3-f9e7371ef761 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:47.726432 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-f475e072-07de-47de-8f94-e47e1b1dfd2d req-3baff604-6157-41e1-9eb3-f9e7371ef761 service nova] Creating event network-vif-plugged:6005c662-3d62-4cfd-8135-e32257e5003f for instance dbb1b9d1-38ff-42da-9e74-91f686f88047 on n-h2-862769-1 Oct 27 03:36:47.733590 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-f475e072-07de-47de-8f94-e47e1b1dfd2d req-3baff604-6157-41e1-9eb3-f9e7371ef761 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052359 Oct 27 03:36:47.734478 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1780/3809] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:36:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:36:47.808199 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f308dcd1-a69c-4bce-9d96-ff936ea4c25c tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2a1bda43-af44-432d-8992-94473a5f8b5d" status: 204 len: 0 microversion: 2.1 time: 0.360165 Oct 27 03:36:47.816930 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2030/3810] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:36:47 2022] DELETE /compute/v2.1/servers/2a1bda43-af44-432d-8992-94473a5f8b5d => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 03:36:47.820266 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2e96d16f-9de6-4e74-ad4c-3cf5b8862796 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:47.820266 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-2e96d16f-9de6-4e74-ad4c-3cf5b8862796 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] [instance: 2a1bda43-af44-432d-8992-94473a5f8b5d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:47.837957 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2e96d16f-9de6-4e74-ad4c-3cf5b8862796 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:47.838486 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2e96d16f-9de6-4e74-ad4c-3cf5b8862796 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:47.838931 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2e96d16f-9de6-4e74-ad4c-3cf5b8862796 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:47.839646 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2e96d16f-9de6-4e74-ad4c-3cf5b8862796 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:47.840149 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2e96d16f-9de6-4e74-ad4c-3cf5b8862796 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:47.840572 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2e96d16f-9de6-4e74-ad4c-3cf5b8862796 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:47.978317 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f09f9f50-40fd-4874-a9eb-c6f4915f0344 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:47.979475 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f09f9f50-40fd-4874-a9eb-c6f4915f0344 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: dbb1b9d1-38ff-42da-9e74-91f686f88047] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:47.992496 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f09f9f50-40fd-4874-a9eb-c6f4915f0344 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:47.993318 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f09f9f50-40fd-4874-a9eb-c6f4915f0344 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:47.996191 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f09f9f50-40fd-4874-a9eb-c6f4915f0344 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:47.996191 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f09f9f50-40fd-4874-a9eb-c6f4915f0344 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:47.996191 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f09f9f50-40fd-4874-a9eb-c6f4915f0344 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:47.996191 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f09f9f50-40fd-4874-a9eb-c6f4915f0344 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:48.024862 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2e96d16f-9de6-4e74-ad4c-3cf5b8862796 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d5d3f1bf1af4cd6884297b207597fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a1ba64cf9c47d5bdae52477338099e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:48.033003 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2e96d16f-9de6-4e74-ad4c-3cf5b8862796 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] 10.222.0.20 "GET /compute/v2.1/servers/2a1bda43-af44-432d-8992-94473a5f8b5d" status: 200 len: 1665 microversion: 2.1 time: 0.218370 Oct 27 03:36:48.034577 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1781/3811] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:47 2022] GET /compute/v2.1/servers/2a1bda43-af44-432d-8992-94473a5f8b5d => generated 1665 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:36:48.175177 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f09f9f50-40fd-4874-a9eb-c6f4915f0344 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:48.191568 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f09f9f50-40fd-4874-a9eb-c6f4915f0344 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/dbb1b9d1-38ff-42da-9e74-91f686f88047" status: 200 len: 1315 microversion: 2.1 time: 0.217669 Oct 27 03:36:48.214163 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2031/3812] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:47 2022] GET /compute/v2.1/servers/dbb1b9d1-38ff-42da-9e74-91f686f88047 => generated 1315 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:48.260790 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9171a3c1-86e3-4cab-85f6-9fb7f514dad0 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:48.261713 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9171a3c1-86e3-4cab-85f6-9fb7f514dad0 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:48.270937 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9171a3c1-86e3-4cab-85f6-9fb7f514dad0 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:48.272166 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9171a3c1-86e3-4cab-85f6-9fb7f514dad0 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:48.272833 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9171a3c1-86e3-4cab-85f6-9fb7f514dad0 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:48.273685 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9171a3c1-86e3-4cab-85f6-9fb7f514dad0 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:48.274826 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9171a3c1-86e3-4cab-85f6-9fb7f514dad0 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:48.275781 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9171a3c1-86e3-4cab-85f6-9fb7f514dad0 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:48.409290 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1c21726d-aa83-40f5-a5a6-d3e6d4b221b8 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:48.409925 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1c21726d-aa83-40f5-a5a6-d3e6d4b221b8 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] [instance: 96c8ef8e-9790-4cd5-9a62-a6778b7bf02c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:48.418107 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1c21726d-aa83-40f5-a5a6-d3e6d4b221b8 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:48.419013 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1c21726d-aa83-40f5-a5a6-d3e6d4b221b8 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:48.420198 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1c21726d-aa83-40f5-a5a6-d3e6d4b221b8 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:48.421314 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1c21726d-aa83-40f5-a5a6-d3e6d4b221b8 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:48.422181 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1c21726d-aa83-40f5-a5a6-d3e6d4b221b8 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:48.422830 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1c21726d-aa83-40f5-a5a6-d3e6d4b221b8 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:48.474177 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1c21726d-aa83-40f5-a5a6-d3e6d4b221b8 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:48.474955 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1c21726d-aa83-40f5-a5a6-d3e6d4b221b8 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:48.475733 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1c21726d-aa83-40f5-a5a6-d3e6d4b221b8 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:48.476269 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-1c21726d-aa83-40f5-a5a6-d3e6d4b221b8 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lazy-loading 'fault' on Instance uuid 96c8ef8e-9790-4cd5-9a62-a6778b7bf02c {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:36:48.476944 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9171a3c1-86e3-4cab-85f6-9fb7f514dad0 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:48.486275 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9171a3c1-86e3-4cab-85f6-9fb7f514dad0 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1527 microversion: 2.1 time: 0.231087 Oct 27 03:36:48.486874 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1782/3813] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:48 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1527 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:48.538955 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1c21726d-aa83-40f5-a5a6-d3e6d4b221b8 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c36bef85ac34b4983a79e03c56965c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e58f30136ed4a4d9bff48e9b4cde5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:48.539948 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9c23abf9-1564-4962-9429-2ee0580cd69a tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:48.541039 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9c23abf9-1564-4962-9429-2ee0580cd69a tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] [instance: f50da5a9-2bb6-4735-93c3-d73ece0964f3] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:48.549235 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9c23abf9-1564-4962-9429-2ee0580cd69a tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:48.550019 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9c23abf9-1564-4962-9429-2ee0580cd69a tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:48.550721 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9c23abf9-1564-4962-9429-2ee0580cd69a tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:48.551633 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9c23abf9-1564-4962-9429-2ee0580cd69a tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:48.552139 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9c23abf9-1564-4962-9429-2ee0580cd69a tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:48.552936 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9c23abf9-1564-4962-9429-2ee0580cd69a tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:48.554551 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1c21726d-aa83-40f5-a5a6-d3e6d4b221b8 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] 10.222.0.20 "GET /compute/v2.1/servers/96c8ef8e-9790-4cd5-9a62-a6778b7bf02c" status: 200 len: 1314 microversion: 2.1 time: 0.148940 Oct 27 03:36:48.555360 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2032/3814] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:48 2022] GET /compute/v2.1/servers/96c8ef8e-9790-4cd5-9a62-a6778b7bf02c => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:48.705733 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9c23abf9-1564-4962-9429-2ee0580cd69a tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae7845f6759c4dcabcc1516a72484174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d371ab6648425eac2cf1702f2789dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:48.711295 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9c23abf9-1564-4962-9429-2ee0580cd69a tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/servers/f50da5a9-2bb6-4735-93c3-d73ece0964f3" status: 200 len: 1473 microversion: 2.1 time: 0.177087 Oct 27 03:36:48.711877 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1783/3815] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:48 2022] GET /compute/v2.1/servers/f50da5a9-2bb6-4735-93c3-d73ece0964f3 => generated 1473 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:49.061869 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-73f20d15-b798-48cf-90b3-eeddcd0d0ad8 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:49.064069 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-73f20d15-b798-48cf-90b3-eeddcd0d0ad8 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] [instance: 2a1bda43-af44-432d-8992-94473a5f8b5d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:49.073088 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-73f20d15-b798-48cf-90b3-eeddcd0d0ad8 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:49.073766 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-73f20d15-b798-48cf-90b3-eeddcd0d0ad8 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:49.076074 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-73f20d15-b798-48cf-90b3-eeddcd0d0ad8 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:49.076074 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-73f20d15-b798-48cf-90b3-eeddcd0d0ad8 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:49.076305 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-73f20d15-b798-48cf-90b3-eeddcd0d0ad8 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:49.076621 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-73f20d15-b798-48cf-90b3-eeddcd0d0ad8 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:49.214708 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-317ae16f-382a-41da-8d1e-661c06d92647 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:49.215334 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-317ae16f-382a-41da-8d1e-661c06d92647 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: dbb1b9d1-38ff-42da-9e74-91f686f88047] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:49.230782 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-317ae16f-382a-41da-8d1e-661c06d92647 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:49.231736 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-317ae16f-382a-41da-8d1e-661c06d92647 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:49.233213 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-317ae16f-382a-41da-8d1e-661c06d92647 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:49.234506 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-317ae16f-382a-41da-8d1e-661c06d92647 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:49.235145 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-317ae16f-382a-41da-8d1e-661c06d92647 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:49.244206 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-317ae16f-382a-41da-8d1e-661c06d92647 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:49.308012 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-73f20d15-b798-48cf-90b3-eeddcd0d0ad8 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d5d3f1bf1af4cd6884297b207597fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a1ba64cf9c47d5bdae52477338099e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:49.316556 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-73f20d15-b798-48cf-90b3-eeddcd0d0ad8 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] 10.222.0.20 "GET /compute/v2.1/servers/2a1bda43-af44-432d-8992-94473a5f8b5d" status: 200 len: 1665 microversion: 2.1 time: 0.260881 Oct 27 03:36:49.320037 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2033/3816] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:49 2022] GET /compute/v2.1/servers/2a1bda43-af44-432d-8992-94473a5f8b5d => generated 1665 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:36:49.509135 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-172e30d0-8799-4f27-abb9-44478010ee7e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:49.509929 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-172e30d0-8799-4f27-abb9-44478010ee7e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:49.522441 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-172e30d0-8799-4f27-abb9-44478010ee7e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:49.523109 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-172e30d0-8799-4f27-abb9-44478010ee7e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:49.523812 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-172e30d0-8799-4f27-abb9-44478010ee7e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:49.524790 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-172e30d0-8799-4f27-abb9-44478010ee7e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:49.527513 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-172e30d0-8799-4f27-abb9-44478010ee7e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:49.528252 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-172e30d0-8799-4f27-abb9-44478010ee7e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:49.590516 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:36:49.620929 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-317ae16f-382a-41da-8d1e-661c06d92647 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:49.623942 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=100 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:36:49.633121 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-317ae16f-382a-41da-8d1e-661c06d92647 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/dbb1b9d1-38ff-42da-9e74-91f686f88047" status: 200 len: 1315 microversion: 2.1 time: 0.422374 Oct 27 03:36:49.636294 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1784/3817] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:49 2022] GET /compute/v2.1/servers/dbb1b9d1-38ff-42da-9e74-91f686f88047 => generated 1315 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:36:49.648946 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-349ab1bf-d723-4e01-bc9c-5ea15b012e8f tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:49.649570 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-349ab1bf-d723-4e01-bc9c-5ea15b012e8f tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] [instance: 96c8ef8e-9790-4cd5-9a62-a6778b7bf02c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:49.670789 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-349ab1bf-d723-4e01-bc9c-5ea15b012e8f tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:49.671657 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-349ab1bf-d723-4e01-bc9c-5ea15b012e8f tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:49.673424 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-349ab1bf-d723-4e01-bc9c-5ea15b012e8f tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:49.676260 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-349ab1bf-d723-4e01-bc9c-5ea15b012e8f tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:49.676943 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-349ab1bf-d723-4e01-bc9c-5ea15b012e8f tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:49.677655 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-349ab1bf-d723-4e01-bc9c-5ea15b012e8f tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:49.708412 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-349ab1bf-d723-4e01-bc9c-5ea15b012e8f tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] HTTP exception thrown: Instance 96c8ef8e-9790-4cd5-9a62-a6778b7bf02c could not be found. Oct 27 03:36:49.712093 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-349ab1bf-d723-4e01-bc9c-5ea15b012e8f tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Request method failure captured: Oct 27 03:36:49.712093 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/96c8ef8e-9790-4cd5-9a62-a6778b7bf02c HTTP/1.1 Oct 27 03:36:49.712093 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:36:49.712093 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:36:49.712093 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:36:49.712093 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:36:49.712093 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:36:49.712093 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:36:49.712093 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:36:49.712093 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:36:49.712093 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfx5Hbc6ITbdSRFtS1-RYRPTs8xU2lFAIvTX0CRBjp8hijBP6KjJjfK-rUuEjncsIe7o_mkFNeieFkwqoNyxVxCVqSYWPgHA26VD6r86MpHHV_eFwebptw3rA_gpbw5SDVw15ZqeHqKSf2NQXZk1XM_suSoUNVero4I26u6VER7fLwA Oct 27 03:36:49.712093 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:36:49.712093 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:36:49.712093 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:36:49.712093 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:36:49.712093 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:36:49.712093 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:36:49.712093 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 2e58f30136ed4a4d9bff48e9b4cde5a8 Oct 27 03:36:49.712093 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-597177073 Oct 27 03:36:49.712093 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:36:49.712093 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:36:49.712093 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2e58f30136ed4a4d9bff48e9b4cde5a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2e58f30136ed4a4d9bff48e9b4cde5a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2e58f30136ed4a4d9bff48e9b4cde5a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2e58f30136ed4a4d9bff48e9b4cde5a8"}]}] Oct 27 03:36:49.712093 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-597177073 Oct 27 03:36:49.712093 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 2e58f30136ed4a4d9bff48e9b4cde5a8 Oct 27 03:36:49.712093 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-597177073 Oct 27 03:36:49.712093 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ImagesOneServerNegativeTestJSON-597177073-project Oct 27 03:36:49.712093 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:36:49.712093 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:36:49.712093 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 5c36bef85ac34b4983a79e03c56965c5 Oct 27 03:36:49.712093 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-597177073-project Oct 27 03:36:49.712093 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:36:49.712093 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 96c8ef8e-9790-4cd5-9a62-a6778b7bf02c could not be found. Oct 27 03:36:49.712093 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '96c8ef8e-9790-4cd5-9a62-a6778b7bf02c'} Oct 27 03:36:49.712093 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:36:49.712093 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:36:49.712093 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:36:49.712093 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:36:49.712093 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:36:49.712093 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:36:49.712093 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:36:49.712093 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:36:49.712093 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:36:49.712093 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:36:49.712093 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96c8ef8e-9790-4cd5-9a62-a6778b7bf02c could not be found. Oct 27 03:36:49.712093 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:36:49.712093 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:36:49.712093 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:36:49.712093 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:36:49.712093 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:36:49.712093 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:36:49.712093 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:36:49.712093 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:36:49.712093 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:36:49.712093 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:36:49.712093 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:36:49.712093 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:36:49.712093 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:36:49.712093 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:36:49.712093 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:36:49.712093 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:36:49.712093 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96c8ef8e-9790-4cd5-9a62-a6778b7bf02c could not be found. Oct 27 03:36:49.712093 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:36:49.712093 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:36:49.721759 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:36:49.721759 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:36:49.721759 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:36:49.721759 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:36:49.721759 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:36:49.721759 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:36:49.721759 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96c8ef8e-9790-4cd5-9a62-a6778b7bf02c could not be found. Oct 27 03:36:49.721759 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:36:49.721759 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-349ab1bf-d723-4e01-bc9c-5ea15b012e8f tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Returning 404 to user: Instance 96c8ef8e-9790-4cd5-9a62-a6778b7bf02c could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:36:49.721759 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-349ab1bf-d723-4e01-bc9c-5ea15b012e8f tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] 10.222.0.20 "GET /compute/v2.1/servers/96c8ef8e-9790-4cd5-9a62-a6778b7bf02c" status: 404 len: 111 microversion: 2.1 time: 0.076559 Oct 27 03:36:49.721759 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1785/3818] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:49 2022] GET /compute/v2.1/servers/96c8ef8e-9790-4cd5-9a62-a6778b7bf02c => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:36:49.738075 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-76b770ad-ae5a-43b0-b31f-3f02f7c81c10 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:49.745842 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-76b770ad-ae5a-43b0-b31f-3f02f7c81c10 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] [instance: f50da5a9-2bb6-4735-93c3-d73ece0964f3] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:49.760103 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-76b770ad-ae5a-43b0-b31f-3f02f7c81c10 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:49.764865 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-76b770ad-ae5a-43b0-b31f-3f02f7c81c10 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:49.765578 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-76b770ad-ae5a-43b0-b31f-3f02f7c81c10 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:49.766591 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-76b770ad-ae5a-43b0-b31f-3f02f7c81c10 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:49.767274 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-76b770ad-ae5a-43b0-b31f-3f02f7c81c10 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:49.767939 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-76b770ad-ae5a-43b0-b31f-3f02f7c81c10 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:49.844679 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-172e30d0-8799-4f27-abb9-44478010ee7e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:49.856784 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-172e30d0-8799-4f27-abb9-44478010ee7e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1527 microversion: 2.1 time: 0.351120 Oct 27 03:36:49.857395 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2034/3819] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:49 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1527 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:49.909282 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d74d1e60-766f-4b40-9150-f4173f2cca8d tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-779690846", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:36:49.930803 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:36:49.977414 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.network.neutron [None req-d74d1e60-766f-4b40-9150-f4173f2cca8d tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] validate_networks() for [('ee40dc00-9956-4077-969f-dfdca68cbee6', None, None, None, None, None)] {{(pid=121001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:36:50.105326 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-76b770ad-ae5a-43b0-b31f-3f02f7c81c10 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae7845f6759c4dcabcc1516a72484174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d371ab6648425eac2cf1702f2789dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:50.120479 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-76b770ad-ae5a-43b0-b31f-3f02f7c81c10 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/servers/f50da5a9-2bb6-4735-93c3-d73ece0964f3" status: 200 len: 1473 microversion: 2.1 time: 0.386508 Oct 27 03:36:50.126025 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1786/3820] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:49 2022] GET /compute/v2.1/servers/f50da5a9-2bb6-4735-93c3-d73ece0964f3 => generated 1473 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:50.358226 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-79614c47-c08c-4f56-94f3-ac63472d0cab tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:50.359480 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-79614c47-c08c-4f56-94f3-ac63472d0cab tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] [instance: 2a1bda43-af44-432d-8992-94473a5f8b5d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:50.383095 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-79614c47-c08c-4f56-94f3-ac63472d0cab tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:50.386620 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-79614c47-c08c-4f56-94f3-ac63472d0cab tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:50.392140 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-79614c47-c08c-4f56-94f3-ac63472d0cab tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:50.392140 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-79614c47-c08c-4f56-94f3-ac63472d0cab tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:50.392140 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-79614c47-c08c-4f56-94f3-ac63472d0cab tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:50.392140 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-79614c47-c08c-4f56-94f3-ac63472d0cab tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:50.842659 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-79614c47-c08c-4f56-94f3-ac63472d0cab tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d5d3f1bf1af4cd6884297b207597fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a1ba64cf9c47d5bdae52477338099e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:50.859518 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-79614c47-c08c-4f56-94f3-ac63472d0cab tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] 10.222.0.20 "GET /compute/v2.1/servers/2a1bda43-af44-432d-8992-94473a5f8b5d" status: 200 len: 1665 microversion: 2.1 time: 0.520475 Oct 27 03:36:50.864081 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1787/3821] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:50 2022] GET /compute/v2.1/servers/2a1bda43-af44-432d-8992-94473a5f8b5d => generated 1665 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:50.880218 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-17078157-589f-455c-97eb-cd1aeaef8ad6 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:50.880655 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-17078157-589f-455c-97eb-cd1aeaef8ad6 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: c5c50ae8-6217-4650-8420-291847e21ace] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:50.905780 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-17078157-589f-455c-97eb-cd1aeaef8ad6 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:50.913587 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-17078157-589f-455c-97eb-cd1aeaef8ad6 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:50.914952 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-17078157-589f-455c-97eb-cd1aeaef8ad6 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:50.921000 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-17078157-589f-455c-97eb-cd1aeaef8ad6 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:50.921465 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-17078157-589f-455c-97eb-cd1aeaef8ad6 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:50.925225 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-17078157-589f-455c-97eb-cd1aeaef8ad6 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:50.931552 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-d74d1e60-766f-4b40-9150-f4173f2cca8d tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Flavor limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:36:50.932150 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-d74d1e60-766f-4b40-9150-f4173f2cca8d tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Image limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:36:50.932465 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-d74d1e60-766f-4b40-9150-f4173f2cca8d tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Flavor pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:36:50.932884 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-d74d1e60-766f-4b40-9150-f4173f2cca8d tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Image pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:36:50.933307 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-d74d1e60-766f-4b40-9150-f4173f2cca8d tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:36:50.969621 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d74d1e60-766f-4b40-9150-f4173f2cca8d tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:50.970331 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d74d1e60-766f-4b40-9150-f4173f2cca8d tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:50.970878 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d74d1e60-766f-4b40-9150-f4173f2cca8d tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:50.972029 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d74d1e60-766f-4b40-9150-f4173f2cca8d tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:50.972590 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d74d1e60-766f-4b40-9150-f4173f2cca8d tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:50.973136 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d74d1e60-766f-4b40-9150-f4173f2cca8d tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:51.007358 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-17078157-589f-455c-97eb-cd1aeaef8ad6 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/c5c50ae8-6217-4650-8420-291847e21ace/ips" status: 200 len: 148 microversion: 2.1 time: 0.140948 Oct 27 03:36:51.011271 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1788/3822] 10.222.0.20 () {58 vars in 1248 bytes} [Thu Oct 27 03:36:50 2022] GET /compute/v2.1/servers/c5c50ae8-6217-4650-8420-291847e21ace/ips => generated 148 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:36:51.012202 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-d74d1e60-766f-4b40-9150-f4173f2cca8d tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Getting quotas for project 2e58f30136ed4a4d9bff48e9b4cde5a8. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:36:51.023162 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d7c1ee27-6910-4885-b763-87a712454387 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:51.024190 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-d74d1e60-766f-4b40-9150-f4173f2cca8d tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Getting quotas for user 5c36bef85ac34b4983a79e03c56965c5 and project 2e58f30136ed4a4d9bff48e9b4cde5a8. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:36:51.025180 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d7c1ee27-6910-4885-b763-87a712454387 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: dbb1b9d1-38ff-42da-9e74-91f686f88047] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:51.041428 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d7c1ee27-6910-4885-b763-87a712454387 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:51.044063 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d7c1ee27-6910-4885-b763-87a712454387 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:51.044530 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d7c1ee27-6910-4885-b763-87a712454387 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:51.045424 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d7c1ee27-6910-4885-b763-87a712454387 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:51.045890 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d7c1ee27-6910-4885-b763-87a712454387 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:51.049668 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d7c1ee27-6910-4885-b763-87a712454387 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:51.055062 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d74d1e60-766f-4b40-9150-f4173f2cca8d tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Going to run 1 instances... {{(pid=121001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:36:51.057453 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d74d1e60-766f-4b40-9150-f4173f2cca8d tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] [instance: 4183c266-b474-4c04-8e81-54a6a86e221b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:36:51.228087 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d74d1e60-766f-4b40-9150-f4173f2cca8d tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.323996 Oct 27 03:36:51.228664 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2035/3823] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:36:49 2022] POST /compute/v2.1/servers => generated 383 bytes in 1326 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 03:36:51.241750 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-ec5e8aec-84cc-4789-9ccf-1974dc7b2bcf req-0a83f9e2-81e8-4973-903b-2fac987743b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f50da5a9-2bb6-4735-93c3-d73ece0964f3", "name": "network-vif-deleted", "tag": "271e155b-8765-4519-870e-105aa22f7ae9"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:36:51.409202 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d7c1ee27-6910-4885-b763-87a712454387 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:51.420753 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d7c1ee27-6910-4885-b763-87a712454387 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/dbb1b9d1-38ff-42da-9e74-91f686f88047" status: 200 len: 1502 microversion: 2.1 time: 0.406701 Oct 27 03:36:51.421365 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1789/3824] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:51 2022] GET /compute/v2.1/servers/dbb1b9d1-38ff-42da-9e74-91f686f88047 => generated 1502 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:51.437568 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b1792a05-b299-4c95-8e7d-d3073a06845c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:51.443066 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b1792a05-b299-4c95-8e7d-d3073a06845c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:51.471290 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b1792a05-b299-4c95-8e7d-d3073a06845c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:51.471801 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b1792a05-b299-4c95-8e7d-d3073a06845c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:51.472251 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b1792a05-b299-4c95-8e7d-d3073a06845c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:51.472976 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b1792a05-b299-4c95-8e7d-d3073a06845c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:51.473433 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b1792a05-b299-4c95-8e7d-d3073a06845c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:51.473858 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b1792a05-b299-4c95-8e7d-d3073a06845c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:51.885134 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b1792a05-b299-4c95-8e7d-d3073a06845c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:51.897918 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b1792a05-b299-4c95-8e7d-d3073a06845c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1527 microversion: 2.1 time: 0.475050 Oct 27 03:36:51.899212 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1790/3825] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:51 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1527 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:51.905780 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b8ed18fb-6f03-4498-801a-4554caec1060 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:51.906923 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b8ed18fb-6f03-4498-801a-4554caec1060 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] [instance: f50da5a9-2bb6-4735-93c3-d73ece0964f3] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:51.914638 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b8ed18fb-6f03-4498-801a-4554caec1060 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:51.916296 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b8ed18fb-6f03-4498-801a-4554caec1060 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:51.917426 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b8ed18fb-6f03-4498-801a-4554caec1060 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:51.919880 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b8ed18fb-6f03-4498-801a-4554caec1060 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:51.920718 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b8ed18fb-6f03-4498-801a-4554caec1060 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:51.921634 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b8ed18fb-6f03-4498-801a-4554caec1060 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:51.928638 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-ec5e8aec-84cc-4789-9ccf-1974dc7b2bcf req-0a83f9e2-81e8-4973-903b-2fac987743b4 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:51.929206 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-ec5e8aec-84cc-4789-9ccf-1974dc7b2bcf req-0a83f9e2-81e8-4973-903b-2fac987743b4 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:51.930052 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-ec5e8aec-84cc-4789-9ccf-1974dc7b2bcf req-0a83f9e2-81e8-4973-903b-2fac987743b4 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:51.943362 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-ec5e8aec-84cc-4789-9ccf-1974dc7b2bcf req-0a83f9e2-81e8-4973-903b-2fac987743b4 service nova] Creating event network-vif-deleted:271e155b-8765-4519-870e-105aa22f7ae9 for instance f50da5a9-2bb6-4735-93c3-d73ece0964f3 on n-h1-862769-1 Oct 27 03:36:51.949519 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-ec5e8aec-84cc-4789-9ccf-1974dc7b2bcf req-0a83f9e2-81e8-4973-903b-2fac987743b4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.718156 Oct 27 03:36:51.954720 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2036/3826] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:36:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:36:51.962477 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-12a7cfd0-be3a-4019-bdc3-12a891cd8dbe tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:51.972187 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-12a7cfd0-be3a-4019-bdc3-12a891cd8dbe tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] [instance: 4183c266-b474-4c04-8e81-54a6a86e221b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:51.972323 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b8ed18fb-6f03-4498-801a-4554caec1060 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:51.979617 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b8ed18fb-6f03-4498-801a-4554caec1060 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:51.980459 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b8ed18fb-6f03-4498-801a-4554caec1060 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:51.981152 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-b8ed18fb-6f03-4498-801a-4554caec1060 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lazy-loading 'fault' on Instance uuid f50da5a9-2bb6-4735-93c3-d73ece0964f3 {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:36:52.071913 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b8ed18fb-6f03-4498-801a-4554caec1060 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae7845f6759c4dcabcc1516a72484174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d371ab6648425eac2cf1702f2789dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:52.084137 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b8ed18fb-6f03-4498-801a-4554caec1060 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/servers/f50da5a9-2bb6-4735-93c3-d73ece0964f3" status: 200 len: 1308 microversion: 2.1 time: 0.183638 Oct 27 03:36:52.088219 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1791/3827] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:51 2022] GET /compute/v2.1/servers/f50da5a9-2bb6-4735-93c3-d73ece0964f3 => generated 1308 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:52.093945 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a40c51d0-0bb7-42f0-8299-b1290db0ef87 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:36:52.094809 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a40c51d0-0bb7-42f0-8299-b1290db0ef87 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: dbb1b9d1-38ff-42da-9e74-91f686f88047] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:52.101883 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a40c51d0-0bb7-42f0-8299-b1290db0ef87 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:52.102889 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a40c51d0-0bb7-42f0-8299-b1290db0ef87 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:52.103552 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a40c51d0-0bb7-42f0-8299-b1290db0ef87 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:52.104575 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a40c51d0-0bb7-42f0-8299-b1290db0ef87 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:52.105220 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a40c51d0-0bb7-42f0-8299-b1290db0ef87 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:52.105834 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a40c51d0-0bb7-42f0-8299-b1290db0ef87 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:52.273435 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-12a7cfd0-be3a-4019-bdc3-12a891cd8dbe tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c36bef85ac34b4983a79e03c56965c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e58f30136ed4a4d9bff48e9b4cde5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:52.283689 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-12a7cfd0-be3a-4019-bdc3-12a891cd8dbe tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] 10.222.0.20 "GET /compute/v2.1/servers/4183c266-b474-4c04-8e81-54a6a86e221b" status: 200 len: 1224 microversion: 2.1 time: 0.325325 Oct 27 03:36:52.294071 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2037/3828] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:51 2022] GET /compute/v2.1/servers/4183c266-b474-4c04-8e81-54a6a86e221b => generated 1224 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:52.294071 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-85963122-655d-4ee2-8285-c9c6a2b0590f tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:52.294071 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-85963122-655d-4ee2-8285-c9c6a2b0590f tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] [instance: 2a1bda43-af44-432d-8992-94473a5f8b5d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:52.302477 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-85963122-655d-4ee2-8285-c9c6a2b0590f tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:52.303046 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-85963122-655d-4ee2-8285-c9c6a2b0590f tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:52.304119 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-85963122-655d-4ee2-8285-c9c6a2b0590f tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:52.304961 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-85963122-655d-4ee2-8285-c9c6a2b0590f tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:52.305604 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-85963122-655d-4ee2-8285-c9c6a2b0590f tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:52.306074 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-85963122-655d-4ee2-8285-c9c6a2b0590f tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:52.430750 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-85963122-655d-4ee2-8285-c9c6a2b0590f tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d5d3f1bf1af4cd6884297b207597fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a1ba64cf9c47d5bdae52477338099e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:52.442989 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-85963122-655d-4ee2-8285-c9c6a2b0590f tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] 10.222.0.20 "GET /compute/v2.1/servers/2a1bda43-af44-432d-8992-94473a5f8b5d" status: 200 len: 1598 microversion: 2.1 time: 0.156805 Oct 27 03:36:52.443991 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2038/3829] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:52 2022] GET /compute/v2.1/servers/2a1bda43-af44-432d-8992-94473a5f8b5d => generated 1598 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:52.595751 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.network.security_group_api [None req-a40c51d0-0bb7-42f0-8299-b1290db0ef87 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Removing security group c1101f8f-fb27-422d-b509-94d2d333783d from port 6005c662-3d62-4cfd-8135-e32257e5003f Oct 27 03:36:52.927148 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-67f4dd77-a55e-4dc2-bc58-1c0d5c4752f8 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:52.928015 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-67f4dd77-a55e-4dc2-bc58-1c0d5c4752f8 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:52.941460 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-67f4dd77-a55e-4dc2-bc58-1c0d5c4752f8 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:52.947724 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-67f4dd77-a55e-4dc2-bc58-1c0d5c4752f8 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:52.947724 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-67f4dd77-a55e-4dc2-bc58-1c0d5c4752f8 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:52.947724 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-67f4dd77-a55e-4dc2-bc58-1c0d5c4752f8 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:52.947724 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-67f4dd77-a55e-4dc2-bc58-1c0d5c4752f8 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:52.947724 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-67f4dd77-a55e-4dc2-bc58-1c0d5c4752f8 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:53.272454 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-67f4dd77-a55e-4dc2-bc58-1c0d5c4752f8 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:53.285021 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-67f4dd77-a55e-4dc2-bc58-1c0d5c4752f8 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1527 microversion: 2.1 time: 0.361624 Oct 27 03:36:53.291685 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2039/3830] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:52 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1527 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:53.312635 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-34d5c0b0-362f-4665-867c-daa37aa9cab8 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:53.318942 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-34d5c0b0-362f-4665-867c-daa37aa9cab8 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] [instance: f50da5a9-2bb6-4735-93c3-d73ece0964f3] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:53.354092 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-34d5c0b0-362f-4665-867c-daa37aa9cab8 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:53.354624 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-34d5c0b0-362f-4665-867c-daa37aa9cab8 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:53.355087 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-34d5c0b0-362f-4665-867c-daa37aa9cab8 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:53.365391 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-34d5c0b0-362f-4665-867c-daa37aa9cab8 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:53.374573 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-34d5c0b0-362f-4665-867c-daa37aa9cab8 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:53.375213 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-34d5c0b0-362f-4665-867c-daa37aa9cab8 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:53.448606 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-34d5c0b0-362f-4665-867c-daa37aa9cab8 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] HTTP exception thrown: Instance f50da5a9-2bb6-4735-93c3-d73ece0964f3 could not be found. Oct 27 03:36:53.452164 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-34d5c0b0-362f-4665-867c-daa37aa9cab8 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Request method failure captured: Oct 27 03:36:53.452164 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/f50da5a9-2bb6-4735-93c3-d73ece0964f3 HTTP/1.1 Oct 27 03:36:53.452164 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:36:53.452164 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:36:53.452164 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:36:53.452164 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:36:53.452164 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:36:53.452164 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:36:53.452164 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:36:53.452164 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:36:53.452164 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfwwmpiSeYbqY1HFz8dGnrpgQKgSn1A-XXvLCWSYnFNXRTdg-U9nT4bXxikihcs0niMRC8vhmZmEA6qlrKlxGAhIBPyO4oKNSKuZwvpy5x4EGTHCvKp4bxCW3yXLBUdsGJZwCx1hZiUFkpb29DrAp508nsBnbFJHk1ligQz5XKRoPy0 Oct 27 03:36:53.452164 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:36:53.452164 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:36:53.452164 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:36:53.452164 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:36:53.452164 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:36:53.452164 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:36:53.452164 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 98d371ab6648425eac2cf1702f2789dc Oct 27 03:36:53.452164 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ListImageFiltersTestJSON-1162809373 Oct 27 03:36:53.452164 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:36:53.452164 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:36:53.452164 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/98d371ab6648425eac2cf1702f2789dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/98d371ab6648425eac2cf1702f2789dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/98d371ab6648425eac2cf1702f2789dc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_98d371ab6648425eac2cf1702f2789dc"}]}] Oct 27 03:36:53.452164 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ListImageFiltersTestJSON-1162809373 Oct 27 03:36:53.452164 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 98d371ab6648425eac2cf1702f2789dc Oct 27 03:36:53.452164 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1162809373 Oct 27 03:36:53.452164 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ListImageFiltersTestJSON-1162809373-project Oct 27 03:36:53.452164 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:36:53.452164 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:36:53.452164 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: ae7845f6759c4dcabcc1516a72484174 Oct 27 03:36:53.452164 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ListImageFiltersTestJSON-1162809373-project Oct 27 03:36:53.452164 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:36:53.452164 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance f50da5a9-2bb6-4735-93c3-d73ece0964f3 could not be found. Oct 27 03:36:53.452164 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': 'f50da5a9-2bb6-4735-93c3-d73ece0964f3'} Oct 27 03:36:53.452164 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:36:53.452164 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:36:53.452164 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:36:53.452164 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:36:53.452164 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:36:53.452164 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:36:53.452164 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:36:53.452164 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:36:53.452164 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:36:53.452164 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:36:53.452164 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f50da5a9-2bb6-4735-93c3-d73ece0964f3 could not be found. Oct 27 03:36:53.452164 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:53.452164 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:36:53.452164 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:53.452164 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:36:53.452164 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:36:53.452164 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:36:53.452164 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:36:53.452164 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:36:53.452164 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:36:53.452164 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:36:53.452164 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:36:53.452164 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:36:53.452164 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:36:53.452164 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:36:53.452164 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:36:53.452164 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:36:53.452164 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f50da5a9-2bb6-4735-93c3-d73ece0964f3 could not be found. Oct 27 03:36:53.452164 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:53.452164 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:36:53.452164 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:53.461876 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:36:53.461876 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:36:53.461876 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:36:53.461876 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:36:53.461876 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:36:53.461876 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f50da5a9-2bb6-4735-93c3-d73ece0964f3 could not be found. Oct 27 03:36:53.461876 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:36:53.461876 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-34d5c0b0-362f-4665-867c-daa37aa9cab8 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Returning 404 to user: Instance f50da5a9-2bb6-4735-93c3-d73ece0964f3 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:36:53.461876 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-34d5c0b0-362f-4665-867c-daa37aa9cab8 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "GET /compute/v2.1/servers/f50da5a9-2bb6-4735-93c3-d73ece0964f3" status: 404 len: 111 microversion: 2.1 time: 0.168233 Oct 27 03:36:53.470347 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2040/3831] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:53 2022] GET /compute/v2.1/servers/f50da5a9-2bb6-4735-93c3-d73ece0964f3 => generated 111 bytes in 178 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:36:53.494832 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-9db3254c-bd5f-44db-a077-a7f18e1714a5 req-3547a574-1537-4b19-b44f-cc28b8abafef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a1bda43-af44-432d-8992-94473a5f8b5d", "name": "network-vif-deleted", "tag": "492e855b-93ee-4a3f-9bb2-1fef411f1a2c"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:36:53.547709 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-9db3254c-bd5f-44db-a077-a7f18e1714a5 req-3547a574-1537-4b19-b44f-cc28b8abafef service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:53.548787 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-9db3254c-bd5f-44db-a077-a7f18e1714a5 req-3547a574-1537-4b19-b44f-cc28b8abafef service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:53.549499 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-9db3254c-bd5f-44db-a077-a7f18e1714a5 req-3547a574-1537-4b19-b44f-cc28b8abafef service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:53.568156 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-9db3254c-bd5f-44db-a077-a7f18e1714a5 req-3547a574-1537-4b19-b44f-cc28b8abafef service nova] Creating event network-vif-deleted:492e855b-93ee-4a3f-9bb2-1fef411f1a2c for instance 2a1bda43-af44-432d-8992-94473a5f8b5d on n-h2-862769-1 Oct 27 03:36:53.574420 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-9db3254c-bd5f-44db-a077-a7f18e1714a5 req-3547a574-1537-4b19-b44f-cc28b8abafef service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102446 Oct 27 03:36:53.580741 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2041/3832] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:36:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:36:53.587962 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-662accc4-bc8a-4c02-9f0c-51ffc0fc5df9 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:53.589039 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-662accc4-bc8a-4c02-9f0c-51ffc0fc5df9 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] [instance: 4183c266-b474-4c04-8e81-54a6a86e221b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:53.596084 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-662accc4-bc8a-4c02-9f0c-51ffc0fc5df9 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:53.597424 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-662accc4-bc8a-4c02-9f0c-51ffc0fc5df9 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:53.598223 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-662accc4-bc8a-4c02-9f0c-51ffc0fc5df9 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:53.599181 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-662accc4-bc8a-4c02-9f0c-51ffc0fc5df9 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:53.599974 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-662accc4-bc8a-4c02-9f0c-51ffc0fc5df9 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:53.601003 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-662accc4-bc8a-4c02-9f0c-51ffc0fc5df9 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:53.811573 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a40c51d0-0bb7-42f0-8299-b1290db0ef87 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "POST /compute/v2.1/servers/dbb1b9d1-38ff-42da-9e74-91f686f88047/action" status: 202 len: 0 microversion: 2.1 time: 1.720011 Oct 27 03:36:53.812285 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1792/3833] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:36:52 2022] POST /compute/v2.1/servers/dbb1b9d1-38ff-42da-9e74-91f686f88047/action => generated 0 bytes in 1723 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:36:53.818737 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e8a17212-a177-49f2-ad4d-5fdfc7c88849 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:53.819369 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e8a17212-a177-49f2-ad4d-5fdfc7c88849 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] [instance: 2a1bda43-af44-432d-8992-94473a5f8b5d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:53.876040 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e8a17212-a177-49f2-ad4d-5fdfc7c88849 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:53.876040 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e8a17212-a177-49f2-ad4d-5fdfc7c88849 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:53.876040 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e8a17212-a177-49f2-ad4d-5fdfc7c88849 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:53.876040 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e8a17212-a177-49f2-ad4d-5fdfc7c88849 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:53.876040 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e8a17212-a177-49f2-ad4d-5fdfc7c88849 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:53.876040 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e8a17212-a177-49f2-ad4d-5fdfc7c88849 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:53.965106 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-662accc4-bc8a-4c02-9f0c-51ffc0fc5df9 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c36bef85ac34b4983a79e03c56965c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e58f30136ed4a4d9bff48e9b4cde5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:53.971110 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e8a17212-a177-49f2-ad4d-5fdfc7c88849 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:53.972166 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e8a17212-a177-49f2-ad4d-5fdfc7c88849 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:53.973251 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e8a17212-a177-49f2-ad4d-5fdfc7c88849 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:53.974140 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-e8a17212-a177-49f2-ad4d-5fdfc7c88849 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Lazy-loading 'fault' on Instance uuid 2a1bda43-af44-432d-8992-94473a5f8b5d {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:36:53.980773 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-662accc4-bc8a-4c02-9f0c-51ffc0fc5df9 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] 10.222.0.20 "GET /compute/v2.1/servers/4183c266-b474-4c04-8e81-54a6a86e221b" status: 200 len: 1220 microversion: 2.1 time: 0.395099 Oct 27 03:36:53.998856 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2042/3834] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:53 2022] GET /compute/v2.1/servers/4183c266-b474-4c04-8e81-54a6a86e221b => generated 1220 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:54.012181 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d89846a9-e10f-4381-97ed-30b85a175d28 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7dd9d67ca0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:54.058252 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e8a17212-a177-49f2-ad4d-5fdfc7c88849 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d5d3f1bf1af4cd6884297b207597fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a1ba64cf9c47d5bdae52477338099e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:54.073233 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e8a17212-a177-49f2-ad4d-5fdfc7c88849 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] 10.222.0.20 "GET /compute/v2.1/servers/2a1bda43-af44-432d-8992-94473a5f8b5d" status: 200 len: 1316 microversion: 2.1 time: 0.254420 Oct 27 03:36:54.086704 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1793/3835] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:53 2022] GET /compute/v2.1/servers/2a1bda43-af44-432d-8992-94473a5f8b5d => generated 1316 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:54.086704 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-fba6a507-906a-4f5b-9b25-0e1ed06fea88 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:54.086704 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-fba6a507-906a-4f5b-9b25-0e1ed06fea88 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: dbb1b9d1-38ff-42da-9e74-91f686f88047] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:54.092413 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fba6a507-906a-4f5b-9b25-0e1ed06fea88 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:54.093464 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fba6a507-906a-4f5b-9b25-0e1ed06fea88 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:54.094178 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fba6a507-906a-4f5b-9b25-0e1ed06fea88 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:54.095102 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fba6a507-906a-4f5b-9b25-0e1ed06fea88 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:54.095721 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fba6a507-906a-4f5b-9b25-0e1ed06fea88 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:54.097356 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fba6a507-906a-4f5b-9b25-0e1ed06fea88 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:54.275227 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-fba6a507-906a-4f5b-9b25-0e1ed06fea88 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:54.286197 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-fba6a507-906a-4f5b-9b25-0e1ed06fea88 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/dbb1b9d1-38ff-42da-9e74-91f686f88047" status: 200 len: 1460 microversion: 2.1 time: 0.208626 Oct 27 03:36:54.287254 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1794/3836] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:54 2022] GET /compute/v2.1/servers/dbb1b9d1-38ff-42da-9e74-91f686f88047 => generated 1460 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:54.326234 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-80594953-0187-48f7-8fe2-271b8a8de464 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:54.327298 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-80594953-0187-48f7-8fe2-271b8a8de464 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:54.336808 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-80594953-0187-48f7-8fe2-271b8a8de464 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:54.339725 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-80594953-0187-48f7-8fe2-271b8a8de464 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:54.339725 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-80594953-0187-48f7-8fe2-271b8a8de464 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:54.341324 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-80594953-0187-48f7-8fe2-271b8a8de464 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:54.342013 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-80594953-0187-48f7-8fe2-271b8a8de464 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:54.343068 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-80594953-0187-48f7-8fe2-271b8a8de464 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:54.579508 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-80594953-0187-48f7-8fe2-271b8a8de464 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:54.627316 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-80594953-0187-48f7-8fe2-271b8a8de464 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1527 microversion: 2.1 time: 0.298338 Oct 27 03:36:54.627316 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1795/3837] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:54 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1527 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:54.629548 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ddfd4e25-12f8-4138-8d41-a3cc6aa514c8 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:54.631910 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ddfd4e25-12f8-4138-8d41-a3cc6aa514c8 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:54.649804 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ddfd4e25-12f8-4138-8d41-a3cc6aa514c8 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:54.651613 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ddfd4e25-12f8-4138-8d41-a3cc6aa514c8 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:54.652914 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ddfd4e25-12f8-4138-8d41-a3cc6aa514c8 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:54.653715 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ddfd4e25-12f8-4138-8d41-a3cc6aa514c8 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:54.654227 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ddfd4e25-12f8-4138-8d41-a3cc6aa514c8 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:54.657789 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ddfd4e25-12f8-4138-8d41-a3cc6aa514c8 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:54.919842 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ddfd4e25-12f8-4138-8d41-a3cc6aa514c8 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:54.929839 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ddfd4e25-12f8-4138-8d41-a3cc6aa514c8 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1669 microversion: 2.1 time: 0.309941 Oct 27 03:36:54.938081 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1796/3838] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:54 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1669 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:54.961112 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-cee27054-c3d4-4dc5-99a1-ac6e3bc0a935 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:54.962329 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-cee27054-c3d4-4dc5-99a1-ac6e3bc0a935 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:54.974644 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d89846a9-e10f-4381-97ed-30b85a175d28 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "DELETE /compute/v2.1/images/b7eaf408-cb44-41a2-b999-ceba1600304d" status: 204 len: 0 microversion: 2.1 time: 0.974494 Oct 27 03:36:54.975909 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2043/3839] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:53 2022] DELETE /compute/v2.1/images/b7eaf408-cb44-41a2-b999-ceba1600304d => generated 0 bytes in 977 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:36:54.987753 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5b94d6ee-5e6e-4703-adcb-0effd07238d3 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7dd9ce23a0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:54.999522 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cee27054-c3d4-4dc5-99a1-ac6e3bc0a935 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:55.000054 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cee27054-c3d4-4dc5-99a1-ac6e3bc0a935 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:55.000492 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cee27054-c3d4-4dc5-99a1-ac6e3bc0a935 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:55.007355 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cee27054-c3d4-4dc5-99a1-ac6e3bc0a935 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:55.009302 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cee27054-c3d4-4dc5-99a1-ac6e3bc0a935 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:55.010463 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cee27054-c3d4-4dc5-99a1-ac6e3bc0a935 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:55.271166 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-cee27054-c3d4-4dc5-99a1-ac6e3bc0a935 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:55.281370 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-cee27054-c3d4-4dc5-99a1-ac6e3bc0a935 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1669 microversion: 2.1 time: 0.325240 Oct 27 03:36:55.282952 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1797/3840] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:54 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1669 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:36:55.287516 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9e16114f-f6af-4fd8-b4e9-be17623656ed tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:55.291663 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9e16114f-f6af-4fd8-b4e9-be17623656ed tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] [instance: 4183c266-b474-4c04-8e81-54a6a86e221b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:55.296339 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9e16114f-f6af-4fd8-b4e9-be17623656ed tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:55.296892 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9e16114f-f6af-4fd8-b4e9-be17623656ed tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:55.297389 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9e16114f-f6af-4fd8-b4e9-be17623656ed tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:55.298231 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9e16114f-f6af-4fd8-b4e9-be17623656ed tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:55.298696 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9e16114f-f6af-4fd8-b4e9-be17623656ed tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:55.299131 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9e16114f-f6af-4fd8-b4e9-be17623656ed tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:55.440229 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9e16114f-f6af-4fd8-b4e9-be17623656ed tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c36bef85ac34b4983a79e03c56965c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e58f30136ed4a4d9bff48e9b4cde5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:55.449692 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9e16114f-f6af-4fd8-b4e9-be17623656ed tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] 10.222.0.20 "GET /compute/v2.1/servers/4183c266-b474-4c04-8e81-54a6a86e221b" status: 200 len: 1284 microversion: 2.1 time: 0.165908 Oct 27 03:36:55.454573 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1798/3841] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:55 2022] GET /compute/v2.1/servers/4183c266-b474-4c04-8e81-54a6a86e221b => generated 1284 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:55.457311 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2c0828da-03cc-47f4-9a63-c1f854a0dfd0 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:55.458139 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-2c0828da-03cc-47f4-9a63-c1f854a0dfd0 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] [instance: 2a1bda43-af44-432d-8992-94473a5f8b5d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:55.479698 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:36:55.493003 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2c0828da-03cc-47f4-9a63-c1f854a0dfd0 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:55.494565 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2c0828da-03cc-47f4-9a63-c1f854a0dfd0 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:55.494565 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2c0828da-03cc-47f4-9a63-c1f854a0dfd0 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:55.494788 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2c0828da-03cc-47f4-9a63-c1f854a0dfd0 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:55.497344 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2c0828da-03cc-47f4-9a63-c1f854a0dfd0 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:55.498351 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2c0828da-03cc-47f4-9a63-c1f854a0dfd0 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:55.537617 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-2c0828da-03cc-47f4-9a63-c1f854a0dfd0 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] HTTP exception thrown: Instance 2a1bda43-af44-432d-8992-94473a5f8b5d could not be found. Oct 27 03:36:55.544751 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2c0828da-03cc-47f4-9a63-c1f854a0dfd0 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Request method failure captured: Oct 27 03:36:55.544751 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/2a1bda43-af44-432d-8992-94473a5f8b5d HTTP/1.1 Oct 27 03:36:55.544751 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:36:55.544751 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:36:55.544751 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:36:55.544751 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:36:55.544751 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:36:55.544751 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:36:55.544751 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:36:55.544751 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:36:55.544751 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfyJRQXUFRQyHzeBJayuoMdLeA38wqxQmMDYf4sx4vqIRa2DUvb0vWEhwQeMoxKTK571HGAca1WVgofU_ScSZBzWDwGF_y-BgsB3eHtGV1d2_Ode3-FVMyhXnOaUgGvhL5qjwoQXuFDmYhKzftE2z2SJEijsQODnYbd-Hi1iiJuV5jk Oct 27 03:36:55.544751 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:36:55.544751 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:36:55.544751 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:36:55.544751 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:36:55.544751 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:36:55.544751 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:36:55.544751 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: e3a1ba64cf9c47d5bdae52477338099e Oct 27 03:36:55.544751 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ServersTestFqdnHostnames-963915328 Oct 27 03:36:55.544751 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:36:55.544751 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:36:55.544751 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e3a1ba64cf9c47d5bdae52477338099e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e3a1ba64cf9c47d5bdae52477338099e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e3a1ba64cf9c47d5bdae52477338099e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e3a1ba64cf9c47d5bdae52477338099e"}]}] Oct 27 03:36:55.544751 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ServersTestFqdnHostnames-963915328 Oct 27 03:36:55.544751 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: e3a1ba64cf9c47d5bdae52477338099e Oct 27 03:36:55.544751 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-963915328 Oct 27 03:36:55.544751 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ServersTestFqdnHostnames-963915328-project Oct 27 03:36:55.544751 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:36:55.544751 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:36:55.544751 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 8d5d3f1bf1af4cd6884297b207597fcc Oct 27 03:36:55.544751 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ServersTestFqdnHostnames-963915328-project Oct 27 03:36:55.544751 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:36:55.544751 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 2a1bda43-af44-432d-8992-94473a5f8b5d could not be found. Oct 27 03:36:55.544751 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '2a1bda43-af44-432d-8992-94473a5f8b5d'} Oct 27 03:36:55.544751 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:36:55.544751 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:36:55.544751 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:36:55.544751 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:36:55.544751 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:36:55.544751 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:36:55.544751 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:36:55.544751 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:36:55.544751 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:36:55.544751 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:36:55.544751 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a1bda43-af44-432d-8992-94473a5f8b5d could not be found. Oct 27 03:36:55.544751 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:36:55.544751 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:36:55.544751 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:36:55.544751 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:36:55.544751 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:36:55.544751 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:36:55.544751 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:36:55.544751 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:36:55.544751 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:36:55.544751 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:36:55.544751 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:36:55.544751 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:36:55.544751 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:36:55.544751 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:36:55.544751 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:36:55.544751 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:36:55.544751 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a1bda43-af44-432d-8992-94473a5f8b5d could not be found. Oct 27 03:36:55.544751 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:36:55.544751 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:36:55.544751 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:36:55.550585 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:36:55.550585 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:36:55.550585 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:36:55.550585 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:36:55.550585 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:36:55.550585 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a1bda43-af44-432d-8992-94473a5f8b5d could not be found. Oct 27 03:36:55.550585 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:36:55.553556 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2c0828da-03cc-47f4-9a63-c1f854a0dfd0 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Returning 404 to user: Instance 2a1bda43-af44-432d-8992-94473a5f8b5d could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:36:55.554830 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2c0828da-03cc-47f4-9a63-c1f854a0dfd0 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] 10.222.0.20 "GET /compute/v2.1/servers/2a1bda43-af44-432d-8992-94473a5f8b5d" status: 404 len: 111 microversion: 2.1 time: 0.102329 Oct 27 03:36:55.555837 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1799/3842] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:55 2022] GET /compute/v2.1/servers/2a1bda43-af44-432d-8992-94473a5f8b5d => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:36:55.561408 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2cf9b693-016d-4dbe-9b42-303d96bb058b tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:55.562246 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-2cf9b693-016d-4dbe-9b42-303d96bb058b tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:55.571281 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2cf9b693-016d-4dbe-9b42-303d96bb058b tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:55.571914 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2cf9b693-016d-4dbe-9b42-303d96bb058b tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:55.572459 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2cf9b693-016d-4dbe-9b42-303d96bb058b tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:55.573306 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2cf9b693-016d-4dbe-9b42-303d96bb058b tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:55.573868 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2cf9b693-016d-4dbe-9b42-303d96bb058b tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:55.574440 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2cf9b693-016d-4dbe-9b42-303d96bb058b tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:55.846089 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5b94d6ee-5e6e-4703-adcb-0effd07238d3 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "DELETE /compute/v2.1/images/47c7e3fd-1e67-44a9-a6bc-bfb91826cc73" status: 204 len: 0 microversion: 2.1 time: 0.860071 Oct 27 03:36:55.846089 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2044/3843] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:54 2022] DELETE /compute/v2.1/images/47c7e3fd-1e67-44a9-a6bc-bfb91826cc73 => generated 0 bytes in 862 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:36:55.852130 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2cf9b693-016d-4dbe-9b42-303d96bb058b tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:55.852606 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-659be603-25b4-498c-a3bf-7d1d4b47a475 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] Calling method '.version_select at 0x7f7dd9dcc790>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:55.862063 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2cf9b693-016d-4dbe-9b42-303d96bb058b tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1669 microversion: 2.1 time: 0.305011 Oct 27 03:36:55.863390 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1800/3844] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:55 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1669 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:55.869099 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-72f9c3e5-390c-4b67-a4ad-5236ec03203e req-1b60035b-6735-4013-9941-8d62233e9e9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbb1b9d1-38ff-42da-9e74-91f686f88047", "tag": "6005c662-3d62-4cfd-8135-e32257e5003f"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:36:55.880631 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-72f9c3e5-390c-4b67-a4ad-5236ec03203e req-1b60035b-6735-4013-9941-8d62233e9e9b service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:55.881309 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-72f9c3e5-390c-4b67-a4ad-5236ec03203e req-1b60035b-6735-4013-9941-8d62233e9e9b service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:55.881880 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-72f9c3e5-390c-4b67-a4ad-5236ec03203e req-1b60035b-6735-4013-9941-8d62233e9e9b service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:55.899623 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-72f9c3e5-390c-4b67-a4ad-5236ec03203e req-1b60035b-6735-4013-9941-8d62233e9e9b service nova] Creating event network-changed:6005c662-3d62-4cfd-8135-e32257e5003f for instance dbb1b9d1-38ff-42da-9e74-91f686f88047 on n-h2-862769-1 Oct 27 03:36:55.906447 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-72f9c3e5-390c-4b67-a4ad-5236ec03203e req-1b60035b-6735-4013-9941-8d62233e9e9b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041864 Oct 27 03:36:55.910854 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1801/3845] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:36:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:36:55.917192 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-eb8aee8d-6d2c-48a0-b281-6bd918ea9816 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:55.918634 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-eb8aee8d-6d2c-48a0-b281-6bd918ea9816 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:55.928027 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eb8aee8d-6d2c-48a0-b281-6bd918ea9816 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:55.928716 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eb8aee8d-6d2c-48a0-b281-6bd918ea9816 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:55.929220 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eb8aee8d-6d2c-48a0-b281-6bd918ea9816 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:55.930185 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eb8aee8d-6d2c-48a0-b281-6bd918ea9816 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:55.930744 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eb8aee8d-6d2c-48a0-b281-6bd918ea9816 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:55.935377 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eb8aee8d-6d2c-48a0-b281-6bd918ea9816 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:55.980552 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-659be603-25b4-498c-a3bf-7d1d4b47a475 tempest-ServersTestFqdnHostnames-963915328 tempest-ServersTestFqdnHostnames-963915328-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1529526182" status: 202 len: 0 microversion: 2.1 time: 0.135443 Oct 27 03:36:55.986106 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2045/3846] 10.222.0.20 () {58 vars in 1221 bytes} [Thu Oct 27 03:36:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1529526182 => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:36:55.992505 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6741bf66-726d-4f1f-8047-bf5a111a24cf tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "72e75738-cb91-475f-a857-1aba96e97efe"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:36:56.001802 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-6741bf66-726d-4f1f-8047-bf5a111a24cf tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: c5c50ae8-6217-4650-8420-291847e21ace] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:56.019756 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6741bf66-726d-4f1f-8047-bf5a111a24cf tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:56.023927 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6741bf66-726d-4f1f-8047-bf5a111a24cf tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:56.024871 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6741bf66-726d-4f1f-8047-bf5a111a24cf tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:56.025960 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6741bf66-726d-4f1f-8047-bf5a111a24cf tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:56.029852 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6741bf66-726d-4f1f-8047-bf5a111a24cf tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:56.031941 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6741bf66-726d-4f1f-8047-bf5a111a24cf tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:56.404283 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-eb8aee8d-6d2c-48a0-b281-6bd918ea9816 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:56.412357 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-eb8aee8d-6d2c-48a0-b281-6bd918ea9816 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1527 microversion: 2.1 time: 0.500092 Oct 27 03:36:56.412943 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1802/3847] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:55 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1527 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:56.426712 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7f559f01-6752-4e81-8dde-03692e39ca10 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] Calling method '.version_select at 0x7f7ddee30430>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:56.965447 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6741bf66-726d-4f1f-8047-bf5a111a24cf tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "POST /compute/v2.1/servers/c5c50ae8-6217-4650-8420-291847e21ace/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.977457 Oct 27 03:36:56.966796 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2046/3848] 10.222.0.20 () {60 vars in 1323 bytes} [Thu Oct 27 03:36:55 2022] POST /compute/v2.1/servers/c5c50ae8-6217-4650-8420-291847e21ace/os-volume_attachments => generated 194 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:36:56.991161 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b7c2b37d-28f0-4d52-989f-07c85fa7f677 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:56.991161 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b7c2b37d-28f0-4d52-989f-07c85fa7f677 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:57.016871 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b7c2b37d-28f0-4d52-989f-07c85fa7f677 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:57.019693 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b7c2b37d-28f0-4d52-989f-07c85fa7f677 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:57.021684 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b7c2b37d-28f0-4d52-989f-07c85fa7f677 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:57.029392 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b7c2b37d-28f0-4d52-989f-07c85fa7f677 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:57.031252 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b7c2b37d-28f0-4d52-989f-07c85fa7f677 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:57.032257 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b7c2b37d-28f0-4d52-989f-07c85fa7f677 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:57.176170 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7f559f01-6752-4e81-8dde-03692e39ca10 tempest-ListImageFiltersTestJSON-1162809373 tempest-ListImageFiltersTestJSON-1162809373-project] 10.222.0.20 "DELETE /compute/v2.1/images/2261c57f-bc36-4b55-abf7-8c041551a14b" status: 204 len: 0 microversion: 2.1 time: 0.755780 Oct 27 03:36:57.176825 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1803/3849] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:56 2022] DELETE /compute/v2.1/images/2261c57f-bc36-4b55-abf7-8c041551a14b => generated 0 bytes in 760 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:36:57.193768 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-14496071-330b-4590-b62b-92083b18e312 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:57.197345 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-14496071-330b-4590-b62b-92083b18e312 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] [instance: 4183c266-b474-4c04-8e81-54a6a86e221b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:57.217310 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-14496071-330b-4590-b62b-92083b18e312 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:57.219228 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-14496071-330b-4590-b62b-92083b18e312 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:57.219894 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-14496071-330b-4590-b62b-92083b18e312 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:57.222708 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-14496071-330b-4590-b62b-92083b18e312 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:57.225771 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-14496071-330b-4590-b62b-92083b18e312 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:57.229119 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-14496071-330b-4590-b62b-92083b18e312 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:57.267607 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=100 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:36:57.325964 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b7c2b37d-28f0-4d52-989f-07c85fa7f677 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:57.339492 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b7c2b37d-28f0-4d52-989f-07c85fa7f677 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1669 microversion: 2.1 time: 0.371219 Oct 27 03:36:57.354689 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2047/3850] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:56 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1669 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:57.440450 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-39bbe3de-3aaf-4051-a655-a3f091a0c31f tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:57.441351 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-39bbe3de-3aaf-4051-a655-a3f091a0c31f tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:57.468388 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-39bbe3de-3aaf-4051-a655-a3f091a0c31f tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:57.470944 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-39bbe3de-3aaf-4051-a655-a3f091a0c31f tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:57.480190 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-39bbe3de-3aaf-4051-a655-a3f091a0c31f tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:57.481063 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-39bbe3de-3aaf-4051-a655-a3f091a0c31f tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:57.482513 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-39bbe3de-3aaf-4051-a655-a3f091a0c31f tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:57.483033 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-39bbe3de-3aaf-4051-a655-a3f091a0c31f tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:57.742963 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-14496071-330b-4590-b62b-92083b18e312 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c36bef85ac34b4983a79e03c56965c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e58f30136ed4a4d9bff48e9b4cde5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:57.754877 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-14496071-330b-4590-b62b-92083b18e312 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] 10.222.0.20 "GET /compute/v2.1/servers/4183c266-b474-4c04-8e81-54a6a86e221b" status: 200 len: 1324 microversion: 2.1 time: 0.576964 Oct 27 03:36:57.757944 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1804/3851] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:57 2022] GET /compute/v2.1/servers/4183c266-b474-4c04-8e81-54a6a86e221b => generated 1324 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:36:57.777840 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6b004417-2372-4ef3-ba77-e2c4266dca04 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-613943311", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": [{"uuid": "3c58b3a5-6f00-4601-ab92-e31d99f01594"}]}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:36:57.930294 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-6b004417-2372-4ef3-ba77-e2c4266dca04 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] validate_networks() for [('3c58b3a5-6f00-4601-ab92-e31d99f01594', None, None, None, None, None)] {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:36:57.933856 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-39bbe3de-3aaf-4051-a655-a3f091a0c31f tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:57.988908 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-39bbe3de-3aaf-4051-a655-a3f091a0c31f tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1527 microversion: 2.1 time: 0.550331 Oct 27 03:36:57.993968 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2048/3852] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:57 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1527 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:36:58.785554 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-47666e06-a1bf-4c46-a0f8-c208d95bae25 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:58.786221 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-47666e06-a1bf-4c46-a0f8-c208d95bae25 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] [instance: 4183c266-b474-4c04-8e81-54a6a86e221b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:58.799714 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-47666e06-a1bf-4c46-a0f8-c208d95bae25 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:58.802497 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-47666e06-a1bf-4c46-a0f8-c208d95bae25 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:58.805504 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-47666e06-a1bf-4c46-a0f8-c208d95bae25 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:58.807266 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-47666e06-a1bf-4c46-a0f8-c208d95bae25 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:58.810247 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-47666e06-a1bf-4c46-a0f8-c208d95bae25 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:58.812241 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-47666e06-a1bf-4c46-a0f8-c208d95bae25 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:59.129360 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-6b004417-2372-4ef3-ba77-e2c4266dca04 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:36:59.130381 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-6b004417-2372-4ef3-ba77-e2c4266dca04 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:36:59.131279 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-6b004417-2372-4ef3-ba77-e2c4266dca04 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:36:59.132207 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-6b004417-2372-4ef3-ba77-e2c4266dca04 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:36:59.132838 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-6b004417-2372-4ef3-ba77-e2c4266dca04 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:36:59.159194 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6b004417-2372-4ef3-ba77-e2c4266dca04 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:59.160446 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6b004417-2372-4ef3-ba77-e2c4266dca04 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:59.162013 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6b004417-2372-4ef3-ba77-e2c4266dca04 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:59.165708 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6b004417-2372-4ef3-ba77-e2c4266dca04 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:59.175239 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6b004417-2372-4ef3-ba77-e2c4266dca04 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:59.176744 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6b004417-2372-4ef3-ba77-e2c4266dca04 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:59.269743 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-6b004417-2372-4ef3-ba77-e2c4266dca04 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Getting quotas for project 3e9ede68f63747d59153a46412033856. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:36:59.277363 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-6b004417-2372-4ef3-ba77-e2c4266dca04 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Getting quotas for user 94897f20beb94dbd8e7eff6ecba30026 and project 3e9ede68f63747d59153a46412033856. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:36:59.301595 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6b004417-2372-4ef3-ba77-e2c4266dca04 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:36:59.304869 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6b004417-2372-4ef3-ba77-e2c4266dca04 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: 2d8900c4-92eb-4374-bd63-6d0ebbf407b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:36:59.379746 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-47666e06-a1bf-4c46-a0f8-c208d95bae25 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c36bef85ac34b4983a79e03c56965c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e58f30136ed4a4d9bff48e9b4cde5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:36:59.391674 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-47666e06-a1bf-4c46-a0f8-c208d95bae25 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] 10.222.0.20 "GET /compute/v2.1/servers/4183c266-b474-4c04-8e81-54a6a86e221b" status: 200 len: 1324 microversion: 2.1 time: 0.609894 Oct 27 03:36:59.398703 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2049/3853] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:58 2022] GET /compute/v2.1/servers/4183c266-b474-4c04-8e81-54a6a86e221b => generated 1324 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:36:59.414590 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-38eb2dc6-3717-4a88-9ba8-0c06f10ec11c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:59.415234 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-38eb2dc6-3717-4a88-9ba8-0c06f10ec11c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:36:59.447864 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-38eb2dc6-3717-4a88-9ba8-0c06f10ec11c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:59.449317 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-38eb2dc6-3717-4a88-9ba8-0c06f10ec11c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:59.459831 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-38eb2dc6-3717-4a88-9ba8-0c06f10ec11c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:59.460958 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-38eb2dc6-3717-4a88-9ba8-0c06f10ec11c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:59.463062 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-38eb2dc6-3717-4a88-9ba8-0c06f10ec11c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:59.463786 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-38eb2dc6-3717-4a88-9ba8-0c06f10ec11c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:59.668399 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6b004417-2372-4ef3-ba77-e2c4266dca04 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.900796 Oct 27 03:36:59.684263 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1805/3854] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:36:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1917 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 03:36:59.695074 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-36560e5d-286f-4617-8708-6f536916f901 req-af6859b0-1bec-4db3-a254-57cb702e1ce1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4183c266-b474-4c04-8e81-54a6a86e221b", "tag": "357d8a7a-810d-49af-aada-7fc361e514da"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:36:59.709251 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-36560e5d-286f-4617-8708-6f536916f901 req-af6859b0-1bec-4db3-a254-57cb702e1ce1 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:36:59.710020 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-36560e5d-286f-4617-8708-6f536916f901 req-af6859b0-1bec-4db3-a254-57cb702e1ce1 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:36:59.710692 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-36560e5d-286f-4617-8708-6f536916f901 req-af6859b0-1bec-4db3-a254-57cb702e1ce1 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:36:59.728870 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-36560e5d-286f-4617-8708-6f536916f901 req-af6859b0-1bec-4db3-a254-57cb702e1ce1 service nova] Creating event network-changed:357d8a7a-810d-49af-aada-7fc361e514da for instance 4183c266-b474-4c04-8e81-54a6a86e221b on n-h1-862769-1 Oct 27 03:36:59.761061 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-36560e5d-286f-4617-8708-6f536916f901 req-af6859b0-1bec-4db3-a254-57cb702e1ce1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073083 Oct 27 03:36:59.763831 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1806/3855] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:36:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:36:59.794531 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e1597aae-1e0f-42ec-b0e9-20f91e3daab2 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:36:59.799998 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e1597aae-1e0f-42ec-b0e9-20f91e3daab2 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: 2d8900c4-92eb-4374-bd63-6d0ebbf407b7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:00.225419 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-38eb2dc6-3717-4a88-9ba8-0c06f10ec11c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:00.243841 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-38eb2dc6-3717-4a88-9ba8-0c06f10ec11c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1527 microversion: 2.1 time: 0.843902 Oct 27 03:37:00.249482 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2050/3856] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:59 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1527 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:37:00.426780 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3ec59ff6-5fa3-49ab-ad40-98b175310b32 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:00.428350 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3ec59ff6-5fa3-49ab-ad40-98b175310b32 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] [instance: 4183c266-b474-4c04-8e81-54a6a86e221b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:00.440759 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3ec59ff6-5fa3-49ab-ad40-98b175310b32 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:00.441279 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3ec59ff6-5fa3-49ab-ad40-98b175310b32 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:00.441740 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3ec59ff6-5fa3-49ab-ad40-98b175310b32 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:00.442523 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3ec59ff6-5fa3-49ab-ad40-98b175310b32 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:00.442989 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3ec59ff6-5fa3-49ab-ad40-98b175310b32 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:00.448171 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3ec59ff6-5fa3-49ab-ad40-98b175310b32 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:00.702144 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e1597aae-1e0f-42ec-b0e9-20f91e3daab2 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:00.716401 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e1597aae-1e0f-42ec-b0e9-20f91e3daab2 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/2d8900c4-92eb-4374-bd63-6d0ebbf407b7" status: 200 len: 1214 microversion: 2.1 time: 0.950039 Oct 27 03:37:00.720422 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1807/3857] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:36:59 2022] GET /compute/v2.1/servers/2d8900c4-92eb-4374-bd63-6d0ebbf407b7 => generated 1214 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:37:00.755819 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3ec59ff6-5fa3-49ab-ad40-98b175310b32 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c36bef85ac34b4983a79e03c56965c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e58f30136ed4a4d9bff48e9b4cde5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:00.770748 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3ec59ff6-5fa3-49ab-ad40-98b175310b32 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] 10.222.0.20 "GET /compute/v2.1/servers/4183c266-b474-4c04-8e81-54a6a86e221b" status: 200 len: 1324 microversion: 2.1 time: 0.347780 Oct 27 03:37:00.771661 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2051/3858] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:00 2022] GET /compute/v2.1/servers/4183c266-b474-4c04-8e81-54a6a86e221b => generated 1324 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:37:01.308098 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-63d38480-5c7a-4793-8c6e-063cd480bb34 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:01.308098 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-63d38480-5c7a-4793-8c6e-063cd480bb34 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:01.315434 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-63d38480-5c7a-4793-8c6e-063cd480bb34 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:01.326263 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-63d38480-5c7a-4793-8c6e-063cd480bb34 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:01.330873 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-63d38480-5c7a-4793-8c6e-063cd480bb34 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:01.333427 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-63d38480-5c7a-4793-8c6e-063cd480bb34 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:01.336546 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-63d38480-5c7a-4793-8c6e-063cd480bb34 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:01.339770 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-63d38480-5c7a-4793-8c6e-063cd480bb34 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:01.529655 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:37:01.737593 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4397d3e3-db27-417a-a02b-de803c7a5a0d tempest-KeyPairsV2TestJSON-571914453 tempest-KeyPairsV2TestJSON-571914453-project] Action: 'create', calling method: .version_select at 0x7f7dd9de05e0>, body: {"keypair": {"name": "tempest-keypair-2098954962", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNOz4HI3oc9qWgUSTThLsa+jP8R8ORs8ggfeHufoDlZ5GCkKAEBzNIPztxnJuCQoPNhV87TjjWBay5ordQjfIRGEEzMxEhkcF661zn80N+E8Y+/ZGalI+q3Qa/TS0fegAw=="}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:37:01.818947 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-4397d3e3-db27-417a-a02b-de803c7a5a0d tempest-KeyPairsV2TestJSON-571914453 tempest-KeyPairsV2TestJSON-571914453-project] Getting quotas for project b5d9e5de2b66480fafc7aadead985426. Resources: {'key_pairs'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:37:01.834404 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-4397d3e3-db27-417a-a02b-de803c7a5a0d tempest-KeyPairsV2TestJSON-571914453 tempest-KeyPairsV2TestJSON-571914453-project] Getting quotas for user e5c7cc81e5fc448581de55b810df0d1b and project b5d9e5de2b66480fafc7aadead985426. Resources: {'key_pairs'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:37:01.927825 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-63d38480-5c7a-4793-8c6e-063cd480bb34 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:01.939698 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-63d38480-5c7a-4793-8c6e-063cd480bb34 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1527 microversion: 2.1 time: 0.674464 Oct 27 03:37:01.944194 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1808/3859] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:01 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1527 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:37:01.954659 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-25dfac18-6615-40f5-bf64-bb0a92592ed9 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:01.958443 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-25dfac18-6615-40f5-bf64-bb0a92592ed9 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: 2d8900c4-92eb-4374-bd63-6d0ebbf407b7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:01.971458 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-25dfac18-6615-40f5-bf64-bb0a92592ed9 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:01.972653 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-25dfac18-6615-40f5-bf64-bb0a92592ed9 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:01.975911 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-25dfac18-6615-40f5-bf64-bb0a92592ed9 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:01.983484 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4397d3e3-db27-417a-a02b-de803c7a5a0d tempest-KeyPairsV2TestJSON-571914453 tempest-KeyPairsV2TestJSON-571914453-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.454279 Oct 27 03:37:01.983885 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-25dfac18-6615-40f5-bf64-bb0a92592ed9 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:01.983994 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2052/3860] 10.222.0.20 () {60 vars in 1159 bytes} [Thu Oct 27 03:37:01 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:37:01.984100 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-25dfac18-6615-40f5-bf64-bb0a92592ed9 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:01.984100 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-25dfac18-6615-40f5-bf64-bb0a92592ed9 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:01.986574 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0eec76ef-55b6-4593-a773-297afc3c9ab0 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:01.987489 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0eec76ef-55b6-4593-a773-297afc3c9ab0 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] [instance: 4183c266-b474-4c04-8e81-54a6a86e221b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:02.000737 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0eec76ef-55b6-4593-a773-297afc3c9ab0 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:02.002191 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0eec76ef-55b6-4593-a773-297afc3c9ab0 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:02.015265 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0eec76ef-55b6-4593-a773-297afc3c9ab0 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:02.019801 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0eec76ef-55b6-4593-a773-297afc3c9ab0 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:02.020617 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0eec76ef-55b6-4593-a773-297afc3c9ab0 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:02.022619 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0eec76ef-55b6-4593-a773-297afc3c9ab0 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:02.155445 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-25dfac18-6615-40f5-bf64-bb0a92592ed9 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:02.163834 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-25dfac18-6615-40f5-bf64-bb0a92592ed9 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/2d8900c4-92eb-4374-bd63-6d0ebbf407b7" status: 200 len: 1210 microversion: 2.1 time: 0.214462 Oct 27 03:37:02.191455 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1809/3861] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:01 2022] GET /compute/v2.1/servers/2d8900c4-92eb-4374-bd63-6d0ebbf407b7 => generated 1210 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:37:02.201409 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-bdbf36d8-f50f-4f30-8392-0994e8e6e612 tempest-KeyPairsV2TestJSON-571914453 tempest-KeyPairsV2TestJSON-571914453-project] Calling method '.version_select at 0x7f7ddee45ca0>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:02.236815 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-bdbf36d8-f50f-4f30-8392-0994e8e6e612 tempest-KeyPairsV2TestJSON-571914453 tempest-KeyPairsV2TestJSON-571914453-project] 10.222.0.20 "GET /compute/v2.1/os-keypairs/tempest-keypair-2098954962" status: 200 len: 498 microversion: 2.1 time: 0.043010 Oct 27 03:37:02.237546 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1810/3862] 10.222.0.20 () {58 vars in 1218 bytes} [Thu Oct 27 03:37:02 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-2098954962 => generated 498 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:37:02.263494 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c601facf-c72f-41a2-ae47-9351ac5c0bb5 tempest-KeyPairsV2TestJSON-571914453 tempest-KeyPairsV2TestJSON-571914453-project] Calling method '.version_select at 0x7f7dd9debee0>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:02.421907 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c601facf-c72f-41a2-ae47-9351ac5c0bb5 tempest-KeyPairsV2TestJSON-571914453 tempest-KeyPairsV2TestJSON-571914453-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2098954962" status: 202 len: 0 microversion: 2.1 time: 0.174676 Oct 27 03:37:02.422673 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1811/3863] 10.222.0.20 () {58 vars in 1221 bytes} [Thu Oct 27 03:37:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2098954962 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:37:02.437301 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c1f623c3-88e8-4971-ba39-f4baa69fc850 tempest-KeyPairsV2TestJSON-571914453 tempest-KeyPairsV2TestJSON-571914453-project] Action: 'create', calling method: .version_select at 0x7f7ddec7c820>, body: {"keypair": {"name": "tempest-keypair-1885180139", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD/cLQ/irYiRtLXtmrFaMzCj6A72IzM4iwDHoYTSzrgjT4Kub8adtovtEXGEQIFAt5DJfDXrmWk7nlA+2X2fYeTnDYWr5BkDUo5PTGolrs/QGYKiFWefPFvhdRqJ30tXcQ=="}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:37:02.472132 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0eec76ef-55b6-4593-a773-297afc3c9ab0 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c36bef85ac34b4983a79e03c56965c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e58f30136ed4a4d9bff48e9b4cde5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:02.485868 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0eec76ef-55b6-4593-a773-297afc3c9ab0 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] 10.222.0.20 "GET /compute/v2.1/servers/4183c266-b474-4c04-8e81-54a6a86e221b" status: 200 len: 1324 microversion: 2.1 time: 0.503334 Oct 27 03:37:02.489834 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2053/3864] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:01 2022] GET /compute/v2.1/servers/4183c266-b474-4c04-8e81-54a6a86e221b => generated 1324 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:37:02.552027 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-c1f623c3-88e8-4971-ba39-f4baa69fc850 tempest-KeyPairsV2TestJSON-571914453 tempest-KeyPairsV2TestJSON-571914453-project] Getting quotas for project b5d9e5de2b66480fafc7aadead985426. Resources: {'key_pairs'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:37:02.567201 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-c1f623c3-88e8-4971-ba39-f4baa69fc850 tempest-KeyPairsV2TestJSON-571914453 tempest-KeyPairsV2TestJSON-571914453-project] Getting quotas for user e5c7cc81e5fc448581de55b810df0d1b and project b5d9e5de2b66480fafc7aadead985426. Resources: {'key_pairs'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:37:02.744054 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c1f623c3-88e8-4971-ba39-f4baa69fc850 tempest-KeyPairsV2TestJSON-571914453 tempest-KeyPairsV2TestJSON-571914453-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.311255 Oct 27 03:37:02.753665 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1812/3865] 10.222.0.20 () {60 vars in 1159 bytes} [Thu Oct 27 03:37:02 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:37:02.757082 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-21927025-355a-4843-ad6c-9a1364391133 tempest-KeyPairsV2TestJSON-571914453 tempest-KeyPairsV2TestJSON-571914453-project] Calling method '.version_select at 0x7f7dd9e91670>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:02.953890 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-21927025-355a-4843-ad6c-9a1364391133 tempest-KeyPairsV2TestJSON-571914453 tempest-KeyPairsV2TestJSON-571914453-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1885180139" status: 202 len: 0 microversion: 2.1 time: 0.200992 Oct 27 03:37:02.958133 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2054/3866] 10.222.0.20 () {58 vars in 1221 bytes} [Thu Oct 27 03:37:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1885180139 => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:37:02.965628 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-352c3143-2d78-4a77-af59-09f58719b150 tempest-KeyPairsV2TestJSON-571914453 tempest-KeyPairsV2TestJSON-571914453-project] Action: 'create', calling method: .version_select at 0x7f7ddecae790>, body: {"keypair": {"name": "tempest-keypair-165643907", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:37:02.995553 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ccf37cf2-088f-4c33-83e9-f33700f756d6 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:02.998849 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ccf37cf2-088f-4c33-83e9-f33700f756d6 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:03.019203 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ccf37cf2-088f-4c33-83e9-f33700f756d6 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:03.021781 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ccf37cf2-088f-4c33-83e9-f33700f756d6 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:03.023830 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ccf37cf2-088f-4c33-83e9-f33700f756d6 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:03.026969 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ccf37cf2-088f-4c33-83e9-f33700f756d6 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:03.029616 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ccf37cf2-088f-4c33-83e9-f33700f756d6 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:03.031664 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ccf37cf2-088f-4c33-83e9-f33700f756d6 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:03.043002 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-352c3143-2d78-4a77-af59-09f58719b150 tempest-KeyPairsV2TestJSON-571914453 tempest-KeyPairsV2TestJSON-571914453-project] Getting quotas for project b5d9e5de2b66480fafc7aadead985426. Resources: {'key_pairs'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:37:03.081513 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-352c3143-2d78-4a77-af59-09f58719b150 tempest-KeyPairsV2TestJSON-571914453 tempest-KeyPairsV2TestJSON-571914453-project] Getting quotas for user e5c7cc81e5fc448581de55b810df0d1b and project b5d9e5de2b66480fafc7aadead985426. Resources: {'key_pairs'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:37:03.245154 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-352c3143-2d78-4a77-af59-09f58719b150 tempest-KeyPairsV2TestJSON-571914453 tempest-KeyPairsV2TestJSON-571914453-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 573 microversion: 2.1 time: 0.283541 Oct 27 03:37:03.246178 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1813/3867] 10.222.0.20 () {60 vars in 1159 bytes} [Thu Oct 27 03:37:02 2022] POST /compute/v2.1/os-keypairs => generated 573 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:37:03.274417 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c3b5b897-80a7-4ca5-94be-f2a75134fce4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:03.276655 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c3b5b897-80a7-4ca5-94be-f2a75134fce4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: 2d8900c4-92eb-4374-bd63-6d0ebbf407b7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:03.300410 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c3b5b897-80a7-4ca5-94be-f2a75134fce4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:03.301981 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c3b5b897-80a7-4ca5-94be-f2a75134fce4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:03.302753 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c3b5b897-80a7-4ca5-94be-f2a75134fce4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:03.303707 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c3b5b897-80a7-4ca5-94be-f2a75134fce4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:03.306066 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c3b5b897-80a7-4ca5-94be-f2a75134fce4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:03.311802 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c3b5b897-80a7-4ca5-94be-f2a75134fce4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:03.604717 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c3b5b897-80a7-4ca5-94be-f2a75134fce4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:03.618397 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c3b5b897-80a7-4ca5-94be-f2a75134fce4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/2d8900c4-92eb-4374-bd63-6d0ebbf407b7" status: 200 len: 1266 microversion: 2.1 time: 0.363563 Oct 27 03:37:03.620474 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1814/3868] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:03 2022] GET /compute/v2.1/servers/2d8900c4-92eb-4374-bd63-6d0ebbf407b7 => generated 1266 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:37:03.635915 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-96cac7fc-c343-486b-8d11-2dc21f85ac0f tempest-KeyPairsV2TestJSON-571914453 tempest-KeyPairsV2TestJSON-571914453-project] Calling method '.version_select at 0x7f7ddee45d30>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:03.794298 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-96cac7fc-c343-486b-8d11-2dc21f85ac0f tempest-KeyPairsV2TestJSON-571914453 tempest-KeyPairsV2TestJSON-571914453-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-165643907" status: 202 len: 0 microversion: 2.1 time: 0.171951 Oct 27 03:37:03.800433 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1815/3869] 10.222.0.20 () {58 vars in 1218 bytes} [Thu Oct 27 03:37:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-165643907 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:37:03.807986 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c8de8a2c-c017-4db9-ad6b-1fa4dfdc9d23 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:03.809010 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c8de8a2c-c017-4db9-ad6b-1fa4dfdc9d23 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] [instance: 4183c266-b474-4c04-8e81-54a6a86e221b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:03.821428 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c8de8a2c-c017-4db9-ad6b-1fa4dfdc9d23 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:03.822318 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c8de8a2c-c017-4db9-ad6b-1fa4dfdc9d23 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:03.824603 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c8de8a2c-c017-4db9-ad6b-1fa4dfdc9d23 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:03.825851 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ccf37cf2-088f-4c33-83e9-f33700f756d6 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:03.828318 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c8de8a2c-c017-4db9-ad6b-1fa4dfdc9d23 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:03.829046 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c8de8a2c-c017-4db9-ad6b-1fa4dfdc9d23 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:03.829893 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c8de8a2c-c017-4db9-ad6b-1fa4dfdc9d23 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:03.857641 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ccf37cf2-088f-4c33-83e9-f33700f756d6 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1527 microversion: 2.1 time: 0.889925 Oct 27 03:37:03.859890 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2055/3870] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:02 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1527 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:37:03.866384 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-eaf268de-8ac9-4a1b-ad78-dffae999e36b tempest-KeyPairsV2TestJSON-571914453 tempest-KeyPairsV2TestJSON-571914453-project] Action: 'create', calling method: .version_select at 0x7f7dd9f6c3a0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1125038819", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP63Wr5+PezylpgjyTwJmEAJKz7AgVHpuM+uUfK2soqTFsNhsr/XIYQ8+cn4tWLZDCuNjFpnB45BGThXBefKKMDxb85/4lcBPTICpW+eDMwJz9KawjDSGAlfPwGeD5FRFA=="}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:37:03.891218 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-eaf268de-8ac9-4a1b-ad78-dffae999e36b tempest-KeyPairsV2TestJSON-571914453 tempest-KeyPairsV2TestJSON-571914453-project] Getting quotas for project b5d9e5de2b66480fafc7aadead985426. Resources: {'key_pairs'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:37:03.898625 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-eaf268de-8ac9-4a1b-ad78-dffae999e36b tempest-KeyPairsV2TestJSON-571914453 tempest-KeyPairsV2TestJSON-571914453-project] Getting quotas for user e5c7cc81e5fc448581de55b810df0d1b and project b5d9e5de2b66480fafc7aadead985426. Resources: {'key_pairs'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:37:04.012141 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-eaf268de-8ac9-4a1b-ad78-dffae999e36b tempest-KeyPairsV2TestJSON-571914453 tempest-KeyPairsV2TestJSON-571914453-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.150765 Oct 27 03:37:04.013665 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2056/3871] 10.222.0.20 () {60 vars in 1159 bytes} [Thu Oct 27 03:37:03 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:37:04.029603 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-fbad21e5-7baa-4c93-9866-395be1e9f3e8 tempest-KeyPairsV2TestJSON-571914453 tempest-KeyPairsV2TestJSON-571914453-project] Action: 'create', calling method: .version_select at 0x7f7dd9d765e0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-502557827", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ7AR9VBTZlplaXZzV9CkGTIlEJ0wsMNEFErsQZQSQOdPcn2ZLx3/cQL/2Ch5dlVPlpT0cUNZppo/nKzxzyQndZHxzN9AeJtkzBrFFmkh6a7xPLx6lrKwtCol55fbzI2dg=="}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:37:04.082403 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-fbad21e5-7baa-4c93-9866-395be1e9f3e8 tempest-KeyPairsV2TestJSON-571914453 tempest-KeyPairsV2TestJSON-571914453-project] Getting quotas for project b5d9e5de2b66480fafc7aadead985426. Resources: {'key_pairs'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:37:04.099515 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-fbad21e5-7baa-4c93-9866-395be1e9f3e8 tempest-KeyPairsV2TestJSON-571914453 tempest-KeyPairsV2TestJSON-571914453-project] Getting quotas for user e5c7cc81e5fc448581de55b810df0d1b and project b5d9e5de2b66480fafc7aadead985426. Resources: {'key_pairs'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:37:04.260014 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c8de8a2c-c017-4db9-ad6b-1fa4dfdc9d23 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c36bef85ac34b4983a79e03c56965c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e58f30136ed4a4d9bff48e9b4cde5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:04.273240 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c8de8a2c-c017-4db9-ad6b-1fa4dfdc9d23 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] 10.222.0.20 "GET /compute/v2.1/servers/4183c266-b474-4c04-8e81-54a6a86e221b" status: 200 len: 1324 microversion: 2.1 time: 0.476521 Oct 27 03:37:04.274133 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1816/3872] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:03 2022] GET /compute/v2.1/servers/4183c266-b474-4c04-8e81-54a6a86e221b => generated 1324 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:37:04.447349 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-fbad21e5-7baa-4c93-9866-395be1e9f3e8 tempest-KeyPairsV2TestJSON-571914453 tempest-KeyPairsV2TestJSON-571914453-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.423215 Oct 27 03:37:04.450853 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2057/3873] 10.222.0.20 () {60 vars in 1159 bytes} [Thu Oct 27 03:37:04 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:37:04.464202 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a9f154b7-f465-4f37-a213-02c042f8a229 tempest-KeyPairsV2TestJSON-571914453 tempest-KeyPairsV2TestJSON-571914453-project] Action: 'create', calling method: .version_select at 0x7f7ddecb54c0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-609368069", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBnCXKP4fsLPZSy/DZJhNmjVj4Zpbngs4pNO8VWE1aT9RE8ilbhL1D+G87TDyffYZnmKy7ayKcTkejr/ZDk/kfiI9+liaq58dzujRtTnBbxrI9gLEPArybEoGv+LpE3mhg=="}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:37:04.500165 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-a9f154b7-f465-4f37-a213-02c042f8a229 tempest-KeyPairsV2TestJSON-571914453 tempest-KeyPairsV2TestJSON-571914453-project] Getting quotas for project b5d9e5de2b66480fafc7aadead985426. Resources: {'key_pairs'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:37:04.514333 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-a9f154b7-f465-4f37-a213-02c042f8a229 tempest-KeyPairsV2TestJSON-571914453 tempest-KeyPairsV2TestJSON-571914453-project] Getting quotas for user e5c7cc81e5fc448581de55b810df0d1b and project b5d9e5de2b66480fafc7aadead985426. Resources: {'key_pairs'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:37:04.649160 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a9f154b7-f465-4f37-a213-02c042f8a229 tempest-KeyPairsV2TestJSON-571914453 tempest-KeyPairsV2TestJSON-571914453-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.187503 Oct 27 03:37:04.652009 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0cac5c8c-e288-4b1a-9545-36e28abe51d8 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:04.653930 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1817/3874] 10.222.0.20 () {60 vars in 1159 bytes} [Thu Oct 27 03:37:04 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:37:04.654962 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0cac5c8c-e288-4b1a-9545-36e28abe51d8 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: 2d8900c4-92eb-4374-bd63-6d0ebbf407b7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:04.665108 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c58caff9-ef06-4129-be40-13345aaa738c tempest-KeyPairsV2TestJSON-571914453 tempest-KeyPairsV2TestJSON-571914453-project] Calling method '.version_select at 0x7f7dda130f70>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:04.679856 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0cac5c8c-e288-4b1a-9545-36e28abe51d8 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:04.680793 n-d-862769-1 devstack@n-api.service[121000]: WARNING oslo_db.sqlalchemy.utils [None req-c58caff9-ef06-4129-be40-13345aaa738c tempest-KeyPairsV2TestJSON-571914453 tempest-KeyPairsV2TestJSON-571914453-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 27 03:37:04.681643 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0cac5c8c-e288-4b1a-9545-36e28abe51d8 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:04.682672 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0cac5c8c-e288-4b1a-9545-36e28abe51d8 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:04.684944 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0cac5c8c-e288-4b1a-9545-36e28abe51d8 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:04.688824 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0cac5c8c-e288-4b1a-9545-36e28abe51d8 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:04.703348 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0cac5c8c-e288-4b1a-9545-36e28abe51d8 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:04.703528 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c58caff9-ef06-4129-be40-13345aaa738c tempest-KeyPairsV2TestJSON-571914453 tempest-KeyPairsV2TestJSON-571914453-project] 10.222.0.20 "GET /compute/v2.1/os-keypairs" status: 200 len: 1092 microversion: 2.1 time: 0.042120 Oct 27 03:37:04.708156 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1818/3875] 10.222.0.20 () {58 vars in 1137 bytes} [Thu Oct 27 03:37:04 2022] GET /compute/v2.1/os-keypairs => generated 1092 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:37:04.731396 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-563e131c-7952-4775-ac42-1e949ee14ee5 tempest-KeyPairsV2TestJSON-571914453 tempest-KeyPairsV2TestJSON-571914453-project] Calling method '.version_select at 0x7f7ddecc84c0>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:04.906358 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-563e131c-7952-4775-ac42-1e949ee14ee5 tempest-KeyPairsV2TestJSON-571914453 tempest-KeyPairsV2TestJSON-571914453-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-609368069" status: 202 len: 0 microversion: 2.1 time: 0.195783 Oct 27 03:37:04.908366 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1819/3876] 10.222.0.20 () {58 vars in 1275 bytes} [Thu Oct 27 03:37:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-609368069 => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:37:04.918627 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7e3e5599-48af-40b6-8671-a0e67250349e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:04.929965 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7e3e5599-48af-40b6-8671-a0e67250349e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:04.946403 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7e3e5599-48af-40b6-8671-a0e67250349e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:04.947521 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7e3e5599-48af-40b6-8671-a0e67250349e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:04.948287 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7e3e5599-48af-40b6-8671-a0e67250349e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:04.949286 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7e3e5599-48af-40b6-8671-a0e67250349e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:04.950634 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7e3e5599-48af-40b6-8671-a0e67250349e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:04.952581 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7e3e5599-48af-40b6-8671-a0e67250349e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:05.061270 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0cac5c8c-e288-4b1a-9545-36e28abe51d8 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:05.088167 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0cac5c8c-e288-4b1a-9545-36e28abe51d8 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/2d8900c4-92eb-4374-bd63-6d0ebbf407b7" status: 200 len: 1272 microversion: 2.1 time: 0.442381 Oct 27 03:37:05.089583 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2058/3877] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:04 2022] GET /compute/v2.1/servers/2d8900c4-92eb-4374-bd63-6d0ebbf407b7 => generated 1272 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:37:05.100124 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ed7516c2-1662-4691-8de6-b013a38fa92b tempest-KeyPairsV2TestJSON-571914453 tempest-KeyPairsV2TestJSON-571914453-project] Calling method '.version_select at 0x7f7dd9d76af0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:05.239646 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ed7516c2-1662-4691-8de6-b013a38fa92b tempest-KeyPairsV2TestJSON-571914453 tempest-KeyPairsV2TestJSON-571914453-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-502557827" status: 202 len: 0 microversion: 2.1 time: 0.147585 Oct 27 03:37:05.240156 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2059/3878] 10.222.0.20 () {58 vars in 1275 bytes} [Thu Oct 27 03:37:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-502557827 => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:37:05.253020 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4faa611d-5abf-46d1-b72b-bef623dfe553 tempest-KeyPairsV2TestJSON-571914453 tempest-KeyPairsV2TestJSON-571914453-project] Calling method '.version_select at 0x7f7dd9cb1ee0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:05.315536 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:37:05.407811 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7e3e5599-48af-40b6-8671-a0e67250349e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:05.417697 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7e3e5599-48af-40b6-8671-a0e67250349e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1527 microversion: 2.1 time: 0.507775 Oct 27 03:37:05.419407 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1820/3879] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:04 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1527 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:37:05.424286 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-951c4098-d0ef-4377-8772-a968ce37e85a tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:05.425175 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-951c4098-d0ef-4377-8772-a968ce37e85a tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] [instance: 4183c266-b474-4c04-8e81-54a6a86e221b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:05.430795 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4faa611d-5abf-46d1-b72b-bef623dfe553 tempest-KeyPairsV2TestJSON-571914453 tempest-KeyPairsV2TestJSON-571914453-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1125038819" status: 202 len: 0 microversion: 2.1 time: 0.186316 Oct 27 03:37:05.444994 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2060/3880] 10.222.0.20 () {58 vars in 1278 bytes} [Thu Oct 27 03:37:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1125038819 => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:37:05.445181 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-951c4098-d0ef-4377-8772-a968ce37e85a tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:05.445181 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-951c4098-d0ef-4377-8772-a968ce37e85a tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:05.445181 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-951c4098-d0ef-4377-8772-a968ce37e85a tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:05.445181 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-951c4098-d0ef-4377-8772-a968ce37e85a tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:05.445181 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-951c4098-d0ef-4377-8772-a968ce37e85a tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:05.445181 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-951c4098-d0ef-4377-8772-a968ce37e85a tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:05.861968 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-951c4098-d0ef-4377-8772-a968ce37e85a tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c36bef85ac34b4983a79e03c56965c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e58f30136ed4a4d9bff48e9b4cde5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:05.895528 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-951c4098-d0ef-4377-8772-a968ce37e85a tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] 10.222.0.20 "GET /compute/v2.1/servers/4183c266-b474-4c04-8e81-54a6a86e221b" status: 200 len: 1324 microversion: 2.1 time: 0.473676 Oct 27 03:37:05.897833 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1821/3881] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:05 2022] GET /compute/v2.1/servers/4183c266-b474-4c04-8e81-54a6a86e221b => generated 1324 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:37:06.115305 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a2eda738-a531-492b-a9d6-70d7d7f5f850 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:06.122587 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a2eda738-a531-492b-a9d6-70d7d7f5f850 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: 2d8900c4-92eb-4374-bd63-6d0ebbf407b7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:06.163722 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a2eda738-a531-492b-a9d6-70d7d7f5f850 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:06.164249 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a2eda738-a531-492b-a9d6-70d7d7f5f850 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:06.169789 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a2eda738-a531-492b-a9d6-70d7d7f5f850 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:06.172005 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a2eda738-a531-492b-a9d6-70d7d7f5f850 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:06.174064 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a2eda738-a531-492b-a9d6-70d7d7f5f850 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:06.174846 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a2eda738-a531-492b-a9d6-70d7d7f5f850 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:06.446843 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f602a909-2a08-4ac1-8171-45a77e0bb871 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:06.447517 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f602a909-2a08-4ac1-8171-45a77e0bb871 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:06.460246 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f602a909-2a08-4ac1-8171-45a77e0bb871 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:06.462023 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f602a909-2a08-4ac1-8171-45a77e0bb871 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:06.466555 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f602a909-2a08-4ac1-8171-45a77e0bb871 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:06.466555 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f602a909-2a08-4ac1-8171-45a77e0bb871 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:06.466555 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f602a909-2a08-4ac1-8171-45a77e0bb871 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:06.466555 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f602a909-2a08-4ac1-8171-45a77e0bb871 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:06.724496 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a2eda738-a531-492b-a9d6-70d7d7f5f850 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:06.747637 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a2eda738-a531-492b-a9d6-70d7d7f5f850 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/2d8900c4-92eb-4374-bd63-6d0ebbf407b7" status: 200 len: 1314 microversion: 2.1 time: 0.638611 Oct 27 03:37:06.767369 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2061/3882] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:06 2022] GET /compute/v2.1/servers/2d8900c4-92eb-4374-bd63-6d0ebbf407b7 => generated 1314 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:37:06.928740 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-42c11f4e-76e0-4d80-87f7-5fd76ed823cc tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:06.929573 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-42c11f4e-76e0-4d80-87f7-5fd76ed823cc tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] [instance: 4183c266-b474-4c04-8e81-54a6a86e221b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:06.941718 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-42c11f4e-76e0-4d80-87f7-5fd76ed823cc tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:06.942976 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-42c11f4e-76e0-4d80-87f7-5fd76ed823cc tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:06.944195 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-42c11f4e-76e0-4d80-87f7-5fd76ed823cc tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:06.947256 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-42c11f4e-76e0-4d80-87f7-5fd76ed823cc tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:06.947936 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-42c11f4e-76e0-4d80-87f7-5fd76ed823cc tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:06.948561 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-42c11f4e-76e0-4d80-87f7-5fd76ed823cc tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:06.984527 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:37:07.196232 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f602a909-2a08-4ac1-8171-45a77e0bb871 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:07.205785 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f602a909-2a08-4ac1-8171-45a77e0bb871 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1527 microversion: 2.1 time: 0.764781 Oct 27 03:37:07.207028 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1822/3883] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:06 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1527 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:37:07.281336 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-42c11f4e-76e0-4d80-87f7-5fd76ed823cc tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c36bef85ac34b4983a79e03c56965c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e58f30136ed4a4d9bff48e9b4cde5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:07.308703 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-42c11f4e-76e0-4d80-87f7-5fd76ed823cc tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] 10.222.0.20 "GET /compute/v2.1/servers/4183c266-b474-4c04-8e81-54a6a86e221b" status: 200 len: 1324 microversion: 2.1 time: 0.385020 Oct 27 03:37:07.310422 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2062/3884] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:06 2022] GET /compute/v2.1/servers/4183c266-b474-4c04-8e81-54a6a86e221b => generated 1324 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:37:07.778675 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-68ad1780-e9f8-4f25-9c84-a17bb5efc345 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:07.779967 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-68ad1780-e9f8-4f25-9c84-a17bb5efc345 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: 2d8900c4-92eb-4374-bd63-6d0ebbf407b7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:07.814466 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-68ad1780-e9f8-4f25-9c84-a17bb5efc345 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:07.816724 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-68ad1780-e9f8-4f25-9c84-a17bb5efc345 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:07.833503 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-68ad1780-e9f8-4f25-9c84-a17bb5efc345 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:07.838544 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-68ad1780-e9f8-4f25-9c84-a17bb5efc345 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:07.838544 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-68ad1780-e9f8-4f25-9c84-a17bb5efc345 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:07.838544 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-68ad1780-e9f8-4f25-9c84-a17bb5efc345 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:07.896197 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-b569e18f-eede-4d18-a7f0-294fd9920050 req-a174a015-091c-47e5-9610-a020857957af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4183c266-b474-4c04-8e81-54a6a86e221b", "name": "network-vif-plugged", "status": "completed", "tag": "357d8a7a-810d-49af-aada-7fc361e514da"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:37:07.914914 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-b569e18f-eede-4d18-a7f0-294fd9920050 req-a174a015-091c-47e5-9610-a020857957af service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:07.916129 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-b569e18f-eede-4d18-a7f0-294fd9920050 req-a174a015-091c-47e5-9610-a020857957af service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:07.916867 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-b569e18f-eede-4d18-a7f0-294fd9920050 req-a174a015-091c-47e5-9610-a020857957af service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:07.933681 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-b569e18f-eede-4d18-a7f0-294fd9920050 req-a174a015-091c-47e5-9610-a020857957af service nova] Creating event network-vif-plugged:357d8a7a-810d-49af-aada-7fc361e514da for instance 4183c266-b474-4c04-8e81-54a6a86e221b on n-h1-862769-1 Oct 27 03:37:07.941654 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-b569e18f-eede-4d18-a7f0-294fd9920050 req-a174a015-091c-47e5-9610-a020857957af service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050188 Oct 27 03:37:07.944286 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2063/3885] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:37:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:37:08.074132 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-95ed0a42-12af-495c-a8b8-405bc24325dc req-f650ca74-992a-4956-9424-30feed54e862 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d8900c4-92eb-4374-bd63-6d0ebbf407b7", "tag": "fae83cc0-a7ce-470e-8ecf-19d03d536ec7"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:37:08.100476 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-95ed0a42-12af-495c-a8b8-405bc24325dc req-f650ca74-992a-4956-9424-30feed54e862 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:08.100970 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-95ed0a42-12af-495c-a8b8-405bc24325dc req-f650ca74-992a-4956-9424-30feed54e862 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:08.101436 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-95ed0a42-12af-495c-a8b8-405bc24325dc req-f650ca74-992a-4956-9424-30feed54e862 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:08.127449 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-95ed0a42-12af-495c-a8b8-405bc24325dc req-f650ca74-992a-4956-9424-30feed54e862 service nova] Creating event network-changed:fae83cc0-a7ce-470e-8ecf-19d03d536ec7 for instance 2d8900c4-92eb-4374-bd63-6d0ebbf407b7 on n-h2-862769-1 Oct 27 03:37:08.141933 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-95ed0a42-12af-495c-a8b8-405bc24325dc req-f650ca74-992a-4956-9424-30feed54e862 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075815 Oct 27 03:37:08.145196 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2064/3886] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:37:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:37:08.242696 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a2f28c95-ad37-42fe-9b44-60c95aa06b26 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:08.245248 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a2f28c95-ad37-42fe-9b44-60c95aa06b26 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:08.264193 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a2f28c95-ad37-42fe-9b44-60c95aa06b26 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:08.269147 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a2f28c95-ad37-42fe-9b44-60c95aa06b26 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:08.269864 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a2f28c95-ad37-42fe-9b44-60c95aa06b26 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:08.274653 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a2f28c95-ad37-42fe-9b44-60c95aa06b26 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:08.276201 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a2f28c95-ad37-42fe-9b44-60c95aa06b26 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:08.277095 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a2f28c95-ad37-42fe-9b44-60c95aa06b26 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:08.384948 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-68ad1780-e9f8-4f25-9c84-a17bb5efc345 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:08.416915 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-68ad1780-e9f8-4f25-9c84-a17bb5efc345 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/2d8900c4-92eb-4374-bd63-6d0ebbf407b7" status: 200 len: 1314 microversion: 2.1 time: 0.644655 Oct 27 03:37:08.423519 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1823/3887] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:07 2022] GET /compute/v2.1/servers/2d8900c4-92eb-4374-bd63-6d0ebbf407b7 => generated 1314 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:37:08.434547 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d157e527-511b-4af8-85ce-a883147fa81a tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:08.441378 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d157e527-511b-4af8-85ce-a883147fa81a tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] [instance: 4183c266-b474-4c04-8e81-54a6a86e221b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:08.445234 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:37:08.458274 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d157e527-511b-4af8-85ce-a883147fa81a tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:08.459199 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d157e527-511b-4af8-85ce-a883147fa81a tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:08.459907 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d157e527-511b-4af8-85ce-a883147fa81a tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:08.461938 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d157e527-511b-4af8-85ce-a883147fa81a tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:08.463653 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d157e527-511b-4af8-85ce-a883147fa81a tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:08.464371 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d157e527-511b-4af8-85ce-a883147fa81a tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:08.803251 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d157e527-511b-4af8-85ce-a883147fa81a tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c36bef85ac34b4983a79e03c56965c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e58f30136ed4a4d9bff48e9b4cde5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:08.812513 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d157e527-511b-4af8-85ce-a883147fa81a tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] 10.222.0.20 "GET /compute/v2.1/servers/4183c266-b474-4c04-8e81-54a6a86e221b" status: 200 len: 1324 microversion: 2.1 time: 0.387540 Oct 27 03:37:08.813097 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1824/3888] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:08 2022] GET /compute/v2.1/servers/4183c266-b474-4c04-8e81-54a6a86e221b => generated 1324 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:37:08.858074 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a2f28c95-ad37-42fe-9b44-60c95aa06b26 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:08.872501 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a2f28c95-ad37-42fe-9b44-60c95aa06b26 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1509 microversion: 2.1 time: 0.646631 Oct 27 03:37:08.873458 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2065/3889] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:08 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1509 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:37:09.271355 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:37:09.431731 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c6f1aca3-fab5-4eac-915e-7f0c3eb2ec15 tempest-KeyPairsV22TestJSON-1186237770 tempest-KeyPairsV22TestJSON-1186237770-project] Action: 'create', calling method: .version_select at 0x7f7dd9e3f790>, body: {"keypair": {"name": "tempest-keypair-1184959650", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGp7Yalz+BBXhkGCdw2Uy9KZ75M6HoCYovSJU7znUcC4yFOTxS4DNgwHhX9856mJ5/JNeA/GdKQbFVcFAD2v1f7PH+NQ1KT4xq6BGST/D0/twOXmDVCsB3sJycasnpJK4g=="}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:37:09.443983 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0ae72230-427a-4976-8693-bec91730bb4c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:09.444603 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0ae72230-427a-4976-8693-bec91730bb4c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: 2d8900c4-92eb-4374-bd63-6d0ebbf407b7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:09.456389 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0ae72230-427a-4976-8693-bec91730bb4c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:09.456881 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0ae72230-427a-4976-8693-bec91730bb4c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:09.457325 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0ae72230-427a-4976-8693-bec91730bb4c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:09.458106 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0ae72230-427a-4976-8693-bec91730bb4c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:09.458520 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0ae72230-427a-4976-8693-bec91730bb4c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:09.458953 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0ae72230-427a-4976-8693-bec91730bb4c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:09.468544 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-c6f1aca3-fab5-4eac-915e-7f0c3eb2ec15 tempest-KeyPairsV22TestJSON-1186237770 tempest-KeyPairsV22TestJSON-1186237770-project] Getting quotas for project c52caa270c8d4a0385ddcc13dae2fa90. Resources: {'key_pairs'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:37:09.473721 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-c6f1aca3-fab5-4eac-915e-7f0c3eb2ec15 tempest-KeyPairsV22TestJSON-1186237770 tempest-KeyPairsV22TestJSON-1186237770-project] Getting quotas for user 6d8f1c7482ad4bf0896165c50f70ad95 and project c52caa270c8d4a0385ddcc13dae2fa90. Resources: {'key_pairs'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:37:09.581341 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c6f1aca3-fab5-4eac-915e-7f0c3eb2ec15 tempest-KeyPairsV22TestJSON-1186237770 tempest-KeyPairsV22TestJSON-1186237770-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.316165 Oct 27 03:37:09.583692 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1825/3890] 10.222.0.20 () {62 vars in 1199 bytes} [Thu Oct 27 03:37:09 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 318 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 27 03:37:09.594169 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-fb15c553-45f4-4057-886b-3882fbab2685 tempest-KeyPairsV22TestJSON-1186237770 tempest-KeyPairsV22TestJSON-1186237770-project] Calling method '.version_select at 0x7f7ddec554c0>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:09.604955 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-fb15c553-45f4-4057-886b-3882fbab2685 tempest-KeyPairsV22TestJSON-1186237770 tempest-KeyPairsV22TestJSON-1186237770-project] 10.222.0.20 "GET /compute/v2.1/os-keypairs/tempest-keypair-1184959650" status: 200 len: 513 microversion: 2.2 time: 0.015757 Oct 27 03:37:09.605778 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1826/3891] 10.222.0.20 () {60 vars in 1258 bytes} [Thu Oct 27 03:37:09 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1184959650 => generated 513 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:37:09.618689 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0ae72230-427a-4976-8693-bec91730bb4c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:09.620334 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0a359144-46cc-4f59-aa2b-db7ddd2ef8f4 tempest-KeyPairsV22TestJSON-1186237770 tempest-KeyPairsV22TestJSON-1186237770-project] Calling method '.version_select at 0x7f7ddecc8280>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:09.627509 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0ae72230-427a-4976-8693-bec91730bb4c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/2d8900c4-92eb-4374-bd63-6d0ebbf407b7" status: 200 len: 1314 microversion: 2.1 time: 0.187508 Oct 27 03:37:09.628291 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2066/3892] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:09 2022] GET /compute/v2.1/servers/2d8900c4-92eb-4374-bd63-6d0ebbf407b7 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:37:09.808979 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0a359144-46cc-4f59-aa2b-db7ddd2ef8f4 tempest-KeyPairsV22TestJSON-1186237770 tempest-KeyPairsV22TestJSON-1186237770-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1184959650" status: 204 len: 0 microversion: 2.2 time: 0.192481 Oct 27 03:37:09.809562 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1827/3893] 10.222.0.20 () {60 vars in 1261 bytes} [Thu Oct 27 03:37:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1184959650 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 03:37:09.821499 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-21b78a79-5470-4557-9b6e-cb5c5ac13764 tempest-KeyPairsV22TestJSON-1186237770 tempest-KeyPairsV22TestJSON-1186237770-project] Action: 'create', calling method: .version_select at 0x7f7dd9fb2670>, body: {"keypair": {"name": "tempest-keypair-2028099564", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIROct8amCQKAgkhOOhdR1Q/BJfv3K4lB9WgttjgrheMeFL5vftM8m91IDuBJN8sGKDRTMp/sQz53kVzZH/Ff8/k9dBqhcnJJyjY3lR/SXxbwoKQ28rtbUkjfSGKwdSb8A=="}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:37:09.839535 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-04cb11df-12a6-46f1-a419-959931e961a5 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:09.839535 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-04cb11df-12a6-46f1-a419-959931e961a5 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] [instance: 4183c266-b474-4c04-8e81-54a6a86e221b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:09.847615 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-21b78a79-5470-4557-9b6e-cb5c5ac13764 tempest-KeyPairsV22TestJSON-1186237770 tempest-KeyPairsV22TestJSON-1186237770-project] Getting quotas for project c52caa270c8d4a0385ddcc13dae2fa90. Resources: {'key_pairs'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:37:09.851942 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-04cb11df-12a6-46f1-a419-959931e961a5 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:09.852435 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-04cb11df-12a6-46f1-a419-959931e961a5 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:09.852877 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-04cb11df-12a6-46f1-a419-959931e961a5 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:09.853634 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-04cb11df-12a6-46f1-a419-959931e961a5 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:09.854134 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-04cb11df-12a6-46f1-a419-959931e961a5 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:09.854488 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-04cb11df-12a6-46f1-a419-959931e961a5 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:09.860074 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-21b78a79-5470-4557-9b6e-cb5c5ac13764 tempest-KeyPairsV22TestJSON-1186237770 tempest-KeyPairsV22TestJSON-1186237770-project] Getting quotas for user 6d8f1c7482ad4bf0896165c50f70ad95 and project c52caa270c8d4a0385ddcc13dae2fa90. Resources: {'key_pairs'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:37:09.939254 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-21b78a79-5470-4557-9b6e-cb5c5ac13764 tempest-KeyPairsV22TestJSON-1186237770 tempest-KeyPairsV22TestJSON-1186237770-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.121496 Oct 27 03:37:09.940754 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2067/3894] 10.222.0.20 () {62 vars in 1199 bytes} [Thu Oct 27 03:37:09 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 124 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 27 03:37:09.947392 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-18d6dcd1-e492-4b4c-89ca-9bddb38fda2c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:09.947392 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-18d6dcd1-e492-4b4c-89ca-9bddb38fda2c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:09.953582 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-18d6dcd1-e492-4b4c-89ca-9bddb38fda2c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:09.954108 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-18d6dcd1-e492-4b4c-89ca-9bddb38fda2c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:09.954562 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-18d6dcd1-e492-4b4c-89ca-9bddb38fda2c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:09.955306 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-18d6dcd1-e492-4b4c-89ca-9bddb38fda2c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:09.955824 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-18d6dcd1-e492-4b4c-89ca-9bddb38fda2c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:09.956197 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-18d6dcd1-e492-4b4c-89ca-9bddb38fda2c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:10.095711 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-04cb11df-12a6-46f1-a419-959931e961a5 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c36bef85ac34b4983a79e03c56965c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e58f30136ed4a4d9bff48e9b4cde5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:10.106008 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-04cb11df-12a6-46f1-a419-959931e961a5 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] 10.222.0.20 "GET /compute/v2.1/servers/4183c266-b474-4c04-8e81-54a6a86e221b" status: 200 len: 1324 microversion: 2.1 time: 0.271683 Oct 27 03:37:10.106632 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1828/3895] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:09 2022] GET /compute/v2.1/servers/4183c266-b474-4c04-8e81-54a6a86e221b => generated 1324 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:37:10.111422 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6066c4f1-fde8-4198-8338-08ac3e996c07 tempest-KeyPairsV22TestJSON-1186237770 tempest-KeyPairsV22TestJSON-1186237770-project] Calling method '.version_select at 0x7f7ddec559d0>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:10.131321 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-18d6dcd1-e492-4b4c-89ca-9bddb38fda2c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:10.140701 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-18d6dcd1-e492-4b4c-89ca-9bddb38fda2c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1509 microversion: 2.1 time: 0.198034 Oct 27 03:37:10.151919 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2068/3896] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:09 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1509 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:37:10.274420 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6066c4f1-fde8-4198-8338-08ac3e996c07 tempest-KeyPairsV22TestJSON-1186237770 tempest-KeyPairsV22TestJSON-1186237770-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2028099564" status: 204 len: 0 microversion: 2.2 time: 0.166530 Oct 27 03:37:10.276599 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1829/3897] 10.222.0.20 () {60 vars in 1261 bytes} [Thu Oct 27 03:37:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2028099564 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:37:10.286459 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-79bd4ca2-a631-4bba-95a1-423d6accaf2f tempest-KeyPairsV22TestJSON-1186237770 tempest-KeyPairsV22TestJSON-1186237770-project] Action: 'create', calling method: .version_select at 0x7f7dd9d83430>, body: {"keypair": {"name": "tempest-keypair-1431468467", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:37:10.315579 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-79bd4ca2-a631-4bba-95a1-423d6accaf2f tempest-KeyPairsV22TestJSON-1186237770 tempest-KeyPairsV22TestJSON-1186237770-project] Getting quotas for project c52caa270c8d4a0385ddcc13dae2fa90. Resources: {'key_pairs'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:37:10.321125 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-79bd4ca2-a631-4bba-95a1-423d6accaf2f tempest-KeyPairsV22TestJSON-1186237770 tempest-KeyPairsV22TestJSON-1186237770-project] Getting quotas for user 6d8f1c7482ad4bf0896165c50f70ad95 and project c52caa270c8d4a0385ddcc13dae2fa90. Resources: {'key_pairs'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:37:10.439516 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-79bd4ca2-a631-4bba-95a1-423d6accaf2f tempest-KeyPairsV22TestJSON-1186237770 tempest-KeyPairsV22TestJSON-1186237770-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.157077 Oct 27 03:37:10.439889 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2069/3898] 10.222.0.20 () {62 vars in 1199 bytes} [Thu Oct 27 03:37:10 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 159 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 27 03:37:10.451371 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-507d1ab2-1be7-49b0-b4a7-4411711c22dd tempest-KeyPairsV22TestJSON-1186237770 tempest-KeyPairsV22TestJSON-1186237770-project] Calling method '.version_select at 0x7f7ddecc8700>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:10.546822 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-507d1ab2-1be7-49b0-b4a7-4411711c22dd tempest-KeyPairsV22TestJSON-1186237770 tempest-KeyPairsV22TestJSON-1186237770-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1431468467" status: 204 len: 0 microversion: 2.2 time: 0.099997 Oct 27 03:37:10.547410 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1830/3899] 10.222.0.20 () {60 vars in 1261 bytes} [Thu Oct 27 03:37:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1431468467 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 03:37:10.560049 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2cfda219-4a1e-454d-815f-0a8d5cf33868 tempest-KeyPairsV22TestJSON-1186237770 tempest-KeyPairsV22TestJSON-1186237770-project] Action: 'create', calling method: .version_select at 0x7f7dd9ce2310>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-360647973", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFDp5TlTHBIAW41iqG7Lefqyou/+ptHVI/8Zx0MpOWWWiswAjI5gv6x9mYrLzC2kcAp0pga3YEwlBkcVJnNaKNptCzeP+Fesh224wh0fp0+cuPfKZ27wmhAqeYFEbnEKvQ=="}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:37:10.578290 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-2cfda219-4a1e-454d-815f-0a8d5cf33868 tempest-KeyPairsV22TestJSON-1186237770 tempest-KeyPairsV22TestJSON-1186237770-project] Getting quotas for project c52caa270c8d4a0385ddcc13dae2fa90. Resources: {'key_pairs'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:37:10.584549 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-2cfda219-4a1e-454d-815f-0a8d5cf33868 tempest-KeyPairsV22TestJSON-1186237770 tempest-KeyPairsV22TestJSON-1186237770-project] Getting quotas for user 6d8f1c7482ad4bf0896165c50f70ad95 and project c52caa270c8d4a0385ddcc13dae2fa90. Resources: {'key_pairs'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:37:10.654016 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0250bab0-5b64-4707-9cec-2bb0dad26318 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:10.655116 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0250bab0-5b64-4707-9cec-2bb0dad26318 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: 2d8900c4-92eb-4374-bd63-6d0ebbf407b7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:10.666917 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2cfda219-4a1e-454d-815f-0a8d5cf33868 tempest-KeyPairsV22TestJSON-1186237770 tempest-KeyPairsV22TestJSON-1186237770-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.109766 Oct 27 03:37:10.666917 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2070/3900] 10.222.0.20 () {62 vars in 1199 bytes} [Thu Oct 27 03:37:10 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 112 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 27 03:37:10.667124 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0250bab0-5b64-4707-9cec-2bb0dad26318 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:10.667853 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0250bab0-5b64-4707-9cec-2bb0dad26318 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:10.668370 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0250bab0-5b64-4707-9cec-2bb0dad26318 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:10.669632 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0250bab0-5b64-4707-9cec-2bb0dad26318 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:10.670145 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0250bab0-5b64-4707-9cec-2bb0dad26318 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:10.670789 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0250bab0-5b64-4707-9cec-2bb0dad26318 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:10.683623 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e5951940-59eb-4843-9ce2-334fc5048144 tempest-KeyPairsV22TestJSON-1186237770 tempest-KeyPairsV22TestJSON-1186237770-project] Action: 'create', calling method: .version_select at 0x7f7dd9d76790>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1766665191", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJlKFl3QLUTO+SzUtbC9wwB+pm53cFZyFX5vt7yBvMgIrLmR1Bx4FjcshlGeozPztlmnBK9IwnIX/3I5qXtg/k/S7NyX6mjQeFOu3M5ILm6xsc4u5eH5G5+y7DTJwtXw+A=="}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:37:10.701690 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-e5951940-59eb-4843-9ce2-334fc5048144 tempest-KeyPairsV22TestJSON-1186237770 tempest-KeyPairsV22TestJSON-1186237770-project] Getting quotas for project c52caa270c8d4a0385ddcc13dae2fa90. Resources: {'key_pairs'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:37:10.707672 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-e5951940-59eb-4843-9ce2-334fc5048144 tempest-KeyPairsV22TestJSON-1186237770 tempest-KeyPairsV22TestJSON-1186237770-project] Getting quotas for user 6d8f1c7482ad4bf0896165c50f70ad95 and project c52caa270c8d4a0385ddcc13dae2fa90. Resources: {'key_pairs'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:37:10.828984 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e5951940-59eb-4843-9ce2-334fc5048144 tempest-KeyPairsV22TestJSON-1186237770 tempest-KeyPairsV22TestJSON-1186237770-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.149087 Oct 27 03:37:10.829846 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2071/3901] 10.222.0.20 () {62 vars in 1199 bytes} [Thu Oct 27 03:37:10 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 151 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 27 03:37:10.845844 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3b25fe11-11c4-434d-830d-02451b31ffb8 tempest-KeyPairsV22TestJSON-1186237770 tempest-KeyPairsV22TestJSON-1186237770-project] Action: 'create', calling method: .version_select at 0x7f7dd9d55ca0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-419431981", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFY1uNhKrSWB6MbJlsTQ4ltb9Lybg3+AyHHyOsRtNCZCullGMlNwcnpj6BmvKkT9ib5SqW7OurhwraLEyhFXv0oOSzgn+X9ryGDHPmuakKioFinmoBIN+O9BfK0o1o6ytQ=="}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:37:10.850826 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0250bab0-5b64-4707-9cec-2bb0dad26318 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:10.860699 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0250bab0-5b64-4707-9cec-2bb0dad26318 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/2d8900c4-92eb-4374-bd63-6d0ebbf407b7" status: 200 len: 1314 microversion: 2.1 time: 0.210685 Oct 27 03:37:10.861597 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1831/3902] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:10 2022] GET /compute/v2.1/servers/2d8900c4-92eb-4374-bd63-6d0ebbf407b7 => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:37:10.873395 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-3b25fe11-11c4-434d-830d-02451b31ffb8 tempest-KeyPairsV22TestJSON-1186237770 tempest-KeyPairsV22TestJSON-1186237770-project] Getting quotas for project c52caa270c8d4a0385ddcc13dae2fa90. Resources: {'key_pairs'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:37:10.878560 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-3b25fe11-11c4-434d-830d-02451b31ffb8 tempest-KeyPairsV22TestJSON-1186237770 tempest-KeyPairsV22TestJSON-1186237770-project] Getting quotas for user 6d8f1c7482ad4bf0896165c50f70ad95 and project c52caa270c8d4a0385ddcc13dae2fa90. Resources: {'key_pairs'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:37:10.970495 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3b25fe11-11c4-434d-830d-02451b31ffb8 tempest-KeyPairsV22TestJSON-1186237770 tempest-KeyPairsV22TestJSON-1186237770-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.129648 Oct 27 03:37:10.971236 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2072/3903] 10.222.0.20 () {62 vars in 1199 bytes} [Thu Oct 27 03:37:10 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 131 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 27 03:37:10.984324 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-fedf0eb9-9253-452d-8df5-795a3322fef0 tempest-KeyPairsV22TestJSON-1186237770 tempest-KeyPairsV22TestJSON-1186237770-project] Calling method '.version_select at 0x7f7ddee00a60>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:10.988469 n-d-862769-1 devstack@n-api.service[121000]: WARNING oslo_db.sqlalchemy.utils [None req-fedf0eb9-9253-452d-8df5-795a3322fef0 tempest-KeyPairsV22TestJSON-1186237770 tempest-KeyPairsV22TestJSON-1186237770-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 27 03:37:10.993863 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-fedf0eb9-9253-452d-8df5-795a3322fef0 tempest-KeyPairsV22TestJSON-1186237770 tempest-KeyPairsV22TestJSON-1186237770-project] 10.222.0.20 "GET /compute/v2.1/os-keypairs" status: 200 len: 1140 microversion: 2.2 time: 0.013976 Oct 27 03:37:10.994463 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1832/3904] 10.222.0.20 () {60 vars in 1177 bytes} [Thu Oct 27 03:37:10 2022] GET /compute/v2.1/os-keypairs => generated 1140 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:37:11.005853 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b2b1ca7f-fbc9-43ae-8c3c-fdddeb09c899 tempest-KeyPairsV22TestJSON-1186237770 tempest-KeyPairsV22TestJSON-1186237770-project] Calling method '.version_select at 0x7f7dd9d83670>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:11.131283 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4d7f4a6b-18d7-4714-820f-dd6f91fbb7fd tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:11.131907 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4d7f4a6b-18d7-4714-820f-dd6f91fbb7fd tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] [instance: 4183c266-b474-4c04-8e81-54a6a86e221b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:11.140413 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4d7f4a6b-18d7-4714-820f-dd6f91fbb7fd tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:11.140915 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4d7f4a6b-18d7-4714-820f-dd6f91fbb7fd tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:11.144642 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4d7f4a6b-18d7-4714-820f-dd6f91fbb7fd tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:11.144642 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4d7f4a6b-18d7-4714-820f-dd6f91fbb7fd tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:11.144642 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4d7f4a6b-18d7-4714-820f-dd6f91fbb7fd tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:11.144642 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4d7f4a6b-18d7-4714-820f-dd6f91fbb7fd tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:11.166480 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b2b1ca7f-fbc9-43ae-8c3c-fdddeb09c899 tempest-KeyPairsV22TestJSON-1186237770 tempest-KeyPairsV22TestJSON-1186237770-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-419431981" status: 204 len: 0 microversion: 2.2 time: 0.164523 Oct 27 03:37:11.167165 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2073/3905] 10.222.0.20 () {60 vars in 1318 bytes} [Thu Oct 27 03:37:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-419431981 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 03:37:11.176540 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e9339a8c-996f-4fbf-bc97-514860e18977 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:11.177481 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e9339a8c-996f-4fbf-bc97-514860e18977 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:11.192868 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e9339a8c-996f-4fbf-bc97-514860e18977 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:11.193867 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e9339a8c-996f-4fbf-bc97-514860e18977 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:11.195405 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e9339a8c-996f-4fbf-bc97-514860e18977 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:11.195932 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e9339a8c-996f-4fbf-bc97-514860e18977 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:11.196483 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e9339a8c-996f-4fbf-bc97-514860e18977 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:11.197007 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e9339a8c-996f-4fbf-bc97-514860e18977 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:11.347564 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4d7f4a6b-18d7-4714-820f-dd6f91fbb7fd tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c36bef85ac34b4983a79e03c56965c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e58f30136ed4a4d9bff48e9b4cde5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:11.362448 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4d7f4a6b-18d7-4714-820f-dd6f91fbb7fd tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] 10.222.0.20 "GET /compute/v2.1/servers/4183c266-b474-4c04-8e81-54a6a86e221b" status: 200 len: 1520 microversion: 2.1 time: 0.228144 Oct 27 03:37:11.362448 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1833/3906] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:11 2022] GET /compute/v2.1/servers/4183c266-b474-4c04-8e81-54a6a86e221b => generated 1520 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:37:11.362690 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e9339a8c-996f-4fbf-bc97-514860e18977 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:11.362798 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-cd9a7fbb-c7be-4e95-b515-84b2b2637caf tempest-KeyPairsV22TestJSON-1186237770 tempest-KeyPairsV22TestJSON-1186237770-project] Calling method '.version_select at 0x7f7dda130f70>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:11.368784 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e9339a8c-996f-4fbf-bc97-514860e18977 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1509 microversion: 2.1 time: 0.196486 Oct 27 03:37:11.369362 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2074/3907] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:11 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1509 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:37:11.383355 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-59ef8ed5-ebb5-4a33-a82d-8e91d7f31169 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:11.383910 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-59ef8ed5-ebb5-4a33-a82d-8e91d7f31169 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] [instance: 4183c266-b474-4c04-8e81-54a6a86e221b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:11.390411 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-59ef8ed5-ebb5-4a33-a82d-8e91d7f31169 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:11.390902 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-59ef8ed5-ebb5-4a33-a82d-8e91d7f31169 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:11.391347 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-59ef8ed5-ebb5-4a33-a82d-8e91d7f31169 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:11.392046 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-59ef8ed5-ebb5-4a33-a82d-8e91d7f31169 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:11.392504 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-59ef8ed5-ebb5-4a33-a82d-8e91d7f31169 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:11.392936 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-59ef8ed5-ebb5-4a33-a82d-8e91d7f31169 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:11.419024 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-59ef8ed5-ebb5-4a33-a82d-8e91d7f31169 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] [instance: 4183c266-b474-4c04-8e81-54a6a86e221b] Going to try to terminate instance {{(pid=121001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:37:11.569364 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-cd9a7fbb-c7be-4e95-b515-84b2b2637caf tempest-KeyPairsV22TestJSON-1186237770 tempest-KeyPairsV22TestJSON-1186237770-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1766665191" status: 204 len: 0 microversion: 2.2 time: 0.212052 Oct 27 03:37:11.570004 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1834/3908] 10.222.0.20 () {60 vars in 1321 bytes} [Thu Oct 27 03:37:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1766665191 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:37:11.578851 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5a9ef741-4930-4ce8-839c-54f97b13a998 tempest-KeyPairsV22TestJSON-1186237770 tempest-KeyPairsV22TestJSON-1186237770-project] Calling method '.version_select at 0x7f7dda1b6790>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:11.667436 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5a9ef741-4930-4ce8-839c-54f97b13a998 tempest-KeyPairsV22TestJSON-1186237770 tempest-KeyPairsV22TestJSON-1186237770-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-360647973" status: 204 len: 0 microversion: 2.2 time: 0.093129 Oct 27 03:37:11.668027 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1835/3909] 10.222.0.20 () {60 vars in 1318 bytes} [Thu Oct 27 03:37:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-360647973 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 03:37:11.679572 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6a1d5a00-fab5-4941-ab8b-01ca38513cd1 tempest-KeyPairsV22TestJSON-1186237770 tempest-KeyPairsV22TestJSON-1186237770-project] Action: 'create', calling method: .version_select at 0x7f7dd9d593a0>, body: {"keypair": {"name": "tempest-keypair-2027453311", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKnPc4VOF9rznQCzsToT1604+/wMFMLJpKtU6BTGv0IEXIYAoJatWJbUNehtbjB3iAs8URzm+5fvYQuiT1+vVbV+IgNDBoqwVFHi8Kbzc8fjfyQ6PAnp+A5vsUg/MOV8RA=="}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:37:11.696168 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-6a1d5a00-fab5-4941-ab8b-01ca38513cd1 tempest-KeyPairsV22TestJSON-1186237770 tempest-KeyPairsV22TestJSON-1186237770-project] Getting quotas for project c52caa270c8d4a0385ddcc13dae2fa90. Resources: {'key_pairs'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:37:11.701923 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-6a1d5a00-fab5-4941-ab8b-01ca38513cd1 tempest-KeyPairsV22TestJSON-1186237770 tempest-KeyPairsV22TestJSON-1186237770-project] Getting quotas for user 6d8f1c7482ad4bf0896165c50f70ad95 and project c52caa270c8d4a0385ddcc13dae2fa90. Resources: {'key_pairs'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:37:11.826339 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-59ef8ed5-ebb5-4a33-a82d-8e91d7f31169 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4183c266-b474-4c04-8e81-54a6a86e221b" status: 204 len: 0 microversion: 2.1 time: 0.447437 Oct 27 03:37:11.826939 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2075/3910] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:37:11 2022] DELETE /compute/v2.1/servers/4183c266-b474-4c04-8e81-54a6a86e221b => generated 0 bytes in 449 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 03:37:11.827915 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6a1d5a00-fab5-4941-ab8b-01ca38513cd1 tempest-KeyPairsV22TestJSON-1186237770 tempest-KeyPairsV22TestJSON-1186237770-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.152035 Oct 27 03:37:11.828801 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1836/3911] 10.222.0.20 () {62 vars in 1199 bytes} [Thu Oct 27 03:37:11 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 154 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Oct 27 03:37:11.836228 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1a773496-5a9a-406b-a51e-1b6cffab7059 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:11.838288 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1a773496-5a9a-406b-a51e-1b6cffab7059 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] [instance: 4183c266-b474-4c04-8e81-54a6a86e221b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:11.843342 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1a773496-5a9a-406b-a51e-1b6cffab7059 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:11.843837 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1a773496-5a9a-406b-a51e-1b6cffab7059 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:11.844286 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1a773496-5a9a-406b-a51e-1b6cffab7059 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:11.844993 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1a773496-5a9a-406b-a51e-1b6cffab7059 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:11.845456 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1a773496-5a9a-406b-a51e-1b6cffab7059 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:11.845890 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1a773496-5a9a-406b-a51e-1b6cffab7059 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:11.847497 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-84b5e0f0-2d8a-42f6-a943-2af5e0b966fb tempest-KeyPairsV22TestJSON-1186237770 tempest-KeyPairsV22TestJSON-1186237770-project] Calling method '.version_select at 0x7f7dd9d595e0>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:11.859968 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-84b5e0f0-2d8a-42f6-a943-2af5e0b966fb tempest-KeyPairsV22TestJSON-1186237770 tempest-KeyPairsV22TestJSON-1186237770-project] 10.222.0.20 "GET /compute/v2.1/os-keypairs/tempest-keypair-2027453311" status: 200 len: 513 microversion: 2.2 time: 0.016100 Oct 27 03:37:11.860919 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1837/3912] 10.222.0.20 () {60 vars in 1258 bytes} [Thu Oct 27 03:37:11 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-2027453311 => generated 513 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:37:11.879183 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-75b7da1d-33ca-4575-8cc4-7768aca0e2d5 tempest-KeyPairsV22TestJSON-1186237770 tempest-KeyPairsV22TestJSON-1186237770-project] Calling method '.version_select at 0x7f7dd9d11f70>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:11.883892 n-d-862769-1 devstack@n-api.service[121000]: WARNING oslo_db.sqlalchemy.utils [None req-75b7da1d-33ca-4575-8cc4-7768aca0e2d5 tempest-KeyPairsV22TestJSON-1186237770 tempest-KeyPairsV22TestJSON-1186237770-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 27 03:37:11.890970 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-75b7da1d-33ca-4575-8cc4-7768aca0e2d5 tempest-KeyPairsV22TestJSON-1186237770 tempest-KeyPairsV22TestJSON-1186237770-project] 10.222.0.20 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.015914 Oct 27 03:37:11.898268 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1838/3913] 10.222.0.20 () {60 vars in 1177 bytes} [Thu Oct 27 03:37:11 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:37:11.903594 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9ddf1a0b-00cc-4032-bcf8-71bd1ecba160 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:11.904850 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9ddf1a0b-00cc-4032-bcf8-71bd1ecba160 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: 2d8900c4-92eb-4374-bd63-6d0ebbf407b7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:11.912013 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9ddf1a0b-00cc-4032-bcf8-71bd1ecba160 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:11.912508 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9ddf1a0b-00cc-4032-bcf8-71bd1ecba160 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:11.913139 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9ddf1a0b-00cc-4032-bcf8-71bd1ecba160 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:11.913685 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9ddf1a0b-00cc-4032-bcf8-71bd1ecba160 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:11.914170 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9ddf1a0b-00cc-4032-bcf8-71bd1ecba160 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:11.914601 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9ddf1a0b-00cc-4032-bcf8-71bd1ecba160 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:11.995563 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1a773496-5a9a-406b-a51e-1b6cffab7059 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c36bef85ac34b4983a79e03c56965c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e58f30136ed4a4d9bff48e9b4cde5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:12.004305 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1a773496-5a9a-406b-a51e-1b6cffab7059 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] 10.222.0.20 "GET /compute/v2.1/servers/4183c266-b474-4c04-8e81-54a6a86e221b" status: 200 len: 1526 microversion: 2.1 time: 0.172374 Oct 27 03:37:12.004889 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2076/3914] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:11 2022] GET /compute/v2.1/servers/4183c266-b474-4c04-8e81-54a6a86e221b => generated 1526 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:37:12.009974 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a15c9bdc-675b-4082-bae9-3bc95b965440 tempest-KeyPairsV22TestJSON-1186237770 tempest-KeyPairsV22TestJSON-1186237770-project] Calling method '.version_select at 0x7f7dd9f6c550>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:12.094634 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a15c9bdc-675b-4082-bae9-3bc95b965440 tempest-KeyPairsV22TestJSON-1186237770 tempest-KeyPairsV22TestJSON-1186237770-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2027453311" status: 204 len: 0 microversion: 2.2 time: 0.088626 Oct 27 03:37:12.100663 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2077/3915] 10.222.0.20 () {60 vars in 1261 bytes} [Thu Oct 27 03:37:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2027453311 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:37:12.104889 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-31175da6-86b0-426e-af2d-3e762d6db540 tempest-KeyPairsV22TestJSON-1186237770 tempest-KeyPairsV22TestJSON-1186237770-project] Action: 'create', calling method: .version_select at 0x7f7dd9ce2790>, body: {"keypair": {"name": "tempest-keypair-1644786040", "type": "x509"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:37:12.122644 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-31175da6-86b0-426e-af2d-3e762d6db540 tempest-KeyPairsV22TestJSON-1186237770 tempest-KeyPairsV22TestJSON-1186237770-project] Getting quotas for project c52caa270c8d4a0385ddcc13dae2fa90. Resources: {'key_pairs'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:37:12.124916 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:DELETE=3,nova_api:SELECT=91,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:37:12.129199 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-31175da6-86b0-426e-af2d-3e762d6db540 tempest-KeyPairsV22TestJSON-1186237770 tempest-KeyPairsV22TestJSON-1186237770-project] Getting quotas for user 6d8f1c7482ad4bf0896165c50f70ad95 and project c52caa270c8d4a0385ddcc13dae2fa90. Resources: {'key_pairs'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:37:12.146162 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9ddf1a0b-00cc-4032-bcf8-71bd1ecba160 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:12.147157 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.processutils [None req-31175da6-86b0-426e-af2d-3e762d6db540 tempest-KeyPairsV22TestJSON-1186237770 tempest-KeyPairsV22TestJSON-1186237770-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmp903wpbgw/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp903wpbgw/temp.key -subj /CN=6d8f1c7482ad4bf0896165c50f70ad95 -extensions v3_req_client {{(pid=121001) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 27 03:37:12.153628 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9ddf1a0b-00cc-4032-bcf8-71bd1ecba160 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/2d8900c4-92eb-4374-bd63-6d0ebbf407b7" status: 200 len: 1314 microversion: 2.1 time: 0.253967 Oct 27 03:37:12.154272 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1839/3916] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:11 2022] GET /compute/v2.1/servers/2d8900c4-92eb-4374-bd63-6d0ebbf407b7 => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:37:12.391696 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7314958a-9271-41e0-b95f-bdfa7b37c4b5 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:12.392742 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7314958a-9271-41e0-b95f-bdfa7b37c4b5 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:12.401082 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7314958a-9271-41e0-b95f-bdfa7b37c4b5 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:12.401704 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7314958a-9271-41e0-b95f-bdfa7b37c4b5 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:12.402537 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7314958a-9271-41e0-b95f-bdfa7b37c4b5 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:12.404105 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7314958a-9271-41e0-b95f-bdfa7b37c4b5 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:12.404768 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7314958a-9271-41e0-b95f-bdfa7b37c4b5 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:12.409201 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7314958a-9271-41e0-b95f-bdfa7b37c4b5 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:12.584317 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7314958a-9271-41e0-b95f-bdfa7b37c4b5 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:12.594420 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7314958a-9271-41e0-b95f-bdfa7b37c4b5 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1512 microversion: 2.1 time: 0.206752 Oct 27 03:37:12.595347 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1840/3917] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:12 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1512 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:37:12.613561 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-f6c616d8-b362-4bc3-b60f-6bbe7d40fe12 req-5aa6a8ba-1bc1-48ba-92c4-c4cdefdc8623 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "376ac459-e31f-4727-9e34-535f055ac20d", "name": "network-vif-unplugged", "status": "completed", "tag": "e825dd69-54a1-4411-addc-e78fd04434d2"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:37:12.623191 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-f6c616d8-b362-4bc3-b60f-6bbe7d40fe12 req-5aa6a8ba-1bc1-48ba-92c4-c4cdefdc8623 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:12.623667 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-f6c616d8-b362-4bc3-b60f-6bbe7d40fe12 req-5aa6a8ba-1bc1-48ba-92c4-c4cdefdc8623 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:12.624105 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-f6c616d8-b362-4bc3-b60f-6bbe7d40fe12 req-5aa6a8ba-1bc1-48ba-92c4-c4cdefdc8623 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:12.635070 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-f6c616d8-b362-4bc3-b60f-6bbe7d40fe12 req-5aa6a8ba-1bc1-48ba-92c4-c4cdefdc8623 service nova] Creating event network-vif-unplugged:e825dd69-54a1-4411-addc-e78fd04434d2 for instance 376ac459-e31f-4727-9e34-535f055ac20d on n-h2-862769-1 Oct 27 03:37:12.640427 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-f6c616d8-b362-4bc3-b60f-6bbe7d40fe12 req-5aa6a8ba-1bc1-48ba-92c4-c4cdefdc8623 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030474 Oct 27 03:37:12.641369 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1841/3918] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:37:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:37:12.646582 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4362d95f-d6be-457b-a788-01d5bb8bf3f4 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:12.647293 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4362d95f-d6be-457b-a788-01d5bb8bf3f4 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:12.649148 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.processutils [None req-31175da6-86b0-426e-af2d-3e762d6db540 tempest-KeyPairsV22TestJSON-1186237770 tempest-KeyPairsV22TestJSON-1186237770-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmp903wpbgw/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp903wpbgw/temp.key -subj /CN=6d8f1c7482ad4bf0896165c50f70ad95 -extensions v3_req_client" returned: 0 in 0.501s {{(pid=121001) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 27 03:37:12.651391 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.processutils [None req-31175da6-86b0-426e-af2d-3e762d6db540 tempest-KeyPairsV22TestJSON-1186237770 tempest-KeyPairsV22TestJSON-1186237770-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmp903wpbgw/temp.key -password pass: {{(pid=121001) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 27 03:37:12.653956 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4362d95f-d6be-457b-a788-01d5bb8bf3f4 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:12.656441 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4362d95f-d6be-457b-a788-01d5bb8bf3f4 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:12.656441 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4362d95f-d6be-457b-a788-01d5bb8bf3f4 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:12.656441 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4362d95f-d6be-457b-a788-01d5bb8bf3f4 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:12.656441 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4362d95f-d6be-457b-a788-01d5bb8bf3f4 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:12.656840 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4362d95f-d6be-457b-a788-01d5bb8bf3f4 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:12.681420 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.processutils [None req-31175da6-86b0-426e-af2d-3e762d6db540 tempest-KeyPairsV22TestJSON-1186237770 tempest-KeyPairsV22TestJSON-1186237770-project] CMD "openssl pkcs12 -export -inkey /tmp/tmp903wpbgw/temp.key -password pass:" returned: 0 in 0.029s {{(pid=121001) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 27 03:37:12.795298 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4362d95f-d6be-457b-a788-01d5bb8bf3f4 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:12.812210 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4362d95f-d6be-457b-a788-01d5bb8bf3f4 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1512 microversion: 2.1 time: 0.169617 Oct 27 03:37:12.813183 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1842/3919] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:12 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1512 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:37:12.861659 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-31175da6-86b0-426e-af2d-3e762d6db540 tempest-KeyPairsV22TestJSON-1186237770 tempest-KeyPairsV22TestJSON-1186237770-project] Getting quotas for project c52caa270c8d4a0385ddcc13dae2fa90. Resources: {'key_pairs'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:37:12.867486 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-31175da6-86b0-426e-af2d-3e762d6db540 tempest-KeyPairsV22TestJSON-1186237770 tempest-KeyPairsV22TestJSON-1186237770-project] Getting quotas for user 6d8f1c7482ad4bf0896165c50f70ad95 and project c52caa270c8d4a0385ddcc13dae2fa90. Resources: {'key_pairs'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:37:12.885357 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-31175da6-86b0-426e-af2d-3e762d6db540 tempest-KeyPairsV22TestJSON-1186237770 tempest-KeyPairsV22TestJSON-1186237770-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 0.784496 Oct 27 03:37:12.886523 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2078/3920] 10.222.0.20 () {62 vars in 1198 bytes} [Thu Oct 27 03:37:12 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 786 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:37:12.898333 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b6f2e976-2c4b-42f0-af50-854028e4d471 tempest-KeyPairsV22TestJSON-1186237770 tempest-KeyPairsV22TestJSON-1186237770-project] Calling method '.version_select at 0x7f7ddee439d0>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:12.908981 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b6f2e976-2c4b-42f0-af50-854028e4d471 tempest-KeyPairsV22TestJSON-1186237770 tempest-KeyPairsV22TestJSON-1186237770-project] 10.222.0.20 "GET /compute/v2.1/os-keypairs/tempest-keypair-1644786040" status: 200 len: 1534 microversion: 2.2 time: 0.014498 Oct 27 03:37:12.909561 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1843/3921] 10.222.0.20 () {60 vars in 1258 bytes} [Thu Oct 27 03:37:12 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1644786040 => generated 1534 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:37:12.912489 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a55d8c18-615f-43cf-a88f-f36b835b2872 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:37:12.913114 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a55d8c18-615f-43cf-a88f-f36b835b2872 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:12.920476 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a55d8c18-615f-43cf-a88f-f36b835b2872 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:12.921016 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a55d8c18-615f-43cf-a88f-f36b835b2872 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:12.921414 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8c7018e5-9259-4bb4-88d9-e663151bf4ad tempest-KeyPairsV22TestJSON-1186237770 tempest-KeyPairsV22TestJSON-1186237770-project] Calling method '.version_select at 0x7f7dd9d595e0>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:12.921545 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a55d8c18-615f-43cf-a88f-f36b835b2872 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:12.922307 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a55d8c18-615f-43cf-a88f-f36b835b2872 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:12.922811 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a55d8c18-615f-43cf-a88f-f36b835b2872 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:12.923253 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a55d8c18-615f-43cf-a88f-f36b835b2872 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:12.925185 n-d-862769-1 devstack@n-api.service[121000]: WARNING oslo_db.sqlalchemy.utils [None req-8c7018e5-9259-4bb4-88d9-e663151bf4ad tempest-KeyPairsV22TestJSON-1186237770 tempest-KeyPairsV22TestJSON-1186237770-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 27 03:37:12.930489 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8c7018e5-9259-4bb4-88d9-e663151bf4ad tempest-KeyPairsV22TestJSON-1186237770 tempest-KeyPairsV22TestJSON-1186237770-project] 10.222.0.20 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.012779 Oct 27 03:37:12.931049 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1844/3922] 10.222.0.20 () {60 vars in 1177 bytes} [Thu Oct 27 03:37:12 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:37:12.941560 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0dccf64f-bd89-452d-9ba1-bf552441d74e tempest-KeyPairsV22TestJSON-1186237770 tempest-KeyPairsV22TestJSON-1186237770-project] Calling method '.version_select at 0x7f7dd9dc78b0>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:12.951182 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-a55d8c18-615f-43cf-a88f-f36b835b2872 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lazy-loading 'flavor' on Instance uuid 376ac459-e31f-4727-9e34-535f055ac20d {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:37:12.968861 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-a55d8c18-615f-43cf-a88f-f36b835b2872 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] HTTP exception thrown: Cannot 'shelve' instance 376ac459-e31f-4727-9e34-535f055ac20d while it is in vm_state shelved_offloaded Oct 27 03:37:12.970588 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a55d8c18-615f-43cf-a88f-f36b835b2872 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Request method failure captured: Oct 27 03:37:12.970588 n-d-862769-1 devstack@n-api.service[121001]: request: POST /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d/action HTTP/1.1 Oct 27 03:37:12.970588 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:37:12.970588 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:37:12.970588 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:37:12.970588 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 14 Oct 27 03:37:12.970588 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:37:12.970588 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:37:12.970588 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:37:12.970588 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:37:12.970588 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfxF6ut9nM9a9AcpKLO7IgCu-akAJ2YJGjrI9C8NUveA8uObV2XgQIQvsIxuWjvLl9meIEqpfGwZYr8MTX_PAGoiJsNUPXh5ERSce5cPYQYCCFPL0HtTb-E11C_2kfWy1wRps1tClRNvtj8zAqCGRhs1x-Uvl0zISdfHepXmvWX31Us Oct 27 03:37:12.970588 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:37:12.970588 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:37:12.970588 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:37:12.970588 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:37:12.970588 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:37:12.970588 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:37:12.970588 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 8bb5d291069d4329a90123e327fe9c59 Oct 27 03:37:12.970588 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:37:12.970588 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:37:12.970588 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:37:12.970588 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8bb5d291069d4329a90123e327fe9c59"}]}] Oct 27 03:37:12.970588 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:37:12.970588 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 8bb5d291069d4329a90123e327fe9c59 Oct 27 03:37:12.970588 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:37:12.970588 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServersNegativeTestJSON-4378389-project Oct 27 03:37:12.970588 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:37:12.970588 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:37:12.970588 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: f9c32b7626594ff888970c7f3227bb20 Oct 27 03:37:12.970588 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServersNegativeTestJSON-4378389-project Oct 27 03:37:12.970588 n-d-862769-1 devstack@n-api.service[121001]: Oct 27 03:37:12.970588 n-d-862769-1 devstack@n-api.service[121001]: {"shelve": {}} Oct 27 03:37:12.970588 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:37:12.970588 n-d-862769-1 devstack@n-api.service[121001]: exception: Cannot 'shelve' instance 376ac459-e31f-4727-9e34-535f055ac20d while it is in vm_state shelved_offloaded Oct 27 03:37:12.970588 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '376ac459-e31f-4727-9e34-535f055ac20d', 'body': {'shelve': {}}} Oct 27 03:37:12.970588 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:37:12.970588 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:37:12.970588 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Oct 27 03:37:12.970588 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Oct 27 03:37:12.970588 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 27 03:37:12.970588 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 27 03:37:12.970588 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 27 03:37:12.970588 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 27 03:37:12.970588 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 27 03:37:12.970588 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 27 03:37:12.970588 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 03:37:12.970588 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 03:37:12.970588 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 27 03:37:12.970588 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 27 03:37:12.970588 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 376ac459-e31f-4727-9e34-535f055ac20d in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Oct 27 03:37:12.970588 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:37:12.970588 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:37:12.970588 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:37:12.970588 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:37:12.970588 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:37:12.970588 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:37:12.970588 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:37:12.970588 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:37:12.970588 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:37:12.970588 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:37:12.970588 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Oct 27 03:37:12.970588 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 27 03:37:12.970588 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 27 03:37:12.970588 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 27 03:37:12.980664 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 376ac459-e31f-4727-9e34-535f055ac20d while it is in vm_state shelved_offloaded Oct 27 03:37:12.980664 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:37:12.980664 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:37:12.980664 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:37:12.980664 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:37:12.980664 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:37:12.980664 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:37:12.980664 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:37:12.980664 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:37:12.980664 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 376ac459-e31f-4727-9e34-535f055ac20d while it is in vm_state shelved_offloaded Oct 27 03:37:12.980664 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:37:12.980664 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a55d8c18-615f-43cf-a88f-f36b835b2872 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Returning 409 to user: Cannot 'shelve' instance 376ac459-e31f-4727-9e34-535f055ac20d while it is in vm_state shelved_offloaded {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:37:12.980664 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a55d8c18-615f-43cf-a88f-f36b835b2872 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "POST /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d/action" status: 409 len: 155 microversion: 2.1 time: 0.065551 Oct 27 03:37:12.980664 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2079/3923] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:37:12 2022] POST /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d/action => generated 155 bytes in 67 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 27 03:37:12.987870 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-83e82070-2beb-4e68-977f-1534ad6bd865 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:37:12.988508 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-83e82070-2beb-4e68-977f-1534ad6bd865 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:12.995693 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-83e82070-2beb-4e68-977f-1534ad6bd865 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:12.996473 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-83e82070-2beb-4e68-977f-1534ad6bd865 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:12.996473 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-83e82070-2beb-4e68-977f-1534ad6bd865 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:12.997201 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-83e82070-2beb-4e68-977f-1534ad6bd865 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:12.997749 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-83e82070-2beb-4e68-977f-1534ad6bd865 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:12.998295 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-83e82070-2beb-4e68-977f-1534ad6bd865 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:13.014511 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0dccf64f-bd89-452d-9ba1-bf552441d74e tempest-KeyPairsV22TestJSON-1186237770 tempest-KeyPairsV22TestJSON-1186237770-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1644786040" status: 204 len: 0 microversion: 2.2 time: 0.076412 Oct 27 03:37:13.015635 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1845/3924] 10.222.0.20 () {60 vars in 1261 bytes} [Thu Oct 27 03:37:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1644786040 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 03:37:13.029197 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-22049d57-27f9-4188-bbef-ed3af7f848cf tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:13.029824 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-22049d57-27f9-4188-bbef-ed3af7f848cf tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] [instance: 4183c266-b474-4c04-8e81-54a6a86e221b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:13.036872 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-22049d57-27f9-4188-bbef-ed3af7f848cf tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:13.037617 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-22049d57-27f9-4188-bbef-ed3af7f848cf tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:13.042365 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-22049d57-27f9-4188-bbef-ed3af7f848cf tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:13.042365 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-22049d57-27f9-4188-bbef-ed3af7f848cf tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:13.042365 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-22049d57-27f9-4188-bbef-ed3af7f848cf tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:13.042365 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-22049d57-27f9-4188-bbef-ed3af7f848cf tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:13.045716 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=100 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:37:13.115153 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-83e82070-2beb-4e68-977f-1534ad6bd865 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121001) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 27 03:37:13.197169 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-22049d57-27f9-4188-bbef-ed3af7f848cf tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c36bef85ac34b4983a79e03c56965c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e58f30136ed4a4d9bff48e9b4cde5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:13.205564 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-22049d57-27f9-4188-bbef-ed3af7f848cf tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] 10.222.0.20 "GET /compute/v2.1/servers/4183c266-b474-4c04-8e81-54a6a86e221b" status: 200 len: 1526 microversion: 2.1 time: 0.180790 Oct 27 03:37:13.206155 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1846/3925] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:13 2022] GET /compute/v2.1/servers/4183c266-b474-4c04-8e81-54a6a86e221b => generated 1526 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:37:13.210787 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b7b89732-0b81-4ea6-9484-9bb050d79aa6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:13.211393 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b7b89732-0b81-4ea6-9484-9bb050d79aa6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: 2d8900c4-92eb-4374-bd63-6d0ebbf407b7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:13.217161 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b7b89732-0b81-4ea6-9484-9bb050d79aa6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:13.217855 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b7b89732-0b81-4ea6-9484-9bb050d79aa6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:13.218331 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b7b89732-0b81-4ea6-9484-9bb050d79aa6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:13.219046 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b7b89732-0b81-4ea6-9484-9bb050d79aa6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:13.219673 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b7b89732-0b81-4ea6-9484-9bb050d79aa6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:13.220269 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b7b89732-0b81-4ea6-9484-9bb050d79aa6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:13.367724 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b7b89732-0b81-4ea6-9484-9bb050d79aa6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:13.372707 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b7b89732-0b81-4ea6-9484-9bb050d79aa6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/2d8900c4-92eb-4374-bd63-6d0ebbf407b7" status: 200 len: 1314 microversion: 2.1 time: 0.165508 Oct 27 03:37:13.373291 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1847/3926] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:13 2022] GET /compute/v2.1/servers/2d8900c4-92eb-4374-bd63-6d0ebbf407b7 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:37:13.480075 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-83e82070-2beb-4e68-977f-1534ad6bd865 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "POST /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d/action" status: 202 len: 0 microversion: 2.1 time: 0.497200 Oct 27 03:37:13.480716 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2080/3927] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:37:12 2022] POST /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d/action => generated 0 bytes in 499 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 03:37:13.491452 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5d4f4a26-2b4a-40c5-8b12-a1e0c9a99a01 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:13.492216 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5d4f4a26-2b4a-40c5-8b12-a1e0c9a99a01 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:13.504118 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5d4f4a26-2b4a-40c5-8b12-a1e0c9a99a01 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:13.506574 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5d4f4a26-2b4a-40c5-8b12-a1e0c9a99a01 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:13.507262 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5d4f4a26-2b4a-40c5-8b12-a1e0c9a99a01 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:13.508081 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5d4f4a26-2b4a-40c5-8b12-a1e0c9a99a01 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:13.511029 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5d4f4a26-2b4a-40c5-8b12-a1e0c9a99a01 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:13.511573 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5d4f4a26-2b4a-40c5-8b12-a1e0c9a99a01 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:13.675198 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5d4f4a26-2b4a-40c5-8b12-a1e0c9a99a01 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:13.686537 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5d4f4a26-2b4a-40c5-8b12-a1e0c9a99a01 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1460 microversion: 2.1 time: 0.199535 Oct 27 03:37:13.687558 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1848/3928] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:13 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1460 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:37:14.166681 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-44f89f5f-22e1-41c1-8e2c-719673f1aaa2 req-b7a7260b-cf62-460e-9d26-07f9a00c425e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4183c266-b474-4c04-8e81-54a6a86e221b", "name": "network-vif-deleted", "tag": "357d8a7a-810d-49af-aada-7fc361e514da"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:37:14.190229 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-44f89f5f-22e1-41c1-8e2c-719673f1aaa2 req-b7a7260b-cf62-460e-9d26-07f9a00c425e service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:14.193006 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-44f89f5f-22e1-41c1-8e2c-719673f1aaa2 req-b7a7260b-cf62-460e-9d26-07f9a00c425e service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:14.193709 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-44f89f5f-22e1-41c1-8e2c-719673f1aaa2 req-b7a7260b-cf62-460e-9d26-07f9a00c425e service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:14.224520 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-44f89f5f-22e1-41c1-8e2c-719673f1aaa2 req-b7a7260b-cf62-460e-9d26-07f9a00c425e service nova] Creating event network-vif-deleted:357d8a7a-810d-49af-aada-7fc361e514da for instance 4183c266-b474-4c04-8e81-54a6a86e221b on n-h1-862769-1 Oct 27 03:37:14.229458 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3625f044-1082-480b-8edd-1b15aea57c13 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:14.235180 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-3625f044-1082-480b-8edd-1b15aea57c13 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] [instance: 4183c266-b474-4c04-8e81-54a6a86e221b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:14.247718 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-44f89f5f-22e1-41c1-8e2c-719673f1aaa2 req-b7a7260b-cf62-460e-9d26-07f9a00c425e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085424 Oct 27 03:37:14.248970 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2081/3929] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:37:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:37:14.250586 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3625f044-1082-480b-8edd-1b15aea57c13 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:14.251153 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3625f044-1082-480b-8edd-1b15aea57c13 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:14.263451 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3625f044-1082-480b-8edd-1b15aea57c13 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:14.273703 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3625f044-1082-480b-8edd-1b15aea57c13 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:14.277518 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3625f044-1082-480b-8edd-1b15aea57c13 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:14.278604 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3625f044-1082-480b-8edd-1b15aea57c13 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:14.398516 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e549eb58-9de5-4434-99c4-7f8cc0eeaabc tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:14.401513 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e549eb58-9de5-4434-99c4-7f8cc0eeaabc tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: 2d8900c4-92eb-4374-bd63-6d0ebbf407b7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:14.419667 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e549eb58-9de5-4434-99c4-7f8cc0eeaabc tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:14.420183 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e549eb58-9de5-4434-99c4-7f8cc0eeaabc tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:14.420640 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e549eb58-9de5-4434-99c4-7f8cc0eeaabc tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:14.426833 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e549eb58-9de5-4434-99c4-7f8cc0eeaabc tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:14.427707 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e549eb58-9de5-4434-99c4-7f8cc0eeaabc tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:14.428336 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e549eb58-9de5-4434-99c4-7f8cc0eeaabc tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:14.438584 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-3625f044-1082-480b-8edd-1b15aea57c13 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c36bef85ac34b4983a79e03c56965c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e58f30136ed4a4d9bff48e9b4cde5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:14.456945 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3625f044-1082-480b-8edd-1b15aea57c13 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] 10.222.0.20 "GET /compute/v2.1/servers/4183c266-b474-4c04-8e81-54a6a86e221b" status: 200 len: 1484 microversion: 2.1 time: 0.231294 Oct 27 03:37:14.458087 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1849/3930] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:14 2022] GET /compute/v2.1/servers/4183c266-b474-4c04-8e81-54a6a86e221b => generated 1484 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:37:14.715187 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f64ecb3b-fc56-44cb-b0ac-c41e1ecc9126 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:14.715868 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f64ecb3b-fc56-44cb-b0ac-c41e1ecc9126 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:14.723974 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f64ecb3b-fc56-44cb-b0ac-c41e1ecc9126 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:14.728962 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f64ecb3b-fc56-44cb-b0ac-c41e1ecc9126 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:14.729499 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f64ecb3b-fc56-44cb-b0ac-c41e1ecc9126 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:14.730312 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f64ecb3b-fc56-44cb-b0ac-c41e1ecc9126 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:14.737025 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f64ecb3b-fc56-44cb-b0ac-c41e1ecc9126 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:14.738986 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f64ecb3b-fc56-44cb-b0ac-c41e1ecc9126 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:14.975222 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f64ecb3b-fc56-44cb-b0ac-c41e1ecc9126 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:14.993396 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f64ecb3b-fc56-44cb-b0ac-c41e1ecc9126 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1460 microversion: 2.1 time: 0.283767 Oct 27 03:37:14.998807 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1850/3931] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:14 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1460 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:37:15.117999 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4436b3ce-d06b-4d67-ad75-3613763c3a3d tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Action: 'create', calling method: .version_select at 0x7f7ddaa61a60>, body: {"keypair": {"name": "tempest-keypair-1572205689", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOe3HYE7EJjIwOFjx4taPq4g4ig8jQOBHb4nu0ZtLGhoN0ZBe9wekvK8t+Lj82/8Mi7/Ya8Wn+hO0oNEkloO7BJ6haji3oeXhP4IKsPWzQ9wKZcs2R/RER0HEKyJp+dTIA=="}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:37:15.139063 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-4436b3ce-d06b-4d67-ad75-3613763c3a3d tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Getting quotas for project 229dcb63bc41444391544883b576ce2e. Resources: {'key_pairs'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:37:15.150844 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-4436b3ce-d06b-4d67-ad75-3613763c3a3d tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Getting quotas for user 18036411a99e4634bfbaeae24b9f254d and project 229dcb63bc41444391544883b576ce2e. Resources: {'key_pairs'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:37:15.243668 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4436b3ce-d06b-4d67-ad75-3613763c3a3d tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.130434 Oct 27 03:37:15.244316 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1851/3932] 10.222.0.20 () {60 vars in 1159 bytes} [Thu Oct 27 03:37:15 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:37:15.482747 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-dd07ed88-cf63-4f96-83af-d095d372284f tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:15.483731 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-dd07ed88-cf63-4f96-83af-d095d372284f tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] [instance: 4183c266-b474-4c04-8e81-54a6a86e221b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:15.500326 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dd07ed88-cf63-4f96-83af-d095d372284f tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:15.503816 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dd07ed88-cf63-4f96-83af-d095d372284f tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:15.506709 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dd07ed88-cf63-4f96-83af-d095d372284f tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:15.522421 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dd07ed88-cf63-4f96-83af-d095d372284f tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:15.547922 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dd07ed88-cf63-4f96-83af-d095d372284f tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:15.550113 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dd07ed88-cf63-4f96-83af-d095d372284f tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:15.662630 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3,nova_api:DELETE=6 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:37:15.677072 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dd07ed88-cf63-4f96-83af-d095d372284f tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:15.677934 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dd07ed88-cf63-4f96-83af-d095d372284f tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:15.678609 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dd07ed88-cf63-4f96-83af-d095d372284f tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:15.679261 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-dd07ed88-cf63-4f96-83af-d095d372284f tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lazy-loading 'fault' on Instance uuid 4183c266-b474-4c04-8e81-54a6a86e221b {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:37:15.741111 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e549eb58-9de5-4434-99c4-7f8cc0eeaabc tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:15.758857 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e549eb58-9de5-4434-99c4-7f8cc0eeaabc tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/2d8900c4-92eb-4374-bd63-6d0ebbf407b7" status: 200 len: 1314 microversion: 2.1 time: 1.365537 Oct 27 03:37:15.759467 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2082/3933] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:14 2022] GET /compute/v2.1/servers/2d8900c4-92eb-4374-bd63-6d0ebbf407b7 => generated 1314 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:37:15.957588 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-dd07ed88-cf63-4f96-83af-d095d372284f tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c36bef85ac34b4983a79e03c56965c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e58f30136ed4a4d9bff48e9b4cde5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:15.969838 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-dd07ed88-cf63-4f96-83af-d095d372284f tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] 10.222.0.20 "GET /compute/v2.1/servers/4183c266-b474-4c04-8e81-54a6a86e221b" status: 200 len: 1314 microversion: 2.1 time: 0.492209 Oct 27 03:37:15.975309 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1852/3934] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:15 2022] GET /compute/v2.1/servers/4183c266-b474-4c04-8e81-54a6a86e221b => generated 1314 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:37:16.021593 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f5da9c26-41ce-4ae3-bb3f-d04bde08fef0 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:16.021593 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f5da9c26-41ce-4ae3-bb3f-d04bde08fef0 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:16.033032 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f5da9c26-41ce-4ae3-bb3f-d04bde08fef0 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:16.033573 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f5da9c26-41ce-4ae3-bb3f-d04bde08fef0 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:16.040395 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f5da9c26-41ce-4ae3-bb3f-d04bde08fef0 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:16.041516 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f5da9c26-41ce-4ae3-bb3f-d04bde08fef0 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:16.042333 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f5da9c26-41ce-4ae3-bb3f-d04bde08fef0 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:16.043988 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f5da9c26-41ce-4ae3-bb3f-d04bde08fef0 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:16.304440 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f5da9c26-41ce-4ae3-bb3f-d04bde08fef0 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:16.315902 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f5da9c26-41ce-4ae3-bb3f-d04bde08fef0 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1460 microversion: 2.1 time: 0.301469 Oct 27 03:37:16.316514 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2083/3935] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:16 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1460 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:37:16.786565 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-be38a68e-2a84-47e6-a4d8-42ef79b73249 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:16.787191 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-be38a68e-2a84-47e6-a4d8-42ef79b73249 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: 2d8900c4-92eb-4374-bd63-6d0ebbf407b7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:16.801677 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-be38a68e-2a84-47e6-a4d8-42ef79b73249 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:16.802926 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-be38a68e-2a84-47e6-a4d8-42ef79b73249 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:16.804181 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-be38a68e-2a84-47e6-a4d8-42ef79b73249 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:16.805264 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-be38a68e-2a84-47e6-a4d8-42ef79b73249 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:16.808102 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-be38a68e-2a84-47e6-a4d8-42ef79b73249 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:16.810066 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-be38a68e-2a84-47e6-a4d8-42ef79b73249 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:16.997632 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2b1aff0b-88fc-4ccd-a9aa-f8a9b9ad0414 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:16.999593 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2b1aff0b-88fc-4ccd-a9aa-f8a9b9ad0414 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] [instance: 4183c266-b474-4c04-8e81-54a6a86e221b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:17.008604 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2b1aff0b-88fc-4ccd-a9aa-f8a9b9ad0414 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:17.009859 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2b1aff0b-88fc-4ccd-a9aa-f8a9b9ad0414 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:17.011351 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2b1aff0b-88fc-4ccd-a9aa-f8a9b9ad0414 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:17.012116 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2b1aff0b-88fc-4ccd-a9aa-f8a9b9ad0414 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:17.013412 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2b1aff0b-88fc-4ccd-a9aa-f8a9b9ad0414 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:17.014189 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2b1aff0b-88fc-4ccd-a9aa-f8a9b9ad0414 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:17.034840 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-2b1aff0b-88fc-4ccd-a9aa-f8a9b9ad0414 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] HTTP exception thrown: Instance 4183c266-b474-4c04-8e81-54a6a86e221b could not be found. Oct 27 03:37:17.038590 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2b1aff0b-88fc-4ccd-a9aa-f8a9b9ad0414 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Request method failure captured: Oct 27 03:37:17.038590 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/4183c266-b474-4c04-8e81-54a6a86e221b HTTP/1.1 Oct 27 03:37:17.038590 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:37:17.038590 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:37:17.038590 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:37:17.038590 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:37:17.038590 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:37:17.038590 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:37:17.038590 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:37:17.038590 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:37:17.038590 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfx5Hbc6ITbdSRFtS1-RYRPTs8xU2lFAIvTX0CRBjp8hijBP6KjJjfK-rUuEjncsIe7o_mkFNeieFkwqoNyxVxCVqSYWPgHA26VD6r86MpHHV_eFwebptw3rA_gpbw5SDVw15ZqeHqKSf2NQXZk1XM_suSoUNVero4I26u6VER7fLwA Oct 27 03:37:17.038590 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:37:17.038590 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:37:17.038590 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:37:17.038590 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:37:17.038590 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:37:17.038590 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:37:17.038590 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 2e58f30136ed4a4d9bff48e9b4cde5a8 Oct 27 03:37:17.038590 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-597177073 Oct 27 03:37:17.038590 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:37:17.038590 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:37:17.038590 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2e58f30136ed4a4d9bff48e9b4cde5a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2e58f30136ed4a4d9bff48e9b4cde5a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2e58f30136ed4a4d9bff48e9b4cde5a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2e58f30136ed4a4d9bff48e9b4cde5a8"}]}] Oct 27 03:37:17.038590 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-597177073 Oct 27 03:37:17.038590 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 2e58f30136ed4a4d9bff48e9b4cde5a8 Oct 27 03:37:17.038590 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-597177073 Oct 27 03:37:17.038590 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ImagesOneServerNegativeTestJSON-597177073-project Oct 27 03:37:17.038590 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:37:17.038590 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:37:17.038590 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 5c36bef85ac34b4983a79e03c56965c5 Oct 27 03:37:17.038590 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-597177073-project Oct 27 03:37:17.038590 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:37:17.038590 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 4183c266-b474-4c04-8e81-54a6a86e221b could not be found. Oct 27 03:37:17.038590 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '4183c266-b474-4c04-8e81-54a6a86e221b'} Oct 27 03:37:17.038590 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:37:17.038590 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:37:17.038590 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:37:17.038590 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:37:17.038590 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:37:17.038590 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:37:17.038590 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:37:17.038590 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:37:17.038590 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:37:17.038590 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:37:17.038590 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4183c266-b474-4c04-8e81-54a6a86e221b could not be found. Oct 27 03:37:17.038590 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:37:17.038590 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:37:17.038590 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:37:17.038590 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:37:17.038590 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:37:17.038590 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:37:17.038590 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:37:17.038590 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:37:17.038590 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:37:17.038590 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:37:17.038590 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:37:17.038590 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:37:17.038590 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:37:17.038590 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:37:17.038590 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:37:17.038590 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:37:17.038590 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4183c266-b474-4c04-8e81-54a6a86e221b could not be found. Oct 27 03:37:17.038590 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:37:17.038590 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:37:17.046505 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:37:17.046505 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:37:17.046505 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:37:17.046505 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:37:17.046505 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:37:17.046505 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:37:17.046505 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4183c266-b474-4c04-8e81-54a6a86e221b could not be found. Oct 27 03:37:17.046505 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:37:17.048394 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2b1aff0b-88fc-4ccd-a9aa-f8a9b9ad0414 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Returning 404 to user: Instance 4183c266-b474-4c04-8e81-54a6a86e221b could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:37:17.049535 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2b1aff0b-88fc-4ccd-a9aa-f8a9b9ad0414 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] 10.222.0.20 "GET /compute/v2.1/servers/4183c266-b474-4c04-8e81-54a6a86e221b" status: 404 len: 111 microversion: 2.1 time: 0.058342 Oct 27 03:37:17.051490 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2084/3936] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:16 2022] GET /compute/v2.1/servers/4183c266-b474-4c04-8e81-54a6a86e221b => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:37:17.060303 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-cc9b1a31-8be7-41da-b591-dfddd23116e0 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Calling method '.version_select at 0x7f7dda4b2ca0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:17.095530 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-be38a68e-2a84-47e6-a4d8-42ef79b73249 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:17.095686 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-cc9b1a31-8be7-41da-b591-dfddd23116e0 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] HTTP exception thrown: Image not found. Oct 27 03:37:17.095686 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-cc9b1a31-8be7-41da-b591-dfddd23116e0 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Request method failure captured: Oct 27 03:37:17.095686 n-d-862769-1 devstack@n-api.service[121001]: request: DELETE /compute/v2.1/images/fcedaa19-2a7b-40b5-bc2a-b874c4fb9bdb HTTP/1.1 Oct 27 03:37:17.095686 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:37:17.095686 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:37:17.095686 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:37:17.095686 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:37:17.095686 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:37:17.095686 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:37:17.095686 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:37:17.095686 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:37:17.095686 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfx5Hbc6ITbdSRFtS1-RYRPTs8xU2lFAIvTX0CRBjp8hijBP6KjJjfK-rUuEjncsIe7o_mkFNeieFkwqoNyxVxCVqSYWPgHA26VD6r86MpHHV_eFwebptw3rA_gpbw5SDVw15ZqeHqKSf2NQXZk1XM_suSoUNVero4I26u6VER7fLwA Oct 27 03:37:17.095686 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:37:17.095686 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:37:17.095686 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:37:17.095686 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:37:17.095686 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:37:17.095686 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:37:17.095686 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 2e58f30136ed4a4d9bff48e9b4cde5a8 Oct 27 03:37:17.095686 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-597177073 Oct 27 03:37:17.095686 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:37:17.095686 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:37:17.095686 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2e58f30136ed4a4d9bff48e9b4cde5a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2e58f30136ed4a4d9bff48e9b4cde5a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2e58f30136ed4a4d9bff48e9b4cde5a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2e58f30136ed4a4d9bff48e9b4cde5a8"}]}] Oct 27 03:37:17.095686 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-597177073 Oct 27 03:37:17.095686 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 2e58f30136ed4a4d9bff48e9b4cde5a8 Oct 27 03:37:17.095686 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-597177073 Oct 27 03:37:17.095686 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ImagesOneServerNegativeTestJSON-597177073-project Oct 27 03:37:17.095686 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:37:17.095686 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:37:17.095686 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 5c36bef85ac34b4983a79e03c56965c5 Oct 27 03:37:17.095686 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-597177073-project Oct 27 03:37:17.095686 n-d-862769-1 devstack@n-api.service[121001]: method: Oct 27 03:37:17.095686 n-d-862769-1 devstack@n-api.service[121001]: exception: Image not found. Oct 27 03:37:17.095686 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': 'fcedaa19-2a7b-40b5-bc2a-b874c4fb9bdb'} Oct 27 03:37:17.095686 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:37:17.095686 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:37:17.095686 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 27 03:37:17.095686 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 27 03:37:17.095686 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 03:37:17.095686 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 03:37:17.095686 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 03:37:17.095686 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 03:37:17.095686 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 27 03:37:17.095686 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 27 03:37:17.095686 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 27 03:37:17.095686 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 27 03:37:17.095686 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 03:37:17.095686 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 03:37:17.095686 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 03:37:17.095686 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 03:37:17.095686 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image fcedaa19-2a7b-40b5-bc2a-b874c4fb9bdb to delete Oct 27 03:37:17.095686 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:37:17.095686 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:37:17.095686 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:37:17.095686 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:37:17.095686 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 27 03:37:17.095686 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 27 03:37:17.095686 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 27 03:37:17.095686 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 27 03:37:17.095686 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 27 03:37:17.095686 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 27 03:37:17.101241 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image fcedaa19-2a7b-40b5-bc2a-b874c4fb9bdb could not be found. Oct 27 03:37:17.101241 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:37:17.101241 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:37:17.101241 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:37:17.101241 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:37:17.101241 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:37:17.101241 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:37:17.101241 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:37:17.101241 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:37:17.101241 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:37:17.101241 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:37:17.101241 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:37:17.101241 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:37:17.101241 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 27 03:37:17.101241 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 27 03:37:17.101241 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 27 03:37:17.101241 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:37:17.101241 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:37:17.101241 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:37:17.101241 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:37:17.101241 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:37:17.101241 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:37:17.101241 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:37:17.101241 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:37:17.101241 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 27 03:37:17.101241 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:37:17.103567 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-be38a68e-2a84-47e6-a4d8-42ef79b73249 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/2d8900c4-92eb-4374-bd63-6d0ebbf407b7" status: 200 len: 1314 microversion: 2.1 time: 0.317582 Oct 27 03:37:17.103567 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1853/3937] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:16 2022] GET /compute/v2.1/servers/2d8900c4-92eb-4374-bd63-6d0ebbf407b7 => generated 1314 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:37:17.106080 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-cc9b1a31-8be7-41da-b591-dfddd23116e0 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Returning 404 to user: Image not found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:37:17.106080 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-cc9b1a31-8be7-41da-b591-dfddd23116e0 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] 10.222.0.20 "DELETE /compute/v2.1/images/fcedaa19-2a7b-40b5-bc2a-b874c4fb9bdb" status: 404 len: 62 microversion: 2.1 time: 0.050355 Oct 27 03:37:17.106520 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2085/3938] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:17 2022] DELETE /compute/v2.1/images/fcedaa19-2a7b-40b5-bc2a-b874c4fb9bdb => generated 62 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 03:37:17.135006 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6f8ff70b-0094-4254-ab28-789c48b851d0 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:17.135650 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6f8ff70b-0094-4254-ab28-789c48b851d0 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] [instance: 96c8ef8e-9790-4cd5-9a62-a6778b7bf02c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:17.145931 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6f8ff70b-0094-4254-ab28-789c48b851d0 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:17.145931 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6f8ff70b-0094-4254-ab28-789c48b851d0 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:17.145931 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6f8ff70b-0094-4254-ab28-789c48b851d0 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:17.147030 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6f8ff70b-0094-4254-ab28-789c48b851d0 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:17.147339 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6f8ff70b-0094-4254-ab28-789c48b851d0 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:17.147921 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6f8ff70b-0094-4254-ab28-789c48b851d0 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:17.164985 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-6f8ff70b-0094-4254-ab28-789c48b851d0 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] HTTP exception thrown: Instance 96c8ef8e-9790-4cd5-9a62-a6778b7bf02c could not be found. Oct 27 03:37:17.167304 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6f8ff70b-0094-4254-ab28-789c48b851d0 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Request method failure captured: Oct 27 03:37:17.167304 n-d-862769-1 devstack@n-api.service[121000]: request: DELETE /compute/v2.1/servers/96c8ef8e-9790-4cd5-9a62-a6778b7bf02c HTTP/1.1 Oct 27 03:37:17.167304 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:37:17.167304 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:37:17.167304 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:37:17.167304 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:37:17.167304 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:37:17.167304 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:37:17.167304 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:37:17.167304 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:37:17.167304 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfx5Hbc6ITbdSRFtS1-RYRPTs8xU2lFAIvTX0CRBjp8hijBP6KjJjfK-rUuEjncsIe7o_mkFNeieFkwqoNyxVxCVqSYWPgHA26VD6r86MpHHV_eFwebptw3rA_gpbw5SDVw15ZqeHqKSf2NQXZk1XM_suSoUNVero4I26u6VER7fLwA Oct 27 03:37:17.167304 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:37:17.167304 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:37:17.167304 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:37:17.167304 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:37:17.167304 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:37:17.167304 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:37:17.167304 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 2e58f30136ed4a4d9bff48e9b4cde5a8 Oct 27 03:37:17.167304 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-597177073 Oct 27 03:37:17.167304 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:37:17.167304 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:37:17.167304 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2e58f30136ed4a4d9bff48e9b4cde5a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2e58f30136ed4a4d9bff48e9b4cde5a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2e58f30136ed4a4d9bff48e9b4cde5a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2e58f30136ed4a4d9bff48e9b4cde5a8"}]}] Oct 27 03:37:17.167304 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-597177073 Oct 27 03:37:17.167304 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 2e58f30136ed4a4d9bff48e9b4cde5a8 Oct 27 03:37:17.167304 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-597177073 Oct 27 03:37:17.167304 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ImagesOneServerNegativeTestJSON-597177073-project Oct 27 03:37:17.167304 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:37:17.167304 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:37:17.167304 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 5c36bef85ac34b4983a79e03c56965c5 Oct 27 03:37:17.167304 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-597177073-project Oct 27 03:37:17.167304 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:37:17.167304 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 96c8ef8e-9790-4cd5-9a62-a6778b7bf02c could not be found. Oct 27 03:37:17.167304 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '96c8ef8e-9790-4cd5-9a62-a6778b7bf02c'} Oct 27 03:37:17.167304 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:37:17.167304 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:37:17.167304 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:37:17.167304 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:37:17.167304 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:37:17.167304 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:37:17.167304 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:37:17.167304 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:37:17.167304 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:37:17.167304 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:37:17.167304 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96c8ef8e-9790-4cd5-9a62-a6778b7bf02c could not be found. Oct 27 03:37:17.167304 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:37:17.167304 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:37:17.167304 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:37:17.167304 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:37:17.167304 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:37:17.167304 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:37:17.167304 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:37:17.167304 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:37:17.167304 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:37:17.167304 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:37:17.167304 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 03:37:17.167304 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 03:37:17.167304 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 03:37:17.167304 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 03:37:17.167304 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:37:17.167304 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:37:17.167304 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:37:17.167304 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:37:17.174572 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96c8ef8e-9790-4cd5-9a62-a6778b7bf02c could not be found. Oct 27 03:37:17.174572 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:37:17.174572 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:37:17.174572 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:37:17.174572 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:37:17.174572 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:37:17.174572 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:37:17.174572 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:37:17.174572 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:37:17.174572 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96c8ef8e-9790-4cd5-9a62-a6778b7bf02c could not be found. Oct 27 03:37:17.174572 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:37:17.174572 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6f8ff70b-0094-4254-ab28-789c48b851d0 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Returning 404 to user: Instance 96c8ef8e-9790-4cd5-9a62-a6778b7bf02c could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:37:17.174572 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6f8ff70b-0094-4254-ab28-789c48b851d0 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] 10.222.0.20 "DELETE /compute/v2.1/servers/96c8ef8e-9790-4cd5-9a62-a6778b7bf02c" status: 404 len: 111 microversion: 2.1 time: 0.058106 Oct 27 03:37:17.174572 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1854/3939] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:37:17 2022] DELETE /compute/v2.1/servers/96c8ef8e-9790-4cd5-9a62-a6778b7bf02c => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:37:17.181241 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f5fcc608-7327-4d31-a7df-094589d63ef7 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:17.181888 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f5fcc608-7327-4d31-a7df-094589d63ef7 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] [instance: 96c8ef8e-9790-4cd5-9a62-a6778b7bf02c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:17.206911 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f5fcc608-7327-4d31-a7df-094589d63ef7 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:17.207671 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f5fcc608-7327-4d31-a7df-094589d63ef7 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:17.209119 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f5fcc608-7327-4d31-a7df-094589d63ef7 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:17.210101 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f5fcc608-7327-4d31-a7df-094589d63ef7 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:17.210828 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f5fcc608-7327-4d31-a7df-094589d63ef7 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:17.211447 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f5fcc608-7327-4d31-a7df-094589d63ef7 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:17.234113 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-f5fcc608-7327-4d31-a7df-094589d63ef7 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] HTTP exception thrown: Instance 96c8ef8e-9790-4cd5-9a62-a6778b7bf02c could not be found. Oct 27 03:37:17.236305 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f5fcc608-7327-4d31-a7df-094589d63ef7 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Request method failure captured: Oct 27 03:37:17.236305 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/96c8ef8e-9790-4cd5-9a62-a6778b7bf02c HTTP/1.1 Oct 27 03:37:17.236305 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:37:17.236305 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:37:17.236305 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:37:17.236305 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:37:17.236305 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:37:17.236305 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:37:17.236305 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:37:17.236305 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:37:17.236305 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfx5Hbc6ITbdSRFtS1-RYRPTs8xU2lFAIvTX0CRBjp8hijBP6KjJjfK-rUuEjncsIe7o_mkFNeieFkwqoNyxVxCVqSYWPgHA26VD6r86MpHHV_eFwebptw3rA_gpbw5SDVw15ZqeHqKSf2NQXZk1XM_suSoUNVero4I26u6VER7fLwA Oct 27 03:37:17.236305 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:37:17.236305 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:37:17.236305 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:37:17.236305 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:37:17.236305 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:37:17.236305 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:37:17.236305 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 2e58f30136ed4a4d9bff48e9b4cde5a8 Oct 27 03:37:17.236305 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-597177073 Oct 27 03:37:17.236305 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:37:17.236305 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:37:17.236305 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2e58f30136ed4a4d9bff48e9b4cde5a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2e58f30136ed4a4d9bff48e9b4cde5a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2e58f30136ed4a4d9bff48e9b4cde5a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2e58f30136ed4a4d9bff48e9b4cde5a8"}]}] Oct 27 03:37:17.236305 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-597177073 Oct 27 03:37:17.236305 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 2e58f30136ed4a4d9bff48e9b4cde5a8 Oct 27 03:37:17.236305 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-597177073 Oct 27 03:37:17.236305 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ImagesOneServerNegativeTestJSON-597177073-project Oct 27 03:37:17.236305 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:37:17.236305 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:37:17.236305 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 5c36bef85ac34b4983a79e03c56965c5 Oct 27 03:37:17.236305 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-597177073-project Oct 27 03:37:17.236305 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:37:17.236305 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 96c8ef8e-9790-4cd5-9a62-a6778b7bf02c could not be found. Oct 27 03:37:17.236305 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '96c8ef8e-9790-4cd5-9a62-a6778b7bf02c'} Oct 27 03:37:17.236305 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:37:17.236305 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:37:17.236305 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:37:17.236305 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:37:17.236305 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:37:17.236305 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:37:17.236305 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:37:17.236305 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:37:17.236305 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:37:17.236305 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:37:17.236305 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96c8ef8e-9790-4cd5-9a62-a6778b7bf02c could not be found. Oct 27 03:37:17.236305 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:37:17.236305 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:37:17.236305 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:37:17.236305 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:37:17.236305 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:37:17.236305 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:37:17.236305 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:37:17.236305 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:37:17.236305 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:37:17.236305 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:37:17.236305 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:37:17.236305 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:37:17.236305 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:37:17.236305 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:37:17.236305 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:37:17.236305 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:37:17.236305 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96c8ef8e-9790-4cd5-9a62-a6778b7bf02c could not be found. Oct 27 03:37:17.236305 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:37:17.236305 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:37:17.241615 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:37:17.241615 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:37:17.241615 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:37:17.241615 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:37:17.241615 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:37:17.241615 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:37:17.241615 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96c8ef8e-9790-4cd5-9a62-a6778b7bf02c could not be found. Oct 27 03:37:17.241615 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:37:17.243775 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f5fcc608-7327-4d31-a7df-094589d63ef7 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Returning 404 to user: Instance 96c8ef8e-9790-4cd5-9a62-a6778b7bf02c could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:37:17.245054 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f5fcc608-7327-4d31-a7df-094589d63ef7 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] 10.222.0.20 "GET /compute/v2.1/servers/96c8ef8e-9790-4cd5-9a62-a6778b7bf02c" status: 404 len: 111 microversion: 2.1 time: 0.070943 Oct 27 03:37:17.247120 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2086/3940] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:17 2022] GET /compute/v2.1/servers/96c8ef8e-9790-4cd5-9a62-a6778b7bf02c => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:37:17.260411 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a0568fb8-1b8e-4029-9c80-4675a98e2d36 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Calling method '.version_select at 0x7f7dda1b69d0>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:17.347751 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-eb6c458b-ba2b-4b6c-ae47-cf7e38db81a8 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:17.349105 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-eb6c458b-ba2b-4b6c-ae47-cf7e38db81a8 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:17.363307 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eb6c458b-ba2b-4b6c-ae47-cf7e38db81a8 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:17.364092 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eb6c458b-ba2b-4b6c-ae47-cf7e38db81a8 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:17.364745 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eb6c458b-ba2b-4b6c-ae47-cf7e38db81a8 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:17.365788 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eb6c458b-ba2b-4b6c-ae47-cf7e38db81a8 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:17.366530 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eb6c458b-ba2b-4b6c-ae47-cf7e38db81a8 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:17.367238 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eb6c458b-ba2b-4b6c-ae47-cf7e38db81a8 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:17.378069 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a0568fb8-1b8e-4029-9c80-4675a98e2d36 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-757146510" status: 202 len: 0 microversion: 2.1 time: 0.126455 Oct 27 03:37:17.383592 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1855/3941] 10.222.0.20 () {58 vars in 1218 bytes} [Thu Oct 27 03:37:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-757146510 => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:37:17.558305 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-f5d1fa77-ba0d-479c-965a-15bfdeea70d5 req-0ae54a3d-db24-47ab-a05f-73c2ff34a773 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d8900c4-92eb-4374-bd63-6d0ebbf407b7", "name": "network-vif-plugged", "status": "completed", "tag": "fae83cc0-a7ce-470e-8ecf-19d03d536ec7"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:37:17.588150 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-f5d1fa77-ba0d-479c-965a-15bfdeea70d5 req-0ae54a3d-db24-47ab-a05f-73c2ff34a773 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:17.593148 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-f5d1fa77-ba0d-479c-965a-15bfdeea70d5 req-0ae54a3d-db24-47ab-a05f-73c2ff34a773 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:17.593668 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-f5d1fa77-ba0d-479c-965a-15bfdeea70d5 req-0ae54a3d-db24-47ab-a05f-73c2ff34a773 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:17.611152 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-f5d1fa77-ba0d-479c-965a-15bfdeea70d5 req-0ae54a3d-db24-47ab-a05f-73c2ff34a773 service nova] Creating event network-vif-plugged:fae83cc0-a7ce-470e-8ecf-19d03d536ec7 for instance 2d8900c4-92eb-4374-bd63-6d0ebbf407b7 on n-h2-862769-1 Oct 27 03:37:17.616940 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-f5d1fa77-ba0d-479c-965a-15bfdeea70d5 req-0ae54a3d-db24-47ab-a05f-73c2ff34a773 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063253 Oct 27 03:37:17.618240 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1856/3942] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:37:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:37:17.692233 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-eb6c458b-ba2b-4b6c-ae47-cf7e38db81a8 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:17.702300 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-eb6c458b-ba2b-4b6c-ae47-cf7e38db81a8 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1462 microversion: 2.1 time: 0.358360 Oct 27 03:37:17.703454 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2087/3943] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:17 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1462 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:37:18.130560 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b909c0bd-d603-4763-b3ce-6cae06345630 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:18.133366 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b909c0bd-d603-4763-b3ce-6cae06345630 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: 2d8900c4-92eb-4374-bd63-6d0ebbf407b7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:18.144660 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b909c0bd-d603-4763-b3ce-6cae06345630 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:18.149798 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b909c0bd-d603-4763-b3ce-6cae06345630 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:18.150746 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b909c0bd-d603-4763-b3ce-6cae06345630 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:18.152560 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b909c0bd-d603-4763-b3ce-6cae06345630 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:18.154386 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b909c0bd-d603-4763-b3ce-6cae06345630 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:18.155062 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b909c0bd-d603-4763-b3ce-6cae06345630 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:18.393762 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b909c0bd-d603-4763-b3ce-6cae06345630 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:18.411901 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b909c0bd-d603-4763-b3ce-6cae06345630 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/2d8900c4-92eb-4374-bd63-6d0ebbf407b7" status: 200 len: 1314 microversion: 2.1 time: 0.293011 Oct 27 03:37:18.413564 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1857/3944] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:18 2022] GET /compute/v2.1/servers/2d8900c4-92eb-4374-bd63-6d0ebbf407b7 => generated 1314 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:37:18.733825 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e1b5d723-433e-48ba-a8cc-73a7d2756901 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:18.735412 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e1b5d723-433e-48ba-a8cc-73a7d2756901 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:18.749332 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e1b5d723-433e-48ba-a8cc-73a7d2756901 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:18.753148 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e1b5d723-433e-48ba-a8cc-73a7d2756901 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:18.753851 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e1b5d723-433e-48ba-a8cc-73a7d2756901 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:18.754812 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e1b5d723-433e-48ba-a8cc-73a7d2756901 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:18.756545 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e1b5d723-433e-48ba-a8cc-73a7d2756901 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:18.760259 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e1b5d723-433e-48ba-a8cc-73a7d2756901 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:19.439787 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-17c00246-ade0-4080-bad4-18974ef8fcf2 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:19.441037 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-17c00246-ade0-4080-bad4-18974ef8fcf2 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: 2d8900c4-92eb-4374-bd63-6d0ebbf407b7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:19.459726 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-17c00246-ade0-4080-bad4-18974ef8fcf2 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:19.460620 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-17c00246-ade0-4080-bad4-18974ef8fcf2 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:19.461912 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-17c00246-ade0-4080-bad4-18974ef8fcf2 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:19.465903 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-17c00246-ade0-4080-bad4-18974ef8fcf2 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:19.468598 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-17c00246-ade0-4080-bad4-18974ef8fcf2 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:19.476529 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-17c00246-ade0-4080-bad4-18974ef8fcf2 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:19.568499 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e1b5d723-433e-48ba-a8cc-73a7d2756901 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:19.577768 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:37:19.596875 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e1b5d723-433e-48ba-a8cc-73a7d2756901 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1518 microversion: 2.1 time: 0.851360 Oct 27 03:37:19.606938 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2088/3945] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:18 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1518 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:37:19.763831 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-17c00246-ade0-4080-bad4-18974ef8fcf2 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:19.776669 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-17c00246-ade0-4080-bad4-18974ef8fcf2 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/2d8900c4-92eb-4374-bd63-6d0ebbf407b7" status: 200 len: 1501 microversion: 2.1 time: 0.342850 Oct 27 03:37:19.790071 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1858/3946] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:19 2022] GET /compute/v2.1/servers/2d8900c4-92eb-4374-bd63-6d0ebbf407b7 => generated 1501 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:37:19.802131 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9b260429-c5a1-45f7-9942-2546b7e54eb5 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:37:19.804146 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-9b260429-c5a1-45f7-9942-2546b7e54eb5 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: 2d8900c4-92eb-4374-bd63-6d0ebbf407b7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:19.815388 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9b260429-c5a1-45f7-9942-2546b7e54eb5 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:19.816269 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9b260429-c5a1-45f7-9942-2546b7e54eb5 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:19.816896 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9b260429-c5a1-45f7-9942-2546b7e54eb5 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:19.818015 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9b260429-c5a1-45f7-9942-2546b7e54eb5 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:19.818741 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9b260429-c5a1-45f7-9942-2546b7e54eb5 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:19.819357 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9b260429-c5a1-45f7-9942-2546b7e54eb5 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:20.148632 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9b260429-c5a1-45f7-9942-2546b7e54eb5 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "POST /compute/v2.1/servers/2d8900c4-92eb-4374-bd63-6d0ebbf407b7/action" status: 202 len: 0 microversion: 2.1 time: 0.351322 Oct 27 03:37:20.149707 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2089/3947] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:37:19 2022] POST /compute/v2.1/servers/2d8900c4-92eb-4374-bd63-6d0ebbf407b7/action => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:37:20.161373 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6ec855c6-9849-49b4-b0fe-a8b3f99374e6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:20.162006 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6ec855c6-9849-49b4-b0fe-a8b3f99374e6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: 2d8900c4-92eb-4374-bd63-6d0ebbf407b7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:20.176214 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6ec855c6-9849-49b4-b0fe-a8b3f99374e6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:20.176800 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6ec855c6-9849-49b4-b0fe-a8b3f99374e6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:20.177254 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6ec855c6-9849-49b4-b0fe-a8b3f99374e6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:20.177980 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6ec855c6-9849-49b4-b0fe-a8b3f99374e6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:20.178824 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6ec855c6-9849-49b4-b0fe-a8b3f99374e6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:20.191132 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6ec855c6-9849-49b4-b0fe-a8b3f99374e6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:20.612897 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8cba6882-9039-465a-9abb-d96d1bd38970 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:20.614754 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8cba6882-9039-465a-9abb-d96d1bd38970 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:20.629575 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8cba6882-9039-465a-9abb-d96d1bd38970 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:20.630684 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-6ec855c6-9849-49b4-b0fe-a8b3f99374e6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:20.631651 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8cba6882-9039-465a-9abb-d96d1bd38970 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:20.637812 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8cba6882-9039-465a-9abb-d96d1bd38970 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:20.640726 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8cba6882-9039-465a-9abb-d96d1bd38970 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:20.641984 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8cba6882-9039-465a-9abb-d96d1bd38970 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:20.642716 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8cba6882-9039-465a-9abb-d96d1bd38970 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:20.644707 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6ec855c6-9849-49b4-b0fe-a8b3f99374e6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/2d8900c4-92eb-4374-bd63-6d0ebbf407b7" status: 200 len: 1506 microversion: 2.1 time: 0.485188 Oct 27 03:37:20.646809 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1859/3948] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:20 2022] GET /compute/v2.1/servers/2d8900c4-92eb-4374-bd63-6d0ebbf407b7 => generated 1506 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:37:20.716545 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1fc3d4c4-8e33-453c-8744-0db668eeeb3c tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Calling method '.version_select at 0x7f7dd9dc7d30>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:20.762912 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-1fc3d4c4-8e33-453c-8744-0db668eeeb3c tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] HTTP exception thrown: Image not found. Oct 27 03:37:20.765109 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1fc3d4c4-8e33-453c-8744-0db668eeeb3c tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Request method failure captured: Oct 27 03:37:20.765109 n-d-862769-1 devstack@n-api.service[121000]: request: DELETE /compute/v2.1/images/f2f752a5-ebaf-4a15-b2d9-ee7cf10cc793 HTTP/1.1 Oct 27 03:37:20.765109 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:37:20.765109 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:37:20.765109 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:37:20.765109 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:37:20.765109 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:37:20.765109 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:37:20.765109 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:37:20.765109 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:37:20.765109 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfx5Hbc6ITbdSRFtS1-RYRPTs8xU2lFAIvTX0CRBjp8hijBP6KjJjfK-rUuEjncsIe7o_mkFNeieFkwqoNyxVxCVqSYWPgHA26VD6r86MpHHV_eFwebptw3rA_gpbw5SDVw15ZqeHqKSf2NQXZk1XM_suSoUNVero4I26u6VER7fLwA Oct 27 03:37:20.765109 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:37:20.765109 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:37:20.765109 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:37:20.765109 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:37:20.765109 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:37:20.765109 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:37:20.765109 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 2e58f30136ed4a4d9bff48e9b4cde5a8 Oct 27 03:37:20.765109 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-597177073 Oct 27 03:37:20.765109 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:37:20.765109 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:37:20.765109 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2e58f30136ed4a4d9bff48e9b4cde5a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2e58f30136ed4a4d9bff48e9b4cde5a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2e58f30136ed4a4d9bff48e9b4cde5a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2e58f30136ed4a4d9bff48e9b4cde5a8"}]}] Oct 27 03:37:20.765109 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-597177073 Oct 27 03:37:20.765109 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 2e58f30136ed4a4d9bff48e9b4cde5a8 Oct 27 03:37:20.765109 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-597177073 Oct 27 03:37:20.765109 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ImagesOneServerNegativeTestJSON-597177073-project Oct 27 03:37:20.765109 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:37:20.765109 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:37:20.765109 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 5c36bef85ac34b4983a79e03c56965c5 Oct 27 03:37:20.765109 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-597177073-project Oct 27 03:37:20.765109 n-d-862769-1 devstack@n-api.service[121000]: method: Oct 27 03:37:20.765109 n-d-862769-1 devstack@n-api.service[121000]: exception: Image not found. Oct 27 03:37:20.765109 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': 'f2f752a5-ebaf-4a15-b2d9-ee7cf10cc793'} Oct 27 03:37:20.765109 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:37:20.765109 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:37:20.765109 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 27 03:37:20.765109 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 27 03:37:20.765109 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 03:37:20.765109 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 03:37:20.765109 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 03:37:20.765109 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 03:37:20.765109 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 27 03:37:20.765109 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 27 03:37:20.765109 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 27 03:37:20.765109 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 27 03:37:20.765109 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 03:37:20.765109 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 03:37:20.765109 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 03:37:20.765109 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 03:37:20.765109 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image f2f752a5-ebaf-4a15-b2d9-ee7cf10cc793 to delete Oct 27 03:37:20.765109 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:37:20.765109 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:37:20.765109 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:37:20.765109 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:37:20.765109 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 27 03:37:20.765109 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 27 03:37:20.765109 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 27 03:37:20.765109 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 27 03:37:20.765109 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 27 03:37:20.765109 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 27 03:37:20.765109 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f2f752a5-ebaf-4a15-b2d9-ee7cf10cc793 could not be found. Oct 27 03:37:20.765109 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:37:20.765109 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:37:20.765109 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:37:20.770416 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:37:20.770416 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:37:20.770416 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:37:20.770416 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:37:20.770416 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:37:20.770416 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:37:20.770416 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:37:20.770416 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:37:20.770416 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:37:20.770416 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 27 03:37:20.770416 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 27 03:37:20.770416 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 27 03:37:20.770416 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:37:20.770416 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:37:20.770416 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:37:20.770416 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:37:20.770416 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:37:20.770416 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:37:20.770416 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:37:20.770416 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:37:20.770416 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 27 03:37:20.770416 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:37:20.774409 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1fc3d4c4-8e33-453c-8744-0db668eeeb3c tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Returning 404 to user: Image not found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:37:20.775453 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1fc3d4c4-8e33-453c-8744-0db668eeeb3c tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] 10.222.0.20 "DELETE /compute/v2.1/images/f2f752a5-ebaf-4a15-b2d9-ee7cf10cc793" status: 404 len: 62 microversion: 2.1 time: 0.063564 Oct 27 03:37:20.780058 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1860/3949] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:20 2022] DELETE /compute/v2.1/images/f2f752a5-ebaf-4a15-b2d9-ee7cf10cc793 => generated 62 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 03:37:20.792863 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-fa4131ba-ceef-4cc2-8528-39c11a8bfc66 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:20.794244 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-fa4131ba-ceef-4cc2-8528-39c11a8bfc66 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] [instance: 09065cd4-8246-49ee-80fe-b4f1c11b468d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:20.808307 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fa4131ba-ceef-4cc2-8528-39c11a8bfc66 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:20.809130 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fa4131ba-ceef-4cc2-8528-39c11a8bfc66 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:20.809790 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fa4131ba-ceef-4cc2-8528-39c11a8bfc66 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:20.810890 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fa4131ba-ceef-4cc2-8528-39c11a8bfc66 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:20.811517 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fa4131ba-ceef-4cc2-8528-39c11a8bfc66 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:20.812218 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fa4131ba-ceef-4cc2-8528-39c11a8bfc66 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:20.841385 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-fa4131ba-ceef-4cc2-8528-39c11a8bfc66 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] HTTP exception thrown: Instance 09065cd4-8246-49ee-80fe-b4f1c11b468d could not be found. Oct 27 03:37:20.843156 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-fa4131ba-ceef-4cc2-8528-39c11a8bfc66 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Request method failure captured: Oct 27 03:37:20.843156 n-d-862769-1 devstack@n-api.service[121000]: request: DELETE /compute/v2.1/servers/09065cd4-8246-49ee-80fe-b4f1c11b468d HTTP/1.1 Oct 27 03:37:20.843156 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:37:20.843156 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:37:20.843156 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:37:20.843156 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:37:20.843156 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:37:20.843156 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:37:20.843156 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:37:20.843156 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:37:20.843156 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfx5Hbc6ITbdSRFtS1-RYRPTs8xU2lFAIvTX0CRBjp8hijBP6KjJjfK-rUuEjncsIe7o_mkFNeieFkwqoNyxVxCVqSYWPgHA26VD6r86MpHHV_eFwebptw3rA_gpbw5SDVw15ZqeHqKSf2NQXZk1XM_suSoUNVero4I26u6VER7fLwA Oct 27 03:37:20.843156 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:37:20.843156 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:37:20.843156 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:37:20.843156 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:37:20.843156 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:37:20.843156 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:37:20.843156 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 2e58f30136ed4a4d9bff48e9b4cde5a8 Oct 27 03:37:20.843156 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-597177073 Oct 27 03:37:20.843156 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:37:20.843156 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:37:20.843156 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2e58f30136ed4a4d9bff48e9b4cde5a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2e58f30136ed4a4d9bff48e9b4cde5a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2e58f30136ed4a4d9bff48e9b4cde5a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2e58f30136ed4a4d9bff48e9b4cde5a8"}]}] Oct 27 03:37:20.843156 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-597177073 Oct 27 03:37:20.843156 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 2e58f30136ed4a4d9bff48e9b4cde5a8 Oct 27 03:37:20.843156 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-597177073 Oct 27 03:37:20.843156 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ImagesOneServerNegativeTestJSON-597177073-project Oct 27 03:37:20.843156 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:37:20.843156 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:37:20.843156 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 5c36bef85ac34b4983a79e03c56965c5 Oct 27 03:37:20.843156 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-597177073-project Oct 27 03:37:20.843156 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:37:20.843156 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 09065cd4-8246-49ee-80fe-b4f1c11b468d could not be found. Oct 27 03:37:20.843156 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '09065cd4-8246-49ee-80fe-b4f1c11b468d'} Oct 27 03:37:20.843156 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:37:20.843156 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:37:20.843156 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:37:20.843156 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:37:20.843156 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:37:20.843156 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:37:20.843156 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:37:20.843156 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:37:20.843156 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:37:20.843156 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:37:20.843156 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09065cd4-8246-49ee-80fe-b4f1c11b468d could not be found. Oct 27 03:37:20.843156 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:37:20.843156 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:37:20.843156 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:37:20.843156 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:37:20.843156 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:37:20.843156 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:37:20.843156 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:37:20.843156 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:37:20.843156 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:37:20.843156 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:37:20.843156 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 03:37:20.843156 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 03:37:20.843156 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 03:37:20.843156 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 03:37:20.843156 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:37:20.843156 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:37:20.843156 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:37:20.843156 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:37:20.857206 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09065cd4-8246-49ee-80fe-b4f1c11b468d could not be found. Oct 27 03:37:20.857206 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:37:20.857206 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:37:20.857206 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:37:20.857206 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:37:20.857206 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:37:20.857206 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:37:20.857206 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:37:20.857206 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:37:20.857206 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09065cd4-8246-49ee-80fe-b4f1c11b468d could not be found. Oct 27 03:37:20.857206 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:37:20.857206 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-fa4131ba-ceef-4cc2-8528-39c11a8bfc66 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Returning 404 to user: Instance 09065cd4-8246-49ee-80fe-b4f1c11b468d could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:37:20.857206 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-fa4131ba-ceef-4cc2-8528-39c11a8bfc66 tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] 10.222.0.20 "DELETE /compute/v2.1/servers/09065cd4-8246-49ee-80fe-b4f1c11b468d" status: 404 len: 111 microversion: 2.1 time: 0.061888 Oct 27 03:37:20.857206 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1861/3950] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:37:20 2022] DELETE /compute/v2.1/servers/09065cd4-8246-49ee-80fe-b4f1c11b468d => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:37:20.870451 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5a1918ea-69dd-4073-9a2b-3cfb8cce1a8e tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:20.875720 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5a1918ea-69dd-4073-9a2b-3cfb8cce1a8e tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] [instance: 09065cd4-8246-49ee-80fe-b4f1c11b468d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:20.887908 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5a1918ea-69dd-4073-9a2b-3cfb8cce1a8e tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:20.888811 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5a1918ea-69dd-4073-9a2b-3cfb8cce1a8e tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:20.889482 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5a1918ea-69dd-4073-9a2b-3cfb8cce1a8e tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:20.890456 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5a1918ea-69dd-4073-9a2b-3cfb8cce1a8e tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:20.891121 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5a1918ea-69dd-4073-9a2b-3cfb8cce1a8e tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:20.891780 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5a1918ea-69dd-4073-9a2b-3cfb8cce1a8e tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:20.920491 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-5a1918ea-69dd-4073-9a2b-3cfb8cce1a8e tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] HTTP exception thrown: Instance 09065cd4-8246-49ee-80fe-b4f1c11b468d could not be found. Oct 27 03:37:20.922398 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5a1918ea-69dd-4073-9a2b-3cfb8cce1a8e tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Request method failure captured: Oct 27 03:37:20.922398 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/09065cd4-8246-49ee-80fe-b4f1c11b468d HTTP/1.1 Oct 27 03:37:20.922398 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:37:20.922398 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:37:20.922398 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:37:20.922398 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:37:20.922398 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:37:20.922398 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:37:20.922398 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:37:20.922398 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:37:20.922398 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfx5Hbc6ITbdSRFtS1-RYRPTs8xU2lFAIvTX0CRBjp8hijBP6KjJjfK-rUuEjncsIe7o_mkFNeieFkwqoNyxVxCVqSYWPgHA26VD6r86MpHHV_eFwebptw3rA_gpbw5SDVw15ZqeHqKSf2NQXZk1XM_suSoUNVero4I26u6VER7fLwA Oct 27 03:37:20.922398 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:37:20.922398 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:37:20.922398 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:37:20.922398 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:37:20.922398 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:37:20.922398 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:37:20.922398 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 2e58f30136ed4a4d9bff48e9b4cde5a8 Oct 27 03:37:20.922398 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-597177073 Oct 27 03:37:20.922398 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:37:20.922398 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:37:20.922398 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2e58f30136ed4a4d9bff48e9b4cde5a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2e58f30136ed4a4d9bff48e9b4cde5a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2e58f30136ed4a4d9bff48e9b4cde5a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2e58f30136ed4a4d9bff48e9b4cde5a8"}]}] Oct 27 03:37:20.922398 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-597177073 Oct 27 03:37:20.922398 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 2e58f30136ed4a4d9bff48e9b4cde5a8 Oct 27 03:37:20.922398 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-597177073 Oct 27 03:37:20.922398 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ImagesOneServerNegativeTestJSON-597177073-project Oct 27 03:37:20.922398 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:37:20.922398 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:37:20.922398 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 5c36bef85ac34b4983a79e03c56965c5 Oct 27 03:37:20.922398 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-597177073-project Oct 27 03:37:20.922398 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:37:20.922398 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 09065cd4-8246-49ee-80fe-b4f1c11b468d could not be found. Oct 27 03:37:20.922398 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '09065cd4-8246-49ee-80fe-b4f1c11b468d'} Oct 27 03:37:20.922398 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:37:20.922398 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:37:20.922398 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:37:20.922398 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:37:20.922398 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:37:20.922398 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:37:20.922398 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:37:20.922398 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:37:20.922398 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:37:20.922398 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:37:20.922398 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09065cd4-8246-49ee-80fe-b4f1c11b468d could not be found. Oct 27 03:37:20.922398 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:37:20.922398 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:37:20.922398 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:37:20.922398 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:37:20.922398 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:37:20.922398 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:37:20.922398 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:37:20.922398 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:37:20.922398 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:37:20.922398 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:37:20.922398 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:37:20.922398 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:37:20.922398 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:37:20.922398 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:37:20.922398 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:37:20.922398 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:37:20.922398 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09065cd4-8246-49ee-80fe-b4f1c11b468d could not be found. Oct 27 03:37:20.922398 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:37:20.922398 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:37:20.926983 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:37:20.926983 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:37:20.926983 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:37:20.926983 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:37:20.926983 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:37:20.926983 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:37:20.926983 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09065cd4-8246-49ee-80fe-b4f1c11b468d could not be found. Oct 27 03:37:20.926983 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:37:20.929252 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5a1918ea-69dd-4073-9a2b-3cfb8cce1a8e tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] Returning 404 to user: Instance 09065cd4-8246-49ee-80fe-b4f1c11b468d could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:37:20.930464 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5a1918ea-69dd-4073-9a2b-3cfb8cce1a8e tempest-ImagesOneServerNegativeTestJSON-597177073 tempest-ImagesOneServerNegativeTestJSON-597177073-project] 10.222.0.20 "GET /compute/v2.1/servers/09065cd4-8246-49ee-80fe-b4f1c11b468d" status: 404 len: 111 microversion: 2.1 time: 0.065404 Oct 27 03:37:20.934512 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1862/3951] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:20 2022] GET /compute/v2.1/servers/09065cd4-8246-49ee-80fe-b4f1c11b468d => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:37:21.015606 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a3d5ac7a-062e-4692-aac6-d1ce296cbe08 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2102887980", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "015ce8ac-7a6f-4fac-a9b8-c0d16c24afe3"}], "security_groups": [{"name": "tempest-securitygroup--1640848312"}], "key_name": "tempest-keypair-1572205689", "user_data": "}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:37:21.155134 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8cba6882-9039-465a-9abb-d96d1bd38970 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:21.165992 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8cba6882-9039-465a-9abb-d96d1bd38970 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1518 microversion: 2.1 time: 0.564316 Oct 27 03:37:21.194768 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2090/3952] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:20 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1518 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:37:21.260468 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-a3d5ac7a-062e-4692-aac6-d1ce296cbe08 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] validate_networks() for [('015ce8ac-7a6f-4fac-a9b8-c0d16c24afe3', None, None, None, None, None)] {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:37:21.546478 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-5fe77ccf-b6a8-4018-b8c5-59a28500ce41 req-bbe8da6e-5130-4d0a-8a42-9e74b630cd46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "376ac459-e31f-4727-9e34-535f055ac20d", "tag": "e825dd69-54a1-4411-addc-e78fd04434d2"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:37:21.569429 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-5fe77ccf-b6a8-4018-b8c5-59a28500ce41 req-bbe8da6e-5130-4d0a-8a42-9e74b630cd46 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:21.572074 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-5fe77ccf-b6a8-4018-b8c5-59a28500ce41 req-bbe8da6e-5130-4d0a-8a42-9e74b630cd46 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:21.574448 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-5fe77ccf-b6a8-4018-b8c5-59a28500ce41 req-bbe8da6e-5130-4d0a-8a42-9e74b630cd46 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:21.634554 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-5fe77ccf-b6a8-4018-b8c5-59a28500ce41 req-bbe8da6e-5130-4d0a-8a42-9e74b630cd46 service nova] Creating event network-changed:e825dd69-54a1-4411-addc-e78fd04434d2 for instance 376ac459-e31f-4727-9e34-535f055ac20d on n-h1-862769-1 Oct 27 03:37:21.650328 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-5fe77ccf-b6a8-4018-b8c5-59a28500ce41 req-bbe8da6e-5130-4d0a-8a42-9e74b630cd46 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109118 Oct 27 03:37:21.651383 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2091/3953] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:37:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:37:21.675014 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a3091c34-a936-4657-b326-4c9129bfb579 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:21.680447 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a3091c34-a936-4657-b326-4c9129bfb579 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: 2d8900c4-92eb-4374-bd63-6d0ebbf407b7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:21.689855 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a3091c34-a936-4657-b326-4c9129bfb579 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:21.690561 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a3091c34-a936-4657-b326-4c9129bfb579 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:21.691158 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a3091c34-a936-4657-b326-4c9129bfb579 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:21.691962 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a3091c34-a936-4657-b326-4c9129bfb579 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:21.692575 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a3091c34-a936-4657-b326-4c9129bfb579 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:21.693084 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a3091c34-a936-4657-b326-4c9129bfb579 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:22.316065 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a3091c34-a936-4657-b326-4c9129bfb579 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:22.348326 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a3091c34-a936-4657-b326-4c9129bfb579 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/2d8900c4-92eb-4374-bd63-6d0ebbf407b7" status: 200 len: 1486 microversion: 2.1 time: 0.678288 Oct 27 03:37:22.360503 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-a3d5ac7a-062e-4692-aac6-d1ce296cbe08 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:37:22.361053 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-a3d5ac7a-062e-4692-aac6-d1ce296cbe08 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:37:22.361611 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-a3d5ac7a-062e-4692-aac6-d1ce296cbe08 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:37:22.362147 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-a3d5ac7a-062e-4692-aac6-d1ce296cbe08 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:37:22.362419 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2092/3954] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:21 2022] GET /compute/v2.1/servers/2d8900c4-92eb-4374-bd63-6d0ebbf407b7 => generated 1486 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:37:22.363040 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-a3d5ac7a-062e-4692-aac6-d1ce296cbe08 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:37:22.369671 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a69f3e86-a172-4f9c-ae83-b62a12daa021 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:22.370575 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a69f3e86-a172-4f9c-ae83-b62a12daa021 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:22.383996 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a3d5ac7a-062e-4692-aac6-d1ce296cbe08 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:22.385104 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a3d5ac7a-062e-4692-aac6-d1ce296cbe08 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:22.386277 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a3d5ac7a-062e-4692-aac6-d1ce296cbe08 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:22.389512 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a3d5ac7a-062e-4692-aac6-d1ce296cbe08 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:22.392256 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a3d5ac7a-062e-4692-aac6-d1ce296cbe08 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:22.393799 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a3d5ac7a-062e-4692-aac6-d1ce296cbe08 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:22.404108 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a69f3e86-a172-4f9c-ae83-b62a12daa021 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:22.404108 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a69f3e86-a172-4f9c-ae83-b62a12daa021 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:22.404108 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a69f3e86-a172-4f9c-ae83-b62a12daa021 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:22.407501 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a69f3e86-a172-4f9c-ae83-b62a12daa021 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:22.408227 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a69f3e86-a172-4f9c-ae83-b62a12daa021 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:22.410076 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a69f3e86-a172-4f9c-ae83-b62a12daa021 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:22.483288 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-a3d5ac7a-062e-4692-aac6-d1ce296cbe08 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Getting quotas for project 229dcb63bc41444391544883b576ce2e. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:37:22.502635 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-a3d5ac7a-062e-4692-aac6-d1ce296cbe08 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Getting quotas for user 18036411a99e4634bfbaeae24b9f254d and project 229dcb63bc41444391544883b576ce2e. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:37:22.570665 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a3d5ac7a-062e-4692-aac6-d1ce296cbe08 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:37:22.573826 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a3d5ac7a-062e-4692-aac6-d1ce296cbe08 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: d963bc87-b838-431c-92c3-8f06dd7afba7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:37:22.820799 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a3d5ac7a-062e-4692-aac6-d1ce296cbe08 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.806542 Oct 27 03:37:22.821954 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1863/3955] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:37:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 1812 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 03:37:22.833796 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b4ee2986-41de-495b-a79b-25007397b011 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:37:22.841613 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b4ee2986-41de-495b-a79b-25007397b011 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: 2d8900c4-92eb-4374-bd63-6d0ebbf407b7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:22.877330 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=48 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:37:22.881531 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b4ee2986-41de-495b-a79b-25007397b011 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:22.885998 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b4ee2986-41de-495b-a79b-25007397b011 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:22.886483 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b4ee2986-41de-495b-a79b-25007397b011 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:22.887280 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b4ee2986-41de-495b-a79b-25007397b011 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:22.887743 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b4ee2986-41de-495b-a79b-25007397b011 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:22.890507 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b4ee2986-41de-495b-a79b-25007397b011 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:22.947606 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-b4ee2986-41de-495b-a79b-25007397b011 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lazy-loading 'flavor' on Instance uuid 2d8900c4-92eb-4374-bd63-6d0ebbf407b7 {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:37:23.164229 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a69f3e86-a172-4f9c-ae83-b62a12daa021 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:23.175391 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a69f3e86-a172-4f9c-ae83-b62a12daa021 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1518 microversion: 2.1 time: 0.811583 Oct 27 03:37:23.176426 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2093/3956] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:22 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1518 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:37:23.183325 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c1f5bae3-e94b-46e7-bc98-3275f6f2426c tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:23.193842 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c1f5bae3-e94b-46e7-bc98-3275f6f2426c tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: d963bc87-b838-431c-92c3-8f06dd7afba7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:23.723753 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c1f5bae3-e94b-46e7-bc98-3275f6f2426c tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18036411a99e4634bfbaeae24b9f254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229dcb63bc41444391544883b576ce2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:23.734717 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c1f5bae3-e94b-46e7-bc98-3275f6f2426c tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/d963bc87-b838-431c-92c3-8f06dd7afba7" status: 200 len: 1242 microversion: 2.1 time: 0.556968 Oct 27 03:37:23.735487 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2094/3957] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:23 2022] GET /compute/v2.1/servers/d963bc87-b838-431c-92c3-8f06dd7afba7 => generated 1242 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:37:23.848473 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b4ee2986-41de-495b-a79b-25007397b011 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "POST /compute/v2.1/servers/2d8900c4-92eb-4374-bd63-6d0ebbf407b7/action" status: 202 len: 0 microversion: 2.1 time: 1.024331 Oct 27 03:37:23.851378 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1864/3958] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:37:22 2022] POST /compute/v2.1/servers/2d8900c4-92eb-4374-bd63-6d0ebbf407b7/action => generated 0 bytes in 1029 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:37:23.875971 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-decd91eb-02f8-44e5-b8c0-6acb3525f13d tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:23.878600 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-decd91eb-02f8-44e5-b8c0-6acb3525f13d tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: 2d8900c4-92eb-4374-bd63-6d0ebbf407b7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:23.892340 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-decd91eb-02f8-44e5-b8c0-6acb3525f13d tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:23.892851 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-decd91eb-02f8-44e5-b8c0-6acb3525f13d tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:23.893301 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-decd91eb-02f8-44e5-b8c0-6acb3525f13d tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:23.894113 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-decd91eb-02f8-44e5-b8c0-6acb3525f13d tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:23.894537 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-decd91eb-02f8-44e5-b8c0-6acb3525f13d tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:23.894953 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-decd91eb-02f8-44e5-b8c0-6acb3525f13d tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:24.094700 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-527ab43b-1913-4c75-9e60-f9dc50673f69 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Action: 'create', calling method: .version_select at 0x7f7dd9e3faf0>, body: {"keypair": {"name": "tempest-keypair-1412355363", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDVV7ZUMiaIPtQai4QEQwNXwKISsRTNLXcJbYg5AFtT565KaqN07UgqZIRwz7NfLt+IfVYEySmD6SKU0OTpphyeXSAxfTIOEpZxxxTFPt/KPLMQPetnab3DN0b44aMpEJw=="}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:37:24.116230 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-527ab43b-1913-4c75-9e60-f9dc50673f69 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Getting quotas for project 1ec987ba67f94da4bbdadc3835e56d7d. Resources: {'key_pairs'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:37:24.123679 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-527ab43b-1913-4c75-9e60-f9dc50673f69 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Getting quotas for user 88497702ee824799952e4bcd583ee367 and project 1ec987ba67f94da4bbdadc3835e56d7d. Resources: {'key_pairs'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:37:24.393207 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-527ab43b-1913-4c75-9e60-f9dc50673f69 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.305084 Oct 27 03:37:24.394281 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1865/3959] 10.222.0.20 () {62 vars in 1200 bytes} [Thu Oct 27 03:37:24 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 309 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 27 03:37:24.401708 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-80b13c39-3cdb-4ed7-bf39-c4a3a59d9929 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:24.404287 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-80b13c39-3cdb-4ed7-bf39-c4a3a59d9929 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:24.420860 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-80b13c39-3cdb-4ed7-bf39-c4a3a59d9929 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:24.421154 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-decd91eb-02f8-44e5-b8c0-6acb3525f13d tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:24.421378 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-80b13c39-3cdb-4ed7-bf39-c4a3a59d9929 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:24.421833 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-80b13c39-3cdb-4ed7-bf39-c4a3a59d9929 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:24.430261 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-80b13c39-3cdb-4ed7-bf39-c4a3a59d9929 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:24.430779 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-80b13c39-3cdb-4ed7-bf39-c4a3a59d9929 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:24.431874 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-80b13c39-3cdb-4ed7-bf39-c4a3a59d9929 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:24.436143 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-decd91eb-02f8-44e5-b8c0-6acb3525f13d tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/2d8900c4-92eb-4374-bd63-6d0ebbf407b7" status: 200 len: 1492 microversion: 2.1 time: 0.579963 Oct 27 03:37:24.436689 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2095/3960] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:23 2022] GET /compute/v2.1/servers/2d8900c4-92eb-4374-bd63-6d0ebbf407b7 => generated 1492 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:37:24.621971 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-80b13c39-3cdb-4ed7-bf39-c4a3a59d9929 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:24.637279 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-80b13c39-3cdb-4ed7-bf39-c4a3a59d9929 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1518 microversion: 2.1 time: 0.241603 Oct 27 03:37:24.641448 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1866/3961] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:24 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1518 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:37:24.763703 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d70de0f0-cc93-4684-b46a-e42b185ba325 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:24.765183 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d70de0f0-cc93-4684-b46a-e42b185ba325 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: d963bc87-b838-431c-92c3-8f06dd7afba7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:24.781876 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d70de0f0-cc93-4684-b46a-e42b185ba325 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:24.783545 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d70de0f0-cc93-4684-b46a-e42b185ba325 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:24.784028 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d70de0f0-cc93-4684-b46a-e42b185ba325 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:24.786752 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d70de0f0-cc93-4684-b46a-e42b185ba325 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:24.787269 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d70de0f0-cc93-4684-b46a-e42b185ba325 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:24.787837 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d70de0f0-cc93-4684-b46a-e42b185ba325 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:25.087434 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d70de0f0-cc93-4684-b46a-e42b185ba325 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18036411a99e4634bfbaeae24b9f254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229dcb63bc41444391544883b576ce2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:25.096361 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d70de0f0-cc93-4684-b46a-e42b185ba325 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/d963bc87-b838-431c-92c3-8f06dd7afba7" status: 200 len: 1246 microversion: 2.1 time: 0.342353 Oct 27 03:37:25.096946 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2096/3962] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:24 2022] GET /compute/v2.1/servers/d963bc87-b838-431c-92c3-8f06dd7afba7 => generated 1246 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:37:25.464810 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a5d3634e-2dc1-49e6-b79f-ec90156d5c5c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:25.465800 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a5d3634e-2dc1-49e6-b79f-ec90156d5c5c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: 2d8900c4-92eb-4374-bd63-6d0ebbf407b7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:25.473610 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a5d3634e-2dc1-49e6-b79f-ec90156d5c5c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:25.479747 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a5d3634e-2dc1-49e6-b79f-ec90156d5c5c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:25.480351 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a5d3634e-2dc1-49e6-b79f-ec90156d5c5c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:25.482948 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a5d3634e-2dc1-49e6-b79f-ec90156d5c5c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:25.491295 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a5d3634e-2dc1-49e6-b79f-ec90156d5c5c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:25.491295 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a5d3634e-2dc1-49e6-b79f-ec90156d5c5c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:25.669294 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-79559bd5-39c2-426a-9128-005046e21c72 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:25.670590 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-79559bd5-39c2-426a-9128-005046e21c72 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:25.696510 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-79559bd5-39c2-426a-9128-005046e21c72 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:25.708279 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-79559bd5-39c2-426a-9128-005046e21c72 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:25.709655 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-79559bd5-39c2-426a-9128-005046e21c72 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:25.712245 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-79559bd5-39c2-426a-9128-005046e21c72 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:25.713854 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-79559bd5-39c2-426a-9128-005046e21c72 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:25.716501 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-79559bd5-39c2-426a-9128-005046e21c72 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:25.899454 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a5d3634e-2dc1-49e6-b79f-ec90156d5c5c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:25.901964 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:37:25.909571 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a5d3634e-2dc1-49e6-b79f-ec90156d5c5c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/2d8900c4-92eb-4374-bd63-6d0ebbf407b7" status: 200 len: 1513 microversion: 2.1 time: 0.449081 Oct 27 03:37:25.922968 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1867/3963] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:25 2022] GET /compute/v2.1/servers/2d8900c4-92eb-4374-bd63-6d0ebbf407b7 => generated 1513 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:37:26.126753 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-339e2f8e-7156-4887-bf39-956f8a74c304 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:26.128632 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-339e2f8e-7156-4887-bf39-956f8a74c304 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: d963bc87-b838-431c-92c3-8f06dd7afba7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:26.139930 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-339e2f8e-7156-4887-bf39-956f8a74c304 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:26.140444 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-339e2f8e-7156-4887-bf39-956f8a74c304 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:26.140896 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-339e2f8e-7156-4887-bf39-956f8a74c304 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:26.141629 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-339e2f8e-7156-4887-bf39-956f8a74c304 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:26.142124 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-339e2f8e-7156-4887-bf39-956f8a74c304 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:26.147439 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-339e2f8e-7156-4887-bf39-956f8a74c304 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:26.327778 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-339e2f8e-7156-4887-bf39-956f8a74c304 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18036411a99e4634bfbaeae24b9f254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229dcb63bc41444391544883b576ce2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:26.337296 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-339e2f8e-7156-4887-bf39-956f8a74c304 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/d963bc87-b838-431c-92c3-8f06dd7afba7" status: 200 len: 1294 microversion: 2.1 time: 0.216184 Oct 27 03:37:26.338574 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1868/3964] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:26 2022] GET /compute/v2.1/servers/d963bc87-b838-431c-92c3-8f06dd7afba7 => generated 1294 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:37:26.945512 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-79559bd5-39c2-426a-9128-005046e21c72 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:26.948727 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-448e5a3e-c919-4d3b-90fa-0434a5338c1f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:26.950159 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-448e5a3e-c919-4d3b-90fa-0434a5338c1f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: 2d8900c4-92eb-4374-bd63-6d0ebbf407b7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:26.958619 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-79559bd5-39c2-426a-9128-005046e21c72 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1518 microversion: 2.1 time: 1.294528 Oct 27 03:37:26.966658 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-448e5a3e-c919-4d3b-90fa-0434a5338c1f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:26.967743 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-448e5a3e-c919-4d3b-90fa-0434a5338c1f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:26.968460 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-448e5a3e-c919-4d3b-90fa-0434a5338c1f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:26.969457 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-448e5a3e-c919-4d3b-90fa-0434a5338c1f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:26.970387 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-448e5a3e-c919-4d3b-90fa-0434a5338c1f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:26.970517 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2097/3965] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:25 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1518 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:37:26.973172 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-448e5a3e-c919-4d3b-90fa-0434a5338c1f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:27.362705 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d9ff3510-4d1a-40bd-afe2-0b5424e1550a tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:27.363682 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d9ff3510-4d1a-40bd-afe2-0b5424e1550a tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: d963bc87-b838-431c-92c3-8f06dd7afba7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:27.381872 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d9ff3510-4d1a-40bd-afe2-0b5424e1550a tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:27.382708 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d9ff3510-4d1a-40bd-afe2-0b5424e1550a tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:27.383423 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d9ff3510-4d1a-40bd-afe2-0b5424e1550a tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:27.384417 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d9ff3510-4d1a-40bd-afe2-0b5424e1550a tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:27.385272 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d9ff3510-4d1a-40bd-afe2-0b5424e1550a tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:27.386135 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d9ff3510-4d1a-40bd-afe2-0b5424e1550a tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:27.715949 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-448e5a3e-c919-4d3b-90fa-0434a5338c1f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:27.733618 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-448e5a3e-c919-4d3b-90fa-0434a5338c1f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/2d8900c4-92eb-4374-bd63-6d0ebbf407b7" status: 200 len: 1508 microversion: 2.1 time: 0.794434 Oct 27 03:37:27.754424 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1869/3966] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:26 2022] GET /compute/v2.1/servers/2d8900c4-92eb-4374-bd63-6d0ebbf407b7 => generated 1508 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:37:27.985293 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d3c883f0-943d-46dc-812e-32ddafebec94 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:27.986800 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d3c883f0-943d-46dc-812e-32ddafebec94 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:27.998627 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d3c883f0-943d-46dc-812e-32ddafebec94 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:28.010884 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d3c883f0-943d-46dc-812e-32ddafebec94 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:28.011770 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d3c883f0-943d-46dc-812e-32ddafebec94 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:28.012896 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d3c883f0-943d-46dc-812e-32ddafebec94 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:28.013607 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d3c883f0-943d-46dc-812e-32ddafebec94 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:28.014338 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d3c883f0-943d-46dc-812e-32ddafebec94 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:28.724416 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d9ff3510-4d1a-40bd-afe2-0b5424e1550a tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18036411a99e4634bfbaeae24b9f254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229dcb63bc41444391544883b576ce2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:28.744792 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d9ff3510-4d1a-40bd-afe2-0b5424e1550a tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/d963bc87-b838-431c-92c3-8f06dd7afba7" status: 200 len: 1312 microversion: 2.1 time: 1.386234 Oct 27 03:37:28.759861 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2098/3967] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:27 2022] GET /compute/v2.1/servers/d963bc87-b838-431c-92c3-8f06dd7afba7 => generated 1312 bytes in 1400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:37:28.787683 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a6476f92-b08e-4ede-9efb-edf68abaa9e8 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:28.792299 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a6476f92-b08e-4ede-9efb-edf68abaa9e8 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: 2d8900c4-92eb-4374-bd63-6d0ebbf407b7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:28.828418 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a6476f92-b08e-4ede-9efb-edf68abaa9e8 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:28.829499 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a6476f92-b08e-4ede-9efb-edf68abaa9e8 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:28.833236 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a6476f92-b08e-4ede-9efb-edf68abaa9e8 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:28.835344 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a6476f92-b08e-4ede-9efb-edf68abaa9e8 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:28.838642 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a6476f92-b08e-4ede-9efb-edf68abaa9e8 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:28.844281 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a6476f92-b08e-4ede-9efb-edf68abaa9e8 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:29.643904 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d3c883f0-943d-46dc-812e-32ddafebec94 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:29.660682 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d3c883f0-943d-46dc-812e-32ddafebec94 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1518 microversion: 2.1 time: 1.674036 Oct 27 03:37:29.675022 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1870/3968] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:27 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1518 bytes in 1695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:37:29.700777 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a6476f92-b08e-4ede-9efb-edf68abaa9e8 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:29.712405 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a6476f92-b08e-4ede-9efb-edf68abaa9e8 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/2d8900c4-92eb-4374-bd63-6d0ebbf407b7" status: 200 len: 1508 microversion: 2.1 time: 0.943854 Oct 27 03:37:29.713053 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2099/3969] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:28 2022] GET /compute/v2.1/servers/2d8900c4-92eb-4374-bd63-6d0ebbf407b7 => generated 1508 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:37:29.773228 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-27d41044-1bf0-401b-9156-dd9b27c0ee42 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:29.774055 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-27d41044-1bf0-401b-9156-dd9b27c0ee42 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: d963bc87-b838-431c-92c3-8f06dd7afba7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:29.785992 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-27d41044-1bf0-401b-9156-dd9b27c0ee42 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:29.788648 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-27d41044-1bf0-401b-9156-dd9b27c0ee42 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:29.789860 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-27d41044-1bf0-401b-9156-dd9b27c0ee42 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:29.793028 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-27d41044-1bf0-401b-9156-dd9b27c0ee42 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:29.798732 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-27d41044-1bf0-401b-9156-dd9b27c0ee42 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:29.799272 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-27d41044-1bf0-401b-9156-dd9b27c0ee42 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:30.087066 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-27d41044-1bf0-401b-9156-dd9b27c0ee42 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18036411a99e4634bfbaeae24b9f254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229dcb63bc41444391544883b576ce2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:30.099035 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-27d41044-1bf0-401b-9156-dd9b27c0ee42 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/d963bc87-b838-431c-92c3-8f06dd7afba7" status: 200 len: 1300 microversion: 2.1 time: 0.328239 Oct 27 03:37:30.099760 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1871/3970] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:29 2022] GET /compute/v2.1/servers/d963bc87-b838-431c-92c3-8f06dd7afba7 => generated 1300 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:37:30.689567 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-67ada62c-5ffb-407e-b058-2e2ddf26c8f9 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:30.693224 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-67ada62c-5ffb-407e-b058-2e2ddf26c8f9 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:30.715004 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-67ada62c-5ffb-407e-b058-2e2ddf26c8f9 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:30.715004 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-67ada62c-5ffb-407e-b058-2e2ddf26c8f9 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:30.716556 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-67ada62c-5ffb-407e-b058-2e2ddf26c8f9 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:30.721131 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-67ada62c-5ffb-407e-b058-2e2ddf26c8f9 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:30.721642 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-67ada62c-5ffb-407e-b058-2e2ddf26c8f9 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:30.722499 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-67ada62c-5ffb-407e-b058-2e2ddf26c8f9 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:30.741571 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-91ce59be-017b-425f-99c1-888cc166cebe tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:30.742222 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-91ce59be-017b-425f-99c1-888cc166cebe tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: 2d8900c4-92eb-4374-bd63-6d0ebbf407b7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:30.758363 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-91ce59be-017b-425f-99c1-888cc166cebe tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:30.758943 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-91ce59be-017b-425f-99c1-888cc166cebe tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:30.759322 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-91ce59be-017b-425f-99c1-888cc166cebe tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:30.764953 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-91ce59be-017b-425f-99c1-888cc166cebe tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:30.765447 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-91ce59be-017b-425f-99c1-888cc166cebe tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:30.765988 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-91ce59be-017b-425f-99c1-888cc166cebe tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:31.358169 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-91ce59be-017b-425f-99c1-888cc166cebe tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:31.370327 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-91ce59be-017b-425f-99c1-888cc166cebe tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/2d8900c4-92eb-4374-bd63-6d0ebbf407b7" status: 200 len: 1508 microversion: 2.1 time: 0.633254 Oct 27 03:37:31.388148 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1872/3971] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:30 2022] GET /compute/v2.1/servers/2d8900c4-92eb-4374-bd63-6d0ebbf407b7 => generated 1508 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:37:31.391120 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a6befef6-e295-4a68-aee0-ef1d6d8121f6 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:31.391605 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a6befef6-e295-4a68-aee0-ef1d6d8121f6 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: d963bc87-b838-431c-92c3-8f06dd7afba7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:31.414317 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a6befef6-e295-4a68-aee0-ef1d6d8121f6 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:31.414859 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a6befef6-e295-4a68-aee0-ef1d6d8121f6 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:31.415307 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a6befef6-e295-4a68-aee0-ef1d6d8121f6 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:31.416308 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a6befef6-e295-4a68-aee0-ef1d6d8121f6 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:31.416781 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a6befef6-e295-4a68-aee0-ef1d6d8121f6 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:31.422853 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a6befef6-e295-4a68-aee0-ef1d6d8121f6 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:31.731499 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-67ada62c-5ffb-407e-b058-2e2ddf26c8f9 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:31.741837 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-67ada62c-5ffb-407e-b058-2e2ddf26c8f9 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1518 microversion: 2.1 time: 1.056813 Oct 27 03:37:31.753359 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2100/3972] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:30 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1518 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:37:31.907258 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-144003c6-7967-4710-a9c3-75bf5b234cca req-a56da907-7297-4d77-bab5-a816f007afa7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d8900c4-92eb-4374-bd63-6d0ebbf407b7", "name": "network-vif-plugged", "status": "completed", "tag": "fae83cc0-a7ce-470e-8ecf-19d03d536ec7"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:37:31.936612 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-144003c6-7967-4710-a9c3-75bf5b234cca req-a56da907-7297-4d77-bab5-a816f007afa7 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:31.937163 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-144003c6-7967-4710-a9c3-75bf5b234cca req-a56da907-7297-4d77-bab5-a816f007afa7 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:31.937605 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-144003c6-7967-4710-a9c3-75bf5b234cca req-a56da907-7297-4d77-bab5-a816f007afa7 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:32.009437 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-144003c6-7967-4710-a9c3-75bf5b234cca req-a56da907-7297-4d77-bab5-a816f007afa7 service nova] Creating event network-vif-plugged:fae83cc0-a7ce-470e-8ecf-19d03d536ec7 for instance 2d8900c4-92eb-4374-bd63-6d0ebbf407b7 on n-h2-862769-1 Oct 27 03:37:32.028927 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-144003c6-7967-4710-a9c3-75bf5b234cca req-a56da907-7297-4d77-bab5-a816f007afa7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126477 Oct 27 03:37:32.038076 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2101/3973] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:37:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:37:32.406178 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6d6742f4-b939-4cd7-85d5-0e37af40f765 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:32.407209 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-6d6742f4-b939-4cd7-85d5-0e37af40f765 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: 2d8900c4-92eb-4374-bd63-6d0ebbf407b7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:32.413876 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:37:32.423066 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6d6742f4-b939-4cd7-85d5-0e37af40f765 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:32.428381 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6d6742f4-b939-4cd7-85d5-0e37af40f765 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:32.429484 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6d6742f4-b939-4cd7-85d5-0e37af40f765 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:32.432661 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6d6742f4-b939-4cd7-85d5-0e37af40f765 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:32.435671 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6d6742f4-b939-4cd7-85d5-0e37af40f765 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:32.436393 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6d6742f4-b939-4cd7-85d5-0e37af40f765 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:32.591167 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a6befef6-e295-4a68-aee0-ef1d6d8121f6 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18036411a99e4634bfbaeae24b9f254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229dcb63bc41444391544883b576ce2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:32.610478 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a6befef6-e295-4a68-aee0-ef1d6d8121f6 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/d963bc87-b838-431c-92c3-8f06dd7afba7" status: 200 len: 1368 microversion: 2.1 time: 1.232302 Oct 27 03:37:32.622525 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1873/3974] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:31 2022] GET /compute/v2.1/servers/d963bc87-b838-431c-92c3-8f06dd7afba7 => generated 1368 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:37:32.663796 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b5227353-2661-4432-b43c-eadb1ccd7377 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-265969914", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "2ae1e1a8-e2cb-4e32-833e-2ed4671f97d0"}, {"port": "190ba0a3-05d8-4eb3-b0ba-354848d76577", "tag": "port-1"}, {"port": "9e919ed7-a3b4-4ea2-bd4e-1bff31a5ba66", "tag": "port-2"}, {"uuid": "2668ce88-6582-4a8d-8173-51e57a88a3b3", "tag": "net-1"}, {"uuid": "2668ce88-6582-4a8d-8173-51e57a88a3b3"}, {"uuid": "245e9b24-7199-4f62-8ce3-9608c2839d97", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "245e9b24-7199-4f62-8ce3-9608c2839d97", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "afbf47de-4e03-45e6-a260-ee1b0ae9c53d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "e6f1bcb8-cb27-4ebd-b469-76f027c7d1f3", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "5a28b444-1ee9-459e-ac15-065f22345abf", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1193238087"}], "key_name": "tempest-keypair-1412355363", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:37:33.089084 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6d6742f4-b939-4cd7-85d5-0e37af40f765 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:33.111856 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6d6742f4-b939-4cd7-85d5-0e37af40f765 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/2d8900c4-92eb-4374-bd63-6d0ebbf407b7" status: 200 len: 1508 microversion: 2.1 time: 0.705353 Oct 27 03:37:33.112811 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2102/3975] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:32 2022] GET /compute/v2.1/servers/2d8900c4-92eb-4374-bd63-6d0ebbf407b7 => generated 1508 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:37:33.542178 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a080ffbe-9388-4a65-be2e-95aab2ff9451 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1791378122", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": [{"uuid": "b1f1f8a3-6579-4551-8baa-e65f1847be2c"}]}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:37:33.731926 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:37:34.132834 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=42 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:37:42.596880 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=37 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:37:42.756290 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=66,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:37:43.095178 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:37:43.566466 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:37:43.642119 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.network.neutron [None req-a080ffbe-9388-4a65-be2e-95aab2ff9451 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] validate_networks() for [('b1f1f8a3-6579-4551-8baa-e65f1847be2c', None, None, None, None, None)] {{(pid=121001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:37:43.743069 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-b5227353-2661-4432-b43c-eadb1ccd7377 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] validate_networks() for [('2ae1e1a8-e2cb-4e32-833e-2ed4671f97d0', None, None, None, None, None), (None, None, '190ba0a3-05d8-4eb3-b0ba-354848d76577', None, None, None), (None, None, '9e919ed7-a3b4-4ea2-bd4e-1bff31a5ba66', None, None, None), ('2668ce88-6582-4a8d-8173-51e57a88a3b3', None, None, None, None, None), ('2668ce88-6582-4a8d-8173-51e57a88a3b3', None, None, None, None, None), ('245e9b24-7199-4f62-8ce3-9608c2839d97', '10.2.2.100', None, None, None, None), ('245e9b24-7199-4f62-8ce3-9608c2839d97', '10.2.2.200', None, None, None, None)] {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:37:44.449868 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-a080ffbe-9388-4a65-be2e-95aab2ff9451 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Flavor limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:37:44.450431 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-a080ffbe-9388-4a65-be2e-95aab2ff9451 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Image limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:37:44.450876 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-a080ffbe-9388-4a65-be2e-95aab2ff9451 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Flavor pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:37:44.451322 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-a080ffbe-9388-4a65-be2e-95aab2ff9451 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Image pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:37:44.452048 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-a080ffbe-9388-4a65-be2e-95aab2ff9451 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:37:44.463339 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a080ffbe-9388-4a65-be2e-95aab2ff9451 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:44.464190 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a080ffbe-9388-4a65-be2e-95aab2ff9451 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:44.464889 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a080ffbe-9388-4a65-be2e-95aab2ff9451 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:44.465956 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a080ffbe-9388-4a65-be2e-95aab2ff9451 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:44.466707 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a080ffbe-9388-4a65-be2e-95aab2ff9451 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:44.467386 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a080ffbe-9388-4a65-be2e-95aab2ff9451 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:44.490798 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-a080ffbe-9388-4a65-be2e-95aab2ff9451 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Getting quotas for project 911997e881754ce390af17919f29b4ab. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:37:44.499161 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-a080ffbe-9388-4a65-be2e-95aab2ff9451 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Getting quotas for user b1cc79af058b4c35b3c572448fac86a7 and project 911997e881754ce390af17919f29b4ab. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:37:44.517660 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a080ffbe-9388-4a65-be2e-95aab2ff9451 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Going to run 1 instances... {{(pid=121001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:37:44.520738 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a080ffbe-9388-4a65-be2e-95aab2ff9451 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 17bdf735-2944-4b40-984c-4646caa855f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:37:44.777943 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a080ffbe-9388-4a65-be2e-95aab2ff9451 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 11.662344 Oct 27 03:37:44.779432 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2103/3976] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:37:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 11666 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 03:37:44.804325 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-858ac074-6c9d-4726-808c-213d9ce4c12f tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:44.804984 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-858ac074-6c9d-4726-808c-213d9ce4c12f tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:44.813498 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-858ac074-6c9d-4726-808c-213d9ce4c12f tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:44.814001 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-858ac074-6c9d-4726-808c-213d9ce4c12f tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:44.814518 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-858ac074-6c9d-4726-808c-213d9ce4c12f tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:44.815214 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-858ac074-6c9d-4726-808c-213d9ce4c12f tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:44.815682 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-858ac074-6c9d-4726-808c-213d9ce4c12f tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:44.816177 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-858ac074-6c9d-4726-808c-213d9ce4c12f tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:45.119188 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-858ac074-6c9d-4726-808c-213d9ce4c12f tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:45.128946 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-858ac074-6c9d-4726-808c-213d9ce4c12f tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1518 microversion: 2.1 time: 0.347455 Oct 27 03:37:45.129781 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2104/3977] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:44 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1518 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:37:45.146428 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1adcb512-f952-430e-b7d2-7eda17dd0b6b tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:45.147093 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1adcb512-f952-430e-b7d2-7eda17dd0b6b tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: d963bc87-b838-431c-92c3-8f06dd7afba7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:45.160884 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1adcb512-f952-430e-b7d2-7eda17dd0b6b tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:45.161484 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1adcb512-f952-430e-b7d2-7eda17dd0b6b tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:45.162058 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1adcb512-f952-430e-b7d2-7eda17dd0b6b tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:45.163177 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1adcb512-f952-430e-b7d2-7eda17dd0b6b tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:45.163994 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1adcb512-f952-430e-b7d2-7eda17dd0b6b tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:45.164688 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1adcb512-f952-430e-b7d2-7eda17dd0b6b tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:45.359696 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1adcb512-f952-430e-b7d2-7eda17dd0b6b tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18036411a99e4634bfbaeae24b9f254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229dcb63bc41444391544883b576ce2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:45.361865 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1adcb512-f952-430e-b7d2-7eda17dd0b6b tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/d963bc87-b838-431c-92c3-8f06dd7afba7" status: 200 len: 1368 microversion: 2.1 time: 0.230653 Oct 27 03:37:45.362724 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2105/3978] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:45 2022] GET /compute/v2.1/servers/d963bc87-b838-431c-92c3-8f06dd7afba7 => generated 1368 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:37:45.368006 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ae07c337-ae18-40bd-9bfa-c3669d4b598e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:45.368900 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ae07c337-ae18-40bd-9bfa-c3669d4b598e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: 2d8900c4-92eb-4374-bd63-6d0ebbf407b7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:45.376090 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ae07c337-ae18-40bd-9bfa-c3669d4b598e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:45.377055 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ae07c337-ae18-40bd-9bfa-c3669d4b598e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:45.377746 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ae07c337-ae18-40bd-9bfa-c3669d4b598e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:45.378607 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ae07c337-ae18-40bd-9bfa-c3669d4b598e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:45.379177 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ae07c337-ae18-40bd-9bfa-c3669d4b598e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:45.379684 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ae07c337-ae18-40bd-9bfa-c3669d4b598e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:45.569771 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ae07c337-ae18-40bd-9bfa-c3669d4b598e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:45.579559 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ae07c337-ae18-40bd-9bfa-c3669d4b598e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/2d8900c4-92eb-4374-bd63-6d0ebbf407b7" status: 200 len: 1508 microversion: 2.1 time: 0.215487 Oct 27 03:37:45.580255 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2106/3979] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:45 2022] GET /compute/v2.1/servers/2d8900c4-92eb-4374-bd63-6d0ebbf407b7 => generated 1508 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:37:45.585337 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-0eddbeed-6b16-4520-8e66-af70938543fd req-f3c8e05d-d2cf-4e2b-95d8-5959f0f21844 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d963bc87-b838-431c-92c3-8f06dd7afba7", "tag": "d76e2f68-c54b-49b5-8391-83058b2b1e64"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:37:45.608353 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-0eddbeed-6b16-4520-8e66-af70938543fd req-f3c8e05d-d2cf-4e2b-95d8-5959f0f21844 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:45.608827 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-0eddbeed-6b16-4520-8e66-af70938543fd req-f3c8e05d-d2cf-4e2b-95d8-5959f0f21844 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:45.609319 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-0eddbeed-6b16-4520-8e66-af70938543fd req-f3c8e05d-d2cf-4e2b-95d8-5959f0f21844 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:45.624261 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-0eddbeed-6b16-4520-8e66-af70938543fd req-f3c8e05d-d2cf-4e2b-95d8-5959f0f21844 service nova] Creating event network-changed:d76e2f68-c54b-49b5-8391-83058b2b1e64 for instance d963bc87-b838-431c-92c3-8f06dd7afba7 on n-h1-862769-1 Oct 27 03:37:45.631149 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-0eddbeed-6b16-4520-8e66-af70938543fd req-f3c8e05d-d2cf-4e2b-95d8-5959f0f21844 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049418 Oct 27 03:37:45.632026 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2107/3980] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:37:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:37:45.891297 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c05b6665-0f80-4075-a4a4-c183631a134c tempest-SecurityGroupRulesNegativeTestJSON-912274608 tempest-SecurityGroupRulesNegativeTestJSON-912274608-project] Action: 'create', calling method: .version_select at 0x7f7dda590280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-168017200", "description": "tempest-description-2061355524"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:37:46.350660 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c05b6665-0f80-4075-a4a4-c183631a134c tempest-SecurityGroupRulesNegativeTestJSON-912274608 tempest-SecurityGroupRulesNegativeTestJSON-912274608-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.717008 Oct 27 03:37:46.351538 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2108/3981] 10.222.0.20 () {60 vars in 1180 bytes} [Thu Oct 27 03:37:45 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:37:46.368151 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-e989e36c-688e-4451-9a40-4aa9ec295c3e req-cfeb31f7-84fc-4d89-bcd7-5101dffcef78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d963bc87-b838-431c-92c3-8f06dd7afba7", "name": "network-vif-plugged", "status": "completed", "tag": "d76e2f68-c54b-49b5-8391-83058b2b1e64"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:37:46.381682 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-e989e36c-688e-4451-9a40-4aa9ec295c3e req-cfeb31f7-84fc-4d89-bcd7-5101dffcef78 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:46.382900 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-e989e36c-688e-4451-9a40-4aa9ec295c3e req-cfeb31f7-84fc-4d89-bcd7-5101dffcef78 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:46.383405 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-e989e36c-688e-4451-9a40-4aa9ec295c3e req-cfeb31f7-84fc-4d89-bcd7-5101dffcef78 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:46.396632 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-e989e36c-688e-4451-9a40-4aa9ec295c3e req-cfeb31f7-84fc-4d89-bcd7-5101dffcef78 service nova] Creating event network-vif-plugged:d76e2f68-c54b-49b5-8391-83058b2b1e64 for instance d963bc87-b838-431c-92c3-8f06dd7afba7 on n-h1-862769-1 Oct 27 03:37:46.406148 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-e989e36c-688e-4451-9a40-4aa9ec295c3e req-cfeb31f7-84fc-4d89-bcd7-5101dffcef78 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040815 Oct 27 03:37:46.406148 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2109/3982] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:37:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:37:46.411081 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-78dc2557-0181-43fe-a33d-f77a47bcea2e tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:46.412117 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-78dc2557-0181-43fe-a33d-f77a47bcea2e tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 17bdf735-2944-4b40-984c-4646caa855f0] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:46.507258 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-78dc2557-0181-43fe-a33d-f77a47bcea2e tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:46.518391 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-78dc2557-0181-43fe-a33d-f77a47bcea2e tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/17bdf735-2944-4b40-984c-4646caa855f0" status: 200 len: 1215 microversion: 2.1 time: 0.111482 Oct 27 03:37:46.519289 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2110/3983] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:46 2022] GET /compute/v2.1/servers/17bdf735-2944-4b40-984c-4646caa855f0 => generated 1215 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:37:46.524499 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-399710d4-34c3-444e-afb8-25fe1468a0d9 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:46.525784 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-399710d4-34c3-444e-afb8-25fe1468a0d9 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:46.539129 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-399710d4-34c3-444e-afb8-25fe1468a0d9 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:46.540218 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-399710d4-34c3-444e-afb8-25fe1468a0d9 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:46.540741 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-399710d4-34c3-444e-afb8-25fe1468a0d9 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:46.541902 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-399710d4-34c3-444e-afb8-25fe1468a0d9 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:46.542680 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-399710d4-34c3-444e-afb8-25fe1468a0d9 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:46.543375 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-399710d4-34c3-444e-afb8-25fe1468a0d9 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:46.742192 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-399710d4-34c3-444e-afb8-25fe1468a0d9 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:46.752965 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-399710d4-34c3-444e-afb8-25fe1468a0d9 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1518 microversion: 2.1 time: 0.232181 Oct 27 03:37:46.753904 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2111/3984] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:46 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1518 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:37:46.760161 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2d36baa5-4acd-4943-9ce1-ee0230d1428c tempest-SecurityGroupRulesNegativeTestJSON-912274608 tempest-SecurityGroupRulesNegativeTestJSON-912274608-project] Action: 'create', calling method: .version_select at 0x7f7dd9d559d0>, body: {"security_group_rule": {"parent_group_id": "ad235dec-d20a-49b3-83e0-3698142993da", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:37:47.238007 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2d36baa5-4acd-4943-9ce1-ee0230d1428c tempest-SecurityGroupRulesNegativeTestJSON-912274608 tempest-SecurityGroupRulesNegativeTestJSON-912274608-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.479890 Oct 27 03:37:47.238007 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2112/3985] 10.222.0.20 () {60 vars in 1195 bytes} [Thu Oct 27 03:37:46 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:37:47.247202 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7265a4ce-72c5-45ea-b287-b72a23cfcb1f tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:47.247797 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7265a4ce-72c5-45ea-b287-b72a23cfcb1f tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: d963bc87-b838-431c-92c3-8f06dd7afba7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:47.256928 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7265a4ce-72c5-45ea-b287-b72a23cfcb1f tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:47.264223 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7265a4ce-72c5-45ea-b287-b72a23cfcb1f tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:47.264698 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7265a4ce-72c5-45ea-b287-b72a23cfcb1f tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:47.265671 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7265a4ce-72c5-45ea-b287-b72a23cfcb1f tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:47.266366 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7265a4ce-72c5-45ea-b287-b72a23cfcb1f tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:47.267162 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7265a4ce-72c5-45ea-b287-b72a23cfcb1f tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:47.428907 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7265a4ce-72c5-45ea-b287-b72a23cfcb1f tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18036411a99e4634bfbaeae24b9f254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229dcb63bc41444391544883b576ce2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:47.439301 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7265a4ce-72c5-45ea-b287-b72a23cfcb1f tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/d963bc87-b838-431c-92c3-8f06dd7afba7" status: 200 len: 1368 microversion: 2.1 time: 0.201448 Oct 27 03:37:47.453201 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2113/3986] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:47 2022] GET /compute/v2.1/servers/d963bc87-b838-431c-92c3-8f06dd7afba7 => generated 1368 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:37:47.453201 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0c204eae-50db-4131-b638-41478a0479b5 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:47.453201 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0c204eae-50db-4131-b638-41478a0479b5 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: 2d8900c4-92eb-4374-bd63-6d0ebbf407b7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:47.462119 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0c204eae-50db-4131-b638-41478a0479b5 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:47.462635 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0c204eae-50db-4131-b638-41478a0479b5 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:47.466508 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0c204eae-50db-4131-b638-41478a0479b5 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:47.467942 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0c204eae-50db-4131-b638-41478a0479b5 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:47.468191 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0c204eae-50db-4131-b638-41478a0479b5 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:47.468637 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0c204eae-50db-4131-b638-41478a0479b5 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:47.674735 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0c204eae-50db-4131-b638-41478a0479b5 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:47.685447 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0c204eae-50db-4131-b638-41478a0479b5 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/2d8900c4-92eb-4374-bd63-6d0ebbf407b7" status: 200 len: 1505 microversion: 2.1 time: 0.243911 Oct 27 03:37:47.707707 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2114/3987] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:47 2022] GET /compute/v2.1/servers/2d8900c4-92eb-4374-bd63-6d0ebbf407b7 => generated 1505 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:37:47.716191 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3dbd0f74-1e94-4549-a724-b960bc6a40a7 tempest-SecurityGroupRulesNegativeTestJSON-912274608 tempest-SecurityGroupRulesNegativeTestJSON-912274608-project] Action: 'create', calling method: .version_select at 0x7f7dd9d559d0>, body: {"security_group_rule": {"parent_group_id": "ad235dec-d20a-49b3-83e0-3698142993da", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:37:47.849256 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-3dbd0f74-1e94-4549-a724-b960bc6a40a7 tempest-SecurityGroupRulesNegativeTestJSON-912274608 tempest-SecurityGroupRulesNegativeTestJSON-912274608-project] HTTP exception thrown: This rule already exists in group ad235dec-d20a-49b3-83e0-3698142993da Oct 27 03:37:47.851005 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3dbd0f74-1e94-4549-a724-b960bc6a40a7 tempest-SecurityGroupRulesNegativeTestJSON-912274608 tempest-SecurityGroupRulesNegativeTestJSON-912274608-project] Request method failure captured: Oct 27 03:37:47.851005 n-d-862769-1 devstack@n-api.service[121001]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 27 03:37:47.851005 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:37:47.851005 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:37:47.851005 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:37:47.851005 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 138 Oct 27 03:37:47.851005 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:37:47.851005 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:37:47.851005 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:37:47.851005 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:37:47.851005 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWf0C0EOecmyXIjI0mIbxm9OmM5e99cJTKTDmYm2Y90TBW3x1ZQJKrhE56xLOKh6WNvhGmoubByAWz9FxJaReoFbR2rjtgUECjWtOu_AWAk31mBxI8t5omUqYbUvEADlUhcungVw26cYsWVJNUaosfYD1hHQOoaXzpzRlG0pv1I_b1VE Oct 27 03:37:47.851005 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:37:47.851005 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:37:47.851005 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:37:47.851005 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:37:47.851005 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:37:47.851005 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:37:47.851005 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 3ab3d7ec4d294c8fbbb0c19559accba1 Oct 27 03:37:47.851005 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-912274608 Oct 27 03:37:47.851005 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:37:47.851005 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:37:47.851005 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3ab3d7ec4d294c8fbbb0c19559accba1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3ab3d7ec4d294c8fbbb0c19559accba1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3ab3d7ec4d294c8fbbb0c19559accba1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3ab3d7ec4d294c8fbbb0c19559accba1"}]}] Oct 27 03:37:47.851005 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-912274608 Oct 27 03:37:47.851005 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 3ab3d7ec4d294c8fbbb0c19559accba1 Oct 27 03:37:47.851005 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-912274608 Oct 27 03:37:47.851005 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-912274608-project Oct 27 03:37:47.851005 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:37:47.851005 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:37:47.851005 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: cbfbad32b0c64e98a852e16cc3acd654 Oct 27 03:37:47.851005 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-912274608-project Oct 27 03:37:47.851005 n-d-862769-1 devstack@n-api.service[121001]: Oct 27 03:37:47.851005 n-d-862769-1 devstack@n-api.service[121001]: {"security_group_rule": {"parent_group_id": "ad235dec-d20a-49b3-83e0-3698142993da", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 27 03:37:47.851005 n-d-862769-1 devstack@n-api.service[121001]: method: Oct 27 03:37:47.851005 n-d-862769-1 devstack@n-api.service[121001]: exception: This rule already exists in group ad235dec-d20a-49b3-83e0-3698142993da Oct 27 03:37:47.851005 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'ad235dec-d20a-49b3-83e0-3698142993da', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 27 03:37:47.851005 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:37:47.851005 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:37:47.851005 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Oct 27 03:37:47.851005 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Oct 27 03:37:47.851005 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Oct 27 03:37:47.851005 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 27 03:37:47.851005 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group ad235dec-d20a-49b3-83e0-3698142993da Oct 27 03:37:47.851005 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:37:47.851005 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:37:47.851005 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:37:47.851005 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:37:47.851005 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:37:47.851005 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:37:47.851005 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:37:47.851005 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:37:47.851005 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:37:47.851005 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:37:47.851005 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:37:47.851005 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:37:47.851005 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Oct 27 03:37:47.851005 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 27 03:37:47.851005 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group ad235dec-d20a-49b3-83e0-3698142993da Oct 27 03:37:47.851005 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:37:47.851005 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:37:47.851005 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:37:47.851005 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:37:47.851005 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:37:47.851005 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:37:47.866513 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:37:47.866513 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:37:47.866513 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group ad235dec-d20a-49b3-83e0-3698142993da Oct 27 03:37:47.866513 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:37:47.866513 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3dbd0f74-1e94-4549-a724-b960bc6a40a7 tempest-SecurityGroupRulesNegativeTestJSON-912274608 tempest-SecurityGroupRulesNegativeTestJSON-912274608-project] Returning 400 to user: This rule already exists in group ad235dec-d20a-49b3-83e0-3698142993da {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:37:47.866513 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3dbd0f74-1e94-4549-a724-b960bc6a40a7 tempest-SecurityGroupRulesNegativeTestJSON-912274608 tempest-SecurityGroupRulesNegativeTestJSON-912274608-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.142088 Oct 27 03:37:47.866513 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2115/3988] 10.222.0.20 () {60 vars in 1195 bytes} [Thu Oct 27 03:37:47 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 143 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 03:37:47.866513 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1a7d3354-c4db-46f6-a7aa-a4cea6aae564 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:47.866513 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1a7d3354-c4db-46f6-a7aa-a4cea6aae564 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 17bdf735-2944-4b40-984c-4646caa855f0] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:47.877803 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1a7d3354-c4db-46f6-a7aa-a4cea6aae564 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:47.879996 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1a7d3354-c4db-46f6-a7aa-a4cea6aae564 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:47.879996 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1a7d3354-c4db-46f6-a7aa-a4cea6aae564 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:47.880660 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1a7d3354-c4db-46f6-a7aa-a4cea6aae564 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:47.885731 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1a7d3354-c4db-46f6-a7aa-a4cea6aae564 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:47.886675 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1a7d3354-c4db-46f6-a7aa-a4cea6aae564 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:47.978324 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1a7d3354-c4db-46f6-a7aa-a4cea6aae564 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:47.986682 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1a7d3354-c4db-46f6-a7aa-a4cea6aae564 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/17bdf735-2944-4b40-984c-4646caa855f0" status: 200 len: 1267 microversion: 2.1 time: 0.132507 Oct 27 03:37:47.987283 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2116/3989] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:47 2022] GET /compute/v2.1/servers/17bdf735-2944-4b40-984c-4646caa855f0 => generated 1267 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:37:47.992665 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6b963f5e-a154-48a0-a2f3-c492d51dddb2 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:47.993578 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-6b963f5e-a154-48a0-a2f3-c492d51dddb2 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:48.005123 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6b963f5e-a154-48a0-a2f3-c492d51dddb2 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:48.005873 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6b963f5e-a154-48a0-a2f3-c492d51dddb2 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:48.006564 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6b963f5e-a154-48a0-a2f3-c492d51dddb2 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:48.007317 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6b963f5e-a154-48a0-a2f3-c492d51dddb2 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:48.008171 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6b963f5e-a154-48a0-a2f3-c492d51dddb2 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:48.008865 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6b963f5e-a154-48a0-a2f3-c492d51dddb2 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:48.236749 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6b963f5e-a154-48a0-a2f3-c492d51dddb2 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:48.246517 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6b963f5e-a154-48a0-a2f3-c492d51dddb2 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1518 microversion: 2.1 time: 0.257627 Oct 27 03:37:48.250177 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2117/3990] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:47 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1518 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:37:48.254323 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-19f48226-a7d7-44f0-9f4d-b7e8ace6c494 tempest-SecurityGroupRulesNegativeTestJSON-912274608 tempest-SecurityGroupRulesNegativeTestJSON-912274608-project] Calling method '.version_select at 0x7f7dda50e8b0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:48.572615 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-19f48226-a7d7-44f0-9f4d-b7e8ace6c494 tempest-SecurityGroupRulesNegativeTestJSON-912274608 tempest-SecurityGroupRulesNegativeTestJSON-912274608-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-group-rules/e542ba8e-c687-46bc-a5fb-4ee3d08cc350" status: 202 len: 0 microversion: 2.1 time: 0.323625 Oct 27 03:37:48.573557 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2118/3991] 10.222.0.20 () {58 vars in 1287 bytes} [Thu Oct 27 03:37:48 2022] DELETE /compute/v2.1/os-security-group-rules/e542ba8e-c687-46bc-a5fb-4ee3d08cc350 => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:37:48.583734 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-7a63a7ae-ae5e-469e-b0bd-6c74d372a51b req-27f26cf0-8fed-49f0-abdc-f2d1ca69b0b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "376ac459-e31f-4727-9e34-535f055ac20d", "name": "network-vif-plugged", "status": "completed", "tag": "e825dd69-54a1-4411-addc-e78fd04434d2"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:37:48.615957 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-7a63a7ae-ae5e-469e-b0bd-6c74d372a51b req-27f26cf0-8fed-49f0-abdc-f2d1ca69b0b2 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:48.616866 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-7a63a7ae-ae5e-469e-b0bd-6c74d372a51b req-27f26cf0-8fed-49f0-abdc-f2d1ca69b0b2 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:48.617735 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-7a63a7ae-ae5e-469e-b0bd-6c74d372a51b req-27f26cf0-8fed-49f0-abdc-f2d1ca69b0b2 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:48.642600 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-7a63a7ae-ae5e-469e-b0bd-6c74d372a51b req-27f26cf0-8fed-49f0-abdc-f2d1ca69b0b2 service nova] Creating event network-vif-plugged:e825dd69-54a1-4411-addc-e78fd04434d2 for instance 376ac459-e31f-4727-9e34-535f055ac20d on n-h1-862769-1 Oct 27 03:37:48.651265 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-7a63a7ae-ae5e-469e-b0bd-6c74d372a51b req-27f26cf0-8fed-49f0-abdc-f2d1ca69b0b2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074744 Oct 27 03:37:48.652587 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2119/3992] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:37:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:37:48.678289 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-b5227353-2661-4432-b43c-eadb1ccd7377 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:37:48.680042 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2dd1acd1-4b75-4b50-b63c-2291f246c298 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:48.681362 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2dd1acd1-4b75-4b50-b63c-2291f246c298 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: d963bc87-b838-431c-92c3-8f06dd7afba7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:48.684769 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-b5227353-2661-4432-b43c-eadb1ccd7377 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:37:48.685928 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-b5227353-2661-4432-b43c-eadb1ccd7377 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:37:48.685928 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-b5227353-2661-4432-b43c-eadb1ccd7377 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:37:48.686277 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-b5227353-2661-4432-b43c-eadb1ccd7377 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:37:48.691325 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2dd1acd1-4b75-4b50-b63c-2291f246c298 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:48.691825 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2dd1acd1-4b75-4b50-b63c-2291f246c298 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:48.692354 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2dd1acd1-4b75-4b50-b63c-2291f246c298 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:48.693128 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2dd1acd1-4b75-4b50-b63c-2291f246c298 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:48.693780 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2dd1acd1-4b75-4b50-b63c-2291f246c298 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:48.694478 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2dd1acd1-4b75-4b50-b63c-2291f246c298 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:48.717069 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b5227353-2661-4432-b43c-eadb1ccd7377 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:48.717706 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b5227353-2661-4432-b43c-eadb1ccd7377 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:48.718206 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b5227353-2661-4432-b43c-eadb1ccd7377 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:48.719138 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b5227353-2661-4432-b43c-eadb1ccd7377 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:48.719596 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b5227353-2661-4432-b43c-eadb1ccd7377 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:48.722336 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b5227353-2661-4432-b43c-eadb1ccd7377 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:48.770497 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-b5227353-2661-4432-b43c-eadb1ccd7377 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Getting quotas for project 1ec987ba67f94da4bbdadc3835e56d7d. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:37:48.777653 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-b5227353-2661-4432-b43c-eadb1ccd7377 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Getting quotas for user 88497702ee824799952e4bcd583ee367 and project 1ec987ba67f94da4bbdadc3835e56d7d. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:37:48.902770 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2dd1acd1-4b75-4b50-b63c-2291f246c298 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18036411a99e4634bfbaeae24b9f254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229dcb63bc41444391544883b576ce2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:48.914295 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2dd1acd1-4b75-4b50-b63c-2291f246c298 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/d963bc87-b838-431c-92c3-8f06dd7afba7" status: 200 len: 1558 microversion: 2.1 time: 0.260136 Oct 27 03:37:48.916654 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2120/3993] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:48 2022] GET /compute/v2.1/servers/d963bc87-b838-431c-92c3-8f06dd7afba7 => generated 1558 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:37:48.927999 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7062c8d0-2cea-489e-bb41-6668e8b5996f tempest-SecurityGroupRulesNegativeTestJSON-912274608 tempest-SecurityGroupRulesNegativeTestJSON-912274608-project] Action: 'create', calling method: .version_select at 0x7f7ddac48790>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-79513175", "description": "tempest-description-1083629612"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:37:48.992307 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b5227353-2661-4432-b43c-eadb1ccd7377 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:37:48.992307 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b5227353-2661-4432-b43c-eadb1ccd7377 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] [instance: 7e73d534-0a40-42d2-813c-2e9dbb9239ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='afbf47de-4e03-45e6-a260-ee1b0ae9c53d',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='e6f1bcb8-cb27-4ebd-b469-76f027c7d1f3',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5a28b444-1ee9-459e-ac15-065f22345abf',volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:37:49.384833 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7062c8d0-2cea-489e-bb41-6668e8b5996f tempest-SecurityGroupRulesNegativeTestJSON-912274608 tempest-SecurityGroupRulesNegativeTestJSON-912274608-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.466848 Oct 27 03:37:49.385768 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2121/3994] 10.222.0.20 () {60 vars in 1180 bytes} [Thu Oct 27 03:37:48 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:37:49.390839 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7c03c628-faa3-40b0-b592-b58c986f4231 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:49.391793 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7c03c628-faa3-40b0-b592-b58c986f4231 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: 2d8900c4-92eb-4374-bd63-6d0ebbf407b7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:49.398399 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7c03c628-faa3-40b0-b592-b58c986f4231 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:49.398979 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7c03c628-faa3-40b0-b592-b58c986f4231 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:49.399511 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7c03c628-faa3-40b0-b592-b58c986f4231 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:49.400499 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7c03c628-faa3-40b0-b592-b58c986f4231 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:49.400961 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7c03c628-faa3-40b0-b592-b58c986f4231 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:49.401591 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7c03c628-faa3-40b0-b592-b58c986f4231 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:49.543690 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7c03c628-faa3-40b0-b592-b58c986f4231 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:49.552152 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7c03c628-faa3-40b0-b592-b58c986f4231 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/2d8900c4-92eb-4374-bd63-6d0ebbf407b7" status: 200 len: 1505 microversion: 2.1 time: 0.164973 Oct 27 03:37:49.552745 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2122/3995] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:49 2022] GET /compute/v2.1/servers/2d8900c4-92eb-4374-bd63-6d0ebbf407b7 => generated 1505 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:37:49.557744 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c68488c5-1ddc-4565-89f2-181a9a107833 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:49.563763 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c68488c5-1ddc-4565-89f2-181a9a107833 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: d963bc87-b838-431c-92c3-8f06dd7afba7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:49.565188 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c68488c5-1ddc-4565-89f2-181a9a107833 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:49.565691 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c68488c5-1ddc-4565-89f2-181a9a107833 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:49.566170 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c68488c5-1ddc-4565-89f2-181a9a107833 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:49.566883 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c68488c5-1ddc-4565-89f2-181a9a107833 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:49.567351 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c68488c5-1ddc-4565-89f2-181a9a107833 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:49.567788 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c68488c5-1ddc-4565-89f2-181a9a107833 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:49.653181 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c68488c5-1ddc-4565-89f2-181a9a107833 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/d963bc87-b838-431c-92c3-8f06dd7afba7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.098469 Oct 27 03:37:49.653986 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2123/3996] 10.222.0.20 () {58 vars in 1275 bytes} [Thu Oct 27 03:37:49 2022] GET /compute/v2.1/servers/d963bc87-b838-431c-92c3-8f06dd7afba7/os-interface => generated 285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:37:49.660137 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ebb20709-0f2f-425a-8177-04dc00d63d33 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:49.667404 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ebb20709-0f2f-425a-8177-04dc00d63d33 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 17bdf735-2944-4b40-984c-4646caa855f0] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:49.668139 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ebb20709-0f2f-425a-8177-04dc00d63d33 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:49.668638 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ebb20709-0f2f-425a-8177-04dc00d63d33 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:49.669063 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ebb20709-0f2f-425a-8177-04dc00d63d33 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:49.669774 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ebb20709-0f2f-425a-8177-04dc00d63d33 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:49.670443 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ebb20709-0f2f-425a-8177-04dc00d63d33 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:49.671117 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ebb20709-0f2f-425a-8177-04dc00d63d33 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:49.784644 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ebb20709-0f2f-425a-8177-04dc00d63d33 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:49.792700 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ebb20709-0f2f-425a-8177-04dc00d63d33 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/17bdf735-2944-4b40-984c-4646caa855f0" status: 200 len: 1285 microversion: 2.1 time: 0.137633 Oct 27 03:37:49.796067 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2124/3997] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:49 2022] GET /compute/v2.1/servers/17bdf735-2944-4b40-984c-4646caa855f0 => generated 1285 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:37:49.797848 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5b542bed-c94d-4b98-911b-4a40aed954dd tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:49.798752 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5b542bed-c94d-4b98-911b-4a40aed954dd tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:49.805507 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5b542bed-c94d-4b98-911b-4a40aed954dd tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:49.806306 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5b542bed-c94d-4b98-911b-4a40aed954dd tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:49.807026 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5b542bed-c94d-4b98-911b-4a40aed954dd tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:49.807968 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5b542bed-c94d-4b98-911b-4a40aed954dd tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:49.809891 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5b542bed-c94d-4b98-911b-4a40aed954dd tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:49.810565 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5b542bed-c94d-4b98-911b-4a40aed954dd tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:50.024629 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5b542bed-c94d-4b98-911b-4a40aed954dd tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:50.039436 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5b542bed-c94d-4b98-911b-4a40aed954dd tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1518 microversion: 2.1 time: 0.244948 Oct 27 03:37:50.054061 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2125/3998] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:49 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1518 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:37:50.057372 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d28e0a67-6f5c-4fb4-b3ce-7d307ebec663 tempest-SecurityGroupRulesNegativeTestJSON-912274608 tempest-SecurityGroupRulesNegativeTestJSON-912274608-project] Action: 'create', calling method: .version_select at 0x7f7ddec288b0>, body: {"security_group_rule": {"parent_group_id": "96a0f6a8-67b0-44f9-a699-9c1dc9613cda", "ip_protocol": "tcp", "from_port": 2141171314, "to_port": 22}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:37:50.187854 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-d28e0a67-6f5c-4fb4-b3ce-7d307ebec663 tempest-SecurityGroupRulesNegativeTestJSON-912274608 tempest-SecurityGroupRulesNegativeTestJSON-912274608-project] HTTP exception thrown: Invalid port range 2141171314:22. Former value cannot be greater than the later Oct 27 03:37:50.189683 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d28e0a67-6f5c-4fb4-b3ce-7d307ebec663 tempest-SecurityGroupRulesNegativeTestJSON-912274608 tempest-SecurityGroupRulesNegativeTestJSON-912274608-project] Request method failure captured: Oct 27 03:37:50.189683 n-d-862769-1 devstack@n-api.service[121001]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 27 03:37:50.189683 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:37:50.189683 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:37:50.189683 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:37:50.189683 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 146 Oct 27 03:37:50.189683 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:37:50.189683 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:37:50.189683 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:37:50.189683 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:37:50.189683 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWf0C0EOecmyXIjI0mIbxm9OmM5e99cJTKTDmYm2Y90TBW3x1ZQJKrhE56xLOKh6WNvhGmoubByAWz9FxJaReoFbR2rjtgUECjWtOu_AWAk31mBxI8t5omUqYbUvEADlUhcungVw26cYsWVJNUaosfYD1hHQOoaXzpzRlG0pv1I_b1VE Oct 27 03:37:50.189683 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:37:50.189683 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:37:50.189683 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:37:50.189683 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:37:50.189683 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:37:50.189683 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:37:50.189683 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 3ab3d7ec4d294c8fbbb0c19559accba1 Oct 27 03:37:50.189683 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-912274608 Oct 27 03:37:50.189683 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:37:50.189683 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:37:50.189683 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3ab3d7ec4d294c8fbbb0c19559accba1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3ab3d7ec4d294c8fbbb0c19559accba1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3ab3d7ec4d294c8fbbb0c19559accba1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3ab3d7ec4d294c8fbbb0c19559accba1"}]}] Oct 27 03:37:50.189683 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-912274608 Oct 27 03:37:50.189683 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 3ab3d7ec4d294c8fbbb0c19559accba1 Oct 27 03:37:50.189683 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-912274608 Oct 27 03:37:50.189683 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-912274608-project Oct 27 03:37:50.189683 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:37:50.189683 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:37:50.189683 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: cbfbad32b0c64e98a852e16cc3acd654 Oct 27 03:37:50.189683 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-912274608-project Oct 27 03:37:50.189683 n-d-862769-1 devstack@n-api.service[121001]: Oct 27 03:37:50.189683 n-d-862769-1 devstack@n-api.service[121001]: {"security_group_rule": {"parent_group_id": "96a0f6a8-67b0-44f9-a699-9c1dc9613cda", "ip_protocol": "tcp", "from_port": 2141171314, "to_port": 22}} Oct 27 03:37:50.189683 n-d-862769-1 devstack@n-api.service[121001]: method: Oct 27 03:37:50.189683 n-d-862769-1 devstack@n-api.service[121001]: exception: Invalid port range 2141171314:22. Former value cannot be greater than the later Oct 27 03:37:50.189683 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'body': {'security_group_rule': {'parent_group_id': '96a0f6a8-67b0-44f9-a699-9c1dc9613cda', 'ip_protocol': 'tcp', 'from_port': 2141171314, 'to_port': 22}}} Oct 27 03:37:50.189683 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:37:50.189683 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:37:50.189683 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 27 03:37:50.189683 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 27 03:37:50.189683 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 27 03:37:50.189683 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 27 03:37:50.189683 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 27 03:37:50.189683 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 27 03:37:50.189683 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 27 03:37:50.189683 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 27 03:37:50.189683 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 2141171314:22. Former value cannot be greater than the later Oct 27 03:37:50.189683 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:37:50.189683 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:37:50.189683 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:37:50.189683 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:37:50.189683 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:37:50.189683 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:37:50.189683 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:37:50.189683 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:37:50.189683 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:37:50.189683 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:37:50.189683 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:37:50.189683 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:37:50.189683 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 27 03:37:50.189683 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 27 03:37:50.189683 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 2141171314:22. Former value cannot be greater than the later Oct 27 03:37:50.189683 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:37:50.194193 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:37:50.194193 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:37:50.194193 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:37:50.194193 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:37:50.194193 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:37:50.194193 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:37:50.194193 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:37:50.194193 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 2141171314:22. Former value cannot be greater than the later Oct 27 03:37:50.194193 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:37:50.194193 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d28e0a67-6f5c-4fb4-b3ce-7d307ebec663 tempest-SecurityGroupRulesNegativeTestJSON-912274608 tempest-SecurityGroupRulesNegativeTestJSON-912274608-project] Returning 400 to user: Invalid port range 2141171314:22. Former value cannot be greater than the later {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:37:50.194193 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d28e0a67-6f5c-4fb4-b3ce-7d307ebec663 tempest-SecurityGroupRulesNegativeTestJSON-912274608 tempest-SecurityGroupRulesNegativeTestJSON-912274608-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.142189 Oct 27 03:37:50.197841 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2126/3999] 10.222.0.20 () {60 vars in 1195 bytes} [Thu Oct 27 03:37:50 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 150 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 03:37:50.207582 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d07c6431-3388-4ff7-afb9-8ade17145b86 tempest-SecurityGroupRulesNegativeTestJSON-912274608 tempest-SecurityGroupRulesNegativeTestJSON-912274608-project] Action: 'create', calling method: .version_select at 0x7f7dd9d55dc0>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1266123892", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:37:50.209683 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-d07c6431-3388-4ff7-afb9-8ade17145b86 tempest-SecurityGroupRulesNegativeTestJSON-912274608 tempest-SecurityGroupRulesNegativeTestJSON-912274608-project] HTTP exception thrown: Security group id should be uuid Oct 27 03:37:50.211195 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d07c6431-3388-4ff7-afb9-8ade17145b86 tempest-SecurityGroupRulesNegativeTestJSON-912274608 tempest-SecurityGroupRulesNegativeTestJSON-912274608-project] Request method failure captured: Oct 27 03:37:50.211195 n-d-862769-1 devstack@n-api.service[121001]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 27 03:37:50.211195 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:37:50.211195 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:37:50.211195 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:37:50.211195 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 131 Oct 27 03:37:50.211195 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:37:50.211195 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:37:50.211195 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:37:50.211195 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:37:50.211195 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWf0C0EOecmyXIjI0mIbxm9OmM5e99cJTKTDmYm2Y90TBW3x1ZQJKrhE56xLOKh6WNvhGmoubByAWz9FxJaReoFbR2rjtgUECjWtOu_AWAk31mBxI8t5omUqYbUvEADlUhcungVw26cYsWVJNUaosfYD1hHQOoaXzpzRlG0pv1I_b1VE Oct 27 03:37:50.211195 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:37:50.211195 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:37:50.211195 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:37:50.211195 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:37:50.211195 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:37:50.211195 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:37:50.211195 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 3ab3d7ec4d294c8fbbb0c19559accba1 Oct 27 03:37:50.211195 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-912274608 Oct 27 03:37:50.211195 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:37:50.211195 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:37:50.211195 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3ab3d7ec4d294c8fbbb0c19559accba1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3ab3d7ec4d294c8fbbb0c19559accba1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3ab3d7ec4d294c8fbbb0c19559accba1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3ab3d7ec4d294c8fbbb0c19559accba1"}]}] Oct 27 03:37:50.211195 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-912274608 Oct 27 03:37:50.211195 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 3ab3d7ec4d294c8fbbb0c19559accba1 Oct 27 03:37:50.211195 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-912274608 Oct 27 03:37:50.211195 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-912274608-project Oct 27 03:37:50.211195 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:37:50.211195 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:37:50.211195 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: cbfbad32b0c64e98a852e16cc3acd654 Oct 27 03:37:50.211195 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-912274608-project Oct 27 03:37:50.211195 n-d-862769-1 devstack@n-api.service[121001]: Oct 27 03:37:50.211195 n-d-862769-1 devstack@n-api.service[121001]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1266123892", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 27 03:37:50.211195 n-d-862769-1 devstack@n-api.service[121001]: method: Oct 27 03:37:50.211195 n-d-862769-1 devstack@n-api.service[121001]: exception: Security group id should be uuid Oct 27 03:37:50.211195 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-1266123892', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 27 03:37:50.211195 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:37:50.211195 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:37:50.211195 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Oct 27 03:37:50.211195 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Oct 27 03:37:50.211195 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Oct 27 03:37:50.211195 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 27 03:37:50.211195 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Oct 27 03:37:50.211195 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:37:50.211195 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:37:50.211195 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:37:50.211195 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:37:50.211195 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:37:50.211195 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:37:50.211195 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:37:50.211195 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:37:50.211195 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:37:50.211195 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:37:50.211195 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:37:50.211195 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:37:50.211195 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 27 03:37:50.211195 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 27 03:37:50.211195 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Oct 27 03:37:50.211195 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:37:50.211195 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:37:50.211195 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:37:50.211195 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:37:50.211195 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:37:50.211195 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:37:50.211195 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:37:50.211195 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:37:50.218208 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Oct 27 03:37:50.218208 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:37:50.218208 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d07c6431-3388-4ff7-afb9-8ade17145b86 tempest-SecurityGroupRulesNegativeTestJSON-912274608 tempest-SecurityGroupRulesNegativeTestJSON-912274608-project] Returning 400 to user: Security group id should be uuid {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:37:50.218208 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d07c6431-3388-4ff7-afb9-8ade17145b86 tempest-SecurityGroupRulesNegativeTestJSON-912274608 tempest-SecurityGroupRulesNegativeTestJSON-912274608-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.015511 Oct 27 03:37:50.235162 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2127/4000] 10.222.0.20 () {60 vars in 1195 bytes} [Thu Oct 27 03:37:50 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 27 03:37:50.238450 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0d1e4181-2d87-4796-b1e6-0ad6ad1c6b36 tempest-SecurityGroupRulesNegativeTestJSON-912274608 tempest-SecurityGroupRulesNegativeTestJSON-912274608-project] Action: 'create', calling method: .version_select at 0x7f7dda495c10>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1285784893", "description": "tempest-description-856493501"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:37:50.301264 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b5227353-2661-4432-b43c-eadb1ccd7377 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 17.683602 Oct 27 03:37:50.304282 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1874/4001] 10.222.0.20 () {62 vars in 1189 bytes} [Thu Oct 27 03:37:32 2022] POST /compute/v2.1/servers => generated 406 bytes in 17690 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 27 03:37:50.326760 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-cbf733a7-71b7-438e-9c14-d15d8afc4d11 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:50.327426 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-cbf733a7-71b7-438e-9c14-d15d8afc4d11 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] [instance: 7e73d534-0a40-42d2-813c-2e9dbb9239ac] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:50.461745 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-cbf733a7-71b7-438e-9c14-d15d8afc4d11 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:50.473089 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-cbf733a7-71b7-438e-9c14-d15d8afc4d11 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:50.474915 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-cbf733a7-71b7-438e-9c14-d15d8afc4d11 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:50.476681 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-cbf733a7-71b7-438e-9c14-d15d8afc4d11 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] 10.222.0.20 "GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac" status: 200 len: 1285 microversion: 2.32 time: 0.163225 Oct 27 03:37:50.477447 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1875/4002] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:37:50 2022] GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac => generated 1285 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:37:50.575870 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9d2f9fd4-79a8-43a5-a656-7464b37c2ae7 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:50.576817 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9d2f9fd4-79a8-43a5-a656-7464b37c2ae7 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: 2d8900c4-92eb-4374-bd63-6d0ebbf407b7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:50.585746 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9d2f9fd4-79a8-43a5-a656-7464b37c2ae7 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:50.586943 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9d2f9fd4-79a8-43a5-a656-7464b37c2ae7 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:50.590068 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9d2f9fd4-79a8-43a5-a656-7464b37c2ae7 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:50.591673 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9d2f9fd4-79a8-43a5-a656-7464b37c2ae7 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:50.593384 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9d2f9fd4-79a8-43a5-a656-7464b37c2ae7 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:50.595275 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9d2f9fd4-79a8-43a5-a656-7464b37c2ae7 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:50.854413 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9d2f9fd4-79a8-43a5-a656-7464b37c2ae7 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:50.867120 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9d2f9fd4-79a8-43a5-a656-7464b37c2ae7 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/2d8900c4-92eb-4374-bd63-6d0ebbf407b7" status: 200 len: 1505 microversion: 2.1 time: 0.295058 Oct 27 03:37:50.867728 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1876/4003] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:50 2022] GET /compute/v2.1/servers/2d8900c4-92eb-4374-bd63-6d0ebbf407b7 => generated 1505 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:37:50.879170 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9da43955-e0cb-458d-b731-ed21ebb4a705 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:50.881749 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9da43955-e0cb-458d-b731-ed21ebb4a705 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 17bdf735-2944-4b40-984c-4646caa855f0] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:50.892175 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9da43955-e0cb-458d-b731-ed21ebb4a705 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:50.892915 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9da43955-e0cb-458d-b731-ed21ebb4a705 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:50.893551 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9da43955-e0cb-458d-b731-ed21ebb4a705 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:50.894491 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9da43955-e0cb-458d-b731-ed21ebb4a705 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:50.894954 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9da43955-e0cb-458d-b731-ed21ebb4a705 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:50.895559 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9da43955-e0cb-458d-b731-ed21ebb4a705 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:50.986109 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9da43955-e0cb-458d-b731-ed21ebb4a705 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:50.998525 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9da43955-e0cb-458d-b731-ed21ebb4a705 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/17bdf735-2944-4b40-984c-4646caa855f0" status: 200 len: 1273 microversion: 2.1 time: 0.128883 Oct 27 03:37:50.999838 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1877/4004] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:50 2022] GET /compute/v2.1/servers/17bdf735-2944-4b40-984c-4646caa855f0 => generated 1273 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:37:51.009758 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-0cf980f3-a597-4e7e-9be1-7fbb2a3750e2 req-edd4aed3-1c3f-474e-a4af-b64d1ec31553 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d8900c4-92eb-4374-bd63-6d0ebbf407b7", "name": "network-vif-unplugged", "status": "completed", "tag": "fae83cc0-a7ce-470e-8ecf-19d03d536ec7"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:37:51.023412 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-0cf980f3-a597-4e7e-9be1-7fbb2a3750e2 req-edd4aed3-1c3f-474e-a4af-b64d1ec31553 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:51.024388 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-0cf980f3-a597-4e7e-9be1-7fbb2a3750e2 req-edd4aed3-1c3f-474e-a4af-b64d1ec31553 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:51.024985 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-0cf980f3-a597-4e7e-9be1-7fbb2a3750e2 req-edd4aed3-1c3f-474e-a4af-b64d1ec31553 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:51.045212 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-0cf980f3-a597-4e7e-9be1-7fbb2a3750e2 req-edd4aed3-1c3f-474e-a4af-b64d1ec31553 service nova] Creating event network-vif-unplugged:fae83cc0-a7ce-470e-8ecf-19d03d536ec7 for instance 2d8900c4-92eb-4374-bd63-6d0ebbf407b7 on n-h2-862769-1 Oct 27 03:37:51.051091 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-0cf980f3-a597-4e7e-9be1-7fbb2a3750e2 req-edd4aed3-1c3f-474e-a4af-b64d1ec31553 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049619 Oct 27 03:37:51.056274 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1878/4005] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:37:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:37:51.065545 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-be867b3e-d3d5-47c4-8d26-e95967df06de tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:51.066281 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-be867b3e-d3d5-47c4-8d26-e95967df06de tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:51.072452 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-be867b3e-d3d5-47c4-8d26-e95967df06de tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:51.072967 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-be867b3e-d3d5-47c4-8d26-e95967df06de tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:51.073499 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-be867b3e-d3d5-47c4-8d26-e95967df06de tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:51.075090 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-be867b3e-d3d5-47c4-8d26-e95967df06de tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:51.075792 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-be867b3e-d3d5-47c4-8d26-e95967df06de tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:51.079272 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-be867b3e-d3d5-47c4-8d26-e95967df06de tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:51.421534 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0d1e4181-2d87-4796-b1e6-0ad6ad1c6b36 tempest-SecurityGroupRulesNegativeTestJSON-912274608 tempest-SecurityGroupRulesNegativeTestJSON-912274608-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.188078 Oct 27 03:37:51.430127 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2128/4006] 10.222.0.20 () {60 vars in 1180 bytes} [Thu Oct 27 03:37:50 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:37:51.442851 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e8224571-8e83-4fd2-9578-fe89e8072321 tempest-SecurityGroupRulesNegativeTestJSON-912274608 tempest-SecurityGroupRulesNegativeTestJSON-912274608-project] Action: 'create', calling method: .version_select at 0x7f7dda54e0d0>, body: {"security_group_rule": {"parent_group_id": "68fa8cad-b2fb-4e98-b68e-5c643cd20064", "ip_protocol": "tempest-999-994209627", "from_port": 22, "to_port": 22}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:37:51.531403 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-be867b3e-d3d5-47c4-8d26-e95967df06de tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:51.546007 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-be867b3e-d3d5-47c4-8d26-e95967df06de tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1518 microversion: 2.1 time: 0.480872 Oct 27 03:37:51.546692 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1879/4007] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:51 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1518 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:37:51.554189 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0a9c885c-d6e8-4f1f-8fa4-630fdbc1065d tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:51.555036 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0a9c885c-d6e8-4f1f-8fa4-630fdbc1065d tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] [instance: 7e73d534-0a40-42d2-813c-2e9dbb9239ac] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:51.653525 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-e8224571-8e83-4fd2-9578-fe89e8072321 tempest-SecurityGroupRulesNegativeTestJSON-912274608 tempest-SecurityGroupRulesNegativeTestJSON-912274608-project] HTTP exception thrown: Invalid IP protocol tempest-999-994209627. Oct 27 03:37:51.655397 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e8224571-8e83-4fd2-9578-fe89e8072321 tempest-SecurityGroupRulesNegativeTestJSON-912274608 tempest-SecurityGroupRulesNegativeTestJSON-912274608-project] Request method failure captured: Oct 27 03:37:51.655397 n-d-862769-1 devstack@n-api.service[121001]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 27 03:37:51.655397 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:37:51.655397 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:37:51.655397 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:37:51.655397 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 156 Oct 27 03:37:51.655397 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:37:51.655397 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:37:51.655397 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:37:51.655397 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:37:51.655397 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWf0C0EOecmyXIjI0mIbxm9OmM5e99cJTKTDmYm2Y90TBW3x1ZQJKrhE56xLOKh6WNvhGmoubByAWz9FxJaReoFbR2rjtgUECjWtOu_AWAk31mBxI8t5omUqYbUvEADlUhcungVw26cYsWVJNUaosfYD1hHQOoaXzpzRlG0pv1I_b1VE Oct 27 03:37:51.655397 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:37:51.655397 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:37:51.655397 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:37:51.655397 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:37:51.655397 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:37:51.655397 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:37:51.655397 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 3ab3d7ec4d294c8fbbb0c19559accba1 Oct 27 03:37:51.655397 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-912274608 Oct 27 03:37:51.655397 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:37:51.655397 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:37:51.655397 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3ab3d7ec4d294c8fbbb0c19559accba1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3ab3d7ec4d294c8fbbb0c19559accba1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3ab3d7ec4d294c8fbbb0c19559accba1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3ab3d7ec4d294c8fbbb0c19559accba1"}]}] Oct 27 03:37:51.655397 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-912274608 Oct 27 03:37:51.655397 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 3ab3d7ec4d294c8fbbb0c19559accba1 Oct 27 03:37:51.655397 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-912274608 Oct 27 03:37:51.655397 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-912274608-project Oct 27 03:37:51.655397 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:37:51.655397 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:37:51.655397 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: cbfbad32b0c64e98a852e16cc3acd654 Oct 27 03:37:51.655397 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-912274608-project Oct 27 03:37:51.655397 n-d-862769-1 devstack@n-api.service[121001]: Oct 27 03:37:51.655397 n-d-862769-1 devstack@n-api.service[121001]: {"security_group_rule": {"parent_group_id": "68fa8cad-b2fb-4e98-b68e-5c643cd20064", "ip_protocol": "tempest-999-994209627", "from_port": 22, "to_port": 22}} Oct 27 03:37:51.655397 n-d-862769-1 devstack@n-api.service[121001]: method: Oct 27 03:37:51.655397 n-d-862769-1 devstack@n-api.service[121001]: exception: Invalid IP protocol tempest-999-994209627. Oct 27 03:37:51.655397 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'body': {'security_group_rule': {'parent_group_id': '68fa8cad-b2fb-4e98-b68e-5c643cd20064', 'ip_protocol': 'tempest-999-994209627', 'from_port': 22, 'to_port': 22}}} Oct 27 03:37:51.655397 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:37:51.655397 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:37:51.655397 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 27 03:37:51.655397 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 27 03:37:51.655397 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 27 03:37:51.655397 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 27 03:37:51.655397 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 27 03:37:51.655397 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 27 03:37:51.655397 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Oct 27 03:37:51.655397 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Oct 27 03:37:51.655397 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-994209627. Oct 27 03:37:51.655397 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:37:51.655397 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:37:51.655397 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:37:51.655397 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:37:51.655397 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:37:51.655397 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:37:51.655397 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:37:51.655397 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:37:51.655397 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:37:51.655397 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:37:51.655397 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:37:51.655397 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:37:51.655397 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 27 03:37:51.655397 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 27 03:37:51.655397 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-994209627. Oct 27 03:37:51.655397 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:37:51.655397 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:37:51.660846 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:37:51.660846 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:37:51.660846 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:37:51.660846 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:37:51.660846 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:37:51.660846 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:37:51.660846 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-994209627. Oct 27 03:37:51.660846 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:37:51.660846 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e8224571-8e83-4fd2-9578-fe89e8072321 tempest-SecurityGroupRulesNegativeTestJSON-912274608 tempest-SecurityGroupRulesNegativeTestJSON-912274608-project] Returning 400 to user: Invalid IP protocol tempest-999-994209627. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:37:51.674213 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e8224571-8e83-4fd2-9578-fe89e8072321 tempest-SecurityGroupRulesNegativeTestJSON-912274608 tempest-SecurityGroupRulesNegativeTestJSON-912274608-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 86 microversion: 2.1 time: 0.235128 Oct 27 03:37:51.674213 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2129/4008] 10.222.0.20 () {60 vars in 1195 bytes} [Thu Oct 27 03:37:51 2022] POST /compute/v2.1/os-security-group-rules => generated 86 bytes in 237 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 27 03:37:51.685115 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-44d5f88c-0268-4e62-90db-0413ac642fdc tempest-SecurityGroupRulesNegativeTestJSON-912274608 tempest-SecurityGroupRulesNegativeTestJSON-912274608-project] Action: 'create', calling method: .version_select at 0x7f7dda590c10>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1624516181", "description": "tempest-description-331114595"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:37:51.685509 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0a9c885c-d6e8-4f1f-8fa4-630fdbc1065d tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:51.704988 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0a9c885c-d6e8-4f1f-8fa4-630fdbc1065d tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:51.707329 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0a9c885c-d6e8-4f1f-8fa4-630fdbc1065d tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:51.708787 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0a9c885c-d6e8-4f1f-8fa4-630fdbc1065d tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] 10.222.0.20 "GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac" status: 200 len: 1285 microversion: 2.32 time: 0.160884 Oct 27 03:37:51.709573 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1880/4009] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:37:51 2022] GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac => generated 1285 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:37:51.891482 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-098e1d43-fe4c-4dc2-8aff-c8863f5a21a8 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:51.892433 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-098e1d43-fe4c-4dc2-8aff-c8863f5a21a8 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: 2d8900c4-92eb-4374-bd63-6d0ebbf407b7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:51.901732 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-098e1d43-fe4c-4dc2-8aff-c8863f5a21a8 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:51.902337 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-098e1d43-fe4c-4dc2-8aff-c8863f5a21a8 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:51.902983 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-098e1d43-fe4c-4dc2-8aff-c8863f5a21a8 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:51.904183 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-098e1d43-fe4c-4dc2-8aff-c8863f5a21a8 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:51.904998 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-098e1d43-fe4c-4dc2-8aff-c8863f5a21a8 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:51.906800 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-098e1d43-fe4c-4dc2-8aff-c8863f5a21a8 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:52.229847 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-098e1d43-fe4c-4dc2-8aff-c8863f5a21a8 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:52.243013 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-098e1d43-fe4c-4dc2-8aff-c8863f5a21a8 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/2d8900c4-92eb-4374-bd63-6d0ebbf407b7" status: 200 len: 1508 microversion: 2.1 time: 0.356455 Oct 27 03:37:52.243610 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1881/4010] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:51 2022] GET /compute/v2.1/servers/2d8900c4-92eb-4374-bd63-6d0ebbf407b7 => generated 1508 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:37:52.249106 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-22187b38-1aa6-4ab3-848a-57641e0f999c tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:52.250096 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-22187b38-1aa6-4ab3-848a-57641e0f999c tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 17bdf735-2944-4b40-984c-4646caa855f0] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:52.257710 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-22187b38-1aa6-4ab3-848a-57641e0f999c tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:52.259010 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-22187b38-1aa6-4ab3-848a-57641e0f999c tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:52.259630 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-22187b38-1aa6-4ab3-848a-57641e0f999c tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:52.260536 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-22187b38-1aa6-4ab3-848a-57641e0f999c tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:52.261307 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-22187b38-1aa6-4ab3-848a-57641e0f999c tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:52.261949 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-22187b38-1aa6-4ab3-848a-57641e0f999c tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:52.453556 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-44d5f88c-0268-4e62-90db-0413ac642fdc tempest-SecurityGroupRulesNegativeTestJSON-912274608 tempest-SecurityGroupRulesNegativeTestJSON-912274608-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.777380 Oct 27 03:37:52.454886 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2130/4011] 10.222.0.20 () {60 vars in 1180 bytes} [Thu Oct 27 03:37:51 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:37:52.464416 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-cd33e3d3-a324-455d-94ec-228ec204968c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:52.466880 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-cd33e3d3-a324-455d-94ec-228ec204968c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:52.485552 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cd33e3d3-a324-455d-94ec-228ec204968c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:52.490207 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cd33e3d3-a324-455d-94ec-228ec204968c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:52.491501 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cd33e3d3-a324-455d-94ec-228ec204968c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:52.492677 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cd33e3d3-a324-455d-94ec-228ec204968c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:52.493402 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cd33e3d3-a324-455d-94ec-228ec204968c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:52.493972 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cd33e3d3-a324-455d-94ec-228ec204968c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:52.786010 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-cd33e3d3-a324-455d-94ec-228ec204968c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:52.796212 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-22187b38-1aa6-4ab3-848a-57641e0f999c tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:52.800922 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-cd33e3d3-a324-455d-94ec-228ec204968c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1669 microversion: 2.1 time: 0.341518 Oct 27 03:37:52.801804 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2131/4012] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:52 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1669 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:37:52.806948 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-1933efcf-f1f0-4b45-a2df-c3c5fdec4cfe req-bd23e74d-c623-4678-9d7d-dd66978c7870 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d963bc87-b838-431c-92c3-8f06dd7afba7", "tag": "d76e2f68-c54b-49b5-8391-83058b2b1e64"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:37:52.825444 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-22187b38-1aa6-4ab3-848a-57641e0f999c tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/17bdf735-2944-4b40-984c-4646caa855f0" status: 200 len: 1315 microversion: 2.1 time: 0.580434 Oct 27 03:37:52.826771 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1882/4013] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:52 2022] GET /compute/v2.1/servers/17bdf735-2944-4b40-984c-4646caa855f0 => generated 1315 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:37:52.833493 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9adeffcb-54b2-424b-aeaa-0c144f0e4b5c tempest-SecurityGroupRulesNegativeTestJSON-912274608 tempest-SecurityGroupRulesNegativeTestJSON-912274608-project] Action: 'create', calling method: .version_select at 0x7f7dd9c9f430>, body: {"security_group_rule": {"parent_group_id": "984674e6-69cf-4ef6-b1ee-1a5960af6291", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:37:52.856409 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-1933efcf-f1f0-4b45-a2df-c3c5fdec4cfe req-bd23e74d-c623-4678-9d7d-dd66978c7870 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:52.859864 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-1933efcf-f1f0-4b45-a2df-c3c5fdec4cfe req-bd23e74d-c623-4678-9d7d-dd66978c7870 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:52.860397 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-1933efcf-f1f0-4b45-a2df-c3c5fdec4cfe req-bd23e74d-c623-4678-9d7d-dd66978c7870 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:52.885361 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-1933efcf-f1f0-4b45-a2df-c3c5fdec4cfe req-bd23e74d-c623-4678-9d7d-dd66978c7870 service nova] Creating event network-changed:d76e2f68-c54b-49b5-8391-83058b2b1e64 for instance d963bc87-b838-431c-92c3-8f06dd7afba7 on n-h1-862769-1 Oct 27 03:37:52.906132 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-1933efcf-f1f0-4b45-a2df-c3c5fdec4cfe req-bd23e74d-c623-4678-9d7d-dd66978c7870 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102604 Oct 27 03:37:52.914119 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2132/4014] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:37:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:37:52.938424 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3d59276d-bdba-4f0a-ba0f-7b72017d259c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:52.951085 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3d59276d-bdba-4f0a-ba0f-7b72017d259c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:52.973658 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3d59276d-bdba-4f0a-ba0f-7b72017d259c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:52.974209 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3d59276d-bdba-4f0a-ba0f-7b72017d259c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:52.974671 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3d59276d-bdba-4f0a-ba0f-7b72017d259c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:52.975417 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3d59276d-bdba-4f0a-ba0f-7b72017d259c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:52.975882 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3d59276d-bdba-4f0a-ba0f-7b72017d259c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:52.980520 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3d59276d-bdba-4f0a-ba0f-7b72017d259c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:53.328895 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3d59276d-bdba-4f0a-ba0f-7b72017d259c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:53.345870 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3d59276d-bdba-4f0a-ba0f-7b72017d259c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1518 microversion: 2.1 time: 0.427878 Oct 27 03:37:53.347415 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2133/4015] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:52 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1518 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:37:53.356957 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-cce0b0f7-bb38-4143-b3b0-d7110aa5f8e9 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:53.357903 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-cce0b0f7-bb38-4143-b3b0-d7110aa5f8e9 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] [instance: 7e73d534-0a40-42d2-813c-2e9dbb9239ac] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:53.366566 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cce0b0f7-bb38-4143-b3b0-d7110aa5f8e9 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:53.367303 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cce0b0f7-bb38-4143-b3b0-d7110aa5f8e9 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:53.368224 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cce0b0f7-bb38-4143-b3b0-d7110aa5f8e9 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:53.369169 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cce0b0f7-bb38-4143-b3b0-d7110aa5f8e9 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:53.369851 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cce0b0f7-bb38-4143-b3b0-d7110aa5f8e9 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:53.370561 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cce0b0f7-bb38-4143-b3b0-d7110aa5f8e9 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:53.410575 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=100 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:37:53.504698 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-cce0b0f7-bb38-4143-b3b0-d7110aa5f8e9 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:53.535135 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-cce0b0f7-bb38-4143-b3b0-d7110aa5f8e9 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:53.540580 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-cce0b0f7-bb38-4143-b3b0-d7110aa5f8e9 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:53.544138 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-cce0b0f7-bb38-4143-b3b0-d7110aa5f8e9 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] 10.222.0.20 "GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac" status: 200 len: 1527 microversion: 2.32 time: 0.195209 Oct 27 03:37:53.550061 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2134/4016] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:37:53 2022] GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac => generated 1527 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:37:53.571432 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a2bf9ef8-a9a6-4118-9392-d75a8ad44b31 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:53.572137 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a2bf9ef8-a9a6-4118-9392-d75a8ad44b31 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:53.590407 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a2bf9ef8-a9a6-4118-9392-d75a8ad44b31 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:53.591607 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a2bf9ef8-a9a6-4118-9392-d75a8ad44b31 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:53.594546 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a2bf9ef8-a9a6-4118-9392-d75a8ad44b31 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:53.598992 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a2bf9ef8-a9a6-4118-9392-d75a8ad44b31 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:53.601511 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a2bf9ef8-a9a6-4118-9392-d75a8ad44b31 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:53.602238 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a2bf9ef8-a9a6-4118-9392-d75a8ad44b31 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:53.753337 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-9adeffcb-54b2-424b-aeaa-0c144f0e4b5c tempest-SecurityGroupRulesNegativeTestJSON-912274608 tempest-SecurityGroupRulesNegativeTestJSON-912274608-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Oct 27 03:37:53.758730 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9adeffcb-54b2-424b-aeaa-0c144f0e4b5c tempest-SecurityGroupRulesNegativeTestJSON-912274608 tempest-SecurityGroupRulesNegativeTestJSON-912274608-project] Request method failure captured: Oct 27 03:37:53.758730 n-d-862769-1 devstack@n-api.service[121000]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 27 03:37:53.758730 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:37:53.758730 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:37:53.758730 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:37:53.758730 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 138 Oct 27 03:37:53.758730 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:37:53.758730 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:37:53.758730 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:37:53.758730 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:37:53.758730 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWf0C0EOecmyXIjI0mIbxm9OmM5e99cJTKTDmYm2Y90TBW3x1ZQJKrhE56xLOKh6WNvhGmoubByAWz9FxJaReoFbR2rjtgUECjWtOu_AWAk31mBxI8t5omUqYbUvEADlUhcungVw26cYsWVJNUaosfYD1hHQOoaXzpzRlG0pv1I_b1VE Oct 27 03:37:53.758730 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:37:53.758730 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:37:53.758730 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:37:53.758730 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:37:53.758730 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:37:53.758730 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:37:53.758730 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 3ab3d7ec4d294c8fbbb0c19559accba1 Oct 27 03:37:53.758730 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-912274608 Oct 27 03:37:53.758730 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:37:53.758730 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:37:53.758730 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3ab3d7ec4d294c8fbbb0c19559accba1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3ab3d7ec4d294c8fbbb0c19559accba1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3ab3d7ec4d294c8fbbb0c19559accba1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3ab3d7ec4d294c8fbbb0c19559accba1"}]}] Oct 27 03:37:53.758730 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-912274608 Oct 27 03:37:53.758730 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 3ab3d7ec4d294c8fbbb0c19559accba1 Oct 27 03:37:53.758730 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-912274608 Oct 27 03:37:53.758730 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-912274608-project Oct 27 03:37:53.758730 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:37:53.758730 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:37:53.758730 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: cbfbad32b0c64e98a852e16cc3acd654 Oct 27 03:37:53.758730 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-912274608-project Oct 27 03:37:53.758730 n-d-862769-1 devstack@n-api.service[121000]: Oct 27 03:37:53.758730 n-d-862769-1 devstack@n-api.service[121000]: {"security_group_rule": {"parent_group_id": "984674e6-69cf-4ef6-b1ee-1a5960af6291", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Oct 27 03:37:53.758730 n-d-862769-1 devstack@n-api.service[121000]: method: Oct 27 03:37:53.758730 n-d-862769-1 devstack@n-api.service[121000]: exception: Invalid port range 22:21. Former value cannot be greater than the later Oct 27 03:37:53.758730 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'body': {'security_group_rule': {'parent_group_id': '984674e6-69cf-4ef6-b1ee-1a5960af6291', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Oct 27 03:37:53.758730 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:37:53.758730 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:37:53.758730 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 27 03:37:53.758730 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 27 03:37:53.758730 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 27 03:37:53.758730 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 27 03:37:53.758730 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 27 03:37:53.758730 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 27 03:37:53.758730 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 27 03:37:53.758730 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 27 03:37:53.758730 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Oct 27 03:37:53.758730 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:37:53.758730 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:37:53.758730 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:37:53.758730 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:37:53.758730 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:37:53.758730 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:37:53.758730 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:37:53.758730 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:37:53.758730 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:37:53.758730 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:37:53.758730 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:37:53.758730 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:37:53.758730 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 27 03:37:53.758730 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 27 03:37:53.758730 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Oct 27 03:37:53.758730 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:37:53.763746 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:37:53.763746 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:37:53.763746 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:37:53.763746 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:37:53.763746 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:37:53.763746 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:37:53.763746 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:37:53.763746 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Oct 27 03:37:53.763746 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:37:53.763746 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9adeffcb-54b2-424b-aeaa-0c144f0e4b5c tempest-SecurityGroupRulesNegativeTestJSON-912274608 tempest-SecurityGroupRulesNegativeTestJSON-912274608-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:37:53.763746 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9adeffcb-54b2-424b-aeaa-0c144f0e4b5c tempest-SecurityGroupRulesNegativeTestJSON-912274608 tempest-SecurityGroupRulesNegativeTestJSON-912274608-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.932572 Oct 27 03:37:53.763746 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1883/4017] 10.222.0.20 () {60 vars in 1195 bytes} [Thu Oct 27 03:37:52 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 934 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 03:37:53.772313 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9ebaae28-93df-409f-aadb-4c3c969eda7d tempest-SecurityGroupRulesNegativeTestJSON-912274608 tempest-SecurityGroupRulesNegativeTestJSON-912274608-project] Action: 'create', calling method: .version_select at 0x7f7dd9c9d040>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-832900711", "description": "tempest-description-1307944458"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:37:53.896402 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a2bf9ef8-a9a6-4118-9392-d75a8ad44b31 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:53.909546 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a2bf9ef8-a9a6-4118-9392-d75a8ad44b31 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1669 microversion: 2.1 time: 0.358154 Oct 27 03:37:53.914629 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2135/4018] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:53 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1669 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:37:53.922370 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-82a944d2-c9b6-4bad-82dc-82c4fa170150 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:53.923615 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-82a944d2-c9b6-4bad-82dc-82c4fa170150 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 17bdf735-2944-4b40-984c-4646caa855f0] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:53.934011 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-82a944d2-c9b6-4bad-82dc-82c4fa170150 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:53.941114 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-82a944d2-c9b6-4bad-82dc-82c4fa170150 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:53.941114 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-82a944d2-c9b6-4bad-82dc-82c4fa170150 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:53.941114 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-82a944d2-c9b6-4bad-82dc-82c4fa170150 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:53.941114 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-82a944d2-c9b6-4bad-82dc-82c4fa170150 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:53.941114 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-82a944d2-c9b6-4bad-82dc-82c4fa170150 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:54.200270 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-82a944d2-c9b6-4bad-82dc-82c4fa170150 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:54.210577 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-82a944d2-c9b6-4bad-82dc-82c4fa170150 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/17bdf735-2944-4b40-984c-4646caa855f0" status: 200 len: 1315 microversion: 2.1 time: 0.294554 Oct 27 03:37:54.215822 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2136/4019] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:53 2022] GET /compute/v2.1/servers/17bdf735-2944-4b40-984c-4646caa855f0 => generated 1315 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:37:54.222394 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8f414836-0b18-44ff-9853-3271d00b8466 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:54.223243 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8f414836-0b18-44ff-9853-3271d00b8466 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:54.234930 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8f414836-0b18-44ff-9853-3271d00b8466 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:54.235609 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8f414836-0b18-44ff-9853-3271d00b8466 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:54.236231 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8f414836-0b18-44ff-9853-3271d00b8466 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:54.237362 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8f414836-0b18-44ff-9853-3271d00b8466 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:54.238159 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8f414836-0b18-44ff-9853-3271d00b8466 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:54.239938 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8f414836-0b18-44ff-9853-3271d00b8466 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:54.479303 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:37:54.503382 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8f414836-0b18-44ff-9853-3271d00b8466 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:54.517887 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8f414836-0b18-44ff-9853-3271d00b8466 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1669 microversion: 2.1 time: 0.300560 Oct 27 03:37:54.519166 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2137/4020] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:54 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1669 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:37:54.591971 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-aa164a3d-b4d9-412b-9da7-3c2452e5495d tempest-SecurityGroupsNegativeTestJSON-1746164540 tempest-SecurityGroupsNegativeTestJSON-1746164540-project] Calling method '.version_select at 0x7f7dd9fb25e0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:54.624238 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9ebaae28-93df-409f-aadb-4c3c969eda7d tempest-SecurityGroupRulesNegativeTestJSON-912274608 tempest-SecurityGroupRulesNegativeTestJSON-912274608-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.855724 Oct 27 03:37:54.632112 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1884/4021] 10.222.0.20 () {60 vars in 1180 bytes} [Thu Oct 27 03:37:53 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:37:54.641158 n-d-862769-1 devstack@n-api.service[121001]: DEBUG neutronclient.v2_0.client [None req-aa164a3d-b4d9-412b-9da7-3c2452e5495d tempest-SecurityGroupsNegativeTestJSON-1746164540 tempest-SecurityGroupsNegativeTestJSON-1746164540-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group eb62f324-a4ad-4e71-8640-8d25d5719289 does not exist", "detail": ""}} {{(pid=121001) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 03:37:54.641545 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3ce1b3a5-456c-4bea-9ed5-e6b86cffb5ee tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:54.641803 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.network.security_group_api [None req-aa164a3d-b4d9-412b-9da7-3c2452e5495d tempest-SecurityGroupsNegativeTestJSON-1746164540 tempest-SecurityGroupsNegativeTestJSON-1746164540-project] Neutron security group eb62f324-a4ad-4e71-8640-8d25d5719289 not found {{(pid=121001) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 27 03:37:54.642185 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-3ce1b3a5-456c-4bea-9ed5-e6b86cffb5ee tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:54.642386 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-aa164a3d-b4d9-412b-9da7-3c2452e5495d tempest-SecurityGroupsNegativeTestJSON-1746164540 tempest-SecurityGroupsNegativeTestJSON-1746164540-project] HTTP exception thrown: Security group eb62f324-a4ad-4e71-8640-8d25d5719289 does not exist Oct 27 03:37:54.642386 n-d-862769-1 devstack@n-api.service[121001]: Neutron server returns request_ids: ['req-289970ea-d05f-4228-8b3e-b0fa6ab4285c'] Oct 27 03:37:54.644730 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-aa164a3d-b4d9-412b-9da7-3c2452e5495d tempest-SecurityGroupsNegativeTestJSON-1746164540 tempest-SecurityGroupsNegativeTestJSON-1746164540-project] Request method failure captured: Oct 27 03:37:54.644730 n-d-862769-1 devstack@n-api.service[121001]: request: DELETE /compute/v2.1/os-security-groups/eb62f324-a4ad-4e71-8640-8d25d5719289 HTTP/1.1 Oct 27 03:37:54.644730 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:37:54.644730 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:37:54.644730 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:37:54.644730 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:37:54.644730 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:37:54.644730 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:37:54.644730 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:37:54.644730 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:37:54.644730 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWf0SpFxbna_xGRthxIV0d_XKbF042AAWGYo9YU8k9EyYaDTWOy_vzQSZJsgJ6UsrIgj9IsPzMVEiJldyuSZ4n3eVg-4tdF6R7jiHS6chs5wl_SR4NYDdpuN4JqXjATqOqM69NivzpyaYnARvEKVUWGHixdRaTmlzhVkO9Lsma1bGXxQ Oct 27 03:37:54.644730 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:37:54.644730 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:37:54.644730 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:37:54.644730 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:37:54.644730 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:37:54.644730 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:37:54.644730 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: d60717661c654932ba6adb856af896b6 Oct 27 03:37:54.644730 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1746164540 Oct 27 03:37:54.644730 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:37:54.644730 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:37:54.644730 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d60717661c654932ba6adb856af896b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d60717661c654932ba6adb856af896b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d60717661c654932ba6adb856af896b6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d60717661c654932ba6adb856af896b6"}]}] Oct 27 03:37:54.644730 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1746164540 Oct 27 03:37:54.644730 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: d60717661c654932ba6adb856af896b6 Oct 27 03:37:54.644730 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1746164540 Oct 27 03:37:54.644730 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-SecurityGroupsNegativeTestJSON-1746164540-project Oct 27 03:37:54.644730 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:37:54.644730 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:37:54.644730 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: f3bdefb00cb847f5bd55a2e42dc0b277 Oct 27 03:37:54.644730 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1746164540-project Oct 27 03:37:54.644730 n-d-862769-1 devstack@n-api.service[121001]: method: Oct 27 03:37:54.644730 n-d-862769-1 devstack@n-api.service[121001]: exception: Security group eb62f324-a4ad-4e71-8640-8d25d5719289 does not exist Oct 27 03:37:54.644730 n-d-862769-1 devstack@n-api.service[121001]: Neutron server returns request_ids: ['req-289970ea-d05f-4228-8b3e-b0fa6ab4285c'] Oct 27 03:37:54.644730 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': 'eb62f324-a4ad-4e71-8640-8d25d5719289'} Oct 27 03:37:54.644730 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:37:54.644730 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:37:54.644730 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 27 03:37:54.644730 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 27 03:37:54.644730 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:37:54.644730 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:37:54.644730 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 27 03:37:54.644730 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 27 03:37:54.644730 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:37:54.644730 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:37:54.644730 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 27 03:37:54.644730 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 27 03:37:54.644730 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:37:54.644730 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:37:54.644730 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 03:37:54.644730 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 03:37:54.644730 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:37:54.644730 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:37:54.644730 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 03:37:54.644730 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 03:37:54.644730 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:37:54.644730 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:37:54.644730 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 03:37:54.644730 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 03:37:54.644730 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 03:37:54.644730 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 03:37:54.644730 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group eb62f324-a4ad-4e71-8640-8d25d5719289 does not exist Oct 27 03:37:54.649890 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-289970ea-d05f-4228-8b3e-b0fa6ab4285c'] Oct 27 03:37:54.649890 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:37:54.649890 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:37:54.649890 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:37:54.649890 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:37:54.649890 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 27 03:37:54.649890 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 27 03:37:54.649890 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 27 03:37:54.649890 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 27 03:37:54.649890 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group eb62f324-a4ad-4e71-8640-8d25d5719289 does not exist Oct 27 03:37:54.649890 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-289970ea-d05f-4228-8b3e-b0fa6ab4285c'] Oct 27 03:37:54.649890 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:37:54.649890 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:37:54.649890 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:37:54.649890 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:37:54.649890 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:37:54.649890 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:37:54.649890 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:37:54.649890 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:37:54.649890 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:37:54.649890 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:37:54.649890 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:37:54.649890 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:37:54.649890 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 27 03:37:54.649890 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 27 03:37:54.649890 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group eb62f324-a4ad-4e71-8640-8d25d5719289 does not exist Oct 27 03:37:54.649890 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-289970ea-d05f-4228-8b3e-b0fa6ab4285c'] Oct 27 03:37:54.649890 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:37:54.649890 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:37:54.649890 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:37:54.649890 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:37:54.649890 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:37:54.649890 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:37:54.649890 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:37:54.649890 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:37:54.649890 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group eb62f324-a4ad-4e71-8640-8d25d5719289 does not exist Oct 27 03:37:54.649890 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-289970ea-d05f-4228-8b3e-b0fa6ab4285c'] Oct 27 03:37:54.649890 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:37:54.649890 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-aa164a3d-b4d9-412b-9da7-3c2452e5495d tempest-SecurityGroupsNegativeTestJSON-1746164540 tempest-SecurityGroupsNegativeTestJSON-1746164540-project] Returning 404 to user: Security group eb62f324-a4ad-4e71-8640-8d25d5719289 does not exist Oct 27 03:37:54.649890 n-d-862769-1 devstack@n-api.service[121001]: Neutron server returns request_ids: ['req-289970ea-d05f-4228-8b3e-b0fa6ab4285c'] {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:37:54.649890 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-aa164a3d-b4d9-412b-9da7-3c2452e5495d tempest-SecurityGroupsNegativeTestJSON-1746164540 tempest-SecurityGroupsNegativeTestJSON-1746164540-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/eb62f324-a4ad-4e71-8640-8d25d5719289" status: 404 len: 194 microversion: 2.1 time: 0.126070 Oct 27 03:37:54.649890 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2138/4022] 10.222.0.20 () {58 vars in 1272 bytes} [Thu Oct 27 03:37:54 2022] DELETE /compute/v2.1/os-security-groups/eb62f324-a4ad-4e71-8640-8d25d5719289 => generated 194 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:37:54.663644 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4f1f0fcd-77d1-406f-bc9f-cfd48499d93c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:54.663644 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4f1f0fcd-77d1-406f-bc9f-cfd48499d93c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:54.664042 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3ce1b3a5-456c-4bea-9ed5-e6b86cffb5ee tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:54.664042 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3ce1b3a5-456c-4bea-9ed5-e6b86cffb5ee tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:54.664042 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3ce1b3a5-456c-4bea-9ed5-e6b86cffb5ee tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:54.664042 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3ce1b3a5-456c-4bea-9ed5-e6b86cffb5ee tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:54.664042 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3ce1b3a5-456c-4bea-9ed5-e6b86cffb5ee tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:54.664042 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3ce1b3a5-456c-4bea-9ed5-e6b86cffb5ee tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:54.683029 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4f1f0fcd-77d1-406f-bc9f-cfd48499d93c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:54.684070 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4f1f0fcd-77d1-406f-bc9f-cfd48499d93c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:54.684720 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4f1f0fcd-77d1-406f-bc9f-cfd48499d93c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:54.685633 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4f1f0fcd-77d1-406f-bc9f-cfd48499d93c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:54.686316 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4f1f0fcd-77d1-406f-bc9f-cfd48499d93c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:54.686916 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4f1f0fcd-77d1-406f-bc9f-cfd48499d93c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:54.895543 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-3ce1b3a5-456c-4bea-9ed5-e6b86cffb5ee tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:54.904053 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3ce1b3a5-456c-4bea-9ed5-e6b86cffb5ee tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1505 microversion: 2.1 time: 0.269290 Oct 27 03:37:54.904763 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1885/4023] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:54 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1505 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:37:54.915618 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6834d857-5420-483d-a9e5-c37156e61e08 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:54.916824 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6834d857-5420-483d-a9e5-c37156e61e08 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] [instance: 7e73d534-0a40-42d2-813c-2e9dbb9239ac] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:54.926251 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6834d857-5420-483d-a9e5-c37156e61e08 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:54.926871 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6834d857-5420-483d-a9e5-c37156e61e08 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:54.927827 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6834d857-5420-483d-a9e5-c37156e61e08 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:54.928549 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6834d857-5420-483d-a9e5-c37156e61e08 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:54.929006 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6834d857-5420-483d-a9e5-c37156e61e08 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:54.929438 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6834d857-5420-483d-a9e5-c37156e61e08 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:54.959480 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4f1f0fcd-77d1-406f-bc9f-cfd48499d93c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:54.976779 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4f1f0fcd-77d1-406f-bc9f-cfd48499d93c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1669 microversion: 2.1 time: 0.327233 Oct 27 03:37:54.977943 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2139/4024] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:54 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1669 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:37:54.986369 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-96806e3d-2e60-4ba2-a9cf-3fd1fd598ba6 tempest-SecurityGroupRulesNegativeTestJSON-912274608 tempest-SecurityGroupRulesNegativeTestJSON-912274608-project] Action: 'create', calling method: .version_select at 0x7f7dd9f8b940>, body: {"security_group_rule": {"parent_group_id": "9a62843b-98b4-4a7e-85b5-266bbc60a9ac", "ip_protocol": "tcp", "from_port": 22, "to_port": 128030669}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:37:55.012701 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-6834d857-5420-483d-a9e5-c37156e61e08 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:55.026328 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-6834d857-5420-483d-a9e5-c37156e61e08 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:55.028531 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-6834d857-5420-483d-a9e5-c37156e61e08 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:55.030130 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6834d857-5420-483d-a9e5-c37156e61e08 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] 10.222.0.20 "GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac" status: 200 len: 1575 microversion: 2.32 time: 0.124110 Oct 27 03:37:55.031311 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1886/4025] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:37:54 2022] GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac => generated 1575 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:37:55.039092 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-61e46502-ae43-42d8-9b5e-51833197dfea tempest-SecurityGroupsNegativeTestJSON-1746164540 tempest-SecurityGroupsNegativeTestJSON-1746164540-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.004528 Oct 27 03:37:55.040158 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1887/4026] 10.222.0.20 () {58 vars in 1164 bytes} [Thu Oct 27 03:37:55 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 27 03:37:55.046660 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9e70b7cb-fa56-4ea3-ac16-73cc6d7fd39a tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:55.047476 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9e70b7cb-fa56-4ea3-ac16-73cc6d7fd39a tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:55.053635 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9e70b7cb-fa56-4ea3-ac16-73cc6d7fd39a tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:55.054164 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9e70b7cb-fa56-4ea3-ac16-73cc6d7fd39a tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:55.054598 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9e70b7cb-fa56-4ea3-ac16-73cc6d7fd39a tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:55.055662 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9e70b7cb-fa56-4ea3-ac16-73cc6d7fd39a tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:55.056363 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9e70b7cb-fa56-4ea3-ac16-73cc6d7fd39a tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:55.056965 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9e70b7cb-fa56-4ea3-ac16-73cc6d7fd39a tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:55.092498 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-96806e3d-2e60-4ba2-a9cf-3fd1fd598ba6 tempest-SecurityGroupRulesNegativeTestJSON-912274608 tempest-SecurityGroupRulesNegativeTestJSON-912274608-project] HTTP exception thrown: Invalid port range 22:128030669. Valid TCP ports should be between 1-65535 Oct 27 03:37:55.094289 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-96806e3d-2e60-4ba2-a9cf-3fd1fd598ba6 tempest-SecurityGroupRulesNegativeTestJSON-912274608 tempest-SecurityGroupRulesNegativeTestJSON-912274608-project] Request method failure captured: Oct 27 03:37:55.094289 n-d-862769-1 devstack@n-api.service[121001]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 27 03:37:55.094289 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:37:55.094289 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:37:55.094289 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:37:55.094289 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 145 Oct 27 03:37:55.094289 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:37:55.094289 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:37:55.094289 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:37:55.094289 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:37:55.094289 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWf0C0EOecmyXIjI0mIbxm9OmM5e99cJTKTDmYm2Y90TBW3x1ZQJKrhE56xLOKh6WNvhGmoubByAWz9FxJaReoFbR2rjtgUECjWtOu_AWAk31mBxI8t5omUqYbUvEADlUhcungVw26cYsWVJNUaosfYD1hHQOoaXzpzRlG0pv1I_b1VE Oct 27 03:37:55.094289 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:37:55.094289 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:37:55.094289 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:37:55.094289 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:37:55.094289 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:37:55.094289 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:37:55.094289 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 3ab3d7ec4d294c8fbbb0c19559accba1 Oct 27 03:37:55.094289 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-912274608 Oct 27 03:37:55.094289 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:37:55.094289 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:37:55.094289 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3ab3d7ec4d294c8fbbb0c19559accba1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3ab3d7ec4d294c8fbbb0c19559accba1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3ab3d7ec4d294c8fbbb0c19559accba1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3ab3d7ec4d294c8fbbb0c19559accba1"}]}] Oct 27 03:37:55.094289 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-912274608 Oct 27 03:37:55.094289 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 3ab3d7ec4d294c8fbbb0c19559accba1 Oct 27 03:37:55.094289 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-912274608 Oct 27 03:37:55.094289 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-912274608-project Oct 27 03:37:55.094289 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:37:55.094289 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:37:55.094289 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: cbfbad32b0c64e98a852e16cc3acd654 Oct 27 03:37:55.094289 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-912274608-project Oct 27 03:37:55.094289 n-d-862769-1 devstack@n-api.service[121001]: Oct 27 03:37:55.094289 n-d-862769-1 devstack@n-api.service[121001]: {"security_group_rule": {"parent_group_id": "9a62843b-98b4-4a7e-85b5-266bbc60a9ac", "ip_protocol": "tcp", "from_port": 22, "to_port": 128030669}} Oct 27 03:37:55.094289 n-d-862769-1 devstack@n-api.service[121001]: method: Oct 27 03:37:55.094289 n-d-862769-1 devstack@n-api.service[121001]: exception: Invalid port range 22:128030669. Valid TCP ports should be between 1-65535 Oct 27 03:37:55.094289 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'body': {'security_group_rule': {'parent_group_id': '9a62843b-98b4-4a7e-85b5-266bbc60a9ac', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 128030669}}} Oct 27 03:37:55.094289 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:37:55.094289 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:37:55.094289 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 27 03:37:55.094289 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 27 03:37:55.094289 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 27 03:37:55.094289 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 27 03:37:55.094289 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 27 03:37:55.094289 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 27 03:37:55.094289 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Oct 27 03:37:55.094289 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 27 03:37:55.094289 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:128030669. Valid TCP ports should be between 1-65535 Oct 27 03:37:55.094289 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:37:55.094289 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:37:55.094289 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:37:55.094289 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:37:55.094289 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:37:55.094289 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:37:55.094289 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:37:55.094289 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:37:55.094289 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:37:55.094289 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:37:55.094289 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:37:55.094289 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:37:55.094289 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 27 03:37:55.094289 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 27 03:37:55.094289 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:128030669. Valid TCP ports should be between 1-65535 Oct 27 03:37:55.094289 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:37:55.102902 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:37:55.102902 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:37:55.102902 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:37:55.102902 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:37:55.102902 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:37:55.102902 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:37:55.102902 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:37:55.102902 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:128030669. Valid TCP ports should be between 1-65535 Oct 27 03:37:55.102902 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:37:55.102902 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-96806e3d-2e60-4ba2-a9cf-3fd1fd598ba6 tempest-SecurityGroupRulesNegativeTestJSON-912274608 tempest-SecurityGroupRulesNegativeTestJSON-912274608-project] Returning 400 to user: Invalid port range 22:128030669. Valid TCP ports should be between 1-65535 {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:37:55.102902 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-96806e3d-2e60-4ba2-a9cf-3fd1fd598ba6 tempest-SecurityGroupRulesNegativeTestJSON-912274608 tempest-SecurityGroupRulesNegativeTestJSON-912274608-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 118 microversion: 2.1 time: 0.116403 Oct 27 03:37:55.102902 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2140/4027] 10.222.0.20 () {60 vars in 1195 bytes} [Thu Oct 27 03:37:54 2022] POST /compute/v2.1/os-security-group-rules => generated 118 bytes in 119 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 03:37:55.106618 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-98ffa1eb-a663-4979-956d-77e70938c0fb req-fe1f3005-b083-444a-895b-38744fb83f04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17bdf735-2944-4b40-984c-4646caa855f0", "tag": "06874d1d-d01a-4494-a246-90bef790a6f3"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:37:55.118903 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-98ffa1eb-a663-4979-956d-77e70938c0fb req-fe1f3005-b083-444a-895b-38744fb83f04 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:55.119809 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-98ffa1eb-a663-4979-956d-77e70938c0fb req-fe1f3005-b083-444a-895b-38744fb83f04 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:55.120477 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-98ffa1eb-a663-4979-956d-77e70938c0fb req-fe1f3005-b083-444a-895b-38744fb83f04 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:55.133933 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-98ffa1eb-a663-4979-956d-77e70938c0fb req-fe1f3005-b083-444a-895b-38744fb83f04 service nova] Creating event network-changed:06874d1d-d01a-4494-a246-90bef790a6f3 for instance 17bdf735-2944-4b40-984c-4646caa855f0 on n-h2-862769-1 Oct 27 03:37:55.139694 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-98ffa1eb-a663-4979-956d-77e70938c0fb req-fe1f3005-b083-444a-895b-38744fb83f04 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040237 Oct 27 03:37:55.141339 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2141/4028] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:37:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:37:55.153574 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-be205dba-75a1-4f2d-909a-2749eb90eef9 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:37:55.159054 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-be205dba-75a1-4f2d-909a-2749eb90eef9 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:55.167103 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-be205dba-75a1-4f2d-909a-2749eb90eef9 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:55.171516 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-be205dba-75a1-4f2d-909a-2749eb90eef9 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:55.221611 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-be205dba-75a1-4f2d-909a-2749eb90eef9 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Going to try to stop instance {{(pid=121001) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 27 03:37:55.491432 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-be205dba-75a1-4f2d-909a-2749eb90eef9 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "POST /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86/action" status: 202 len: 0 microversion: 2.1 time: 0.348278 Oct 27 03:37:55.492080 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2142/4029] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:37:55 2022] POST /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86/action => generated 0 bytes in 350 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:37:55.498541 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9e70b7cb-fa56-4ea3-ac16-73cc6d7fd39a tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:55.509530 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ff31be3f-9930-4da8-bfa5-04e4525de858 tempest-SecurityGroupsNegativeTestJSON-1746164540 tempest-SecurityGroupsNegativeTestJSON-1746164540-project] Calling method '.version_select at 0x7f7dd9d55790>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:55.515697 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9e70b7cb-fa56-4ea3-ac16-73cc6d7fd39a tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1505 microversion: 2.1 time: 0.474018 Oct 27 03:37:55.518200 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1888/4030] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:55 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1505 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:37:55.524326 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-60b9adcd-d801-4ac7-88a4-1356151f872f tempest-SecurityGroupRulesNegativeTestJSON-912274608 tempest-SecurityGroupRulesNegativeTestJSON-912274608-project] Action: 'create', calling method: .version_select at 0x7f7ddecc84c0>, body: {"security_group_rule": {"parent_group_id": "1a4dc134-d553-44a5-b752-5a566485fae4", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:37:55.576327 n-d-862769-1 devstack@n-api.service[121000]: DEBUG neutronclient.v2_0.client [None req-60b9adcd-d801-4ac7-88a4-1356151f872f tempest-SecurityGroupRulesNegativeTestJSON-912274608 tempest-SecurityGroupRulesNegativeTestJSON-912274608-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 1a4dc134-d553-44a5-b752-5a566485fae4 does not exist", "detail": ""}} {{(pid=121000) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 03:37:55.576935 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.security_group_api [None req-60b9adcd-d801-4ac7-88a4-1356151f872f tempest-SecurityGroupRulesNegativeTestJSON-912274608 tempest-SecurityGroupRulesNegativeTestJSON-912274608-project] Neutron security group 1a4dc134-d553-44a5-b752-5a566485fae4 not found {{(pid=121000) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 27 03:37:55.577464 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-60b9adcd-d801-4ac7-88a4-1356151f872f tempest-SecurityGroupRulesNegativeTestJSON-912274608 tempest-SecurityGroupRulesNegativeTestJSON-912274608-project] HTTP exception thrown: Security group 1a4dc134-d553-44a5-b752-5a566485fae4 does not exist Oct 27 03:37:55.577464 n-d-862769-1 devstack@n-api.service[121000]: Neutron server returns request_ids: ['req-59bf8caf-cb2a-43e2-8495-05ed9717a480'] Oct 27 03:37:55.579651 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-60b9adcd-d801-4ac7-88a4-1356151f872f tempest-SecurityGroupRulesNegativeTestJSON-912274608 tempest-SecurityGroupRulesNegativeTestJSON-912274608-project] Request method failure captured: Oct 27 03:37:55.579651 n-d-862769-1 devstack@n-api.service[121000]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 27 03:37:55.579651 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:37:55.579651 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:37:55.579651 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:37:55.579651 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 138 Oct 27 03:37:55.579651 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:37:55.579651 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:37:55.579651 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:37:55.579651 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:37:55.579651 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWf0C0EOecmyXIjI0mIbxm9OmM5e99cJTKTDmYm2Y90TBW3x1ZQJKrhE56xLOKh6WNvhGmoubByAWz9FxJaReoFbR2rjtgUECjWtOu_AWAk31mBxI8t5omUqYbUvEADlUhcungVw26cYsWVJNUaosfYD1hHQOoaXzpzRlG0pv1I_b1VE Oct 27 03:37:55.579651 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:37:55.579651 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:37:55.579651 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:37:55.579651 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:37:55.579651 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:37:55.579651 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:37:55.579651 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 3ab3d7ec4d294c8fbbb0c19559accba1 Oct 27 03:37:55.579651 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-912274608 Oct 27 03:37:55.579651 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:37:55.579651 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:37:55.579651 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3ab3d7ec4d294c8fbbb0c19559accba1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3ab3d7ec4d294c8fbbb0c19559accba1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3ab3d7ec4d294c8fbbb0c19559accba1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3ab3d7ec4d294c8fbbb0c19559accba1"}]}] Oct 27 03:37:55.579651 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-912274608 Oct 27 03:37:55.579651 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 3ab3d7ec4d294c8fbbb0c19559accba1 Oct 27 03:37:55.579651 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-912274608 Oct 27 03:37:55.579651 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-912274608-project Oct 27 03:37:55.579651 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:37:55.579651 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:37:55.579651 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: cbfbad32b0c64e98a852e16cc3acd654 Oct 27 03:37:55.579651 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-912274608-project Oct 27 03:37:55.579651 n-d-862769-1 devstack@n-api.service[121000]: Oct 27 03:37:55.579651 n-d-862769-1 devstack@n-api.service[121000]: {"security_group_rule": {"parent_group_id": "1a4dc134-d553-44a5-b752-5a566485fae4", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 27 03:37:55.579651 n-d-862769-1 devstack@n-api.service[121000]: method: Oct 27 03:37:55.579651 n-d-862769-1 devstack@n-api.service[121000]: exception: Security group 1a4dc134-d553-44a5-b752-5a566485fae4 does not exist Oct 27 03:37:55.579651 n-d-862769-1 devstack@n-api.service[121000]: Neutron server returns request_ids: ['req-59bf8caf-cb2a-43e2-8495-05ed9717a480'] Oct 27 03:37:55.579651 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'body': {'security_group_rule': {'parent_group_id': '1a4dc134-d553-44a5-b752-5a566485fae4', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 27 03:37:55.579651 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:37:55.579651 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:37:55.579651 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 27 03:37:55.579651 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 27 03:37:55.579651 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:37:55.579651 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:37:55.579651 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 27 03:37:55.579651 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 27 03:37:55.579651 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:37:55.579651 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:37:55.579651 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 27 03:37:55.579651 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 27 03:37:55.579651 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:37:55.579651 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:37:55.579651 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 03:37:55.579651 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 03:37:55.579651 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:37:55.579651 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:37:55.579651 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 03:37:55.579651 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 03:37:55.579651 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:37:55.579651 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:37:55.579651 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 03:37:55.579651 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 03:37:55.579651 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 03:37:55.584643 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 03:37:55.584643 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 1a4dc134-d553-44a5-b752-5a566485fae4 does not exist Oct 27 03:37:55.584643 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-59bf8caf-cb2a-43e2-8495-05ed9717a480'] Oct 27 03:37:55.584643 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:37:55.584643 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:37:55.584643 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:37:55.584643 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:37:55.584643 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Oct 27 03:37:55.584643 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Oct 27 03:37:55.584643 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 27 03:37:55.584643 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 27 03:37:55.584643 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 1a4dc134-d553-44a5-b752-5a566485fae4 does not exist Oct 27 03:37:55.584643 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-59bf8caf-cb2a-43e2-8495-05ed9717a480'] Oct 27 03:37:55.584643 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:37:55.584643 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:37:55.584643 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:37:55.584643 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:37:55.584643 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:37:55.584643 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:37:55.584643 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:37:55.584643 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:37:55.584643 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:37:55.584643 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:37:55.584643 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:37:55.584643 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:37:55.584643 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Oct 27 03:37:55.584643 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 27 03:37:55.584643 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 1a4dc134-d553-44a5-b752-5a566485fae4 does not exist Oct 27 03:37:55.584643 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-59bf8caf-cb2a-43e2-8495-05ed9717a480'] Oct 27 03:37:55.584643 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:37:55.584643 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:37:55.584643 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:37:55.584643 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:37:55.584643 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:37:55.584643 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:37:55.584643 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:37:55.584643 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:37:55.584643 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 1a4dc134-d553-44a5-b752-5a566485fae4 does not exist Oct 27 03:37:55.584643 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-59bf8caf-cb2a-43e2-8495-05ed9717a480'] Oct 27 03:37:55.584643 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:37:55.584643 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-60b9adcd-d801-4ac7-88a4-1356151f872f tempest-SecurityGroupRulesNegativeTestJSON-912274608 tempest-SecurityGroupRulesNegativeTestJSON-912274608-project] Returning 404 to user: Security group 1a4dc134-d553-44a5-b752-5a566485fae4 does not exist Oct 27 03:37:55.584643 n-d-862769-1 devstack@n-api.service[121000]: Neutron server returns request_ids: ['req-59bf8caf-cb2a-43e2-8495-05ed9717a480'] {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:37:55.584643 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-60b9adcd-d801-4ac7-88a4-1356151f872f tempest-SecurityGroupRulesNegativeTestJSON-912274608 tempest-SecurityGroupRulesNegativeTestJSON-912274608-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.061528 Oct 27 03:37:55.592028 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1889/4031] 10.222.0.20 () {60 vars in 1195 bytes} [Thu Oct 27 03:37:55 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:37:55.597548 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-154abcb1-a4b7-4ff7-ac6c-633e48adf074 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:55.598231 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-154abcb1-a4b7-4ff7-ac6c-633e48adf074 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 17bdf735-2944-4b40-984c-4646caa855f0] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:55.605258 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-154abcb1-a4b7-4ff7-ac6c-633e48adf074 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:55.605760 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-154abcb1-a4b7-4ff7-ac6c-633e48adf074 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:55.606257 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-154abcb1-a4b7-4ff7-ac6c-633e48adf074 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:55.607033 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-154abcb1-a4b7-4ff7-ac6c-633e48adf074 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:55.607497 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-154abcb1-a4b7-4ff7-ac6c-633e48adf074 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:55.607966 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-154abcb1-a4b7-4ff7-ac6c-633e48adf074 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:55.716277 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ff31be3f-9930-4da8-bfa5-04e4525de858 tempest-SecurityGroupsNegativeTestJSON-1746164540 tempest-SecurityGroupsNegativeTestJSON-1746164540-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.218517 Oct 27 03:37:55.716872 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2143/4032] 10.222.0.20 () {58 vars in 1158 bytes} [Thu Oct 27 03:37:55 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:37:55.721866 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a44d0efa-3716-4add-8390-056304d31fbe tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:55.723013 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a44d0efa-3716-4add-8390-056304d31fbe tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:55.730990 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a44d0efa-3716-4add-8390-056304d31fbe tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:55.738135 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a44d0efa-3716-4add-8390-056304d31fbe tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:55.738135 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a44d0efa-3716-4add-8390-056304d31fbe tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:55.738135 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a44d0efa-3716-4add-8390-056304d31fbe tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:55.738135 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a44d0efa-3716-4add-8390-056304d31fbe tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:55.738135 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a44d0efa-3716-4add-8390-056304d31fbe tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:55.749317 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-154abcb1-a4b7-4ff7-ac6c-633e48adf074 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:55.757456 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-154abcb1-a4b7-4ff7-ac6c-633e48adf074 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/17bdf735-2944-4b40-984c-4646caa855f0" status: 200 len: 1315 microversion: 2.1 time: 0.169352 Oct 27 03:37:55.762163 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1890/4033] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:55 2022] GET /compute/v2.1/servers/17bdf735-2944-4b40-984c-4646caa855f0 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:37:55.765867 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f9e77851-417f-451b-b340-e01906d8e4d5 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:55.772360 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f9e77851-417f-451b-b340-e01906d8e4d5 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:55.772879 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f9e77851-417f-451b-b340-e01906d8e4d5 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:55.773380 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f9e77851-417f-451b-b340-e01906d8e4d5 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:55.773825 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f9e77851-417f-451b-b340-e01906d8e4d5 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:55.774574 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f9e77851-417f-451b-b340-e01906d8e4d5 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:55.775040 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f9e77851-417f-451b-b340-e01906d8e4d5 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:55.775473 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f9e77851-417f-451b-b340-e01906d8e4d5 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:55.882647 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a44d0efa-3716-4add-8390-056304d31fbe tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:55.892142 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a44d0efa-3716-4add-8390-056304d31fbe tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1679 microversion: 2.1 time: 0.173923 Oct 27 03:37:55.892741 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2144/4034] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:55 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1679 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:37:55.898643 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-28c9a06f-e8d1-4b33-938a-3032ab142d75 tempest-SecurityGroupRulesNegativeTestJSON-912274608 tempest-SecurityGroupRulesNegativeTestJSON-912274608-project] Calling method '.version_select at 0x7f7dd9d55ca0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:55.921813 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f9e77851-417f-451b-b340-e01906d8e4d5 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:55.924190 n-d-862769-1 devstack@n-api.service[121001]: DEBUG neutronclient.v2_0.client [None req-28c9a06f-e8d1-4b33-938a-3032ab142d75 tempest-SecurityGroupRulesNegativeTestJSON-912274608 tempest-SecurityGroupRulesNegativeTestJSON-912274608-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 38495d33-eef2-4f16-b367-a608900d65d9 does not exist", "detail": ""}} {{(pid=121001) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 03:37:55.925247 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.network.security_group_api [None req-28c9a06f-e8d1-4b33-938a-3032ab142d75 tempest-SecurityGroupRulesNegativeTestJSON-912274608 tempest-SecurityGroupRulesNegativeTestJSON-912274608-project] Neutron security group rule 38495d33-eef2-4f16-b367-a608900d65d9 not found {{(pid=121001) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Oct 27 03:37:55.926334 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-28c9a06f-e8d1-4b33-938a-3032ab142d75 tempest-SecurityGroupRulesNegativeTestJSON-912274608 tempest-SecurityGroupRulesNegativeTestJSON-912274608-project] HTTP exception thrown: Security group rule 38495d33-eef2-4f16-b367-a608900d65d9 does not exist Oct 27 03:37:55.926334 n-d-862769-1 devstack@n-api.service[121001]: Neutron server returns request_ids: ['req-7bd84410-c05a-4c93-87a8-b946b41921c1'] Oct 27 03:37:55.928707 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-28c9a06f-e8d1-4b33-938a-3032ab142d75 tempest-SecurityGroupRulesNegativeTestJSON-912274608 tempest-SecurityGroupRulesNegativeTestJSON-912274608-project] Request method failure captured: Oct 27 03:37:55.928707 n-d-862769-1 devstack@n-api.service[121001]: request: DELETE /compute/v2.1/os-security-group-rules/38495d33-eef2-4f16-b367-a608900d65d9 HTTP/1.1 Oct 27 03:37:55.928707 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:37:55.928707 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:37:55.928707 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:37:55.928707 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:37:55.928707 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:37:55.928707 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:37:55.928707 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:37:55.928707 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:37:55.928707 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWf0C0EOecmyXIjI0mIbxm9OmM5e99cJTKTDmYm2Y90TBW3x1ZQJKrhE56xLOKh6WNvhGmoubByAWz9FxJaReoFbR2rjtgUECjWtOu_AWAk31mBxI8t5omUqYbUvEADlUhcungVw26cYsWVJNUaosfYD1hHQOoaXzpzRlG0pv1I_b1VE Oct 27 03:37:55.928707 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:37:55.928707 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:37:55.928707 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:37:55.928707 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:37:55.928707 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:37:55.928707 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:37:55.928707 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 3ab3d7ec4d294c8fbbb0c19559accba1 Oct 27 03:37:55.928707 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-912274608 Oct 27 03:37:55.928707 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:37:55.928707 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:37:55.928707 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3ab3d7ec4d294c8fbbb0c19559accba1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3ab3d7ec4d294c8fbbb0c19559accba1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3ab3d7ec4d294c8fbbb0c19559accba1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3ab3d7ec4d294c8fbbb0c19559accba1"}]}] Oct 27 03:37:55.928707 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-912274608 Oct 27 03:37:55.928707 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 3ab3d7ec4d294c8fbbb0c19559accba1 Oct 27 03:37:55.928707 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-912274608 Oct 27 03:37:55.928707 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-912274608-project Oct 27 03:37:55.928707 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:37:55.928707 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:37:55.928707 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: cbfbad32b0c64e98a852e16cc3acd654 Oct 27 03:37:55.928707 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-912274608-project Oct 27 03:37:55.928707 n-d-862769-1 devstack@n-api.service[121001]: method: Oct 27 03:37:55.928707 n-d-862769-1 devstack@n-api.service[121001]: exception: Security group rule 38495d33-eef2-4f16-b367-a608900d65d9 does not exist Oct 27 03:37:55.928707 n-d-862769-1 devstack@n-api.service[121001]: Neutron server returns request_ids: ['req-7bd84410-c05a-4c93-87a8-b946b41921c1'] Oct 27 03:37:55.928707 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '38495d33-eef2-4f16-b367-a608900d65d9'} Oct 27 03:37:55.928707 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:37:55.928707 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:37:55.928707 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Oct 27 03:37:55.928707 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Oct 27 03:37:55.928707 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:37:55.928707 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:37:55.928707 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Oct 27 03:37:55.928707 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Oct 27 03:37:55.928707 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:37:55.928707 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:37:55.928707 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 27 03:37:55.928707 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 27 03:37:55.928707 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:37:55.928707 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:37:55.928707 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 03:37:55.928707 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 03:37:55.928707 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:37:55.928707 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:37:55.928707 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 03:37:55.928707 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 03:37:55.928707 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:37:55.928707 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:37:55.928707 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 03:37:55.928707 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 03:37:55.928707 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 03:37:55.928707 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 03:37:55.933802 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 38495d33-eef2-4f16-b367-a608900d65d9 does not exist Oct 27 03:37:55.933802 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7bd84410-c05a-4c93-87a8-b946b41921c1'] Oct 27 03:37:55.933802 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:37:55.933802 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:37:55.933802 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:37:55.933802 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:37:55.933802 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Oct 27 03:37:55.933802 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Oct 27 03:37:55.933802 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Oct 27 03:37:55.933802 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 27 03:37:55.933802 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 38495d33-eef2-4f16-b367-a608900d65d9 does not exist Oct 27 03:37:55.933802 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7bd84410-c05a-4c93-87a8-b946b41921c1'] Oct 27 03:37:55.933802 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:37:55.933802 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:37:55.933802 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:37:55.933802 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:37:55.933802 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:37:55.933802 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:37:55.933802 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:37:55.933802 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:37:55.933802 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:37:55.933802 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:37:55.933802 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:37:55.933802 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:37:55.933802 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Oct 27 03:37:55.933802 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 27 03:37:55.933802 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 38495d33-eef2-4f16-b367-a608900d65d9 does not exist Oct 27 03:37:55.933802 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7bd84410-c05a-4c93-87a8-b946b41921c1'] Oct 27 03:37:55.933802 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:37:55.933802 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:37:55.933802 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:37:55.933802 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:37:55.933802 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:37:55.933802 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:37:55.933802 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:37:55.933802 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:37:55.933802 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 38495d33-eef2-4f16-b367-a608900d65d9 does not exist Oct 27 03:37:55.933802 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7bd84410-c05a-4c93-87a8-b946b41921c1'] Oct 27 03:37:55.933802 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:37:55.940091 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f9e77851-417f-451b-b340-e01906d8e4d5 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1505 microversion: 2.1 time: 0.169275 Oct 27 03:37:55.940091 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1891/4035] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:55 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1505 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:37:55.940352 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-28c9a06f-e8d1-4b33-938a-3032ab142d75 tempest-SecurityGroupRulesNegativeTestJSON-912274608 tempest-SecurityGroupRulesNegativeTestJSON-912274608-project] Returning 404 to user: Security group rule 38495d33-eef2-4f16-b367-a608900d65d9 does not exist Oct 27 03:37:55.940352 n-d-862769-1 devstack@n-api.service[121001]: Neutron server returns request_ids: ['req-7bd84410-c05a-4c93-87a8-b946b41921c1'] {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:37:55.940770 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1e28c20c-dd59-4a40-9f8a-8db3cac40707 tempest-SecurityGroupsNegativeTestJSON-1746164540 tempest-SecurityGroupsNegativeTestJSON-1746164540-project] Calling method '.version_select at 0x7f7dd9d599d0>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:55.941472 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-28c9a06f-e8d1-4b33-938a-3032ab142d75 tempest-SecurityGroupRulesNegativeTestJSON-912274608 tempest-SecurityGroupRulesNegativeTestJSON-912274608-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-group-rules/38495d33-eef2-4f16-b367-a608900d65d9" status: 404 len: 199 microversion: 2.1 time: 0.042398 Oct 27 03:37:55.941472 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2145/4036] 10.222.0.20 () {58 vars in 1287 bytes} [Thu Oct 27 03:37:55 2022] DELETE /compute/v2.1/os-security-group-rules/38495d33-eef2-4f16-b367-a608900d65d9 => generated 199 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:37:55.950271 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-cfa81136-8aad-419a-ba6c-b57e632588af tempest-SecurityGroupRulesNegativeTestJSON-912274608 tempest-SecurityGroupRulesNegativeTestJSON-912274608-project] Calling method '.version_select at 0x7f7dd9fb2790>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:56.065400 n-d-862769-1 devstack@n-api.service[121000]: DEBUG neutronclient.v2_0.client [None req-1e28c20c-dd59-4a40-9f8a-8db3cac40707 tempest-SecurityGroupsNegativeTestJSON-1746164540 tempest-SecurityGroupsNegativeTestJSON-1746164540-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=121000) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 03:37:56.066206 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-1e28c20c-dd59-4a40-9f8a-8db3cac40707 tempest-SecurityGroupsNegativeTestJSON-1746164540 tempest-SecurityGroupsNegativeTestJSON-1746164540-project] HTTP exception thrown: Insufficient rights for removing default security group. Oct 27 03:37:56.066206 n-d-862769-1 devstack@n-api.service[121000]: Neutron server returns request_ids: ['req-b6b923e1-8ef5-4a49-ab73-27cbe37f2f07'] Oct 27 03:37:56.068115 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1e28c20c-dd59-4a40-9f8a-8db3cac40707 tempest-SecurityGroupsNegativeTestJSON-1746164540 tempest-SecurityGroupsNegativeTestJSON-1746164540-project] Request method failure captured: Oct 27 03:37:56.068115 n-d-862769-1 devstack@n-api.service[121000]: request: DELETE /compute/v2.1/os-security-groups/266b8d4e-2832-4903-a02c-717c4d64b841 HTTP/1.1 Oct 27 03:37:56.068115 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:37:56.068115 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:37:56.068115 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:37:56.068115 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:37:56.068115 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:37:56.068115 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:37:56.068115 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:37:56.068115 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:37:56.068115 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWf0SpFxbna_xGRthxIV0d_XKbF042AAWGYo9YU8k9EyYaDTWOy_vzQSZJsgJ6UsrIgj9IsPzMVEiJldyuSZ4n3eVg-4tdF6R7jiHS6chs5wl_SR4NYDdpuN4JqXjATqOqM69NivzpyaYnARvEKVUWGHixdRaTmlzhVkO9Lsma1bGXxQ Oct 27 03:37:56.068115 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:37:56.068115 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:37:56.068115 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:37:56.068115 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:37:56.068115 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:37:56.068115 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:37:56.068115 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: d60717661c654932ba6adb856af896b6 Oct 27 03:37:56.068115 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1746164540 Oct 27 03:37:56.068115 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:37:56.068115 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:37:56.068115 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d60717661c654932ba6adb856af896b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d60717661c654932ba6adb856af896b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d60717661c654932ba6adb856af896b6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d60717661c654932ba6adb856af896b6"}]}] Oct 27 03:37:56.068115 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1746164540 Oct 27 03:37:56.068115 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: d60717661c654932ba6adb856af896b6 Oct 27 03:37:56.068115 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1746164540 Oct 27 03:37:56.068115 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-SecurityGroupsNegativeTestJSON-1746164540-project Oct 27 03:37:56.068115 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:37:56.068115 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:37:56.068115 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: f3bdefb00cb847f5bd55a2e42dc0b277 Oct 27 03:37:56.068115 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1746164540-project Oct 27 03:37:56.068115 n-d-862769-1 devstack@n-api.service[121000]: method: Oct 27 03:37:56.068115 n-d-862769-1 devstack@n-api.service[121000]: exception: Insufficient rights for removing default security group. Oct 27 03:37:56.068115 n-d-862769-1 devstack@n-api.service[121000]: Neutron server returns request_ids: ['req-b6b923e1-8ef5-4a49-ab73-27cbe37f2f07'] Oct 27 03:37:56.068115 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '266b8d4e-2832-4903-a02c-717c4d64b841'} Oct 27 03:37:56.068115 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:37:56.068115 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:37:56.068115 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 27 03:37:56.068115 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 27 03:37:56.068115 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:37:56.068115 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:37:56.068115 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 27 03:37:56.068115 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 27 03:37:56.068115 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:37:56.068115 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:37:56.068115 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 27 03:37:56.068115 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 27 03:37:56.068115 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:37:56.068115 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:37:56.068115 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 03:37:56.068115 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 03:37:56.068115 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:37:56.068115 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:37:56.068115 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 03:37:56.068115 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 03:37:56.068115 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:37:56.068115 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:37:56.068115 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 03:37:56.068115 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 03:37:56.068115 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 03:37:56.068115 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 03:37:56.068115 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Oct 27 03:37:56.073028 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b6b923e1-8ef5-4a49-ab73-27cbe37f2f07'] Oct 27 03:37:56.073028 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:37:56.073028 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:37:56.073028 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:37:56.073028 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:37:56.073028 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 27 03:37:56.073028 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 27 03:37:56.073028 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 27 03:37:56.073028 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 27 03:37:56.073028 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Oct 27 03:37:56.073028 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b6b923e1-8ef5-4a49-ab73-27cbe37f2f07'] Oct 27 03:37:56.073028 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:37:56.073028 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:37:56.073028 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:37:56.073028 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:37:56.073028 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:37:56.073028 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:37:56.073028 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:37:56.073028 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:37:56.073028 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:37:56.073028 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:37:56.073028 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:37:56.073028 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:37:56.073028 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 27 03:37:56.073028 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 27 03:37:56.073028 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Oct 27 03:37:56.073028 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b6b923e1-8ef5-4a49-ab73-27cbe37f2f07'] Oct 27 03:37:56.073028 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:37:56.073028 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:37:56.073028 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:37:56.073028 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:37:56.073028 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:37:56.073028 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:37:56.073028 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:37:56.073028 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:37:56.073028 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Oct 27 03:37:56.073028 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b6b923e1-8ef5-4a49-ab73-27cbe37f2f07'] Oct 27 03:37:56.073028 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:37:56.073028 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1e28c20c-dd59-4a40-9f8a-8db3cac40707 tempest-SecurityGroupsNegativeTestJSON-1746164540 tempest-SecurityGroupsNegativeTestJSON-1746164540-project] Returning 400 to user: Insufficient rights for removing default security group. Oct 27 03:37:56.073028 n-d-862769-1 devstack@n-api.service[121000]: Neutron server returns request_ids: ['req-b6b923e1-8ef5-4a49-ab73-27cbe37f2f07'] {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:37:56.073028 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1e28c20c-dd59-4a40-9f8a-8db3cac40707 tempest-SecurityGroupsNegativeTestJSON-1746164540 tempest-SecurityGroupsNegativeTestJSON-1746164540-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/266b8d4e-2832-4903-a02c-717c4d64b841" status: 400 len: 182 microversion: 2.1 time: 0.138239 Oct 27 03:37:56.073028 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1892/4037] 10.222.0.20 () {58 vars in 1272 bytes} [Thu Oct 27 03:37:55 2022] DELETE /compute/v2.1/os-security-groups/266b8d4e-2832-4903-a02c-717c4d64b841 => generated 182 bytes in 139 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 03:37:56.076795 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-24ee1473-dad8-4f91-b992-d503605a3a63 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:37:56.088498 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-24ee1473-dad8-4f91-b992-d503605a3a63 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] HTTP exception thrown: Instance 7cb5d713-cb0d-4f8f-a174-85f775931414 has no mapping to a cell. Oct 27 03:37:56.104887 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-24ee1473-dad8-4f91-b992-d503605a3a63 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Request method failure captured: Oct 27 03:37:56.104887 n-d-862769-1 devstack@n-api.service[121000]: request: POST /compute/v2.1/servers/7cb5d713-cb0d-4f8f-a174-85f775931414/action HTTP/1.1 Oct 27 03:37:56.104887 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:37:56.104887 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:37:56.104887 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:37:56.104887 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 15 Oct 27 03:37:56.104887 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:37:56.104887 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:37:56.104887 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:37:56.104887 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:37:56.104887 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfxF6ut9nM9a9AcpKLO7IgCu-akAJ2YJGjrI9C8NUveA8uObV2XgQIQvsIxuWjvLl9meIEqpfGwZYr8MTX_PAGoiJsNUPXh5ERSce5cPYQYCCFPL0HtTb-E11C_2kfWy1wRps1tClRNvtj8zAqCGRhs1x-Uvl0zISdfHepXmvWX31Us Oct 27 03:37:56.104887 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:37:56.104887 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:37:56.104887 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:37:56.104887 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:37:56.104887 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:37:56.104887 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:37:56.104887 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 8bb5d291069d4329a90123e327fe9c59 Oct 27 03:37:56.104887 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:37:56.104887 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:37:56.104887 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:37:56.104887 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8bb5d291069d4329a90123e327fe9c59"}]}] Oct 27 03:37:56.104887 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:37:56.104887 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 8bb5d291069d4329a90123e327fe9c59 Oct 27 03:37:56.104887 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:37:56.104887 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ServersNegativeTestJSON-4378389-project Oct 27 03:37:56.104887 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:37:56.104887 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:37:56.104887 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: f9c32b7626594ff888970c7f3227bb20 Oct 27 03:37:56.104887 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ServersNegativeTestJSON-4378389-project Oct 27 03:37:56.104887 n-d-862769-1 devstack@n-api.service[121000]: Oct 27 03:37:56.104887 n-d-862769-1 devstack@n-api.service[121000]: {"os-stop": {}} Oct 27 03:37:56.104887 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:37:56.104887 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 7cb5d713-cb0d-4f8f-a174-85f775931414 has no mapping to a cell. Oct 27 03:37:56.104887 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '7cb5d713-cb0d-4f8f-a174-85f775931414', 'body': {'os-stop': {}}} Oct 27 03:37:56.104887 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:37:56.104887 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:37:56.104887 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1411, in _get_instance Oct 27 03:37:56.104887 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Oct 27 03:37:56.104887 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 03:37:56.104887 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 03:37:56.104887 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Oct 27 03:37:56.104887 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 27 03:37:56.104887 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 03:37:56.104887 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 03:37:56.104887 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Oct 27 03:37:56.104887 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Oct 27 03:37:56.104887 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 7cb5d713-cb0d-4f8f-a174-85f775931414 has no mapping to a cell. Oct 27 03:37:56.104887 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:37:56.104887 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:37:56.104887 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:37:56.104887 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:37:56.104887 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:37:56.104887 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:37:56.104887 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:37:56.104887 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:37:56.104887 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:37:56.104887 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:37:56.104887 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1444, in _stop_server Oct 27 03:37:56.104887 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Oct 27 03:37:56.104887 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1418, in _get_instance Oct 27 03:37:56.104887 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:37:56.104887 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cb5d713-cb0d-4f8f-a174-85f775931414 has no mapping to a cell. Oct 27 03:37:56.116538 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:37:56.116538 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:37:56.116538 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:37:56.116538 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:37:56.116538 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:37:56.116538 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:37:56.116538 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:37:56.116538 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:37:56.116538 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cb5d713-cb0d-4f8f-a174-85f775931414 has no mapping to a cell. Oct 27 03:37:56.116538 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:37:56.116538 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-24ee1473-dad8-4f91-b992-d503605a3a63 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Returning 404 to user: Instance 7cb5d713-cb0d-4f8f-a174-85f775931414 has no mapping to a cell. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:37:56.116538 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-24ee1473-dad8-4f91-b992-d503605a3a63 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "POST /compute/v2.1/servers/7cb5d713-cb0d-4f8f-a174-85f775931414/action" status: 404 len: 117 microversion: 2.1 time: 0.035892 Oct 27 03:37:56.116538 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1893/4038] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:37:56 2022] POST /compute/v2.1/servers/7cb5d713-cb0d-4f8f-a174-85f775931414/action => generated 117 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:37:56.119012 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6e3b9810-3eed-48a2-8b44-8a1801d936aa tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:56.119762 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6e3b9810-3eed-48a2-8b44-8a1801d936aa tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] [instance: 7e73d534-0a40-42d2-813c-2e9dbb9239ac] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:56.126445 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6e3b9810-3eed-48a2-8b44-8a1801d936aa tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:56.127073 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6e3b9810-3eed-48a2-8b44-8a1801d936aa tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:56.127609 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6e3b9810-3eed-48a2-8b44-8a1801d936aa tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:56.128438 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6e3b9810-3eed-48a2-8b44-8a1801d936aa tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:56.128991 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6e3b9810-3eed-48a2-8b44-8a1801d936aa tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:56.129664 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6e3b9810-3eed-48a2-8b44-8a1801d936aa tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:56.201873 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-6e3b9810-3eed-48a2-8b44-8a1801d936aa tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:56.212052 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-6e3b9810-3eed-48a2-8b44-8a1801d936aa tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:56.213765 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-6e3b9810-3eed-48a2-8b44-8a1801d936aa tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:56.215154 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6e3b9810-3eed-48a2-8b44-8a1801d936aa tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] 10.222.0.20 "GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac" status: 200 len: 1593 microversion: 2.32 time: 0.105929 Oct 27 03:37:56.215721 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1894/4039] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:37:56 2022] GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac => generated 1593 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:37:56.220336 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d5527312-6229-48a5-8a32-888d3b2ccf14 tempest-SecurityGroupsNegativeTestJSON-1746164540 tempest-SecurityGroupsNegativeTestJSON-1746164540-project] Calling method '.version_select at 0x7f7ddaa61f70>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:56.243591 n-d-862769-1 devstack@n-api.service[121000]: DEBUG neutronclient.v2_0.client [None req-d5527312-6229-48a5-8a32-888d3b2ccf14 tempest-SecurityGroupsNegativeTestJSON-1746164540 tempest-SecurityGroupsNegativeTestJSON-1746164540-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 67fa3bca-0d50-40fd-a32b-9ca24ff9618e does not exist", "detail": ""}} {{(pid=121000) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 03:37:56.244218 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.security_group_api [None req-d5527312-6229-48a5-8a32-888d3b2ccf14 tempest-SecurityGroupsNegativeTestJSON-1746164540 tempest-SecurityGroupsNegativeTestJSON-1746164540-project] Neutron security group 67fa3bca-0d50-40fd-a32b-9ca24ff9618e not found {{(pid=121000) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 27 03:37:56.244796 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-d5527312-6229-48a5-8a32-888d3b2ccf14 tempest-SecurityGroupsNegativeTestJSON-1746164540 tempest-SecurityGroupsNegativeTestJSON-1746164540-project] HTTP exception thrown: Security group 67fa3bca-0d50-40fd-a32b-9ca24ff9618e does not exist Oct 27 03:37:56.244796 n-d-862769-1 devstack@n-api.service[121000]: Neutron server returns request_ids: ['req-a2c363ec-01db-4608-b6ce-8507d9a14e1a'] Oct 27 03:37:56.247370 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d5527312-6229-48a5-8a32-888d3b2ccf14 tempest-SecurityGroupsNegativeTestJSON-1746164540 tempest-SecurityGroupsNegativeTestJSON-1746164540-project] Request method failure captured: Oct 27 03:37:56.247370 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/os-security-groups/67fa3bca-0d50-40fd-a32b-9ca24ff9618e HTTP/1.1 Oct 27 03:37:56.247370 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:37:56.247370 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:37:56.247370 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:37:56.247370 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:37:56.247370 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:37:56.247370 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:37:56.247370 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:37:56.247370 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:37:56.247370 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWf0SpFxbna_xGRthxIV0d_XKbF042AAWGYo9YU8k9EyYaDTWOy_vzQSZJsgJ6UsrIgj9IsPzMVEiJldyuSZ4n3eVg-4tdF6R7jiHS6chs5wl_SR4NYDdpuN4JqXjATqOqM69NivzpyaYnARvEKVUWGHixdRaTmlzhVkO9Lsma1bGXxQ Oct 27 03:37:56.247370 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:37:56.247370 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:37:56.247370 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:37:56.247370 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:37:56.247370 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:37:56.247370 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:37:56.247370 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: d60717661c654932ba6adb856af896b6 Oct 27 03:37:56.247370 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1746164540 Oct 27 03:37:56.247370 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:37:56.247370 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:37:56.247370 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d60717661c654932ba6adb856af896b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d60717661c654932ba6adb856af896b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d60717661c654932ba6adb856af896b6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d60717661c654932ba6adb856af896b6"}]}] Oct 27 03:37:56.247370 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1746164540 Oct 27 03:37:56.247370 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: d60717661c654932ba6adb856af896b6 Oct 27 03:37:56.247370 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1746164540 Oct 27 03:37:56.247370 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-SecurityGroupsNegativeTestJSON-1746164540-project Oct 27 03:37:56.247370 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:37:56.247370 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:37:56.247370 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: f3bdefb00cb847f5bd55a2e42dc0b277 Oct 27 03:37:56.247370 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1746164540-project Oct 27 03:37:56.247370 n-d-862769-1 devstack@n-api.service[121000]: method: Oct 27 03:37:56.247370 n-d-862769-1 devstack@n-api.service[121000]: exception: Security group 67fa3bca-0d50-40fd-a32b-9ca24ff9618e does not exist Oct 27 03:37:56.247370 n-d-862769-1 devstack@n-api.service[121000]: Neutron server returns request_ids: ['req-a2c363ec-01db-4608-b6ce-8507d9a14e1a'] Oct 27 03:37:56.247370 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '67fa3bca-0d50-40fd-a32b-9ca24ff9618e'} Oct 27 03:37:56.247370 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:37:56.247370 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:37:56.247370 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 27 03:37:56.247370 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 27 03:37:56.247370 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:37:56.247370 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:37:56.247370 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 27 03:37:56.247370 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 27 03:37:56.247370 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:37:56.247370 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:37:56.247370 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 27 03:37:56.247370 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 27 03:37:56.247370 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:37:56.247370 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:37:56.247370 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 03:37:56.247370 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 03:37:56.247370 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:37:56.247370 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:37:56.247370 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 03:37:56.247370 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 03:37:56.247370 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:37:56.247370 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:37:56.247370 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 03:37:56.247370 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 03:37:56.247370 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 03:37:56.247370 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 03:37:56.247370 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 67fa3bca-0d50-40fd-a32b-9ca24ff9618e does not exist Oct 27 03:37:56.252418 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a2c363ec-01db-4608-b6ce-8507d9a14e1a'] Oct 27 03:37:56.252418 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:37:56.252418 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:37:56.252418 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:37:56.252418 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:37:56.252418 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 27 03:37:56.252418 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 27 03:37:56.252418 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 27 03:37:56.252418 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 27 03:37:56.252418 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 67fa3bca-0d50-40fd-a32b-9ca24ff9618e does not exist Oct 27 03:37:56.252418 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a2c363ec-01db-4608-b6ce-8507d9a14e1a'] Oct 27 03:37:56.252418 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:37:56.252418 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:37:56.252418 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:37:56.252418 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:37:56.252418 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:37:56.252418 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:37:56.252418 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:37:56.252418 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:37:56.252418 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:37:56.252418 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:37:56.252418 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:37:56.252418 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:37:56.252418 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 27 03:37:56.252418 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 27 03:37:56.252418 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 67fa3bca-0d50-40fd-a32b-9ca24ff9618e does not exist Oct 27 03:37:56.252418 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a2c363ec-01db-4608-b6ce-8507d9a14e1a'] Oct 27 03:37:56.252418 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:37:56.252418 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:37:56.252418 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:37:56.252418 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:37:56.252418 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:37:56.252418 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:37:56.252418 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:37:56.252418 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:37:56.252418 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 67fa3bca-0d50-40fd-a32b-9ca24ff9618e does not exist Oct 27 03:37:56.252418 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a2c363ec-01db-4608-b6ce-8507d9a14e1a'] Oct 27 03:37:56.252418 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:37:56.252418 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d5527312-6229-48a5-8a32-888d3b2ccf14 tempest-SecurityGroupsNegativeTestJSON-1746164540 tempest-SecurityGroupsNegativeTestJSON-1746164540-project] Returning 404 to user: Security group 67fa3bca-0d50-40fd-a32b-9ca24ff9618e does not exist Oct 27 03:37:56.252418 n-d-862769-1 devstack@n-api.service[121000]: Neutron server returns request_ids: ['req-a2c363ec-01db-4608-b6ce-8507d9a14e1a'] {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:37:56.252418 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d5527312-6229-48a5-8a32-888d3b2ccf14 tempest-SecurityGroupsNegativeTestJSON-1746164540 tempest-SecurityGroupsNegativeTestJSON-1746164540-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups/67fa3bca-0d50-40fd-a32b-9ca24ff9618e" status: 404 len: 194 microversion: 2.1 time: 0.032192 Oct 27 03:37:56.252418 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1895/4040] 10.222.0.20 () {58 vars in 1269 bytes} [Thu Oct 27 03:37:56 2022] GET /compute/v2.1/os-security-groups/67fa3bca-0d50-40fd-a32b-9ca24ff9618e => generated 194 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:37:56.258365 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-cfa81136-8aad-419a-ba6c-b57e632588af tempest-SecurityGroupRulesNegativeTestJSON-912274608 tempest-SecurityGroupRulesNegativeTestJSON-912274608-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/9a62843b-98b4-4a7e-85b5-266bbc60a9ac" status: 202 len: 0 microversion: 2.1 time: 0.312896 Oct 27 03:37:56.259152 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2146/4041] 10.222.0.20 () {58 vars in 1272 bytes} [Thu Oct 27 03:37:55 2022] DELETE /compute/v2.1/os-security-groups/9a62843b-98b4-4a7e-85b5-266bbc60a9ac => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:37:56.264255 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-fa534e17-6d96-4637-b7a5-a7818e4d214b tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:56.264890 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-fa534e17-6d96-4637-b7a5-a7818e4d214b tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:56.265030 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-747b0eff-ff39-4234-b625-01c44b4166a5 tempest-SecurityGroupsNegativeTestJSON-1746164540 tempest-SecurityGroupsNegativeTestJSON-1746164540-project] Action: 'update', calling method: .version_select at 0x7f7ddac48d30>, body: {"security_group": {"name": "tempest-sg-1230878843", "description": "tempest-description-604203289"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:37:56.278360 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fa534e17-6d96-4637-b7a5-a7818e4d214b tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:56.279099 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fa534e17-6d96-4637-b7a5-a7818e4d214b tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:56.279621 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fa534e17-6d96-4637-b7a5-a7818e4d214b tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:56.280517 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fa534e17-6d96-4637-b7a5-a7818e4d214b tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:56.281160 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fa534e17-6d96-4637-b7a5-a7818e4d214b tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:56.281730 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fa534e17-6d96-4637-b7a5-a7818e4d214b tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:56.291503 n-d-862769-1 devstack@n-api.service[121001]: DEBUG neutronclient.v2_0.client [None req-747b0eff-ff39-4234-b625-01c44b4166a5 tempest-SecurityGroupsNegativeTestJSON-1746164540 tempest-SecurityGroupsNegativeTestJSON-1746164540-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 2e6ec46e-d7cf-4396-a415-77239c6ff3e6 does not exist", "detail": ""}} {{(pid=121001) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 03:37:56.292117 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.network.security_group_api [None req-747b0eff-ff39-4234-b625-01c44b4166a5 tempest-SecurityGroupsNegativeTestJSON-1746164540 tempest-SecurityGroupsNegativeTestJSON-1746164540-project] Neutron security group 2e6ec46e-d7cf-4396-a415-77239c6ff3e6 not found {{(pid=121001) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 27 03:37:56.293374 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-747b0eff-ff39-4234-b625-01c44b4166a5 tempest-SecurityGroupsNegativeTestJSON-1746164540 tempest-SecurityGroupsNegativeTestJSON-1746164540-project] HTTP exception thrown: Security group 2e6ec46e-d7cf-4396-a415-77239c6ff3e6 does not exist Oct 27 03:37:56.293374 n-d-862769-1 devstack@n-api.service[121001]: Neutron server returns request_ids: ['req-8c5b0f8e-d331-4232-8d66-1837427fce97'] Oct 27 03:37:56.295319 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-747b0eff-ff39-4234-b625-01c44b4166a5 tempest-SecurityGroupsNegativeTestJSON-1746164540 tempest-SecurityGroupsNegativeTestJSON-1746164540-project] Request method failure captured: Oct 27 03:37:56.295319 n-d-862769-1 devstack@n-api.service[121001]: request: PUT /compute/v2.1/os-security-groups/2e6ec46e-d7cf-4396-a415-77239c6ff3e6 HTTP/1.1 Oct 27 03:37:56.295319 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:37:56.295319 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:37:56.295319 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:37:56.295319 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 101 Oct 27 03:37:56.295319 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:37:56.295319 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:37:56.295319 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:37:56.295319 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:37:56.295319 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWf0SpFxbna_xGRthxIV0d_XKbF042AAWGYo9YU8k9EyYaDTWOy_vzQSZJsgJ6UsrIgj9IsPzMVEiJldyuSZ4n3eVg-4tdF6R7jiHS6chs5wl_SR4NYDdpuN4JqXjATqOqM69NivzpyaYnARvEKVUWGHixdRaTmlzhVkO9Lsma1bGXxQ Oct 27 03:37:56.295319 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:37:56.295319 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:37:56.295319 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:37:56.295319 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:37:56.295319 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:37:56.295319 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:37:56.295319 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: d60717661c654932ba6adb856af896b6 Oct 27 03:37:56.295319 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1746164540 Oct 27 03:37:56.295319 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:37:56.295319 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:37:56.295319 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d60717661c654932ba6adb856af896b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d60717661c654932ba6adb856af896b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d60717661c654932ba6adb856af896b6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d60717661c654932ba6adb856af896b6"}]}] Oct 27 03:37:56.295319 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1746164540 Oct 27 03:37:56.295319 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: d60717661c654932ba6adb856af896b6 Oct 27 03:37:56.295319 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1746164540 Oct 27 03:37:56.295319 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-SecurityGroupsNegativeTestJSON-1746164540-project Oct 27 03:37:56.295319 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:37:56.295319 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:37:56.295319 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: f3bdefb00cb847f5bd55a2e42dc0b277 Oct 27 03:37:56.295319 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1746164540-project Oct 27 03:37:56.295319 n-d-862769-1 devstack@n-api.service[121001]: Oct 27 03:37:56.295319 n-d-862769-1 devstack@n-api.service[121001]: {"security_group": {"name": "tempest-sg-1230878843", "description": "tempest-description-604203289"}} Oct 27 03:37:56.295319 n-d-862769-1 devstack@n-api.service[121001]: method: Oct 27 03:37:56.295319 n-d-862769-1 devstack@n-api.service[121001]: exception: Security group 2e6ec46e-d7cf-4396-a415-77239c6ff3e6 does not exist Oct 27 03:37:56.295319 n-d-862769-1 devstack@n-api.service[121001]: Neutron server returns request_ids: ['req-8c5b0f8e-d331-4232-8d66-1837427fce97'] Oct 27 03:37:56.295319 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '2e6ec46e-d7cf-4396-a415-77239c6ff3e6', 'body': {'security_group': {'name': 'tempest-sg-1230878843', 'description': 'tempest-description-604203289'}}} Oct 27 03:37:56.295319 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:37:56.295319 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:37:56.295319 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 27 03:37:56.295319 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 27 03:37:56.295319 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:37:56.295319 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:37:56.295319 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 27 03:37:56.295319 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 27 03:37:56.295319 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:37:56.295319 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:37:56.295319 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 27 03:37:56.295319 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 27 03:37:56.295319 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:37:56.295319 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:37:56.295319 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 03:37:56.295319 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 03:37:56.295319 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:37:56.295319 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:37:56.295319 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 03:37:56.295319 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 03:37:56.295319 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 03:37:56.295319 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 03:37:56.295319 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 03:37:56.295319 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 03:37:56.295319 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 03:37:56.301320 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 03:37:56.301320 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 2e6ec46e-d7cf-4396-a415-77239c6ff3e6 does not exist Oct 27 03:37:56.301320 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8c5b0f8e-d331-4232-8d66-1837427fce97'] Oct 27 03:37:56.301320 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:37:56.301320 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:37:56.301320 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:37:56.301320 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:37:56.301320 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Oct 27 03:37:56.301320 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 27 03:37:56.301320 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 27 03:37:56.301320 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 27 03:37:56.301320 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 2e6ec46e-d7cf-4396-a415-77239c6ff3e6 does not exist Oct 27 03:37:56.301320 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8c5b0f8e-d331-4232-8d66-1837427fce97'] Oct 27 03:37:56.301320 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:37:56.301320 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:37:56.301320 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:37:56.301320 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:37:56.301320 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:37:56.301320 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:37:56.301320 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:37:56.301320 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:37:56.301320 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:37:56.301320 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:37:56.301320 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:37:56.301320 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:37:56.301320 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Oct 27 03:37:56.301320 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 27 03:37:56.301320 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 2e6ec46e-d7cf-4396-a415-77239c6ff3e6 does not exist Oct 27 03:37:56.301320 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8c5b0f8e-d331-4232-8d66-1837427fce97'] Oct 27 03:37:56.301320 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:37:56.301320 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:37:56.301320 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:37:56.301320 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:37:56.301320 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:37:56.301320 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:37:56.301320 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:37:56.301320 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:37:56.301320 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 2e6ec46e-d7cf-4396-a415-77239c6ff3e6 does not exist Oct 27 03:37:56.301320 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8c5b0f8e-d331-4232-8d66-1837427fce97'] Oct 27 03:37:56.301320 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:37:56.301320 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-747b0eff-ff39-4234-b625-01c44b4166a5 tempest-SecurityGroupsNegativeTestJSON-1746164540 tempest-SecurityGroupsNegativeTestJSON-1746164540-project] Returning 404 to user: Security group 2e6ec46e-d7cf-4396-a415-77239c6ff3e6 does not exist Oct 27 03:37:56.301320 n-d-862769-1 devstack@n-api.service[121001]: Neutron server returns request_ids: ['req-8c5b0f8e-d331-4232-8d66-1837427fce97'] {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:37:56.301320 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-747b0eff-ff39-4234-b625-01c44b4166a5 tempest-SecurityGroupsNegativeTestJSON-1746164540 tempest-SecurityGroupsNegativeTestJSON-1746164540-project] 10.222.0.20 "PUT /compute/v2.1/os-security-groups/2e6ec46e-d7cf-4396-a415-77239c6ff3e6" status: 404 len: 194 microversion: 2.1 time: 0.036386 Oct 27 03:37:56.301320 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2147/4042] 10.222.0.20 () {60 vars in 1290 bytes} [Thu Oct 27 03:37:56 2022] PUT /compute/v2.1/os-security-groups/2e6ec46e-d7cf-4396-a415-77239c6ff3e6 => generated 194 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:37:56.306740 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9020a654-1498-4172-bda6-c3b0247aeccc tempest-SecurityGroupRulesNegativeTestJSON-912274608 tempest-SecurityGroupRulesNegativeTestJSON-912274608-project] Calling method '.version_select at 0x7f7dd9fa1f70>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:56.514468 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=8 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:37:56.569047 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-fa534e17-6d96-4637-b7a5-a7818e4d214b tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:56.579272 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-fa534e17-6d96-4637-b7a5-a7818e4d214b tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1505 microversion: 2.1 time: 0.328698 Oct 27 03:37:56.579868 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1896/4043] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:56 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1505 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:37:56.607030 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-18945e35-8dd6-40e2-8766-991996543fed tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:56.611895 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-18945e35-8dd6-40e2-8766-991996543fed tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:56.614281 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-18945e35-8dd6-40e2-8766-991996543fed tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:56.614787 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-18945e35-8dd6-40e2-8766-991996543fed tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:56.615226 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-18945e35-8dd6-40e2-8766-991996543fed tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:56.615949 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-18945e35-8dd6-40e2-8766-991996543fed tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:56.616749 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-18945e35-8dd6-40e2-8766-991996543fed tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:56.617107 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-18945e35-8dd6-40e2-8766-991996543fed tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:56.948368 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-18945e35-8dd6-40e2-8766-991996543fed tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:56.961415 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-18945e35-8dd6-40e2-8766-991996543fed tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1505 microversion: 2.1 time: 0.358838 Oct 27 03:37:56.962423 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1897/4044] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:56 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1505 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:37:56.980483 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-363eaf9c-973d-408d-94e2-41315e9f7bee tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:56.981352 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-363eaf9c-973d-408d-94e2-41315e9f7bee tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 17bdf735-2944-4b40-984c-4646caa855f0] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:56.991888 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-363eaf9c-973d-408d-94e2-41315e9f7bee tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:56.994075 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-363eaf9c-973d-408d-94e2-41315e9f7bee tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:56.994700 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-363eaf9c-973d-408d-94e2-41315e9f7bee tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:57.004464 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-363eaf9c-973d-408d-94e2-41315e9f7bee tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:57.004464 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-363eaf9c-973d-408d-94e2-41315e9f7bee tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:57.004464 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-363eaf9c-973d-408d-94e2-41315e9f7bee tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:57.263840 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-363eaf9c-973d-408d-94e2-41315e9f7bee tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:57.277579 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-363eaf9c-973d-408d-94e2-41315e9f7bee tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/17bdf735-2944-4b40-984c-4646caa855f0" status: 200 len: 1315 microversion: 2.1 time: 0.313349 Oct 27 03:37:57.278154 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1898/4045] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:56 2022] GET /compute/v2.1/servers/17bdf735-2944-4b40-984c-4646caa855f0 => generated 1315 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:37:57.287247 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d1eac8bf-af93-491e-81de-23ddf9ffaea6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:57.290612 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d1eac8bf-af93-491e-81de-23ddf9ffaea6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:57.298408 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9020a654-1498-4172-bda6-c3b0247aeccc tempest-SecurityGroupRulesNegativeTestJSON-912274608 tempest-SecurityGroupRulesNegativeTestJSON-912274608-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/984674e6-69cf-4ef6-b1ee-1a5960af6291" status: 202 len: 0 microversion: 2.1 time: 0.999526 Oct 27 03:37:57.299719 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2148/4046] 10.222.0.20 () {58 vars in 1272 bytes} [Thu Oct 27 03:37:56 2022] DELETE /compute/v2.1/os-security-groups/984674e6-69cf-4ef6-b1ee-1a5960af6291 => generated 0 bytes in 1001 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:37:57.304308 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6520c747-88c6-415c-9c3f-a3c76fe09e34 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:37:57.304874 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-6520c747-88c6-415c-9c3f-a3c76fe09e34 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 35c0b7f3-d1c1-4152-aada-66aecb8ff1f6] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:57.321105 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d1eac8bf-af93-491e-81de-23ddf9ffaea6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:57.322934 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-6520c747-88c6-415c-9c3f-a3c76fe09e34 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] HTTP exception thrown: Instance 35c0b7f3-d1c1-4152-aada-66aecb8ff1f6 could not be found. Oct 27 03:37:57.324540 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d1eac8bf-af93-491e-81de-23ddf9ffaea6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:57.337788 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d1eac8bf-af93-491e-81de-23ddf9ffaea6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:57.337901 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6520c747-88c6-415c-9c3f-a3c76fe09e34 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Request method failure captured: Oct 27 03:37:57.337901 n-d-862769-1 devstack@n-api.service[121001]: request: POST /compute/v2.1/servers/35c0b7f3-d1c1-4152-aada-66aecb8ff1f6/action HTTP/1.1 Oct 27 03:37:57.337901 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:37:57.337901 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:37:57.337901 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:37:57.337901 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 15 Oct 27 03:37:57.337901 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:37:57.337901 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:37:57.337901 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:37:57.337901 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:37:57.337901 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfxF6ut9nM9a9AcpKLO7IgCu-akAJ2YJGjrI9C8NUveA8uObV2XgQIQvsIxuWjvLl9meIEqpfGwZYr8MTX_PAGoiJsNUPXh5ERSce5cPYQYCCFPL0HtTb-E11C_2kfWy1wRps1tClRNvtj8zAqCGRhs1x-Uvl0zISdfHepXmvWX31Us Oct 27 03:37:57.337901 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:37:57.337901 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:37:57.337901 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:37:57.337901 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:37:57.337901 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:37:57.337901 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:37:57.337901 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 8bb5d291069d4329a90123e327fe9c59 Oct 27 03:37:57.337901 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:37:57.337901 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:37:57.337901 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:37:57.337901 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8bb5d291069d4329a90123e327fe9c59"}]}] Oct 27 03:37:57.337901 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:37:57.337901 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 8bb5d291069d4329a90123e327fe9c59 Oct 27 03:37:57.337901 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:37:57.337901 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServersNegativeTestJSON-4378389-project Oct 27 03:37:57.337901 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:37:57.337901 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:37:57.337901 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: f9c32b7626594ff888970c7f3227bb20 Oct 27 03:37:57.337901 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServersNegativeTestJSON-4378389-project Oct 27 03:37:57.337901 n-d-862769-1 devstack@n-api.service[121001]: Oct 27 03:37:57.337901 n-d-862769-1 devstack@n-api.service[121001]: {"suspend": {}} Oct 27 03:37:57.337901 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:37:57.337901 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 35c0b7f3-d1c1-4152-aada-66aecb8ff1f6 could not be found. Oct 27 03:37:57.337901 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '35c0b7f3-d1c1-4152-aada-66aecb8ff1f6', 'body': {'suspend': {}}} Oct 27 03:37:57.337901 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:37:57.337901 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:37:57.337901 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:37:57.337901 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:37:57.337901 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:37:57.337901 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:37:57.337901 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 03:37:57.337901 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 03:37:57.337901 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35c0b7f3-d1c1-4152-aada-66aecb8ff1f6 could not be found. Oct 27 03:37:57.337901 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:37:57.337901 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:37:57.337901 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:37:57.337901 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:37:57.337901 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:37:57.337901 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:37:57.337901 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:37:57.337901 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:37:57.337901 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:37:57.337901 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:37:57.337901 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Oct 27 03:37:57.337901 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 27 03:37:57.337901 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:37:57.337901 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:37:57.337901 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35c0b7f3-d1c1-4152-aada-66aecb8ff1f6 could not be found. Oct 27 03:37:57.337901 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:37:57.337901 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:37:57.337901 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:37:57.337901 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:37:57.337901 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:37:57.337901 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:37:57.343046 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:37:57.343046 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:37:57.343046 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35c0b7f3-d1c1-4152-aada-66aecb8ff1f6 could not be found. Oct 27 03:37:57.343046 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:37:57.343821 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d1eac8bf-af93-491e-81de-23ddf9ffaea6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:57.343821 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d1eac8bf-af93-491e-81de-23ddf9ffaea6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:57.344004 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6520c747-88c6-415c-9c3f-a3c76fe09e34 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Returning 404 to user: Instance 35c0b7f3-d1c1-4152-aada-66aecb8ff1f6 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:37:57.344092 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d1eac8bf-af93-491e-81de-23ddf9ffaea6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:57.345037 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6520c747-88c6-415c-9c3f-a3c76fe09e34 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "POST /compute/v2.1/servers/35c0b7f3-d1c1-4152-aada-66aecb8ff1f6/action" status: 404 len: 111 microversion: 2.1 time: 0.044550 Oct 27 03:37:57.350395 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2149/4047] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:37:57 2022] POST /compute/v2.1/servers/35c0b7f3-d1c1-4152-aada-66aecb8ff1f6/action => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:37:57.361738 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-aa3e89c2-0b7c-4464-968c-b3db7bfa73d1 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:57.362729 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-aa3e89c2-0b7c-4464-968c-b3db7bfa73d1 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] [instance: 7e73d534-0a40-42d2-813c-2e9dbb9239ac] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:57.382402 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aa3e89c2-0b7c-4464-968c-b3db7bfa73d1 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:57.387123 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aa3e89c2-0b7c-4464-968c-b3db7bfa73d1 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:57.387123 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aa3e89c2-0b7c-4464-968c-b3db7bfa73d1 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:57.387123 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aa3e89c2-0b7c-4464-968c-b3db7bfa73d1 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:57.387123 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aa3e89c2-0b7c-4464-968c-b3db7bfa73d1 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:57.387123 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aa3e89c2-0b7c-4464-968c-b3db7bfa73d1 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:57.668856 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d1eac8bf-af93-491e-81de-23ddf9ffaea6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:57.679972 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d1eac8bf-af93-491e-81de-23ddf9ffaea6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1679 microversion: 2.1 time: 0.396621 Oct 27 03:37:57.681641 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1899/4048] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:57 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1679 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:37:57.702591 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8cba7e06-8d44-4205-9d7e-91b3fc220d69 tempest-SecurityGroupRulesNegativeTestJSON-912274608 tempest-SecurityGroupRulesNegativeTestJSON-912274608-project] Calling method '.version_select at 0x7f7dd9d59e50>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:58.043716 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-aa3e89c2-0b7c-4464-968c-b3db7bfa73d1 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:58.064071 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-aa3e89c2-0b7c-4464-968c-b3db7bfa73d1 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:58.065965 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-aa3e89c2-0b7c-4464-968c-b3db7bfa73d1 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:58.067224 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-aa3e89c2-0b7c-4464-968c-b3db7bfa73d1 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] 10.222.0.20 "GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac" status: 200 len: 1593 microversion: 2.32 time: 0.712305 Oct 27 03:37:58.082981 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2150/4049] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:37:57 2022] GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac => generated 1593 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:37:58.094867 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8be61290-2f7e-48f3-b76c-71b6059834ec tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:58.095857 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8be61290-2f7e-48f3-b76c-71b6059834ec tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:58.106612 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8be61290-2f7e-48f3-b76c-71b6059834ec tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:58.107497 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8be61290-2f7e-48f3-b76c-71b6059834ec tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:58.108164 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8be61290-2f7e-48f3-b76c-71b6059834ec tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:58.109088 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8be61290-2f7e-48f3-b76c-71b6059834ec tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:58.109775 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8be61290-2f7e-48f3-b76c-71b6059834ec tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:58.110405 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8be61290-2f7e-48f3-b76c-71b6059834ec tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:58.299601 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8cba7e06-8d44-4205-9d7e-91b3fc220d69 tempest-SecurityGroupRulesNegativeTestJSON-912274608 tempest-SecurityGroupRulesNegativeTestJSON-912274608-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/68fa8cad-b2fb-4e98-b68e-5c643cd20064" status: 202 len: 0 microversion: 2.1 time: 0.616595 Oct 27 03:37:58.301573 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1900/4050] 10.222.0.20 () {58 vars in 1272 bytes} [Thu Oct 27 03:37:57 2022] DELETE /compute/v2.1/os-security-groups/68fa8cad-b2fb-4e98-b68e-5c643cd20064 => generated 0 bytes in 619 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:37:58.310863 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0848db49-8869-4ec8-b941-8956ac0b884f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:58.312013 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0848db49-8869-4ec8-b941-8956ac0b884f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 17bdf735-2944-4b40-984c-4646caa855f0] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:58.329329 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0848db49-8869-4ec8-b941-8956ac0b884f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:58.330454 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0848db49-8869-4ec8-b941-8956ac0b884f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:58.331167 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0848db49-8869-4ec8-b941-8956ac0b884f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:58.333579 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0848db49-8869-4ec8-b941-8956ac0b884f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:58.335057 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0848db49-8869-4ec8-b941-8956ac0b884f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:58.335982 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0848db49-8869-4ec8-b941-8956ac0b884f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:58.517259 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8be61290-2f7e-48f3-b76c-71b6059834ec tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:58.531508 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8be61290-2f7e-48f3-b76c-71b6059834ec tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1505 microversion: 2.1 time: 0.446328 Oct 27 03:37:58.532712 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2151/4051] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:58 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1505 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:37:58.539860 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f4cafa5d-9f2a-429b-9854-cdaf1445ea38 tempest-SecurityGroupRulesNegativeTestJSON-912274608 tempest-SecurityGroupRulesNegativeTestJSON-912274608-project] Calling method '.version_select at 0x7f7dd9fa1e50>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:58.576980 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0848db49-8869-4ec8-b941-8956ac0b884f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:58.583193 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=100 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:37:58.589211 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0848db49-8869-4ec8-b941-8956ac0b884f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/17bdf735-2944-4b40-984c-4646caa855f0" status: 200 len: 1315 microversion: 2.1 time: 0.285594 Oct 27 03:37:58.589837 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1901/4052] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:58 2022] GET /compute/v2.1/servers/17bdf735-2944-4b40-984c-4646caa855f0 => generated 1315 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:37:58.599461 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0d689ef3-d884-429f-ace4-016c3dcdb160 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:58.600296 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0d689ef3-d884-429f-ace4-016c3dcdb160 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:58.607935 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0d689ef3-d884-429f-ace4-016c3dcdb160 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:58.608726 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0d689ef3-d884-429f-ace4-016c3dcdb160 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:58.609221 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0d689ef3-d884-429f-ace4-016c3dcdb160 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:58.609928 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0d689ef3-d884-429f-ace4-016c3dcdb160 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:58.610631 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0d689ef3-d884-429f-ace4-016c3dcdb160 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:58.611098 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0d689ef3-d884-429f-ace4-016c3dcdb160 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:58.756031 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:37:58.937567 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0d689ef3-d884-429f-ace4-016c3dcdb160 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:58.952137 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0d689ef3-d884-429f-ace4-016c3dcdb160 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1505 microversion: 2.1 time: 0.361156 Oct 27 03:37:58.953594 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1902/4053] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:58 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1505 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:37:58.963693 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4822c328-a3ec-401c-b238-35c9dfde9e1c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:58.965395 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4822c328-a3ec-401c-b238-35c9dfde9e1c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:58.973929 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4822c328-a3ec-401c-b238-35c9dfde9e1c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:58.975988 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4822c328-a3ec-401c-b238-35c9dfde9e1c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:58.976709 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4822c328-a3ec-401c-b238-35c9dfde9e1c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:58.977723 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4822c328-a3ec-401c-b238-35c9dfde9e1c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:58.979053 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4822c328-a3ec-401c-b238-35c9dfde9e1c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:58.980860 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4822c328-a3ec-401c-b238-35c9dfde9e1c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:59.036483 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f4cafa5d-9f2a-429b-9854-cdaf1445ea38 tempest-SecurityGroupRulesNegativeTestJSON-912274608 tempest-SecurityGroupRulesNegativeTestJSON-912274608-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/96a0f6a8-67b0-44f9-a699-9c1dc9613cda" status: 202 len: 0 microversion: 2.1 time: 0.501350 Oct 27 03:37:59.040347 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2152/4054] 10.222.0.20 () {58 vars in 1272 bytes} [Thu Oct 27 03:37:58 2022] DELETE /compute/v2.1/os-security-groups/96a0f6a8-67b0-44f9-a699-9c1dc9613cda => generated 0 bytes in 506 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:37:59.050683 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c403dae9-1f61-44f8-9c0d-eb80c75c95bb tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:37:59.051757 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c403dae9-1f61-44f8-9c0d-eb80c75c95bb tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:59.072678 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c403dae9-1f61-44f8-9c0d-eb80c75c95bb tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:59.073810 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c403dae9-1f61-44f8-9c0d-eb80c75c95bb tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:59.077627 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c403dae9-1f61-44f8-9c0d-eb80c75c95bb tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:59.078596 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c403dae9-1f61-44f8-9c0d-eb80c75c95bb tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:59.079983 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c403dae9-1f61-44f8-9c0d-eb80c75c95bb tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:59.080607 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c403dae9-1f61-44f8-9c0d-eb80c75c95bb tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:59.158446 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-c403dae9-1f61-44f8-9c0d-eb80c75c95bb tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lazy-loading 'flavor' on Instance uuid 376ac459-e31f-4727-9e34-535f055ac20d {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:37:59.406981 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4822c328-a3ec-401c-b238-35c9dfde9e1c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:59.420912 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4822c328-a3ec-401c-b238-35c9dfde9e1c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1679 microversion: 2.1 time: 0.465606 Oct 27 03:37:59.428172 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1903/4055] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:58 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1679 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:37:59.432331 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9f0070bd-0ed1-42af-8d4a-23652c6d27b6 tempest-SecurityGroupRulesNegativeTestJSON-912274608 tempest-SecurityGroupRulesNegativeTestJSON-912274608-project] Calling method '.version_select at 0x7f7ddeda1310>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:59.588822 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c403dae9-1f61-44f8-9c0d-eb80c75c95bb tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "POST /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d/action" status: 202 len: 0 microversion: 2.1 time: 0.544665 Oct 27 03:37:59.590080 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2153/4056] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:37:59 2022] POST /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d/action => generated 0 bytes in 549 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:37:59.602560 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-38b27935-1236-4037-a6bf-4910e505c05c tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:59.605444 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-38b27935-1236-4037-a6bf-4910e505c05c tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] [instance: 7e73d534-0a40-42d2-813c-2e9dbb9239ac] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:59.616605 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-38b27935-1236-4037-a6bf-4910e505c05c tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:59.617567 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-38b27935-1236-4037-a6bf-4910e505c05c tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:59.618956 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-38b27935-1236-4037-a6bf-4910e505c05c tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:59.619792 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-38b27935-1236-4037-a6bf-4910e505c05c tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:59.620427 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-38b27935-1236-4037-a6bf-4910e505c05c tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:59.621554 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-38b27935-1236-4037-a6bf-4910e505c05c tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:59.894075 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-38b27935-1236-4037-a6bf-4910e505c05c tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:59.912238 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-38b27935-1236-4037-a6bf-4910e505c05c tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:59.916850 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-38b27935-1236-4037-a6bf-4910e505c05c tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:37:59.918676 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-38b27935-1236-4037-a6bf-4910e505c05c tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] 10.222.0.20 "GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac" status: 200 len: 1708 microversion: 2.32 time: 0.327026 Oct 27 03:37:59.920469 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2154/4057] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:37:59 2022] GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac => generated 1708 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:37:59.927535 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-eb85422b-1bb9-4f6d-b8da-981492bdeb6c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:37:59.928979 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-eb85422b-1bb9-4f6d-b8da-981492bdeb6c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:37:59.938734 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eb85422b-1bb9-4f6d-b8da-981492bdeb6c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:59.939514 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eb85422b-1bb9-4f6d-b8da-981492bdeb6c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:59.940243 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eb85422b-1bb9-4f6d-b8da-981492bdeb6c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:59.941259 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eb85422b-1bb9-4f6d-b8da-981492bdeb6c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:37:59.941949 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eb85422b-1bb9-4f6d-b8da-981492bdeb6c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:37:59.943352 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eb85422b-1bb9-4f6d-b8da-981492bdeb6c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:37:59.984535 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9f0070bd-0ed1-42af-8d4a-23652c6d27b6 tempest-SecurityGroupRulesNegativeTestJSON-912274608 tempest-SecurityGroupRulesNegativeTestJSON-912274608-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/ad235dec-d20a-49b3-83e0-3698142993da" status: 202 len: 0 microversion: 2.1 time: 0.559214 Oct 27 03:37:59.987089 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1904/4058] 10.222.0.20 () {58 vars in 1272 bytes} [Thu Oct 27 03:37:59 2022] DELETE /compute/v2.1/os-security-groups/ad235dec-d20a-49b3-83e0-3698142993da => generated 0 bytes in 562 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:37:59.998488 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-cf28fea9-d3af-47d4-b15c-19a84b127f58 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:00.012140 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-cf28fea9-d3af-47d4-b15c-19a84b127f58 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 17bdf735-2944-4b40-984c-4646caa855f0] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:00.042065 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cf28fea9-d3af-47d4-b15c-19a84b127f58 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:00.043407 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cf28fea9-d3af-47d4-b15c-19a84b127f58 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:00.044026 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cf28fea9-d3af-47d4-b15c-19a84b127f58 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:00.045442 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cf28fea9-d3af-47d4-b15c-19a84b127f58 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:00.047342 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cf28fea9-d3af-47d4-b15c-19a84b127f58 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:00.051110 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cf28fea9-d3af-47d4-b15c-19a84b127f58 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:00.267856 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-eb85422b-1bb9-4f6d-b8da-981492bdeb6c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:00.278620 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-eb85422b-1bb9-4f6d-b8da-981492bdeb6c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1513 microversion: 2.1 time: 0.356115 Oct 27 03:38:00.279913 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2155/4059] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:59 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1513 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:38:00.449015 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d9b9140c-ab7e-4e47-ae06-a294b41992d6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:00.450161 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d9b9140c-ab7e-4e47-ae06-a294b41992d6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:00.462406 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d9b9140c-ab7e-4e47-ae06-a294b41992d6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:00.462939 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d9b9140c-ab7e-4e47-ae06-a294b41992d6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:00.463387 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d9b9140c-ab7e-4e47-ae06-a294b41992d6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:00.464116 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d9b9140c-ab7e-4e47-ae06-a294b41992d6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:00.470935 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d9b9140c-ab7e-4e47-ae06-a294b41992d6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:00.470935 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d9b9140c-ab7e-4e47-ae06-a294b41992d6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:00.593166 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-cf28fea9-d3af-47d4-b15c-19a84b127f58 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:00.610409 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-cf28fea9-d3af-47d4-b15c-19a84b127f58 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/17bdf735-2944-4b40-984c-4646caa855f0" status: 200 len: 1315 microversion: 2.1 time: 0.621841 Oct 27 03:38:00.611155 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1905/4060] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:37:59 2022] GET /compute/v2.1/servers/17bdf735-2944-4b40-984c-4646caa855f0 => generated 1315 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:38:00.726976 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d9b9140c-ab7e-4e47-ae06-a294b41992d6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:00.736474 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d9b9140c-ab7e-4e47-ae06-a294b41992d6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1679 microversion: 2.1 time: 0.292369 Oct 27 03:38:00.742140 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2156/4061] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:00 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1679 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:38:00.950563 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-eabb3d0e-0517-4399-a94f-c3adb431d0e2 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:00.951190 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-eabb3d0e-0517-4399-a94f-c3adb431d0e2 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] [instance: 7e73d534-0a40-42d2-813c-2e9dbb9239ac] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:00.957400 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eabb3d0e-0517-4399-a94f-c3adb431d0e2 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:00.960671 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eabb3d0e-0517-4399-a94f-c3adb431d0e2 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:00.963190 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eabb3d0e-0517-4399-a94f-c3adb431d0e2 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:00.963959 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eabb3d0e-0517-4399-a94f-c3adb431d0e2 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:00.965352 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eabb3d0e-0517-4399-a94f-c3adb431d0e2 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:00.966666 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eabb3d0e-0517-4399-a94f-c3adb431d0e2 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:01.321039 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d98db61d-9305-4099-b8cc-69a44f5a5103 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:01.328630 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d98db61d-9305-4099-b8cc-69a44f5a5103 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:01.331641 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d98db61d-9305-4099-b8cc-69a44f5a5103 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:01.332324 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d98db61d-9305-4099-b8cc-69a44f5a5103 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:01.332971 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d98db61d-9305-4099-b8cc-69a44f5a5103 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:01.333915 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d98db61d-9305-4099-b8cc-69a44f5a5103 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:01.334578 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d98db61d-9305-4099-b8cc-69a44f5a5103 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:01.335190 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d98db61d-9305-4099-b8cc-69a44f5a5103 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:01.413942 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-eabb3d0e-0517-4399-a94f-c3adb431d0e2 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:01.427101 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-eabb3d0e-0517-4399-a94f-c3adb431d0e2 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:01.428845 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-eabb3d0e-0517-4399-a94f-c3adb431d0e2 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:01.430379 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-eabb3d0e-0517-4399-a94f-c3adb431d0e2 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] 10.222.0.20 "GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac" status: 200 len: 1708 microversion: 2.32 time: 0.485386 Oct 27 03:38:01.443287 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1906/4062] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:38:00 2022] GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac => generated 1708 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:38:01.636378 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-351a41d0-f71f-45c9-a8f3-1c037db36948 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:01.637955 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-351a41d0-f71f-45c9-a8f3-1c037db36948 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 17bdf735-2944-4b40-984c-4646caa855f0] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:01.653446 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-351a41d0-f71f-45c9-a8f3-1c037db36948 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:01.654240 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-351a41d0-f71f-45c9-a8f3-1c037db36948 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:01.654890 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-351a41d0-f71f-45c9-a8f3-1c037db36948 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:01.657192 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-351a41d0-f71f-45c9-a8f3-1c037db36948 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:01.661078 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-351a41d0-f71f-45c9-a8f3-1c037db36948 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:01.661769 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-351a41d0-f71f-45c9-a8f3-1c037db36948 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:01.706549 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=10 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:38:01.766307 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d98db61d-9305-4099-b8cc-69a44f5a5103 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:01.783431 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:38:01.788797 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d98db61d-9305-4099-b8cc-69a44f5a5103 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1496 microversion: 2.1 time: 0.468707 Oct 27 03:38:01.789541 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2157/4063] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:01 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1496 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:38:01.821643 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-13002504-c004-4395-83f6-85157645d6e1 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:01.822541 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-13002504-c004-4395-83f6-85157645d6e1 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:01.834916 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-13002504-c004-4395-83f6-85157645d6e1 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:01.835604 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-13002504-c004-4395-83f6-85157645d6e1 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:01.836422 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-13002504-c004-4395-83f6-85157645d6e1 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:01.837404 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-13002504-c004-4395-83f6-85157645d6e1 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:01.839905 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-13002504-c004-4395-83f6-85157645d6e1 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:01.841234 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-13002504-c004-4395-83f6-85157645d6e1 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:02.223416 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-13002504-c004-4395-83f6-85157645d6e1 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:02.234070 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-13002504-c004-4395-83f6-85157645d6e1 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1679 microversion: 2.1 time: 0.432112 Oct 27 03:38:02.236641 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2158/4064] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:01 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1679 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:38:02.241956 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-35bc2d62-e8c2-4396-a8ba-583f7c9f375c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:38:02.242672 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-35bc2d62-e8c2-4396-a8ba-583f7c9f375c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:02.250788 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-35bc2d62-e8c2-4396-a8ba-583f7c9f375c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:02.251296 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-35bc2d62-e8c2-4396-a8ba-583f7c9f375c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:02.252401 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-35bc2d62-e8c2-4396-a8ba-583f7c9f375c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:02.253282 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-35bc2d62-e8c2-4396-a8ba-583f7c9f375c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:02.253759 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-35bc2d62-e8c2-4396-a8ba-583f7c9f375c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:02.254235 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-35bc2d62-e8c2-4396-a8ba-583f7c9f375c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:02.294291 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-35bc2d62-e8c2-4396-a8ba-583f7c9f375c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lazy-loading 'flavor' on Instance uuid 376ac459-e31f-4727-9e34-535f055ac20d {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:38:02.320021 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-35bc2d62-e8c2-4396-a8ba-583f7c9f375c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] HTTP exception thrown: Cannot 'suspend' instance 376ac459-e31f-4727-9e34-535f055ac20d while it is in vm_state suspended Oct 27 03:38:02.322381 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-35bc2d62-e8c2-4396-a8ba-583f7c9f375c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Request method failure captured: Oct 27 03:38:02.322381 n-d-862769-1 devstack@n-api.service[121001]: request: POST /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d/action HTTP/1.1 Oct 27 03:38:02.322381 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:38:02.322381 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:38:02.322381 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:38:02.322381 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 15 Oct 27 03:38:02.322381 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:38:02.322381 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:38:02.322381 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:38:02.322381 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:38:02.322381 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfxF6ut9nM9a9AcpKLO7IgCu-akAJ2YJGjrI9C8NUveA8uObV2XgQIQvsIxuWjvLl9meIEqpfGwZYr8MTX_PAGoiJsNUPXh5ERSce5cPYQYCCFPL0HtTb-E11C_2kfWy1wRps1tClRNvtj8zAqCGRhs1x-Uvl0zISdfHepXmvWX31Us Oct 27 03:38:02.322381 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:38:02.322381 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:38:02.322381 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:38:02.322381 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:38:02.322381 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:38:02.322381 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:38:02.322381 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 8bb5d291069d4329a90123e327fe9c59 Oct 27 03:38:02.322381 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:38:02.322381 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:38:02.322381 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:38:02.322381 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8bb5d291069d4329a90123e327fe9c59"}]}] Oct 27 03:38:02.322381 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:38:02.322381 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 8bb5d291069d4329a90123e327fe9c59 Oct 27 03:38:02.322381 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:38:02.322381 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServersNegativeTestJSON-4378389-project Oct 27 03:38:02.322381 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:38:02.322381 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:38:02.322381 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: f9c32b7626594ff888970c7f3227bb20 Oct 27 03:38:02.322381 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServersNegativeTestJSON-4378389-project Oct 27 03:38:02.322381 n-d-862769-1 devstack@n-api.service[121001]: Oct 27 03:38:02.322381 n-d-862769-1 devstack@n-api.service[121001]: {"suspend": {}} Oct 27 03:38:02.322381 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:38:02.322381 n-d-862769-1 devstack@n-api.service[121001]: exception: Cannot 'suspend' instance 376ac459-e31f-4727-9e34-535f055ac20d while it is in vm_state suspended Oct 27 03:38:02.322381 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '376ac459-e31f-4727-9e34-535f055ac20d', 'body': {'suspend': {}}} Oct 27 03:38:02.322381 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:38:02.322381 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:38:02.322381 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Oct 27 03:38:02.322381 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Oct 27 03:38:02.322381 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 27 03:38:02.322381 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 27 03:38:02.322381 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 27 03:38:02.322381 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 27 03:38:02.322381 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 27 03:38:02.322381 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 27 03:38:02.322381 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 27 03:38:02.322381 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 27 03:38:02.322381 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 03:38:02.322381 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 03:38:02.322381 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 27 03:38:02.322381 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 27 03:38:02.322381 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 376ac459-e31f-4727-9e34-535f055ac20d in vm_state suspended. Cannot suspend while the instance is in this state. Oct 27 03:38:02.322381 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:38:02.322381 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:38:02.322381 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:38:02.322381 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:38:02.322381 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:38:02.322381 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:38:02.322381 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:38:02.322381 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:38:02.322381 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:38:02.322381 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:38:02.322381 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Oct 27 03:38:02.322381 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 27 03:38:02.330382 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 27 03:38:02.330382 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 27 03:38:02.330382 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 376ac459-e31f-4727-9e34-535f055ac20d while it is in vm_state suspended Oct 27 03:38:02.330382 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:38:02.330382 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:38:02.330382 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:38:02.330382 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:38:02.330382 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:38:02.330382 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:38:02.330382 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:38:02.330382 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:38:02.330382 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 376ac459-e31f-4727-9e34-535f055ac20d while it is in vm_state suspended Oct 27 03:38:02.330382 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:38:02.330382 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-35bc2d62-e8c2-4396-a8ba-583f7c9f375c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Returning 409 to user: Cannot 'suspend' instance 376ac459-e31f-4727-9e34-535f055ac20d while it is in vm_state suspended {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:38:02.330382 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-35bc2d62-e8c2-4396-a8ba-583f7c9f375c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "POST /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d/action" status: 409 len: 148 microversion: 2.1 time: 0.086104 Oct 27 03:38:02.330382 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2159/4065] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:38:02 2022] POST /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d/action => generated 148 bytes in 88 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 27 03:38:02.341078 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-de8c0c54-2a00-4866-a74b-6c0066b9563e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:38:02.341841 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-de8c0c54-2a00-4866-a74b-6c0066b9563e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:02.349922 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-de8c0c54-2a00-4866-a74b-6c0066b9563e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:02.350508 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-de8c0c54-2a00-4866-a74b-6c0066b9563e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:02.351022 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-de8c0c54-2a00-4866-a74b-6c0066b9563e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:02.351788 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-de8c0c54-2a00-4866-a74b-6c0066b9563e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:02.352474 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-de8c0c54-2a00-4866-a74b-6c0066b9563e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:02.353108 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-de8c0c54-2a00-4866-a74b-6c0066b9563e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:02.434510 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-351a41d0-f71f-45c9-a8f3-1c037db36948 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:02.443881 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-351a41d0-f71f-45c9-a8f3-1c037db36948 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/17bdf735-2944-4b40-984c-4646caa855f0" status: 200 len: 1315 microversion: 2.1 time: 0.811507 Oct 27 03:38:02.444490 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1907/4066] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:01 2022] GET /compute/v2.1/servers/17bdf735-2944-4b40-984c-4646caa855f0 => generated 1315 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:38:02.469503 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1cc4edd6-8b6b-4332-84e1-65b305a2e893 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:02.478556 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1cc4edd6-8b6b-4332-84e1-65b305a2e893 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] [instance: 7e73d534-0a40-42d2-813c-2e9dbb9239ac] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:02.487874 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1cc4edd6-8b6b-4332-84e1-65b305a2e893 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:02.488389 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1cc4edd6-8b6b-4332-84e1-65b305a2e893 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:02.490819 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1cc4edd6-8b6b-4332-84e1-65b305a2e893 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:02.491587 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1cc4edd6-8b6b-4332-84e1-65b305a2e893 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:02.492073 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1cc4edd6-8b6b-4332-84e1-65b305a2e893 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:02.492531 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1cc4edd6-8b6b-4332-84e1-65b305a2e893 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:02.684381 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-de8c0c54-2a00-4866-a74b-6c0066b9563e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "POST /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d/action" status: 202 len: 0 microversion: 2.1 time: 0.347697 Oct 27 03:38:02.685491 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2160/4067] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:38:02 2022] POST /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d/action => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:38:02.696705 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a9f16d6e-ffab-4ed8-bfb6-3cc6931c7b5e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:02.703960 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a9f16d6e-ffab-4ed8-bfb6-3cc6931c7b5e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:02.710816 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a9f16d6e-ffab-4ed8-bfb6-3cc6931c7b5e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:02.711635 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a9f16d6e-ffab-4ed8-bfb6-3cc6931c7b5e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:02.712324 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a9f16d6e-ffab-4ed8-bfb6-3cc6931c7b5e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:02.713466 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a9f16d6e-ffab-4ed8-bfb6-3cc6931c7b5e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:02.714182 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a9f16d6e-ffab-4ed8-bfb6-3cc6931c7b5e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:02.714926 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a9f16d6e-ffab-4ed8-bfb6-3cc6931c7b5e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:02.986441 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1cc4edd6-8b6b-4332-84e1-65b305a2e893 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:03.004814 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1cc4edd6-8b6b-4332-84e1-65b305a2e893 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:03.009674 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1cc4edd6-8b6b-4332-84e1-65b305a2e893 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:03.013994 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1cc4edd6-8b6b-4332-84e1-65b305a2e893 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] 10.222.0.20 "GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac" status: 200 len: 1755 microversion: 2.32 time: 0.545698 Oct 27 03:38:03.015364 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1908/4068] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:38:02 2022] GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac => generated 1755 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:38:03.070693 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a9f16d6e-ffab-4ed8-bfb6-3cc6931c7b5e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:03.090261 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a9f16d6e-ffab-4ed8-bfb6-3cc6931c7b5e tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1502 microversion: 2.1 time: 0.397762 Oct 27 03:38:03.090261 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2161/4069] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:02 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1502 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:38:03.185748 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-bd5a4f57-19e3-4528-a8df-2525294b203f req-7a9148c3-c099-4331-b6d9-3a98333753b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17bdf735-2944-4b40-984c-4646caa855f0", "name": "network-vif-plugged", "status": "completed", "tag": "06874d1d-d01a-4494-a246-90bef790a6f3"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:38:03.211209 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-bd5a4f57-19e3-4528-a8df-2525294b203f req-7a9148c3-c099-4331-b6d9-3a98333753b3 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:03.211792 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-bd5a4f57-19e3-4528-a8df-2525294b203f req-7a9148c3-c099-4331-b6d9-3a98333753b3 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:03.212427 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-bd5a4f57-19e3-4528-a8df-2525294b203f req-7a9148c3-c099-4331-b6d9-3a98333753b3 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:03.248889 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-bd5a4f57-19e3-4528-a8df-2525294b203f req-7a9148c3-c099-4331-b6d9-3a98333753b3 service nova] Creating event network-vif-plugged:06874d1d-d01a-4494-a246-90bef790a6f3 for instance 17bdf735-2944-4b40-984c-4646caa855f0 on n-h2-862769-1 Oct 27 03:38:03.257839 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6a785329-205f-4557-a1f8-ddd4bf03c3bc tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:03.258529 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-6a785329-205f-4557-a1f8-ddd4bf03c3bc tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:03.259999 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-bd5a4f57-19e3-4528-a8df-2525294b203f req-7a9148c3-c099-4331-b6d9-3a98333753b3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079853 Oct 27 03:38:03.260678 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1909/4070] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:38:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:38:03.280009 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6a785329-205f-4557-a1f8-ddd4bf03c3bc tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:03.281456 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6a785329-205f-4557-a1f8-ddd4bf03c3bc tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:03.281456 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6a785329-205f-4557-a1f8-ddd4bf03c3bc tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:03.281731 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6a785329-205f-4557-a1f8-ddd4bf03c3bc tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:03.282211 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6a785329-205f-4557-a1f8-ddd4bf03c3bc tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:03.282670 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6a785329-205f-4557-a1f8-ddd4bf03c3bc tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:03.476232 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-fb6afe31-9dc2-4b05-9517-3fcffa3e0db4 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:03.477922 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-fb6afe31-9dc2-4b05-9517-3fcffa3e0db4 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 17bdf735-2944-4b40-984c-4646caa855f0] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:03.490551 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fb6afe31-9dc2-4b05-9517-3fcffa3e0db4 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:03.492628 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fb6afe31-9dc2-4b05-9517-3fcffa3e0db4 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:03.493653 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fb6afe31-9dc2-4b05-9517-3fcffa3e0db4 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:03.495151 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fb6afe31-9dc2-4b05-9517-3fcffa3e0db4 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:03.496971 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fb6afe31-9dc2-4b05-9517-3fcffa3e0db4 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:03.498119 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fb6afe31-9dc2-4b05-9517-3fcffa3e0db4 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:03.824521 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6a785329-205f-4557-a1f8-ddd4bf03c3bc tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:03.834011 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6a785329-205f-4557-a1f8-ddd4bf03c3bc tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1679 microversion: 2.1 time: 0.581039 Oct 27 03:38:03.845318 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2162/4071] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:03 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1679 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:38:04.048951 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a4525dd0-fa05-4ea1-a23c-08098befa5ec tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:04.051797 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a4525dd0-fa05-4ea1-a23c-08098befa5ec tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] [instance: 7e73d534-0a40-42d2-813c-2e9dbb9239ac] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:04.055816 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:38:04.060549 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a4525dd0-fa05-4ea1-a23c-08098befa5ec tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:04.061284 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a4525dd0-fa05-4ea1-a23c-08098befa5ec tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:04.062577 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a4525dd0-fa05-4ea1-a23c-08098befa5ec tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:04.063490 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a4525dd0-fa05-4ea1-a23c-08098befa5ec tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:04.064196 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a4525dd0-fa05-4ea1-a23c-08098befa5ec tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:04.064802 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a4525dd0-fa05-4ea1-a23c-08098befa5ec tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:04.103502 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-fb6afe31-9dc2-4b05-9517-3fcffa3e0db4 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:04.115635 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-fb6afe31-9dc2-4b05-9517-3fcffa3e0db4 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/17bdf735-2944-4b40-984c-4646caa855f0" status: 200 len: 1315 microversion: 2.1 time: 0.646806 Oct 27 03:38:04.119005 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1910/4072] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:03 2022] GET /compute/v2.1/servers/17bdf735-2944-4b40-984c-4646caa855f0 => generated 1315 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:38:04.131504 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0a6d8347-efea-498f-955e-dd171985f4c8 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:04.134781 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0a6d8347-efea-498f-955e-dd171985f4c8 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:04.143614 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0a6d8347-efea-498f-955e-dd171985f4c8 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:04.144243 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0a6d8347-efea-498f-955e-dd171985f4c8 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:04.144694 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0a6d8347-efea-498f-955e-dd171985f4c8 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:04.145464 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0a6d8347-efea-498f-955e-dd171985f4c8 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:04.145926 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0a6d8347-efea-498f-955e-dd171985f4c8 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:04.146588 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0a6d8347-efea-498f-955e-dd171985f4c8 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:04.402526 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a4525dd0-fa05-4ea1-a23c-08098befa5ec tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:04.412397 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a4525dd0-fa05-4ea1-a23c-08098befa5ec tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:04.416012 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a4525dd0-fa05-4ea1-a23c-08098befa5ec tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:04.416012 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a4525dd0-fa05-4ea1-a23c-08098befa5ec tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] 10.222.0.20 "GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac" status: 200 len: 1755 microversion: 2.32 time: 0.371531 Oct 27 03:38:04.416012 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2163/4073] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:38:04 2022] GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac => generated 1755 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:38:04.608897 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0a6d8347-efea-498f-955e-dd171985f4c8 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:04.623851 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0a6d8347-efea-498f-955e-dd171985f4c8 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1502 microversion: 2.1 time: 0.502452 Oct 27 03:38:04.632181 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1911/4074] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:04 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1502 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:38:04.864891 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9e75954b-fd4d-43b5-8594-62e6b36ecc02 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:04.865595 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-9e75954b-fd4d-43b5-8594-62e6b36ecc02 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:04.879654 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9e75954b-fd4d-43b5-8594-62e6b36ecc02 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:04.882867 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9e75954b-fd4d-43b5-8594-62e6b36ecc02 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:04.883322 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9e75954b-fd4d-43b5-8594-62e6b36ecc02 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:04.884082 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9e75954b-fd4d-43b5-8594-62e6b36ecc02 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:04.887790 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9e75954b-fd4d-43b5-8594-62e6b36ecc02 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:04.889725 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9e75954b-fd4d-43b5-8594-62e6b36ecc02 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:05.140422 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-fb1e9cf5-6d04-4142-9812-bfb04124e49d tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:05.141085 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-fb1e9cf5-6d04-4142-9812-bfb04124e49d tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 17bdf735-2944-4b40-984c-4646caa855f0] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:05.168320 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fb1e9cf5-6d04-4142-9812-bfb04124e49d tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:05.168866 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fb1e9cf5-6d04-4142-9812-bfb04124e49d tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:05.169334 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fb1e9cf5-6d04-4142-9812-bfb04124e49d tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:05.178294 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fb1e9cf5-6d04-4142-9812-bfb04124e49d tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:05.178896 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fb1e9cf5-6d04-4142-9812-bfb04124e49d tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:05.180624 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fb1e9cf5-6d04-4142-9812-bfb04124e49d tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:05.533026 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9e75954b-fd4d-43b5-8594-62e6b36ecc02 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:05.550675 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9e75954b-fd4d-43b5-8594-62e6b36ecc02 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1679 microversion: 2.1 time: 0.688990 Oct 27 03:38:05.553001 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2164/4075] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:04 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1679 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:38:05.564230 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d529e3a3-0931-4ae1-9cb1-708c12b140a1 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:05.565444 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d529e3a3-0931-4ae1-9cb1-708c12b140a1 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] [instance: 7e73d534-0a40-42d2-813c-2e9dbb9239ac] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:05.590809 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d529e3a3-0931-4ae1-9cb1-708c12b140a1 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:05.591592 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d529e3a3-0931-4ae1-9cb1-708c12b140a1 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:05.594669 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d529e3a3-0931-4ae1-9cb1-708c12b140a1 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:05.595664 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d529e3a3-0931-4ae1-9cb1-708c12b140a1 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:05.597649 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d529e3a3-0931-4ae1-9cb1-708c12b140a1 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:05.598411 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d529e3a3-0931-4ae1-9cb1-708c12b140a1 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:06.210455 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d529e3a3-0931-4ae1-9cb1-708c12b140a1 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:06.221402 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d529e3a3-0931-4ae1-9cb1-708c12b140a1 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:06.228652 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d529e3a3-0931-4ae1-9cb1-708c12b140a1 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:06.238873 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d529e3a3-0931-4ae1-9cb1-708c12b140a1 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] 10.222.0.20 "GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac" status: 200 len: 1802 microversion: 2.32 time: 0.671800 Oct 27 03:38:06.239922 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2165/4076] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:38:05 2022] GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac => generated 1802 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:38:06.248379 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a3d9bcb0-6c7e-4250-b841-9b21d987137d tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:06.249073 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a3d9bcb0-6c7e-4250-b841-9b21d987137d tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:06.257533 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a3d9bcb0-6c7e-4250-b841-9b21d987137d tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:06.258136 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a3d9bcb0-6c7e-4250-b841-9b21d987137d tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:06.258584 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a3d9bcb0-6c7e-4250-b841-9b21d987137d tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:06.259312 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a3d9bcb0-6c7e-4250-b841-9b21d987137d tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:06.259775 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a3d9bcb0-6c7e-4250-b841-9b21d987137d tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:06.260649 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a3d9bcb0-6c7e-4250-b841-9b21d987137d tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:06.548199 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-fb1e9cf5-6d04-4142-9812-bfb04124e49d tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:06.583153 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-fb1e9cf5-6d04-4142-9812-bfb04124e49d tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/17bdf735-2944-4b40-984c-4646caa855f0" status: 200 len: 1315 microversion: 2.1 time: 1.448264 Oct 27 03:38:06.591507 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1912/4077] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:05 2022] GET /compute/v2.1/servers/17bdf735-2944-4b40-984c-4646caa855f0 => generated 1315 bytes in 1458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:38:06.617229 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a3d9bcb0-6c7e-4250-b841-9b21d987137d tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:06.619727 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-893d3142-7da9-4998-b930-bbc594054449 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:06.622489 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-893d3142-7da9-4998-b930-bbc594054449 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:06.627347 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a3d9bcb0-6c7e-4250-b841-9b21d987137d tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1505 microversion: 2.1 time: 0.386264 Oct 27 03:38:06.635604 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-893d3142-7da9-4998-b930-bbc594054449 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:06.635966 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2166/4078] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:06 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1505 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:38:06.637257 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-893d3142-7da9-4998-b930-bbc594054449 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:06.649445 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-893d3142-7da9-4998-b930-bbc594054449 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:06.651395 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-893d3142-7da9-4998-b930-bbc594054449 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:06.652137 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-893d3142-7da9-4998-b930-bbc594054449 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:06.652847 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-893d3142-7da9-4998-b930-bbc594054449 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:06.655352 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6da20db3-2fff-4358-95f1-09b852d7a1da tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:06.667228 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-6da20db3-2fff-4358-95f1-09b852d7a1da tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:06.680628 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6da20db3-2fff-4358-95f1-09b852d7a1da tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:06.682537 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6da20db3-2fff-4358-95f1-09b852d7a1da tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:06.683953 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6da20db3-2fff-4358-95f1-09b852d7a1da tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:06.684768 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6da20db3-2fff-4358-95f1-09b852d7a1da tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:06.688121 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6da20db3-2fff-4358-95f1-09b852d7a1da tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:06.688652 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6da20db3-2fff-4358-95f1-09b852d7a1da tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:07.037022 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6da20db3-2fff-4358-95f1-09b852d7a1da tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:07.054892 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6da20db3-2fff-4358-95f1-09b852d7a1da tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1505 microversion: 2.1 time: 0.403610 Oct 27 03:38:07.074591 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2167/4079] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:06 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1505 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:38:07.081856 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e9790564-e298-4ca6-9e5d-c63b68147c9c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:38:07.082802 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e9790564-e298-4ca6-9e5d-c63b68147c9c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 5ddc35b1-add1-48ec-a5d3-df73470e8670] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:07.089522 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-e9790564-e298-4ca6-9e5d-c63b68147c9c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] HTTP exception thrown: Instance 5ddc35b1-add1-48ec-a5d3-df73470e8670 could not be found. Oct 27 03:38:07.091473 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e9790564-e298-4ca6-9e5d-c63b68147c9c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Request method failure captured: Oct 27 03:38:07.091473 n-d-862769-1 devstack@n-api.service[121001]: request: POST /compute/v2.1/servers/5ddc35b1-add1-48ec-a5d3-df73470e8670/action HTTP/1.1 Oct 27 03:38:07.091473 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:38:07.091473 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:38:07.091473 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:38:07.091473 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 15 Oct 27 03:38:07.091473 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:38:07.091473 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:38:07.091473 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:38:07.091473 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:38:07.091473 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfxF6ut9nM9a9AcpKLO7IgCu-akAJ2YJGjrI9C8NUveA8uObV2XgQIQvsIxuWjvLl9meIEqpfGwZYr8MTX_PAGoiJsNUPXh5ERSce5cPYQYCCFPL0HtTb-E11C_2kfWy1wRps1tClRNvtj8zAqCGRhs1x-Uvl0zISdfHepXmvWX31Us Oct 27 03:38:07.091473 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:38:07.091473 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:38:07.091473 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:38:07.091473 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:38:07.091473 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:38:07.091473 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:38:07.091473 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 8bb5d291069d4329a90123e327fe9c59 Oct 27 03:38:07.091473 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:38:07.091473 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:38:07.091473 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:38:07.091473 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8bb5d291069d4329a90123e327fe9c59"}]}] Oct 27 03:38:07.091473 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:38:07.091473 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 8bb5d291069d4329a90123e327fe9c59 Oct 27 03:38:07.091473 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:38:07.091473 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServersNegativeTestJSON-4378389-project Oct 27 03:38:07.091473 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:38:07.091473 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:38:07.091473 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: f9c32b7626594ff888970c7f3227bb20 Oct 27 03:38:07.091473 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServersNegativeTestJSON-4378389-project Oct 27 03:38:07.091473 n-d-862769-1 devstack@n-api.service[121001]: Oct 27 03:38:07.091473 n-d-862769-1 devstack@n-api.service[121001]: {"unpause": {}} Oct 27 03:38:07.091473 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:38:07.091473 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 5ddc35b1-add1-48ec-a5d3-df73470e8670 could not be found. Oct 27 03:38:07.091473 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '5ddc35b1-add1-48ec-a5d3-df73470e8670', 'body': {'unpause': {}}} Oct 27 03:38:07.091473 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:38:07.091473 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:38:07.091473 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:38:07.091473 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:38:07.091473 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:38:07.091473 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:38:07.091473 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 03:38:07.091473 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 03:38:07.091473 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ddc35b1-add1-48ec-a5d3-df73470e8670 could not be found. Oct 27 03:38:07.091473 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:38:07.091473 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:38:07.091473 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:38:07.091473 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:38:07.091473 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:38:07.091473 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:38:07.091473 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:38:07.091473 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:38:07.091473 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:38:07.091473 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:38:07.091473 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Oct 27 03:38:07.091473 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 27 03:38:07.091473 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:38:07.091473 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:38:07.091473 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ddc35b1-add1-48ec-a5d3-df73470e8670 could not be found. Oct 27 03:38:07.091473 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:38:07.091473 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:38:07.091473 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:38:07.091473 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:38:07.091473 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:38:07.091473 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:38:07.102844 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:38:07.102844 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:38:07.102844 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ddc35b1-add1-48ec-a5d3-df73470e8670 could not be found. Oct 27 03:38:07.102844 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:38:07.102844 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e9790564-e298-4ca6-9e5d-c63b68147c9c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Returning 404 to user: Instance 5ddc35b1-add1-48ec-a5d3-df73470e8670 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:38:07.102844 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e9790564-e298-4ca6-9e5d-c63b68147c9c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "POST /compute/v2.1/servers/5ddc35b1-add1-48ec-a5d3-df73470e8670/action" status: 404 len: 111 microversion: 2.1 time: 0.015596 Oct 27 03:38:07.104119 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2168/4080] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:38:07 2022] POST /compute/v2.1/servers/5ddc35b1-add1-48ec-a5d3-df73470e8670/action => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 03:38:07.113480 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a40682d2-7385-47be-9947-9f041b30655a tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:07.121590 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a40682d2-7385-47be-9947-9f041b30655a tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:07.130869 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a40682d2-7385-47be-9947-9f041b30655a tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:07.131663 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a40682d2-7385-47be-9947-9f041b30655a tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:07.132290 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a40682d2-7385-47be-9947-9f041b30655a tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:07.133212 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a40682d2-7385-47be-9947-9f041b30655a tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:07.133867 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a40682d2-7385-47be-9947-9f041b30655a tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:07.134855 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a40682d2-7385-47be-9947-9f041b30655a tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:07.211438 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-893d3142-7da9-4998-b930-bbc594054449 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:07.225453 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-893d3142-7da9-4998-b930-bbc594054449 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1656 microversion: 2.1 time: 0.631614 Oct 27 03:38:07.228884 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1913/4081] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:06 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1656 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:38:07.263964 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-af4a21f5-2895-47b4-bc17-a03e68b0e20f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:38:07.270748 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-af4a21f5-2895-47b4-bc17-a03e68b0e20f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:07.271420 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-af4a21f5-2895-47b4-bc17-a03e68b0e20f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:07.271966 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-af4a21f5-2895-47b4-bc17-a03e68b0e20f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:07.303863 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-af4a21f5-2895-47b4-bc17-a03e68b0e20f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Going to try to start instance {{(pid=121000) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 27 03:38:07.505461 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a40682d2-7385-47be-9947-9f041b30655a tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:07.520130 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-af4a21f5-2895-47b4-bc17-a03e68b0e20f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "POST /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86/action" status: 202 len: 0 microversion: 2.1 time: 0.261210 Oct 27 03:38:07.521580 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1914/4082] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:38:07 2022] POST /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86/action => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 03:38:07.546053 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a40682d2-7385-47be-9947-9f041b30655a tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1505 microversion: 2.1 time: 0.435240 Oct 27 03:38:07.547230 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2169/4083] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:07 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1505 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:38:07.547972 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-25b6a286-6874-424f-8409-a9d5b2792d7e tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:07.548807 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-25b6a286-6874-424f-8409-a9d5b2792d7e tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] [instance: 7e73d534-0a40-42d2-813c-2e9dbb9239ac] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:07.567109 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-34b91294-3cd9-4182-a627-bf863d60aa56 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:07.570447 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-34b91294-3cd9-4182-a627-bf863d60aa56 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:07.575364 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-25b6a286-6874-424f-8409-a9d5b2792d7e tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:07.577705 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-25b6a286-6874-424f-8409-a9d5b2792d7e tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:07.581114 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-25b6a286-6874-424f-8409-a9d5b2792d7e tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:07.584984 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-25b6a286-6874-424f-8409-a9d5b2792d7e tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:07.585844 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-25b6a286-6874-424f-8409-a9d5b2792d7e tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:07.586512 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-25b6a286-6874-424f-8409-a9d5b2792d7e tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:07.592896 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-34b91294-3cd9-4182-a627-bf863d60aa56 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:07.596493 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-34b91294-3cd9-4182-a627-bf863d60aa56 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:07.601067 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-34b91294-3cd9-4182-a627-bf863d60aa56 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:07.608758 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-34b91294-3cd9-4182-a627-bf863d60aa56 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:07.609534 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-34b91294-3cd9-4182-a627-bf863d60aa56 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:07.611705 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-34b91294-3cd9-4182-a627-bf863d60aa56 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:07.941301 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-34b91294-3cd9-4182-a627-bf863d60aa56 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:07.949596 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-34b91294-3cd9-4182-a627-bf863d60aa56 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1665 microversion: 2.1 time: 0.397877 Oct 27 03:38:07.950278 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2170/4084] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:07 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1665 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:38:07.979095 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f64b0451-cbb4-4c88-b7e7-81bb282ee773 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:07.979786 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f64b0451-cbb4-4c88-b7e7-81bb282ee773 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:07.989821 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f64b0451-cbb4-4c88-b7e7-81bb282ee773 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:07.993987 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f64b0451-cbb4-4c88-b7e7-81bb282ee773 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:07.994494 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f64b0451-cbb4-4c88-b7e7-81bb282ee773 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:07.995250 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f64b0451-cbb4-4c88-b7e7-81bb282ee773 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:07.996278 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f64b0451-cbb4-4c88-b7e7-81bb282ee773 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:07.996723 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f64b0451-cbb4-4c88-b7e7-81bb282ee773 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:08.211619 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-25b6a286-6874-424f-8409-a9d5b2792d7e tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:08.241131 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-25b6a286-6874-424f-8409-a9d5b2792d7e tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:08.247681 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-25b6a286-6874-424f-8409-a9d5b2792d7e tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:08.249234 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-25b6a286-6874-424f-8409-a9d5b2792d7e tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] 10.222.0.20 "GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac" status: 200 len: 1802 microversion: 2.32 time: 0.726117 Oct 27 03:38:08.250340 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1915/4085] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:38:07 2022] GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac => generated 1802 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:38:08.255950 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9e3af9e0-a791-4ba6-9301-d8d030011824 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:08.257213 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9e3af9e0-a791-4ba6-9301-d8d030011824 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 17bdf735-2944-4b40-984c-4646caa855f0] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:08.270337 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9e3af9e0-a791-4ba6-9301-d8d030011824 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:08.271144 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9e3af9e0-a791-4ba6-9301-d8d030011824 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:08.271757 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9e3af9e0-a791-4ba6-9301-d8d030011824 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:08.272653 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9e3af9e0-a791-4ba6-9301-d8d030011824 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:08.273333 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9e3af9e0-a791-4ba6-9301-d8d030011824 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:08.273944 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9e3af9e0-a791-4ba6-9301-d8d030011824 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:08.334190 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f64b0451-cbb4-4c88-b7e7-81bb282ee773 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:08.344124 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f64b0451-cbb4-4c88-b7e7-81bb282ee773 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1505 microversion: 2.1 time: 0.375515 Oct 27 03:38:08.345183 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2171/4086] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:07 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1505 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:38:08.377644 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-913dda01-2d9f-4f6c-a52c-f5a23e48dbbb tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:38:08.378574 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-913dda01-2d9f-4f6c-a52c-f5a23e48dbbb tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:08.386526 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-913dda01-2d9f-4f6c-a52c-f5a23e48dbbb tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:08.387542 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-913dda01-2d9f-4f6c-a52c-f5a23e48dbbb tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:08.388164 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-913dda01-2d9f-4f6c-a52c-f5a23e48dbbb tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:08.394550 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-913dda01-2d9f-4f6c-a52c-f5a23e48dbbb tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:08.394550 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-913dda01-2d9f-4f6c-a52c-f5a23e48dbbb tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:08.394550 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-913dda01-2d9f-4f6c-a52c-f5a23e48dbbb tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:08.436414 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-913dda01-2d9f-4f6c-a52c-f5a23e48dbbb tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] HTTP exception thrown: Cannot 'unpause' instance 376ac459-e31f-4727-9e34-535f055ac20d while it is in vm_state active Oct 27 03:38:08.438005 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-913dda01-2d9f-4f6c-a52c-f5a23e48dbbb tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Request method failure captured: Oct 27 03:38:08.438005 n-d-862769-1 devstack@n-api.service[121001]: request: POST /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d/action HTTP/1.1 Oct 27 03:38:08.438005 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:38:08.438005 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:38:08.438005 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:38:08.438005 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 15 Oct 27 03:38:08.438005 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:38:08.438005 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:38:08.438005 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:38:08.438005 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:38:08.438005 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfxF6ut9nM9a9AcpKLO7IgCu-akAJ2YJGjrI9C8NUveA8uObV2XgQIQvsIxuWjvLl9meIEqpfGwZYr8MTX_PAGoiJsNUPXh5ERSce5cPYQYCCFPL0HtTb-E11C_2kfWy1wRps1tClRNvtj8zAqCGRhs1x-Uvl0zISdfHepXmvWX31Us Oct 27 03:38:08.438005 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:38:08.438005 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:38:08.438005 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:38:08.438005 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:38:08.438005 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:38:08.438005 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:38:08.438005 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 8bb5d291069d4329a90123e327fe9c59 Oct 27 03:38:08.438005 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:38:08.438005 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:38:08.438005 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:38:08.438005 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8bb5d291069d4329a90123e327fe9c59"}]}] Oct 27 03:38:08.438005 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:38:08.438005 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 8bb5d291069d4329a90123e327fe9c59 Oct 27 03:38:08.438005 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:38:08.438005 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServersNegativeTestJSON-4378389-project Oct 27 03:38:08.438005 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:38:08.438005 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:38:08.438005 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: f9c32b7626594ff888970c7f3227bb20 Oct 27 03:38:08.438005 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServersNegativeTestJSON-4378389-project Oct 27 03:38:08.438005 n-d-862769-1 devstack@n-api.service[121001]: Oct 27 03:38:08.438005 n-d-862769-1 devstack@n-api.service[121001]: {"unpause": {}} Oct 27 03:38:08.438005 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:38:08.438005 n-d-862769-1 devstack@n-api.service[121001]: exception: Cannot 'unpause' instance 376ac459-e31f-4727-9e34-535f055ac20d while it is in vm_state active Oct 27 03:38:08.438005 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '376ac459-e31f-4727-9e34-535f055ac20d', 'body': {'unpause': {}}} Oct 27 03:38:08.438005 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:38:08.438005 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:38:08.438005 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Oct 27 03:38:08.438005 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Oct 27 03:38:08.438005 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 03:38:08.438005 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 03:38:08.438005 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 27 03:38:08.438005 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 27 03:38:08.438005 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 376ac459-e31f-4727-9e34-535f055ac20d in vm_state active. Cannot unpause while the instance is in this state. Oct 27 03:38:08.438005 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:38:08.438005 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:38:08.438005 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:38:08.438005 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:38:08.438005 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:38:08.438005 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:38:08.438005 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:38:08.438005 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:38:08.438005 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:38:08.438005 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:38:08.438005 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Oct 27 03:38:08.438005 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 27 03:38:08.438005 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 27 03:38:08.438005 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 27 03:38:08.438005 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 376ac459-e31f-4727-9e34-535f055ac20d while it is in vm_state active Oct 27 03:38:08.438005 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:38:08.438005 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:38:08.438005 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:38:08.438005 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:38:08.438005 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:38:08.445288 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:38:08.445288 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:38:08.445288 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:38:08.445288 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 376ac459-e31f-4727-9e34-535f055ac20d while it is in vm_state active Oct 27 03:38:08.445288 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:38:08.445288 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-913dda01-2d9f-4f6c-a52c-f5a23e48dbbb tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Returning 409 to user: Cannot 'unpause' instance 376ac459-e31f-4727-9e34-535f055ac20d while it is in vm_state active {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:38:08.445288 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-913dda01-2d9f-4f6c-a52c-f5a23e48dbbb tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "POST /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d/action" status: 409 len: 145 microversion: 2.1 time: 0.070673 Oct 27 03:38:08.445288 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2172/4087] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:38:08 2022] POST /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d/action => generated 145 bytes in 76 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 27 03:38:08.460239 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-13f242ed-1834-43d9-bf64-3b0926d2e246 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:08.460810 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-13f242ed-1834-43d9-bf64-3b0926d2e246 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:08.473012 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-13f242ed-1834-43d9-bf64-3b0926d2e246 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:08.473810 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-13f242ed-1834-43d9-bf64-3b0926d2e246 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:08.474496 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-13f242ed-1834-43d9-bf64-3b0926d2e246 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:08.475467 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-13f242ed-1834-43d9-bf64-3b0926d2e246 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:08.476237 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-13f242ed-1834-43d9-bf64-3b0926d2e246 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:08.476772 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-13f242ed-1834-43d9-bf64-3b0926d2e246 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:08.759362 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-13f242ed-1834-43d9-bf64-3b0926d2e246 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:08.770172 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-13f242ed-1834-43d9-bf64-3b0926d2e246 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1505 microversion: 2.1 time: 0.324477 Oct 27 03:38:08.771101 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2173/4088] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:08 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1505 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:38:08.798191 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-305860a7-25f1-4fa6-9ca1-dbfe2c722172 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:08.799350 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-305860a7-25f1-4fa6-9ca1-dbfe2c722172 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:08.806011 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-305860a7-25f1-4fa6-9ca1-dbfe2c722172 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:08.811834 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-305860a7-25f1-4fa6-9ca1-dbfe2c722172 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:08.811834 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-305860a7-25f1-4fa6-9ca1-dbfe2c722172 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:08.811834 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-305860a7-25f1-4fa6-9ca1-dbfe2c722172 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:08.811834 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-305860a7-25f1-4fa6-9ca1-dbfe2c722172 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:08.811834 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-305860a7-25f1-4fa6-9ca1-dbfe2c722172 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:08.984288 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-305860a7-25f1-4fa6-9ca1-dbfe2c722172 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:08.984921 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9e3af9e0-a791-4ba6-9301-d8d030011824 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:08.989662 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:38:08.994413 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9e3af9e0-a791-4ba6-9301-d8d030011824 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/17bdf735-2944-4b40-984c-4646caa855f0" status: 200 len: 1502 microversion: 2.1 time: 0.742368 Oct 27 03:38:08.996524 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1916/4089] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:08 2022] GET /compute/v2.1/servers/17bdf735-2944-4b40-984c-4646caa855f0 => generated 1502 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:38:09.001375 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a765d9a8-8bbc-40ea-9b09-0c24a890ae62 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:09.002300 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a765d9a8-8bbc-40ea-9b09-0c24a890ae62 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:09.009106 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a765d9a8-8bbc-40ea-9b09-0c24a890ae62 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:09.009910 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a765d9a8-8bbc-40ea-9b09-0c24a890ae62 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:09.010879 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a765d9a8-8bbc-40ea-9b09-0c24a890ae62 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:09.011888 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a765d9a8-8bbc-40ea-9b09-0c24a890ae62 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:09.012597 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a765d9a8-8bbc-40ea-9b09-0c24a890ae62 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:09.013256 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a765d9a8-8bbc-40ea-9b09-0c24a890ae62 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:09.016150 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-305860a7-25f1-4fa6-9ca1-dbfe2c722172 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1505 microversion: 2.1 time: 0.213832 Oct 27 03:38:09.026318 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2174/4090] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:08 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1505 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:38:09.044045 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d9386465-3876-4e99-a58c-b6adb2718821 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:09.044696 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d9386465-3876-4e99-a58c-b6adb2718821 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 17bdf735-2944-4b40-984c-4646caa855f0] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:09.051978 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d9386465-3876-4e99-a58c-b6adb2718821 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:09.052557 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d9386465-3876-4e99-a58c-b6adb2718821 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:09.053020 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d9386465-3876-4e99-a58c-b6adb2718821 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:09.055526 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d9386465-3876-4e99-a58c-b6adb2718821 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:09.055526 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d9386465-3876-4e99-a58c-b6adb2718821 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:09.055526 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d9386465-3876-4e99-a58c-b6adb2718821 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:09.086192 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d9386465-3876-4e99-a58c-b6adb2718821 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 17bdf735-2944-4b40-984c-4646caa855f0] Going to try to terminate instance {{(pid=121001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:38:09.450762 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a765d9a8-8bbc-40ea-9b09-0c24a890ae62 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:09.463067 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a765d9a8-8bbc-40ea-9b09-0c24a890ae62 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1665 microversion: 2.1 time: 0.462365 Oct 27 03:38:09.465526 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1917/4091] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:08 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1665 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:38:09.477508 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-89c261e8-c712-41a7-8b3d-86202e5e21ef tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:38:09.478231 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-89c261e8-c712-41a7-8b3d-86202e5e21ef tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 909b1e5d-ec6c-4eff-95cc-947fe34aac13] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:09.489287 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-89c261e8-c712-41a7-8b3d-86202e5e21ef tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] HTTP exception thrown: Instance 909b1e5d-ec6c-4eff-95cc-947fe34aac13 could not be found. Oct 27 03:38:09.501695 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-89c261e8-c712-41a7-8b3d-86202e5e21ef tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Request method failure captured: Oct 27 03:38:09.501695 n-d-862769-1 devstack@n-api.service[121000]: request: POST /compute/v2.1/servers/909b1e5d-ec6c-4eff-95cc-947fe34aac13/action HTTP/1.1 Oct 27 03:38:09.501695 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:38:09.501695 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:38:09.501695 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:38:09.501695 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 18 Oct 27 03:38:09.501695 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:38:09.501695 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:38:09.501695 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:38:09.501695 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:38:09.501695 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfxF6ut9nM9a9AcpKLO7IgCu-akAJ2YJGjrI9C8NUveA8uObV2XgQIQvsIxuWjvLl9meIEqpfGwZYr8MTX_PAGoiJsNUPXh5ERSce5cPYQYCCFPL0HtTb-E11C_2kfWy1wRps1tClRNvtj8zAqCGRhs1x-Uvl0zISdfHepXmvWX31Us Oct 27 03:38:09.501695 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:38:09.501695 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:38:09.501695 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:38:09.501695 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:38:09.501695 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:38:09.501695 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:38:09.501695 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 8bb5d291069d4329a90123e327fe9c59 Oct 27 03:38:09.501695 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:38:09.501695 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:38:09.501695 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:38:09.501695 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8bb5d291069d4329a90123e327fe9c59"}]}] Oct 27 03:38:09.501695 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:38:09.501695 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 8bb5d291069d4329a90123e327fe9c59 Oct 27 03:38:09.501695 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:38:09.501695 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ServersNegativeTestJSON-4378389-project Oct 27 03:38:09.501695 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:38:09.501695 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:38:09.501695 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: f9c32b7626594ff888970c7f3227bb20 Oct 27 03:38:09.501695 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ServersNegativeTestJSON-4378389-project Oct 27 03:38:09.501695 n-d-862769-1 devstack@n-api.service[121000]: Oct 27 03:38:09.501695 n-d-862769-1 devstack@n-api.service[121000]: {"unshelve": null} Oct 27 03:38:09.501695 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:38:09.501695 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 909b1e5d-ec6c-4eff-95cc-947fe34aac13 could not be found. Oct 27 03:38:09.501695 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '909b1e5d-ec6c-4eff-95cc-947fe34aac13', 'body': {'unshelve': None}} Oct 27 03:38:09.501695 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:38:09.501695 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:38:09.501695 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:38:09.501695 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:38:09.501695 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:38:09.501695 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:38:09.501695 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 03:38:09.501695 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 03:38:09.501695 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 909b1e5d-ec6c-4eff-95cc-947fe34aac13 could not be found. Oct 27 03:38:09.501695 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:38:09.501695 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:38:09.501695 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:38:09.501695 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:38:09.501695 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:38:09.501695 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:38:09.501695 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:38:09.501695 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:38:09.501695 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:38:09.501695 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:38:09.501695 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:38:09.501695 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:38:09.501695 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:38:09.501695 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:38:09.501695 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Oct 27 03:38:09.501695 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 27 03:38:09.501695 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:38:09.501695 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:38:09.501695 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 909b1e5d-ec6c-4eff-95cc-947fe34aac13 could not be found. Oct 27 03:38:09.501695 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:38:09.501695 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:38:09.501695 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:38:09.507861 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:38:09.507861 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:38:09.507861 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:38:09.507861 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:38:09.507861 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:38:09.507861 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 909b1e5d-ec6c-4eff-95cc-947fe34aac13 could not be found. Oct 27 03:38:09.507861 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:38:09.507861 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-89c261e8-c712-41a7-8b3d-86202e5e21ef tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Returning 404 to user: Instance 909b1e5d-ec6c-4eff-95cc-947fe34aac13 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:38:09.507861 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-89c261e8-c712-41a7-8b3d-86202e5e21ef tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "POST /compute/v2.1/servers/909b1e5d-ec6c-4eff-95cc-947fe34aac13/action" status: 404 len: 111 microversion: 2.1 time: 0.029026 Oct 27 03:38:09.507861 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1918/4092] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:38:09 2022] POST /compute/v2.1/servers/909b1e5d-ec6c-4eff-95cc-947fe34aac13/action => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:38:09.507861 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c2a59283-f348-49ba-8db6-a881cc37e103 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:09.507861 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c2a59283-f348-49ba-8db6-a881cc37e103 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] [instance: 7e73d534-0a40-42d2-813c-2e9dbb9239ac] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:09.519753 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c2a59283-f348-49ba-8db6-a881cc37e103 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:09.520266 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c2a59283-f348-49ba-8db6-a881cc37e103 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:09.521475 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c2a59283-f348-49ba-8db6-a881cc37e103 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:09.522450 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c2a59283-f348-49ba-8db6-a881cc37e103 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:09.523090 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c2a59283-f348-49ba-8db6-a881cc37e103 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:09.524147 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c2a59283-f348-49ba-8db6-a881cc37e103 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:09.679857 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d9386465-3876-4e99-a58c-b6adb2718821 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "DELETE /compute/v2.1/servers/17bdf735-2944-4b40-984c-4646caa855f0" status: 204 len: 0 microversion: 2.1 time: 0.651771 Oct 27 03:38:09.685613 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2175/4093] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:38:09 2022] DELETE /compute/v2.1/servers/17bdf735-2944-4b40-984c-4646caa855f0 => generated 0 bytes in 655 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:38:09.687974 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2d2c5099-a9ae-4fbc-987b-8c6ff0d3b8b7 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:09.689946 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2d2c5099-a9ae-4fbc-987b-8c6ff0d3b8b7 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:09.696623 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2d2c5099-a9ae-4fbc-987b-8c6ff0d3b8b7 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:09.697380 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2d2c5099-a9ae-4fbc-987b-8c6ff0d3b8b7 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:09.697829 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2d2c5099-a9ae-4fbc-987b-8c6ff0d3b8b7 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:09.699153 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2d2c5099-a9ae-4fbc-987b-8c6ff0d3b8b7 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:09.699618 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2d2c5099-a9ae-4fbc-987b-8c6ff0d3b8b7 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:09.700226 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2d2c5099-a9ae-4fbc-987b-8c6ff0d3b8b7 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:09.915627 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2d2c5099-a9ae-4fbc-987b-8c6ff0d3b8b7 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:09.946048 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2d2c5099-a9ae-4fbc-987b-8c6ff0d3b8b7 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1505 microversion: 2.1 time: 0.260368 Oct 27 03:38:09.948137 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2176/4094] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:09 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1505 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:38:09.958281 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4b83c024-441b-4aa2-930c-c3c995022653 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:09.963441 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4b83c024-441b-4aa2-930c-c3c995022653 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 17bdf735-2944-4b40-984c-4646caa855f0] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:09.993888 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4b83c024-441b-4aa2-930c-c3c995022653 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:09.996315 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4b83c024-441b-4aa2-930c-c3c995022653 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:09.996787 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4b83c024-441b-4aa2-930c-c3c995022653 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:09.997542 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4b83c024-441b-4aa2-930c-c3c995022653 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:09.999761 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4b83c024-441b-4aa2-930c-c3c995022653 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:10.000602 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4b83c024-441b-4aa2-930c-c3c995022653 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:10.362307 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4b83c024-441b-4aa2-930c-c3c995022653 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:10.371369 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4b83c024-441b-4aa2-930c-c3c995022653 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/17bdf735-2944-4b40-984c-4646caa855f0" status: 200 len: 1508 microversion: 2.1 time: 0.419514 Oct 27 03:38:10.395402 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2177/4095] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:09 2022] GET /compute/v2.1/servers/17bdf735-2944-4b40-984c-4646caa855f0 => generated 1508 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:38:10.410654 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9ed97656-5d8d-4c7b-8810-6f1e26fbf6cb tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:10.411378 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-9ed97656-5d8d-4c7b-8810-6f1e26fbf6cb tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:10.424319 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9ed97656-5d8d-4c7b-8810-6f1e26fbf6cb tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:10.426911 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9ed97656-5d8d-4c7b-8810-6f1e26fbf6cb tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:10.426911 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9ed97656-5d8d-4c7b-8810-6f1e26fbf6cb tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:10.427540 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9ed97656-5d8d-4c7b-8810-6f1e26fbf6cb tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:10.428026 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9ed97656-5d8d-4c7b-8810-6f1e26fbf6cb tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:10.428473 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9ed97656-5d8d-4c7b-8810-6f1e26fbf6cb tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:10.584859 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c2a59283-f348-49ba-8db6-a881cc37e103 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:10.604410 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c2a59283-f348-49ba-8db6-a881cc37e103 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:10.607812 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c2a59283-f348-49ba-8db6-a881cc37e103 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:10.609657 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c2a59283-f348-49ba-8db6-a881cc37e103 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] 10.222.0.20 "GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac" status: 200 len: 1849 microversion: 2.32 time: 1.110770 Oct 27 03:38:10.612503 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1919/4096] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:38:09 2022] GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac => generated 1849 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:38:10.620551 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7ed360d8-2177-4667-adf7-d049ed499042 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:10.621615 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7ed360d8-2177-4667-adf7-d049ed499042 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:10.627774 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7ed360d8-2177-4667-adf7-d049ed499042 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:10.628623 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7ed360d8-2177-4667-adf7-d049ed499042 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:10.629189 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7ed360d8-2177-4667-adf7-d049ed499042 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:10.630066 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7ed360d8-2177-4667-adf7-d049ed499042 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:10.631019 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7ed360d8-2177-4667-adf7-d049ed499042 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:10.631603 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7ed360d8-2177-4667-adf7-d049ed499042 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:10.649471 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:38:10.756605 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9ed97656-5d8d-4c7b-8810-6f1e26fbf6cb tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:10.772042 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9ed97656-5d8d-4c7b-8810-6f1e26fbf6cb tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1505 microversion: 2.1 time: 0.374837 Oct 27 03:38:10.772772 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2178/4097] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:10 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1505 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:38:10.800440 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-823a122d-242d-4c47-ab04-c6cd2ca36f81 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:38:10.801049 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-823a122d-242d-4c47-ab04-c6cd2ca36f81 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:10.813690 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-823a122d-242d-4c47-ab04-c6cd2ca36f81 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:10.814700 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-823a122d-242d-4c47-ab04-c6cd2ca36f81 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:10.814700 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-823a122d-242d-4c47-ab04-c6cd2ca36f81 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:10.815444 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-823a122d-242d-4c47-ab04-c6cd2ca36f81 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:10.815922 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-823a122d-242d-4c47-ab04-c6cd2ca36f81 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:10.816350 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-823a122d-242d-4c47-ab04-c6cd2ca36f81 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:10.852114 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-823a122d-242d-4c47-ab04-c6cd2ca36f81 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] HTTP exception thrown: Cannot 'unshelve' instance 376ac459-e31f-4727-9e34-535f055ac20d while it is in vm_state active Oct 27 03:38:10.853906 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-823a122d-242d-4c47-ab04-c6cd2ca36f81 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Request method failure captured: Oct 27 03:38:10.853906 n-d-862769-1 devstack@n-api.service[121001]: request: POST /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d/action HTTP/1.1 Oct 27 03:38:10.853906 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:38:10.853906 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:38:10.853906 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:38:10.853906 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 18 Oct 27 03:38:10.853906 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:38:10.853906 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:38:10.853906 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:38:10.853906 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:38:10.853906 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfxF6ut9nM9a9AcpKLO7IgCu-akAJ2YJGjrI9C8NUveA8uObV2XgQIQvsIxuWjvLl9meIEqpfGwZYr8MTX_PAGoiJsNUPXh5ERSce5cPYQYCCFPL0HtTb-E11C_2kfWy1wRps1tClRNvtj8zAqCGRhs1x-Uvl0zISdfHepXmvWX31Us Oct 27 03:38:10.853906 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:38:10.853906 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:38:10.853906 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:38:10.853906 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:38:10.853906 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:38:10.853906 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:38:10.853906 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 8bb5d291069d4329a90123e327fe9c59 Oct 27 03:38:10.853906 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:38:10.853906 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:38:10.853906 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:38:10.853906 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8bb5d291069d4329a90123e327fe9c59"}]}] Oct 27 03:38:10.853906 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:38:10.853906 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 8bb5d291069d4329a90123e327fe9c59 Oct 27 03:38:10.853906 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:38:10.853906 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServersNegativeTestJSON-4378389-project Oct 27 03:38:10.853906 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:38:10.853906 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:38:10.853906 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: f9c32b7626594ff888970c7f3227bb20 Oct 27 03:38:10.853906 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServersNegativeTestJSON-4378389-project Oct 27 03:38:10.853906 n-d-862769-1 devstack@n-api.service[121001]: Oct 27 03:38:10.853906 n-d-862769-1 devstack@n-api.service[121001]: {"unshelve": null} Oct 27 03:38:10.853906 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:38:10.853906 n-d-862769-1 devstack@n-api.service[121001]: exception: Cannot 'unshelve' instance 376ac459-e31f-4727-9e34-535f055ac20d while it is in vm_state active Oct 27 03:38:10.853906 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '376ac459-e31f-4727-9e34-535f055ac20d', 'body': {'unshelve': None}} Oct 27 03:38:10.853906 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:38:10.853906 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:38:10.853906 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Oct 27 03:38:10.853906 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Oct 27 03:38:10.853906 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 27 03:38:10.853906 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 03:38:10.853906 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 03:38:10.853906 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 03:38:10.853906 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 27 03:38:10.853906 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 27 03:38:10.853906 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 376ac459-e31f-4727-9e34-535f055ac20d in vm_state active. Cannot unshelve while the instance is in this state. Oct 27 03:38:10.853906 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:38:10.853906 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:38:10.853906 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:38:10.853906 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:38:10.853906 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:38:10.853906 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:38:10.853906 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:38:10.853906 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:38:10.853906 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:38:10.853906 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:38:10.853906 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:38:10.853906 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:38:10.853906 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:38:10.853906 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:38:10.853906 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Oct 27 03:38:10.853906 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 27 03:38:10.853906 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 27 03:38:10.853906 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 27 03:38:10.862772 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 376ac459-e31f-4727-9e34-535f055ac20d while it is in vm_state active Oct 27 03:38:10.862772 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:38:10.862772 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:38:10.862772 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:38:10.862772 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:38:10.862772 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:38:10.862772 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:38:10.862772 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:38:10.862772 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:38:10.862772 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 376ac459-e31f-4727-9e34-535f055ac20d while it is in vm_state active Oct 27 03:38:10.862772 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:38:10.862772 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-823a122d-242d-4c47-ab04-c6cd2ca36f81 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Returning 409 to user: Cannot 'unshelve' instance 376ac459-e31f-4727-9e34-535f055ac20d while it is in vm_state active {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:38:10.862772 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-823a122d-242d-4c47-ab04-c6cd2ca36f81 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "POST /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d/action" status: 409 len: 146 microversion: 2.1 time: 0.058994 Oct 27 03:38:10.864165 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7ed360d8-2177-4667-adf7-d049ed499042 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:10.866457 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2179/4098] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:38:10 2022] POST /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d/action => generated 146 bytes in 70 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 27 03:38:10.875207 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7ed360d8-2177-4667-adf7-d049ed499042 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1665 microversion: 2.1 time: 0.261239 Oct 27 03:38:10.875878 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1920/4099] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:10 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1665 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:38:10.881311 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-81fac6a7-f92d-4412-81c5-19adfd0480c4 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:10.881950 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-81fac6a7-f92d-4412-81c5-19adfd0480c4 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:10.889168 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-81fac6a7-f92d-4412-81c5-19adfd0480c4 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:10.889660 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-81fac6a7-f92d-4412-81c5-19adfd0480c4 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:10.890137 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-81fac6a7-f92d-4412-81c5-19adfd0480c4 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:10.890860 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-81fac6a7-f92d-4412-81c5-19adfd0480c4 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:10.891310 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-81fac6a7-f92d-4412-81c5-19adfd0480c4 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:10.891740 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-81fac6a7-f92d-4412-81c5-19adfd0480c4 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:11.403716 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-23c134c8-bdf3-42c2-bb23-007b46d743f5 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:11.404375 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-23c134c8-bdf3-42c2-bb23-007b46d743f5 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 17bdf735-2944-4b40-984c-4646caa855f0] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:11.412525 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-23c134c8-bdf3-42c2-bb23-007b46d743f5 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:11.413220 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-23c134c8-bdf3-42c2-bb23-007b46d743f5 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:11.413669 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-23c134c8-bdf3-42c2-bb23-007b46d743f5 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:11.414407 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-23c134c8-bdf3-42c2-bb23-007b46d743f5 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:11.414897 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-23c134c8-bdf3-42c2-bb23-007b46d743f5 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:11.415332 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-23c134c8-bdf3-42c2-bb23-007b46d743f5 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:11.634418 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-23c134c8-bdf3-42c2-bb23-007b46d743f5 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:11.642580 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-23c134c8-bdf3-42c2-bb23-007b46d743f5 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/17bdf735-2944-4b40-984c-4646caa855f0" status: 200 len: 1508 microversion: 2.1 time: 0.243661 Oct 27 03:38:11.643172 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1921/4100] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:11 2022] GET /compute/v2.1/servers/17bdf735-2944-4b40-984c-4646caa855f0 => generated 1508 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:38:11.660910 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-e636306a-ae21-48cf-bd4a-7e981bae703d req-16b1a5b5-6c2d-4414-8271-81e852c668a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e73d534-0a40-42d2-813c-2e9dbb9239ac", "tag": "0cd3187b-ba4d-438e-9eba-f156955f5791"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:38:11.668286 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:38:11.673775 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-e636306a-ae21-48cf-bd4a-7e981bae703d req-16b1a5b5-6c2d-4414-8271-81e852c668a0 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:11.674654 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-e636306a-ae21-48cf-bd4a-7e981bae703d req-16b1a5b5-6c2d-4414-8271-81e852c668a0 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:11.675093 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-e636306a-ae21-48cf-bd4a-7e981bae703d req-16b1a5b5-6c2d-4414-8271-81e852c668a0 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:11.689869 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-e636306a-ae21-48cf-bd4a-7e981bae703d req-16b1a5b5-6c2d-4414-8271-81e852c668a0 service nova] Creating event network-changed:0cd3187b-ba4d-438e-9eba-f156955f5791 for instance 7e73d534-0a40-42d2-813c-2e9dbb9239ac on n-h2-862769-1 Oct 27 03:38:11.694772 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-e636306a-ae21-48cf-bd4a-7e981bae703d req-16b1a5b5-6c2d-4414-8271-81e852c668a0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049763 Oct 27 03:38:11.697765 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1922/4101] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:38:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:38:11.701217 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c4f8fbcf-8941-4de6-9ddb-e9c73a50b517 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:11.702060 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c4f8fbcf-8941-4de6-9ddb-e9c73a50b517 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] [instance: 7e73d534-0a40-42d2-813c-2e9dbb9239ac] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:11.705411 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-81fac6a7-f92d-4412-81c5-19adfd0480c4 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:11.709723 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c4f8fbcf-8941-4de6-9ddb-e9c73a50b517 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:11.710421 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c4f8fbcf-8941-4de6-9ddb-e9c73a50b517 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:11.711149 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c4f8fbcf-8941-4de6-9ddb-e9c73a50b517 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:11.712027 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c4f8fbcf-8941-4de6-9ddb-e9c73a50b517 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:11.712742 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c4f8fbcf-8941-4de6-9ddb-e9c73a50b517 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:11.713498 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c4f8fbcf-8941-4de6-9ddb-e9c73a50b517 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:11.723117 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-81fac6a7-f92d-4412-81c5-19adfd0480c4 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1505 microversion: 2.1 time: 0.855436 Oct 27 03:38:11.723869 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2180/4102] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:10 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1505 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:38:11.757530 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-59e4d040-f9a2-4daa-8733-ca5b69c2f045 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:11.758601 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-59e4d040-f9a2-4daa-8733-ca5b69c2f045 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:11.768503 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-59e4d040-f9a2-4daa-8733-ca5b69c2f045 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:11.769278 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-59e4d040-f9a2-4daa-8733-ca5b69c2f045 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:11.769922 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-59e4d040-f9a2-4daa-8733-ca5b69c2f045 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:11.774435 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-59e4d040-f9a2-4daa-8733-ca5b69c2f045 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:11.775191 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-59e4d040-f9a2-4daa-8733-ca5b69c2f045 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:11.775933 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-59e4d040-f9a2-4daa-8733-ca5b69c2f045 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:12.161496 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-59e4d040-f9a2-4daa-8733-ca5b69c2f045 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:12.178719 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-59e4d040-f9a2-4daa-8733-ca5b69c2f045 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1505 microversion: 2.1 time: 0.424772 Oct 27 03:38:12.179921 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2181/4103] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:11 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1505 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:38:12.185251 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d474940b-bec2-47a1-a4e1-0fea4cbbfac2 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:12.186259 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d474940b-bec2-47a1-a4e1-0fea4cbbfac2 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:12.193059 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d474940b-bec2-47a1-a4e1-0fea4cbbfac2 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:12.193767 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d474940b-bec2-47a1-a4e1-0fea4cbbfac2 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:12.194426 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d474940b-bec2-47a1-a4e1-0fea4cbbfac2 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:12.195357 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d474940b-bec2-47a1-a4e1-0fea4cbbfac2 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:12.196209 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d474940b-bec2-47a1-a4e1-0fea4cbbfac2 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:12.196967 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d474940b-bec2-47a1-a4e1-0fea4cbbfac2 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:12.232687 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c4f8fbcf-8941-4de6-9ddb-e9c73a50b517 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:12.245402 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c4f8fbcf-8941-4de6-9ddb-e9c73a50b517 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:12.246887 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c4f8fbcf-8941-4de6-9ddb-e9c73a50b517 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:12.248251 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c4f8fbcf-8941-4de6-9ddb-e9c73a50b517 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] 10.222.0.20 "GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac" status: 200 len: 1849 microversion: 2.32 time: 0.551299 Oct 27 03:38:12.249046 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1923/4104] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:38:11 2022] GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac => generated 1849 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:38:12.273855 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4b3cce00-5fc3-46d8-896b-6ff58b264caa tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1331079798_updated"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:38:12.277992 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4b3cce00-5fc3-46d8-896b-6ff58b264caa tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 7efe92d7-b016-4999-b121-65531f728a66] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:12.284302 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-4b3cce00-5fc3-46d8-896b-6ff58b264caa tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] HTTP exception thrown: Instance 7efe92d7-b016-4999-b121-65531f728a66 could not be found. Oct 27 03:38:12.286704 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4b3cce00-5fc3-46d8-896b-6ff58b264caa tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Request method failure captured: Oct 27 03:38:12.286704 n-d-862769-1 devstack@n-api.service[121000]: request: PUT /compute/v2.1/servers/7efe92d7-b016-4999-b121-65531f728a66 HTTP/1.1 Oct 27 03:38:12.286704 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:38:12.286704 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:38:12.286704 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:38:12.286704 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 81 Oct 27 03:38:12.286704 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:38:12.286704 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:38:12.286704 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:38:12.286704 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:38:12.286704 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfxF6ut9nM9a9AcpKLO7IgCu-akAJ2YJGjrI9C8NUveA8uObV2XgQIQvsIxuWjvLl9meIEqpfGwZYr8MTX_PAGoiJsNUPXh5ERSce5cPYQYCCFPL0HtTb-E11C_2kfWy1wRps1tClRNvtj8zAqCGRhs1x-Uvl0zISdfHepXmvWX31Us Oct 27 03:38:12.286704 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:38:12.286704 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:38:12.286704 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:38:12.286704 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:38:12.286704 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:38:12.286704 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:38:12.286704 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 8bb5d291069d4329a90123e327fe9c59 Oct 27 03:38:12.286704 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:38:12.286704 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:38:12.286704 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:38:12.286704 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8bb5d291069d4329a90123e327fe9c59"}]}] Oct 27 03:38:12.286704 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:38:12.286704 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 8bb5d291069d4329a90123e327fe9c59 Oct 27 03:38:12.286704 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:38:12.286704 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ServersNegativeTestJSON-4378389-project Oct 27 03:38:12.286704 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:38:12.286704 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:38:12.286704 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: f9c32b7626594ff888970c7f3227bb20 Oct 27 03:38:12.286704 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ServersNegativeTestJSON-4378389-project Oct 27 03:38:12.286704 n-d-862769-1 devstack@n-api.service[121000]: Oct 27 03:38:12.286704 n-d-862769-1 devstack@n-api.service[121000]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1331079798_updated"}} Oct 27 03:38:12.286704 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:38:12.286704 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 7efe92d7-b016-4999-b121-65531f728a66 could not be found. Oct 27 03:38:12.286704 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '7efe92d7-b016-4999-b121-65531f728a66', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1331079798_updated'}}} Oct 27 03:38:12.286704 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:38:12.286704 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:38:12.286704 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:38:12.286704 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:38:12.286704 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:38:12.286704 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:38:12.286704 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 03:38:12.286704 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 03:38:12.286704 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7efe92d7-b016-4999-b121-65531f728a66 could not be found. Oct 27 03:38:12.286704 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:38:12.286704 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:38:12.286704 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:38:12.286704 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:38:12.286704 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:38:12.286704 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:38:12.286704 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:38:12.286704 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:38:12.286704 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:38:12.286704 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:38:12.286704 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:38:12.286704 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:38:12.286704 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:38:12.286704 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:38:12.286704 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:38:12.286704 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:38:12.286704 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 27 03:38:12.286704 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 27 03:38:12.286704 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 27 03:38:12.286704 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:38:12.292637 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:38:12.292637 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:38:12.292637 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:38:12.292637 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7efe92d7-b016-4999-b121-65531f728a66 could not be found. Oct 27 03:38:12.292637 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:38:12.292637 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:38:12.292637 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:38:12.292637 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:38:12.292637 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:38:12.292637 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:38:12.292637 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:38:12.292637 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:38:12.292637 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7efe92d7-b016-4999-b121-65531f728a66 could not be found. Oct 27 03:38:12.292637 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:38:12.294724 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4b3cce00-5fc3-46d8-896b-6ff58b264caa tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Returning 404 to user: Instance 7efe92d7-b016-4999-b121-65531f728a66 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:38:12.295783 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4b3cce00-5fc3-46d8-896b-6ff58b264caa tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "PUT /compute/v2.1/servers/7efe92d7-b016-4999-b121-65531f728a66" status: 404 len: 111 microversion: 2.1 time: 0.032329 Oct 27 03:38:12.300095 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1924/4105] 10.222.0.20 () {60 vars in 1256 bytes} [Thu Oct 27 03:38:12 2022] PUT /compute/v2.1/servers/7efe92d7-b016-4999-b121-65531f728a66 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:38:12.305203 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6adf53ab-8bff-4dde-b632-37538987f804 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:12.313493 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6adf53ab-8bff-4dde-b632-37538987f804 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:12.322852 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6adf53ab-8bff-4dde-b632-37538987f804 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:12.324039 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6adf53ab-8bff-4dde-b632-37538987f804 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:12.324555 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6adf53ab-8bff-4dde-b632-37538987f804 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:12.325407 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6adf53ab-8bff-4dde-b632-37538987f804 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:12.332955 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6adf53ab-8bff-4dde-b632-37538987f804 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:12.332955 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6adf53ab-8bff-4dde-b632-37538987f804 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:12.442316 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d474940b-bec2-47a1-a4e1-0fea4cbbfac2 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:12.457199 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d474940b-bec2-47a1-a4e1-0fea4cbbfac2 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1669 microversion: 2.1 time: 0.275686 Oct 27 03:38:12.474193 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2182/4106] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:12 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1669 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:38:12.485396 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-879a3e0f-90a3-4db9-88ef-28b57342cc3c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:12.486303 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-879a3e0f-90a3-4db9-88ef-28b57342cc3c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:12.493423 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-879a3e0f-90a3-4db9-88ef-28b57342cc3c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:12.493934 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-879a3e0f-90a3-4db9-88ef-28b57342cc3c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:12.494638 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-879a3e0f-90a3-4db9-88ef-28b57342cc3c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:12.495928 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-879a3e0f-90a3-4db9-88ef-28b57342cc3c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:12.496533 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-879a3e0f-90a3-4db9-88ef-28b57342cc3c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:12.496985 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-879a3e0f-90a3-4db9-88ef-28b57342cc3c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:12.661290 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-6adf53ab-8bff-4dde-b632-37538987f804 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:12.675361 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6adf53ab-8bff-4dde-b632-37538987f804 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1505 microversion: 2.1 time: 0.373752 Oct 27 03:38:12.678172 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1925/4107] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:12 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1505 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:38:12.686020 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e4d70aab-c47f-498b-baef-dda3e1e93046 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:12.687109 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e4d70aab-c47f-498b-baef-dda3e1e93046 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 17bdf735-2944-4b40-984c-4646caa855f0] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:12.695651 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e4d70aab-c47f-498b-baef-dda3e1e93046 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:12.696623 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e4d70aab-c47f-498b-baef-dda3e1e93046 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:12.697521 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e4d70aab-c47f-498b-baef-dda3e1e93046 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:12.699177 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e4d70aab-c47f-498b-baef-dda3e1e93046 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:12.699864 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e4d70aab-c47f-498b-baef-dda3e1e93046 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:12.700598 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e4d70aab-c47f-498b-baef-dda3e1e93046 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:12.779313 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e4d70aab-c47f-498b-baef-dda3e1e93046 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:12.789143 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e4d70aab-c47f-498b-baef-dda3e1e93046 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/17bdf735-2944-4b40-984c-4646caa855f0" status: 200 len: 1466 microversion: 2.1 time: 0.109092 Oct 27 03:38:12.809131 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1926/4108] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:12 2022] GET /compute/v2.1/servers/17bdf735-2944-4b40-984c-4646caa855f0 => generated 1466 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:38:12.814387 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d0002f78-3bf8-41e2-8dcc-00e8af1ce9ae tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:12.815323 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d0002f78-3bf8-41e2-8dcc-00e8af1ce9ae tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:12.823190 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d0002f78-3bf8-41e2-8dcc-00e8af1ce9ae tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:12.824255 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d0002f78-3bf8-41e2-8dcc-00e8af1ce9ae tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:12.824962 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d0002f78-3bf8-41e2-8dcc-00e8af1ce9ae tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:12.825959 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d0002f78-3bf8-41e2-8dcc-00e8af1ce9ae tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:12.826446 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d0002f78-3bf8-41e2-8dcc-00e8af1ce9ae tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:12.826875 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d0002f78-3bf8-41e2-8dcc-00e8af1ce9ae tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:12.842490 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-879a3e0f-90a3-4db9-88ef-28b57342cc3c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:12.853703 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-879a3e0f-90a3-4db9-88ef-28b57342cc3c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1669 microversion: 2.1 time: 0.372827 Oct 27 03:38:12.854333 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2183/4109] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:12 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1669 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:38:12.886930 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-aeed9016-cac9-4427-9164-1a8a39ee2efd tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:12.888528 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-aeed9016-cac9-4427-9164-1a8a39ee2efd tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:12.902013 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aeed9016-cac9-4427-9164-1a8a39ee2efd tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:12.904595 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aeed9016-cac9-4427-9164-1a8a39ee2efd tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:12.904595 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aeed9016-cac9-4427-9164-1a8a39ee2efd tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:12.904595 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aeed9016-cac9-4427-9164-1a8a39ee2efd tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:12.905178 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aeed9016-cac9-4427-9164-1a8a39ee2efd tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:12.905808 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aeed9016-cac9-4427-9164-1a8a39ee2efd tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:13.100796 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d0002f78-3bf8-41e2-8dcc-00e8af1ce9ae tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:13.116556 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d0002f78-3bf8-41e2-8dcc-00e8af1ce9ae tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1505 microversion: 2.1 time: 0.306048 Oct 27 03:38:13.130307 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1927/4110] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:12 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1505 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:38:13.141712 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-7321f32a-517d-4d23-9b8e-bbde65e67134 req-b64d6830-d251-4bae-b266-bb1fd8a17559 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17bdf735-2944-4b40-984c-4646caa855f0", "name": "network-vif-deleted", "tag": "06874d1d-d01a-4494-a246-90bef790a6f3"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:38:13.152457 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-7321f32a-517d-4d23-9b8e-bbde65e67134 req-b64d6830-d251-4bae-b266-bb1fd8a17559 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:13.153051 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-7321f32a-517d-4d23-9b8e-bbde65e67134 req-b64d6830-d251-4bae-b266-bb1fd8a17559 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:13.153784 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-7321f32a-517d-4d23-9b8e-bbde65e67134 req-b64d6830-d251-4bae-b266-bb1fd8a17559 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:13.172010 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-7321f32a-517d-4d23-9b8e-bbde65e67134 req-b64d6830-d251-4bae-b266-bb1fd8a17559 service nova] Creating event network-vif-deleted:06874d1d-d01a-4494-a246-90bef790a6f3 for instance 17bdf735-2944-4b40-984c-4646caa855f0 on n-h2-862769-1 Oct 27 03:38:13.180178 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-7321f32a-517d-4d23-9b8e-bbde65e67134 req-b64d6830-d251-4bae-b266-bb1fd8a17559 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048278 Oct 27 03:38:13.181513 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1928/4111] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:38:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:38:13.189968 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f9d92fa9-a2bf-4ddd-bb1e-757d616e9ae5 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:38:13.194614 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f9d92fa9-a2bf-4ddd-bb1e-757d616e9ae5 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Request method failure captured: Oct 27 03:38:13.194614 n-d-862769-1 devstack@n-api.service[121000]: request: PUT /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d HTTP/1.1 Oct 27 03:38:13.194614 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:38:13.194614 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:38:13.194614 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:38:13.194614 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 280 Oct 27 03:38:13.194614 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:38:13.194614 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:38:13.194614 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:38:13.194614 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:38:13.194614 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfxF6ut9nM9a9AcpKLO7IgCu-akAJ2YJGjrI9C8NUveA8uObV2XgQIQvsIxuWjvLl9meIEqpfGwZYr8MTX_PAGoiJsNUPXh5ERSce5cPYQYCCFPL0HtTb-E11C_2kfWy1wRps1tClRNvtj8zAqCGRhs1x-Uvl0zISdfHepXmvWX31Us Oct 27 03:38:13.194614 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:38:13.194614 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:38:13.194614 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:38:13.194614 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:38:13.194614 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:38:13.194614 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:38:13.194614 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 8bb5d291069d4329a90123e327fe9c59 Oct 27 03:38:13.194614 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:38:13.194614 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:38:13.194614 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:38:13.194614 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8bb5d291069d4329a90123e327fe9c59"}]}] Oct 27 03:38:13.194614 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:38:13.194614 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 8bb5d291069d4329a90123e327fe9c59 Oct 27 03:38:13.194614 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:38:13.194614 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ServersNegativeTestJSON-4378389-project Oct 27 03:38:13.194614 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:38:13.194614 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:38:13.194614 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: f9c32b7626594ff888970c7f3227bb20 Oct 27 03:38:13.194614 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ServersNegativeTestJSON-4378389-project Oct 27 03:38:13.194614 n-d-862769-1 devstack@n-api.service[121000]: Oct 27 03:38:13.194614 n-d-862769-1 devstack@n-api.service[121000]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 27 03:38:13.194614 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:38:13.194614 n-d-862769-1 devstack@n-api.service[121000]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 27 03:38:13.194614 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '376ac459-e31f-4727-9e34-535f055ac20d', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 27 03:38:13.194614 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:38:13.194614 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:38:13.194614 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 03:38:13.194614 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 03:38:13.194614 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 03:38:13.194614 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise error Oct 27 03:38:13.194614 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 27 03:38:13.194614 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:38:13.194614 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 27 03:38:13.194614 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 27 03:38:13.194614 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:38:13.194614 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 27 03:38:13.194614 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 27 03:38:13.194614 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:38:13.194614 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:38:13.194614 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:38:13.194614 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:38:13.206210 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:38:13.206210 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:38:13.206210 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:38:13.206210 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:38:13.206210 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:38:13.206210 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:38:13.206210 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:38:13.206210 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:38:13.206210 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 03:38:13.206210 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 03:38:13.206210 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 03:38:13.206210 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 03:38:13.206210 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 03:38:13.206210 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 03:38:13.206210 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 27 03:38:13.206210 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:38:13.206210 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:38:13.206210 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:38:13.206210 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:38:13.206210 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:38:13.206210 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:38:13.206210 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 03:38:13.206210 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 03:38:13.206210 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 27 03:38:13.206210 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:38:13.206210 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f9d92fa9-a2bf-4ddd-bb1e-757d616e9ae5 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:38:13.206210 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f9d92fa9-a2bf-4ddd-bb1e-757d616e9ae5 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "PUT /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 400 len: 619 microversion: 2.1 time: 0.012744 Oct 27 03:38:13.206210 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1929/4112] 10.222.0.20 () {60 vars in 1257 bytes} [Thu Oct 27 03:38:13 2022] PUT /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 619 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 03:38:13.214965 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-48c14130-5e0a-47f7-b2b0-405174b66ba1 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:13.215934 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-48c14130-5e0a-47f7-b2b0-405174b66ba1 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:13.226287 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-48c14130-5e0a-47f7-b2b0-405174b66ba1 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:13.227252 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-48c14130-5e0a-47f7-b2b0-405174b66ba1 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:13.228185 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-48c14130-5e0a-47f7-b2b0-405174b66ba1 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:13.229511 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-48c14130-5e0a-47f7-b2b0-405174b66ba1 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:13.231414 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-48c14130-5e0a-47f7-b2b0-405174b66ba1 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:13.242278 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-48c14130-5e0a-47f7-b2b0-405174b66ba1 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:13.476912 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-aeed9016-cac9-4427-9164-1a8a39ee2efd tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:13.487744 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-aeed9016-cac9-4427-9164-1a8a39ee2efd tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1669 microversion: 2.1 time: 0.605669 Oct 27 03:38:13.489053 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2184/4113] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:12 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1669 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:38:13.503083 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5d5047ff-85b0-4d82-b32d-f2927622985e tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:13.506207 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5d5047ff-85b0-4d82-b32d-f2927622985e tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] [instance: 7e73d534-0a40-42d2-813c-2e9dbb9239ac] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:13.513460 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5d5047ff-85b0-4d82-b32d-f2927622985e tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:13.514317 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5d5047ff-85b0-4d82-b32d-f2927622985e tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:13.514992 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5d5047ff-85b0-4d82-b32d-f2927622985e tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:13.515956 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5d5047ff-85b0-4d82-b32d-f2927622985e tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:13.516627 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5d5047ff-85b0-4d82-b32d-f2927622985e tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:13.517275 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5d5047ff-85b0-4d82-b32d-f2927622985e tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:13.540630 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-48c14130-5e0a-47f7-b2b0-405174b66ba1 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:13.548994 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-48c14130-5e0a-47f7-b2b0-405174b66ba1 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1505 microversion: 2.1 time: 0.338890 Oct 27 03:38:13.549579 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1930/4114] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:13 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1505 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:38:13.555163 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a31b2c5b-d55b-4ce1-b70e-334ce393700f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:13.555793 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a31b2c5b-d55b-4ce1-b70e-334ce393700f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:13.562475 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a31b2c5b-d55b-4ce1-b70e-334ce393700f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:13.562975 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a31b2c5b-d55b-4ce1-b70e-334ce393700f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:13.563413 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a31b2c5b-d55b-4ce1-b70e-334ce393700f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:13.564160 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a31b2c5b-d55b-4ce1-b70e-334ce393700f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:13.564612 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a31b2c5b-d55b-4ce1-b70e-334ce393700f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:13.565044 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a31b2c5b-d55b-4ce1-b70e-334ce393700f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:13.717138 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a31b2c5b-d55b-4ce1-b70e-334ce393700f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:13.717815 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5d5047ff-85b0-4d82-b32d-f2927622985e tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:13.726624 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a31b2c5b-d55b-4ce1-b70e-334ce393700f tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1669 microversion: 2.1 time: 0.175873 Oct 27 03:38:13.727233 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1931/4115] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:13 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1669 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:38:13.738299 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5d5047ff-85b0-4d82-b32d-f2927622985e tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:13.738299 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5d5047ff-85b0-4d82-b32d-f2927622985e tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:13.738299 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5d5047ff-85b0-4d82-b32d-f2927622985e tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] 10.222.0.20 "GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac" status: 200 len: 1870 microversion: 2.32 time: 0.239937 Oct 27 03:38:13.738299 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2185/4116] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:38:13 2022] GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac => generated 1870 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:38:13.738299 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0c60e58e-152d-404d-9e7b-b7d147066da7 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:13.738299 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0c60e58e-152d-404d-9e7b-b7d147066da7 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:13.741994 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0c60e58e-152d-404d-9e7b-b7d147066da7 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:13.742687 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0c60e58e-152d-404d-9e7b-b7d147066da7 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:13.743299 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0c60e58e-152d-404d-9e7b-b7d147066da7 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:13.744207 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0c60e58e-152d-404d-9e7b-b7d147066da7 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:13.745000 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0c60e58e-152d-404d-9e7b-b7d147066da7 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:13.745640 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0c60e58e-152d-404d-9e7b-b7d147066da7 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:13.749807 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-820f2e07-cdf8-4c97-890a-cae2f9e2f88e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:13.750530 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-820f2e07-cdf8-4c97-890a-cae2f9e2f88e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:13.756451 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-820f2e07-cdf8-4c97-890a-cae2f9e2f88e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:13.757013 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-820f2e07-cdf8-4c97-890a-cae2f9e2f88e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:13.757522 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-820f2e07-cdf8-4c97-890a-cae2f9e2f88e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:13.758325 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-820f2e07-cdf8-4c97-890a-cae2f9e2f88e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:13.758873 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-820f2e07-cdf8-4c97-890a-cae2f9e2f88e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:13.759449 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-820f2e07-cdf8-4c97-890a-cae2f9e2f88e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:13.883862 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0c60e58e-152d-404d-9e7b-b7d147066da7 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:13.893337 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0c60e58e-152d-404d-9e7b-b7d147066da7 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1505 microversion: 2.1 time: 0.161407 Oct 27 03:38:13.894081 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2186/4117] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:13 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1505 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:38:13.910618 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-820f2e07-cdf8-4c97-890a-cae2f9e2f88e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:13.919621 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-820f2e07-cdf8-4c97-890a-cae2f9e2f88e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1669 microversion: 2.1 time: 0.173664 Oct 27 03:38:13.924570 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1932/4118] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:13 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1669 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:38:13.926026 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c7f7e5e1-0006-40a9-aa61-939c6f5cab11 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:13.926671 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c7f7e5e1-0006-40a9-aa61-939c6f5cab11 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 17bdf735-2944-4b40-984c-4646caa855f0] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:13.931118 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e6468c19-b34d-4887-97f7-847144aaab7b tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:38:13.936264 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e6468c19-b34d-4887-97f7-847144aaab7b tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Request method failure captured: Oct 27 03:38:13.936264 n-d-862769-1 devstack@n-api.service[121000]: request: PUT /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d HTTP/1.1 Oct 27 03:38:13.936264 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:38:13.936264 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:38:13.936264 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:38:13.936264 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 24 Oct 27 03:38:13.936264 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:38:13.936264 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:38:13.936264 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:38:13.936264 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:38:13.936264 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfxF6ut9nM9a9AcpKLO7IgCu-akAJ2YJGjrI9C8NUveA8uObV2XgQIQvsIxuWjvLl9meIEqpfGwZYr8MTX_PAGoiJsNUPXh5ERSce5cPYQYCCFPL0HtTb-E11C_2kfWy1wRps1tClRNvtj8zAqCGRhs1x-Uvl0zISdfHepXmvWX31Us Oct 27 03:38:13.936264 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:38:13.936264 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:38:13.936264 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:38:13.936264 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:38:13.936264 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:38:13.936264 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:38:13.936264 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 8bb5d291069d4329a90123e327fe9c59 Oct 27 03:38:13.936264 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:38:13.936264 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:38:13.936264 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:38:13.936264 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8bb5d291069d4329a90123e327fe9c59"}]}] Oct 27 03:38:13.936264 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:38:13.936264 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 8bb5d291069d4329a90123e327fe9c59 Oct 27 03:38:13.936264 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:38:13.936264 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ServersNegativeTestJSON-4378389-project Oct 27 03:38:13.936264 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:38:13.936264 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:38:13.936264 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: f9c32b7626594ff888970c7f3227bb20 Oct 27 03:38:13.936264 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ServersNegativeTestJSON-4378389-project Oct 27 03:38:13.936264 n-d-862769-1 devstack@n-api.service[121000]: Oct 27 03:38:13.936264 n-d-862769-1 devstack@n-api.service[121000]: {"server": {"name": ""}} Oct 27 03:38:13.936264 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:38:13.936264 n-d-862769-1 devstack@n-api.service[121000]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 27 03:38:13.936264 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '376ac459-e31f-4727-9e34-535f055ac20d', 'body': {'server': {'name': ''}}} Oct 27 03:38:13.936264 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:38:13.936264 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:38:13.936264 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 03:38:13.936264 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 03:38:13.936264 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 03:38:13.936264 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise error Oct 27 03:38:13.936264 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 27 03:38:13.936264 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:38:13.936264 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 27 03:38:13.936264 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 27 03:38:13.936264 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:38:13.936264 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 27 03:38:13.936264 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi '' Oct 27 03:38:13.936264 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:38:13.936264 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:38:13.936264 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:38:13.936264 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:38:13.936264 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:38:13.936264 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:38:13.936264 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:38:13.936264 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:38:13.936264 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:38:13.936264 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:38:13.936264 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:38:13.936264 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:38:13.936264 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 03:38:13.936264 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 03:38:13.936264 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 03:38:13.936264 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 03:38:13.936264 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 03:38:13.936264 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 03:38:13.936264 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 27 03:38:13.941526 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:38:13.941526 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:38:13.941526 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:38:13.941526 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:38:13.941526 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:38:13.941526 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:38:13.941526 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 03:38:13.941526 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 03:38:13.941526 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 27 03:38:13.941526 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:38:13.945827 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c7f7e5e1-0006-40a9-aa61-939c6f5cab11 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:13.963731 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c7f7e5e1-0006-40a9-aa61-939c6f5cab11 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:13.965195 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c7f7e5e1-0006-40a9-aa61-939c6f5cab11 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:13.967258 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c7f7e5e1-0006-40a9-aa61-939c6f5cab11 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:13.968196 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c7f7e5e1-0006-40a9-aa61-939c6f5cab11 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:13.969546 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c7f7e5e1-0006-40a9-aa61-939c6f5cab11 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:13.975230 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e6468c19-b34d-4887-97f7-847144aaab7b tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:38:13.989257 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e6468c19-b34d-4887-97f7-847144aaab7b tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "PUT /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 400 len: 108 microversion: 2.1 time: 0.066169 Oct 27 03:38:13.993569 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1933/4119] 10.222.0.20 () {60 vars in 1256 bytes} [Thu Oct 27 03:38:13 2022] PUT /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 108 bytes in 71 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 03:38:14.017940 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f6eb3339-cb40-48a3-85aa-150935d4f9ed tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:38:14.024302 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f6eb3339-cb40-48a3-85aa-150935d4f9ed tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:14.031879 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c7f7e5e1-0006-40a9-aa61-939c6f5cab11 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:14.032455 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c7f7e5e1-0006-40a9-aa61-939c6f5cab11 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:14.032910 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c7f7e5e1-0006-40a9-aa61-939c6f5cab11 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:14.040835 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-c7f7e5e1-0006-40a9-aa61-939c6f5cab11 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lazy-loading 'fault' on Instance uuid 17bdf735-2944-4b40-984c-4646caa855f0 {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:38:14.070795 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f6eb3339-cb40-48a3-85aa-150935d4f9ed tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:14.074226 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f6eb3339-cb40-48a3-85aa-150935d4f9ed tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:14.076044 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f6eb3339-cb40-48a3-85aa-150935d4f9ed tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:14.077222 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f6eb3339-cb40-48a3-85aa-150935d4f9ed tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:14.077994 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f6eb3339-cb40-48a3-85aa-150935d4f9ed tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:14.086304 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f6eb3339-cb40-48a3-85aa-150935d4f9ed tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:14.166562 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c7f7e5e1-0006-40a9-aa61-939c6f5cab11 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:14.179750 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-f6eb3339-cb40-48a3-85aa-150935d4f9ed tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lazy-loading 'flavor' on Instance uuid ed74f42b-af82-4808-bfc2-86110840fe86 {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:38:14.181080 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c7f7e5e1-0006-40a9-aa61-939c6f5cab11 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/17bdf735-2944-4b40-984c-4646caa855f0" status: 200 len: 1305 microversion: 2.1 time: 0.268877 Oct 27 03:38:14.192085 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2187/4120] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:13 2022] GET /compute/v2.1/servers/17bdf735-2944-4b40-984c-4646caa855f0 => generated 1305 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:38:14.204590 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-998f0298-87ad-436b-8d90-b185217c29ae tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:14.211300 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-998f0298-87ad-436b-8d90-b185217c29ae tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:14.238346 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-998f0298-87ad-436b-8d90-b185217c29ae tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:14.238803 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-998f0298-87ad-436b-8d90-b185217c29ae tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:14.239254 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-998f0298-87ad-436b-8d90-b185217c29ae tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:14.239978 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-998f0298-87ad-436b-8d90-b185217c29ae tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:14.240441 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-998f0298-87ad-436b-8d90-b185217c29ae tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:14.240878 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-998f0298-87ad-436b-8d90-b185217c29ae tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:14.640444 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f6eb3339-cb40-48a3-85aa-150935d4f9ed tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "POST /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86/action" status: 202 len: 0 microversion: 2.1 time: 0.642451 Oct 27 03:38:14.645353 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1934/4121] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:38:13 2022] POST /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86/action => generated 0 bytes in 647 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:38:14.671538 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-3e2a93f6-8011-4e1a-80ae-fa66cffc2c1e req-b2606c4a-0546-4be3-8365-705d3c24cd87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e73d534-0a40-42d2-813c-2e9dbb9239ac", "tag": "190ba0a3-05d8-4eb3-b0ba-354848d76577"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:38:14.696733 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-3e2a93f6-8011-4e1a-80ae-fa66cffc2c1e req-b2606c4a-0546-4be3-8365-705d3c24cd87 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:14.702708 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-3e2a93f6-8011-4e1a-80ae-fa66cffc2c1e req-b2606c4a-0546-4be3-8365-705d3c24cd87 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:14.702708 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-3e2a93f6-8011-4e1a-80ae-fa66cffc2c1e req-b2606c4a-0546-4be3-8365-705d3c24cd87 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:14.725732 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-998f0298-87ad-436b-8d90-b185217c29ae tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:14.729666 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-3e2a93f6-8011-4e1a-80ae-fa66cffc2c1e req-b2606c4a-0546-4be3-8365-705d3c24cd87 service nova] Creating event network-changed:190ba0a3-05d8-4eb3-b0ba-354848d76577 for instance 7e73d534-0a40-42d2-813c-2e9dbb9239ac on n-h2-862769-1 Oct 27 03:38:14.741273 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-998f0298-87ad-436b-8d90-b185217c29ae tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1505 microversion: 2.1 time: 0.540604 Oct 27 03:38:14.744702 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-3e2a93f6-8011-4e1a-80ae-fa66cffc2c1e req-b2606c4a-0546-4be3-8365-705d3c24cd87 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096334 Oct 27 03:38:14.747572 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1935/4122] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:38:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:38:14.760137 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-dc374f6c-60a8-42cc-a958-f34c90987f82 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:14.765834 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-dc374f6c-60a8-42cc-a958-f34c90987f82 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:14.775382 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2188/4123] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:14 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1505 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:38:14.786565 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dc374f6c-60a8-42cc-a958-f34c90987f82 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:14.795176 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dc374f6c-60a8-42cc-a958-f34c90987f82 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:14.797530 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a825ea4a-98d0-428a-b42b-6058713575c6 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:14.799576 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a825ea4a-98d0-428a-b42b-6058713575c6 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] [instance: 7e73d534-0a40-42d2-813c-2e9dbb9239ac] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:14.802193 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dc374f6c-60a8-42cc-a958-f34c90987f82 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:14.803286 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dc374f6c-60a8-42cc-a958-f34c90987f82 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:14.807370 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dc374f6c-60a8-42cc-a958-f34c90987f82 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:14.808232 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dc374f6c-60a8-42cc-a958-f34c90987f82 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:14.818653 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a825ea4a-98d0-428a-b42b-6058713575c6 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:14.819174 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a825ea4a-98d0-428a-b42b-6058713575c6 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:14.819633 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a825ea4a-98d0-428a-b42b-6058713575c6 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:14.820366 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a825ea4a-98d0-428a-b42b-6058713575c6 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:14.820829 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a825ea4a-98d0-428a-b42b-6058713575c6 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:14.825451 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a825ea4a-98d0-428a-b42b-6058713575c6 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:15.160883 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-dc374f6c-60a8-42cc-a958-f34c90987f82 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:15.195440 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-dc374f6c-60a8-42cc-a958-f34c90987f82 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1677 microversion: 2.1 time: 0.423503 Oct 27 03:38:15.215881 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1936/4124] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:14 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1677 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:38:15.229601 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c43977d5-4fb9-4ce6-b0b9-798b304a3549 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:15.231288 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c43977d5-4fb9-4ce6-b0b9-798b304a3549 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 17bdf735-2944-4b40-984c-4646caa855f0] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:15.249309 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c43977d5-4fb9-4ce6-b0b9-798b304a3549 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:15.252100 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c43977d5-4fb9-4ce6-b0b9-798b304a3549 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:15.252833 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c43977d5-4fb9-4ce6-b0b9-798b304a3549 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:15.256319 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c43977d5-4fb9-4ce6-b0b9-798b304a3549 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:15.257475 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c43977d5-4fb9-4ce6-b0b9-798b304a3549 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:15.259239 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c43977d5-4fb9-4ce6-b0b9-798b304a3549 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:15.300469 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-c43977d5-4fb9-4ce6-b0b9-798b304a3549 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] HTTP exception thrown: Instance 17bdf735-2944-4b40-984c-4646caa855f0 could not be found. Oct 27 03:38:15.302223 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c43977d5-4fb9-4ce6-b0b9-798b304a3549 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Request method failure captured: Oct 27 03:38:15.302223 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/17bdf735-2944-4b40-984c-4646caa855f0 HTTP/1.1 Oct 27 03:38:15.302223 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:38:15.302223 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:38:15.302223 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:38:15.302223 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:38:15.302223 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:38:15.302223 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:38:15.302223 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:38:15.302223 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:38:15.302223 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfz83jPBQR-IO_RgpXfqqqN_tSIl3Aju213bQLpPTkR-R_lkTGSpHz1Evy7Lbg7I5hWxU9AxviJyxNS0i-wRdj1_O4LyvZEjE6jerjzwB22Vu4S-ThF8W8FJgumwczGUcQup-Bjpiay7kN0UoT8q0uFoQytE3MKt1MX9CDbsUgcc03A Oct 27 03:38:15.302223 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:38:15.302223 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:38:15.302223 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:38:15.302223 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:38:15.302223 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:38:15.302223 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:38:15.302223 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 911997e881754ce390af17919f29b4ab Oct 27 03:38:15.302223 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-DeleteServersTestJSON-858473437 Oct 27 03:38:15.302223 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:38:15.302223 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:38:15.302223 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/911997e881754ce390af17919f29b4ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/911997e881754ce390af17919f29b4ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/911997e881754ce390af17919f29b4ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_911997e881754ce390af17919f29b4ab"}]}] Oct 27 03:38:15.302223 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-DeleteServersTestJSON-858473437 Oct 27 03:38:15.302223 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 911997e881754ce390af17919f29b4ab Oct 27 03:38:15.302223 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-DeleteServersTestJSON-858473437 Oct 27 03:38:15.302223 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-DeleteServersTestJSON-858473437-project Oct 27 03:38:15.302223 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:38:15.302223 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:38:15.302223 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: b1cc79af058b4c35b3c572448fac86a7 Oct 27 03:38:15.302223 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-DeleteServersTestJSON-858473437-project Oct 27 03:38:15.302223 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:38:15.302223 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 17bdf735-2944-4b40-984c-4646caa855f0 could not be found. Oct 27 03:38:15.302223 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '17bdf735-2944-4b40-984c-4646caa855f0'} Oct 27 03:38:15.302223 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:38:15.302223 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:38:15.302223 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:38:15.302223 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:38:15.302223 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:38:15.302223 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:38:15.302223 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:38:15.302223 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:38:15.302223 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:38:15.302223 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:38:15.302223 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17bdf735-2944-4b40-984c-4646caa855f0 could not be found. Oct 27 03:38:15.302223 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:38:15.302223 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:38:15.302223 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:38:15.302223 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:38:15.302223 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:38:15.302223 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:38:15.302223 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:38:15.302223 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:38:15.302223 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:38:15.302223 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:38:15.302223 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:38:15.302223 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:38:15.302223 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:38:15.302223 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:38:15.302223 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:38:15.302223 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:38:15.302223 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17bdf735-2944-4b40-984c-4646caa855f0 could not be found. Oct 27 03:38:15.302223 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:38:15.302223 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:38:15.302223 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:38:15.307130 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:38:15.307130 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:38:15.307130 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:38:15.307130 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:38:15.307130 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:38:15.307130 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17bdf735-2944-4b40-984c-4646caa855f0 could not be found. Oct 27 03:38:15.307130 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:38:15.310125 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c43977d5-4fb9-4ce6-b0b9-798b304a3549 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Returning 404 to user: Instance 17bdf735-2944-4b40-984c-4646caa855f0 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:38:15.311373 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c43977d5-4fb9-4ce6-b0b9-798b304a3549 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/17bdf735-2944-4b40-984c-4646caa855f0" status: 404 len: 111 microversion: 2.1 time: 0.094316 Oct 27 03:38:15.312534 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1937/4125] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:15 2022] GET /compute/v2.1/servers/17bdf735-2944-4b40-984c-4646caa855f0 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:38:15.505791 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a825ea4a-98d0-428a-b42b-6058713575c6 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:15.513950 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:38:15.530298 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a825ea4a-98d0-428a-b42b-6058713575c6 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:15.532875 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a825ea4a-98d0-428a-b42b-6058713575c6 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:15.534361 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a825ea4a-98d0-428a-b42b-6058713575c6 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] 10.222.0.20 "GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac" status: 200 len: 1870 microversion: 2.32 time: 0.757653 Oct 27 03:38:15.539369 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2189/4126] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:38:14 2022] GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac => generated 1870 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:38:15.573059 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-31d67c1f-f94d-447b-9531-42ad476ef67c tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1972626940", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": [{"uuid": "b1f1f8a3-6579-4551-8baa-e65f1847be2c"}]}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:38:15.705455 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-31d67c1f-f94d-447b-9531-42ad476ef67c tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] validate_networks() for [('b1f1f8a3-6579-4551-8baa-e65f1847be2c', None, None, None, None, None)] {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:38:16.225207 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-bf624977-5b28-4a2a-b468-f48b0328578c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:16.226335 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-bf624977-5b28-4a2a-b468-f48b0328578c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:16.239235 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bf624977-5b28-4a2a-b468-f48b0328578c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:16.243394 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bf624977-5b28-4a2a-b468-f48b0328578c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:16.243969 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bf624977-5b28-4a2a-b468-f48b0328578c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:16.244930 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bf624977-5b28-4a2a-b468-f48b0328578c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:16.246301 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bf624977-5b28-4a2a-b468-f48b0328578c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:16.246939 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bf624977-5b28-4a2a-b468-f48b0328578c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:16.995798 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-bf624977-5b28-4a2a-b468-f48b0328578c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:17.012167 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-bf624977-5b28-4a2a-b468-f48b0328578c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1660 microversion: 2.1 time: 0.787297 Oct 27 03:38:17.012167 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2190/4127] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:16 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1660 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:38:17.018254 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-45e67160-55cd-42bc-9a66-541ee977ad3f tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:17.019077 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-45e67160-55cd-42bc-9a66-541ee977ad3f tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] [instance: 7e73d534-0a40-42d2-813c-2e9dbb9239ac] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:17.040920 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-45e67160-55cd-42bc-9a66-541ee977ad3f tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:17.046736 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-45e67160-55cd-42bc-9a66-541ee977ad3f tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:17.047410 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-45e67160-55cd-42bc-9a66-541ee977ad3f tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:17.048458 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-45e67160-55cd-42bc-9a66-541ee977ad3f tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:17.049087 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-45e67160-55cd-42bc-9a66-541ee977ad3f tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:17.049704 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-45e67160-55cd-42bc-9a66-541ee977ad3f tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:17.319541 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-31d67c1f-f94d-447b-9531-42ad476ef67c tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:38:17.326209 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-31d67c1f-f94d-447b-9531-42ad476ef67c tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:38:17.326937 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-31d67c1f-f94d-447b-9531-42ad476ef67c tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:38:17.327736 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-31d67c1f-f94d-447b-9531-42ad476ef67c tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:38:17.328334 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-31d67c1f-f94d-447b-9531-42ad476ef67c tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:38:17.346049 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-31d67c1f-f94d-447b-9531-42ad476ef67c tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:17.349596 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-31d67c1f-f94d-447b-9531-42ad476ef67c tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:17.350286 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-31d67c1f-f94d-447b-9531-42ad476ef67c tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:17.351257 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-31d67c1f-f94d-447b-9531-42ad476ef67c tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:17.353925 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-31d67c1f-f94d-447b-9531-42ad476ef67c tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:17.356734 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-31d67c1f-f94d-447b-9531-42ad476ef67c tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:17.402381 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-31d67c1f-f94d-447b-9531-42ad476ef67c tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Getting quotas for project 911997e881754ce390af17919f29b4ab. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:38:17.414099 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-31d67c1f-f94d-447b-9531-42ad476ef67c tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Getting quotas for user b1cc79af058b4c35b3c572448fac86a7 and project 911997e881754ce390af17919f29b4ab. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:38:17.448543 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-31d67c1f-f94d-447b-9531-42ad476ef67c tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:38:17.453642 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-31d67c1f-f94d-447b-9531-42ad476ef67c tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 2ec095f2-c25e-434f-87ff-10788b0fe6c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:38:17.643866 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-31d67c1f-f94d-447b-9531-42ad476ef67c tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.075177 Oct 27 03:38:17.653728 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1938/4128] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:38:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 2086 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 03:38:17.659593 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-3cd9a28c-4c5d-483c-accc-a391d4a442c4 req-239dd3c8-fb02-43e7-a9c4-91865b4e61f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e73d534-0a40-42d2-813c-2e9dbb9239ac", "tag": "9e919ed7-a3b4-4ea2-bd4e-1bff31a5ba66"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:38:17.687338 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-3cd9a28c-4c5d-483c-accc-a391d4a442c4 req-239dd3c8-fb02-43e7-a9c4-91865b4e61f1 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:17.690552 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-3cd9a28c-4c5d-483c-accc-a391d4a442c4 req-239dd3c8-fb02-43e7-a9c4-91865b4e61f1 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:17.694883 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-3cd9a28c-4c5d-483c-accc-a391d4a442c4 req-239dd3c8-fb02-43e7-a9c4-91865b4e61f1 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:17.727432 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-3cd9a28c-4c5d-483c-accc-a391d4a442c4 req-239dd3c8-fb02-43e7-a9c4-91865b4e61f1 service nova] Creating event network-changed:9e919ed7-a3b4-4ea2-bd4e-1bff31a5ba66 for instance 7e73d534-0a40-42d2-813c-2e9dbb9239ac on n-h2-862769-1 Oct 27 03:38:17.740601 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-3cd9a28c-4c5d-483c-accc-a391d4a442c4 req-239dd3c8-fb02-43e7-a9c4-91865b4e61f1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085120 Oct 27 03:38:17.751531 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1939/4129] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:38:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:38:17.751531 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c52e99b1-1677-4f87-ba24-ed4fa9a9c4d0 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:38:17.751531 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c52e99b1-1677-4f87-ba24-ed4fa9a9c4d0 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:17.772115 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c52e99b1-1677-4f87-ba24-ed4fa9a9c4d0 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:17.772789 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c52e99b1-1677-4f87-ba24-ed4fa9a9c4d0 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:17.773243 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c52e99b1-1677-4f87-ba24-ed4fa9a9c4d0 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:17.773974 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c52e99b1-1677-4f87-ba24-ed4fa9a9c4d0 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:17.774465 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c52e99b1-1677-4f87-ba24-ed4fa9a9c4d0 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:17.778180 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c52e99b1-1677-4f87-ba24-ed4fa9a9c4d0 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:18.032726 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c52e99b1-1677-4f87-ba24-ed4fa9a9c4d0 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "POST /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86/action" status: 202 len: 0 microversion: 2.1 time: 0.289927 Oct 27 03:38:18.036454 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1940/4130] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:38:17 2022] POST /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86/action => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:38:18.047612 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-52a2aff4-416e-4a8d-ad40-e6161e6e27c1 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:18.048461 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-52a2aff4-416e-4a8d-ad40-e6161e6e27c1 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 2ec095f2-c25e-434f-87ff-10788b0fe6c3] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:18.180702 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-52a2aff4-416e-4a8d-ad40-e6161e6e27c1 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:18.190740 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-52a2aff4-416e-4a8d-ad40-e6161e6e27c1 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/2ec095f2-c25e-434f-87ff-10788b0fe6c3" status: 200 len: 1215 microversion: 2.1 time: 0.152917 Oct 27 03:38:18.191397 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1941/4131] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:18 2022] GET /compute/v2.1/servers/2ec095f2-c25e-434f-87ff-10788b0fe6c3 => generated 1215 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:38:18.201098 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-45e67160-55cd-42bc-9a66-541ee977ad3f tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:18.207083 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-303191a1-4d05-4e94-a759-f60803bd8302 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:18.207965 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-303191a1-4d05-4e94-a759-f60803bd8302 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:18.219620 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-303191a1-4d05-4e94-a759-f60803bd8302 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:18.221441 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-303191a1-4d05-4e94-a759-f60803bd8302 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:18.223516 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-303191a1-4d05-4e94-a759-f60803bd8302 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:18.224570 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-303191a1-4d05-4e94-a759-f60803bd8302 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:18.226573 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-303191a1-4d05-4e94-a759-f60803bd8302 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:18.228265 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-45e67160-55cd-42bc-9a66-541ee977ad3f tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:18.230013 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-303191a1-4d05-4e94-a759-f60803bd8302 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:18.235449 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-45e67160-55cd-42bc-9a66-541ee977ad3f tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:18.240002 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-45e67160-55cd-42bc-9a66-541ee977ad3f tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] 10.222.0.20 "GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac" status: 200 len: 1891 microversion: 2.32 time: 1.223086 Oct 27 03:38:18.251330 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2191/4132] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:38:17 2022] GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac => generated 1891 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:38:18.275711 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:38:19.063032 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-303191a1-4d05-4e94-a759-f60803bd8302 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:19.079316 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-303191a1-4d05-4e94-a759-f60803bd8302 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1666 microversion: 2.1 time: 0.884208 Oct 27 03:38:19.106265 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1942/4133] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:18 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1666 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:38:19.222677 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f007f54b-455a-48b6-bdd8-4e5ee199ff22 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:19.224490 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f007f54b-455a-48b6-bdd8-4e5ee199ff22 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 2ec095f2-c25e-434f-87ff-10788b0fe6c3] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:19.235534 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f007f54b-455a-48b6-bdd8-4e5ee199ff22 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:19.236416 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f007f54b-455a-48b6-bdd8-4e5ee199ff22 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:19.237121 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f007f54b-455a-48b6-bdd8-4e5ee199ff22 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:19.238222 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f007f54b-455a-48b6-bdd8-4e5ee199ff22 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:19.241341 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f007f54b-455a-48b6-bdd8-4e5ee199ff22 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:19.242122 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f007f54b-455a-48b6-bdd8-4e5ee199ff22 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:19.277585 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-55d1cb5b-0ccc-4ac5-9d8b-d77c16c92d68 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:19.280987 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-55d1cb5b-0ccc-4ac5-9d8b-d77c16c92d68 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] [instance: 7e73d534-0a40-42d2-813c-2e9dbb9239ac] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:19.319718 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-55d1cb5b-0ccc-4ac5-9d8b-d77c16c92d68 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:19.323800 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-55d1cb5b-0ccc-4ac5-9d8b-d77c16c92d68 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:19.324555 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-55d1cb5b-0ccc-4ac5-9d8b-d77c16c92d68 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:19.329210 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-55d1cb5b-0ccc-4ac5-9d8b-d77c16c92d68 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:19.330676 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-55d1cb5b-0ccc-4ac5-9d8b-d77c16c92d68 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:19.332007 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-55d1cb5b-0ccc-4ac5-9d8b-d77c16c92d68 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:19.480526 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f007f54b-455a-48b6-bdd8-4e5ee199ff22 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:19.493754 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f007f54b-455a-48b6-bdd8-4e5ee199ff22 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/2ec095f2-c25e-434f-87ff-10788b0fe6c3" status: 200 len: 1219 microversion: 2.1 time: 0.282515 Oct 27 03:38:19.499602 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2192/4134] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:19 2022] GET /compute/v2.1/servers/2ec095f2-c25e-434f-87ff-10788b0fe6c3 => generated 1219 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:38:19.993507 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-789a73fa-6382-4923-9ee2-c9dd77225b48 req-217d22d9-cd68-4675-aa53-5141684eee06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e73d534-0a40-42d2-813c-2e9dbb9239ac", "tag": "c0c13817-3015-471d-b722-6926066dd1a7"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:38:20.024436 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-789a73fa-6382-4923-9ee2-c9dd77225b48 req-217d22d9-cd68-4675-aa53-5141684eee06 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:20.026460 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-789a73fa-6382-4923-9ee2-c9dd77225b48 req-217d22d9-cd68-4675-aa53-5141684eee06 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:20.027131 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-789a73fa-6382-4923-9ee2-c9dd77225b48 req-217d22d9-cd68-4675-aa53-5141684eee06 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:20.058972 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-789a73fa-6382-4923-9ee2-c9dd77225b48 req-217d22d9-cd68-4675-aa53-5141684eee06 service nova] Creating event network-changed:c0c13817-3015-471d-b722-6926066dd1a7 for instance 7e73d534-0a40-42d2-813c-2e9dbb9239ac on n-h2-862769-1 Oct 27 03:38:20.072063 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-789a73fa-6382-4923-9ee2-c9dd77225b48 req-217d22d9-cd68-4675-aa53-5141684eee06 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083562 Oct 27 03:38:20.076661 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2193/4135] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:38:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:38:20.134600 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5c7cfc5b-ed0d-4a12-83df-60a16c27c85e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:20.135681 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5c7cfc5b-ed0d-4a12-83df-60a16c27c85e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:20.180046 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5c7cfc5b-ed0d-4a12-83df-60a16c27c85e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:20.180046 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5c7cfc5b-ed0d-4a12-83df-60a16c27c85e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:20.180046 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5c7cfc5b-ed0d-4a12-83df-60a16c27c85e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:20.180046 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5c7cfc5b-ed0d-4a12-83df-60a16c27c85e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:20.180046 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5c7cfc5b-ed0d-4a12-83df-60a16c27c85e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:20.199623 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5c7cfc5b-ed0d-4a12-83df-60a16c27c85e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:20.489906 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-55d1cb5b-0ccc-4ac5-9d8b-d77c16c92d68 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:20.576842 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-55d1cb5b-0ccc-4ac5-9d8b-d77c16c92d68 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:20.610724 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-55d1cb5b-0ccc-4ac5-9d8b-d77c16c92d68 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:20.620383 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-55d1cb5b-0ccc-4ac5-9d8b-d77c16c92d68 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] 10.222.0.20 "GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac" status: 200 len: 1891 microversion: 2.32 time: 1.345141 Oct 27 03:38:20.645002 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1943/4136] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:38:19 2022] GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac => generated 1891 bytes in 1356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:38:20.671632 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d93417fd-250d-43e1-ae92-f606e7bd2d4b tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:20.677830 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d93417fd-250d-43e1-ae92-f606e7bd2d4b tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] [instance: 8c8a2cbb-4acf-4a6b-b684-567617bb930d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:20.709347 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d93417fd-250d-43e1-ae92-f606e7bd2d4b tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:20.713118 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d93417fd-250d-43e1-ae92-f606e7bd2d4b tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:20.715526 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d93417fd-250d-43e1-ae92-f606e7bd2d4b tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:20.734379 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d93417fd-250d-43e1-ae92-f606e7bd2d4b tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:20.740276 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d93417fd-250d-43e1-ae92-f606e7bd2d4b tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:20.741106 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d93417fd-250d-43e1-ae92-f606e7bd2d4b tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:20.980327 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5c7cfc5b-ed0d-4a12-83df-60a16c27c85e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:20.991785 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5c7cfc5b-ed0d-4a12-83df-60a16c27c85e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1666 microversion: 2.1 time: 0.865145 Oct 27 03:38:21.014206 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2194/4137] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:20 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1666 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:38:21.021696 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-71a5c09a-db3f-4e41-bccb-9f96f6dc703a tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:21.022610 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-71a5c09a-db3f-4e41-bccb-9f96f6dc703a tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 2ec095f2-c25e-434f-87ff-10788b0fe6c3] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:21.029674 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-71a5c09a-db3f-4e41-bccb-9f96f6dc703a tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:21.032572 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-71a5c09a-db3f-4e41-bccb-9f96f6dc703a tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:21.032572 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-71a5c09a-db3f-4e41-bccb-9f96f6dc703a tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:21.032572 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-71a5c09a-db3f-4e41-bccb-9f96f6dc703a tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:21.032572 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-71a5c09a-db3f-4e41-bccb-9f96f6dc703a tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:21.032572 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-71a5c09a-db3f-4e41-bccb-9f96f6dc703a tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:21.213175 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-71a5c09a-db3f-4e41-bccb-9f96f6dc703a tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:21.227841 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-71a5c09a-db3f-4e41-bccb-9f96f6dc703a tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/2ec095f2-c25e-434f-87ff-10788b0fe6c3" status: 200 len: 1275 microversion: 2.1 time: 0.211928 Oct 27 03:38:21.228861 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2195/4138] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:21 2022] GET /compute/v2.1/servers/2ec095f2-c25e-434f-87ff-10788b0fe6c3 => generated 1275 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:38:21.659774 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-aaeb1539-41f4-4b1e-8d29-5481a985cf99 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:21.660819 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-aaeb1539-41f4-4b1e-8d29-5481a985cf99 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] [instance: 7e73d534-0a40-42d2-813c-2e9dbb9239ac] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:21.681992 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aaeb1539-41f4-4b1e-8d29-5481a985cf99 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:21.684655 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aaeb1539-41f4-4b1e-8d29-5481a985cf99 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:21.689591 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aaeb1539-41f4-4b1e-8d29-5481a985cf99 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:21.692777 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aaeb1539-41f4-4b1e-8d29-5481a985cf99 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:21.695588 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aaeb1539-41f4-4b1e-8d29-5481a985cf99 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:21.696509 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aaeb1539-41f4-4b1e-8d29-5481a985cf99 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:21.796194 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d93417fd-250d-43e1-ae92-f606e7bd2d4b tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:21.817485 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d93417fd-250d-43e1-ae92-f606e7bd2d4b tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:21.822541 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d93417fd-250d-43e1-ae92-f606e7bd2d4b tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:21.825836 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d93417fd-250d-43e1-ae92-f606e7bd2d4b tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d" status: 200 len: 2955 microversion: 2.42 time: 1.178679 Oct 27 03:38:21.826473 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1944/4139] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:38:20 2022] GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d => generated 2955 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:38:21.855736 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7d7a2402-cb61-4d24-8a08-f514dddbffdb tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:21.856688 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7d7a2402-cb61-4d24-8a08-f514dddbffdb tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] [instance: 8c8a2cbb-4acf-4a6b-b684-567617bb930d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:21.866737 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7d7a2402-cb61-4d24-8a08-f514dddbffdb tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:21.870786 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7d7a2402-cb61-4d24-8a08-f514dddbffdb tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:21.870786 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7d7a2402-cb61-4d24-8a08-f514dddbffdb tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:21.871528 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7d7a2402-cb61-4d24-8a08-f514dddbffdb tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:21.873189 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7d7a2402-cb61-4d24-8a08-f514dddbffdb tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:21.873814 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7d7a2402-cb61-4d24-8a08-f514dddbffdb tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:22.171298 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7d7a2402-cb61-4d24-8a08-f514dddbffdb tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.320932 Oct 27 03:38:22.171980 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1945/4140] 10.222.0.20 () {60 vars in 1316 bytes} [Thu Oct 27 03:38:21 2022] GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d/os-interface => generated 1831 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:38:22.190790 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a7d8c1bd-04cf-4816-b0f5-c2e506a8c797 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:22.192104 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a7d8c1bd-04cf-4816-b0f5-c2e506a8c797 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:22.208312 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a7d8c1bd-04cf-4816-b0f5-c2e506a8c797 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:22.208312 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a7d8c1bd-04cf-4816-b0f5-c2e506a8c797 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:22.208312 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a7d8c1bd-04cf-4816-b0f5-c2e506a8c797 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:22.211950 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a7d8c1bd-04cf-4816-b0f5-c2e506a8c797 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:22.215631 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-aaeb1539-41f4-4b1e-8d29-5481a985cf99 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:22.216342 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a7d8c1bd-04cf-4816-b0f5-c2e506a8c797 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:22.216901 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a7d8c1bd-04cf-4816-b0f5-c2e506a8c797 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:22.250390 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-aaeb1539-41f4-4b1e-8d29-5481a985cf99 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:22.256822 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-aaeb1539-41f4-4b1e-8d29-5481a985cf99 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:22.263346 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-aaeb1539-41f4-4b1e-8d29-5481a985cf99 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] 10.222.0.20 "GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac" status: 200 len: 1891 microversion: 2.32 time: 0.608718 Oct 27 03:38:22.271765 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2196/4141] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:38:21 2022] GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac => generated 1891 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:38:22.282552 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-baedd031-4d2c-4ecd-a42b-e534fe27377b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:22.283023 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-baedd031-4d2c-4ecd-a42b-e534fe27377b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 2ec095f2-c25e-434f-87ff-10788b0fe6c3] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:22.316536 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-baedd031-4d2c-4ecd-a42b-e534fe27377b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:22.322466 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-baedd031-4d2c-4ecd-a42b-e534fe27377b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:22.324624 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-baedd031-4d2c-4ecd-a42b-e534fe27377b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:22.328658 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-baedd031-4d2c-4ecd-a42b-e534fe27377b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:22.329435 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-baedd031-4d2c-4ecd-a42b-e534fe27377b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:22.334868 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-baedd031-4d2c-4ecd-a42b-e534fe27377b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:22.605241 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-baedd031-4d2c-4ecd-a42b-e534fe27377b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:22.620112 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-baedd031-4d2c-4ecd-a42b-e534fe27377b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/2ec095f2-c25e-434f-87ff-10788b0fe6c3" status: 200 len: 1273 microversion: 2.1 time: 0.344721 Oct 27 03:38:22.631372 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2197/4142] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:22 2022] GET /compute/v2.1/servers/2ec095f2-c25e-434f-87ff-10788b0fe6c3 => generated 1273 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:38:22.924206 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a7d8c1bd-04cf-4816-b0f5-c2e506a8c797 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:22.939677 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a7d8c1bd-04cf-4816-b0f5-c2e506a8c797 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1669 microversion: 2.1 time: 0.757165 Oct 27 03:38:22.955376 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1946/4143] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:22 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1669 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:38:22.970893 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-722f9f00-7ca5-4def-98de-6ce80d4cd124 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:22.972586 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-722f9f00-7ca5-4def-98de-6ce80d4cd124 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:22.988683 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-722f9f00-7ca5-4def-98de-6ce80d4cd124 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:22.989549 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-722f9f00-7ca5-4def-98de-6ce80d4cd124 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:22.990183 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-722f9f00-7ca5-4def-98de-6ce80d4cd124 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:22.991103 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-722f9f00-7ca5-4def-98de-6ce80d4cd124 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:22.992571 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-722f9f00-7ca5-4def-98de-6ce80d4cd124 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:22.998929 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-722f9f00-7ca5-4def-98de-6ce80d4cd124 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:23.298597 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-722f9f00-7ca5-4def-98de-6ce80d4cd124 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:23.310542 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-722f9f00-7ca5-4def-98de-6ce80d4cd124 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1669 microversion: 2.1 time: 0.345078 Oct 27 03:38:23.312272 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2198/4144] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:22 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1669 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:38:23.314855 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-10cb5528-45af-486d-a712-fcde4bdeaf3a tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:23.315618 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-10cb5528-45af-486d-a712-fcde4bdeaf3a tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] [instance: 7e73d534-0a40-42d2-813c-2e9dbb9239ac] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:23.371509 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-10cb5528-45af-486d-a712-fcde4bdeaf3a tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:23.373081 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-10cb5528-45af-486d-a712-fcde4bdeaf3a tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:23.373636 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-84464e81-7789-4a69-a7f3-3bcc3f60438c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:23.374217 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-10cb5528-45af-486d-a712-fcde4bdeaf3a tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:23.376351 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-84464e81-7789-4a69-a7f3-3bcc3f60438c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: 2d8900c4-92eb-4374-bd63-6d0ebbf407b7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:23.377380 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-10cb5528-45af-486d-a712-fcde4bdeaf3a tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:23.377942 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-10cb5528-45af-486d-a712-fcde4bdeaf3a tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:23.378436 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-10cb5528-45af-486d-a712-fcde4bdeaf3a tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:23.389464 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-84464e81-7789-4a69-a7f3-3bcc3f60438c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:23.391610 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-84464e81-7789-4a69-a7f3-3bcc3f60438c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:23.393254 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-84464e81-7789-4a69-a7f3-3bcc3f60438c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:23.394906 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-84464e81-7789-4a69-a7f3-3bcc3f60438c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:23.396834 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-84464e81-7789-4a69-a7f3-3bcc3f60438c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:23.399530 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-84464e81-7789-4a69-a7f3-3bcc3f60438c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:23.452245 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-84464e81-7789-4a69-a7f3-3bcc3f60438c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: 2d8900c4-92eb-4374-bd63-6d0ebbf407b7] Going to try to terminate instance {{(pid=121001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:38:23.483253 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.compute.api [None req-84464e81-7789-4a69-a7f3-3bcc3f60438c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: 2d8900c4-92eb-4374-bd63-6d0ebbf407b7] Working on deleting snapshot 83064baa-6d0c-4167-a36d-558f5cf4ee18 from shelved instance... Oct 27 03:38:24.490273 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-10cb5528-45af-486d-a712-fcde4bdeaf3a tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:24.526387 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-10cb5528-45af-486d-a712-fcde4bdeaf3a tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:24.529237 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-10cb5528-45af-486d-a712-fcde4bdeaf3a tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:24.529237 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-10cb5528-45af-486d-a712-fcde4bdeaf3a tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] 10.222.0.20 "GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac" status: 200 len: 1891 microversion: 2.32 time: 1.225855 Oct 27 03:38:24.546414 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1947/4145] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:38:23 2022] GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac => generated 1891 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:38:24.566597 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ba383c80-16a3-42c8-9bc2-1aef388717ca tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:24.567994 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ba383c80-16a3-42c8-9bc2-1aef388717ca tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 2ec095f2-c25e-434f-87ff-10788b0fe6c3] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:24.583875 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ba383c80-16a3-42c8-9bc2-1aef388717ca tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:24.585978 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ba383c80-16a3-42c8-9bc2-1aef388717ca tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:24.586457 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ba383c80-16a3-42c8-9bc2-1aef388717ca tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:24.588203 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ba383c80-16a3-42c8-9bc2-1aef388717ca tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:24.590631 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ba383c80-16a3-42c8-9bc2-1aef388717ca tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:24.591329 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ba383c80-16a3-42c8-9bc2-1aef388717ca tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:25.522817 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-84464e81-7789-4a69-a7f3-3bcc3f60438c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: 2d8900c4-92eb-4374-bd63-6d0ebbf407b7] Doing local delete in cell d4405804-b3fd-4c57-a074-5c4e2aef7c93(cell1) {{(pid=121001) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 27 03:38:25.524822 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-84464e81-7789-4a69-a7f3-3bcc3f60438c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:25.537620 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-84464e81-7789-4a69-a7f3-3bcc3f60438c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:25.538236 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-84464e81-7789-4a69-a7f3-3bcc3f60438c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:25.538709 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.compute.api [None req-84464e81-7789-4a69-a7f3-3bcc3f60438c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: 2d8900c4-92eb-4374-bd63-6d0ebbf407b7] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 27 03:38:25.543428 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.network.neutron [None req-84464e81-7789-4a69-a7f3-3bcc3f60438c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: 2d8900c4-92eb-4374-bd63-6d0ebbf407b7] deallocate_for_instance() {{(pid=121001) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 27 03:38:25.835604 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ba383c80-16a3-42c8-9bc2-1aef388717ca tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:25.847378 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ba383c80-16a3-42c8-9bc2-1aef388717ca tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/2ec095f2-c25e-434f-87ff-10788b0fe6c3" status: 200 len: 1315 microversion: 2.1 time: 1.296506 Oct 27 03:38:25.864822 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1948/4146] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:24 2022] GET /compute/v2.1/servers/2ec095f2-c25e-434f-87ff-10788b0fe6c3 => generated 1315 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:38:25.874571 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-cd8331f5-48c9-449d-af81-84741221c855 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:25.878372 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-cd8331f5-48c9-449d-af81-84741221c855 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 35a0ac1a-379f-456e-a3d7-81f888daebbf] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:25.891981 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cd8331f5-48c9-449d-af81-84741221c855 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:25.898880 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cd8331f5-48c9-449d-af81-84741221c855 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:25.898880 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cd8331f5-48c9-449d-af81-84741221c855 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:25.898880 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cd8331f5-48c9-449d-af81-84741221c855 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:25.898880 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cd8331f5-48c9-449d-af81-84741221c855 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:25.898880 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cd8331f5-48c9-449d-af81-84741221c855 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:25.930058 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-cd8331f5-48c9-449d-af81-84741221c855 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] HTTP exception thrown: Instance 35a0ac1a-379f-456e-a3d7-81f888daebbf could not be found. Oct 27 03:38:25.937099 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-cd8331f5-48c9-449d-af81-84741221c855 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Request method failure captured: Oct 27 03:38:25.937099 n-d-862769-1 devstack@n-api.service[121000]: request: DELETE /compute/v2.1/servers/35a0ac1a-379f-456e-a3d7-81f888daebbf HTTP/1.1 Oct 27 03:38:25.937099 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:38:25.937099 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:38:25.937099 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:38:25.937099 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:38:25.937099 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:38:25.937099 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:38:25.937099 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:38:25.937099 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:38:25.937099 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfxF6ut9nM9a9AcpKLO7IgCu-akAJ2YJGjrI9C8NUveA8uObV2XgQIQvsIxuWjvLl9meIEqpfGwZYr8MTX_PAGoiJsNUPXh5ERSce5cPYQYCCFPL0HtTb-E11C_2kfWy1wRps1tClRNvtj8zAqCGRhs1x-Uvl0zISdfHepXmvWX31Us Oct 27 03:38:25.937099 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:38:25.937099 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:38:25.937099 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:38:25.937099 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:38:25.937099 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:38:25.937099 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:38:25.937099 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 8bb5d291069d4329a90123e327fe9c59 Oct 27 03:38:25.937099 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:38:25.937099 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:38:25.937099 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:38:25.937099 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8bb5d291069d4329a90123e327fe9c59"}]}] Oct 27 03:38:25.937099 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:38:25.937099 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 8bb5d291069d4329a90123e327fe9c59 Oct 27 03:38:25.937099 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:38:25.937099 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ServersNegativeTestJSON-4378389-project Oct 27 03:38:25.937099 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:38:25.937099 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:38:25.937099 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: f9c32b7626594ff888970c7f3227bb20 Oct 27 03:38:25.937099 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ServersNegativeTestJSON-4378389-project Oct 27 03:38:25.937099 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:38:25.937099 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 35a0ac1a-379f-456e-a3d7-81f888daebbf could not be found. Oct 27 03:38:25.937099 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '35a0ac1a-379f-456e-a3d7-81f888daebbf'} Oct 27 03:38:25.937099 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:38:25.937099 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:38:25.937099 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:38:25.937099 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:38:25.937099 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:38:25.937099 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:38:25.937099 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:38:25.937099 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:38:25.937099 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:38:25.937099 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:38:25.937099 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35a0ac1a-379f-456e-a3d7-81f888daebbf could not be found. Oct 27 03:38:25.937099 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:38:25.937099 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:38:25.937099 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:38:25.937099 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:38:25.937099 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:38:25.937099 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:38:25.937099 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:38:25.937099 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:38:25.937099 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:38:25.937099 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:38:25.937099 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 03:38:25.937099 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 03:38:25.937099 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 03:38:25.937099 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 03:38:25.937099 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:38:25.937099 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:38:25.937099 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:38:25.937099 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:38:25.950269 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35a0ac1a-379f-456e-a3d7-81f888daebbf could not be found. Oct 27 03:38:25.950269 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:38:25.950269 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:38:25.950269 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:38:25.950269 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:38:25.950269 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:38:25.950269 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:38:25.950269 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:38:25.950269 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:38:25.950269 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35a0ac1a-379f-456e-a3d7-81f888daebbf could not be found. Oct 27 03:38:25.950269 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:38:25.950269 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-cd8331f5-48c9-449d-af81-84741221c855 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Returning 404 to user: Instance 35a0ac1a-379f-456e-a3d7-81f888daebbf could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:38:25.950269 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-cd8331f5-48c9-449d-af81-84741221c855 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "DELETE /compute/v2.1/servers/35a0ac1a-379f-456e-a3d7-81f888daebbf" status: 404 len: 111 microversion: 2.1 time: 0.079861 Oct 27 03:38:25.950269 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1949/4147] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:38:25 2022] DELETE /compute/v2.1/servers/35a0ac1a-379f-456e-a3d7-81f888daebbf => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:38:26.236345 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4d0358f8-4949-42e0-9c15-7f4b66e1001c tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-686673020", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": [{"uuid": "d117b635-c445-4112-aec9-1896ff5b6f4e"}]}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:38:26.332496 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-4d0358f8-4949-42e0-9c15-7f4b66e1001c tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] validate_networks() for [('d117b635-c445-4112-aec9-1896ff5b6f4e', None, None, None, None, None)] {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:38:27.295318 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.network.neutron [None req-84464e81-7789-4a69-a7f3-3bcc3f60438c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: 2d8900c4-92eb-4374-bd63-6d0ebbf407b7] Updating instance_info_cache with network_info: [] {{(pid=121001) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 27 03:38:27.375638 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:38:28.128312 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-84464e81-7789-4a69-a7f3-3bcc3f60438c tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2d8900c4-92eb-4374-bd63-6d0ebbf407b7" status: 204 len: 0 microversion: 2.1 time: 4.779294 Oct 27 03:38:28.128990 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2199/4148] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:38:23 2022] DELETE /compute/v2.1/servers/2d8900c4-92eb-4374-bd63-6d0ebbf407b7 => generated 0 bytes in 4781 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:38:28.134871 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-eeddd36f-bb8f-4e0a-84b6-d54b5b0ed392 req-584fc285-68fb-476c-aabd-474b2238e508 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e73d534-0a40-42d2-813c-2e9dbb9239ac", "tag": "56ab5e70-ff8a-49bf-b017-824334f93dca"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:38:28.142640 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-4d0358f8-4949-42e0-9c15-7f4b66e1001c tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:38:28.143392 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-4d0358f8-4949-42e0-9c15-7f4b66e1001c tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:38:28.144154 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-4d0358f8-4949-42e0-9c15-7f4b66e1001c tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:38:28.145595 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-4d0358f8-4949-42e0-9c15-7f4b66e1001c tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:38:28.145752 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-eeddd36f-bb8f-4e0a-84b6-d54b5b0ed392 req-584fc285-68fb-476c-aabd-474b2238e508 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:28.146208 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-eeddd36f-bb8f-4e0a-84b6-d54b5b0ed392 req-584fc285-68fb-476c-aabd-474b2238e508 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:28.146660 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-eeddd36f-bb8f-4e0a-84b6-d54b5b0ed392 req-584fc285-68fb-476c-aabd-474b2238e508 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:28.146954 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-4d0358f8-4949-42e0-9c15-7f4b66e1001c tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:38:28.157279 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4d0358f8-4949-42e0-9c15-7f4b66e1001c tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:28.158096 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4d0358f8-4949-42e0-9c15-7f4b66e1001c tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:28.158747 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4d0358f8-4949-42e0-9c15-7f4b66e1001c tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:28.159673 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4d0358f8-4949-42e0-9c15-7f4b66e1001c tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:28.160408 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4d0358f8-4949-42e0-9c15-7f4b66e1001c tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:28.162653 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-eeddd36f-bb8f-4e0a-84b6-d54b5b0ed392 req-584fc285-68fb-476c-aabd-474b2238e508 service nova] Creating event network-changed:56ab5e70-ff8a-49bf-b017-824334f93dca for instance 7e73d534-0a40-42d2-813c-2e9dbb9239ac on n-h2-862769-1 Oct 27 03:38:28.162985 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4d0358f8-4949-42e0-9c15-7f4b66e1001c tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:28.172472 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-eeddd36f-bb8f-4e0a-84b6-d54b5b0ed392 req-584fc285-68fb-476c-aabd-474b2238e508 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042018 Oct 27 03:38:28.174273 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2200/4149] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:38:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:38:28.195020 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-4d0358f8-4949-42e0-9c15-7f4b66e1001c tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Getting quotas for project 93732dbf56414de2b7667e1e70262a32. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:38:28.197276 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-12b23ea8-c88c-411a-8efd-2390d1b7d094 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:28.197997 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-12b23ea8-c88c-411a-8efd-2390d1b7d094 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] [instance: 7e73d534-0a40-42d2-813c-2e9dbb9239ac] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:28.202767 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-4d0358f8-4949-42e0-9c15-7f4b66e1001c tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Getting quotas for user 51be346b3c5448c28ac57f5c1ffe50bc and project 93732dbf56414de2b7667e1e70262a32. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:38:28.205684 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-12b23ea8-c88c-411a-8efd-2390d1b7d094 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:28.206403 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-12b23ea8-c88c-411a-8efd-2390d1b7d094 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:28.206857 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-12b23ea8-c88c-411a-8efd-2390d1b7d094 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:28.207573 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-12b23ea8-c88c-411a-8efd-2390d1b7d094 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:28.208026 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-12b23ea8-c88c-411a-8efd-2390d1b7d094 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:28.208691 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-12b23ea8-c88c-411a-8efd-2390d1b7d094 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:28.218598 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4d0358f8-4949-42e0-9c15-7f4b66e1001c tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:38:28.226815 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4d0358f8-4949-42e0-9c15-7f4b66e1001c tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] [instance: e3b8bf04-529a-4909-9727-404cb7bba177] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:38:28.248950 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:38:28.378662 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4d0358f8-4949-42e0-9c15-7f4b66e1001c tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 2.431535 Oct 27 03:38:28.387323 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1950/4150] 10.222.0.20 () {62 vars in 1188 bytes} [Thu Oct 27 03:38:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 2434 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 27 03:38:28.392634 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7e18ce3b-c2fc-46cb-b176-cd6d3347a65f tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:28.394064 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7e18ce3b-c2fc-46cb-b176-cd6d3347a65f tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 35a0ac1a-379f-456e-a3d7-81f888daebbf] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:28.403387 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7e18ce3b-c2fc-46cb-b176-cd6d3347a65f tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:28.408398 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7e18ce3b-c2fc-46cb-b176-cd6d3347a65f tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:28.408398 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7e18ce3b-c2fc-46cb-b176-cd6d3347a65f tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:28.408398 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7e18ce3b-c2fc-46cb-b176-cd6d3347a65f tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:28.408398 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7e18ce3b-c2fc-46cb-b176-cd6d3347a65f tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:28.408398 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7e18ce3b-c2fc-46cb-b176-cd6d3347a65f tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:28.443533 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-7e18ce3b-c2fc-46cb-b176-cd6d3347a65f tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] HTTP exception thrown: Instance 35a0ac1a-379f-456e-a3d7-81f888daebbf could not be found. Oct 27 03:38:28.446439 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7e18ce3b-c2fc-46cb-b176-cd6d3347a65f tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Request method failure captured: Oct 27 03:38:28.446439 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/35a0ac1a-379f-456e-a3d7-81f888daebbf HTTP/1.1 Oct 27 03:38:28.446439 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:38:28.446439 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:38:28.446439 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:38:28.446439 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:38:28.446439 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:38:28.446439 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:38:28.446439 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:38:28.446439 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:38:28.446439 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfxF6ut9nM9a9AcpKLO7IgCu-akAJ2YJGjrI9C8NUveA8uObV2XgQIQvsIxuWjvLl9meIEqpfGwZYr8MTX_PAGoiJsNUPXh5ERSce5cPYQYCCFPL0HtTb-E11C_2kfWy1wRps1tClRNvtj8zAqCGRhs1x-Uvl0zISdfHepXmvWX31Us Oct 27 03:38:28.446439 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:38:28.446439 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:38:28.446439 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:38:28.446439 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:38:28.446439 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:38:28.446439 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:38:28.446439 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 8bb5d291069d4329a90123e327fe9c59 Oct 27 03:38:28.446439 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:38:28.446439 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:38:28.446439 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:38:28.446439 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8bb5d291069d4329a90123e327fe9c59"}]}] Oct 27 03:38:28.446439 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:38:28.446439 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 8bb5d291069d4329a90123e327fe9c59 Oct 27 03:38:28.446439 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:38:28.446439 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ServersNegativeTestJSON-4378389-project Oct 27 03:38:28.446439 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:38:28.446439 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:38:28.446439 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: f9c32b7626594ff888970c7f3227bb20 Oct 27 03:38:28.446439 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ServersNegativeTestJSON-4378389-project Oct 27 03:38:28.446439 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:38:28.446439 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 35a0ac1a-379f-456e-a3d7-81f888daebbf could not be found. Oct 27 03:38:28.446439 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '35a0ac1a-379f-456e-a3d7-81f888daebbf'} Oct 27 03:38:28.446439 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:38:28.446439 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:38:28.446439 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:38:28.446439 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:38:28.446439 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:38:28.446439 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:38:28.446439 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:38:28.446439 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:38:28.446439 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:38:28.446439 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:38:28.446439 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35a0ac1a-379f-456e-a3d7-81f888daebbf could not be found. Oct 27 03:38:28.446439 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:38:28.446439 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:38:28.446439 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:38:28.446439 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:38:28.446439 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:38:28.446439 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:38:28.446439 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:38:28.446439 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:38:28.446439 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:38:28.446439 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:38:28.446439 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:38:28.446439 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:38:28.446439 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:38:28.446439 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:38:28.446439 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:38:28.446439 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:38:28.446439 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35a0ac1a-379f-456e-a3d7-81f888daebbf could not be found. Oct 27 03:38:28.446439 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:38:28.446439 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:38:28.446439 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:38:28.452824 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:38:28.452824 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:38:28.452824 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:38:28.452824 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:38:28.452824 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:38:28.452824 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35a0ac1a-379f-456e-a3d7-81f888daebbf could not be found. Oct 27 03:38:28.452824 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:38:28.462823 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7e18ce3b-c2fc-46cb-b176-cd6d3347a65f tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Returning 404 to user: Instance 35a0ac1a-379f-456e-a3d7-81f888daebbf could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:38:28.465552 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7e18ce3b-c2fc-46cb-b176-cd6d3347a65f tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/35a0ac1a-379f-456e-a3d7-81f888daebbf" status: 404 len: 111 microversion: 2.1 time: 0.081703 Oct 27 03:38:28.465552 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1951/4151] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:28 2022] GET /compute/v2.1/servers/35a0ac1a-379f-456e-a3d7-81f888daebbf => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:38:28.475822 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4aecf681-39ad-4a6d-a0b0-ba390528fa99 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:28.477414 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4aecf681-39ad-4a6d-a0b0-ba390528fa99 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 2ec095f2-c25e-434f-87ff-10788b0fe6c3] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:28.492040 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4aecf681-39ad-4a6d-a0b0-ba390528fa99 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:28.494709 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4aecf681-39ad-4a6d-a0b0-ba390528fa99 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:28.502568 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4aecf681-39ad-4a6d-a0b0-ba390528fa99 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:28.503427 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4aecf681-39ad-4a6d-a0b0-ba390528fa99 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:28.503915 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4aecf681-39ad-4a6d-a0b0-ba390528fa99 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:28.504449 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4aecf681-39ad-4a6d-a0b0-ba390528fa99 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:28.604162 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-12b23ea8-c88c-411a-8efd-2390d1b7d094 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:28.620739 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-12b23ea8-c88c-411a-8efd-2390d1b7d094 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:28.622604 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-12b23ea8-c88c-411a-8efd-2390d1b7d094 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:28.624342 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-12b23ea8-c88c-411a-8efd-2390d1b7d094 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] 10.222.0.20 "GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac" status: 200 len: 1879 microversion: 2.32 time: 0.448221 Oct 27 03:38:28.629673 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2201/4152] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:38:28 2022] GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac => generated 1879 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:38:28.632875 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-aefbd9de-6251-4748-95c0-238d69da12d4 req-8e47330c-0bd1-4097-94a9-be2f7642cb25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d8900c4-92eb-4374-bd63-6d0ebbf407b7", "name": "network-vif-deleted", "tag": "fae83cc0-a7ce-470e-8ecf-19d03d536ec7"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:38:28.660747 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-aefbd9de-6251-4748-95c0-238d69da12d4 req-8e47330c-0bd1-4097-94a9-be2f7642cb25 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:28.661258 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-aefbd9de-6251-4748-95c0-238d69da12d4 req-8e47330c-0bd1-4097-94a9-be2f7642cb25 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:28.661659 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-aefbd9de-6251-4748-95c0-238d69da12d4 req-8e47330c-0bd1-4097-94a9-be2f7642cb25 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:28.687075 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.compute.server_external_events [req-aefbd9de-6251-4748-95c0-238d69da12d4 req-8e47330c-0bd1-4097-94a9-be2f7642cb25 service nova] Unable to find a host for instance 2d8900c4-92eb-4374-bd63-6d0ebbf407b7. Dropping event network-vif-deleted {{(pid=121001) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 27 03:38:28.689863 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-aefbd9de-6251-4748-95c0-238d69da12d4 req-8e47330c-0bd1-4097-94a9-be2f7642cb25 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.062808 Oct 27 03:38:28.690648 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2202/4153] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:38:28 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 64 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 27 03:38:28.697064 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9627ce33-9f30-44b2-b19c-a8345b54ace9 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:28.697782 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-9627ce33-9f30-44b2-b19c-a8345b54ace9 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: d963bc87-b838-431c-92c3-8f06dd7afba7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:28.705289 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9627ce33-9f30-44b2-b19c-a8345b54ace9 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:28.710195 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9627ce33-9f30-44b2-b19c-a8345b54ace9 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:28.710195 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9627ce33-9f30-44b2-b19c-a8345b54ace9 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:28.710195 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9627ce33-9f30-44b2-b19c-a8345b54ace9 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:28.710195 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9627ce33-9f30-44b2-b19c-a8345b54ace9 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:28.710195 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9627ce33-9f30-44b2-b19c-a8345b54ace9 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:28.737612 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9627ce33-9f30-44b2-b19c-a8345b54ace9 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/d963bc87-b838-431c-92c3-8f06dd7afba7/ips" status: 200 len: 149 microversion: 2.1 time: 0.044985 Oct 27 03:38:28.739588 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2203/4154] 10.222.0.20 () {58 vars in 1248 bytes} [Thu Oct 27 03:38:28 2022] GET /compute/v2.1/servers/d963bc87-b838-431c-92c3-8f06dd7afba7/ips => generated 149 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:38:28.744461 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-89824672-502b-46c3-89e9-a647ec0140ee tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:28.746371 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-89824672-502b-46c3-89e9-a647ec0140ee tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: 2d8900c4-92eb-4374-bd63-6d0ebbf407b7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:28.753707 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-89824672-502b-46c3-89e9-a647ec0140ee tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:28.755908 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-89824672-502b-46c3-89e9-a647ec0140ee tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:28.755908 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-89824672-502b-46c3-89e9-a647ec0140ee tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:28.755908 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-89824672-502b-46c3-89e9-a647ec0140ee tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:28.756630 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-89824672-502b-46c3-89e9-a647ec0140ee tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:28.757233 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-89824672-502b-46c3-89e9-a647ec0140ee tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:28.771991 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-89824672-502b-46c3-89e9-a647ec0140ee tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] HTTP exception thrown: Instance 2d8900c4-92eb-4374-bd63-6d0ebbf407b7 could not be found. Oct 27 03:38:28.773947 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-89824672-502b-46c3-89e9-a647ec0140ee tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Request method failure captured: Oct 27 03:38:28.773947 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/2d8900c4-92eb-4374-bd63-6d0ebbf407b7 HTTP/1.1 Oct 27 03:38:28.773947 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:38:28.773947 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:38:28.773947 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:38:28.773947 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:38:28.773947 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:38:28.773947 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:38:28.773947 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:38:28.773947 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:38:28.773947 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfsa_BAeMB3RnYvkmJQwjLzdAXRwOtmdTc4q-U2TyHH4sY2pC7-yKXDlPkKgdlBzGRlepw8PNzs2kNd86HTPJPZkHZ4DJy78RLBBzCNtKZaBrkpRAbSZW5Gv7329yxsJiAdDbJaiPVC-uHRtJPx_KALbDnjOM5yyEW86DSYN-HLC8ok Oct 27 03:38:28.773947 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:38:28.773947 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:38:28.773947 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:38:28.773947 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:38:28.773947 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:38:28.773947 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:38:28.773947 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 3e9ede68f63747d59153a46412033856 Oct 27 03:38:28.773947 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServerActionsTestJSON-24656121 Oct 27 03:38:28.773947 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:38:28.773947 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:38:28.773947 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3e9ede68f63747d59153a46412033856"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3e9ede68f63747d59153a46412033856"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3e9ede68f63747d59153a46412033856"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3e9ede68f63747d59153a46412033856"}]}] Oct 27 03:38:28.773947 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServerActionsTestJSON-24656121 Oct 27 03:38:28.773947 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 3e9ede68f63747d59153a46412033856 Oct 27 03:38:28.773947 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServerActionsTestJSON-24656121 Oct 27 03:38:28.773947 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServerActionsTestJSON-24656121-project Oct 27 03:38:28.773947 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:38:28.773947 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:38:28.773947 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 94897f20beb94dbd8e7eff6ecba30026 Oct 27 03:38:28.773947 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServerActionsTestJSON-24656121-project Oct 27 03:38:28.773947 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:38:28.773947 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 2d8900c4-92eb-4374-bd63-6d0ebbf407b7 could not be found. Oct 27 03:38:28.773947 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '2d8900c4-92eb-4374-bd63-6d0ebbf407b7'} Oct 27 03:38:28.773947 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:38:28.773947 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:38:28.773947 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:38:28.773947 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:38:28.773947 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:38:28.773947 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:38:28.773947 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:38:28.773947 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:38:28.773947 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:38:28.773947 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:38:28.773947 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d8900c4-92eb-4374-bd63-6d0ebbf407b7 could not be found. Oct 27 03:38:28.773947 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:38:28.773947 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:38:28.773947 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:38:28.773947 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:38:28.773947 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:38:28.773947 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:38:28.773947 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:38:28.773947 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:38:28.773947 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:38:28.773947 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:38:28.773947 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:38:28.773947 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:38:28.773947 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:38:28.773947 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:38:28.773947 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:38:28.773947 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:38:28.773947 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d8900c4-92eb-4374-bd63-6d0ebbf407b7 could not be found. Oct 27 03:38:28.773947 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:38:28.773947 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:38:28.773947 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:38:28.783512 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:38:28.783512 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:38:28.783512 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:38:28.783512 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:38:28.783512 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:38:28.783512 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d8900c4-92eb-4374-bd63-6d0ebbf407b7 could not be found. Oct 27 03:38:28.783512 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:38:28.783512 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-89824672-502b-46c3-89e9-a647ec0140ee tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Returning 404 to user: Instance 2d8900c4-92eb-4374-bd63-6d0ebbf407b7 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:38:28.783512 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-89824672-502b-46c3-89e9-a647ec0140ee tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/2d8900c4-92eb-4374-bd63-6d0ebbf407b7" status: 404 len: 111 microversion: 2.1 time: 0.036163 Oct 27 03:38:28.783512 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2204/4155] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:28 2022] GET /compute/v2.1/servers/2d8900c4-92eb-4374-bd63-6d0ebbf407b7 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:38:28.791115 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-06755515-d9d1-43a3-a725-6dbf1a416b9b tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:28.793121 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-06755515-d9d1-43a3-a725-6dbf1a416b9b tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] [instance: e3b8bf04-529a-4909-9727-404cb7bba177] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:28.796763 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:38:28.855181 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-06755515-d9d1-43a3-a725-6dbf1a416b9b tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51be346b3c5448c28ac57f5c1ffe50bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93732dbf56414de2b7667e1e70262a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:28.863313 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-06755515-d9d1-43a3-a725-6dbf1a416b9b tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51be346b3c5448c28ac57f5c1ffe50bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93732dbf56414de2b7667e1e70262a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:28.864764 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-06755515-d9d1-43a3-a725-6dbf1a416b9b tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51be346b3c5448c28ac57f5c1ffe50bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93732dbf56414de2b7667e1e70262a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:28.866359 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-06755515-d9d1-43a3-a725-6dbf1a416b9b tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] 10.222.0.20 "GET /compute/v2.1/servers/e3b8bf04-529a-4909-9727-404cb7bba177" status: 200 len: 1258 microversion: 2.21 time: 0.087387 Oct 27 03:38:28.878144 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2205/4156] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:38:28 2022] GET /compute/v2.1/servers/e3b8bf04-529a-4909-9727-404cb7bba177 => generated 1258 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:38:28.882048 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ddf45367-552e-47d7-978b-3ecbe8eaca61 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:28.883013 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ddf45367-552e-47d7-978b-3ecbe8eaca61 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:28.891566 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ddf45367-552e-47d7-978b-3ecbe8eaca61 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:28.892612 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ddf45367-552e-47d7-978b-3ecbe8eaca61 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:28.893065 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ddf45367-552e-47d7-978b-3ecbe8eaca61 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:28.893772 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ddf45367-552e-47d7-978b-3ecbe8eaca61 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:28.894299 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ddf45367-552e-47d7-978b-3ecbe8eaca61 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:28.894795 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ddf45367-552e-47d7-978b-3ecbe8eaca61 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:28.925173 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ddf45367-552e-47d7-978b-3ecbe8eaca61 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Going to try to terminate instance {{(pid=121001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:38:29.178343 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4aecf681-39ad-4a6d-a0b0-ba390528fa99 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:29.190501 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4aecf681-39ad-4a6d-a0b0-ba390528fa99 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/2ec095f2-c25e-434f-87ff-10788b0fe6c3" status: 200 len: 1315 microversion: 2.1 time: 0.723248 Oct 27 03:38:29.197068 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1952/4157] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:28 2022] GET /compute/v2.1/servers/2ec095f2-c25e-434f-87ff-10788b0fe6c3 => generated 1315 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:38:29.216168 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f560db31-68d4-4a0b-8673-3c039e56bca3 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "72e75738-cb91-475f-a857-1aba96e97efe"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:38:29.220176 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f560db31-68d4-4a0b-8673-3c039e56bca3 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: d963bc87-b838-431c-92c3-8f06dd7afba7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:29.236225 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f560db31-68d4-4a0b-8673-3c039e56bca3 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:29.236746 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f560db31-68d4-4a0b-8673-3c039e56bca3 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:29.237194 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f560db31-68d4-4a0b-8673-3c039e56bca3 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:29.238054 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f560db31-68d4-4a0b-8673-3c039e56bca3 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:29.242778 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f560db31-68d4-4a0b-8673-3c039e56bca3 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:29.243489 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f560db31-68d4-4a0b-8673-3c039e56bca3 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:29.353516 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-f560db31-68d4-4a0b-8673-3c039e56bca3 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] HTTP exception thrown: Invalid volume: volume 72e75738-cb91-475f-a857-1aba96e97efe is already attached to instances: c5c50ae8-6217-4650-8420-291847e21ace Oct 27 03:38:29.355514 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f560db31-68d4-4a0b-8673-3c039e56bca3 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Request method failure captured: Oct 27 03:38:29.355514 n-d-862769-1 devstack@n-api.service[121000]: request: POST /compute/v2.1/servers/d963bc87-b838-431c-92c3-8f06dd7afba7/os-volume_attachments HTTP/1.1 Oct 27 03:38:29.355514 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:38:29.355514 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:38:29.355514 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:38:29.355514 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 74 Oct 27 03:38:29.355514 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:38:29.355514 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:38:29.355514 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:38:29.355514 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:38:29.355514 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfyO20A1D6ympGjQc2k7pGwXBVoOs4AtFX551niq39NWe_HjifvxGvre6cHeeNp8osa7J1PNEE0_yy7-MG05YNEONXkGtR3-F0Zb6-60FxqOiIpeJ5N_dbXBRWjEl88UsCCW068A90fytHXWgtrGlYksZomXGQlrDugSxyxjlY4_NPY Oct 27 03:38:29.355514 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:38:29.355514 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:38:29.355514 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:38:29.355514 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:38:29.355514 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:38:29.355514 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:38:29.355514 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 229dcb63bc41444391544883b576ce2e Oct 27 03:38:29.355514 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-AttachVolumeNegativeTest-199004901 Oct 27 03:38:29.355514 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:38:29.355514 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:38:29.355514 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/229dcb63bc41444391544883b576ce2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/229dcb63bc41444391544883b576ce2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/229dcb63bc41444391544883b576ce2e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_229dcb63bc41444391544883b576ce2e"}]}] Oct 27 03:38:29.355514 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-AttachVolumeNegativeTest-199004901 Oct 27 03:38:29.355514 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 229dcb63bc41444391544883b576ce2e Oct 27 03:38:29.355514 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-199004901 Oct 27 03:38:29.355514 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-AttachVolumeNegativeTest-199004901-project Oct 27 03:38:29.355514 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:38:29.355514 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:38:29.355514 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 18036411a99e4634bfbaeae24b9f254d Oct 27 03:38:29.355514 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-AttachVolumeNegativeTest-199004901-project Oct 27 03:38:29.355514 n-d-862769-1 devstack@n-api.service[121000]: Oct 27 03:38:29.355514 n-d-862769-1 devstack@n-api.service[121000]: {"volumeAttachment": {"volumeId": "72e75738-cb91-475f-a857-1aba96e97efe"}} Oct 27 03:38:29.355514 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:38:29.355514 n-d-862769-1 devstack@n-api.service[121000]: exception: Invalid volume: volume 72e75738-cb91-475f-a857-1aba96e97efe is already attached to instances: c5c50ae8-6217-4650-8420-291847e21ace Oct 27 03:38:29.355514 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'server_id': 'd963bc87-b838-431c-92c3-8f06dd7afba7', 'body': {'volumeAttachment': {'volumeId': '72e75738-cb91-475f-a857-1aba96e97efe'}}} Oct 27 03:38:29.355514 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:38:29.355514 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:38:29.355514 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 27 03:38:29.355514 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 27 03:38:29.355514 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 03:38:29.355514 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 03:38:29.355514 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 27 03:38:29.355514 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 27 03:38:29.355514 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 27 03:38:29.355514 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 27 03:38:29.355514 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 27 03:38:29.355514 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 27 03:38:29.355514 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 72e75738-cb91-475f-a857-1aba96e97efe is already attached to instances: c5c50ae8-6217-4650-8420-291847e21ace Oct 27 03:38:29.355514 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:38:29.355514 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:38:29.355514 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:38:29.355514 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:38:29.355514 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:38:29.355514 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:38:29.355514 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:38:29.355514 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:38:29.355514 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:38:29.355514 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:38:29.355514 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:38:29.355514 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:38:29.355514 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:38:29.355514 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:38:29.361267 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:38:29.361267 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:38:29.361267 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 27 03:38:29.361267 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 27 03:38:29.361267 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 72e75738-cb91-475f-a857-1aba96e97efe is already attached to instances: c5c50ae8-6217-4650-8420-291847e21ace Oct 27 03:38:29.361267 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:38:29.361267 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:38:29.361267 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:38:29.361267 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:38:29.361267 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:38:29.361267 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:38:29.361267 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:38:29.361267 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:38:29.361267 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 72e75738-cb91-475f-a857-1aba96e97efe is already attached to instances: c5c50ae8-6217-4650-8420-291847e21ace Oct 27 03:38:29.361267 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:38:29.361267 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f560db31-68d4-4a0b-8673-3c039e56bca3 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Returning 400 to user: Invalid volume: volume 72e75738-cb91-475f-a857-1aba96e97efe is already attached to instances: c5c50ae8-6217-4650-8420-291847e21ace {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:38:29.361267 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f560db31-68d4-4a0b-8673-3c039e56bca3 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "POST /compute/v2.1/servers/d963bc87-b838-431c-92c3-8f06dd7afba7/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.153990 Oct 27 03:38:29.361267 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1953/4158] 10.222.0.20 () {60 vars in 1323 bytes} [Thu Oct 27 03:38:29 2022] POST /compute/v2.1/servers/d963bc87-b838-431c-92c3-8f06dd7afba7/os-volume_attachments => generated 174 bytes in 163 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 03:38:29.365222 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-04a98bc2-54c9-4cae-9efb-bbabaf1d8f0e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:29.365729 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-04a98bc2-54c9-4cae-9efb-bbabaf1d8f0e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: dbb1b9d1-38ff-42da-9e74-91f686f88047] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:29.374471 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-04a98bc2-54c9-4cae-9efb-bbabaf1d8f0e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:29.378544 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-04a98bc2-54c9-4cae-9efb-bbabaf1d8f0e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:29.378544 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-04a98bc2-54c9-4cae-9efb-bbabaf1d8f0e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:29.378544 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-04a98bc2-54c9-4cae-9efb-bbabaf1d8f0e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:29.378544 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-04a98bc2-54c9-4cae-9efb-bbabaf1d8f0e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:29.378544 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-04a98bc2-54c9-4cae-9efb-bbabaf1d8f0e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:29.383427 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ddf45367-552e-47d7-978b-3ecbe8eaca61 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "DELETE /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 204 len: 0 microversion: 2.1 time: 0.499475 Oct 27 03:38:29.387627 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2206/4159] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:38:28 2022] DELETE /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 0 bytes in 516 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:38:29.393611 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-18a9aa8a-65a4-4771-9788-4bcf7e345dd1 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:29.397207 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-18a9aa8a-65a4-4771-9788-4bcf7e345dd1 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: d963bc87-b838-431c-92c3-8f06dd7afba7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:29.415198 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-18a9aa8a-65a4-4771-9788-4bcf7e345dd1 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:29.415709 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-18a9aa8a-65a4-4771-9788-4bcf7e345dd1 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:29.417030 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-18a9aa8a-65a4-4771-9788-4bcf7e345dd1 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:29.417199 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-18a9aa8a-65a4-4771-9788-4bcf7e345dd1 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:29.417639 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-18a9aa8a-65a4-4771-9788-4bcf7e345dd1 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:29.418282 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-18a9aa8a-65a4-4771-9788-4bcf7e345dd1 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:29.444103 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-04a98bc2-54c9-4cae-9efb-bbabaf1d8f0e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: dbb1b9d1-38ff-42da-9e74-91f686f88047] Going to try to terminate instance {{(pid=121000) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:38:29.447574 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-18a9aa8a-65a4-4771-9788-4bcf7e345dd1 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: d963bc87-b838-431c-92c3-8f06dd7afba7] Going to try to terminate instance {{(pid=121001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:38:29.845235 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-04a98bc2-54c9-4cae-9efb-bbabaf1d8f0e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "DELETE /compute/v2.1/servers/dbb1b9d1-38ff-42da-9e74-91f686f88047" status: 204 len: 0 microversion: 2.1 time: 0.483392 Oct 27 03:38:29.849905 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1954/4160] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:38:29 2022] DELETE /compute/v2.1/servers/dbb1b9d1-38ff-42da-9e74-91f686f88047 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:38:29.858627 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-88bff7c4-2b09-4b10-81d4-de2ee292dee2 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:29.860561 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-88bff7c4-2b09-4b10-81d4-de2ee292dee2 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:29.873856 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-88bff7c4-2b09-4b10-81d4-de2ee292dee2 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:29.875235 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-88bff7c4-2b09-4b10-81d4-de2ee292dee2 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:29.876333 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-88bff7c4-2b09-4b10-81d4-de2ee292dee2 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:29.877420 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-88bff7c4-2b09-4b10-81d4-de2ee292dee2 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:29.878154 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-88bff7c4-2b09-4b10-81d4-de2ee292dee2 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:29.879123 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-88bff7c4-2b09-4b10-81d4-de2ee292dee2 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:29.993822 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-18a9aa8a-65a4-4771-9788-4bcf7e345dd1 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d963bc87-b838-431c-92c3-8f06dd7afba7" status: 204 len: 0 microversion: 2.1 time: 0.604534 Oct 27 03:38:29.995628 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2207/4161] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:38:29 2022] DELETE /compute/v2.1/servers/d963bc87-b838-431c-92c3-8f06dd7afba7 => generated 0 bytes in 607 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:38:30.001654 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9bce6fdc-4351-47ed-8cc7-fd1fc3eee97c tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:30.007144 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-9bce6fdc-4351-47ed-8cc7-fd1fc3eee97c tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] [instance: 7e73d534-0a40-42d2-813c-2e9dbb9239ac] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:30.009337 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9bce6fdc-4351-47ed-8cc7-fd1fc3eee97c tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:30.010172 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9bce6fdc-4351-47ed-8cc7-fd1fc3eee97c tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:30.010907 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9bce6fdc-4351-47ed-8cc7-fd1fc3eee97c tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:30.011860 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9bce6fdc-4351-47ed-8cc7-fd1fc3eee97c tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:30.012561 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9bce6fdc-4351-47ed-8cc7-fd1fc3eee97c tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:30.013243 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9bce6fdc-4351-47ed-8cc7-fd1fc3eee97c tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:30.129794 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-88bff7c4-2b09-4b10-81d4-de2ee292dee2 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:30.140350 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-88bff7c4-2b09-4b10-81d4-de2ee292dee2 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1511 microversion: 2.1 time: 0.287117 Oct 27 03:38:30.140937 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1955/4162] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:29 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1511 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:38:30.145597 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-552afedd-facd-4ae4-94dd-1739c6166f19 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:30.148201 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-552afedd-facd-4ae4-94dd-1739c6166f19 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: dbb1b9d1-38ff-42da-9e74-91f686f88047] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:30.161992 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:38:30.164988 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-552afedd-facd-4ae4-94dd-1739c6166f19 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:30.165857 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-552afedd-facd-4ae4-94dd-1739c6166f19 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:30.167923 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-552afedd-facd-4ae4-94dd-1739c6166f19 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:30.169305 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-552afedd-facd-4ae4-94dd-1739c6166f19 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:30.170310 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-552afedd-facd-4ae4-94dd-1739c6166f19 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:30.170817 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-552afedd-facd-4ae4-94dd-1739c6166f19 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:30.331220 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-552afedd-facd-4ae4-94dd-1739c6166f19 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:30.342019 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-552afedd-facd-4ae4-94dd-1739c6166f19 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/dbb1b9d1-38ff-42da-9e74-91f686f88047" status: 200 len: 1466 microversion: 2.1 time: 0.199825 Oct 27 03:38:30.346333 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1956/4163] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:30 2022] GET /compute/v2.1/servers/dbb1b9d1-38ff-42da-9e74-91f686f88047 => generated 1466 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:38:30.351313 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-300095f1-d609-45b4-974d-2caf490f7700 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:30.352106 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-300095f1-d609-45b4-974d-2caf490f7700 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] [instance: e3b8bf04-529a-4909-9727-404cb7bba177] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:30.358979 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-300095f1-d609-45b4-974d-2caf490f7700 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:30.359711 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-300095f1-d609-45b4-974d-2caf490f7700 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:30.360406 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-300095f1-d609-45b4-974d-2caf490f7700 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:30.361298 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-300095f1-d609-45b4-974d-2caf490f7700 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:30.361985 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-300095f1-d609-45b4-974d-2caf490f7700 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:30.362444 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-300095f1-d609-45b4-974d-2caf490f7700 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:30.430532 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-300095f1-d609-45b4-974d-2caf490f7700 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51be346b3c5448c28ac57f5c1ffe50bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93732dbf56414de2b7667e1e70262a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:30.438844 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9bce6fdc-4351-47ed-8cc7-fd1fc3eee97c tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:30.439033 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-300095f1-d609-45b4-974d-2caf490f7700 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51be346b3c5448c28ac57f5c1ffe50bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93732dbf56414de2b7667e1e70262a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:30.440444 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-300095f1-d609-45b4-974d-2caf490f7700 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51be346b3c5448c28ac57f5c1ffe50bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93732dbf56414de2b7667e1e70262a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:30.441596 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-300095f1-d609-45b4-974d-2caf490f7700 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] 10.222.0.20 "GET /compute/v2.1/servers/e3b8bf04-529a-4909-9727-404cb7bba177" status: 200 len: 1262 microversion: 2.21 time: 0.094046 Oct 27 03:38:30.442200 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1957/4164] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:38:30 2022] GET /compute/v2.1/servers/e3b8bf04-529a-4909-9727-404cb7bba177 => generated 1262 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:38:30.446954 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d12109a5-bef1-471a-8253-1b69a10a4b56 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:30.447569 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d12109a5-bef1-471a-8253-1b69a10a4b56 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: d963bc87-b838-431c-92c3-8f06dd7afba7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:30.457178 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d12109a5-bef1-471a-8253-1b69a10a4b56 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:30.457956 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d12109a5-bef1-471a-8253-1b69a10a4b56 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:30.458436 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d12109a5-bef1-471a-8253-1b69a10a4b56 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:30.459147 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d12109a5-bef1-471a-8253-1b69a10a4b56 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:30.459775 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d12109a5-bef1-471a-8253-1b69a10a4b56 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:30.460379 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d12109a5-bef1-471a-8253-1b69a10a4b56 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:30.468160 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9bce6fdc-4351-47ed-8cc7-fd1fc3eee97c tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:30.469714 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9bce6fdc-4351-47ed-8cc7-fd1fc3eee97c tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:30.471662 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9bce6fdc-4351-47ed-8cc7-fd1fc3eee97c tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] 10.222.0.20 "GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac" status: 200 len: 1879 microversion: 2.32 time: 0.473982 Oct 27 03:38:30.479907 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2208/4165] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:38:29 2022] GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac => generated 1879 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:38:30.479907 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-d7fc740e-7a12-4c1b-ae6f-f5af70965cec req-560d31ca-0ad7-4a9b-9845-b3947a437623 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e73d534-0a40-42d2-813c-2e9dbb9239ac", "tag": "7eb3c0a9-011b-4ec7-a337-29cffc7192c5"}, {"name": "network-changed", "server_uuid": "2ec095f2-c25e-434f-87ff-10788b0fe6c3", "tag": "5c64c2e5-5026-4fce-99fc-27a5bf039bb7"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:38:30.489865 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-d7fc740e-7a12-4c1b-ae6f-f5af70965cec req-560d31ca-0ad7-4a9b-9845-b3947a437623 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:30.492259 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-d7fc740e-7a12-4c1b-ae6f-f5af70965cec req-560d31ca-0ad7-4a9b-9845-b3947a437623 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:30.492259 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-d7fc740e-7a12-4c1b-ae6f-f5af70965cec req-560d31ca-0ad7-4a9b-9845-b3947a437623 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:30.520875 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-d7fc740e-7a12-4c1b-ae6f-f5af70965cec req-560d31ca-0ad7-4a9b-9845-b3947a437623 service nova] Creating event network-changed:7eb3c0a9-011b-4ec7-a337-29cffc7192c5 for instance 7e73d534-0a40-42d2-813c-2e9dbb9239ac on n-h2-862769-1 Oct 27 03:38:30.521668 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-d7fc740e-7a12-4c1b-ae6f-f5af70965cec req-560d31ca-0ad7-4a9b-9845-b3947a437623 service nova] Creating event network-changed:5c64c2e5-5026-4fce-99fc-27a5bf039bb7 for instance 2ec095f2-c25e-434f-87ff-10788b0fe6c3 on n-h1-862769-1 Oct 27 03:38:30.531678 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-d7fc740e-7a12-4c1b-ae6f-f5af70965cec req-560d31ca-0ad7-4a9b-9845-b3947a437623 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.057169 Oct 27 03:38:30.532510 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2209/4166] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:38:30 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:38:30.539093 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2da8111e-539a-4073-a789-1c107a854cd0 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:30.540010 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2da8111e-539a-4073-a789-1c107a854cd0 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 2ec095f2-c25e-434f-87ff-10788b0fe6c3] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:30.549899 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2da8111e-539a-4073-a789-1c107a854cd0 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:30.549899 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2da8111e-539a-4073-a789-1c107a854cd0 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:30.549899 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2da8111e-539a-4073-a789-1c107a854cd0 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:30.550393 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2da8111e-539a-4073-a789-1c107a854cd0 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:30.551036 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2da8111e-539a-4073-a789-1c107a854cd0 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:30.551636 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2da8111e-539a-4073-a789-1c107a854cd0 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:30.653141 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d12109a5-bef1-471a-8253-1b69a10a4b56 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18036411a99e4634bfbaeae24b9f254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229dcb63bc41444391544883b576ce2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:30.661682 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d12109a5-bef1-471a-8253-1b69a10a4b56 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/d963bc87-b838-431c-92c3-8f06dd7afba7" status: 200 len: 1682 microversion: 2.1 time: 0.218153 Oct 27 03:38:30.663284 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1958/4167] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:30 2022] GET /compute/v2.1/servers/d963bc87-b838-431c-92c3-8f06dd7afba7 => generated 1682 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:38:30.781724 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2da8111e-539a-4073-a789-1c107a854cd0 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:30.786581 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2da8111e-539a-4073-a789-1c107a854cd0 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/2ec095f2-c25e-434f-87ff-10788b0fe6c3" status: 200 len: 1315 microversion: 2.1 time: 0.252619 Oct 27 03:38:30.787726 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2210/4168] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:30 2022] GET /compute/v2.1/servers/2ec095f2-c25e-434f-87ff-10788b0fe6c3 => generated 1315 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:38:31.171018 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-74ab4299-5d54-438a-bd96-98b13d83eab3 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:31.171458 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-74ab4299-5d54-438a-bd96-98b13d83eab3 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:31.190850 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-74ab4299-5d54-438a-bd96-98b13d83eab3 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:31.194073 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-74ab4299-5d54-438a-bd96-98b13d83eab3 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:31.194073 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-74ab4299-5d54-438a-bd96-98b13d83eab3 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:31.194073 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-74ab4299-5d54-438a-bd96-98b13d83eab3 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:31.194073 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-74ab4299-5d54-438a-bd96-98b13d83eab3 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:31.194073 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-74ab4299-5d54-438a-bd96-98b13d83eab3 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:31.236081 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:38:31.375561 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d5fecf41-1243-4890-8e22-7429b75a1658 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:31.380467 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d5fecf41-1243-4890-8e22-7429b75a1658 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: dbb1b9d1-38ff-42da-9e74-91f686f88047] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:31.411214 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d5fecf41-1243-4890-8e22-7429b75a1658 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:31.412552 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d5fecf41-1243-4890-8e22-7429b75a1658 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:31.413919 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d5fecf41-1243-4890-8e22-7429b75a1658 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:31.416664 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d5fecf41-1243-4890-8e22-7429b75a1658 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:31.417319 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d5fecf41-1243-4890-8e22-7429b75a1658 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:31.418684 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d5fecf41-1243-4890-8e22-7429b75a1658 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:31.557948 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-74ab4299-5d54-438a-bd96-98b13d83eab3 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:31.571575 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-74ab4299-5d54-438a-bd96-98b13d83eab3 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1511 microversion: 2.1 time: 0.405896 Oct 27 03:38:31.576226 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1959/4169] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:31 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1511 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:38:31.585178 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-53d2c86f-ad7d-4451-a44e-4f00ae00ce9f tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:31.586661 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-53d2c86f-ad7d-4451-a44e-4f00ae00ce9f tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] [instance: e3b8bf04-529a-4909-9727-404cb7bba177] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:31.600057 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-53d2c86f-ad7d-4451-a44e-4f00ae00ce9f tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:31.601224 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-53d2c86f-ad7d-4451-a44e-4f00ae00ce9f tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:31.602903 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-53d2c86f-ad7d-4451-a44e-4f00ae00ce9f tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:31.606991 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-53d2c86f-ad7d-4451-a44e-4f00ae00ce9f tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:31.607793 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-53d2c86f-ad7d-4451-a44e-4f00ae00ce9f tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:31.608431 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-53d2c86f-ad7d-4451-a44e-4f00ae00ce9f tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:31.728342 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d5fecf41-1243-4890-8e22-7429b75a1658 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:31.740798 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d5fecf41-1243-4890-8e22-7429b75a1658 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/dbb1b9d1-38ff-42da-9e74-91f686f88047" status: 200 len: 1466 microversion: 2.1 time: 0.376132 Oct 27 03:38:31.751072 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2211/4170] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:31 2022] GET /compute/v2.1/servers/dbb1b9d1-38ff-42da-9e74-91f686f88047 => generated 1466 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:38:31.758935 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-36f1cddc-3731-4b09-9f0f-c5257f37cfc0 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:31.763118 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-36f1cddc-3731-4b09-9f0f-c5257f37cfc0 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] [instance: 7e73d534-0a40-42d2-813c-2e9dbb9239ac] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:31.771593 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-53d2c86f-ad7d-4451-a44e-4f00ae00ce9f tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51be346b3c5448c28ac57f5c1ffe50bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93732dbf56414de2b7667e1e70262a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:31.772722 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-36f1cddc-3731-4b09-9f0f-c5257f37cfc0 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:31.773625 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-36f1cddc-3731-4b09-9f0f-c5257f37cfc0 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:31.774298 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-36f1cddc-3731-4b09-9f0f-c5257f37cfc0 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:31.777527 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-36f1cddc-3731-4b09-9f0f-c5257f37cfc0 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:31.777946 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-36f1cddc-3731-4b09-9f0f-c5257f37cfc0 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:31.778449 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-36f1cddc-3731-4b09-9f0f-c5257f37cfc0 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:31.800526 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-53d2c86f-ad7d-4451-a44e-4f00ae00ce9f tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51be346b3c5448c28ac57f5c1ffe50bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93732dbf56414de2b7667e1e70262a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:31.804964 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-53d2c86f-ad7d-4451-a44e-4f00ae00ce9f tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51be346b3c5448c28ac57f5c1ffe50bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93732dbf56414de2b7667e1e70262a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:31.808608 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-53d2c86f-ad7d-4451-a44e-4f00ae00ce9f tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] 10.222.0.20 "GET /compute/v2.1/servers/e3b8bf04-529a-4909-9727-404cb7bba177" status: 200 len: 1310 microversion: 2.21 time: 0.231227 Oct 27 03:38:31.810212 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1960/4171] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:38:31 2022] GET /compute/v2.1/servers/e3b8bf04-529a-4909-9727-404cb7bba177 => generated 1310 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:38:31.823457 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-57bfb20b-f91d-43b3-bfe7-8af1c5293472 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:31.823457 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-57bfb20b-f91d-43b3-bfe7-8af1c5293472 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: d963bc87-b838-431c-92c3-8f06dd7afba7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:31.836298 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-57bfb20b-f91d-43b3-bfe7-8af1c5293472 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:31.837256 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-57bfb20b-f91d-43b3-bfe7-8af1c5293472 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:31.837952 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-57bfb20b-f91d-43b3-bfe7-8af1c5293472 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:31.839602 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-57bfb20b-f91d-43b3-bfe7-8af1c5293472 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:31.840073 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-57bfb20b-f91d-43b3-bfe7-8af1c5293472 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:31.840648 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-57bfb20b-f91d-43b3-bfe7-8af1c5293472 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:32.104879 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-57bfb20b-f91d-43b3-bfe7-8af1c5293472 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18036411a99e4634bfbaeae24b9f254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229dcb63bc41444391544883b576ce2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:32.112646 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-57bfb20b-f91d-43b3-bfe7-8af1c5293472 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/d963bc87-b838-431c-92c3-8f06dd7afba7" status: 200 len: 1682 microversion: 2.1 time: 0.301191 Oct 27 03:38:32.113602 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1961/4172] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:31 2022] GET /compute/v2.1/servers/d963bc87-b838-431c-92c3-8f06dd7afba7 => generated 1682 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:38:32.118540 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-82890264-b862-4077-93f8-f7d965c7c28b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:32.119456 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-82890264-b862-4077-93f8-f7d965c7c28b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 2ec095f2-c25e-434f-87ff-10788b0fe6c3] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:32.126868 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-82890264-b862-4077-93f8-f7d965c7c28b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:32.129088 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-82890264-b862-4077-93f8-f7d965c7c28b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:32.129088 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-82890264-b862-4077-93f8-f7d965c7c28b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:32.130201 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-82890264-b862-4077-93f8-f7d965c7c28b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:32.130888 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-82890264-b862-4077-93f8-f7d965c7c28b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:32.131525 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-82890264-b862-4077-93f8-f7d965c7c28b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:32.227960 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-36f1cddc-3731-4b09-9f0f-c5257f37cfc0 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:32.243334 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-36f1cddc-3731-4b09-9f0f-c5257f37cfc0 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:32.245251 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-36f1cddc-3731-4b09-9f0f-c5257f37cfc0 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:32.246703 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-36f1cddc-3731-4b09-9f0f-c5257f37cfc0 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] 10.222.0.20 "GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac" status: 200 len: 1879 microversion: 2.32 time: 0.494495 Oct 27 03:38:32.247511 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2212/4173] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:38:31 2022] GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac => generated 1879 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:38:32.421342 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-82890264-b862-4077-93f8-f7d965c7c28b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:32.433542 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-82890264-b862-4077-93f8-f7d965c7c28b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/2ec095f2-c25e-434f-87ff-10788b0fe6c3" status: 200 len: 1315 microversion: 2.1 time: 0.318518 Oct 27 03:38:32.434519 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1962/4174] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:32 2022] GET /compute/v2.1/servers/2ec095f2-c25e-434f-87ff-10788b0fe6c3 => generated 1315 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:38:32.610862 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-271f3c28-d821-4374-a78a-0fbeb20b5329 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:32.617520 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-1a36fd30-9fc2-4b4c-be9e-480709e9eeb4 req-6ce1e652-190d-4b00-b7d9-ef4dd648fe4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbb1b9d1-38ff-42da-9e74-91f686f88047", "name": "network-vif-deleted", "tag": "6005c662-3d62-4cfd-8135-e32257e5003f"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:38:32.618103 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-271f3c28-d821-4374-a78a-0fbeb20b5329 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:32.638553 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-271f3c28-d821-4374-a78a-0fbeb20b5329 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:32.639316 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-271f3c28-d821-4374-a78a-0fbeb20b5329 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:32.640004 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-271f3c28-d821-4374-a78a-0fbeb20b5329 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:32.640936 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-271f3c28-d821-4374-a78a-0fbeb20b5329 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:32.641630 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-271f3c28-d821-4374-a78a-0fbeb20b5329 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:32.643394 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-271f3c28-d821-4374-a78a-0fbeb20b5329 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:32.648898 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-1a36fd30-9fc2-4b4c-be9e-480709e9eeb4 req-6ce1e652-190d-4b00-b7d9-ef4dd648fe4b service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:32.649825 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-1a36fd30-9fc2-4b4c-be9e-480709e9eeb4 req-6ce1e652-190d-4b00-b7d9-ef4dd648fe4b service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:32.650469 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-1a36fd30-9fc2-4b4c-be9e-480709e9eeb4 req-6ce1e652-190d-4b00-b7d9-ef4dd648fe4b service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:32.677600 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-1a36fd30-9fc2-4b4c-be9e-480709e9eeb4 req-6ce1e652-190d-4b00-b7d9-ef4dd648fe4b service nova] Creating event network-vif-deleted:6005c662-3d62-4cfd-8135-e32257e5003f for instance dbb1b9d1-38ff-42da-9e74-91f686f88047 on n-h2-862769-1 Oct 27 03:38:32.690344 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-1a36fd30-9fc2-4b4c-be9e-480709e9eeb4 req-6ce1e652-190d-4b00-b7d9-ef4dd648fe4b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076826 Oct 27 03:38:32.691366 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1963/4175] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:38:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:38:32.700965 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-e1fd4f28-a144-4f71-9255-5619443dd858 req-7d44881e-0eed-440a-98d2-76452edede76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e73d534-0a40-42d2-813c-2e9dbb9239ac", "tag": "46cca111-fadc-4d6b-a199-5b4f2005c03d"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:38:32.725429 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-e1fd4f28-a144-4f71-9255-5619443dd858 req-7d44881e-0eed-440a-98d2-76452edede76 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:32.725979 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-e1fd4f28-a144-4f71-9255-5619443dd858 req-7d44881e-0eed-440a-98d2-76452edede76 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:32.726624 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-e1fd4f28-a144-4f71-9255-5619443dd858 req-7d44881e-0eed-440a-98d2-76452edede76 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:32.741639 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-e1fd4f28-a144-4f71-9255-5619443dd858 req-7d44881e-0eed-440a-98d2-76452edede76 service nova] Creating event network-changed:46cca111-fadc-4d6b-a199-5b4f2005c03d for instance 7e73d534-0a40-42d2-813c-2e9dbb9239ac on n-h2-862769-1 Oct 27 03:38:32.747168 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-e1fd4f28-a144-4f71-9255-5619443dd858 req-7d44881e-0eed-440a-98d2-76452edede76 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054493 Oct 27 03:38:32.747778 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1964/4176] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:38:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:38:32.767535 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b7b3580e-4297-415a-9d57-29b0a7e35455 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:32.768720 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b7b3580e-4297-415a-9d57-29b0a7e35455 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: dbb1b9d1-38ff-42da-9e74-91f686f88047] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:32.777493 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b7b3580e-4297-415a-9d57-29b0a7e35455 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:32.778282 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b7b3580e-4297-415a-9d57-29b0a7e35455 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:32.778989 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b7b3580e-4297-415a-9d57-29b0a7e35455 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:32.779952 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b7b3580e-4297-415a-9d57-29b0a7e35455 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:32.780791 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b7b3580e-4297-415a-9d57-29b0a7e35455 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:32.781311 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b7b3580e-4297-415a-9d57-29b0a7e35455 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:32.951447 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b7b3580e-4297-415a-9d57-29b0a7e35455 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:32.971576 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b7b3580e-4297-415a-9d57-29b0a7e35455 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/dbb1b9d1-38ff-42da-9e74-91f686f88047" status: 200 len: 1466 microversion: 2.1 time: 0.209536 Oct 27 03:38:32.981173 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1965/4177] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:32 2022] GET /compute/v2.1/servers/dbb1b9d1-38ff-42da-9e74-91f686f88047 => generated 1466 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:38:32.981173 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e8c91931-0afd-4368-965d-2ab44206c5c9 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:32.988860 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e8c91931-0afd-4368-965d-2ab44206c5c9 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] [instance: e3b8bf04-529a-4909-9727-404cb7bba177] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:32.993220 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e8c91931-0afd-4368-965d-2ab44206c5c9 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:32.993845 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e8c91931-0afd-4368-965d-2ab44206c5c9 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:32.994886 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e8c91931-0afd-4368-965d-2ab44206c5c9 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:32.996685 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e8c91931-0afd-4368-965d-2ab44206c5c9 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:32.997251 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e8c91931-0afd-4368-965d-2ab44206c5c9 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:32.998607 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e8c91931-0afd-4368-965d-2ab44206c5c9 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:33.061494 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-271f3c28-d821-4374-a78a-0fbeb20b5329 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:33.071648 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-271f3c28-d821-4374-a78a-0fbeb20b5329 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1511 microversion: 2.1 time: 0.479937 Oct 27 03:38:33.072498 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2213/4178] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:32 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1511 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:38:33.136701 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-342e46d6-d878-43b1-a944-c2e0a27eb7cf tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:33.137277 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-342e46d6-d878-43b1-a944-c2e0a27eb7cf tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: d963bc87-b838-431c-92c3-8f06dd7afba7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:33.144268 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-342e46d6-d878-43b1-a944-c2e0a27eb7cf tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:33.145213 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-342e46d6-d878-43b1-a944-c2e0a27eb7cf tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:33.145883 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-342e46d6-d878-43b1-a944-c2e0a27eb7cf tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:33.147026 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-342e46d6-d878-43b1-a944-c2e0a27eb7cf tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:33.149331 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-342e46d6-d878-43b1-a944-c2e0a27eb7cf tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:33.149871 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-342e46d6-d878-43b1-a944-c2e0a27eb7cf tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:33.369900 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e8c91931-0afd-4368-965d-2ab44206c5c9 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51be346b3c5448c28ac57f5c1ffe50bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93732dbf56414de2b7667e1e70262a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:33.390883 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e8c91931-0afd-4368-965d-2ab44206c5c9 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51be346b3c5448c28ac57f5c1ffe50bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93732dbf56414de2b7667e1e70262a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:33.390883 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e8c91931-0afd-4368-965d-2ab44206c5c9 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51be346b3c5448c28ac57f5c1ffe50bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93732dbf56414de2b7667e1e70262a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:33.391859 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e8c91931-0afd-4368-965d-2ab44206c5c9 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] 10.222.0.20 "GET /compute/v2.1/servers/e3b8bf04-529a-4909-9727-404cb7bba177" status: 200 len: 1316 microversion: 2.21 time: 0.417328 Oct 27 03:38:33.393026 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1966/4179] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:38:32 2022] GET /compute/v2.1/servers/e3b8bf04-529a-4909-9727-404cb7bba177 => generated 1316 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:38:33.412730 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ea7aece0-2fe9-4c50-bca2-bc296b5eb393 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:33.413383 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ea7aece0-2fe9-4c50-bca2-bc296b5eb393 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] [instance: 7e73d534-0a40-42d2-813c-2e9dbb9239ac] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:33.421535 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ea7aece0-2fe9-4c50-bca2-bc296b5eb393 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:33.422049 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ea7aece0-2fe9-4c50-bca2-bc296b5eb393 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:33.422574 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ea7aece0-2fe9-4c50-bca2-bc296b5eb393 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:33.423290 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ea7aece0-2fe9-4c50-bca2-bc296b5eb393 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:33.423855 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ea7aece0-2fe9-4c50-bca2-bc296b5eb393 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:33.424293 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ea7aece0-2fe9-4c50-bca2-bc296b5eb393 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:33.464142 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-342e46d6-d878-43b1-a944-c2e0a27eb7cf tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18036411a99e4634bfbaeae24b9f254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229dcb63bc41444391544883b576ce2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:33.474552 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-342e46d6-d878-43b1-a944-c2e0a27eb7cf tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/d963bc87-b838-431c-92c3-8f06dd7afba7" status: 200 len: 1682 microversion: 2.1 time: 0.342016 Oct 27 03:38:33.475833 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2214/4180] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:33 2022] GET /compute/v2.1/servers/d963bc87-b838-431c-92c3-8f06dd7afba7 => generated 1682 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:38:33.492586 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0895f8d8-fcb2-4c5d-b3a5-ed013fafa5fd tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:33.493964 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0895f8d8-fcb2-4c5d-b3a5-ed013fafa5fd tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 2ec095f2-c25e-434f-87ff-10788b0fe6c3] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:33.501887 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0895f8d8-fcb2-4c5d-b3a5-ed013fafa5fd tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:33.515470 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0895f8d8-fcb2-4c5d-b3a5-ed013fafa5fd tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:33.519835 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0895f8d8-fcb2-4c5d-b3a5-ed013fafa5fd tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:33.521872 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0895f8d8-fcb2-4c5d-b3a5-ed013fafa5fd tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:33.522946 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0895f8d8-fcb2-4c5d-b3a5-ed013fafa5fd tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:33.524205 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0895f8d8-fcb2-4c5d-b3a5-ed013fafa5fd tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:33.907366 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0895f8d8-fcb2-4c5d-b3a5-ed013fafa5fd tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:33.926107 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0895f8d8-fcb2-4c5d-b3a5-ed013fafa5fd tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/2ec095f2-c25e-434f-87ff-10788b0fe6c3" status: 200 len: 1315 microversion: 2.1 time: 0.445022 Oct 27 03:38:33.935703 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2215/4181] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:33 2022] GET /compute/v2.1/servers/2ec095f2-c25e-434f-87ff-10788b0fe6c3 => generated 1315 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:38:34.012747 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-dbcc9361-140d-456e-8edf-55af88f47fd2 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Action: 'create', calling method: .version_select at 0x7f7dded6d820>, body: {"keypair": {"name": "tempest-keypair-682006599", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP5VwGBCVhd+n+j6Xb9QWxS2IYR2ESsrtp1c5pJKGC+dRl1Mz9p9ZULbL4IHFqNNxy1JUBeYtg+sCiRka2TM5ic782iOpvkqpW78M7upo3pGIvPsd4t7efwVsKPDbYhTzQ=="}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:38:34.054282 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-dbcc9361-140d-456e-8edf-55af88f47fd2 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Getting quotas for project 4840257127594149b03c0aa3ab94b486. Resources: {'key_pairs'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:38:34.061474 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-dbcc9361-140d-456e-8edf-55af88f47fd2 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Getting quotas for user 3e8e0bc10d3f451c8837c1f1e4d86eaa and project 4840257127594149b03c0aa3ab94b486. Resources: {'key_pairs'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:38:34.203526 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-dbcc9361-140d-456e-8edf-55af88f47fd2 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.266251 Oct 27 03:38:34.204248 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2216/4182] 10.222.0.20 () {60 vars in 1159 bytes} [Thu Oct 27 03:38:33 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:38:34.212599 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-12e5e665-95f0-47f0-9ec7-fe80170fb61c req-b005fb1a-96f2-41a0-9fcc-4f5550042159 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d963bc87-b838-431c-92c3-8f06dd7afba7", "name": "network-vif-unplugged", "status": "completed", "tag": "d76e2f68-c54b-49b5-8391-83058b2b1e64"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:38:34.224280 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-12e5e665-95f0-47f0-9ec7-fe80170fb61c req-b005fb1a-96f2-41a0-9fcc-4f5550042159 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:34.224780 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-12e5e665-95f0-47f0-9ec7-fe80170fb61c req-b005fb1a-96f2-41a0-9fcc-4f5550042159 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:34.225222 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-12e5e665-95f0-47f0-9ec7-fe80170fb61c req-b005fb1a-96f2-41a0-9fcc-4f5550042159 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:34.242306 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ea7aece0-2fe9-4c50-bca2-bc296b5eb393 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:34.247012 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-12e5e665-95f0-47f0-9ec7-fe80170fb61c req-b005fb1a-96f2-41a0-9fcc-4f5550042159 service nova] Creating event network-vif-unplugged:d76e2f68-c54b-49b5-8391-83058b2b1e64 for instance d963bc87-b838-431c-92c3-8f06dd7afba7 on n-h1-862769-1 Oct 27 03:38:34.256893 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ea7aece0-2fe9-4c50-bca2-bc296b5eb393 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:34.258655 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ea7aece0-2fe9-4c50-bca2-bc296b5eb393 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:34.259902 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-12e5e665-95f0-47f0-9ec7-fe80170fb61c req-b005fb1a-96f2-41a0-9fcc-4f5550042159 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052382 Oct 27 03:38:34.260316 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ea7aece0-2fe9-4c50-bca2-bc296b5eb393 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] 10.222.0.20 "GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac" status: 200 len: 1879 microversion: 2.32 time: 0.865851 Oct 27 03:38:34.261422 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2217/4183] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:38:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:38:34.272147 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ebe7ba39-2b06-4010-a3a4-90cd29259e75 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:34.272962 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ebe7ba39-2b06-4010-a3a4-90cd29259e75 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: dbb1b9d1-38ff-42da-9e74-91f686f88047] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:34.284780 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1967/4184] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:38:33 2022] GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac => generated 1879 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:38:34.285434 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ebe7ba39-2b06-4010-a3a4-90cd29259e75 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:34.286558 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ebe7ba39-2b06-4010-a3a4-90cd29259e75 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:34.287095 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ebe7ba39-2b06-4010-a3a4-90cd29259e75 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:34.287863 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ebe7ba39-2b06-4010-a3a4-90cd29259e75 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:34.289176 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ebe7ba39-2b06-4010-a3a4-90cd29259e75 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:34.289329 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ebe7ba39-2b06-4010-a3a4-90cd29259e75 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:34.290077 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ee463cbb-b63b-4654-a993-8823726fa07c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:34.290698 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ee463cbb-b63b-4654-a993-8823726fa07c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:34.300714 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ee463cbb-b63b-4654-a993-8823726fa07c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:34.301225 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ee463cbb-b63b-4654-a993-8823726fa07c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:34.301966 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ee463cbb-b63b-4654-a993-8823726fa07c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:34.303237 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ee463cbb-b63b-4654-a993-8823726fa07c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:34.303951 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ee463cbb-b63b-4654-a993-8823726fa07c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:34.304614 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ee463cbb-b63b-4654-a993-8823726fa07c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:34.313642 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-ebe7ba39-2b06-4010-a3a4-90cd29259e75 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] HTTP exception thrown: Instance dbb1b9d1-38ff-42da-9e74-91f686f88047 could not be found. Oct 27 03:38:34.315361 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ebe7ba39-2b06-4010-a3a4-90cd29259e75 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Request method failure captured: Oct 27 03:38:34.315361 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/dbb1b9d1-38ff-42da-9e74-91f686f88047 HTTP/1.1 Oct 27 03:38:34.315361 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:38:34.315361 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:38:34.315361 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:38:34.315361 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:38:34.315361 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:38:34.315361 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:38:34.315361 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:38:34.315361 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:38:34.315361 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfsa_BAeMB3RnYvkmJQwjLzdAXRwOtmdTc4q-U2TyHH4sY2pC7-yKXDlPkKgdlBzGRlepw8PNzs2kNd86HTPJPZkHZ4DJy78RLBBzCNtKZaBrkpRAbSZW5Gv7329yxsJiAdDbJaiPVC-uHRtJPx_KALbDnjOM5yyEW86DSYN-HLC8ok Oct 27 03:38:34.315361 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:38:34.315361 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:38:34.315361 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:38:34.315361 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:38:34.315361 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:38:34.315361 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:38:34.315361 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 3e9ede68f63747d59153a46412033856 Oct 27 03:38:34.315361 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServerActionsTestJSON-24656121 Oct 27 03:38:34.315361 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:38:34.315361 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:38:34.315361 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3e9ede68f63747d59153a46412033856"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3e9ede68f63747d59153a46412033856"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3e9ede68f63747d59153a46412033856"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3e9ede68f63747d59153a46412033856"}]}] Oct 27 03:38:34.315361 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServerActionsTestJSON-24656121 Oct 27 03:38:34.315361 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 3e9ede68f63747d59153a46412033856 Oct 27 03:38:34.315361 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServerActionsTestJSON-24656121 Oct 27 03:38:34.315361 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServerActionsTestJSON-24656121-project Oct 27 03:38:34.315361 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:38:34.315361 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:38:34.315361 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 94897f20beb94dbd8e7eff6ecba30026 Oct 27 03:38:34.315361 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServerActionsTestJSON-24656121-project Oct 27 03:38:34.315361 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:38:34.315361 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance dbb1b9d1-38ff-42da-9e74-91f686f88047 could not be found. Oct 27 03:38:34.315361 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': 'dbb1b9d1-38ff-42da-9e74-91f686f88047'} Oct 27 03:38:34.315361 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:38:34.315361 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:38:34.315361 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:38:34.315361 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:38:34.315361 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:38:34.315361 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:38:34.315361 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:38:34.315361 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:38:34.315361 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:38:34.315361 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:38:34.315361 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbb1b9d1-38ff-42da-9e74-91f686f88047 could not be found. Oct 27 03:38:34.315361 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:38:34.315361 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:38:34.315361 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:38:34.315361 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:38:34.315361 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:38:34.315361 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:38:34.315361 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:38:34.315361 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:38:34.315361 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:38:34.315361 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:38:34.315361 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:38:34.315361 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:38:34.315361 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:38:34.315361 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:38:34.315361 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:38:34.315361 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:38:34.315361 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbb1b9d1-38ff-42da-9e74-91f686f88047 could not be found. Oct 27 03:38:34.315361 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:38:34.315361 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:38:34.315361 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:38:34.319975 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:38:34.319975 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:38:34.319975 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:38:34.319975 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:38:34.319975 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:38:34.319975 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbb1b9d1-38ff-42da-9e74-91f686f88047 could not be found. Oct 27 03:38:34.319975 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:38:34.319975 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ebe7ba39-2b06-4010-a3a4-90cd29259e75 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Returning 404 to user: Instance dbb1b9d1-38ff-42da-9e74-91f686f88047 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:38:34.319975 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ebe7ba39-2b06-4010-a3a4-90cd29259e75 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/dbb1b9d1-38ff-42da-9e74-91f686f88047" status: 404 len: 111 microversion: 2.1 time: 0.049434 Oct 27 03:38:34.319975 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2218/4185] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:34 2022] GET /compute/v2.1/servers/dbb1b9d1-38ff-42da-9e74-91f686f88047 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:38:34.328792 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1991943f-3b33-45f7-aee8-ba1159489356 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:34.329361 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1991943f-3b33-45f7-aee8-ba1159489356 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: 8184dc7a-d6db-4374-ace1-f26377f26187] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:34.341495 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1991943f-3b33-45f7-aee8-ba1159489356 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:34.342487 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1991943f-3b33-45f7-aee8-ba1159489356 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:34.347605 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1991943f-3b33-45f7-aee8-ba1159489356 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:34.347605 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1991943f-3b33-45f7-aee8-ba1159489356 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:34.347605 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1991943f-3b33-45f7-aee8-ba1159489356 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:34.347605 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1991943f-3b33-45f7-aee8-ba1159489356 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:34.358868 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ee463cbb-b63b-4654-a993-8823726fa07c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:34.359369 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ee463cbb-b63b-4654-a993-8823726fa07c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:34.359818 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ee463cbb-b63b-4654-a993-8823726fa07c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:34.360365 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-ee463cbb-b63b-4654-a993-8823726fa07c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lazy-loading 'fault' on Instance uuid 376ac459-e31f-4727-9e34-535f055ac20d {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:38:34.384373 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1991943f-3b33-45f7-aee8-ba1159489356 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: 8184dc7a-d6db-4374-ace1-f26377f26187] Going to try to terminate instance {{(pid=121001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:38:34.428405 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:38:34.476614 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ee463cbb-b63b-4654-a993-8823726fa07c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:34.483513 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ee463cbb-b63b-4654-a993-8823726fa07c tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1306 microversion: 2.1 time: 0.197536 Oct 27 03:38:34.484113 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1968/4186] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:34 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1306 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:38:34.499828 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9fd6c179-8689-49e4-9f4d-6593159fe7ce tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:34.505338 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9fd6c179-8689-49e4-9f4d-6593159fe7ce tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] [instance: e3b8bf04-529a-4909-9727-404cb7bba177] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:34.508010 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9fd6c179-8689-49e4-9f4d-6593159fe7ce tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:34.509076 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9fd6c179-8689-49e4-9f4d-6593159fe7ce tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:34.509185 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9fd6c179-8689-49e4-9f4d-6593159fe7ce tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:34.509850 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9fd6c179-8689-49e4-9f4d-6593159fe7ce tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:34.510450 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9fd6c179-8689-49e4-9f4d-6593159fe7ce tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:34.510886 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9fd6c179-8689-49e4-9f4d-6593159fe7ce tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:34.615091 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9fd6c179-8689-49e4-9f4d-6593159fe7ce tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51be346b3c5448c28ac57f5c1ffe50bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93732dbf56414de2b7667e1e70262a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:34.625027 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9fd6c179-8689-49e4-9f4d-6593159fe7ce tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51be346b3c5448c28ac57f5c1ffe50bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93732dbf56414de2b7667e1e70262a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:34.627089 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9fd6c179-8689-49e4-9f4d-6593159fe7ce tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51be346b3c5448c28ac57f5c1ffe50bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93732dbf56414de2b7667e1e70262a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:34.628147 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9fd6c179-8689-49e4-9f4d-6593159fe7ce tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] 10.222.0.20 "GET /compute/v2.1/servers/e3b8bf04-529a-4909-9727-404cb7bba177" status: 200 len: 1316 microversion: 2.21 time: 0.143074 Oct 27 03:38:34.628718 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1969/4187] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:38:34 2022] GET /compute/v2.1/servers/e3b8bf04-529a-4909-9727-404cb7bba177 => generated 1316 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:38:34.633235 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4e952f53-b942-4f07-9c31-8f2dd099ff33 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:34.633854 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4e952f53-b942-4f07-9c31-8f2dd099ff33 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: d963bc87-b838-431c-92c3-8f06dd7afba7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:34.642138 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4e952f53-b942-4f07-9c31-8f2dd099ff33 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:34.642979 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4e952f53-b942-4f07-9c31-8f2dd099ff33 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:34.643438 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4e952f53-b942-4f07-9c31-8f2dd099ff33 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:34.644254 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4e952f53-b942-4f07-9c31-8f2dd099ff33 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:34.654650 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4e952f53-b942-4f07-9c31-8f2dd099ff33 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:34.655582 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4e952f53-b942-4f07-9c31-8f2dd099ff33 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:34.732823 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1991943f-3b33-45f7-aee8-ba1159489356 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8184dc7a-d6db-4374-ace1-f26377f26187" status: 204 len: 0 microversion: 2.1 time: 0.408161 Oct 27 03:38:34.733425 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2219/4188] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:38:34 2022] DELETE /compute/v2.1/servers/8184dc7a-d6db-4374-ace1-f26377f26187 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 03:38:34.738743 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-a872cb11-0749-472d-be87-de1151f2fafc req-d3ce57f4-b520-4fb8-a82e-ab64a6724bfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "376ac459-e31f-4727-9e34-535f055ac20d", "name": "network-vif-deleted", "tag": "e825dd69-54a1-4411-addc-e78fd04434d2"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:38:34.749080 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-a872cb11-0749-472d-be87-de1151f2fafc req-d3ce57f4-b520-4fb8-a82e-ab64a6724bfa service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:34.749929 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-a872cb11-0749-472d-be87-de1151f2fafc req-d3ce57f4-b520-4fb8-a82e-ab64a6724bfa service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:34.750702 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-a872cb11-0749-472d-be87-de1151f2fafc req-d3ce57f4-b520-4fb8-a82e-ab64a6724bfa service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:34.765134 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-a872cb11-0749-472d-be87-de1151f2fafc req-d3ce57f4-b520-4fb8-a82e-ab64a6724bfa service nova] Creating event network-vif-deleted:e825dd69-54a1-4411-addc-e78fd04434d2 for instance 376ac459-e31f-4727-9e34-535f055ac20d on n-h1-862769-1 Oct 27 03:38:34.770870 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-a872cb11-0749-472d-be87-de1151f2fafc req-d3ce57f4-b520-4fb8-a82e-ab64a6724bfa service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036020 Oct 27 03:38:34.771861 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2220/4189] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:38:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:38:34.778176 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a4400718-0308-4d0a-a6fc-09ec1102971e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:34.778963 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a4400718-0308-4d0a-a6fc-09ec1102971e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: 8184dc7a-d6db-4374-ace1-f26377f26187] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:34.785766 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a4400718-0308-4d0a-a6fc-09ec1102971e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:34.786434 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a4400718-0308-4d0a-a6fc-09ec1102971e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:34.786947 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a4400718-0308-4d0a-a6fc-09ec1102971e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:34.787840 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a4400718-0308-4d0a-a6fc-09ec1102971e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:34.788391 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a4400718-0308-4d0a-a6fc-09ec1102971e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:34.788888 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a4400718-0308-4d0a-a6fc-09ec1102971e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:35.021789 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a4400718-0308-4d0a-a6fc-09ec1102971e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:35.030606 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a4400718-0308-4d0a-a6fc-09ec1102971e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/8184dc7a-d6db-4374-ace1-f26377f26187" status: 200 len: 1506 microversion: 2.1 time: 0.257359 Oct 27 03:38:35.031494 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2221/4190] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:34 2022] GET /compute/v2.1/servers/8184dc7a-d6db-4374-ace1-f26377f26187 => generated 1506 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:38:35.036783 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2e373083-fffa-42e4-8d09-4d4ed94cd283 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:35.037646 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2e373083-fffa-42e4-8d09-4d4ed94cd283 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 2ec095f2-c25e-434f-87ff-10788b0fe6c3] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:35.044914 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2e373083-fffa-42e4-8d09-4d4ed94cd283 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:35.046192 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2e373083-fffa-42e4-8d09-4d4ed94cd283 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:35.046936 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2e373083-fffa-42e4-8d09-4d4ed94cd283 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:35.047886 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2e373083-fffa-42e4-8d09-4d4ed94cd283 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:35.048887 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2e373083-fffa-42e4-8d09-4d4ed94cd283 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:35.049549 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2e373083-fffa-42e4-8d09-4d4ed94cd283 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:35.080351 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4e952f53-b942-4f07-9c31-8f2dd099ff33 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18036411a99e4634bfbaeae24b9f254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229dcb63bc41444391544883b576ce2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:35.093844 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4e952f53-b942-4f07-9c31-8f2dd099ff33 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/d963bc87-b838-431c-92c3-8f06dd7afba7" status: 200 len: 1682 microversion: 2.1 time: 0.462252 Oct 27 03:38:35.096577 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1970/4191] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:34 2022] GET /compute/v2.1/servers/d963bc87-b838-431c-92c3-8f06dd7afba7 => generated 1682 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:38:35.284016 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2e373083-fffa-42e4-8d09-4d4ed94cd283 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:35.287917 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d9891307-5fa7-4abe-9a47-ad00560941c9 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:35.288534 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d9891307-5fa7-4abe-9a47-ad00560941c9 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] [instance: 7e73d534-0a40-42d2-813c-2e9dbb9239ac] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:35.294665 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2e373083-fffa-42e4-8d09-4d4ed94cd283 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/2ec095f2-c25e-434f-87ff-10788b0fe6c3" status: 200 len: 1315 microversion: 2.1 time: 0.261755 Oct 27 03:38:35.295224 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2222/4192] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:35 2022] GET /compute/v2.1/servers/2ec095f2-c25e-434f-87ff-10788b0fe6c3 => generated 1315 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:38:35.295889 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d9891307-5fa7-4abe-9a47-ad00560941c9 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:35.296381 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d9891307-5fa7-4abe-9a47-ad00560941c9 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:35.296818 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d9891307-5fa7-4abe-9a47-ad00560941c9 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:35.297524 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d9891307-5fa7-4abe-9a47-ad00560941c9 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:35.297977 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d9891307-5fa7-4abe-9a47-ad00560941c9 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:35.306803 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d9891307-5fa7-4abe-9a47-ad00560941c9 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:35.521736 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1e448e5d-95fe-4caf-a36b-da81a83020c6 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:35.522618 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1e448e5d-95fe-4caf-a36b-da81a83020c6 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:35.545686 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1e448e5d-95fe-4caf-a36b-da81a83020c6 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:35.549170 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1e448e5d-95fe-4caf-a36b-da81a83020c6 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:35.550509 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1e448e5d-95fe-4caf-a36b-da81a83020c6 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:35.551283 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1e448e5d-95fe-4caf-a36b-da81a83020c6 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:35.551766 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1e448e5d-95fe-4caf-a36b-da81a83020c6 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:35.552210 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1e448e5d-95fe-4caf-a36b-da81a83020c6 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:35.639825 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1e448e5d-95fe-4caf-a36b-da81a83020c6 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:35.640570 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1e448e5d-95fe-4caf-a36b-da81a83020c6 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:35.642091 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1e448e5d-95fe-4caf-a36b-da81a83020c6 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:35.642806 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-1e448e5d-95fe-4caf-a36b-da81a83020c6 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lazy-loading 'fault' on Instance uuid 376ac459-e31f-4727-9e34-535f055ac20d {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:38:35.725101 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1e448e5d-95fe-4caf-a36b-da81a83020c6 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:35.735732 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1e448e5d-95fe-4caf-a36b-da81a83020c6 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1306 microversion: 2.1 time: 0.226713 Oct 27 03:38:35.756386 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2223/4193] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:35 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1306 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:38:35.769356 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-281c8f5e-ae10-409b-9b0d-517e06781857 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:35.770239 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-281c8f5e-ae10-409b-9b0d-517e06781857 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] [instance: e3b8bf04-529a-4909-9727-404cb7bba177] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:35.778551 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-281c8f5e-ae10-409b-9b0d-517e06781857 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:35.779237 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-281c8f5e-ae10-409b-9b0d-517e06781857 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:35.787058 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-281c8f5e-ae10-409b-9b0d-517e06781857 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:35.790951 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-281c8f5e-ae10-409b-9b0d-517e06781857 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:35.790951 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-281c8f5e-ae10-409b-9b0d-517e06781857 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:35.790951 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-281c8f5e-ae10-409b-9b0d-517e06781857 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:36.090669 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-281c8f5e-ae10-409b-9b0d-517e06781857 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51be346b3c5448c28ac57f5c1ffe50bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93732dbf56414de2b7667e1e70262a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:36.093046 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d9891307-5fa7-4abe-9a47-ad00560941c9 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:36.099418 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-281c8f5e-ae10-409b-9b0d-517e06781857 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51be346b3c5448c28ac57f5c1ffe50bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93732dbf56414de2b7667e1e70262a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:36.100881 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-281c8f5e-ae10-409b-9b0d-517e06781857 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51be346b3c5448c28ac57f5c1ffe50bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93732dbf56414de2b7667e1e70262a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:36.102064 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-281c8f5e-ae10-409b-9b0d-517e06781857 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] 10.222.0.20 "GET /compute/v2.1/servers/e3b8bf04-529a-4909-9727-404cb7bba177" status: 200 len: 1358 microversion: 2.21 time: 0.344490 Oct 27 03:38:36.102616 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d9891307-5fa7-4abe-9a47-ad00560941c9 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:36.102779 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2224/4194] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:38:35 2022] GET /compute/v2.1/servers/e3b8bf04-529a-4909-9727-404cb7bba177 => generated 1358 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:38:36.111117 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d9891307-5fa7-4abe-9a47-ad00560941c9 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:36.113007 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d9891307-5fa7-4abe-9a47-ad00560941c9 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] 10.222.0.20 "GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac" status: 200 len: 1879 microversion: 2.32 time: 0.829470 Oct 27 03:38:36.113556 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d170b65c-be6a-4893-b1af-03f49ab54ccc tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:36.113846 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1971/4195] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:38:35 2022] GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac => generated 1879 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:38:36.123131 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d170b65c-be6a-4893-b1af-03f49ab54ccc tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: 8184dc7a-d6db-4374-ace1-f26377f26187] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:36.128614 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c87600ca-63bb-4e88-b180-6a9b01bc4fe2 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:36.129539 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c87600ca-63bb-4e88-b180-6a9b01bc4fe2 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: d963bc87-b838-431c-92c3-8f06dd7afba7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:36.137918 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d170b65c-be6a-4893-b1af-03f49ab54ccc tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:36.138836 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d170b65c-be6a-4893-b1af-03f49ab54ccc tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:36.139449 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d170b65c-be6a-4893-b1af-03f49ab54ccc tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:36.141459 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d170b65c-be6a-4893-b1af-03f49ab54ccc tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:36.144584 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d170b65c-be6a-4893-b1af-03f49ab54ccc tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:36.145315 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d170b65c-be6a-4893-b1af-03f49ab54ccc tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:36.148067 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c87600ca-63bb-4e88-b180-6a9b01bc4fe2 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:36.148576 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c87600ca-63bb-4e88-b180-6a9b01bc4fe2 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:36.149060 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c87600ca-63bb-4e88-b180-6a9b01bc4fe2 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:36.149791 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c87600ca-63bb-4e88-b180-6a9b01bc4fe2 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:36.150289 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c87600ca-63bb-4e88-b180-6a9b01bc4fe2 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:36.150725 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c87600ca-63bb-4e88-b180-6a9b01bc4fe2 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:36.333448 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c87600ca-63bb-4e88-b180-6a9b01bc4fe2 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18036411a99e4634bfbaeae24b9f254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229dcb63bc41444391544883b576ce2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:36.342166 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c87600ca-63bb-4e88-b180-6a9b01bc4fe2 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/d963bc87-b838-431c-92c3-8f06dd7afba7" status: 200 len: 1614 microversion: 2.1 time: 0.217212 Oct 27 03:38:36.343436 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1972/4196] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:36 2022] GET /compute/v2.1/servers/d963bc87-b838-431c-92c3-8f06dd7afba7 => generated 1614 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:38:36.348379 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3c4b635d-c3a9-4a0d-86ee-e93bf8360b57 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:36.349287 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-3c4b635d-c3a9-4a0d-86ee-e93bf8360b57 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 2ec095f2-c25e-434f-87ff-10788b0fe6c3] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:36.357159 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3c4b635d-c3a9-4a0d-86ee-e93bf8360b57 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:36.357927 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3c4b635d-c3a9-4a0d-86ee-e93bf8360b57 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:36.365635 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3c4b635d-c3a9-4a0d-86ee-e93bf8360b57 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:36.365635 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3c4b635d-c3a9-4a0d-86ee-e93bf8360b57 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:36.365635 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3c4b635d-c3a9-4a0d-86ee-e93bf8360b57 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:36.365635 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3c4b635d-c3a9-4a0d-86ee-e93bf8360b57 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:36.740124 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d170b65c-be6a-4893-b1af-03f49ab54ccc tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:36.772433 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d170b65c-be6a-4893-b1af-03f49ab54ccc tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/8184dc7a-d6db-4374-ace1-f26377f26187" status: 200 len: 1506 microversion: 2.1 time: 0.660568 Oct 27 03:38:36.773134 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2225/4197] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:36 2022] GET /compute/v2.1/servers/8184dc7a-d6db-4374-ace1-f26377f26187 => generated 1506 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:38:36.781232 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-913c232f-9027-464d-8670-a4bf3b4c08e4 req-1f87168f-f4ca-47f2-a7e8-90f7d3ae11d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d963bc87-b838-431c-92c3-8f06dd7afba7", "name": "network-vif-deleted", "tag": "d76e2f68-c54b-49b5-8391-83058b2b1e64"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:38:36.803320 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-913c232f-9027-464d-8670-a4bf3b4c08e4 req-1f87168f-f4ca-47f2-a7e8-90f7d3ae11d3 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:36.803790 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-913c232f-9027-464d-8670-a4bf3b4c08e4 req-1f87168f-f4ca-47f2-a7e8-90f7d3ae11d3 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:36.810857 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-913c232f-9027-464d-8670-a4bf3b4c08e4 req-1f87168f-f4ca-47f2-a7e8-90f7d3ae11d3 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:36.859179 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-913c232f-9027-464d-8670-a4bf3b4c08e4 req-1f87168f-f4ca-47f2-a7e8-90f7d3ae11d3 service nova] Creating event network-vif-deleted:d76e2f68-c54b-49b5-8391-83058b2b1e64 for instance d963bc87-b838-431c-92c3-8f06dd7afba7 on n-h1-862769-1 Oct 27 03:38:36.866814 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-913c232f-9027-464d-8670-a4bf3b4c08e4 req-1f87168f-f4ca-47f2-a7e8-90f7d3ae11d3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091071 Oct 27 03:38:36.867955 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2226/4198] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:38:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:38:36.876016 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0dac5310-a093-4486-9806-60195e4d82db tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:36.877001 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0dac5310-a093-4486-9806-60195e4d82db tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:36.884759 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0dac5310-a093-4486-9806-60195e4d82db tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:36.886402 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0dac5310-a093-4486-9806-60195e4d82db tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:36.887075 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0dac5310-a093-4486-9806-60195e4d82db tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:36.887972 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0dac5310-a093-4486-9806-60195e4d82db tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:36.889049 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0dac5310-a093-4486-9806-60195e4d82db tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:36.889979 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0dac5310-a093-4486-9806-60195e4d82db tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:36.958302 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0dac5310-a093-4486-9806-60195e4d82db tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:36.959241 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0dac5310-a093-4486-9806-60195e4d82db tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:36.959863 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0dac5310-a093-4486-9806-60195e4d82db tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:36.960496 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-0dac5310-a093-4486-9806-60195e4d82db tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lazy-loading 'fault' on Instance uuid 376ac459-e31f-4727-9e34-535f055ac20d {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:38:37.037201 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0dac5310-a093-4486-9806-60195e4d82db tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c32b7626594ff888970c7f3227bb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb5d291069d4329a90123e327fe9c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:37.046257 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0dac5310-a093-4486-9806-60195e4d82db tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 200 len: 1306 microversion: 2.1 time: 0.176291 Oct 27 03:38:37.047449 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2227/4199] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:36 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 1306 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:38:37.134325 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d079f0db-fdde-442e-9364-5f3129fdc053 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:37.135024 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d079f0db-fdde-442e-9364-5f3129fdc053 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] [instance: e3b8bf04-529a-4909-9727-404cb7bba177] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:37.146739 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d079f0db-fdde-442e-9364-5f3129fdc053 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:37.146739 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d079f0db-fdde-442e-9364-5f3129fdc053 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:37.146739 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d079f0db-fdde-442e-9364-5f3129fdc053 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:37.147408 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d079f0db-fdde-442e-9364-5f3129fdc053 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:37.148063 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d079f0db-fdde-442e-9364-5f3129fdc053 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:37.148943 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d079f0db-fdde-442e-9364-5f3129fdc053 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:37.605118 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d079f0db-fdde-442e-9364-5f3129fdc053 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51be346b3c5448c28ac57f5c1ffe50bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93732dbf56414de2b7667e1e70262a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:37.614360 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d079f0db-fdde-442e-9364-5f3129fdc053 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51be346b3c5448c28ac57f5c1ffe50bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93732dbf56414de2b7667e1e70262a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:37.615846 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d079f0db-fdde-442e-9364-5f3129fdc053 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51be346b3c5448c28ac57f5c1ffe50bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93732dbf56414de2b7667e1e70262a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:37.616999 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d079f0db-fdde-442e-9364-5f3129fdc053 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] 10.222.0.20 "GET /compute/v2.1/servers/e3b8bf04-529a-4909-9727-404cb7bba177" status: 200 len: 1358 microversion: 2.21 time: 0.486727 Oct 27 03:38:37.634972 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2228/4200] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:38:37 2022] GET /compute/v2.1/servers/e3b8bf04-529a-4909-9727-404cb7bba177 => generated 1358 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:38:37.640061 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-bca4310d-766c-424e-bf01-09274b37f3cb tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:37.640952 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-bca4310d-766c-424e-bf01-09274b37f3cb tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] [instance: 7e73d534-0a40-42d2-813c-2e9dbb9239ac] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:37.647338 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-3c4b635d-c3a9-4a0d-86ee-e93bf8360b57 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:37.647982 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bca4310d-766c-424e-bf01-09274b37f3cb tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:37.648717 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bca4310d-766c-424e-bf01-09274b37f3cb tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:37.654726 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bca4310d-766c-424e-bf01-09274b37f3cb tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:37.654726 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bca4310d-766c-424e-bf01-09274b37f3cb tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:37.654726 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bca4310d-766c-424e-bf01-09274b37f3cb tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:37.654726 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bca4310d-766c-424e-bf01-09274b37f3cb tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:37.656441 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3c4b635d-c3a9-4a0d-86ee-e93bf8360b57 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/2ec095f2-c25e-434f-87ff-10788b0fe6c3" status: 200 len: 1315 microversion: 2.1 time: 1.311677 Oct 27 03:38:37.657292 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1973/4201] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:36 2022] GET /compute/v2.1/servers/2ec095f2-c25e-434f-87ff-10788b0fe6c3 => generated 1315 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:38:37.663637 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2dcc762e-cbfb-4683-97b1-79c42f3a8123 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:37.664583 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-2dcc762e-cbfb-4683-97b1-79c42f3a8123 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: d963bc87-b838-431c-92c3-8f06dd7afba7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:37.672274 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2dcc762e-cbfb-4683-97b1-79c42f3a8123 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:37.673189 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2dcc762e-cbfb-4683-97b1-79c42f3a8123 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:37.673806 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2dcc762e-cbfb-4683-97b1-79c42f3a8123 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:37.674734 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2dcc762e-cbfb-4683-97b1-79c42f3a8123 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:37.675365 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2dcc762e-cbfb-4683-97b1-79c42f3a8123 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:37.681880 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2dcc762e-cbfb-4683-97b1-79c42f3a8123 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:37.722126 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2dcc762e-cbfb-4683-97b1-79c42f3a8123 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:37.722528 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2dcc762e-cbfb-4683-97b1-79c42f3a8123 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:37.723192 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2dcc762e-cbfb-4683-97b1-79c42f3a8123 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:37.724442 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-2dcc762e-cbfb-4683-97b1-79c42f3a8123 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lazy-loading 'fault' on Instance uuid d963bc87-b838-431c-92c3-8f06dd7afba7 {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:38:37.887682 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2dcc762e-cbfb-4683-97b1-79c42f3a8123 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18036411a99e4634bfbaeae24b9f254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229dcb63bc41444391544883b576ce2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:37.897615 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2dcc762e-cbfb-4683-97b1-79c42f3a8123 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/d963bc87-b838-431c-92c3-8f06dd7afba7" status: 200 len: 1332 microversion: 2.1 time: 0.238750 Oct 27 03:38:37.898938 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1974/4202] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:37 2022] GET /compute/v2.1/servers/d963bc87-b838-431c-92c3-8f06dd7afba7 => generated 1332 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:38:37.905408 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a5a06564-c000-4388-a2e8-95071a18908e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:37.909222 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a5a06564-c000-4388-a2e8-95071a18908e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: 8184dc7a-d6db-4374-ace1-f26377f26187] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:37.918981 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a5a06564-c000-4388-a2e8-95071a18908e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:37.919714 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a5a06564-c000-4388-a2e8-95071a18908e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:37.920483 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a5a06564-c000-4388-a2e8-95071a18908e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:37.921450 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a5a06564-c000-4388-a2e8-95071a18908e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:37.923303 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a5a06564-c000-4388-a2e8-95071a18908e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:37.923934 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a5a06564-c000-4388-a2e8-95071a18908e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:38.053335 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-bca4310d-766c-424e-bf01-09274b37f3cb tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:38.065964 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-bca4310d-766c-424e-bf01-09274b37f3cb tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:38.073016 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-bca4310d-766c-424e-bf01-09274b37f3cb tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:38.074293 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-bca4310d-766c-424e-bf01-09274b37f3cb tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] 10.222.0.20 "GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac" status: 200 len: 1879 microversion: 2.32 time: 0.438271 Oct 27 03:38:38.079022 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2229/4203] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:38:37 2022] GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac => generated 1879 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:38:38.095042 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b321ad74-804f-4eac-b17c-8677a79a85b9 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:38.095672 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b321ad74-804f-4eac-b17c-8677a79a85b9 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] [instance: 376ac459-e31f-4727-9e34-535f055ac20d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:38.102430 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b321ad74-804f-4eac-b17c-8677a79a85b9 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:38.102969 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b321ad74-804f-4eac-b17c-8677a79a85b9 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:38.103462 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b321ad74-804f-4eac-b17c-8677a79a85b9 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:38.104737 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b321ad74-804f-4eac-b17c-8677a79a85b9 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:38.105202 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b321ad74-804f-4eac-b17c-8677a79a85b9 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:38.105635 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b321ad74-804f-4eac-b17c-8677a79a85b9 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:38.139637 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-b321ad74-804f-4eac-b17c-8677a79a85b9 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] HTTP exception thrown: Instance 376ac459-e31f-4727-9e34-535f055ac20d could not be found. Oct 27 03:38:38.141395 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b321ad74-804f-4eac-b17c-8677a79a85b9 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Request method failure captured: Oct 27 03:38:38.141395 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d HTTP/1.1 Oct 27 03:38:38.141395 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:38:38.141395 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:38:38.141395 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:38:38.141395 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:38:38.141395 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:38:38.141395 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:38:38.141395 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:38:38.141395 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:38:38.141395 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfxF6ut9nM9a9AcpKLO7IgCu-akAJ2YJGjrI9C8NUveA8uObV2XgQIQvsIxuWjvLl9meIEqpfGwZYr8MTX_PAGoiJsNUPXh5ERSce5cPYQYCCFPL0HtTb-E11C_2kfWy1wRps1tClRNvtj8zAqCGRhs1x-Uvl0zISdfHepXmvWX31Us Oct 27 03:38:38.141395 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:38:38.141395 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:38:38.141395 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:38:38.141395 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:38:38.141395 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:38:38.141395 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:38:38.141395 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 8bb5d291069d4329a90123e327fe9c59 Oct 27 03:38:38.141395 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:38:38.141395 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:38:38.141395 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:38:38.141395 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8bb5d291069d4329a90123e327fe9c59"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8bb5d291069d4329a90123e327fe9c59"}]}] Oct 27 03:38:38.141395 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:38:38.141395 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 8bb5d291069d4329a90123e327fe9c59 Oct 27 03:38:38.141395 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServersNegativeTestJSON-4378389 Oct 27 03:38:38.141395 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServersNegativeTestJSON-4378389-project Oct 27 03:38:38.141395 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:38:38.141395 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:38:38.141395 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: f9c32b7626594ff888970c7f3227bb20 Oct 27 03:38:38.141395 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServersNegativeTestJSON-4378389-project Oct 27 03:38:38.141395 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:38:38.141395 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 376ac459-e31f-4727-9e34-535f055ac20d could not be found. Oct 27 03:38:38.141395 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '376ac459-e31f-4727-9e34-535f055ac20d'} Oct 27 03:38:38.141395 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:38:38.141395 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:38:38.141395 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:38:38.141395 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:38:38.141395 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:38:38.141395 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:38:38.141395 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:38:38.141395 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:38:38.141395 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:38:38.141395 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:38:38.141395 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 376ac459-e31f-4727-9e34-535f055ac20d could not be found. Oct 27 03:38:38.141395 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:38:38.141395 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:38:38.141395 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:38:38.141395 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:38:38.141395 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:38:38.141395 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:38:38.141395 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:38:38.141395 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:38:38.141395 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:38:38.141395 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:38:38.141395 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:38:38.141395 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:38:38.141395 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:38:38.141395 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:38:38.141395 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:38:38.141395 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:38:38.141395 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 376ac459-e31f-4727-9e34-535f055ac20d could not be found. Oct 27 03:38:38.141395 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:38:38.141395 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:38:38.141395 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:38:38.148519 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:38:38.148519 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:38:38.148519 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:38:38.148519 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:38:38.148519 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:38:38.148519 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 376ac459-e31f-4727-9e34-535f055ac20d could not be found. Oct 27 03:38:38.148519 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:38:38.148519 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b321ad74-804f-4eac-b17c-8677a79a85b9 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] Returning 404 to user: Instance 376ac459-e31f-4727-9e34-535f055ac20d could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:38:38.148519 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b321ad74-804f-4eac-b17c-8677a79a85b9 tempest-ServersNegativeTestJSON-4378389 tempest-ServersNegativeTestJSON-4378389-project] 10.222.0.20 "GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d" status: 404 len: 111 microversion: 2.1 time: 0.066059 Oct 27 03:38:38.148519 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2230/4204] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:38 2022] GET /compute/v2.1/servers/376ac459-e31f-4727-9e34-535f055ac20d => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:38:38.176525 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:38:38.223551 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=14 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:38:38.340366 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-a575f880-1d0c-4c40-978b-b8cb188915fe req-3fe83ce9-1f71-44db-afcc-0f68295f1062 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ec095f2-c25e-434f-87ff-10788b0fe6c3", "name": "network-vif-plugged", "status": "completed", "tag": "5c64c2e5-5026-4fce-99fc-27a5bf039bb7"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:38:38.352455 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-a575f880-1d0c-4c40-978b-b8cb188915fe req-3fe83ce9-1f71-44db-afcc-0f68295f1062 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:38.352947 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-a575f880-1d0c-4c40-978b-b8cb188915fe req-3fe83ce9-1f71-44db-afcc-0f68295f1062 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:38.353606 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-a575f880-1d0c-4c40-978b-b8cb188915fe req-3fe83ce9-1f71-44db-afcc-0f68295f1062 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:38.365709 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-a575f880-1d0c-4c40-978b-b8cb188915fe req-3fe83ce9-1f71-44db-afcc-0f68295f1062 service nova] Creating event network-vif-plugged:5c64c2e5-5026-4fce-99fc-27a5bf039bb7 for instance 2ec095f2-c25e-434f-87ff-10788b0fe6c3 on n-h1-862769-1 Oct 27 03:38:38.371322 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-a575f880-1d0c-4c40-978b-b8cb188915fe req-3fe83ce9-1f71-44db-afcc-0f68295f1062 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038546 Oct 27 03:38:38.375107 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2231/4205] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:38:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:38:38.568492 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a5a06564-c000-4388-a2e8-95071a18908e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:38.581620 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a5a06564-c000-4388-a2e8-95071a18908e tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/8184dc7a-d6db-4374-ace1-f26377f26187" status: 200 len: 1506 microversion: 2.1 time: 0.681026 Oct 27 03:38:38.584039 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1975/4206] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:37 2022] GET /compute/v2.1/servers/8184dc7a-d6db-4374-ace1-f26377f26187 => generated 1506 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:38:38.647501 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-717fa51b-9327-4c36-ad6e-92bcb0f1154b tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:38.648480 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-717fa51b-9327-4c36-ad6e-92bcb0f1154b tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] [instance: e3b8bf04-529a-4909-9727-404cb7bba177] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:38.663523 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-717fa51b-9327-4c36-ad6e-92bcb0f1154b tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:38.668159 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-717fa51b-9327-4c36-ad6e-92bcb0f1154b tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:38.668847 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-717fa51b-9327-4c36-ad6e-92bcb0f1154b tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:38.673216 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-717fa51b-9327-4c36-ad6e-92bcb0f1154b tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:38.673934 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-717fa51b-9327-4c36-ad6e-92bcb0f1154b tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:38.674608 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-717fa51b-9327-4c36-ad6e-92bcb0f1154b tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:38.684284 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-534e8f30-7115-4500-84a1-31a1621a2e25 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:38.685615 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-534e8f30-7115-4500-84a1-31a1621a2e25 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 2ec095f2-c25e-434f-87ff-10788b0fe6c3] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:38.695290 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-534e8f30-7115-4500-84a1-31a1621a2e25 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:38.696445 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-534e8f30-7115-4500-84a1-31a1621a2e25 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:38.697070 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-534e8f30-7115-4500-84a1-31a1621a2e25 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:38.698505 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-534e8f30-7115-4500-84a1-31a1621a2e25 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:38.699369 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-534e8f30-7115-4500-84a1-31a1621a2e25 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:38.700508 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-534e8f30-7115-4500-84a1-31a1621a2e25 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:39.099011 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-717fa51b-9327-4c36-ad6e-92bcb0f1154b tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51be346b3c5448c28ac57f5c1ffe50bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93732dbf56414de2b7667e1e70262a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:39.112272 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-717fa51b-9327-4c36-ad6e-92bcb0f1154b tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51be346b3c5448c28ac57f5c1ffe50bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93732dbf56414de2b7667e1e70262a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:39.130281 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-717fa51b-9327-4c36-ad6e-92bcb0f1154b tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51be346b3c5448c28ac57f5c1ffe50bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93732dbf56414de2b7667e1e70262a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:39.131736 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-717fa51b-9327-4c36-ad6e-92bcb0f1154b tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] 10.222.0.20 "GET /compute/v2.1/servers/e3b8bf04-529a-4909-9727-404cb7bba177" status: 200 len: 1358 microversion: 2.21 time: 0.492244 Oct 27 03:38:39.132885 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2232/4207] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:38:38 2022] GET /compute/v2.1/servers/e3b8bf04-529a-4909-9727-404cb7bba177 => generated 1358 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:38:39.146648 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6b863b05-4442-4fa4-9710-b836c1d5106e tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1063751939", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "2c331e5b-12cc-4654-b641-c734728a18ef"}], "security_groups": [{"name": "tempest-securitygroup--1973707120"}], "key_name": "tempest-keypair-682006599", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:38:39.355729 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.network.neutron [None req-6b863b05-4442-4fa4-9710-b836c1d5106e tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] validate_networks() for [('2c331e5b-12cc-4654-b641-c734728a18ef', None, None, None, None, None)] {{(pid=121001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:38:39.426848 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-534e8f30-7115-4500-84a1-31a1621a2e25 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:39.448861 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=100 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:38:39.476383 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-534e8f30-7115-4500-84a1-31a1621a2e25 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/2ec095f2-c25e-434f-87ff-10788b0fe6c3" status: 200 len: 1315 microversion: 2.1 time: 0.796882 Oct 27 03:38:39.483680 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1976/4208] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:38 2022] GET /compute/v2.1/servers/2ec095f2-c25e-434f-87ff-10788b0fe6c3 => generated 1315 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:38:39.500262 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-45692ab6-0e56-493e-bf5c-460857fab923 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:39.500940 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-45692ab6-0e56-493e-bf5c-460857fab923 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: d963bc87-b838-431c-92c3-8f06dd7afba7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:39.510278 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-45692ab6-0e56-493e-bf5c-460857fab923 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:39.511323 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-45692ab6-0e56-493e-bf5c-460857fab923 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:39.511754 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-45692ab6-0e56-493e-bf5c-460857fab923 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:39.512668 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-45692ab6-0e56-493e-bf5c-460857fab923 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:39.513343 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-45692ab6-0e56-493e-bf5c-460857fab923 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:39.513939 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-45692ab6-0e56-493e-bf5c-460857fab923 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:39.529873 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-45692ab6-0e56-493e-bf5c-460857fab923 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] HTTP exception thrown: Instance d963bc87-b838-431c-92c3-8f06dd7afba7 could not be found. Oct 27 03:38:39.531564 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-45692ab6-0e56-493e-bf5c-460857fab923 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Request method failure captured: Oct 27 03:38:39.531564 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/d963bc87-b838-431c-92c3-8f06dd7afba7 HTTP/1.1 Oct 27 03:38:39.531564 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:38:39.531564 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:38:39.531564 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:38:39.531564 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:38:39.531564 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:38:39.531564 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:38:39.531564 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:38:39.531564 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:38:39.531564 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfyO20A1D6ympGjQc2k7pGwXBVoOs4AtFX551niq39NWe_HjifvxGvre6cHeeNp8osa7J1PNEE0_yy7-MG05YNEONXkGtR3-F0Zb6-60FxqOiIpeJ5N_dbXBRWjEl88UsCCW068A90fytHXWgtrGlYksZomXGQlrDugSxyxjlY4_NPY Oct 27 03:38:39.531564 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:38:39.531564 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:38:39.531564 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:38:39.531564 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:38:39.531564 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:38:39.531564 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:38:39.531564 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 229dcb63bc41444391544883b576ce2e Oct 27 03:38:39.531564 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-AttachVolumeNegativeTest-199004901 Oct 27 03:38:39.531564 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:38:39.531564 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:38:39.531564 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/229dcb63bc41444391544883b576ce2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/229dcb63bc41444391544883b576ce2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/229dcb63bc41444391544883b576ce2e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_229dcb63bc41444391544883b576ce2e"}]}] Oct 27 03:38:39.531564 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-AttachVolumeNegativeTest-199004901 Oct 27 03:38:39.531564 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 229dcb63bc41444391544883b576ce2e Oct 27 03:38:39.531564 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-199004901 Oct 27 03:38:39.531564 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-AttachVolumeNegativeTest-199004901-project Oct 27 03:38:39.531564 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:38:39.531564 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:38:39.531564 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 18036411a99e4634bfbaeae24b9f254d Oct 27 03:38:39.531564 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-AttachVolumeNegativeTest-199004901-project Oct 27 03:38:39.531564 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:38:39.531564 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance d963bc87-b838-431c-92c3-8f06dd7afba7 could not be found. Oct 27 03:38:39.531564 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': 'd963bc87-b838-431c-92c3-8f06dd7afba7'} Oct 27 03:38:39.531564 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:38:39.531564 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:38:39.531564 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:38:39.531564 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:38:39.531564 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:38:39.531564 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:38:39.531564 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:38:39.531564 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:38:39.531564 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:38:39.531564 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:38:39.531564 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d963bc87-b838-431c-92c3-8f06dd7afba7 could not be found. Oct 27 03:38:39.531564 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:38:39.531564 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:38:39.531564 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:38:39.531564 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:38:39.531564 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:38:39.531564 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:38:39.531564 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:38:39.531564 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:38:39.531564 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:38:39.531564 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:38:39.531564 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:38:39.531564 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:38:39.531564 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:38:39.531564 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:38:39.531564 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:38:39.531564 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:38:39.531564 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d963bc87-b838-431c-92c3-8f06dd7afba7 could not be found. Oct 27 03:38:39.531564 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:38:39.531564 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:38:39.531564 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:38:39.544249 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:38:39.544249 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:38:39.544249 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:38:39.544249 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:38:39.544249 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:38:39.544249 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d963bc87-b838-431c-92c3-8f06dd7afba7 could not be found. Oct 27 03:38:39.544249 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:38:39.544249 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-45692ab6-0e56-493e-bf5c-460857fab923 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Returning 404 to user: Instance d963bc87-b838-431c-92c3-8f06dd7afba7 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:38:39.544249 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-45692ab6-0e56-493e-bf5c-460857fab923 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/d963bc87-b838-431c-92c3-8f06dd7afba7" status: 404 len: 111 microversion: 2.1 time: 0.048027 Oct 27 03:38:39.544249 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1977/4209] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:39 2022] GET /compute/v2.1/servers/d963bc87-b838-431c-92c3-8f06dd7afba7 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:38:39.546491 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-19980709-892f-41bf-bae3-c700a7867066 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:39.546491 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-19980709-892f-41bf-bae3-c700a7867066 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] [instance: 7e73d534-0a40-42d2-813c-2e9dbb9239ac] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:39.553080 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-19980709-892f-41bf-bae3-c700a7867066 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:39.553636 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-19980709-892f-41bf-bae3-c700a7867066 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:39.554140 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-19980709-892f-41bf-bae3-c700a7867066 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:39.554872 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-19980709-892f-41bf-bae3-c700a7867066 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:39.555331 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-19980709-892f-41bf-bae3-c700a7867066 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:39.555758 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-19980709-892f-41bf-bae3-c700a7867066 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:40.106861 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-6b863b05-4442-4fa4-9710-b836c1d5106e tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Getting quotas for project 4840257127594149b03c0aa3ab94b486. Resources: dict_keys(['metadata_items']) {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:38:40.114446 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-6b863b05-4442-4fa4-9710-b836c1d5106e tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Getting quotas for user 3e8e0bc10d3f451c8837c1f1e4d86eaa and project 4840257127594149b03c0aa3ab94b486. Resources: dict_keys(['metadata_items']) {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:38:40.125291 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:38:40.130027 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-6b863b05-4442-4fa4-9710-b836c1d5106e tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Flavor limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:38:40.130544 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-6b863b05-4442-4fa4-9710-b836c1d5106e tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Image limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:38:40.131042 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-6b863b05-4442-4fa4-9710-b836c1d5106e tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Flavor pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:38:40.131463 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-6b863b05-4442-4fa4-9710-b836c1d5106e tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Image pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:38:40.131986 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-6b863b05-4442-4fa4-9710-b836c1d5106e tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:38:40.141593 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6b863b05-4442-4fa4-9710-b836c1d5106e tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:40.142129 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6b863b05-4442-4fa4-9710-b836c1d5106e tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:40.142587 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6b863b05-4442-4fa4-9710-b836c1d5106e tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:40.143383 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6b863b05-4442-4fa4-9710-b836c1d5106e tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:40.155149 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6b863b05-4442-4fa4-9710-b836c1d5106e tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:40.155149 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6b863b05-4442-4fa4-9710-b836c1d5106e tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:40.166061 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-6b863b05-4442-4fa4-9710-b836c1d5106e tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Getting quotas for project 4840257127594149b03c0aa3ab94b486. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:38:40.173095 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-6b863b05-4442-4fa4-9710-b836c1d5106e tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Getting quotas for user 3e8e0bc10d3f451c8837c1f1e4d86eaa and project 4840257127594149b03c0aa3ab94b486. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:38:40.204202 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-6b863b05-4442-4fa4-9710-b836c1d5106e tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Going to run 1 instances... {{(pid=121001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:38:40.207011 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-6b863b05-4442-4fa4-9710-b836c1d5106e tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] [instance: a5b04eee-69d9-4e2e-ac89-47cac8cdc538] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:38:40.225406 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-19980709-892f-41bf-bae3-c700a7867066 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:40.240478 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-19980709-892f-41bf-bae3-c700a7867066 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:40.241929 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-19980709-892f-41bf-bae3-c700a7867066 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:40.243155 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-19980709-892f-41bf-bae3-c700a7867066 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] 10.222.0.20 "GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac" status: 200 len: 1879 microversion: 2.32 time: 0.708704 Oct 27 03:38:40.243727 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1978/4210] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:38:39 2022] GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac => generated 1879 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:38:40.259205 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d5025e36-4859-46ce-a104-334884c9443b tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '.version_select at 0x7f7dd9c1b1f0>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:40.357787 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d5025e36-4859-46ce-a104-334884c9443b tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1572205689" status: 202 len: 0 microversion: 2.1 time: 0.109289 Oct 27 03:38:40.358417 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1979/4211] 10.222.0.20 () {58 vars in 1221 bytes} [Thu Oct 27 03:38:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1572205689 => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:38:40.364134 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-bcf3ec70-3e61-4c5f-a922-b8d566e02c96 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:40.372763 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-bcf3ec70-3e61-4c5f-a922-b8d566e02c96 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: 8184dc7a-d6db-4374-ace1-f26377f26187] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:40.380472 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bcf3ec70-3e61-4c5f-a922-b8d566e02c96 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:40.381213 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bcf3ec70-3e61-4c5f-a922-b8d566e02c96 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:40.381852 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bcf3ec70-3e61-4c5f-a922-b8d566e02c96 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:40.383344 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bcf3ec70-3e61-4c5f-a922-b8d566e02c96 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:40.383989 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bcf3ec70-3e61-4c5f-a922-b8d566e02c96 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:40.384756 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bcf3ec70-3e61-4c5f-a922-b8d566e02c96 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:40.460540 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6b863b05-4442-4fa4-9710-b836c1d5106e tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.321036 Oct 27 03:38:40.461586 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2233/4212] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:38:39 2022] POST /compute/v2.1/servers => generated 407 bytes in 1328 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 03:38:40.472715 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-fd181bcb-15a8-4dd9-8e55-b14aa257321c req-16acaec8-03d5-42cd-b1a5-f62e96f1a8b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8184dc7a-d6db-4374-ace1-f26377f26187", "name": "network-vif-deleted", "tag": "a77a3d1b-554a-4133-b6bc-00f0b2a88101"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:38:40.536273 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-fd181bcb-15a8-4dd9-8e55-b14aa257321c req-16acaec8-03d5-42cd-b1a5-f62e96f1a8b3 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:40.537049 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-fd181bcb-15a8-4dd9-8e55-b14aa257321c req-16acaec8-03d5-42cd-b1a5-f62e96f1a8b3 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:40.539925 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-fd181bcb-15a8-4dd9-8e55-b14aa257321c req-16acaec8-03d5-42cd-b1a5-f62e96f1a8b3 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:40.566895 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-fd181bcb-15a8-4dd9-8e55-b14aa257321c req-16acaec8-03d5-42cd-b1a5-f62e96f1a8b3 service nova] Creating event network-vif-deleted:a77a3d1b-554a-4133-b6bc-00f0b2a88101 for instance 8184dc7a-d6db-4374-ace1-f26377f26187 on n-h1-862769-1 Oct 27 03:38:40.594633 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-fd181bcb-15a8-4dd9-8e55-b14aa257321c req-16acaec8-03d5-42cd-b1a5-f62e96f1a8b3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122841 Oct 27 03:38:40.594808 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-bcf3ec70-3e61-4c5f-a922-b8d566e02c96 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:40.596062 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2234/4213] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:38:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:38:40.604510 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4ccca54f-156c-4c8f-b2f9-dd7c85739aad tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:40.605471 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4ccca54f-156c-4c8f-b2f9-dd7c85739aad tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] [instance: e3b8bf04-529a-4909-9727-404cb7bba177] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:40.613120 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-bcf3ec70-3e61-4c5f-a922-b8d566e02c96 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/8184dc7a-d6db-4374-ace1-f26377f26187" status: 200 len: 1299 microversion: 2.1 time: 0.248000 Oct 27 03:38:40.616790 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1980/4214] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:40 2022] GET /compute/v2.1/servers/8184dc7a-d6db-4374-ace1-f26377f26187 => generated 1299 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:38:40.621978 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4ccca54f-156c-4c8f-b2f9-dd7c85739aad tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:40.621978 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4ccca54f-156c-4c8f-b2f9-dd7c85739aad tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:40.621978 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4ccca54f-156c-4c8f-b2f9-dd7c85739aad tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:40.623506 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4ccca54f-156c-4c8f-b2f9-dd7c85739aad tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:40.624438 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4ccca54f-156c-4c8f-b2f9-dd7c85739aad tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:40.625087 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4ccca54f-156c-4c8f-b2f9-dd7c85739aad tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:40.642677 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-9b0ae568-84f7-40ea-be5a-aaab2b1d81ac req-596bc9b4-e4bf-43e4-afbc-4b926e8eca90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8184dc7a-d6db-4374-ace1-f26377f26187", "name": "network-vif-unplugged", "status": "completed", "tag": "a77a3d1b-554a-4133-b6bc-00f0b2a88101"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:38:40.681449 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-9b0ae568-84f7-40ea-be5a-aaab2b1d81ac req-596bc9b4-e4bf-43e4-afbc-4b926e8eca90 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:40.683903 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-9b0ae568-84f7-40ea-be5a-aaab2b1d81ac req-596bc9b4-e4bf-43e4-afbc-4b926e8eca90 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:40.684632 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-9b0ae568-84f7-40ea-be5a-aaab2b1d81ac req-596bc9b4-e4bf-43e4-afbc-4b926e8eca90 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:40.723800 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-9b0ae568-84f7-40ea-be5a-aaab2b1d81ac req-596bc9b4-e4bf-43e4-afbc-4b926e8eca90 service nova] Creating event network-vif-unplugged:a77a3d1b-554a-4133-b6bc-00f0b2a88101 for instance 8184dc7a-d6db-4374-ace1-f26377f26187 on n-h1-862769-1 Oct 27 03:38:40.735957 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-9b0ae568-84f7-40ea-be5a-aaab2b1d81ac req-596bc9b4-e4bf-43e4-afbc-4b926e8eca90 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.117531 Oct 27 03:38:40.740118 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1981/4215] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:38:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:38:40.748395 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-bca938a8-dbff-43b2-95e0-ed7f23cce206 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:40.755703 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-bca938a8-dbff-43b2-95e0-ed7f23cce206 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] [instance: a5b04eee-69d9-4e2e-ac89-47cac8cdc538] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:40.902083 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-bca938a8-dbff-43b2-95e0-ed7f23cce206 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8e0bc10d3f451c8837c1f1e4d86eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4840257127594149b03c0aa3ab94b486', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:40.911423 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-bca938a8-dbff-43b2-95e0-ed7f23cce206 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] 10.222.0.20 "GET /compute/v2.1/servers/a5b04eee-69d9-4e2e-ac89-47cac8cdc538" status: 200 len: 1269 microversion: 2.1 time: 0.169665 Oct 27 03:38:40.915153 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1982/4216] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:40 2022] GET /compute/v2.1/servers/a5b04eee-69d9-4e2e-ac89-47cac8cdc538 => generated 1269 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:38:40.943785 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-246d054c-0891-4696-82e3-699d4c99e131 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:40.956093 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-246d054c-0891-4696-82e3-699d4c99e131 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 2ec095f2-c25e-434f-87ff-10788b0fe6c3] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:40.958311 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4ccca54f-156c-4c8f-b2f9-dd7c85739aad tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51be346b3c5448c28ac57f5c1ffe50bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93732dbf56414de2b7667e1e70262a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:40.969678 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4ccca54f-156c-4c8f-b2f9-dd7c85739aad tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51be346b3c5448c28ac57f5c1ffe50bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93732dbf56414de2b7667e1e70262a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:40.973169 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4ccca54f-156c-4c8f-b2f9-dd7c85739aad tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51be346b3c5448c28ac57f5c1ffe50bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93732dbf56414de2b7667e1e70262a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:40.977385 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-246d054c-0891-4696-82e3-699d4c99e131 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:40.981806 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4ccca54f-156c-4c8f-b2f9-dd7c85739aad tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] 10.222.0.20 "GET /compute/v2.1/servers/e3b8bf04-529a-4909-9727-404cb7bba177" status: 200 len: 1358 microversion: 2.21 time: 0.381400 Oct 27 03:38:40.982008 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-246d054c-0891-4696-82e3-699d4c99e131 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:40.982614 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-246d054c-0891-4696-82e3-699d4c99e131 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:40.983415 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-246d054c-0891-4696-82e3-699d4c99e131 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:40.983562 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2235/4217] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:38:40 2022] GET /compute/v2.1/servers/e3b8bf04-529a-4909-9727-404cb7bba177 => generated 1358 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:38:40.989302 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-246d054c-0891-4696-82e3-699d4c99e131 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:40.989302 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-246d054c-0891-4696-82e3-699d4c99e131 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:41.274557 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ca6c946d-8319-441f-83b5-4929ff00236a tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:41.275974 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ca6c946d-8319-441f-83b5-4929ff00236a tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] [instance: 7e73d534-0a40-42d2-813c-2e9dbb9239ac] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:41.283277 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ca6c946d-8319-441f-83b5-4929ff00236a tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:41.294812 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ca6c946d-8319-441f-83b5-4929ff00236a tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:41.295277 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ca6c946d-8319-441f-83b5-4929ff00236a tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:41.296269 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ca6c946d-8319-441f-83b5-4929ff00236a tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:41.297481 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ca6c946d-8319-441f-83b5-4929ff00236a tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:41.297941 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ca6c946d-8319-441f-83b5-4929ff00236a tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:41.330689 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-246d054c-0891-4696-82e3-699d4c99e131 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:41.342939 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-246d054c-0891-4696-82e3-699d4c99e131 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/2ec095f2-c25e-434f-87ff-10788b0fe6c3" status: 200 len: 1503 microversion: 2.1 time: 0.407243 Oct 27 03:38:41.345263 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1983/4218] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:40 2022] GET /compute/v2.1/servers/2ec095f2-c25e-434f-87ff-10788b0fe6c3 => generated 1503 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:38:41.648466 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9a9c799c-25b7-47a6-9b7b-551d71872bdc tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:41.649375 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9a9c799c-25b7-47a6-9b7b-551d71872bdc tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: 8184dc7a-d6db-4374-ace1-f26377f26187] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:41.663060 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9a9c799c-25b7-47a6-9b7b-551d71872bdc tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:41.663835 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9a9c799c-25b7-47a6-9b7b-551d71872bdc tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:41.664481 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9a9c799c-25b7-47a6-9b7b-551d71872bdc tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:41.665241 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9a9c799c-25b7-47a6-9b7b-551d71872bdc tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:41.665712 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9a9c799c-25b7-47a6-9b7b-551d71872bdc tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:41.666251 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9a9c799c-25b7-47a6-9b7b-551d71872bdc tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:41.707836 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9a9c799c-25b7-47a6-9b7b-551d71872bdc tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:41.708336 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9a9c799c-25b7-47a6-9b7b-551d71872bdc tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:41.708873 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9a9c799c-25b7-47a6-9b7b-551d71872bdc tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:41.709393 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-9a9c799c-25b7-47a6-9b7b-551d71872bdc tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lazy-loading 'fault' on Instance uuid 8184dc7a-d6db-4374-ace1-f26377f26187 {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:38:41.799666 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9a9c799c-25b7-47a6-9b7b-551d71872bdc tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:41.808715 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9a9c799c-25b7-47a6-9b7b-551d71872bdc tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/8184dc7a-d6db-4374-ace1-f26377f26187" status: 200 len: 1304 microversion: 2.1 time: 0.168335 Oct 27 03:38:41.826103 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1984/4219] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:41 2022] GET /compute/v2.1/servers/8184dc7a-d6db-4374-ace1-f26377f26187 => generated 1304 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:38:41.943263 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-212502af-d6a7-4dd4-866f-e86552216b9a tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:41.943925 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-212502af-d6a7-4dd4-866f-e86552216b9a tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] [instance: a5b04eee-69d9-4e2e-ac89-47cac8cdc538] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:42.057166 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-212502af-d6a7-4dd4-866f-e86552216b9a tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8e0bc10d3f451c8837c1f1e4d86eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4840257127594149b03c0aa3ab94b486', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:42.068480 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-212502af-d6a7-4dd4-866f-e86552216b9a tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] 10.222.0.20 "GET /compute/v2.1/servers/a5b04eee-69d9-4e2e-ac89-47cac8cdc538" status: 200 len: 1269 microversion: 2.1 time: 0.130049 Oct 27 03:38:42.069613 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1985/4220] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:41 2022] GET /compute/v2.1/servers/a5b04eee-69d9-4e2e-ac89-47cac8cdc538 => generated 1269 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:38:42.080096 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-533c329e-4624-4fab-a156-a5d85fd1ce06 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:42.081132 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-533c329e-4624-4fab-a156-a5d85fd1ce06 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] [instance: e3b8bf04-529a-4909-9727-404cb7bba177] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:42.089449 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-533c329e-4624-4fab-a156-a5d85fd1ce06 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:42.090438 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-533c329e-4624-4fab-a156-a5d85fd1ce06 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:42.091093 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-533c329e-4624-4fab-a156-a5d85fd1ce06 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:42.092040 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-533c329e-4624-4fab-a156-a5d85fd1ce06 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:42.092730 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-533c329e-4624-4fab-a156-a5d85fd1ce06 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:42.093518 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-533c329e-4624-4fab-a156-a5d85fd1ce06 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:42.302707 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ca6c946d-8319-441f-83b5-4929ff00236a tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:42.320859 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ca6c946d-8319-441f-83b5-4929ff00236a tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:42.329079 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ca6c946d-8319-441f-83b5-4929ff00236a tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:42.335310 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ca6c946d-8319-441f-83b5-4929ff00236a tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] 10.222.0.20 "GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac" status: 200 len: 1879 microversion: 2.32 time: 1.060419 Oct 27 03:38:42.366625 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2236/4221] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:38:41 2022] GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac => generated 1879 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:38:42.620435 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-7bdc3e83-23b9-4556-94db-697ed2a9d9eb req-42dd26ee-af07-4b19-8459-4365cbf221a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3b8bf04-529a-4909-9727-404cb7bba177", "tag": "beb1dd89-3e2f-4a8d-9259-11e4d9b00116"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:38:42.639850 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-7bdc3e83-23b9-4556-94db-697ed2a9d9eb req-42dd26ee-af07-4b19-8459-4365cbf221a7 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:42.640343 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-7bdc3e83-23b9-4556-94db-697ed2a9d9eb req-42dd26ee-af07-4b19-8459-4365cbf221a7 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:42.640780 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-7bdc3e83-23b9-4556-94db-697ed2a9d9eb req-42dd26ee-af07-4b19-8459-4365cbf221a7 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:42.654712 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-7bdc3e83-23b9-4556-94db-697ed2a9d9eb req-42dd26ee-af07-4b19-8459-4365cbf221a7 service nova] Creating event network-changed:beb1dd89-3e2f-4a8d-9259-11e4d9b00116 for instance e3b8bf04-529a-4909-9727-404cb7bba177 on n-h2-862769-1 Oct 27 03:38:42.660308 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-7bdc3e83-23b9-4556-94db-697ed2a9d9eb req-42dd26ee-af07-4b19-8459-4365cbf221a7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044060 Oct 27 03:38:42.661415 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2237/4222] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:38:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:38:42.700314 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-533c329e-4624-4fab-a156-a5d85fd1ce06 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51be346b3c5448c28ac57f5c1ffe50bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93732dbf56414de2b7667e1e70262a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:42.712153 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-533c329e-4624-4fab-a156-a5d85fd1ce06 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51be346b3c5448c28ac57f5c1ffe50bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93732dbf56414de2b7667e1e70262a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:42.714450 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-533c329e-4624-4fab-a156-a5d85fd1ce06 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51be346b3c5448c28ac57f5c1ffe50bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93732dbf56414de2b7667e1e70262a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:42.715838 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-533c329e-4624-4fab-a156-a5d85fd1ce06 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] 10.222.0.20 "GET /compute/v2.1/servers/e3b8bf04-529a-4909-9727-404cb7bba177" status: 200 len: 1358 microversion: 2.21 time: 0.644903 Oct 27 03:38:42.716422 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1986/4223] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:38:42 2022] GET /compute/v2.1/servers/e3b8bf04-529a-4909-9727-404cb7bba177 => generated 1358 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:38:42.833093 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-36ab3b05-c6d6-4ba9-a36b-cc7ecab66aea tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:42.833720 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-36ab3b05-c6d6-4ba9-a36b-cc7ecab66aea tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: 8184dc7a-d6db-4374-ace1-f26377f26187] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:42.834022 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b6c9bf74-37b7-42be-bebd-b1ebf8c1f259 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:42.834858 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b6c9bf74-37b7-42be-bebd-b1ebf8c1f259 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: c5c50ae8-6217-4650-8420-291847e21ace] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:42.842204 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-36ab3b05-c6d6-4ba9-a36b-cc7ecab66aea tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:42.842935 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-36ab3b05-c6d6-4ba9-a36b-cc7ecab66aea tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:42.843536 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b6c9bf74-37b7-42be-bebd-b1ebf8c1f259 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:42.844250 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b6c9bf74-37b7-42be-bebd-b1ebf8c1f259 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:42.844426 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-36ab3b05-c6d6-4ba9-a36b-cc7ecab66aea tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:42.844712 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b6c9bf74-37b7-42be-bebd-b1ebf8c1f259 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:42.845457 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b6c9bf74-37b7-42be-bebd-b1ebf8c1f259 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:42.845698 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-36ab3b05-c6d6-4ba9-a36b-cc7ecab66aea tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:42.845968 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b6c9bf74-37b7-42be-bebd-b1ebf8c1f259 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:42.846427 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b6c9bf74-37b7-42be-bebd-b1ebf8c1f259 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:42.850133 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-36ab3b05-c6d6-4ba9-a36b-cc7ecab66aea tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:42.850133 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-36ab3b05-c6d6-4ba9-a36b-cc7ecab66aea tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:42.864532 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-36ab3b05-c6d6-4ba9-a36b-cc7ecab66aea tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] HTTP exception thrown: Instance 8184dc7a-d6db-4374-ace1-f26377f26187 could not be found. Oct 27 03:38:42.866790 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-36ab3b05-c6d6-4ba9-a36b-cc7ecab66aea tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Request method failure captured: Oct 27 03:38:42.866790 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/8184dc7a-d6db-4374-ace1-f26377f26187 HTTP/1.1 Oct 27 03:38:42.866790 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:38:42.866790 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:38:42.866790 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:38:42.866790 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:38:42.866790 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:38:42.866790 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:38:42.866790 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:38:42.866790 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:38:42.866790 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfsa_BAeMB3RnYvkmJQwjLzdAXRwOtmdTc4q-U2TyHH4sY2pC7-yKXDlPkKgdlBzGRlepw8PNzs2kNd86HTPJPZkHZ4DJy78RLBBzCNtKZaBrkpRAbSZW5Gv7329yxsJiAdDbJaiPVC-uHRtJPx_KALbDnjOM5yyEW86DSYN-HLC8ok Oct 27 03:38:42.866790 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:38:42.866790 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:38:42.866790 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:38:42.866790 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:38:42.866790 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:38:42.866790 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:38:42.866790 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 3e9ede68f63747d59153a46412033856 Oct 27 03:38:42.866790 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ServerActionsTestJSON-24656121 Oct 27 03:38:42.866790 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:38:42.866790 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:38:42.866790 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3e9ede68f63747d59153a46412033856"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3e9ede68f63747d59153a46412033856"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3e9ede68f63747d59153a46412033856"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3e9ede68f63747d59153a46412033856"}]}] Oct 27 03:38:42.866790 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ServerActionsTestJSON-24656121 Oct 27 03:38:42.866790 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 3e9ede68f63747d59153a46412033856 Oct 27 03:38:42.866790 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ServerActionsTestJSON-24656121 Oct 27 03:38:42.866790 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ServerActionsTestJSON-24656121-project Oct 27 03:38:42.866790 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:38:42.866790 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:38:42.866790 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 94897f20beb94dbd8e7eff6ecba30026 Oct 27 03:38:42.866790 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ServerActionsTestJSON-24656121-project Oct 27 03:38:42.866790 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:38:42.866790 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 8184dc7a-d6db-4374-ace1-f26377f26187 could not be found. Oct 27 03:38:42.866790 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '8184dc7a-d6db-4374-ace1-f26377f26187'} Oct 27 03:38:42.866790 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:38:42.866790 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:38:42.866790 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:38:42.866790 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:38:42.866790 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:38:42.866790 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:38:42.866790 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:38:42.866790 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:38:42.866790 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:38:42.866790 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:38:42.866790 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8184dc7a-d6db-4374-ace1-f26377f26187 could not be found. Oct 27 03:38:42.866790 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:38:42.866790 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:38:42.866790 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:38:42.866790 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:38:42.866790 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:38:42.866790 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:38:42.866790 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:38:42.866790 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:38:42.866790 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:38:42.866790 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:38:42.866790 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:38:42.866790 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:38:42.866790 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:38:42.866790 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:38:42.866790 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:38:42.866790 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:38:42.866790 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8184dc7a-d6db-4374-ace1-f26377f26187 could not be found. Oct 27 03:38:42.866790 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:38:42.866790 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:38:42.866790 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:38:42.872382 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:38:42.872382 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:38:42.872382 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:38:42.872382 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:38:42.872382 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:38:42.872382 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8184dc7a-d6db-4374-ace1-f26377f26187 could not be found. Oct 27 03:38:42.872382 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:38:42.873646 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-36ab3b05-c6d6-4ba9-a36b-cc7ecab66aea tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Returning 404 to user: Instance 8184dc7a-d6db-4374-ace1-f26377f26187 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:38:42.874725 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-36ab3b05-c6d6-4ba9-a36b-cc7ecab66aea tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/8184dc7a-d6db-4374-ace1-f26377f26187" status: 404 len: 111 microversion: 2.1 time: 0.046453 Oct 27 03:38:42.875973 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1987/4224] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:42 2022] GET /compute/v2.1/servers/8184dc7a-d6db-4374-ace1-f26377f26187 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:38:42.888719 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d37e994c-c3a3-47b5-9e53-ccb96a3be9b0 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:42.890945 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d37e994c-c3a3-47b5-9e53-ccb96a3be9b0 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: d70ad817-aab3-419c-85ab-b458bb9d8d26] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:42.897450 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d37e994c-c3a3-47b5-9e53-ccb96a3be9b0 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:42.898861 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d37e994c-c3a3-47b5-9e53-ccb96a3be9b0 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:42.899485 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d37e994c-c3a3-47b5-9e53-ccb96a3be9b0 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:42.900401 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d37e994c-c3a3-47b5-9e53-ccb96a3be9b0 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:42.902294 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d37e994c-c3a3-47b5-9e53-ccb96a3be9b0 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:42.902919 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d37e994c-c3a3-47b5-9e53-ccb96a3be9b0 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:42.935584 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d37e994c-c3a3-47b5-9e53-ccb96a3be9b0 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: d70ad817-aab3-419c-85ab-b458bb9d8d26] Going to try to terminate instance {{(pid=121000) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:38:43.038203 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-b6c9bf74-37b7-42be-bebd-b1ebf8c1f259 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lazy-loading 'services' on Instance uuid c5c50ae8-6217-4650-8420-291847e21ace {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:38:43.246598 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=97,nova_cell1:INSERT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:38:43.270960 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d37e994c-c3a3-47b5-9e53-ccb96a3be9b0 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d70ad817-aab3-419c-85ab-b458bb9d8d26" status: 204 len: 0 microversion: 2.1 time: 0.386365 Oct 27 03:38:43.274171 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1988/4225] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:38:42 2022] DELETE /compute/v2.1/servers/d70ad817-aab3-419c-85ab-b458bb9d8d26 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:38:43.281195 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-65d65418-a3e3-44fb-a5da-bb97093a0be6 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:43.282293 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-65d65418-a3e3-44fb-a5da-bb97093a0be6 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] [instance: a5b04eee-69d9-4e2e-ac89-47cac8cdc538] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:43.290497 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-65d65418-a3e3-44fb-a5da-bb97093a0be6 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:43.291232 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-65d65418-a3e3-44fb-a5da-bb97093a0be6 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:43.292083 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-65d65418-a3e3-44fb-a5da-bb97093a0be6 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:43.292907 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-65d65418-a3e3-44fb-a5da-bb97093a0be6 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:43.293656 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-65d65418-a3e3-44fb-a5da-bb97093a0be6 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:43.294455 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-65d65418-a3e3-44fb-a5da-bb97093a0be6 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:43.374813 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b6c9bf74-37b7-42be-bebd-b1ebf8c1f259 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c5c50ae8-6217-4650-8420-291847e21ace/os-volume_attachments/72e75738-cb91-475f-a857-1aba96e97efe" status: 202 len: 0 microversion: 2.1 time: 0.545519 Oct 27 03:38:43.380825 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2238/4226] 10.222.0.20 () {58 vars in 1416 bytes} [Thu Oct 27 03:38:42 2022] DELETE /compute/v2.1/servers/c5c50ae8-6217-4650-8420-291847e21ace/os-volume_attachments/72e75738-cb91-475f-a857-1aba96e97efe => generated 0 bytes in 555 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:38:43.397588 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ce339651-c433-4148-921b-2abfd43f3801 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:43.401298 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ce339651-c433-4148-921b-2abfd43f3801 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: d70ad817-aab3-419c-85ab-b458bb9d8d26] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:43.412835 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ce339651-c433-4148-921b-2abfd43f3801 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:43.413778 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ce339651-c433-4148-921b-2abfd43f3801 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:43.414516 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ce339651-c433-4148-921b-2abfd43f3801 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:43.415721 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ce339651-c433-4148-921b-2abfd43f3801 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:43.416839 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ce339651-c433-4148-921b-2abfd43f3801 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:43.417844 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ce339651-c433-4148-921b-2abfd43f3801 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:43.420760 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-65d65418-a3e3-44fb-a5da-bb97093a0be6 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8e0bc10d3f451c8837c1f1e4d86eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4840257127594149b03c0aa3ab94b486', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:43.451177 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-65d65418-a3e3-44fb-a5da-bb97093a0be6 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] 10.222.0.20 "GET /compute/v2.1/servers/a5b04eee-69d9-4e2e-ac89-47cac8cdc538" status: 200 len: 1321 microversion: 2.1 time: 0.175325 Oct 27 03:38:43.454260 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1989/4227] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:43 2022] GET /compute/v2.1/servers/a5b04eee-69d9-4e2e-ac89-47cac8cdc538 => generated 1321 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:38:43.475695 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f0c36739-a043-4ada-abef-90a3dbb34a86 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:43.476582 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f0c36739-a043-4ada-abef-90a3dbb34a86 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] [instance: 7e73d534-0a40-42d2-813c-2e9dbb9239ac] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:43.498025 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f0c36739-a043-4ada-abef-90a3dbb34a86 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:43.498552 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f0c36739-a043-4ada-abef-90a3dbb34a86 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:43.500681 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f0c36739-a043-4ada-abef-90a3dbb34a86 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:43.505646 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f0c36739-a043-4ada-abef-90a3dbb34a86 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:43.506170 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f0c36739-a043-4ada-abef-90a3dbb34a86 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:43.506621 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f0c36739-a043-4ada-abef-90a3dbb34a86 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:43.862063 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ce339651-c433-4148-921b-2abfd43f3801 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:43.880022 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ce339651-c433-4148-921b-2abfd43f3801 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/d70ad817-aab3-419c-85ab-b458bb9d8d26" status: 200 len: 1495 microversion: 2.1 time: 0.497053 Oct 27 03:38:43.902549 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2239/4228] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:43 2022] GET /compute/v2.1/servers/d70ad817-aab3-419c-85ab-b458bb9d8d26 => generated 1495 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:38:43.908350 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3a1761fc-8580-46ed-9fe0-7d13c81be651 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:43.911472 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3a1761fc-8580-46ed-9fe0-7d13c81be651 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: c5c50ae8-6217-4650-8420-291847e21ace] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:43.919634 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3a1761fc-8580-46ed-9fe0-7d13c81be651 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:43.920365 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3a1761fc-8580-46ed-9fe0-7d13c81be651 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:43.921061 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3a1761fc-8580-46ed-9fe0-7d13c81be651 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:43.922169 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3a1761fc-8580-46ed-9fe0-7d13c81be651 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:43.922856 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3a1761fc-8580-46ed-9fe0-7d13c81be651 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:43.923651 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3a1761fc-8580-46ed-9fe0-7d13c81be651 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:44.004443 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3a1761fc-8580-46ed-9fe0-7d13c81be651 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/c5c50ae8-6217-4650-8420-291847e21ace/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.100355 Oct 27 03:38:44.005675 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2240/4229] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 27 03:38:43 2022] GET /compute/v2.1/servers/c5c50ae8-6217-4650-8420-291847e21ace/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:38:44.010736 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-270ea044-6412-4bfd-9511-6d304540907f tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:44.011464 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-270ea044-6412-4bfd-9511-6d304540907f tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] [instance: e3b8bf04-529a-4909-9727-404cb7bba177] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:44.017715 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-270ea044-6412-4bfd-9511-6d304540907f tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:44.018663 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-270ea044-6412-4bfd-9511-6d304540907f tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:44.019363 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-270ea044-6412-4bfd-9511-6d304540907f tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:44.020316 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-270ea044-6412-4bfd-9511-6d304540907f tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:44.021047 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-270ea044-6412-4bfd-9511-6d304540907f tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:44.022366 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-270ea044-6412-4bfd-9511-6d304540907f tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:44.111077 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f0c36739-a043-4ada-abef-90a3dbb34a86 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:44.131597 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f0c36739-a043-4ada-abef-90a3dbb34a86 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:44.149196 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f0c36739-a043-4ada-abef-90a3dbb34a86 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:44.151769 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f0c36739-a043-4ada-abef-90a3dbb34a86 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] 10.222.0.20 "GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac" status: 200 len: 1879 microversion: 2.32 time: 0.688196 Oct 27 03:38:44.152869 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1990/4230] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:38:43 2022] GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac => generated 1879 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:38:44.352507 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-270ea044-6412-4bfd-9511-6d304540907f tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51be346b3c5448c28ac57f5c1ffe50bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93732dbf56414de2b7667e1e70262a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:44.372046 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-270ea044-6412-4bfd-9511-6d304540907f tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51be346b3c5448c28ac57f5c1ffe50bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93732dbf56414de2b7667e1e70262a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:44.375670 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-270ea044-6412-4bfd-9511-6d304540907f tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51be346b3c5448c28ac57f5c1ffe50bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93732dbf56414de2b7667e1e70262a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:44.377644 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-270ea044-6412-4bfd-9511-6d304540907f tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] 10.222.0.20 "GET /compute/v2.1/servers/e3b8bf04-529a-4909-9727-404cb7bba177" status: 200 len: 1358 microversion: 2.21 time: 0.370549 Oct 27 03:38:44.378862 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2241/4231] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:38:44 2022] GET /compute/v2.1/servers/e3b8bf04-529a-4909-9727-404cb7bba177 => generated 1358 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:38:44.583615 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-bc1a731b-4038-4769-a2b9-8aa82f5d3d2e tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:44.583615 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-bc1a731b-4038-4769-a2b9-8aa82f5d3d2e tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] [instance: a5b04eee-69d9-4e2e-ac89-47cac8cdc538] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:44.583615 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bc1a731b-4038-4769-a2b9-8aa82f5d3d2e tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:44.583615 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bc1a731b-4038-4769-a2b9-8aa82f5d3d2e tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:44.583615 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bc1a731b-4038-4769-a2b9-8aa82f5d3d2e tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:44.583615 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bc1a731b-4038-4769-a2b9-8aa82f5d3d2e tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:44.583615 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bc1a731b-4038-4769-a2b9-8aa82f5d3d2e tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:44.583615 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bc1a731b-4038-4769-a2b9-8aa82f5d3d2e tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:44.583615 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-bc1a731b-4038-4769-a2b9-8aa82f5d3d2e tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8e0bc10d3f451c8837c1f1e4d86eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4840257127594149b03c0aa3ab94b486', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:44.612044 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-bc1a731b-4038-4769-a2b9-8aa82f5d3d2e tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] 10.222.0.20 "GET /compute/v2.1/servers/a5b04eee-69d9-4e2e-ac89-47cac8cdc538" status: 200 len: 1329 microversion: 2.1 time: 0.138049 Oct 27 03:38:44.614218 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1991/4232] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:44 2022] GET /compute/v2.1/servers/a5b04eee-69d9-4e2e-ac89-47cac8cdc538 => generated 1329 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:38:44.671609 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c4eed531-5759-457e-a91a-78b55d60a506 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "83264c6b-2ea8-4e20-a232-5eb849321d3e"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:38:44.674103 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c4eed531-5759-457e-a91a-78b55d60a506 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 2ec095f2-c25e-434f-87ff-10788b0fe6c3] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:44.680954 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c4eed531-5759-457e-a91a-78b55d60a506 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:44.681458 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c4eed531-5759-457e-a91a-78b55d60a506 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:44.682641 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c4eed531-5759-457e-a91a-78b55d60a506 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:44.683587 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c4eed531-5759-457e-a91a-78b55d60a506 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:44.684220 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c4eed531-5759-457e-a91a-78b55d60a506 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:44.684826 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c4eed531-5759-457e-a91a-78b55d60a506 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:44.908819 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a70556c1-3b0f-4fc3-8d0b-07e3bcd762c6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:44.909444 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a70556c1-3b0f-4fc3-8d0b-07e3bcd762c6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: d70ad817-aab3-419c-85ab-b458bb9d8d26] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:44.916771 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a70556c1-3b0f-4fc3-8d0b-07e3bcd762c6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:44.924280 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a70556c1-3b0f-4fc3-8d0b-07e3bcd762c6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:44.929592 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a70556c1-3b0f-4fc3-8d0b-07e3bcd762c6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:44.929592 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a70556c1-3b0f-4fc3-8d0b-07e3bcd762c6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:44.929592 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a70556c1-3b0f-4fc3-8d0b-07e3bcd762c6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:44.929592 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a70556c1-3b0f-4fc3-8d0b-07e3bcd762c6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:45.400719 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a70556c1-3b0f-4fc3-8d0b-07e3bcd762c6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:45.414480 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a70556c1-3b0f-4fc3-8d0b-07e3bcd762c6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/d70ad817-aab3-419c-85ab-b458bb9d8d26" status: 200 len: 1453 microversion: 2.1 time: 0.506554 Oct 27 03:38:45.416761 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1992/4233] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:44 2022] GET /compute/v2.1/servers/d70ad817-aab3-419c-85ab-b458bb9d8d26 => generated 1453 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:38:45.424181 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b75d7daf-afe6-47a7-a26b-c46cd3830687 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:45.426995 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b75d7daf-afe6-47a7-a26b-c46cd3830687 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: c5c50ae8-6217-4650-8420-291847e21ace] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:45.451616 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b75d7daf-afe6-47a7-a26b-c46cd3830687 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:45.454138 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b75d7daf-afe6-47a7-a26b-c46cd3830687 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:45.454831 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b75d7daf-afe6-47a7-a26b-c46cd3830687 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:45.457496 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b75d7daf-afe6-47a7-a26b-c46cd3830687 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:45.460916 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b75d7daf-afe6-47a7-a26b-c46cd3830687 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:45.462164 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b75d7daf-afe6-47a7-a26b-c46cd3830687 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:45.518845 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b75d7daf-afe6-47a7-a26b-c46cd3830687 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/c5c50ae8-6217-4650-8420-291847e21ace/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099803 Oct 27 03:38:45.520028 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1993/4234] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 27 03:38:45 2022] GET /compute/v2.1/servers/c5c50ae8-6217-4650-8420-291847e21ace/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:38:45.528822 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-ef32759c-9515-4a54-99dd-a6ecb73b71e3 req-b07d9483-0a6b-408a-85d9-68e8a8a96bf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d70ad817-aab3-419c-85ab-b458bb9d8d26", "name": "network-vif-deleted", "tag": "c70fed81-8427-44e7-9315-905828e6c445"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:38:45.588403 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-ef32759c-9515-4a54-99dd-a6ecb73b71e3 req-b07d9483-0a6b-408a-85d9-68e8a8a96bf2 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:45.589160 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-ef32759c-9515-4a54-99dd-a6ecb73b71e3 req-b07d9483-0a6b-408a-85d9-68e8a8a96bf2 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:45.591315 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-ef32759c-9515-4a54-99dd-a6ecb73b71e3 req-b07d9483-0a6b-408a-85d9-68e8a8a96bf2 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:45.626936 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-ef32759c-9515-4a54-99dd-a6ecb73b71e3 req-b07d9483-0a6b-408a-85d9-68e8a8a96bf2 service nova] Creating event network-vif-deleted:c70fed81-8427-44e7-9315-905828e6c445 for instance d70ad817-aab3-419c-85ab-b458bb9d8d26 on n-h2-862769-1 Oct 27 03:38:45.641911 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-ef32759c-9515-4a54-99dd-a6ecb73b71e3 req-b07d9483-0a6b-408a-85d9-68e8a8a96bf2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120471 Oct 27 03:38:45.642559 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1994/4235] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:38:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:38:45.649100 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-067c5649-0a26-4ae3-9567-b15541d6ec5b tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:45.649807 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-067c5649-0a26-4ae3-9567-b15541d6ec5b tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] [instance: 7e73d534-0a40-42d2-813c-2e9dbb9239ac] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:45.656280 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-067c5649-0a26-4ae3-9567-b15541d6ec5b tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:45.656771 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-067c5649-0a26-4ae3-9567-b15541d6ec5b tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:45.657207 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-067c5649-0a26-4ae3-9567-b15541d6ec5b tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:45.657903 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-067c5649-0a26-4ae3-9567-b15541d6ec5b tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:45.658413 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-067c5649-0a26-4ae3-9567-b15541d6ec5b tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:45.658835 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-067c5649-0a26-4ae3-9567-b15541d6ec5b tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:45.768277 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c4eed531-5759-457e-a91a-78b55d60a506 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "POST /compute/v2.1/servers/2ec095f2-c25e-434f-87ff-10788b0fe6c3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.101049 Oct 27 03:38:45.770490 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2242/4236] 10.222.0.20 () {60 vars in 1323 bytes} [Thu Oct 27 03:38:44 2022] POST /compute/v2.1/servers/2ec095f2-c25e-434f-87ff-10788b0fe6c3/os-volume_attachments => generated 194 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:38:45.785432 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-087e1afc-885c-4b8d-89f5-bdf803db2059 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:45.786856 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-087e1afc-885c-4b8d-89f5-bdf803db2059 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] [instance: e3b8bf04-529a-4909-9727-404cb7bba177] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:45.808816 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-087e1afc-885c-4b8d-89f5-bdf803db2059 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:45.810788 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-087e1afc-885c-4b8d-89f5-bdf803db2059 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:45.812415 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-087e1afc-885c-4b8d-89f5-bdf803db2059 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:45.817554 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-087e1afc-885c-4b8d-89f5-bdf803db2059 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:45.819129 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-087e1afc-885c-4b8d-89f5-bdf803db2059 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:45.820522 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-087e1afc-885c-4b8d-89f5-bdf803db2059 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:46.147241 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-087e1afc-885c-4b8d-89f5-bdf803db2059 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51be346b3c5448c28ac57f5c1ffe50bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93732dbf56414de2b7667e1e70262a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:46.163287 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-087e1afc-885c-4b8d-89f5-bdf803db2059 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51be346b3c5448c28ac57f5c1ffe50bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93732dbf56414de2b7667e1e70262a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:46.169968 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-087e1afc-885c-4b8d-89f5-bdf803db2059 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51be346b3c5448c28ac57f5c1ffe50bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93732dbf56414de2b7667e1e70262a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:46.175622 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-087e1afc-885c-4b8d-89f5-bdf803db2059 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] 10.222.0.20 "GET /compute/v2.1/servers/e3b8bf04-529a-4909-9727-404cb7bba177" status: 200 len: 1358 microversion: 2.21 time: 0.403458 Oct 27 03:38:46.176410 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2243/4237] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:38:45 2022] GET /compute/v2.1/servers/e3b8bf04-529a-4909-9727-404cb7bba177 => generated 1358 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:38:46.186414 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-bb426e23-cde5-4b93-91ed-5b9b3143833e tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:46.188236 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-bb426e23-cde5-4b93-91ed-5b9b3143833e tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] [instance: a5b04eee-69d9-4e2e-ac89-47cac8cdc538] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:46.231842 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bb426e23-cde5-4b93-91ed-5b9b3143833e tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:46.235724 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bb426e23-cde5-4b93-91ed-5b9b3143833e tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:46.237217 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bb426e23-cde5-4b93-91ed-5b9b3143833e tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:46.238279 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bb426e23-cde5-4b93-91ed-5b9b3143833e tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:46.241255 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bb426e23-cde5-4b93-91ed-5b9b3143833e tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:46.242146 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bb426e23-cde5-4b93-91ed-5b9b3143833e tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:46.320118 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-067c5649-0a26-4ae3-9567-b15541d6ec5b tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:46.336851 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-067c5649-0a26-4ae3-9567-b15541d6ec5b tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:46.358277 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-067c5649-0a26-4ae3-9567-b15541d6ec5b tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:46.366519 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-067c5649-0a26-4ae3-9567-b15541d6ec5b tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] 10.222.0.20 "GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac" status: 200 len: 1879 microversion: 2.32 time: 0.716743 Oct 27 03:38:46.375696 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1995/4238] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:38:45 2022] GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac => generated 1879 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:38:46.448379 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-85cdacaf-bdde-4563-9891-31c74e65255d tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:46.449310 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-85cdacaf-bdde-4563-9891-31c74e65255d tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: d70ad817-aab3-419c-85ab-b458bb9d8d26] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:46.459604 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-85cdacaf-bdde-4563-9891-31c74e65255d tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:46.462332 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-85cdacaf-bdde-4563-9891-31c74e65255d tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:46.462901 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-85cdacaf-bdde-4563-9891-31c74e65255d tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:46.465288 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-85cdacaf-bdde-4563-9891-31c74e65255d tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:46.467528 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-85cdacaf-bdde-4563-9891-31c74e65255d tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:46.468251 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-85cdacaf-bdde-4563-9891-31c74e65255d tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:46.553718 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-bb426e23-cde5-4b93-91ed-5b9b3143833e tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8e0bc10d3f451c8837c1f1e4d86eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4840257127594149b03c0aa3ab94b486', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:46.568138 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-bb426e23-cde5-4b93-91ed-5b9b3143833e tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] 10.222.0.20 "GET /compute/v2.1/servers/a5b04eee-69d9-4e2e-ac89-47cac8cdc538" status: 200 len: 1395 microversion: 2.1 time: 0.390401 Oct 27 03:38:46.575105 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2244/4239] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:46 2022] GET /compute/v2.1/servers/a5b04eee-69d9-4e2e-ac89-47cac8cdc538 => generated 1395 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:38:46.576444 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:38:46.580626 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4901a533-0ce3-40d8-9f1e-8fc8aab51e34 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:46.588504 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4901a533-0ce3-40d8-9f1e-8fc8aab51e34 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: c5c50ae8-6217-4650-8420-291847e21ace] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:46.591269 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-85cdacaf-bdde-4563-9891-31c74e65255d tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:46.592497 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-85cdacaf-bdde-4563-9891-31c74e65255d tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:46.597576 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-85cdacaf-bdde-4563-9891-31c74e65255d tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:46.597576 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-85cdacaf-bdde-4563-9891-31c74e65255d tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lazy-loading 'fault' on Instance uuid d70ad817-aab3-419c-85ab-b458bb9d8d26 {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:38:46.612761 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4901a533-0ce3-40d8-9f1e-8fc8aab51e34 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:46.613946 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4901a533-0ce3-40d8-9f1e-8fc8aab51e34 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:46.614432 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4901a533-0ce3-40d8-9f1e-8fc8aab51e34 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:46.615171 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4901a533-0ce3-40d8-9f1e-8fc8aab51e34 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:46.615637 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4901a533-0ce3-40d8-9f1e-8fc8aab51e34 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:46.616069 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4901a533-0ce3-40d8-9f1e-8fc8aab51e34 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:46.678236 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4901a533-0ce3-40d8-9f1e-8fc8aab51e34 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/c5c50ae8-6217-4650-8420-291847e21ace/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.101486 Oct 27 03:38:46.687151 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2245/4240] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 27 03:38:46 2022] GET /compute/v2.1/servers/c5c50ae8-6217-4650-8420-291847e21ace/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:38:46.734984 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-85cdacaf-bdde-4563-9891-31c74e65255d tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:46.745434 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:38:46.755621 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-85cdacaf-bdde-4563-9891-31c74e65255d tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/d70ad817-aab3-419c-85ab-b458bb9d8d26" status: 200 len: 1305 microversion: 2.1 time: 0.317414 Oct 27 03:38:46.762008 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1996/4241] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:46 2022] GET /compute/v2.1/servers/d70ad817-aab3-419c-85ab-b458bb9d8d26 => generated 1305 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:38:47.208685 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b99168dc-f109-404a-b50b-6d66ae9a9cc3 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:47.209455 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b99168dc-f109-404a-b50b-6d66ae9a9cc3 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] [instance: e3b8bf04-529a-4909-9727-404cb7bba177] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:47.222717 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b99168dc-f109-404a-b50b-6d66ae9a9cc3 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:47.222717 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b99168dc-f109-404a-b50b-6d66ae9a9cc3 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:47.222717 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b99168dc-f109-404a-b50b-6d66ae9a9cc3 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:47.222717 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b99168dc-f109-404a-b50b-6d66ae9a9cc3 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:47.222717 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b99168dc-f109-404a-b50b-6d66ae9a9cc3 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:47.224285 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b99168dc-f109-404a-b50b-6d66ae9a9cc3 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:47.403374 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b99168dc-f109-404a-b50b-6d66ae9a9cc3 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51be346b3c5448c28ac57f5c1ffe50bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93732dbf56414de2b7667e1e70262a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:47.410903 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-65f218ed-75bd-420a-94ae-40adad58e70c tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:47.411831 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-65f218ed-75bd-420a-94ae-40adad58e70c tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] [instance: 7e73d534-0a40-42d2-813c-2e9dbb9239ac] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:47.429258 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b99168dc-f109-404a-b50b-6d66ae9a9cc3 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51be346b3c5448c28ac57f5c1ffe50bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93732dbf56414de2b7667e1e70262a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:47.435817 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b99168dc-f109-404a-b50b-6d66ae9a9cc3 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51be346b3c5448c28ac57f5c1ffe50bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93732dbf56414de2b7667e1e70262a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:47.436374 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-65f218ed-75bd-420a-94ae-40adad58e70c tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:47.437518 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-65f218ed-75bd-420a-94ae-40adad58e70c tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:47.438061 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-65f218ed-75bd-420a-94ae-40adad58e70c tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:47.438885 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b99168dc-f109-404a-b50b-6d66ae9a9cc3 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] 10.222.0.20 "GET /compute/v2.1/servers/e3b8bf04-529a-4909-9727-404cb7bba177" status: 200 len: 1358 microversion: 2.21 time: 0.236431 Oct 27 03:38:47.439768 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-65f218ed-75bd-420a-94ae-40adad58e70c tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:47.440036 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2246/4242] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:38:47 2022] GET /compute/v2.1/servers/e3b8bf04-529a-4909-9727-404cb7bba177 => generated 1358 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:38:47.440893 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-65f218ed-75bd-420a-94ae-40adad58e70c tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:47.441702 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-65f218ed-75bd-420a-94ae-40adad58e70c tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:47.607919 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-cb5b8b01-797e-4616-86ec-22d2165d86b5 req-22b98d6a-5a90-4496-af85-664ece6212f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5b04eee-69d9-4e2e-ac89-47cac8cdc538", "tag": "ac9f1ae7-c113-419c-8833-ae00612ec193"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:38:47.632840 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-cb5b8b01-797e-4616-86ec-22d2165d86b5 req-22b98d6a-5a90-4496-af85-664ece6212f7 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:47.633343 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-cb5b8b01-797e-4616-86ec-22d2165d86b5 req-22b98d6a-5a90-4496-af85-664ece6212f7 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:47.633800 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-cb5b8b01-797e-4616-86ec-22d2165d86b5 req-22b98d6a-5a90-4496-af85-664ece6212f7 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:47.651180 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-cb5b8b01-797e-4616-86ec-22d2165d86b5 req-22b98d6a-5a90-4496-af85-664ece6212f7 service nova] Creating event network-changed:ac9f1ae7-c113-419c-8833-ae00612ec193 for instance a5b04eee-69d9-4e2e-ac89-47cac8cdc538 on n-h1-862769-1 Oct 27 03:38:47.657043 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-cb5b8b01-797e-4616-86ec-22d2165d86b5 req-22b98d6a-5a90-4496-af85-664ece6212f7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057316 Oct 27 03:38:47.658236 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2247/4243] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:38:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:38:47.664710 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-185d011a-963a-4c27-bc88-281a05952b95 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:47.665990 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-185d011a-963a-4c27-bc88-281a05952b95 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] [instance: a5b04eee-69d9-4e2e-ac89-47cac8cdc538] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:47.674543 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-185d011a-963a-4c27-bc88-281a05952b95 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:47.675312 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-185d011a-963a-4c27-bc88-281a05952b95 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:47.676075 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-185d011a-963a-4c27-bc88-281a05952b95 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:47.676989 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-185d011a-963a-4c27-bc88-281a05952b95 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:47.677631 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-185d011a-963a-4c27-bc88-281a05952b95 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:47.678397 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-185d011a-963a-4c27-bc88-281a05952b95 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:47.709105 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-65f218ed-75bd-420a-94ae-40adad58e70c tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:47.719528 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-65f218ed-75bd-420a-94ae-40adad58e70c tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:47.723879 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-65f218ed-75bd-420a-94ae-40adad58e70c tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:47.724799 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-65f218ed-75bd-420a-94ae-40adad58e70c tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] 10.222.0.20 "GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac" status: 200 len: 1879 microversion: 2.32 time: 0.330904 Oct 27 03:38:47.725373 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1997/4244] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:38:47 2022] GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac => generated 1879 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:38:47.735692 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5a3dfce6-a7c6-43a6-8fef-766fd1b4613c tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:47.743836 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5a3dfce6-a7c6-43a6-8fef-766fd1b4613c tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: c5c50ae8-6217-4650-8420-291847e21ace] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:47.753875 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5a3dfce6-a7c6-43a6-8fef-766fd1b4613c tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:47.754673 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5a3dfce6-a7c6-43a6-8fef-766fd1b4613c tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:47.755114 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5a3dfce6-a7c6-43a6-8fef-766fd1b4613c tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:47.756009 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5a3dfce6-a7c6-43a6-8fef-766fd1b4613c tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:47.756978 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5a3dfce6-a7c6-43a6-8fef-766fd1b4613c tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:47.757593 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5a3dfce6-a7c6-43a6-8fef-766fd1b4613c tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:47.798486 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5a3dfce6-a7c6-43a6-8fef-766fd1b4613c tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/c5c50ae8-6217-4650-8420-291847e21ace/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066221 Oct 27 03:38:47.799030 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1998/4245] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 27 03:38:47 2022] GET /compute/v2.1/servers/c5c50ae8-6217-4650-8420-291847e21ace/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:38:47.805219 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a7552a81-5f40-4498-b207-16caccb2778d tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:47.806159 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a7552a81-5f40-4498-b207-16caccb2778d tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: d70ad817-aab3-419c-85ab-b458bb9d8d26] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:47.813530 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a7552a81-5f40-4498-b207-16caccb2778d tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:47.814395 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a7552a81-5f40-4498-b207-16caccb2778d tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:47.815230 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a7552a81-5f40-4498-b207-16caccb2778d tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:47.816187 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a7552a81-5f40-4498-b207-16caccb2778d tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:47.816646 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a7552a81-5f40-4498-b207-16caccb2778d tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:47.817110 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a7552a81-5f40-4498-b207-16caccb2778d tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:47.842506 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-a7552a81-5f40-4498-b207-16caccb2778d tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] HTTP exception thrown: Instance d70ad817-aab3-419c-85ab-b458bb9d8d26 could not be found. Oct 27 03:38:47.844178 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a7552a81-5f40-4498-b207-16caccb2778d tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Request method failure captured: Oct 27 03:38:47.844178 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/d70ad817-aab3-419c-85ab-b458bb9d8d26 HTTP/1.1 Oct 27 03:38:47.844178 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:38:47.844178 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:38:47.844178 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:38:47.844178 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:38:47.844178 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:38:47.844178 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:38:47.844178 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:38:47.844178 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:38:47.844178 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfsa_BAeMB3RnYvkmJQwjLzdAXRwOtmdTc4q-U2TyHH4sY2pC7-yKXDlPkKgdlBzGRlepw8PNzs2kNd86HTPJPZkHZ4DJy78RLBBzCNtKZaBrkpRAbSZW5Gv7329yxsJiAdDbJaiPVC-uHRtJPx_KALbDnjOM5yyEW86DSYN-HLC8ok Oct 27 03:38:47.844178 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:38:47.844178 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:38:47.844178 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:38:47.844178 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:38:47.844178 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:38:47.844178 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:38:47.844178 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 3e9ede68f63747d59153a46412033856 Oct 27 03:38:47.844178 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ServerActionsTestJSON-24656121 Oct 27 03:38:47.844178 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:38:47.844178 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:38:47.844178 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3e9ede68f63747d59153a46412033856"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3e9ede68f63747d59153a46412033856"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3e9ede68f63747d59153a46412033856"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3e9ede68f63747d59153a46412033856"}]}] Oct 27 03:38:47.844178 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ServerActionsTestJSON-24656121 Oct 27 03:38:47.844178 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 3e9ede68f63747d59153a46412033856 Oct 27 03:38:47.844178 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ServerActionsTestJSON-24656121 Oct 27 03:38:47.844178 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ServerActionsTestJSON-24656121-project Oct 27 03:38:47.844178 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:38:47.844178 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:38:47.844178 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 94897f20beb94dbd8e7eff6ecba30026 Oct 27 03:38:47.844178 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ServerActionsTestJSON-24656121-project Oct 27 03:38:47.844178 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:38:47.844178 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance d70ad817-aab3-419c-85ab-b458bb9d8d26 could not be found. Oct 27 03:38:47.844178 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': 'd70ad817-aab3-419c-85ab-b458bb9d8d26'} Oct 27 03:38:47.844178 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:38:47.844178 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:38:47.844178 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:38:47.844178 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:38:47.844178 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:38:47.844178 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:38:47.844178 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:38:47.844178 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:38:47.844178 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:38:47.844178 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:38:47.844178 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d70ad817-aab3-419c-85ab-b458bb9d8d26 could not be found. Oct 27 03:38:47.844178 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:38:47.844178 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:38:47.844178 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:38:47.844178 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:38:47.844178 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:38:47.844178 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:38:47.844178 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:38:47.844178 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:38:47.844178 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:38:47.844178 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:38:47.844178 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:38:47.844178 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:38:47.844178 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:38:47.844178 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:38:47.844178 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:38:47.844178 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:38:47.844178 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d70ad817-aab3-419c-85ab-b458bb9d8d26 could not be found. Oct 27 03:38:47.844178 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:38:47.844178 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:38:47.844178 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:38:47.850359 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:38:47.850359 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:38:47.850359 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:38:47.850359 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:38:47.850359 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:38:47.850359 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d70ad817-aab3-419c-85ab-b458bb9d8d26 could not be found. Oct 27 03:38:47.850359 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:38:47.857940 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a7552a81-5f40-4498-b207-16caccb2778d tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Returning 404 to user: Instance d70ad817-aab3-419c-85ab-b458bb9d8d26 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:38:47.861687 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a7552a81-5f40-4498-b207-16caccb2778d tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/d70ad817-aab3-419c-85ab-b458bb9d8d26" status: 404 len: 111 microversion: 2.1 time: 0.059091 Oct 27 03:38:47.861687 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 1999/4246] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:47 2022] GET /compute/v2.1/servers/d70ad817-aab3-419c-85ab-b458bb9d8d26 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:38:47.867939 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d31fc4d6-6f3b-4834-8523-9be87665d640 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:47.868451 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d31fc4d6-6f3b-4834-8523-9be87665d640 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:47.876288 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d31fc4d6-6f3b-4834-8523-9be87665d640 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:47.876804 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d31fc4d6-6f3b-4834-8523-9be87665d640 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:47.877253 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d31fc4d6-6f3b-4834-8523-9be87665d640 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:47.877977 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d31fc4d6-6f3b-4834-8523-9be87665d640 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:47.878469 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d31fc4d6-6f3b-4834-8523-9be87665d640 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:47.879182 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d31fc4d6-6f3b-4834-8523-9be87665d640 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:47.925995 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d31fc4d6-6f3b-4834-8523-9be87665d640 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Going to try to terminate instance {{(pid=121000) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:38:47.978115 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-185d011a-963a-4c27-bc88-281a05952b95 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8e0bc10d3f451c8837c1f1e4d86eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4840257127594149b03c0aa3ab94b486', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:47.988739 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-185d011a-963a-4c27-bc88-281a05952b95 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] 10.222.0.20 "GET /compute/v2.1/servers/a5b04eee-69d9-4e2e-ac89-47cac8cdc538" status: 200 len: 1395 microversion: 2.1 time: 0.329052 Oct 27 03:38:48.006797 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2248/4247] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:47 2022] GET /compute/v2.1/servers/a5b04eee-69d9-4e2e-ac89-47cac8cdc538 => generated 1395 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:38:48.061954 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-2616ccea-536b-441b-a098-d2fcb88df372 req-8192e24e-f7c2-4d53-b9c6-3385a3aab46b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3b8bf04-529a-4909-9727-404cb7bba177", "name": "network-vif-plugged", "status": "completed", "tag": "beb1dd89-3e2f-4a8d-9259-11e4d9b00116"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:38:48.076820 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-2616ccea-536b-441b-a098-d2fcb88df372 req-8192e24e-f7c2-4d53-b9c6-3385a3aab46b service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:48.077672 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-2616ccea-536b-441b-a098-d2fcb88df372 req-8192e24e-f7c2-4d53-b9c6-3385a3aab46b service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:48.078395 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-2616ccea-536b-441b-a098-d2fcb88df372 req-8192e24e-f7c2-4d53-b9c6-3385a3aab46b service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:48.091119 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-2616ccea-536b-441b-a098-d2fcb88df372 req-8192e24e-f7c2-4d53-b9c6-3385a3aab46b service nova] Creating event network-vif-plugged:beb1dd89-3e2f-4a8d-9259-11e4d9b00116 for instance e3b8bf04-529a-4909-9727-404cb7bba177 on n-h2-862769-1 Oct 27 03:38:48.096399 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-2616ccea-536b-441b-a098-d2fcb88df372 req-8192e24e-f7c2-4d53-b9c6-3385a3aab46b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040054 Oct 27 03:38:48.097223 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2249/4248] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:38:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:38:48.325349 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d31fc4d6-6f3b-4834-8523-9be87665d640 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 204 len: 0 microversion: 2.1 time: 0.460909 Oct 27 03:38:48.325944 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2000/4249] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:38:47 2022] DELETE /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 03:38:48.334919 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d8ce7a02-68c8-4462-a775-809edd9ee2c9 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:48.336315 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d8ce7a02-68c8-4462-a775-809edd9ee2c9 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:48.343939 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d8ce7a02-68c8-4462-a775-809edd9ee2c9 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:48.344732 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d8ce7a02-68c8-4462-a775-809edd9ee2c9 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:48.345541 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d8ce7a02-68c8-4462-a775-809edd9ee2c9 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:48.346532 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d8ce7a02-68c8-4462-a775-809edd9ee2c9 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:48.347204 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d8ce7a02-68c8-4462-a775-809edd9ee2c9 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:48.347864 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d8ce7a02-68c8-4462-a775-809edd9ee2c9 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:48.465338 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-70828ee4-934f-4b18-8dfe-24eba08f17c9 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:48.466095 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-70828ee4-934f-4b18-8dfe-24eba08f17c9 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] [instance: e3b8bf04-529a-4909-9727-404cb7bba177] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:48.476380 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-70828ee4-934f-4b18-8dfe-24eba08f17c9 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:48.476992 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-70828ee4-934f-4b18-8dfe-24eba08f17c9 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:48.477152 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-70828ee4-934f-4b18-8dfe-24eba08f17c9 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:48.477877 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-70828ee4-934f-4b18-8dfe-24eba08f17c9 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:48.478368 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-70828ee4-934f-4b18-8dfe-24eba08f17c9 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:48.478881 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-70828ee4-934f-4b18-8dfe-24eba08f17c9 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:48.518721 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d8ce7a02-68c8-4462-a775-809edd9ee2c9 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:48.527648 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d8ce7a02-68c8-4462-a775-809edd9ee2c9 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1675 microversion: 2.1 time: 0.197072 Oct 27 03:38:48.534180 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2250/4250] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:48 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1675 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:38:48.637333 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-70828ee4-934f-4b18-8dfe-24eba08f17c9 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51be346b3c5448c28ac57f5c1ffe50bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93732dbf56414de2b7667e1e70262a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:48.646540 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-70828ee4-934f-4b18-8dfe-24eba08f17c9 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51be346b3c5448c28ac57f5c1ffe50bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93732dbf56414de2b7667e1e70262a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:48.649063 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-70828ee4-934f-4b18-8dfe-24eba08f17c9 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51be346b3c5448c28ac57f5c1ffe50bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93732dbf56414de2b7667e1e70262a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:48.650272 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-70828ee4-934f-4b18-8dfe-24eba08f17c9 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] 10.222.0.20 "GET /compute/v2.1/servers/e3b8bf04-529a-4909-9727-404cb7bba177" status: 200 len: 1358 microversion: 2.21 time: 0.189270 Oct 27 03:38:48.650969 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2001/4251] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:38:48 2022] GET /compute/v2.1/servers/e3b8bf04-529a-4909-9727-404cb7bba177 => generated 1358 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:38:48.752285 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1940e29c-88e1-45fc-bdac-93392b1bb047 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:48.753149 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1940e29c-88e1-45fc-bdac-93392b1bb047 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] [instance: 7e73d534-0a40-42d2-813c-2e9dbb9239ac] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:48.759348 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1940e29c-88e1-45fc-bdac-93392b1bb047 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:48.759884 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1940e29c-88e1-45fc-bdac-93392b1bb047 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:48.760368 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1940e29c-88e1-45fc-bdac-93392b1bb047 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:48.761084 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1940e29c-88e1-45fc-bdac-93392b1bb047 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:48.761549 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1940e29c-88e1-45fc-bdac-93392b1bb047 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:48.761985 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1940e29c-88e1-45fc-bdac-93392b1bb047 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:48.810803 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e79cf614-5f8f-4fa4-8a44-59a49cac574e tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:48.813131 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e79cf614-5f8f-4fa4-8a44-59a49cac574e tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: c5c50ae8-6217-4650-8420-291847e21ace] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:48.819762 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e79cf614-5f8f-4fa4-8a44-59a49cac574e tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:48.820186 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e79cf614-5f8f-4fa4-8a44-59a49cac574e tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:48.820634 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e79cf614-5f8f-4fa4-8a44-59a49cac574e tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:48.821464 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e79cf614-5f8f-4fa4-8a44-59a49cac574e tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:48.821928 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e79cf614-5f8f-4fa4-8a44-59a49cac574e tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:48.822392 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e79cf614-5f8f-4fa4-8a44-59a49cac574e tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:48.856980 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e79cf614-5f8f-4fa4-8a44-59a49cac574e tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/c5c50ae8-6217-4650-8420-291847e21ace/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050949 Oct 27 03:38:48.862378 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2002/4252] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 27 03:38:48 2022] GET /compute/v2.1/servers/c5c50ae8-6217-4650-8420-291847e21ace/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:38:49.004409 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1940e29c-88e1-45fc-bdac-93392b1bb047 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:49.013496 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-94ef0100-b494-4b8f-8634-49b7e58a4f77 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:49.014212 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-94ef0100-b494-4b8f-8634-49b7e58a4f77 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] [instance: a5b04eee-69d9-4e2e-ac89-47cac8cdc538] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:49.017176 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1940e29c-88e1-45fc-bdac-93392b1bb047 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:49.018666 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1940e29c-88e1-45fc-bdac-93392b1bb047 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:49.020544 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1940e29c-88e1-45fc-bdac-93392b1bb047 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] 10.222.0.20 "GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac" status: 200 len: 1879 microversion: 2.32 time: 0.272386 Oct 27 03:38:49.020975 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-94ef0100-b494-4b8f-8634-49b7e58a4f77 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:49.034059 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2251/4253] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:38:48 2022] GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac => generated 1879 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:38:49.035022 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-94ef0100-b494-4b8f-8634-49b7e58a4f77 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:49.035604 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-94ef0100-b494-4b8f-8634-49b7e58a4f77 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:49.036263 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-94ef0100-b494-4b8f-8634-49b7e58a4f77 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:49.036732 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-94ef0100-b494-4b8f-8634-49b7e58a4f77 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:49.037169 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-94ef0100-b494-4b8f-8634-49b7e58a4f77 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:49.184132 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-94ef0100-b494-4b8f-8634-49b7e58a4f77 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8e0bc10d3f451c8837c1f1e4d86eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4840257127594149b03c0aa3ab94b486', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:49.202828 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-94ef0100-b494-4b8f-8634-49b7e58a4f77 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] 10.222.0.20 "GET /compute/v2.1/servers/a5b04eee-69d9-4e2e-ac89-47cac8cdc538" status: 200 len: 1395 microversion: 2.1 time: 0.193044 Oct 27 03:38:49.217829 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2003/4254] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:49 2022] GET /compute/v2.1/servers/a5b04eee-69d9-4e2e-ac89-47cac8cdc538 => generated 1395 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:38:49.551918 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-daf9b521-ad49-4b31-8518-651d472484b4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:49.552579 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-daf9b521-ad49-4b31-8518-651d472484b4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:49.571329 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-daf9b521-ad49-4b31-8518-651d472484b4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:49.575501 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-daf9b521-ad49-4b31-8518-651d472484b4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:49.576016 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-daf9b521-ad49-4b31-8518-651d472484b4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:49.576783 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-daf9b521-ad49-4b31-8518-651d472484b4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:49.577256 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-daf9b521-ad49-4b31-8518-651d472484b4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:49.577693 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-daf9b521-ad49-4b31-8518-651d472484b4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:49.776758 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-daf9b521-ad49-4b31-8518-651d472484b4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:49.791165 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-daf9b521-ad49-4b31-8518-651d472484b4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1675 microversion: 2.1 time: 0.243072 Oct 27 03:38:49.792418 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2252/4255] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:49 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1675 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:38:49.797954 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f5839323-47c7-40f8-8f9d-5d4b8373fadd tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:49.799339 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f5839323-47c7-40f8-8f9d-5d4b8373fadd tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] [instance: e3b8bf04-529a-4909-9727-404cb7bba177] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:49.807640 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f5839323-47c7-40f8-8f9d-5d4b8373fadd tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:49.808347 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f5839323-47c7-40f8-8f9d-5d4b8373fadd tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:49.808990 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f5839323-47c7-40f8-8f9d-5d4b8373fadd tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:49.809893 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f5839323-47c7-40f8-8f9d-5d4b8373fadd tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:49.810549 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f5839323-47c7-40f8-8f9d-5d4b8373fadd tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:49.811199 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f5839323-47c7-40f8-8f9d-5d4b8373fadd tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:49.836856 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d45c5ffb-0881-4ed7-a361-91bbb8afa1a2 tempest-ComputeTenantNetworksTest-1340342339 tempest-ComputeTenantNetworksTest-1340342339-project] Calling method '.version_select at 0x7f7dd9c4f5e0>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:49.997105 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f5839323-47c7-40f8-8f9d-5d4b8373fadd tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51be346b3c5448c28ac57f5c1ffe50bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93732dbf56414de2b7667e1e70262a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:50.005761 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f5839323-47c7-40f8-8f9d-5d4b8373fadd tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51be346b3c5448c28ac57f5c1ffe50bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93732dbf56414de2b7667e1e70262a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:50.007349 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f5839323-47c7-40f8-8f9d-5d4b8373fadd tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51be346b3c5448c28ac57f5c1ffe50bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93732dbf56414de2b7667e1e70262a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:50.008549 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f5839323-47c7-40f8-8f9d-5d4b8373fadd tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] 10.222.0.20 "GET /compute/v2.1/servers/e3b8bf04-529a-4909-9727-404cb7bba177" status: 200 len: 1549 microversion: 2.21 time: 0.215045 Oct 27 03:38:50.009332 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2253/4256] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:38:49 2022] GET /compute/v2.1/servers/e3b8bf04-529a-4909-9727-404cb7bba177 => generated 1549 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:38:50.030177 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b3f3bbdf-5a17-4cc6-88fc-436de84f8fbb tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:50.033262 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b3f3bbdf-5a17-4cc6-88fc-436de84f8fbb tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: c5c50ae8-6217-4650-8420-291847e21ace] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:50.040551 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b3f3bbdf-5a17-4cc6-88fc-436de84f8fbb tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:50.041184 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b3f3bbdf-5a17-4cc6-88fc-436de84f8fbb tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:50.042235 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b3f3bbdf-5a17-4cc6-88fc-436de84f8fbb tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:50.043062 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b3f3bbdf-5a17-4cc6-88fc-436de84f8fbb tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:50.043928 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b3f3bbdf-5a17-4cc6-88fc-436de84f8fbb tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:50.044720 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b3f3bbdf-5a17-4cc6-88fc-436de84f8fbb tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:50.090564 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b3f3bbdf-5a17-4cc6-88fc-436de84f8fbb tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/c5c50ae8-6217-4650-8420-291847e21ace/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078811 Oct 27 03:38:50.096468 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2254/4257] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 27 03:38:50 2022] GET /compute/v2.1/servers/c5c50ae8-6217-4650-8420-291847e21ace/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:38:50.119134 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a1f5c519-0294-4a03-bceb-b55780e62896 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:50.120848 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a1f5c519-0294-4a03-bceb-b55780e62896 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] [instance: e3b8bf04-529a-4909-9727-404cb7bba177] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:50.129849 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a1f5c519-0294-4a03-bceb-b55780e62896 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:50.131058 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a1f5c519-0294-4a03-bceb-b55780e62896 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:50.131804 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a1f5c519-0294-4a03-bceb-b55780e62896 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:50.132802 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a1f5c519-0294-4a03-bceb-b55780e62896 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:50.134305 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a1f5c519-0294-4a03-bceb-b55780e62896 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:50.135067 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a1f5c519-0294-4a03-bceb-b55780e62896 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:50.157945 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:38:50.164769 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:38:50.174374 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a1f5c519-0294-4a03-bceb-b55780e62896 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] [instance: e3b8bf04-529a-4909-9727-404cb7bba177] Going to try to terminate instance {{(pid=121001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:38:50.195797 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=16 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:38:50.231174 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d45c5ffb-0881-4ed7-a361-91bbb8afa1a2 tempest-ComputeTenantNetworksTest-1340342339 tempest-ComputeTenantNetworksTest-1340342339-project] 10.222.0.20 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 308 microversion: 2.1 time: 0.556001 Oct 27 03:38:50.235370 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2004/4258] 10.222.0.20 () {58 vars in 1158 bytes} [Thu Oct 27 03:38:49 2022] GET /compute/v2.1/os-tenant-networks => generated 308 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:38:50.239630 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c29b94b1-06f4-40fe-a400-4502676d9773 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:50.240258 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c29b94b1-06f4-40fe-a400-4502676d9773 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] [instance: 7e73d534-0a40-42d2-813c-2e9dbb9239ac] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:50.247310 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c29b94b1-06f4-40fe-a400-4502676d9773 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:50.247917 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c29b94b1-06f4-40fe-a400-4502676d9773 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:50.248665 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c29b94b1-06f4-40fe-a400-4502676d9773 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:50.249618 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c29b94b1-06f4-40fe-a400-4502676d9773 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:50.250225 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c29b94b1-06f4-40fe-a400-4502676d9773 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:50.250845 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c29b94b1-06f4-40fe-a400-4502676d9773 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:50.563260 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a1f5c519-0294-4a03-bceb-b55780e62896 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e3b8bf04-529a-4909-9727-404cb7bba177" status: 204 len: 0 microversion: 2.21 time: 0.464943 Oct 27 03:38:50.564310 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2255/4259] 10.222.0.20 () {60 vars in 1280 bytes} [Thu Oct 27 03:38:50 2022] DELETE /compute/v2.1/servers/e3b8bf04-529a-4909-9727-404cb7bba177 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 03:38:50.570495 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8f045839-4821-4f28-8f2a-c70d36fc4294 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:50.571282 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8f045839-4821-4f28-8f2a-c70d36fc4294 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] [instance: a5b04eee-69d9-4e2e-ac89-47cac8cdc538] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:50.577762 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8f045839-4821-4f28-8f2a-c70d36fc4294 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:50.578431 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8f045839-4821-4f28-8f2a-c70d36fc4294 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:50.579486 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8f045839-4821-4f28-8f2a-c70d36fc4294 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:50.579615 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8f045839-4821-4f28-8f2a-c70d36fc4294 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:50.580025 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8f045839-4821-4f28-8f2a-c70d36fc4294 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:50.580501 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8f045839-4821-4f28-8f2a-c70d36fc4294 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:50.729905 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8f045839-4821-4f28-8f2a-c70d36fc4294 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8e0bc10d3f451c8837c1f1e4d86eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4840257127594149b03c0aa3ab94b486', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:50.739130 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8f045839-4821-4f28-8f2a-c70d36fc4294 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] 10.222.0.20 "GET /compute/v2.1/servers/a5b04eee-69d9-4e2e-ac89-47cac8cdc538" status: 200 len: 1395 microversion: 2.1 time: 0.172995 Oct 27 03:38:50.744073 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2256/4260] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:50 2022] GET /compute/v2.1/servers/a5b04eee-69d9-4e2e-ac89-47cac8cdc538 => generated 1395 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:38:50.751412 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-80354910-6e4f-4a56-92f3-1faeee040b8b tempest-ComputeTenantNetworksTest-1340342339 tempest-ComputeTenantNetworksTest-1340342339-project] Calling method '.version_select at 0x7f7ddab16b80>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:50.851963 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-80354910-6e4f-4a56-92f3-1faeee040b8b tempest-ComputeTenantNetworksTest-1340342339 tempest-ComputeTenantNetworksTest-1340342339-project] 10.222.0.20 "GET /compute/v2.1/os-tenant-networks/e2e658bf-c771-4076-bbd5-4d044cfbe113" status: 200 len: 139 microversion: 2.1 time: 0.105801 Oct 27 03:38:50.852145 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c29b94b1-06f4-40fe-a400-4502676d9773 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:50.861920 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2257/4261] 10.222.0.20 () {58 vars in 1269 bytes} [Thu Oct 27 03:38:50 2022] GET /compute/v2.1/os-tenant-networks/e2e658bf-c771-4076-bbd5-4d044cfbe113 => generated 139 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:38:50.863063 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c29b94b1-06f4-40fe-a400-4502676d9773 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:50.864967 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c29b94b1-06f4-40fe-a400-4502676d9773 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:50.866402 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c29b94b1-06f4-40fe-a400-4502676d9773 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] 10.222.0.20 "GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac" status: 200 len: 1879 microversion: 2.32 time: 0.633517 Oct 27 03:38:50.878277 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0fc7a3b4-bcfe-41a4-b2e7-15041532cd49 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:50.878277 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0fc7a3b4-bcfe-41a4-b2e7-15041532cd49 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] [instance: e3b8bf04-529a-4909-9727-404cb7bba177] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:50.878277 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0fc7a3b4-bcfe-41a4-b2e7-15041532cd49 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:50.878277 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0fc7a3b4-bcfe-41a4-b2e7-15041532cd49 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:50.879308 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2005/4262] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:38:50 2022] GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac => generated 1879 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:38:50.888847 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0fc7a3b4-bcfe-41a4-b2e7-15041532cd49 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:50.888847 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0fc7a3b4-bcfe-41a4-b2e7-15041532cd49 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:50.888847 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0fc7a3b4-bcfe-41a4-b2e7-15041532cd49 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:50.891989 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f0d9403a-ec2d-424b-a370-005f3ccc6ca6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:50.892140 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0fc7a3b4-bcfe-41a4-b2e7-15041532cd49 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:50.892914 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f0d9403a-ec2d-424b-a370-005f3ccc6ca6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:50.899273 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f0d9403a-ec2d-424b-a370-005f3ccc6ca6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:50.900002 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f0d9403a-ec2d-424b-a370-005f3ccc6ca6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:50.901187 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f0d9403a-ec2d-424b-a370-005f3ccc6ca6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:50.902613 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f0d9403a-ec2d-424b-a370-005f3ccc6ca6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:50.903547 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f0d9403a-ec2d-424b-a370-005f3ccc6ca6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:50.904214 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f0d9403a-ec2d-424b-a370-005f3ccc6ca6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:51.151667 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f0d9403a-ec2d-424b-a370-005f3ccc6ca6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:51.164031 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f0d9403a-ec2d-424b-a370-005f3ccc6ca6 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1675 microversion: 2.1 time: 0.280004 Oct 27 03:38:51.175949 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2006/4263] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:50 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1675 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:38:51.183331 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c95858ff-5dd1-4e96-96ea-b0d69b877572 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:51.186639 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c95858ff-5dd1-4e96-96ea-b0d69b877572 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: c5c50ae8-6217-4650-8420-291847e21ace] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:51.193954 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c95858ff-5dd1-4e96-96ea-b0d69b877572 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:51.195468 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c95858ff-5dd1-4e96-96ea-b0d69b877572 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:51.201682 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c95858ff-5dd1-4e96-96ea-b0d69b877572 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:51.203000 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0fc7a3b4-bcfe-41a4-b2e7-15041532cd49 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51be346b3c5448c28ac57f5c1ffe50bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93732dbf56414de2b7667e1e70262a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:51.203426 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c95858ff-5dd1-4e96-96ea-b0d69b877572 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:51.203426 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c95858ff-5dd1-4e96-96ea-b0d69b877572 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:51.203426 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c95858ff-5dd1-4e96-96ea-b0d69b877572 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:51.212943 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0fc7a3b4-bcfe-41a4-b2e7-15041532cd49 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51be346b3c5448c28ac57f5c1ffe50bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93732dbf56414de2b7667e1e70262a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:51.215010 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0fc7a3b4-bcfe-41a4-b2e7-15041532cd49 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51be346b3c5448c28ac57f5c1ffe50bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93732dbf56414de2b7667e1e70262a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:51.233271 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0fc7a3b4-bcfe-41a4-b2e7-15041532cd49 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] 10.222.0.20 "GET /compute/v2.1/servers/e3b8bf04-529a-4909-9727-404cb7bba177" status: 200 len: 1555 microversion: 2.21 time: 0.350996 Oct 27 03:38:51.233938 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2258/4264] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:38:50 2022] GET /compute/v2.1/servers/e3b8bf04-529a-4909-9727-404cb7bba177 => generated 1555 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:38:51.239005 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c95858ff-5dd1-4e96-96ea-b0d69b877572 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/c5c50ae8-6217-4650-8420-291847e21ace/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.061843 Oct 27 03:38:51.240126 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2007/4265] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 27 03:38:51 2022] GET /compute/v2.1/servers/c5c50ae8-6217-4650-8420-291847e21ace/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 03:38:51.352362 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-79167167-3060-4b7a-8dd0-827a763c7383 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:51.352850 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-79167167-3060-4b7a-8dd0-827a763c7383 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: c5c50ae8-6217-4650-8420-291847e21ace] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:51.359094 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-79167167-3060-4b7a-8dd0-827a763c7383 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:51.359827 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-79167167-3060-4b7a-8dd0-827a763c7383 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:51.360274 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-79167167-3060-4b7a-8dd0-827a763c7383 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:51.360970 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-79167167-3060-4b7a-8dd0-827a763c7383 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:51.361427 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-79167167-3060-4b7a-8dd0-827a763c7383 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:51.361854 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-79167167-3060-4b7a-8dd0-827a763c7383 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:51.390340 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-79167167-3060-4b7a-8dd0-827a763c7383 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: c5c50ae8-6217-4650-8420-291847e21ace] Going to try to terminate instance {{(pid=121001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:38:51.738602 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-79167167-3060-4b7a-8dd0-827a763c7383 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c5c50ae8-6217-4650-8420-291847e21ace" status: 204 len: 0 microversion: 2.1 time: 0.389812 Oct 27 03:38:51.743159 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2259/4266] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:38:51 2022] DELETE /compute/v2.1/servers/c5c50ae8-6217-4650-8420-291847e21ace => generated 0 bytes in 392 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:38:51.748952 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-389b9b83-d473-4f36-98be-f368cfe224eb tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:51.749611 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-389b9b83-d473-4f36-98be-f368cfe224eb tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: c5c50ae8-6217-4650-8420-291847e21ace] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:51.764138 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-389b9b83-d473-4f36-98be-f368cfe224eb tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:51.764641 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-95c60a4e-786a-4393-900c-83a716c99363 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:51.764810 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-389b9b83-d473-4f36-98be-f368cfe224eb tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:51.765087 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-389b9b83-d473-4f36-98be-f368cfe224eb tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:51.765717 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-95c60a4e-786a-4393-900c-83a716c99363 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] [instance: a5b04eee-69d9-4e2e-ac89-47cac8cdc538] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:51.765878 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-389b9b83-d473-4f36-98be-f368cfe224eb tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:51.766288 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-389b9b83-d473-4f36-98be-f368cfe224eb tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:51.766724 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-389b9b83-d473-4f36-98be-f368cfe224eb tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:51.776089 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-95c60a4e-786a-4393-900c-83a716c99363 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:51.779082 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-95c60a4e-786a-4393-900c-83a716c99363 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:51.782241 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-95c60a4e-786a-4393-900c-83a716c99363 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:51.783395 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-95c60a4e-786a-4393-900c-83a716c99363 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:51.785158 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-95c60a4e-786a-4393-900c-83a716c99363 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:51.787822 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-95c60a4e-786a-4393-900c-83a716c99363 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:52.066495 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=4 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:38:52.097451 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-389b9b83-d473-4f36-98be-f368cfe224eb tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18036411a99e4634bfbaeae24b9f254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229dcb63bc41444391544883b576ce2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:52.116489 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-389b9b83-d473-4f36-98be-f368cfe224eb tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/c5c50ae8-6217-4650-8420-291847e21ace" status: 200 len: 1677 microversion: 2.1 time: 0.372338 Oct 27 03:38:52.118235 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2008/4267] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:51 2022] GET /compute/v2.1/servers/c5c50ae8-6217-4650-8420-291847e21ace => generated 1677 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:38:52.123217 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-631d8fdc-3711-463a-bd9c-230cfdd221d3 req-199a21d0-8338-4bf6-864d-38a6c9c372bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed74f42b-af82-4808-bfc2-86110840fe86", "name": "network-vif-deleted", "tag": "05464839-777e-4176-af2d-6086d6f9acaa"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:38:52.151319 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-631d8fdc-3711-463a-bd9c-230cfdd221d3 req-199a21d0-8338-4bf6-864d-38a6c9c372bd service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:52.151823 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-631d8fdc-3711-463a-bd9c-230cfdd221d3 req-199a21d0-8338-4bf6-864d-38a6c9c372bd service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:52.152264 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-631d8fdc-3711-463a-bd9c-230cfdd221d3 req-199a21d0-8338-4bf6-864d-38a6c9c372bd service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:52.198467 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-631d8fdc-3711-463a-bd9c-230cfdd221d3 req-199a21d0-8338-4bf6-864d-38a6c9c372bd service nova] Creating event network-vif-deleted:05464839-777e-4176-af2d-6086d6f9acaa for instance ed74f42b-af82-4808-bfc2-86110840fe86 on n-h1-862769-1 Oct 27 03:38:52.203881 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-631d8fdc-3711-463a-bd9c-230cfdd221d3 req-199a21d0-8338-4bf6-864d-38a6c9c372bd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084216 Oct 27 03:38:52.205122 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2009/4268] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:38:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:38:52.211671 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-475d3f2f-6bae-4a06-94f5-d01ed1902c9a tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:52.213741 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-475d3f2f-6bae-4a06-94f5-d01ed1902c9a tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] [instance: 7e73d534-0a40-42d2-813c-2e9dbb9239ac] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:52.221678 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-475d3f2f-6bae-4a06-94f5-d01ed1902c9a tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:52.222909 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-475d3f2f-6bae-4a06-94f5-d01ed1902c9a tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:52.227355 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-475d3f2f-6bae-4a06-94f5-d01ed1902c9a tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:52.227355 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-475d3f2f-6bae-4a06-94f5-d01ed1902c9a tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:52.227355 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-475d3f2f-6bae-4a06-94f5-d01ed1902c9a tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:52.227355 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-475d3f2f-6bae-4a06-94f5-d01ed1902c9a tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:52.239181 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-95c60a4e-786a-4393-900c-83a716c99363 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8e0bc10d3f451c8837c1f1e4d86eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4840257127594149b03c0aa3ab94b486', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:52.266858 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-95c60a4e-786a-4393-900c-83a716c99363 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] 10.222.0.20 "GET /compute/v2.1/servers/a5b04eee-69d9-4e2e-ac89-47cac8cdc538" status: 200 len: 1395 microversion: 2.1 time: 0.505909 Oct 27 03:38:52.288073 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2260/4269] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:51 2022] GET /compute/v2.1/servers/a5b04eee-69d9-4e2e-ac89-47cac8cdc538 => generated 1395 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:38:52.294109 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2ee7b573-9475-4633-975e-c823a994393d tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:52.295505 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2ee7b573-9475-4633-975e-c823a994393d tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:52.308140 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2ee7b573-9475-4633-975e-c823a994393d tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:52.317133 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2ee7b573-9475-4633-975e-c823a994393d tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:52.319331 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2ee7b573-9475-4633-975e-c823a994393d tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:52.320370 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2ee7b573-9475-4633-975e-c823a994393d tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:52.326656 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2ee7b573-9475-4633-975e-c823a994393d tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:52.327364 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2ee7b573-9475-4633-975e-c823a994393d tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:52.467905 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2ee7b573-9475-4633-975e-c823a994393d tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:52.491143 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2ee7b573-9475-4633-975e-c823a994393d tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1607 microversion: 2.1 time: 0.200421 Oct 27 03:38:52.498008 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2261/4270] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:52 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1607 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:38:52.520682 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-011f118b-b0ad-41ba-bf2a-79d43f4f72e7 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:52.523302 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-011f118b-b0ad-41ba-bf2a-79d43f4f72e7 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] [instance: e3b8bf04-529a-4909-9727-404cb7bba177] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:52.543698 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-475d3f2f-6bae-4a06-94f5-d01ed1902c9a tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:52.554835 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-475d3f2f-6bae-4a06-94f5-d01ed1902c9a tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:52.556820 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-475d3f2f-6bae-4a06-94f5-d01ed1902c9a tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:52.558881 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-011f118b-b0ad-41ba-bf2a-79d43f4f72e7 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:52.559583 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-011f118b-b0ad-41ba-bf2a-79d43f4f72e7 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:52.560427 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-475d3f2f-6bae-4a06-94f5-d01ed1902c9a tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] 10.222.0.20 "GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac" status: 200 len: 1879 microversion: 2.32 time: 0.351506 Oct 27 03:38:52.561865 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2010/4271] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:38:52 2022] GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac => generated 1879 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:38:52.562403 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-011f118b-b0ad-41ba-bf2a-79d43f4f72e7 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:52.563370 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-011f118b-b0ad-41ba-bf2a-79d43f4f72e7 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:52.563875 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-011f118b-b0ad-41ba-bf2a-79d43f4f72e7 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:52.564308 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-011f118b-b0ad-41ba-bf2a-79d43f4f72e7 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:52.855696 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-011f118b-b0ad-41ba-bf2a-79d43f4f72e7 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51be346b3c5448c28ac57f5c1ffe50bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93732dbf56414de2b7667e1e70262a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:52.874158 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-011f118b-b0ad-41ba-bf2a-79d43f4f72e7 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51be346b3c5448c28ac57f5c1ffe50bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93732dbf56414de2b7667e1e70262a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:52.875761 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-011f118b-b0ad-41ba-bf2a-79d43f4f72e7 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51be346b3c5448c28ac57f5c1ffe50bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93732dbf56414de2b7667e1e70262a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:52.877287 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-011f118b-b0ad-41ba-bf2a-79d43f4f72e7 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] 10.222.0.20 "GET /compute/v2.1/servers/e3b8bf04-529a-4909-9727-404cb7bba177" status: 200 len: 1555 microversion: 2.21 time: 0.376770 Oct 27 03:38:52.878275 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2262/4272] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:38:52 2022] GET /compute/v2.1/servers/e3b8bf04-529a-4909-9727-404cb7bba177 => generated 1555 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:38:53.108590 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-a4777c48-a039-4c31-adea-ca070cf53e6b req-f7755fae-4b44-43e6-b3af-f33f29fad112 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3b8bf04-529a-4909-9727-404cb7bba177", "name": "network-vif-deleted", "tag": "beb1dd89-3e2f-4a8d-9259-11e4d9b00116"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:38:53.124142 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-a4777c48-a039-4c31-adea-ca070cf53e6b req-f7755fae-4b44-43e6-b3af-f33f29fad112 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:53.124643 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-a4777c48-a039-4c31-adea-ca070cf53e6b req-f7755fae-4b44-43e6-b3af-f33f29fad112 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:53.125084 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-a4777c48-a039-4c31-adea-ca070cf53e6b req-f7755fae-4b44-43e6-b3af-f33f29fad112 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:53.139140 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-a4777c48-a039-4c31-adea-ca070cf53e6b req-f7755fae-4b44-43e6-b3af-f33f29fad112 service nova] Creating event network-vif-deleted:beb1dd89-3e2f-4a8d-9259-11e4d9b00116 for instance e3b8bf04-529a-4909-9727-404cb7bba177 on n-h2-862769-1 Oct 27 03:38:53.145308 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ea9993cd-7d05-47a4-a88f-523e46c06d95 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:53.146232 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ea9993cd-7d05-47a4-a88f-523e46c06d95 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: c5c50ae8-6217-4650-8420-291847e21ace] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:53.156816 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ea9993cd-7d05-47a4-a88f-523e46c06d95 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:53.162061 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ea9993cd-7d05-47a4-a88f-523e46c06d95 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:53.162061 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ea9993cd-7d05-47a4-a88f-523e46c06d95 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:53.162061 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ea9993cd-7d05-47a4-a88f-523e46c06d95 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:53.162061 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ea9993cd-7d05-47a4-a88f-523e46c06d95 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:53.162061 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ea9993cd-7d05-47a4-a88f-523e46c06d95 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:53.168439 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-a4777c48-a039-4c31-adea-ca070cf53e6b req-f7755fae-4b44-43e6-b3af-f33f29fad112 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058946 Oct 27 03:38:53.169245 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2011/4273] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:38:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:38:53.301957 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-af5676e9-7fa2-43e1-a3b5-7ac09cbd9cd1 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:53.303238 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-af5676e9-7fa2-43e1-a3b5-7ac09cbd9cd1 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] [instance: a5b04eee-69d9-4e2e-ac89-47cac8cdc538] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:53.332737 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-af5676e9-7fa2-43e1-a3b5-7ac09cbd9cd1 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:53.350422 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-af5676e9-7fa2-43e1-a3b5-7ac09cbd9cd1 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:53.351019 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-af5676e9-7fa2-43e1-a3b5-7ac09cbd9cd1 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:53.356808 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-af5676e9-7fa2-43e1-a3b5-7ac09cbd9cd1 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:53.357966 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ea9993cd-7d05-47a4-a88f-523e46c06d95 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18036411a99e4634bfbaeae24b9f254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229dcb63bc41444391544883b576ce2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:53.358916 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-af5676e9-7fa2-43e1-a3b5-7ac09cbd9cd1 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:53.359322 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-af5676e9-7fa2-43e1-a3b5-7ac09cbd9cd1 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:53.370793 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ea9993cd-7d05-47a4-a88f-523e46c06d95 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/c5c50ae8-6217-4650-8420-291847e21ace" status: 200 len: 1677 microversion: 2.1 time: 0.231219 Oct 27 03:38:53.383274 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2263/4274] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:53 2022] GET /compute/v2.1/servers/c5c50ae8-6217-4650-8420-291847e21ace => generated 1677 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:38:53.523484 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c9664480-2159-416a-a362-e0da10742148 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:53.524520 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c9664480-2159-416a-a362-e0da10742148 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:53.539066 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c9664480-2159-416a-a362-e0da10742148 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:53.539571 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c9664480-2159-416a-a362-e0da10742148 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:53.540014 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c9664480-2159-416a-a362-e0da10742148 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:53.540733 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c9664480-2159-416a-a362-e0da10742148 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:53.542086 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c9664480-2159-416a-a362-e0da10742148 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:53.546538 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c9664480-2159-416a-a362-e0da10742148 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:53.634339 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c9664480-2159-416a-a362-e0da10742148 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:53.634901 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c9664480-2159-416a-a362-e0da10742148 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:53.635495 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c9664480-2159-416a-a362-e0da10742148 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:53.635964 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-c9664480-2159-416a-a362-e0da10742148 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lazy-loading 'fault' on Instance uuid ed74f42b-af82-4808-bfc2-86110840fe86 {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:38:53.690666 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c9664480-2159-416a-a362-e0da10742148 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:53.699557 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c9664480-2159-416a-a362-e0da10742148 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1329 microversion: 2.1 time: 0.180032 Oct 27 03:38:53.705036 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2264/4275] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:53 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1329 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:38:53.712377 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d5275802-8d19-411e-be36-59021fb26bac tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:53.712377 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d5275802-8d19-411e-be36-59021fb26bac tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] [instance: 7e73d534-0a40-42d2-813c-2e9dbb9239ac] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:53.715329 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-af5676e9-7fa2-43e1-a3b5-7ac09cbd9cd1 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8e0bc10d3f451c8837c1f1e4d86eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4840257127594149b03c0aa3ab94b486', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:53.722407 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d5275802-8d19-411e-be36-59021fb26bac tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:53.723012 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d5275802-8d19-411e-be36-59021fb26bac tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:53.723708 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d5275802-8d19-411e-be36-59021fb26bac tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:53.725070 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d5275802-8d19-411e-be36-59021fb26bac tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:53.726138 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d5275802-8d19-411e-be36-59021fb26bac tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:53.726867 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d5275802-8d19-411e-be36-59021fb26bac tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:53.742912 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-af5676e9-7fa2-43e1-a3b5-7ac09cbd9cd1 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] 10.222.0.20 "GET /compute/v2.1/servers/a5b04eee-69d9-4e2e-ac89-47cac8cdc538" status: 200 len: 1395 microversion: 2.1 time: 0.454438 Oct 27 03:38:53.745373 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2012/4276] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:53 2022] GET /compute/v2.1/servers/a5b04eee-69d9-4e2e-ac89-47cac8cdc538 => generated 1395 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:38:53.907739 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7096966c-2a8a-46a8-834e-af895fef6b6c tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:53.909186 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7096966c-2a8a-46a8-834e-af895fef6b6c tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] [instance: e3b8bf04-529a-4909-9727-404cb7bba177] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:53.919481 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7096966c-2a8a-46a8-834e-af895fef6b6c tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:53.920575 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7096966c-2a8a-46a8-834e-af895fef6b6c tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:53.920903 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7096966c-2a8a-46a8-834e-af895fef6b6c tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:53.921928 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7096966c-2a8a-46a8-834e-af895fef6b6c tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:53.922585 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7096966c-2a8a-46a8-834e-af895fef6b6c tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:53.923632 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7096966c-2a8a-46a8-834e-af895fef6b6c tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:54.016744 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7096966c-2a8a-46a8-834e-af895fef6b6c tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:54.018007 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7096966c-2a8a-46a8-834e-af895fef6b6c tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:54.020566 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7096966c-2a8a-46a8-834e-af895fef6b6c tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:54.021325 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-7096966c-2a8a-46a8-834e-af895fef6b6c tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Lazy-loading 'fault' on Instance uuid e3b8bf04-529a-4909-9727-404cb7bba177 {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:38:54.083276 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d5275802-8d19-411e-be36-59021fb26bac tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:54.088636 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7096966c-2a8a-46a8-834e-af895fef6b6c tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51be346b3c5448c28ac57f5c1ffe50bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93732dbf56414de2b7667e1e70262a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:54.094865 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d5275802-8d19-411e-be36-59021fb26bac tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:54.097619 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d5275802-8d19-411e-be36-59021fb26bac tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:54.099886 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d5275802-8d19-411e-be36-59021fb26bac tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] 10.222.0.20 "GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac" status: 200 len: 1879 microversion: 2.32 time: 0.396412 Oct 27 03:38:54.110375 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7096966c-2a8a-46a8-834e-af895fef6b6c tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51be346b3c5448c28ac57f5c1ffe50bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93732dbf56414de2b7667e1e70262a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:54.110818 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2265/4277] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:38:53 2022] GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac => generated 1879 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:38:54.110929 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7096966c-2a8a-46a8-834e-af895fef6b6c tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51be346b3c5448c28ac57f5c1ffe50bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93732dbf56414de2b7667e1e70262a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:54.112456 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7096966c-2a8a-46a8-834e-af895fef6b6c tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] 10.222.0.20 "GET /compute/v2.1/servers/e3b8bf04-529a-4909-9727-404cb7bba177" status: 200 len: 1348 microversion: 2.21 time: 0.208568 Oct 27 03:38:54.113536 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2013/4278] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:38:53 2022] GET /compute/v2.1/servers/e3b8bf04-529a-4909-9727-404cb7bba177 => generated 1348 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:38:54.143665 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-1f43f775-092c-4b0c-a3af-3b5bb36b6de4 req-c478d979-1040-4a54-b8f7-01f85cf9f804 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5b04eee-69d9-4e2e-ac89-47cac8cdc538", "name": "network-vif-plugged", "status": "completed", "tag": "ac9f1ae7-c113-419c-8833-ae00612ec193"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:38:54.160026 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-1f43f775-092c-4b0c-a3af-3b5bb36b6de4 req-c478d979-1040-4a54-b8f7-01f85cf9f804 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:54.160649 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-1f43f775-092c-4b0c-a3af-3b5bb36b6de4 req-c478d979-1040-4a54-b8f7-01f85cf9f804 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:54.161213 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-1f43f775-092c-4b0c-a3af-3b5bb36b6de4 req-c478d979-1040-4a54-b8f7-01f85cf9f804 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:54.177586 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-1f43f775-092c-4b0c-a3af-3b5bb36b6de4 req-c478d979-1040-4a54-b8f7-01f85cf9f804 service nova] Creating event network-vif-plugged:ac9f1ae7-c113-419c-8833-ae00612ec193 for instance a5b04eee-69d9-4e2e-ac89-47cac8cdc538 on n-h1-862769-1 Oct 27 03:38:54.199344 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-1f43f775-092c-4b0c-a3af-3b5bb36b6de4 req-c478d979-1040-4a54-b8f7-01f85cf9f804 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059585 Oct 27 03:38:54.200308 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2266/4279] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:38:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:38:54.395893 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ea41d138-07cb-4c82-b49d-18f2959c3128 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:54.396798 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ea41d138-07cb-4c82-b49d-18f2959c3128 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: c5c50ae8-6217-4650-8420-291847e21ace] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:54.412462 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ea41d138-07cb-4c82-b49d-18f2959c3128 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:54.412462 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ea41d138-07cb-4c82-b49d-18f2959c3128 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:54.412462 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ea41d138-07cb-4c82-b49d-18f2959c3128 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:54.412462 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ea41d138-07cb-4c82-b49d-18f2959c3128 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:54.413342 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ea41d138-07cb-4c82-b49d-18f2959c3128 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:54.414012 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ea41d138-07cb-4c82-b49d-18f2959c3128 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:54.435523 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:38:54.712172 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ea41d138-07cb-4c82-b49d-18f2959c3128 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18036411a99e4634bfbaeae24b9f254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229dcb63bc41444391544883b576ce2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:54.724776 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ea41d138-07cb-4c82-b49d-18f2959c3128 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/c5c50ae8-6217-4650-8420-291847e21ace" status: 200 len: 1677 microversion: 2.1 time: 0.331738 Oct 27 03:38:54.725304 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-77d2066d-6077-476d-a492-7264432826b4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:54.730717 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-77d2066d-6077-476d-a492-7264432826b4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:54.730899 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2014/4280] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:54 2022] GET /compute/v2.1/servers/c5c50ae8-6217-4650-8420-291847e21ace => generated 1677 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:38:54.737651 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-77d2066d-6077-476d-a492-7264432826b4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:54.738256 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-77d2066d-6077-476d-a492-7264432826b4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:54.738720 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-77d2066d-6077-476d-a492-7264432826b4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:54.739449 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-77d2066d-6077-476d-a492-7264432826b4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:54.739918 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-77d2066d-6077-476d-a492-7264432826b4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:54.742574 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-77d2066d-6077-476d-a492-7264432826b4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:54.766339 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a41af260-4104-408f-a41b-f8e04e93f215 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:54.767021 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a41af260-4104-408f-a41b-f8e04e93f215 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] [instance: a5b04eee-69d9-4e2e-ac89-47cac8cdc538] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:54.777130 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a41af260-4104-408f-a41b-f8e04e93f215 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:54.777904 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a41af260-4104-408f-a41b-f8e04e93f215 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:54.778615 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a41af260-4104-408f-a41b-f8e04e93f215 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:54.780014 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a41af260-4104-408f-a41b-f8e04e93f215 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:54.780014 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a41af260-4104-408f-a41b-f8e04e93f215 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:54.780728 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a41af260-4104-408f-a41b-f8e04e93f215 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:54.788564 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-77d2066d-6077-476d-a492-7264432826b4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:54.789323 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-77d2066d-6077-476d-a492-7264432826b4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:54.790007 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-77d2066d-6077-476d-a492-7264432826b4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:54.790656 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-77d2066d-6077-476d-a492-7264432826b4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lazy-loading 'fault' on Instance uuid ed74f42b-af82-4808-bfc2-86110840fe86 {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:38:54.873883 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-77d2066d-6077-476d-a492-7264432826b4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94897f20beb94dbd8e7eff6ecba30026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9ede68f63747d59153a46412033856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:54.886793 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-77d2066d-6077-476d-a492-7264432826b4 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 200 len: 1329 microversion: 2.1 time: 0.166309 Oct 27 03:38:54.889314 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2267/4281] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:54 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 1329 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:38:55.025205 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a41af260-4104-408f-a41b-f8e04e93f215 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8e0bc10d3f451c8837c1f1e4d86eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4840257127594149b03c0aa3ab94b486', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:55.038902 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a41af260-4104-408f-a41b-f8e04e93f215 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] 10.222.0.20 "GET /compute/v2.1/servers/a5b04eee-69d9-4e2e-ac89-47cac8cdc538" status: 200 len: 1395 microversion: 2.1 time: 0.276236 Oct 27 03:38:55.054410 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2015/4282] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:54 2022] GET /compute/v2.1/servers/a5b04eee-69d9-4e2e-ac89-47cac8cdc538 => generated 1395 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:38:55.110589 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-56fed79c-599a-46c5-b149-63772fdab09c req-1854b870-cb7c-4c47-bfb4-d092439d0812 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5c50ae8-6217-4650-8420-291847e21ace", "name": "network-vif-deleted", "tag": "72613a85-f4ba-4f66-8e4c-034d84cc97e5"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:38:55.126771 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-56fed79c-599a-46c5-b149-63772fdab09c req-1854b870-cb7c-4c47-bfb4-d092439d0812 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:55.126771 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-56fed79c-599a-46c5-b149-63772fdab09c req-1854b870-cb7c-4c47-bfb4-d092439d0812 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:55.126771 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-56fed79c-599a-46c5-b149-63772fdab09c req-1854b870-cb7c-4c47-bfb4-d092439d0812 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:55.135847 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-39bc3f82-026c-44e9-9335-4aaf45f5fc08 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:55.136461 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-39bc3f82-026c-44e9-9335-4aaf45f5fc08 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] [instance: 7e73d534-0a40-42d2-813c-2e9dbb9239ac] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:55.149167 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-39bc3f82-026c-44e9-9335-4aaf45f5fc08 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:55.153255 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-39bc3f82-026c-44e9-9335-4aaf45f5fc08 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:55.153934 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-39bc3f82-026c-44e9-9335-4aaf45f5fc08 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:55.157335 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-39bc3f82-026c-44e9-9335-4aaf45f5fc08 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:55.158148 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-39bc3f82-026c-44e9-9335-4aaf45f5fc08 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:55.158769 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-39bc3f82-026c-44e9-9335-4aaf45f5fc08 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:55.172876 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-56fed79c-599a-46c5-b149-63772fdab09c req-1854b870-cb7c-4c47-bfb4-d092439d0812 service nova] Creating event network-vif-deleted:72613a85-f4ba-4f66-8e4c-034d84cc97e5 for instance c5c50ae8-6217-4650-8420-291847e21ace on n-h1-862769-1 Oct 27 03:38:55.181501 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-56fed79c-599a-46c5-b149-63772fdab09c req-1854b870-cb7c-4c47-bfb4-d092439d0812 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076298 Oct 27 03:38:55.186387 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2268/4283] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:38:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:38:55.203805 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8c22c9ce-0c9c-4ac6-b814-8137c798a37f tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:55.205856 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8c22c9ce-0c9c-4ac6-b814-8137c798a37f tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] [instance: e3b8bf04-529a-4909-9727-404cb7bba177] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:55.213135 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:38:55.222862 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8c22c9ce-0c9c-4ac6-b814-8137c798a37f tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:55.225896 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8c22c9ce-0c9c-4ac6-b814-8137c798a37f tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:55.227371 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8c22c9ce-0c9c-4ac6-b814-8137c798a37f tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:55.228422 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8c22c9ce-0c9c-4ac6-b814-8137c798a37f tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:55.230924 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8c22c9ce-0c9c-4ac6-b814-8137c798a37f tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:55.232236 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8c22c9ce-0c9c-4ac6-b814-8137c798a37f tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:55.258616 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-8c22c9ce-0c9c-4ac6-b814-8137c798a37f tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] HTTP exception thrown: Instance e3b8bf04-529a-4909-9727-404cb7bba177 could not be found. Oct 27 03:38:55.261516 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8c22c9ce-0c9c-4ac6-b814-8137c798a37f tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Request method failure captured: Oct 27 03:38:55.261516 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/e3b8bf04-529a-4909-9727-404cb7bba177 HTTP/1.1 Oct 27 03:38:55.261516 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:38:55.261516 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:38:55.261516 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:38:55.261516 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:38:55.261516 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:38:55.261516 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:38:55.261516 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:38:55.261516 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:38:55.261516 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWf0wVKLoJByu0L2-qeYAIKIlxFLCyP_RpH0eStRLHtinDJ1YMFwt5SIA-KHj8zGoRhjnWObAim8n8FTZURDgQo90G1k46G1kO5-JfQLcMdwTXw5y71Fzk3mI02YbCcIPw7k_AHI67uQI463fVQQP6BUFnm8-m7vzRVG23sm37ySK9J4 Oct 27 03:38:55.261516 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:38:55.261516 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:38:55.261516 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:38:55.261516 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:38:55.261516 n-d-862769-1 devstack@n-api.service[121001]: X-Openstack-Nova-Api-Version: 2.21 Oct 27 03:38:55.261516 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:38:55.261516 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:38:55.261516 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 93732dbf56414de2b7667e1e70262a32 Oct 27 03:38:55.261516 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-InstanceActionsV221TestJSON-528274811 Oct 27 03:38:55.261516 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:38:55.261516 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:38:55.261516 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/93732dbf56414de2b7667e1e70262a32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/93732dbf56414de2b7667e1e70262a32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/93732dbf56414de2b7667e1e70262a32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_93732dbf56414de2b7667e1e70262a32"}]}] Oct 27 03:38:55.261516 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-InstanceActionsV221TestJSON-528274811 Oct 27 03:38:55.261516 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 93732dbf56414de2b7667e1e70262a32 Oct 27 03:38:55.261516 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-528274811 Oct 27 03:38:55.261516 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-InstanceActionsV221TestJSON-528274811-project Oct 27 03:38:55.261516 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:38:55.261516 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:38:55.261516 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 51be346b3c5448c28ac57f5c1ffe50bc Oct 27 03:38:55.261516 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-InstanceActionsV221TestJSON-528274811-project Oct 27 03:38:55.261516 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:38:55.261516 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance e3b8bf04-529a-4909-9727-404cb7bba177 could not be found. Oct 27 03:38:55.261516 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': 'e3b8bf04-529a-4909-9727-404cb7bba177'} Oct 27 03:38:55.261516 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:38:55.261516 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:38:55.261516 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:38:55.261516 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:38:55.261516 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:38:55.261516 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:38:55.261516 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:38:55.261516 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:38:55.261516 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:38:55.261516 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:38:55.261516 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3b8bf04-529a-4909-9727-404cb7bba177 could not be found. Oct 27 03:38:55.261516 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:38:55.261516 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:38:55.261516 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:38:55.261516 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:38:55.261516 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:38:55.261516 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:38:55.261516 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:38:55.261516 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:38:55.261516 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:38:55.261516 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:38:55.261516 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:38:55.261516 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:38:55.261516 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:38:55.261516 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:38:55.261516 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:38:55.261516 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:38:55.261516 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3b8bf04-529a-4909-9727-404cb7bba177 could not be found. Oct 27 03:38:55.261516 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:38:55.261516 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:38:55.267141 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:38:55.267141 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:38:55.267141 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:38:55.267141 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:38:55.267141 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:38:55.267141 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:38:55.267141 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3b8bf04-529a-4909-9727-404cb7bba177 could not be found. Oct 27 03:38:55.267141 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:38:55.267827 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8c22c9ce-0c9c-4ac6-b814-8137c798a37f tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Returning 404 to user: Instance e3b8bf04-529a-4909-9727-404cb7bba177 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:38:55.269219 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8c22c9ce-0c9c-4ac6-b814-8137c798a37f tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] 10.222.0.20 "GET /compute/v2.1/servers/e3b8bf04-529a-4909-9727-404cb7bba177" status: 404 len: 111 microversion: 2.21 time: 0.079440 Oct 27 03:38:55.270186 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2269/4284] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:38:55 2022] GET /compute/v2.1/servers/e3b8bf04-529a-4909-9727-404cb7bba177 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 03:38:55.279127 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d8db1edf-c2e5-435b-89a6-c33c8b9c1a61 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Calling method '.version_select at 0x7f7dded66820>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:55.281029 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d8db1edf-c2e5-435b-89a6-c33c8b9c1a61 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] [instance: e3b8bf04-529a-4909-9727-404cb7bba177] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:55.287183 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d8db1edf-c2e5-435b-89a6-c33c8b9c1a61 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:55.287968 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d8db1edf-c2e5-435b-89a6-c33c8b9c1a61 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:55.288611 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d8db1edf-c2e5-435b-89a6-c33c8b9c1a61 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:55.289874 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d8db1edf-c2e5-435b-89a6-c33c8b9c1a61 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:55.290545 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d8db1edf-c2e5-435b-89a6-c33c8b9c1a61 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:55.291212 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d8db1edf-c2e5-435b-89a6-c33c8b9c1a61 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:55.415940 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d8db1edf-c2e5-435b-89a6-c33c8b9c1a61 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] 10.222.0.20 "GET /compute/v2.1/servers/e3b8bf04-529a-4909-9727-404cb7bba177/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.141096 Oct 27 03:38:55.418581 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2270/4285] 10.222.0.20 () {60 vars in 1337 bytes} [Thu Oct 27 03:38:55 2022] GET /compute/v2.1/servers/e3b8bf04-529a-4909-9727-404cb7bba177/os-instance-actions => generated 611 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 03:38:55.437767 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-161b24b1-cb32-4469-8a40-87c8d7bad2f8 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:55.440399 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-161b24b1-cb32-4469-8a40-87c8d7bad2f8 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] [instance: e3b8bf04-529a-4909-9727-404cb7bba177] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:55.445564 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-161b24b1-cb32-4469-8a40-87c8d7bad2f8 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:55.446388 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-161b24b1-cb32-4469-8a40-87c8d7bad2f8 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:55.447057 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-161b24b1-cb32-4469-8a40-87c8d7bad2f8 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:55.448916 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-161b24b1-cb32-4469-8a40-87c8d7bad2f8 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:55.449593 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-161b24b1-cb32-4469-8a40-87c8d7bad2f8 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:55.450943 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-161b24b1-cb32-4469-8a40-87c8d7bad2f8 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:55.474685 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:38:55.476219 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-161b24b1-cb32-4469-8a40-87c8d7bad2f8 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] HTTP exception thrown: Instance e3b8bf04-529a-4909-9727-404cb7bba177 could not be found. Oct 27 03:38:55.478283 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-161b24b1-cb32-4469-8a40-87c8d7bad2f8 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Request method failure captured: Oct 27 03:38:55.478283 n-d-862769-1 devstack@n-api.service[121001]: request: DELETE /compute/v2.1/servers/e3b8bf04-529a-4909-9727-404cb7bba177 HTTP/1.1 Oct 27 03:38:55.478283 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:38:55.478283 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:38:55.478283 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:38:55.478283 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:38:55.478283 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:38:55.478283 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:38:55.478283 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:38:55.478283 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:38:55.478283 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWf0wVKLoJByu0L2-qeYAIKIlxFLCyP_RpH0eStRLHtinDJ1YMFwt5SIA-KHj8zGoRhjnWObAim8n8FTZURDgQo90G1k46G1kO5-JfQLcMdwTXw5y71Fzk3mI02YbCcIPw7k_AHI67uQI463fVQQP6BUFnm8-m7vzRVG23sm37ySK9J4 Oct 27 03:38:55.478283 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:38:55.478283 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:38:55.478283 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:38:55.478283 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:38:55.478283 n-d-862769-1 devstack@n-api.service[121001]: X-Openstack-Nova-Api-Version: 2.21 Oct 27 03:38:55.478283 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:38:55.478283 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:38:55.478283 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 93732dbf56414de2b7667e1e70262a32 Oct 27 03:38:55.478283 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-InstanceActionsV221TestJSON-528274811 Oct 27 03:38:55.478283 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:38:55.478283 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:38:55.478283 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/93732dbf56414de2b7667e1e70262a32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/93732dbf56414de2b7667e1e70262a32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/93732dbf56414de2b7667e1e70262a32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_93732dbf56414de2b7667e1e70262a32"}]}] Oct 27 03:38:55.478283 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-InstanceActionsV221TestJSON-528274811 Oct 27 03:38:55.478283 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 93732dbf56414de2b7667e1e70262a32 Oct 27 03:38:55.478283 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-528274811 Oct 27 03:38:55.478283 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-InstanceActionsV221TestJSON-528274811-project Oct 27 03:38:55.478283 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:38:55.478283 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:38:55.478283 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 51be346b3c5448c28ac57f5c1ffe50bc Oct 27 03:38:55.478283 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-InstanceActionsV221TestJSON-528274811-project Oct 27 03:38:55.478283 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:38:55.478283 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance e3b8bf04-529a-4909-9727-404cb7bba177 could not be found. Oct 27 03:38:55.478283 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': 'e3b8bf04-529a-4909-9727-404cb7bba177'} Oct 27 03:38:55.478283 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:38:55.478283 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:38:55.478283 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:38:55.478283 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:38:55.478283 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:38:55.478283 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:38:55.478283 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:38:55.478283 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:38:55.478283 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:38:55.478283 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:38:55.478283 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3b8bf04-529a-4909-9727-404cb7bba177 could not be found. Oct 27 03:38:55.478283 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:38:55.478283 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:38:55.478283 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:38:55.478283 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:38:55.478283 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:38:55.478283 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:38:55.478283 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:38:55.478283 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:38:55.478283 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:38:55.478283 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:38:55.478283 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 03:38:55.478283 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 03:38:55.478283 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 03:38:55.478283 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 03:38:55.478283 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:38:55.478283 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:38:55.478283 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:38:55.478283 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:38:55.483805 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3b8bf04-529a-4909-9727-404cb7bba177 could not be found. Oct 27 03:38:55.483805 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:38:55.483805 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:38:55.483805 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:38:55.483805 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:38:55.483805 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:38:55.483805 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:38:55.483805 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:38:55.483805 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:38:55.483805 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3b8bf04-529a-4909-9727-404cb7bba177 could not be found. Oct 27 03:38:55.483805 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:38:55.485605 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-161b24b1-cb32-4469-8a40-87c8d7bad2f8 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Returning 404 to user: Instance e3b8bf04-529a-4909-9727-404cb7bba177 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:38:55.486740 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-161b24b1-cb32-4469-8a40-87c8d7bad2f8 tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e3b8bf04-529a-4909-9727-404cb7bba177" status: 404 len: 111 microversion: 2.21 time: 0.053992 Oct 27 03:38:55.487989 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2271/4286] 10.222.0.20 () {60 vars in 1280 bytes} [Thu Oct 27 03:38:55 2022] DELETE /compute/v2.1/servers/e3b8bf04-529a-4909-9727-404cb7bba177 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 27 03:38:55.509681 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f721e351-a2d1-4568-8585-276eacf08e1c tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:55.511368 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f721e351-a2d1-4568-8585-276eacf08e1c tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] [instance: e3b8bf04-529a-4909-9727-404cb7bba177] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:55.518567 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-39bc3f82-026c-44e9-9335-4aaf45f5fc08 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:55.523789 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f721e351-a2d1-4568-8585-276eacf08e1c tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:55.526745 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f721e351-a2d1-4568-8585-276eacf08e1c tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:55.532194 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f721e351-a2d1-4568-8585-276eacf08e1c tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:55.532194 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f721e351-a2d1-4568-8585-276eacf08e1c tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:55.532589 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-39bc3f82-026c-44e9-9335-4aaf45f5fc08 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:55.533164 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f721e351-a2d1-4568-8585-276eacf08e1c tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:55.533589 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-39bc3f82-026c-44e9-9335-4aaf45f5fc08 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:55.534025 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f721e351-a2d1-4568-8585-276eacf08e1c tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:55.535775 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-39bc3f82-026c-44e9-9335-4aaf45f5fc08 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] 10.222.0.20 "GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac" status: 200 len: 1879 microversion: 2.32 time: 0.404287 Oct 27 03:38:55.551135 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2016/4287] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:38:55 2022] GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac => generated 1879 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:38:55.571288 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-f721e351-a2d1-4568-8585-276eacf08e1c tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] HTTP exception thrown: Instance e3b8bf04-529a-4909-9727-404cb7bba177 could not be found. Oct 27 03:38:55.573803 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f721e351-a2d1-4568-8585-276eacf08e1c tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Request method failure captured: Oct 27 03:38:55.573803 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/e3b8bf04-529a-4909-9727-404cb7bba177 HTTP/1.1 Oct 27 03:38:55.573803 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:38:55.573803 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:38:55.573803 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:38:55.573803 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:38:55.573803 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:38:55.573803 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:38:55.573803 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:38:55.573803 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:38:55.573803 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWf0wVKLoJByu0L2-qeYAIKIlxFLCyP_RpH0eStRLHtinDJ1YMFwt5SIA-KHj8zGoRhjnWObAim8n8FTZURDgQo90G1k46G1kO5-JfQLcMdwTXw5y71Fzk3mI02YbCcIPw7k_AHI67uQI463fVQQP6BUFnm8-m7vzRVG23sm37ySK9J4 Oct 27 03:38:55.573803 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:38:55.573803 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:38:55.573803 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:38:55.573803 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:38:55.573803 n-d-862769-1 devstack@n-api.service[121001]: X-Openstack-Nova-Api-Version: 2.21 Oct 27 03:38:55.573803 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:38:55.573803 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:38:55.573803 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 93732dbf56414de2b7667e1e70262a32 Oct 27 03:38:55.573803 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-InstanceActionsV221TestJSON-528274811 Oct 27 03:38:55.573803 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:38:55.573803 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:38:55.573803 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/93732dbf56414de2b7667e1e70262a32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/93732dbf56414de2b7667e1e70262a32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/93732dbf56414de2b7667e1e70262a32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_93732dbf56414de2b7667e1e70262a32"}]}] Oct 27 03:38:55.573803 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-InstanceActionsV221TestJSON-528274811 Oct 27 03:38:55.573803 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 93732dbf56414de2b7667e1e70262a32 Oct 27 03:38:55.573803 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-528274811 Oct 27 03:38:55.573803 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-InstanceActionsV221TestJSON-528274811-project Oct 27 03:38:55.573803 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:38:55.573803 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:38:55.573803 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 51be346b3c5448c28ac57f5c1ffe50bc Oct 27 03:38:55.573803 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-InstanceActionsV221TestJSON-528274811-project Oct 27 03:38:55.573803 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:38:55.573803 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance e3b8bf04-529a-4909-9727-404cb7bba177 could not be found. Oct 27 03:38:55.573803 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': 'e3b8bf04-529a-4909-9727-404cb7bba177'} Oct 27 03:38:55.573803 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:38:55.573803 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:38:55.573803 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:38:55.573803 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:38:55.573803 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:38:55.573803 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:38:55.573803 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:38:55.573803 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:38:55.573803 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:38:55.573803 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:38:55.573803 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3b8bf04-529a-4909-9727-404cb7bba177 could not be found. Oct 27 03:38:55.573803 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:38:55.573803 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:38:55.573803 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:38:55.573803 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:38:55.573803 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:38:55.573803 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:38:55.573803 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:38:55.573803 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:38:55.573803 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:38:55.573803 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:38:55.573803 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:38:55.573803 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:38:55.573803 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:38:55.573803 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:38:55.573803 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:38:55.573803 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:38:55.573803 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3b8bf04-529a-4909-9727-404cb7bba177 could not be found. Oct 27 03:38:55.573803 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:38:55.573803 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:38:55.581236 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:38:55.581236 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:38:55.581236 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:38:55.581236 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:38:55.581236 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:38:55.581236 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:38:55.581236 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3b8bf04-529a-4909-9727-404cb7bba177 could not be found. Oct 27 03:38:55.581236 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:38:55.581236 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f721e351-a2d1-4568-8585-276eacf08e1c tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] Returning 404 to user: Instance e3b8bf04-529a-4909-9727-404cb7bba177 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:38:55.581236 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f721e351-a2d1-4568-8585-276eacf08e1c tempest-InstanceActionsV221TestJSON-528274811 tempest-InstanceActionsV221TestJSON-528274811-project] 10.222.0.20 "GET /compute/v2.1/servers/e3b8bf04-529a-4909-9727-404cb7bba177" status: 404 len: 111 microversion: 2.21 time: 0.084449 Oct 27 03:38:55.582249 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2272/4288] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:38:55 2022] GET /compute/v2.1/servers/e3b8bf04-529a-4909-9727-404cb7bba177 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 27 03:38:55.749255 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-985986b8-5387-4e27-bbe3-0933c376593e tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:55.749892 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-985986b8-5387-4e27-bbe3-0933c376593e tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: c5c50ae8-6217-4650-8420-291847e21ace] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:55.774186 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-985986b8-5387-4e27-bbe3-0933c376593e tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:55.775012 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-985986b8-5387-4e27-bbe3-0933c376593e tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:55.776740 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-985986b8-5387-4e27-bbe3-0933c376593e tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:55.778291 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-985986b8-5387-4e27-bbe3-0933c376593e tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:55.778999 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-985986b8-5387-4e27-bbe3-0933c376593e tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:55.779489 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-985986b8-5387-4e27-bbe3-0933c376593e tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:55.842938 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-985986b8-5387-4e27-bbe3-0933c376593e tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:55.843708 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-985986b8-5387-4e27-bbe3-0933c376593e tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:55.844324 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-985986b8-5387-4e27-bbe3-0933c376593e tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:55.844992 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-985986b8-5387-4e27-bbe3-0933c376593e tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lazy-loading 'fault' on Instance uuid c5c50ae8-6217-4650-8420-291847e21ace {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:38:55.917696 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a2fe7f58-d521-40ff-920e-39e8cfced6fb tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:55.918809 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a2fe7f58-d521-40ff-920e-39e8cfced6fb tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] [instance: ed74f42b-af82-4808-bfc2-86110840fe86] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:55.936779 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a2fe7f58-d521-40ff-920e-39e8cfced6fb tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:55.937573 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a2fe7f58-d521-40ff-920e-39e8cfced6fb tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:55.938313 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a2fe7f58-d521-40ff-920e-39e8cfced6fb tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:55.939307 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a2fe7f58-d521-40ff-920e-39e8cfced6fb tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:55.940173 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a2fe7f58-d521-40ff-920e-39e8cfced6fb tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:55.941085 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a2fe7f58-d521-40ff-920e-39e8cfced6fb tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:55.996230 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-a2fe7f58-d521-40ff-920e-39e8cfced6fb tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] HTTP exception thrown: Instance ed74f42b-af82-4808-bfc2-86110840fe86 could not be found. Oct 27 03:38:55.998352 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-985986b8-5387-4e27-bbe3-0933c376593e tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18036411a99e4634bfbaeae24b9f254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229dcb63bc41444391544883b576ce2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:55.999132 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a2fe7f58-d521-40ff-920e-39e8cfced6fb tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Request method failure captured: Oct 27 03:38:55.999132 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 HTTP/1.1 Oct 27 03:38:55.999132 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:38:55.999132 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:38:55.999132 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:38:55.999132 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:38:55.999132 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:38:55.999132 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:38:55.999132 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:38:55.999132 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:38:55.999132 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfsa_BAeMB3RnYvkmJQwjLzdAXRwOtmdTc4q-U2TyHH4sY2pC7-yKXDlPkKgdlBzGRlepw8PNzs2kNd86HTPJPZkHZ4DJy78RLBBzCNtKZaBrkpRAbSZW5Gv7329yxsJiAdDbJaiPVC-uHRtJPx_KALbDnjOM5yyEW86DSYN-HLC8ok Oct 27 03:38:55.999132 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:38:55.999132 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:38:55.999132 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:38:55.999132 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:38:55.999132 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:38:55.999132 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:38:55.999132 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 3e9ede68f63747d59153a46412033856 Oct 27 03:38:55.999132 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServerActionsTestJSON-24656121 Oct 27 03:38:55.999132 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:38:55.999132 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:38:55.999132 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3e9ede68f63747d59153a46412033856"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3e9ede68f63747d59153a46412033856"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3e9ede68f63747d59153a46412033856"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3e9ede68f63747d59153a46412033856"}]}] Oct 27 03:38:55.999132 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServerActionsTestJSON-24656121 Oct 27 03:38:55.999132 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 3e9ede68f63747d59153a46412033856 Oct 27 03:38:55.999132 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServerActionsTestJSON-24656121 Oct 27 03:38:55.999132 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServerActionsTestJSON-24656121-project Oct 27 03:38:55.999132 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:38:55.999132 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:38:55.999132 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 94897f20beb94dbd8e7eff6ecba30026 Oct 27 03:38:55.999132 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServerActionsTestJSON-24656121-project Oct 27 03:38:55.999132 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:38:55.999132 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance ed74f42b-af82-4808-bfc2-86110840fe86 could not be found. Oct 27 03:38:55.999132 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': 'ed74f42b-af82-4808-bfc2-86110840fe86'} Oct 27 03:38:55.999132 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:38:55.999132 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:38:55.999132 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:38:55.999132 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:38:55.999132 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:38:55.999132 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:38:55.999132 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:38:55.999132 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:38:55.999132 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:38:55.999132 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:38:55.999132 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed74f42b-af82-4808-bfc2-86110840fe86 could not be found. Oct 27 03:38:55.999132 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:38:55.999132 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:38:55.999132 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:38:55.999132 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:38:55.999132 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:38:55.999132 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:38:55.999132 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:38:55.999132 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:38:55.999132 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:38:55.999132 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:38:55.999132 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:38:55.999132 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:38:55.999132 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:38:55.999132 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:38:55.999132 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:38:55.999132 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:38:55.999132 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed74f42b-af82-4808-bfc2-86110840fe86 could not be found. Oct 27 03:38:55.999132 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:38:55.999132 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:38:55.999132 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:38:56.003906 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:38:56.003906 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:38:56.003906 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:38:56.003906 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:38:56.003906 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:38:56.003906 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed74f42b-af82-4808-bfc2-86110840fe86 could not be found. Oct 27 03:38:56.003906 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:38:56.003906 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a2fe7f58-d521-40ff-920e-39e8cfced6fb tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Returning 404 to user: Instance ed74f42b-af82-4808-bfc2-86110840fe86 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:38:56.003906 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a2fe7f58-d521-40ff-920e-39e8cfced6fb tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86" status: 404 len: 111 microversion: 2.1 time: 0.089141 Oct 27 03:38:56.006756 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2273/4289] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:55 2022] GET /compute/v2.1/servers/ed74f42b-af82-4808-bfc2-86110840fe86 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 03:38:56.012395 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-985986b8-5387-4e27-bbe3-0933c376593e tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/c5c50ae8-6217-4650-8420-291847e21ace" status: 200 len: 1329 microversion: 2.1 time: 0.267920 Oct 27 03:38:56.013217 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2017/4290] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:55 2022] GET /compute/v2.1/servers/c5c50ae8-6217-4650-8420-291847e21ace => generated 1329 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:38:56.016715 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7f20da4c-11cf-4bcd-92b2-f5f50d5696b5 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] Calling method '.version_select at 0x7f7dda466ee0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:56.066510 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-de55fde2-3f67-4165-bcdf-4863f3e7b6bc tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:56.067342 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-de55fde2-3f67-4165-bcdf-4863f3e7b6bc tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] [instance: a5b04eee-69d9-4e2e-ac89-47cac8cdc538] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:56.080157 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-de55fde2-3f67-4165-bcdf-4863f3e7b6bc tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:56.081028 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-de55fde2-3f67-4165-bcdf-4863f3e7b6bc tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:56.081708 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-de55fde2-3f67-4165-bcdf-4863f3e7b6bc tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:56.085536 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-de55fde2-3f67-4165-bcdf-4863f3e7b6bc tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:56.086298 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-de55fde2-3f67-4165-bcdf-4863f3e7b6bc tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:56.087070 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-de55fde2-3f67-4165-bcdf-4863f3e7b6bc tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:56.116783 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7f20da4c-11cf-4bcd-92b2-f5f50d5696b5 tempest-ServerActionsTestJSON-24656121 tempest-ServerActionsTestJSON-24656121-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1121307756" status: 202 len: 0 microversion: 2.1 time: 0.108011 Oct 27 03:38:56.117949 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2274/4291] 10.222.0.20 () {58 vars in 1221 bytes} [Thu Oct 27 03:38:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1121307756 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:38:56.485314 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-de55fde2-3f67-4165-bcdf-4863f3e7b6bc tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8e0bc10d3f451c8837c1f1e4d86eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4840257127594149b03c0aa3ab94b486', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:56.496329 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-de55fde2-3f67-4165-bcdf-4863f3e7b6bc tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] 10.222.0.20 "GET /compute/v2.1/servers/a5b04eee-69d9-4e2e-ac89-47cac8cdc538" status: 200 len: 1577 microversion: 2.1 time: 0.434303 Oct 27 03:38:56.497573 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2018/4292] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:56 2022] GET /compute/v2.1/servers/a5b04eee-69d9-4e2e-ac89-47cac8cdc538 => generated 1577 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:38:56.525279 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7af94660-1d1a-4c35-b57f-830588a4aafa tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:56.528363 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7af94660-1d1a-4c35-b57f-830588a4aafa tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] [instance: a5b04eee-69d9-4e2e-ac89-47cac8cdc538] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:56.536281 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7af94660-1d1a-4c35-b57f-830588a4aafa tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:56.536281 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7af94660-1d1a-4c35-b57f-830588a4aafa tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:56.536281 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7af94660-1d1a-4c35-b57f-830588a4aafa tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:56.536620 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7af94660-1d1a-4c35-b57f-830588a4aafa tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:56.537066 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7af94660-1d1a-4c35-b57f-830588a4aafa tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:56.537752 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7af94660-1d1a-4c35-b57f-830588a4aafa tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:56.564177 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0adabc2d-d9b3-4462-a105-8a7e77c3bdde tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:56.565318 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0adabc2d-d9b3-4462-a105-8a7e77c3bdde tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] [instance: 7e73d534-0a40-42d2-813c-2e9dbb9239ac] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:56.572231 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0adabc2d-d9b3-4462-a105-8a7e77c3bdde tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:56.573209 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0adabc2d-d9b3-4462-a105-8a7e77c3bdde tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:56.573834 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0adabc2d-d9b3-4462-a105-8a7e77c3bdde tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:56.574920 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0adabc2d-d9b3-4462-a105-8a7e77c3bdde tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:56.575872 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0adabc2d-d9b3-4462-a105-8a7e77c3bdde tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:56.576472 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0adabc2d-d9b3-4462-a105-8a7e77c3bdde tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:56.701811 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7af94660-1d1a-4c35-b57f-830588a4aafa tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] 10.222.0.20 "GET /compute/v2.1/servers/a5b04eee-69d9-4e2e-ac89-47cac8cdc538/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.181080 Oct 27 03:38:56.706773 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2275/4293] 10.222.0.20 () {58 vars in 1275 bytes} [Thu Oct 27 03:38:56 2022] GET /compute/v2.1/servers/a5b04eee-69d9-4e2e-ac89-47cac8cdc538/os-interface => generated 285 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:38:57.045820 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-75404585-859d-4c6d-83fd-7a744f5397fe tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:57.046800 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-75404585-859d-4c6d-83fd-7a744f5397fe tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: c5c50ae8-6217-4650-8420-291847e21ace] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:57.055107 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-75404585-859d-4c6d-83fd-7a744f5397fe tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:57.055904 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-75404585-859d-4c6d-83fd-7a744f5397fe tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:57.056584 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-75404585-859d-4c6d-83fd-7a744f5397fe tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:57.057735 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-75404585-859d-4c6d-83fd-7a744f5397fe tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:57.058404 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-75404585-859d-4c6d-83fd-7a744f5397fe tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:57.059008 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-75404585-859d-4c6d-83fd-7a744f5397fe tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:57.078261 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-75404585-859d-4c6d-83fd-7a744f5397fe tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] HTTP exception thrown: Instance c5c50ae8-6217-4650-8420-291847e21ace could not be found. Oct 27 03:38:57.080627 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-75404585-859d-4c6d-83fd-7a744f5397fe tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Request method failure captured: Oct 27 03:38:57.080627 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/c5c50ae8-6217-4650-8420-291847e21ace HTTP/1.1 Oct 27 03:38:57.080627 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:38:57.080627 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:38:57.080627 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:38:57.080627 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:38:57.080627 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:38:57.080627 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:38:57.080627 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:38:57.080627 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:38:57.080627 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfyO20A1D6ympGjQc2k7pGwXBVoOs4AtFX551niq39NWe_HjifvxGvre6cHeeNp8osa7J1PNEE0_yy7-MG05YNEONXkGtR3-F0Zb6-60FxqOiIpeJ5N_dbXBRWjEl88UsCCW068A90fytHXWgtrGlYksZomXGQlrDugSxyxjlY4_NPY Oct 27 03:38:57.080627 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:38:57.080627 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:38:57.080627 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:38:57.080627 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:38:57.080627 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:38:57.080627 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:38:57.080627 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 229dcb63bc41444391544883b576ce2e Oct 27 03:38:57.080627 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-AttachVolumeNegativeTest-199004901 Oct 27 03:38:57.080627 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:38:57.080627 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:38:57.080627 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/229dcb63bc41444391544883b576ce2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/229dcb63bc41444391544883b576ce2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/229dcb63bc41444391544883b576ce2e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_229dcb63bc41444391544883b576ce2e"}]}] Oct 27 03:38:57.080627 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-AttachVolumeNegativeTest-199004901 Oct 27 03:38:57.080627 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 229dcb63bc41444391544883b576ce2e Oct 27 03:38:57.080627 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-199004901 Oct 27 03:38:57.080627 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-AttachVolumeNegativeTest-199004901-project Oct 27 03:38:57.080627 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:38:57.080627 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:38:57.080627 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 18036411a99e4634bfbaeae24b9f254d Oct 27 03:38:57.080627 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-AttachVolumeNegativeTest-199004901-project Oct 27 03:38:57.080627 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:38:57.080627 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance c5c50ae8-6217-4650-8420-291847e21ace could not be found. Oct 27 03:38:57.080627 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': 'c5c50ae8-6217-4650-8420-291847e21ace'} Oct 27 03:38:57.080627 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:38:57.080627 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:38:57.080627 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:38:57.080627 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:38:57.080627 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:38:57.080627 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:38:57.080627 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:38:57.080627 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:38:57.080627 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:38:57.080627 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:38:57.080627 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5c50ae8-6217-4650-8420-291847e21ace could not be found. Oct 27 03:38:57.080627 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:38:57.080627 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:38:57.080627 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:38:57.080627 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:38:57.080627 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:38:57.080627 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:38:57.080627 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:38:57.080627 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:38:57.080627 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:38:57.080627 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:38:57.080627 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:38:57.080627 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:38:57.080627 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:38:57.080627 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:38:57.080627 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:38:57.080627 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:38:57.080627 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5c50ae8-6217-4650-8420-291847e21ace could not be found. Oct 27 03:38:57.080627 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:38:57.080627 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:38:57.080627 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:38:57.087109 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:38:57.087109 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:38:57.087109 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:38:57.087109 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:38:57.087109 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:38:57.087109 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5c50ae8-6217-4650-8420-291847e21ace could not be found. Oct 27 03:38:57.087109 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:38:57.089340 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-75404585-859d-4c6d-83fd-7a744f5397fe tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Returning 404 to user: Instance c5c50ae8-6217-4650-8420-291847e21ace could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:38:57.090990 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-75404585-859d-4c6d-83fd-7a744f5397fe tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/c5c50ae8-6217-4650-8420-291847e21ace" status: 404 len: 111 microversion: 2.1 time: 0.050777 Oct 27 03:38:57.096383 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2276/4294] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:57 2022] GET /compute/v2.1/servers/c5c50ae8-6217-4650-8420-291847e21ace => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 03:38:57.101865 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c79f27f6-295d-4db7-9c0a-edd1e2cfa906 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '.version_select at 0x7f7dded534c0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:57.128585 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0adabc2d-d9b3-4462-a105-8a7e77c3bdde tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:57.144377 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0adabc2d-d9b3-4462-a105-8a7e77c3bdde tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:57.145851 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0adabc2d-d9b3-4462-a105-8a7e77c3bdde tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:57.147286 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0adabc2d-d9b3-4462-a105-8a7e77c3bdde tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] 10.222.0.20 "GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac" status: 200 len: 1879 microversion: 2.32 time: 0.587340 Oct 27 03:38:57.148433 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2019/4295] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:38:56 2022] GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac => generated 1879 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:38:57.185422 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c79f27f6-295d-4db7-9c0a-edd1e2cfa906 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-56934881" status: 202 len: 0 microversion: 2.1 time: 0.087667 Oct 27 03:38:57.190854 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2277/4296] 10.222.0.20 () {58 vars in 1215 bytes} [Thu Oct 27 03:38:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-56934881 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:38:58.175424 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-97878029-e1c8-4dab-ba52-1bc576edbaf0 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:58.176685 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-97878029-e1c8-4dab-ba52-1bc576edbaf0 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] [instance: 7e73d534-0a40-42d2-813c-2e9dbb9239ac] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:58.184656 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-97878029-e1c8-4dab-ba52-1bc576edbaf0 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:58.185493 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-97878029-e1c8-4dab-ba52-1bc576edbaf0 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:58.185948 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-97878029-e1c8-4dab-ba52-1bc576edbaf0 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:58.186717 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-97878029-e1c8-4dab-ba52-1bc576edbaf0 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:58.187363 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-97878029-e1c8-4dab-ba52-1bc576edbaf0 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:58.187973 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-97878029-e1c8-4dab-ba52-1bc576edbaf0 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:58.570322 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-97878029-e1c8-4dab-ba52-1bc576edbaf0 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:58.580258 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-97878029-e1c8-4dab-ba52-1bc576edbaf0 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:58.581944 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-97878029-e1c8-4dab-ba52-1bc576edbaf0 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:58.584946 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-97878029-e1c8-4dab-ba52-1bc576edbaf0 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] 10.222.0.20 "GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac" status: 200 len: 1879 microversion: 2.32 time: 0.413390 Oct 27 03:38:58.585935 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2020/4297] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:38:58 2022] GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac => generated 1879 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:38:59.277733 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f68d59bf-295d-4707-93db-26c40fd8b54f tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:59.278490 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f68d59bf-295d-4707-93db-26c40fd8b54f tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] [instance: a5b04eee-69d9-4e2e-ac89-47cac8cdc538] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:59.293229 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f68d59bf-295d-4707-93db-26c40fd8b54f tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:59.302819 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-4860be07-5d51-4111-bea7-1e5006ef56b6 req-c4c3064a-9bf2-4308-9d83-54f927efc2ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5b04eee-69d9-4e2e-ac89-47cac8cdc538", "tag": "ac9f1ae7-c113-419c-8833-ae00612ec193"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:38:59.310846 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f68d59bf-295d-4707-93db-26c40fd8b54f tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:59.311322 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f68d59bf-295d-4707-93db-26c40fd8b54f tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:59.312087 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f68d59bf-295d-4707-93db-26c40fd8b54f tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:59.312561 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f68d59bf-295d-4707-93db-26c40fd8b54f tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:59.319137 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f68d59bf-295d-4707-93db-26c40fd8b54f tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:59.325692 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-4860be07-5d51-4111-bea7-1e5006ef56b6 req-c4c3064a-9bf2-4308-9d83-54f927efc2ac service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:59.326229 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-4860be07-5d51-4111-bea7-1e5006ef56b6 req-c4c3064a-9bf2-4308-9d83-54f927efc2ac service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:59.326760 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-4860be07-5d51-4111-bea7-1e5006ef56b6 req-c4c3064a-9bf2-4308-9d83-54f927efc2ac service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:59.382107 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-4860be07-5d51-4111-bea7-1e5006ef56b6 req-c4c3064a-9bf2-4308-9d83-54f927efc2ac service nova] Creating event network-changed:ac9f1ae7-c113-419c-8833-ae00612ec193 for instance a5b04eee-69d9-4e2e-ac89-47cac8cdc538 on n-h1-862769-1 Oct 27 03:38:59.399863 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-4860be07-5d51-4111-bea7-1e5006ef56b6 req-c4c3064a-9bf2-4308-9d83-54f927efc2ac service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101438 Oct 27 03:38:59.401618 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2021/4298] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:38:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:38:59.617457 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-20ea8c52-aeeb-428e-b5ae-3a2ed0c20f09 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:38:59.619773 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-20ea8c52-aeeb-428e-b5ae-3a2ed0c20f09 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] [instance: 7e73d534-0a40-42d2-813c-2e9dbb9239ac] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:38:59.632007 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-20ea8c52-aeeb-428e-b5ae-3a2ed0c20f09 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:59.634781 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-20ea8c52-aeeb-428e-b5ae-3a2ed0c20f09 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:59.635467 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-20ea8c52-aeeb-428e-b5ae-3a2ed0c20f09 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:59.636458 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-20ea8c52-aeeb-428e-b5ae-3a2ed0c20f09 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:38:59.637671 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-20ea8c52-aeeb-428e-b5ae-3a2ed0c20f09 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:38:59.640334 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-20ea8c52-aeeb-428e-b5ae-3a2ed0c20f09 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:38:59.877704 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f68d59bf-295d-4707-93db-26c40fd8b54f tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8e0bc10d3f451c8837c1f1e4d86eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4840257127594149b03c0aa3ab94b486', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:38:59.905045 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f68d59bf-295d-4707-93db-26c40fd8b54f tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] 10.222.0.20 "GET /compute/v2.1/servers/a5b04eee-69d9-4e2e-ac89-47cac8cdc538" status: 200 len: 1577 microversion: 2.1 time: 0.632855 Oct 27 03:38:59.936411 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2278/4299] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:38:59 2022] GET /compute/v2.1/servers/a5b04eee-69d9-4e2e-ac89-47cac8cdc538 => generated 1577 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:38:59.941490 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-96e52a81-db4b-44b3-9c7c-0b5beeb595fc tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Action: 'create', calling method: .version_select at 0x7f7dda4eb8b0>, body: {"keypair": {"name": "tempest-keypair-100889886", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCRTjecDBO3PuoO0R8pl6WDh42F43ZQk6L9vj7nGg8hS2gVdEJH9ErwcM6jvO+67onGartSvI2iWBQNKxrCc7vTKEOP1B1R2fq7Gv/h4Pk2S2+3O1lGCut8GmiP7hsO+hg=="}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:38:59.994996 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-96e52a81-db4b-44b3-9c7c-0b5beeb595fc tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Getting quotas for project 229dcb63bc41444391544883b576ce2e. Resources: {'key_pairs'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:39:00.007288 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-96e52a81-db4b-44b3-9c7c-0b5beeb595fc tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Getting quotas for user 18036411a99e4634bfbaeae24b9f254d and project 229dcb63bc41444391544883b576ce2e. Resources: {'key_pairs'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:39:00.123495 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-96e52a81-db4b-44b3-9c7c-0b5beeb595fc tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.185722 Oct 27 03:39:00.132763 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2279/4300] 10.222.0.20 () {60 vars in 1159 bytes} [Thu Oct 27 03:38:59 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:39:00.253128 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-20ea8c52-aeeb-428e-b5ae-3a2ed0c20f09 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:00.265062 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-20ea8c52-aeeb-428e-b5ae-3a2ed0c20f09 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:00.270989 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-20ea8c52-aeeb-428e-b5ae-3a2ed0c20f09 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:00.272424 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-20ea8c52-aeeb-428e-b5ae-3a2ed0c20f09 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] 10.222.0.20 "GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac" status: 200 len: 1879 microversion: 2.32 time: 0.660144 Oct 27 03:39:00.273915 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2022/4301] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:38:59 2022] GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac => generated 1879 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:39:01.306714 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9146d939-34dd-4139-8ab1-3e31a8e1a78a tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:01.308200 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-9146d939-34dd-4139-8ab1-3e31a8e1a78a tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] [instance: 7e73d534-0a40-42d2-813c-2e9dbb9239ac] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:01.315240 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9146d939-34dd-4139-8ab1-3e31a8e1a78a tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:01.316242 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9146d939-34dd-4139-8ab1-3e31a8e1a78a tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:01.317043 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9146d939-34dd-4139-8ab1-3e31a8e1a78a tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:01.318245 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9146d939-34dd-4139-8ab1-3e31a8e1a78a tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:01.319017 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9146d939-34dd-4139-8ab1-3e31a8e1a78a tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:01.319707 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9146d939-34dd-4139-8ab1-3e31a8e1a78a tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:01.786648 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9146d939-34dd-4139-8ab1-3e31a8e1a78a tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:01.811521 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9146d939-34dd-4139-8ab1-3e31a8e1a78a tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:01.815214 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9146d939-34dd-4139-8ab1-3e31a8e1a78a tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:01.818394 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9146d939-34dd-4139-8ab1-3e31a8e1a78a tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] 10.222.0.20 "GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac" status: 200 len: 1879 microversion: 2.32 time: 0.517050 Oct 27 03:39:01.819044 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2280/4302] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:39:01 2022] GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac => generated 1879 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:39:02.849120 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-90d02bf7-1052-4c23-82f3-8853c00679a4 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:02.851154 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-90d02bf7-1052-4c23-82f3-8853c00679a4 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] [instance: 7e73d534-0a40-42d2-813c-2e9dbb9239ac] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:02.858818 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-90d02bf7-1052-4c23-82f3-8853c00679a4 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:02.860102 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-90d02bf7-1052-4c23-82f3-8853c00679a4 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:02.860715 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-90d02bf7-1052-4c23-82f3-8853c00679a4 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:02.861896 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-90d02bf7-1052-4c23-82f3-8853c00679a4 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:02.862577 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-90d02bf7-1052-4c23-82f3-8853c00679a4 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:02.863012 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-90d02bf7-1052-4c23-82f3-8853c00679a4 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:03.222657 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-90d02bf7-1052-4c23-82f3-8853c00679a4 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:03.294530 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-90d02bf7-1052-4c23-82f3-8853c00679a4 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:03.299112 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-90d02bf7-1052-4c23-82f3-8853c00679a4 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:03.307592 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-90d02bf7-1052-4c23-82f3-8853c00679a4 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] 10.222.0.20 "GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac" status: 200 len: 1879 microversion: 2.32 time: 0.455448 Oct 27 03:39:03.328869 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2023/4303] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:39:02 2022] GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac => generated 1879 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:39:03.511550 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c985f084-a3d4-42c5-bce0-7c58d636e5ae tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:03.512610 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c985f084-a3d4-42c5-bce0-7c58d636e5ae tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 2ec095f2-c25e-434f-87ff-10788b0fe6c3] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:03.523513 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c985f084-a3d4-42c5-bce0-7c58d636e5ae tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:03.524018 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c985f084-a3d4-42c5-bce0-7c58d636e5ae tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:03.524462 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c985f084-a3d4-42c5-bce0-7c58d636e5ae tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:03.525175 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c985f084-a3d4-42c5-bce0-7c58d636e5ae tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:03.525683 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c985f084-a3d4-42c5-bce0-7c58d636e5ae tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:03.526145 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c985f084-a3d4-42c5-bce0-7c58d636e5ae tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:03.589236 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c985f084-a3d4-42c5-bce0-7c58d636e5ae tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 2ec095f2-c25e-434f-87ff-10788b0fe6c3] Going to try to terminate instance {{(pid=121001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:39:03.935897 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c985f084-a3d4-42c5-bce0-7c58d636e5ae tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2ec095f2-c25e-434f-87ff-10788b0fe6c3" status: 204 len: 0 microversion: 2.1 time: 0.428798 Oct 27 03:39:03.936760 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2281/4304] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:39:03 2022] DELETE /compute/v2.1/servers/2ec095f2-c25e-434f-87ff-10788b0fe6c3 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:39:03.948547 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-58988f52-59db-469e-af24-704be5ef921b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:03.949918 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-58988f52-59db-469e-af24-704be5ef921b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 2ec095f2-c25e-434f-87ff-10788b0fe6c3] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:03.957595 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-58988f52-59db-469e-af24-704be5ef921b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:03.958440 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-58988f52-59db-469e-af24-704be5ef921b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:03.959018 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-58988f52-59db-469e-af24-704be5ef921b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:03.960041 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-58988f52-59db-469e-af24-704be5ef921b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:03.961356 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-58988f52-59db-469e-af24-704be5ef921b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:03.962445 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-58988f52-59db-469e-af24-704be5ef921b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:04.186099 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-58988f52-59db-469e-af24-704be5ef921b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:04.198900 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-58988f52-59db-469e-af24-704be5ef921b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/2ec095f2-c25e-434f-87ff-10788b0fe6c3" status: 200 len: 1555 microversion: 2.1 time: 0.257517 Oct 27 03:39:04.200153 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2024/4305] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:03 2022] GET /compute/v2.1/servers/2ec095f2-c25e-434f-87ff-10788b0fe6c3 => generated 1555 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:39:04.341971 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b21d5e15-d940-4a07-9b39-70f05e4a3726 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:04.342713 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b21d5e15-d940-4a07-9b39-70f05e4a3726 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] [instance: 7e73d534-0a40-42d2-813c-2e9dbb9239ac] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:04.353530 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b21d5e15-d940-4a07-9b39-70f05e4a3726 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:04.355113 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b21d5e15-d940-4a07-9b39-70f05e4a3726 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:04.355718 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b21d5e15-d940-4a07-9b39-70f05e4a3726 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:04.357602 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b21d5e15-d940-4a07-9b39-70f05e4a3726 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:04.357602 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b21d5e15-d940-4a07-9b39-70f05e4a3726 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:04.358845 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b21d5e15-d940-4a07-9b39-70f05e4a3726 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:05.193051 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b21d5e15-d940-4a07-9b39-70f05e4a3726 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:05.228102 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-14b061bf-2c44-4d33-a4aa-98a34d8b125e tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:05.229276 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-14b061bf-2c44-4d33-a4aa-98a34d8b125e tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 2ec095f2-c25e-434f-87ff-10788b0fe6c3] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:05.247204 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b21d5e15-d940-4a07-9b39-70f05e4a3726 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:05.251389 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b21d5e15-d940-4a07-9b39-70f05e4a3726 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:05.252920 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-14b061bf-2c44-4d33-a4aa-98a34d8b125e tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:05.253813 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-14b061bf-2c44-4d33-a4aa-98a34d8b125e tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:05.256155 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-14b061bf-2c44-4d33-a4aa-98a34d8b125e tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:05.257972 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-14b061bf-2c44-4d33-a4aa-98a34d8b125e tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:05.258627 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-14b061bf-2c44-4d33-a4aa-98a34d8b125e tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:05.267376 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b21d5e15-d940-4a07-9b39-70f05e4a3726 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] 10.222.0.20 "GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac" status: 200 len: 1879 microversion: 2.32 time: 0.921586 Oct 27 03:39:05.267376 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2282/4306] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:39:04 2022] GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac => generated 1879 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:39:05.273376 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-14b061bf-2c44-4d33-a4aa-98a34d8b125e tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:05.721057 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-cf43b6ce-36ff-43a8-a10d-114fdab6b992 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Action: 'create', calling method: .version_select at 0x7f7dda0d8280>, body: {"keypair": {"name": "tempest-keypair-1326885653", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFNCUqk3pc89bWj1N+tH29o5DWSE0tJXPGfM6mU9G36uw4K1XtwTDGZo6/TLW7JWuZVPzWVIlVB+FEs+AYVCo4GN/vy2A6KcmG+QLCEhvDfOS4mjmGVloiDA3QvGSN+IfA=="}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:39:05.745048 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-cf43b6ce-36ff-43a8-a10d-114fdab6b992 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Getting quotas for project 38450368ef5c4e68ac3c19c7a0a1ce65. Resources: {'key_pairs'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:39:05.754585 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-cf43b6ce-36ff-43a8-a10d-114fdab6b992 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Getting quotas for user 5ffc2b1c410149e884a47240b5425e57 and project 38450368ef5c4e68ac3c19c7a0a1ce65. Resources: {'key_pairs'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:39:05.848677 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-cf43b6ce-36ff-43a8-a10d-114fdab6b992 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.400833 Oct 27 03:39:05.850685 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2283/4307] 10.222.0.20 () {60 vars in 1159 bytes} [Thu Oct 27 03:39:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:39:06.013723 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-14b061bf-2c44-4d33-a4aa-98a34d8b125e tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:06.032674 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-14b061bf-2c44-4d33-a4aa-98a34d8b125e tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/2ec095f2-c25e-434f-87ff-10788b0fe6c3" status: 200 len: 1555 microversion: 2.1 time: 0.811600 Oct 27 03:39:06.033291 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2025/4308] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:05 2022] GET /compute/v2.1/servers/2ec095f2-c25e-434f-87ff-10788b0fe6c3 => generated 1555 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:39:06.294622 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ca1faec9-63e5-4bf7-ba59-debfb15c91f8 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:06.299454 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ca1faec9-63e5-4bf7-ba59-debfb15c91f8 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] [instance: 7e73d534-0a40-42d2-813c-2e9dbb9239ac] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:06.310480 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ca1faec9-63e5-4bf7-ba59-debfb15c91f8 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:06.312469 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ca1faec9-63e5-4bf7-ba59-debfb15c91f8 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:06.312932 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ca1faec9-63e5-4bf7-ba59-debfb15c91f8 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:06.313670 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ca1faec9-63e5-4bf7-ba59-debfb15c91f8 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:06.314179 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ca1faec9-63e5-4bf7-ba59-debfb15c91f8 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:06.314620 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ca1faec9-63e5-4bf7-ba59-debfb15c91f8 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:06.884792 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-574b4f64-7485-4422-b27b-46922578118d tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-18139852", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "015ce8ac-7a6f-4fac-a9b8-c0d16c24afe3"}], "security_groups": [{"name": "tempest-securitygroup--626360875"}], "key_name": "tempest-keypair-100889886", "user_data": "}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:39:06.906327 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ca1faec9-63e5-4bf7-ba59-debfb15c91f8 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:06.935420 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ca1faec9-63e5-4bf7-ba59-debfb15c91f8 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:06.938720 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ca1faec9-63e5-4bf7-ba59-debfb15c91f8 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:06.939587 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ca1faec9-63e5-4bf7-ba59-debfb15c91f8 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] 10.222.0.20 "GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac" status: 200 len: 1879 microversion: 2.32 time: 0.649795 Oct 27 03:39:06.959752 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2284/4309] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:39:06 2022] GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac => generated 1879 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:39:07.059828 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f67182b2-c9a3-47ad-983f-bb5f262318db tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:07.061376 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f67182b2-c9a3-47ad-983f-bb5f262318db tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 2ec095f2-c25e-434f-87ff-10788b0fe6c3] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:07.071507 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f67182b2-c9a3-47ad-983f-bb5f262318db tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:07.072593 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f67182b2-c9a3-47ad-983f-bb5f262318db tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:07.073930 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f67182b2-c9a3-47ad-983f-bb5f262318db tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:07.075757 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f67182b2-c9a3-47ad-983f-bb5f262318db tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:07.076544 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f67182b2-c9a3-47ad-983f-bb5f262318db tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:07.077421 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f67182b2-c9a3-47ad-983f-bb5f262318db tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:07.162382 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-574b4f64-7485-4422-b27b-46922578118d tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] validate_networks() for [('015ce8ac-7a6f-4fac-a9b8-c0d16c24afe3', None, None, None, None, None)] {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:39:07.287238 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f67182b2-c9a3-47ad-983f-bb5f262318db tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:07.299827 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f67182b2-c9a3-47ad-983f-bb5f262318db tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/2ec095f2-c25e-434f-87ff-10788b0fe6c3" status: 200 len: 1555 microversion: 2.1 time: 0.246608 Oct 27 03:39:07.303430 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2285/4310] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:07 2022] GET /compute/v2.1/servers/2ec095f2-c25e-434f-87ff-10788b0fe6c3 => generated 1555 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:39:07.971598 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-480b6622-adf2-407b-9ed6-b0738261e19b tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:07.972548 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-480b6622-adf2-407b-9ed6-b0738261e19b tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] [instance: 7e73d534-0a40-42d2-813c-2e9dbb9239ac] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:07.982812 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-480b6622-adf2-407b-9ed6-b0738261e19b tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:07.983898 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-480b6622-adf2-407b-9ed6-b0738261e19b tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:07.985632 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-480b6622-adf2-407b-9ed6-b0738261e19b tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:07.986877 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-480b6622-adf2-407b-9ed6-b0738261e19b tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:07.988072 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-480b6622-adf2-407b-9ed6-b0738261e19b tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:07.989117 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-480b6622-adf2-407b-9ed6-b0738261e19b tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:08.379273 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-574b4f64-7485-4422-b27b-46922578118d tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:39:08.380451 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-574b4f64-7485-4422-b27b-46922578118d tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:39:08.381972 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-574b4f64-7485-4422-b27b-46922578118d tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:39:08.383763 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-574b4f64-7485-4422-b27b-46922578118d tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:39:08.386992 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-574b4f64-7485-4422-b27b-46922578118d tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:39:08.408682 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-574b4f64-7485-4422-b27b-46922578118d tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:08.409661 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-574b4f64-7485-4422-b27b-46922578118d tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:08.411122 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-574b4f64-7485-4422-b27b-46922578118d tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:08.412788 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-574b4f64-7485-4422-b27b-46922578118d tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:08.413411 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-574b4f64-7485-4422-b27b-46922578118d tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:08.414194 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-574b4f64-7485-4422-b27b-46922578118d tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:08.428824 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-480b6622-adf2-407b-9ed6-b0738261e19b tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:08.454686 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-480b6622-adf2-407b-9ed6-b0738261e19b tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:08.456422 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-480b6622-adf2-407b-9ed6-b0738261e19b tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:08.457709 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-480b6622-adf2-407b-9ed6-b0738261e19b tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] 10.222.0.20 "GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac" status: 200 len: 1879 microversion: 2.32 time: 0.491638 Oct 27 03:39:08.458590 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2286/4311] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:39:07 2022] GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac => generated 1879 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:39:08.463455 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0d53a8e2-c9db-4e7b-930b-7efd0ef061bc tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:08.464228 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0d53a8e2-c9db-4e7b-930b-7efd0ef061bc tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 2ec095f2-c25e-434f-87ff-10788b0fe6c3] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:08.472319 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0d53a8e2-c9db-4e7b-930b-7efd0ef061bc tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:08.473467 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0d53a8e2-c9db-4e7b-930b-7efd0ef061bc tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:08.474287 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0d53a8e2-c9db-4e7b-930b-7efd0ef061bc tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:08.475325 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0d53a8e2-c9db-4e7b-930b-7efd0ef061bc tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:08.476162 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0d53a8e2-c9db-4e7b-930b-7efd0ef061bc tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:08.476826 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0d53a8e2-c9db-4e7b-930b-7efd0ef061bc tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:08.527250 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-574b4f64-7485-4422-b27b-46922578118d tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Getting quotas for project 229dcb63bc41444391544883b576ce2e. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:39:08.537861 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-574b4f64-7485-4422-b27b-46922578118d tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Getting quotas for user 18036411a99e4634bfbaeae24b9f254d and project 229dcb63bc41444391544883b576ce2e. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:39:08.566104 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0d53a8e2-c9db-4e7b-930b-7efd0ef061bc tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:08.579788 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-574b4f64-7485-4422-b27b-46922578118d tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:39:08.587334 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-574b4f64-7485-4422-b27b-46922578118d tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: 611195a7-9a81-43eb-9d7d-6c29d80f5933] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:39:08.596330 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0d53a8e2-c9db-4e7b-930b-7efd0ef061bc tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/2ec095f2-c25e-434f-87ff-10788b0fe6c3" status: 200 len: 1513 microversion: 2.1 time: 0.134177 Oct 27 03:39:08.597525 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2287/4312] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:08 2022] GET /compute/v2.1/servers/2ec095f2-c25e-434f-87ff-10788b0fe6c3 => generated 1513 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:39:08.605829 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-cc02fe70-8fc3-4fc2-89d3-b2737fb57984 req-2b525106-c571-47f9-be7a-40316ee3bd52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ec095f2-c25e-434f-87ff-10788b0fe6c3", "name": "network-vif-deleted", "tag": "5c64c2e5-5026-4fce-99fc-27a5bf039bb7"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:39:08.621995 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-cc02fe70-8fc3-4fc2-89d3-b2737fb57984 req-2b525106-c571-47f9-be7a-40316ee3bd52 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:08.624466 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-cc02fe70-8fc3-4fc2-89d3-b2737fb57984 req-2b525106-c571-47f9-be7a-40316ee3bd52 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:08.625606 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-cc02fe70-8fc3-4fc2-89d3-b2737fb57984 req-2b525106-c571-47f9-be7a-40316ee3bd52 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:08.659490 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-cc02fe70-8fc3-4fc2-89d3-b2737fb57984 req-2b525106-c571-47f9-be7a-40316ee3bd52 service nova] Creating event network-vif-deleted:5c64c2e5-5026-4fce-99fc-27a5bf039bb7 for instance 2ec095f2-c25e-434f-87ff-10788b0fe6c3 on n-h1-862769-1 Oct 27 03:39:08.672419 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-cc02fe70-8fc3-4fc2-89d3-b2737fb57984 req-2b525106-c571-47f9-be7a-40316ee3bd52 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073272 Oct 27 03:39:08.674190 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2288/4313] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:39:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:39:08.750529 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-574b4f64-7485-4422-b27b-46922578118d tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.873181 Oct 27 03:39:08.757336 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2026/4314] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:39:06 2022] POST /compute/v2.1/servers => generated 401 bytes in 1876 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 03:39:08.775769 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-88b6a001-ebf1-4ac7-8cf6-8d3b01306d0c tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:08.787307 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-88b6a001-ebf1-4ac7-8cf6-8d3b01306d0c tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: 611195a7-9a81-43eb-9d7d-6c29d80f5933] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:08.956788 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-88b6a001-ebf1-4ac7-8cf6-8d3b01306d0c tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18036411a99e4634bfbaeae24b9f254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229dcb63bc41444391544883b576ce2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:08.967615 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-88b6a001-ebf1-4ac7-8cf6-8d3b01306d0c tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/611195a7-9a81-43eb-9d7d-6c29d80f5933" status: 200 len: 1239 microversion: 2.1 time: 0.207952 Oct 27 03:39:08.971226 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2289/4315] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:08 2022] GET /compute/v2.1/servers/611195a7-9a81-43eb-9d7d-6c29d80f5933 => generated 1239 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:39:09.489976 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a2bd879e-48a3-4509-9a79-5a6510637152 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:09.491607 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a2bd879e-48a3-4509-9a79-5a6510637152 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] [instance: 7e73d534-0a40-42d2-813c-2e9dbb9239ac] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:09.502125 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a2bd879e-48a3-4509-9a79-5a6510637152 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:09.502850 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a2bd879e-48a3-4509-9a79-5a6510637152 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:09.503444 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a2bd879e-48a3-4509-9a79-5a6510637152 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:09.504416 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a2bd879e-48a3-4509-9a79-5a6510637152 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:09.505029 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a2bd879e-48a3-4509-9a79-5a6510637152 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:09.505644 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a2bd879e-48a3-4509-9a79-5a6510637152 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:09.622189 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-dff6e7e3-e857-4db2-94ca-afbef28d1b44 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:09.622829 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-dff6e7e3-e857-4db2-94ca-afbef28d1b44 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 2ec095f2-c25e-434f-87ff-10788b0fe6c3] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:09.636208 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dff6e7e3-e857-4db2-94ca-afbef28d1b44 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:09.636808 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dff6e7e3-e857-4db2-94ca-afbef28d1b44 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:09.637278 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dff6e7e3-e857-4db2-94ca-afbef28d1b44 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:09.638065 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dff6e7e3-e857-4db2-94ca-afbef28d1b44 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:09.658852 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dff6e7e3-e857-4db2-94ca-afbef28d1b44 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:09.660470 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dff6e7e3-e857-4db2-94ca-afbef28d1b44 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:09.777484 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-dff6e7e3-e857-4db2-94ca-afbef28d1b44 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:09.784047 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-dff6e7e3-e857-4db2-94ca-afbef28d1b44 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/2ec095f2-c25e-434f-87ff-10788b0fe6c3" status: 200 len: 1346 microversion: 2.1 time: 0.166831 Oct 27 03:39:09.787654 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2290/4316] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:09 2022] GET /compute/v2.1/servers/2ec095f2-c25e-434f-87ff-10788b0fe6c3 => generated 1346 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:39:09.959974 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a2bd879e-48a3-4509-9a79-5a6510637152 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:09.976005 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a2bd879e-48a3-4509-9a79-5a6510637152 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:09.977923 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a2bd879e-48a3-4509-9a79-5a6510637152 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:09.979594 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a2bd879e-48a3-4509-9a79-5a6510637152 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] 10.222.0.20 "GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac" status: 200 len: 1879 microversion: 2.32 time: 0.494719 Oct 27 03:39:09.980666 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2027/4317] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:39:09 2022] GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac => generated 1879 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:39:10.000608 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-19700de3-9adc-46a6-b0f6-e1a5f41dcaa1 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:10.001707 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-19700de3-9adc-46a6-b0f6-e1a5f41dcaa1 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: 611195a7-9a81-43eb-9d7d-6c29d80f5933] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:10.108832 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-19700de3-9adc-46a6-b0f6-e1a5f41dcaa1 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18036411a99e4634bfbaeae24b9f254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229dcb63bc41444391544883b576ce2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:10.122568 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-19700de3-9adc-46a6-b0f6-e1a5f41dcaa1 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/611195a7-9a81-43eb-9d7d-6c29d80f5933" status: 200 len: 1239 microversion: 2.1 time: 0.126147 Oct 27 03:39:10.123443 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2291/4318] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:09 2022] GET /compute/v2.1/servers/611195a7-9a81-43eb-9d7d-6c29d80f5933 => generated 1239 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:39:10.246191 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e659d340-91ec-4ada-8b17-066738b39adf tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2067427454", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0b028178-0415-4e42-8380-95bb745375a2"}], "security_groups": [{"name": "tempest-securitygroup--1453335577"}], "key_name": "tempest-keypair-1326885653", "user_data": "}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:39:10.395797 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-e659d340-91ec-4ada-8b17-066738b39adf tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] validate_networks() for [('0b028178-0415-4e42-8380-95bb745375a2', None, None, None, None, None)] {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:39:10.816566 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e58e66ed-6b31-4574-8722-d67e6cc97536 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:10.819104 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e58e66ed-6b31-4574-8722-d67e6cc97536 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 2ec095f2-c25e-434f-87ff-10788b0fe6c3] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:10.841863 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e58e66ed-6b31-4574-8722-d67e6cc97536 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:10.842412 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e58e66ed-6b31-4574-8722-d67e6cc97536 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:10.843085 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e58e66ed-6b31-4574-8722-d67e6cc97536 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:10.843901 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e58e66ed-6b31-4574-8722-d67e6cc97536 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:10.844373 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e58e66ed-6b31-4574-8722-d67e6cc97536 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:10.845964 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e58e66ed-6b31-4574-8722-d67e6cc97536 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:10.979845 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e58e66ed-6b31-4574-8722-d67e6cc97536 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:11.002344 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e58e66ed-6b31-4574-8722-d67e6cc97536 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/2ec095f2-c25e-434f-87ff-10788b0fe6c3" status: 200 len: 1346 microversion: 2.1 time: 0.194767 Oct 27 03:39:11.003264 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2292/4319] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:10 2022] GET /compute/v2.1/servers/2ec095f2-c25e-434f-87ff-10788b0fe6c3 => generated 1346 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:39:11.011887 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4e51afa7-c629-4ade-ab9a-5767736c348e tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:11.012832 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4e51afa7-c629-4ade-ab9a-5767736c348e tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] [instance: 7e73d534-0a40-42d2-813c-2e9dbb9239ac] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:11.023474 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4e51afa7-c629-4ade-ab9a-5767736c348e tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:11.023815 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-e659d340-91ec-4ada-8b17-066738b39adf tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:39:11.024879 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-e659d340-91ec-4ada-8b17-066738b39adf tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:39:11.026163 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-e659d340-91ec-4ada-8b17-066738b39adf tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:39:11.026278 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4e51afa7-c629-4ade-ab9a-5767736c348e tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:11.026673 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4e51afa7-c629-4ade-ab9a-5767736c348e tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:11.026963 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-e659d340-91ec-4ada-8b17-066738b39adf tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:39:11.027559 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-e659d340-91ec-4ada-8b17-066738b39adf tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:39:11.028714 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4e51afa7-c629-4ade-ab9a-5767736c348e tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:11.029940 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4e51afa7-c629-4ade-ab9a-5767736c348e tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:11.030575 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4e51afa7-c629-4ade-ab9a-5767736c348e tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:11.044516 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e659d340-91ec-4ada-8b17-066738b39adf tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:11.045291 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e659d340-91ec-4ada-8b17-066738b39adf tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:11.045931 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e659d340-91ec-4ada-8b17-066738b39adf tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:11.046959 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e659d340-91ec-4ada-8b17-066738b39adf tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:11.048053 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e659d340-91ec-4ada-8b17-066738b39adf tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:11.048684 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e659d340-91ec-4ada-8b17-066738b39adf tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:11.070534 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-e659d340-91ec-4ada-8b17-066738b39adf tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Getting quotas for project 38450368ef5c4e68ac3c19c7a0a1ce65. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:39:11.077460 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-e659d340-91ec-4ada-8b17-066738b39adf tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Getting quotas for user 5ffc2b1c410149e884a47240b5425e57 and project 38450368ef5c4e68ac3c19c7a0a1ce65. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:39:11.092678 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:39:11.096421 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e659d340-91ec-4ada-8b17-066738b39adf tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:39:11.099079 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e659d340-91ec-4ada-8b17-066738b39adf tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:39:11.234707 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e659d340-91ec-4ada-8b17-066738b39adf tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.992471 Oct 27 03:39:11.242179 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2028/4320] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:39:10 2022] POST /compute/v2.1/servers => generated 402 bytes in 1002 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 03:39:11.247484 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-797d6560-c001-41a0-8526-f780b90fbac8 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:11.248208 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-797d6560-c001-41a0-8526-f780b90fbac8 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: 611195a7-9a81-43eb-9d7d-6c29d80f5933] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:11.255396 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-797d6560-c001-41a0-8526-f780b90fbac8 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:11.256081 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-797d6560-c001-41a0-8526-f780b90fbac8 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:11.256619 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-797d6560-c001-41a0-8526-f780b90fbac8 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:11.257429 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-797d6560-c001-41a0-8526-f780b90fbac8 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:11.258143 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-797d6560-c001-41a0-8526-f780b90fbac8 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:11.258672 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-797d6560-c001-41a0-8526-f780b90fbac8 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:11.418143 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4e51afa7-c629-4ade-ab9a-5767736c348e tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:11.432448 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4e51afa7-c629-4ade-ab9a-5767736c348e tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:11.433931 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4e51afa7-c629-4ade-ab9a-5767736c348e tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:11.437023 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4e51afa7-c629-4ade-ab9a-5767736c348e tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] 10.222.0.20 "GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac" status: 200 len: 1879 microversion: 2.32 time: 0.432311 Oct 27 03:39:11.437612 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2293/4321] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:39:11 2022] GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac => generated 1879 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:39:11.450895 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-07c7dab2-1a95-4895-9a91-9dfa68cebee3 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:11.451353 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-07c7dab2-1a95-4895-9a91-9dfa68cebee3 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:11.543883 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-797d6560-c001-41a0-8526-f780b90fbac8 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18036411a99e4634bfbaeae24b9f254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229dcb63bc41444391544883b576ce2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:11.552207 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-797d6560-c001-41a0-8526-f780b90fbac8 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/611195a7-9a81-43eb-9d7d-6c29d80f5933" status: 200 len: 1291 microversion: 2.1 time: 0.308836 Oct 27 03:39:11.552802 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2029/4322] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:11 2022] GET /compute/v2.1/servers/611195a7-9a81-43eb-9d7d-6c29d80f5933 => generated 1291 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:39:11.558211 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-07c7dab2-1a95-4895-9a91-9dfa68cebee3 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffc2b1c410149e884a47240b5425e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38450368ef5c4e68ac3c19c7a0a1ce65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:11.592232 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-07c7dab2-1a95-4895-9a91-9dfa68cebee3 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b" status: 200 len: 1238 microversion: 2.1 time: 0.149925 Oct 27 03:39:11.592839 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2294/4323] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:11 2022] GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b => generated 1238 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:39:12.026599 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ee9d6025-2eee-4fb6-89b3-44e376aaf169 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:12.027226 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ee9d6025-2eee-4fb6-89b3-44e376aaf169 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 2ec095f2-c25e-434f-87ff-10788b0fe6c3] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:12.040211 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ee9d6025-2eee-4fb6-89b3-44e376aaf169 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:12.047035 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ee9d6025-2eee-4fb6-89b3-44e376aaf169 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:12.047035 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ee9d6025-2eee-4fb6-89b3-44e376aaf169 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:12.047711 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ee9d6025-2eee-4fb6-89b3-44e376aaf169 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:12.048927 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ee9d6025-2eee-4fb6-89b3-44e376aaf169 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:12.049569 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ee9d6025-2eee-4fb6-89b3-44e376aaf169 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:12.199512 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ee9d6025-2eee-4fb6-89b3-44e376aaf169 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:12.218398 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ee9d6025-2eee-4fb6-89b3-44e376aaf169 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/2ec095f2-c25e-434f-87ff-10788b0fe6c3" status: 200 len: 1346 microversion: 2.1 time: 0.197319 Oct 27 03:39:12.219017 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2030/4324] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:12 2022] GET /compute/v2.1/servers/2ec095f2-c25e-434f-87ff-10788b0fe6c3 => generated 1346 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:39:12.464628 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d87a72cb-3c10-4750-9fc7-7cfd4ecff36b tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:12.465391 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d87a72cb-3c10-4750-9fc7-7cfd4ecff36b tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] [instance: 7e73d534-0a40-42d2-813c-2e9dbb9239ac] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:12.483514 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d87a72cb-3c10-4750-9fc7-7cfd4ecff36b tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:12.484388 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d87a72cb-3c10-4750-9fc7-7cfd4ecff36b tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:12.485026 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d87a72cb-3c10-4750-9fc7-7cfd4ecff36b tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:12.485957 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d87a72cb-3c10-4750-9fc7-7cfd4ecff36b tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:12.486606 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d87a72cb-3c10-4750-9fc7-7cfd4ecff36b tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:12.487811 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d87a72cb-3c10-4750-9fc7-7cfd4ecff36b tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:12.575809 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-de3887f0-9646-47a7-a073-c799124f92a8 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:12.576736 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-de3887f0-9646-47a7-a073-c799124f92a8 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: 611195a7-9a81-43eb-9d7d-6c29d80f5933] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:12.585199 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-de3887f0-9646-47a7-a073-c799124f92a8 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:12.585948 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-de3887f0-9646-47a7-a073-c799124f92a8 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:12.586608 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-de3887f0-9646-47a7-a073-c799124f92a8 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:12.588299 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-de3887f0-9646-47a7-a073-c799124f92a8 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:12.588961 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-de3887f0-9646-47a7-a073-c799124f92a8 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:12.593154 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-de3887f0-9646-47a7-a073-c799124f92a8 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:12.707263 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-de3887f0-9646-47a7-a073-c799124f92a8 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18036411a99e4634bfbaeae24b9f254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229dcb63bc41444391544883b576ce2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:12.720723 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-de3887f0-9646-47a7-a073-c799124f92a8 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/611195a7-9a81-43eb-9d7d-6c29d80f5933" status: 200 len: 1297 microversion: 2.1 time: 0.146562 Oct 27 03:39:12.724191 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2031/4325] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:12 2022] GET /compute/v2.1/servers/611195a7-9a81-43eb-9d7d-6c29d80f5933 => generated 1297 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:39:12.729447 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-18f1a26f-0fc3-4525-bafd-04f9592f56c0 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:12.730355 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-18f1a26f-0fc3-4525-bafd-04f9592f56c0 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:12.867561 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-18f1a26f-0fc3-4525-bafd-04f9592f56c0 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffc2b1c410149e884a47240b5425e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38450368ef5c4e68ac3c19c7a0a1ce65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:12.877527 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-18f1a26f-0fc3-4525-bafd-04f9592f56c0 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b" status: 200 len: 1238 microversion: 2.1 time: 0.150933 Oct 27 03:39:12.878164 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2032/4326] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:12 2022] GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b => generated 1238 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:39:12.896022 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d87a72cb-3c10-4750-9fc7-7cfd4ecff36b tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:12.917256 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d87a72cb-3c10-4750-9fc7-7cfd4ecff36b tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:12.919630 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d87a72cb-3c10-4750-9fc7-7cfd4ecff36b tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:12.922688 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d87a72cb-3c10-4750-9fc7-7cfd4ecff36b tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] 10.222.0.20 "GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac" status: 200 len: 1879 microversion: 2.32 time: 0.462800 Oct 27 03:39:12.923804 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2295/4327] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:39:12 2022] GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac => generated 1879 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:39:13.247255 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d63daf22-c5ca-47a1-893c-c5fab50e4436 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:13.247959 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d63daf22-c5ca-47a1-893c-c5fab50e4436 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 2ec095f2-c25e-434f-87ff-10788b0fe6c3] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:13.255827 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d63daf22-c5ca-47a1-893c-c5fab50e4436 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:13.260682 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d63daf22-c5ca-47a1-893c-c5fab50e4436 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:13.261499 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d63daf22-c5ca-47a1-893c-c5fab50e4436 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:13.262350 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d63daf22-c5ca-47a1-893c-c5fab50e4436 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:13.262929 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d63daf22-c5ca-47a1-893c-c5fab50e4436 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:13.264089 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d63daf22-c5ca-47a1-893c-c5fab50e4436 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:13.451737 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d63daf22-c5ca-47a1-893c-c5fab50e4436 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:13.456063 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=100 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:39:13.461890 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d63daf22-c5ca-47a1-893c-c5fab50e4436 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/2ec095f2-c25e-434f-87ff-10788b0fe6c3" status: 200 len: 1346 microversion: 2.1 time: 0.219565 Oct 27 03:39:13.462974 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2033/4328] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:13 2022] GET /compute/v2.1/servers/2ec095f2-c25e-434f-87ff-10788b0fe6c3 => generated 1346 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:39:13.758658 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7adf552e-13d4-490b-8831-947393d4a2ec tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:13.759896 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7adf552e-13d4-490b-8831-947393d4a2ec tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: 611195a7-9a81-43eb-9d7d-6c29d80f5933] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:13.770186 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7adf552e-13d4-490b-8831-947393d4a2ec tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:13.771001 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7adf552e-13d4-490b-8831-947393d4a2ec tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:13.771635 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7adf552e-13d4-490b-8831-947393d4a2ec tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:13.772574 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7adf552e-13d4-490b-8831-947393d4a2ec tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:13.773362 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7adf552e-13d4-490b-8831-947393d4a2ec tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:13.774050 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7adf552e-13d4-490b-8831-947393d4a2ec tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:13.910300 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1e12eb1c-8cf6-4532-9f8e-5a8eb6681922 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:13.911025 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1e12eb1c-8cf6-4532-9f8e-5a8eb6681922 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:13.934135 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1e12eb1c-8cf6-4532-9f8e-5a8eb6681922 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:13.934940 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1e12eb1c-8cf6-4532-9f8e-5a8eb6681922 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:13.935468 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1e12eb1c-8cf6-4532-9f8e-5a8eb6681922 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:13.936293 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1e12eb1c-8cf6-4532-9f8e-5a8eb6681922 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:13.936829 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1e12eb1c-8cf6-4532-9f8e-5a8eb6681922 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:13.937333 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1e12eb1c-8cf6-4532-9f8e-5a8eb6681922 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:14.102772 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1e12eb1c-8cf6-4532-9f8e-5a8eb6681922 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffc2b1c410149e884a47240b5425e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38450368ef5c4e68ac3c19c7a0a1ce65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:14.115707 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1e12eb1c-8cf6-4532-9f8e-5a8eb6681922 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b" status: 200 len: 1290 microversion: 2.1 time: 0.214282 Oct 27 03:39:14.136972 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2034/4329] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:13 2022] GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b => generated 1290 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:39:14.142624 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2831c22a-d5b2-4cb3-a50f-4ebd328f4602 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:14.143531 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-2831c22a-d5b2-4cb3-a50f-4ebd328f4602 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] [instance: 7e73d534-0a40-42d2-813c-2e9dbb9239ac] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:14.151171 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2831c22a-d5b2-4cb3-a50f-4ebd328f4602 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:14.151945 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2831c22a-d5b2-4cb3-a50f-4ebd328f4602 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:14.152585 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2831c22a-d5b2-4cb3-a50f-4ebd328f4602 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:14.153490 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2831c22a-d5b2-4cb3-a50f-4ebd328f4602 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:14.154164 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2831c22a-d5b2-4cb3-a50f-4ebd328f4602 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:14.154799 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2831c22a-d5b2-4cb3-a50f-4ebd328f4602 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:14.742620 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2831c22a-d5b2-4cb3-a50f-4ebd328f4602 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:14.771793 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2831c22a-d5b2-4cb3-a50f-4ebd328f4602 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:14.780110 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2831c22a-d5b2-4cb3-a50f-4ebd328f4602 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:14.781381 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2831c22a-d5b2-4cb3-a50f-4ebd328f4602 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] 10.222.0.20 "GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac" status: 200 len: 1879 microversion: 2.32 time: 0.643036 Oct 27 03:39:14.791597 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2035/4330] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:39:14 2022] GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac => generated 1879 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:39:14.802227 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e7a91ce5-a4cf-43cb-9ab1-17ccad2d7a50 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:14.803059 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e7a91ce5-a4cf-43cb-9ab1-17ccad2d7a50 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 2ec095f2-c25e-434f-87ff-10788b0fe6c3] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:14.834419 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e7a91ce5-a4cf-43cb-9ab1-17ccad2d7a50 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:14.835074 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7adf552e-13d4-490b-8831-947393d4a2ec tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18036411a99e4634bfbaeae24b9f254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229dcb63bc41444391544883b576ce2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:14.835550 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e7a91ce5-a4cf-43cb-9ab1-17ccad2d7a50 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:14.835643 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e7a91ce5-a4cf-43cb-9ab1-17ccad2d7a50 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:14.840158 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:39:14.846894 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e7a91ce5-a4cf-43cb-9ab1-17ccad2d7a50 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:14.847743 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e7a91ce5-a4cf-43cb-9ab1-17ccad2d7a50 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:14.848334 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e7a91ce5-a4cf-43cb-9ab1-17ccad2d7a50 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:14.858787 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7adf552e-13d4-490b-8831-947393d4a2ec tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/611195a7-9a81-43eb-9d7d-6c29d80f5933" status: 200 len: 1364 microversion: 2.1 time: 1.118541 Oct 27 03:39:14.859395 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2296/4331] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:13 2022] GET /compute/v2.1/servers/611195a7-9a81-43eb-9d7d-6c29d80f5933 => generated 1364 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:39:15.035865 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e7a91ce5-a4cf-43cb-9ab1-17ccad2d7a50 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:15.063913 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e7a91ce5-a4cf-43cb-9ab1-17ccad2d7a50 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/2ec095f2-c25e-434f-87ff-10788b0fe6c3" status: 200 len: 1346 microversion: 2.1 time: 0.266890 Oct 27 03:39:15.064769 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2036/4332] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:14 2022] GET /compute/v2.1/servers/2ec095f2-c25e-434f-87ff-10788b0fe6c3 => generated 1346 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:39:15.144874 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-fc7ad41b-7170-486b-9962-f3e998468e65 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:15.145542 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-fc7ad41b-7170-486b-9962-f3e998468e65 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:15.155869 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fc7ad41b-7170-486b-9962-f3e998468e65 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:15.165373 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fc7ad41b-7170-486b-9962-f3e998468e65 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:15.165373 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fc7ad41b-7170-486b-9962-f3e998468e65 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:15.165373 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fc7ad41b-7170-486b-9962-f3e998468e65 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:15.165373 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fc7ad41b-7170-486b-9962-f3e998468e65 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:15.165373 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fc7ad41b-7170-486b-9962-f3e998468e65 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:15.379839 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-fc7ad41b-7170-486b-9962-f3e998468e65 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffc2b1c410149e884a47240b5425e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38450368ef5c4e68ac3c19c7a0a1ce65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:15.389206 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-fc7ad41b-7170-486b-9962-f3e998468e65 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b" status: 200 len: 1296 microversion: 2.1 time: 0.249738 Oct 27 03:39:15.395098 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2297/4333] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:15 2022] GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b => generated 1296 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:39:15.828706 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-47b2d8ba-cbeb-4a8c-9510-5fea5d5e601a tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:15.829814 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-47b2d8ba-cbeb-4a8c-9510-5fea5d5e601a tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] [instance: 7e73d534-0a40-42d2-813c-2e9dbb9239ac] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:15.847252 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-47b2d8ba-cbeb-4a8c-9510-5fea5d5e601a tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:15.870160 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-47b2d8ba-cbeb-4a8c-9510-5fea5d5e601a tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:15.873455 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-47b2d8ba-cbeb-4a8c-9510-5fea5d5e601a tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:15.875726 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-47b2d8ba-cbeb-4a8c-9510-5fea5d5e601a tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:15.881634 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-47b2d8ba-cbeb-4a8c-9510-5fea5d5e601a tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:15.882820 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-47b2d8ba-cbeb-4a8c-9510-5fea5d5e601a tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:15.896209 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4cd4ead1-5a6a-419e-a32a-b20297c44bd0 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:15.896209 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4cd4ead1-5a6a-419e-a32a-b20297c44bd0 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: 611195a7-9a81-43eb-9d7d-6c29d80f5933] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:15.911759 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4cd4ead1-5a6a-419e-a32a-b20297c44bd0 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:15.914946 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4cd4ead1-5a6a-419e-a32a-b20297c44bd0 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:15.915573 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4cd4ead1-5a6a-419e-a32a-b20297c44bd0 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:15.918444 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4cd4ead1-5a6a-419e-a32a-b20297c44bd0 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:15.919808 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4cd4ead1-5a6a-419e-a32a-b20297c44bd0 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:15.928334 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4cd4ead1-5a6a-419e-a32a-b20297c44bd0 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:16.422808 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-47b2d8ba-cbeb-4a8c-9510-5fea5d5e601a tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:16.439288 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4cd4ead1-5a6a-419e-a32a-b20297c44bd0 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18036411a99e4634bfbaeae24b9f254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229dcb63bc41444391544883b576ce2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:16.458726 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4cd4ead1-5a6a-419e-a32a-b20297c44bd0 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/611195a7-9a81-43eb-9d7d-6c29d80f5933" status: 200 len: 1364 microversion: 2.1 time: 0.571916 Oct 27 03:39:16.462293 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2298/4334] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:15 2022] GET /compute/v2.1/servers/611195a7-9a81-43eb-9d7d-6c29d80f5933 => generated 1364 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:39:16.465460 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-47b2d8ba-cbeb-4a8c-9510-5fea5d5e601a tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:16.468346 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-47b2d8ba-cbeb-4a8c-9510-5fea5d5e601a tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:16.470749 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-47b2d8ba-cbeb-4a8c-9510-5fea5d5e601a tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] 10.222.0.20 "GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac" status: 200 len: 1879 microversion: 2.32 time: 0.656578 Oct 27 03:39:16.472630 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2037/4335] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:39:15 2022] GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac => generated 1879 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:39:16.478646 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-61b1360b-f473-4461-8957-3a5dd6966f72 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:16.479757 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-61b1360b-f473-4461-8957-3a5dd6966f72 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 2ec095f2-c25e-434f-87ff-10788b0fe6c3] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:16.487211 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-efe050d6-f560-4a4f-9eee-fe22af2979eb tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:16.492052 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-efe050d6-f560-4a4f-9eee-fe22af2979eb tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:16.495935 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-61b1360b-f473-4461-8957-3a5dd6966f72 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:16.497689 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-61b1360b-f473-4461-8957-3a5dd6966f72 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:16.499630 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-61b1360b-f473-4461-8957-3a5dd6966f72 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:16.499630 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-61b1360b-f473-4461-8957-3a5dd6966f72 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:16.503386 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-61b1360b-f473-4461-8957-3a5dd6966f72 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:16.506626 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-61b1360b-f473-4461-8957-3a5dd6966f72 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:16.515580 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-efe050d6-f560-4a4f-9eee-fe22af2979eb tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:16.518459 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-efe050d6-f560-4a4f-9eee-fe22af2979eb tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:16.519206 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-efe050d6-f560-4a4f-9eee-fe22af2979eb tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:16.521749 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-efe050d6-f560-4a4f-9eee-fe22af2979eb tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:16.522846 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-efe050d6-f560-4a4f-9eee-fe22af2979eb tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:16.526349 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-efe050d6-f560-4a4f-9eee-fe22af2979eb tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:16.612202 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-61b1360b-f473-4461-8957-3a5dd6966f72 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:16.617528 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-61b1360b-f473-4461-8957-3a5dd6966f72 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:16.618311 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-61b1360b-f473-4461-8957-3a5dd6966f72 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:16.619030 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-61b1360b-f473-4461-8957-3a5dd6966f72 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lazy-loading 'fault' on Instance uuid 2ec095f2-c25e-434f-87ff-10788b0fe6c3 {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:39:16.750162 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-61b1360b-f473-4461-8957-3a5dd6966f72 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:16.764307 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-61b1360b-f473-4461-8957-3a5dd6966f72 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/2ec095f2-c25e-434f-87ff-10788b0fe6c3" status: 200 len: 1351 microversion: 2.1 time: 0.300316 Oct 27 03:39:16.765605 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2299/4336] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:16 2022] GET /compute/v2.1/servers/2ec095f2-c25e-434f-87ff-10788b0fe6c3 => generated 1351 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:39:16.880542 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-3490f38b-3a5f-4642-88b0-7d4e2d48f437 req-1a064074-19b6-46e7-9dfe-2d3f0ad109f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "611195a7-9a81-43eb-9d7d-6c29d80f5933", "tag": "2191274a-4ef4-4cc4-a7b0-bf8217300db1"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:39:16.907939 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=2,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:39:16.910944 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-3490f38b-3a5f-4642-88b0-7d4e2d48f437 req-1a064074-19b6-46e7-9dfe-2d3f0ad109f8 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:16.911956 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-3490f38b-3a5f-4642-88b0-7d4e2d48f437 req-1a064074-19b6-46e7-9dfe-2d3f0ad109f8 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:16.912719 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-3490f38b-3a5f-4642-88b0-7d4e2d48f437 req-1a064074-19b6-46e7-9dfe-2d3f0ad109f8 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:16.933084 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-3490f38b-3a5f-4642-88b0-7d4e2d48f437 req-1a064074-19b6-46e7-9dfe-2d3f0ad109f8 service nova] Creating event network-changed:2191274a-4ef4-4cc4-a7b0-bf8217300db1 for instance 611195a7-9a81-43eb-9d7d-6c29d80f5933 on n-h2-862769-1 Oct 27 03:39:16.940481 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-3490f38b-3a5f-4642-88b0-7d4e2d48f437 req-1a064074-19b6-46e7-9dfe-2d3f0ad109f8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076010 Oct 27 03:39:16.941657 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2300/4337] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:39:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:39:16.947944 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-324529ab-ecac-4219-b7eb-fdc8112e731b req-118851d4-0aad-4f9c-ad39-6eeb31ad4452 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e73d534-0a40-42d2-813c-2e9dbb9239ac", "name": "network-vif-plugged", "status": "completed", "tag": "0cd3187b-ba4d-438e-9eba-f156955f5791"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:39:16.976055 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-324529ab-ecac-4219-b7eb-fdc8112e731b req-118851d4-0aad-4f9c-ad39-6eeb31ad4452 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:16.983318 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-324529ab-ecac-4219-b7eb-fdc8112e731b req-118851d4-0aad-4f9c-ad39-6eeb31ad4452 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:16.991965 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-324529ab-ecac-4219-b7eb-fdc8112e731b req-118851d4-0aad-4f9c-ad39-6eeb31ad4452 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:17.015181 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-324529ab-ecac-4219-b7eb-fdc8112e731b req-118851d4-0aad-4f9c-ad39-6eeb31ad4452 service nova] Creating event network-vif-plugged:0cd3187b-ba4d-438e-9eba-f156955f5791 for instance 7e73d534-0a40-42d2-813c-2e9dbb9239ac on n-h2-862769-1 Oct 27 03:39:17.023265 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-324529ab-ecac-4219-b7eb-fdc8112e731b req-118851d4-0aad-4f9c-ad39-6eeb31ad4452 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080021 Oct 27 03:39:17.024405 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2301/4338] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:39:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:39:17.300841 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-efe050d6-f560-4a4f-9eee-fe22af2979eb tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffc2b1c410149e884a47240b5425e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38450368ef5c4e68ac3c19c7a0a1ce65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:17.311214 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-efe050d6-f560-4a4f-9eee-fe22af2979eb tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b" status: 200 len: 1364 microversion: 2.1 time: 0.837284 Oct 27 03:39:17.317562 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2038/4339] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:16 2022] GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b => generated 1364 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:39:17.490333 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1b2711b9-c360-467f-8926-f5d2c3d53e65 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:17.491043 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1b2711b9-c360-467f-8926-f5d2c3d53e65 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: 611195a7-9a81-43eb-9d7d-6c29d80f5933] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:17.501682 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1e76bb56-c23a-434f-93a9-957683947601 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:17.502534 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1b2711b9-c360-467f-8926-f5d2c3d53e65 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:17.502654 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1e76bb56-c23a-434f-93a9-957683947601 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] [instance: 7e73d534-0a40-42d2-813c-2e9dbb9239ac] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:17.503035 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1b2711b9-c360-467f-8926-f5d2c3d53e65 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:17.503626 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1b2711b9-c360-467f-8926-f5d2c3d53e65 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:17.511366 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1e76bb56-c23a-434f-93a9-957683947601 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:17.512498 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1b2711b9-c360-467f-8926-f5d2c3d53e65 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:17.513189 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1b2711b9-c360-467f-8926-f5d2c3d53e65 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:17.513305 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1e76bb56-c23a-434f-93a9-957683947601 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:17.513652 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1b2711b9-c360-467f-8926-f5d2c3d53e65 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:17.513760 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1e76bb56-c23a-434f-93a9-957683947601 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:17.514615 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1e76bb56-c23a-434f-93a9-957683947601 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:17.516113 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1e76bb56-c23a-434f-93a9-957683947601 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:17.516703 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1e76bb56-c23a-434f-93a9-957683947601 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:18.071577 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1b2711b9-c360-467f-8926-f5d2c3d53e65 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18036411a99e4634bfbaeae24b9f254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229dcb63bc41444391544883b576ce2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:18.085166 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1b2711b9-c360-467f-8926-f5d2c3d53e65 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/611195a7-9a81-43eb-9d7d-6c29d80f5933" status: 200 len: 1364 microversion: 2.1 time: 0.600038 Oct 27 03:39:18.103047 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2302/4340] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:17 2022] GET /compute/v2.1/servers/611195a7-9a81-43eb-9d7d-6c29d80f5933 => generated 1364 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:39:18.103047 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a3fd2983-1c9e-4e5a-a160-be0c8f8d3acb tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:18.104212 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a3fd2983-1c9e-4e5a-a160-be0c8f8d3acb tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 2ec095f2-c25e-434f-87ff-10788b0fe6c3] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:18.115455 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a3fd2983-1c9e-4e5a-a160-be0c8f8d3acb tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:18.118304 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a3fd2983-1c9e-4e5a-a160-be0c8f8d3acb tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:18.120778 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a3fd2983-1c9e-4e5a-a160-be0c8f8d3acb tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:18.122557 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a3fd2983-1c9e-4e5a-a160-be0c8f8d3acb tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:18.124385 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a3fd2983-1c9e-4e5a-a160-be0c8f8d3acb tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:18.125747 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a3fd2983-1c9e-4e5a-a160-be0c8f8d3acb tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:18.167955 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-a3fd2983-1c9e-4e5a-a160-be0c8f8d3acb tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] HTTP exception thrown: Instance 2ec095f2-c25e-434f-87ff-10788b0fe6c3 could not be found. Oct 27 03:39:18.178849 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a3fd2983-1c9e-4e5a-a160-be0c8f8d3acb tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Request method failure captured: Oct 27 03:39:18.178849 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/2ec095f2-c25e-434f-87ff-10788b0fe6c3 HTTP/1.1 Oct 27 03:39:18.178849 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:39:18.178849 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:39:18.178849 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:39:18.178849 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:39:18.178849 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:39:18.178849 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:39:18.178849 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:39:18.178849 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:39:18.178849 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfz83jPBQR-IO_RgpXfqqqN_tSIl3Aju213bQLpPTkR-R_lkTGSpHz1Evy7Lbg7I5hWxU9AxviJyxNS0i-wRdj1_O4LyvZEjE6jerjzwB22Vu4S-ThF8W8FJgumwczGUcQup-Bjpiay7kN0UoT8q0uFoQytE3MKt1MX9CDbsUgcc03A Oct 27 03:39:18.178849 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:39:18.178849 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:39:18.178849 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:39:18.178849 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:39:18.178849 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:39:18.178849 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:39:18.178849 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 911997e881754ce390af17919f29b4ab Oct 27 03:39:18.178849 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-DeleteServersTestJSON-858473437 Oct 27 03:39:18.178849 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:39:18.178849 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:39:18.178849 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/911997e881754ce390af17919f29b4ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/911997e881754ce390af17919f29b4ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/911997e881754ce390af17919f29b4ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_911997e881754ce390af17919f29b4ab"}]}] Oct 27 03:39:18.178849 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-DeleteServersTestJSON-858473437 Oct 27 03:39:18.178849 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 911997e881754ce390af17919f29b4ab Oct 27 03:39:18.178849 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-DeleteServersTestJSON-858473437 Oct 27 03:39:18.178849 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-DeleteServersTestJSON-858473437-project Oct 27 03:39:18.178849 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:39:18.178849 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:39:18.178849 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: b1cc79af058b4c35b3c572448fac86a7 Oct 27 03:39:18.178849 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-DeleteServersTestJSON-858473437-project Oct 27 03:39:18.178849 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:39:18.178849 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 2ec095f2-c25e-434f-87ff-10788b0fe6c3 could not be found. Oct 27 03:39:18.178849 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '2ec095f2-c25e-434f-87ff-10788b0fe6c3'} Oct 27 03:39:18.178849 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:39:18.178849 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:39:18.178849 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:39:18.178849 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:39:18.178849 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:39:18.178849 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:39:18.178849 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:39:18.178849 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:39:18.178849 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:39:18.178849 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:39:18.178849 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ec095f2-c25e-434f-87ff-10788b0fe6c3 could not be found. Oct 27 03:39:18.178849 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:39:18.178849 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:39:18.178849 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:39:18.178849 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:39:18.178849 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:39:18.178849 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:39:18.178849 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:39:18.178849 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:39:18.178849 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:39:18.178849 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:39:18.178849 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:39:18.178849 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:39:18.178849 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:39:18.178849 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:39:18.178849 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:39:18.178849 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:39:18.178849 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ec095f2-c25e-434f-87ff-10788b0fe6c3 could not be found. Oct 27 03:39:18.178849 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:39:18.178849 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:39:18.178849 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:39:18.193400 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:39:18.193400 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:39:18.193400 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:39:18.193400 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:39:18.193400 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:39:18.193400 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ec095f2-c25e-434f-87ff-10788b0fe6c3 could not be found. Oct 27 03:39:18.193400 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:39:18.193400 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a3fd2983-1c9e-4e5a-a160-be0c8f8d3acb tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Returning 404 to user: Instance 2ec095f2-c25e-434f-87ff-10788b0fe6c3 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:39:18.193400 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a3fd2983-1c9e-4e5a-a160-be0c8f8d3acb tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/2ec095f2-c25e-434f-87ff-10788b0fe6c3" status: 404 len: 111 microversion: 2.1 time: 0.096839 Oct 27 03:39:18.193400 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2303/4341] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:18 2022] GET /compute/v2.1/servers/2ec095f2-c25e-434f-87ff-10788b0fe6c3 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:39:18.337093 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-15b4c4af-fe0d-439d-a22d-6eadafa499fc tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:18.339094 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-15b4c4af-fe0d-439d-a22d-6eadafa499fc tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:18.357764 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-15b4c4af-fe0d-439d-a22d-6eadafa499fc tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:18.359835 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-15b4c4af-fe0d-439d-a22d-6eadafa499fc tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:18.361071 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-15b4c4af-fe0d-439d-a22d-6eadafa499fc tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:18.363458 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-15b4c4af-fe0d-439d-a22d-6eadafa499fc tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:18.364102 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-15b4c4af-fe0d-439d-a22d-6eadafa499fc tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:18.364703 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-15b4c4af-fe0d-439d-a22d-6eadafa499fc tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:18.554988 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1e76bb56-c23a-434f-93a9-957683947601 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:18.570915 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1e76bb56-c23a-434f-93a9-957683947601 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:18.572350 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1e76bb56-c23a-434f-93a9-957683947601 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:18.573613 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1e76bb56-c23a-434f-93a9-957683947601 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] 10.222.0.20 "GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac" status: 200 len: 1879 microversion: 2.32 time: 1.076522 Oct 27 03:39:18.591695 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2039/4342] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:39:17 2022] GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac => generated 1879 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:39:18.598731 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4b28df98-6435-4259-bac8-40676f33d700 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:18.602691 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4b28df98-6435-4259-bac8-40676f33d700 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 2ec095f2-c25e-434f-87ff-10788b0fe6c3] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:18.613755 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4b28df98-6435-4259-bac8-40676f33d700 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:18.614284 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4b28df98-6435-4259-bac8-40676f33d700 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:18.617976 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4b28df98-6435-4259-bac8-40676f33d700 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:18.617976 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4b28df98-6435-4259-bac8-40676f33d700 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:18.619223 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4b28df98-6435-4259-bac8-40676f33d700 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:18.619792 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4b28df98-6435-4259-bac8-40676f33d700 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:18.649911 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-4b28df98-6435-4259-bac8-40676f33d700 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] HTTP exception thrown: Instance 2ec095f2-c25e-434f-87ff-10788b0fe6c3 could not be found. Oct 27 03:39:18.653692 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4b28df98-6435-4259-bac8-40676f33d700 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Request method failure captured: Oct 27 03:39:18.653692 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/2ec095f2-c25e-434f-87ff-10788b0fe6c3/os-volume_attachments HTTP/1.1 Oct 27 03:39:18.653692 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:39:18.653692 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:39:18.653692 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:39:18.653692 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:39:18.653692 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:39:18.653692 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:39:18.653692 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:39:18.653692 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:39:18.653692 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfz83jPBQR-IO_RgpXfqqqN_tSIl3Aju213bQLpPTkR-R_lkTGSpHz1Evy7Lbg7I5hWxU9AxviJyxNS0i-wRdj1_O4LyvZEjE6jerjzwB22Vu4S-ThF8W8FJgumwczGUcQup-Bjpiay7kN0UoT8q0uFoQytE3MKt1MX9CDbsUgcc03A Oct 27 03:39:18.653692 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:39:18.653692 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:39:18.653692 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:39:18.653692 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:39:18.653692 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:39:18.653692 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:39:18.653692 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 911997e881754ce390af17919f29b4ab Oct 27 03:39:18.653692 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-DeleteServersTestJSON-858473437 Oct 27 03:39:18.653692 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:39:18.653692 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:39:18.653692 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/911997e881754ce390af17919f29b4ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/911997e881754ce390af17919f29b4ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/911997e881754ce390af17919f29b4ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_911997e881754ce390af17919f29b4ab"}]}] Oct 27 03:39:18.653692 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-DeleteServersTestJSON-858473437 Oct 27 03:39:18.653692 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 911997e881754ce390af17919f29b4ab Oct 27 03:39:18.653692 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-DeleteServersTestJSON-858473437 Oct 27 03:39:18.653692 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-DeleteServersTestJSON-858473437-project Oct 27 03:39:18.653692 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:39:18.653692 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:39:18.653692 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: b1cc79af058b4c35b3c572448fac86a7 Oct 27 03:39:18.653692 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-DeleteServersTestJSON-858473437-project Oct 27 03:39:18.653692 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:39:18.653692 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 2ec095f2-c25e-434f-87ff-10788b0fe6c3 could not be found. Oct 27 03:39:18.653692 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'server_id': '2ec095f2-c25e-434f-87ff-10788b0fe6c3'} Oct 27 03:39:18.653692 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:39:18.653692 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:39:18.653692 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:39:18.653692 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:39:18.653692 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:39:18.653692 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:39:18.653692 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:39:18.653692 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:39:18.653692 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:39:18.653692 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:39:18.653692 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ec095f2-c25e-434f-87ff-10788b0fe6c3 could not be found. Oct 27 03:39:18.653692 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:39:18.653692 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:39:18.653692 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:39:18.653692 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:39:18.653692 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:39:18.653692 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:39:18.653692 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:39:18.653692 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:39:18.653692 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:39:18.653692 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:39:18.653692 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 03:39:18.653692 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:39:18.653692 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 03:39:18.653692 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:39:18.653692 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 27 03:39:18.653692 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 27 03:39:18.653692 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:39:18.653692 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:39:18.657209 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ec095f2-c25e-434f-87ff-10788b0fe6c3 could not be found. Oct 27 03:39:18.657209 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:39:18.657209 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:39:18.657209 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:39:18.657209 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:39:18.657209 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:39:18.657209 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:39:18.657209 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:39:18.657209 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:39:18.657209 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ec095f2-c25e-434f-87ff-10788b0fe6c3 could not be found. Oct 27 03:39:18.657209 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:39:18.659174 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4b28df98-6435-4259-bac8-40676f33d700 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Returning 404 to user: Instance 2ec095f2-c25e-434f-87ff-10788b0fe6c3 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:39:18.660727 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4b28df98-6435-4259-bac8-40676f33d700 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/2ec095f2-c25e-434f-87ff-10788b0fe6c3/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.067281 Oct 27 03:39:18.661826 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2040/4343] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 27 03:39:18 2022] GET /compute/v2.1/servers/2ec095f2-c25e-434f-87ff-10788b0fe6c3/os-volume_attachments => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:39:18.715514 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-15b4c4af-fe0d-439d-a22d-6eadafa499fc tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffc2b1c410149e884a47240b5425e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38450368ef5c4e68ac3c19c7a0a1ce65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:18.728209 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-15b4c4af-fe0d-439d-a22d-6eadafa499fc tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b" status: 200 len: 1364 microversion: 2.1 time: 0.395138 Oct 27 03:39:18.731332 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2304/4344] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:18 2022] GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b => generated 1364 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:39:18.905169 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b4624880-88d4-4e95-9f68-de6892c32b58 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-918817966", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": [{"uuid": "b1f1f8a3-6579-4551-8baa-e65f1847be2c"}]}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:39:18.992416 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-b4624880-88d4-4e95-9f68-de6892c32b58 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] validate_networks() for [('b1f1f8a3-6579-4551-8baa-e65f1847be2c', None, None, None, None, None)] {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:39:19.087935 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-607d3e90-75e2-40ee-8560-8856d159640f req-65109be3-f10b-4ac4-929e-cbd3d7c9b548 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e73d534-0a40-42d2-813c-2e9dbb9239ac", "name": "network-vif-plugged", "status": "completed", "tag": "9e919ed7-a3b4-4ea2-bd4e-1bff31a5ba66"}, {"server_uuid": "7e73d534-0a40-42d2-813c-2e9dbb9239ac", "name": "network-vif-plugged", "status": "completed", "tag": "7eb3c0a9-011b-4ec7-a337-29cffc7192c5"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:39:19.103503 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-607d3e90-75e2-40ee-8560-8856d159640f req-65109be3-f10b-4ac4-929e-cbd3d7c9b548 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:19.104388 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-607d3e90-75e2-40ee-8560-8856d159640f req-65109be3-f10b-4ac4-929e-cbd3d7c9b548 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:19.104976 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-607d3e90-75e2-40ee-8560-8856d159640f req-65109be3-f10b-4ac4-929e-cbd3d7c9b548 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:19.138660 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-607d3e90-75e2-40ee-8560-8856d159640f req-65109be3-f10b-4ac4-929e-cbd3d7c9b548 service nova] Creating event network-vif-plugged:9e919ed7-a3b4-4ea2-bd4e-1bff31a5ba66 for instance 7e73d534-0a40-42d2-813c-2e9dbb9239ac on n-h2-862769-1 Oct 27 03:39:19.139735 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-607d3e90-75e2-40ee-8560-8856d159640f req-65109be3-f10b-4ac4-929e-cbd3d7c9b548 service nova] Creating event network-vif-plugged:7eb3c0a9-011b-4ec7-a337-29cffc7192c5 for instance 7e73d534-0a40-42d2-813c-2e9dbb9239ac on n-h2-862769-1 Oct 27 03:39:19.149369 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-607d3e90-75e2-40ee-8560-8856d159640f req-65109be3-f10b-4ac4-929e-cbd3d7c9b548 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.066458 Oct 27 03:39:19.151887 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2305/4345] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:39:19 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:39:19.159965 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3c792f52-af3f-47e8-8a71-66b343d0d37e tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:19.161384 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3c792f52-af3f-47e8-8a71-66b343d0d37e tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: 611195a7-9a81-43eb-9d7d-6c29d80f5933] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:19.176659 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3c792f52-af3f-47e8-8a71-66b343d0d37e tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:19.177361 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3c792f52-af3f-47e8-8a71-66b343d0d37e tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:19.177955 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3c792f52-af3f-47e8-8a71-66b343d0d37e tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:19.201637 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3c792f52-af3f-47e8-8a71-66b343d0d37e tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:19.202556 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3c792f52-af3f-47e8-8a71-66b343d0d37e tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:19.205326 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3c792f52-af3f-47e8-8a71-66b343d0d37e tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:19.530392 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3c792f52-af3f-47e8-8a71-66b343d0d37e tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18036411a99e4634bfbaeae24b9f254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229dcb63bc41444391544883b576ce2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:19.541409 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3c792f52-af3f-47e8-8a71-66b343d0d37e tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/611195a7-9a81-43eb-9d7d-6c29d80f5933" status: 200 len: 1364 microversion: 2.1 time: 0.387094 Oct 27 03:39:19.542999 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2306/4346] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:19 2022] GET /compute/v2.1/servers/611195a7-9a81-43eb-9d7d-6c29d80f5933 => generated 1364 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:39:19.612058 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-db1286d2-263c-441f-ad9b-439fa8ab732a tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:19.613029 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-db1286d2-263c-441f-ad9b-439fa8ab732a tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] [instance: 7e73d534-0a40-42d2-813c-2e9dbb9239ac] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:19.621318 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-db1286d2-263c-441f-ad9b-439fa8ab732a tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:19.623756 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-db1286d2-263c-441f-ad9b-439fa8ab732a tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:19.628423 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-db1286d2-263c-441f-ad9b-439fa8ab732a tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:19.629419 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-db1286d2-263c-441f-ad9b-439fa8ab732a tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:19.630711 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-db1286d2-263c-441f-ad9b-439fa8ab732a tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:19.631361 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-db1286d2-263c-441f-ad9b-439fa8ab732a tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:19.807656 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-b4624880-88d4-4e95-9f68-de6892c32b58 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:39:19.809995 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-b4624880-88d4-4e95-9f68-de6892c32b58 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:39:19.810563 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-b4624880-88d4-4e95-9f68-de6892c32b58 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:39:19.810992 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-b4624880-88d4-4e95-9f68-de6892c32b58 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:39:19.811416 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-b4624880-88d4-4e95-9f68-de6892c32b58 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:39:19.849090 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b4624880-88d4-4e95-9f68-de6892c32b58 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:19.849624 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b4624880-88d4-4e95-9f68-de6892c32b58 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:19.855351 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b4624880-88d4-4e95-9f68-de6892c32b58 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:19.861404 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b4624880-88d4-4e95-9f68-de6892c32b58 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:19.862760 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b4624880-88d4-4e95-9f68-de6892c32b58 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:19.863093 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b4624880-88d4-4e95-9f68-de6892c32b58 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:19.893363 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-b4624880-88d4-4e95-9f68-de6892c32b58 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Getting quotas for project 911997e881754ce390af17919f29b4ab. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:39:19.904852 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-b4624880-88d4-4e95-9f68-de6892c32b58 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Getting quotas for user b1cc79af058b4c35b3c572448fac86a7 and project 911997e881754ce390af17919f29b4ab. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:39:19.925424 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b4624880-88d4-4e95-9f68-de6892c32b58 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:39:19.928561 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b4624880-88d4-4e95-9f68-de6892c32b58 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: f637baad-6eca-4d76-a340-f7d25c6710b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:39:20.134940 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-db1286d2-263c-441f-ad9b-439fa8ab732a tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:20.157982 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b4624880-88d4-4e95-9f68-de6892c32b58 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.259269 Oct 27 03:39:20.159110 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2041/4347] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:39:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1261 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 03:39:20.164348 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a929792e-8c58-4260-b960-1070038b1149 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:20.168098 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a929792e-8c58-4260-b960-1070038b1149 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:20.170841 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-db1286d2-263c-441f-ad9b-439fa8ab732a tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:20.172767 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-db1286d2-263c-441f-ad9b-439fa8ab732a tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:20.178246 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-db1286d2-263c-441f-ad9b-439fa8ab732a tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] 10.222.0.20 "GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac" status: 200 len: 1879 microversion: 2.32 time: 0.570664 Oct 27 03:39:20.193655 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a929792e-8c58-4260-b960-1070038b1149 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:20.194343 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a929792e-8c58-4260-b960-1070038b1149 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:20.194922 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a929792e-8c58-4260-b960-1070038b1149 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:20.200163 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a929792e-8c58-4260-b960-1070038b1149 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:20.200857 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a929792e-8c58-4260-b960-1070038b1149 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:20.201877 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a929792e-8c58-4260-b960-1070038b1149 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:20.236237 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2307/4348] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:39:19 2022] GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac => generated 1879 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:39:20.263783 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-65d8578d-ce71-48c8-b13a-c7ac7b6899e4 req-6ebc0e8e-66b6-48b1-b2a8-1ccbbbc35796 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b", "tag": "a17729b0-068d-4ef4-8788-ff96c4c95fc2"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:39:20.317735 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-65d8578d-ce71-48c8-b13a-c7ac7b6899e4 req-6ebc0e8e-66b6-48b1-b2a8-1ccbbbc35796 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:20.318699 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-65d8578d-ce71-48c8-b13a-c7ac7b6899e4 req-6ebc0e8e-66b6-48b1-b2a8-1ccbbbc35796 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:20.319391 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-65d8578d-ce71-48c8-b13a-c7ac7b6899e4 req-6ebc0e8e-66b6-48b1-b2a8-1ccbbbc35796 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:20.358246 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-65d8578d-ce71-48c8-b13a-c7ac7b6899e4 req-6ebc0e8e-66b6-48b1-b2a8-1ccbbbc35796 service nova] Creating event network-changed:a17729b0-068d-4ef4-8788-ff96c4c95fc2 for instance db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b on n-h1-862769-1 Oct 27 03:39:20.380463 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-65d8578d-ce71-48c8-b13a-c7ac7b6899e4 req-6ebc0e8e-66b6-48b1-b2a8-1ccbbbc35796 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135567 Oct 27 03:39:20.383925 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2308/4349] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:39:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:39:20.397468 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-015848d9-8f6f-4b65-ab65-fdf94eeb62a4 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:20.399751 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-015848d9-8f6f-4b65-ab65-fdf94eeb62a4 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: f637baad-6eca-4d76-a340-f7d25c6710b4] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:20.542561 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a929792e-8c58-4260-b960-1070038b1149 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffc2b1c410149e884a47240b5425e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38450368ef5c4e68ac3c19c7a0a1ce65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:20.555654 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a929792e-8c58-4260-b960-1070038b1149 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b" status: 200 len: 1364 microversion: 2.1 time: 0.395216 Oct 27 03:39:20.567379 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2042/4350] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:20 2022] GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b => generated 1364 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:39:20.586554 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a9b0faaa-a65d-4006-8967-677f2c36af52 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:20.587446 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a9b0faaa-a65d-4006-8967-677f2c36af52 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: 611195a7-9a81-43eb-9d7d-6c29d80f5933] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:20.596149 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a9b0faaa-a65d-4006-8967-677f2c36af52 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:20.596907 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a9b0faaa-a65d-4006-8967-677f2c36af52 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:20.599202 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a9b0faaa-a65d-4006-8967-677f2c36af52 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:20.600185 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a9b0faaa-a65d-4006-8967-677f2c36af52 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:20.604320 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a9b0faaa-a65d-4006-8967-677f2c36af52 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:20.604791 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a9b0faaa-a65d-4006-8967-677f2c36af52 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:20.639002 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-015848d9-8f6f-4b65-ab65-fdf94eeb62a4 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:20.647151 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=15 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:39:20.656277 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-015848d9-8f6f-4b65-ab65-fdf94eeb62a4 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/f637baad-6eca-4d76-a340-f7d25c6710b4" status: 200 len: 1214 microversion: 2.1 time: 0.261070 Oct 27 03:39:20.657037 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2309/4351] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:20 2022] GET /compute/v2.1/servers/f637baad-6eca-4d76-a340-f7d25c6710b4 => generated 1214 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:39:20.686891 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-aba935f8-ce1b-4ebd-bf90-a0c65e41aba5 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:20.687527 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-aba935f8-ce1b-4ebd-bf90-a0c65e41aba5 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: f637baad-6eca-4d76-a340-f7d25c6710b4] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:20.726476 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-aba935f8-ce1b-4ebd-bf90-a0c65e41aba5 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: f637baad-6eca-4d76-a340-f7d25c6710b4] Going to try to terminate instance {{(pid=121001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:39:20.989841 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a9b0faaa-a65d-4006-8967-677f2c36af52 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18036411a99e4634bfbaeae24b9f254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229dcb63bc41444391544883b576ce2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:21.002649 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a9b0faaa-a65d-4006-8967-677f2c36af52 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/611195a7-9a81-43eb-9d7d-6c29d80f5933" status: 200 len: 1364 microversion: 2.1 time: 0.432584 Oct 27 03:39:21.005135 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2043/4352] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:20 2022] GET /compute/v2.1/servers/611195a7-9a81-43eb-9d7d-6c29d80f5933 => generated 1364 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:39:21.185928 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-35b707c7-db0f-48d3-928d-cdc4ceaf1dd2 req-15414c80-c8fb-4283-94cc-ee4a33ff3a3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e73d534-0a40-42d2-813c-2e9dbb9239ac", "name": "network-vif-plugged", "status": "completed", "tag": "46cca111-fadc-4d6b-a199-5b4f2005c03d"}, {"server_uuid": "7e73d534-0a40-42d2-813c-2e9dbb9239ac", "name": "network-vif-plugged", "status": "completed", "tag": "56ab5e70-ff8a-49bf-b017-824334f93dca"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:39:21.202485 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-35b707c7-db0f-48d3-928d-cdc4ceaf1dd2 req-15414c80-c8fb-4283-94cc-ee4a33ff3a3d service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:21.202976 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-35b707c7-db0f-48d3-928d-cdc4ceaf1dd2 req-15414c80-c8fb-4283-94cc-ee4a33ff3a3d service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:21.203414 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-35b707c7-db0f-48d3-928d-cdc4ceaf1dd2 req-15414c80-c8fb-4283-94cc-ee4a33ff3a3d service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:21.227544 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-35b707c7-db0f-48d3-928d-cdc4ceaf1dd2 req-15414c80-c8fb-4283-94cc-ee4a33ff3a3d service nova] Creating event network-vif-plugged:46cca111-fadc-4d6b-a199-5b4f2005c03d for instance 7e73d534-0a40-42d2-813c-2e9dbb9239ac on n-h2-862769-1 Oct 27 03:39:21.229390 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-35b707c7-db0f-48d3-928d-cdc4ceaf1dd2 req-15414c80-c8fb-4283-94cc-ee4a33ff3a3d service nova] Creating event network-vif-plugged:56ab5e70-ff8a-49bf-b017-824334f93dca for instance 7e73d534-0a40-42d2-813c-2e9dbb9239ac on n-h2-862769-1 Oct 27 03:39:21.242027 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-35b707c7-db0f-48d3-928d-cdc4ceaf1dd2 req-15414c80-c8fb-4283-94cc-ee4a33ff3a3d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.060900 Oct 27 03:39:21.245718 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2044/4353] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:39:21 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:39:21.264312 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-02c39752-27a7-46e1-832c-31a9b45a6984 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:21.264312 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-02c39752-27a7-46e1-832c-31a9b45a6984 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] [instance: 7e73d534-0a40-42d2-813c-2e9dbb9239ac] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:21.264641 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.scheduler.client.report [None req-aba935f8-ce1b-4ebd-bf90-a0c65e41aba5 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Deleted allocations for instance f637baad-6eca-4d76-a340-f7d25c6710b4 Oct 27 03:39:21.280984 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.compute.api [None req-aba935f8-ce1b-4ebd-bf90-a0c65e41aba5 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: f637baad-6eca-4d76-a340-f7d25c6710b4] Instance Mapping does not exist while attempting local delete cleanup. Oct 27 03:39:21.282024 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-aba935f8-ce1b-4ebd-bf90-a0c65e41aba5 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f637baad-6eca-4d76-a340-f7d25c6710b4" status: 204 len: 0 microversion: 2.1 time: 0.599728 Oct 27 03:39:21.285211 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2310/4354] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:39:20 2022] DELETE /compute/v2.1/servers/f637baad-6eca-4d76-a340-f7d25c6710b4 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 03:39:21.295007 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-02c39752-27a7-46e1-832c-31a9b45a6984 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:21.298022 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-02c39752-27a7-46e1-832c-31a9b45a6984 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:21.301554 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-02c39752-27a7-46e1-832c-31a9b45a6984 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:21.302612 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-02c39752-27a7-46e1-832c-31a9b45a6984 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:21.304620 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4ed9b7df-2949-471c-9ca9-2cbf5aa481fe tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:21.305774 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-02c39752-27a7-46e1-832c-31a9b45a6984 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:21.307423 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4ed9b7df-2949-471c-9ca9-2cbf5aa481fe tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: f637baad-6eca-4d76-a340-f7d25c6710b4] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:21.309912 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-02c39752-27a7-46e1-832c-31a9b45a6984 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:21.327704 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-4ed9b7df-2949-471c-9ca9-2cbf5aa481fe tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] HTTP exception thrown: Instance f637baad-6eca-4d76-a340-f7d25c6710b4 could not be found. Oct 27 03:39:21.327704 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4ed9b7df-2949-471c-9ca9-2cbf5aa481fe tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Request method failure captured: Oct 27 03:39:21.327704 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/f637baad-6eca-4d76-a340-f7d25c6710b4 HTTP/1.1 Oct 27 03:39:21.327704 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:39:21.327704 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:39:21.327704 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:39:21.327704 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:39:21.327704 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:39:21.327704 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:39:21.327704 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:39:21.327704 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:39:21.327704 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfz83jPBQR-IO_RgpXfqqqN_tSIl3Aju213bQLpPTkR-R_lkTGSpHz1Evy7Lbg7I5hWxU9AxviJyxNS0i-wRdj1_O4LyvZEjE6jerjzwB22Vu4S-ThF8W8FJgumwczGUcQup-Bjpiay7kN0UoT8q0uFoQytE3MKt1MX9CDbsUgcc03A Oct 27 03:39:21.327704 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:39:21.327704 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:39:21.327704 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:39:21.327704 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:39:21.327704 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:39:21.327704 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:39:21.327704 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 911997e881754ce390af17919f29b4ab Oct 27 03:39:21.327704 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-DeleteServersTestJSON-858473437 Oct 27 03:39:21.327704 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:39:21.327704 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:39:21.327704 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/911997e881754ce390af17919f29b4ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/911997e881754ce390af17919f29b4ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/911997e881754ce390af17919f29b4ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_911997e881754ce390af17919f29b4ab"}]}] Oct 27 03:39:21.327704 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-DeleteServersTestJSON-858473437 Oct 27 03:39:21.327704 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 911997e881754ce390af17919f29b4ab Oct 27 03:39:21.327704 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-DeleteServersTestJSON-858473437 Oct 27 03:39:21.327704 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-DeleteServersTestJSON-858473437-project Oct 27 03:39:21.327704 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:39:21.327704 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:39:21.327704 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: b1cc79af058b4c35b3c572448fac86a7 Oct 27 03:39:21.327704 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-DeleteServersTestJSON-858473437-project Oct 27 03:39:21.327704 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:39:21.327704 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance f637baad-6eca-4d76-a340-f7d25c6710b4 could not be found. Oct 27 03:39:21.327704 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': 'f637baad-6eca-4d76-a340-f7d25c6710b4'} Oct 27 03:39:21.327704 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:39:21.327704 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:39:21.327704 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:39:21.327704 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:39:21.327704 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:39:21.327704 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:39:21.327704 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 03:39:21.327704 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 03:39:21.327704 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f637baad-6eca-4d76-a340-f7d25c6710b4 could not be found. Oct 27 03:39:21.327704 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:39:21.327704 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:39:21.327704 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:39:21.327704 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:39:21.327704 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:39:21.327704 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:39:21.327704 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:39:21.327704 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:39:21.327704 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:39:21.327704 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:39:21.327704 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:39:21.327704 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:39:21.327704 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:39:21.327704 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:39:21.327704 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:39:21.327704 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:39:21.327704 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f637baad-6eca-4d76-a340-f7d25c6710b4 could not be found. Oct 27 03:39:21.327704 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:39:21.331245 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:39:21.331245 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:39:21.331245 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:39:21.331245 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:39:21.331245 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:39:21.331245 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:39:21.331245 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:39:21.331245 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f637baad-6eca-4d76-a340-f7d25c6710b4 could not be found. Oct 27 03:39:21.331245 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:39:21.338300 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4ed9b7df-2949-471c-9ca9-2cbf5aa481fe tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Returning 404 to user: Instance f637baad-6eca-4d76-a340-f7d25c6710b4 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:39:21.342374 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4ed9b7df-2949-471c-9ca9-2cbf5aa481fe tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/f637baad-6eca-4d76-a340-f7d25c6710b4" status: 404 len: 111 microversion: 2.1 time: 0.048607 Oct 27 03:39:21.344226 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2311/4355] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:21 2022] GET /compute/v2.1/servers/f637baad-6eca-4d76-a340-f7d25c6710b4 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:39:21.458368 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-10a61f04-8d61-44a9-8c8b-0efd60a14d2a tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-673604631", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": [{"uuid": "b1f1f8a3-6579-4551-8baa-e65f1847be2c"}]}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:39:21.536637 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.network.neutron [None req-10a61f04-8d61-44a9-8c8b-0efd60a14d2a tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] validate_networks() for [('b1f1f8a3-6579-4551-8baa-e65f1847be2c', None, None, None, None, None)] {{(pid=121001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:39:21.634163 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-02c39752-27a7-46e1-832c-31a9b45a6984 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:21.644325 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-02c39752-27a7-46e1-832c-31a9b45a6984 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:21.645813 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-02c39752-27a7-46e1-832c-31a9b45a6984 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:21.647019 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-02c39752-27a7-46e1-832c-31a9b45a6984 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] 10.222.0.20 "GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac" status: 200 len: 1879 microversion: 2.32 time: 0.398474 Oct 27 03:39:21.666352 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2045/4356] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:39:21 2022] GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac => generated 1879 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:39:21.670245 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8d96dc6b-1def-42c2-bd24-7bd1c9bd65da tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:21.671027 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8d96dc6b-1def-42c2-bd24-7bd1c9bd65da tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:21.677116 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8d96dc6b-1def-42c2-bd24-7bd1c9bd65da tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:21.681014 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8d96dc6b-1def-42c2-bd24-7bd1c9bd65da tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:21.681014 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8d96dc6b-1def-42c2-bd24-7bd1c9bd65da tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:21.681014 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8d96dc6b-1def-42c2-bd24-7bd1c9bd65da tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:21.681014 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8d96dc6b-1def-42c2-bd24-7bd1c9bd65da tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:21.681014 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8d96dc6b-1def-42c2-bd24-7bd1c9bd65da tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:21.832012 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8d96dc6b-1def-42c2-bd24-7bd1c9bd65da tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffc2b1c410149e884a47240b5425e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38450368ef5c4e68ac3c19c7a0a1ce65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:21.842605 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8d96dc6b-1def-42c2-bd24-7bd1c9bd65da tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b" status: 200 len: 1364 microversion: 2.1 time: 0.178985 Oct 27 03:39:21.843199 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2046/4357] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:21 2022] GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b => generated 1364 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:39:22.027872 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4e5335dd-f816-47ae-b46d-6922f19e675a tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:22.029193 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4e5335dd-f816-47ae-b46d-6922f19e675a tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: 611195a7-9a81-43eb-9d7d-6c29d80f5933] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:22.036543 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4e5335dd-f816-47ae-b46d-6922f19e675a tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:22.037054 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4e5335dd-f816-47ae-b46d-6922f19e675a tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:22.037490 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4e5335dd-f816-47ae-b46d-6922f19e675a tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:22.038320 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4e5335dd-f816-47ae-b46d-6922f19e675a tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:22.038935 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4e5335dd-f816-47ae-b46d-6922f19e675a tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:22.039598 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4e5335dd-f816-47ae-b46d-6922f19e675a tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:22.302881 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4e5335dd-f816-47ae-b46d-6922f19e675a tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18036411a99e4634bfbaeae24b9f254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229dcb63bc41444391544883b576ce2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:22.313331 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4e5335dd-f816-47ae-b46d-6922f19e675a tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/611195a7-9a81-43eb-9d7d-6c29d80f5933" status: 200 len: 1364 microversion: 2.1 time: 0.289139 Oct 27 03:39:22.348149 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2047/4358] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:22 2022] GET /compute/v2.1/servers/611195a7-9a81-43eb-9d7d-6c29d80f5933 => generated 1364 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:39:22.605633 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-10a61f04-8d61-44a9-8c8b-0efd60a14d2a tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Flavor limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:39:22.609360 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-10a61f04-8d61-44a9-8c8b-0efd60a14d2a tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Image limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:39:22.609360 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-10a61f04-8d61-44a9-8c8b-0efd60a14d2a tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Flavor pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:39:22.609360 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-10a61f04-8d61-44a9-8c8b-0efd60a14d2a tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Image pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:39:22.609360 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-10a61f04-8d61-44a9-8c8b-0efd60a14d2a tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:39:22.620409 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-10a61f04-8d61-44a9-8c8b-0efd60a14d2a tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:22.620991 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-10a61f04-8d61-44a9-8c8b-0efd60a14d2a tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:22.621559 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-10a61f04-8d61-44a9-8c8b-0efd60a14d2a tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:22.625266 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-10a61f04-8d61-44a9-8c8b-0efd60a14d2a tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:22.626238 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-10a61f04-8d61-44a9-8c8b-0efd60a14d2a tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:22.627209 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-10a61f04-8d61-44a9-8c8b-0efd60a14d2a tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:22.666331 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-10a61f04-8d61-44a9-8c8b-0efd60a14d2a tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Getting quotas for project 911997e881754ce390af17919f29b4ab. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:39:22.674701 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-10a61f04-8d61-44a9-8c8b-0efd60a14d2a tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Getting quotas for user b1cc79af058b4c35b3c572448fac86a7 and project 911997e881754ce390af17919f29b4ab. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:39:22.677883 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-fc3d283c-4a57-4c2b-a81a-5c93e9520680 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:22.678566 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-fc3d283c-4a57-4c2b-a81a-5c93e9520680 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] [instance: 7e73d534-0a40-42d2-813c-2e9dbb9239ac] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:22.686930 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fc3d283c-4a57-4c2b-a81a-5c93e9520680 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:22.687444 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fc3d283c-4a57-4c2b-a81a-5c93e9520680 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:22.687896 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fc3d283c-4a57-4c2b-a81a-5c93e9520680 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:22.691069 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fc3d283c-4a57-4c2b-a81a-5c93e9520680 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:22.691824 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fc3d283c-4a57-4c2b-a81a-5c93e9520680 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:22.694629 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fc3d283c-4a57-4c2b-a81a-5c93e9520680 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:22.704685 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-10a61f04-8d61-44a9-8c8b-0efd60a14d2a tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Going to run 1 instances... {{(pid=121001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:39:22.707952 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-10a61f04-8d61-44a9-8c8b-0efd60a14d2a tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 5a8d53f2-5448-44a3-af8f-cf17bfc69a12] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:39:22.903368 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-10a61f04-8d61-44a9-8c8b-0efd60a14d2a tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.453693 Oct 27 03:39:22.904730 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2312/4359] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:39:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1456 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 03:39:22.912381 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d9f422b4-b17d-4dcb-a6af-d907f4fd887e tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:22.913204 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d9f422b4-b17d-4dcb-a6af-d907f4fd887e tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:22.921732 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d9f422b4-b17d-4dcb-a6af-d907f4fd887e tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:22.923061 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d9f422b4-b17d-4dcb-a6af-d907f4fd887e tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:22.923646 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d9f422b4-b17d-4dcb-a6af-d907f4fd887e tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:22.924599 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d9f422b4-b17d-4dcb-a6af-d907f4fd887e tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:22.925782 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d9f422b4-b17d-4dcb-a6af-d907f4fd887e tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:22.926657 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d9f422b4-b17d-4dcb-a6af-d907f4fd887e tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:23.129106 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-fc3d283c-4a57-4c2b-a81a-5c93e9520680 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:23.145986 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-fc3d283c-4a57-4c2b-a81a-5c93e9520680 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:23.147490 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-fc3d283c-4a57-4c2b-a81a-5c93e9520680 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:23.148862 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-fc3d283c-4a57-4c2b-a81a-5c93e9520680 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] 10.222.0.20 "GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac" status: 200 len: 1879 microversion: 2.32 time: 0.476832 Oct 27 03:39:23.158926 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2048/4360] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:39:22 2022] GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac => generated 1879 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:39:23.164353 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c949d457-3aa1-491e-acab-dd383f1d5a8b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:23.164993 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c949d457-3aa1-491e-acab-dd383f1d5a8b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 5a8d53f2-5448-44a3-af8f-cf17bfc69a12] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:23.262722 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c949d457-3aa1-491e-acab-dd383f1d5a8b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:23.272562 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c949d457-3aa1-491e-acab-dd383f1d5a8b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/5a8d53f2-5448-44a3-af8f-cf17bfc69a12" status: 200 len: 1214 microversion: 2.1 time: 0.109729 Oct 27 03:39:23.273189 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2049/4361] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:23 2022] GET /compute/v2.1/servers/5a8d53f2-5448-44a3-af8f-cf17bfc69a12 => generated 1214 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:39:23.294650 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-8016e917-7695-4362-be50-99ca2d1a5fdc req-e727b153-7f07-4a23-b807-ea22815403c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e73d534-0a40-42d2-813c-2e9dbb9239ac", "name": "network-vif-plugged", "status": "completed", "tag": "190ba0a3-05d8-4eb3-b0ba-354848d76577"}, {"server_uuid": "7e73d534-0a40-42d2-813c-2e9dbb9239ac", "name": "network-vif-plugged", "status": "completed", "tag": "c0c13817-3015-471d-b722-6926066dd1a7"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:39:23.594654 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-8016e917-7695-4362-be50-99ca2d1a5fdc req-e727b153-7f07-4a23-b807-ea22815403c5 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:23.595584 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-8016e917-7695-4362-be50-99ca2d1a5fdc req-e727b153-7f07-4a23-b807-ea22815403c5 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:23.599310 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-8016e917-7695-4362-be50-99ca2d1a5fdc req-e727b153-7f07-4a23-b807-ea22815403c5 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:23.618284 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-8016e917-7695-4362-be50-99ca2d1a5fdc req-e727b153-7f07-4a23-b807-ea22815403c5 service nova] Creating event network-vif-plugged:190ba0a3-05d8-4eb3-b0ba-354848d76577 for instance 7e73d534-0a40-42d2-813c-2e9dbb9239ac on n-h2-862769-1 Oct 27 03:39:23.621325 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-8016e917-7695-4362-be50-99ca2d1a5fdc req-e727b153-7f07-4a23-b807-ea22815403c5 service nova] Creating event network-vif-plugged:c0c13817-3015-471d-b722-6926066dd1a7 for instance 7e73d534-0a40-42d2-813c-2e9dbb9239ac on n-h2-862769-1 Oct 27 03:39:23.627568 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-8016e917-7695-4362-be50-99ca2d1a5fdc req-e727b153-7f07-4a23-b807-ea22815403c5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.352761 Oct 27 03:39:23.628713 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2050/4362] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:39:23 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:39:23.640087 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6891a522-bd6d-4ab9-8b5d-8fed5d1a17e4 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:23.640087 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6891a522-bd6d-4ab9-8b5d-8fed5d1a17e4 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: 611195a7-9a81-43eb-9d7d-6c29d80f5933] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:23.655335 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6891a522-bd6d-4ab9-8b5d-8fed5d1a17e4 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:23.655852 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6891a522-bd6d-4ab9-8b5d-8fed5d1a17e4 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:23.658403 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6891a522-bd6d-4ab9-8b5d-8fed5d1a17e4 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:23.659393 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6891a522-bd6d-4ab9-8b5d-8fed5d1a17e4 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:23.660111 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6891a522-bd6d-4ab9-8b5d-8fed5d1a17e4 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:23.660737 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6891a522-bd6d-4ab9-8b5d-8fed5d1a17e4 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:23.918667 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-6891a522-bd6d-4ab9-8b5d-8fed5d1a17e4 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18036411a99e4634bfbaeae24b9f254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229dcb63bc41444391544883b576ce2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:23.927086 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6891a522-bd6d-4ab9-8b5d-8fed5d1a17e4 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/611195a7-9a81-43eb-9d7d-6c29d80f5933" status: 200 len: 1364 microversion: 2.1 time: 0.296899 Oct 27 03:39:23.927664 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2051/4363] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:23 2022] GET /compute/v2.1/servers/611195a7-9a81-43eb-9d7d-6c29d80f5933 => generated 1364 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:39:24.002673 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d9f422b4-b17d-4dcb-a6af-d907f4fd887e tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffc2b1c410149e884a47240b5425e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38450368ef5c4e68ac3c19c7a0a1ce65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:24.032702 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d9f422b4-b17d-4dcb-a6af-d907f4fd887e tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b" status: 200 len: 1364 microversion: 2.1 time: 1.126434 Oct 27 03:39:24.034365 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2313/4364] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:22 2022] GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b => generated 1364 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:39:24.175531 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b39dd40f-d396-43b7-9b7f-c1a21a05ba5d tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:24.176154 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b39dd40f-d396-43b7-9b7f-c1a21a05ba5d tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] [instance: 7e73d534-0a40-42d2-813c-2e9dbb9239ac] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:24.193164 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b39dd40f-d396-43b7-9b7f-c1a21a05ba5d tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:24.197438 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b39dd40f-d396-43b7-9b7f-c1a21a05ba5d tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:24.198225 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b39dd40f-d396-43b7-9b7f-c1a21a05ba5d tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:24.201969 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b39dd40f-d396-43b7-9b7f-c1a21a05ba5d tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:24.202358 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b39dd40f-d396-43b7-9b7f-c1a21a05ba5d tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:24.202817 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b39dd40f-d396-43b7-9b7f-c1a21a05ba5d tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:24.285780 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e4854cdf-737a-41f6-bd5b-80e86dceed82 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Action: 'create', calling method: .version_select at 0x7f7dd9c13a60>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-760585035", "policies": ["affinity"]}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:39:24.349557 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-e4854cdf-737a-41f6-bd5b-80e86dceed82 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Getting quotas for project 41e4481a955a4c98a44cffcc89af6eb4. Resources: {'server_groups'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:39:24.367494 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-e4854cdf-737a-41f6-bd5b-80e86dceed82 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Getting quotas for user 15f467c14d5241f2b147e4b88fb05916 and project 41e4481a955a4c98a44cffcc89af6eb4. Resources: {'server_groups'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:39:24.534395 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-e4854cdf-737a-41f6-bd5b-80e86dceed82 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Getting quotas for project 41e4481a955a4c98a44cffcc89af6eb4. Resources: {'server_groups'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:39:24.543595 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-e4854cdf-737a-41f6-bd5b-80e86dceed82 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Getting quotas for user 15f467c14d5241f2b147e4b88fb05916 and project 41e4481a955a4c98a44cffcc89af6eb4. Resources: {'server_groups'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:39:24.567242 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e4854cdf-737a-41f6-bd5b-80e86dceed82 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] 10.222.0.20 "POST /compute/v2.1/os-server-groups" status: 200 len: 183 microversion: 2.1 time: 0.616340 Oct 27 03:39:24.568432 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2052/4365] 10.222.0.20 () {60 vars in 1174 bytes} [Thu Oct 27 03:39:23 2022] POST /compute/v2.1/os-server-groups => generated 183 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:39:24.574444 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-65920f63-4256-4027-93bf-5390d322c58b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:24.578879 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-65920f63-4256-4027-93bf-5390d322c58b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 5a8d53f2-5448-44a3-af8f-cf17bfc69a12] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:24.582719 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-65920f63-4256-4027-93bf-5390d322c58b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:24.583615 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-65920f63-4256-4027-93bf-5390d322c58b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:24.584259 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-65920f63-4256-4027-93bf-5390d322c58b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:24.585178 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-65920f63-4256-4027-93bf-5390d322c58b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:24.585913 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-65920f63-4256-4027-93bf-5390d322c58b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:24.586762 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-65920f63-4256-4027-93bf-5390d322c58b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:24.720044 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-65920f63-4256-4027-93bf-5390d322c58b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:24.736649 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-65920f63-4256-4027-93bf-5390d322c58b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/5a8d53f2-5448-44a3-af8f-cf17bfc69a12" status: 200 len: 1218 microversion: 2.1 time: 0.165950 Oct 27 03:39:24.739638 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2053/4366] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:24 2022] GET /compute/v2.1/servers/5a8d53f2-5448-44a3-af8f-cf17bfc69a12 => generated 1218 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:39:24.746503 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b39dd40f-d396-43b7-9b7f-c1a21a05ba5d tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:24.761729 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-49416268-7f10-4066-8f63-c962329d2faa tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Action: 'create', calling method: .version_select at 0x7f7dd9c13040>, body: {"server_group": {"name": "tempest-server-group-1957485082", "policies": ["affinity"]}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:39:24.770819 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b39dd40f-d396-43b7-9b7f-c1a21a05ba5d tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:24.775957 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b39dd40f-d396-43b7-9b7f-c1a21a05ba5d tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:24.781810 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b39dd40f-d396-43b7-9b7f-c1a21a05ba5d tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] 10.222.0.20 "GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac" status: 200 len: 1879 microversion: 2.32 time: 0.610080 Oct 27 03:39:24.794258 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:39:24.801947 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2314/4367] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:39:24 2022] GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac => generated 1879 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:39:24.847748 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-49416268-7f10-4066-8f63-c962329d2faa tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Getting quotas for project 41e4481a955a4c98a44cffcc89af6eb4. Resources: {'server_groups'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:39:24.860533 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-49416268-7f10-4066-8f63-c962329d2faa tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Getting quotas for user 15f467c14d5241f2b147e4b88fb05916 and project 41e4481a955a4c98a44cffcc89af6eb4. Resources: {'server_groups'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:39:24.956329 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2672ce64-e858-4151-b8a8-5035095e628e tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:24.957180 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2672ce64-e858-4151-b8a8-5035095e628e tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: 611195a7-9a81-43eb-9d7d-6c29d80f5933] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:24.977180 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2672ce64-e858-4151-b8a8-5035095e628e tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:24.978531 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2672ce64-e858-4151-b8a8-5035095e628e tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:24.979124 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2672ce64-e858-4151-b8a8-5035095e628e tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:24.980003 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2672ce64-e858-4151-b8a8-5035095e628e tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:24.982108 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2672ce64-e858-4151-b8a8-5035095e628e tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:24.983022 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2672ce64-e858-4151-b8a8-5035095e628e tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:25.050877 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-49416268-7f10-4066-8f63-c962329d2faa tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Getting quotas for project 41e4481a955a4c98a44cffcc89af6eb4. Resources: {'server_groups'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:39:25.062117 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-49416268-7f10-4066-8f63-c962329d2faa tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Getting quotas for user 15f467c14d5241f2b147e4b88fb05916 and project 41e4481a955a4c98a44cffcc89af6eb4. Resources: {'server_groups'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:39:25.078549 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-49416268-7f10-4066-8f63-c962329d2faa tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] 10.222.0.20 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.337096 Oct 27 03:39:25.085332 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2054/4368] 10.222.0.20 () {60 vars in 1173 bytes} [Thu Oct 27 03:39:24 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:39:25.110064 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-64914642-8577-4b88-94e6-b662f9059684 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:25.110735 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-64914642-8577-4b88-94e6-b662f9059684 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:25.124867 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-64914642-8577-4b88-94e6-b662f9059684 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:25.125420 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-64914642-8577-4b88-94e6-b662f9059684 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:25.125877 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-64914642-8577-4b88-94e6-b662f9059684 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:25.126722 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-64914642-8577-4b88-94e6-b662f9059684 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:25.128059 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-64914642-8577-4b88-94e6-b662f9059684 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:25.128513 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-64914642-8577-4b88-94e6-b662f9059684 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:25.233015 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2672ce64-e858-4151-b8a8-5035095e628e tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18036411a99e4634bfbaeae24b9f254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229dcb63bc41444391544883b576ce2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:25.241767 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2672ce64-e858-4151-b8a8-5035095e628e tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/611195a7-9a81-43eb-9d7d-6c29d80f5933" status: 200 len: 1364 microversion: 2.1 time: 0.289787 Oct 27 03:39:25.254661 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2315/4369] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:24 2022] GET /compute/v2.1/servers/611195a7-9a81-43eb-9d7d-6c29d80f5933 => generated 1364 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:39:25.259419 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c8c0c9a1-701c-4cb3-a7ff-fd85c0d08457 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Action: 'create', calling method: .version_select at 0x7f7dd9eb51f0>, body: {"server_group": {"name": "tempest-server-group-1957485082", "policies": ["affinity"]}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:39:25.315066 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-c8c0c9a1-701c-4cb3-a7ff-fd85c0d08457 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Getting quotas for project 41e4481a955a4c98a44cffcc89af6eb4. Resources: {'server_groups'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:39:25.346825 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-c8c0c9a1-701c-4cb3-a7ff-fd85c0d08457 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Getting quotas for user 15f467c14d5241f2b147e4b88fb05916 and project 41e4481a955a4c98a44cffcc89af6eb4. Resources: {'server_groups'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:39:25.390602 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-64914642-8577-4b88-94e6-b662f9059684 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffc2b1c410149e884a47240b5425e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38450368ef5c4e68ac3c19c7a0a1ce65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:25.400698 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-64914642-8577-4b88-94e6-b662f9059684 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b" status: 200 len: 1364 microversion: 2.1 time: 0.314290 Oct 27 03:39:25.401592 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2055/4370] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:25 2022] GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b => generated 1364 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:39:25.477889 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f650d5af-dda7-408c-9150-36ee0dff2887 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Action: 'create', calling method: .version_select at 0x7f7dd9c13b80>, body: {"keypair": {"name": "tempest-keypair-340082829", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP+NySayLsRK0MNwBBRPHqmPt73Q8epUwQUhabFVmnABDWGIbHm1F+KV8HjW/Kxz+9rmT2ekxZuJVcE+0DbK0VH3RAq7avs2C0s+Gd1iX8wvUe1ZIC/jwygZPhymWMfoKg=="}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:39:25.500028 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-f650d5af-dda7-408c-9150-36ee0dff2887 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Getting quotas for project c48bca00e4d445918f030bf885424b40. Resources: {'key_pairs'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:39:25.508825 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-f650d5af-dda7-408c-9150-36ee0dff2887 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Getting quotas for user b74e8d6facd1460ab31a3ce4b24dd315 and project c48bca00e4d445918f030bf885424b40. Resources: {'key_pairs'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:39:25.546157 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-c8c0c9a1-701c-4cb3-a7ff-fd85c0d08457 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Getting quotas for project 41e4481a955a4c98a44cffcc89af6eb4. Resources: {'server_groups'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:39:25.551872 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-c8c0c9a1-701c-4cb3-a7ff-fd85c0d08457 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Getting quotas for user 15f467c14d5241f2b147e4b88fb05916 and project 41e4481a955a4c98a44cffcc89af6eb4. Resources: {'server_groups'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:39:25.567533 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c8c0c9a1-701c-4cb3-a7ff-fd85c0d08457 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] 10.222.0.20 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.323621 Oct 27 03:39:25.568582 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2316/4371] 10.222.0.20 () {60 vars in 1173 bytes} [Thu Oct 27 03:39:25 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:39:25.587933 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c33662f7-3335-4d4b-b25d-624ed89aa73d tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:25.616371 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f650d5af-dda7-408c-9150-36ee0dff2887 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.213217 Oct 27 03:39:25.617229 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2056/4372] 10.222.0.20 () {62 vars in 1200 bytes} [Thu Oct 27 03:39:25 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 215 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 27 03:39:25.665188 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-4ab3e0f7-88df-46d5-9a2f-19dd7fc3d6b8 req-90db7616-2aed-44ad-b364-3d180217ce67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "611195a7-9a81-43eb-9d7d-6c29d80f5933", "name": "network-vif-plugged", "status": "completed", "tag": "2191274a-4ef4-4cc4-a7b0-bf8217300db1"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:39:25.687442 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-4ab3e0f7-88df-46d5-9a2f-19dd7fc3d6b8 req-90db7616-2aed-44ad-b364-3d180217ce67 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:25.687941 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-4ab3e0f7-88df-46d5-9a2f-19dd7fc3d6b8 req-90db7616-2aed-44ad-b364-3d180217ce67 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:25.688444 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-4ab3e0f7-88df-46d5-9a2f-19dd7fc3d6b8 req-90db7616-2aed-44ad-b364-3d180217ce67 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:25.693245 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=100 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:39:25.701016 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-4ab3e0f7-88df-46d5-9a2f-19dd7fc3d6b8 req-90db7616-2aed-44ad-b364-3d180217ce67 service nova] Creating event network-vif-plugged:2191274a-4ef4-4cc4-a7b0-bf8217300db1 for instance 611195a7-9a81-43eb-9d7d-6c29d80f5933 on n-h2-862769-1 Oct 27 03:39:25.706091 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-4ab3e0f7-88df-46d5-9a2f-19dd7fc3d6b8 req-90db7616-2aed-44ad-b364-3d180217ce67 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052010 Oct 27 03:39:25.707009 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2057/4373] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:39:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:39:25.757339 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c33662f7-3335-4d4b-b25d-624ed89aa73d tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/49041da4-0bd5-4fe3-b372-7b614ddd87fb" status: 204 len: 0 microversion: 2.1 time: 0.181559 Oct 27 03:39:25.759027 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2317/4374] 10.222.0.20 () {58 vars in 1266 bytes} [Thu Oct 27 03:39:25 2022] DELETE /compute/v2.1/os-server-groups/49041da4-0bd5-4fe3-b372-7b614ddd87fb => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:39:25.767915 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-deb96412-c323-4fd7-a2b5-0406e3858f2d tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:25.768096 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4bf744da-821c-42b8-84ed-50de2e2bcd8c tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:25.771229 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4bf744da-821c-42b8-84ed-50de2e2bcd8c tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 5a8d53f2-5448-44a3-af8f-cf17bfc69a12] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:25.792430 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4bf744da-821c-42b8-84ed-50de2e2bcd8c tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:25.793300 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4bf744da-821c-42b8-84ed-50de2e2bcd8c tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:25.793970 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4bf744da-821c-42b8-84ed-50de2e2bcd8c tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:25.794769 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-deb96412-c323-4fd7-a2b5-0406e3858f2d tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups" status: 200 len: 334 microversion: 2.1 time: 0.029329 Oct 27 03:39:25.796100 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4bf744da-821c-42b8-84ed-50de2e2bcd8c tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:25.796899 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4bf744da-821c-42b8-84ed-50de2e2bcd8c tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:25.797227 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2318/4375] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Oct 27 03:39:25 2022] GET /compute/v2.1/os-server-groups => generated 334 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:39:25.798161 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4bf744da-821c-42b8-84ed-50de2e2bcd8c tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:25.810418 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b3f6ca3b-7730-4ba4-b47a-c6f6c5aba404 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:25.846572 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=6,nova_api:INSERT=5 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:39:25.933178 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b3f6ca3b-7730-4ba4-b47a-c6f6c5aba404 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/f79917a5-e42b-49d9-8673-e452167bcd7b" status: 204 len: 0 microversion: 2.1 time: 0.128523 Oct 27 03:39:25.937355 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2319/4376] 10.222.0.20 () {58 vars in 1266 bytes} [Thu Oct 27 03:39:25 2022] DELETE /compute/v2.1/os-server-groups/f79917a5-e42b-49d9-8673-e452167bcd7b => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 03:39:25.943715 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4b50cd61-e8a9-44e2-ae5e-2ee641a60211 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:25.944356 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4b50cd61-e8a9-44e2-ae5e-2ee641a60211 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] [instance: 7e73d534-0a40-42d2-813c-2e9dbb9239ac] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:25.954147 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4bf744da-821c-42b8-84ed-50de2e2bcd8c tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:25.961005 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4b50cd61-e8a9-44e2-ae5e-2ee641a60211 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:25.963000 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4b50cd61-e8a9-44e2-ae5e-2ee641a60211 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:25.963753 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4b50cd61-e8a9-44e2-ae5e-2ee641a60211 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:25.964678 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4b50cd61-e8a9-44e2-ae5e-2ee641a60211 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:25.966552 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4b50cd61-e8a9-44e2-ae5e-2ee641a60211 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:25.968309 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4b50cd61-e8a9-44e2-ae5e-2ee641a60211 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:25.969831 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4bf744da-821c-42b8-84ed-50de2e2bcd8c tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/5a8d53f2-5448-44a3-af8f-cf17bfc69a12" status: 200 len: 1266 microversion: 2.1 time: 0.211283 Oct 27 03:39:25.970620 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2058/4377] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:25 2022] GET /compute/v2.1/servers/5a8d53f2-5448-44a3-af8f-cf17bfc69a12 => generated 1266 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:39:25.985984 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c0480686-154d-445a-bc4e-a261837e3a6c tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:26.015827 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c0480686-154d-445a-bc4e-a261837e3a6c tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.040585 Oct 27 03:39:26.023545 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2059/4378] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Oct 27 03:39:25 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:39:26.033035 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3d269acd-301e-4083-b65a-ff0c7789cfa2 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Action: 'create', calling method: .version_select at 0x7f7ddb2c0820>, body: {"server_group": {"name": "tempest-server-group-308121432", "policies": ["affinity"]}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:39:26.080182 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-3d269acd-301e-4083-b65a-ff0c7789cfa2 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Getting quotas for project 41e4481a955a4c98a44cffcc89af6eb4. Resources: {'server_groups'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:39:26.088339 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-3d269acd-301e-4083-b65a-ff0c7789cfa2 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Getting quotas for user 15f467c14d5241f2b147e4b88fb05916 and project 41e4481a955a4c98a44cffcc89af6eb4. Resources: {'server_groups'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:39:26.278446 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-3d269acd-301e-4083-b65a-ff0c7789cfa2 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Getting quotas for project 41e4481a955a4c98a44cffcc89af6eb4. Resources: {'server_groups'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:39:26.285121 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-3d269acd-301e-4083-b65a-ff0c7789cfa2 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Getting quotas for user 15f467c14d5241f2b147e4b88fb05916 and project 41e4481a955a4c98a44cffcc89af6eb4. Resources: {'server_groups'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:39:26.304500 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3d269acd-301e-4083-b65a-ff0c7789cfa2 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] 10.222.0.20 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.278011 Oct 27 03:39:26.305499 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2060/4379] 10.222.0.20 () {60 vars in 1173 bytes} [Thu Oct 27 03:39:26 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:39:26.318938 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-33177e52-e3ec-41ad-9891-e19a0efa9057 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:26.319959 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-33177e52-e3ec-41ad-9891-e19a0efa9057 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: 611195a7-9a81-43eb-9d7d-6c29d80f5933] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:26.328026 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-33177e52-e3ec-41ad-9891-e19a0efa9057 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:26.328659 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-33177e52-e3ec-41ad-9891-e19a0efa9057 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:26.329194 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-33177e52-e3ec-41ad-9891-e19a0efa9057 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:26.329527 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4b50cd61-e8a9-44e2-ae5e-2ee641a60211 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:26.330134 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-33177e52-e3ec-41ad-9891-e19a0efa9057 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:26.330755 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-33177e52-e3ec-41ad-9891-e19a0efa9057 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:26.331291 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-33177e52-e3ec-41ad-9891-e19a0efa9057 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:26.341525 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4b50cd61-e8a9-44e2-ae5e-2ee641a60211 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:26.348954 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4b50cd61-e8a9-44e2-ae5e-2ee641a60211 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:26.366247 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4b50cd61-e8a9-44e2-ae5e-2ee641a60211 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] 10.222.0.20 "GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac" status: 200 len: 2828 microversion: 2.32 time: 0.412065 Oct 27 03:39:26.366247 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2320/4380] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:39:25 2022] GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac => generated 2828 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:39:26.366247 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9c04d28c-bb68-42ff-9e28-090125e6a28b tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:26.483241 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9c04d28c-bb68-42ff-9e28-090125e6a28b tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/549aced4-1ce6-4621-98c4-071dd75b058c" status: 204 len: 0 microversion: 2.1 time: 0.131047 Oct 27 03:39:26.484200 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2321/4381] 10.222.0.20 () {58 vars in 1266 bytes} [Thu Oct 27 03:39:26 2022] DELETE /compute/v2.1/os-server-groups/549aced4-1ce6-4621-98c4-071dd75b058c => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:39:26.489983 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b587b5da-b226-47c9-beff-018c27e73887 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:26.490736 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b587b5da-b226-47c9-beff-018c27e73887 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] [instance: 7e73d534-0a40-42d2-813c-2e9dbb9239ac] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:26.497763 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b587b5da-b226-47c9-beff-018c27e73887 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:26.499940 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b587b5da-b226-47c9-beff-018c27e73887 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:26.500645 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b587b5da-b226-47c9-beff-018c27e73887 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:26.501377 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b587b5da-b226-47c9-beff-018c27e73887 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:26.501838 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b587b5da-b226-47c9-beff-018c27e73887 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:26.502295 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b587b5da-b226-47c9-beff-018c27e73887 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:26.541120 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-33177e52-e3ec-41ad-9891-e19a0efa9057 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18036411a99e4634bfbaeae24b9f254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229dcb63bc41444391544883b576ce2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:26.550726 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-33177e52-e3ec-41ad-9891-e19a0efa9057 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/611195a7-9a81-43eb-9d7d-6c29d80f5933" status: 200 len: 1364 microversion: 2.1 time: 0.236356 Oct 27 03:39:26.551689 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2061/4382] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:26 2022] GET /compute/v2.1/servers/611195a7-9a81-43eb-9d7d-6c29d80f5933 => generated 1364 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:39:26.574154 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a5586041-de9f-4d7a-b9a8-68b1693344da tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:26.574741 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a5586041-de9f-4d7a-b9a8-68b1693344da tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:26.582385 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a5586041-de9f-4d7a-b9a8-68b1693344da tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:26.583185 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a5586041-de9f-4d7a-b9a8-68b1693344da tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:26.583295 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a5586041-de9f-4d7a-b9a8-68b1693344da tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:26.583983 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a5586041-de9f-4d7a-b9a8-68b1693344da tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:26.584445 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a5586041-de9f-4d7a-b9a8-68b1693344da tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:26.585546 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a5586041-de9f-4d7a-b9a8-68b1693344da tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:26.655331 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b587b5da-b226-47c9-beff-018c27e73887 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] 10.222.0.20 "GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac/os-interface" status: 200 len: 1828 microversion: 2.32 time: 0.169873 Oct 27 03:39:26.656378 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2322/4383] 10.222.0.20 () {60 vars in 1316 bytes} [Thu Oct 27 03:39:26 2022] GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac/os-interface => generated 1828 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:39:26.661057 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6b15d1f0-6860-43b4-b64a-76ea768958ef tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:26.684854 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6b15d1f0-6860-43b4-b64a-76ea768958ef tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.027840 Oct 27 03:39:26.685920 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2323/4384] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Oct 27 03:39:26 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:39:26.700480 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d5d810b1-09a2-4d50-8a07-95ab35f15a0c tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Action: 'create', calling method: .version_select at 0x7f7dda0d8a60>, body: {"server_group": {"name": "tempest-server-group-1165469366", "policies": ["anti-affinity"]}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:39:26.724612 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-d5d810b1-09a2-4d50-8a07-95ab35f15a0c tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Getting quotas for project 41e4481a955a4c98a44cffcc89af6eb4. Resources: {'server_groups'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:39:26.731908 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-d5d810b1-09a2-4d50-8a07-95ab35f15a0c tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Getting quotas for user 15f467c14d5241f2b147e4b88fb05916 and project 41e4481a955a4c98a44cffcc89af6eb4. Resources: {'server_groups'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:39:26.841825 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a5586041-de9f-4d7a-b9a8-68b1693344da tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffc2b1c410149e884a47240b5425e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38450368ef5c4e68ac3c19c7a0a1ce65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:26.859855 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a5586041-de9f-4d7a-b9a8-68b1693344da tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b" status: 200 len: 1364 microversion: 2.1 time: 0.290533 Oct 27 03:39:26.861065 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2062/4385] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:26 2022] GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b => generated 1364 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:39:26.881948 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-d5d810b1-09a2-4d50-8a07-95ab35f15a0c tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Getting quotas for project 41e4481a955a4c98a44cffcc89af6eb4. Resources: {'server_groups'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:39:26.887475 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-d5d810b1-09a2-4d50-8a07-95ab35f15a0c tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Getting quotas for user 15f467c14d5241f2b147e4b88fb05916 and project 41e4481a955a4c98a44cffcc89af6eb4. Resources: {'server_groups'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:39:26.917734 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d5d810b1-09a2-4d50-8a07-95ab35f15a0c tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] 10.222.0.20 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.219623 Oct 27 03:39:26.918409 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2324/4386] 10.222.0.20 () {60 vars in 1173 bytes} [Thu Oct 27 03:39:26 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:39:26.929408 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b8f36845-4296-468d-89ba-467e4c3379bf tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:26.997504 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-47dfd165-6499-41a1-bdbb-12b7272c194b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:26.998394 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-47dfd165-6499-41a1-bdbb-12b7272c194b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 5a8d53f2-5448-44a3-af8f-cf17bfc69a12] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:27.007755 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-47dfd165-6499-41a1-bdbb-12b7272c194b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:27.008582 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-47dfd165-6499-41a1-bdbb-12b7272c194b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:27.009759 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-47dfd165-6499-41a1-bdbb-12b7272c194b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:27.010867 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-47dfd165-6499-41a1-bdbb-12b7272c194b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:27.011554 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-47dfd165-6499-41a1-bdbb-12b7272c194b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:27.012246 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-47dfd165-6499-41a1-bdbb-12b7272c194b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:27.081279 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b8f36845-4296-468d-89ba-467e4c3379bf tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/29df1d4f-b381-4450-ad1b-5c902c66806e" status: 204 len: 0 microversion: 2.1 time: 0.155885 Oct 27 03:39:27.081799 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2063/4387] 10.222.0.20 () {58 vars in 1266 bytes} [Thu Oct 27 03:39:26 2022] DELETE /compute/v2.1/os-server-groups/29df1d4f-b381-4450-ad1b-5c902c66806e => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:39:27.090491 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-47e75dc9-2f1e-43fd-8832-00c4efcc71f8 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:27.105228 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-47e75dc9-2f1e-43fd-8832-00c4efcc71f8 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.019044 Oct 27 03:39:27.107270 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2064/4388] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Oct 27 03:39:27 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:39:27.146404 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-47dfd165-6499-41a1-bdbb-12b7272c194b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:27.162190 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-47dfd165-6499-41a1-bdbb-12b7272c194b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/5a8d53f2-5448-44a3-af8f-cf17bfc69a12" status: 200 len: 1272 microversion: 2.1 time: 0.166649 Oct 27 03:39:27.163383 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2325/4389] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:26 2022] GET /compute/v2.1/servers/5a8d53f2-5448-44a3-af8f-cf17bfc69a12 => generated 1272 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:39:27.255660 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c9339355-78c5-4dc7-8f19-a693b5588c8c tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-2028130551", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": [{"uuid": "6d43ec92-e372-47c2-83fa-097ea6d22962"}]}, "os:scheduler_hints": {"group": "32e52a42-c3c4-4147-9538-93f4a58a6069"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:39:27.350909 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-c9339355-78c5-4dc7-8f19-a693b5588c8c tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] validate_networks() for [('6d43ec92-e372-47c2-83fa-097ea6d22962', None, None, None, None, None)] {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:39:27.578103 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ae8b11ae-b39e-4be8-aee1-b7948355ccf2 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:27.579459 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ae8b11ae-b39e-4be8-aee1-b7948355ccf2 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: 611195a7-9a81-43eb-9d7d-6c29d80f5933] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:27.594512 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ae8b11ae-b39e-4be8-aee1-b7948355ccf2 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:27.595321 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ae8b11ae-b39e-4be8-aee1-b7948355ccf2 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:27.596044 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ae8b11ae-b39e-4be8-aee1-b7948355ccf2 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:27.596995 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ae8b11ae-b39e-4be8-aee1-b7948355ccf2 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:27.597670 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ae8b11ae-b39e-4be8-aee1-b7948355ccf2 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:27.598349 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ae8b11ae-b39e-4be8-aee1-b7948355ccf2 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:28.078481 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ae8b11ae-b39e-4be8-aee1-b7948355ccf2 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18036411a99e4634bfbaeae24b9f254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229dcb63bc41444391544883b576ce2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:28.089130 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ae8b11ae-b39e-4be8-aee1-b7948355ccf2 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/611195a7-9a81-43eb-9d7d-6c29d80f5933" status: 200 len: 1554 microversion: 2.1 time: 0.515106 Oct 27 03:39:28.091282 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2326/4390] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:27 2022] GET /compute/v2.1/servers/611195a7-9a81-43eb-9d7d-6c29d80f5933 => generated 1554 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:39:28.108149 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-21637124-6582-4764-9e11-167d760c553e req-41c5741d-7697-48ff-b3f4-9221be800d67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b", "name": "network-vif-plugged", "status": "completed", "tag": "a17729b0-068d-4ef4-8788-ff96c4c95fc2"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:39:28.124941 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-21637124-6582-4764-9e11-167d760c553e req-41c5741d-7697-48ff-b3f4-9221be800d67 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:28.129164 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-21637124-6582-4764-9e11-167d760c553e req-41c5741d-7697-48ff-b3f4-9221be800d67 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:28.129932 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-21637124-6582-4764-9e11-167d760c553e req-41c5741d-7697-48ff-b3f4-9221be800d67 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:28.152191 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-21637124-6582-4764-9e11-167d760c553e req-41c5741d-7697-48ff-b3f4-9221be800d67 service nova] Creating event network-vif-plugged:a17729b0-068d-4ef4-8788-ff96c4c95fc2 for instance db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b on n-h1-862769-1 Oct 27 03:39:28.169396 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-21637124-6582-4764-9e11-167d760c553e req-41c5741d-7697-48ff-b3f4-9221be800d67 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075486 Oct 27 03:39:28.171383 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2327/4391] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:39:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:39:28.179229 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-01f91697-acb9-4d18-bd90-3cb003567070 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:28.180348 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-01f91697-acb9-4d18-bd90-3cb003567070 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:28.188988 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-01f91697-acb9-4d18-bd90-3cb003567070 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:28.189816 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-01f91697-acb9-4d18-bd90-3cb003567070 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:28.190565 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-01f91697-acb9-4d18-bd90-3cb003567070 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:28.192979 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-01f91697-acb9-4d18-bd90-3cb003567070 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:28.193660 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-01f91697-acb9-4d18-bd90-3cb003567070 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:28.194331 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-01f91697-acb9-4d18-bd90-3cb003567070 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:28.215974 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=100 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:39:28.635666 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-01f91697-acb9-4d18-bd90-3cb003567070 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffc2b1c410149e884a47240b5425e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38450368ef5c4e68ac3c19c7a0a1ce65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:28.647929 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-01f91697-acb9-4d18-bd90-3cb003567070 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b" status: 200 len: 1364 microversion: 2.1 time: 0.474070 Oct 27 03:39:28.650437 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2328/4392] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:28 2022] GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b => generated 1364 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:39:28.658987 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-664ff3af-4dee-4321-a527-dd5f079386dc tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:28.659856 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-664ff3af-4dee-4321-a527-dd5f079386dc tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: 611195a7-9a81-43eb-9d7d-6c29d80f5933] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:28.673684 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-664ff3af-4dee-4321-a527-dd5f079386dc tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:28.675633 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-664ff3af-4dee-4321-a527-dd5f079386dc tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:28.677843 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-664ff3af-4dee-4321-a527-dd5f079386dc tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:28.679242 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-664ff3af-4dee-4321-a527-dd5f079386dc tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:28.680586 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-664ff3af-4dee-4321-a527-dd5f079386dc tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:28.681211 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-664ff3af-4dee-4321-a527-dd5f079386dc tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:28.785741 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-c9339355-78c5-4dc7-8f19-a693b5588c8c tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:39:28.786297 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-c9339355-78c5-4dc7-8f19-a693b5588c8c tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:39:28.786742 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-c9339355-78c5-4dc7-8f19-a693b5588c8c tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:39:28.787164 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-c9339355-78c5-4dc7-8f19-a693b5588c8c tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:39:28.787579 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-c9339355-78c5-4dc7-8f19-a693b5588c8c tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:39:28.802968 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c9339355-78c5-4dc7-8f19-a693b5588c8c tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:28.804196 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c9339355-78c5-4dc7-8f19-a693b5588c8c tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:28.804642 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c9339355-78c5-4dc7-8f19-a693b5588c8c tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:28.805388 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c9339355-78c5-4dc7-8f19-a693b5588c8c tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:28.805875 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c9339355-78c5-4dc7-8f19-a693b5588c8c tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:28.806885 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c9339355-78c5-4dc7-8f19-a693b5588c8c tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:28.815249 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=7 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:39:28.829996 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-664ff3af-4dee-4321-a527-dd5f079386dc tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/611195a7-9a81-43eb-9d7d-6c29d80f5933/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.177577 Oct 27 03:39:28.831245 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2329/4393] 10.222.0.20 () {58 vars in 1275 bytes} [Thu Oct 27 03:39:28 2022] GET /compute/v2.1/servers/611195a7-9a81-43eb-9d7d-6c29d80f5933/os-interface => generated 285 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:39:28.842982 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-c9339355-78c5-4dc7-8f19-a693b5588c8c tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Getting quotas for project 41e4481a955a4c98a44cffcc89af6eb4. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:39:28.843707 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f88570d5-56e8-41f0-afa0-61d828df44e5 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:28.844602 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f88570d5-56e8-41f0-afa0-61d828df44e5 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 5a8d53f2-5448-44a3-af8f-cf17bfc69a12] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:28.850892 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-c9339355-78c5-4dc7-8f19-a693b5588c8c tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Getting quotas for user 15f467c14d5241f2b147e4b88fb05916 and project 41e4481a955a4c98a44cffcc89af6eb4. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:39:28.856416 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f88570d5-56e8-41f0-afa0-61d828df44e5 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:28.857532 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f88570d5-56e8-41f0-afa0-61d828df44e5 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:28.858333 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f88570d5-56e8-41f0-afa0-61d828df44e5 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:28.861015 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f88570d5-56e8-41f0-afa0-61d828df44e5 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:28.861716 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f88570d5-56e8-41f0-afa0-61d828df44e5 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:28.862595 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f88570d5-56e8-41f0-afa0-61d828df44e5 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:28.864507 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c9339355-78c5-4dc7-8f19-a693b5588c8c tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:39:28.867171 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c9339355-78c5-4dc7-8f19-a693b5588c8c tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] [instance: 4c75e633-07ac-41b3-b095-a48f36a306a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:39:28.883083 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:DELETE=3 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:39:28.990204 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-c9339355-78c5-4dc7-8f19-a693b5588c8c tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Getting quotas for project 41e4481a955a4c98a44cffcc89af6eb4. Resources: {'server_group_members'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:39:28.996930 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-c9339355-78c5-4dc7-8f19-a693b5588c8c tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Getting quotas for user 15f467c14d5241f2b147e4b88fb05916 and project 41e4481a955a4c98a44cffcc89af6eb4. Resources: {'server_group_members'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:39:29.146785 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-c9339355-78c5-4dc7-8f19-a693b5588c8c tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Getting quotas for project 41e4481a955a4c98a44cffcc89af6eb4. Resources: {'server_group_members'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:39:29.152522 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-c9339355-78c5-4dc7-8f19-a693b5588c8c tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Getting quotas for user 15f467c14d5241f2b147e4b88fb05916 and project 41e4481a955a4c98a44cffcc89af6eb4. Resources: {'server_group_members'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:39:29.185174 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c9339355-78c5-4dc7-8f19-a693b5588c8c tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.933434 Oct 27 03:39:29.192413 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2065/4394] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:39:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1941 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 03:39:29.199168 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-be6a27f5-d621-46ab-aaea-df669046bd91 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:29.200201 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-be6a27f5-d621-46ab-aaea-df669046bd91 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] [instance: 4c75e633-07ac-41b3-b095-a48f36a306a0] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:29.297276 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-be6a27f5-d621-46ab-aaea-df669046bd91 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15f467c14d5241f2b147e4b88fb05916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4481a955a4c98a44cffcc89af6eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:29.310249 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-be6a27f5-d621-46ab-aaea-df669046bd91 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] 10.222.0.20 "GET /compute/v2.1/servers/4c75e633-07ac-41b3-b095-a48f36a306a0" status: 200 len: 1213 microversion: 2.1 time: 0.115375 Oct 27 03:39:29.315557 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2066/4395] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:29 2022] GET /compute/v2.1/servers/4c75e633-07ac-41b3-b095-a48f36a306a0 => generated 1213 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:39:29.595079 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-e89ee1b5-042c-4527-af56-1984b91bb367 req-a5b44d74-8eb3-465b-9c5e-bf80d58a639d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a8d53f2-5448-44a3-af8f-cf17bfc69a12", "tag": "c92bc264-d9b3-4da3-963f-e07775a44744"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:39:29.619023 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-e89ee1b5-042c-4527-af56-1984b91bb367 req-a5b44d74-8eb3-465b-9c5e-bf80d58a639d service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:29.620219 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-e89ee1b5-042c-4527-af56-1984b91bb367 req-a5b44d74-8eb3-465b-9c5e-bf80d58a639d service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:29.620926 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-e89ee1b5-042c-4527-af56-1984b91bb367 req-a5b44d74-8eb3-465b-9c5e-bf80d58a639d service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:29.644310 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-e89ee1b5-042c-4527-af56-1984b91bb367 req-a5b44d74-8eb3-465b-9c5e-bf80d58a639d service nova] Creating event network-changed:c92bc264-d9b3-4da3-963f-e07775a44744 for instance 5a8d53f2-5448-44a3-af8f-cf17bfc69a12 on n-h1-862769-1 Oct 27 03:39:29.651020 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-e89ee1b5-042c-4527-af56-1984b91bb367 req-a5b44d74-8eb3-465b-9c5e-bf80d58a639d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059502 Oct 27 03:39:29.652531 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2067/4396] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:39:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:39:29.677042 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2405ac91-2727-4707-981c-6b8962f50a1f tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:29.677760 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-2405ac91-2727-4707-981c-6b8962f50a1f tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:29.684708 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f88570d5-56e8-41f0-afa0-61d828df44e5 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:29.696142 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f88570d5-56e8-41f0-afa0-61d828df44e5 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/5a8d53f2-5448-44a3-af8f-cf17bfc69a12" status: 200 len: 1314 microversion: 2.1 time: 0.861885 Oct 27 03:39:29.706822 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2330/4397] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:28 2022] GET /compute/v2.1/servers/5a8d53f2-5448-44a3-af8f-cf17bfc69a12 => generated 1314 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:39:29.707209 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2405ac91-2727-4707-981c-6b8962f50a1f tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:29.707723 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2405ac91-2727-4707-981c-6b8962f50a1f tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:29.708171 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2405ac91-2727-4707-981c-6b8962f50a1f tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:29.709283 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2405ac91-2727-4707-981c-6b8962f50a1f tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:29.709842 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2405ac91-2727-4707-981c-6b8962f50a1f tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:29.713166 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2405ac91-2727-4707-981c-6b8962f50a1f tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:29.835562 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-c390c399-db7b-4861-98f1-ab29f8eebdeb req-aa4001ef-08a5-4c29-9343-ec730f01f544 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e73d534-0a40-42d2-813c-2e9dbb9239ac", "tag": "0cd3187b-ba4d-438e-9eba-f156955f5791"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:39:29.859716 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-c390c399-db7b-4861-98f1-ab29f8eebdeb req-aa4001ef-08a5-4c29-9343-ec730f01f544 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:29.860379 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-c390c399-db7b-4861-98f1-ab29f8eebdeb req-aa4001ef-08a5-4c29-9343-ec730f01f544 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:29.860994 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-c390c399-db7b-4861-98f1-ab29f8eebdeb req-aa4001ef-08a5-4c29-9343-ec730f01f544 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:29.881539 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-c390c399-db7b-4861-98f1-ab29f8eebdeb req-aa4001ef-08a5-4c29-9343-ec730f01f544 service nova] Creating event network-changed:0cd3187b-ba4d-438e-9eba-f156955f5791 for instance 7e73d534-0a40-42d2-813c-2e9dbb9239ac on n-h2-862769-1 Oct 27 03:39:29.901222 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-c390c399-db7b-4861-98f1-ab29f8eebdeb req-aa4001ef-08a5-4c29-9343-ec730f01f544 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069314 Oct 27 03:39:29.906873 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2331/4398] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:39:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:39:30.067113 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2405ac91-2727-4707-981c-6b8962f50a1f tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffc2b1c410149e884a47240b5425e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38450368ef5c4e68ac3c19c7a0a1ce65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:30.077855 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2405ac91-2727-4707-981c-6b8962f50a1f tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b" status: 200 len: 1364 microversion: 2.1 time: 0.406460 Oct 27 03:39:30.081557 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2068/4399] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:29 2022] GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b => generated 1364 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:39:30.342689 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0e5400c7-81f1-44a6-a32c-2b29083c4373 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:30.343400 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0e5400c7-81f1-44a6-a32c-2b29083c4373 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] [instance: 4c75e633-07ac-41b3-b095-a48f36a306a0] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:30.496864 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0e5400c7-81f1-44a6-a32c-2b29083c4373 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15f467c14d5241f2b147e4b88fb05916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4481a955a4c98a44cffcc89af6eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:30.507236 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0e5400c7-81f1-44a6-a32c-2b29083c4373 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] 10.222.0.20 "GET /compute/v2.1/servers/4c75e633-07ac-41b3-b095-a48f36a306a0" status: 200 len: 1213 microversion: 2.1 time: 0.169490 Oct 27 03:39:30.528887 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2332/4400] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:30 2022] GET /compute/v2.1/servers/4c75e633-07ac-41b3-b095-a48f36a306a0 => generated 1213 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:39:30.735943 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c4dbc224-3c29-41cf-b8cf-c11666c61c1b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:30.739534 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c4dbc224-3c29-41cf-b8cf-c11666c61c1b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 5a8d53f2-5448-44a3-af8f-cf17bfc69a12] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:30.768941 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c4dbc224-3c29-41cf-b8cf-c11666c61c1b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:30.771029 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c4dbc224-3c29-41cf-b8cf-c11666c61c1b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:30.771656 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c4dbc224-3c29-41cf-b8cf-c11666c61c1b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:30.773280 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c4dbc224-3c29-41cf-b8cf-c11666c61c1b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:30.774240 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c4dbc224-3c29-41cf-b8cf-c11666c61c1b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:30.774935 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c4dbc224-3c29-41cf-b8cf-c11666c61c1b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:30.974922 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c4dbc224-3c29-41cf-b8cf-c11666c61c1b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:31.001193 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c4dbc224-3c29-41cf-b8cf-c11666c61c1b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/5a8d53f2-5448-44a3-af8f-cf17bfc69a12" status: 200 len: 1314 microversion: 2.1 time: 0.271436 Oct 27 03:39:31.002326 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2069/4401] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:30 2022] GET /compute/v2.1/servers/5a8d53f2-5448-44a3-af8f-cf17bfc69a12 => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:39:31.104874 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ba3c89a6-23fa-4d01-b3f3-0bf77b30f642 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:31.105508 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ba3c89a6-23fa-4d01-b3f3-0bf77b30f642 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:31.125364 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ba3c89a6-23fa-4d01-b3f3-0bf77b30f642 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:31.125702 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e9ac9af5-a1e3-4c0c-9c2f-ce2aa78a47be tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-98249226", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "268657d7-8aff-46cc-acb8-efbdb14ca663"}], "security_groups": [{"name": "tempest-securitygroup--1938641986"}], "key_name": "tempest-keypair-340082829", "user_data": "}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:39:31.126313 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ba3c89a6-23fa-4d01-b3f3-0bf77b30f642 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:31.126475 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ba3c89a6-23fa-4d01-b3f3-0bf77b30f642 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:31.127139 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ba3c89a6-23fa-4d01-b3f3-0bf77b30f642 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:31.127602 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ba3c89a6-23fa-4d01-b3f3-0bf77b30f642 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:31.128038 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ba3c89a6-23fa-4d01-b3f3-0bf77b30f642 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:31.265466 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-e9ac9af5-a1e3-4c0c-9c2f-ce2aa78a47be tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] validate_networks() for [('268657d7-8aff-46cc-acb8-efbdb14ca663', None, None, None, None, None)] {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:39:31.432433 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ba3c89a6-23fa-4d01-b3f3-0bf77b30f642 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffc2b1c410149e884a47240b5425e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38450368ef5c4e68ac3c19c7a0a1ce65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:31.443646 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ba3c89a6-23fa-4d01-b3f3-0bf77b30f642 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b" status: 200 len: 1550 microversion: 2.1 time: 0.343222 Oct 27 03:39:31.444843 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2333/4402] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:31 2022] GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b => generated 1550 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:39:31.469136 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-15fa2dbe-52db-44ad-b7d4-a04ff85cec24 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:31.472077 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-15fa2dbe-52db-44ad-b7d4-a04ff85cec24 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:31.476385 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-15fa2dbe-52db-44ad-b7d4-a04ff85cec24 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:31.477151 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-15fa2dbe-52db-44ad-b7d4-a04ff85cec24 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:31.477757 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-15fa2dbe-52db-44ad-b7d4-a04ff85cec24 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:31.479168 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-15fa2dbe-52db-44ad-b7d4-a04ff85cec24 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:31.479795 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-15fa2dbe-52db-44ad-b7d4-a04ff85cec24 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:31.480365 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-15fa2dbe-52db-44ad-b7d4-a04ff85cec24 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:31.605452 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-15fa2dbe-52db-44ad-b7d4-a04ff85cec24 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.141021 Oct 27 03:39:31.606117 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2334/4403] 10.222.0.20 () {58 vars in 1275 bytes} [Thu Oct 27 03:39:31 2022] GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b/os-interface => generated 285 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:39:31.611077 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-28ecdb10-912e-4df8-ad60-32481a786fdd tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:31.611692 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-28ecdb10-912e-4df8-ad60-32481a786fdd tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] [instance: 4c75e633-07ac-41b3-b095-a48f36a306a0] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:31.623306 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-28ecdb10-912e-4df8-ad60-32481a786fdd tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:31.624600 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-28ecdb10-912e-4df8-ad60-32481a786fdd tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:31.626063 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-28ecdb10-912e-4df8-ad60-32481a786fdd tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:31.634322 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-28ecdb10-912e-4df8-ad60-32481a786fdd tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:31.639443 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-28ecdb10-912e-4df8-ad60-32481a786fdd tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:31.641227 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-28ecdb10-912e-4df8-ad60-32481a786fdd tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:31.763624 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-e9ac9af5-a1e3-4c0c-9c2f-ce2aa78a47be tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:39:31.765519 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-e9ac9af5-a1e3-4c0c-9c2f-ce2aa78a47be tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:39:31.766226 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-e9ac9af5-a1e3-4c0c-9c2f-ce2aa78a47be tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:39:31.766833 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-e9ac9af5-a1e3-4c0c-9c2f-ce2aa78a47be tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:39:31.767397 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-e9ac9af5-a1e3-4c0c-9c2f-ce2aa78a47be tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:39:31.779722 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e9ac9af5-a1e3-4c0c-9c2f-ce2aa78a47be tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:31.780315 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e9ac9af5-a1e3-4c0c-9c2f-ce2aa78a47be tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:31.780760 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e9ac9af5-a1e3-4c0c-9c2f-ce2aa78a47be tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:31.784845 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e9ac9af5-a1e3-4c0c-9c2f-ce2aa78a47be tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:31.784845 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e9ac9af5-a1e3-4c0c-9c2f-ce2aa78a47be tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:31.784845 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e9ac9af5-a1e3-4c0c-9c2f-ce2aa78a47be tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:31.799475 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-28ecdb10-912e-4df8-ad60-32481a786fdd tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15f467c14d5241f2b147e4b88fb05916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4481a955a4c98a44cffcc89af6eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:31.810625 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-e9ac9af5-a1e3-4c0c-9c2f-ce2aa78a47be tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Getting quotas for project c48bca00e4d445918f030bf885424b40. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:39:31.816399 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-28ecdb10-912e-4df8-ad60-32481a786fdd tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] 10.222.0.20 "GET /compute/v2.1/servers/4c75e633-07ac-41b3-b095-a48f36a306a0" status: 200 len: 1217 microversion: 2.1 time: 0.209142 Oct 27 03:39:31.819384 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-e9ac9af5-a1e3-4c0c-9c2f-ce2aa78a47be tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Getting quotas for user b74e8d6facd1460ab31a3ce4b24dd315 and project c48bca00e4d445918f030bf885424b40. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:39:31.820143 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2335/4404] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:31 2022] GET /compute/v2.1/servers/4c75e633-07ac-41b3-b095-a48f36a306a0 => generated 1217 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:39:31.842460 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e9ac9af5-a1e3-4c0c-9c2f-ce2aa78a47be tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:39:31.845323 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e9ac9af5-a1e3-4c0c-9c2f-ce2aa78a47be tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:39:32.024532 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4e2e95eb-f368-4be6-aeba-053e7d5c63f8 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:32.026099 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4e2e95eb-f368-4be6-aeba-053e7d5c63f8 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 5a8d53f2-5448-44a3-af8f-cf17bfc69a12] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:32.039262 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4e2e95eb-f368-4be6-aeba-053e7d5c63f8 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:32.042384 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4e2e95eb-f368-4be6-aeba-053e7d5c63f8 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:32.042384 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4e2e95eb-f368-4be6-aeba-053e7d5c63f8 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:32.043454 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4e2e95eb-f368-4be6-aeba-053e7d5c63f8 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:32.044251 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4e2e95eb-f368-4be6-aeba-053e7d5c63f8 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:32.044850 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4e2e95eb-f368-4be6-aeba-053e7d5c63f8 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:32.145972 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e9ac9af5-a1e3-4c0c-9c2f-ce2aa78a47be tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.024796 Oct 27 03:39:32.152093 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2070/4405] 10.222.0.20 () {62 vars in 1188 bytes} [Thu Oct 27 03:39:31 2022] POST /compute/v2.1/servers => generated 402 bytes in 1031 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 27 03:39:32.164443 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e7682699-48ef-4aee-92be-02cbcf21af0c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:32.165079 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e7682699-48ef-4aee-92be-02cbcf21af0c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:32.310654 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e7682699-48ef-4aee-92be-02cbcf21af0c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:32.324573 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e7682699-48ef-4aee-92be-02cbcf21af0c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:32.324573 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e7682699-48ef-4aee-92be-02cbcf21af0c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:32.325591 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e7682699-48ef-4aee-92be-02cbcf21af0c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79" status: 200 len: 1279 microversion: 2.20 time: 0.166606 Oct 27 03:39:32.326236 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2071/4406] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:39:32 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 => generated 1279 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:39:32.425775 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-4b712f5f-b516-4dfe-9ec3-5441d43edeb1 req-29874cbd-187f-413b-bdb0-0d23545618fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "611195a7-9a81-43eb-9d7d-6c29d80f5933", "tag": "2191274a-4ef4-4cc4-a7b0-bf8217300db1"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:39:32.441026 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-4b712f5f-b516-4dfe-9ec3-5441d43edeb1 req-29874cbd-187f-413b-bdb0-0d23545618fd service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:32.441026 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-4b712f5f-b516-4dfe-9ec3-5441d43edeb1 req-29874cbd-187f-413b-bdb0-0d23545618fd service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:32.441307 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-4b712f5f-b516-4dfe-9ec3-5441d43edeb1 req-29874cbd-187f-413b-bdb0-0d23545618fd service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:32.464094 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-4b712f5f-b516-4dfe-9ec3-5441d43edeb1 req-29874cbd-187f-413b-bdb0-0d23545618fd service nova] Creating event network-changed:2191274a-4ef4-4cc4-a7b0-bf8217300db1 for instance 611195a7-9a81-43eb-9d7d-6c29d80f5933 on n-h2-862769-1 Oct 27 03:39:32.469796 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-4b712f5f-b516-4dfe-9ec3-5441d43edeb1 req-29874cbd-187f-413b-bdb0-0d23545618fd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055279 Oct 27 03:39:32.471098 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2072/4407] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:39:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:39:32.653524 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:39:32.792520 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4e2e95eb-f368-4be6-aeba-053e7d5c63f8 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:32.801633 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4e2e95eb-f368-4be6-aeba-053e7d5c63f8 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/5a8d53f2-5448-44a3-af8f-cf17bfc69a12" status: 200 len: 1314 microversion: 2.1 time: 0.780977 Oct 27 03:39:32.802265 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2336/4408] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:32 2022] GET /compute/v2.1/servers/5a8d53f2-5448-44a3-af8f-cf17bfc69a12 => generated 1314 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:39:32.854063 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a16b9743-ab94-4b6b-8e61-26e9592876ec tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:32.854916 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a16b9743-ab94-4b6b-8e61-26e9592876ec tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] [instance: 4c75e633-07ac-41b3-b095-a48f36a306a0] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:32.861901 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a16b9743-ab94-4b6b-8e61-26e9592876ec tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:32.863690 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a16b9743-ab94-4b6b-8e61-26e9592876ec tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:32.871030 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a16b9743-ab94-4b6b-8e61-26e9592876ec tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:32.871030 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a16b9743-ab94-4b6b-8e61-26e9592876ec tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:32.871030 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a16b9743-ab94-4b6b-8e61-26e9592876ec tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:32.871030 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a16b9743-ab94-4b6b-8e61-26e9592876ec tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:32.954327 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a16b9743-ab94-4b6b-8e61-26e9592876ec tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15f467c14d5241f2b147e4b88fb05916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4481a955a4c98a44cffcc89af6eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:32.976960 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a16b9743-ab94-4b6b-8e61-26e9592876ec tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] 10.222.0.20 "GET /compute/v2.1/servers/4c75e633-07ac-41b3-b095-a48f36a306a0" status: 200 len: 1265 microversion: 2.1 time: 0.127829 Oct 27 03:39:32.991552 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2073/4409] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:32 2022] GET /compute/v2.1/servers/4c75e633-07ac-41b3-b095-a48f36a306a0 => generated 1265 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:39:33.355625 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ed72bcd5-d15b-44e6-af60-536494ec10ca tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:33.356235 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ed72bcd5-d15b-44e6-af60-536494ec10ca tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:33.450921 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ed72bcd5-d15b-44e6-af60-536494ec10ca tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:33.460297 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ed72bcd5-d15b-44e6-af60-536494ec10ca tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:33.462976 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ed72bcd5-d15b-44e6-af60-536494ec10ca tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:33.465624 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ed72bcd5-d15b-44e6-af60-536494ec10ca tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79" status: 200 len: 1279 microversion: 2.20 time: 0.116019 Oct 27 03:39:33.475565 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2337/4410] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:39:33 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 => generated 1279 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:39:33.825365 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a6fcaf72-a07e-4508-ae31-5e016f4cb6d0 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:33.825992 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a6fcaf72-a07e-4508-ae31-5e016f4cb6d0 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 5a8d53f2-5448-44a3-af8f-cf17bfc69a12] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:33.840976 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a6fcaf72-a07e-4508-ae31-5e016f4cb6d0 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:33.844531 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a6fcaf72-a07e-4508-ae31-5e016f4cb6d0 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:33.844531 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a6fcaf72-a07e-4508-ae31-5e016f4cb6d0 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:33.848333 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a6fcaf72-a07e-4508-ae31-5e016f4cb6d0 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:33.848796 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a6fcaf72-a07e-4508-ae31-5e016f4cb6d0 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:33.849309 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a6fcaf72-a07e-4508-ae31-5e016f4cb6d0 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:34.012608 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3e8f0862-95e5-41c7-9699-e0892a1ad1ac tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:34.013819 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3e8f0862-95e5-41c7-9699-e0892a1ad1ac tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] [instance: 4c75e633-07ac-41b3-b095-a48f36a306a0] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:34.021421 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3e8f0862-95e5-41c7-9699-e0892a1ad1ac tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:34.022213 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3e8f0862-95e5-41c7-9699-e0892a1ad1ac tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:34.022958 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3e8f0862-95e5-41c7-9699-e0892a1ad1ac tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:34.023835 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3e8f0862-95e5-41c7-9699-e0892a1ad1ac tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:34.024478 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3e8f0862-95e5-41c7-9699-e0892a1ad1ac tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:34.025635 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3e8f0862-95e5-41c7-9699-e0892a1ad1ac tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:34.105109 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a6fcaf72-a07e-4508-ae31-5e016f4cb6d0 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:34.122143 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a6fcaf72-a07e-4508-ae31-5e016f4cb6d0 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/5a8d53f2-5448-44a3-af8f-cf17bfc69a12" status: 200 len: 1314 microversion: 2.1 time: 0.301109 Oct 27 03:39:34.127405 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2074/4411] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:33 2022] GET /compute/v2.1/servers/5a8d53f2-5448-44a3-af8f-cf17bfc69a12 => generated 1314 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:39:34.138126 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3e8f0862-95e5-41c7-9699-e0892a1ad1ac tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15f467c14d5241f2b147e4b88fb05916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4481a955a4c98a44cffcc89af6eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:34.150146 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3e8f0862-95e5-41c7-9699-e0892a1ad1ac tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] 10.222.0.20 "GET /compute/v2.1/servers/4c75e633-07ac-41b3-b095-a48f36a306a0" status: 200 len: 1271 microversion: 2.1 time: 0.141244 Oct 27 03:39:34.153663 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2338/4412] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:34 2022] GET /compute/v2.1/servers/4c75e633-07ac-41b3-b095-a48f36a306a0 => generated 1271 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:39:34.380812 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-74a4bacf-09ed-4ca6-82db-f4714960335d req-73137955-a7c9-46ca-8cd5-cb6f513ebe71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a8d53f2-5448-44a3-af8f-cf17bfc69a12", "name": "network-vif-plugged", "status": "completed", "tag": "c92bc264-d9b3-4da3-963f-e07775a44744"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:39:34.391320 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-74a4bacf-09ed-4ca6-82db-f4714960335d req-73137955-a7c9-46ca-8cd5-cb6f513ebe71 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:34.391814 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-74a4bacf-09ed-4ca6-82db-f4714960335d req-73137955-a7c9-46ca-8cd5-cb6f513ebe71 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:34.394672 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-74a4bacf-09ed-4ca6-82db-f4714960335d req-73137955-a7c9-46ca-8cd5-cb6f513ebe71 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:34.404137 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-74a4bacf-09ed-4ca6-82db-f4714960335d req-73137955-a7c9-46ca-8cd5-cb6f513ebe71 service nova] Creating event network-vif-plugged:c92bc264-d9b3-4da3-963f-e07775a44744 for instance 5a8d53f2-5448-44a3-af8f-cf17bfc69a12 on n-h1-862769-1 Oct 27 03:39:34.409204 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-74a4bacf-09ed-4ca6-82db-f4714960335d req-73137955-a7c9-46ca-8cd5-cb6f513ebe71 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032179 Oct 27 03:39:34.410072 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2075/4413] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:39:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:39:34.500219 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f065565a-115d-4515-8ea2-7a0bd8d6fc06 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:34.501533 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f065565a-115d-4515-8ea2-7a0bd8d6fc06 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:34.511521 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f065565a-115d-4515-8ea2-7a0bd8d6fc06 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:34.512009 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f065565a-115d-4515-8ea2-7a0bd8d6fc06 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:34.512452 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f065565a-115d-4515-8ea2-7a0bd8d6fc06 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:34.513160 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f065565a-115d-4515-8ea2-7a0bd8d6fc06 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:34.513613 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f065565a-115d-4515-8ea2-7a0bd8d6fc06 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:34.514128 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f065565a-115d-4515-8ea2-7a0bd8d6fc06 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:34.529142 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-c7bbf380-e880-444f-ab65-467b01d1a55b req-bab751dd-4b41-4b71-8374-15c8dcb16509 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b", "tag": "a17729b0-068d-4ef4-8788-ff96c4c95fc2"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:39:34.546590 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-c7bbf380-e880-444f-ab65-467b01d1a55b req-bab751dd-4b41-4b71-8374-15c8dcb16509 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:34.547412 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-c7bbf380-e880-444f-ab65-467b01d1a55b req-bab751dd-4b41-4b71-8374-15c8dcb16509 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:34.547858 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-c7bbf380-e880-444f-ab65-467b01d1a55b req-bab751dd-4b41-4b71-8374-15c8dcb16509 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:34.559857 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-c7bbf380-e880-444f-ab65-467b01d1a55b req-bab751dd-4b41-4b71-8374-15c8dcb16509 service nova] Creating event network-changed:a17729b0-068d-4ef4-8788-ff96c4c95fc2 for instance db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b on n-h1-862769-1 Oct 27 03:39:34.565810 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-c7bbf380-e880-444f-ab65-467b01d1a55b req-bab751dd-4b41-4b71-8374-15c8dcb16509 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042125 Oct 27 03:39:34.567103 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2076/4414] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:39:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:39:34.603084 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f065565a-115d-4515-8ea2-7a0bd8d6fc06 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:34.620154 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f065565a-115d-4515-8ea2-7a0bd8d6fc06 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:34.628665 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f065565a-115d-4515-8ea2-7a0bd8d6fc06 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:34.633258 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f065565a-115d-4515-8ea2-7a0bd8d6fc06 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79" status: 200 len: 1331 microversion: 2.20 time: 0.137009 Oct 27 03:39:34.637403 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2339/4415] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:39:34 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 => generated 1331 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:39:34.946402 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1a763bc0-3b6b-48b6-8239-de6f6ca394de tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:34.962159 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1a763bc0-3b6b-48b6-8239-de6f6ca394de tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3e8e0bc10d3f451c8837c1f1e4d86eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4840257127594149b03c0aa3ab94b486', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:34.969739 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1a763bc0-3b6b-48b6-8239-de6f6ca394de tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Searching by: {'deleted': False, 'project_id': '4840257127594149b03c0aa3ab94b486'} {{(pid=121000) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 03:39:34.995214 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1a763bc0-3b6b-48b6-8239-de6f6ca394de tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:34.996068 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1a763bc0-3b6b-48b6-8239-de6f6ca394de tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:34.998839 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1a763bc0-3b6b-48b6-8239-de6f6ca394de tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:35.007939 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1a763bc0-3b6b-48b6-8239-de6f6ca394de tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:35.008452 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1a763bc0-3b6b-48b6-8239-de6f6ca394de tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:35.011815 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1a763bc0-3b6b-48b6-8239-de6f6ca394de tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:35.055462 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.multi_cell_list [None req-1a763bc0-3b6b-48b6-8239-de6f6ca394de tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121000) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 03:39:35.087493 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1a763bc0-3b6b-48b6-8239-de6f6ca394de tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.145369 Oct 27 03:39:35.088113 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2077/4416] 10.222.0.20 () {58 vars in 1125 bytes} [Thu Oct 27 03:39:34 2022] GET /compute/v2.1/servers => generated 334 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:39:35.103550 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2e9a1210-0726-49c5-9945-a5bfe55b5a8d tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:35.111351 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2e9a1210-0726-49c5-9945-a5bfe55b5a8d tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3e8e0bc10d3f451c8837c1f1e4d86eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4840257127594149b03c0aa3ab94b486', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:35.112218 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2e9a1210-0726-49c5-9945-a5bfe55b5a8d tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Searching by: {'deleted': False, 'project_id': '4840257127594149b03c0aa3ab94b486'} {{(pid=121001) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 03:39:35.117838 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2e9a1210-0726-49c5-9945-a5bfe55b5a8d tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:35.118885 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2e9a1210-0726-49c5-9945-a5bfe55b5a8d tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:35.119362 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2e9a1210-0726-49c5-9945-a5bfe55b5a8d tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:35.120084 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2e9a1210-0726-49c5-9945-a5bfe55b5a8d tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:35.120543 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2e9a1210-0726-49c5-9945-a5bfe55b5a8d tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:35.121609 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2e9a1210-0726-49c5-9945-a5bfe55b5a8d tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:35.151810 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7731a425-f0a4-4541-b787-376984c43b7c tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:35.152690 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.multi_cell_list [None req-2e9a1210-0726-49c5-9945-a5bfe55b5a8d tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121001) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 03:39:35.153388 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7731a425-f0a4-4541-b787-376984c43b7c tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 5a8d53f2-5448-44a3-af8f-cf17bfc69a12] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:35.162864 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7731a425-f0a4-4541-b787-376984c43b7c tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:35.163832 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7731a425-f0a4-4541-b787-376984c43b7c tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:35.164706 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7731a425-f0a4-4541-b787-376984c43b7c tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:35.165934 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7731a425-f0a4-4541-b787-376984c43b7c tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:35.166577 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7731a425-f0a4-4541-b787-376984c43b7c tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:35.167605 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7731a425-f0a4-4541-b787-376984c43b7c tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:35.200769 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2e9a1210-0726-49c5-9945-a5bfe55b5a8d tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8e0bc10d3f451c8837c1f1e4d86eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4840257127594149b03c0aa3ab94b486', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:35.207461 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2e9a1210-0726-49c5-9945-a5bfe55b5a8d tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:35.208134 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2e9a1210-0726-49c5-9945-a5bfe55b5a8d tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:35.208743 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2e9a1210-0726-49c5-9945-a5bfe55b5a8d tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:35.338567 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2e9a1210-0726-49c5-9945-a5bfe55b5a8d tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] 10.222.0.20 "GET /compute/v2.1/servers/detail" status: 200 len: 1699 microversion: 2.1 time: 0.239120 Oct 27 03:39:35.339335 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2340/4417] 10.222.0.20 () {58 vars in 1146 bytes} [Thu Oct 27 03:39:35 2022] GET /compute/v2.1/servers/detail => generated 1699 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:39:35.344145 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-25404bcd-f7fb-4196-a4d5-47cb5a5b9ae4 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:35.344763 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-25404bcd-f7fb-4196-a4d5-47cb5a5b9ae4 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] [instance: 4c75e633-07ac-41b3-b095-a48f36a306a0] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:35.350789 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-25404bcd-f7fb-4196-a4d5-47cb5a5b9ae4 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:35.351444 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-25404bcd-f7fb-4196-a4d5-47cb5a5b9ae4 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:35.352033 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-25404bcd-f7fb-4196-a4d5-47cb5a5b9ae4 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:35.353435 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-25404bcd-f7fb-4196-a4d5-47cb5a5b9ae4 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:35.354069 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-25404bcd-f7fb-4196-a4d5-47cb5a5b9ae4 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:35.354666 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-25404bcd-f7fb-4196-a4d5-47cb5a5b9ae4 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:35.418331 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7731a425-f0a4-4541-b787-376984c43b7c tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:35.427356 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7731a425-f0a4-4541-b787-376984c43b7c tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/5a8d53f2-5448-44a3-af8f-cf17bfc69a12" status: 200 len: 1314 microversion: 2.1 time: 0.282149 Oct 27 03:39:35.429352 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2078/4418] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:35 2022] GET /compute/v2.1/servers/5a8d53f2-5448-44a3-af8f-cf17bfc69a12 => generated 1314 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:39:35.435294 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1b4f5288-b0eb-4578-b375-0ff844c3e686 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:35.443753 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1b4f5288-b0eb-4578-b375-0ff844c3e686 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013330 Oct 27 03:39:35.444410 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2079/4419] 10.222.0.20 () {58 vars in 1137 bytes} [Thu Oct 27 03:39:35 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:39:35.532486 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-25404bcd-f7fb-4196-a4d5-47cb5a5b9ae4 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15f467c14d5241f2b147e4b88fb05916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4481a955a4c98a44cffcc89af6eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:35.541129 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-25404bcd-f7fb-4196-a4d5-47cb5a5b9ae4 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] 10.222.0.20 "GET /compute/v2.1/servers/4c75e633-07ac-41b3-b095-a48f36a306a0" status: 200 len: 1313 microversion: 2.1 time: 0.200129 Oct 27 03:39:35.541715 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2341/4420] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:35 2022] GET /compute/v2.1/servers/4c75e633-07ac-41b3-b095-a48f36a306a0 => generated 1313 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:39:35.667849 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-142169a1-8c8f-4061-a512-22f017d078bc tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:35.668487 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-142169a1-8c8f-4061-a512-22f017d078bc tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:35.674601 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-142169a1-8c8f-4061-a512-22f017d078bc tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:35.675293 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-142169a1-8c8f-4061-a512-22f017d078bc tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:35.675739 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-142169a1-8c8f-4061-a512-22f017d078bc tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:35.676621 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-142169a1-8c8f-4061-a512-22f017d078bc tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:35.676904 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-142169a1-8c8f-4061-a512-22f017d078bc tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:35.677336 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-142169a1-8c8f-4061-a512-22f017d078bc tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:35.757872 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-142169a1-8c8f-4061-a512-22f017d078bc tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:35.767357 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-142169a1-8c8f-4061-a512-22f017d078bc tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:35.768826 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-142169a1-8c8f-4061-a512-22f017d078bc tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:35.769973 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-142169a1-8c8f-4061-a512-22f017d078bc tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79" status: 200 len: 1331 microversion: 2.20 time: 0.107647 Oct 27 03:39:35.770692 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2080/4421] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:39:35 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 => generated 1331 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:39:35.917888 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-28e28c87-0403-4602-b42a-71ca1633a2b5 req-04bbe666-7fd2-4688-b399-57bb551e83fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c75e633-07ac-41b3-b095-a48f36a306a0", "tag": "2630e3e8-4991-4eb0-aca2-222f4e778427"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:39:35.932909 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-28e28c87-0403-4602-b42a-71ca1633a2b5 req-04bbe666-7fd2-4688-b399-57bb551e83fb service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:35.933395 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-28e28c87-0403-4602-b42a-71ca1633a2b5 req-04bbe666-7fd2-4688-b399-57bb551e83fb service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:35.934024 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-28e28c87-0403-4602-b42a-71ca1633a2b5 req-04bbe666-7fd2-4688-b399-57bb551e83fb service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:35.950068 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-28e28c87-0403-4602-b42a-71ca1633a2b5 req-04bbe666-7fd2-4688-b399-57bb551e83fb service nova] Creating event network-changed:2630e3e8-4991-4eb0-aca2-222f4e778427 for instance 4c75e633-07ac-41b3-b095-a48f36a306a0 on n-h1-862769-1 Oct 27 03:39:35.955207 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-28e28c87-0403-4602-b42a-71ca1633a2b5 req-04bbe666-7fd2-4688-b399-57bb551e83fb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042150 Oct 27 03:39:35.956206 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2342/4422] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:39:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:39:35.995034 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6543dbe5-0e59-43b4-96c0-2600d67dd165 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:35.995613 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6543dbe5-0e59-43b4-96c0-2600d67dd165 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] [instance: a5b04eee-69d9-4e2e-ac89-47cac8cdc538] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:36.002871 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6543dbe5-0e59-43b4-96c0-2600d67dd165 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:36.003593 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6543dbe5-0e59-43b4-96c0-2600d67dd165 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:36.004188 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6543dbe5-0e59-43b4-96c0-2600d67dd165 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:36.005285 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6543dbe5-0e59-43b4-96c0-2600d67dd165 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:36.005898 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6543dbe5-0e59-43b4-96c0-2600d67dd165 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:36.006365 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6543dbe5-0e59-43b4-96c0-2600d67dd165 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:36.060673 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6543dbe5-0e59-43b4-96c0-2600d67dd165 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] [instance: a5b04eee-69d9-4e2e-ac89-47cac8cdc538] Going to try to terminate instance {{(pid=121000) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:39:36.454819 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5c4a6e4a-44bc-448a-910b-b23e355c9c20 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:36.455594 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5c4a6e4a-44bc-448a-910b-b23e355c9c20 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 5a8d53f2-5448-44a3-af8f-cf17bfc69a12] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:36.463016 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5c4a6e4a-44bc-448a-910b-b23e355c9c20 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:36.463718 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5c4a6e4a-44bc-448a-910b-b23e355c9c20 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:36.464112 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5c4a6e4a-44bc-448a-910b-b23e355c9c20 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:36.464820 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5c4a6e4a-44bc-448a-910b-b23e355c9c20 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:36.465307 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5c4a6e4a-44bc-448a-910b-b23e355c9c20 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:36.465863 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5c4a6e4a-44bc-448a-910b-b23e355c9c20 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:36.472775 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6543dbe5-0e59-43b4-96c0-2600d67dd165 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a5b04eee-69d9-4e2e-ac89-47cac8cdc538" status: 204 len: 0 microversion: 2.1 time: 0.481012 Oct 27 03:39:36.473390 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2081/4423] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:39:35 2022] DELETE /compute/v2.1/servers/a5b04eee-69d9-4e2e-ac89-47cac8cdc538 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:39:36.482514 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c8740da8-08ba-4b26-afb3-905c4a7ef166 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:36.484251 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c8740da8-08ba-4b26-afb3-905c4a7ef166 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] [instance: a5b04eee-69d9-4e2e-ac89-47cac8cdc538] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:36.491960 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c8740da8-08ba-4b26-afb3-905c4a7ef166 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:36.492860 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c8740da8-08ba-4b26-afb3-905c4a7ef166 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:36.494015 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c8740da8-08ba-4b26-afb3-905c4a7ef166 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:36.494825 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c8740da8-08ba-4b26-afb3-905c4a7ef166 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:36.495441 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c8740da8-08ba-4b26-afb3-905c4a7ef166 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:36.495875 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c8740da8-08ba-4b26-afb3-905c4a7ef166 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:36.620968 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5c4a6e4a-44bc-448a-910b-b23e355c9c20 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:36.629956 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5c4a6e4a-44bc-448a-910b-b23e355c9c20 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/5a8d53f2-5448-44a3-af8f-cf17bfc69a12" status: 200 len: 1501 microversion: 2.1 time: 0.179501 Oct 27 03:39:36.633650 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2343/4424] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:36 2022] GET /compute/v2.1/servers/5a8d53f2-5448-44a3-af8f-cf17bfc69a12 => generated 1501 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:39:36.635615 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-36819fd6-7e55-48c1-9800-681c2d7c0fd1 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:36.636234 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-36819fd6-7e55-48c1-9800-681c2d7c0fd1 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] [instance: 4c75e633-07ac-41b3-b095-a48f36a306a0] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:36.645025 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-36819fd6-7e55-48c1-9800-681c2d7c0fd1 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:36.645522 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-36819fd6-7e55-48c1-9800-681c2d7c0fd1 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:36.646101 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-36819fd6-7e55-48c1-9800-681c2d7c0fd1 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:36.650643 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-36819fd6-7e55-48c1-9800-681c2d7c0fd1 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:36.650643 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-36819fd6-7e55-48c1-9800-681c2d7c0fd1 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:36.650643 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-36819fd6-7e55-48c1-9800-681c2d7c0fd1 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:36.740072 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c8740da8-08ba-4b26-afb3-905c4a7ef166 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8e0bc10d3f451c8837c1f1e4d86eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4840257127594149b03c0aa3ab94b486', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:36.745058 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c8740da8-08ba-4b26-afb3-905c4a7ef166 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] 10.222.0.20 "GET /compute/v2.1/servers/a5b04eee-69d9-4e2e-ac89-47cac8cdc538" status: 200 len: 1702 microversion: 2.1 time: 0.267249 Oct 27 03:39:36.745647 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2082/4425] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:36 2022] GET /compute/v2.1/servers/a5b04eee-69d9-4e2e-ac89-47cac8cdc538 => generated 1702 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:39:36.750485 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-277d4a67-252a-42db-837c-b5c479dc5515 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:39:36.751264 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-277d4a67-252a-42db-837c-b5c479dc5515 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 5a8d53f2-5448-44a3-af8f-cf17bfc69a12] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:36.758241 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-277d4a67-252a-42db-837c-b5c479dc5515 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:36.763221 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-277d4a67-252a-42db-837c-b5c479dc5515 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:36.763221 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-277d4a67-252a-42db-837c-b5c479dc5515 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:36.763221 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-277d4a67-252a-42db-837c-b5c479dc5515 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:36.763221 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-277d4a67-252a-42db-837c-b5c479dc5515 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:36.763221 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-277d4a67-252a-42db-837c-b5c479dc5515 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:36.784582 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-36819fd6-7e55-48c1-9800-681c2d7c0fd1 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15f467c14d5241f2b147e4b88fb05916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4481a955a4c98a44cffcc89af6eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:36.792649 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:39:36.793586 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-36819fd6-7e55-48c1-9800-681c2d7c0fd1 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] 10.222.0.20 "GET /compute/v2.1/servers/4c75e633-07ac-41b3-b095-a48f36a306a0" status: 200 len: 1313 microversion: 2.1 time: 0.162210 Oct 27 03:39:36.794429 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2344/4426] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:36 2022] GET /compute/v2.1/servers/4c75e633-07ac-41b3-b095-a48f36a306a0 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:39:36.799466 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0f205ad0-20f8-4260-9576-d06c18440961 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:36.800259 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0f205ad0-20f8-4260-9576-d06c18440961 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:36.807222 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0f205ad0-20f8-4260-9576-d06c18440961 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:36.807984 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0f205ad0-20f8-4260-9576-d06c18440961 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:36.808655 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0f205ad0-20f8-4260-9576-d06c18440961 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:36.809665 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0f205ad0-20f8-4260-9576-d06c18440961 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:36.810510 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0f205ad0-20f8-4260-9576-d06c18440961 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:36.811200 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0f205ad0-20f8-4260-9576-d06c18440961 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:36.882308 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0f205ad0-20f8-4260-9576-d06c18440961 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:36.891174 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0f205ad0-20f8-4260-9576-d06c18440961 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:36.895069 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0f205ad0-20f8-4260-9576-d06c18440961 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:36.895069 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0f205ad0-20f8-4260-9576-d06c18440961 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79" status: 200 len: 1337 microversion: 2.20 time: 0.098283 Oct 27 03:39:36.895069 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2345/4427] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:39:36 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 => generated 1337 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:39:37.004735 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-277d4a67-252a-42db-837c-b5c479dc5515 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "POST /compute/v2.1/servers/5a8d53f2-5448-44a3-af8f-cf17bfc69a12/action" status: 202 len: 0 microversion: 2.1 time: 0.257469 Oct 27 03:39:37.005529 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2083/4428] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:39:36 2022] POST /compute/v2.1/servers/5a8d53f2-5448-44a3-af8f-cf17bfc69a12/action => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:39:37.017525 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9711f347-f469-4514-8e71-d6c3133966c8 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:37.018181 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-9711f347-f469-4514-8e71-d6c3133966c8 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 5a8d53f2-5448-44a3-af8f-cf17bfc69a12] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:37.024756 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9711f347-f469-4514-8e71-d6c3133966c8 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:37.026098 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9711f347-f469-4514-8e71-d6c3133966c8 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:37.026098 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9711f347-f469-4514-8e71-d6c3133966c8 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:37.026516 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9711f347-f469-4514-8e71-d6c3133966c8 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:37.026984 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9711f347-f469-4514-8e71-d6c3133966c8 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:37.027461 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9711f347-f469-4514-8e71-d6c3133966c8 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:37.169170 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9711f347-f469-4514-8e71-d6c3133966c8 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:37.181736 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9711f347-f469-4514-8e71-d6c3133966c8 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/5a8d53f2-5448-44a3-af8f-cf17bfc69a12" status: 200 len: 1506 microversion: 2.1 time: 0.171232 Oct 27 03:39:37.188034 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2346/4429] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:37 2022] GET /compute/v2.1/servers/5a8d53f2-5448-44a3-af8f-cf17bfc69a12 => generated 1506 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:39:37.771419 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c695d5b4-bba2-4bba-8c92-a00352ad3c58 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:37.772245 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c695d5b4-bba2-4bba-8c92-a00352ad3c58 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] [instance: a5b04eee-69d9-4e2e-ac89-47cac8cdc538] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:37.779906 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c695d5b4-bba2-4bba-8c92-a00352ad3c58 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:37.780427 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c695d5b4-bba2-4bba-8c92-a00352ad3c58 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:37.780866 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c695d5b4-bba2-4bba-8c92-a00352ad3c58 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:37.781585 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c695d5b4-bba2-4bba-8c92-a00352ad3c58 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:37.782075 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c695d5b4-bba2-4bba-8c92-a00352ad3c58 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:37.782538 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c695d5b4-bba2-4bba-8c92-a00352ad3c58 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:37.821026 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5e176839-e735-4230-be85-47c0ae8d8d6f tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:37.823020 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5e176839-e735-4230-be85-47c0ae8d8d6f tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] [instance: 4c75e633-07ac-41b3-b095-a48f36a306a0] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:37.831854 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5e176839-e735-4230-be85-47c0ae8d8d6f tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:37.835454 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5e176839-e735-4230-be85-47c0ae8d8d6f tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:37.835454 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5e176839-e735-4230-be85-47c0ae8d8d6f tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:37.835454 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5e176839-e735-4230-be85-47c0ae8d8d6f tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:37.835454 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5e176839-e735-4230-be85-47c0ae8d8d6f tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:37.835454 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5e176839-e735-4230-be85-47c0ae8d8d6f tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:38.112885 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5e176839-e735-4230-be85-47c0ae8d8d6f tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15f467c14d5241f2b147e4b88fb05916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4481a955a4c98a44cffcc89af6eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:38.122923 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5e176839-e735-4230-be85-47c0ae8d8d6f tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] 10.222.0.20 "GET /compute/v2.1/servers/4c75e633-07ac-41b3-b095-a48f36a306a0" status: 200 len: 1313 microversion: 2.1 time: 0.307334 Oct 27 03:39:38.123234 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2347/4430] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:37 2022] GET /compute/v2.1/servers/4c75e633-07ac-41b3-b095-a48f36a306a0 => generated 1313 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:39:38.130447 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-94adf345-1e80-46c2-a12e-b2521452ee15 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:38.131127 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-94adf345-1e80-46c2-a12e-b2521452ee15 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:38.139662 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-94adf345-1e80-46c2-a12e-b2521452ee15 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:38.140762 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-94adf345-1e80-46c2-a12e-b2521452ee15 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:38.141220 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-94adf345-1e80-46c2-a12e-b2521452ee15 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:38.142293 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-94adf345-1e80-46c2-a12e-b2521452ee15 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:38.142894 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-94adf345-1e80-46c2-a12e-b2521452ee15 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:38.143449 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-94adf345-1e80-46c2-a12e-b2521452ee15 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:38.151155 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=100 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:39:38.386865 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-94adf345-1e80-46c2-a12e-b2521452ee15 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:38.396085 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-94adf345-1e80-46c2-a12e-b2521452ee15 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:38.397749 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-94adf345-1e80-46c2-a12e-b2521452ee15 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:38.399021 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-94adf345-1e80-46c2-a12e-b2521452ee15 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79" status: 200 len: 1405 microversion: 2.20 time: 0.273521 Oct 27 03:39:38.410416 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2348/4431] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:39:38 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 => generated 1405 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:39:38.410416 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b8ac3c25-07c3-4e18-9a29-4c8799338b14 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:38.410416 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b8ac3c25-07c3-4e18-9a29-4c8799338b14 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 5a8d53f2-5448-44a3-af8f-cf17bfc69a12] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:38.411649 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b8ac3c25-07c3-4e18-9a29-4c8799338b14 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:38.412129 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b8ac3c25-07c3-4e18-9a29-4c8799338b14 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:38.412576 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b8ac3c25-07c3-4e18-9a29-4c8799338b14 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:38.413477 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b8ac3c25-07c3-4e18-9a29-4c8799338b14 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:38.413942 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b8ac3c25-07c3-4e18-9a29-4c8799338b14 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:38.414406 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b8ac3c25-07c3-4e18-9a29-4c8799338b14 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:38.466587 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c695d5b4-bba2-4bba-8c92-a00352ad3c58 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8e0bc10d3f451c8837c1f1e4d86eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4840257127594149b03c0aa3ab94b486', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:38.478694 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c695d5b4-bba2-4bba-8c92-a00352ad3c58 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] 10.222.0.20 "GET /compute/v2.1/servers/a5b04eee-69d9-4e2e-ac89-47cac8cdc538" status: 200 len: 1702 microversion: 2.1 time: 0.711532 Oct 27 03:39:38.479588 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2084/4432] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:37 2022] GET /compute/v2.1/servers/a5b04eee-69d9-4e2e-ac89-47cac8cdc538 => generated 1702 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:39:38.660978 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b8ac3c25-07c3-4e18-9a29-4c8799338b14 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:38.670194 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b8ac3c25-07c3-4e18-9a29-4c8799338b14 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/5a8d53f2-5448-44a3-af8f-cf17bfc69a12" status: 200 len: 1486 microversion: 2.1 time: 0.269635 Oct 27 03:39:38.676439 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2349/4433] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:38 2022] GET /compute/v2.1/servers/5a8d53f2-5448-44a3-af8f-cf17bfc69a12 => generated 1486 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:39:38.693934 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-34e6798c-c2f9-4253-91f4-2c262e066cca tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:38.694691 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-34e6798c-c2f9-4253-91f4-2c262e066cca tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 5a8d53f2-5448-44a3-af8f-cf17bfc69a12] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:38.702412 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-34e6798c-c2f9-4253-91f4-2c262e066cca tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:38.702935 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-34e6798c-c2f9-4253-91f4-2c262e066cca tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:38.703812 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-34e6798c-c2f9-4253-91f4-2c262e066cca tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:38.704673 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-34e6798c-c2f9-4253-91f4-2c262e066cca tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:38.705219 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-34e6798c-c2f9-4253-91f4-2c262e066cca tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:38.705735 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-34e6798c-c2f9-4253-91f4-2c262e066cca tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:38.736400 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-34e6798c-c2f9-4253-91f4-2c262e066cca tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 5a8d53f2-5448-44a3-af8f-cf17bfc69a12] Going to try to terminate instance {{(pid=121000) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:39:39.110019 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-e0da6a59-e0d3-44ff-ac53-e21bdd3e767f req-5170ccee-236f-4c31-ba09-a34bbae179ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6854d7f3-0f6d-45c2-b46d-a5dc2922fe79", "tag": "425e1d50-5b4c-44cd-a54b-de48e280a305"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:39:39.114490 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-34e6798c-c2f9-4253-91f4-2c262e066cca tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5a8d53f2-5448-44a3-af8f-cf17bfc69a12" status: 204 len: 0 microversion: 2.1 time: 0.422205 Oct 27 03:39:39.114490 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2085/4434] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:39:38 2022] DELETE /compute/v2.1/servers/5a8d53f2-5448-44a3-af8f-cf17bfc69a12 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:39:39.118470 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:DELETE=4,nova_api:SELECT=94,nova_api:INSERT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:39:39.123373 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-e0da6a59-e0d3-44ff-ac53-e21bdd3e767f req-5170ccee-236f-4c31-ba09-a34bbae179ad service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:39.123864 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-58970f62-7bfc-424b-b594-12b3a60d3aee tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:39.124837 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-58970f62-7bfc-424b-b594-12b3a60d3aee tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 5a8d53f2-5448-44a3-af8f-cf17bfc69a12] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:39.125063 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-e0da6a59-e0d3-44ff-ac53-e21bdd3e767f req-5170ccee-236f-4c31-ba09-a34bbae179ad service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:39.125509 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-e0da6a59-e0d3-44ff-ac53-e21bdd3e767f req-5170ccee-236f-4c31-ba09-a34bbae179ad service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:39.132335 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:INSERT=7,nova_api:SELECT=91,nova_api:UPDATE=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:39:39.134764 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-58970f62-7bfc-424b-b594-12b3a60d3aee tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:39.135615 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-58970f62-7bfc-424b-b594-12b3a60d3aee tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:39.136232 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-58970f62-7bfc-424b-b594-12b3a60d3aee tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:39.137119 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-58970f62-7bfc-424b-b594-12b3a60d3aee tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:39.137732 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-58970f62-7bfc-424b-b594-12b3a60d3aee tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:39.138420 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-58970f62-7bfc-424b-b594-12b3a60d3aee tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:39.140105 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-e0da6a59-e0d3-44ff-ac53-e21bdd3e767f req-5170ccee-236f-4c31-ba09-a34bbae179ad service nova] Creating event network-changed:425e1d50-5b4c-44cd-a54b-de48e280a305 for instance 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 on n-h1-862769-1 Oct 27 03:39:39.150265 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-e0da6a59-e0d3-44ff-ac53-e21bdd3e767f req-5170ccee-236f-4c31-ba09-a34bbae179ad service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043518 Oct 27 03:39:39.152569 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2350/4435] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:39:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:39:39.159007 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d52f5e91-9a63-4e32-8313-1db4ec53622a tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:39.161029 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d52f5e91-9a63-4e32-8313-1db4ec53622a tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] [instance: 4c75e633-07ac-41b3-b095-a48f36a306a0] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:39.174926 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d52f5e91-9a63-4e32-8313-1db4ec53622a tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:39.176181 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d52f5e91-9a63-4e32-8313-1db4ec53622a tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:39.176919 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d52f5e91-9a63-4e32-8313-1db4ec53622a tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:39.177979 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d52f5e91-9a63-4e32-8313-1db4ec53622a tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:39.178694 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d52f5e91-9a63-4e32-8313-1db4ec53622a tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:39.179374 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d52f5e91-9a63-4e32-8313-1db4ec53622a tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:39.356307 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-58970f62-7bfc-424b-b594-12b3a60d3aee tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:39.366937 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-58970f62-7bfc-424b-b594-12b3a60d3aee tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/5a8d53f2-5448-44a3-af8f-cf17bfc69a12" status: 200 len: 1492 microversion: 2.1 time: 0.249387 Oct 27 03:39:39.378685 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2086/4436] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:39 2022] GET /compute/v2.1/servers/5a8d53f2-5448-44a3-af8f-cf17bfc69a12 => generated 1492 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:39:39.426976 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-cad382d6-1ed4-4ff3-841a-b9fe72bf9ec4 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:39.427728 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-cad382d6-1ed4-4ff3-841a-b9fe72bf9ec4 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:39.441396 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cad382d6-1ed4-4ff3-841a-b9fe72bf9ec4 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:39.441396 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cad382d6-1ed4-4ff3-841a-b9fe72bf9ec4 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:39.441396 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cad382d6-1ed4-4ff3-841a-b9fe72bf9ec4 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:39.441396 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cad382d6-1ed4-4ff3-841a-b9fe72bf9ec4 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:39.441396 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cad382d6-1ed4-4ff3-841a-b9fe72bf9ec4 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:39.441396 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cad382d6-1ed4-4ff3-841a-b9fe72bf9ec4 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:39.629788 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-cad382d6-1ed4-4ff3-841a-b9fe72bf9ec4 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:39.636329 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d52f5e91-9a63-4e32-8313-1db4ec53622a tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15f467c14d5241f2b147e4b88fb05916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4481a955a4c98a44cffcc89af6eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:39.641370 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-cad382d6-1ed4-4ff3-841a-b9fe72bf9ec4 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:39.643217 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-cad382d6-1ed4-4ff3-841a-b9fe72bf9ec4 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:39.643972 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d52f5e91-9a63-4e32-8313-1db4ec53622a tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] 10.222.0.20 "GET /compute/v2.1/servers/4c75e633-07ac-41b3-b095-a48f36a306a0" status: 200 len: 1313 microversion: 2.1 time: 0.489858 Oct 27 03:39:39.644548 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2351/4437] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:39 2022] GET /compute/v2.1/servers/4c75e633-07ac-41b3-b095-a48f36a306a0 => generated 1313 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:39:39.644685 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-cad382d6-1ed4-4ff3-841a-b9fe72bf9ec4 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79" status: 200 len: 1405 microversion: 2.20 time: 0.222477 Oct 27 03:39:39.645366 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2087/4438] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:39:39 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 => generated 1405 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:39:39.649403 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3243ac8f-8ab6-4d75-95f2-e1398c084ee3 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:39.649963 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3243ac8f-8ab6-4d75-95f2-e1398c084ee3 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] [instance: a5b04eee-69d9-4e2e-ac89-47cac8cdc538] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:39.650695 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-4e7f86b3-4146-4b80-9233-06434e0775d3 req-b310c15d-3292-4493-a3bb-2e29e16c8e3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5b04eee-69d9-4e2e-ac89-47cac8cdc538", "name": "network-vif-deleted", "tag": "ac9f1ae7-c113-419c-8833-ae00612ec193"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:39:39.661606 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-4e7f86b3-4146-4b80-9233-06434e0775d3 req-b310c15d-3292-4493-a3bb-2e29e16c8e3d service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:39.662562 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-4e7f86b3-4146-4b80-9233-06434e0775d3 req-b310c15d-3292-4493-a3bb-2e29e16c8e3d service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:39.663257 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-4e7f86b3-4146-4b80-9233-06434e0775d3 req-b310c15d-3292-4493-a3bb-2e29e16c8e3d service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:39.671385 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3243ac8f-8ab6-4d75-95f2-e1398c084ee3 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:39.673562 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3243ac8f-8ab6-4d75-95f2-e1398c084ee3 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:39.673562 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3243ac8f-8ab6-4d75-95f2-e1398c084ee3 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:39.673562 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3243ac8f-8ab6-4d75-95f2-e1398c084ee3 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:39.673562 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3243ac8f-8ab6-4d75-95f2-e1398c084ee3 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:39.674234 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3243ac8f-8ab6-4d75-95f2-e1398c084ee3 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:39.678625 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-4e7f86b3-4146-4b80-9233-06434e0775d3 req-b310c15d-3292-4493-a3bb-2e29e16c8e3d service nova] Creating event network-vif-deleted:ac9f1ae7-c113-419c-8833-ae00612ec193 for instance a5b04eee-69d9-4e2e-ac89-47cac8cdc538 on n-h1-862769-1 Oct 27 03:39:39.685820 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-4e7f86b3-4146-4b80-9233-06434e0775d3 req-b310c15d-3292-4493-a3bb-2e29e16c8e3d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038838 Oct 27 03:39:39.687099 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2088/4439] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:39:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:39:39.765457 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3243ac8f-8ab6-4d75-95f2-e1398c084ee3 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8e0bc10d3f451c8837c1f1e4d86eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4840257127594149b03c0aa3ab94b486', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:39.773679 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3243ac8f-8ab6-4d75-95f2-e1398c084ee3 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] 10.222.0.20 "GET /compute/v2.1/servers/a5b04eee-69d9-4e2e-ac89-47cac8cdc538" status: 200 len: 1634 microversion: 2.1 time: 0.127774 Oct 27 03:39:39.774284 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2352/4440] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:39 2022] GET /compute/v2.1/servers/a5b04eee-69d9-4e2e-ac89-47cac8cdc538 => generated 1634 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:39:40.392689 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-48794582-d139-45d3-8317-0ffa42a2f22a tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:40.393404 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-48794582-d139-45d3-8317-0ffa42a2f22a tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 5a8d53f2-5448-44a3-af8f-cf17bfc69a12] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:40.402268 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-48794582-d139-45d3-8317-0ffa42a2f22a tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:40.402826 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-48794582-d139-45d3-8317-0ffa42a2f22a tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:40.403271 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-48794582-d139-45d3-8317-0ffa42a2f22a tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:40.403979 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-48794582-d139-45d3-8317-0ffa42a2f22a tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:40.404438 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-48794582-d139-45d3-8317-0ffa42a2f22a tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:40.404867 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-48794582-d139-45d3-8317-0ffa42a2f22a tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:40.554362 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-48794582-d139-45d3-8317-0ffa42a2f22a tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:40.562474 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-48794582-d139-45d3-8317-0ffa42a2f22a tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/5a8d53f2-5448-44a3-af8f-cf17bfc69a12" status: 200 len: 1492 microversion: 2.1 time: 0.175028 Oct 27 03:39:40.563052 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2089/4441] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:40 2022] GET /compute/v2.1/servers/5a8d53f2-5448-44a3-af8f-cf17bfc69a12 => generated 1492 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:39:40.669015 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-82b1383b-694b-4d6e-976e-583a9af6a8c9 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:40.669660 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-82b1383b-694b-4d6e-976e-583a9af6a8c9 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] [instance: 4c75e633-07ac-41b3-b095-a48f36a306a0] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:40.675979 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-65383e99-a761-4cc3-b0a1-1e6604240ad5 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:40.676931 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-65383e99-a761-4cc3-b0a1-1e6604240ad5 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:40.678533 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-82b1383b-694b-4d6e-976e-583a9af6a8c9 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:40.678970 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-82b1383b-694b-4d6e-976e-583a9af6a8c9 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:40.679489 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-82b1383b-694b-4d6e-976e-583a9af6a8c9 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:40.680307 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-82b1383b-694b-4d6e-976e-583a9af6a8c9 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:40.680866 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-82b1383b-694b-4d6e-976e-583a9af6a8c9 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:40.681368 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-82b1383b-694b-4d6e-976e-583a9af6a8c9 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:40.683263 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-65383e99-a761-4cc3-b0a1-1e6604240ad5 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:40.683766 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-65383e99-a761-4cc3-b0a1-1e6604240ad5 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:40.684213 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-65383e99-a761-4cc3-b0a1-1e6604240ad5 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:40.685098 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-65383e99-a761-4cc3-b0a1-1e6604240ad5 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:40.685674 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-65383e99-a761-4cc3-b0a1-1e6604240ad5 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:40.686329 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-65383e99-a761-4cc3-b0a1-1e6604240ad5 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:40.827781 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-82b1383b-694b-4d6e-976e-583a9af6a8c9 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15f467c14d5241f2b147e4b88fb05916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4481a955a4c98a44cffcc89af6eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:40.841019 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-82b1383b-694b-4d6e-976e-583a9af6a8c9 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] 10.222.0.20 "GET /compute/v2.1/servers/4c75e633-07ac-41b3-b095-a48f36a306a0" status: 200 len: 1313 microversion: 2.1 time: 0.176963 Oct 27 03:39:40.842270 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2353/4442] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:40 2022] GET /compute/v2.1/servers/4c75e633-07ac-41b3-b095-a48f36a306a0 => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:39:40.843101 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-65383e99-a761-4cc3-b0a1-1e6604240ad5 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:40.847978 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e6307248-d580-4696-b0fb-451bf56a7627 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:40.848601 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e6307248-d580-4696-b0fb-451bf56a7627 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] [instance: a5b04eee-69d9-4e2e-ac89-47cac8cdc538] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:40.851834 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-65383e99-a761-4cc3-b0a1-1e6604240ad5 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:40.853610 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-65383e99-a761-4cc3-b0a1-1e6604240ad5 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:40.854793 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-65383e99-a761-4cc3-b0a1-1e6604240ad5 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79" status: 200 len: 1405 microversion: 2.20 time: 0.182968 Oct 27 03:39:40.854909 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e6307248-d580-4696-b0fb-451bf56a7627 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:40.855363 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e6307248-d580-4696-b0fb-451bf56a7627 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:40.868839 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2090/4443] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:39:40 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 => generated 1405 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:39:40.869859 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e6307248-d580-4696-b0fb-451bf56a7627 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:40.869859 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e6307248-d580-4696-b0fb-451bf56a7627 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:40.869859 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e6307248-d580-4696-b0fb-451bf56a7627 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:40.869859 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e6307248-d580-4696-b0fb-451bf56a7627 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:40.929965 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e6307248-d580-4696-b0fb-451bf56a7627 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8e0bc10d3f451c8837c1f1e4d86eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4840257127594149b03c0aa3ab94b486', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:40.938160 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e6307248-d580-4696-b0fb-451bf56a7627 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] 10.222.0.20 "GET /compute/v2.1/servers/a5b04eee-69d9-4e2e-ac89-47cac8cdc538" status: 200 len: 1354 microversion: 2.1 time: 0.094751 Oct 27 03:39:40.938730 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2354/4444] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:40 2022] GET /compute/v2.1/servers/a5b04eee-69d9-4e2e-ac89-47cac8cdc538 => generated 1354 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:39:41.591071 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-74223886-df6f-40eb-854e-9121fd249b28 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:41.592913 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-74223886-df6f-40eb-854e-9121fd249b28 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 5a8d53f2-5448-44a3-af8f-cf17bfc69a12] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:41.600294 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-74223886-df6f-40eb-854e-9121fd249b28 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:41.601155 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-74223886-df6f-40eb-854e-9121fd249b28 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:41.601669 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-74223886-df6f-40eb-854e-9121fd249b28 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:41.602451 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-74223886-df6f-40eb-854e-9121fd249b28 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:41.603545 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-74223886-df6f-40eb-854e-9121fd249b28 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:41.604211 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-74223886-df6f-40eb-854e-9121fd249b28 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:41.801043 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-74223886-df6f-40eb-854e-9121fd249b28 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:41.808710 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-74223886-df6f-40eb-854e-9121fd249b28 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/5a8d53f2-5448-44a3-af8f-cf17bfc69a12" status: 200 len: 1492 microversion: 2.1 time: 0.226215 Oct 27 03:39:41.809298 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2091/4445] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:41 2022] GET /compute/v2.1/servers/5a8d53f2-5448-44a3-af8f-cf17bfc69a12 => generated 1492 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:39:41.867173 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d38a790f-52bb-45be-9160-85be555de9ee tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:41.867889 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d38a790f-52bb-45be-9160-85be555de9ee tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] [instance: 4c75e633-07ac-41b3-b095-a48f36a306a0] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:41.874809 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d38a790f-52bb-45be-9160-85be555de9ee tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:41.875301 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d38a790f-52bb-45be-9160-85be555de9ee tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:41.875743 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d38a790f-52bb-45be-9160-85be555de9ee tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:41.877532 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d38a790f-52bb-45be-9160-85be555de9ee tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:41.877532 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d38a790f-52bb-45be-9160-85be555de9ee tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:41.877677 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d38a790f-52bb-45be-9160-85be555de9ee tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:41.892463 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-046f84cc-7356-4de7-af18-802baa33d8d6 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:41.893107 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-046f84cc-7356-4de7-af18-802baa33d8d6 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:41.900234 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-046f84cc-7356-4de7-af18-802baa33d8d6 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:41.900975 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-046f84cc-7356-4de7-af18-802baa33d8d6 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:41.901577 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-046f84cc-7356-4de7-af18-802baa33d8d6 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:41.902383 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-046f84cc-7356-4de7-af18-802baa33d8d6 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:41.902842 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-046f84cc-7356-4de7-af18-802baa33d8d6 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:41.903426 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-046f84cc-7356-4de7-af18-802baa33d8d6 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:42.090749 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d38a790f-52bb-45be-9160-85be555de9ee tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15f467c14d5241f2b147e4b88fb05916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4481a955a4c98a44cffcc89af6eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:42.118577 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d38a790f-52bb-45be-9160-85be555de9ee tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] 10.222.0.20 "GET /compute/v2.1/servers/4c75e633-07ac-41b3-b095-a48f36a306a0" status: 200 len: 1313 microversion: 2.1 time: 0.240678 Oct 27 03:39:42.118577 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2355/4446] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:41 2022] GET /compute/v2.1/servers/4c75e633-07ac-41b3-b095-a48f36a306a0 => generated 1313 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:39:42.118845 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-046f84cc-7356-4de7-af18-802baa33d8d6 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:42.130154 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-046f84cc-7356-4de7-af18-802baa33d8d6 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:42.131844 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-046f84cc-7356-4de7-af18-802baa33d8d6 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:42.132134 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-03325351-1ac3-4f06-930c-3515127c9bbc tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:42.132834 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-03325351-1ac3-4f06-930c-3515127c9bbc tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] [instance: a5b04eee-69d9-4e2e-ac89-47cac8cdc538] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:42.133036 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-046f84cc-7356-4de7-af18-802baa33d8d6 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79" status: 200 len: 1405 microversion: 2.20 time: 0.250576 Oct 27 03:39:42.140795 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-03325351-1ac3-4f06-930c-3515127c9bbc tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:42.141487 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-03325351-1ac3-4f06-930c-3515127c9bbc tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:42.141939 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-03325351-1ac3-4f06-930c-3515127c9bbc tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:42.143055 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-03325351-1ac3-4f06-930c-3515127c9bbc tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:42.147904 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-03325351-1ac3-4f06-930c-3515127c9bbc tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:42.147904 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-03325351-1ac3-4f06-930c-3515127c9bbc tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:42.150532 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2092/4447] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:39:41 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 => generated 1405 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:39:42.192336 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-03325351-1ac3-4f06-930c-3515127c9bbc tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:42.192842 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-03325351-1ac3-4f06-930c-3515127c9bbc tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:42.193287 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-03325351-1ac3-4f06-930c-3515127c9bbc tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:42.194423 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-03325351-1ac3-4f06-930c-3515127c9bbc tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Lazy-loading 'fault' on Instance uuid a5b04eee-69d9-4e2e-ac89-47cac8cdc538 {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:39:42.197202 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-a44eb027-676c-465a-9429-76d46ce1a323 req-375d75e9-f5f0-44e1-84e4-c3204435d524 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a8d53f2-5448-44a3-af8f-cf17bfc69a12", "name": "network-vif-deleted", "tag": "c92bc264-d9b3-4da3-963f-e07775a44744"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:39:42.211525 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-a44eb027-676c-465a-9429-76d46ce1a323 req-375d75e9-f5f0-44e1-84e4-c3204435d524 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:42.212746 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-a44eb027-676c-465a-9429-76d46ce1a323 req-375d75e9-f5f0-44e1-84e4-c3204435d524 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:42.213207 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-a44eb027-676c-465a-9429-76d46ce1a323 req-375d75e9-f5f0-44e1-84e4-c3204435d524 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:42.233219 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-a44eb027-676c-465a-9429-76d46ce1a323 req-375d75e9-f5f0-44e1-84e4-c3204435d524 service nova] Creating event network-vif-deleted:c92bc264-d9b3-4da3-963f-e07775a44744 for instance 5a8d53f2-5448-44a3-af8f-cf17bfc69a12 on n-h1-862769-1 Oct 27 03:39:42.241708 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-03325351-1ac3-4f06-930c-3515127c9bbc tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8e0bc10d3f451c8837c1f1e4d86eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4840257127594149b03c0aa3ab94b486', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:42.243768 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-a44eb027-676c-465a-9429-76d46ce1a323 req-375d75e9-f5f0-44e1-84e4-c3204435d524 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062511 Oct 27 03:39:42.245782 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2093/4448] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:39:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:39:42.259708 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-03325351-1ac3-4f06-930c-3515127c9bbc tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] 10.222.0.20 "GET /compute/v2.1/servers/a5b04eee-69d9-4e2e-ac89-47cac8cdc538" status: 200 len: 1359 microversion: 2.1 time: 0.125504 Oct 27 03:39:42.266272 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2356/4449] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:42 2022] GET /compute/v2.1/servers/a5b04eee-69d9-4e2e-ac89-47cac8cdc538 => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:39:42.352371 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=74 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:39:42.356635 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-2f4febb5-768d-4485-8f6b-19d48062c8c4 req-d20b8e53-fde8-48b2-8170-9e109ac3d703 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c75e633-07ac-41b3-b095-a48f36a306a0", "name": "network-vif-plugged", "status": "completed", "tag": "2630e3e8-4991-4eb0-aca2-222f4e778427"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:39:42.366434 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-2f4febb5-768d-4485-8f6b-19d48062c8c4 req-d20b8e53-fde8-48b2-8170-9e109ac3d703 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:42.366916 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-2f4febb5-768d-4485-8f6b-19d48062c8c4 req-d20b8e53-fde8-48b2-8170-9e109ac3d703 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:42.367411 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-2f4febb5-768d-4485-8f6b-19d48062c8c4 req-d20b8e53-fde8-48b2-8170-9e109ac3d703 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:42.379236 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-2f4febb5-768d-4485-8f6b-19d48062c8c4 req-d20b8e53-fde8-48b2-8170-9e109ac3d703 service nova] Creating event network-vif-plugged:2630e3e8-4991-4eb0-aca2-222f4e778427 for instance 4c75e633-07ac-41b3-b095-a48f36a306a0 on n-h1-862769-1 Oct 27 03:39:42.384715 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-2f4febb5-768d-4485-8f6b-19d48062c8c4 req-d20b8e53-fde8-48b2-8170-9e109ac3d703 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032552 Oct 27 03:39:42.385317 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2094/4450] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:39:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:39:42.832079 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-68a3cd67-357d-46b7-9738-42461ebda384 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:42.832623 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-68a3cd67-357d-46b7-9738-42461ebda384 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 5a8d53f2-5448-44a3-af8f-cf17bfc69a12] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:42.839596 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-68a3cd67-357d-46b7-9738-42461ebda384 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:42.840117 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-68a3cd67-357d-46b7-9738-42461ebda384 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:42.840644 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-68a3cd67-357d-46b7-9738-42461ebda384 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:42.841441 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-68a3cd67-357d-46b7-9738-42461ebda384 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:42.841890 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-68a3cd67-357d-46b7-9738-42461ebda384 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:42.842346 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-68a3cd67-357d-46b7-9738-42461ebda384 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:42.905254 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-68a3cd67-357d-46b7-9738-42461ebda384 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:42.913009 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-68a3cd67-357d-46b7-9738-42461ebda384 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/5a8d53f2-5448-44a3-af8f-cf17bfc69a12" status: 200 len: 1450 microversion: 2.1 time: 0.084862 Oct 27 03:39:42.913578 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2357/4451] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:42 2022] GET /compute/v2.1/servers/5a8d53f2-5448-44a3-af8f-cf17bfc69a12 => generated 1450 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:39:43.135581 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-290a7522-fe6b-4594-be4b-05f7a02e3af7 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:43.136222 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-290a7522-fe6b-4594-be4b-05f7a02e3af7 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] [instance: 4c75e633-07ac-41b3-b095-a48f36a306a0] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:43.142968 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-290a7522-fe6b-4594-be4b-05f7a02e3af7 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:43.143453 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-290a7522-fe6b-4594-be4b-05f7a02e3af7 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:43.143890 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-290a7522-fe6b-4594-be4b-05f7a02e3af7 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:43.144588 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-290a7522-fe6b-4594-be4b-05f7a02e3af7 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:43.145047 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-290a7522-fe6b-4594-be4b-05f7a02e3af7 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:43.145474 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-290a7522-fe6b-4594-be4b-05f7a02e3af7 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:43.180158 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-27580443-df04-48ab-9ede-7dcef75ee4c6 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:43.184038 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-27580443-df04-48ab-9ede-7dcef75ee4c6 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:43.194458 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-27580443-df04-48ab-9ede-7dcef75ee4c6 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:43.194961 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-27580443-df04-48ab-9ede-7dcef75ee4c6 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:43.195412 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-27580443-df04-48ab-9ede-7dcef75ee4c6 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:43.196128 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-27580443-df04-48ab-9ede-7dcef75ee4c6 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:43.196589 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-27580443-df04-48ab-9ede-7dcef75ee4c6 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:43.197022 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-27580443-df04-48ab-9ede-7dcef75ee4c6 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:43.344318 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-27580443-df04-48ab-9ede-7dcef75ee4c6 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:43.345467 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-290a7522-fe6b-4594-be4b-05f7a02e3af7 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15f467c14d5241f2b147e4b88fb05916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4481a955a4c98a44cffcc89af6eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:43.355876 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-290a7522-fe6b-4594-be4b-05f7a02e3af7 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] 10.222.0.20 "GET /compute/v2.1/servers/4c75e633-07ac-41b3-b095-a48f36a306a0" status: 200 len: 1313 microversion: 2.1 time: 0.226073 Oct 27 03:39:43.356480 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2095/4452] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:43 2022] GET /compute/v2.1/servers/4c75e633-07ac-41b3-b095-a48f36a306a0 => generated 1313 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:39:43.372409 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-27580443-df04-48ab-9ede-7dcef75ee4c6 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:43.373899 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-27580443-df04-48ab-9ede-7dcef75ee4c6 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:43.375049 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-27580443-df04-48ab-9ede-7dcef75ee4c6 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79" status: 200 len: 1405 microversion: 2.20 time: 0.198872 Oct 27 03:39:43.375614 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2358/4453] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:39:43 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 => generated 1405 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:39:43.376264 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a10d6275-a2c0-47d5-9ed3-55911d3385f0 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:43.376893 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a10d6275-a2c0-47d5-9ed3-55911d3385f0 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] [instance: a5b04eee-69d9-4e2e-ac89-47cac8cdc538] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:43.383310 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a10d6275-a2c0-47d5-9ed3-55911d3385f0 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:43.387821 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a10d6275-a2c0-47d5-9ed3-55911d3385f0 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:43.387821 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a10d6275-a2c0-47d5-9ed3-55911d3385f0 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:43.387821 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a10d6275-a2c0-47d5-9ed3-55911d3385f0 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:43.387821 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a10d6275-a2c0-47d5-9ed3-55911d3385f0 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:43.387821 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a10d6275-a2c0-47d5-9ed3-55911d3385f0 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:43.400147 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-a10d6275-a2c0-47d5-9ed3-55911d3385f0 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] HTTP exception thrown: Instance a5b04eee-69d9-4e2e-ac89-47cac8cdc538 could not be found. Oct 27 03:39:43.401917 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a10d6275-a2c0-47d5-9ed3-55911d3385f0 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Request method failure captured: Oct 27 03:39:43.401917 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/a5b04eee-69d9-4e2e-ac89-47cac8cdc538 HTTP/1.1 Oct 27 03:39:43.401917 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:39:43.401917 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:39:43.401917 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:39:43.401917 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:39:43.401917 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:39:43.401917 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:39:43.401917 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:39:43.401917 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:39:43.401917 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWf05vpAHOJzx2Z3QPBOQn8Ia2CneGDQSDkeux7KiVliYVGLlB1vtiufQHgvGOnbSwBYjuJEuHyYrkFVI_7gH_ADDlpLZb72wjai2ePuRtVuJ8tKfjw7lHFCN6n5VGryW6Infb1MOg_TtVGV6vYEKv_7BjH-VfjY1Rv_qKwe0WOlwyhs Oct 27 03:39:43.401917 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:39:43.401917 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:39:43.401917 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:39:43.401917 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:39:43.401917 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:39:43.401917 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:39:43.401917 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 4840257127594149b03c0aa3ab94b486 Oct 27 03:39:43.401917 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ServersTestJSON-250183280 Oct 27 03:39:43.401917 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:39:43.401917 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:39:43.401917 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4840257127594149b03c0aa3ab94b486"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4840257127594149b03c0aa3ab94b486"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4840257127594149b03c0aa3ab94b486"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4840257127594149b03c0aa3ab94b486"}]}] Oct 27 03:39:43.401917 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ServersTestJSON-250183280 Oct 27 03:39:43.401917 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 4840257127594149b03c0aa3ab94b486 Oct 27 03:39:43.401917 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ServersTestJSON-250183280 Oct 27 03:39:43.401917 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ServersTestJSON-250183280-project Oct 27 03:39:43.401917 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:39:43.401917 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:39:43.401917 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 3e8e0bc10d3f451c8837c1f1e4d86eaa Oct 27 03:39:43.401917 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ServersTestJSON-250183280-project Oct 27 03:39:43.401917 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:39:43.401917 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance a5b04eee-69d9-4e2e-ac89-47cac8cdc538 could not be found. Oct 27 03:39:43.401917 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': 'a5b04eee-69d9-4e2e-ac89-47cac8cdc538'} Oct 27 03:39:43.401917 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:39:43.401917 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:39:43.401917 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:39:43.401917 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:39:43.401917 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:39:43.401917 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:39:43.401917 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:39:43.401917 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:39:43.401917 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:39:43.401917 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:39:43.401917 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5b04eee-69d9-4e2e-ac89-47cac8cdc538 could not be found. Oct 27 03:39:43.401917 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:39:43.401917 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:39:43.401917 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:39:43.401917 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:39:43.401917 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:39:43.401917 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:39:43.401917 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:39:43.401917 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:39:43.401917 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:39:43.401917 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:39:43.401917 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:39:43.401917 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:39:43.401917 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:39:43.401917 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:39:43.401917 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:39:43.401917 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:39:43.401917 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5b04eee-69d9-4e2e-ac89-47cac8cdc538 could not be found. Oct 27 03:39:43.401917 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:39:43.401917 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:39:43.401917 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:39:43.401917 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:39:43.406055 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:39:43.406055 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:39:43.406055 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:39:43.406055 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:39:43.406055 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5b04eee-69d9-4e2e-ac89-47cac8cdc538 could not be found. Oct 27 03:39:43.406055 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:39:43.406055 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a10d6275-a2c0-47d5-9ed3-55911d3385f0 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Returning 404 to user: Instance a5b04eee-69d9-4e2e-ac89-47cac8cdc538 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:39:43.406055 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a10d6275-a2c0-47d5-9ed3-55911d3385f0 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] 10.222.0.20 "GET /compute/v2.1/servers/a5b04eee-69d9-4e2e-ac89-47cac8cdc538" status: 404 len: 111 microversion: 2.1 time: 0.030939 Oct 27 03:39:43.406055 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2096/4454] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:43 2022] GET /compute/v2.1/servers/a5b04eee-69d9-4e2e-ac89-47cac8cdc538 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:39:43.412005 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-21bc7bdc-3a32-4e7e-b641-ddf2a790ada2 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] Calling method '.version_select at 0x7f7dd9ef49d0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:43.555867 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-21bc7bdc-3a32-4e7e-b641-ddf2a790ada2 tempest-ServersTestJSON-250183280 tempest-ServersTestJSON-250183280-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-682006599" status: 202 len: 0 microversion: 2.1 time: 0.147527 Oct 27 03:39:43.556450 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2359/4455] 10.222.0.20 () {58 vars in 1218 bytes} [Thu Oct 27 03:39:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-682006599 => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:39:43.936407 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2fc1237b-3156-41a7-993d-9a73f6bf30ca tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:43.937049 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-2fc1237b-3156-41a7-993d-9a73f6bf30ca tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 5a8d53f2-5448-44a3-af8f-cf17bfc69a12] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:43.943035 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2fc1237b-3156-41a7-993d-9a73f6bf30ca tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:43.943531 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2fc1237b-3156-41a7-993d-9a73f6bf30ca tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:43.943977 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2fc1237b-3156-41a7-993d-9a73f6bf30ca tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:43.944676 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2fc1237b-3156-41a7-993d-9a73f6bf30ca tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:43.945137 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2fc1237b-3156-41a7-993d-9a73f6bf30ca tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:43.945573 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2fc1237b-3156-41a7-993d-9a73f6bf30ca tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:43.978368 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2fc1237b-3156-41a7-993d-9a73f6bf30ca tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:43.979464 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2fc1237b-3156-41a7-993d-9a73f6bf30ca tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:43.979913 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2fc1237b-3156-41a7-993d-9a73f6bf30ca tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:43.980392 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-2fc1237b-3156-41a7-993d-9a73f6bf30ca tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lazy-loading 'fault' on Instance uuid 5a8d53f2-5448-44a3-af8f-cf17bfc69a12 {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:39:44.031429 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2fc1237b-3156-41a7-993d-9a73f6bf30ca tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:44.039792 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2fc1237b-3156-41a7-993d-9a73f6bf30ca tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/5a8d53f2-5448-44a3-af8f-cf17bfc69a12" status: 200 len: 1304 microversion: 2.1 time: 0.107352 Oct 27 03:39:44.040378 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2097/4456] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:43 2022] GET /compute/v2.1/servers/5a8d53f2-5448-44a3-af8f-cf17bfc69a12 => generated 1304 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:39:44.382425 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-57f96170-5cf7-4056-ac23-27b01472ca55 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:44.384150 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-57f96170-5cf7-4056-ac23-27b01472ca55 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] [instance: 4c75e633-07ac-41b3-b095-a48f36a306a0] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:44.392296 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-57f96170-5cf7-4056-ac23-27b01472ca55 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:44.392829 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-57f96170-5cf7-4056-ac23-27b01472ca55 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:44.393274 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-57f96170-5cf7-4056-ac23-27b01472ca55 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:44.394108 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-57f96170-5cf7-4056-ac23-27b01472ca55 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:44.394724 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-57f96170-5cf7-4056-ac23-27b01472ca55 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:44.395434 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-57f96170-5cf7-4056-ac23-27b01472ca55 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:44.404980 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-715da3ef-cb40-4914-833c-06ec6f88be89 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:44.404980 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-715da3ef-cb40-4914-833c-06ec6f88be89 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:44.411995 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-715da3ef-cb40-4914-833c-06ec6f88be89 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:44.412502 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-715da3ef-cb40-4914-833c-06ec6f88be89 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:44.412927 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-715da3ef-cb40-4914-833c-06ec6f88be89 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:44.413632 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-715da3ef-cb40-4914-833c-06ec6f88be89 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:44.414119 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-715da3ef-cb40-4914-833c-06ec6f88be89 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:44.414549 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-715da3ef-cb40-4914-833c-06ec6f88be89 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:44.561868 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-715da3ef-cb40-4914-833c-06ec6f88be89 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:44.570791 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-715da3ef-cb40-4914-833c-06ec6f88be89 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:44.573243 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-715da3ef-cb40-4914-833c-06ec6f88be89 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:44.574451 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-715da3ef-cb40-4914-833c-06ec6f88be89 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79" status: 200 len: 1405 microversion: 2.20 time: 0.177463 Oct 27 03:39:44.574779 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2098/4457] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:39:44 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 => generated 1405 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:39:44.661667 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-57f96170-5cf7-4056-ac23-27b01472ca55 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15f467c14d5241f2b147e4b88fb05916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4481a955a4c98a44cffcc89af6eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:44.672260 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-57f96170-5cf7-4056-ac23-27b01472ca55 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] 10.222.0.20 "GET /compute/v2.1/servers/4c75e633-07ac-41b3-b095-a48f36a306a0" status: 200 len: 1313 microversion: 2.1 time: 0.294908 Oct 27 03:39:44.672851 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2360/4458] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:44 2022] GET /compute/v2.1/servers/4c75e633-07ac-41b3-b095-a48f36a306a0 => generated 1313 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:39:45.064663 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0ff570bf-6e23-4b05-93c4-83c65647b3b7 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:45.065486 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0ff570bf-6e23-4b05-93c4-83c65647b3b7 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 5a8d53f2-5448-44a3-af8f-cf17bfc69a12] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:45.067599 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=5 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:39:45.073903 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0ff570bf-6e23-4b05-93c4-83c65647b3b7 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:45.074426 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0ff570bf-6e23-4b05-93c4-83c65647b3b7 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:45.074904 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0ff570bf-6e23-4b05-93c4-83c65647b3b7 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:45.075621 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0ff570bf-6e23-4b05-93c4-83c65647b3b7 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:45.076143 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0ff570bf-6e23-4b05-93c4-83c65647b3b7 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:45.076655 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0ff570bf-6e23-4b05-93c4-83c65647b3b7 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:45.093062 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-0ff570bf-6e23-4b05-93c4-83c65647b3b7 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] HTTP exception thrown: Instance 5a8d53f2-5448-44a3-af8f-cf17bfc69a12 could not be found. Oct 27 03:39:45.094699 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0ff570bf-6e23-4b05-93c4-83c65647b3b7 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Request method failure captured: Oct 27 03:39:45.094699 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/5a8d53f2-5448-44a3-af8f-cf17bfc69a12 HTTP/1.1 Oct 27 03:39:45.094699 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:39:45.094699 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:39:45.094699 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:39:45.094699 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:39:45.094699 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:39:45.094699 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:39:45.094699 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:39:45.094699 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:39:45.094699 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfz83jPBQR-IO_RgpXfqqqN_tSIl3Aju213bQLpPTkR-R_lkTGSpHz1Evy7Lbg7I5hWxU9AxviJyxNS0i-wRdj1_O4LyvZEjE6jerjzwB22Vu4S-ThF8W8FJgumwczGUcQup-Bjpiay7kN0UoT8q0uFoQytE3MKt1MX9CDbsUgcc03A Oct 27 03:39:45.094699 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:39:45.094699 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:39:45.094699 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:39:45.094699 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:39:45.094699 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:39:45.094699 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:39:45.094699 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 911997e881754ce390af17919f29b4ab Oct 27 03:39:45.094699 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-DeleteServersTestJSON-858473437 Oct 27 03:39:45.094699 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:39:45.094699 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:39:45.094699 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/911997e881754ce390af17919f29b4ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/911997e881754ce390af17919f29b4ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/911997e881754ce390af17919f29b4ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_911997e881754ce390af17919f29b4ab"}]}] Oct 27 03:39:45.094699 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-DeleteServersTestJSON-858473437 Oct 27 03:39:45.094699 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 911997e881754ce390af17919f29b4ab Oct 27 03:39:45.094699 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-DeleteServersTestJSON-858473437 Oct 27 03:39:45.094699 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-DeleteServersTestJSON-858473437-project Oct 27 03:39:45.094699 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:39:45.094699 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:39:45.094699 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: b1cc79af058b4c35b3c572448fac86a7 Oct 27 03:39:45.094699 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-DeleteServersTestJSON-858473437-project Oct 27 03:39:45.094699 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:39:45.094699 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 5a8d53f2-5448-44a3-af8f-cf17bfc69a12 could not be found. Oct 27 03:39:45.094699 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '5a8d53f2-5448-44a3-af8f-cf17bfc69a12'} Oct 27 03:39:45.094699 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:39:45.094699 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:39:45.094699 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:39:45.094699 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:39:45.094699 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:39:45.094699 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:39:45.094699 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:39:45.094699 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:39:45.094699 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:39:45.094699 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:39:45.094699 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a8d53f2-5448-44a3-af8f-cf17bfc69a12 could not be found. Oct 27 03:39:45.094699 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:39:45.094699 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:39:45.094699 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:39:45.094699 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:39:45.094699 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:39:45.094699 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:39:45.094699 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:39:45.094699 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:39:45.094699 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:39:45.094699 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:39:45.094699 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:39:45.094699 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:39:45.094699 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:39:45.094699 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:39:45.094699 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:39:45.094699 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:39:45.094699 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a8d53f2-5448-44a3-af8f-cf17bfc69a12 could not be found. Oct 27 03:39:45.094699 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:39:45.094699 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:39:45.094699 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:39:45.098474 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:39:45.098474 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:39:45.098474 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:39:45.098474 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:39:45.098474 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:39:45.098474 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a8d53f2-5448-44a3-af8f-cf17bfc69a12 could not be found. Oct 27 03:39:45.098474 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:39:45.098474 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0ff570bf-6e23-4b05-93c4-83c65647b3b7 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Returning 404 to user: Instance 5a8d53f2-5448-44a3-af8f-cf17bfc69a12 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:39:45.098474 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0ff570bf-6e23-4b05-93c4-83c65647b3b7 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/5a8d53f2-5448-44a3-af8f-cf17bfc69a12" status: 404 len: 111 microversion: 2.1 time: 0.035664 Oct 27 03:39:45.098474 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2099/4459] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:45 2022] GET /compute/v2.1/servers/5a8d53f2-5448-44a3-af8f-cf17bfc69a12 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:39:45.150399 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-21c9c650-604b-439c-9b2b-5afa3798f792 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1604314434", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": [{"uuid": "b1f1f8a3-6579-4551-8baa-e65f1847be2c"}]}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:39:45.159006 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:39:45.206470 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=31 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:39:45.212308 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.network.neutron [None req-21c9c650-604b-439c-9b2b-5afa3798f792 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] validate_networks() for [('b1f1f8a3-6579-4551-8baa-e65f1847be2c', None, None, None, None, None)] {{(pid=121001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:39:45.600020 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d223cbee-9cde-47e6-aa66-5daf0edfdd7a tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:45.600772 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d223cbee-9cde-47e6-aa66-5daf0edfdd7a tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:45.608679 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d223cbee-9cde-47e6-aa66-5daf0edfdd7a tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:45.609176 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d223cbee-9cde-47e6-aa66-5daf0edfdd7a tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:45.609618 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d223cbee-9cde-47e6-aa66-5daf0edfdd7a tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:45.610355 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d223cbee-9cde-47e6-aa66-5daf0edfdd7a tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:45.610846 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d223cbee-9cde-47e6-aa66-5daf0edfdd7a tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:45.611276 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d223cbee-9cde-47e6-aa66-5daf0edfdd7a tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:45.631158 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:39:45.765745 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d223cbee-9cde-47e6-aa66-5daf0edfdd7a tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:45.774542 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d223cbee-9cde-47e6-aa66-5daf0edfdd7a tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:45.776825 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d223cbee-9cde-47e6-aa66-5daf0edfdd7a tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:45.778009 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d223cbee-9cde-47e6-aa66-5daf0edfdd7a tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79" status: 200 len: 1405 microversion: 2.20 time: 0.182225 Oct 27 03:39:45.778784 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2100/4460] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:39:45 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 => generated 1405 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:39:45.784346 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a5a8c78a-fed4-4f06-abdc-bdb31f69fbfc tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:45.788627 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a5a8c78a-fed4-4f06-abdc-bdb31f69fbfc tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] [instance: 4c75e633-07ac-41b3-b095-a48f36a306a0] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:45.791967 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a5a8c78a-fed4-4f06-abdc-bdb31f69fbfc tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:45.792900 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a5a8c78a-fed4-4f06-abdc-bdb31f69fbfc tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:45.793487 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a5a8c78a-fed4-4f06-abdc-bdb31f69fbfc tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:45.794413 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a5a8c78a-fed4-4f06-abdc-bdb31f69fbfc tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:45.795004 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a5a8c78a-fed4-4f06-abdc-bdb31f69fbfc tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:45.795559 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a5a8c78a-fed4-4f06-abdc-bdb31f69fbfc tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:45.824826 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-21c9c650-604b-439c-9b2b-5afa3798f792 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Flavor limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:39:45.825356 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-21c9c650-604b-439c-9b2b-5afa3798f792 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Image limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:39:45.825726 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-21c9c650-604b-439c-9b2b-5afa3798f792 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Flavor pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:39:45.826176 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-21c9c650-604b-439c-9b2b-5afa3798f792 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Image pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:39:45.826775 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-21c9c650-604b-439c-9b2b-5afa3798f792 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:39:45.836665 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-21c9c650-604b-439c-9b2b-5afa3798f792 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:45.837376 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-21c9c650-604b-439c-9b2b-5afa3798f792 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:45.838652 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-21c9c650-604b-439c-9b2b-5afa3798f792 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:45.839570 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-21c9c650-604b-439c-9b2b-5afa3798f792 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:45.840202 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-21c9c650-604b-439c-9b2b-5afa3798f792 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:45.840796 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-21c9c650-604b-439c-9b2b-5afa3798f792 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:45.865484 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-21c9c650-604b-439c-9b2b-5afa3798f792 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Getting quotas for project 911997e881754ce390af17919f29b4ab. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:39:45.877693 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-21c9c650-604b-439c-9b2b-5afa3798f792 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Getting quotas for user b1cc79af058b4c35b3c572448fac86a7 and project 911997e881754ce390af17919f29b4ab. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:39:45.899686 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-21c9c650-604b-439c-9b2b-5afa3798f792 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Going to run 1 instances... {{(pid=121001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:39:45.907812 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-21c9c650-604b-439c-9b2b-5afa3798f792 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 9fa9583d-e294-4e5f-a6dc-a51d619dc03d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:39:45.951180 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a5a8c78a-fed4-4f06-abdc-bdb31f69fbfc tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15f467c14d5241f2b147e4b88fb05916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4481a955a4c98a44cffcc89af6eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:45.959621 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a5a8c78a-fed4-4f06-abdc-bdb31f69fbfc tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] 10.222.0.20 "GET /compute/v2.1/servers/4c75e633-07ac-41b3-b095-a48f36a306a0" status: 200 len: 1497 microversion: 2.1 time: 0.178929 Oct 27 03:39:45.960404 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2101/4461] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:45 2022] GET /compute/v2.1/servers/4c75e633-07ac-41b3-b095-a48f36a306a0 => generated 1497 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:39:45.985606 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-48e3e3a0-2058-4266-90e6-859eadeec89a tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:46.003712 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.compute.server_groups [None req-48e3e3a0-2058-4266-90e6-859eadeec89a tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Querying cell d4405804-b3fd-4c57-a074-5c4e2aef7c93(cell1) for 1 instances {{(pid=121000) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 27 03:39:46.004577 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-48e3e3a0-2058-4266-90e6-859eadeec89a tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:46.005128 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-48e3e3a0-2058-4266-90e6-859eadeec89a tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:46.005760 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-48e3e3a0-2058-4266-90e6-859eadeec89a tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:46.023723 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-48e3e3a0-2058-4266-90e6-859eadeec89a tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups/32e52a42-c3c4-4147-9538-93f4a58a6069" status: 200 len: 221 microversion: 2.1 time: 0.044252 Oct 27 03:39:46.024521 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2102/4462] 10.222.0.20 () {58 vars in 1263 bytes} [Thu Oct 27 03:39:45 2022] GET /compute/v2.1/os-server-groups/32e52a42-c3c4-4147-9538-93f4a58a6069 => generated 221 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:39:46.035712 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9d4660ee-9a51-4ba7-a950-fc84ae318c61 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:46.036223 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9d4660ee-9a51-4ba7-a950-fc84ae318c61 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] [instance: 4c75e633-07ac-41b3-b095-a48f36a306a0] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:46.042545 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9d4660ee-9a51-4ba7-a950-fc84ae318c61 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:46.043046 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9d4660ee-9a51-4ba7-a950-fc84ae318c61 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:46.043588 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9d4660ee-9a51-4ba7-a950-fc84ae318c61 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:46.044310 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9d4660ee-9a51-4ba7-a950-fc84ae318c61 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:46.044864 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9d4660ee-9a51-4ba7-a950-fc84ae318c61 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:46.045203 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9d4660ee-9a51-4ba7-a950-fc84ae318c61 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:46.075519 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9d4660ee-9a51-4ba7-a950-fc84ae318c61 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] [instance: 4c75e633-07ac-41b3-b095-a48f36a306a0] Going to try to terminate instance {{(pid=121000) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:39:46.084089 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-21c9c650-604b-439c-9b2b-5afa3798f792 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.937219 Oct 27 03:39:46.085437 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2361/4463] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:39:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 940 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 03:39:46.100824 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5d146366-c4c8-4996-a6c5-86e42c503708 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:46.102654 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5d146366-c4c8-4996-a6c5-86e42c503708 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 9fa9583d-e294-4e5f-a6dc-a51d619dc03d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:46.198429 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5d146366-c4c8-4996-a6c5-86e42c503708 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:46.207698 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5d146366-c4c8-4996-a6c5-86e42c503708 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d" status: 200 len: 1215 microversion: 2.1 time: 0.114537 Oct 27 03:39:46.207864 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2362/4464] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:46 2022] GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d => generated 1215 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:39:46.503277 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9d4660ee-9a51-4ba7-a950-fc84ae318c61 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4c75e633-07ac-41b3-b095-a48f36a306a0" status: 204 len: 0 microversion: 2.1 time: 0.468841 Oct 27 03:39:46.505119 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2103/4465] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:39:46 2022] DELETE /compute/v2.1/servers/4c75e633-07ac-41b3-b095-a48f36a306a0 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 03:39:46.513882 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f33fb511-c012-4095-9204-5188da8a54c4 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:46.514643 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f33fb511-c012-4095-9204-5188da8a54c4 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] [instance: 4c75e633-07ac-41b3-b095-a48f36a306a0] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:46.530458 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f33fb511-c012-4095-9204-5188da8a54c4 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:46.531017 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f33fb511-c012-4095-9204-5188da8a54c4 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:46.533000 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f33fb511-c012-4095-9204-5188da8a54c4 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:46.534019 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f33fb511-c012-4095-9204-5188da8a54c4 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:46.534663 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f33fb511-c012-4095-9204-5188da8a54c4 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:46.546304 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f33fb511-c012-4095-9204-5188da8a54c4 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:46.553291 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-a3b24d7a-d326-4c96-8c4c-39626c1cd9c1 req-6e313618-4d17-458e-86f8-8f5711ac2c92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6854d7f3-0f6d-45c2-b46d-a5dc2922fe79", "name": "network-vif-plugged", "status": "completed", "tag": "425e1d50-5b4c-44cd-a54b-de48e280a305"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:39:46.575057 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-a3b24d7a-d326-4c96-8c4c-39626c1cd9c1 req-6e313618-4d17-458e-86f8-8f5711ac2c92 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:46.579373 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-a3b24d7a-d326-4c96-8c4c-39626c1cd9c1 req-6e313618-4d17-458e-86f8-8f5711ac2c92 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:46.579698 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-a3b24d7a-d326-4c96-8c4c-39626c1cd9c1 req-6e313618-4d17-458e-86f8-8f5711ac2c92 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:46.601282 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-a3b24d7a-d326-4c96-8c4c-39626c1cd9c1 req-6e313618-4d17-458e-86f8-8f5711ac2c92 service nova] Creating event network-vif-plugged:425e1d50-5b4c-44cd-a54b-de48e280a305 for instance 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 on n-h1-862769-1 Oct 27 03:39:46.609269 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-a3b24d7a-d326-4c96-8c4c-39626c1cd9c1 req-6e313618-4d17-458e-86f8-8f5711ac2c92 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060097 Oct 27 03:39:46.609872 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2104/4466] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:39:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:39:46.792539 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f33fb511-c012-4095-9204-5188da8a54c4 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15f467c14d5241f2b147e4b88fb05916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4481a955a4c98a44cffcc89af6eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:46.801754 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f33fb511-c012-4095-9204-5188da8a54c4 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] 10.222.0.20 "GET /compute/v2.1/servers/4c75e633-07ac-41b3-b095-a48f36a306a0" status: 200 len: 1503 microversion: 2.1 time: 0.292244 Oct 27 03:39:46.803093 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2363/4467] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:46 2022] GET /compute/v2.1/servers/4c75e633-07ac-41b3-b095-a48f36a306a0 => generated 1503 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:39:46.813050 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2599b78f-f443-4e4b-ac49-64c36de99d81 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:46.815859 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-2599b78f-f443-4e4b-ac49-64c36de99d81 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:46.821821 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2599b78f-f443-4e4b-ac49-64c36de99d81 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:46.822394 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2599b78f-f443-4e4b-ac49-64c36de99d81 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:46.823069 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2599b78f-f443-4e4b-ac49-64c36de99d81 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:46.824010 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2599b78f-f443-4e4b-ac49-64c36de99d81 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:46.824880 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2599b78f-f443-4e4b-ac49-64c36de99d81 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:46.825513 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2599b78f-f443-4e4b-ac49-64c36de99d81 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:47.054619 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2599b78f-f443-4e4b-ac49-64c36de99d81 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:47.065164 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2599b78f-f443-4e4b-ac49-64c36de99d81 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:47.066858 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2599b78f-f443-4e4b-ac49-64c36de99d81 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:47.068276 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2599b78f-f443-4e4b-ac49-64c36de99d81 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79" status: 200 len: 1405 microversion: 2.20 time: 0.267880 Oct 27 03:39:47.069752 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2105/4468] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:39:46 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 => generated 1405 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:39:47.232851 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ddb75120-ec18-431c-9eb7-dec80c013d88 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:47.233480 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ddb75120-ec18-431c-9eb7-dec80c013d88 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 9fa9583d-e294-4e5f-a6dc-a51d619dc03d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:47.241798 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ddb75120-ec18-431c-9eb7-dec80c013d88 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:47.241798 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ddb75120-ec18-431c-9eb7-dec80c013d88 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:47.241798 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ddb75120-ec18-431c-9eb7-dec80c013d88 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:47.241798 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ddb75120-ec18-431c-9eb7-dec80c013d88 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:47.241798 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ddb75120-ec18-431c-9eb7-dec80c013d88 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:47.242301 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ddb75120-ec18-431c-9eb7-dec80c013d88 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:47.306078 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ddb75120-ec18-431c-9eb7-dec80c013d88 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:47.313736 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ddb75120-ec18-431c-9eb7-dec80c013d88 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d" status: 200 len: 1219 microversion: 2.1 time: 0.084925 Oct 27 03:39:47.314442 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2364/4469] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:47 2022] GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:39:47.827446 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-21f89bc5-5daa-49dc-8434-27b44782b5b8 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:47.828072 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-21f89bc5-5daa-49dc-8434-27b44782b5b8 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] [instance: 4c75e633-07ac-41b3-b095-a48f36a306a0] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:47.835400 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-21f89bc5-5daa-49dc-8434-27b44782b5b8 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:47.835898 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-21f89bc5-5daa-49dc-8434-27b44782b5b8 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:47.836382 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-21f89bc5-5daa-49dc-8434-27b44782b5b8 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:47.837187 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-21f89bc5-5daa-49dc-8434-27b44782b5b8 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:47.837766 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-21f89bc5-5daa-49dc-8434-27b44782b5b8 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:47.838871 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-21f89bc5-5daa-49dc-8434-27b44782b5b8 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:47.990459 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-21f89bc5-5daa-49dc-8434-27b44782b5b8 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15f467c14d5241f2b147e4b88fb05916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4481a955a4c98a44cffcc89af6eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:48.013149 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-21f89bc5-5daa-49dc-8434-27b44782b5b8 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] 10.222.0.20 "GET /compute/v2.1/servers/4c75e633-07ac-41b3-b095-a48f36a306a0" status: 200 len: 1503 microversion: 2.1 time: 0.190337 Oct 27 03:39:48.014518 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2106/4470] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:47 2022] GET /compute/v2.1/servers/4c75e633-07ac-41b3-b095-a48f36a306a0 => generated 1503 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:39:48.105363 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7e2e52f2-99d3-4ef8-9f8f-9f8f0334139d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:48.106273 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7e2e52f2-99d3-4ef8-9f8f-9f8f0334139d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:48.118662 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7e2e52f2-99d3-4ef8-9f8f-9f8f0334139d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:48.120035 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7e2e52f2-99d3-4ef8-9f8f-9f8f0334139d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:48.120696 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7e2e52f2-99d3-4ef8-9f8f-9f8f0334139d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:48.124586 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7e2e52f2-99d3-4ef8-9f8f-9f8f0334139d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:48.125243 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7e2e52f2-99d3-4ef8-9f8f-9f8f0334139d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:48.125687 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7e2e52f2-99d3-4ef8-9f8f-9f8f0334139d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:48.337066 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9eb67f0b-31da-4b3a-847a-617f3c146181 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:48.338440 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9eb67f0b-31da-4b3a-847a-617f3c146181 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 9fa9583d-e294-4e5f-a6dc-a51d619dc03d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:48.347323 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9eb67f0b-31da-4b3a-847a-617f3c146181 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:48.350207 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9eb67f0b-31da-4b3a-847a-617f3c146181 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:48.350571 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9eb67f0b-31da-4b3a-847a-617f3c146181 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:48.351404 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9eb67f0b-31da-4b3a-847a-617f3c146181 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:48.351915 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9eb67f0b-31da-4b3a-847a-617f3c146181 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:48.352308 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9eb67f0b-31da-4b3a-847a-617f3c146181 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:48.362753 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7e2e52f2-99d3-4ef8-9f8f-9f8f0334139d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:48.372712 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7e2e52f2-99d3-4ef8-9f8f-9f8f0334139d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:48.379594 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7e2e52f2-99d3-4ef8-9f8f-9f8f0334139d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:48.388517 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7e2e52f2-99d3-4ef8-9f8f-9f8f0334139d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79" status: 200 len: 1405 microversion: 2.20 time: 0.293305 Oct 27 03:39:48.390317 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2365/4471] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:39:48 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 => generated 1405 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:39:48.479130 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9eb67f0b-31da-4b3a-847a-617f3c146181 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:48.492673 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9eb67f0b-31da-4b3a-847a-617f3c146181 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d" status: 200 len: 1267 microversion: 2.1 time: 0.156177 Oct 27 03:39:48.506966 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2107/4472] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:48 2022] GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d => generated 1267 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:39:49.037094 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-305d2170-4332-48d1-8866-ce60949b98b2 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:49.037970 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-305d2170-4332-48d1-8866-ce60949b98b2 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] [instance: 4c75e633-07ac-41b3-b095-a48f36a306a0] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:49.046820 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-305d2170-4332-48d1-8866-ce60949b98b2 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:49.047625 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-305d2170-4332-48d1-8866-ce60949b98b2 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:49.051182 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-305d2170-4332-48d1-8866-ce60949b98b2 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:49.051182 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-305d2170-4332-48d1-8866-ce60949b98b2 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:49.051182 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-305d2170-4332-48d1-8866-ce60949b98b2 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:49.051182 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-305d2170-4332-48d1-8866-ce60949b98b2 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:49.144923 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-cff3d982-6d8c-48e3-9fdb-334f58a60ad8 req-21efe141-fbd8-4079-8acc-5bf19f212c54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c75e633-07ac-41b3-b095-a48f36a306a0", "name": "network-vif-deleted", "tag": "2630e3e8-4991-4eb0-aca2-222f4e778427"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:39:49.158390 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-cff3d982-6d8c-48e3-9fdb-334f58a60ad8 req-21efe141-fbd8-4079-8acc-5bf19f212c54 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:49.158958 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-cff3d982-6d8c-48e3-9fdb-334f58a60ad8 req-21efe141-fbd8-4079-8acc-5bf19f212c54 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:49.159464 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-cff3d982-6d8c-48e3-9fdb-334f58a60ad8 req-21efe141-fbd8-4079-8acc-5bf19f212c54 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:49.170826 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-305d2170-4332-48d1-8866-ce60949b98b2 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15f467c14d5241f2b147e4b88fb05916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4481a955a4c98a44cffcc89af6eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:49.178782 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-cff3d982-6d8c-48e3-9fdb-334f58a60ad8 req-21efe141-fbd8-4079-8acc-5bf19f212c54 service nova] Creating event network-vif-deleted:2630e3e8-4991-4eb0-aca2-222f4e778427 for instance 4c75e633-07ac-41b3-b095-a48f36a306a0 on n-h1-862769-1 Oct 27 03:39:49.183804 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-305d2170-4332-48d1-8866-ce60949b98b2 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] 10.222.0.20 "GET /compute/v2.1/servers/4c75e633-07ac-41b3-b095-a48f36a306a0" status: 200 len: 1461 microversion: 2.1 time: 0.150859 Oct 27 03:39:49.185000 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2366/4473] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:49 2022] GET /compute/v2.1/servers/4c75e633-07ac-41b3-b095-a48f36a306a0 => generated 1461 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:39:49.196330 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-cff3d982-6d8c-48e3-9fdb-334f58a60ad8 req-21efe141-fbd8-4079-8acc-5bf19f212c54 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055031 Oct 27 03:39:49.197554 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2108/4474] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:39:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:39:49.421405 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-11a67646-8e2a-4b76-be4e-2aec8058aa24 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:49.422024 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-11a67646-8e2a-4b76-be4e-2aec8058aa24 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:49.428772 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-11a67646-8e2a-4b76-be4e-2aec8058aa24 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:49.429522 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-11a67646-8e2a-4b76-be4e-2aec8058aa24 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:49.430224 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-11a67646-8e2a-4b76-be4e-2aec8058aa24 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:49.431151 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-11a67646-8e2a-4b76-be4e-2aec8058aa24 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:49.431716 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-11a67646-8e2a-4b76-be4e-2aec8058aa24 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:49.432154 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-11a67646-8e2a-4b76-be4e-2aec8058aa24 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:49.515780 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-996c8c67-825f-4699-8e42-cae3b56a9a7f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:49.516569 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-996c8c67-825f-4699-8e42-cae3b56a9a7f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 9fa9583d-e294-4e5f-a6dc-a51d619dc03d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:49.523659 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-996c8c67-825f-4699-8e42-cae3b56a9a7f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:49.524194 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-996c8c67-825f-4699-8e42-cae3b56a9a7f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:49.524694 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-996c8c67-825f-4699-8e42-cae3b56a9a7f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:49.526361 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-996c8c67-825f-4699-8e42-cae3b56a9a7f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:49.526836 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-996c8c67-825f-4699-8e42-cae3b56a9a7f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:49.527255 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-996c8c67-825f-4699-8e42-cae3b56a9a7f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:49.592950 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-11a67646-8e2a-4b76-be4e-2aec8058aa24 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:49.601838 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=100 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:39:49.602982 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-996c8c67-825f-4699-8e42-cae3b56a9a7f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:49.606789 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-11a67646-8e2a-4b76-be4e-2aec8058aa24 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:49.608704 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-11a67646-8e2a-4b76-be4e-2aec8058aa24 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:49.610381 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-11a67646-8e2a-4b76-be4e-2aec8058aa24 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79" status: 200 len: 1598 microversion: 2.20 time: 0.193621 Oct 27 03:39:49.611464 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2367/4475] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:39:49 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 => generated 1598 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:39:49.616676 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-996c8c67-825f-4699-8e42-cae3b56a9a7f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d" status: 200 len: 1273 microversion: 2.1 time: 0.107049 Oct 27 03:39:49.618068 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2109/4476] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:49 2022] GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d => generated 1273 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:39:49.636067 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a5c973aa-4faf-4c69-be53-ebc6dbd00cfb tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:49.636363 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a5c973aa-4faf-4c69-be53-ebc6dbd00cfb tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:49.642338 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a5c973aa-4faf-4c69-be53-ebc6dbd00cfb tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:49.642839 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a5c973aa-4faf-4c69-be53-ebc6dbd00cfb tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:49.643277 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a5c973aa-4faf-4c69-be53-ebc6dbd00cfb tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:49.643976 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a5c973aa-4faf-4c69-be53-ebc6dbd00cfb tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:49.644433 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a5c973aa-4faf-4c69-be53-ebc6dbd00cfb tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:49.644861 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a5c973aa-4faf-4c69-be53-ebc6dbd00cfb tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:49.769446 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a5c973aa-4faf-4c69-be53-ebc6dbd00cfb tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.135597 Oct 27 03:39:49.769446 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2368/4477] 10.222.0.20 () {60 vars in 1316 bytes} [Thu Oct 27 03:39:49 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79/os-interface => generated 285 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 03:39:50.209781 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-78403993-0a0a-4928-98c2-d26ef786d681 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:50.210671 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-78403993-0a0a-4928-98c2-d26ef786d681 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] [instance: 4c75e633-07ac-41b3-b095-a48f36a306a0] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:50.222353 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-78403993-0a0a-4928-98c2-d26ef786d681 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:50.223869 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-78403993-0a0a-4928-98c2-d26ef786d681 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:50.224761 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-78403993-0a0a-4928-98c2-d26ef786d681 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:50.226129 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-78403993-0a0a-4928-98c2-d26ef786d681 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:50.226805 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-78403993-0a0a-4928-98c2-d26ef786d681 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:50.227661 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-78403993-0a0a-4928-98c2-d26ef786d681 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:50.290156 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-78403993-0a0a-4928-98c2-d26ef786d681 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:50.291283 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-78403993-0a0a-4928-98c2-d26ef786d681 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:50.291804 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-78403993-0a0a-4928-98c2-d26ef786d681 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:50.292689 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-78403993-0a0a-4928-98c2-d26ef786d681 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Lazy-loading 'fault' on Instance uuid 4c75e633-07ac-41b3-b095-a48f36a306a0 {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:39:50.406122 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-78403993-0a0a-4928-98c2-d26ef786d681 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15f467c14d5241f2b147e4b88fb05916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e4481a955a4c98a44cffcc89af6eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:50.414230 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-78403993-0a0a-4928-98c2-d26ef786d681 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] 10.222.0.20 "GET /compute/v2.1/servers/4c75e633-07ac-41b3-b095-a48f36a306a0" status: 200 len: 1303 microversion: 2.1 time: 0.210180 Oct 27 03:39:50.415346 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2110/4478] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:50 2022] GET /compute/v2.1/servers/4c75e633-07ac-41b3-b095-a48f36a306a0 => generated 1303 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:39:50.641490 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7d6eeef1-f3a9-4b6b-80f0-df3f894ad259 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:50.643822 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7d6eeef1-f3a9-4b6b-80f0-df3f894ad259 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 9fa9583d-e294-4e5f-a6dc-a51d619dc03d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:50.654259 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7d6eeef1-f3a9-4b6b-80f0-df3f894ad259 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:50.655463 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7d6eeef1-f3a9-4b6b-80f0-df3f894ad259 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:50.656147 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7d6eeef1-f3a9-4b6b-80f0-df3f894ad259 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:50.657101 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7d6eeef1-f3a9-4b6b-80f0-df3f894ad259 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:50.657891 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7d6eeef1-f3a9-4b6b-80f0-df3f894ad259 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:50.658542 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7d6eeef1-f3a9-4b6b-80f0-df3f894ad259 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:51.110777 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7d6eeef1-f3a9-4b6b-80f0-df3f894ad259 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:51.120672 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7d6eeef1-f3a9-4b6b-80f0-df3f894ad259 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d" status: 200 len: 1315 microversion: 2.1 time: 0.484153 Oct 27 03:39:51.121461 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2369/4479] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:50 2022] GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d => generated 1315 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:39:51.311846 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-9847fe84-ed4f-45b3-9073-a995216572f3 req-1bc2d65a-6d66-4d49-9888-751fe9b1aa88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6854d7f3-0f6d-45c2-b46d-a5dc2922fe79", "tag": "425e1d50-5b4c-44cd-a54b-de48e280a305"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:39:51.324155 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-9847fe84-ed4f-45b3-9073-a995216572f3 req-1bc2d65a-6d66-4d49-9888-751fe9b1aa88 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:51.324642 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-9847fe84-ed4f-45b3-9073-a995216572f3 req-1bc2d65a-6d66-4d49-9888-751fe9b1aa88 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:51.325078 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-9847fe84-ed4f-45b3-9073-a995216572f3 req-1bc2d65a-6d66-4d49-9888-751fe9b1aa88 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:51.337565 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-9847fe84-ed4f-45b3-9073-a995216572f3 req-1bc2d65a-6d66-4d49-9888-751fe9b1aa88 service nova] Creating event network-changed:425e1d50-5b4c-44cd-a54b-de48e280a305 for instance 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 on n-h1-862769-1 Oct 27 03:39:51.342810 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-9847fe84-ed4f-45b3-9073-a995216572f3 req-1bc2d65a-6d66-4d49-9888-751fe9b1aa88 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036251 Oct 27 03:39:51.343417 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2111/4480] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:39:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:39:51.439799 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-681a7e05-33f9-4c39-824e-d00ff9e6f75a tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:51.440466 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-681a7e05-33f9-4c39-824e-d00ff9e6f75a tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] [instance: 4c75e633-07ac-41b3-b095-a48f36a306a0] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:51.446998 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-681a7e05-33f9-4c39-824e-d00ff9e6f75a tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:51.448095 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-681a7e05-33f9-4c39-824e-d00ff9e6f75a tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:51.448723 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-681a7e05-33f9-4c39-824e-d00ff9e6f75a tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:51.449643 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-681a7e05-33f9-4c39-824e-d00ff9e6f75a tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:51.450151 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-681a7e05-33f9-4c39-824e-d00ff9e6f75a tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:51.450644 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-681a7e05-33f9-4c39-824e-d00ff9e6f75a tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:51.465067 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-681a7e05-33f9-4c39-824e-d00ff9e6f75a tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] HTTP exception thrown: Instance 4c75e633-07ac-41b3-b095-a48f36a306a0 could not be found. Oct 27 03:39:51.466841 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-681a7e05-33f9-4c39-824e-d00ff9e6f75a tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Request method failure captured: Oct 27 03:39:51.466841 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/4c75e633-07ac-41b3-b095-a48f36a306a0 HTTP/1.1 Oct 27 03:39:51.466841 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:39:51.466841 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:39:51.466841 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:39:51.466841 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:39:51.466841 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:39:51.466841 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:39:51.466841 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:39:51.466841 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:39:51.466841 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWf1rF5xWunpTnBmBRylb2X5Kg_TSg4tENmClZuLZqo7_pa8g7YBoYZtoYqXSUH9d4TlHdSnTr-qoL6w6yDkKRqARltQ_Z4IOXsEu8OMSPMPT7vokMwx38hK1tKBfex7R1KCb5gC3NDT2mKJYhkDBpKmhWo_Dr71JuBl6yBzWLX_ijgc Oct 27 03:39:51.466841 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:39:51.466841 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:39:51.466841 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:39:51.466841 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:39:51.466841 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:39:51.466841 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:39:51.466841 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 41e4481a955a4c98a44cffcc89af6eb4 Oct 27 03:39:51.466841 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServerGroupTestJSON-1996011464 Oct 27 03:39:51.466841 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:39:51.466841 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:39:51.466841 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/41e4481a955a4c98a44cffcc89af6eb4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/41e4481a955a4c98a44cffcc89af6eb4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/41e4481a955a4c98a44cffcc89af6eb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_41e4481a955a4c98a44cffcc89af6eb4"}]}] Oct 27 03:39:51.466841 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServerGroupTestJSON-1996011464 Oct 27 03:39:51.466841 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 41e4481a955a4c98a44cffcc89af6eb4 Oct 27 03:39:51.466841 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServerGroupTestJSON-1996011464 Oct 27 03:39:51.466841 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServerGroupTestJSON-1996011464-project Oct 27 03:39:51.466841 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:39:51.466841 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:39:51.466841 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 15f467c14d5241f2b147e4b88fb05916 Oct 27 03:39:51.466841 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServerGroupTestJSON-1996011464-project Oct 27 03:39:51.466841 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:39:51.466841 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 4c75e633-07ac-41b3-b095-a48f36a306a0 could not be found. Oct 27 03:39:51.466841 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '4c75e633-07ac-41b3-b095-a48f36a306a0'} Oct 27 03:39:51.466841 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:39:51.466841 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:39:51.466841 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:39:51.466841 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:39:51.466841 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:39:51.466841 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:39:51.466841 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:39:51.466841 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:39:51.466841 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:39:51.466841 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:39:51.466841 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c75e633-07ac-41b3-b095-a48f36a306a0 could not be found. Oct 27 03:39:51.466841 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:39:51.466841 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:39:51.466841 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:39:51.466841 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:39:51.466841 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:39:51.466841 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:39:51.466841 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:39:51.466841 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:39:51.466841 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:39:51.466841 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:39:51.466841 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:39:51.466841 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:39:51.466841 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:39:51.466841 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:39:51.466841 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:39:51.466841 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:39:51.466841 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c75e633-07ac-41b3-b095-a48f36a306a0 could not be found. Oct 27 03:39:51.466841 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:39:51.466841 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:39:51.466841 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:39:51.470412 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:39:51.470412 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:39:51.470412 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:39:51.470412 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:39:51.470412 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:39:51.470412 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c75e633-07ac-41b3-b095-a48f36a306a0 could not be found. Oct 27 03:39:51.470412 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:39:51.472268 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-681a7e05-33f9-4c39-824e-d00ff9e6f75a tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Returning 404 to user: Instance 4c75e633-07ac-41b3-b095-a48f36a306a0 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:39:51.473369 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-681a7e05-33f9-4c39-824e-d00ff9e6f75a tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] 10.222.0.20 "GET /compute/v2.1/servers/4c75e633-07ac-41b3-b095-a48f36a306a0" status: 404 len: 111 microversion: 2.1 time: 0.038057 Oct 27 03:39:51.474582 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2370/4481] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:51 2022] GET /compute/v2.1/servers/4c75e633-07ac-41b3-b095-a48f36a306a0 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:39:51.486534 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-42584060-0d5b-41a7-b20b-67f11b2d5022 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:51.514431 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.compute.server_groups [None req-42584060-0d5b-41a7-b20b-67f11b2d5022 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Querying cell d4405804-b3fd-4c57-a074-5c4e2aef7c93(cell1) for 1 instances {{(pid=121000) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 27 03:39:51.515305 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-42584060-0d5b-41a7-b20b-67f11b2d5022 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:51.515831 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-42584060-0d5b-41a7-b20b-67f11b2d5022 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:51.516280 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-42584060-0d5b-41a7-b20b-67f11b2d5022 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:51.530835 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-42584060-0d5b-41a7-b20b-67f11b2d5022 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.048670 Oct 27 03:39:51.539980 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2112/4482] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Oct 27 03:39:51 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:39:51.545099 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a1ab5de5-dd07-4a86-aaa3-1d337125f997 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:51.575757 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.compute.server_groups [None req-a1ab5de5-dd07-4a86-aaa3-1d337125f997 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Querying cell d4405804-b3fd-4c57-a074-5c4e2aef7c93(cell1) for 1 instances {{(pid=121001) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 27 03:39:51.577847 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a1ab5de5-dd07-4a86-aaa3-1d337125f997 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:51.578661 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a1ab5de5-dd07-4a86-aaa3-1d337125f997 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:51.581204 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a1ab5de5-dd07-4a86-aaa3-1d337125f997 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:51.616607 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a1ab5de5-dd07-4a86-aaa3-1d337125f997 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups/32e52a42-c3c4-4147-9538-93f4a58a6069" status: 200 len: 183 microversion: 2.1 time: 0.075257 Oct 27 03:39:51.617479 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2371/4483] 10.222.0.20 () {58 vars in 1263 bytes} [Thu Oct 27 03:39:51 2022] GET /compute/v2.1/os-server-groups/32e52a42-c3c4-4147-9538-93f4a58a6069 => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:39:51.629530 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-67ebe91a-b8b2-4133-bcc8-b1d4e41a6cd3 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:51.630358 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-67ebe91a-b8b2-4133-bcc8-b1d4e41a6cd3 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] [instance: 4c75e633-07ac-41b3-b095-a48f36a306a0] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:51.643245 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-67ebe91a-b8b2-4133-bcc8-b1d4e41a6cd3 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:51.643753 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-67ebe91a-b8b2-4133-bcc8-b1d4e41a6cd3 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:51.647175 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-67ebe91a-b8b2-4133-bcc8-b1d4e41a6cd3 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:51.647175 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-67ebe91a-b8b2-4133-bcc8-b1d4e41a6cd3 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:51.647175 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-67ebe91a-b8b2-4133-bcc8-b1d4e41a6cd3 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:51.647175 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-67ebe91a-b8b2-4133-bcc8-b1d4e41a6cd3 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:51.667882 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-67ebe91a-b8b2-4133-bcc8-b1d4e41a6cd3 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] HTTP exception thrown: Instance 4c75e633-07ac-41b3-b095-a48f36a306a0 could not be found. Oct 27 03:39:51.669889 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-67ebe91a-b8b2-4133-bcc8-b1d4e41a6cd3 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Request method failure captured: Oct 27 03:39:51.669889 n-d-862769-1 devstack@n-api.service[121000]: request: DELETE /compute/v2.1/servers/4c75e633-07ac-41b3-b095-a48f36a306a0 HTTP/1.1 Oct 27 03:39:51.669889 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:39:51.669889 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:39:51.669889 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:39:51.669889 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:39:51.669889 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:39:51.669889 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:39:51.669889 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:39:51.669889 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:39:51.669889 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWf1rF5xWunpTnBmBRylb2X5Kg_TSg4tENmClZuLZqo7_pa8g7YBoYZtoYqXSUH9d4TlHdSnTr-qoL6w6yDkKRqARltQ_Z4IOXsEu8OMSPMPT7vokMwx38hK1tKBfex7R1KCb5gC3NDT2mKJYhkDBpKmhWo_Dr71JuBl6yBzWLX_ijgc Oct 27 03:39:51.669889 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:39:51.669889 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:39:51.669889 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:39:51.669889 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:39:51.669889 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:39:51.669889 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:39:51.669889 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 41e4481a955a4c98a44cffcc89af6eb4 Oct 27 03:39:51.669889 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ServerGroupTestJSON-1996011464 Oct 27 03:39:51.669889 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:39:51.669889 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:39:51.669889 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/41e4481a955a4c98a44cffcc89af6eb4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/41e4481a955a4c98a44cffcc89af6eb4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/41e4481a955a4c98a44cffcc89af6eb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_41e4481a955a4c98a44cffcc89af6eb4"}]}] Oct 27 03:39:51.669889 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ServerGroupTestJSON-1996011464 Oct 27 03:39:51.669889 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 41e4481a955a4c98a44cffcc89af6eb4 Oct 27 03:39:51.669889 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ServerGroupTestJSON-1996011464 Oct 27 03:39:51.669889 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ServerGroupTestJSON-1996011464-project Oct 27 03:39:51.669889 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:39:51.669889 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:39:51.669889 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 15f467c14d5241f2b147e4b88fb05916 Oct 27 03:39:51.669889 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ServerGroupTestJSON-1996011464-project Oct 27 03:39:51.669889 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:39:51.669889 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 4c75e633-07ac-41b3-b095-a48f36a306a0 could not be found. Oct 27 03:39:51.669889 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '4c75e633-07ac-41b3-b095-a48f36a306a0'} Oct 27 03:39:51.669889 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:39:51.669889 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:39:51.669889 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:39:51.669889 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:39:51.669889 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:39:51.669889 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:39:51.669889 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:39:51.669889 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:39:51.669889 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:39:51.669889 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:39:51.669889 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c75e633-07ac-41b3-b095-a48f36a306a0 could not be found. Oct 27 03:39:51.669889 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:39:51.669889 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:39:51.669889 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:39:51.669889 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:39:51.669889 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:39:51.669889 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:39:51.669889 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:39:51.669889 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:39:51.669889 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:39:51.669889 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:39:51.669889 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 03:39:51.669889 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 03:39:51.669889 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 03:39:51.669889 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 03:39:51.669889 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:39:51.669889 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:39:51.669889 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:39:51.669889 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:39:51.673793 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c75e633-07ac-41b3-b095-a48f36a306a0 could not be found. Oct 27 03:39:51.673793 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:39:51.673793 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:39:51.673793 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:39:51.673793 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:39:51.673793 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:39:51.673793 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:39:51.673793 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:39:51.673793 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:39:51.673793 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c75e633-07ac-41b3-b095-a48f36a306a0 could not be found. Oct 27 03:39:51.673793 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:39:51.675926 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-67ebe91a-b8b2-4133-bcc8-b1d4e41a6cd3 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Returning 404 to user: Instance 4c75e633-07ac-41b3-b095-a48f36a306a0 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:39:51.677085 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-67ebe91a-b8b2-4133-bcc8-b1d4e41a6cd3 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4c75e633-07ac-41b3-b095-a48f36a306a0" status: 404 len: 111 microversion: 2.1 time: 0.051320 Oct 27 03:39:51.678054 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2113/4484] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:39:51 2022] DELETE /compute/v2.1/servers/4c75e633-07ac-41b3-b095-a48f36a306a0 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:39:51.687468 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-24897138-3055-44be-b026-3a215f45aed0 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:51.688655 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-24897138-3055-44be-b026-3a215f45aed0 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] [instance: 4c75e633-07ac-41b3-b095-a48f36a306a0] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:51.696387 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-24897138-3055-44be-b026-3a215f45aed0 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:51.697090 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-24897138-3055-44be-b026-3a215f45aed0 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:51.698545 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-24897138-3055-44be-b026-3a215f45aed0 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:51.699486 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-24897138-3055-44be-b026-3a215f45aed0 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:51.700095 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-24897138-3055-44be-b026-3a215f45aed0 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:51.700802 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-24897138-3055-44be-b026-3a215f45aed0 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:51.725939 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-24897138-3055-44be-b026-3a215f45aed0 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] HTTP exception thrown: Instance 4c75e633-07ac-41b3-b095-a48f36a306a0 could not be found. Oct 27 03:39:51.727677 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-24897138-3055-44be-b026-3a215f45aed0 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Request method failure captured: Oct 27 03:39:51.727677 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/4c75e633-07ac-41b3-b095-a48f36a306a0 HTTP/1.1 Oct 27 03:39:51.727677 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:39:51.727677 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:39:51.727677 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:39:51.727677 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:39:51.727677 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:39:51.727677 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:39:51.727677 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:39:51.727677 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:39:51.727677 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWf1rF5xWunpTnBmBRylb2X5Kg_TSg4tENmClZuLZqo7_pa8g7YBoYZtoYqXSUH9d4TlHdSnTr-qoL6w6yDkKRqARltQ_Z4IOXsEu8OMSPMPT7vokMwx38hK1tKBfex7R1KCb5gC3NDT2mKJYhkDBpKmhWo_Dr71JuBl6yBzWLX_ijgc Oct 27 03:39:51.727677 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:39:51.727677 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:39:51.727677 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:39:51.727677 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:39:51.727677 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:39:51.727677 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:39:51.727677 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 41e4481a955a4c98a44cffcc89af6eb4 Oct 27 03:39:51.727677 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServerGroupTestJSON-1996011464 Oct 27 03:39:51.727677 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:39:51.727677 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:39:51.727677 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/41e4481a955a4c98a44cffcc89af6eb4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/41e4481a955a4c98a44cffcc89af6eb4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/41e4481a955a4c98a44cffcc89af6eb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_41e4481a955a4c98a44cffcc89af6eb4"}]}] Oct 27 03:39:51.727677 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServerGroupTestJSON-1996011464 Oct 27 03:39:51.727677 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 41e4481a955a4c98a44cffcc89af6eb4 Oct 27 03:39:51.727677 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServerGroupTestJSON-1996011464 Oct 27 03:39:51.727677 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServerGroupTestJSON-1996011464-project Oct 27 03:39:51.727677 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:39:51.727677 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:39:51.727677 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 15f467c14d5241f2b147e4b88fb05916 Oct 27 03:39:51.727677 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServerGroupTestJSON-1996011464-project Oct 27 03:39:51.727677 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:39:51.727677 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 4c75e633-07ac-41b3-b095-a48f36a306a0 could not be found. Oct 27 03:39:51.727677 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '4c75e633-07ac-41b3-b095-a48f36a306a0'} Oct 27 03:39:51.727677 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:39:51.727677 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:39:51.727677 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:39:51.727677 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:39:51.727677 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:39:51.727677 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:39:51.727677 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:39:51.727677 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:39:51.727677 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:39:51.727677 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:39:51.727677 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c75e633-07ac-41b3-b095-a48f36a306a0 could not be found. Oct 27 03:39:51.727677 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:39:51.727677 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:39:51.727677 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:39:51.727677 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:39:51.727677 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:39:51.727677 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:39:51.727677 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:39:51.727677 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:39:51.727677 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:39:51.727677 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:39:51.727677 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:39:51.727677 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:39:51.727677 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:39:51.727677 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:39:51.727677 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:39:51.727677 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:39:51.727677 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c75e633-07ac-41b3-b095-a48f36a306a0 could not be found. Oct 27 03:39:51.727677 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:39:51.727677 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:39:51.727677 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:39:51.731559 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:39:51.731559 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:39:51.731559 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:39:51.731559 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:39:51.731559 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:39:51.731559 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c75e633-07ac-41b3-b095-a48f36a306a0 could not be found. Oct 27 03:39:51.731559 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:39:51.731559 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-24897138-3055-44be-b026-3a215f45aed0 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Returning 404 to user: Instance 4c75e633-07ac-41b3-b095-a48f36a306a0 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:39:51.731559 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-24897138-3055-44be-b026-3a215f45aed0 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] 10.222.0.20 "GET /compute/v2.1/servers/4c75e633-07ac-41b3-b095-a48f36a306a0" status: 404 len: 111 microversion: 2.1 time: 0.047266 Oct 27 03:39:51.734498 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2372/4485] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:51 2022] GET /compute/v2.1/servers/4c75e633-07ac-41b3-b095-a48f36a306a0 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:39:51.738401 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f0164266-a30c-4990-a34c-fa011e38d20e tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:51.745181 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-f0164266-a30c-4990-a34c-fa011e38d20e tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] HTTP exception thrown: Instance group 29df1d4f-b381-4450-ad1b-5c902c66806e could not be found. Oct 27 03:39:51.756486 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f0164266-a30c-4990-a34c-fa011e38d20e tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Request method failure captured: Oct 27 03:39:51.756486 n-d-862769-1 devstack@n-api.service[121000]: request: DELETE /compute/v2.1/os-server-groups/29df1d4f-b381-4450-ad1b-5c902c66806e HTTP/1.1 Oct 27 03:39:51.756486 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:39:51.756486 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:39:51.756486 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:39:51.756486 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:39:51.756486 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:39:51.756486 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:39:51.756486 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:39:51.756486 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:39:51.756486 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWf1rF5xWunpTnBmBRylb2X5Kg_TSg4tENmClZuLZqo7_pa8g7YBoYZtoYqXSUH9d4TlHdSnTr-qoL6w6yDkKRqARltQ_Z4IOXsEu8OMSPMPT7vokMwx38hK1tKBfex7R1KCb5gC3NDT2mKJYhkDBpKmhWo_Dr71JuBl6yBzWLX_ijgc Oct 27 03:39:51.756486 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:39:51.756486 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:39:51.756486 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:39:51.756486 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:39:51.756486 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:39:51.756486 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:39:51.756486 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 41e4481a955a4c98a44cffcc89af6eb4 Oct 27 03:39:51.756486 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ServerGroupTestJSON-1996011464 Oct 27 03:39:51.756486 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:39:51.756486 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:39:51.756486 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/41e4481a955a4c98a44cffcc89af6eb4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/41e4481a955a4c98a44cffcc89af6eb4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/41e4481a955a4c98a44cffcc89af6eb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_41e4481a955a4c98a44cffcc89af6eb4"}]}] Oct 27 03:39:51.756486 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ServerGroupTestJSON-1996011464 Oct 27 03:39:51.756486 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 41e4481a955a4c98a44cffcc89af6eb4 Oct 27 03:39:51.756486 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ServerGroupTestJSON-1996011464 Oct 27 03:39:51.756486 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ServerGroupTestJSON-1996011464-project Oct 27 03:39:51.756486 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:39:51.756486 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:39:51.756486 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 15f467c14d5241f2b147e4b88fb05916 Oct 27 03:39:51.756486 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ServerGroupTestJSON-1996011464-project Oct 27 03:39:51.756486 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:39:51.756486 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance group 29df1d4f-b381-4450-ad1b-5c902c66806e could not be found. Oct 27 03:39:51.756486 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '29df1d4f-b381-4450-ad1b-5c902c66806e'} Oct 27 03:39:51.756486 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:39:51.756486 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:39:51.756486 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 27 03:39:51.756486 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 27 03:39:51.756486 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 03:39:51.756486 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 03:39:51.756486 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 27 03:39:51.756486 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 27 03:39:51.756486 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 03:39:51.756486 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 03:39:51.756486 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 27 03:39:51.756486 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 27 03:39:51.756486 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 29df1d4f-b381-4450-ad1b-5c902c66806e could not be found. Oct 27 03:39:51.756486 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:39:51.756486 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:39:51.756486 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:39:51.756486 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:39:51.756486 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:39:51.756486 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:39:51.756486 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:39:51.756486 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:39:51.756486 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:39:51.756486 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:39:51.756486 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 27 03:39:51.756486 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:39:51.756486 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 29df1d4f-b381-4450-ad1b-5c902c66806e could not be found. Oct 27 03:39:51.756486 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:39:51.756486 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:39:51.756486 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:39:51.756486 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:39:51.761220 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:39:51.761220 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:39:51.761220 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:39:51.761220 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:39:51.761220 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 29df1d4f-b381-4450-ad1b-5c902c66806e could not be found. Oct 27 03:39:51.761220 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:39:51.761220 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f0164266-a30c-4990-a34c-fa011e38d20e tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Returning 404 to user: Instance group 29df1d4f-b381-4450-ad1b-5c902c66806e could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:39:51.763439 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f0164266-a30c-4990-a34c-fa011e38d20e tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/29df1d4f-b381-4450-ad1b-5c902c66806e" status: 404 len: 117 microversion: 2.1 time: 0.022848 Oct 27 03:39:51.768038 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2114/4486] 10.222.0.20 () {58 vars in 1266 bytes} [Thu Oct 27 03:39:51 2022] DELETE /compute/v2.1/os-server-groups/29df1d4f-b381-4450-ad1b-5c902c66806e => generated 117 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:39:51.776601 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-db1a84e1-2f56-4dc0-9a15-e3deb51ce9fd tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:51.788309 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-db1a84e1-2f56-4dc0-9a15-e3deb51ce9fd tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] HTTP exception thrown: Instance group 549aced4-1ce6-4621-98c4-071dd75b058c could not be found. Oct 27 03:39:51.790125 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-db1a84e1-2f56-4dc0-9a15-e3deb51ce9fd tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Request method failure captured: Oct 27 03:39:51.790125 n-d-862769-1 devstack@n-api.service[121001]: request: DELETE /compute/v2.1/os-server-groups/549aced4-1ce6-4621-98c4-071dd75b058c HTTP/1.1 Oct 27 03:39:51.790125 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:39:51.790125 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:39:51.790125 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:39:51.790125 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:39:51.790125 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:39:51.790125 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:39:51.790125 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:39:51.790125 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:39:51.790125 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWf1rF5xWunpTnBmBRylb2X5Kg_TSg4tENmClZuLZqo7_pa8g7YBoYZtoYqXSUH9d4TlHdSnTr-qoL6w6yDkKRqARltQ_Z4IOXsEu8OMSPMPT7vokMwx38hK1tKBfex7R1KCb5gC3NDT2mKJYhkDBpKmhWo_Dr71JuBl6yBzWLX_ijgc Oct 27 03:39:51.790125 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:39:51.790125 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:39:51.790125 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:39:51.790125 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:39:51.790125 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:39:51.790125 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:39:51.790125 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 41e4481a955a4c98a44cffcc89af6eb4 Oct 27 03:39:51.790125 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServerGroupTestJSON-1996011464 Oct 27 03:39:51.790125 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:39:51.790125 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:39:51.790125 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/41e4481a955a4c98a44cffcc89af6eb4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/41e4481a955a4c98a44cffcc89af6eb4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/41e4481a955a4c98a44cffcc89af6eb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_41e4481a955a4c98a44cffcc89af6eb4"}]}] Oct 27 03:39:51.790125 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServerGroupTestJSON-1996011464 Oct 27 03:39:51.790125 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 41e4481a955a4c98a44cffcc89af6eb4 Oct 27 03:39:51.790125 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServerGroupTestJSON-1996011464 Oct 27 03:39:51.790125 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServerGroupTestJSON-1996011464-project Oct 27 03:39:51.790125 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:39:51.790125 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:39:51.790125 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 15f467c14d5241f2b147e4b88fb05916 Oct 27 03:39:51.790125 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServerGroupTestJSON-1996011464-project Oct 27 03:39:51.790125 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:39:51.790125 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance group 549aced4-1ce6-4621-98c4-071dd75b058c could not be found. Oct 27 03:39:51.790125 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '549aced4-1ce6-4621-98c4-071dd75b058c'} Oct 27 03:39:51.790125 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:39:51.790125 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:39:51.790125 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 27 03:39:51.790125 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 27 03:39:51.790125 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 03:39:51.790125 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 03:39:51.790125 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 27 03:39:51.790125 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 27 03:39:51.790125 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 03:39:51.790125 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 03:39:51.790125 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 27 03:39:51.790125 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 27 03:39:51.790125 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 549aced4-1ce6-4621-98c4-071dd75b058c could not be found. Oct 27 03:39:51.790125 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:39:51.790125 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:39:51.790125 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:39:51.790125 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:39:51.790125 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:39:51.790125 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:39:51.790125 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:39:51.790125 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:39:51.790125 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:39:51.790125 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:39:51.790125 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 27 03:39:51.790125 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:39:51.790125 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 549aced4-1ce6-4621-98c4-071dd75b058c could not be found. Oct 27 03:39:51.790125 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:39:51.790125 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:39:51.790125 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:39:51.790125 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:39:51.799224 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:39:51.799224 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:39:51.799224 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:39:51.799224 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:39:51.799224 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 549aced4-1ce6-4621-98c4-071dd75b058c could not be found. Oct 27 03:39:51.799224 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:39:51.799224 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-db1a84e1-2f56-4dc0-9a15-e3deb51ce9fd tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Returning 404 to user: Instance group 549aced4-1ce6-4621-98c4-071dd75b058c could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:39:51.799224 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-db1a84e1-2f56-4dc0-9a15-e3deb51ce9fd tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/549aced4-1ce6-4621-98c4-071dd75b058c" status: 404 len: 117 microversion: 2.1 time: 0.019649 Oct 27 03:39:51.799224 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2373/4487] 10.222.0.20 () {58 vars in 1266 bytes} [Thu Oct 27 03:39:51 2022] DELETE /compute/v2.1/os-server-groups/549aced4-1ce6-4621-98c4-071dd75b058c => generated 117 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:39:51.803038 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-fdc5b0cb-fb85-4904-83cc-933a4031d95a tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:51.816909 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-fdc5b0cb-fb85-4904-83cc-933a4031d95a tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] HTTP exception thrown: Instance group f79917a5-e42b-49d9-8673-e452167bcd7b could not be found. Oct 27 03:39:51.820307 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-fdc5b0cb-fb85-4904-83cc-933a4031d95a tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Request method failure captured: Oct 27 03:39:51.820307 n-d-862769-1 devstack@n-api.service[121000]: request: DELETE /compute/v2.1/os-server-groups/f79917a5-e42b-49d9-8673-e452167bcd7b HTTP/1.1 Oct 27 03:39:51.820307 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:39:51.820307 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:39:51.820307 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:39:51.820307 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:39:51.820307 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:39:51.820307 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:39:51.820307 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:39:51.820307 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:39:51.820307 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWf1rF5xWunpTnBmBRylb2X5Kg_TSg4tENmClZuLZqo7_pa8g7YBoYZtoYqXSUH9d4TlHdSnTr-qoL6w6yDkKRqARltQ_Z4IOXsEu8OMSPMPT7vokMwx38hK1tKBfex7R1KCb5gC3NDT2mKJYhkDBpKmhWo_Dr71JuBl6yBzWLX_ijgc Oct 27 03:39:51.820307 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:39:51.820307 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:39:51.820307 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:39:51.820307 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:39:51.820307 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:39:51.820307 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:39:51.820307 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 41e4481a955a4c98a44cffcc89af6eb4 Oct 27 03:39:51.820307 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ServerGroupTestJSON-1996011464 Oct 27 03:39:51.820307 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:39:51.820307 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:39:51.820307 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/41e4481a955a4c98a44cffcc89af6eb4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/41e4481a955a4c98a44cffcc89af6eb4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/41e4481a955a4c98a44cffcc89af6eb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_41e4481a955a4c98a44cffcc89af6eb4"}]}] Oct 27 03:39:51.820307 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ServerGroupTestJSON-1996011464 Oct 27 03:39:51.820307 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 41e4481a955a4c98a44cffcc89af6eb4 Oct 27 03:39:51.820307 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ServerGroupTestJSON-1996011464 Oct 27 03:39:51.820307 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ServerGroupTestJSON-1996011464-project Oct 27 03:39:51.820307 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:39:51.820307 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:39:51.820307 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 15f467c14d5241f2b147e4b88fb05916 Oct 27 03:39:51.820307 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ServerGroupTestJSON-1996011464-project Oct 27 03:39:51.820307 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:39:51.820307 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance group f79917a5-e42b-49d9-8673-e452167bcd7b could not be found. Oct 27 03:39:51.820307 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': 'f79917a5-e42b-49d9-8673-e452167bcd7b'} Oct 27 03:39:51.820307 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:39:51.820307 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:39:51.820307 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 27 03:39:51.820307 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 27 03:39:51.820307 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 03:39:51.820307 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 03:39:51.820307 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 27 03:39:51.820307 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 27 03:39:51.820307 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 03:39:51.820307 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 03:39:51.820307 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 27 03:39:51.820307 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 27 03:39:51.820307 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group f79917a5-e42b-49d9-8673-e452167bcd7b could not be found. Oct 27 03:39:51.820307 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:39:51.820307 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:39:51.820307 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:39:51.820307 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:39:51.820307 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:39:51.820307 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:39:51.820307 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:39:51.820307 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:39:51.820307 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:39:51.820307 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:39:51.820307 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 27 03:39:51.820307 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:39:51.820307 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group f79917a5-e42b-49d9-8673-e452167bcd7b could not be found. Oct 27 03:39:51.820307 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:39:51.820307 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:39:51.820307 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:39:51.820307 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:39:51.824612 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:39:51.824612 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:39:51.824612 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:39:51.824612 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:39:51.824612 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group f79917a5-e42b-49d9-8673-e452167bcd7b could not be found. Oct 27 03:39:51.824612 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:39:51.824612 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-fdc5b0cb-fb85-4904-83cc-933a4031d95a tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Returning 404 to user: Instance group f79917a5-e42b-49d9-8673-e452167bcd7b could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:39:51.824612 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-fdc5b0cb-fb85-4904-83cc-933a4031d95a tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/f79917a5-e42b-49d9-8673-e452167bcd7b" status: 404 len: 117 microversion: 2.1 time: 0.024741 Oct 27 03:39:51.830969 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2115/4488] 10.222.0.20 () {58 vars in 1266 bytes} [Thu Oct 27 03:39:51 2022] DELETE /compute/v2.1/os-server-groups/f79917a5-e42b-49d9-8673-e452167bcd7b => generated 117 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:39:51.834273 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5f8f2259-dad2-4b43-a591-1a416194d36d tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:51.844826 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-5f8f2259-dad2-4b43-a591-1a416194d36d tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] HTTP exception thrown: Instance group 49041da4-0bd5-4fe3-b372-7b614ddd87fb could not be found. Oct 27 03:39:51.847636 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5f8f2259-dad2-4b43-a591-1a416194d36d tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Request method failure captured: Oct 27 03:39:51.847636 n-d-862769-1 devstack@n-api.service[121001]: request: DELETE /compute/v2.1/os-server-groups/49041da4-0bd5-4fe3-b372-7b614ddd87fb HTTP/1.1 Oct 27 03:39:51.847636 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:39:51.847636 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:39:51.847636 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:39:51.847636 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:39:51.847636 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:39:51.847636 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:39:51.847636 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:39:51.847636 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:39:51.847636 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWf1rF5xWunpTnBmBRylb2X5Kg_TSg4tENmClZuLZqo7_pa8g7YBoYZtoYqXSUH9d4TlHdSnTr-qoL6w6yDkKRqARltQ_Z4IOXsEu8OMSPMPT7vokMwx38hK1tKBfex7R1KCb5gC3NDT2mKJYhkDBpKmhWo_Dr71JuBl6yBzWLX_ijgc Oct 27 03:39:51.847636 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:39:51.847636 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:39:51.847636 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:39:51.847636 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:39:51.847636 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:39:51.847636 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:39:51.847636 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 41e4481a955a4c98a44cffcc89af6eb4 Oct 27 03:39:51.847636 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServerGroupTestJSON-1996011464 Oct 27 03:39:51.847636 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:39:51.847636 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:39:51.847636 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/41e4481a955a4c98a44cffcc89af6eb4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/41e4481a955a4c98a44cffcc89af6eb4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/41e4481a955a4c98a44cffcc89af6eb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_41e4481a955a4c98a44cffcc89af6eb4"}]}] Oct 27 03:39:51.847636 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServerGroupTestJSON-1996011464 Oct 27 03:39:51.847636 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 41e4481a955a4c98a44cffcc89af6eb4 Oct 27 03:39:51.847636 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServerGroupTestJSON-1996011464 Oct 27 03:39:51.847636 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServerGroupTestJSON-1996011464-project Oct 27 03:39:51.847636 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:39:51.847636 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:39:51.847636 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 15f467c14d5241f2b147e4b88fb05916 Oct 27 03:39:51.847636 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServerGroupTestJSON-1996011464-project Oct 27 03:39:51.847636 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:39:51.847636 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance group 49041da4-0bd5-4fe3-b372-7b614ddd87fb could not be found. Oct 27 03:39:51.847636 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '49041da4-0bd5-4fe3-b372-7b614ddd87fb'} Oct 27 03:39:51.847636 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:39:51.847636 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:39:51.847636 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 27 03:39:51.847636 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 27 03:39:51.847636 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 03:39:51.847636 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 03:39:51.847636 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 27 03:39:51.847636 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 27 03:39:51.847636 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 03:39:51.847636 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 03:39:51.847636 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 27 03:39:51.847636 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 27 03:39:51.847636 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 49041da4-0bd5-4fe3-b372-7b614ddd87fb could not be found. Oct 27 03:39:51.847636 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:39:51.847636 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:39:51.847636 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:39:51.847636 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:39:51.847636 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:39:51.847636 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:39:51.847636 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:39:51.847636 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:39:51.847636 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:39:51.847636 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:39:51.847636 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 27 03:39:51.847636 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:39:51.847636 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 49041da4-0bd5-4fe3-b372-7b614ddd87fb could not be found. Oct 27 03:39:51.847636 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:39:51.847636 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:39:51.847636 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:39:51.847636 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:39:51.852002 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:39:51.852002 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:39:51.852002 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:39:51.852002 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:39:51.852002 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 49041da4-0bd5-4fe3-b372-7b614ddd87fb could not be found. Oct 27 03:39:51.852002 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:39:51.852002 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5f8f2259-dad2-4b43-a591-1a416194d36d tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Returning 404 to user: Instance group 49041da4-0bd5-4fe3-b372-7b614ddd87fb could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:39:51.852002 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5f8f2259-dad2-4b43-a591-1a416194d36d tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/49041da4-0bd5-4fe3-b372-7b614ddd87fb" status: 404 len: 117 microversion: 2.1 time: 0.020489 Oct 27 03:39:51.853265 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2374/4489] 10.222.0.20 () {58 vars in 1266 bytes} [Thu Oct 27 03:39:51 2022] DELETE /compute/v2.1/os-server-groups/49041da4-0bd5-4fe3-b372-7b614ddd87fb => generated 117 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:39:51.859937 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d196b4c9-8d89-40b3-941c-18f13bfd8dd3 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:51.985816 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d196b4c9-8d89-40b3-941c-18f13bfd8dd3 tempest-ServerGroupTestJSON-1996011464 tempest-ServerGroupTestJSON-1996011464-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/32e52a42-c3c4-4147-9538-93f4a58a6069" status: 204 len: 0 microversion: 2.1 time: 0.131109 Oct 27 03:39:51.987303 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2116/4490] 10.222.0.20 () {58 vars in 1266 bytes} [Thu Oct 27 03:39:51 2022] DELETE /compute/v2.1/os-server-groups/32e52a42-c3c4-4147-9538-93f4a58a6069 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:39:52.080228 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-f4c809f5-5be8-4364-8823-e83f72db4ef8 req-d811c019-05f9-463d-be0c-c8dd26a0ebf3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fa9583d-e294-4e5f-a6dc-a51d619dc03d", "tag": "aca66186-53fb-44cb-b3c0-fd4406f7b0dd"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:39:52.095548 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-f4c809f5-5be8-4364-8823-e83f72db4ef8 req-d811c019-05f9-463d-be0c-c8dd26a0ebf3 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:52.095548 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-f4c809f5-5be8-4364-8823-e83f72db4ef8 req-d811c019-05f9-463d-be0c-c8dd26a0ebf3 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:52.095548 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-f4c809f5-5be8-4364-8823-e83f72db4ef8 req-d811c019-05f9-463d-be0c-c8dd26a0ebf3 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:52.104902 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-f4c809f5-5be8-4364-8823-e83f72db4ef8 req-d811c019-05f9-463d-be0c-c8dd26a0ebf3 service nova] Creating event network-changed:aca66186-53fb-44cb-b3c0-fd4406f7b0dd for instance 9fa9583d-e294-4e5f-a6dc-a51d619dc03d on n-h2-862769-1 Oct 27 03:39:52.110449 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-f4c809f5-5be8-4364-8823-e83f72db4ef8 req-d811c019-05f9-463d-be0c-c8dd26a0ebf3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040649 Oct 27 03:39:52.111663 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2375/4491] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:39:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:39:52.149538 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-aed595e1-1122-468f-a8eb-ee028453853e tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:52.160495 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-aed595e1-1122-468f-a8eb-ee028453853e tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 9fa9583d-e294-4e5f-a6dc-a51d619dc03d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:52.160495 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aed595e1-1122-468f-a8eb-ee028453853e tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:52.160495 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aed595e1-1122-468f-a8eb-ee028453853e tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:52.160495 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aed595e1-1122-468f-a8eb-ee028453853e tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:52.160495 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aed595e1-1122-468f-a8eb-ee028453853e tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:52.161576 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aed595e1-1122-468f-a8eb-ee028453853e tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:52.162117 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aed595e1-1122-468f-a8eb-ee028453853e tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:52.326644 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-aed595e1-1122-468f-a8eb-ee028453853e tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:52.335876 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-aed595e1-1122-468f-a8eb-ee028453853e tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d" status: 200 len: 1315 microversion: 2.1 time: 0.190635 Oct 27 03:39:52.336768 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2117/4492] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:52 2022] GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:39:53.365523 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e179b231-8948-460b-877d-b4bc31ec79a6 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:53.368221 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e179b231-8948-460b-877d-b4bc31ec79a6 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 9fa9583d-e294-4e5f-a6dc-a51d619dc03d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:53.376886 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e179b231-8948-460b-877d-b4bc31ec79a6 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:53.377446 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e179b231-8948-460b-877d-b4bc31ec79a6 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:53.378259 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e179b231-8948-460b-877d-b4bc31ec79a6 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:53.379007 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e179b231-8948-460b-877d-b4bc31ec79a6 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:53.379616 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e179b231-8948-460b-877d-b4bc31ec79a6 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:53.380313 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e179b231-8948-460b-877d-b4bc31ec79a6 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:53.655999 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e179b231-8948-460b-877d-b4bc31ec79a6 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:53.667479 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e179b231-8948-460b-877d-b4bc31ec79a6 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d" status: 200 len: 1315 microversion: 2.1 time: 0.305835 Oct 27 03:39:53.678279 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2376/4493] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:53 2022] GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d => generated 1315 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:39:54.692100 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-09eca819-c367-431a-b083-729ff4e1ce03 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:54.692862 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-09eca819-c367-431a-b083-729ff4e1ce03 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 9fa9583d-e294-4e5f-a6dc-a51d619dc03d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:54.700569 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-09eca819-c367-431a-b083-729ff4e1ce03 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:54.701581 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-09eca819-c367-431a-b083-729ff4e1ce03 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:54.702279 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-09eca819-c367-431a-b083-729ff4e1ce03 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:54.703902 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-09eca819-c367-431a-b083-729ff4e1ce03 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:54.704437 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-09eca819-c367-431a-b083-729ff4e1ce03 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:54.705079 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-09eca819-c367-431a-b083-729ff4e1ce03 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:54.847668 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-09eca819-c367-431a-b083-729ff4e1ce03 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:54.856543 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-09eca819-c367-431a-b083-729ff4e1ce03 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d" status: 200 len: 1315 microversion: 2.1 time: 0.168528 Oct 27 03:39:54.857171 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2118/4494] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:54 2022] GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:39:55.881611 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f6e1403c-d5d4-4405-926c-dbd105035c12 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:55.882446 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f6e1403c-d5d4-4405-926c-dbd105035c12 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 9fa9583d-e294-4e5f-a6dc-a51d619dc03d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:55.887099 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:39:55.891013 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f6e1403c-d5d4-4405-926c-dbd105035c12 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:55.891680 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f6e1403c-d5d4-4405-926c-dbd105035c12 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:55.892328 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f6e1403c-d5d4-4405-926c-dbd105035c12 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:55.893208 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f6e1403c-d5d4-4405-926c-dbd105035c12 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:55.893841 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f6e1403c-d5d4-4405-926c-dbd105035c12 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:55.894455 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f6e1403c-d5d4-4405-926c-dbd105035c12 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:56.202400 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=8 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:39:56.249023 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f6e1403c-d5d4-4405-926c-dbd105035c12 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:56.262598 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f6e1403c-d5d4-4405-926c-dbd105035c12 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d" status: 200 len: 1315 microversion: 2.1 time: 0.384806 Oct 27 03:39:56.263647 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2377/4495] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:55 2022] GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d => generated 1315 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:39:57.287985 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6d55530b-50d4-41b6-8958-9a7c722ec6cc tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:57.288485 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6d55530b-50d4-41b6-8958-9a7c722ec6cc tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 9fa9583d-e294-4e5f-a6dc-a51d619dc03d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:57.308244 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6d55530b-50d4-41b6-8958-9a7c722ec6cc tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:57.308767 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6d55530b-50d4-41b6-8958-9a7c722ec6cc tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:57.309224 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6d55530b-50d4-41b6-8958-9a7c722ec6cc tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:57.309967 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6d55530b-50d4-41b6-8958-9a7c722ec6cc tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:57.316020 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6d55530b-50d4-41b6-8958-9a7c722ec6cc tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:57.316020 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6d55530b-50d4-41b6-8958-9a7c722ec6cc tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:57.611517 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-6d55530b-50d4-41b6-8958-9a7c722ec6cc tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:57.625980 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6d55530b-50d4-41b6-8958-9a7c722ec6cc tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d" status: 200 len: 1315 microversion: 2.1 time: 0.342617 Oct 27 03:39:57.630408 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2119/4496] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:57 2022] GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d => generated 1315 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:39:58.649785 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4c0216e8-aa51-45f8-9050-e5964a411772 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:39:58.650273 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4c0216e8-aa51-45f8-9050-e5964a411772 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 9fa9583d-e294-4e5f-a6dc-a51d619dc03d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:39:58.658086 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4c0216e8-aa51-45f8-9050-e5964a411772 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:58.658560 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4c0216e8-aa51-45f8-9050-e5964a411772 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:58.659013 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4c0216e8-aa51-45f8-9050-e5964a411772 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:58.669006 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4c0216e8-aa51-45f8-9050-e5964a411772 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:58.669006 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4c0216e8-aa51-45f8-9050-e5964a411772 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:58.669006 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4c0216e8-aa51-45f8-9050-e5964a411772 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:58.973074 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4c0216e8-aa51-45f8-9050-e5964a411772 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:39:58.984530 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4c0216e8-aa51-45f8-9050-e5964a411772 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d" status: 200 len: 1315 microversion: 2.1 time: 0.338991 Oct 27 03:39:58.985960 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2378/4497] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:39:58 2022] GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d => generated 1315 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:39:59.206212 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-e3e32897-c446-401e-a4f7-7cd4dbe8a250 req-c57ad61b-99c9-4802-89b4-fe82a054f23c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fa9583d-e294-4e5f-a6dc-a51d619dc03d", "name": "network-vif-plugged", "status": "completed", "tag": "aca66186-53fb-44cb-b3c0-fd4406f7b0dd"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:39:59.218799 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-e3e32897-c446-401e-a4f7-7cd4dbe8a250 req-c57ad61b-99c9-4802-89b4-fe82a054f23c service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:39:59.220140 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-e3e32897-c446-401e-a4f7-7cd4dbe8a250 req-c57ad61b-99c9-4802-89b4-fe82a054f23c service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:39:59.220670 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-e3e32897-c446-401e-a4f7-7cd4dbe8a250 req-c57ad61b-99c9-4802-89b4-fe82a054f23c service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:39:59.237152 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-e3e32897-c446-401e-a4f7-7cd4dbe8a250 req-c57ad61b-99c9-4802-89b4-fe82a054f23c service nova] Creating event network-vif-plugged:aca66186-53fb-44cb-b3c0-fd4406f7b0dd for instance 9fa9583d-e294-4e5f-a6dc-a51d619dc03d on n-h2-862769-1 Oct 27 03:39:59.242626 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-e3e32897-c446-401e-a4f7-7cd4dbe8a250 req-c57ad61b-99c9-4802-89b4-fe82a054f23c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043525 Oct 27 03:39:59.243292 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2120/4498] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:39:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:40:00.012022 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-be1a5e66-6796-4578-bccd-3a42f5090a44 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:00.012878 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-be1a5e66-6796-4578-bccd-3a42f5090a44 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 9fa9583d-e294-4e5f-a6dc-a51d619dc03d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:00.020552 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-be1a5e66-6796-4578-bccd-3a42f5090a44 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:00.021057 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-be1a5e66-6796-4578-bccd-3a42f5090a44 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:00.021476 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-be1a5e66-6796-4578-bccd-3a42f5090a44 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:00.022224 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-be1a5e66-6796-4578-bccd-3a42f5090a44 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:00.022850 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-be1a5e66-6796-4578-bccd-3a42f5090a44 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:00.023288 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-be1a5e66-6796-4578-bccd-3a42f5090a44 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:00.222631 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-be1a5e66-6796-4578-bccd-3a42f5090a44 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:00.237428 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-be1a5e66-6796-4578-bccd-3a42f5090a44 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d" status: 200 len: 1315 microversion: 2.1 time: 0.229932 Oct 27 03:40:00.238018 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2379/4499] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:00 2022] GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:40:00.340772 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9e5df8fe-fb39-4c69-8452-a269d322a9c3 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-746125022", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "bc03229a-4a53-45c0-8381-072be9f8e997"}]}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:40:00.401887 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-9e5df8fe-fb39-4c69-8452-a269d322a9c3 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] validate_networks() for [('bc03229a-4a53-45c0-8381-072be9f8e997', None, None, None, None, None)] {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:40:00.793418 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-9e5df8fe-fb39-4c69-8452-a269d322a9c3 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:40:00.793844 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-9e5df8fe-fb39-4c69-8452-a269d322a9c3 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:40:00.794365 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-9e5df8fe-fb39-4c69-8452-a269d322a9c3 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:40:00.794794 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-9e5df8fe-fb39-4c69-8452-a269d322a9c3 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:40:00.795216 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-9e5df8fe-fb39-4c69-8452-a269d322a9c3 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:40:00.804627 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9e5df8fe-fb39-4c69-8452-a269d322a9c3 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:00.805117 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9e5df8fe-fb39-4c69-8452-a269d322a9c3 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:00.805560 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9e5df8fe-fb39-4c69-8452-a269d322a9c3 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:00.806357 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9e5df8fe-fb39-4c69-8452-a269d322a9c3 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:00.807449 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9e5df8fe-fb39-4c69-8452-a269d322a9c3 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:00.807914 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9e5df8fe-fb39-4c69-8452-a269d322a9c3 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:00.827705 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-9e5df8fe-fb39-4c69-8452-a269d322a9c3 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Getting quotas for project 05672dc7b53747988fde6abc4adb2ef1. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:40:00.833720 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-9e5df8fe-fb39-4c69-8452-a269d322a9c3 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Getting quotas for user eba500c7bb654a649a57bb8c96aa8bf0 and project 05672dc7b53747988fde6abc4adb2ef1. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:40:00.844936 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:40:00.848789 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9e5df8fe-fb39-4c69-8452-a269d322a9c3 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Going to run 2 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:40:00.855762 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9e5df8fe-fb39-4c69-8452-a269d322a9c3 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] [instance: 4f3464bb-bbd7-4bb0-9172-afcb04b5360e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:40:01.040795 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9e5df8fe-fb39-4c69-8452-a269d322a9c3 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] [instance: 9e22e79e-fe50-4837-b052-2a38c966cca6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=4f3464bb-bbd7-4bb0-9172-afcb04b5360e,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:40:01.122213 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1bbc59b3-5fcf-4a7d-b80b-cb635874c91a tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1441841560", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": "none"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:40:01.185576 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-1bbc59b3-5fcf-4a7d-b80b-cb635874c91a tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Flavor limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:40:01.186192 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-1bbc59b3-5fcf-4a7d-b80b-cb635874c91a tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Image limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:40:01.188158 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-1bbc59b3-5fcf-4a7d-b80b-cb635874c91a tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Flavor pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:40:01.188934 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-1bbc59b3-5fcf-4a7d-b80b-cb635874c91a tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Image pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:40:01.189695 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-1bbc59b3-5fcf-4a7d-b80b-cb635874c91a tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:40:01.208040 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1bbc59b3-5fcf-4a7d-b80b-cb635874c91a tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:01.208546 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1bbc59b3-5fcf-4a7d-b80b-cb635874c91a tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:01.208995 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1bbc59b3-5fcf-4a7d-b80b-cb635874c91a tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:01.209742 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1bbc59b3-5fcf-4a7d-b80b-cb635874c91a tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:01.210239 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1bbc59b3-5fcf-4a7d-b80b-cb635874c91a tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:01.210829 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1bbc59b3-5fcf-4a7d-b80b-cb635874c91a tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:01.231070 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-1bbc59b3-5fcf-4a7d-b80b-cb635874c91a tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Getting quotas for project bf22fab0894144d095b92e8e61d4de9d. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:40:01.237474 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-1bbc59b3-5fcf-4a7d-b80b-cb635874c91a tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Getting quotas for user d68306e38a3945a29ecd3ec026cbcee0 and project bf22fab0894144d095b92e8e61d4de9d. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:40:01.238660 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9e5df8fe-fb39-4c69-8452-a269d322a9c3 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.044441 Oct 27 03:40:01.250240 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2121/4500] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:40:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1057 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 03:40:01.251728 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1bbc59b3-5fcf-4a7d-b80b-cb635874c91a tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Going to run 1 instances... {{(pid=121001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:40:01.254191 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1bbc59b3-5fcf-4a7d-b80b-cb635874c91a tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] [instance: cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:40:01.258755 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e1dc5232-53ab-42a8-81da-116fc935d6fe tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:01.286077 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e1dc5232-53ab-42a8-81da-116fc935d6fe tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'eba500c7bb654a649a57bb8c96aa8bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05672dc7b53747988fde6abc4adb2ef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:01.297917 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e1dc5232-53ab-42a8-81da-116fc935d6fe tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Searching by: {'deleted': False, 'project_id': '05672dc7b53747988fde6abc4adb2ef1'} {{(pid=121000) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 03:40:01.319572 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e1dc5232-53ab-42a8-81da-116fc935d6fe tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:01.320095 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e1dc5232-53ab-42a8-81da-116fc935d6fe tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:01.320559 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e1dc5232-53ab-42a8-81da-116fc935d6fe tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:01.321449 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e1dc5232-53ab-42a8-81da-116fc935d6fe tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:01.322062 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e1dc5232-53ab-42a8-81da-116fc935d6fe tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:01.322670 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e1dc5232-53ab-42a8-81da-116fc935d6fe tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:01.358720 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e1dc5232-53ab-42a8-81da-116fc935d6fe tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 675 microversion: 2.1 time: 0.106565 Oct 27 03:40:01.359848 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2122/4501] 10.222.0.20 () {58 vars in 1125 bytes} [Thu Oct 27 03:40:01 2022] GET /compute/v2.1/servers => generated 675 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:40:01.373161 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8290c254-d1ce-435a-8fce-11cb10d05bc4 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:01.374104 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8290c254-d1ce-435a-8fce-11cb10d05bc4 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 9fa9583d-e294-4e5f-a6dc-a51d619dc03d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:01.380426 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1bbc59b3-5fcf-4a7d-b80b-cb635874c91a tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.377255 Oct 27 03:40:01.381708 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2380/4502] 10.222.0.20 () {62 vars in 1188 bytes} [Thu Oct 27 03:40:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 379 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 27 03:40:01.394691 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7b07ce4d-e1c5-4756-87a0-003269e00573 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:01.394691 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7b07ce4d-e1c5-4756-87a0-003269e00573 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] [instance: 9e22e79e-fe50-4837-b052-2a38c966cca6] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:01.398692 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8290c254-d1ce-435a-8fce-11cb10d05bc4 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:01.399439 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8290c254-d1ce-435a-8fce-11cb10d05bc4 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:01.400679 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8290c254-d1ce-435a-8fce-11cb10d05bc4 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:01.401598 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8290c254-d1ce-435a-8fce-11cb10d05bc4 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:01.402297 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8290c254-d1ce-435a-8fce-11cb10d05bc4 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:01.402942 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8290c254-d1ce-435a-8fce-11cb10d05bc4 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:01.421235 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:40:01.513898 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7b07ce4d-e1c5-4756-87a0-003269e00573 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba500c7bb654a649a57bb8c96aa8bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05672dc7b53747988fde6abc4adb2ef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:01.521093 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7b07ce4d-e1c5-4756-87a0-003269e00573 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] 10.222.0.20 "GET /compute/v2.1/servers/9e22e79e-fe50-4837-b052-2a38c966cca6" status: 200 len: 1219 microversion: 2.1 time: 0.137768 Oct 27 03:40:01.521753 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2381/4503] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:01 2022] GET /compute/v2.1/servers/9e22e79e-fe50-4837-b052-2a38c966cca6 => generated 1219 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:40:01.544064 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d15e0595-1251-4a1e-bdaf-2d7486cde94f tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:01.545029 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d15e0595-1251-4a1e-bdaf-2d7486cde94f tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] [instance: cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:01.603650 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8290c254-d1ce-435a-8fce-11cb10d05bc4 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:01.606126 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d15e0595-1251-4a1e-bdaf-2d7486cde94f tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:01.615139 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d15e0595-1251-4a1e-bdaf-2d7486cde94f tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:01.616592 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d15e0595-1251-4a1e-bdaf-2d7486cde94f tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:01.617924 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d15e0595-1251-4a1e-bdaf-2d7486cde94f tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29" status: 200 len: 1278 microversion: 2.57 time: 0.081741 Oct 27 03:40:01.620753 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2382/4504] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:40:01 2022] GET /compute/v2.1/servers/cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29 => generated 1278 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:40:01.622364 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:40:01.632469 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8290c254-d1ce-435a-8fce-11cb10d05bc4 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d" status: 200 len: 1502 microversion: 2.1 time: 0.261897 Oct 27 03:40:01.647746 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2123/4505] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:01 2022] GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d => generated 1502 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:40:01.661790 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ce5db850-6916-42b4-9dae-280ba052bc0a tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:40:01.663011 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ce5db850-6916-42b4-9dae-280ba052bc0a tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 9fa9583d-e294-4e5f-a6dc-a51d619dc03d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:01.670564 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ce5db850-6916-42b4-9dae-280ba052bc0a tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:01.671341 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ce5db850-6916-42b4-9dae-280ba052bc0a tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:01.673375 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ce5db850-6916-42b4-9dae-280ba052bc0a tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:01.674255 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ce5db850-6916-42b4-9dae-280ba052bc0a tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:01.674815 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ce5db850-6916-42b4-9dae-280ba052bc0a tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:01.675186 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ce5db850-6916-42b4-9dae-280ba052bc0a tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:01.701660 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-ce5db850-6916-42b4-9dae-280ba052bc0a tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lazy-loading 'flavor' on Instance uuid 9fa9583d-e294-4e5f-a6dc-a51d619dc03d {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:40:02.303640 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ce5db850-6916-42b4-9dae-280ba052bc0a tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "POST /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d/action" status: 202 len: 0 microversion: 2.1 time: 0.645792 Oct 27 03:40:02.304922 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2383/4506] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:40:01 2022] POST /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d/action => generated 0 bytes in 648 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:40:02.314682 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-851f9593-b223-4bfc-bf6c-abbc8090447b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:02.315727 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-851f9593-b223-4bfc-bf6c-abbc8090447b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 9fa9583d-e294-4e5f-a6dc-a51d619dc03d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:02.324095 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-851f9593-b223-4bfc-bf6c-abbc8090447b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:02.324659 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-851f9593-b223-4bfc-bf6c-abbc8090447b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:02.325114 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-851f9593-b223-4bfc-bf6c-abbc8090447b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:02.329332 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-851f9593-b223-4bfc-bf6c-abbc8090447b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:02.329332 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-851f9593-b223-4bfc-bf6c-abbc8090447b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:02.329332 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-851f9593-b223-4bfc-bf6c-abbc8090447b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:02.484654 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-851f9593-b223-4bfc-bf6c-abbc8090447b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:02.495250 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-851f9593-b223-4bfc-bf6c-abbc8090447b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d" status: 200 len: 1508 microversion: 2.1 time: 0.185032 Oct 27 03:40:02.511131 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2124/4507] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:02 2022] GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d => generated 1508 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:40:02.548351 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-cbd374db-2f8e-41c7-bc65-771ef99f2b0c tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:02.549071 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-cbd374db-2f8e-41c7-bc65-771ef99f2b0c tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] [instance: 9e22e79e-fe50-4837-b052-2a38c966cca6] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:02.624552 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-cbd374db-2f8e-41c7-bc65-771ef99f2b0c tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba500c7bb654a649a57bb8c96aa8bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05672dc7b53747988fde6abc4adb2ef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:02.633081 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-cbd374db-2f8e-41c7-bc65-771ef99f2b0c tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] 10.222.0.20 "GET /compute/v2.1/servers/9e22e79e-fe50-4837-b052-2a38c966cca6" status: 200 len: 1219 microversion: 2.1 time: 0.088958 Oct 27 03:40:02.634222 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2384/4508] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:02 2022] GET /compute/v2.1/servers/9e22e79e-fe50-4837-b052-2a38c966cca6 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:40:02.649126 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-92ce3d91-bb08-4590-ba37-ed44c46ea6f3 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:02.650246 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-92ce3d91-bb08-4590-ba37-ed44c46ea6f3 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] [instance: cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:02.717565 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-92ce3d91-bb08-4590-ba37-ed44c46ea6f3 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:02.725165 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-92ce3d91-bb08-4590-ba37-ed44c46ea6f3 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:02.726778 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-92ce3d91-bb08-4590-ba37-ed44c46ea6f3 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:02.727943 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-92ce3d91-bb08-4590-ba37-ed44c46ea6f3 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29" status: 200 len: 1278 microversion: 2.57 time: 0.083846 Oct 27 03:40:02.728541 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2125/4509] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:40:02 2022] GET /compute/v2.1/servers/cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29 => generated 1278 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:40:03.527743 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b2f5c5c0-916e-4690-a2e8-4a24bcb36e81 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:03.529850 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b2f5c5c0-916e-4690-a2e8-4a24bcb36e81 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 9fa9583d-e294-4e5f-a6dc-a51d619dc03d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:03.548389 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b2f5c5c0-916e-4690-a2e8-4a24bcb36e81 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:03.548389 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b2f5c5c0-916e-4690-a2e8-4a24bcb36e81 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:03.548389 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b2f5c5c0-916e-4690-a2e8-4a24bcb36e81 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:03.548389 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b2f5c5c0-916e-4690-a2e8-4a24bcb36e81 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:03.548389 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b2f5c5c0-916e-4690-a2e8-4a24bcb36e81 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:03.548389 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b2f5c5c0-916e-4690-a2e8-4a24bcb36e81 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:03.659667 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5d5e2304-031a-4bbb-a34c-54066cc582c4 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:03.661618 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5d5e2304-031a-4bbb-a34c-54066cc582c4 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] [instance: 9e22e79e-fe50-4837-b052-2a38c966cca6] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:03.731183 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5d5e2304-031a-4bbb-a34c-54066cc582c4 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba500c7bb654a649a57bb8c96aa8bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05672dc7b53747988fde6abc4adb2ef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:03.741373 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5d5e2304-031a-4bbb-a34c-54066cc582c4 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] 10.222.0.20 "GET /compute/v2.1/servers/9e22e79e-fe50-4837-b052-2a38c966cca6" status: 200 len: 1219 microversion: 2.1 time: 0.086342 Oct 27 03:40:03.742303 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2126/4510] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:03 2022] GET /compute/v2.1/servers/9e22e79e-fe50-4837-b052-2a38c966cca6 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:40:03.760857 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2964a1c0-4a0b-4aa8-9651-aca416626315 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:03.762220 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-2964a1c0-4a0b-4aa8-9651-aca416626315 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] [instance: cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:03.768973 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2964a1c0-4a0b-4aa8-9651-aca416626315 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:03.769872 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2964a1c0-4a0b-4aa8-9651-aca416626315 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:03.770482 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2964a1c0-4a0b-4aa8-9651-aca416626315 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:03.771656 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2964a1c0-4a0b-4aa8-9651-aca416626315 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:03.772267 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2964a1c0-4a0b-4aa8-9651-aca416626315 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:03.772871 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2964a1c0-4a0b-4aa8-9651-aca416626315 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:03.798233 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b2f5c5c0-916e-4690-a2e8-4a24bcb36e81 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:03.811265 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b2f5c5c0-916e-4690-a2e8-4a24bcb36e81 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d" status: 200 len: 1508 microversion: 2.1 time: 0.290762 Oct 27 03:40:03.813484 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2385/4511] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:03 2022] GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d => generated 1508 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:40:03.860489 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2964a1c0-4a0b-4aa8-9651-aca416626315 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:03.874800 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2964a1c0-4a0b-4aa8-9651-aca416626315 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:03.877391 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2964a1c0-4a0b-4aa8-9651-aca416626315 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:03.879624 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2964a1c0-4a0b-4aa8-9651-aca416626315 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29" status: 200 len: 1274 microversion: 2.57 time: 0.126107 Oct 27 03:40:03.893217 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2127/4512] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:40:03 2022] GET /compute/v2.1/servers/cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29 => generated 1274 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:40:04.769001 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2a087be9-1ead-4ba1-a94a-05989713855f tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:04.771303 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2a087be9-1ead-4ba1-a94a-05989713855f tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] [instance: 9e22e79e-fe50-4837-b052-2a38c966cca6] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:04.779067 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2a087be9-1ead-4ba1-a94a-05989713855f tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:04.779564 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2a087be9-1ead-4ba1-a94a-05989713855f tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:04.780005 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2a087be9-1ead-4ba1-a94a-05989713855f tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:04.781187 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2a087be9-1ead-4ba1-a94a-05989713855f tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:04.781657 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2a087be9-1ead-4ba1-a94a-05989713855f tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:04.782114 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2a087be9-1ead-4ba1-a94a-05989713855f tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:04.838715 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-dd52fd2f-672b-4d13-83b5-fd5a5999d6d0 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:04.839350 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-dd52fd2f-672b-4d13-83b5-fd5a5999d6d0 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 9fa9583d-e294-4e5f-a6dc-a51d619dc03d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:04.846573 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dd52fd2f-672b-4d13-83b5-fd5a5999d6d0 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:04.855773 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dd52fd2f-672b-4d13-83b5-fd5a5999d6d0 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:04.855773 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dd52fd2f-672b-4d13-83b5-fd5a5999d6d0 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:04.855773 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dd52fd2f-672b-4d13-83b5-fd5a5999d6d0 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:04.855773 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dd52fd2f-672b-4d13-83b5-fd5a5999d6d0 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:04.855773 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dd52fd2f-672b-4d13-83b5-fd5a5999d6d0 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:04.856485 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2a087be9-1ead-4ba1-a94a-05989713855f tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba500c7bb654a649a57bb8c96aa8bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05672dc7b53747988fde6abc4adb2ef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:04.861280 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2a087be9-1ead-4ba1-a94a-05989713855f tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] 10.222.0.20 "GET /compute/v2.1/servers/9e22e79e-fe50-4837-b052-2a38c966cca6" status: 200 len: 1215 microversion: 2.1 time: 0.096514 Oct 27 03:40:04.861962 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2386/4513] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:04 2022] GET /compute/v2.1/servers/9e22e79e-fe50-4837-b052-2a38c966cca6 => generated 1215 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:40:04.906603 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9b011a5d-5274-4317-82fa-3488a81dc7ae tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:04.907488 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-9b011a5d-5274-4317-82fa-3488a81dc7ae tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] [instance: cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:04.914547 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9b011a5d-5274-4317-82fa-3488a81dc7ae tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:04.915378 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9b011a5d-5274-4317-82fa-3488a81dc7ae tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:04.916009 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9b011a5d-5274-4317-82fa-3488a81dc7ae tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:04.916909 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9b011a5d-5274-4317-82fa-3488a81dc7ae tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:04.918172 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9b011a5d-5274-4317-82fa-3488a81dc7ae tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:04.918854 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9b011a5d-5274-4317-82fa-3488a81dc7ae tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:05.012312 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9b011a5d-5274-4317-82fa-3488a81dc7ae tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:05.016510 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-dd52fd2f-672b-4d13-83b5-fd5a5999d6d0 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:05.026334 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9b011a5d-5274-4317-82fa-3488a81dc7ae tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:05.027869 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-dd52fd2f-672b-4d13-83b5-fd5a5999d6d0 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d" status: 200 len: 1508 microversion: 2.1 time: 0.193214 Oct 27 03:40:05.028232 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9b011a5d-5274-4317-82fa-3488a81dc7ae tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:05.030092 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2128/4514] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:04 2022] GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d => generated 1508 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:40:05.032117 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9b011a5d-5274-4317-82fa-3488a81dc7ae tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29" status: 200 len: 1338 microversion: 2.57 time: 0.129436 Oct 27 03:40:05.034793 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2387/4515] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:40:04 2022] GET /compute/v2.1/servers/cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29 => generated 1338 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:40:05.258383 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-626fa03f-02d5-4afa-850d-dd710806ebc1 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:05.258936 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-626fa03f-02d5-4afa-850d-dd710806ebc1 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: 611195a7-9a81-43eb-9d7d-6c29d80f5933] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:05.266503 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-626fa03f-02d5-4afa-850d-dd710806ebc1 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:05.267009 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-626fa03f-02d5-4afa-850d-dd710806ebc1 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:05.267457 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-626fa03f-02d5-4afa-850d-dd710806ebc1 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:05.268178 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-626fa03f-02d5-4afa-850d-dd710806ebc1 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:05.268687 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-626fa03f-02d5-4afa-850d-dd710806ebc1 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:05.269182 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-626fa03f-02d5-4afa-850d-dd710806ebc1 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:05.300378 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-626fa03f-02d5-4afa-850d-dd710806ebc1 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/611195a7-9a81-43eb-9d7d-6c29d80f5933/ips" status: 200 len: 150 microversion: 2.1 time: 0.045767 Oct 27 03:40:05.302524 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2129/4516] 10.222.0.20 () {58 vars in 1248 bytes} [Thu Oct 27 03:40:05 2022] GET /compute/v2.1/servers/611195a7-9a81-43eb-9d7d-6c29d80f5933/ips => generated 150 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:40:05.892817 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-789f7972-5138-4a1a-ae47-f6a0e0876aec tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:05.893467 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-789f7972-5138-4a1a-ae47-f6a0e0876aec tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] [instance: 9e22e79e-fe50-4837-b052-2a38c966cca6] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:05.900701 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-789f7972-5138-4a1a-ae47-f6a0e0876aec tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:05.901187 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-789f7972-5138-4a1a-ae47-f6a0e0876aec tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:05.901623 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-789f7972-5138-4a1a-ae47-f6a0e0876aec tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:05.902355 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-789f7972-5138-4a1a-ae47-f6a0e0876aec tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:05.902831 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-789f7972-5138-4a1a-ae47-f6a0e0876aec tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:05.903235 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-789f7972-5138-4a1a-ae47-f6a0e0876aec tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:05.973617 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-789f7972-5138-4a1a-ae47-f6a0e0876aec tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba500c7bb654a649a57bb8c96aa8bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05672dc7b53747988fde6abc4adb2ef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:05.981577 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-789f7972-5138-4a1a-ae47-f6a0e0876aec tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] 10.222.0.20 "GET /compute/v2.1/servers/9e22e79e-fe50-4837-b052-2a38c966cca6" status: 200 len: 1271 microversion: 2.1 time: 0.092801 Oct 27 03:40:05.982185 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2388/4517] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:05 2022] GET /compute/v2.1/servers/9e22e79e-fe50-4837-b052-2a38c966cca6 => generated 1271 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:40:06.052052 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-bc04c9d6-4c7d-443e-ae83-7039ae49806b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:06.052710 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-bc04c9d6-4c7d-443e-ae83-7039ae49806b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 9fa9583d-e294-4e5f-a6dc-a51d619dc03d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:06.059749 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bc04c9d6-4c7d-443e-ae83-7039ae49806b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:06.060365 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bc04c9d6-4c7d-443e-ae83-7039ae49806b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:06.060937 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bc04c9d6-4c7d-443e-ae83-7039ae49806b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:06.061657 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bc04c9d6-4c7d-443e-ae83-7039ae49806b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:06.062157 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bc04c9d6-4c7d-443e-ae83-7039ae49806b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:06.064597 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bc04c9d6-4c7d-443e-ae83-7039ae49806b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:06.069730 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5886ac16-7fbc-407f-9671-398460685af4 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:06.070508 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5886ac16-7fbc-407f-9671-398460685af4 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] [instance: cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:06.076926 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5886ac16-7fbc-407f-9671-398460685af4 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:06.077449 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5886ac16-7fbc-407f-9671-398460685af4 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:06.077889 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5886ac16-7fbc-407f-9671-398460685af4 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:06.078677 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5886ac16-7fbc-407f-9671-398460685af4 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:06.079067 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5886ac16-7fbc-407f-9671-398460685af4 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:06.079489 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5886ac16-7fbc-407f-9671-398460685af4 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:06.158171 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5886ac16-7fbc-407f-9671-398460685af4 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:06.166818 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5886ac16-7fbc-407f-9671-398460685af4 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:06.168866 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5886ac16-7fbc-407f-9671-398460685af4 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:06.170267 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5886ac16-7fbc-407f-9671-398460685af4 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29" status: 200 len: 1336 microversion: 2.57 time: 0.104514 Oct 27 03:40:06.171098 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2389/4518] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:40:06 2022] GET /compute/v2.1/servers/cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29 => generated 1336 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:40:06.211345 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-bc04c9d6-4c7d-443e-ae83-7039ae49806b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:06.221595 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-bc04c9d6-4c7d-443e-ae83-7039ae49806b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d" status: 200 len: 1508 microversion: 2.1 time: 0.173448 Oct 27 03:40:06.222215 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2130/4519] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:06 2022] GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d => generated 1508 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:40:07.005006 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d1c572b5-942a-4206-91e9-89d2ef3473e9 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:07.005765 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d1c572b5-942a-4206-91e9-89d2ef3473e9 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] [instance: 9e22e79e-fe50-4837-b052-2a38c966cca6] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:07.015212 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d1c572b5-942a-4206-91e9-89d2ef3473e9 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:07.015980 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d1c572b5-942a-4206-91e9-89d2ef3473e9 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:07.016463 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d1c572b5-942a-4206-91e9-89d2ef3473e9 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:07.017303 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d1c572b5-942a-4206-91e9-89d2ef3473e9 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:07.017767 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d1c572b5-942a-4206-91e9-89d2ef3473e9 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:07.018230 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d1c572b5-942a-4206-91e9-89d2ef3473e9 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:07.106255 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d1c572b5-942a-4206-91e9-89d2ef3473e9 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba500c7bb654a649a57bb8c96aa8bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05672dc7b53747988fde6abc4adb2ef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:07.113688 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d1c572b5-942a-4206-91e9-89d2ef3473e9 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] 10.222.0.20 "GET /compute/v2.1/servers/9e22e79e-fe50-4837-b052-2a38c966cca6" status: 200 len: 1271 microversion: 2.1 time: 0.112456 Oct 27 03:40:07.114360 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2390/4520] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:06 2022] GET /compute/v2.1/servers/9e22e79e-fe50-4837-b052-2a38c966cca6 => generated 1271 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:40:07.202858 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-72e5ca1d-5ce8-4078-b281-13b359c66791 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:07.203483 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-72e5ca1d-5ce8-4078-b281-13b359c66791 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] [instance: cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:07.210867 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-72e5ca1d-5ce8-4078-b281-13b359c66791 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:07.211361 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-72e5ca1d-5ce8-4078-b281-13b359c66791 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:07.211849 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-72e5ca1d-5ce8-4078-b281-13b359c66791 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:07.213405 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-72e5ca1d-5ce8-4078-b281-13b359c66791 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:07.213878 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-72e5ca1d-5ce8-4078-b281-13b359c66791 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:07.214335 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-72e5ca1d-5ce8-4078-b281-13b359c66791 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:07.245528 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-bbc26f27-6e6b-43fa-8661-94a04609f6d3 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:07.246801 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-bbc26f27-6e6b-43fa-8661-94a04609f6d3 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 9fa9583d-e294-4e5f-a6dc-a51d619dc03d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:07.252886 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bbc26f27-6e6b-43fa-8661-94a04609f6d3 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:07.253712 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bbc26f27-6e6b-43fa-8661-94a04609f6d3 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:07.254250 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bbc26f27-6e6b-43fa-8661-94a04609f6d3 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:07.255197 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bbc26f27-6e6b-43fa-8661-94a04609f6d3 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:07.255731 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bbc26f27-6e6b-43fa-8661-94a04609f6d3 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:07.256388 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bbc26f27-6e6b-43fa-8661-94a04609f6d3 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:07.267285 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:40:07.345082 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-72e5ca1d-5ce8-4078-b281-13b359c66791 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:07.359852 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-72e5ca1d-5ce8-4078-b281-13b359c66791 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:07.361496 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-72e5ca1d-5ce8-4078-b281-13b359c66791 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:07.363126 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-72e5ca1d-5ce8-4078-b281-13b359c66791 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29" status: 200 len: 1336 microversion: 2.57 time: 0.164305 Oct 27 03:40:07.367068 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2131/4521] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:40:07 2022] GET /compute/v2.1/servers/cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29 => generated 1336 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:40:07.418169 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-bbc26f27-6e6b-43fa-8661-94a04609f6d3 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:07.427007 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-bbc26f27-6e6b-43fa-8661-94a04609f6d3 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d" status: 200 len: 1508 microversion: 2.1 time: 0.185570 Oct 27 03:40:07.427471 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2391/4522] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:07 2022] GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d => generated 1508 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:40:08.039115 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9a5cc5e0-d9c9-44a9-98e1-2d6848e5d86f tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eef6ec43-2efa-4797-9fc2-7141fab5e678"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:40:08.043140 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9a5cc5e0-d9c9-44a9-98e1-2d6848e5d86f tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: 611195a7-9a81-43eb-9d7d-6c29d80f5933] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:08.049586 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9a5cc5e0-d9c9-44a9-98e1-2d6848e5d86f tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:08.050347 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9a5cc5e0-d9c9-44a9-98e1-2d6848e5d86f tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:08.050884 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9a5cc5e0-d9c9-44a9-98e1-2d6848e5d86f tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:08.051826 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9a5cc5e0-d9c9-44a9-98e1-2d6848e5d86f tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:08.052469 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9a5cc5e0-d9c9-44a9-98e1-2d6848e5d86f tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:08.053075 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9a5cc5e0-d9c9-44a9-98e1-2d6848e5d86f tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:08.140825 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e056cd91-b7b6-42ea-8d2b-12718f3adc90 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:08.145709 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e056cd91-b7b6-42ea-8d2b-12718f3adc90 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] [instance: 9e22e79e-fe50-4837-b052-2a38c966cca6] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:08.159816 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e056cd91-b7b6-42ea-8d2b-12718f3adc90 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:08.164924 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e056cd91-b7b6-42ea-8d2b-12718f3adc90 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:08.166144 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e056cd91-b7b6-42ea-8d2b-12718f3adc90 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:08.167741 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e056cd91-b7b6-42ea-8d2b-12718f3adc90 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:08.168496 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e056cd91-b7b6-42ea-8d2b-12718f3adc90 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:08.169209 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e056cd91-b7b6-42ea-8d2b-12718f3adc90 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:08.277332 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e056cd91-b7b6-42ea-8d2b-12718f3adc90 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba500c7bb654a649a57bb8c96aa8bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05672dc7b53747988fde6abc4adb2ef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:08.294646 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e056cd91-b7b6-42ea-8d2b-12718f3adc90 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] 10.222.0.20 "GET /compute/v2.1/servers/9e22e79e-fe50-4837-b052-2a38c966cca6" status: 200 len: 1279 microversion: 2.1 time: 0.158763 Oct 27 03:40:08.311770 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2392/4523] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:08 2022] GET /compute/v2.1/servers/9e22e79e-fe50-4837-b052-2a38c966cca6 => generated 1279 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:40:08.393088 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-69bc6854-42d6-4e19-9fd2-17f69f33c470 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:08.393660 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-69bc6854-42d6-4e19-9fd2-17f69f33c470 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] [instance: cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:08.399795 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-69bc6854-42d6-4e19-9fd2-17f69f33c470 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:08.403939 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-69bc6854-42d6-4e19-9fd2-17f69f33c470 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:08.403939 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-69bc6854-42d6-4e19-9fd2-17f69f33c470 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:08.403939 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-69bc6854-42d6-4e19-9fd2-17f69f33c470 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:08.403939 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-69bc6854-42d6-4e19-9fd2-17f69f33c470 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:08.403939 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-69bc6854-42d6-4e19-9fd2-17f69f33c470 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:08.496192 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-69bc6854-42d6-4e19-9fd2-17f69f33c470 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:08.507125 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-69bc6854-42d6-4e19-9fd2-17f69f33c470 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:08.509002 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-69bc6854-42d6-4e19-9fd2-17f69f33c470 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:08.511264 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-69bc6854-42d6-4e19-9fd2-17f69f33c470 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29" status: 200 len: 1357 microversion: 2.57 time: 0.122174 Oct 27 03:40:08.511831 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2393/4524] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:40:08 2022] GET /compute/v2.1/servers/cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29 => generated 1357 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:40:08.516677 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b18d5d93-a197-4536-9e85-36e5b151ab95 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:08.517733 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b18d5d93-a197-4536-9e85-36e5b151ab95 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 9fa9583d-e294-4e5f-a6dc-a51d619dc03d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:08.525031 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b18d5d93-a197-4536-9e85-36e5b151ab95 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:08.526668 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b18d5d93-a197-4536-9e85-36e5b151ab95 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:08.527329 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b18d5d93-a197-4536-9e85-36e5b151ab95 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:08.529814 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b18d5d93-a197-4536-9e85-36e5b151ab95 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:08.530719 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b18d5d93-a197-4536-9e85-36e5b151ab95 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:08.531365 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b18d5d93-a197-4536-9e85-36e5b151ab95 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:08.740364 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b18d5d93-a197-4536-9e85-36e5b151ab95 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:08.749469 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b18d5d93-a197-4536-9e85-36e5b151ab95 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d" status: 200 len: 1508 microversion: 2.1 time: 0.236276 Oct 27 03:40:08.750326 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2394/4525] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:08 2022] GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d => generated 1508 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:40:08.771222 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4fc62cda-b2c4-4759-a088-fc54ae221b91 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:40:08.774318 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4fc62cda-b2c4-4759-a088-fc54ae221b91 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] [instance: cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:08.780343 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4fc62cda-b2c4-4759-a088-fc54ae221b91 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:08.780849 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4fc62cda-b2c4-4759-a088-fc54ae221b91 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:08.781297 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4fc62cda-b2c4-4759-a088-fc54ae221b91 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:08.782016 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4fc62cda-b2c4-4759-a088-fc54ae221b91 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:08.782549 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4fc62cda-b2c4-4759-a088-fc54ae221b91 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:08.782928 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4fc62cda-b2c4-4759-a088-fc54ae221b91 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:08.885371 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-4fc62cda-b2c4-4759-a088-fc54ae221b91 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Flavor limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:40:08.886225 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-4fc62cda-b2c4-4759-a088-fc54ae221b91 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Image limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:40:08.886893 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-4fc62cda-b2c4-4759-a088-fc54ae221b91 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Flavor pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:40:08.887597 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-4fc62cda-b2c4-4759-a088-fc54ae221b91 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Image pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:40:08.888146 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-4fc62cda-b2c4-4759-a088-fc54ae221b91 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:40:09.113610 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9a5cc5e0-d9c9-44a9-98e1-2d6848e5d86f tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "POST /compute/v2.1/servers/611195a7-9a81-43eb-9d7d-6c29d80f5933/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.078351 Oct 27 03:40:09.114284 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2132/4526] 10.222.0.20 () {60 vars in 1323 bytes} [Thu Oct 27 03:40:08 2022] POST /compute/v2.1/servers/611195a7-9a81-43eb-9d7d-6c29d80f5933/os-volume_attachments => generated 194 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:40:09.170460 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4fc62cda-b2c4-4759-a088-fc54ae221b91 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] [instance: cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:09.176496 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4fc62cda-b2c4-4759-a088-fc54ae221b91 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:09.177231 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4fc62cda-b2c4-4759-a088-fc54ae221b91 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:09.177683 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4fc62cda-b2c4-4759-a088-fc54ae221b91 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:09.178424 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4fc62cda-b2c4-4759-a088-fc54ae221b91 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:09.179048 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4fc62cda-b2c4-4759-a088-fc54ae221b91 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:09.179762 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4fc62cda-b2c4-4759-a088-fc54ae221b91 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:09.198121 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-d78b4cf8-7297-4819-90e5-0275163ee0fb req-24a9b4cb-ff6d-4d99-9c58-a90559b02188 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f3464bb-bbd7-4bb0-9172-afcb04b5360e", "tag": "bdf21ea9-89d1-47e6-8cb7-dfbbe545ee64"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:40:09.220289 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-d78b4cf8-7297-4819-90e5-0275163ee0fb req-24a9b4cb-ff6d-4d99-9c58-a90559b02188 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:09.224873 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-d78b4cf8-7297-4819-90e5-0275163ee0fb req-24a9b4cb-ff6d-4d99-9c58-a90559b02188 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:09.224873 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-d78b4cf8-7297-4819-90e5-0275163ee0fb req-24a9b4cb-ff6d-4d99-9c58-a90559b02188 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:09.225100 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4fc62cda-b2c4-4759-a088-fc54ae221b91 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] 10.222.0.20 "POST /compute/v2.1/servers/cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29/action" status: 202 len: 1138 microversion: 2.57 time: 0.460137 Oct 27 03:40:09.225100 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2395/4527] 10.222.0.20 () {62 vars in 1320 bytes} [Thu Oct 27 03:40:08 2022] POST /compute/v2.1/servers/cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29/action => generated 1138 bytes in 473 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 27 03:40:09.234338 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-d78b4cf8-7297-4819-90e5-0275163ee0fb req-24a9b4cb-ff6d-4d99-9c58-a90559b02188 service nova] Creating event network-changed:bdf21ea9-89d1-47e6-8cb7-dfbbe545ee64 for instance 4f3464bb-bbd7-4bb0-9172-afcb04b5360e on n-h1-862769-1 Oct 27 03:40:09.244716 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-d78b4cf8-7297-4819-90e5-0275163ee0fb req-24a9b4cb-ff6d-4d99-9c58-a90559b02188 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050389 Oct 27 03:40:09.245809 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2133/4528] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:40:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:40:09.250283 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-271f9006-9706-4748-bc83-316cd3df5970 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:09.251092 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-271f9006-9706-4748-bc83-316cd3df5970 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] [instance: cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:09.259637 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-271f9006-9706-4748-bc83-316cd3df5970 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:09.259830 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-271f9006-9706-4748-bc83-316cd3df5970 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:09.260208 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-271f9006-9706-4748-bc83-316cd3df5970 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:09.261478 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-271f9006-9706-4748-bc83-316cd3df5970 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:09.261939 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-271f9006-9706-4748-bc83-316cd3df5970 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:09.262472 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-271f9006-9706-4748-bc83-316cd3df5970 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:09.324362 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3756a952-3663-4cb8-8c4f-4843ef0c5bc6 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:09.325393 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-3756a952-3663-4cb8-8c4f-4843ef0c5bc6 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] [instance: 9e22e79e-fe50-4837-b052-2a38c966cca6] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:09.343116 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3756a952-3663-4cb8-8c4f-4843ef0c5bc6 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:09.344065 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3756a952-3663-4cb8-8c4f-4843ef0c5bc6 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:09.344921 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3756a952-3663-4cb8-8c4f-4843ef0c5bc6 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:09.346789 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3756a952-3663-4cb8-8c4f-4843ef0c5bc6 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:09.347565 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3756a952-3663-4cb8-8c4f-4843ef0c5bc6 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:09.348905 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3756a952-3663-4cb8-8c4f-4843ef0c5bc6 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:09.375907 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-271f9006-9706-4748-bc83-316cd3df5970 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:09.388362 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-271f9006-9706-4748-bc83-316cd3df5970 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:09.388362 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-271f9006-9706-4748-bc83-316cd3df5970 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:09.390261 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-271f9006-9706-4748-bc83-316cd3df5970 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29" status: 200 len: 1366 microversion: 2.57 time: 0.143840 Oct 27 03:40:09.405558 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2396/4529] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:40:09 2022] GET /compute/v2.1/servers/cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:40:09.486443 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c0efe60c-f691-4b49-ab55-0ba084535002 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:09.487319 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c0efe60c-f691-4b49-ab55-0ba084535002 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:09.495502 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c0efe60c-f691-4b49-ab55-0ba084535002 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:09.496114 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c0efe60c-f691-4b49-ab55-0ba084535002 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:09.496621 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c0efe60c-f691-4b49-ab55-0ba084535002 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:09.498183 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c0efe60c-f691-4b49-ab55-0ba084535002 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:09.498892 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c0efe60c-f691-4b49-ab55-0ba084535002 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:09.499391 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c0efe60c-f691-4b49-ab55-0ba084535002 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:09.537789 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c0efe60c-f691-4b49-ab55-0ba084535002 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b/ips" status: 200 len: 146 microversion: 2.1 time: 0.055579 Oct 27 03:40:09.547245 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2397/4530] 10.222.0.20 () {58 vars in 1248 bytes} [Thu Oct 27 03:40:09 2022] GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b/ips => generated 146 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:40:09.778901 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-20d87121-f2a1-414a-a545-cbfbac778abe tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:09.779798 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-20d87121-f2a1-414a-a545-cbfbac778abe tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 9fa9583d-e294-4e5f-a6dc-a51d619dc03d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:09.786841 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-20d87121-f2a1-414a-a545-cbfbac778abe tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:09.787495 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-20d87121-f2a1-414a-a545-cbfbac778abe tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:09.788261 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-20d87121-f2a1-414a-a545-cbfbac778abe tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:09.789117 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-20d87121-f2a1-414a-a545-cbfbac778abe tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:09.789728 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-20d87121-f2a1-414a-a545-cbfbac778abe tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:09.790302 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-20d87121-f2a1-414a-a545-cbfbac778abe tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:09.959871 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-20d87121-f2a1-414a-a545-cbfbac778abe tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:09.970942 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-20d87121-f2a1-414a-a545-cbfbac778abe tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d" status: 200 len: 1508 microversion: 2.1 time: 0.197103 Oct 27 03:40:09.971920 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2398/4531] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:09 2022] GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d => generated 1508 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:40:10.015054 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-3756a952-3663-4cb8-8c4f-4843ef0c5bc6 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba500c7bb654a649a57bb8c96aa8bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05672dc7b53747988fde6abc4adb2ef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:10.019818 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3756a952-3663-4cb8-8c4f-4843ef0c5bc6 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] 10.222.0.20 "GET /compute/v2.1/servers/9e22e79e-fe50-4837-b052-2a38c966cca6" status: 200 len: 1319 microversion: 2.1 time: 0.701437 Oct 27 03:40:10.020736 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2134/4532] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:09 2022] GET /compute/v2.1/servers/9e22e79e-fe50-4837-b052-2a38c966cca6 => generated 1319 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:40:10.424222 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-111be099-6879-40dc-b689-45c44c19fbf0 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:10.424776 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-111be099-6879-40dc-b689-45c44c19fbf0 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] [instance: cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:10.431816 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-111be099-6879-40dc-b689-45c44c19fbf0 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:10.432525 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-111be099-6879-40dc-b689-45c44c19fbf0 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:10.432970 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-111be099-6879-40dc-b689-45c44c19fbf0 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:10.433845 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-111be099-6879-40dc-b689-45c44c19fbf0 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:10.434337 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-111be099-6879-40dc-b689-45c44c19fbf0 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:10.434769 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-111be099-6879-40dc-b689-45c44c19fbf0 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:10.507423 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-111be099-6879-40dc-b689-45c44c19fbf0 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:10.516923 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-111be099-6879-40dc-b689-45c44c19fbf0 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:10.519144 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-111be099-6879-40dc-b689-45c44c19fbf0 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:10.520536 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-111be099-6879-40dc-b689-45c44c19fbf0 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29" status: 200 len: 1366 microversion: 2.57 time: 0.100341 Oct 27 03:40:10.521106 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2399/4533] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:40:10 2022] GET /compute/v2.1/servers/cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29 => generated 1366 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:40:10.994955 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7c7c598b-a5ec-4b7a-9d60-0f3e086363f7 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:10.995591 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7c7c598b-a5ec-4b7a-9d60-0f3e086363f7 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 9fa9583d-e294-4e5f-a6dc-a51d619dc03d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:11.005316 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7c7c598b-a5ec-4b7a-9d60-0f3e086363f7 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:11.009482 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7c7c598b-a5ec-4b7a-9d60-0f3e086363f7 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:11.009482 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7c7c598b-a5ec-4b7a-9d60-0f3e086363f7 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:11.009482 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7c7c598b-a5ec-4b7a-9d60-0f3e086363f7 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:11.009482 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7c7c598b-a5ec-4b7a-9d60-0f3e086363f7 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:11.009928 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7c7c598b-a5ec-4b7a-9d60-0f3e086363f7 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:11.045946 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-bc6a4a79-440d-43b8-be76-02f8e3fab086 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:11.046916 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-bc6a4a79-440d-43b8-be76-02f8e3fab086 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] [instance: 9e22e79e-fe50-4837-b052-2a38c966cca6] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:11.057624 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bc6a4a79-440d-43b8-be76-02f8e3fab086 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:11.059963 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bc6a4a79-440d-43b8-be76-02f8e3fab086 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:11.060526 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bc6a4a79-440d-43b8-be76-02f8e3fab086 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:11.061358 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bc6a4a79-440d-43b8-be76-02f8e3fab086 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:11.061984 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bc6a4a79-440d-43b8-be76-02f8e3fab086 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:11.062584 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bc6a4a79-440d-43b8-be76-02f8e3fab086 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:11.209562 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7c7c598b-a5ec-4b7a-9d60-0f3e086363f7 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:11.219116 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:40:11.222487 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7c7c598b-a5ec-4b7a-9d60-0f3e086363f7 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d" status: 200 len: 1508 microversion: 2.1 time: 0.231352 Oct 27 03:40:11.223183 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2135/4534] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:10 2022] GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d => generated 1508 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:40:11.231242 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-bc6a4a79-440d-43b8-be76-02f8e3fab086 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba500c7bb654a649a57bb8c96aa8bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05672dc7b53747988fde6abc4adb2ef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:11.240136 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-bc6a4a79-440d-43b8-be76-02f8e3fab086 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] 10.222.0.20 "GET /compute/v2.1/servers/9e22e79e-fe50-4837-b052-2a38c966cca6" status: 200 len: 1319 microversion: 2.1 time: 0.198472 Oct 27 03:40:11.241407 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2400/4535] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:11 2022] GET /compute/v2.1/servers/9e22e79e-fe50-4837-b052-2a38c966cca6 => generated 1319 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:40:11.260146 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-d1a109dc-3841-4663-884e-17a961f0dd4f req-e475f2dc-a663-4c20-9149-eb0623be6b87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e22e79e-fe50-4837-b052-2a38c966cca6", "tag": "bf5a0d05-cccf-4b93-b265-a5d9ad9f3738"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:40:11.270163 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-d1a109dc-3841-4663-884e-17a961f0dd4f req-e475f2dc-a663-4c20-9149-eb0623be6b87 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:11.270660 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-d1a109dc-3841-4663-884e-17a961f0dd4f req-e475f2dc-a663-4c20-9149-eb0623be6b87 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:11.271105 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-d1a109dc-3841-4663-884e-17a961f0dd4f req-e475f2dc-a663-4c20-9149-eb0623be6b87 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:11.293521 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-d1a109dc-3841-4663-884e-17a961f0dd4f req-e475f2dc-a663-4c20-9149-eb0623be6b87 service nova] Creating event network-changed:bf5a0d05-cccf-4b93-b265-a5d9ad9f3738 for instance 9e22e79e-fe50-4837-b052-2a38c966cca6 on n-h1-862769-1 Oct 27 03:40:11.299095 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-d1a109dc-3841-4663-884e-17a961f0dd4f req-e475f2dc-a663-4c20-9149-eb0623be6b87 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042528 Oct 27 03:40:11.303216 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2136/4536] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:40:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:40:11.549219 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-154d65c7-6c8d-4796-aa81-da6e7848b2d9 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:11.550081 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-154d65c7-6c8d-4796-aa81-da6e7848b2d9 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] [instance: cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:11.559648 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-154d65c7-6c8d-4796-aa81-da6e7848b2d9 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:11.559648 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-154d65c7-6c8d-4796-aa81-da6e7848b2d9 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:11.560249 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-154d65c7-6c8d-4796-aa81-da6e7848b2d9 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:11.570648 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-154d65c7-6c8d-4796-aa81-da6e7848b2d9 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:11.570648 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-154d65c7-6c8d-4796-aa81-da6e7848b2d9 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:11.570648 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-154d65c7-6c8d-4796-aa81-da6e7848b2d9 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:11.641592 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-154d65c7-6c8d-4796-aa81-da6e7848b2d9 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:11.651775 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-154d65c7-6c8d-4796-aa81-da6e7848b2d9 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:11.653340 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-154d65c7-6c8d-4796-aa81-da6e7848b2d9 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:11.654754 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-154d65c7-6c8d-4796-aa81-da6e7848b2d9 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29" status: 200 len: 1366 microversion: 2.57 time: 0.112046 Oct 27 03:40:11.655459 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2401/4537] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:40:11 2022] GET /compute/v2.1/servers/cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29 => generated 1366 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:40:12.249826 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=4 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:40:12.256135 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b41f8a59-995c-4109-927c-96c579eed2b2 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:12.256905 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b41f8a59-995c-4109-927c-96c579eed2b2 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 9fa9583d-e294-4e5f-a6dc-a51d619dc03d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:12.266148 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e3ef4358-3a27-471b-b867-f784e7ac86ba tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:12.267101 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e3ef4358-3a27-471b-b867-f784e7ac86ba tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] [instance: 9e22e79e-fe50-4837-b052-2a38c966cca6] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:12.271764 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b41f8a59-995c-4109-927c-96c579eed2b2 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:12.272380 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b41f8a59-995c-4109-927c-96c579eed2b2 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:12.273081 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b41f8a59-995c-4109-927c-96c579eed2b2 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:12.273891 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b41f8a59-995c-4109-927c-96c579eed2b2 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:12.274455 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b41f8a59-995c-4109-927c-96c579eed2b2 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:12.276213 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b41f8a59-995c-4109-927c-96c579eed2b2 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:12.279133 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e3ef4358-3a27-471b-b867-f784e7ac86ba tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:12.280932 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e3ef4358-3a27-471b-b867-f784e7ac86ba tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:12.282264 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e3ef4358-3a27-471b-b867-f784e7ac86ba tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:12.285347 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e3ef4358-3a27-471b-b867-f784e7ac86ba tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:12.286053 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e3ef4358-3a27-471b-b867-f784e7ac86ba tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:12.286651 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e3ef4358-3a27-471b-b867-f784e7ac86ba tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:12.536157 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e3ef4358-3a27-471b-b867-f784e7ac86ba tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba500c7bb654a649a57bb8c96aa8bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05672dc7b53747988fde6abc4adb2ef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:12.539498 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b41f8a59-995c-4109-927c-96c579eed2b2 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:12.546061 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e3ef4358-3a27-471b-b867-f784e7ac86ba tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] 10.222.0.20 "GET /compute/v2.1/servers/9e22e79e-fe50-4837-b052-2a38c966cca6" status: 200 len: 1319 microversion: 2.1 time: 0.285222 Oct 27 03:40:12.550078 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2402/4538] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:12 2022] GET /compute/v2.1/servers/9e22e79e-fe50-4837-b052-2a38c966cca6 => generated 1319 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:40:12.552901 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b41f8a59-995c-4109-927c-96c579eed2b2 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d" status: 200 len: 1508 microversion: 2.1 time: 0.300268 Oct 27 03:40:12.561709 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2137/4539] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:12 2022] GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d => generated 1508 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:40:12.685355 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6c333cfc-5b88-43fb-897e-f6d2c1955979 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:12.686252 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-6c333cfc-5b88-43fb-897e-f6d2c1955979 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] [instance: cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:12.693100 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=12 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:40:12.698687 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6c333cfc-5b88-43fb-897e-f6d2c1955979 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:12.699622 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6c333cfc-5b88-43fb-897e-f6d2c1955979 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:12.700670 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6c333cfc-5b88-43fb-897e-f6d2c1955979 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:12.701883 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6c333cfc-5b88-43fb-897e-f6d2c1955979 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:12.702966 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6c333cfc-5b88-43fb-897e-f6d2c1955979 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:12.703556 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6c333cfc-5b88-43fb-897e-f6d2c1955979 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:12.789917 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6c333cfc-5b88-43fb-897e-f6d2c1955979 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:12.802399 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6c333cfc-5b88-43fb-897e-f6d2c1955979 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:12.804208 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6c333cfc-5b88-43fb-897e-f6d2c1955979 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:12.806733 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6c333cfc-5b88-43fb-897e-f6d2c1955979 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29" status: 200 len: 1366 microversion: 2.57 time: 0.127164 Oct 27 03:40:12.807848 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2403/4540] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:40:12 2022] GET /compute/v2.1/servers/cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29 => generated 1366 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:40:13.570730 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6cba50b2-31e8-4b08-ada1-6ab6749cdc90 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:13.571418 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6cba50b2-31e8-4b08-ada1-6ab6749cdc90 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] [instance: 9e22e79e-fe50-4837-b052-2a38c966cca6] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:13.572829 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-97952404-6beb-4672-961b-c08fcfb106c8 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:13.573480 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-97952404-6beb-4672-961b-c08fcfb106c8 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 9fa9583d-e294-4e5f-a6dc-a51d619dc03d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:13.580245 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6cba50b2-31e8-4b08-ada1-6ab6749cdc90 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:13.582294 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-97952404-6beb-4672-961b-c08fcfb106c8 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:13.582395 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6cba50b2-31e8-4b08-ada1-6ab6749cdc90 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:13.582486 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-97952404-6beb-4672-961b-c08fcfb106c8 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:13.582561 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6cba50b2-31e8-4b08-ada1-6ab6749cdc90 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:13.582645 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-97952404-6beb-4672-961b-c08fcfb106c8 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:13.582717 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6cba50b2-31e8-4b08-ada1-6ab6749cdc90 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:13.582787 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-97952404-6beb-4672-961b-c08fcfb106c8 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:13.582856 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6cba50b2-31e8-4b08-ada1-6ab6749cdc90 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:13.582934 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-97952404-6beb-4672-961b-c08fcfb106c8 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:13.583011 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6cba50b2-31e8-4b08-ada1-6ab6749cdc90 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:13.583081 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-97952404-6beb-4672-961b-c08fcfb106c8 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:13.737333 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-6cba50b2-31e8-4b08-ada1-6ab6749cdc90 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba500c7bb654a649a57bb8c96aa8bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05672dc7b53747988fde6abc4adb2ef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:13.739686 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=10 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:40:13.747660 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6cba50b2-31e8-4b08-ada1-6ab6749cdc90 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] 10.222.0.20 "GET /compute/v2.1/servers/9e22e79e-fe50-4837-b052-2a38c966cca6" status: 200 len: 1319 microversion: 2.1 time: 0.181124 Oct 27 03:40:13.756244 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2138/4541] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:13 2022] GET /compute/v2.1/servers/9e22e79e-fe50-4837-b052-2a38c966cca6 => generated 1319 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:40:13.756589 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-97952404-6beb-4672-961b-c08fcfb106c8 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:13.764236 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-97952404-6beb-4672-961b-c08fcfb106c8 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d" status: 200 len: 1508 microversion: 2.1 time: 0.195673 Oct 27 03:40:13.764869 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2404/4542] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:13 2022] GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d => generated 1508 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:40:13.809180 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1d84dca1-072a-4509-91fd-bb3b45a59730 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "661a773a-0e0c-46bc-b4a0-c64a5df52378"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:40:13.811704 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1d84dca1-072a-4509-91fd-bb3b45a59730 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:13.818157 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1d84dca1-072a-4509-91fd-bb3b45a59730 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:13.818666 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1d84dca1-072a-4509-91fd-bb3b45a59730 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:13.819114 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1d84dca1-072a-4509-91fd-bb3b45a59730 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:13.819841 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1d84dca1-072a-4509-91fd-bb3b45a59730 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:13.820309 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1d84dca1-072a-4509-91fd-bb3b45a59730 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:13.820800 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1d84dca1-072a-4509-91fd-bb3b45a59730 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:13.835992 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-41f9abd4-45c0-41dd-ba74-e438a72eaa98 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:13.835992 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-41f9abd4-45c0-41dd-ba74-e438a72eaa98 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] [instance: cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:13.842003 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-41f9abd4-45c0-41dd-ba74-e438a72eaa98 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:13.842693 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-41f9abd4-45c0-41dd-ba74-e438a72eaa98 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:13.843635 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-41f9abd4-45c0-41dd-ba74-e438a72eaa98 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:13.844461 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-41f9abd4-45c0-41dd-ba74-e438a72eaa98 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:13.845031 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-41f9abd4-45c0-41dd-ba74-e438a72eaa98 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:13.845567 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-41f9abd4-45c0-41dd-ba74-e438a72eaa98 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:13.920075 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-41f9abd4-45c0-41dd-ba74-e438a72eaa98 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:13.928522 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-41f9abd4-45c0-41dd-ba74-e438a72eaa98 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:13.929974 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-41f9abd4-45c0-41dd-ba74-e438a72eaa98 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:13.931789 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-41f9abd4-45c0-41dd-ba74-e438a72eaa98 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29" status: 200 len: 1366 microversion: 2.57 time: 0.100989 Oct 27 03:40:13.932356 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2405/4543] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:40:13 2022] GET /compute/v2.1/servers/cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29 => generated 1366 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:40:14.404432 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-2623d581-d538-452a-bc95-4e098547da3c req-85796a78-3dc0-4262-ada4-ad7ec0a80742 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f3464bb-bbd7-4bb0-9172-afcb04b5360e", "name": "network-vif-plugged", "status": "completed", "tag": "bdf21ea9-89d1-47e6-8cb7-dfbbe545ee64"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:40:14.414199 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-2623d581-d538-452a-bc95-4e098547da3c req-85796a78-3dc0-4262-ada4-ad7ec0a80742 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:14.415895 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-2623d581-d538-452a-bc95-4e098547da3c req-85796a78-3dc0-4262-ada4-ad7ec0a80742 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:14.415895 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-2623d581-d538-452a-bc95-4e098547da3c req-85796a78-3dc0-4262-ada4-ad7ec0a80742 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:14.419783 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:40:14.427263 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-2623d581-d538-452a-bc95-4e098547da3c req-85796a78-3dc0-4262-ada4-ad7ec0a80742 service nova] Creating event network-vif-plugged:bdf21ea9-89d1-47e6-8cb7-dfbbe545ee64 for instance 4f3464bb-bbd7-4bb0-9172-afcb04b5360e on n-h1-862769-1 Oct 27 03:40:14.432901 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-2623d581-d538-452a-bc95-4e098547da3c req-85796a78-3dc0-4262-ada4-ad7ec0a80742 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032198 Oct 27 03:40:14.433506 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2406/4544] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:40:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:40:14.776450 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-785a368b-0566-4db1-9f74-72ddd0f4207d tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:14.778182 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-785a368b-0566-4db1-9f74-72ddd0f4207d tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] [instance: 9e22e79e-fe50-4837-b052-2a38c966cca6] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:14.786698 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-785a368b-0566-4db1-9f74-72ddd0f4207d tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:14.788470 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-785a368b-0566-4db1-9f74-72ddd0f4207d tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:14.788470 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-785a368b-0566-4db1-9f74-72ddd0f4207d tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:14.789709 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-785a368b-0566-4db1-9f74-72ddd0f4207d tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:14.790216 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-785a368b-0566-4db1-9f74-72ddd0f4207d tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:14.791332 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-785a368b-0566-4db1-9f74-72ddd0f4207d tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:14.935485 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-785a368b-0566-4db1-9f74-72ddd0f4207d tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba500c7bb654a649a57bb8c96aa8bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05672dc7b53747988fde6abc4adb2ef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:14.944044 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-785a368b-0566-4db1-9f74-72ddd0f4207d tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] 10.222.0.20 "GET /compute/v2.1/servers/9e22e79e-fe50-4837-b052-2a38c966cca6" status: 200 len: 1319 microversion: 2.1 time: 0.173516 Oct 27 03:40:14.958076 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2407/4545] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:14 2022] GET /compute/v2.1/servers/9e22e79e-fe50-4837-b052-2a38c966cca6 => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:40:14.961149 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f049d3d1-ffea-4edf-9c67-39f4965924b4 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:14.962004 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f049d3d1-ffea-4edf-9c67-39f4965924b4 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 9fa9583d-e294-4e5f-a6dc-a51d619dc03d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:14.969902 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f049d3d1-ffea-4edf-9c67-39f4965924b4 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:14.970591 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f049d3d1-ffea-4edf-9c67-39f4965924b4 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:14.971458 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f049d3d1-ffea-4edf-9c67-39f4965924b4 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:14.972359 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f049d3d1-ffea-4edf-9c67-39f4965924b4 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:14.972832 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f049d3d1-ffea-4edf-9c67-39f4965924b4 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:14.973272 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f049d3d1-ffea-4edf-9c67-39f4965924b4 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:15.121115 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f049d3d1-ffea-4edf-9c67-39f4965924b4 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:15.133860 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f049d3d1-ffea-4edf-9c67-39f4965924b4 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d" status: 200 len: 1508 microversion: 2.1 time: 0.173352 Oct 27 03:40:15.133860 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2408/4546] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:14 2022] GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d => generated 1508 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:40:15.135410 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4de10dfb-131b-4472-a5f5-593003f31ab2 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:15.136024 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4de10dfb-131b-4472-a5f5-593003f31ab2 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] [instance: cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:15.141965 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4de10dfb-131b-4472-a5f5-593003f31ab2 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:15.142487 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4de10dfb-131b-4472-a5f5-593003f31ab2 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:15.142926 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4de10dfb-131b-4472-a5f5-593003f31ab2 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:15.143617 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4de10dfb-131b-4472-a5f5-593003f31ab2 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:15.144302 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4de10dfb-131b-4472-a5f5-593003f31ab2 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:15.144733 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4de10dfb-131b-4472-a5f5-593003f31ab2 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:15.158346 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1d84dca1-072a-4509-91fd-bb3b45a59730 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "POST /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.353883 Oct 27 03:40:15.159126 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2139/4547] 10.222.0.20 () {60 vars in 1323 bytes} [Thu Oct 27 03:40:13 2022] POST /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b/os-volume_attachments => generated 194 bytes in 1356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:40:15.225965 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4de10dfb-131b-4472-a5f5-593003f31ab2 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:15.235765 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4de10dfb-131b-4472-a5f5-593003f31ab2 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:15.237543 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4de10dfb-131b-4472-a5f5-593003f31ab2 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:15.238958 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4de10dfb-131b-4472-a5f5-593003f31ab2 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29" status: 200 len: 1366 microversion: 2.57 time: 0.107475 Oct 27 03:40:15.239553 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2409/4548] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:40:15 2022] GET /compute/v2.1/servers/cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29 => generated 1366 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:40:15.970176 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5b807a2f-fc81-410f-89c9-2f351ba0523c tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:15.971043 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5b807a2f-fc81-410f-89c9-2f351ba0523c tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] [instance: 9e22e79e-fe50-4837-b052-2a38c966cca6] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:15.977333 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5b807a2f-fc81-410f-89c9-2f351ba0523c tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:15.977883 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5b807a2f-fc81-410f-89c9-2f351ba0523c tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:15.978362 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5b807a2f-fc81-410f-89c9-2f351ba0523c tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:15.979070 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5b807a2f-fc81-410f-89c9-2f351ba0523c tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:15.979533 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5b807a2f-fc81-410f-89c9-2f351ba0523c tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:15.979970 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5b807a2f-fc81-410f-89c9-2f351ba0523c tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:16.120979 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5b807a2f-fc81-410f-89c9-2f351ba0523c tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba500c7bb654a649a57bb8c96aa8bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05672dc7b53747988fde6abc4adb2ef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:16.129033 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5b807a2f-fc81-410f-89c9-2f351ba0523c tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] 10.222.0.20 "GET /compute/v2.1/servers/9e22e79e-fe50-4837-b052-2a38c966cca6" status: 200 len: 1319 microversion: 2.1 time: 0.164016 Oct 27 03:40:16.129691 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2140/4549] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:15 2022] GET /compute/v2.1/servers/9e22e79e-fe50-4837-b052-2a38c966cca6 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:40:16.152975 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f375a306-dd16-4327-86a9-2b8c4c941d9f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:16.153807 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f375a306-dd16-4327-86a9-2b8c4c941d9f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 9fa9583d-e294-4e5f-a6dc-a51d619dc03d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:16.161177 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f375a306-dd16-4327-86a9-2b8c4c941d9f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:16.161783 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f375a306-dd16-4327-86a9-2b8c4c941d9f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:16.162335 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f375a306-dd16-4327-86a9-2b8c4c941d9f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:16.163116 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f375a306-dd16-4327-86a9-2b8c4c941d9f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:16.163649 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f375a306-dd16-4327-86a9-2b8c4c941d9f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:16.164150 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f375a306-dd16-4327-86a9-2b8c4c941d9f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:16.326249 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2214b4ec-5235-4a91-91df-9ac802b4e37c tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:16.326249 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-2214b4ec-5235-4a91-91df-9ac802b4e37c tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] [instance: cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:16.326249 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2214b4ec-5235-4a91-91df-9ac802b4e37c tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:16.326249 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2214b4ec-5235-4a91-91df-9ac802b4e37c tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:16.326249 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2214b4ec-5235-4a91-91df-9ac802b4e37c tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:16.326249 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2214b4ec-5235-4a91-91df-9ac802b4e37c tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:16.326249 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2214b4ec-5235-4a91-91df-9ac802b4e37c tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:16.326249 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2214b4ec-5235-4a91-91df-9ac802b4e37c tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:16.329532 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:40:16.359221 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f375a306-dd16-4327-86a9-2b8c4c941d9f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:16.368074 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f375a306-dd16-4327-86a9-2b8c4c941d9f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d" status: 200 len: 1508 microversion: 2.1 time: 0.219071 Oct 27 03:40:16.381570 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2410/4550] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:16 2022] GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d => generated 1508 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:40:16.393998 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2214b4ec-5235-4a91-91df-9ac802b4e37c tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:16.403006 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2214b4ec-5235-4a91-91df-9ac802b4e37c tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:16.404471 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2214b4ec-5235-4a91-91df-9ac802b4e37c tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:16.405750 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2214b4ec-5235-4a91-91df-9ac802b4e37c tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29" status: 200 len: 1366 microversion: 2.57 time: 0.142258 Oct 27 03:40:16.406538 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2141/4551] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:40:16 2022] GET /compute/v2.1/servers/cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29 => generated 1366 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:40:17.153134 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ece1f9fe-45df-4a9a-9bdf-b4240c2067b1 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:17.153894 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ece1f9fe-45df-4a9a-9bdf-b4240c2067b1 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] [instance: 9e22e79e-fe50-4837-b052-2a38c966cca6] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:17.160377 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ece1f9fe-45df-4a9a-9bdf-b4240c2067b1 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:17.160972 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ece1f9fe-45df-4a9a-9bdf-b4240c2067b1 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:17.161516 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ece1f9fe-45df-4a9a-9bdf-b4240c2067b1 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:17.162347 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ece1f9fe-45df-4a9a-9bdf-b4240c2067b1 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:17.162912 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ece1f9fe-45df-4a9a-9bdf-b4240c2067b1 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:17.163443 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ece1f9fe-45df-4a9a-9bdf-b4240c2067b1 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:17.304548 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ece1f9fe-45df-4a9a-9bdf-b4240c2067b1 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba500c7bb654a649a57bb8c96aa8bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05672dc7b53747988fde6abc4adb2ef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:17.313353 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ece1f9fe-45df-4a9a-9bdf-b4240c2067b1 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] 10.222.0.20 "GET /compute/v2.1/servers/9e22e79e-fe50-4837-b052-2a38c966cca6" status: 200 len: 1319 microversion: 2.1 time: 0.164354 Oct 27 03:40:17.313930 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2411/4552] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:17 2022] GET /compute/v2.1/servers/9e22e79e-fe50-4837-b052-2a38c966cca6 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:40:17.393000 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3b947375-d3bf-423b-a59d-27779d2179c1 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:17.393631 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-3b947375-d3bf-423b-a59d-27779d2179c1 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 9fa9583d-e294-4e5f-a6dc-a51d619dc03d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:17.402021 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3b947375-d3bf-423b-a59d-27779d2179c1 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:17.402884 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3b947375-d3bf-423b-a59d-27779d2179c1 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:17.403495 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3b947375-d3bf-423b-a59d-27779d2179c1 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:17.404373 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3b947375-d3bf-423b-a59d-27779d2179c1 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:17.404988 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3b947375-d3bf-423b-a59d-27779d2179c1 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:17.405576 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3b947375-d3bf-423b-a59d-27779d2179c1 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:17.434508 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-041a17e9-e510-4375-93e3-4c9baf357470 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:17.435206 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-041a17e9-e510-4375-93e3-4c9baf357470 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] [instance: cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:17.441267 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-041a17e9-e510-4375-93e3-4c9baf357470 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:17.441761 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-041a17e9-e510-4375-93e3-4c9baf357470 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:17.442430 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-041a17e9-e510-4375-93e3-4c9baf357470 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:17.443136 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-041a17e9-e510-4375-93e3-4c9baf357470 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:17.443781 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-041a17e9-e510-4375-93e3-4c9baf357470 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:17.444217 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-041a17e9-e510-4375-93e3-4c9baf357470 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:17.515297 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-041a17e9-e510-4375-93e3-4c9baf357470 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:17.526731 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-041a17e9-e510-4375-93e3-4c9baf357470 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:17.528517 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-041a17e9-e510-4375-93e3-4c9baf357470 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:17.529867 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-041a17e9-e510-4375-93e3-4c9baf357470 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29" status: 200 len: 1366 microversion: 2.57 time: 0.100536 Oct 27 03:40:17.534883 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2412/4553] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:40:17 2022] GET /compute/v2.1/servers/cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29 => generated 1366 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:40:17.556266 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-3b947375-d3bf-423b-a59d-27779d2179c1 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:17.564917 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3b947375-d3bf-423b-a59d-27779d2179c1 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d" status: 200 len: 1508 microversion: 2.1 time: 0.175921 Oct 27 03:40:17.565509 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2142/4554] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:17 2022] GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d => generated 1508 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:40:18.336337 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-813a5a88-475c-4d51-af63-2794015fb405 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:18.337393 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-813a5a88-475c-4d51-af63-2794015fb405 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] [instance: 9e22e79e-fe50-4837-b052-2a38c966cca6] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:18.344377 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-813a5a88-475c-4d51-af63-2794015fb405 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:18.344874 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-813a5a88-475c-4d51-af63-2794015fb405 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:18.345321 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-813a5a88-475c-4d51-af63-2794015fb405 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:18.346045 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-813a5a88-475c-4d51-af63-2794015fb405 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:18.346514 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-813a5a88-475c-4d51-af63-2794015fb405 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:18.346948 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-813a5a88-475c-4d51-af63-2794015fb405 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:18.497012 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-813a5a88-475c-4d51-af63-2794015fb405 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba500c7bb654a649a57bb8c96aa8bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05672dc7b53747988fde6abc4adb2ef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:18.505785 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-813a5a88-475c-4d51-af63-2794015fb405 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] 10.222.0.20 "GET /compute/v2.1/servers/9e22e79e-fe50-4837-b052-2a38c966cca6" status: 200 len: 1319 microversion: 2.1 time: 0.173396 Oct 27 03:40:18.512939 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-066559a0-cea7-4f83-b48e-5c703eae8cdf req-dd3bc255-abd1-4de1-9055-764d50fc0d28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e22e79e-fe50-4837-b052-2a38c966cca6", "name": "network-vif-plugged", "status": "completed", "tag": "bf5a0d05-cccf-4b93-b265-a5d9ad9f3738"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:40:18.517778 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2413/4555] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:18 2022] GET /compute/v2.1/servers/9e22e79e-fe50-4837-b052-2a38c966cca6 => generated 1319 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:40:18.526790 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-066559a0-cea7-4f83-b48e-5c703eae8cdf req-dd3bc255-abd1-4de1-9055-764d50fc0d28 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:18.527285 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-066559a0-cea7-4f83-b48e-5c703eae8cdf req-dd3bc255-abd1-4de1-9055-764d50fc0d28 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:18.527730 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-066559a0-cea7-4f83-b48e-5c703eae8cdf req-dd3bc255-abd1-4de1-9055-764d50fc0d28 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:18.538687 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-066559a0-cea7-4f83-b48e-5c703eae8cdf req-dd3bc255-abd1-4de1-9055-764d50fc0d28 service nova] Creating event network-vif-plugged:bf5a0d05-cccf-4b93-b265-a5d9ad9f3738 for instance 9e22e79e-fe50-4837-b052-2a38c966cca6 on n-h1-862769-1 Oct 27 03:40:18.544143 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-066559a0-cea7-4f83-b48e-5c703eae8cdf req-dd3bc255-abd1-4de1-9055-764d50fc0d28 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036928 Oct 27 03:40:18.544744 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2143/4556] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:40:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:40:18.557239 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-428d0bf2-9818-45cb-85ab-72522152a5c9 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:18.557986 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-428d0bf2-9818-45cb-85ab-72522152a5c9 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] [instance: cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:18.564180 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-428d0bf2-9818-45cb-85ab-72522152a5c9 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:18.564828 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-428d0bf2-9818-45cb-85ab-72522152a5c9 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:18.565347 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-428d0bf2-9818-45cb-85ab-72522152a5c9 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:18.566172 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-428d0bf2-9818-45cb-85ab-72522152a5c9 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:18.566799 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-428d0bf2-9818-45cb-85ab-72522152a5c9 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:18.567242 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-428d0bf2-9818-45cb-85ab-72522152a5c9 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:18.588937 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d444962e-1f4d-4014-92bb-d4035d05db69 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:18.590193 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d444962e-1f4d-4014-92bb-d4035d05db69 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 9fa9583d-e294-4e5f-a6dc-a51d619dc03d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:18.597003 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d444962e-1f4d-4014-92bb-d4035d05db69 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:18.597711 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d444962e-1f4d-4014-92bb-d4035d05db69 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:18.598562 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d444962e-1f4d-4014-92bb-d4035d05db69 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:18.599609 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d444962e-1f4d-4014-92bb-d4035d05db69 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:18.600332 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d444962e-1f4d-4014-92bb-d4035d05db69 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:18.600915 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d444962e-1f4d-4014-92bb-d4035d05db69 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:18.640314 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-428d0bf2-9818-45cb-85ab-72522152a5c9 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:18.649324 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-428d0bf2-9818-45cb-85ab-72522152a5c9 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:18.650970 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-428d0bf2-9818-45cb-85ab-72522152a5c9 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:18.652496 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-428d0bf2-9818-45cb-85ab-72522152a5c9 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29" status: 200 len: 1366 microversion: 2.57 time: 0.099710 Oct 27 03:40:18.653307 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2414/4557] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:40:18 2022] GET /compute/v2.1/servers/cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29 => generated 1366 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:40:18.817925 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d444962e-1f4d-4014-92bb-d4035d05db69 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:18.825925 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d444962e-1f4d-4014-92bb-d4035d05db69 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d" status: 200 len: 1508 microversion: 2.1 time: 0.241920 Oct 27 03:40:18.826534 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2144/4558] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:18 2022] GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d => generated 1508 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:40:19.530863 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9762bcd3-3bb9-4eb9-908b-a116c23d140e tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:19.531496 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-9762bcd3-3bb9-4eb9-908b-a116c23d140e tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] [instance: 9e22e79e-fe50-4837-b052-2a38c966cca6] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:19.539387 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9762bcd3-3bb9-4eb9-908b-a116c23d140e tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:19.539966 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9762bcd3-3bb9-4eb9-908b-a116c23d140e tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:19.540343 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9762bcd3-3bb9-4eb9-908b-a116c23d140e tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:19.541069 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9762bcd3-3bb9-4eb9-908b-a116c23d140e tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:19.541528 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9762bcd3-3bb9-4eb9-908b-a116c23d140e tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:19.541970 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9762bcd3-3bb9-4eb9-908b-a116c23d140e tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:19.680324 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c5bc523c-4fe6-4467-b9c2-0447a0a56323 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:19.681035 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c5bc523c-4fe6-4467-b9c2-0447a0a56323 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] [instance: cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:19.688176 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c5bc523c-4fe6-4467-b9c2-0447a0a56323 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:19.688741 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c5bc523c-4fe6-4467-b9c2-0447a0a56323 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:19.689212 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9762bcd3-3bb9-4eb9-908b-a116c23d140e tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba500c7bb654a649a57bb8c96aa8bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05672dc7b53747988fde6abc4adb2ef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:19.689377 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c5bc523c-4fe6-4467-b9c2-0447a0a56323 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:19.689971 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c5bc523c-4fe6-4467-b9c2-0447a0a56323 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:19.690469 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c5bc523c-4fe6-4467-b9c2-0447a0a56323 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:19.691079 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c5bc523c-4fe6-4467-b9c2-0447a0a56323 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:19.700241 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9762bcd3-3bb9-4eb9-908b-a116c23d140e tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] 10.222.0.20 "GET /compute/v2.1/servers/9e22e79e-fe50-4837-b052-2a38c966cca6" status: 200 len: 1319 microversion: 2.1 time: 0.172837 Oct 27 03:40:19.704533 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2415/4559] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:19 2022] GET /compute/v2.1/servers/9e22e79e-fe50-4837-b052-2a38c966cca6 => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:40:19.759838 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c5bc523c-4fe6-4467-b9c2-0447a0a56323 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:19.768433 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c5bc523c-4fe6-4467-b9c2-0447a0a56323 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:19.773367 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c5bc523c-4fe6-4467-b9c2-0447a0a56323 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:19.773367 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c5bc523c-4fe6-4467-b9c2-0447a0a56323 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29" status: 200 len: 1366 microversion: 2.57 time: 0.094963 Oct 27 03:40:19.773367 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2145/4560] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:40:19 2022] GET /compute/v2.1/servers/cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29 => generated 1366 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:40:19.848789 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4912ddc9-6283-4719-80f0-0c51f54d0f16 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:19.849477 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4912ddc9-6283-4719-80f0-0c51f54d0f16 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 9fa9583d-e294-4e5f-a6dc-a51d619dc03d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:19.855844 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4912ddc9-6283-4719-80f0-0c51f54d0f16 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:19.860297 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4912ddc9-6283-4719-80f0-0c51f54d0f16 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:19.860297 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4912ddc9-6283-4719-80f0-0c51f54d0f16 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:19.860297 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4912ddc9-6283-4719-80f0-0c51f54d0f16 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:19.860297 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4912ddc9-6283-4719-80f0-0c51f54d0f16 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:19.860297 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4912ddc9-6283-4719-80f0-0c51f54d0f16 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:19.991946 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4912ddc9-6283-4719-80f0-0c51f54d0f16 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:20.001273 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4912ddc9-6283-4719-80f0-0c51f54d0f16 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d" status: 200 len: 1508 microversion: 2.1 time: 0.155874 Oct 27 03:40:20.007659 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2416/4561] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:19 2022] GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d => generated 1508 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:40:20.723872 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-717edef5-ceac-408b-8269-1edf59dbb594 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:20.724521 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-717edef5-ceac-408b-8269-1edf59dbb594 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] [instance: 9e22e79e-fe50-4837-b052-2a38c966cca6] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:20.732237 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-717edef5-ceac-408b-8269-1edf59dbb594 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:20.732739 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-717edef5-ceac-408b-8269-1edf59dbb594 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:20.733185 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-717edef5-ceac-408b-8269-1edf59dbb594 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:20.733894 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-717edef5-ceac-408b-8269-1edf59dbb594 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:20.734441 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-717edef5-ceac-408b-8269-1edf59dbb594 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:20.734909 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-717edef5-ceac-408b-8269-1edf59dbb594 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:20.799304 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-caa7446a-f907-49b8-bc84-387cef5c7bf6 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:20.800227 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-caa7446a-f907-49b8-bc84-387cef5c7bf6 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] [instance: cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:20.807419 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-caa7446a-f907-49b8-bc84-387cef5c7bf6 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:20.807914 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-caa7446a-f907-49b8-bc84-387cef5c7bf6 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:20.808398 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-caa7446a-f907-49b8-bc84-387cef5c7bf6 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:20.809097 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-caa7446a-f907-49b8-bc84-387cef5c7bf6 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:20.809577 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-caa7446a-f907-49b8-bc84-387cef5c7bf6 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:20.810069 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-caa7446a-f907-49b8-bc84-387cef5c7bf6 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:20.877170 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-717edef5-ceac-408b-8269-1edf59dbb594 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba500c7bb654a649a57bb8c96aa8bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05672dc7b53747988fde6abc4adb2ef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:20.886922 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-717edef5-ceac-408b-8269-1edf59dbb594 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] 10.222.0.20 "GET /compute/v2.1/servers/9e22e79e-fe50-4837-b052-2a38c966cca6" status: 200 len: 1506 microversion: 2.1 time: 0.166806 Oct 27 03:40:20.897548 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2146/4562] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:20 2022] GET /compute/v2.1/servers/9e22e79e-fe50-4837-b052-2a38c966cca6 => generated 1506 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:40:20.897748 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-caa7446a-f907-49b8-bc84-387cef5c7bf6 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:20.897748 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-caa7446a-f907-49b8-bc84-387cef5c7bf6 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:20.899068 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-caa7446a-f907-49b8-bc84-387cef5c7bf6 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:20.900866 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-caa7446a-f907-49b8-bc84-387cef5c7bf6 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29" status: 200 len: 1366 microversion: 2.57 time: 0.106255 Oct 27 03:40:20.901720 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2417/4563] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:40:20 2022] GET /compute/v2.1/servers/cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29 => generated 1366 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:40:20.910646 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9696afae-3a68-432b-a719-a1337548643b tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:20.911268 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9696afae-3a68-432b-a719-a1337548643b tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] [instance: 4f3464bb-bbd7-4bb0-9172-afcb04b5360e] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:20.918734 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9696afae-3a68-432b-a719-a1337548643b tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:20.919222 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9696afae-3a68-432b-a719-a1337548643b tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:20.919840 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9696afae-3a68-432b-a719-a1337548643b tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:20.920545 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9696afae-3a68-432b-a719-a1337548643b tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:20.921006 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9696afae-3a68-432b-a719-a1337548643b tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:20.921436 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9696afae-3a68-432b-a719-a1337548643b tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:21.024920 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-39625d79-debd-4985-8192-50d6fe8b401a tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:21.025699 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-39625d79-debd-4985-8192-50d6fe8b401a tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 9fa9583d-e294-4e5f-a6dc-a51d619dc03d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:21.031879 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-39625d79-debd-4985-8192-50d6fe8b401a tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:21.032980 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-39625d79-debd-4985-8192-50d6fe8b401a tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:21.032980 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-39625d79-debd-4985-8192-50d6fe8b401a tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:21.033547 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-39625d79-debd-4985-8192-50d6fe8b401a tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:21.034016 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-39625d79-debd-4985-8192-50d6fe8b401a tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:21.034477 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-39625d79-debd-4985-8192-50d6fe8b401a tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:21.059829 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9696afae-3a68-432b-a719-a1337548643b tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba500c7bb654a649a57bb8c96aa8bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05672dc7b53747988fde6abc4adb2ef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:21.068089 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9696afae-3a68-432b-a719-a1337548643b tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] 10.222.0.20 "GET /compute/v2.1/servers/4f3464bb-bbd7-4bb0-9172-afcb04b5360e" status: 200 len: 1506 microversion: 2.1 time: 0.161225 Oct 27 03:40:21.068676 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2147/4564] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:20 2022] GET /compute/v2.1/servers/4f3464bb-bbd7-4bb0-9172-afcb04b5360e => generated 1506 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:40:21.091810 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-db97d5d1-634c-4192-9b3c-539735a7ac34 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:21.092365 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-db97d5d1-634c-4192-9b3c-539735a7ac34 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] [instance: 4f3464bb-bbd7-4bb0-9172-afcb04b5360e] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:21.099070 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-db97d5d1-634c-4192-9b3c-539735a7ac34 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:21.099791 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-db97d5d1-634c-4192-9b3c-539735a7ac34 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:21.100240 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-db97d5d1-634c-4192-9b3c-539735a7ac34 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:21.100947 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-db97d5d1-634c-4192-9b3c-539735a7ac34 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:21.101597 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-db97d5d1-634c-4192-9b3c-539735a7ac34 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:21.102215 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-db97d5d1-634c-4192-9b3c-539735a7ac34 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:21.131862 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-db97d5d1-634c-4192-9b3c-539735a7ac34 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] [instance: 4f3464bb-bbd7-4bb0-9172-afcb04b5360e] Going to try to terminate instance {{(pid=121000) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:40:21.175743 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-39625d79-debd-4985-8192-50d6fe8b401a tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:21.184177 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-39625d79-debd-4985-8192-50d6fe8b401a tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d" status: 200 len: 1508 microversion: 2.1 time: 0.163345 Oct 27 03:40:21.184753 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2418/4565] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:21 2022] GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d => generated 1508 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:40:21.433911 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-db97d5d1-634c-4192-9b3c-539735a7ac34 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4f3464bb-bbd7-4bb0-9172-afcb04b5360e" status: 204 len: 0 microversion: 2.1 time: 0.346031 Oct 27 03:40:21.434576 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2148/4566] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:40:21 2022] DELETE /compute/v2.1/servers/4f3464bb-bbd7-4bb0-9172-afcb04b5360e => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 03:40:21.442966 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b5c2ac46-f6ab-48ee-8b81-865531c57cdb tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:21.443499 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b5c2ac46-f6ab-48ee-8b81-865531c57cdb tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] [instance: 9e22e79e-fe50-4837-b052-2a38c966cca6] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:21.450604 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b5c2ac46-f6ab-48ee-8b81-865531c57cdb tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:21.451125 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b5c2ac46-f6ab-48ee-8b81-865531c57cdb tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:21.451644 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b5c2ac46-f6ab-48ee-8b81-865531c57cdb tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:21.452352 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b5c2ac46-f6ab-48ee-8b81-865531c57cdb tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:21.452806 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b5c2ac46-f6ab-48ee-8b81-865531c57cdb tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:21.453235 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b5c2ac46-f6ab-48ee-8b81-865531c57cdb tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:21.480471 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b5c2ac46-f6ab-48ee-8b81-865531c57cdb tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] [instance: 9e22e79e-fe50-4837-b052-2a38c966cca6] Going to try to terminate instance {{(pid=121001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:40:21.482718 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d68fea17-55c7-47fb-b348-2b7a2097d1ca tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eef6ec43-2efa-4797-9fc2-7141fab5e678"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:40:21.485347 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d68fea17-55c7-47fb-b348-2b7a2097d1ca tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: 611195a7-9a81-43eb-9d7d-6c29d80f5933] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:21.491356 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d68fea17-55c7-47fb-b348-2b7a2097d1ca tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:21.491848 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d68fea17-55c7-47fb-b348-2b7a2097d1ca tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:21.492296 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d68fea17-55c7-47fb-b348-2b7a2097d1ca tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:21.493002 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d68fea17-55c7-47fb-b348-2b7a2097d1ca tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:21.493469 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d68fea17-55c7-47fb-b348-2b7a2097d1ca tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:21.493970 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d68fea17-55c7-47fb-b348-2b7a2097d1ca tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:21.572849 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-d68fea17-55c7-47fb-b348-2b7a2097d1ca tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] HTTP exception thrown: Invalid volume: volume eef6ec43-2efa-4797-9fc2-7141fab5e678 is already attached to instances: 611195a7-9a81-43eb-9d7d-6c29d80f5933 Oct 27 03:40:21.574776 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d68fea17-55c7-47fb-b348-2b7a2097d1ca tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Request method failure captured: Oct 27 03:40:21.574776 n-d-862769-1 devstack@n-api.service[121000]: request: POST /compute/v2.1/servers/611195a7-9a81-43eb-9d7d-6c29d80f5933/os-volume_attachments HTTP/1.1 Oct 27 03:40:21.574776 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:40:21.574776 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:40:21.574776 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:40:21.574776 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 74 Oct 27 03:40:21.574776 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:40:21.574776 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:40:21.574776 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:40:21.574776 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:40:21.574776 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfyO20A1D6ympGjQc2k7pGwXBVoOs4AtFX551niq39NWe_HjifvxGvre6cHeeNp8osa7J1PNEE0_yy7-MG05YNEONXkGtR3-F0Zb6-60FxqOiIpeJ5N_dbXBRWjEl88UsCCW068A90fytHXWgtrGlYksZomXGQlrDugSxyxjlY4_NPY Oct 27 03:40:21.574776 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:40:21.574776 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:40:21.574776 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:40:21.574776 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:40:21.574776 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:40:21.574776 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:40:21.574776 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 229dcb63bc41444391544883b576ce2e Oct 27 03:40:21.574776 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-AttachVolumeNegativeTest-199004901 Oct 27 03:40:21.574776 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:40:21.574776 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:40:21.574776 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/229dcb63bc41444391544883b576ce2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/229dcb63bc41444391544883b576ce2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/229dcb63bc41444391544883b576ce2e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_229dcb63bc41444391544883b576ce2e"}]}] Oct 27 03:40:21.574776 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-AttachVolumeNegativeTest-199004901 Oct 27 03:40:21.574776 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 229dcb63bc41444391544883b576ce2e Oct 27 03:40:21.574776 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-199004901 Oct 27 03:40:21.574776 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-AttachVolumeNegativeTest-199004901-project Oct 27 03:40:21.574776 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:40:21.574776 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:40:21.574776 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 18036411a99e4634bfbaeae24b9f254d Oct 27 03:40:21.574776 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-AttachVolumeNegativeTest-199004901-project Oct 27 03:40:21.574776 n-d-862769-1 devstack@n-api.service[121000]: Oct 27 03:40:21.574776 n-d-862769-1 devstack@n-api.service[121000]: {"volumeAttachment": {"volumeId": "eef6ec43-2efa-4797-9fc2-7141fab5e678"}} Oct 27 03:40:21.574776 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:40:21.574776 n-d-862769-1 devstack@n-api.service[121000]: exception: Invalid volume: volume eef6ec43-2efa-4797-9fc2-7141fab5e678 is already attached to instances: 611195a7-9a81-43eb-9d7d-6c29d80f5933 Oct 27 03:40:21.574776 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'server_id': '611195a7-9a81-43eb-9d7d-6c29d80f5933', 'body': {'volumeAttachment': {'volumeId': 'eef6ec43-2efa-4797-9fc2-7141fab5e678'}}} Oct 27 03:40:21.574776 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:40:21.574776 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:40:21.574776 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 27 03:40:21.574776 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 27 03:40:21.574776 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 03:40:21.574776 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 03:40:21.574776 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 27 03:40:21.574776 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 27 03:40:21.574776 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 27 03:40:21.574776 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 27 03:40:21.574776 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 27 03:40:21.574776 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 27 03:40:21.574776 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume eef6ec43-2efa-4797-9fc2-7141fab5e678 is already attached to instances: 611195a7-9a81-43eb-9d7d-6c29d80f5933 Oct 27 03:40:21.574776 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:40:21.574776 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:40:21.574776 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:40:21.574776 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:40:21.574776 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:40:21.574776 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:40:21.574776 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:40:21.574776 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:40:21.574776 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:40:21.574776 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:40:21.574776 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:40:21.574776 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:40:21.574776 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:40:21.574776 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:40:21.579372 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:40:21.579372 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:40:21.579372 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 27 03:40:21.579372 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 27 03:40:21.579372 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume eef6ec43-2efa-4797-9fc2-7141fab5e678 is already attached to instances: 611195a7-9a81-43eb-9d7d-6c29d80f5933 Oct 27 03:40:21.579372 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:40:21.579372 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:40:21.579372 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:40:21.579372 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:40:21.579372 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:40:21.579372 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:40:21.579372 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:40:21.579372 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:40:21.579372 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume eef6ec43-2efa-4797-9fc2-7141fab5e678 is already attached to instances: 611195a7-9a81-43eb-9d7d-6c29d80f5933 Oct 27 03:40:21.579372 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:40:21.579372 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d68fea17-55c7-47fb-b348-2b7a2097d1ca tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Returning 400 to user: Invalid volume: volume eef6ec43-2efa-4797-9fc2-7141fab5e678 is already attached to instances: 611195a7-9a81-43eb-9d7d-6c29d80f5933 {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:40:21.579372 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d68fea17-55c7-47fb-b348-2b7a2097d1ca tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "POST /compute/v2.1/servers/611195a7-9a81-43eb-9d7d-6c29d80f5933/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098833 Oct 27 03:40:21.579372 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2149/4567] 10.222.0.20 () {60 vars in 1323 bytes} [Thu Oct 27 03:40:21 2022] POST /compute/v2.1/servers/611195a7-9a81-43eb-9d7d-6c29d80f5933/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 03:40:21.643120 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d2e41444-b8a2-43e2-943f-dd1f8a6df07c tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:21.643626 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d2e41444-b8a2-43e2-943f-dd1f8a6df07c tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: 611195a7-9a81-43eb-9d7d-6c29d80f5933] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:21.650198 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d2e41444-b8a2-43e2-943f-dd1f8a6df07c tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:21.650701 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d2e41444-b8a2-43e2-943f-dd1f8a6df07c tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:21.651151 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d2e41444-b8a2-43e2-943f-dd1f8a6df07c tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:21.651906 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d2e41444-b8a2-43e2-943f-dd1f8a6df07c tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:21.652375 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d2e41444-b8a2-43e2-943f-dd1f8a6df07c tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:21.652812 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d2e41444-b8a2-43e2-943f-dd1f8a6df07c tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:21.735863 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-d2e41444-b8a2-43e2-943f-dd1f8a6df07c tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lazy-loading 'services' on Instance uuid 611195a7-9a81-43eb-9d7d-6c29d80f5933 {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:40:21.749961 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b5c2ac46-f6ab-48ee-8b81-865531c57cdb tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9e22e79e-fe50-4837-b052-2a38c966cca6" status: 204 len: 0 microversion: 2.1 time: 0.310824 Oct 27 03:40:21.750654 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2419/4568] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:40:21 2022] DELETE /compute/v2.1/servers/9e22e79e-fe50-4837-b052-2a38c966cca6 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:40:21.850453 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-aeba3be9-d1de-428d-b2c1-b751c25bc20f tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-237925278", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "bc03229a-4a53-45c0-8381-072be9f8e997"}]}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:40:21.904482 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.network.neutron [None req-aeba3be9-d1de-428d-b2c1-b751c25bc20f tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] validate_networks() for [('bc03229a-4a53-45c0-8381-072be9f8e997', None, None, None, None, None)] {{(pid=121001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:40:21.932541 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d2e41444-b8a2-43e2-943f-dd1f8a6df07c tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "DELETE /compute/v2.1/servers/611195a7-9a81-43eb-9d7d-6c29d80f5933/os-volume_attachments/eef6ec43-2efa-4797-9fc2-7141fab5e678" status: 202 len: 0 microversion: 2.1 time: 0.292497 Oct 27 03:40:21.932541 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2150/4569] 10.222.0.20 () {58 vars in 1416 bytes} [Thu Oct 27 03:40:21 2022] DELETE /compute/v2.1/servers/611195a7-9a81-43eb-9d7d-6c29d80f5933/os-volume_attachments/eef6ec43-2efa-4797-9fc2-7141fab5e678 => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 03:40:21.937576 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c4926490-d75a-4bf4-b106-566b06aa09e0 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:21.938317 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c4926490-d75a-4bf4-b106-566b06aa09e0 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] [instance: cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:21.945003 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c4926490-d75a-4bf4-b106-566b06aa09e0 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:21.945532 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c4926490-d75a-4bf4-b106-566b06aa09e0 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:21.945943 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c4926490-d75a-4bf4-b106-566b06aa09e0 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:21.947446 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c4926490-d75a-4bf4-b106-566b06aa09e0 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:21.947726 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c4926490-d75a-4bf4-b106-566b06aa09e0 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:21.948150 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c4926490-d75a-4bf4-b106-566b06aa09e0 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:22.014028 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c4926490-d75a-4bf4-b106-566b06aa09e0 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:22.022884 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c4926490-d75a-4bf4-b106-566b06aa09e0 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:22.024021 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c4926490-d75a-4bf4-b106-566b06aa09e0 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:22.025803 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c4926490-d75a-4bf4-b106-566b06aa09e0 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29" status: 200 len: 1366 microversion: 2.57 time: 0.092256 Oct 27 03:40:22.026400 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2151/4570] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:40:21 2022] GET /compute/v2.1/servers/cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29 => generated 1366 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:40:22.042933 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d273e315-e917-4545-9650-b26012af2bf3 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:22.045347 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d273e315-e917-4545-9650-b26012af2bf3 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: 611195a7-9a81-43eb-9d7d-6c29d80f5933] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:22.051826 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d273e315-e917-4545-9650-b26012af2bf3 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:22.052394 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d273e315-e917-4545-9650-b26012af2bf3 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:22.053185 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d273e315-e917-4545-9650-b26012af2bf3 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:22.053539 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d273e315-e917-4545-9650-b26012af2bf3 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:22.053995 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d273e315-e917-4545-9650-b26012af2bf3 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:22.054447 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d273e315-e917-4545-9650-b26012af2bf3 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:22.086418 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d273e315-e917-4545-9650-b26012af2bf3 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/611195a7-9a81-43eb-9d7d-6c29d80f5933/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047902 Oct 27 03:40:22.087006 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2152/4571] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 27 03:40:22 2022] GET /compute/v2.1/servers/611195a7-9a81-43eb-9d7d-6c29d80f5933/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:40:22.207693 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c9b0b14a-b2a6-4601-81af-2c22c5ee3b6d tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:22.208350 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c9b0b14a-b2a6-4601-81af-2c22c5ee3b6d tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 9fa9583d-e294-4e5f-a6dc-a51d619dc03d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:22.214327 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c9b0b14a-b2a6-4601-81af-2c22c5ee3b6d tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:22.214820 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c9b0b14a-b2a6-4601-81af-2c22c5ee3b6d tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:22.215262 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c9b0b14a-b2a6-4601-81af-2c22c5ee3b6d tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:22.215967 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c9b0b14a-b2a6-4601-81af-2c22c5ee3b6d tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:22.216425 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c9b0b14a-b2a6-4601-81af-2c22c5ee3b6d tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:22.216856 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c9b0b14a-b2a6-4601-81af-2c22c5ee3b6d tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:22.309314 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-aeba3be9-d1de-428d-b2c1-b751c25bc20f tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Flavor limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:40:22.311692 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-aeba3be9-d1de-428d-b2c1-b751c25bc20f tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Image limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:40:22.311692 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-aeba3be9-d1de-428d-b2c1-b751c25bc20f tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Flavor pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:40:22.311692 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-aeba3be9-d1de-428d-b2c1-b751c25bc20f tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Image pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:40:22.311692 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-aeba3be9-d1de-428d-b2c1-b751c25bc20f tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:40:22.320483 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aeba3be9-d1de-428d-b2c1-b751c25bc20f tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:22.320974 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aeba3be9-d1de-428d-b2c1-b751c25bc20f tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:22.321421 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aeba3be9-d1de-428d-b2c1-b751c25bc20f tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:22.322781 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aeba3be9-d1de-428d-b2c1-b751c25bc20f tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:22.323241 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aeba3be9-d1de-428d-b2c1-b751c25bc20f tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:22.323669 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aeba3be9-d1de-428d-b2c1-b751c25bc20f tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:22.341556 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-aeba3be9-d1de-428d-b2c1-b751c25bc20f tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Getting quotas for project 05672dc7b53747988fde6abc4adb2ef1. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:40:22.347239 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-aeba3be9-d1de-428d-b2c1-b751c25bc20f tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Getting quotas for user eba500c7bb654a649a57bb8c96aa8bf0 and project 05672dc7b53747988fde6abc4adb2ef1. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:40:22.349270 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c9b0b14a-b2a6-4601-81af-2c22c5ee3b6d tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:22.349769 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:40:22.357293 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c9b0b14a-b2a6-4601-81af-2c22c5ee3b6d tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d" status: 200 len: 1508 microversion: 2.1 time: 0.153589 Oct 27 03:40:22.357964 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2153/4572] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:22 2022] GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:40:22.360668 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-aeba3be9-d1de-428d-b2c1-b751c25bc20f tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Going to run 2 instances... {{(pid=121001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:40:22.363260 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-aeba3be9-d1de-428d-b2c1-b751c25bc20f tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] [instance: 6d2f30ee-6086-48e1-8701-a8270012be0c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:40:22.516256 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-aeba3be9-d1de-428d-b2c1-b751c25bc20f tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] [instance: 621fa99f-f6ef-4333-9e54-1820cb63e2ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=6d2f30ee-6086-48e1-8701-a8270012be0c,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:40:22.619726 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-aeba3be9-d1de-428d-b2c1-b751c25bc20f tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.773388 Oct 27 03:40:22.620678 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2420/4573] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:40:21 2022] POST /compute/v2.1/servers => generated 32 bytes in 775 msecs (HTTP/1.1 202) 9 headers in 362 bytes (2 switches on core 0) Oct 27 03:40:22.632521 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4e4b58eb-e924-42eb-a64d-87b0e11b6f1d tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:22.645028 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4e4b58eb-e924-42eb-a64d-87b0e11b6f1d tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'eba500c7bb654a649a57bb8c96aa8bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05672dc7b53747988fde6abc4adb2ef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:22.645905 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4e4b58eb-e924-42eb-a64d-87b0e11b6f1d tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Searching by: {'deleted': False, 'project_id': '05672dc7b53747988fde6abc4adb2ef1'} {{(pid=121000) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 03:40:22.671112 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4e4b58eb-e924-42eb-a64d-87b0e11b6f1d tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:22.671714 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4e4b58eb-e924-42eb-a64d-87b0e11b6f1d tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:22.672303 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4e4b58eb-e924-42eb-a64d-87b0e11b6f1d tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:22.673497 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4e4b58eb-e924-42eb-a64d-87b0e11b6f1d tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:22.674221 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4e4b58eb-e924-42eb-a64d-87b0e11b6f1d tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:22.674648 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4e4b58eb-e924-42eb-a64d-87b0e11b6f1d tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:22.707189 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.multi_cell_list [None req-4e4b58eb-e924-42eb-a64d-87b0e11b6f1d tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=121000) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 03:40:22.746294 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4e4b58eb-e924-42eb-a64d-87b0e11b6f1d tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 1333 microversion: 2.1 time: 0.121566 Oct 27 03:40:22.747578 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2154/4574] 10.222.0.20 () {58 vars in 1125 bytes} [Thu Oct 27 03:40:22 2022] GET /compute/v2.1/servers => generated 1333 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:40:22.760272 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-252904b7-fc54-4c65-bf2d-631374412c40 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:22.760911 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-252904b7-fc54-4c65-bf2d-631374412c40 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] [instance: 621fa99f-f6ef-4333-9e54-1820cb63e2ee] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:22.828387 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-252904b7-fc54-4c65-bf2d-631374412c40 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba500c7bb654a649a57bb8c96aa8bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05672dc7b53747988fde6abc4adb2ef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:22.839702 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-252904b7-fc54-4c65-bf2d-631374412c40 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] 10.222.0.20 "GET /compute/v2.1/servers/621fa99f-f6ef-4333-9e54-1820cb63e2ee" status: 200 len: 1217 microversion: 2.1 time: 0.083377 Oct 27 03:40:22.847098 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2421/4575] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:22 2022] GET /compute/v2.1/servers/621fa99f-f6ef-4333-9e54-1820cb63e2ee => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:40:23.052930 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-856df61e-5a3c-4e13-a900-b6cf78f67dd8 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:23.053793 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-856df61e-5a3c-4e13-a900-b6cf78f67dd8 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] [instance: cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:23.060925 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-856df61e-5a3c-4e13-a900-b6cf78f67dd8 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:23.061621 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-856df61e-5a3c-4e13-a900-b6cf78f67dd8 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:23.062194 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-856df61e-5a3c-4e13-a900-b6cf78f67dd8 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:23.062976 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-856df61e-5a3c-4e13-a900-b6cf78f67dd8 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:23.063532 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-856df61e-5a3c-4e13-a900-b6cf78f67dd8 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:23.064138 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-856df61e-5a3c-4e13-a900-b6cf78f67dd8 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:23.098865 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ee5540c7-4322-4785-855e-2de6d137233a tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:23.101265 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ee5540c7-4322-4785-855e-2de6d137233a tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: 611195a7-9a81-43eb-9d7d-6c29d80f5933] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:23.110057 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ee5540c7-4322-4785-855e-2de6d137233a tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:23.110652 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ee5540c7-4322-4785-855e-2de6d137233a tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:23.111155 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ee5540c7-4322-4785-855e-2de6d137233a tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:23.112051 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ee5540c7-4322-4785-855e-2de6d137233a tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:23.112510 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ee5540c7-4322-4785-855e-2de6d137233a tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:23.113100 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ee5540c7-4322-4785-855e-2de6d137233a tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:23.141531 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-856df61e-5a3c-4e13-a900-b6cf78f67dd8 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:23.145265 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ee5540c7-4322-4785-855e-2de6d137233a tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/611195a7-9a81-43eb-9d7d-6c29d80f5933/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050338 Oct 27 03:40:23.146059 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2422/4576] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 27 03:40:23 2022] GET /compute/v2.1/servers/611195a7-9a81-43eb-9d7d-6c29d80f5933/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:40:23.153500 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-856df61e-5a3c-4e13-a900-b6cf78f67dd8 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:23.155153 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-856df61e-5a3c-4e13-a900-b6cf78f67dd8 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:23.156358 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-856df61e-5a3c-4e13-a900-b6cf78f67dd8 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29" status: 200 len: 1366 microversion: 2.57 time: 0.107589 Oct 27 03:40:23.156919 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2155/4577] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:40:23 2022] GET /compute/v2.1/servers/cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29 => generated 1366 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:40:23.383603 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-62e4374e-046d-433a-8e6d-84d49cf140b9 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:23.384303 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-62e4374e-046d-433a-8e6d-84d49cf140b9 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 9fa9583d-e294-4e5f-a6dc-a51d619dc03d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:23.390646 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-62e4374e-046d-433a-8e6d-84d49cf140b9 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:23.391145 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-62e4374e-046d-433a-8e6d-84d49cf140b9 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:23.391592 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-62e4374e-046d-433a-8e6d-84d49cf140b9 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:23.392354 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-62e4374e-046d-433a-8e6d-84d49cf140b9 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:23.392850 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-62e4374e-046d-433a-8e6d-84d49cf140b9 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:23.393287 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-62e4374e-046d-433a-8e6d-84d49cf140b9 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:23.413996 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:40:23.534013 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-62e4374e-046d-433a-8e6d-84d49cf140b9 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:23.542971 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-62e4374e-046d-433a-8e6d-84d49cf140b9 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d" status: 200 len: 1508 microversion: 2.1 time: 0.163126 Oct 27 03:40:23.543922 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2423/4578] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:23 2022] GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d => generated 1508 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:40:23.863808 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-bb512dc5-fa5b-4ce1-9e47-6fd5c70c7f23 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:23.864430 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-bb512dc5-fa5b-4ce1-9e47-6fd5c70c7f23 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] [instance: 621fa99f-f6ef-4333-9e54-1820cb63e2ee] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:23.918373 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-bb512dc5-fa5b-4ce1-9e47-6fd5c70c7f23 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba500c7bb654a649a57bb8c96aa8bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05672dc7b53747988fde6abc4adb2ef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:23.925638 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-bb512dc5-fa5b-4ce1-9e47-6fd5c70c7f23 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] 10.222.0.20 "GET /compute/v2.1/servers/621fa99f-f6ef-4333-9e54-1820cb63e2ee" status: 200 len: 1217 microversion: 2.1 time: 0.065680 Oct 27 03:40:23.926246 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2156/4579] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:23 2022] GET /compute/v2.1/servers/621fa99f-f6ef-4333-9e54-1820cb63e2ee => generated 1217 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:40:24.159784 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8cbe681a-61eb-4a20-9f76-d41c9158b5c4 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:24.162522 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8cbe681a-61eb-4a20-9f76-d41c9158b5c4 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: 611195a7-9a81-43eb-9d7d-6c29d80f5933] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:24.171268 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8cbe681a-61eb-4a20-9f76-d41c9158b5c4 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:24.176432 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8cbe681a-61eb-4a20-9f76-d41c9158b5c4 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:24.176432 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8cbe681a-61eb-4a20-9f76-d41c9158b5c4 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:24.176432 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8cbe681a-61eb-4a20-9f76-d41c9158b5c4 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:24.176432 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8cbe681a-61eb-4a20-9f76-d41c9158b5c4 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:24.176432 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8cbe681a-61eb-4a20-9f76-d41c9158b5c4 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:24.189919 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9560d621-ade3-4305-b37d-77a135b19684 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:24.190763 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9560d621-ade3-4305-b37d-77a135b19684 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] [instance: cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:24.205038 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9560d621-ade3-4305-b37d-77a135b19684 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:24.207476 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9560d621-ade3-4305-b37d-77a135b19684 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:24.207476 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9560d621-ade3-4305-b37d-77a135b19684 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:24.207896 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9560d621-ade3-4305-b37d-77a135b19684 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:24.208385 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9560d621-ade3-4305-b37d-77a135b19684 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:24.208826 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9560d621-ade3-4305-b37d-77a135b19684 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:24.212903 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8cbe681a-61eb-4a20-9f76-d41c9158b5c4 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/611195a7-9a81-43eb-9d7d-6c29d80f5933/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057938 Oct 27 03:40:24.213639 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2424/4580] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 27 03:40:24 2022] GET /compute/v2.1/servers/611195a7-9a81-43eb-9d7d-6c29d80f5933/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:40:24.213979 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:40:24.299548 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9560d621-ade3-4305-b37d-77a135b19684 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:24.309466 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9560d621-ade3-4305-b37d-77a135b19684 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:24.311245 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9560d621-ade3-4305-b37d-77a135b19684 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:24.312729 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9560d621-ade3-4305-b37d-77a135b19684 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29" status: 200 len: 1366 microversion: 2.57 time: 0.131745 Oct 27 03:40:24.313420 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2157/4581] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:40:24 2022] GET /compute/v2.1/servers/cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29 => generated 1366 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:40:24.576824 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3d030b1d-2f38-41e5-ae93-2946dc58ed19 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:24.577682 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3d030b1d-2f38-41e5-ae93-2946dc58ed19 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 9fa9583d-e294-4e5f-a6dc-a51d619dc03d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:24.584311 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3d030b1d-2f38-41e5-ae93-2946dc58ed19 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:24.585697 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3d030b1d-2f38-41e5-ae93-2946dc58ed19 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:24.585697 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3d030b1d-2f38-41e5-ae93-2946dc58ed19 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:24.585904 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3d030b1d-2f38-41e5-ae93-2946dc58ed19 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:24.586540 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3d030b1d-2f38-41e5-ae93-2946dc58ed19 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:24.587146 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3d030b1d-2f38-41e5-ae93-2946dc58ed19 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:24.793951 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3d030b1d-2f38-41e5-ae93-2946dc58ed19 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:24.826157 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3d030b1d-2f38-41e5-ae93-2946dc58ed19 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d" status: 200 len: 1508 microversion: 2.1 time: 0.253090 Oct 27 03:40:24.826889 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2425/4582] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:24 2022] GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d => generated 1508 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:40:24.949463 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-359ec1b2-29dd-40f1-ba76-26e85e316b01 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:24.951495 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-359ec1b2-29dd-40f1-ba76-26e85e316b01 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] [instance: 621fa99f-f6ef-4333-9e54-1820cb63e2ee] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:24.971852 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-359ec1b2-29dd-40f1-ba76-26e85e316b01 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:24.973509 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-359ec1b2-29dd-40f1-ba76-26e85e316b01 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:24.974724 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-359ec1b2-29dd-40f1-ba76-26e85e316b01 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:24.975623 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-359ec1b2-29dd-40f1-ba76-26e85e316b01 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:24.976252 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-359ec1b2-29dd-40f1-ba76-26e85e316b01 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:24.976760 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-359ec1b2-29dd-40f1-ba76-26e85e316b01 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:25.094661 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-359ec1b2-29dd-40f1-ba76-26e85e316b01 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba500c7bb654a649a57bb8c96aa8bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05672dc7b53747988fde6abc4adb2ef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:25.100145 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-8e635e0b-42e2-4844-a606-55df2709ac93 req-635a5653-04a4-4a1f-9c77-0af9d264d618 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f3464bb-bbd7-4bb0-9172-afcb04b5360e", "name": "network-vif-deleted", "tag": "bdf21ea9-89d1-47e6-8cb7-dfbbe545ee64"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:40:25.132017 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-359ec1b2-29dd-40f1-ba76-26e85e316b01 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] 10.222.0.20 "GET /compute/v2.1/servers/621fa99f-f6ef-4333-9e54-1820cb63e2ee" status: 200 len: 1213 microversion: 2.1 time: 0.180962 Oct 27 03:40:25.132689 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2158/4583] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:24 2022] GET /compute/v2.1/servers/621fa99f-f6ef-4333-9e54-1820cb63e2ee => generated 1213 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:40:25.142654 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-8e635e0b-42e2-4844-a606-55df2709ac93 req-635a5653-04a4-4a1f-9c77-0af9d264d618 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:25.148147 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-8e635e0b-42e2-4844-a606-55df2709ac93 req-635a5653-04a4-4a1f-9c77-0af9d264d618 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:25.150878 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-8e635e0b-42e2-4844-a606-55df2709ac93 req-635a5653-04a4-4a1f-9c77-0af9d264d618 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:25.186998 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-8e635e0b-42e2-4844-a606-55df2709ac93 req-635a5653-04a4-4a1f-9c77-0af9d264d618 service nova] Creating event network-vif-deleted:bdf21ea9-89d1-47e6-8cb7-dfbbe545ee64 for instance 4f3464bb-bbd7-4bb0-9172-afcb04b5360e on n-h1-862769-1 Oct 27 03:40:25.209192 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-8e635e0b-42e2-4844-a606-55df2709ac93 req-635a5653-04a4-4a1f-9c77-0af9d264d618 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122493 Oct 27 03:40:25.210301 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2426/4584] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:40:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:40:25.226158 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b1778270-1126-43f5-a7d7-34fb8ab5550a tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:25.229204 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b1778270-1126-43f5-a7d7-34fb8ab5550a tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: 611195a7-9a81-43eb-9d7d-6c29d80f5933] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:25.236686 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b1778270-1126-43f5-a7d7-34fb8ab5550a tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:25.237661 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b1778270-1126-43f5-a7d7-34fb8ab5550a tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:25.238331 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b1778270-1126-43f5-a7d7-34fb8ab5550a tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:25.240047 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b1778270-1126-43f5-a7d7-34fb8ab5550a tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:25.240893 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b1778270-1126-43f5-a7d7-34fb8ab5550a tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:25.241581 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b1778270-1126-43f5-a7d7-34fb8ab5550a tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:25.279764 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b1778270-1126-43f5-a7d7-34fb8ab5550a tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/611195a7-9a81-43eb-9d7d-6c29d80f5933/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058187 Oct 27 03:40:25.280955 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2159/4585] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 27 03:40:25 2022] GET /compute/v2.1/servers/611195a7-9a81-43eb-9d7d-6c29d80f5933/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:40:25.341439 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6ce76c63-7763-43b5-8e65-c1f018d1bc74 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:25.342337 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-6ce76c63-7763-43b5-8e65-c1f018d1bc74 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] [instance: cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:25.349369 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6ce76c63-7763-43b5-8e65-c1f018d1bc74 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:25.349877 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6ce76c63-7763-43b5-8e65-c1f018d1bc74 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:25.350363 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6ce76c63-7763-43b5-8e65-c1f018d1bc74 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:25.351259 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6ce76c63-7763-43b5-8e65-c1f018d1bc74 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:25.351742 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6ce76c63-7763-43b5-8e65-c1f018d1bc74 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:25.352172 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6ce76c63-7763-43b5-8e65-c1f018d1bc74 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:25.449282 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6ce76c63-7763-43b5-8e65-c1f018d1bc74 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:25.458388 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6ce76c63-7763-43b5-8e65-c1f018d1bc74 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:25.459842 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6ce76c63-7763-43b5-8e65-c1f018d1bc74 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:25.461341 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6ce76c63-7763-43b5-8e65-c1f018d1bc74 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29" status: 200 len: 1366 microversion: 2.57 time: 0.124912 Oct 27 03:40:25.461912 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2427/4586] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:40:25 2022] GET /compute/v2.1/servers/cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29 => generated 1366 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:40:25.854941 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0a381058-2be1-48bb-8caf-b32cddfccb33 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:25.855430 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0a381058-2be1-48bb-8caf-b32cddfccb33 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 9fa9583d-e294-4e5f-a6dc-a51d619dc03d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:25.862383 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0a381058-2be1-48bb-8caf-b32cddfccb33 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:25.862939 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0a381058-2be1-48bb-8caf-b32cddfccb33 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:25.863454 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0a381058-2be1-48bb-8caf-b32cddfccb33 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:25.864365 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0a381058-2be1-48bb-8caf-b32cddfccb33 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:25.864964 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0a381058-2be1-48bb-8caf-b32cddfccb33 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:25.865458 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0a381058-2be1-48bb-8caf-b32cddfccb33 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:26.045773 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0a381058-2be1-48bb-8caf-b32cddfccb33 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:26.058284 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0a381058-2be1-48bb-8caf-b32cddfccb33 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d" status: 200 len: 1508 microversion: 2.1 time: 0.211089 Oct 27 03:40:26.060382 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2160/4587] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:25 2022] GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d => generated 1508 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:40:26.164683 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-51ba6596-ba41-4d9f-ab11-2b8f7a568ac4 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:26.169131 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-51ba6596-ba41-4d9f-ab11-2b8f7a568ac4 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] [instance: 621fa99f-f6ef-4333-9e54-1820cb63e2ee] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:26.175623 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-51ba6596-ba41-4d9f-ab11-2b8f7a568ac4 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:26.176116 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-51ba6596-ba41-4d9f-ab11-2b8f7a568ac4 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:26.176564 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-51ba6596-ba41-4d9f-ab11-2b8f7a568ac4 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:26.177319 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-51ba6596-ba41-4d9f-ab11-2b8f7a568ac4 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:26.177782 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-51ba6596-ba41-4d9f-ab11-2b8f7a568ac4 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:26.178227 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-51ba6596-ba41-4d9f-ab11-2b8f7a568ac4 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:26.272907 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-51ba6596-ba41-4d9f-ab11-2b8f7a568ac4 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba500c7bb654a649a57bb8c96aa8bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05672dc7b53747988fde6abc4adb2ef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:26.300016 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d6086584-7ec7-4516-8b5c-df4c0c62b560 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:26.304107 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d6086584-7ec7-4516-8b5c-df4c0c62b560 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: 611195a7-9a81-43eb-9d7d-6c29d80f5933] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:26.305003 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-51ba6596-ba41-4d9f-ab11-2b8f7a568ac4 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] 10.222.0.20 "GET /compute/v2.1/servers/621fa99f-f6ef-4333-9e54-1820cb63e2ee" status: 200 len: 1269 microversion: 2.1 time: 0.145363 Oct 27 03:40:26.306696 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:40:26.307698 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2428/4588] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:26 2022] GET /compute/v2.1/servers/621fa99f-f6ef-4333-9e54-1820cb63e2ee => generated 1269 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:40:26.321769 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d6086584-7ec7-4516-8b5c-df4c0c62b560 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:26.322381 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d6086584-7ec7-4516-8b5c-df4c0c62b560 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:26.329747 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d6086584-7ec7-4516-8b5c-df4c0c62b560 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:26.330896 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d6086584-7ec7-4516-8b5c-df4c0c62b560 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:26.331524 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d6086584-7ec7-4516-8b5c-df4c0c62b560 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:26.332105 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d6086584-7ec7-4516-8b5c-df4c0c62b560 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:26.385448 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d6086584-7ec7-4516-8b5c-df4c0c62b560 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/611195a7-9a81-43eb-9d7d-6c29d80f5933/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091487 Oct 27 03:40:26.385448 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2161/4589] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 27 03:40:26 2022] GET /compute/v2.1/servers/611195a7-9a81-43eb-9d7d-6c29d80f5933/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:40:26.489932 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1424d4e3-e7b1-43f8-a750-6cc02105590a tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:26.491064 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1424d4e3-e7b1-43f8-a750-6cc02105590a tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] [instance: cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:26.509426 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1424d4e3-e7b1-43f8-a750-6cc02105590a tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:26.510821 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1424d4e3-e7b1-43f8-a750-6cc02105590a tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:26.514859 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1424d4e3-e7b1-43f8-a750-6cc02105590a tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:26.515993 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1424d4e3-e7b1-43f8-a750-6cc02105590a tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:26.517125 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1424d4e3-e7b1-43f8-a750-6cc02105590a tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:26.518968 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1424d4e3-e7b1-43f8-a750-6cc02105590a tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:26.670816 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1424d4e3-e7b1-43f8-a750-6cc02105590a tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:26.707824 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1424d4e3-e7b1-43f8-a750-6cc02105590a tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:26.715412 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1424d4e3-e7b1-43f8-a750-6cc02105590a tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:26.715412 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1424d4e3-e7b1-43f8-a750-6cc02105590a tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29" status: 200 len: 1366 microversion: 2.57 time: 0.226440 Oct 27 03:40:26.715412 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2429/4590] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:40:26 2022] GET /compute/v2.1/servers/cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29 => generated 1366 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:40:27.099419 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3b120af5-f9ba-4274-a2c5-ffe55b960711 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:27.100080 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3b120af5-f9ba-4274-a2c5-ffe55b960711 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 9fa9583d-e294-4e5f-a6dc-a51d619dc03d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:27.118345 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3b120af5-f9ba-4274-a2c5-ffe55b960711 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:27.121282 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3b120af5-f9ba-4274-a2c5-ffe55b960711 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:27.121508 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3b120af5-f9ba-4274-a2c5-ffe55b960711 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:27.122287 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3b120af5-f9ba-4274-a2c5-ffe55b960711 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:27.124004 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3b120af5-f9ba-4274-a2c5-ffe55b960711 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:27.124413 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3b120af5-f9ba-4274-a2c5-ffe55b960711 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:27.214276 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-967611a7-cdaf-4ed2-a292-a5d3b24c3d68 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:27.217159 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-967611a7-cdaf-4ed2-a292-a5d3b24c3d68 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] [instance: 8c8a2cbb-4acf-4a6b-b684-567617bb930d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:27.230478 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-967611a7-cdaf-4ed2-a292-a5d3b24c3d68 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:27.231236 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-967611a7-cdaf-4ed2-a292-a5d3b24c3d68 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:27.231915 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-967611a7-cdaf-4ed2-a292-a5d3b24c3d68 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:27.232814 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-967611a7-cdaf-4ed2-a292-a5d3b24c3d68 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:27.233431 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-967611a7-cdaf-4ed2-a292-a5d3b24c3d68 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:27.234025 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-967611a7-cdaf-4ed2-a292-a5d3b24c3d68 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:27.288577 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-967611a7-cdaf-4ed2-a292-a5d3b24c3d68 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] [instance: 8c8a2cbb-4acf-4a6b-b684-567617bb930d] Going to try to terminate instance {{(pid=121000) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:40:27.319927 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3b120af5-f9ba-4274-a2c5-ffe55b960711 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:27.329142 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3b120af5-f9ba-4274-a2c5-ffe55b960711 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d" status: 200 len: 1508 microversion: 2.1 time: 0.249673 Oct 27 03:40:27.330124 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2430/4591] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:27 2022] GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d => generated 1508 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:40:27.339548 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-0d1cca02-9056-4ba1-bef3-76663ba3fd2e req-0978039e-0292-427d-a5c4-46db9736b34d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e22e79e-fe50-4837-b052-2a38c966cca6", "name": "network-vif-deleted", "tag": "bf5a0d05-cccf-4b93-b265-a5d9ad9f3738"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:40:27.350271 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-0d1cca02-9056-4ba1-bef3-76663ba3fd2e req-0978039e-0292-427d-a5c4-46db9736b34d service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:27.351033 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-0d1cca02-9056-4ba1-bef3-76663ba3fd2e req-0978039e-0292-427d-a5c4-46db9736b34d service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:27.351791 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-0d1cca02-9056-4ba1-bef3-76663ba3fd2e req-0978039e-0292-427d-a5c4-46db9736b34d service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:27.371945 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-0d1cca02-9056-4ba1-bef3-76663ba3fd2e req-0978039e-0292-427d-a5c4-46db9736b34d service nova] Creating event network-vif-deleted:bf5a0d05-cccf-4b93-b265-a5d9ad9f3738 for instance 9e22e79e-fe50-4837-b052-2a38c966cca6 on n-h1-862769-1 Oct 27 03:40:27.382271 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-0d1cca02-9056-4ba1-bef3-76663ba3fd2e req-0978039e-0292-427d-a5c4-46db9736b34d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041699 Oct 27 03:40:27.383523 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2431/4592] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:40:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:40:27.390989 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2e51534b-47fa-4253-9c61-a53729c1b7fa tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:40:27.400033 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2e51534b-47fa-4253-9c61-a53729c1b7fa tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:27.400753 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2e51534b-47fa-4253-9c61-a53729c1b7fa tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:27.401373 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2e51534b-47fa-4253-9c61-a53729c1b7fa tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:27.432766 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2e51534b-47fa-4253-9c61-a53729c1b7fa tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b] Going to try to stop instance {{(pid=121001) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 27 03:40:27.687349 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-967611a7-cdaf-4ed2-a292-a5d3b24c3d68 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d" status: 204 len: 0 microversion: 2.42 time: 0.755653 Oct 27 03:40:27.687943 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2162/4593] 10.222.0.20 () {60 vars in 1280 bytes} [Thu Oct 27 03:40:26 2022] DELETE /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d => generated 0 bytes in 758 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 03:40:27.698979 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7b44d2a2-c669-4be5-ace9-bd4a88e7dc09 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:27.698979 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7b44d2a2-c669-4be5-ace9-bd4a88e7dc09 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] [instance: 621fa99f-f6ef-4333-9e54-1820cb63e2ee] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:27.701577 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7b44d2a2-c669-4be5-ace9-bd4a88e7dc09 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:27.702131 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7b44d2a2-c669-4be5-ace9-bd4a88e7dc09 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:27.702568 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7b44d2a2-c669-4be5-ace9-bd4a88e7dc09 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:27.703343 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7b44d2a2-c669-4be5-ace9-bd4a88e7dc09 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:27.703800 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7b44d2a2-c669-4be5-ace9-bd4a88e7dc09 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:27.704340 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7b44d2a2-c669-4be5-ace9-bd4a88e7dc09 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:27.809215 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2e51534b-47fa-4253-9c61-a53729c1b7fa tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "POST /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b/action" status: 202 len: 0 microversion: 2.1 time: 0.422665 Oct 27 03:40:27.811613 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2432/4594] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:40:27 2022] POST /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b/action => generated 0 bytes in 425 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:40:27.816668 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ed196ac6-b610-4c04-b5df-8c3372cd880d tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:27.819508 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ed196ac6-b610-4c04-b5df-8c3372cd880d tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: 611195a7-9a81-43eb-9d7d-6c29d80f5933] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:27.826677 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ed196ac6-b610-4c04-b5df-8c3372cd880d tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:27.827538 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ed196ac6-b610-4c04-b5df-8c3372cd880d tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:27.833081 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ed196ac6-b610-4c04-b5df-8c3372cd880d tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:27.833081 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ed196ac6-b610-4c04-b5df-8c3372cd880d tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:27.833081 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ed196ac6-b610-4c04-b5df-8c3372cd880d tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:27.833081 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ed196ac6-b610-4c04-b5df-8c3372cd880d tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:27.864064 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ed196ac6-b610-4c04-b5df-8c3372cd880d tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/611195a7-9a81-43eb-9d7d-6c29d80f5933/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052382 Oct 27 03:40:27.865041 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2433/4595] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 27 03:40:27 2022] GET /compute/v2.1/servers/611195a7-9a81-43eb-9d7d-6c29d80f5933/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:40:27.874099 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6b05fdfd-944a-4812-8315-ac6b50f7aeec tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:27.874828 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-6b05fdfd-944a-4812-8315-ac6b50f7aeec tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] [instance: 8c8a2cbb-4acf-4a6b-b684-567617bb930d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:27.881557 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6b05fdfd-944a-4812-8315-ac6b50f7aeec tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:27.887280 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6b05fdfd-944a-4812-8315-ac6b50f7aeec tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:27.887280 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6b05fdfd-944a-4812-8315-ac6b50f7aeec tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:27.887280 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6b05fdfd-944a-4812-8315-ac6b50f7aeec tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:27.887280 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6b05fdfd-944a-4812-8315-ac6b50f7aeec tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:27.887280 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6b05fdfd-944a-4812-8315-ac6b50f7aeec tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:27.951361 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7b44d2a2-c669-4be5-ace9-bd4a88e7dc09 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba500c7bb654a649a57bb8c96aa8bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05672dc7b53747988fde6abc4adb2ef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:27.960211 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7b44d2a2-c669-4be5-ace9-bd4a88e7dc09 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] 10.222.0.20 "GET /compute/v2.1/servers/621fa99f-f6ef-4333-9e54-1820cb63e2ee" status: 200 len: 1317 microversion: 2.1 time: 0.270339 Oct 27 03:40:27.961197 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2163/4596] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:27 2022] GET /compute/v2.1/servers/621fa99f-f6ef-4333-9e54-1820cb63e2ee => generated 1317 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:40:27.966978 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c571b207-1084-4b7c-b32a-4195cb6ddd03 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:27.968539 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c571b207-1084-4b7c-b32a-4195cb6ddd03 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] [instance: cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:27.975278 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c571b207-1084-4b7c-b32a-4195cb6ddd03 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:27.976036 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c571b207-1084-4b7c-b32a-4195cb6ddd03 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:27.976678 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c571b207-1084-4b7c-b32a-4195cb6ddd03 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:27.978503 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c571b207-1084-4b7c-b32a-4195cb6ddd03 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:27.979179 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c571b207-1084-4b7c-b32a-4195cb6ddd03 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:27.979826 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c571b207-1084-4b7c-b32a-4195cb6ddd03 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:28.062826 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c571b207-1084-4b7c-b32a-4195cb6ddd03 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:28.073243 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c571b207-1084-4b7c-b32a-4195cb6ddd03 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:28.075390 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c571b207-1084-4b7c-b32a-4195cb6ddd03 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:28.076601 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c571b207-1084-4b7c-b32a-4195cb6ddd03 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29" status: 200 len: 1366 microversion: 2.57 time: 0.113578 Oct 27 03:40:28.091213 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2164/4597] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:40:27 2022] GET /compute/v2.1/servers/cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29 => generated 1366 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:40:28.102411 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-830c0e8a-e2ac-4303-811c-f7c5ba831d6b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:28.103921 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-830c0e8a-e2ac-4303-811c-f7c5ba831d6b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:28.109923 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-830c0e8a-e2ac-4303-811c-f7c5ba831d6b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:28.112139 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-830c0e8a-e2ac-4303-811c-f7c5ba831d6b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:28.112139 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-830c0e8a-e2ac-4303-811c-f7c5ba831d6b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:28.112139 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-830c0e8a-e2ac-4303-811c-f7c5ba831d6b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:28.112519 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-830c0e8a-e2ac-4303-811c-f7c5ba831d6b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:28.112886 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-830c0e8a-e2ac-4303-811c-f7c5ba831d6b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:28.140458 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-830c0e8a-e2ac-4303-811c-f7c5ba831d6b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79/ips" status: 200 len: 153 microversion: 2.20 time: 0.048185 Oct 27 03:40:28.141062 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2165/4598] 10.222.0.20 () {60 vars in 1289 bytes} [Thu Oct 27 03:40:28 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79/ips => generated 153 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 03:40:28.146867 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6ee1cdf9-b958-47dd-9919-21d2c8476f2c tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:28.147604 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6ee1cdf9-b958-47dd-9919-21d2c8476f2c tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:28.153665 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6ee1cdf9-b958-47dd-9919-21d2c8476f2c tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:28.158186 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6ee1cdf9-b958-47dd-9919-21d2c8476f2c tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:28.158186 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6ee1cdf9-b958-47dd-9919-21d2c8476f2c tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:28.158186 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6ee1cdf9-b958-47dd-9919-21d2c8476f2c tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:28.158186 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6ee1cdf9-b958-47dd-9919-21d2c8476f2c tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:28.158186 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6ee1cdf9-b958-47dd-9919-21d2c8476f2c tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:28.200692 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6b05fdfd-944a-4812-8315-ac6b50f7aeec tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:28.219845 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6b05fdfd-944a-4812-8315-ac6b50f7aeec tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:28.221307 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6b05fdfd-944a-4812-8315-ac6b50f7aeec tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:28.222801 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6b05fdfd-944a-4812-8315-ac6b50f7aeec tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d" status: 200 len: 2961 microversion: 2.42 time: 0.352651 Oct 27 03:40:28.223544 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2434/4599] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:40:27 2022] GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d => generated 2961 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:40:28.348127 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-5a925dbf-02e1-4852-9d66-3501d0dec0c6 req-db394f7f-d039-471f-bbc5-0d74e86fc85c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d2f30ee-6086-48e1-8701-a8270012be0c", "tag": "2ea0c596-e9c9-43f8-bafe-b6f0a944e46e"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:40:28.358357 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-5a925dbf-02e1-4852-9d66-3501d0dec0c6 req-db394f7f-d039-471f-bbc5-0d74e86fc85c service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:28.358833 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-5a925dbf-02e1-4852-9d66-3501d0dec0c6 req-db394f7f-d039-471f-bbc5-0d74e86fc85c service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:28.359268 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-5a925dbf-02e1-4852-9d66-3501d0dec0c6 req-db394f7f-d039-471f-bbc5-0d74e86fc85c service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:28.371858 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-5a925dbf-02e1-4852-9d66-3501d0dec0c6 req-db394f7f-d039-471f-bbc5-0d74e86fc85c service nova] Creating event network-changed:2ea0c596-e9c9-43f8-bafe-b6f0a944e46e for instance 6d2f30ee-6086-48e1-8701-a8270012be0c on n-h2-862769-1 Oct 27 03:40:28.377194 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-5a925dbf-02e1-4852-9d66-3501d0dec0c6 req-db394f7f-d039-471f-bbc5-0d74e86fc85c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034622 Oct 27 03:40:28.378385 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2435/4600] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:40:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:40:28.384684 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-23977dc3-0827-4c06-bd55-9130d7e1f4af tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:28.385569 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-23977dc3-0827-4c06-bd55-9130d7e1f4af tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 9fa9583d-e294-4e5f-a6dc-a51d619dc03d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:28.386773 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-6ee1cdf9-b958-47dd-9919-21d2c8476f2c tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffc2b1c410149e884a47240b5425e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38450368ef5c4e68ac3c19c7a0a1ce65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:28.393628 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-23977dc3-0827-4c06-bd55-9130d7e1f4af tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:28.394145 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-23977dc3-0827-4c06-bd55-9130d7e1f4af tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:28.399325 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-23977dc3-0827-4c06-bd55-9130d7e1f4af tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:28.399493 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6ee1cdf9-b958-47dd-9919-21d2c8476f2c tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b" status: 200 len: 1725 microversion: 2.1 time: 0.253144 Oct 27 03:40:28.399577 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-23977dc3-0827-4c06-bd55-9130d7e1f4af tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:28.399577 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-23977dc3-0827-4c06-bd55-9130d7e1f4af tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:28.399705 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2166/4601] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:28 2022] GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b => generated 1725 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:40:28.399796 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-23977dc3-0827-4c06-bd55-9130d7e1f4af tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:28.529932 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-23977dc3-0827-4c06-bd55-9130d7e1f4af tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:28.537954 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-23977dc3-0827-4c06-bd55-9130d7e1f4af tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d" status: 200 len: 1508 microversion: 2.1 time: 0.158386 Oct 27 03:40:28.538576 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2436/4602] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:28 2022] GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:40:28.876825 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4d858385-1142-46b8-9296-8a99395b0803 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:28.879282 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4d858385-1142-46b8-9296-8a99395b0803 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: 611195a7-9a81-43eb-9d7d-6c29d80f5933] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:28.885676 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4d858385-1142-46b8-9296-8a99395b0803 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:28.886301 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4d858385-1142-46b8-9296-8a99395b0803 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:28.886733 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4d858385-1142-46b8-9296-8a99395b0803 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:28.887472 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4d858385-1142-46b8-9296-8a99395b0803 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:28.887928 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4d858385-1142-46b8-9296-8a99395b0803 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:28.888359 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4d858385-1142-46b8-9296-8a99395b0803 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:28.921301 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4d858385-1142-46b8-9296-8a99395b0803 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/611195a7-9a81-43eb-9d7d-6c29d80f5933/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048433 Oct 27 03:40:28.921880 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2167/4603] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 27 03:40:28 2022] GET /compute/v2.1/servers/611195a7-9a81-43eb-9d7d-6c29d80f5933/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:40:28.985122 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-90781391-a734-444f-a7a0-d572a14d2516 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:28.985804 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-90781391-a734-444f-a7a0-d572a14d2516 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] [instance: 621fa99f-f6ef-4333-9e54-1820cb63e2ee] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:28.992263 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-90781391-a734-444f-a7a0-d572a14d2516 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:28.992754 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-90781391-a734-444f-a7a0-d572a14d2516 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:28.993241 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-90781391-a734-444f-a7a0-d572a14d2516 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:28.994059 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-90781391-a734-444f-a7a0-d572a14d2516 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:28.994576 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-90781391-a734-444f-a7a0-d572a14d2516 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:28.995003 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-90781391-a734-444f-a7a0-d572a14d2516 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:29.108018 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0baf52fc-39f2-4fe4-86d9-9edeff5366a5 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:29.108646 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0baf52fc-39f2-4fe4-86d9-9edeff5366a5 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] [instance: cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:29.115487 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0baf52fc-39f2-4fe4-86d9-9edeff5366a5 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:29.115981 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0baf52fc-39f2-4fe4-86d9-9edeff5366a5 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:29.116433 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0baf52fc-39f2-4fe4-86d9-9edeff5366a5 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:29.117816 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0baf52fc-39f2-4fe4-86d9-9edeff5366a5 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:29.118347 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0baf52fc-39f2-4fe4-86d9-9edeff5366a5 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:29.119024 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0baf52fc-39f2-4fe4-86d9-9edeff5366a5 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:29.128700 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-90781391-a734-444f-a7a0-d572a14d2516 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba500c7bb654a649a57bb8c96aa8bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05672dc7b53747988fde6abc4adb2ef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:29.136696 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-90781391-a734-444f-a7a0-d572a14d2516 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] 10.222.0.20 "GET /compute/v2.1/servers/621fa99f-f6ef-4333-9e54-1820cb63e2ee" status: 200 len: 1317 microversion: 2.1 time: 0.155657 Oct 27 03:40:29.137271 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2437/4604] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:28 2022] GET /compute/v2.1/servers/621fa99f-f6ef-4333-9e54-1820cb63e2ee => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:40:29.187313 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0baf52fc-39f2-4fe4-86d9-9edeff5366a5 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:29.197562 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0baf52fc-39f2-4fe4-86d9-9edeff5366a5 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:29.199051 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0baf52fc-39f2-4fe4-86d9-9edeff5366a5 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:29.200257 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0baf52fc-39f2-4fe4-86d9-9edeff5366a5 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29" status: 200 len: 1366 microversion: 2.57 time: 0.096369 Oct 27 03:40:29.200815 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2168/4605] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:40:29 2022] GET /compute/v2.1/servers/cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29 => generated 1366 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:40:29.250824 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-826b4bfa-ff69-4ff7-9f0d-b266882bbe33 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:29.251456 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-826b4bfa-ff69-4ff7-9f0d-b266882bbe33 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] [instance: 8c8a2cbb-4acf-4a6b-b684-567617bb930d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:29.258350 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-826b4bfa-ff69-4ff7-9f0d-b266882bbe33 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:29.259380 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-826b4bfa-ff69-4ff7-9f0d-b266882bbe33 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:29.259870 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-826b4bfa-ff69-4ff7-9f0d-b266882bbe33 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:29.260565 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-826b4bfa-ff69-4ff7-9f0d-b266882bbe33 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:29.261022 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-826b4bfa-ff69-4ff7-9f0d-b266882bbe33 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:29.261527 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-826b4bfa-ff69-4ff7-9f0d-b266882bbe33 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:29.420947 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e59808fc-fe4b-4cc7-a3c7-111ed56ee5e3 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:29.422390 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e59808fc-fe4b-4cc7-a3c7-111ed56ee5e3 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:29.429562 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e59808fc-fe4b-4cc7-a3c7-111ed56ee5e3 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:29.431067 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e59808fc-fe4b-4cc7-a3c7-111ed56ee5e3 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:29.431242 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e59808fc-fe4b-4cc7-a3c7-111ed56ee5e3 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:29.431993 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e59808fc-fe4b-4cc7-a3c7-111ed56ee5e3 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:29.432491 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e59808fc-fe4b-4cc7-a3c7-111ed56ee5e3 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:29.432937 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e59808fc-fe4b-4cc7-a3c7-111ed56ee5e3 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:29.461157 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-826b4bfa-ff69-4ff7-9f0d-b266882bbe33 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:29.471652 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-826b4bfa-ff69-4ff7-9f0d-b266882bbe33 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:29.474139 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-826b4bfa-ff69-4ff7-9f0d-b266882bbe33 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:29.476833 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-826b4bfa-ff69-4ff7-9f0d-b266882bbe33 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d" status: 200 len: 2961 microversion: 2.42 time: 0.228701 Oct 27 03:40:29.476833 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2438/4606] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:40:29 2022] GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d => generated 2961 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:40:29.496911 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-5fc80bf4-3621-4dd4-96ee-ccca96e77c88 req-b61b70da-8844-4e06-b2f8-ae3ef7570d1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "621fa99f-f6ef-4333-9e54-1820cb63e2ee", "tag": "d51a47e3-8013-48e0-aea2-a32501a5465e"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:40:29.508720 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-5fc80bf4-3621-4dd4-96ee-ccca96e77c88 req-b61b70da-8844-4e06-b2f8-ae3ef7570d1a service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:29.510406 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-5fc80bf4-3621-4dd4-96ee-ccca96e77c88 req-b61b70da-8844-4e06-b2f8-ae3ef7570d1a service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:29.510889 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-5fc80bf4-3621-4dd4-96ee-ccca96e77c88 req-b61b70da-8844-4e06-b2f8-ae3ef7570d1a service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:29.522686 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-5fc80bf4-3621-4dd4-96ee-ccca96e77c88 req-b61b70da-8844-4e06-b2f8-ae3ef7570d1a service nova] Creating event network-changed:d51a47e3-8013-48e0-aea2-a32501a5465e for instance 621fa99f-f6ef-4333-9e54-1820cb63e2ee on n-h2-862769-1 Oct 27 03:40:29.528359 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-5fc80bf4-3621-4dd4-96ee-ccca96e77c88 req-b61b70da-8844-4e06-b2f8-ae3ef7570d1a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036879 Oct 27 03:40:29.532693 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2439/4607] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:40:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:40:29.563170 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1460ba01-1bec-4268-895d-6574f25da06e tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:29.563955 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1460ba01-1bec-4268-895d-6574f25da06e tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 9fa9583d-e294-4e5f-a6dc-a51d619dc03d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:29.570546 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1460ba01-1bec-4268-895d-6574f25da06e tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:29.570721 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1460ba01-1bec-4268-895d-6574f25da06e tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:29.571152 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1460ba01-1bec-4268-895d-6574f25da06e tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:29.571894 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1460ba01-1bec-4268-895d-6574f25da06e tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:29.572356 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1460ba01-1bec-4268-895d-6574f25da06e tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:29.572794 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1460ba01-1bec-4268-895d-6574f25da06e tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:29.587868 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e59808fc-fe4b-4cc7-a3c7-111ed56ee5e3 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffc2b1c410149e884a47240b5425e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38450368ef5c4e68ac3c19c7a0a1ce65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:29.596841 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e59808fc-fe4b-4cc7-a3c7-111ed56ee5e3 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b" status: 200 len: 1725 microversion: 2.1 time: 0.181561 Oct 27 03:40:29.597445 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2169/4608] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:29 2022] GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b => generated 1725 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:40:29.718973 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1460ba01-1bec-4268-895d-6574f25da06e tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:29.730711 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1460ba01-1bec-4268-895d-6574f25da06e tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d" status: 200 len: 1508 microversion: 2.1 time: 0.172277 Oct 27 03:40:29.731977 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2440/4609] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:29 2022] GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d => generated 1508 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:40:29.933703 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ade6a104-2138-4e83-8b89-b0ecbf1820ad tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:29.935817 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ade6a104-2138-4e83-8b89-b0ecbf1820ad tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: 611195a7-9a81-43eb-9d7d-6c29d80f5933] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:29.947241 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ade6a104-2138-4e83-8b89-b0ecbf1820ad tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:29.948041 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ade6a104-2138-4e83-8b89-b0ecbf1820ad tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:29.948495 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ade6a104-2138-4e83-8b89-b0ecbf1820ad tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:29.949222 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ade6a104-2138-4e83-8b89-b0ecbf1820ad tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:29.949690 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ade6a104-2138-4e83-8b89-b0ecbf1820ad tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:29.950224 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ade6a104-2138-4e83-8b89-b0ecbf1820ad tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:29.983769 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ade6a104-2138-4e83-8b89-b0ecbf1820ad tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/611195a7-9a81-43eb-9d7d-6c29d80f5933/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054692 Oct 27 03:40:29.984342 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2170/4610] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 27 03:40:29 2022] GET /compute/v2.1/servers/611195a7-9a81-43eb-9d7d-6c29d80f5933/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 03:40:30.072537 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b706fdaf-1c9f-47ae-86e2-648d0e02f9ff tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:30.073034 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b706fdaf-1c9f-47ae-86e2-648d0e02f9ff tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: 611195a7-9a81-43eb-9d7d-6c29d80f5933] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:30.083257 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b706fdaf-1c9f-47ae-86e2-648d0e02f9ff tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:30.083798 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b706fdaf-1c9f-47ae-86e2-648d0e02f9ff tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:30.084248 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b706fdaf-1c9f-47ae-86e2-648d0e02f9ff tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:30.085481 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b706fdaf-1c9f-47ae-86e2-648d0e02f9ff tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:30.085949 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b706fdaf-1c9f-47ae-86e2-648d0e02f9ff tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:30.086404 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b706fdaf-1c9f-47ae-86e2-648d0e02f9ff tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:30.119774 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b706fdaf-1c9f-47ae-86e2-648d0e02f9ff tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: 611195a7-9a81-43eb-9d7d-6c29d80f5933] Going to try to terminate instance {{(pid=121001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:40:30.124044 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:40:30.164923 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-698eb344-fbc4-49b2-a6f7-9ef038872178 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:30.165616 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-698eb344-fbc4-49b2-a6f7-9ef038872178 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] [instance: 621fa99f-f6ef-4333-9e54-1820cb63e2ee] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:30.182216 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-698eb344-fbc4-49b2-a6f7-9ef038872178 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:30.182816 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-698eb344-fbc4-49b2-a6f7-9ef038872178 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:30.183280 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-698eb344-fbc4-49b2-a6f7-9ef038872178 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:30.184784 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-698eb344-fbc4-49b2-a6f7-9ef038872178 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:30.185218 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-698eb344-fbc4-49b2-a6f7-9ef038872178 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:30.185738 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-698eb344-fbc4-49b2-a6f7-9ef038872178 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:30.521698 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b706fdaf-1c9f-47ae-86e2-648d0e02f9ff tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "DELETE /compute/v2.1/servers/611195a7-9a81-43eb-9d7d-6c29d80f5933" status: 204 len: 0 microversion: 2.1 time: 0.453007 Oct 27 03:40:30.522456 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2441/4611] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:40:30 2022] DELETE /compute/v2.1/servers/611195a7-9a81-43eb-9d7d-6c29d80f5933 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:40:30.528583 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-33b2f3ef-2b6d-4e6c-b311-5fc47c6721bb tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:30.529334 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-33b2f3ef-2b6d-4e6c-b311-5fc47c6721bb tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] [instance: cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:30.537085 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-33b2f3ef-2b6d-4e6c-b311-5fc47c6721bb tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:30.537717 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-33b2f3ef-2b6d-4e6c-b311-5fc47c6721bb tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:30.538220 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-33b2f3ef-2b6d-4e6c-b311-5fc47c6721bb tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:30.538941 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-33b2f3ef-2b6d-4e6c-b311-5fc47c6721bb tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:30.539424 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-33b2f3ef-2b6d-4e6c-b311-5fc47c6721bb tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:30.539855 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-33b2f3ef-2b6d-4e6c-b311-5fc47c6721bb tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:30.548565 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-698eb344-fbc4-49b2-a6f7-9ef038872178 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba500c7bb654a649a57bb8c96aa8bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05672dc7b53747988fde6abc4adb2ef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:30.556412 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-698eb344-fbc4-49b2-a6f7-9ef038872178 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] 10.222.0.20 "GET /compute/v2.1/servers/621fa99f-f6ef-4333-9e54-1820cb63e2ee" status: 200 len: 1317 microversion: 2.1 time: 0.399241 Oct 27 03:40:30.557013 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2171/4612] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:30 2022] GET /compute/v2.1/servers/621fa99f-f6ef-4333-9e54-1820cb63e2ee => generated 1317 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:40:30.562321 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-82beaaa0-cb2a-40d7-90f2-166dc3b4d8fc tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:30.563021 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-82beaaa0-cb2a-40d7-90f2-166dc3b4d8fc tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] [instance: 8c8a2cbb-4acf-4a6b-b684-567617bb930d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:30.570643 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-82beaaa0-cb2a-40d7-90f2-166dc3b4d8fc tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:30.571173 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-82beaaa0-cb2a-40d7-90f2-166dc3b4d8fc tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:30.571881 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-82beaaa0-cb2a-40d7-90f2-166dc3b4d8fc tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:30.572673 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-82beaaa0-cb2a-40d7-90f2-166dc3b4d8fc tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:30.573147 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-82beaaa0-cb2a-40d7-90f2-166dc3b4d8fc tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:30.573630 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-82beaaa0-cb2a-40d7-90f2-166dc3b4d8fc tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:30.594129 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:40:30.610849 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-33b2f3ef-2b6d-4e6c-b311-5fc47c6721bb tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:30.619691 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-33b2f3ef-2b6d-4e6c-b311-5fc47c6721bb tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:30.621206 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-33b2f3ef-2b6d-4e6c-b311-5fc47c6721bb tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:30.622449 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-33b2f3ef-2b6d-4e6c-b311-5fc47c6721bb tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29" status: 200 len: 1366 microversion: 2.57 time: 0.098776 Oct 27 03:40:30.623024 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2442/4613] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:40:30 2022] GET /compute/v2.1/servers/cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29 => generated 1366 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:40:30.627546 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-eb5e77cf-0fb5-4deb-82d2-85a221948ff7 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:30.628159 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-eb5e77cf-0fb5-4deb-82d2-85a221948ff7 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: 611195a7-9a81-43eb-9d7d-6c29d80f5933] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:30.634263 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eb5e77cf-0fb5-4deb-82d2-85a221948ff7 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:30.634889 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eb5e77cf-0fb5-4deb-82d2-85a221948ff7 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:30.635412 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eb5e77cf-0fb5-4deb-82d2-85a221948ff7 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:30.636193 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eb5e77cf-0fb5-4deb-82d2-85a221948ff7 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:30.636840 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eb5e77cf-0fb5-4deb-82d2-85a221948ff7 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:30.637348 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eb5e77cf-0fb5-4deb-82d2-85a221948ff7 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:30.765172 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-82beaaa0-cb2a-40d7-90f2-166dc3b4d8fc tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:30.775226 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-82beaaa0-cb2a-40d7-90f2-166dc3b4d8fc tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:30.776685 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-82beaaa0-cb2a-40d7-90f2-166dc3b4d8fc tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:30.777962 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-82beaaa0-cb2a-40d7-90f2-166dc3b4d8fc tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d" status: 200 len: 2961 microversion: 2.42 time: 0.219593 Oct 27 03:40:30.778567 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2172/4614] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:40:30 2022] GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d => generated 2961 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:40:30.780477 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-eb5e77cf-0fb5-4deb-82d2-85a221948ff7 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18036411a99e4634bfbaeae24b9f254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229dcb63bc41444391544883b576ce2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:30.783346 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-dc9b9edc-8e37-4695-a16a-9389f3ccef9c tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:30.784193 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-dc9b9edc-8e37-4695-a16a-9389f3ccef9c tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:30.791021 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-eb5e77cf-0fb5-4deb-82d2-85a221948ff7 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/611195a7-9a81-43eb-9d7d-6c29d80f5933" status: 200 len: 1679 microversion: 2.1 time: 0.166262 Oct 27 03:40:30.791493 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dc9b9edc-8e37-4695-a16a-9389f3ccef9c tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:30.791993 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dc9b9edc-8e37-4695-a16a-9389f3ccef9c tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:30.792674 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dc9b9edc-8e37-4695-a16a-9389f3ccef9c tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:30.793565 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dc9b9edc-8e37-4695-a16a-9389f3ccef9c tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:30.794062 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dc9b9edc-8e37-4695-a16a-9389f3ccef9c tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:30.794489 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dc9b9edc-8e37-4695-a16a-9389f3ccef9c tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:30.800817 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2443/4615] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:30 2022] GET /compute/v2.1/servers/611195a7-9a81-43eb-9d7d-6c29d80f5933 => generated 1679 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:40:30.805420 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8141ee0e-74b2-4e45-b4b4-a2c13c25eaf9 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:30.806689 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8141ee0e-74b2-4e45-b4b4-a2c13c25eaf9 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 9fa9583d-e294-4e5f-a6dc-a51d619dc03d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:30.812435 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8141ee0e-74b2-4e45-b4b4-a2c13c25eaf9 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:30.812905 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8141ee0e-74b2-4e45-b4b4-a2c13c25eaf9 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:30.813348 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8141ee0e-74b2-4e45-b4b4-a2c13c25eaf9 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:30.814071 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8141ee0e-74b2-4e45-b4b4-a2c13c25eaf9 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:30.814534 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8141ee0e-74b2-4e45-b4b4-a2c13c25eaf9 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:30.814963 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8141ee0e-74b2-4e45-b4b4-a2c13c25eaf9 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:30.936984 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-dc9b9edc-8e37-4695-a16a-9389f3ccef9c tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffc2b1c410149e884a47240b5425e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38450368ef5c4e68ac3c19c7a0a1ce65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:30.947041 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-dc9b9edc-8e37-4695-a16a-9389f3ccef9c tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b" status: 200 len: 1725 microversion: 2.1 time: 0.166939 Oct 27 03:40:30.947763 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2173/4616] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:30 2022] GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:40:30.954731 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8141ee0e-74b2-4e45-b4b4-a2c13c25eaf9 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:30.962507 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8141ee0e-74b2-4e45-b4b4-a2c13c25eaf9 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d" status: 200 len: 1529 microversion: 2.1 time: 0.160633 Oct 27 03:40:30.963272 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2444/4617] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:30 2022] GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d => generated 1529 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:40:31.579735 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-983bb82c-b379-4a64-8d9d-38ac9de69a5d tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:31.580567 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-983bb82c-b379-4a64-8d9d-38ac9de69a5d tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] [instance: 621fa99f-f6ef-4333-9e54-1820cb63e2ee] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:31.587851 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-983bb82c-b379-4a64-8d9d-38ac9de69a5d tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:31.588332 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-983bb82c-b379-4a64-8d9d-38ac9de69a5d tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:31.588768 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-983bb82c-b379-4a64-8d9d-38ac9de69a5d tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:31.589456 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-983bb82c-b379-4a64-8d9d-38ac9de69a5d tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:31.589912 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-983bb82c-b379-4a64-8d9d-38ac9de69a5d tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:31.590431 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-983bb82c-b379-4a64-8d9d-38ac9de69a5d tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:31.649125 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-84d0a263-e67d-4345-840e-a33fc3cfcd82 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:31.651495 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-84d0a263-e67d-4345-840e-a33fc3cfcd82 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] [instance: cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:31.658112 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-84d0a263-e67d-4345-840e-a33fc3cfcd82 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:31.662627 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-84d0a263-e67d-4345-840e-a33fc3cfcd82 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:31.662627 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-84d0a263-e67d-4345-840e-a33fc3cfcd82 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:31.662627 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-84d0a263-e67d-4345-840e-a33fc3cfcd82 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:31.662627 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-84d0a263-e67d-4345-840e-a33fc3cfcd82 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:31.662627 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-84d0a263-e67d-4345-840e-a33fc3cfcd82 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:31.727366 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-983bb82c-b379-4a64-8d9d-38ac9de69a5d tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba500c7bb654a649a57bb8c96aa8bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05672dc7b53747988fde6abc4adb2ef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:31.728689 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-84d0a263-e67d-4345-840e-a33fc3cfcd82 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:31.737712 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-84d0a263-e67d-4345-840e-a33fc3cfcd82 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:31.739214 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-84d0a263-e67d-4345-840e-a33fc3cfcd82 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:31.740703 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-84d0a263-e67d-4345-840e-a33fc3cfcd82 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29" status: 200 len: 1366 microversion: 2.57 time: 0.095762 Oct 27 03:40:31.741828 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2445/4618] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:40:31 2022] GET /compute/v2.1/servers/cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29 => generated 1366 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:40:31.743218 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-983bb82c-b379-4a64-8d9d-38ac9de69a5d tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] 10.222.0.20 "GET /compute/v2.1/servers/621fa99f-f6ef-4333-9e54-1820cb63e2ee" status: 200 len: 1317 microversion: 2.1 time: 0.167200 Oct 27 03:40:31.744431 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2174/4619] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:31 2022] GET /compute/v2.1/servers/621fa99f-f6ef-4333-9e54-1820cb63e2ee => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:40:31.806485 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d1174a64-4a2e-4172-884c-c54a0f4e4f8c tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:31.807118 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d1174a64-4a2e-4172-884c-c54a0f4e4f8c tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] [instance: 8c8a2cbb-4acf-4a6b-b684-567617bb930d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:31.813437 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d1174a64-4a2e-4172-884c-c54a0f4e4f8c tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:31.813928 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d1174a64-4a2e-4172-884c-c54a0f4e4f8c tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:31.814431 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d1174a64-4a2e-4172-884c-c54a0f4e4f8c tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:31.815137 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d1174a64-4a2e-4172-884c-c54a0f4e4f8c tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:31.815602 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d1174a64-4a2e-4172-884c-c54a0f4e4f8c tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:31.816035 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d1174a64-4a2e-4172-884c-c54a0f4e4f8c tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:31.816747 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0d4338f6-44be-4824-bd04-f7a58f062220 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:31.817434 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0d4338f6-44be-4824-bd04-f7a58f062220 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: 611195a7-9a81-43eb-9d7d-6c29d80f5933] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:31.823653 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0d4338f6-44be-4824-bd04-f7a58f062220 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:31.824219 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0d4338f6-44be-4824-bd04-f7a58f062220 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:31.824661 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0d4338f6-44be-4824-bd04-f7a58f062220 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:31.825362 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0d4338f6-44be-4824-bd04-f7a58f062220 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:31.825821 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0d4338f6-44be-4824-bd04-f7a58f062220 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:31.826347 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0d4338f6-44be-4824-bd04-f7a58f062220 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:31.961772 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0d4338f6-44be-4824-bd04-f7a58f062220 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18036411a99e4634bfbaeae24b9f254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229dcb63bc41444391544883b576ce2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:31.970894 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0d4338f6-44be-4824-bd04-f7a58f062220 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/611195a7-9a81-43eb-9d7d-6c29d80f5933" status: 200 len: 1679 microversion: 2.1 time: 0.158116 Oct 27 03:40:31.975061 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2175/4620] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:31 2022] GET /compute/v2.1/servers/611195a7-9a81-43eb-9d7d-6c29d80f5933 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:40:31.976776 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c4e633ca-889d-462f-befc-f8887be6361c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:40:31.976903 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c4e633ca-889d-462f-befc-f8887be6361c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:31.983590 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c4e633ca-889d-462f-befc-f8887be6361c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:31.984092 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c4e633ca-889d-462f-befc-f8887be6361c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:31.984543 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c4e633ca-889d-462f-befc-f8887be6361c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:31.985258 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c4e633ca-889d-462f-befc-f8887be6361c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:31.985907 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c4e633ca-889d-462f-befc-f8887be6361c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:31.986389 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c4e633ca-889d-462f-befc-f8887be6361c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:32.007907 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d1174a64-4a2e-4172-884c-c54a0f4e4f8c tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:32.010697 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-c4e633ca-889d-462f-befc-f8887be6361c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lazy-loading 'flavor' on Instance uuid 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:40:32.018119 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d1174a64-4a2e-4172-884c-c54a0f4e4f8c tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:32.019581 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d1174a64-4a2e-4172-884c-c54a0f4e4f8c tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:32.020974 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d1174a64-4a2e-4172-884c-c54a0f4e4f8c tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d" status: 200 len: 2961 microversion: 2.42 time: 0.218672 Oct 27 03:40:32.024376 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2446/4621] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:40:31 2022] GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d => generated 2961 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:40:32.026105 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d922cea3-de58-4d71-b29b-b3bd130caafb tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:32.026896 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d922cea3-de58-4d71-b29b-b3bd130caafb tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:32.034454 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d922cea3-de58-4d71-b29b-b3bd130caafb tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:32.034953 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d922cea3-de58-4d71-b29b-b3bd130caafb tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:32.035606 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d922cea3-de58-4d71-b29b-b3bd130caafb tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:32.036322 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d922cea3-de58-4d71-b29b-b3bd130caafb tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:32.036783 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d922cea3-de58-4d71-b29b-b3bd130caafb tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:32.037226 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d922cea3-de58-4d71-b29b-b3bd130caafb tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:32.208959 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d922cea3-de58-4d71-b29b-b3bd130caafb tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffc2b1c410149e884a47240b5425e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38450368ef5c4e68ac3c19c7a0a1ce65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:32.218618 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d922cea3-de58-4d71-b29b-b3bd130caafb tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b" status: 200 len: 1725 microversion: 2.1 time: 0.195874 Oct 27 03:40:32.219212 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2447/4622] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:32 2022] GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b => generated 1725 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:40:32.223994 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-519daa86-7935-4409-95cf-c110ad4e6ab9 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:32.224750 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-519daa86-7935-4409-95cf-c110ad4e6ab9 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 9fa9583d-e294-4e5f-a6dc-a51d619dc03d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:32.241427 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-519daa86-7935-4409-95cf-c110ad4e6ab9 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:32.241965 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-519daa86-7935-4409-95cf-c110ad4e6ab9 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:32.242440 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-519daa86-7935-4409-95cf-c110ad4e6ab9 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:32.243191 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-519daa86-7935-4409-95cf-c110ad4e6ab9 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:32.243657 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-519daa86-7935-4409-95cf-c110ad4e6ab9 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:32.244091 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-519daa86-7935-4409-95cf-c110ad4e6ab9 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:32.331833 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:40:32.475788 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-519daa86-7935-4409-95cf-c110ad4e6ab9 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:32.491372 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-519daa86-7935-4409-95cf-c110ad4e6ab9 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d" status: 200 len: 1529 microversion: 2.1 time: 0.270747 Oct 27 03:40:32.492332 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2448/4623] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:32 2022] GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d => generated 1529 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:40:32.573081 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c4e633ca-889d-462f-befc-f8887be6361c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "POST /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79/action" status: 202 len: 0 microversion: 2.20 time: 0.599123 Oct 27 03:40:32.574186 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2176/4624] 10.222.0.20 () {62 vars in 1319 bytes} [Thu Oct 27 03:40:31 2022] POST /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79/action => generated 0 bytes in 602 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:40:32.587599 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b8c19c30-63ef-49ef-b124-b6686652eee0 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:32.591811 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b8c19c30-63ef-49ef-b124-b6686652eee0 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:32.600233 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b8c19c30-63ef-49ef-b124-b6686652eee0 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:32.601329 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b8c19c30-63ef-49ef-b124-b6686652eee0 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:32.601875 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b8c19c30-63ef-49ef-b124-b6686652eee0 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:32.602815 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b8c19c30-63ef-49ef-b124-b6686652eee0 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:32.603375 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b8c19c30-63ef-49ef-b124-b6686652eee0 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:32.603900 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b8c19c30-63ef-49ef-b124-b6686652eee0 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:32.768132 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:40:32.775283 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-af79b776-2e62-4d11-ae2d-d57ad2d97a1f tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:32.777584 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-af79b776-2e62-4d11-ae2d-d57ad2d97a1f tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] [instance: cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:32.788992 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-af79b776-2e62-4d11-ae2d-d57ad2d97a1f tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:32.791982 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-af79b776-2e62-4d11-ae2d-d57ad2d97a1f tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:32.793430 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-af79b776-2e62-4d11-ae2d-d57ad2d97a1f tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:32.794446 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-af79b776-2e62-4d11-ae2d-d57ad2d97a1f tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:32.795133 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-af79b776-2e62-4d11-ae2d-d57ad2d97a1f tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:32.795891 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-af79b776-2e62-4d11-ae2d-d57ad2d97a1f tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:32.839368 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=8 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:40:32.907737 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-af79b776-2e62-4d11-ae2d-d57ad2d97a1f tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:32.921276 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-af79b776-2e62-4d11-ae2d-d57ad2d97a1f tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:32.925924 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-af79b776-2e62-4d11-ae2d-d57ad2d97a1f tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:32.934715 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-af79b776-2e62-4d11-ae2d-d57ad2d97a1f tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29" status: 200 len: 1366 microversion: 2.57 time: 0.166122 Oct 27 03:40:32.950069 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2177/4625] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:40:32 2022] GET /compute/v2.1/servers/cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29 => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:40:32.950069 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-45abe394-a336-460a-bf9f-223abd7a22e6 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:32.950069 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-45abe394-a336-460a-bf9f-223abd7a22e6 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] [instance: 621fa99f-f6ef-4333-9e54-1820cb63e2ee] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:32.950958 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-45abe394-a336-460a-bf9f-223abd7a22e6 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:32.951752 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-45abe394-a336-460a-bf9f-223abd7a22e6 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:32.952369 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-45abe394-a336-460a-bf9f-223abd7a22e6 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:32.953573 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-45abe394-a336-460a-bf9f-223abd7a22e6 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:32.954232 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-45abe394-a336-460a-bf9f-223abd7a22e6 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:32.954954 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-45abe394-a336-460a-bf9f-223abd7a22e6 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:32.975118 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b8c19c30-63ef-49ef-b124-b6686652eee0 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:32.993639 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b8c19c30-63ef-49ef-b124-b6686652eee0 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:32.998318 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b8c19c30-63ef-49ef-b124-b6686652eee0 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:32.999569 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b8c19c30-63ef-49ef-b124-b6686652eee0 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79" status: 200 len: 1723 microversion: 2.20 time: 0.421395 Oct 27 03:40:33.000325 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2449/4626] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:40:32 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 => generated 1723 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:40:33.015261 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9d3ebdba-952b-4c86-95a4-8d4e680414ad tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:33.015981 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-9d3ebdba-952b-4c86-95a4-8d4e680414ad tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: 611195a7-9a81-43eb-9d7d-6c29d80f5933] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:33.041465 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9d3ebdba-952b-4c86-95a4-8d4e680414ad tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:33.042002 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9d3ebdba-952b-4c86-95a4-8d4e680414ad tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:33.042803 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9d3ebdba-952b-4c86-95a4-8d4e680414ad tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:33.047542 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9d3ebdba-952b-4c86-95a4-8d4e680414ad tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:33.048318 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9d3ebdba-952b-4c86-95a4-8d4e680414ad tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:33.052434 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9d3ebdba-952b-4c86-95a4-8d4e680414ad tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:33.191206 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-45abe394-a336-460a-bf9f-223abd7a22e6 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba500c7bb654a649a57bb8c96aa8bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05672dc7b53747988fde6abc4adb2ef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:33.203367 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-45abe394-a336-460a-bf9f-223abd7a22e6 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] 10.222.0.20 "GET /compute/v2.1/servers/621fa99f-f6ef-4333-9e54-1820cb63e2ee" status: 200 len: 1317 microversion: 2.1 time: 0.265677 Oct 27 03:40:33.203973 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2178/4627] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:32 2022] GET /compute/v2.1/servers/621fa99f-f6ef-4333-9e54-1820cb63e2ee => generated 1317 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:40:33.209159 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-983e1417-68a8-4b7c-a97d-cd31077c6bc3 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:33.210289 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-983e1417-68a8-4b7c-a97d-cd31077c6bc3 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] [instance: 8c8a2cbb-4acf-4a6b-b684-567617bb930d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:33.218792 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-983e1417-68a8-4b7c-a97d-cd31077c6bc3 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:33.219512 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-983e1417-68a8-4b7c-a97d-cd31077c6bc3 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:33.220278 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-983e1417-68a8-4b7c-a97d-cd31077c6bc3 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:33.221008 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-983e1417-68a8-4b7c-a97d-cd31077c6bc3 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:33.221466 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-983e1417-68a8-4b7c-a97d-cd31077c6bc3 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:33.221942 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-983e1417-68a8-4b7c-a97d-cd31077c6bc3 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:33.473656 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-983e1417-68a8-4b7c-a97d-cd31077c6bc3 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:33.486024 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-983e1417-68a8-4b7c-a97d-cd31077c6bc3 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:33.488409 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-983e1417-68a8-4b7c-a97d-cd31077c6bc3 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:33.490058 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-983e1417-68a8-4b7c-a97d-cd31077c6bc3 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d" status: 200 len: 2940 microversion: 2.42 time: 0.284911 Oct 27 03:40:33.490536 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2179/4628] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:40:33 2022] GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d => generated 2940 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:40:33.496029 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-501f2847-e27c-479d-8595-15ca324b75eb req-85f64111-9613-47aa-a525-4763a047280c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fa9583d-e294-4e5f-a6dc-a51d619dc03d", "name": "network-vif-plugged", "status": "completed", "tag": "aca66186-53fb-44cb-b3c0-fd4406f7b0dd"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:40:33.508457 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-501f2847-e27c-479d-8595-15ca324b75eb req-85f64111-9613-47aa-a525-4763a047280c service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:33.509562 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-501f2847-e27c-479d-8595-15ca324b75eb req-85f64111-9613-47aa-a525-4763a047280c service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:33.510092 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-501f2847-e27c-479d-8595-15ca324b75eb req-85f64111-9613-47aa-a525-4763a047280c service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:33.523240 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-501f2847-e27c-479d-8595-15ca324b75eb req-85f64111-9613-47aa-a525-4763a047280c service nova] Creating event network-vif-plugged:aca66186-53fb-44cb-b3c0-fd4406f7b0dd for instance 9fa9583d-e294-4e5f-a6dc-a51d619dc03d on n-h2-862769-1 Oct 27 03:40:33.529225 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-501f2847-e27c-479d-8595-15ca324b75eb req-85f64111-9613-47aa-a525-4763a047280c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037348 Oct 27 03:40:33.529942 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2180/4629] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:40:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:40:33.535093 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e8de7615-7f06-4d56-8f96-60cb41814e79 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:33.536070 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e8de7615-7f06-4d56-8f96-60cb41814e79 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:33.543603 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e8de7615-7f06-4d56-8f96-60cb41814e79 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:33.544186 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e8de7615-7f06-4d56-8f96-60cb41814e79 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:33.544705 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e8de7615-7f06-4d56-8f96-60cb41814e79 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:33.545531 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e8de7615-7f06-4d56-8f96-60cb41814e79 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:33.546182 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e8de7615-7f06-4d56-8f96-60cb41814e79 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:33.546675 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e8de7615-7f06-4d56-8f96-60cb41814e79 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:33.588948 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9d3ebdba-952b-4c86-95a4-8d4e680414ad tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18036411a99e4634bfbaeae24b9f254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229dcb63bc41444391544883b576ce2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:33.607404 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9d3ebdba-952b-4c86-95a4-8d4e680414ad tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/611195a7-9a81-43eb-9d7d-6c29d80f5933" status: 200 len: 1679 microversion: 2.1 time: 0.605393 Oct 27 03:40:33.608004 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2450/4630] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:33 2022] GET /compute/v2.1/servers/611195a7-9a81-43eb-9d7d-6c29d80f5933 => generated 1679 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:40:33.623535 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-95528e98-2132-4ff1-84e1-aaaff785f34d tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:33.623535 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-95528e98-2132-4ff1-84e1-aaaff785f34d tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 9fa9583d-e294-4e5f-a6dc-a51d619dc03d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:33.627156 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-95528e98-2132-4ff1-84e1-aaaff785f34d tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:33.628723 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-95528e98-2132-4ff1-84e1-aaaff785f34d tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:33.628723 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-95528e98-2132-4ff1-84e1-aaaff785f34d tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:33.630396 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-95528e98-2132-4ff1-84e1-aaaff785f34d tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:33.631189 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-95528e98-2132-4ff1-84e1-aaaff785f34d tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:33.632226 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-95528e98-2132-4ff1-84e1-aaaff785f34d tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:33.708860 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e8de7615-7f06-4d56-8f96-60cb41814e79 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffc2b1c410149e884a47240b5425e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38450368ef5c4e68ac3c19c7a0a1ce65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:33.719367 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e8de7615-7f06-4d56-8f96-60cb41814e79 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b" status: 200 len: 1725 microversion: 2.1 time: 0.188008 Oct 27 03:40:33.720244 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2181/4631] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:33 2022] GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b => generated 1725 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:40:33.804630 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-95528e98-2132-4ff1-84e1-aaaff785f34d tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:33.812420 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-95528e98-2132-4ff1-84e1-aaaff785f34d tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d" status: 200 len: 1524 microversion: 2.1 time: 0.203339 Oct 27 03:40:33.813168 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2451/4632] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:33 2022] GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d => generated 1524 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:40:33.969977 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8633c041-e3bc-4951-b102-66aa3d8feafd tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:33.970931 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8633c041-e3bc-4951-b102-66aa3d8feafd tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] [instance: cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:33.975114 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:40:33.979492 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8633c041-e3bc-4951-b102-66aa3d8feafd tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:33.980693 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8633c041-e3bc-4951-b102-66aa3d8feafd tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:33.981586 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8633c041-e3bc-4951-b102-66aa3d8feafd tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:33.982735 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8633c041-e3bc-4951-b102-66aa3d8feafd tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:33.983271 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8633c041-e3bc-4951-b102-66aa3d8feafd tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:33.983830 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8633c041-e3bc-4951-b102-66aa3d8feafd tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:34.033351 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5f4e6dc3-9f0d-4f1a-bed9-f7729068b0bb tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:34.034508 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5f4e6dc3-9f0d-4f1a-bed9-f7729068b0bb tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:34.051534 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5f4e6dc3-9f0d-4f1a-bed9-f7729068b0bb tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:34.062479 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5f4e6dc3-9f0d-4f1a-bed9-f7729068b0bb tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:34.063139 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5f4e6dc3-9f0d-4f1a-bed9-f7729068b0bb tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:34.063388 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8633c041-e3bc-4951-b102-66aa3d8feafd tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:34.064695 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5f4e6dc3-9f0d-4f1a-bed9-f7729068b0bb tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:34.065262 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5f4e6dc3-9f0d-4f1a-bed9-f7729068b0bb tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:34.065753 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5f4e6dc3-9f0d-4f1a-bed9-f7729068b0bb tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:34.074771 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8633c041-e3bc-4951-b102-66aa3d8feafd tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:34.075384 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8633c041-e3bc-4951-b102-66aa3d8feafd tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:34.076614 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8633c041-e3bc-4951-b102-66aa3d8feafd tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29" status: 200 len: 1366 microversion: 2.57 time: 0.113366 Oct 27 03:40:34.077496 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2182/4633] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:40:33 2022] GET /compute/v2.1/servers/cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29 => generated 1366 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:40:34.232100 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e7acad8d-53fc-4c63-9a19-003dde52efef tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:34.232739 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e7acad8d-53fc-4c63-9a19-003dde52efef tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] [instance: 621fa99f-f6ef-4333-9e54-1820cb63e2ee] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:34.247090 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e7acad8d-53fc-4c63-9a19-003dde52efef tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:34.250287 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e7acad8d-53fc-4c63-9a19-003dde52efef tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:34.250287 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e7acad8d-53fc-4c63-9a19-003dde52efef tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:34.250287 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e7acad8d-53fc-4c63-9a19-003dde52efef tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:34.250287 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e7acad8d-53fc-4c63-9a19-003dde52efef tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:34.252331 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e7acad8d-53fc-4c63-9a19-003dde52efef tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:34.342103 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5f4e6dc3-9f0d-4f1a-bed9-f7729068b0bb tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:34.351827 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5f4e6dc3-9f0d-4f1a-bed9-f7729068b0bb tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:34.353341 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5f4e6dc3-9f0d-4f1a-bed9-f7729068b0bb tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:34.363302 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5f4e6dc3-9f0d-4f1a-bed9-f7729068b0bb tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79" status: 200 len: 1723 microversion: 2.20 time: 0.335999 Oct 27 03:40:34.363910 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2452/4634] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:40:34 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 => generated 1723 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:40:34.379346 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-a2e62e96-5afb-4758-a11b-f3b0c22ba0a7 req-ab4d2e51-be83-42d8-9c13-9154e082b121 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "611195a7-9a81-43eb-9d7d-6c29d80f5933", "name": "network-vif-deleted", "tag": "2191274a-4ef4-4cc4-a7b0-bf8217300db1"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:40:34.398293 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-a2e62e96-5afb-4758-a11b-f3b0c22ba0a7 req-ab4d2e51-be83-42d8-9c13-9154e082b121 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:34.398827 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-a2e62e96-5afb-4758-a11b-f3b0c22ba0a7 req-ab4d2e51-be83-42d8-9c13-9154e082b121 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:34.400051 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-a2e62e96-5afb-4758-a11b-f3b0c22ba0a7 req-ab4d2e51-be83-42d8-9c13-9154e082b121 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:34.414251 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-a2e62e96-5afb-4758-a11b-f3b0c22ba0a7 req-ab4d2e51-be83-42d8-9c13-9154e082b121 service nova] Creating event network-vif-deleted:2191274a-4ef4-4cc4-a7b0-bf8217300db1 for instance 611195a7-9a81-43eb-9d7d-6c29d80f5933 on n-h2-862769-1 Oct 27 03:40:34.421550 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-a2e62e96-5afb-4758-a11b-f3b0c22ba0a7 req-ab4d2e51-be83-42d8-9c13-9154e082b121 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056387 Oct 27 03:40:34.422810 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2453/4635] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:40:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:40:34.490861 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e7acad8d-53fc-4c63-9a19-003dde52efef tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba500c7bb654a649a57bb8c96aa8bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05672dc7b53747988fde6abc4adb2ef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:34.501807 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e7acad8d-53fc-4c63-9a19-003dde52efef tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] 10.222.0.20 "GET /compute/v2.1/servers/621fa99f-f6ef-4333-9e54-1820cb63e2ee" status: 200 len: 1317 microversion: 2.1 time: 0.273889 Oct 27 03:40:34.504981 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2183/4636] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:34 2022] GET /compute/v2.1/servers/621fa99f-f6ef-4333-9e54-1820cb63e2ee => generated 1317 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:40:34.521232 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e959be14-c960-4adf-a7e9-4a622439e58d tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:34.521232 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e959be14-c960-4adf-a7e9-4a622439e58d tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] [instance: 8c8a2cbb-4acf-4a6b-b684-567617bb930d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:34.530121 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e959be14-c960-4adf-a7e9-4a622439e58d tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:34.530854 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e959be14-c960-4adf-a7e9-4a622439e58d tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:34.531459 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e959be14-c960-4adf-a7e9-4a622439e58d tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:34.533011 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e959be14-c960-4adf-a7e9-4a622439e58d tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:34.533719 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e959be14-c960-4adf-a7e9-4a622439e58d tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:34.534820 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e959be14-c960-4adf-a7e9-4a622439e58d tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:34.631327 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-24e7cd54-c05c-4a9f-bce6-2bd6b479211f tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:34.632303 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-24e7cd54-c05c-4a9f-bce6-2bd6b479211f tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: 611195a7-9a81-43eb-9d7d-6c29d80f5933] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:34.647151 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-24e7cd54-c05c-4a9f-bce6-2bd6b479211f tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:34.648456 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-24e7cd54-c05c-4a9f-bce6-2bd6b479211f tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:34.648901 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-24e7cd54-c05c-4a9f-bce6-2bd6b479211f tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:34.652386 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-24e7cd54-c05c-4a9f-bce6-2bd6b479211f tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:34.652870 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-24e7cd54-c05c-4a9f-bce6-2bd6b479211f tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:34.656842 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-24e7cd54-c05c-4a9f-bce6-2bd6b479211f tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:34.756430 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-24e7cd54-c05c-4a9f-bce6-2bd6b479211f tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18036411a99e4634bfbaeae24b9f254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229dcb63bc41444391544883b576ce2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:34.766758 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-24e7cd54-c05c-4a9f-bce6-2bd6b479211f tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/611195a7-9a81-43eb-9d7d-6c29d80f5933" status: 200 len: 1612 microversion: 2.1 time: 0.139394 Oct 27 03:40:34.782187 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2184/4637] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:34 2022] GET /compute/v2.1/servers/611195a7-9a81-43eb-9d7d-6c29d80f5933 => generated 1612 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:40:34.788908 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-113bd5dd-5c4d-4cba-a043-95c1c1293e98 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:34.789733 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-113bd5dd-5c4d-4cba-a043-95c1c1293e98 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:34.796447 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-113bd5dd-5c4d-4cba-a043-95c1c1293e98 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:34.797162 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-113bd5dd-5c4d-4cba-a043-95c1c1293e98 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:34.797751 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-113bd5dd-5c4d-4cba-a043-95c1c1293e98 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:34.798636 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-113bd5dd-5c4d-4cba-a043-95c1c1293e98 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:34.799238 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-113bd5dd-5c4d-4cba-a043-95c1c1293e98 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:34.799813 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-113bd5dd-5c4d-4cba-a043-95c1c1293e98 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:34.898181 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e959be14-c960-4adf-a7e9-4a622439e58d tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:34.916589 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e959be14-c960-4adf-a7e9-4a622439e58d tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:34.918489 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e959be14-c960-4adf-a7e9-4a622439e58d tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:34.920167 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e959be14-c960-4adf-a7e9-4a622439e58d tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d" status: 200 len: 2940 microversion: 2.42 time: 0.404939 Oct 27 03:40:34.925570 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2454/4638] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:40:34 2022] GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d => generated 2940 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:40:34.926041 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b0ff5145-b85f-4404-bed4-a477f6d842d5 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:34.929746 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b0ff5145-b85f-4404-bed4-a477f6d842d5 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 9fa9583d-e294-4e5f-a6dc-a51d619dc03d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:34.947985 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b0ff5145-b85f-4404-bed4-a477f6d842d5 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:34.950610 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b0ff5145-b85f-4404-bed4-a477f6d842d5 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:34.951067 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b0ff5145-b85f-4404-bed4-a477f6d842d5 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:34.952653 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b0ff5145-b85f-4404-bed4-a477f6d842d5 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:34.958412 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b0ff5145-b85f-4404-bed4-a477f6d842d5 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:34.959320 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b0ff5145-b85f-4404-bed4-a477f6d842d5 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:35.204938 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-113bd5dd-5c4d-4cba-a043-95c1c1293e98 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffc2b1c410149e884a47240b5425e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38450368ef5c4e68ac3c19c7a0a1ce65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:35.227160 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-113bd5dd-5c4d-4cba-a043-95c1c1293e98 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b" status: 200 len: 1725 microversion: 2.1 time: 0.442354 Oct 27 03:40:35.263652 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2185/4639] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:34 2022] GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b => generated 1725 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:40:35.272468 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ad055482-a124-4224-8cc6-334460f991b0 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:35.273367 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ad055482-a124-4224-8cc6-334460f991b0 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] [instance: cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:35.295097 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ad055482-a124-4224-8cc6-334460f991b0 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:35.295849 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ad055482-a124-4224-8cc6-334460f991b0 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:35.296445 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ad055482-a124-4224-8cc6-334460f991b0 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:35.298158 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ad055482-a124-4224-8cc6-334460f991b0 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:35.298831 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ad055482-a124-4224-8cc6-334460f991b0 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:35.299407 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ad055482-a124-4224-8cc6-334460f991b0 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:35.390890 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b0ff5145-b85f-4404-bed4-a477f6d842d5 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:35.408150 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b0ff5145-b85f-4404-bed4-a477f6d842d5 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d" status: 200 len: 1524 microversion: 2.1 time: 0.485269 Oct 27 03:40:35.430228 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2455/4640] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:34 2022] GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d => generated 1524 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:40:35.445641 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-103aa71b-5f6e-44b3-9ce8-6a3c12e998da tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:35.449147 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-103aa71b-5f6e-44b3-9ce8-6a3c12e998da tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:35.457423 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-103aa71b-5f6e-44b3-9ce8-6a3c12e998da tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:35.457929 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-103aa71b-5f6e-44b3-9ce8-6a3c12e998da tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:35.458890 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-103aa71b-5f6e-44b3-9ce8-6a3c12e998da tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:35.461714 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-103aa71b-5f6e-44b3-9ce8-6a3c12e998da tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:35.461714 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-103aa71b-5f6e-44b3-9ce8-6a3c12e998da tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:35.461714 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-103aa71b-5f6e-44b3-9ce8-6a3c12e998da tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:35.478658 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ad055482-a124-4224-8cc6-334460f991b0 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:35.511055 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ad055482-a124-4224-8cc6-334460f991b0 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:35.525864 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ad055482-a124-4224-8cc6-334460f991b0 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:35.529412 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ad055482-a124-4224-8cc6-334460f991b0 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29" status: 200 len: 1366 microversion: 2.57 time: 0.263220 Oct 27 03:40:35.537725 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2186/4641] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:40:35 2022] GET /compute/v2.1/servers/cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29 => generated 1366 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:40:35.551302 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d563dffc-36ce-4940-bbe5-50e09f5674a9 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:35.557253 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d563dffc-36ce-4940-bbe5-50e09f5674a9 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] [instance: 621fa99f-f6ef-4333-9e54-1820cb63e2ee] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:35.578420 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d563dffc-36ce-4940-bbe5-50e09f5674a9 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:35.578928 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d563dffc-36ce-4940-bbe5-50e09f5674a9 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:35.579386 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d563dffc-36ce-4940-bbe5-50e09f5674a9 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:35.580107 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d563dffc-36ce-4940-bbe5-50e09f5674a9 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:35.586173 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d563dffc-36ce-4940-bbe5-50e09f5674a9 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:35.587558 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d563dffc-36ce-4940-bbe5-50e09f5674a9 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:35.738128 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-103aa71b-5f6e-44b3-9ce8-6a3c12e998da tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:35.761089 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-103aa71b-5f6e-44b3-9ce8-6a3c12e998da tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:35.762633 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-103aa71b-5f6e-44b3-9ce8-6a3c12e998da tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:35.764577 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-103aa71b-5f6e-44b3-9ce8-6a3c12e998da tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79" status: 200 len: 1723 microversion: 2.20 time: 0.330997 Oct 27 03:40:35.769003 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2456/4642] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:40:35 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 => generated 1723 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:40:35.777620 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-31b6e249-f5ea-41d7-8e79-0e0dad8baf86 req-9b1b66a7-0720-4e0e-806b-91aa18ff6164 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c8a2cbb-4acf-4a6b-b684-567617bb930d", "name": "network-vif-unplugged", "status": "completed", "tag": "05efbe65-e414-4934-8f17-a13f864d1dab"}, {"server_uuid": "8c8a2cbb-4acf-4a6b-b684-567617bb930d", "name": "network-vif-unplugged", "status": "completed", "tag": "67feebc0-6f53-4380-af0b-a0f8be99846e"}, {"server_uuid": "8c8a2cbb-4acf-4a6b-b684-567617bb930d", "name": "network-vif-unplugged", "status": "completed", "tag": "3a1ccaa7-51b5-4235-87d4-b3c14e28f77b"}, {"server_uuid": "8c8a2cbb-4acf-4a6b-b684-567617bb930d", "name": "network-vif-unplugged", "status": "completed", "tag": "2e9b0521-8b60-4153-8c0a-3a8fbe3a87fe"}, {"server_uuid": "8c8a2cbb-4acf-4a6b-b684-567617bb930d", "name": "network-vif-unplugged", "status": "completed", "tag": "40696ddf-b935-4016-95dc-a4e42979795f"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:40:35.810308 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-31b6e249-f5ea-41d7-8e79-0e0dad8baf86 req-9b1b66a7-0720-4e0e-806b-91aa18ff6164 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:35.810724 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-31b6e249-f5ea-41d7-8e79-0e0dad8baf86 req-9b1b66a7-0720-4e0e-806b-91aa18ff6164 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:35.811174 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-31b6e249-f5ea-41d7-8e79-0e0dad8baf86 req-9b1b66a7-0720-4e0e-806b-91aa18ff6164 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:35.835376 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-31b6e249-f5ea-41d7-8e79-0e0dad8baf86 req-9b1b66a7-0720-4e0e-806b-91aa18ff6164 service nova] Creating event network-vif-unplugged:05efbe65-e414-4934-8f17-a13f864d1dab for instance 8c8a2cbb-4acf-4a6b-b684-567617bb930d on n-h2-862769-1 Oct 27 03:40:35.835907 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-31b6e249-f5ea-41d7-8e79-0e0dad8baf86 req-9b1b66a7-0720-4e0e-806b-91aa18ff6164 service nova] Creating event network-vif-unplugged:67feebc0-6f53-4380-af0b-a0f8be99846e for instance 8c8a2cbb-4acf-4a6b-b684-567617bb930d on n-h2-862769-1 Oct 27 03:40:35.838582 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-31b6e249-f5ea-41d7-8e79-0e0dad8baf86 req-9b1b66a7-0720-4e0e-806b-91aa18ff6164 service nova] Creating event network-vif-unplugged:3a1ccaa7-51b5-4235-87d4-b3c14e28f77b for instance 8c8a2cbb-4acf-4a6b-b684-567617bb930d on n-h2-862769-1 Oct 27 03:40:35.840244 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-31b6e249-f5ea-41d7-8e79-0e0dad8baf86 req-9b1b66a7-0720-4e0e-806b-91aa18ff6164 service nova] Creating event network-vif-unplugged:2e9b0521-8b60-4153-8c0a-3a8fbe3a87fe for instance 8c8a2cbb-4acf-4a6b-b684-567617bb930d on n-h2-862769-1 Oct 27 03:40:35.841941 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-31b6e249-f5ea-41d7-8e79-0e0dad8baf86 req-9b1b66a7-0720-4e0e-806b-91aa18ff6164 service nova] Creating event network-vif-unplugged:40696ddf-b935-4016-95dc-a4e42979795f for instance 8c8a2cbb-4acf-4a6b-b684-567617bb930d on n-h2-862769-1 Oct 27 03:40:35.860728 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-31b6e249-f5ea-41d7-8e79-0e0dad8baf86 req-9b1b66a7-0720-4e0e-806b-91aa18ff6164 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 877 microversion: 2.1 time: 0.089968 Oct 27 03:40:35.861742 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2457/4643] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:40:35 2022] POST /compute/v2.1/os-server-external-events => generated 877 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:40:35.870045 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e2644384-1113-4bfa-8e21-9488ea65cddf tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:35.872004 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e2644384-1113-4bfa-8e21-9488ea65cddf tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: 611195a7-9a81-43eb-9d7d-6c29d80f5933] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:35.882476 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e2644384-1113-4bfa-8e21-9488ea65cddf tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:35.883643 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e2644384-1113-4bfa-8e21-9488ea65cddf tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:35.884263 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e2644384-1113-4bfa-8e21-9488ea65cddf tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:35.886368 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e2644384-1113-4bfa-8e21-9488ea65cddf tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:35.887007 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e2644384-1113-4bfa-8e21-9488ea65cddf tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:35.887772 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e2644384-1113-4bfa-8e21-9488ea65cddf tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:35.896180 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:40:35.918737 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d563dffc-36ce-4940-bbe5-50e09f5674a9 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba500c7bb654a649a57bb8c96aa8bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05672dc7b53747988fde6abc4adb2ef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:35.925600 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:40:35.936913 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d563dffc-36ce-4940-bbe5-50e09f5674a9 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] 10.222.0.20 "GET /compute/v2.1/servers/621fa99f-f6ef-4333-9e54-1820cb63e2ee" status: 200 len: 1317 microversion: 2.1 time: 0.396595 Oct 27 03:40:35.938091 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2187/4644] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:35 2022] GET /compute/v2.1/servers/621fa99f-f6ef-4333-9e54-1820cb63e2ee => generated 1317 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:40:35.938646 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e2644384-1113-4bfa-8e21-9488ea65cddf tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:35.939231 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e2644384-1113-4bfa-8e21-9488ea65cddf tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:35.939772 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e2644384-1113-4bfa-8e21-9488ea65cddf tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:35.940335 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-e2644384-1113-4bfa-8e21-9488ea65cddf tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lazy-loading 'fault' on Instance uuid 611195a7-9a81-43eb-9d7d-6c29d80f5933 {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:40:35.951200 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8974bf1e-1b73-4e7f-9204-3c99e9825181 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:35.952126 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8974bf1e-1b73-4e7f-9204-3c99e9825181 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] [instance: 8c8a2cbb-4acf-4a6b-b684-567617bb930d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:35.966186 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8974bf1e-1b73-4e7f-9204-3c99e9825181 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:35.969231 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8974bf1e-1b73-4e7f-9204-3c99e9825181 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:35.970610 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8974bf1e-1b73-4e7f-9204-3c99e9825181 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:35.975133 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8974bf1e-1b73-4e7f-9204-3c99e9825181 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:35.975940 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8974bf1e-1b73-4e7f-9204-3c99e9825181 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:35.976558 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8974bf1e-1b73-4e7f-9204-3c99e9825181 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:36.044245 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e2644384-1113-4bfa-8e21-9488ea65cddf tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18036411a99e4634bfbaeae24b9f254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229dcb63bc41444391544883b576ce2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:36.062379 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e2644384-1113-4bfa-8e21-9488ea65cddf tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/611195a7-9a81-43eb-9d7d-6c29d80f5933" status: 200 len: 1329 microversion: 2.1 time: 0.189865 Oct 27 03:40:36.063444 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2458/4645] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:35 2022] GET /compute/v2.1/servers/611195a7-9a81-43eb-9d7d-6c29d80f5933 => generated 1329 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:40:36.265431 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ec5dfdc6-d299-41ab-8a25-27938a9bd965 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:36.266170 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ec5dfdc6-d299-41ab-8a25-27938a9bd965 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:36.279693 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ec5dfdc6-d299-41ab-8a25-27938a9bd965 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:36.280204 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ec5dfdc6-d299-41ab-8a25-27938a9bd965 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:36.281369 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ec5dfdc6-d299-41ab-8a25-27938a9bd965 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:36.281369 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ec5dfdc6-d299-41ab-8a25-27938a9bd965 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:36.281833 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ec5dfdc6-d299-41ab-8a25-27938a9bd965 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:36.282306 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ec5dfdc6-d299-41ab-8a25-27938a9bd965 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:36.425174 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8974bf1e-1b73-4e7f-9204-3c99e9825181 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:36.444969 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8974bf1e-1b73-4e7f-9204-3c99e9825181 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:36.451210 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8974bf1e-1b73-4e7f-9204-3c99e9825181 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:36.455738 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8974bf1e-1b73-4e7f-9204-3c99e9825181 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d" status: 200 len: 2919 microversion: 2.42 time: 0.510264 Oct 27 03:40:36.470640 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2188/4646] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:40:35 2022] GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d => generated 2919 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:40:36.479478 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-11697ec5-9ce5-497e-8e37-f24a97847c4f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:36.480399 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-11697ec5-9ce5-497e-8e37-f24a97847c4f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 9fa9583d-e294-4e5f-a6dc-a51d619dc03d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:36.488545 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-11697ec5-9ce5-497e-8e37-f24a97847c4f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:36.489542 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-11697ec5-9ce5-497e-8e37-f24a97847c4f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:36.490344 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-11697ec5-9ce5-497e-8e37-f24a97847c4f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:36.491913 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-11697ec5-9ce5-497e-8e37-f24a97847c4f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:36.492913 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-11697ec5-9ce5-497e-8e37-f24a97847c4f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:36.494231 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-11697ec5-9ce5-497e-8e37-f24a97847c4f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:36.556528 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ec5dfdc6-d299-41ab-8a25-27938a9bd965 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffc2b1c410149e884a47240b5425e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38450368ef5c4e68ac3c19c7a0a1ce65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:36.569547 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ec5dfdc6-d299-41ab-8a25-27938a9bd965 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b" status: 200 len: 1725 microversion: 2.1 time: 0.307883 Oct 27 03:40:36.570598 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2459/4647] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:36 2022] GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b => generated 1725 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:40:36.576300 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-712c3d67-dd7c-4a2e-bbb8-7f809bf3ae0c tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:36.576933 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-712c3d67-dd7c-4a2e-bbb8-7f809bf3ae0c tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] [instance: cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:36.584610 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:40:36.587362 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-712c3d67-dd7c-4a2e-bbb8-7f809bf3ae0c tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:36.591589 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-712c3d67-dd7c-4a2e-bbb8-7f809bf3ae0c tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:36.591589 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-712c3d67-dd7c-4a2e-bbb8-7f809bf3ae0c tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:36.591589 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-712c3d67-dd7c-4a2e-bbb8-7f809bf3ae0c tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:36.591589 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-712c3d67-dd7c-4a2e-bbb8-7f809bf3ae0c tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:36.591589 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-712c3d67-dd7c-4a2e-bbb8-7f809bf3ae0c tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:36.676435 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-712c3d67-dd7c-4a2e-bbb8-7f809bf3ae0c tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:36.687207 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-712c3d67-dd7c-4a2e-bbb8-7f809bf3ae0c tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:36.688841 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-712c3d67-dd7c-4a2e-bbb8-7f809bf3ae0c tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:36.695748 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-712c3d67-dd7c-4a2e-bbb8-7f809bf3ae0c tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29" status: 200 len: 1366 microversion: 2.57 time: 0.122257 Oct 27 03:40:36.697715 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2460/4648] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:40:36 2022] GET /compute/v2.1/servers/cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29 => generated 1366 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:40:36.765354 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-11697ec5-9ce5-497e-8e37-f24a97847c4f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:36.778519 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-11697ec5-9ce5-497e-8e37-f24a97847c4f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d" status: 200 len: 1524 microversion: 2.1 time: 0.305389 Oct 27 03:40:36.779483 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2189/4649] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:36 2022] GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d => generated 1524 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:40:36.799624 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-706dcc6a-bb12-491d-a224-5c012ecd6bae tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:36.800629 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-706dcc6a-bb12-491d-a224-5c012ecd6bae tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:36.812588 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-706dcc6a-bb12-491d-a224-5c012ecd6bae tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:36.813114 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-706dcc6a-bb12-491d-a224-5c012ecd6bae tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:36.813563 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-706dcc6a-bb12-491d-a224-5c012ecd6bae tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:36.814621 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-706dcc6a-bb12-491d-a224-5c012ecd6bae tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:36.815444 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-706dcc6a-bb12-491d-a224-5c012ecd6bae tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:36.816352 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-706dcc6a-bb12-491d-a224-5c012ecd6bae tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:36.966994 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0173f6f1-ca39-412c-a8c9-585dd9e6ae9a tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:36.967630 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0173f6f1-ca39-412c-a8c9-585dd9e6ae9a tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] [instance: 621fa99f-f6ef-4333-9e54-1820cb63e2ee] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:36.976956 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0173f6f1-ca39-412c-a8c9-585dd9e6ae9a tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:36.978246 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0173f6f1-ca39-412c-a8c9-585dd9e6ae9a tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:36.979379 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0173f6f1-ca39-412c-a8c9-585dd9e6ae9a tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:36.980280 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0173f6f1-ca39-412c-a8c9-585dd9e6ae9a tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:36.981479 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0173f6f1-ca39-412c-a8c9-585dd9e6ae9a tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:36.982101 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0173f6f1-ca39-412c-a8c9-585dd9e6ae9a tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:36.985587 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-706dcc6a-bb12-491d-a224-5c012ecd6bae tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:36.996428 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-706dcc6a-bb12-491d-a224-5c012ecd6bae tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:36.998558 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-706dcc6a-bb12-491d-a224-5c012ecd6bae tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:37.000021 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-706dcc6a-bb12-491d-a224-5c012ecd6bae tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79" status: 200 len: 1723 microversion: 2.20 time: 0.204480 Oct 27 03:40:37.001182 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2461/4650] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:40:36 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 => generated 1723 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:40:37.086598 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ae2895eb-4487-4773-b600-45ed9a12aa41 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:37.087789 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ae2895eb-4487-4773-b600-45ed9a12aa41 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: 611195a7-9a81-43eb-9d7d-6c29d80f5933] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:37.101549 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ae2895eb-4487-4773-b600-45ed9a12aa41 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:37.102078 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ae2895eb-4487-4773-b600-45ed9a12aa41 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:37.103514 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ae2895eb-4487-4773-b600-45ed9a12aa41 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:37.104258 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ae2895eb-4487-4773-b600-45ed9a12aa41 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:37.104726 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ae2895eb-4487-4773-b600-45ed9a12aa41 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:37.108374 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ae2895eb-4487-4773-b600-45ed9a12aa41 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:37.140104 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-ae2895eb-4487-4773-b600-45ed9a12aa41 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] HTTP exception thrown: Instance 611195a7-9a81-43eb-9d7d-6c29d80f5933 could not be found. Oct 27 03:40:37.142815 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ae2895eb-4487-4773-b600-45ed9a12aa41 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Request method failure captured: Oct 27 03:40:37.142815 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/611195a7-9a81-43eb-9d7d-6c29d80f5933 HTTP/1.1 Oct 27 03:40:37.142815 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:40:37.142815 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:40:37.142815 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:40:37.142815 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:40:37.142815 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:40:37.142815 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:40:37.142815 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:40:37.142815 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:40:37.142815 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfyO20A1D6ympGjQc2k7pGwXBVoOs4AtFX551niq39NWe_HjifvxGvre6cHeeNp8osa7J1PNEE0_yy7-MG05YNEONXkGtR3-F0Zb6-60FxqOiIpeJ5N_dbXBRWjEl88UsCCW068A90fytHXWgtrGlYksZomXGQlrDugSxyxjlY4_NPY Oct 27 03:40:37.142815 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:40:37.142815 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:40:37.142815 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:40:37.142815 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:40:37.142815 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:40:37.142815 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:40:37.142815 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 229dcb63bc41444391544883b576ce2e Oct 27 03:40:37.142815 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-AttachVolumeNegativeTest-199004901 Oct 27 03:40:37.142815 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:40:37.142815 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:40:37.142815 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/229dcb63bc41444391544883b576ce2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/229dcb63bc41444391544883b576ce2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/229dcb63bc41444391544883b576ce2e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_229dcb63bc41444391544883b576ce2e"}]}] Oct 27 03:40:37.142815 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-AttachVolumeNegativeTest-199004901 Oct 27 03:40:37.142815 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 229dcb63bc41444391544883b576ce2e Oct 27 03:40:37.142815 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-199004901 Oct 27 03:40:37.142815 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-AttachVolumeNegativeTest-199004901-project Oct 27 03:40:37.142815 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:40:37.142815 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:40:37.142815 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 18036411a99e4634bfbaeae24b9f254d Oct 27 03:40:37.142815 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-AttachVolumeNegativeTest-199004901-project Oct 27 03:40:37.142815 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:40:37.142815 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 611195a7-9a81-43eb-9d7d-6c29d80f5933 could not be found. Oct 27 03:40:37.142815 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '611195a7-9a81-43eb-9d7d-6c29d80f5933'} Oct 27 03:40:37.142815 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:40:37.142815 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:40:37.142815 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:40:37.142815 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:40:37.142815 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:40:37.142815 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:40:37.142815 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:40:37.142815 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:40:37.142815 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:40:37.142815 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:40:37.142815 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 611195a7-9a81-43eb-9d7d-6c29d80f5933 could not be found. Oct 27 03:40:37.142815 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:40:37.142815 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:40:37.142815 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:40:37.142815 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:40:37.142815 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:40:37.142815 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:40:37.142815 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:40:37.142815 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:40:37.142815 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:40:37.142815 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:40:37.142815 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:40:37.142815 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:40:37.142815 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:40:37.142815 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:40:37.142815 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:40:37.142815 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:40:37.142815 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 611195a7-9a81-43eb-9d7d-6c29d80f5933 could not be found. Oct 27 03:40:37.142815 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:40:37.142815 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:40:37.142815 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:40:37.147252 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:40:37.147252 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:40:37.147252 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:40:37.147252 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:40:37.147252 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:40:37.147252 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 611195a7-9a81-43eb-9d7d-6c29d80f5933 could not be found. Oct 27 03:40:37.147252 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:40:37.149984 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ae2895eb-4487-4773-b600-45ed9a12aa41 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Returning 404 to user: Instance 611195a7-9a81-43eb-9d7d-6c29d80f5933 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:40:37.151842 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ae2895eb-4487-4773-b600-45ed9a12aa41 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/611195a7-9a81-43eb-9d7d-6c29d80f5933" status: 404 len: 111 microversion: 2.1 time: 0.069478 Oct 27 03:40:37.154334 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2462/4651] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:37 2022] GET /compute/v2.1/servers/611195a7-9a81-43eb-9d7d-6c29d80f5933 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 03:40:37.164021 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-93236b3d-3392-428b-886e-554e4f34e922 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '.version_select at 0x7f7dd9c57790>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:37.265814 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-93236b3d-3392-428b-886e-554e4f34e922 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-100889886" status: 202 len: 0 microversion: 2.1 time: 0.107378 Oct 27 03:40:37.267168 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2463/4652] 10.222.0.20 () {58 vars in 1218 bytes} [Thu Oct 27 03:40:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-100889886 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:40:37.283561 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-4fd90ded-40ef-47ba-a36f-e5602b911d46 req-102484d8-2386-4657-bf6a-cc122034ac0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c8a2cbb-4acf-4a6b-b684-567617bb930d", "name": "network-vif-deleted", "tag": "05efbe65-e414-4934-8f17-a13f864d1dab"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:40:37.308544 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-4fd90ded-40ef-47ba-a36f-e5602b911d46 req-102484d8-2386-4657-bf6a-cc122034ac0b service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:37.310413 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-4fd90ded-40ef-47ba-a36f-e5602b911d46 req-102484d8-2386-4657-bf6a-cc122034ac0b service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:37.312685 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-4fd90ded-40ef-47ba-a36f-e5602b911d46 req-102484d8-2386-4657-bf6a-cc122034ac0b service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:37.344520 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-4fd90ded-40ef-47ba-a36f-e5602b911d46 req-102484d8-2386-4657-bf6a-cc122034ac0b service nova] Creating event network-vif-deleted:05efbe65-e414-4934-8f17-a13f864d1dab for instance 8c8a2cbb-4acf-4a6b-b684-567617bb930d on n-h2-862769-1 Oct 27 03:40:37.378721 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0173f6f1-ca39-412c-a8c9-585dd9e6ae9a tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba500c7bb654a649a57bb8c96aa8bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05672dc7b53747988fde6abc4adb2ef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:37.379433 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-4fd90ded-40ef-47ba-a36f-e5602b911d46 req-102484d8-2386-4657-bf6a-cc122034ac0b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088546 Oct 27 03:40:37.379433 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2464/4653] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:40:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:40:37.379592 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0173f6f1-ca39-412c-a8c9-585dd9e6ae9a tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] 10.222.0.20 "GET /compute/v2.1/servers/621fa99f-f6ef-4333-9e54-1820cb63e2ee" status: 200 len: 1317 microversion: 2.1 time: 0.402155 Oct 27 03:40:37.382437 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2190/4654] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:36 2022] GET /compute/v2.1/servers/621fa99f-f6ef-4333-9e54-1820cb63e2ee => generated 1317 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:40:37.507794 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-90eed87d-2b31-4fd8-a88d-ae7df90e7a44 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:37.508680 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-90eed87d-2b31-4fd8-a88d-ae7df90e7a44 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] [instance: 8c8a2cbb-4acf-4a6b-b684-567617bb930d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:37.519423 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-90eed87d-2b31-4fd8-a88d-ae7df90e7a44 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:37.519964 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-90eed87d-2b31-4fd8-a88d-ae7df90e7a44 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:37.520575 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-90eed87d-2b31-4fd8-a88d-ae7df90e7a44 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:37.521426 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-90eed87d-2b31-4fd8-a88d-ae7df90e7a44 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:37.521961 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-90eed87d-2b31-4fd8-a88d-ae7df90e7a44 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:37.522495 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-90eed87d-2b31-4fd8-a88d-ae7df90e7a44 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:37.593567 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-74740cd0-eba2-4fec-8587-ec93f233b218 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:37.594894 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-74740cd0-eba2-4fec-8587-ec93f233b218 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:37.606871 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-74740cd0-eba2-4fec-8587-ec93f233b218 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:37.607389 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-74740cd0-eba2-4fec-8587-ec93f233b218 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:37.607843 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-74740cd0-eba2-4fec-8587-ec93f233b218 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:37.608580 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-74740cd0-eba2-4fec-8587-ec93f233b218 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:37.618397 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-74740cd0-eba2-4fec-8587-ec93f233b218 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:37.618980 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-74740cd0-eba2-4fec-8587-ec93f233b218 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:37.797987 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-90eed87d-2b31-4fd8-a88d-ae7df90e7a44 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:37.818147 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-90eed87d-2b31-4fd8-a88d-ae7df90e7a44 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:37.820693 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-90eed87d-2b31-4fd8-a88d-ae7df90e7a44 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:37.825052 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-90eed87d-2b31-4fd8-a88d-ae7df90e7a44 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d" status: 200 len: 2872 microversion: 2.42 time: 0.320693 Oct 27 03:40:37.831613 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2465/4655] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:40:37 2022] GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d => generated 2872 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:40:37.843772 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d1ac95a3-e8e7-4707-a033-ba87b31b20bf tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:37.844644 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d1ac95a3-e8e7-4707-a033-ba87b31b20bf tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] [instance: cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:37.864649 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d1ac95a3-e8e7-4707-a033-ba87b31b20bf tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:37.865353 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d1ac95a3-e8e7-4707-a033-ba87b31b20bf tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:37.866940 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d1ac95a3-e8e7-4707-a033-ba87b31b20bf tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:37.868839 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d1ac95a3-e8e7-4707-a033-ba87b31b20bf tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:37.869471 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d1ac95a3-e8e7-4707-a033-ba87b31b20bf tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:37.871094 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d1ac95a3-e8e7-4707-a033-ba87b31b20bf tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:37.983829 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d1ac95a3-e8e7-4707-a033-ba87b31b20bf tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:38.021877 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d1ac95a3-e8e7-4707-a033-ba87b31b20bf tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:38.029944 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d1ac95a3-e8e7-4707-a033-ba87b31b20bf tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:38.032223 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d1ac95a3-e8e7-4707-a033-ba87b31b20bf tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29" status: 200 len: 1366 microversion: 2.57 time: 0.198356 Oct 27 03:40:38.034071 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2466/4656] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:40:37 2022] GET /compute/v2.1/servers/cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29 => generated 1366 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:40:38.040814 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-556bb9f5-00cd-4ef1-9edc-8a1a7ec74c23 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:38.041568 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-556bb9f5-00cd-4ef1-9edc-8a1a7ec74c23 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 9fa9583d-e294-4e5f-a6dc-a51d619dc03d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:38.062847 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-556bb9f5-00cd-4ef1-9edc-8a1a7ec74c23 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:38.063425 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-556bb9f5-00cd-4ef1-9edc-8a1a7ec74c23 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:38.063883 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-556bb9f5-00cd-4ef1-9edc-8a1a7ec74c23 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:38.064627 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-556bb9f5-00cd-4ef1-9edc-8a1a7ec74c23 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:38.065292 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-556bb9f5-00cd-4ef1-9edc-8a1a7ec74c23 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:38.066060 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-556bb9f5-00cd-4ef1-9edc-8a1a7ec74c23 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:38.086143 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-74740cd0-eba2-4fec-8587-ec93f233b218 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffc2b1c410149e884a47240b5425e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38450368ef5c4e68ac3c19c7a0a1ce65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:38.100181 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-74740cd0-eba2-4fec-8587-ec93f233b218 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b" status: 200 len: 1725 microversion: 2.1 time: 0.510564 Oct 27 03:40:38.103277 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2191/4657] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:37 2022] GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b => generated 1725 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:40:38.111618 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-9b88856b-f671-49f6-91ba-98709d72a91a req-33a31ce3-b9bf-4ce9-b72a-f8c536b0e3d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c8a2cbb-4acf-4a6b-b684-567617bb930d", "name": "network-vif-unplugged", "status": "completed", "tag": "be4d3f04-e26e-4f91-8a8f-ac908acaa7cc"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:40:38.127382 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-9b88856b-f671-49f6-91ba-98709d72a91a req-33a31ce3-b9bf-4ce9-b72a-f8c536b0e3d1 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:38.134466 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-9b88856b-f671-49f6-91ba-98709d72a91a req-33a31ce3-b9bf-4ce9-b72a-f8c536b0e3d1 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:38.134466 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-9b88856b-f671-49f6-91ba-98709d72a91a req-33a31ce3-b9bf-4ce9-b72a-f8c536b0e3d1 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:38.144106 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-9b88856b-f671-49f6-91ba-98709d72a91a req-33a31ce3-b9bf-4ce9-b72a-f8c536b0e3d1 service nova] Creating event network-vif-unplugged:be4d3f04-e26e-4f91-8a8f-ac908acaa7cc for instance 8c8a2cbb-4acf-4a6b-b684-567617bb930d on n-h2-862769-1 Oct 27 03:40:38.153363 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-9b88856b-f671-49f6-91ba-98709d72a91a req-33a31ce3-b9bf-4ce9-b72a-f8c536b0e3d1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048589 Oct 27 03:40:38.156775 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2192/4658] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:40:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:40:38.166216 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-fc984deb-35cf-44be-af9c-9eaae1bda6e7 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:38.167182 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-fc984deb-35cf-44be-af9c-9eaae1bda6e7 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:38.180477 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fc984deb-35cf-44be-af9c-9eaae1bda6e7 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:38.182058 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fc984deb-35cf-44be-af9c-9eaae1bda6e7 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:38.184918 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fc984deb-35cf-44be-af9c-9eaae1bda6e7 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:38.186890 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fc984deb-35cf-44be-af9c-9eaae1bda6e7 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:38.188317 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fc984deb-35cf-44be-af9c-9eaae1bda6e7 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:38.189790 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fc984deb-35cf-44be-af9c-9eaae1bda6e7 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:38.295280 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-556bb9f5-00cd-4ef1-9edc-8a1a7ec74c23 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:38.310070 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-556bb9f5-00cd-4ef1-9edc-8a1a7ec74c23 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d" status: 200 len: 1524 microversion: 2.1 time: 0.272339 Oct 27 03:40:38.310070 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2467/4659] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:38 2022] GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d => generated 1524 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:40:38.392050 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-fa924d64-3903-403b-aa15-706a41fddf9c tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:38.392780 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-fa924d64-3903-403b-aa15-706a41fddf9c tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] [instance: 621fa99f-f6ef-4333-9e54-1820cb63e2ee] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:38.399498 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fa924d64-3903-403b-aa15-706a41fddf9c tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:38.399997 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fa924d64-3903-403b-aa15-706a41fddf9c tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:38.400499 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fa924d64-3903-403b-aa15-706a41fddf9c tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:38.401363 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fa924d64-3903-403b-aa15-706a41fddf9c tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:38.401848 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fa924d64-3903-403b-aa15-706a41fddf9c tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:38.402384 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fa924d64-3903-403b-aa15-706a41fddf9c tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:38.599966 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-fa924d64-3903-403b-aa15-706a41fddf9c tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba500c7bb654a649a57bb8c96aa8bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05672dc7b53747988fde6abc4adb2ef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:38.609528 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-fa924d64-3903-403b-aa15-706a41fddf9c tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] 10.222.0.20 "GET /compute/v2.1/servers/621fa99f-f6ef-4333-9e54-1820cb63e2ee" status: 200 len: 1317 microversion: 2.1 time: 0.222035 Oct 27 03:40:38.611325 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2468/4660] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:38 2022] GET /compute/v2.1/servers/621fa99f-f6ef-4333-9e54-1820cb63e2ee => generated 1317 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:40:38.853230 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8376a33e-af35-49ea-bb9f-e5e3a1fa798e tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:38.853891 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8376a33e-af35-49ea-bb9f-e5e3a1fa798e tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] [instance: 8c8a2cbb-4acf-4a6b-b684-567617bb930d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:38.861417 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8376a33e-af35-49ea-bb9f-e5e3a1fa798e tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:38.861919 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8376a33e-af35-49ea-bb9f-e5e3a1fa798e tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:38.862401 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8376a33e-af35-49ea-bb9f-e5e3a1fa798e tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:38.863177 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8376a33e-af35-49ea-bb9f-e5e3a1fa798e tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:38.863815 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8376a33e-af35-49ea-bb9f-e5e3a1fa798e tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:38.864680 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8376a33e-af35-49ea-bb9f-e5e3a1fa798e tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:38.964154 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-fc984deb-35cf-44be-af9c-9eaae1bda6e7 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:38.974535 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-fc984deb-35cf-44be-af9c-9eaae1bda6e7 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:38.976470 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-fc984deb-35cf-44be-af9c-9eaae1bda6e7 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:38.978190 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-fc984deb-35cf-44be-af9c-9eaae1bda6e7 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79" status: 200 len: 1723 microversion: 2.20 time: 0.819867 Oct 27 03:40:38.999034 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2193/4661] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:40:38 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 => generated 1723 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:40:39.053775 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8376a33e-af35-49ea-bb9f-e5e3a1fa798e tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:39.066832 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b91824b1-3afe-4bda-8ed9-cf470adb5e9a tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:39.067884 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b91824b1-3afe-4bda-8ed9-cf470adb5e9a tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] [instance: cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:39.068976 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8376a33e-af35-49ea-bb9f-e5e3a1fa798e tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:39.070687 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8376a33e-af35-49ea-bb9f-e5e3a1fa798e tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:39.072735 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8376a33e-af35-49ea-bb9f-e5e3a1fa798e tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d" status: 200 len: 2712 microversion: 2.42 time: 0.224154 Oct 27 03:40:39.086284 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b91824b1-3afe-4bda-8ed9-cf470adb5e9a tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:39.086284 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b91824b1-3afe-4bda-8ed9-cf470adb5e9a tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:39.086284 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b91824b1-3afe-4bda-8ed9-cf470adb5e9a tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:39.086284 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b91824b1-3afe-4bda-8ed9-cf470adb5e9a tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:39.087610 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2469/4662] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:40:38 2022] GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d => generated 2712 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:40:39.093266 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b91824b1-3afe-4bda-8ed9-cf470adb5e9a tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:39.093266 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b91824b1-3afe-4bda-8ed9-cf470adb5e9a tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:39.132158 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-fc92c0a1-f96e-4f2c-835b-f24d62aa4a01 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:39.133155 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-fc92c0a1-f96e-4f2c-835b-f24d62aa4a01 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:39.139793 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fc92c0a1-f96e-4f2c-835b-f24d62aa4a01 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:39.141559 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fc92c0a1-f96e-4f2c-835b-f24d62aa4a01 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:39.142016 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fc92c0a1-f96e-4f2c-835b-f24d62aa4a01 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:39.145942 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fc92c0a1-f96e-4f2c-835b-f24d62aa4a01 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:39.145942 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fc92c0a1-f96e-4f2c-835b-f24d62aa4a01 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:39.145942 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fc92c0a1-f96e-4f2c-835b-f24d62aa4a01 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:39.282715 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b91824b1-3afe-4bda-8ed9-cf470adb5e9a tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:39.304430 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b91824b1-3afe-4bda-8ed9-cf470adb5e9a tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:39.306217 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b91824b1-3afe-4bda-8ed9-cf470adb5e9a tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:39.309358 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b91824b1-3afe-4bda-8ed9-cf470adb5e9a tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29" status: 200 len: 1366 microversion: 2.57 time: 0.248037 Oct 27 03:40:39.310335 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2194/4663] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:40:39 2022] GET /compute/v2.1/servers/cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29 => generated 1366 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:40:39.337799 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a2be6ed7-84c5-44f6-a994-8bd9bab6ce62 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:39.338082 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-fc92c0a1-f96e-4f2c-835b-f24d62aa4a01 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffc2b1c410149e884a47240b5425e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38450368ef5c4e68ac3c19c7a0a1ce65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:39.340524 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a2be6ed7-84c5-44f6-a994-8bd9bab6ce62 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 9fa9583d-e294-4e5f-a6dc-a51d619dc03d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:39.347771 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-fc92c0a1-f96e-4f2c-835b-f24d62aa4a01 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b" status: 200 len: 1702 microversion: 2.1 time: 0.221261 Oct 27 03:40:39.354275 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a2be6ed7-84c5-44f6-a994-8bd9bab6ce62 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:39.354275 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a2be6ed7-84c5-44f6-a994-8bd9bab6ce62 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:39.354528 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2470/4664] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:39 2022] GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b => generated 1702 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:40:39.366675 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a2be6ed7-84c5-44f6-a994-8bd9bab6ce62 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:39.372299 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a2be6ed7-84c5-44f6-a994-8bd9bab6ce62 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:39.372299 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a2be6ed7-84c5-44f6-a994-8bd9bab6ce62 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:39.372299 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a2be6ed7-84c5-44f6-a994-8bd9bab6ce62 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:39.372589 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-55b52d34-bbd5-4d4b-a6c0-19d242ab5937 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:40:39.381472 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-55b52d34-bbd5-4d4b-a6c0-19d242ab5937 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:39.392717 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-55b52d34-bbd5-4d4b-a6c0-19d242ab5937 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:39.393797 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-55b52d34-bbd5-4d4b-a6c0-19d242ab5937 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:39.429634 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-55b52d34-bbd5-4d4b-a6c0-19d242ab5937 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b] Going to try to start instance {{(pid=121001) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 27 03:40:39.659464 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a2be6ed7-84c5-44f6-a994-8bd9bab6ce62 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:39.670939 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a2be6ed7-84c5-44f6-a994-8bd9bab6ce62 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d" status: 200 len: 1524 microversion: 2.1 time: 0.338826 Oct 27 03:40:39.672252 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2195/4665] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:39 2022] GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d => generated 1524 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:40:39.679091 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-05095eff-3be3-482c-b7e6-09e17a8a720a req-1d234f27-3f8d-4afd-8942-7c24f57af35b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c8a2cbb-4acf-4a6b-b684-567617bb930d", "name": "network-vif-deleted", "tag": "be4d3f04-e26e-4f91-8a8f-ac908acaa7cc"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:40:39.691858 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-05095eff-3be3-482c-b7e6-09e17a8a720a req-1d234f27-3f8d-4afd-8942-7c24f57af35b service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:39.692349 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-05095eff-3be3-482c-b7e6-09e17a8a720a req-1d234f27-3f8d-4afd-8942-7c24f57af35b service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:39.692969 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-05095eff-3be3-482c-b7e6-09e17a8a720a req-1d234f27-3f8d-4afd-8942-7c24f57af35b service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:39.706748 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-05095eff-3be3-482c-b7e6-09e17a8a720a req-1d234f27-3f8d-4afd-8942-7c24f57af35b service nova] Creating event network-vif-deleted:be4d3f04-e26e-4f91-8a8f-ac908acaa7cc for instance 8c8a2cbb-4acf-4a6b-b684-567617bb930d on n-h2-862769-1 Oct 27 03:40:39.717433 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-05095eff-3be3-482c-b7e6-09e17a8a720a req-1d234f27-3f8d-4afd-8942-7c24f57af35b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043465 Oct 27 03:40:39.719287 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2196/4666] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:40:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:40:39.724883 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-57f55998-75ea-4c1b-86a1-20781efb322b tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Action: 'create', calling method: .version_select at 0x7f7ddee30310>, body: {"keypair": {"name": "tempest-keypair-210768671", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCliOVIEKSzpwOrcyVqAPk7tVATbfWIxy77/YQWPqA63zBMBX8QwDWsKdVmao3aFPPdbZGuJM2cLYck/iDCoe3yd4t9rFCzvF868Z28Tww9J8Nku8o8aIgWYXeEi2LVXXA=="}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:40:39.748105 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-57f55998-75ea-4c1b-86a1-20781efb322b tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Getting quotas for project 229dcb63bc41444391544883b576ce2e. Resources: {'key_pairs'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:40:39.754812 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-57f55998-75ea-4c1b-86a1-20781efb322b tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Getting quotas for user 18036411a99e4634bfbaeae24b9f254d and project 229dcb63bc41444391544883b576ce2e. Resources: {'key_pairs'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:40:39.908750 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-57f55998-75ea-4c1b-86a1-20781efb322b tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.188043 Oct 27 03:40:39.909545 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2197/4667] 10.222.0.20 () {60 vars in 1159 bytes} [Thu Oct 27 03:40:39 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:40:39.914207 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-fe649da2-1426-4462-a829-c9c490cc24ab tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:39.914999 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-fe649da2-1426-4462-a829-c9c490cc24ab tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] [instance: 621fa99f-f6ef-4333-9e54-1820cb63e2ee] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:39.930859 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fe649da2-1426-4462-a829-c9c490cc24ab tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:39.930859 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fe649da2-1426-4462-a829-c9c490cc24ab tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:39.930859 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fe649da2-1426-4462-a829-c9c490cc24ab tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:39.930859 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fe649da2-1426-4462-a829-c9c490cc24ab tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:39.930859 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fe649da2-1426-4462-a829-c9c490cc24ab tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:39.930859 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fe649da2-1426-4462-a829-c9c490cc24ab tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:39.955539 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-55b52d34-bbd5-4d4b-a6c0-19d242ab5937 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "POST /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b/action" status: 202 len: 0 microversion: 2.1 time: 0.587490 Oct 27 03:40:39.957074 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2471/4668] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:40:39 2022] POST /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b/action => generated 0 bytes in 590 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:40:39.972882 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2c439b81-6c91-43d5-95b1-38db0f3616ec tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:39.980738 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2c439b81-6c91-43d5-95b1-38db0f3616ec tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:40.008508 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2c439b81-6c91-43d5-95b1-38db0f3616ec tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:40.009897 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2c439b81-6c91-43d5-95b1-38db0f3616ec tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:40.010535 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2c439b81-6c91-43d5-95b1-38db0f3616ec tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:40.013621 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2c439b81-6c91-43d5-95b1-38db0f3616ec tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:40.014348 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2c439b81-6c91-43d5-95b1-38db0f3616ec tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:40.014967 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2c439b81-6c91-43d5-95b1-38db0f3616ec tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:40.289185 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2c439b81-6c91-43d5-95b1-38db0f3616ec tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffc2b1c410149e884a47240b5425e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38450368ef5c4e68ac3c19c7a0a1ce65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:40.298191 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2c439b81-6c91-43d5-95b1-38db0f3616ec tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b" status: 200 len: 1711 microversion: 2.1 time: 0.332715 Oct 27 03:40:40.299106 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2472/4669] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:39 2022] GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b => generated 1711 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:40:40.309640 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-da3e7a94-47f9-4b2d-806f-8ce030f37e0c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:40.309640 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-da3e7a94-47f9-4b2d-806f-8ce030f37e0c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:40.312376 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-da3e7a94-47f9-4b2d-806f-8ce030f37e0c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:40.312917 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-da3e7a94-47f9-4b2d-806f-8ce030f37e0c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:40.313369 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-da3e7a94-47f9-4b2d-806f-8ce030f37e0c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:40.314117 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-da3e7a94-47f9-4b2d-806f-8ce030f37e0c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:40.314587 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-da3e7a94-47f9-4b2d-806f-8ce030f37e0c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:40.315024 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-da3e7a94-47f9-4b2d-806f-8ce030f37e0c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:40.315852 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-fe649da2-1426-4462-a829-c9c490cc24ab tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba500c7bb654a649a57bb8c96aa8bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05672dc7b53747988fde6abc4adb2ef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:40.326385 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-fe649da2-1426-4462-a829-c9c490cc24ab tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] 10.222.0.20 "GET /compute/v2.1/servers/621fa99f-f6ef-4333-9e54-1820cb63e2ee" status: 200 len: 1317 microversion: 2.1 time: 0.415926 Oct 27 03:40:40.328929 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2198/4670] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:39 2022] GET /compute/v2.1/servers/621fa99f-f6ef-4333-9e54-1820cb63e2ee => generated 1317 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:40:40.352718 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3353e996-418b-4461-af30-be7013a9538e tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:40.355172 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-3353e996-418b-4461-af30-be7013a9538e tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] [instance: 8c8a2cbb-4acf-4a6b-b684-567617bb930d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:40.365819 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3353e996-418b-4461-af30-be7013a9538e tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:40.373057 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3353e996-418b-4461-af30-be7013a9538e tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:40.373057 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3353e996-418b-4461-af30-be7013a9538e tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:40.373057 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3353e996-418b-4461-af30-be7013a9538e tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:40.373057 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3353e996-418b-4461-af30-be7013a9538e tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:40.373057 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3353e996-418b-4461-af30-be7013a9538e tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:40.628530 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-da3e7a94-47f9-4b2d-806f-8ce030f37e0c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:40.638638 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-da3e7a94-47f9-4b2d-806f-8ce030f37e0c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:40.640232 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-da3e7a94-47f9-4b2d-806f-8ce030f37e0c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:40.641552 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-da3e7a94-47f9-4b2d-806f-8ce030f37e0c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79" status: 200 len: 1723 microversion: 2.20 time: 0.341471 Oct 27 03:40:40.642455 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2473/4671] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:40:40 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 => generated 1723 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:40:40.651778 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-3353e996-418b-4461-af30-be7013a9538e tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:40.663754 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-3353e996-418b-4461-af30-be7013a9538e tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:40.665538 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9e522621-cdfe-45ee-a8f8-e27217c940bf tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:40.666298 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-9e522621-cdfe-45ee-a8f8-e27217c940bf tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] [instance: cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:40.667366 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-3353e996-418b-4461-af30-be7013a9538e tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:40.669893 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3353e996-418b-4461-af30-be7013a9538e tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d" status: 200 len: 2551 microversion: 2.42 time: 0.330288 Oct 27 03:40:40.673168 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9e522621-cdfe-45ee-a8f8-e27217c940bf tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:40.673808 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9e522621-cdfe-45ee-a8f8-e27217c940bf tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:40.674455 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9e522621-cdfe-45ee-a8f8-e27217c940bf tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:40.674620 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2199/4672] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:40:40 2022] GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d => generated 2551 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:40:40.675328 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9e522621-cdfe-45ee-a8f8-e27217c940bf tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:40.675891 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9e522621-cdfe-45ee-a8f8-e27217c940bf tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:40.676567 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9e522621-cdfe-45ee-a8f8-e27217c940bf tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:40.685353 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-3635b8e5-ada2-479f-aed0-75300c987791 req-41d56fea-31dc-494d-b34b-09193c74a966 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d2f30ee-6086-48e1-8701-a8270012be0c", "name": "network-vif-plugged", "status": "completed", "tag": "2ea0c596-e9c9-43f8-bafe-b6f0a944e46e"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:40:40.706164 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-3635b8e5-ada2-479f-aed0-75300c987791 req-41d56fea-31dc-494d-b34b-09193c74a966 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:40.708481 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-3635b8e5-ada2-479f-aed0-75300c987791 req-41d56fea-31dc-494d-b34b-09193c74a966 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:40.709101 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-3635b8e5-ada2-479f-aed0-75300c987791 req-41d56fea-31dc-494d-b34b-09193c74a966 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:40.744568 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-3635b8e5-ada2-479f-aed0-75300c987791 req-41d56fea-31dc-494d-b34b-09193c74a966 service nova] Creating event network-vif-plugged:2ea0c596-e9c9-43f8-bafe-b6f0a944e46e for instance 6d2f30ee-6086-48e1-8701-a8270012be0c on n-h2-862769-1 Oct 27 03:40:40.751642 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-3635b8e5-ada2-479f-aed0-75300c987791 req-41d56fea-31dc-494d-b34b-09193c74a966 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075444 Oct 27 03:40:40.755540 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2200/4673] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:40:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:40:40.773759 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0ee64753-9121-454f-b876-a32dc4191626 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:40.779542 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0ee64753-9121-454f-b876-a32dc4191626 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 9fa9583d-e294-4e5f-a6dc-a51d619dc03d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:40.806531 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9e522621-cdfe-45ee-a8f8-e27217c940bf tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:40.809330 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0ee64753-9121-454f-b876-a32dc4191626 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:40.811585 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0ee64753-9121-454f-b876-a32dc4191626 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:40.812254 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0ee64753-9121-454f-b876-a32dc4191626 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:40.815369 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0ee64753-9121-454f-b876-a32dc4191626 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:40.816661 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0ee64753-9121-454f-b876-a32dc4191626 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:40.817479 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0ee64753-9121-454f-b876-a32dc4191626 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:40.818616 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9e522621-cdfe-45ee-a8f8-e27217c940bf tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:40.822412 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9e522621-cdfe-45ee-a8f8-e27217c940bf tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:40.827462 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9e522621-cdfe-45ee-a8f8-e27217c940bf tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29" status: 200 len: 1366 microversion: 2.57 time: 0.170756 Oct 27 03:40:40.842066 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2474/4674] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:40:40 2022] GET /compute/v2.1/servers/cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29 => generated 1366 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:40:41.175925 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0ee64753-9121-454f-b876-a32dc4191626 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:41.217972 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0ee64753-9121-454f-b876-a32dc4191626 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d" status: 200 len: 1524 microversion: 2.1 time: 0.460919 Oct 27 03:40:41.222741 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2201/4675] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:40 2022] GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d => generated 1524 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:40:41.326740 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-af35e1c2-e87c-45a9-860e-0372fba893b3 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:41.327234 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-af35e1c2-e87c-45a9-860e-0372fba893b3 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:41.336428 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-af35e1c2-e87c-45a9-860e-0372fba893b3 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:41.337727 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-af35e1c2-e87c-45a9-860e-0372fba893b3 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:41.338363 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-af35e1c2-e87c-45a9-860e-0372fba893b3 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:41.339229 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-af35e1c2-e87c-45a9-860e-0372fba893b3 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:41.340018 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-af35e1c2-e87c-45a9-860e-0372fba893b3 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:41.340594 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-af35e1c2-e87c-45a9-860e-0372fba893b3 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:41.356030 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-093ea945-faea-4c67-ab27-cad5c24b3df3 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:41.356692 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-093ea945-faea-4c67-ab27-cad5c24b3df3 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] [instance: 621fa99f-f6ef-4333-9e54-1820cb63e2ee] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:41.365206 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-093ea945-faea-4c67-ab27-cad5c24b3df3 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:41.365704 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-093ea945-faea-4c67-ab27-cad5c24b3df3 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:41.366176 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-093ea945-faea-4c67-ab27-cad5c24b3df3 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:41.366892 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-093ea945-faea-4c67-ab27-cad5c24b3df3 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:41.367370 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-093ea945-faea-4c67-ab27-cad5c24b3df3 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:41.367778 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-093ea945-faea-4c67-ab27-cad5c24b3df3 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:41.574358 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-af35e1c2-e87c-45a9-860e-0372fba893b3 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffc2b1c410149e884a47240b5425e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38450368ef5c4e68ac3c19c7a0a1ce65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:41.578253 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:40:41.583979 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-af35e1c2-e87c-45a9-860e-0372fba893b3 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b" status: 200 len: 1711 microversion: 2.1 time: 0.261354 Oct 27 03:40:41.598059 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2475/4676] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:41 2022] GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b => generated 1711 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:40:41.678120 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8258f347-8088-47e9-81a1-b3dbf882fc5b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:41.679255 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8258f347-8088-47e9-81a1-b3dbf882fc5b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:41.686826 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8258f347-8088-47e9-81a1-b3dbf882fc5b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:41.687591 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8258f347-8088-47e9-81a1-b3dbf882fc5b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:41.688304 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8258f347-8088-47e9-81a1-b3dbf882fc5b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:41.689235 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8258f347-8088-47e9-81a1-b3dbf882fc5b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:41.689916 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8258f347-8088-47e9-81a1-b3dbf882fc5b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:41.690592 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8258f347-8088-47e9-81a1-b3dbf882fc5b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:41.778071 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-093ea945-faea-4c67-ab27-cad5c24b3df3 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba500c7bb654a649a57bb8c96aa8bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05672dc7b53747988fde6abc4adb2ef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:41.790378 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-093ea945-faea-4c67-ab27-cad5c24b3df3 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] 10.222.0.20 "GET /compute/v2.1/servers/621fa99f-f6ef-4333-9e54-1820cb63e2ee" status: 200 len: 1317 microversion: 2.1 time: 0.438667 Oct 27 03:40:41.791673 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2202/4677] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:41 2022] GET /compute/v2.1/servers/621fa99f-f6ef-4333-9e54-1820cb63e2ee => generated 1317 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:40:41.818710 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c99aad10-8ab8-4d43-822c-c3d9b19c1abb tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:41.819621 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c99aad10-8ab8-4d43-822c-c3d9b19c1abb tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] [instance: 8c8a2cbb-4acf-4a6b-b684-567617bb930d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:41.825260 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:40:41.851975 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c99aad10-8ab8-4d43-822c-c3d9b19c1abb tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:41.853322 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c99aad10-8ab8-4d43-822c-c3d9b19c1abb tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:41.856599 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c99aad10-8ab8-4d43-822c-c3d9b19c1abb tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:41.857589 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c99aad10-8ab8-4d43-822c-c3d9b19c1abb tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:41.858101 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c99aad10-8ab8-4d43-822c-c3d9b19c1abb tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:41.867053 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c99aad10-8ab8-4d43-822c-c3d9b19c1abb tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:41.880849 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8258f347-8088-47e9-81a1-b3dbf882fc5b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:41.916662 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8258f347-8088-47e9-81a1-b3dbf882fc5b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:41.921452 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8258f347-8088-47e9-81a1-b3dbf882fc5b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:41.924383 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8258f347-8088-47e9-81a1-b3dbf882fc5b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79" status: 200 len: 1723 microversion: 2.20 time: 0.257521 Oct 27 03:40:41.925658 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2476/4678] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:40:41 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 => generated 1723 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:40:41.930824 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-0af1b968-cb0c-4aa8-9638-f7d09354d445 req-bad79f50-1cd1-4c90-8b3c-9b74b043e18f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c8a2cbb-4acf-4a6b-b684-567617bb930d", "name": "network-vif-deleted", "tag": "2e9b0521-8b60-4153-8c0a-3a8fbe3a87fe"}, {"server_uuid": "8c8a2cbb-4acf-4a6b-b684-567617bb930d", "name": "network-vif-deleted", "tag": "67feebc0-6f53-4380-af0b-a0f8be99846e"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:40:41.950477 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-0af1b968-cb0c-4aa8-9638-f7d09354d445 req-bad79f50-1cd1-4c90-8b3c-9b74b043e18f service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:41.958720 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-0af1b968-cb0c-4aa8-9638-f7d09354d445 req-bad79f50-1cd1-4c90-8b3c-9b74b043e18f service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:41.958720 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-0af1b968-cb0c-4aa8-9638-f7d09354d445 req-bad79f50-1cd1-4c90-8b3c-9b74b043e18f service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:41.967294 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-0af1b968-cb0c-4aa8-9638-f7d09354d445 req-bad79f50-1cd1-4c90-8b3c-9b74b043e18f service nova] Creating event network-vif-deleted:2e9b0521-8b60-4153-8c0a-3a8fbe3a87fe for instance 8c8a2cbb-4acf-4a6b-b684-567617bb930d on n-h2-862769-1 Oct 27 03:40:41.968069 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-0af1b968-cb0c-4aa8-9638-f7d09354d445 req-bad79f50-1cd1-4c90-8b3c-9b74b043e18f service nova] Creating event network-vif-deleted:67feebc0-6f53-4380-af0b-a0f8be99846e for instance 8c8a2cbb-4acf-4a6b-b684-567617bb930d on n-h2-862769-1 Oct 27 03:40:41.981330 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-0af1b968-cb0c-4aa8-9638-f7d09354d445 req-bad79f50-1cd1-4c90-8b3c-9b74b043e18f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.054049 Oct 27 03:40:41.990332 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2477/4679] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:40:41 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:40:41.994424 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-fed4460a-c5f7-486e-b29e-b40c9b619fb9 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:41.995385 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-fed4460a-c5f7-486e-b29e-b40c9b619fb9 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] [instance: cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:42.004283 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fed4460a-c5f7-486e-b29e-b40c9b619fb9 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:42.005120 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fed4460a-c5f7-486e-b29e-b40c9b619fb9 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:42.005834 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fed4460a-c5f7-486e-b29e-b40c9b619fb9 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:42.007189 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fed4460a-c5f7-486e-b29e-b40c9b619fb9 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:42.007865 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fed4460a-c5f7-486e-b29e-b40c9b619fb9 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:42.008847 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fed4460a-c5f7-486e-b29e-b40c9b619fb9 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:42.155900 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-fed4460a-c5f7-486e-b29e-b40c9b619fb9 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:42.197189 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c99aad10-8ab8-4d43-822c-c3d9b19c1abb tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:42.208558 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c99aad10-8ab8-4d43-822c-c3d9b19c1abb tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:42.214571 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c99aad10-8ab8-4d43-822c-c3d9b19c1abb tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:42.217014 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-fed4460a-c5f7-486e-b29e-b40c9b619fb9 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:42.218751 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c99aad10-8ab8-4d43-822c-c3d9b19c1abb tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d" status: 200 len: 2504 microversion: 2.42 time: 0.425407 Oct 27 03:40:42.220995 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-fed4460a-c5f7-486e-b29e-b40c9b619fb9 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:42.221852 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2203/4680] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:40:41 2022] GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d => generated 2504 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:40:42.230730 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-fed4460a-c5f7-486e-b29e-b40c9b619fb9 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29" status: 200 len: 1372 microversion: 2.57 time: 0.234661 Oct 27 03:40:42.242050 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2478/4681] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:40:41 2022] GET /compute/v2.1/servers/cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29 => generated 1372 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:40:42.250634 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-dd761326-f95c-41c6-8299-3dd7538f8074 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:42.251489 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-dd761326-f95c-41c6-8299-3dd7538f8074 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 9fa9583d-e294-4e5f-a6dc-a51d619dc03d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:42.264041 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dd761326-f95c-41c6-8299-3dd7538f8074 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:42.266569 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dd761326-f95c-41c6-8299-3dd7538f8074 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:42.267109 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dd761326-f95c-41c6-8299-3dd7538f8074 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:42.269363 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dd761326-f95c-41c6-8299-3dd7538f8074 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:42.270057 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dd761326-f95c-41c6-8299-3dd7538f8074 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:42.275213 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dd761326-f95c-41c6-8299-3dd7538f8074 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:42.547763 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-dd761326-f95c-41c6-8299-3dd7538f8074 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:42.569088 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-dd761326-f95c-41c6-8299-3dd7538f8074 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d" status: 200 len: 1524 microversion: 2.1 time: 0.318927 Oct 27 03:40:42.574188 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2204/4682] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:42 2022] GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d => generated 1524 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:40:42.608459 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-683edb67-c00a-4a84-ab98-55148e25057e tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:42.609085 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-683edb67-c00a-4a84-ab98-55148e25057e tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:42.620939 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-683edb67-c00a-4a84-ab98-55148e25057e tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:42.621628 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-683edb67-c00a-4a84-ab98-55148e25057e tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:42.622085 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-683edb67-c00a-4a84-ab98-55148e25057e tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:42.622965 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-683edb67-c00a-4a84-ab98-55148e25057e tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:42.623569 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-683edb67-c00a-4a84-ab98-55148e25057e tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:42.624144 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-683edb67-c00a-4a84-ab98-55148e25057e tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:42.818075 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-6202bca0-0f23-4f77-b47d-055cb7dd8bb3 req-29b040f8-c473-4793-8f84-87c371a27f8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "621fa99f-f6ef-4333-9e54-1820cb63e2ee", "name": "network-vif-plugged", "status": "completed", "tag": "d51a47e3-8013-48e0-aea2-a32501a5465e"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:40:42.858609 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-6202bca0-0f23-4f77-b47d-055cb7dd8bb3 req-29b040f8-c473-4793-8f84-87c371a27f8d service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:42.859148 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-6202bca0-0f23-4f77-b47d-055cb7dd8bb3 req-29b040f8-c473-4793-8f84-87c371a27f8d service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:42.859604 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-6202bca0-0f23-4f77-b47d-055cb7dd8bb3 req-29b040f8-c473-4793-8f84-87c371a27f8d service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:42.896981 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-6202bca0-0f23-4f77-b47d-055cb7dd8bb3 req-29b040f8-c473-4793-8f84-87c371a27f8d service nova] Creating event network-vif-plugged:d51a47e3-8013-48e0-aea2-a32501a5465e for instance 621fa99f-f6ef-4333-9e54-1820cb63e2ee on n-h2-862769-1 Oct 27 03:40:42.907627 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-6202bca0-0f23-4f77-b47d-055cb7dd8bb3 req-29b040f8-c473-4793-8f84-87c371a27f8d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094959 Oct 27 03:40:42.910684 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2205/4683] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:40:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:40:42.920773 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a93eb846-5d70-48ff-b068-af4d85521eb4 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:42.922659 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a93eb846-5d70-48ff-b068-af4d85521eb4 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] [instance: 621fa99f-f6ef-4333-9e54-1820cb63e2ee] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:42.938252 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a93eb846-5d70-48ff-b068-af4d85521eb4 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:42.939114 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a93eb846-5d70-48ff-b068-af4d85521eb4 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:42.940439 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a93eb846-5d70-48ff-b068-af4d85521eb4 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:42.943887 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a93eb846-5d70-48ff-b068-af4d85521eb4 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:42.946849 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a93eb846-5d70-48ff-b068-af4d85521eb4 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:42.947342 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a93eb846-5d70-48ff-b068-af4d85521eb4 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:42.970264 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-683edb67-c00a-4a84-ab98-55148e25057e tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffc2b1c410149e884a47240b5425e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38450368ef5c4e68ac3c19c7a0a1ce65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:42.985419 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-683edb67-c00a-4a84-ab98-55148e25057e tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b" status: 200 len: 1711 microversion: 2.1 time: 0.374763 Oct 27 03:40:42.987271 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2479/4684] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:42 2022] GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b => generated 1711 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:40:43.015154 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a2fc577b-81d2-4fdf-b60f-3cd0e89b563d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:43.016602 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a2fc577b-81d2-4fdf-b60f-3cd0e89b563d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:43.041302 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a2fc577b-81d2-4fdf-b60f-3cd0e89b563d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:43.041802 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a2fc577b-81d2-4fdf-b60f-3cd0e89b563d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:43.042281 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a2fc577b-81d2-4fdf-b60f-3cd0e89b563d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:43.043258 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a2fc577b-81d2-4fdf-b60f-3cd0e89b563d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:43.043717 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a2fc577b-81d2-4fdf-b60f-3cd0e89b563d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:43.048629 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a2fc577b-81d2-4fdf-b60f-3cd0e89b563d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:43.381951 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a2fc577b-81d2-4fdf-b60f-3cd0e89b563d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:43.400251 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a2fc577b-81d2-4fdf-b60f-3cd0e89b563d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:43.405673 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a2fc577b-81d2-4fdf-b60f-3cd0e89b563d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:43.408075 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a2fc577b-81d2-4fdf-b60f-3cd0e89b563d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79" status: 200 len: 1723 microversion: 2.20 time: 0.403281 Oct 27 03:40:43.410912 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2480/4685] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:40:43 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 => generated 1723 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:40:43.425738 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7c2f9bc9-ba37-450d-ab65-fdecf6b44279 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:43.426716 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7c2f9bc9-ba37-450d-ab65-fdecf6b44279 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] [instance: 8c8a2cbb-4acf-4a6b-b684-567617bb930d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:43.442703 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7c2f9bc9-ba37-450d-ab65-fdecf6b44279 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:43.445707 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7c2f9bc9-ba37-450d-ab65-fdecf6b44279 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:43.446511 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7c2f9bc9-ba37-450d-ab65-fdecf6b44279 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:43.448015 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7c2f9bc9-ba37-450d-ab65-fdecf6b44279 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:43.449307 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7c2f9bc9-ba37-450d-ab65-fdecf6b44279 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:43.450377 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7c2f9bc9-ba37-450d-ab65-fdecf6b44279 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:43.626781 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7c2f9bc9-ba37-450d-ab65-fdecf6b44279 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:43.656665 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7c2f9bc9-ba37-450d-ab65-fdecf6b44279 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:43.669758 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7c2f9bc9-ba37-450d-ab65-fdecf6b44279 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:43.675714 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7c2f9bc9-ba37-450d-ab65-fdecf6b44279 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d" status: 200 len: 1603 microversion: 2.42 time: 0.262279 Oct 27 03:40:43.679262 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2481/4686] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:40:43 2022] GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d => generated 1603 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:40:43.697661 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8541d963-baca-4959-85e0-d24e780020c7 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:43.700380 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8541d963-baca-4959-85e0-d24e780020c7 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] [instance: cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:43.730860 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8541d963-baca-4959-85e0-d24e780020c7 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:43.732021 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8541d963-baca-4959-85e0-d24e780020c7 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:43.733234 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8541d963-baca-4959-85e0-d24e780020c7 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:43.734885 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8541d963-baca-4959-85e0-d24e780020c7 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:43.736940 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8541d963-baca-4959-85e0-d24e780020c7 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:43.737660 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8541d963-baca-4959-85e0-d24e780020c7 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:43.820886 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a93eb846-5d70-48ff-b068-af4d85521eb4 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba500c7bb654a649a57bb8c96aa8bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05672dc7b53747988fde6abc4adb2ef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:43.836931 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a93eb846-5d70-48ff-b068-af4d85521eb4 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] 10.222.0.20 "GET /compute/v2.1/servers/621fa99f-f6ef-4333-9e54-1820cb63e2ee" status: 200 len: 1317 microversion: 2.1 time: 0.923583 Oct 27 03:40:43.837748 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2206/4687] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:42 2022] GET /compute/v2.1/servers/621fa99f-f6ef-4333-9e54-1820cb63e2ee => generated 1317 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:40:43.842716 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8c22e918-37c0-4706-931f-c1615aa672cd tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:43.845602 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8c22e918-37c0-4706-931f-c1615aa672cd tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 9fa9583d-e294-4e5f-a6dc-a51d619dc03d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:43.859776 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8c22e918-37c0-4706-931f-c1615aa672cd tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:43.860513 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8c22e918-37c0-4706-931f-c1615aa672cd tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:43.861107 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8c22e918-37c0-4706-931f-c1615aa672cd tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:43.862062 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8c22e918-37c0-4706-931f-c1615aa672cd tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:43.865184 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8c22e918-37c0-4706-931f-c1615aa672cd tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:43.865902 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8c22e918-37c0-4706-931f-c1615aa672cd tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:43.950323 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8541d963-baca-4959-85e0-d24e780020c7 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:43.964720 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8541d963-baca-4959-85e0-d24e780020c7 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:43.966462 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8541d963-baca-4959-85e0-d24e780020c7 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:43.967842 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8541d963-baca-4959-85e0-d24e780020c7 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29" status: 200 len: 1372 microversion: 2.57 time: 0.286957 Oct 27 03:40:43.970723 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2482/4688] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:40:43 2022] GET /compute/v2.1/servers/cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29 => generated 1372 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:40:44.012008 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e310fdea-4f39-4550-a56e-a1c0b4049626 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:44.013058 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e310fdea-4f39-4550-a56e-a1c0b4049626 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:44.024856 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e310fdea-4f39-4550-a56e-a1c0b4049626 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:44.025611 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e310fdea-4f39-4550-a56e-a1c0b4049626 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:44.027725 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e310fdea-4f39-4550-a56e-a1c0b4049626 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:44.029886 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e310fdea-4f39-4550-a56e-a1c0b4049626 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:44.030602 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e310fdea-4f39-4550-a56e-a1c0b4049626 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:44.031386 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e310fdea-4f39-4550-a56e-a1c0b4049626 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:44.186281 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8c22e918-37c0-4706-931f-c1615aa672cd tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:44.194533 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8c22e918-37c0-4706-931f-c1615aa672cd tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d" status: 200 len: 1524 microversion: 2.1 time: 0.355477 Oct 27 03:40:44.195125 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2207/4689] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:43 2022] GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d => generated 1524 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:40:44.202138 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-5615b018-c1ee-435d-a4e5-78468b4b475b req-bfc83403-b2c0-42e7-912e-6332bd3f4ba3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c8a2cbb-4acf-4a6b-b684-567617bb930d", "name": "network-vif-deleted", "tag": "3a1ccaa7-51b5-4235-87d4-b3c14e28f77b"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:40:44.213454 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-5615b018-c1ee-435d-a4e5-78468b4b475b req-bfc83403-b2c0-42e7-912e-6332bd3f4ba3 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:44.214188 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-5615b018-c1ee-435d-a4e5-78468b4b475b req-bfc83403-b2c0-42e7-912e-6332bd3f4ba3 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:44.214774 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-5615b018-c1ee-435d-a4e5-78468b4b475b req-bfc83403-b2c0-42e7-912e-6332bd3f4ba3 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:44.225373 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=100 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:40:44.237756 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-5615b018-c1ee-435d-a4e5-78468b4b475b req-bfc83403-b2c0-42e7-912e-6332bd3f4ba3 service nova] Creating event network-vif-deleted:3a1ccaa7-51b5-4235-87d4-b3c14e28f77b for instance 8c8a2cbb-4acf-4a6b-b684-567617bb930d on n-h2-862769-1 Oct 27 03:40:44.260536 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-5615b018-c1ee-435d-a4e5-78468b4b475b req-bfc83403-b2c0-42e7-912e-6332bd3f4ba3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062728 Oct 27 03:40:44.272694 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2208/4690] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:40:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:40:44.396209 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e310fdea-4f39-4550-a56e-a1c0b4049626 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffc2b1c410149e884a47240b5425e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38450368ef5c4e68ac3c19c7a0a1ce65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:44.404984 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e310fdea-4f39-4550-a56e-a1c0b4049626 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b" status: 200 len: 1711 microversion: 2.1 time: 0.397372 Oct 27 03:40:44.405582 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2483/4691] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:44 2022] GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b => generated 1711 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:40:44.461898 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7a9b9e7c-0e2d-436d-a846-f0f707886ad4 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:44.463019 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7a9b9e7c-0e2d-436d-a846-f0f707886ad4 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:44.483359 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7a9b9e7c-0e2d-436d-a846-f0f707886ad4 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:44.485240 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7a9b9e7c-0e2d-436d-a846-f0f707886ad4 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:44.485860 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7a9b9e7c-0e2d-436d-a846-f0f707886ad4 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:44.492260 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7a9b9e7c-0e2d-436d-a846-f0f707886ad4 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:44.493726 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7a9b9e7c-0e2d-436d-a846-f0f707886ad4 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:44.495836 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7a9b9e7c-0e2d-436d-a846-f0f707886ad4 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:44.587206 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a2b961d4-7614-458b-9fdc-b537429497ba tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1193426650", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "015ce8ac-7a6f-4fac-a9b8-c0d16c24afe3"}], "security_groups": [{"name": "tempest-securitygroup--1698207007"}], "key_name": "tempest-keypair-210768671", "user_data": "}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:40:44.742388 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7a9b9e7c-0e2d-436d-a846-f0f707886ad4 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:44.759623 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7a9b9e7c-0e2d-436d-a846-f0f707886ad4 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:44.763326 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7a9b9e7c-0e2d-436d-a846-f0f707886ad4 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:44.766944 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-a2b961d4-7614-458b-9fdc-b537429497ba tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] validate_networks() for [('015ce8ac-7a6f-4fac-a9b8-c0d16c24afe3', None, None, None, None, None)] {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:40:44.769010 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7a9b9e7c-0e2d-436d-a846-f0f707886ad4 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79" status: 200 len: 1723 microversion: 2.20 time: 0.312061 Oct 27 03:40:44.770007 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2484/4692] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:40:44 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 => generated 1723 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:40:44.778137 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ed56c6f8-5208-4eb4-8f7e-e75a01ebbafd tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:44.788232 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ed56c6f8-5208-4eb4-8f7e-e75a01ebbafd tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] [instance: 8c8a2cbb-4acf-4a6b-b684-567617bb930d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:44.816381 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ed56c6f8-5208-4eb4-8f7e-e75a01ebbafd tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:44.817557 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ed56c6f8-5208-4eb4-8f7e-e75a01ebbafd tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:44.820064 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ed56c6f8-5208-4eb4-8f7e-e75a01ebbafd tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:44.821156 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ed56c6f8-5208-4eb4-8f7e-e75a01ebbafd tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:44.825690 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ed56c6f8-5208-4eb4-8f7e-e75a01ebbafd tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:44.833361 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ed56c6f8-5208-4eb4-8f7e-e75a01ebbafd tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:44.991982 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ed56c6f8-5208-4eb4-8f7e-e75a01ebbafd tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:45.007593 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ed56c6f8-5208-4eb4-8f7e-e75a01ebbafd tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:45.009617 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ed56c6f8-5208-4eb4-8f7e-e75a01ebbafd tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:45.010859 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ed56c6f8-5208-4eb4-8f7e-e75a01ebbafd tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d" status: 200 len: 1603 microversion: 2.42 time: 0.239768 Oct 27 03:40:45.042210 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2485/4693] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:40:44 2022] GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d => generated 1603 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:40:45.056304 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e28d1b45-a6e6-419f-9963-c1b765e37f80 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:45.057272 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e28d1b45-a6e6-419f-9963-c1b765e37f80 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] [instance: 621fa99f-f6ef-4333-9e54-1820cb63e2ee] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:45.097655 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e28d1b45-a6e6-419f-9963-c1b765e37f80 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:45.100520 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e28d1b45-a6e6-419f-9963-c1b765e37f80 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:45.109575 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e28d1b45-a6e6-419f-9963-c1b765e37f80 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:45.109575 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e28d1b45-a6e6-419f-9963-c1b765e37f80 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:45.109920 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e28d1b45-a6e6-419f-9963-c1b765e37f80 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:45.110727 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e28d1b45-a6e6-419f-9963-c1b765e37f80 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:45.341626 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e28d1b45-a6e6-419f-9963-c1b765e37f80 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba500c7bb654a649a57bb8c96aa8bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05672dc7b53747988fde6abc4adb2ef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:45.351399 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e28d1b45-a6e6-419f-9963-c1b765e37f80 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] 10.222.0.20 "GET /compute/v2.1/servers/621fa99f-f6ef-4333-9e54-1820cb63e2ee" status: 200 len: 1317 microversion: 2.1 time: 0.305976 Oct 27 03:40:45.353265 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2486/4694] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:45 2022] GET /compute/v2.1/servers/621fa99f-f6ef-4333-9e54-1820cb63e2ee => generated 1317 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:40:45.358258 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3e2a9ffa-396a-4a57-8028-e80160210f98 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:45.359066 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3e2a9ffa-396a-4a57-8028-e80160210f98 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] [instance: cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:45.366262 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3e2a9ffa-396a-4a57-8028-e80160210f98 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:45.366952 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3e2a9ffa-396a-4a57-8028-e80160210f98 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:45.367543 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3e2a9ffa-396a-4a57-8028-e80160210f98 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:45.369455 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3e2a9ffa-396a-4a57-8028-e80160210f98 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:45.370237 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3e2a9ffa-396a-4a57-8028-e80160210f98 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:45.370869 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3e2a9ffa-396a-4a57-8028-e80160210f98 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:45.469858 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3e2a9ffa-396a-4a57-8028-e80160210f98 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:45.483261 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3e2a9ffa-396a-4a57-8028-e80160210f98 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:45.485507 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3e2a9ffa-396a-4a57-8028-e80160210f98 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:45.486516 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3e2a9ffa-396a-4a57-8028-e80160210f98 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29" status: 200 len: 1357 microversion: 2.57 time: 0.132002 Oct 27 03:40:45.495304 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2487/4695] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:40:45 2022] GET /compute/v2.1/servers/cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29 => generated 1357 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:40:45.504345 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-893d81db-d207-4ef2-b830-03f5b02ab9c7 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:45.507576 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-893d81db-d207-4ef2-b830-03f5b02ab9c7 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 9fa9583d-e294-4e5f-a6dc-a51d619dc03d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:45.528188 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-893d81db-d207-4ef2-b830-03f5b02ab9c7 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:45.528852 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-893d81db-d207-4ef2-b830-03f5b02ab9c7 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:45.529897 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-893d81db-d207-4ef2-b830-03f5b02ab9c7 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:45.533350 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-893d81db-d207-4ef2-b830-03f5b02ab9c7 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:45.533995 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-893d81db-d207-4ef2-b830-03f5b02ab9c7 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:45.534599 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-893d81db-d207-4ef2-b830-03f5b02ab9c7 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:45.576417 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-a2b961d4-7614-458b-9fdc-b537429497ba tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:40:45.576981 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-a2b961d4-7614-458b-9fdc-b537429497ba tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:40:45.577508 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-a2b961d4-7614-458b-9fdc-b537429497ba tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:40:45.578011 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-a2b961d4-7614-458b-9fdc-b537429497ba tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:40:45.578590 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-a2b961d4-7614-458b-9fdc-b537429497ba tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:40:45.590841 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a2b961d4-7614-458b-9fdc-b537429497ba tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:45.591705 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a2b961d4-7614-458b-9fdc-b537429497ba tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:45.594710 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a2b961d4-7614-458b-9fdc-b537429497ba tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:45.594710 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a2b961d4-7614-458b-9fdc-b537429497ba tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:45.594710 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a2b961d4-7614-458b-9fdc-b537429497ba tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:45.594710 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a2b961d4-7614-458b-9fdc-b537429497ba tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:45.616556 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-a2b961d4-7614-458b-9fdc-b537429497ba tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Getting quotas for project 229dcb63bc41444391544883b576ce2e. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:40:45.623960 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-a2b961d4-7614-458b-9fdc-b537429497ba tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Getting quotas for user 18036411a99e4634bfbaeae24b9f254d and project 229dcb63bc41444391544883b576ce2e. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:40:45.640552 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a2b961d4-7614-458b-9fdc-b537429497ba tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:40:45.643605 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a2b961d4-7614-458b-9fdc-b537429497ba tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: 003c8652-2a85-4abc-8f02-ff46b4afcfd1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:40:45.732653 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-893d81db-d207-4ef2-b830-03f5b02ab9c7 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:45.740653 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-893d81db-d207-4ef2-b830-03f5b02ab9c7 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d" status: 200 len: 1524 microversion: 2.1 time: 0.246465 Oct 27 03:40:45.752282 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2488/4696] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:45 2022] GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d => generated 1524 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:40:45.752282 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-22b1c9f9-83cf-4faf-9c24-d5fee5e08843 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:45.752282 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-22b1c9f9-83cf-4faf-9c24-d5fee5e08843 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:45.753036 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-22b1c9f9-83cf-4faf-9c24-d5fee5e08843 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:45.753293 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-22b1c9f9-83cf-4faf-9c24-d5fee5e08843 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:45.753964 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-22b1c9f9-83cf-4faf-9c24-d5fee5e08843 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:45.754871 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-22b1c9f9-83cf-4faf-9c24-d5fee5e08843 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:45.755501 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-22b1c9f9-83cf-4faf-9c24-d5fee5e08843 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:45.756068 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-22b1c9f9-83cf-4faf-9c24-d5fee5e08843 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:45.900577 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-22b1c9f9-83cf-4faf-9c24-d5fee5e08843 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffc2b1c410149e884a47240b5425e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38450368ef5c4e68ac3c19c7a0a1ce65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:45.909969 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-22b1c9f9-83cf-4faf-9c24-d5fee5e08843 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b" status: 200 len: 1715 microversion: 2.1 time: 0.167184 Oct 27 03:40:45.910612 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2489/4697] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:45 2022] GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b => generated 1715 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:40:45.925727 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1e789ac3-da11-47e7-b9d2-e01167381ce1 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:45.925727 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1e789ac3-da11-47e7-b9d2-e01167381ce1 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] [instance: cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:45.925727 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1e789ac3-da11-47e7-b9d2-e01167381ce1 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:45.925727 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1e789ac3-da11-47e7-b9d2-e01167381ce1 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:45.925727 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1e789ac3-da11-47e7-b9d2-e01167381ce1 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:45.925727 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1e789ac3-da11-47e7-b9d2-e01167381ce1 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:45.925727 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1e789ac3-da11-47e7-b9d2-e01167381ce1 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:45.925727 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1e789ac3-da11-47e7-b9d2-e01167381ce1 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:45.950845 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1e789ac3-da11-47e7-b9d2-e01167381ce1 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] [instance: cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29] Going to try to terminate instance {{(pid=121001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:40:46.101913 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a2b961d4-7614-458b-9fdc-b537429497ba tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.657208 Oct 27 03:40:46.109327 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2209/4698] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:40:44 2022] POST /compute/v2.1/servers => generated 402 bytes in 1660 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 03:40:46.109327 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8640a062-01eb-4f20-9ee9-ddeedb170bf8 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:46.109327 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8640a062-01eb-4f20-9ee9-ddeedb170bf8 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:46.115029 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8640a062-01eb-4f20-9ee9-ddeedb170bf8 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:46.115525 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8640a062-01eb-4f20-9ee9-ddeedb170bf8 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:46.115977 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8640a062-01eb-4f20-9ee9-ddeedb170bf8 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:46.116687 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8640a062-01eb-4f20-9ee9-ddeedb170bf8 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:46.117155 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8640a062-01eb-4f20-9ee9-ddeedb170bf8 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:46.117589 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8640a062-01eb-4f20-9ee9-ddeedb170bf8 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:46.325199 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8640a062-01eb-4f20-9ee9-ddeedb170bf8 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:46.338346 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8640a062-01eb-4f20-9ee9-ddeedb170bf8 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:46.353150 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8640a062-01eb-4f20-9ee9-ddeedb170bf8 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:46.353150 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8640a062-01eb-4f20-9ee9-ddeedb170bf8 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79" status: 200 len: 1723 microversion: 2.20 time: 0.236829 Oct 27 03:40:46.353150 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2210/4699] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:40:46 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 => generated 1723 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:40:46.365545 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-569de9ee-f75b-4420-8094-6650619b9a09 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:46.368987 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-569de9ee-f75b-4420-8094-6650619b9a09 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] [instance: 8c8a2cbb-4acf-4a6b-b684-567617bb930d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:46.380533 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-569de9ee-f75b-4420-8094-6650619b9a09 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:46.381031 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-569de9ee-f75b-4420-8094-6650619b9a09 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:46.381477 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-569de9ee-f75b-4420-8094-6650619b9a09 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:46.382220 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-569de9ee-f75b-4420-8094-6650619b9a09 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:46.382701 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-569de9ee-f75b-4420-8094-6650619b9a09 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:46.383162 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-569de9ee-f75b-4420-8094-6650619b9a09 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:46.448400 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1e789ac3-da11-47e7-b9d2-e01167381ce1 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] 10.222.0.20 "DELETE /compute/v2.1/servers/cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29" status: 204 len: 0 microversion: 2.57 time: 0.536029 Oct 27 03:40:46.453031 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2490/4700] 10.222.0.20 () {60 vars in 1280 bytes} [Thu Oct 27 03:40:45 2022] DELETE /compute/v2.1/servers/cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 03:40:46.461552 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-df10c1e2-b168-41fc-b866-96fe7ed228d5 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:46.464919 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-df10c1e2-b168-41fc-b866-96fe7ed228d5 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: 003c8652-2a85-4abc-8f02-ff46b4afcfd1] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:46.470316 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-569de9ee-f75b-4420-8094-6650619b9a09 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:46.491719 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-569de9ee-f75b-4420-8094-6650619b9a09 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:46.496190 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-569de9ee-f75b-4420-8094-6650619b9a09 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:46.497659 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-569de9ee-f75b-4420-8094-6650619b9a09 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d" status: 200 len: 1603 microversion: 2.42 time: 0.154836 Oct 27 03:40:46.521817 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2211/4701] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:40:46 2022] GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d => generated 1603 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:40:46.524931 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-76dfb3cf-3dfb-4399-ba66-f828b5774819 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:46.526196 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-76dfb3cf-3dfb-4399-ba66-f828b5774819 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] [instance: 621fa99f-f6ef-4333-9e54-1820cb63e2ee] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:46.538021 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-76dfb3cf-3dfb-4399-ba66-f828b5774819 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:46.538709 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-76dfb3cf-3dfb-4399-ba66-f828b5774819 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:46.539505 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-76dfb3cf-3dfb-4399-ba66-f828b5774819 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:46.540571 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-76dfb3cf-3dfb-4399-ba66-f828b5774819 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:46.541446 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-76dfb3cf-3dfb-4399-ba66-f828b5774819 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:46.542093 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-76dfb3cf-3dfb-4399-ba66-f828b5774819 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:46.583369 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-df10c1e2-b168-41fc-b866-96fe7ed228d5 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18036411a99e4634bfbaeae24b9f254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229dcb63bc41444391544883b576ce2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:46.593879 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-df10c1e2-b168-41fc-b866-96fe7ed228d5 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/003c8652-2a85-4abc-8f02-ff46b4afcfd1" status: 200 len: 1241 microversion: 2.1 time: 0.138908 Oct 27 03:40:46.614841 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2491/4702] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:46 2022] GET /compute/v2.1/servers/003c8652-2a85-4abc-8f02-ff46b4afcfd1 => generated 1241 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:40:46.621624 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a503ca99-3934-4bad-83a1-cb20124969f8 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:46.622383 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a503ca99-3934-4bad-83a1-cb20124969f8 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] [instance: cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:46.630521 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a503ca99-3934-4bad-83a1-cb20124969f8 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:46.631120 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a503ca99-3934-4bad-83a1-cb20124969f8 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:46.631652 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a503ca99-3934-4bad-83a1-cb20124969f8 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:46.632492 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a503ca99-3934-4bad-83a1-cb20124969f8 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:46.633070 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a503ca99-3934-4bad-83a1-cb20124969f8 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:46.634181 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a503ca99-3934-4bad-83a1-cb20124969f8 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:46.663729 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:40:46.732664 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a503ca99-3934-4bad-83a1-cb20124969f8 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:46.744143 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a503ca99-3934-4bad-83a1-cb20124969f8 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:46.745595 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a503ca99-3934-4bad-83a1-cb20124969f8 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:46.746900 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a503ca99-3934-4bad-83a1-cb20124969f8 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29" status: 200 len: 1363 microversion: 2.57 time: 0.130684 Oct 27 03:40:46.747466 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2492/4703] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:40:46 2022] GET /compute/v2.1/servers/cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29 => generated 1363 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:40:46.765882 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7c9fe7c2-8176-426b-81eb-b255ba30ceb2 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:46.770171 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7c9fe7c2-8176-426b-81eb-b255ba30ceb2 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 9fa9583d-e294-4e5f-a6dc-a51d619dc03d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:46.777013 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7c9fe7c2-8176-426b-81eb-b255ba30ceb2 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:46.777811 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7c9fe7c2-8176-426b-81eb-b255ba30ceb2 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:46.777959 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7c9fe7c2-8176-426b-81eb-b255ba30ceb2 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:46.791023 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7c9fe7c2-8176-426b-81eb-b255ba30ceb2 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:46.794194 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7c9fe7c2-8176-426b-81eb-b255ba30ceb2 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:46.794194 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7c9fe7c2-8176-426b-81eb-b255ba30ceb2 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:46.878297 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-76dfb3cf-3dfb-4399-ba66-f828b5774819 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba500c7bb654a649a57bb8c96aa8bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05672dc7b53747988fde6abc4adb2ef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:46.896124 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-76dfb3cf-3dfb-4399-ba66-f828b5774819 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] 10.222.0.20 "GET /compute/v2.1/servers/621fa99f-f6ef-4333-9e54-1820cb63e2ee" status: 200 len: 1504 microversion: 2.1 time: 0.379037 Oct 27 03:40:46.910452 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2212/4704] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:46 2022] GET /compute/v2.1/servers/621fa99f-f6ef-4333-9e54-1820cb63e2ee => generated 1504 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:40:46.925219 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-cef8298f-7cc1-43ed-8b58-961bf6b75791 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:46.928125 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-cef8298f-7cc1-43ed-8b58-961bf6b75791 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] [instance: 6d2f30ee-6086-48e1-8701-a8270012be0c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:46.955933 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cef8298f-7cc1-43ed-8b58-961bf6b75791 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:46.956447 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cef8298f-7cc1-43ed-8b58-961bf6b75791 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:46.956930 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cef8298f-7cc1-43ed-8b58-961bf6b75791 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:46.957698 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cef8298f-7cc1-43ed-8b58-961bf6b75791 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:46.958210 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cef8298f-7cc1-43ed-8b58-961bf6b75791 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:46.958639 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cef8298f-7cc1-43ed-8b58-961bf6b75791 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:46.975895 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7c9fe7c2-8176-426b-81eb-b255ba30ceb2 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:46.994750 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7c9fe7c2-8176-426b-81eb-b255ba30ceb2 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d" status: 200 len: 1524 microversion: 2.1 time: 0.232716 Oct 27 03:40:46.995356 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2493/4705] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:46 2022] GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d => generated 1524 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:40:47.151577 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-cef8298f-7cc1-43ed-8b58-961bf6b75791 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba500c7bb654a649a57bb8c96aa8bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05672dc7b53747988fde6abc4adb2ef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:47.161689 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-cef8298f-7cc1-43ed-8b58-961bf6b75791 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] 10.222.0.20 "GET /compute/v2.1/servers/6d2f30ee-6086-48e1-8701-a8270012be0c" status: 200 len: 1504 microversion: 2.1 time: 0.240275 Oct 27 03:40:47.163179 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2213/4706] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:46 2022] GET /compute/v2.1/servers/6d2f30ee-6086-48e1-8701-a8270012be0c => generated 1504 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:40:47.191617 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-15334be7-e920-461a-9848-0530ece47dac tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:47.192121 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-15334be7-e920-461a-9848-0530ece47dac tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] [instance: 6d2f30ee-6086-48e1-8701-a8270012be0c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:47.201174 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-15334be7-e920-461a-9848-0530ece47dac tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:47.201675 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-15334be7-e920-461a-9848-0530ece47dac tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:47.202148 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-15334be7-e920-461a-9848-0530ece47dac tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:47.203077 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-15334be7-e920-461a-9848-0530ece47dac tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:47.203726 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-15334be7-e920-461a-9848-0530ece47dac tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:47.204373 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-15334be7-e920-461a-9848-0530ece47dac tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:47.241454 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-15334be7-e920-461a-9848-0530ece47dac tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] [instance: 6d2f30ee-6086-48e1-8701-a8270012be0c] Going to try to terminate instance {{(pid=121001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:40:47.370052 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b27af071-dda1-481b-8691-c6c679028dab tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:47.372552 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b27af071-dda1-481b-8691-c6c679028dab tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:47.388132 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b27af071-dda1-481b-8691-c6c679028dab tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:47.388987 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b27af071-dda1-481b-8691-c6c679028dab tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:47.389444 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b27af071-dda1-481b-8691-c6c679028dab tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:47.390208 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b27af071-dda1-481b-8691-c6c679028dab tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:47.390676 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b27af071-dda1-481b-8691-c6c679028dab tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:47.391316 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b27af071-dda1-481b-8691-c6c679028dab tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:47.568676 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b27af071-dda1-481b-8691-c6c679028dab tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:47.580241 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b27af071-dda1-481b-8691-c6c679028dab tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:47.581883 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b27af071-dda1-481b-8691-c6c679028dab tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:47.583362 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b27af071-dda1-481b-8691-c6c679028dab tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79" status: 200 len: 1723 microversion: 2.20 time: 0.217572 Oct 27 03:40:47.584008 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2214/4707] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:40:47 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 => generated 1723 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:40:47.589514 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a7324b94-ab24-453c-99d5-3285d7392f40 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:47.590605 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a7324b94-ab24-453c-99d5-3285d7392f40 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] [instance: 8c8a2cbb-4acf-4a6b-b684-567617bb930d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:47.597194 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a7324b94-ab24-453c-99d5-3285d7392f40 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:47.597995 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a7324b94-ab24-453c-99d5-3285d7392f40 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:47.598670 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a7324b94-ab24-453c-99d5-3285d7392f40 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:47.599711 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a7324b94-ab24-453c-99d5-3285d7392f40 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:47.600598 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a7324b94-ab24-453c-99d5-3285d7392f40 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:47.601238 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a7324b94-ab24-453c-99d5-3285d7392f40 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:47.614963 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-15334be7-e920-461a-9848-0530ece47dac tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6d2f30ee-6086-48e1-8701-a8270012be0c" status: 204 len: 0 microversion: 2.1 time: 0.426952 Oct 27 03:40:47.615914 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2494/4708] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:40:47 2022] DELETE /compute/v2.1/servers/6d2f30ee-6086-48e1-8701-a8270012be0c => generated 0 bytes in 429 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:40:47.621622 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-eeef2dbb-0fac-4f6e-8b81-a8b6da7bc0a4 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:47.622493 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-eeef2dbb-0fac-4f6e-8b81-a8b6da7bc0a4 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: 003c8652-2a85-4abc-8f02-ff46b4afcfd1] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:47.629040 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eeef2dbb-0fac-4f6e-8b81-a8b6da7bc0a4 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:47.629643 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eeef2dbb-0fac-4f6e-8b81-a8b6da7bc0a4 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:47.630374 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eeef2dbb-0fac-4f6e-8b81-a8b6da7bc0a4 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:47.631142 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eeef2dbb-0fac-4f6e-8b81-a8b6da7bc0a4 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:47.631723 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eeef2dbb-0fac-4f6e-8b81-a8b6da7bc0a4 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:47.632373 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eeef2dbb-0fac-4f6e-8b81-a8b6da7bc0a4 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:47.715609 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a7324b94-ab24-453c-99d5-3285d7392f40 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:47.730402 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a7324b94-ab24-453c-99d5-3285d7392f40 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:47.730860 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-eeef2dbb-0fac-4f6e-8b81-a8b6da7bc0a4 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18036411a99e4634bfbaeae24b9f254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229dcb63bc41444391544883b576ce2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:47.733829 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a7324b94-ab24-453c-99d5-3285d7392f40 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:47.736213 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a7324b94-ab24-453c-99d5-3285d7392f40 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d" status: 200 len: 1603 microversion: 2.42 time: 0.150266 Oct 27 03:40:47.744027 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-eeef2dbb-0fac-4f6e-8b81-a8b6da7bc0a4 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/003c8652-2a85-4abc-8f02-ff46b4afcfd1" status: 200 len: 1245 microversion: 2.1 time: 0.126021 Oct 27 03:40:47.745208 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2495/4709] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:47 2022] GET /compute/v2.1/servers/003c8652-2a85-4abc-8f02-ff46b4afcfd1 => generated 1245 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:40:47.750115 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c76db8cf-efab-4894-b2a5-8be7b05cb465 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:47.750800 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2215/4710] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:40:47 2022] GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d => generated 1603 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:40:47.751077 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c76db8cf-efab-4894-b2a5-8be7b05cb465 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] [instance: 621fa99f-f6ef-4333-9e54-1820cb63e2ee] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:47.761260 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c76db8cf-efab-4894-b2a5-8be7b05cb465 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:47.762297 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c76db8cf-efab-4894-b2a5-8be7b05cb465 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:47.763304 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c76db8cf-efab-4894-b2a5-8be7b05cb465 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:47.764229 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c76db8cf-efab-4894-b2a5-8be7b05cb465 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:47.765070 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c76db8cf-efab-4894-b2a5-8be7b05cb465 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:47.765711 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c76db8cf-efab-4894-b2a5-8be7b05cb465 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:47.781991 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-38b49145-0f99-42c0-bd71-39db27863876 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:47.783047 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-38b49145-0f99-42c0-bd71-39db27863876 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] [instance: cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:47.794586 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-38b49145-0f99-42c0-bd71-39db27863876 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:47.795324 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-38b49145-0f99-42c0-bd71-39db27863876 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:47.795921 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-38b49145-0f99-42c0-bd71-39db27863876 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:47.796820 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-38b49145-0f99-42c0-bd71-39db27863876 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:47.797430 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-38b49145-0f99-42c0-bd71-39db27863876 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:47.797549 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c76db8cf-efab-4894-b2a5-8be7b05cb465 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] [instance: 621fa99f-f6ef-4333-9e54-1820cb63e2ee] Going to try to terminate instance {{(pid=121001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:40:47.798480 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-38b49145-0f99-42c0-bd71-39db27863876 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:47.881441 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-38b49145-0f99-42c0-bd71-39db27863876 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:47.891269 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-38b49145-0f99-42c0-bd71-39db27863876 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:47.892932 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-38b49145-0f99-42c0-bd71-39db27863876 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:47.894397 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-38b49145-0f99-42c0-bd71-39db27863876 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29" status: 200 len: 1363 microversion: 2.57 time: 0.117515 Oct 27 03:40:47.895605 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2216/4711] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:40:47 2022] GET /compute/v2.1/servers/cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29 => generated 1363 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:40:48.023211 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a29e7d46-bb06-4171-84f5-6ce1e7c277ea tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:48.023842 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a29e7d46-bb06-4171-84f5-6ce1e7c277ea tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 9fa9583d-e294-4e5f-a6dc-a51d619dc03d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:48.040638 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a29e7d46-bb06-4171-84f5-6ce1e7c277ea tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:48.041708 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a29e7d46-bb06-4171-84f5-6ce1e7c277ea tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:48.042150 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a29e7d46-bb06-4171-84f5-6ce1e7c277ea tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:48.043378 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a29e7d46-bb06-4171-84f5-6ce1e7c277ea tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:48.044011 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a29e7d46-bb06-4171-84f5-6ce1e7c277ea tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:48.044940 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a29e7d46-bb06-4171-84f5-6ce1e7c277ea tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:48.142980 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c76db8cf-efab-4894-b2a5-8be7b05cb465 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] 10.222.0.20 "DELETE /compute/v2.1/servers/621fa99f-f6ef-4333-9e54-1820cb63e2ee" status: 204 len: 0 microversion: 2.1 time: 0.396255 Oct 27 03:40:48.143891 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2496/4712] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:40:47 2022] DELETE /compute/v2.1/servers/621fa99f-f6ef-4333-9e54-1820cb63e2ee => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:40:48.153218 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-27daeb62-218a-4a90-a4c0-210836c9cb1f tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:48.153978 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-27daeb62-218a-4a90-a4c0-210836c9cb1f tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] [instance: 6d2f30ee-6086-48e1-8701-a8270012be0c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:48.163538 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-27daeb62-218a-4a90-a4c0-210836c9cb1f tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:48.168082 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-27daeb62-218a-4a90-a4c0-210836c9cb1f tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:48.168082 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-27daeb62-218a-4a90-a4c0-210836c9cb1f tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:48.168082 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-27daeb62-218a-4a90-a4c0-210836c9cb1f tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:48.168082 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-27daeb62-218a-4a90-a4c0-210836c9cb1f tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:48.168082 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-27daeb62-218a-4a90-a4c0-210836c9cb1f tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:48.285261 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a29e7d46-bb06-4171-84f5-6ce1e7c277ea tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:48.300622 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a29e7d46-bb06-4171-84f5-6ce1e7c277ea tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d" status: 200 len: 1524 microversion: 2.1 time: 0.281251 Oct 27 03:40:48.301657 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2217/4713] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:48 2022] GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d => generated 1524 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:40:48.358870 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-27daeb62-218a-4a90-a4c0-210836c9cb1f tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba500c7bb654a649a57bb8c96aa8bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05672dc7b53747988fde6abc4adb2ef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:48.369299 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-27daeb62-218a-4a90-a4c0-210836c9cb1f tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] 10.222.0.20 "GET /compute/v2.1/servers/6d2f30ee-6086-48e1-8701-a8270012be0c" status: 200 len: 1510 microversion: 2.1 time: 0.220299 Oct 27 03:40:48.383561 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2497/4714] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:48 2022] GET /compute/v2.1/servers/6d2f30ee-6086-48e1-8701-a8270012be0c => generated 1510 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:40:48.612946 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f6b954f5-5a37-476e-94a3-90c5be7bcb56 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:48.613550 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f6b954f5-5a37-476e-94a3-90c5be7bcb56 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:48.629062 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f6b954f5-5a37-476e-94a3-90c5be7bcb56 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:48.629878 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f6b954f5-5a37-476e-94a3-90c5be7bcb56 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:48.630881 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f6b954f5-5a37-476e-94a3-90c5be7bcb56 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:48.632125 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f6b954f5-5a37-476e-94a3-90c5be7bcb56 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:48.632755 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f6b954f5-5a37-476e-94a3-90c5be7bcb56 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:48.634708 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f6b954f5-5a37-476e-94a3-90c5be7bcb56 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:48.763481 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9363053d-03d4-4f19-a673-dd592a8f7047 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:48.764108 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-9363053d-03d4-4f19-a673-dd592a8f7047 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] [instance: 8c8a2cbb-4acf-4a6b-b684-567617bb930d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:48.773431 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9363053d-03d4-4f19-a673-dd592a8f7047 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:48.774065 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9363053d-03d4-4f19-a673-dd592a8f7047 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:48.774520 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9363053d-03d4-4f19-a673-dd592a8f7047 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:48.775241 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9363053d-03d4-4f19-a673-dd592a8f7047 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:48.775695 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9363053d-03d4-4f19-a673-dd592a8f7047 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:48.776125 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9363053d-03d4-4f19-a673-dd592a8f7047 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:48.873776 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f6b954f5-5a37-476e-94a3-90c5be7bcb56 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:48.882274 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f6b954f5-5a37-476e-94a3-90c5be7bcb56 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:48.883769 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f6b954f5-5a37-476e-94a3-90c5be7bcb56 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:48.885452 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f6b954f5-5a37-476e-94a3-90c5be7bcb56 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79" status: 200 len: 1744 microversion: 2.20 time: 0.278279 Oct 27 03:40:48.886384 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2218/4715] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:40:48 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 => generated 1744 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:40:48.891103 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-342ba485-b7bc-4351-8b55-37f158d64040 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:48.891738 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-342ba485-b7bc-4351-8b55-37f158d64040 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: 003c8652-2a85-4abc-8f02-ff46b4afcfd1] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:48.899933 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-342ba485-b7bc-4351-8b55-37f158d64040 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:48.900445 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-342ba485-b7bc-4351-8b55-37f158d64040 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:48.901553 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-342ba485-b7bc-4351-8b55-37f158d64040 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:48.902325 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-342ba485-b7bc-4351-8b55-37f158d64040 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:48.902797 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-342ba485-b7bc-4351-8b55-37f158d64040 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:48.903313 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-342ba485-b7bc-4351-8b55-37f158d64040 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:48.944967 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9363053d-03d4-4f19-a673-dd592a8f7047 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:48.961223 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9363053d-03d4-4f19-a673-dd592a8f7047 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:48.962939 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9363053d-03d4-4f19-a673-dd592a8f7047 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:48.964200 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9363053d-03d4-4f19-a673-dd592a8f7047 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d" status: 200 len: 1603 microversion: 2.42 time: 0.204752 Oct 27 03:40:48.977738 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2498/4716] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:40:48 2022] GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d => generated 1603 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:40:48.977738 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3f2fc100-05b2-40bc-aded-49096a3ae975 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:48.977738 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3f2fc100-05b2-40bc-aded-49096a3ae975 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] [instance: cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:48.990880 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:UPDATE=3 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:40:48.995153 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3f2fc100-05b2-40bc-aded-49096a3ae975 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:48.995658 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3f2fc100-05b2-40bc-aded-49096a3ae975 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:48.997513 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3f2fc100-05b2-40bc-aded-49096a3ae975 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:48.997615 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-342ba485-b7bc-4351-8b55-37f158d64040 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18036411a99e4634bfbaeae24b9f254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229dcb63bc41444391544883b576ce2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:48.997711 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3f2fc100-05b2-40bc-aded-49096a3ae975 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:48.998986 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3f2fc100-05b2-40bc-aded-49096a3ae975 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:48.999435 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3f2fc100-05b2-40bc-aded-49096a3ae975 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:49.004882 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-342ba485-b7bc-4351-8b55-37f158d64040 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/003c8652-2a85-4abc-8f02-ff46b4afcfd1" status: 200 len: 1293 microversion: 2.1 time: 0.117313 Oct 27 03:40:49.005898 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2219/4717] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:48 2022] GET /compute/v2.1/servers/003c8652-2a85-4abc-8f02-ff46b4afcfd1 => generated 1293 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:40:49.067144 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3f2fc100-05b2-40bc-aded-49096a3ae975 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:49.067630 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3f2fc100-05b2-40bc-aded-49096a3ae975 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:49.068067 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3f2fc100-05b2-40bc-aded-49096a3ae975 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:49.068517 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-3f2fc100-05b2-40bc-aded-49096a3ae975 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lazy-loading 'fault' on Instance uuid cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29 {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:40:49.121231 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3f2fc100-05b2-40bc-aded-49096a3ae975 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:49.134940 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3f2fc100-05b2-40bc-aded-49096a3ae975 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:49.134940 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3f2fc100-05b2-40bc-aded-49096a3ae975 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:49.134940 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3f2fc100-05b2-40bc-aded-49096a3ae975 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29" status: 200 len: 1368 microversion: 2.57 time: 0.167701 Oct 27 03:40:49.147583 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2499/4718] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:40:48 2022] GET /compute/v2.1/servers/cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29 => generated 1368 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:40:49.328768 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-74576b20-bc25-46d9-a581-11ec246a2790 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:49.329360 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-74576b20-bc25-46d9-a581-11ec246a2790 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 9fa9583d-e294-4e5f-a6dc-a51d619dc03d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:49.338971 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-74576b20-bc25-46d9-a581-11ec246a2790 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:49.339473 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-74576b20-bc25-46d9-a581-11ec246a2790 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:49.339922 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-74576b20-bc25-46d9-a581-11ec246a2790 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:49.340634 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-74576b20-bc25-46d9-a581-11ec246a2790 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:49.341098 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-74576b20-bc25-46d9-a581-11ec246a2790 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:49.341527 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-74576b20-bc25-46d9-a581-11ec246a2790 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:49.398536 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-bddbd481-aec7-4982-842d-592af7efece2 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:49.399554 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-bddbd481-aec7-4982-842d-592af7efece2 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] [instance: 6d2f30ee-6086-48e1-8701-a8270012be0c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:49.406431 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bddbd481-aec7-4982-842d-592af7efece2 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:49.406923 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bddbd481-aec7-4982-842d-592af7efece2 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:49.407363 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bddbd481-aec7-4982-842d-592af7efece2 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:49.408072 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bddbd481-aec7-4982-842d-592af7efece2 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:49.408528 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bddbd481-aec7-4982-842d-592af7efece2 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:49.408960 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bddbd481-aec7-4982-842d-592af7efece2 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:49.553794 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-74576b20-bc25-46d9-a581-11ec246a2790 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:49.569358 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-74576b20-bc25-46d9-a581-11ec246a2790 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d" status: 200 len: 1524 microversion: 2.1 time: 0.245762 Oct 27 03:40:49.570451 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2220/4719] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:49 2022] GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d => generated 1524 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:40:49.653983 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-bddbd481-aec7-4982-842d-592af7efece2 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba500c7bb654a649a57bb8c96aa8bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05672dc7b53747988fde6abc4adb2ef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:49.676246 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-bddbd481-aec7-4982-842d-592af7efece2 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] 10.222.0.20 "GET /compute/v2.1/servers/6d2f30ee-6086-48e1-8701-a8270012be0c" status: 200 len: 1510 microversion: 2.1 time: 0.285071 Oct 27 03:40:49.693065 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2500/4720] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:49 2022] GET /compute/v2.1/servers/6d2f30ee-6086-48e1-8701-a8270012be0c => generated 1510 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:40:49.922249 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8350696f-518a-4174-a354-e054c1daf1b7 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:49.923448 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8350696f-518a-4174-a354-e054c1daf1b7 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:49.933677 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8350696f-518a-4174-a354-e054c1daf1b7 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:49.934245 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8350696f-518a-4174-a354-e054c1daf1b7 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:49.934698 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8350696f-518a-4174-a354-e054c1daf1b7 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:49.935468 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8350696f-518a-4174-a354-e054c1daf1b7 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:49.936002 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8350696f-518a-4174-a354-e054c1daf1b7 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:49.936560 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8350696f-518a-4174-a354-e054c1daf1b7 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:49.995799 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0bbb3569-9bee-4929-b6d6-d818d84af5fc tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:49.996624 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0bbb3569-9bee-4929-b6d6-d818d84af5fc tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] [instance: 8c8a2cbb-4acf-4a6b-b684-567617bb930d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:50.007598 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0bbb3569-9bee-4929-b6d6-d818d84af5fc tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:50.008104 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0bbb3569-9bee-4929-b6d6-d818d84af5fc tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:50.009142 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0bbb3569-9bee-4929-b6d6-d818d84af5fc tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:50.009928 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0bbb3569-9bee-4929-b6d6-d818d84af5fc tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:50.014174 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0bbb3569-9bee-4929-b6d6-d818d84af5fc tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:50.014627 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0bbb3569-9bee-4929-b6d6-d818d84af5fc tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:50.183763 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0bbb3569-9bee-4929-b6d6-d818d84af5fc tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:50.199836 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0bbb3569-9bee-4929-b6d6-d818d84af5fc tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:50.201300 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0bbb3569-9bee-4929-b6d6-d818d84af5fc tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:50.202611 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0bbb3569-9bee-4929-b6d6-d818d84af5fc tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d" status: 200 len: 1603 microversion: 2.42 time: 0.211583 Oct 27 03:40:50.226939 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2501/4721] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:40:49 2022] GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d => generated 1603 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:40:50.232377 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2f8388f9-3c1d-4c9c-9ef2-42db64628ea1 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:50.233146 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2f8388f9-3c1d-4c9c-9ef2-42db64628ea1 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: 003c8652-2a85-4abc-8f02-ff46b4afcfd1] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:50.240526 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2f8388f9-3c1d-4c9c-9ef2-42db64628ea1 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:50.241077 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2f8388f9-3c1d-4c9c-9ef2-42db64628ea1 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:50.241522 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2f8388f9-3c1d-4c9c-9ef2-42db64628ea1 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:50.242378 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2f8388f9-3c1d-4c9c-9ef2-42db64628ea1 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:50.242893 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2f8388f9-3c1d-4c9c-9ef2-42db64628ea1 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:50.243328 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2f8388f9-3c1d-4c9c-9ef2-42db64628ea1 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:50.312713 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8350696f-518a-4174-a354-e054c1daf1b7 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:50.323866 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8350696f-518a-4174-a354-e054c1daf1b7 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:50.330158 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8350696f-518a-4174-a354-e054c1daf1b7 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:50.330158 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8350696f-518a-4174-a354-e054c1daf1b7 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79" status: 200 len: 1744 microversion: 2.20 time: 0.409492 Oct 27 03:40:50.346216 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2221/4722] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:40:49 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 => generated 1744 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:40:50.351729 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6b8cf91a-976f-41d9-801d-95838b729e80 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:50.352397 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6b8cf91a-976f-41d9-801d-95838b729e80 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] [instance: cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:50.365551 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6b8cf91a-976f-41d9-801d-95838b729e80 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:50.366815 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6b8cf91a-976f-41d9-801d-95838b729e80 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:50.367281 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6b8cf91a-976f-41d9-801d-95838b729e80 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:50.368149 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6b8cf91a-976f-41d9-801d-95838b729e80 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:50.368761 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6b8cf91a-976f-41d9-801d-95838b729e80 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:50.369208 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6b8cf91a-976f-41d9-801d-95838b729e80 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:50.402378 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2f8388f9-3c1d-4c9c-9ef2-42db64628ea1 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18036411a99e4634bfbaeae24b9f254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229dcb63bc41444391544883b576ce2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:50.415552 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2f8388f9-3c1d-4c9c-9ef2-42db64628ea1 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/003c8652-2a85-4abc-8f02-ff46b4afcfd1" status: 200 len: 1311 microversion: 2.1 time: 0.185909 Oct 27 03:40:50.416394 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2502/4723] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:50 2022] GET /compute/v2.1/servers/003c8652-2a85-4abc-8f02-ff46b4afcfd1 => generated 1311 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:40:50.457886 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6b8cf91a-976f-41d9-801d-95838b729e80 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:50.458428 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6b8cf91a-976f-41d9-801d-95838b729e80 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:50.458887 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6b8cf91a-976f-41d9-801d-95838b729e80 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:50.459360 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-6b8cf91a-976f-41d9-801d-95838b729e80 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lazy-loading 'fault' on Instance uuid cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29 {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:40:50.599738 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e414bdfe-1471-4b23-b881-d7ba124256c1 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:50.600374 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e414bdfe-1471-4b23-b881-d7ba124256c1 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 9fa9583d-e294-4e5f-a6dc-a51d619dc03d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:50.608057 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e414bdfe-1471-4b23-b881-d7ba124256c1 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:50.608558 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e414bdfe-1471-4b23-b881-d7ba124256c1 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:50.609017 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e414bdfe-1471-4b23-b881-d7ba124256c1 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:50.609729 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e414bdfe-1471-4b23-b881-d7ba124256c1 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:50.610223 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e414bdfe-1471-4b23-b881-d7ba124256c1 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:50.610656 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e414bdfe-1471-4b23-b881-d7ba124256c1 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:50.652557 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-6b8cf91a-976f-41d9-801d-95838b729e80 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:50.664157 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-6b8cf91a-976f-41d9-801d-95838b729e80 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:50.667927 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-6b8cf91a-976f-41d9-801d-95838b729e80 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd68306e38a3945a29ecd3ec026cbcee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf22fab0894144d095b92e8e61d4de9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:50.669355 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6b8cf91a-976f-41d9-801d-95838b729e80 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29" status: 200 len: 1368 microversion: 2.57 time: 0.321775 Oct 27 03:40:50.670356 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2222/4724] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:40:50 2022] GET /compute/v2.1/servers/cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29 => generated 1368 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:40:50.703148 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c259287d-93d6-4536-a494-d5c83166b3b8 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:50.704210 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c259287d-93d6-4536-a494-d5c83166b3b8 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] [instance: 6d2f30ee-6086-48e1-8701-a8270012be0c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:50.712454 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c259287d-93d6-4536-a494-d5c83166b3b8 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:50.773040 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c259287d-93d6-4536-a494-d5c83166b3b8 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:50.773040 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c259287d-93d6-4536-a494-d5c83166b3b8 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:50.773040 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c259287d-93d6-4536-a494-d5c83166b3b8 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:50.773040 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c259287d-93d6-4536-a494-d5c83166b3b8 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:50.773040 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c259287d-93d6-4536-a494-d5c83166b3b8 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:51.044381 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e414bdfe-1471-4b23-b881-d7ba124256c1 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:51.058606 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e414bdfe-1471-4b23-b881-d7ba124256c1 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d" status: 200 len: 1524 microversion: 2.1 time: 0.458293 Oct 27 03:40:51.075389 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2503/4725] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:50 2022] GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d => generated 1524 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:40:51.235101 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-164119cb-f450-42f2-b8b1-ec39959f7b30 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:51.235734 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-164119cb-f450-42f2-b8b1-ec39959f7b30 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] [instance: 8c8a2cbb-4acf-4a6b-b684-567617bb930d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:51.254217 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-164119cb-f450-42f2-b8b1-ec39959f7b30 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:51.254723 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-164119cb-f450-42f2-b8b1-ec39959f7b30 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:51.255170 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-164119cb-f450-42f2-b8b1-ec39959f7b30 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:51.256057 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-164119cb-f450-42f2-b8b1-ec39959f7b30 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:51.261669 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-164119cb-f450-42f2-b8b1-ec39959f7b30 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:51.264890 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-164119cb-f450-42f2-b8b1-ec39959f7b30 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:51.462876 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-164119cb-f450-42f2-b8b1-ec39959f7b30 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:51.484695 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-164119cb-f450-42f2-b8b1-ec39959f7b30 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:51.505988 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-164119cb-f450-42f2-b8b1-ec39959f7b30 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:51.507453 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-164119cb-f450-42f2-b8b1-ec39959f7b30 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d" status: 200 len: 1603 microversion: 2.42 time: 0.278383 Oct 27 03:40:51.516493 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2504/4726] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:40:51 2022] GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d => generated 1603 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:40:51.540483 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4af8a7d3-1a83-47b0-94f5-888bd13788c0 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:51.541146 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4af8a7d3-1a83-47b0-94f5-888bd13788c0 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:51.578527 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4af8a7d3-1a83-47b0-94f5-888bd13788c0 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:51.587561 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4af8a7d3-1a83-47b0-94f5-888bd13788c0 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:51.587561 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4af8a7d3-1a83-47b0-94f5-888bd13788c0 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:51.591015 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4af8a7d3-1a83-47b0-94f5-888bd13788c0 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:51.591535 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4af8a7d3-1a83-47b0-94f5-888bd13788c0 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:51.591998 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4af8a7d3-1a83-47b0-94f5-888bd13788c0 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:51.656449 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:40:51.730192 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c259287d-93d6-4536-a494-d5c83166b3b8 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba500c7bb654a649a57bb8c96aa8bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05672dc7b53747988fde6abc4adb2ef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:51.741635 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c259287d-93d6-4536-a494-d5c83166b3b8 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] 10.222.0.20 "GET /compute/v2.1/servers/6d2f30ee-6086-48e1-8701-a8270012be0c" status: 200 len: 1510 microversion: 2.1 time: 1.044379 Oct 27 03:40:51.758077 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2223/4727] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:50 2022] GET /compute/v2.1/servers/6d2f30ee-6086-48e1-8701-a8270012be0c => generated 1510 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:40:51.758077 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6977fce7-004b-47f1-8546-7c8149e5d234 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:51.759646 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6977fce7-004b-47f1-8546-7c8149e5d234 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: 003c8652-2a85-4abc-8f02-ff46b4afcfd1] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:51.790558 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6977fce7-004b-47f1-8546-7c8149e5d234 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:51.791230 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6977fce7-004b-47f1-8546-7c8149e5d234 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:51.791706 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6977fce7-004b-47f1-8546-7c8149e5d234 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:51.792475 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6977fce7-004b-47f1-8546-7c8149e5d234 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:51.799945 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6977fce7-004b-47f1-8546-7c8149e5d234 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:51.800777 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6977fce7-004b-47f1-8546-7c8149e5d234 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:51.861889 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4af8a7d3-1a83-47b0-94f5-888bd13788c0 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:51.879923 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4af8a7d3-1a83-47b0-94f5-888bd13788c0 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:51.885605 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4af8a7d3-1a83-47b0-94f5-888bd13788c0 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:51.888671 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4af8a7d3-1a83-47b0-94f5-888bd13788c0 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79" status: 200 len: 1739 microversion: 2.20 time: 0.367535 Oct 27 03:40:51.890023 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2505/4728] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:40:51 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 => generated 1739 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:40:51.911750 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-e971152a-ad64-464e-b96f-78a672ac4ae6 req-5ca996bc-05b2-42e8-a3a1-06923183679d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "621fa99f-f6ef-4333-9e54-1820cb63e2ee", "name": "network-vif-deleted", "tag": "d51a47e3-8013-48e0-aea2-a32501a5465e"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:40:51.943394 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-e971152a-ad64-464e-b96f-78a672ac4ae6 req-5ca996bc-05b2-42e8-a3a1-06923183679d service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:51.943394 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-e971152a-ad64-464e-b96f-78a672ac4ae6 req-5ca996bc-05b2-42e8-a3a1-06923183679d service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:51.943394 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-e971152a-ad64-464e-b96f-78a672ac4ae6 req-5ca996bc-05b2-42e8-a3a1-06923183679d service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:51.959934 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-e971152a-ad64-464e-b96f-78a672ac4ae6 req-5ca996bc-05b2-42e8-a3a1-06923183679d service nova] Creating event network-vif-deleted:d51a47e3-8013-48e0-aea2-a32501a5465e for instance 621fa99f-f6ef-4333-9e54-1820cb63e2ee on n-h2-862769-1 Oct 27 03:40:51.970998 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-e971152a-ad64-464e-b96f-78a672ac4ae6 req-5ca996bc-05b2-42e8-a3a1-06923183679d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078931 Oct 27 03:40:51.975394 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2506/4729] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:40:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:40:51.981400 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a728a332-2d45-4897-bc8e-a3d9cfcebef2 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:51.982224 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a728a332-2d45-4897-bc8e-a3d9cfcebef2 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] [instance: cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:51.992035 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a728a332-2d45-4897-bc8e-a3d9cfcebef2 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:51.996595 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a728a332-2d45-4897-bc8e-a3d9cfcebef2 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:51.997241 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a728a332-2d45-4897-bc8e-a3d9cfcebef2 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:51.999581 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a728a332-2d45-4897-bc8e-a3d9cfcebef2 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:52.003767 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a728a332-2d45-4897-bc8e-a3d9cfcebef2 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:52.006695 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a728a332-2d45-4897-bc8e-a3d9cfcebef2 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:52.062883 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-a728a332-2d45-4897-bc8e-a3d9cfcebef2 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] HTTP exception thrown: Instance cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29 could not be found. Oct 27 03:40:52.084646 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a728a332-2d45-4897-bc8e-a3d9cfcebef2 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Request method failure captured: Oct 27 03:40:52.084646 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29 HTTP/1.1 Oct 27 03:40:52.084646 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:40:52.084646 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:40:52.084646 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:40:52.084646 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:40:52.084646 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:40:52.084646 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:40:52.084646 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:40:52.084646 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:40:52.084646 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWf2QIBOqYm0cTERTAGpy8r8x4mAT73Nmj05Rn2wrbmStJO-QBbFGEbIbZ4hMJ3NxewzbQ_SFMGACv_Kw2hnDv2YbZdiGqWd-I8He04lD4ne2a0EBUjmRqBpE9HdbHo8DCuJPGh031ta4L5iIbB3hjJYYWFAcPsVcjmlGhMG2JtxrWtE Oct 27 03:40:52.084646 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:40:52.084646 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:40:52.084646 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:40:52.084646 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:40:52.084646 n-d-862769-1 devstack@n-api.service[121001]: X-Openstack-Nova-Api-Version: 2.57 Oct 27 03:40:52.084646 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:40:52.084646 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:40:52.084646 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: bf22fab0894144d095b92e8e61d4de9d Oct 27 03:40:52.084646 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServerShowV257Test-269840716 Oct 27 03:40:52.084646 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:40:52.084646 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:40:52.084646 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bf22fab0894144d095b92e8e61d4de9d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bf22fab0894144d095b92e8e61d4de9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bf22fab0894144d095b92e8e61d4de9d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bf22fab0894144d095b92e8e61d4de9d"}]}] Oct 27 03:40:52.084646 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServerShowV257Test-269840716 Oct 27 03:40:52.084646 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: bf22fab0894144d095b92e8e61d4de9d Oct 27 03:40:52.084646 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServerShowV257Test-269840716 Oct 27 03:40:52.084646 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServerShowV257Test-269840716-project Oct 27 03:40:52.084646 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:40:52.084646 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:40:52.084646 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: d68306e38a3945a29ecd3ec026cbcee0 Oct 27 03:40:52.084646 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServerShowV257Test-269840716-project Oct 27 03:40:52.084646 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:40:52.084646 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29 could not be found. Oct 27 03:40:52.084646 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': 'cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29'} Oct 27 03:40:52.084646 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:40:52.084646 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:40:52.084646 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:40:52.084646 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:40:52.084646 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:40:52.084646 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:40:52.084646 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:40:52.084646 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:40:52.084646 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:40:52.084646 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:40:52.084646 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29 could not be found. Oct 27 03:40:52.084646 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:40:52.084646 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:40:52.084646 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:40:52.084646 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:40:52.084646 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:40:52.084646 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:40:52.084646 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:40:52.084646 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:40:52.084646 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:40:52.084646 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:40:52.084646 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:40:52.084646 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:40:52.084646 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:40:52.084646 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:40:52.084646 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:40:52.084646 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:40:52.084646 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29 could not be found. Oct 27 03:40:52.084646 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:40:52.084646 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:40:52.084646 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:40:52.089061 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:40:52.089061 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:40:52.089061 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:40:52.089061 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:40:52.089061 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:40:52.089061 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29 could not be found. Oct 27 03:40:52.089061 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:40:52.090694 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a728a332-2d45-4897-bc8e-a3d9cfcebef2 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] Returning 404 to user: Instance cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:40:52.091791 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a728a332-2d45-4897-bc8e-a3d9cfcebef2 tempest-ServerShowV257Test-269840716 tempest-ServerShowV257Test-269840716-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29" status: 404 len: 111 microversion: 2.57 time: 0.115334 Oct 27 03:40:52.092883 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2507/4730] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:40:51 2022] GET /compute/v2.1/servers/cc0eb09c-d57f-4cf5-9acc-ee5baa00cb29 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 03:40:52.115607 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0457bfa0-aec8-405e-a41e-e3e92f586b35 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:52.118398 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-6977fce7-004b-47f1-8546-7c8149e5d234 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18036411a99e4634bfbaeae24b9f254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229dcb63bc41444391544883b576ce2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:52.119302 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0457bfa0-aec8-405e-a41e-e3e92f586b35 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 9fa9583d-e294-4e5f-a6dc-a51d619dc03d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:52.127405 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6977fce7-004b-47f1-8546-7c8149e5d234 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/003c8652-2a85-4abc-8f02-ff46b4afcfd1" status: 200 len: 1299 microversion: 2.1 time: 0.379193 Oct 27 03:40:52.138718 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2224/4731] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:51 2022] GET /compute/v2.1/servers/003c8652-2a85-4abc-8f02-ff46b4afcfd1 => generated 1299 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:40:52.150302 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0457bfa0-aec8-405e-a41e-e3e92f586b35 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:52.154537 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0457bfa0-aec8-405e-a41e-e3e92f586b35 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:52.156486 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0457bfa0-aec8-405e-a41e-e3e92f586b35 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:52.157398 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0457bfa0-aec8-405e-a41e-e3e92f586b35 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:52.160058 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0457bfa0-aec8-405e-a41e-e3e92f586b35 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:52.161148 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0457bfa0-aec8-405e-a41e-e3e92f586b35 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:52.168912 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-240fcb7b-6e4b-45bf-8b6e-e1a345e22c65 req-2e8e3d81-bb1b-44da-814b-d09003226135 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d2f30ee-6086-48e1-8701-a8270012be0c", "name": "network-vif-deleted", "tag": "2ea0c596-e9c9-43f8-bafe-b6f0a944e46e"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:40:52.194060 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-240fcb7b-6e4b-45bf-8b6e-e1a345e22c65 req-2e8e3d81-bb1b-44da-814b-d09003226135 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:52.198356 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-240fcb7b-6e4b-45bf-8b6e-e1a345e22c65 req-2e8e3d81-bb1b-44da-814b-d09003226135 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:52.199137 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-240fcb7b-6e4b-45bf-8b6e-e1a345e22c65 req-2e8e3d81-bb1b-44da-814b-d09003226135 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:52.220406 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-240fcb7b-6e4b-45bf-8b6e-e1a345e22c65 req-2e8e3d81-bb1b-44da-814b-d09003226135 service nova] Creating event network-vif-deleted:2ea0c596-e9c9-43f8-bafe-b6f0a944e46e for instance 6d2f30ee-6086-48e1-8701-a8270012be0c on n-h2-862769-1 Oct 27 03:40:52.246536 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-240fcb7b-6e4b-45bf-8b6e-e1a345e22c65 req-2e8e3d81-bb1b-44da-814b-d09003226135 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084669 Oct 27 03:40:52.250937 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2225/4732] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:40:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:40:52.548232 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1eb8e49f-abc1-42d9-ac0d-1b5b49bd0f31 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:52.549009 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1eb8e49f-abc1-42d9-ac0d-1b5b49bd0f31 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] [instance: 8c8a2cbb-4acf-4a6b-b684-567617bb930d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:52.563782 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1eb8e49f-abc1-42d9-ac0d-1b5b49bd0f31 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:52.564356 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1eb8e49f-abc1-42d9-ac0d-1b5b49bd0f31 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:52.564804 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1eb8e49f-abc1-42d9-ac0d-1b5b49bd0f31 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:52.565529 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1eb8e49f-abc1-42d9-ac0d-1b5b49bd0f31 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:52.565988 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1eb8e49f-abc1-42d9-ac0d-1b5b49bd0f31 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:52.566476 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1eb8e49f-abc1-42d9-ac0d-1b5b49bd0f31 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:52.583819 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0457bfa0-aec8-405e-a41e-e3e92f586b35 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:52.600616 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0457bfa0-aec8-405e-a41e-e3e92f586b35 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d" status: 200 len: 1524 microversion: 2.1 time: 0.498721 Oct 27 03:40:52.601529 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2508/4733] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:52 2022] GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d => generated 1524 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:40:52.691284 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=100 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:40:52.702547 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-4110d1af-30a4-4967-ac57-f2a9523d6bea req-00b10956-6b48-4d3b-ae42-610e78dfdcc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6854d7f3-0f6d-45c2-b46d-a5dc2922fe79", "name": "network-vif-plugged", "status": "completed", "tag": "425e1d50-5b4c-44cd-a54b-de48e280a305"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:40:52.733688 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-4110d1af-30a4-4967-ac57-f2a9523d6bea req-00b10956-6b48-4d3b-ae42-610e78dfdcc8 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:52.735244 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-4110d1af-30a4-4967-ac57-f2a9523d6bea req-00b10956-6b48-4d3b-ae42-610e78dfdcc8 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:52.736185 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-4110d1af-30a4-4967-ac57-f2a9523d6bea req-00b10956-6b48-4d3b-ae42-610e78dfdcc8 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:52.787493 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-4110d1af-30a4-4967-ac57-f2a9523d6bea req-00b10956-6b48-4d3b-ae42-610e78dfdcc8 service nova] Creating event network-vif-plugged:425e1d50-5b4c-44cd-a54b-de48e280a305 for instance 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 on n-h1-862769-1 Oct 27 03:40:52.812174 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-4110d1af-30a4-4967-ac57-f2a9523d6bea req-00b10956-6b48-4d3b-ae42-610e78dfdcc8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113639 Oct 27 03:40:52.813168 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2509/4734] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:40:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:40:52.822845 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4353a129-69e3-421f-bc93-686f7af790e1 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:52.830462 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4353a129-69e3-421f-bc93-686f7af790e1 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] [instance: 6d2f30ee-6086-48e1-8701-a8270012be0c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:52.846855 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1eb8e49f-abc1-42d9-ac0d-1b5b49bd0f31 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:52.847313 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4353a129-69e3-421f-bc93-686f7af790e1 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:52.847313 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4353a129-69e3-421f-bc93-686f7af790e1 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:52.847313 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4353a129-69e3-421f-bc93-686f7af790e1 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:52.847313 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4353a129-69e3-421f-bc93-686f7af790e1 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:52.847313 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4353a129-69e3-421f-bc93-686f7af790e1 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:52.847313 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4353a129-69e3-421f-bc93-686f7af790e1 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:52.871321 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1eb8e49f-abc1-42d9-ac0d-1b5b49bd0f31 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:52.889258 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1eb8e49f-abc1-42d9-ac0d-1b5b49bd0f31 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:52.889258 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1eb8e49f-abc1-42d9-ac0d-1b5b49bd0f31 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d" status: 200 len: 1603 microversion: 2.42 time: 0.336439 Oct 27 03:40:52.889258 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2226/4735] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:40:52 2022] GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d => generated 1603 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:40:52.933653 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4353a129-69e3-421f-bc93-686f7af790e1 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:52.934215 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4353a129-69e3-421f-bc93-686f7af790e1 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:52.934662 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4353a129-69e3-421f-bc93-686f7af790e1 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:52.935217 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-4353a129-69e3-421f-bc93-686f7af790e1 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lazy-loading 'fault' on Instance uuid 6d2f30ee-6086-48e1-8701-a8270012be0c {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:40:52.941312 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9f80ece8-97e9-43ff-b489-91a07376c2c5 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:52.942398 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9f80ece8-97e9-43ff-b489-91a07376c2c5 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:52.963677 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9f80ece8-97e9-43ff-b489-91a07376c2c5 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:52.964557 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9f80ece8-97e9-43ff-b489-91a07376c2c5 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:52.965634 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9f80ece8-97e9-43ff-b489-91a07376c2c5 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:52.966774 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9f80ece8-97e9-43ff-b489-91a07376c2c5 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:52.967454 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9f80ece8-97e9-43ff-b489-91a07376c2c5 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:52.968098 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9f80ece8-97e9-43ff-b489-91a07376c2c5 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:53.033594 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4353a129-69e3-421f-bc93-686f7af790e1 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba500c7bb654a649a57bb8c96aa8bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05672dc7b53747988fde6abc4adb2ef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:53.044057 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4353a129-69e3-421f-bc93-686f7af790e1 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] 10.222.0.20 "GET /compute/v2.1/servers/6d2f30ee-6086-48e1-8701-a8270012be0c" status: 200 len: 1307 microversion: 2.1 time: 0.229503 Oct 27 03:40:53.047888 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2510/4736] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:52 2022] GET /compute/v2.1/servers/6d2f30ee-6086-48e1-8701-a8270012be0c => generated 1307 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:40:53.165233 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6b909221-5232-45f3-bfa2-f3c6aad8afb3 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:53.166824 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-6b909221-5232-45f3-bfa2-f3c6aad8afb3 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: 003c8652-2a85-4abc-8f02-ff46b4afcfd1] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:53.182343 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6b909221-5232-45f3-bfa2-f3c6aad8afb3 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:53.184513 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6b909221-5232-45f3-bfa2-f3c6aad8afb3 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:53.185270 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6b909221-5232-45f3-bfa2-f3c6aad8afb3 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:53.186923 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6b909221-5232-45f3-bfa2-f3c6aad8afb3 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:53.188768 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6b909221-5232-45f3-bfa2-f3c6aad8afb3 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:53.191148 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6b909221-5232-45f3-bfa2-f3c6aad8afb3 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:53.510149 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9f80ece8-97e9-43ff-b489-91a07376c2c5 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:53.533724 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9f80ece8-97e9-43ff-b489-91a07376c2c5 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:53.537210 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9f80ece8-97e9-43ff-b489-91a07376c2c5 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:53.539787 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9f80ece8-97e9-43ff-b489-91a07376c2c5 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79" status: 200 len: 1739 microversion: 2.20 time: 0.622637 Oct 27 03:40:53.543124 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6b909221-5232-45f3-bfa2-f3c6aad8afb3 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18036411a99e4634bfbaeae24b9f254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229dcb63bc41444391544883b576ce2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:53.561599 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6b909221-5232-45f3-bfa2-f3c6aad8afb3 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/003c8652-2a85-4abc-8f02-ff46b4afcfd1" status: 200 len: 1367 microversion: 2.1 time: 0.401153 Oct 27 03:40:53.562731 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2511/4737] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:53 2022] GET /compute/v2.1/servers/003c8652-2a85-4abc-8f02-ff46b4afcfd1 => generated 1367 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:40:53.564799 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2227/4738] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:40:52 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 => generated 1739 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:40:53.628107 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-73f7bf95-1940-47b2-af02-07b21c499acb tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:53.629049 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-73f7bf95-1940-47b2-af02-07b21c499acb tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 9fa9583d-e294-4e5f-a6dc-a51d619dc03d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:53.640658 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-73f7bf95-1940-47b2-af02-07b21c499acb tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:53.649892 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-73f7bf95-1940-47b2-af02-07b21c499acb tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:53.650718 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-73f7bf95-1940-47b2-af02-07b21c499acb tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:53.652244 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-73f7bf95-1940-47b2-af02-07b21c499acb tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:53.652244 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-73f7bf95-1940-47b2-af02-07b21c499acb tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:53.653011 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-73f7bf95-1940-47b2-af02-07b21c499acb tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:53.921777 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-eced6c9f-1170-46b9-bb59-cb33a6c767b0 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:53.922448 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-eced6c9f-1170-46b9-bb59-cb33a6c767b0 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] [instance: 8c8a2cbb-4acf-4a6b-b684-567617bb930d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:53.950489 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-73f7bf95-1940-47b2-af02-07b21c499acb tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:53.960379 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eced6c9f-1170-46b9-bb59-cb33a6c767b0 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:53.961119 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eced6c9f-1170-46b9-bb59-cb33a6c767b0 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:53.963009 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eced6c9f-1170-46b9-bb59-cb33a6c767b0 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:53.966930 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eced6c9f-1170-46b9-bb59-cb33a6c767b0 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:53.967445 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-73f7bf95-1940-47b2-af02-07b21c499acb tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d" status: 200 len: 1506 microversion: 2.1 time: 0.343326 Oct 27 03:40:53.968093 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eced6c9f-1170-46b9-bb59-cb33a6c767b0 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:53.969675 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eced6c9f-1170-46b9-bb59-cb33a6c767b0 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:53.982756 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2512/4739] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:53 2022] GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d => generated 1506 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:40:54.077293 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8e6ae501-b979-46b5-a5b0-d2faf07a14d9 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:54.078232 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8e6ae501-b979-46b5-a5b0-d2faf07a14d9 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] [instance: 6d2f30ee-6086-48e1-8701-a8270012be0c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:54.095577 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8e6ae501-b979-46b5-a5b0-d2faf07a14d9 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:54.096322 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8e6ae501-b979-46b5-a5b0-d2faf07a14d9 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:54.096972 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8e6ae501-b979-46b5-a5b0-d2faf07a14d9 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:54.097864 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8e6ae501-b979-46b5-a5b0-d2faf07a14d9 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:54.098527 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8e6ae501-b979-46b5-a5b0-d2faf07a14d9 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:54.099194 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8e6ae501-b979-46b5-a5b0-d2faf07a14d9 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:54.179944 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8e6ae501-b979-46b5-a5b0-d2faf07a14d9 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:54.181245 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8e6ae501-b979-46b5-a5b0-d2faf07a14d9 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:54.192954 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8e6ae501-b979-46b5-a5b0-d2faf07a14d9 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:54.193745 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-8e6ae501-b979-46b5-a5b0-d2faf07a14d9 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lazy-loading 'fault' on Instance uuid 6d2f30ee-6086-48e1-8701-a8270012be0c {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:40:54.252607 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-eced6c9f-1170-46b9-bb59-cb33a6c767b0 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:54.254730 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8e6ae501-b979-46b5-a5b0-d2faf07a14d9 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eba500c7bb654a649a57bb8c96aa8bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05672dc7b53747988fde6abc4adb2ef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:54.268767 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8e6ae501-b979-46b5-a5b0-d2faf07a14d9 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] 10.222.0.20 "GET /compute/v2.1/servers/6d2f30ee-6086-48e1-8701-a8270012be0c" status: 200 len: 1307 microversion: 2.1 time: 0.196266 Oct 27 03:40:54.275647 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-eced6c9f-1170-46b9-bb59-cb33a6c767b0 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:54.279754 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-eced6c9f-1170-46b9-bb59-cb33a6c767b0 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:54.281843 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-eced6c9f-1170-46b9-bb59-cb33a6c767b0 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d" status: 200 len: 1603 microversion: 2.42 time: 0.374080 Oct 27 03:40:54.283542 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2228/4740] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:40:53 2022] GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d => generated 1603 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:40:54.291606 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2513/4741] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:54 2022] GET /compute/v2.1/servers/6d2f30ee-6086-48e1-8701-a8270012be0c => generated 1307 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:40:54.588811 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8df84bac-c59b-4182-ad7a-2ac4198d90a3 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:54.589634 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8df84bac-c59b-4182-ad7a-2ac4198d90a3 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: 003c8652-2a85-4abc-8f02-ff46b4afcfd1] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:54.596817 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2a28de7a-19da-423c-b611-b7c087f02763 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:54.601250 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2a28de7a-19da-423c-b611-b7c087f02763 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:54.603330 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8df84bac-c59b-4182-ad7a-2ac4198d90a3 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:54.605594 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8df84bac-c59b-4182-ad7a-2ac4198d90a3 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:54.607398 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8df84bac-c59b-4182-ad7a-2ac4198d90a3 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:54.610709 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8df84bac-c59b-4182-ad7a-2ac4198d90a3 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:54.612310 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2a28de7a-19da-423c-b611-b7c087f02763 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:54.612812 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2a28de7a-19da-423c-b611-b7c087f02763 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:54.613259 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2a28de7a-19da-423c-b611-b7c087f02763 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:54.613516 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8df84bac-c59b-4182-ad7a-2ac4198d90a3 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:54.614156 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2a28de7a-19da-423c-b611-b7c087f02763 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:54.614487 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8df84bac-c59b-4182-ad7a-2ac4198d90a3 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:54.617600 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2a28de7a-19da-423c-b611-b7c087f02763 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:54.617971 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2a28de7a-19da-423c-b611-b7c087f02763 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:54.817081 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2a28de7a-19da-423c-b611-b7c087f02763 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:54.829091 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2a28de7a-19da-423c-b611-b7c087f02763 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:54.830612 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2a28de7a-19da-423c-b611-b7c087f02763 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:54.831932 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2a28de7a-19da-423c-b611-b7c087f02763 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79" status: 200 len: 1739 microversion: 2.20 time: 0.239938 Oct 27 03:40:54.832804 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2514/4742] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:40:54 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 => generated 1739 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:40:55.000025 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2e62da80-e164-48c4-b1ee-1b5195c8f695 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:55.000646 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2e62da80-e164-48c4-b1ee-1b5195c8f695 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 9fa9583d-e294-4e5f-a6dc-a51d619dc03d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:55.018769 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2e62da80-e164-48c4-b1ee-1b5195c8f695 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:55.019265 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2e62da80-e164-48c4-b1ee-1b5195c8f695 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:55.021120 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2e62da80-e164-48c4-b1ee-1b5195c8f695 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:55.021851 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2e62da80-e164-48c4-b1ee-1b5195c8f695 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:55.022470 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2e62da80-e164-48c4-b1ee-1b5195c8f695 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:55.022878 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2e62da80-e164-48c4-b1ee-1b5195c8f695 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:55.175953 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8df84bac-c59b-4182-ad7a-2ac4198d90a3 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18036411a99e4634bfbaeae24b9f254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229dcb63bc41444391544883b576ce2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:55.190827 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8df84bac-c59b-4182-ad7a-2ac4198d90a3 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/003c8652-2a85-4abc-8f02-ff46b4afcfd1" status: 200 len: 1367 microversion: 2.1 time: 0.607192 Oct 27 03:40:55.192285 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2229/4743] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:54 2022] GET /compute/v2.1/servers/003c8652-2a85-4abc-8f02-ff46b4afcfd1 => generated 1367 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:40:55.290766 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2e62da80-e164-48c4-b1ee-1b5195c8f695 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:55.300078 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3a6e24f1-43e1-45dc-a632-cd033e8e2432 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:55.300710 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-3a6e24f1-43e1-45dc-a632-cd033e8e2432 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] [instance: 6d2f30ee-6086-48e1-8701-a8270012be0c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:55.302461 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2e62da80-e164-48c4-b1ee-1b5195c8f695 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d" status: 200 len: 1506 microversion: 2.1 time: 0.306226 Oct 27 03:40:55.304625 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2515/4744] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:54 2022] GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d => generated 1506 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:40:55.311442 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3a6e24f1-43e1-45dc-a632-cd033e8e2432 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:55.311948 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3a6e24f1-43e1-45dc-a632-cd033e8e2432 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:55.312396 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3a6e24f1-43e1-45dc-a632-cd033e8e2432 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:55.313677 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-eb0b6a01-7ce1-45cb-ac06-d75167e2188c tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:55.314731 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-eb0b6a01-7ce1-45cb-ac06-d75167e2188c tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] [instance: 8c8a2cbb-4acf-4a6b-b684-567617bb930d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:55.318706 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3a6e24f1-43e1-45dc-a632-cd033e8e2432 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:55.319279 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3a6e24f1-43e1-45dc-a632-cd033e8e2432 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:55.323105 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eb0b6a01-7ce1-45cb-ac06-d75167e2188c tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:55.323255 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3a6e24f1-43e1-45dc-a632-cd033e8e2432 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:55.324009 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eb0b6a01-7ce1-45cb-ac06-d75167e2188c tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:55.324899 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eb0b6a01-7ce1-45cb-ac06-d75167e2188c tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:55.325848 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eb0b6a01-7ce1-45cb-ac06-d75167e2188c tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:55.326555 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eb0b6a01-7ce1-45cb-ac06-d75167e2188c tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:55.327274 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eb0b6a01-7ce1-45cb-ac06-d75167e2188c tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:55.359333 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-3a6e24f1-43e1-45dc-a632-cd033e8e2432 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] HTTP exception thrown: Instance 6d2f30ee-6086-48e1-8701-a8270012be0c could not be found. Oct 27 03:40:55.362423 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3a6e24f1-43e1-45dc-a632-cd033e8e2432 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Request method failure captured: Oct 27 03:40:55.362423 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/6d2f30ee-6086-48e1-8701-a8270012be0c HTTP/1.1 Oct 27 03:40:55.362423 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:40:55.362423 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:40:55.362423 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:40:55.362423 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:40:55.362423 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:40:55.362423 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:40:55.362423 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:40:55.362423 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:40:55.362423 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWf2QKfhIMr-E7cxoCim99MIGM40_Nu76KaYyh7TGDLfhy-zaXQfa0yEUH4oszqfTiJnufyjxSH3Sa5K8Y2tD4DMMRp_hVU3JYALx9mY4dECRAEpqlSRWcWkxc0w70RBDt-_ZsFqSL4fws0Zn9OFne9Nlpd9Yx4c4GjTwi8EXDvQFB-0 Oct 27 03:40:55.362423 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:40:55.362423 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:40:55.362423 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:40:55.362423 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:40:55.362423 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:40:55.362423 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:40:55.362423 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 05672dc7b53747988fde6abc4adb2ef1 Oct 27 03:40:55.362423 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-MultipleCreateTestJSON-1468943424 Oct 27 03:40:55.362423 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:40:55.362423 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:40:55.362423 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/05672dc7b53747988fde6abc4adb2ef1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/05672dc7b53747988fde6abc4adb2ef1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/05672dc7b53747988fde6abc4adb2ef1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_05672dc7b53747988fde6abc4adb2ef1"}]}] Oct 27 03:40:55.362423 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-MultipleCreateTestJSON-1468943424 Oct 27 03:40:55.362423 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 05672dc7b53747988fde6abc4adb2ef1 Oct 27 03:40:55.362423 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1468943424 Oct 27 03:40:55.362423 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-MultipleCreateTestJSON-1468943424-project Oct 27 03:40:55.362423 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:40:55.362423 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:40:55.362423 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: eba500c7bb654a649a57bb8c96aa8bf0 Oct 27 03:40:55.362423 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-MultipleCreateTestJSON-1468943424-project Oct 27 03:40:55.362423 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:40:55.362423 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 6d2f30ee-6086-48e1-8701-a8270012be0c could not be found. Oct 27 03:40:55.362423 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '6d2f30ee-6086-48e1-8701-a8270012be0c'} Oct 27 03:40:55.362423 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:40:55.362423 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:40:55.362423 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:40:55.362423 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:40:55.362423 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:40:55.362423 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:40:55.362423 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:40:55.362423 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:40:55.362423 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:40:55.362423 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:40:55.362423 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d2f30ee-6086-48e1-8701-a8270012be0c could not be found. Oct 27 03:40:55.362423 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:40:55.362423 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:40:55.362423 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:40:55.362423 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:40:55.362423 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:40:55.362423 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:40:55.362423 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:40:55.362423 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:40:55.362423 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:40:55.362423 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:40:55.362423 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:40:55.362423 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:40:55.362423 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:40:55.362423 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:40:55.362423 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:40:55.362423 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:40:55.362423 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d2f30ee-6086-48e1-8701-a8270012be0c could not be found. Oct 27 03:40:55.362423 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:40:55.362423 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:40:55.362423 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:40:55.371448 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:40:55.371448 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:40:55.371448 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:40:55.371448 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:40:55.371448 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:40:55.371448 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d2f30ee-6086-48e1-8701-a8270012be0c could not be found. Oct 27 03:40:55.371448 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:40:55.371448 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3a6e24f1-43e1-45dc-a632-cd033e8e2432 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Returning 404 to user: Instance 6d2f30ee-6086-48e1-8701-a8270012be0c could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:40:55.371448 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3a6e24f1-43e1-45dc-a632-cd033e8e2432 tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] 10.222.0.20 "GET /compute/v2.1/servers/6d2f30ee-6086-48e1-8701-a8270012be0c" status: 404 len: 111 microversion: 2.1 time: 0.069003 Oct 27 03:40:55.371448 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2230/4745] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:55 2022] GET /compute/v2.1/servers/6d2f30ee-6086-48e1-8701-a8270012be0c => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 03:40:55.382848 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ec0204f1-b3d3-45c7-803a-010065b30eab tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:55.384057 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ec0204f1-b3d3-45c7-803a-010065b30eab tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] [instance: 621fa99f-f6ef-4333-9e54-1820cb63e2ee] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:55.401352 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ec0204f1-b3d3-45c7-803a-010065b30eab tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:55.402169 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ec0204f1-b3d3-45c7-803a-010065b30eab tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:55.402772 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ec0204f1-b3d3-45c7-803a-010065b30eab tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:55.403744 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ec0204f1-b3d3-45c7-803a-010065b30eab tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:55.404368 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ec0204f1-b3d3-45c7-803a-010065b30eab tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:55.404955 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ec0204f1-b3d3-45c7-803a-010065b30eab tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:55.418546 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-eb0b6a01-7ce1-45cb-ac06-d75167e2188c tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:55.426179 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-ec0204f1-b3d3-45c7-803a-010065b30eab tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] HTTP exception thrown: Instance 621fa99f-f6ef-4333-9e54-1820cb63e2ee could not be found. Oct 27 03:40:55.428151 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ec0204f1-b3d3-45c7-803a-010065b30eab tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Request method failure captured: Oct 27 03:40:55.428151 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/621fa99f-f6ef-4333-9e54-1820cb63e2ee HTTP/1.1 Oct 27 03:40:55.428151 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:40:55.428151 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:40:55.428151 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:40:55.428151 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:40:55.428151 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:40:55.428151 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:40:55.428151 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:40:55.428151 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:40:55.428151 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWf2QKfhIMr-E7cxoCim99MIGM40_Nu76KaYyh7TGDLfhy-zaXQfa0yEUH4oszqfTiJnufyjxSH3Sa5K8Y2tD4DMMRp_hVU3JYALx9mY4dECRAEpqlSRWcWkxc0w70RBDt-_ZsFqSL4fws0Zn9OFne9Nlpd9Yx4c4GjTwi8EXDvQFB-0 Oct 27 03:40:55.428151 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:40:55.428151 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:40:55.428151 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:40:55.428151 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:40:55.428151 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:40:55.428151 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:40:55.428151 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 05672dc7b53747988fde6abc4adb2ef1 Oct 27 03:40:55.428151 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-MultipleCreateTestJSON-1468943424 Oct 27 03:40:55.428151 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:40:55.428151 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:40:55.428151 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/05672dc7b53747988fde6abc4adb2ef1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/05672dc7b53747988fde6abc4adb2ef1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/05672dc7b53747988fde6abc4adb2ef1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_05672dc7b53747988fde6abc4adb2ef1"}]}] Oct 27 03:40:55.428151 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-MultipleCreateTestJSON-1468943424 Oct 27 03:40:55.428151 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 05672dc7b53747988fde6abc4adb2ef1 Oct 27 03:40:55.428151 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1468943424 Oct 27 03:40:55.428151 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-MultipleCreateTestJSON-1468943424-project Oct 27 03:40:55.428151 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:40:55.428151 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:40:55.428151 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: eba500c7bb654a649a57bb8c96aa8bf0 Oct 27 03:40:55.428151 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-MultipleCreateTestJSON-1468943424-project Oct 27 03:40:55.428151 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:40:55.428151 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 621fa99f-f6ef-4333-9e54-1820cb63e2ee could not be found. Oct 27 03:40:55.428151 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '621fa99f-f6ef-4333-9e54-1820cb63e2ee'} Oct 27 03:40:55.428151 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:40:55.428151 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:40:55.428151 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:40:55.428151 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:40:55.428151 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:40:55.428151 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:40:55.428151 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:40:55.428151 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:40:55.428151 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:40:55.428151 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:40:55.428151 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 621fa99f-f6ef-4333-9e54-1820cb63e2ee could not be found. Oct 27 03:40:55.428151 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:40:55.428151 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:40:55.428151 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:40:55.428151 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:40:55.428151 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:40:55.428151 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:40:55.428151 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:40:55.428151 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:40:55.428151 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:40:55.428151 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:40:55.428151 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:40:55.428151 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:40:55.428151 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:40:55.428151 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:40:55.428151 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:40:55.428151 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:40:55.428151 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 621fa99f-f6ef-4333-9e54-1820cb63e2ee could not be found. Oct 27 03:40:55.428151 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:40:55.428151 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:40:55.428151 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:40:55.432538 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:40:55.432538 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:40:55.432538 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:40:55.432538 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:40:55.432538 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:40:55.432538 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 621fa99f-f6ef-4333-9e54-1820cb63e2ee could not be found. Oct 27 03:40:55.432538 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:40:55.433038 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-eb0b6a01-7ce1-45cb-ac06-d75167e2188c tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:55.433038 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-eb0b6a01-7ce1-45cb-ac06-d75167e2188c tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:55.433038 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-eb0b6a01-7ce1-45cb-ac06-d75167e2188c tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d" status: 200 len: 1603 microversion: 2.42 time: 0.125030 Oct 27 03:40:55.434328 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ec0204f1-b3d3-45c7-803a-010065b30eab tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] Returning 404 to user: Instance 621fa99f-f6ef-4333-9e54-1820cb63e2ee could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:40:55.435350 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ec0204f1-b3d3-45c7-803a-010065b30eab tempest-MultipleCreateTestJSON-1468943424 tempest-MultipleCreateTestJSON-1468943424-project] 10.222.0.20 "GET /compute/v2.1/servers/621fa99f-f6ef-4333-9e54-1820cb63e2ee" status: 404 len: 111 microversion: 2.1 time: 0.064714 Oct 27 03:40:55.436093 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2231/4746] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:55 2022] GET /compute/v2.1/servers/621fa99f-f6ef-4333-9e54-1820cb63e2ee => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 03:40:55.438291 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2516/4747] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:40:55 2022] GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d => generated 1603 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:40:55.507809 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-76d4c29b-1527-490d-b85a-2e1cad6ac28d req-e22e88df-4bd9-43a6-9c4a-b4b580cbdf93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "003c8652-2a85-4abc-8f02-ff46b4afcfd1", "tag": "006cf94f-9d7e-4841-85fe-ed1dfa04276d"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:40:55.531196 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-76d4c29b-1527-490d-b85a-2e1cad6ac28d req-e22e88df-4bd9-43a6-9c4a-b4b580cbdf93 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:55.531689 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-76d4c29b-1527-490d-b85a-2e1cad6ac28d req-e22e88df-4bd9-43a6-9c4a-b4b580cbdf93 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:55.532134 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-76d4c29b-1527-490d-b85a-2e1cad6ac28d req-e22e88df-4bd9-43a6-9c4a-b4b580cbdf93 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:55.556042 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-76d4c29b-1527-490d-b85a-2e1cad6ac28d req-e22e88df-4bd9-43a6-9c4a-b4b580cbdf93 service nova] Creating event network-changed:006cf94f-9d7e-4841-85fe-ed1dfa04276d for instance 003c8652-2a85-4abc-8f02-ff46b4afcfd1 on n-h1-862769-1 Oct 27 03:40:55.564431 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-76d4c29b-1527-490d-b85a-2e1cad6ac28d req-e22e88df-4bd9-43a6-9c4a-b4b580cbdf93 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061221 Oct 27 03:40:55.565216 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2232/4748] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:40:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:40:55.675974 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-c3582f73-4444-49d8-afbc-6d1735d4e089 req-7faee406-7db3-45a7-9791-0131e543ff30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fa9583d-e294-4e5f-a6dc-a51d619dc03d", "name": "network-vif-unplugged", "status": "completed", "tag": "aca66186-53fb-44cb-b3c0-fd4406f7b0dd"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:40:55.695319 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-c3582f73-4444-49d8-afbc-6d1735d4e089 req-7faee406-7db3-45a7-9791-0131e543ff30 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:55.696603 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-c3582f73-4444-49d8-afbc-6d1735d4e089 req-7faee406-7db3-45a7-9791-0131e543ff30 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:55.697217 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-c3582f73-4444-49d8-afbc-6d1735d4e089 req-7faee406-7db3-45a7-9791-0131e543ff30 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:55.719509 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-c3582f73-4444-49d8-afbc-6d1735d4e089 req-7faee406-7db3-45a7-9791-0131e543ff30 service nova] Creating event network-vif-unplugged:aca66186-53fb-44cb-b3c0-fd4406f7b0dd for instance 9fa9583d-e294-4e5f-a6dc-a51d619dc03d on n-h2-862769-1 Oct 27 03:40:55.736037 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-c3582f73-4444-49d8-afbc-6d1735d4e089 req-7faee406-7db3-45a7-9791-0131e543ff30 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063861 Oct 27 03:40:55.739863 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2517/4749] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:40:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:40:55.856952 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:40:55.858899 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=10 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:40:55.864436 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f07aec2d-484f-49c8-8abb-2f31d2e09de3 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:55.866299 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f07aec2d-484f-49c8-8abb-2f31d2e09de3 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:55.880925 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f07aec2d-484f-49c8-8abb-2f31d2e09de3 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:55.882735 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f07aec2d-484f-49c8-8abb-2f31d2e09de3 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:55.885764 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f07aec2d-484f-49c8-8abb-2f31d2e09de3 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:55.886840 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f07aec2d-484f-49c8-8abb-2f31d2e09de3 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:55.887389 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f07aec2d-484f-49c8-8abb-2f31d2e09de3 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:55.888045 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f07aec2d-484f-49c8-8abb-2f31d2e09de3 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:56.221664 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-55aff5c2-49e7-4898-8a50-b0f0602aaf42 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:56.222419 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-55aff5c2-49e7-4898-8a50-b0f0602aaf42 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: 003c8652-2a85-4abc-8f02-ff46b4afcfd1] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:56.241626 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-55aff5c2-49e7-4898-8a50-b0f0602aaf42 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:56.242171 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-55aff5c2-49e7-4898-8a50-b0f0602aaf42 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:56.242671 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-55aff5c2-49e7-4898-8a50-b0f0602aaf42 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:56.243405 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-55aff5c2-49e7-4898-8a50-b0f0602aaf42 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:56.248400 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-55aff5c2-49e7-4898-8a50-b0f0602aaf42 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:56.248887 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-55aff5c2-49e7-4898-8a50-b0f0602aaf42 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:56.407218 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f07aec2d-484f-49c8-8abb-2f31d2e09de3 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:56.423188 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f07aec2d-484f-49c8-8abb-2f31d2e09de3 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:56.432179 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f07aec2d-484f-49c8-8abb-2f31d2e09de3 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:56.433880 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f07aec2d-484f-49c8-8abb-2f31d2e09de3 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79" status: 200 len: 1739 microversion: 2.20 time: 0.577919 Oct 27 03:40:56.434990 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2233/4750] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:40:55 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 => generated 1739 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:40:56.440153 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-98bdca57-44a7-4dc3-ac44-a903b5efa79f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:56.441000 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-98bdca57-44a7-4dc3-ac44-a903b5efa79f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 9fa9583d-e294-4e5f-a6dc-a51d619dc03d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:56.451848 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-98bdca57-44a7-4dc3-ac44-a903b5efa79f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:56.454986 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-98bdca57-44a7-4dc3-ac44-a903b5efa79f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:56.456761 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-98bdca57-44a7-4dc3-ac44-a903b5efa79f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:56.459598 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-98bdca57-44a7-4dc3-ac44-a903b5efa79f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:56.460254 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-98bdca57-44a7-4dc3-ac44-a903b5efa79f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:56.461427 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-98bdca57-44a7-4dc3-ac44-a903b5efa79f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:56.592761 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:40:56.671903 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-55aff5c2-49e7-4898-8a50-b0f0602aaf42 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18036411a99e4634bfbaeae24b9f254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229dcb63bc41444391544883b576ce2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:56.680437 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-55aff5c2-49e7-4898-8a50-b0f0602aaf42 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/003c8652-2a85-4abc-8f02-ff46b4afcfd1" status: 200 len: 1367 microversion: 2.1 time: 0.464427 Oct 27 03:40:56.683687 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2518/4751] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:56 2022] GET /compute/v2.1/servers/003c8652-2a85-4abc-8f02-ff46b4afcfd1 => generated 1367 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:40:56.725296 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-98bdca57-44a7-4dc3-ac44-a903b5efa79f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:56.743133 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-98bdca57-44a7-4dc3-ac44-a903b5efa79f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d" status: 200 len: 1506 microversion: 2.1 time: 0.306835 Oct 27 03:40:56.754076 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2234/4752] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:56 2022] GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d => generated 1506 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:40:56.762241 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-65408440-802f-40a7-a536-3214e06d5de9 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:56.762241 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-65408440-802f-40a7-a536-3214e06d5de9 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] [instance: 8c8a2cbb-4acf-4a6b-b684-567617bb930d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:56.777576 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-65408440-802f-40a7-a536-3214e06d5de9 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:56.778112 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-65408440-802f-40a7-a536-3214e06d5de9 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:56.779453 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-65408440-802f-40a7-a536-3214e06d5de9 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:56.783859 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-65408440-802f-40a7-a536-3214e06d5de9 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:56.784861 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-65408440-802f-40a7-a536-3214e06d5de9 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:56.784979 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-65408440-802f-40a7-a536-3214e06d5de9 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:56.914086 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ebcf5d55-38bb-4f5d-b514-481be205c9d7 tempest-QuotasTestJSON-339732456 tempest-QuotasTestJSON-339732456-project] Calling method '.version_select at 0x7f7dd9b81e50>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:56.958648 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-65408440-802f-40a7-a536-3214e06d5de9 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:56.973425 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-65408440-802f-40a7-a536-3214e06d5de9 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:56.981932 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-65408440-802f-40a7-a536-3214e06d5de9 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:56.985446 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-65408440-802f-40a7-a536-3214e06d5de9 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d" status: 200 len: 1603 microversion: 2.42 time: 0.239047 Oct 27 03:40:57.003340 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2235/4753] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:40:56 2022] GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d => generated 1603 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:40:57.015062 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ebcf5d55-38bb-4f5d-b514-481be205c9d7 tempest-QuotasTestJSON-339732456 tempest-QuotasTestJSON-339732456-project] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/13ff89cf3090446693a050dc83fc2aa0/defaults" status: 200 len: 371 microversion: 2.1 time: 0.328794 Oct 27 03:40:57.023729 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2519/4754] 10.222.0.20 () {58 vars in 1269 bytes} [Thu Oct 27 03:40:56 2022] GET /compute/v2.1/os-quota-sets/13ff89cf3090446693a050dc83fc2aa0/defaults => generated 371 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:40:57.030401 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9c074942-a09c-4810-a106-cdb5c7729065 tempest-QuotasTestJSON-339732456 tempest-QuotasTestJSON-339732456-project] Calling method '.version_select at 0x7f7dda1bc550>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:57.135448 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9c074942-a09c-4810-a106-cdb5c7729065 tempest-QuotasTestJSON-339732456 tempest-QuotasTestJSON-339732456-project] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/13ff89cf3090446693a050dc83fc2aa0" status: 200 len: 371 microversion: 2.1 time: 0.110152 Oct 27 03:40:57.136822 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2236/4755] 10.222.0.20 () {58 vars in 1242 bytes} [Thu Oct 27 03:40:57 2022] GET /compute/v2.1/os-quota-sets/13ff89cf3090446693a050dc83fc2aa0 => generated 371 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:40:57.152024 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d1e1f8d5-45af-42d1-9f35-136ca39bfaf2 tempest-QuotasTestJSON-339732456 tempest-QuotasTestJSON-339732456-project] Calling method '.version_select at 0x7f7dd9b3d8b0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:57.261482 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d1e1f8d5-45af-42d1-9f35-136ca39bfaf2 tempest-QuotasTestJSON-339732456 tempest-QuotasTestJSON-339732456-project] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/13ff89cf3090446693a050dc83fc2aa0/defaults" status: 200 len: 371 microversion: 2.1 time: 0.114067 Oct 27 03:40:57.264595 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2520/4756] 10.222.0.20 () {58 vars in 1269 bytes} [Thu Oct 27 03:40:57 2022] GET /compute/v2.1/os-quota-sets/13ff89cf3090446693a050dc83fc2aa0/defaults => generated 371 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:40:57.279645 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-64bffd81-a1f0-465a-8a35-330abf733484 tempest-QuotasTestJSON-339732456 tempest-QuotasTestJSON-339732456-project] Calling method '.version_select at 0x7f7ddabcf430>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:57.422440 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-64bffd81-a1f0-465a-8a35-330abf733484 tempest-QuotasTestJSON-339732456 tempest-QuotasTestJSON-339732456-project] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/13ff89cf3090446693a050dc83fc2aa0" status: 200 len: 371 microversion: 2.1 time: 0.146639 Oct 27 03:40:57.436472 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2237/4757] 10.222.0.20 () {58 vars in 1242 bytes} [Thu Oct 27 03:40:57 2022] GET /compute/v2.1/os-quota-sets/13ff89cf3090446693a050dc83fc2aa0 => generated 371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:40:57.440143 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c136d37c-c59b-47ce-95a7-2792d7ebd0e5 tempest-QuotasTestJSON-339732456 tempest-QuotasTestJSON-339732456-project] Calling method '.version_select at 0x7f7dd9b814c0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:57.459753 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c7f55539-f926-48c5-b11f-571d71c2d070 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:57.460660 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c7f55539-f926-48c5-b11f-571d71c2d070 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:57.490738 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c7f55539-f926-48c5-b11f-571d71c2d070 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:57.497933 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c7f55539-f926-48c5-b11f-571d71c2d070 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:57.498863 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c7f55539-f926-48c5-b11f-571d71c2d070 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:57.502061 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c7f55539-f926-48c5-b11f-571d71c2d070 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:57.503974 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c7f55539-f926-48c5-b11f-571d71c2d070 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:57.510284 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c7f55539-f926-48c5-b11f-571d71c2d070 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:57.631869 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c136d37c-c59b-47ce-95a7-2792d7ebd0e5 tempest-QuotasTestJSON-339732456 tempest-QuotasTestJSON-339732456-project] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/13ff89cf3090446693a050dc83fc2aa0?user_id=36b3153de6c9425196160ca3e3bfb5d0" status: 200 len: 371 microversion: 2.1 time: 0.195785 Oct 27 03:40:57.632990 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2521/4758] 10.222.0.20 () {58 vars in 1323 bytes} [Thu Oct 27 03:40:57 2022] GET /compute/v2.1/os-quota-sets/13ff89cf3090446693a050dc83fc2aa0?user_id=36b3153de6c9425196160ca3e3bfb5d0 => generated 371 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:40:57.708800 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d3ecb294-cc3f-4003-a5f5-53fbe601b82e tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:57.709628 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d3ecb294-cc3f-4003-a5f5-53fbe601b82e tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: 003c8652-2a85-4abc-8f02-ff46b4afcfd1] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:57.721030 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d3ecb294-cc3f-4003-a5f5-53fbe601b82e tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:57.721949 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d3ecb294-cc3f-4003-a5f5-53fbe601b82e tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:57.725112 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d3ecb294-cc3f-4003-a5f5-53fbe601b82e tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:57.727805 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d3ecb294-cc3f-4003-a5f5-53fbe601b82e tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:57.729517 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d3ecb294-cc3f-4003-a5f5-53fbe601b82e tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:57.730188 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d3ecb294-cc3f-4003-a5f5-53fbe601b82e tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:57.843915 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c7f55539-f926-48c5-b11f-571d71c2d070 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:57.853571 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c7f55539-f926-48c5-b11f-571d71c2d070 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:57.863074 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c7f55539-f926-48c5-b11f-571d71c2d070 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:57.864338 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c7f55539-f926-48c5-b11f-571d71c2d070 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79" status: 200 len: 1739 microversion: 2.20 time: 0.408808 Oct 27 03:40:57.865167 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2238/4759] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:40:57 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 => generated 1739 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:40:57.870529 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5da80c9a-b0fc-4084-aab3-7d84ea8220ed tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:57.871152 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5da80c9a-b0fc-4084-aab3-7d84ea8220ed tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 9fa9583d-e294-4e5f-a6dc-a51d619dc03d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:57.881492 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5da80c9a-b0fc-4084-aab3-7d84ea8220ed tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:57.881492 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5da80c9a-b0fc-4084-aab3-7d84ea8220ed tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:57.881492 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5da80c9a-b0fc-4084-aab3-7d84ea8220ed tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:57.881492 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5da80c9a-b0fc-4084-aab3-7d84ea8220ed tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:57.881492 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5da80c9a-b0fc-4084-aab3-7d84ea8220ed tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:57.881492 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5da80c9a-b0fc-4084-aab3-7d84ea8220ed tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:58.124055 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d3ecb294-cc3f-4003-a5f5-53fbe601b82e tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18036411a99e4634bfbaeae24b9f254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229dcb63bc41444391544883b576ce2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:58.139898 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d3ecb294-cc3f-4003-a5f5-53fbe601b82e tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/003c8652-2a85-4abc-8f02-ff46b4afcfd1" status: 200 len: 1367 microversion: 2.1 time: 0.436656 Oct 27 03:40:58.143873 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2522/4760] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:57 2022] GET /compute/v2.1/servers/003c8652-2a85-4abc-8f02-ff46b4afcfd1 => generated 1367 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:40:58.152563 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6df9f7e3-bf64-436f-bd9a-463bef49d209 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:58.157333 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-6df9f7e3-bf64-436f-bd9a-463bef49d209 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] [instance: 8c8a2cbb-4acf-4a6b-b684-567617bb930d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:58.183898 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6df9f7e3-bf64-436f-bd9a-463bef49d209 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:58.195899 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5da80c9a-b0fc-4084-aab3-7d84ea8220ed tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:58.196088 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6df9f7e3-bf64-436f-bd9a-463bef49d209 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:58.200924 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6df9f7e3-bf64-436f-bd9a-463bef49d209 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:58.204578 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6df9f7e3-bf64-436f-bd9a-463bef49d209 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:58.205618 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6df9f7e3-bf64-436f-bd9a-463bef49d209 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:58.206396 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5da80c9a-b0fc-4084-aab3-7d84ea8220ed tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d" status: 200 len: 1509 microversion: 2.1 time: 0.337557 Oct 27 03:40:58.207176 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2239/4761] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:57 2022] GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d => generated 1509 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:40:58.208833 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6df9f7e3-bf64-436f-bd9a-463bef49d209 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:58.239128 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-69ad6240-3ac0-4f9a-b7b4-3a1fc69c2bc5 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:58.241647 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-69ad6240-3ac0-4f9a-b7b4-3a1fc69c2bc5 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 9fa9583d-e294-4e5f-a6dc-a51d619dc03d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:58.254831 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-69ad6240-3ac0-4f9a-b7b4-3a1fc69c2bc5 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:58.255333 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-69ad6240-3ac0-4f9a-b7b4-3a1fc69c2bc5 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:58.259296 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-69ad6240-3ac0-4f9a-b7b4-3a1fc69c2bc5 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:58.260388 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-69ad6240-3ac0-4f9a-b7b4-3a1fc69c2bc5 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:58.261903 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-69ad6240-3ac0-4f9a-b7b4-3a1fc69c2bc5 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:58.265700 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-69ad6240-3ac0-4f9a-b7b4-3a1fc69c2bc5 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:58.335234 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-69ad6240-3ac0-4f9a-b7b4-3a1fc69c2bc5 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 9fa9583d-e294-4e5f-a6dc-a51d619dc03d] Going to try to terminate instance {{(pid=121000) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:40:58.349069 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.compute.api [None req-69ad6240-3ac0-4f9a-b7b4-3a1fc69c2bc5 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 9fa9583d-e294-4e5f-a6dc-a51d619dc03d] Working on deleting snapshot c45cbc52-79b7-484c-a648-5ff84fb0af14 from shelved instance... Oct 27 03:40:58.399680 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6df9f7e3-bf64-436f-bd9a-463bef49d209 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:58.412159 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6df9f7e3-bf64-436f-bd9a-463bef49d209 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:58.417134 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6df9f7e3-bf64-436f-bd9a-463bef49d209 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:58.423507 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6df9f7e3-bf64-436f-bd9a-463bef49d209 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d" status: 200 len: 1603 microversion: 2.42 time: 0.276766 Oct 27 03:40:58.424883 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2523/4762] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:40:58 2022] GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d => generated 1603 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:40:58.895893 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5b5f1996-7356-4868-ac94-046b6a25261d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:58.897625 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5b5f1996-7356-4868-ac94-046b6a25261d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:58.914067 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5b5f1996-7356-4868-ac94-046b6a25261d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:58.921641 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5b5f1996-7356-4868-ac94-046b6a25261d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:58.923140 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5b5f1996-7356-4868-ac94-046b6a25261d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:58.924422 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5b5f1996-7356-4868-ac94-046b6a25261d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:58.927318 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5b5f1996-7356-4868-ac94-046b6a25261d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:58.932374 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5b5f1996-7356-4868-ac94-046b6a25261d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:59.326145 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5b5f1996-7356-4868-ac94-046b6a25261d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:59.344457 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5b5f1996-7356-4868-ac94-046b6a25261d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:59.346359 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5b5f1996-7356-4868-ac94-046b6a25261d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:59.347592 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5b5f1996-7356-4868-ac94-046b6a25261d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79" status: 200 len: 1739 microversion: 2.20 time: 0.456357 Oct 27 03:40:59.369810 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2524/4763] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:40:58 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 => generated 1739 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:40:59.380989 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5fd2a508-29a8-4389-82c0-58aa7a4887b0 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:59.381484 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5fd2a508-29a8-4389-82c0-58aa7a4887b0 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: 003c8652-2a85-4abc-8f02-ff46b4afcfd1] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:59.396333 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5fd2a508-29a8-4389-82c0-58aa7a4887b0 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:59.396845 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5fd2a508-29a8-4389-82c0-58aa7a4887b0 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:59.397298 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5fd2a508-29a8-4389-82c0-58aa7a4887b0 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:59.398073 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5fd2a508-29a8-4389-82c0-58aa7a4887b0 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:59.398548 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5fd2a508-29a8-4389-82c0-58aa7a4887b0 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:59.399535 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5fd2a508-29a8-4389-82c0-58aa7a4887b0 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:59.868966 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5fd2a508-29a8-4389-82c0-58aa7a4887b0 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18036411a99e4634bfbaeae24b9f254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229dcb63bc41444391544883b576ce2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:40:59.877852 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5fd2a508-29a8-4389-82c0-58aa7a4887b0 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/003c8652-2a85-4abc-8f02-ff46b4afcfd1" status: 200 len: 1367 microversion: 2.1 time: 0.505912 Oct 27 03:40:59.882841 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2525/4764] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:40:59 2022] GET /compute/v2.1/servers/003c8652-2a85-4abc-8f02-ff46b4afcfd1 => generated 1367 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:40:59.888920 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-cad92c58-c33f-4f46-8dc7-0bedecfe5af8 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:40:59.890189 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-cad92c58-c33f-4f46-8dc7-0bedecfe5af8 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] [instance: 8c8a2cbb-4acf-4a6b-b684-567617bb930d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:40:59.898129 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cad92c58-c33f-4f46-8dc7-0bedecfe5af8 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:59.899859 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cad92c58-c33f-4f46-8dc7-0bedecfe5af8 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:59.900460 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cad92c58-c33f-4f46-8dc7-0bedecfe5af8 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:40:59.901365 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cad92c58-c33f-4f46-8dc7-0bedecfe5af8 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:40:59.902020 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cad92c58-c33f-4f46-8dc7-0bedecfe5af8 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:40:59.902672 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cad92c58-c33f-4f46-8dc7-0bedecfe5af8 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:00.073606 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-cad92c58-c33f-4f46-8dc7-0bedecfe5af8 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:00.103012 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-cad92c58-c33f-4f46-8dc7-0bedecfe5af8 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:00.109155 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-cad92c58-c33f-4f46-8dc7-0bedecfe5af8 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:00.113234 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-cad92c58-c33f-4f46-8dc7-0bedecfe5af8 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d" status: 200 len: 1603 microversion: 2.42 time: 0.227151 Oct 27 03:41:00.114779 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2526/4765] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:40:59 2022] GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d => generated 1603 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:41:00.376905 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-eb90642a-9c0d-4d20-b913-1ef9e793e21d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:00.377523 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-eb90642a-9c0d-4d20-b913-1ef9e793e21d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:00.386672 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eb90642a-9c0d-4d20-b913-1ef9e793e21d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:00.391947 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eb90642a-9c0d-4d20-b913-1ef9e793e21d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:00.393325 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eb90642a-9c0d-4d20-b913-1ef9e793e21d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:00.394887 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eb90642a-9c0d-4d20-b913-1ef9e793e21d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:00.397844 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eb90642a-9c0d-4d20-b913-1ef9e793e21d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:00.398597 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eb90642a-9c0d-4d20-b913-1ef9e793e21d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:00.476924 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=100 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:41:01.170336 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-eb90642a-9c0d-4d20-b913-1ef9e793e21d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:01.195352 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-eb90642a-9c0d-4d20-b913-1ef9e793e21d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:01.201754 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-eb90642a-9c0d-4d20-b913-1ef9e793e21d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:01.208739 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-eb90642a-9c0d-4d20-b913-1ef9e793e21d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79" status: 200 len: 1739 microversion: 2.20 time: 0.833675 Oct 27 03:41:01.222857 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2527/4766] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:41:00 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 => generated 1739 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:41:01.243140 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-18664421-de1b-4c2f-8320-f2d12a035c7e tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:01.244861 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-18664421-de1b-4c2f-8320-f2d12a035c7e tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: 003c8652-2a85-4abc-8f02-ff46b4afcfd1] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:01.253750 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-18664421-de1b-4c2f-8320-f2d12a035c7e tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:01.254685 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-18664421-de1b-4c2f-8320-f2d12a035c7e tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:01.255398 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-18664421-de1b-4c2f-8320-f2d12a035c7e tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:01.256639 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-18664421-de1b-4c2f-8320-f2d12a035c7e tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:01.257377 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-18664421-de1b-4c2f-8320-f2d12a035c7e tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:01.258070 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-18664421-de1b-4c2f-8320-f2d12a035c7e tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:01.491526 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-18664421-de1b-4c2f-8320-f2d12a035c7e tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18036411a99e4634bfbaeae24b9f254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229dcb63bc41444391544883b576ce2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:01.508501 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-18664421-de1b-4c2f-8320-f2d12a035c7e tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/003c8652-2a85-4abc-8f02-ff46b4afcfd1" status: 200 len: 1367 microversion: 2.1 time: 0.283808 Oct 27 03:41:01.518647 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2528/4767] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:41:01 2022] GET /compute/v2.1/servers/003c8652-2a85-4abc-8f02-ff46b4afcfd1 => generated 1367 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:41:01.522121 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-69ad6240-3ac0-4f9a-b7b4-3a1fc69c2bc5 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 9fa9583d-e294-4e5f-a6dc-a51d619dc03d] Doing local delete in cell d4405804-b3fd-4c57-a074-5c4e2aef7c93(cell1) {{(pid=121000) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 27 03:41:01.522913 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-69ad6240-3ac0-4f9a-b7b4-3a1fc69c2bc5 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:01.525797 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-69ad6240-3ac0-4f9a-b7b4-3a1fc69c2bc5 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:01.525797 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-69ad6240-3ac0-4f9a-b7b4-3a1fc69c2bc5 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:01.525797 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.compute.api [None req-69ad6240-3ac0-4f9a-b7b4-3a1fc69c2bc5 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 9fa9583d-e294-4e5f-a6dc-a51d619dc03d] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 27 03:41:01.533420 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a14c456e-7394-4102-a5ca-bbca385d3001 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:01.533862 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-69ad6240-3ac0-4f9a-b7b4-3a1fc69c2bc5 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 9fa9583d-e294-4e5f-a6dc-a51d619dc03d] deallocate_for_instance() {{(pid=121000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 27 03:41:01.534563 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a14c456e-7394-4102-a5ca-bbca385d3001 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] [instance: 8c8a2cbb-4acf-4a6b-b684-567617bb930d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:01.550581 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a14c456e-7394-4102-a5ca-bbca385d3001 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:01.551306 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a14c456e-7394-4102-a5ca-bbca385d3001 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:01.554536 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a14c456e-7394-4102-a5ca-bbca385d3001 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:01.556354 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a14c456e-7394-4102-a5ca-bbca385d3001 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:01.557408 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a14c456e-7394-4102-a5ca-bbca385d3001 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:01.561804 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a14c456e-7394-4102-a5ca-bbca385d3001 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:01.723935 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a14c456e-7394-4102-a5ca-bbca385d3001 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:01.735522 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a14c456e-7394-4102-a5ca-bbca385d3001 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:01.737750 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a14c456e-7394-4102-a5ca-bbca385d3001 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:01.739487 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a14c456e-7394-4102-a5ca-bbca385d3001 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d" status: 200 len: 1603 microversion: 2.42 time: 0.216972 Oct 27 03:41:01.741451 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2529/4768] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:41:01 2022] GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d => generated 1603 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:41:02.317668 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0a690835-1f67-4635-8870-56da29ede76c tempest-VolumesGetTestJSON-1555534636 tempest-VolumesGetTestJSON-1555534636-project] Action: 'create', calling method: .version_select at 0x7f7dd9b3d040>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-129795143", "metadata": {"Type": "work"}}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:41:02.537516 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-69ad6240-3ac0-4f9a-b7b4-3a1fc69c2bc5 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 9fa9583d-e294-4e5f-a6dc-a51d619dc03d] Updating instance_info_cache with network_info: [] {{(pid=121000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 27 03:41:03.329322 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:41:03.419974 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0a690835-1f67-4635-8870-56da29ede76c tempest-VolumesGetTestJSON-1555534636 tempest-VolumesGetTestJSON-1555534636-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 1.358292 Oct 27 03:41:03.420766 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2530/4769] 10.222.0.20 () {60 vars in 1156 bytes} [Thu Oct 27 03:41:02 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 1360 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 27 03:41:03.425675 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d79db780-64e4-4581-872d-01ff1060432e tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:03.426581 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d79db780-64e4-4581-872d-01ff1060432e tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:03.631858 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:41:03.713818 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-69ad6240-3ac0-4f9a-b7b4-3a1fc69c2bc5 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d" status: 204 len: 0 microversion: 2.1 time: 5.478450 Oct 27 03:41:03.714454 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2240/4770] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:40:58 2022] DELETE /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d => generated 0 bytes in 5480 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:41:03.719793 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-ee2a2158-1c86-4fff-b657-ba3b70964850 req-8cb0072e-ba54-4261-9c49-6d305d23e22b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fa9583d-e294-4e5f-a6dc-a51d619dc03d", "name": "network-vif-deleted", "tag": "aca66186-53fb-44cb-b3c0-fd4406f7b0dd"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:41:03.744241 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-ee2a2158-1c86-4fff-b657-ba3b70964850 req-8cb0072e-ba54-4261-9c49-6d305d23e22b service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:03.756388 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-ee2a2158-1c86-4fff-b657-ba3b70964850 req-8cb0072e-ba54-4261-9c49-6d305d23e22b service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:03.757096 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-ee2a2158-1c86-4fff-b657-ba3b70964850 req-8cb0072e-ba54-4261-9c49-6d305d23e22b service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:03.775616 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.compute.server_external_events [req-ee2a2158-1c86-4fff-b657-ba3b70964850 req-8cb0072e-ba54-4261-9c49-6d305d23e22b service nova] Unable to find a host for instance 9fa9583d-e294-4e5f-a6dc-a51d619dc03d. Dropping event network-vif-deleted {{(pid=121000) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 27 03:41:03.782755 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-ee2a2158-1c86-4fff-b657-ba3b70964850 req-8cb0072e-ba54-4261-9c49-6d305d23e22b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.066614 Oct 27 03:41:03.787416 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2241/4771] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:41:03 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 72 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 27 03:41:03.793579 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3abddf2b-11c7-4ec1-9854-7267ab54858e tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:03.802141 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-3abddf2b-11c7-4ec1-9854-7267ab54858e tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: 003c8652-2a85-4abc-8f02-ff46b4afcfd1] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:03.818964 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3abddf2b-11c7-4ec1-9854-7267ab54858e tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:03.819767 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3abddf2b-11c7-4ec1-9854-7267ab54858e tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:03.820452 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3abddf2b-11c7-4ec1-9854-7267ab54858e tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:03.824568 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3abddf2b-11c7-4ec1-9854-7267ab54858e tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:03.825404 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3abddf2b-11c7-4ec1-9854-7267ab54858e tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:03.826185 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3abddf2b-11c7-4ec1-9854-7267ab54858e tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:03.916389 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d79db780-64e4-4581-872d-01ff1060432e tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:03.917240 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d79db780-64e4-4581-872d-01ff1060432e tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:03.918155 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d79db780-64e4-4581-872d-01ff1060432e tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:03.928267 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d79db780-64e4-4581-872d-01ff1060432e tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:03.928267 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d79db780-64e4-4581-872d-01ff1060432e tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:03.928267 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d79db780-64e4-4581-872d-01ff1060432e tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:04.185487 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d79db780-64e4-4581-872d-01ff1060432e tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:04.199173 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d79db780-64e4-4581-872d-01ff1060432e tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:04.202644 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d79db780-64e4-4581-872d-01ff1060432e tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:04.205137 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d79db780-64e4-4581-872d-01ff1060432e tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79" status: 200 len: 1739 microversion: 2.20 time: 0.783076 Oct 27 03:41:04.207677 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2531/4772] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:41:03 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 => generated 1739 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:41:04.227587 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-cb6032fa-6f1f-47f1-b9d5-3c52dd18fdef tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:04.228608 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-cb6032fa-6f1f-47f1-b9d5-3c52dd18fdef tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] [instance: 8c8a2cbb-4acf-4a6b-b684-567617bb930d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:04.246817 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cb6032fa-6f1f-47f1-b9d5-3c52dd18fdef tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:04.247909 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cb6032fa-6f1f-47f1-b9d5-3c52dd18fdef tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:04.248639 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cb6032fa-6f1f-47f1-b9d5-3c52dd18fdef tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:04.249562 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cb6032fa-6f1f-47f1-b9d5-3c52dd18fdef tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:04.252195 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cb6032fa-6f1f-47f1-b9d5-3c52dd18fdef tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:04.252894 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cb6032fa-6f1f-47f1-b9d5-3c52dd18fdef tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:04.447094 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-cb6032fa-6f1f-47f1-b9d5-3c52dd18fdef tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:04.463034 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-cb6032fa-6f1f-47f1-b9d5-3c52dd18fdef tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:04.470959 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-cb6032fa-6f1f-47f1-b9d5-3c52dd18fdef tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:04.474413 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-cb6032fa-6f1f-47f1-b9d5-3c52dd18fdef tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d" status: 200 len: 1603 microversion: 2.42 time: 0.265078 Oct 27 03:41:04.477027 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2532/4773] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:41:04 2022] GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d => generated 1603 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:41:04.492425 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-0a92c2cd-beaf-47b2-9342-0bfd9f788939 req-6b753eb5-0240-4911-b90e-f38020b135e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "003c8652-2a85-4abc-8f02-ff46b4afcfd1", "name": "network-vif-plugged", "status": "completed", "tag": "006cf94f-9d7e-4841-85fe-ed1dfa04276d"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:41:04.511011 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-3abddf2b-11c7-4ec1-9854-7267ab54858e tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18036411a99e4634bfbaeae24b9f254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229dcb63bc41444391544883b576ce2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:04.518557 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-0a92c2cd-beaf-47b2-9342-0bfd9f788939 req-6b753eb5-0240-4911-b90e-f38020b135e7 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:04.519199 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-0a92c2cd-beaf-47b2-9342-0bfd9f788939 req-6b753eb5-0240-4911-b90e-f38020b135e7 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:04.519335 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3abddf2b-11c7-4ec1-9854-7267ab54858e tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/003c8652-2a85-4abc-8f02-ff46b4afcfd1" status: 200 len: 1367 microversion: 2.1 time: 0.730567 Oct 27 03:41:04.521284 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-0a92c2cd-beaf-47b2-9342-0bfd9f788939 req-6b753eb5-0240-4911-b90e-f38020b135e7 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:04.525378 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2242/4774] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:41:03 2022] GET /compute/v2.1/servers/003c8652-2a85-4abc-8f02-ff46b4afcfd1 => generated 1367 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:41:04.531418 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b8c2a971-fb48-4599-873c-91403ab1d226 tempest-VolumesGetTestJSON-1555534636 tempest-VolumesGetTestJSON-1555534636-project] Calling method '.version_select at 0x7f7ddee455e0>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:04.553220 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-0a92c2cd-beaf-47b2-9342-0bfd9f788939 req-6b753eb5-0240-4911-b90e-f38020b135e7 service nova] Creating event network-vif-plugged:006cf94f-9d7e-4841-85fe-ed1dfa04276d for instance 003c8652-2a85-4abc-8f02-ff46b4afcfd1 on n-h1-862769-1 Oct 27 03:41:04.567738 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-0a92c2cd-beaf-47b2-9342-0bfd9f788939 req-6b753eb5-0240-4911-b90e-f38020b135e7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087867 Oct 27 03:41:04.568812 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2533/4775] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:41:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:41:04.596353 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-992fc8ae-475d-47bb-a814-0fb30edd4f10 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:04.596353 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-992fc8ae-475d-47bb-a814-0fb30edd4f10 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 9fa9583d-e294-4e5f-a6dc-a51d619dc03d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:04.603453 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-992fc8ae-475d-47bb-a814-0fb30edd4f10 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:04.604410 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-992fc8ae-475d-47bb-a814-0fb30edd4f10 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:04.606277 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-992fc8ae-475d-47bb-a814-0fb30edd4f10 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:04.608161 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-992fc8ae-475d-47bb-a814-0fb30edd4f10 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:04.608907 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-992fc8ae-475d-47bb-a814-0fb30edd4f10 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:04.609545 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-992fc8ae-475d-47bb-a814-0fb30edd4f10 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:04.642359 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b8c2a971-fb48-4599-873c-91403ab1d226 tempest-VolumesGetTestJSON-1555534636 tempest-VolumesGetTestJSON-1555534636-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/e738cbf3-f8d2-4566-96d6-d652859904e4" status: 200 len: 352 microversion: 2.1 time: 0.115191 Oct 27 03:41:04.642938 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2243/4776] 10.222.0.20 () {58 vars in 1245 bytes} [Thu Oct 27 03:41:04 2022] GET /compute/v2.1/os-volumes/e738cbf3-f8d2-4566-96d6-d652859904e4 => generated 352 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:41:04.650003 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-992fc8ae-475d-47bb-a814-0fb30edd4f10 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] HTTP exception thrown: Instance 9fa9583d-e294-4e5f-a6dc-a51d619dc03d could not be found. Oct 27 03:41:04.652058 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-992fc8ae-475d-47bb-a814-0fb30edd4f10 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Request method failure captured: Oct 27 03:41:04.652058 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d HTTP/1.1 Oct 27 03:41:04.652058 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:41:04.652058 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:41:04.652058 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:41:04.652058 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:41:04.652058 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:41:04.652058 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:41:04.652058 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:41:04.652058 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:41:04.652058 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfz83jPBQR-IO_RgpXfqqqN_tSIl3Aju213bQLpPTkR-R_lkTGSpHz1Evy7Lbg7I5hWxU9AxviJyxNS0i-wRdj1_O4LyvZEjE6jerjzwB22Vu4S-ThF8W8FJgumwczGUcQup-Bjpiay7kN0UoT8q0uFoQytE3MKt1MX9CDbsUgcc03A Oct 27 03:41:04.652058 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:41:04.652058 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:41:04.652058 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:41:04.652058 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:41:04.652058 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:41:04.652058 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:41:04.652058 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 911997e881754ce390af17919f29b4ab Oct 27 03:41:04.652058 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-DeleteServersTestJSON-858473437 Oct 27 03:41:04.652058 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:41:04.652058 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:41:04.652058 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/911997e881754ce390af17919f29b4ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/911997e881754ce390af17919f29b4ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/911997e881754ce390af17919f29b4ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_911997e881754ce390af17919f29b4ab"}]}] Oct 27 03:41:04.652058 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-DeleteServersTestJSON-858473437 Oct 27 03:41:04.652058 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 911997e881754ce390af17919f29b4ab Oct 27 03:41:04.652058 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-DeleteServersTestJSON-858473437 Oct 27 03:41:04.652058 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-DeleteServersTestJSON-858473437-project Oct 27 03:41:04.652058 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:41:04.652058 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:41:04.652058 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: b1cc79af058b4c35b3c572448fac86a7 Oct 27 03:41:04.652058 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-DeleteServersTestJSON-858473437-project Oct 27 03:41:04.652058 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:41:04.652058 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 9fa9583d-e294-4e5f-a6dc-a51d619dc03d could not be found. Oct 27 03:41:04.652058 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '9fa9583d-e294-4e5f-a6dc-a51d619dc03d'} Oct 27 03:41:04.652058 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:41:04.652058 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:41:04.652058 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:41:04.652058 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:41:04.652058 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:41:04.652058 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:41:04.652058 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:41:04.652058 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:41:04.652058 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:41:04.652058 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:41:04.652058 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fa9583d-e294-4e5f-a6dc-a51d619dc03d could not be found. Oct 27 03:41:04.652058 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:41:04.652058 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:41:04.652058 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:41:04.652058 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:41:04.652058 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:41:04.652058 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:41:04.652058 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:41:04.652058 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:41:04.652058 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:41:04.652058 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:41:04.652058 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:41:04.652058 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:41:04.652058 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:41:04.652058 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:41:04.652058 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:41:04.652058 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:41:04.652058 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fa9583d-e294-4e5f-a6dc-a51d619dc03d could not be found. Oct 27 03:41:04.652058 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:41:04.652058 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:41:04.652058 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:41:04.657022 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:41:04.657022 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:41:04.657022 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:41:04.657022 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:41:04.657022 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:41:04.657022 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fa9583d-e294-4e5f-a6dc-a51d619dc03d could not be found. Oct 27 03:41:04.657022 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:41:04.657022 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-992fc8ae-475d-47bb-a814-0fb30edd4f10 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Returning 404 to user: Instance 9fa9583d-e294-4e5f-a6dc-a51d619dc03d could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:41:04.657022 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-992fc8ae-475d-47bb-a814-0fb30edd4f10 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d" status: 404 len: 111 microversion: 2.1 time: 0.085436 Oct 27 03:41:04.657983 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2534/4777] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:41:04 2022] GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:41:04.798926 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e4c10315-8ceb-43fc-b15f-dcd20a653ca5 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2019011124", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": [{"uuid": "b1f1f8a3-6579-4551-8baa-e65f1847be2c"}]}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:41:04.871794 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-e4c10315-8ceb-43fc-b15f-dcd20a653ca5 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] validate_networks() for [('b1f1f8a3-6579-4551-8baa-e65f1847be2c', None, None, None, None, None)] {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:41:05.243778 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-bbdfcf59-80b0-4067-bf79-5203d86a9e6b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:05.246111 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-bbdfcf59-80b0-4067-bf79-5203d86a9e6b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:05.268810 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bbdfcf59-80b0-4067-bf79-5203d86a9e6b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:05.270672 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bbdfcf59-80b0-4067-bf79-5203d86a9e6b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:05.273018 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bbdfcf59-80b0-4067-bf79-5203d86a9e6b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:05.280239 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bbdfcf59-80b0-4067-bf79-5203d86a9e6b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:05.280737 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bbdfcf59-80b0-4067-bf79-5203d86a9e6b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:05.284322 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bbdfcf59-80b0-4067-bf79-5203d86a9e6b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:05.510071 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-bbdfcf59-80b0-4067-bf79-5203d86a9e6b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:05.522623 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-bbdfcf59-80b0-4067-bf79-5203d86a9e6b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:05.525804 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-bbdfcf59-80b0-4067-bf79-5203d86a9e6b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:05.528292 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-bbdfcf59-80b0-4067-bf79-5203d86a9e6b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79" status: 200 len: 1739 microversion: 2.20 time: 0.297447 Oct 27 03:41:05.529455 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2535/4778] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:41:05 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 => generated 1739 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:41:05.535519 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-59b9838b-2757-4ff1-b8ac-626c3dae35e5 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:05.538740 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-59b9838b-2757-4ff1-b8ac-626c3dae35e5 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] [instance: 8c8a2cbb-4acf-4a6b-b684-567617bb930d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:05.547158 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-59b9838b-2757-4ff1-b8ac-626c3dae35e5 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:05.563402 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-59b9838b-2757-4ff1-b8ac-626c3dae35e5 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:05.564214 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-59b9838b-2757-4ff1-b8ac-626c3dae35e5 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:05.566500 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-59b9838b-2757-4ff1-b8ac-626c3dae35e5 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:05.567676 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-59b9838b-2757-4ff1-b8ac-626c3dae35e5 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:05.568406 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-59b9838b-2757-4ff1-b8ac-626c3dae35e5 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:05.657583 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-59b9838b-2757-4ff1-b8ac-626c3dae35e5 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:05.668245 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-59b9838b-2757-4ff1-b8ac-626c3dae35e5 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:05.670077 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-59b9838b-2757-4ff1-b8ac-626c3dae35e5 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:05.671076 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-59b9838b-2757-4ff1-b8ac-626c3dae35e5 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d" status: 200 len: 1603 microversion: 2.42 time: 0.140294 Oct 27 03:41:05.682060 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2536/4779] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:41:05 2022] GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d => generated 1603 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:41:05.682060 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c6a35ef0-43a6-4a2a-ba6d-a5b4fab2cf3d tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:05.682060 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c6a35ef0-43a6-4a2a-ba6d-a5b4fab2cf3d tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: 003c8652-2a85-4abc-8f02-ff46b4afcfd1] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:05.691775 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c6a35ef0-43a6-4a2a-ba6d-a5b4fab2cf3d tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:05.691775 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c6a35ef0-43a6-4a2a-ba6d-a5b4fab2cf3d tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:05.691775 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c6a35ef0-43a6-4a2a-ba6d-a5b4fab2cf3d tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:05.691775 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c6a35ef0-43a6-4a2a-ba6d-a5b4fab2cf3d tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:05.691775 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c6a35ef0-43a6-4a2a-ba6d-a5b4fab2cf3d tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:05.691775 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c6a35ef0-43a6-4a2a-ba6d-a5b4fab2cf3d tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:05.959634 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c6a35ef0-43a6-4a2a-ba6d-a5b4fab2cf3d tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18036411a99e4634bfbaeae24b9f254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229dcb63bc41444391544883b576ce2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:05.986121 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c6a35ef0-43a6-4a2a-ba6d-a5b4fab2cf3d tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/003c8652-2a85-4abc-8f02-ff46b4afcfd1" status: 200 len: 1367 microversion: 2.1 time: 0.297788 Oct 27 03:41:05.986121 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2537/4780] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:41:05 2022] GET /compute/v2.1/servers/003c8652-2a85-4abc-8f02-ff46b4afcfd1 => generated 1367 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:41:05.986121 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f3f5a8bd-4482-4ab0-89cf-c76ed97e72e8 tempest-VolumesGetTestJSON-1555534636 tempest-VolumesGetTestJSON-1555534636-project] Calling method '.version_select at 0x7f7dd9f7e8b0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:06.041317 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f3f5a8bd-4482-4ab0-89cf-c76ed97e72e8 tempest-VolumesGetTestJSON-1555534636 tempest-VolumesGetTestJSON-1555534636-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/e738cbf3-f8d2-4566-96d6-d652859904e4" status: 200 len: 353 microversion: 2.1 time: 0.068253 Oct 27 03:41:06.050804 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2538/4781] 10.222.0.20 () {58 vars in 1245 bytes} [Thu Oct 27 03:41:05 2022] GET /compute/v2.1/os-volumes/e738cbf3-f8d2-4566-96d6-d652859904e4 => generated 353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:41:06.057943 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a67a2295-e864-4788-86fb-b7e751a726ff tempest-VolumesGetTestJSON-1555534636 tempest-VolumesGetTestJSON-1555534636-project] Calling method '.version_select at 0x7f7dd9c458b0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:06.137703 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a67a2295-e864-4788-86fb-b7e751a726ff tempest-VolumesGetTestJSON-1555534636 tempest-VolumesGetTestJSON-1555534636-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/e738cbf3-f8d2-4566-96d6-d652859904e4" status: 200 len: 353 microversion: 2.1 time: 0.084814 Oct 27 03:41:06.145957 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2539/4782] 10.222.0.20 () {58 vars in 1245 bytes} [Thu Oct 27 03:41:06 2022] GET /compute/v2.1/os-volumes/e738cbf3-f8d2-4566-96d6-d652859904e4 => generated 353 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:41:06.160725 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b2ac8020-4cbf-4327-9e70-c196f12d5e0e tempest-VolumesGetTestJSON-1555534636 tempest-VolumesGetTestJSON-1555534636-project] Calling method '.version_select at 0x7f7dd9c45f70>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:06.505443 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-e4c10315-8ceb-43fc-b15f-dcd20a653ca5 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:41:06.506552 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-e4c10315-8ceb-43fc-b15f-dcd20a653ca5 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:41:06.507272 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-e4c10315-8ceb-43fc-b15f-dcd20a653ca5 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:41:06.507944 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-e4c10315-8ceb-43fc-b15f-dcd20a653ca5 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:41:06.508671 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-e4c10315-8ceb-43fc-b15f-dcd20a653ca5 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:41:06.519399 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e4c10315-8ceb-43fc-b15f-dcd20a653ca5 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:06.520237 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e4c10315-8ceb-43fc-b15f-dcd20a653ca5 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:06.520930 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e4c10315-8ceb-43fc-b15f-dcd20a653ca5 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:06.522543 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e4c10315-8ceb-43fc-b15f-dcd20a653ca5 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:06.523988 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e4c10315-8ceb-43fc-b15f-dcd20a653ca5 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:06.525248 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e4c10315-8ceb-43fc-b15f-dcd20a653ca5 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:06.549184 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-e4c10315-8ceb-43fc-b15f-dcd20a653ca5 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Getting quotas for project 911997e881754ce390af17919f29b4ab. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:41:06.557594 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-e4c10315-8ceb-43fc-b15f-dcd20a653ca5 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Getting quotas for user b1cc79af058b4c35b3c572448fac86a7 and project 911997e881754ce390af17919f29b4ab. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:41:06.575213 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b2ac8020-4cbf-4327-9e70-c196f12d5e0e tempest-VolumesGetTestJSON-1555534636 tempest-VolumesGetTestJSON-1555534636-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/e738cbf3-f8d2-4566-96d6-d652859904e4" status: 202 len: 0 microversion: 2.1 time: 0.420969 Oct 27 03:41:06.576710 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2540/4783] 10.222.0.20 () {58 vars in 1248 bytes} [Thu Oct 27 03:41:06 2022] DELETE /compute/v2.1/os-volumes/e738cbf3-f8d2-4566-96d6-d652859904e4 => generated 0 bytes in 424 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:41:06.632219 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e4c10315-8ceb-43fc-b15f-dcd20a653ca5 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:41:06.640585 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e4c10315-8ceb-43fc-b15f-dcd20a653ca5 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: ac9da5d0-c534-4955-b148-f401c9308618] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:41:06.807538 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e4c10315-8ceb-43fc-b15f-dcd20a653ca5 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.012905 Oct 27 03:41:06.810373 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2244/4784] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:41:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 2016 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 03:41:06.826403 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ecfe8025-4d5d-40bb-8cc7-3f228f7b99cd tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:06.828497 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ecfe8025-4d5d-40bb-8cc7-3f228f7b99cd tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:06.854746 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ecfe8025-4d5d-40bb-8cc7-3f228f7b99cd tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:06.855747 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ecfe8025-4d5d-40bb-8cc7-3f228f7b99cd tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:06.856770 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ecfe8025-4d5d-40bb-8cc7-3f228f7b99cd tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:06.861584 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ecfe8025-4d5d-40bb-8cc7-3f228f7b99cd tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:06.861584 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ecfe8025-4d5d-40bb-8cc7-3f228f7b99cd tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:06.861584 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ecfe8025-4d5d-40bb-8cc7-3f228f7b99cd tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:06.884690 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-60098ffe-9a37-43e0-bf11-d782ba67fd1d tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-783716883", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": "none"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:41:07.059611 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-60098ffe-9a37-43e0-bf11-d782ba67fd1d tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Flavor limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:41:07.059611 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-60098ffe-9a37-43e0-bf11-d782ba67fd1d tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Image limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:41:07.059611 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-60098ffe-9a37-43e0-bf11-d782ba67fd1d tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Flavor pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:41:07.059611 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-60098ffe-9a37-43e0-bf11-d782ba67fd1d tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Image pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:41:07.059611 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-60098ffe-9a37-43e0-bf11-d782ba67fd1d tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:41:07.059611 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-60098ffe-9a37-43e0-bf11-d782ba67fd1d tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:07.059611 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-60098ffe-9a37-43e0-bf11-d782ba67fd1d tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:07.059611 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-60098ffe-9a37-43e0-bf11-d782ba67fd1d tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:07.059611 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-60098ffe-9a37-43e0-bf11-d782ba67fd1d tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:07.059611 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-60098ffe-9a37-43e0-bf11-d782ba67fd1d tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:07.059611 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-60098ffe-9a37-43e0-bf11-d782ba67fd1d tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:07.066916 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-60098ffe-9a37-43e0-bf11-d782ba67fd1d tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Getting quotas for project f139e1ec9338495c94d9df2cc3652247. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:41:07.077288 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-60098ffe-9a37-43e0-bf11-d782ba67fd1d tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Getting quotas for user 6bc4279c64ba4b52aefd967ce73f9530 and project f139e1ec9338495c94d9df2cc3652247. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:41:07.101056 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-60098ffe-9a37-43e0-bf11-d782ba67fd1d tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Going to run 1 instances... {{(pid=121001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:41:07.106014 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-60098ffe-9a37-43e0-bf11-d782ba67fd1d tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] [instance: 993b1281-2151-4081-80f9-0b14f4838a9b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:41:07.164533 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ecfe8025-4d5d-40bb-8cc7-3f228f7b99cd tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:07.182494 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ecfe8025-4d5d-40bb-8cc7-3f228f7b99cd tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:07.184342 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ecfe8025-4d5d-40bb-8cc7-3f228f7b99cd tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:07.187944 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ecfe8025-4d5d-40bb-8cc7-3f228f7b99cd tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79" status: 200 len: 1739 microversion: 2.20 time: 0.373240 Oct 27 03:41:07.190642 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2245/4785] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:41:06 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 => generated 1739 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:41:07.198120 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ff0a2850-4ce6-4e6a-a9da-0a899998707d tempest-VolumesGetTestJSON-1555534636 tempest-VolumesGetTestJSON-1555534636-project] Calling method '.version_select at 0x7f7dda873af0>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:07.254533 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:41:07.272183 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ff0a2850-4ce6-4e6a-a9da-0a899998707d tempest-VolumesGetTestJSON-1555534636 tempest-VolumesGetTestJSON-1555534636-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/e738cbf3-f8d2-4566-96d6-d652859904e4" status: 200 len: 352 microversion: 2.1 time: 0.080146 Oct 27 03:41:07.280828 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2246/4786] 10.222.0.20 () {58 vars in 1245 bytes} [Thu Oct 27 03:41:07 2022] GET /compute/v2.1/os-volumes/e738cbf3-f8d2-4566-96d6-d652859904e4 => generated 352 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:41:07.286804 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9d610efa-ac2a-45ea-9034-710273a3f79e tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:07.287814 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9d610efa-ac2a-45ea-9034-710273a3f79e tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] [instance: 8c8a2cbb-4acf-4a6b-b684-567617bb930d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:07.298325 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9d610efa-ac2a-45ea-9034-710273a3f79e tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:07.299162 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9d610efa-ac2a-45ea-9034-710273a3f79e tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:07.299870 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9d610efa-ac2a-45ea-9034-710273a3f79e tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:07.301019 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9d610efa-ac2a-45ea-9034-710273a3f79e tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:07.301628 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9d610efa-ac2a-45ea-9034-710273a3f79e tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:07.302305 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9d610efa-ac2a-45ea-9034-710273a3f79e tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:07.354606 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9d610efa-ac2a-45ea-9034-710273a3f79e tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:07.355118 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9d610efa-ac2a-45ea-9034-710273a3f79e tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:07.355691 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9d610efa-ac2a-45ea-9034-710273a3f79e tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:07.356308 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-9d610efa-ac2a-45ea-9034-710273a3f79e tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lazy-loading 'fault' on Instance uuid 8c8a2cbb-4acf-4a6b-b684-567617bb930d {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:41:07.434975 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9d610efa-ac2a-45ea-9034-710273a3f79e tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:07.455659 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9d610efa-ac2a-45ea-9034-710273a3f79e tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:07.457112 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9d610efa-ac2a-45ea-9034-710273a3f79e tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9053ce63864308b29190f9f51bd85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296abb4b5dde441da95f4d09089f348e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:07.469545 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-60098ffe-9a37-43e0-bf11-d782ba67fd1d tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.876044 Oct 27 03:41:07.471274 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9d610efa-ac2a-45ea-9034-710273a3f79e tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d" status: 200 len: 1608 microversion: 2.42 time: 0.188916 Oct 27 03:41:07.471969 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2247/4787] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:41:07 2022] GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d => generated 1608 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:41:07.472266 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2541/4788] 10.222.0.20 () {62 vars in 1188 bytes} [Thu Oct 27 03:41:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 888 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 27 03:41:07.478868 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-52b37d8c-78b5-459b-ba43-ee4679fb648f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:07.482944 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-52b37d8c-78b5-459b-ba43-ee4679fb648f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: ac9da5d0-c534-4955-b148-f401c9308618] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:07.496816 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a93395c7-24b2-4e37-b0f1-3b0543a5abb7 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:07.499993 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a93395c7-24b2-4e37-b0f1-3b0543a5abb7 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: 003c8652-2a85-4abc-8f02-ff46b4afcfd1] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:07.514359 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a93395c7-24b2-4e37-b0f1-3b0543a5abb7 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:07.517706 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a93395c7-24b2-4e37-b0f1-3b0543a5abb7 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:07.518966 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a93395c7-24b2-4e37-b0f1-3b0543a5abb7 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:07.519831 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a93395c7-24b2-4e37-b0f1-3b0543a5abb7 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:07.520299 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a93395c7-24b2-4e37-b0f1-3b0543a5abb7 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:07.520756 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a93395c7-24b2-4e37-b0f1-3b0543a5abb7 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:07.706319 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-52b37d8c-78b5-459b-ba43-ee4679fb648f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:07.706319 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-52b37d8c-78b5-459b-ba43-ee4679fb648f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/ac9da5d0-c534-4955-b148-f401c9308618" status: 200 len: 1215 microversion: 2.1 time: 0.224642 Oct 27 03:41:07.706319 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2248/4789] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:41:07 2022] GET /compute/v2.1/servers/ac9da5d0-c534-4955-b148-f401c9308618 => generated 1215 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:41:07.706319 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c2803ce0-0fb3-43e0-9ee5-76ff745ad898 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:07.706319 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c2803ce0-0fb3-43e0-9ee5-76ff745ad898 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] [instance: 993b1281-2151-4081-80f9-0b14f4838a9b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:07.795647 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a93395c7-24b2-4e37-b0f1-3b0543a5abb7 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18036411a99e4634bfbaeae24b9f254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229dcb63bc41444391544883b576ce2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:07.805479 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a93395c7-24b2-4e37-b0f1-3b0543a5abb7 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/003c8652-2a85-4abc-8f02-ff46b4afcfd1" status: 200 len: 1556 microversion: 2.1 time: 0.331232 Oct 27 03:41:07.806489 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2542/4790] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:41:07 2022] GET /compute/v2.1/servers/003c8652-2a85-4abc-8f02-ff46b4afcfd1 => generated 1556 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:41:07.830786 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f94cac48-34a1-4a92-aab1-9e8c1ba8253c tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:07.831833 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f94cac48-34a1-4a92-aab1-9e8c1ba8253c tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: 003c8652-2a85-4abc-8f02-ff46b4afcfd1] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:07.840827 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f94cac48-34a1-4a92-aab1-9e8c1ba8253c tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:07.854410 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f94cac48-34a1-4a92-aab1-9e8c1ba8253c tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:07.855316 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f94cac48-34a1-4a92-aab1-9e8c1ba8253c tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:07.857828 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f94cac48-34a1-4a92-aab1-9e8c1ba8253c tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:07.858595 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f94cac48-34a1-4a92-aab1-9e8c1ba8253c tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:07.864069 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f94cac48-34a1-4a92-aab1-9e8c1ba8253c tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:07.887580 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c2803ce0-0fb3-43e0-9ee5-76ff745ad898 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc4279c64ba4b52aefd967ce73f9530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f139e1ec9338495c94d9df2cc3652247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:07.902191 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c2803ce0-0fb3-43e0-9ee5-76ff745ad898 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc4279c64ba4b52aefd967ce73f9530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f139e1ec9338495c94d9df2cc3652247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:07.906566 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c2803ce0-0fb3-43e0-9ee5-76ff745ad898 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc4279c64ba4b52aefd967ce73f9530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f139e1ec9338495c94d9df2cc3652247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:07.908836 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c2803ce0-0fb3-43e0-9ee5-76ff745ad898 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] 10.222.0.20 "GET /compute/v2.1/servers/993b1281-2151-4081-80f9-0b14f4838a9b" status: 200 len: 1280 microversion: 2.47 time: 0.207427 Oct 27 03:41:07.909493 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2249/4791] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:41:07 2022] GET /compute/v2.1/servers/993b1281-2151-4081-80f9-0b14f4838a9b => generated 1280 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:41:08.105657 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f94cac48-34a1-4a92-aab1-9e8c1ba8253c tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/003c8652-2a85-4abc-8f02-ff46b4afcfd1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.279622 Oct 27 03:41:08.106722 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2543/4792] 10.222.0.20 () {58 vars in 1275 bytes} [Thu Oct 27 03:41:07 2022] GET /compute/v2.1/servers/003c8652-2a85-4abc-8f02-ff46b4afcfd1/os-interface => generated 284 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:41:08.222059 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-99dc19b1-8854-499d-a7c0-006369c40452 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:08.223258 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-99dc19b1-8854-499d-a7c0-006369c40452 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:08.236304 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-99dc19b1-8854-499d-a7c0-006369c40452 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:08.238554 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-99dc19b1-8854-499d-a7c0-006369c40452 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:08.239214 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-99dc19b1-8854-499d-a7c0-006369c40452 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:08.240014 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-99dc19b1-8854-499d-a7c0-006369c40452 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:08.243853 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-99dc19b1-8854-499d-a7c0-006369c40452 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:08.244532 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-99dc19b1-8854-499d-a7c0-006369c40452 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:08.288130 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0cbb9ac5-5e2e-417f-a270-763dda12eedc tempest-VolumesGetTestJSON-1555534636 tempest-VolumesGetTestJSON-1555534636-project] Calling method '.version_select at 0x7f7dd9b98af0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:08.461635 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0cbb9ac5-5e2e-417f-a270-763dda12eedc tempest-VolumesGetTestJSON-1555534636 tempest-VolumesGetTestJSON-1555534636-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/e738cbf3-f8d2-4566-96d6-d652859904e4" status: 200 len: 352 microversion: 2.1 time: 0.178119 Oct 27 03:41:08.462273 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2544/4793] 10.222.0.20 () {58 vars in 1245 bytes} [Thu Oct 27 03:41:08 2022] GET /compute/v2.1/os-volumes/e738cbf3-f8d2-4566-96d6-d652859904e4 => generated 352 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:41:08.499658 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1a35738d-edd4-44a6-9c88-6a719be85166 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:08.500489 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1a35738d-edd4-44a6-9c88-6a719be85166 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] [instance: 8c8a2cbb-4acf-4a6b-b684-567617bb930d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:08.510194 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1a35738d-edd4-44a6-9c88-6a719be85166 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:08.515805 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1a35738d-edd4-44a6-9c88-6a719be85166 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:08.520728 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1a35738d-edd4-44a6-9c88-6a719be85166 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:08.521728 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1a35738d-edd4-44a6-9c88-6a719be85166 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:08.522394 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1a35738d-edd4-44a6-9c88-6a719be85166 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:08.523162 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1a35738d-edd4-44a6-9c88-6a719be85166 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:08.554626 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-1a35738d-edd4-44a6-9c88-6a719be85166 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] HTTP exception thrown: Instance 8c8a2cbb-4acf-4a6b-b684-567617bb930d could not be found. Oct 27 03:41:08.557648 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1a35738d-edd4-44a6-9c88-6a719be85166 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Request method failure captured: Oct 27 03:41:08.557648 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d HTTP/1.1 Oct 27 03:41:08.557648 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:41:08.557648 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:41:08.557648 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:41:08.557648 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:41:08.557648 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:41:08.557648 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:41:08.557648 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:41:08.557648 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:41:08.557648 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfvwB3lGLd4DkzMcu7xOE1iUX01_uWUEjXXpWvOm4czSAe90DY6BHH-THIkABflsY3JgVK75QX5KsFftByEDgIegxv8tHwyuN5cFITjwygkdcMnxKq-KMBdRYtvneTxKxK6-oftDeAN9-TSTJH4Q_0b1nCqCzYIpLqbes3DDaks_L-g Oct 27 03:41:08.557648 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:41:08.557648 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:41:08.557648 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:41:08.557648 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:41:08.557648 n-d-862769-1 devstack@n-api.service[121001]: X-Openstack-Nova-Api-Version: 2.42 Oct 27 03:41:08.557648 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:41:08.557648 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:41:08.557648 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 296abb4b5dde441da95f4d09089f348e Oct 27 03:41:08.557648 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-790237949 Oct 27 03:41:08.557648 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:41:08.557648 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:41:08.557648 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/296abb4b5dde441da95f4d09089f348e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/296abb4b5dde441da95f4d09089f348e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/296abb4b5dde441da95f4d09089f348e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_296abb4b5dde441da95f4d09089f348e"}]}] Oct 27 03:41:08.557648 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-TaggedBootDevicesTest_v242-790237949 Oct 27 03:41:08.557648 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 296abb4b5dde441da95f4d09089f348e Oct 27 03:41:08.557648 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-790237949 Oct 27 03:41:08.557648 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-TaggedBootDevicesTest_v242-790237949-project Oct 27 03:41:08.557648 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:41:08.557648 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:41:08.557648 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 0d9053ce63864308b29190f9f51bd85f Oct 27 03:41:08.557648 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-TaggedBootDevicesTest_v242-790237949-project Oct 27 03:41:08.557648 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:41:08.557648 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 8c8a2cbb-4acf-4a6b-b684-567617bb930d could not be found. Oct 27 03:41:08.557648 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '8c8a2cbb-4acf-4a6b-b684-567617bb930d'} Oct 27 03:41:08.557648 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:41:08.557648 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:41:08.557648 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:41:08.557648 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:41:08.557648 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:41:08.557648 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:41:08.557648 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:41:08.557648 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:41:08.557648 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:41:08.557648 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:41:08.557648 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c8a2cbb-4acf-4a6b-b684-567617bb930d could not be found. Oct 27 03:41:08.557648 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:41:08.557648 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:41:08.557648 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:41:08.557648 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:41:08.557648 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:41:08.557648 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:41:08.557648 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:41:08.557648 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:41:08.557648 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:41:08.557648 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:41:08.557648 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:41:08.557648 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:41:08.557648 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:41:08.557648 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:41:08.557648 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:41:08.557648 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:41:08.557648 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c8a2cbb-4acf-4a6b-b684-567617bb930d could not be found. Oct 27 03:41:08.557648 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:41:08.557648 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:41:08.562173 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:41:08.562173 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:41:08.562173 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:41:08.562173 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:41:08.562173 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:41:08.562173 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:41:08.562173 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c8a2cbb-4acf-4a6b-b684-567617bb930d could not be found. Oct 27 03:41:08.562173 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:41:08.562173 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1a35738d-edd4-44a6-9c88-6a719be85166 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Returning 404 to user: Instance 8c8a2cbb-4acf-4a6b-b684-567617bb930d could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:41:08.562173 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1a35738d-edd4-44a6-9c88-6a719be85166 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d" status: 404 len: 111 microversion: 2.42 time: 0.064403 Oct 27 03:41:08.563407 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2545/4794] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:41:08 2022] GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 03:41:08.569707 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0260c399-6258-4558-bf35-d9c326c5e989 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Calling method '.version_select at 0x7f7dd9b3d8b0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:08.723167 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0260c399-6258-4558-bf35-d9c326c5e989 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-501150173" status: 204 len: 0 microversion: 2.42 time: 0.158395 Oct 27 03:41:08.725542 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2546/4795] 10.222.0.20 () {60 vars in 1259 bytes} [Thu Oct 27 03:41:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-501150173 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 03:41:08.735774 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f023fc3b-fa6b-497c-b099-6f43dfbf9d65 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:08.736018 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-99dc19b1-8854-499d-a7c0-006369c40452 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:08.737284 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f023fc3b-fa6b-497c-b099-6f43dfbf9d65 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: ac9da5d0-c534-4955-b148-f401c9308618] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:08.749393 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f023fc3b-fa6b-497c-b099-6f43dfbf9d65 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:08.750202 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f023fc3b-fa6b-497c-b099-6f43dfbf9d65 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:08.751116 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f023fc3b-fa6b-497c-b099-6f43dfbf9d65 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:08.753585 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f023fc3b-fa6b-497c-b099-6f43dfbf9d65 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:08.754369 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f023fc3b-fa6b-497c-b099-6f43dfbf9d65 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:08.754492 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-99dc19b1-8854-499d-a7c0-006369c40452 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:08.755085 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f023fc3b-fa6b-497c-b099-6f43dfbf9d65 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:08.764074 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-99dc19b1-8854-499d-a7c0-006369c40452 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:08.764074 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-99dc19b1-8854-499d-a7c0-006369c40452 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79" status: 200 len: 1739 microversion: 2.20 time: 0.541239 Oct 27 03:41:08.764074 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2250/4796] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:41:08 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 => generated 1739 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:41:08.939852 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1b53465d-8a51-4753-ac5e-c9938c3cdaaa tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:08.940858 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1b53465d-8a51-4753-ac5e-c9938c3cdaaa tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] [instance: 993b1281-2151-4081-80f9-0b14f4838a9b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:08.983190 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f023fc3b-fa6b-497c-b099-6f43dfbf9d65 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:09.002433 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f023fc3b-fa6b-497c-b099-6f43dfbf9d65 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/ac9da5d0-c534-4955-b148-f401c9308618" status: 200 len: 1219 microversion: 2.1 time: 0.270823 Oct 27 03:41:09.004376 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2547/4797] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:41:08 2022] GET /compute/v2.1/servers/ac9da5d0-c534-4955-b148-f401c9308618 => generated 1219 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:41:09.230968 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1b53465d-8a51-4753-ac5e-c9938c3cdaaa tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc4279c64ba4b52aefd967ce73f9530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f139e1ec9338495c94d9df2cc3652247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:09.249667 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1b53465d-8a51-4753-ac5e-c9938c3cdaaa tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc4279c64ba4b52aefd967ce73f9530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f139e1ec9338495c94d9df2cc3652247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:09.255991 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1b53465d-8a51-4753-ac5e-c9938c3cdaaa tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc4279c64ba4b52aefd967ce73f9530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f139e1ec9338495c94d9df2cc3652247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:09.259218 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1b53465d-8a51-4753-ac5e-c9938c3cdaaa tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] 10.222.0.20 "GET /compute/v2.1/servers/993b1281-2151-4081-80f9-0b14f4838a9b" status: 200 len: 1280 microversion: 2.47 time: 0.323215 Oct 27 03:41:09.261332 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2251/4798] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:41:08 2022] GET /compute/v2.1/servers/993b1281-2151-4081-80f9-0b14f4838a9b => generated 1280 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:41:09.476686 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d18e08df-113c-4789-9140-89879b7d096d tempest-VolumesGetTestJSON-1555534636 tempest-VolumesGetTestJSON-1555534636-project] Calling method '.version_select at 0x7f7dd9b3d8b0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:09.597423 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d18e08df-113c-4789-9140-89879b7d096d tempest-VolumesGetTestJSON-1555534636 tempest-VolumesGetTestJSON-1555534636-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/e738cbf3-f8d2-4566-96d6-d652859904e4" status: 200 len: 352 microversion: 2.1 time: 0.125525 Oct 27 03:41:09.598396 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2548/4799] 10.222.0.20 () {58 vars in 1245 bytes} [Thu Oct 27 03:41:09 2022] GET /compute/v2.1/os-volumes/e738cbf3-f8d2-4566-96d6-d652859904e4 => generated 352 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:41:09.804097 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7094f615-d060-426d-8a6a-258cf2135af9 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:09.810465 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7094f615-d060-426d-8a6a-258cf2135af9 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:09.835516 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7094f615-d060-426d-8a6a-258cf2135af9 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:09.837176 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7094f615-d060-426d-8a6a-258cf2135af9 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:09.837944 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7094f615-d060-426d-8a6a-258cf2135af9 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:09.839761 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7094f615-d060-426d-8a6a-258cf2135af9 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:09.840875 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7094f615-d060-426d-8a6a-258cf2135af9 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:09.841576 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7094f615-d060-426d-8a6a-258cf2135af9 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:10.028895 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-be653d40-5216-4987-8a06-ee23936287e9 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:10.030224 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-be653d40-5216-4987-8a06-ee23936287e9 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: ac9da5d0-c534-4955-b148-f401c9308618] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:10.040251 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-be653d40-5216-4987-8a06-ee23936287e9 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:10.043944 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-be653d40-5216-4987-8a06-ee23936287e9 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:10.043944 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-be653d40-5216-4987-8a06-ee23936287e9 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:10.043944 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-be653d40-5216-4987-8a06-ee23936287e9 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:10.043944 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-be653d40-5216-4987-8a06-ee23936287e9 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:10.043944 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-be653d40-5216-4987-8a06-ee23936287e9 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:10.127956 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-be653d40-5216-4987-8a06-ee23936287e9 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:10.138162 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-be653d40-5216-4987-8a06-ee23936287e9 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/ac9da5d0-c534-4955-b148-f401c9308618" status: 200 len: 1267 microversion: 2.1 time: 0.114071 Oct 27 03:41:10.139729 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2549/4800] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:41:10 2022] GET /compute/v2.1/servers/ac9da5d0-c534-4955-b148-f401c9308618 => generated 1267 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:41:10.293326 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-fd1a385a-4929-4215-85bc-3f6d743357a5 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:10.296501 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-fd1a385a-4929-4215-85bc-3f6d743357a5 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] [instance: 993b1281-2151-4081-80f9-0b14f4838a9b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:10.310638 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fd1a385a-4929-4215-85bc-3f6d743357a5 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:10.313692 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fd1a385a-4929-4215-85bc-3f6d743357a5 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:10.313692 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fd1a385a-4929-4215-85bc-3f6d743357a5 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:10.313692 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fd1a385a-4929-4215-85bc-3f6d743357a5 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:10.313692 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fd1a385a-4929-4215-85bc-3f6d743357a5 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:10.314472 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fd1a385a-4929-4215-85bc-3f6d743357a5 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:10.442132 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7094f615-d060-426d-8a6a-258cf2135af9 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:10.455504 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7094f615-d060-426d-8a6a-258cf2135af9 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:10.464665 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7094f615-d060-426d-8a6a-258cf2135af9 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:10.466151 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7094f615-d060-426d-8a6a-258cf2135af9 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79" status: 200 len: 1739 microversion: 2.20 time: 0.677164 Oct 27 03:41:10.469632 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2252/4801] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:41:09 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 => generated 1739 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:41:10.511146 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-fd1a385a-4929-4215-85bc-3f6d743357a5 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc4279c64ba4b52aefd967ce73f9530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f139e1ec9338495c94d9df2cc3652247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:10.526608 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-fd1a385a-4929-4215-85bc-3f6d743357a5 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc4279c64ba4b52aefd967ce73f9530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f139e1ec9338495c94d9df2cc3652247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:10.528926 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-fd1a385a-4929-4215-85bc-3f6d743357a5 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc4279c64ba4b52aefd967ce73f9530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f139e1ec9338495c94d9df2cc3652247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:10.532136 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-fd1a385a-4929-4215-85bc-3f6d743357a5 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] 10.222.0.20 "GET /compute/v2.1/servers/993b1281-2151-4081-80f9-0b14f4838a9b" status: 200 len: 1276 microversion: 2.47 time: 0.245235 Oct 27 03:41:10.533959 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2550/4802] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:41:10 2022] GET /compute/v2.1/servers/993b1281-2151-4081-80f9-0b14f4838a9b => generated 1276 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:41:10.613271 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-82ff225c-9c81-48d1-8cb8-5018172a951f tempest-VolumesGetTestJSON-1555534636 tempest-VolumesGetTestJSON-1555534636-project] Calling method '.version_select at 0x7f7dda9b9d30>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:10.669668 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-82ff225c-9c81-48d1-8cb8-5018172a951f tempest-VolumesGetTestJSON-1555534636 tempest-VolumesGetTestJSON-1555534636-project] HTTP exception thrown: Volume e738cbf3-f8d2-4566-96d6-d652859904e4 could not be found. Oct 27 03:41:10.682717 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-82ff225c-9c81-48d1-8cb8-5018172a951f tempest-VolumesGetTestJSON-1555534636 tempest-VolumesGetTestJSON-1555534636-project] Request method failure captured: Oct 27 03:41:10.682717 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/os-volumes/e738cbf3-f8d2-4566-96d6-d652859904e4 HTTP/1.1 Oct 27 03:41:10.682717 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:41:10.682717 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:41:10.682717 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:41:10.682717 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:41:10.682717 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:41:10.682717 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:41:10.682717 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:41:10.682717 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:41:10.682717 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWf3NsS3-D2bvnkGrrBHy6vzYJ6EEttfI4ZDy7sVffboiE2neB5-Ie1qUJQXN9mpoYFllLBhwXsDHwB6O6vUOxROV0YWNKNcjyvZ-AUKeoFiHBKU2WLlAbL1x3Tg8p_VEQU37xcLXbyt69P2QUz0Hdo-kTjRFJIAi5n01hqo7L8qoHho Oct 27 03:41:10.682717 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:41:10.682717 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:41:10.682717 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:41:10.682717 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:41:10.682717 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:41:10.682717 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:41:10.682717 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 35f5298f2bce42758be2373c640881fe Oct 27 03:41:10.682717 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-VolumesGetTestJSON-1555534636 Oct 27 03:41:10.682717 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:41:10.682717 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:41:10.682717 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/35f5298f2bce42758be2373c640881fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/35f5298f2bce42758be2373c640881fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/35f5298f2bce42758be2373c640881fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_35f5298f2bce42758be2373c640881fe"}]}] Oct 27 03:41:10.682717 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-VolumesGetTestJSON-1555534636 Oct 27 03:41:10.682717 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 35f5298f2bce42758be2373c640881fe Oct 27 03:41:10.682717 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-VolumesGetTestJSON-1555534636 Oct 27 03:41:10.682717 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-VolumesGetTestJSON-1555534636-project Oct 27 03:41:10.682717 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:41:10.682717 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:41:10.682717 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 7e74c5f19f2245d18d8dbb31c916e5e9 Oct 27 03:41:10.682717 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-VolumesGetTestJSON-1555534636-project Oct 27 03:41:10.682717 n-d-862769-1 devstack@n-api.service[121000]: method: Oct 27 03:41:10.682717 n-d-862769-1 devstack@n-api.service[121000]: exception: Volume e738cbf3-f8d2-4566-96d6-d652859904e4 could not be found. Oct 27 03:41:10.682717 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': 'e738cbf3-f8d2-4566-96d6-d652859904e4'} Oct 27 03:41:10.682717 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:41:10.682717 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:41:10.682717 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 03:41:10.682717 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 03:41:10.682717 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 27 03:41:10.682717 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 27 03:41:10.682717 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 27 03:41:10.682717 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 27 03:41:10.682717 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 03:41:10.682717 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 03:41:10.682717 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 03:41:10.682717 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 03:41:10.682717 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 03:41:10.682717 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 03:41:10.682717 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 03:41:10.682717 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 03:41:10.682717 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e738cbf3-f8d2-4566-96d6-d652859904e4 could not be found. (HTTP 404) (Request-ID: req-cee2fc35-9317-4e68-b4f4-0562067fa743) Oct 27 03:41:10.682717 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:41:10.682717 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:41:10.682717 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:41:10.682717 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:41:10.682717 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 27 03:41:10.682717 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 27 03:41:10.682717 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 27 03:41:10.682717 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 27 03:41:10.682717 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 27 03:41:10.682717 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 27 03:41:10.682717 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 27 03:41:10.682717 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 27 03:41:10.682717 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 03:41:10.691575 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 03:41:10.691575 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 27 03:41:10.691575 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 27 03:41:10.691575 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 27 03:41:10.691575 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 27 03:41:10.691575 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 03:41:10.691575 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 03:41:10.691575 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 03:41:10.691575 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 03:41:10.691575 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 03:41:10.691575 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 03:41:10.691575 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 03:41:10.691575 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 03:41:10.691575 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e738cbf3-f8d2-4566-96d6-d652859904e4 could not be found. Oct 27 03:41:10.691575 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:41:10.691575 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:41:10.691575 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:41:10.691575 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:41:10.691575 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:41:10.691575 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:41:10.691575 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:41:10.691575 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:41:10.691575 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:41:10.691575 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:41:10.691575 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:41:10.691575 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:41:10.691575 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 27 03:41:10.691575 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:41:10.691575 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e738cbf3-f8d2-4566-96d6-d652859904e4 could not be found. Oct 27 03:41:10.691575 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:41:10.691575 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:41:10.691575 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:41:10.691575 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:41:10.691575 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:41:10.691575 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:41:10.691575 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:41:10.691575 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:41:10.691575 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e738cbf3-f8d2-4566-96d6-d652859904e4 could not be found. Oct 27 03:41:10.691575 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:41:10.691575 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-82ff225c-9c81-48d1-8cb8-5018172a951f tempest-VolumesGetTestJSON-1555534636 tempest-VolumesGetTestJSON-1555534636-project] Returning 404 to user: Volume e738cbf3-f8d2-4566-96d6-d652859904e4 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:41:10.691575 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-82ff225c-9c81-48d1-8cb8-5018172a951f tempest-VolumesGetTestJSON-1555534636 tempest-VolumesGetTestJSON-1555534636-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/e738cbf3-f8d2-4566-96d6-d652859904e4" status: 404 len: 109 microversion: 2.1 time: 0.076464 Oct 27 03:41:10.691575 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2253/4803] 10.222.0.20 () {58 vars in 1245 bytes} [Thu Oct 27 03:41:10 2022] GET /compute/v2.1/os-volumes/e738cbf3-f8d2-4566-96d6-d652859904e4 => generated 109 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:41:10.855962 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-2b3bfb57-9d63-4a36-9cd0-c3ee54977b0a req-ec87fd80-54fa-4cf0-b333-7d54465b0aef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "003c8652-2a85-4abc-8f02-ff46b4afcfd1", "tag": "006cf94f-9d7e-4841-85fe-ed1dfa04276d"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:41:10.887670 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-2b3bfb57-9d63-4a36-9cd0-c3ee54977b0a req-ec87fd80-54fa-4cf0-b333-7d54465b0aef service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:10.888458 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-2b3bfb57-9d63-4a36-9cd0-c3ee54977b0a req-ec87fd80-54fa-4cf0-b333-7d54465b0aef service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:10.889968 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-2b3bfb57-9d63-4a36-9cd0-c3ee54977b0a req-ec87fd80-54fa-4cf0-b333-7d54465b0aef service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:10.911821 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-2b3bfb57-9d63-4a36-9cd0-c3ee54977b0a req-ec87fd80-54fa-4cf0-b333-7d54465b0aef service nova] Creating event network-changed:006cf94f-9d7e-4841-85fe-ed1dfa04276d for instance 003c8652-2a85-4abc-8f02-ff46b4afcfd1 on n-h1-862769-1 Oct 27 03:41:10.919783 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-2b3bfb57-9d63-4a36-9cd0-c3ee54977b0a req-ec87fd80-54fa-4cf0-b333-7d54465b0aef service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068829 Oct 27 03:41:10.923084 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2551/4804] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:41:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:41:11.185112 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-cad3cc66-bd0d-4bbc-98cc-26ac9b72a469 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:11.190759 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-cad3cc66-bd0d-4bbc-98cc-26ac9b72a469 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: ac9da5d0-c534-4955-b148-f401c9308618] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:11.245189 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cad3cc66-bd0d-4bbc-98cc-26ac9b72a469 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:11.255023 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cad3cc66-bd0d-4bbc-98cc-26ac9b72a469 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:11.256585 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cad3cc66-bd0d-4bbc-98cc-26ac9b72a469 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:11.261194 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cad3cc66-bd0d-4bbc-98cc-26ac9b72a469 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:11.265178 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cad3cc66-bd0d-4bbc-98cc-26ac9b72a469 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:11.265940 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cad3cc66-bd0d-4bbc-98cc-26ac9b72a469 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:11.501514 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3cd6b620-7272-4fa8-aa31-b5df0532c9b1 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:11.502276 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3cd6b620-7272-4fa8-aa31-b5df0532c9b1 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:11.525618 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3cd6b620-7272-4fa8-aa31-b5df0532c9b1 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:11.525618 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3cd6b620-7272-4fa8-aa31-b5df0532c9b1 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:11.525618 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3cd6b620-7272-4fa8-aa31-b5df0532c9b1 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:11.531981 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3cd6b620-7272-4fa8-aa31-b5df0532c9b1 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:11.535864 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3cd6b620-7272-4fa8-aa31-b5df0532c9b1 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:11.538000 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3cd6b620-7272-4fa8-aa31-b5df0532c9b1 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:12.069117 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3cd6b620-7272-4fa8-aa31-b5df0532c9b1 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:12.104500 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3cd6b620-7272-4fa8-aa31-b5df0532c9b1 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:12.108630 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3cd6b620-7272-4fa8-aa31-b5df0532c9b1 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:12.116801 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3cd6b620-7272-4fa8-aa31-b5df0532c9b1 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79" status: 200 len: 1739 microversion: 2.20 time: 0.619459 Oct 27 03:41:12.125765 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2552/4805] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:41:11 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 => generated 1739 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:41:12.139724 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3efd7e3b-9cbe-4bda-9fda-2db123abc9cf tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:12.142809 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3efd7e3b-9cbe-4bda-9fda-2db123abc9cf tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] [instance: 993b1281-2151-4081-80f9-0b14f4838a9b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:12.160309 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3efd7e3b-9cbe-4bda-9fda-2db123abc9cf tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:12.176885 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3efd7e3b-9cbe-4bda-9fda-2db123abc9cf tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:12.180322 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3efd7e3b-9cbe-4bda-9fda-2db123abc9cf tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:12.183388 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3efd7e3b-9cbe-4bda-9fda-2db123abc9cf tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:12.187687 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3efd7e3b-9cbe-4bda-9fda-2db123abc9cf tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:12.188498 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3efd7e3b-9cbe-4bda-9fda-2db123abc9cf tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:12.388987 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3efd7e3b-9cbe-4bda-9fda-2db123abc9cf tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc4279c64ba4b52aefd967ce73f9530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f139e1ec9338495c94d9df2cc3652247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:12.403044 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3efd7e3b-9cbe-4bda-9fda-2db123abc9cf tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc4279c64ba4b52aefd967ce73f9530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f139e1ec9338495c94d9df2cc3652247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:12.408801 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3efd7e3b-9cbe-4bda-9fda-2db123abc9cf tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc4279c64ba4b52aefd967ce73f9530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f139e1ec9338495c94d9df2cc3652247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:12.412580 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-cad3cc66-bd0d-4bbc-98cc-26ac9b72a469 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:12.413063 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3efd7e3b-9cbe-4bda-9fda-2db123abc9cf tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] 10.222.0.20 "GET /compute/v2.1/servers/993b1281-2151-4081-80f9-0b14f4838a9b" status: 200 len: 1350 microversion: 2.47 time: 0.284330 Oct 27 03:41:12.416910 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2553/4806] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:41:12 2022] GET /compute/v2.1/servers/993b1281-2151-4081-80f9-0b14f4838a9b => generated 1350 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:41:12.441097 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-83331f60-ff68-4621-9664-3d1076ff7440 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:12.444282 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-83331f60-ff68-4621-9664-3d1076ff7440 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] [instance: 7e73d534-0a40-42d2-813c-2e9dbb9239ac] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:12.448088 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-cad3cc66-bd0d-4bbc-98cc-26ac9b72a469 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/ac9da5d0-c534-4955-b148-f401c9308618" status: 200 len: 1315 microversion: 2.1 time: 1.285701 Oct 27 03:41:12.448664 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2254/4807] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:41:11 2022] GET /compute/v2.1/servers/ac9da5d0-c534-4955-b148-f401c9308618 => generated 1315 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:41:12.485386 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-83331f60-ff68-4621-9664-3d1076ff7440 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:12.487057 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-83331f60-ff68-4621-9664-3d1076ff7440 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:12.490727 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-83331f60-ff68-4621-9664-3d1076ff7440 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:12.494853 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-83331f60-ff68-4621-9664-3d1076ff7440 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:12.495083 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-83331f60-ff68-4621-9664-3d1076ff7440 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:12.495546 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-83331f60-ff68-4621-9664-3d1076ff7440 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:12.570896 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=100 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:41:13.155804 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4440b1a5-1756-4951-a389-3d33184d478d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:13.156713 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4440b1a5-1756-4951-a389-3d33184d478d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:13.177897 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4440b1a5-1756-4951-a389-3d33184d478d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:13.207712 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4440b1a5-1756-4951-a389-3d33184d478d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.035s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:13.208609 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4440b1a5-1756-4951-a389-3d33184d478d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:13.211927 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4440b1a5-1756-4951-a389-3d33184d478d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:13.212996 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4440b1a5-1756-4951-a389-3d33184d478d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:13.223951 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4440b1a5-1756-4951-a389-3d33184d478d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:13.364717 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-83331f60-ff68-4621-9664-3d1076ff7440 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:13.379671 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-83331f60-ff68-4621-9664-3d1076ff7440 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:13.383322 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-83331f60-ff68-4621-9664-3d1076ff7440 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:13.393076 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-83331f60-ff68-4621-9664-3d1076ff7440 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] 10.222.0.20 "GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac" status: 200 len: 2947 microversion: 2.32 time: 0.968632 Oct 27 03:41:13.393076 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2554/4808] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:41:12 2022] GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac => generated 2947 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:41:13.423083 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a54292f1-900a-4495-95e8-f1af8f833d28 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:13.423934 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a54292f1-900a-4495-95e8-f1af8f833d28 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] [instance: 7e73d534-0a40-42d2-813c-2e9dbb9239ac] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:13.434749 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a54292f1-900a-4495-95e8-f1af8f833d28 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:13.435511 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a54292f1-900a-4495-95e8-f1af8f833d28 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:13.436318 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a54292f1-900a-4495-95e8-f1af8f833d28 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:13.438518 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a54292f1-900a-4495-95e8-f1af8f833d28 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:13.442422 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a54292f1-900a-4495-95e8-f1af8f833d28 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:13.443520 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a54292f1-900a-4495-95e8-f1af8f833d28 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:13.652168 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a54292f1-900a-4495-95e8-f1af8f833d28 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] 10.222.0.20 "GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac/os-interface" status: 200 len: 1828 microversion: 2.32 time: 0.228981 Oct 27 03:41:13.659622 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2555/4809] 10.222.0.20 () {60 vars in 1316 bytes} [Thu Oct 27 03:41:13 2022] GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac/os-interface => generated 1828 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:41:13.666331 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a432c893-5384-4d17-9b53-56acda009e88 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:13.667232 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a432c893-5384-4d17-9b53-56acda009e88 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] [instance: 993b1281-2151-4081-80f9-0b14f4838a9b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:13.674670 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a432c893-5384-4d17-9b53-56acda009e88 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:13.676944 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a432c893-5384-4d17-9b53-56acda009e88 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:13.677893 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a432c893-5384-4d17-9b53-56acda009e88 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:13.681635 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a432c893-5384-4d17-9b53-56acda009e88 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:13.682349 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a432c893-5384-4d17-9b53-56acda009e88 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:13.683471 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a432c893-5384-4d17-9b53-56acda009e88 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:13.802163 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a432c893-5384-4d17-9b53-56acda009e88 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc4279c64ba4b52aefd967ce73f9530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f139e1ec9338495c94d9df2cc3652247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:13.813438 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a432c893-5384-4d17-9b53-56acda009e88 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc4279c64ba4b52aefd967ce73f9530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f139e1ec9338495c94d9df2cc3652247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:13.819795 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a432c893-5384-4d17-9b53-56acda009e88 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc4279c64ba4b52aefd967ce73f9530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f139e1ec9338495c94d9df2cc3652247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:13.821671 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a432c893-5384-4d17-9b53-56acda009e88 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] 10.222.0.20 "GET /compute/v2.1/servers/993b1281-2151-4081-80f9-0b14f4838a9b" status: 200 len: 1338 microversion: 2.47 time: 0.159847 Oct 27 03:41:13.842393 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2556/4810] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:41:13 2022] GET /compute/v2.1/servers/993b1281-2151-4081-80f9-0b14f4838a9b => generated 1338 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:41:13.856003 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-10a47c5b-8c1f-4417-89b5-57db8cbbf913 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:13.857201 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-10a47c5b-8c1f-4417-89b5-57db8cbbf913 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: ac9da5d0-c534-4955-b148-f401c9308618] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:13.867968 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-10a47c5b-8c1f-4417-89b5-57db8cbbf913 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:13.868209 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-10a47c5b-8c1f-4417-89b5-57db8cbbf913 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:13.868490 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-10a47c5b-8c1f-4417-89b5-57db8cbbf913 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:13.869215 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-10a47c5b-8c1f-4417-89b5-57db8cbbf913 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:13.869735 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-10a47c5b-8c1f-4417-89b5-57db8cbbf913 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:13.870239 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-10a47c5b-8c1f-4417-89b5-57db8cbbf913 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:13.906002 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4440b1a5-1756-4951-a389-3d33184d478d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:13.936479 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4440b1a5-1756-4951-a389-3d33184d478d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:13.938327 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4440b1a5-1756-4951-a389-3d33184d478d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:13.939755 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4440b1a5-1756-4951-a389-3d33184d478d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79" status: 200 len: 1739 microversion: 2.20 time: 0.791200 Oct 27 03:41:13.940547 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2255/4811] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:41:13 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 => generated 1739 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:41:14.210288 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-10a47c5b-8c1f-4417-89b5-57db8cbbf913 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:14.229566 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-10a47c5b-8c1f-4417-89b5-57db8cbbf913 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/ac9da5d0-c534-4955-b148-f401c9308618" status: 200 len: 1315 microversion: 2.1 time: 0.385628 Oct 27 03:41:14.235475 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2557/4812] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:41:13 2022] GET /compute/v2.1/servers/ac9da5d0-c534-4955-b148-f401c9308618 => generated 1315 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:41:14.856192 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d51c8ecd-6d70-45a7-90ec-842e93f12e2c tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:14.857166 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d51c8ecd-6d70-45a7-90ec-842e93f12e2c tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] [instance: 993b1281-2151-4081-80f9-0b14f4838a9b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:14.890733 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d51c8ecd-6d70-45a7-90ec-842e93f12e2c tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:14.891184 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d51c8ecd-6d70-45a7-90ec-842e93f12e2c tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:14.891655 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d51c8ecd-6d70-45a7-90ec-842e93f12e2c tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:14.902643 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d51c8ecd-6d70-45a7-90ec-842e93f12e2c tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:14.906306 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d51c8ecd-6d70-45a7-90ec-842e93f12e2c tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:14.906787 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d51c8ecd-6d70-45a7-90ec-842e93f12e2c tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:14.969815 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e7bca611-5032-40d8-a162-8af2c0cd007e tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:14.971622 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e7bca611-5032-40d8-a162-8af2c0cd007e tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:14.996911 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e7bca611-5032-40d8-a162-8af2c0cd007e tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:14.996911 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e7bca611-5032-40d8-a162-8af2c0cd007e tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:15.003676 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e7bca611-5032-40d8-a162-8af2c0cd007e tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:15.005034 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e7bca611-5032-40d8-a162-8af2c0cd007e tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:15.010095 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e7bca611-5032-40d8-a162-8af2c0cd007e tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:15.010576 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e7bca611-5032-40d8-a162-8af2c0cd007e tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:15.168880 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d51c8ecd-6d70-45a7-90ec-842e93f12e2c tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc4279c64ba4b52aefd967ce73f9530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f139e1ec9338495c94d9df2cc3652247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:15.183077 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d51c8ecd-6d70-45a7-90ec-842e93f12e2c tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc4279c64ba4b52aefd967ce73f9530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f139e1ec9338495c94d9df2cc3652247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:15.191974 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d51c8ecd-6d70-45a7-90ec-842e93f12e2c tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc4279c64ba4b52aefd967ce73f9530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f139e1ec9338495c94d9df2cc3652247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:15.191974 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d51c8ecd-6d70-45a7-90ec-842e93f12e2c tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] 10.222.0.20 "GET /compute/v2.1/servers/993b1281-2151-4081-80f9-0b14f4838a9b" status: 200 len: 1338 microversion: 2.47 time: 0.338257 Oct 27 03:41:15.196510 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2256/4813] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:41:14 2022] GET /compute/v2.1/servers/993b1281-2151-4081-80f9-0b14f4838a9b => generated 1338 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:41:15.287980 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9ee185ec-1e46-4d81-be4e-6e2c9acf9eed tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:15.295450 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9ee185ec-1e46-4d81-be4e-6e2c9acf9eed tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: ac9da5d0-c534-4955-b148-f401c9308618] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:15.301141 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9ee185ec-1e46-4d81-be4e-6e2c9acf9eed tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:15.301871 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9ee185ec-1e46-4d81-be4e-6e2c9acf9eed tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:15.305566 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9ee185ec-1e46-4d81-be4e-6e2c9acf9eed tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:15.306517 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9ee185ec-1e46-4d81-be4e-6e2c9acf9eed tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:15.309864 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9ee185ec-1e46-4d81-be4e-6e2c9acf9eed tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:15.310760 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9ee185ec-1e46-4d81-be4e-6e2c9acf9eed tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:15.628465 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9ee185ec-1e46-4d81-be4e-6e2c9acf9eed tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:15.640881 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9ee185ec-1e46-4d81-be4e-6e2c9acf9eed tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/ac9da5d0-c534-4955-b148-f401c9308618" status: 200 len: 1315 microversion: 2.1 time: 0.357302 Oct 27 03:41:15.650632 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2257/4814] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:41:15 2022] GET /compute/v2.1/servers/ac9da5d0-c534-4955-b148-f401c9308618 => generated 1315 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:41:15.863903 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e7bca611-5032-40d8-a162-8af2c0cd007e tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:15.877810 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e7bca611-5032-40d8-a162-8af2c0cd007e tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:15.883877 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e7bca611-5032-40d8-a162-8af2c0cd007e tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:15.885114 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e7bca611-5032-40d8-a162-8af2c0cd007e tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79" status: 200 len: 1739 microversion: 2.20 time: 0.920830 Oct 27 03:41:15.886566 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2558/4815] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:41:14 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 => generated 1739 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:41:16.220854 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f4bd0307-afe4-4502-b6e3-1071d6e2ddc4 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:16.221475 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f4bd0307-afe4-4502-b6e3-1071d6e2ddc4 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] [instance: 993b1281-2151-4081-80f9-0b14f4838a9b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:16.234583 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f4bd0307-afe4-4502-b6e3-1071d6e2ddc4 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:16.235360 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f4bd0307-afe4-4502-b6e3-1071d6e2ddc4 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:16.235968 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f4bd0307-afe4-4502-b6e3-1071d6e2ddc4 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:16.237235 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f4bd0307-afe4-4502-b6e3-1071d6e2ddc4 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:16.241515 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f4bd0307-afe4-4502-b6e3-1071d6e2ddc4 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:16.241515 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f4bd0307-afe4-4502-b6e3-1071d6e2ddc4 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:16.477164 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f4bd0307-afe4-4502-b6e3-1071d6e2ddc4 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc4279c64ba4b52aefd967ce73f9530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f139e1ec9338495c94d9df2cc3652247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:16.494855 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f4bd0307-afe4-4502-b6e3-1071d6e2ddc4 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc4279c64ba4b52aefd967ce73f9530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f139e1ec9338495c94d9df2cc3652247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:16.496984 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f4bd0307-afe4-4502-b6e3-1071d6e2ddc4 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc4279c64ba4b52aefd967ce73f9530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f139e1ec9338495c94d9df2cc3652247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:16.498657 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f4bd0307-afe4-4502-b6e3-1071d6e2ddc4 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] 10.222.0.20 "GET /compute/v2.1/servers/993b1281-2151-4081-80f9-0b14f4838a9b" status: 200 len: 1359 microversion: 2.47 time: 0.281514 Oct 27 03:41:16.499795 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2258/4816] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:41:16 2022] GET /compute/v2.1/servers/993b1281-2151-4081-80f9-0b14f4838a9b => generated 1359 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:41:16.532681 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-abeb609c-4d1e-4a36-8acf-18cee342e7ed tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-517561122"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:41:16.535711 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-abeb609c-4d1e-4a36-8acf-18cee342e7ed tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] [instance: 993b1281-2151-4081-80f9-0b14f4838a9b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:16.547794 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-abeb609c-4d1e-4a36-8acf-18cee342e7ed tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:16.555881 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-abeb609c-4d1e-4a36-8acf-18cee342e7ed tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:16.555881 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-abeb609c-4d1e-4a36-8acf-18cee342e7ed tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:16.555881 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-abeb609c-4d1e-4a36-8acf-18cee342e7ed tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:16.555881 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-abeb609c-4d1e-4a36-8acf-18cee342e7ed tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:16.555881 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-abeb609c-4d1e-4a36-8acf-18cee342e7ed tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:16.556609 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-23b6d16e-023c-4ae7-b05a-0a926b719261 req-d681a646-8a79-4688-8918-144493b1ddf6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac9da5d0-c534-4955-b148-f401c9308618", "tag": "d3a712e1-7d9c-409f-a8fb-730e54622d49"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:41:16.571835 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:41:16.574665 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-23b6d16e-023c-4ae7-b05a-0a926b719261 req-d681a646-8a79-4688-8918-144493b1ddf6 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:16.575361 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-23b6d16e-023c-4ae7-b05a-0a926b719261 req-d681a646-8a79-4688-8918-144493b1ddf6 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:16.575970 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-23b6d16e-023c-4ae7-b05a-0a926b719261 req-d681a646-8a79-4688-8918-144493b1ddf6 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:16.589695 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-23b6d16e-023c-4ae7-b05a-0a926b719261 req-d681a646-8a79-4688-8918-144493b1ddf6 service nova] Creating event network-changed:d3a712e1-7d9c-409f-a8fb-730e54622d49 for instance ac9da5d0-c534-4955-b148-f401c9308618 on n-h2-862769-1 Oct 27 03:41:16.596386 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-23b6d16e-023c-4ae7-b05a-0a926b719261 req-d681a646-8a79-4688-8918-144493b1ddf6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048166 Oct 27 03:41:16.597242 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2259/4817] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:41:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:41:16.677147 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5bb96eb2-8321-4888-b6dc-8d6240ff521f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:16.678512 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5bb96eb2-8321-4888-b6dc-8d6240ff521f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: ac9da5d0-c534-4955-b148-f401c9308618] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:16.688099 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5bb96eb2-8321-4888-b6dc-8d6240ff521f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:16.688593 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5bb96eb2-8321-4888-b6dc-8d6240ff521f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:16.689033 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5bb96eb2-8321-4888-b6dc-8d6240ff521f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:16.694537 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5bb96eb2-8321-4888-b6dc-8d6240ff521f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:16.695603 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5bb96eb2-8321-4888-b6dc-8d6240ff521f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:16.698624 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5bb96eb2-8321-4888-b6dc-8d6240ff521f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:17.019709 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5bb96eb2-8321-4888-b6dc-8d6240ff521f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:17.026805 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5bb96eb2-8321-4888-b6dc-8d6240ff521f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/ac9da5d0-c534-4955-b148-f401c9308618" status: 200 len: 1315 microversion: 2.1 time: 0.355690 Oct 27 03:41:17.028000 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2260/4818] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:41:16 2022] GET /compute/v2.1/servers/ac9da5d0-c534-4955-b148-f401c9308618 => generated 1315 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:41:17.040290 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1bac8a0f-3d93-4db1-9667-892a51ca1fe5 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:17.043473 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1bac8a0f-3d93-4db1-9667-892a51ca1fe5 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:17.049401 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:41:17.077791 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1bac8a0f-3d93-4db1-9667-892a51ca1fe5 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:17.078351 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1bac8a0f-3d93-4db1-9667-892a51ca1fe5 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:17.078802 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1bac8a0f-3d93-4db1-9667-892a51ca1fe5 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:17.079532 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1bac8a0f-3d93-4db1-9667-892a51ca1fe5 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:17.080005 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1bac8a0f-3d93-4db1-9667-892a51ca1fe5 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:17.080416 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1bac8a0f-3d93-4db1-9667-892a51ca1fe5 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:17.091848 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=10 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:41:17.325759 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-abeb609c-4d1e-4a36-8acf-18cee342e7ed tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] 10.222.0.20 "POST /compute/v2.1/servers/993b1281-2151-4081-80f9-0b14f4838a9b/action" status: 202 len: 52 microversion: 2.47 time: 0.796964 Oct 27 03:41:17.326919 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2559/4819] 10.222.0.20 () {62 vars in 1319 bytes} [Thu Oct 27 03:41:16 2022] POST /compute/v2.1/servers/993b1281-2151-4081-80f9-0b14f4838a9b/action => generated 52 bytes in 799 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Oct 27 03:41:17.343200 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-710be116-1d93-4537-8830-2af2756fafb6 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:17.353380 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-710be116-1d93-4537-8830-2af2756fafb6 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] [instance: 993b1281-2151-4081-80f9-0b14f4838a9b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:17.353380 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-710be116-1d93-4537-8830-2af2756fafb6 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:17.353380 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-710be116-1d93-4537-8830-2af2756fafb6 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:17.353380 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-710be116-1d93-4537-8830-2af2756fafb6 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:17.354979 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-710be116-1d93-4537-8830-2af2756fafb6 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:17.355703 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-710be116-1d93-4537-8830-2af2756fafb6 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:17.356983 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-710be116-1d93-4537-8830-2af2756fafb6 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:17.392080 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-710be116-1d93-4537-8830-2af2756fafb6 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] [instance: 993b1281-2151-4081-80f9-0b14f4838a9b] Going to try to terminate instance {{(pid=121001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:41:17.424822 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1bac8a0f-3d93-4db1-9667-892a51ca1fe5 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:17.435045 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1bac8a0f-3d93-4db1-9667-892a51ca1fe5 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:17.449186 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1bac8a0f-3d93-4db1-9667-892a51ca1fe5 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:17.450539 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1bac8a0f-3d93-4db1-9667-892a51ca1fe5 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79" status: 200 len: 1739 microversion: 2.20 time: 0.421363 Oct 27 03:41:17.470109 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2261/4820] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:41:17 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 => generated 1739 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:41:17.819964 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-710be116-1d93-4537-8830-2af2756fafb6 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] 10.222.0.20 "DELETE /compute/v2.1/servers/993b1281-2151-4081-80f9-0b14f4838a9b" status: 204 len: 0 microversion: 2.47 time: 0.481332 Oct 27 03:41:17.823970 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2560/4821] 10.222.0.20 () {60 vars in 1280 bytes} [Thu Oct 27 03:41:17 2022] DELETE /compute/v2.1/servers/993b1281-2151-4081-80f9-0b14f4838a9b => generated 0 bytes in 483 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 27 03:41:17.829466 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ef1e69e7-c4e7-4f80-858e-b64fdbcb88b3 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:17.829941 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ef1e69e7-c4e7-4f80-858e-b64fdbcb88b3 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] [instance: 993b1281-2151-4081-80f9-0b14f4838a9b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:17.836661 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ef1e69e7-c4e7-4f80-858e-b64fdbcb88b3 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:17.837681 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ef1e69e7-c4e7-4f80-858e-b64fdbcb88b3 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:17.837769 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ef1e69e7-c4e7-4f80-858e-b64fdbcb88b3 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:17.838494 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ef1e69e7-c4e7-4f80-858e-b64fdbcb88b3 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:17.838950 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ef1e69e7-c4e7-4f80-858e-b64fdbcb88b3 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:17.839370 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ef1e69e7-c4e7-4f80-858e-b64fdbcb88b3 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:17.905429 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ef1e69e7-c4e7-4f80-858e-b64fdbcb88b3 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc4279c64ba4b52aefd967ce73f9530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f139e1ec9338495c94d9df2cc3652247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:17.913871 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ef1e69e7-c4e7-4f80-858e-b64fdbcb88b3 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc4279c64ba4b52aefd967ce73f9530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f139e1ec9338495c94d9df2cc3652247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:17.915881 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ef1e69e7-c4e7-4f80-858e-b64fdbcb88b3 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc4279c64ba4b52aefd967ce73f9530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f139e1ec9338495c94d9df2cc3652247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:17.917051 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ef1e69e7-c4e7-4f80-858e-b64fdbcb88b3 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] 10.222.0.20 "GET /compute/v2.1/servers/993b1281-2151-4081-80f9-0b14f4838a9b" status: 200 len: 1365 microversion: 2.47 time: 0.092005 Oct 27 03:41:17.917620 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2262/4822] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:41:17 2022] GET /compute/v2.1/servers/993b1281-2151-4081-80f9-0b14f4838a9b => generated 1365 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:41:18.052279 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b618dc60-14b1-4c71-8087-86dbeb9b5dfd tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:18.053297 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b618dc60-14b1-4c71-8087-86dbeb9b5dfd tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: ac9da5d0-c534-4955-b148-f401c9308618] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:18.068702 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b618dc60-14b1-4c71-8087-86dbeb9b5dfd tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:18.069419 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b618dc60-14b1-4c71-8087-86dbeb9b5dfd tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:18.073298 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b618dc60-14b1-4c71-8087-86dbeb9b5dfd tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:18.073298 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b618dc60-14b1-4c71-8087-86dbeb9b5dfd tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:18.073298 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b618dc60-14b1-4c71-8087-86dbeb9b5dfd tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:18.073298 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b618dc60-14b1-4c71-8087-86dbeb9b5dfd tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:18.221787 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b618dc60-14b1-4c71-8087-86dbeb9b5dfd tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:18.231590 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b618dc60-14b1-4c71-8087-86dbeb9b5dfd tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/ac9da5d0-c534-4955-b148-f401c9308618" status: 200 len: 1315 microversion: 2.1 time: 0.183479 Oct 27 03:41:18.232192 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2561/4823] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:41:18 2022] GET /compute/v2.1/servers/ac9da5d0-c534-4955-b148-f401c9308618 => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:41:18.477976 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-83f5e225-39fc-40d8-a0fe-59b648990dd9 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:18.481240 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-83f5e225-39fc-40d8-a0fe-59b648990dd9 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:18.485900 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-83f5e225-39fc-40d8-a0fe-59b648990dd9 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:18.486429 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-83f5e225-39fc-40d8-a0fe-59b648990dd9 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:18.486900 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-83f5e225-39fc-40d8-a0fe-59b648990dd9 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:18.487639 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-83f5e225-39fc-40d8-a0fe-59b648990dd9 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:18.488221 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-83f5e225-39fc-40d8-a0fe-59b648990dd9 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:18.488659 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-83f5e225-39fc-40d8-a0fe-59b648990dd9 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:18.744773 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e60d9b01-11fd-4cd9-9787-d03fd21e5ace tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:18.745754 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e60d9b01-11fd-4cd9-9787-d03fd21e5ace tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] [instance: 8c8a2cbb-4acf-4a6b-b684-567617bb930d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:18.753522 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-83f5e225-39fc-40d8-a0fe-59b648990dd9 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:18.754781 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e60d9b01-11fd-4cd9-9787-d03fd21e5ace tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:18.755489 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e60d9b01-11fd-4cd9-9787-d03fd21e5ace tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:18.756336 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e60d9b01-11fd-4cd9-9787-d03fd21e5ace tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:18.757284 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e60d9b01-11fd-4cd9-9787-d03fd21e5ace tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:18.758563 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e60d9b01-11fd-4cd9-9787-d03fd21e5ace tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:18.759213 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e60d9b01-11fd-4cd9-9787-d03fd21e5ace tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:18.763896 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-83f5e225-39fc-40d8-a0fe-59b648990dd9 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:18.765901 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-83f5e225-39fc-40d8-a0fe-59b648990dd9 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:18.767639 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-83f5e225-39fc-40d8-a0fe-59b648990dd9 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79" status: 200 len: 1721 microversion: 2.20 time: 0.293776 Oct 27 03:41:18.768578 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2263/4824] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:41:18 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 => generated 1721 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:41:18.784366 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-e60d9b01-11fd-4cd9-9787-d03fd21e5ace tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] HTTP exception thrown: Instance 8c8a2cbb-4acf-4a6b-b684-567617bb930d could not be found. Oct 27 03:41:18.793085 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e60d9b01-11fd-4cd9-9787-d03fd21e5ace tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Request method failure captured: Oct 27 03:41:18.793085 n-d-862769-1 devstack@n-api.service[121001]: request: DELETE /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d HTTP/1.1 Oct 27 03:41:18.793085 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:41:18.793085 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:41:18.793085 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:41:18.793085 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:41:18.793085 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:41:18.793085 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:41:18.793085 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:41:18.793085 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:41:18.793085 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfvwB3lGLd4DkzMcu7xOE1iUX01_uWUEjXXpWvOm4czSAe90DY6BHH-THIkABflsY3JgVK75QX5KsFftByEDgIegxv8tHwyuN5cFITjwygkdcMnxKq-KMBdRYtvneTxKxK6-oftDeAN9-TSTJH4Q_0b1nCqCzYIpLqbes3DDaks_L-g Oct 27 03:41:18.793085 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:41:18.793085 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:41:18.793085 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:41:18.793085 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:41:18.793085 n-d-862769-1 devstack@n-api.service[121001]: X-Openstack-Nova-Api-Version: 2.42 Oct 27 03:41:18.793085 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:41:18.793085 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:41:18.793085 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 296abb4b5dde441da95f4d09089f348e Oct 27 03:41:18.793085 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-790237949 Oct 27 03:41:18.793085 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:41:18.793085 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:41:18.793085 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/296abb4b5dde441da95f4d09089f348e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/296abb4b5dde441da95f4d09089f348e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/296abb4b5dde441da95f4d09089f348e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_296abb4b5dde441da95f4d09089f348e"}]}] Oct 27 03:41:18.793085 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-TaggedBootDevicesTest_v242-790237949 Oct 27 03:41:18.793085 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 296abb4b5dde441da95f4d09089f348e Oct 27 03:41:18.793085 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-790237949 Oct 27 03:41:18.793085 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-TaggedBootDevicesTest_v242-790237949-project Oct 27 03:41:18.793085 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:41:18.793085 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:41:18.793085 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 0d9053ce63864308b29190f9f51bd85f Oct 27 03:41:18.793085 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-TaggedBootDevicesTest_v242-790237949-project Oct 27 03:41:18.793085 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:41:18.793085 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 8c8a2cbb-4acf-4a6b-b684-567617bb930d could not be found. Oct 27 03:41:18.793085 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '8c8a2cbb-4acf-4a6b-b684-567617bb930d'} Oct 27 03:41:18.793085 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:41:18.793085 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:41:18.793085 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:41:18.793085 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:41:18.793085 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:41:18.793085 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:41:18.793085 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:41:18.793085 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:41:18.793085 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:41:18.793085 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:41:18.793085 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c8a2cbb-4acf-4a6b-b684-567617bb930d could not be found. Oct 27 03:41:18.793085 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:41:18.793085 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:41:18.793085 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:41:18.793085 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:41:18.793085 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:41:18.793085 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:41:18.793085 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:41:18.793085 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:41:18.793085 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:41:18.793085 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:41:18.793085 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 03:41:18.793085 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 03:41:18.793085 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 03:41:18.793085 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 03:41:18.793085 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:41:18.793085 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:41:18.793085 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:41:18.793085 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:41:18.797287 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c8a2cbb-4acf-4a6b-b684-567617bb930d could not be found. Oct 27 03:41:18.797287 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:41:18.797287 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:41:18.797287 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:41:18.797287 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:41:18.797287 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:41:18.797287 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:41:18.797287 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:41:18.797287 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:41:18.797287 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c8a2cbb-4acf-4a6b-b684-567617bb930d could not be found. Oct 27 03:41:18.797287 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:41:18.797287 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e60d9b01-11fd-4cd9-9787-d03fd21e5ace tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Returning 404 to user: Instance 8c8a2cbb-4acf-4a6b-b684-567617bb930d could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:41:18.797287 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e60d9b01-11fd-4cd9-9787-d03fd21e5ace tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d" status: 404 len: 111 microversion: 2.42 time: 0.048739 Oct 27 03:41:18.797287 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2562/4825] 10.222.0.20 () {60 vars in 1280 bytes} [Thu Oct 27 03:41:18 2022] DELETE /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 27 03:41:18.803560 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9852028e-5c05-4e2f-b0be-19dc2b857aa7 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:18.804376 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9852028e-5c05-4e2f-b0be-19dc2b857aa7 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] [instance: 8c8a2cbb-4acf-4a6b-b684-567617bb930d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:18.810906 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9852028e-5c05-4e2f-b0be-19dc2b857aa7 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:18.811612 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9852028e-5c05-4e2f-b0be-19dc2b857aa7 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:18.812059 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9852028e-5c05-4e2f-b0be-19dc2b857aa7 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:18.812768 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9852028e-5c05-4e2f-b0be-19dc2b857aa7 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:18.813388 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9852028e-5c05-4e2f-b0be-19dc2b857aa7 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:18.813976 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9852028e-5c05-4e2f-b0be-19dc2b857aa7 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:18.829480 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-9852028e-5c05-4e2f-b0be-19dc2b857aa7 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] HTTP exception thrown: Instance 8c8a2cbb-4acf-4a6b-b684-567617bb930d could not be found. Oct 27 03:41:18.831506 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9852028e-5c05-4e2f-b0be-19dc2b857aa7 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Request method failure captured: Oct 27 03:41:18.831506 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d HTTP/1.1 Oct 27 03:41:18.831506 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:41:18.831506 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:41:18.831506 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:41:18.831506 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:41:18.831506 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:41:18.831506 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:41:18.831506 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:41:18.831506 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:41:18.831506 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfvwB3lGLd4DkzMcu7xOE1iUX01_uWUEjXXpWvOm4czSAe90DY6BHH-THIkABflsY3JgVK75QX5KsFftByEDgIegxv8tHwyuN5cFITjwygkdcMnxKq-KMBdRYtvneTxKxK6-oftDeAN9-TSTJH4Q_0b1nCqCzYIpLqbes3DDaks_L-g Oct 27 03:41:18.831506 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:41:18.831506 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:41:18.831506 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:41:18.831506 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:41:18.831506 n-d-862769-1 devstack@n-api.service[121000]: X-Openstack-Nova-Api-Version: 2.42 Oct 27 03:41:18.831506 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:41:18.831506 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:41:18.831506 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 296abb4b5dde441da95f4d09089f348e Oct 27 03:41:18.831506 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-790237949 Oct 27 03:41:18.831506 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:41:18.831506 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:41:18.831506 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/296abb4b5dde441da95f4d09089f348e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/296abb4b5dde441da95f4d09089f348e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/296abb4b5dde441da95f4d09089f348e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_296abb4b5dde441da95f4d09089f348e"}]}] Oct 27 03:41:18.831506 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-TaggedBootDevicesTest_v242-790237949 Oct 27 03:41:18.831506 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 296abb4b5dde441da95f4d09089f348e Oct 27 03:41:18.831506 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-790237949 Oct 27 03:41:18.831506 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-TaggedBootDevicesTest_v242-790237949-project Oct 27 03:41:18.831506 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:41:18.831506 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:41:18.831506 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 0d9053ce63864308b29190f9f51bd85f Oct 27 03:41:18.831506 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-TaggedBootDevicesTest_v242-790237949-project Oct 27 03:41:18.831506 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:41:18.831506 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 8c8a2cbb-4acf-4a6b-b684-567617bb930d could not be found. Oct 27 03:41:18.831506 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '8c8a2cbb-4acf-4a6b-b684-567617bb930d'} Oct 27 03:41:18.831506 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:41:18.831506 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:41:18.831506 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:41:18.831506 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:41:18.831506 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:41:18.831506 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:41:18.831506 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:41:18.831506 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:41:18.831506 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:41:18.831506 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:41:18.831506 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c8a2cbb-4acf-4a6b-b684-567617bb930d could not be found. Oct 27 03:41:18.831506 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:41:18.831506 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:41:18.831506 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:41:18.831506 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:41:18.831506 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:41:18.831506 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:41:18.831506 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:41:18.831506 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:41:18.831506 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:41:18.831506 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:41:18.831506 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:41:18.831506 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:41:18.831506 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:41:18.831506 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:41:18.831506 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:41:18.831506 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:41:18.831506 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c8a2cbb-4acf-4a6b-b684-567617bb930d could not be found. Oct 27 03:41:18.831506 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:41:18.831506 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:41:18.835678 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:41:18.835678 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:41:18.835678 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:41:18.835678 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:41:18.835678 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:41:18.835678 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:41:18.835678 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c8a2cbb-4acf-4a6b-b684-567617bb930d could not be found. Oct 27 03:41:18.835678 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:41:18.835678 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9852028e-5c05-4e2f-b0be-19dc2b857aa7 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] Returning 404 to user: Instance 8c8a2cbb-4acf-4a6b-b684-567617bb930d could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:41:18.835678 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9852028e-5c05-4e2f-b0be-19dc2b857aa7 tempest-TaggedBootDevicesTest_v242-790237949 tempest-TaggedBootDevicesTest_v242-790237949-project] 10.222.0.20 "GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d" status: 404 len: 111 microversion: 2.42 time: 0.033377 Oct 27 03:41:18.835678 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2264/4826] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:41:18 2022] GET /compute/v2.1/servers/8c8a2cbb-4acf-4a6b-b684-567617bb930d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 03:41:18.946753 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4768ae26-f869-4e43-93da-a32b96d3ab09 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:18.947372 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4768ae26-f869-4e43-93da-a32b96d3ab09 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] [instance: 993b1281-2151-4081-80f9-0b14f4838a9b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:18.953553 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4768ae26-f869-4e43-93da-a32b96d3ab09 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:18.954157 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4768ae26-f869-4e43-93da-a32b96d3ab09 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:18.954611 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4768ae26-f869-4e43-93da-a32b96d3ab09 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:18.955319 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4768ae26-f869-4e43-93da-a32b96d3ab09 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:18.955783 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4768ae26-f869-4e43-93da-a32b96d3ab09 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:18.956219 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4768ae26-f869-4e43-93da-a32b96d3ab09 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:19.042580 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4768ae26-f869-4e43-93da-a32b96d3ab09 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc4279c64ba4b52aefd967ce73f9530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f139e1ec9338495c94d9df2cc3652247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:19.052817 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4768ae26-f869-4e43-93da-a32b96d3ab09 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc4279c64ba4b52aefd967ce73f9530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f139e1ec9338495c94d9df2cc3652247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:19.054889 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4768ae26-f869-4e43-93da-a32b96d3ab09 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc4279c64ba4b52aefd967ce73f9530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f139e1ec9338495c94d9df2cc3652247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:19.056710 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4768ae26-f869-4e43-93da-a32b96d3ab09 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] 10.222.0.20 "GET /compute/v2.1/servers/993b1281-2151-4081-80f9-0b14f4838a9b" status: 200 len: 1365 microversion: 2.47 time: 0.114547 Oct 27 03:41:19.057596 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2563/4827] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:41:18 2022] GET /compute/v2.1/servers/993b1281-2151-4081-80f9-0b14f4838a9b => generated 1365 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:41:19.108061 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-37a9321a-7e8b-4996-ab35-764fb3f1dc70 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:19.110547 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-37a9321a-7e8b-4996-ab35-764fb3f1dc70 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:19.118460 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-37a9321a-7e8b-4996-ab35-764fb3f1dc70 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:19.118967 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-37a9321a-7e8b-4996-ab35-764fb3f1dc70 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:19.125572 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-37a9321a-7e8b-4996-ab35-764fb3f1dc70 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:19.126732 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-37a9321a-7e8b-4996-ab35-764fb3f1dc70 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:19.127228 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-37a9321a-7e8b-4996-ab35-764fb3f1dc70 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:19.127672 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-37a9321a-7e8b-4996-ab35-764fb3f1dc70 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:19.230977 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=100 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:41:19.237837 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=16 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:41:19.239789 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-37a9321a-7e8b-4996-ab35-764fb3f1dc70 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lazy-loading 'services' on Instance uuid db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:41:19.254942 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ad8cb313-6141-498a-b968-31085cfd64a6 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:19.255725 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ad8cb313-6141-498a-b968-31085cfd64a6 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: ac9da5d0-c534-4955-b148-f401c9308618] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:19.262343 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ad8cb313-6141-498a-b968-31085cfd64a6 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:19.262946 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ad8cb313-6141-498a-b968-31085cfd64a6 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:19.263492 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ad8cb313-6141-498a-b968-31085cfd64a6 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:19.264405 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ad8cb313-6141-498a-b968-31085cfd64a6 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:19.265128 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ad8cb313-6141-498a-b968-31085cfd64a6 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:19.265718 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ad8cb313-6141-498a-b968-31085cfd64a6 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:19.435699 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ad8cb313-6141-498a-b968-31085cfd64a6 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:19.443948 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ad8cb313-6141-498a-b968-31085cfd64a6 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/ac9da5d0-c534-4955-b148-f401c9308618" status: 200 len: 1315 microversion: 2.1 time: 0.192866 Oct 27 03:41:19.445257 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2564/4828] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:41:19 2022] GET /compute/v2.1/servers/ac9da5d0-c534-4955-b148-f401c9308618 => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:41:19.510126 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-37a9321a-7e8b-4996-ab35-764fb3f1dc70 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "DELETE /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b/os-volume_attachments/661a773a-0e0c-46bc-b4a0-c64a5df52378" status: 202 len: 0 microversion: 2.1 time: 0.405732 Oct 27 03:41:19.510730 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2265/4829] 10.222.0.20 () {58 vars in 1416 bytes} [Thu Oct 27 03:41:19 2022] DELETE /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b/os-volume_attachments/661a773a-0e0c-46bc-b4a0-c64a5df52378 => generated 0 bytes in 407 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:41:19.803378 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-bbf89011-0f6e-4bee-b2c0-a2b4e6069342 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:19.803998 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-bbf89011-0f6e-4bee-b2c0-a2b4e6069342 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:19.812654 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bbf89011-0f6e-4bee-b2c0-a2b4e6069342 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:19.813157 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bbf89011-0f6e-4bee-b2c0-a2b4e6069342 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:19.813604 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bbf89011-0f6e-4bee-b2c0-a2b4e6069342 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:19.814345 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bbf89011-0f6e-4bee-b2c0-a2b4e6069342 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:19.814950 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bbf89011-0f6e-4bee-b2c0-a2b4e6069342 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:19.815935 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bbf89011-0f6e-4bee-b2c0-a2b4e6069342 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:19.970732 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-bbf89011-0f6e-4bee-b2c0-a2b4e6069342 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:19.979540 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-bbf89011-0f6e-4bee-b2c0-a2b4e6069342 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:19.981916 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-bbf89011-0f6e-4bee-b2c0-a2b4e6069342 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:19.983710 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-bbf89011-0f6e-4bee-b2c0-a2b4e6069342 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79" status: 200 len: 1721 microversion: 2.20 time: 0.184247 Oct 27 03:41:19.984373 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2565/4830] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:41:19 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 => generated 1721 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:41:20.087320 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b1d6a4df-71ae-4eb6-9e67-e27452277de3 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:20.088384 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b1d6a4df-71ae-4eb6-9e67-e27452277de3 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] [instance: 993b1281-2151-4081-80f9-0b14f4838a9b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:20.096960 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b1d6a4df-71ae-4eb6-9e67-e27452277de3 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:20.097641 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b1d6a4df-71ae-4eb6-9e67-e27452277de3 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:20.098316 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b1d6a4df-71ae-4eb6-9e67-e27452277de3 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:20.099198 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b1d6a4df-71ae-4eb6-9e67-e27452277de3 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:20.100125 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b1d6a4df-71ae-4eb6-9e67-e27452277de3 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:20.100728 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b1d6a4df-71ae-4eb6-9e67-e27452277de3 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:20.184088 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b1d6a4df-71ae-4eb6-9e67-e27452277de3 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc4279c64ba4b52aefd967ce73f9530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f139e1ec9338495c94d9df2cc3652247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:20.194197 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b1d6a4df-71ae-4eb6-9e67-e27452277de3 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc4279c64ba4b52aefd967ce73f9530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f139e1ec9338495c94d9df2cc3652247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:20.197393 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b1d6a4df-71ae-4eb6-9e67-e27452277de3 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc4279c64ba4b52aefd967ce73f9530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f139e1ec9338495c94d9df2cc3652247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:20.199347 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b1d6a4df-71ae-4eb6-9e67-e27452277de3 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] 10.222.0.20 "GET /compute/v2.1/servers/993b1281-2151-4081-80f9-0b14f4838a9b" status: 200 len: 1365 microversion: 2.47 time: 0.117886 Oct 27 03:41:20.199458 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2266/4831] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:41:20 2022] GET /compute/v2.1/servers/993b1281-2151-4081-80f9-0b14f4838a9b => generated 1365 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:41:20.467289 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0edd3e49-e8b8-47dc-aa1d-48fe7380e14d tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:20.468024 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0edd3e49-e8b8-47dc-aa1d-48fe7380e14d tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: ac9da5d0-c534-4955-b148-f401c9308618] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:20.474161 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0edd3e49-e8b8-47dc-aa1d-48fe7380e14d tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:20.474873 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0edd3e49-e8b8-47dc-aa1d-48fe7380e14d tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:20.475485 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0edd3e49-e8b8-47dc-aa1d-48fe7380e14d tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:20.476917 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0edd3e49-e8b8-47dc-aa1d-48fe7380e14d tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:20.477555 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0edd3e49-e8b8-47dc-aa1d-48fe7380e14d tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:20.479628 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0edd3e49-e8b8-47dc-aa1d-48fe7380e14d tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:20.633839 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0edd3e49-e8b8-47dc-aa1d-48fe7380e14d tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:20.649759 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0edd3e49-e8b8-47dc-aa1d-48fe7380e14d tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/ac9da5d0-c534-4955-b148-f401c9308618" status: 200 len: 1315 microversion: 2.1 time: 0.186349 Oct 27 03:41:20.654337 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2566/4832] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:41:20 2022] GET /compute/v2.1/servers/ac9da5d0-c534-4955-b148-f401c9308618 => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:41:20.796204 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-e7ced324-3d78-430a-921e-dcdef062c56f req-2db7b872-836e-466d-859b-2a53db9be1e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6854d7f3-0f6d-45c2-b46d-a5dc2922fe79", "name": "network-vif-unplugged", "status": "completed", "tag": "425e1d50-5b4c-44cd-a54b-de48e280a305"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:41:20.816653 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-e7ced324-3d78-430a-921e-dcdef062c56f req-2db7b872-836e-466d-859b-2a53db9be1e8 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:20.816653 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-e7ced324-3d78-430a-921e-dcdef062c56f req-2db7b872-836e-466d-859b-2a53db9be1e8 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:20.816653 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-e7ced324-3d78-430a-921e-dcdef062c56f req-2db7b872-836e-466d-859b-2a53db9be1e8 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:20.826068 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-e7ced324-3d78-430a-921e-dcdef062c56f req-2db7b872-836e-466d-859b-2a53db9be1e8 service nova] Creating event network-vif-unplugged:425e1d50-5b4c-44cd-a54b-de48e280a305 for instance 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 on n-h1-862769-1 Oct 27 03:41:20.831268 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-e7ced324-3d78-430a-921e-dcdef062c56f req-2db7b872-836e-466d-859b-2a53db9be1e8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044107 Oct 27 03:41:20.831897 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2267/4833] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:41:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:41:21.013646 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-752e3c41-5e2b-4368-8ca3-77230e99737a tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:21.018872 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-752e3c41-5e2b-4368-8ca3-77230e99737a tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:21.033513 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-752e3c41-5e2b-4368-8ca3-77230e99737a tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:21.034488 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-752e3c41-5e2b-4368-8ca3-77230e99737a tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:21.036728 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-752e3c41-5e2b-4368-8ca3-77230e99737a tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:21.038816 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-752e3c41-5e2b-4368-8ca3-77230e99737a tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:21.039514 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-752e3c41-5e2b-4368-8ca3-77230e99737a tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:21.040125 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-752e3c41-5e2b-4368-8ca3-77230e99737a tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:21.208562 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-752e3c41-5e2b-4368-8ca3-77230e99737a tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:21.225468 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-752e3c41-5e2b-4368-8ca3-77230e99737a tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:21.227540 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-752e3c41-5e2b-4368-8ca3-77230e99737a tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:21.229270 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b05cb69c-b0ca-46f8-ad4a-76b6fccaec54 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:21.230468 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b05cb69c-b0ca-46f8-ad4a-76b6fccaec54 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] [instance: 993b1281-2151-4081-80f9-0b14f4838a9b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:21.230744 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-752e3c41-5e2b-4368-8ca3-77230e99737a tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79" status: 200 len: 1721 microversion: 2.20 time: 0.224257 Oct 27 03:41:21.238229 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b05cb69c-b0ca-46f8-ad4a-76b6fccaec54 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:21.239208 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b05cb69c-b0ca-46f8-ad4a-76b6fccaec54 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:21.239859 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b05cb69c-b0ca-46f8-ad4a-76b6fccaec54 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:21.241003 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b05cb69c-b0ca-46f8-ad4a-76b6fccaec54 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:21.241696 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b05cb69c-b0ca-46f8-ad4a-76b6fccaec54 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:21.243168 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b05cb69c-b0ca-46f8-ad4a-76b6fccaec54 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:21.243887 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2567/4834] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:41:21 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 => generated 1721 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:41:21.300301 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b05cb69c-b0ca-46f8-ad4a-76b6fccaec54 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:21.301307 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b05cb69c-b0ca-46f8-ad4a-76b6fccaec54 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:21.302243 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b05cb69c-b0ca-46f8-ad4a-76b6fccaec54 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:21.302922 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-b05cb69c-b0ca-46f8-ad4a-76b6fccaec54 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Lazy-loading 'fault' on Instance uuid 993b1281-2151-4081-80f9-0b14f4838a9b {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:41:21.367762 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b05cb69c-b0ca-46f8-ad4a-76b6fccaec54 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc4279c64ba4b52aefd967ce73f9530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f139e1ec9338495c94d9df2cc3652247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:21.379808 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b05cb69c-b0ca-46f8-ad4a-76b6fccaec54 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc4279c64ba4b52aefd967ce73f9530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f139e1ec9338495c94d9df2cc3652247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:21.381397 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b05cb69c-b0ca-46f8-ad4a-76b6fccaec54 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc4279c64ba4b52aefd967ce73f9530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f139e1ec9338495c94d9df2cc3652247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:21.383232 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b05cb69c-b0ca-46f8-ad4a-76b6fccaec54 tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] 10.222.0.20 "GET /compute/v2.1/servers/993b1281-2151-4081-80f9-0b14f4838a9b" status: 200 len: 1370 microversion: 2.47 time: 0.159375 Oct 27 03:41:21.383880 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2268/4835] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:41:21 2022] GET /compute/v2.1/servers/993b1281-2151-4081-80f9-0b14f4838a9b => generated 1370 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:41:21.677510 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d29e4b20-7fee-4b12-a45d-7695cf3f3848 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:21.678498 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d29e4b20-7fee-4b12-a45d-7695cf3f3848 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: ac9da5d0-c534-4955-b148-f401c9308618] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:21.685645 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d29e4b20-7fee-4b12-a45d-7695cf3f3848 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:21.687230 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d29e4b20-7fee-4b12-a45d-7695cf3f3848 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:21.687904 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d29e4b20-7fee-4b12-a45d-7695cf3f3848 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:21.688822 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d29e4b20-7fee-4b12-a45d-7695cf3f3848 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:21.689480 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d29e4b20-7fee-4b12-a45d-7695cf3f3848 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:21.690305 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d29e4b20-7fee-4b12-a45d-7695cf3f3848 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:21.867784 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d29e4b20-7fee-4b12-a45d-7695cf3f3848 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:21.877910 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d29e4b20-7fee-4b12-a45d-7695cf3f3848 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/ac9da5d0-c534-4955-b148-f401c9308618" status: 200 len: 1315 microversion: 2.1 time: 0.203372 Oct 27 03:41:21.891211 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2568/4836] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:41:21 2022] GET /compute/v2.1/servers/ac9da5d0-c534-4955-b148-f401c9308618 => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:41:22.262840 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a2e8a568-6aa4-4a5c-990e-9741ae41deb0 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:22.268450 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a2e8a568-6aa4-4a5c-990e-9741ae41deb0 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:22.281914 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a2e8a568-6aa4-4a5c-990e-9741ae41deb0 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:22.288317 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a2e8a568-6aa4-4a5c-990e-9741ae41deb0 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:22.289729 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a2e8a568-6aa4-4a5c-990e-9741ae41deb0 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:22.302021 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a2e8a568-6aa4-4a5c-990e-9741ae41deb0 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:22.302021 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a2e8a568-6aa4-4a5c-990e-9741ae41deb0 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:22.302021 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a2e8a568-6aa4-4a5c-990e-9741ae41deb0 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:22.410788 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-bf508dbf-bf4c-4400-b8fa-db6424309f4a tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:22.411432 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-bf508dbf-bf4c-4400-b8fa-db6424309f4a tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] [instance: 993b1281-2151-4081-80f9-0b14f4838a9b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:22.420516 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bf508dbf-bf4c-4400-b8fa-db6424309f4a tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:22.423347 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bf508dbf-bf4c-4400-b8fa-db6424309f4a tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:22.424527 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bf508dbf-bf4c-4400-b8fa-db6424309f4a tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:22.425890 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bf508dbf-bf4c-4400-b8fa-db6424309f4a tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:22.426607 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bf508dbf-bf4c-4400-b8fa-db6424309f4a tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:22.427271 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bf508dbf-bf4c-4400-b8fa-db6424309f4a tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:22.446581 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:41:22.447887 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-bf508dbf-bf4c-4400-b8fa-db6424309f4a tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] HTTP exception thrown: Instance 993b1281-2151-4081-80f9-0b14f4838a9b could not be found. Oct 27 03:41:22.449769 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-bf508dbf-bf4c-4400-b8fa-db6424309f4a tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Request method failure captured: Oct 27 03:41:22.449769 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/993b1281-2151-4081-80f9-0b14f4838a9b HTTP/1.1 Oct 27 03:41:22.449769 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:41:22.449769 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:41:22.449769 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:41:22.449769 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:41:22.449769 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:41:22.449769 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:41:22.449769 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:41:22.449769 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:41:22.449769 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWf3SR1DB_uQrZl1Hyf1aj5D2nffbJZGei2RZA2cDlWa8cOxnklBiLAw-gH9N2egNtyu10t88Tn4oIM2LT7BKsRvwgOwho8Ly3Y2MYVmlw2TF2c-BR_qKTqHctNDNy-9JrPPVx8YJ63PX1gpMX1mTYeML_vPFswGb3khbSjk5990s_tI Oct 27 03:41:22.449769 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:41:22.449769 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:41:22.449769 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:41:22.449769 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:41:22.449769 n-d-862769-1 devstack@n-api.service[121001]: X-Openstack-Nova-Api-Version: 2.47 Oct 27 03:41:22.449769 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:41:22.449769 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:41:22.449769 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: f139e1ec9338495c94d9df2cc3652247 Oct 27 03:41:22.449769 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServersAaction247Test-1401883131 Oct 27 03:41:22.449769 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:41:22.449769 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:41:22.449769 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f139e1ec9338495c94d9df2cc3652247"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f139e1ec9338495c94d9df2cc3652247"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f139e1ec9338495c94d9df2cc3652247"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f139e1ec9338495c94d9df2cc3652247"}]}] Oct 27 03:41:22.449769 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServersAaction247Test-1401883131 Oct 27 03:41:22.449769 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: f139e1ec9338495c94d9df2cc3652247 Oct 27 03:41:22.449769 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServersAaction247Test-1401883131 Oct 27 03:41:22.449769 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServersAaction247Test-1401883131-project Oct 27 03:41:22.449769 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:41:22.449769 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:41:22.449769 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 6bc4279c64ba4b52aefd967ce73f9530 Oct 27 03:41:22.449769 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServersAaction247Test-1401883131-project Oct 27 03:41:22.449769 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:41:22.449769 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 993b1281-2151-4081-80f9-0b14f4838a9b could not be found. Oct 27 03:41:22.449769 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '993b1281-2151-4081-80f9-0b14f4838a9b'} Oct 27 03:41:22.449769 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:41:22.449769 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:41:22.449769 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:41:22.449769 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:41:22.449769 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:41:22.449769 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:41:22.449769 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:41:22.449769 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:41:22.449769 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:41:22.449769 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:41:22.449769 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 993b1281-2151-4081-80f9-0b14f4838a9b could not be found. Oct 27 03:41:22.449769 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:41:22.449769 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:41:22.449769 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:41:22.449769 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:41:22.449769 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:41:22.449769 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:41:22.449769 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:41:22.449769 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:41:22.449769 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:41:22.449769 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:41:22.449769 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:41:22.449769 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:41:22.449769 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:41:22.449769 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:41:22.449769 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:41:22.449769 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:41:22.449769 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 993b1281-2151-4081-80f9-0b14f4838a9b could not be found. Oct 27 03:41:22.449769 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:41:22.449769 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:41:22.454230 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:41:22.454230 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:41:22.454230 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:41:22.454230 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:41:22.454230 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:41:22.454230 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:41:22.454230 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 993b1281-2151-4081-80f9-0b14f4838a9b could not be found. Oct 27 03:41:22.454230 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:41:22.454230 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-bf508dbf-bf4c-4400-b8fa-db6424309f4a tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] Returning 404 to user: Instance 993b1281-2151-4081-80f9-0b14f4838a9b could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:41:22.454230 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-bf508dbf-bf4c-4400-b8fa-db6424309f4a tempest-ServersAaction247Test-1401883131 tempest-ServersAaction247Test-1401883131-project] 10.222.0.20 "GET /compute/v2.1/servers/993b1281-2151-4081-80f9-0b14f4838a9b" status: 404 len: 111 microversion: 2.47 time: 0.045381 Oct 27 03:41:22.454230 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2569/4837] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:41:22 2022] GET /compute/v2.1/servers/993b1281-2151-4081-80f9-0b14f4838a9b => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 27 03:41:22.680540 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a2e8a568-6aa4-4a5c-990e-9741ae41deb0 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:22.689692 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a2e8a568-6aa4-4a5c-990e-9741ae41deb0 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:22.691447 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a2e8a568-6aa4-4a5c-990e-9741ae41deb0 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:22.693188 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a2e8a568-6aa4-4a5c-990e-9741ae41deb0 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79" status: 200 len: 1664 microversion: 2.20 time: 0.436998 Oct 27 03:41:22.714169 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2269/4838] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:41:22 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 => generated 1664 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:41:22.724194 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-125d596c-34fb-448a-af06-cf98f9b73460 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8159df87-767a-4a23-9eb2-58a855f16937"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:41:22.726903 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-125d596c-34fb-448a-af06-cf98f9b73460 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:22.738190 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-125d596c-34fb-448a-af06-cf98f9b73460 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:22.739023 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-125d596c-34fb-448a-af06-cf98f9b73460 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:22.739866 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-125d596c-34fb-448a-af06-cf98f9b73460 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:22.741154 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-125d596c-34fb-448a-af06-cf98f9b73460 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:22.741945 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-125d596c-34fb-448a-af06-cf98f9b73460 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:22.742764 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-125d596c-34fb-448a-af06-cf98f9b73460 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:22.850638 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-6891344b-3dcf-4cc8-a33b-bff94a9f96c9 req-0c9fa5d0-581c-4e75-a820-d44fdff924bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac9da5d0-c534-4955-b148-f401c9308618", "name": "network-vif-plugged", "status": "completed", "tag": "d3a712e1-7d9c-409f-a8fb-730e54622d49"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:41:22.861717 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-6891344b-3dcf-4cc8-a33b-bff94a9f96c9 req-0c9fa5d0-581c-4e75-a820-d44fdff924bb service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:22.861833 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-6891344b-3dcf-4cc8-a33b-bff94a9f96c9 req-0c9fa5d0-581c-4e75-a820-d44fdff924bb service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:22.862214 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-6891344b-3dcf-4cc8-a33b-bff94a9f96c9 req-0c9fa5d0-581c-4e75-a820-d44fdff924bb service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:22.876080 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-6891344b-3dcf-4cc8-a33b-bff94a9f96c9 req-0c9fa5d0-581c-4e75-a820-d44fdff924bb service nova] Creating event network-vif-plugged:d3a712e1-7d9c-409f-a8fb-730e54622d49 for instance ac9da5d0-c534-4955-b148-f401c9308618 on n-h2-862769-1 Oct 27 03:41:22.883211 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-6891344b-3dcf-4cc8-a33b-bff94a9f96c9 req-0c9fa5d0-581c-4e75-a820-d44fdff924bb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035657 Oct 27 03:41:22.884012 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2270/4839] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:41:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:41:22.910594 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-37e1b187-d62a-4a69-b443-cd1faab7761a tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:22.911266 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-37e1b187-d62a-4a69-b443-cd1faab7761a tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: ac9da5d0-c534-4955-b148-f401c9308618] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:22.919428 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-37e1b187-d62a-4a69-b443-cd1faab7761a tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:22.920618 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-37e1b187-d62a-4a69-b443-cd1faab7761a tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:22.921351 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-37e1b187-d62a-4a69-b443-cd1faab7761a tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:22.922289 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-37e1b187-d62a-4a69-b443-cd1faab7761a tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:22.922899 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-37e1b187-d62a-4a69-b443-cd1faab7761a tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:22.924175 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-37e1b187-d62a-4a69-b443-cd1faab7761a tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:23.150744 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-37e1b187-d62a-4a69-b443-cd1faab7761a tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:23.163247 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-37e1b187-d62a-4a69-b443-cd1faab7761a tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/ac9da5d0-c534-4955-b148-f401c9308618" status: 200 len: 1315 microversion: 2.1 time: 0.261515 Oct 27 03:41:23.164729 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2271/4840] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:41:22 2022] GET /compute/v2.1/servers/ac9da5d0-c534-4955-b148-f401c9308618 => generated 1315 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:41:24.189668 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-fd918300-27b6-440b-9669-ba8ed9d0edba tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:24.191473 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-fd918300-27b6-440b-9669-ba8ed9d0edba tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: ac9da5d0-c534-4955-b148-f401c9308618] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:24.205314 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fd918300-27b6-440b-9669-ba8ed9d0edba tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:24.209331 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fd918300-27b6-440b-9669-ba8ed9d0edba tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:24.210081 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fd918300-27b6-440b-9669-ba8ed9d0edba tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:24.211942 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fd918300-27b6-440b-9669-ba8ed9d0edba tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:24.212613 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fd918300-27b6-440b-9669-ba8ed9d0edba tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:24.213058 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fd918300-27b6-440b-9669-ba8ed9d0edba tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:24.246350 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-125d596c-34fb-448a-af06-cf98f9b73460 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "POST /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.526371 Oct 27 03:41:24.248447 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2570/4841] 10.222.0.20 () {62 vars in 1364 bytes} [Thu Oct 27 03:41:22 2022] POST /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79/os-volume_attachments => generated 188 bytes in 1529 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 03:41:24.432373 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f943addf-a2d4-40c8-8185-922eb8730dd3 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:41:24.433425 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f943addf-a2d4-40c8-8185-922eb8730dd3 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:24.454798 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f943addf-a2d4-40c8-8185-922eb8730dd3 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:24.455320 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f943addf-a2d4-40c8-8185-922eb8730dd3 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:24.460675 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f943addf-a2d4-40c8-8185-922eb8730dd3 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:24.460675 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f943addf-a2d4-40c8-8185-922eb8730dd3 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:24.460675 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f943addf-a2d4-40c8-8185-922eb8730dd3 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:24.460675 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f943addf-a2d4-40c8-8185-922eb8730dd3 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:24.499376 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f943addf-a2d4-40c8-8185-922eb8730dd3 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121001) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 27 03:41:24.503269 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-fd918300-27b6-440b-9669-ba8ed9d0edba tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:24.517010 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-fd918300-27b6-440b-9669-ba8ed9d0edba tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/ac9da5d0-c534-4955-b148-f401c9308618" status: 200 len: 1315 microversion: 2.1 time: 0.331850 Oct 27 03:41:24.518566 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2272/4842] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:41:24 2022] GET /compute/v2.1/servers/ac9da5d0-c534-4955-b148-f401c9308618 => generated 1315 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:41:24.831139 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f943addf-a2d4-40c8-8185-922eb8730dd3 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "POST /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79/action" status: 202 len: 0 microversion: 2.20 time: 0.406372 Oct 27 03:41:24.835643 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2571/4843] 10.222.0.20 () {62 vars in 1319 bytes} [Thu Oct 27 03:41:24 2022] POST /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79/action => generated 0 bytes in 412 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:41:24.844809 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-362897ce-1be1-4a55-819b-425052e134b2 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:24.844809 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-362897ce-1be1-4a55-819b-425052e134b2 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:24.850388 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-362897ce-1be1-4a55-819b-425052e134b2 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:24.851172 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-362897ce-1be1-4a55-819b-425052e134b2 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:24.851866 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-362897ce-1be1-4a55-819b-425052e134b2 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:24.853841 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-362897ce-1be1-4a55-819b-425052e134b2 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:24.854633 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-362897ce-1be1-4a55-819b-425052e134b2 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:24.855510 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-362897ce-1be1-4a55-819b-425052e134b2 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:25.028787 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-362897ce-1be1-4a55-819b-425052e134b2 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:25.038648 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-362897ce-1be1-4a55-819b-425052e134b2 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:25.040900 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-362897ce-1be1-4a55-819b-425052e134b2 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:25.042308 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-362897ce-1be1-4a55-819b-425052e134b2 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79" status: 200 len: 1750 microversion: 2.20 time: 0.203898 Oct 27 03:41:25.043132 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2273/4844] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:41:24 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 => generated 1750 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:41:25.544734 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7014050a-2b36-4916-907e-ca45e48ee02e tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:25.545602 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7014050a-2b36-4916-907e-ca45e48ee02e tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: ac9da5d0-c534-4955-b148-f401c9308618] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:25.556369 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7014050a-2b36-4916-907e-ca45e48ee02e tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:25.557218 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7014050a-2b36-4916-907e-ca45e48ee02e tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:25.562385 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7014050a-2b36-4916-907e-ca45e48ee02e tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:25.562385 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7014050a-2b36-4916-907e-ca45e48ee02e tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:25.562385 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7014050a-2b36-4916-907e-ca45e48ee02e tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:25.562385 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7014050a-2b36-4916-907e-ca45e48ee02e tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:25.755623 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7014050a-2b36-4916-907e-ca45e48ee02e tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:25.768802 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7014050a-2b36-4916-907e-ca45e48ee02e tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/ac9da5d0-c534-4955-b148-f401c9308618" status: 200 len: 1502 microversion: 2.1 time: 0.231652 Oct 27 03:41:25.769832 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2572/4845] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:41:25 2022] GET /compute/v2.1/servers/ac9da5d0-c534-4955-b148-f401c9308618 => generated 1502 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:41:25.794241 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-519f534e-90e2-4b1b-9e65-e824fe2adb8b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:41:25.802468 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-519f534e-90e2-4b1b-9e65-e824fe2adb8b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:25.803191 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-519f534e-90e2-4b1b-9e65-e824fe2adb8b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:25.803781 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-519f534e-90e2-4b1b-9e65-e824fe2adb8b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:25.831469 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-519f534e-90e2-4b1b-9e65-e824fe2adb8b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: ac9da5d0-c534-4955-b148-f401c9308618] Going to try to stop instance {{(pid=121000) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 27 03:41:26.026350 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-519f534e-90e2-4b1b-9e65-e824fe2adb8b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "POST /compute/v2.1/servers/ac9da5d0-c534-4955-b148-f401c9308618/action" status: 202 len: 0 microversion: 2.1 time: 0.236068 Oct 27 03:41:26.028519 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2274/4846] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:41:25 2022] POST /compute/v2.1/servers/ac9da5d0-c534-4955-b148-f401c9308618/action => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:41:26.044014 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-442296c0-978f-4ec0-a0df-79f38542bbde tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:26.044614 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-442296c0-978f-4ec0-a0df-79f38542bbde tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: ac9da5d0-c534-4955-b148-f401c9308618] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:26.068927 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f3e7272d-5959-4125-b8d9-7d301039b68b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:26.069648 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f3e7272d-5959-4125-b8d9-7d301039b68b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:26.074563 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-442296c0-978f-4ec0-a0df-79f38542bbde tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:26.075071 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-442296c0-978f-4ec0-a0df-79f38542bbde tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:26.075519 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-442296c0-978f-4ec0-a0df-79f38542bbde tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:26.080718 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-442296c0-978f-4ec0-a0df-79f38542bbde tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:26.081209 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-442296c0-978f-4ec0-a0df-79f38542bbde tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:26.082620 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-442296c0-978f-4ec0-a0df-79f38542bbde tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:26.089866 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f3e7272d-5959-4125-b8d9-7d301039b68b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:26.091399 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f3e7272d-5959-4125-b8d9-7d301039b68b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:26.092867 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f3e7272d-5959-4125-b8d9-7d301039b68b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:26.094716 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f3e7272d-5959-4125-b8d9-7d301039b68b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:26.095180 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f3e7272d-5959-4125-b8d9-7d301039b68b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:26.095967 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f3e7272d-5959-4125-b8d9-7d301039b68b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:26.404334 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-442296c0-978f-4ec0-a0df-79f38542bbde tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:26.415128 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-442296c0-978f-4ec0-a0df-79f38542bbde tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/ac9da5d0-c534-4955-b148-f401c9308618" status: 200 len: 1512 microversion: 2.1 time: 0.374850 Oct 27 03:41:26.423255 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2573/4847] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:41:26 2022] GET /compute/v2.1/servers/ac9da5d0-c534-4955-b148-f401c9308618 => generated 1512 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:41:26.428918 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f3e7272d-5959-4125-b8d9-7d301039b68b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:26.439126 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f3e7272d-5959-4125-b8d9-7d301039b68b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:26.441433 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f3e7272d-5959-4125-b8d9-7d301039b68b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:26.442999 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f3e7272d-5959-4125-b8d9-7d301039b68b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79" status: 200 len: 1750 microversion: 2.20 time: 0.378387 Oct 27 03:41:26.458883 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2275/4848] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:41:26 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 => generated 1750 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:41:27.440081 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0b93e125-37c1-43ce-af42-2ba9aa8c89ee tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:27.440706 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0b93e125-37c1-43ce-af42-2ba9aa8c89ee tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: ac9da5d0-c534-4955-b148-f401c9308618] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:27.450294 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0b93e125-37c1-43ce-af42-2ba9aa8c89ee tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:27.456575 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0b93e125-37c1-43ce-af42-2ba9aa8c89ee tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:27.456575 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0b93e125-37c1-43ce-af42-2ba9aa8c89ee tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:27.456575 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0b93e125-37c1-43ce-af42-2ba9aa8c89ee tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:27.456575 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0b93e125-37c1-43ce-af42-2ba9aa8c89ee tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:27.456575 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0b93e125-37c1-43ce-af42-2ba9aa8c89ee tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:27.482695 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-179641c4-b9e7-47ed-8ce2-fa69de99447c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:27.483934 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-179641c4-b9e7-47ed-8ce2-fa69de99447c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:27.492656 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-179641c4-b9e7-47ed-8ce2-fa69de99447c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:27.493391 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-179641c4-b9e7-47ed-8ce2-fa69de99447c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:27.493986 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-179641c4-b9e7-47ed-8ce2-fa69de99447c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:27.496611 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-179641c4-b9e7-47ed-8ce2-fa69de99447c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:27.496611 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-179641c4-b9e7-47ed-8ce2-fa69de99447c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:27.496611 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-179641c4-b9e7-47ed-8ce2-fa69de99447c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:27.735079 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0b93e125-37c1-43ce-af42-2ba9aa8c89ee tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:27.746847 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0b93e125-37c1-43ce-af42-2ba9aa8c89ee tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/ac9da5d0-c534-4955-b148-f401c9308618" status: 200 len: 1512 microversion: 2.1 time: 0.310552 Oct 27 03:41:27.748384 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2574/4849] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:41:27 2022] GET /compute/v2.1/servers/ac9da5d0-c534-4955-b148-f401c9308618 => generated 1512 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:41:27.761073 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-474f5678-da1a-486a-8424-0b4194553777 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:41:27.766362 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-179641c4-b9e7-47ed-8ce2-fa69de99447c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:27.770007 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-474f5678-da1a-486a-8424-0b4194553777 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:27.772409 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-474f5678-da1a-486a-8424-0b4194553777 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:27.774967 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-474f5678-da1a-486a-8424-0b4194553777 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:27.783087 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-179641c4-b9e7-47ed-8ce2-fa69de99447c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:27.784565 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-179641c4-b9e7-47ed-8ce2-fa69de99447c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:27.786519 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-179641c4-b9e7-47ed-8ce2-fa69de99447c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79" status: 200 len: 1752 microversion: 2.20 time: 0.308221 Oct 27 03:41:27.809110 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2276/4850] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:41:27 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 => generated 1752 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:41:27.828499 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-474f5678-da1a-486a-8424-0b4194553777 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b] Going to try to stop instance {{(pid=121001) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 27 03:41:28.077702 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-474f5678-da1a-486a-8424-0b4194553777 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "POST /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b/action" status: 202 len: 0 microversion: 2.1 time: 0.327859 Oct 27 03:41:28.078858 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2575/4851] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:41:27 2022] POST /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b/action => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:41:28.087267 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7abfe9ba-fee9-4b78-903f-72424f040dbe tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:28.087924 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7abfe9ba-fee9-4b78-903f-72424f040dbe tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:28.107730 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7abfe9ba-fee9-4b78-903f-72424f040dbe tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:28.108230 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7abfe9ba-fee9-4b78-903f-72424f040dbe tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:28.110859 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7abfe9ba-fee9-4b78-903f-72424f040dbe tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:28.111856 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7abfe9ba-fee9-4b78-903f-72424f040dbe tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:28.112473 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7abfe9ba-fee9-4b78-903f-72424f040dbe tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:28.113064 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7abfe9ba-fee9-4b78-903f-72424f040dbe tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:28.440448 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7abfe9ba-fee9-4b78-903f-72424f040dbe tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffc2b1c410149e884a47240b5425e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38450368ef5c4e68ac3c19c7a0a1ce65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:28.452867 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7abfe9ba-fee9-4b78-903f-72424f040dbe tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b" status: 200 len: 1679 microversion: 2.1 time: 0.368783 Oct 27 03:41:28.454231 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2277/4852] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:41:28 2022] GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b => generated 1679 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:41:28.777397 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-602ab1f6-3a40-4811-bf84-db3ab33d675f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:28.778746 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-602ab1f6-3a40-4811-bf84-db3ab33d675f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: ac9da5d0-c534-4955-b148-f401c9308618] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:28.791979 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-602ab1f6-3a40-4811-bf84-db3ab33d675f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:28.795448 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-602ab1f6-3a40-4811-bf84-db3ab33d675f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:28.796260 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-602ab1f6-3a40-4811-bf84-db3ab33d675f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:28.797542 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-602ab1f6-3a40-4811-bf84-db3ab33d675f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:28.798207 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-602ab1f6-3a40-4811-bf84-db3ab33d675f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:28.806883 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-602ab1f6-3a40-4811-bf84-db3ab33d675f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:28.817845 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-87599013-2edc-420c-90b7-1e11694ac047 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:28.819485 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-87599013-2edc-420c-90b7-1e11694ac047 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:28.838970 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-87599013-2edc-420c-90b7-1e11694ac047 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:28.839484 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-87599013-2edc-420c-90b7-1e11694ac047 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:28.839934 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-87599013-2edc-420c-90b7-1e11694ac047 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:28.840668 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-87599013-2edc-420c-90b7-1e11694ac047 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:28.841135 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-87599013-2edc-420c-90b7-1e11694ac047 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:28.841577 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-87599013-2edc-420c-90b7-1e11694ac047 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:29.015106 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-87599013-2edc-420c-90b7-1e11694ac047 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:29.026025 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-87599013-2edc-420c-90b7-1e11694ac047 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:29.027725 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-87599013-2edc-420c-90b7-1e11694ac047 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:29.029107 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-87599013-2edc-420c-90b7-1e11694ac047 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79" status: 200 len: 1752 microversion: 2.20 time: 0.215383 Oct 27 03:41:29.042751 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2278/4853] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:41:28 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 => generated 1752 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:41:29.477543 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d322ee67-841c-4171-a8fa-59fa5a155ac5 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:29.478202 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d322ee67-841c-4171-a8fa-59fa5a155ac5 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:29.486301 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:41:29.494372 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d322ee67-841c-4171-a8fa-59fa5a155ac5 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:29.494864 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d322ee67-841c-4171-a8fa-59fa5a155ac5 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:29.495310 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d322ee67-841c-4171-a8fa-59fa5a155ac5 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:29.496035 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d322ee67-841c-4171-a8fa-59fa5a155ac5 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:29.496495 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d322ee67-841c-4171-a8fa-59fa5a155ac5 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:29.503144 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d322ee67-841c-4171-a8fa-59fa5a155ac5 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:29.658466 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-602ab1f6-3a40-4811-bf84-db3ab33d675f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:29.672944 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-602ab1f6-3a40-4811-bf84-db3ab33d675f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/ac9da5d0-c534-4955-b148-f401c9308618" status: 200 len: 1512 microversion: 2.1 time: 0.899921 Oct 27 03:41:29.679652 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2576/4854] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:41:28 2022] GET /compute/v2.1/servers/ac9da5d0-c534-4955-b148-f401c9308618 => generated 1512 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:41:29.814313 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d322ee67-841c-4171-a8fa-59fa5a155ac5 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffc2b1c410149e884a47240b5425e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38450368ef5c4e68ac3c19c7a0a1ce65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:29.827359 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d322ee67-841c-4171-a8fa-59fa5a155ac5 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b" status: 200 len: 1679 microversion: 2.1 time: 0.354218 Oct 27 03:41:29.828286 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2279/4855] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:41:29 2022] GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b => generated 1679 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:41:30.057113 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-276ab95f-333a-42ec-acb8-736445f7aa57 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:30.057744 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-276ab95f-333a-42ec-acb8-736445f7aa57 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:30.076112 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-276ab95f-333a-42ec-acb8-736445f7aa57 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:30.076112 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-276ab95f-333a-42ec-acb8-736445f7aa57 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:30.076112 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-276ab95f-333a-42ec-acb8-736445f7aa57 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:30.076112 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-276ab95f-333a-42ec-acb8-736445f7aa57 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:30.076112 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-276ab95f-333a-42ec-acb8-736445f7aa57 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:30.081435 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-276ab95f-333a-42ec-acb8-736445f7aa57 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:30.373866 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-276ab95f-333a-42ec-acb8-736445f7aa57 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:30.384626 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-276ab95f-333a-42ec-acb8-736445f7aa57 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:30.386452 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-276ab95f-333a-42ec-acb8-736445f7aa57 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:30.388023 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-276ab95f-333a-42ec-acb8-736445f7aa57 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79" status: 200 len: 1752 microversion: 2.20 time: 0.335143 Oct 27 03:41:30.402708 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2577/4856] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:41:30 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 => generated 1752 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:41:30.699549 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-892ad288-f503-4216-901c-c09ac427601c tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:30.700724 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-892ad288-f503-4216-901c-c09ac427601c tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: ac9da5d0-c534-4955-b148-f401c9308618] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:30.708139 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-892ad288-f503-4216-901c-c09ac427601c tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:30.708877 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-892ad288-f503-4216-901c-c09ac427601c tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:30.709478 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-892ad288-f503-4216-901c-c09ac427601c tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:30.710406 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-892ad288-f503-4216-901c-c09ac427601c tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:30.711281 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-892ad288-f503-4216-901c-c09ac427601c tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:30.711959 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-892ad288-f503-4216-901c-c09ac427601c tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:30.857027 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f28ade48-8cb8-4fd4-ab17-15c1d0f2db02 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:30.858024 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f28ade48-8cb8-4fd4-ab17-15c1d0f2db02 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:30.873420 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f28ade48-8cb8-4fd4-ab17-15c1d0f2db02 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:30.874076 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f28ade48-8cb8-4fd4-ab17-15c1d0f2db02 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:30.878551 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f28ade48-8cb8-4fd4-ab17-15c1d0f2db02 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:30.880820 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f28ade48-8cb8-4fd4-ab17-15c1d0f2db02 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:30.884076 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f28ade48-8cb8-4fd4-ab17-15c1d0f2db02 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:30.884629 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f28ade48-8cb8-4fd4-ab17-15c1d0f2db02 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:30.933745 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-892ad288-f503-4216-901c-c09ac427601c tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:30.944171 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-892ad288-f503-4216-901c-c09ac427601c tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/ac9da5d0-c534-4955-b148-f401c9308618" status: 200 len: 1512 microversion: 2.1 time: 0.249276 Oct 27 03:41:30.960232 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2280/4857] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:41:30 2022] GET /compute/v2.1/servers/ac9da5d0-c534-4955-b148-f401c9308618 => generated 1512 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:41:31.119304 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f28ade48-8cb8-4fd4-ab17-15c1d0f2db02 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffc2b1c410149e884a47240b5425e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38450368ef5c4e68ac3c19c7a0a1ce65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:31.129492 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f28ade48-8cb8-4fd4-ab17-15c1d0f2db02 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b" status: 200 len: 1679 microversion: 2.1 time: 0.276566 Oct 27 03:41:31.131068 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2578/4858] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:41:30 2022] GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b => generated 1679 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:41:31.416857 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-dd687ef9-88bf-4185-b76a-40f4dbfc7b83 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:31.416857 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-dd687ef9-88bf-4185-b76a-40f4dbfc7b83 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:31.428232 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dd687ef9-88bf-4185-b76a-40f4dbfc7b83 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:31.438803 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dd687ef9-88bf-4185-b76a-40f4dbfc7b83 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:31.445452 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dd687ef9-88bf-4185-b76a-40f4dbfc7b83 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:31.445452 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dd687ef9-88bf-4185-b76a-40f4dbfc7b83 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:31.445452 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dd687ef9-88bf-4185-b76a-40f4dbfc7b83 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:31.445452 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dd687ef9-88bf-4185-b76a-40f4dbfc7b83 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:31.970949 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-eb43ca67-3aff-42a7-b698-48191cffe9df tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:31.971567 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-eb43ca67-3aff-42a7-b698-48191cffe9df tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: ac9da5d0-c534-4955-b148-f401c9308618] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:31.977846 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eb43ca67-3aff-42a7-b698-48191cffe9df tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:31.983330 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eb43ca67-3aff-42a7-b698-48191cffe9df tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:31.983330 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eb43ca67-3aff-42a7-b698-48191cffe9df tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:31.983330 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eb43ca67-3aff-42a7-b698-48191cffe9df tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:31.983330 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eb43ca67-3aff-42a7-b698-48191cffe9df tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:31.983330 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eb43ca67-3aff-42a7-b698-48191cffe9df tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:32.165451 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-eb43ca67-3aff-42a7-b698-48191cffe9df tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:32.187912 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-eb43ca67-3aff-42a7-b698-48191cffe9df tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/ac9da5d0-c534-4955-b148-f401c9308618" status: 200 len: 1512 microversion: 2.1 time: 0.220217 Oct 27 03:41:32.188998 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2579/4859] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:41:31 2022] GET /compute/v2.1/servers/ac9da5d0-c534-4955-b148-f401c9308618 => generated 1512 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:41:32.196700 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-60caeaa7-b99a-4aed-b4db-d5421aa95569 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:32.197491 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-60caeaa7-b99a-4aed-b4db-d5421aa95569 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:32.205839 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-60caeaa7-b99a-4aed-b4db-d5421aa95569 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:32.206857 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-60caeaa7-b99a-4aed-b4db-d5421aa95569 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:32.207537 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-60caeaa7-b99a-4aed-b4db-d5421aa95569 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:32.208518 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-60caeaa7-b99a-4aed-b4db-d5421aa95569 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:32.209196 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-60caeaa7-b99a-4aed-b4db-d5421aa95569 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:32.209784 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-60caeaa7-b99a-4aed-b4db-d5421aa95569 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:32.331061 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-dd687ef9-88bf-4185-b76a-40f4dbfc7b83 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:32.344596 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:41:32.352439 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-dd687ef9-88bf-4185-b76a-40f4dbfc7b83 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:32.359164 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-dd687ef9-88bf-4185-b76a-40f4dbfc7b83 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:32.363018 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-dd687ef9-88bf-4185-b76a-40f4dbfc7b83 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79" status: 200 len: 1752 microversion: 2.20 time: 0.952565 Oct 27 03:41:32.364156 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2281/4860] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:41:31 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 => generated 1752 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:41:32.442208 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-60caeaa7-b99a-4aed-b4db-d5421aa95569 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffc2b1c410149e884a47240b5425e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38450368ef5c4e68ac3c19c7a0a1ce65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:32.453394 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-60caeaa7-b99a-4aed-b4db-d5421aa95569 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b" status: 200 len: 1679 microversion: 2.1 time: 0.263190 Oct 27 03:41:32.454240 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2580/4861] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:41:32 2022] GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b => generated 1679 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:41:33.223736 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-95844145-f3b1-43e3-85f9-9d43ff2db8f6 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:33.224777 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-95844145-f3b1-43e3-85f9-9d43ff2db8f6 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: ac9da5d0-c534-4955-b148-f401c9308618] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:33.251768 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-95844145-f3b1-43e3-85f9-9d43ff2db8f6 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:33.256934 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-95844145-f3b1-43e3-85f9-9d43ff2db8f6 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:33.258779 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-95844145-f3b1-43e3-85f9-9d43ff2db8f6 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:33.261247 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-95844145-f3b1-43e3-85f9-9d43ff2db8f6 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:33.261845 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-95844145-f3b1-43e3-85f9-9d43ff2db8f6 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:33.262404 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-95844145-f3b1-43e3-85f9-9d43ff2db8f6 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:33.390590 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e59737d4-e04e-4d14-8e24-4284a67322d7 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:33.391815 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e59737d4-e04e-4d14-8e24-4284a67322d7 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:33.399978 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e59737d4-e04e-4d14-8e24-4284a67322d7 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:33.400655 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e59737d4-e04e-4d14-8e24-4284a67322d7 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:33.401109 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e59737d4-e04e-4d14-8e24-4284a67322d7 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:33.401885 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e59737d4-e04e-4d14-8e24-4284a67322d7 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:33.402600 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e59737d4-e04e-4d14-8e24-4284a67322d7 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:33.403048 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e59737d4-e04e-4d14-8e24-4284a67322d7 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:33.512726 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-95844145-f3b1-43e3-85f9-9d43ff2db8f6 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:33.521863 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-95844145-f3b1-43e3-85f9-9d43ff2db8f6 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/ac9da5d0-c534-4955-b148-f401c9308618" status: 200 len: 1512 microversion: 2.1 time: 0.307383 Oct 27 03:41:33.525700 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2282/4862] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:41:33 2022] GET /compute/v2.1/servers/ac9da5d0-c534-4955-b148-f401c9308618 => generated 1512 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:41:33.530748 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-627f1641-2b1a-49cb-bb53-f0a4c73b3fd9 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:33.531375 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-627f1641-2b1a-49cb-bb53-f0a4c73b3fd9 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:33.540920 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-627f1641-2b1a-49cb-bb53-f0a4c73b3fd9 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:33.541567 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-627f1641-2b1a-49cb-bb53-f0a4c73b3fd9 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:33.542283 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-627f1641-2b1a-49cb-bb53-f0a4c73b3fd9 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:33.543457 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-627f1641-2b1a-49cb-bb53-f0a4c73b3fd9 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:33.544074 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-627f1641-2b1a-49cb-bb53-f0a4c73b3fd9 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:33.544661 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-627f1641-2b1a-49cb-bb53-f0a4c73b3fd9 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:33.622266 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e59737d4-e04e-4d14-8e24-4284a67322d7 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:33.627861 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=5,nova_cell1:UPDATE=6 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:41:33.636100 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e59737d4-e04e-4d14-8e24-4284a67322d7 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:33.637912 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e59737d4-e04e-4d14-8e24-4284a67322d7 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:33.639352 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e59737d4-e04e-4d14-8e24-4284a67322d7 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79" status: 200 len: 1752 microversion: 2.20 time: 0.253967 Oct 27 03:41:33.640472 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2581/4863] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:41:33 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 => generated 1752 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:41:33.887027 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-627f1641-2b1a-49cb-bb53-f0a4c73b3fd9 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffc2b1c410149e884a47240b5425e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38450368ef5c4e68ac3c19c7a0a1ce65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:33.930123 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-627f1641-2b1a-49cb-bb53-f0a4c73b3fd9 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b" status: 200 len: 1679 microversion: 2.1 time: 0.402212 Oct 27 03:41:33.934423 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2283/4864] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:41:33 2022] GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b => generated 1679 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:41:34.549934 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-dc538198-6e2f-44e3-bcaa-0180a8ac662e tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:34.551283 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-dc538198-6e2f-44e3-bcaa-0180a8ac662e tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: ac9da5d0-c534-4955-b148-f401c9308618] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:34.559755 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dc538198-6e2f-44e3-bcaa-0180a8ac662e tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:34.560501 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dc538198-6e2f-44e3-bcaa-0180a8ac662e tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:34.561101 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dc538198-6e2f-44e3-bcaa-0180a8ac662e tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:34.562186 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dc538198-6e2f-44e3-bcaa-0180a8ac662e tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:34.563326 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dc538198-6e2f-44e3-bcaa-0180a8ac662e tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:34.564111 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dc538198-6e2f-44e3-bcaa-0180a8ac662e tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:34.683368 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-30eb4c62-bd7b-4bd8-87b2-9ed4db902eda tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1473090071", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:41:34.767877 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-dc538198-6e2f-44e3-bcaa-0180a8ac662e tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:34.777865 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.network.neutron [None req-30eb4c62-bd7b-4bd8-87b2-9ed4db902eda tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] validate_networks() for [('13518e9c-733a-4655-9e92-8d0d06018415', None, None, None, None, None)] {{(pid=121001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:41:34.784773 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-dc538198-6e2f-44e3-bcaa-0180a8ac662e tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/ac9da5d0-c534-4955-b148-f401c9308618" status: 200 len: 1512 microversion: 2.1 time: 0.239087 Oct 27 03:41:34.794184 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2284/4865] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:41:34 2022] GET /compute/v2.1/servers/ac9da5d0-c534-4955-b148-f401c9308618 => generated 1512 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:41:34.805125 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9e2a6ec0-a289-4d04-81b3-452f25992d78 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:34.806156 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9e2a6ec0-a289-4d04-81b3-452f25992d78 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:34.814254 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9e2a6ec0-a289-4d04-81b3-452f25992d78 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:34.815045 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9e2a6ec0-a289-4d04-81b3-452f25992d78 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:34.815726 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9e2a6ec0-a289-4d04-81b3-452f25992d78 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:34.816950 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9e2a6ec0-a289-4d04-81b3-452f25992d78 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:34.817911 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9e2a6ec0-a289-4d04-81b3-452f25992d78 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:34.818525 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9e2a6ec0-a289-4d04-81b3-452f25992d78 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:35.129348 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9e2a6ec0-a289-4d04-81b3-452f25992d78 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:35.142245 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9e2a6ec0-a289-4d04-81b3-452f25992d78 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:35.148989 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9e2a6ec0-a289-4d04-81b3-452f25992d78 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:35.150660 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9e2a6ec0-a289-4d04-81b3-452f25992d78 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79" status: 200 len: 1752 microversion: 2.20 time: 0.354398 Oct 27 03:41:35.154673 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2285/4866] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:41:34 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 => generated 1752 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:41:35.169782 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6b785386-0789-4adc-bd5a-2ebd70e1aa00 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:35.170438 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6b785386-0789-4adc-bd5a-2ebd70e1aa00 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:35.200377 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6b785386-0789-4adc-bd5a-2ebd70e1aa00 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:35.200870 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6b785386-0789-4adc-bd5a-2ebd70e1aa00 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:35.203366 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6b785386-0789-4adc-bd5a-2ebd70e1aa00 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:35.205641 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6b785386-0789-4adc-bd5a-2ebd70e1aa00 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:35.206321 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6b785386-0789-4adc-bd5a-2ebd70e1aa00 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:35.207141 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6b785386-0789-4adc-bd5a-2ebd70e1aa00 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:35.492401 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-6b785386-0789-4adc-bd5a-2ebd70e1aa00 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffc2b1c410149e884a47240b5425e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38450368ef5c4e68ac3c19c7a0a1ce65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:35.494498 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-30eb4c62-bd7b-4bd8-87b2-9ed4db902eda tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Flavor limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:41:35.497162 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-30eb4c62-bd7b-4bd8-87b2-9ed4db902eda tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Image limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:41:35.497674 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-30eb4c62-bd7b-4bd8-87b2-9ed4db902eda tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Flavor pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:41:35.499099 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-30eb4c62-bd7b-4bd8-87b2-9ed4db902eda tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Image pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:41:35.499614 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-30eb4c62-bd7b-4bd8-87b2-9ed4db902eda tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:41:35.502337 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6b785386-0789-4adc-bd5a-2ebd70e1aa00 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b" status: 200 len: 1679 microversion: 2.1 time: 0.346609 Oct 27 03:41:35.502944 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2286/4867] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:41:35 2022] GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b => generated 1679 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:41:35.527664 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-30eb4c62-bd7b-4bd8-87b2-9ed4db902eda tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:35.528303 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-30eb4c62-bd7b-4bd8-87b2-9ed4db902eda tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:35.528907 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-30eb4c62-bd7b-4bd8-87b2-9ed4db902eda tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:35.533162 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-30eb4c62-bd7b-4bd8-87b2-9ed4db902eda tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:35.533749 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-30eb4c62-bd7b-4bd8-87b2-9ed4db902eda tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:35.534315 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-30eb4c62-bd7b-4bd8-87b2-9ed4db902eda tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:35.581155 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-30eb4c62-bd7b-4bd8-87b2-9ed4db902eda tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Getting quotas for project e1f3ed7ef6c648c9ac771fbaadde1d0c. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:41:35.587703 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-30eb4c62-bd7b-4bd8-87b2-9ed4db902eda tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Getting quotas for user 43172c9e71704c869a25181574d67b35 and project e1f3ed7ef6c648c9ac771fbaadde1d0c. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:41:35.619849 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:41:35.624224 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-30eb4c62-bd7b-4bd8-87b2-9ed4db902eda tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Going to run 1 instances... {{(pid=121001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:41:35.628976 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-30eb4c62-bd7b-4bd8-87b2-9ed4db902eda tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: dda902a6-dcad-42bf-9b3c-ed716ea0af70] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:41:35.789262 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-30eb4c62-bd7b-4bd8-87b2-9ed4db902eda tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.253211 Oct 27 03:41:35.790367 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2582/4868] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:41:34 2022] POST /compute/v2.1/servers => generated 383 bytes in 1256 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 03:41:35.813939 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-56b2ea27-4b87-4f46-b88c-cf07af43bbf6 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:35.814849 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4840f444-d878-4527-aa31-18a1ad16c326 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:35.815474 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4840f444-d878-4527-aa31-18a1ad16c326 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: dda902a6-dcad-42bf-9b3c-ed716ea0af70] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:35.821048 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-56b2ea27-4b87-4f46-b88c-cf07af43bbf6 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: ac9da5d0-c534-4955-b148-f401c9308618] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:35.850788 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-56b2ea27-4b87-4f46-b88c-cf07af43bbf6 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:35.851326 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-56b2ea27-4b87-4f46-b88c-cf07af43bbf6 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:35.851780 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-56b2ea27-4b87-4f46-b88c-cf07af43bbf6 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:35.852505 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-56b2ea27-4b87-4f46-b88c-cf07af43bbf6 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:35.863747 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-56b2ea27-4b87-4f46-b88c-cf07af43bbf6 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:35.864675 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-56b2ea27-4b87-4f46-b88c-cf07af43bbf6 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:35.956477 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4840f444-d878-4527-aa31-18a1ad16c326 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:35.966530 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4840f444-d878-4527-aa31-18a1ad16c326 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/dda902a6-dcad-42bf-9b3c-ed716ea0af70" status: 200 len: 1222 microversion: 2.1 time: 0.168480 Oct 27 03:41:35.986070 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2287/4869] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:41:35 2022] GET /compute/v2.1/servers/dda902a6-dcad-42bf-9b3c-ed716ea0af70 => generated 1222 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:41:36.159978 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e19c6b2c-0c20-4a92-b011-2bd890ca3585 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-247437849", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:41:36.194099 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-56b2ea27-4b87-4f46-b88c-cf07af43bbf6 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:36.204163 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-56b2ea27-4b87-4f46-b88c-cf07af43bbf6 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/ac9da5d0-c534-4955-b148-f401c9308618" status: 200 len: 1512 microversion: 2.1 time: 0.399974 Oct 27 03:41:36.204621 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2583/4870] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:41:35 2022] GET /compute/v2.1/servers/ac9da5d0-c534-4955-b148-f401c9308618 => generated 1512 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:41:36.222381 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7376ed3d-9ef3-4693-9aa0-b8fe7b8b13e5 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:36.223020 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7376ed3d-9ef3-4693-9aa0-b8fe7b8b13e5 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:36.237183 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7376ed3d-9ef3-4693-9aa0-b8fe7b8b13e5 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:36.237887 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7376ed3d-9ef3-4693-9aa0-b8fe7b8b13e5 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:36.245107 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7376ed3d-9ef3-4693-9aa0-b8fe7b8b13e5 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:36.253418 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7376ed3d-9ef3-4693-9aa0-b8fe7b8b13e5 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:36.260348 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7376ed3d-9ef3-4693-9aa0-b8fe7b8b13e5 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:36.261753 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7376ed3d-9ef3-4693-9aa0-b8fe7b8b13e5 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:36.311885 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-e19c6b2c-0c20-4a92-b011-2bd890ca3585 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] validate_networks() for [('13518e9c-733a-4655-9e92-8d0d06018415', None, None, None, None, None)] {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:41:36.520367 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7376ed3d-9ef3-4693-9aa0-b8fe7b8b13e5 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:36.536161 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7376ed3d-9ef3-4693-9aa0-b8fe7b8b13e5 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:36.537879 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7376ed3d-9ef3-4693-9aa0-b8fe7b8b13e5 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:36.555531 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7376ed3d-9ef3-4693-9aa0-b8fe7b8b13e5 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79" status: 200 len: 1752 microversion: 2.20 time: 0.330043 Oct 27 03:41:36.555531 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2584/4871] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:41:36 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 => generated 1752 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:41:36.555531 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e98e1ca8-68fd-4406-b57e-a5832ae30236 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:36.555531 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e98e1ca8-68fd-4406-b57e-a5832ae30236 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:36.555531 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e98e1ca8-68fd-4406-b57e-a5832ae30236 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:36.555531 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e98e1ca8-68fd-4406-b57e-a5832ae30236 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:36.555531 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e98e1ca8-68fd-4406-b57e-a5832ae30236 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:36.555531 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e98e1ca8-68fd-4406-b57e-a5832ae30236 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:36.555531 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e98e1ca8-68fd-4406-b57e-a5832ae30236 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:36.555531 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e98e1ca8-68fd-4406-b57e-a5832ae30236 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:36.754461 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e98e1ca8-68fd-4406-b57e-a5832ae30236 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffc2b1c410149e884a47240b5425e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38450368ef5c4e68ac3c19c7a0a1ce65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:36.770327 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e98e1ca8-68fd-4406-b57e-a5832ae30236 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b" status: 200 len: 1679 microversion: 2.1 time: 0.228552 Oct 27 03:41:36.773700 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2585/4872] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:41:36 2022] GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b => generated 1679 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:41:36.891484 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-e19c6b2c-0c20-4a92-b011-2bd890ca3585 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:41:36.891984 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-e19c6b2c-0c20-4a92-b011-2bd890ca3585 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:41:36.892369 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-e19c6b2c-0c20-4a92-b011-2bd890ca3585 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:41:36.892778 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-e19c6b2c-0c20-4a92-b011-2bd890ca3585 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:41:36.893188 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-e19c6b2c-0c20-4a92-b011-2bd890ca3585 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:41:36.906949 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e19c6b2c-0c20-4a92-b011-2bd890ca3585 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:36.907462 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e19c6b2c-0c20-4a92-b011-2bd890ca3585 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:36.907881 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e19c6b2c-0c20-4a92-b011-2bd890ca3585 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:36.908621 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e19c6b2c-0c20-4a92-b011-2bd890ca3585 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:36.909109 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e19c6b2c-0c20-4a92-b011-2bd890ca3585 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:36.909501 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e19c6b2c-0c20-4a92-b011-2bd890ca3585 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:36.930839 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-e19c6b2c-0c20-4a92-b011-2bd890ca3585 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Getting quotas for project e1f3ed7ef6c648c9ac771fbaadde1d0c. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:41:36.936232 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-e19c6b2c-0c20-4a92-b011-2bd890ca3585 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Getting quotas for user 43172c9e71704c869a25181574d67b35 and project e1f3ed7ef6c648c9ac771fbaadde1d0c. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:41:36.950049 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e19c6b2c-0c20-4a92-b011-2bd890ca3585 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:41:36.953037 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e19c6b2c-0c20-4a92-b011-2bd890ca3585 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: c9e02344-a91a-40c8-b8c0-c0abe503204c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:41:37.110452 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e19c6b2c-0c20-4a92-b011-2bd890ca3585 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.954903 Oct 27 03:41:37.111576 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2288/4873] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:41:36 2022] POST /compute/v2.1/servers => generated 383 bytes in 957 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 03:41:37.127759 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2f0dc341-fb64-4c55-996a-b2ea94406baa tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:37.130905 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2f0dc341-fb64-4c55-996a-b2ea94406baa tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: c9e02344-a91a-40c8-b8c0-c0abe503204c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:37.232152 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5a17e830-f62c-4a9f-8731-8093638e317d tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:37.233054 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5a17e830-f62c-4a9f-8731-8093638e317d tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: ac9da5d0-c534-4955-b148-f401c9308618] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:37.251427 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5a17e830-f62c-4a9f-8731-8093638e317d tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:37.251427 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5a17e830-f62c-4a9f-8731-8093638e317d tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:37.251427 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5a17e830-f62c-4a9f-8731-8093638e317d tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:37.251427 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5a17e830-f62c-4a9f-8731-8093638e317d tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:37.251427 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5a17e830-f62c-4a9f-8731-8093638e317d tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:37.257667 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5a17e830-f62c-4a9f-8731-8093638e317d tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:37.281586 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2f0dc341-fb64-4c55-996a-b2ea94406baa tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:37.288399 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2f0dc341-fb64-4c55-996a-b2ea94406baa tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c" status: 200 len: 1221 microversion: 2.1 time: 0.169220 Oct 27 03:41:37.290203 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2586/4874] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:41:37 2022] GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c => generated 1221 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:41:37.565020 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5a17e830-f62c-4a9f-8731-8093638e317d tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:37.572456 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f708cdc6-df06-429e-9066-a3ca6b2d1e65 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:37.574729 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f708cdc6-df06-429e-9066-a3ca6b2d1e65 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:37.577284 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5a17e830-f62c-4a9f-8731-8093638e317d tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/ac9da5d0-c534-4955-b148-f401c9308618" status: 200 len: 1512 microversion: 2.1 time: 0.349309 Oct 27 03:41:37.578002 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2289/4875] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:41:37 2022] GET /compute/v2.1/servers/ac9da5d0-c534-4955-b148-f401c9308618 => generated 1512 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:41:37.602567 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f708cdc6-df06-429e-9066-a3ca6b2d1e65 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:37.606023 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f708cdc6-df06-429e-9066-a3ca6b2d1e65 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:37.606521 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f708cdc6-df06-429e-9066-a3ca6b2d1e65 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:37.607286 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f708cdc6-df06-429e-9066-a3ca6b2d1e65 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:37.609360 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f708cdc6-df06-429e-9066-a3ca6b2d1e65 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:37.609820 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f708cdc6-df06-429e-9066-a3ca6b2d1e65 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:37.799517 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-caf5b75f-1cfa-4da5-803f-b5c7c11d9b81 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:37.800457 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-caf5b75f-1cfa-4da5-803f-b5c7c11d9b81 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:37.811915 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-caf5b75f-1cfa-4da5-803f-b5c7c11d9b81 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:37.815194 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-caf5b75f-1cfa-4da5-803f-b5c7c11d9b81 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:37.815917 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-caf5b75f-1cfa-4da5-803f-b5c7c11d9b81 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:37.817992 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-caf5b75f-1cfa-4da5-803f-b5c7c11d9b81 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:37.818888 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-caf5b75f-1cfa-4da5-803f-b5c7c11d9b81 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:37.823751 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-caf5b75f-1cfa-4da5-803f-b5c7c11d9b81 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:38.106544 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-caf5b75f-1cfa-4da5-803f-b5c7c11d9b81 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffc2b1c410149e884a47240b5425e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38450368ef5c4e68ac3c19c7a0a1ce65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:38.120495 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-caf5b75f-1cfa-4da5-803f-b5c7c11d9b81 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b" status: 200 len: 1679 microversion: 2.1 time: 0.324933 Oct 27 03:41:38.123224 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2290/4876] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:41:37 2022] GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b => generated 1679 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:41:38.248573 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f708cdc6-df06-429e-9066-a3ca6b2d1e65 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:38.264450 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f708cdc6-df06-429e-9066-a3ca6b2d1e65 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:38.265533 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f708cdc6-df06-429e-9066-a3ca6b2d1e65 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:38.279022 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f708cdc6-df06-429e-9066-a3ca6b2d1e65 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79" status: 200 len: 1752 microversion: 2.20 time: 0.712548 Oct 27 03:41:38.285432 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2587/4877] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:41:37 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 => generated 1752 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:41:38.326964 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-12f52d6c-94f5-4d01-9485-e8391bd3198b tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:38.326964 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-12f52d6c-94f5-4d01-9485-e8391bd3198b tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: c9e02344-a91a-40c8-b8c0-c0abe503204c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:38.447536 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-12f52d6c-94f5-4d01-9485-e8391bd3198b tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:38.456445 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-12f52d6c-94f5-4d01-9485-e8391bd3198b tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c" status: 200 len: 1221 microversion: 2.1 time: 0.145382 Oct 27 03:41:38.464061 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2291/4878] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:41:38 2022] GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c => generated 1221 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:41:38.616202 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ff12706f-4a18-47c9-9e3a-b547f65ec71c tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:38.619745 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ff12706f-4a18-47c9-9e3a-b547f65ec71c tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: ac9da5d0-c534-4955-b148-f401c9308618] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:38.645316 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ff12706f-4a18-47c9-9e3a-b547f65ec71c tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:38.645837 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ff12706f-4a18-47c9-9e3a-b547f65ec71c tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:38.646327 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ff12706f-4a18-47c9-9e3a-b547f65ec71c tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:38.647075 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ff12706f-4a18-47c9-9e3a-b547f65ec71c tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:38.648367 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ff12706f-4a18-47c9-9e3a-b547f65ec71c tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:38.651044 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ff12706f-4a18-47c9-9e3a-b547f65ec71c tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:39.102346 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ff12706f-4a18-47c9-9e3a-b547f65ec71c tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:39.115001 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ff12706f-4a18-47c9-9e3a-b547f65ec71c tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/ac9da5d0-c534-4955-b148-f401c9308618" status: 200 len: 1512 microversion: 2.1 time: 0.515256 Oct 27 03:41:39.116419 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2588/4879] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:41:38 2022] GET /compute/v2.1/servers/ac9da5d0-c534-4955-b148-f401c9308618 => generated 1512 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:41:39.146129 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-71b98d25-fff5-4ef2-8b17-804494429e60 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:39.146771 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-71b98d25-fff5-4ef2-8b17-804494429e60 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:39.159466 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-71b98d25-fff5-4ef2-8b17-804494429e60 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:39.160513 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-71b98d25-fff5-4ef2-8b17-804494429e60 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:39.161312 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-71b98d25-fff5-4ef2-8b17-804494429e60 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:39.162380 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-71b98d25-fff5-4ef2-8b17-804494429e60 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:39.163900 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-71b98d25-fff5-4ef2-8b17-804494429e60 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:39.164493 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-71b98d25-fff5-4ef2-8b17-804494429e60 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:39.305623 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-790ce31c-26b4-47b6-b90e-874f8d9a3f3e tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:39.306292 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-790ce31c-26b4-47b6-b90e-874f8d9a3f3e tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:39.315223 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-790ce31c-26b4-47b6-b90e-874f8d9a3f3e tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:39.316037 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-790ce31c-26b4-47b6-b90e-874f8d9a3f3e tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:39.316665 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-790ce31c-26b4-47b6-b90e-874f8d9a3f3e tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:39.318076 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-790ce31c-26b4-47b6-b90e-874f8d9a3f3e tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:39.318812 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-790ce31c-26b4-47b6-b90e-874f8d9a3f3e tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:39.319585 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-790ce31c-26b4-47b6-b90e-874f8d9a3f3e tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:39.544191 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-71b98d25-fff5-4ef2-8b17-804494429e60 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffc2b1c410149e884a47240b5425e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38450368ef5c4e68ac3c19c7a0a1ce65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:39.564557 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-71b98d25-fff5-4ef2-8b17-804494429e60 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b" status: 200 len: 1656 microversion: 2.1 time: 0.423372 Oct 27 03:41:39.568405 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2292/4880] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:41:39 2022] GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b => generated 1656 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:41:39.577698 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ba2f1742-69c2-4ed8-82fd-083b6b948682 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:39.578374 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ba2f1742-69c2-4ed8-82fd-083b6b948682 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: c9e02344-a91a-40c8-b8c0-c0abe503204c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:39.594911 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-790ce31c-26b4-47b6-b90e-874f8d9a3f3e tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:39.596536 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ba2f1742-69c2-4ed8-82fd-083b6b948682 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:39.597253 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ba2f1742-69c2-4ed8-82fd-083b6b948682 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:39.597868 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ba2f1742-69c2-4ed8-82fd-083b6b948682 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:39.598882 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ba2f1742-69c2-4ed8-82fd-083b6b948682 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:39.599537 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ba2f1742-69c2-4ed8-82fd-083b6b948682 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:39.600194 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ba2f1742-69c2-4ed8-82fd-083b6b948682 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:39.606889 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-790ce31c-26b4-47b6-b90e-874f8d9a3f3e tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:39.615649 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-790ce31c-26b4-47b6-b90e-874f8d9a3f3e tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:39.616960 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-790ce31c-26b4-47b6-b90e-874f8d9a3f3e tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79" status: 200 len: 1808 microversion: 2.20 time: 0.316002 Oct 27 03:41:39.634122 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2589/4881] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:41:39 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 => generated 1808 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:41:39.638481 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d41fbebe-2d95-47bd-937d-22373ea8f700 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:41:39.728707 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d41fbebe-2d95-47bd-937d-22373ea8f700 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:39.728707 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d41fbebe-2d95-47bd-937d-22373ea8f700 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:39.728707 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d41fbebe-2d95-47bd-937d-22373ea8f700 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:39.729837 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ba2f1742-69c2-4ed8-82fd-083b6b948682 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:39.729837 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ba2f1742-69c2-4ed8-82fd-083b6b948682 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c" status: 200 len: 1217 microversion: 2.1 time: 0.156151 Oct 27 03:41:39.729837 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2293/4882] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:41:39 2022] GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c => generated 1217 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:41:39.765158 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d41fbebe-2d95-47bd-937d-22373ea8f700 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b] Going to try to start instance {{(pid=121001) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 27 03:41:40.020767 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d41fbebe-2d95-47bd-937d-22373ea8f700 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "POST /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b/action" status: 202 len: 0 microversion: 2.1 time: 0.390599 Oct 27 03:41:40.021698 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2590/4883] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:41:39 2022] POST /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b/action => generated 0 bytes in 392 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:41:40.031519 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e87a9098-1ab4-46bd-9400-960d39d5a921 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:40.032163 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e87a9098-1ab4-46bd-9400-960d39d5a921 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:40.046961 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e87a9098-1ab4-46bd-9400-960d39d5a921 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:40.047718 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e87a9098-1ab4-46bd-9400-960d39d5a921 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:40.048321 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e87a9098-1ab4-46bd-9400-960d39d5a921 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:40.049223 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e87a9098-1ab4-46bd-9400-960d39d5a921 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:40.050648 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e87a9098-1ab4-46bd-9400-960d39d5a921 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:40.052157 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e87a9098-1ab4-46bd-9400-960d39d5a921 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:40.155092 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-bc873737-1695-4ed0-8ec6-482ef1476b09 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:40.156062 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-bc873737-1695-4ed0-8ec6-482ef1476b09 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: ac9da5d0-c534-4955-b148-f401c9308618] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:40.183195 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bc873737-1695-4ed0-8ec6-482ef1476b09 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:40.183195 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bc873737-1695-4ed0-8ec6-482ef1476b09 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:40.183195 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bc873737-1695-4ed0-8ec6-482ef1476b09 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:40.183195 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bc873737-1695-4ed0-8ec6-482ef1476b09 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:40.183195 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bc873737-1695-4ed0-8ec6-482ef1476b09 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:40.183681 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bc873737-1695-4ed0-8ec6-482ef1476b09 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:40.762194 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-bc873737-1695-4ed0-8ec6-482ef1476b09 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:40.771763 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-bc873737-1695-4ed0-8ec6-482ef1476b09 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/ac9da5d0-c534-4955-b148-f401c9308618" status: 200 len: 1512 microversion: 2.1 time: 0.631973 Oct 27 03:41:40.805745 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2591/4884] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:41:40 2022] GET /compute/v2.1/servers/ac9da5d0-c534-4955-b148-f401c9308618 => generated 1512 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:41:40.811305 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-fc8b1db1-e90b-415c-a53c-2f6829531cbe tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:40.814092 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-fc8b1db1-e90b-415c-a53c-2f6829531cbe tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:40.823976 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fc8b1db1-e90b-415c-a53c-2f6829531cbe tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:40.824800 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fc8b1db1-e90b-415c-a53c-2f6829531cbe tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:40.825480 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fc8b1db1-e90b-415c-a53c-2f6829531cbe tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:40.827021 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fc8b1db1-e90b-415c-a53c-2f6829531cbe tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:40.827712 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fc8b1db1-e90b-415c-a53c-2f6829531cbe tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:40.828486 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fc8b1db1-e90b-415c-a53c-2f6829531cbe tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:40.903610 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e87a9098-1ab4-46bd-9400-960d39d5a921 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffc2b1c410149e884a47240b5425e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38450368ef5c4e68ac3c19c7a0a1ce65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:40.912774 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e87a9098-1ab4-46bd-9400-960d39d5a921 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b" status: 200 len: 1665 microversion: 2.1 time: 0.886438 Oct 27 03:41:40.915386 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2294/4885] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:41:40 2022] GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b => generated 1665 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:41:40.920695 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5dd67aae-0de3-4284-afa0-a8fe5da30be1 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:40.921424 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5dd67aae-0de3-4284-afa0-a8fe5da30be1 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: c9e02344-a91a-40c8-b8c0-c0abe503204c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:40.927635 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5dd67aae-0de3-4284-afa0-a8fe5da30be1 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:40.928349 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5dd67aae-0de3-4284-afa0-a8fe5da30be1 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:40.929566 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5dd67aae-0de3-4284-afa0-a8fe5da30be1 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:40.930764 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5dd67aae-0de3-4284-afa0-a8fe5da30be1 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:40.931431 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5dd67aae-0de3-4284-afa0-a8fe5da30be1 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:40.932065 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5dd67aae-0de3-4284-afa0-a8fe5da30be1 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:41.033563 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5dd67aae-0de3-4284-afa0-a8fe5da30be1 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:41.056277 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5dd67aae-0de3-4284-afa0-a8fe5da30be1 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c" status: 200 len: 1273 microversion: 2.1 time: 0.130795 Oct 27 03:41:41.056277 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2295/4886] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:41:40 2022] GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c => generated 1273 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:41:41.800655 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1f3568d4-3509-4ec8-a932-f02440dbc37f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:41.801385 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1f3568d4-3509-4ec8-a932-f02440dbc37f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: ac9da5d0-c534-4955-b148-f401c9308618] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:41.812866 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1f3568d4-3509-4ec8-a932-f02440dbc37f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:41.813367 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1f3568d4-3509-4ec8-a932-f02440dbc37f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:41.813809 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1f3568d4-3509-4ec8-a932-f02440dbc37f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:41.828669 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1f3568d4-3509-4ec8-a932-f02440dbc37f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:41.828669 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1f3568d4-3509-4ec8-a932-f02440dbc37f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:41.828892 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1f3568d4-3509-4ec8-a932-f02440dbc37f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:41.995272 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-fc8b1db1-e90b-415c-a53c-2f6829531cbe tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:42.016241 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-fc8b1db1-e90b-415c-a53c-2f6829531cbe tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:42.027275 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-fc8b1db1-e90b-415c-a53c-2f6829531cbe tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:42.029753 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-fc8b1db1-e90b-415c-a53c-2f6829531cbe tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79" status: 200 len: 1808 microversion: 2.20 time: 1.222831 Oct 27 03:41:42.034122 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2592/4887] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:41:40 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 => generated 1808 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:41:42.047438 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7d0692a7-c103-4dc7-b70c-6df3929d60a4 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:42.051001 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7d0692a7-c103-4dc7-b70c-6df3929d60a4 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:42.065884 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7d0692a7-c103-4dc7-b70c-6df3929d60a4 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:42.067603 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7d0692a7-c103-4dc7-b70c-6df3929d60a4 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:42.067603 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7d0692a7-c103-4dc7-b70c-6df3929d60a4 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:42.075164 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7d0692a7-c103-4dc7-b70c-6df3929d60a4 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:42.077842 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7d0692a7-c103-4dc7-b70c-6df3929d60a4 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:42.078624 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7d0692a7-c103-4dc7-b70c-6df3929d60a4 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:42.510006 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7d0692a7-c103-4dc7-b70c-6df3929d60a4 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffc2b1c410149e884a47240b5425e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38450368ef5c4e68ac3c19c7a0a1ce65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:42.529550 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7d0692a7-c103-4dc7-b70c-6df3929d60a4 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b" status: 200 len: 1665 microversion: 2.1 time: 0.489075 Oct 27 03:41:42.532128 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2593/4888] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:41:42 2022] GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b => generated 1665 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:41:42.555652 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3ddfe2c2-ce85-48ac-8414-5bc24d68f091 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:42.556491 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3ddfe2c2-ce85-48ac-8414-5bc24d68f091 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: c9e02344-a91a-40c8-b8c0-c0abe503204c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:42.577303 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3ddfe2c2-ce85-48ac-8414-5bc24d68f091 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:42.577303 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3ddfe2c2-ce85-48ac-8414-5bc24d68f091 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:42.577588 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3ddfe2c2-ce85-48ac-8414-5bc24d68f091 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:42.578312 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3ddfe2c2-ce85-48ac-8414-5bc24d68f091 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:42.578789 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3ddfe2c2-ce85-48ac-8414-5bc24d68f091 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:42.579229 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3ddfe2c2-ce85-48ac-8414-5bc24d68f091 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:42.665546 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1f3568d4-3509-4ec8-a932-f02440dbc37f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:42.679829 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1f3568d4-3509-4ec8-a932-f02440dbc37f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/ac9da5d0-c534-4955-b148-f401c9308618" status: 200 len: 1512 microversion: 2.1 time: 0.883373 Oct 27 03:41:42.706496 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2296/4889] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:41:41 2022] GET /compute/v2.1/servers/ac9da5d0-c534-4955-b148-f401c9308618 => generated 1512 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:41:42.815651 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3ddfe2c2-ce85-48ac-8414-5bc24d68f091 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:42.832298 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3ddfe2c2-ce85-48ac-8414-5bc24d68f091 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c" status: 200 len: 1279 microversion: 2.1 time: 0.298723 Oct 27 03:41:42.834582 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2594/4890] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:41:42 2022] GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c => generated 1279 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:41:43.069521 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-274e811c-727d-45cb-98f8-6d9d893a3a11 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:43.069521 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-274e811c-727d-45cb-98f8-6d9d893a3a11 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:43.075675 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-274e811c-727d-45cb-98f8-6d9d893a3a11 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:43.076498 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-274e811c-727d-45cb-98f8-6d9d893a3a11 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:43.077344 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-274e811c-727d-45cb-98f8-6d9d893a3a11 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:43.078434 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-274e811c-727d-45cb-98f8-6d9d893a3a11 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:43.079218 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-274e811c-727d-45cb-98f8-6d9d893a3a11 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:43.079864 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-274e811c-727d-45cb-98f8-6d9d893a3a11 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:43.437322 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-274e811c-727d-45cb-98f8-6d9d893a3a11 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:43.457400 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-274e811c-727d-45cb-98f8-6d9d893a3a11 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:43.460198 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-274e811c-727d-45cb-98f8-6d9d893a3a11 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:43.464223 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-274e811c-727d-45cb-98f8-6d9d893a3a11 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79" status: 200 len: 1808 microversion: 2.20 time: 0.404383 Oct 27 03:41:43.475081 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2297/4891] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:41:43 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 => generated 1808 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:41:43.560342 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-af4d1cae-bcfb-494d-8d5b-6c5c9690b8d8 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:43.561024 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-af4d1cae-bcfb-494d-8d5b-6c5c9690b8d8 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:43.575869 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-af4d1cae-bcfb-494d-8d5b-6c5c9690b8d8 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:43.576428 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-af4d1cae-bcfb-494d-8d5b-6c5c9690b8d8 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:43.576885 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-af4d1cae-bcfb-494d-8d5b-6c5c9690b8d8 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:43.577612 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-af4d1cae-bcfb-494d-8d5b-6c5c9690b8d8 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:43.593296 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-af4d1cae-bcfb-494d-8d5b-6c5c9690b8d8 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:43.593850 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-af4d1cae-bcfb-494d-8d5b-6c5c9690b8d8 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:43.722224 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-110234d6-f4cc-4ce6-8809-21e7c1bea297 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:43.723391 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-110234d6-f4cc-4ce6-8809-21e7c1bea297 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: ac9da5d0-c534-4955-b148-f401c9308618] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:43.731437 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-110234d6-f4cc-4ce6-8809-21e7c1bea297 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:43.732174 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-110234d6-f4cc-4ce6-8809-21e7c1bea297 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:43.732807 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-110234d6-f4cc-4ce6-8809-21e7c1bea297 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:43.733685 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-110234d6-f4cc-4ce6-8809-21e7c1bea297 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:43.734335 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-110234d6-f4cc-4ce6-8809-21e7c1bea297 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:43.734920 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-110234d6-f4cc-4ce6-8809-21e7c1bea297 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:44.082152 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-110234d6-f4cc-4ce6-8809-21e7c1bea297 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:44.098939 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-110234d6-f4cc-4ce6-8809-21e7c1bea297 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/ac9da5d0-c534-4955-b148-f401c9308618" status: 200 len: 1512 microversion: 2.1 time: 0.382522 Oct 27 03:41:44.101574 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2298/4892] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:41:43 2022] GET /compute/v2.1/servers/ac9da5d0-c534-4955-b148-f401c9308618 => generated 1512 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:41:44.106205 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d4cac46c-becf-458f-9a37-1c5f3a953b3c tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:44.106846 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d4cac46c-becf-458f-9a37-1c5f3a953b3c tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: c9e02344-a91a-40c8-b8c0-c0abe503204c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:44.122904 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d4cac46c-becf-458f-9a37-1c5f3a953b3c tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:44.124376 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d4cac46c-becf-458f-9a37-1c5f3a953b3c tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:44.124376 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d4cac46c-becf-458f-9a37-1c5f3a953b3c tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:44.124699 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d4cac46c-becf-458f-9a37-1c5f3a953b3c tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:44.125164 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d4cac46c-becf-458f-9a37-1c5f3a953b3c tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:44.125730 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d4cac46c-becf-458f-9a37-1c5f3a953b3c tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:44.238854 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d4cac46c-becf-458f-9a37-1c5f3a953b3c tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:44.256208 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d4cac46c-becf-458f-9a37-1c5f3a953b3c tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c" status: 200 len: 1279 microversion: 2.1 time: 0.155266 Oct 27 03:41:44.270623 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2299/4893] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:41:44 2022] GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c => generated 1279 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:41:44.328054 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-af4d1cae-bcfb-494d-8d5b-6c5c9690b8d8 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffc2b1c410149e884a47240b5425e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38450368ef5c4e68ac3c19c7a0a1ce65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:44.343802 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-af4d1cae-bcfb-494d-8d5b-6c5c9690b8d8 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b" status: 200 len: 1665 microversion: 2.1 time: 0.787960 Oct 27 03:41:44.345715 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2595/4894] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:41:43 2022] GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b => generated 1665 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:41:44.509165 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a530f375-b69b-4844-ab84-1c0e8d51ca58 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:44.510143 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a530f375-b69b-4844-ab84-1c0e8d51ca58 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:44.530258 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a530f375-b69b-4844-ab84-1c0e8d51ca58 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:44.532555 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a530f375-b69b-4844-ab84-1c0e8d51ca58 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:44.535072 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a530f375-b69b-4844-ab84-1c0e8d51ca58 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:44.538402 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a530f375-b69b-4844-ab84-1c0e8d51ca58 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:44.540465 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a530f375-b69b-4844-ab84-1c0e8d51ca58 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:44.550150 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a530f375-b69b-4844-ab84-1c0e8d51ca58 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:45.130637 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-bcd52803-6772-48fb-bd1c-5e6ed336ac48 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:45.132818 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-bcd52803-6772-48fb-bd1c-5e6ed336ac48 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: ac9da5d0-c534-4955-b148-f401c9308618] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:45.155975 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bcd52803-6772-48fb-bd1c-5e6ed336ac48 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:45.158258 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bcd52803-6772-48fb-bd1c-5e6ed336ac48 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:45.172375 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bcd52803-6772-48fb-bd1c-5e6ed336ac48 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:45.175194 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bcd52803-6772-48fb-bd1c-5e6ed336ac48 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:45.177525 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bcd52803-6772-48fb-bd1c-5e6ed336ac48 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:45.180430 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bcd52803-6772-48fb-bd1c-5e6ed336ac48 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:45.468096 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a530f375-b69b-4844-ab84-1c0e8d51ca58 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:45.493041 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a530f375-b69b-4844-ab84-1c0e8d51ca58 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:45.496092 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a530f375-b69b-4844-ab84-1c0e8d51ca58 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:45.497695 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a530f375-b69b-4844-ab84-1c0e8d51ca58 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79" status: 200 len: 1808 microversion: 2.20 time: 0.997594 Oct 27 03:41:45.498858 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2300/4895] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:41:44 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 => generated 1808 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:41:45.537646 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3a824f53-3f11-4f78-85f5-a488e608b8ff tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:45.537646 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-3a824f53-3f11-4f78-85f5-a488e608b8ff tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: c9e02344-a91a-40c8-b8c0-c0abe503204c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:45.537646 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3a824f53-3f11-4f78-85f5-a488e608b8ff tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:45.537646 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3a824f53-3f11-4f78-85f5-a488e608b8ff tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:45.537646 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3a824f53-3f11-4f78-85f5-a488e608b8ff tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:45.537646 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3a824f53-3f11-4f78-85f5-a488e608b8ff tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:45.537646 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3a824f53-3f11-4f78-85f5-a488e608b8ff tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:45.537646 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3a824f53-3f11-4f78-85f5-a488e608b8ff tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:45.548415 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=100 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:41:45.559757 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:41:45.709851 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-bcd52803-6772-48fb-bd1c-5e6ed336ac48 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:45.723323 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-bcd52803-6772-48fb-bd1c-5e6ed336ac48 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/ac9da5d0-c534-4955-b148-f401c9308618" status: 200 len: 1512 microversion: 2.1 time: 0.598907 Oct 27 03:41:45.724426 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2596/4896] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:41:45 2022] GET /compute/v2.1/servers/ac9da5d0-c534-4955-b148-f401c9308618 => generated 1512 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:41:45.734571 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-668ab3bb-455c-4386-9e3a-4717b0da9ab1 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:45.739067 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-668ab3bb-455c-4386-9e3a-4717b0da9ab1 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:45.758651 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-668ab3bb-455c-4386-9e3a-4717b0da9ab1 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:45.762301 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-668ab3bb-455c-4386-9e3a-4717b0da9ab1 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:45.762301 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-668ab3bb-455c-4386-9e3a-4717b0da9ab1 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:45.762301 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-668ab3bb-455c-4386-9e3a-4717b0da9ab1 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:45.762576 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-668ab3bb-455c-4386-9e3a-4717b0da9ab1 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:45.762834 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-668ab3bb-455c-4386-9e3a-4717b0da9ab1 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:46.163998 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-3a824f53-3f11-4f78-85f5-a488e608b8ff tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:46.179665 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3a824f53-3f11-4f78-85f5-a488e608b8ff tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c" status: 200 len: 1321 microversion: 2.1 time: 0.679463 Oct 27 03:41:46.180281 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2301/4897] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:41:45 2022] GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c => generated 1321 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:41:46.191570 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5444cd05-afa0-4630-94a1-4448d201b0de tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:46.196461 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5444cd05-afa0-4630-94a1-4448d201b0de tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: 003c8652-2a85-4abc-8f02-ff46b4afcfd1] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:46.204806 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5444cd05-afa0-4630-94a1-4448d201b0de tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:46.205838 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5444cd05-afa0-4630-94a1-4448d201b0de tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:46.206533 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5444cd05-afa0-4630-94a1-4448d201b0de tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:46.217215 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5444cd05-afa0-4630-94a1-4448d201b0de tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:46.218169 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5444cd05-afa0-4630-94a1-4448d201b0de tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:46.219112 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5444cd05-afa0-4630-94a1-4448d201b0de tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:46.283465 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5444cd05-afa0-4630-94a1-4448d201b0de tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/003c8652-2a85-4abc-8f02-ff46b4afcfd1/ips" status: 200 len: 149 microversion: 2.1 time: 0.102103 Oct 27 03:41:46.284914 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2302/4898] 10.222.0.20 () {58 vars in 1248 bytes} [Thu Oct 27 03:41:46 2022] GET /compute/v2.1/servers/003c8652-2a85-4abc-8f02-ff46b4afcfd1/ips => generated 149 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:41:46.528149 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1d1cba0e-a6e2-4b79-9d36-5ff143962026 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:46.529787 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1d1cba0e-a6e2-4b79-9d36-5ff143962026 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:46.539296 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1d1cba0e-a6e2-4b79-9d36-5ff143962026 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:46.546540 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1d1cba0e-a6e2-4b79-9d36-5ff143962026 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:46.546540 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1d1cba0e-a6e2-4b79-9d36-5ff143962026 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:46.546540 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1d1cba0e-a6e2-4b79-9d36-5ff143962026 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:46.546540 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1d1cba0e-a6e2-4b79-9d36-5ff143962026 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:46.546540 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1d1cba0e-a6e2-4b79-9d36-5ff143962026 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:46.784091 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-668ab3bb-455c-4386-9e3a-4717b0da9ab1 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffc2b1c410149e884a47240b5425e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38450368ef5c4e68ac3c19c7a0a1ce65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:46.812354 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-668ab3bb-455c-4386-9e3a-4717b0da9ab1 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b" status: 200 len: 1669 microversion: 2.1 time: 1.086363 Oct 27 03:41:46.813855 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2597/4899] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:41:45 2022] GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b => generated 1669 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:41:46.921614 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1d1cba0e-a6e2-4b79-9d36-5ff143962026 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:46.934473 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:41:46.940599 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1d1cba0e-a6e2-4b79-9d36-5ff143962026 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:46.949473 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1d1cba0e-a6e2-4b79-9d36-5ff143962026 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:46.949473 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1d1cba0e-a6e2-4b79-9d36-5ff143962026 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79" status: 200 len: 1808 microversion: 2.20 time: 0.422938 Oct 27 03:41:46.949473 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2303/4900] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:41:46 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 => generated 1808 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:41:46.951076 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-cb568b50-b5c9-4508-be67-c3291e4b768b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:46.952015 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-cb568b50-b5c9-4508-be67-c3291e4b768b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: ac9da5d0-c534-4955-b148-f401c9308618] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:46.968432 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cb568b50-b5c9-4508-be67-c3291e4b768b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:46.968921 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cb568b50-b5c9-4508-be67-c3291e4b768b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:46.969552 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cb568b50-b5c9-4508-be67-c3291e4b768b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:46.970499 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cb568b50-b5c9-4508-be67-c3291e4b768b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:46.971131 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cb568b50-b5c9-4508-be67-c3291e4b768b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:46.971917 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cb568b50-b5c9-4508-be67-c3291e4b768b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:47.242678 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-1d58016e-a026-49fb-964f-04ca62016d92 req-5e39fda3-5e81-4f74-948b-b7c6c9ea7f9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dda902a6-dcad-42bf-9b3c-ed716ea0af70", "tag": "9a88e217-8a33-468a-a33d-1530420fa236"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:41:47.260950 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-1d58016e-a026-49fb-964f-04ca62016d92 req-5e39fda3-5e81-4f74-948b-b7c6c9ea7f9c service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:47.262422 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-1d58016e-a026-49fb-964f-04ca62016d92 req-5e39fda3-5e81-4f74-948b-b7c6c9ea7f9c service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:47.263109 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-1d58016e-a026-49fb-964f-04ca62016d92 req-5e39fda3-5e81-4f74-948b-b7c6c9ea7f9c service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:47.303271 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=8 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:41:47.307867 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-1d58016e-a026-49fb-964f-04ca62016d92 req-5e39fda3-5e81-4f74-948b-b7c6c9ea7f9c service nova] Creating event network-changed:9a88e217-8a33-468a-a33d-1530420fa236 for instance dda902a6-dcad-42bf-9b3c-ed716ea0af70 on n-h1-862769-1 Oct 27 03:41:47.314277 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-1d58016e-a026-49fb-964f-04ca62016d92 req-5e39fda3-5e81-4f74-948b-b7c6c9ea7f9c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.498717 Oct 27 03:41:47.315269 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2598/4901] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:41:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:41:47.322613 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-318d70fe-c64d-44b0-a32f-4c90e0bd9768 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:47.323341 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-318d70fe-c64d-44b0-a32f-4c90e0bd9768 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: c9e02344-a91a-40c8-b8c0-c0abe503204c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:47.330202 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-318d70fe-c64d-44b0-a32f-4c90e0bd9768 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:47.330957 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-318d70fe-c64d-44b0-a32f-4c90e0bd9768 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:47.337360 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-318d70fe-c64d-44b0-a32f-4c90e0bd9768 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:47.337360 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-318d70fe-c64d-44b0-a32f-4c90e0bd9768 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:47.337360 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-318d70fe-c64d-44b0-a32f-4c90e0bd9768 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:47.337360 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-318d70fe-c64d-44b0-a32f-4c90e0bd9768 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:47.434653 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-cb568b50-b5c9-4508-be67-c3291e4b768b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:47.448582 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-cb568b50-b5c9-4508-be67-c3291e4b768b tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/ac9da5d0-c534-4955-b148-f401c9308618" status: 200 len: 1512 microversion: 2.1 time: 0.501560 Oct 27 03:41:47.449493 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2304/4902] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:41:46 2022] GET /compute/v2.1/servers/ac9da5d0-c534-4955-b148-f401c9308618 => generated 1512 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:41:47.692349 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-318d70fe-c64d-44b0-a32f-4c90e0bd9768 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:47.703917 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:41:47.706823 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-318d70fe-c64d-44b0-a32f-4c90e0bd9768 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c" status: 200 len: 1321 microversion: 2.1 time: 0.390197 Oct 27 03:41:47.708055 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2599/4903] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:41:47 2022] GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c => generated 1321 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:41:47.973096 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c58d8b21-3db1-4c03-98ae-a5f516f765f9 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:47.973767 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c58d8b21-3db1-4c03-98ae-a5f516f765f9 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:47.989026 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c58d8b21-3db1-4c03-98ae-a5f516f765f9 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:47.989542 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c58d8b21-3db1-4c03-98ae-a5f516f765f9 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:48.002813 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c58d8b21-3db1-4c03-98ae-a5f516f765f9 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:48.003626 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c58d8b21-3db1-4c03-98ae-a5f516f765f9 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:48.004119 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c58d8b21-3db1-4c03-98ae-a5f516f765f9 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:48.004568 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c58d8b21-3db1-4c03-98ae-a5f516f765f9 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:48.049046 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-f3a12a0d-ec79-42a6-baaa-0a88b1fedd5b req-0bd4d3e8-f19b-4a9d-a8f5-cf202afc082c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9e02344-a91a-40c8-b8c0-c0abe503204c", "tag": "e157ee23-ea0e-4581-bdfe-c2587fb6895a"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:41:48.075970 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-f3a12a0d-ec79-42a6-baaa-0a88b1fedd5b req-0bd4d3e8-f19b-4a9d-a8f5-cf202afc082c service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:48.077004 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-f3a12a0d-ec79-42a6-baaa-0a88b1fedd5b req-0bd4d3e8-f19b-4a9d-a8f5-cf202afc082c service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:48.077913 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-f3a12a0d-ec79-42a6-baaa-0a88b1fedd5b req-0bd4d3e8-f19b-4a9d-a8f5-cf202afc082c service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:48.111698 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-f3a12a0d-ec79-42a6-baaa-0a88b1fedd5b req-0bd4d3e8-f19b-4a9d-a8f5-cf202afc082c service nova] Creating event network-changed:e157ee23-ea0e-4581-bdfe-c2587fb6895a for instance c9e02344-a91a-40c8-b8c0-c0abe503204c on n-h1-862769-1 Oct 27 03:41:48.121533 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-f3a12a0d-ec79-42a6-baaa-0a88b1fedd5b req-0bd4d3e8-f19b-4a9d-a8f5-cf202afc082c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.338653 Oct 27 03:41:48.122557 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2305/4904] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:41:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:41:48.212618 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c58d8b21-3db1-4c03-98ae-a5f516f765f9 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:48.225017 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c58d8b21-3db1-4c03-98ae-a5f516f765f9 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:48.227078 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c58d8b21-3db1-4c03-98ae-a5f516f765f9 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:48.236422 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c58d8b21-3db1-4c03-98ae-a5f516f765f9 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79" status: 200 len: 1808 microversion: 2.20 time: 0.267178 Oct 27 03:41:48.237569 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2600/4905] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:41:47 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 => generated 1808 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:41:48.476616 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c8fa90b1-8c18-496b-84ed-1f7caa490f76 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:48.478541 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c8fa90b1-8c18-496b-84ed-1f7caa490f76 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: ac9da5d0-c534-4955-b148-f401c9308618] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:48.489551 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=10 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:41:48.492870 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c8fa90b1-8c18-496b-84ed-1f7caa490f76 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:48.493726 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c8fa90b1-8c18-496b-84ed-1f7caa490f76 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:48.494658 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c8fa90b1-8c18-496b-84ed-1f7caa490f76 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:48.495871 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c8fa90b1-8c18-496b-84ed-1f7caa490f76 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:48.496536 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c8fa90b1-8c18-496b-84ed-1f7caa490f76 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:48.497454 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c8fa90b1-8c18-496b-84ed-1f7caa490f76 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:48.736567 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-852fab54-0401-4b3f-8a7c-85b08b21e65e tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:48.737730 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-852fab54-0401-4b3f-8a7c-85b08b21e65e tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: c9e02344-a91a-40c8-b8c0-c0abe503204c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:48.745520 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-852fab54-0401-4b3f-8a7c-85b08b21e65e tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:48.746428 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-852fab54-0401-4b3f-8a7c-85b08b21e65e tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:48.747299 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-852fab54-0401-4b3f-8a7c-85b08b21e65e tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:48.748586 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-852fab54-0401-4b3f-8a7c-85b08b21e65e tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:48.749318 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-852fab54-0401-4b3f-8a7c-85b08b21e65e tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:48.749985 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-852fab54-0401-4b3f-8a7c-85b08b21e65e tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:48.810881 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c8fa90b1-8c18-496b-84ed-1f7caa490f76 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:48.833773 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c8fa90b1-8c18-496b-84ed-1f7caa490f76 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/ac9da5d0-c534-4955-b148-f401c9308618" status: 200 len: 1512 microversion: 2.1 time: 0.362440 Oct 27 03:41:48.839031 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2306/4906] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:41:48 2022] GET /compute/v2.1/servers/ac9da5d0-c534-4955-b148-f401c9308618 => generated 1512 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:41:49.007559 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-852fab54-0401-4b3f-8a7c-85b08b21e65e tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:49.017880 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-852fab54-0401-4b3f-8a7c-85b08b21e65e tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c" status: 200 len: 1321 microversion: 2.1 time: 0.285484 Oct 27 03:41:49.027452 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2601/4907] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:41:48 2022] GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c => generated 1321 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:41:49.285741 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c4c60dd2-ad87-422b-8a55-ab4c8285743e tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:49.292180 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c4c60dd2-ad87-422b-8a55-ab4c8285743e tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:49.328817 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c4c60dd2-ad87-422b-8a55-ab4c8285743e tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:49.337267 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c4c60dd2-ad87-422b-8a55-ab4c8285743e tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:49.341052 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c4c60dd2-ad87-422b-8a55-ab4c8285743e tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:49.344772 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c4c60dd2-ad87-422b-8a55-ab4c8285743e tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:49.353273 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c4c60dd2-ad87-422b-8a55-ab4c8285743e tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:49.354430 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c4c60dd2-ad87-422b-8a55-ab4c8285743e tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:49.448635 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9e7c025a-b2e3-4f1b-a919-cb35d9105398 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "055d1b24-414d-4236-98b9-6ed4dbd62c1b"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:41:49.451716 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-9e7c025a-b2e3-4f1b-a919-cb35d9105398 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: 003c8652-2a85-4abc-8f02-ff46b4afcfd1] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:49.464443 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9e7c025a-b2e3-4f1b-a919-cb35d9105398 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:49.464443 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9e7c025a-b2e3-4f1b-a919-cb35d9105398 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:49.464443 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9e7c025a-b2e3-4f1b-a919-cb35d9105398 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:49.464443 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9e7c025a-b2e3-4f1b-a919-cb35d9105398 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:49.469412 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9e7c025a-b2e3-4f1b-a919-cb35d9105398 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:49.470489 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9e7c025a-b2e3-4f1b-a919-cb35d9105398 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:50.067179 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c4c60dd2-ad87-422b-8a55-ab4c8285743e tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:50.088064 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c4c60dd2-ad87-422b-8a55-ab4c8285743e tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:50.091902 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c4c60dd2-ad87-422b-8a55-ab4c8285743e tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:50.098060 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c4c60dd2-ad87-422b-8a55-ab4c8285743e tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79" status: 200 len: 1808 microversion: 2.20 time: 0.832007 Oct 27 03:41:50.098060 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2307/4908] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:41:49 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 => generated 1808 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:41:50.114250 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e93366f6-e45a-4dd5-aaa9-effdc090a3cd tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:50.115247 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e93366f6-e45a-4dd5-aaa9-effdc090a3cd tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: ac9da5d0-c534-4955-b148-f401c9308618] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:50.126790 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e93366f6-e45a-4dd5-aaa9-effdc090a3cd tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:50.126790 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e93366f6-e45a-4dd5-aaa9-effdc090a3cd tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:50.126790 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e93366f6-e45a-4dd5-aaa9-effdc090a3cd tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:50.126790 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e93366f6-e45a-4dd5-aaa9-effdc090a3cd tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:50.134097 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e93366f6-e45a-4dd5-aaa9-effdc090a3cd tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:50.135868 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e93366f6-e45a-4dd5-aaa9-effdc090a3cd tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:50.557839 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9e7c025a-b2e3-4f1b-a919-cb35d9105398 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "POST /compute/v2.1/servers/003c8652-2a85-4abc-8f02-ff46b4afcfd1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.112888 Oct 27 03:41:50.560780 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2602/4909] 10.222.0.20 () {60 vars in 1323 bytes} [Thu Oct 27 03:41:49 2022] POST /compute/v2.1/servers/003c8652-2a85-4abc-8f02-ff46b4afcfd1/os-volume_attachments => generated 194 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:41:50.580680 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-67d4b921-44d8-459e-9082-5f94c135d9a1 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:50.588331 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-67d4b921-44d8-459e-9082-5f94c135d9a1 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: c9e02344-a91a-40c8-b8c0-c0abe503204c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:50.606249 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-67d4b921-44d8-459e-9082-5f94c135d9a1 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:50.607942 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-67d4b921-44d8-459e-9082-5f94c135d9a1 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:50.608952 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-67d4b921-44d8-459e-9082-5f94c135d9a1 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:50.610122 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-67d4b921-44d8-459e-9082-5f94c135d9a1 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:50.610760 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-67d4b921-44d8-459e-9082-5f94c135d9a1 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:50.611430 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-67d4b921-44d8-459e-9082-5f94c135d9a1 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:50.965335 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e93366f6-e45a-4dd5-aaa9-effdc090a3cd tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:50.982399 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e93366f6-e45a-4dd5-aaa9-effdc090a3cd tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/ac9da5d0-c534-4955-b148-f401c9308618" status: 200 len: 1512 microversion: 2.1 time: 0.886518 Oct 27 03:41:51.004956 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2308/4910] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:41:50 2022] GET /compute/v2.1/servers/ac9da5d0-c534-4955-b148-f401c9308618 => generated 1512 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:41:51.015400 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-67d4b921-44d8-459e-9082-5f94c135d9a1 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:51.057612 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-67d4b921-44d8-459e-9082-5f94c135d9a1 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c" status: 200 len: 1321 microversion: 2.1 time: 0.486683 Oct 27 03:41:51.076840 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2603/4911] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:41:50 2022] GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c => generated 1321 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:41:51.125084 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c21b835f-77d3-47e1-94f8-15bd12e37efc tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:51.126075 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c21b835f-77d3-47e1-94f8-15bd12e37efc tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:51.137041 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c21b835f-77d3-47e1-94f8-15bd12e37efc tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:51.137973 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c21b835f-77d3-47e1-94f8-15bd12e37efc tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:51.140969 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c21b835f-77d3-47e1-94f8-15bd12e37efc tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:51.141757 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c21b835f-77d3-47e1-94f8-15bd12e37efc tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:51.142270 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c21b835f-77d3-47e1-94f8-15bd12e37efc tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:51.142717 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c21b835f-77d3-47e1-94f8-15bd12e37efc tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:52.067787 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-4e2f8b9c-ac02-49ac-af18-4433646c9cc1 req-c19972b2-286c-42cd-aa3e-a800bedc4a81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dda902a6-dcad-42bf-9b3c-ed716ea0af70", "name": "network-vif-plugged", "status": "completed", "tag": "9a88e217-8a33-468a-a33d-1530420fa236"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:41:52.089528 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-4e2f8b9c-ac02-49ac-af18-4433646c9cc1 req-c19972b2-286c-42cd-aa3e-a800bedc4a81 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:52.093327 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-4e2f8b9c-ac02-49ac-af18-4433646c9cc1 req-c19972b2-286c-42cd-aa3e-a800bedc4a81 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:52.094787 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-4e2f8b9c-ac02-49ac-af18-4433646c9cc1 req-c19972b2-286c-42cd-aa3e-a800bedc4a81 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:52.109455 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-4e2f8b9c-ac02-49ac-af18-4433646c9cc1 req-c19972b2-286c-42cd-aa3e-a800bedc4a81 service nova] Creating event network-vif-plugged:9a88e217-8a33-468a-a33d-1530420fa236 for instance dda902a6-dcad-42bf-9b3c-ed716ea0af70 on n-h1-862769-1 Oct 27 03:41:52.115694 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-4e2f8b9c-ac02-49ac-af18-4433646c9cc1 req-c19972b2-286c-42cd-aa3e-a800bedc4a81 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.573557 Oct 27 03:41:52.116876 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2604/4912] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:41:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:41:52.124034 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5826cf0e-dea6-4c25-b1f8-11c8a803eb75 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:52.125060 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5826cf0e-dea6-4c25-b1f8-11c8a803eb75 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: ac9da5d0-c534-4955-b148-f401c9308618] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:52.132698 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5826cf0e-dea6-4c25-b1f8-11c8a803eb75 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:52.133727 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5826cf0e-dea6-4c25-b1f8-11c8a803eb75 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:52.134669 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5826cf0e-dea6-4c25-b1f8-11c8a803eb75 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:52.145431 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5826cf0e-dea6-4c25-b1f8-11c8a803eb75 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:52.146885 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5826cf0e-dea6-4c25-b1f8-11c8a803eb75 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:52.181597 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5826cf0e-dea6-4c25-b1f8-11c8a803eb75 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:52.310497 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c21b835f-77d3-47e1-94f8-15bd12e37efc tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:52.325345 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c21b835f-77d3-47e1-94f8-15bd12e37efc tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:52.336090 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c21b835f-77d3-47e1-94f8-15bd12e37efc tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:52.342945 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c21b835f-77d3-47e1-94f8-15bd12e37efc tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79" status: 200 len: 1808 microversion: 2.20 time: 1.222873 Oct 27 03:41:52.372330 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2309/4913] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:41:51 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 => generated 1808 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:41:52.388547 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-464a9613-a1ca-4cbd-90de-c99a2ad41c46 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:52.389176 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-464a9613-a1ca-4cbd-90de-c99a2ad41c46 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: c9e02344-a91a-40c8-b8c0-c0abe503204c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:52.415446 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-464a9613-a1ca-4cbd-90de-c99a2ad41c46 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:52.415945 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-464a9613-a1ca-4cbd-90de-c99a2ad41c46 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:52.416458 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-464a9613-a1ca-4cbd-90de-c99a2ad41c46 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:52.417269 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-464a9613-a1ca-4cbd-90de-c99a2ad41c46 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:52.428832 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-464a9613-a1ca-4cbd-90de-c99a2ad41c46 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:52.429349 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-464a9613-a1ca-4cbd-90de-c99a2ad41c46 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:52.691214 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-464a9613-a1ca-4cbd-90de-c99a2ad41c46 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:52.699335 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-464a9613-a1ca-4cbd-90de-c99a2ad41c46 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c" status: 200 len: 1321 microversion: 2.1 time: 0.324072 Oct 27 03:41:52.700353 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5826cf0e-dea6-4c25-b1f8-11c8a803eb75 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:52.714117 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2310/4914] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:41:52 2022] GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c => generated 1321 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:41:52.723815 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5826cf0e-dea6-4c25-b1f8-11c8a803eb75 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/ac9da5d0-c534-4955-b148-f401c9308618" status: 200 len: 1489 microversion: 2.1 time: 0.605409 Oct 27 03:41:52.734905 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2605/4915] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:41:52 2022] GET /compute/v2.1/servers/ac9da5d0-c534-4955-b148-f401c9308618 => generated 1489 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:41:52.753944 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-aa491a29-6a75-45cf-b0db-ea55e3a87967 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:52.754526 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-aa491a29-6a75-45cf-b0db-ea55e3a87967 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: ac9da5d0-c534-4955-b148-f401c9308618] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:52.761773 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aa491a29-6a75-45cf-b0db-ea55e3a87967 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:52.762492 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aa491a29-6a75-45cf-b0db-ea55e3a87967 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:52.762995 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aa491a29-6a75-45cf-b0db-ea55e3a87967 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:52.764370 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aa491a29-6a75-45cf-b0db-ea55e3a87967 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:52.765055 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aa491a29-6a75-45cf-b0db-ea55e3a87967 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:52.765523 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aa491a29-6a75-45cf-b0db-ea55e3a87967 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:52.809839 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-aa491a29-6a75-45cf-b0db-ea55e3a87967 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: ac9da5d0-c534-4955-b148-f401c9308618] Going to try to terminate instance {{(pid=121000) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:41:53.199605 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-aa491a29-6a75-45cf-b0db-ea55e3a87967 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ac9da5d0-c534-4955-b148-f401c9308618" status: 204 len: 0 microversion: 2.1 time: 0.450785 Oct 27 03:41:53.200362 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2311/4916] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:41:52 2022] DELETE /compute/v2.1/servers/ac9da5d0-c534-4955-b148-f401c9308618 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:41:53.208809 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-84eb77ac-651f-4f15-8d7f-f49125d12da7 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:53.210474 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-84eb77ac-651f-4f15-8d7f-f49125d12da7 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: ac9da5d0-c534-4955-b148-f401c9308618] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:53.217520 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-84eb77ac-651f-4f15-8d7f-f49125d12da7 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:53.218358 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-84eb77ac-651f-4f15-8d7f-f49125d12da7 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:53.219037 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-84eb77ac-651f-4f15-8d7f-f49125d12da7 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:53.219922 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-84eb77ac-651f-4f15-8d7f-f49125d12da7 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:53.220601 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-84eb77ac-651f-4f15-8d7f-f49125d12da7 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:53.221151 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-84eb77ac-651f-4f15-8d7f-f49125d12da7 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:53.378799 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-fa823ec3-69e2-4a3c-8447-e0dcb99c91d3 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:53.379409 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-fa823ec3-69e2-4a3c-8447-e0dcb99c91d3 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:53.388005 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fa823ec3-69e2-4a3c-8447-e0dcb99c91d3 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:53.388725 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fa823ec3-69e2-4a3c-8447-e0dcb99c91d3 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:53.389320 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fa823ec3-69e2-4a3c-8447-e0dcb99c91d3 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:53.390214 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fa823ec3-69e2-4a3c-8447-e0dcb99c91d3 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:53.390855 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fa823ec3-69e2-4a3c-8447-e0dcb99c91d3 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:53.391430 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fa823ec3-69e2-4a3c-8447-e0dcb99c91d3 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:53.462578 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-84eb77ac-651f-4f15-8d7f-f49125d12da7 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:53.487833 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-84eb77ac-651f-4f15-8d7f-f49125d12da7 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/ac9da5d0-c534-4955-b148-f401c9308618" status: 200 len: 1495 microversion: 2.1 time: 0.279650 Oct 27 03:41:53.490158 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2606/4917] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:41:53 2022] GET /compute/v2.1/servers/ac9da5d0-c534-4955-b148-f401c9308618 => generated 1495 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:41:53.670292 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-fa823ec3-69e2-4a3c-8447-e0dcb99c91d3 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:53.694731 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-fa823ec3-69e2-4a3c-8447-e0dcb99c91d3 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:53.700937 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-fa823ec3-69e2-4a3c-8447-e0dcb99c91d3 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:53.705457 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-fa823ec3-69e2-4a3c-8447-e0dcb99c91d3 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79" status: 200 len: 1808 microversion: 2.20 time: 0.328561 Oct 27 03:41:53.719964 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2312/4918] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:41:53 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 => generated 1808 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:41:53.723682 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3f7c24a4-ea7b-4dbf-a496-a1472f975e30 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:53.724311 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3f7c24a4-ea7b-4dbf-a496-a1472f975e30 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: c9e02344-a91a-40c8-b8c0-c0abe503204c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:53.734949 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3f7c24a4-ea7b-4dbf-a496-a1472f975e30 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:53.735448 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3f7c24a4-ea7b-4dbf-a496-a1472f975e30 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:53.735898 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3f7c24a4-ea7b-4dbf-a496-a1472f975e30 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:53.736615 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3f7c24a4-ea7b-4dbf-a496-a1472f975e30 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:53.737073 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3f7c24a4-ea7b-4dbf-a496-a1472f975e30 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:53.737504 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3f7c24a4-ea7b-4dbf-a496-a1472f975e30 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:54.076042 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3f7c24a4-ea7b-4dbf-a496-a1472f975e30 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:54.088891 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3f7c24a4-ea7b-4dbf-a496-a1472f975e30 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c" status: 200 len: 1321 microversion: 2.1 time: 0.368797 Oct 27 03:41:54.090408 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2607/4919] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:41:53 2022] GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c => generated 1321 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:41:54.517537 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7bd58193-e373-4c44-92f9-4578c366136c tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:54.518373 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7bd58193-e373-4c44-92f9-4578c366136c tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: ac9da5d0-c534-4955-b148-f401c9308618] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:54.532034 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7bd58193-e373-4c44-92f9-4578c366136c tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:54.534496 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7bd58193-e373-4c44-92f9-4578c366136c tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:54.535878 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7bd58193-e373-4c44-92f9-4578c366136c tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:54.538506 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7bd58193-e373-4c44-92f9-4578c366136c tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:54.540260 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7bd58193-e373-4c44-92f9-4578c366136c tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:54.542006 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7bd58193-e373-4c44-92f9-4578c366136c tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:54.745504 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2ed4bab1-3a0b-4d8f-80ba-237f90c5c771 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:54.746159 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2ed4bab1-3a0b-4d8f-80ba-237f90c5c771 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:54.771619 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2ed4bab1-3a0b-4d8f-80ba-237f90c5c771 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:54.772960 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2ed4bab1-3a0b-4d8f-80ba-237f90c5c771 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:54.773676 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2ed4bab1-3a0b-4d8f-80ba-237f90c5c771 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:54.774596 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2ed4bab1-3a0b-4d8f-80ba-237f90c5c771 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:54.775209 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2ed4bab1-3a0b-4d8f-80ba-237f90c5c771 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:54.775795 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2ed4bab1-3a0b-4d8f-80ba-237f90c5c771 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:54.804418 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7bd58193-e373-4c44-92f9-4578c366136c tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:54.815440 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7bd58193-e373-4c44-92f9-4578c366136c tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/ac9da5d0-c534-4955-b148-f401c9308618" status: 200 len: 1495 microversion: 2.1 time: 0.302150 Oct 27 03:41:54.817139 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2313/4920] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:41:54 2022] GET /compute/v2.1/servers/ac9da5d0-c534-4955-b148-f401c9308618 => generated 1495 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:41:55.114401 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ce009546-d3ca-41d0-8710-3f331656787c tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:55.115089 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ce009546-d3ca-41d0-8710-3f331656787c tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: c9e02344-a91a-40c8-b8c0-c0abe503204c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:55.181426 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ce009546-d3ca-41d0-8710-3f331656787c tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:55.181426 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ce009546-d3ca-41d0-8710-3f331656787c tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:55.181426 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ce009546-d3ca-41d0-8710-3f331656787c tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:55.181426 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ce009546-d3ca-41d0-8710-3f331656787c tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:55.181426 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ce009546-d3ca-41d0-8710-3f331656787c tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:55.181426 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ce009546-d3ca-41d0-8710-3f331656787c tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:55.394164 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2ed4bab1-3a0b-4d8f-80ba-237f90c5c771 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:55.406987 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2ed4bab1-3a0b-4d8f-80ba-237f90c5c771 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:55.408948 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2ed4bab1-3a0b-4d8f-80ba-237f90c5c771 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:55.436124 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2ed4bab1-3a0b-4d8f-80ba-237f90c5c771 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79" status: 200 len: 1808 microversion: 2.20 time: 0.698990 Oct 27 03:41:55.441808 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2608/4921] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:41:54 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 => generated 1808 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:41:55.610691 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ce009546-d3ca-41d0-8710-3f331656787c tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:55.628282 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ce009546-d3ca-41d0-8710-3f331656787c tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c" status: 200 len: 1321 microversion: 2.1 time: 0.519478 Oct 27 03:41:55.636727 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2314/4922] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:41:55 2022] GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c => generated 1321 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:41:55.842777 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-41498e2d-2030-46fa-a4f1-9fa669ae2185 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:55.844659 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-41498e2d-2030-46fa-a4f1-9fa669ae2185 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: ac9da5d0-c534-4955-b148-f401c9308618] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:55.858596 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-41498e2d-2030-46fa-a4f1-9fa669ae2185 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:55.862383 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-41498e2d-2030-46fa-a4f1-9fa669ae2185 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:55.864222 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-41498e2d-2030-46fa-a4f1-9fa669ae2185 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:55.865164 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-41498e2d-2030-46fa-a4f1-9fa669ae2185 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:55.867625 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-41498e2d-2030-46fa-a4f1-9fa669ae2185 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:55.869894 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-41498e2d-2030-46fa-a4f1-9fa669ae2185 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:55.940964 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-1eb3169b-42fe-49fb-a1f5-1c9c4eab97b3 req-4eb808db-90a7-4b98-85d4-f06ed02b48fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac9da5d0-c534-4955-b148-f401c9308618", "name": "network-vif-deleted", "tag": "d3a712e1-7d9c-409f-a8fb-730e54622d49"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:41:55.969645 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-1eb3169b-42fe-49fb-a1f5-1c9c4eab97b3 req-4eb808db-90a7-4b98-85d4-f06ed02b48fa service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:55.970182 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-1eb3169b-42fe-49fb-a1f5-1c9c4eab97b3 req-4eb808db-90a7-4b98-85d4-f06ed02b48fa service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:55.970667 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-1eb3169b-42fe-49fb-a1f5-1c9c4eab97b3 req-4eb808db-90a7-4b98-85d4-f06ed02b48fa service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:56.009907 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-1eb3169b-42fe-49fb-a1f5-1c9c4eab97b3 req-4eb808db-90a7-4b98-85d4-f06ed02b48fa service nova] Creating event network-vif-deleted:d3a712e1-7d9c-409f-a8fb-730e54622d49 for instance ac9da5d0-c534-4955-b148-f401c9308618 on n-h2-862769-1 Oct 27 03:41:56.018496 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-1eb3169b-42fe-49fb-a1f5-1c9c4eab97b3 req-4eb808db-90a7-4b98-85d4-f06ed02b48fa service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080364 Oct 27 03:41:56.027445 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2315/4923] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:41:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:41:56.088133 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-41498e2d-2030-46fa-a4f1-9fa669ae2185 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:56.096819 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-41498e2d-2030-46fa-a4f1-9fa669ae2185 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/ac9da5d0-c534-4955-b148-f401c9308618" status: 200 len: 1453 microversion: 2.1 time: 0.258733 Oct 27 03:41:56.098105 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2609/4924] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:41:55 2022] GET /compute/v2.1/servers/ac9da5d0-c534-4955-b148-f401c9308618 => generated 1453 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:41:56.476329 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2659717b-c58e-4d38-8c3d-faebb457fc67 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:56.483503 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-2659717b-c58e-4d38-8c3d-faebb457fc67 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:56.484878 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2659717b-c58e-4d38-8c3d-faebb457fc67 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:56.485383 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2659717b-c58e-4d38-8c3d-faebb457fc67 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:56.485832 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2659717b-c58e-4d38-8c3d-faebb457fc67 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:56.486580 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2659717b-c58e-4d38-8c3d-faebb457fc67 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:56.493506 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2659717b-c58e-4d38-8c3d-faebb457fc67 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:56.494276 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2659717b-c58e-4d38-8c3d-faebb457fc67 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:56.660080 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-09722977-81ab-42c1-b810-bfd614ffa2b9 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:56.660736 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-09722977-81ab-42c1-b810-bfd614ffa2b9 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: c9e02344-a91a-40c8-b8c0-c0abe503204c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:56.672657 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-09722977-81ab-42c1-b810-bfd614ffa2b9 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:56.674083 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-09722977-81ab-42c1-b810-bfd614ffa2b9 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:56.680401 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-09722977-81ab-42c1-b810-bfd614ffa2b9 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:56.680401 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-09722977-81ab-42c1-b810-bfd614ffa2b9 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:56.680401 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-09722977-81ab-42c1-b810-bfd614ffa2b9 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:56.680978 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-09722977-81ab-42c1-b810-bfd614ffa2b9 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:56.941538 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-09722977-81ab-42c1-b810-bfd614ffa2b9 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:56.953341 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-09722977-81ab-42c1-b810-bfd614ffa2b9 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c" status: 200 len: 1321 microversion: 2.1 time: 0.305601 Oct 27 03:41:56.955782 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2610/4925] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:41:56 2022] GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c => generated 1321 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:41:57.038774 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2659717b-c58e-4d38-8c3d-faebb457fc67 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:57.048941 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2659717b-c58e-4d38-8c3d-faebb457fc67 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:57.050641 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2659717b-c58e-4d38-8c3d-faebb457fc67 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:57.052111 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2659717b-c58e-4d38-8c3d-faebb457fc67 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79" status: 200 len: 1808 microversion: 2.20 time: 0.580710 Oct 27 03:41:57.053520 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2316/4926] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:41:56 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 => generated 1808 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:41:57.122802 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-709afaf7-b916-41cb-bbd0-5abe678b9228 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:57.123671 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-709afaf7-b916-41cb-bbd0-5abe678b9228 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: ac9da5d0-c534-4955-b148-f401c9308618] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:57.129989 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-709afaf7-b916-41cb-bbd0-5abe678b9228 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:57.130526 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-709afaf7-b916-41cb-bbd0-5abe678b9228 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:57.130974 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-709afaf7-b916-41cb-bbd0-5abe678b9228 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:57.132215 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-709afaf7-b916-41cb-bbd0-5abe678b9228 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:57.132721 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-709afaf7-b916-41cb-bbd0-5abe678b9228 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:57.133161 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-709afaf7-b916-41cb-bbd0-5abe678b9228 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:57.172084 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-709afaf7-b916-41cb-bbd0-5abe678b9228 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:57.172587 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-709afaf7-b916-41cb-bbd0-5abe678b9228 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:57.173186 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-709afaf7-b916-41cb-bbd0-5abe678b9228 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:57.173661 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-709afaf7-b916-41cb-bbd0-5abe678b9228 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lazy-loading 'fault' on Instance uuid ac9da5d0-c534-4955-b148-f401c9308618 {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:41:57.243001 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-709afaf7-b916-41cb-bbd0-5abe678b9228 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:57.257934 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-709afaf7-b916-41cb-bbd0-5abe678b9228 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/ac9da5d0-c534-4955-b148-f401c9308618" status: 200 len: 1305 microversion: 2.1 time: 0.138991 Oct 27 03:41:57.270481 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2611/4927] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:41:57 2022] GET /compute/v2.1/servers/ac9da5d0-c534-4955-b148-f401c9308618 => generated 1305 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:41:57.527317 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-d31fcbef-6a03-4667-a303-1edff92be274 req-263ae54a-ff95-4388-a2b3-fbcc1f47e179 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9e02344-a91a-40c8-b8c0-c0abe503204c", "name": "network-vif-plugged", "status": "completed", "tag": "e157ee23-ea0e-4581-bdfe-c2587fb6895a"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:41:57.534158 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:41:57.538945 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-d31fcbef-6a03-4667-a303-1edff92be274 req-263ae54a-ff95-4388-a2b3-fbcc1f47e179 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:57.539424 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-d31fcbef-6a03-4667-a303-1edff92be274 req-263ae54a-ff95-4388-a2b3-fbcc1f47e179 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:57.539859 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-d31fcbef-6a03-4667-a303-1edff92be274 req-263ae54a-ff95-4388-a2b3-fbcc1f47e179 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:57.553062 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-d31fcbef-6a03-4667-a303-1edff92be274 req-263ae54a-ff95-4388-a2b3-fbcc1f47e179 service nova] Creating event network-vif-plugged:e157ee23-ea0e-4581-bdfe-c2587fb6895a for instance c9e02344-a91a-40c8-b8c0-c0abe503204c on n-h1-862769-1 Oct 27 03:41:57.558685 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-d31fcbef-6a03-4667-a303-1edff92be274 req-263ae54a-ff95-4388-a2b3-fbcc1f47e179 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035034 Oct 27 03:41:57.559658 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2317/4928] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:41:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:41:57.980320 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-037620dc-ff6a-4907-9564-b8ac8dfe6f66 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:57.981603 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-037620dc-ff6a-4907-9564-b8ac8dfe6f66 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: c9e02344-a91a-40c8-b8c0-c0abe503204c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:57.988885 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-037620dc-ff6a-4907-9564-b8ac8dfe6f66 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:57.992680 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-037620dc-ff6a-4907-9564-b8ac8dfe6f66 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:57.992680 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-037620dc-ff6a-4907-9564-b8ac8dfe6f66 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:57.992680 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-037620dc-ff6a-4907-9564-b8ac8dfe6f66 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:57.992680 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-037620dc-ff6a-4907-9564-b8ac8dfe6f66 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:57.992680 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-037620dc-ff6a-4907-9564-b8ac8dfe6f66 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:58.079197 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2ecb4038-35c0-4f7f-bf81-c302f1b29d69 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:58.080521 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-2ecb4038-35c0-4f7f-bf81-c302f1b29d69 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:58.087357 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2ecb4038-35c0-4f7f-bf81-c302f1b29d69 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:58.087854 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2ecb4038-35c0-4f7f-bf81-c302f1b29d69 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:58.093481 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2ecb4038-35c0-4f7f-bf81-c302f1b29d69 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:58.093481 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2ecb4038-35c0-4f7f-bf81-c302f1b29d69 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:58.093481 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2ecb4038-35c0-4f7f-bf81-c302f1b29d69 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:58.093481 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2ecb4038-35c0-4f7f-bf81-c302f1b29d69 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:58.120521 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:41:58.174523 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-037620dc-ff6a-4907-9564-b8ac8dfe6f66 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:58.184322 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-037620dc-ff6a-4907-9564-b8ac8dfe6f66 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c" status: 200 len: 1321 microversion: 2.1 time: 0.208103 Oct 27 03:41:58.184928 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2612/4929] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:41:57 2022] GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c => generated 1321 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:41:58.283090 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-03869d9c-4c8e-4dbc-8aa2-d04add58c40f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:58.288944 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-03869d9c-4c8e-4dbc-8aa2-d04add58c40f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: ac9da5d0-c534-4955-b148-f401c9308618] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:58.291575 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-03869d9c-4c8e-4dbc-8aa2-d04add58c40f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:58.292352 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-03869d9c-4c8e-4dbc-8aa2-d04add58c40f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:58.293030 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-03869d9c-4c8e-4dbc-8aa2-d04add58c40f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:58.294301 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-03869d9c-4c8e-4dbc-8aa2-d04add58c40f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:58.294947 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-03869d9c-4c8e-4dbc-8aa2-d04add58c40f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:58.295549 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-03869d9c-4c8e-4dbc-8aa2-d04add58c40f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:58.310210 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2ecb4038-35c0-4f7f-bf81-c302f1b29d69 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:58.314314 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-03869d9c-4c8e-4dbc-8aa2-d04add58c40f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] HTTP exception thrown: Instance ac9da5d0-c534-4955-b148-f401c9308618 could not be found. Oct 27 03:41:58.322584 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-03869d9c-4c8e-4dbc-8aa2-d04add58c40f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Request method failure captured: Oct 27 03:41:58.322584 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/ac9da5d0-c534-4955-b148-f401c9308618 HTTP/1.1 Oct 27 03:41:58.322584 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:41:58.322584 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:41:58.322584 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:41:58.322584 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:41:58.322584 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:41:58.322584 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:41:58.322584 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:41:58.322584 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:41:58.322584 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfz83jPBQR-IO_RgpXfqqqN_tSIl3Aju213bQLpPTkR-R_lkTGSpHz1Evy7Lbg7I5hWxU9AxviJyxNS0i-wRdj1_O4LyvZEjE6jerjzwB22Vu4S-ThF8W8FJgumwczGUcQup-Bjpiay7kN0UoT8q0uFoQytE3MKt1MX9CDbsUgcc03A Oct 27 03:41:58.322584 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:41:58.322584 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:41:58.322584 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:41:58.322584 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:41:58.322584 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:41:58.322584 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:41:58.322584 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 911997e881754ce390af17919f29b4ab Oct 27 03:41:58.322584 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-DeleteServersTestJSON-858473437 Oct 27 03:41:58.322584 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:41:58.322584 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:41:58.322584 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/911997e881754ce390af17919f29b4ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/911997e881754ce390af17919f29b4ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/911997e881754ce390af17919f29b4ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_911997e881754ce390af17919f29b4ab"}]}] Oct 27 03:41:58.322584 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-DeleteServersTestJSON-858473437 Oct 27 03:41:58.322584 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 911997e881754ce390af17919f29b4ab Oct 27 03:41:58.322584 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-DeleteServersTestJSON-858473437 Oct 27 03:41:58.322584 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-DeleteServersTestJSON-858473437-project Oct 27 03:41:58.322584 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:41:58.322584 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:41:58.322584 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: b1cc79af058b4c35b3c572448fac86a7 Oct 27 03:41:58.322584 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-DeleteServersTestJSON-858473437-project Oct 27 03:41:58.322584 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:41:58.322584 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance ac9da5d0-c534-4955-b148-f401c9308618 could not be found. Oct 27 03:41:58.322584 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': 'ac9da5d0-c534-4955-b148-f401c9308618'} Oct 27 03:41:58.322584 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:41:58.322584 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:41:58.322584 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:41:58.322584 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:41:58.322584 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:41:58.322584 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:41:58.322584 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:41:58.322584 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:41:58.322584 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:41:58.322584 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:41:58.322584 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac9da5d0-c534-4955-b148-f401c9308618 could not be found. Oct 27 03:41:58.322584 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:41:58.322584 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:41:58.322584 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:41:58.322584 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:41:58.322584 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:41:58.322584 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:41:58.322584 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:41:58.322584 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:41:58.322584 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:41:58.322584 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:41:58.322584 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:41:58.322584 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:41:58.322584 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:41:58.322584 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:41:58.322584 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:41:58.322584 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:41:58.322584 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac9da5d0-c534-4955-b148-f401c9308618 could not be found. Oct 27 03:41:58.322584 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:41:58.322584 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:41:58.322584 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:41:58.329079 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:41:58.329079 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:41:58.329079 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:41:58.329079 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:41:58.329079 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:41:58.329079 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac9da5d0-c534-4955-b148-f401c9308618 could not be found. Oct 27 03:41:58.329079 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:41:58.329079 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-03869d9c-4c8e-4dbc-8aa2-d04add58c40f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Returning 404 to user: Instance ac9da5d0-c534-4955-b148-f401c9308618 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:41:58.329079 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-03869d9c-4c8e-4dbc-8aa2-d04add58c40f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/ac9da5d0-c534-4955-b148-f401c9308618" status: 404 len: 111 microversion: 2.1 time: 0.040185 Oct 27 03:41:58.330256 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2ecb4038-35c0-4f7f-bf81-c302f1b29d69 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:58.330256 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2ecb4038-35c0-4f7f-bf81-c302f1b29d69 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:58.331059 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2613/4930] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:41:58 2022] GET /compute/v2.1/servers/ac9da5d0-c534-4955-b148-f401c9308618 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 03:41:58.331221 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2ecb4038-35c0-4f7f-bf81-c302f1b29d69 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79" status: 200 len: 1808 microversion: 2.20 time: 0.256281 Oct 27 03:41:58.331701 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2318/4931] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:41:58 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 => generated 1808 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:41:58.454967 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-aaf6a104-1938-4f99-b794-0a566dfa7c59 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-166466846", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": [{"uuid": "b1f1f8a3-6579-4551-8baa-e65f1847be2c"}]}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:41:58.518986 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.network.neutron [None req-aaf6a104-1938-4f99-b794-0a566dfa7c59 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] validate_networks() for [('b1f1f8a3-6579-4551-8baa-e65f1847be2c', None, None, None, None, None)] {{(pid=121001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:41:58.966907 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-aaf6a104-1938-4f99-b794-0a566dfa7c59 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Flavor limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:41:58.967589 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-aaf6a104-1938-4f99-b794-0a566dfa7c59 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Image limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:41:58.967992 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-aaf6a104-1938-4f99-b794-0a566dfa7c59 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Flavor pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:41:58.968410 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-aaf6a104-1938-4f99-b794-0a566dfa7c59 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Image pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:41:58.968829 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-aaf6a104-1938-4f99-b794-0a566dfa7c59 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:41:59.000718 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aaf6a104-1938-4f99-b794-0a566dfa7c59 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:59.003275 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aaf6a104-1938-4f99-b794-0a566dfa7c59 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:59.006362 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aaf6a104-1938-4f99-b794-0a566dfa7c59 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:59.008592 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aaf6a104-1938-4f99-b794-0a566dfa7c59 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:59.009640 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aaf6a104-1938-4f99-b794-0a566dfa7c59 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:59.010833 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aaf6a104-1938-4f99-b794-0a566dfa7c59 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:59.034849 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-aaf6a104-1938-4f99-b794-0a566dfa7c59 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Getting quotas for project 911997e881754ce390af17919f29b4ab. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:41:59.041139 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-aaf6a104-1938-4f99-b794-0a566dfa7c59 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Getting quotas for user b1cc79af058b4c35b3c572448fac86a7 and project 911997e881754ce390af17919f29b4ab. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:41:59.055701 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-aaf6a104-1938-4f99-b794-0a566dfa7c59 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Going to run 1 instances... {{(pid=121001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:41:59.058515 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-aaf6a104-1938-4f99-b794-0a566dfa7c59 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: db0ba858-280c-4ef1-ad3f-15ff7e41af97] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:41:59.184557 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-aaf6a104-1938-4f99-b794-0a566dfa7c59 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.734415 Oct 27 03:41:59.185481 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2614/4932] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:41:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 736 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 03:41:59.198651 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b234f530-7acc-4586-95b0-9042b6ed1143 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:59.201757 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b234f530-7acc-4586-95b0-9042b6ed1143 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: db0ba858-280c-4ef1-ad3f-15ff7e41af97] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:59.216079 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-adbcd9ef-8f69-42ae-8651-8d11898842c4 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:59.223140 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-adbcd9ef-8f69-42ae-8651-8d11898842c4 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: c9e02344-a91a-40c8-b8c0-c0abe503204c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:59.239749 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-adbcd9ef-8f69-42ae-8651-8d11898842c4 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:59.246420 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-adbcd9ef-8f69-42ae-8651-8d11898842c4 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:59.247031 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-adbcd9ef-8f69-42ae-8651-8d11898842c4 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:59.247819 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-adbcd9ef-8f69-42ae-8651-8d11898842c4 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:59.248342 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-adbcd9ef-8f69-42ae-8651-8d11898842c4 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:59.248787 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-adbcd9ef-8f69-42ae-8651-8d11898842c4 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:59.287303 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b234f530-7acc-4586-95b0-9042b6ed1143 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:59.296628 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b234f530-7acc-4586-95b0-9042b6ed1143 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/db0ba858-280c-4ef1-ad3f-15ff7e41af97" status: 200 len: 1214 microversion: 2.1 time: 0.103521 Oct 27 03:41:59.297995 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2319/4933] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:41:59 2022] GET /compute/v2.1/servers/db0ba858-280c-4ef1-ad3f-15ff7e41af97 => generated 1214 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:41:59.361050 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6adb6443-09c2-40c6-9f3e-71c99758e161 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:59.362216 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6adb6443-09c2-40c6-9f3e-71c99758e161 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:59.374080 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6adb6443-09c2-40c6-9f3e-71c99758e161 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:59.378910 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6adb6443-09c2-40c6-9f3e-71c99758e161 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:59.378910 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6adb6443-09c2-40c6-9f3e-71c99758e161 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:59.378910 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6adb6443-09c2-40c6-9f3e-71c99758e161 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:59.378910 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6adb6443-09c2-40c6-9f3e-71c99758e161 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:59.379507 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6adb6443-09c2-40c6-9f3e-71c99758e161 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:59.500787 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-adbcd9ef-8f69-42ae-8651-8d11898842c4 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:59.510092 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-adbcd9ef-8f69-42ae-8651-8d11898842c4 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c" status: 200 len: 1515 microversion: 2.1 time: 0.301569 Oct 27 03:41:59.512489 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2615/4934] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:41:59 2022] GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c => generated 1515 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:41:59.542791 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9b45ed41-8d7a-4b98-aab1-f8858b561360 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:41:59.546367 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-9b45ed41-8d7a-4b98-aab1-f8858b561360 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: c9e02344-a91a-40c8-b8c0-c0abe503204c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:59.553082 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9b45ed41-8d7a-4b98-aab1-f8858b561360 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:59.558667 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9b45ed41-8d7a-4b98-aab1-f8858b561360 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:59.558667 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9b45ed41-8d7a-4b98-aab1-f8858b561360 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:59.558667 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9b45ed41-8d7a-4b98-aab1-f8858b561360 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:59.558667 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9b45ed41-8d7a-4b98-aab1-f8858b561360 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:59.558667 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9b45ed41-8d7a-4b98-aab1-f8858b561360 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:59.591635 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-9b45ed41-8d7a-4b98-aab1-f8858b561360 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lazy-loading 'flavor' on Instance uuid c9e02344-a91a-40c8-b8c0-c0abe503204c {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:41:59.596805 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:41:59.607012 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-6adb6443-09c2-40c6-9f3e-71c99758e161 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:59.617223 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-6adb6443-09c2-40c6-9f3e-71c99758e161 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:59.619498 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-6adb6443-09c2-40c6-9f3e-71c99758e161 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:41:59.622292 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6adb6443-09c2-40c6-9f3e-71c99758e161 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79" status: 200 len: 1808 microversion: 2.20 time: 0.265768 Oct 27 03:41:59.623262 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2320/4935] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:41:59 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 => generated 1808 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:41:59.843980 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9b45ed41-8d7a-4b98-aab1-f8858b561360 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "POST /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c/action" status: 200 len: 32 microversion: 2.1 time: 0.306203 Oct 27 03:41:59.844826 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2616/4936] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:41:59 2022] POST /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c/action => generated 32 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 03:41:59.856176 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c3c67d1c-fae5-410f-bf92-f75174a7e8f8 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:41:59.856810 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c3c67d1c-fae5-410f-bf92-f75174a7e8f8 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: c9e02344-a91a-40c8-b8c0-c0abe503204c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:41:59.863522 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c3c67d1c-fae5-410f-bf92-f75174a7e8f8 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:59.868569 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c3c67d1c-fae5-410f-bf92-f75174a7e8f8 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:59.868569 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c3c67d1c-fae5-410f-bf92-f75174a7e8f8 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:41:59.868569 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c3c67d1c-fae5-410f-bf92-f75174a7e8f8 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:41:59.868569 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c3c67d1c-fae5-410f-bf92-f75174a7e8f8 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:41:59.868569 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c3c67d1c-fae5-410f-bf92-f75174a7e8f8 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:00.051345 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c3c67d1c-fae5-410f-bf92-f75174a7e8f8 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:00.060707 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c3c67d1c-fae5-410f-bf92-f75174a7e8f8 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c" status: 200 len: 1521 microversion: 2.1 time: 0.209761 Oct 27 03:42:00.061833 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2321/4937] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:41:59 2022] GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:42:00.322910 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5e4be893-6637-49dd-bdd1-062dba0e0a01 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:00.323699 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5e4be893-6637-49dd-bdd1-062dba0e0a01 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: db0ba858-280c-4ef1-ad3f-15ff7e41af97] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:00.331806 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5e4be893-6637-49dd-bdd1-062dba0e0a01 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:00.331901 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5e4be893-6637-49dd-bdd1-062dba0e0a01 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:00.336264 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5e4be893-6637-49dd-bdd1-062dba0e0a01 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:00.336264 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5e4be893-6637-49dd-bdd1-062dba0e0a01 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:00.336264 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5e4be893-6637-49dd-bdd1-062dba0e0a01 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:00.336264 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5e4be893-6637-49dd-bdd1-062dba0e0a01 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:00.469967 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5e4be893-6637-49dd-bdd1-062dba0e0a01 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:00.469967 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5e4be893-6637-49dd-bdd1-062dba0e0a01 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/db0ba858-280c-4ef1-ad3f-15ff7e41af97" status: 200 len: 1218 microversion: 2.1 time: 0.108575 Oct 27 03:42:00.469967 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2617/4938] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:00 2022] GET /compute/v2.1/servers/db0ba858-280c-4ef1-ad3f-15ff7e41af97 => generated 1218 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:00.652955 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2ad30f4e-b216-45f2-8fa4-28a139ebb8d2 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:00.653581 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-2ad30f4e-b216-45f2-8fa4-28a139ebb8d2 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:00.661199 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2ad30f4e-b216-45f2-8fa4-28a139ebb8d2 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:00.661693 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2ad30f4e-b216-45f2-8fa4-28a139ebb8d2 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:00.662194 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2ad30f4e-b216-45f2-8fa4-28a139ebb8d2 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:00.663482 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2ad30f4e-b216-45f2-8fa4-28a139ebb8d2 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:00.663947 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2ad30f4e-b216-45f2-8fa4-28a139ebb8d2 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:00.664396 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2ad30f4e-b216-45f2-8fa4-28a139ebb8d2 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:00.801245 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2ad30f4e-b216-45f2-8fa4-28a139ebb8d2 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:00.812625 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2ad30f4e-b216-45f2-8fa4-28a139ebb8d2 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:00.814238 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2ad30f4e-b216-45f2-8fa4-28a139ebb8d2 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:00.815618 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2ad30f4e-b216-45f2-8fa4-28a139ebb8d2 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79" status: 200 len: 1808 microversion: 2.20 time: 0.166846 Oct 27 03:42:00.816284 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2322/4939] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:42:00 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:42:01.085147 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-38b3209f-e9e0-4bab-aa97-87882eefb866 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:01.085720 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-38b3209f-e9e0-4bab-aa97-87882eefb866 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: c9e02344-a91a-40c8-b8c0-c0abe503204c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:01.091948 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-38b3209f-e9e0-4bab-aa97-87882eefb866 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:01.092426 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-38b3209f-e9e0-4bab-aa97-87882eefb866 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:01.092875 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-38b3209f-e9e0-4bab-aa97-87882eefb866 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:01.093714 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-38b3209f-e9e0-4bab-aa97-87882eefb866 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:01.094213 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-38b3209f-e9e0-4bab-aa97-87882eefb866 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:01.094652 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-38b3209f-e9e0-4bab-aa97-87882eefb866 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:01.246257 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-38b3209f-e9e0-4bab-aa97-87882eefb866 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:01.258095 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-38b3209f-e9e0-4bab-aa97-87882eefb866 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c" status: 200 len: 1521 microversion: 2.1 time: 0.176951 Oct 27 03:42:01.261267 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2618/4940] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:01 2022] GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:01.492054 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4ce2aae8-9b61-4f48-bf2a-f127d9a3c893 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:01.492669 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4ce2aae8-9b61-4f48-bf2a-f127d9a3c893 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: db0ba858-280c-4ef1-ad3f-15ff7e41af97] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:01.498803 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4ce2aae8-9b61-4f48-bf2a-f127d9a3c893 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:01.501793 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4ce2aae8-9b61-4f48-bf2a-f127d9a3c893 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:01.501793 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4ce2aae8-9b61-4f48-bf2a-f127d9a3c893 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:01.501793 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4ce2aae8-9b61-4f48-bf2a-f127d9a3c893 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:01.501793 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4ce2aae8-9b61-4f48-bf2a-f127d9a3c893 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:01.501793 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4ce2aae8-9b61-4f48-bf2a-f127d9a3c893 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:01.577130 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4ce2aae8-9b61-4f48-bf2a-f127d9a3c893 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:01.585981 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4ce2aae8-9b61-4f48-bf2a-f127d9a3c893 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/db0ba858-280c-4ef1-ad3f-15ff7e41af97" status: 200 len: 1266 microversion: 2.1 time: 0.097966 Oct 27 03:42:01.588264 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2323/4941] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:01 2022] GET /compute/v2.1/servers/db0ba858-280c-4ef1-ad3f-15ff7e41af97 => generated 1266 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:01.847957 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-bd0ff226-cba4-4e30-a176-f894c7e827fa tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:01.848580 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-bd0ff226-cba4-4e30-a176-f894c7e827fa tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:01.859205 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bd0ff226-cba4-4e30-a176-f894c7e827fa tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:01.859694 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bd0ff226-cba4-4e30-a176-f894c7e827fa tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:01.860146 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bd0ff226-cba4-4e30-a176-f894c7e827fa tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:01.860881 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bd0ff226-cba4-4e30-a176-f894c7e827fa tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:01.861349 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bd0ff226-cba4-4e30-a176-f894c7e827fa tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:01.861793 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bd0ff226-cba4-4e30-a176-f894c7e827fa tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:02.029819 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-bd0ff226-cba4-4e30-a176-f894c7e827fa tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:02.039118 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-bd0ff226-cba4-4e30-a176-f894c7e827fa tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:02.040700 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-bd0ff226-cba4-4e30-a176-f894c7e827fa tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:02.042016 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-bd0ff226-cba4-4e30-a176-f894c7e827fa tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79" status: 200 len: 1808 microversion: 2.20 time: 0.198372 Oct 27 03:42:02.043067 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2619/4942] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:42:01 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 => generated 1808 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:42:02.285182 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3d24586a-da0c-4bdd-937c-78068660a0eb tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:02.285991 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-3d24586a-da0c-4bdd-937c-78068660a0eb tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: c9e02344-a91a-40c8-b8c0-c0abe503204c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:02.294196 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3d24586a-da0c-4bdd-937c-78068660a0eb tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:02.294196 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3d24586a-da0c-4bdd-937c-78068660a0eb tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:02.294494 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3d24586a-da0c-4bdd-937c-78068660a0eb tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:02.295176 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3d24586a-da0c-4bdd-937c-78068660a0eb tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:02.295654 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3d24586a-da0c-4bdd-937c-78068660a0eb tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:02.296066 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3d24586a-da0c-4bdd-937c-78068660a0eb tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:02.489520 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-3d24586a-da0c-4bdd-937c-78068660a0eb tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:02.499811 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3d24586a-da0c-4bdd-937c-78068660a0eb tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c" status: 200 len: 1521 microversion: 2.1 time: 0.218982 Oct 27 03:42:02.500740 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2324/4943] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:02 2022] GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:02.610410 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ff276da0-7ca9-4194-abf6-7a04268b8196 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:02.611299 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ff276da0-7ca9-4194-abf6-7a04268b8196 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: db0ba858-280c-4ef1-ad3f-15ff7e41af97] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:02.618885 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ff276da0-7ca9-4194-abf6-7a04268b8196 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:02.619649 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ff276da0-7ca9-4194-abf6-7a04268b8196 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:02.623687 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ff276da0-7ca9-4194-abf6-7a04268b8196 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:02.623687 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ff276da0-7ca9-4194-abf6-7a04268b8196 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:02.623687 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ff276da0-7ca9-4194-abf6-7a04268b8196 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:02.623687 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ff276da0-7ca9-4194-abf6-7a04268b8196 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:02.792724 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ff276da0-7ca9-4194-abf6-7a04268b8196 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:02.804031 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ff276da0-7ca9-4194-abf6-7a04268b8196 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/db0ba858-280c-4ef1-ad3f-15ff7e41af97" status: 200 len: 1272 microversion: 2.1 time: 0.196757 Oct 27 03:42:02.806391 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2620/4944] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:02 2022] GET /compute/v2.1/servers/db0ba858-280c-4ef1-ad3f-15ff7e41af97 => generated 1272 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:02.959067 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-db7b6b71-d1e1-4d38-a89b-8534f98dba2c tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1338804421", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": [{"uuid": "0f0e13fd-656b-4d2e-b4b3-07a0e37ff0c3"}]}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:42:03.024436 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-db7b6b71-d1e1-4d38-a89b-8534f98dba2c tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] validate_networks() for [('0f0e13fd-656b-4d2e-b4b3-07a0e37ff0c3', None, None, None, None, None)] {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:42:03.072393 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-81fae844-f56a-4de8-b2d5-706ef2d90355 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:03.074641 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-81fae844-f56a-4de8-b2d5-706ef2d90355 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:03.081877 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:42:03.084536 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-81fae844-f56a-4de8-b2d5-706ef2d90355 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:03.085077 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-81fae844-f56a-4de8-b2d5-706ef2d90355 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:03.085585 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-81fae844-f56a-4de8-b2d5-706ef2d90355 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:03.086596 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-81fae844-f56a-4de8-b2d5-706ef2d90355 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:03.087069 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-81fae844-f56a-4de8-b2d5-706ef2d90355 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:03.088585 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-81fae844-f56a-4de8-b2d5-706ef2d90355 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:03.461952 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-81fae844-f56a-4de8-b2d5-706ef2d90355 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:03.472418 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-81fae844-f56a-4de8-b2d5-706ef2d90355 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:03.474303 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-81fae844-f56a-4de8-b2d5-706ef2d90355 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:03.476552 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-81fae844-f56a-4de8-b2d5-706ef2d90355 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79" status: 200 len: 1808 microversion: 2.20 time: 0.410717 Oct 27 03:42:03.477091 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2621/4945] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:42:03 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 => generated 1808 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:42:03.479330 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-db7b6b71-d1e1-4d38-a89b-8534f98dba2c tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:42:03.480540 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-db7b6b71-d1e1-4d38-a89b-8534f98dba2c tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:42:03.481063 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-db7b6b71-d1e1-4d38-a89b-8534f98dba2c tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:42:03.481544 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-db7b6b71-d1e1-4d38-a89b-8534f98dba2c tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:42:03.481974 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-db7b6b71-d1e1-4d38-a89b-8534f98dba2c tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:42:03.492686 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-db7b6b71-d1e1-4d38-a89b-8534f98dba2c tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:03.493350 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-db7b6b71-d1e1-4d38-a89b-8534f98dba2c tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:03.494282 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-db7b6b71-d1e1-4d38-a89b-8534f98dba2c tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:03.495059 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-db7b6b71-d1e1-4d38-a89b-8534f98dba2c tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:03.495526 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-db7b6b71-d1e1-4d38-a89b-8534f98dba2c tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:03.495990 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-db7b6b71-d1e1-4d38-a89b-8534f98dba2c tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:03.514580 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-db7b6b71-d1e1-4d38-a89b-8534f98dba2c tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Getting quotas for project 98617e3a5b6c449c88449c236a8f2ecf. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:42:03.519988 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-db7b6b71-d1e1-4d38-a89b-8534f98dba2c tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Getting quotas for user 82daefe001364499b2ee9eb7da2599be and project 98617e3a5b6c449c88449c236a8f2ecf. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:42:03.525921 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8f641b0a-1de4-4baa-9df6-20d08607b5bd tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:03.526581 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8f641b0a-1de4-4baa-9df6-20d08607b5bd tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: c9e02344-a91a-40c8-b8c0-c0abe503204c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:03.532724 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8f641b0a-1de4-4baa-9df6-20d08607b5bd tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:03.533406 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-db7b6b71-d1e1-4d38-a89b-8534f98dba2c tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:42:03.533548 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8f641b0a-1de4-4baa-9df6-20d08607b5bd tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:03.533879 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8f641b0a-1de4-4baa-9df6-20d08607b5bd tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:03.534944 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8f641b0a-1de4-4baa-9df6-20d08607b5bd tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:03.536482 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8f641b0a-1de4-4baa-9df6-20d08607b5bd tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:03.536482 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8f641b0a-1de4-4baa-9df6-20d08607b5bd tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:03.536879 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-db7b6b71-d1e1-4d38-a89b-8534f98dba2c tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] [instance: 20bed685-d855-499c-90d6-f8c59cfbd701] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:42:03.725687 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-db7b6b71-d1e1-4d38-a89b-8534f98dba2c tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.922591 Oct 27 03:42:03.727470 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2325/4946] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:42:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 925 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 03:42:03.766639 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8f641b0a-1de4-4baa-9df6-20d08607b5bd tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:03.775929 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8f641b0a-1de4-4baa-9df6-20d08607b5bd tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c" status: 200 len: 1521 microversion: 2.1 time: 0.254715 Oct 27 03:42:03.786116 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2622/4947] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:03 2022] GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c => generated 1521 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:03.812654 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-da2659e6-27ae-48b0-a471-70eab97e6c5e tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-408992674", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": [{"uuid": "0f0e13fd-656b-4d2e-b4b3-07a0e37ff0c3"}]}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:42:03.833942 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0ca4c766-4a32-425a-98b6-1b0200aa05fa tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:03.834589 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0ca4c766-4a32-425a-98b6-1b0200aa05fa tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: db0ba858-280c-4ef1-ad3f-15ff7e41af97] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:03.861795 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0ca4c766-4a32-425a-98b6-1b0200aa05fa tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:03.862337 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0ca4c766-4a32-425a-98b6-1b0200aa05fa tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:03.862796 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0ca4c766-4a32-425a-98b6-1b0200aa05fa tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:03.865013 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0ca4c766-4a32-425a-98b6-1b0200aa05fa tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:03.865805 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0ca4c766-4a32-425a-98b6-1b0200aa05fa tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:03.866528 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0ca4c766-4a32-425a-98b6-1b0200aa05fa tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:03.894842 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-da2659e6-27ae-48b0-a471-70eab97e6c5e tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] validate_networks() for [('0f0e13fd-656b-4d2e-b4b3-07a0e37ff0c3', None, None, None, None, None)] {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:42:04.322502 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0ca4c766-4a32-425a-98b6-1b0200aa05fa tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:04.332010 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0ca4c766-4a32-425a-98b6-1b0200aa05fa tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/db0ba858-280c-4ef1-ad3f-15ff7e41af97" status: 200 len: 1314 microversion: 2.1 time: 0.502904 Oct 27 03:42:04.332666 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2623/4948] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:03 2022] GET /compute/v2.1/servers/db0ba858-280c-4ef1-ad3f-15ff7e41af97 => generated 1314 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:04.433431 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-da2659e6-27ae-48b0-a471-70eab97e6c5e tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:42:04.436544 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-da2659e6-27ae-48b0-a471-70eab97e6c5e tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:42:04.436544 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-da2659e6-27ae-48b0-a471-70eab97e6c5e tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:42:04.436544 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-da2659e6-27ae-48b0-a471-70eab97e6c5e tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:42:04.436544 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-da2659e6-27ae-48b0-a471-70eab97e6c5e tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:42:04.447291 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-da2659e6-27ae-48b0-a471-70eab97e6c5e tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:04.447818 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-da2659e6-27ae-48b0-a471-70eab97e6c5e tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:04.448257 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-da2659e6-27ae-48b0-a471-70eab97e6c5e tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:04.448997 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-da2659e6-27ae-48b0-a471-70eab97e6c5e tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:04.449664 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-da2659e6-27ae-48b0-a471-70eab97e6c5e tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:04.450126 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-da2659e6-27ae-48b0-a471-70eab97e6c5e tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:04.473672 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-da2659e6-27ae-48b0-a471-70eab97e6c5e tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Getting quotas for project 98617e3a5b6c449c88449c236a8f2ecf. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:42:04.482799 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-da2659e6-27ae-48b0-a471-70eab97e6c5e tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Getting quotas for user 82daefe001364499b2ee9eb7da2599be and project 98617e3a5b6c449c88449c236a8f2ecf. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:42:04.494556 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-da2659e6-27ae-48b0-a471-70eab97e6c5e tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:42:04.497264 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-da2659e6-27ae-48b0-a471-70eab97e6c5e tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] [instance: 0dd4eda6-95aa-4130-87e5-2986d6b95536] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:42:04.501971 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-80eccf38-2871-493c-9080-86aab5b9541a tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:04.505612 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-80eccf38-2871-493c-9080-86aab5b9541a tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:04.510463 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-80eccf38-2871-493c-9080-86aab5b9541a tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:04.511194 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-80eccf38-2871-493c-9080-86aab5b9541a tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:04.511779 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-80eccf38-2871-493c-9080-86aab5b9541a tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:04.512632 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-80eccf38-2871-493c-9080-86aab5b9541a tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:04.513230 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-80eccf38-2871-493c-9080-86aab5b9541a tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:04.513776 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-80eccf38-2871-493c-9080-86aab5b9541a tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:04.663697 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-da2659e6-27ae-48b0-a471-70eab97e6c5e tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.855001 Oct 27 03:42:04.677504 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2326/4949] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:42:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 869 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 03:42:04.684348 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-80eccf38-2871-493c-9080-86aab5b9541a tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:04.715924 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-80eccf38-2871-493c-9080-86aab5b9541a tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:04.718241 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-80eccf38-2871-493c-9080-86aab5b9541a tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:04.719509 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-80eccf38-2871-493c-9080-86aab5b9541a tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79" status: 200 len: 1808 microversion: 2.20 time: 0.222654 Oct 27 03:42:04.722907 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2624/4950] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:42:04 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 => generated 1808 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:42:04.746869 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-95594a5c-b61c-4f08-a91b-36c29a1b3356 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-479989947", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "451", "networks": [{"uuid": "0f0e13fd-656b-4d2e-b4b3-07a0e37ff0c3"}]}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:42:04.801612 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c1b7d056-1265-4417-9f9b-a5c2569b9929 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:04.805114 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c1b7d056-1265-4417-9f9b-a5c2569b9929 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: c9e02344-a91a-40c8-b8c0-c0abe503204c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:04.811547 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c1b7d056-1265-4417-9f9b-a5c2569b9929 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:04.812288 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c1b7d056-1265-4417-9f9b-a5c2569b9929 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:04.812929 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c1b7d056-1265-4417-9f9b-a5c2569b9929 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:04.814489 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c1b7d056-1265-4417-9f9b-a5c2569b9929 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:04.815248 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c1b7d056-1265-4417-9f9b-a5c2569b9929 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:04.815871 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c1b7d056-1265-4417-9f9b-a5c2569b9929 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:04.846768 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-95594a5c-b61c-4f08-a91b-36c29a1b3356 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] validate_networks() for [('0f0e13fd-656b-4d2e-b4b3-07a0e37ff0c3', None, None, None, None, None)] {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:42:05.248492 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c1b7d056-1265-4417-9f9b-a5c2569b9929 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:05.261234 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c1b7d056-1265-4417-9f9b-a5c2569b9929 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c" status: 200 len: 1521 microversion: 2.1 time: 0.464697 Oct 27 03:42:05.262572 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2625/4951] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:04 2022] GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c => generated 1521 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:42:05.355712 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a5c3a461-4515-4ea0-adc9-92afa7c41673 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:05.356410 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a5c3a461-4515-4ea0-adc9-92afa7c41673 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: db0ba858-280c-4ef1-ad3f-15ff7e41af97] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:05.371251 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a5c3a461-4515-4ea0-adc9-92afa7c41673 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:05.375371 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a5c3a461-4515-4ea0-adc9-92afa7c41673 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:05.377420 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a5c3a461-4515-4ea0-adc9-92afa7c41673 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:05.378407 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a5c3a461-4515-4ea0-adc9-92afa7c41673 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:05.383925 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a5c3a461-4515-4ea0-adc9-92afa7c41673 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:05.384949 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a5c3a461-4515-4ea0-adc9-92afa7c41673 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:05.446636 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-95594a5c-b61c-4f08-a91b-36c29a1b3356 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:42:05.447079 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-95594a5c-b61c-4f08-a91b-36c29a1b3356 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:42:05.447588 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-95594a5c-b61c-4f08-a91b-36c29a1b3356 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:42:05.450144 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-95594a5c-b61c-4f08-a91b-36c29a1b3356 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:42:05.450581 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-95594a5c-b61c-4f08-a91b-36c29a1b3356 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:42:05.462372 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-95594a5c-b61c-4f08-a91b-36c29a1b3356 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:05.462868 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-95594a5c-b61c-4f08-a91b-36c29a1b3356 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:05.463476 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-95594a5c-b61c-4f08-a91b-36c29a1b3356 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:05.464421 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-95594a5c-b61c-4f08-a91b-36c29a1b3356 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:05.465101 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-95594a5c-b61c-4f08-a91b-36c29a1b3356 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:05.477033 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-95594a5c-b61c-4f08-a91b-36c29a1b3356 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:05.535331 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-95594a5c-b61c-4f08-a91b-36c29a1b3356 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Getting quotas for project 98617e3a5b6c449c88449c236a8f2ecf. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:42:05.569673 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-95594a5c-b61c-4f08-a91b-36c29a1b3356 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Getting quotas for user 82daefe001364499b2ee9eb7da2599be and project 98617e3a5b6c449c88449c236a8f2ecf. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:42:05.601227 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-95594a5c-b61c-4f08-a91b-36c29a1b3356 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:42:05.605930 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-95594a5c-b61c-4f08-a91b-36c29a1b3356 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] [instance: 4634ba00-a353-44a2-b49a-7b1bc2fc7e81] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:42:05.742507 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a5c3a461-4515-4ea0-adc9-92afa7c41673 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:05.766178 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a5c3a461-4515-4ea0-adc9-92afa7c41673 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/db0ba858-280c-4ef1-ad3f-15ff7e41af97" status: 200 len: 1314 microversion: 2.1 time: 0.414322 Oct 27 03:42:05.768542 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2626/4952] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:05 2022] GET /compute/v2.1/servers/db0ba858-280c-4ef1-ad3f-15ff7e41af97 => generated 1314 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:05.776235 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-e206c8db-f759-4278-a6df-b1b9cb71a2d1 req-cf18d77f-ae64-4137-900c-732711ba4189 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db0ba858-280c-4ef1-ad3f-15ff7e41af97", "tag": "c229c134-237a-47a0-80b1-b6363b9dcd36"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:42:05.802821 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-e206c8db-f759-4278-a6df-b1b9cb71a2d1 req-cf18d77f-ae64-4137-900c-732711ba4189 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:05.803469 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-e206c8db-f759-4278-a6df-b1b9cb71a2d1 req-cf18d77f-ae64-4137-900c-732711ba4189 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:05.804006 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-e206c8db-f759-4278-a6df-b1b9cb71a2d1 req-cf18d77f-ae64-4137-900c-732711ba4189 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:05.829677 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-95594a5c-b61c-4f08-a91b-36c29a1b3356 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.087686 Oct 27 03:42:05.830865 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2327/4953] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:42:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1089 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 03:42:05.836233 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b17c87e1-63d2-49b9-9951-3e8314771ed5 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:05.836930 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b17c87e1-63d2-49b9-9951-3e8314771ed5 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:05.845546 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b17c87e1-63d2-49b9-9951-3e8314771ed5 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:05.846073 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b17c87e1-63d2-49b9-9951-3e8314771ed5 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:05.846526 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b17c87e1-63d2-49b9-9951-3e8314771ed5 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:05.847297 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b17c87e1-63d2-49b9-9951-3e8314771ed5 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:05.847761 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b17c87e1-63d2-49b9-9951-3e8314771ed5 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:05.848195 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b17c87e1-63d2-49b9-9951-3e8314771ed5 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:05.877516 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-e206c8db-f759-4278-a6df-b1b9cb71a2d1 req-cf18d77f-ae64-4137-900c-732711ba4189 service nova] Creating event network-changed:c229c134-237a-47a0-80b1-b6363b9dcd36 for instance db0ba858-280c-4ef1-ad3f-15ff7e41af97 on n-h2-862769-1 Oct 27 03:42:05.886595 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-e206c8db-f759-4278-a6df-b1b9cb71a2d1 req-cf18d77f-ae64-4137-900c-732711ba4189 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115663 Oct 27 03:42:05.889802 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2627/4954] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:42:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:42:05.950845 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-446d498f-82cf-4414-ab67-a764ccf52b4f tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:05.958054 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-446d498f-82cf-4414-ab67-a764ccf52b4f tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] [instance: 4634ba00-a353-44a2-b49a-7b1bc2fc7e81] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:06.076595 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b17c87e1-63d2-49b9-9951-3e8314771ed5 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:06.092289 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b17c87e1-63d2-49b9-9951-3e8314771ed5 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:06.093795 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b17c87e1-63d2-49b9-9951-3e8314771ed5 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:06.095574 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b17c87e1-63d2-49b9-9951-3e8314771ed5 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79" status: 200 len: 1808 microversion: 2.20 time: 0.263602 Oct 27 03:42:06.096964 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2328/4955] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:42:05 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 => generated 1808 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:42:06.132182 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-446d498f-82cf-4414-ab67-a764ccf52b4f tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82daefe001364499b2ee9eb7da2599be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:06.145543 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-446d498f-82cf-4414-ab67-a764ccf52b4f tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] 10.222.0.20 "GET /compute/v2.1/servers/4634ba00-a353-44a2-b49a-7b1bc2fc7e81" status: 200 len: 1220 microversion: 2.1 time: 0.212374 Oct 27 03:42:06.146382 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2628/4956] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:05 2022] GET /compute/v2.1/servers/4634ba00-a353-44a2-b49a-7b1bc2fc7e81 => generated 1220 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:06.285595 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5dc85ea7-cc0c-4a82-83a2-c8e0f700a64e tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:06.286610 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5dc85ea7-cc0c-4a82-83a2-c8e0f700a64e tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: c9e02344-a91a-40c8-b8c0-c0abe503204c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:06.293550 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5dc85ea7-cc0c-4a82-83a2-c8e0f700a64e tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:06.294126 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5dc85ea7-cc0c-4a82-83a2-c8e0f700a64e tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:06.322726 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5dc85ea7-cc0c-4a82-83a2-c8e0f700a64e tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:06.324644 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5dc85ea7-cc0c-4a82-83a2-c8e0f700a64e tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:06.326963 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5dc85ea7-cc0c-4a82-83a2-c8e0f700a64e tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:06.327439 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5dc85ea7-cc0c-4a82-83a2-c8e0f700a64e tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:06.486048 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-097f4615-5cfb-42b0-9261-4fcd95226377 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:06.486799 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-097f4615-5cfb-42b0-9261-4fcd95226377 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: 003c8652-2a85-4abc-8f02-ff46b4afcfd1] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:06.523265 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-097f4615-5cfb-42b0-9261-4fcd95226377 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:06.523797 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-097f4615-5cfb-42b0-9261-4fcd95226377 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:06.524446 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-097f4615-5cfb-42b0-9261-4fcd95226377 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:06.525194 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-097f4615-5cfb-42b0-9261-4fcd95226377 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:06.525664 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-097f4615-5cfb-42b0-9261-4fcd95226377 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:06.527646 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-097f4615-5cfb-42b0-9261-4fcd95226377 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:06.601784 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5dc85ea7-cc0c-4a82-83a2-c8e0f700a64e tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:06.609683 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5dc85ea7-cc0c-4a82-83a2-c8e0f700a64e tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c" status: 200 len: 1521 microversion: 2.1 time: 0.328244 Oct 27 03:42:06.610311 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2329/4957] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:06 2022] GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c => generated 1521 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:06.622095 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-097f4615-5cfb-42b0-9261-4fcd95226377 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lazy-loading 'services' on Instance uuid 003c8652-2a85-4abc-8f02-ff46b4afcfd1 {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:42:06.797285 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-fedcc39a-05f8-4b48-ae11-3d3770bf67f8 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:06.800811 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-fedcc39a-05f8-4b48-ae11-3d3770bf67f8 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: db0ba858-280c-4ef1-ad3f-15ff7e41af97] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:06.804966 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fedcc39a-05f8-4b48-ae11-3d3770bf67f8 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:06.805526 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fedcc39a-05f8-4b48-ae11-3d3770bf67f8 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:06.806025 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fedcc39a-05f8-4b48-ae11-3d3770bf67f8 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:06.806820 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fedcc39a-05f8-4b48-ae11-3d3770bf67f8 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:06.807456 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fedcc39a-05f8-4b48-ae11-3d3770bf67f8 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:06.807952 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fedcc39a-05f8-4b48-ae11-3d3770bf67f8 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:06.890442 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-097f4615-5cfb-42b0-9261-4fcd95226377 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "DELETE /compute/v2.1/servers/003c8652-2a85-4abc-8f02-ff46b4afcfd1/os-volume_attachments/055d1b24-414d-4236-98b9-6ed4dbd62c1b" status: 202 len: 0 microversion: 2.1 time: 0.408686 Oct 27 03:42:06.891058 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2629/4958] 10.222.0.20 () {58 vars in 1416 bytes} [Thu Oct 27 03:42:06 2022] DELETE /compute/v2.1/servers/003c8652-2a85-4abc-8f02-ff46b4afcfd1/os-volume_attachments/055d1b24-414d-4236-98b9-6ed4dbd62c1b => generated 0 bytes in 410 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:42:06.900714 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b15951a8-a888-43ab-9a2c-decca949c0d7 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:06.903421 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b15951a8-a888-43ab-9a2c-decca949c0d7 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: 003c8652-2a85-4abc-8f02-ff46b4afcfd1] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:06.910990 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b15951a8-a888-43ab-9a2c-decca949c0d7 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:06.911752 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b15951a8-a888-43ab-9a2c-decca949c0d7 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:06.912367 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b15951a8-a888-43ab-9a2c-decca949c0d7 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:06.915015 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b15951a8-a888-43ab-9a2c-decca949c0d7 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:06.915720 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b15951a8-a888-43ab-9a2c-decca949c0d7 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:06.916941 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b15951a8-a888-43ab-9a2c-decca949c0d7 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:06.956248 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-fedcc39a-05f8-4b48-ae11-3d3770bf67f8 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:06.964527 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-fedcc39a-05f8-4b48-ae11-3d3770bf67f8 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/db0ba858-280c-4ef1-ad3f-15ff7e41af97" status: 200 len: 1314 microversion: 2.1 time: 0.171453 Oct 27 03:42:06.965116 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2330/4959] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:06 2022] GET /compute/v2.1/servers/db0ba858-280c-4ef1-ad3f-15ff7e41af97 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:42:06.967414 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b15951a8-a888-43ab-9a2c-decca949c0d7 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/003c8652-2a85-4abc-8f02-ff46b4afcfd1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071190 Oct 27 03:42:06.968144 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2630/4960] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 27 03:42:06 2022] GET /compute/v2.1/servers/003c8652-2a85-4abc-8f02-ff46b4afcfd1/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:42:07.126916 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0540373b-254e-44b6-9053-6214e5b55d5a tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:07.127667 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0540373b-254e-44b6-9053-6214e5b55d5a tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:07.134157 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0540373b-254e-44b6-9053-6214e5b55d5a tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:07.134659 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0540373b-254e-44b6-9053-6214e5b55d5a tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:07.135259 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0540373b-254e-44b6-9053-6214e5b55d5a tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:07.135969 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0540373b-254e-44b6-9053-6214e5b55d5a tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:07.136433 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0540373b-254e-44b6-9053-6214e5b55d5a tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:07.136867 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0540373b-254e-44b6-9053-6214e5b55d5a tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:07.168680 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-565d906c-0af2-4c5c-b846-ad2496961e82 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:07.169308 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-565d906c-0af2-4c5c-b846-ad2496961e82 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] [instance: 4634ba00-a353-44a2-b49a-7b1bc2fc7e81] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:07.176405 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-565d906c-0af2-4c5c-b846-ad2496961e82 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:07.182528 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-565d906c-0af2-4c5c-b846-ad2496961e82 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:07.182528 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-565d906c-0af2-4c5c-b846-ad2496961e82 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:07.182528 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-565d906c-0af2-4c5c-b846-ad2496961e82 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:07.182528 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-565d906c-0af2-4c5c-b846-ad2496961e82 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:07.182528 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-565d906c-0af2-4c5c-b846-ad2496961e82 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:07.261600 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-565d906c-0af2-4c5c-b846-ad2496961e82 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82daefe001364499b2ee9eb7da2599be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:07.269456 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-565d906c-0af2-4c5c-b846-ad2496961e82 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] 10.222.0.20 "GET /compute/v2.1/servers/4634ba00-a353-44a2-b49a-7b1bc2fc7e81" status: 200 len: 1224 microversion: 2.1 time: 0.105542 Oct 27 03:42:07.270706 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2631/4961] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:07 2022] GET /compute/v2.1/servers/4634ba00-a353-44a2-b49a-7b1bc2fc7e81 => generated 1224 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:42:07.299861 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0540373b-254e-44b6-9053-6214e5b55d5a tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:07.308603 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0540373b-254e-44b6-9053-6214e5b55d5a tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:07.310046 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0540373b-254e-44b6-9053-6214e5b55d5a tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:07.311240 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0540373b-254e-44b6-9053-6214e5b55d5a tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79" status: 200 len: 1808 microversion: 2.20 time: 0.188453 Oct 27 03:42:07.311903 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2331/4962] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:42:07 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 => generated 1808 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:42:07.414721 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-f92ed95d-2981-4373-9f9b-c1604aa4b271 req-80e58e82-b728-482b-b43c-3c83cd232cdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6854d7f3-0f6d-45c2-b46d-a5dc2922fe79", "name": "network-vif-plugged", "status": "completed", "tag": "425e1d50-5b4c-44cd-a54b-de48e280a305"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:42:07.429277 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-f92ed95d-2981-4373-9f9b-c1604aa4b271 req-80e58e82-b728-482b-b43c-3c83cd232cdb service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:07.429774 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-f92ed95d-2981-4373-9f9b-c1604aa4b271 req-80e58e82-b728-482b-b43c-3c83cd232cdb service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:07.430252 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-f92ed95d-2981-4373-9f9b-c1604aa4b271 req-80e58e82-b728-482b-b43c-3c83cd232cdb service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:07.443003 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-f92ed95d-2981-4373-9f9b-c1604aa4b271 req-80e58e82-b728-482b-b43c-3c83cd232cdb service nova] Creating event network-vif-plugged:425e1d50-5b4c-44cd-a54b-de48e280a305 for instance 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 on n-h1-862769-1 Oct 27 03:42:07.450533 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-f92ed95d-2981-4373-9f9b-c1604aa4b271 req-80e58e82-b728-482b-b43c-3c83cd232cdb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038244 Oct 27 03:42:07.450533 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2632/4963] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:42:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:42:07.633306 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-60df7ab8-5b46-418a-853f-e61ab0c5f312 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:07.634025 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-60df7ab8-5b46-418a-853f-e61ab0c5f312 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: c9e02344-a91a-40c8-b8c0-c0abe503204c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:07.650569 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-60df7ab8-5b46-418a-853f-e61ab0c5f312 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:07.650569 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-60df7ab8-5b46-418a-853f-e61ab0c5f312 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:07.650569 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-60df7ab8-5b46-418a-853f-e61ab0c5f312 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:07.651219 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-60df7ab8-5b46-418a-853f-e61ab0c5f312 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:07.651849 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-60df7ab8-5b46-418a-853f-e61ab0c5f312 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:07.652293 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-60df7ab8-5b46-418a-853f-e61ab0c5f312 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:07.984689 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-60df7ab8-5b46-418a-853f-e61ab0c5f312 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:07.993049 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-16e18506-8e6b-44fe-b17b-e74584c82b4a tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:08.000172 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-16e18506-8e6b-44fe-b17b-e74584c82b4a tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: 003c8652-2a85-4abc-8f02-ff46b4afcfd1] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:08.000981 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-60df7ab8-5b46-418a-853f-e61ab0c5f312 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c" status: 200 len: 1521 microversion: 2.1 time: 0.364458 Oct 27 03:42:08.002182 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2332/4964] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:07 2022] GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c => generated 1521 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:08.007947 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2a6c0aa6-b7d9-4f86-ae06-6c66e898a4a0 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:08.010505 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-2a6c0aa6-b7d9-4f86-ae06-6c66e898a4a0 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: db0ba858-280c-4ef1-ad3f-15ff7e41af97] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:08.022616 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-16e18506-8e6b-44fe-b17b-e74584c82b4a tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:08.023947 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-16e18506-8e6b-44fe-b17b-e74584c82b4a tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:08.024403 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-16e18506-8e6b-44fe-b17b-e74584c82b4a tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:08.026508 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2a6c0aa6-b7d9-4f86-ae06-6c66e898a4a0 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:08.027214 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2a6c0aa6-b7d9-4f86-ae06-6c66e898a4a0 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:08.027730 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2a6c0aa6-b7d9-4f86-ae06-6c66e898a4a0 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:08.028859 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-16e18506-8e6b-44fe-b17b-e74584c82b4a tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:08.028992 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2a6c0aa6-b7d9-4f86-ae06-6c66e898a4a0 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:08.029624 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-16e18506-8e6b-44fe-b17b-e74584c82b4a tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:08.030365 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-16e18506-8e6b-44fe-b17b-e74584c82b4a tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:08.031048 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2a6c0aa6-b7d9-4f86-ae06-6c66e898a4a0 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:08.045134 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2a6c0aa6-b7d9-4f86-ae06-6c66e898a4a0 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:08.072019 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:42:08.145363 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-16e18506-8e6b-44fe-b17b-e74584c82b4a tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/003c8652-2a85-4abc-8f02-ff46b4afcfd1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.161764 Oct 27 03:42:08.146246 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2633/4965] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 27 03:42:07 2022] GET /compute/v2.1/servers/003c8652-2a85-4abc-8f02-ff46b4afcfd1/os-volume_attachments => generated 197 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:42:08.295439 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a99bb93b-6ba4-48ba-8f4d-936f5670208d tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:08.296383 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a99bb93b-6ba4-48ba-8f4d-936f5670208d tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] [instance: 4634ba00-a353-44a2-b49a-7b1bc2fc7e81] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:08.308192 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a99bb93b-6ba4-48ba-8f4d-936f5670208d tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:08.315827 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a99bb93b-6ba4-48ba-8f4d-936f5670208d tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:08.316822 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a99bb93b-6ba4-48ba-8f4d-936f5670208d tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:08.317827 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a99bb93b-6ba4-48ba-8f4d-936f5670208d tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:08.318412 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a99bb93b-6ba4-48ba-8f4d-936f5670208d tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:08.320699 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a99bb93b-6ba4-48ba-8f4d-936f5670208d tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:08.423722 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a99bb93b-6ba4-48ba-8f4d-936f5670208d tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82daefe001364499b2ee9eb7da2599be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:08.434919 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a99bb93b-6ba4-48ba-8f4d-936f5670208d tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] 10.222.0.20 "GET /compute/v2.1/servers/4634ba00-a353-44a2-b49a-7b1bc2fc7e81" status: 200 len: 1216 microversion: 2.1 time: 0.145963 Oct 27 03:42:08.447491 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2634/4966] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:08 2022] GET /compute/v2.1/servers/4634ba00-a353-44a2-b49a-7b1bc2fc7e81 => generated 1216 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:42:08.459579 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-025ca318-a88f-4ad0-b83c-602c167a70e9 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:08.460096 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-025ca318-a88f-4ad0-b83c-602c167a70e9 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:08.470633 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-025ca318-a88f-4ad0-b83c-602c167a70e9 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:08.471148 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-025ca318-a88f-4ad0-b83c-602c167a70e9 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:08.471655 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-025ca318-a88f-4ad0-b83c-602c167a70e9 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:08.474605 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-025ca318-a88f-4ad0-b83c-602c167a70e9 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:08.474605 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-025ca318-a88f-4ad0-b83c-602c167a70e9 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:08.474605 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-025ca318-a88f-4ad0-b83c-602c167a70e9 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:08.481499 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2a6c0aa6-b7d9-4f86-ae06-6c66e898a4a0 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:08.507078 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2a6c0aa6-b7d9-4f86-ae06-6c66e898a4a0 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/db0ba858-280c-4ef1-ad3f-15ff7e41af97" status: 200 len: 1314 microversion: 2.1 time: 0.503387 Oct 27 03:42:08.511792 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2333/4967] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:08 2022] GET /compute/v2.1/servers/db0ba858-280c-4ef1-ad3f-15ff7e41af97 => generated 1314 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:09.013327 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-025ca318-a88f-4ad0-b83c-602c167a70e9 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:09.026753 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:42:09.034875 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d8eafcc4-8f2c-47fc-96b2-e7771e602c5d tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:09.034875 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d8eafcc4-8f2c-47fc-96b2-e7771e602c5d tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: c9e02344-a91a-40c8-b8c0-c0abe503204c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:09.038519 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d8eafcc4-8f2c-47fc-96b2-e7771e602c5d tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:09.039202 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d8eafcc4-8f2c-47fc-96b2-e7771e602c5d tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:09.040424 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d8eafcc4-8f2c-47fc-96b2-e7771e602c5d tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:09.041795 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d8eafcc4-8f2c-47fc-96b2-e7771e602c5d tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:09.042498 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d8eafcc4-8f2c-47fc-96b2-e7771e602c5d tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:09.043049 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d8eafcc4-8f2c-47fc-96b2-e7771e602c5d tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:09.046227 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-025ca318-a88f-4ad0-b83c-602c167a70e9 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:09.051787 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-025ca318-a88f-4ad0-b83c-602c167a70e9 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:09.051787 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-025ca318-a88f-4ad0-b83c-602c167a70e9 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79" status: 200 len: 1808 microversion: 2.20 time: 0.602828 Oct 27 03:42:09.055025 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2635/4968] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:42:08 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 => generated 1808 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:42:09.163457 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0db6fd23-1fd5-4880-b752-650f114a863b tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:09.166637 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0db6fd23-1fd5-4880-b752-650f114a863b tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: 003c8652-2a85-4abc-8f02-ff46b4afcfd1] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:09.173962 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0db6fd23-1fd5-4880-b752-650f114a863b tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:09.174726 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0db6fd23-1fd5-4880-b752-650f114a863b tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:09.175346 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0db6fd23-1fd5-4880-b752-650f114a863b tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:09.176229 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0db6fd23-1fd5-4880-b752-650f114a863b tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:09.177506 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0db6fd23-1fd5-4880-b752-650f114a863b tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:09.178141 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0db6fd23-1fd5-4880-b752-650f114a863b tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:09.246613 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0db6fd23-1fd5-4880-b752-650f114a863b tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/003c8652-2a85-4abc-8f02-ff46b4afcfd1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092216 Oct 27 03:42:09.254588 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2636/4969] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 27 03:42:09 2022] GET /compute/v2.1/servers/003c8652-2a85-4abc-8f02-ff46b4afcfd1/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:42:09.349778 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d8eafcc4-8f2c-47fc-96b2-e7771e602c5d tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:09.365569 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d8eafcc4-8f2c-47fc-96b2-e7771e602c5d tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c" status: 200 len: 1521 microversion: 2.1 time: 0.345006 Oct 27 03:42:09.366202 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2334/4970] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:09 2022] GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c => generated 1521 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:09.470071 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1fc594b3-d05a-4721-9676-ec1e6de14774 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:09.471050 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1fc594b3-d05a-4721-9676-ec1e6de14774 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] [instance: 4634ba00-a353-44a2-b49a-7b1bc2fc7e81] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:09.480084 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1fc594b3-d05a-4721-9676-ec1e6de14774 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:09.480940 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1fc594b3-d05a-4721-9676-ec1e6de14774 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:09.482290 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1fc594b3-d05a-4721-9676-ec1e6de14774 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:09.483111 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1fc594b3-d05a-4721-9676-ec1e6de14774 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:09.483689 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1fc594b3-d05a-4721-9676-ec1e6de14774 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:09.484216 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1fc594b3-d05a-4721-9676-ec1e6de14774 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:09.539516 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-fc2b5bf3-4d48-438c-8704-3f898c902c05 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:09.541813 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-fc2b5bf3-4d48-438c-8704-3f898c902c05 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: db0ba858-280c-4ef1-ad3f-15ff7e41af97] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:09.555865 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fc2b5bf3-4d48-438c-8704-3f898c902c05 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:09.558970 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fc2b5bf3-4d48-438c-8704-3f898c902c05 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:09.559560 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fc2b5bf3-4d48-438c-8704-3f898c902c05 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:09.563519 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fc2b5bf3-4d48-438c-8704-3f898c902c05 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:09.568428 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fc2b5bf3-4d48-438c-8704-3f898c902c05 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:09.568428 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fc2b5bf3-4d48-438c-8704-3f898c902c05 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:09.679668 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1fc594b3-d05a-4721-9676-ec1e6de14774 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82daefe001364499b2ee9eb7da2599be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:09.690616 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1fc594b3-d05a-4721-9676-ec1e6de14774 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] 10.222.0.20 "GET /compute/v2.1/servers/4634ba00-a353-44a2-b49a-7b1bc2fc7e81" status: 200 len: 1216 microversion: 2.1 time: 0.230968 Oct 27 03:42:09.692464 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2637/4971] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:09 2022] GET /compute/v2.1/servers/4634ba00-a353-44a2-b49a-7b1bc2fc7e81 => generated 1216 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:10.084667 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c06dcb33-2c10-4a4e-8627-70f551515751 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:10.086480 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c06dcb33-2c10-4a4e-8627-70f551515751 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:10.095449 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c06dcb33-2c10-4a4e-8627-70f551515751 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:10.096319 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c06dcb33-2c10-4a4e-8627-70f551515751 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:10.096919 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c06dcb33-2c10-4a4e-8627-70f551515751 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:10.097920 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c06dcb33-2c10-4a4e-8627-70f551515751 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:10.098548 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c06dcb33-2c10-4a4e-8627-70f551515751 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:10.099147 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c06dcb33-2c10-4a4e-8627-70f551515751 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:10.123908 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-fc2b5bf3-4d48-438c-8704-3f898c902c05 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:10.132719 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-fc2b5bf3-4d48-438c-8704-3f898c902c05 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/db0ba858-280c-4ef1-ad3f-15ff7e41af97" status: 200 len: 1314 microversion: 2.1 time: 0.601222 Oct 27 03:42:10.133903 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2335/4972] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:09 2022] GET /compute/v2.1/servers/db0ba858-280c-4ef1-ad3f-15ff7e41af97 => generated 1314 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:10.265553 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f12ee48f-af0e-4417-bd1e-b776afa5b164 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:10.268651 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f12ee48f-af0e-4417-bd1e-b776afa5b164 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: 003c8652-2a85-4abc-8f02-ff46b4afcfd1] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:10.278506 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f12ee48f-af0e-4417-bd1e-b776afa5b164 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:10.278920 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f12ee48f-af0e-4417-bd1e-b776afa5b164 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:10.279272 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f12ee48f-af0e-4417-bd1e-b776afa5b164 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:10.285680 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f12ee48f-af0e-4417-bd1e-b776afa5b164 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:10.286417 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f12ee48f-af0e-4417-bd1e-b776afa5b164 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:10.287017 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f12ee48f-af0e-4417-bd1e-b776afa5b164 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:10.399966 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f12ee48f-af0e-4417-bd1e-b776afa5b164 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/003c8652-2a85-4abc-8f02-ff46b4afcfd1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.143271 Oct 27 03:42:10.414965 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2336/4973] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 27 03:42:10 2022] GET /compute/v2.1/servers/003c8652-2a85-4abc-8f02-ff46b4afcfd1/os-volume_attachments => generated 197 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:42:10.427253 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-486f9515-4c8c-492f-b367-d7e500cf4102 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:10.427253 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-486f9515-4c8c-492f-b367-d7e500cf4102 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: c9e02344-a91a-40c8-b8c0-c0abe503204c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:10.434336 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-486f9515-4c8c-492f-b367-d7e500cf4102 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:10.434842 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-486f9515-4c8c-492f-b367-d7e500cf4102 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:10.435288 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-486f9515-4c8c-492f-b367-d7e500cf4102 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:10.436011 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-486f9515-4c8c-492f-b367-d7e500cf4102 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:10.436480 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-486f9515-4c8c-492f-b367-d7e500cf4102 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:10.436918 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-486f9515-4c8c-492f-b367-d7e500cf4102 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:10.697823 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c06dcb33-2c10-4a4e-8627-70f551515751 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:10.721506 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c06dcb33-2c10-4a4e-8627-70f551515751 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:10.724685 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c06dcb33-2c10-4a4e-8627-70f551515751 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:10.727033 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c06dcb33-2c10-4a4e-8627-70f551515751 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79" status: 200 len: 1808 microversion: 2.20 time: 0.648622 Oct 27 03:42:10.727619 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2638/4974] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:42:10 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 => generated 1808 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:42:10.751352 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a9ed660f-e087-44f6-9ad8-bdf0125c4fb8 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:10.751906 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a9ed660f-e087-44f6-9ad8-bdf0125c4fb8 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] [instance: 4634ba00-a353-44a2-b49a-7b1bc2fc7e81] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:10.768764 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a9ed660f-e087-44f6-9ad8-bdf0125c4fb8 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:10.768764 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a9ed660f-e087-44f6-9ad8-bdf0125c4fb8 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:10.768764 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a9ed660f-e087-44f6-9ad8-bdf0125c4fb8 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:10.768764 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a9ed660f-e087-44f6-9ad8-bdf0125c4fb8 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:10.768764 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a9ed660f-e087-44f6-9ad8-bdf0125c4fb8 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:10.779783 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a9ed660f-e087-44f6-9ad8-bdf0125c4fb8 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:10.921064 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a9ed660f-e087-44f6-9ad8-bdf0125c4fb8 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82daefe001364499b2ee9eb7da2599be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:10.932317 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a9ed660f-e087-44f6-9ad8-bdf0125c4fb8 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] 10.222.0.20 "GET /compute/v2.1/servers/4634ba00-a353-44a2-b49a-7b1bc2fc7e81" status: 200 len: 1280 microversion: 2.1 time: 0.182797 Oct 27 03:42:10.932965 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2639/4975] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:10 2022] GET /compute/v2.1/servers/4634ba00-a353-44a2-b49a-7b1bc2fc7e81 => generated 1280 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:10.947368 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-486f9515-4c8c-492f-b367-d7e500cf4102 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:10.988612 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-486f9515-4c8c-492f-b367-d7e500cf4102 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c" status: 200 len: 1521 microversion: 2.1 time: 0.572378 Oct 27 03:42:10.991445 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2337/4976] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:10 2022] GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c => generated 1521 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:11.160729 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3b08e04a-2d6c-4a10-984e-f3fd7c6db305 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:11.161359 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3b08e04a-2d6c-4a10-984e-f3fd7c6db305 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: db0ba858-280c-4ef1-ad3f-15ff7e41af97] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:11.177667 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3b08e04a-2d6c-4a10-984e-f3fd7c6db305 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:11.178229 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3b08e04a-2d6c-4a10-984e-f3fd7c6db305 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:11.178664 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3b08e04a-2d6c-4a10-984e-f3fd7c6db305 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:11.179959 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3b08e04a-2d6c-4a10-984e-f3fd7c6db305 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:11.180425 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3b08e04a-2d6c-4a10-984e-f3fd7c6db305 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:11.180871 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3b08e04a-2d6c-4a10-984e-f3fd7c6db305 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:11.414509 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-04adac39-aa54-4454-86aa-8e4cd2b39c34 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:11.417370 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-04adac39-aa54-4454-86aa-8e4cd2b39c34 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: 003c8652-2a85-4abc-8f02-ff46b4afcfd1] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:11.434792 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-04adac39-aa54-4454-86aa-8e4cd2b39c34 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:11.436896 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-04adac39-aa54-4454-86aa-8e4cd2b39c34 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:11.437551 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-04adac39-aa54-4454-86aa-8e4cd2b39c34 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:11.438478 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-04adac39-aa54-4454-86aa-8e4cd2b39c34 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:11.441148 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-04adac39-aa54-4454-86aa-8e4cd2b39c34 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:11.441915 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-04adac39-aa54-4454-86aa-8e4cd2b39c34 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:11.454152 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=100 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:42:11.515931 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-04adac39-aa54-4454-86aa-8e4cd2b39c34 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/003c8652-2a85-4abc-8f02-ff46b4afcfd1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106723 Oct 27 03:42:11.523962 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2338/4977] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 27 03:42:11 2022] GET /compute/v2.1/servers/003c8652-2a85-4abc-8f02-ff46b4afcfd1/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:42:11.539157 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3b08e04a-2d6c-4a10-984e-f3fd7c6db305 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:11.548773 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3b08e04a-2d6c-4a10-984e-f3fd7c6db305 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/db0ba858-280c-4ef1-ad3f-15ff7e41af97" status: 200 len: 1314 microversion: 2.1 time: 0.392598 Oct 27 03:42:11.549936 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2640/4978] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:11 2022] GET /compute/v2.1/servers/db0ba858-280c-4ef1-ad3f-15ff7e41af97 => generated 1314 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:11.755656 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-190ffb12-5105-4003-82c5-ac4488cb8e86 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:11.756333 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-190ffb12-5105-4003-82c5-ac4488cb8e86 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:11.767201 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-ca592fdd-5fe5-4749-9979-6f5a8bf9a58b req-eea27a25-cd3f-4025-b283-4bcb95045712 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20bed685-d855-499c-90d6-f8c59cfbd701", "tag": "c626dbd5-9bf5-461f-9f93-96b9e1015065"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:42:11.775515 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-190ffb12-5105-4003-82c5-ac4488cb8e86 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:11.776029 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-190ffb12-5105-4003-82c5-ac4488cb8e86 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:11.776482 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-190ffb12-5105-4003-82c5-ac4488cb8e86 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:11.777351 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-190ffb12-5105-4003-82c5-ac4488cb8e86 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:11.777983 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-190ffb12-5105-4003-82c5-ac4488cb8e86 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:11.778608 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-190ffb12-5105-4003-82c5-ac4488cb8e86 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:11.781847 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-ca592fdd-5fe5-4749-9979-6f5a8bf9a58b req-eea27a25-cd3f-4025-b283-4bcb95045712 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:11.782737 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-ca592fdd-5fe5-4749-9979-6f5a8bf9a58b req-eea27a25-cd3f-4025-b283-4bcb95045712 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:11.783451 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-ca592fdd-5fe5-4749-9979-6f5a8bf9a58b req-eea27a25-cd3f-4025-b283-4bcb95045712 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:11.808168 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-ca592fdd-5fe5-4749-9979-6f5a8bf9a58b req-eea27a25-cd3f-4025-b283-4bcb95045712 service nova] Creating event network-changed:c626dbd5-9bf5-461f-9f93-96b9e1015065 for instance 20bed685-d855-499c-90d6-f8c59cfbd701 on n-h2-862769-1 Oct 27 03:42:11.818996 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-ca592fdd-5fe5-4749-9979-6f5a8bf9a58b req-eea27a25-cd3f-4025-b283-4bcb95045712 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056406 Oct 27 03:42:11.822987 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2641/4979] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:42:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:42:11.959167 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0c726cd0-7a11-41f6-8055-ae88852265d9 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:11.960041 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0c726cd0-7a11-41f6-8055-ae88852265d9 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] [instance: 4634ba00-a353-44a2-b49a-7b1bc2fc7e81] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:11.976219 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0c726cd0-7a11-41f6-8055-ae88852265d9 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:11.976622 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0c726cd0-7a11-41f6-8055-ae88852265d9 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:11.979426 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0c726cd0-7a11-41f6-8055-ae88852265d9 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:11.980210 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0c726cd0-7a11-41f6-8055-ae88852265d9 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:11.980688 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0c726cd0-7a11-41f6-8055-ae88852265d9 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:11.981594 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0c726cd0-7a11-41f6-8055-ae88852265d9 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:12.077778 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-190ffb12-5105-4003-82c5-ac4488cb8e86 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:12.104207 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-190ffb12-5105-4003-82c5-ac4488cb8e86 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:12.106658 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-190ffb12-5105-4003-82c5-ac4488cb8e86 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:12.109116 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-190ffb12-5105-4003-82c5-ac4488cb8e86 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79" status: 200 len: 1808 microversion: 2.20 time: 0.356354 Oct 27 03:42:12.110058 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2339/4980] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:42:11 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 => generated 1808 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:42:12.118279 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ee82fb2f-3fc8-45f7-92fb-8f7335957051 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:12.119852 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ee82fb2f-3fc8-45f7-92fb-8f7335957051 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: c9e02344-a91a-40c8-b8c0-c0abe503204c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:12.127701 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ee82fb2f-3fc8-45f7-92fb-8f7335957051 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:12.128454 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ee82fb2f-3fc8-45f7-92fb-8f7335957051 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:12.129455 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ee82fb2f-3fc8-45f7-92fb-8f7335957051 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:12.130383 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ee82fb2f-3fc8-45f7-92fb-8f7335957051 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:12.131016 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ee82fb2f-3fc8-45f7-92fb-8f7335957051 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:12.131642 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ee82fb2f-3fc8-45f7-92fb-8f7335957051 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:12.372808 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ee82fb2f-3fc8-45f7-92fb-8f7335957051 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:12.392622 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ee82fb2f-3fc8-45f7-92fb-8f7335957051 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c" status: 200 len: 1521 microversion: 2.1 time: 0.273312 Oct 27 03:42:12.394250 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2340/4981] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:12 2022] GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c => generated 1521 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:12.403104 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-1a039bf6-62ee-4c7e-98aa-d84561b75325 req-bf3b740a-db6a-4d97-b57e-187626ed77b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db0ba858-280c-4ef1-ad3f-15ff7e41af97", "name": "network-vif-plugged", "status": "completed", "tag": "c229c134-237a-47a0-80b1-b6363b9dcd36"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:42:12.417417 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-1a039bf6-62ee-4c7e-98aa-d84561b75325 req-bf3b740a-db6a-4d97-b57e-187626ed77b6 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:12.419499 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-1a039bf6-62ee-4c7e-98aa-d84561b75325 req-bf3b740a-db6a-4d97-b57e-187626ed77b6 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:12.420100 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-1a039bf6-62ee-4c7e-98aa-d84561b75325 req-bf3b740a-db6a-4d97-b57e-187626ed77b6 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:12.443132 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0c726cd0-7a11-41f6-8055-ae88852265d9 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82daefe001364499b2ee9eb7da2599be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:12.451852 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0c726cd0-7a11-41f6-8055-ae88852265d9 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] 10.222.0.20 "GET /compute/v2.1/servers/4634ba00-a353-44a2-b49a-7b1bc2fc7e81" status: 200 len: 1278 microversion: 2.1 time: 0.496919 Oct 27 03:42:12.455419 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-1a039bf6-62ee-4c7e-98aa-d84561b75325 req-bf3b740a-db6a-4d97-b57e-187626ed77b6 service nova] Creating event network-vif-plugged:c229c134-237a-47a0-80b1-b6363b9dcd36 for instance db0ba858-280c-4ef1-ad3f-15ff7e41af97 on n-h2-862769-1 Oct 27 03:42:12.469371 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2642/4982] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:11 2022] GET /compute/v2.1/servers/4634ba00-a353-44a2-b49a-7b1bc2fc7e81 => generated 1278 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:42:12.475115 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-1a039bf6-62ee-4c7e-98aa-d84561b75325 req-bf3b740a-db6a-4d97-b57e-187626ed77b6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072596 Oct 27 03:42:12.476874 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2341/4983] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:42:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:42:12.531342 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c6b49655-ae02-43bb-a7ee-f787a0e5757e tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:12.534588 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c6b49655-ae02-43bb-a7ee-f787a0e5757e tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: 003c8652-2a85-4abc-8f02-ff46b4afcfd1] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:12.543589 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c6b49655-ae02-43bb-a7ee-f787a0e5757e tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:12.545930 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c6b49655-ae02-43bb-a7ee-f787a0e5757e tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:12.546655 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c6b49655-ae02-43bb-a7ee-f787a0e5757e tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:12.547554 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c6b49655-ae02-43bb-a7ee-f787a0e5757e tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:12.548572 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c6b49655-ae02-43bb-a7ee-f787a0e5757e tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:12.549175 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c6b49655-ae02-43bb-a7ee-f787a0e5757e tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:12.576268 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0531b6cf-0a41-4435-b57e-c2cd542ec798 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:12.577174 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0531b6cf-0a41-4435-b57e-c2cd542ec798 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: db0ba858-280c-4ef1-ad3f-15ff7e41af97] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:12.588003 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0531b6cf-0a41-4435-b57e-c2cd542ec798 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:12.588916 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0531b6cf-0a41-4435-b57e-c2cd542ec798 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:12.589656 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0531b6cf-0a41-4435-b57e-c2cd542ec798 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:12.591085 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0531b6cf-0a41-4435-b57e-c2cd542ec798 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:12.592566 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0531b6cf-0a41-4435-b57e-c2cd542ec798 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:12.594053 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0531b6cf-0a41-4435-b57e-c2cd542ec798 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:12.598064 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c6b49655-ae02-43bb-a7ee-f787a0e5757e tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/003c8652-2a85-4abc-8f02-ff46b4afcfd1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071545 Oct 27 03:42:12.604086 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2643/4984] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 27 03:42:12 2022] GET /compute/v2.1/servers/003c8652-2a85-4abc-8f02-ff46b4afcfd1/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:42:12.929856 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0531b6cf-0a41-4435-b57e-c2cd542ec798 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:12.940441 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0531b6cf-0a41-4435-b57e-c2cd542ec798 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/db0ba858-280c-4ef1-ad3f-15ff7e41af97" status: 200 len: 1314 microversion: 2.1 time: 0.369358 Oct 27 03:42:12.941052 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2342/4985] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:12 2022] GET /compute/v2.1/servers/db0ba858-280c-4ef1-ad3f-15ff7e41af97 => generated 1314 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:13.138008 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-64017ad4-fc43-49f6-92c1-b7068a1b39d2 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:13.139037 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-64017ad4-fc43-49f6-92c1-b7068a1b39d2 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:13.148896 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-64017ad4-fc43-49f6-92c1-b7068a1b39d2 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:13.149669 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-64017ad4-fc43-49f6-92c1-b7068a1b39d2 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:13.150952 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-64017ad4-fc43-49f6-92c1-b7068a1b39d2 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:13.151876 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-64017ad4-fc43-49f6-92c1-b7068a1b39d2 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:13.152516 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-64017ad4-fc43-49f6-92c1-b7068a1b39d2 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:13.154139 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-64017ad4-fc43-49f6-92c1-b7068a1b39d2 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:13.423107 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9d4bf788-17a7-4b75-a1ed-667700e04602 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:13.424328 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9d4bf788-17a7-4b75-a1ed-667700e04602 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: c9e02344-a91a-40c8-b8c0-c0abe503204c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:13.434163 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9d4bf788-17a7-4b75-a1ed-667700e04602 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:13.435022 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9d4bf788-17a7-4b75-a1ed-667700e04602 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:13.435958 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9d4bf788-17a7-4b75-a1ed-667700e04602 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:13.436946 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9d4bf788-17a7-4b75-a1ed-667700e04602 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:13.437581 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9d4bf788-17a7-4b75-a1ed-667700e04602 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:13.438199 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9d4bf788-17a7-4b75-a1ed-667700e04602 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:13.502972 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-64017ad4-fc43-49f6-92c1-b7068a1b39d2 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:13.512151 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-64017ad4-fc43-49f6-92c1-b7068a1b39d2 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:13.513624 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-64017ad4-fc43-49f6-92c1-b7068a1b39d2 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:13.521656 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-64017ad4-fc43-49f6-92c1-b7068a1b39d2 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79" status: 200 len: 1795 microversion: 2.20 time: 0.389058 Oct 27 03:42:13.528867 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2644/4986] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:42:13 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 => generated 1795 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:42:13.533888 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4c3ecbab-82aa-45b5-91f3-4d4c3931d2be tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:13.534694 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4c3ecbab-82aa-45b5-91f3-4d4c3931d2be tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] [instance: 4634ba00-a353-44a2-b49a-7b1bc2fc7e81] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:13.549021 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4c3ecbab-82aa-45b5-91f3-4d4c3931d2be tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:13.549818 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4c3ecbab-82aa-45b5-91f3-4d4c3931d2be tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:13.562287 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4c3ecbab-82aa-45b5-91f3-4d4c3931d2be tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:13.564011 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4c3ecbab-82aa-45b5-91f3-4d4c3931d2be tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:13.564624 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4c3ecbab-82aa-45b5-91f3-4d4c3931d2be tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:13.565209 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4c3ecbab-82aa-45b5-91f3-4d4c3931d2be tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:13.627325 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9d4bf788-17a7-4b75-a1ed-667700e04602 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:13.640100 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9d4bf788-17a7-4b75-a1ed-667700e04602 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c" status: 200 len: 1521 microversion: 2.1 time: 0.223291 Oct 27 03:42:13.641503 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2343/4987] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:13 2022] GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:13.657134 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1316aca7-2bf0-42eb-a41a-f98c7103d592 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:13.659868 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1316aca7-2bf0-42eb-a41a-f98c7103d592 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: 003c8652-2a85-4abc-8f02-ff46b4afcfd1] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:13.670912 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1316aca7-2bf0-42eb-a41a-f98c7103d592 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:13.672853 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1316aca7-2bf0-42eb-a41a-f98c7103d592 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:13.673685 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1316aca7-2bf0-42eb-a41a-f98c7103d592 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:13.674663 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1316aca7-2bf0-42eb-a41a-f98c7103d592 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:13.678122 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1316aca7-2bf0-42eb-a41a-f98c7103d592 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:13.678841 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1316aca7-2bf0-42eb-a41a-f98c7103d592 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:13.741155 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1316aca7-2bf0-42eb-a41a-f98c7103d592 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/003c8652-2a85-4abc-8f02-ff46b4afcfd1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097968 Oct 27 03:42:13.742117 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2344/4988] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 27 03:42:13 2022] GET /compute/v2.1/servers/003c8652-2a85-4abc-8f02-ff46b4afcfd1/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:42:13.878240 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4c3ecbab-82aa-45b5-91f3-4d4c3931d2be tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82daefe001364499b2ee9eb7da2599be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:13.892279 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4c3ecbab-82aa-45b5-91f3-4d4c3931d2be tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] 10.222.0.20 "GET /compute/v2.1/servers/4634ba00-a353-44a2-b49a-7b1bc2fc7e81" status: 200 len: 1320 microversion: 2.1 time: 0.360565 Oct 27 03:42:13.901262 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2645/4989] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:13 2022] GET /compute/v2.1/servers/4634ba00-a353-44a2-b49a-7b1bc2fc7e81 => generated 1320 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:13.976051 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9ad88ee1-c958-414d-adc0-5aec3ea13bfa tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:13.978977 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9ad88ee1-c958-414d-adc0-5aec3ea13bfa tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: db0ba858-280c-4ef1-ad3f-15ff7e41af97] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:13.997931 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:42:13.997931 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9ad88ee1-c958-414d-adc0-5aec3ea13bfa tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:13.997931 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9ad88ee1-c958-414d-adc0-5aec3ea13bfa tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:13.997931 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9ad88ee1-c958-414d-adc0-5aec3ea13bfa tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:13.997931 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9ad88ee1-c958-414d-adc0-5aec3ea13bfa tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:13.997931 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9ad88ee1-c958-414d-adc0-5aec3ea13bfa tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:13.997931 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9ad88ee1-c958-414d-adc0-5aec3ea13bfa tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:14.124086 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-713af410-c2b6-49dc-9c08-364f9e37261d req-a29c87f1-de41-4631-af37-f2735b8b8add service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0dd4eda6-95aa-4130-87e5-2986d6b95536", "tag": "c145bd52-e31c-495c-b5c9-8d9b40e2a275"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:42:14.141883 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-713af410-c2b6-49dc-9c08-364f9e37261d req-a29c87f1-de41-4631-af37-f2735b8b8add service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:14.142767 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-713af410-c2b6-49dc-9c08-364f9e37261d req-a29c87f1-de41-4631-af37-f2735b8b8add service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:14.143369 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-713af410-c2b6-49dc-9c08-364f9e37261d req-a29c87f1-de41-4631-af37-f2735b8b8add service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:14.169446 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-713af410-c2b6-49dc-9c08-364f9e37261d req-a29c87f1-de41-4631-af37-f2735b8b8add service nova] Creating event network-changed:c145bd52-e31c-495c-b5c9-8d9b40e2a275 for instance 0dd4eda6-95aa-4130-87e5-2986d6b95536 on n-h2-862769-1 Oct 27 03:42:14.176206 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-713af410-c2b6-49dc-9c08-364f9e37261d req-a29c87f1-de41-4631-af37-f2735b8b8add service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056655 Oct 27 03:42:14.178233 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2646/4990] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:42:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:42:14.201074 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9ad88ee1-c958-414d-adc0-5aec3ea13bfa tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:14.217865 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9ad88ee1-c958-414d-adc0-5aec3ea13bfa tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/db0ba858-280c-4ef1-ad3f-15ff7e41af97" status: 200 len: 1314 microversion: 2.1 time: 0.249846 Oct 27 03:42:14.218775 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2345/4991] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:13 2022] GET /compute/v2.1/servers/db0ba858-280c-4ef1-ad3f-15ff7e41af97 => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:14.666714 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-cca79c6a-2ae8-4692-921b-d5ee21e351a2 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:14.668607 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-cca79c6a-2ae8-4692-921b-d5ee21e351a2 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: c9e02344-a91a-40c8-b8c0-c0abe503204c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:14.676249 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cca79c6a-2ae8-4692-921b-d5ee21e351a2 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:14.677993 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cca79c6a-2ae8-4692-921b-d5ee21e351a2 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:14.678255 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cca79c6a-2ae8-4692-921b-d5ee21e351a2 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:14.678955 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cca79c6a-2ae8-4692-921b-d5ee21e351a2 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:14.679939 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cca79c6a-2ae8-4692-921b-d5ee21e351a2 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:14.680782 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cca79c6a-2ae8-4692-921b-d5ee21e351a2 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:14.758244 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-eca6751d-aaae-4310-be0d-60c74777e9ac tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:14.761515 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-eca6751d-aaae-4310-be0d-60c74777e9ac tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: 003c8652-2a85-4abc-8f02-ff46b4afcfd1] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:14.772189 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eca6751d-aaae-4310-be0d-60c74777e9ac tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:14.778959 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eca6751d-aaae-4310-be0d-60c74777e9ac tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:14.778959 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eca6751d-aaae-4310-be0d-60c74777e9ac tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:14.778959 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eca6751d-aaae-4310-be0d-60c74777e9ac tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:14.778959 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eca6751d-aaae-4310-be0d-60c74777e9ac tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:14.778959 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eca6751d-aaae-4310-be0d-60c74777e9ac tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:14.811808 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-eca6751d-aaae-4310-be0d-60c74777e9ac tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/003c8652-2a85-4abc-8f02-ff46b4afcfd1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.061835 Oct 27 03:42:14.813446 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2346/4992] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 27 03:42:14 2022] GET /compute/v2.1/servers/003c8652-2a85-4abc-8f02-ff46b4afcfd1/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 27 03:42:14.892156 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-11d9d218-02b7-4f9b-82ac-63902ccb4964 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:14.895463 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-11d9d218-02b7-4f9b-82ac-63902ccb4964 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: 003c8652-2a85-4abc-8f02-ff46b4afcfd1] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:14.908304 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-11d9d218-02b7-4f9b-82ac-63902ccb4964 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:14.908800 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-11d9d218-02b7-4f9b-82ac-63902ccb4964 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:14.909235 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-11d9d218-02b7-4f9b-82ac-63902ccb4964 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:14.909983 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-11d9d218-02b7-4f9b-82ac-63902ccb4964 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:14.910467 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-11d9d218-02b7-4f9b-82ac-63902ccb4964 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:14.910954 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-11d9d218-02b7-4f9b-82ac-63902ccb4964 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:14.957817 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-11d9d218-02b7-4f9b-82ac-63902ccb4964 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: 003c8652-2a85-4abc-8f02-ff46b4afcfd1] Going to try to terminate instance {{(pid=121000) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:42:15.077706 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-cca79c6a-2ae8-4692-921b-d5ee21e351a2 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:15.092934 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-cca79c6a-2ae8-4692-921b-d5ee21e351a2 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c" status: 200 len: 1521 microversion: 2.1 time: 0.431729 Oct 27 03:42:15.094701 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2647/4993] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:14 2022] GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c => generated 1521 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:15.099981 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d37d001c-d946-4b0d-b3c5-333b43a4b639 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:15.100851 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d37d001c-d946-4b0d-b3c5-333b43a4b639 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] [instance: 4634ba00-a353-44a2-b49a-7b1bc2fc7e81] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:15.107975 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d37d001c-d946-4b0d-b3c5-333b43a4b639 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:15.108728 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d37d001c-d946-4b0d-b3c5-333b43a4b639 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:15.109443 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d37d001c-d946-4b0d-b3c5-333b43a4b639 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:15.118736 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d37d001c-d946-4b0d-b3c5-333b43a4b639 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:15.120584 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d37d001c-d946-4b0d-b3c5-333b43a4b639 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:15.121444 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d37d001c-d946-4b0d-b3c5-333b43a4b639 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:15.290007 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-11d9d218-02b7-4f9b-82ac-63902ccb4964 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "DELETE /compute/v2.1/servers/003c8652-2a85-4abc-8f02-ff46b4afcfd1" status: 204 len: 0 microversion: 2.1 time: 0.402955 Oct 27 03:42:15.290642 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2347/4994] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:42:14 2022] DELETE /compute/v2.1/servers/003c8652-2a85-4abc-8f02-ff46b4afcfd1 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 03:42:15.297738 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a7d3a74d-ac10-4588-b99c-b57eb35a5222 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:15.298615 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a7d3a74d-ac10-4588-b99c-b57eb35a5222 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: db0ba858-280c-4ef1-ad3f-15ff7e41af97] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:15.305027 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a7d3a74d-ac10-4588-b99c-b57eb35a5222 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:15.305519 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a7d3a74d-ac10-4588-b99c-b57eb35a5222 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:15.309210 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a7d3a74d-ac10-4588-b99c-b57eb35a5222 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:15.309210 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a7d3a74d-ac10-4588-b99c-b57eb35a5222 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:15.309210 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a7d3a74d-ac10-4588-b99c-b57eb35a5222 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:15.309210 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a7d3a74d-ac10-4588-b99c-b57eb35a5222 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:15.477237 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a7d3a74d-ac10-4588-b99c-b57eb35a5222 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:15.485297 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a7d3a74d-ac10-4588-b99c-b57eb35a5222 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/db0ba858-280c-4ef1-ad3f-15ff7e41af97" status: 200 len: 1501 microversion: 2.1 time: 0.192106 Oct 27 03:42:15.485899 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2348/4995] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:15 2022] GET /compute/v2.1/servers/db0ba858-280c-4ef1-ad3f-15ff7e41af97 => generated 1501 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:15.505712 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0a316e4f-137f-4425-b62f-393a00ea4b0b tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:15.505712 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0a316e4f-137f-4425-b62f-393a00ea4b0b tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: 003c8652-2a85-4abc-8f02-ff46b4afcfd1] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:15.505712 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=6 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:42:15.505712 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0a316e4f-137f-4425-b62f-393a00ea4b0b tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:15.505712 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0a316e4f-137f-4425-b62f-393a00ea4b0b tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:15.505712 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0a316e4f-137f-4425-b62f-393a00ea4b0b tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:15.505712 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0a316e4f-137f-4425-b62f-393a00ea4b0b tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:15.505712 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0a316e4f-137f-4425-b62f-393a00ea4b0b tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:15.505712 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0a316e4f-137f-4425-b62f-393a00ea4b0b tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:15.593054 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=20 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:42:15.648955 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0a316e4f-137f-4425-b62f-393a00ea4b0b tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18036411a99e4634bfbaeae24b9f254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229dcb63bc41444391544883b576ce2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:15.654511 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d37d001c-d946-4b0d-b3c5-333b43a4b639 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82daefe001364499b2ee9eb7da2599be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:15.658879 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0a316e4f-137f-4425-b62f-393a00ea4b0b tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/003c8652-2a85-4abc-8f02-ff46b4afcfd1" status: 200 len: 1681 microversion: 2.1 time: 0.171837 Oct 27 03:42:15.670177 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2349/4996] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:15 2022] GET /compute/v2.1/servers/003c8652-2a85-4abc-8f02-ff46b4afcfd1 => generated 1681 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:15.670364 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d37d001c-d946-4b0d-b3c5-333b43a4b639 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] 10.222.0.20 "GET /compute/v2.1/servers/4634ba00-a353-44a2-b49a-7b1bc2fc7e81" status: 200 len: 1320 microversion: 2.1 time: 0.572264 Oct 27 03:42:15.679616 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2648/4997] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:15 2022] GET /compute/v2.1/servers/4634ba00-a353-44a2-b49a-7b1bc2fc7e81 => generated 1320 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:15.679777 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5faa5c6b-9f3a-4bec-b648-ba3fd788249a tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:42:15.679777 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5faa5c6b-9f3a-4bec-b648-ba3fd788249a tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: db0ba858-280c-4ef1-ad3f-15ff7e41af97] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:15.686615 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5faa5c6b-9f3a-4bec-b648-ba3fd788249a tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:15.687343 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5faa5c6b-9f3a-4bec-b648-ba3fd788249a tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:15.687850 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5faa5c6b-9f3a-4bec-b648-ba3fd788249a tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:15.688564 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5faa5c6b-9f3a-4bec-b648-ba3fd788249a tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:15.689353 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5faa5c6b-9f3a-4bec-b648-ba3fd788249a tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:15.689780 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5faa5c6b-9f3a-4bec-b648-ba3fd788249a tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:15.716987 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-5faa5c6b-9f3a-4bec-b648-ba3fd788249a tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lazy-loading 'flavor' on Instance uuid db0ba858-280c-4ef1-ad3f-15ff7e41af97 {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:42:16.011286 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5faa5c6b-9f3a-4bec-b648-ba3fd788249a tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "POST /compute/v2.1/servers/db0ba858-280c-4ef1-ad3f-15ff7e41af97/action" status: 202 len: 0 microversion: 2.1 time: 0.347582 Oct 27 03:42:16.020375 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f1856a60-3f71-45d1-84b2-6b89be599dc7 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:16.021118 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f1856a60-3f71-45d1-84b2-6b89be599dc7 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: db0ba858-280c-4ef1-ad3f-15ff7e41af97] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:16.024885 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2350/4998] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:42:15 2022] POST /compute/v2.1/servers/db0ba858-280c-4ef1-ad3f-15ff7e41af97/action => generated 0 bytes in 363 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:42:16.028128 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f1856a60-3f71-45d1-84b2-6b89be599dc7 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:16.028692 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f1856a60-3f71-45d1-84b2-6b89be599dc7 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:16.029236 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f1856a60-3f71-45d1-84b2-6b89be599dc7 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:16.030512 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f1856a60-3f71-45d1-84b2-6b89be599dc7 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:16.031273 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f1856a60-3f71-45d1-84b2-6b89be599dc7 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:16.032501 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f1856a60-3f71-45d1-84b2-6b89be599dc7 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:16.121932 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-04119ee5-3cce-4494-a1d2-99379aaecddd tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:16.122709 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-04119ee5-3cce-4494-a1d2-99379aaecddd tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: c9e02344-a91a-40c8-b8c0-c0abe503204c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:16.129538 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-04119ee5-3cce-4494-a1d2-99379aaecddd tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:16.130500 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-04119ee5-3cce-4494-a1d2-99379aaecddd tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:16.131173 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-04119ee5-3cce-4494-a1d2-99379aaecddd tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:16.132190 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-04119ee5-3cce-4494-a1d2-99379aaecddd tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:16.133709 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-04119ee5-3cce-4494-a1d2-99379aaecddd tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:16.134659 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-04119ee5-3cce-4494-a1d2-99379aaecddd tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:16.140162 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=8 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:42:16.183756 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f1856a60-3f71-45d1-84b2-6b89be599dc7 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:16.194207 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f1856a60-3f71-45d1-84b2-6b89be599dc7 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/db0ba858-280c-4ef1-ad3f-15ff7e41af97" status: 200 len: 1509 microversion: 2.1 time: 0.177653 Oct 27 03:42:16.194939 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2649/4999] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:16 2022] GET /compute/v2.1/servers/db0ba858-280c-4ef1-ad3f-15ff7e41af97 => generated 1509 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:42:16.212655 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-7926905e-3ab4-4e55-b25e-57930b13cee3 req-75ee0622-3c53-4d84-af10-82e5eb1e35f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4634ba00-a353-44a2-b49a-7b1bc2fc7e81", "tag": "b030f178-4218-4b6b-a8b2-8e3531ae7161"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:42:16.224984 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-7926905e-3ab4-4e55-b25e-57930b13cee3 req-75ee0622-3c53-4d84-af10-82e5eb1e35f4 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:16.225686 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-7926905e-3ab4-4e55-b25e-57930b13cee3 req-75ee0622-3c53-4d84-af10-82e5eb1e35f4 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:16.226797 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-7926905e-3ab4-4e55-b25e-57930b13cee3 req-75ee0622-3c53-4d84-af10-82e5eb1e35f4 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:16.242146 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-7926905e-3ab4-4e55-b25e-57930b13cee3 req-75ee0622-3c53-4d84-af10-82e5eb1e35f4 service nova] Creating event network-changed:b030f178-4218-4b6b-a8b2-8e3531ae7161 for instance 4634ba00-a353-44a2-b49a-7b1bc2fc7e81 on n-h2-862769-1 Oct 27 03:42:16.246140 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-7926905e-3ab4-4e55-b25e-57930b13cee3 req-75ee0622-3c53-4d84-af10-82e5eb1e35f4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038831 Oct 27 03:42:16.247357 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2650/5000] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:42:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:42:16.282284 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-04119ee5-3cce-4494-a1d2-99379aaecddd tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:16.291276 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-04119ee5-3cce-4494-a1d2-99379aaecddd tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c" status: 200 len: 1521 microversion: 2.1 time: 0.173736 Oct 27 03:42:16.291951 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2351/5001] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:16 2022] GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:42:16.688096 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-50512a34-657b-4a6d-81ea-fa7fbd45058c tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:16.689364 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-50512a34-657b-4a6d-81ea-fa7fbd45058c tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: 003c8652-2a85-4abc-8f02-ff46b4afcfd1] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:16.691307 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7017ad6c-4845-4f5e-82c7-37e07a915856 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:16.691934 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7017ad6c-4845-4f5e-82c7-37e07a915856 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] [instance: 4634ba00-a353-44a2-b49a-7b1bc2fc7e81] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:16.696670 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-50512a34-657b-4a6d-81ea-fa7fbd45058c tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:16.697156 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-50512a34-657b-4a6d-81ea-fa7fbd45058c tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:16.697595 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-50512a34-657b-4a6d-81ea-fa7fbd45058c tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:16.698022 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7017ad6c-4845-4f5e-82c7-37e07a915856 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:16.698687 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-50512a34-657b-4a6d-81ea-fa7fbd45058c tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:16.698803 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7017ad6c-4845-4f5e-82c7-37e07a915856 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:16.699092 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7017ad6c-4845-4f5e-82c7-37e07a915856 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:16.699223 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-50512a34-657b-4a6d-81ea-fa7fbd45058c tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:16.699610 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-50512a34-657b-4a6d-81ea-fa7fbd45058c tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:16.699791 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7017ad6c-4845-4f5e-82c7-37e07a915856 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:16.700250 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7017ad6c-4845-4f5e-82c7-37e07a915856 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:16.700679 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7017ad6c-4845-4f5e-82c7-37e07a915856 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:16.705137 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:42:16.926964 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-50512a34-657b-4a6d-81ea-fa7fbd45058c tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18036411a99e4634bfbaeae24b9f254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229dcb63bc41444391544883b576ce2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:16.932588 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=100 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:42:16.937824 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-50512a34-657b-4a6d-81ea-fa7fbd45058c tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/003c8652-2a85-4abc-8f02-ff46b4afcfd1" status: 200 len: 1681 microversion: 2.1 time: 0.254599 Oct 27 03:42:16.938458 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2651/5002] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:16 2022] GET /compute/v2.1/servers/003c8652-2a85-4abc-8f02-ff46b4afcfd1 => generated 1681 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:17.169433 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7017ad6c-4845-4f5e-82c7-37e07a915856 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82daefe001364499b2ee9eb7da2599be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:17.179661 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7017ad6c-4845-4f5e-82c7-37e07a915856 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] 10.222.0.20 "GET /compute/v2.1/servers/4634ba00-a353-44a2-b49a-7b1bc2fc7e81" status: 200 len: 1320 microversion: 2.1 time: 0.492089 Oct 27 03:42:17.180762 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2352/5003] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:16 2022] GET /compute/v2.1/servers/4634ba00-a353-44a2-b49a-7b1bc2fc7e81 => generated 1320 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:42:17.217305 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e4c32b69-3aef-41c5-bf28-1219a3540656 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:17.230502 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e4c32b69-3aef-41c5-bf28-1219a3540656 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: db0ba858-280c-4ef1-ad3f-15ff7e41af97] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:17.230502 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e4c32b69-3aef-41c5-bf28-1219a3540656 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:17.230502 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e4c32b69-3aef-41c5-bf28-1219a3540656 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:17.230502 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e4c32b69-3aef-41c5-bf28-1219a3540656 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:17.230502 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e4c32b69-3aef-41c5-bf28-1219a3540656 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:17.230502 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e4c32b69-3aef-41c5-bf28-1219a3540656 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:17.230502 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e4c32b69-3aef-41c5-bf28-1219a3540656 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:17.315146 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-64b0d2f3-dd33-4ae6-84f6-226fcbd57156 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:17.315801 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-64b0d2f3-dd33-4ae6-84f6-226fcbd57156 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: c9e02344-a91a-40c8-b8c0-c0abe503204c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:17.322528 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-64b0d2f3-dd33-4ae6-84f6-226fcbd57156 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:17.323054 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-64b0d2f3-dd33-4ae6-84f6-226fcbd57156 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:17.323524 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-64b0d2f3-dd33-4ae6-84f6-226fcbd57156 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:17.324214 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-64b0d2f3-dd33-4ae6-84f6-226fcbd57156 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:17.324733 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-64b0d2f3-dd33-4ae6-84f6-226fcbd57156 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:17.325120 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-64b0d2f3-dd33-4ae6-84f6-226fcbd57156 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:17.424066 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e4c32b69-3aef-41c5-bf28-1219a3540656 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:17.435692 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e4c32b69-3aef-41c5-bf28-1219a3540656 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/db0ba858-280c-4ef1-ad3f-15ff7e41af97" status: 200 len: 1509 microversion: 2.1 time: 0.222227 Oct 27 03:42:17.436371 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2652/5004] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:17 2022] GET /compute/v2.1/servers/db0ba858-280c-4ef1-ad3f-15ff7e41af97 => generated 1509 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:17.529512 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-64b0d2f3-dd33-4ae6-84f6-226fcbd57156 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:17.537494 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-64b0d2f3-dd33-4ae6-84f6-226fcbd57156 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c" status: 200 len: 1521 microversion: 2.1 time: 0.226288 Oct 27 03:42:17.538939 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2353/5005] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:17 2022] GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:42:17.963278 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-01a20412-950a-4cc5-b389-89e7a8b1d624 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:17.963824 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-01a20412-950a-4cc5-b389-89e7a8b1d624 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: 003c8652-2a85-4abc-8f02-ff46b4afcfd1] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:17.970747 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-01a20412-950a-4cc5-b389-89e7a8b1d624 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:17.976537 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-01a20412-950a-4cc5-b389-89e7a8b1d624 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:17.976537 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-01a20412-950a-4cc5-b389-89e7a8b1d624 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:17.976537 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-01a20412-950a-4cc5-b389-89e7a8b1d624 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:17.976537 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-01a20412-950a-4cc5-b389-89e7a8b1d624 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:17.976537 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-01a20412-950a-4cc5-b389-89e7a8b1d624 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:18.206401 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6c75f754-46b9-4cc4-99a8-65af35c46854 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:18.207826 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6c75f754-46b9-4cc4-99a8-65af35c46854 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] [instance: 4634ba00-a353-44a2-b49a-7b1bc2fc7e81] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:18.218549 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6c75f754-46b9-4cc4-99a8-65af35c46854 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:18.219479 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6c75f754-46b9-4cc4-99a8-65af35c46854 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:18.221081 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6c75f754-46b9-4cc4-99a8-65af35c46854 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:18.221855 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6c75f754-46b9-4cc4-99a8-65af35c46854 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:18.222544 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6c75f754-46b9-4cc4-99a8-65af35c46854 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:18.223898 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6c75f754-46b9-4cc4-99a8-65af35c46854 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:18.412727 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-6c75f754-46b9-4cc4-99a8-65af35c46854 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82daefe001364499b2ee9eb7da2599be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:18.421072 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6c75f754-46b9-4cc4-99a8-65af35c46854 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] 10.222.0.20 "GET /compute/v2.1/servers/4634ba00-a353-44a2-b49a-7b1bc2fc7e81" status: 200 len: 1320 microversion: 2.1 time: 0.220447 Oct 27 03:42:18.422297 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2354/5006] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:18 2022] GET /compute/v2.1/servers/4634ba00-a353-44a2-b49a-7b1bc2fc7e81 => generated 1320 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:42:18.463351 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8ebf597c-fd7e-4f53-9be6-f9f1a6bb9043 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:18.464358 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8ebf597c-fd7e-4f53-9be6-f9f1a6bb9043 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: db0ba858-280c-4ef1-ad3f-15ff7e41af97] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:18.471638 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8ebf597c-fd7e-4f53-9be6-f9f1a6bb9043 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:18.472356 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8ebf597c-fd7e-4f53-9be6-f9f1a6bb9043 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:18.473010 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8ebf597c-fd7e-4f53-9be6-f9f1a6bb9043 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:18.473944 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8ebf597c-fd7e-4f53-9be6-f9f1a6bb9043 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:18.474650 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8ebf597c-fd7e-4f53-9be6-f9f1a6bb9043 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:18.475304 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8ebf597c-fd7e-4f53-9be6-f9f1a6bb9043 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:18.656751 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8ebf597c-fd7e-4f53-9be6-f9f1a6bb9043 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:18.671670 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8ebf597c-fd7e-4f53-9be6-f9f1a6bb9043 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/db0ba858-280c-4ef1-ad3f-15ff7e41af97" status: 200 len: 1492 microversion: 2.1 time: 0.209252 Oct 27 03:42:18.671670 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2355/5007] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:18 2022] GET /compute/v2.1/servers/db0ba858-280c-4ef1-ad3f-15ff7e41af97 => generated 1492 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:42:18.674463 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-faf7d79a-262c-47f7-9237-0beca6af3bdf req-0d3751dd-9048-4aa7-94fe-c3aaf9de02b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20bed685-d855-499c-90d6-f8c59cfbd701", "name": "network-vif-plugged", "status": "completed", "tag": "c626dbd5-9bf5-461f-9f93-96b9e1015065"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:42:18.686606 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-faf7d79a-262c-47f7-9237-0beca6af3bdf req-0d3751dd-9048-4aa7-94fe-c3aaf9de02b8 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:18.687316 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-faf7d79a-262c-47f7-9237-0beca6af3bdf req-0d3751dd-9048-4aa7-94fe-c3aaf9de02b8 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:18.688076 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-faf7d79a-262c-47f7-9237-0beca6af3bdf req-0d3751dd-9048-4aa7-94fe-c3aaf9de02b8 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:18.704365 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-faf7d79a-262c-47f7-9237-0beca6af3bdf req-0d3751dd-9048-4aa7-94fe-c3aaf9de02b8 service nova] Creating event network-vif-plugged:c626dbd5-9bf5-461f-9f93-96b9e1015065 for instance 20bed685-d855-499c-90d6-f8c59cfbd701 on n-h2-862769-1 Oct 27 03:42:18.714303 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-faf7d79a-262c-47f7-9237-0beca6af3bdf req-0d3751dd-9048-4aa7-94fe-c3aaf9de02b8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044499 Oct 27 03:42:18.715302 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2356/5008] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:42:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:42:18.724154 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0504d9fe-a83b-4be4-9cc0-5c4e9c39ff7e tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:18.725078 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0504d9fe-a83b-4be4-9cc0-5c4e9c39ff7e tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: c9e02344-a91a-40c8-b8c0-c0abe503204c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:18.732148 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0504d9fe-a83b-4be4-9cc0-5c4e9c39ff7e tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:18.732727 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0504d9fe-a83b-4be4-9cc0-5c4e9c39ff7e tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:18.733167 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0504d9fe-a83b-4be4-9cc0-5c4e9c39ff7e tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:18.734816 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0504d9fe-a83b-4be4-9cc0-5c4e9c39ff7e tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:18.735530 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0504d9fe-a83b-4be4-9cc0-5c4e9c39ff7e tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:18.735747 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0504d9fe-a83b-4be4-9cc0-5c4e9c39ff7e tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:18.747437 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-01a20412-950a-4cc5-b389-89e7a8b1d624 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18036411a99e4634bfbaeae24b9f254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229dcb63bc41444391544883b576ce2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:18.762813 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-01a20412-950a-4cc5-b389-89e7a8b1d624 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/003c8652-2a85-4abc-8f02-ff46b4afcfd1" status: 200 len: 1681 microversion: 2.1 time: 0.803960 Oct 27 03:42:18.763584 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2653/5009] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:17 2022] GET /compute/v2.1/servers/003c8652-2a85-4abc-8f02-ff46b4afcfd1 => generated 1681 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:18.777981 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9fbac554-f27d-44f1-8d32-444b1b10579c tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:18.778780 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-9fbac554-f27d-44f1-8d32-444b1b10579c tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: db0ba858-280c-4ef1-ad3f-15ff7e41af97] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:18.790282 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9fbac554-f27d-44f1-8d32-444b1b10579c tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:18.790789 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9fbac554-f27d-44f1-8d32-444b1b10579c tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:18.791241 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9fbac554-f27d-44f1-8d32-444b1b10579c tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:18.791967 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9fbac554-f27d-44f1-8d32-444b1b10579c tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:18.792431 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9fbac554-f27d-44f1-8d32-444b1b10579c tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:18.792865 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9fbac554-f27d-44f1-8d32-444b1b10579c tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:18.845731 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-9fbac554-f27d-44f1-8d32-444b1b10579c tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: db0ba858-280c-4ef1-ad3f-15ff7e41af97] Going to try to terminate instance {{(pid=121001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:42:18.931139 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0504d9fe-a83b-4be4-9cc0-5c4e9c39ff7e tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:18.939417 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0504d9fe-a83b-4be4-9cc0-5c4e9c39ff7e tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c" status: 200 len: 1521 microversion: 2.1 time: 0.222375 Oct 27 03:42:18.940094 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2357/5010] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:18 2022] GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:19.193410 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9fbac554-f27d-44f1-8d32-444b1b10579c tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "DELETE /compute/v2.1/servers/db0ba858-280c-4ef1-ad3f-15ff7e41af97" status: 204 len: 0 microversion: 2.1 time: 0.427997 Oct 27 03:42:19.194627 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2654/5011] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:42:18 2022] DELETE /compute/v2.1/servers/db0ba858-280c-4ef1-ad3f-15ff7e41af97 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:42:19.203131 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b9bf1057-24df-48f6-9e55-dfe501425a62 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:19.203754 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b9bf1057-24df-48f6-9e55-dfe501425a62 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: db0ba858-280c-4ef1-ad3f-15ff7e41af97] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:19.211495 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b9bf1057-24df-48f6-9e55-dfe501425a62 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:19.215130 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b9bf1057-24df-48f6-9e55-dfe501425a62 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:19.215308 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b9bf1057-24df-48f6-9e55-dfe501425a62 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:19.216059 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b9bf1057-24df-48f6-9e55-dfe501425a62 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:19.220062 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b9bf1057-24df-48f6-9e55-dfe501425a62 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:19.220062 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b9bf1057-24df-48f6-9e55-dfe501425a62 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:19.283370 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-97b1ddb4-1f97-41d0-8ce2-d98a0b045b3a req-35783113-82b5-45c9-aadc-0f53520c909b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "003c8652-2a85-4abc-8f02-ff46b4afcfd1", "name": "network-vif-deleted", "tag": "006cf94f-9d7e-4841-85fe-ed1dfa04276d"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:42:19.294347 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-97b1ddb4-1f97-41d0-8ce2-d98a0b045b3a req-35783113-82b5-45c9-aadc-0f53520c909b service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:19.294891 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-97b1ddb4-1f97-41d0-8ce2-d98a0b045b3a req-35783113-82b5-45c9-aadc-0f53520c909b service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:19.295324 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-97b1ddb4-1f97-41d0-8ce2-d98a0b045b3a req-35783113-82b5-45c9-aadc-0f53520c909b service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:19.308443 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-97b1ddb4-1f97-41d0-8ce2-d98a0b045b3a req-35783113-82b5-45c9-aadc-0f53520c909b service nova] Creating event network-vif-deleted:006cf94f-9d7e-4841-85fe-ed1dfa04276d for instance 003c8652-2a85-4abc-8f02-ff46b4afcfd1 on n-h1-862769-1 Oct 27 03:42:19.314422 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-97b1ddb4-1f97-41d0-8ce2-d98a0b045b3a req-35783113-82b5-45c9-aadc-0f53520c909b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038708 Oct 27 03:42:19.319296 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2655/5012] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:42:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:42:19.385821 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b9bf1057-24df-48f6-9e55-dfe501425a62 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:19.394048 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b9bf1057-24df-48f6-9e55-dfe501425a62 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/db0ba858-280c-4ef1-ad3f-15ff7e41af97" status: 200 len: 1498 microversion: 2.1 time: 0.194867 Oct 27 03:42:19.394700 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2358/5013] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:19 2022] GET /compute/v2.1/servers/db0ba858-280c-4ef1-ad3f-15ff7e41af97 => generated 1498 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:19.446487 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7bbaa2c7-883b-4f6d-bf4a-44cc3f88d01d tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:19.451674 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7bbaa2c7-883b-4f6d-bf4a-44cc3f88d01d tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] [instance: 4634ba00-a353-44a2-b49a-7b1bc2fc7e81] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:19.459007 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7bbaa2c7-883b-4f6d-bf4a-44cc3f88d01d tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:19.459737 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7bbaa2c7-883b-4f6d-bf4a-44cc3f88d01d tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:19.460271 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7bbaa2c7-883b-4f6d-bf4a-44cc3f88d01d tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:19.461489 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7bbaa2c7-883b-4f6d-bf4a-44cc3f88d01d tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:19.462139 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7bbaa2c7-883b-4f6d-bf4a-44cc3f88d01d tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:19.462575 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7bbaa2c7-883b-4f6d-bf4a-44cc3f88d01d tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:19.619553 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7bbaa2c7-883b-4f6d-bf4a-44cc3f88d01d tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82daefe001364499b2ee9eb7da2599be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:19.631943 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7bbaa2c7-883b-4f6d-bf4a-44cc3f88d01d tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] 10.222.0.20 "GET /compute/v2.1/servers/4634ba00-a353-44a2-b49a-7b1bc2fc7e81" status: 200 len: 1320 microversion: 2.1 time: 0.191417 Oct 27 03:42:19.634130 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2656/5014] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:19 2022] GET /compute/v2.1/servers/4634ba00-a353-44a2-b49a-7b1bc2fc7e81 => generated 1320 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:19.790410 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1d717ca5-9a03-4348-b583-d2b7231b6b74 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:19.791032 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1d717ca5-9a03-4348-b583-d2b7231b6b74 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: 003c8652-2a85-4abc-8f02-ff46b4afcfd1] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:19.797872 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1d717ca5-9a03-4348-b583-d2b7231b6b74 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:19.798564 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1d717ca5-9a03-4348-b583-d2b7231b6b74 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:19.799212 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1d717ca5-9a03-4348-b583-d2b7231b6b74 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:19.800277 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1d717ca5-9a03-4348-b583-d2b7231b6b74 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:19.801021 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1d717ca5-9a03-4348-b583-d2b7231b6b74 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:19.801759 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1d717ca5-9a03-4348-b583-d2b7231b6b74 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:19.837953 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1d717ca5-9a03-4348-b583-d2b7231b6b74 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:19.838497 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1d717ca5-9a03-4348-b583-d2b7231b6b74 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:19.838946 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1d717ca5-9a03-4348-b583-d2b7231b6b74 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:19.839415 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-1d717ca5-9a03-4348-b583-d2b7231b6b74 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lazy-loading 'fault' on Instance uuid 003c8652-2a85-4abc-8f02-ff46b4afcfd1 {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:42:19.903817 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1d717ca5-9a03-4348-b583-d2b7231b6b74 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18036411a99e4634bfbaeae24b9f254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229dcb63bc41444391544883b576ce2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:19.916623 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1d717ca5-9a03-4348-b583-d2b7231b6b74 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/003c8652-2a85-4abc-8f02-ff46b4afcfd1" status: 200 len: 1331 microversion: 2.1 time: 0.129739 Oct 27 03:42:19.930329 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2359/5015] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:19 2022] GET /compute/v2.1/servers/003c8652-2a85-4abc-8f02-ff46b4afcfd1 => generated 1331 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:19.965703 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f7a01b74-2afb-4af2-a567-1b59d7e99b78 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:19.966373 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f7a01b74-2afb-4af2-a567-1b59d7e99b78 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: c9e02344-a91a-40c8-b8c0-c0abe503204c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:19.974119 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f7a01b74-2afb-4af2-a567-1b59d7e99b78 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:19.974864 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f7a01b74-2afb-4af2-a567-1b59d7e99b78 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:19.975534 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f7a01b74-2afb-4af2-a567-1b59d7e99b78 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:19.976899 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f7a01b74-2afb-4af2-a567-1b59d7e99b78 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:19.977361 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f7a01b74-2afb-4af2-a567-1b59d7e99b78 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:19.977803 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f7a01b74-2afb-4af2-a567-1b59d7e99b78 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:20.014368 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2cd63fda-abaf-4b7d-9a49-75645031ab6d tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:20.015373 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-2cd63fda-abaf-4b7d-9a49-75645031ab6d tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:20.022063 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2cd63fda-abaf-4b7d-9a49-75645031ab6d tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:20.022559 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2cd63fda-abaf-4b7d-9a49-75645031ab6d tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:20.023733 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2cd63fda-abaf-4b7d-9a49-75645031ab6d tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:20.024568 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2cd63fda-abaf-4b7d-9a49-75645031ab6d tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:20.024954 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2cd63fda-abaf-4b7d-9a49-75645031ab6d tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:20.025543 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2cd63fda-abaf-4b7d-9a49-75645031ab6d tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:20.057780 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2cd63fda-abaf-4b7d-9a49-75645031ab6d tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049134 Oct 27 03:42:20.058393 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2360/5016] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 27 03:42:20 2022] GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 27 03:42:20.135904 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-417443dc-ec93-44af-baa4-6b2f9252007a tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:20.142462 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-417443dc-ec93-44af-baa4-6b2f9252007a tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:20.158796 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-417443dc-ec93-44af-baa4-6b2f9252007a tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:20.159920 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-417443dc-ec93-44af-baa4-6b2f9252007a tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:20.162218 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-417443dc-ec93-44af-baa4-6b2f9252007a tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:20.163426 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-417443dc-ec93-44af-baa4-6b2f9252007a tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:20.164595 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-417443dc-ec93-44af-baa4-6b2f9252007a tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:20.165239 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-417443dc-ec93-44af-baa4-6b2f9252007a tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:20.199625 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-417443dc-ec93-44af-baa4-6b2f9252007a tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b] Going to try to terminate instance {{(pid=121000) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:42:20.213368 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f7a01b74-2afb-4af2-a567-1b59d7e99b78 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:20.221309 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f7a01b74-2afb-4af2-a567-1b59d7e99b78 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c" status: 200 len: 1521 microversion: 2.1 time: 0.261250 Oct 27 03:42:20.234141 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2657/5017] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:19 2022] GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:20.423261 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3f1cd626-bcdc-4464-a9a9-cf52deb949e5 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:20.423261 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3f1cd626-bcdc-4464-a9a9-cf52deb949e5 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: db0ba858-280c-4ef1-ad3f-15ff7e41af97] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:20.427474 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3f1cd626-bcdc-4464-a9a9-cf52deb949e5 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:20.428020 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3f1cd626-bcdc-4464-a9a9-cf52deb949e5 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:20.428628 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3f1cd626-bcdc-4464-a9a9-cf52deb949e5 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:20.430192 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3f1cd626-bcdc-4464-a9a9-cf52deb949e5 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:20.430865 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3f1cd626-bcdc-4464-a9a9-cf52deb949e5 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:20.431297 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3f1cd626-bcdc-4464-a9a9-cf52deb949e5 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:20.553387 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-417443dc-ec93-44af-baa4-6b2f9252007a tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "DELETE /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b" status: 204 len: 0 microversion: 2.1 time: 0.424929 Oct 27 03:42:20.558363 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2361/5018] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:42:20 2022] DELETE /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b => generated 0 bytes in 428 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 03:42:20.564093 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0af622c6-e6fc-4acf-addf-2f9f3cff7375 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:20.564812 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0af622c6-e6fc-4acf-addf-2f9f3cff7375 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:20.580209 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0af622c6-e6fc-4acf-addf-2f9f3cff7375 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:20.580713 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0af622c6-e6fc-4acf-addf-2f9f3cff7375 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:20.583615 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0af622c6-e6fc-4acf-addf-2f9f3cff7375 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:20.583615 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0af622c6-e6fc-4acf-addf-2f9f3cff7375 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:20.583823 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3f1cd626-bcdc-4464-a9a9-cf52deb949e5 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:20.583934 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0af622c6-e6fc-4acf-addf-2f9f3cff7375 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:20.583934 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0af622c6-e6fc-4acf-addf-2f9f3cff7375 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:20.593564 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3f1cd626-bcdc-4464-a9a9-cf52deb949e5 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/db0ba858-280c-4ef1-ad3f-15ff7e41af97" status: 200 len: 1498 microversion: 2.1 time: 0.178363 Oct 27 03:42:20.594555 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2658/5019] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:20 2022] GET /compute/v2.1/servers/db0ba858-280c-4ef1-ad3f-15ff7e41af97 => generated 1498 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:20.654875 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-597b4067-726e-4756-8044-083b0857c099 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:20.655570 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-597b4067-726e-4756-8044-083b0857c099 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] [instance: 4634ba00-a353-44a2-b49a-7b1bc2fc7e81] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:20.661821 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-597b4067-726e-4756-8044-083b0857c099 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:20.662528 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-597b4067-726e-4756-8044-083b0857c099 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:20.663144 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-597b4067-726e-4756-8044-083b0857c099 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:20.664861 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-597b4067-726e-4756-8044-083b0857c099 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:20.665582 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-597b4067-726e-4756-8044-083b0857c099 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:20.666196 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-597b4067-726e-4756-8044-083b0857c099 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:20.791265 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0af622c6-e6fc-4acf-addf-2f9f3cff7375 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffc2b1c410149e884a47240b5425e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38450368ef5c4e68ac3c19c7a0a1ce65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:20.799923 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0af622c6-e6fc-4acf-addf-2f9f3cff7375 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b" status: 200 len: 1675 microversion: 2.1 time: 0.240287 Oct 27 03:42:20.800504 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2362/5020] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:20 2022] GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b => generated 1675 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:20.809748 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-597b4067-726e-4756-8044-083b0857c099 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82daefe001364499b2ee9eb7da2599be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:20.817635 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-597b4067-726e-4756-8044-083b0857c099 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] 10.222.0.20 "GET /compute/v2.1/servers/4634ba00-a353-44a2-b49a-7b1bc2fc7e81" status: 200 len: 1320 microversion: 2.1 time: 0.166657 Oct 27 03:42:20.818223 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2659/5021] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:20 2022] GET /compute/v2.1/servers/4634ba00-a353-44a2-b49a-7b1bc2fc7e81 => generated 1320 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:42:20.943495 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a5efde04-15d6-4b76-823f-286c8575d237 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:20.944124 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a5efde04-15d6-4b76-823f-286c8575d237 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: 003c8652-2a85-4abc-8f02-ff46b4afcfd1] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:20.950535 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a5efde04-15d6-4b76-823f-286c8575d237 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:20.951029 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a5efde04-15d6-4b76-823f-286c8575d237 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:20.951499 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a5efde04-15d6-4b76-823f-286c8575d237 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:20.952207 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a5efde04-15d6-4b76-823f-286c8575d237 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:20.953141 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a5efde04-15d6-4b76-823f-286c8575d237 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:20.957337 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a5efde04-15d6-4b76-823f-286c8575d237 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:20.972329 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-a5efde04-15d6-4b76-823f-286c8575d237 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] HTTP exception thrown: Instance 003c8652-2a85-4abc-8f02-ff46b4afcfd1 could not be found. Oct 27 03:42:20.976943 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a5efde04-15d6-4b76-823f-286c8575d237 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Request method failure captured: Oct 27 03:42:20.976943 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/003c8652-2a85-4abc-8f02-ff46b4afcfd1 HTTP/1.1 Oct 27 03:42:20.976943 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:42:20.976943 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:42:20.976943 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:42:20.976943 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:42:20.976943 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:42:20.976943 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:42:20.976943 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:42:20.976943 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:42:20.976943 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfyO20A1D6ympGjQc2k7pGwXBVoOs4AtFX551niq39NWe_HjifvxGvre6cHeeNp8osa7J1PNEE0_yy7-MG05YNEONXkGtR3-F0Zb6-60FxqOiIpeJ5N_dbXBRWjEl88UsCCW068A90fytHXWgtrGlYksZomXGQlrDugSxyxjlY4_NPY Oct 27 03:42:20.976943 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:42:20.976943 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:42:20.976943 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:42:20.976943 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:42:20.976943 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:42:20.976943 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:42:20.976943 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 229dcb63bc41444391544883b576ce2e Oct 27 03:42:20.976943 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-AttachVolumeNegativeTest-199004901 Oct 27 03:42:20.976943 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:42:20.976943 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:42:20.976943 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/229dcb63bc41444391544883b576ce2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/229dcb63bc41444391544883b576ce2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/229dcb63bc41444391544883b576ce2e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_229dcb63bc41444391544883b576ce2e"}]}] Oct 27 03:42:20.976943 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-AttachVolumeNegativeTest-199004901 Oct 27 03:42:20.976943 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 229dcb63bc41444391544883b576ce2e Oct 27 03:42:20.976943 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-199004901 Oct 27 03:42:20.976943 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-AttachVolumeNegativeTest-199004901-project Oct 27 03:42:20.976943 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:42:20.976943 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:42:20.976943 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 18036411a99e4634bfbaeae24b9f254d Oct 27 03:42:20.976943 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-AttachVolumeNegativeTest-199004901-project Oct 27 03:42:20.976943 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:42:20.976943 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 003c8652-2a85-4abc-8f02-ff46b4afcfd1 could not be found. Oct 27 03:42:20.976943 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '003c8652-2a85-4abc-8f02-ff46b4afcfd1'} Oct 27 03:42:20.976943 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:42:20.976943 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:20.976943 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:42:20.976943 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:42:20.976943 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:42:20.976943 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:42:20.976943 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:42:20.976943 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:42:20.976943 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:42:20.976943 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:42:20.976943 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 003c8652-2a85-4abc-8f02-ff46b4afcfd1 could not be found. Oct 27 03:42:20.976943 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:42:20.976943 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:42:20.976943 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:42:20.976943 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:20.976943 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:42:20.976943 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:42:20.976943 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:42:20.976943 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:42:20.976943 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:42:20.976943 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:42:20.976943 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:42:20.976943 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:42:20.976943 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:42:20.976943 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:42:20.976943 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:42:20.976943 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:42:20.976943 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 003c8652-2a85-4abc-8f02-ff46b4afcfd1 could not be found. Oct 27 03:42:20.976943 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:42:20.976943 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:42:20.976943 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:42:20.981056 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:20.981056 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:42:20.981056 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:42:20.981056 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:42:20.981056 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:42:20.981056 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 003c8652-2a85-4abc-8f02-ff46b4afcfd1 could not be found. Oct 27 03:42:20.981056 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:42:20.981056 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a5efde04-15d6-4b76-823f-286c8575d237 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Returning 404 to user: Instance 003c8652-2a85-4abc-8f02-ff46b4afcfd1 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:42:20.981056 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a5efde04-15d6-4b76-823f-286c8575d237 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/003c8652-2a85-4abc-8f02-ff46b4afcfd1" status: 404 len: 111 microversion: 2.1 time: 0.036288 Oct 27 03:42:20.981056 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2363/5022] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:20 2022] GET /compute/v2.1/servers/003c8652-2a85-4abc-8f02-ff46b4afcfd1 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:42:20.985343 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-50246895-d01c-476e-9b6f-2668954eb418 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '.version_select at 0x7f7dd9f445e0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:21.086762 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-50246895-d01c-476e-9b6f-2668954eb418 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-210768671" status: 202 len: 0 microversion: 2.1 time: 0.104847 Oct 27 03:42:21.090243 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2660/5023] 10.222.0.20 () {58 vars in 1218 bytes} [Thu Oct 27 03:42:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-210768671 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 03:42:21.249941 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e7358e70-b95a-4b0b-a0cd-36ec08ce8069 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:21.258256 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e7358e70-b95a-4b0b-a0cd-36ec08ce8069 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: c9e02344-a91a-40c8-b8c0-c0abe503204c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:21.273543 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e7358e70-b95a-4b0b-a0cd-36ec08ce8069 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:21.273543 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e7358e70-b95a-4b0b-a0cd-36ec08ce8069 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:21.273543 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e7358e70-b95a-4b0b-a0cd-36ec08ce8069 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:21.273543 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e7358e70-b95a-4b0b-a0cd-36ec08ce8069 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:21.273543 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e7358e70-b95a-4b0b-a0cd-36ec08ce8069 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:21.273543 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e7358e70-b95a-4b0b-a0cd-36ec08ce8069 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:21.618128 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e3092947-9254-40ef-b486-64d52d92cb28 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:21.618583 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e3092947-9254-40ef-b486-64d52d92cb28 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: db0ba858-280c-4ef1-ad3f-15ff7e41af97] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:21.628085 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e3092947-9254-40ef-b486-64d52d92cb28 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:21.629478 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e3092947-9254-40ef-b486-64d52d92cb28 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:21.630163 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e3092947-9254-40ef-b486-64d52d92cb28 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:21.631502 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e3092947-9254-40ef-b486-64d52d92cb28 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:21.632775 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e3092947-9254-40ef-b486-64d52d92cb28 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:21.633502 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e3092947-9254-40ef-b486-64d52d92cb28 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:21.690191 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e7358e70-b95a-4b0b-a0cd-36ec08ce8069 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:21.699795 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e7358e70-b95a-4b0b-a0cd-36ec08ce8069 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c" status: 200 len: 1521 microversion: 2.1 time: 0.454177 Oct 27 03:42:21.700721 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2364/5024] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:21 2022] GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c => generated 1521 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:21.705796 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-bda3a175-4e70-4177-8029-d9d031c3fde5 req-0997ce69-c34e-48ad-bea2-a6d08c028a35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4634ba00-a353-44a2-b49a-7b1bc2fc7e81", "name": "network-vif-plugged", "status": "completed", "tag": "b030f178-4218-4b6b-a8b2-8e3531ae7161"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:42:21.720638 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-bda3a175-4e70-4177-8029-d9d031c3fde5 req-0997ce69-c34e-48ad-bea2-a6d08c028a35 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:21.728311 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-bda3a175-4e70-4177-8029-d9d031c3fde5 req-0997ce69-c34e-48ad-bea2-a6d08c028a35 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:21.728311 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-bda3a175-4e70-4177-8029-d9d031c3fde5 req-0997ce69-c34e-48ad-bea2-a6d08c028a35 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:21.735649 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-bda3a175-4e70-4177-8029-d9d031c3fde5 req-0997ce69-c34e-48ad-bea2-a6d08c028a35 service nova] Creating event network-vif-plugged:b030f178-4218-4b6b-a8b2-8e3531ae7161 for instance 4634ba00-a353-44a2-b49a-7b1bc2fc7e81 on n-h2-862769-1 Oct 27 03:42:21.740905 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-bda3a175-4e70-4177-8029-d9d031c3fde5 req-0997ce69-c34e-48ad-bea2-a6d08c028a35 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038648 Oct 27 03:42:21.742348 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2365/5025] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:42:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:42:21.824342 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1dd902e6-d245-4511-a375-0f201d28d02c tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:21.825040 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1dd902e6-d245-4511-a375-0f201d28d02c tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:21.831599 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1dd902e6-d245-4511-a375-0f201d28d02c tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:21.832327 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1dd902e6-d245-4511-a375-0f201d28d02c tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:21.836685 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1dd902e6-d245-4511-a375-0f201d28d02c tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:21.837809 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1dd902e6-d245-4511-a375-0f201d28d02c tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:21.838468 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1dd902e6-d245-4511-a375-0f201d28d02c tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:21.839277 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1dd902e6-d245-4511-a375-0f201d28d02c tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:21.930138 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e3092947-9254-40ef-b486-64d52d92cb28 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:21.941529 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e3092947-9254-40ef-b486-64d52d92cb28 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/db0ba858-280c-4ef1-ad3f-15ff7e41af97" status: 200 len: 1498 microversion: 2.1 time: 0.328462 Oct 27 03:42:21.943354 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2661/5026] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:21 2022] GET /compute/v2.1/servers/db0ba858-280c-4ef1-ad3f-15ff7e41af97 => generated 1498 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:42:21.949767 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7785d667-d113-4a03-b566-ab70f3737530 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:21.950822 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7785d667-d113-4a03-b566-ab70f3737530 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] [instance: 4634ba00-a353-44a2-b49a-7b1bc2fc7e81] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:21.964415 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7785d667-d113-4a03-b566-ab70f3737530 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:21.965232 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7785d667-d113-4a03-b566-ab70f3737530 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:21.965898 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7785d667-d113-4a03-b566-ab70f3737530 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:21.968117 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7785d667-d113-4a03-b566-ab70f3737530 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:21.968764 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7785d667-d113-4a03-b566-ab70f3737530 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:21.969377 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7785d667-d113-4a03-b566-ab70f3737530 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:22.158927 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1dd902e6-d245-4511-a375-0f201d28d02c tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffc2b1c410149e884a47240b5425e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38450368ef5c4e68ac3c19c7a0a1ce65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:22.160479 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7785d667-d113-4a03-b566-ab70f3737530 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82daefe001364499b2ee9eb7da2599be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:22.171791 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7785d667-d113-4a03-b566-ab70f3737530 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] 10.222.0.20 "GET /compute/v2.1/servers/4634ba00-a353-44a2-b49a-7b1bc2fc7e81" status: 200 len: 1320 microversion: 2.1 time: 0.227053 Oct 27 03:42:22.171994 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1dd902e6-d245-4511-a375-0f201d28d02c tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b" status: 200 len: 1675 microversion: 2.1 time: 0.348536 Oct 27 03:42:22.172741 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2662/5027] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:21 2022] GET /compute/v2.1/servers/4634ba00-a353-44a2-b49a-7b1bc2fc7e81 => generated 1320 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:22.173354 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2366/5028] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:21 2022] GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b => generated 1675 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:42:22.179724 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-f81478de-0aa0-4492-badb-097210b04e42 req-30b8f79c-eca6-488e-87ba-c6a0a521d37f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db0ba858-280c-4ef1-ad3f-15ff7e41af97", "name": "network-vif-deleted", "tag": "c229c134-237a-47a0-80b1-b6363b9dcd36"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:42:22.201376 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-f81478de-0aa0-4492-badb-097210b04e42 req-30b8f79c-eca6-488e-87ba-c6a0a521d37f service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:22.201880 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-f81478de-0aa0-4492-badb-097210b04e42 req-30b8f79c-eca6-488e-87ba-c6a0a521d37f service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:22.202361 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-f81478de-0aa0-4492-badb-097210b04e42 req-30b8f79c-eca6-488e-87ba-c6a0a521d37f service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:22.225189 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-f81478de-0aa0-4492-badb-097210b04e42 req-30b8f79c-eca6-488e-87ba-c6a0a521d37f service nova] Creating event network-vif-deleted:c229c134-237a-47a0-80b1-b6363b9dcd36 for instance db0ba858-280c-4ef1-ad3f-15ff7e41af97 on n-h2-862769-1 Oct 27 03:42:22.233279 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-f81478de-0aa0-4492-badb-097210b04e42 req-30b8f79c-eca6-488e-87ba-c6a0a521d37f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057878 Oct 27 03:42:22.234460 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2663/5029] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:42:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:42:22.727565 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e1f521e7-c9a6-4bc3-ac6f-dcad61e65614 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:22.728191 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e1f521e7-c9a6-4bc3-ac6f-dcad61e65614 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: c9e02344-a91a-40c8-b8c0-c0abe503204c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:22.744936 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e1f521e7-c9a6-4bc3-ac6f-dcad61e65614 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:22.744936 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e1f521e7-c9a6-4bc3-ac6f-dcad61e65614 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:22.764718 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e1f521e7-c9a6-4bc3-ac6f-dcad61e65614 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:22.765559 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e1f521e7-c9a6-4bc3-ac6f-dcad61e65614 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:22.767641 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e1f521e7-c9a6-4bc3-ac6f-dcad61e65614 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:22.767641 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e1f521e7-c9a6-4bc3-ac6f-dcad61e65614 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:22.929915 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e1f521e7-c9a6-4bc3-ac6f-dcad61e65614 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:22.958768 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e1f521e7-c9a6-4bc3-ac6f-dcad61e65614 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c" status: 200 len: 1521 microversion: 2.1 time: 0.226652 Oct 27 03:42:22.975193 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2367/5030] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:22 2022] GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c => generated 1521 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:22.989454 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b501dfec-c2b6-4d5f-8b17-025644187caa tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:22.993287 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b501dfec-c2b6-4d5f-8b17-025644187caa tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: db0ba858-280c-4ef1-ad3f-15ff7e41af97] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:23.020007 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b501dfec-c2b6-4d5f-8b17-025644187caa tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:23.020007 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b501dfec-c2b6-4d5f-8b17-025644187caa tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:23.020007 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b501dfec-c2b6-4d5f-8b17-025644187caa tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:23.020007 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b501dfec-c2b6-4d5f-8b17-025644187caa tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:23.020007 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b501dfec-c2b6-4d5f-8b17-025644187caa tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:23.020007 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b501dfec-c2b6-4d5f-8b17-025644187caa tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:23.074208 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b501dfec-c2b6-4d5f-8b17-025644187caa tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:23.075548 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b501dfec-c2b6-4d5f-8b17-025644187caa tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:23.077026 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b501dfec-c2b6-4d5f-8b17-025644187caa tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:23.077967 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-b501dfec-c2b6-4d5f-8b17-025644187caa tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lazy-loading 'fault' on Instance uuid db0ba858-280c-4ef1-ad3f-15ff7e41af97 {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:42:23.152080 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b501dfec-c2b6-4d5f-8b17-025644187caa tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cc79af058b4c35b3c572448fac86a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911997e881754ce390af17919f29b4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:23.160555 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b501dfec-c2b6-4d5f-8b17-025644187caa tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/db0ba858-280c-4ef1-ad3f-15ff7e41af97" status: 200 len: 1304 microversion: 2.1 time: 0.182551 Oct 27 03:42:23.161729 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2664/5031] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:22 2022] GET /compute/v2.1/servers/db0ba858-280c-4ef1-ad3f-15ff7e41af97 => generated 1304 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:42:23.201292 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-74736ddf-ef38-462a-925c-0556c199952e tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:23.201979 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-74736ddf-ef38-462a-925c-0556c199952e tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] [instance: 4634ba00-a353-44a2-b49a-7b1bc2fc7e81] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:23.211369 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-df445172-137e-4fd6-9ef8-6b40d33735b0 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:23.212309 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-df445172-137e-4fd6-9ef8-6b40d33735b0 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:23.212442 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-74736ddf-ef38-462a-925c-0556c199952e tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:23.212938 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-74736ddf-ef38-462a-925c-0556c199952e tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:23.213653 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-74736ddf-ef38-462a-925c-0556c199952e tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:23.215676 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:42:23.216897 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-74736ddf-ef38-462a-925c-0556c199952e tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:23.217722 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-74736ddf-ef38-462a-925c-0556c199952e tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:23.218910 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-74736ddf-ef38-462a-925c-0556c199952e tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:23.234174 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-df445172-137e-4fd6-9ef8-6b40d33735b0 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:23.234933 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-df445172-137e-4fd6-9ef8-6b40d33735b0 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:23.242223 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-df445172-137e-4fd6-9ef8-6b40d33735b0 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:23.242223 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-df445172-137e-4fd6-9ef8-6b40d33735b0 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:23.242223 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-df445172-137e-4fd6-9ef8-6b40d33735b0 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:23.242223 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-df445172-137e-4fd6-9ef8-6b40d33735b0 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:23.417203 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-74736ddf-ef38-462a-925c-0556c199952e tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82daefe001364499b2ee9eb7da2599be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:23.421848 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:42:23.431309 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-74736ddf-ef38-462a-925c-0556c199952e tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] 10.222.0.20 "GET /compute/v2.1/servers/4634ba00-a353-44a2-b49a-7b1bc2fc7e81" status: 200 len: 1320 microversion: 2.1 time: 0.232598 Oct 27 03:42:23.433627 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2368/5032] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:23 2022] GET /compute/v2.1/servers/4634ba00-a353-44a2-b49a-7b1bc2fc7e81 => generated 1320 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:23.558990 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-df445172-137e-4fd6-9ef8-6b40d33735b0 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffc2b1c410149e884a47240b5425e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38450368ef5c4e68ac3c19c7a0a1ce65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:23.574417 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-df445172-137e-4fd6-9ef8-6b40d33735b0 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b" status: 200 len: 1675 microversion: 2.1 time: 0.368109 Oct 27 03:42:23.575701 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2665/5033] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:23 2022] GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b => generated 1675 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:23.757791 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-e30d0861-a34b-4400-b2ee-6bc9f7529e44 req-86ffa34a-aca5-423a-b174-e76101103b1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dd4eda6-95aa-4130-87e5-2986d6b95536", "name": "network-vif-plugged", "status": "completed", "tag": "c145bd52-e31c-495c-b5c9-8d9b40e2a275"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:42:23.779400 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-e30d0861-a34b-4400-b2ee-6bc9f7529e44 req-86ffa34a-aca5-423a-b174-e76101103b1d service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:23.790998 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-e30d0861-a34b-4400-b2ee-6bc9f7529e44 req-86ffa34a-aca5-423a-b174-e76101103b1d service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:23.791707 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-e30d0861-a34b-4400-b2ee-6bc9f7529e44 req-86ffa34a-aca5-423a-b174-e76101103b1d service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:23.807914 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-e30d0861-a34b-4400-b2ee-6bc9f7529e44 req-86ffa34a-aca5-423a-b174-e76101103b1d service nova] Creating event network-vif-plugged:c145bd52-e31c-495c-b5c9-8d9b40e2a275 for instance 0dd4eda6-95aa-4130-87e5-2986d6b95536 on n-h2-862769-1 Oct 27 03:42:23.813685 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-e30d0861-a34b-4400-b2ee-6bc9f7529e44 req-86ffa34a-aca5-423a-b174-e76101103b1d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060432 Oct 27 03:42:23.815657 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2369/5034] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:42:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:42:24.001045 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a4b6d87a-50f5-44d1-b9db-3ffce09a04e1 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:24.001687 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a4b6d87a-50f5-44d1-b9db-3ffce09a04e1 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: c9e02344-a91a-40c8-b8c0-c0abe503204c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:24.010504 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a4b6d87a-50f5-44d1-b9db-3ffce09a04e1 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:24.011386 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a4b6d87a-50f5-44d1-b9db-3ffce09a04e1 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:24.012039 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a4b6d87a-50f5-44d1-b9db-3ffce09a04e1 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:24.012962 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a4b6d87a-50f5-44d1-b9db-3ffce09a04e1 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:24.013610 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a4b6d87a-50f5-44d1-b9db-3ffce09a04e1 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:24.014427 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a4b6d87a-50f5-44d1-b9db-3ffce09a04e1 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:24.216766 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4f971d5b-895f-463b-943f-c486c20797f2 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:24.219169 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4f971d5b-895f-463b-943f-c486c20797f2 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: db0ba858-280c-4ef1-ad3f-15ff7e41af97] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:24.230800 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4f971d5b-895f-463b-943f-c486c20797f2 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:24.236437 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4f971d5b-895f-463b-943f-c486c20797f2 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:24.240218 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4f971d5b-895f-463b-943f-c486c20797f2 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:24.240218 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4f971d5b-895f-463b-943f-c486c20797f2 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:24.240218 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4f971d5b-895f-463b-943f-c486c20797f2 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:24.241454 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4f971d5b-895f-463b-943f-c486c20797f2 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:24.269412 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-4f971d5b-895f-463b-943f-c486c20797f2 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] HTTP exception thrown: Instance db0ba858-280c-4ef1-ad3f-15ff7e41af97 could not be found. Oct 27 03:42:24.271434 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4f971d5b-895f-463b-943f-c486c20797f2 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Request method failure captured: Oct 27 03:42:24.271434 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/db0ba858-280c-4ef1-ad3f-15ff7e41af97 HTTP/1.1 Oct 27 03:42:24.271434 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:42:24.271434 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:42:24.271434 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:42:24.271434 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:42:24.271434 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:42:24.271434 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:42:24.271434 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:42:24.271434 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:42:24.271434 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfz83jPBQR-IO_RgpXfqqqN_tSIl3Aju213bQLpPTkR-R_lkTGSpHz1Evy7Lbg7I5hWxU9AxviJyxNS0i-wRdj1_O4LyvZEjE6jerjzwB22Vu4S-ThF8W8FJgumwczGUcQup-Bjpiay7kN0UoT8q0uFoQytE3MKt1MX9CDbsUgcc03A Oct 27 03:42:24.271434 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:42:24.271434 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:42:24.271434 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:42:24.271434 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:42:24.271434 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:42:24.271434 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:42:24.271434 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 911997e881754ce390af17919f29b4ab Oct 27 03:42:24.271434 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-DeleteServersTestJSON-858473437 Oct 27 03:42:24.271434 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:42:24.271434 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:42:24.271434 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/911997e881754ce390af17919f29b4ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/911997e881754ce390af17919f29b4ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/911997e881754ce390af17919f29b4ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_911997e881754ce390af17919f29b4ab"}]}] Oct 27 03:42:24.271434 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-DeleteServersTestJSON-858473437 Oct 27 03:42:24.271434 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 911997e881754ce390af17919f29b4ab Oct 27 03:42:24.271434 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-DeleteServersTestJSON-858473437 Oct 27 03:42:24.271434 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-DeleteServersTestJSON-858473437-project Oct 27 03:42:24.271434 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:42:24.271434 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:42:24.271434 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: b1cc79af058b4c35b3c572448fac86a7 Oct 27 03:42:24.271434 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-DeleteServersTestJSON-858473437-project Oct 27 03:42:24.271434 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:42:24.271434 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance db0ba858-280c-4ef1-ad3f-15ff7e41af97 could not be found. Oct 27 03:42:24.271434 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': 'db0ba858-280c-4ef1-ad3f-15ff7e41af97'} Oct 27 03:42:24.271434 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:42:24.271434 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:24.271434 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:42:24.271434 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:42:24.271434 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:42:24.271434 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:42:24.271434 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:42:24.271434 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:42:24.271434 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:42:24.271434 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:42:24.271434 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db0ba858-280c-4ef1-ad3f-15ff7e41af97 could not be found. Oct 27 03:42:24.271434 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:42:24.271434 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:42:24.271434 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:42:24.271434 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:24.271434 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:42:24.271434 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:42:24.271434 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:42:24.271434 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:42:24.271434 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:42:24.271434 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:42:24.271434 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:42:24.271434 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:42:24.271434 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:42:24.271434 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:42:24.271434 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:42:24.271434 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:42:24.271434 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db0ba858-280c-4ef1-ad3f-15ff7e41af97 could not be found. Oct 27 03:42:24.271434 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:42:24.271434 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:42:24.271434 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:42:24.277356 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:24.277356 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:42:24.277356 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:42:24.277356 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:42:24.277356 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:42:24.277356 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db0ba858-280c-4ef1-ad3f-15ff7e41af97 could not be found. Oct 27 03:42:24.277356 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:42:24.277356 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4f971d5b-895f-463b-943f-c486c20797f2 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Returning 404 to user: Instance db0ba858-280c-4ef1-ad3f-15ff7e41af97 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:42:24.277356 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4f971d5b-895f-463b-943f-c486c20797f2 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/db0ba858-280c-4ef1-ad3f-15ff7e41af97" status: 404 len: 111 microversion: 2.1 time: 0.075164 Oct 27 03:42:24.278313 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a4b6d87a-50f5-44d1-b9db-3ffce09a04e1 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:24.284198 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2370/5035] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:24 2022] GET /compute/v2.1/servers/db0ba858-280c-4ef1-ad3f-15ff7e41af97 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:42:24.289296 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-93f21df6-77cc-4737-80a1-fef35114061d tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:24.290077 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-93f21df6-77cc-4737-80a1-fef35114061d tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: db0ba858-280c-4ef1-ad3f-15ff7e41af97] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:24.292039 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a4b6d87a-50f5-44d1-b9db-3ffce09a04e1 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c" status: 200 len: 1521 microversion: 2.1 time: 0.294175 Oct 27 03:42:24.292039 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2666/5036] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:23 2022] GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c => generated 1521 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:24.317487 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-93f21df6-77cc-4737-80a1-fef35114061d tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:24.317906 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-93f21df6-77cc-4737-80a1-fef35114061d tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:24.318390 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-93f21df6-77cc-4737-80a1-fef35114061d tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:24.319149 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-93f21df6-77cc-4737-80a1-fef35114061d tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:24.320543 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-93f21df6-77cc-4737-80a1-fef35114061d tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:24.320985 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-93f21df6-77cc-4737-80a1-fef35114061d tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:24.349156 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-93f21df6-77cc-4737-80a1-fef35114061d tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] HTTP exception thrown: Instance db0ba858-280c-4ef1-ad3f-15ff7e41af97 could not be found. Oct 27 03:42:24.351612 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-93f21df6-77cc-4737-80a1-fef35114061d tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Request method failure captured: Oct 27 03:42:24.351612 n-d-862769-1 devstack@n-api.service[121000]: request: DELETE /compute/v2.1/servers/db0ba858-280c-4ef1-ad3f-15ff7e41af97 HTTP/1.1 Oct 27 03:42:24.351612 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:42:24.351612 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:42:24.351612 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:42:24.351612 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:42:24.351612 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:42:24.351612 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:42:24.351612 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:42:24.351612 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:42:24.351612 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfz83jPBQR-IO_RgpXfqqqN_tSIl3Aju213bQLpPTkR-R_lkTGSpHz1Evy7Lbg7I5hWxU9AxviJyxNS0i-wRdj1_O4LyvZEjE6jerjzwB22Vu4S-ThF8W8FJgumwczGUcQup-Bjpiay7kN0UoT8q0uFoQytE3MKt1MX9CDbsUgcc03A Oct 27 03:42:24.351612 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:42:24.351612 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:42:24.351612 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:42:24.351612 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:42:24.351612 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:42:24.351612 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:42:24.351612 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 911997e881754ce390af17919f29b4ab Oct 27 03:42:24.351612 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-DeleteServersTestJSON-858473437 Oct 27 03:42:24.351612 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:42:24.351612 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:42:24.351612 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/911997e881754ce390af17919f29b4ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/911997e881754ce390af17919f29b4ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/911997e881754ce390af17919f29b4ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_911997e881754ce390af17919f29b4ab"}]}] Oct 27 03:42:24.351612 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-DeleteServersTestJSON-858473437 Oct 27 03:42:24.351612 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 911997e881754ce390af17919f29b4ab Oct 27 03:42:24.351612 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-DeleteServersTestJSON-858473437 Oct 27 03:42:24.351612 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-DeleteServersTestJSON-858473437-project Oct 27 03:42:24.351612 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:42:24.351612 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:42:24.351612 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: b1cc79af058b4c35b3c572448fac86a7 Oct 27 03:42:24.351612 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-DeleteServersTestJSON-858473437-project Oct 27 03:42:24.351612 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:42:24.351612 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance db0ba858-280c-4ef1-ad3f-15ff7e41af97 could not be found. Oct 27 03:42:24.351612 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': 'db0ba858-280c-4ef1-ad3f-15ff7e41af97'} Oct 27 03:42:24.351612 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:42:24.351612 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:24.351612 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:42:24.351612 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:42:24.351612 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:42:24.351612 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:42:24.351612 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:42:24.351612 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:42:24.351612 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:42:24.351612 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:42:24.351612 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db0ba858-280c-4ef1-ad3f-15ff7e41af97 could not be found. Oct 27 03:42:24.351612 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:42:24.351612 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:42:24.351612 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:42:24.351612 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:24.351612 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:42:24.351612 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:42:24.351612 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:42:24.351612 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:42:24.351612 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:42:24.351612 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:42:24.351612 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 03:42:24.351612 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 03:42:24.351612 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 03:42:24.351612 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 03:42:24.351612 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:42:24.351612 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:42:24.351612 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:42:24.351612 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:42:24.355316 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db0ba858-280c-4ef1-ad3f-15ff7e41af97 could not be found. Oct 27 03:42:24.355316 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:42:24.355316 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:42:24.355316 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:42:24.355316 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:24.355316 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:42:24.355316 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:42:24.355316 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:42:24.355316 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:42:24.355316 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db0ba858-280c-4ef1-ad3f-15ff7e41af97 could not be found. Oct 27 03:42:24.355316 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:42:24.355316 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-93f21df6-77cc-4737-80a1-fef35114061d tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Returning 404 to user: Instance db0ba858-280c-4ef1-ad3f-15ff7e41af97 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:42:24.355316 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-93f21df6-77cc-4737-80a1-fef35114061d tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "DELETE /compute/v2.1/servers/db0ba858-280c-4ef1-ad3f-15ff7e41af97" status: 404 len: 111 microversion: 2.1 time: 0.068448 Oct 27 03:42:24.355316 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2371/5037] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:42:24 2022] DELETE /compute/v2.1/servers/db0ba858-280c-4ef1-ad3f-15ff7e41af97 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:42:24.364473 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7b7e945e-5319-4d64-85da-3af3499ddb2a tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:24.365109 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7b7e945e-5319-4d64-85da-3af3499ddb2a tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: db0ba858-280c-4ef1-ad3f-15ff7e41af97] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:24.379022 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7b7e945e-5319-4d64-85da-3af3499ddb2a tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:24.379706 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7b7e945e-5319-4d64-85da-3af3499ddb2a tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:24.380254 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7b7e945e-5319-4d64-85da-3af3499ddb2a tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:24.381178 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7b7e945e-5319-4d64-85da-3af3499ddb2a tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:24.381750 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7b7e945e-5319-4d64-85da-3af3499ddb2a tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:24.383589 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7b7e945e-5319-4d64-85da-3af3499ddb2a tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:24.402912 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-59a4b9be-25cc-48ae-b85a-3e856952245f req-034ed73e-59b3-41e2-a909-8089126e8f3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b", "name": "network-vif-deleted", "tag": "a17729b0-068d-4ef4-8788-ff96c4c95fc2"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:42:24.417835 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-59a4b9be-25cc-48ae-b85a-3e856952245f req-034ed73e-59b3-41e2-a909-8089126e8f3f service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:24.426535 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-59a4b9be-25cc-48ae-b85a-3e856952245f req-034ed73e-59b3-41e2-a909-8089126e8f3f service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:24.427046 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-59a4b9be-25cc-48ae-b85a-3e856952245f req-034ed73e-59b3-41e2-a909-8089126e8f3f service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:24.440176 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-7b7e945e-5319-4d64-85da-3af3499ddb2a tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] HTTP exception thrown: Instance db0ba858-280c-4ef1-ad3f-15ff7e41af97 could not be found. Oct 27 03:42:24.441956 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-59a4b9be-25cc-48ae-b85a-3e856952245f req-034ed73e-59b3-41e2-a909-8089126e8f3f service nova] Creating event network-vif-deleted:a17729b0-068d-4ef4-8788-ff96c4c95fc2 for instance db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b on n-h1-862769-1 Oct 27 03:42:24.442356 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7b7e945e-5319-4d64-85da-3af3499ddb2a tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Request method failure captured: Oct 27 03:42:24.442356 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/db0ba858-280c-4ef1-ad3f-15ff7e41af97 HTTP/1.1 Oct 27 03:42:24.442356 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:42:24.442356 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:42:24.442356 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:42:24.442356 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:42:24.442356 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:42:24.442356 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:42:24.442356 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:42:24.442356 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:42:24.442356 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfz83jPBQR-IO_RgpXfqqqN_tSIl3Aju213bQLpPTkR-R_lkTGSpHz1Evy7Lbg7I5hWxU9AxviJyxNS0i-wRdj1_O4LyvZEjE6jerjzwB22Vu4S-ThF8W8FJgumwczGUcQup-Bjpiay7kN0UoT8q0uFoQytE3MKt1MX9CDbsUgcc03A Oct 27 03:42:24.442356 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:42:24.442356 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:42:24.442356 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:42:24.442356 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:42:24.442356 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:42:24.442356 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:42:24.442356 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 911997e881754ce390af17919f29b4ab Oct 27 03:42:24.442356 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-DeleteServersTestJSON-858473437 Oct 27 03:42:24.442356 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:42:24.442356 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:42:24.442356 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/911997e881754ce390af17919f29b4ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/911997e881754ce390af17919f29b4ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/911997e881754ce390af17919f29b4ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_911997e881754ce390af17919f29b4ab"}]}] Oct 27 03:42:24.442356 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-DeleteServersTestJSON-858473437 Oct 27 03:42:24.442356 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 911997e881754ce390af17919f29b4ab Oct 27 03:42:24.442356 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-DeleteServersTestJSON-858473437 Oct 27 03:42:24.442356 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-DeleteServersTestJSON-858473437-project Oct 27 03:42:24.442356 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:42:24.442356 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:42:24.442356 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: b1cc79af058b4c35b3c572448fac86a7 Oct 27 03:42:24.442356 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-DeleteServersTestJSON-858473437-project Oct 27 03:42:24.442356 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:42:24.442356 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance db0ba858-280c-4ef1-ad3f-15ff7e41af97 could not be found. Oct 27 03:42:24.442356 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': 'db0ba858-280c-4ef1-ad3f-15ff7e41af97'} Oct 27 03:42:24.442356 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:42:24.442356 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:24.442356 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:42:24.442356 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:42:24.442356 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:42:24.442356 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:42:24.442356 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:42:24.442356 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:42:24.442356 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:42:24.442356 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:42:24.442356 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db0ba858-280c-4ef1-ad3f-15ff7e41af97 could not be found. Oct 27 03:42:24.442356 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:42:24.442356 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:42:24.442356 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:42:24.442356 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:24.442356 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:42:24.442356 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:42:24.442356 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:42:24.442356 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:42:24.442356 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:42:24.442356 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:42:24.442356 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:42:24.442356 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:42:24.442356 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:42:24.442356 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:42:24.442356 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:42:24.442356 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:42:24.442356 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db0ba858-280c-4ef1-ad3f-15ff7e41af97 could not be found. Oct 27 03:42:24.442356 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:42:24.442356 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:42:24.442356 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:42:24.447745 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:24.447745 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:42:24.447745 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:42:24.447745 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:42:24.447745 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:42:24.447745 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db0ba858-280c-4ef1-ad3f-15ff7e41af97 could not be found. Oct 27 03:42:24.447745 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:42:24.452028 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7b7e945e-5319-4d64-85da-3af3499ddb2a tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Returning 404 to user: Instance db0ba858-280c-4ef1-ad3f-15ff7e41af97 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:42:24.455014 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7b7e945e-5319-4d64-85da-3af3499ddb2a tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/db0ba858-280c-4ef1-ad3f-15ff7e41af97" status: 404 len: 111 microversion: 2.1 time: 0.094491 Oct 27 03:42:24.458601 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2667/5038] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:24 2022] GET /compute/v2.1/servers/db0ba858-280c-4ef1-ad3f-15ff7e41af97 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:42:24.469883 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2b2d1245-108c-4199-855c-76f56a213d35 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:24.470691 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2b2d1245-108c-4199-855c-76f56a213d35 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] [instance: 4634ba00-a353-44a2-b49a-7b1bc2fc7e81] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:24.473130 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-59a4b9be-25cc-48ae-b85a-3e856952245f req-034ed73e-59b3-41e2-a909-8089126e8f3f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073855 Oct 27 03:42:24.473812 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2372/5039] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:42:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:42:24.480861 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2b2d1245-108c-4199-855c-76f56a213d35 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:24.493645 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ccc97f49-c2b2-4dd6-a852-ba3bf4b26320 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:24.493645 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ccc97f49-c2b2-4dd6-a852-ba3bf4b26320 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: ac9da5d0-c534-4955-b148-f401c9308618] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:24.494570 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2b2d1245-108c-4199-855c-76f56a213d35 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:24.495316 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2b2d1245-108c-4199-855c-76f56a213d35 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:24.496382 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2b2d1245-108c-4199-855c-76f56a213d35 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:24.497096 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2b2d1245-108c-4199-855c-76f56a213d35 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:24.497728 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2b2d1245-108c-4199-855c-76f56a213d35 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:24.512254 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ccc97f49-c2b2-4dd6-a852-ba3bf4b26320 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:24.512778 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ccc97f49-c2b2-4dd6-a852-ba3bf4b26320 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:24.513218 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ccc97f49-c2b2-4dd6-a852-ba3bf4b26320 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:24.517647 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ccc97f49-c2b2-4dd6-a852-ba3bf4b26320 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:24.517647 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ccc97f49-c2b2-4dd6-a852-ba3bf4b26320 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:24.517647 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ccc97f49-c2b2-4dd6-a852-ba3bf4b26320 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:24.538233 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-ccc97f49-c2b2-4dd6-a852-ba3bf4b26320 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] HTTP exception thrown: Instance ac9da5d0-c534-4955-b148-f401c9308618 could not be found. Oct 27 03:42:24.540576 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ccc97f49-c2b2-4dd6-a852-ba3bf4b26320 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Request method failure captured: Oct 27 03:42:24.540576 n-d-862769-1 devstack@n-api.service[121000]: request: DELETE /compute/v2.1/servers/ac9da5d0-c534-4955-b148-f401c9308618 HTTP/1.1 Oct 27 03:42:24.540576 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:42:24.540576 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:42:24.540576 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:42:24.540576 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:42:24.540576 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:42:24.540576 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:42:24.540576 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:42:24.540576 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:42:24.540576 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfz83jPBQR-IO_RgpXfqqqN_tSIl3Aju213bQLpPTkR-R_lkTGSpHz1Evy7Lbg7I5hWxU9AxviJyxNS0i-wRdj1_O4LyvZEjE6jerjzwB22Vu4S-ThF8W8FJgumwczGUcQup-Bjpiay7kN0UoT8q0uFoQytE3MKt1MX9CDbsUgcc03A Oct 27 03:42:24.540576 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:42:24.540576 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:42:24.540576 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:42:24.540576 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:42:24.540576 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:42:24.540576 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:42:24.540576 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 911997e881754ce390af17919f29b4ab Oct 27 03:42:24.540576 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-DeleteServersTestJSON-858473437 Oct 27 03:42:24.540576 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:42:24.540576 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:42:24.540576 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/911997e881754ce390af17919f29b4ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/911997e881754ce390af17919f29b4ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/911997e881754ce390af17919f29b4ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_911997e881754ce390af17919f29b4ab"}]}] Oct 27 03:42:24.540576 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-DeleteServersTestJSON-858473437 Oct 27 03:42:24.540576 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 911997e881754ce390af17919f29b4ab Oct 27 03:42:24.540576 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-DeleteServersTestJSON-858473437 Oct 27 03:42:24.540576 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-DeleteServersTestJSON-858473437-project Oct 27 03:42:24.540576 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:42:24.540576 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:42:24.540576 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: b1cc79af058b4c35b3c572448fac86a7 Oct 27 03:42:24.540576 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-DeleteServersTestJSON-858473437-project Oct 27 03:42:24.540576 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:42:24.540576 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance ac9da5d0-c534-4955-b148-f401c9308618 could not be found. Oct 27 03:42:24.540576 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': 'ac9da5d0-c534-4955-b148-f401c9308618'} Oct 27 03:42:24.540576 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:42:24.540576 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:24.540576 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:42:24.540576 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:42:24.540576 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:42:24.540576 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:42:24.540576 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:42:24.540576 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:42:24.540576 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:42:24.540576 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:42:24.540576 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac9da5d0-c534-4955-b148-f401c9308618 could not be found. Oct 27 03:42:24.540576 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:42:24.540576 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:42:24.540576 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:42:24.540576 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:24.540576 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:42:24.540576 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:42:24.540576 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:42:24.540576 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:42:24.540576 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:42:24.540576 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:42:24.540576 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 03:42:24.540576 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 03:42:24.540576 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 03:42:24.540576 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 03:42:24.540576 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:42:24.540576 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:42:24.540576 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:42:24.540576 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:42:24.544705 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac9da5d0-c534-4955-b148-f401c9308618 could not be found. Oct 27 03:42:24.544705 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:42:24.544705 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:42:24.544705 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:42:24.544705 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:24.544705 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:42:24.544705 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:42:24.544705 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:42:24.544705 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:42:24.544705 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac9da5d0-c534-4955-b148-f401c9308618 could not be found. Oct 27 03:42:24.544705 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:42:24.544705 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ccc97f49-c2b2-4dd6-a852-ba3bf4b26320 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Returning 404 to user: Instance ac9da5d0-c534-4955-b148-f401c9308618 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:42:24.544705 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ccc97f49-c2b2-4dd6-a852-ba3bf4b26320 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ac9da5d0-c534-4955-b148-f401c9308618" status: 404 len: 111 microversion: 2.1 time: 0.067379 Oct 27 03:42:24.544705 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2373/5040] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:42:24 2022] DELETE /compute/v2.1/servers/ac9da5d0-c534-4955-b148-f401c9308618 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:42:24.554802 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f4ca35a9-9bb3-4565-8c8d-cd97d9aece5d tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:24.555861 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f4ca35a9-9bb3-4565-8c8d-cd97d9aece5d tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: ac9da5d0-c534-4955-b148-f401c9308618] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:24.563190 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f4ca35a9-9bb3-4565-8c8d-cd97d9aece5d tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:24.563963 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f4ca35a9-9bb3-4565-8c8d-cd97d9aece5d tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:24.564570 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f4ca35a9-9bb3-4565-8c8d-cd97d9aece5d tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:24.565442 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f4ca35a9-9bb3-4565-8c8d-cd97d9aece5d tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:24.566132 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f4ca35a9-9bb3-4565-8c8d-cd97d9aece5d tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:24.566834 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f4ca35a9-9bb3-4565-8c8d-cd97d9aece5d tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:24.593051 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-f4ca35a9-9bb3-4565-8c8d-cd97d9aece5d tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] HTTP exception thrown: Instance ac9da5d0-c534-4955-b148-f401c9308618 could not be found. Oct 27 03:42:24.594639 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f4ca35a9-9bb3-4565-8c8d-cd97d9aece5d tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Request method failure captured: Oct 27 03:42:24.594639 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/ac9da5d0-c534-4955-b148-f401c9308618 HTTP/1.1 Oct 27 03:42:24.594639 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:42:24.594639 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:42:24.594639 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:42:24.594639 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:42:24.594639 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:42:24.594639 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:42:24.594639 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:42:24.594639 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:42:24.594639 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfz83jPBQR-IO_RgpXfqqqN_tSIl3Aju213bQLpPTkR-R_lkTGSpHz1Evy7Lbg7I5hWxU9AxviJyxNS0i-wRdj1_O4LyvZEjE6jerjzwB22Vu4S-ThF8W8FJgumwczGUcQup-Bjpiay7kN0UoT8q0uFoQytE3MKt1MX9CDbsUgcc03A Oct 27 03:42:24.594639 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:42:24.594639 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:42:24.594639 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:42:24.594639 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:42:24.594639 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:42:24.594639 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:42:24.594639 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 911997e881754ce390af17919f29b4ab Oct 27 03:42:24.594639 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-DeleteServersTestJSON-858473437 Oct 27 03:42:24.594639 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:42:24.594639 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:42:24.594639 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/911997e881754ce390af17919f29b4ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/911997e881754ce390af17919f29b4ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/911997e881754ce390af17919f29b4ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_911997e881754ce390af17919f29b4ab"}]}] Oct 27 03:42:24.594639 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-DeleteServersTestJSON-858473437 Oct 27 03:42:24.594639 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 911997e881754ce390af17919f29b4ab Oct 27 03:42:24.594639 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-DeleteServersTestJSON-858473437 Oct 27 03:42:24.594639 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-DeleteServersTestJSON-858473437-project Oct 27 03:42:24.594639 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:42:24.594639 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:42:24.594639 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: b1cc79af058b4c35b3c572448fac86a7 Oct 27 03:42:24.594639 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-DeleteServersTestJSON-858473437-project Oct 27 03:42:24.594639 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:42:24.594639 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance ac9da5d0-c534-4955-b148-f401c9308618 could not be found. Oct 27 03:42:24.594639 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': 'ac9da5d0-c534-4955-b148-f401c9308618'} Oct 27 03:42:24.594639 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:42:24.594639 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:24.594639 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:42:24.594639 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:42:24.594639 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:42:24.594639 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:42:24.594639 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:42:24.594639 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:42:24.594639 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:42:24.594639 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:42:24.594639 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac9da5d0-c534-4955-b148-f401c9308618 could not be found. Oct 27 03:42:24.594639 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:42:24.594639 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:42:24.594639 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:42:24.594639 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:24.594639 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:42:24.594639 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:42:24.594639 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:42:24.594639 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:42:24.594639 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:42:24.594639 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:42:24.594639 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:42:24.594639 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:42:24.594639 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:42:24.594639 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:42:24.594639 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:42:24.594639 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:42:24.594639 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac9da5d0-c534-4955-b148-f401c9308618 could not be found. Oct 27 03:42:24.594639 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:42:24.594639 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:42:24.594639 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:42:24.603307 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:24.603307 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:42:24.603307 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:42:24.603307 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:42:24.603307 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:42:24.603307 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac9da5d0-c534-4955-b148-f401c9308618 could not be found. Oct 27 03:42:24.603307 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:42:24.603307 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f4ca35a9-9bb3-4565-8c8d-cd97d9aece5d tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Returning 404 to user: Instance ac9da5d0-c534-4955-b148-f401c9308618 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:42:24.603307 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f4ca35a9-9bb3-4565-8c8d-cd97d9aece5d tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/ac9da5d0-c534-4955-b148-f401c9308618" status: 404 len: 111 microversion: 2.1 time: 0.048557 Oct 27 03:42:24.610490 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2374/5041] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:24 2022] GET /compute/v2.1/servers/ac9da5d0-c534-4955-b148-f401c9308618 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 03:42:24.615570 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-895a43c2-1f46-457b-a897-c142ad448641 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:24.616081 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-895a43c2-1f46-457b-a897-c142ad448641 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 9fa9583d-e294-4e5f-a6dc-a51d619dc03d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:24.634371 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-895a43c2-1f46-457b-a897-c142ad448641 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:24.634878 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-895a43c2-1f46-457b-a897-c142ad448641 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:24.635321 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-895a43c2-1f46-457b-a897-c142ad448641 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:24.636099 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-895a43c2-1f46-457b-a897-c142ad448641 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:24.636566 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-895a43c2-1f46-457b-a897-c142ad448641 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:24.637025 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-895a43c2-1f46-457b-a897-c142ad448641 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:24.668990 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-895a43c2-1f46-457b-a897-c142ad448641 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] HTTP exception thrown: Instance 9fa9583d-e294-4e5f-a6dc-a51d619dc03d could not be found. Oct 27 03:42:24.670639 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-895a43c2-1f46-457b-a897-c142ad448641 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Request method failure captured: Oct 27 03:42:24.670639 n-d-862769-1 devstack@n-api.service[121000]: request: DELETE /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d HTTP/1.1 Oct 27 03:42:24.670639 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:42:24.670639 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:42:24.670639 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:42:24.670639 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:42:24.670639 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:42:24.670639 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:42:24.670639 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:42:24.670639 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:42:24.670639 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfz83jPBQR-IO_RgpXfqqqN_tSIl3Aju213bQLpPTkR-R_lkTGSpHz1Evy7Lbg7I5hWxU9AxviJyxNS0i-wRdj1_O4LyvZEjE6jerjzwB22Vu4S-ThF8W8FJgumwczGUcQup-Bjpiay7kN0UoT8q0uFoQytE3MKt1MX9CDbsUgcc03A Oct 27 03:42:24.670639 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:42:24.670639 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:42:24.670639 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:42:24.670639 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:42:24.670639 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:42:24.670639 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:42:24.670639 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 911997e881754ce390af17919f29b4ab Oct 27 03:42:24.670639 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-DeleteServersTestJSON-858473437 Oct 27 03:42:24.670639 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:42:24.670639 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:42:24.670639 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/911997e881754ce390af17919f29b4ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/911997e881754ce390af17919f29b4ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/911997e881754ce390af17919f29b4ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_911997e881754ce390af17919f29b4ab"}]}] Oct 27 03:42:24.670639 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-DeleteServersTestJSON-858473437 Oct 27 03:42:24.670639 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 911997e881754ce390af17919f29b4ab Oct 27 03:42:24.670639 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-DeleteServersTestJSON-858473437 Oct 27 03:42:24.670639 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-DeleteServersTestJSON-858473437-project Oct 27 03:42:24.670639 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:42:24.670639 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:42:24.670639 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: b1cc79af058b4c35b3c572448fac86a7 Oct 27 03:42:24.670639 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-DeleteServersTestJSON-858473437-project Oct 27 03:42:24.670639 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:42:24.670639 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 9fa9583d-e294-4e5f-a6dc-a51d619dc03d could not be found. Oct 27 03:42:24.670639 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '9fa9583d-e294-4e5f-a6dc-a51d619dc03d'} Oct 27 03:42:24.670639 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:42:24.670639 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:24.670639 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:42:24.670639 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:42:24.670639 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:42:24.670639 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:42:24.670639 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:42:24.670639 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:42:24.670639 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:42:24.670639 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:42:24.670639 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fa9583d-e294-4e5f-a6dc-a51d619dc03d could not be found. Oct 27 03:42:24.670639 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:42:24.670639 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:42:24.670639 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:42:24.670639 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:24.670639 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:42:24.670639 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:42:24.670639 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:42:24.670639 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:42:24.670639 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:42:24.670639 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:42:24.670639 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 03:42:24.670639 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 03:42:24.670639 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 03:42:24.670639 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 03:42:24.670639 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:42:24.670639 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:42:24.670639 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:42:24.670639 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:42:24.678169 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fa9583d-e294-4e5f-a6dc-a51d619dc03d could not be found. Oct 27 03:42:24.678169 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:42:24.678169 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:42:24.678169 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:42:24.678169 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:24.678169 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:42:24.678169 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:42:24.678169 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:42:24.678169 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:42:24.678169 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fa9583d-e294-4e5f-a6dc-a51d619dc03d could not be found. Oct 27 03:42:24.678169 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:42:24.678169 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-895a43c2-1f46-457b-a897-c142ad448641 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Returning 404 to user: Instance 9fa9583d-e294-4e5f-a6dc-a51d619dc03d could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:42:24.678169 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-895a43c2-1f46-457b-a897-c142ad448641 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d" status: 404 len: 111 microversion: 2.1 time: 0.060594 Oct 27 03:42:24.681935 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2375/5042] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:42:24 2022] DELETE /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:42:24.685465 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d23517f1-0a4b-4a1c-a61e-c62d7b134a2d tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:24.686164 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d23517f1-0a4b-4a1c-a61e-c62d7b134a2d tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:24.703022 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d23517f1-0a4b-4a1c-a61e-c62d7b134a2d tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:24.703526 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d23517f1-0a4b-4a1c-a61e-c62d7b134a2d tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:24.703970 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d23517f1-0a4b-4a1c-a61e-c62d7b134a2d tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:24.704752 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d23517f1-0a4b-4a1c-a61e-c62d7b134a2d tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:24.705214 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d23517f1-0a4b-4a1c-a61e-c62d7b134a2d tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:24.705647 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d23517f1-0a4b-4a1c-a61e-c62d7b134a2d tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:24.713290 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2b2d1245-108c-4199-855c-76f56a213d35 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82daefe001364499b2ee9eb7da2599be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:24.722611 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2b2d1245-108c-4199-855c-76f56a213d35 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] 10.222.0.20 "GET /compute/v2.1/servers/4634ba00-a353-44a2-b49a-7b1bc2fc7e81" status: 200 len: 1510 microversion: 2.1 time: 0.265234 Oct 27 03:42:24.723587 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2668/5043] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:24 2022] GET /compute/v2.1/servers/4634ba00-a353-44a2-b49a-7b1bc2fc7e81 => generated 1510 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:24.734397 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-86547564-91da-42a4-ae51-320ab66390b0 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:24.735540 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-86547564-91da-42a4-ae51-320ab66390b0 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 9fa9583d-e294-4e5f-a6dc-a51d619dc03d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:24.745715 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-86547564-91da-42a4-ae51-320ab66390b0 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:24.746561 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-86547564-91da-42a4-ae51-320ab66390b0 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:24.747558 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-86547564-91da-42a4-ae51-320ab66390b0 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:24.748873 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-86547564-91da-42a4-ae51-320ab66390b0 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:24.749798 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-86547564-91da-42a4-ae51-320ab66390b0 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:24.750512 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-86547564-91da-42a4-ae51-320ab66390b0 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:24.774351 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-86547564-91da-42a4-ae51-320ab66390b0 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] HTTP exception thrown: Instance 9fa9583d-e294-4e5f-a6dc-a51d619dc03d could not be found. Oct 27 03:42:24.776879 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-86547564-91da-42a4-ae51-320ab66390b0 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Request method failure captured: Oct 27 03:42:24.776879 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d HTTP/1.1 Oct 27 03:42:24.776879 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:42:24.776879 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:42:24.776879 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:42:24.776879 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:42:24.776879 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:42:24.776879 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:42:24.776879 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:42:24.776879 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:42:24.776879 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfz83jPBQR-IO_RgpXfqqqN_tSIl3Aju213bQLpPTkR-R_lkTGSpHz1Evy7Lbg7I5hWxU9AxviJyxNS0i-wRdj1_O4LyvZEjE6jerjzwB22Vu4S-ThF8W8FJgumwczGUcQup-Bjpiay7kN0UoT8q0uFoQytE3MKt1MX9CDbsUgcc03A Oct 27 03:42:24.776879 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:42:24.776879 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:42:24.776879 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:42:24.776879 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:42:24.776879 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:42:24.776879 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:42:24.776879 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 911997e881754ce390af17919f29b4ab Oct 27 03:42:24.776879 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-DeleteServersTestJSON-858473437 Oct 27 03:42:24.776879 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:42:24.776879 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:42:24.776879 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/911997e881754ce390af17919f29b4ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/911997e881754ce390af17919f29b4ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/911997e881754ce390af17919f29b4ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_911997e881754ce390af17919f29b4ab"}]}] Oct 27 03:42:24.776879 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-DeleteServersTestJSON-858473437 Oct 27 03:42:24.776879 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 911997e881754ce390af17919f29b4ab Oct 27 03:42:24.776879 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-DeleteServersTestJSON-858473437 Oct 27 03:42:24.776879 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-DeleteServersTestJSON-858473437-project Oct 27 03:42:24.776879 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:42:24.776879 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:42:24.776879 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: b1cc79af058b4c35b3c572448fac86a7 Oct 27 03:42:24.776879 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-DeleteServersTestJSON-858473437-project Oct 27 03:42:24.776879 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:42:24.776879 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 9fa9583d-e294-4e5f-a6dc-a51d619dc03d could not be found. Oct 27 03:42:24.776879 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '9fa9583d-e294-4e5f-a6dc-a51d619dc03d'} Oct 27 03:42:24.776879 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:42:24.776879 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:24.776879 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:42:24.776879 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:42:24.776879 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:42:24.776879 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:42:24.776879 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:42:24.776879 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:42:24.776879 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:42:24.776879 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:42:24.776879 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fa9583d-e294-4e5f-a6dc-a51d619dc03d could not be found. Oct 27 03:42:24.776879 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:42:24.776879 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:42:24.776879 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:42:24.776879 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:24.776879 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:42:24.776879 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:42:24.776879 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:42:24.776879 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:42:24.776879 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:42:24.776879 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:42:24.776879 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:42:24.776879 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:42:24.776879 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:42:24.776879 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:42:24.776879 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:42:24.776879 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:42:24.776879 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fa9583d-e294-4e5f-a6dc-a51d619dc03d could not be found. Oct 27 03:42:24.776879 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:42:24.776879 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:42:24.776879 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:42:24.780848 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:24.780848 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:42:24.780848 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:42:24.780848 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:42:24.780848 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:42:24.780848 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fa9583d-e294-4e5f-a6dc-a51d619dc03d could not be found. Oct 27 03:42:24.780848 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:42:24.783207 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-86547564-91da-42a4-ae51-320ab66390b0 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Returning 404 to user: Instance 9fa9583d-e294-4e5f-a6dc-a51d619dc03d could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:42:24.784294 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-86547564-91da-42a4-ae51-320ab66390b0 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d" status: 404 len: 111 microversion: 2.1 time: 0.059703 Oct 27 03:42:24.785687 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2669/5044] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:24 2022] GET /compute/v2.1/servers/9fa9583d-e294-4e5f-a6dc-a51d619dc03d => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:42:24.805571 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-28e4e76a-5952-4e25-9792-7e4ea578b64a tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:24.808114 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d23517f1-0a4b-4a1c-a61e-c62d7b134a2d tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffc2b1c410149e884a47240b5425e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38450368ef5c4e68ac3c19c7a0a1ce65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:24.810388 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-28e4e76a-5952-4e25-9792-7e4ea578b64a tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] [instance: 20bed685-d855-499c-90d6-f8c59cfbd701] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:24.829743 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-28e4e76a-5952-4e25-9792-7e4ea578b64a tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:24.829743 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-28e4e76a-5952-4e25-9792-7e4ea578b64a tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:24.830644 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d23517f1-0a4b-4a1c-a61e-c62d7b134a2d tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b" status: 200 len: 1323 microversion: 2.1 time: 0.147257 Oct 27 03:42:24.830742 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-28e4e76a-5952-4e25-9792-7e4ea578b64a tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:24.832381 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2376/5045] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:24 2022] GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b => generated 1323 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:24.846863 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-28e4e76a-5952-4e25-9792-7e4ea578b64a tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:24.848624 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-28e4e76a-5952-4e25-9792-7e4ea578b64a tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:24.852876 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-28e4e76a-5952-4e25-9792-7e4ea578b64a tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:24.853003 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-144e54fa-4e5d-42c5-9d94-f91d753c845f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:24.853003 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-144e54fa-4e5d-42c5-9d94-f91d753c845f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 5a8d53f2-5448-44a3-af8f-cf17bfc69a12] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:24.855467 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:42:24.859831 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-144e54fa-4e5d-42c5-9d94-f91d753c845f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:24.860326 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-144e54fa-4e5d-42c5-9d94-f91d753c845f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:24.860766 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-144e54fa-4e5d-42c5-9d94-f91d753c845f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:24.861570 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-144e54fa-4e5d-42c5-9d94-f91d753c845f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:24.862251 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-144e54fa-4e5d-42c5-9d94-f91d753c845f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:24.862688 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-144e54fa-4e5d-42c5-9d94-f91d753c845f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:24.880907 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-144e54fa-4e5d-42c5-9d94-f91d753c845f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] HTTP exception thrown: Instance 5a8d53f2-5448-44a3-af8f-cf17bfc69a12 could not be found. Oct 27 03:42:24.883412 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-144e54fa-4e5d-42c5-9d94-f91d753c845f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Request method failure captured: Oct 27 03:42:24.883412 n-d-862769-1 devstack@n-api.service[121000]: request: DELETE /compute/v2.1/servers/5a8d53f2-5448-44a3-af8f-cf17bfc69a12 HTTP/1.1 Oct 27 03:42:24.883412 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:42:24.883412 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:42:24.883412 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:42:24.883412 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:42:24.883412 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:42:24.883412 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:42:24.883412 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:42:24.883412 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:42:24.883412 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfz83jPBQR-IO_RgpXfqqqN_tSIl3Aju213bQLpPTkR-R_lkTGSpHz1Evy7Lbg7I5hWxU9AxviJyxNS0i-wRdj1_O4LyvZEjE6jerjzwB22Vu4S-ThF8W8FJgumwczGUcQup-Bjpiay7kN0UoT8q0uFoQytE3MKt1MX9CDbsUgcc03A Oct 27 03:42:24.883412 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:42:24.883412 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:42:24.883412 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:42:24.883412 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:42:24.883412 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:42:24.883412 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:42:24.883412 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 911997e881754ce390af17919f29b4ab Oct 27 03:42:24.883412 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-DeleteServersTestJSON-858473437 Oct 27 03:42:24.883412 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:42:24.883412 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:42:24.883412 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/911997e881754ce390af17919f29b4ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/911997e881754ce390af17919f29b4ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/911997e881754ce390af17919f29b4ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_911997e881754ce390af17919f29b4ab"}]}] Oct 27 03:42:24.883412 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-DeleteServersTestJSON-858473437 Oct 27 03:42:24.883412 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 911997e881754ce390af17919f29b4ab Oct 27 03:42:24.883412 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-DeleteServersTestJSON-858473437 Oct 27 03:42:24.883412 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-DeleteServersTestJSON-858473437-project Oct 27 03:42:24.883412 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:42:24.883412 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:42:24.883412 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: b1cc79af058b4c35b3c572448fac86a7 Oct 27 03:42:24.883412 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-DeleteServersTestJSON-858473437-project Oct 27 03:42:24.883412 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:42:24.883412 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 5a8d53f2-5448-44a3-af8f-cf17bfc69a12 could not be found. Oct 27 03:42:24.883412 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '5a8d53f2-5448-44a3-af8f-cf17bfc69a12'} Oct 27 03:42:24.883412 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:42:24.883412 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:24.883412 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:42:24.883412 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:42:24.883412 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:42:24.883412 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:42:24.883412 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:42:24.883412 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:42:24.883412 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:42:24.883412 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:42:24.883412 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a8d53f2-5448-44a3-af8f-cf17bfc69a12 could not be found. Oct 27 03:42:24.883412 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:42:24.883412 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:42:24.883412 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:42:24.883412 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:24.883412 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:42:24.883412 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:42:24.883412 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:42:24.883412 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:42:24.883412 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:42:24.883412 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:42:24.883412 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 03:42:24.883412 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 03:42:24.883412 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 03:42:24.883412 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 03:42:24.883412 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:42:24.883412 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:42:24.883412 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:42:24.883412 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:42:24.887945 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a8d53f2-5448-44a3-af8f-cf17bfc69a12 could not be found. Oct 27 03:42:24.887945 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:42:24.887945 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:42:24.887945 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:42:24.887945 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:24.887945 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:42:24.887945 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:42:24.887945 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:42:24.887945 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:42:24.887945 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a8d53f2-5448-44a3-af8f-cf17bfc69a12 could not be found. Oct 27 03:42:24.887945 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:42:24.889578 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-144e54fa-4e5d-42c5-9d94-f91d753c845f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Returning 404 to user: Instance 5a8d53f2-5448-44a3-af8f-cf17bfc69a12 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:42:24.890673 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-144e54fa-4e5d-42c5-9d94-f91d753c845f tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5a8d53f2-5448-44a3-af8f-cf17bfc69a12" status: 404 len: 111 microversion: 2.1 time: 0.057212 Oct 27 03:42:24.891710 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2377/5046] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:42:24 2022] DELETE /compute/v2.1/servers/5a8d53f2-5448-44a3-af8f-cf17bfc69a12 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:42:24.900371 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-76b14c56-3e78-49d7-9ae3-4c28eda107b8 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:24.901471 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-76b14c56-3e78-49d7-9ae3-4c28eda107b8 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 5a8d53f2-5448-44a3-af8f-cf17bfc69a12] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:24.910781 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-76b14c56-3e78-49d7-9ae3-4c28eda107b8 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:24.911737 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-76b14c56-3e78-49d7-9ae3-4c28eda107b8 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:24.912336 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-76b14c56-3e78-49d7-9ae3-4c28eda107b8 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:24.913828 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-76b14c56-3e78-49d7-9ae3-4c28eda107b8 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:24.914691 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-76b14c56-3e78-49d7-9ae3-4c28eda107b8 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:24.915137 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-76b14c56-3e78-49d7-9ae3-4c28eda107b8 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:24.933994 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-76b14c56-3e78-49d7-9ae3-4c28eda107b8 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] HTTP exception thrown: Instance 5a8d53f2-5448-44a3-af8f-cf17bfc69a12 could not be found. Oct 27 03:42:24.936994 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-76b14c56-3e78-49d7-9ae3-4c28eda107b8 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Request method failure captured: Oct 27 03:42:24.936994 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/5a8d53f2-5448-44a3-af8f-cf17bfc69a12 HTTP/1.1 Oct 27 03:42:24.936994 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:42:24.936994 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:42:24.936994 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:42:24.936994 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:42:24.936994 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:42:24.936994 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:42:24.936994 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:42:24.936994 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:42:24.936994 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfz83jPBQR-IO_RgpXfqqqN_tSIl3Aju213bQLpPTkR-R_lkTGSpHz1Evy7Lbg7I5hWxU9AxviJyxNS0i-wRdj1_O4LyvZEjE6jerjzwB22Vu4S-ThF8W8FJgumwczGUcQup-Bjpiay7kN0UoT8q0uFoQytE3MKt1MX9CDbsUgcc03A Oct 27 03:42:24.936994 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:42:24.936994 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:42:24.936994 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:42:24.936994 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:42:24.936994 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:42:24.936994 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:42:24.936994 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 911997e881754ce390af17919f29b4ab Oct 27 03:42:24.936994 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-DeleteServersTestJSON-858473437 Oct 27 03:42:24.936994 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:42:24.936994 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:42:24.936994 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/911997e881754ce390af17919f29b4ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/911997e881754ce390af17919f29b4ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/911997e881754ce390af17919f29b4ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_911997e881754ce390af17919f29b4ab"}]}] Oct 27 03:42:24.936994 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-DeleteServersTestJSON-858473437 Oct 27 03:42:24.936994 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 911997e881754ce390af17919f29b4ab Oct 27 03:42:24.936994 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-DeleteServersTestJSON-858473437 Oct 27 03:42:24.936994 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-DeleteServersTestJSON-858473437-project Oct 27 03:42:24.936994 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:42:24.936994 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:42:24.936994 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: b1cc79af058b4c35b3c572448fac86a7 Oct 27 03:42:24.936994 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-DeleteServersTestJSON-858473437-project Oct 27 03:42:24.936994 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:42:24.936994 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 5a8d53f2-5448-44a3-af8f-cf17bfc69a12 could not be found. Oct 27 03:42:24.936994 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '5a8d53f2-5448-44a3-af8f-cf17bfc69a12'} Oct 27 03:42:24.936994 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:42:24.936994 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:24.936994 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:42:24.936994 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:42:24.936994 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:42:24.936994 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:42:24.936994 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:42:24.936994 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:42:24.936994 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:42:24.936994 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:42:24.936994 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a8d53f2-5448-44a3-af8f-cf17bfc69a12 could not be found. Oct 27 03:42:24.936994 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:42:24.936994 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:42:24.936994 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:42:24.936994 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:24.936994 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:42:24.936994 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:42:24.936994 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:42:24.936994 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:42:24.936994 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:42:24.936994 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:42:24.936994 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:42:24.936994 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:42:24.936994 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:42:24.936994 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:42:24.936994 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:42:24.936994 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:42:24.936994 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a8d53f2-5448-44a3-af8f-cf17bfc69a12 could not be found. Oct 27 03:42:24.936994 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:42:24.936994 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:42:24.936994 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:42:24.941513 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:24.941513 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:42:24.941513 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:42:24.941513 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:42:24.941513 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:42:24.941513 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a8d53f2-5448-44a3-af8f-cf17bfc69a12 could not be found. Oct 27 03:42:24.941513 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:42:24.941513 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-76b14c56-3e78-49d7-9ae3-4c28eda107b8 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Returning 404 to user: Instance 5a8d53f2-5448-44a3-af8f-cf17bfc69a12 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:42:24.941513 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-76b14c56-3e78-49d7-9ae3-4c28eda107b8 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/5a8d53f2-5448-44a3-af8f-cf17bfc69a12" status: 404 len: 111 microversion: 2.1 time: 0.042879 Oct 27 03:42:24.941513 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2378/5047] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:24 2022] GET /compute/v2.1/servers/5a8d53f2-5448-44a3-af8f-cf17bfc69a12 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:42:24.950145 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-689b12ba-1132-496b-bbc0-132be38af2bc tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:24.951148 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-689b12ba-1132-496b-bbc0-132be38af2bc tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: f637baad-6eca-4d76-a340-f7d25c6710b4] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:24.958775 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-689b12ba-1132-496b-bbc0-132be38af2bc tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] HTTP exception thrown: Instance f637baad-6eca-4d76-a340-f7d25c6710b4 could not be found. Oct 27 03:42:24.961598 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-689b12ba-1132-496b-bbc0-132be38af2bc tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Request method failure captured: Oct 27 03:42:24.961598 n-d-862769-1 devstack@n-api.service[121000]: request: DELETE /compute/v2.1/servers/f637baad-6eca-4d76-a340-f7d25c6710b4 HTTP/1.1 Oct 27 03:42:24.961598 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:42:24.961598 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:42:24.961598 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:42:24.961598 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:42:24.961598 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:42:24.961598 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:42:24.961598 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:42:24.961598 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:42:24.961598 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfz83jPBQR-IO_RgpXfqqqN_tSIl3Aju213bQLpPTkR-R_lkTGSpHz1Evy7Lbg7I5hWxU9AxviJyxNS0i-wRdj1_O4LyvZEjE6jerjzwB22Vu4S-ThF8W8FJgumwczGUcQup-Bjpiay7kN0UoT8q0uFoQytE3MKt1MX9CDbsUgcc03A Oct 27 03:42:24.961598 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:42:24.961598 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:42:24.961598 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:42:24.961598 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:42:24.961598 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:42:24.961598 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:42:24.961598 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 911997e881754ce390af17919f29b4ab Oct 27 03:42:24.961598 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-DeleteServersTestJSON-858473437 Oct 27 03:42:24.961598 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:42:24.961598 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:42:24.961598 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/911997e881754ce390af17919f29b4ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/911997e881754ce390af17919f29b4ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/911997e881754ce390af17919f29b4ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_911997e881754ce390af17919f29b4ab"}]}] Oct 27 03:42:24.961598 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-DeleteServersTestJSON-858473437 Oct 27 03:42:24.961598 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 911997e881754ce390af17919f29b4ab Oct 27 03:42:24.961598 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-DeleteServersTestJSON-858473437 Oct 27 03:42:24.961598 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-DeleteServersTestJSON-858473437-project Oct 27 03:42:24.961598 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:42:24.961598 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:42:24.961598 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: b1cc79af058b4c35b3c572448fac86a7 Oct 27 03:42:24.961598 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-DeleteServersTestJSON-858473437-project Oct 27 03:42:24.961598 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:42:24.961598 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance f637baad-6eca-4d76-a340-f7d25c6710b4 could not be found. Oct 27 03:42:24.961598 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': 'f637baad-6eca-4d76-a340-f7d25c6710b4'} Oct 27 03:42:24.961598 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:42:24.961598 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:24.961598 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:42:24.961598 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:42:24.961598 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:42:24.961598 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:42:24.961598 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 03:42:24.961598 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 03:42:24.961598 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f637baad-6eca-4d76-a340-f7d25c6710b4 could not be found. Oct 27 03:42:24.961598 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:42:24.961598 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:42:24.961598 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:42:24.961598 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:24.961598 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:42:24.961598 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:42:24.961598 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:42:24.961598 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:42:24.961598 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:42:24.961598 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:42:24.961598 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 03:42:24.961598 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 03:42:24.961598 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 03:42:24.961598 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 03:42:24.961598 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:42:24.961598 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:42:24.961598 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:42:24.961598 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:42:24.961598 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f637baad-6eca-4d76-a340-f7d25c6710b4 could not be found. Oct 27 03:42:24.961598 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:42:24.961598 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:42:24.961598 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:42:24.967526 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:24.967526 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:42:24.967526 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:42:24.967526 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:42:24.967526 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:42:24.967526 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f637baad-6eca-4d76-a340-f7d25c6710b4 could not be found. Oct 27 03:42:24.967526 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:42:24.969878 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-689b12ba-1132-496b-bbc0-132be38af2bc tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Returning 404 to user: Instance f637baad-6eca-4d76-a340-f7d25c6710b4 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:42:24.971472 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-689b12ba-1132-496b-bbc0-132be38af2bc tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f637baad-6eca-4d76-a340-f7d25c6710b4" status: 404 len: 111 microversion: 2.1 time: 0.025388 Oct 27 03:42:24.972581 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2379/5048] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:42:24 2022] DELETE /compute/v2.1/servers/f637baad-6eca-4d76-a340-f7d25c6710b4 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:42:24.990339 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-01789087-38ae-4e7b-8c6b-4bb6f5cca1df tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:24.992476 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-01789087-38ae-4e7b-8c6b-4bb6f5cca1df tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: f637baad-6eca-4d76-a340-f7d25c6710b4] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:25.017281 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-01789087-38ae-4e7b-8c6b-4bb6f5cca1df tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] HTTP exception thrown: Instance f637baad-6eca-4d76-a340-f7d25c6710b4 could not be found. Oct 27 03:42:25.023729 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-01789087-38ae-4e7b-8c6b-4bb6f5cca1df tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Request method failure captured: Oct 27 03:42:25.023729 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/f637baad-6eca-4d76-a340-f7d25c6710b4 HTTP/1.1 Oct 27 03:42:25.023729 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:42:25.023729 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:42:25.023729 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:42:25.023729 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:42:25.023729 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:42:25.023729 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:42:25.023729 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:42:25.023729 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:42:25.023729 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfz83jPBQR-IO_RgpXfqqqN_tSIl3Aju213bQLpPTkR-R_lkTGSpHz1Evy7Lbg7I5hWxU9AxviJyxNS0i-wRdj1_O4LyvZEjE6jerjzwB22Vu4S-ThF8W8FJgumwczGUcQup-Bjpiay7kN0UoT8q0uFoQytE3MKt1MX9CDbsUgcc03A Oct 27 03:42:25.023729 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:42:25.023729 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:42:25.023729 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:42:25.023729 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:42:25.023729 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:42:25.023729 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:42:25.023729 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 911997e881754ce390af17919f29b4ab Oct 27 03:42:25.023729 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-DeleteServersTestJSON-858473437 Oct 27 03:42:25.023729 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:42:25.023729 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:42:25.023729 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/911997e881754ce390af17919f29b4ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/911997e881754ce390af17919f29b4ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/911997e881754ce390af17919f29b4ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_911997e881754ce390af17919f29b4ab"}]}] Oct 27 03:42:25.023729 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-DeleteServersTestJSON-858473437 Oct 27 03:42:25.023729 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 911997e881754ce390af17919f29b4ab Oct 27 03:42:25.023729 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-DeleteServersTestJSON-858473437 Oct 27 03:42:25.023729 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-DeleteServersTestJSON-858473437-project Oct 27 03:42:25.023729 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:42:25.023729 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:42:25.023729 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: b1cc79af058b4c35b3c572448fac86a7 Oct 27 03:42:25.023729 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-DeleteServersTestJSON-858473437-project Oct 27 03:42:25.023729 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:42:25.023729 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance f637baad-6eca-4d76-a340-f7d25c6710b4 could not be found. Oct 27 03:42:25.023729 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': 'f637baad-6eca-4d76-a340-f7d25c6710b4'} Oct 27 03:42:25.023729 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:42:25.023729 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:25.023729 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:42:25.023729 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:42:25.023729 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:42:25.023729 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:42:25.023729 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 03:42:25.023729 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 03:42:25.023729 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f637baad-6eca-4d76-a340-f7d25c6710b4 could not be found. Oct 27 03:42:25.023729 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:42:25.023729 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:42:25.023729 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:42:25.023729 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:25.023729 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:42:25.023729 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:42:25.023729 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:42:25.023729 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:42:25.023729 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:42:25.023729 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:42:25.023729 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:42:25.023729 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:42:25.023729 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:42:25.023729 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:42:25.023729 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:42:25.023729 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:42:25.023729 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f637baad-6eca-4d76-a340-f7d25c6710b4 could not be found. Oct 27 03:42:25.023729 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:42:25.023729 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:42:25.023729 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:42:25.023729 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:25.023729 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:42:25.032980 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:42:25.032980 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:42:25.032980 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:42:25.032980 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f637baad-6eca-4d76-a340-f7d25c6710b4 could not be found. Oct 27 03:42:25.032980 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:42:25.032980 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-01789087-38ae-4e7b-8c6b-4bb6f5cca1df tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Returning 404 to user: Instance f637baad-6eca-4d76-a340-f7d25c6710b4 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:42:25.032980 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-01789087-38ae-4e7b-8c6b-4bb6f5cca1df tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/f637baad-6eca-4d76-a340-f7d25c6710b4" status: 404 len: 111 microversion: 2.1 time: 0.045541 Oct 27 03:42:25.032980 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2380/5049] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:24 2022] GET /compute/v2.1/servers/f637baad-6eca-4d76-a340-f7d25c6710b4 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:42:25.137343 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-28e4e76a-5952-4e25-9792-7e4ea578b64a tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82daefe001364499b2ee9eb7da2599be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:25.148172 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-28e4e76a-5952-4e25-9792-7e4ea578b64a tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] 10.222.0.20 "GET /compute/v2.1/servers/20bed685-d855-499c-90d6-f8c59cfbd701" status: 200 len: 1512 microversion: 2.1 time: 0.359895 Oct 27 03:42:25.148962 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2670/5050] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:24 2022] GET /compute/v2.1/servers/20bed685-d855-499c-90d6-f8c59cfbd701 => generated 1512 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:25.171186 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-08523c0d-e79a-46e6-8348-8a13af9cd37c tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:25.172170 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-08523c0d-e79a-46e6-8348-8a13af9cd37c tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] [instance: 0dd4eda6-95aa-4130-87e5-2986d6b95536] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:25.211628 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-08523c0d-e79a-46e6-8348-8a13af9cd37c tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:25.212896 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-08523c0d-e79a-46e6-8348-8a13af9cd37c tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:25.213819 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-08523c0d-e79a-46e6-8348-8a13af9cd37c tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:25.214689 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-08523c0d-e79a-46e6-8348-8a13af9cd37c tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:25.215301 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-08523c0d-e79a-46e6-8348-8a13af9cd37c tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:25.215825 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-08523c0d-e79a-46e6-8348-8a13af9cd37c tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:25.320500 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-67a6b2e2-a88b-45f1-8e27-83c944f8be70 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:25.321578 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-67a6b2e2-a88b-45f1-8e27-83c944f8be70 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: c9e02344-a91a-40c8-b8c0-c0abe503204c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:25.336995 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-67a6b2e2-a88b-45f1-8e27-83c944f8be70 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:25.337729 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-67a6b2e2-a88b-45f1-8e27-83c944f8be70 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:25.339162 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-67a6b2e2-a88b-45f1-8e27-83c944f8be70 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:25.343842 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-67a6b2e2-a88b-45f1-8e27-83c944f8be70 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:25.344556 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-67a6b2e2-a88b-45f1-8e27-83c944f8be70 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:25.345157 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-67a6b2e2-a88b-45f1-8e27-83c944f8be70 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:25.444096 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-08523c0d-e79a-46e6-8348-8a13af9cd37c tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82daefe001364499b2ee9eb7da2599be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:25.453118 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-08523c0d-e79a-46e6-8348-8a13af9cd37c tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] 10.222.0.20 "GET /compute/v2.1/servers/0dd4eda6-95aa-4130-87e5-2986d6b95536" status: 200 len: 1320 microversion: 2.1 time: 0.286292 Oct 27 03:42:25.455208 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2381/5051] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:25 2022] GET /compute/v2.1/servers/0dd4eda6-95aa-4130-87e5-2986d6b95536 => generated 1320 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:25.604749 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-67a6b2e2-a88b-45f1-8e27-83c944f8be70 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:25.619321 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-67a6b2e2-a88b-45f1-8e27-83c944f8be70 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c" status: 200 len: 1521 microversion: 2.1 time: 0.303955 Oct 27 03:42:25.631906 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2671/5052] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:25 2022] GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c => generated 1521 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:42:25.859392 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2243822d-32ff-48de-8792-7e0fb7875281 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:25.860117 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-2243822d-32ff-48de-8792-7e0fb7875281 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:25.875980 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2243822d-32ff-48de-8792-7e0fb7875281 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:25.876769 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2243822d-32ff-48de-8792-7e0fb7875281 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:25.877524 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2243822d-32ff-48de-8792-7e0fb7875281 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:25.878469 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2243822d-32ff-48de-8792-7e0fb7875281 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:25.879123 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2243822d-32ff-48de-8792-7e0fb7875281 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:25.880609 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2243822d-32ff-48de-8792-7e0fb7875281 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:25.934555 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2243822d-32ff-48de-8792-7e0fb7875281 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:25.935056 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2243822d-32ff-48de-8792-7e0fb7875281 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:25.935638 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2243822d-32ff-48de-8792-7e0fb7875281 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:25.936200 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-2243822d-32ff-48de-8792-7e0fb7875281 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lazy-loading 'fault' on Instance uuid db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:42:26.041431 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2243822d-32ff-48de-8792-7e0fb7875281 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffc2b1c410149e884a47240b5425e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38450368ef5c4e68ac3c19c7a0a1ce65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:26.051525 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2243822d-32ff-48de-8792-7e0fb7875281 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b" status: 200 len: 1328 microversion: 2.1 time: 0.198626 Oct 27 03:42:26.052686 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2382/5053] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:25 2022] GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b => generated 1328 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:26.483276 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d0343f28-b70d-43fc-8c84-79934affadab tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:26.485188 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d0343f28-b70d-43fc-8c84-79934affadab tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] [instance: 0dd4eda6-95aa-4130-87e5-2986d6b95536] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:26.493373 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d0343f28-b70d-43fc-8c84-79934affadab tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:26.493954 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d0343f28-b70d-43fc-8c84-79934affadab tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:26.496122 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d0343f28-b70d-43fc-8c84-79934affadab tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:26.496122 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d0343f28-b70d-43fc-8c84-79934affadab tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:26.496122 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d0343f28-b70d-43fc-8c84-79934affadab tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:26.496373 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d0343f28-b70d-43fc-8c84-79934affadab tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:26.657669 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f216d5ab-b800-4555-be4c-53fca3b7e26e tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:26.657669 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f216d5ab-b800-4555-be4c-53fca3b7e26e tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: c9e02344-a91a-40c8-b8c0-c0abe503204c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:26.660384 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f216d5ab-b800-4555-be4c-53fca3b7e26e tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:26.661263 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f216d5ab-b800-4555-be4c-53fca3b7e26e tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:26.661992 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f216d5ab-b800-4555-be4c-53fca3b7e26e tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:26.663024 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f216d5ab-b800-4555-be4c-53fca3b7e26e tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:26.664513 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f216d5ab-b800-4555-be4c-53fca3b7e26e tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:26.665047 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f216d5ab-b800-4555-be4c-53fca3b7e26e tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:26.681942 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d0343f28-b70d-43fc-8c84-79934affadab tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82daefe001364499b2ee9eb7da2599be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:26.690320 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d0343f28-b70d-43fc-8c84-79934affadab tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] 10.222.0.20 "GET /compute/v2.1/servers/0dd4eda6-95aa-4130-87e5-2986d6b95536" status: 200 len: 1511 microversion: 2.1 time: 0.213915 Oct 27 03:42:26.691446 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2672/5054] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:26 2022] GET /compute/v2.1/servers/0dd4eda6-95aa-4130-87e5-2986d6b95536 => generated 1511 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:26.714184 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e8ba70ad-93ed-4c88-8144-02bf0b36e08e tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:26.719878 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e8ba70ad-93ed-4c88-8144-02bf0b36e08e tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '82daefe001364499b2ee9eb7da2599be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:26.720778 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e8ba70ad-93ed-4c88-8144-02bf0b36e08e tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf'} {{(pid=121001) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 03:42:26.733692 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e8ba70ad-93ed-4c88-8144-02bf0b36e08e tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:26.734390 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e8ba70ad-93ed-4c88-8144-02bf0b36e08e tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:26.734844 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e8ba70ad-93ed-4c88-8144-02bf0b36e08e tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:26.735604 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e8ba70ad-93ed-4c88-8144-02bf0b36e08e tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:26.736072 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e8ba70ad-93ed-4c88-8144-02bf0b36e08e tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:26.736783 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e8ba70ad-93ed-4c88-8144-02bf0b36e08e tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:26.853403 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f216d5ab-b800-4555-be4c-53fca3b7e26e tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:26.864099 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f216d5ab-b800-4555-be4c-53fca3b7e26e tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c" status: 200 len: 1521 microversion: 2.1 time: 0.222279 Oct 27 03:42:26.865055 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2383/5055] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:26 2022] GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:42:26.886477 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.multi_cell_list [None req-e8ba70ad-93ed-4c88-8144-02bf0b36e08e tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121001) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 03:42:26.974069 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e8ba70ad-93ed-4c88-8144-02bf0b36e08e tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82daefe001364499b2ee9eb7da2599be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:26.981847 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e8ba70ad-93ed-4c88-8144-02bf0b36e08e tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:26.982495 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e8ba70ad-93ed-4c88-8144-02bf0b36e08e tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:26.983051 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e8ba70ad-93ed-4c88-8144-02bf0b36e08e tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:27.080291 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-cc303b9a-1dc9-43a0-90b3-1e3a43da12ca tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:27.080933 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-cc303b9a-1dc9-43a0-90b3-1e3a43da12ca tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:27.089050 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cc303b9a-1dc9-43a0-90b3-1e3a43da12ca tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:27.091444 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cc303b9a-1dc9-43a0-90b3-1e3a43da12ca tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:27.091444 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cc303b9a-1dc9-43a0-90b3-1e3a43da12ca tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:27.091958 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cc303b9a-1dc9-43a0-90b3-1e3a43da12ca tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:27.092614 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cc303b9a-1dc9-43a0-90b3-1e3a43da12ca tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:27.093220 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cc303b9a-1dc9-43a0-90b3-1e3a43da12ca tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:27.114692 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-cc303b9a-1dc9-43a0-90b3-1e3a43da12ca tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] HTTP exception thrown: Instance db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b could not be found. Oct 27 03:42:27.114692 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-cc303b9a-1dc9-43a0-90b3-1e3a43da12ca tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Request method failure captured: Oct 27 03:42:27.114692 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b HTTP/1.1 Oct 27 03:42:27.114692 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:42:27.114692 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:42:27.114692 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:42:27.114692 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:42:27.114692 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:42:27.114692 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:42:27.114692 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:42:27.114692 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:42:27.114692 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWf1ZZNjkPjFpbma6U1a30rpW5rz2pgrrBz2Y-zebQ7kUx-XZ8725TKvqHb0qLGWkMX-Aib9FY_k_pJogL520cMR3ZWJWChbAePna2V7kBQy-Nbm9LJN4yabkkyXR2yEa_L7dWwYV9fWj_rKrXm3kLnzTBx9MHVV6fRMUhXnJRxMN3ek Oct 27 03:42:27.114692 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:42:27.114692 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:42:27.114692 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:42:27.114692 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:42:27.114692 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:42:27.114692 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:42:27.114692 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 38450368ef5c4e68ac3c19c7a0a1ce65 Oct 27 03:42:27.114692 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-AttachVolumeTestJSON-1593697068 Oct 27 03:42:27.114692 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:42:27.114692 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:42:27.114692 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/38450368ef5c4e68ac3c19c7a0a1ce65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/38450368ef5c4e68ac3c19c7a0a1ce65"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/38450368ef5c4e68ac3c19c7a0a1ce65"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_38450368ef5c4e68ac3c19c7a0a1ce65"}]}] Oct 27 03:42:27.114692 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-AttachVolumeTestJSON-1593697068 Oct 27 03:42:27.114692 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 38450368ef5c4e68ac3c19c7a0a1ce65 Oct 27 03:42:27.114692 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1593697068 Oct 27 03:42:27.114692 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-AttachVolumeTestJSON-1593697068-project Oct 27 03:42:27.114692 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:42:27.114692 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:42:27.114692 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 5ffc2b1c410149e884a47240b5425e57 Oct 27 03:42:27.114692 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-AttachVolumeTestJSON-1593697068-project Oct 27 03:42:27.114692 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:42:27.114692 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b could not be found. Oct 27 03:42:27.114692 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': 'db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b'} Oct 27 03:42:27.114692 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:42:27.114692 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:27.114692 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:42:27.114692 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:42:27.114692 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:42:27.114692 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:42:27.114692 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:42:27.114692 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:42:27.114692 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:42:27.114692 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:42:27.114692 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b could not be found. Oct 27 03:42:27.114692 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:42:27.114692 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:42:27.114692 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:42:27.114692 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:27.114692 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:42:27.114692 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:42:27.114692 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:42:27.114692 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:42:27.114692 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:42:27.114692 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:42:27.114692 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:42:27.114692 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:42:27.114692 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:42:27.114692 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:42:27.114692 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:42:27.114692 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:42:27.119585 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b could not be found. Oct 27 03:42:27.119585 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:42:27.119585 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:42:27.119585 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:42:27.119585 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:27.119585 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:42:27.119585 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:42:27.119585 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:42:27.119585 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:42:27.119585 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b could not be found. Oct 27 03:42:27.119585 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:42:27.119585 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-cc303b9a-1dc9-43a0-90b3-1e3a43da12ca tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Returning 404 to user: Instance db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:42:27.122163 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-cc303b9a-1dc9-43a0-90b3-1e3a43da12ca tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b" status: 404 len: 111 microversion: 2.1 time: 0.038669 Oct 27 03:42:27.126655 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2384/5056] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:27 2022] GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:42:27.127732 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e8ba70ad-93ed-4c88-8144-02bf0b36e08e tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] 10.222.0.20 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1513 microversion: 2.1 time: 0.417863 Oct 27 03:42:27.128736 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2673/5057] 10.222.0.20 () {58 vars in 1167 bytes} [Thu Oct 27 03:42:26 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1513 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:42:27.141520 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-44298189-f5d0-4a4f-bc51-8f88373b0c53 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Calling method '.version_select at 0x7f7ddaa91af0>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:27.158861 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-90035e67-8833-4c04-b014-80fae91942d3 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:27.165142 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-90035e67-8833-4c04-b014-80fae91942d3 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '82daefe001364499b2ee9eb7da2599be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:27.166336 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-90035e67-8833-4c04-b014-80fae91942d3 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1338804421', 'deleted': False, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf'} {{(pid=121001) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 03:42:27.172572 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-90035e67-8833-4c04-b014-80fae91942d3 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:27.172978 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-90035e67-8833-4c04-b014-80fae91942d3 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:27.173409 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-90035e67-8833-4c04-b014-80fae91942d3 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:27.174177 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-90035e67-8833-4c04-b014-80fae91942d3 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:27.174634 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-90035e67-8833-4c04-b014-80fae91942d3 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:27.175109 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-90035e67-8833-4c04-b014-80fae91942d3 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:27.258289 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-44298189-f5d0-4a4f-bc51-8f88373b0c53 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1326885653" status: 202 len: 0 microversion: 2.1 time: 0.129604 Oct 27 03:42:27.259024 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2385/5058] 10.222.0.20 () {58 vars in 1221 bytes} [Thu Oct 27 03:42:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1326885653 => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:42:27.327730 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.multi_cell_list [None req-90035e67-8833-4c04-b014-80fae91942d3 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121001) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 03:42:27.415574 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-90035e67-8833-4c04-b014-80fae91942d3 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82daefe001364499b2ee9eb7da2599be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:27.429734 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-90035e67-8833-4c04-b014-80fae91942d3 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:27.430217 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-90035e67-8833-4c04-b014-80fae91942d3 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:27.430728 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-90035e67-8833-4c04-b014-80fae91942d3 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:27.565545 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-90035e67-8833-4c04-b014-80fae91942d3 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] 10.222.0.20 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1338804421" status: 200 len: 1515 microversion: 2.1 time: 0.412097 Oct 27 03:42:27.566292 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2674/5059] 10.222.0.20 () {58 vars in 1263 bytes} [Thu Oct 27 03:42:27 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1338804421 => generated 1515 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:27.592954 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2813e384-85d4-4cfa-a72a-96b49d3b8585 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:27.598340 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2813e384-85d4-4cfa-a72a-96b49d3b8585 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '82daefe001364499b2ee9eb7da2599be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:27.599452 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-2813e384-85d4-4cfa-a72a-96b49d3b8585 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf'} {{(pid=121000) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 03:42:27.602150 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:42:27.608414 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2813e384-85d4-4cfa-a72a-96b49d3b8585 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:27.611130 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2813e384-85d4-4cfa-a72a-96b49d3b8585 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:27.611130 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2813e384-85d4-4cfa-a72a-96b49d3b8585 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:27.611130 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2813e384-85d4-4cfa-a72a-96b49d3b8585 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:27.611130 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2813e384-85d4-4cfa-a72a-96b49d3b8585 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:27.611479 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2813e384-85d4-4cfa-a72a-96b49d3b8585 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:27.785923 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.multi_cell_list [None req-2813e384-85d4-4cfa-a72a-96b49d3b8585 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=121000) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 03:42:27.870520 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2813e384-85d4-4cfa-a72a-96b49d3b8585 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82daefe001364499b2ee9eb7da2599be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:27.888927 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3eae4fd3-9a90-4220-b327-6960a974e37b tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:27.889628 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3eae4fd3-9a90-4220-b327-6960a974e37b tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: c9e02344-a91a-40c8-b8c0-c0abe503204c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:27.898809 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2813e384-85d4-4cfa-a72a-96b49d3b8585 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:27.899616 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2813e384-85d4-4cfa-a72a-96b49d3b8585 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:27.900250 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2813e384-85d4-4cfa-a72a-96b49d3b8585 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:27.902775 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3eae4fd3-9a90-4220-b327-6960a974e37b tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:27.905022 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3eae4fd3-9a90-4220-b327-6960a974e37b tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:27.905778 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3eae4fd3-9a90-4220-b327-6960a974e37b tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:27.907858 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3eae4fd3-9a90-4220-b327-6960a974e37b tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:27.909392 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3eae4fd3-9a90-4220-b327-6960a974e37b tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:27.912194 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3eae4fd3-9a90-4220-b327-6960a974e37b tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:28.129845 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3eae4fd3-9a90-4220-b327-6960a974e37b tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:28.136621 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2813e384-85d4-4cfa-a72a-96b49d3b8585 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] 10.222.0.20 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4516 microversion: 2.1 time: 0.548082 Oct 27 03:42:28.142253 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2386/5060] 10.222.0.20 () {58 vars in 1173 bytes} [Thu Oct 27 03:42:27 2022] GET /compute/v2.1/servers/detail?status=active => generated 4516 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:28.142523 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3eae4fd3-9a90-4220-b327-6960a974e37b tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c" status: 200 len: 1521 microversion: 2.1 time: 0.253136 Oct 27 03:42:28.142523 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2675/5061] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:27 2022] GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c => generated 1521 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:42:28.168945 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-874b45fb-6b0f-4e20-862f-82adbdcbe4d3 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:28.177272 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-874b45fb-6b0f-4e20-862f-82adbdcbe4d3 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '82daefe001364499b2ee9eb7da2599be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:28.177951 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.compute.servers [None req-874b45fb-6b0f-4e20-862f-82adbdcbe4d3 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Removing options 'limit' from query {{(pid=121000) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 27 03:42:28.179624 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-874b45fb-6b0f-4e20-862f-82adbdcbe4d3 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Searching by: {'deleted': False, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf'} {{(pid=121000) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 03:42:28.188205 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-874b45fb-6b0f-4e20-862f-82adbdcbe4d3 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:28.192949 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-874b45fb-6b0f-4e20-862f-82adbdcbe4d3 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:28.194280 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-874b45fb-6b0f-4e20-862f-82adbdcbe4d3 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:28.196711 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-874b45fb-6b0f-4e20-862f-82adbdcbe4d3 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:28.197387 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-874b45fb-6b0f-4e20-862f-82adbdcbe4d3 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:28.198017 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-874b45fb-6b0f-4e20-862f-82adbdcbe4d3 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:28.234354 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-480c616b-5f18-4dee-9a7e-59744ece5453 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:28.235137 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-480c616b-5f18-4dee-9a7e-59744ece5453 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: 003c8652-2a85-4abc-8f02-ff46b4afcfd1] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:28.243087 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-480c616b-5f18-4dee-9a7e-59744ece5453 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:28.255984 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-480c616b-5f18-4dee-9a7e-59744ece5453 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:28.255984 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-480c616b-5f18-4dee-9a7e-59744ece5453 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:28.255984 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-480c616b-5f18-4dee-9a7e-59744ece5453 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:28.255984 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-480c616b-5f18-4dee-9a7e-59744ece5453 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:28.255984 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-480c616b-5f18-4dee-9a7e-59744ece5453 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:28.267790 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-874b45fb-6b0f-4e20-862f-82adbdcbe4d3 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82daefe001364499b2ee9eb7da2599be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:28.276443 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-480c616b-5f18-4dee-9a7e-59744ece5453 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] HTTP exception thrown: Instance 003c8652-2a85-4abc-8f02-ff46b4afcfd1 could not be found. Oct 27 03:42:28.276592 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-874b45fb-6b0f-4e20-862f-82adbdcbe4d3 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:28.277012 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-874b45fb-6b0f-4e20-862f-82adbdcbe4d3 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:28.277514 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-874b45fb-6b0f-4e20-862f-82adbdcbe4d3 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:28.278439 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-480c616b-5f18-4dee-9a7e-59744ece5453 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Request method failure captured: Oct 27 03:42:28.278439 n-d-862769-1 devstack@n-api.service[121001]: request: DELETE /compute/v2.1/servers/003c8652-2a85-4abc-8f02-ff46b4afcfd1 HTTP/1.1 Oct 27 03:42:28.278439 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:42:28.278439 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:42:28.278439 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:42:28.278439 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:42:28.278439 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:42:28.278439 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:42:28.278439 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:42:28.278439 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:42:28.278439 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfyO20A1D6ympGjQc2k7pGwXBVoOs4AtFX551niq39NWe_HjifvxGvre6cHeeNp8osa7J1PNEE0_yy7-MG05YNEONXkGtR3-F0Zb6-60FxqOiIpeJ5N_dbXBRWjEl88UsCCW068A90fytHXWgtrGlYksZomXGQlrDugSxyxjlY4_NPY Oct 27 03:42:28.278439 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:42:28.278439 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:42:28.278439 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:42:28.278439 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:42:28.278439 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:42:28.278439 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:42:28.278439 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 229dcb63bc41444391544883b576ce2e Oct 27 03:42:28.278439 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-AttachVolumeNegativeTest-199004901 Oct 27 03:42:28.278439 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:42:28.278439 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:42:28.278439 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/229dcb63bc41444391544883b576ce2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/229dcb63bc41444391544883b576ce2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/229dcb63bc41444391544883b576ce2e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_229dcb63bc41444391544883b576ce2e"}]}] Oct 27 03:42:28.278439 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-AttachVolumeNegativeTest-199004901 Oct 27 03:42:28.278439 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 229dcb63bc41444391544883b576ce2e Oct 27 03:42:28.278439 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-199004901 Oct 27 03:42:28.278439 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-AttachVolumeNegativeTest-199004901-project Oct 27 03:42:28.278439 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:42:28.278439 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:42:28.278439 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 18036411a99e4634bfbaeae24b9f254d Oct 27 03:42:28.278439 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-AttachVolumeNegativeTest-199004901-project Oct 27 03:42:28.278439 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:42:28.278439 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 003c8652-2a85-4abc-8f02-ff46b4afcfd1 could not be found. Oct 27 03:42:28.278439 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '003c8652-2a85-4abc-8f02-ff46b4afcfd1'} Oct 27 03:42:28.278439 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:42:28.278439 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:28.278439 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:42:28.278439 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:42:28.278439 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:42:28.278439 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:42:28.278439 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:42:28.278439 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:42:28.278439 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:42:28.278439 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:42:28.278439 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 003c8652-2a85-4abc-8f02-ff46b4afcfd1 could not be found. Oct 27 03:42:28.278439 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:42:28.278439 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:42:28.278439 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:42:28.278439 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:28.278439 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:42:28.278439 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:42:28.278439 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:42:28.278439 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:42:28.278439 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:42:28.278439 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:42:28.278439 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 03:42:28.278439 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 03:42:28.278439 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 03:42:28.278439 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 03:42:28.278439 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:42:28.278439 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:42:28.278439 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:42:28.278439 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:42:28.283310 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 003c8652-2a85-4abc-8f02-ff46b4afcfd1 could not be found. Oct 27 03:42:28.283310 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:42:28.283310 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:42:28.283310 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:42:28.283310 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:28.283310 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:42:28.283310 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:42:28.283310 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:42:28.283310 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:42:28.283310 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 003c8652-2a85-4abc-8f02-ff46b4afcfd1 could not be found. Oct 27 03:42:28.283310 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:42:28.283310 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-480c616b-5f18-4dee-9a7e-59744ece5453 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Returning 404 to user: Instance 003c8652-2a85-4abc-8f02-ff46b4afcfd1 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:42:28.283310 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-480c616b-5f18-4dee-9a7e-59744ece5453 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "DELETE /compute/v2.1/servers/003c8652-2a85-4abc-8f02-ff46b4afcfd1" status: 404 len: 111 microversion: 2.1 time: 0.052140 Oct 27 03:42:28.283310 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2676/5062] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:42:28 2022] DELETE /compute/v2.1/servers/003c8652-2a85-4abc-8f02-ff46b4afcfd1 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 03:42:28.291592 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2d5f1864-6bfc-485f-b386-51b079cd49f6 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:28.292378 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2d5f1864-6bfc-485f-b386-51b079cd49f6 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: 003c8652-2a85-4abc-8f02-ff46b4afcfd1] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:28.299552 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2d5f1864-6bfc-485f-b386-51b079cd49f6 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:28.300164 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2d5f1864-6bfc-485f-b386-51b079cd49f6 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:28.300614 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2d5f1864-6bfc-485f-b386-51b079cd49f6 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:28.301752 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2d5f1864-6bfc-485f-b386-51b079cd49f6 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:28.302443 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2d5f1864-6bfc-485f-b386-51b079cd49f6 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:28.304341 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2d5f1864-6bfc-485f-b386-51b079cd49f6 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:28.323953 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-2d5f1864-6bfc-485f-b386-51b079cd49f6 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] HTTP exception thrown: Instance 003c8652-2a85-4abc-8f02-ff46b4afcfd1 could not be found. Oct 27 03:42:28.325578 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2d5f1864-6bfc-485f-b386-51b079cd49f6 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Request method failure captured: Oct 27 03:42:28.325578 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/003c8652-2a85-4abc-8f02-ff46b4afcfd1 HTTP/1.1 Oct 27 03:42:28.325578 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:42:28.325578 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:42:28.325578 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:42:28.325578 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:42:28.325578 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:42:28.325578 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:42:28.325578 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:42:28.325578 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:42:28.325578 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfyO20A1D6ympGjQc2k7pGwXBVoOs4AtFX551niq39NWe_HjifvxGvre6cHeeNp8osa7J1PNEE0_yy7-MG05YNEONXkGtR3-F0Zb6-60FxqOiIpeJ5N_dbXBRWjEl88UsCCW068A90fytHXWgtrGlYksZomXGQlrDugSxyxjlY4_NPY Oct 27 03:42:28.325578 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:42:28.325578 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:42:28.325578 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:42:28.325578 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:42:28.325578 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:42:28.325578 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:42:28.325578 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 229dcb63bc41444391544883b576ce2e Oct 27 03:42:28.325578 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-AttachVolumeNegativeTest-199004901 Oct 27 03:42:28.325578 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:42:28.325578 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:42:28.325578 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/229dcb63bc41444391544883b576ce2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/229dcb63bc41444391544883b576ce2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/229dcb63bc41444391544883b576ce2e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_229dcb63bc41444391544883b576ce2e"}]}] Oct 27 03:42:28.325578 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-AttachVolumeNegativeTest-199004901 Oct 27 03:42:28.325578 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 229dcb63bc41444391544883b576ce2e Oct 27 03:42:28.325578 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-199004901 Oct 27 03:42:28.325578 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-AttachVolumeNegativeTest-199004901-project Oct 27 03:42:28.325578 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:42:28.325578 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:42:28.325578 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 18036411a99e4634bfbaeae24b9f254d Oct 27 03:42:28.325578 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-AttachVolumeNegativeTest-199004901-project Oct 27 03:42:28.325578 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:42:28.325578 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 003c8652-2a85-4abc-8f02-ff46b4afcfd1 could not be found. Oct 27 03:42:28.325578 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '003c8652-2a85-4abc-8f02-ff46b4afcfd1'} Oct 27 03:42:28.325578 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:42:28.325578 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:28.325578 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:42:28.325578 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:42:28.325578 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:42:28.325578 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:42:28.325578 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:42:28.325578 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:42:28.325578 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:42:28.325578 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:42:28.325578 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 003c8652-2a85-4abc-8f02-ff46b4afcfd1 could not be found. Oct 27 03:42:28.325578 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:42:28.325578 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:42:28.325578 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:42:28.325578 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:28.325578 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:42:28.325578 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:42:28.325578 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:42:28.325578 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:42:28.325578 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:42:28.325578 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:42:28.325578 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:42:28.325578 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:42:28.325578 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:42:28.325578 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:42:28.325578 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:42:28.325578 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:42:28.325578 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 003c8652-2a85-4abc-8f02-ff46b4afcfd1 could not be found. Oct 27 03:42:28.325578 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:42:28.325578 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:42:28.325578 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:42:28.330334 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:28.330334 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:42:28.330334 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:42:28.330334 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:42:28.330334 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:42:28.330334 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 003c8652-2a85-4abc-8f02-ff46b4afcfd1 could not be found. Oct 27 03:42:28.330334 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:42:28.330334 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2d5f1864-6bfc-485f-b386-51b079cd49f6 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Returning 404 to user: Instance 003c8652-2a85-4abc-8f02-ff46b4afcfd1 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:42:28.330334 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2d5f1864-6bfc-485f-b386-51b079cd49f6 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/003c8652-2a85-4abc-8f02-ff46b4afcfd1" status: 404 len: 111 microversion: 2.1 time: 0.039898 Oct 27 03:42:28.333876 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2677/5063] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:28 2022] GET /compute/v2.1/servers/003c8652-2a85-4abc-8f02-ff46b4afcfd1 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 03:42:28.543135 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-874b45fb-6b0f-4e20-862f-82adbdcbe4d3 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] 10.222.0.20 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1659 microversion: 2.1 time: 0.379607 Oct 27 03:42:28.544011 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2387/5064] 10.222.0.20 () {58 vars in 1161 bytes} [Thu Oct 27 03:42:28 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1659 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:28.570529 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7828af7b-3a51-4f5e-9e84-d3497607ff1e tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:28.576483 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7828af7b-3a51-4f5e-9e84-d3497607ff1e tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '82daefe001364499b2ee9eb7da2599be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:28.577538 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7828af7b-3a51-4f5e-9e84-d3497607ff1e tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf'} {{(pid=121001) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 03:42:28.584435 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7828af7b-3a51-4f5e-9e84-d3497607ff1e tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:28.585751 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7828af7b-3a51-4f5e-9e84-d3497607ff1e tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:28.588452 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7828af7b-3a51-4f5e-9e84-d3497607ff1e tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:28.588452 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7828af7b-3a51-4f5e-9e84-d3497607ff1e tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:28.588452 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7828af7b-3a51-4f5e-9e84-d3497607ff1e tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:28.588452 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7828af7b-3a51-4f5e-9e84-d3497607ff1e tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:28.607224 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f9cf78dd-40db-4132-918e-d6377c99485b tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Action: 'create', calling method: .version_select at 0x7f7dd9debd30>, body: {"keypair": {"name": "tempest-keypair-954509478", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB6792y2rg/563QgmgGyBw4XFcjUCN8Cfp8DgfOYMsUdXcSnMDVxPwifVu5YU665dU7Srx0a0r0LKl1ucEW4YatcgTzndH9RHYP2bQRcBaIMofld4Aq02U9pRFVVgwPWww=="}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:42:28.630855 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-f9cf78dd-40db-4132-918e-d6377c99485b tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Getting quotas for project 38450368ef5c4e68ac3c19c7a0a1ce65. Resources: {'key_pairs'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:42:28.636996 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-f9cf78dd-40db-4132-918e-d6377c99485b tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Getting quotas for user 5ffc2b1c410149e884a47240b5425e57 and project 38450368ef5c4e68ac3c19c7a0a1ce65. Resources: {'key_pairs'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:42:28.649819 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.multi_cell_list [None req-7828af7b-3a51-4f5e-9e84-d3497607ff1e tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=121001) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 03:42:28.686544 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7828af7b-3a51-4f5e-9e84-d3497607ff1e tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] 10.222.0.20 "GET /compute/v2.1/servers?status=active" status: 200 len: 1010 microversion: 2.1 time: 0.120238 Oct 27 03:42:28.687157 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2678/5065] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Oct 27 03:42:28 2022] GET /compute/v2.1/servers?status=active => generated 1010 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:28.701674 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ea60aa6b-b032-46ec-8bfd-a642049ffa19 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:28.716197 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ea60aa6b-b032-46ec-8bfd-a642049ffa19 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '82daefe001364499b2ee9eb7da2599be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:28.718830 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.compute.servers [None req-ea60aa6b-b032-46ec-8bfd-a642049ffa19 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Removing options 'limit' from query {{(pid=121001) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 27 03:42:28.719692 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ea60aa6b-b032-46ec-8bfd-a642049ffa19 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Searching by: {'deleted': False, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf'} {{(pid=121001) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 03:42:28.727201 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ea60aa6b-b032-46ec-8bfd-a642049ffa19 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:28.727832 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ea60aa6b-b032-46ec-8bfd-a642049ffa19 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:28.728132 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ea60aa6b-b032-46ec-8bfd-a642049ffa19 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:28.728901 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ea60aa6b-b032-46ec-8bfd-a642049ffa19 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:28.729364 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ea60aa6b-b032-46ec-8bfd-a642049ffa19 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:28.729796 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ea60aa6b-b032-46ec-8bfd-a642049ffa19 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:28.757748 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.multi_cell_list [None req-ea60aa6b-b032-46ec-8bfd-a642049ffa19 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=121001) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 03:42:28.789171 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ea60aa6b-b032-46ec-8bfd-a642049ffa19 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] 10.222.0.20 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1010 microversion: 2.1 time: 0.090626 Oct 27 03:42:28.790153 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2679/5066] 10.222.0.20 () {58 vars in 1150 bytes} [Thu Oct 27 03:42:28 2022] GET /compute/v2.1/servers?limit=100000 => generated 1010 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:28.792410 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f9cf78dd-40db-4132-918e-d6377c99485b tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.188044 Oct 27 03:42:28.793873 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2388/5067] 10.222.0.20 () {60 vars in 1159 bytes} [Thu Oct 27 03:42:28 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:42:28.816573 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-465555b1-b886-4e01-91fd-a93b4b9d4aac tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:28.838470 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-465555b1-b886-4e01-91fd-a93b4b9d4aac tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '82daefe001364499b2ee9eb7da2599be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:28.839195 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-465555b1-b886-4e01-91fd-a93b4b9d4aac tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Searching by: {'deleted': False, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf'} {{(pid=121001) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 03:42:28.844728 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-465555b1-b886-4e01-91fd-a93b4b9d4aac tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:28.845436 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-465555b1-b886-4e01-91fd-a93b4b9d4aac tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:28.846066 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-465555b1-b886-4e01-91fd-a93b4b9d4aac tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:28.847028 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-465555b1-b886-4e01-91fd-a93b4b9d4aac tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:28.847899 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-465555b1-b886-4e01-91fd-a93b4b9d4aac tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:28.848716 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-465555b1-b886-4e01-91fd-a93b4b9d4aac tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:28.887713 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.multi_cell_list [None req-465555b1-b886-4e01-91fd-a93b4b9d4aac tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=121001) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 03:42:28.923454 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-465555b1-b886-4e01-91fd-a93b4b9d4aac tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 1010 microversion: 2.1 time: 0.114312 Oct 27 03:42:28.924168 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2680/5068] 10.222.0.20 () {58 vars in 1125 bytes} [Thu Oct 27 03:42:28 2022] GET /compute/v2.1/servers => generated 1010 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:28.939326 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0e543ad8-54ed-40ff-83ce-74c4e9d5b0ea tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:28.950559 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0e543ad8-54ed-40ff-83ce-74c4e9d5b0ea tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '82daefe001364499b2ee9eb7da2599be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:28.958466 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0e543ad8-54ed-40ff-83ce-74c4e9d5b0ea tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf'} {{(pid=121000) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 03:42:28.984028 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0e543ad8-54ed-40ff-83ce-74c4e9d5b0ea tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:28.985218 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0e543ad8-54ed-40ff-83ce-74c4e9d5b0ea tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:28.985708 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0e543ad8-54ed-40ff-83ce-74c4e9d5b0ea tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:28.989318 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0e543ad8-54ed-40ff-83ce-74c4e9d5b0ea tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:28.989830 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0e543ad8-54ed-40ff-83ce-74c4e9d5b0ea tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:28.990308 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0e543ad8-54ed-40ff-83ce-74c4e9d5b0ea tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:29.135217 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.multi_cell_list [None req-0e543ad8-54ed-40ff-83ce-74c4e9d5b0ea tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121000) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 03:42:29.165829 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d17e8761-4227-4b22-8d18-07affb4140e3 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:29.166488 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d17e8761-4227-4b22-8d18-07affb4140e3 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: c9e02344-a91a-40c8-b8c0-c0abe503204c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:29.183156 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d17e8761-4227-4b22-8d18-07affb4140e3 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:29.184141 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d17e8761-4227-4b22-8d18-07affb4140e3 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:29.185021 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d17e8761-4227-4b22-8d18-07affb4140e3 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:29.186455 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d17e8761-4227-4b22-8d18-07affb4140e3 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:29.187713 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d17e8761-4227-4b22-8d18-07affb4140e3 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:29.188556 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d17e8761-4227-4b22-8d18-07affb4140e3 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:29.220989 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0e543ad8-54ed-40ff-83ce-74c4e9d5b0ea tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] 10.222.0.20 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 345 microversion: 2.1 time: 0.285676 Oct 27 03:42:29.222062 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2389/5069] 10.222.0.20 () {58 vars in 1146 bytes} [Thu Oct 27 03:42:28 2022] GET /compute/v2.1/servers?flavor=451 => generated 345 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:42:29.240390 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-58c39a1c-dc77-4750-9c46-7cf5fa1c6496 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:29.254467 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-58c39a1c-dc77-4750-9c46-7cf5fa1c6496 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '82daefe001364499b2ee9eb7da2599be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:29.258539 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.compute.servers [None req-58c39a1c-dc77-4750-9c46-7cf5fa1c6496 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Removing options 'limit' from query {{(pid=121000) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 27 03:42:29.259682 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-58c39a1c-dc77-4750-9c46-7cf5fa1c6496 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Searching by: {'deleted': False, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf'} {{(pid=121000) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 03:42:29.287169 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-58c39a1c-dc77-4750-9c46-7cf5fa1c6496 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:29.288743 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-58c39a1c-dc77-4750-9c46-7cf5fa1c6496 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:29.291696 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-58c39a1c-dc77-4750-9c46-7cf5fa1c6496 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:29.292759 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-58c39a1c-dc77-4750-9c46-7cf5fa1c6496 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:29.294552 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-58c39a1c-dc77-4750-9c46-7cf5fa1c6496 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:29.297382 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-58c39a1c-dc77-4750-9c46-7cf5fa1c6496 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:29.337845 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-58c39a1c-dc77-4750-9c46-7cf5fa1c6496 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] 10.222.0.20 "GET /compute/v2.1/servers?limit=1" status: 200 len: 484 microversion: 2.1 time: 0.102542 Oct 27 03:42:29.339120 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2390/5070] 10.222.0.20 () {58 vars in 1140 bytes} [Thu Oct 27 03:42:29 2022] GET /compute/v2.1/servers?limit=1 => generated 484 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:42:29.357623 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-601dbb6e-b000-416e-8dd4-bbc8bcb3a65d tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:29.369614 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-601dbb6e-b000-416e-8dd4-bbc8bcb3a65d tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '82daefe001364499b2ee9eb7da2599be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:29.370932 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-601dbb6e-b000-416e-8dd4-bbc8bcb3a65d tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1338804421', 'deleted': False, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf'} {{(pid=121000) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 03:42:29.377157 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-601dbb6e-b000-416e-8dd4-bbc8bcb3a65d tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:29.377905 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-601dbb6e-b000-416e-8dd4-bbc8bcb3a65d tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:29.378665 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-601dbb6e-b000-416e-8dd4-bbc8bcb3a65d tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:29.379803 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-601dbb6e-b000-416e-8dd4-bbc8bcb3a65d tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:29.380469 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-601dbb6e-b000-416e-8dd4-bbc8bcb3a65d tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:29.381100 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-601dbb6e-b000-416e-8dd4-bbc8bcb3a65d tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:29.389552 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d17e8761-4227-4b22-8d18-07affb4140e3 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:29.401512 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d17e8761-4227-4b22-8d18-07affb4140e3 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c" status: 200 len: 1521 microversion: 2.1 time: 0.239877 Oct 27 03:42:29.410063 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2681/5071] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:29 2022] GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c => generated 1521 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:29.497674 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.multi_cell_list [None req-601dbb6e-b000-416e-8dd4-bbc8bcb3a65d tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121000) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 03:42:29.568188 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-601dbb6e-b000-416e-8dd4-bbc8bcb3a65d tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] 10.222.0.20 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1338804421" status: 200 len: 346 microversion: 2.1 time: 0.218127 Oct 27 03:42:29.568911 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2391/5072] 10.222.0.20 () {58 vars in 1242 bytes} [Thu Oct 27 03:42:29 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1338804421 => generated 346 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:42:29.586079 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-25d88844-2da3-48f3-90cb-6f7a7d752a76 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:42:29.594152 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-25d88844-2da3-48f3-90cb-6f7a7d752a76 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:29.595025 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-25d88844-2da3-48f3-90cb-6f7a7d752a76 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:29.595638 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-25d88844-2da3-48f3-90cb-6f7a7d752a76 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:29.620809 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-25d88844-2da3-48f3-90cb-6f7a7d752a76 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] [instance: 20bed685-d855-499c-90d6-f8c59cfbd701] Going to try to stop instance {{(pid=121001) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 27 03:42:29.690641 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3add4db7-cc87-40bc-8a23-6d0fb0a7b283 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:29.691107 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-3add4db7-cc87-40bc-8a23-6d0fb0a7b283 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 2ec095f2-c25e-434f-87ff-10788b0fe6c3] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:29.700550 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3add4db7-cc87-40bc-8a23-6d0fb0a7b283 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:29.711037 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3add4db7-cc87-40bc-8a23-6d0fb0a7b283 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:29.711037 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3add4db7-cc87-40bc-8a23-6d0fb0a7b283 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:29.711037 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3add4db7-cc87-40bc-8a23-6d0fb0a7b283 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:29.711037 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3add4db7-cc87-40bc-8a23-6d0fb0a7b283 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:29.711037 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3add4db7-cc87-40bc-8a23-6d0fb0a7b283 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:29.721776 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-3add4db7-cc87-40bc-8a23-6d0fb0a7b283 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] HTTP exception thrown: Instance 2ec095f2-c25e-434f-87ff-10788b0fe6c3 could not be found. Oct 27 03:42:29.723588 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3add4db7-cc87-40bc-8a23-6d0fb0a7b283 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Request method failure captured: Oct 27 03:42:29.723588 n-d-862769-1 devstack@n-api.service[121000]: request: DELETE /compute/v2.1/servers/2ec095f2-c25e-434f-87ff-10788b0fe6c3 HTTP/1.1 Oct 27 03:42:29.723588 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:42:29.723588 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:42:29.723588 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:42:29.723588 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:42:29.723588 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:42:29.723588 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:42:29.723588 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:42:29.723588 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:42:29.723588 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfz83jPBQR-IO_RgpXfqqqN_tSIl3Aju213bQLpPTkR-R_lkTGSpHz1Evy7Lbg7I5hWxU9AxviJyxNS0i-wRdj1_O4LyvZEjE6jerjzwB22Vu4S-ThF8W8FJgumwczGUcQup-Bjpiay7kN0UoT8q0uFoQytE3MKt1MX9CDbsUgcc03A Oct 27 03:42:29.723588 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:42:29.723588 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:42:29.723588 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:42:29.723588 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:42:29.723588 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:42:29.723588 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:42:29.723588 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 911997e881754ce390af17919f29b4ab Oct 27 03:42:29.723588 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-DeleteServersTestJSON-858473437 Oct 27 03:42:29.723588 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:42:29.723588 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:42:29.723588 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/911997e881754ce390af17919f29b4ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/911997e881754ce390af17919f29b4ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/911997e881754ce390af17919f29b4ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_911997e881754ce390af17919f29b4ab"}]}] Oct 27 03:42:29.723588 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-DeleteServersTestJSON-858473437 Oct 27 03:42:29.723588 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 911997e881754ce390af17919f29b4ab Oct 27 03:42:29.723588 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-DeleteServersTestJSON-858473437 Oct 27 03:42:29.723588 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-DeleteServersTestJSON-858473437-project Oct 27 03:42:29.723588 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:42:29.723588 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:42:29.723588 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: b1cc79af058b4c35b3c572448fac86a7 Oct 27 03:42:29.723588 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-DeleteServersTestJSON-858473437-project Oct 27 03:42:29.723588 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:42:29.723588 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 2ec095f2-c25e-434f-87ff-10788b0fe6c3 could not be found. Oct 27 03:42:29.723588 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '2ec095f2-c25e-434f-87ff-10788b0fe6c3'} Oct 27 03:42:29.723588 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:42:29.723588 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:29.723588 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:42:29.723588 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:42:29.723588 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:42:29.723588 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:42:29.723588 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:42:29.723588 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:42:29.723588 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:42:29.723588 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:42:29.723588 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ec095f2-c25e-434f-87ff-10788b0fe6c3 could not be found. Oct 27 03:42:29.723588 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:42:29.723588 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:42:29.723588 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:42:29.723588 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:29.723588 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:42:29.723588 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:42:29.723588 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:42:29.723588 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:42:29.723588 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:42:29.723588 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:42:29.723588 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 03:42:29.723588 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 03:42:29.723588 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 03:42:29.723588 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 03:42:29.723588 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:42:29.723588 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:42:29.723588 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:42:29.723588 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:42:29.729738 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ec095f2-c25e-434f-87ff-10788b0fe6c3 could not be found. Oct 27 03:42:29.729738 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:42:29.729738 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:42:29.729738 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:42:29.729738 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:29.729738 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:42:29.729738 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:42:29.729738 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:42:29.729738 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:42:29.729738 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ec095f2-c25e-434f-87ff-10788b0fe6c3 could not be found. Oct 27 03:42:29.729738 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:42:29.729738 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3add4db7-cc87-40bc-8a23-6d0fb0a7b283 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Returning 404 to user: Instance 2ec095f2-c25e-434f-87ff-10788b0fe6c3 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:42:29.729738 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3add4db7-cc87-40bc-8a23-6d0fb0a7b283 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2ec095f2-c25e-434f-87ff-10788b0fe6c3" status: 404 len: 111 microversion: 2.1 time: 0.040470 Oct 27 03:42:29.729738 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2392/5073] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:42:29 2022] DELETE /compute/v2.1/servers/2ec095f2-c25e-434f-87ff-10788b0fe6c3 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 03:42:29.748269 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e4e46f2c-946b-45d4-be94-55e669862d13 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:29.749080 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e4e46f2c-946b-45d4-be94-55e669862d13 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 2ec095f2-c25e-434f-87ff-10788b0fe6c3] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:29.757732 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e4e46f2c-946b-45d4-be94-55e669862d13 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:29.758452 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e4e46f2c-946b-45d4-be94-55e669862d13 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:29.758821 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e4e46f2c-946b-45d4-be94-55e669862d13 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:29.759835 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e4e46f2c-946b-45d4-be94-55e669862d13 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:29.761249 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e4e46f2c-946b-45d4-be94-55e669862d13 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:29.761891 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e4e46f2c-946b-45d4-be94-55e669862d13 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:29.780094 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-e4e46f2c-946b-45d4-be94-55e669862d13 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] HTTP exception thrown: Instance 2ec095f2-c25e-434f-87ff-10788b0fe6c3 could not be found. Oct 27 03:42:29.781930 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e4e46f2c-946b-45d4-be94-55e669862d13 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Request method failure captured: Oct 27 03:42:29.781930 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/2ec095f2-c25e-434f-87ff-10788b0fe6c3 HTTP/1.1 Oct 27 03:42:29.781930 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:42:29.781930 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:42:29.781930 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:42:29.781930 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:42:29.781930 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:42:29.781930 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:42:29.781930 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:42:29.781930 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:42:29.781930 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfz83jPBQR-IO_RgpXfqqqN_tSIl3Aju213bQLpPTkR-R_lkTGSpHz1Evy7Lbg7I5hWxU9AxviJyxNS0i-wRdj1_O4LyvZEjE6jerjzwB22Vu4S-ThF8W8FJgumwczGUcQup-Bjpiay7kN0UoT8q0uFoQytE3MKt1MX9CDbsUgcc03A Oct 27 03:42:29.781930 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:42:29.781930 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:42:29.781930 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:42:29.781930 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:42:29.781930 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:42:29.781930 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:42:29.781930 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 911997e881754ce390af17919f29b4ab Oct 27 03:42:29.781930 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-DeleteServersTestJSON-858473437 Oct 27 03:42:29.781930 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:42:29.781930 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:42:29.781930 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/911997e881754ce390af17919f29b4ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/911997e881754ce390af17919f29b4ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/911997e881754ce390af17919f29b4ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_911997e881754ce390af17919f29b4ab"}]}] Oct 27 03:42:29.781930 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-DeleteServersTestJSON-858473437 Oct 27 03:42:29.781930 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 911997e881754ce390af17919f29b4ab Oct 27 03:42:29.781930 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-DeleteServersTestJSON-858473437 Oct 27 03:42:29.781930 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-DeleteServersTestJSON-858473437-project Oct 27 03:42:29.781930 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:42:29.781930 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:42:29.781930 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: b1cc79af058b4c35b3c572448fac86a7 Oct 27 03:42:29.781930 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-DeleteServersTestJSON-858473437-project Oct 27 03:42:29.781930 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:42:29.781930 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 2ec095f2-c25e-434f-87ff-10788b0fe6c3 could not be found. Oct 27 03:42:29.781930 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '2ec095f2-c25e-434f-87ff-10788b0fe6c3'} Oct 27 03:42:29.781930 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:42:29.781930 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:29.781930 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:42:29.781930 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:42:29.781930 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:42:29.781930 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:42:29.781930 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:42:29.781930 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:42:29.781930 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:42:29.781930 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:42:29.781930 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ec095f2-c25e-434f-87ff-10788b0fe6c3 could not be found. Oct 27 03:42:29.781930 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:42:29.781930 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:42:29.781930 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:42:29.781930 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:29.781930 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:42:29.781930 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:42:29.781930 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:42:29.781930 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:42:29.781930 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:42:29.781930 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:42:29.781930 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:42:29.781930 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:42:29.781930 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:42:29.781930 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:42:29.781930 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:42:29.781930 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:42:29.781930 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ec095f2-c25e-434f-87ff-10788b0fe6c3 could not be found. Oct 27 03:42:29.781930 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:42:29.781930 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:42:29.781930 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:42:29.786087 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:29.786087 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:42:29.786087 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:42:29.786087 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:42:29.786087 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:42:29.786087 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ec095f2-c25e-434f-87ff-10788b0fe6c3 could not be found. Oct 27 03:42:29.786087 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:42:29.786087 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e4e46f2c-946b-45d4-be94-55e669862d13 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Returning 404 to user: Instance 2ec095f2-c25e-434f-87ff-10788b0fe6c3 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:42:29.786087 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e4e46f2c-946b-45d4-be94-55e669862d13 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/2ec095f2-c25e-434f-87ff-10788b0fe6c3" status: 404 len: 111 microversion: 2.1 time: 0.040090 Oct 27 03:42:29.786087 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2393/5074] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:29 2022] GET /compute/v2.1/servers/2ec095f2-c25e-434f-87ff-10788b0fe6c3 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 03:42:29.799068 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-02a27655-7524-4e05-b321-27bd96a89519 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:29.799626 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-02a27655-7524-4e05-b321-27bd96a89519 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 17bdf735-2944-4b40-984c-4646caa855f0] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:29.818329 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-02a27655-7524-4e05-b321-27bd96a89519 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:29.818844 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-02a27655-7524-4e05-b321-27bd96a89519 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:29.819698 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-02a27655-7524-4e05-b321-27bd96a89519 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:29.820445 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-02a27655-7524-4e05-b321-27bd96a89519 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:29.821003 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-02a27655-7524-4e05-b321-27bd96a89519 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:29.823060 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-02a27655-7524-4e05-b321-27bd96a89519 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:29.845753 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-25d88844-2da3-48f3-90cb-6f7a7d752a76 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] 10.222.0.20 "POST /compute/v2.1/servers/20bed685-d855-499c-90d6-f8c59cfbd701/action" status: 202 len: 0 microversion: 2.1 time: 0.264956 Oct 27 03:42:29.846591 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2682/5075] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:42:29 2022] POST /compute/v2.1/servers/20bed685-d855-499c-90d6-f8c59cfbd701/action => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:42:29.858809 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b36fca06-2363-4522-bfe6-0e65744e9af8 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:29.859925 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b36fca06-2363-4522-bfe6-0e65744e9af8 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] [instance: 20bed685-d855-499c-90d6-f8c59cfbd701] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:29.867785 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b36fca06-2363-4522-bfe6-0e65744e9af8 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:29.869152 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b36fca06-2363-4522-bfe6-0e65744e9af8 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:29.869991 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b36fca06-2363-4522-bfe6-0e65744e9af8 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:29.871117 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b36fca06-2363-4522-bfe6-0e65744e9af8 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:29.872081 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b36fca06-2363-4522-bfe6-0e65744e9af8 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:29.873134 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b36fca06-2363-4522-bfe6-0e65744e9af8 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:29.874575 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-02a27655-7524-4e05-b321-27bd96a89519 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] HTTP exception thrown: Instance 17bdf735-2944-4b40-984c-4646caa855f0 could not be found. Oct 27 03:42:29.877239 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-02a27655-7524-4e05-b321-27bd96a89519 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Request method failure captured: Oct 27 03:42:29.877239 n-d-862769-1 devstack@n-api.service[121000]: request: DELETE /compute/v2.1/servers/17bdf735-2944-4b40-984c-4646caa855f0 HTTP/1.1 Oct 27 03:42:29.877239 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:42:29.877239 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:42:29.877239 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:42:29.877239 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:42:29.877239 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:42:29.877239 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:42:29.877239 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:42:29.877239 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:42:29.877239 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfz83jPBQR-IO_RgpXfqqqN_tSIl3Aju213bQLpPTkR-R_lkTGSpHz1Evy7Lbg7I5hWxU9AxviJyxNS0i-wRdj1_O4LyvZEjE6jerjzwB22Vu4S-ThF8W8FJgumwczGUcQup-Bjpiay7kN0UoT8q0uFoQytE3MKt1MX9CDbsUgcc03A Oct 27 03:42:29.877239 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:42:29.877239 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:42:29.877239 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:42:29.877239 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:42:29.877239 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:42:29.877239 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:42:29.877239 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 911997e881754ce390af17919f29b4ab Oct 27 03:42:29.877239 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-DeleteServersTestJSON-858473437 Oct 27 03:42:29.877239 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:42:29.877239 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:42:29.877239 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/911997e881754ce390af17919f29b4ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/911997e881754ce390af17919f29b4ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/911997e881754ce390af17919f29b4ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_911997e881754ce390af17919f29b4ab"}]}] Oct 27 03:42:29.877239 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-DeleteServersTestJSON-858473437 Oct 27 03:42:29.877239 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 911997e881754ce390af17919f29b4ab Oct 27 03:42:29.877239 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-DeleteServersTestJSON-858473437 Oct 27 03:42:29.877239 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-DeleteServersTestJSON-858473437-project Oct 27 03:42:29.877239 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:42:29.877239 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:42:29.877239 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: b1cc79af058b4c35b3c572448fac86a7 Oct 27 03:42:29.877239 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-DeleteServersTestJSON-858473437-project Oct 27 03:42:29.877239 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:42:29.877239 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 17bdf735-2944-4b40-984c-4646caa855f0 could not be found. Oct 27 03:42:29.877239 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '17bdf735-2944-4b40-984c-4646caa855f0'} Oct 27 03:42:29.877239 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:42:29.877239 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:29.877239 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:42:29.877239 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:42:29.877239 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:42:29.877239 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:42:29.877239 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:42:29.877239 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:42:29.877239 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:42:29.877239 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:42:29.877239 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17bdf735-2944-4b40-984c-4646caa855f0 could not be found. Oct 27 03:42:29.877239 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:42:29.877239 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:42:29.877239 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:42:29.877239 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:29.877239 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:42:29.877239 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:42:29.877239 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:42:29.877239 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:42:29.877239 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:42:29.877239 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:42:29.877239 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 03:42:29.877239 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 03:42:29.877239 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 03:42:29.877239 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 03:42:29.877239 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:42:29.877239 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:42:29.877239 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:42:29.877239 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:42:29.881073 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17bdf735-2944-4b40-984c-4646caa855f0 could not be found. Oct 27 03:42:29.881073 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:42:29.881073 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:42:29.881073 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:42:29.881073 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:29.881073 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:42:29.881073 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:42:29.881073 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:42:29.881073 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:42:29.881073 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17bdf735-2944-4b40-984c-4646caa855f0 could not be found. Oct 27 03:42:29.881073 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:42:29.881073 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-02a27655-7524-4e05-b321-27bd96a89519 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Returning 404 to user: Instance 17bdf735-2944-4b40-984c-4646caa855f0 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:42:29.881073 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-02a27655-7524-4e05-b321-27bd96a89519 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "DELETE /compute/v2.1/servers/17bdf735-2944-4b40-984c-4646caa855f0" status: 404 len: 111 microversion: 2.1 time: 0.089543 Oct 27 03:42:29.882559 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2394/5076] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:42:29 2022] DELETE /compute/v2.1/servers/17bdf735-2944-4b40-984c-4646caa855f0 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:42:29.894214 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-797d46f2-9003-40db-a4bf-2c8ff56ee3e5 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:29.894937 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-797d46f2-9003-40db-a4bf-2c8ff56ee3e5 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] [instance: 17bdf735-2944-4b40-984c-4646caa855f0] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:29.940290 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-797d46f2-9003-40db-a4bf-2c8ff56ee3e5 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:29.945704 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-797d46f2-9003-40db-a4bf-2c8ff56ee3e5 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:29.946271 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-797d46f2-9003-40db-a4bf-2c8ff56ee3e5 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:29.950984 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-797d46f2-9003-40db-a4bf-2c8ff56ee3e5 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:29.951750 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-797d46f2-9003-40db-a4bf-2c8ff56ee3e5 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:29.953920 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-797d46f2-9003-40db-a4bf-2c8ff56ee3e5 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:29.991427 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-797d46f2-9003-40db-a4bf-2c8ff56ee3e5 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] HTTP exception thrown: Instance 17bdf735-2944-4b40-984c-4646caa855f0 could not be found. Oct 27 03:42:29.993011 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-797d46f2-9003-40db-a4bf-2c8ff56ee3e5 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Request method failure captured: Oct 27 03:42:29.993011 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/17bdf735-2944-4b40-984c-4646caa855f0 HTTP/1.1 Oct 27 03:42:29.993011 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:42:29.993011 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:42:29.993011 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:42:29.993011 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:42:29.993011 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:42:29.993011 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:42:29.993011 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:42:29.993011 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:42:29.993011 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfz83jPBQR-IO_RgpXfqqqN_tSIl3Aju213bQLpPTkR-R_lkTGSpHz1Evy7Lbg7I5hWxU9AxviJyxNS0i-wRdj1_O4LyvZEjE6jerjzwB22Vu4S-ThF8W8FJgumwczGUcQup-Bjpiay7kN0UoT8q0uFoQytE3MKt1MX9CDbsUgcc03A Oct 27 03:42:29.993011 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:42:29.993011 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:42:29.993011 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:42:29.993011 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:42:29.993011 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:42:29.993011 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:42:29.993011 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 911997e881754ce390af17919f29b4ab Oct 27 03:42:29.993011 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-DeleteServersTestJSON-858473437 Oct 27 03:42:29.993011 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:42:29.993011 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:42:29.993011 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/911997e881754ce390af17919f29b4ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/911997e881754ce390af17919f29b4ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/911997e881754ce390af17919f29b4ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_911997e881754ce390af17919f29b4ab"}]}] Oct 27 03:42:29.993011 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-DeleteServersTestJSON-858473437 Oct 27 03:42:29.993011 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 911997e881754ce390af17919f29b4ab Oct 27 03:42:29.993011 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-DeleteServersTestJSON-858473437 Oct 27 03:42:29.993011 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-DeleteServersTestJSON-858473437-project Oct 27 03:42:29.993011 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:42:29.993011 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:42:29.993011 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: b1cc79af058b4c35b3c572448fac86a7 Oct 27 03:42:29.993011 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-DeleteServersTestJSON-858473437-project Oct 27 03:42:29.993011 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:42:29.993011 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 17bdf735-2944-4b40-984c-4646caa855f0 could not be found. Oct 27 03:42:29.993011 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '17bdf735-2944-4b40-984c-4646caa855f0'} Oct 27 03:42:29.993011 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:42:29.993011 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:29.993011 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:42:29.993011 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:42:29.993011 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:42:29.993011 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:42:29.993011 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:42:29.993011 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:42:29.993011 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:42:29.993011 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:42:29.993011 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17bdf735-2944-4b40-984c-4646caa855f0 could not be found. Oct 27 03:42:29.993011 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:42:29.993011 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:42:29.993011 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:42:29.993011 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:29.993011 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:42:29.993011 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:42:29.993011 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:42:29.993011 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:42:29.993011 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:42:29.993011 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:42:29.993011 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:42:29.993011 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:42:29.993011 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:42:29.993011 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:42:29.993011 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:42:29.993011 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:42:29.993011 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17bdf735-2944-4b40-984c-4646caa855f0 could not be found. Oct 27 03:42:29.993011 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:42:29.993011 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:42:29.993011 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:42:29.997302 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:29.997302 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:42:29.997302 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:42:29.997302 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:42:29.997302 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:42:29.997302 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17bdf735-2944-4b40-984c-4646caa855f0 could not be found. Oct 27 03:42:29.997302 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:42:29.997302 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-797d46f2-9003-40db-a4bf-2c8ff56ee3e5 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] Returning 404 to user: Instance 17bdf735-2944-4b40-984c-4646caa855f0 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:42:29.997302 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-797d46f2-9003-40db-a4bf-2c8ff56ee3e5 tempest-DeleteServersTestJSON-858473437 tempest-DeleteServersTestJSON-858473437-project] 10.222.0.20 "GET /compute/v2.1/servers/17bdf735-2944-4b40-984c-4646caa855f0" status: 404 len: 111 microversion: 2.1 time: 0.108046 Oct 27 03:42:30.002495 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2395/5077] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:29 2022] GET /compute/v2.1/servers/17bdf735-2944-4b40-984c-4646caa855f0 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 03:42:30.196277 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b36fca06-2363-4522-bfe6-0e65744e9af8 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82daefe001364499b2ee9eb7da2599be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:30.236279 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b36fca06-2363-4522-bfe6-0e65744e9af8 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] 10.222.0.20 "GET /compute/v2.1/servers/20bed685-d855-499c-90d6-f8c59cfbd701" status: 200 len: 1522 microversion: 2.1 time: 0.381990 Oct 27 03:42:30.238860 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2683/5078] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:29 2022] GET /compute/v2.1/servers/20bed685-d855-499c-90d6-f8c59cfbd701 => generated 1522 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:30.432797 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-91a41a76-cd99-4f2a-b94c-b7640cae1c00 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:30.433966 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-91a41a76-cd99-4f2a-b94c-b7640cae1c00 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: c9e02344-a91a-40c8-b8c0-c0abe503204c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:30.441745 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-91a41a76-cd99-4f2a-b94c-b7640cae1c00 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:30.447282 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-91a41a76-cd99-4f2a-b94c-b7640cae1c00 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:30.447282 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-91a41a76-cd99-4f2a-b94c-b7640cae1c00 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:30.447282 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-91a41a76-cd99-4f2a-b94c-b7640cae1c00 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:30.450749 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0e8a8562-e5e9-4347-b608-ce49f463e2ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-1994298068 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1994298068-project-admin] Calling method '.version_select at 0x7f7dd9d59e50>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:30.450980 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-91a41a76-cd99-4f2a-b94c-b7640cae1c00 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:30.451864 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-91a41a76-cd99-4f2a-b94c-b7640cae1c00 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:30.452601 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0e8a8562-e5e9-4347-b608-ce49f463e2ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-1994298068 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1994298068-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:30.453101 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0e8a8562-e5e9-4347-b608-ce49f463e2ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-1994298068 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1994298068-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:30.453549 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0e8a8562-e5e9-4347-b608-ce49f463e2ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-1994298068 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1994298068-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:30.483046 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0e8a8562-e5e9-4347-b608-ce49f463e2ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-1994298068 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1994298068-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:30.483046 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0e8a8562-e5e9-4347-b608-ce49f463e2ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-1994298068 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1994298068-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:30.483046 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0e8a8562-e5e9-4347-b608-ce49f463e2ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-1994298068 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1994298068-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:30.503441 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0e8a8562-e5e9-4347-b608-ce49f463e2ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-1994298068 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1994298068-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:30.503942 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0e8a8562-e5e9-4347-b608-ce49f463e2ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-1994298068 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1994298068-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:30.505014 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0e8a8562-e5e9-4347-b608-ce49f463e2ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-1994298068 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1994298068-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:30.512757 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0e8a8562-e5e9-4347-b608-ce49f463e2ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-1994298068 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1994298068-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.303426 Oct 27 03:42:30.520394 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2396/5079] 10.222.0.20 () {58 vars in 1146 bytes} [Thu Oct 27 03:42:30 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:42:30.996141 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-91a41a76-cd99-4f2a-b94c-b7640cae1c00 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:31.000256 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:42:31.009049 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-91a41a76-cd99-4f2a-b94c-b7640cae1c00 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c" status: 200 len: 1521 microversion: 2.1 time: 0.580494 Oct 27 03:42:31.009049 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2684/5080] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:30 2022] GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c => generated 1521 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:42:31.269275 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-83a04b78-dcf0-4a56-bb23-4e4641dcdc23 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:31.270727 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-83a04b78-dcf0-4a56-bb23-4e4641dcdc23 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] [instance: 20bed685-d855-499c-90d6-f8c59cfbd701] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:31.279611 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-83a04b78-dcf0-4a56-bb23-4e4641dcdc23 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:31.282003 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-83a04b78-dcf0-4a56-bb23-4e4641dcdc23 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:31.284102 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-83a04b78-dcf0-4a56-bb23-4e4641dcdc23 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:31.288054 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-83a04b78-dcf0-4a56-bb23-4e4641dcdc23 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:31.288054 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-83a04b78-dcf0-4a56-bb23-4e4641dcdc23 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:31.288054 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-83a04b78-dcf0-4a56-bb23-4e4641dcdc23 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:31.606821 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-83a04b78-dcf0-4a56-bb23-4e4641dcdc23 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82daefe001364499b2ee9eb7da2599be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:31.610739 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=100 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:42:31.617184 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-83a04b78-dcf0-4a56-bb23-4e4641dcdc23 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] 10.222.0.20 "GET /compute/v2.1/servers/20bed685-d855-499c-90d6-f8c59cfbd701" status: 200 len: 1522 microversion: 2.1 time: 0.355299 Oct 27 03:42:31.618674 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2397/5081] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:31 2022] GET /compute/v2.1/servers/20bed685-d855-499c-90d6-f8c59cfbd701 => generated 1522 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:32.033264 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-695996a0-aad7-4ca3-a216-75229617f7e0 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:32.034133 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-695996a0-aad7-4ca3-a216-75229617f7e0 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: c9e02344-a91a-40c8-b8c0-c0abe503204c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:32.043124 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-695996a0-aad7-4ca3-a216-75229617f7e0 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:32.044490 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-695996a0-aad7-4ca3-a216-75229617f7e0 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:32.045266 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-695996a0-aad7-4ca3-a216-75229617f7e0 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:32.046254 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-695996a0-aad7-4ca3-a216-75229617f7e0 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:32.046926 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-695996a0-aad7-4ca3-a216-75229617f7e0 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:32.047537 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-695996a0-aad7-4ca3-a216-75229617f7e0 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:32.186601 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d3477a67-ee0f-41fe-95b3-c6d85fa0d92b tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-652588174", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0b028178-0415-4e42-8380-95bb745375a2"}], "security_groups": [{"name": "tempest-securitygroup--1679587173"}], "key_name": "tempest-keypair-954509478", "user_data": "}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:42:32.255185 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-695996a0-aad7-4ca3-a216-75229617f7e0 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:32.266732 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-695996a0-aad7-4ca3-a216-75229617f7e0 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c" status: 200 len: 1521 microversion: 2.1 time: 0.239240 Oct 27 03:42:32.267733 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2685/5082] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:32 2022] GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c => generated 1521 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:32.515915 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-d3477a67-ee0f-41fe-95b3-c6d85fa0d92b tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] validate_networks() for [('0b028178-0415-4e42-8380-95bb745375a2', None, None, None, None, None)] {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:42:32.643254 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-68ad26fc-9ab0-48d1-9418-bb8cf4ad301c tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:32.644172 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-68ad26fc-9ab0-48d1-9418-bb8cf4ad301c tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] [instance: 20bed685-d855-499c-90d6-f8c59cfbd701] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:32.652311 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-68ad26fc-9ab0-48d1-9418-bb8cf4ad301c tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:32.652816 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-68ad26fc-9ab0-48d1-9418-bb8cf4ad301c tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:32.653264 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-68ad26fc-9ab0-48d1-9418-bb8cf4ad301c tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:32.654380 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-68ad26fc-9ab0-48d1-9418-bb8cf4ad301c tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:32.654843 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-68ad26fc-9ab0-48d1-9418-bb8cf4ad301c tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:32.655274 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-68ad26fc-9ab0-48d1-9418-bb8cf4ad301c tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:32.832669 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-68ad26fc-9ab0-48d1-9418-bb8cf4ad301c tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82daefe001364499b2ee9eb7da2599be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:32.842884 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-68ad26fc-9ab0-48d1-9418-bb8cf4ad301c tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] 10.222.0.20 "GET /compute/v2.1/servers/20bed685-d855-499c-90d6-f8c59cfbd701" status: 200 len: 1522 microversion: 2.1 time: 0.204226 Oct 27 03:42:32.859574 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2686/5083] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:32 2022] GET /compute/v2.1/servers/20bed685-d855-499c-90d6-f8c59cfbd701 => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:42:33.053979 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9edb9b88-9dea-43f2-9090-f806ae65dec7 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:33.055601 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-9edb9b88-9dea-43f2-9090-f806ae65dec7 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: 611195a7-9a81-43eb-9d7d-6c29d80f5933] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:33.063823 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9edb9b88-9dea-43f2-9090-f806ae65dec7 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:33.077462 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9edb9b88-9dea-43f2-9090-f806ae65dec7 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:33.077462 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9edb9b88-9dea-43f2-9090-f806ae65dec7 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:33.077462 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9edb9b88-9dea-43f2-9090-f806ae65dec7 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:33.077462 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9edb9b88-9dea-43f2-9090-f806ae65dec7 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:33.077462 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9edb9b88-9dea-43f2-9090-f806ae65dec7 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:33.084537 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-9edb9b88-9dea-43f2-9090-f806ae65dec7 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] HTTP exception thrown: Instance 611195a7-9a81-43eb-9d7d-6c29d80f5933 could not be found. Oct 27 03:42:33.087125 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9edb9b88-9dea-43f2-9090-f806ae65dec7 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Request method failure captured: Oct 27 03:42:33.087125 n-d-862769-1 devstack@n-api.service[121001]: request: DELETE /compute/v2.1/servers/611195a7-9a81-43eb-9d7d-6c29d80f5933 HTTP/1.1 Oct 27 03:42:33.087125 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:42:33.087125 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:42:33.087125 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:42:33.087125 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:42:33.087125 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:42:33.087125 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:42:33.087125 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:42:33.087125 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:42:33.087125 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfyO20A1D6ympGjQc2k7pGwXBVoOs4AtFX551niq39NWe_HjifvxGvre6cHeeNp8osa7J1PNEE0_yy7-MG05YNEONXkGtR3-F0Zb6-60FxqOiIpeJ5N_dbXBRWjEl88UsCCW068A90fytHXWgtrGlYksZomXGQlrDugSxyxjlY4_NPY Oct 27 03:42:33.087125 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:42:33.087125 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:42:33.087125 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:42:33.087125 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:42:33.087125 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:42:33.087125 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:42:33.087125 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 229dcb63bc41444391544883b576ce2e Oct 27 03:42:33.087125 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-AttachVolumeNegativeTest-199004901 Oct 27 03:42:33.087125 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:42:33.087125 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:42:33.087125 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/229dcb63bc41444391544883b576ce2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/229dcb63bc41444391544883b576ce2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/229dcb63bc41444391544883b576ce2e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_229dcb63bc41444391544883b576ce2e"}]}] Oct 27 03:42:33.087125 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-AttachVolumeNegativeTest-199004901 Oct 27 03:42:33.087125 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 229dcb63bc41444391544883b576ce2e Oct 27 03:42:33.087125 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-199004901 Oct 27 03:42:33.087125 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-AttachVolumeNegativeTest-199004901-project Oct 27 03:42:33.087125 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:42:33.087125 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:42:33.087125 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 18036411a99e4634bfbaeae24b9f254d Oct 27 03:42:33.087125 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-AttachVolumeNegativeTest-199004901-project Oct 27 03:42:33.087125 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:42:33.087125 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 611195a7-9a81-43eb-9d7d-6c29d80f5933 could not be found. Oct 27 03:42:33.087125 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '611195a7-9a81-43eb-9d7d-6c29d80f5933'} Oct 27 03:42:33.087125 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:42:33.087125 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:33.087125 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:42:33.087125 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:42:33.087125 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:42:33.087125 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:42:33.087125 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:42:33.087125 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:42:33.087125 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:42:33.087125 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:42:33.087125 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 611195a7-9a81-43eb-9d7d-6c29d80f5933 could not be found. Oct 27 03:42:33.087125 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:42:33.087125 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:42:33.087125 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:42:33.087125 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:33.087125 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:42:33.087125 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:42:33.087125 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:42:33.087125 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:42:33.087125 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:42:33.087125 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:42:33.087125 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 03:42:33.087125 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 03:42:33.087125 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 03:42:33.087125 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 03:42:33.087125 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:42:33.087125 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:42:33.087125 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:42:33.087125 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:42:33.091024 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 611195a7-9a81-43eb-9d7d-6c29d80f5933 could not be found. Oct 27 03:42:33.091024 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:42:33.091024 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:42:33.091024 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:42:33.091024 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:33.091024 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:42:33.091024 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:42:33.091024 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:42:33.091024 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:42:33.091024 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 611195a7-9a81-43eb-9d7d-6c29d80f5933 could not be found. Oct 27 03:42:33.091024 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:42:33.093315 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9edb9b88-9dea-43f2-9090-f806ae65dec7 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Returning 404 to user: Instance 611195a7-9a81-43eb-9d7d-6c29d80f5933 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:42:33.094247 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9edb9b88-9dea-43f2-9090-f806ae65dec7 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "DELETE /compute/v2.1/servers/611195a7-9a81-43eb-9d7d-6c29d80f5933" status: 404 len: 111 microversion: 2.1 time: 0.044216 Oct 27 03:42:33.095180 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2687/5084] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:42:33 2022] DELETE /compute/v2.1/servers/611195a7-9a81-43eb-9d7d-6c29d80f5933 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 03:42:33.108708 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6237212f-37da-4901-9ccd-53ae880dfa79 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:33.109606 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-6237212f-37da-4901-9ccd-53ae880dfa79 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: 611195a7-9a81-43eb-9d7d-6c29d80f5933] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:33.117628 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6237212f-37da-4901-9ccd-53ae880dfa79 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:33.119034 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6237212f-37da-4901-9ccd-53ae880dfa79 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:33.119639 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6237212f-37da-4901-9ccd-53ae880dfa79 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:33.120750 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6237212f-37da-4901-9ccd-53ae880dfa79 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:33.122133 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6237212f-37da-4901-9ccd-53ae880dfa79 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:33.122732 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6237212f-37da-4901-9ccd-53ae880dfa79 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:33.138542 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-6237212f-37da-4901-9ccd-53ae880dfa79 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] HTTP exception thrown: Instance 611195a7-9a81-43eb-9d7d-6c29d80f5933 could not be found. Oct 27 03:42:33.140500 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6237212f-37da-4901-9ccd-53ae880dfa79 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Request method failure captured: Oct 27 03:42:33.140500 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/611195a7-9a81-43eb-9d7d-6c29d80f5933 HTTP/1.1 Oct 27 03:42:33.140500 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:42:33.140500 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:42:33.140500 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:42:33.140500 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:42:33.140500 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:42:33.140500 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:42:33.140500 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:42:33.140500 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:42:33.140500 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfyO20A1D6ympGjQc2k7pGwXBVoOs4AtFX551niq39NWe_HjifvxGvre6cHeeNp8osa7J1PNEE0_yy7-MG05YNEONXkGtR3-F0Zb6-60FxqOiIpeJ5N_dbXBRWjEl88UsCCW068A90fytHXWgtrGlYksZomXGQlrDugSxyxjlY4_NPY Oct 27 03:42:33.140500 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:42:33.140500 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:42:33.140500 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:42:33.140500 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:42:33.140500 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:42:33.140500 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:42:33.140500 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 229dcb63bc41444391544883b576ce2e Oct 27 03:42:33.140500 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-AttachVolumeNegativeTest-199004901 Oct 27 03:42:33.140500 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:42:33.140500 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:42:33.140500 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/229dcb63bc41444391544883b576ce2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/229dcb63bc41444391544883b576ce2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/229dcb63bc41444391544883b576ce2e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_229dcb63bc41444391544883b576ce2e"}]}] Oct 27 03:42:33.140500 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-AttachVolumeNegativeTest-199004901 Oct 27 03:42:33.140500 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 229dcb63bc41444391544883b576ce2e Oct 27 03:42:33.140500 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-199004901 Oct 27 03:42:33.140500 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-AttachVolumeNegativeTest-199004901-project Oct 27 03:42:33.140500 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:42:33.140500 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:42:33.140500 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 18036411a99e4634bfbaeae24b9f254d Oct 27 03:42:33.140500 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-AttachVolumeNegativeTest-199004901-project Oct 27 03:42:33.140500 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:42:33.140500 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 611195a7-9a81-43eb-9d7d-6c29d80f5933 could not be found. Oct 27 03:42:33.140500 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '611195a7-9a81-43eb-9d7d-6c29d80f5933'} Oct 27 03:42:33.140500 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:42:33.140500 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:33.140500 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:42:33.140500 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:42:33.140500 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:42:33.140500 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:42:33.140500 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:42:33.140500 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:42:33.140500 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:42:33.140500 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:42:33.140500 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 611195a7-9a81-43eb-9d7d-6c29d80f5933 could not be found. Oct 27 03:42:33.140500 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:42:33.140500 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:42:33.140500 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:42:33.140500 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:33.140500 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:42:33.140500 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:42:33.140500 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:42:33.140500 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:42:33.140500 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:42:33.140500 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:42:33.140500 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:42:33.140500 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:42:33.140500 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:42:33.140500 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:42:33.140500 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:42:33.140500 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:42:33.140500 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 611195a7-9a81-43eb-9d7d-6c29d80f5933 could not be found. Oct 27 03:42:33.140500 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:42:33.140500 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:42:33.140500 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:42:33.145190 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:33.145190 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:42:33.145190 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:42:33.145190 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:42:33.145190 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:42:33.145190 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 611195a7-9a81-43eb-9d7d-6c29d80f5933 could not be found. Oct 27 03:42:33.145190 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:42:33.146724 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6237212f-37da-4901-9ccd-53ae880dfa79 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Returning 404 to user: Instance 611195a7-9a81-43eb-9d7d-6c29d80f5933 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:42:33.147808 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6237212f-37da-4901-9ccd-53ae880dfa79 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/611195a7-9a81-43eb-9d7d-6c29d80f5933" status: 404 len: 111 microversion: 2.1 time: 0.048793 Oct 27 03:42:33.148911 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2688/5085] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:33 2022] GET /compute/v2.1/servers/611195a7-9a81-43eb-9d7d-6c29d80f5933 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:42:33.159737 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f1784ab4-7466-403d-b708-fc53dee5fa9a tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:33.160339 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f1784ab4-7466-403d-b708-fc53dee5fa9a tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: d963bc87-b838-431c-92c3-8f06dd7afba7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:33.167149 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f1784ab4-7466-403d-b708-fc53dee5fa9a tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:33.167982 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f1784ab4-7466-403d-b708-fc53dee5fa9a tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:33.168985 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f1784ab4-7466-403d-b708-fc53dee5fa9a tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:33.170588 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f1784ab4-7466-403d-b708-fc53dee5fa9a tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:33.170588 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f1784ab4-7466-403d-b708-fc53dee5fa9a tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:33.171184 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f1784ab4-7466-403d-b708-fc53dee5fa9a tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:33.211878 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-f1784ab4-7466-403d-b708-fc53dee5fa9a tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] HTTP exception thrown: Instance d963bc87-b838-431c-92c3-8f06dd7afba7 could not be found. Oct 27 03:42:33.214315 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f1784ab4-7466-403d-b708-fc53dee5fa9a tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Request method failure captured: Oct 27 03:42:33.214315 n-d-862769-1 devstack@n-api.service[121001]: request: DELETE /compute/v2.1/servers/d963bc87-b838-431c-92c3-8f06dd7afba7 HTTP/1.1 Oct 27 03:42:33.214315 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:42:33.214315 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:42:33.214315 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:42:33.214315 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:42:33.214315 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:42:33.214315 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:42:33.214315 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:42:33.214315 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:42:33.214315 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfyO20A1D6ympGjQc2k7pGwXBVoOs4AtFX551niq39NWe_HjifvxGvre6cHeeNp8osa7J1PNEE0_yy7-MG05YNEONXkGtR3-F0Zb6-60FxqOiIpeJ5N_dbXBRWjEl88UsCCW068A90fytHXWgtrGlYksZomXGQlrDugSxyxjlY4_NPY Oct 27 03:42:33.214315 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:42:33.214315 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:42:33.214315 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:42:33.214315 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:42:33.214315 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:42:33.214315 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:42:33.214315 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 229dcb63bc41444391544883b576ce2e Oct 27 03:42:33.214315 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-AttachVolumeNegativeTest-199004901 Oct 27 03:42:33.214315 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:42:33.214315 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:42:33.214315 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/229dcb63bc41444391544883b576ce2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/229dcb63bc41444391544883b576ce2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/229dcb63bc41444391544883b576ce2e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_229dcb63bc41444391544883b576ce2e"}]}] Oct 27 03:42:33.214315 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-AttachVolumeNegativeTest-199004901 Oct 27 03:42:33.214315 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 229dcb63bc41444391544883b576ce2e Oct 27 03:42:33.214315 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-199004901 Oct 27 03:42:33.214315 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-AttachVolumeNegativeTest-199004901-project Oct 27 03:42:33.214315 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:42:33.214315 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:42:33.214315 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 18036411a99e4634bfbaeae24b9f254d Oct 27 03:42:33.214315 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-AttachVolumeNegativeTest-199004901-project Oct 27 03:42:33.214315 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:42:33.214315 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance d963bc87-b838-431c-92c3-8f06dd7afba7 could not be found. Oct 27 03:42:33.214315 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': 'd963bc87-b838-431c-92c3-8f06dd7afba7'} Oct 27 03:42:33.214315 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:42:33.214315 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:33.214315 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:42:33.214315 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:42:33.214315 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:42:33.214315 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:42:33.214315 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:42:33.214315 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:42:33.214315 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:42:33.214315 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:42:33.214315 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d963bc87-b838-431c-92c3-8f06dd7afba7 could not be found. Oct 27 03:42:33.214315 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:42:33.214315 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:42:33.214315 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:42:33.214315 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:33.214315 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:42:33.214315 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:42:33.214315 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:42:33.214315 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:42:33.214315 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:42:33.214315 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:42:33.214315 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 03:42:33.214315 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 03:42:33.214315 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 03:42:33.214315 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 03:42:33.214315 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:42:33.214315 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:42:33.214315 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:42:33.214315 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:42:33.226415 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d963bc87-b838-431c-92c3-8f06dd7afba7 could not be found. Oct 27 03:42:33.226415 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:42:33.226415 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:42:33.226415 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:42:33.226415 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:33.226415 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:42:33.226415 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:42:33.226415 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:42:33.226415 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:42:33.226415 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d963bc87-b838-431c-92c3-8f06dd7afba7 could not be found. Oct 27 03:42:33.226415 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:42:33.226415 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f1784ab4-7466-403d-b708-fc53dee5fa9a tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Returning 404 to user: Instance d963bc87-b838-431c-92c3-8f06dd7afba7 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:42:33.226415 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f1784ab4-7466-403d-b708-fc53dee5fa9a tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d963bc87-b838-431c-92c3-8f06dd7afba7" status: 404 len: 111 microversion: 2.1 time: 0.060437 Oct 27 03:42:33.226415 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2689/5086] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:42:33 2022] DELETE /compute/v2.1/servers/d963bc87-b838-431c-92c3-8f06dd7afba7 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:42:33.231669 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d126b845-abd1-4d3c-ba95-6afec54e2741 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:33.232305 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d126b845-abd1-4d3c-ba95-6afec54e2741 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: d963bc87-b838-431c-92c3-8f06dd7afba7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:33.239124 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d126b845-abd1-4d3c-ba95-6afec54e2741 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:33.239929 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d126b845-abd1-4d3c-ba95-6afec54e2741 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:33.240567 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d126b845-abd1-4d3c-ba95-6afec54e2741 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:33.242118 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d126b845-abd1-4d3c-ba95-6afec54e2741 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:33.242772 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d126b845-abd1-4d3c-ba95-6afec54e2741 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:33.243514 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d126b845-abd1-4d3c-ba95-6afec54e2741 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:33.261674 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-d126b845-abd1-4d3c-ba95-6afec54e2741 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] HTTP exception thrown: Instance d963bc87-b838-431c-92c3-8f06dd7afba7 could not be found. Oct 27 03:42:33.265893 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d126b845-abd1-4d3c-ba95-6afec54e2741 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Request method failure captured: Oct 27 03:42:33.265893 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/d963bc87-b838-431c-92c3-8f06dd7afba7 HTTP/1.1 Oct 27 03:42:33.265893 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:42:33.265893 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:42:33.265893 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:42:33.265893 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:42:33.265893 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:42:33.265893 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:42:33.265893 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:42:33.265893 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:42:33.265893 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfyO20A1D6ympGjQc2k7pGwXBVoOs4AtFX551niq39NWe_HjifvxGvre6cHeeNp8osa7J1PNEE0_yy7-MG05YNEONXkGtR3-F0Zb6-60FxqOiIpeJ5N_dbXBRWjEl88UsCCW068A90fytHXWgtrGlYksZomXGQlrDugSxyxjlY4_NPY Oct 27 03:42:33.265893 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:42:33.265893 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:42:33.265893 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:42:33.265893 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:42:33.265893 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:42:33.265893 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:42:33.265893 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 229dcb63bc41444391544883b576ce2e Oct 27 03:42:33.265893 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-AttachVolumeNegativeTest-199004901 Oct 27 03:42:33.265893 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:42:33.265893 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:42:33.265893 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/229dcb63bc41444391544883b576ce2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/229dcb63bc41444391544883b576ce2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/229dcb63bc41444391544883b576ce2e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_229dcb63bc41444391544883b576ce2e"}]}] Oct 27 03:42:33.265893 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-AttachVolumeNegativeTest-199004901 Oct 27 03:42:33.265893 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 229dcb63bc41444391544883b576ce2e Oct 27 03:42:33.265893 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-199004901 Oct 27 03:42:33.265893 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-AttachVolumeNegativeTest-199004901-project Oct 27 03:42:33.265893 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:42:33.265893 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:42:33.265893 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 18036411a99e4634bfbaeae24b9f254d Oct 27 03:42:33.265893 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-AttachVolumeNegativeTest-199004901-project Oct 27 03:42:33.265893 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:42:33.265893 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance d963bc87-b838-431c-92c3-8f06dd7afba7 could not be found. Oct 27 03:42:33.265893 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': 'd963bc87-b838-431c-92c3-8f06dd7afba7'} Oct 27 03:42:33.265893 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:42:33.265893 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:33.265893 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:42:33.265893 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:42:33.265893 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:42:33.265893 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:42:33.265893 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:42:33.265893 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:42:33.265893 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:42:33.265893 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:42:33.265893 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d963bc87-b838-431c-92c3-8f06dd7afba7 could not be found. Oct 27 03:42:33.265893 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:42:33.265893 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:42:33.265893 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:42:33.265893 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:33.265893 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:42:33.265893 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:42:33.265893 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:42:33.265893 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:42:33.265893 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:42:33.265893 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:42:33.265893 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:42:33.265893 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:42:33.265893 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:42:33.265893 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:42:33.265893 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:42:33.265893 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:42:33.265893 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d963bc87-b838-431c-92c3-8f06dd7afba7 could not be found. Oct 27 03:42:33.265893 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:42:33.265893 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:42:33.265893 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:42:33.272019 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:33.272019 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:42:33.272019 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:42:33.272019 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:42:33.272019 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:42:33.272019 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d963bc87-b838-431c-92c3-8f06dd7afba7 could not be found. Oct 27 03:42:33.272019 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:42:33.272019 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d126b845-abd1-4d3c-ba95-6afec54e2741 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Returning 404 to user: Instance d963bc87-b838-431c-92c3-8f06dd7afba7 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:42:33.272019 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d126b845-abd1-4d3c-ba95-6afec54e2741 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/d963bc87-b838-431c-92c3-8f06dd7afba7" status: 404 len: 111 microversion: 2.1 time: 0.040085 Oct 27 03:42:33.274644 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2690/5087] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:33 2022] GET /compute/v2.1/servers/d963bc87-b838-431c-92c3-8f06dd7afba7 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:42:33.295502 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2c927121-aabc-40c1-94e2-649f29366875 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:33.300629 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2c927121-aabc-40c1-94e2-649f29366875 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: c9e02344-a91a-40c8-b8c0-c0abe503204c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:33.318459 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2c927121-aabc-40c1-94e2-649f29366875 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:33.320702 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2c927121-aabc-40c1-94e2-649f29366875 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:33.321165 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2c927121-aabc-40c1-94e2-649f29366875 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:33.321901 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2c927121-aabc-40c1-94e2-649f29366875 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:33.326173 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2c927121-aabc-40c1-94e2-649f29366875 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:33.326648 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2c927121-aabc-40c1-94e2-649f29366875 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:33.437043 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-d3477a67-ee0f-41fe-95b3-c6d85fa0d92b tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:42:33.439793 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-d3477a67-ee0f-41fe-95b3-c6d85fa0d92b tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:42:33.440599 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-d3477a67-ee0f-41fe-95b3-c6d85fa0d92b tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:42:33.441450 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-d3477a67-ee0f-41fe-95b3-c6d85fa0d92b tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:42:33.442584 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-d3477a67-ee0f-41fe-95b3-c6d85fa0d92b tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:42:33.464717 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d3477a67-ee0f-41fe-95b3-c6d85fa0d92b tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:33.464717 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d3477a67-ee0f-41fe-95b3-c6d85fa0d92b tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:33.464962 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d3477a67-ee0f-41fe-95b3-c6d85fa0d92b tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:33.465981 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d3477a67-ee0f-41fe-95b3-c6d85fa0d92b tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:33.468424 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d3477a67-ee0f-41fe-95b3-c6d85fa0d92b tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:33.469095 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d3477a67-ee0f-41fe-95b3-c6d85fa0d92b tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:33.515625 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-d3477a67-ee0f-41fe-95b3-c6d85fa0d92b tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Getting quotas for project 38450368ef5c4e68ac3c19c7a0a1ce65. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:42:33.528618 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-d3477a67-ee0f-41fe-95b3-c6d85fa0d92b tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Getting quotas for user 5ffc2b1c410149e884a47240b5425e57 and project 38450368ef5c4e68ac3c19c7a0a1ce65. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:42:33.562865 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d3477a67-ee0f-41fe-95b3-c6d85fa0d92b tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:42:33.565578 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d3477a67-ee0f-41fe-95b3-c6d85fa0d92b tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: ce85aa86-fbba-4eca-97e8-173da3cdc7c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:42:33.776548 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d3477a67-ee0f-41fe-95b3-c6d85fa0d92b tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.599515 Oct 27 03:42:33.779393 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2398/5088] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:42:32 2022] POST /compute/v2.1/servers => generated 402 bytes in 1603 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 03:42:33.815566 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-179d462a-cfb8-4f10-9155-3dcdbf8f8e27 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:33.820547 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-179d462a-cfb8-4f10-9155-3dcdbf8f8e27 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: ce85aa86-fbba-4eca-97e8-173da3cdc7c3] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:33.959547 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-179d462a-cfb8-4f10-9155-3dcdbf8f8e27 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffc2b1c410149e884a47240b5425e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38450368ef5c4e68ac3c19c7a0a1ce65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:33.973871 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-179d462a-cfb8-4f10-9155-3dcdbf8f8e27 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "GET /compute/v2.1/servers/ce85aa86-fbba-4eca-97e8-173da3cdc7c3" status: 200 len: 1236 microversion: 2.1 time: 0.187100 Oct 27 03:42:33.979176 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2399/5089] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:33 2022] GET /compute/v2.1/servers/ce85aa86-fbba-4eca-97e8-173da3cdc7c3 => generated 1236 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:33.989396 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b7b0fa7b-aecb-4f12-a468-a9c2d479003f tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:33.990205 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b7b0fa7b-aecb-4f12-a468-a9c2d479003f tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] [instance: 20bed685-d855-499c-90d6-f8c59cfbd701] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:34.003613 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b7b0fa7b-aecb-4f12-a468-a9c2d479003f tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:34.007746 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b7b0fa7b-aecb-4f12-a468-a9c2d479003f tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:34.007890 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b7b0fa7b-aecb-4f12-a468-a9c2d479003f tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:34.008826 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b7b0fa7b-aecb-4f12-a468-a9c2d479003f tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:34.009295 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b7b0fa7b-aecb-4f12-a468-a9c2d479003f tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:34.012615 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b7b0fa7b-aecb-4f12-a468-a9c2d479003f tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:34.316115 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2c927121-aabc-40c1-94e2-649f29366875 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:34.329574 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2c927121-aabc-40c1-94e2-649f29366875 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c" status: 200 len: 1521 microversion: 2.1 time: 1.041792 Oct 27 03:42:34.330903 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2691/5090] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:33 2022] GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c => generated 1521 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:34.474669 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b7b0fa7b-aecb-4f12-a468-a9c2d479003f tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82daefe001364499b2ee9eb7da2599be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:34.487873 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b7b0fa7b-aecb-4f12-a468-a9c2d479003f tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] 10.222.0.20 "GET /compute/v2.1/servers/20bed685-d855-499c-90d6-f8c59cfbd701" status: 200 len: 1522 microversion: 2.1 time: 0.505386 Oct 27 03:42:34.489199 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2400/5091] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:33 2022] GET /compute/v2.1/servers/20bed685-d855-499c-90d6-f8c59cfbd701 => generated 1522 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:34.996985 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a5804bab-3afd-465b-9e0d-a206d9319a30 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:34.997887 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a5804bab-3afd-465b-9e0d-a206d9319a30 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: ce85aa86-fbba-4eca-97e8-173da3cdc7c3] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:35.075034 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a5804bab-3afd-465b-9e0d-a206d9319a30 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffc2b1c410149e884a47240b5425e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38450368ef5c4e68ac3c19c7a0a1ce65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:35.083628 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a5804bab-3afd-465b-9e0d-a206d9319a30 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "GET /compute/v2.1/servers/ce85aa86-fbba-4eca-97e8-173da3cdc7c3" status: 200 len: 1236 microversion: 2.1 time: 0.090449 Oct 27 03:42:35.098446 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2692/5092] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:34 2022] GET /compute/v2.1/servers/ce85aa86-fbba-4eca-97e8-173da3cdc7c3 => generated 1236 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:35.353721 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8e4c78d9-db26-4676-bb5f-d77b3f9ec860 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:35.354402 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8e4c78d9-db26-4676-bb5f-d77b3f9ec860 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: c9e02344-a91a-40c8-b8c0-c0abe503204c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:35.369971 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8e4c78d9-db26-4676-bb5f-d77b3f9ec860 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:35.370750 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8e4c78d9-db26-4676-bb5f-d77b3f9ec860 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:35.371363 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8e4c78d9-db26-4676-bb5f-d77b3f9ec860 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:35.373444 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8e4c78d9-db26-4676-bb5f-d77b3f9ec860 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:35.375254 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8e4c78d9-db26-4676-bb5f-d77b3f9ec860 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:35.380413 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8e4c78d9-db26-4676-bb5f-d77b3f9ec860 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:35.521646 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-50f6a4a7-ed1d-4697-a8ac-749443cee042 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:35.527215 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-50f6a4a7-ed1d-4697-a8ac-749443cee042 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] [instance: 20bed685-d855-499c-90d6-f8c59cfbd701] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:35.540677 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8e4c78d9-db26-4676-bb5f-d77b3f9ec860 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:35.545452 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-50f6a4a7-ed1d-4697-a8ac-749443cee042 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:35.550446 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-50f6a4a7-ed1d-4697-a8ac-749443cee042 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:35.550446 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-50f6a4a7-ed1d-4697-a8ac-749443cee042 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:35.550446 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-50f6a4a7-ed1d-4697-a8ac-749443cee042 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:35.550446 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-50f6a4a7-ed1d-4697-a8ac-749443cee042 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:35.550446 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-50f6a4a7-ed1d-4697-a8ac-749443cee042 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:35.556894 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8e4c78d9-db26-4676-bb5f-d77b3f9ec860 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c" status: 200 len: 1521 microversion: 2.1 time: 0.207803 Oct 27 03:42:35.592368 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2401/5093] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:35 2022] GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:35.900096 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-50f6a4a7-ed1d-4697-a8ac-749443cee042 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82daefe001364499b2ee9eb7da2599be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:35.914458 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-50f6a4a7-ed1d-4697-a8ac-749443cee042 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] 10.222.0.20 "GET /compute/v2.1/servers/20bed685-d855-499c-90d6-f8c59cfbd701" status: 200 len: 1522 microversion: 2.1 time: 0.401584 Oct 27 03:42:35.916192 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2693/5094] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:35 2022] GET /compute/v2.1/servers/20bed685-d855-499c-90d6-f8c59cfbd701 => generated 1522 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:36.107686 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3a4e852a-94c7-4224-a2cb-8e66d16cbdd1 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:36.108312 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-3a4e852a-94c7-4224-a2cb-8e66d16cbdd1 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: ce85aa86-fbba-4eca-97e8-173da3cdc7c3] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:36.117900 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3a4e852a-94c7-4224-a2cb-8e66d16cbdd1 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:36.118440 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3a4e852a-94c7-4224-a2cb-8e66d16cbdd1 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:36.118887 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3a4e852a-94c7-4224-a2cb-8e66d16cbdd1 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:36.119607 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3a4e852a-94c7-4224-a2cb-8e66d16cbdd1 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:36.120067 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3a4e852a-94c7-4224-a2cb-8e66d16cbdd1 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:36.124825 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3a4e852a-94c7-4224-a2cb-8e66d16cbdd1 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:36.361636 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-3a4e852a-94c7-4224-a2cb-8e66d16cbdd1 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffc2b1c410149e884a47240b5425e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38450368ef5c4e68ac3c19c7a0a1ce65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:36.371626 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3a4e852a-94c7-4224-a2cb-8e66d16cbdd1 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "GET /compute/v2.1/servers/ce85aa86-fbba-4eca-97e8-173da3cdc7c3" status: 200 len: 1288 microversion: 2.1 time: 0.267777 Oct 27 03:42:36.389044 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2402/5095] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:36 2022] GET /compute/v2.1/servers/ce85aa86-fbba-4eca-97e8-173da3cdc7c3 => generated 1288 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:36.598596 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b3ad2df8-c860-4afc-b2b2-89fd76390cd1 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:36.600300 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b3ad2df8-c860-4afc-b2b2-89fd76390cd1 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: c9e02344-a91a-40c8-b8c0-c0abe503204c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:36.609734 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b3ad2df8-c860-4afc-b2b2-89fd76390cd1 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:36.610517 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b3ad2df8-c860-4afc-b2b2-89fd76390cd1 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:36.611682 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b3ad2df8-c860-4afc-b2b2-89fd76390cd1 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:36.613201 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b3ad2df8-c860-4afc-b2b2-89fd76390cd1 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:36.614175 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b3ad2df8-c860-4afc-b2b2-89fd76390cd1 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:36.615043 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b3ad2df8-c860-4afc-b2b2-89fd76390cd1 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:36.921089 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b3ad2df8-c860-4afc-b2b2-89fd76390cd1 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:36.938219 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-bacb1383-a353-4d5e-bf62-740aece6eb6a tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:36.939419 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-bacb1383-a353-4d5e-bf62-740aece6eb6a tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] [instance: 20bed685-d855-499c-90d6-f8c59cfbd701] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:36.949499 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b3ad2df8-c860-4afc-b2b2-89fd76390cd1 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c" status: 200 len: 1501 microversion: 2.1 time: 0.354077 Oct 27 03:42:36.951530 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bacb1383-a353-4d5e-bf62-740aece6eb6a tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:36.952261 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bacb1383-a353-4d5e-bf62-740aece6eb6a tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:36.952865 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bacb1383-a353-4d5e-bf62-740aece6eb6a tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:36.953757 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bacb1383-a353-4d5e-bf62-740aece6eb6a tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:36.967278 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bacb1383-a353-4d5e-bf62-740aece6eb6a tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:36.968539 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bacb1383-a353-4d5e-bf62-740aece6eb6a tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:36.968877 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2694/5096] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:36 2022] GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c => generated 1501 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:36.983159 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-748ad52b-decb-483d-b917-82bc9f2ad2b1 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:36.984177 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-748ad52b-decb-483d-b917-82bc9f2ad2b1 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: dda902a6-dcad-42bf-9b3c-ed716ea0af70] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:36.993694 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-748ad52b-decb-483d-b917-82bc9f2ad2b1 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:36.994827 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-748ad52b-decb-483d-b917-82bc9f2ad2b1 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:36.995796 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-748ad52b-decb-483d-b917-82bc9f2ad2b1 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:36.996943 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-748ad52b-decb-483d-b917-82bc9f2ad2b1 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:36.997435 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-748ad52b-decb-483d-b917-82bc9f2ad2b1 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:36.998014 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-748ad52b-decb-483d-b917-82bc9f2ad2b1 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:37.197373 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-bacb1383-a353-4d5e-bf62-740aece6eb6a tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82daefe001364499b2ee9eb7da2599be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:37.206701 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-bacb1383-a353-4d5e-bf62-740aece6eb6a tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] 10.222.0.20 "GET /compute/v2.1/servers/20bed685-d855-499c-90d6-f8c59cfbd701" status: 200 len: 1522 microversion: 2.1 time: 0.272944 Oct 27 03:42:37.207470 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2403/5097] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:36 2022] GET /compute/v2.1/servers/20bed685-d855-499c-90d6-f8c59cfbd701 => generated 1522 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:42:37.396915 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-87d82572-23bf-40b3-8aab-90a017db42ae tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:37.400184 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-87d82572-23bf-40b3-8aab-90a017db42ae tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: ce85aa86-fbba-4eca-97e8-173da3cdc7c3] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:37.405146 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-87d82572-23bf-40b3-8aab-90a017db42ae tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:37.405781 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-87d82572-23bf-40b3-8aab-90a017db42ae tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:37.406445 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-87d82572-23bf-40b3-8aab-90a017db42ae tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:37.407266 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-87d82572-23bf-40b3-8aab-90a017db42ae tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:37.407739 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-87d82572-23bf-40b3-8aab-90a017db42ae tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:37.408318 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-87d82572-23bf-40b3-8aab-90a017db42ae tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:37.440541 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-748ad52b-decb-483d-b917-82bc9f2ad2b1 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:37.450827 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-748ad52b-decb-483d-b917-82bc9f2ad2b1 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/dda902a6-dcad-42bf-9b3c-ed716ea0af70" status: 200 len: 1516 microversion: 2.1 time: 0.474069 Oct 27 03:42:37.451490 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2695/5098] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:36 2022] GET /compute/v2.1/servers/dda902a6-dcad-42bf-9b3c-ed716ea0af70 => generated 1516 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:37.483677 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3712ea30-294e-4086-be2a-48522633bd98 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:42:37.490463 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3712ea30-294e-4086-be2a-48522633bd98 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: 60466a2e-b446-4725-a267-64917ed0e00e] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:37.503386 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-3712ea30-294e-4086-be2a-48522633bd98 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] HTTP exception thrown: Instance 60466a2e-b446-4725-a267-64917ed0e00e could not be found. Oct 27 03:42:37.510977 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-87d82572-23bf-40b3-8aab-90a017db42ae tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffc2b1c410149e884a47240b5425e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38450368ef5c4e68ac3c19c7a0a1ce65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:37.511407 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3712ea30-294e-4086-be2a-48522633bd98 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Request method failure captured: Oct 27 03:42:37.511407 n-d-862769-1 devstack@n-api.service[121001]: request: POST /compute/v2.1/servers/60466a2e-b446-4725-a267-64917ed0e00e/action HTTP/1.1 Oct 27 03:42:37.511407 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:42:37.511407 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:42:37.511407 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:42:37.511407 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 14 Oct 27 03:42:37.511407 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:42:37.511407 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:42:37.511407 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:42:37.511407 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:42:37.511407 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWf3uUTnEN6JEj9qTF9cAY0BLnY-YCL30UQa3hBWeUb1dNx6UaDGQTlfRNfawcK1WUPI3AVcIhTKI_7viSsI0VCiS7DswtiywtZ-RbWwufMeio2Ivv3GBrhAaC4UKKUNrtl6wYtdRVU_yfZaWJd2e4jOiCo3IliQOw95nmGOg5mVlF04 Oct 27 03:42:37.511407 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:42:37.511407 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:42:37.511407 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:42:37.511407 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:42:37.511407 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:42:37.511407 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:42:37.511407 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: e1f3ed7ef6c648c9ac771fbaadde1d0c Oct 27 03:42:37.511407 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-143118573 Oct 27 03:42:37.511407 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:42:37.511407 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:42:37.511407 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e1f3ed7ef6c648c9ac771fbaadde1d0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e1f3ed7ef6c648c9ac771fbaadde1d0c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e1f3ed7ef6c648c9ac771fbaadde1d0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e1f3ed7ef6c648c9ac771fbaadde1d0c"}]}] Oct 27 03:42:37.511407 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServerRescueNegativeTestJSON-143118573 Oct 27 03:42:37.511407 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: e1f3ed7ef6c648c9ac771fbaadde1d0c Oct 27 03:42:37.511407 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-143118573 Oct 27 03:42:37.511407 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServerRescueNegativeTestJSON-143118573-project Oct 27 03:42:37.511407 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:42:37.511407 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:42:37.511407 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 43172c9e71704c869a25181574d67b35 Oct 27 03:42:37.511407 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServerRescueNegativeTestJSON-143118573-project Oct 27 03:42:37.511407 n-d-862769-1 devstack@n-api.service[121001]: Oct 27 03:42:37.511407 n-d-862769-1 devstack@n-api.service[121001]: {"rescue": {}} Oct 27 03:42:37.511407 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:42:37.511407 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 60466a2e-b446-4725-a267-64917ed0e00e could not be found. Oct 27 03:42:37.511407 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '60466a2e-b446-4725-a267-64917ed0e00e', 'body': {'rescue': {}}} Oct 27 03:42:37.511407 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:42:37.511407 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:37.511407 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:42:37.511407 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:42:37.511407 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:42:37.511407 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:42:37.511407 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 03:42:37.511407 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 03:42:37.511407 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60466a2e-b446-4725-a267-64917ed0e00e could not be found. Oct 27 03:42:37.511407 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:42:37.511407 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:42:37.511407 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:42:37.511407 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:37.511407 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:42:37.511407 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:42:37.511407 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:42:37.511407 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:42:37.511407 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:42:37.511407 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:42:37.511407 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:42:37.511407 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:42:37.511407 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Oct 27 03:42:37.511407 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 27 03:42:37.511407 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:42:37.511407 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:42:37.511407 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60466a2e-b446-4725-a267-64917ed0e00e could not be found. Oct 27 03:42:37.511407 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:42:37.511407 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:42:37.511407 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:42:37.511407 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:37.515470 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:42:37.515470 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:42:37.515470 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:42:37.515470 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:42:37.515470 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60466a2e-b446-4725-a267-64917ed0e00e could not be found. Oct 27 03:42:37.515470 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:42:37.515470 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3712ea30-294e-4086-be2a-48522633bd98 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Returning 404 to user: Instance 60466a2e-b446-4725-a267-64917ed0e00e could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:42:37.516692 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3712ea30-294e-4086-be2a-48522633bd98 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "POST /compute/v2.1/servers/60466a2e-b446-4725-a267-64917ed0e00e/action" status: 404 len: 111 microversion: 2.1 time: 0.043162 Oct 27 03:42:37.517317 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2696/5099] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:42:37 2022] POST /compute/v2.1/servers/60466a2e-b446-4725-a267-64917ed0e00e/action => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 03:42:37.525045 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-87d82572-23bf-40b3-8aab-90a017db42ae tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "GET /compute/v2.1/servers/ce85aa86-fbba-4eca-97e8-173da3cdc7c3" status: 200 len: 1294 microversion: 2.1 time: 0.132364 Oct 27 03:42:37.528226 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2404/5100] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:37 2022] GET /compute/v2.1/servers/ce85aa86-fbba-4eca-97e8-173da3cdc7c3 => generated 1294 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:42:37.536450 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-cc34f55e-1ecf-4da2-a411-576b9fb1f1a3 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:42:37.537267 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-cc34f55e-1ecf-4da2-a411-576b9fb1f1a3 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: dda902a6-dcad-42bf-9b3c-ed716ea0af70] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:37.546572 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cc34f55e-1ecf-4da2-a411-576b9fb1f1a3 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:37.547337 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cc34f55e-1ecf-4da2-a411-576b9fb1f1a3 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:37.548139 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cc34f55e-1ecf-4da2-a411-576b9fb1f1a3 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:37.549500 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cc34f55e-1ecf-4da2-a411-576b9fb1f1a3 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:37.563884 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cc34f55e-1ecf-4da2-a411-576b9fb1f1a3 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:37.564675 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cc34f55e-1ecf-4da2-a411-576b9fb1f1a3 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:37.889484 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-cc34f55e-1ecf-4da2-a411-576b9fb1f1a3 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "POST /compute/v2.1/servers/dda902a6-dcad-42bf-9b3c-ed716ea0af70/action" status: 202 len: 0 microversion: 2.1 time: 0.362189 Oct 27 03:42:37.890991 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2697/5101] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:42:37 2022] POST /compute/v2.1/servers/dda902a6-dcad-42bf-9b3c-ed716ea0af70/action => generated 0 bytes in 367 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:42:37.899870 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8bb5dff1-d07f-4734-a303-da6c730b0bad tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:37.900498 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8bb5dff1-d07f-4734-a303-da6c730b0bad tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: dda902a6-dcad-42bf-9b3c-ed716ea0af70] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:37.911014 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8bb5dff1-d07f-4734-a303-da6c730b0bad tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:37.913929 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8bb5dff1-d07f-4734-a303-da6c730b0bad tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:37.914438 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8bb5dff1-d07f-4734-a303-da6c730b0bad tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:37.915168 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8bb5dff1-d07f-4734-a303-da6c730b0bad tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:37.915873 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8bb5dff1-d07f-4734-a303-da6c730b0bad tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:37.916311 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8bb5dff1-d07f-4734-a303-da6c730b0bad tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:38.049970 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6010f53b-f87a-4eea-a9a9-6f2af18af863 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:38.051804 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-6010f53b-f87a-4eea-a9a9-6f2af18af863 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: c5c50ae8-6217-4650-8420-291847e21ace] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:38.058610 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6010f53b-f87a-4eea-a9a9-6f2af18af863 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:38.059948 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6010f53b-f87a-4eea-a9a9-6f2af18af863 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:38.060618 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6010f53b-f87a-4eea-a9a9-6f2af18af863 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:38.061741 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6010f53b-f87a-4eea-a9a9-6f2af18af863 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:38.062435 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6010f53b-f87a-4eea-a9a9-6f2af18af863 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:38.063072 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6010f53b-f87a-4eea-a9a9-6f2af18af863 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:38.082080 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-6010f53b-f87a-4eea-a9a9-6f2af18af863 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] HTTP exception thrown: Instance c5c50ae8-6217-4650-8420-291847e21ace could not be found. Oct 27 03:42:38.084361 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6010f53b-f87a-4eea-a9a9-6f2af18af863 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Request method failure captured: Oct 27 03:42:38.084361 n-d-862769-1 devstack@n-api.service[121001]: request: DELETE /compute/v2.1/servers/c5c50ae8-6217-4650-8420-291847e21ace HTTP/1.1 Oct 27 03:42:38.084361 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:42:38.084361 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:42:38.084361 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:42:38.084361 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:42:38.084361 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:42:38.084361 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:42:38.084361 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:42:38.084361 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:42:38.084361 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfyO20A1D6ympGjQc2k7pGwXBVoOs4AtFX551niq39NWe_HjifvxGvre6cHeeNp8osa7J1PNEE0_yy7-MG05YNEONXkGtR3-F0Zb6-60FxqOiIpeJ5N_dbXBRWjEl88UsCCW068A90fytHXWgtrGlYksZomXGQlrDugSxyxjlY4_NPY Oct 27 03:42:38.084361 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:42:38.084361 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:42:38.084361 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:42:38.084361 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:42:38.084361 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:42:38.084361 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:42:38.084361 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 229dcb63bc41444391544883b576ce2e Oct 27 03:42:38.084361 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-AttachVolumeNegativeTest-199004901 Oct 27 03:42:38.084361 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:42:38.084361 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:42:38.084361 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/229dcb63bc41444391544883b576ce2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/229dcb63bc41444391544883b576ce2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/229dcb63bc41444391544883b576ce2e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_229dcb63bc41444391544883b576ce2e"}]}] Oct 27 03:42:38.084361 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-AttachVolumeNegativeTest-199004901 Oct 27 03:42:38.084361 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 229dcb63bc41444391544883b576ce2e Oct 27 03:42:38.084361 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-199004901 Oct 27 03:42:38.084361 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-AttachVolumeNegativeTest-199004901-project Oct 27 03:42:38.084361 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:42:38.084361 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:42:38.084361 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 18036411a99e4634bfbaeae24b9f254d Oct 27 03:42:38.084361 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-AttachVolumeNegativeTest-199004901-project Oct 27 03:42:38.084361 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:42:38.084361 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance c5c50ae8-6217-4650-8420-291847e21ace could not be found. Oct 27 03:42:38.084361 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': 'c5c50ae8-6217-4650-8420-291847e21ace'} Oct 27 03:42:38.084361 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:42:38.084361 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:38.084361 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:42:38.084361 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:42:38.084361 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:42:38.084361 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:42:38.084361 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:42:38.084361 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:42:38.084361 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:42:38.084361 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:42:38.084361 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5c50ae8-6217-4650-8420-291847e21ace could not be found. Oct 27 03:42:38.084361 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:42:38.084361 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:42:38.084361 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:42:38.084361 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:38.084361 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:42:38.084361 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:42:38.084361 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:42:38.084361 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:42:38.084361 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:42:38.084361 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:42:38.084361 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 03:42:38.084361 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 03:42:38.084361 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 03:42:38.084361 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 03:42:38.084361 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:42:38.084361 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:42:38.084361 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:42:38.084361 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:42:38.088713 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5c50ae8-6217-4650-8420-291847e21ace could not be found. Oct 27 03:42:38.088713 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:42:38.088713 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:42:38.088713 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:42:38.088713 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:38.088713 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:42:38.088713 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:42:38.088713 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:42:38.088713 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:42:38.088713 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5c50ae8-6217-4650-8420-291847e21ace could not be found. Oct 27 03:42:38.088713 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:42:38.091623 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6010f53b-f87a-4eea-a9a9-6f2af18af863 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Returning 404 to user: Instance c5c50ae8-6217-4650-8420-291847e21ace could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:42:38.093064 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6010f53b-f87a-4eea-a9a9-6f2af18af863 tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c5c50ae8-6217-4650-8420-291847e21ace" status: 404 len: 111 microversion: 2.1 time: 0.048511 Oct 27 03:42:38.094184 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2698/5102] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:42:38 2022] DELETE /compute/v2.1/servers/c5c50ae8-6217-4650-8420-291847e21ace => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:42:38.100091 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8bb5dff1-d07f-4734-a303-da6c730b0bad tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:38.109792 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8bb5dff1-d07f-4734-a303-da6c730b0bad tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/dda902a6-dcad-42bf-9b3c-ed716ea0af70" status: 200 len: 1521 microversion: 2.1 time: 0.214562 Oct 27 03:42:38.114158 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2405/5103] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:37 2022] GET /compute/v2.1/servers/dda902a6-dcad-42bf-9b3c-ed716ea0af70 => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:38.119144 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3ba2646b-48a5-4022-a8f1-5e3f56439c5c tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:38.121074 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3ba2646b-48a5-4022-a8f1-5e3f56439c5c tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] [instance: c5c50ae8-6217-4650-8420-291847e21ace] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:38.133539 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3ba2646b-48a5-4022-a8f1-5e3f56439c5c tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:38.134758 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3ba2646b-48a5-4022-a8f1-5e3f56439c5c tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:38.135329 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3ba2646b-48a5-4022-a8f1-5e3f56439c5c tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:38.137464 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3ba2646b-48a5-4022-a8f1-5e3f56439c5c tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:38.138312 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3ba2646b-48a5-4022-a8f1-5e3f56439c5c tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:38.139075 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3ba2646b-48a5-4022-a8f1-5e3f56439c5c tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:38.156343 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-3ba2646b-48a5-4022-a8f1-5e3f56439c5c tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] HTTP exception thrown: Instance c5c50ae8-6217-4650-8420-291847e21ace could not be found. Oct 27 03:42:38.158277 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3ba2646b-48a5-4022-a8f1-5e3f56439c5c tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Request method failure captured: Oct 27 03:42:38.158277 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/c5c50ae8-6217-4650-8420-291847e21ace HTTP/1.1 Oct 27 03:42:38.158277 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:42:38.158277 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:42:38.158277 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:42:38.158277 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:42:38.158277 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:42:38.158277 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:42:38.158277 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:42:38.158277 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:42:38.158277 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfyO20A1D6ympGjQc2k7pGwXBVoOs4AtFX551niq39NWe_HjifvxGvre6cHeeNp8osa7J1PNEE0_yy7-MG05YNEONXkGtR3-F0Zb6-60FxqOiIpeJ5N_dbXBRWjEl88UsCCW068A90fytHXWgtrGlYksZomXGQlrDugSxyxjlY4_NPY Oct 27 03:42:38.158277 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:42:38.158277 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:42:38.158277 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:42:38.158277 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:42:38.158277 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:42:38.158277 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:42:38.158277 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 229dcb63bc41444391544883b576ce2e Oct 27 03:42:38.158277 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-AttachVolumeNegativeTest-199004901 Oct 27 03:42:38.158277 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:42:38.158277 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:42:38.158277 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/229dcb63bc41444391544883b576ce2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/229dcb63bc41444391544883b576ce2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/229dcb63bc41444391544883b576ce2e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_229dcb63bc41444391544883b576ce2e"}]}] Oct 27 03:42:38.158277 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-AttachVolumeNegativeTest-199004901 Oct 27 03:42:38.158277 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 229dcb63bc41444391544883b576ce2e Oct 27 03:42:38.158277 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-199004901 Oct 27 03:42:38.158277 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-AttachVolumeNegativeTest-199004901-project Oct 27 03:42:38.158277 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:42:38.158277 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:42:38.158277 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 18036411a99e4634bfbaeae24b9f254d Oct 27 03:42:38.158277 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-AttachVolumeNegativeTest-199004901-project Oct 27 03:42:38.158277 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:42:38.158277 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance c5c50ae8-6217-4650-8420-291847e21ace could not be found. Oct 27 03:42:38.158277 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': 'c5c50ae8-6217-4650-8420-291847e21ace'} Oct 27 03:42:38.158277 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:42:38.158277 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:38.158277 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:42:38.158277 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:42:38.158277 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:42:38.158277 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:42:38.158277 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:42:38.158277 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:42:38.158277 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:42:38.158277 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:42:38.158277 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5c50ae8-6217-4650-8420-291847e21ace could not be found. Oct 27 03:42:38.158277 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:42:38.158277 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:42:38.158277 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:42:38.158277 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:38.158277 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:42:38.158277 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:42:38.158277 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:42:38.158277 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:42:38.158277 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:42:38.158277 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:42:38.158277 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:42:38.158277 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:42:38.158277 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:42:38.158277 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:42:38.158277 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:42:38.158277 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:42:38.158277 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5c50ae8-6217-4650-8420-291847e21ace could not be found. Oct 27 03:42:38.158277 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:42:38.158277 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:42:38.158277 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:42:38.162442 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:38.162442 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:42:38.162442 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:42:38.162442 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:42:38.162442 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:42:38.162442 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5c50ae8-6217-4650-8420-291847e21ace could not be found. Oct 27 03:42:38.162442 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:42:38.162879 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3ba2646b-48a5-4022-a8f1-5e3f56439c5c tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] Returning 404 to user: Instance c5c50ae8-6217-4650-8420-291847e21ace could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:42:38.164668 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3ba2646b-48a5-4022-a8f1-5e3f56439c5c tempest-AttachVolumeNegativeTest-199004901 tempest-AttachVolumeNegativeTest-199004901-project] 10.222.0.20 "GET /compute/v2.1/servers/c5c50ae8-6217-4650-8420-291847e21ace" status: 404 len: 111 microversion: 2.1 time: 0.065823 Oct 27 03:42:38.170124 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2699/5104] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:38 2022] GET /compute/v2.1/servers/c5c50ae8-6217-4650-8420-291847e21ace => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 03:42:38.231141 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-de138d47-c892-4f6a-be43-8ff291575430 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:38.233000 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-de138d47-c892-4f6a-be43-8ff291575430 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] [instance: 20bed685-d855-499c-90d6-f8c59cfbd701] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:38.248261 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-de138d47-c892-4f6a-be43-8ff291575430 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:38.249141 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-de138d47-c892-4f6a-be43-8ff291575430 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:38.249851 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-de138d47-c892-4f6a-be43-8ff291575430 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:38.250810 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-de138d47-c892-4f6a-be43-8ff291575430 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:38.251496 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-de138d47-c892-4f6a-be43-8ff291575430 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:38.252147 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-de138d47-c892-4f6a-be43-8ff291575430 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:38.451320 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-de138d47-c892-4f6a-be43-8ff291575430 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82daefe001364499b2ee9eb7da2599be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:38.464068 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-de138d47-c892-4f6a-be43-8ff291575430 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] 10.222.0.20 "GET /compute/v2.1/servers/20bed685-d855-499c-90d6-f8c59cfbd701" status: 200 len: 1522 microversion: 2.1 time: 0.237996 Oct 27 03:42:38.465280 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2406/5105] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:38 2022] GET /compute/v2.1/servers/20bed685-d855-499c-90d6-f8c59cfbd701 => generated 1522 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:38.552278 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e0810293-cb2b-4087-bd4c-79f557ee4f6a tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:38.552906 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e0810293-cb2b-4087-bd4c-79f557ee4f6a tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: ce85aa86-fbba-4eca-97e8-173da3cdc7c3] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:38.563065 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e0810293-cb2b-4087-bd4c-79f557ee4f6a tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:38.563561 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e0810293-cb2b-4087-bd4c-79f557ee4f6a tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:38.564054 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e0810293-cb2b-4087-bd4c-79f557ee4f6a tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:38.564725 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e0810293-cb2b-4087-bd4c-79f557ee4f6a tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:38.565179 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e0810293-cb2b-4087-bd4c-79f557ee4f6a tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:38.565608 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e0810293-cb2b-4087-bd4c-79f557ee4f6a tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:38.856963 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=10 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:42:38.937862 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e0810293-cb2b-4087-bd4c-79f557ee4f6a tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffc2b1c410149e884a47240b5425e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38450368ef5c4e68ac3c19c7a0a1ce65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:38.949266 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e0810293-cb2b-4087-bd4c-79f557ee4f6a tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "GET /compute/v2.1/servers/ce85aa86-fbba-4eca-97e8-173da3cdc7c3" status: 200 len: 1362 microversion: 2.1 time: 0.402660 Oct 27 03:42:38.955845 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2700/5106] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:38 2022] GET /compute/v2.1/servers/ce85aa86-fbba-4eca-97e8-173da3cdc7c3 => generated 1362 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:39.136130 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-08dcf7bc-c01f-424a-8b9a-e1bdb1cfb2ed tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:39.136746 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-08dcf7bc-c01f-424a-8b9a-e1bdb1cfb2ed tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: dda902a6-dcad-42bf-9b3c-ed716ea0af70] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:39.142953 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-08dcf7bc-c01f-424a-8b9a-e1bdb1cfb2ed tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:39.145934 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-08dcf7bc-c01f-424a-8b9a-e1bdb1cfb2ed tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:39.146443 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-08dcf7bc-c01f-424a-8b9a-e1bdb1cfb2ed tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:39.147262 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-08dcf7bc-c01f-424a-8b9a-e1bdb1cfb2ed tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:39.148237 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-08dcf7bc-c01f-424a-8b9a-e1bdb1cfb2ed tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:39.148676 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-08dcf7bc-c01f-424a-8b9a-e1bdb1cfb2ed tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:39.450847 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-08dcf7bc-c01f-424a-8b9a-e1bdb1cfb2ed tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:39.468305 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-08dcf7bc-c01f-424a-8b9a-e1bdb1cfb2ed tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/dda902a6-dcad-42bf-9b3c-ed716ea0af70" status: 200 len: 1501 microversion: 2.1 time: 0.336312 Oct 27 03:42:39.482171 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2407/5107] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:39 2022] GET /compute/v2.1/servers/dda902a6-dcad-42bf-9b3c-ed716ea0af70 => generated 1501 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:39.489248 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-fe3f025f-c601-482b-a798-bbc80d32b8f3 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:39.490132 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-fe3f025f-c601-482b-a798-bbc80d32b8f3 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] [instance: 20bed685-d855-499c-90d6-f8c59cfbd701] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:39.499254 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fe3f025f-c601-482b-a798-bbc80d32b8f3 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:39.499791 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1ca467f9-6592-48ba-b9ef-0e43a480151d tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:42:39.500019 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fe3f025f-c601-482b-a798-bbc80d32b8f3 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:39.500715 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fe3f025f-c601-482b-a798-bbc80d32b8f3 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:39.501812 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fe3f025f-c601-482b-a798-bbc80d32b8f3 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:39.502540 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fe3f025f-c601-482b-a798-bbc80d32b8f3 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:39.503070 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fe3f025f-c601-482b-a798-bbc80d32b8f3 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:39.509331 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1ca467f9-6592-48ba-b9ef-0e43a480151d tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: dda902a6-dcad-42bf-9b3c-ed716ea0af70] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:39.527350 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1ca467f9-6592-48ba-b9ef-0e43a480151d tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:39.528351 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1ca467f9-6592-48ba-b9ef-0e43a480151d tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:39.528819 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1ca467f9-6592-48ba-b9ef-0e43a480151d tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:39.530266 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1ca467f9-6592-48ba-b9ef-0e43a480151d tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:39.530815 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1ca467f9-6592-48ba-b9ef-0e43a480151d tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:39.531167 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1ca467f9-6592-48ba-b9ef-0e43a480151d tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:39.564013 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-1ca467f9-6592-48ba-b9ef-0e43a480151d tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lazy-loading 'flavor' on Instance uuid dda902a6-dcad-42bf-9b3c-ed716ea0af70 {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:42:39.577665 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-1ca467f9-6592-48ba-b9ef-0e43a480151d tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] HTTP exception thrown: Cannot 'rescue' instance dda902a6-dcad-42bf-9b3c-ed716ea0af70 while it is in vm_state paused Oct 27 03:42:39.579519 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1ca467f9-6592-48ba-b9ef-0e43a480151d tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Request method failure captured: Oct 27 03:42:39.579519 n-d-862769-1 devstack@n-api.service[121000]: request: POST /compute/v2.1/servers/dda902a6-dcad-42bf-9b3c-ed716ea0af70/action HTTP/1.1 Oct 27 03:42:39.579519 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:42:39.579519 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:42:39.579519 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:42:39.579519 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 14 Oct 27 03:42:39.579519 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:42:39.579519 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:42:39.579519 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:42:39.579519 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:42:39.579519 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWf3uUTnEN6JEj9qTF9cAY0BLnY-YCL30UQa3hBWeUb1dNx6UaDGQTlfRNfawcK1WUPI3AVcIhTKI_7viSsI0VCiS7DswtiywtZ-RbWwufMeio2Ivv3GBrhAaC4UKKUNrtl6wYtdRVU_yfZaWJd2e4jOiCo3IliQOw95nmGOg5mVlF04 Oct 27 03:42:39.579519 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:42:39.579519 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:42:39.579519 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:42:39.579519 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:42:39.579519 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:42:39.579519 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:42:39.579519 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: e1f3ed7ef6c648c9ac771fbaadde1d0c Oct 27 03:42:39.579519 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-143118573 Oct 27 03:42:39.579519 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:42:39.579519 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:42:39.579519 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e1f3ed7ef6c648c9ac771fbaadde1d0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e1f3ed7ef6c648c9ac771fbaadde1d0c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e1f3ed7ef6c648c9ac771fbaadde1d0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e1f3ed7ef6c648c9ac771fbaadde1d0c"}]}] Oct 27 03:42:39.579519 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ServerRescueNegativeTestJSON-143118573 Oct 27 03:42:39.579519 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: e1f3ed7ef6c648c9ac771fbaadde1d0c Oct 27 03:42:39.579519 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-143118573 Oct 27 03:42:39.579519 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ServerRescueNegativeTestJSON-143118573-project Oct 27 03:42:39.579519 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:42:39.579519 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:42:39.579519 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 43172c9e71704c869a25181574d67b35 Oct 27 03:42:39.579519 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ServerRescueNegativeTestJSON-143118573-project Oct 27 03:42:39.579519 n-d-862769-1 devstack@n-api.service[121000]: Oct 27 03:42:39.579519 n-d-862769-1 devstack@n-api.service[121000]: {"rescue": {}} Oct 27 03:42:39.579519 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:42:39.579519 n-d-862769-1 devstack@n-api.service[121000]: exception: Cannot 'rescue' instance dda902a6-dcad-42bf-9b3c-ed716ea0af70 while it is in vm_state paused Oct 27 03:42:39.579519 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': 'dda902a6-dcad-42bf-9b3c-ed716ea0af70', 'body': {'rescue': {}}} Oct 27 03:42:39.579519 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:42:39.579519 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:39.579519 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Oct 27 03:42:39.579519 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Oct 27 03:42:39.579519 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 27 03:42:39.579519 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 27 03:42:39.579519 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 03:42:39.579519 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 03:42:39.579519 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 27 03:42:39.579519 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 27 03:42:39.579519 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance dda902a6-dcad-42bf-9b3c-ed716ea0af70 in vm_state paused. Cannot rescue while the instance is in this state. Oct 27 03:42:39.579519 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:42:39.579519 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:42:39.579519 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:42:39.579519 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:39.579519 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:42:39.579519 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:42:39.579519 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:42:39.579519 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:42:39.579519 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:42:39.579519 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:42:39.579519 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:42:39.579519 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:42:39.579519 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Oct 27 03:42:39.579519 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 27 03:42:39.579519 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 27 03:42:39.579519 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 27 03:42:39.579519 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance dda902a6-dcad-42bf-9b3c-ed716ea0af70 while it is in vm_state paused Oct 27 03:42:39.579519 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:42:39.587878 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:42:39.587878 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:42:39.587878 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:39.587878 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:42:39.587878 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:42:39.587878 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:42:39.587878 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:42:39.587878 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance dda902a6-dcad-42bf-9b3c-ed716ea0af70 while it is in vm_state paused Oct 27 03:42:39.587878 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:42:39.587878 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1ca467f9-6592-48ba-b9ef-0e43a480151d tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Returning 409 to user: Cannot 'rescue' instance dda902a6-dcad-42bf-9b3c-ed716ea0af70 while it is in vm_state paused {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:42:39.587878 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1ca467f9-6592-48ba-b9ef-0e43a480151d tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "POST /compute/v2.1/servers/dda902a6-dcad-42bf-9b3c-ed716ea0af70/action" status: 409 len: 144 microversion: 2.1 time: 0.086664 Oct 27 03:42:39.587878 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2408/5108] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:42:39 2022] POST /compute/v2.1/servers/dda902a6-dcad-42bf-9b3c-ed716ea0af70/action => generated 144 bytes in 91 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 27 03:42:39.591003 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f8fd9d28-8e6c-4d3b-96ea-844901ad4f3e tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:42:39.591575 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f8fd9d28-8e6c-4d3b-96ea-844901ad4f3e tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: dda902a6-dcad-42bf-9b3c-ed716ea0af70] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:39.597570 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f8fd9d28-8e6c-4d3b-96ea-844901ad4f3e tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:39.598090 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f8fd9d28-8e6c-4d3b-96ea-844901ad4f3e tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:39.598540 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f8fd9d28-8e6c-4d3b-96ea-844901ad4f3e tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:39.599255 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f8fd9d28-8e6c-4d3b-96ea-844901ad4f3e tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:39.599718 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f8fd9d28-8e6c-4d3b-96ea-844901ad4f3e tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:39.600155 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f8fd9d28-8e6c-4d3b-96ea-844901ad4f3e tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:39.801728 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f8fd9d28-8e6c-4d3b-96ea-844901ad4f3e tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "POST /compute/v2.1/servers/dda902a6-dcad-42bf-9b3c-ed716ea0af70/action" status: 202 len: 0 microversion: 2.1 time: 0.214197 Oct 27 03:42:39.802708 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2409/5109] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:42:39 2022] POST /compute/v2.1/servers/dda902a6-dcad-42bf-9b3c-ed716ea0af70/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:42:39.813118 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d46a0baa-ff28-4950-b3a5-c12d97be0cab tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:39.814700 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d46a0baa-ff28-4950-b3a5-c12d97be0cab tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: dda902a6-dcad-42bf-9b3c-ed716ea0af70] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:39.821749 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d46a0baa-ff28-4950-b3a5-c12d97be0cab tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:39.822611 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d46a0baa-ff28-4950-b3a5-c12d97be0cab tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:39.823130 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d46a0baa-ff28-4950-b3a5-c12d97be0cab tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:39.823930 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d46a0baa-ff28-4950-b3a5-c12d97be0cab tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:39.824630 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d46a0baa-ff28-4950-b3a5-c12d97be0cab tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:39.825305 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d46a0baa-ff28-4950-b3a5-c12d97be0cab tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:39.854964 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-fe3f025f-c601-482b-a798-bbc80d32b8f3 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82daefe001364499b2ee9eb7da2599be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:39.863844 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-fe3f025f-c601-482b-a798-bbc80d32b8f3 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] 10.222.0.20 "GET /compute/v2.1/servers/20bed685-d855-499c-90d6-f8c59cfbd701" status: 200 len: 1522 microversion: 2.1 time: 0.378120 Oct 27 03:42:39.865228 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2701/5110] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:39 2022] GET /compute/v2.1/servers/20bed685-d855-499c-90d6-f8c59cfbd701 => generated 1522 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:39.986260 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-21cd5e1d-3aa6-4aa4-b88f-cadd6e616577 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:39.987902 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-21cd5e1d-3aa6-4aa4-b88f-cadd6e616577 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: ce85aa86-fbba-4eca-97e8-173da3cdc7c3] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:39.996908 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-21cd5e1d-3aa6-4aa4-b88f-cadd6e616577 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:40.000920 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-21cd5e1d-3aa6-4aa4-b88f-cadd6e616577 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:40.000920 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-21cd5e1d-3aa6-4aa4-b88f-cadd6e616577 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:40.000920 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-21cd5e1d-3aa6-4aa4-b88f-cadd6e616577 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:40.000920 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-21cd5e1d-3aa6-4aa4-b88f-cadd6e616577 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:40.000920 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-21cd5e1d-3aa6-4aa4-b88f-cadd6e616577 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:40.512022 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d46a0baa-ff28-4950-b3a5-c12d97be0cab tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:40.521044 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d46a0baa-ff28-4950-b3a5-c12d97be0cab tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/dda902a6-dcad-42bf-9b3c-ed716ea0af70" status: 200 len: 1508 microversion: 2.1 time: 0.712089 Oct 27 03:42:40.521989 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2410/5111] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:39 2022] GET /compute/v2.1/servers/dda902a6-dcad-42bf-9b3c-ed716ea0af70 => generated 1508 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:40.775040 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-21cd5e1d-3aa6-4aa4-b88f-cadd6e616577 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffc2b1c410149e884a47240b5425e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38450368ef5c4e68ac3c19c7a0a1ce65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:40.790817 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-21cd5e1d-3aa6-4aa4-b88f-cadd6e616577 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "GET /compute/v2.1/servers/ce85aa86-fbba-4eca-97e8-173da3cdc7c3" status: 200 len: 1362 microversion: 2.1 time: 0.812241 Oct 27 03:42:40.791411 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2702/5112] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:39 2022] GET /compute/v2.1/servers/ce85aa86-fbba-4eca-97e8-173da3cdc7c3 => generated 1362 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:40.890312 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4c4d0c7f-debf-4609-84d2-69f635e97d45 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:40.891224 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4c4d0c7f-debf-4609-84d2-69f635e97d45 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] [instance: 20bed685-d855-499c-90d6-f8c59cfbd701] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:40.908069 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4c4d0c7f-debf-4609-84d2-69f635e97d45 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:40.909260 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4c4d0c7f-debf-4609-84d2-69f635e97d45 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:40.909902 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4c4d0c7f-debf-4609-84d2-69f635e97d45 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:40.910842 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4c4d0c7f-debf-4609-84d2-69f635e97d45 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:40.911475 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4c4d0c7f-debf-4609-84d2-69f635e97d45 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:40.912074 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4c4d0c7f-debf-4609-84d2-69f635e97d45 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:41.242500 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4c4d0c7f-debf-4609-84d2-69f635e97d45 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82daefe001364499b2ee9eb7da2599be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:41.257167 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4c4d0c7f-debf-4609-84d2-69f635e97d45 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] 10.222.0.20 "GET /compute/v2.1/servers/20bed685-d855-499c-90d6-f8c59cfbd701" status: 200 len: 1522 microversion: 2.1 time: 0.371572 Oct 27 03:42:41.258487 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2411/5113] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:40 2022] GET /compute/v2.1/servers/20bed685-d855-499c-90d6-f8c59cfbd701 => generated 1522 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:41.431380 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-bb5e9770-7c9b-4251-8ae0-6ff633d49231 req-25589c85-d409-492a-b335-0c13ed0a9c04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce85aa86-fbba-4eca-97e8-173da3cdc7c3", "tag": "7a4318fe-6fd1-4b83-9550-ccdb4f022ef2"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:42:41.447878 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-bb5e9770-7c9b-4251-8ae0-6ff633d49231 req-25589c85-d409-492a-b335-0c13ed0a9c04 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:41.449449 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-bb5e9770-7c9b-4251-8ae0-6ff633d49231 req-25589c85-d409-492a-b335-0c13ed0a9c04 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:41.450084 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-bb5e9770-7c9b-4251-8ae0-6ff633d49231 req-25589c85-d409-492a-b335-0c13ed0a9c04 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:41.471847 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-bb5e9770-7c9b-4251-8ae0-6ff633d49231 req-25589c85-d409-492a-b335-0c13ed0a9c04 service nova] Creating event network-changed:7a4318fe-6fd1-4b83-9550-ccdb4f022ef2 for instance ce85aa86-fbba-4eca-97e8-173da3cdc7c3 on n-h1-862769-1 Oct 27 03:42:41.495835 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-bb5e9770-7c9b-4251-8ae0-6ff633d49231 req-25589c85-d409-492a-b335-0c13ed0a9c04 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069009 Oct 27 03:42:41.510447 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2703/5114] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:42:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:42:41.549869 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-06f15224-f00a-4693-b46c-320f46a58d22 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:41.550542 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-06f15224-f00a-4693-b46c-320f46a58d22 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: dda902a6-dcad-42bf-9b3c-ed716ea0af70] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:41.559434 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-06f15224-f00a-4693-b46c-320f46a58d22 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:41.559935 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-06f15224-f00a-4693-b46c-320f46a58d22 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:41.560377 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-06f15224-f00a-4693-b46c-320f46a58d22 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:41.561288 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-06f15224-f00a-4693-b46c-320f46a58d22 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:41.561912 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-06f15224-f00a-4693-b46c-320f46a58d22 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:41.564779 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-06f15224-f00a-4693-b46c-320f46a58d22 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:41.823111 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0d93f0ed-a218-448c-9495-0977d292b778 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:41.823935 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0d93f0ed-a218-448c-9495-0977d292b778 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: ce85aa86-fbba-4eca-97e8-173da3cdc7c3] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:41.832929 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0d93f0ed-a218-448c-9495-0977d292b778 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:41.833786 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0d93f0ed-a218-448c-9495-0977d292b778 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:41.834436 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0d93f0ed-a218-448c-9495-0977d292b778 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:41.835346 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0d93f0ed-a218-448c-9495-0977d292b778 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:41.835977 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0d93f0ed-a218-448c-9495-0977d292b778 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:41.836576 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0d93f0ed-a218-448c-9495-0977d292b778 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:42.000895 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-06f15224-f00a-4693-b46c-320f46a58d22 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:42.017976 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-06f15224-f00a-4693-b46c-320f46a58d22 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/dda902a6-dcad-42bf-9b3c-ed716ea0af70" status: 200 len: 1516 microversion: 2.1 time: 0.474197 Oct 27 03:42:42.018875 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2412/5115] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:41 2022] GET /compute/v2.1/servers/dda902a6-dcad-42bf-9b3c-ed716ea0af70 => generated 1516 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:42.229766 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0d93f0ed-a218-448c-9495-0977d292b778 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffc2b1c410149e884a47240b5425e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38450368ef5c4e68ac3c19c7a0a1ce65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:42.247806 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0d93f0ed-a218-448c-9495-0977d292b778 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "GET /compute/v2.1/servers/ce85aa86-fbba-4eca-97e8-173da3cdc7c3" status: 200 len: 1362 microversion: 2.1 time: 0.430628 Oct 27 03:42:42.249399 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2704/5116] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:41 2022] GET /compute/v2.1/servers/ce85aa86-fbba-4eca-97e8-173da3cdc7c3 => generated 1362 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:42:42.282735 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-577de47e-d82b-4c8d-bd6a-99a3f6f88375 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:42.284136 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-577de47e-d82b-4c8d-bd6a-99a3f6f88375 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] [instance: 20bed685-d855-499c-90d6-f8c59cfbd701] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:42.296530 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-577de47e-d82b-4c8d-bd6a-99a3f6f88375 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:42.297274 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-577de47e-d82b-4c8d-bd6a-99a3f6f88375 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:42.297790 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-577de47e-d82b-4c8d-bd6a-99a3f6f88375 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:42.298651 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-577de47e-d82b-4c8d-bd6a-99a3f6f88375 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:42.299223 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-577de47e-d82b-4c8d-bd6a-99a3f6f88375 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:42.299777 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-577de47e-d82b-4c8d-bd6a-99a3f6f88375 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:42.545491 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-577de47e-d82b-4c8d-bd6a-99a3f6f88375 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82daefe001364499b2ee9eb7da2599be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:42.554227 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-577de47e-d82b-4c8d-bd6a-99a3f6f88375 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] 10.222.0.20 "GET /compute/v2.1/servers/20bed685-d855-499c-90d6-f8c59cfbd701" status: 200 len: 1522 microversion: 2.1 time: 0.277232 Oct 27 03:42:42.554835 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2413/5117] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:42 2022] GET /compute/v2.1/servers/20bed685-d855-499c-90d6-f8c59cfbd701 => generated 1522 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:43.283494 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a56719fc-d9d5-44fb-9a27-557d444e23d2 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:43.285417 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a56719fc-d9d5-44fb-9a27-557d444e23d2 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: ce85aa86-fbba-4eca-97e8-173da3cdc7c3] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:43.294469 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a56719fc-d9d5-44fb-9a27-557d444e23d2 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:43.295462 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a56719fc-d9d5-44fb-9a27-557d444e23d2 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:43.297185 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a56719fc-d9d5-44fb-9a27-557d444e23d2 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:43.298986 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a56719fc-d9d5-44fb-9a27-557d444e23d2 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:43.299630 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a56719fc-d9d5-44fb-9a27-557d444e23d2 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:43.300297 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a56719fc-d9d5-44fb-9a27-557d444e23d2 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:43.577162 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e1f4d199-01f4-43bb-9e24-c1f0f0c7a226 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:43.577853 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e1f4d199-01f4-43bb-9e24-c1f0f0c7a226 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] [instance: 20bed685-d855-499c-90d6-f8c59cfbd701] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:43.580927 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=12 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:42:43.601503 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e1f4d199-01f4-43bb-9e24-c1f0f0c7a226 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:43.608711 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e1f4d199-01f4-43bb-9e24-c1f0f0c7a226 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:43.609426 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e1f4d199-01f4-43bb-9e24-c1f0f0c7a226 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:43.613620 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e1f4d199-01f4-43bb-9e24-c1f0f0c7a226 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:43.613620 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e1f4d199-01f4-43bb-9e24-c1f0f0c7a226 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:43.614338 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e1f4d199-01f4-43bb-9e24-c1f0f0c7a226 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:43.712173 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a56719fc-d9d5-44fb-9a27-557d444e23d2 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffc2b1c410149e884a47240b5425e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38450368ef5c4e68ac3c19c7a0a1ce65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:43.729812 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a56719fc-d9d5-44fb-9a27-557d444e23d2 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "GET /compute/v2.1/servers/ce85aa86-fbba-4eca-97e8-173da3cdc7c3" status: 200 len: 1362 microversion: 2.1 time: 0.452188 Oct 27 03:42:43.730980 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2705/5118] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:43 2022] GET /compute/v2.1/servers/ce85aa86-fbba-4eca-97e8-173da3cdc7c3 => generated 1362 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:43.973014 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=16 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:42:44.100826 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e1f4d199-01f4-43bb-9e24-c1f0f0c7a226 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82daefe001364499b2ee9eb7da2599be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:44.109865 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e1f4d199-01f4-43bb-9e24-c1f0f0c7a226 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] 10.222.0.20 "GET /compute/v2.1/servers/20bed685-d855-499c-90d6-f8c59cfbd701" status: 200 len: 1522 microversion: 2.1 time: 0.536860 Oct 27 03:42:44.112361 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2414/5119] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:43 2022] GET /compute/v2.1/servers/20bed685-d855-499c-90d6-f8c59cfbd701 => generated 1522 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:42:44.758184 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6d450b49-5e74-4666-8fcf-bb380cbc3350 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:44.759216 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-6d450b49-5e74-4666-8fcf-bb380cbc3350 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: ce85aa86-fbba-4eca-97e8-173da3cdc7c3] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:44.770624 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6d450b49-5e74-4666-8fcf-bb380cbc3350 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:44.771130 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6d450b49-5e74-4666-8fcf-bb380cbc3350 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:44.773334 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6d450b49-5e74-4666-8fcf-bb380cbc3350 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:44.774098 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6d450b49-5e74-4666-8fcf-bb380cbc3350 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:44.774567 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6d450b49-5e74-4666-8fcf-bb380cbc3350 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:44.777721 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6d450b49-5e74-4666-8fcf-bb380cbc3350 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:45.080079 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=6 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:42:45.102140 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6d450b49-5e74-4666-8fcf-bb380cbc3350 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffc2b1c410149e884a47240b5425e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38450368ef5c4e68ac3c19c7a0a1ce65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:45.114003 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6d450b49-5e74-4666-8fcf-bb380cbc3350 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "GET /compute/v2.1/servers/ce85aa86-fbba-4eca-97e8-173da3cdc7c3" status: 200 len: 1362 microversion: 2.1 time: 0.361662 Oct 27 03:42:45.115365 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2706/5120] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:44 2022] GET /compute/v2.1/servers/ce85aa86-fbba-4eca-97e8-173da3cdc7c3 => generated 1362 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:45.145595 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ffd974c8-ffb8-43ae-b339-a9cb7fa46093 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:45.146296 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ffd974c8-ffb8-43ae-b339-a9cb7fa46093 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] [instance: 20bed685-d855-499c-90d6-f8c59cfbd701] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:45.154805 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-261928c0-74a3-4697-8fbf-51901cadee8f tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:42:45.156899 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ffd974c8-ffb8-43ae-b339-a9cb7fa46093 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:45.157577 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-261928c0-74a3-4697-8fbf-51901cadee8f tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: dda902a6-dcad-42bf-9b3c-ed716ea0af70] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:45.158872 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ffd974c8-ffb8-43ae-b339-a9cb7fa46093 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:45.159677 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ffd974c8-ffb8-43ae-b339-a9cb7fa46093 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:45.160976 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ffd974c8-ffb8-43ae-b339-a9cb7fa46093 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:45.161797 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ffd974c8-ffb8-43ae-b339-a9cb7fa46093 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:45.162481 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ffd974c8-ffb8-43ae-b339-a9cb7fa46093 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:45.169573 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:42:45.169785 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-261928c0-74a3-4697-8fbf-51901cadee8f tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:45.170274 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-261928c0-74a3-4697-8fbf-51901cadee8f tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:45.170910 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-261928c0-74a3-4697-8fbf-51901cadee8f tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:45.171812 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-261928c0-74a3-4697-8fbf-51901cadee8f tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:45.172593 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-261928c0-74a3-4697-8fbf-51901cadee8f tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:45.173276 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-261928c0-74a3-4697-8fbf-51901cadee8f tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:45.197776 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:42:45.218862 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-261928c0-74a3-4697-8fbf-51901cadee8f tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lazy-loading 'flavor' on Instance uuid dda902a6-dcad-42bf-9b3c-ed716ea0af70 {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:42:45.412268 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ffd974c8-ffb8-43ae-b339-a9cb7fa46093 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82daefe001364499b2ee9eb7da2599be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:45.448601 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ffd974c8-ffb8-43ae-b339-a9cb7fa46093 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] 10.222.0.20 "GET /compute/v2.1/servers/20bed685-d855-499c-90d6-f8c59cfbd701" status: 200 len: 1522 microversion: 2.1 time: 0.308875 Oct 27 03:42:45.455174 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2415/5121] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:45 2022] GET /compute/v2.1/servers/20bed685-d855-499c-90d6-f8c59cfbd701 => generated 1522 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:45.548148 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-261928c0-74a3-4697-8fbf-51901cadee8f tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "POST /compute/v2.1/servers/dda902a6-dcad-42bf-9b3c-ed716ea0af70/action" status: 200 len: 32 microversion: 2.1 time: 0.398880 Oct 27 03:42:45.549080 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2707/5122] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:42:45 2022] POST /compute/v2.1/servers/dda902a6-dcad-42bf-9b3c-ed716ea0af70/action => generated 32 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 27 03:42:45.568756 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7f9b60a4-6e52-4b7f-ad08-34cfbbc8bb11 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:45.569812 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7f9b60a4-6e52-4b7f-ad08-34cfbbc8bb11 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: dda902a6-dcad-42bf-9b3c-ed716ea0af70] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:45.590500 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7f9b60a4-6e52-4b7f-ad08-34cfbbc8bb11 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:45.591316 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7f9b60a4-6e52-4b7f-ad08-34cfbbc8bb11 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:45.592056 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7f9b60a4-6e52-4b7f-ad08-34cfbbc8bb11 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:45.593490 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7f9b60a4-6e52-4b7f-ad08-34cfbbc8bb11 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:45.594212 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7f9b60a4-6e52-4b7f-ad08-34cfbbc8bb11 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:45.594881 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7f9b60a4-6e52-4b7f-ad08-34cfbbc8bb11 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:45.816689 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7f9b60a4-6e52-4b7f-ad08-34cfbbc8bb11 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:45.826526 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7f9b60a4-6e52-4b7f-ad08-34cfbbc8bb11 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/dda902a6-dcad-42bf-9b3c-ed716ea0af70" status: 200 len: 1522 microversion: 2.1 time: 0.271081 Oct 27 03:42:45.827956 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2416/5123] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:45 2022] GET /compute/v2.1/servers/dda902a6-dcad-42bf-9b3c-ed716ea0af70 => generated 1522 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:42:46.141327 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e324cef4-caa4-412a-93a5-785b63433f78 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:46.143475 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e324cef4-caa4-412a-93a5-785b63433f78 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: ce85aa86-fbba-4eca-97e8-173da3cdc7c3] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:46.152916 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e324cef4-caa4-412a-93a5-785b63433f78 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:46.154781 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e324cef4-caa4-412a-93a5-785b63433f78 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:46.163367 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e324cef4-caa4-412a-93a5-785b63433f78 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:46.164231 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e324cef4-caa4-412a-93a5-785b63433f78 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:46.164719 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e324cef4-caa4-412a-93a5-785b63433f78 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:46.165363 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e324cef4-caa4-412a-93a5-785b63433f78 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:46.409603 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ae010fd4-5363-4bd5-bdf7-7b3b6cc8fe5e tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:46.410438 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ae010fd4-5363-4bd5-bdf7-7b3b6cc8fe5e tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:46.420256 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ae010fd4-5363-4bd5-bdf7-7b3b6cc8fe5e tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:46.423898 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ae010fd4-5363-4bd5-bdf7-7b3b6cc8fe5e tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:46.423898 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ae010fd4-5363-4bd5-bdf7-7b3b6cc8fe5e tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:46.423898 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ae010fd4-5363-4bd5-bdf7-7b3b6cc8fe5e tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:46.423898 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ae010fd4-5363-4bd5-bdf7-7b3b6cc8fe5e tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:46.423898 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ae010fd4-5363-4bd5-bdf7-7b3b6cc8fe5e tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:46.461475 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ae010fd4-5363-4bd5-bdf7-7b3b6cc8fe5e tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79/os-volume_attachments/8159df87-767a-4a23-9eb2-58a855f16937" status: 200 len: 194 microversion: 2.20 time: 0.056660 Oct 27 03:42:46.462155 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2417/5124] 10.222.0.20 () {60 vars in 1454 bytes} [Thu Oct 27 03:42:46 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79/os-volume_attachments/8159df87-767a-4a23-9eb2-58a855f16937 => generated 194 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 03:42:46.479858 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6d394c88-4d62-463a-b926-f508032a3ab9 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:46.481055 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6d394c88-4d62-463a-b926-f508032a3ab9 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] [instance: 20bed685-d855-499c-90d6-f8c59cfbd701] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:46.487407 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:42:46.489602 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6d394c88-4d62-463a-b926-f508032a3ab9 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:46.490347 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6d394c88-4d62-463a-b926-f508032a3ab9 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:46.490989 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6d394c88-4d62-463a-b926-f508032a3ab9 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:46.491946 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6d394c88-4d62-463a-b926-f508032a3ab9 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:46.492733 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6d394c88-4d62-463a-b926-f508032a3ab9 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:46.493463 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6d394c88-4d62-463a-b926-f508032a3ab9 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:46.686232 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-6d394c88-4d62-463a-b926-f508032a3ab9 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82daefe001364499b2ee9eb7da2599be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:46.705874 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6d394c88-4d62-463a-b926-f508032a3ab9 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] 10.222.0.20 "GET /compute/v2.1/servers/20bed685-d855-499c-90d6-f8c59cfbd701" status: 200 len: 1522 microversion: 2.1 time: 0.231114 Oct 27 03:42:46.727132 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2418/5125] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:46 2022] GET /compute/v2.1/servers/20bed685-d855-499c-90d6-f8c59cfbd701 => generated 1522 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:46.732402 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-bde4c8cb-1c1e-4732-8bb2-2ae2b0e9bc23 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:46.735114 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-bde4c8cb-1c1e-4732-8bb2-2ae2b0e9bc23 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:46.740029 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bde4c8cb-1c1e-4732-8bb2-2ae2b0e9bc23 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:46.740752 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bde4c8cb-1c1e-4732-8bb2-2ae2b0e9bc23 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:46.741620 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bde4c8cb-1c1e-4732-8bb2-2ae2b0e9bc23 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:46.742538 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bde4c8cb-1c1e-4732-8bb2-2ae2b0e9bc23 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:46.743145 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bde4c8cb-1c1e-4732-8bb2-2ae2b0e9bc23 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:46.743726 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bde4c8cb-1c1e-4732-8bb2-2ae2b0e9bc23 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:46.811465 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e324cef4-caa4-412a-93a5-785b63433f78 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffc2b1c410149e884a47240b5425e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38450368ef5c4e68ac3c19c7a0a1ce65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:46.825447 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e324cef4-caa4-412a-93a5-785b63433f78 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "GET /compute/v2.1/servers/ce85aa86-fbba-4eca-97e8-173da3cdc7c3" status: 200 len: 1362 microversion: 2.1 time: 0.690316 Oct 27 03:42:46.842602 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2708/5126] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:46 2022] GET /compute/v2.1/servers/ce85aa86-fbba-4eca-97e8-173da3cdc7c3 => generated 1362 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:46.851400 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-994f20ca-0acf-434e-830b-62b4fbaa9896 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:46.852896 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-994f20ca-0acf-434e-830b-62b4fbaa9896 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: dda902a6-dcad-42bf-9b3c-ed716ea0af70] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:46.859251 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-994f20ca-0acf-434e-830b-62b4fbaa9896 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:46.860340 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-994f20ca-0acf-434e-830b-62b4fbaa9896 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:46.861240 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-994f20ca-0acf-434e-830b-62b4fbaa9896 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:46.862331 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-994f20ca-0acf-434e-830b-62b4fbaa9896 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:46.864011 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-994f20ca-0acf-434e-830b-62b4fbaa9896 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:46.864696 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-994f20ca-0acf-434e-830b-62b4fbaa9896 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:46.883274 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-bde4c8cb-1c1e-4732-8bb2-2ae2b0e9bc23 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lazy-loading 'services' on Instance uuid 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:42:47.140501 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-bde4c8cb-1c1e-4732-8bb2-2ae2b0e9bc23 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79/os-volume_attachments/8159df87-767a-4a23-9eb2-58a855f16937" status: 202 len: 0 microversion: 2.20 time: 0.392395 Oct 27 03:42:47.144190 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2419/5127] 10.222.0.20 () {60 vars in 1457 bytes} [Thu Oct 27 03:42:46 2022] DELETE /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79/os-volume_attachments/8159df87-767a-4a23-9eb2-58a855f16937 => generated 0 bytes in 417 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:42:47.148731 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-994f20ca-0acf-434e-830b-62b4fbaa9896 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:47.161412 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-994f20ca-0acf-434e-830b-62b4fbaa9896 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/dda902a6-dcad-42bf-9b3c-ed716ea0af70" status: 200 len: 1522 microversion: 2.1 time: 0.314145 Oct 27 03:42:47.165950 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2709/5128] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:46 2022] GET /compute/v2.1/servers/dda902a6-dcad-42bf-9b3c-ed716ea0af70 => generated 1522 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:47.166483 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f8579561-0246-4f4d-9946-2b3f3706b317 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:47.171528 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f8579561-0246-4f4d-9946-2b3f3706b317 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:47.183982 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f8579561-0246-4f4d-9946-2b3f3706b317 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:47.185100 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f8579561-0246-4f4d-9946-2b3f3706b317 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:47.185643 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f8579561-0246-4f4d-9946-2b3f3706b317 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:47.190121 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f8579561-0246-4f4d-9946-2b3f3706b317 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:47.190121 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f8579561-0246-4f4d-9946-2b3f3706b317 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:47.190121 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f8579561-0246-4f4d-9946-2b3f3706b317 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:47.287108 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f8579561-0246-4f4d-9946-2b3f3706b317 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.139544 Oct 27 03:42:47.293128 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2420/5129] 10.222.0.20 () {60 vars in 1343 bytes} [Thu Oct 27 03:42:47 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79/os-volume_attachments => generated 197 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 03:42:47.479167 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-02888892-8dbe-4365-bba4-3501753990d1 tempest-VolumesNegativeTest-2037325305 tempest-VolumesNegativeTest-2037325305-project] Action: 'create', calling method: .version_select at 0x7f7ddac48310>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-824929970", "metadata": {"Type": "work"}}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:42:47.483143 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-02888892-8dbe-4365-bba4-3501753990d1 tempest-VolumesNegativeTest-2037325305 tempest-VolumesNegativeTest-2037325305-project] Request method failure captured: Oct 27 03:42:47.483143 n-d-862769-1 devstack@n-api.service[121001]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 27 03:42:47.483143 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:42:47.483143 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:42:47.483143 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:42:47.483143 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 121 Oct 27 03:42:47.483143 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:42:47.483143 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:42:47.483143 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:42:47.483143 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:42:47.483143 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWf43SFOdzjefR3ii6GFe8n4MyuEHsL5dH1Rq2wJ58oqVx9FQa8dVY720quCDJ93otGNKVcjBy1XWSgd_j32XBXhqh8rPmq79LT1V6-mtwKNmx54NY0ONpUddDt28p0B2ydhQKqtMhE03hOwq9rrnqC1ek8WdunPSKwX9JD0-Xkrw9us Oct 27 03:42:47.483143 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:42:47.483143 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:42:47.483143 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:42:47.483143 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:42:47.483143 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:42:47.483143 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:42:47.483143 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: bfe0c3e569214309819d61fc0410d9e2 Oct 27 03:42:47.483143 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-VolumesNegativeTest-2037325305 Oct 27 03:42:47.483143 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:42:47.483143 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:42:47.483143 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bfe0c3e569214309819d61fc0410d9e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bfe0c3e569214309819d61fc0410d9e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bfe0c3e569214309819d61fc0410d9e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bfe0c3e569214309819d61fc0410d9e2"}]}] Oct 27 03:42:47.483143 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-VolumesNegativeTest-2037325305 Oct 27 03:42:47.483143 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: bfe0c3e569214309819d61fc0410d9e2 Oct 27 03:42:47.483143 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-VolumesNegativeTest-2037325305 Oct 27 03:42:47.483143 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-VolumesNegativeTest-2037325305-project Oct 27 03:42:47.483143 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:42:47.483143 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:42:47.483143 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: be31286e3e394c7695c25b183bd50edd Oct 27 03:42:47.483143 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-VolumesNegativeTest-2037325305-project Oct 27 03:42:47.483143 n-d-862769-1 devstack@n-api.service[121001]: Oct 27 03:42:47.483143 n-d-862769-1 devstack@n-api.service[121001]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-824929970", "metadata": {"Type": "work"}}} Oct 27 03:42:47.483143 n-d-862769-1 devstack@n-api.service[121001]: method: Oct 27 03:42:47.483143 n-d-862769-1 devstack@n-api.service[121001]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 27 03:42:47.483143 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-824929970', 'metadata': {'Type': 'work'}}}} Oct 27 03:42:47.483143 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:42:47.483143 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:47.483143 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 03:42:47.483143 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 03:42:47.483143 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 03:42:47.483143 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise error Oct 27 03:42:47.483143 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 27 03:42:47.483143 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:42:47.483143 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 27 03:42:47.483143 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 27 03:42:47.483143 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:42:47.483143 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 27 03:42:47.483143 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi '#$%' Oct 27 03:42:47.483143 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:42:47.483143 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:42:47.483143 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:42:47.483143 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:47.483143 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:42:47.483143 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:42:47.483143 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:42:47.483143 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:42:47.483143 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:42:47.483143 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:42:47.483143 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:42:47.483143 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:42:47.483143 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 03:42:47.483143 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 03:42:47.483143 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 03:42:47.483143 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 03:42:47.483143 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 03:42:47.483143 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 03:42:47.488705 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 27 03:42:47.488705 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:42:47.488705 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:42:47.488705 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:42:47.488705 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:47.488705 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:42:47.488705 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:42:47.488705 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 03:42:47.488705 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 03:42:47.488705 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 27 03:42:47.488705 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:42:47.488705 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-02888892-8dbe-4365-bba4-3501753990d1 tempest-VolumesNegativeTest-2037325305 tempest-VolumesNegativeTest-2037325305-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:42:47.488705 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-02888892-8dbe-4365-bba4-3501753990d1 tempest-VolumesNegativeTest-2037325305 tempest-VolumesNegativeTest-2037325305-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.179321 Oct 27 03:42:47.488705 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2710/5130] 10.222.0.20 () {60 vars in 1156 bytes} [Thu Oct 27 03:42:47 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 180 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 03:42:47.495010 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ca013640-0976-4ed6-9dc2-c15d19dc39f8 tempest-VolumesNegativeTest-2037325305 tempest-VolumesNegativeTest-2037325305-project] Action: 'create', calling method: .version_select at 0x7f7ddb178e50>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2113109680", "metadata": {"Type": "work"}}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:42:47.499241 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ca013640-0976-4ed6-9dc2-c15d19dc39f8 tempest-VolumesNegativeTest-2037325305 tempest-VolumesNegativeTest-2037325305-project] Request method failure captured: Oct 27 03:42:47.499241 n-d-862769-1 devstack@n-api.service[121000]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 27 03:42:47.499241 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:42:47.499241 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:42:47.499241 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:42:47.499241 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 120 Oct 27 03:42:47.499241 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:42:47.499241 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:42:47.499241 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:42:47.499241 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:42:47.499241 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWf43SFOdzjefR3ii6GFe8n4MyuEHsL5dH1Rq2wJ58oqVx9FQa8dVY720quCDJ93otGNKVcjBy1XWSgd_j32XBXhqh8rPmq79LT1V6-mtwKNmx54NY0ONpUddDt28p0B2ydhQKqtMhE03hOwq9rrnqC1ek8WdunPSKwX9JD0-Xkrw9us Oct 27 03:42:47.499241 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:42:47.499241 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:42:47.499241 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:42:47.499241 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:42:47.499241 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:42:47.499241 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:42:47.499241 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: bfe0c3e569214309819d61fc0410d9e2 Oct 27 03:42:47.499241 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-VolumesNegativeTest-2037325305 Oct 27 03:42:47.499241 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:42:47.499241 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:42:47.499241 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bfe0c3e569214309819d61fc0410d9e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bfe0c3e569214309819d61fc0410d9e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bfe0c3e569214309819d61fc0410d9e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bfe0c3e569214309819d61fc0410d9e2"}]}] Oct 27 03:42:47.499241 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-VolumesNegativeTest-2037325305 Oct 27 03:42:47.499241 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: bfe0c3e569214309819d61fc0410d9e2 Oct 27 03:42:47.499241 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-VolumesNegativeTest-2037325305 Oct 27 03:42:47.499241 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-VolumesNegativeTest-2037325305-project Oct 27 03:42:47.499241 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:42:47.499241 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:42:47.499241 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: be31286e3e394c7695c25b183bd50edd Oct 27 03:42:47.499241 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-VolumesNegativeTest-2037325305-project Oct 27 03:42:47.499241 n-d-862769-1 devstack@n-api.service[121000]: Oct 27 03:42:47.499241 n-d-862769-1 devstack@n-api.service[121000]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2113109680", "metadata": {"Type": "work"}}} Oct 27 03:42:47.499241 n-d-862769-1 devstack@n-api.service[121000]: method: Oct 27 03:42:47.499241 n-d-862769-1 devstack@n-api.service[121000]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 27 03:42:47.499241 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-2113109680', 'metadata': {'Type': 'work'}}}} Oct 27 03:42:47.499241 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:42:47.499241 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:47.499241 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 03:42:47.499241 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 03:42:47.499241 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 03:42:47.499241 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise error Oct 27 03:42:47.499241 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 27 03:42:47.499241 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:42:47.499241 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 27 03:42:47.499241 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 27 03:42:47.499241 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:42:47.499241 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 27 03:42:47.499241 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi '0' Oct 27 03:42:47.499241 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:42:47.499241 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:42:47.499241 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:42:47.499241 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:47.499241 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:42:47.499241 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:42:47.499241 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:42:47.499241 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:42:47.499241 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:42:47.499241 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:42:47.499241 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:42:47.499241 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:42:47.499241 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 03:42:47.499241 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 03:42:47.499241 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 03:42:47.499241 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 03:42:47.499241 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 03:42:47.499241 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 03:42:47.504578 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 27 03:42:47.504578 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:42:47.504578 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:42:47.504578 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:42:47.504578 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:47.504578 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:42:47.504578 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:42:47.504578 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 03:42:47.504578 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 03:42:47.504578 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 27 03:42:47.504578 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:42:47.504578 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ca013640-0976-4ed6-9dc2-c15d19dc39f8 tempest-VolumesNegativeTest-2037325305 tempest-VolumesNegativeTest-2037325305-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:42:47.504578 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ca013640-0976-4ed6-9dc2-c15d19dc39f8 tempest-VolumesNegativeTest-2037325305 tempest-VolumesNegativeTest-2037325305-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010073 Oct 27 03:42:47.517599 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2421/5131] 10.222.0.20 () {60 vars in 1156 bytes} [Thu Oct 27 03:42:47 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 03:42:47.520544 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8bfb5787-8979-4e87-b8c2-1adeb53640c1 tempest-VolumesNegativeTest-2037325305 tempest-VolumesNegativeTest-2037325305-project] Action: 'create', calling method: .version_select at 0x7f7ddeceaa60>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1040614954", "metadata": {"Type": "work"}}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:42:47.531670 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8bfb5787-8979-4e87-b8c2-1adeb53640c1 tempest-VolumesNegativeTest-2037325305 tempest-VolumesNegativeTest-2037325305-project] Request method failure captured: Oct 27 03:42:47.531670 n-d-862769-1 devstack@n-api.service[121001]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 27 03:42:47.531670 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:42:47.531670 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:42:47.531670 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:42:47.531670 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 119 Oct 27 03:42:47.531670 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:42:47.531670 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:42:47.531670 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:42:47.531670 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:42:47.531670 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWf43SFOdzjefR3ii6GFe8n4MyuEHsL5dH1Rq2wJ58oqVx9FQa8dVY720quCDJ93otGNKVcjBy1XWSgd_j32XBXhqh8rPmq79LT1V6-mtwKNmx54NY0ONpUddDt28p0B2ydhQKqtMhE03hOwq9rrnqC1ek8WdunPSKwX9JD0-Xkrw9us Oct 27 03:42:47.531670 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:42:47.531670 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:42:47.531670 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:42:47.531670 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:42:47.531670 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:42:47.531670 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:42:47.531670 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: bfe0c3e569214309819d61fc0410d9e2 Oct 27 03:42:47.531670 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-VolumesNegativeTest-2037325305 Oct 27 03:42:47.531670 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:42:47.531670 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:42:47.531670 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bfe0c3e569214309819d61fc0410d9e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bfe0c3e569214309819d61fc0410d9e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bfe0c3e569214309819d61fc0410d9e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bfe0c3e569214309819d61fc0410d9e2"}]}] Oct 27 03:42:47.531670 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-VolumesNegativeTest-2037325305 Oct 27 03:42:47.531670 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: bfe0c3e569214309819d61fc0410d9e2 Oct 27 03:42:47.531670 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-VolumesNegativeTest-2037325305 Oct 27 03:42:47.531670 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-VolumesNegativeTest-2037325305-project Oct 27 03:42:47.531670 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:42:47.531670 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:42:47.531670 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: be31286e3e394c7695c25b183bd50edd Oct 27 03:42:47.531670 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-VolumesNegativeTest-2037325305-project Oct 27 03:42:47.531670 n-d-862769-1 devstack@n-api.service[121001]: Oct 27 03:42:47.531670 n-d-862769-1 devstack@n-api.service[121001]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1040614954", "metadata": {"Type": "work"}}} Oct 27 03:42:47.531670 n-d-862769-1 devstack@n-api.service[121001]: method: Oct 27 03:42:47.531670 n-d-862769-1 devstack@n-api.service[121001]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 27 03:42:47.531670 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1040614954', 'metadata': {'Type': 'work'}}}} Oct 27 03:42:47.531670 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:42:47.531670 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:47.531670 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 03:42:47.531670 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 03:42:47.531670 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 03:42:47.531670 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise error Oct 27 03:42:47.531670 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 27 03:42:47.531670 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:42:47.531670 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 27 03:42:47.531670 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 27 03:42:47.531670 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:42:47.531670 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 27 03:42:47.531670 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi '' Oct 27 03:42:47.531670 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:42:47.531670 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:42:47.531670 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:42:47.531670 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:47.531670 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:42:47.531670 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:42:47.531670 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:42:47.531670 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:42:47.531670 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:42:47.531670 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:42:47.531670 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:42:47.531670 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:42:47.531670 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 03:42:47.531670 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 03:42:47.531670 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 03:42:47.531670 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 03:42:47.531670 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 03:42:47.531670 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 03:42:47.538220 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 27 03:42:47.538220 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:42:47.538220 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:42:47.538220 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:42:47.538220 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:47.538220 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:42:47.538220 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:42:47.538220 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 03:42:47.538220 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 03:42:47.538220 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 27 03:42:47.538220 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:42:47.538220 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8bfb5787-8979-4e87-b8c2-1adeb53640c1 tempest-VolumesNegativeTest-2037325305 tempest-VolumesNegativeTest-2037325305-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:42:47.539675 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8bfb5787-8979-4e87-b8c2-1adeb53640c1 tempest-VolumesNegativeTest-2037325305 tempest-VolumesNegativeTest-2037325305-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.024116 Oct 27 03:42:47.542087 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2711/5132] 10.222.0.20 () {60 vars in 1156 bytes} [Thu Oct 27 03:42:47 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 03:42:47.558697 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e00350fd-0c37-4c45-9477-3079f965fe76 tempest-VolumesNegativeTest-2037325305 tempest-VolumesNegativeTest-2037325305-project] Calling method '.version_select at 0x7f7dd9a01160>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:47.626877 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-e00350fd-0c37-4c45-9477-3079f965fe76 tempest-VolumesNegativeTest-2037325305 tempest-VolumesNegativeTest-2037325305-project] HTTP exception thrown: Volume tempest-invalid-1443407886 could not be found. Oct 27 03:42:47.629965 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e00350fd-0c37-4c45-9477-3079f965fe76 tempest-VolumesNegativeTest-2037325305 tempest-VolumesNegativeTest-2037325305-project] Request method failure captured: Oct 27 03:42:47.629965 n-d-862769-1 devstack@n-api.service[121000]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1443407886 HTTP/1.1 Oct 27 03:42:47.629965 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:42:47.629965 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:42:47.629965 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:42:47.629965 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:42:47.629965 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:42:47.629965 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:42:47.629965 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:42:47.629965 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:42:47.629965 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWf43SFOdzjefR3ii6GFe8n4MyuEHsL5dH1Rq2wJ58oqVx9FQa8dVY720quCDJ93otGNKVcjBy1XWSgd_j32XBXhqh8rPmq79LT1V6-mtwKNmx54NY0ONpUddDt28p0B2ydhQKqtMhE03hOwq9rrnqC1ek8WdunPSKwX9JD0-Xkrw9us Oct 27 03:42:47.629965 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:42:47.629965 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:42:47.629965 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:42:47.629965 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:42:47.629965 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:42:47.629965 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:42:47.629965 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: bfe0c3e569214309819d61fc0410d9e2 Oct 27 03:42:47.629965 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-VolumesNegativeTest-2037325305 Oct 27 03:42:47.629965 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:42:47.629965 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:42:47.629965 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bfe0c3e569214309819d61fc0410d9e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bfe0c3e569214309819d61fc0410d9e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bfe0c3e569214309819d61fc0410d9e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bfe0c3e569214309819d61fc0410d9e2"}]}] Oct 27 03:42:47.629965 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-VolumesNegativeTest-2037325305 Oct 27 03:42:47.629965 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: bfe0c3e569214309819d61fc0410d9e2 Oct 27 03:42:47.629965 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-VolumesNegativeTest-2037325305 Oct 27 03:42:47.629965 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-VolumesNegativeTest-2037325305-project Oct 27 03:42:47.629965 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:42:47.629965 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:42:47.629965 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: be31286e3e394c7695c25b183bd50edd Oct 27 03:42:47.629965 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-VolumesNegativeTest-2037325305-project Oct 27 03:42:47.629965 n-d-862769-1 devstack@n-api.service[121000]: method: Oct 27 03:42:47.629965 n-d-862769-1 devstack@n-api.service[121000]: exception: Volume tempest-invalid-1443407886 could not be found. Oct 27 03:42:47.629965 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': 'tempest-invalid-1443407886'} Oct 27 03:42:47.629965 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:42:47.629965 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:47.629965 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 03:42:47.629965 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 03:42:47.629965 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 27 03:42:47.629965 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 27 03:42:47.629965 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 27 03:42:47.629965 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 27 03:42:47.629965 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 27 03:42:47.629965 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 27 03:42:47.629965 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 27 03:42:47.629965 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 27 03:42:47.629965 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 03:42:47.629965 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 03:42:47.629965 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 03:42:47.629965 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 03:42:47.629965 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1443407886 could not be found. (HTTP 404) (Request-ID: req-dc9b8ca0-6c4e-400d-85b1-3d8893968b2f) Oct 27 03:42:47.629965 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:42:47.629965 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:42:47.629965 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:42:47.629965 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:47.629965 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 27 03:42:47.629965 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 27 03:42:47.629965 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 27 03:42:47.629965 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 27 03:42:47.629965 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 27 03:42:47.629965 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 27 03:42:47.629965 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 27 03:42:47.629965 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 27 03:42:47.629965 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 03:42:47.634635 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 03:42:47.634635 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 27 03:42:47.634635 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 27 03:42:47.634635 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 27 03:42:47.634635 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 27 03:42:47.634635 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 27 03:42:47.634635 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 27 03:42:47.634635 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 27 03:42:47.634635 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 27 03:42:47.634635 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 03:42:47.634635 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 03:42:47.634635 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 03:42:47.634635 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 03:42:47.634635 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1443407886 could not be found. Oct 27 03:42:47.634635 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:42:47.634635 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:42:47.634635 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:42:47.634635 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:47.634635 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:42:47.634635 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:42:47.634635 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:42:47.634635 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:42:47.634635 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:42:47.634635 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:42:47.634635 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:42:47.634635 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:42:47.634635 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 27 03:42:47.634635 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:42:47.634635 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1443407886 could not be found. Oct 27 03:42:47.634635 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:42:47.634635 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:42:47.634635 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:42:47.634635 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:47.634635 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:42:47.634635 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:42:47.634635 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:42:47.634635 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:42:47.634635 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1443407886 could not be found. Oct 27 03:42:47.634635 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:42:47.634635 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e00350fd-0c37-4c45-9477-3079f965fe76 tempest-VolumesNegativeTest-2037325305 tempest-VolumesNegativeTest-2037325305-project] Returning 404 to user: Volume tempest-invalid-1443407886 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:42:47.634635 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e00350fd-0c37-4c45-9477-3079f965fe76 tempest-VolumesNegativeTest-2037325305 tempest-VolumesNegativeTest-2037325305-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1443407886" status: 404 len: 99 microversion: 2.1 time: 0.085876 Oct 27 03:42:47.634635 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2422/5133] 10.222.0.20 () {58 vars in 1218 bytes} [Thu Oct 27 03:42:47 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1443407886 => generated 99 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 03:42:47.645981 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d1d6d891-01b6-4b9b-9d21-900907954222 tempest-VolumesNegativeTest-2037325305 tempest-VolumesNegativeTest-2037325305-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005133 Oct 27 03:42:47.652588 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2712/5134] 10.222.0.20 () {58 vars in 1140 bytes} [Thu Oct 27 03:42:47 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 13 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 27 03:42:47.659782 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-fa72fc63-bad9-450e-bcd7-39ab2af4e0cb tempest-VolumesNegativeTest-2037325305 tempest-VolumesNegativeTest-2037325305-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005169 Oct 27 03:42:47.665120 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2423/5135] 10.222.0.20 () {58 vars in 1137 bytes} [Thu Oct 27 03:42:47 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 27 03:42:47.675780 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d3f4310d-fb0c-4630-9a3f-a78fc1fd0d5d tempest-VolumesNegativeTest-2037325305 tempest-VolumesNegativeTest-2037325305-project] Calling method '.version_select at 0x7f7dda598700>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:47.710877 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-d3f4310d-fb0c-4630-9a3f-a78fc1fd0d5d tempest-VolumesNegativeTest-2037325305 tempest-VolumesNegativeTest-2037325305-project] HTTP exception thrown: Volume b1805a14-af11-4f42-81d5-4c32630d40e5 could not be found. Oct 27 03:42:47.733951 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-121a0d44-d0fc-4c90-bb23-11cbe3860552 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:47.734594 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-121a0d44-d0fc-4c90-bb23-11cbe3860552 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] [instance: 20bed685-d855-499c-90d6-f8c59cfbd701] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:47.737543 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d3f4310d-fb0c-4630-9a3f-a78fc1fd0d5d tempest-VolumesNegativeTest-2037325305 tempest-VolumesNegativeTest-2037325305-project] Request method failure captured: Oct 27 03:42:47.737543 n-d-862769-1 devstack@n-api.service[121001]: request: DELETE /compute/v2.1/os-volumes/b1805a14-af11-4f42-81d5-4c32630d40e5 HTTP/1.1 Oct 27 03:42:47.737543 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:42:47.737543 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:42:47.737543 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:42:47.737543 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:42:47.737543 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:42:47.737543 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:42:47.737543 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:42:47.737543 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:42:47.737543 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWf43SFOdzjefR3ii6GFe8n4MyuEHsL5dH1Rq2wJ58oqVx9FQa8dVY720quCDJ93otGNKVcjBy1XWSgd_j32XBXhqh8rPmq79LT1V6-mtwKNmx54NY0ONpUddDt28p0B2ydhQKqtMhE03hOwq9rrnqC1ek8WdunPSKwX9JD0-Xkrw9us Oct 27 03:42:47.737543 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:42:47.737543 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:42:47.737543 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:42:47.737543 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:42:47.737543 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:42:47.737543 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:42:47.737543 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: bfe0c3e569214309819d61fc0410d9e2 Oct 27 03:42:47.737543 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-VolumesNegativeTest-2037325305 Oct 27 03:42:47.737543 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:42:47.737543 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:42:47.737543 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bfe0c3e569214309819d61fc0410d9e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bfe0c3e569214309819d61fc0410d9e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bfe0c3e569214309819d61fc0410d9e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bfe0c3e569214309819d61fc0410d9e2"}]}] Oct 27 03:42:47.737543 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-VolumesNegativeTest-2037325305 Oct 27 03:42:47.737543 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: bfe0c3e569214309819d61fc0410d9e2 Oct 27 03:42:47.737543 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-VolumesNegativeTest-2037325305 Oct 27 03:42:47.737543 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-VolumesNegativeTest-2037325305-project Oct 27 03:42:47.737543 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:42:47.737543 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:42:47.737543 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: be31286e3e394c7695c25b183bd50edd Oct 27 03:42:47.737543 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-VolumesNegativeTest-2037325305-project Oct 27 03:42:47.737543 n-d-862769-1 devstack@n-api.service[121001]: method: Oct 27 03:42:47.737543 n-d-862769-1 devstack@n-api.service[121001]: exception: Volume b1805a14-af11-4f42-81d5-4c32630d40e5 could not be found. Oct 27 03:42:47.737543 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': 'b1805a14-af11-4f42-81d5-4c32630d40e5'} Oct 27 03:42:47.737543 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:42:47.737543 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:47.737543 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 03:42:47.737543 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 03:42:47.737543 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 27 03:42:47.737543 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 27 03:42:47.737543 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 27 03:42:47.737543 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 27 03:42:47.737543 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 27 03:42:47.737543 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 27 03:42:47.737543 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 27 03:42:47.737543 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 27 03:42:47.737543 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 03:42:47.737543 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 03:42:47.737543 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 03:42:47.737543 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 03:42:47.737543 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b1805a14-af11-4f42-81d5-4c32630d40e5 could not be found. (HTTP 404) (Request-ID: req-4da8607a-95bc-4c5a-b7c2-0aceb722a8dc) Oct 27 03:42:47.737543 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:42:47.737543 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:42:47.737543 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:42:47.737543 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:47.737543 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 27 03:42:47.737543 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 27 03:42:47.737543 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 27 03:42:47.737543 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 27 03:42:47.737543 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 27 03:42:47.737543 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 27 03:42:47.737543 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 27 03:42:47.737543 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 27 03:42:47.737543 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 03:42:47.749219 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 03:42:47.749219 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 27 03:42:47.749219 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 27 03:42:47.749219 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 27 03:42:47.749219 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 27 03:42:47.749219 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 27 03:42:47.749219 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 27 03:42:47.749219 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 27 03:42:47.749219 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 27 03:42:47.749219 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 03:42:47.749219 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 03:42:47.749219 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 03:42:47.749219 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 03:42:47.749219 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b1805a14-af11-4f42-81d5-4c32630d40e5 could not be found. Oct 27 03:42:47.749219 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:42:47.749219 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:42:47.749219 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:42:47.749219 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:47.749219 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:42:47.749219 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:42:47.749219 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:42:47.749219 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:42:47.749219 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:42:47.749219 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:42:47.749219 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:42:47.749219 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:42:47.749219 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 27 03:42:47.749219 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:42:47.749219 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b1805a14-af11-4f42-81d5-4c32630d40e5 could not be found. Oct 27 03:42:47.749219 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:42:47.749219 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:42:47.749219 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:42:47.749219 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:47.749219 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:42:47.749219 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:42:47.749219 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:42:47.749219 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:42:47.749219 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b1805a14-af11-4f42-81d5-4c32630d40e5 could not be found. Oct 27 03:42:47.749219 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:42:47.749219 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d3f4310d-fb0c-4630-9a3f-a78fc1fd0d5d tempest-VolumesNegativeTest-2037325305 tempest-VolumesNegativeTest-2037325305-project] Returning 404 to user: Volume b1805a14-af11-4f42-81d5-4c32630d40e5 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:42:47.749219 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d3f4310d-fb0c-4630-9a3f-a78fc1fd0d5d tempest-VolumesNegativeTest-2037325305 tempest-VolumesNegativeTest-2037325305-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/b1805a14-af11-4f42-81d5-4c32630d40e5" status: 404 len: 109 microversion: 2.1 time: 0.068259 Oct 27 03:42:47.749219 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2713/5136] 10.222.0.20 () {58 vars in 1248 bytes} [Thu Oct 27 03:42:47 2022] DELETE /compute/v2.1/os-volumes/b1805a14-af11-4f42-81d5-4c32630d40e5 => generated 109 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:42:47.756754 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-121a0d44-d0fc-4c90-bb23-11cbe3860552 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:47.756895 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-01f73d91-ba95-4077-9a1d-de32d3c84221 tempest-VolumesNegativeTest-2037325305 tempest-VolumesNegativeTest-2037325305-project] Calling method '.version_select at 0x7f7ddaadd5e0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:47.757601 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-121a0d44-d0fc-4c90-bb23-11cbe3860552 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:47.758299 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-121a0d44-d0fc-4c90-bb23-11cbe3860552 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:47.759255 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-121a0d44-d0fc-4c90-bb23-11cbe3860552 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:47.759920 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-121a0d44-d0fc-4c90-bb23-11cbe3860552 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:47.760590 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-121a0d44-d0fc-4c90-bb23-11cbe3860552 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:47.806875 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-01f73d91-ba95-4077-9a1d-de32d3c84221 tempest-VolumesNegativeTest-2037325305 tempest-VolumesNegativeTest-2037325305-project] HTTP exception thrown: Volume f6fb1c63-0afd-491a-bba8-cf579e9d33a7 could not be found. Oct 27 03:42:47.809497 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-01f73d91-ba95-4077-9a1d-de32d3c84221 tempest-VolumesNegativeTest-2037325305 tempest-VolumesNegativeTest-2037325305-project] Request method failure captured: Oct 27 03:42:47.809497 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/os-volumes/f6fb1c63-0afd-491a-bba8-cf579e9d33a7 HTTP/1.1 Oct 27 03:42:47.809497 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:42:47.809497 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:42:47.809497 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:42:47.809497 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:42:47.809497 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:42:47.809497 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:42:47.809497 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:42:47.809497 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:42:47.809497 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWf43SFOdzjefR3ii6GFe8n4MyuEHsL5dH1Rq2wJ58oqVx9FQa8dVY720quCDJ93otGNKVcjBy1XWSgd_j32XBXhqh8rPmq79LT1V6-mtwKNmx54NY0ONpUddDt28p0B2ydhQKqtMhE03hOwq9rrnqC1ek8WdunPSKwX9JD0-Xkrw9us Oct 27 03:42:47.809497 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:42:47.809497 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:42:47.809497 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:42:47.809497 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:42:47.809497 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:42:47.809497 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:42:47.809497 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: bfe0c3e569214309819d61fc0410d9e2 Oct 27 03:42:47.809497 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-VolumesNegativeTest-2037325305 Oct 27 03:42:47.809497 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:42:47.809497 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:42:47.809497 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bfe0c3e569214309819d61fc0410d9e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bfe0c3e569214309819d61fc0410d9e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bfe0c3e569214309819d61fc0410d9e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bfe0c3e569214309819d61fc0410d9e2"}]}] Oct 27 03:42:47.809497 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-VolumesNegativeTest-2037325305 Oct 27 03:42:47.809497 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: bfe0c3e569214309819d61fc0410d9e2 Oct 27 03:42:47.809497 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-VolumesNegativeTest-2037325305 Oct 27 03:42:47.809497 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-VolumesNegativeTest-2037325305-project Oct 27 03:42:47.809497 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:42:47.809497 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:42:47.809497 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: be31286e3e394c7695c25b183bd50edd Oct 27 03:42:47.809497 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-VolumesNegativeTest-2037325305-project Oct 27 03:42:47.809497 n-d-862769-1 devstack@n-api.service[121001]: method: Oct 27 03:42:47.809497 n-d-862769-1 devstack@n-api.service[121001]: exception: Volume f6fb1c63-0afd-491a-bba8-cf579e9d33a7 could not be found. Oct 27 03:42:47.809497 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': 'f6fb1c63-0afd-491a-bba8-cf579e9d33a7'} Oct 27 03:42:47.809497 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:42:47.809497 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:47.809497 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 03:42:47.809497 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 03:42:47.809497 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 27 03:42:47.809497 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 27 03:42:47.809497 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 27 03:42:47.809497 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 27 03:42:47.809497 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 03:42:47.809497 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 03:42:47.809497 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 03:42:47.809497 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 03:42:47.809497 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 03:42:47.809497 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 03:42:47.809497 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 03:42:47.809497 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 03:42:47.809497 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f6fb1c63-0afd-491a-bba8-cf579e9d33a7 could not be found. (HTTP 404) (Request-ID: req-0ad4d362-b40a-40d1-ad72-45bb28ebe6d7) Oct 27 03:42:47.809497 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:42:47.809497 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:42:47.809497 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:42:47.809497 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:47.809497 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 27 03:42:47.809497 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 27 03:42:47.809497 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 27 03:42:47.809497 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 27 03:42:47.809497 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 27 03:42:47.809497 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 27 03:42:47.809497 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 27 03:42:47.809497 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 27 03:42:47.809497 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 03:42:47.813444 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 03:42:47.813444 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 27 03:42:47.813444 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 27 03:42:47.813444 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 27 03:42:47.813444 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 27 03:42:47.813444 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 03:42:47.813444 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 03:42:47.813444 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 03:42:47.813444 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 03:42:47.813444 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 03:42:47.813444 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 03:42:47.813444 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 03:42:47.813444 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 03:42:47.813444 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f6fb1c63-0afd-491a-bba8-cf579e9d33a7 could not be found. Oct 27 03:42:47.813444 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:42:47.813444 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:42:47.813444 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:42:47.813444 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:47.813444 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:42:47.813444 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:42:47.813444 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:42:47.813444 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:42:47.813444 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:42:47.813444 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:42:47.813444 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:42:47.813444 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:42:47.813444 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 27 03:42:47.813444 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:42:47.813444 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f6fb1c63-0afd-491a-bba8-cf579e9d33a7 could not be found. Oct 27 03:42:47.813444 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:42:47.813444 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:42:47.813444 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:42:47.813444 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:42:47.813444 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:42:47.813444 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:42:47.813444 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:42:47.813444 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:42:47.813444 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f6fb1c63-0afd-491a-bba8-cf579e9d33a7 could not be found. Oct 27 03:42:47.813444 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:42:47.813444 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-01f73d91-ba95-4077-9a1d-de32d3c84221 tempest-VolumesNegativeTest-2037325305 tempest-VolumesNegativeTest-2037325305-project] Returning 404 to user: Volume f6fb1c63-0afd-491a-bba8-cf579e9d33a7 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:42:47.813444 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-01f73d91-ba95-4077-9a1d-de32d3c84221 tempest-VolumesNegativeTest-2037325305 tempest-VolumesNegativeTest-2037325305-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/f6fb1c63-0afd-491a-bba8-cf579e9d33a7" status: 404 len: 109 microversion: 2.1 time: 0.064790 Oct 27 03:42:47.813444 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2714/5137] 10.222.0.20 () {58 vars in 1245 bytes} [Thu Oct 27 03:42:47 2022] GET /compute/v2.1/os-volumes/f6fb1c63-0afd-491a-bba8-cf579e9d33a7 => generated 109 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:42:47.849546 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1f189efa-81c6-4454-8e33-29f6014d6ab2 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:47.850324 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1f189efa-81c6-4454-8e33-29f6014d6ab2 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: ce85aa86-fbba-4eca-97e8-173da3cdc7c3] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:47.863406 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1f189efa-81c6-4454-8e33-29f6014d6ab2 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:47.863928 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1f189efa-81c6-4454-8e33-29f6014d6ab2 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:47.865381 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1f189efa-81c6-4454-8e33-29f6014d6ab2 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:47.866889 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1f189efa-81c6-4454-8e33-29f6014d6ab2 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:47.871998 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1f189efa-81c6-4454-8e33-29f6014d6ab2 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:47.872783 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1f189efa-81c6-4454-8e33-29f6014d6ab2 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:48.163607 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1f189efa-81c6-4454-8e33-29f6014d6ab2 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffc2b1c410149e884a47240b5425e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38450368ef5c4e68ac3c19c7a0a1ce65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:48.177472 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1f189efa-81c6-4454-8e33-29f6014d6ab2 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "GET /compute/v2.1/servers/ce85aa86-fbba-4eca-97e8-173da3cdc7c3" status: 200 len: 1362 microversion: 2.1 time: 0.332513 Oct 27 03:42:48.178129 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2715/5138] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:47 2022] GET /compute/v2.1/servers/ce85aa86-fbba-4eca-97e8-173da3cdc7c3 => generated 1362 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:48.195121 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-51b2dc3d-7b7e-4916-8248-a7fc55e6394e tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:48.196103 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-51b2dc3d-7b7e-4916-8248-a7fc55e6394e tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: dda902a6-dcad-42bf-9b3c-ed716ea0af70] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:48.201638 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=100 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:42:48.203227 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-51b2dc3d-7b7e-4916-8248-a7fc55e6394e tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:48.206655 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-51b2dc3d-7b7e-4916-8248-a7fc55e6394e tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:48.209024 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-51b2dc3d-7b7e-4916-8248-a7fc55e6394e tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:48.211574 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-51b2dc3d-7b7e-4916-8248-a7fc55e6394e tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:48.212068 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-51b2dc3d-7b7e-4916-8248-a7fc55e6394e tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:48.212690 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-51b2dc3d-7b7e-4916-8248-a7fc55e6394e tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:48.475081 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-51b2dc3d-7b7e-4916-8248-a7fc55e6394e tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:48.487939 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-51b2dc3d-7b7e-4916-8248-a7fc55e6394e tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/dda902a6-dcad-42bf-9b3c-ed716ea0af70" status: 200 len: 1522 microversion: 2.1 time: 0.302239 Oct 27 03:42:48.491316 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2716/5139] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:48 2022] GET /compute/v2.1/servers/dda902a6-dcad-42bf-9b3c-ed716ea0af70 => generated 1522 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:48.491767 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-121a0d44-d0fc-4c90-bb23-11cbe3860552 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82daefe001364499b2ee9eb7da2599be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:48.496028 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1408092b-880a-4acb-970d-aebf0119fce9 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:48.499192 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1408092b-880a-4acb-970d-aebf0119fce9 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:48.501935 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-121a0d44-d0fc-4c90-bb23-11cbe3860552 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] 10.222.0.20 "GET /compute/v2.1/servers/20bed685-d855-499c-90d6-f8c59cfbd701" status: 200 len: 1522 microversion: 2.1 time: 0.772639 Oct 27 03:42:48.506160 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2424/5140] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:47 2022] GET /compute/v2.1/servers/20bed685-d855-499c-90d6-f8c59cfbd701 => generated 1522 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:48.511772 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-a4e59df5-d477-4b0f-b461-421e5df5486d req-f6344444-75f3-4123-a158-48d42ce0b754 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce85aa86-fbba-4eca-97e8-173da3cdc7c3", "name": "network-vif-plugged", "status": "completed", "tag": "7a4318fe-6fd1-4b83-9550-ccdb4f022ef2"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:42:48.525322 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1408092b-880a-4acb-970d-aebf0119fce9 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:48.526386 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1408092b-880a-4acb-970d-aebf0119fce9 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:48.527109 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1408092b-880a-4acb-970d-aebf0119fce9 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:48.528132 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1408092b-880a-4acb-970d-aebf0119fce9 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:48.528794 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1408092b-880a-4acb-970d-aebf0119fce9 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:48.529722 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1408092b-880a-4acb-970d-aebf0119fce9 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:48.534635 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-a4e59df5-d477-4b0f-b461-421e5df5486d req-f6344444-75f3-4123-a158-48d42ce0b754 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:48.535957 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-a4e59df5-d477-4b0f-b461-421e5df5486d req-f6344444-75f3-4123-a158-48d42ce0b754 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:48.540119 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-a4e59df5-d477-4b0f-b461-421e5df5486d req-f6344444-75f3-4123-a158-48d42ce0b754 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:48.556285 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-a4e59df5-d477-4b0f-b461-421e5df5486d req-f6344444-75f3-4123-a158-48d42ce0b754 service nova] Creating event network-vif-plugged:7a4318fe-6fd1-4b83-9550-ccdb4f022ef2 for instance ce85aa86-fbba-4eca-97e8-173da3cdc7c3 on n-h1-862769-1 Oct 27 03:42:48.562748 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-a4e59df5-d477-4b0f-b461-421e5df5486d req-f6344444-75f3-4123-a158-48d42ce0b754 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054483 Oct 27 03:42:48.563806 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2425/5141] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:42:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:42:48.596404 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1408092b-880a-4acb-970d-aebf0119fce9 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.105782 Oct 27 03:42:48.597440 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2717/5142] 10.222.0.20 () {60 vars in 1343 bytes} [Thu Oct 27 03:42:48 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 03:42:49.207095 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e341b578-f05e-4ced-b04b-17f735dbe2f6 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:49.207952 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e341b578-f05e-4ced-b04b-17f735dbe2f6 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: ce85aa86-fbba-4eca-97e8-173da3cdc7c3] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:49.221016 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e341b578-f05e-4ced-b04b-17f735dbe2f6 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:49.221755 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e341b578-f05e-4ced-b04b-17f735dbe2f6 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:49.222645 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e341b578-f05e-4ced-b04b-17f735dbe2f6 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:49.222964 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e341b578-f05e-4ced-b04b-17f735dbe2f6 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:49.223434 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e341b578-f05e-4ced-b04b-17f735dbe2f6 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:49.226538 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e341b578-f05e-4ced-b04b-17f735dbe2f6 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:49.482841 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e341b578-f05e-4ced-b04b-17f735dbe2f6 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffc2b1c410149e884a47240b5425e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38450368ef5c4e68ac3c19c7a0a1ce65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:49.492005 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e341b578-f05e-4ced-b04b-17f735dbe2f6 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "GET /compute/v2.1/servers/ce85aa86-fbba-4eca-97e8-173da3cdc7c3" status: 200 len: 1362 microversion: 2.1 time: 0.290227 Oct 27 03:42:49.492674 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2426/5143] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:49 2022] GET /compute/v2.1/servers/ce85aa86-fbba-4eca-97e8-173da3cdc7c3 => generated 1362 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:49.513480 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-db852113-7ecb-43f9-8233-ed4e26f352d1 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:49.514253 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-db852113-7ecb-43f9-8233-ed4e26f352d1 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: dda902a6-dcad-42bf-9b3c-ed716ea0af70] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:49.532157 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-74c561a0-65b4-4d58-83a9-f4b4bd5e6786 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:49.532784 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-74c561a0-65b4-4d58-83a9-f4b4bd5e6786 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] [instance: 20bed685-d855-499c-90d6-f8c59cfbd701] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:49.542027 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-db852113-7ecb-43f9-8233-ed4e26f352d1 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:49.542928 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-db852113-7ecb-43f9-8233-ed4e26f352d1 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:49.544016 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-db852113-7ecb-43f9-8233-ed4e26f352d1 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:49.544951 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-db852113-7ecb-43f9-8233-ed4e26f352d1 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:49.545593 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-db852113-7ecb-43f9-8233-ed4e26f352d1 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:49.546503 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-db852113-7ecb-43f9-8233-ed4e26f352d1 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:49.551836 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-74c561a0-65b4-4d58-83a9-f4b4bd5e6786 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:49.551836 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-74c561a0-65b4-4d58-83a9-f4b4bd5e6786 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:49.552627 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-74c561a0-65b4-4d58-83a9-f4b4bd5e6786 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:49.553483 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-74c561a0-65b4-4d58-83a9-f4b4bd5e6786 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:49.554015 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-74c561a0-65b4-4d58-83a9-f4b4bd5e6786 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:49.554496 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-74c561a0-65b4-4d58-83a9-f4b4bd5e6786 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:49.850694 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-db852113-7ecb-43f9-8233-ed4e26f352d1 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:49.861416 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-db852113-7ecb-43f9-8233-ed4e26f352d1 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/dda902a6-dcad-42bf-9b3c-ed716ea0af70" status: 200 len: 1522 microversion: 2.1 time: 0.351903 Oct 27 03:42:49.867537 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2718/5144] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:49 2022] GET /compute/v2.1/servers/dda902a6-dcad-42bf-9b3c-ed716ea0af70 => generated 1522 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:49.868700 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9b54b7d6-7aac-45a4-840e-67d500927a4d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:49.871111 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-9b54b7d6-7aac-45a4-840e-67d500927a4d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:49.884867 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9b54b7d6-7aac-45a4-840e-67d500927a4d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:49.885961 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9b54b7d6-7aac-45a4-840e-67d500927a4d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:49.886615 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9b54b7d6-7aac-45a4-840e-67d500927a4d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:49.887525 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9b54b7d6-7aac-45a4-840e-67d500927a4d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:49.888149 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9b54b7d6-7aac-45a4-840e-67d500927a4d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:49.888829 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9b54b7d6-7aac-45a4-840e-67d500927a4d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:49.932213 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9b54b7d6-7aac-45a4-840e-67d500927a4d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.068878 Oct 27 03:42:49.933901 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2719/5145] 10.222.0.20 () {60 vars in 1343 bytes} [Thu Oct 27 03:42:49 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 03:42:49.999031 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-74c561a0-65b4-4d58-83a9-f4b4bd5e6786 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82daefe001364499b2ee9eb7da2599be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:50.009114 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-74c561a0-65b4-4d58-83a9-f4b4bd5e6786 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] 10.222.0.20 "GET /compute/v2.1/servers/20bed685-d855-499c-90d6-f8c59cfbd701" status: 200 len: 1522 microversion: 2.1 time: 0.480675 Oct 27 03:42:50.011820 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2427/5146] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:49 2022] GET /compute/v2.1/servers/20bed685-d855-499c-90d6-f8c59cfbd701 => generated 1522 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:42:50.517905 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-fcc35d19-7e35-4502-81d7-fcc38da13ad1 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:50.518721 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-fcc35d19-7e35-4502-81d7-fcc38da13ad1 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: ce85aa86-fbba-4eca-97e8-173da3cdc7c3] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:50.542680 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fcc35d19-7e35-4502-81d7-fcc38da13ad1 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:50.543315 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fcc35d19-7e35-4502-81d7-fcc38da13ad1 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:50.551219 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fcc35d19-7e35-4502-81d7-fcc38da13ad1 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:50.552202 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fcc35d19-7e35-4502-81d7-fcc38da13ad1 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:50.552709 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fcc35d19-7e35-4502-81d7-fcc38da13ad1 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:50.559729 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fcc35d19-7e35-4502-81d7-fcc38da13ad1 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:50.775902 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-fcc35d19-7e35-4502-81d7-fcc38da13ad1 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffc2b1c410149e884a47240b5425e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38450368ef5c4e68ac3c19c7a0a1ce65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:50.787112 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-fcc35d19-7e35-4502-81d7-fcc38da13ad1 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "GET /compute/v2.1/servers/ce85aa86-fbba-4eca-97e8-173da3cdc7c3" status: 200 len: 1547 microversion: 2.1 time: 0.274638 Oct 27 03:42:50.801174 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2720/5147] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:50 2022] GET /compute/v2.1/servers/ce85aa86-fbba-4eca-97e8-173da3cdc7c3 => generated 1547 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:50.812358 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-be1b0c28-c880-48d6-9fa9-d73fb0716ec4 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:50.812358 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-be1b0c28-c880-48d6-9fa9-d73fb0716ec4 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: ce85aa86-fbba-4eca-97e8-173da3cdc7c3] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:50.831371 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-be1b0c28-c880-48d6-9fa9-d73fb0716ec4 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:50.833097 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-be1b0c28-c880-48d6-9fa9-d73fb0716ec4 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:50.833595 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-be1b0c28-c880-48d6-9fa9-d73fb0716ec4 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:50.843161 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-be1b0c28-c880-48d6-9fa9-d73fb0716ec4 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:50.843899 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-be1b0c28-c880-48d6-9fa9-d73fb0716ec4 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:50.849709 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-be1b0c28-c880-48d6-9fa9-d73fb0716ec4 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:50.887162 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1ce320e3-bb70-4c9d-b7f2-4348d217ced0 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:50.887788 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1ce320e3-bb70-4c9d-b7f2-4348d217ced0 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: dda902a6-dcad-42bf-9b3c-ed716ea0af70] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:50.905538 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1ce320e3-bb70-4c9d-b7f2-4348d217ced0 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:50.906197 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1ce320e3-bb70-4c9d-b7f2-4348d217ced0 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:50.911362 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1ce320e3-bb70-4c9d-b7f2-4348d217ced0 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:50.912192 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1ce320e3-bb70-4c9d-b7f2-4348d217ced0 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:50.912707 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1ce320e3-bb70-4c9d-b7f2-4348d217ced0 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:50.913148 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1ce320e3-bb70-4c9d-b7f2-4348d217ced0 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:51.001758 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-be1b0c28-c880-48d6-9fa9-d73fb0716ec4 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "GET /compute/v2.1/servers/ce85aa86-fbba-4eca-97e8-173da3cdc7c3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.194973 Oct 27 03:42:51.002385 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2428/5148] 10.222.0.20 () {58 vars in 1275 bytes} [Thu Oct 27 03:42:50 2022] GET /compute/v2.1/servers/ce85aa86-fbba-4eca-97e8-173da3cdc7c3/os-interface => generated 284 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:42:51.008963 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d6751482-5f42-4d74-976e-428b72624c0b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:51.011766 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d6751482-5f42-4d74-976e-428b72624c0b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:51.027592 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d6751482-5f42-4d74-976e-428b72624c0b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:51.032333 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d6751482-5f42-4d74-976e-428b72624c0b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:51.035505 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d6751482-5f42-4d74-976e-428b72624c0b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:51.035505 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d6751482-5f42-4d74-976e-428b72624c0b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:51.035831 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d6751482-5f42-4d74-976e-428b72624c0b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:51.036275 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d6751482-5f42-4d74-976e-428b72624c0b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:51.084382 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d6751482-5f42-4d74-976e-428b72624c0b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.080781 Oct 27 03:42:51.089469 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2429/5149] 10.222.0.20 () {60 vars in 1343 bytes} [Thu Oct 27 03:42:51 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 03:42:51.134208 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1ce320e3-bb70-4c9d-b7f2-4348d217ced0 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:51.143507 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1ce320e3-bb70-4c9d-b7f2-4348d217ced0 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/dda902a6-dcad-42bf-9b3c-ed716ea0af70" status: 200 len: 1522 microversion: 2.1 time: 0.259026 Oct 27 03:42:51.144105 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2721/5150] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:50 2022] GET /compute/v2.1/servers/dda902a6-dcad-42bf-9b3c-ed716ea0af70 => generated 1522 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:51.165686 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-969e8a81-5423-43e5-a88e-29c56407dc03 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:51.166561 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-969e8a81-5423-43e5-a88e-29c56407dc03 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] [instance: 20bed685-d855-499c-90d6-f8c59cfbd701] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:51.173604 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-969e8a81-5423-43e5-a88e-29c56407dc03 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:51.174386 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-969e8a81-5423-43e5-a88e-29c56407dc03 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:51.174997 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-969e8a81-5423-43e5-a88e-29c56407dc03 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:51.175851 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-969e8a81-5423-43e5-a88e-29c56407dc03 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:51.176590 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-969e8a81-5423-43e5-a88e-29c56407dc03 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:51.177170 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-969e8a81-5423-43e5-a88e-29c56407dc03 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:51.364024 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-969e8a81-5423-43e5-a88e-29c56407dc03 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82daefe001364499b2ee9eb7da2599be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:51.375885 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-969e8a81-5423-43e5-a88e-29c56407dc03 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] 10.222.0.20 "GET /compute/v2.1/servers/20bed685-d855-499c-90d6-f8c59cfbd701" status: 200 len: 1499 microversion: 2.1 time: 0.221561 Oct 27 03:42:51.378773 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2722/5151] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:51 2022] GET /compute/v2.1/servers/20bed685-d855-499c-90d6-f8c59cfbd701 => generated 1499 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:51.406792 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-dcecb57e-eb73-42d6-9f96-0a1f4018e9c1 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:51.413627 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-dcecb57e-eb73-42d6-9f96-0a1f4018e9c1 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '82daefe001364499b2ee9eb7da2599be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:51.415227 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-dcecb57e-eb73-42d6-9f96-0a1f4018e9c1 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf'} {{(pid=121001) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 03:42:51.422964 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dcecb57e-eb73-42d6-9f96-0a1f4018e9c1 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:51.424132 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dcecb57e-eb73-42d6-9f96-0a1f4018e9c1 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:51.424259 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dcecb57e-eb73-42d6-9f96-0a1f4018e9c1 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:51.425618 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dcecb57e-eb73-42d6-9f96-0a1f4018e9c1 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:51.426285 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dcecb57e-eb73-42d6-9f96-0a1f4018e9c1 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:51.426967 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dcecb57e-eb73-42d6-9f96-0a1f4018e9c1 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:51.484270 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.multi_cell_list [None req-dcecb57e-eb73-42d6-9f96-0a1f4018e9c1 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121001) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 03:42:51.556276 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-dcecb57e-eb73-42d6-9f96-0a1f4018e9c1 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] 10.222.0.20 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.154355 Oct 27 03:42:51.559928 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2723/5152] 10.222.0.20 () {58 vars in 1154 bytes} [Thu Oct 27 03:42:51 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:42:51.573005 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f437e840-fc72-4c83-ba7f-ea2d1f186108 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:42:51.587964 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f437e840-fc72-4c83-ba7f-ea2d1f186108 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:51.590595 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f437e840-fc72-4c83-ba7f-ea2d1f186108 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:51.591148 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f437e840-fc72-4c83-ba7f-ea2d1f186108 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:51.613247 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6e379863-fcc6-415a-bd8e-0fe7948111ca tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1991474511", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": [{"uuid": "54013623-5e33-4e24-b0d5-2e92945ee737"}]}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:42:51.645344 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f437e840-fc72-4c83-ba7f-ea2d1f186108 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] [instance: 20bed685-d855-499c-90d6-f8c59cfbd701] Going to try to start instance {{(pid=121001) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 27 03:42:51.703597 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-6e379863-fcc6-415a-bd8e-0fe7948111ca tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] validate_networks() for [('54013623-5e33-4e24-b0d5-2e92945ee737', None, None, None, None, None)] {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:42:51.900663 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f437e840-fc72-4c83-ba7f-ea2d1f186108 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] 10.222.0.20 "POST /compute/v2.1/servers/20bed685-d855-499c-90d6-f8c59cfbd701/action" status: 202 len: 0 microversion: 2.1 time: 0.333771 Oct 27 03:42:51.901499 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2724/5153] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:42:51 2022] POST /compute/v2.1/servers/20bed685-d855-499c-90d6-f8c59cfbd701/action => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 03:42:51.932395 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f7c6a412-283f-412c-a70c-e0539455e7b4 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:51.935581 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f7c6a412-283f-412c-a70c-e0539455e7b4 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] [instance: 20bed685-d855-499c-90d6-f8c59cfbd701] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:51.951842 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f7c6a412-283f-412c-a70c-e0539455e7b4 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:51.952580 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f7c6a412-283f-412c-a70c-e0539455e7b4 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:51.954114 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f7c6a412-283f-412c-a70c-e0539455e7b4 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:51.955191 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f7c6a412-283f-412c-a70c-e0539455e7b4 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:51.956252 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f7c6a412-283f-412c-a70c-e0539455e7b4 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:51.959436 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f7c6a412-283f-412c-a70c-e0539455e7b4 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:52.001025 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:42:52.250414 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f7c6a412-283f-412c-a70c-e0539455e7b4 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82daefe001364499b2ee9eb7da2599be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:52.262409 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f7c6a412-283f-412c-a70c-e0539455e7b4 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] 10.222.0.20 "GET /compute/v2.1/servers/20bed685-d855-499c-90d6-f8c59cfbd701" status: 200 len: 1508 microversion: 2.1 time: 0.346516 Oct 27 03:42:52.273930 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2725/5154] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:51 2022] GET /compute/v2.1/servers/20bed685-d855-499c-90d6-f8c59cfbd701 => generated 1508 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:52.279948 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-dddf8ff4-0d36-4dd1-b52f-f082136b70cb tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:52.285285 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-dddf8ff4-0d36-4dd1-b52f-f082136b70cb tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:52.305882 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dddf8ff4-0d36-4dd1-b52f-f082136b70cb tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:52.306509 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dddf8ff4-0d36-4dd1-b52f-f082136b70cb tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:52.307078 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dddf8ff4-0d36-4dd1-b52f-f082136b70cb tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:52.307790 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dddf8ff4-0d36-4dd1-b52f-f082136b70cb tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:52.308247 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dddf8ff4-0d36-4dd1-b52f-f082136b70cb tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:52.308712 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dddf8ff4-0d36-4dd1-b52f-f082136b70cb tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:52.383360 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-dddf8ff4-0d36-4dd1-b52f-f082136b70cb tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.108132 Oct 27 03:42:52.389355 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2726/5155] 10.222.0.20 () {60 vars in 1343 bytes} [Thu Oct 27 03:42:52 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 03:42:52.399445 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6dc776a1-26c5-4cff-aa82-bd672c94dc7d tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:52.400998 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-6dc776a1-26c5-4cff-aa82-bd672c94dc7d tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: dda902a6-dcad-42bf-9b3c-ed716ea0af70] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:52.418742 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6dc776a1-26c5-4cff-aa82-bd672c94dc7d tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:52.419042 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6dc776a1-26c5-4cff-aa82-bd672c94dc7d tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:52.419597 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6dc776a1-26c5-4cff-aa82-bd672c94dc7d tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:52.420416 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6dc776a1-26c5-4cff-aa82-bd672c94dc7d tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:52.420969 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6dc776a1-26c5-4cff-aa82-bd672c94dc7d tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:52.421573 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6dc776a1-26c5-4cff-aa82-bd672c94dc7d tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:52.868702 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6dc776a1-26c5-4cff-aa82-bd672c94dc7d tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:52.879195 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6dc776a1-26c5-4cff-aa82-bd672c94dc7d tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/dda902a6-dcad-42bf-9b3c-ed716ea0af70" status: 200 len: 1522 microversion: 2.1 time: 0.488646 Oct 27 03:42:52.883116 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2727/5156] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:52 2022] GET /compute/v2.1/servers/dda902a6-dcad-42bf-9b3c-ed716ea0af70 => generated 1522 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:53.295329 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-61168b8a-b8c6-4e59-965a-6b389e91a3fc req-a64fc34f-5c2d-4e01-99c3-d969b3f04464 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce85aa86-fbba-4eca-97e8-173da3cdc7c3", "tag": "7a4318fe-6fd1-4b83-9550-ccdb4f022ef2"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:42:53.318095 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-6e379863-fcc6-415a-bd8e-0fe7948111ca tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:42:53.319210 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-6e379863-fcc6-415a-bd8e-0fe7948111ca tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:42:53.320003 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-6e379863-fcc6-415a-bd8e-0fe7948111ca tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:42:53.320579 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-6e379863-fcc6-415a-bd8e-0fe7948111ca tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:42:53.321112 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-6e379863-fcc6-415a-bd8e-0fe7948111ca tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:42:53.332530 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-61168b8a-b8c6-4e59-965a-6b389e91a3fc req-a64fc34f-5c2d-4e01-99c3-d969b3f04464 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:53.333042 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-61168b8a-b8c6-4e59-965a-6b389e91a3fc req-a64fc34f-5c2d-4e01-99c3-d969b3f04464 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:53.333490 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-61168b8a-b8c6-4e59-965a-6b389e91a3fc req-a64fc34f-5c2d-4e01-99c3-d969b3f04464 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:53.347838 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6e379863-fcc6-415a-bd8e-0fe7948111ca tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:53.350948 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6e379863-fcc6-415a-bd8e-0fe7948111ca tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:53.354271 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6e379863-fcc6-415a-bd8e-0fe7948111ca tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:53.355875 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6e379863-fcc6-415a-bd8e-0fe7948111ca tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:53.356101 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-61168b8a-b8c6-4e59-965a-6b389e91a3fc req-a64fc34f-5c2d-4e01-99c3-d969b3f04464 service nova] Creating event network-changed:7a4318fe-6fd1-4b83-9550-ccdb4f022ef2 for instance ce85aa86-fbba-4eca-97e8-173da3cdc7c3 on n-h1-862769-1 Oct 27 03:42:53.356721 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6e379863-fcc6-415a-bd8e-0fe7948111ca tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:53.358493 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6e379863-fcc6-415a-bd8e-0fe7948111ca tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:53.364151 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-61168b8a-b8c6-4e59-965a-6b389e91a3fc req-a64fc34f-5c2d-4e01-99c3-d969b3f04464 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072943 Oct 27 03:42:53.366366 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2728/5157] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:42:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:42:53.387250 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8167fc45-d776-40ef-a08f-45b609a164a1 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:53.392133 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8167fc45-d776-40ef-a08f-45b609a164a1 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] [instance: 20bed685-d855-499c-90d6-f8c59cfbd701] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:53.406699 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-6e379863-fcc6-415a-bd8e-0fe7948111ca tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Getting quotas for project eb2e83a4c2af45b49c6f23de08547160. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:42:53.421259 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-6e379863-fcc6-415a-bd8e-0fe7948111ca tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Getting quotas for user 9454949c8d794b6093d7d4fc64d12c33 and project eb2e83a4c2af45b49c6f23de08547160. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:42:53.436852 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8167fc45-d776-40ef-a08f-45b609a164a1 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:53.437430 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8167fc45-d776-40ef-a08f-45b609a164a1 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:53.439775 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8167fc45-d776-40ef-a08f-45b609a164a1 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:53.440898 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8167fc45-d776-40ef-a08f-45b609a164a1 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:53.447727 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8167fc45-d776-40ef-a08f-45b609a164a1 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:53.447727 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8167fc45-d776-40ef-a08f-45b609a164a1 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:53.474886 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6e379863-fcc6-415a-bd8e-0fe7948111ca tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:42:53.478816 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6e379863-fcc6-415a-bd8e-0fe7948111ca tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: 55152bbe-5a47-4916-ad12-5f1640f0be61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:42:53.768236 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6e379863-fcc6-415a-bd8e-0fe7948111ca tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.677089 Oct 27 03:42:53.769569 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2430/5158] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:42:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 2679 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 03:42:53.775844 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3aababe3-cb9f-4a99-a4f3-7d3e722b63eb tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:53.778427 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8167fc45-d776-40ef-a08f-45b609a164a1 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82daefe001364499b2ee9eb7da2599be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:53.779057 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-3aababe3-cb9f-4a99-a4f3-7d3e722b63eb tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:53.787176 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3aababe3-cb9f-4a99-a4f3-7d3e722b63eb tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:53.788765 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8167fc45-d776-40ef-a08f-45b609a164a1 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] 10.222.0.20 "GET /compute/v2.1/servers/20bed685-d855-499c-90d6-f8c59cfbd701" status: 200 len: 1508 microversion: 2.1 time: 0.419614 Oct 27 03:42:53.792114 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3aababe3-cb9f-4a99-a4f3-7d3e722b63eb tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:53.792585 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3aababe3-cb9f-4a99-a4f3-7d3e722b63eb tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:53.810749 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3aababe3-cb9f-4a99-a4f3-7d3e722b63eb tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:53.810749 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3aababe3-cb9f-4a99-a4f3-7d3e722b63eb tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:53.810749 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3aababe3-cb9f-4a99-a4f3-7d3e722b63eb tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:53.811073 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2729/5159] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:53 2022] GET /compute/v2.1/servers/20bed685-d855-499c-90d6-f8c59cfbd701 => generated 1508 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:53.826666 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-31b521f9-4682-4b6e-9fa3-3c0d6bab0d00 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:53.830691 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-31b521f9-4682-4b6e-9fa3-3c0d6bab0d00 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: 55152bbe-5a47-4916-ad12-5f1640f0be61] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:53.888804 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3aababe3-cb9f-4a99-a4f3-7d3e722b63eb tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.117713 Oct 27 03:42:53.894714 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2431/5160] 10.222.0.20 () {60 vars in 1343 bytes} [Thu Oct 27 03:42:53 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 03:42:53.911455 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-820d03fa-578f-41c2-9859-eb95a3f2c072 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:53.912864 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-820d03fa-578f-41c2-9859-eb95a3f2c072 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: dda902a6-dcad-42bf-9b3c-ed716ea0af70] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:53.920822 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-820d03fa-578f-41c2-9859-eb95a3f2c072 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:53.921759 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-820d03fa-578f-41c2-9859-eb95a3f2c072 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:53.922559 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-820d03fa-578f-41c2-9859-eb95a3f2c072 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:53.923572 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-820d03fa-578f-41c2-9859-eb95a3f2c072 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:53.924262 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-820d03fa-578f-41c2-9859-eb95a3f2c072 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:53.925224 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-820d03fa-578f-41c2-9859-eb95a3f2c072 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:53.954563 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-31b521f9-4682-4b6e-9fa3-3c0d6bab0d00 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:53.970112 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-31b521f9-4682-4b6e-9fa3-3c0d6bab0d00 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61" status: 200 len: 1218 microversion: 2.1 time: 0.161983 Oct 27 03:42:53.970703 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2730/5161] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:53 2022] GET /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61 => generated 1218 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:54.189033 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-820d03fa-578f-41c2-9859-eb95a3f2c072 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:54.200313 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-820d03fa-578f-41c2-9859-eb95a3f2c072 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/dda902a6-dcad-42bf-9b3c-ed716ea0af70" status: 200 len: 1522 microversion: 2.1 time: 0.296152 Oct 27 03:42:54.203891 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2432/5162] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:53 2022] GET /compute/v2.1/servers/dda902a6-dcad-42bf-9b3c-ed716ea0af70 => generated 1522 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:54.821335 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-53fc30eb-1ea3-47bb-9951-d73be4148fa4 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:54.822463 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-53fc30eb-1ea3-47bb-9951-d73be4148fa4 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] [instance: 20bed685-d855-499c-90d6-f8c59cfbd701] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:54.837146 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-53fc30eb-1ea3-47bb-9951-d73be4148fa4 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:54.837905 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-53fc30eb-1ea3-47bb-9951-d73be4148fa4 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:54.838746 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-53fc30eb-1ea3-47bb-9951-d73be4148fa4 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:54.840691 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-53fc30eb-1ea3-47bb-9951-d73be4148fa4 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:54.843272 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-53fc30eb-1ea3-47bb-9951-d73be4148fa4 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:54.844446 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-53fc30eb-1ea3-47bb-9951-d73be4148fa4 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:54.904042 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-cc4febd1-2411-43e3-8480-b582b4301b23 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:54.907834 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-cc4febd1-2411-43e3-8480-b582b4301b23 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:54.928576 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cc4febd1-2411-43e3-8480-b582b4301b23 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:54.930372 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cc4febd1-2411-43e3-8480-b582b4301b23 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:54.930834 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cc4febd1-2411-43e3-8480-b582b4301b23 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:54.931564 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cc4febd1-2411-43e3-8480-b582b4301b23 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:54.936237 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cc4febd1-2411-43e3-8480-b582b4301b23 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:54.937868 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cc4febd1-2411-43e3-8480-b582b4301b23 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:55.001054 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-cc4febd1-2411-43e3-8480-b582b4301b23 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.103072 Oct 27 03:42:55.006664 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2433/5163] 10.222.0.20 () {60 vars in 1343 bytes} [Thu Oct 27 03:42:54 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 03:42:55.013398 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a4cb65e4-de55-4f9a-922e-306b9c8ed40d tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:55.014381 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a4cb65e4-de55-4f9a-922e-306b9c8ed40d tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: 55152bbe-5a47-4916-ad12-5f1640f0be61] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:55.148101 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-53fc30eb-1ea3-47bb-9951-d73be4148fa4 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82daefe001364499b2ee9eb7da2599be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:55.166794 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-53fc30eb-1ea3-47bb-9951-d73be4148fa4 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] 10.222.0.20 "GET /compute/v2.1/servers/20bed685-d855-499c-90d6-f8c59cfbd701" status: 200 len: 1512 microversion: 2.1 time: 0.348806 Oct 27 03:42:55.200472 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2731/5164] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:54 2022] GET /compute/v2.1/servers/20bed685-d855-499c-90d6-f8c59cfbd701 => generated 1512 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:55.206432 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e96fec04-5572-42cf-92f3-fa844c6b607e tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:55.212695 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e96fec04-5572-42cf-92f3-fa844c6b607e tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '82daefe001364499b2ee9eb7da2599be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:55.215927 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.compute.servers [None req-e96fec04-5572-42cf-92f3-fa844c6b607e tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Removing options 'limit' from query {{(pid=121001) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 27 03:42:55.215927 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e96fec04-5572-42cf-92f3-fa844c6b607e tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Searching by: {'deleted': False, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf'} {{(pid=121001) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 03:42:55.215927 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e96fec04-5572-42cf-92f3-fa844c6b607e tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:55.216421 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e96fec04-5572-42cf-92f3-fa844c6b607e tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:55.216943 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e96fec04-5572-42cf-92f3-fa844c6b607e tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:55.217852 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e96fec04-5572-42cf-92f3-fa844c6b607e tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:55.218575 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e96fec04-5572-42cf-92f3-fa844c6b607e tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:55.219278 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e96fec04-5572-42cf-92f3-fa844c6b607e tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:55.221997 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e96fec04-5572-42cf-92f3-fa844c6b607e tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] 10.222.0.20 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.019158 Oct 27 03:42:55.235084 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2732/5165] 10.222.0.20 () {58 vars in 1140 bytes} [Thu Oct 27 03:42:55 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 03:42:55.242330 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1f93ce18-0ed2-4d43-8873-71f6d79bac80 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:55.243150 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1f93ce18-0ed2-4d43-8873-71f6d79bac80 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: dda902a6-dcad-42bf-9b3c-ed716ea0af70] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:55.251910 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1f93ce18-0ed2-4d43-8873-71f6d79bac80 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:55.252283 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a4cb65e4-de55-4f9a-922e-306b9c8ed40d tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:55.252780 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1f93ce18-0ed2-4d43-8873-71f6d79bac80 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:55.253412 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1f93ce18-0ed2-4d43-8873-71f6d79bac80 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:55.254394 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1f93ce18-0ed2-4d43-8873-71f6d79bac80 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:55.260826 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a4cb65e4-de55-4f9a-922e-306b9c8ed40d tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61" status: 200 len: 1218 microversion: 2.1 time: 0.252802 Oct 27 03:42:55.266394 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2434/5166] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:55 2022] GET /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61 => generated 1218 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:55.271309 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2e659500-fe9f-4938-9594-7192d9345716 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:55.271543 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1f93ce18-0ed2-4d43-8873-71f6d79bac80 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:55.271974 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-2e659500-fe9f-4938-9594-7192d9345716 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] [instance: 20bed685-d855-499c-90d6-f8c59cfbd701] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:55.272476 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1f93ce18-0ed2-4d43-8873-71f6d79bac80 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:55.289071 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2e659500-fe9f-4938-9594-7192d9345716 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:55.290609 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2e659500-fe9f-4938-9594-7192d9345716 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:55.290609 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2e659500-fe9f-4938-9594-7192d9345716 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:55.293196 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2e659500-fe9f-4938-9594-7192d9345716 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:55.293948 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2e659500-fe9f-4938-9594-7192d9345716 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:55.298525 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2e659500-fe9f-4938-9594-7192d9345716 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:55.532479 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1f93ce18-0ed2-4d43-8873-71f6d79bac80 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:55.557431 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1f93ce18-0ed2-4d43-8873-71f6d79bac80 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/dda902a6-dcad-42bf-9b3c-ed716ea0af70" status: 200 len: 1522 microversion: 2.1 time: 0.320938 Oct 27 03:42:55.571322 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2733/5167] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:55 2022] GET /compute/v2.1/servers/dda902a6-dcad-42bf-9b3c-ed716ea0af70 => generated 1522 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:55.707717 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2e659500-fe9f-4938-9594-7192d9345716 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82daefe001364499b2ee9eb7da2599be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:55.739050 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2e659500-fe9f-4938-9594-7192d9345716 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] 10.222.0.20 "GET /compute/v2.1/servers/20bed685-d855-499c-90d6-f8c59cfbd701" status: 200 len: 1512 microversion: 2.1 time: 0.467258 Oct 27 03:42:55.739973 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2435/5168] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:55 2022] GET /compute/v2.1/servers/20bed685-d855-499c-90d6-f8c59cfbd701 => generated 1512 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:55.762714 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-18ec75a4-2973-428b-8f68-584043982208 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:55.763634 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-18ec75a4-2973-428b-8f68-584043982208 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] [instance: 0dd4eda6-95aa-4130-87e5-2986d6b95536] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:55.773924 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-18ec75a4-2973-428b-8f68-584043982208 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:55.774776 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-18ec75a4-2973-428b-8f68-584043982208 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:55.775441 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-18ec75a4-2973-428b-8f68-584043982208 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:55.776408 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-18ec75a4-2973-428b-8f68-584043982208 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:55.777088 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-18ec75a4-2973-428b-8f68-584043982208 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:55.777758 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-18ec75a4-2973-428b-8f68-584043982208 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:56.013275 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-18ec75a4-2973-428b-8f68-584043982208 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82daefe001364499b2ee9eb7da2599be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:56.015702 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c90b5c7c-7383-4fd9-940a-bbcafd13a884 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:56.016988 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c90b5c7c-7383-4fd9-940a-bbcafd13a884 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:56.025318 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-18ec75a4-2973-428b-8f68-584043982208 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] 10.222.0.20 "GET /compute/v2.1/servers/0dd4eda6-95aa-4130-87e5-2986d6b95536" status: 200 len: 1511 microversion: 2.1 time: 0.266785 Oct 27 03:42:56.029458 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2734/5169] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:55 2022] GET /compute/v2.1/servers/0dd4eda6-95aa-4130-87e5-2986d6b95536 => generated 1511 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:56.030737 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c90b5c7c-7383-4fd9-940a-bbcafd13a884 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:56.035848 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c90b5c7c-7383-4fd9-940a-bbcafd13a884 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:56.035848 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c90b5c7c-7383-4fd9-940a-bbcafd13a884 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:56.035848 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c90b5c7c-7383-4fd9-940a-bbcafd13a884 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:56.035848 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c90b5c7c-7383-4fd9-940a-bbcafd13a884 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:56.035848 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c90b5c7c-7383-4fd9-940a-bbcafd13a884 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:56.049966 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1c13f2e1-5f0f-4ca7-9260-cd22af7f67a5 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:56.050912 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1c13f2e1-5f0f-4ca7-9260-cd22af7f67a5 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] [instance: 4634ba00-a353-44a2-b49a-7b1bc2fc7e81] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:56.059086 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1c13f2e1-5f0f-4ca7-9260-cd22af7f67a5 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:56.059556 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1c13f2e1-5f0f-4ca7-9260-cd22af7f67a5 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:56.060230 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1c13f2e1-5f0f-4ca7-9260-cd22af7f67a5 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:56.061135 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1c13f2e1-5f0f-4ca7-9260-cd22af7f67a5 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:56.061759 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1c13f2e1-5f0f-4ca7-9260-cd22af7f67a5 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:56.062411 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1c13f2e1-5f0f-4ca7-9260-cd22af7f67a5 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:56.087539 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:42:56.090304 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c90b5c7c-7383-4fd9-940a-bbcafd13a884 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.079919 Oct 27 03:42:56.091394 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2436/5170] 10.222.0.20 () {60 vars in 1343 bytes} [Thu Oct 27 03:42:56 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79/os-volume_attachments => generated 25 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:42:56.186389 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b915b8ab-c407-4e55-95e8-4cfb5ba5a490 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:56.186963 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b915b8ab-c407-4e55-95e8-4cfb5ba5a490 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:56.200761 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b915b8ab-c407-4e55-95e8-4cfb5ba5a490 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:56.201280 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b915b8ab-c407-4e55-95e8-4cfb5ba5a490 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:56.202570 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b915b8ab-c407-4e55-95e8-4cfb5ba5a490 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:56.203363 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b915b8ab-c407-4e55-95e8-4cfb5ba5a490 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:56.203829 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b915b8ab-c407-4e55-95e8-4cfb5ba5a490 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:56.204265 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b915b8ab-c407-4e55-95e8-4cfb5ba5a490 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:56.239433 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b915b8ab-c407-4e55-95e8-4cfb5ba5a490 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Going to try to terminate instance {{(pid=121000) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:42:56.280597 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1c13f2e1-5f0f-4ca7-9260-cd22af7f67a5 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82daefe001364499b2ee9eb7da2599be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:56.292565 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1c13f2e1-5f0f-4ca7-9260-cd22af7f67a5 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] 10.222.0.20 "GET /compute/v2.1/servers/4634ba00-a353-44a2-b49a-7b1bc2fc7e81" status: 200 len: 1510 microversion: 2.1 time: 0.247014 Oct 27 03:42:56.293792 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2735/5171] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:56 2022] GET /compute/v2.1/servers/4634ba00-a353-44a2-b49a-7b1bc2fc7e81 => generated 1510 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:56.312606 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-349ddd3c-658e-40b9-a145-cd0fccccfcdb tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:56.312606 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-349ddd3c-658e-40b9-a145-cd0fccccfcdb tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: 55152bbe-5a47-4916-ad12-5f1640f0be61] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:56.316912 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-349ddd3c-658e-40b9-a145-cd0fccccfcdb tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:56.317590 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-349ddd3c-658e-40b9-a145-cd0fccccfcdb tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:56.318321 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-349ddd3c-658e-40b9-a145-cd0fccccfcdb tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:56.319149 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-349ddd3c-658e-40b9-a145-cd0fccccfcdb tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:56.319644 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-349ddd3c-658e-40b9-a145-cd0fccccfcdb tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:56.320121 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-349ddd3c-658e-40b9-a145-cd0fccccfcdb tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:56.409297 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-349ddd3c-658e-40b9-a145-cd0fccccfcdb tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:56.418943 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-349ddd3c-658e-40b9-a145-cd0fccccfcdb tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61" status: 200 len: 1270 microversion: 2.1 time: 0.123592 Oct 27 03:42:56.419580 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2736/5172] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:56 2022] GET /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61 => generated 1270 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:56.443297 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b84bdd94-5006-456c-831f-b00760a21dd2 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:56.448803 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b84bdd94-5006-456c-831f-b00760a21dd2 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '82daefe001364499b2ee9eb7da2599be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:56.449489 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b84bdd94-5006-456c-831f-b00760a21dd2 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Searching by: {'ip': '172.20.0.14', 'deleted': False, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf'} {{(pid=121001) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 03:42:56.592557 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b915b8ab-c407-4e55-95e8-4cfb5ba5a490 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79" status: 204 len: 0 microversion: 2.20 time: 0.413028 Oct 27 03:42:56.593163 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2437/5173] 10.222.0.20 () {60 vars in 1280 bytes} [Thu Oct 27 03:42:56 2022] DELETE /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 03:42:56.604567 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-94ab19e1-776a-4196-abdd-47c831fece49 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:56.606099 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-94ab19e1-776a-4196-abdd-47c831fece49 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: dda902a6-dcad-42bf-9b3c-ed716ea0af70] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:56.611046 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b84bdd94-5006-456c-831f-b00760a21dd2 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:56.611880 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b84bdd94-5006-456c-831f-b00760a21dd2 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:56.612968 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-94ab19e1-776a-4196-abdd-47c831fece49 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:56.613114 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b84bdd94-5006-456c-831f-b00760a21dd2 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:56.614059 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-94ab19e1-776a-4196-abdd-47c831fece49 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:56.614958 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-94ab19e1-776a-4196-abdd-47c831fece49 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:56.616238 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b84bdd94-5006-456c-831f-b00760a21dd2 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:56.616569 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-94ab19e1-776a-4196-abdd-47c831fece49 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:56.617010 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b84bdd94-5006-456c-831f-b00760a21dd2 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:56.617797 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-94ab19e1-776a-4196-abdd-47c831fece49 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:56.618472 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-94ab19e1-776a-4196-abdd-47c831fece49 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:56.621232 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b84bdd94-5006-456c-831f-b00760a21dd2 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:56.752630 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.multi_cell_list [None req-b84bdd94-5006-456c-831f-b00760a21dd2 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121001) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 03:42:56.797428 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-94ab19e1-776a-4196-abdd-47c831fece49 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:56.813307 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-94ab19e1-776a-4196-abdd-47c831fece49 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/dda902a6-dcad-42bf-9b3c-ed716ea0af70" status: 200 len: 1522 microversion: 2.1 time: 0.211708 Oct 27 03:42:56.814838 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2438/5174] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:56 2022] GET /compute/v2.1/servers/dda902a6-dcad-42bf-9b3c-ed716ea0af70 => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:56.823886 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-404c7747-3211-49d5-a564-b1d1270eabdd tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:56.824738 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-404c7747-3211-49d5-a564-b1d1270eabdd tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:56.832738 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-404c7747-3211-49d5-a564-b1d1270eabdd tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:56.833507 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-404c7747-3211-49d5-a564-b1d1270eabdd tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:56.834012 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-404c7747-3211-49d5-a564-b1d1270eabdd tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:56.835369 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-404c7747-3211-49d5-a564-b1d1270eabdd tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:56.835885 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-404c7747-3211-49d5-a564-b1d1270eabdd tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:56.836618 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-404c7747-3211-49d5-a564-b1d1270eabdd tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:56.838499 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b84bdd94-5006-456c-831f-b00760a21dd2 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] 10.222.0.20 "GET /compute/v2.1/servers?ip=172.20.0.14" status: 200 len: 345 microversion: 2.1 time: 0.403203 Oct 27 03:42:56.849193 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2737/5175] 10.222.0.20 () {58 vars in 1154 bytes} [Thu Oct 27 03:42:56 2022] GET /compute/v2.1/servers?ip=172.20.0.14 => generated 345 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:42:56.863059 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3bd2770b-87fc-4c50-b1ba-8071668a8074 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:56.864049 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3bd2770b-87fc-4c50-b1ba-8071668a8074 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] [instance: 20bed685-d855-499c-90d6-f8c59cfbd701] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:56.871292 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3bd2770b-87fc-4c50-b1ba-8071668a8074 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:56.872139 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3bd2770b-87fc-4c50-b1ba-8071668a8074 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:56.872895 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3bd2770b-87fc-4c50-b1ba-8071668a8074 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:56.873801 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3bd2770b-87fc-4c50-b1ba-8071668a8074 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:56.874478 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3bd2770b-87fc-4c50-b1ba-8071668a8074 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:56.875240 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3bd2770b-87fc-4c50-b1ba-8071668a8074 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:56.987085 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-404c7747-3211-49d5-a564-b1d1270eabdd tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:56.996404 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-404c7747-3211-49d5-a564-b1d1270eabdd tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:56.997863 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-404c7747-3211-49d5-a564-b1d1270eabdd tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:56.999113 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-404c7747-3211-49d5-a564-b1d1270eabdd tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79" status: 200 len: 1723 microversion: 2.20 time: 0.182991 Oct 27 03:42:56.999689 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2439/5176] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:42:56 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:42:57.116368 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3bd2770b-87fc-4c50-b1ba-8071668a8074 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82daefe001364499b2ee9eb7da2599be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:57.129137 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3bd2770b-87fc-4c50-b1ba-8071668a8074 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] 10.222.0.20 "GET /compute/v2.1/servers/20bed685-d855-499c-90d6-f8c59cfbd701" status: 200 len: 1512 microversion: 2.1 time: 0.265816 Oct 27 03:42:57.129137 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2738/5177] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:56 2022] GET /compute/v2.1/servers/20bed685-d855-499c-90d6-f8c59cfbd701 => generated 1512 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:42:57.147568 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-910b894d-a929-44e9-a7f0-5fc67a9307e3 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:57.148201 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-910b894d-a929-44e9-a7f0-5fc67a9307e3 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] [instance: 0dd4eda6-95aa-4130-87e5-2986d6b95536] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:57.155350 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-910b894d-a929-44e9-a7f0-5fc67a9307e3 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:57.155848 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-910b894d-a929-44e9-a7f0-5fc67a9307e3 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:57.156292 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-910b894d-a929-44e9-a7f0-5fc67a9307e3 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:57.156997 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-910b894d-a929-44e9-a7f0-5fc67a9307e3 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:57.157459 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-910b894d-a929-44e9-a7f0-5fc67a9307e3 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:57.157891 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-910b894d-a929-44e9-a7f0-5fc67a9307e3 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:57.340922 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-910b894d-a929-44e9-a7f0-5fc67a9307e3 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82daefe001364499b2ee9eb7da2599be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:57.349451 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-910b894d-a929-44e9-a7f0-5fc67a9307e3 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] 10.222.0.20 "GET /compute/v2.1/servers/0dd4eda6-95aa-4130-87e5-2986d6b95536" status: 200 len: 1511 microversion: 2.1 time: 0.206228 Oct 27 03:42:57.351398 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2440/5178] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:57 2022] GET /compute/v2.1/servers/0dd4eda6-95aa-4130-87e5-2986d6b95536 => generated 1511 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:57.374651 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4eb2dc9f-5005-4b8d-b5d8-095b8175c3d2 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:57.375409 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4eb2dc9f-5005-4b8d-b5d8-095b8175c3d2 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] [instance: 4634ba00-a353-44a2-b49a-7b1bc2fc7e81] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:57.381483 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4eb2dc9f-5005-4b8d-b5d8-095b8175c3d2 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:57.382060 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4eb2dc9f-5005-4b8d-b5d8-095b8175c3d2 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:57.382593 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4eb2dc9f-5005-4b8d-b5d8-095b8175c3d2 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:57.383366 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4eb2dc9f-5005-4b8d-b5d8-095b8175c3d2 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:57.383886 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4eb2dc9f-5005-4b8d-b5d8-095b8175c3d2 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:57.384324 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4eb2dc9f-5005-4b8d-b5d8-095b8175c3d2 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:57.451676 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a6db88f0-862b-4cd0-b6c7-bdffa4890dce tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:57.452690 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a6db88f0-862b-4cd0-b6c7-bdffa4890dce tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: 55152bbe-5a47-4916-ad12-5f1640f0be61] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:57.461425 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a6db88f0-862b-4cd0-b6c7-bdffa4890dce tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:57.461924 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a6db88f0-862b-4cd0-b6c7-bdffa4890dce tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:57.462395 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a6db88f0-862b-4cd0-b6c7-bdffa4890dce tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:57.463106 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a6db88f0-862b-4cd0-b6c7-bdffa4890dce tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:57.463651 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a6db88f0-862b-4cd0-b6c7-bdffa4890dce tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:57.464000 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a6db88f0-862b-4cd0-b6c7-bdffa4890dce tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:57.541503 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4eb2dc9f-5005-4b8d-b5d8-095b8175c3d2 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82daefe001364499b2ee9eb7da2599be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:57.551895 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4eb2dc9f-5005-4b8d-b5d8-095b8175c3d2 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] 10.222.0.20 "GET /compute/v2.1/servers/4634ba00-a353-44a2-b49a-7b1bc2fc7e81" status: 200 len: 1510 microversion: 2.1 time: 0.180949 Oct 27 03:42:57.552783 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2739/5179] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:57 2022] GET /compute/v2.1/servers/4634ba00-a353-44a2-b49a-7b1bc2fc7e81 => generated 1510 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:57.580306 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8f680b05-399b-493d-af90-b33bf58da3ae tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:57.588233 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8f680b05-399b-493d-af90-b33bf58da3ae tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '82daefe001364499b2ee9eb7da2599be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:57.589132 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8f680b05-399b-493d-af90-b33bf58da3ae tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Searching by: {'deleted': False, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf'} {{(pid=121001) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 03:42:57.595639 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8f680b05-399b-493d-af90-b33bf58da3ae tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:57.596992 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8f680b05-399b-493d-af90-b33bf58da3ae tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:57.597472 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8f680b05-399b-493d-af90-b33bf58da3ae tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:57.598438 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8f680b05-399b-493d-af90-b33bf58da3ae tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:57.598993 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8f680b05-399b-493d-af90-b33bf58da3ae tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:57.599433 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8f680b05-399b-493d-af90-b33bf58da3ae tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:57.651602 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.multi_cell_list [None req-8f680b05-399b-493d-af90-b33bf58da3ae tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=121001) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 03:42:57.715002 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8f680b05-399b-493d-af90-b33bf58da3ae tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82daefe001364499b2ee9eb7da2599be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:57.722574 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8f680b05-399b-493d-af90-b33bf58da3ae tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:57.723065 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8f680b05-399b-493d-af90-b33bf58da3ae tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:57.723509 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8f680b05-399b-493d-af90-b33bf58da3ae tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:57.796263 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a6db88f0-862b-4cd0-b6c7-bdffa4890dce tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:57.805275 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a6db88f0-862b-4cd0-b6c7-bdffa4890dce tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61" status: 200 len: 1270 microversion: 2.1 time: 0.358258 Oct 27 03:42:57.810205 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2441/5180] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:57 2022] GET /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61 => generated 1270 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:42:57.842802 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-de31e1c3-0195-49ce-9d14-4db1e1eb4277 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:57.845594 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-de31e1c3-0195-49ce-9d14-4db1e1eb4277 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: dda902a6-dcad-42bf-9b3c-ed716ea0af70] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:57.851916 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-de31e1c3-0195-49ce-9d14-4db1e1eb4277 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:57.855612 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-de31e1c3-0195-49ce-9d14-4db1e1eb4277 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:57.856301 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-de31e1c3-0195-49ce-9d14-4db1e1eb4277 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:57.857850 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-de31e1c3-0195-49ce-9d14-4db1e1eb4277 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:57.858515 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-de31e1c3-0195-49ce-9d14-4db1e1eb4277 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:57.859749 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-de31e1c3-0195-49ce-9d14-4db1e1eb4277 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:57.889580 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8f680b05-399b-493d-af90-b33bf58da3ae tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] 10.222.0.20 "GET /compute/v2.1/servers/detail" status: 200 len: 4516 microversion: 2.1 time: 0.314603 Oct 27 03:42:57.890355 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2740/5181] 10.222.0.20 () {58 vars in 1146 bytes} [Thu Oct 27 03:42:57 2022] GET /compute/v2.1/servers/detail => generated 4516 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:57.915721 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-fa84123a-c038-45d9-a724-cde9b955815d tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:57.921210 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-fa84123a-c038-45d9-a724-cde9b955815d tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '82daefe001364499b2ee9eb7da2599be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:57.921955 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-fa84123a-c038-45d9-a724-cde9b955815d tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf'} {{(pid=121001) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 03:42:58.004897 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fa84123a-c038-45d9-a724-cde9b955815d tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:58.005600 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fa84123a-c038-45d9-a724-cde9b955815d tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:58.010093 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fa84123a-c038-45d9-a724-cde9b955815d tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:58.010093 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fa84123a-c038-45d9-a724-cde9b955815d tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:58.010093 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fa84123a-c038-45d9-a724-cde9b955815d tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:58.010093 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fa84123a-c038-45d9-a724-cde9b955815d tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:58.044954 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.multi_cell_list [None req-fa84123a-c038-45d9-a724-cde9b955815d tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=121001) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 03:42:58.057946 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-de31e1c3-0195-49ce-9d14-4db1e1eb4277 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:58.066813 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-de31e1c3-0195-49ce-9d14-4db1e1eb4277 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/dda902a6-dcad-42bf-9b3c-ed716ea0af70" status: 200 len: 1522 microversion: 2.1 time: 0.229556 Oct 27 03:42:58.067383 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2442/5182] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:57 2022] GET /compute/v2.1/servers/dda902a6-dcad-42bf-9b3c-ed716ea0af70 => generated 1522 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:58.073448 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4b71a024-064a-4193-adb4-f74f492f61f3 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:58.074084 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4b71a024-064a-4193-adb4-f74f492f61f3 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:58.080279 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4b71a024-064a-4193-adb4-f74f492f61f3 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:58.081055 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4b71a024-064a-4193-adb4-f74f492f61f3 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:58.081691 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4b71a024-064a-4193-adb4-f74f492f61f3 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:58.082603 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4b71a024-064a-4193-adb4-f74f492f61f3 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:58.083214 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4b71a024-064a-4193-adb4-f74f492f61f3 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:58.083802 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4b71a024-064a-4193-adb4-f74f492f61f3 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:58.100496 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-fa84123a-c038-45d9-a724-cde9b955815d tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] 10.222.0.20 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1010 microversion: 2.1 time: 0.187621 Oct 27 03:42:58.101417 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2741/5183] 10.222.0.20 () {58 vars in 1150 bytes} [Thu Oct 27 03:42:57 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1010 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:42:58.128356 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e0e6d9eb-fb68-4de8-9b8d-0e39acb8b62b tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:58.128356 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e0e6d9eb-fb68-4de8-9b8d-0e39acb8b62b tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '82daefe001364499b2ee9eb7da2599be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:58.128356 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e0e6d9eb-fb68-4de8-9b8d-0e39acb8b62b tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf'} {{(pid=121001) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 03:42:58.134537 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e0e6d9eb-fb68-4de8-9b8d-0e39acb8b62b tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:58.135034 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e0e6d9eb-fb68-4de8-9b8d-0e39acb8b62b tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:58.135479 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e0e6d9eb-fb68-4de8-9b8d-0e39acb8b62b tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:58.136219 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e0e6d9eb-fb68-4de8-9b8d-0e39acb8b62b tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:58.136723 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e0e6d9eb-fb68-4de8-9b8d-0e39acb8b62b tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:58.137167 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e0e6d9eb-fb68-4de8-9b8d-0e39acb8b62b tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:58.231229 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.multi_cell_list [None req-e0e6d9eb-fb68-4de8-9b8d-0e39acb8b62b tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=121001) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 03:42:58.279677 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4b71a024-064a-4193-adb4-f74f492f61f3 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:58.288399 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4b71a024-064a-4193-adb4-f74f492f61f3 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:58.290888 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4b71a024-064a-4193-adb4-f74f492f61f3 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:58.291395 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e0e6d9eb-fb68-4de8-9b8d-0e39acb8b62b tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] 10.222.0.20 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1010 microversion: 2.1 time: 0.177890 Oct 27 03:42:58.292238 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2742/5184] 10.222.0.20 () {58 vars in 1212 bytes} [Thu Oct 27 03:42:58 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1010 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:58.292383 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4b71a024-064a-4193-adb4-f74f492f61f3 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79" status: 200 len: 1723 microversion: 2.20 time: 0.222389 Oct 27 03:42:58.293023 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2443/5185] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:42:58 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 => generated 1723 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:42:58.308649 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-fb422fff-15fa-490a-aae5-a9cc5dddb0d7 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:58.313626 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-fb422fff-15fa-490a-aae5-a9cc5dddb0d7 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '82daefe001364499b2ee9eb7da2599be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:58.314346 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-fb422fff-15fa-490a-aae5-a9cc5dddb0d7 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf'} {{(pid=121001) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 03:42:58.320142 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fb422fff-15fa-490a-aae5-a9cc5dddb0d7 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:58.320622 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fb422fff-15fa-490a-aae5-a9cc5dddb0d7 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:58.321060 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fb422fff-15fa-490a-aae5-a9cc5dddb0d7 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:58.321789 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fb422fff-15fa-490a-aae5-a9cc5dddb0d7 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:58.322284 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fb422fff-15fa-490a-aae5-a9cc5dddb0d7 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:58.325810 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fb422fff-15fa-490a-aae5-a9cc5dddb0d7 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:58.391020 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=100 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:42:58.413259 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.multi_cell_list [None req-fb422fff-15fa-490a-aae5-a9cc5dddb0d7 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=121001) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 03:42:58.483644 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-fb422fff-15fa-490a-aae5-a9cc5dddb0d7 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] 10.222.0.20 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1010 microversion: 2.1 time: 0.178809 Oct 27 03:42:58.484246 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2743/5186] 10.222.0.20 () {58 vars in 1196 bytes} [Thu Oct 27 03:42:58 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1010 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:58.497351 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f0f087f2-d0c8-4d80-90ec-6ef19953af3d tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:58.502826 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f0f087f2-d0c8-4d80-90ec-6ef19953af3d tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '82daefe001364499b2ee9eb7da2599be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:58.503591 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f0f087f2-d0c8-4d80-90ec-6ef19953af3d tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Searching by: {'name': '1338804421', 'deleted': False, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf'} {{(pid=121000) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 03:42:58.509320 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f0f087f2-d0c8-4d80-90ec-6ef19953af3d tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:58.509814 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f0f087f2-d0c8-4d80-90ec-6ef19953af3d tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:58.510281 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f0f087f2-d0c8-4d80-90ec-6ef19953af3d tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:58.511201 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f0f087f2-d0c8-4d80-90ec-6ef19953af3d tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:58.511651 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f0f087f2-d0c8-4d80-90ec-6ef19953af3d tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:58.512386 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f0f087f2-d0c8-4d80-90ec-6ef19953af3d tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:58.598920 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.multi_cell_list [None req-f0f087f2-d0c8-4d80-90ec-6ef19953af3d tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121000) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 03:42:58.658779 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f0f087f2-d0c8-4d80-90ec-6ef19953af3d tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] 10.222.0.20 "GET /compute/v2.1/servers?name=1338804421" status: 200 len: 346 microversion: 2.1 time: 0.165308 Oct 27 03:42:58.659278 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2444/5187] 10.222.0.20 () {58 vars in 1156 bytes} [Thu Oct 27 03:42:58 2022] GET /compute/v2.1/servers?name=1338804421 => generated 346 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:42:58.672562 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-acbb8833-9473-44a4-80e7-b52359d9d768 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:58.677487 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-acbb8833-9473-44a4-80e7-b52359d9d768 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '82daefe001364499b2ee9eb7da2599be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:58.680836 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-acbb8833-9473-44a4-80e7-b52359d9d768 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf'} {{(pid=121001) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 03:42:58.684347 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-acbb8833-9473-44a4-80e7-b52359d9d768 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:58.684628 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-acbb8833-9473-44a4-80e7-b52359d9d768 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:58.685034 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-acbb8833-9473-44a4-80e7-b52359d9d768 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:58.685760 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-acbb8833-9473-44a4-80e7-b52359d9d768 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:58.686243 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-acbb8833-9473-44a4-80e7-b52359d9d768 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:58.686670 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-acbb8833-9473-44a4-80e7-b52359d9d768 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:58.778746 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.multi_cell_list [None req-acbb8833-9473-44a4-80e7-b52359d9d768 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=121001) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 03:42:58.829363 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ed5ee60e-279b-4c02-8094-9292aa6ed444 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:58.830000 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ed5ee60e-279b-4c02-8094-9292aa6ed444 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: 55152bbe-5a47-4916-ad12-5f1640f0be61] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:58.839313 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-acbb8833-9473-44a4-80e7-b52359d9d768 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] 10.222.0.20 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1010 microversion: 2.1 time: 0.170667 Oct 27 03:42:58.840228 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2744/5188] 10.222.0.20 () {58 vars in 1154 bytes} [Thu Oct 27 03:42:58 2022] GET /compute/v2.1/servers?name=-instance => generated 1010 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:58.842283 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ed5ee60e-279b-4c02-8094-9292aa6ed444 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:58.843120 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ed5ee60e-279b-4c02-8094-9292aa6ed444 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:58.844324 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ed5ee60e-279b-4c02-8094-9292aa6ed444 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:58.853829 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ed5ee60e-279b-4c02-8094-9292aa6ed444 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:58.853829 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ed5ee60e-279b-4c02-8094-9292aa6ed444 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:58.853829 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ed5ee60e-279b-4c02-8094-9292aa6ed444 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:58.861801 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a92b353d-2422-4b6b-9ff7-3787570a633e tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:58.867497 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a92b353d-2422-4b6b-9ff7-3787570a633e tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '82daefe001364499b2ee9eb7da2599be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:58.868206 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a92b353d-2422-4b6b-9ff7-3787570a633e tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-133880442', 'deleted': False, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf'} {{(pid=121001) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 03:42:58.874914 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a92b353d-2422-4b6b-9ff7-3787570a633e tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:58.877460 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a92b353d-2422-4b6b-9ff7-3787570a633e tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:58.877460 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a92b353d-2422-4b6b-9ff7-3787570a633e tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:58.877460 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a92b353d-2422-4b6b-9ff7-3787570a633e tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:58.877460 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a92b353d-2422-4b6b-9ff7-3787570a633e tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:58.877833 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a92b353d-2422-4b6b-9ff7-3787570a633e tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:58.930059 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ed5ee60e-279b-4c02-8094-9292aa6ed444 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:58.938520 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ed5ee60e-279b-4c02-8094-9292aa6ed444 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61" status: 200 len: 1278 microversion: 2.1 time: 0.113618 Oct 27 03:42:58.939433 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2445/5189] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:58 2022] GET /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61 => generated 1278 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:42:58.966734 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.multi_cell_list [None req-a92b353d-2422-4b6b-9ff7-3787570a633e tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121001) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 03:42:59.026060 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a92b353d-2422-4b6b-9ff7-3787570a633e tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] 10.222.0.20 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-133880442" status: 200 len: 346 microversion: 2.1 time: 0.171127 Oct 27 03:42:59.029897 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2745/5190] 10.222.0.20 () {58 vars in 1228 bytes} [Thu Oct 27 03:42:58 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-133880442 => generated 346 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:42:59.040200 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c8b17ab8-b449-47fa-a8ce-a98574ab2b14 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:59.040709 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c8b17ab8-b449-47fa-a8ce-a98574ab2b14 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] [instance: 4634ba00-a353-44a2-b49a-7b1bc2fc7e81] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:59.046844 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c8b17ab8-b449-47fa-a8ce-a98574ab2b14 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:59.047359 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c8b17ab8-b449-47fa-a8ce-a98574ab2b14 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:59.047785 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c8b17ab8-b449-47fa-a8ce-a98574ab2b14 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:59.048498 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c8b17ab8-b449-47fa-a8ce-a98574ab2b14 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:59.048965 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c8b17ab8-b449-47fa-a8ce-a98574ab2b14 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:59.049394 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c8b17ab8-b449-47fa-a8ce-a98574ab2b14 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:59.074524 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c8b17ab8-b449-47fa-a8ce-a98574ab2b14 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] [instance: 4634ba00-a353-44a2-b49a-7b1bc2fc7e81] Going to try to terminate instance {{(pid=121000) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:42:59.091330 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3cceb4d2-226c-4825-a844-cbfc2015b7ea tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:59.091968 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3cceb4d2-226c-4825-a844-cbfc2015b7ea tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: dda902a6-dcad-42bf-9b3c-ed716ea0af70] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:59.097927 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3cceb4d2-226c-4825-a844-cbfc2015b7ea tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:59.098453 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3cceb4d2-226c-4825-a844-cbfc2015b7ea tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:59.098907 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3cceb4d2-226c-4825-a844-cbfc2015b7ea tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:59.099609 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3cceb4d2-226c-4825-a844-cbfc2015b7ea tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:59.100623 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3cceb4d2-226c-4825-a844-cbfc2015b7ea tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:59.101067 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3cceb4d2-226c-4825-a844-cbfc2015b7ea tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:59.260409 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3cceb4d2-226c-4825-a844-cbfc2015b7ea tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:59.268605 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3cceb4d2-226c-4825-a844-cbfc2015b7ea tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/dda902a6-dcad-42bf-9b3c-ed716ea0af70" status: 200 len: 1522 microversion: 2.1 time: 0.181051 Oct 27 03:42:59.269202 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2746/5191] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:59 2022] GET /compute/v2.1/servers/dda902a6-dcad-42bf-9b3c-ed716ea0af70 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:42:59.313801 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c8b17ab8-b449-47fa-a8ce-a98574ab2b14 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4634ba00-a353-44a2-b49a-7b1bc2fc7e81" status: 204 len: 0 microversion: 2.1 time: 0.277303 Oct 27 03:42:59.314589 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2446/5192] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:42:59 2022] DELETE /compute/v2.1/servers/4634ba00-a353-44a2-b49a-7b1bc2fc7e81 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:42:59.323012 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-cc7f52c8-b33a-411c-bd83-38a2d837c675 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:59.324037 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-cc7f52c8-b33a-411c-bd83-38a2d837c675 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:59.324808 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-fc8bb571-89b3-4430-a92d-406bb8022318 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:59.325518 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-fc8bb571-89b3-4430-a92d-406bb8022318 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] [instance: 4634ba00-a353-44a2-b49a-7b1bc2fc7e81] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:59.332078 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cc7f52c8-b33a-411c-bd83-38a2d837c675 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:59.333648 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cc7f52c8-b33a-411c-bd83-38a2d837c675 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:59.335369 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cc7f52c8-b33a-411c-bd83-38a2d837c675 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:59.336303 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cc7f52c8-b33a-411c-bd83-38a2d837c675 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:59.336889 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fc8bb571-89b3-4430-a92d-406bb8022318 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:59.337173 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cc7f52c8-b33a-411c-bd83-38a2d837c675 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:59.337821 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cc7f52c8-b33a-411c-bd83-38a2d837c675 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:59.338221 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fc8bb571-89b3-4430-a92d-406bb8022318 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:59.338784 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fc8bb571-89b3-4430-a92d-406bb8022318 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:59.340215 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fc8bb571-89b3-4430-a92d-406bb8022318 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:59.340739 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fc8bb571-89b3-4430-a92d-406bb8022318 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:59.341177 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fc8bb571-89b3-4430-a92d-406bb8022318 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:59.632071 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-cc7f52c8-b33a-411c-bd83-38a2d837c675 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:59.644673 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-cc7f52c8-b33a-411c-bd83-38a2d837c675 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:59.647039 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-cc7f52c8-b33a-411c-bd83-38a2d837c675 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:59.651132 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-cc7f52c8-b33a-411c-bd83-38a2d837c675 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79" status: 200 len: 1723 microversion: 2.20 time: 0.333179 Oct 27 03:42:59.651132 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2747/5193] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:42:59 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 => generated 1723 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:42:59.696212 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-fc8bb571-89b3-4430-a92d-406bb8022318 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82daefe001364499b2ee9eb7da2599be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:42:59.705793 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-fc8bb571-89b3-4430-a92d-406bb8022318 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] 10.222.0.20 "GET /compute/v2.1/servers/4634ba00-a353-44a2-b49a-7b1bc2fc7e81" status: 200 len: 1516 microversion: 2.1 time: 0.385529 Oct 27 03:42:59.726420 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2447/5194] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:59 2022] GET /compute/v2.1/servers/4634ba00-a353-44a2-b49a-7b1bc2fc7e81 => generated 1516 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:42:59.964939 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-13103e28-be41-48ba-b344-754b8b91e246 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:42:59.965869 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-13103e28-be41-48ba-b344-754b8b91e246 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: 55152bbe-5a47-4916-ad12-5f1640f0be61] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:42:59.981999 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-13103e28-be41-48ba-b344-754b8b91e246 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:59.982455 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-13103e28-be41-48ba-b344-754b8b91e246 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:59.982898 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-13103e28-be41-48ba-b344-754b8b91e246 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:42:59.984716 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-13103e28-be41-48ba-b344-754b8b91e246 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:42:59.985409 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-13103e28-be41-48ba-b344-754b8b91e246 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:42:59.986061 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-13103e28-be41-48ba-b344-754b8b91e246 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:00.109932 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-13103e28-be41-48ba-b344-754b8b91e246 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:00.109932 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-13103e28-be41-48ba-b344-754b8b91e246 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61" status: 200 len: 1276 microversion: 2.1 time: 0.143165 Oct 27 03:43:00.109932 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2748/5195] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:42:59 2022] GET /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61 => generated 1276 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:43:00.294390 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8faf0a56-ce71-4ae5-8311-ee5cbdc64f6b tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:00.295442 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8faf0a56-ce71-4ae5-8311-ee5cbdc64f6b tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: dda902a6-dcad-42bf-9b3c-ed716ea0af70] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:00.302535 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8faf0a56-ce71-4ae5-8311-ee5cbdc64f6b tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:00.305249 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8faf0a56-ce71-4ae5-8311-ee5cbdc64f6b tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:00.309099 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8faf0a56-ce71-4ae5-8311-ee5cbdc64f6b tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:00.310747 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8faf0a56-ce71-4ae5-8311-ee5cbdc64f6b tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:00.311563 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8faf0a56-ce71-4ae5-8311-ee5cbdc64f6b tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:00.312241 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8faf0a56-ce71-4ae5-8311-ee5cbdc64f6b tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:00.577293 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8faf0a56-ce71-4ae5-8311-ee5cbdc64f6b tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:00.590225 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8faf0a56-ce71-4ae5-8311-ee5cbdc64f6b tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/dda902a6-dcad-42bf-9b3c-ed716ea0af70" status: 200 len: 1522 microversion: 2.1 time: 0.300735 Oct 27 03:43:00.591517 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2448/5196] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:43:00 2022] GET /compute/v2.1/servers/dda902a6-dcad-42bf-9b3c-ed716ea0af70 => generated 1522 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:43:00.680963 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-88f43424-7f89-45f0-909d-13261aad8f2a tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:00.681764 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-88f43424-7f89-45f0-909d-13261aad8f2a tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:00.695680 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-0d2c0bc9-86b3-40c8-8cdc-fece840ab772 req-f870bca8-85d8-42f6-b30d-479748c3dd9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6854d7f3-0f6d-45c2-b46d-a5dc2922fe79", "name": "network-vif-deleted", "tag": "425e1d50-5b4c-44cd-a54b-de48e280a305"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:43:00.705036 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-88f43424-7f89-45f0-909d-13261aad8f2a tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:00.706236 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-88f43424-7f89-45f0-909d-13261aad8f2a tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:00.706760 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-88f43424-7f89-45f0-909d-13261aad8f2a tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:00.707535 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-88f43424-7f89-45f0-909d-13261aad8f2a tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:00.708011 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-88f43424-7f89-45f0-909d-13261aad8f2a tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:00.708451 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-88f43424-7f89-45f0-909d-13261aad8f2a tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:00.716328 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-0d2c0bc9-86b3-40c8-8cdc-fece840ab772 req-f870bca8-85d8-42f6-b30d-479748c3dd9c service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:00.716841 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-0d2c0bc9-86b3-40c8-8cdc-fece840ab772 req-f870bca8-85d8-42f6-b30d-479748c3dd9c service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:00.717368 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-0d2c0bc9-86b3-40c8-8cdc-fece840ab772 req-f870bca8-85d8-42f6-b30d-479748c3dd9c service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:00.754735 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-0d2c0bc9-86b3-40c8-8cdc-fece840ab772 req-f870bca8-85d8-42f6-b30d-479748c3dd9c service nova] Creating event network-vif-deleted:425e1d50-5b4c-44cd-a54b-de48e280a305 for instance 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 on n-h1-862769-1 Oct 27 03:43:00.768409 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-0d2c0bc9-86b3-40c8-8cdc-fece840ab772 req-f870bca8-85d8-42f6-b30d-479748c3dd9c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075066 Oct 27 03:43:00.776395 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2449/5197] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:43:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:43:00.787711 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-771ccff4-c6bf-4c34-a145-c7026249cc86 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:00.793438 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-771ccff4-c6bf-4c34-a145-c7026249cc86 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] [instance: 4634ba00-a353-44a2-b49a-7b1bc2fc7e81] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:00.816623 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-771ccff4-c6bf-4c34-a145-c7026249cc86 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:00.817134 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-771ccff4-c6bf-4c34-a145-c7026249cc86 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:00.818008 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-771ccff4-c6bf-4c34-a145-c7026249cc86 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:00.837985 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-771ccff4-c6bf-4c34-a145-c7026249cc86 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:00.838489 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-771ccff4-c6bf-4c34-a145-c7026249cc86 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:00.839397 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-771ccff4-c6bf-4c34-a145-c7026249cc86 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:00.900448 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:43:00.944022 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-88f43424-7f89-45f0-909d-13261aad8f2a tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:00.977888 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-88f43424-7f89-45f0-909d-13261aad8f2a tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:00.979714 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-88f43424-7f89-45f0-909d-13261aad8f2a tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:00.983745 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-88f43424-7f89-45f0-909d-13261aad8f2a tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79" status: 200 len: 1655 microversion: 2.20 time: 0.308117 Oct 27 03:43:00.991590 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2749/5198] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:43:00 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 => generated 1655 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:43:01.104324 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-771ccff4-c6bf-4c34-a145-c7026249cc86 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82daefe001364499b2ee9eb7da2599be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:01.111271 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-771ccff4-c6bf-4c34-a145-c7026249cc86 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] 10.222.0.20 "GET /compute/v2.1/servers/4634ba00-a353-44a2-b49a-7b1bc2fc7e81" status: 200 len: 1516 microversion: 2.1 time: 0.333577 Oct 27 03:43:01.111853 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2450/5199] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:43:00 2022] GET /compute/v2.1/servers/4634ba00-a353-44a2-b49a-7b1bc2fc7e81 => generated 1516 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:43:01.142424 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e4569183-0a13-400d-9201-a1f8bd0c4456 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:01.142424 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e4569183-0a13-400d-9201-a1f8bd0c4456 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: 55152bbe-5a47-4916-ad12-5f1640f0be61] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:01.147904 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e4569183-0a13-400d-9201-a1f8bd0c4456 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:01.149658 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e4569183-0a13-400d-9201-a1f8bd0c4456 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:01.150257 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e4569183-0a13-400d-9201-a1f8bd0c4456 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:01.151121 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e4569183-0a13-400d-9201-a1f8bd0c4456 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:01.151789 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e4569183-0a13-400d-9201-a1f8bd0c4456 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:01.152848 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e4569183-0a13-400d-9201-a1f8bd0c4456 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:01.547249 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e4569183-0a13-400d-9201-a1f8bd0c4456 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:01.559400 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e4569183-0a13-400d-9201-a1f8bd0c4456 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61" status: 200 len: 1318 microversion: 2.1 time: 0.431301 Oct 27 03:43:01.560048 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2750/5200] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:43:01 2022] GET /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61 => generated 1318 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:43:01.614228 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-cec560e5-ba07-4ecc-9b72-41b729d1e567 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:01.616068 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-cec560e5-ba07-4ecc-9b72-41b729d1e567 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: dda902a6-dcad-42bf-9b3c-ed716ea0af70] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:01.631498 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cec560e5-ba07-4ecc-9b72-41b729d1e567 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:01.631984 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cec560e5-ba07-4ecc-9b72-41b729d1e567 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:01.632429 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cec560e5-ba07-4ecc-9b72-41b729d1e567 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:01.633153 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cec560e5-ba07-4ecc-9b72-41b729d1e567 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:01.633621 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cec560e5-ba07-4ecc-9b72-41b729d1e567 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:01.634094 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cec560e5-ba07-4ecc-9b72-41b729d1e567 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:01.877769 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-cec560e5-ba07-4ecc-9b72-41b729d1e567 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:01.893366 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-cec560e5-ba07-4ecc-9b72-41b729d1e567 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/dda902a6-dcad-42bf-9b3c-ed716ea0af70" status: 200 len: 1502 microversion: 2.1 time: 0.283054 Oct 27 03:43:01.898358 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2451/5201] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:43:01 2022] GET /compute/v2.1/servers/dda902a6-dcad-42bf-9b3c-ed716ea0af70 => generated 1502 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:43:01.923214 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-169362a1-b934-422c-a4d5-412c555c7d1c tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eadd88ee-656b-446a-8023-383f448d8d76"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:43:01.925736 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-169362a1-b934-422c-a4d5-412c555c7d1c tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: dda902a6-dcad-42bf-9b3c-ed716ea0af70] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:01.941773 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-169362a1-b934-422c-a4d5-412c555c7d1c tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:01.942807 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-169362a1-b934-422c-a4d5-412c555c7d1c tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:01.944813 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-169362a1-b934-422c-a4d5-412c555c7d1c tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:01.948162 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-169362a1-b934-422c-a4d5-412c555c7d1c tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:01.950564 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-169362a1-b934-422c-a4d5-412c555c7d1c tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:01.952764 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-169362a1-b934-422c-a4d5-412c555c7d1c tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:02.019581 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-99f1e416-1b4e-4b20-ad09-ef2de6a48e46 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:02.020111 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-99f1e416-1b4e-4b20-ad09-ef2de6a48e46 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:02.023221 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-169362a1-b934-422c-a4d5-412c555c7d1c tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] HTTP exception thrown: Cannot 'attach_volume' instance dda902a6-dcad-42bf-9b3c-ed716ea0af70 while it is in vm_state rescued Oct 27 03:43:02.029843 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-169362a1-b934-422c-a4d5-412c555c7d1c tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Request method failure captured: Oct 27 03:43:02.029843 n-d-862769-1 devstack@n-api.service[121001]: request: POST /compute/v2.1/servers/dda902a6-dcad-42bf-9b3c-ed716ea0af70/os-volume_attachments HTTP/1.1 Oct 27 03:43:02.029843 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:43:02.029843 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:43:02.029843 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:43:02.029843 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 74 Oct 27 03:43:02.029843 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:43:02.029843 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:43:02.029843 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:43:02.029843 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:43:02.029843 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWf3uUTnEN6JEj9qTF9cAY0BLnY-YCL30UQa3hBWeUb1dNx6UaDGQTlfRNfawcK1WUPI3AVcIhTKI_7viSsI0VCiS7DswtiywtZ-RbWwufMeio2Ivv3GBrhAaC4UKKUNrtl6wYtdRVU_yfZaWJd2e4jOiCo3IliQOw95nmGOg5mVlF04 Oct 27 03:43:02.029843 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:43:02.029843 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:43:02.029843 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:43:02.029843 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:43:02.029843 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:43:02.029843 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:43:02.029843 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: e1f3ed7ef6c648c9ac771fbaadde1d0c Oct 27 03:43:02.029843 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-143118573 Oct 27 03:43:02.029843 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:43:02.029843 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:43:02.029843 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e1f3ed7ef6c648c9ac771fbaadde1d0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e1f3ed7ef6c648c9ac771fbaadde1d0c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e1f3ed7ef6c648c9ac771fbaadde1d0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e1f3ed7ef6c648c9ac771fbaadde1d0c"}]}] Oct 27 03:43:02.029843 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServerRescueNegativeTestJSON-143118573 Oct 27 03:43:02.029843 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: e1f3ed7ef6c648c9ac771fbaadde1d0c Oct 27 03:43:02.029843 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-143118573 Oct 27 03:43:02.029843 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServerRescueNegativeTestJSON-143118573-project Oct 27 03:43:02.029843 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:43:02.029843 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:43:02.029843 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 43172c9e71704c869a25181574d67b35 Oct 27 03:43:02.029843 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServerRescueNegativeTestJSON-143118573-project Oct 27 03:43:02.029843 n-d-862769-1 devstack@n-api.service[121001]: Oct 27 03:43:02.029843 n-d-862769-1 devstack@n-api.service[121001]: {"volumeAttachment": {"volumeId": "eadd88ee-656b-446a-8023-383f448d8d76"}} Oct 27 03:43:02.029843 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:43:02.029843 n-d-862769-1 devstack@n-api.service[121001]: exception: Cannot 'attach_volume' instance dda902a6-dcad-42bf-9b3c-ed716ea0af70 while it is in vm_state rescued Oct 27 03:43:02.029843 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'server_id': 'dda902a6-dcad-42bf-9b3c-ed716ea0af70', 'body': {'volumeAttachment': {'volumeId': 'eadd88ee-656b-446a-8023-383f448d8d76'}}} Oct 27 03:43:02.029843 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:43:02.029843 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:43:02.029843 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 27 03:43:02.029843 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 27 03:43:02.029843 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 03:43:02.029843 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 03:43:02.029843 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 27 03:43:02.029843 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 27 03:43:02.029843 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance dda902a6-dcad-42bf-9b3c-ed716ea0af70 in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 27 03:43:02.029843 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:43:02.029843 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:43:02.029843 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:43:02.029843 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:43:02.029843 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:43:02.029843 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:43:02.029843 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:43:02.029843 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:43:02.029843 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:43:02.029843 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:43:02.029843 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:43:02.029843 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:43:02.029843 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:43:02.029843 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:43:02.029843 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:43:02.029843 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:43:02.029843 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 27 03:43:02.029843 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 27 03:43:02.033988 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 27 03:43:02.033988 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 27 03:43:02.033988 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance dda902a6-dcad-42bf-9b3c-ed716ea0af70 while it is in vm_state rescued Oct 27 03:43:02.033988 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:43:02.033988 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:43:02.033988 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:43:02.033988 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:43:02.033988 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:43:02.033988 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:43:02.033988 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:43:02.033988 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:43:02.033988 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance dda902a6-dcad-42bf-9b3c-ed716ea0af70 while it is in vm_state rescued Oct 27 03:43:02.033988 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:43:02.038579 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-99f1e416-1b4e-4b20-ad09-ef2de6a48e46 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:02.038872 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-169362a1-b934-422c-a4d5-412c555c7d1c tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Returning 409 to user: Cannot 'attach_volume' instance dda902a6-dcad-42bf-9b3c-ed716ea0af70 while it is in vm_state rescued {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:43:02.039674 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-99f1e416-1b4e-4b20-ad09-ef2de6a48e46 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:02.041390 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-169362a1-b934-422c-a4d5-412c555c7d1c tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "POST /compute/v2.1/servers/dda902a6-dcad-42bf-9b3c-ed716ea0af70/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.121986 Oct 27 03:43:02.042199 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2751/5202] 10.222.0.20 () {60 vars in 1323 bytes} [Thu Oct 27 03:43:01 2022] POST /compute/v2.1/servers/dda902a6-dcad-42bf-9b3c-ed716ea0af70/os-volume_attachments => generated 152 bytes in 124 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 27 03:43:02.044230 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-99f1e416-1b4e-4b20-ad09-ef2de6a48e46 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:02.045057 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-99f1e416-1b4e-4b20-ad09-ef2de6a48e46 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:02.045546 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-99f1e416-1b4e-4b20-ad09-ef2de6a48e46 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:02.046311 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-99f1e416-1b4e-4b20-ad09-ef2de6a48e46 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:02.055689 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-aa9312c6-3d85-4f4a-a12d-dc17c10a30c3 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:43:02.061681 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-aa9312c6-3d85-4f4a-a12d-dc17c10a30c3 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: dda902a6-dcad-42bf-9b3c-ed716ea0af70] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:02.076892 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aa9312c6-3d85-4f4a-a12d-dc17c10a30c3 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:02.078874 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aa9312c6-3d85-4f4a-a12d-dc17c10a30c3 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:02.080132 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aa9312c6-3d85-4f4a-a12d-dc17c10a30c3 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:02.081045 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aa9312c6-3d85-4f4a-a12d-dc17c10a30c3 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:02.083192 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aa9312c6-3d85-4f4a-a12d-dc17c10a30c3 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:02.084728 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aa9312c6-3d85-4f4a-a12d-dc17c10a30c3 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:02.135831 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-99f1e416-1b4e-4b20-ad09-ef2de6a48e46 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:02.136329 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-99f1e416-1b4e-4b20-ad09-ef2de6a48e46 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:02.136776 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-99f1e416-1b4e-4b20-ad09-ef2de6a48e46 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:02.137331 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-99f1e416-1b4e-4b20-ad09-ef2de6a48e46 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lazy-loading 'fault' on Instance uuid 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:43:02.202413 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-99f1e416-1b4e-4b20-ad09-ef2de6a48e46 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:02.214054 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-99f1e416-1b4e-4b20-ad09-ef2de6a48e46 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:02.215915 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-99f1e416-1b4e-4b20-ad09-ef2de6a48e46 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:02.217343 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-99f1e416-1b4e-4b20-ad09-ef2de6a48e46 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79" status: 200 len: 1369 microversion: 2.20 time: 0.203036 Oct 27 03:43:02.218530 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2452/5203] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:43:02 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 => generated 1369 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:43:02.223765 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2c6bc219-f667-454f-a276-841ddfe0486f tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:02.224693 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-2c6bc219-f667-454f-a276-841ddfe0486f tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] [instance: 4634ba00-a353-44a2-b49a-7b1bc2fc7e81] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:02.238196 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2c6bc219-f667-454f-a276-841ddfe0486f tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:02.238979 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2c6bc219-f667-454f-a276-841ddfe0486f tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:02.239620 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2c6bc219-f667-454f-a276-841ddfe0486f tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:02.240528 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2c6bc219-f667-454f-a276-841ddfe0486f tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:02.240968 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2c6bc219-f667-454f-a276-841ddfe0486f tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:02.241439 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2c6bc219-f667-454f-a276-841ddfe0486f tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:02.335988 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-aa9312c6-3d85-4f4a-a12d-dc17c10a30c3 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "POST /compute/v2.1/servers/dda902a6-dcad-42bf-9b3c-ed716ea0af70/action" status: 202 len: 0 microversion: 2.1 time: 0.287864 Oct 27 03:43:02.350761 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2752/5204] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:43:02 2022] POST /compute/v2.1/servers/dda902a6-dcad-42bf-9b3c-ed716ea0af70/action => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:43:02.364238 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-769134f1-d8f8-4c50-b289-18c932a37042 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:02.366891 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-769134f1-d8f8-4c50-b289-18c932a37042 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: dda902a6-dcad-42bf-9b3c-ed716ea0af70] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:02.388116 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-769134f1-d8f8-4c50-b289-18c932a37042 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:02.389130 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-769134f1-d8f8-4c50-b289-18c932a37042 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:02.389595 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-769134f1-d8f8-4c50-b289-18c932a37042 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:02.390367 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-769134f1-d8f8-4c50-b289-18c932a37042 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:02.390834 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-769134f1-d8f8-4c50-b289-18c932a37042 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:02.391439 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-769134f1-d8f8-4c50-b289-18c932a37042 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:02.461556 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2c6bc219-f667-454f-a276-841ddfe0486f tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82daefe001364499b2ee9eb7da2599be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:02.470001 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2c6bc219-f667-454f-a276-841ddfe0486f tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] 10.222.0.20 "GET /compute/v2.1/servers/4634ba00-a353-44a2-b49a-7b1bc2fc7e81" status: 200 len: 1516 microversion: 2.1 time: 0.250145 Oct 27 03:43:02.488119 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2453/5205] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:43:02 2022] GET /compute/v2.1/servers/4634ba00-a353-44a2-b49a-7b1bc2fc7e81 => generated 1516 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:43:02.582379 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5d02c4e1-281b-4646-9388-ce76e0c89eb9 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:02.583001 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5d02c4e1-281b-4646-9388-ce76e0c89eb9 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: 55152bbe-5a47-4916-ad12-5f1640f0be61] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:02.590881 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5d02c4e1-281b-4646-9388-ce76e0c89eb9 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:02.591703 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5d02c4e1-281b-4646-9388-ce76e0c89eb9 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:02.592584 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5d02c4e1-281b-4646-9388-ce76e0c89eb9 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:02.593559 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5d02c4e1-281b-4646-9388-ce76e0c89eb9 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:02.594292 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5d02c4e1-281b-4646-9388-ce76e0c89eb9 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:02.594954 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5d02c4e1-281b-4646-9388-ce76e0c89eb9 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:02.785178 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-769134f1-d8f8-4c50-b289-18c932a37042 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:02.800318 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-769134f1-d8f8-4c50-b289-18c932a37042 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/dda902a6-dcad-42bf-9b3c-ed716ea0af70" status: 200 len: 1510 microversion: 2.1 time: 0.445076 Oct 27 03:43:02.813133 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2753/5206] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:43:02 2022] GET /compute/v2.1/servers/dda902a6-dcad-42bf-9b3c-ed716ea0af70 => generated 1510 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:43:02.884234 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5d02c4e1-281b-4646-9388-ce76e0c89eb9 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:02.901765 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5d02c4e1-281b-4646-9388-ce76e0c89eb9 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61" status: 200 len: 1318 microversion: 2.1 time: 0.323209 Oct 27 03:43:02.903088 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2454/5207] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:43:02 2022] GET /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61 => generated 1318 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:43:03.155884 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-f051cf61-9deb-4933-ba9f-da8b95a336e2 req-35f7ede5-4074-4679-86fc-230f931b4007 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4634ba00-a353-44a2-b49a-7b1bc2fc7e81", "name": "network-vif-deleted", "tag": "b030f178-4218-4b6b-a8b2-8e3531ae7161"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:43:03.197717 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-f051cf61-9deb-4933-ba9f-da8b95a336e2 req-35f7ede5-4074-4679-86fc-230f931b4007 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:03.200246 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-f051cf61-9deb-4933-ba9f-da8b95a336e2 req-35f7ede5-4074-4679-86fc-230f931b4007 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:03.201658 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-f051cf61-9deb-4933-ba9f-da8b95a336e2 req-35f7ede5-4074-4679-86fc-230f931b4007 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:03.229175 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-f051cf61-9deb-4933-ba9f-da8b95a336e2 req-35f7ede5-4074-4679-86fc-230f931b4007 service nova] Creating event network-vif-deleted:b030f178-4218-4b6b-a8b2-8e3531ae7161 for instance 4634ba00-a353-44a2-b49a-7b1bc2fc7e81 on n-h2-862769-1 Oct 27 03:43:03.236697 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-f051cf61-9deb-4933-ba9f-da8b95a336e2 req-35f7ede5-4074-4679-86fc-230f931b4007 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085338 Oct 27 03:43:03.237872 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2754/5208] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:43:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:43:03.253090 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-68ba99c1-9fa2-4758-8efe-feeeb2475696 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:03.253727 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-68ba99c1-9fa2-4758-8efe-feeeb2475696 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:03.265065 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-68ba99c1-9fa2-4758-8efe-feeeb2475696 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:03.265901 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-68ba99c1-9fa2-4758-8efe-feeeb2475696 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:03.266565 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-68ba99c1-9fa2-4758-8efe-feeeb2475696 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:03.267609 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-68ba99c1-9fa2-4758-8efe-feeeb2475696 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:03.268303 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-68ba99c1-9fa2-4758-8efe-feeeb2475696 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:03.269527 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-68ba99c1-9fa2-4758-8efe-feeeb2475696 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:03.301383 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-68ba99c1-9fa2-4758-8efe-feeeb2475696 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] HTTP exception thrown: Instance 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 could not be found. Oct 27 03:43:03.305733 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-68ba99c1-9fa2-4758-8efe-feeeb2475696 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Request method failure captured: Oct 27 03:43:03.305733 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 HTTP/1.1 Oct 27 03:43:03.305733 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:43:03.305733 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:43:03.305733 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:43:03.305733 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:43:03.305733 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:43:03.305733 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:43:03.305733 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:43:03.305733 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:43:03.305733 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWf1tpBFEbkvSK3SqNKiaBdt2iU4VU0up94oX5h2-dwelsBTcOMjAbogxTF1m6837ADQrTcsoRLUG6fwb1i91GnLWdY1HiMrerSGB8x7h0qmRtRJ0xxks9W3iJabiTHs4YSYs5Sa938DRiTXN21ja7qe0GdEoHSxnnRlw0wNIOnjEc_c Oct 27 03:43:03.305733 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:43:03.305733 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:43:03.305733 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:43:03.305733 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:43:03.305733 n-d-862769-1 devstack@n-api.service[121000]: X-Openstack-Nova-Api-Version: 2.20 Oct 27 03:43:03.305733 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:43:03.305733 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:43:03.305733 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: c48bca00e4d445918f030bf885424b40 Oct 27 03:43:03.305733 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-186270836 Oct 27 03:43:03.305733 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:43:03.305733 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:43:03.305733 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c48bca00e4d445918f030bf885424b40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c48bca00e4d445918f030bf885424b40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c48bca00e4d445918f030bf885424b40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c48bca00e4d445918f030bf885424b40"}]}] Oct 27 03:43:03.305733 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-AttachVolumeShelveTestJSON-186270836 Oct 27 03:43:03.305733 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: c48bca00e4d445918f030bf885424b40 Oct 27 03:43:03.305733 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-186270836 Oct 27 03:43:03.305733 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-AttachVolumeShelveTestJSON-186270836-project Oct 27 03:43:03.305733 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:43:03.305733 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:43:03.305733 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: b74e8d6facd1460ab31a3ce4b24dd315 Oct 27 03:43:03.305733 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-AttachVolumeShelveTestJSON-186270836-project Oct 27 03:43:03.305733 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:43:03.305733 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 could not be found. Oct 27 03:43:03.305733 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '6854d7f3-0f6d-45c2-b46d-a5dc2922fe79'} Oct 27 03:43:03.305733 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:43:03.305733 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:43:03.305733 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:43:03.305733 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:43:03.305733 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:43:03.305733 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:43:03.305733 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:43:03.305733 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:43:03.305733 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:43:03.305733 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:43:03.305733 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 could not be found. Oct 27 03:43:03.305733 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:43:03.305733 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:43:03.305733 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:43:03.305733 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:43:03.305733 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:43:03.305733 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:43:03.305733 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:43:03.305733 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:43:03.305733 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:43:03.305733 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:43:03.305733 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:43:03.305733 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:43:03.305733 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:43:03.305733 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:43:03.305733 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:43:03.305733 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:43:03.305733 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 could not be found. Oct 27 03:43:03.305733 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:43:03.305733 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:43:03.310016 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:43:03.310016 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:43:03.310016 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:43:03.310016 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:43:03.310016 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:43:03.310016 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:43:03.310016 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 could not be found. Oct 27 03:43:03.310016 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:43:03.312575 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-68ba99c1-9fa2-4758-8efe-feeeb2475696 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Returning 404 to user: Instance 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:43:03.314321 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-68ba99c1-9fa2-4758-8efe-feeeb2475696 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79" status: 404 len: 111 microversion: 2.20 time: 0.069998 Oct 27 03:43:03.315462 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2455/5209] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:43:03 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 03:43:03.329255 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-076b6398-e00e-408c-a49b-4bf2f8d678c3 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '.version_select at 0x7f7dd9fa11f0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:03.447045 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-076b6398-e00e-408c-a49b-4bf2f8d678c3 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-340082829" status: 204 len: 0 microversion: 2.20 time: 0.118599 Oct 27 03:43:03.447045 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2755/5210] 10.222.0.20 () {60 vars in 1259 bytes} [Thu Oct 27 03:43:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-340082829 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 27 03:43:03.501587 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-33793c75-c0da-482d-8fbf-dd2eb66e328a tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:03.502308 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-33793c75-c0da-482d-8fbf-dd2eb66e328a tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] [instance: 4634ba00-a353-44a2-b49a-7b1bc2fc7e81] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:03.504250 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:43:03.512690 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-33793c75-c0da-482d-8fbf-dd2eb66e328a tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:03.513438 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-33793c75-c0da-482d-8fbf-dd2eb66e328a tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:03.514072 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-33793c75-c0da-482d-8fbf-dd2eb66e328a tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:03.514996 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-33793c75-c0da-482d-8fbf-dd2eb66e328a tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:03.515624 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-33793c75-c0da-482d-8fbf-dd2eb66e328a tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:03.516223 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-33793c75-c0da-482d-8fbf-dd2eb66e328a tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:03.556817 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-33793c75-c0da-482d-8fbf-dd2eb66e328a tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:03.569872 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-33793c75-c0da-482d-8fbf-dd2eb66e328a tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:03.570927 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-33793c75-c0da-482d-8fbf-dd2eb66e328a tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:03.571590 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-33793c75-c0da-482d-8fbf-dd2eb66e328a tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lazy-loading 'fault' on Instance uuid 4634ba00-a353-44a2-b49a-7b1bc2fc7e81 {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:43:03.726743 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-33793c75-c0da-482d-8fbf-dd2eb66e328a tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82daefe001364499b2ee9eb7da2599be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:03.788501 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-33793c75-c0da-482d-8fbf-dd2eb66e328a tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] 10.222.0.20 "GET /compute/v2.1/servers/4634ba00-a353-44a2-b49a-7b1bc2fc7e81" status: 200 len: 1310 microversion: 2.1 time: 0.276426 Oct 27 03:43:03.794234 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2456/5211] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:43:03 2022] GET /compute/v2.1/servers/4634ba00-a353-44a2-b49a-7b1bc2fc7e81 => generated 1310 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:43:03.828850 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-dd131949-58e6-41da-a4d9-bced491d8fc8 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:03.829868 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-dd131949-58e6-41da-a4d9-bced491d8fc8 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: dda902a6-dcad-42bf-9b3c-ed716ea0af70] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:03.837017 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dd131949-58e6-41da-a4d9-bced491d8fc8 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:03.837730 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dd131949-58e6-41da-a4d9-bced491d8fc8 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:03.838397 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dd131949-58e6-41da-a4d9-bced491d8fc8 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:03.839359 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dd131949-58e6-41da-a4d9-bced491d8fc8 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:03.839987 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dd131949-58e6-41da-a4d9-bced491d8fc8 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:03.841029 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dd131949-58e6-41da-a4d9-bced491d8fc8 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:03.933644 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6894c84c-d8e6-4013-ae57-d1f8013c4974 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:03.939272 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6894c84c-d8e6-4013-ae57-d1f8013c4974 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: 55152bbe-5a47-4916-ad12-5f1640f0be61] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:03.949903 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6894c84c-d8e6-4013-ae57-d1f8013c4974 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:03.950591 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6894c84c-d8e6-4013-ae57-d1f8013c4974 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:03.951795 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6894c84c-d8e6-4013-ae57-d1f8013c4974 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:03.953681 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6894c84c-d8e6-4013-ae57-d1f8013c4974 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:03.954977 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6894c84c-d8e6-4013-ae57-d1f8013c4974 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:03.955602 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6894c84c-d8e6-4013-ae57-d1f8013c4974 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:04.082356 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-dd131949-58e6-41da-a4d9-bced491d8fc8 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:04.090249 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-dd131949-58e6-41da-a4d9-bced491d8fc8 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/dda902a6-dcad-42bf-9b3c-ed716ea0af70" status: 200 len: 1510 microversion: 2.1 time: 0.265299 Oct 27 03:43:04.090858 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2756/5212] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:43:03 2022] GET /compute/v2.1/servers/dda902a6-dcad-42bf-9b3c-ed716ea0af70 => generated 1510 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:43:04.219221 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-6894c84c-d8e6-4013-ae57-d1f8013c4974 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:04.228569 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6894c84c-d8e6-4013-ae57-d1f8013c4974 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61" status: 200 len: 1318 microversion: 2.1 time: 0.304801 Oct 27 03:43:04.229842 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2457/5213] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:43:03 2022] GET /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61 => generated 1318 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:43:04.820685 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-23a7fe82-d298-4db0-a2ec-3169a14f92ef tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:04.822806 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-23a7fe82-d298-4db0-a2ec-3169a14f92ef tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] [instance: 4634ba00-a353-44a2-b49a-7b1bc2fc7e81] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:04.839347 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-23a7fe82-d298-4db0-a2ec-3169a14f92ef tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:04.841103 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-23a7fe82-d298-4db0-a2ec-3169a14f92ef tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:04.847889 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-23a7fe82-d298-4db0-a2ec-3169a14f92ef tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:04.847889 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-23a7fe82-d298-4db0-a2ec-3169a14f92ef tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:04.847889 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-23a7fe82-d298-4db0-a2ec-3169a14f92ef tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:04.847889 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-23a7fe82-d298-4db0-a2ec-3169a14f92ef tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:04.872895 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-23a7fe82-d298-4db0-a2ec-3169a14f92ef tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] HTTP exception thrown: Instance 4634ba00-a353-44a2-b49a-7b1bc2fc7e81 could not be found. Oct 27 03:43:04.874470 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-23a7fe82-d298-4db0-a2ec-3169a14f92ef tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Request method failure captured: Oct 27 03:43:04.874470 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/4634ba00-a353-44a2-b49a-7b1bc2fc7e81 HTTP/1.1 Oct 27 03:43:04.874470 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:43:04.874470 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:43:04.874470 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:43:04.874470 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:43:04.874470 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:43:04.874470 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:43:04.874470 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:43:04.874470 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:43:04.874470 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWf4KJy8RSxzaHk_-CZ3sEEqRoKqs6c4PVSXoJpj_sCGU6N3kvbwGZxVDPnp45mPrN57LYtsrxSyFhwgvPnW9IjsqSFQKRcxP8mp91tWW1jyf6ZsFcMuPIu9-teuZ1cktYxjepcqSJ6PT0Y06spksKtYr20dvet7sEfLwY7DDXILQbI0 Oct 27 03:43:04.874470 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:43:04.874470 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:43:04.874470 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:43:04.874470 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:43:04.874470 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:43:04.874470 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:43:04.874470 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 98617e3a5b6c449c88449c236a8f2ecf Oct 27 03:43:04.874470 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ListServerFiltersTestJSON-1238636021 Oct 27 03:43:04.874470 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:43:04.874470 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:43:04.874470 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/98617e3a5b6c449c88449c236a8f2ecf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/98617e3a5b6c449c88449c236a8f2ecf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/98617e3a5b6c449c88449c236a8f2ecf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_98617e3a5b6c449c88449c236a8f2ecf"}]}] Oct 27 03:43:04.874470 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ListServerFiltersTestJSON-1238636021 Oct 27 03:43:04.874470 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 98617e3a5b6c449c88449c236a8f2ecf Oct 27 03:43:04.874470 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1238636021 Oct 27 03:43:04.874470 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ListServerFiltersTestJSON-1238636021-project Oct 27 03:43:04.874470 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:43:04.874470 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:43:04.874470 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 82daefe001364499b2ee9eb7da2599be Oct 27 03:43:04.874470 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ListServerFiltersTestJSON-1238636021-project Oct 27 03:43:04.874470 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:43:04.874470 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 4634ba00-a353-44a2-b49a-7b1bc2fc7e81 could not be found. Oct 27 03:43:04.874470 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '4634ba00-a353-44a2-b49a-7b1bc2fc7e81'} Oct 27 03:43:04.874470 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:43:04.874470 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:43:04.874470 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:43:04.874470 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:43:04.874470 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:43:04.874470 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:43:04.874470 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:43:04.874470 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:43:04.874470 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:43:04.874470 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:43:04.874470 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4634ba00-a353-44a2-b49a-7b1bc2fc7e81 could not be found. Oct 27 03:43:04.874470 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:43:04.874470 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:43:04.874470 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:43:04.874470 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:43:04.874470 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:43:04.874470 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:43:04.874470 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:43:04.874470 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:43:04.874470 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:43:04.874470 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:43:04.874470 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:43:04.874470 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:43:04.874470 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:43:04.874470 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:43:04.874470 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:43:04.874470 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:43:04.874470 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4634ba00-a353-44a2-b49a-7b1bc2fc7e81 could not be found. Oct 27 03:43:04.874470 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:43:04.874470 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:43:04.874470 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:43:04.879736 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:43:04.879736 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:43:04.879736 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:43:04.879736 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:43:04.879736 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:43:04.879736 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4634ba00-a353-44a2-b49a-7b1bc2fc7e81 could not be found. Oct 27 03:43:04.879736 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:43:04.886558 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-23a7fe82-d298-4db0-a2ec-3169a14f92ef tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Returning 404 to user: Instance 4634ba00-a353-44a2-b49a-7b1bc2fc7e81 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:43:04.887757 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-23a7fe82-d298-4db0-a2ec-3169a14f92ef tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] 10.222.0.20 "GET /compute/v2.1/servers/4634ba00-a353-44a2-b49a-7b1bc2fc7e81" status: 404 len: 111 microversion: 2.1 time: 0.075263 Oct 27 03:43:04.891579 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2757/5214] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:43:04 2022] GET /compute/v2.1/servers/4634ba00-a353-44a2-b49a-7b1bc2fc7e81 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:43:04.901819 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7b58bd1e-b52c-4e5f-ad98-aff3b34c721f tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:04.907477 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7b58bd1e-b52c-4e5f-ad98-aff3b34c721f tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] [instance: 0dd4eda6-95aa-4130-87e5-2986d6b95536] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:04.916562 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7b58bd1e-b52c-4e5f-ad98-aff3b34c721f tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:04.917662 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7b58bd1e-b52c-4e5f-ad98-aff3b34c721f tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:04.918343 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7b58bd1e-b52c-4e5f-ad98-aff3b34c721f tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:04.919551 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7b58bd1e-b52c-4e5f-ad98-aff3b34c721f tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:04.921289 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7b58bd1e-b52c-4e5f-ad98-aff3b34c721f tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:04.925163 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7b58bd1e-b52c-4e5f-ad98-aff3b34c721f tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:04.958533 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7b58bd1e-b52c-4e5f-ad98-aff3b34c721f tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] [instance: 0dd4eda6-95aa-4130-87e5-2986d6b95536] Going to try to terminate instance {{(pid=121000) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:43:05.115914 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ff5a1626-4230-4569-b3d2-d7a47f95af39 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:05.116832 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ff5a1626-4230-4569-b3d2-d7a47f95af39 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: dda902a6-dcad-42bf-9b3c-ed716ea0af70] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:05.123482 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ff5a1626-4230-4569-b3d2-d7a47f95af39 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:05.124169 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ff5a1626-4230-4569-b3d2-d7a47f95af39 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:05.124786 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ff5a1626-4230-4569-b3d2-d7a47f95af39 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:05.125893 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ff5a1626-4230-4569-b3d2-d7a47f95af39 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:05.126634 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ff5a1626-4230-4569-b3d2-d7a47f95af39 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:05.127218 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ff5a1626-4230-4569-b3d2-d7a47f95af39 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:05.261960 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7b58bd1e-b52c-4e5f-ad98-aff3b34c721f tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0dd4eda6-95aa-4130-87e5-2986d6b95536" status: 204 len: 0 microversion: 2.1 time: 0.366987 Oct 27 03:43:05.265848 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2458/5215] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:43:04 2022] DELETE /compute/v2.1/servers/0dd4eda6-95aa-4130-87e5-2986d6b95536 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:43:05.280764 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d419c59a-8746-4b8d-a63b-0bedc0f555ee tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Action: 'create', calling method: .version_select at 0x7f7dd9d7f670>, body: {"keypair": {"name": "tempest-keypair-609591935", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMK2IHgM4u/qd0FPPY6KKOOLUDL6pdVHEbI20AkzA523GpoeqC1tteI3QgMLvRORbeJ3cAWBkqB7zXgqVshqYBJ8DmIkZ3AIyQmv2ghWwoMjftuQAtT62OWzwnJzZRKiCg=="}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:43:05.290356 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=8 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:43:05.317875 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-d419c59a-8746-4b8d-a63b-0bedc0f555ee tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Getting quotas for project c48bca00e4d445918f030bf885424b40. Resources: {'key_pairs'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:43:05.326825 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-d419c59a-8746-4b8d-a63b-0bedc0f555ee tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Getting quotas for user b74e8d6facd1460ab31a3ce4b24dd315 and project c48bca00e4d445918f030bf885424b40. Resources: {'key_pairs'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:43:05.398971 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ff5a1626-4230-4569-b3d2-d7a47f95af39 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:05.407257 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ff5a1626-4230-4569-b3d2-d7a47f95af39 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/dda902a6-dcad-42bf-9b3c-ed716ea0af70" status: 200 len: 1510 microversion: 2.1 time: 0.296161 Oct 27 03:43:05.407825 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2758/5216] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:43:05 2022] GET /compute/v2.1/servers/dda902a6-dcad-42bf-9b3c-ed716ea0af70 => generated 1510 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:43:05.412783 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4c9b78eb-6105-4adb-aeba-7fca77bb1668 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:05.413408 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4c9b78eb-6105-4adb-aeba-7fca77bb1668 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: 55152bbe-5a47-4916-ad12-5f1640f0be61] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:05.433221 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4c9b78eb-6105-4adb-aeba-7fca77bb1668 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:05.433708 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4c9b78eb-6105-4adb-aeba-7fca77bb1668 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:05.434378 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4c9b78eb-6105-4adb-aeba-7fca77bb1668 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:05.435740 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4c9b78eb-6105-4adb-aeba-7fca77bb1668 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:05.435740 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4c9b78eb-6105-4adb-aeba-7fca77bb1668 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:05.436016 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4c9b78eb-6105-4adb-aeba-7fca77bb1668 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:05.461996 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d419c59a-8746-4b8d-a63b-0bedc0f555ee tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.186679 Oct 27 03:43:05.471714 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2459/5217] 10.222.0.20 () {62 vars in 1200 bytes} [Thu Oct 27 03:43:05 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 208 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 27 03:43:05.508154 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ff14e8e3-6a2e-48d5-8f7e-5dd3e587224a tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:05.508929 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ff14e8e3-6a2e-48d5-8f7e-5dd3e587224a tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] [instance: 0dd4eda6-95aa-4130-87e5-2986d6b95536] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:05.517908 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ff14e8e3-6a2e-48d5-8f7e-5dd3e587224a tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:05.518462 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ff14e8e3-6a2e-48d5-8f7e-5dd3e587224a tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:05.518975 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ff14e8e3-6a2e-48d5-8f7e-5dd3e587224a tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:05.519765 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ff14e8e3-6a2e-48d5-8f7e-5dd3e587224a tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:05.520619 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ff14e8e3-6a2e-48d5-8f7e-5dd3e587224a tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:05.521079 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ff14e8e3-6a2e-48d5-8f7e-5dd3e587224a tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:05.703043 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4c9b78eb-6105-4adb-aeba-7fca77bb1668 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:05.713394 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4c9b78eb-6105-4adb-aeba-7fca77bb1668 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61" status: 200 len: 1318 microversion: 2.1 time: 0.304459 Oct 27 03:43:05.714000 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2759/5218] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:43:05 2022] GET /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61 => generated 1318 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:43:05.719732 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-2848e774-377d-463b-9535-287ba78ae680 req-7fe9beef-e189-43f0-8a61-dd4fe034efc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55152bbe-5a47-4916-ad12-5f1640f0be61", "tag": "67a01d77-0a6b-4674-a21b-94e9feab543c"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:43:05.732772 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-2848e774-377d-463b-9535-287ba78ae680 req-7fe9beef-e189-43f0-8a61-dd4fe034efc6 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:05.733607 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-2848e774-377d-463b-9535-287ba78ae680 req-7fe9beef-e189-43f0-8a61-dd4fe034efc6 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:05.734258 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-2848e774-377d-463b-9535-287ba78ae680 req-7fe9beef-e189-43f0-8a61-dd4fe034efc6 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:05.756582 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-2848e774-377d-463b-9535-287ba78ae680 req-7fe9beef-e189-43f0-8a61-dd4fe034efc6 service nova] Creating event network-changed:67a01d77-0a6b-4674-a21b-94e9feab543c for instance 55152bbe-5a47-4916-ad12-5f1640f0be61 on n-h1-862769-1 Oct 27 03:43:05.763406 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-2848e774-377d-463b-9535-287ba78ae680 req-7fe9beef-e189-43f0-8a61-dd4fe034efc6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047507 Oct 27 03:43:05.770728 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2760/5219] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:43:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:43:06.075144 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ff14e8e3-6a2e-48d5-8f7e-5dd3e587224a tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82daefe001364499b2ee9eb7da2599be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:06.083532 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ff14e8e3-6a2e-48d5-8f7e-5dd3e587224a tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] 10.222.0.20 "GET /compute/v2.1/servers/0dd4eda6-95aa-4130-87e5-2986d6b95536" status: 200 len: 1517 microversion: 2.1 time: 0.610310 Oct 27 03:43:06.084961 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2460/5220] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:43:05 2022] GET /compute/v2.1/servers/0dd4eda6-95aa-4130-87e5-2986d6b95536 => generated 1517 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:43:06.433753 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d0912140-f770-4d78-b71c-2d8178fe9bd5 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:06.434609 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d0912140-f770-4d78-b71c-2d8178fe9bd5 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: dda902a6-dcad-42bf-9b3c-ed716ea0af70] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:06.447070 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d0912140-f770-4d78-b71c-2d8178fe9bd5 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:06.447969 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d0912140-f770-4d78-b71c-2d8178fe9bd5 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:06.448642 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d0912140-f770-4d78-b71c-2d8178fe9bd5 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:06.449751 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d0912140-f770-4d78-b71c-2d8178fe9bd5 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:06.450654 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d0912140-f770-4d78-b71c-2d8178fe9bd5 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:06.451402 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d0912140-f770-4d78-b71c-2d8178fe9bd5 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:06.457327 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:43:06.752947 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-589765f2-3972-40da-bd45-dabc09b84fcc tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:06.757720 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-589765f2-3972-40da-bd45-dabc09b84fcc tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: 55152bbe-5a47-4916-ad12-5f1640f0be61] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:06.778427 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d0912140-f770-4d78-b71c-2d8178fe9bd5 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:06.783526 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-589765f2-3972-40da-bd45-dabc09b84fcc tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:06.783526 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-589765f2-3972-40da-bd45-dabc09b84fcc tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:06.783526 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-589765f2-3972-40da-bd45-dabc09b84fcc tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:06.785766 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-589765f2-3972-40da-bd45-dabc09b84fcc tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:06.786406 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-589765f2-3972-40da-bd45-dabc09b84fcc tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:06.787989 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-589765f2-3972-40da-bd45-dabc09b84fcc tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:06.818633 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d0912140-f770-4d78-b71c-2d8178fe9bd5 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/dda902a6-dcad-42bf-9b3c-ed716ea0af70" status: 200 len: 1516 microversion: 2.1 time: 0.389338 Oct 27 03:43:06.832276 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2761/5221] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:43:06 2022] GET /compute/v2.1/servers/dda902a6-dcad-42bf-9b3c-ed716ea0af70 => generated 1516 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:43:07.119865 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9ed6c624-8384-452f-a80d-ce22fdf8c25f tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:07.120725 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-9ed6c624-8384-452f-a80d-ce22fdf8c25f tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] [instance: 0dd4eda6-95aa-4130-87e5-2986d6b95536] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:07.136454 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-589765f2-3972-40da-bd45-dabc09b84fcc tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:07.141235 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9ed6c624-8384-452f-a80d-ce22fdf8c25f tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:07.143870 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9ed6c624-8384-452f-a80d-ce22fdf8c25f tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:07.145213 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9ed6c624-8384-452f-a80d-ce22fdf8c25f tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:07.146250 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9ed6c624-8384-452f-a80d-ce22fdf8c25f tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:07.146393 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-589765f2-3972-40da-bd45-dabc09b84fcc tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61" status: 200 len: 1318 microversion: 2.1 time: 0.408539 Oct 27 03:43:07.151768 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9ed6c624-8384-452f-a80d-ce22fdf8c25f tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:07.155025 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9ed6c624-8384-452f-a80d-ce22fdf8c25f tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:07.161804 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2461/5222] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:43:06 2022] GET /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61 => generated 1318 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:43:07.711907 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9ed6c624-8384-452f-a80d-ce22fdf8c25f tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82daefe001364499b2ee9eb7da2599be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:07.714327 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=4 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:43:07.726068 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9ed6c624-8384-452f-a80d-ce22fdf8c25f tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] 10.222.0.20 "GET /compute/v2.1/servers/0dd4eda6-95aa-4130-87e5-2986d6b95536" status: 200 len: 1517 microversion: 2.1 time: 0.618343 Oct 27 03:43:07.727367 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2762/5223] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:43:07 2022] GET /compute/v2.1/servers/0dd4eda6-95aa-4130-87e5-2986d6b95536 => generated 1517 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:43:08.169965 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-529dcd88-ca73-492c-9445-04d65c7853c6 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:08.170623 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-529dcd88-ca73-492c-9445-04d65c7853c6 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: 55152bbe-5a47-4916-ad12-5f1640f0be61] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:08.185219 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-529dcd88-ca73-492c-9445-04d65c7853c6 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:08.185728 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-529dcd88-ca73-492c-9445-04d65c7853c6 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:08.190170 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-529dcd88-ca73-492c-9445-04d65c7853c6 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:08.191113 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-529dcd88-ca73-492c-9445-04d65c7853c6 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:08.198877 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-529dcd88-ca73-492c-9445-04d65c7853c6 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:08.199764 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-529dcd88-ca73-492c-9445-04d65c7853c6 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:08.540983 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=4 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:43:08.694937 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-529dcd88-ca73-492c-9445-04d65c7853c6 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:08.706773 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-529dcd88-ca73-492c-9445-04d65c7853c6 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61" status: 200 len: 1318 microversion: 2.1 time: 0.541174 Oct 27 03:43:08.710755 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2462/5224] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:43:08 2022] GET /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61 => generated 1318 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:43:08.753891 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c2a624ec-e957-48a0-b829-5df1542d7485 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:08.755146 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c2a624ec-e957-48a0-b829-5df1542d7485 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] [instance: 0dd4eda6-95aa-4130-87e5-2986d6b95536] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:08.769740 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c2a624ec-e957-48a0-b829-5df1542d7485 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:08.770601 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c2a624ec-e957-48a0-b829-5df1542d7485 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:08.771858 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c2a624ec-e957-48a0-b829-5df1542d7485 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:08.772919 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c2a624ec-e957-48a0-b829-5df1542d7485 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:08.773438 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c2a624ec-e957-48a0-b829-5df1542d7485 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:08.774090 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c2a624ec-e957-48a0-b829-5df1542d7485 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:08.878385 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c2a624ec-e957-48a0-b829-5df1542d7485 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82daefe001364499b2ee9eb7da2599be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:08.887743 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c2a624ec-e957-48a0-b829-5df1542d7485 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] 10.222.0.20 "GET /compute/v2.1/servers/0dd4eda6-95aa-4130-87e5-2986d6b95536" status: 200 len: 1475 microversion: 2.1 time: 0.140015 Oct 27 03:43:08.892563 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2763/5225] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:43:08 2022] GET /compute/v2.1/servers/0dd4eda6-95aa-4130-87e5-2986d6b95536 => generated 1475 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:43:08.912750 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-59a1f954-93b2-4b97-b52b-3cef913cac14 req-db4d9146-a3f3-4674-bede-2c648db78b27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dd4eda6-95aa-4130-87e5-2986d6b95536", "name": "network-vif-deleted", "tag": "c145bd52-e31c-495c-b5c9-8d9b40e2a275"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:43:08.934737 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-59a1f954-93b2-4b97-b52b-3cef913cac14 req-db4d9146-a3f3-4674-bede-2c648db78b27 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:08.935417 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-59a1f954-93b2-4b97-b52b-3cef913cac14 req-db4d9146-a3f3-4674-bede-2c648db78b27 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:08.936340 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-59a1f954-93b2-4b97-b52b-3cef913cac14 req-db4d9146-a3f3-4674-bede-2c648db78b27 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:08.957118 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-59a1f954-93b2-4b97-b52b-3cef913cac14 req-db4d9146-a3f3-4674-bede-2c648db78b27 service nova] Creating event network-vif-deleted:c145bd52-e31c-495c-b5c9-8d9b40e2a275 for instance 0dd4eda6-95aa-4130-87e5-2986d6b95536 on n-h2-862769-1 Oct 27 03:43:08.970752 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-59a1f954-93b2-4b97-b52b-3cef913cac14 req-db4d9146-a3f3-4674-bede-2c648db78b27 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059999 Oct 27 03:43:08.971809 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2463/5226] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:43:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:43:09.736917 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f346ab00-2e6f-4265-af03-1659ee59af9c tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:09.739091 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f346ab00-2e6f-4265-af03-1659ee59af9c tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: 55152bbe-5a47-4916-ad12-5f1640f0be61] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:09.747408 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=16 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:43:09.761967 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f346ab00-2e6f-4265-af03-1659ee59af9c tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:09.764099 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f346ab00-2e6f-4265-af03-1659ee59af9c tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:09.765182 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f346ab00-2e6f-4265-af03-1659ee59af9c tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:09.767138 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f346ab00-2e6f-4265-af03-1659ee59af9c tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:09.768349 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f346ab00-2e6f-4265-af03-1659ee59af9c tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:09.769502 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f346ab00-2e6f-4265-af03-1659ee59af9c tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:09.843378 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f821a8c4-8f21-4720-87fe-ad02254b3d74 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Action: 'create', calling method: .version_select at 0x7f7dd9d7eaf0>, body: {"keypair": {"name": "tempest-keypair-859936746", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGQsGH1Woor4UbHkIIlIaVRaF4rykygl+2LqjVo1rXBhxCbveVd3+J0Yy7WooGfCBNLtY4GwD1J7TANsWbPIRyKLLYVNcxE5tyBL7qM/cSru82EUhAiWAe8j14I/yLhpng=="}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:43:09.906838 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-f821a8c4-8f21-4720-87fe-ad02254b3d74 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Getting quotas for project e1f3ed7ef6c648c9ac771fbaadde1d0c. Resources: {'key_pairs'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:43:09.915931 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-f821a8c4-8f21-4720-87fe-ad02254b3d74 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Getting quotas for user 43172c9e71704c869a25181574d67b35 and project e1f3ed7ef6c648c9ac771fbaadde1d0c. Resources: {'key_pairs'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:43:10.030236 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f821a8c4-8f21-4720-87fe-ad02254b3d74 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.192864 Oct 27 03:43:10.034232 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2464/5227] 10.222.0.20 () {60 vars in 1159 bytes} [Thu Oct 27 03:43:09 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:43:10.044514 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0a292996-17f1-4f7f-a217-3d5dc2f02549 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:10.045907 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0a292996-17f1-4f7f-a217-3d5dc2f02549 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] [instance: 0dd4eda6-95aa-4130-87e5-2986d6b95536] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:10.065983 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0a292996-17f1-4f7f-a217-3d5dc2f02549 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:10.074387 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0a292996-17f1-4f7f-a217-3d5dc2f02549 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:10.074942 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0a292996-17f1-4f7f-a217-3d5dc2f02549 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:10.076226 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0a292996-17f1-4f7f-a217-3d5dc2f02549 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:10.076883 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0a292996-17f1-4f7f-a217-3d5dc2f02549 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:10.077904 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0a292996-17f1-4f7f-a217-3d5dc2f02549 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:10.125446 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f346ab00-2e6f-4265-af03-1659ee59af9c tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:10.135190 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f346ab00-2e6f-4265-af03-1659ee59af9c tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61" status: 200 len: 1318 microversion: 2.1 time: 0.402812 Oct 27 03:43:10.140809 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2764/5228] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:43:09 2022] GET /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61 => generated 1318 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:43:10.148870 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0a292996-17f1-4f7f-a217-3d5dc2f02549 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:10.150026 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0a292996-17f1-4f7f-a217-3d5dc2f02549 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:10.150778 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0a292996-17f1-4f7f-a217-3d5dc2f02549 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:10.151544 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-0a292996-17f1-4f7f-a217-3d5dc2f02549 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lazy-loading 'fault' on Instance uuid 0dd4eda6-95aa-4130-87e5-2986d6b95536 {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:43:10.159481 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b21f460e-142e-47ff-93cc-6e4e1d2bfd5d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1150601529", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "268657d7-8aff-46cc-acb8-efbdb14ca663"}], "security_groups": [{"name": "tempest-securitygroup--634342884"}], "key_name": "tempest-keypair-609591935", "user_data": "}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:43:10.408149 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0a292996-17f1-4f7f-a217-3d5dc2f02549 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82daefe001364499b2ee9eb7da2599be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:10.430372 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0a292996-17f1-4f7f-a217-3d5dc2f02549 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] 10.222.0.20 "GET /compute/v2.1/servers/0dd4eda6-95aa-4130-87e5-2986d6b95536" status: 200 len: 1310 microversion: 2.1 time: 0.383036 Oct 27 03:43:10.431448 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2465/5229] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:43:10 2022] GET /compute/v2.1/servers/0dd4eda6-95aa-4130-87e5-2986d6b95536 => generated 1310 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:43:10.436357 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-5bcd1bc5-96e0-446e-a79d-6e036665034c req-43b33e9f-8d95-4a40-afb5-28722e1bd3af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55152bbe-5a47-4916-ad12-5f1640f0be61", "name": "network-vif-plugged", "status": "completed", "tag": "67a01d77-0a6b-4674-a21b-94e9feab543c"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:43:10.446383 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-5bcd1bc5-96e0-446e-a79d-6e036665034c req-43b33e9f-8d95-4a40-afb5-28722e1bd3af service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:10.447132 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-5bcd1bc5-96e0-446e-a79d-6e036665034c req-43b33e9f-8d95-4a40-afb5-28722e1bd3af service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:10.447744 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-5bcd1bc5-96e0-446e-a79d-6e036665034c req-43b33e9f-8d95-4a40-afb5-28722e1bd3af service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:10.461785 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-5bcd1bc5-96e0-446e-a79d-6e036665034c req-43b33e9f-8d95-4a40-afb5-28722e1bd3af service nova] Creating event network-vif-plugged:67a01d77-0a6b-4674-a21b-94e9feab543c for instance 55152bbe-5a47-4916-ad12-5f1640f0be61 on n-h1-862769-1 Oct 27 03:43:10.467511 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-5bcd1bc5-96e0-446e-a79d-6e036665034c req-43b33e9f-8d95-4a40-afb5-28722e1bd3af service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034707 Oct 27 03:43:10.468478 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2466/5230] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:43:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:43:10.643665 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.network.neutron [None req-b21f460e-142e-47ff-93cc-6e4e1d2bfd5d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] validate_networks() for [('268657d7-8aff-46cc-acb8-efbdb14ca663', None, None, None, None, None)] {{(pid=121001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:43:11.069819 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:43:11.168404 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3025fd73-bb8d-44a0-a635-87c8ece28c27 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:11.170630 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-3025fd73-bb8d-44a0-a635-87c8ece28c27 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: 55152bbe-5a47-4916-ad12-5f1640f0be61] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:11.197365 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3025fd73-bb8d-44a0-a635-87c8ece28c27 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:11.199021 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3025fd73-bb8d-44a0-a635-87c8ece28c27 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:11.199468 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3025fd73-bb8d-44a0-a635-87c8ece28c27 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:11.200194 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3025fd73-bb8d-44a0-a635-87c8ece28c27 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:11.203890 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3025fd73-bb8d-44a0-a635-87c8ece28c27 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:11.203890 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3025fd73-bb8d-44a0-a635-87c8ece28c27 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:11.569941 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-3025fd73-bb8d-44a0-a635-87c8ece28c27 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:11.586876 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3025fd73-bb8d-44a0-a635-87c8ece28c27 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61" status: 200 len: 1318 microversion: 2.1 time: 0.424815 Oct 27 03:43:11.592052 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2467/5231] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:43:11 2022] GET /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61 => generated 1318 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:43:11.603290 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-106de27c-a30e-463f-b29b-8ba7c5b3e03c tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:11.606656 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-106de27c-a30e-463f-b29b-8ba7c5b3e03c tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] [instance: 0dd4eda6-95aa-4130-87e5-2986d6b95536] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:11.623516 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-106de27c-a30e-463f-b29b-8ba7c5b3e03c tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:11.624362 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-106de27c-a30e-463f-b29b-8ba7c5b3e03c tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:11.624977 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-106de27c-a30e-463f-b29b-8ba7c5b3e03c tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:11.628933 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-106de27c-a30e-463f-b29b-8ba7c5b3e03c tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:11.635573 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-106de27c-a30e-463f-b29b-8ba7c5b3e03c tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:11.648616 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-106de27c-a30e-463f-b29b-8ba7c5b3e03c tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:11.689559 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-106de27c-a30e-463f-b29b-8ba7c5b3e03c tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] HTTP exception thrown: Instance 0dd4eda6-95aa-4130-87e5-2986d6b95536 could not be found. Oct 27 03:43:11.691799 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-106de27c-a30e-463f-b29b-8ba7c5b3e03c tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Request method failure captured: Oct 27 03:43:11.691799 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/0dd4eda6-95aa-4130-87e5-2986d6b95536 HTTP/1.1 Oct 27 03:43:11.691799 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:43:11.691799 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:43:11.691799 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:43:11.691799 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:43:11.691799 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:43:11.691799 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:43:11.691799 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:43:11.691799 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:43:11.691799 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWf4KJy8RSxzaHk_-CZ3sEEqRoKqs6c4PVSXoJpj_sCGU6N3kvbwGZxVDPnp45mPrN57LYtsrxSyFhwgvPnW9IjsqSFQKRcxP8mp91tWW1jyf6ZsFcMuPIu9-teuZ1cktYxjepcqSJ6PT0Y06spksKtYr20dvet7sEfLwY7DDXILQbI0 Oct 27 03:43:11.691799 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:43:11.691799 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:43:11.691799 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:43:11.691799 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:43:11.691799 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:43:11.691799 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:43:11.691799 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 98617e3a5b6c449c88449c236a8f2ecf Oct 27 03:43:11.691799 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ListServerFiltersTestJSON-1238636021 Oct 27 03:43:11.691799 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:43:11.691799 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:43:11.691799 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/98617e3a5b6c449c88449c236a8f2ecf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/98617e3a5b6c449c88449c236a8f2ecf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/98617e3a5b6c449c88449c236a8f2ecf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_98617e3a5b6c449c88449c236a8f2ecf"}]}] Oct 27 03:43:11.691799 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ListServerFiltersTestJSON-1238636021 Oct 27 03:43:11.691799 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 98617e3a5b6c449c88449c236a8f2ecf Oct 27 03:43:11.691799 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1238636021 Oct 27 03:43:11.691799 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ListServerFiltersTestJSON-1238636021-project Oct 27 03:43:11.691799 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:43:11.691799 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:43:11.691799 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 82daefe001364499b2ee9eb7da2599be Oct 27 03:43:11.691799 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ListServerFiltersTestJSON-1238636021-project Oct 27 03:43:11.691799 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:43:11.691799 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 0dd4eda6-95aa-4130-87e5-2986d6b95536 could not be found. Oct 27 03:43:11.691799 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '0dd4eda6-95aa-4130-87e5-2986d6b95536'} Oct 27 03:43:11.691799 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:43:11.691799 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:43:11.691799 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:43:11.691799 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:43:11.691799 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:43:11.691799 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:43:11.691799 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:43:11.691799 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:43:11.691799 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:43:11.691799 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:43:11.691799 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0dd4eda6-95aa-4130-87e5-2986d6b95536 could not be found. Oct 27 03:43:11.691799 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:43:11.691799 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:43:11.691799 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:43:11.691799 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:43:11.691799 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:43:11.691799 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:43:11.691799 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:43:11.691799 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:43:11.691799 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:43:11.691799 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:43:11.691799 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:43:11.691799 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:43:11.691799 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:43:11.691799 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:43:11.691799 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:43:11.691799 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:43:11.691799 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0dd4eda6-95aa-4130-87e5-2986d6b95536 could not be found. Oct 27 03:43:11.691799 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:43:11.691799 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:43:11.691799 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:43:11.696408 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:43:11.696408 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:43:11.696408 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:43:11.696408 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:43:11.696408 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:43:11.696408 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0dd4eda6-95aa-4130-87e5-2986d6b95536 could not be found. Oct 27 03:43:11.696408 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:43:11.696408 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-106de27c-a30e-463f-b29b-8ba7c5b3e03c tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Returning 404 to user: Instance 0dd4eda6-95aa-4130-87e5-2986d6b95536 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:43:11.696408 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-106de27c-a30e-463f-b29b-8ba7c5b3e03c tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] 10.222.0.20 "GET /compute/v2.1/servers/0dd4eda6-95aa-4130-87e5-2986d6b95536" status: 404 len: 111 microversion: 2.1 time: 0.100503 Oct 27 03:43:11.698438 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2468/5232] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:43:11 2022] GET /compute/v2.1/servers/0dd4eda6-95aa-4130-87e5-2986d6b95536 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:43:11.714336 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7360e5e4-72aa-455f-9860-4a1e8151078b tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:11.714875 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7360e5e4-72aa-455f-9860-4a1e8151078b tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] [instance: 20bed685-d855-499c-90d6-f8c59cfbd701] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:11.732779 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7360e5e4-72aa-455f-9860-4a1e8151078b tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:11.733321 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7360e5e4-72aa-455f-9860-4a1e8151078b tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:11.733783 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7360e5e4-72aa-455f-9860-4a1e8151078b tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:11.736309 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7360e5e4-72aa-455f-9860-4a1e8151078b tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:11.737901 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7360e5e4-72aa-455f-9860-4a1e8151078b tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:11.739872 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7360e5e4-72aa-455f-9860-4a1e8151078b tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:11.803644 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:43:11.816918 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-b21f460e-142e-47ff-93cc-6e4e1d2bfd5d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Flavor limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:43:11.817351 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-b21f460e-142e-47ff-93cc-6e4e1d2bfd5d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Image limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:43:11.818719 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-b21f460e-142e-47ff-93cc-6e4e1d2bfd5d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Flavor pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:43:11.818826 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7360e5e4-72aa-455f-9860-4a1e8151078b tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] [instance: 20bed685-d855-499c-90d6-f8c59cfbd701] Going to try to terminate instance {{(pid=121000) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:43:11.818912 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-b21f460e-142e-47ff-93cc-6e4e1d2bfd5d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Image pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:43:11.819059 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-b21f460e-142e-47ff-93cc-6e4e1d2bfd5d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:43:11.836339 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b21f460e-142e-47ff-93cc-6e4e1d2bfd5d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:11.839889 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b21f460e-142e-47ff-93cc-6e4e1d2bfd5d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:11.840160 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b21f460e-142e-47ff-93cc-6e4e1d2bfd5d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:11.840999 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b21f460e-142e-47ff-93cc-6e4e1d2bfd5d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:11.841469 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b21f460e-142e-47ff-93cc-6e4e1d2bfd5d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:11.841905 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b21f460e-142e-47ff-93cc-6e4e1d2bfd5d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:11.890685 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-b21f460e-142e-47ff-93cc-6e4e1d2bfd5d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Getting quotas for project c48bca00e4d445918f030bf885424b40. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:43:11.902209 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-b21f460e-142e-47ff-93cc-6e4e1d2bfd5d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Getting quotas for user b74e8d6facd1460ab31a3ce4b24dd315 and project c48bca00e4d445918f030bf885424b40. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:43:11.939779 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b21f460e-142e-47ff-93cc-6e4e1d2bfd5d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Going to run 1 instances... {{(pid=121001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:43:11.950738 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b21f460e-142e-47ff-93cc-6e4e1d2bfd5d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 1db2318e-9ac7-4994-8daa-14ae22537d5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:43:12.124573 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b21f460e-142e-47ff-93cc-6e4e1d2bfd5d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.981575 Oct 27 03:43:12.126446 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2765/5233] 10.222.0.20 () {62 vars in 1188 bytes} [Thu Oct 27 03:43:10 2022] POST /compute/v2.1/servers => generated 401 bytes in 1985 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 27 03:43:12.139485 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6e131263-efe1-4d18-9231-7c01e718d817 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:12.142120 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-6e131263-efe1-4d18-9231-7c01e718d817 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 1db2318e-9ac7-4994-8daa-14ae22537d5d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:12.211484 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7360e5e4-72aa-455f-9860-4a1e8151078b tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] 10.222.0.20 "DELETE /compute/v2.1/servers/20bed685-d855-499c-90d6-f8c59cfbd701" status: 204 len: 0 microversion: 2.1 time: 0.508157 Oct 27 03:43:12.218992 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2469/5234] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:43:11 2022] DELETE /compute/v2.1/servers/20bed685-d855-499c-90d6-f8c59cfbd701 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:43:12.236389 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6e55144a-cc30-4534-9bfd-c6c0f791aa67 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:12.243510 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6e131263-efe1-4d18-9231-7c01e718d817 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:12.251605 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6e131263-efe1-4d18-9231-7c01e718d817 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:12.255294 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6e131263-efe1-4d18-9231-7c01e718d817 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:12.256272 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6e55144a-cc30-4534-9bfd-c6c0f791aa67 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] [instance: 20bed685-d855-499c-90d6-f8c59cfbd701] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:12.257462 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6e131263-efe1-4d18-9231-7c01e718d817 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d" status: 200 len: 1281 microversion: 2.20 time: 0.122280 Oct 27 03:43:12.258596 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2766/5235] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:43:12 2022] GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d => generated 1281 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:43:12.276918 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6e55144a-cc30-4534-9bfd-c6c0f791aa67 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:12.277430 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6e55144a-cc30-4534-9bfd-c6c0f791aa67 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:12.277881 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6e55144a-cc30-4534-9bfd-c6c0f791aa67 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:12.295173 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6e55144a-cc30-4534-9bfd-c6c0f791aa67 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:12.295173 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6e55144a-cc30-4534-9bfd-c6c0f791aa67 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:12.295173 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6e55144a-cc30-4534-9bfd-c6c0f791aa67 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:12.618434 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e35561da-ef3b-4a58-af01-7036ce846170 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:12.619168 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e35561da-ef3b-4a58-af01-7036ce846170 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: 55152bbe-5a47-4916-ad12-5f1640f0be61] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:12.629079 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e35561da-ef3b-4a58-af01-7036ce846170 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:12.629758 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e35561da-ef3b-4a58-af01-7036ce846170 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:12.630266 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e35561da-ef3b-4a58-af01-7036ce846170 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:12.637353 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e35561da-ef3b-4a58-af01-7036ce846170 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:12.637353 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e35561da-ef3b-4a58-af01-7036ce846170 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:12.637353 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e35561da-ef3b-4a58-af01-7036ce846170 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:12.727793 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-6e55144a-cc30-4534-9bfd-c6c0f791aa67 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82daefe001364499b2ee9eb7da2599be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:12.744433 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6e55144a-cc30-4534-9bfd-c6c0f791aa67 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] 10.222.0.20 "GET /compute/v2.1/servers/20bed685-d855-499c-90d6-f8c59cfbd701" status: 200 len: 1518 microversion: 2.1 time: 0.520679 Oct 27 03:43:12.745169 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2470/5236] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:43:12 2022] GET /compute/v2.1/servers/20bed685-d855-499c-90d6-f8c59cfbd701 => generated 1518 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:43:12.960863 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e35561da-ef3b-4a58-af01-7036ce846170 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:12.970474 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e35561da-ef3b-4a58-af01-7036ce846170 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61" status: 200 len: 1508 microversion: 2.1 time: 0.355431 Oct 27 03:43:12.971300 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2767/5237] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:43:12 2022] GET /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61 => generated 1508 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:43:12.999709 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e9b3872f-8380-41af-9dc7-bfebe3c19232 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:13.000567 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e9b3872f-8380-41af-9dc7-bfebe3c19232 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: 55152bbe-5a47-4916-ad12-5f1640f0be61] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:13.012248 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e9b3872f-8380-41af-9dc7-bfebe3c19232 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:13.014124 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e9b3872f-8380-41af-9dc7-bfebe3c19232 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:13.019033 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e9b3872f-8380-41af-9dc7-bfebe3c19232 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:13.019033 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e9b3872f-8380-41af-9dc7-bfebe3c19232 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:13.022583 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e9b3872f-8380-41af-9dc7-bfebe3c19232 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:13.023224 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e9b3872f-8380-41af-9dc7-bfebe3c19232 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:13.288901 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e9b3872f-8380-41af-9dc7-bfebe3c19232 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:13.294763 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5ca9f196-65a6-4855-8697-90b8abbf8c48 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:13.299781 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5ca9f196-65a6-4855-8697-90b8abbf8c48 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 1db2318e-9ac7-4994-8daa-14ae22537d5d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:13.310556 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e9b3872f-8380-41af-9dc7-bfebe3c19232 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61" status: 200 len: 1508 microversion: 2.1 time: 0.315233 Oct 27 03:43:13.311666 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2471/5238] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:43:12 2022] GET /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61 => generated 1508 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:43:13.343006 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9f915fc3-d1e7-4692-b833-58c42a5c1509 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "OS-DCF:diskConfig": "AUTO"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:43:13.345751 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9f915fc3-d1e7-4692-b833-58c42a5c1509 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: 55152bbe-5a47-4916-ad12-5f1640f0be61] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:13.363788 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9f915fc3-d1e7-4692-b833-58c42a5c1509 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:13.364491 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9f915fc3-d1e7-4692-b833-58c42a5c1509 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:13.365465 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9f915fc3-d1e7-4692-b833-58c42a5c1509 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:13.366939 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9f915fc3-d1e7-4692-b833-58c42a5c1509 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:13.367572 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9f915fc3-d1e7-4692-b833-58c42a5c1509 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:13.368348 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9f915fc3-d1e7-4692-b833-58c42a5c1509 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:13.388781 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5ca9f196-65a6-4855-8697-90b8abbf8c48 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:13.396528 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5ca9f196-65a6-4855-8697-90b8abbf8c48 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:13.397726 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5ca9f196-65a6-4855-8697-90b8abbf8c48 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:13.403123 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5ca9f196-65a6-4855-8697-90b8abbf8c48 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d" status: 200 len: 1281 microversion: 2.20 time: 0.123527 Oct 27 03:43:13.418439 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2768/5239] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:43:13 2022] GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d => generated 1281 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:43:13.492663 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-9f915fc3-d1e7-4692-b833-58c42a5c1509 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:43:13.492663 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-9f915fc3-d1e7-4692-b833-58c42a5c1509 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:43:13.492663 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-9f915fc3-d1e7-4692-b833-58c42a5c1509 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:43:13.492663 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-9f915fc3-d1e7-4692-b833-58c42a5c1509 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:43:13.492663 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-9f915fc3-d1e7-4692-b833-58c42a5c1509 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:43:13.764435 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9f915fc3-d1e7-4692-b833-58c42a5c1509 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: 55152bbe-5a47-4916-ad12-5f1640f0be61] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:13.770568 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-316cd4a5-e94c-457b-bb9d-40f2f75c4abe tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:13.775424 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-316cd4a5-e94c-457b-bb9d-40f2f75c4abe tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] [instance: 20bed685-d855-499c-90d6-f8c59cfbd701] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:13.779122 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9f915fc3-d1e7-4692-b833-58c42a5c1509 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:13.779636 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9f915fc3-d1e7-4692-b833-58c42a5c1509 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:13.780094 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9f915fc3-d1e7-4692-b833-58c42a5c1509 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:13.783006 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9f915fc3-d1e7-4692-b833-58c42a5c1509 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:13.783006 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9f915fc3-d1e7-4692-b833-58c42a5c1509 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:13.784762 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9f915fc3-d1e7-4692-b833-58c42a5c1509 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:13.802077 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-316cd4a5-e94c-457b-bb9d-40f2f75c4abe tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:13.803178 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-316cd4a5-e94c-457b-bb9d-40f2f75c4abe tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:13.803634 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-316cd4a5-e94c-457b-bb9d-40f2f75c4abe tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:13.804379 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-316cd4a5-e94c-457b-bb9d-40f2f75c4abe tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:13.804860 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-316cd4a5-e94c-457b-bb9d-40f2f75c4abe tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:13.805292 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-316cd4a5-e94c-457b-bb9d-40f2f75c4abe tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:13.856396 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9f915fc3-d1e7-4692-b833-58c42a5c1509 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "POST /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61/action" status: 202 len: 1110 microversion: 2.1 time: 0.520924 Oct 27 03:43:13.871154 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2472/5240] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:43:13 2022] POST /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61/action => generated 1110 bytes in 536 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 27 03:43:13.879160 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-37efcd90-b240-49fe-86cd-1b840a5d3c5f tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:13.880466 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-37efcd90-b240-49fe-86cd-1b840a5d3c5f tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: 55152bbe-5a47-4916-ad12-5f1640f0be61] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:13.899601 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-37efcd90-b240-49fe-86cd-1b840a5d3c5f tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:13.905121 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-37efcd90-b240-49fe-86cd-1b840a5d3c5f tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:13.907180 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-37efcd90-b240-49fe-86cd-1b840a5d3c5f tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:13.910628 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-37efcd90-b240-49fe-86cd-1b840a5d3c5f tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:13.911354 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-37efcd90-b240-49fe-86cd-1b840a5d3c5f tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:13.919360 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-37efcd90-b240-49fe-86cd-1b840a5d3c5f tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:14.158952 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-316cd4a5-e94c-457b-bb9d-40f2f75c4abe tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82daefe001364499b2ee9eb7da2599be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:14.171133 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-316cd4a5-e94c-457b-bb9d-40f2f75c4abe tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] 10.222.0.20 "GET /compute/v2.1/servers/20bed685-d855-499c-90d6-f8c59cfbd701" status: 200 len: 1518 microversion: 2.1 time: 0.405020 Oct 27 03:43:14.190169 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2769/5241] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:43:13 2022] GET /compute/v2.1/servers/20bed685-d855-499c-90d6-f8c59cfbd701 => generated 1518 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:43:14.392075 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-37efcd90-b240-49fe-86cd-1b840a5d3c5f tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:14.403958 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-37efcd90-b240-49fe-86cd-1b840a5d3c5f tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61" status: 200 len: 1515 microversion: 2.1 time: 0.531260 Oct 27 03:43:14.420284 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2473/5242] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:43:13 2022] GET /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61 => generated 1515 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:43:14.431519 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-828c79f4-1559-4ce4-9f3c-53be2eee40b9 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:14.432827 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-828c79f4-1559-4ce4-9f3c-53be2eee40b9 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 1db2318e-9ac7-4994-8daa-14ae22537d5d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:14.442673 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-828c79f4-1559-4ce4-9f3c-53be2eee40b9 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:14.444063 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-828c79f4-1559-4ce4-9f3c-53be2eee40b9 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:14.446243 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-828c79f4-1559-4ce4-9f3c-53be2eee40b9 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:14.447255 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-828c79f4-1559-4ce4-9f3c-53be2eee40b9 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:14.447929 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-828c79f4-1559-4ce4-9f3c-53be2eee40b9 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:14.448631 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-828c79f4-1559-4ce4-9f3c-53be2eee40b9 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:14.608876 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-828c79f4-1559-4ce4-9f3c-53be2eee40b9 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:14.624091 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-828c79f4-1559-4ce4-9f3c-53be2eee40b9 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:14.626823 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-828c79f4-1559-4ce4-9f3c-53be2eee40b9 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:14.628312 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-828c79f4-1559-4ce4-9f3c-53be2eee40b9 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d" status: 200 len: 1333 microversion: 2.20 time: 0.202175 Oct 27 03:43:14.631275 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2770/5243] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:43:14 2022] GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d => generated 1333 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:43:14.747055 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-aaa26c03-3df7-4396-a642-4a6c29dcbcd0 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-467087539", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "13518e9c-733a-4655-9e92-8d0d06018415"}], "security_groups": [{"name": "tempest-securitygroup--1178606888"}], "key_name": "tempest-keypair-859936746", "user_data": "}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:43:14.926198 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-aaa26c03-3df7-4396-a642-4a6c29dcbcd0 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] validate_networks() for [('13518e9c-733a-4655-9e92-8d0d06018415', None, None, None, None, None)] {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:43:15.196322 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f722f5cc-387b-480c-bfc1-c6f9a0fd80b9 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:15.197313 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f722f5cc-387b-480c-bfc1-c6f9a0fd80b9 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] [instance: 20bed685-d855-499c-90d6-f8c59cfbd701] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:15.206021 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f722f5cc-387b-480c-bfc1-c6f9a0fd80b9 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:15.206771 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f722f5cc-387b-480c-bfc1-c6f9a0fd80b9 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:15.207380 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f722f5cc-387b-480c-bfc1-c6f9a0fd80b9 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:15.208275 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f722f5cc-387b-480c-bfc1-c6f9a0fd80b9 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:15.208925 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f722f5cc-387b-480c-bfc1-c6f9a0fd80b9 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:15.209518 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f722f5cc-387b-480c-bfc1-c6f9a0fd80b9 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:15.562411 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-aaa26c03-3df7-4396-a642-4a6c29dcbcd0 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:43:15.569755 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-aaa26c03-3df7-4396-a642-4a6c29dcbcd0 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:43:15.570528 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-aaa26c03-3df7-4396-a642-4a6c29dcbcd0 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:43:15.571133 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-aaa26c03-3df7-4396-a642-4a6c29dcbcd0 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:43:15.571574 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-aaa26c03-3df7-4396-a642-4a6c29dcbcd0 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:43:15.590924 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aaa26c03-3df7-4396-a642-4a6c29dcbcd0 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:15.596756 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aaa26c03-3df7-4396-a642-4a6c29dcbcd0 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:15.597463 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aaa26c03-3df7-4396-a642-4a6c29dcbcd0 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:15.598484 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aaa26c03-3df7-4396-a642-4a6c29dcbcd0 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:15.599217 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aaa26c03-3df7-4396-a642-4a6c29dcbcd0 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:15.600124 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aaa26c03-3df7-4396-a642-4a6c29dcbcd0 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:15.635175 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-aaa26c03-3df7-4396-a642-4a6c29dcbcd0 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Getting quotas for project e1f3ed7ef6c648c9ac771fbaadde1d0c. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:43:15.642616 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-aaa26c03-3df7-4396-a642-4a6c29dcbcd0 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Getting quotas for user 43172c9e71704c869a25181574d67b35 and project e1f3ed7ef6c648c9ac771fbaadde1d0c. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:43:15.657568 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-aaa26c03-3df7-4396-a642-4a6c29dcbcd0 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:43:15.665529 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-aaa26c03-3df7-4396-a642-4a6c29dcbcd0 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: dbdbec9a-f4bf-4740-ab67-3c8891e341a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:43:15.835757 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-aaa26c03-3df7-4396-a642-4a6c29dcbcd0 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.096949 Oct 27 03:43:15.836819 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2474/5244] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:43:14 2022] POST /compute/v2.1/servers => generated 409 bytes in 1100 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 03:43:15.841991 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c4a071f8-3dd9-4cc8-bf93-2327210cd714 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:15.848158 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c4a071f8-3dd9-4cc8-bf93-2327210cd714 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: 55152bbe-5a47-4916-ad12-5f1640f0be61] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:15.871445 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c4a071f8-3dd9-4cc8-bf93-2327210cd714 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:15.871984 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c4a071f8-3dd9-4cc8-bf93-2327210cd714 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:15.872463 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c4a071f8-3dd9-4cc8-bf93-2327210cd714 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:15.878625 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c4a071f8-3dd9-4cc8-bf93-2327210cd714 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:15.880499 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c4a071f8-3dd9-4cc8-bf93-2327210cd714 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:15.881930 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c4a071f8-3dd9-4cc8-bf93-2327210cd714 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:15.958234 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f722f5cc-387b-480c-bfc1-c6f9a0fd80b9 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82daefe001364499b2ee9eb7da2599be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:15.972675 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f722f5cc-387b-480c-bfc1-c6f9a0fd80b9 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] 10.222.0.20 "GET /compute/v2.1/servers/20bed685-d855-499c-90d6-f8c59cfbd701" status: 200 len: 1518 microversion: 2.1 time: 0.778803 Oct 27 03:43:15.973994 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2771/5245] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:43:15 2022] GET /compute/v2.1/servers/20bed685-d855-499c-90d6-f8c59cfbd701 => generated 1518 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:43:15.994878 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b05fa149-cff8-4135-baba-5669a6d3de0c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:15.995512 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b05fa149-cff8-4135-baba-5669a6d3de0c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 1db2318e-9ac7-4994-8daa-14ae22537d5d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:16.003803 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b05fa149-cff8-4135-baba-5669a6d3de0c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:16.004311 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b05fa149-cff8-4135-baba-5669a6d3de0c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:16.004755 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b05fa149-cff8-4135-baba-5669a6d3de0c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:16.005533 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b05fa149-cff8-4135-baba-5669a6d3de0c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:16.005997 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b05fa149-cff8-4135-baba-5669a6d3de0c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:16.006458 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b05fa149-cff8-4135-baba-5669a6d3de0c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:16.152678 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b05fa149-cff8-4135-baba-5669a6d3de0c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:16.158365 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c4a071f8-3dd9-4cc8-bf93-2327210cd714 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:16.166544 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b05fa149-cff8-4135-baba-5669a6d3de0c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:16.171877 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c4a071f8-3dd9-4cc8-bf93-2327210cd714 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61" status: 200 len: 1515 microversion: 2.1 time: 0.332260 Oct 27 03:43:16.172897 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b05fa149-cff8-4135-baba-5669a6d3de0c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:16.174363 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b05fa149-cff8-4135-baba-5669a6d3de0c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d" status: 200 len: 1351 microversion: 2.20 time: 0.198379 Oct 27 03:43:16.174989 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2475/5246] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:43:15 2022] GET /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61 => generated 1515 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:43:16.176798 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2772/5247] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:43:15 2022] GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d => generated 1351 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:43:16.206005 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b2da6189-9c8b-4661-9b7e-18cf9b044952 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:16.210434 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b2da6189-9c8b-4661-9b7e-18cf9b044952 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: dbdbec9a-f4bf-4740-ab67-3c8891e341a1] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:16.312581 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b2da6189-9c8b-4661-9b7e-18cf9b044952 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:16.322377 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b2da6189-9c8b-4661-9b7e-18cf9b044952 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1" status: 200 len: 1244 microversion: 2.1 time: 0.130921 Oct 27 03:43:16.334347 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2476/5248] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:43:16 2022] GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1 => generated 1244 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:43:16.375487 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-9a588c76-4fe6-4ea4-bfe2-ccf3e8d583f0 req-b158a3ff-e2f7-441a-9549-0555b23d93fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20bed685-d855-499c-90d6-f8c59cfbd701", "name": "network-vif-deleted", "tag": "c626dbd5-9bf5-461f-9f93-96b9e1015065"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:43:16.393884 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-9a588c76-4fe6-4ea4-bfe2-ccf3e8d583f0 req-b158a3ff-e2f7-441a-9549-0555b23d93fd service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:16.395755 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-9a588c76-4fe6-4ea4-bfe2-ccf3e8d583f0 req-b158a3ff-e2f7-441a-9549-0555b23d93fd service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:16.396378 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-9a588c76-4fe6-4ea4-bfe2-ccf3e8d583f0 req-b158a3ff-e2f7-441a-9549-0555b23d93fd service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:16.417354 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-9a588c76-4fe6-4ea4-bfe2-ccf3e8d583f0 req-b158a3ff-e2f7-441a-9549-0555b23d93fd service nova] Creating event network-vif-deleted:c626dbd5-9bf5-461f-9f93-96b9e1015065 for instance 20bed685-d855-499c-90d6-f8c59cfbd701 on n-h2-862769-1 Oct 27 03:43:16.425727 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-9a588c76-4fe6-4ea4-bfe2-ccf3e8d583f0 req-b158a3ff-e2f7-441a-9549-0555b23d93fd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055260 Oct 27 03:43:16.426846 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2773/5249] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:43:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:43:16.997256 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5088977b-20bd-45dc-bcd6-20d383514a29 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:16.997885 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5088977b-20bd-45dc-bcd6-20d383514a29 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] [instance: 20bed685-d855-499c-90d6-f8c59cfbd701] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:17.004821 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:INSERT=5 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:43:17.007544 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5088977b-20bd-45dc-bcd6-20d383514a29 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:17.008513 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5088977b-20bd-45dc-bcd6-20d383514a29 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:17.009122 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5088977b-20bd-45dc-bcd6-20d383514a29 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:17.010370 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5088977b-20bd-45dc-bcd6-20d383514a29 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:17.011001 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5088977b-20bd-45dc-bcd6-20d383514a29 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:17.011591 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5088977b-20bd-45dc-bcd6-20d383514a29 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:17.058116 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5088977b-20bd-45dc-bcd6-20d383514a29 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:17.059215 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5088977b-20bd-45dc-bcd6-20d383514a29 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:17.060079 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5088977b-20bd-45dc-bcd6-20d383514a29 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:17.060566 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-5088977b-20bd-45dc-bcd6-20d383514a29 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lazy-loading 'fault' on Instance uuid 20bed685-d855-499c-90d6-f8c59cfbd701 {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:43:17.143333 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5088977b-20bd-45dc-bcd6-20d383514a29 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82daefe001364499b2ee9eb7da2599be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98617e3a5b6c449c88449c236a8f2ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:17.159211 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5088977b-20bd-45dc-bcd6-20d383514a29 tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] 10.222.0.20 "GET /compute/v2.1/servers/20bed685-d855-499c-90d6-f8c59cfbd701" status: 200 len: 1311 microversion: 2.1 time: 0.165438 Oct 27 03:43:17.171496 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2477/5250] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:43:16 2022] GET /compute/v2.1/servers/20bed685-d855-499c-90d6-f8c59cfbd701 => generated 1311 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:43:17.200722 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-cdcfcaa2-0749-48af-bad4-0ad65aa52e68 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:17.202778 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-cdcfcaa2-0749-48af-bad4-0ad65aa52e68 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: 55152bbe-5a47-4916-ad12-5f1640f0be61] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:17.221524 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cdcfcaa2-0749-48af-bad4-0ad65aa52e68 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:17.222265 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cdcfcaa2-0749-48af-bad4-0ad65aa52e68 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:17.222446 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3bdf0fa3-586e-44b9-951a-a5cd190c54cd tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:17.223227 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-3bdf0fa3-586e-44b9-951a-a5cd190c54cd tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 1db2318e-9ac7-4994-8daa-14ae22537d5d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:17.223858 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cdcfcaa2-0749-48af-bad4-0ad65aa52e68 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:17.225833 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cdcfcaa2-0749-48af-bad4-0ad65aa52e68 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:17.228094 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cdcfcaa2-0749-48af-bad4-0ad65aa52e68 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:17.228628 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cdcfcaa2-0749-48af-bad4-0ad65aa52e68 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:17.239576 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3bdf0fa3-586e-44b9-951a-a5cd190c54cd tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:17.247314 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3bdf0fa3-586e-44b9-951a-a5cd190c54cd tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:17.248194 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3bdf0fa3-586e-44b9-951a-a5cd190c54cd tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:17.249338 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3bdf0fa3-586e-44b9-951a-a5cd190c54cd tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:17.250904 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3bdf0fa3-586e-44b9-951a-a5cd190c54cd tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:17.251723 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3bdf0fa3-586e-44b9-951a-a5cd190c54cd tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:17.539957 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-3bdf0fa3-586e-44b9-951a-a5cd190c54cd tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:17.565447 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-3bdf0fa3-586e-44b9-951a-a5cd190c54cd tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:17.566949 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-3bdf0fa3-586e-44b9-951a-a5cd190c54cd tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:17.575330 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-cdcfcaa2-0749-48af-bad4-0ad65aa52e68 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:17.578992 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3bdf0fa3-586e-44b9-951a-a5cd190c54cd tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d" status: 200 len: 1406 microversion: 2.20 time: 0.370340 Oct 27 03:43:17.579615 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2478/5251] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:43:17 2022] GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d => generated 1406 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:43:17.585573 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-cdcfcaa2-0749-48af-bad4-0ad65aa52e68 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61" status: 200 len: 1515 microversion: 2.1 time: 0.392475 Oct 27 03:43:17.589125 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2774/5252] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:43:17 2022] GET /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61 => generated 1515 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:43:17.619160 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e28a56d5-220d-4012-8f5b-81fb13eb6ec7 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:17.621623 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e28a56d5-220d-4012-8f5b-81fb13eb6ec7 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: dbdbec9a-f4bf-4740-ab67-3c8891e341a1] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:17.630398 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e28a56d5-220d-4012-8f5b-81fb13eb6ec7 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:17.631795 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e28a56d5-220d-4012-8f5b-81fb13eb6ec7 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:17.632494 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e28a56d5-220d-4012-8f5b-81fb13eb6ec7 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:17.633427 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e28a56d5-220d-4012-8f5b-81fb13eb6ec7 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:17.634805 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e28a56d5-220d-4012-8f5b-81fb13eb6ec7 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:17.635769 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e28a56d5-220d-4012-8f5b-81fb13eb6ec7 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:17.789105 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e28a56d5-220d-4012-8f5b-81fb13eb6ec7 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:17.805340 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e28a56d5-220d-4012-8f5b-81fb13eb6ec7 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1" status: 200 len: 1248 microversion: 2.1 time: 0.200164 Oct 27 03:43:17.817152 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2479/5253] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:43:17 2022] GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1 => generated 1248 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:43:18.191079 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-44b99d09-930a-4188-9ab6-b7f0e7b7802e tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:18.192426 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-44b99d09-930a-4188-9ab6-b7f0e7b7802e tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] [instance: 20bed685-d855-499c-90d6-f8c59cfbd701] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:18.211019 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-44b99d09-930a-4188-9ab6-b7f0e7b7802e tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:18.213004 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-44b99d09-930a-4188-9ab6-b7f0e7b7802e tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:18.214024 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-44b99d09-930a-4188-9ab6-b7f0e7b7802e tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:18.217272 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-44b99d09-930a-4188-9ab6-b7f0e7b7802e tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:18.219168 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-44b99d09-930a-4188-9ab6-b7f0e7b7802e tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:18.220761 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-44b99d09-930a-4188-9ab6-b7f0e7b7802e tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:18.256221 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-44b99d09-930a-4188-9ab6-b7f0e7b7802e tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] HTTP exception thrown: Instance 20bed685-d855-499c-90d6-f8c59cfbd701 could not be found. Oct 27 03:43:18.260016 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-44b99d09-930a-4188-9ab6-b7f0e7b7802e tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Request method failure captured: Oct 27 03:43:18.260016 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/20bed685-d855-499c-90d6-f8c59cfbd701 HTTP/1.1 Oct 27 03:43:18.260016 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:43:18.260016 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:43:18.260016 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:43:18.260016 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:43:18.260016 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:43:18.260016 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:43:18.260016 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:43:18.260016 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:43:18.260016 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWf4KJy8RSxzaHk_-CZ3sEEqRoKqs6c4PVSXoJpj_sCGU6N3kvbwGZxVDPnp45mPrN57LYtsrxSyFhwgvPnW9IjsqSFQKRcxP8mp91tWW1jyf6ZsFcMuPIu9-teuZ1cktYxjepcqSJ6PT0Y06spksKtYr20dvet7sEfLwY7DDXILQbI0 Oct 27 03:43:18.260016 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:43:18.260016 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:43:18.260016 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:43:18.260016 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:43:18.260016 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:43:18.260016 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:43:18.260016 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 98617e3a5b6c449c88449c236a8f2ecf Oct 27 03:43:18.260016 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ListServerFiltersTestJSON-1238636021 Oct 27 03:43:18.260016 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:43:18.260016 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:43:18.260016 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/98617e3a5b6c449c88449c236a8f2ecf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/98617e3a5b6c449c88449c236a8f2ecf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/98617e3a5b6c449c88449c236a8f2ecf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_98617e3a5b6c449c88449c236a8f2ecf"}]}] Oct 27 03:43:18.260016 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ListServerFiltersTestJSON-1238636021 Oct 27 03:43:18.260016 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 98617e3a5b6c449c88449c236a8f2ecf Oct 27 03:43:18.260016 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1238636021 Oct 27 03:43:18.260016 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ListServerFiltersTestJSON-1238636021-project Oct 27 03:43:18.260016 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:43:18.260016 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:43:18.260016 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 82daefe001364499b2ee9eb7da2599be Oct 27 03:43:18.260016 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ListServerFiltersTestJSON-1238636021-project Oct 27 03:43:18.260016 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:43:18.260016 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 20bed685-d855-499c-90d6-f8c59cfbd701 could not be found. Oct 27 03:43:18.260016 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '20bed685-d855-499c-90d6-f8c59cfbd701'} Oct 27 03:43:18.260016 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:43:18.260016 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:43:18.260016 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:43:18.260016 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:43:18.260016 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:43:18.260016 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:43:18.260016 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:43:18.260016 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:43:18.260016 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:43:18.260016 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:43:18.260016 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20bed685-d855-499c-90d6-f8c59cfbd701 could not be found. Oct 27 03:43:18.260016 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:43:18.260016 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:43:18.260016 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:43:18.260016 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:43:18.260016 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:43:18.260016 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:43:18.260016 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:43:18.260016 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:43:18.260016 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:43:18.260016 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:43:18.260016 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:43:18.260016 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:43:18.260016 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:43:18.260016 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:43:18.260016 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:43:18.260016 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:43:18.260016 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20bed685-d855-499c-90d6-f8c59cfbd701 could not be found. Oct 27 03:43:18.260016 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:43:18.260016 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:43:18.260016 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:43:18.264670 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:43:18.264670 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:43:18.264670 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:43:18.264670 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:43:18.264670 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:43:18.264670 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20bed685-d855-499c-90d6-f8c59cfbd701 could not be found. Oct 27 03:43:18.264670 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:43:18.264670 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-44b99d09-930a-4188-9ab6-b7f0e7b7802e tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] Returning 404 to user: Instance 20bed685-d855-499c-90d6-f8c59cfbd701 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:43:18.264670 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-44b99d09-930a-4188-9ab6-b7f0e7b7802e tempest-ListServerFiltersTestJSON-1238636021 tempest-ListServerFiltersTestJSON-1238636021-project] 10.222.0.20 "GET /compute/v2.1/servers/20bed685-d855-499c-90d6-f8c59cfbd701" status: 404 len: 111 microversion: 2.1 time: 0.080754 Oct 27 03:43:18.264670 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2775/5254] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:43:18 2022] GET /compute/v2.1/servers/20bed685-d855-499c-90d6-f8c59cfbd701 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:43:18.605728 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9b787db4-7e6f-4936-8575-abd8b4312e88 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:18.606324 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9b787db4-7e6f-4936-8575-abd8b4312e88 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 1db2318e-9ac7-4994-8daa-14ae22537d5d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:18.614632 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9b787db4-7e6f-4936-8575-abd8b4312e88 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:18.615673 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9b787db4-7e6f-4936-8575-abd8b4312e88 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:18.616122 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9b787db4-7e6f-4936-8575-abd8b4312e88 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:18.617206 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9b787db4-7e6f-4936-8575-abd8b4312e88 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:18.617621 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9b787db4-7e6f-4936-8575-abd8b4312e88 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:18.618129 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9b787db4-7e6f-4936-8575-abd8b4312e88 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:18.621392 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c8459508-38ec-467c-b811-b3ee03caa94e tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:18.622223 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c8459508-38ec-467c-b811-b3ee03caa94e tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: 55152bbe-5a47-4916-ad12-5f1640f0be61] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:18.628988 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c8459508-38ec-467c-b811-b3ee03caa94e tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:18.629603 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c8459508-38ec-467c-b811-b3ee03caa94e tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:18.630073 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c8459508-38ec-467c-b811-b3ee03caa94e tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:18.631709 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c8459508-38ec-467c-b811-b3ee03caa94e tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:18.632831 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c8459508-38ec-467c-b811-b3ee03caa94e tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:18.633475 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c8459508-38ec-467c-b811-b3ee03caa94e tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:18.863443 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9b787db4-7e6f-4936-8575-abd8b4312e88 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:18.876306 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9b787db4-7e6f-4936-8575-abd8b4312e88 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:18.878677 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9b787db4-7e6f-4936-8575-abd8b4312e88 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:18.882414 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9b787db4-7e6f-4936-8575-abd8b4312e88 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d" status: 200 len: 1406 microversion: 2.20 time: 0.281075 Oct 27 03:43:18.887396 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2480/5255] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:43:18 2022] GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d => generated 1406 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:43:18.892379 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-aaed5f73-90d2-4af0-b612-fea44f592b47 req-a3e29a43-c736-45f0-b29e-3a8e5ae22c12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1db2318e-9ac7-4994-8daa-14ae22537d5d", "tag": "162a3612-f72a-4eb0-9872-8b121e85445d"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:43:18.915817 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c8459508-38ec-467c-b811-b3ee03caa94e tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:18.922970 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-aaed5f73-90d2-4af0-b612-fea44f592b47 req-a3e29a43-c736-45f0-b29e-3a8e5ae22c12 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:18.923454 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-aaed5f73-90d2-4af0-b612-fea44f592b47 req-a3e29a43-c736-45f0-b29e-3a8e5ae22c12 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:18.923890 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-aaed5f73-90d2-4af0-b612-fea44f592b47 req-a3e29a43-c736-45f0-b29e-3a8e5ae22c12 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:18.925025 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c8459508-38ec-467c-b811-b3ee03caa94e tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61" status: 200 len: 1515 microversion: 2.1 time: 0.308765 Oct 27 03:43:18.925715 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2776/5256] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:43:18 2022] GET /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61 => generated 1515 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:43:18.934629 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-26fba18a-06d8-4fc1-97bb-9635541745a2 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:18.935731 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-26fba18a-06d8-4fc1-97bb-9635541745a2 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: dbdbec9a-f4bf-4740-ab67-3c8891e341a1] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:18.953205 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-26fba18a-06d8-4fc1-97bb-9635541745a2 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:18.954284 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-26fba18a-06d8-4fc1-97bb-9635541745a2 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:18.955167 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-26fba18a-06d8-4fc1-97bb-9635541745a2 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:18.957094 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-26fba18a-06d8-4fc1-97bb-9635541745a2 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:18.957804 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-26fba18a-06d8-4fc1-97bb-9635541745a2 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:18.958499 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-26fba18a-06d8-4fc1-97bb-9635541745a2 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:18.971248 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-aaed5f73-90d2-4af0-b612-fea44f592b47 req-a3e29a43-c736-45f0-b29e-3a8e5ae22c12 service nova] Creating event network-changed:162a3612-f72a-4eb0-9872-8b121e85445d for instance 1db2318e-9ac7-4994-8daa-14ae22537d5d on n-h2-862769-1 Oct 27 03:43:18.979386 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-aaed5f73-90d2-4af0-b612-fea44f592b47 req-a3e29a43-c736-45f0-b29e-3a8e5ae22c12 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090650 Oct 27 03:43:18.983131 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2481/5257] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:43:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:43:19.218961 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-26fba18a-06d8-4fc1-97bb-9635541745a2 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:19.232939 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-26fba18a-06d8-4fc1-97bb-9635541745a2 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1" status: 200 len: 1296 microversion: 2.1 time: 0.303092 Oct 27 03:43:19.257568 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2777/5258] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:43:18 2022] GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1 => generated 1296 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:43:19.662734 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1e135831-9267-45e5-8e4d-542b826d193e tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:19.663603 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1e135831-9267-45e5-8e4d-542b826d193e tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] [instance: 7e73d534-0a40-42d2-813c-2e9dbb9239ac] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:19.678266 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1e135831-9267-45e5-8e4d-542b826d193e tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:19.679823 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1e135831-9267-45e5-8e4d-542b826d193e tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:19.680396 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1e135831-9267-45e5-8e4d-542b826d193e tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:19.681254 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1e135831-9267-45e5-8e4d-542b826d193e tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:19.683227 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1e135831-9267-45e5-8e4d-542b826d193e tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:19.684899 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1e135831-9267-45e5-8e4d-542b826d193e tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:19.749601 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1e135831-9267-45e5-8e4d-542b826d193e tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] [instance: 7e73d534-0a40-42d2-813c-2e9dbb9239ac] Going to try to terminate instance {{(pid=121000) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:43:19.911557 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:43:19.912490 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-985ffcc2-6403-4a30-a7c4-a36b90b7fa36 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:19.913468 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-985ffcc2-6403-4a30-a7c4-a36b90b7fa36 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 1db2318e-9ac7-4994-8daa-14ae22537d5d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:19.925918 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-985ffcc2-6403-4a30-a7c4-a36b90b7fa36 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:19.928397 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-985ffcc2-6403-4a30-a7c4-a36b90b7fa36 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:19.929187 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-985ffcc2-6403-4a30-a7c4-a36b90b7fa36 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:19.930309 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-985ffcc2-6403-4a30-a7c4-a36b90b7fa36 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:19.933046 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-985ffcc2-6403-4a30-a7c4-a36b90b7fa36 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:19.934379 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-985ffcc2-6403-4a30-a7c4-a36b90b7fa36 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:20.185872 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1e135831-9267-45e5-8e4d-542b826d193e tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac" status: 204 len: 0 microversion: 2.32 time: 0.942132 Oct 27 03:43:20.186913 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2482/5259] 10.222.0.20 () {60 vars in 1280 bytes} [Thu Oct 27 03:43:19 2022] DELETE /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac => generated 0 bytes in 944 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 27 03:43:20.199368 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5138cdf2-1871-43a3-9518-b2e28934a310 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:20.199368 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5138cdf2-1871-43a3-9518-b2e28934a310 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: 55152bbe-5a47-4916-ad12-5f1640f0be61] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:20.205556 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5138cdf2-1871-43a3-9518-b2e28934a310 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:20.206315 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5138cdf2-1871-43a3-9518-b2e28934a310 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:20.206963 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5138cdf2-1871-43a3-9518-b2e28934a310 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:20.207689 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5138cdf2-1871-43a3-9518-b2e28934a310 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:20.208338 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5138cdf2-1871-43a3-9518-b2e28934a310 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:20.209576 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5138cdf2-1871-43a3-9518-b2e28934a310 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:20.272792 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-985ffcc2-6403-4a30-a7c4-a36b90b7fa36 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:20.281902 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-985ffcc2-6403-4a30-a7c4-a36b90b7fa36 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:20.296936 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-985ffcc2-6403-4a30-a7c4-a36b90b7fa36 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:20.296936 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-985ffcc2-6403-4a30-a7c4-a36b90b7fa36 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d" status: 200 len: 1406 microversion: 2.20 time: 0.378898 Oct 27 03:43:20.296936 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2778/5260] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:43:19 2022] GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d => generated 1406 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:43:20.296936 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-97c079db-79a8-4c53-b071-c960813a5362 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:20.296936 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-97c079db-79a8-4c53-b071-c960813a5362 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] [instance: 7e73d534-0a40-42d2-813c-2e9dbb9239ac] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:20.297457 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-97c079db-79a8-4c53-b071-c960813a5362 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:20.297934 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-97c079db-79a8-4c53-b071-c960813a5362 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:20.298591 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-97c079db-79a8-4c53-b071-c960813a5362 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:20.299457 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-97c079db-79a8-4c53-b071-c960813a5362 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:20.300147 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-97c079db-79a8-4c53-b071-c960813a5362 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:20.300767 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-97c079db-79a8-4c53-b071-c960813a5362 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:20.774244 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-97c079db-79a8-4c53-b071-c960813a5362 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:20.785098 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-97c079db-79a8-4c53-b071-c960813a5362 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:20.786500 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-97c079db-79a8-4c53-b071-c960813a5362 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:20.788189 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-97c079db-79a8-4c53-b071-c960813a5362 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] 10.222.0.20 "GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac" status: 200 len: 2953 microversion: 2.32 time: 0.501439 Oct 27 03:43:20.803922 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2779/5261] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:43:20 2022] GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac => generated 2953 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:43:20.816984 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-83992274-191d-4adc-aaec-1f8fb4c53fb2 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:20.818586 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-83992274-191d-4adc-aaec-1f8fb4c53fb2 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: dbdbec9a-f4bf-4740-ab67-3c8891e341a1] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:20.824961 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-83992274-191d-4adc-aaec-1f8fb4c53fb2 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:20.825700 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-83992274-191d-4adc-aaec-1f8fb4c53fb2 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:20.826341 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-83992274-191d-4adc-aaec-1f8fb4c53fb2 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:20.827209 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-83992274-191d-4adc-aaec-1f8fb4c53fb2 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:20.827822 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-83992274-191d-4adc-aaec-1f8fb4c53fb2 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:20.828408 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-83992274-191d-4adc-aaec-1f8fb4c53fb2 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:20.843949 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5138cdf2-1871-43a3-9518-b2e28934a310 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:20.855287 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5138cdf2-1871-43a3-9518-b2e28934a310 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61" status: 200 len: 1515 microversion: 2.1 time: 0.665396 Oct 27 03:43:20.856211 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2483/5262] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:43:20 2022] GET /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61 => generated 1515 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:43:20.957698 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-83992274-191d-4adc-aaec-1f8fb4c53fb2 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:20.970549 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-83992274-191d-4adc-aaec-1f8fb4c53fb2 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1" status: 200 len: 1302 microversion: 2.1 time: 0.165405 Oct 27 03:43:20.971926 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2780/5263] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:43:20 2022] GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1 => generated 1302 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:43:21.310547 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-576f6a3d-5a9b-4a23-9270-8a90897249e9 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:21.311559 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-576f6a3d-5a9b-4a23-9270-8a90897249e9 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 1db2318e-9ac7-4994-8daa-14ae22537d5d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:21.323109 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-576f6a3d-5a9b-4a23-9270-8a90897249e9 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:21.324053 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-576f6a3d-5a9b-4a23-9270-8a90897249e9 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:21.324716 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-576f6a3d-5a9b-4a23-9270-8a90897249e9 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:21.328542 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-576f6a3d-5a9b-4a23-9270-8a90897249e9 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:21.328542 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-576f6a3d-5a9b-4a23-9270-8a90897249e9 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:21.328542 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-576f6a3d-5a9b-4a23-9270-8a90897249e9 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:21.576979 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-576f6a3d-5a9b-4a23-9270-8a90897249e9 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:21.586658 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-576f6a3d-5a9b-4a23-9270-8a90897249e9 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:21.588290 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-576f6a3d-5a9b-4a23-9270-8a90897249e9 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:21.589515 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-576f6a3d-5a9b-4a23-9270-8a90897249e9 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d" status: 200 len: 1406 microversion: 2.20 time: 0.283898 Oct 27 03:43:21.590189 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2484/5264] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:43:21 2022] GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d => generated 1406 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:43:21.818730 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-99f72485-44ef-402e-a09d-17351085e983 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:21.819367 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-99f72485-44ef-402e-a09d-17351085e983 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] [instance: 7e73d534-0a40-42d2-813c-2e9dbb9239ac] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:21.826083 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-99f72485-44ef-402e-a09d-17351085e983 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:21.826512 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-99f72485-44ef-402e-a09d-17351085e983 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:21.826953 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-99f72485-44ef-402e-a09d-17351085e983 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:21.827651 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-99f72485-44ef-402e-a09d-17351085e983 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:21.828104 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-99f72485-44ef-402e-a09d-17351085e983 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:21.828867 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-99f72485-44ef-402e-a09d-17351085e983 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:21.852342 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:43:21.884479 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d1be5f08-cda0-4aea-993f-4e6d59120d5b tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:21.885352 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d1be5f08-cda0-4aea-993f-4e6d59120d5b tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: 55152bbe-5a47-4916-ad12-5f1640f0be61] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:21.895738 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d1be5f08-cda0-4aea-993f-4e6d59120d5b tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:21.897451 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d1be5f08-cda0-4aea-993f-4e6d59120d5b tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:21.898182 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d1be5f08-cda0-4aea-993f-4e6d59120d5b tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:21.899455 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d1be5f08-cda0-4aea-993f-4e6d59120d5b tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:21.904477 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d1be5f08-cda0-4aea-993f-4e6d59120d5b tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:21.904477 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d1be5f08-cda0-4aea-993f-4e6d59120d5b tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:22.087746 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-99f72485-44ef-402e-a09d-17351085e983 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:22.092201 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=100 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:43:22.098923 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-99f72485-44ef-402e-a09d-17351085e983 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:22.102233 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-99f72485-44ef-402e-a09d-17351085e983 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:22.103785 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-99f72485-44ef-402e-a09d-17351085e983 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] 10.222.0.20 "GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac" status: 200 len: 2953 microversion: 2.32 time: 0.288963 Oct 27 03:43:22.118767 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2781/5265] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:43:21 2022] GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac => generated 2953 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:43:22.130991 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-369de0f1-0c3b-44f8-85e9-5ac5589a4016 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:22.131861 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-369de0f1-0c3b-44f8-85e9-5ac5589a4016 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: dbdbec9a-f4bf-4740-ab67-3c8891e341a1] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:22.138853 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-369de0f1-0c3b-44f8-85e9-5ac5589a4016 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:22.139521 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-369de0f1-0c3b-44f8-85e9-5ac5589a4016 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:22.140135 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-369de0f1-0c3b-44f8-85e9-5ac5589a4016 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:22.141028 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-369de0f1-0c3b-44f8-85e9-5ac5589a4016 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:22.141655 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-369de0f1-0c3b-44f8-85e9-5ac5589a4016 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:22.142418 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-369de0f1-0c3b-44f8-85e9-5ac5589a4016 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:22.374281 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d1be5f08-cda0-4aea-993f-4e6d59120d5b tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:22.383838 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d1be5f08-cda0-4aea-993f-4e6d59120d5b tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61" status: 200 len: 1515 microversion: 2.1 time: 0.504796 Oct 27 03:43:22.398971 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2485/5266] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:43:21 2022] GET /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61 => generated 1515 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:43:22.405186 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-369de0f1-0c3b-44f8-85e9-5ac5589a4016 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:22.414495 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-369de0f1-0c3b-44f8-85e9-5ac5589a4016 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1" status: 200 len: 1370 microversion: 2.1 time: 0.294379 Oct 27 03:43:22.415498 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2782/5267] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:43:22 2022] GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1 => generated 1370 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:43:22.616472 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e2b7f5f8-db28-493e-bbf9-f466bd107943 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:22.617417 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e2b7f5f8-db28-493e-bbf9-f466bd107943 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 1db2318e-9ac7-4994-8daa-14ae22537d5d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:22.627926 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e2b7f5f8-db28-493e-bbf9-f466bd107943 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:22.629082 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e2b7f5f8-db28-493e-bbf9-f466bd107943 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:22.631509 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e2b7f5f8-db28-493e-bbf9-f466bd107943 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:22.634571 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e2b7f5f8-db28-493e-bbf9-f466bd107943 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:22.635064 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e2b7f5f8-db28-493e-bbf9-f466bd107943 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:22.636856 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e2b7f5f8-db28-493e-bbf9-f466bd107943 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:22.926928 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e2b7f5f8-db28-493e-bbf9-f466bd107943 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:22.937855 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e2b7f5f8-db28-493e-bbf9-f466bd107943 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:22.942404 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e2b7f5f8-db28-493e-bbf9-f466bd107943 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:22.950549 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e2b7f5f8-db28-493e-bbf9-f466bd107943 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d" status: 200 len: 1406 microversion: 2.20 time: 0.338937 Oct 27 03:43:22.970476 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2486/5268] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:43:22 2022] GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d => generated 1406 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:43:23.138120 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ba12a4c5-00c3-47e2-8dc6-b69be4f7a228 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:23.138944 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ba12a4c5-00c3-47e2-8dc6-b69be4f7a228 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] [instance: 7e73d534-0a40-42d2-813c-2e9dbb9239ac] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:23.159950 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ba12a4c5-00c3-47e2-8dc6-b69be4f7a228 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:23.160910 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ba12a4c5-00c3-47e2-8dc6-b69be4f7a228 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:23.161349 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ba12a4c5-00c3-47e2-8dc6-b69be4f7a228 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:23.162564 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ba12a4c5-00c3-47e2-8dc6-b69be4f7a228 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:23.163052 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ba12a4c5-00c3-47e2-8dc6-b69be4f7a228 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:23.166277 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ba12a4c5-00c3-47e2-8dc6-b69be4f7a228 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:23.268431 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-427bb4c5-eeca-4145-8e3f-de1739527564 req-cc577949-168a-4912-ba23-6a1b374a616e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbdbec9a-f4bf-4740-ab67-3c8891e341a1", "tag": "833035a3-c97d-4212-b516-f56e8d9754b6"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:43:23.281638 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-427bb4c5-eeca-4145-8e3f-de1739527564 req-cc577949-168a-4912-ba23-6a1b374a616e service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:23.281638 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-427bb4c5-eeca-4145-8e3f-de1739527564 req-cc577949-168a-4912-ba23-6a1b374a616e service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:23.281638 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-427bb4c5-eeca-4145-8e3f-de1739527564 req-cc577949-168a-4912-ba23-6a1b374a616e service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:23.292847 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-427bb4c5-eeca-4145-8e3f-de1739527564 req-cc577949-168a-4912-ba23-6a1b374a616e service nova] Creating event network-changed:833035a3-c97d-4212-b516-f56e8d9754b6 for instance dbdbec9a-f4bf-4740-ab67-3c8891e341a1 on n-h2-862769-1 Oct 27 03:43:23.298106 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-427bb4c5-eeca-4145-8e3f-de1739527564 req-cc577949-168a-4912-ba23-6a1b374a616e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033307 Oct 27 03:43:23.299207 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2487/5269] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:43:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:43:23.392799 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=10 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:43:23.411467 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-41fda6a4-aecb-46fe-8d10-ffd1f26b64d6 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:23.412978 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-41fda6a4-aecb-46fe-8d10-ffd1f26b64d6 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: 55152bbe-5a47-4916-ad12-5f1640f0be61] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:23.420429 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-41fda6a4-aecb-46fe-8d10-ffd1f26b64d6 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:23.420947 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-41fda6a4-aecb-46fe-8d10-ffd1f26b64d6 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:23.421394 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-41fda6a4-aecb-46fe-8d10-ffd1f26b64d6 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:23.422150 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-41fda6a4-aecb-46fe-8d10-ffd1f26b64d6 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:23.422622 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-41fda6a4-aecb-46fe-8d10-ffd1f26b64d6 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:23.423059 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-41fda6a4-aecb-46fe-8d10-ffd1f26b64d6 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:23.667604 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ba12a4c5-00c3-47e2-8dc6-b69be4f7a228 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:23.679434 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ba12a4c5-00c3-47e2-8dc6-b69be4f7a228 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:23.683475 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ba12a4c5-00c3-47e2-8dc6-b69be4f7a228 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:23.683475 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ba12a4c5-00c3-47e2-8dc6-b69be4f7a228 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] 10.222.0.20 "GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac" status: 200 len: 2953 microversion: 2.32 time: 0.548646 Oct 27 03:43:23.683475 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2783/5270] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:43:23 2022] GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac => generated 2953 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:43:23.688827 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ed3d1e7e-85a3-4856-887b-b373eb04062b tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:23.690006 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ed3d1e7e-85a3-4856-887b-b373eb04062b tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: dbdbec9a-f4bf-4740-ab67-3c8891e341a1] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:23.696269 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ed3d1e7e-85a3-4856-887b-b373eb04062b tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:23.699097 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ed3d1e7e-85a3-4856-887b-b373eb04062b tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:23.699737 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ed3d1e7e-85a3-4856-887b-b373eb04062b tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:23.700656 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ed3d1e7e-85a3-4856-887b-b373eb04062b tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:23.701271 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ed3d1e7e-85a3-4856-887b-b373eb04062b tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:23.701861 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ed3d1e7e-85a3-4856-887b-b373eb04062b tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:23.778687 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-41fda6a4-aecb-46fe-8d10-ffd1f26b64d6 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:23.792942 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-41fda6a4-aecb-46fe-8d10-ffd1f26b64d6 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61" status: 200 len: 1515 microversion: 2.1 time: 0.387753 Oct 27 03:43:23.795218 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2488/5271] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:43:23 2022] GET /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61 => generated 1515 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:43:23.980667 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d4acadfb-81e0-4e5f-ba6c-981eef60b916 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:23.982187 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d4acadfb-81e0-4e5f-ba6c-981eef60b916 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 1db2318e-9ac7-4994-8daa-14ae22537d5d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:23.995224 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d4acadfb-81e0-4e5f-ba6c-981eef60b916 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:23.999081 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d4acadfb-81e0-4e5f-ba6c-981eef60b916 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:23.999913 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d4acadfb-81e0-4e5f-ba6c-981eef60b916 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:24.001215 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d4acadfb-81e0-4e5f-ba6c-981eef60b916 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:24.005076 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d4acadfb-81e0-4e5f-ba6c-981eef60b916 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:24.006546 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d4acadfb-81e0-4e5f-ba6c-981eef60b916 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:24.424148 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d4acadfb-81e0-4e5f-ba6c-981eef60b916 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:24.442487 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d4acadfb-81e0-4e5f-ba6c-981eef60b916 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:24.446710 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d4acadfb-81e0-4e5f-ba6c-981eef60b916 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:24.454768 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d4acadfb-81e0-4e5f-ba6c-981eef60b916 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d" status: 200 len: 1406 microversion: 2.20 time: 0.472559 Oct 27 03:43:24.459468 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2489/5272] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:43:23 2022] GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d => generated 1406 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:43:24.532931 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ed3d1e7e-85a3-4856-887b-b373eb04062b tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:24.545682 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ed3d1e7e-85a3-4856-887b-b373eb04062b tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1" status: 200 len: 1370 microversion: 2.1 time: 0.860734 Oct 27 03:43:24.546322 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2784/5273] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:43:23 2022] GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1 => generated 1370 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:43:24.717399 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-63febf3f-264f-402c-aaae-1f1b5abd2b70 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:24.718249 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-63febf3f-264f-402c-aaae-1f1b5abd2b70 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] [instance: 7e73d534-0a40-42d2-813c-2e9dbb9239ac] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:24.726795 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-63febf3f-264f-402c-aaae-1f1b5abd2b70 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:24.727405 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-63febf3f-264f-402c-aaae-1f1b5abd2b70 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:24.727989 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-63febf3f-264f-402c-aaae-1f1b5abd2b70 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:24.728957 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-63febf3f-264f-402c-aaae-1f1b5abd2b70 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:24.729702 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-63febf3f-264f-402c-aaae-1f1b5abd2b70 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:24.730330 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-63febf3f-264f-402c-aaae-1f1b5abd2b70 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:24.825331 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-09a48f6e-5844-436a-9cdf-7347b4e9547d tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:24.825968 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-09a48f6e-5844-436a-9cdf-7347b4e9547d tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: 55152bbe-5a47-4916-ad12-5f1640f0be61] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:24.832137 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-09a48f6e-5844-436a-9cdf-7347b4e9547d tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:24.837564 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-09a48f6e-5844-436a-9cdf-7347b4e9547d tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:24.837564 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-09a48f6e-5844-436a-9cdf-7347b4e9547d tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:24.837564 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-09a48f6e-5844-436a-9cdf-7347b4e9547d tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:24.837564 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-09a48f6e-5844-436a-9cdf-7347b4e9547d tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:24.837564 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-09a48f6e-5844-436a-9cdf-7347b4e9547d tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:25.069718 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-63febf3f-264f-402c-aaae-1f1b5abd2b70 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:25.080436 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-63febf3f-264f-402c-aaae-1f1b5abd2b70 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:25.082278 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-63febf3f-264f-402c-aaae-1f1b5abd2b70 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:25.083854 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-63febf3f-264f-402c-aaae-1f1b5abd2b70 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] 10.222.0.20 "GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac" status: 200 len: 2953 microversion: 2.32 time: 0.371107 Oct 27 03:43:25.085286 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2490/5274] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:43:24 2022] GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac => generated 2953 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:43:25.203631 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-09a48f6e-5844-436a-9cdf-7347b4e9547d tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:25.212418 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-09a48f6e-5844-436a-9cdf-7347b4e9547d tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61" status: 200 len: 1515 microversion: 2.1 time: 0.391430 Oct 27 03:43:25.214133 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2785/5275] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:43:24 2022] GET /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61 => generated 1515 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:43:25.489962 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c960c6ec-21be-4396-905b-92312ac568c0 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:25.491359 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c960c6ec-21be-4396-905b-92312ac568c0 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 1db2318e-9ac7-4994-8daa-14ae22537d5d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:25.497878 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c960c6ec-21be-4396-905b-92312ac568c0 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:25.498547 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c960c6ec-21be-4396-905b-92312ac568c0 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:25.498993 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c960c6ec-21be-4396-905b-92312ac568c0 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:25.499884 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c960c6ec-21be-4396-905b-92312ac568c0 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:25.500346 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c960c6ec-21be-4396-905b-92312ac568c0 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:25.500775 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c960c6ec-21be-4396-905b-92312ac568c0 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:25.569275 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5efc154b-720c-459b-943d-9a19d96449da tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:25.570441 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5efc154b-720c-459b-943d-9a19d96449da tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: dbdbec9a-f4bf-4740-ab67-3c8891e341a1] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:25.593632 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5efc154b-720c-459b-943d-9a19d96449da tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:25.593632 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5efc154b-720c-459b-943d-9a19d96449da tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:25.593632 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5efc154b-720c-459b-943d-9a19d96449da tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:25.594263 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5efc154b-720c-459b-943d-9a19d96449da tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:25.594951 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5efc154b-720c-459b-943d-9a19d96449da tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:25.595588 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5efc154b-720c-459b-943d-9a19d96449da tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:25.607655 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:43:25.814553 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c960c6ec-21be-4396-905b-92312ac568c0 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:25.818475 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5efc154b-720c-459b-943d-9a19d96449da tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:25.829801 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5efc154b-720c-459b-943d-9a19d96449da tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1" status: 200 len: 1370 microversion: 2.1 time: 0.263883 Oct 27 03:43:25.830372 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c960c6ec-21be-4396-905b-92312ac568c0 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:25.835351 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c960c6ec-21be-4396-905b-92312ac568c0 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:25.837900 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c960c6ec-21be-4396-905b-92312ac568c0 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d" status: 200 len: 1406 microversion: 2.20 time: 0.358474 Oct 27 03:43:25.841468 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2491/5276] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:43:25 2022] GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d => generated 1406 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:43:25.847641 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2786/5277] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:43:25 2022] GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1 => generated 1370 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:43:26.112636 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9e0857bc-ba8f-423f-897f-5d2459adaddc tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:26.113266 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9e0857bc-ba8f-423f-897f-5d2459adaddc tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] [instance: 7e73d534-0a40-42d2-813c-2e9dbb9239ac] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:26.126471 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9e0857bc-ba8f-423f-897f-5d2459adaddc tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:26.127543 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9e0857bc-ba8f-423f-897f-5d2459adaddc tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:26.128036 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9e0857bc-ba8f-423f-897f-5d2459adaddc tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:26.128976 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9e0857bc-ba8f-423f-897f-5d2459adaddc tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:26.129602 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9e0857bc-ba8f-423f-897f-5d2459adaddc tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:26.130849 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9e0857bc-ba8f-423f-897f-5d2459adaddc tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:26.237207 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-20048d18-9c85-4f7a-a1db-d3b207883d22 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:26.238380 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-20048d18-9c85-4f7a-a1db-d3b207883d22 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: 55152bbe-5a47-4916-ad12-5f1640f0be61] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:26.249848 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-20048d18-9c85-4f7a-a1db-d3b207883d22 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:26.251265 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-20048d18-9c85-4f7a-a1db-d3b207883d22 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:26.252239 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-20048d18-9c85-4f7a-a1db-d3b207883d22 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:26.253340 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-20048d18-9c85-4f7a-a1db-d3b207883d22 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:26.254452 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-20048d18-9c85-4f7a-a1db-d3b207883d22 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:26.255798 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-20048d18-9c85-4f7a-a1db-d3b207883d22 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:26.317155 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9e0857bc-ba8f-423f-897f-5d2459adaddc tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:26.321495 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=16 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:43:26.327933 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9e0857bc-ba8f-423f-897f-5d2459adaddc tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:26.329733 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9e0857bc-ba8f-423f-897f-5d2459adaddc tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:26.330653 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9e0857bc-ba8f-423f-897f-5d2459adaddc tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] 10.222.0.20 "GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac" status: 200 len: 2911 microversion: 2.32 time: 0.222095 Oct 27 03:43:26.331240 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2492/5278] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:43:26 2022] GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac => generated 2911 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:43:26.594126 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-20048d18-9c85-4f7a-a1db-d3b207883d22 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:26.604633 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-20048d18-9c85-4f7a-a1db-d3b207883d22 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61" status: 200 len: 1515 microversion: 2.1 time: 0.371927 Oct 27 03:43:26.606652 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2787/5279] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:43:26 2022] GET /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61 => generated 1515 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:43:26.853536 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0640dc84-7ef6-4519-823c-3cb3abf1a0ff tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:26.854364 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0640dc84-7ef6-4519-823c-3cb3abf1a0ff tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: dbdbec9a-f4bf-4740-ab67-3c8891e341a1] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:26.860820 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0640dc84-7ef6-4519-823c-3cb3abf1a0ff tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:26.861326 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0640dc84-7ef6-4519-823c-3cb3abf1a0ff tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:26.862077 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0640dc84-7ef6-4519-823c-3cb3abf1a0ff tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:26.863563 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0640dc84-7ef6-4519-823c-3cb3abf1a0ff tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:26.863563 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0640dc84-7ef6-4519-823c-3cb3abf1a0ff tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:26.863563 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0640dc84-7ef6-4519-823c-3cb3abf1a0ff tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:26.866306 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-fac7f965-9bf2-431d-b00b-d837dd351e06 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:26.867022 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-fac7f965-9bf2-431d-b00b-d837dd351e06 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 1db2318e-9ac7-4994-8daa-14ae22537d5d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:26.873386 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fac7f965-9bf2-431d-b00b-d837dd351e06 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:26.874235 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fac7f965-9bf2-431d-b00b-d837dd351e06 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:26.874839 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fac7f965-9bf2-431d-b00b-d837dd351e06 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:26.875850 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fac7f965-9bf2-431d-b00b-d837dd351e06 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:26.876406 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fac7f965-9bf2-431d-b00b-d837dd351e06 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:26.876953 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fac7f965-9bf2-431d-b00b-d837dd351e06 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:27.157906 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-fac7f965-9bf2-431d-b00b-d837dd351e06 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:27.169261 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-fac7f965-9bf2-431d-b00b-d837dd351e06 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:27.172666 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-fac7f965-9bf2-431d-b00b-d837dd351e06 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:27.174733 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-fac7f965-9bf2-431d-b00b-d837dd351e06 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d" status: 200 len: 1406 microversion: 2.20 time: 0.313597 Oct 27 03:43:27.176181 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2788/5280] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:43:26 2022] GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d => generated 1406 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:43:27.184014 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-a1432655-c520-4de4-be42-78da1fa68dae req-116a0829-5cc1-409e-9029-309bfdb9cb46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e73d534-0a40-42d2-813c-2e9dbb9239ac", "name": "network-vif-deleted", "tag": "56ab5e70-ff8a-49bf-b017-824334f93dca"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:43:27.203600 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-a1432655-c520-4de4-be42-78da1fa68dae req-116a0829-5cc1-409e-9029-309bfdb9cb46 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:27.204312 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-a1432655-c520-4de4-be42-78da1fa68dae req-116a0829-5cc1-409e-9029-309bfdb9cb46 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:27.204849 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-a1432655-c520-4de4-be42-78da1fa68dae req-116a0829-5cc1-409e-9029-309bfdb9cb46 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:27.232569 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-a1432655-c520-4de4-be42-78da1fa68dae req-116a0829-5cc1-409e-9029-309bfdb9cb46 service nova] Creating event network-vif-deleted:56ab5e70-ff8a-49bf-b017-824334f93dca for instance 7e73d534-0a40-42d2-813c-2e9dbb9239ac on n-h2-862769-1 Oct 27 03:43:27.232569 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-a1432655-c520-4de4-be42-78da1fa68dae req-116a0829-5cc1-409e-9029-309bfdb9cb46 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050432 Oct 27 03:43:27.232569 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2789/5281] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:43:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:43:27.258639 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0640dc84-7ef6-4519-823c-3cb3abf1a0ff tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:27.267611 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0640dc84-7ef6-4519-823c-3cb3abf1a0ff tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1" status: 200 len: 1370 microversion: 2.1 time: 0.418096 Oct 27 03:43:27.287992 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2493/5282] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:43:26 2022] GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1 => generated 1370 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:43:27.362928 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-76a5f81a-895d-4b18-8041-9e1caf456dbc tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:27.365350 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-76a5f81a-895d-4b18-8041-9e1caf456dbc tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] [instance: 7e73d534-0a40-42d2-813c-2e9dbb9239ac] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:27.389200 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-76a5f81a-895d-4b18-8041-9e1caf456dbc tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:27.389731 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-76a5f81a-895d-4b18-8041-9e1caf456dbc tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:27.392049 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-76a5f81a-895d-4b18-8041-9e1caf456dbc tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:27.396265 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-76a5f81a-895d-4b18-8041-9e1caf456dbc tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:27.398914 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-76a5f81a-895d-4b18-8041-9e1caf456dbc tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:27.399661 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-76a5f81a-895d-4b18-8041-9e1caf456dbc tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:27.630699 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1c997374-e23d-4818-9bc3-7dfae5f382f5 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:27.631361 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1c997374-e23d-4818-9bc3-7dfae5f382f5 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: 55152bbe-5a47-4916-ad12-5f1640f0be61] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:27.644483 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1c997374-e23d-4818-9bc3-7dfae5f382f5 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:27.645613 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1c997374-e23d-4818-9bc3-7dfae5f382f5 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:27.645613 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1c997374-e23d-4818-9bc3-7dfae5f382f5 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:27.650126 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1c997374-e23d-4818-9bc3-7dfae5f382f5 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:27.650843 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1c997374-e23d-4818-9bc3-7dfae5f382f5 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:27.651455 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1c997374-e23d-4818-9bc3-7dfae5f382f5 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:27.887904 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-76a5f81a-895d-4b18-8041-9e1caf456dbc tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:27.903654 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1c997374-e23d-4818-9bc3-7dfae5f382f5 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:27.919155 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1c997374-e23d-4818-9bc3-7dfae5f382f5 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61" status: 200 len: 1515 microversion: 2.1 time: 0.292522 Oct 27 03:43:27.919774 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2494/5283] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:43:27 2022] GET /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61 => generated 1515 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:43:27.920439 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-76a5f81a-895d-4b18-8041-9e1caf456dbc tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:27.922749 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-76a5f81a-895d-4b18-8041-9e1caf456dbc tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:27.924422 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-9921452e-a0af-47ae-bb4f-79d8fbb7099a req-22ddcc8f-fce4-4dab-b4ca-df8eadbac293 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1db2318e-9ac7-4994-8daa-14ae22537d5d", "name": "network-vif-plugged", "status": "completed", "tag": "162a3612-f72a-4eb0-9872-8b121e85445d"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:43:27.925811 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-76a5f81a-895d-4b18-8041-9e1caf456dbc tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] 10.222.0.20 "GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac" status: 200 len: 2751 microversion: 2.32 time: 0.569665 Oct 27 03:43:27.929425 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2790/5284] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:43:27 2022] GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac => generated 2751 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:43:27.944537 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-9921452e-a0af-47ae-bb4f-79d8fbb7099a req-22ddcc8f-fce4-4dab-b4ca-df8eadbac293 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:27.945152 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-9921452e-a0af-47ae-bb4f-79d8fbb7099a req-22ddcc8f-fce4-4dab-b4ca-df8eadbac293 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:27.945786 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-9921452e-a0af-47ae-bb4f-79d8fbb7099a req-22ddcc8f-fce4-4dab-b4ca-df8eadbac293 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:27.968823 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-9921452e-a0af-47ae-bb4f-79d8fbb7099a req-22ddcc8f-fce4-4dab-b4ca-df8eadbac293 service nova] Creating event network-vif-plugged:162a3612-f72a-4eb0-9872-8b121e85445d for instance 1db2318e-9ac7-4994-8daa-14ae22537d5d on n-h2-862769-1 Oct 27 03:43:27.975625 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-9921452e-a0af-47ae-bb4f-79d8fbb7099a req-22ddcc8f-fce4-4dab-b4ca-df8eadbac293 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054507 Oct 27 03:43:27.976252 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2495/5285] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:43:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:43:28.213094 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-40242ee3-2f00-44b3-bfc5-728ff703f1d4 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:28.214941 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-40242ee3-2f00-44b3-bfc5-728ff703f1d4 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 1db2318e-9ac7-4994-8daa-14ae22537d5d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:28.223473 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-40242ee3-2f00-44b3-bfc5-728ff703f1d4 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:28.224382 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-40242ee3-2f00-44b3-bfc5-728ff703f1d4 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:28.225947 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-40242ee3-2f00-44b3-bfc5-728ff703f1d4 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:28.227009 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-40242ee3-2f00-44b3-bfc5-728ff703f1d4 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:28.227691 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-40242ee3-2f00-44b3-bfc5-728ff703f1d4 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:28.228340 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-40242ee3-2f00-44b3-bfc5-728ff703f1d4 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:28.296444 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-67ff3c9c-66d4-42c0-bf5b-3c7b2d20072a tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:28.300957 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-67ff3c9c-66d4-42c0-bf5b-3c7b2d20072a tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: dbdbec9a-f4bf-4740-ab67-3c8891e341a1] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:28.317345 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-67ff3c9c-66d4-42c0-bf5b-3c7b2d20072a tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:28.319110 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-67ff3c9c-66d4-42c0-bf5b-3c7b2d20072a tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:28.319951 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-67ff3c9c-66d4-42c0-bf5b-3c7b2d20072a tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:28.321163 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-67ff3c9c-66d4-42c0-bf5b-3c7b2d20072a tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:28.322092 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-67ff3c9c-66d4-42c0-bf5b-3c7b2d20072a tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:28.322838 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-67ff3c9c-66d4-42c0-bf5b-3c7b2d20072a tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:28.538074 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-67ff3c9c-66d4-42c0-bf5b-3c7b2d20072a tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:28.567183 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-67ff3c9c-66d4-42c0-bf5b-3c7b2d20072a tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1" status: 200 len: 1370 microversion: 2.1 time: 0.257185 Oct 27 03:43:28.567183 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2496/5286] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:43:28 2022] GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1 => generated 1370 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:43:28.589226 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a2faa506-1bb5-4036-b785-cebb0b01d79c tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:28.589945 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a2faa506-1bb5-4036-b785-cebb0b01d79c tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: ce85aa86-fbba-4eca-97e8-173da3cdc7c3] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:28.610990 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a2faa506-1bb5-4036-b785-cebb0b01d79c tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:28.611557 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a2faa506-1bb5-4036-b785-cebb0b01d79c tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:28.612016 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a2faa506-1bb5-4036-b785-cebb0b01d79c tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:28.612881 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a2faa506-1bb5-4036-b785-cebb0b01d79c tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:28.613491 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a2faa506-1bb5-4036-b785-cebb0b01d79c tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:28.614108 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a2faa506-1bb5-4036-b785-cebb0b01d79c tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:28.647204 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a2faa506-1bb5-4036-b785-cebb0b01d79c tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "GET /compute/v2.1/servers/ce85aa86-fbba-4eca-97e8-173da3cdc7c3/ips" status: 200 len: 144 microversion: 2.1 time: 0.097038 Oct 27 03:43:28.647741 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2497/5287] 10.222.0.20 () {58 vars in 1248 bytes} [Thu Oct 27 03:43:28 2022] GET /compute/v2.1/servers/ce85aa86-fbba-4eca-97e8-173da3cdc7c3/ips => generated 144 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:43:28.943636 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a667f34d-f39f-4f2c-b273-5fb5da294ef7 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:28.944460 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a667f34d-f39f-4f2c-b273-5fb5da294ef7 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: 55152bbe-5a47-4916-ad12-5f1640f0be61] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:28.957598 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a667f34d-f39f-4f2c-b273-5fb5da294ef7 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:28.958499 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a667f34d-f39f-4f2c-b273-5fb5da294ef7 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:28.959074 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a667f34d-f39f-4f2c-b273-5fb5da294ef7 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:28.959935 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a667f34d-f39f-4f2c-b273-5fb5da294ef7 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:28.960534 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a667f34d-f39f-4f2c-b273-5fb5da294ef7 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:28.961308 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a667f34d-f39f-4f2c-b273-5fb5da294ef7 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:29.138024 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-40242ee3-2f00-44b3-bfc5-728ff703f1d4 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:29.158202 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-40242ee3-2f00-44b3-bfc5-728ff703f1d4 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:29.160462 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-40242ee3-2f00-44b3-bfc5-728ff703f1d4 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:29.164527 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-40242ee3-2f00-44b3-bfc5-728ff703f1d4 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d" status: 200 len: 1406 microversion: 2.20 time: 0.964600 Oct 27 03:43:29.165761 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2791/5288] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:43:28 2022] GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d => generated 1406 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:43:29.240773 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f398261f-a129-4f4d-98cf-707da05d55e0 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:29.241904 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f398261f-a129-4f4d-98cf-707da05d55e0 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] [instance: 7e73d534-0a40-42d2-813c-2e9dbb9239ac] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:29.253889 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f398261f-a129-4f4d-98cf-707da05d55e0 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:29.257082 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f398261f-a129-4f4d-98cf-707da05d55e0 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:29.258953 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f398261f-a129-4f4d-98cf-707da05d55e0 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:29.266809 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f398261f-a129-4f4d-98cf-707da05d55e0 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:29.268645 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f398261f-a129-4f4d-98cf-707da05d55e0 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:29.269370 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f398261f-a129-4f4d-98cf-707da05d55e0 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:29.714534 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a667f34d-f39f-4f2c-b273-5fb5da294ef7 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:29.723330 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a667f34d-f39f-4f2c-b273-5fb5da294ef7 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61" status: 200 len: 1515 microversion: 2.1 time: 0.784128 Oct 27 03:43:29.726785 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2498/5289] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:43:28 2022] GET /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61 => generated 1515 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:43:29.742388 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-db6a8d08-3f43-4826-80e6-bb1cb71561bd req-0379347b-c893-49f5-8dce-60745184f790 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e73d534-0a40-42d2-813c-2e9dbb9239ac", "name": "network-vif-deleted", "tag": "c0c13817-3015-471d-b722-6926066dd1a7"}, {"server_uuid": "7e73d534-0a40-42d2-813c-2e9dbb9239ac", "name": "network-vif-deleted", "tag": "7eb3c0a9-011b-4ec7-a337-29cffc7192c5"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:43:29.770008 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-db6a8d08-3f43-4826-80e6-bb1cb71561bd req-0379347b-c893-49f5-8dce-60745184f790 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:29.770538 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-db6a8d08-3f43-4826-80e6-bb1cb71561bd req-0379347b-c893-49f5-8dce-60745184f790 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:29.771950 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-db6a8d08-3f43-4826-80e6-bb1cb71561bd req-0379347b-c893-49f5-8dce-60745184f790 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:29.798227 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-db6a8d08-3f43-4826-80e6-bb1cb71561bd req-0379347b-c893-49f5-8dce-60745184f790 service nova] Creating event network-vif-deleted:c0c13817-3015-471d-b722-6926066dd1a7 for instance 7e73d534-0a40-42d2-813c-2e9dbb9239ac on n-h2-862769-1 Oct 27 03:43:29.798503 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-db6a8d08-3f43-4826-80e6-bb1cb71561bd req-0379347b-c893-49f5-8dce-60745184f790 service nova] Creating event network-vif-deleted:7eb3c0a9-011b-4ec7-a337-29cffc7192c5 for instance 7e73d534-0a40-42d2-813c-2e9dbb9239ac on n-h2-862769-1 Oct 27 03:43:29.812790 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-db6a8d08-3f43-4826-80e6-bb1cb71561bd req-0379347b-c893-49f5-8dce-60745184f790 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.083949 Oct 27 03:43:29.821276 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2499/5290] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:43:29 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:43:29.832993 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e1d57d90-2b7f-473c-9a8b-3446e8d00934 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:29.836608 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e1d57d90-2b7f-473c-9a8b-3446e8d00934 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: dbdbec9a-f4bf-4740-ab67-3c8891e341a1] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:29.852742 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e1d57d90-2b7f-473c-9a8b-3446e8d00934 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:29.853743 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e1d57d90-2b7f-473c-9a8b-3446e8d00934 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:29.854399 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e1d57d90-2b7f-473c-9a8b-3446e8d00934 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:29.855316 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e1d57d90-2b7f-473c-9a8b-3446e8d00934 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:29.855945 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e1d57d90-2b7f-473c-9a8b-3446e8d00934 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:29.858833 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e1d57d90-2b7f-473c-9a8b-3446e8d00934 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:29.912901 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f398261f-a129-4f4d-98cf-707da05d55e0 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:29.925853 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f398261f-a129-4f4d-98cf-707da05d55e0 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:29.930941 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f398261f-a129-4f4d-98cf-707da05d55e0 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:29.934564 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f398261f-a129-4f4d-98cf-707da05d55e0 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] 10.222.0.20 "GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac" status: 200 len: 2657 microversion: 2.32 time: 0.766664 Oct 27 03:43:29.935225 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2792/5291] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:43:29 2022] GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac => generated 2657 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:43:30.043210 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-b5b3dcfe-2cbb-437c-bc92-fb859bf3af61 req-6a5abef0-f9cb-423c-9556-d54cf934b24e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e73d534-0a40-42d2-813c-2e9dbb9239ac", "name": "network-vif-unplugged", "status": "completed", "tag": "0cd3187b-ba4d-438e-9eba-f156955f5791"}, {"server_uuid": "7e73d534-0a40-42d2-813c-2e9dbb9239ac", "name": "network-vif-unplugged", "status": "completed", "tag": "46cca111-fadc-4d6b-a199-5b4f2005c03d"}, {"server_uuid": "dbdbec9a-f4bf-4740-ab67-3c8891e341a1", "name": "network-vif-plugged", "status": "completed", "tag": "833035a3-c97d-4212-b516-f56e8d9754b6"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:43:30.069779 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-b5b3dcfe-2cbb-437c-bc92-fb859bf3af61 req-6a5abef0-f9cb-423c-9556-d54cf934b24e service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:30.069779 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-b5b3dcfe-2cbb-437c-bc92-fb859bf3af61 req-6a5abef0-f9cb-423c-9556-d54cf934b24e service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:30.069779 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-b5b3dcfe-2cbb-437c-bc92-fb859bf3af61 req-6a5abef0-f9cb-423c-9556-d54cf934b24e service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:30.094737 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-b5b3dcfe-2cbb-437c-bc92-fb859bf3af61 req-6a5abef0-f9cb-423c-9556-d54cf934b24e service nova] Creating event network-vif-unplugged:0cd3187b-ba4d-438e-9eba-f156955f5791 for instance 7e73d534-0a40-42d2-813c-2e9dbb9239ac on n-h2-862769-1 Oct 27 03:43:30.098455 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e1d57d90-2b7f-473c-9a8b-3446e8d00934 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:30.099887 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-b5b3dcfe-2cbb-437c-bc92-fb859bf3af61 req-6a5abef0-f9cb-423c-9556-d54cf934b24e service nova] Creating event network-vif-unplugged:46cca111-fadc-4d6b-a199-5b4f2005c03d for instance 7e73d534-0a40-42d2-813c-2e9dbb9239ac on n-h2-862769-1 Oct 27 03:43:30.100850 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-b5b3dcfe-2cbb-437c-bc92-fb859bf3af61 req-6a5abef0-f9cb-423c-9556-d54cf934b24e service nova] Creating event network-vif-plugged:833035a3-c97d-4212-b516-f56e8d9754b6 for instance dbdbec9a-f4bf-4740-ab67-3c8891e341a1 on n-h2-862769-1 Oct 27 03:43:30.107221 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e1d57d90-2b7f-473c-9a8b-3446e8d00934 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1" status: 200 len: 1370 microversion: 2.1 time: 0.284588 Oct 27 03:43:30.109451 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2500/5292] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:43:29 2022] GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1 => generated 1370 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:43:30.113857 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-b5b3dcfe-2cbb-437c-bc92-fb859bf3af61 req-6a5abef0-f9cb-423c-9556-d54cf934b24e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 529 microversion: 2.1 time: 0.081000 Oct 27 03:43:30.115834 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2793/5293] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:43:30 2022] POST /compute/v2.1/os-server-external-events => generated 529 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:43:30.202829 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4cc0d873-008a-450d-9069-83b974b3a3f3 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:30.202829 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4cc0d873-008a-450d-9069-83b974b3a3f3 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 1db2318e-9ac7-4994-8daa-14ae22537d5d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:30.211142 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4cc0d873-008a-450d-9069-83b974b3a3f3 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:30.214597 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4cc0d873-008a-450d-9069-83b974b3a3f3 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:30.214597 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4cc0d873-008a-450d-9069-83b974b3a3f3 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:30.215525 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4cc0d873-008a-450d-9069-83b974b3a3f3 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:30.216282 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4cc0d873-008a-450d-9069-83b974b3a3f3 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:30.217144 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4cc0d873-008a-450d-9069-83b974b3a3f3 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:30.269956 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:43:30.533858 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4cc0d873-008a-450d-9069-83b974b3a3f3 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:30.546998 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4cc0d873-008a-450d-9069-83b974b3a3f3 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:30.551703 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4cc0d873-008a-450d-9069-83b974b3a3f3 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:30.560849 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4cc0d873-008a-450d-9069-83b974b3a3f3 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d" status: 200 len: 1406 microversion: 2.20 time: 0.363922 Oct 27 03:43:30.560849 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2501/5294] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:43:30 2022] GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d => generated 1406 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:43:30.750688 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7b77be8d-daf2-4ebd-bd42-4cdd33eff234 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:30.751562 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7b77be8d-daf2-4ebd-bd42-4cdd33eff234 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: 55152bbe-5a47-4916-ad12-5f1640f0be61] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:30.765918 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7b77be8d-daf2-4ebd-bd42-4cdd33eff234 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:30.766978 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7b77be8d-daf2-4ebd-bd42-4cdd33eff234 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:30.767439 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7b77be8d-daf2-4ebd-bd42-4cdd33eff234 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:30.768181 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7b77be8d-daf2-4ebd-bd42-4cdd33eff234 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:30.768653 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7b77be8d-daf2-4ebd-bd42-4cdd33eff234 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:30.769096 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7b77be8d-daf2-4ebd-bd42-4cdd33eff234 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:30.970214 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1516f679-c817-4812-b244-10ae2e9b5d09 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:30.971428 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1516f679-c817-4812-b244-10ae2e9b5d09 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] [instance: 7e73d534-0a40-42d2-813c-2e9dbb9239ac] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:30.983317 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1516f679-c817-4812-b244-10ae2e9b5d09 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:30.995112 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1516f679-c817-4812-b244-10ae2e9b5d09 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:30.995784 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1516f679-c817-4812-b244-10ae2e9b5d09 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:30.996722 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1516f679-c817-4812-b244-10ae2e9b5d09 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:30.997366 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1516f679-c817-4812-b244-10ae2e9b5d09 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:30.997977 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1516f679-c817-4812-b244-10ae2e9b5d09 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:31.153275 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7b77be8d-daf2-4ebd-bd42-4cdd33eff234 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:31.163338 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7b77be8d-daf2-4ebd-bd42-4cdd33eff234 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61" status: 200 len: 1515 microversion: 2.1 time: 0.418056 Oct 27 03:43:31.169039 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2794/5295] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:43:30 2022] GET /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61 => generated 1515 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:43:31.181168 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c439aa56-5d8f-413a-88be-1cb6ac731f16 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:31.181842 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c439aa56-5d8f-413a-88be-1cb6ac731f16 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: dbdbec9a-f4bf-4740-ab67-3c8891e341a1] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:31.203217 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c439aa56-5d8f-413a-88be-1cb6ac731f16 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:31.203217 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c439aa56-5d8f-413a-88be-1cb6ac731f16 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:31.203217 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c439aa56-5d8f-413a-88be-1cb6ac731f16 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:31.203217 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c439aa56-5d8f-413a-88be-1cb6ac731f16 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:31.203217 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c439aa56-5d8f-413a-88be-1cb6ac731f16 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:31.203217 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c439aa56-5d8f-413a-88be-1cb6ac731f16 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:31.565425 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c439aa56-5d8f-413a-88be-1cb6ac731f16 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:31.589927 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c439aa56-5d8f-413a-88be-1cb6ac731f16 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1" status: 200 len: 1370 microversion: 2.1 time: 0.418267 Oct 27 03:43:31.595119 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2795/5296] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:43:31 2022] GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1 => generated 1370 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:43:31.602876 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-918492f4-1f38-4ecc-af68-c0fff8fe901b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:31.604058 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-918492f4-1f38-4ecc-af68-c0fff8fe901b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 1db2318e-9ac7-4994-8daa-14ae22537d5d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:31.611234 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-918492f4-1f38-4ecc-af68-c0fff8fe901b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:31.612937 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-918492f4-1f38-4ecc-af68-c0fff8fe901b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:31.612937 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-918492f4-1f38-4ecc-af68-c0fff8fe901b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:31.613718 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-918492f4-1f38-4ecc-af68-c0fff8fe901b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:31.614229 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-918492f4-1f38-4ecc-af68-c0fff8fe901b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:31.615103 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-918492f4-1f38-4ecc-af68-c0fff8fe901b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:31.780028 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1516f679-c817-4812-b244-10ae2e9b5d09 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:31.819302 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1516f679-c817-4812-b244-10ae2e9b5d09 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:31.824474 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1516f679-c817-4812-b244-10ae2e9b5d09 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:31.839711 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1516f679-c817-4812-b244-10ae2e9b5d09 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] 10.222.0.20 "GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac" status: 200 len: 2383 microversion: 2.32 time: 0.866808 Oct 27 03:43:31.846210 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2502/5297] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:43:30 2022] GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac => generated 2383 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:43:31.872739 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8fec49fa-38a8-449f-b62c-80c563c9d454 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1c7e475a-3b5e-44fc-8548-9fcc062c82ec"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:43:31.881412 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8fec49fa-38a8-449f-b62c-80c563c9d454 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: ce85aa86-fbba-4eca-97e8-173da3cdc7c3] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:31.901464 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-918492f4-1f38-4ecc-af68-c0fff8fe901b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:31.938846 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8fec49fa-38a8-449f-b62c-80c563c9d454 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:31.940779 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8fec49fa-38a8-449f-b62c-80c563c9d454 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:31.942682 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8fec49fa-38a8-449f-b62c-80c563c9d454 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:31.949451 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8fec49fa-38a8-449f-b62c-80c563c9d454 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:31.949451 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8fec49fa-38a8-449f-b62c-80c563c9d454 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:31.949786 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-918492f4-1f38-4ecc-af68-c0fff8fe901b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:31.949899 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8fec49fa-38a8-449f-b62c-80c563c9d454 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:31.949992 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-918492f4-1f38-4ecc-af68-c0fff8fe901b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:31.953395 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-918492f4-1f38-4ecc-af68-c0fff8fe901b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d" status: 200 len: 1599 microversion: 2.20 time: 0.356603 Oct 27 03:43:31.954405 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2796/5298] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:43:31 2022] GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d => generated 1599 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:43:31.979005 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-922fbc89-71f4-4523-b084-9f525cdf23b2 req-24e6e02e-fcaa-4aff-a541-c9f6aefce0b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e73d534-0a40-42d2-813c-2e9dbb9239ac", "name": "network-vif-deleted", "tag": "0cd3187b-ba4d-438e-9eba-f156955f5791"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:43:32.008935 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-922fbc89-71f4-4523-b084-9f525cdf23b2 req-24e6e02e-fcaa-4aff-a541-c9f6aefce0b5 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:32.009718 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-922fbc89-71f4-4523-b084-9f525cdf23b2 req-24e6e02e-fcaa-4aff-a541-c9f6aefce0b5 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:32.009853 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-922fbc89-71f4-4523-b084-9f525cdf23b2 req-24e6e02e-fcaa-4aff-a541-c9f6aefce0b5 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:32.049245 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-922fbc89-71f4-4523-b084-9f525cdf23b2 req-24e6e02e-fcaa-4aff-a541-c9f6aefce0b5 service nova] Creating event network-vif-deleted:0cd3187b-ba4d-438e-9eba-f156955f5791 for instance 7e73d534-0a40-42d2-813c-2e9dbb9239ac on n-h2-862769-1 Oct 27 03:43:32.055815 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-922fbc89-71f4-4523-b084-9f525cdf23b2 req-24e6e02e-fcaa-4aff-a541-c9f6aefce0b5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091413 Oct 27 03:43:32.057074 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2797/5299] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:43:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:43:32.068956 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-da3b004b-53e9-41a2-aecd-6dc1b4d96d03 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:32.071400 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-da3b004b-53e9-41a2-aecd-6dc1b4d96d03 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 1db2318e-9ac7-4994-8daa-14ae22537d5d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:32.079347 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-da3b004b-53e9-41a2-aecd-6dc1b4d96d03 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:32.079919 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-da3b004b-53e9-41a2-aecd-6dc1b4d96d03 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:32.080767 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-da3b004b-53e9-41a2-aecd-6dc1b4d96d03 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:32.081557 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-da3b004b-53e9-41a2-aecd-6dc1b4d96d03 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:32.082159 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-da3b004b-53e9-41a2-aecd-6dc1b4d96d03 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:32.082810 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-da3b004b-53e9-41a2-aecd-6dc1b4d96d03 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:32.244955 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-da3b004b-53e9-41a2-aecd-6dc1b4d96d03 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.182644 Oct 27 03:43:32.251429 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2798/5300] 10.222.0.20 () {60 vars in 1316 bytes} [Thu Oct 27 03:43:32 2022] GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d/os-interface => generated 285 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 03:43:32.266219 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-12b349b0-b6f3-46ec-9f3d-a6849df124cf tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:32.271574 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-12b349b0-b6f3-46ec-9f3d-a6849df124cf tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: 55152bbe-5a47-4916-ad12-5f1640f0be61] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:32.276018 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-12b349b0-b6f3-46ec-9f3d-a6849df124cf tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:32.276888 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-12b349b0-b6f3-46ec-9f3d-a6849df124cf tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:32.277596 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-12b349b0-b6f3-46ec-9f3d-a6849df124cf tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:32.279365 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-12b349b0-b6f3-46ec-9f3d-a6849df124cf tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:32.280586 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-12b349b0-b6f3-46ec-9f3d-a6849df124cf tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:32.281039 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-12b349b0-b6f3-46ec-9f3d-a6849df124cf tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:32.825228 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-12b349b0-b6f3-46ec-9f3d-a6849df124cf tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:32.838268 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-12b349b0-b6f3-46ec-9f3d-a6849df124cf tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61" status: 200 len: 1515 microversion: 2.1 time: 0.582668 Oct 27 03:43:32.840438 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2799/5301] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:43:32 2022] GET /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61 => generated 1515 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:43:32.850793 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d1a89b4d-cee8-46cb-a83c-9348dddb9b66 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:32.852514 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d1a89b4d-cee8-46cb-a83c-9348dddb9b66 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: dbdbec9a-f4bf-4740-ab67-3c8891e341a1] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:32.870785 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d1a89b4d-cee8-46cb-a83c-9348dddb9b66 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:32.871293 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d1a89b4d-cee8-46cb-a83c-9348dddb9b66 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:32.871953 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d1a89b4d-cee8-46cb-a83c-9348dddb9b66 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:32.872907 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d1a89b4d-cee8-46cb-a83c-9348dddb9b66 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:32.873529 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d1a89b4d-cee8-46cb-a83c-9348dddb9b66 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:32.875241 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d1a89b4d-cee8-46cb-a83c-9348dddb9b66 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:32.895464 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8fec49fa-38a8-449f-b62c-80c563c9d454 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "POST /compute/v2.1/servers/ce85aa86-fbba-4eca-97e8-173da3cdc7c3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.046894 Oct 27 03:43:32.896994 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2503/5302] 10.222.0.20 () {60 vars in 1323 bytes} [Thu Oct 27 03:43:31 2022] POST /compute/v2.1/servers/ce85aa86-fbba-4eca-97e8-173da3cdc7c3/os-volume_attachments => generated 194 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:43:32.908233 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-61075fa9-0775-4792-903c-d67db46efcb4 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:32.910226 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-61075fa9-0775-4792-903c-d67db46efcb4 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] [instance: 7e73d534-0a40-42d2-813c-2e9dbb9239ac] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:32.925935 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-61075fa9-0775-4792-903c-d67db46efcb4 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:32.925935 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-61075fa9-0775-4792-903c-d67db46efcb4 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:32.925935 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-61075fa9-0775-4792-903c-d67db46efcb4 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:32.926653 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-61075fa9-0775-4792-903c-d67db46efcb4 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:32.927425 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-61075fa9-0775-4792-903c-d67db46efcb4 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:32.928985 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-61075fa9-0775-4792-903c-d67db46efcb4 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:33.356316 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-61075fa9-0775-4792-903c-d67db46efcb4 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:33.370776 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-61075fa9-0775-4792-903c-d67db46efcb4 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:33.372651 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-61075fa9-0775-4792-903c-d67db46efcb4 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:33.379689 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-61075fa9-0775-4792-903c-d67db46efcb4 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] 10.222.0.20 "GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac" status: 200 len: 2029 microversion: 2.32 time: 0.481384 Oct 27 03:43:33.381086 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2504/5303] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:43:32 2022] GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac => generated 2029 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:43:33.813145 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d1a89b4d-cee8-46cb-a83c-9348dddb9b66 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:33.820764 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=100 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:43:33.827625 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d1a89b4d-cee8-46cb-a83c-9348dddb9b66 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1" status: 200 len: 1564 microversion: 2.1 time: 0.983749 Oct 27 03:43:33.828252 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2800/5304] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:43:32 2022] GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1 => generated 1564 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:43:33.857162 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5a0417c6-3562-4ab8-a97a-e954830ce640 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:33.857833 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5a0417c6-3562-4ab8-a97a-e954830ce640 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: dbdbec9a-f4bf-4740-ab67-3c8891e341a1] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:33.866607 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-67464283-4d84-4b1c-b157-efaba6cc3d53 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:33.867247 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-67464283-4d84-4b1c-b157-efaba6cc3d53 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: 55152bbe-5a47-4916-ad12-5f1640f0be61] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:33.880954 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-67464283-4d84-4b1c-b157-efaba6cc3d53 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:33.883436 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5a0417c6-3562-4ab8-a97a-e954830ce640 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:33.883944 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5a0417c6-3562-4ab8-a97a-e954830ce640 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:33.884392 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5a0417c6-3562-4ab8-a97a-e954830ce640 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:33.885116 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5a0417c6-3562-4ab8-a97a-e954830ce640 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:33.885612 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5a0417c6-3562-4ab8-a97a-e954830ce640 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:33.900828 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-67464283-4d84-4b1c-b157-efaba6cc3d53 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:33.901474 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-67464283-4d84-4b1c-b157-efaba6cc3d53 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:33.902300 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-67464283-4d84-4b1c-b157-efaba6cc3d53 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:33.902769 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-67464283-4d84-4b1c-b157-efaba6cc3d53 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:33.907954 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5a0417c6-3562-4ab8-a97a-e954830ce640 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:33.909107 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-67464283-4d84-4b1c-b157-efaba6cc3d53 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:34.149714 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5a0417c6-3562-4ab8-a97a-e954830ce640 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.296839 Oct 27 03:43:34.150830 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2505/5305] 10.222.0.20 () {58 vars in 1275 bytes} [Thu Oct 27 03:43:33 2022] GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1/os-interface => generated 284 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:43:34.167011 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-052e73f4-45da-446b-9a92-23245feed35a req-16dc2961-0118-432d-88c3-2c6e17adcaf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e73d534-0a40-42d2-813c-2e9dbb9239ac", "name": "network-vif-deleted", "tag": "46cca111-fadc-4d6b-a199-5b4f2005c03d"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:43:34.181947 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-052e73f4-45da-446b-9a92-23245feed35a req-16dc2961-0118-432d-88c3-2c6e17adcaf4 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:34.182604 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-052e73f4-45da-446b-9a92-23245feed35a req-16dc2961-0118-432d-88c3-2c6e17adcaf4 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:34.183075 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-052e73f4-45da-446b-9a92-23245feed35a req-16dc2961-0118-432d-88c3-2c6e17adcaf4 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:34.222080 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-052e73f4-45da-446b-9a92-23245feed35a req-16dc2961-0118-432d-88c3-2c6e17adcaf4 service nova] Creating event network-vif-deleted:46cca111-fadc-4d6b-a199-5b4f2005c03d for instance 7e73d534-0a40-42d2-813c-2e9dbb9239ac on n-h2-862769-1 Oct 27 03:43:34.239475 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-052e73f4-45da-446b-9a92-23245feed35a req-16dc2961-0118-432d-88c3-2c6e17adcaf4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081081 Oct 27 03:43:34.249540 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2506/5306] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:43:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:43:34.413235 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-43c61d6c-1ae3-4ea9-b86e-95e146687548 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:34.413953 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-43c61d6c-1ae3-4ea9-b86e-95e146687548 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] [instance: 7e73d534-0a40-42d2-813c-2e9dbb9239ac] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:34.429052 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-43c61d6c-1ae3-4ea9-b86e-95e146687548 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:34.436203 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-43c61d6c-1ae3-4ea9-b86e-95e146687548 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:34.436203 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-43c61d6c-1ae3-4ea9-b86e-95e146687548 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:34.436203 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-43c61d6c-1ae3-4ea9-b86e-95e146687548 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:34.436203 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-43c61d6c-1ae3-4ea9-b86e-95e146687548 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:34.439351 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-43c61d6c-1ae3-4ea9-b86e-95e146687548 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:34.590626 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-67464283-4d84-4b1c-b157-efaba6cc3d53 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:34.604806 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-67464283-4d84-4b1c-b157-efaba6cc3d53 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61" status: 200 len: 1515 microversion: 2.1 time: 0.742686 Oct 27 03:43:34.610693 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2801/5307] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:43:33 2022] GET /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61 => generated 1515 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:43:34.629847 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-43c61d6c-1ae3-4ea9-b86e-95e146687548 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:34.653280 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-43c61d6c-1ae3-4ea9-b86e-95e146687548 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:34.656760 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-43c61d6c-1ae3-4ea9-b86e-95e146687548 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:34.658342 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-43c61d6c-1ae3-4ea9-b86e-95e146687548 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] 10.222.0.20 "GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac" status: 200 len: 1604 microversion: 2.32 time: 0.250642 Oct 27 03:43:34.686428 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2507/5308] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:43:34 2022] GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac => generated 1604 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:43:35.636473 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f15f5f68-b524-4fad-93d5-823d2d33afc1 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:35.637678 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f15f5f68-b524-4fad-93d5-823d2d33afc1 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: 55152bbe-5a47-4916-ad12-5f1640f0be61] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:35.659526 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f15f5f68-b524-4fad-93d5-823d2d33afc1 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:35.660116 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f15f5f68-b524-4fad-93d5-823d2d33afc1 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:35.660562 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f15f5f68-b524-4fad-93d5-823d2d33afc1 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:35.672422 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f15f5f68-b524-4fad-93d5-823d2d33afc1 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:35.675636 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f15f5f68-b524-4fad-93d5-823d2d33afc1 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:35.681008 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f15f5f68-b524-4fad-93d5-823d2d33afc1 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:35.686741 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-93fd73ce-437b-4c08-b639-7ee9a6dda35c tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:35.687957 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-93fd73ce-437b-4c08-b639-7ee9a6dda35c tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] [instance: 7e73d534-0a40-42d2-813c-2e9dbb9239ac] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:35.698959 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-93fd73ce-437b-4c08-b639-7ee9a6dda35c tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:35.705538 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-93fd73ce-437b-4c08-b639-7ee9a6dda35c tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:35.705538 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-93fd73ce-437b-4c08-b639-7ee9a6dda35c tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:35.707919 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-93fd73ce-437b-4c08-b639-7ee9a6dda35c tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:35.709226 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-93fd73ce-437b-4c08-b639-7ee9a6dda35c tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:35.710572 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-93fd73ce-437b-4c08-b639-7ee9a6dda35c tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:35.943711 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-93fd73ce-437b-4c08-b639-7ee9a6dda35c tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:35.984281 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-93fd73ce-437b-4c08-b639-7ee9a6dda35c tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:35.987732 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-93fd73ce-437b-4c08-b639-7ee9a6dda35c tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:35.991276 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-93fd73ce-437b-4c08-b639-7ee9a6dda35c tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] 10.222.0.20 "GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac" status: 200 len: 1604 microversion: 2.32 time: 0.308676 Oct 27 03:43:36.005732 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2508/5309] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:43:35 2022] GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac => generated 1604 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:43:36.024698 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-da342059-3442-4f2c-b1d8-d63894ea4951 req-0546160b-f713-4dea-8bb4-d690196f96d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1db2318e-9ac7-4994-8daa-14ae22537d5d", "tag": "162a3612-f72a-4eb0-9872-8b121e85445d"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:43:36.037477 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-da342059-3442-4f2c-b1d8-d63894ea4951 req-0546160b-f713-4dea-8bb4-d690196f96d6 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:36.038512 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-da342059-3442-4f2c-b1d8-d63894ea4951 req-0546160b-f713-4dea-8bb4-d690196f96d6 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:36.039167 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-da342059-3442-4f2c-b1d8-d63894ea4951 req-0546160b-f713-4dea-8bb4-d690196f96d6 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:36.077335 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-da342059-3442-4f2c-b1d8-d63894ea4951 req-0546160b-f713-4dea-8bb4-d690196f96d6 service nova] Creating event network-changed:162a3612-f72a-4eb0-9872-8b121e85445d for instance 1db2318e-9ac7-4994-8daa-14ae22537d5d on n-h2-862769-1 Oct 27 03:43:36.092260 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-da342059-3442-4f2c-b1d8-d63894ea4951 req-0546160b-f713-4dea-8bb4-d690196f96d6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072344 Oct 27 03:43:36.093288 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2509/5310] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:43:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:43:36.199397 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f15f5f68-b524-4fad-93d5-823d2d33afc1 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:36.214498 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f15f5f68-b524-4fad-93d5-823d2d33afc1 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61" status: 200 len: 1515 microversion: 2.1 time: 0.580531 Oct 27 03:43:36.215116 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2802/5311] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:43:35 2022] GET /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61 => generated 1515 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:43:36.855522 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0a1f4e07-bb77-4395-b3f7-575108ef9a63 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-174852628", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:43:36.963414 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-0a1f4e07-bb77-4395-b3f7-575108ef9a63 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] validate_networks() for [('3784a63d-0c1a-4444-9ee2-139a9d54618f', None, None, None, None, None)] {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:43:37.025077 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ed0cbac7-c194-4f7f-a65f-af41b7e6f71f tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:37.035804 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ed0cbac7-c194-4f7f-a65f-af41b7e6f71f tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] [instance: 7e73d534-0a40-42d2-813c-2e9dbb9239ac] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:37.061192 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ed0cbac7-c194-4f7f-a65f-af41b7e6f71f tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:37.061998 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ed0cbac7-c194-4f7f-a65f-af41b7e6f71f tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:37.065148 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ed0cbac7-c194-4f7f-a65f-af41b7e6f71f tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:37.066199 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ed0cbac7-c194-4f7f-a65f-af41b7e6f71f tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:37.069491 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ed0cbac7-c194-4f7f-a65f-af41b7e6f71f tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:37.071202 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ed0cbac7-c194-4f7f-a65f-af41b7e6f71f tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:37.238359 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ed0cbac7-c194-4f7f-a65f-af41b7e6f71f tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:37.248824 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ed0cbac7-c194-4f7f-a65f-af41b7e6f71f tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:37.257839 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ed0cbac7-c194-4f7f-a65f-af41b7e6f71f tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:37.264325 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ed0cbac7-c194-4f7f-a65f-af41b7e6f71f tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] 10.222.0.20 "GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac" status: 200 len: 1604 microversion: 2.32 time: 0.239660 Oct 27 03:43:37.264325 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2803/5312] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:43:37 2022] GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac => generated 1604 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:43:37.274917 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4ce2b1df-dbe2-4585-b7bf-4bec6226d7d5 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:37.275978 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4ce2b1df-dbe2-4585-b7bf-4bec6226d7d5 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: 55152bbe-5a47-4916-ad12-5f1640f0be61] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:37.298386 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4ce2b1df-dbe2-4585-b7bf-4bec6226d7d5 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:37.300920 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4ce2b1df-dbe2-4585-b7bf-4bec6226d7d5 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:37.303804 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4ce2b1df-dbe2-4585-b7bf-4bec6226d7d5 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:37.304608 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4ce2b1df-dbe2-4585-b7bf-4bec6226d7d5 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:37.306990 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4ce2b1df-dbe2-4585-b7bf-4bec6226d7d5 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:37.307698 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4ce2b1df-dbe2-4585-b7bf-4bec6226d7d5 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:37.743315 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4ce2b1df-dbe2-4585-b7bf-4bec6226d7d5 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:37.753218 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4ce2b1df-dbe2-4585-b7bf-4bec6226d7d5 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61" status: 200 len: 1515 microversion: 2.1 time: 0.492037 Oct 27 03:43:37.766919 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2804/5313] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:43:37 2022] GET /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61 => generated 1515 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:43:38.038274 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-63ff726e-1db5-4677-b802-37c9022186b4 req-43eb91d0-b2b4-40a6-8d74-85be4cd71de3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbdbec9a-f4bf-4740-ab67-3c8891e341a1", "tag": "833035a3-c97d-4212-b516-f56e8d9754b6"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:43:38.063160 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-63ff726e-1db5-4677-b802-37c9022186b4 req-43eb91d0-b2b4-40a6-8d74-85be4cd71de3 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:38.063695 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-63ff726e-1db5-4677-b802-37c9022186b4 req-43eb91d0-b2b4-40a6-8d74-85be4cd71de3 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:38.064148 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-63ff726e-1db5-4677-b802-37c9022186b4 req-43eb91d0-b2b4-40a6-8d74-85be4cd71de3 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:38.092913 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-63ff726e-1db5-4677-b802-37c9022186b4 req-43eb91d0-b2b4-40a6-8d74-85be4cd71de3 service nova] Creating event network-changed:833035a3-c97d-4212-b516-f56e8d9754b6 for instance dbdbec9a-f4bf-4740-ab67-3c8891e341a1 on n-h2-862769-1 Oct 27 03:43:38.107826 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-63ff726e-1db5-4677-b802-37c9022186b4 req-43eb91d0-b2b4-40a6-8d74-85be4cd71de3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073836 Oct 27 03:43:38.109548 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2805/5314] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:43:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:43:38.294904 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3ab66fa5-e28a-4321-81a0-1d670290ec25 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:38.295628 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3ab66fa5-e28a-4321-81a0-1d670290ec25 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] [instance: 7e73d534-0a40-42d2-813c-2e9dbb9239ac] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:38.297660 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:43:38.315740 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3ab66fa5-e28a-4321-81a0-1d670290ec25 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:38.316252 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3ab66fa5-e28a-4321-81a0-1d670290ec25 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:38.316708 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3ab66fa5-e28a-4321-81a0-1d670290ec25 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:38.317473 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3ab66fa5-e28a-4321-81a0-1d670290ec25 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:38.318013 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3ab66fa5-e28a-4321-81a0-1d670290ec25 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:38.318493 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3ab66fa5-e28a-4321-81a0-1d670290ec25 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:38.402269 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-0a1f4e07-bb77-4395-b3f7-575108ef9a63 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:43:38.402782 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-0a1f4e07-bb77-4395-b3f7-575108ef9a63 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:43:38.403593 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-0a1f4e07-bb77-4395-b3f7-575108ef9a63 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:43:38.404023 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-0a1f4e07-bb77-4395-b3f7-575108ef9a63 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:43:38.404627 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-0a1f4e07-bb77-4395-b3f7-575108ef9a63 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:43:38.428208 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0a1f4e07-bb77-4395-b3f7-575108ef9a63 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:38.431149 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0a1f4e07-bb77-4395-b3f7-575108ef9a63 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:38.432028 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0a1f4e07-bb77-4395-b3f7-575108ef9a63 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:38.435441 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0a1f4e07-bb77-4395-b3f7-575108ef9a63 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:38.437357 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0a1f4e07-bb77-4395-b3f7-575108ef9a63 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:38.439086 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0a1f4e07-bb77-4395-b3f7-575108ef9a63 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:38.490786 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3ab66fa5-e28a-4321-81a0-1d670290ec25 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:38.499396 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-0a1f4e07-bb77-4395-b3f7-575108ef9a63 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Getting quotas for project e4f0730b38a946759ea32c36f5876eb3. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:43:38.505622 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3ab66fa5-e28a-4321-81a0-1d670290ec25 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:38.507259 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-0a1f4e07-bb77-4395-b3f7-575108ef9a63 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Getting quotas for user ae9ddb0e44024937865411a7d2c3d956 and project e4f0730b38a946759ea32c36f5876eb3. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:43:38.515603 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3ab66fa5-e28a-4321-81a0-1d670290ec25 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:38.516881 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3ab66fa5-e28a-4321-81a0-1d670290ec25 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] 10.222.0.20 "GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac" status: 200 len: 1604 microversion: 2.32 time: 0.226773 Oct 27 03:43:38.518276 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2806/5315] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:43:38 2022] GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac => generated 1604 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:43:38.525686 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0a1f4e07-bb77-4395-b3f7-575108ef9a63 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:43:38.529386 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0a1f4e07-bb77-4395-b3f7-575108ef9a63 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] [instance: af90f208-7b8a-4ae4-a654-5fc632279527] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:43:38.687949 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0a1f4e07-bb77-4395-b3f7-575108ef9a63 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.062641 Oct 27 03:43:38.693407 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2510/5316] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:43:36 2022] POST /compute/v2.1/servers => generated 383 bytes in 2069 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 03:43:38.706553 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-19a0ea05-9e3c-466d-ab46-4e1267900eda tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:38.708642 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-19a0ea05-9e3c-466d-ab46-4e1267900eda tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] [instance: af90f208-7b8a-4ae4-a654-5fc632279527] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:38.778135 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-49376d76-e026-4f6f-b232-a94a5c660bf3 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:38.779028 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-49376d76-e026-4f6f-b232-a94a5c660bf3 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: 55152bbe-5a47-4916-ad12-5f1640f0be61] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:38.791111 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-49376d76-e026-4f6f-b232-a94a5c660bf3 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:38.791911 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-49376d76-e026-4f6f-b232-a94a5c660bf3 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:38.792538 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-49376d76-e026-4f6f-b232-a94a5c660bf3 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:38.794831 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-49376d76-e026-4f6f-b232-a94a5c660bf3 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:38.797555 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-49376d76-e026-4f6f-b232-a94a5c660bf3 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:38.798226 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-49376d76-e026-4f6f-b232-a94a5c660bf3 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:38.804161 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-19a0ea05-9e3c-466d-ab46-4e1267900eda tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9ddb0e44024937865411a7d2c3d956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4f0730b38a946759ea32c36f5876eb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:38.813974 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-19a0ea05-9e3c-466d-ab46-4e1267900eda tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] 10.222.0.20 "GET /compute/v2.1/servers/af90f208-7b8a-4ae4-a654-5fc632279527" status: 200 len: 1222 microversion: 2.1 time: 0.111987 Oct 27 03:43:38.815332 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2807/5317] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:43:38 2022] GET /compute/v2.1/servers/af90f208-7b8a-4ae4-a654-5fc632279527 => generated 1222 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:43:39.263027 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-49376d76-e026-4f6f-b232-a94a5c660bf3 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:39.278095 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-49376d76-e026-4f6f-b232-a94a5c660bf3 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61" status: 200 len: 1515 microversion: 2.1 time: 0.503720 Oct 27 03:43:39.279233 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2511/5318] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:43:38 2022] GET /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61 => generated 1515 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:43:39.559124 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-49c69098-538d-406f-baed-2ed3048fb963 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:39.562003 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-49c69098-538d-406f-baed-2ed3048fb963 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] [instance: 7e73d534-0a40-42d2-813c-2e9dbb9239ac] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:39.594688 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-49c69098-538d-406f-baed-2ed3048fb963 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:39.595492 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-49c69098-538d-406f-baed-2ed3048fb963 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:39.596104 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-49c69098-538d-406f-baed-2ed3048fb963 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:39.597360 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-49c69098-538d-406f-baed-2ed3048fb963 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:39.598222 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-49c69098-538d-406f-baed-2ed3048fb963 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:39.600569 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-49c69098-538d-406f-baed-2ed3048fb963 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:39.754575 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-49c69098-538d-406f-baed-2ed3048fb963 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:39.772207 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-49c69098-538d-406f-baed-2ed3048fb963 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:39.776159 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-49c69098-538d-406f-baed-2ed3048fb963 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:39.778525 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-49c69098-538d-406f-baed-2ed3048fb963 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] 10.222.0.20 "GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac" status: 200 len: 1604 microversion: 2.32 time: 0.229509 Oct 27 03:43:39.782590 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2808/5319] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:43:39 2022] GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac => generated 1604 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:43:39.841969 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-641bb3e2-b698-44f5-8ed4-4b75aeb300d3 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:39.842630 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-641bb3e2-b698-44f5-8ed4-4b75aeb300d3 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] [instance: af90f208-7b8a-4ae4-a654-5fc632279527] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:39.952329 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-641bb3e2-b698-44f5-8ed4-4b75aeb300d3 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9ddb0e44024937865411a7d2c3d956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4f0730b38a946759ea32c36f5876eb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:39.964856 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-641bb3e2-b698-44f5-8ed4-4b75aeb300d3 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] 10.222.0.20 "GET /compute/v2.1/servers/af90f208-7b8a-4ae4-a654-5fc632279527" status: 200 len: 1222 microversion: 2.1 time: 0.125970 Oct 27 03:43:39.965806 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2512/5320] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:43:39 2022] GET /compute/v2.1/servers/af90f208-7b8a-4ae4-a654-5fc632279527 => generated 1222 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:43:40.302766 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-293cb826-380e-41be-b9b0-14f072e4f18d tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:40.303409 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-293cb826-380e-41be-b9b0-14f072e4f18d tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: 55152bbe-5a47-4916-ad12-5f1640f0be61] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:40.324787 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-293cb826-380e-41be-b9b0-14f072e4f18d tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:40.324787 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-293cb826-380e-41be-b9b0-14f072e4f18d tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:40.324787 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-293cb826-380e-41be-b9b0-14f072e4f18d tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:40.325866 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-293cb826-380e-41be-b9b0-14f072e4f18d tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:40.331641 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-293cb826-380e-41be-b9b0-14f072e4f18d tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:40.332106 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-293cb826-380e-41be-b9b0-14f072e4f18d tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:40.666682 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-293cb826-380e-41be-b9b0-14f072e4f18d tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:40.674924 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-293cb826-380e-41be-b9b0-14f072e4f18d tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61" status: 200 len: 1515 microversion: 2.1 time: 0.376649 Oct 27 03:43:40.697510 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2809/5321] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:43:40 2022] GET /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61 => generated 1515 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:43:40.810478 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-94ee7560-0c27-4a29-ab2c-abf24641a4c8 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:40.812138 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-94ee7560-0c27-4a29-ab2c-abf24641a4c8 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] [instance: 7e73d534-0a40-42d2-813c-2e9dbb9239ac] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:40.836188 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-94ee7560-0c27-4a29-ab2c-abf24641a4c8 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:40.836971 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-94ee7560-0c27-4a29-ab2c-abf24641a4c8 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:40.837586 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-94ee7560-0c27-4a29-ab2c-abf24641a4c8 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:40.838602 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-94ee7560-0c27-4a29-ab2c-abf24641a4c8 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:40.839153 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-94ee7560-0c27-4a29-ab2c-abf24641a4c8 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:40.839910 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-94ee7560-0c27-4a29-ab2c-abf24641a4c8 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:40.991030 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-286b4690-8912-44be-8119-c76cfc132f83 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:40.991672 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-286b4690-8912-44be-8119-c76cfc132f83 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] [instance: af90f208-7b8a-4ae4-a654-5fc632279527] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:41.010543 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-286b4690-8912-44be-8119-c76cfc132f83 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:41.011054 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-286b4690-8912-44be-8119-c76cfc132f83 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:41.011505 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-286b4690-8912-44be-8119-c76cfc132f83 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:41.016869 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-286b4690-8912-44be-8119-c76cfc132f83 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:41.017378 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-286b4690-8912-44be-8119-c76cfc132f83 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:41.017835 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-286b4690-8912-44be-8119-c76cfc132f83 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:41.127019 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-286b4690-8912-44be-8119-c76cfc132f83 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9ddb0e44024937865411a7d2c3d956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4f0730b38a946759ea32c36f5876eb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:41.145304 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-286b4690-8912-44be-8119-c76cfc132f83 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] 10.222.0.20 "GET /compute/v2.1/servers/af90f208-7b8a-4ae4-a654-5fc632279527" status: 200 len: 1274 microversion: 2.1 time: 0.160662 Oct 27 03:43:41.146146 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2810/5322] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:43:40 2022] GET /compute/v2.1/servers/af90f208-7b8a-4ae4-a654-5fc632279527 => generated 1274 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:43:41.264203 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-94ee7560-0c27-4a29-ab2c-abf24641a4c8 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:41.281080 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-94ee7560-0c27-4a29-ab2c-abf24641a4c8 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:41.289829 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-94ee7560-0c27-4a29-ab2c-abf24641a4c8 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:41.292565 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-94ee7560-0c27-4a29-ab2c-abf24641a4c8 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] 10.222.0.20 "GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac" status: 200 len: 1604 microversion: 2.32 time: 0.485128 Oct 27 03:43:41.292814 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2513/5323] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:43:40 2022] GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac => generated 1604 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:43:41.728986 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-35dfdfa5-7247-4c34-8fbd-db3a24a1d68e tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:41.731552 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-35dfdfa5-7247-4c34-8fbd-db3a24a1d68e tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: 55152bbe-5a47-4916-ad12-5f1640f0be61] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:41.756895 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-35dfdfa5-7247-4c34-8fbd-db3a24a1d68e tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:41.757750 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-35dfdfa5-7247-4c34-8fbd-db3a24a1d68e tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:41.759635 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-35dfdfa5-7247-4c34-8fbd-db3a24a1d68e tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:41.762119 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-35dfdfa5-7247-4c34-8fbd-db3a24a1d68e tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:41.763018 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-35dfdfa5-7247-4c34-8fbd-db3a24a1d68e tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:41.766623 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-35dfdfa5-7247-4c34-8fbd-db3a24a1d68e tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:42.173128 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0fd220e1-6bd8-4257-9ee8-38941c0374e5 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:42.173850 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0fd220e1-6bd8-4257-9ee8-38941c0374e5 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] [instance: af90f208-7b8a-4ae4-a654-5fc632279527] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:42.177792 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-35dfdfa5-7247-4c34-8fbd-db3a24a1d68e tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:42.186631 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-35dfdfa5-7247-4c34-8fbd-db3a24a1d68e tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61" status: 200 len: 1515 microversion: 2.1 time: 0.462418 Oct 27 03:43:42.202765 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2811/5324] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:43:41 2022] GET /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61 => generated 1515 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:43:42.202872 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0fd220e1-6bd8-4257-9ee8-38941c0374e5 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:42.202872 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0fd220e1-6bd8-4257-9ee8-38941c0374e5 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:42.202872 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0fd220e1-6bd8-4257-9ee8-38941c0374e5 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:42.202872 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0fd220e1-6bd8-4257-9ee8-38941c0374e5 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:42.202872 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0fd220e1-6bd8-4257-9ee8-38941c0374e5 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:42.202872 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0fd220e1-6bd8-4257-9ee8-38941c0374e5 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:42.320339 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0fd220e1-6bd8-4257-9ee8-38941c0374e5 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9ddb0e44024937865411a7d2c3d956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4f0730b38a946759ea32c36f5876eb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:42.324014 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-abe1f8c4-b17c-497f-b63b-1f26ad6e60e9 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:42.324475 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-abe1f8c4-b17c-497f-b63b-1f26ad6e60e9 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] [instance: 7e73d534-0a40-42d2-813c-2e9dbb9239ac] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:42.331171 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-abe1f8c4-b17c-497f-b63b-1f26ad6e60e9 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:42.331660 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-abe1f8c4-b17c-497f-b63b-1f26ad6e60e9 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:42.332296 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-abe1f8c4-b17c-497f-b63b-1f26ad6e60e9 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:42.333950 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-abe1f8c4-b17c-497f-b63b-1f26ad6e60e9 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:42.334602 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-abe1f8c4-b17c-497f-b63b-1f26ad6e60e9 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:42.335192 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-abe1f8c4-b17c-497f-b63b-1f26ad6e60e9 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:42.338018 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0fd220e1-6bd8-4257-9ee8-38941c0374e5 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] 10.222.0.20 "GET /compute/v2.1/servers/af90f208-7b8a-4ae4-a654-5fc632279527" status: 200 len: 1274 microversion: 2.1 time: 0.168984 Oct 27 03:43:42.338630 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2514/5325] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:43:42 2022] GET /compute/v2.1/servers/af90f208-7b8a-4ae4-a654-5fc632279527 => generated 1274 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:43:42.491426 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-abe1f8c4-b17c-497f-b63b-1f26ad6e60e9 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:42.505787 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-abe1f8c4-b17c-497f-b63b-1f26ad6e60e9 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:42.507858 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-abe1f8c4-b17c-497f-b63b-1f26ad6e60e9 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:42.510267 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-abe1f8c4-b17c-497f-b63b-1f26ad6e60e9 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] 10.222.0.20 "GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac" status: 200 len: 1604 microversion: 2.32 time: 0.191524 Oct 27 03:43:42.521359 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2812/5326] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:43:42 2022] GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac => generated 1604 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:43:43.216552 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f9ae71de-680e-48f5-b349-63ed9f195138 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:43.217682 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f9ae71de-680e-48f5-b349-63ed9f195138 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: 55152bbe-5a47-4916-ad12-5f1640f0be61] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:43.221582 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:43:43.228761 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f9ae71de-680e-48f5-b349-63ed9f195138 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:43.230366 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f9ae71de-680e-48f5-b349-63ed9f195138 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:43.230653 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f9ae71de-680e-48f5-b349-63ed9f195138 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:43.231438 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f9ae71de-680e-48f5-b349-63ed9f195138 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:43.232149 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f9ae71de-680e-48f5-b349-63ed9f195138 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:43.232871 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f9ae71de-680e-48f5-b349-63ed9f195138 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:43.364919 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-dd7a30cb-131a-4b4a-bdd1-026b33a94ff1 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:43.367162 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-dd7a30cb-131a-4b4a-bdd1-026b33a94ff1 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] [instance: af90f208-7b8a-4ae4-a654-5fc632279527] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:43.381458 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dd7a30cb-131a-4b4a-bdd1-026b33a94ff1 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:43.387644 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dd7a30cb-131a-4b4a-bdd1-026b33a94ff1 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:43.389531 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dd7a30cb-131a-4b4a-bdd1-026b33a94ff1 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:43.391718 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dd7a30cb-131a-4b4a-bdd1-026b33a94ff1 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:43.392408 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dd7a30cb-131a-4b4a-bdd1-026b33a94ff1 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:43.393597 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dd7a30cb-131a-4b4a-bdd1-026b33a94ff1 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:43.557149 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f9ae71de-680e-48f5-b349-63ed9f195138 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:43.568259 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f9ae71de-680e-48f5-b349-63ed9f195138 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61" status: 200 len: 1521 microversion: 2.1 time: 0.356895 Oct 27 03:43:43.576478 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2515/5327] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:43:43 2022] GET /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61 => generated 1521 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:43:43.594700 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-fec90980-d7b0-4393-84ec-2fc47328578e tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:43.595643 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-fec90980-d7b0-4393-84ec-2fc47328578e tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] [instance: 7e73d534-0a40-42d2-813c-2e9dbb9239ac] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:43.599907 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-dd7a30cb-131a-4b4a-bdd1-026b33a94ff1 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9ddb0e44024937865411a7d2c3d956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4f0730b38a946759ea32c36f5876eb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:43.610649 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fec90980-d7b0-4393-84ec-2fc47328578e tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:43.612462 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fec90980-d7b0-4393-84ec-2fc47328578e tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:43.615140 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fec90980-d7b0-4393-84ec-2fc47328578e tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:43.622364 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fec90980-d7b0-4393-84ec-2fc47328578e tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:43.623457 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fec90980-d7b0-4393-84ec-2fc47328578e tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:43.628981 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fec90980-d7b0-4393-84ec-2fc47328578e tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:43.646279 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-dd7a30cb-131a-4b4a-bdd1-026b33a94ff1 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] 10.222.0.20 "GET /compute/v2.1/servers/af90f208-7b8a-4ae4-a654-5fc632279527" status: 200 len: 1282 microversion: 2.1 time: 0.288049 Oct 27 03:43:43.655089 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2813/5328] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:43:43 2022] GET /compute/v2.1/servers/af90f208-7b8a-4ae4-a654-5fc632279527 => generated 1282 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:43:43.796611 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-fec90980-d7b0-4393-84ec-2fc47328578e tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:43.810626 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-fec90980-d7b0-4393-84ec-2fc47328578e tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:43.818115 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-fec90980-d7b0-4393-84ec-2fc47328578e tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:43.819432 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-fec90980-d7b0-4393-84ec-2fc47328578e tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] 10.222.0.20 "GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac" status: 200 len: 1604 microversion: 2.32 time: 0.241738 Oct 27 03:43:43.820025 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2516/5329] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:43:43 2022] GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac => generated 1604 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:43:44.603561 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ce8efbc8-4115-480b-a176-bafefc09ecdf tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:44.604185 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ce8efbc8-4115-480b-a176-bafefc09ecdf tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: 55152bbe-5a47-4916-ad12-5f1640f0be61] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:44.617594 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ce8efbc8-4115-480b-a176-bafefc09ecdf tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:44.618373 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ce8efbc8-4115-480b-a176-bafefc09ecdf tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:44.619205 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ce8efbc8-4115-480b-a176-bafefc09ecdf tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:44.623050 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ce8efbc8-4115-480b-a176-bafefc09ecdf tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:44.624041 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ce8efbc8-4115-480b-a176-bafefc09ecdf tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:44.624807 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ce8efbc8-4115-480b-a176-bafefc09ecdf tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:44.685661 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6313ec14-15f3-4bed-9c81-481f718b3fb9 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:44.686322 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6313ec14-15f3-4bed-9c81-481f718b3fb9 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] [instance: af90f208-7b8a-4ae4-a654-5fc632279527] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:44.703892 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6313ec14-15f3-4bed-9c81-481f718b3fb9 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:44.704686 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6313ec14-15f3-4bed-9c81-481f718b3fb9 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:44.705323 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6313ec14-15f3-4bed-9c81-481f718b3fb9 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:44.706272 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6313ec14-15f3-4bed-9c81-481f718b3fb9 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:44.706927 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6313ec14-15f3-4bed-9c81-481f718b3fb9 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:44.707526 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6313ec14-15f3-4bed-9c81-481f718b3fb9 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:44.847719 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ce8efbc8-4115-480b-a176-bafefc09ecdf tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:44.855956 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ce8efbc8-4115-480b-a176-bafefc09ecdf tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61" status: 200 len: 1521 microversion: 2.1 time: 0.256255 Oct 27 03:43:44.856537 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2814/5330] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:43:44 2022] GET /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61 => generated 1521 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:43:44.861808 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5dc94c60-61af-4698-b260-3f7d81188a60 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:44.862654 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5dc94c60-61af-4698-b260-3f7d81188a60 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] [instance: 7e73d534-0a40-42d2-813c-2e9dbb9239ac] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:44.869687 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5dc94c60-61af-4698-b260-3f7d81188a60 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:44.870475 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5dc94c60-61af-4698-b260-3f7d81188a60 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:44.873524 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5dc94c60-61af-4698-b260-3f7d81188a60 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:44.874298 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5dc94c60-61af-4698-b260-3f7d81188a60 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:44.874766 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5dc94c60-61af-4698-b260-3f7d81188a60 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:44.875325 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5dc94c60-61af-4698-b260-3f7d81188a60 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:44.898665 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-6313ec14-15f3-4bed-9c81-481f718b3fb9 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9ddb0e44024937865411a7d2c3d956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4f0730b38a946759ea32c36f5876eb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:44.909453 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6313ec14-15f3-4bed-9c81-481f718b3fb9 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] 10.222.0.20 "GET /compute/v2.1/servers/af90f208-7b8a-4ae4-a654-5fc632279527" status: 200 len: 1280 microversion: 2.1 time: 0.229440 Oct 27 03:43:44.911663 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2517/5331] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:43:44 2022] GET /compute/v2.1/servers/af90f208-7b8a-4ae4-a654-5fc632279527 => generated 1280 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:43:44.948115 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5dc94c60-61af-4698-b260-3f7d81188a60 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:44.960473 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5dc94c60-61af-4698-b260-3f7d81188a60 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:44.963930 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5dc94c60-61af-4698-b260-3f7d81188a60 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:44.969327 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5dc94c60-61af-4698-b260-3f7d81188a60 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] 10.222.0.20 "GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac" status: 200 len: 1604 microversion: 2.32 time: 0.105520 Oct 27 03:43:44.970202 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2815/5332] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:43:44 2022] GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac => generated 1604 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:43:45.880587 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b3d328b9-093f-45eb-8a36-b6b6538ad270 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:45.881277 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b3d328b9-093f-45eb-8a36-b6b6538ad270 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: 55152bbe-5a47-4916-ad12-5f1640f0be61] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:45.893047 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b3d328b9-093f-45eb-8a36-b6b6538ad270 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:45.894744 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b3d328b9-093f-45eb-8a36-b6b6538ad270 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:45.897651 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b3d328b9-093f-45eb-8a36-b6b6538ad270 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:45.899000 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b3d328b9-093f-45eb-8a36-b6b6538ad270 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:45.899651 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b3d328b9-093f-45eb-8a36-b6b6538ad270 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:45.902782 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b3d328b9-093f-45eb-8a36-b6b6538ad270 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:45.934116 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ad695d61-9aea-4e5f-b2de-e8432da8bc65 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:45.934759 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ad695d61-9aea-4e5f-b2de-e8432da8bc65 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] [instance: af90f208-7b8a-4ae4-a654-5fc632279527] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:45.946871 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ad695d61-9aea-4e5f-b2de-e8432da8bc65 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:45.947391 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ad695d61-9aea-4e5f-b2de-e8432da8bc65 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:45.947851 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ad695d61-9aea-4e5f-b2de-e8432da8bc65 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:45.948927 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ad695d61-9aea-4e5f-b2de-e8432da8bc65 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:45.950593 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ad695d61-9aea-4e5f-b2de-e8432da8bc65 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:45.951855 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ad695d61-9aea-4e5f-b2de-e8432da8bc65 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:46.181348 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ad695d61-9aea-4e5f-b2de-e8432da8bc65 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9ddb0e44024937865411a7d2c3d956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4f0730b38a946759ea32c36f5876eb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:46.191033 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ad695d61-9aea-4e5f-b2de-e8432da8bc65 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] 10.222.0.20 "GET /compute/v2.1/servers/af90f208-7b8a-4ae4-a654-5fc632279527" status: 200 len: 1322 microversion: 2.1 time: 0.261390 Oct 27 03:43:46.192802 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2816/5333] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:43:45 2022] GET /compute/v2.1/servers/af90f208-7b8a-4ae4-a654-5fc632279527 => generated 1322 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:43:46.198587 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-56a7a6c2-d54e-4b69-8f2d-d8da2a0c3c09 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:46.199423 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-56a7a6c2-d54e-4b69-8f2d-d8da2a0c3c09 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] [instance: 7e73d534-0a40-42d2-813c-2e9dbb9239ac] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:46.208292 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-56a7a6c2-d54e-4b69-8f2d-d8da2a0c3c09 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:46.209038 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-56a7a6c2-d54e-4b69-8f2d-d8da2a0c3c09 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:46.209829 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-56a7a6c2-d54e-4b69-8f2d-d8da2a0c3c09 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:46.210958 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-56a7a6c2-d54e-4b69-8f2d-d8da2a0c3c09 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:46.211723 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-56a7a6c2-d54e-4b69-8f2d-d8da2a0c3c09 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:46.212440 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-56a7a6c2-d54e-4b69-8f2d-d8da2a0c3c09 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:46.353355 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b3d328b9-093f-45eb-8a36-b6b6538ad270 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:46.363271 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b3d328b9-093f-45eb-8a36-b6b6538ad270 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61" status: 200 len: 1521 microversion: 2.1 time: 0.486778 Oct 27 03:43:46.369467 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2518/5334] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:43:45 2022] GET /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61 => generated 1521 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:43:46.384436 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-1d6c3dff-3592-4f5c-9878-c7ea6737b8bd req-fe872c1d-17d5-43ef-a174-3a31c46755f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55152bbe-5a47-4916-ad12-5f1640f0be61", "name": "network-vif-unplugged", "status": "completed", "tag": "67a01d77-0a6b-4674-a21b-94e9feab543c"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:43:46.391172 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-56a7a6c2-d54e-4b69-8f2d-d8da2a0c3c09 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:46.405105 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-56a7a6c2-d54e-4b69-8f2d-d8da2a0c3c09 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:46.407866 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-56a7a6c2-d54e-4b69-8f2d-d8da2a0c3c09 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:46.409366 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-56a7a6c2-d54e-4b69-8f2d-d8da2a0c3c09 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] 10.222.0.20 "GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac" status: 200 len: 1604 microversion: 2.32 time: 0.215455 Oct 27 03:43:46.409790 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-1d6c3dff-3592-4f5c-9878-c7ea6737b8bd req-fe872c1d-17d5-43ef-a174-3a31c46755f9 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:46.410311 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-1d6c3dff-3592-4f5c-9878-c7ea6737b8bd req-fe872c1d-17d5-43ef-a174-3a31c46755f9 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:46.410745 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-1d6c3dff-3592-4f5c-9878-c7ea6737b8bd req-fe872c1d-17d5-43ef-a174-3a31c46755f9 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:46.411045 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2817/5335] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:43:46 2022] GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac => generated 1604 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:43:46.425398 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-1d6c3dff-3592-4f5c-9878-c7ea6737b8bd req-fe872c1d-17d5-43ef-a174-3a31c46755f9 service nova] Creating event network-vif-unplugged:67a01d77-0a6b-4674-a21b-94e9feab543c for instance 55152bbe-5a47-4916-ad12-5f1640f0be61 on n-h1-862769-1 Oct 27 03:43:46.432004 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-1d6c3dff-3592-4f5c-9878-c7ea6737b8bd req-fe872c1d-17d5-43ef-a174-3a31c46755f9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060604 Oct 27 03:43:46.432947 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2519/5336] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:43:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:43:46.816133 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-6c420d80-9c31-4427-8809-ccf4c1af71b9 req-673406e5-aacb-40b7-8baf-2e233dcddc7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af90f208-7b8a-4ae4-a654-5fc632279527", "tag": "3697490b-4346-4713-baa7-c8f934701f1a"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:43:46.831931 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-6c420d80-9c31-4427-8809-ccf4c1af71b9 req-673406e5-aacb-40b7-8baf-2e233dcddc7d service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:46.837441 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-6c420d80-9c31-4427-8809-ccf4c1af71b9 req-673406e5-aacb-40b7-8baf-2e233dcddc7d service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:46.837441 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-6c420d80-9c31-4427-8809-ccf4c1af71b9 req-673406e5-aacb-40b7-8baf-2e233dcddc7d service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:46.851784 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-6c420d80-9c31-4427-8809-ccf4c1af71b9 req-673406e5-aacb-40b7-8baf-2e233dcddc7d service nova] Creating event network-changed:3697490b-4346-4713-baa7-c8f934701f1a for instance af90f208-7b8a-4ae4-a654-5fc632279527 on n-h1-862769-1 Oct 27 03:43:46.857416 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-6c420d80-9c31-4427-8809-ccf4c1af71b9 req-673406e5-aacb-40b7-8baf-2e233dcddc7d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045270 Oct 27 03:43:46.858697 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2818/5337] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:43:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:43:47.219305 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9f88f01d-75ba-4a44-8569-35f3a41ea16d tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:47.227514 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9f88f01d-75ba-4a44-8569-35f3a41ea16d tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] [instance: af90f208-7b8a-4ae4-a654-5fc632279527] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:47.242762 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9f88f01d-75ba-4a44-8569-35f3a41ea16d tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:47.243546 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9f88f01d-75ba-4a44-8569-35f3a41ea16d tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:47.244239 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9f88f01d-75ba-4a44-8569-35f3a41ea16d tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:47.245167 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9f88f01d-75ba-4a44-8569-35f3a41ea16d tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:47.245802 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9f88f01d-75ba-4a44-8569-35f3a41ea16d tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:47.246422 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9f88f01d-75ba-4a44-8569-35f3a41ea16d tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:47.393382 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-096ab21c-3613-4607-8e9c-28743a848ad4 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:47.394802 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-096ab21c-3613-4607-8e9c-28743a848ad4 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: 55152bbe-5a47-4916-ad12-5f1640f0be61] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:47.405373 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-096ab21c-3613-4607-8e9c-28743a848ad4 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:47.406264 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-096ab21c-3613-4607-8e9c-28743a848ad4 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:47.407261 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-096ab21c-3613-4607-8e9c-28743a848ad4 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:47.408458 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-096ab21c-3613-4607-8e9c-28743a848ad4 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:47.408829 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-096ab21c-3613-4607-8e9c-28743a848ad4 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:47.409384 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-096ab21c-3613-4607-8e9c-28743a848ad4 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:47.515878 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9f88f01d-75ba-4a44-8569-35f3a41ea16d tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9ddb0e44024937865411a7d2c3d956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4f0730b38a946759ea32c36f5876eb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:47.519820 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:43:47.530337 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9f88f01d-75ba-4a44-8569-35f3a41ea16d tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] 10.222.0.20 "GET /compute/v2.1/servers/af90f208-7b8a-4ae4-a654-5fc632279527" status: 200 len: 1322 microversion: 2.1 time: 0.316985 Oct 27 03:43:47.552301 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2520/5338] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:43:47 2022] GET /compute/v2.1/servers/af90f208-7b8a-4ae4-a654-5fc632279527 => generated 1322 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:43:47.560008 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-470d652f-f8e2-4f32-b85e-cfeaf9e8514c tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:47.560945 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-470d652f-f8e2-4f32-b85e-cfeaf9e8514c tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] [instance: 7e73d534-0a40-42d2-813c-2e9dbb9239ac] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:47.567760 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-470d652f-f8e2-4f32-b85e-cfeaf9e8514c tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:47.568542 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-470d652f-f8e2-4f32-b85e-cfeaf9e8514c tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:47.570098 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-470d652f-f8e2-4f32-b85e-cfeaf9e8514c tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:47.570098 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-470d652f-f8e2-4f32-b85e-cfeaf9e8514c tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:47.570853 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-470d652f-f8e2-4f32-b85e-cfeaf9e8514c tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:47.571507 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-470d652f-f8e2-4f32-b85e-cfeaf9e8514c tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:47.655917 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-096ab21c-3613-4607-8e9c-28743a848ad4 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:47.662469 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-470d652f-f8e2-4f32-b85e-cfeaf9e8514c tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:47.673370 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-470d652f-f8e2-4f32-b85e-cfeaf9e8514c tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:47.678216 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-470d652f-f8e2-4f32-b85e-cfeaf9e8514c tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:47.680042 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=100 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:43:47.682557 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-470d652f-f8e2-4f32-b85e-cfeaf9e8514c tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] 10.222.0.20 "GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac" status: 200 len: 1604 microversion: 2.32 time: 0.126394 Oct 27 03:43:47.683751 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2521/5339] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:43:47 2022] GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac => generated 1604 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:43:47.701133 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-096ab21c-3613-4607-8e9c-28743a848ad4 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61" status: 200 len: 1521 microversion: 2.1 time: 0.312073 Oct 27 03:43:47.702478 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2819/5340] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:43:47 2022] GET /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61 => generated 1521 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:43:48.556253 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-15d27811-5896-465e-bf74-3c18ab26dd43 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:48.556878 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-15d27811-5896-465e-bf74-3c18ab26dd43 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] [instance: af90f208-7b8a-4ae4-a654-5fc632279527] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:48.559848 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:43:48.565069 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-15d27811-5896-465e-bf74-3c18ab26dd43 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:48.565784 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-15d27811-5896-465e-bf74-3c18ab26dd43 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:48.566688 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-15d27811-5896-465e-bf74-3c18ab26dd43 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:48.568396 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-15d27811-5896-465e-bf74-3c18ab26dd43 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:48.568857 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-15d27811-5896-465e-bf74-3c18ab26dd43 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:48.569287 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-15d27811-5896-465e-bf74-3c18ab26dd43 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:48.712300 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5a4008bb-5547-44ac-8a6a-c519a51030d3 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:48.713021 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5a4008bb-5547-44ac-8a6a-c519a51030d3 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] [instance: 7e73d534-0a40-42d2-813c-2e9dbb9239ac] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:48.723414 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5a4008bb-5547-44ac-8a6a-c519a51030d3 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:48.724687 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5a4008bb-5547-44ac-8a6a-c519a51030d3 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:48.724687 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5a4008bb-5547-44ac-8a6a-c519a51030d3 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:48.725339 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5a4008bb-5547-44ac-8a6a-c519a51030d3 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:48.726282 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5a4008bb-5547-44ac-8a6a-c519a51030d3 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:48.727109 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5a4008bb-5547-44ac-8a6a-c519a51030d3 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:48.747087 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-15d27811-5896-465e-bf74-3c18ab26dd43 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9ddb0e44024937865411a7d2c3d956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4f0730b38a946759ea32c36f5876eb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:48.755540 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-15d27811-5896-465e-bf74-3c18ab26dd43 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] 10.222.0.20 "GET /compute/v2.1/servers/af90f208-7b8a-4ae4-a654-5fc632279527" status: 200 len: 1322 microversion: 2.1 time: 0.203675 Oct 27 03:43:48.756247 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2522/5341] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:43:48 2022] GET /compute/v2.1/servers/af90f208-7b8a-4ae4-a654-5fc632279527 => generated 1322 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:43:48.761599 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-88df55d9-153c-481c-978f-47216a31a8eb tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:48.762909 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-88df55d9-153c-481c-978f-47216a31a8eb tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: 55152bbe-5a47-4916-ad12-5f1640f0be61] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:48.783852 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-88df55d9-153c-481c-978f-47216a31a8eb tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:48.792229 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-88df55d9-153c-481c-978f-47216a31a8eb tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:48.792761 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-88df55d9-153c-481c-978f-47216a31a8eb tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:48.793733 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-88df55d9-153c-481c-978f-47216a31a8eb tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:48.796723 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-88df55d9-153c-481c-978f-47216a31a8eb tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:48.797568 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-88df55d9-153c-481c-978f-47216a31a8eb tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:48.808205 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:43:48.852435 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5a4008bb-5547-44ac-8a6a-c519a51030d3 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:48.865071 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5a4008bb-5547-44ac-8a6a-c519a51030d3 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:48.868201 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5a4008bb-5547-44ac-8a6a-c519a51030d3 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:48.870805 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5a4008bb-5547-44ac-8a6a-c519a51030d3 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] 10.222.0.20 "GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac" status: 200 len: 1604 microversion: 2.32 time: 0.163349 Oct 27 03:43:48.871454 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2820/5342] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:43:48 2022] GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac => generated 1604 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:43:48.949228 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-88df55d9-153c-481c-978f-47216a31a8eb tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:48.957460 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-88df55d9-153c-481c-978f-47216a31a8eb tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61" status: 200 len: 1521 microversion: 2.1 time: 0.200107 Oct 27 03:43:48.958952 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2523/5343] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:43:48 2022] GET /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61 => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:43:49.781924 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-218494ce-9970-4e3d-981c-d3743b868902 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:49.782603 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-218494ce-9970-4e3d-981c-d3743b868902 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] [instance: af90f208-7b8a-4ae4-a654-5fc632279527] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:49.791026 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-218494ce-9970-4e3d-981c-d3743b868902 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:49.802432 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-218494ce-9970-4e3d-981c-d3743b868902 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:49.802432 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-218494ce-9970-4e3d-981c-d3743b868902 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:49.802432 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-218494ce-9970-4e3d-981c-d3743b868902 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:49.802432 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-218494ce-9970-4e3d-981c-d3743b868902 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:49.802432 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-218494ce-9970-4e3d-981c-d3743b868902 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:49.902565 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-bbaf4d91-b7f5-40a8-994a-fc928858362f tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:49.903195 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-bbaf4d91-b7f5-40a8-994a-fc928858362f tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] [instance: 7e73d534-0a40-42d2-813c-2e9dbb9239ac] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:49.914541 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bbaf4d91-b7f5-40a8-994a-fc928858362f tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:49.916343 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bbaf4d91-b7f5-40a8-994a-fc928858362f tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:49.917957 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bbaf4d91-b7f5-40a8-994a-fc928858362f tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:49.919945 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bbaf4d91-b7f5-40a8-994a-fc928858362f tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:49.920639 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bbaf4d91-b7f5-40a8-994a-fc928858362f tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:49.921350 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bbaf4d91-b7f5-40a8-994a-fc928858362f tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:49.957261 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=8 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:43:50.009559 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-bbaf4d91-b7f5-40a8-994a-fc928858362f tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:50.021915 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-bbaf4d91-b7f5-40a8-994a-fc928858362f tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:50.023820 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-bbaf4d91-b7f5-40a8-994a-fc928858362f tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:50.025230 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-bbaf4d91-b7f5-40a8-994a-fc928858362f tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] 10.222.0.20 "GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac" status: 200 len: 1604 microversion: 2.32 time: 0.126555 Oct 27 03:43:50.026346 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2524/5344] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:43:49 2022] GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac => generated 1604 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:43:50.031146 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-bfb59827-fbb5-46cc-9d21-5a9219ff73d8 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:50.032038 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-bfb59827-fbb5-46cc-9d21-5a9219ff73d8 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: 55152bbe-5a47-4916-ad12-5f1640f0be61] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:50.040120 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bfb59827-fbb5-46cc-9d21-5a9219ff73d8 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:50.040955 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bfb59827-fbb5-46cc-9d21-5a9219ff73d8 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:50.041781 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bfb59827-fbb5-46cc-9d21-5a9219ff73d8 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:50.043099 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bfb59827-fbb5-46cc-9d21-5a9219ff73d8 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:50.044235 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bfb59827-fbb5-46cc-9d21-5a9219ff73d8 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:50.045337 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bfb59827-fbb5-46cc-9d21-5a9219ff73d8 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:50.070973 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-218494ce-9970-4e3d-981c-d3743b868902 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9ddb0e44024937865411a7d2c3d956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4f0730b38a946759ea32c36f5876eb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:50.079600 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-218494ce-9970-4e3d-981c-d3743b868902 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] 10.222.0.20 "GET /compute/v2.1/servers/af90f208-7b8a-4ae4-a654-5fc632279527" status: 200 len: 1322 microversion: 2.1 time: 0.302686 Oct 27 03:43:50.081325 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2821/5345] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:43:49 2022] GET /compute/v2.1/servers/af90f208-7b8a-4ae4-a654-5fc632279527 => generated 1322 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:43:50.095636 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-05b0d0de-b751-4307-96d0-bf3e860095ad req-7bd0b592-f9e7-49f7-85cc-47baed2bb3ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55152bbe-5a47-4916-ad12-5f1640f0be61", "name": "network-vif-plugged", "status": "completed", "tag": "67a01d77-0a6b-4674-a21b-94e9feab543c"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:43:50.108867 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-05b0d0de-b751-4307-96d0-bf3e860095ad req-7bd0b592-f9e7-49f7-85cc-47baed2bb3ce service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:50.109686 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-05b0d0de-b751-4307-96d0-bf3e860095ad req-7bd0b592-f9e7-49f7-85cc-47baed2bb3ce service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:50.110482 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-05b0d0de-b751-4307-96d0-bf3e860095ad req-7bd0b592-f9e7-49f7-85cc-47baed2bb3ce service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:50.123637 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-05b0d0de-b751-4307-96d0-bf3e860095ad req-7bd0b592-f9e7-49f7-85cc-47baed2bb3ce service nova] Creating event network-vif-plugged:67a01d77-0a6b-4674-a21b-94e9feab543c for instance 55152bbe-5a47-4916-ad12-5f1640f0be61 on n-h1-862769-1 Oct 27 03:43:50.131652 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-05b0d0de-b751-4307-96d0-bf3e860095ad req-7bd0b592-f9e7-49f7-85cc-47baed2bb3ce service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040144 Oct 27 03:43:50.132927 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2822/5346] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:43:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:43:50.242716 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-bfb59827-fbb5-46cc-9d21-5a9219ff73d8 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:50.262771 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-bfb59827-fbb5-46cc-9d21-5a9219ff73d8 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61" status: 200 len: 1521 microversion: 2.1 time: 0.232402 Oct 27 03:43:50.263544 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2525/5347] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:43:50 2022] GET /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61 => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:43:51.056277 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0021901e-de21-4614-b640-16fc054ec1fe tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:51.057748 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0021901e-de21-4614-b640-16fc054ec1fe tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] [instance: 7e73d534-0a40-42d2-813c-2e9dbb9239ac] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:51.068051 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0021901e-de21-4614-b640-16fc054ec1fe tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:51.068682 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0021901e-de21-4614-b640-16fc054ec1fe tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:51.069311 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0021901e-de21-4614-b640-16fc054ec1fe tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:51.071564 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0021901e-de21-4614-b640-16fc054ec1fe tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:51.071564 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0021901e-de21-4614-b640-16fc054ec1fe tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:51.071564 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0021901e-de21-4614-b640-16fc054ec1fe tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:51.103251 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-cf6f2295-0765-490a-bc46-86e07b83224d tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:51.103913 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-cf6f2295-0765-490a-bc46-86e07b83224d tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] [instance: af90f208-7b8a-4ae4-a654-5fc632279527] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:51.111086 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cf6f2295-0765-490a-bc46-86e07b83224d tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:51.111605 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cf6f2295-0765-490a-bc46-86e07b83224d tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:51.112024 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cf6f2295-0765-490a-bc46-86e07b83224d tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:51.112939 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cf6f2295-0765-490a-bc46-86e07b83224d tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:51.113531 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cf6f2295-0765-490a-bc46-86e07b83224d tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:51.113998 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cf6f2295-0765-490a-bc46-86e07b83224d tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:51.155904 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0021901e-de21-4614-b640-16fc054ec1fe tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:51.167067 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0021901e-de21-4614-b640-16fc054ec1fe tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:51.169178 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0021901e-de21-4614-b640-16fc054ec1fe tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:51.171124 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0021901e-de21-4614-b640-16fc054ec1fe tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] 10.222.0.20 "GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac" status: 200 len: 1604 microversion: 2.32 time: 0.118856 Oct 27 03:43:51.171915 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2823/5348] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:43:51 2022] GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac => generated 1604 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:43:51.284950 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-cf6f2295-0765-490a-bc46-86e07b83224d tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9ddb0e44024937865411a7d2c3d956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4f0730b38a946759ea32c36f5876eb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:51.290055 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f2705d5b-2756-4846-9258-cd284e7feaed tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:51.291403 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f2705d5b-2756-4846-9258-cd284e7feaed tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: 55152bbe-5a47-4916-ad12-5f1640f0be61] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:51.297961 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f2705d5b-2756-4846-9258-cd284e7feaed tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:51.298789 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f2705d5b-2756-4846-9258-cd284e7feaed tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:51.299585 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-cf6f2295-0765-490a-bc46-86e07b83224d tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] 10.222.0.20 "GET /compute/v2.1/servers/af90f208-7b8a-4ae4-a654-5fc632279527" status: 200 len: 1322 microversion: 2.1 time: 0.200112 Oct 27 03:43:51.299908 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f2705d5b-2756-4846-9258-cd284e7feaed tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:51.310183 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2526/5349] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:43:51 2022] GET /compute/v2.1/servers/af90f208-7b8a-4ae4-a654-5fc632279527 => generated 1322 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:43:51.319277 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f2705d5b-2756-4846-9258-cd284e7feaed tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:51.320222 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f2705d5b-2756-4846-9258-cd284e7feaed tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:51.321771 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f2705d5b-2756-4846-9258-cd284e7feaed tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:51.563663 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f2705d5b-2756-4846-9258-cd284e7feaed tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:51.577000 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f2705d5b-2756-4846-9258-cd284e7feaed tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61" status: 200 len: 1521 microversion: 2.1 time: 0.290992 Oct 27 03:43:51.581985 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2824/5350] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:43:51 2022] GET /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61 => generated 1521 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:43:52.153819 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-4c99e4d1-1cce-4ab5-a150-e6d533d24c40 req-74111bc5-c8c5-4bee-9cbd-d03076b5c4b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af90f208-7b8a-4ae4-a654-5fc632279527", "name": "network-vif-plugged", "status": "completed", "tag": "3697490b-4346-4713-baa7-c8f934701f1a"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:43:52.179327 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-4c99e4d1-1cce-4ab5-a150-e6d533d24c40 req-74111bc5-c8c5-4bee-9cbd-d03076b5c4b2 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:52.179817 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-4c99e4d1-1cce-4ab5-a150-e6d533d24c40 req-74111bc5-c8c5-4bee-9cbd-d03076b5c4b2 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:52.180508 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-4c99e4d1-1cce-4ab5-a150-e6d533d24c40 req-74111bc5-c8c5-4bee-9cbd-d03076b5c4b2 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:52.199217 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ddfa5e6a-c222-440b-81db-ef54fd7bed77 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:52.199941 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ddfa5e6a-c222-440b-81db-ef54fd7bed77 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] [instance: 7e73d534-0a40-42d2-813c-2e9dbb9239ac] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:52.207163 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-4c99e4d1-1cce-4ab5-a150-e6d533d24c40 req-74111bc5-c8c5-4bee-9cbd-d03076b5c4b2 service nova] Creating event network-vif-plugged:3697490b-4346-4713-baa7-c8f934701f1a for instance af90f208-7b8a-4ae4-a654-5fc632279527 on n-h1-862769-1 Oct 27 03:43:52.212296 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ddfa5e6a-c222-440b-81db-ef54fd7bed77 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:52.216943 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ddfa5e6a-c222-440b-81db-ef54fd7bed77 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:52.216943 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ddfa5e6a-c222-440b-81db-ef54fd7bed77 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:52.216943 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ddfa5e6a-c222-440b-81db-ef54fd7bed77 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:52.217259 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-4c99e4d1-1cce-4ab5-a150-e6d533d24c40 req-74111bc5-c8c5-4bee-9cbd-d03076b5c4b2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066570 Oct 27 03:43:52.218204 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2527/5351] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:43:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:43:52.218864 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ddfa5e6a-c222-440b-81db-ef54fd7bed77 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:52.220442 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ddfa5e6a-c222-440b-81db-ef54fd7bed77 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:52.313244 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ddfa5e6a-c222-440b-81db-ef54fd7bed77 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:52.328848 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-fbcaeccd-aa74-44c5-a2ce-0703692e4bd4 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:52.329588 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-fbcaeccd-aa74-44c5-a2ce-0703692e4bd4 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] [instance: af90f208-7b8a-4ae4-a654-5fc632279527] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:52.342770 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fbcaeccd-aa74-44c5-a2ce-0703692e4bd4 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:52.343366 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fbcaeccd-aa74-44c5-a2ce-0703692e4bd4 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:52.343797 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fbcaeccd-aa74-44c5-a2ce-0703692e4bd4 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:52.345450 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ddfa5e6a-c222-440b-81db-ef54fd7bed77 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:52.348178 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fbcaeccd-aa74-44c5-a2ce-0703692e4bd4 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:52.353428 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ddfa5e6a-c222-440b-81db-ef54fd7bed77 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:52.353428 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ddfa5e6a-c222-440b-81db-ef54fd7bed77 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] 10.222.0.20 "GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac" status: 200 len: 1604 microversion: 2.32 time: 0.156661 Oct 27 03:43:52.354271 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fbcaeccd-aa74-44c5-a2ce-0703692e4bd4 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:52.354271 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fbcaeccd-aa74-44c5-a2ce-0703692e4bd4 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:52.360552 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2825/5352] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:43:52 2022] GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac => generated 1604 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:43:52.540968 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-fbcaeccd-aa74-44c5-a2ce-0703692e4bd4 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9ddb0e44024937865411a7d2c3d956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4f0730b38a946759ea32c36f5876eb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:52.549319 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-fbcaeccd-aa74-44c5-a2ce-0703692e4bd4 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] 10.222.0.20 "GET /compute/v2.1/servers/af90f208-7b8a-4ae4-a654-5fc632279527" status: 200 len: 1322 microversion: 2.1 time: 0.226854 Oct 27 03:43:52.550054 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2528/5353] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:43:52 2022] GET /compute/v2.1/servers/af90f208-7b8a-4ae4-a654-5fc632279527 => generated 1322 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:43:52.608375 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7e8116c3-e63c-4603-b904-a13db1c3aaa8 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:52.609034 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7e8116c3-e63c-4603-b904-a13db1c3aaa8 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: 55152bbe-5a47-4916-ad12-5f1640f0be61] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:52.616062 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7e8116c3-e63c-4603-b904-a13db1c3aaa8 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:52.616566 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7e8116c3-e63c-4603-b904-a13db1c3aaa8 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:52.617076 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7e8116c3-e63c-4603-b904-a13db1c3aaa8 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:52.617833 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7e8116c3-e63c-4603-b904-a13db1c3aaa8 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:52.618513 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7e8116c3-e63c-4603-b904-a13db1c3aaa8 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:52.618949 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7e8116c3-e63c-4603-b904-a13db1c3aaa8 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:52.781691 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7e8116c3-e63c-4603-b904-a13db1c3aaa8 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:52.792824 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7e8116c3-e63c-4603-b904-a13db1c3aaa8 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61" status: 200 len: 1506 microversion: 2.1 time: 0.188472 Oct 27 03:43:52.794533 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2826/5354] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:43:52 2022] GET /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61 => generated 1506 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:43:52.818226 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ed9f2065-943c-42e6-9a0d-0b821c097ebc tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:52.818878 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ed9f2065-943c-42e6-9a0d-0b821c097ebc tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: 55152bbe-5a47-4916-ad12-5f1640f0be61] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:52.840613 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ed9f2065-943c-42e6-9a0d-0b821c097ebc tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:52.840613 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ed9f2065-943c-42e6-9a0d-0b821c097ebc tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:52.840613 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ed9f2065-943c-42e6-9a0d-0b821c097ebc tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:52.840613 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ed9f2065-943c-42e6-9a0d-0b821c097ebc tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:52.840613 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ed9f2065-943c-42e6-9a0d-0b821c097ebc tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:52.840613 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ed9f2065-943c-42e6-9a0d-0b821c097ebc tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:52.997041 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ed9f2065-943c-42e6-9a0d-0b821c097ebc tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:53.008835 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ed9f2065-943c-42e6-9a0d-0b821c097ebc tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61" status: 200 len: 1506 microversion: 2.1 time: 0.194665 Oct 27 03:43:53.009835 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2529/5355] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:43:52 2022] GET /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61 => generated 1506 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:43:53.032437 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a7957734-df59-42d7-ad30-505c94712af4 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:53.032950 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a7957734-df59-42d7-ad30-505c94712af4 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: 55152bbe-5a47-4916-ad12-5f1640f0be61] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:53.039955 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a7957734-df59-42d7-ad30-505c94712af4 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:53.040454 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a7957734-df59-42d7-ad30-505c94712af4 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:53.040899 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a7957734-df59-42d7-ad30-505c94712af4 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:53.041825 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a7957734-df59-42d7-ad30-505c94712af4 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:53.042332 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a7957734-df59-42d7-ad30-505c94712af4 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:53.042766 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a7957734-df59-42d7-ad30-505c94712af4 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:53.077632 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a7957734-df59-42d7-ad30-505c94712af4 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: 55152bbe-5a47-4916-ad12-5f1640f0be61] Going to try to terminate instance {{(pid=121001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:43:53.362385 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a7957734-df59-42d7-ad30-505c94712af4 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "DELETE /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61" status: 204 len: 0 microversion: 2.1 time: 0.333468 Oct 27 03:43:53.367108 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2827/5356] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:43:53 2022] DELETE /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:43:53.389159 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5b1f5805-c8c9-4de0-986f-b09336157f85 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:53.389785 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5b1f5805-c8c9-4de0-986f-b09336157f85 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] [instance: 7e73d534-0a40-42d2-813c-2e9dbb9239ac] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:53.412615 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5b1f5805-c8c9-4de0-986f-b09336157f85 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:53.416405 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5b1f5805-c8c9-4de0-986f-b09336157f85 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:53.417022 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5b1f5805-c8c9-4de0-986f-b09336157f85 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:53.417785 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5b1f5805-c8c9-4de0-986f-b09336157f85 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:53.418286 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5b1f5805-c8c9-4de0-986f-b09336157f85 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:53.418721 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5b1f5805-c8c9-4de0-986f-b09336157f85 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:53.537607 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5b1f5805-c8c9-4de0-986f-b09336157f85 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:53.552351 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5b1f5805-c8c9-4de0-986f-b09336157f85 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:53.557038 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5b1f5805-c8c9-4de0-986f-b09336157f85 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:53.561354 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5b1f5805-c8c9-4de0-986f-b09336157f85 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] 10.222.0.20 "GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac" status: 200 len: 1604 microversion: 2.32 time: 0.174475 Oct 27 03:43:53.577528 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-37edfff7-1b65-4bd9-b2fe-12176ad41159 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:53.577528 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-37edfff7-1b65-4bd9-b2fe-12176ad41159 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] [instance: af90f208-7b8a-4ae4-a654-5fc632279527] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:53.583656 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2530/5357] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:43:53 2022] GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac => generated 1604 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:43:53.593573 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-37edfff7-1b65-4bd9-b2fe-12176ad41159 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:53.594377 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-37edfff7-1b65-4bd9-b2fe-12176ad41159 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:53.595009 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-37edfff7-1b65-4bd9-b2fe-12176ad41159 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:53.595205 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-83272405-05c7-43cc-b11c-c592052fcba7 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1271027211", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": [{"uuid": "54013623-5e33-4e24-b0d5-2e92945ee737"}]}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:43:53.595948 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-37edfff7-1b65-4bd9-b2fe-12176ad41159 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:53.596418 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-37edfff7-1b65-4bd9-b2fe-12176ad41159 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:53.596989 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-37edfff7-1b65-4bd9-b2fe-12176ad41159 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:53.675918 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-83272405-05c7-43cc-b11c-c592052fcba7 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] validate_networks() for [('54013623-5e33-4e24-b0d5-2e92945ee737', None, None, None, None, None)] {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:43:53.805043 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-37edfff7-1b65-4bd9-b2fe-12176ad41159 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9ddb0e44024937865411a7d2c3d956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4f0730b38a946759ea32c36f5876eb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:53.814593 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-37edfff7-1b65-4bd9-b2fe-12176ad41159 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] 10.222.0.20 "GET /compute/v2.1/servers/af90f208-7b8a-4ae4-a654-5fc632279527" status: 200 len: 1322 microversion: 2.1 time: 0.245325 Oct 27 03:43:53.815489 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2828/5358] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:43:53 2022] GET /compute/v2.1/servers/af90f208-7b8a-4ae4-a654-5fc632279527 => generated 1322 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:43:54.197579 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-83272405-05c7-43cc-b11c-c592052fcba7 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:43:54.198375 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-83272405-05c7-43cc-b11c-c592052fcba7 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:43:54.199098 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-83272405-05c7-43cc-b11c-c592052fcba7 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:43:54.199782 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-83272405-05c7-43cc-b11c-c592052fcba7 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:43:54.200998 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-83272405-05c7-43cc-b11c-c592052fcba7 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:43:54.213250 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-83272405-05c7-43cc-b11c-c592052fcba7 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:54.213250 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-83272405-05c7-43cc-b11c-c592052fcba7 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:54.213250 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-83272405-05c7-43cc-b11c-c592052fcba7 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:54.213250 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-83272405-05c7-43cc-b11c-c592052fcba7 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:54.213250 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-83272405-05c7-43cc-b11c-c592052fcba7 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:54.214331 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-83272405-05c7-43cc-b11c-c592052fcba7 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:54.233035 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-83272405-05c7-43cc-b11c-c592052fcba7 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Getting quotas for project eb2e83a4c2af45b49c6f23de08547160. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:43:54.243307 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-83272405-05c7-43cc-b11c-c592052fcba7 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Getting quotas for user 9454949c8d794b6093d7d4fc64d12c33 and project eb2e83a4c2af45b49c6f23de08547160. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:43:54.260232 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-83272405-05c7-43cc-b11c-c592052fcba7 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:43:54.262973 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-83272405-05c7-43cc-b11c-c592052fcba7 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: f3fcf361-2e24-402c-8290-6bc77b1125fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:43:54.427540 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-83272405-05c7-43cc-b11c-c592052fcba7 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.842165 Oct 27 03:43:54.429373 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2531/5359] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:43:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 845 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 03:43:54.441891 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6b2ff8b8-5575-4d80-bccf-b7e3d6c01d7c tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:54.442971 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-6b2ff8b8-5575-4d80-bccf-b7e3d6c01d7c tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: f3fcf361-2e24-402c-8290-6bc77b1125fa] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:54.519475 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6b2ff8b8-5575-4d80-bccf-b7e3d6c01d7c tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:54.532529 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6b2ff8b8-5575-4d80-bccf-b7e3d6c01d7c tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/f3fcf361-2e24-402c-8290-6bc77b1125fa" status: 200 len: 1218 microversion: 2.1 time: 0.094798 Oct 27 03:43:54.533592 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2829/5360] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:43:54 2022] GET /compute/v2.1/servers/f3fcf361-2e24-402c-8290-6bc77b1125fa => generated 1218 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:43:54.599691 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-53fd7605-9a9a-466e-9b96-0f2b4edd8062 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:54.600949 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-53fd7605-9a9a-466e-9b96-0f2b4edd8062 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] [instance: 7e73d534-0a40-42d2-813c-2e9dbb9239ac] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:54.625763 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-53fd7605-9a9a-466e-9b96-0f2b4edd8062 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:54.628766 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-53fd7605-9a9a-466e-9b96-0f2b4edd8062 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:54.629254 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-53fd7605-9a9a-466e-9b96-0f2b4edd8062 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:54.630658 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-53fd7605-9a9a-466e-9b96-0f2b4edd8062 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:54.631143 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-53fd7605-9a9a-466e-9b96-0f2b4edd8062 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:54.631587 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-53fd7605-9a9a-466e-9b96-0f2b4edd8062 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:54.723144 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-53fd7605-9a9a-466e-9b96-0f2b4edd8062 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:54.735957 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-53fd7605-9a9a-466e-9b96-0f2b4edd8062 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:54.737629 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-53fd7605-9a9a-466e-9b96-0f2b4edd8062 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:54.739961 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-53fd7605-9a9a-466e-9b96-0f2b4edd8062 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] 10.222.0.20 "GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac" status: 200 len: 1604 microversion: 2.32 time: 0.144977 Oct 27 03:43:54.740738 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2532/5361] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:43:54 2022] GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac => generated 1604 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:43:54.839319 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-19fd5524-d866-49d7-b384-44a59c46256b tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:54.839957 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-19fd5524-d866-49d7-b384-44a59c46256b tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] [instance: af90f208-7b8a-4ae4-a654-5fc632279527] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:54.859479 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-19fd5524-d866-49d7-b384-44a59c46256b tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:54.860001 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-19fd5524-d866-49d7-b384-44a59c46256b tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:54.860465 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-19fd5524-d866-49d7-b384-44a59c46256b tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:54.862674 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-19fd5524-d866-49d7-b384-44a59c46256b tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:54.865350 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-19fd5524-d866-49d7-b384-44a59c46256b tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:54.865828 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-19fd5524-d866-49d7-b384-44a59c46256b tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:55.085553 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-19fd5524-d866-49d7-b384-44a59c46256b tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9ddb0e44024937865411a7d2c3d956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4f0730b38a946759ea32c36f5876eb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:55.099105 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-19fd5524-d866-49d7-b384-44a59c46256b tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] 10.222.0.20 "GET /compute/v2.1/servers/af90f208-7b8a-4ae4-a654-5fc632279527" status: 200 len: 1517 microversion: 2.1 time: 0.260289 Oct 27 03:43:55.099105 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2830/5362] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:43:54 2022] GET /compute/v2.1/servers/af90f208-7b8a-4ae4-a654-5fc632279527 => generated 1517 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:43:55.120215 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9b94d84b-6ed7-4a28-8417-09f25abd063f tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:43:55.122676 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9b94d84b-6ed7-4a28-8417-09f25abd063f tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] [instance: af90f208-7b8a-4ae4-a654-5fc632279527] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:55.135832 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9b94d84b-6ed7-4a28-8417-09f25abd063f tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:55.139193 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9b94d84b-6ed7-4a28-8417-09f25abd063f tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:55.139193 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9b94d84b-6ed7-4a28-8417-09f25abd063f tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:55.139193 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9b94d84b-6ed7-4a28-8417-09f25abd063f tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:55.139193 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9b94d84b-6ed7-4a28-8417-09f25abd063f tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:55.139558 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9b94d84b-6ed7-4a28-8417-09f25abd063f tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:55.187856 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-9b94d84b-6ed7-4a28-8417-09f25abd063f tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lazy-loading 'flavor' on Instance uuid af90f208-7b8a-4ae4-a654-5fc632279527 {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:43:55.469249 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9b94d84b-6ed7-4a28-8417-09f25abd063f tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] 10.222.0.20 "POST /compute/v2.1/servers/af90f208-7b8a-4ae4-a654-5fc632279527/action" status: 200 len: 32 microversion: 2.1 time: 0.353201 Oct 27 03:43:55.470979 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2533/5363] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:43:55 2022] POST /compute/v2.1/servers/af90f208-7b8a-4ae4-a654-5fc632279527/action => generated 32 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 03:43:55.483140 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b047978d-bf03-4781-83c1-bcb3d008620f tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:55.483696 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b047978d-bf03-4781-83c1-bcb3d008620f tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] [instance: af90f208-7b8a-4ae4-a654-5fc632279527] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:55.503396 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b047978d-bf03-4781-83c1-bcb3d008620f tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:55.505944 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b047978d-bf03-4781-83c1-bcb3d008620f tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:55.506539 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b047978d-bf03-4781-83c1-bcb3d008620f tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:55.508820 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b047978d-bf03-4781-83c1-bcb3d008620f tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:55.509511 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b047978d-bf03-4781-83c1-bcb3d008620f tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:55.509956 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b047978d-bf03-4781-83c1-bcb3d008620f tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:55.559958 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-17797775-9f1d-45d2-b8ab-32db6aec0f3d tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:55.560892 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-17797775-9f1d-45d2-b8ab-32db6aec0f3d tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: f3fcf361-2e24-402c-8290-6bc77b1125fa] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:55.732435 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-17797775-9f1d-45d2-b8ab-32db6aec0f3d tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:55.742004 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-17797775-9f1d-45d2-b8ab-32db6aec0f3d tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/f3fcf361-2e24-402c-8290-6bc77b1125fa" status: 200 len: 1218 microversion: 2.1 time: 0.188329 Oct 27 03:43:55.742824 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2534/5364] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:43:55 2022] GET /compute/v2.1/servers/f3fcf361-2e24-402c-8290-6bc77b1125fa => generated 1218 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:43:55.779946 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1d29aed9-0e33-442a-9ec2-a0dcb2db2da8 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:55.780650 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1d29aed9-0e33-442a-9ec2-a0dcb2db2da8 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] [instance: 7e73d534-0a40-42d2-813c-2e9dbb9239ac] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:55.796724 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1d29aed9-0e33-442a-9ec2-a0dcb2db2da8 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:55.797455 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1d29aed9-0e33-442a-9ec2-a0dcb2db2da8 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:55.797917 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1d29aed9-0e33-442a-9ec2-a0dcb2db2da8 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:55.798693 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1d29aed9-0e33-442a-9ec2-a0dcb2db2da8 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:55.799159 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1d29aed9-0e33-442a-9ec2-a0dcb2db2da8 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:55.799902 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1d29aed9-0e33-442a-9ec2-a0dcb2db2da8 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:55.924049 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1d29aed9-0e33-442a-9ec2-a0dcb2db2da8 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:55.937198 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1d29aed9-0e33-442a-9ec2-a0dcb2db2da8 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:55.938627 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1d29aed9-0e33-442a-9ec2-a0dcb2db2da8 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:55.939846 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1d29aed9-0e33-442a-9ec2-a0dcb2db2da8 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] 10.222.0.20 "GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac" status: 200 len: 1604 microversion: 2.32 time: 0.175093 Oct 27 03:43:55.950459 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2535/5365] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:43:55 2022] GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac => generated 1604 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:43:56.144098 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b047978d-bf03-4781-83c1-bcb3d008620f tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9ddb0e44024937865411a7d2c3d956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4f0730b38a946759ea32c36f5876eb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:56.157742 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b047978d-bf03-4781-83c1-bcb3d008620f tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] 10.222.0.20 "GET /compute/v2.1/servers/af90f208-7b8a-4ae4-a654-5fc632279527" status: 200 len: 1523 microversion: 2.1 time: 0.680544 Oct 27 03:43:56.160036 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2831/5366] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:43:55 2022] GET /compute/v2.1/servers/af90f208-7b8a-4ae4-a654-5fc632279527 => generated 1523 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:43:56.440959 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-c0fca8c3-3b67-4fb5-9e36-dc56f52d3fe5 req-e62f952a-cfeb-4124-ab67-c5c773d0f0f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55152bbe-5a47-4916-ad12-5f1640f0be61", "name": "network-vif-deleted", "tag": "67a01d77-0a6b-4674-a21b-94e9feab543c"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:43:56.461390 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-c0fca8c3-3b67-4fb5-9e36-dc56f52d3fe5 req-e62f952a-cfeb-4124-ab67-c5c773d0f0f3 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:56.461893 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-c0fca8c3-3b67-4fb5-9e36-dc56f52d3fe5 req-e62f952a-cfeb-4124-ab67-c5c773d0f0f3 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:56.462359 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-c0fca8c3-3b67-4fb5-9e36-dc56f52d3fe5 req-e62f952a-cfeb-4124-ab67-c5c773d0f0f3 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:56.492224 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-c0fca8c3-3b67-4fb5-9e36-dc56f52d3fe5 req-e62f952a-cfeb-4124-ab67-c5c773d0f0f3 service nova] Creating event network-vif-deleted:67a01d77-0a6b-4674-a21b-94e9feab543c for instance 55152bbe-5a47-4916-ad12-5f1640f0be61 on n-h1-862769-1 Oct 27 03:43:56.498302 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-c0fca8c3-3b67-4fb5-9e36-dc56f52d3fe5 req-e62f952a-cfeb-4124-ab67-c5c773d0f0f3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060887 Oct 27 03:43:56.499554 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2536/5367] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:43:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:43:56.765011 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-136c3e3f-834b-4b28-a582-61e3de38be1f tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:56.765629 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-136c3e3f-834b-4b28-a582-61e3de38be1f tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: f3fcf361-2e24-402c-8290-6bc77b1125fa] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:56.785684 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-136c3e3f-834b-4b28-a582-61e3de38be1f tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:56.786799 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-136c3e3f-834b-4b28-a582-61e3de38be1f tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:56.787243 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-136c3e3f-834b-4b28-a582-61e3de38be1f tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:56.787957 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-136c3e3f-834b-4b28-a582-61e3de38be1f tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:56.789114 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-136c3e3f-834b-4b28-a582-61e3de38be1f tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:56.789114 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-136c3e3f-834b-4b28-a582-61e3de38be1f tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:56.887846 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-136c3e3f-834b-4b28-a582-61e3de38be1f tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:56.901203 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-136c3e3f-834b-4b28-a582-61e3de38be1f tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/f3fcf361-2e24-402c-8290-6bc77b1125fa" status: 200 len: 1270 microversion: 2.1 time: 0.139882 Oct 27 03:43:56.901809 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2832/5368] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:43:56 2022] GET /compute/v2.1/servers/f3fcf361-2e24-402c-8290-6bc77b1125fa => generated 1270 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:43:56.967387 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-96e84a64-f26d-4cf8-85f4-99b1406213a7 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:56.972165 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-96e84a64-f26d-4cf8-85f4-99b1406213a7 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] [instance: 7e73d534-0a40-42d2-813c-2e9dbb9239ac] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:56.975195 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-96e84a64-f26d-4cf8-85f4-99b1406213a7 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:56.975898 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-96e84a64-f26d-4cf8-85f4-99b1406213a7 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:56.976347 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-96e84a64-f26d-4cf8-85f4-99b1406213a7 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:56.977065 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-96e84a64-f26d-4cf8-85f4-99b1406213a7 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:56.977566 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-96e84a64-f26d-4cf8-85f4-99b1406213a7 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:56.978366 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-96e84a64-f26d-4cf8-85f4-99b1406213a7 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:57.016868 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-96e84a64-f26d-4cf8-85f4-99b1406213a7 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:57.017363 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-96e84a64-f26d-4cf8-85f4-99b1406213a7 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:57.018014 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-96e84a64-f26d-4cf8-85f4-99b1406213a7 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:57.018528 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-96e84a64-f26d-4cf8-85f4-99b1406213a7 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lazy-loading 'fault' on Instance uuid 7e73d534-0a40-42d2-813c-2e9dbb9239ac {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:43:57.100673 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-96e84a64-f26d-4cf8-85f4-99b1406213a7 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:57.116328 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-96e84a64-f26d-4cf8-85f4-99b1406213a7 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:57.132780 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-96e84a64-f26d-4cf8-85f4-99b1406213a7 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:57.132780 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-96e84a64-f26d-4cf8-85f4-99b1406213a7 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] 10.222.0.20 "GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac" status: 200 len: 1609 microversion: 2.32 time: 0.157129 Oct 27 03:43:57.132780 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2537/5369] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:43:56 2022] GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac => generated 1609 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:43:57.183118 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0440d1f0-3dd4-48de-b146-794d43574789 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:57.183745 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0440d1f0-3dd4-48de-b146-794d43574789 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] [instance: af90f208-7b8a-4ae4-a654-5fc632279527] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:57.189829 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0440d1f0-3dd4-48de-b146-794d43574789 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:57.190577 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0440d1f0-3dd4-48de-b146-794d43574789 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:57.191269 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0440d1f0-3dd4-48de-b146-794d43574789 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:57.192778 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0440d1f0-3dd4-48de-b146-794d43574789 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:57.193536 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0440d1f0-3dd4-48de-b146-794d43574789 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:57.194232 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0440d1f0-3dd4-48de-b146-794d43574789 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:57.528684 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0440d1f0-3dd4-48de-b146-794d43574789 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9ddb0e44024937865411a7d2c3d956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4f0730b38a946759ea32c36f5876eb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:57.542622 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0440d1f0-3dd4-48de-b146-794d43574789 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] 10.222.0.20 "GET /compute/v2.1/servers/af90f208-7b8a-4ae4-a654-5fc632279527" status: 200 len: 1523 microversion: 2.1 time: 0.363259 Oct 27 03:43:57.567668 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2833/5370] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:43:57 2022] GET /compute/v2.1/servers/af90f208-7b8a-4ae4-a654-5fc632279527 => generated 1523 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:43:57.925784 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a222de2d-1a7f-486c-83dc-9d54782e9f27 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:57.927733 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a222de2d-1a7f-486c-83dc-9d54782e9f27 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: f3fcf361-2e24-402c-8290-6bc77b1125fa] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:57.947354 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a222de2d-1a7f-486c-83dc-9d54782e9f27 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:57.949371 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a222de2d-1a7f-486c-83dc-9d54782e9f27 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:57.950063 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a222de2d-1a7f-486c-83dc-9d54782e9f27 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:57.950985 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a222de2d-1a7f-486c-83dc-9d54782e9f27 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:57.952706 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a222de2d-1a7f-486c-83dc-9d54782e9f27 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:57.954759 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a222de2d-1a7f-486c-83dc-9d54782e9f27 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:57.966474 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:43:58.093133 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a222de2d-1a7f-486c-83dc-9d54782e9f27 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:58.102151 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a222de2d-1a7f-486c-83dc-9d54782e9f27 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/f3fcf361-2e24-402c-8290-6bc77b1125fa" status: 200 len: 1276 microversion: 2.1 time: 0.180749 Oct 27 03:43:58.103321 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2538/5371] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:43:57 2022] GET /compute/v2.1/servers/f3fcf361-2e24-402c-8290-6bc77b1125fa => generated 1276 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:43:58.147324 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-862f2e65-223e-4155-ada6-05fc570cda7b tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:58.149195 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-862f2e65-223e-4155-ada6-05fc570cda7b tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] [instance: 7e73d534-0a40-42d2-813c-2e9dbb9239ac] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:58.163797 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-862f2e65-223e-4155-ada6-05fc570cda7b tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:58.164344 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-862f2e65-223e-4155-ada6-05fc570cda7b tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:58.164805 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-862f2e65-223e-4155-ada6-05fc570cda7b tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:58.165548 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-862f2e65-223e-4155-ada6-05fc570cda7b tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:58.166013 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-862f2e65-223e-4155-ada6-05fc570cda7b tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:58.166475 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-862f2e65-223e-4155-ada6-05fc570cda7b tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:58.230411 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-862f2e65-223e-4155-ada6-05fc570cda7b tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:58.231213 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-862f2e65-223e-4155-ada6-05fc570cda7b tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:58.232735 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-862f2e65-223e-4155-ada6-05fc570cda7b tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:58.233549 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-862f2e65-223e-4155-ada6-05fc570cda7b tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lazy-loading 'fault' on Instance uuid 7e73d534-0a40-42d2-813c-2e9dbb9239ac {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:43:58.326504 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-862f2e65-223e-4155-ada6-05fc570cda7b tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:58.335622 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-862f2e65-223e-4155-ada6-05fc570cda7b tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:58.339981 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-862f2e65-223e-4155-ada6-05fc570cda7b tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88497702ee824799952e4bcd583ee367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec987ba67f94da4bbdadc3835e56d7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:58.364284 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-862f2e65-223e-4155-ada6-05fc570cda7b tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] 10.222.0.20 "GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac" status: 200 len: 1371 microversion: 2.32 time: 0.202585 Oct 27 03:43:58.366323 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2834/5372] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:43:58 2022] GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac => generated 1371 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:43:58.527812 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6a3367b4-c73b-48ba-999b-49449cd192a6 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:58.530358 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6a3367b4-c73b-48ba-999b-49449cd192a6 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: ce85aa86-fbba-4eca-97e8-173da3cdc7c3] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:58.536551 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6a3367b4-c73b-48ba-999b-49449cd192a6 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:58.537048 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6a3367b4-c73b-48ba-999b-49449cd192a6 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:58.537485 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6a3367b4-c73b-48ba-999b-49449cd192a6 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:58.538267 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6a3367b4-c73b-48ba-999b-49449cd192a6 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:58.538731 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6a3367b4-c73b-48ba-999b-49449cd192a6 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:58.539220 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6a3367b4-c73b-48ba-999b-49449cd192a6 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:58.570560 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-30930927-74f7-48df-b133-c94977303193 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:58.580051 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6a3367b4-c73b-48ba-999b-49449cd192a6 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "GET /compute/v2.1/servers/ce85aa86-fbba-4eca-97e8-173da3cdc7c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056946 Oct 27 03:43:58.580863 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2539/5373] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 27 03:43:58 2022] GET /compute/v2.1/servers/ce85aa86-fbba-4eca-97e8-173da3cdc7c3/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:43:58.581345 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-30930927-74f7-48df-b133-c94977303193 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] [instance: af90f208-7b8a-4ae4-a654-5fc632279527] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:58.590082 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-30930927-74f7-48df-b133-c94977303193 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:58.590577 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-30930927-74f7-48df-b133-c94977303193 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:58.591021 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-30930927-74f7-48df-b133-c94977303193 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:58.591735 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-30930927-74f7-48df-b133-c94977303193 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:58.592192 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-30930927-74f7-48df-b133-c94977303193 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:58.592627 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-30930927-74f7-48df-b133-c94977303193 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:58.592938 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0a82098e-c5f0-4da0-bb00-579c74cd1c23 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:58.593437 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0a82098e-c5f0-4da0-bb00-579c74cd1c23 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: ce85aa86-fbba-4eca-97e8-173da3cdc7c3] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:58.600401 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0a82098e-c5f0-4da0-bb00-579c74cd1c23 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:58.601209 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0a82098e-c5f0-4da0-bb00-579c74cd1c23 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:58.601889 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0a82098e-c5f0-4da0-bb00-579c74cd1c23 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:58.603029 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0a82098e-c5f0-4da0-bb00-579c74cd1c23 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:58.603713 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0a82098e-c5f0-4da0-bb00-579c74cd1c23 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:58.604354 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0a82098e-c5f0-4da0-bb00-579c74cd1c23 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:58.644679 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0a82098e-c5f0-4da0-bb00-579c74cd1c23 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "GET /compute/v2.1/servers/ce85aa86-fbba-4eca-97e8-173da3cdc7c3/os-volume_attachments/1c7e475a-3b5e-44fc-8548-9fcc062c82ec" status: 200 len: 194 microversion: 2.1 time: 0.055761 Oct 27 03:43:58.646006 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2540/5374] 10.222.0.20 () {58 vars in 1413 bytes} [Thu Oct 27 03:43:58 2022] GET /compute/v2.1/servers/ce85aa86-fbba-4eca-97e8-173da3cdc7c3/os-volume_attachments/1c7e475a-3b5e-44fc-8548-9fcc062c82ec => generated 194 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:43:58.889917 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-30930927-74f7-48df-b133-c94977303193 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9ddb0e44024937865411a7d2c3d956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4f0730b38a946759ea32c36f5876eb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:58.902364 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-30930927-74f7-48df-b133-c94977303193 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] 10.222.0.20 "GET /compute/v2.1/servers/af90f208-7b8a-4ae4-a654-5fc632279527" status: 200 len: 1523 microversion: 2.1 time: 0.336235 Oct 27 03:43:58.903456 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2835/5375] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:43:58 2022] GET /compute/v2.1/servers/af90f208-7b8a-4ae4-a654-5fc632279527 => generated 1523 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:43:59.127690 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-fe90ea8e-ec89-4fca-b692-a9fb2df2b8f6 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:59.128329 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-fe90ea8e-ec89-4fca-b692-a9fb2df2b8f6 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: f3fcf361-2e24-402c-8290-6bc77b1125fa] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:59.136331 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fe90ea8e-ec89-4fca-b692-a9fb2df2b8f6 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:59.136834 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fe90ea8e-ec89-4fca-b692-a9fb2df2b8f6 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:59.137277 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fe90ea8e-ec89-4fca-b692-a9fb2df2b8f6 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:59.141109 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fe90ea8e-ec89-4fca-b692-a9fb2df2b8f6 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:59.141678 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fe90ea8e-ec89-4fca-b692-a9fb2df2b8f6 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:59.142169 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fe90ea8e-ec89-4fca-b692-a9fb2df2b8f6 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:59.371865 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6c3c58a2-91e2-4ee9-8e59-f7f59b8955c9 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:59.374173 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-6c3c58a2-91e2-4ee9-8e59-f7f59b8955c9 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] [instance: 7e73d534-0a40-42d2-813c-2e9dbb9239ac] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:59.382723 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6c3c58a2-91e2-4ee9-8e59-f7f59b8955c9 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:59.383295 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6c3c58a2-91e2-4ee9-8e59-f7f59b8955c9 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:59.383861 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6c3c58a2-91e2-4ee9-8e59-f7f59b8955c9 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:59.385049 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6c3c58a2-91e2-4ee9-8e59-f7f59b8955c9 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:59.385579 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6c3c58a2-91e2-4ee9-8e59-f7f59b8955c9 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:59.386212 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6c3c58a2-91e2-4ee9-8e59-f7f59b8955c9 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:59.391087 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:43:59.401958 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-6c3c58a2-91e2-4ee9-8e59-f7f59b8955c9 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] HTTP exception thrown: Instance 7e73d534-0a40-42d2-813c-2e9dbb9239ac could not be found. Oct 27 03:43:59.403735 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6c3c58a2-91e2-4ee9-8e59-f7f59b8955c9 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Request method failure captured: Oct 27 03:43:59.403735 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac HTTP/1.1 Oct 27 03:43:59.403735 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:43:59.403735 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:43:59.403735 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:43:59.403735 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:43:59.403735 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:43:59.403735 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:43:59.403735 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:43:59.403735 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:43:59.403735 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfywu0ZFc0x96D-qrEGl_LvIXEmmFxIZracic18BO0Q5vEsM9cZJDi8XBWMSHQd4J19B3kzaQZOu7xTkNuDgbrCeQfPg4dUpPH83j_OncaKtVRWOJPN1MIdY1Sdpfouqbxy2wKFJZ_OjpkqUHCf9s2wFoFXUtRnz1GSPXHrTaz4B_OI Oct 27 03:43:59.403735 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:43:59.403735 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:43:59.403735 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:43:59.403735 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:43:59.403735 n-d-862769-1 devstack@n-api.service[121001]: X-Openstack-Nova-Api-Version: 2.32 Oct 27 03:43:59.403735 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:43:59.403735 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:43:59.403735 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 1ec987ba67f94da4bbdadc3835e56d7d Oct 27 03:43:59.403735 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-TaggedBootDevicesTest-1407049990 Oct 27 03:43:59.403735 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:43:59.403735 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:43:59.403735 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1ec987ba67f94da4bbdadc3835e56d7d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1ec987ba67f94da4bbdadc3835e56d7d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1ec987ba67f94da4bbdadc3835e56d7d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1ec987ba67f94da4bbdadc3835e56d7d"}]}] Oct 27 03:43:59.403735 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-TaggedBootDevicesTest-1407049990 Oct 27 03:43:59.403735 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 1ec987ba67f94da4bbdadc3835e56d7d Oct 27 03:43:59.403735 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1407049990 Oct 27 03:43:59.403735 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-TaggedBootDevicesTest-1407049990-project Oct 27 03:43:59.403735 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:43:59.403735 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:43:59.403735 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 88497702ee824799952e4bcd583ee367 Oct 27 03:43:59.403735 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-TaggedBootDevicesTest-1407049990-project Oct 27 03:43:59.403735 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:43:59.403735 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 7e73d534-0a40-42d2-813c-2e9dbb9239ac could not be found. Oct 27 03:43:59.403735 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '7e73d534-0a40-42d2-813c-2e9dbb9239ac'} Oct 27 03:43:59.403735 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:43:59.403735 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:43:59.403735 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:43:59.403735 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:43:59.403735 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:43:59.403735 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:43:59.403735 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:43:59.403735 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:43:59.403735 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:43:59.403735 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:43:59.403735 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e73d534-0a40-42d2-813c-2e9dbb9239ac could not be found. Oct 27 03:43:59.403735 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:43:59.403735 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:43:59.403735 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:43:59.403735 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:43:59.403735 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:43:59.403735 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:43:59.403735 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:43:59.403735 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:43:59.403735 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:43:59.403735 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:43:59.403735 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:43:59.403735 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:43:59.403735 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:43:59.403735 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:43:59.403735 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:43:59.403735 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:43:59.403735 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e73d534-0a40-42d2-813c-2e9dbb9239ac could not be found. Oct 27 03:43:59.403735 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:43:59.403735 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:43:59.416007 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:43:59.416007 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:43:59.416007 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:43:59.416007 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:43:59.416007 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:43:59.416007 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:43:59.416007 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e73d534-0a40-42d2-813c-2e9dbb9239ac could not be found. Oct 27 03:43:59.416007 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:43:59.416007 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6c3c58a2-91e2-4ee9-8e59-f7f59b8955c9 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Returning 404 to user: Instance 7e73d534-0a40-42d2-813c-2e9dbb9239ac could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:43:59.416007 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6c3c58a2-91e2-4ee9-8e59-f7f59b8955c9 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] 10.222.0.20 "GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac" status: 404 len: 111 microversion: 2.32 time: 0.037672 Oct 27 03:43:59.416007 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2836/5376] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:43:59 2022] GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 27 03:43:59.416007 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c4e948b6-2580-45f0-a7c1-b1de38b22443 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Calling method '.version_select at 0x7f7dd97975e0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:59.515946 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-fe90ea8e-ec89-4fca-b692-a9fb2df2b8f6 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:43:59.531650 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-fe90ea8e-ec89-4fca-b692-a9fb2df2b8f6 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/f3fcf361-2e24-402c-8290-6bc77b1125fa" status: 200 len: 1318 microversion: 2.1 time: 0.408083 Oct 27 03:43:59.533071 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2541/5377] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:43:59 2022] GET /compute/v2.1/servers/f3fcf361-2e24-402c-8290-6bc77b1125fa => generated 1318 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:43:59.677814 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c4e948b6-2580-45f0-a7c1-b1de38b22443 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1412355363" status: 204 len: 0 microversion: 2.32 time: 0.266842 Oct 27 03:43:59.685235 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2837/5378] 10.222.0.20 () {60 vars in 1262 bytes} [Thu Oct 27 03:43:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1412355363 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 27 03:43:59.929633 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-197dc969-de2d-4f09-9d37-ecd5c53f3538 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:43:59.930671 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-197dc969-de2d-4f09-9d37-ecd5c53f3538 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] [instance: af90f208-7b8a-4ae4-a654-5fc632279527] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:43:59.939026 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-197dc969-de2d-4f09-9d37-ecd5c53f3538 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:59.941212 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-197dc969-de2d-4f09-9d37-ecd5c53f3538 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:59.941212 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-197dc969-de2d-4f09-9d37-ecd5c53f3538 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:43:59.941212 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-197dc969-de2d-4f09-9d37-ecd5c53f3538 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:43:59.941212 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-197dc969-de2d-4f09-9d37-ecd5c53f3538 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:43:59.941664 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-197dc969-de2d-4f09-9d37-ecd5c53f3538 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:00.236105 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-197dc969-de2d-4f09-9d37-ecd5c53f3538 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9ddb0e44024937865411a7d2c3d956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4f0730b38a946759ea32c36f5876eb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:00.253576 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-197dc969-de2d-4f09-9d37-ecd5c53f3538 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] 10.222.0.20 "GET /compute/v2.1/servers/af90f208-7b8a-4ae4-a654-5fc632279527" status: 200 len: 1523 microversion: 2.1 time: 0.328409 Oct 27 03:44:00.254881 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2542/5379] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:43:59 2022] GET /compute/v2.1/servers/af90f208-7b8a-4ae4-a654-5fc632279527 => generated 1523 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:44:00.557549 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-93c8c392-dfde-4a05-ae78-7ca82c9a4783 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:00.558899 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-93c8c392-dfde-4a05-ae78-7ca82c9a4783 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: f3fcf361-2e24-402c-8290-6bc77b1125fa] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:00.568957 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-93c8c392-dfde-4a05-ae78-7ca82c9a4783 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:00.571544 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-93c8c392-dfde-4a05-ae78-7ca82c9a4783 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:00.572860 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-93c8c392-dfde-4a05-ae78-7ca82c9a4783 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:00.573962 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-93c8c392-dfde-4a05-ae78-7ca82c9a4783 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:00.574642 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-93c8c392-dfde-4a05-ae78-7ca82c9a4783 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:00.575246 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-93c8c392-dfde-4a05-ae78-7ca82c9a4783 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:01.037150 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-93c8c392-dfde-4a05-ae78-7ca82c9a4783 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:01.053113 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-93c8c392-dfde-4a05-ae78-7ca82c9a4783 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/f3fcf361-2e24-402c-8290-6bc77b1125fa" status: 200 len: 1318 microversion: 2.1 time: 0.498453 Oct 27 03:44:01.055331 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2838/5380] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:44:00 2022] GET /compute/v2.1/servers/f3fcf361-2e24-402c-8290-6bc77b1125fa => generated 1318 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:44:01.199858 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-21ad63e9-e5de-42a1-aaff-a0c0fabc47c0 req-27a1b727-3e2a-470f-988d-c6f90ab4a588 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3fcf361-2e24-402c-8290-6bc77b1125fa", "tag": "cb4aafd8-0533-425c-84b7-290165d4cdea"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:44:01.214555 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-21ad63e9-e5de-42a1-aaff-a0c0fabc47c0 req-27a1b727-3e2a-470f-988d-c6f90ab4a588 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:01.215372 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-21ad63e9-e5de-42a1-aaff-a0c0fabc47c0 req-27a1b727-3e2a-470f-988d-c6f90ab4a588 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:01.215628 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-21ad63e9-e5de-42a1-aaff-a0c0fabc47c0 req-27a1b727-3e2a-470f-988d-c6f90ab4a588 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:01.230592 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-21ad63e9-e5de-42a1-aaff-a0c0fabc47c0 req-27a1b727-3e2a-470f-988d-c6f90ab4a588 service nova] Creating event network-changed:cb4aafd8-0533-425c-84b7-290165d4cdea for instance f3fcf361-2e24-402c-8290-6bc77b1125fa on n-h2-862769-1 Oct 27 03:44:01.236944 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-21ad63e9-e5de-42a1-aaff-a0c0fabc47c0 req-27a1b727-3e2a-470f-988d-c6f90ab4a588 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041570 Oct 27 03:44:01.244261 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2543/5381] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:44:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:44:01.277438 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-22cf3f1a-a06e-4aab-9387-c72b3c7878b9 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:01.278083 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-22cf3f1a-a06e-4aab-9387-c72b3c7878b9 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] [instance: af90f208-7b8a-4ae4-a654-5fc632279527] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:01.284386 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-22cf3f1a-a06e-4aab-9387-c72b3c7878b9 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:01.284802 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-22cf3f1a-a06e-4aab-9387-c72b3c7878b9 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:01.285242 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-22cf3f1a-a06e-4aab-9387-c72b3c7878b9 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:01.287267 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-22cf3f1a-a06e-4aab-9387-c72b3c7878b9 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:01.287730 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-22cf3f1a-a06e-4aab-9387-c72b3c7878b9 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:01.288164 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-22cf3f1a-a06e-4aab-9387-c72b3c7878b9 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:01.504103 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7d2fce8d-1236-480f-9884-cf0973c49f90 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dbf01790-0c6f-4201-a18f-24bd16da3db3"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:44:01.515023 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7d2fce8d-1236-480f-9884-cf0973c49f90 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: ce85aa86-fbba-4eca-97e8-173da3cdc7c3] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:01.530745 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7d2fce8d-1236-480f-9884-cf0973c49f90 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:01.533999 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7d2fce8d-1236-480f-9884-cf0973c49f90 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:01.534755 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7d2fce8d-1236-480f-9884-cf0973c49f90 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:01.535692 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7d2fce8d-1236-480f-9884-cf0973c49f90 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:01.536322 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7d2fce8d-1236-480f-9884-cf0973c49f90 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:01.539050 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7d2fce8d-1236-480f-9884-cf0973c49f90 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:01.648503 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-22cf3f1a-a06e-4aab-9387-c72b3c7878b9 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9ddb0e44024937865411a7d2c3d956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4f0730b38a946759ea32c36f5876eb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:01.657512 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-22cf3f1a-a06e-4aab-9387-c72b3c7878b9 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] 10.222.0.20 "GET /compute/v2.1/servers/af90f208-7b8a-4ae4-a654-5fc632279527" status: 200 len: 1523 microversion: 2.1 time: 0.384088 Oct 27 03:44:01.660424 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2839/5382] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:44:01 2022] GET /compute/v2.1/servers/af90f208-7b8a-4ae4-a654-5fc632279527 => generated 1523 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:44:02.077813 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7e39f297-1654-4ac9-b054-8b73fe8e8dc9 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:02.081088 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7e39f297-1654-4ac9-b054-8b73fe8e8dc9 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: f3fcf361-2e24-402c-8290-6bc77b1125fa] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:02.093288 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7e39f297-1654-4ac9-b054-8b73fe8e8dc9 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:02.093288 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7e39f297-1654-4ac9-b054-8b73fe8e8dc9 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:02.093475 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7e39f297-1654-4ac9-b054-8b73fe8e8dc9 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:02.094064 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7e39f297-1654-4ac9-b054-8b73fe8e8dc9 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:02.094515 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7e39f297-1654-4ac9-b054-8b73fe8e8dc9 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:02.094942 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7e39f297-1654-4ac9-b054-8b73fe8e8dc9 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:02.321840 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7d2fce8d-1236-480f-9884-cf0973c49f90 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "POST /compute/v2.1/servers/ce85aa86-fbba-4eca-97e8-173da3cdc7c3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.829456 Oct 27 03:44:02.321840 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2544/5383] 10.222.0.20 () {60 vars in 1323 bytes} [Thu Oct 27 03:44:01 2022] POST /compute/v2.1/servers/ce85aa86-fbba-4eca-97e8-173da3cdc7c3/os-volume_attachments => generated 194 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:44:02.334617 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7e39f297-1654-4ac9-b054-8b73fe8e8dc9 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:02.343296 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7e39f297-1654-4ac9-b054-8b73fe8e8dc9 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/f3fcf361-2e24-402c-8290-6bc77b1125fa" status: 200 len: 1318 microversion: 2.1 time: 0.269294 Oct 27 03:44:02.354329 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2840/5384] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:44:02 2022] GET /compute/v2.1/servers/f3fcf361-2e24-402c-8290-6bc77b1125fa => generated 1318 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:44:02.685047 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-40267b0a-2299-405f-b9d9-59a943c08b34 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:02.685777 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-40267b0a-2299-405f-b9d9-59a943c08b34 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] [instance: af90f208-7b8a-4ae4-a654-5fc632279527] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:02.693032 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-40267b0a-2299-405f-b9d9-59a943c08b34 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:02.693869 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-40267b0a-2299-405f-b9d9-59a943c08b34 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:02.694346 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-40267b0a-2299-405f-b9d9-59a943c08b34 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:02.695097 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-40267b0a-2299-405f-b9d9-59a943c08b34 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:02.695529 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-40267b0a-2299-405f-b9d9-59a943c08b34 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:02.695961 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-40267b0a-2299-405f-b9d9-59a943c08b34 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:03.230589 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-40267b0a-2299-405f-b9d9-59a943c08b34 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9ddb0e44024937865411a7d2c3d956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4f0730b38a946759ea32c36f5876eb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:03.242885 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-40267b0a-2299-405f-b9d9-59a943c08b34 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] 10.222.0.20 "GET /compute/v2.1/servers/af90f208-7b8a-4ae4-a654-5fc632279527" status: 200 len: 1523 microversion: 2.1 time: 0.562119 Oct 27 03:44:03.251195 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2545/5385] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:44:02 2022] GET /compute/v2.1/servers/af90f208-7b8a-4ae4-a654-5fc632279527 => generated 1523 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:44:03.378361 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1be50858-ccd5-4c2b-b868-9c8177e7b0f6 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:03.380971 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1be50858-ccd5-4c2b-b868-9c8177e7b0f6 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: f3fcf361-2e24-402c-8290-6bc77b1125fa] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:03.390310 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1be50858-ccd5-4c2b-b868-9c8177e7b0f6 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:03.392172 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1be50858-ccd5-4c2b-b868-9c8177e7b0f6 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:03.392817 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1be50858-ccd5-4c2b-b868-9c8177e7b0f6 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:03.393845 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1be50858-ccd5-4c2b-b868-9c8177e7b0f6 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:03.394638 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1be50858-ccd5-4c2b-b868-9c8177e7b0f6 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:03.395262 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1be50858-ccd5-4c2b-b868-9c8177e7b0f6 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:03.559103 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1be50858-ccd5-4c2b-b868-9c8177e7b0f6 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:03.568136 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1be50858-ccd5-4c2b-b868-9c8177e7b0f6 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/f3fcf361-2e24-402c-8290-6bc77b1125fa" status: 200 len: 1318 microversion: 2.1 time: 0.198064 Oct 27 03:44:03.569068 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2841/5386] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:44:03 2022] GET /compute/v2.1/servers/f3fcf361-2e24-402c-8290-6bc77b1125fa => generated 1318 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:44:04.277803 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c8f8257c-579a-4d1e-b5a8-642c6516e0a0 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:04.279955 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c8f8257c-579a-4d1e-b5a8-642c6516e0a0 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] [instance: af90f208-7b8a-4ae4-a654-5fc632279527] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:04.293713 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:44:04.297700 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c8f8257c-579a-4d1e-b5a8-642c6516e0a0 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:04.297700 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c8f8257c-579a-4d1e-b5a8-642c6516e0a0 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:04.297700 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c8f8257c-579a-4d1e-b5a8-642c6516e0a0 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:04.297700 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c8f8257c-579a-4d1e-b5a8-642c6516e0a0 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:04.308576 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c8f8257c-579a-4d1e-b5a8-642c6516e0a0 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:04.310203 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c8f8257c-579a-4d1e-b5a8-642c6516e0a0 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:04.598735 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-fbf04f4b-38c3-4cc4-ba40-9f20b9d5068f tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:04.600227 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-fbf04f4b-38c3-4cc4-ba40-9f20b9d5068f tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: f3fcf361-2e24-402c-8290-6bc77b1125fa] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:04.609785 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:44:04.612449 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fbf04f4b-38c3-4cc4-ba40-9f20b9d5068f tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:04.613382 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fbf04f4b-38c3-4cc4-ba40-9f20b9d5068f tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:04.614359 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fbf04f4b-38c3-4cc4-ba40-9f20b9d5068f tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:04.615310 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fbf04f4b-38c3-4cc4-ba40-9f20b9d5068f tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:04.616200 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fbf04f4b-38c3-4cc4-ba40-9f20b9d5068f tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:04.616964 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fbf04f4b-38c3-4cc4-ba40-9f20b9d5068f tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:04.792791 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c8f8257c-579a-4d1e-b5a8-642c6516e0a0 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9ddb0e44024937865411a7d2c3d956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4f0730b38a946759ea32c36f5876eb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:04.806227 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c8f8257c-579a-4d1e-b5a8-642c6516e0a0 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] 10.222.0.20 "GET /compute/v2.1/servers/af90f208-7b8a-4ae4-a654-5fc632279527" status: 200 len: 1523 microversion: 2.1 time: 0.534910 Oct 27 03:44:04.806913 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2546/5387] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:44:04 2022] GET /compute/v2.1/servers/af90f208-7b8a-4ae4-a654-5fc632279527 => generated 1523 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:44:04.922068 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-fbf04f4b-38c3-4cc4-ba40-9f20b9d5068f tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:04.932268 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-fbf04f4b-38c3-4cc4-ba40-9f20b9d5068f tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/f3fcf361-2e24-402c-8290-6bc77b1125fa" status: 200 len: 1318 microversion: 2.1 time: 0.343917 Oct 27 03:44:04.938361 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2842/5388] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:44:04 2022] GET /compute/v2.1/servers/f3fcf361-2e24-402c-8290-6bc77b1125fa => generated 1318 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:44:05.840425 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ab390be9-2cd9-4d1f-a29f-eeab6895d495 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:05.843019 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ab390be9-2cd9-4d1f-a29f-eeab6895d495 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] [instance: af90f208-7b8a-4ae4-a654-5fc632279527] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:05.854455 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=8 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:44:05.869195 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ab390be9-2cd9-4d1f-a29f-eeab6895d495 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:05.871289 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ab390be9-2cd9-4d1f-a29f-eeab6895d495 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:05.874582 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ab390be9-2cd9-4d1f-a29f-eeab6895d495 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:05.879266 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ab390be9-2cd9-4d1f-a29f-eeab6895d495 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:05.879924 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ab390be9-2cd9-4d1f-a29f-eeab6895d495 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:05.884754 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ab390be9-2cd9-4d1f-a29f-eeab6895d495 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:05.965972 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a810b8f6-a4c3-402b-b07c-aceef8a2e203 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:05.969710 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a810b8f6-a4c3-402b-b07c-aceef8a2e203 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: f3fcf361-2e24-402c-8290-6bc77b1125fa] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:05.982286 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a810b8f6-a4c3-402b-b07c-aceef8a2e203 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:05.983035 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a810b8f6-a4c3-402b-b07c-aceef8a2e203 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:05.983652 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a810b8f6-a4c3-402b-b07c-aceef8a2e203 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:05.985132 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a810b8f6-a4c3-402b-b07c-aceef8a2e203 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:05.985925 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a810b8f6-a4c3-402b-b07c-aceef8a2e203 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:05.986940 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a810b8f6-a4c3-402b-b07c-aceef8a2e203 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:06.631064 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a810b8f6-a4c3-402b-b07c-aceef8a2e203 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:06.639696 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a810b8f6-a4c3-402b-b07c-aceef8a2e203 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/f3fcf361-2e24-402c-8290-6bc77b1125fa" status: 200 len: 1318 microversion: 2.1 time: 0.678705 Oct 27 03:44:06.640687 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2843/5389] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:44:05 2022] GET /compute/v2.1/servers/f3fcf361-2e24-402c-8290-6bc77b1125fa => generated 1318 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:44:06.682970 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ab390be9-2cd9-4d1f-a29f-eeab6895d495 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9ddb0e44024937865411a7d2c3d956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4f0730b38a946759ea32c36f5876eb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:06.698850 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ab390be9-2cd9-4d1f-a29f-eeab6895d495 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] 10.222.0.20 "GET /compute/v2.1/servers/af90f208-7b8a-4ae4-a654-5fc632279527" status: 200 len: 1523 microversion: 2.1 time: 0.868652 Oct 27 03:44:06.699516 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2547/5390] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:44:05 2022] GET /compute/v2.1/servers/af90f208-7b8a-4ae4-a654-5fc632279527 => generated 1523 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:44:07.121512 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b21dcaa7-b7ed-4c29-9151-f26d0cd8378b tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:07.122702 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b21dcaa7-b7ed-4c29-9151-f26d0cd8378b tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] [instance: 7e73d534-0a40-42d2-813c-2e9dbb9239ac] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:07.135796 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b21dcaa7-b7ed-4c29-9151-f26d0cd8378b tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:07.136566 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b21dcaa7-b7ed-4c29-9151-f26d0cd8378b tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:07.137203 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b21dcaa7-b7ed-4c29-9151-f26d0cd8378b tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:07.138140 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b21dcaa7-b7ed-4c29-9151-f26d0cd8378b tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:07.138779 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b21dcaa7-b7ed-4c29-9151-f26d0cd8378b tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:07.139206 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b21dcaa7-b7ed-4c29-9151-f26d0cd8378b tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:07.172861 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-b21dcaa7-b7ed-4c29-9151-f26d0cd8378b tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] HTTP exception thrown: Instance 7e73d534-0a40-42d2-813c-2e9dbb9239ac could not be found. Oct 27 03:44:07.174685 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b21dcaa7-b7ed-4c29-9151-f26d0cd8378b tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Request method failure captured: Oct 27 03:44:07.174685 n-d-862769-1 devstack@n-api.service[121001]: request: DELETE /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac HTTP/1.1 Oct 27 03:44:07.174685 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:44:07.174685 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:44:07.174685 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:44:07.174685 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:44:07.174685 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:44:07.174685 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:44:07.174685 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:44:07.174685 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:44:07.174685 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWfywu0ZFc0x96D-qrEGl_LvIXEmmFxIZracic18BO0Q5vEsM9cZJDi8XBWMSHQd4J19B3kzaQZOu7xTkNuDgbrCeQfPg4dUpPH83j_OncaKtVRWOJPN1MIdY1Sdpfouqbxy2wKFJZ_OjpkqUHCf9s2wFoFXUtRnz1GSPXHrTaz4B_OI Oct 27 03:44:07.174685 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:44:07.174685 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:44:07.174685 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:44:07.174685 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:44:07.174685 n-d-862769-1 devstack@n-api.service[121001]: X-Openstack-Nova-Api-Version: 2.32 Oct 27 03:44:07.174685 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:44:07.174685 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:44:07.174685 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 1ec987ba67f94da4bbdadc3835e56d7d Oct 27 03:44:07.174685 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-TaggedBootDevicesTest-1407049990 Oct 27 03:44:07.174685 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:44:07.174685 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:44:07.174685 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1ec987ba67f94da4bbdadc3835e56d7d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1ec987ba67f94da4bbdadc3835e56d7d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1ec987ba67f94da4bbdadc3835e56d7d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1ec987ba67f94da4bbdadc3835e56d7d"}]}] Oct 27 03:44:07.174685 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-TaggedBootDevicesTest-1407049990 Oct 27 03:44:07.174685 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 1ec987ba67f94da4bbdadc3835e56d7d Oct 27 03:44:07.174685 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1407049990 Oct 27 03:44:07.174685 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-TaggedBootDevicesTest-1407049990-project Oct 27 03:44:07.174685 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:44:07.174685 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:44:07.174685 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 88497702ee824799952e4bcd583ee367 Oct 27 03:44:07.174685 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-TaggedBootDevicesTest-1407049990-project Oct 27 03:44:07.174685 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:44:07.174685 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 7e73d534-0a40-42d2-813c-2e9dbb9239ac could not be found. Oct 27 03:44:07.174685 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '7e73d534-0a40-42d2-813c-2e9dbb9239ac'} Oct 27 03:44:07.174685 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:44:07.174685 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:44:07.174685 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:44:07.174685 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:44:07.174685 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:44:07.174685 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:44:07.174685 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:44:07.174685 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:44:07.174685 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:44:07.174685 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:44:07.174685 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e73d534-0a40-42d2-813c-2e9dbb9239ac could not be found. Oct 27 03:44:07.174685 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:44:07.174685 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:44:07.174685 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:44:07.174685 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:44:07.174685 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:44:07.174685 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:44:07.174685 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:44:07.174685 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:44:07.174685 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:44:07.174685 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:44:07.174685 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 03:44:07.174685 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 03:44:07.174685 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 03:44:07.174685 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 03:44:07.174685 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:44:07.174685 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:44:07.174685 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:44:07.174685 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:44:07.180180 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e73d534-0a40-42d2-813c-2e9dbb9239ac could not be found. Oct 27 03:44:07.180180 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:44:07.180180 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:44:07.180180 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:44:07.180180 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:44:07.180180 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:44:07.180180 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:44:07.180180 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:44:07.180180 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:44:07.180180 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e73d534-0a40-42d2-813c-2e9dbb9239ac could not be found. Oct 27 03:44:07.180180 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:44:07.182192 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b21dcaa7-b7ed-4c29-9151-f26d0cd8378b tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Returning 404 to user: Instance 7e73d534-0a40-42d2-813c-2e9dbb9239ac could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:44:07.183225 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b21dcaa7-b7ed-4c29-9151-f26d0cd8378b tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac" status: 404 len: 111 microversion: 2.32 time: 0.065667 Oct 27 03:44:07.194326 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2844/5391] 10.222.0.20 () {60 vars in 1280 bytes} [Thu Oct 27 03:44:07 2022] DELETE /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 03:44:07.208962 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-84af6728-9f2c-4b11-a730-9c2320fae1d9 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:07.210241 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-84af6728-9f2c-4b11-a730-9c2320fae1d9 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] [instance: 7e73d534-0a40-42d2-813c-2e9dbb9239ac] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:07.218008 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-84af6728-9f2c-4b11-a730-9c2320fae1d9 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:07.218746 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-84af6728-9f2c-4b11-a730-9c2320fae1d9 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:07.219374 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-84af6728-9f2c-4b11-a730-9c2320fae1d9 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:07.220363 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-84af6728-9f2c-4b11-a730-9c2320fae1d9 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:07.221240 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-84af6728-9f2c-4b11-a730-9c2320fae1d9 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:07.221826 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-84af6728-9f2c-4b11-a730-9c2320fae1d9 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:07.239554 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-84af6728-9f2c-4b11-a730-9c2320fae1d9 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] HTTP exception thrown: Instance 7e73d534-0a40-42d2-813c-2e9dbb9239ac could not be found. Oct 27 03:44:07.241797 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-84af6728-9f2c-4b11-a730-9c2320fae1d9 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Request method failure captured: Oct 27 03:44:07.241797 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac HTTP/1.1 Oct 27 03:44:07.241797 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:44:07.241797 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:44:07.241797 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:44:07.241797 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:44:07.241797 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:44:07.241797 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:44:07.241797 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:44:07.241797 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:44:07.241797 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWfywu0ZFc0x96D-qrEGl_LvIXEmmFxIZracic18BO0Q5vEsM9cZJDi8XBWMSHQd4J19B3kzaQZOu7xTkNuDgbrCeQfPg4dUpPH83j_OncaKtVRWOJPN1MIdY1Sdpfouqbxy2wKFJZ_OjpkqUHCf9s2wFoFXUtRnz1GSPXHrTaz4B_OI Oct 27 03:44:07.241797 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:44:07.241797 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:44:07.241797 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:44:07.241797 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:44:07.241797 n-d-862769-1 devstack@n-api.service[121000]: X-Openstack-Nova-Api-Version: 2.32 Oct 27 03:44:07.241797 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:44:07.241797 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:44:07.241797 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 1ec987ba67f94da4bbdadc3835e56d7d Oct 27 03:44:07.241797 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-TaggedBootDevicesTest-1407049990 Oct 27 03:44:07.241797 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:44:07.241797 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:44:07.241797 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1ec987ba67f94da4bbdadc3835e56d7d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1ec987ba67f94da4bbdadc3835e56d7d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1ec987ba67f94da4bbdadc3835e56d7d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1ec987ba67f94da4bbdadc3835e56d7d"}]}] Oct 27 03:44:07.241797 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-TaggedBootDevicesTest-1407049990 Oct 27 03:44:07.241797 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 1ec987ba67f94da4bbdadc3835e56d7d Oct 27 03:44:07.241797 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1407049990 Oct 27 03:44:07.241797 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-TaggedBootDevicesTest-1407049990-project Oct 27 03:44:07.241797 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:44:07.241797 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:44:07.241797 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 88497702ee824799952e4bcd583ee367 Oct 27 03:44:07.241797 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-TaggedBootDevicesTest-1407049990-project Oct 27 03:44:07.241797 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:44:07.241797 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 7e73d534-0a40-42d2-813c-2e9dbb9239ac could not be found. Oct 27 03:44:07.241797 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '7e73d534-0a40-42d2-813c-2e9dbb9239ac'} Oct 27 03:44:07.241797 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:44:07.241797 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:44:07.241797 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:44:07.241797 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:44:07.241797 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:44:07.241797 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:44:07.241797 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:44:07.241797 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:44:07.241797 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:44:07.241797 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:44:07.241797 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e73d534-0a40-42d2-813c-2e9dbb9239ac could not be found. Oct 27 03:44:07.241797 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:44:07.241797 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:44:07.241797 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:44:07.241797 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:44:07.241797 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:44:07.241797 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:44:07.241797 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:44:07.241797 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:44:07.241797 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:44:07.241797 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:44:07.241797 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:44:07.241797 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:44:07.241797 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:44:07.241797 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:44:07.241797 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:44:07.241797 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:44:07.241797 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e73d534-0a40-42d2-813c-2e9dbb9239ac could not be found. Oct 27 03:44:07.241797 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:44:07.241797 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:44:07.252071 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:44:07.252071 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:44:07.252071 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:44:07.252071 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:44:07.252071 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:44:07.252071 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:44:07.252071 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e73d534-0a40-42d2-813c-2e9dbb9239ac could not be found. Oct 27 03:44:07.252071 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:44:07.252071 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-84af6728-9f2c-4b11-a730-9c2320fae1d9 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] Returning 404 to user: Instance 7e73d534-0a40-42d2-813c-2e9dbb9239ac could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:44:07.252071 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-84af6728-9f2c-4b11-a730-9c2320fae1d9 tempest-TaggedBootDevicesTest-1407049990 tempest-TaggedBootDevicesTest-1407049990-project] 10.222.0.20 "GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac" status: 404 len: 111 microversion: 2.32 time: 0.052208 Oct 27 03:44:07.253512 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2548/5392] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:44:07 2022] GET /compute/v2.1/servers/7e73d534-0a40-42d2-813c-2e9dbb9239ac => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 03:44:07.562676 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-35f46397-a6fe-4a81-a189-18b8ce4e1b94 req-b33581df-4db9-43db-a899-ebfc1bb74999 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3fcf361-2e24-402c-8290-6bc77b1125fa", "name": "network-vif-plugged", "status": "completed", "tag": "cb4aafd8-0533-425c-84b7-290165d4cdea"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:44:07.603751 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-35f46397-a6fe-4a81-a189-18b8ce4e1b94 req-b33581df-4db9-43db-a899-ebfc1bb74999 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:07.604811 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-35f46397-a6fe-4a81-a189-18b8ce4e1b94 req-b33581df-4db9-43db-a899-ebfc1bb74999 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:07.604811 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-35f46397-a6fe-4a81-a189-18b8ce4e1b94 req-b33581df-4db9-43db-a899-ebfc1bb74999 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:07.628945 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-35f46397-a6fe-4a81-a189-18b8ce4e1b94 req-b33581df-4db9-43db-a899-ebfc1bb74999 service nova] Creating event network-vif-plugged:cb4aafd8-0533-425c-84b7-290165d4cdea for instance f3fcf361-2e24-402c-8290-6bc77b1125fa on n-h2-862769-1 Oct 27 03:44:07.634384 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-35f46397-a6fe-4a81-a189-18b8ce4e1b94 req-b33581df-4db9-43db-a899-ebfc1bb74999 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077794 Oct 27 03:44:07.635408 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2845/5393] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:44:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:44:07.663511 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1449ec00-3183-4ab1-8309-3b7ef8ae7d82 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:07.664138 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1449ec00-3183-4ab1-8309-3b7ef8ae7d82 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: f3fcf361-2e24-402c-8290-6bc77b1125fa] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:07.685048 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1449ec00-3183-4ab1-8309-3b7ef8ae7d82 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:07.685611 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1449ec00-3183-4ab1-8309-3b7ef8ae7d82 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:07.690117 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1449ec00-3183-4ab1-8309-3b7ef8ae7d82 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:07.690117 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1449ec00-3183-4ab1-8309-3b7ef8ae7d82 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:07.690117 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1449ec00-3183-4ab1-8309-3b7ef8ae7d82 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:07.690117 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1449ec00-3183-4ab1-8309-3b7ef8ae7d82 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:07.723901 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1e3efff1-5721-499f-808f-799cc57b460d tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:07.724541 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1e3efff1-5721-499f-808f-799cc57b460d tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] [instance: af90f208-7b8a-4ae4-a654-5fc632279527] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:07.734422 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1e3efff1-5721-499f-808f-799cc57b460d tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:07.734920 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1e3efff1-5721-499f-808f-799cc57b460d tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:07.735367 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1e3efff1-5721-499f-808f-799cc57b460d tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:07.736095 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1e3efff1-5721-499f-808f-799cc57b460d tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:07.736557 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1e3efff1-5721-499f-808f-799cc57b460d tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:07.746214 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1e3efff1-5721-499f-808f-799cc57b460d tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:08.104543 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1e3efff1-5721-499f-808f-799cc57b460d tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9ddb0e44024937865411a7d2c3d956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4f0730b38a946759ea32c36f5876eb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:08.113265 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1e3efff1-5721-499f-808f-799cc57b460d tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] 10.222.0.20 "GET /compute/v2.1/servers/af90f208-7b8a-4ae4-a654-5fc632279527" status: 200 len: 1523 microversion: 2.1 time: 0.394793 Oct 27 03:44:08.123102 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2846/5394] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:44:07 2022] GET /compute/v2.1/servers/af90f208-7b8a-4ae4-a654-5fc632279527 => generated 1523 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:44:08.265385 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1449ec00-3183-4ab1-8309-3b7ef8ae7d82 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:08.279341 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1449ec00-3183-4ab1-8309-3b7ef8ae7d82 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/f3fcf361-2e24-402c-8290-6bc77b1125fa" status: 200 len: 1318 microversion: 2.1 time: 0.620180 Oct 27 03:44:08.282870 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1b58f453-2762-40c1-8d6f-becdd4fc1865 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:08.283273 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2549/5395] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:44:07 2022] GET /compute/v2.1/servers/f3fcf361-2e24-402c-8290-6bc77b1125fa => generated 1318 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:44:08.283473 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1b58f453-2762-40c1-8d6f-becdd4fc1865 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 1db2318e-9ac7-4994-8daa-14ae22537d5d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:08.297525 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1b58f453-2762-40c1-8d6f-becdd4fc1865 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:08.298070 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1b58f453-2762-40c1-8d6f-becdd4fc1865 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:08.298521 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1b58f453-2762-40c1-8d6f-becdd4fc1865 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:08.299254 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1b58f453-2762-40c1-8d6f-becdd4fc1865 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:08.299724 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1b58f453-2762-40c1-8d6f-becdd4fc1865 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:08.300160 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1b58f453-2762-40c1-8d6f-becdd4fc1865 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:08.369138 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1b58f453-2762-40c1-8d6f-becdd4fc1865 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d/ips" status: 200 len: 153 microversion: 2.20 time: 0.091454 Oct 27 03:44:08.376574 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2847/5396] 10.222.0.20 () {60 vars in 1289 bytes} [Thu Oct 27 03:44:08 2022] GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d/ips => generated 153 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 03:44:08.794650 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-749ec00b-1f32-4403-931f-c3ea3c41ddb5 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c7f5d06b-4c82-4323-989e-6306c263cb6f"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:44:08.797231 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-749ec00b-1f32-4403-931f-c3ea3c41ddb5 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: dbdbec9a-f4bf-4740-ab67-3c8891e341a1] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:08.811327 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-749ec00b-1f32-4403-931f-c3ea3c41ddb5 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:08.812098 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-749ec00b-1f32-4403-931f-c3ea3c41ddb5 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:08.813448 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-749ec00b-1f32-4403-931f-c3ea3c41ddb5 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:08.814667 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-749ec00b-1f32-4403-931f-c3ea3c41ddb5 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:08.815465 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-749ec00b-1f32-4403-931f-c3ea3c41ddb5 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:08.816255 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-749ec00b-1f32-4403-931f-c3ea3c41ddb5 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:09.139392 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-fdba6efc-5736-4845-a0ca-724243456cdf tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:09.140570 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-fdba6efc-5736-4845-a0ca-724243456cdf tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] [instance: af90f208-7b8a-4ae4-a654-5fc632279527] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:09.163386 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fdba6efc-5736-4845-a0ca-724243456cdf tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:09.166268 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fdba6efc-5736-4845-a0ca-724243456cdf tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:09.168632 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fdba6efc-5736-4845-a0ca-724243456cdf tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:09.171236 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fdba6efc-5736-4845-a0ca-724243456cdf tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:09.173438 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fdba6efc-5736-4845-a0ca-724243456cdf tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:09.179141 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fdba6efc-5736-4845-a0ca-724243456cdf tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:09.618126 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-fdba6efc-5736-4845-a0ca-724243456cdf tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9ddb0e44024937865411a7d2c3d956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4f0730b38a946759ea32c36f5876eb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:09.642585 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-fdba6efc-5736-4845-a0ca-724243456cdf tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] 10.222.0.20 "GET /compute/v2.1/servers/af90f208-7b8a-4ae4-a654-5fc632279527" status: 200 len: 1523 microversion: 2.1 time: 0.507515 Oct 27 03:44:09.648744 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2848/5397] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:44:09 2022] GET /compute/v2.1/servers/af90f208-7b8a-4ae4-a654-5fc632279527 => generated 1523 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:44:09.661778 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2ead5e0b-9e54-47bb-ab55-aba22541607c tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:09.662453 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2ead5e0b-9e54-47bb-ab55-aba22541607c tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: f3fcf361-2e24-402c-8290-6bc77b1125fa] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:09.678132 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:44:09.681097 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2ead5e0b-9e54-47bb-ab55-aba22541607c tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:09.694385 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2ead5e0b-9e54-47bb-ab55-aba22541607c tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:09.695085 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2ead5e0b-9e54-47bb-ab55-aba22541607c tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:09.699448 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2ead5e0b-9e54-47bb-ab55-aba22541607c tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:09.699934 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2ead5e0b-9e54-47bb-ab55-aba22541607c tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:09.704259 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2ead5e0b-9e54-47bb-ab55-aba22541607c tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:10.110966 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-749ec00b-1f32-4403-931f-c3ea3c41ddb5 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "POST /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.322333 Oct 27 03:44:10.112246 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2550/5398] 10.222.0.20 () {60 vars in 1323 bytes} [Thu Oct 27 03:44:08 2022] POST /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1/os-volume_attachments => generated 194 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:44:10.291263 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2ead5e0b-9e54-47bb-ab55-aba22541607c tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:10.300767 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2ead5e0b-9e54-47bb-ab55-aba22541607c tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/f3fcf361-2e24-402c-8290-6bc77b1125fa" status: 200 len: 1318 microversion: 2.1 time: 0.650649 Oct 27 03:44:10.301560 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2849/5399] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:44:09 2022] GET /compute/v2.1/servers/f3fcf361-2e24-402c-8290-6bc77b1125fa => generated 1318 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:44:10.665975 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-69cbff55-8752-475f-8b82-a48945a94b20 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:10.666721 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-69cbff55-8752-475f-8b82-a48945a94b20 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] [instance: af90f208-7b8a-4ae4-a654-5fc632279527] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:10.683827 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-69cbff55-8752-475f-8b82-a48945a94b20 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:10.690290 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-69cbff55-8752-475f-8b82-a48945a94b20 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:10.691032 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-69cbff55-8752-475f-8b82-a48945a94b20 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:10.692017 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-69cbff55-8752-475f-8b82-a48945a94b20 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:10.692640 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-69cbff55-8752-475f-8b82-a48945a94b20 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:10.693429 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-69cbff55-8752-475f-8b82-a48945a94b20 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:11.096994 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-69cbff55-8752-475f-8b82-a48945a94b20 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9ddb0e44024937865411a7d2c3d956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4f0730b38a946759ea32c36f5876eb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:11.105473 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-69cbff55-8752-475f-8b82-a48945a94b20 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] 10.222.0.20 "GET /compute/v2.1/servers/af90f208-7b8a-4ae4-a654-5fc632279527" status: 200 len: 1523 microversion: 2.1 time: 0.443811 Oct 27 03:44:11.114451 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2551/5400] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:44:10 2022] GET /compute/v2.1/servers/af90f208-7b8a-4ae4-a654-5fc632279527 => generated 1523 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:44:11.329100 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-bcf5968e-1d41-4fa5-9752-8b9275ced33b tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:11.330404 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-bcf5968e-1d41-4fa5-9752-8b9275ced33b tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: f3fcf361-2e24-402c-8290-6bc77b1125fa] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:11.342315 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bcf5968e-1d41-4fa5-9752-8b9275ced33b tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:11.370168 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bcf5968e-1d41-4fa5-9752-8b9275ced33b tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:11.370947 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bcf5968e-1d41-4fa5-9752-8b9275ced33b tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:11.373001 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bcf5968e-1d41-4fa5-9752-8b9275ced33b tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:11.377599 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bcf5968e-1d41-4fa5-9752-8b9275ced33b tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:11.378953 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bcf5968e-1d41-4fa5-9752-8b9275ced33b tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:11.889008 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-bcf5968e-1d41-4fa5-9752-8b9275ced33b tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:11.903772 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-bcf5968e-1d41-4fa5-9752-8b9275ced33b tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/f3fcf361-2e24-402c-8290-6bc77b1125fa" status: 200 len: 1508 microversion: 2.1 time: 0.577630 Oct 27 03:44:11.918652 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2850/5401] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:44:11 2022] GET /compute/v2.1/servers/f3fcf361-2e24-402c-8290-6bc77b1125fa => generated 1508 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:44:11.930527 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-417af8bf-86cf-4c6a-8734-78f1aba1adfe tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:11.931254 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-417af8bf-86cf-4c6a-8734-78f1aba1adfe tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: f3fcf361-2e24-402c-8290-6bc77b1125fa] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:11.946981 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-417af8bf-86cf-4c6a-8734-78f1aba1adfe tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:11.947505 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-417af8bf-86cf-4c6a-8734-78f1aba1adfe tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:11.947964 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-417af8bf-86cf-4c6a-8734-78f1aba1adfe tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:11.948710 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-417af8bf-86cf-4c6a-8734-78f1aba1adfe tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:11.950961 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-417af8bf-86cf-4c6a-8734-78f1aba1adfe tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:11.951409 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-417af8bf-86cf-4c6a-8734-78f1aba1adfe tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:12.077623 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7741e589-3907-4a95-b6ee-ad03eeab7a46 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:44:12.082830 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7741e589-3907-4a95-b6ee-ad03eeab7a46 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 1db2318e-9ac7-4994-8daa-14ae22537d5d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:12.098120 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7741e589-3907-4a95-b6ee-ad03eeab7a46 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:12.099918 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7741e589-3907-4a95-b6ee-ad03eeab7a46 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:12.100915 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7741e589-3907-4a95-b6ee-ad03eeab7a46 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:12.113543 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7741e589-3907-4a95-b6ee-ad03eeab7a46 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:12.114451 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7741e589-3907-4a95-b6ee-ad03eeab7a46 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:12.116750 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7741e589-3907-4a95-b6ee-ad03eeab7a46 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:12.156831 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-7741e589-3907-4a95-b6ee-ad03eeab7a46 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lazy-loading 'flavor' on Instance uuid 1db2318e-9ac7-4994-8daa-14ae22537d5d {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:44:12.464669 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-417af8bf-86cf-4c6a-8734-78f1aba1adfe tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:12.476561 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-417af8bf-86cf-4c6a-8734-78f1aba1adfe tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/f3fcf361-2e24-402c-8290-6bc77b1125fa" status: 200 len: 1508 microversion: 2.1 time: 0.548977 Oct 27 03:44:12.477731 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2552/5402] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:44:11 2022] GET /compute/v2.1/servers/f3fcf361-2e24-402c-8290-6bc77b1125fa => generated 1508 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:44:12.489896 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-06abd113-8426-4f0f-953d-19a1934f3692 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:12.492018 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-06abd113-8426-4f0f-953d-19a1934f3692 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] [instance: af90f208-7b8a-4ae4-a654-5fc632279527] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:12.506124 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-06abd113-8426-4f0f-953d-19a1934f3692 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:12.507458 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-06abd113-8426-4f0f-953d-19a1934f3692 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:12.508355 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-06abd113-8426-4f0f-953d-19a1934f3692 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:12.510950 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-06abd113-8426-4f0f-953d-19a1934f3692 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:12.511454 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-06abd113-8426-4f0f-953d-19a1934f3692 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:12.511882 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-06abd113-8426-4f0f-953d-19a1934f3692 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:12.584527 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:44:12.826026 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-06abd113-8426-4f0f-953d-19a1934f3692 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9ddb0e44024937865411a7d2c3d956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4f0730b38a946759ea32c36f5876eb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:12.834676 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-06abd113-8426-4f0f-953d-19a1934f3692 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] 10.222.0.20 "GET /compute/v2.1/servers/af90f208-7b8a-4ae4-a654-5fc632279527" status: 200 len: 1523 microversion: 2.1 time: 0.355590 Oct 27 03:44:12.836230 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2553/5403] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:44:12 2022] GET /compute/v2.1/servers/af90f208-7b8a-4ae4-a654-5fc632279527 => generated 1523 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:44:12.840529 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3e462078-d672-461c-a84c-471ca146ad79 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:44:12.843074 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-3e462078-d672-461c-a84c-471ca146ad79 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: f3fcf361-2e24-402c-8290-6bc77b1125fa] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:12.850319 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3e462078-d672-461c-a84c-471ca146ad79 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:12.851079 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3e462078-d672-461c-a84c-471ca146ad79 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:12.857364 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3e462078-d672-461c-a84c-471ca146ad79 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:12.857364 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3e462078-d672-461c-a84c-471ca146ad79 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:12.857364 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3e462078-d672-461c-a84c-471ca146ad79 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:12.857364 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3e462078-d672-461c-a84c-471ca146ad79 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:12.932172 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7741e589-3907-4a95-b6ee-ad03eeab7a46 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "POST /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d/action" status: 202 len: 0 microversion: 2.20 time: 0.866690 Oct 27 03:44:12.937306 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2851/5404] 10.222.0.20 () {62 vars in 1319 bytes} [Thu Oct 27 03:44:12 2022] POST /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d/action => generated 0 bytes in 874 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 27 03:44:12.954212 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c05a46fd-d58e-472e-9aa1-09ef55f3380d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:12.955191 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c05a46fd-d58e-472e-9aa1-09ef55f3380d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 1db2318e-9ac7-4994-8daa-14ae22537d5d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:12.963300 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c05a46fd-d58e-472e-9aa1-09ef55f3380d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:12.964234 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c05a46fd-d58e-472e-9aa1-09ef55f3380d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:12.964869 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c05a46fd-d58e-472e-9aa1-09ef55f3380d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:12.967285 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c05a46fd-d58e-472e-9aa1-09ef55f3380d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:12.967285 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c05a46fd-d58e-472e-9aa1-09ef55f3380d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:12.973965 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c05a46fd-d58e-472e-9aa1-09ef55f3380d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:13.029603 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3e462078-d672-461c-a84c-471ca146ad79 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "PUT /compute/v2.1/servers/f3fcf361-2e24-402c-8290-6bc77b1125fa" status: 200 len: 1080 microversion: 2.1 time: 0.193045 Oct 27 03:44:13.030385 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2554/5405] 10.222.0.20 () {60 vars in 1256 bytes} [Thu Oct 27 03:44:12 2022] PUT /compute/v2.1/servers/f3fcf361-2e24-402c-8290-6bc77b1125fa => generated 1080 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:44:13.056805 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a5beb110-dc89-4002-9316-6d85f344dd59 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:13.057823 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a5beb110-dc89-4002-9316-6d85f344dd59 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: f3fcf361-2e24-402c-8290-6bc77b1125fa] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:13.064952 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a5beb110-dc89-4002-9316-6d85f344dd59 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:13.065916 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a5beb110-dc89-4002-9316-6d85f344dd59 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:13.066668 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a5beb110-dc89-4002-9316-6d85f344dd59 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:13.067874 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a5beb110-dc89-4002-9316-6d85f344dd59 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:13.068553 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a5beb110-dc89-4002-9316-6d85f344dd59 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:13.069319 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a5beb110-dc89-4002-9316-6d85f344dd59 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:13.257769 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c05a46fd-d58e-472e-9aa1-09ef55f3380d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:13.268627 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c05a46fd-d58e-472e-9aa1-09ef55f3380d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:13.276369 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c05a46fd-d58e-472e-9aa1-09ef55f3380d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:13.277883 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c05a46fd-d58e-472e-9aa1-09ef55f3380d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d" status: 200 len: 1724 microversion: 2.20 time: 0.338562 Oct 27 03:44:13.282486 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2852/5406] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:44:12 2022] GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d => generated 1724 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:44:13.442922 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a5beb110-dc89-4002-9316-6d85f344dd59 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:13.460480 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a5beb110-dc89-4002-9316-6d85f344dd59 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/f3fcf361-2e24-402c-8290-6bc77b1125fa" status: 200 len: 1506 microversion: 2.1 time: 0.407737 Oct 27 03:44:13.461566 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2555/5407] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:44:13 2022] GET /compute/v2.1/servers/f3fcf361-2e24-402c-8290-6bc77b1125fa => generated 1506 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:44:13.492118 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-db92bec1-d108-45c5-ad3f-f027993d209d tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:13.492738 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-db92bec1-d108-45c5-ad3f-f027993d209d tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: f3fcf361-2e24-402c-8290-6bc77b1125fa] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:13.503986 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-db92bec1-d108-45c5-ad3f-f027993d209d tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:13.504992 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-db92bec1-d108-45c5-ad3f-f027993d209d tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:13.505432 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-db92bec1-d108-45c5-ad3f-f027993d209d tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:13.510594 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-db92bec1-d108-45c5-ad3f-f027993d209d tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:13.511152 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-db92bec1-d108-45c5-ad3f-f027993d209d tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:13.511594 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-db92bec1-d108-45c5-ad3f-f027993d209d tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:13.870837 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-891f5569-d827-497d-a31a-41ec1da9db32 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:13.872088 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-891f5569-d827-497d-a31a-41ec1da9db32 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] [instance: af90f208-7b8a-4ae4-a654-5fc632279527] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:13.879653 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:44:13.890129 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-891f5569-d827-497d-a31a-41ec1da9db32 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:13.894290 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-891f5569-d827-497d-a31a-41ec1da9db32 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:13.898308 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-891f5569-d827-497d-a31a-41ec1da9db32 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:13.899257 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-891f5569-d827-497d-a31a-41ec1da9db32 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:13.899811 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-891f5569-d827-497d-a31a-41ec1da9db32 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:13.900427 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-891f5569-d827-497d-a31a-41ec1da9db32 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:14.152134 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-db92bec1-d108-45c5-ad3f-f027993d209d tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:14.165839 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-db92bec1-d108-45c5-ad3f-f027993d209d tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/f3fcf361-2e24-402c-8290-6bc77b1125fa" status: 200 len: 1506 microversion: 2.1 time: 0.676339 Oct 27 03:44:14.168589 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2853/5408] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:44:13 2022] GET /compute/v2.1/servers/f3fcf361-2e24-402c-8290-6bc77b1125fa => generated 1506 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:44:14.196749 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-05f4d6ca-8638-4339-b745-bbbc6a980634 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:44:14.200053 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-05f4d6ca-8638-4339-b745-bbbc6a980634 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: f3fcf361-2e24-402c-8290-6bc77b1125fa] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:14.227059 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-05f4d6ca-8638-4339-b745-bbbc6a980634 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:14.229089 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-05f4d6ca-8638-4339-b745-bbbc6a980634 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:14.230278 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-05f4d6ca-8638-4339-b745-bbbc6a980634 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:14.231639 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-05f4d6ca-8638-4339-b745-bbbc6a980634 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:14.235088 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-05f4d6ca-8638-4339-b745-bbbc6a980634 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:14.237097 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-05f4d6ca-8638-4339-b745-bbbc6a980634 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:14.252914 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:44:14.444623 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-891f5569-d827-497d-a31a-41ec1da9db32 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9ddb0e44024937865411a7d2c3d956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4f0730b38a946759ea32c36f5876eb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:14.460521 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-891f5569-d827-497d-a31a-41ec1da9db32 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] 10.222.0.20 "GET /compute/v2.1/servers/af90f208-7b8a-4ae4-a654-5fc632279527" status: 200 len: 1523 microversion: 2.1 time: 0.604118 Oct 27 03:44:14.464164 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2556/5409] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:44:13 2022] GET /compute/v2.1/servers/af90f208-7b8a-4ae4-a654-5fc632279527 => generated 1523 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:44:14.482124 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-13ff769c-8138-44af-86be-54bc38c5ef44 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:14.484849 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-13ff769c-8138-44af-86be-54bc38c5ef44 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 1db2318e-9ac7-4994-8daa-14ae22537d5d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:14.499027 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-13ff769c-8138-44af-86be-54bc38c5ef44 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:14.510944 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-13ff769c-8138-44af-86be-54bc38c5ef44 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:14.511734 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-13ff769c-8138-44af-86be-54bc38c5ef44 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:14.512703 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-13ff769c-8138-44af-86be-54bc38c5ef44 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:14.513401 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-13ff769c-8138-44af-86be-54bc38c5ef44 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:14.531522 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-13ff769c-8138-44af-86be-54bc38c5ef44 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:14.750449 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-05f4d6ca-8638-4339-b745-bbbc6a980634 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Flavor limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:44:14.751314 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-05f4d6ca-8638-4339-b745-bbbc6a980634 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Image limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:44:14.751964 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-05f4d6ca-8638-4339-b745-bbbc6a980634 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Flavor pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:44:14.753140 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-05f4d6ca-8638-4339-b745-bbbc6a980634 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Image pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:44:14.753735 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-05f4d6ca-8638-4339-b745-bbbc6a980634 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:44:14.974839 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-05f4d6ca-8638-4339-b745-bbbc6a980634 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: f3fcf361-2e24-402c-8290-6bc77b1125fa] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:14.985715 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-05f4d6ca-8638-4339-b745-bbbc6a980634 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:14.987808 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-05f4d6ca-8638-4339-b745-bbbc6a980634 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:14.987808 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-05f4d6ca-8638-4339-b745-bbbc6a980634 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:14.992863 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-05f4d6ca-8638-4339-b745-bbbc6a980634 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:14.993505 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-05f4d6ca-8638-4339-b745-bbbc6a980634 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:14.995043 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-05f4d6ca-8638-4339-b745-bbbc6a980634 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:15.083027 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-05f4d6ca-8638-4339-b745-bbbc6a980634 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "POST /compute/v2.1/servers/f3fcf361-2e24-402c-8290-6bc77b1125fa/action" status: 202 len: 1112 microversion: 2.1 time: 0.891050 Oct 27 03:44:15.092117 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2854/5410] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:44:14 2022] POST /compute/v2.1/servers/f3fcf361-2e24-402c-8290-6bc77b1125fa/action => generated 1112 bytes in 901 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 27 03:44:15.116312 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1ad71431-4f78-4188-a702-7423a6b76459 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:15.117051 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1ad71431-4f78-4188-a702-7423a6b76459 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: f3fcf361-2e24-402c-8290-6bc77b1125fa] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:15.123559 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1ad71431-4f78-4188-a702-7423a6b76459 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:15.124093 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1ad71431-4f78-4188-a702-7423a6b76459 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:15.124496 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1ad71431-4f78-4188-a702-7423a6b76459 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:15.125398 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1ad71431-4f78-4188-a702-7423a6b76459 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:15.125872 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1ad71431-4f78-4188-a702-7423a6b76459 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:15.126343 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1ad71431-4f78-4188-a702-7423a6b76459 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:15.183547 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-13ff769c-8138-44af-86be-54bc38c5ef44 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:15.201297 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-13ff769c-8138-44af-86be-54bc38c5ef44 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:15.203660 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-13ff769c-8138-44af-86be-54bc38c5ef44 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:15.205207 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-13ff769c-8138-44af-86be-54bc38c5ef44 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d" status: 200 len: 1724 microversion: 2.20 time: 0.739743 Oct 27 03:44:15.236303 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2557/5411] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:44:14 2022] GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d => generated 1724 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:44:15.490385 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4f17404d-5c68-42dd-bcd0-ee7794e3b642 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:15.490918 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4f17404d-5c68-42dd-bcd0-ee7794e3b642 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] [instance: af90f208-7b8a-4ae4-a654-5fc632279527] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:15.505409 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4f17404d-5c68-42dd-bcd0-ee7794e3b642 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:15.509238 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4f17404d-5c68-42dd-bcd0-ee7794e3b642 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:15.509732 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4f17404d-5c68-42dd-bcd0-ee7794e3b642 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:15.510517 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4f17404d-5c68-42dd-bcd0-ee7794e3b642 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:15.510987 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4f17404d-5c68-42dd-bcd0-ee7794e3b642 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:15.517638 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4f17404d-5c68-42dd-bcd0-ee7794e3b642 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:15.629856 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1ad71431-4f78-4188-a702-7423a6b76459 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:15.639378 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1ad71431-4f78-4188-a702-7423a6b76459 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/f3fcf361-2e24-402c-8290-6bc77b1125fa" status: 200 len: 1517 microversion: 2.1 time: 0.527948 Oct 27 03:44:15.643460 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2855/5412] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:44:15 2022] GET /compute/v2.1/servers/f3fcf361-2e24-402c-8290-6bc77b1125fa => generated 1517 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:44:16.080745 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4f17404d-5c68-42dd-bcd0-ee7794e3b642 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9ddb0e44024937865411a7d2c3d956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4f0730b38a946759ea32c36f5876eb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:16.094733 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4f17404d-5c68-42dd-bcd0-ee7794e3b642 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] 10.222.0.20 "GET /compute/v2.1/servers/af90f208-7b8a-4ae4-a654-5fc632279527" status: 200 len: 1523 microversion: 2.1 time: 0.610012 Oct 27 03:44:16.096055 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2558/5413] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:44:15 2022] GET /compute/v2.1/servers/af90f208-7b8a-4ae4-a654-5fc632279527 => generated 1523 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:44:16.243552 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b8aa9dfa-9392-4693-af32-7105795c8b7c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:16.244647 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b8aa9dfa-9392-4693-af32-7105795c8b7c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 1db2318e-9ac7-4994-8daa-14ae22537d5d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:16.259345 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b8aa9dfa-9392-4693-af32-7105795c8b7c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:16.264876 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b8aa9dfa-9392-4693-af32-7105795c8b7c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:16.264876 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b8aa9dfa-9392-4693-af32-7105795c8b7c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:16.264876 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b8aa9dfa-9392-4693-af32-7105795c8b7c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:16.264876 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b8aa9dfa-9392-4693-af32-7105795c8b7c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:16.264876 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b8aa9dfa-9392-4693-af32-7105795c8b7c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:16.569843 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b8aa9dfa-9392-4693-af32-7105795c8b7c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:16.578097 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9aea4b22-26e6-4abc-8658-6cdd8ac28db1 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:16.580248 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9aea4b22-26e6-4abc-8658-6cdd8ac28db1 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: ce85aa86-fbba-4eca-97e8-173da3cdc7c3] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:16.586223 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b8aa9dfa-9392-4693-af32-7105795c8b7c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:16.587229 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9aea4b22-26e6-4abc-8658-6cdd8ac28db1 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:16.587913 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9aea4b22-26e6-4abc-8658-6cdd8ac28db1 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:16.588543 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9aea4b22-26e6-4abc-8658-6cdd8ac28db1 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:16.589185 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b8aa9dfa-9392-4693-af32-7105795c8b7c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:16.589686 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9aea4b22-26e6-4abc-8658-6cdd8ac28db1 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:16.590349 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9aea4b22-26e6-4abc-8658-6cdd8ac28db1 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:16.592127 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9aea4b22-26e6-4abc-8658-6cdd8ac28db1 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:16.592249 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b8aa9dfa-9392-4693-af32-7105795c8b7c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d" status: 200 len: 1724 microversion: 2.20 time: 0.360384 Oct 27 03:44:16.598516 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2856/5414] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:44:16 2022] GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d => generated 1724 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:44:16.640768 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9aea4b22-26e6-4abc-8658-6cdd8ac28db1 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "GET /compute/v2.1/servers/ce85aa86-fbba-4eca-97e8-173da3cdc7c3/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.066958 Oct 27 03:44:16.648291 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2559/5415] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 27 03:44:16 2022] GET /compute/v2.1/servers/ce85aa86-fbba-4eca-97e8-173da3cdc7c3/os-volume_attachments => generated 371 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:44:16.666018 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-120b31be-192b-453f-9e84-160938b957c1 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:16.666816 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-120b31be-192b-453f-9e84-160938b957c1 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: f3fcf361-2e24-402c-8290-6bc77b1125fa] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:16.678513 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-120b31be-192b-453f-9e84-160938b957c1 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:16.679082 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-120b31be-192b-453f-9e84-160938b957c1 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:16.679727 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-120b31be-192b-453f-9e84-160938b957c1 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:16.680903 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-120b31be-192b-453f-9e84-160938b957c1 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:16.682358 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-120b31be-192b-453f-9e84-160938b957c1 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:16.682961 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-120b31be-192b-453f-9e84-160938b957c1 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:16.791474 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a087ea71-dcf6-4e45-a56f-779825c53254 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:16.791474 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a087ea71-dcf6-4e45-a56f-779825c53254 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: ce85aa86-fbba-4eca-97e8-173da3cdc7c3] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:16.801792 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a087ea71-dcf6-4e45-a56f-779825c53254 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:16.802577 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a087ea71-dcf6-4e45-a56f-779825c53254 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:16.803460 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a087ea71-dcf6-4e45-a56f-779825c53254 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:16.804845 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a087ea71-dcf6-4e45-a56f-779825c53254 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:16.805927 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a087ea71-dcf6-4e45-a56f-779825c53254 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:16.806704 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a087ea71-dcf6-4e45-a56f-779825c53254 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:16.867031 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a087ea71-dcf6-4e45-a56f-779825c53254 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "GET /compute/v2.1/servers/ce85aa86-fbba-4eca-97e8-173da3cdc7c3/os-volume_attachments/1c7e475a-3b5e-44fc-8548-9fcc062c82ec" status: 200 len: 194 microversion: 2.1 time: 0.082601 Oct 27 03:44:16.868508 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2560/5416] 10.222.0.20 () {58 vars in 1413 bytes} [Thu Oct 27 03:44:16 2022] GET /compute/v2.1/servers/ce85aa86-fbba-4eca-97e8-173da3cdc7c3/os-volume_attachments/1c7e475a-3b5e-44fc-8548-9fcc062c82ec => generated 194 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:44:16.879145 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e30ffa2b-6628-4275-816d-1da0455a3f3c tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:16.879829 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e30ffa2b-6628-4275-816d-1da0455a3f3c tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: ce85aa86-fbba-4eca-97e8-173da3cdc7c3] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:16.888104 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e30ffa2b-6628-4275-816d-1da0455a3f3c tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:16.888761 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e30ffa2b-6628-4275-816d-1da0455a3f3c tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:16.889734 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e30ffa2b-6628-4275-816d-1da0455a3f3c tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:16.892180 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e30ffa2b-6628-4275-816d-1da0455a3f3c tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:16.893201 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e30ffa2b-6628-4275-816d-1da0455a3f3c tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:16.893847 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e30ffa2b-6628-4275-816d-1da0455a3f3c tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:16.968284 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-120b31be-192b-453f-9e84-160938b957c1 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:16.977355 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-120b31be-192b-453f-9e84-160938b957c1 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/f3fcf361-2e24-402c-8290-6bc77b1125fa" status: 200 len: 1517 microversion: 2.1 time: 0.317952 Oct 27 03:44:16.980591 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2857/5417] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:44:16 2022] GET /compute/v2.1/servers/f3fcf361-2e24-402c-8290-6bc77b1125fa => generated 1517 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:44:17.046850 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-e30ffa2b-6628-4275-816d-1da0455a3f3c tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lazy-loading 'services' on Instance uuid ce85aa86-fbba-4eca-97e8-173da3cdc7c3 {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:44:17.122765 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9e571807-fa35-4706-9096-a94373f46cd5 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:17.123392 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-9e571807-fa35-4706-9096-a94373f46cd5 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] [instance: af90f208-7b8a-4ae4-a654-5fc632279527] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:17.130718 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9e571807-fa35-4706-9096-a94373f46cd5 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:17.131255 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9e571807-fa35-4706-9096-a94373f46cd5 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:17.131696 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9e571807-fa35-4706-9096-a94373f46cd5 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:17.132421 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9e571807-fa35-4706-9096-a94373f46cd5 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:17.132887 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9e571807-fa35-4706-9096-a94373f46cd5 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:17.133326 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9e571807-fa35-4706-9096-a94373f46cd5 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:17.354643 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9e571807-fa35-4706-9096-a94373f46cd5 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9ddb0e44024937865411a7d2c3d956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4f0730b38a946759ea32c36f5876eb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:17.359562 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e30ffa2b-6628-4275-816d-1da0455a3f3c tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ce85aa86-fbba-4eca-97e8-173da3cdc7c3/os-volume_attachments/1c7e475a-3b5e-44fc-8548-9fcc062c82ec" status: 202 len: 0 microversion: 2.1 time: 0.484815 Oct 27 03:44:17.360924 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2561/5418] 10.222.0.20 () {58 vars in 1416 bytes} [Thu Oct 27 03:44:16 2022] DELETE /compute/v2.1/servers/ce85aa86-fbba-4eca-97e8-173da3cdc7c3/os-volume_attachments/1c7e475a-3b5e-44fc-8548-9fcc062c82ec => generated 0 bytes in 487 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:44:17.380380 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9e571807-fa35-4706-9096-a94373f46cd5 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] 10.222.0.20 "GET /compute/v2.1/servers/af90f208-7b8a-4ae4-a654-5fc632279527" status: 200 len: 1523 microversion: 2.1 time: 0.261300 Oct 27 03:44:17.381562 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2858/5419] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:44:17 2022] GET /compute/v2.1/servers/af90f208-7b8a-4ae4-a654-5fc632279527 => generated 1523 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:44:17.622466 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8f04e37d-fe65-4ebe-ab59-6a1b1d00317d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:17.623673 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8f04e37d-fe65-4ebe-ab59-6a1b1d00317d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 1db2318e-9ac7-4994-8daa-14ae22537d5d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:17.636704 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8f04e37d-fe65-4ebe-ab59-6a1b1d00317d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:17.637216 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8f04e37d-fe65-4ebe-ab59-6a1b1d00317d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:17.637661 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8f04e37d-fe65-4ebe-ab59-6a1b1d00317d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:17.638418 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8f04e37d-fe65-4ebe-ab59-6a1b1d00317d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:17.642570 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8f04e37d-fe65-4ebe-ab59-6a1b1d00317d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:17.643028 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8f04e37d-fe65-4ebe-ab59-6a1b1d00317d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:17.912518 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8f04e37d-fe65-4ebe-ab59-6a1b1d00317d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:17.925226 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8f04e37d-fe65-4ebe-ab59-6a1b1d00317d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:17.926899 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8f04e37d-fe65-4ebe-ab59-6a1b1d00317d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:17.928728 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8f04e37d-fe65-4ebe-ab59-6a1b1d00317d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d" status: 200 len: 1724 microversion: 2.20 time: 0.311987 Oct 27 03:44:17.929786 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2562/5420] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:44:17 2022] GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d => generated 1724 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:44:18.004975 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5e3200e3-84b5-4e43-b378-d07416a68b1d tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:18.005939 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5e3200e3-84b5-4e43-b378-d07416a68b1d tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: f3fcf361-2e24-402c-8290-6bc77b1125fa] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:18.018697 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5e3200e3-84b5-4e43-b378-d07416a68b1d tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:18.019541 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5e3200e3-84b5-4e43-b378-d07416a68b1d tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:18.022703 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5e3200e3-84b5-4e43-b378-d07416a68b1d tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:18.023646 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5e3200e3-84b5-4e43-b378-d07416a68b1d tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:18.026216 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5e3200e3-84b5-4e43-b378-d07416a68b1d tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:18.026794 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5e3200e3-84b5-4e43-b378-d07416a68b1d tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:18.315008 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5e3200e3-84b5-4e43-b378-d07416a68b1d tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:18.324919 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5e3200e3-84b5-4e43-b378-d07416a68b1d tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/f3fcf361-2e24-402c-8290-6bc77b1125fa" status: 200 len: 1517 microversion: 2.1 time: 0.324651 Oct 27 03:44:18.327291 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2859/5421] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:44:17 2022] GET /compute/v2.1/servers/f3fcf361-2e24-402c-8290-6bc77b1125fa => generated 1517 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:44:18.404582 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-cee5f528-e05a-4438-943e-11c5eec35490 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:18.405681 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-cee5f528-e05a-4438-943e-11c5eec35490 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] [instance: af90f208-7b8a-4ae4-a654-5fc632279527] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:18.413288 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cee5f528-e05a-4438-943e-11c5eec35490 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:18.413793 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cee5f528-e05a-4438-943e-11c5eec35490 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:18.414460 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cee5f528-e05a-4438-943e-11c5eec35490 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:18.415174 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cee5f528-e05a-4438-943e-11c5eec35490 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:18.415638 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cee5f528-e05a-4438-943e-11c5eec35490 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:18.416168 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cee5f528-e05a-4438-943e-11c5eec35490 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:18.636879 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-cee5f528-e05a-4438-943e-11c5eec35490 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9ddb0e44024937865411a7d2c3d956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4f0730b38a946759ea32c36f5876eb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:18.646630 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-cee5f528-e05a-4438-943e-11c5eec35490 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] 10.222.0.20 "GET /compute/v2.1/servers/af90f208-7b8a-4ae4-a654-5fc632279527" status: 200 len: 1523 microversion: 2.1 time: 0.245644 Oct 27 03:44:18.662080 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2563/5422] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:44:18 2022] GET /compute/v2.1/servers/af90f208-7b8a-4ae4-a654-5fc632279527 => generated 1523 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:44:18.956483 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0023e69b-09b6-4e4a-a1e7-858abd4e5dd8 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:18.957742 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0023e69b-09b6-4e4a-a1e7-858abd4e5dd8 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 1db2318e-9ac7-4994-8daa-14ae22537d5d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:18.968865 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0023e69b-09b6-4e4a-a1e7-858abd4e5dd8 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:18.969452 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0023e69b-09b6-4e4a-a1e7-858abd4e5dd8 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:18.969928 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0023e69b-09b6-4e4a-a1e7-858abd4e5dd8 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:18.970718 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0023e69b-09b6-4e4a-a1e7-858abd4e5dd8 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:18.974172 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0023e69b-09b6-4e4a-a1e7-858abd4e5dd8 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:18.974839 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0023e69b-09b6-4e4a-a1e7-858abd4e5dd8 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:19.212449 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0023e69b-09b6-4e4a-a1e7-858abd4e5dd8 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:19.226851 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0023e69b-09b6-4e4a-a1e7-858abd4e5dd8 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:19.228851 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0023e69b-09b6-4e4a-a1e7-858abd4e5dd8 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:19.230488 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0023e69b-09b6-4e4a-a1e7-858abd4e5dd8 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d" status: 200 len: 1724 microversion: 2.20 time: 0.278185 Oct 27 03:44:19.231726 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2860/5423] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:44:18 2022] GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d => generated 1724 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:44:19.358985 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-df543415-b334-4f17-80d8-c46b583bad82 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:19.360135 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-df543415-b334-4f17-80d8-c46b583bad82 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: f3fcf361-2e24-402c-8290-6bc77b1125fa] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:19.367870 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-df543415-b334-4f17-80d8-c46b583bad82 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:19.368375 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-df543415-b334-4f17-80d8-c46b583bad82 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:19.374770 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-df543415-b334-4f17-80d8-c46b583bad82 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:19.376648 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-df543415-b334-4f17-80d8-c46b583bad82 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:19.382701 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-df543415-b334-4f17-80d8-c46b583bad82 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:19.383449 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-df543415-b334-4f17-80d8-c46b583bad82 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:19.666105 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-df543415-b334-4f17-80d8-c46b583bad82 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:19.672070 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d9506198-5cf0-47f1-8288-b6e1dce75fbb tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:19.673525 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d9506198-5cf0-47f1-8288-b6e1dce75fbb tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] [instance: af90f208-7b8a-4ae4-a654-5fc632279527] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:19.677597 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-df543415-b334-4f17-80d8-c46b583bad82 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/f3fcf361-2e24-402c-8290-6bc77b1125fa" status: 200 len: 1517 microversion: 2.1 time: 0.330419 Oct 27 03:44:19.678218 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2564/5424] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:44:19 2022] GET /compute/v2.1/servers/f3fcf361-2e24-402c-8290-6bc77b1125fa => generated 1517 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:44:19.686643 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d9506198-5cf0-47f1-8288-b6e1dce75fbb tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:19.687220 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d9506198-5cf0-47f1-8288-b6e1dce75fbb tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:19.692536 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d9506198-5cf0-47f1-8288-b6e1dce75fbb tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:19.696356 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d9506198-5cf0-47f1-8288-b6e1dce75fbb tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:19.696356 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d9506198-5cf0-47f1-8288-b6e1dce75fbb tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:19.696356 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d9506198-5cf0-47f1-8288-b6e1dce75fbb tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:19.966742 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d9506198-5cf0-47f1-8288-b6e1dce75fbb tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9ddb0e44024937865411a7d2c3d956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4f0730b38a946759ea32c36f5876eb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:19.975259 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d9506198-5cf0-47f1-8288-b6e1dce75fbb tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] 10.222.0.20 "GET /compute/v2.1/servers/af90f208-7b8a-4ae4-a654-5fc632279527" status: 200 len: 1523 microversion: 2.1 time: 0.308340 Oct 27 03:44:19.976083 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2861/5425] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:44:19 2022] GET /compute/v2.1/servers/af90f208-7b8a-4ae4-a654-5fc632279527 => generated 1523 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:44:20.256043 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b359c0d3-504e-43b4-94f7-3603c930a54f tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:20.256669 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b359c0d3-504e-43b4-94f7-3603c930a54f tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 1db2318e-9ac7-4994-8daa-14ae22537d5d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:20.263070 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b359c0d3-504e-43b4-94f7-3603c930a54f tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:20.263773 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b359c0d3-504e-43b4-94f7-3603c930a54f tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:20.264506 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b359c0d3-504e-43b4-94f7-3603c930a54f tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:20.265529 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b359c0d3-504e-43b4-94f7-3603c930a54f tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:20.266197 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b359c0d3-504e-43b4-94f7-3603c930a54f tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:20.266798 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b359c0d3-504e-43b4-94f7-3603c930a54f tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:20.566295 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b359c0d3-504e-43b4-94f7-3603c930a54f tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:20.576614 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b359c0d3-504e-43b4-94f7-3603c930a54f tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:20.579205 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b359c0d3-504e-43b4-94f7-3603c930a54f tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:20.580707 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b359c0d3-504e-43b4-94f7-3603c930a54f tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d" status: 200 len: 1724 microversion: 2.20 time: 0.329200 Oct 27 03:44:20.581732 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2565/5426] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:44:20 2022] GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d => generated 1724 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:44:20.703855 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c4fb997d-85c6-4e38-833e-38ad785e29f7 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:20.705604 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c4fb997d-85c6-4e38-833e-38ad785e29f7 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: f3fcf361-2e24-402c-8290-6bc77b1125fa] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:20.715045 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c4fb997d-85c6-4e38-833e-38ad785e29f7 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:20.715959 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c4fb997d-85c6-4e38-833e-38ad785e29f7 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:20.716641 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c4fb997d-85c6-4e38-833e-38ad785e29f7 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:20.718114 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c4fb997d-85c6-4e38-833e-38ad785e29f7 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:20.719963 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c4fb997d-85c6-4e38-833e-38ad785e29f7 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:20.721412 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c4fb997d-85c6-4e38-833e-38ad785e29f7 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:20.980401 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c4fb997d-85c6-4e38-833e-38ad785e29f7 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:20.991579 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c4fb997d-85c6-4e38-833e-38ad785e29f7 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/f3fcf361-2e24-402c-8290-6bc77b1125fa" status: 200 len: 1517 microversion: 2.1 time: 0.292895 Oct 27 03:44:20.992898 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2862/5427] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:44:20 2022] GET /compute/v2.1/servers/f3fcf361-2e24-402c-8290-6bc77b1125fa => generated 1517 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:44:20.999446 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e4b85c64-2566-47f7-9ea3-748ebf70bdd0 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:21.004904 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e4b85c64-2566-47f7-9ea3-748ebf70bdd0 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] [instance: af90f208-7b8a-4ae4-a654-5fc632279527] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:21.012722 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e4b85c64-2566-47f7-9ea3-748ebf70bdd0 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:21.019103 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e4b85c64-2566-47f7-9ea3-748ebf70bdd0 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:21.019103 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e4b85c64-2566-47f7-9ea3-748ebf70bdd0 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:21.019103 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e4b85c64-2566-47f7-9ea3-748ebf70bdd0 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:21.019103 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e4b85c64-2566-47f7-9ea3-748ebf70bdd0 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:21.019103 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e4b85c64-2566-47f7-9ea3-748ebf70bdd0 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:21.262108 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e4b85c64-2566-47f7-9ea3-748ebf70bdd0 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9ddb0e44024937865411a7d2c3d956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4f0730b38a946759ea32c36f5876eb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:21.273385 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e4b85c64-2566-47f7-9ea3-748ebf70bdd0 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] 10.222.0.20 "GET /compute/v2.1/servers/af90f208-7b8a-4ae4-a654-5fc632279527" status: 200 len: 1523 microversion: 2.1 time: 0.277680 Oct 27 03:44:21.277558 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2566/5428] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:44:20 2022] GET /compute/v2.1/servers/af90f208-7b8a-4ae4-a654-5fc632279527 => generated 1523 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:44:21.615887 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6edc7170-b7f6-4791-a04e-2e66cf626ef4 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:21.615887 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-6edc7170-b7f6-4791-a04e-2e66cf626ef4 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 1db2318e-9ac7-4994-8daa-14ae22537d5d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:21.625222 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6edc7170-b7f6-4791-a04e-2e66cf626ef4 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:21.627953 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6edc7170-b7f6-4791-a04e-2e66cf626ef4 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:21.630664 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6edc7170-b7f6-4791-a04e-2e66cf626ef4 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:21.636312 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6edc7170-b7f6-4791-a04e-2e66cf626ef4 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:21.639447 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6edc7170-b7f6-4791-a04e-2e66cf626ef4 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:21.640060 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6edc7170-b7f6-4791-a04e-2e66cf626ef4 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:21.977028 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6edc7170-b7f6-4791-a04e-2e66cf626ef4 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:21.987825 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6edc7170-b7f6-4791-a04e-2e66cf626ef4 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:21.990251 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6edc7170-b7f6-4791-a04e-2e66cf626ef4 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:21.991864 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6edc7170-b7f6-4791-a04e-2e66cf626ef4 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d" status: 200 len: 1724 microversion: 2.20 time: 0.384393 Oct 27 03:44:21.993094 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2863/5429] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:44:21 2022] GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d => generated 1724 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:44:22.015852 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-55398c69-ec3e-4252-a733-d8fe8d27026b tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:22.017100 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-55398c69-ec3e-4252-a733-d8fe8d27026b tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: f3fcf361-2e24-402c-8290-6bc77b1125fa] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:22.025089 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-55398c69-ec3e-4252-a733-d8fe8d27026b tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:22.025811 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-55398c69-ec3e-4252-a733-d8fe8d27026b tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:22.026675 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-55398c69-ec3e-4252-a733-d8fe8d27026b tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:22.027577 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-55398c69-ec3e-4252-a733-d8fe8d27026b tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:22.028194 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-55398c69-ec3e-4252-a733-d8fe8d27026b tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:22.028786 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-55398c69-ec3e-4252-a733-d8fe8d27026b tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:22.300015 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-799efee1-9b9c-425f-a456-1d8f82ba65a6 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:22.300887 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-799efee1-9b9c-425f-a456-1d8f82ba65a6 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] [instance: af90f208-7b8a-4ae4-a654-5fc632279527] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:22.307044 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-799efee1-9b9c-425f-a456-1d8f82ba65a6 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:22.307809 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-799efee1-9b9c-425f-a456-1d8f82ba65a6 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:22.308259 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-799efee1-9b9c-425f-a456-1d8f82ba65a6 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:22.309086 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-799efee1-9b9c-425f-a456-1d8f82ba65a6 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:22.309718 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-799efee1-9b9c-425f-a456-1d8f82ba65a6 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:22.310184 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-799efee1-9b9c-425f-a456-1d8f82ba65a6 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:22.350310 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-55398c69-ec3e-4252-a733-d8fe8d27026b tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:22.363146 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-55398c69-ec3e-4252-a733-d8fe8d27026b tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/f3fcf361-2e24-402c-8290-6bc77b1125fa" status: 200 len: 1517 microversion: 2.1 time: 0.350993 Oct 27 03:44:22.363756 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2567/5430] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:44:22 2022] GET /compute/v2.1/servers/f3fcf361-2e24-402c-8290-6bc77b1125fa => generated 1517 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:44:22.516533 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-799efee1-9b9c-425f-a456-1d8f82ba65a6 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9ddb0e44024937865411a7d2c3d956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4f0730b38a946759ea32c36f5876eb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:22.531981 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-799efee1-9b9c-425f-a456-1d8f82ba65a6 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] 10.222.0.20 "GET /compute/v2.1/servers/af90f208-7b8a-4ae4-a654-5fc632279527" status: 200 len: 1523 microversion: 2.1 time: 0.235864 Oct 27 03:44:22.532576 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2864/5431] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:44:22 2022] GET /compute/v2.1/servers/af90f208-7b8a-4ae4-a654-5fc632279527 => generated 1523 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:44:23.022588 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4f30ea53-68c9-44c1-91a5-e4232e45064b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:23.024357 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4f30ea53-68c9-44c1-91a5-e4232e45064b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 1db2318e-9ac7-4994-8daa-14ae22537d5d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:23.048163 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4f30ea53-68c9-44c1-91a5-e4232e45064b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:23.049056 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4f30ea53-68c9-44c1-91a5-e4232e45064b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:23.050606 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4f30ea53-68c9-44c1-91a5-e4232e45064b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:23.054304 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4f30ea53-68c9-44c1-91a5-e4232e45064b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:23.057059 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4f30ea53-68c9-44c1-91a5-e4232e45064b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:23.057528 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4f30ea53-68c9-44c1-91a5-e4232e45064b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:23.320774 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4f30ea53-68c9-44c1-91a5-e4232e45064b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:23.326083 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:44:23.333460 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4f30ea53-68c9-44c1-91a5-e4232e45064b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:23.335635 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4f30ea53-68c9-44c1-91a5-e4232e45064b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:23.337205 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4f30ea53-68c9-44c1-91a5-e4232e45064b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d" status: 200 len: 1724 microversion: 2.20 time: 0.320635 Oct 27 03:44:23.338404 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2568/5432] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:44:23 2022] GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d => generated 1724 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:44:23.387337 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0b097c02-8fc8-4553-9a22-59313375f831 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:23.387977 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0b097c02-8fc8-4553-9a22-59313375f831 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: f3fcf361-2e24-402c-8290-6bc77b1125fa] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:23.406574 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0b097c02-8fc8-4553-9a22-59313375f831 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:23.407585 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0b097c02-8fc8-4553-9a22-59313375f831 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:23.408426 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0b097c02-8fc8-4553-9a22-59313375f831 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:23.409581 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0b097c02-8fc8-4553-9a22-59313375f831 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:23.411174 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0b097c02-8fc8-4553-9a22-59313375f831 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:23.412057 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0b097c02-8fc8-4553-9a22-59313375f831 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:23.562544 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5c08b6ae-9f86-4d10-961e-b9f495d269e4 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:23.563469 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5c08b6ae-9f86-4d10-961e-b9f495d269e4 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] [instance: af90f208-7b8a-4ae4-a654-5fc632279527] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:23.571515 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5c08b6ae-9f86-4d10-961e-b9f495d269e4 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:23.572263 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5c08b6ae-9f86-4d10-961e-b9f495d269e4 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:23.573328 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5c08b6ae-9f86-4d10-961e-b9f495d269e4 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:23.574359 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5c08b6ae-9f86-4d10-961e-b9f495d269e4 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:23.575009 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5c08b6ae-9f86-4d10-961e-b9f495d269e4 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:23.575789 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5c08b6ae-9f86-4d10-961e-b9f495d269e4 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:23.771527 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0b097c02-8fc8-4553-9a22-59313375f831 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:23.781567 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0b097c02-8fc8-4553-9a22-59313375f831 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/f3fcf361-2e24-402c-8290-6bc77b1125fa" status: 200 len: 1517 microversion: 2.1 time: 0.398108 Oct 27 03:44:23.782431 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2865/5433] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:44:23 2022] GET /compute/v2.1/servers/f3fcf361-2e24-402c-8290-6bc77b1125fa => generated 1517 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:44:23.828352 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5c08b6ae-9f86-4d10-961e-b9f495d269e4 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9ddb0e44024937865411a7d2c3d956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4f0730b38a946759ea32c36f5876eb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:23.842568 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5c08b6ae-9f86-4d10-961e-b9f495d269e4 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] 10.222.0.20 "GET /compute/v2.1/servers/af90f208-7b8a-4ae4-a654-5fc632279527" status: 200 len: 1523 microversion: 2.1 time: 0.285706 Oct 27 03:44:23.846540 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2569/5434] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:44:23 2022] GET /compute/v2.1/servers/af90f208-7b8a-4ae4-a654-5fc632279527 => generated 1523 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:44:24.387707 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8308f63a-4e06-4cdb-9e14-8d717b2138da tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:24.388289 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8308f63a-4e06-4cdb-9e14-8d717b2138da tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 1db2318e-9ac7-4994-8daa-14ae22537d5d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:24.395986 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8308f63a-4e06-4cdb-9e14-8d717b2138da tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:24.396486 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8308f63a-4e06-4cdb-9e14-8d717b2138da tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:24.397252 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8308f63a-4e06-4cdb-9e14-8d717b2138da tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:24.397974 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8308f63a-4e06-4cdb-9e14-8d717b2138da tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:24.398462 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8308f63a-4e06-4cdb-9e14-8d717b2138da tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:24.399012 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8308f63a-4e06-4cdb-9e14-8d717b2138da tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:24.735026 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8308f63a-4e06-4cdb-9e14-8d717b2138da tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:24.751446 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8308f63a-4e06-4cdb-9e14-8d717b2138da tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:24.758606 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8308f63a-4e06-4cdb-9e14-8d717b2138da tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:24.760488 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8308f63a-4e06-4cdb-9e14-8d717b2138da tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d" status: 200 len: 1745 microversion: 2.20 time: 0.376993 Oct 27 03:44:24.761953 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2866/5435] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:44:24 2022] GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d => generated 1745 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:44:24.810250 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8bff1c5e-3b94-4573-b9f3-8f264837b961 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:24.811003 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8bff1c5e-3b94-4573-b9f3-8f264837b961 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: f3fcf361-2e24-402c-8290-6bc77b1125fa] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:24.822839 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8bff1c5e-3b94-4573-b9f3-8f264837b961 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:24.823594 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8bff1c5e-3b94-4573-b9f3-8f264837b961 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:24.824207 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8bff1c5e-3b94-4573-b9f3-8f264837b961 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:24.827719 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8bff1c5e-3b94-4573-b9f3-8f264837b961 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:24.827719 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8bff1c5e-3b94-4573-b9f3-8f264837b961 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:24.827719 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8bff1c5e-3b94-4573-b9f3-8f264837b961 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:24.869148 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4d26f093-8f44-4ec9-ba1d-fc401297ebd4 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:24.869832 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4d26f093-8f44-4ec9-ba1d-fc401297ebd4 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] [instance: af90f208-7b8a-4ae4-a654-5fc632279527] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:24.878543 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4d26f093-8f44-4ec9-ba1d-fc401297ebd4 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:24.879086 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4d26f093-8f44-4ec9-ba1d-fc401297ebd4 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:24.879534 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4d26f093-8f44-4ec9-ba1d-fc401297ebd4 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:24.884324 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4d26f093-8f44-4ec9-ba1d-fc401297ebd4 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:24.884324 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4d26f093-8f44-4ec9-ba1d-fc401297ebd4 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:24.884324 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4d26f093-8f44-4ec9-ba1d-fc401297ebd4 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:25.145415 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8bff1c5e-3b94-4573-b9f3-8f264837b961 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:25.152608 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4d26f093-8f44-4ec9-ba1d-fc401297ebd4 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9ddb0e44024937865411a7d2c3d956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4f0730b38a946759ea32c36f5876eb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:25.160084 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8bff1c5e-3b94-4573-b9f3-8f264837b961 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/f3fcf361-2e24-402c-8290-6bc77b1125fa" status: 200 len: 1517 microversion: 2.1 time: 0.353328 Oct 27 03:44:25.161270 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2570/5436] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:44:24 2022] GET /compute/v2.1/servers/f3fcf361-2e24-402c-8290-6bc77b1125fa => generated 1517 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:44:25.209418 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4d26f093-8f44-4ec9-ba1d-fc401297ebd4 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] 10.222.0.20 "GET /compute/v2.1/servers/af90f208-7b8a-4ae4-a654-5fc632279527" status: 200 len: 1503 microversion: 2.1 time: 0.344477 Oct 27 03:44:25.210327 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2867/5437] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:44:24 2022] GET /compute/v2.1/servers/af90f208-7b8a-4ae4-a654-5fc632279527 => generated 1503 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:44:25.235495 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-dc65f714-10a6-4544-bf9a-493f53f3c373 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Action: 'create', calling method: .version_select at 0x7f7ddb06cf70>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-742485815", "description": "tempest-description-1153269435"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:44:25.743824 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-dc65f714-10a6-4544-bf9a-493f53f3c373 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 250 microversion: 2.1 time: 0.512877 Oct 27 03:44:25.749893 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2571/5438] 10.222.0.20 () {60 vars in 1180 bytes} [Thu Oct 27 03:44:25 2022] POST /compute/v2.1/os-security-groups => generated 250 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:44:25.766735 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7907fe9a-36e1-45a1-9883-065691eb7962 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-742485815"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:44:25.767980 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7907fe9a-36e1-45a1-9883-065691eb7962 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] [instance: af90f208-7b8a-4ae4-a654-5fc632279527] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:25.778872 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-efdfdaef-cd31-4084-8d29-ed979230ee60 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:25.779602 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-efdfdaef-cd31-4084-8d29-ed979230ee60 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: ce85aa86-fbba-4eca-97e8-173da3cdc7c3] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:25.787825 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-efdfdaef-cd31-4084-8d29-ed979230ee60 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:25.788569 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-efdfdaef-cd31-4084-8d29-ed979230ee60 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:25.789424 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-efdfdaef-cd31-4084-8d29-ed979230ee60 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:25.790441 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-efdfdaef-cd31-4084-8d29-ed979230ee60 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:25.791061 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-efdfdaef-cd31-4084-8d29-ed979230ee60 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:25.791651 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-efdfdaef-cd31-4084-8d29-ed979230ee60 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:25.799309 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7907fe9a-36e1-45a1-9883-065691eb7962 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:25.799820 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7907fe9a-36e1-45a1-9883-065691eb7962 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:25.800267 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7907fe9a-36e1-45a1-9883-065691eb7962 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:25.810539 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7907fe9a-36e1-45a1-9883-065691eb7962 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:25.821963 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7907fe9a-36e1-45a1-9883-065691eb7962 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:25.822635 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7907fe9a-36e1-45a1-9883-065691eb7962 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:25.842871 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-efdfdaef-cd31-4084-8d29-ed979230ee60 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "GET /compute/v2.1/servers/ce85aa86-fbba-4eca-97e8-173da3cdc7c3/os-volume_attachments/dbf01790-0c6f-4201-a18f-24bd16da3db3" status: 200 len: 194 microversion: 2.1 time: 0.069570 Oct 27 03:44:25.852041 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2572/5439] 10.222.0.20 () {58 vars in 1413 bytes} [Thu Oct 27 03:44:25 2022] GET /compute/v2.1/servers/ce85aa86-fbba-4eca-97e8-173da3cdc7c3/os-volume_attachments/dbf01790-0c6f-4201-a18f-24bd16da3db3 => generated 194 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:44:26.173510 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1037bdda-286f-4d44-b99e-4d25f29c6325 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:26.174171 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1037bdda-286f-4d44-b99e-4d25f29c6325 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 1db2318e-9ac7-4994-8daa-14ae22537d5d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:26.212495 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1037bdda-286f-4d44-b99e-4d25f29c6325 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:26.213013 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1037bdda-286f-4d44-b99e-4d25f29c6325 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:26.215759 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1037bdda-286f-4d44-b99e-4d25f29c6325 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:26.217648 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1037bdda-286f-4d44-b99e-4d25f29c6325 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:26.218431 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1037bdda-286f-4d44-b99e-4d25f29c6325 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:26.218892 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1037bdda-286f-4d44-b99e-4d25f29c6325 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:26.523121 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1037bdda-286f-4d44-b99e-4d25f29c6325 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:26.535531 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1037bdda-286f-4d44-b99e-4d25f29c6325 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:26.545067 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1037bdda-286f-4d44-b99e-4d25f29c6325 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:26.551288 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1037bdda-286f-4d44-b99e-4d25f29c6325 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d" status: 200 len: 1740 microversion: 2.20 time: 0.693209 Oct 27 03:44:26.551288 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2573/5440] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:44:25 2022] GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d => generated 1740 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:44:26.564745 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ed0fbcf3-4c22-4e01-a5a5-6a7f5ad40207 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:26.568670 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ed0fbcf3-4c22-4e01-a5a5-6a7f5ad40207 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: ce85aa86-fbba-4eca-97e8-173da3cdc7c3] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:26.593447 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ed0fbcf3-4c22-4e01-a5a5-6a7f5ad40207 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:26.594188 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ed0fbcf3-4c22-4e01-a5a5-6a7f5ad40207 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:26.594656 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ed0fbcf3-4c22-4e01-a5a5-6a7f5ad40207 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:26.613662 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ed0fbcf3-4c22-4e01-a5a5-6a7f5ad40207 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:26.614227 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ed0fbcf3-4c22-4e01-a5a5-6a7f5ad40207 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:26.614690 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ed0fbcf3-4c22-4e01-a5a5-6a7f5ad40207 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:26.829828 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-ed0fbcf3-4c22-4e01-a5a5-6a7f5ad40207 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lazy-loading 'services' on Instance uuid ce85aa86-fbba-4eca-97e8-173da3cdc7c3 {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:44:27.082516 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.network.security_group_api [None req-7907fe9a-36e1-45a1-9883-065691eb7962 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Adding security group b2d9d343-caee-41f8-a960-375b06ff7fbb to port 3697490b-4346-4713-baa7-c8f934701f1a Oct 27 03:44:27.126261 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ed0fbcf3-4c22-4e01-a5a5-6a7f5ad40207 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ce85aa86-fbba-4eca-97e8-173da3cdc7c3/os-volume_attachments/dbf01790-0c6f-4201-a18f-24bd16da3db3" status: 202 len: 0 microversion: 2.1 time: 0.571488 Oct 27 03:44:27.126261 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2574/5441] 10.222.0.20 () {58 vars in 1416 bytes} [Thu Oct 27 03:44:26 2022] DELETE /compute/v2.1/servers/ce85aa86-fbba-4eca-97e8-173da3cdc7c3/os-volume_attachments/dbf01790-0c6f-4201-a18f-24bd16da3db3 => generated 0 bytes in 575 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:44:27.160920 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-be3ad30b-72b9-447d-9df0-1c395e4992db tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:27.162247 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-be3ad30b-72b9-447d-9df0-1c395e4992db tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: f3fcf361-2e24-402c-8290-6bc77b1125fa] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:27.175098 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-be3ad30b-72b9-447d-9df0-1c395e4992db tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:27.175645 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-be3ad30b-72b9-447d-9df0-1c395e4992db tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:27.176397 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-be3ad30b-72b9-447d-9df0-1c395e4992db tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:27.177124 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-be3ad30b-72b9-447d-9df0-1c395e4992db tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:27.186657 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-be3ad30b-72b9-447d-9df0-1c395e4992db tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:27.197560 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-be3ad30b-72b9-447d-9df0-1c395e4992db tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:27.503266 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-be3ad30b-72b9-447d-9df0-1c395e4992db tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:27.511592 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-be3ad30b-72b9-447d-9df0-1c395e4992db tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/f3fcf361-2e24-402c-8290-6bc77b1125fa" status: 200 len: 1517 microversion: 2.1 time: 0.386721 Oct 27 03:44:27.532283 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2575/5442] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:44:27 2022] GET /compute/v2.1/servers/f3fcf361-2e24-402c-8290-6bc77b1125fa => generated 1517 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:44:27.535914 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e220208e-8241-42de-9e7a-21db26e34c69 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:44:27.552680 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e220208e-8241-42de-9e7a-21db26e34c69 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: dbdbec9a-f4bf-4740-ab67-3c8891e341a1] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:27.559390 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e220208e-8241-42de-9e7a-21db26e34c69 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:27.559902 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e220208e-8241-42de-9e7a-21db26e34c69 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:27.560349 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e220208e-8241-42de-9e7a-21db26e34c69 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:27.561073 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e220208e-8241-42de-9e7a-21db26e34c69 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:27.561537 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e220208e-8241-42de-9e7a-21db26e34c69 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:27.561969 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e220208e-8241-42de-9e7a-21db26e34c69 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:27.624754 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-e220208e-8241-42de-9e7a-21db26e34c69 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lazy-loading 'flavor' on Instance uuid dbdbec9a-f4bf-4740-ab67-3c8891e341a1 {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:44:28.170992 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e220208e-8241-42de-9e7a-21db26e34c69 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "POST /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1/action" status: 200 len: 32 microversion: 2.1 time: 0.655731 Oct 27 03:44:28.172740 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2576/5443] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:44:27 2022] POST /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1/action => generated 32 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 03:44:28.208920 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7907fe9a-36e1-45a1-9883-065691eb7962 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] 10.222.0.20 "POST /compute/v2.1/servers/af90f208-7b8a-4ae4-a654-5fc632279527/action" status: 202 len: 0 microversion: 2.1 time: 2.451237 Oct 27 03:44:28.213992 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2868/5444] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:44:25 2022] POST /compute/v2.1/servers/af90f208-7b8a-4ae4-a654-5fc632279527/action => generated 0 bytes in 2457 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:44:28.217365 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-98a3027f-e508-4a0c-8059-f6f6d92d76a7 req-67374edf-d32a-4144-b620-5d91553b8d3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1db2318e-9ac7-4994-8daa-14ae22537d5d", "name": "network-vif-plugged", "status": "completed", "tag": "162a3612-f72a-4eb0-9872-8b121e85445d"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:44:28.221414 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f3c38d9f-ed35-45eb-93c2-41a426063adf tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:28.224233 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f3c38d9f-ed35-45eb-93c2-41a426063adf tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 1db2318e-9ac7-4994-8daa-14ae22537d5d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:28.244609 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f3c38d9f-ed35-45eb-93c2-41a426063adf tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:28.256003 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f3c38d9f-ed35-45eb-93c2-41a426063adf tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:28.257047 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f3c38d9f-ed35-45eb-93c2-41a426063adf tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:28.260569 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f3c38d9f-ed35-45eb-93c2-41a426063adf tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:28.262942 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f3c38d9f-ed35-45eb-93c2-41a426063adf tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:28.266137 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f3c38d9f-ed35-45eb-93c2-41a426063adf tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:28.266981 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-98a3027f-e508-4a0c-8059-f6f6d92d76a7 req-67374edf-d32a-4144-b620-5d91553b8d3d service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:28.270840 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-98a3027f-e508-4a0c-8059-f6f6d92d76a7 req-67374edf-d32a-4144-b620-5d91553b8d3d service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:28.271351 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-98a3027f-e508-4a0c-8059-f6f6d92d76a7 req-67374edf-d32a-4144-b620-5d91553b8d3d service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:28.285819 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:44:28.317913 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-98a3027f-e508-4a0c-8059-f6f6d92d76a7 req-67374edf-d32a-4144-b620-5d91553b8d3d service nova] Creating event network-vif-plugged:162a3612-f72a-4eb0-9872-8b121e85445d for instance 1db2318e-9ac7-4994-8daa-14ae22537d5d on n-h2-862769-1 Oct 27 03:44:28.334949 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-98a3027f-e508-4a0c-8059-f6f6d92d76a7 req-67374edf-d32a-4144-b620-5d91553b8d3d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160597 Oct 27 03:44:28.342804 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2577/5445] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:44:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:44:28.360868 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f5987878-92fb-4066-a2e7-64ca91ab7e71 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:28.364749 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f5987878-92fb-4066-a2e7-64ca91ab7e71 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: dbdbec9a-f4bf-4740-ab67-3c8891e341a1] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:28.387847 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f5987878-92fb-4066-a2e7-64ca91ab7e71 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:28.397709 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f5987878-92fb-4066-a2e7-64ca91ab7e71 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:28.403297 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f5987878-92fb-4066-a2e7-64ca91ab7e71 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:28.407906 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f5987878-92fb-4066-a2e7-64ca91ab7e71 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:28.411087 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f5987878-92fb-4066-a2e7-64ca91ab7e71 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:28.415871 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f5987878-92fb-4066-a2e7-64ca91ab7e71 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:28.813746 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f3c38d9f-ed35-45eb-93c2-41a426063adf tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:28.843672 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f3c38d9f-ed35-45eb-93c2-41a426063adf tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:28.843672 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f3c38d9f-ed35-45eb-93c2-41a426063adf tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:28.843672 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f3c38d9f-ed35-45eb-93c2-41a426063adf tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d" status: 200 len: 1740 microversion: 2.20 time: 0.625286 Oct 27 03:44:28.844274 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2869/5446] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:44:28 2022] GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d => generated 1740 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:44:28.858624 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f68c323e-3783-4d81-8579-92f5a2b56814 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-742485815"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:44:28.860518 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f68c323e-3783-4d81-8579-92f5a2b56814 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] [instance: af90f208-7b8a-4ae4-a654-5fc632279527] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:28.883137 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f68c323e-3783-4d81-8579-92f5a2b56814 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:28.883917 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f68c323e-3783-4d81-8579-92f5a2b56814 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:28.886877 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f68c323e-3783-4d81-8579-92f5a2b56814 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:28.888452 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f68c323e-3783-4d81-8579-92f5a2b56814 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:28.889096 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f68c323e-3783-4d81-8579-92f5a2b56814 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:28.891114 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f68c323e-3783-4d81-8579-92f5a2b56814 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:29.181702 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.network.security_group_api [None req-f68c323e-3783-4d81-8579-92f5a2b56814 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Removing security group b2d9d343-caee-41f8-a960-375b06ff7fbb from port 3697490b-4346-4713-baa7-c8f934701f1a Oct 27 03:44:29.428106 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f5987878-92fb-4066-a2e7-64ca91ab7e71 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:29.439133 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f5987878-92fb-4066-a2e7-64ca91ab7e71 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1" status: 200 len: 1734 microversion: 2.1 time: 1.094932 Oct 27 03:44:29.444930 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2578/5447] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:44:28 2022] GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1 => generated 1734 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:44:29.457184 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-a9703378-cf06-4ade-9158-63722e65dd8a req-5c6f7766-6517-400e-aa73-0ef0c6895688 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af90f208-7b8a-4ae4-a654-5fc632279527", "tag": "3697490b-4346-4713-baa7-c8f934701f1a"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:44:29.479924 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-a9703378-cf06-4ade-9158-63722e65dd8a req-5c6f7766-6517-400e-aa73-0ef0c6895688 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:29.482663 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-a9703378-cf06-4ade-9158-63722e65dd8a req-5c6f7766-6517-400e-aa73-0ef0c6895688 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:29.483346 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-a9703378-cf06-4ade-9158-63722e65dd8a req-5c6f7766-6517-400e-aa73-0ef0c6895688 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:29.523134 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-a9703378-cf06-4ade-9158-63722e65dd8a req-5c6f7766-6517-400e-aa73-0ef0c6895688 service nova] Creating event network-changed:3697490b-4346-4713-baa7-c8f934701f1a for instance af90f208-7b8a-4ae4-a654-5fc632279527 on n-h1-862769-1 Oct 27 03:44:29.540514 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-a9703378-cf06-4ade-9158-63722e65dd8a req-5c6f7766-6517-400e-aa73-0ef0c6895688 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094047 Oct 27 03:44:29.547136 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2579/5448] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:44:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:44:29.561029 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-fbd3b8c2-413a-4500-9594-35202ca6b5cb tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:29.562001 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-fbd3b8c2-413a-4500-9594-35202ca6b5cb tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: f3fcf361-2e24-402c-8290-6bc77b1125fa] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:29.591910 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fbd3b8c2-413a-4500-9594-35202ca6b5cb tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:29.592954 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fbd3b8c2-413a-4500-9594-35202ca6b5cb tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:29.593667 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fbd3b8c2-413a-4500-9594-35202ca6b5cb tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:29.594445 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fbd3b8c2-413a-4500-9594-35202ca6b5cb tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:29.594911 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fbd3b8c2-413a-4500-9594-35202ca6b5cb tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:29.602961 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fbd3b8c2-413a-4500-9594-35202ca6b5cb tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:30.164136 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-fbd3b8c2-413a-4500-9594-35202ca6b5cb tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:30.177026 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-fbd3b8c2-413a-4500-9594-35202ca6b5cb tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/f3fcf361-2e24-402c-8290-6bc77b1125fa" status: 200 len: 1517 microversion: 2.1 time: 0.627925 Oct 27 03:44:30.181383 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2580/5449] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:44:29 2022] GET /compute/v2.1/servers/f3fcf361-2e24-402c-8290-6bc77b1125fa => generated 1517 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:44:30.193680 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9b1bf0ab-8612-4258-b3c6-ac5ee70bb97b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:30.196524 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9b1bf0ab-8612-4258-b3c6-ac5ee70bb97b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 1db2318e-9ac7-4994-8daa-14ae22537d5d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:30.218084 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9b1bf0ab-8612-4258-b3c6-ac5ee70bb97b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:30.218600 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9b1bf0ab-8612-4258-b3c6-ac5ee70bb97b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:30.219048 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9b1bf0ab-8612-4258-b3c6-ac5ee70bb97b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:30.219979 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9b1bf0ab-8612-4258-b3c6-ac5ee70bb97b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:30.220603 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9b1bf0ab-8612-4258-b3c6-ac5ee70bb97b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:30.221198 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9b1bf0ab-8612-4258-b3c6-ac5ee70bb97b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:30.440692 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f68c323e-3783-4d81-8579-92f5a2b56814 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] 10.222.0.20 "POST /compute/v2.1/servers/af90f208-7b8a-4ae4-a654-5fc632279527/action" status: 202 len: 0 microversion: 2.1 time: 1.592440 Oct 27 03:44:30.442409 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2870/5450] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:44:28 2022] POST /compute/v2.1/servers/af90f208-7b8a-4ae4-a654-5fc632279527/action => generated 0 bytes in 1595 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:44:30.451813 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5c20354e-7502-4027-b8e6-d73ecbc44f3b tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Action: 'create', calling method: .version_select at 0x7f7dd96a38b0>, body: {"pool": null} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:44:30.552028 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9b1bf0ab-8612-4258-b3c6-ac5ee70bb97b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:30.557278 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9b1bf0ab-8612-4258-b3c6-ac5ee70bb97b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:30.572642 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9b1bf0ab-8612-4258-b3c6-ac5ee70bb97b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:30.620128 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9b1bf0ab-8612-4258-b3c6-ac5ee70bb97b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d" status: 200 len: 1740 microversion: 2.20 time: 0.390078 Oct 27 03:44:30.620128 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2581/5451] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:44:30 2022] GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d => generated 1740 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:44:30.620128 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f57d36e6-7f13-429b-ba8c-fa70cf50491c tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:30.620128 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f57d36e6-7f13-429b-ba8c-fa70cf50491c tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: dbdbec9a-f4bf-4740-ab67-3c8891e341a1] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:30.620128 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f57d36e6-7f13-429b-ba8c-fa70cf50491c tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:30.620128 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f57d36e6-7f13-429b-ba8c-fa70cf50491c tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:30.620128 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f57d36e6-7f13-429b-ba8c-fa70cf50491c tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:30.620128 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f57d36e6-7f13-429b-ba8c-fa70cf50491c tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:30.620128 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f57d36e6-7f13-429b-ba8c-fa70cf50491c tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:30.620128 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f57d36e6-7f13-429b-ba8c-fa70cf50491c tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:30.942688 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f57d36e6-7f13-429b-ba8c-fa70cf50491c tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:30.970276 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f57d36e6-7f13-429b-ba8c-fa70cf50491c tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1" status: 200 len: 1734 microversion: 2.1 time: 0.370939 Oct 27 03:44:30.970963 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2582/5452] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:44:30 2022] GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1 => generated 1734 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:44:31.215550 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c91873b7-c0ea-43b8-acdb-1aa72df16b9d tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:31.216183 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c91873b7-c0ea-43b8-acdb-1aa72df16b9d tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: f3fcf361-2e24-402c-8290-6bc77b1125fa] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:31.226506 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c91873b7-c0ea-43b8-acdb-1aa72df16b9d tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:31.227004 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c91873b7-c0ea-43b8-acdb-1aa72df16b9d tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:31.227446 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c91873b7-c0ea-43b8-acdb-1aa72df16b9d tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:31.228166 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c91873b7-c0ea-43b8-acdb-1aa72df16b9d tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:31.228626 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c91873b7-c0ea-43b8-acdb-1aa72df16b9d tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:31.229053 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c91873b7-c0ea-43b8-acdb-1aa72df16b9d tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:31.761015 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c91873b7-c0ea-43b8-acdb-1aa72df16b9d tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:31.773250 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c91873b7-c0ea-43b8-acdb-1aa72df16b9d tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/f3fcf361-2e24-402c-8290-6bc77b1125fa" status: 200 len: 1517 microversion: 2.1 time: 0.563763 Oct 27 03:44:31.773999 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2583/5453] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:44:31 2022] GET /compute/v2.1/servers/f3fcf361-2e24-402c-8290-6bc77b1125fa => generated 1517 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:44:31.802743 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e51925e6-bed1-4973-8afa-c6b14c8a67fb tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:31.803423 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e51925e6-bed1-4973-8afa-c6b14c8a67fb tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 1db2318e-9ac7-4994-8daa-14ae22537d5d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:31.819920 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e51925e6-bed1-4973-8afa-c6b14c8a67fb tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:31.821040 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e51925e6-bed1-4973-8afa-c6b14c8a67fb tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:31.821495 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e51925e6-bed1-4973-8afa-c6b14c8a67fb tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:31.826576 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e51925e6-bed1-4973-8afa-c6b14c8a67fb tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:31.827075 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e51925e6-bed1-4973-8afa-c6b14c8a67fb tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:31.827526 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e51925e6-bed1-4973-8afa-c6b14c8a67fb tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:32.478635 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e51925e6-bed1-4973-8afa-c6b14c8a67fb tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:32.493467 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e51925e6-bed1-4973-8afa-c6b14c8a67fb tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:32.495392 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e51925e6-bed1-4973-8afa-c6b14c8a67fb tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:32.499606 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e51925e6-bed1-4973-8afa-c6b14c8a67fb tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d" status: 200 len: 1740 microversion: 2.20 time: 0.712307 Oct 27 03:44:32.519167 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2584/5454] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:44:31 2022] GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d => generated 1740 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:44:32.541593 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-4103c1db-003b-46f0-9165-b492e25fd7dc req-a1650f01-145a-40dd-93e9-d91f5015cb8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af90f208-7b8a-4ae4-a654-5fc632279527", "tag": "3697490b-4346-4713-baa7-c8f934701f1a"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:44:32.575715 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-4103c1db-003b-46f0-9165-b492e25fd7dc req-a1650f01-145a-40dd-93e9-d91f5015cb8b service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:32.576505 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-4103c1db-003b-46f0-9165-b492e25fd7dc req-a1650f01-145a-40dd-93e9-d91f5015cb8b service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:32.577143 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-4103c1db-003b-46f0-9165-b492e25fd7dc req-a1650f01-145a-40dd-93e9-d91f5015cb8b service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:32.590374 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:44:32.611222 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-4103c1db-003b-46f0-9165-b492e25fd7dc req-a1650f01-145a-40dd-93e9-d91f5015cb8b service nova] Creating event network-changed:3697490b-4346-4713-baa7-c8f934701f1a for instance af90f208-7b8a-4ae4-a654-5fc632279527 on n-h1-862769-1 Oct 27 03:44:32.623813 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-4103c1db-003b-46f0-9165-b492e25fd7dc req-a1650f01-145a-40dd-93e9-d91f5015cb8b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102517 Oct 27 03:44:32.628262 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2585/5455] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:44:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:44:32.639614 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ea9cde8f-6c54-4b0c-8c23-8a59b9e6109e tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:32.641081 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ea9cde8f-6c54-4b0c-8c23-8a59b9e6109e tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: dbdbec9a-f4bf-4740-ab67-3c8891e341a1] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:32.661793 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ea9cde8f-6c54-4b0c-8c23-8a59b9e6109e tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:32.662527 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ea9cde8f-6c54-4b0c-8c23-8a59b9e6109e tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:32.668389 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ea9cde8f-6c54-4b0c-8c23-8a59b9e6109e tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:32.668389 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ea9cde8f-6c54-4b0c-8c23-8a59b9e6109e tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:32.668389 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ea9cde8f-6c54-4b0c-8c23-8a59b9e6109e tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:32.668389 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ea9cde8f-6c54-4b0c-8c23-8a59b9e6109e tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:33.004123 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ea9cde8f-6c54-4b0c-8c23-8a59b9e6109e tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:33.016615 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ea9cde8f-6c54-4b0c-8c23-8a59b9e6109e tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1" status: 200 len: 1734 microversion: 2.1 time: 0.390472 Oct 27 03:44:33.020586 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2586/5456] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:44:32 2022] GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1 => generated 1734 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:44:33.038239 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8b961b0d-a7b3-49b1-b43b-ffa6ffcb3fd2 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:33.039513 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8b961b0d-a7b3-49b1-b43b-ffa6ffcb3fd2 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: f3fcf361-2e24-402c-8290-6bc77b1125fa] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:33.057018 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8b961b0d-a7b3-49b1-b43b-ffa6ffcb3fd2 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:33.057782 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8b961b0d-a7b3-49b1-b43b-ffa6ffcb3fd2 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:33.059369 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8b961b0d-a7b3-49b1-b43b-ffa6ffcb3fd2 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:33.060288 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8b961b0d-a7b3-49b1-b43b-ffa6ffcb3fd2 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:33.061726 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8b961b0d-a7b3-49b1-b43b-ffa6ffcb3fd2 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:33.062213 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8b961b0d-a7b3-49b1-b43b-ffa6ffcb3fd2 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:34.392767 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8b961b0d-a7b3-49b1-b43b-ffa6ffcb3fd2 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:34.402802 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8b961b0d-a7b3-49b1-b43b-ffa6ffcb3fd2 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/f3fcf361-2e24-402c-8290-6bc77b1125fa" status: 200 len: 1517 microversion: 2.1 time: 1.380881 Oct 27 03:44:34.407743 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2587/5457] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:44:33 2022] GET /compute/v2.1/servers/f3fcf361-2e24-402c-8290-6bc77b1125fa => generated 1517 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:44:34.422668 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3d318251-52f0-4ad0-99ae-3cf1b6ff0987 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:34.423541 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-3d318251-52f0-4ad0-99ae-3cf1b6ff0987 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 1db2318e-9ac7-4994-8daa-14ae22537d5d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:34.450594 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3d318251-52f0-4ad0-99ae-3cf1b6ff0987 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:34.451108 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3d318251-52f0-4ad0-99ae-3cf1b6ff0987 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:34.455128 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3d318251-52f0-4ad0-99ae-3cf1b6ff0987 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:34.455128 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3d318251-52f0-4ad0-99ae-3cf1b6ff0987 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:34.455128 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3d318251-52f0-4ad0-99ae-3cf1b6ff0987 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:34.455128 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3d318251-52f0-4ad0-99ae-3cf1b6ff0987 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:35.255568 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-3d318251-52f0-4ad0-99ae-3cf1b6ff0987 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:35.271401 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-3d318251-52f0-4ad0-99ae-3cf1b6ff0987 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:35.277495 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-3d318251-52f0-4ad0-99ae-3cf1b6ff0987 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:35.279324 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3d318251-52f0-4ad0-99ae-3cf1b6ff0987 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d" status: 200 len: 1740 microversion: 2.20 time: 0.871508 Oct 27 03:44:35.280990 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2588/5458] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:44:34 2022] GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d => generated 1740 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:44:35.288821 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-cab24fc3-9903-4fde-9039-0babda070dbc tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:35.292070 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-cab24fc3-9903-4fde-9039-0babda070dbc tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: dbdbec9a-f4bf-4740-ab67-3c8891e341a1] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:35.330554 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cab24fc3-9903-4fde-9039-0babda070dbc tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:35.333505 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cab24fc3-9903-4fde-9039-0babda070dbc tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:35.334262 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cab24fc3-9903-4fde-9039-0babda070dbc tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:35.336108 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cab24fc3-9903-4fde-9039-0babda070dbc tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:35.341406 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cab24fc3-9903-4fde-9039-0babda070dbc tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:35.343234 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cab24fc3-9903-4fde-9039-0babda070dbc tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:35.856684 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-cab24fc3-9903-4fde-9039-0babda070dbc tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:35.878405 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-cab24fc3-9903-4fde-9039-0babda070dbc tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1" status: 200 len: 1734 microversion: 2.1 time: 0.594091 Oct 27 03:44:35.884688 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2589/5459] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:44:35 2022] GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1 => generated 1734 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:44:35.974887 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1f11b249-715d-4d03-a008-69642db6fb4c tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:35.974887 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1f11b249-715d-4d03-a008-69642db6fb4c tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: f3fcf361-2e24-402c-8290-6bc77b1125fa] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:35.974887 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1f11b249-715d-4d03-a008-69642db6fb4c tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:35.974887 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1f11b249-715d-4d03-a008-69642db6fb4c tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:35.974887 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1f11b249-715d-4d03-a008-69642db6fb4c tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:35.974887 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1f11b249-715d-4d03-a008-69642db6fb4c tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:35.974887 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1f11b249-715d-4d03-a008-69642db6fb4c tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:35.974887 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1f11b249-715d-4d03-a008-69642db6fb4c tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:36.525547 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1f11b249-715d-4d03-a008-69642db6fb4c tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:36.546934 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1f11b249-715d-4d03-a008-69642db6fb4c tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/f3fcf361-2e24-402c-8290-6bc77b1125fa" status: 200 len: 1517 microversion: 2.1 time: 0.657710 Oct 27 03:44:36.548591 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2590/5460] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:44:35 2022] GET /compute/v2.1/servers/f3fcf361-2e24-402c-8290-6bc77b1125fa => generated 1517 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:44:36.568121 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-bb5d52ec-5b3e-409f-a6fd-f56529d9a8e5 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:36.568961 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-bb5d52ec-5b3e-409f-a6fd-f56529d9a8e5 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 1db2318e-9ac7-4994-8daa-14ae22537d5d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:36.592910 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bb5d52ec-5b3e-409f-a6fd-f56529d9a8e5 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:36.594709 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bb5d52ec-5b3e-409f-a6fd-f56529d9a8e5 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:36.599443 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bb5d52ec-5b3e-409f-a6fd-f56529d9a8e5 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:36.600415 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bb5d52ec-5b3e-409f-a6fd-f56529d9a8e5 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:36.606004 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bb5d52ec-5b3e-409f-a6fd-f56529d9a8e5 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:36.606759 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bb5d52ec-5b3e-409f-a6fd-f56529d9a8e5 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:36.963714 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5c20354e-7502-4027-b8e6-d73ecbc44f3b tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 6.515976 Oct 27 03:44:37.100726 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2871/5461] 10.222.0.20 () {60 vars in 1170 bytes} [Thu Oct 27 03:44:30 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 6518 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:44:37.100726 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-88c41632-0d1e-4c66-948b-62efac72fdf7 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:37.100726 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-88c41632-0d1e-4c66-948b-62efac72fdf7 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: dbdbec9a-f4bf-4740-ab67-3c8891e341a1] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:37.100726 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-88c41632-0d1e-4c66-948b-62efac72fdf7 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:37.100726 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-88c41632-0d1e-4c66-948b-62efac72fdf7 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:37.100726 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-88c41632-0d1e-4c66-948b-62efac72fdf7 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:37.100726 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-88c41632-0d1e-4c66-948b-62efac72fdf7 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:37.100726 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-88c41632-0d1e-4c66-948b-62efac72fdf7 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:37.100726 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-88c41632-0d1e-4c66-948b-62efac72fdf7 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:37.144976 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-bb5d52ec-5b3e-409f-a6fd-f56529d9a8e5 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:37.176698 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-bb5d52ec-5b3e-409f-a6fd-f56529d9a8e5 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:37.194356 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-88c41632-0d1e-4c66-948b-62efac72fdf7 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:37.197278 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-bb5d52ec-5b3e-409f-a6fd-f56529d9a8e5 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:37.198770 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-bb5d52ec-5b3e-409f-a6fd-f56529d9a8e5 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d" status: 200 len: 1740 microversion: 2.20 time: 0.648995 Oct 27 03:44:37.200446 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2591/5462] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:44:36 2022] GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d => generated 1740 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:44:37.219795 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-201b472e-d209-44c2-b8fb-e5fec52c7779 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.6.195"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:44:37.229495 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-201b472e-d209-44c2-b8fb-e5fec52c7779 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] [instance: af90f208-7b8a-4ae4-a654-5fc632279527] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:37.238290 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-201b472e-d209-44c2-b8fb-e5fec52c7779 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:37.239395 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-88c41632-0d1e-4c66-948b-62efac72fdf7 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1" status: 200 len: 1734 microversion: 2.1 time: 0.272741 Oct 27 03:44:37.239553 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-201b472e-d209-44c2-b8fb-e5fec52c7779 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:37.240011 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-201b472e-d209-44c2-b8fb-e5fec52c7779 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:37.240742 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-201b472e-d209-44c2-b8fb-e5fec52c7779 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:37.241448 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-201b472e-d209-44c2-b8fb-e5fec52c7779 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:37.242101 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-201b472e-d209-44c2-b8fb-e5fec52c7779 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:37.260443 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2872/5463] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:44:36 2022] GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1 => generated 1734 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:44:37.290500 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-201b472e-d209-44c2-b8fb-e5fec52c7779 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Acquiring lock "refresh_cache-af90f208-7b8a-4ae4-a654-5fc632279527" {{(pid=121000) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 27 03:44:37.292653 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-201b472e-d209-44c2-b8fb-e5fec52c7779 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Acquired lock "refresh_cache-af90f208-7b8a-4ae4-a654-5fc632279527" {{(pid=121000) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 27 03:44:37.581134 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e4f2bf80-3b23-4cdf-9549-b6de7cc39f84 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:37.582765 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e4f2bf80-3b23-4cdf-9549-b6de7cc39f84 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: f3fcf361-2e24-402c-8290-6bc77b1125fa] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:37.593952 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e4f2bf80-3b23-4cdf-9549-b6de7cc39f84 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:37.594185 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e4f2bf80-3b23-4cdf-9549-b6de7cc39f84 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:37.601743 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e4f2bf80-3b23-4cdf-9549-b6de7cc39f84 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:37.603304 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e4f2bf80-3b23-4cdf-9549-b6de7cc39f84 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:37.604375 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e4f2bf80-3b23-4cdf-9549-b6de7cc39f84 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:37.605729 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e4f2bf80-3b23-4cdf-9549-b6de7cc39f84 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:37.857241 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e4f2bf80-3b23-4cdf-9549-b6de7cc39f84 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:37.871174 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e4f2bf80-3b23-4cdf-9549-b6de7cc39f84 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/f3fcf361-2e24-402c-8290-6bc77b1125fa" status: 200 len: 1517 microversion: 2.1 time: 0.296176 Oct 27 03:44:37.874010 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2873/5464] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:44:37 2022] GET /compute/v2.1/servers/f3fcf361-2e24-402c-8290-6bc77b1125fa => generated 1517 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:44:37.954392 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7340d7a1-00f1-413a-9f4c-3dcda335ce77 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:37.957390 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7340d7a1-00f1-413a-9f4c-3dcda335ce77 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: ce85aa86-fbba-4eca-97e8-173da3cdc7c3] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:37.983015 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7340d7a1-00f1-413a-9f4c-3dcda335ce77 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:37.983650 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7340d7a1-00f1-413a-9f4c-3dcda335ce77 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:37.983996 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7340d7a1-00f1-413a-9f4c-3dcda335ce77 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:37.984741 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7340d7a1-00f1-413a-9f4c-3dcda335ce77 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:37.997638 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7340d7a1-00f1-413a-9f4c-3dcda335ce77 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:37.998464 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7340d7a1-00f1-413a-9f4c-3dcda335ce77 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:38.074796 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7340d7a1-00f1-413a-9f4c-3dcda335ce77 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "GET /compute/v2.1/servers/ce85aa86-fbba-4eca-97e8-173da3cdc7c3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.127390 Oct 27 03:44:38.076218 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2874/5465] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 27 03:44:37 2022] GET /compute/v2.1/servers/ce85aa86-fbba-4eca-97e8-173da3cdc7c3/os-volume_attachments => generated 25 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 03:44:38.231550 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-de158841-f740-4660-88db-c5559c88714b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:38.232740 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-de158841-f740-4660-88db-c5559c88714b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 1db2318e-9ac7-4994-8daa-14ae22537d5d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:38.259401 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-de158841-f740-4660-88db-c5559c88714b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:38.260178 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-de158841-f740-4660-88db-c5559c88714b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:38.260803 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-de158841-f740-4660-88db-c5559c88714b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:38.261699 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-de158841-f740-4660-88db-c5559c88714b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:38.263125 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-de158841-f740-4660-88db-c5559c88714b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:38.265477 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-de158841-f740-4660-88db-c5559c88714b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:38.695774 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-de158841-f740-4660-88db-c5559c88714b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:38.706938 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-de158841-f740-4660-88db-c5559c88714b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:38.708465 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-de158841-f740-4660-88db-c5559c88714b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:38.709722 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-de158841-f740-4660-88db-c5559c88714b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d" status: 200 len: 1740 microversion: 2.20 time: 0.482470 Oct 27 03:44:38.710347 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2875/5466] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:44:38 2022] GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d => generated 1740 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:44:38.722753 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f1691700-9d4c-41a6-bf4d-7e90f8ab8ed8 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:38.734987 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f1691700-9d4c-41a6-bf4d-7e90f8ab8ed8 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: dbdbec9a-f4bf-4740-ab67-3c8891e341a1] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:38.741617 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f1691700-9d4c-41a6-bf4d-7e90f8ab8ed8 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:38.742383 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f1691700-9d4c-41a6-bf4d-7e90f8ab8ed8 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:38.743005 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f1691700-9d4c-41a6-bf4d-7e90f8ab8ed8 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:38.743908 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f1691700-9d4c-41a6-bf4d-7e90f8ab8ed8 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:38.754858 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f1691700-9d4c-41a6-bf4d-7e90f8ab8ed8 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:38.755730 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f1691700-9d4c-41a6-bf4d-7e90f8ab8ed8 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:39.016382 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f1691700-9d4c-41a6-bf4d-7e90f8ab8ed8 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:39.028085 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f1691700-9d4c-41a6-bf4d-7e90f8ab8ed8 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1" status: 200 len: 1734 microversion: 2.1 time: 0.309709 Oct 27 03:44:39.048633 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2876/5467] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:44:38 2022] GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1 => generated 1734 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:44:39.056519 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b0c290b9-db93-445a-91a3-bda780e0c0a5 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:39.059477 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b0c290b9-db93-445a-91a3-bda780e0c0a5 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: ce85aa86-fbba-4eca-97e8-173da3cdc7c3] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:39.065680 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b0c290b9-db93-445a-91a3-bda780e0c0a5 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:39.067829 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b0c290b9-db93-445a-91a3-bda780e0c0a5 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:39.067829 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b0c290b9-db93-445a-91a3-bda780e0c0a5 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:39.068275 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b0c290b9-db93-445a-91a3-bda780e0c0a5 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:39.069107 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b0c290b9-db93-445a-91a3-bda780e0c0a5 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:39.069726 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b0c290b9-db93-445a-91a3-bda780e0c0a5 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:39.108022 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b0c290b9-db93-445a-91a3-bda780e0c0a5 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "GET /compute/v2.1/servers/ce85aa86-fbba-4eca-97e8-173da3cdc7c3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058140 Oct 27 03:44:39.109389 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2877/5468] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 27 03:44:39 2022] GET /compute/v2.1/servers/ce85aa86-fbba-4eca-97e8-173da3cdc7c3/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 03:44:39.127183 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ada3f271-8663-48ad-984b-a57843cab584 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:39.137954 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ada3f271-8663-48ad-984b-a57843cab584 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: f3fcf361-2e24-402c-8290-6bc77b1125fa] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:39.145224 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ada3f271-8663-48ad-984b-a57843cab584 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:39.148060 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ada3f271-8663-48ad-984b-a57843cab584 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:39.149178 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ada3f271-8663-48ad-984b-a57843cab584 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:39.153641 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ada3f271-8663-48ad-984b-a57843cab584 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:39.154520 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ada3f271-8663-48ad-984b-a57843cab584 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:39.155203 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ada3f271-8663-48ad-984b-a57843cab584 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:39.374618 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ada3f271-8663-48ad-984b-a57843cab584 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:39.385675 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ada3f271-8663-48ad-984b-a57843cab584 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/f3fcf361-2e24-402c-8290-6bc77b1125fa" status: 200 len: 1517 microversion: 2.1 time: 0.274929 Oct 27 03:44:39.399805 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2878/5469] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:44:39 2022] GET /compute/v2.1/servers/f3fcf361-2e24-402c-8290-6bc77b1125fa => generated 1517 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:44:39.411485 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8550afa4-4d9b-4bce-b981-b3c5c022f650 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:39.412576 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8550afa4-4d9b-4bce-b981-b3c5c022f650 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: ce85aa86-fbba-4eca-97e8-173da3cdc7c3] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:39.421047 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8550afa4-4d9b-4bce-b981-b3c5c022f650 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:39.421921 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8550afa4-4d9b-4bce-b981-b3c5c022f650 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:39.422640 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8550afa4-4d9b-4bce-b981-b3c5c022f650 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:39.423593 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8550afa4-4d9b-4bce-b981-b3c5c022f650 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:39.424334 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8550afa4-4d9b-4bce-b981-b3c5c022f650 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:39.424988 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8550afa4-4d9b-4bce-b981-b3c5c022f650 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:39.470018 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8550afa4-4d9b-4bce-b981-b3c5c022f650 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: ce85aa86-fbba-4eca-97e8-173da3cdc7c3] Going to try to terminate instance {{(pid=121001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:44:39.953050 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8550afa4-4d9b-4bce-b981-b3c5c022f650 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ce85aa86-fbba-4eca-97e8-173da3cdc7c3" status: 204 len: 0 microversion: 2.1 time: 0.551390 Oct 27 03:44:39.958489 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2879/5470] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:44:39 2022] DELETE /compute/v2.1/servers/ce85aa86-fbba-4eca-97e8-173da3cdc7c3 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:44:39.980487 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-51312a8b-5798-4727-94a1-877feb87713a tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:39.982646 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-51312a8b-5798-4727-94a1-877feb87713a tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 1db2318e-9ac7-4994-8daa-14ae22537d5d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:40.001663 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-51312a8b-5798-4727-94a1-877feb87713a tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:40.006386 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-51312a8b-5798-4727-94a1-877feb87713a tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:40.006386 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-51312a8b-5798-4727-94a1-877feb87713a tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:40.006386 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-51312a8b-5798-4727-94a1-877feb87713a tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:40.006386 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-51312a8b-5798-4727-94a1-877feb87713a tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:40.010573 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-51312a8b-5798-4727-94a1-877feb87713a tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:40.367613 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-51312a8b-5798-4727-94a1-877feb87713a tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:40.381893 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-51312a8b-5798-4727-94a1-877feb87713a tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:40.389295 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-51312a8b-5798-4727-94a1-877feb87713a tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:40.396201 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-51312a8b-5798-4727-94a1-877feb87713a tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d" status: 200 len: 1740 microversion: 2.20 time: 0.436029 Oct 27 03:44:40.408956 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2880/5471] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:44:39 2022] GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d => generated 1740 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:44:40.429719 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0636b7ca-e682-481e-8682-fc826b235924 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:40.435691 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0636b7ca-e682-481e-8682-fc826b235924 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: ce85aa86-fbba-4eca-97e8-173da3cdc7c3] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:40.444283 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-201b472e-d209-44c2-b8fb-e5fec52c7779 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] [instance: af90f208-7b8a-4ae4-a654-5fc632279527] Building network info cache for instance {{(pid=121000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 27 03:44:40.450988 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:44:40.455782 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0636b7ca-e682-481e-8682-fc826b235924 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:40.457259 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0636b7ca-e682-481e-8682-fc826b235924 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:40.462672 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0636b7ca-e682-481e-8682-fc826b235924 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:40.467680 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0636b7ca-e682-481e-8682-fc826b235924 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:40.467680 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0636b7ca-e682-481e-8682-fc826b235924 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:40.467680 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0636b7ca-e682-481e-8682-fc826b235924 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:40.813249 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0636b7ca-e682-481e-8682-fc826b235924 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffc2b1c410149e884a47240b5425e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38450368ef5c4e68ac3c19c7a0a1ce65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:40.826278 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0636b7ca-e682-481e-8682-fc826b235924 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "GET /compute/v2.1/servers/ce85aa86-fbba-4eca-97e8-173da3cdc7c3" status: 200 len: 1671 microversion: 2.1 time: 0.415968 Oct 27 03:44:40.843324 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2881/5472] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:44:40 2022] GET /compute/v2.1/servers/ce85aa86-fbba-4eca-97e8-173da3cdc7c3 => generated 1671 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:44:40.857934 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a17c5052-19ce-40c0-91a3-962f33812afc tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:40.860302 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a17c5052-19ce-40c0-91a3-962f33812afc tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: dbdbec9a-f4bf-4740-ab67-3c8891e341a1] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:40.872566 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a17c5052-19ce-40c0-91a3-962f33812afc tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:40.873931 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a17c5052-19ce-40c0-91a3-962f33812afc tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:40.875191 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a17c5052-19ce-40c0-91a3-962f33812afc tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:40.876662 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a17c5052-19ce-40c0-91a3-962f33812afc tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:40.877330 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a17c5052-19ce-40c0-91a3-962f33812afc tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:40.878096 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a17c5052-19ce-40c0-91a3-962f33812afc tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:41.210079 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a17c5052-19ce-40c0-91a3-962f33812afc tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:41.225227 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a17c5052-19ce-40c0-91a3-962f33812afc tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1" status: 200 len: 1734 microversion: 2.1 time: 0.380302 Oct 27 03:44:41.229030 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2882/5473] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:44:40 2022] GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1 => generated 1734 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:44:41.246319 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f4ca95b6-1b0c-4ebc-a3a3-d9bb1199ec05 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:41.247398 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f4ca95b6-1b0c-4ebc-a3a3-d9bb1199ec05 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: f3fcf361-2e24-402c-8290-6bc77b1125fa] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:41.262163 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f4ca95b6-1b0c-4ebc-a3a3-d9bb1199ec05 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:41.264305 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f4ca95b6-1b0c-4ebc-a3a3-d9bb1199ec05 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:41.265019 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f4ca95b6-1b0c-4ebc-a3a3-d9bb1199ec05 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:41.275758 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f4ca95b6-1b0c-4ebc-a3a3-d9bb1199ec05 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:41.276677 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f4ca95b6-1b0c-4ebc-a3a3-d9bb1199ec05 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:41.278081 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f4ca95b6-1b0c-4ebc-a3a3-d9bb1199ec05 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:41.519761 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-201b472e-d209-44c2-b8fb-e5fec52c7779 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] [instance: af90f208-7b8a-4ae4-a654-5fc632279527] Updating instance_info_cache with network_info: [{"id": "3697490b-4346-4713-baa7-c8f934701f1a", "address": "fa:16:3e:41:c9:0e", "network": {"id": "3784a63d-0c1a-4444-9ee2-139a9d54618f", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-874001350-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.6.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e4f0730b38a946759ea32c36f5876eb3", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap3697490b-43", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=121000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 27 03:44:41.618164 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-201b472e-d209-44c2-b8fb-e5fec52c7779 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Releasing lock "refresh_cache-af90f208-7b8a-4ae4-a654-5fc632279527" {{(pid=121000) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 27 03:44:41.619492 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-201b472e-d209-44c2-b8fb-e5fec52c7779 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] 10.222.0.20 "POST /compute/v2.1/servers/af90f208-7b8a-4ae4-a654-5fc632279527/action" status: 202 len: 0 microversion: 2.1 time: 4.417760 Oct 27 03:44:41.620353 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2592/5474] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:44:37 2022] POST /compute/v2.1/servers/af90f208-7b8a-4ae4-a654-5fc632279527/action => generated 0 bytes in 4419 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 27 03:44:41.629513 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-54e3943c-5259-483b-8c75-1e9690055b63 req-d2614cf7-df8d-421e-9db2-031a7d345c7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af90f208-7b8a-4ae4-a654-5fc632279527", "tag": "3697490b-4346-4713-baa7-c8f934701f1a"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:44:41.652619 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-54e3943c-5259-483b-8c75-1e9690055b63 req-d2614cf7-df8d-421e-9db2-031a7d345c7b service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:41.656338 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-54e3943c-5259-483b-8c75-1e9690055b63 req-d2614cf7-df8d-421e-9db2-031a7d345c7b service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:41.658937 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-54e3943c-5259-483b-8c75-1e9690055b63 req-d2614cf7-df8d-421e-9db2-031a7d345c7b service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:41.683742 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-54e3943c-5259-483b-8c75-1e9690055b63 req-d2614cf7-df8d-421e-9db2-031a7d345c7b service nova] Creating event network-changed:3697490b-4346-4713-baa7-c8f934701f1a for instance af90f208-7b8a-4ae4-a654-5fc632279527 on n-h1-862769-1 Oct 27 03:44:41.697927 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-54e3943c-5259-483b-8c75-1e9690055b63 req-d2614cf7-df8d-421e-9db2-031a7d345c7b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073509 Oct 27 03:44:41.700615 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2593/5475] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:44:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:44:41.715762 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7e6aef76-b8b7-4581-82b5-8a5d656667a6 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:41.724054 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7e6aef76-b8b7-4581-82b5-8a5d656667a6 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 1db2318e-9ac7-4994-8daa-14ae22537d5d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:41.734133 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7e6aef76-b8b7-4581-82b5-8a5d656667a6 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:41.734623 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7e6aef76-b8b7-4581-82b5-8a5d656667a6 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:41.735092 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7e6aef76-b8b7-4581-82b5-8a5d656667a6 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:41.735973 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7e6aef76-b8b7-4581-82b5-8a5d656667a6 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:41.746460 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7e6aef76-b8b7-4581-82b5-8a5d656667a6 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:41.747263 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7e6aef76-b8b7-4581-82b5-8a5d656667a6 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:41.896946 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f4ca95b6-1b0c-4ebc-a3a3-d9bb1199ec05 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:41.907093 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f4ca95b6-1b0c-4ebc-a3a3-d9bb1199ec05 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/f3fcf361-2e24-402c-8290-6bc77b1125fa" status: 200 len: 1517 microversion: 2.1 time: 0.676033 Oct 27 03:44:41.928370 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2883/5476] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:44:41 2022] GET /compute/v2.1/servers/f3fcf361-2e24-402c-8290-6bc77b1125fa => generated 1517 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:44:41.943510 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4104c35e-9bde-443a-b491-b18cca0e74d2 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.6.195"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:44:42.272514 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7e6aef76-b8b7-4581-82b5-8a5d656667a6 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:42.288488 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7e6aef76-b8b7-4581-82b5-8a5d656667a6 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:42.291464 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7e6aef76-b8b7-4581-82b5-8a5d656667a6 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:42.295205 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7e6aef76-b8b7-4581-82b5-8a5d656667a6 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d" status: 200 len: 1740 microversion: 2.20 time: 0.593068 Oct 27 03:44:42.297584 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2594/5477] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:44:41 2022] GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d => generated 1740 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:44:42.324797 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e03be736-98b3-4938-aea1-44cd63041fcf tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:42.327026 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e03be736-98b3-4938-aea1-44cd63041fcf tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: ce85aa86-fbba-4eca-97e8-173da3cdc7c3] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:42.346536 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e03be736-98b3-4938-aea1-44cd63041fcf tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:42.350019 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e03be736-98b3-4938-aea1-44cd63041fcf tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:42.350019 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e03be736-98b3-4938-aea1-44cd63041fcf tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:42.350019 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e03be736-98b3-4938-aea1-44cd63041fcf tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:42.355328 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e03be736-98b3-4938-aea1-44cd63041fcf tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:42.357438 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e03be736-98b3-4938-aea1-44cd63041fcf tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:42.741749 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4104c35e-9bde-443a-b491-b18cca0e74d2 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] [instance: af90f208-7b8a-4ae4-a654-5fc632279527] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:42.749076 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4104c35e-9bde-443a-b491-b18cca0e74d2 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:42.749592 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4104c35e-9bde-443a-b491-b18cca0e74d2 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:42.750068 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4104c35e-9bde-443a-b491-b18cca0e74d2 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:42.750813 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4104c35e-9bde-443a-b491-b18cca0e74d2 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:42.751287 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4104c35e-9bde-443a-b491-b18cca0e74d2 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:42.751732 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4104c35e-9bde-443a-b491-b18cca0e74d2 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:42.902966 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e03be736-98b3-4938-aea1-44cd63041fcf tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffc2b1c410149e884a47240b5425e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38450368ef5c4e68ac3c19c7a0a1ce65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:42.915961 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e03be736-98b3-4938-aea1-44cd63041fcf tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "GET /compute/v2.1/servers/ce85aa86-fbba-4eca-97e8-173da3cdc7c3" status: 200 len: 1671 microversion: 2.1 time: 0.615651 Oct 27 03:44:42.916913 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2595/5478] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:44:42 2022] GET /compute/v2.1/servers/ce85aa86-fbba-4eca-97e8-173da3cdc7c3 => generated 1671 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:44:42.942150 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-cb57735b-18cf-4593-ae08-a215a797056a tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:42.946743 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-cb57735b-18cf-4593-ae08-a215a797056a tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: dbdbec9a-f4bf-4740-ab67-3c8891e341a1] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:42.950601 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cb57735b-18cf-4593-ae08-a215a797056a tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:42.951300 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cb57735b-18cf-4593-ae08-a215a797056a tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:42.951953 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cb57735b-18cf-4593-ae08-a215a797056a tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:42.952881 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cb57735b-18cf-4593-ae08-a215a797056a tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:42.953625 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cb57735b-18cf-4593-ae08-a215a797056a tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:42.954272 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cb57735b-18cf-4593-ae08-a215a797056a tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:43.477922 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4104c35e-9bde-443a-b491-b18cca0e74d2 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Acquiring lock "refresh_cache-af90f208-7b8a-4ae4-a654-5fc632279527" {{(pid=121001) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 27 03:44:43.478971 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4104c35e-9bde-443a-b491-b18cca0e74d2 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Acquired lock "refresh_cache-af90f208-7b8a-4ae4-a654-5fc632279527" {{(pid=121001) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 27 03:44:43.539677 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-cb57735b-18cf-4593-ae08-a215a797056a tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:43.559206 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-cb57735b-18cf-4593-ae08-a215a797056a tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1" status: 200 len: 1734 microversion: 2.1 time: 0.619817 Oct 27 03:44:43.559206 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2596/5479] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:44:42 2022] GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1 => generated 1734 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:44:43.582867 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7b8eae9a-8295-406a-a9dd-4ee6877371fb tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:43.584897 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7b8eae9a-8295-406a-a9dd-4ee6877371fb tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: f3fcf361-2e24-402c-8290-6bc77b1125fa] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:43.616580 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7b8eae9a-8295-406a-a9dd-4ee6877371fb tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:43.619458 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7b8eae9a-8295-406a-a9dd-4ee6877371fb tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:43.621361 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7b8eae9a-8295-406a-a9dd-4ee6877371fb tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:43.622235 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7b8eae9a-8295-406a-a9dd-4ee6877371fb tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:43.627849 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7b8eae9a-8295-406a-a9dd-4ee6877371fb tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:43.628360 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7b8eae9a-8295-406a-a9dd-4ee6877371fb tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:44.398544 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7b8eae9a-8295-406a-a9dd-4ee6877371fb tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:44.419892 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7b8eae9a-8295-406a-a9dd-4ee6877371fb tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/f3fcf361-2e24-402c-8290-6bc77b1125fa" status: 200 len: 1517 microversion: 2.1 time: 0.847502 Oct 27 03:44:44.441991 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2597/5480] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:44:43 2022] GET /compute/v2.1/servers/f3fcf361-2e24-402c-8290-6bc77b1125fa => generated 1517 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:44:44.463751 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-52226fc9-0ac7-46ab-a219-85db2c3dc6b6 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:44.466850 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-52226fc9-0ac7-46ab-a219-85db2c3dc6b6 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 1db2318e-9ac7-4994-8daa-14ae22537d5d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:44.470391 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=82 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:44:44.477692 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-52226fc9-0ac7-46ab-a219-85db2c3dc6b6 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:44.478244 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-52226fc9-0ac7-46ab-a219-85db2c3dc6b6 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:44.478781 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-52226fc9-0ac7-46ab-a219-85db2c3dc6b6 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:44.479506 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-52226fc9-0ac7-46ab-a219-85db2c3dc6b6 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:44.479999 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-52226fc9-0ac7-46ab-a219-85db2c3dc6b6 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:44.480408 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-52226fc9-0ac7-46ab-a219-85db2c3dc6b6 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:44.923962 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-52226fc9-0ac7-46ab-a219-85db2c3dc6b6 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:44.933249 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-52226fc9-0ac7-46ab-a219-85db2c3dc6b6 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:44.935079 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-52226fc9-0ac7-46ab-a219-85db2c3dc6b6 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:44.936332 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-52226fc9-0ac7-46ab-a219-85db2c3dc6b6 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d" status: 200 len: 1740 microversion: 2.20 time: 0.493190 Oct 27 03:44:44.937396 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2598/5481] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:44:44 2022] GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d => generated 1740 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:44:44.942872 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-daefaddb-290d-468a-9c3e-7c980bb570ab tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:44.943715 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-daefaddb-290d-468a-9c3e-7c980bb570ab tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: ce85aa86-fbba-4eca-97e8-173da3cdc7c3] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:44.950464 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-daefaddb-290d-468a-9c3e-7c980bb570ab tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:44.951188 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-daefaddb-290d-468a-9c3e-7c980bb570ab tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:44.951808 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-daefaddb-290d-468a-9c3e-7c980bb570ab tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:44.952693 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-daefaddb-290d-468a-9c3e-7c980bb570ab tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:44.953305 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-daefaddb-290d-468a-9c3e-7c980bb570ab tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:44.953898 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-daefaddb-290d-468a-9c3e-7c980bb570ab tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:45.026265 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-daefaddb-290d-468a-9c3e-7c980bb570ab tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffc2b1c410149e884a47240b5425e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38450368ef5c4e68ac3c19c7a0a1ce65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:45.041569 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-daefaddb-290d-468a-9c3e-7c980bb570ab tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "GET /compute/v2.1/servers/ce85aa86-fbba-4eca-97e8-173da3cdc7c3" status: 200 len: 1603 microversion: 2.1 time: 0.102803 Oct 27 03:44:45.047895 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2599/5482] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:44:44 2022] GET /compute/v2.1/servers/ce85aa86-fbba-4eca-97e8-173da3cdc7c3 => generated 1603 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:44:45.076376 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-588ce067-2a2b-4c25-8bd4-acc14eb8fab1 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:45.078232 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-588ce067-2a2b-4c25-8bd4-acc14eb8fab1 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: dbdbec9a-f4bf-4740-ab67-3c8891e341a1] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:45.091280 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-588ce067-2a2b-4c25-8bd4-acc14eb8fab1 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:45.092060 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-588ce067-2a2b-4c25-8bd4-acc14eb8fab1 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:45.092690 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-588ce067-2a2b-4c25-8bd4-acc14eb8fab1 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:45.093592 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-588ce067-2a2b-4c25-8bd4-acc14eb8fab1 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:45.094247 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-588ce067-2a2b-4c25-8bd4-acc14eb8fab1 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:45.094853 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-588ce067-2a2b-4c25-8bd4-acc14eb8fab1 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:45.769125 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-588ce067-2a2b-4c25-8bd4-acc14eb8fab1 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:45.785882 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-588ce067-2a2b-4c25-8bd4-acc14eb8fab1 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1" status: 200 len: 1734 microversion: 2.1 time: 0.733748 Oct 27 03:44:45.795032 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2600/5483] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:44:45 2022] GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1 => generated 1734 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:44:45.817551 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-df190cdb-e68c-4d00-9fd9-65a22d3e52a8 req-2a399b78-c80a-43e8-b649-93ff75e3b321 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce85aa86-fbba-4eca-97e8-173da3cdc7c3", "name": "network-vif-deleted", "tag": "7a4318fe-6fd1-4b83-9550-ccdb4f022ef2"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:44:45.855853 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-df190cdb-e68c-4d00-9fd9-65a22d3e52a8 req-2a399b78-c80a-43e8-b649-93ff75e3b321 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:45.856426 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-df190cdb-e68c-4d00-9fd9-65a22d3e52a8 req-2a399b78-c80a-43e8-b649-93ff75e3b321 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:45.857059 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-df190cdb-e68c-4d00-9fd9-65a22d3e52a8 req-2a399b78-c80a-43e8-b649-93ff75e3b321 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:45.895545 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-df190cdb-e68c-4d00-9fd9-65a22d3e52a8 req-2a399b78-c80a-43e8-b649-93ff75e3b321 service nova] Creating event network-vif-deleted:7a4318fe-6fd1-4b83-9550-ccdb4f022ef2 for instance ce85aa86-fbba-4eca-97e8-173da3cdc7c3 on n-h1-862769-1 Oct 27 03:44:45.912686 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-df190cdb-e68c-4d00-9fd9-65a22d3e52a8 req-2a399b78-c80a-43e8-b649-93ff75e3b321 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112247 Oct 27 03:44:45.913950 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2601/5484] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:44:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:44:45.930778 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1efc3342-2f9b-43b2-8e2f-0e1587f0419c tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:45.934632 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1efc3342-2f9b-43b2-8e2f-0e1587f0419c tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: f3fcf361-2e24-402c-8290-6bc77b1125fa] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:45.952463 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1efc3342-2f9b-43b2-8e2f-0e1587f0419c tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:45.954528 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1efc3342-2f9b-43b2-8e2f-0e1587f0419c tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:45.955230 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1efc3342-2f9b-43b2-8e2f-0e1587f0419c tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:45.958407 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1efc3342-2f9b-43b2-8e2f-0e1587f0419c tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:45.959159 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1efc3342-2f9b-43b2-8e2f-0e1587f0419c tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:45.960732 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1efc3342-2f9b-43b2-8e2f-0e1587f0419c tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:46.351536 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1efc3342-2f9b-43b2-8e2f-0e1587f0419c tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:46.382436 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1efc3342-2f9b-43b2-8e2f-0e1587f0419c tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/f3fcf361-2e24-402c-8290-6bc77b1125fa" status: 200 len: 1517 microversion: 2.1 time: 0.463296 Oct 27 03:44:46.385783 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2602/5485] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:44:45 2022] GET /compute/v2.1/servers/f3fcf361-2e24-402c-8290-6bc77b1125fa => generated 1517 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:44:46.394994 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2c8f1e60-3ebd-42b6-9a93-bac5fa896ad2 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:46.397577 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-2c8f1e60-3ebd-42b6-9a93-bac5fa896ad2 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 1db2318e-9ac7-4994-8daa-14ae22537d5d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:46.418571 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2c8f1e60-3ebd-42b6-9a93-bac5fa896ad2 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:46.419795 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2c8f1e60-3ebd-42b6-9a93-bac5fa896ad2 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:46.423145 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2c8f1e60-3ebd-42b6-9a93-bac5fa896ad2 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:46.424278 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2c8f1e60-3ebd-42b6-9a93-bac5fa896ad2 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:46.425595 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2c8f1e60-3ebd-42b6-9a93-bac5fa896ad2 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:46.426292 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2c8f1e60-3ebd-42b6-9a93-bac5fa896ad2 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:46.437566 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:44:46.473288 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.network.neutron [None req-4104c35e-9bde-443a-b491-b18cca0e74d2 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] [instance: af90f208-7b8a-4ae4-a654-5fc632279527] Building network info cache for instance {{(pid=121001) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 27 03:44:46.780493 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2c8f1e60-3ebd-42b6-9a93-bac5fa896ad2 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:46.794565 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2c8f1e60-3ebd-42b6-9a93-bac5fa896ad2 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:46.798733 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2c8f1e60-3ebd-42b6-9a93-bac5fa896ad2 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:46.800902 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2c8f1e60-3ebd-42b6-9a93-bac5fa896ad2 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d" status: 200 len: 1740 microversion: 2.20 time: 0.413812 Oct 27 03:44:46.806056 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2603/5486] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:44:46 2022] GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d => generated 1740 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:44:46.824093 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0db66fbb-bb45-4dd9-abdf-106b1ae07540 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:46.835294 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0db66fbb-bb45-4dd9-abdf-106b1ae07540 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: ce85aa86-fbba-4eca-97e8-173da3cdc7c3] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:46.857261 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0db66fbb-bb45-4dd9-abdf-106b1ae07540 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:46.859028 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0db66fbb-bb45-4dd9-abdf-106b1ae07540 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:46.863317 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0db66fbb-bb45-4dd9-abdf-106b1ae07540 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:46.863317 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0db66fbb-bb45-4dd9-abdf-106b1ae07540 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:46.863317 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0db66fbb-bb45-4dd9-abdf-106b1ae07540 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:46.866587 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0db66fbb-bb45-4dd9-abdf-106b1ae07540 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:46.908393 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-0db66fbb-bb45-4dd9-abdf-106b1ae07540 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] HTTP exception thrown: Instance ce85aa86-fbba-4eca-97e8-173da3cdc7c3 could not be found. Oct 27 03:44:46.913973 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0db66fbb-bb45-4dd9-abdf-106b1ae07540 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Request method failure captured: Oct 27 03:44:46.913973 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/ce85aa86-fbba-4eca-97e8-173da3cdc7c3 HTTP/1.1 Oct 27 03:44:46.913973 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:44:46.913973 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:44:46.913973 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:44:46.913973 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:44:46.913973 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:44:46.913973 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:44:46.913973 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:44:46.913973 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:44:46.913973 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWf1ZZNjkPjFpbma6U1a30rpW5rz2pgrrBz2Y-zebQ7kUx-XZ8725TKvqHb0qLGWkMX-Aib9FY_k_pJogL520cMR3ZWJWChbAePna2V7kBQy-Nbm9LJN4yabkkyXR2yEa_L7dWwYV9fWj_rKrXm3kLnzTBx9MHVV6fRMUhXnJRxMN3ek Oct 27 03:44:46.913973 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:44:46.913973 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:44:46.913973 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:44:46.913973 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:44:46.913973 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:44:46.913973 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:44:46.913973 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 38450368ef5c4e68ac3c19c7a0a1ce65 Oct 27 03:44:46.913973 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-AttachVolumeTestJSON-1593697068 Oct 27 03:44:46.913973 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:44:46.913973 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:44:46.913973 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/38450368ef5c4e68ac3c19c7a0a1ce65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/38450368ef5c4e68ac3c19c7a0a1ce65"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/38450368ef5c4e68ac3c19c7a0a1ce65"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_38450368ef5c4e68ac3c19c7a0a1ce65"}]}] Oct 27 03:44:46.913973 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-AttachVolumeTestJSON-1593697068 Oct 27 03:44:46.913973 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 38450368ef5c4e68ac3c19c7a0a1ce65 Oct 27 03:44:46.913973 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1593697068 Oct 27 03:44:46.913973 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-AttachVolumeTestJSON-1593697068-project Oct 27 03:44:46.913973 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:44:46.913973 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:44:46.913973 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 5ffc2b1c410149e884a47240b5425e57 Oct 27 03:44:46.913973 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-AttachVolumeTestJSON-1593697068-project Oct 27 03:44:46.913973 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:44:46.913973 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance ce85aa86-fbba-4eca-97e8-173da3cdc7c3 could not be found. Oct 27 03:44:46.913973 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': 'ce85aa86-fbba-4eca-97e8-173da3cdc7c3'} Oct 27 03:44:46.913973 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:44:46.913973 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:44:46.913973 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:44:46.913973 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:44:46.913973 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:44:46.913973 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:44:46.913973 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:44:46.913973 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:44:46.913973 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:44:46.913973 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:44:46.913973 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce85aa86-fbba-4eca-97e8-173da3cdc7c3 could not be found. Oct 27 03:44:46.913973 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:44:46.913973 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:44:46.913973 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:44:46.913973 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:44:46.913973 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:44:46.913973 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:44:46.913973 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:44:46.913973 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:44:46.913973 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:44:46.913973 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:44:46.913973 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:44:46.913973 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:44:46.913973 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:44:46.913973 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:44:46.913973 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:44:46.913973 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:44:46.913973 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce85aa86-fbba-4eca-97e8-173da3cdc7c3 could not be found. Oct 27 03:44:46.913973 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:44:46.913973 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:44:46.913973 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:44:46.927730 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:44:46.927730 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:44:46.927730 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:44:46.927730 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:44:46.927730 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:44:46.927730 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce85aa86-fbba-4eca-97e8-173da3cdc7c3 could not be found. Oct 27 03:44:46.927730 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:44:46.927730 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0db66fbb-bb45-4dd9-abdf-106b1ae07540 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Returning 404 to user: Instance ce85aa86-fbba-4eca-97e8-173da3cdc7c3 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:44:46.927730 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0db66fbb-bb45-4dd9-abdf-106b1ae07540 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "GET /compute/v2.1/servers/ce85aa86-fbba-4eca-97e8-173da3cdc7c3" status: 404 len: 111 microversion: 2.1 time: 0.108070 Oct 27 03:44:46.927730 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2604/5487] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:44:46 2022] GET /compute/v2.1/servers/ce85aa86-fbba-4eca-97e8-173da3cdc7c3 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:44:46.933592 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-bdca92ba-3552-4ae9-b9c8-aafd124a27e0 req-03b923ab-1247-4a3f-a2b8-3a860cfe067e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af90f208-7b8a-4ae4-a654-5fc632279527", "tag": "3697490b-4346-4713-baa7-c8f934701f1a"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:44:46.963291 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-bdca92ba-3552-4ae9-b9c8-aafd124a27e0 req-03b923ab-1247-4a3f-a2b8-3a860cfe067e service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:46.963945 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-bdca92ba-3552-4ae9-b9c8-aafd124a27e0 req-03b923ab-1247-4a3f-a2b8-3a860cfe067e service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:46.965101 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-bdca92ba-3552-4ae9-b9c8-aafd124a27e0 req-03b923ab-1247-4a3f-a2b8-3a860cfe067e service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:47.000110 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-bdca92ba-3552-4ae9-b9c8-aafd124a27e0 req-03b923ab-1247-4a3f-a2b8-3a860cfe067e service nova] Creating event network-changed:3697490b-4346-4713-baa7-c8f934701f1a for instance af90f208-7b8a-4ae4-a654-5fc632279527 on n-h1-862769-1 Oct 27 03:44:47.012601 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-bdca92ba-3552-4ae9-b9c8-aafd124a27e0 req-03b923ab-1247-4a3f-a2b8-3a860cfe067e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090487 Oct 27 03:44:47.015194 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2605/5488] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:44:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:44:47.028024 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8488132a-f8fe-4d03-827d-9da6868eea39 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:47.033488 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8488132a-f8fe-4d03-827d-9da6868eea39 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: dbdbec9a-f4bf-4740-ab67-3c8891e341a1] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:47.046535 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8488132a-f8fe-4d03-827d-9da6868eea39 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:47.047797 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8488132a-f8fe-4d03-827d-9da6868eea39 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:47.049410 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8488132a-f8fe-4d03-827d-9da6868eea39 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:47.050769 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8488132a-f8fe-4d03-827d-9da6868eea39 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:47.052614 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8488132a-f8fe-4d03-827d-9da6868eea39 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:47.053551 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8488132a-f8fe-4d03-827d-9da6868eea39 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:47.825662 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8488132a-f8fe-4d03-827d-9da6868eea39 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:47.840501 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8488132a-f8fe-4d03-827d-9da6868eea39 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1" status: 200 len: 1734 microversion: 2.1 time: 0.823972 Oct 27 03:44:47.855098 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2606/5489] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:44:47 2022] GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1 => generated 1734 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:44:47.867127 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-295e9531-1ea7-4677-aa9e-dfb51ea334ec tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Calling method '.version_select at 0x7f7dda7dc5e0>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:47.999577 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-295e9531-1ea7-4677-aa9e-dfb51ea334ec tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-954509478" status: 202 len: 0 microversion: 2.1 time: 0.142834 Oct 27 03:44:48.004641 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2607/5490] 10.222.0.20 () {58 vars in 1218 bytes} [Thu Oct 27 03:44:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-954509478 => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:44:48.022994 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-080dbeee-509d-444c-b32e-7bb955faa63a tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:48.031789 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-080dbeee-509d-444c-b32e-7bb955faa63a tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: f3fcf361-2e24-402c-8290-6bc77b1125fa] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:48.066362 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-080dbeee-509d-444c-b32e-7bb955faa63a tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:48.066362 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-080dbeee-509d-444c-b32e-7bb955faa63a tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:48.066362 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-080dbeee-509d-444c-b32e-7bb955faa63a tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:48.066362 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-080dbeee-509d-444c-b32e-7bb955faa63a tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:48.067740 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-080dbeee-509d-444c-b32e-7bb955faa63a tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:48.069068 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-080dbeee-509d-444c-b32e-7bb955faa63a tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:48.259746 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.network.neutron [None req-4104c35e-9bde-443a-b491-b18cca0e74d2 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] [instance: af90f208-7b8a-4ae4-a654-5fc632279527] Updating instance_info_cache with network_info: [{"id": "3697490b-4346-4713-baa7-c8f934701f1a", "address": "fa:16:3e:41:c9:0e", "network": {"id": "3784a63d-0c1a-4444-9ee2-139a9d54618f", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-874001350-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e4f0730b38a946759ea32c36f5876eb3", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap3697490b-43", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=121001) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 27 03:44:48.274301 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:44:48.277142 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4104c35e-9bde-443a-b491-b18cca0e74d2 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Releasing lock "refresh_cache-af90f208-7b8a-4ae4-a654-5fc632279527" {{(pid=121001) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 27 03:44:48.279190 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4104c35e-9bde-443a-b491-b18cca0e74d2 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] 10.222.0.20 "POST /compute/v2.1/servers/af90f208-7b8a-4ae4-a654-5fc632279527/action" status: 202 len: 0 microversion: 2.1 time: 6.347898 Oct 27 03:44:48.285132 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2884/5491] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:44:41 2022] POST /compute/v2.1/servers/af90f208-7b8a-4ae4-a654-5fc632279527/action => generated 0 bytes in 6354 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 27 03:44:48.291447 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-dec3742d-1a82-4b45-94b2-6c327f4e7e89 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:48.292591 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-dec3742d-1a82-4b45-94b2-6c327f4e7e89 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 1db2318e-9ac7-4994-8daa-14ae22537d5d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:48.334591 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dec3742d-1a82-4b45-94b2-6c327f4e7e89 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:48.339648 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dec3742d-1a82-4b45-94b2-6c327f4e7e89 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:48.340968 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dec3742d-1a82-4b45-94b2-6c327f4e7e89 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:48.340968 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dec3742d-1a82-4b45-94b2-6c327f4e7e89 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:48.343963 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dec3742d-1a82-4b45-94b2-6c327f4e7e89 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:48.344846 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dec3742d-1a82-4b45-94b2-6c327f4e7e89 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:48.423290 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-080dbeee-509d-444c-b32e-7bb955faa63a tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:48.464073 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-080dbeee-509d-444c-b32e-7bb955faa63a tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/f3fcf361-2e24-402c-8290-6bc77b1125fa" status: 200 len: 1523 microversion: 2.1 time: 0.440193 Oct 27 03:44:48.468184 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2608/5492] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:44:48 2022] GET /compute/v2.1/servers/f3fcf361-2e24-402c-8290-6bc77b1125fa => generated 1523 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:44:48.489172 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-944f80b2-c991-4f09-88c2-29505fc7a231 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Calling method '.version_select at 0x7f7ddaa91ca0>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:49.152355 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-dec3742d-1a82-4b45-94b2-6c327f4e7e89 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:49.169750 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-dec3742d-1a82-4b45-94b2-6c327f4e7e89 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:49.173529 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-dec3742d-1a82-4b45-94b2-6c327f4e7e89 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:49.177395 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-dec3742d-1a82-4b45-94b2-6c327f4e7e89 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d" status: 200 len: 1740 microversion: 2.20 time: 0.890907 Oct 27 03:44:49.204235 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2885/5493] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:44:48 2022] GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d => generated 1740 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:44:49.224539 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-167e9395-ef0f-4084-a81a-ec853b7faebd tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:49.225203 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-167e9395-ef0f-4084-a81a-ec853b7faebd tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: dbdbec9a-f4bf-4740-ab67-3c8891e341a1] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:49.257868 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-167e9395-ef0f-4084-a81a-ec853b7faebd tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:49.258533 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-167e9395-ef0f-4084-a81a-ec853b7faebd tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:49.259000 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-167e9395-ef0f-4084-a81a-ec853b7faebd tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:49.259744 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-167e9395-ef0f-4084-a81a-ec853b7faebd tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:49.260219 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-167e9395-ef0f-4084-a81a-ec853b7faebd tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:49.262237 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-167e9395-ef0f-4084-a81a-ec853b7faebd tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:49.604116 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-167e9395-ef0f-4084-a81a-ec853b7faebd tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:49.618492 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-167e9395-ef0f-4084-a81a-ec853b7faebd tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1" status: 200 len: 1734 microversion: 2.1 time: 0.412893 Oct 27 03:44:49.622087 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2886/5494] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:44:49 2022] GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1 => generated 1734 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:44:49.633265 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2b533469-abac-45f6-9bd1-5f8eabb6b49a tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:49.636295 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2b533469-abac-45f6-9bd1-5f8eabb6b49a tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: f3fcf361-2e24-402c-8290-6bc77b1125fa] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:49.654002 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2b533469-abac-45f6-9bd1-5f8eabb6b49a tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:49.654887 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2b533469-abac-45f6-9bd1-5f8eabb6b49a tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:49.655633 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2b533469-abac-45f6-9bd1-5f8eabb6b49a tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:49.656756 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2b533469-abac-45f6-9bd1-5f8eabb6b49a tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:49.658731 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2b533469-abac-45f6-9bd1-5f8eabb6b49a tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:49.659598 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2b533469-abac-45f6-9bd1-5f8eabb6b49a tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:50.473804 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2b533469-abac-45f6-9bd1-5f8eabb6b49a tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:50.484736 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2b533469-abac-45f6-9bd1-5f8eabb6b49a tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/f3fcf361-2e24-402c-8290-6bc77b1125fa" status: 200 len: 1523 microversion: 2.1 time: 0.858678 Oct 27 03:44:50.488110 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2887/5495] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:44:49 2022] GET /compute/v2.1/servers/f3fcf361-2e24-402c-8290-6bc77b1125fa => generated 1523 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:44:50.500576 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a2fd0082-e6ef-4833-9fd5-3e032efb35a4 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:50.501442 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a2fd0082-e6ef-4833-9fd5-3e032efb35a4 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 1db2318e-9ac7-4994-8daa-14ae22537d5d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:50.512430 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a2fd0082-e6ef-4833-9fd5-3e032efb35a4 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:50.513574 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a2fd0082-e6ef-4833-9fd5-3e032efb35a4 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:50.514241 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a2fd0082-e6ef-4833-9fd5-3e032efb35a4 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:50.515257 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a2fd0082-e6ef-4833-9fd5-3e032efb35a4 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:50.516434 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a2fd0082-e6ef-4833-9fd5-3e032efb35a4 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:50.517794 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a2fd0082-e6ef-4833-9fd5-3e032efb35a4 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:50.802278 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a2fd0082-e6ef-4833-9fd5-3e032efb35a4 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:50.833362 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a2fd0082-e6ef-4833-9fd5-3e032efb35a4 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:50.868685 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a2fd0082-e6ef-4833-9fd5-3e032efb35a4 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:50.878634 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a2fd0082-e6ef-4833-9fd5-3e032efb35a4 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d" status: 200 len: 1740 microversion: 2.20 time: 0.378884 Oct 27 03:44:50.878634 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2888/5496] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:44:50 2022] GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d => generated 1740 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:44:50.889263 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2db79db0-3328-4cab-acf2-8c5231e03847 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:50.889911 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2db79db0-3328-4cab-acf2-8c5231e03847 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: dbdbec9a-f4bf-4740-ab67-3c8891e341a1] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:50.928335 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2db79db0-3328-4cab-acf2-8c5231e03847 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:50.928850 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2db79db0-3328-4cab-acf2-8c5231e03847 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:50.929303 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2db79db0-3328-4cab-acf2-8c5231e03847 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:50.930057 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2db79db0-3328-4cab-acf2-8c5231e03847 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:50.930542 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2db79db0-3328-4cab-acf2-8c5231e03847 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:50.938196 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2db79db0-3328-4cab-acf2-8c5231e03847 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:51.064266 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-944f80b2-c991-4f09-88c2-29505fc7a231 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/3459d03e-2037-46da-ac19-a35dfb385142" status: 202 len: 0 microversion: 2.1 time: 2.592451 Oct 27 03:44:51.064266 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2609/5497] 10.222.0.20 () {58 vars in 1263 bytes} [Thu Oct 27 03:44:48 2022] DELETE /compute/v2.1/os-floating-ips/3459d03e-2037-46da-ac19-a35dfb385142 => generated 0 bytes in 2595 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:44:51.072853 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-201f387e-ab21-4fad-9228-9ba7ca0c68ce tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Calling method '.version_select at 0x7f7ddec889d0>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:52.202006 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2db79db0-3328-4cab-acf2-8c5231e03847 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:52.220800 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2db79db0-3328-4cab-acf2-8c5231e03847 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1" status: 200 len: 1734 microversion: 2.1 time: 1.345589 Oct 27 03:44:52.231299 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2889/5498] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:44:50 2022] GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1 => generated 1734 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:44:52.242780 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a0a724e2-9e61-4ef2-b893-5dd799c636b3 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:52.243410 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a0a724e2-9e61-4ef2-b893-5dd799c636b3 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: f3fcf361-2e24-402c-8290-6bc77b1125fa] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:52.262318 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a0a724e2-9e61-4ef2-b893-5dd799c636b3 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:52.263168 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a0a724e2-9e61-4ef2-b893-5dd799c636b3 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:52.263773 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a0a724e2-9e61-4ef2-b893-5dd799c636b3 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:52.264875 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a0a724e2-9e61-4ef2-b893-5dd799c636b3 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:52.265559 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a0a724e2-9e61-4ef2-b893-5dd799c636b3 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:52.266237 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a0a724e2-9e61-4ef2-b893-5dd799c636b3 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:52.314339 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-201f387e-ab21-4fad-9228-9ba7ca0c68ce tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/b2d9d343-caee-41f8-a960-375b06ff7fbb" status: 202 len: 0 microversion: 2.1 time: 1.245186 Oct 27 03:44:52.314953 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2610/5499] 10.222.0.20 () {58 vars in 1272 bytes} [Thu Oct 27 03:44:51 2022] DELETE /compute/v2.1/os-security-groups/b2d9d343-caee-41f8-a960-375b06ff7fbb => generated 0 bytes in 1247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 03:44:52.320352 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5f61a3a3-9ac9-4079-805d-b75f11a846c2 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:52.320990 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5f61a3a3-9ac9-4079-805d-b75f11a846c2 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 1db2318e-9ac7-4994-8daa-14ae22537d5d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:52.347905 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5f61a3a3-9ac9-4079-805d-b75f11a846c2 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:52.348420 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5f61a3a3-9ac9-4079-805d-b75f11a846c2 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:52.348870 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5f61a3a3-9ac9-4079-805d-b75f11a846c2 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:52.349607 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5f61a3a3-9ac9-4079-805d-b75f11a846c2 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:52.366963 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5f61a3a3-9ac9-4079-805d-b75f11a846c2 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:52.367664 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5f61a3a3-9ac9-4079-805d-b75f11a846c2 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:52.908349 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5f61a3a3-9ac9-4079-805d-b75f11a846c2 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:52.918317 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5f61a3a3-9ac9-4079-805d-b75f11a846c2 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:52.920079 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5f61a3a3-9ac9-4079-805d-b75f11a846c2 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:52.937254 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5f61a3a3-9ac9-4079-805d-b75f11a846c2 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d" status: 200 len: 1740 microversion: 2.20 time: 0.620658 Oct 27 03:44:52.939592 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a0a724e2-9e61-4ef2-b893-5dd799c636b3 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:52.941869 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2611/5500] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:44:52 2022] GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d => generated 1740 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:44:52.952440 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-77132ac4-c5f3-40d0-ad9b-e2ee9cec3197 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:52.964113 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a0a724e2-9e61-4ef2-b893-5dd799c636b3 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/f3fcf361-2e24-402c-8290-6bc77b1125fa" status: 200 len: 1523 microversion: 2.1 time: 0.731568 Oct 27 03:44:52.974220 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-77132ac4-c5f3-40d0-ad9b-e2ee9cec3197 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] [instance: af90f208-7b8a-4ae4-a654-5fc632279527] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:52.981482 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2890/5501] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:44:52 2022] GET /compute/v2.1/servers/f3fcf361-2e24-402c-8290-6bc77b1125fa => generated 1523 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:44:53.000977 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-77132ac4-c5f3-40d0-ad9b-e2ee9cec3197 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:53.001418 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-77132ac4-c5f3-40d0-ad9b-e2ee9cec3197 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:53.001906 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-77132ac4-c5f3-40d0-ad9b-e2ee9cec3197 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:53.002672 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-77132ac4-c5f3-40d0-ad9b-e2ee9cec3197 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:53.003177 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-77132ac4-c5f3-40d0-ad9b-e2ee9cec3197 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:53.011850 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-77132ac4-c5f3-40d0-ad9b-e2ee9cec3197 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:53.060906 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-77132ac4-c5f3-40d0-ad9b-e2ee9cec3197 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] [instance: af90f208-7b8a-4ae4-a654-5fc632279527] Going to try to terminate instance {{(pid=121000) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:44:53.249155 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9d07a5c5-d209-4d91-a415-92be8bb9978d tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:53.249922 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-9d07a5c5-d209-4d91-a415-92be8bb9978d tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: dbdbec9a-f4bf-4740-ab67-3c8891e341a1] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:53.263618 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9d07a5c5-d209-4d91-a415-92be8bb9978d tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:53.269675 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9d07a5c5-d209-4d91-a415-92be8bb9978d tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:53.272414 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9d07a5c5-d209-4d91-a415-92be8bb9978d tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:53.273608 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9d07a5c5-d209-4d91-a415-92be8bb9978d tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:53.275806 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9d07a5c5-d209-4d91-a415-92be8bb9978d tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:53.279967 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9d07a5c5-d209-4d91-a415-92be8bb9978d tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:53.447786 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-77132ac4-c5f3-40d0-ad9b-e2ee9cec3197 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] 10.222.0.20 "DELETE /compute/v2.1/servers/af90f208-7b8a-4ae4-a654-5fc632279527" status: 204 len: 0 microversion: 2.1 time: 0.501440 Oct 27 03:44:53.451416 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2612/5502] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:44:52 2022] DELETE /compute/v2.1/servers/af90f208-7b8a-4ae4-a654-5fc632279527 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:44:53.459714 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ed67ec05-eef7-4126-9e3c-adce6437227e tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:53.460415 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ed67ec05-eef7-4126-9e3c-adce6437227e tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] [instance: af90f208-7b8a-4ae4-a654-5fc632279527] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:53.480649 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ed67ec05-eef7-4126-9e3c-adce6437227e tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:53.484191 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ed67ec05-eef7-4126-9e3c-adce6437227e tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:53.485187 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ed67ec05-eef7-4126-9e3c-adce6437227e tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:53.486272 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ed67ec05-eef7-4126-9e3c-adce6437227e tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:53.489027 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ed67ec05-eef7-4126-9e3c-adce6437227e tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:53.489733 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ed67ec05-eef7-4126-9e3c-adce6437227e tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:53.886421 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9d07a5c5-d209-4d91-a415-92be8bb9978d tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:53.901060 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9d07a5c5-d209-4d91-a415-92be8bb9978d tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1" status: 200 len: 1734 microversion: 2.1 time: 0.659153 Oct 27 03:44:53.905159 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2891/5503] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:44:53 2022] GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1 => generated 1734 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:44:53.914131 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-8db92482-829c-4ccd-92f9-38a736369cc9 req-3a555c7d-d740-4b65-ab37-db813425b095 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3fcf361-2e24-402c-8290-6bc77b1125fa", "name": "network-vif-plugged", "status": "completed", "tag": "cb4aafd8-0533-425c-84b7-290165d4cdea"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:44:53.929274 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-8db92482-829c-4ccd-92f9-38a736369cc9 req-3a555c7d-d740-4b65-ab37-db813425b095 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:53.930156 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-8db92482-829c-4ccd-92f9-38a736369cc9 req-3a555c7d-d740-4b65-ab37-db813425b095 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:53.930998 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-8db92482-829c-4ccd-92f9-38a736369cc9 req-3a555c7d-d740-4b65-ab37-db813425b095 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:53.948151 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-8db92482-829c-4ccd-92f9-38a736369cc9 req-3a555c7d-d740-4b65-ab37-db813425b095 service nova] Creating event network-vif-plugged:cb4aafd8-0533-425c-84b7-290165d4cdea for instance f3fcf361-2e24-402c-8290-6bc77b1125fa on n-h2-862769-1 Oct 27 03:44:53.954351 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-8db92482-829c-4ccd-92f9-38a736369cc9 req-3a555c7d-d740-4b65-ab37-db813425b095 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046722 Oct 27 03:44:53.955533 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2892/5504] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:44:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:44:53.997364 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-da2a097f-913d-4212-9270-a3ae4d3913b4 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:53.998249 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-da2a097f-913d-4212-9270-a3ae4d3913b4 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 1db2318e-9ac7-4994-8daa-14ae22537d5d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:54.030356 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-da2a097f-913d-4212-9270-a3ae4d3913b4 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:54.030980 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-da2a097f-913d-4212-9270-a3ae4d3913b4 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:54.032917 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-da2a097f-913d-4212-9270-a3ae4d3913b4 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:54.033803 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-da2a097f-913d-4212-9270-a3ae4d3913b4 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:54.036185 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-da2a097f-913d-4212-9270-a3ae4d3913b4 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:54.039220 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-da2a097f-913d-4212-9270-a3ae4d3913b4 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:54.149779 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ed67ec05-eef7-4126-9e3c-adce6437227e tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9ddb0e44024937865411a7d2c3d956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4f0730b38a946759ea32c36f5876eb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:54.162567 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ed67ec05-eef7-4126-9e3c-adce6437227e tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] 10.222.0.20 "GET /compute/v2.1/servers/af90f208-7b8a-4ae4-a654-5fc632279527" status: 200 len: 1509 microversion: 2.1 time: 0.706038 Oct 27 03:44:54.165724 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2613/5505] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:44:53 2022] GET /compute/v2.1/servers/af90f208-7b8a-4ae4-a654-5fc632279527 => generated 1509 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:44:54.191756 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-83d0c978-c398-4088-ac78-604a2bd8e708 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:54.193774 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-83d0c978-c398-4088-ac78-604a2bd8e708 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: f3fcf361-2e24-402c-8290-6bc77b1125fa] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:54.219166 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-83d0c978-c398-4088-ac78-604a2bd8e708 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:54.219777 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-83d0c978-c398-4088-ac78-604a2bd8e708 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:54.220242 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-83d0c978-c398-4088-ac78-604a2bd8e708 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:54.230505 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-83d0c978-c398-4088-ac78-604a2bd8e708 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:54.231039 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-83d0c978-c398-4088-ac78-604a2bd8e708 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:54.231497 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-83d0c978-c398-4088-ac78-604a2bd8e708 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:54.754816 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-da2a097f-913d-4212-9270-a3ae4d3913b4 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:54.767261 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-da2a097f-913d-4212-9270-a3ae4d3913b4 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:54.770028 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-da2a097f-913d-4212-9270-a3ae4d3913b4 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:54.777055 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-da2a097f-913d-4212-9270-a3ae4d3913b4 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d" status: 200 len: 1740 microversion: 2.20 time: 0.803893 Oct 27 03:44:54.787632 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2893/5506] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:44:53 2022] GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d => generated 1740 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:44:54.990723 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e27edcd4-af57-4290-9575-14c835fdaf08 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:54.991357 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e27edcd4-af57-4290-9575-14c835fdaf08 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: dbdbec9a-f4bf-4740-ab67-3c8891e341a1] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:55.005568 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e27edcd4-af57-4290-9575-14c835fdaf08 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:55.006100 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e27edcd4-af57-4290-9575-14c835fdaf08 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:55.006754 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e27edcd4-af57-4290-9575-14c835fdaf08 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:55.008708 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e27edcd4-af57-4290-9575-14c835fdaf08 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:55.008708 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e27edcd4-af57-4290-9575-14c835fdaf08 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:55.009531 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e27edcd4-af57-4290-9575-14c835fdaf08 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:55.067121 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-83d0c978-c398-4088-ac78-604a2bd8e708 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:55.104546 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-83d0c978-c398-4088-ac78-604a2bd8e708 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/f3fcf361-2e24-402c-8290-6bc77b1125fa" status: 200 len: 1523 microversion: 2.1 time: 0.922377 Oct 27 03:44:55.108577 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2614/5507] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:44:54 2022] GET /compute/v2.1/servers/f3fcf361-2e24-402c-8290-6bc77b1125fa => generated 1523 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:44:55.202234 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3892c778-38d4-4a41-8ea0-cc04fbad0aa7 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:55.203202 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-3892c778-38d4-4a41-8ea0-cc04fbad0aa7 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] [instance: af90f208-7b8a-4ae4-a654-5fc632279527] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:55.228246 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3892c778-38d4-4a41-8ea0-cc04fbad0aa7 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:55.228754 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3892c778-38d4-4a41-8ea0-cc04fbad0aa7 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:55.229204 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3892c778-38d4-4a41-8ea0-cc04fbad0aa7 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:55.229936 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3892c778-38d4-4a41-8ea0-cc04fbad0aa7 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:55.230494 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3892c778-38d4-4a41-8ea0-cc04fbad0aa7 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:55.230934 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3892c778-38d4-4a41-8ea0-cc04fbad0aa7 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:55.668505 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e27edcd4-af57-4290-9575-14c835fdaf08 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:55.678345 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e27edcd4-af57-4290-9575-14c835fdaf08 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1" status: 200 len: 1734 microversion: 2.1 time: 0.692115 Oct 27 03:44:55.686432 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2894/5508] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:44:54 2022] GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1 => generated 1734 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:44:55.757062 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-3892c778-38d4-4a41-8ea0-cc04fbad0aa7 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9ddb0e44024937865411a7d2c3d956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4f0730b38a946759ea32c36f5876eb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:55.770691 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3892c778-38d4-4a41-8ea0-cc04fbad0aa7 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] 10.222.0.20 "GET /compute/v2.1/servers/af90f208-7b8a-4ae4-a654-5fc632279527" status: 200 len: 1509 microversion: 2.1 time: 0.578340 Oct 27 03:44:55.774396 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2615/5509] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:44:55 2022] GET /compute/v2.1/servers/af90f208-7b8a-4ae4-a654-5fc632279527 => generated 1509 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:44:55.815082 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-56cc6544-2493-41e7-accf-0f65c3cde2f0 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:55.815768 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-56cc6544-2493-41e7-accf-0f65c3cde2f0 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 1db2318e-9ac7-4994-8daa-14ae22537d5d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:55.825109 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-56cc6544-2493-41e7-accf-0f65c3cde2f0 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:55.829239 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-56cc6544-2493-41e7-accf-0f65c3cde2f0 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:55.832731 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-56cc6544-2493-41e7-accf-0f65c3cde2f0 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:55.835464 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-56cc6544-2493-41e7-accf-0f65c3cde2f0 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:55.835464 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-56cc6544-2493-41e7-accf-0f65c3cde2f0 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:55.835464 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-56cc6544-2493-41e7-accf-0f65c3cde2f0 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:56.137083 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-38c8bd75-f465-4ea0-be31-d6b743f9d2ab tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:56.137717 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-38c8bd75-f465-4ea0-be31-d6b743f9d2ab tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: f3fcf361-2e24-402c-8290-6bc77b1125fa] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:56.147753 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-38c8bd75-f465-4ea0-be31-d6b743f9d2ab tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:56.162477 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-38c8bd75-f465-4ea0-be31-d6b743f9d2ab tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:56.163269 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-38c8bd75-f465-4ea0-be31-d6b743f9d2ab tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:56.167756 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-38c8bd75-f465-4ea0-be31-d6b743f9d2ab tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:56.167756 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-38c8bd75-f465-4ea0-be31-d6b743f9d2ab tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:56.167756 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-38c8bd75-f465-4ea0-be31-d6b743f9d2ab tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:56.532100 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-56cc6544-2493-41e7-accf-0f65c3cde2f0 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:56.548019 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-56cc6544-2493-41e7-accf-0f65c3cde2f0 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:56.555672 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-56cc6544-2493-41e7-accf-0f65c3cde2f0 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:56.559844 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-56cc6544-2493-41e7-accf-0f65c3cde2f0 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d" status: 200 len: 1740 microversion: 2.20 time: 0.746925 Oct 27 03:44:56.563214 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2895/5510] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:44:55 2022] GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d => generated 1740 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:44:56.706781 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-121cac72-ae66-49af-b0a3-991b68e652f5 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:56.711426 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-121cac72-ae66-49af-b0a3-991b68e652f5 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: dbdbec9a-f4bf-4740-ab67-3c8891e341a1] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:56.717732 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-121cac72-ae66-49af-b0a3-991b68e652f5 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:56.718411 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-121cac72-ae66-49af-b0a3-991b68e652f5 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:56.720918 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-121cac72-ae66-49af-b0a3-991b68e652f5 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:56.722444 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-121cac72-ae66-49af-b0a3-991b68e652f5 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:56.724606 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-121cac72-ae66-49af-b0a3-991b68e652f5 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:56.725197 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-121cac72-ae66-49af-b0a3-991b68e652f5 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:56.879595 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-38c8bd75-f465-4ea0-be31-d6b743f9d2ab tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:56.891795 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-38c8bd75-f465-4ea0-be31-d6b743f9d2ab tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/f3fcf361-2e24-402c-8290-6bc77b1125fa" status: 200 len: 1523 microversion: 2.1 time: 0.759473 Oct 27 03:44:56.893268 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2616/5511] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:44:56 2022] GET /compute/v2.1/servers/f3fcf361-2e24-402c-8290-6bc77b1125fa => generated 1523 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:44:56.906990 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-51a25e9a-80b4-4496-8842-1ff36002318a tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:56.909191 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-51a25e9a-80b4-4496-8842-1ff36002318a tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] [instance: af90f208-7b8a-4ae4-a654-5fc632279527] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:56.927340 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-51a25e9a-80b4-4496-8842-1ff36002318a tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:56.928725 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-51a25e9a-80b4-4496-8842-1ff36002318a tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:56.929413 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-51a25e9a-80b4-4496-8842-1ff36002318a tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:56.930560 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-51a25e9a-80b4-4496-8842-1ff36002318a tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:56.931433 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-51a25e9a-80b4-4496-8842-1ff36002318a tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:56.935158 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-51a25e9a-80b4-4496-8842-1ff36002318a tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:57.416994 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-121cac72-ae66-49af-b0a3-991b68e652f5 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:57.428874 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-121cac72-ae66-49af-b0a3-991b68e652f5 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1" status: 200 len: 1734 microversion: 2.1 time: 0.726789 Oct 27 03:44:57.446123 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2896/5512] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:44:56 2022] GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1 => generated 1734 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:44:57.536281 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-e154387d-3d68-49dc-870f-d484b3f72a55 req-b1727fb0-2568-4f5f-8a87-3c5ab0a581ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af90f208-7b8a-4ae4-a654-5fc632279527", "name": "network-vif-deleted", "tag": "3697490b-4346-4713-baa7-c8f934701f1a"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:44:57.558309 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-e154387d-3d68-49dc-870f-d484b3f72a55 req-b1727fb0-2568-4f5f-8a87-3c5ab0a581ff service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:57.558910 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-e154387d-3d68-49dc-870f-d484b3f72a55 req-b1727fb0-2568-4f5f-8a87-3c5ab0a581ff service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:57.559360 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-e154387d-3d68-49dc-870f-d484b3f72a55 req-b1727fb0-2568-4f5f-8a87-3c5ab0a581ff service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:57.615823 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-e154387d-3d68-49dc-870f-d484b3f72a55 req-b1727fb0-2568-4f5f-8a87-3c5ab0a581ff service nova] Creating event network-vif-deleted:3697490b-4346-4713-baa7-c8f934701f1a for instance af90f208-7b8a-4ae4-a654-5fc632279527 on n-h1-862769-1 Oct 27 03:44:57.633372 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-e154387d-3d68-49dc-870f-d484b3f72a55 req-b1727fb0-2568-4f5f-8a87-3c5ab0a581ff service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106421 Oct 27 03:44:57.634551 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2897/5513] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:44:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:44:57.663661 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-51a25e9a-80b4-4496-8842-1ff36002318a tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9ddb0e44024937865411a7d2c3d956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4f0730b38a946759ea32c36f5876eb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:57.668709 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-14ad432a-39d4-45e8-8964-b46d218955df tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:57.669967 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-14ad432a-39d4-45e8-8964-b46d218955df tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 1db2318e-9ac7-4994-8daa-14ae22537d5d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:57.677537 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-51a25e9a-80b4-4496-8842-1ff36002318a tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] 10.222.0.20 "GET /compute/v2.1/servers/af90f208-7b8a-4ae4-a654-5fc632279527" status: 200 len: 1509 microversion: 2.1 time: 0.778692 Oct 27 03:44:57.680964 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2617/5514] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:44:56 2022] GET /compute/v2.1/servers/af90f208-7b8a-4ae4-a654-5fc632279527 => generated 1509 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:44:57.699688 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-14ad432a-39d4-45e8-8964-b46d218955df tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:57.703481 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-14ad432a-39d4-45e8-8964-b46d218955df tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:57.704145 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-14ad432a-39d4-45e8-8964-b46d218955df tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:57.705087 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-14ad432a-39d4-45e8-8964-b46d218955df tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:57.706998 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-14ad432a-39d4-45e8-8964-b46d218955df tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:57.708038 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-14ad432a-39d4-45e8-8964-b46d218955df tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:57.915773 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a097016f-06e7-4570-8c93-cdb9b9a4cb9a tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:57.916450 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a097016f-06e7-4570-8c93-cdb9b9a4cb9a tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: f3fcf361-2e24-402c-8290-6bc77b1125fa] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:57.939751 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a097016f-06e7-4570-8c93-cdb9b9a4cb9a tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:57.940307 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a097016f-06e7-4570-8c93-cdb9b9a4cb9a tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:57.940760 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a097016f-06e7-4570-8c93-cdb9b9a4cb9a tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:57.941909 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a097016f-06e7-4570-8c93-cdb9b9a4cb9a tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:57.942415 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a097016f-06e7-4570-8c93-cdb9b9a4cb9a tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:57.942859 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a097016f-06e7-4570-8c93-cdb9b9a4cb9a tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:58.195522 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-14ad432a-39d4-45e8-8964-b46d218955df tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:58.204287 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-14ad432a-39d4-45e8-8964-b46d218955df tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:58.205747 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-14ad432a-39d4-45e8-8964-b46d218955df tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:58.207038 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-14ad432a-39d4-45e8-8964-b46d218955df tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d" status: 200 len: 1722 microversion: 2.20 time: 0.569720 Oct 27 03:44:58.207625 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2898/5515] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:44:57 2022] GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d => generated 1722 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:44:58.468851 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f13f6ea9-8e0b-42c3-8d4b-67dbf46bbde3 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:58.469483 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f13f6ea9-8e0b-42c3-8d4b-67dbf46bbde3 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: dbdbec9a-f4bf-4740-ab67-3c8891e341a1] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:58.479094 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a097016f-06e7-4570-8c93-cdb9b9a4cb9a tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:58.493729 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a097016f-06e7-4570-8c93-cdb9b9a4cb9a tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/f3fcf361-2e24-402c-8290-6bc77b1125fa" status: 200 len: 1508 microversion: 2.1 time: 0.582213 Oct 27 03:44:58.497395 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f13f6ea9-8e0b-42c3-8d4b-67dbf46bbde3 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:58.497906 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f13f6ea9-8e0b-42c3-8d4b-67dbf46bbde3 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:58.498966 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2618/5516] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:44:57 2022] GET /compute/v2.1/servers/f3fcf361-2e24-402c-8290-6bc77b1125fa => generated 1508 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:44:58.499367 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f13f6ea9-8e0b-42c3-8d4b-67dbf46bbde3 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:58.500111 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f13f6ea9-8e0b-42c3-8d4b-67dbf46bbde3 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:58.501083 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f13f6ea9-8e0b-42c3-8d4b-67dbf46bbde3 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:58.501533 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f13f6ea9-8e0b-42c3-8d4b-67dbf46bbde3 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:58.524483 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-77218746-6e44-4f02-a3c9-21b99a25ea02 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:58.525647 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-77218746-6e44-4f02-a3c9-21b99a25ea02 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: f3fcf361-2e24-402c-8290-6bc77b1125fa] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:58.535499 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-77218746-6e44-4f02-a3c9-21b99a25ea02 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:58.539789 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-77218746-6e44-4f02-a3c9-21b99a25ea02 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:58.540441 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-77218746-6e44-4f02-a3c9-21b99a25ea02 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:58.541409 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-77218746-6e44-4f02-a3c9-21b99a25ea02 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:58.544532 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-77218746-6e44-4f02-a3c9-21b99a25ea02 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:58.545247 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-77218746-6e44-4f02-a3c9-21b99a25ea02 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:58.842537 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-77218746-6e44-4f02-a3c9-21b99a25ea02 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:58.854887 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-77218746-6e44-4f02-a3c9-21b99a25ea02 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/f3fcf361-2e24-402c-8290-6bc77b1125fa" status: 200 len: 1508 microversion: 2.1 time: 0.334114 Oct 27 03:44:58.857438 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2619/5517] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:44:58 2022] GET /compute/v2.1/servers/f3fcf361-2e24-402c-8290-6bc77b1125fa => generated 1508 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:44:58.881652 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d411aa71-4a8e-4e69-af55-59be381f747b tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:58.882779 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d411aa71-4a8e-4e69-af55-59be381f747b tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] [instance: af90f208-7b8a-4ae4-a654-5fc632279527] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:58.908179 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d411aa71-4a8e-4e69-af55-59be381f747b tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:58.913643 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d411aa71-4a8e-4e69-af55-59be381f747b tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:58.915453 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d411aa71-4a8e-4e69-af55-59be381f747b tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:58.916503 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d411aa71-4a8e-4e69-af55-59be381f747b tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:58.919707 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d411aa71-4a8e-4e69-af55-59be381f747b tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:58.922949 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d411aa71-4a8e-4e69-af55-59be381f747b tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:59.051319 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d411aa71-4a8e-4e69-af55-59be381f747b tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:59.057563 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d411aa71-4a8e-4e69-af55-59be381f747b tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:59.058402 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d411aa71-4a8e-4e69-af55-59be381f747b tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:59.058898 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-d411aa71-4a8e-4e69-af55-59be381f747b tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lazy-loading 'fault' on Instance uuid af90f208-7b8a-4ae4-a654-5fc632279527 {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:44:59.392933 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f13f6ea9-8e0b-42c3-8d4b-67dbf46bbde3 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:59.404578 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f13f6ea9-8e0b-42c3-8d4b-67dbf46bbde3 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1" status: 200 len: 1734 microversion: 2.1 time: 0.939604 Oct 27 03:44:59.422354 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2899/5518] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:44:58 2022] GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1 => generated 1734 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:44:59.439323 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-86b2000a-2c45-4d04-ac1f-0e8b44cee843 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:59.442642 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-86b2000a-2c45-4d04-ac1f-0e8b44cee843 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: f3fcf361-2e24-402c-8290-6bc77b1125fa] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:59.451862 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-86b2000a-2c45-4d04-ac1f-0e8b44cee843 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:59.452699 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d411aa71-4a8e-4e69-af55-59be381f747b tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9ddb0e44024937865411a7d2c3d956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4f0730b38a946759ea32c36f5876eb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:44:59.453226 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-86b2000a-2c45-4d04-ac1f-0e8b44cee843 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:59.454883 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-86b2000a-2c45-4d04-ac1f-0e8b44cee843 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:59.455865 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-86b2000a-2c45-4d04-ac1f-0e8b44cee843 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:59.457027 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-86b2000a-2c45-4d04-ac1f-0e8b44cee843 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:59.457769 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-86b2000a-2c45-4d04-ac1f-0e8b44cee843 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:59.466429 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d411aa71-4a8e-4e69-af55-59be381f747b tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] 10.222.0.20 "GET /compute/v2.1/servers/af90f208-7b8a-4ae4-a654-5fc632279527" status: 200 len: 1312 microversion: 2.1 time: 0.602681 Oct 27 03:44:59.467757 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2620/5519] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:44:58 2022] GET /compute/v2.1/servers/af90f208-7b8a-4ae4-a654-5fc632279527 => generated 1312 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:44:59.497081 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a8c3ae59-7f0c-4cb1-9c4c-5ac587bb599a tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:44:59.497712 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a8c3ae59-7f0c-4cb1-9c4c-5ac587bb599a tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 1db2318e-9ac7-4994-8daa-14ae22537d5d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:44:59.514946 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a8c3ae59-7f0c-4cb1-9c4c-5ac587bb599a tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:59.515484 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a8c3ae59-7f0c-4cb1-9c4c-5ac587bb599a tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:59.515941 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a8c3ae59-7f0c-4cb1-9c4c-5ac587bb599a tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:59.516683 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a8c3ae59-7f0c-4cb1-9c4c-5ac587bb599a tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:44:59.520769 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a8c3ae59-7f0c-4cb1-9c4c-5ac587bb599a tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:44:59.521290 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a8c3ae59-7f0c-4cb1-9c4c-5ac587bb599a tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:44:59.522971 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-86b2000a-2c45-4d04-ac1f-0e8b44cee843 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: f3fcf361-2e24-402c-8290-6bc77b1125fa] Going to try to terminate instance {{(pid=121001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:44:59.944665 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-86b2000a-2c45-4d04-ac1f-0e8b44cee843 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f3fcf361-2e24-402c-8290-6bc77b1125fa" status: 204 len: 0 microversion: 2.1 time: 0.520216 Oct 27 03:44:59.949394 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2900/5520] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:44:59 2022] DELETE /compute/v2.1/servers/f3fcf361-2e24-402c-8290-6bc77b1125fa => generated 0 bytes in 523 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:45:00.059529 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a8c3ae59-7f0c-4cb1-9c4c-5ac587bb599a tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:00.073129 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a8c3ae59-7f0c-4cb1-9c4c-5ac587bb599a tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:00.074682 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a8c3ae59-7f0c-4cb1-9c4c-5ac587bb599a tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:00.079018 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a8c3ae59-7f0c-4cb1-9c4c-5ac587bb599a tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d" status: 200 len: 1722 microversion: 2.20 time: 0.608982 Oct 27 03:45:00.084773 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2621/5521] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:44:59 2022] GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d => generated 1722 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:45:00.094812 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8806d5f7-051f-4477-a1e1-82d4f78f239a tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-924672352", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": [{"uuid": "54013623-5e33-4e24-b0d5-2e92945ee737"}]}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:45:00.179012 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.network.neutron [None req-8806d5f7-051f-4477-a1e1-82d4f78f239a tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] validate_networks() for [('54013623-5e33-4e24-b0d5-2e92945ee737', None, None, None, None, None)] {{(pid=121001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:45:00.450813 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5ed3a125-98a2-4388-a443-7958399f026d tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:00.451984 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5ed3a125-98a2-4388-a443-7958399f026d tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: dbdbec9a-f4bf-4740-ab67-3c8891e341a1] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:00.464300 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5ed3a125-98a2-4388-a443-7958399f026d tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:00.464817 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5ed3a125-98a2-4388-a443-7958399f026d tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:00.465274 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5ed3a125-98a2-4388-a443-7958399f026d tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:00.466028 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5ed3a125-98a2-4388-a443-7958399f026d tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:00.466540 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5ed3a125-98a2-4388-a443-7958399f026d tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:00.470134 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5ed3a125-98a2-4388-a443-7958399f026d tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:00.477101 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:45:00.785862 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-8806d5f7-051f-4477-a1e1-82d4f78f239a tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Flavor limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:45:00.786584 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-8806d5f7-051f-4477-a1e1-82d4f78f239a tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Image limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:45:00.787094 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-8806d5f7-051f-4477-a1e1-82d4f78f239a tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Flavor pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:45:00.787519 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-8806d5f7-051f-4477-a1e1-82d4f78f239a tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Image pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:45:00.787943 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-8806d5f7-051f-4477-a1e1-82d4f78f239a tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:45:00.800915 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8806d5f7-051f-4477-a1e1-82d4f78f239a tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:00.801686 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8806d5f7-051f-4477-a1e1-82d4f78f239a tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:00.802239 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8806d5f7-051f-4477-a1e1-82d4f78f239a tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:00.803240 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8806d5f7-051f-4477-a1e1-82d4f78f239a tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:00.803924 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8806d5f7-051f-4477-a1e1-82d4f78f239a tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:00.804561 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8806d5f7-051f-4477-a1e1-82d4f78f239a tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:00.817448 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:45:00.829608 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-8806d5f7-051f-4477-a1e1-82d4f78f239a tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Getting quotas for project eb2e83a4c2af45b49c6f23de08547160. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:45:00.837892 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-8806d5f7-051f-4477-a1e1-82d4f78f239a tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Getting quotas for user 9454949c8d794b6093d7d4fc64d12c33 and project eb2e83a4c2af45b49c6f23de08547160. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:45:00.855433 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8806d5f7-051f-4477-a1e1-82d4f78f239a tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Going to run 1 instances... {{(pid=121001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:45:00.858502 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8806d5f7-051f-4477-a1e1-82d4f78f239a tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: f9ea8cc2-b198-43e0-bc40-252eebf55631] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:45:01.002132 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8806d5f7-051f-4477-a1e1-82d4f78f239a tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.911440 Oct 27 03:45:01.004441 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2901/5522] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:45:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 916 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 03:45:01.019876 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e36cecbf-804b-49c3-9c75-339a2ecca8e8 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:01.039721 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e36cecbf-804b-49c3-9c75-339a2ecca8e8 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] [instance: af90f208-7b8a-4ae4-a654-5fc632279527] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:01.060637 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e36cecbf-804b-49c3-9c75-339a2ecca8e8 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:01.061535 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e36cecbf-804b-49c3-9c75-339a2ecca8e8 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:01.064495 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e36cecbf-804b-49c3-9c75-339a2ecca8e8 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:01.065610 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e36cecbf-804b-49c3-9c75-339a2ecca8e8 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:01.068075 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e36cecbf-804b-49c3-9c75-339a2ecca8e8 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:01.069155 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e36cecbf-804b-49c3-9c75-339a2ecca8e8 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:01.104106 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-e36cecbf-804b-49c3-9c75-339a2ecca8e8 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] HTTP exception thrown: Instance af90f208-7b8a-4ae4-a654-5fc632279527 could not be found. Oct 27 03:45:01.104106 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e36cecbf-804b-49c3-9c75-339a2ecca8e8 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Request method failure captured: Oct 27 03:45:01.104106 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/af90f208-7b8a-4ae4-a654-5fc632279527 HTTP/1.1 Oct 27 03:45:01.104106 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:45:01.104106 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:45:01.104106 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:45:01.104106 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:45:01.104106 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:45:01.104106 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:45:01.104106 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:45:01.104106 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:45:01.104106 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWf5ox0QfJKdnOIvnIwQmgZZAMKWnruwUwcBChXgtHVeMdZm1ENAqKwvR81ho4TUhPfskYCI1ORIjPloCus5V8HjyxRd-LoaDVBNyHrSPMV9E_L6Sf1v29SnzvsCDEAuGSNftSR6KvNnhZM1WFYppgSGH2Sq4RCYYhA5rDw5QbelA3NQ Oct 27 03:45:01.104106 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:45:01.104106 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:45:01.104106 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:45:01.104106 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:45:01.104106 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:45:01.104106 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:45:01.104106 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: e4f0730b38a946759ea32c36f5876eb3 Oct 27 03:45:01.104106 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-827960924 Oct 27 03:45:01.104106 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:45:01.104106 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:45:01.104106 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e4f0730b38a946759ea32c36f5876eb3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e4f0730b38a946759ea32c36f5876eb3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e4f0730b38a946759ea32c36f5876eb3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e4f0730b38a946759ea32c36f5876eb3"}]}] Oct 27 03:45:01.104106 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-827960924 Oct 27 03:45:01.104106 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: e4f0730b38a946759ea32c36f5876eb3 Oct 27 03:45:01.104106 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-827960924 Oct 27 03:45:01.104106 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServerRescueTestJSONUnderV235-827960924-project Oct 27 03:45:01.104106 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:45:01.104106 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:45:01.104106 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: ae9ddb0e44024937865411a7d2c3d956 Oct 27 03:45:01.104106 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-827960924-project Oct 27 03:45:01.104106 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:45:01.104106 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance af90f208-7b8a-4ae4-a654-5fc632279527 could not be found. Oct 27 03:45:01.104106 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': 'af90f208-7b8a-4ae4-a654-5fc632279527'} Oct 27 03:45:01.104106 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:45:01.104106 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:45:01.104106 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:45:01.104106 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:45:01.104106 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:45:01.104106 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:45:01.104106 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:45:01.104106 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:45:01.104106 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:45:01.104106 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:45:01.104106 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af90f208-7b8a-4ae4-a654-5fc632279527 could not be found. Oct 27 03:45:01.104106 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:45:01.104106 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:45:01.104106 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:45:01.104106 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:45:01.104106 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:45:01.104106 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:45:01.104106 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:45:01.104106 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:45:01.104106 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:45:01.104106 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:45:01.104106 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:45:01.104106 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:45:01.104106 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:45:01.104106 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:45:01.104106 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:45:01.108818 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:45:01.108818 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af90f208-7b8a-4ae4-a654-5fc632279527 could not be found. Oct 27 03:45:01.108818 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:45:01.108818 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:45:01.108818 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:45:01.108818 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:45:01.108818 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:45:01.108818 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:45:01.108818 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:45:01.108818 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:45:01.108818 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af90f208-7b8a-4ae4-a654-5fc632279527 could not be found. Oct 27 03:45:01.108818 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:45:01.108818 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e36cecbf-804b-49c3-9c75-339a2ecca8e8 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] Returning 404 to user: Instance af90f208-7b8a-4ae4-a654-5fc632279527 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:45:01.108818 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e36cecbf-804b-49c3-9c75-339a2ecca8e8 tempest-ServerRescueTestJSONUnderV235-827960924 tempest-ServerRescueTestJSONUnderV235-827960924-project] 10.222.0.20 "GET /compute/v2.1/servers/af90f208-7b8a-4ae4-a654-5fc632279527" status: 404 len: 111 microversion: 2.1 time: 0.090260 Oct 27 03:45:01.124325 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2902/5523] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:45:01 2022] GET /compute/v2.1/servers/af90f208-7b8a-4ae4-a654-5fc632279527 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:45:01.142627 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8955042d-cbe7-4284-a893-72bcd230165b tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:01.144803 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8955042d-cbe7-4284-a893-72bcd230165b tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: f9ea8cc2-b198-43e0-bc40-252eebf55631] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:01.384550 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5ed3a125-98a2-4388-a443-7958399f026d tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:01.417644 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5ed3a125-98a2-4388-a443-7958399f026d tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1" status: 200 len: 1714 microversion: 2.1 time: 0.967691 Oct 27 03:45:01.434379 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2622/5524] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:45:00 2022] GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1 => generated 1714 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:45:01.435064 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8955042d-cbe7-4284-a893-72bcd230165b tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:01.435307 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-718d336e-a4b4-4a87-962a-742a1e52c44b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:01.435307 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-718d336e-a4b4-4a87-962a-742a1e52c44b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 1db2318e-9ac7-4994-8daa-14ae22537d5d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:01.443176 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8955042d-cbe7-4284-a893-72bcd230165b tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/f9ea8cc2-b198-43e0-bc40-252eebf55631" status: 200 len: 1217 microversion: 2.1 time: 0.315290 Oct 27 03:45:01.444730 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2903/5525] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:45:01 2022] GET /compute/v2.1/servers/f9ea8cc2-b198-43e0-bc40-252eebf55631 => generated 1217 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:45:01.448428 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-718d336e-a4b4-4a87-962a-742a1e52c44b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:01.450670 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-718d336e-a4b4-4a87-962a-742a1e52c44b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:01.454748 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-718d336e-a4b4-4a87-962a-742a1e52c44b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:01.455675 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-718d336e-a4b4-4a87-962a-742a1e52c44b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:01.456297 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-718d336e-a4b4-4a87-962a-742a1e52c44b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:01.456846 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-718d336e-a4b4-4a87-962a-742a1e52c44b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:01.695430 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-cd942673-daab-44b5-941c-5d8a081da89b tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:01.696177 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-cd942673-daab-44b5-941c-5d8a081da89b tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: dbdbec9a-f4bf-4740-ab67-3c8891e341a1] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:01.771166 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cd942673-daab-44b5-941c-5d8a081da89b tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:01.773132 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cd942673-daab-44b5-941c-5d8a081da89b tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:01.775953 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cd942673-daab-44b5-941c-5d8a081da89b tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:01.777881 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cd942673-daab-44b5-941c-5d8a081da89b tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:01.779403 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cd942673-daab-44b5-941c-5d8a081da89b tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:01.781607 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cd942673-daab-44b5-941c-5d8a081da89b tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:02.030446 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-cd942673-daab-44b5-941c-5d8a081da89b tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] HTTP exception thrown: Cannot 'detach_volume' instance dbdbec9a-f4bf-4740-ab67-3c8891e341a1 while it is in vm_state rescued Oct 27 03:45:02.036541 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-cd942673-daab-44b5-941c-5d8a081da89b tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Request method failure captured: Oct 27 03:45:02.036541 n-d-862769-1 devstack@n-api.service[121001]: request: DELETE /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1/os-volume_attachments/c7f5d06b-4c82-4323-989e-6306c263cb6f HTTP/1.1 Oct 27 03:45:02.036541 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:45:02.036541 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:45:02.036541 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:45:02.036541 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:45:02.036541 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:45:02.036541 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:45:02.036541 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:45:02.036541 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:45:02.036541 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWf3uUTnEN6JEj9qTF9cAY0BLnY-YCL30UQa3hBWeUb1dNx6UaDGQTlfRNfawcK1WUPI3AVcIhTKI_7viSsI0VCiS7DswtiywtZ-RbWwufMeio2Ivv3GBrhAaC4UKKUNrtl6wYtdRVU_yfZaWJd2e4jOiCo3IliQOw95nmGOg5mVlF04 Oct 27 03:45:02.036541 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:45:02.036541 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:45:02.036541 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:45:02.036541 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:45:02.036541 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:45:02.036541 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:45:02.036541 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: e1f3ed7ef6c648c9ac771fbaadde1d0c Oct 27 03:45:02.036541 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-143118573 Oct 27 03:45:02.036541 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:45:02.036541 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:45:02.036541 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e1f3ed7ef6c648c9ac771fbaadde1d0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e1f3ed7ef6c648c9ac771fbaadde1d0c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e1f3ed7ef6c648c9ac771fbaadde1d0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e1f3ed7ef6c648c9ac771fbaadde1d0c"}]}] Oct 27 03:45:02.036541 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServerRescueNegativeTestJSON-143118573 Oct 27 03:45:02.036541 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: e1f3ed7ef6c648c9ac771fbaadde1d0c Oct 27 03:45:02.036541 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-143118573 Oct 27 03:45:02.036541 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServerRescueNegativeTestJSON-143118573-project Oct 27 03:45:02.036541 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:45:02.036541 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:45:02.036541 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 43172c9e71704c869a25181574d67b35 Oct 27 03:45:02.036541 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServerRescueNegativeTestJSON-143118573-project Oct 27 03:45:02.036541 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:45:02.036541 n-d-862769-1 devstack@n-api.service[121001]: exception: Cannot 'detach_volume' instance dbdbec9a-f4bf-4740-ab67-3c8891e341a1 while it is in vm_state rescued Oct 27 03:45:02.036541 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'server_id': 'dbdbec9a-f4bf-4740-ab67-3c8891e341a1', 'id': 'c7f5d06b-4c82-4323-989e-6306c263cb6f'} Oct 27 03:45:02.036541 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:45:02.036541 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:45:02.036541 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 27 03:45:02.036541 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 27 03:45:02.036541 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 03:45:02.036541 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 03:45:02.036541 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 27 03:45:02.036541 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 27 03:45:02.036541 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance dbdbec9a-f4bf-4740-ab67-3c8891e341a1 in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 27 03:45:02.036541 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:45:02.036541 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:45:02.036541 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:45:02.036541 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:45:02.036541 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:45:02.036541 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:45:02.036541 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:45:02.036541 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:45:02.036541 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:45:02.036541 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:45:02.036541 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 27 03:45:02.036541 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 27 03:45:02.036541 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 27 03:45:02.036541 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 27 03:45:02.036541 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance dbdbec9a-f4bf-4740-ab67-3c8891e341a1 while it is in vm_state rescued Oct 27 03:45:02.036541 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:45:02.036541 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:45:02.036541 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:45:02.036541 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:45:02.041480 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:45:02.041480 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:45:02.041480 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:45:02.041480 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:45:02.041480 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance dbdbec9a-f4bf-4740-ab67-3c8891e341a1 while it is in vm_state rescued Oct 27 03:45:02.041480 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:45:02.041480 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-cd942673-daab-44b5-941c-5d8a081da89b tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Returning 409 to user: Cannot 'detach_volume' instance dbdbec9a-f4bf-4740-ab67-3c8891e341a1 while it is in vm_state rescued {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:45:02.041480 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-cd942673-daab-44b5-941c-5d8a081da89b tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "DELETE /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1/os-volume_attachments/c7f5d06b-4c82-4323-989e-6306c263cb6f" status: 409 len: 152 microversion: 2.1 time: 0.350807 Oct 27 03:45:02.042008 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-718d336e-a4b4-4a87-962a-742a1e52c44b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:02.042861 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2904/5526] 10.222.0.20 () {58 vars in 1416 bytes} [Thu Oct 27 03:45:01 2022] DELETE /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1/os-volume_attachments/c7f5d06b-4c82-4323-989e-6306c263cb6f => generated 152 bytes in 352 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 27 03:45:02.052063 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-718d336e-a4b4-4a87-962a-742a1e52c44b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:02.054394 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-718d336e-a4b4-4a87-962a-742a1e52c44b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:02.055956 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-718d336e-a4b4-4a87-962a-742a1e52c44b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d" status: 200 len: 1722 microversion: 2.20 time: 0.634795 Oct 27 03:45:02.060700 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-573be9eb-7c90-4a38-b53d-372d89124101 req-1457bfcc-154e-417c-a56b-30e1acb8992e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1db2318e-9ac7-4994-8daa-14ae22537d5d", "name": "network-vif-unplugged", "status": "completed", "tag": "162a3612-f72a-4eb0-9872-8b121e85445d"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:45:02.077570 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2623/5527] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:45:01 2022] GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d => generated 1722 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:45:02.083846 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7701fe0f-abe2-4bfd-b189-6a169c31b75c tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:45:02.084787 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7701fe0f-abe2-4bfd-b189-6a169c31b75c tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: dbdbec9a-f4bf-4740-ab67-3c8891e341a1] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:02.086708 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-573be9eb-7c90-4a38-b53d-372d89124101 req-1457bfcc-154e-417c-a56b-30e1acb8992e service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:02.087219 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-573be9eb-7c90-4a38-b53d-372d89124101 req-1457bfcc-154e-417c-a56b-30e1acb8992e service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:02.089562 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-573be9eb-7c90-4a38-b53d-372d89124101 req-1457bfcc-154e-417c-a56b-30e1acb8992e service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:02.093755 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7701fe0f-abe2-4bfd-b189-6a169c31b75c tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:02.102232 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7701fe0f-abe2-4bfd-b189-6a169c31b75c tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:02.102232 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7701fe0f-abe2-4bfd-b189-6a169c31b75c tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:02.102232 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7701fe0f-abe2-4bfd-b189-6a169c31b75c tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:02.102232 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7701fe0f-abe2-4bfd-b189-6a169c31b75c tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:02.102232 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7701fe0f-abe2-4bfd-b189-6a169c31b75c tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:02.116923 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-573be9eb-7c90-4a38-b53d-372d89124101 req-1457bfcc-154e-417c-a56b-30e1acb8992e service nova] Creating event network-vif-unplugged:162a3612-f72a-4eb0-9872-8b121e85445d for instance 1db2318e-9ac7-4994-8daa-14ae22537d5d on n-h2-862769-1 Oct 27 03:45:02.137320 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-573be9eb-7c90-4a38-b53d-372d89124101 req-1457bfcc-154e-417c-a56b-30e1acb8992e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087792 Oct 27 03:45:02.141270 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2905/5528] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:45:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:45:02.430576 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7701fe0f-abe2-4bfd-b189-6a169c31b75c tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "POST /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1/action" status: 202 len: 0 microversion: 2.1 time: 0.351238 Oct 27 03:45:02.440370 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0c77a77e-6b30-4a7c-8926-4cce7ef4db66 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:02.441074 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0c77a77e-6b30-4a7c-8926-4cce7ef4db66 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: dbdbec9a-f4bf-4740-ab67-3c8891e341a1] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:02.444158 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2624/5529] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:45:02 2022] POST /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1/action => generated 0 bytes in 366 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:45:02.458656 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0c77a77e-6b30-4a7c-8926-4cce7ef4db66 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:02.459185 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0c77a77e-6b30-4a7c-8926-4cce7ef4db66 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:02.464494 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0c77a77e-6b30-4a7c-8926-4cce7ef4db66 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:02.465422 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0c77a77e-6b30-4a7c-8926-4cce7ef4db66 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:02.465946 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0c77a77e-6b30-4a7c-8926-4cce7ef4db66 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:02.466593 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0c77a77e-6b30-4a7c-8926-4cce7ef4db66 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:02.470228 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6b0701b2-1d41-4d75-8519-e2f0dc6236a1 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:02.472035 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6b0701b2-1d41-4d75-8519-e2f0dc6236a1 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: f9ea8cc2-b198-43e0-bc40-252eebf55631] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:02.937440 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-6b0701b2-1d41-4d75-8519-e2f0dc6236a1 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:02.948825 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6b0701b2-1d41-4d75-8519-e2f0dc6236a1 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/f9ea8cc2-b198-43e0-bc40-252eebf55631" status: 200 len: 1217 microversion: 2.1 time: 0.483696 Oct 27 03:45:02.950103 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2625/5530] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:45:02 2022] GET /compute/v2.1/servers/f9ea8cc2-b198-43e0-bc40-252eebf55631 => generated 1217 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:45:03.099293 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-aa3cb544-0b08-423c-aa17-e44dff63402b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:03.100424 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-aa3cb544-0b08-423c-aa17-e44dff63402b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 1db2318e-9ac7-4994-8daa-14ae22537d5d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:03.132073 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aa3cb544-0b08-423c-aa17-e44dff63402b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:03.132996 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aa3cb544-0b08-423c-aa17-e44dff63402b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:03.133617 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aa3cb544-0b08-423c-aa17-e44dff63402b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:03.156034 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aa3cb544-0b08-423c-aa17-e44dff63402b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:03.156034 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aa3cb544-0b08-423c-aa17-e44dff63402b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:03.156034 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aa3cb544-0b08-423c-aa17-e44dff63402b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:03.192894 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0c77a77e-6b30-4a7c-8926-4cce7ef4db66 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:03.205319 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0c77a77e-6b30-4a7c-8926-4cce7ef4db66 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1" status: 200 len: 1722 microversion: 2.1 time: 0.769252 Oct 27 03:45:03.205965 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2906/5531] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:45:02 2022] GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1 => generated 1722 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:45:03.708256 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-aa3cb544-0b08-423c-aa17-e44dff63402b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:03.732702 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-aa3cb544-0b08-423c-aa17-e44dff63402b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:03.743775 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-aa3cb544-0b08-423c-aa17-e44dff63402b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:03.745065 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-aa3cb544-0b08-423c-aa17-e44dff63402b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d" status: 200 len: 1722 microversion: 2.20 time: 0.665236 Oct 27 03:45:03.745657 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2626/5532] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:45:03 2022] GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d => generated 1722 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:45:03.978559 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9f9d3d86-fa23-486a-87f6-8f1b097431f9 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:03.979460 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-9f9d3d86-fa23-486a-87f6-8f1b097431f9 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: f9ea8cc2-b198-43e0-bc40-252eebf55631] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:03.989660 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9f9d3d86-fa23-486a-87f6-8f1b097431f9 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:03.991420 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9f9d3d86-fa23-486a-87f6-8f1b097431f9 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:03.992097 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9f9d3d86-fa23-486a-87f6-8f1b097431f9 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:03.993015 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9f9d3d86-fa23-486a-87f6-8f1b097431f9 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:03.993656 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9f9d3d86-fa23-486a-87f6-8f1b097431f9 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:03.994306 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9f9d3d86-fa23-486a-87f6-8f1b097431f9 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:04.141637 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9f9d3d86-fa23-486a-87f6-8f1b097431f9 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:04.153799 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9f9d3d86-fa23-486a-87f6-8f1b097431f9 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/f9ea8cc2-b198-43e0-bc40-252eebf55631" status: 200 len: 1269 microversion: 2.1 time: 0.180416 Oct 27 03:45:04.155755 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2907/5533] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:45:03 2022] GET /compute/v2.1/servers/f9ea8cc2-b198-43e0-bc40-252eebf55631 => generated 1269 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:45:04.241256 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-582bf392-baab-452e-8166-78c00a459dc4 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:04.253458 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-582bf392-baab-452e-8166-78c00a459dc4 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: dbdbec9a-f4bf-4740-ab67-3c8891e341a1] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:04.261346 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-582bf392-baab-452e-8166-78c00a459dc4 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:04.265944 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-582bf392-baab-452e-8166-78c00a459dc4 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:04.265944 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-582bf392-baab-452e-8166-78c00a459dc4 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:04.272639 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-582bf392-baab-452e-8166-78c00a459dc4 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:04.273467 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-582bf392-baab-452e-8166-78c00a459dc4 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:04.274126 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-582bf392-baab-452e-8166-78c00a459dc4 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:04.361078 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8ebe7bd6-66b7-4fa7-9930-928e59df7712 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:04.363093 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8ebe7bd6-66b7-4fa7-9930-928e59df7712 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: ce85aa86-fbba-4eca-97e8-173da3cdc7c3] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:04.371170 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8ebe7bd6-66b7-4fa7-9930-928e59df7712 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:04.372576 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8ebe7bd6-66b7-4fa7-9930-928e59df7712 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:04.372576 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8ebe7bd6-66b7-4fa7-9930-928e59df7712 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:04.372799 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8ebe7bd6-66b7-4fa7-9930-928e59df7712 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:04.373575 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8ebe7bd6-66b7-4fa7-9930-928e59df7712 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:04.374201 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8ebe7bd6-66b7-4fa7-9930-928e59df7712 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:04.402291 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-8ebe7bd6-66b7-4fa7-9930-928e59df7712 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] HTTP exception thrown: Instance ce85aa86-fbba-4eca-97e8-173da3cdc7c3 could not be found. Oct 27 03:45:04.407254 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8ebe7bd6-66b7-4fa7-9930-928e59df7712 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Request method failure captured: Oct 27 03:45:04.407254 n-d-862769-1 devstack@n-api.service[121001]: request: DELETE /compute/v2.1/servers/ce85aa86-fbba-4eca-97e8-173da3cdc7c3 HTTP/1.1 Oct 27 03:45:04.407254 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:45:04.407254 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:45:04.407254 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:45:04.407254 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:45:04.407254 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:45:04.407254 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:45:04.407254 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:45:04.407254 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:45:04.407254 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWf1ZZNjkPjFpbma6U1a30rpW5rz2pgrrBz2Y-zebQ7kUx-XZ8725TKvqHb0qLGWkMX-Aib9FY_k_pJogL520cMR3ZWJWChbAePna2V7kBQy-Nbm9LJN4yabkkyXR2yEa_L7dWwYV9fWj_rKrXm3kLnzTBx9MHVV6fRMUhXnJRxMN3ek Oct 27 03:45:04.407254 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:45:04.407254 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:45:04.407254 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:45:04.407254 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:45:04.407254 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:45:04.407254 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:45:04.407254 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 38450368ef5c4e68ac3c19c7a0a1ce65 Oct 27 03:45:04.407254 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-AttachVolumeTestJSON-1593697068 Oct 27 03:45:04.407254 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:45:04.407254 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:45:04.407254 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/38450368ef5c4e68ac3c19c7a0a1ce65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/38450368ef5c4e68ac3c19c7a0a1ce65"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/38450368ef5c4e68ac3c19c7a0a1ce65"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_38450368ef5c4e68ac3c19c7a0a1ce65"}]}] Oct 27 03:45:04.407254 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-AttachVolumeTestJSON-1593697068 Oct 27 03:45:04.407254 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 38450368ef5c4e68ac3c19c7a0a1ce65 Oct 27 03:45:04.407254 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1593697068 Oct 27 03:45:04.407254 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-AttachVolumeTestJSON-1593697068-project Oct 27 03:45:04.407254 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:45:04.407254 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:45:04.407254 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 5ffc2b1c410149e884a47240b5425e57 Oct 27 03:45:04.407254 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-AttachVolumeTestJSON-1593697068-project Oct 27 03:45:04.407254 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:45:04.407254 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance ce85aa86-fbba-4eca-97e8-173da3cdc7c3 could not be found. Oct 27 03:45:04.407254 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': 'ce85aa86-fbba-4eca-97e8-173da3cdc7c3'} Oct 27 03:45:04.407254 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:45:04.407254 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:45:04.407254 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:45:04.407254 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:45:04.407254 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:45:04.407254 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:45:04.407254 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:45:04.407254 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:45:04.407254 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:45:04.407254 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:45:04.407254 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce85aa86-fbba-4eca-97e8-173da3cdc7c3 could not be found. Oct 27 03:45:04.407254 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:45:04.407254 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:45:04.407254 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:45:04.407254 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:45:04.407254 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:45:04.407254 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:45:04.407254 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:45:04.407254 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:45:04.407254 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:45:04.407254 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:45:04.407254 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 03:45:04.407254 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 03:45:04.407254 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 03:45:04.407254 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 03:45:04.407254 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:45:04.407254 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:45:04.407254 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:45:04.407254 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:45:04.413984 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce85aa86-fbba-4eca-97e8-173da3cdc7c3 could not be found. Oct 27 03:45:04.413984 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:45:04.413984 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:45:04.413984 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:45:04.413984 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:45:04.413984 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:45:04.413984 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:45:04.413984 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:45:04.413984 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:45:04.413984 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce85aa86-fbba-4eca-97e8-173da3cdc7c3 could not be found. Oct 27 03:45:04.413984 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:45:04.413984 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8ebe7bd6-66b7-4fa7-9930-928e59df7712 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Returning 404 to user: Instance ce85aa86-fbba-4eca-97e8-173da3cdc7c3 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:45:04.413984 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8ebe7bd6-66b7-4fa7-9930-928e59df7712 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ce85aa86-fbba-4eca-97e8-173da3cdc7c3" status: 404 len: 111 microversion: 2.1 time: 0.049150 Oct 27 03:45:04.417573 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2908/5534] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:45:04 2022] DELETE /compute/v2.1/servers/ce85aa86-fbba-4eca-97e8-173da3cdc7c3 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:45:04.428950 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9b595411-39fb-4c3a-82da-8911769deb85 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:04.429589 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-9b595411-39fb-4c3a-82da-8911769deb85 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: ce85aa86-fbba-4eca-97e8-173da3cdc7c3] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:04.448932 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9b595411-39fb-4c3a-82da-8911769deb85 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:04.449440 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9b595411-39fb-4c3a-82da-8911769deb85 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:04.449890 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9b595411-39fb-4c3a-82da-8911769deb85 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:04.462573 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9b595411-39fb-4c3a-82da-8911769deb85 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:04.463215 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9b595411-39fb-4c3a-82da-8911769deb85 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:04.463692 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9b595411-39fb-4c3a-82da-8911769deb85 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:04.484067 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-9b595411-39fb-4c3a-82da-8911769deb85 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] HTTP exception thrown: Instance ce85aa86-fbba-4eca-97e8-173da3cdc7c3 could not be found. Oct 27 03:45:04.485661 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9b595411-39fb-4c3a-82da-8911769deb85 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Request method failure captured: Oct 27 03:45:04.485661 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/ce85aa86-fbba-4eca-97e8-173da3cdc7c3 HTTP/1.1 Oct 27 03:45:04.485661 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:45:04.485661 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:45:04.485661 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:45:04.485661 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:45:04.485661 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:45:04.485661 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:45:04.485661 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:45:04.485661 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:45:04.485661 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWf1ZZNjkPjFpbma6U1a30rpW5rz2pgrrBz2Y-zebQ7kUx-XZ8725TKvqHb0qLGWkMX-Aib9FY_k_pJogL520cMR3ZWJWChbAePna2V7kBQy-Nbm9LJN4yabkkyXR2yEa_L7dWwYV9fWj_rKrXm3kLnzTBx9MHVV6fRMUhXnJRxMN3ek Oct 27 03:45:04.485661 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:45:04.485661 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:45:04.485661 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:45:04.485661 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:45:04.485661 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:45:04.485661 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:45:04.485661 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 38450368ef5c4e68ac3c19c7a0a1ce65 Oct 27 03:45:04.485661 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-AttachVolumeTestJSON-1593697068 Oct 27 03:45:04.485661 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:45:04.485661 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:45:04.485661 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/38450368ef5c4e68ac3c19c7a0a1ce65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/38450368ef5c4e68ac3c19c7a0a1ce65"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/38450368ef5c4e68ac3c19c7a0a1ce65"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_38450368ef5c4e68ac3c19c7a0a1ce65"}]}] Oct 27 03:45:04.485661 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-AttachVolumeTestJSON-1593697068 Oct 27 03:45:04.485661 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 38450368ef5c4e68ac3c19c7a0a1ce65 Oct 27 03:45:04.485661 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1593697068 Oct 27 03:45:04.485661 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-AttachVolumeTestJSON-1593697068-project Oct 27 03:45:04.485661 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:45:04.485661 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:45:04.485661 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 5ffc2b1c410149e884a47240b5425e57 Oct 27 03:45:04.485661 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-AttachVolumeTestJSON-1593697068-project Oct 27 03:45:04.485661 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:45:04.485661 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance ce85aa86-fbba-4eca-97e8-173da3cdc7c3 could not be found. Oct 27 03:45:04.485661 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': 'ce85aa86-fbba-4eca-97e8-173da3cdc7c3'} Oct 27 03:45:04.485661 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:45:04.485661 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:45:04.485661 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:45:04.485661 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:45:04.485661 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:45:04.485661 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:45:04.485661 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:45:04.485661 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:45:04.485661 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:45:04.485661 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:45:04.485661 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce85aa86-fbba-4eca-97e8-173da3cdc7c3 could not be found. Oct 27 03:45:04.485661 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:45:04.485661 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:45:04.485661 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:45:04.485661 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:45:04.485661 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:45:04.485661 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:45:04.485661 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:45:04.485661 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:45:04.485661 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:45:04.485661 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:45:04.485661 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:45:04.485661 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:45:04.485661 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:45:04.485661 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:45:04.485661 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:45:04.485661 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:45:04.485661 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce85aa86-fbba-4eca-97e8-173da3cdc7c3 could not be found. Oct 27 03:45:04.485661 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:45:04.485661 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:45:04.485661 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:45:04.491147 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:45:04.491147 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:45:04.491147 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:45:04.491147 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:45:04.491147 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:45:04.491147 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce85aa86-fbba-4eca-97e8-173da3cdc7c3 could not be found. Oct 27 03:45:04.491147 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:45:04.504818 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9b595411-39fb-4c3a-82da-8911769deb85 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Returning 404 to user: Instance ce85aa86-fbba-4eca-97e8-173da3cdc7c3 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:45:04.510296 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9b595411-39fb-4c3a-82da-8911769deb85 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "GET /compute/v2.1/servers/ce85aa86-fbba-4eca-97e8-173da3cdc7c3" status: 404 len: 111 microversion: 2.1 time: 0.091331 Oct 27 03:45:04.521804 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2909/5535] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:45:04 2022] GET /compute/v2.1/servers/ce85aa86-fbba-4eca-97e8-173da3cdc7c3 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:45:04.535909 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-f46b1143-bc49-44b7-8103-65b83b95b572 req-a87454d1-4384-4ef4-8d50-be626c598daa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3fcf361-2e24-402c-8290-6bc77b1125fa", "name": "network-vif-deleted", "tag": "cb4aafd8-0533-425c-84b7-290165d4cdea"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:45:04.567169 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-f46b1143-bc49-44b7-8103-65b83b95b572 req-a87454d1-4384-4ef4-8d50-be626c598daa service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:04.572451 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-f46b1143-bc49-44b7-8103-65b83b95b572 req-a87454d1-4384-4ef4-8d50-be626c598daa service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:04.573078 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-f46b1143-bc49-44b7-8103-65b83b95b572 req-a87454d1-4384-4ef4-8d50-be626c598daa service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:04.599141 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-f46b1143-bc49-44b7-8103-65b83b95b572 req-a87454d1-4384-4ef4-8d50-be626c598daa service nova] Creating event network-vif-deleted:cb4aafd8-0533-425c-84b7-290165d4cdea for instance f3fcf361-2e24-402c-8290-6bc77b1125fa on n-h2-862769-1 Oct 27 03:45:04.619986 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-f46b1143-bc49-44b7-8103-65b83b95b572 req-a87454d1-4384-4ef4-8d50-be626c598daa service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095819 Oct 27 03:45:04.620986 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2910/5536] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:45:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:45:04.777551 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c043d606-f159-4b8b-aaf4-2eb6bb047e9b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:04.778332 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c043d606-f159-4b8b-aaf4-2eb6bb047e9b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 1db2318e-9ac7-4994-8daa-14ae22537d5d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:04.805108 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c043d606-f159-4b8b-aaf4-2eb6bb047e9b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:04.806314 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c043d606-f159-4b8b-aaf4-2eb6bb047e9b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:04.806314 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c043d606-f159-4b8b-aaf4-2eb6bb047e9b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:04.806765 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c043d606-f159-4b8b-aaf4-2eb6bb047e9b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:04.813406 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c043d606-f159-4b8b-aaf4-2eb6bb047e9b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:04.814560 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c043d606-f159-4b8b-aaf4-2eb6bb047e9b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:05.262888 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c043d606-f159-4b8b-aaf4-2eb6bb047e9b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:05.295375 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c043d606-f159-4b8b-aaf4-2eb6bb047e9b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:05.313375 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c043d606-f159-4b8b-aaf4-2eb6bb047e9b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:05.320250 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c043d606-f159-4b8b-aaf4-2eb6bb047e9b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d" status: 200 len: 1665 microversion: 2.20 time: 0.551810 Oct 27 03:45:05.323041 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2911/5537] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:45:04 2022] GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d => generated 1665 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:45:05.343828 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5f9c7402-3d2a-4f10-8966-24e0369c8387 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:05.345843 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5f9c7402-3d2a-4f10-8966-24e0369c8387 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: f9ea8cc2-b198-43e0-bc40-252eebf55631] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:05.366679 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5f9c7402-3d2a-4f10-8966-24e0369c8387 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:05.392637 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5f9c7402-3d2a-4f10-8966-24e0369c8387 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:05.396187 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5f9c7402-3d2a-4f10-8966-24e0369c8387 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:05.397189 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5f9c7402-3d2a-4f10-8966-24e0369c8387 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:05.398729 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5f9c7402-3d2a-4f10-8966-24e0369c8387 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:05.401583 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5f9c7402-3d2a-4f10-8966-24e0369c8387 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:05.706852 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-582bf392-baab-452e-8166-78c00a459dc4 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:05.719840 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-582bf392-baab-452e-8166-78c00a459dc4 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1" status: 200 len: 1722 microversion: 2.1 time: 1.485920 Oct 27 03:45:05.720465 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2627/5538] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:45:04 2022] GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1 => generated 1722 bytes in 1488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:45:05.752970 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-14d4a77c-d594-4c83-909e-c700b5affcc8 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "05edc904-157f-4bc7-bae8-e5ca6254c30d"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:45:05.769009 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-14d4a77c-d594-4c83-909e-c700b5affcc8 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 1db2318e-9ac7-4994-8daa-14ae22537d5d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:05.779069 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-14d4a77c-d594-4c83-909e-c700b5affcc8 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:05.782791 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-14d4a77c-d594-4c83-909e-c700b5affcc8 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:05.784884 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-14d4a77c-d594-4c83-909e-c700b5affcc8 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:05.786823 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-14d4a77c-d594-4c83-909e-c700b5affcc8 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:05.788881 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-14d4a77c-d594-4c83-909e-c700b5affcc8 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:05.793268 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-14d4a77c-d594-4c83-909e-c700b5affcc8 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:06.177172 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5f9c7402-3d2a-4f10-8966-24e0369c8387 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:06.190787 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5f9c7402-3d2a-4f10-8966-24e0369c8387 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/f9ea8cc2-b198-43e0-bc40-252eebf55631" status: 200 len: 1275 microversion: 2.1 time: 0.864564 Oct 27 03:45:06.195661 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2912/5539] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:45:05 2022] GET /compute/v2.1/servers/f9ea8cc2-b198-43e0-bc40-252eebf55631 => generated 1275 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:45:06.748634 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-cfaaf44f-6469-4a3d-9740-e63d11509178 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:06.749261 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-cfaaf44f-6469-4a3d-9740-e63d11509178 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: dbdbec9a-f4bf-4740-ab67-3c8891e341a1] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:06.761623 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cfaaf44f-6469-4a3d-9740-e63d11509178 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:06.762159 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cfaaf44f-6469-4a3d-9740-e63d11509178 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:06.762613 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cfaaf44f-6469-4a3d-9740-e63d11509178 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:06.763341 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cfaaf44f-6469-4a3d-9740-e63d11509178 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:06.763805 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cfaaf44f-6469-4a3d-9740-e63d11509178 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:06.764242 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cfaaf44f-6469-4a3d-9740-e63d11509178 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:07.189191 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-cfaaf44f-6469-4a3d-9740-e63d11509178 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:07.205358 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-cfaaf44f-6469-4a3d-9740-e63d11509178 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1" status: 200 len: 1722 microversion: 2.1 time: 0.460968 Oct 27 03:45:07.221899 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2913/5540] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:45:06 2022] GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1 => generated 1722 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:45:07.239520 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5b416ee6-49d2-494d-bc67-f51b2634080b tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:07.239520 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5b416ee6-49d2-494d-bc67-f51b2634080b tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: f9ea8cc2-b198-43e0-bc40-252eebf55631] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:07.245522 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5b416ee6-49d2-494d-bc67-f51b2634080b tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:07.246744 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5b416ee6-49d2-494d-bc67-f51b2634080b tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:07.247217 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5b416ee6-49d2-494d-bc67-f51b2634080b tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:07.247958 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5b416ee6-49d2-494d-bc67-f51b2634080b tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:07.253573 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5b416ee6-49d2-494d-bc67-f51b2634080b tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:07.254392 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5b416ee6-49d2-494d-bc67-f51b2634080b tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:07.321619 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-14d4a77c-d594-4c83-909e-c700b5affcc8 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "POST /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.580189 Oct 27 03:45:07.328548 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2628/5541] 10.222.0.20 () {62 vars in 1364 bytes} [Thu Oct 27 03:45:05 2022] POST /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d/os-volume_attachments => generated 188 bytes in 1584 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 03:45:07.452016 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5b416ee6-49d2-494d-bc67-f51b2634080b tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:07.475280 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5b416ee6-49d2-494d-bc67-f51b2634080b tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/f9ea8cc2-b198-43e0-bc40-252eebf55631" status: 200 len: 1275 microversion: 2.1 time: 0.236520 Oct 27 03:45:07.475280 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2914/5542] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:45:07 2022] GET /compute/v2.1/servers/f9ea8cc2-b198-43e0-bc40-252eebf55631 => generated 1275 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:45:07.585241 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1a978859-885e-418a-85ee-4e480e2fd5c4 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:07.586152 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1a978859-885e-418a-85ee-4e480e2fd5c4 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 1db2318e-9ac7-4994-8daa-14ae22537d5d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:07.594632 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1a978859-885e-418a-85ee-4e480e2fd5c4 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:07.595761 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1a978859-885e-418a-85ee-4e480e2fd5c4 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:07.597104 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1a978859-885e-418a-85ee-4e480e2fd5c4 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:07.598121 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1a978859-885e-418a-85ee-4e480e2fd5c4 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:07.598823 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1a978859-885e-418a-85ee-4e480e2fd5c4 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:07.599503 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1a978859-885e-418a-85ee-4e480e2fd5c4 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:08.236324 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5fce6c9c-d866-44c0-9e77-2d89882a2b71 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:08.237923 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5fce6c9c-d866-44c0-9e77-2d89882a2b71 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: dbdbec9a-f4bf-4740-ab67-3c8891e341a1] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:08.253806 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5fce6c9c-d866-44c0-9e77-2d89882a2b71 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:08.254454 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5fce6c9c-d866-44c0-9e77-2d89882a2b71 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:08.258827 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5fce6c9c-d866-44c0-9e77-2d89882a2b71 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:08.259891 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5fce6c9c-d866-44c0-9e77-2d89882a2b71 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:08.260482 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5fce6c9c-d866-44c0-9e77-2d89882a2b71 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:08.261015 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5fce6c9c-d866-44c0-9e77-2d89882a2b71 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:08.605431 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1a978859-885e-418a-85ee-4e480e2fd5c4 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d/os-volume_attachments/05edc904-157f-4bc7-bae8-e5ca6254c30d" status: 202 len: 0 microversion: 2.20 time: 1.024910 Oct 27 03:45:08.606823 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2629/5543] 10.222.0.20 () {60 vars in 1457 bytes} [Thu Oct 27 03:45:07 2022] DELETE /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d/os-volume_attachments/05edc904-157f-4bc7-bae8-e5ca6254c30d => generated 0 bytes in 1027 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:45:08.612577 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-94a7d768-f31d-41aa-82f9-465eced03a9e tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:08.613264 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-94a7d768-f31d-41aa-82f9-465eced03a9e tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: f9ea8cc2-b198-43e0-bc40-252eebf55631] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:08.642972 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-94a7d768-f31d-41aa-82f9-465eced03a9e tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:08.644854 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-94a7d768-f31d-41aa-82f9-465eced03a9e tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:08.647352 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-94a7d768-f31d-41aa-82f9-465eced03a9e tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:08.650686 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-94a7d768-f31d-41aa-82f9-465eced03a9e tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:08.653099 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-94a7d768-f31d-41aa-82f9-465eced03a9e tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:08.658012 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-94a7d768-f31d-41aa-82f9-465eced03a9e tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:08.687994 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5fce6c9c-d866-44c0-9e77-2d89882a2b71 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:08.697333 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5fce6c9c-d866-44c0-9e77-2d89882a2b71 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1" status: 200 len: 1728 microversion: 2.1 time: 0.464999 Oct 27 03:45:08.707015 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2915/5544] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:45:08 2022] GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1 => generated 1728 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:45:08.712046 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ba5544cd-cb17-4e2a-965d-32d5fa38f9f6 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:45:08.719983 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ba5544cd-cb17-4e2a-965d-32d5fa38f9f6 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 1db2318e-9ac7-4994-8daa-14ae22537d5d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:08.738289 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ba5544cd-cb17-4e2a-965d-32d5fa38f9f6 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:08.739054 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ba5544cd-cb17-4e2a-965d-32d5fa38f9f6 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:08.739730 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ba5544cd-cb17-4e2a-965d-32d5fa38f9f6 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:08.740967 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ba5544cd-cb17-4e2a-965d-32d5fa38f9f6 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:08.741656 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ba5544cd-cb17-4e2a-965d-32d5fa38f9f6 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:08.743979 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ba5544cd-cb17-4e2a-965d-32d5fa38f9f6 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:08.815096 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ba5544cd-cb17-4e2a-965d-32d5fa38f9f6 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 1db2318e-9ac7-4994-8daa-14ae22537d5d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121001) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 27 03:45:09.206778 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-94a7d768-f31d-41aa-82f9-465eced03a9e tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:09.218892 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-94a7d768-f31d-41aa-82f9-465eced03a9e tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/f9ea8cc2-b198-43e0-bc40-252eebf55631" status: 200 len: 1317 microversion: 2.1 time: 0.610797 Oct 27 03:45:09.220329 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2630/5545] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:45:08 2022] GET /compute/v2.1/servers/f9ea8cc2-b198-43e0-bc40-252eebf55631 => generated 1317 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:45:09.220952 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ba5544cd-cb17-4e2a-965d-32d5fa38f9f6 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "POST /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d/action" status: 202 len: 0 microversion: 2.20 time: 0.512814 Oct 27 03:45:09.226763 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2916/5546] 10.222.0.20 () {62 vars in 1319 bytes} [Thu Oct 27 03:45:08 2022] POST /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d/action => generated 0 bytes in 517 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:45:09.231974 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a0c5cd95-e8e6-4fb4-88ca-3c596f42606f tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:09.232613 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a0c5cd95-e8e6-4fb4-88ca-3c596f42606f tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 1db2318e-9ac7-4994-8daa-14ae22537d5d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:09.236123 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-36de50bc-6ea9-4c33-9a38-10160458d3b8 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:09.238624 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-36de50bc-6ea9-4c33-9a38-10160458d3b8 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: dbdbec9a-f4bf-4740-ab67-3c8891e341a1] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:09.245057 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:45:09.251838 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a0c5cd95-e8e6-4fb4-88ca-3c596f42606f tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:09.252874 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a0c5cd95-e8e6-4fb4-88ca-3c596f42606f tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:09.253563 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a0c5cd95-e8e6-4fb4-88ca-3c596f42606f tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:09.254847 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-36de50bc-6ea9-4c33-9a38-10160458d3b8 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:09.255011 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a0c5cd95-e8e6-4fb4-88ca-3c596f42606f tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:09.255361 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-36de50bc-6ea9-4c33-9a38-10160458d3b8 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:09.255800 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-36de50bc-6ea9-4c33-9a38-10160458d3b8 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:09.256551 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a0c5cd95-e8e6-4fb4-88ca-3c596f42606f tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:09.256999 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a0c5cd95-e8e6-4fb4-88ca-3c596f42606f tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:09.257472 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-36de50bc-6ea9-4c33-9a38-10160458d3b8 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:09.257943 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-36de50bc-6ea9-4c33-9a38-10160458d3b8 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:09.260888 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-36de50bc-6ea9-4c33-9a38-10160458d3b8 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:09.479180 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-36de50bc-6ea9-4c33-9a38-10160458d3b8 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.257270 Oct 27 03:45:09.487243 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2631/5547] 10.222.0.20 () {58 vars in 1275 bytes} [Thu Oct 27 03:45:09 2022] GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1/os-interface => generated 284 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:45:09.930674 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a0c5cd95-e8e6-4fb4-88ca-3c596f42606f tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:09.955546 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a0c5cd95-e8e6-4fb4-88ca-3c596f42606f tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:09.959974 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a0c5cd95-e8e6-4fb4-88ca-3c596f42606f tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:09.965533 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a0c5cd95-e8e6-4fb4-88ca-3c596f42606f tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d" status: 200 len: 1673 microversion: 2.20 time: 0.737351 Oct 27 03:45:09.970462 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2917/5548] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:45:09 2022] GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d => generated 1673 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:45:10.243714 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d90a526e-4c12-4580-aeb7-6bcea521d972 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:10.244972 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d90a526e-4c12-4580-aeb7-6bcea521d972 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: f9ea8cc2-b198-43e0-bc40-252eebf55631] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:10.260510 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d90a526e-4c12-4580-aeb7-6bcea521d972 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:10.261473 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d90a526e-4c12-4580-aeb7-6bcea521d972 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:10.262014 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d90a526e-4c12-4580-aeb7-6bcea521d972 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:10.262876 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d90a526e-4c12-4580-aeb7-6bcea521d972 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:10.263570 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d90a526e-4c12-4580-aeb7-6bcea521d972 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:10.264350 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d90a526e-4c12-4580-aeb7-6bcea521d972 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:10.837113 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d90a526e-4c12-4580-aeb7-6bcea521d972 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:10.846872 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d90a526e-4c12-4580-aeb7-6bcea521d972 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/f9ea8cc2-b198-43e0-bc40-252eebf55631" status: 200 len: 1317 microversion: 2.1 time: 0.606879 Oct 27 03:45:10.863323 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2632/5549] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:45:10 2022] GET /compute/v2.1/servers/f9ea8cc2-b198-43e0-bc40-252eebf55631 => generated 1317 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:45:10.998802 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e24fe01b-9500-4e38-a300-0dfdb97c50cb tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:10.999447 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e24fe01b-9500-4e38-a300-0dfdb97c50cb tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 1db2318e-9ac7-4994-8daa-14ae22537d5d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:11.010976 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:45:11.012849 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e24fe01b-9500-4e38-a300-0dfdb97c50cb tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:11.013359 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e24fe01b-9500-4e38-a300-0dfdb97c50cb tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:11.013813 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e24fe01b-9500-4e38-a300-0dfdb97c50cb tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:11.014592 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e24fe01b-9500-4e38-a300-0dfdb97c50cb tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:11.015058 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e24fe01b-9500-4e38-a300-0dfdb97c50cb tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:11.015494 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e24fe01b-9500-4e38-a300-0dfdb97c50cb tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:11.435761 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=8 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:45:11.777655 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b17ecffa-5255-4a86-8c1d-060d54f87961 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:11.778374 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b17ecffa-5255-4a86-8c1d-060d54f87961 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:11.795181 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b17ecffa-5255-4a86-8c1d-060d54f87961 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:11.795691 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b17ecffa-5255-4a86-8c1d-060d54f87961 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:11.796138 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b17ecffa-5255-4a86-8c1d-060d54f87961 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:11.796865 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b17ecffa-5255-4a86-8c1d-060d54f87961 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:11.797932 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b17ecffa-5255-4a86-8c1d-060d54f87961 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:11.797932 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b17ecffa-5255-4a86-8c1d-060d54f87961 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:11.822363 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-b17ecffa-5255-4a86-8c1d-060d54f87961 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] HTTP exception thrown: Instance db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b could not be found. Oct 27 03:45:11.824864 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b17ecffa-5255-4a86-8c1d-060d54f87961 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Request method failure captured: Oct 27 03:45:11.824864 n-d-862769-1 devstack@n-api.service[121000]: request: DELETE /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b HTTP/1.1 Oct 27 03:45:11.824864 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:45:11.824864 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:45:11.824864 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:45:11.824864 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:45:11.824864 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:45:11.824864 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:45:11.824864 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:45:11.824864 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:45:11.824864 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWf1ZZNjkPjFpbma6U1a30rpW5rz2pgrrBz2Y-zebQ7kUx-XZ8725TKvqHb0qLGWkMX-Aib9FY_k_pJogL520cMR3ZWJWChbAePna2V7kBQy-Nbm9LJN4yabkkyXR2yEa_L7dWwYV9fWj_rKrXm3kLnzTBx9MHVV6fRMUhXnJRxMN3ek Oct 27 03:45:11.824864 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:45:11.824864 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:45:11.824864 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:45:11.824864 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:45:11.824864 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:45:11.824864 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:45:11.824864 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 38450368ef5c4e68ac3c19c7a0a1ce65 Oct 27 03:45:11.824864 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-AttachVolumeTestJSON-1593697068 Oct 27 03:45:11.824864 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:45:11.824864 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:45:11.824864 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/38450368ef5c4e68ac3c19c7a0a1ce65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/38450368ef5c4e68ac3c19c7a0a1ce65"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/38450368ef5c4e68ac3c19c7a0a1ce65"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_38450368ef5c4e68ac3c19c7a0a1ce65"}]}] Oct 27 03:45:11.824864 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-AttachVolumeTestJSON-1593697068 Oct 27 03:45:11.824864 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 38450368ef5c4e68ac3c19c7a0a1ce65 Oct 27 03:45:11.824864 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1593697068 Oct 27 03:45:11.824864 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-AttachVolumeTestJSON-1593697068-project Oct 27 03:45:11.824864 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:45:11.824864 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:45:11.824864 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 5ffc2b1c410149e884a47240b5425e57 Oct 27 03:45:11.824864 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-AttachVolumeTestJSON-1593697068-project Oct 27 03:45:11.824864 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:45:11.824864 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b could not be found. Oct 27 03:45:11.824864 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': 'db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b'} Oct 27 03:45:11.824864 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:45:11.824864 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:45:11.824864 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:45:11.824864 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:45:11.824864 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:45:11.824864 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:45:11.824864 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:45:11.824864 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:45:11.824864 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:45:11.824864 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:45:11.824864 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b could not be found. Oct 27 03:45:11.824864 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:45:11.824864 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:45:11.824864 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:45:11.824864 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:45:11.824864 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:45:11.824864 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:45:11.824864 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:45:11.824864 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:45:11.824864 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:45:11.824864 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:45:11.824864 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 03:45:11.824864 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 03:45:11.824864 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 03:45:11.824864 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 03:45:11.824864 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:45:11.824864 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:45:11.824864 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:45:11.824864 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:45:11.833480 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b could not be found. Oct 27 03:45:11.833480 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:45:11.833480 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:45:11.833480 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:45:11.833480 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:45:11.833480 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:45:11.833480 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:45:11.833480 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:45:11.833480 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:45:11.833480 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b could not be found. Oct 27 03:45:11.833480 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:45:11.833480 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b17ecffa-5255-4a86-8c1d-060d54f87961 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Returning 404 to user: Instance db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:45:11.833480 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b17ecffa-5255-4a86-8c1d-060d54f87961 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "DELETE /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b" status: 404 len: 111 microversion: 2.1 time: 0.053487 Oct 27 03:45:11.835749 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2633/5550] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:45:11 2022] DELETE /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 03:45:11.874999 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-eb4c5994-d569-4dd1-aa7b-0e1bcacefea2 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:11.875903 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-eb4c5994-d569-4dd1-aa7b-0e1bcacefea2 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] [instance: db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:11.912358 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eb4c5994-d569-4dd1-aa7b-0e1bcacefea2 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:11.924625 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eb4c5994-d569-4dd1-aa7b-0e1bcacefea2 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:11.924625 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eb4c5994-d569-4dd1-aa7b-0e1bcacefea2 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:11.924625 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eb4c5994-d569-4dd1-aa7b-0e1bcacefea2 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:11.924625 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eb4c5994-d569-4dd1-aa7b-0e1bcacefea2 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:11.924625 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eb4c5994-d569-4dd1-aa7b-0e1bcacefea2 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:11.995109 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-eb4c5994-d569-4dd1-aa7b-0e1bcacefea2 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] HTTP exception thrown: Instance db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b could not be found. Oct 27 03:45:11.998944 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-eb4c5994-d569-4dd1-aa7b-0e1bcacefea2 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Request method failure captured: Oct 27 03:45:11.998944 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b HTTP/1.1 Oct 27 03:45:11.998944 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:45:11.998944 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:45:11.998944 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:45:11.998944 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:45:11.998944 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:45:11.998944 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:45:11.998944 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:45:11.998944 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:45:11.998944 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWf1ZZNjkPjFpbma6U1a30rpW5rz2pgrrBz2Y-zebQ7kUx-XZ8725TKvqHb0qLGWkMX-Aib9FY_k_pJogL520cMR3ZWJWChbAePna2V7kBQy-Nbm9LJN4yabkkyXR2yEa_L7dWwYV9fWj_rKrXm3kLnzTBx9MHVV6fRMUhXnJRxMN3ek Oct 27 03:45:11.998944 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:45:11.998944 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:45:11.998944 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:45:11.998944 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:45:11.998944 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:45:11.998944 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:45:11.998944 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 38450368ef5c4e68ac3c19c7a0a1ce65 Oct 27 03:45:11.998944 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-AttachVolumeTestJSON-1593697068 Oct 27 03:45:11.998944 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:45:11.998944 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:45:11.998944 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/38450368ef5c4e68ac3c19c7a0a1ce65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/38450368ef5c4e68ac3c19c7a0a1ce65"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/38450368ef5c4e68ac3c19c7a0a1ce65"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_38450368ef5c4e68ac3c19c7a0a1ce65"}]}] Oct 27 03:45:11.998944 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-AttachVolumeTestJSON-1593697068 Oct 27 03:45:11.998944 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 38450368ef5c4e68ac3c19c7a0a1ce65 Oct 27 03:45:11.998944 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1593697068 Oct 27 03:45:11.998944 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-AttachVolumeTestJSON-1593697068-project Oct 27 03:45:11.998944 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:45:11.998944 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:45:11.998944 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 5ffc2b1c410149e884a47240b5425e57 Oct 27 03:45:11.998944 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-AttachVolumeTestJSON-1593697068-project Oct 27 03:45:11.998944 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:45:11.998944 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b could not be found. Oct 27 03:45:11.998944 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': 'db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b'} Oct 27 03:45:11.998944 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:45:11.998944 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:45:11.998944 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:45:11.998944 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:45:11.998944 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:45:11.998944 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:45:11.998944 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:45:11.998944 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:45:11.998944 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:45:11.998944 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:45:11.998944 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b could not be found. Oct 27 03:45:11.998944 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:45:11.998944 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:45:11.998944 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:45:11.998944 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:45:11.998944 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:45:11.998944 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:45:11.998944 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:45:11.998944 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:45:11.998944 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:45:11.998944 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:45:11.998944 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:45:11.998944 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:45:11.998944 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:45:11.998944 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:45:11.998944 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:45:11.998944 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:45:11.998944 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b could not be found. Oct 27 03:45:11.998944 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:45:11.998944 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:45:11.998944 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:45:12.005786 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:45:12.005786 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:45:12.005786 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:45:12.005786 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:45:12.005786 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:45:12.005786 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b could not be found. Oct 27 03:45:12.005786 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:45:12.011492 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-eb4c5994-d569-4dd1-aa7b-0e1bcacefea2 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] Returning 404 to user: Instance db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:45:12.019007 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-eb4c5994-d569-4dd1-aa7b-0e1bcacefea2 tempest-AttachVolumeTestJSON-1593697068 tempest-AttachVolumeTestJSON-1593697068-project] 10.222.0.20 "GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b" status: 404 len: 111 microversion: 2.1 time: 0.173378 Oct 27 03:45:12.026220 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2634/5551] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:45:11 2022] GET /compute/v2.1/servers/db7d3ee6-88ad-440f-a8ef-8c1aa6e5b21b => generated 111 bytes in 186 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:45:12.051858 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7e9bc7f6-d00a-436e-be6e-6c1e35f300f0 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:12.051858 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7e9bc7f6-d00a-436e-be6e-6c1e35f300f0 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: f9ea8cc2-b198-43e0-bc40-252eebf55631] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:12.067324 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7e9bc7f6-d00a-436e-be6e-6c1e35f300f0 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:12.071963 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7e9bc7f6-d00a-436e-be6e-6c1e35f300f0 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:12.072576 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7e9bc7f6-d00a-436e-be6e-6c1e35f300f0 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:12.073472 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7e9bc7f6-d00a-436e-be6e-6c1e35f300f0 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:12.074103 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7e9bc7f6-d00a-436e-be6e-6c1e35f300f0 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:12.074677 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7e9bc7f6-d00a-436e-be6e-6c1e35f300f0 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:12.098309 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=9,nova_cell1:INSERT=6 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:45:12.378875 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e24fe01b-9500-4e38-a300-0dfdb97c50cb tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:12.397372 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e24fe01b-9500-4e38-a300-0dfdb97c50cb tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:12.402286 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e24fe01b-9500-4e38-a300-0dfdb97c50cb tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:12.408497 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e24fe01b-9500-4e38-a300-0dfdb97c50cb tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d" status: 200 len: 1673 microversion: 2.20 time: 1.410474 Oct 27 03:45:12.411659 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2918/5552] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:45:10 2022] GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d => generated 1673 bytes in 1418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:45:12.942708 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:45:13.276035 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7e9bc7f6-d00a-436e-be6e-6c1e35f300f0 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:13.290831 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7e9bc7f6-d00a-436e-be6e-6c1e35f300f0 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/f9ea8cc2-b198-43e0-bc40-252eebf55631" status: 200 len: 1317 microversion: 2.1 time: 1.262544 Oct 27 03:45:13.292431 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2635/5553] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:45:12 2022] GET /compute/v2.1/servers/f9ea8cc2-b198-43e0-bc40-252eebf55631 => generated 1317 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:45:13.332708 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-0353f53a-ed43-494c-ad28-0cd5fc7604f0 req-0e50c7b5-bded-4030-b9c9-8f09209b77d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9ea8cc2-b198-43e0-bc40-252eebf55631", "tag": "47c63dd7-7f02-41c4-b66d-e207607a866f"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:45:13.355378 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-0353f53a-ed43-494c-ad28-0cd5fc7604f0 req-0e50c7b5-bded-4030-b9c9-8f09209b77d1 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:13.358368 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-0353f53a-ed43-494c-ad28-0cd5fc7604f0 req-0e50c7b5-bded-4030-b9c9-8f09209b77d1 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:13.360662 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-0353f53a-ed43-494c-ad28-0cd5fc7604f0 req-0e50c7b5-bded-4030-b9c9-8f09209b77d1 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:13.402142 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-0353f53a-ed43-494c-ad28-0cd5fc7604f0 req-0e50c7b5-bded-4030-b9c9-8f09209b77d1 service nova] Creating event network-changed:47c63dd7-7f02-41c4-b66d-e207607a866f for instance f9ea8cc2-b198-43e0-bc40-252eebf55631 on n-h1-862769-1 Oct 27 03:45:13.413892 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-0353f53a-ed43-494c-ad28-0cd5fc7604f0 req-0e50c7b5-bded-4030-b9c9-8f09209b77d1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086566 Oct 27 03:45:13.415643 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2919/5554] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:45:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:45:13.438386 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-07983178-be1f-4d57-a042-3d7359322325 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:13.439127 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-07983178-be1f-4d57-a042-3d7359322325 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 1db2318e-9ac7-4994-8daa-14ae22537d5d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:13.447821 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-07983178-be1f-4d57-a042-3d7359322325 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:13.448601 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-07983178-be1f-4d57-a042-3d7359322325 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:13.449863 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-07983178-be1f-4d57-a042-3d7359322325 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:13.450863 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-07983178-be1f-4d57-a042-3d7359322325 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:13.451540 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-07983178-be1f-4d57-a042-3d7359322325 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:13.452151 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-07983178-be1f-4d57-a042-3d7359322325 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:13.943841 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-07983178-be1f-4d57-a042-3d7359322325 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:13.957466 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-07983178-be1f-4d57-a042-3d7359322325 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:13.966797 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-07983178-be1f-4d57-a042-3d7359322325 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:13.968135 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-07983178-be1f-4d57-a042-3d7359322325 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d" status: 200 len: 1731 microversion: 2.20 time: 0.534059 Oct 27 03:45:13.969873 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2636/5555] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:45:13 2022] GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d => generated 1731 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:45:14.316530 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-cb89015c-a916-4361-88ca-c34f1996dfc5 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:14.317347 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-cb89015c-a916-4361-88ca-c34f1996dfc5 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: f9ea8cc2-b198-43e0-bc40-252eebf55631] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:14.326022 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cb89015c-a916-4361-88ca-c34f1996dfc5 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:14.326553 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cb89015c-a916-4361-88ca-c34f1996dfc5 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:14.327011 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cb89015c-a916-4361-88ca-c34f1996dfc5 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:14.340062 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cb89015c-a916-4361-88ca-c34f1996dfc5 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:14.340062 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cb89015c-a916-4361-88ca-c34f1996dfc5 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:14.340062 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cb89015c-a916-4361-88ca-c34f1996dfc5 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:14.999570 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-87cafc93-7bf7-446c-bc65-a2ea05d09d05 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:15.000885 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-87cafc93-7bf7-446c-bc65-a2ea05d09d05 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 1db2318e-9ac7-4994-8daa-14ae22537d5d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:15.004815 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:45:15.010941 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-87cafc93-7bf7-446c-bc65-a2ea05d09d05 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:15.011776 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-87cafc93-7bf7-446c-bc65-a2ea05d09d05 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:15.012465 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-87cafc93-7bf7-446c-bc65-a2ea05d09d05 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:15.013411 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-87cafc93-7bf7-446c-bc65-a2ea05d09d05 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:15.014355 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-87cafc93-7bf7-446c-bc65-a2ea05d09d05 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:15.018488 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-87cafc93-7bf7-446c-bc65-a2ea05d09d05 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:15.245612 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-cb89015c-a916-4361-88ca-c34f1996dfc5 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:15.265917 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-cb89015c-a916-4361-88ca-c34f1996dfc5 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/f9ea8cc2-b198-43e0-bc40-252eebf55631" status: 200 len: 1317 microversion: 2.1 time: 0.954730 Oct 27 03:45:15.267234 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2920/5556] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:45:14 2022] GET /compute/v2.1/servers/f9ea8cc2-b198-43e0-bc40-252eebf55631 => generated 1317 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:45:15.325546 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-87cafc93-7bf7-446c-bc65-a2ea05d09d05 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:15.338093 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-87cafc93-7bf7-446c-bc65-a2ea05d09d05 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:15.341244 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-87cafc93-7bf7-446c-bc65-a2ea05d09d05 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:15.347250 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-87cafc93-7bf7-446c-bc65-a2ea05d09d05 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d" status: 200 len: 1731 microversion: 2.20 time: 0.345763 Oct 27 03:45:15.348220 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2637/5557] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:45:14 2022] GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d => generated 1731 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:45:16.395984 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a429ff98-aa17-4e60-b952-f3313779adc5 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:16.395984 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a429ff98-aa17-4e60-b952-f3313779adc5 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: f9ea8cc2-b198-43e0-bc40-252eebf55631] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:16.395984 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a429ff98-aa17-4e60-b952-f3313779adc5 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:16.395984 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a429ff98-aa17-4e60-b952-f3313779adc5 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:16.395984 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a429ff98-aa17-4e60-b952-f3313779adc5 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:16.395984 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a429ff98-aa17-4e60-b952-f3313779adc5 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:16.397367 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-b216c4b1-f025-4ebd-82d0-7e810c398a02 req-3570dd3a-092b-4de8-adfc-173e44a42188 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbdbec9a-f4bf-4740-ab67-3c8891e341a1", "tag": "833035a3-c97d-4212-b516-f56e8d9754b6"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:45:16.397899 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a429ff98-aa17-4e60-b952-f3313779adc5 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:16.397899 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a429ff98-aa17-4e60-b952-f3313779adc5 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:16.398700 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-b216c4b1-f025-4ebd-82d0-7e810c398a02 req-3570dd3a-092b-4de8-adfc-173e44a42188 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:16.398700 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-b216c4b1-f025-4ebd-82d0-7e810c398a02 req-3570dd3a-092b-4de8-adfc-173e44a42188 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:16.398700 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-b216c4b1-f025-4ebd-82d0-7e810c398a02 req-3570dd3a-092b-4de8-adfc-173e44a42188 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:16.398700 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-b216c4b1-f025-4ebd-82d0-7e810c398a02 req-3570dd3a-092b-4de8-adfc-173e44a42188 service nova] Creating event network-changed:833035a3-c97d-4212-b516-f56e8d9754b6 for instance dbdbec9a-f4bf-4740-ab67-3c8891e341a1 on n-h2-862769-1 Oct 27 03:45:16.398700 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-b216c4b1-f025-4ebd-82d0-7e810c398a02 req-3570dd3a-092b-4de8-adfc-173e44a42188 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045470 Oct 27 03:45:16.398700 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2638/5558] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:45:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:45:16.405272 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-aef10738-53c2-41fc-aba1-f877f0241229 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:16.405272 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-aef10738-53c2-41fc-aba1-f877f0241229 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 1db2318e-9ac7-4994-8daa-14ae22537d5d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:16.411662 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aef10738-53c2-41fc-aba1-f877f0241229 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:16.412452 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aef10738-53c2-41fc-aba1-f877f0241229 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:16.413128 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aef10738-53c2-41fc-aba1-f877f0241229 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:16.414113 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aef10738-53c2-41fc-aba1-f877f0241229 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:16.415187 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aef10738-53c2-41fc-aba1-f877f0241229 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:16.415802 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aef10738-53c2-41fc-aba1-f877f0241229 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:17.345306 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-aef10738-53c2-41fc-aba1-f877f0241229 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:17.359083 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-aef10738-53c2-41fc-aba1-f877f0241229 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:17.360665 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-aef10738-53c2-41fc-aba1-f877f0241229 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:17.361954 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-aef10738-53c2-41fc-aba1-f877f0241229 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d" status: 200 len: 1731 microversion: 2.20 time: 0.965529 Oct 27 03:45:17.369179 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2639/5559] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:45:16 2022] GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d => generated 1731 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:45:17.477521 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a429ff98-aa17-4e60-b952-f3313779adc5 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:17.513616 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a429ff98-aa17-4e60-b952-f3313779adc5 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/f9ea8cc2-b198-43e0-bc40-252eebf55631" status: 200 len: 1317 microversion: 2.1 time: 1.221055 Oct 27 03:45:17.514836 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2921/5560] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:45:16 2022] GET /compute/v2.1/servers/f9ea8cc2-b198-43e0-bc40-252eebf55631 => generated 1317 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:45:18.395617 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-436cf6ee-2b52-4b09-b0f0-e0a282662a08 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:18.398711 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-436cf6ee-2b52-4b09-b0f0-e0a282662a08 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 1db2318e-9ac7-4994-8daa-14ae22537d5d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:18.414257 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-436cf6ee-2b52-4b09-b0f0-e0a282662a08 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:18.415372 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-436cf6ee-2b52-4b09-b0f0-e0a282662a08 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:18.417192 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-436cf6ee-2b52-4b09-b0f0-e0a282662a08 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:18.420092 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-436cf6ee-2b52-4b09-b0f0-e0a282662a08 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:18.421551 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-436cf6ee-2b52-4b09-b0f0-e0a282662a08 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:18.423240 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-436cf6ee-2b52-4b09-b0f0-e0a282662a08 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:18.551266 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a56a561b-cb50-4430-9681-b53834eae299 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:18.552567 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a56a561b-cb50-4430-9681-b53834eae299 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: f9ea8cc2-b198-43e0-bc40-252eebf55631] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:18.571753 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a56a561b-cb50-4430-9681-b53834eae299 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:18.572302 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a56a561b-cb50-4430-9681-b53834eae299 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:18.572745 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a56a561b-cb50-4430-9681-b53834eae299 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:18.583081 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a56a561b-cb50-4430-9681-b53834eae299 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:18.584896 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a56a561b-cb50-4430-9681-b53834eae299 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:18.589196 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a56a561b-cb50-4430-9681-b53834eae299 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:18.663819 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:45:19.532421 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-436cf6ee-2b52-4b09-b0f0-e0a282662a08 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:19.547060 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-436cf6ee-2b52-4b09-b0f0-e0a282662a08 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:19.548563 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-436cf6ee-2b52-4b09-b0f0-e0a282662a08 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:19.551344 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-436cf6ee-2b52-4b09-b0f0-e0a282662a08 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d" status: 200 len: 1731 microversion: 2.20 time: 1.159182 Oct 27 03:45:19.567142 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2640/5561] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:45:18 2022] GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d => generated 1731 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:45:19.595462 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-f0be2a35-86d0-47a7-bdc0-cdc9915b7619 req-3ad77224-bc50-4c1c-8dae-9c0d5448435e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbdbec9a-f4bf-4740-ab67-3c8891e341a1", "tag": "833035a3-c97d-4212-b516-f56e8d9754b6"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:45:19.631998 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-f0be2a35-86d0-47a7-bdc0-cdc9915b7619 req-3ad77224-bc50-4c1c-8dae-9c0d5448435e service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:19.637421 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-f0be2a35-86d0-47a7-bdc0-cdc9915b7619 req-3ad77224-bc50-4c1c-8dae-9c0d5448435e service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:19.638301 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-f0be2a35-86d0-47a7-bdc0-cdc9915b7619 req-3ad77224-bc50-4c1c-8dae-9c0d5448435e service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:19.712444 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-f0be2a35-86d0-47a7-bdc0-cdc9915b7619 req-3ad77224-bc50-4c1c-8dae-9c0d5448435e service nova] Creating event network-changed:833035a3-c97d-4212-b516-f56e8d9754b6 for instance dbdbec9a-f4bf-4740-ab67-3c8891e341a1 on n-h2-862769-1 Oct 27 03:45:19.739569 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-f0be2a35-86d0-47a7-bdc0-cdc9915b7619 req-3ad77224-bc50-4c1c-8dae-9c0d5448435e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.164023 Oct 27 03:45:19.740663 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2641/5562] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:45:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:45:20.075747 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a56a561b-cb50-4430-9681-b53834eae299 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:20.089424 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a56a561b-cb50-4430-9681-b53834eae299 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/f9ea8cc2-b198-43e0-bc40-252eebf55631" status: 200 len: 1317 microversion: 2.1 time: 1.556174 Oct 27 03:45:20.098470 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2922/5563] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:45:18 2022] GET /compute/v2.1/servers/f9ea8cc2-b198-43e0-bc40-252eebf55631 => generated 1317 bytes in 1566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:45:20.598470 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-785331c7-7405-4746-bd0c-724e057682ef tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:20.602025 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-785331c7-7405-4746-bd0c-724e057682ef tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 1db2318e-9ac7-4994-8daa-14ae22537d5d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:20.617467 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-785331c7-7405-4746-bd0c-724e057682ef tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:20.619288 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-785331c7-7405-4746-bd0c-724e057682ef tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:20.619794 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-785331c7-7405-4746-bd0c-724e057682ef tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:20.622790 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-785331c7-7405-4746-bd0c-724e057682ef tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:20.623291 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-785331c7-7405-4746-bd0c-724e057682ef tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:20.623736 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-785331c7-7405-4746-bd0c-724e057682ef tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:20.885825 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-5cfe0c2c-618f-4127-86cb-004ddb7c57f1 req-267765e0-bca2-4ded-ae31-5886a2cf7fe1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9ea8cc2-b198-43e0-bc40-252eebf55631", "name": "network-vif-plugged", "status": "completed", "tag": "47c63dd7-7f02-41c4-b66d-e207607a866f"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:45:20.902274 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-5cfe0c2c-618f-4127-86cb-004ddb7c57f1 req-267765e0-bca2-4ded-ae31-5886a2cf7fe1 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:20.902881 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-5cfe0c2c-618f-4127-86cb-004ddb7c57f1 req-267765e0-bca2-4ded-ae31-5886a2cf7fe1 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:20.903324 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-5cfe0c2c-618f-4127-86cb-004ddb7c57f1 req-267765e0-bca2-4ded-ae31-5886a2cf7fe1 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:20.958838 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-5cfe0c2c-618f-4127-86cb-004ddb7c57f1 req-267765e0-bca2-4ded-ae31-5886a2cf7fe1 service nova] Creating event network-vif-plugged:47c63dd7-7f02-41c4-b66d-e207607a866f for instance f9ea8cc2-b198-43e0-bc40-252eebf55631 on n-h1-862769-1 Oct 27 03:45:20.988658 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-5cfe0c2c-618f-4127-86cb-004ddb7c57f1 req-267765e0-bca2-4ded-ae31-5886a2cf7fe1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106731 Oct 27 03:45:20.994831 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2923/5564] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:45:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:45:21.118455 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c7a46495-6310-4b41-a20a-8213084aa799 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:21.119247 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c7a46495-6310-4b41-a20a-8213084aa799 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: f9ea8cc2-b198-43e0-bc40-252eebf55631] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:21.159412 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c7a46495-6310-4b41-a20a-8213084aa799 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:21.160188 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c7a46495-6310-4b41-a20a-8213084aa799 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:21.161192 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c7a46495-6310-4b41-a20a-8213084aa799 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:21.165655 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c7a46495-6310-4b41-a20a-8213084aa799 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:21.166578 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c7a46495-6310-4b41-a20a-8213084aa799 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:21.168581 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c7a46495-6310-4b41-a20a-8213084aa799 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:22.348040 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c7a46495-6310-4b41-a20a-8213084aa799 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:22.364875 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c7a46495-6310-4b41-a20a-8213084aa799 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/f9ea8cc2-b198-43e0-bc40-252eebf55631" status: 200 len: 1317 microversion: 2.1 time: 1.250853 Oct 27 03:45:22.365304 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2924/5565] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:45:21 2022] GET /compute/v2.1/servers/f9ea8cc2-b198-43e0-bc40-252eebf55631 => generated 1317 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:45:22.565298 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-785331c7-7405-4746-bd0c-724e057682ef tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:22.582577 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-785331c7-7405-4746-bd0c-724e057682ef tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:22.592133 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-785331c7-7405-4746-bd0c-724e057682ef tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:22.614865 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-785331c7-7405-4746-bd0c-724e057682ef tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d" status: 200 len: 1731 microversion: 2.20 time: 2.005053 Oct 27 03:45:22.620181 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2642/5566] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:45:20 2022] GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d => generated 1731 bytes in 2029 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:45:23.397423 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f789acbf-7235-4d10-97d2-0919b12247f8 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:23.399874 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f789acbf-7235-4d10-97d2-0919b12247f8 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: f9ea8cc2-b198-43e0-bc40-252eebf55631] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:23.421244 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f789acbf-7235-4d10-97d2-0919b12247f8 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:23.427621 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f789acbf-7235-4d10-97d2-0919b12247f8 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:23.428596 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f789acbf-7235-4d10-97d2-0919b12247f8 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:23.435245 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f789acbf-7235-4d10-97d2-0919b12247f8 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:23.436291 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f789acbf-7235-4d10-97d2-0919b12247f8 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:23.438704 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f789acbf-7235-4d10-97d2-0919b12247f8 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:23.650710 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-13428bb1-cc3d-4c8e-ba8a-c7ab24c1294b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:23.651338 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-13428bb1-cc3d-4c8e-ba8a-c7ab24c1294b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 1db2318e-9ac7-4994-8daa-14ae22537d5d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:23.666694 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-13428bb1-cc3d-4c8e-ba8a-c7ab24c1294b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:23.677984 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-13428bb1-cc3d-4c8e-ba8a-c7ab24c1294b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:23.678418 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-13428bb1-cc3d-4c8e-ba8a-c7ab24c1294b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:23.681678 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-13428bb1-cc3d-4c8e-ba8a-c7ab24c1294b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:23.684388 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-13428bb1-cc3d-4c8e-ba8a-c7ab24c1294b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:23.690916 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-13428bb1-cc3d-4c8e-ba8a-c7ab24c1294b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:24.336405 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f789acbf-7235-4d10-97d2-0919b12247f8 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:24.349452 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f789acbf-7235-4d10-97d2-0919b12247f8 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/f9ea8cc2-b198-43e0-bc40-252eebf55631" status: 200 len: 1317 microversion: 2.1 time: 0.960189 Oct 27 03:45:24.363311 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2925/5567] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:45:23 2022] GET /compute/v2.1/servers/f9ea8cc2-b198-43e0-bc40-252eebf55631 => generated 1317 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:45:24.992128 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-13428bb1-cc3d-4c8e-ba8a-c7ab24c1294b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:25.009752 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-13428bb1-cc3d-4c8e-ba8a-c7ab24c1294b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:25.015745 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-13428bb1-cc3d-4c8e-ba8a-c7ab24c1294b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:25.019616 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-13428bb1-cc3d-4c8e-ba8a-c7ab24c1294b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d" status: 200 len: 1731 microversion: 2.20 time: 1.374425 Oct 27 03:45:25.023788 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2643/5568] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:45:23 2022] GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d => generated 1731 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:45:25.378298 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-00d60d3a-e96e-4c44-bcdf-602d5aa6ad15 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:25.398821 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-00d60d3a-e96e-4c44-bcdf-602d5aa6ad15 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: f9ea8cc2-b198-43e0-bc40-252eebf55631] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:25.419174 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-00d60d3a-e96e-4c44-bcdf-602d5aa6ad15 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:25.423566 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-00d60d3a-e96e-4c44-bcdf-602d5aa6ad15 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:25.425096 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-00d60d3a-e96e-4c44-bcdf-602d5aa6ad15 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:25.426829 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-00d60d3a-e96e-4c44-bcdf-602d5aa6ad15 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:25.428405 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-00d60d3a-e96e-4c44-bcdf-602d5aa6ad15 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:25.430697 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-00d60d3a-e96e-4c44-bcdf-602d5aa6ad15 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:25.873759 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-00d60d3a-e96e-4c44-bcdf-602d5aa6ad15 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:25.900489 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-00d60d3a-e96e-4c44-bcdf-602d5aa6ad15 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/f9ea8cc2-b198-43e0-bc40-252eebf55631" status: 200 len: 1508 microversion: 2.1 time: 0.528312 Oct 27 03:45:25.904523 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2926/5569] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:45:25 2022] GET /compute/v2.1/servers/f9ea8cc2-b198-43e0-bc40-252eebf55631 => generated 1508 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:45:25.927271 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-09e323f1-7dcc-4cf5-87df-f52b31b561a1 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:25.928218 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-09e323f1-7dcc-4cf5-87df-f52b31b561a1 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: f9ea8cc2-b198-43e0-bc40-252eebf55631] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:25.963659 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-09e323f1-7dcc-4cf5-87df-f52b31b561a1 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:25.965190 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-09e323f1-7dcc-4cf5-87df-f52b31b561a1 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:25.966177 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-09e323f1-7dcc-4cf5-87df-f52b31b561a1 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:25.967594 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-09e323f1-7dcc-4cf5-87df-f52b31b561a1 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:25.968544 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-09e323f1-7dcc-4cf5-87df-f52b31b561a1 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:25.969268 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-09e323f1-7dcc-4cf5-87df-f52b31b561a1 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:26.047445 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-83032346-54ea-491e-828d-f9399ff3f6f3 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:26.048232 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-83032346-54ea-491e-828d-f9399ff3f6f3 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 1db2318e-9ac7-4994-8daa-14ae22537d5d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:26.062649 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-83032346-54ea-491e-828d-f9399ff3f6f3 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:26.064714 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-83032346-54ea-491e-828d-f9399ff3f6f3 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:26.065408 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-83032346-54ea-491e-828d-f9399ff3f6f3 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:26.093510 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-83032346-54ea-491e-828d-f9399ff3f6f3 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:26.094046 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-83032346-54ea-491e-828d-f9399ff3f6f3 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:26.094515 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-83032346-54ea-491e-828d-f9399ff3f6f3 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:26.611805 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-09e323f1-7dcc-4cf5-87df-f52b31b561a1 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:26.623713 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-09e323f1-7dcc-4cf5-87df-f52b31b561a1 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/f9ea8cc2-b198-43e0-bc40-252eebf55631" status: 200 len: 1508 microversion: 2.1 time: 0.700894 Oct 27 03:45:26.642976 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2644/5570] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:45:25 2022] GET /compute/v2.1/servers/f9ea8cc2-b198-43e0-bc40-252eebf55631 => generated 1508 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:45:26.650388 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-684bff67-333e-4955-af9c-23ef18574003 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:45:26.653631 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-684bff67-333e-4955-af9c-23ef18574003 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: f9ea8cc2-b198-43e0-bc40-252eebf55631] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:26.685210 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-684bff67-333e-4955-af9c-23ef18574003 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:26.689505 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-684bff67-333e-4955-af9c-23ef18574003 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:26.689922 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-684bff67-333e-4955-af9c-23ef18574003 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:26.691170 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-684bff67-333e-4955-af9c-23ef18574003 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:26.692866 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-684bff67-333e-4955-af9c-23ef18574003 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:26.695563 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-684bff67-333e-4955-af9c-23ef18574003 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:26.793577 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-83032346-54ea-491e-828d-f9399ff3f6f3 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:26.807700 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-83032346-54ea-491e-828d-f9399ff3f6f3 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:26.813954 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-83032346-54ea-491e-828d-f9399ff3f6f3 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:26.816660 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-83032346-54ea-491e-828d-f9399ff3f6f3 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d" status: 200 len: 1731 microversion: 2.20 time: 0.773570 Oct 27 03:45:26.835437 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2927/5571] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:45:26 2022] GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d => generated 1731 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:45:26.957864 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-684bff67-333e-4955-af9c-23ef18574003 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "PUT /compute/v2.1/servers/f9ea8cc2-b198-43e0-bc40-252eebf55631" status: 200 len: 1080 microversion: 2.1 time: 0.307293 Oct 27 03:45:26.957864 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2645/5572] 10.222.0.20 () {60 vars in 1256 bytes} [Thu Oct 27 03:45:26 2022] PUT /compute/v2.1/servers/f9ea8cc2-b198-43e0-bc40-252eebf55631 => generated 1080 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:45:26.987083 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5b5ea507-9f15-4e51-92b7-f7d5edba92cf tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:26.987083 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5b5ea507-9f15-4e51-92b7-f7d5edba92cf tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: f9ea8cc2-b198-43e0-bc40-252eebf55631] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:27.005545 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5b5ea507-9f15-4e51-92b7-f7d5edba92cf tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:27.006072 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5b5ea507-9f15-4e51-92b7-f7d5edba92cf tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:27.006527 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5b5ea507-9f15-4e51-92b7-f7d5edba92cf tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:27.009629 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5b5ea507-9f15-4e51-92b7-f7d5edba92cf tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:27.010419 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5b5ea507-9f15-4e51-92b7-f7d5edba92cf tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:27.021223 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5b5ea507-9f15-4e51-92b7-f7d5edba92cf tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:27.379002 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5b5ea507-9f15-4e51-92b7-f7d5edba92cf tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:27.396526 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5b5ea507-9f15-4e51-92b7-f7d5edba92cf tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/f9ea8cc2-b198-43e0-bc40-252eebf55631" status: 200 len: 1506 microversion: 2.1 time: 0.416442 Oct 27 03:45:27.410270 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2928/5573] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:45:26 2022] GET /compute/v2.1/servers/f9ea8cc2-b198-43e0-bc40-252eebf55631 => generated 1506 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:45:27.434886 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-813755dd-f7d8-42ff-a303-ff7a27ecd567 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:27.435890 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-813755dd-f7d8-42ff-a303-ff7a27ecd567 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: f9ea8cc2-b198-43e0-bc40-252eebf55631] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:27.445781 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-813755dd-f7d8-42ff-a303-ff7a27ecd567 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:27.446442 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-813755dd-f7d8-42ff-a303-ff7a27ecd567 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:27.449477 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-813755dd-f7d8-42ff-a303-ff7a27ecd567 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:27.450445 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-813755dd-f7d8-42ff-a303-ff7a27ecd567 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:27.451149 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-813755dd-f7d8-42ff-a303-ff7a27ecd567 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:27.453109 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-813755dd-f7d8-42ff-a303-ff7a27ecd567 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:27.851042 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-71ed6a2c-ad73-4f1f-bb5b-7dd31f6799f5 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:27.852839 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-71ed6a2c-ad73-4f1f-bb5b-7dd31f6799f5 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 1db2318e-9ac7-4994-8daa-14ae22537d5d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:27.860702 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-71ed6a2c-ad73-4f1f-bb5b-7dd31f6799f5 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:27.861721 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-71ed6a2c-ad73-4f1f-bb5b-7dd31f6799f5 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:27.862468 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-71ed6a2c-ad73-4f1f-bb5b-7dd31f6799f5 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:27.863776 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-71ed6a2c-ad73-4f1f-bb5b-7dd31f6799f5 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:27.864473 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-71ed6a2c-ad73-4f1f-bb5b-7dd31f6799f5 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:27.865136 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-71ed6a2c-ad73-4f1f-bb5b-7dd31f6799f5 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:28.371480 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-71ed6a2c-ad73-4f1f-bb5b-7dd31f6799f5 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:28.396881 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-71ed6a2c-ad73-4f1f-bb5b-7dd31f6799f5 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:28.400895 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-71ed6a2c-ad73-4f1f-bb5b-7dd31f6799f5 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:28.402450 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-71ed6a2c-ad73-4f1f-bb5b-7dd31f6799f5 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d" status: 200 len: 1731 microversion: 2.20 time: 0.556010 Oct 27 03:45:28.403384 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2929/5574] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:45:27 2022] GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d => generated 1731 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:45:29.432016 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0131bc38-a927-4f38-8884-2c691f17d23f tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:29.432736 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0131bc38-a927-4f38-8884-2c691f17d23f tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 1db2318e-9ac7-4994-8daa-14ae22537d5d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:29.448961 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0131bc38-a927-4f38-8884-2c691f17d23f tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:29.456792 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0131bc38-a927-4f38-8884-2c691f17d23f tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:29.457405 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0131bc38-a927-4f38-8884-2c691f17d23f tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:29.460088 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0131bc38-a927-4f38-8884-2c691f17d23f tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:29.460994 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0131bc38-a927-4f38-8884-2c691f17d23f tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:29.461639 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0131bc38-a927-4f38-8884-2c691f17d23f tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:29.532285 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-813755dd-f7d8-42ff-a303-ff7a27ecd567 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:29.541660 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-813755dd-f7d8-42ff-a303-ff7a27ecd567 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/f9ea8cc2-b198-43e0-bc40-252eebf55631" status: 200 len: 1506 microversion: 2.1 time: 2.110929 Oct 27 03:45:29.574341 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2646/5575] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:45:27 2022] GET /compute/v2.1/servers/f9ea8cc2-b198-43e0-bc40-252eebf55631 => generated 1506 bytes in 2143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:45:29.602395 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ebe20480-007c-47b2-b964-659cc984d891 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:45:29.605187 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ebe20480-007c-47b2-b964-659cc984d891 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: f9ea8cc2-b198-43e0-bc40-252eebf55631] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:29.612353 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ebe20480-007c-47b2-b964-659cc984d891 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:29.613042 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ebe20480-007c-47b2-b964-659cc984d891 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:29.613673 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ebe20480-007c-47b2-b964-659cc984d891 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:29.614617 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ebe20480-007c-47b2-b964-659cc984d891 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:29.615253 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ebe20480-007c-47b2-b964-659cc984d891 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:29.616047 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ebe20480-007c-47b2-b964-659cc984d891 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:29.794523 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ebe20480-007c-47b2-b964-659cc984d891 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "PUT /compute/v2.1/servers/f9ea8cc2-b198-43e0-bc40-252eebf55631" status: 200 len: 1082 microversion: 2.1 time: 0.195424 Oct 27 03:45:29.814100 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2647/5576] 10.222.0.20 () {60 vars in 1256 bytes} [Thu Oct 27 03:45:29 2022] PUT /compute/v2.1/servers/f9ea8cc2-b198-43e0-bc40-252eebf55631 => generated 1082 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:45:29.839278 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2eebe8b8-6c0a-4da2-b056-be63baaa6872 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:29.840697 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-2eebe8b8-6c0a-4da2-b056-be63baaa6872 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: f9ea8cc2-b198-43e0-bc40-252eebf55631] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:29.862808 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2eebe8b8-6c0a-4da2-b056-be63baaa6872 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:29.866117 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2eebe8b8-6c0a-4da2-b056-be63baaa6872 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:29.869029 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2eebe8b8-6c0a-4da2-b056-be63baaa6872 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:29.870305 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2eebe8b8-6c0a-4da2-b056-be63baaa6872 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:29.871684 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2eebe8b8-6c0a-4da2-b056-be63baaa6872 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:29.874884 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2eebe8b8-6c0a-4da2-b056-be63baaa6872 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:29.904955 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0131bc38-a927-4f38-8884-2c691f17d23f tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:29.939904 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0131bc38-a927-4f38-8884-2c691f17d23f tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:29.941527 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0131bc38-a927-4f38-8884-2c691f17d23f tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:29.953888 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0131bc38-a927-4f38-8884-2c691f17d23f tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d" status: 200 len: 1731 microversion: 2.20 time: 0.527090 Oct 27 03:45:29.954531 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2930/5577] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:45:29 2022] GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d => generated 1731 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:45:30.484713 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2eebe8b8-6c0a-4da2-b056-be63baaa6872 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:30.497421 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2eebe8b8-6c0a-4da2-b056-be63baaa6872 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/f9ea8cc2-b198-43e0-bc40-252eebf55631" status: 200 len: 1508 microversion: 2.1 time: 0.668653 Oct 27 03:45:30.504993 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2648/5578] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:45:29 2022] GET /compute/v2.1/servers/f9ea8cc2-b198-43e0-bc40-252eebf55631 => generated 1508 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:45:30.525265 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f7e92d60-c06e-491c-b0df-d3e8c7e80272 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:30.525919 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f7e92d60-c06e-491c-b0df-d3e8c7e80272 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: f9ea8cc2-b198-43e0-bc40-252eebf55631] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:30.552356 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f7e92d60-c06e-491c-b0df-d3e8c7e80272 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:30.552865 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f7e92d60-c06e-491c-b0df-d3e8c7e80272 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:30.553313 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f7e92d60-c06e-491c-b0df-d3e8c7e80272 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:30.554071 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f7e92d60-c06e-491c-b0df-d3e8c7e80272 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:30.554555 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f7e92d60-c06e-491c-b0df-d3e8c7e80272 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:30.554990 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f7e92d60-c06e-491c-b0df-d3e8c7e80272 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:30.806254 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f7e92d60-c06e-491c-b0df-d3e8c7e80272 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:30.816893 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f7e92d60-c06e-491c-b0df-d3e8c7e80272 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/f9ea8cc2-b198-43e0-bc40-252eebf55631" status: 200 len: 1508 microversion: 2.1 time: 0.295470 Oct 27 03:45:30.817487 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2931/5579] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:45:30 2022] GET /compute/v2.1/servers/f9ea8cc2-b198-43e0-bc40-252eebf55631 => generated 1508 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:45:30.842852 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e741f06f-354e-4bfa-9b98-6683fe13fe04 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:30.843653 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e741f06f-354e-4bfa-9b98-6683fe13fe04 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: f9ea8cc2-b198-43e0-bc40-252eebf55631] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:30.859065 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e741f06f-354e-4bfa-9b98-6683fe13fe04 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:30.864738 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e741f06f-354e-4bfa-9b98-6683fe13fe04 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:30.864738 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e741f06f-354e-4bfa-9b98-6683fe13fe04 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:30.864738 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e741f06f-354e-4bfa-9b98-6683fe13fe04 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:30.864738 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e741f06f-354e-4bfa-9b98-6683fe13fe04 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:30.865376 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e741f06f-354e-4bfa-9b98-6683fe13fe04 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:30.913869 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0f757194-c97d-407e-b645-9c379b8fb8cb tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-1172545552", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": [{"uuid": "6ad05158-ac44-4c49-b5d6-443f42165c93"}]}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:45:30.917638 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e741f06f-354e-4bfa-9b98-6683fe13fe04 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: f9ea8cc2-b198-43e0-bc40-252eebf55631] Going to try to terminate instance {{(pid=121001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:45:31.042595 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-0f757194-c97d-407e-b645-9c379b8fb8cb tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] validate_networks() for [('6ad05158-ac44-4c49-b5d6-443f42165c93', None, None, None, None, None)] {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:45:31.282349 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e741f06f-354e-4bfa-9b98-6683fe13fe04 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f9ea8cc2-b198-43e0-bc40-252eebf55631" status: 204 len: 0 microversion: 2.1 time: 0.439929 Oct 27 03:45:31.284880 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2932/5580] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:45:30 2022] DELETE /compute/v2.1/servers/f9ea8cc2-b198-43e0-bc40-252eebf55631 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 03:45:31.303826 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3e468976-1dc3-4347-bbc1-eb0f1135e00c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:31.307498 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3e468976-1dc3-4347-bbc1-eb0f1135e00c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 1db2318e-9ac7-4994-8daa-14ae22537d5d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:31.324425 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3e468976-1dc3-4347-bbc1-eb0f1135e00c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:31.328695 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3e468976-1dc3-4347-bbc1-eb0f1135e00c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:31.329400 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3e468976-1dc3-4347-bbc1-eb0f1135e00c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:31.333547 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3e468976-1dc3-4347-bbc1-eb0f1135e00c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:31.334361 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3e468976-1dc3-4347-bbc1-eb0f1135e00c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:31.335064 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3e468976-1dc3-4347-bbc1-eb0f1135e00c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:31.798204 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3e468976-1dc3-4347-bbc1-eb0f1135e00c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:31.811253 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3e468976-1dc3-4347-bbc1-eb0f1135e00c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:31.817096 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3e468976-1dc3-4347-bbc1-eb0f1135e00c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:31.821920 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3e468976-1dc3-4347-bbc1-eb0f1135e00c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d" status: 200 len: 1731 microversion: 2.20 time: 0.531469 Oct 27 03:45:31.822755 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2933/5581] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:45:31 2022] GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d => generated 1731 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:45:31.834490 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ed42840d-ad18-4a75-8601-830861afc18b tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:31.835552 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ed42840d-ad18-4a75-8601-830861afc18b tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: f9ea8cc2-b198-43e0-bc40-252eebf55631] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:31.849703 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ed42840d-ad18-4a75-8601-830861afc18b tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:31.855196 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ed42840d-ad18-4a75-8601-830861afc18b tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:31.855196 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ed42840d-ad18-4a75-8601-830861afc18b tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:31.857265 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ed42840d-ad18-4a75-8601-830861afc18b tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:31.858744 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ed42840d-ad18-4a75-8601-830861afc18b tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:31.859321 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ed42840d-ad18-4a75-8601-830861afc18b tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:31.906570 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ed42840d-ad18-4a75-8601-830861afc18b tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: f9ea8cc2-b198-43e0-bc40-252eebf55631] Going to try to terminate instance {{(pid=121001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:45:31.907831 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-0f757194-c97d-407e-b645-9c379b8fb8cb tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:45:31.908528 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-0f757194-c97d-407e-b645-9c379b8fb8cb tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:45:31.909080 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-0f757194-c97d-407e-b645-9c379b8fb8cb tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:45:31.909734 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-0f757194-c97d-407e-b645-9c379b8fb8cb tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:45:31.910221 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-0f757194-c97d-407e-b645-9c379b8fb8cb tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:45:31.921361 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0f757194-c97d-407e-b645-9c379b8fb8cb tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:31.922018 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0f757194-c97d-407e-b645-9c379b8fb8cb tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:31.922361 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0f757194-c97d-407e-b645-9c379b8fb8cb tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:31.923110 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0f757194-c97d-407e-b645-9c379b8fb8cb tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:31.923573 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0f757194-c97d-407e-b645-9c379b8fb8cb tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:31.925613 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0f757194-c97d-407e-b645-9c379b8fb8cb tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:31.969332 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-0f757194-c97d-407e-b645-9c379b8fb8cb tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Getting quotas for project 86b90d4cb5eb42958248b6f82516ce19. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:45:31.979768 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-0f757194-c97d-407e-b645-9c379b8fb8cb tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Getting quotas for user ca2da57f02884a968d685b53a5399e46 and project 86b90d4cb5eb42958248b6f82516ce19. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:45:32.012033 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0f757194-c97d-407e-b645-9c379b8fb8cb tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:45:32.018800 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0f757194-c97d-407e-b645-9c379b8fb8cb tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 1b2e58e9-cd92-4a71-91f6-1e77ad99a685] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:45:32.080629 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.compute.api [None req-ed42840d-ad18-4a75-8601-830861afc18b tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: f9ea8cc2-b198-43e0-bc40-252eebf55631] Instance is already in deleting state, ignoring this request Oct 27 03:45:32.084435 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ed42840d-ad18-4a75-8601-830861afc18b tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f9ea8cc2-b198-43e0-bc40-252eebf55631" status: 204 len: 0 microversion: 2.1 time: 0.257250 Oct 27 03:45:32.088580 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2934/5582] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:45:31 2022] DELETE /compute/v2.1/servers/f9ea8cc2-b198-43e0-bc40-252eebf55631 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:45:32.115544 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ce1ea363-ab91-48c9-a3c3-4cfb3d18d1b3 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:32.116543 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ce1ea363-ab91-48c9-a3c3-4cfb3d18d1b3 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: f9ea8cc2-b198-43e0-bc40-252eebf55631] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:32.125086 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ce1ea363-ab91-48c9-a3c3-4cfb3d18d1b3 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:32.125928 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ce1ea363-ab91-48c9-a3c3-4cfb3d18d1b3 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:32.127473 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ce1ea363-ab91-48c9-a3c3-4cfb3d18d1b3 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:32.128598 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ce1ea363-ab91-48c9-a3c3-4cfb3d18d1b3 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:32.129365 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ce1ea363-ab91-48c9-a3c3-4cfb3d18d1b3 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:32.130310 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ce1ea363-ab91-48c9-a3c3-4cfb3d18d1b3 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:32.218161 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0f757194-c97d-407e-b645-9c379b8fb8cb tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.567249 Oct 27 03:45:32.225576 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2649/5583] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:45:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 03:45:32.230989 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1137c727-55f9-487c-b55d-0e7c4e567fd6 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:32.234108 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1137c727-55f9-487c-b55d-0e7c4e567fd6 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 1b2e58e9-cd92-4a71-91f6-1e77ad99a685] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:32.343783 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1137c727-55f9-487c-b55d-0e7c4e567fd6 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:32.364226 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1137c727-55f9-487c-b55d-0e7c4e567fd6 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/1b2e58e9-cd92-4a71-91f6-1e77ad99a685" status: 200 len: 1193 microversion: 2.1 time: 0.137066 Oct 27 03:45:32.371517 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2650/5584] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:45:32 2022] GET /compute/v2.1/servers/1b2e58e9-cd92-4a71-91f6-1e77ad99a685 => generated 1193 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:45:32.499534 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ce1ea363-ab91-48c9-a3c3-4cfb3d18d1b3 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:32.523361 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ce1ea363-ab91-48c9-a3c3-4cfb3d18d1b3 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/f9ea8cc2-b198-43e0-bc40-252eebf55631" status: 200 len: 1514 microversion: 2.1 time: 0.430061 Oct 27 03:45:32.526817 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2935/5585] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:45:32 2022] GET /compute/v2.1/servers/f9ea8cc2-b198-43e0-bc40-252eebf55631 => generated 1514 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:45:32.848329 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3661d1fa-5bfe-4ed2-94ff-4a4839e654ec tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:32.848973 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-3661d1fa-5bfe-4ed2-94ff-4a4839e654ec tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 1db2318e-9ac7-4994-8daa-14ae22537d5d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:32.862793 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3661d1fa-5bfe-4ed2-94ff-4a4839e654ec tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:32.869060 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3661d1fa-5bfe-4ed2-94ff-4a4839e654ec tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:32.869060 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3661d1fa-5bfe-4ed2-94ff-4a4839e654ec tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:32.869060 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3661d1fa-5bfe-4ed2-94ff-4a4839e654ec tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:32.869060 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3661d1fa-5bfe-4ed2-94ff-4a4839e654ec tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:32.869060 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3661d1fa-5bfe-4ed2-94ff-4a4839e654ec tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:33.388969 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-59adef18-cefe-46ea-85e5-2a9e99fbf32a tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:33.390370 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-59adef18-cefe-46ea-85e5-2a9e99fbf32a tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 1b2e58e9-cd92-4a71-91f6-1e77ad99a685] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:33.490386 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-59adef18-cefe-46ea-85e5-2a9e99fbf32a tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:33.500677 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-59adef18-cefe-46ea-85e5-2a9e99fbf32a tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/1b2e58e9-cd92-4a71-91f6-1e77ad99a685" status: 200 len: 1193 microversion: 2.1 time: 0.116469 Oct 27 03:45:33.515461 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2936/5586] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:45:33 2022] GET /compute/v2.1/servers/1b2e58e9-cd92-4a71-91f6-1e77ad99a685 => generated 1193 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:45:33.555186 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e3e32d60-9f94-4780-8feb-e7e34da69bd5 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:33.557178 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e3e32d60-9f94-4780-8feb-e7e34da69bd5 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: f9ea8cc2-b198-43e0-bc40-252eebf55631] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:33.567763 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e3e32d60-9f94-4780-8feb-e7e34da69bd5 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:33.569193 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e3e32d60-9f94-4780-8feb-e7e34da69bd5 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:33.570376 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e3e32d60-9f94-4780-8feb-e7e34da69bd5 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:33.575341 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-3661d1fa-5bfe-4ed2-94ff-4a4839e654ec tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:33.600310 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e3e32d60-9f94-4780-8feb-e7e34da69bd5 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:33.603194 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e3e32d60-9f94-4780-8feb-e7e34da69bd5 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.032s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:33.607319 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e3e32d60-9f94-4780-8feb-e7e34da69bd5 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:33.625032 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-3661d1fa-5bfe-4ed2-94ff-4a4839e654ec tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:33.631168 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-3661d1fa-5bfe-4ed2-94ff-4a4839e654ec tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:33.634593 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3661d1fa-5bfe-4ed2-94ff-4a4839e654ec tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d" status: 200 len: 1731 microversion: 2.20 time: 0.790912 Oct 27 03:45:33.640878 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2651/5587] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:45:32 2022] GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d => generated 1731 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:45:33.840183 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e3e32d60-9f94-4780-8feb-e7e34da69bd5 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:33.843859 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:45:33.848930 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e3e32d60-9f94-4780-8feb-e7e34da69bd5 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/f9ea8cc2-b198-43e0-bc40-252eebf55631" status: 200 len: 1514 microversion: 2.1 time: 0.301701 Oct 27 03:45:33.862403 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2937/5588] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:45:33 2022] GET /compute/v2.1/servers/f9ea8cc2-b198-43e0-bc40-252eebf55631 => generated 1514 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:45:34.529000 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-73eedbf7-162e-4143-ae1c-7fabeaf0ff25 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:34.529704 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-73eedbf7-162e-4143-ae1c-7fabeaf0ff25 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 1b2e58e9-cd92-4a71-91f6-1e77ad99a685] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:34.546144 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-73eedbf7-162e-4143-ae1c-7fabeaf0ff25 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:34.556808 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-73eedbf7-162e-4143-ae1c-7fabeaf0ff25 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:34.559489 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-73eedbf7-162e-4143-ae1c-7fabeaf0ff25 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:34.561921 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-73eedbf7-162e-4143-ae1c-7fabeaf0ff25 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:34.565166 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-73eedbf7-162e-4143-ae1c-7fabeaf0ff25 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:34.565637 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-73eedbf7-162e-4143-ae1c-7fabeaf0ff25 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:34.617433 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-8d27cc7c-13d0-4834-9053-0f2a56359738 req-84ca7859-112b-4dd2-9c46-266ffc0d7db0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9ea8cc2-b198-43e0-bc40-252eebf55631", "name": "network-vif-deleted", "tag": "47c63dd7-7f02-41c4-b66d-e207607a866f"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:45:34.642634 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-8d27cc7c-13d0-4834-9053-0f2a56359738 req-84ca7859-112b-4dd2-9c46-266ffc0d7db0 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:34.643533 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-8d27cc7c-13d0-4834-9053-0f2a56359738 req-84ca7859-112b-4dd2-9c46-266ffc0d7db0 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:34.644203 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-8d27cc7c-13d0-4834-9053-0f2a56359738 req-84ca7859-112b-4dd2-9c46-266ffc0d7db0 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:34.662397 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-8d27cc7c-13d0-4834-9053-0f2a56359738 req-84ca7859-112b-4dd2-9c46-266ffc0d7db0 service nova] Creating event network-vif-deleted:47c63dd7-7f02-41c4-b66d-e207607a866f for instance f9ea8cc2-b198-43e0-bc40-252eebf55631 on n-h1-862769-1 Oct 27 03:45:34.668902 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-8d27cc7c-13d0-4834-9053-0f2a56359738 req-84ca7859-112b-4dd2-9c46-266ffc0d7db0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056107 Oct 27 03:45:34.670310 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2938/5589] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:45:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:45:34.677334 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8bc18470-b959-46d8-98df-30da9ee43e58 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:34.679448 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8bc18470-b959-46d8-98df-30da9ee43e58 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 1db2318e-9ac7-4994-8daa-14ae22537d5d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:34.692247 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8bc18470-b959-46d8-98df-30da9ee43e58 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:34.692247 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8bc18470-b959-46d8-98df-30da9ee43e58 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:34.692247 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8bc18470-b959-46d8-98df-30da9ee43e58 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:34.692247 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8bc18470-b959-46d8-98df-30da9ee43e58 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:34.692910 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8bc18470-b959-46d8-98df-30da9ee43e58 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:34.693674 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8bc18470-b959-46d8-98df-30da9ee43e58 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:34.816723 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-73eedbf7-162e-4143-ae1c-7fabeaf0ff25 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:34.831707 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-73eedbf7-162e-4143-ae1c-7fabeaf0ff25 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/1b2e58e9-cd92-4a71-91f6-1e77ad99a685" status: 200 len: 1245 microversion: 2.1 time: 0.306015 Oct 27 03:45:34.833259 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2652/5590] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:45:34 2022] GET /compute/v2.1/servers/1b2e58e9-cd92-4a71-91f6-1e77ad99a685 => generated 1245 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:45:34.883507 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7cedb536-af5f-4874-9284-99f3f509af3e tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:34.885033 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7cedb536-af5f-4874-9284-99f3f509af3e tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: f9ea8cc2-b198-43e0-bc40-252eebf55631] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:34.903340 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7cedb536-af5f-4874-9284-99f3f509af3e tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:34.906819 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7cedb536-af5f-4874-9284-99f3f509af3e tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:34.909661 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7cedb536-af5f-4874-9284-99f3f509af3e tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:34.912911 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7cedb536-af5f-4874-9284-99f3f509af3e tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:34.915174 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7cedb536-af5f-4874-9284-99f3f509af3e tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:34.917891 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7cedb536-af5f-4874-9284-99f3f509af3e tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:34.982540 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8bc18470-b959-46d8-98df-30da9ee43e58 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:34.993479 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:45:34.993943 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8bc18470-b959-46d8-98df-30da9ee43e58 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:34.995720 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8bc18470-b959-46d8-98df-30da9ee43e58 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:34.997257 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8bc18470-b959-46d8-98df-30da9ee43e58 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d" status: 200 len: 1731 microversion: 2.20 time: 0.325426 Oct 27 03:45:34.998217 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2939/5591] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:45:34 2022] GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d => generated 1731 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:45:35.128776 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7cedb536-af5f-4874-9284-99f3f509af3e tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:35.141051 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7cedb536-af5f-4874-9284-99f3f509af3e tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/f9ea8cc2-b198-43e0-bc40-252eebf55631" status: 200 len: 1302 microversion: 2.1 time: 0.268707 Oct 27 03:45:35.144404 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2653/5592] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:45:34 2022] GET /compute/v2.1/servers/f9ea8cc2-b198-43e0-bc40-252eebf55631 => generated 1302 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:45:35.860115 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1b9b1fc4-c2c5-4f1a-9684-bd3ca8e95819 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:35.862991 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1b9b1fc4-c2c5-4f1a-9684-bd3ca8e95819 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 1b2e58e9-cd92-4a71-91f6-1e77ad99a685] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:35.886002 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1b9b1fc4-c2c5-4f1a-9684-bd3ca8e95819 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:35.894637 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-1cbfdd3a-f96d-44c7-93cd-a01cd2f3c08a req-8ee3577b-c9e8-4240-8ff7-de9a140ead81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1db2318e-9ac7-4994-8daa-14ae22537d5d", "name": "network-vif-plugged", "status": "completed", "tag": "162a3612-f72a-4eb0-9872-8b121e85445d"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:45:35.903341 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1b9b1fc4-c2c5-4f1a-9684-bd3ca8e95819 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:35.914999 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-1cbfdd3a-f96d-44c7-93cd-a01cd2f3c08a req-8ee3577b-c9e8-4240-8ff7-de9a140ead81 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:35.917031 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-1cbfdd3a-f96d-44c7-93cd-a01cd2f3c08a req-8ee3577b-c9e8-4240-8ff7-de9a140ead81 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:35.918175 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-1cbfdd3a-f96d-44c7-93cd-a01cd2f3c08a req-8ee3577b-c9e8-4240-8ff7-de9a140ead81 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:35.921603 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1b9b1fc4-c2c5-4f1a-9684-bd3ca8e95819 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:35.924963 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1b9b1fc4-c2c5-4f1a-9684-bd3ca8e95819 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:35.925501 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1b9b1fc4-c2c5-4f1a-9684-bd3ca8e95819 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:35.928310 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1b9b1fc4-c2c5-4f1a-9684-bd3ca8e95819 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:35.938472 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-1cbfdd3a-f96d-44c7-93cd-a01cd2f3c08a req-8ee3577b-c9e8-4240-8ff7-de9a140ead81 service nova] Creating event network-vif-plugged:162a3612-f72a-4eb0-9872-8b121e85445d for instance 1db2318e-9ac7-4994-8daa-14ae22537d5d on n-h2-862769-1 Oct 27 03:45:35.991674 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-1cbfdd3a-f96d-44c7-93cd-a01cd2f3c08a req-8ee3577b-c9e8-4240-8ff7-de9a140ead81 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097944 Oct 27 03:45:36.000808 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2654/5593] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:45:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:45:36.025625 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-cd4e177b-dcab-469c-9d35-4b4654b66b53 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:36.027014 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-cd4e177b-dcab-469c-9d35-4b4654b66b53 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 1db2318e-9ac7-4994-8daa-14ae22537d5d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:36.048512 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cd4e177b-dcab-469c-9d35-4b4654b66b53 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:36.049162 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cd4e177b-dcab-469c-9d35-4b4654b66b53 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:36.050461 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cd4e177b-dcab-469c-9d35-4b4654b66b53 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:36.051217 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cd4e177b-dcab-469c-9d35-4b4654b66b53 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:36.059923 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cd4e177b-dcab-469c-9d35-4b4654b66b53 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:36.059923 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cd4e177b-dcab-469c-9d35-4b4654b66b53 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:36.191703 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1b9b1fc4-c2c5-4f1a-9684-bd3ca8e95819 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:36.208515 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1b9b1fc4-c2c5-4f1a-9684-bd3ca8e95819 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/1b2e58e9-cd92-4a71-91f6-1e77ad99a685" status: 200 len: 1253 microversion: 2.1 time: 0.351043 Oct 27 03:45:36.210815 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2940/5594] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:45:35 2022] GET /compute/v2.1/servers/1b2e58e9-cd92-4a71-91f6-1e77ad99a685 => generated 1253 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:45:36.226603 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7889f194-6389-4e0e-8133-4b47127bce50 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:36.228478 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7889f194-6389-4e0e-8133-4b47127bce50 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: f9ea8cc2-b198-43e0-bc40-252eebf55631] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:36.248657 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7889f194-6389-4e0e-8133-4b47127bce50 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:36.249176 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7889f194-6389-4e0e-8133-4b47127bce50 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:36.252707 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7889f194-6389-4e0e-8133-4b47127bce50 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:36.255204 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7889f194-6389-4e0e-8133-4b47127bce50 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:36.257356 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7889f194-6389-4e0e-8133-4b47127bce50 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:36.258703 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7889f194-6389-4e0e-8133-4b47127bce50 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:36.317850 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7889f194-6389-4e0e-8133-4b47127bce50 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:36.318450 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7889f194-6389-4e0e-8133-4b47127bce50 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:36.319149 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7889f194-6389-4e0e-8133-4b47127bce50 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:36.320162 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-7889f194-6389-4e0e-8133-4b47127bce50 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lazy-loading 'fault' on Instance uuid f9ea8cc2-b198-43e0-bc40-252eebf55631 {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:45:36.407033 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7889f194-6389-4e0e-8133-4b47127bce50 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454949c8d794b6093d7d4fc64d12c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e83a4c2af45b49c6f23de08547160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:36.423236 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7889f194-6389-4e0e-8133-4b47127bce50 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/f9ea8cc2-b198-43e0-bc40-252eebf55631" status: 200 len: 1307 microversion: 2.1 time: 0.207168 Oct 27 03:45:36.424978 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2941/5595] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:45:36 2022] GET /compute/v2.1/servers/f9ea8cc2-b198-43e0-bc40-252eebf55631 => generated 1307 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:45:36.720149 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-cd4e177b-dcab-469c-9d35-4b4654b66b53 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:36.735914 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-cd4e177b-dcab-469c-9d35-4b4654b66b53 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:36.738725 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-cd4e177b-dcab-469c-9d35-4b4654b66b53 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:36.740243 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-cd4e177b-dcab-469c-9d35-4b4654b66b53 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d" status: 200 len: 1731 microversion: 2.20 time: 0.719960 Oct 27 03:45:36.763464 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2655/5596] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:45:36 2022] GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d => generated 1731 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:45:37.237912 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7310fdee-3f0c-43c5-bad1-fbb5fbd19866 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:37.239078 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7310fdee-3f0c-43c5-bad1-fbb5fbd19866 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 1b2e58e9-cd92-4a71-91f6-1e77ad99a685] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:37.252059 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7310fdee-3f0c-43c5-bad1-fbb5fbd19866 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:37.252623 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7310fdee-3f0c-43c5-bad1-fbb5fbd19866 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:37.253719 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7310fdee-3f0c-43c5-bad1-fbb5fbd19866 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:37.254774 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7310fdee-3f0c-43c5-bad1-fbb5fbd19866 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:37.255491 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7310fdee-3f0c-43c5-bad1-fbb5fbd19866 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:37.256414 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7310fdee-3f0c-43c5-bad1-fbb5fbd19866 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:37.341046 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7310fdee-3f0c-43c5-bad1-fbb5fbd19866 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:37.348915 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7310fdee-3f0c-43c5-bad1-fbb5fbd19866 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/1b2e58e9-cd92-4a71-91f6-1e77ad99a685" status: 200 len: 1251 microversion: 2.1 time: 0.116152 Oct 27 03:45:37.349758 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2942/5597] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:45:37 2022] GET /compute/v2.1/servers/1b2e58e9-cd92-4a71-91f6-1e77ad99a685 => generated 1251 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:45:37.456747 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-cbea6e51-b812-4fc6-bebb-02e3e8acd391 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:37.456747 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-cbea6e51-b812-4fc6-bebb-02e3e8acd391 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: f9ea8cc2-b198-43e0-bc40-252eebf55631] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:37.466376 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cbea6e51-b812-4fc6-bebb-02e3e8acd391 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:37.467105 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cbea6e51-b812-4fc6-bebb-02e3e8acd391 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:37.467763 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cbea6e51-b812-4fc6-bebb-02e3e8acd391 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:37.468719 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cbea6e51-b812-4fc6-bebb-02e3e8acd391 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:37.469659 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cbea6e51-b812-4fc6-bebb-02e3e8acd391 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:37.470707 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cbea6e51-b812-4fc6-bebb-02e3e8acd391 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:37.489895 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-cbea6e51-b812-4fc6-bebb-02e3e8acd391 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] HTTP exception thrown: Instance f9ea8cc2-b198-43e0-bc40-252eebf55631 could not be found. Oct 27 03:45:37.492501 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-cbea6e51-b812-4fc6-bebb-02e3e8acd391 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Request method failure captured: Oct 27 03:45:37.492501 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/f9ea8cc2-b198-43e0-bc40-252eebf55631 HTTP/1.1 Oct 27 03:45:37.492501 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:45:37.492501 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:45:37.492501 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:45:37.492501 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:45:37.492501 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:45:37.492501 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:45:37.492501 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:45:37.492501 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:45:37.492501 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWf46R9AxjgEFrHb7AiRobQH39rbeL1ckKWnVGdkzC1zmyiK4yenEe3yaH7e4lFwYjbkrGU3Z3yYsFh0NL6Q4374F-z32JXuOUJVaKajgMquCNY59IbbWsLnC7j42FcqZKFZSuZcq3PTs5XcTfyud7oZRQqgN0qCyBq1n8t4CELUydAE Oct 27 03:45:37.492501 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:45:37.492501 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:45:37.492501 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:45:37.492501 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:45:37.492501 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:45:37.492501 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:45:37.492501 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: eb2e83a4c2af45b49c6f23de08547160 Oct 27 03:45:37.492501 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2106504994 Oct 27 03:45:37.492501 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:45:37.492501 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:45:37.492501 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eb2e83a4c2af45b49c6f23de08547160"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/eb2e83a4c2af45b49c6f23de08547160"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eb2e83a4c2af45b49c6f23de08547160"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_eb2e83a4c2af45b49c6f23de08547160"}]}] Oct 27 03:45:37.492501 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ServerDiskConfigTestJSON-2106504994 Oct 27 03:45:37.492501 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: eb2e83a4c2af45b49c6f23de08547160 Oct 27 03:45:37.492501 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2106504994 Oct 27 03:45:37.492501 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ServerDiskConfigTestJSON-2106504994-project Oct 27 03:45:37.492501 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:45:37.492501 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:45:37.492501 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 9454949c8d794b6093d7d4fc64d12c33 Oct 27 03:45:37.492501 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ServerDiskConfigTestJSON-2106504994-project Oct 27 03:45:37.492501 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:45:37.492501 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance f9ea8cc2-b198-43e0-bc40-252eebf55631 could not be found. Oct 27 03:45:37.492501 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': 'f9ea8cc2-b198-43e0-bc40-252eebf55631'} Oct 27 03:45:37.492501 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:45:37.492501 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:45:37.492501 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:45:37.492501 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:45:37.492501 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:45:37.492501 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:45:37.492501 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:45:37.492501 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:45:37.492501 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:45:37.492501 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:45:37.492501 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9ea8cc2-b198-43e0-bc40-252eebf55631 could not be found. Oct 27 03:45:37.492501 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:45:37.492501 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:45:37.492501 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:45:37.492501 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:45:37.492501 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:45:37.492501 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:45:37.492501 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:45:37.492501 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:45:37.492501 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:45:37.492501 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:45:37.492501 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:45:37.492501 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:45:37.492501 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:45:37.492501 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:45:37.492501 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:45:37.492501 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:45:37.492501 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9ea8cc2-b198-43e0-bc40-252eebf55631 could not be found. Oct 27 03:45:37.492501 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:45:37.492501 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:45:37.492501 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:45:37.497722 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:45:37.497722 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:45:37.497722 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:45:37.497722 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:45:37.497722 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:45:37.497722 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9ea8cc2-b198-43e0-bc40-252eebf55631 could not be found. Oct 27 03:45:37.497722 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:45:37.499528 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-cbea6e51-b812-4fc6-bebb-02e3e8acd391 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Returning 404 to user: Instance f9ea8cc2-b198-43e0-bc40-252eebf55631 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:45:37.500984 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-cbea6e51-b812-4fc6-bebb-02e3e8acd391 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/f9ea8cc2-b198-43e0-bc40-252eebf55631" status: 404 len: 111 microversion: 2.1 time: 0.051165 Oct 27 03:45:37.502595 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2656/5598] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:45:37 2022] GET /compute/v2.1/servers/f9ea8cc2-b198-43e0-bc40-252eebf55631 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:45:37.512624 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-619c1f9e-62e2-4b67-bb27-3fd1224a6865 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:37.513290 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-619c1f9e-62e2-4b67-bb27-3fd1224a6865 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: f3fcf361-2e24-402c-8290-6bc77b1125fa] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:37.523283 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-619c1f9e-62e2-4b67-bb27-3fd1224a6865 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:37.523970 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-619c1f9e-62e2-4b67-bb27-3fd1224a6865 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:37.524595 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-619c1f9e-62e2-4b67-bb27-3fd1224a6865 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:37.525488 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-619c1f9e-62e2-4b67-bb27-3fd1224a6865 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:37.526160 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-619c1f9e-62e2-4b67-bb27-3fd1224a6865 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:37.526872 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-619c1f9e-62e2-4b67-bb27-3fd1224a6865 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:37.551880 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-619c1f9e-62e2-4b67-bb27-3fd1224a6865 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] HTTP exception thrown: Instance f3fcf361-2e24-402c-8290-6bc77b1125fa could not be found. Oct 27 03:45:37.554809 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-619c1f9e-62e2-4b67-bb27-3fd1224a6865 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Request method failure captured: Oct 27 03:45:37.554809 n-d-862769-1 devstack@n-api.service[121001]: request: DELETE /compute/v2.1/servers/f3fcf361-2e24-402c-8290-6bc77b1125fa HTTP/1.1 Oct 27 03:45:37.554809 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:45:37.554809 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:45:37.554809 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:45:37.554809 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:45:37.554809 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:45:37.554809 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:45:37.554809 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:45:37.554809 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:45:37.554809 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWf46R9AxjgEFrHb7AiRobQH39rbeL1ckKWnVGdkzC1zmyiK4yenEe3yaH7e4lFwYjbkrGU3Z3yYsFh0NL6Q4374F-z32JXuOUJVaKajgMquCNY59IbbWsLnC7j42FcqZKFZSuZcq3PTs5XcTfyud7oZRQqgN0qCyBq1n8t4CELUydAE Oct 27 03:45:37.554809 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:45:37.554809 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:45:37.554809 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:45:37.554809 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:45:37.554809 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:45:37.554809 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:45:37.554809 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: eb2e83a4c2af45b49c6f23de08547160 Oct 27 03:45:37.554809 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2106504994 Oct 27 03:45:37.554809 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:45:37.554809 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:45:37.554809 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eb2e83a4c2af45b49c6f23de08547160"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/eb2e83a4c2af45b49c6f23de08547160"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eb2e83a4c2af45b49c6f23de08547160"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_eb2e83a4c2af45b49c6f23de08547160"}]}] Oct 27 03:45:37.554809 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServerDiskConfigTestJSON-2106504994 Oct 27 03:45:37.554809 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: eb2e83a4c2af45b49c6f23de08547160 Oct 27 03:45:37.554809 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2106504994 Oct 27 03:45:37.554809 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServerDiskConfigTestJSON-2106504994-project Oct 27 03:45:37.554809 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:45:37.554809 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:45:37.554809 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 9454949c8d794b6093d7d4fc64d12c33 Oct 27 03:45:37.554809 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServerDiskConfigTestJSON-2106504994-project Oct 27 03:45:37.554809 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:45:37.554809 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance f3fcf361-2e24-402c-8290-6bc77b1125fa could not be found. Oct 27 03:45:37.554809 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': 'f3fcf361-2e24-402c-8290-6bc77b1125fa'} Oct 27 03:45:37.554809 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:45:37.554809 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:45:37.554809 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:45:37.554809 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:45:37.554809 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:45:37.554809 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:45:37.554809 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:45:37.554809 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:45:37.554809 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:45:37.554809 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:45:37.554809 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3fcf361-2e24-402c-8290-6bc77b1125fa could not be found. Oct 27 03:45:37.554809 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:45:37.554809 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:45:37.554809 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:45:37.554809 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:45:37.554809 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:45:37.554809 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:45:37.554809 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:45:37.554809 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:45:37.554809 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:45:37.554809 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:45:37.554809 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 03:45:37.554809 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 03:45:37.554809 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 03:45:37.554809 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 03:45:37.554809 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:45:37.554809 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:45:37.554809 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:45:37.554809 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:45:37.567295 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3fcf361-2e24-402c-8290-6bc77b1125fa could not be found. Oct 27 03:45:37.567295 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:45:37.567295 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:45:37.567295 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:45:37.567295 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:45:37.567295 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:45:37.567295 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:45:37.567295 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:45:37.567295 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:45:37.567295 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3fcf361-2e24-402c-8290-6bc77b1125fa could not be found. Oct 27 03:45:37.567295 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:45:37.567295 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-619c1f9e-62e2-4b67-bb27-3fd1224a6865 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Returning 404 to user: Instance f3fcf361-2e24-402c-8290-6bc77b1125fa could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:45:37.567295 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-619c1f9e-62e2-4b67-bb27-3fd1224a6865 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f3fcf361-2e24-402c-8290-6bc77b1125fa" status: 404 len: 111 microversion: 2.1 time: 0.050959 Oct 27 03:45:37.567295 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2943/5599] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:45:37 2022] DELETE /compute/v2.1/servers/f3fcf361-2e24-402c-8290-6bc77b1125fa => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 03:45:37.574601 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-88943afe-f6e3-406b-9d97-29fd709cc581 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:37.575338 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-88943afe-f6e3-406b-9d97-29fd709cc581 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: f3fcf361-2e24-402c-8290-6bc77b1125fa] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:37.583123 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-88943afe-f6e3-406b-9d97-29fd709cc581 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:37.585691 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-88943afe-f6e3-406b-9d97-29fd709cc581 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:37.595324 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-88943afe-f6e3-406b-9d97-29fd709cc581 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:37.595324 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-88943afe-f6e3-406b-9d97-29fd709cc581 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:37.595324 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-88943afe-f6e3-406b-9d97-29fd709cc581 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:37.595324 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-88943afe-f6e3-406b-9d97-29fd709cc581 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:37.622567 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-88943afe-f6e3-406b-9d97-29fd709cc581 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] HTTP exception thrown: Instance f3fcf361-2e24-402c-8290-6bc77b1125fa could not be found. Oct 27 03:45:37.628975 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-88943afe-f6e3-406b-9d97-29fd709cc581 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Request method failure captured: Oct 27 03:45:37.628975 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/f3fcf361-2e24-402c-8290-6bc77b1125fa HTTP/1.1 Oct 27 03:45:37.628975 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:45:37.628975 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:45:37.628975 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:45:37.628975 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:45:37.628975 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:45:37.628975 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:45:37.628975 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:45:37.628975 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:45:37.628975 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWf46R9AxjgEFrHb7AiRobQH39rbeL1ckKWnVGdkzC1zmyiK4yenEe3yaH7e4lFwYjbkrGU3Z3yYsFh0NL6Q4374F-z32JXuOUJVaKajgMquCNY59IbbWsLnC7j42FcqZKFZSuZcq3PTs5XcTfyud7oZRQqgN0qCyBq1n8t4CELUydAE Oct 27 03:45:37.628975 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:45:37.628975 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:45:37.628975 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:45:37.628975 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:45:37.628975 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:45:37.628975 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:45:37.628975 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: eb2e83a4c2af45b49c6f23de08547160 Oct 27 03:45:37.628975 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2106504994 Oct 27 03:45:37.628975 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:45:37.628975 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:45:37.628975 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eb2e83a4c2af45b49c6f23de08547160"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/eb2e83a4c2af45b49c6f23de08547160"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eb2e83a4c2af45b49c6f23de08547160"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_eb2e83a4c2af45b49c6f23de08547160"}]}] Oct 27 03:45:37.628975 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ServerDiskConfigTestJSON-2106504994 Oct 27 03:45:37.628975 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: eb2e83a4c2af45b49c6f23de08547160 Oct 27 03:45:37.628975 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2106504994 Oct 27 03:45:37.628975 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ServerDiskConfigTestJSON-2106504994-project Oct 27 03:45:37.628975 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:45:37.628975 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:45:37.628975 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 9454949c8d794b6093d7d4fc64d12c33 Oct 27 03:45:37.628975 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ServerDiskConfigTestJSON-2106504994-project Oct 27 03:45:37.628975 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:45:37.628975 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance f3fcf361-2e24-402c-8290-6bc77b1125fa could not be found. Oct 27 03:45:37.628975 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': 'f3fcf361-2e24-402c-8290-6bc77b1125fa'} Oct 27 03:45:37.628975 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:45:37.628975 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:45:37.628975 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:45:37.628975 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:45:37.628975 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:45:37.628975 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:45:37.628975 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:45:37.628975 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:45:37.628975 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:45:37.628975 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:45:37.628975 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3fcf361-2e24-402c-8290-6bc77b1125fa could not be found. Oct 27 03:45:37.628975 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:45:37.628975 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:45:37.628975 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:45:37.628975 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:45:37.628975 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:45:37.628975 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:45:37.628975 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:45:37.628975 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:45:37.628975 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:45:37.628975 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:45:37.628975 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:45:37.628975 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:45:37.628975 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:45:37.628975 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:45:37.628975 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:45:37.628975 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:45:37.628975 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3fcf361-2e24-402c-8290-6bc77b1125fa could not be found. Oct 27 03:45:37.628975 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:45:37.628975 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:45:37.628975 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:45:37.635528 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:45:37.635528 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:45:37.635528 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:45:37.635528 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:45:37.635528 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:45:37.635528 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3fcf361-2e24-402c-8290-6bc77b1125fa could not be found. Oct 27 03:45:37.635528 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:45:37.635528 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-88943afe-f6e3-406b-9d97-29fd709cc581 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Returning 404 to user: Instance f3fcf361-2e24-402c-8290-6bc77b1125fa could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:45:37.635528 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-88943afe-f6e3-406b-9d97-29fd709cc581 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/f3fcf361-2e24-402c-8290-6bc77b1125fa" status: 404 len: 111 microversion: 2.1 time: 0.056977 Oct 27 03:45:37.635528 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2657/5600] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:45:37 2022] GET /compute/v2.1/servers/f3fcf361-2e24-402c-8290-6bc77b1125fa => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:45:37.643803 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-78b3cbd8-f515-4799-98dc-b33c6d5534de tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:37.645505 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-78b3cbd8-f515-4799-98dc-b33c6d5534de tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: 55152bbe-5a47-4916-ad12-5f1640f0be61] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:37.655509 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-78b3cbd8-f515-4799-98dc-b33c6d5534de tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:37.656686 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-78b3cbd8-f515-4799-98dc-b33c6d5534de tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:37.657692 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-78b3cbd8-f515-4799-98dc-b33c6d5534de tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:37.659392 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-78b3cbd8-f515-4799-98dc-b33c6d5534de tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:37.660073 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-78b3cbd8-f515-4799-98dc-b33c6d5534de tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:37.660717 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-78b3cbd8-f515-4799-98dc-b33c6d5534de tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:37.692933 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-78b3cbd8-f515-4799-98dc-b33c6d5534de tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] HTTP exception thrown: Instance 55152bbe-5a47-4916-ad12-5f1640f0be61 could not be found. Oct 27 03:45:37.694802 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-78b3cbd8-f515-4799-98dc-b33c6d5534de tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Request method failure captured: Oct 27 03:45:37.694802 n-d-862769-1 devstack@n-api.service[121001]: request: DELETE /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61 HTTP/1.1 Oct 27 03:45:37.694802 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:45:37.694802 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:45:37.694802 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:45:37.694802 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:45:37.694802 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:45:37.694802 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:45:37.694802 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:45:37.694802 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:45:37.694802 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWf46R9AxjgEFrHb7AiRobQH39rbeL1ckKWnVGdkzC1zmyiK4yenEe3yaH7e4lFwYjbkrGU3Z3yYsFh0NL6Q4374F-z32JXuOUJVaKajgMquCNY59IbbWsLnC7j42FcqZKFZSuZcq3PTs5XcTfyud7oZRQqgN0qCyBq1n8t4CELUydAE Oct 27 03:45:37.694802 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:45:37.694802 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:45:37.694802 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:45:37.694802 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:45:37.694802 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:45:37.694802 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:45:37.694802 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: eb2e83a4c2af45b49c6f23de08547160 Oct 27 03:45:37.694802 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2106504994 Oct 27 03:45:37.694802 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:45:37.694802 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:45:37.694802 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eb2e83a4c2af45b49c6f23de08547160"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/eb2e83a4c2af45b49c6f23de08547160"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eb2e83a4c2af45b49c6f23de08547160"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_eb2e83a4c2af45b49c6f23de08547160"}]}] Oct 27 03:45:37.694802 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServerDiskConfigTestJSON-2106504994 Oct 27 03:45:37.694802 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: eb2e83a4c2af45b49c6f23de08547160 Oct 27 03:45:37.694802 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2106504994 Oct 27 03:45:37.694802 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServerDiskConfigTestJSON-2106504994-project Oct 27 03:45:37.694802 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:45:37.694802 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:45:37.694802 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 9454949c8d794b6093d7d4fc64d12c33 Oct 27 03:45:37.694802 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServerDiskConfigTestJSON-2106504994-project Oct 27 03:45:37.694802 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:45:37.694802 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 55152bbe-5a47-4916-ad12-5f1640f0be61 could not be found. Oct 27 03:45:37.694802 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '55152bbe-5a47-4916-ad12-5f1640f0be61'} Oct 27 03:45:37.694802 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:45:37.694802 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:45:37.694802 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:45:37.694802 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:45:37.694802 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:45:37.694802 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:45:37.694802 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:45:37.694802 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:45:37.694802 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:45:37.694802 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:45:37.694802 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55152bbe-5a47-4916-ad12-5f1640f0be61 could not be found. Oct 27 03:45:37.694802 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:45:37.694802 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:45:37.694802 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:45:37.694802 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:45:37.694802 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:45:37.694802 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:45:37.694802 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:45:37.694802 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:45:37.694802 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:45:37.694802 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:45:37.694802 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 03:45:37.694802 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 03:45:37.694802 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 03:45:37.694802 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 03:45:37.694802 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:45:37.694802 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:45:37.694802 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:45:37.694802 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:45:37.699726 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55152bbe-5a47-4916-ad12-5f1640f0be61 could not be found. Oct 27 03:45:37.699726 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:45:37.699726 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:45:37.699726 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:45:37.699726 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:45:37.699726 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:45:37.699726 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:45:37.699726 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:45:37.699726 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:45:37.699726 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55152bbe-5a47-4916-ad12-5f1640f0be61 could not be found. Oct 27 03:45:37.699726 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:45:37.699726 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-78b3cbd8-f515-4799-98dc-b33c6d5534de tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Returning 404 to user: Instance 55152bbe-5a47-4916-ad12-5f1640f0be61 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:45:37.699726 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-78b3cbd8-f515-4799-98dc-b33c6d5534de tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "DELETE /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61" status: 404 len: 111 microversion: 2.1 time: 0.058270 Oct 27 03:45:37.701980 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2944/5601] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:45:37 2022] DELETE /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:45:37.707273 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-87206214-a734-4fa1-8324-0818eed44db9 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:37.707903 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-87206214-a734-4fa1-8324-0818eed44db9 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] [instance: 55152bbe-5a47-4916-ad12-5f1640f0be61] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:37.718342 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-87206214-a734-4fa1-8324-0818eed44db9 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:37.718914 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-87206214-a734-4fa1-8324-0818eed44db9 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:37.721360 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-87206214-a734-4fa1-8324-0818eed44db9 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:37.722271 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-87206214-a734-4fa1-8324-0818eed44db9 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:37.722914 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-87206214-a734-4fa1-8324-0818eed44db9 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:37.723638 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-87206214-a734-4fa1-8324-0818eed44db9 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:37.747602 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-87206214-a734-4fa1-8324-0818eed44db9 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] HTTP exception thrown: Instance 55152bbe-5a47-4916-ad12-5f1640f0be61 could not be found. Oct 27 03:45:37.750590 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-87206214-a734-4fa1-8324-0818eed44db9 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Request method failure captured: Oct 27 03:45:37.750590 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61 HTTP/1.1 Oct 27 03:45:37.750590 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:45:37.750590 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:45:37.750590 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:45:37.750590 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:45:37.750590 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:45:37.750590 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:45:37.750590 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:45:37.750590 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:45:37.750590 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWf46R9AxjgEFrHb7AiRobQH39rbeL1ckKWnVGdkzC1zmyiK4yenEe3yaH7e4lFwYjbkrGU3Z3yYsFh0NL6Q4374F-z32JXuOUJVaKajgMquCNY59IbbWsLnC7j42FcqZKFZSuZcq3PTs5XcTfyud7oZRQqgN0qCyBq1n8t4CELUydAE Oct 27 03:45:37.750590 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:45:37.750590 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:45:37.750590 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:45:37.750590 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:45:37.750590 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:45:37.750590 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:45:37.750590 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: eb2e83a4c2af45b49c6f23de08547160 Oct 27 03:45:37.750590 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2106504994 Oct 27 03:45:37.750590 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:45:37.750590 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:45:37.750590 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eb2e83a4c2af45b49c6f23de08547160"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/eb2e83a4c2af45b49c6f23de08547160"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eb2e83a4c2af45b49c6f23de08547160"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_eb2e83a4c2af45b49c6f23de08547160"}]}] Oct 27 03:45:37.750590 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ServerDiskConfigTestJSON-2106504994 Oct 27 03:45:37.750590 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: eb2e83a4c2af45b49c6f23de08547160 Oct 27 03:45:37.750590 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2106504994 Oct 27 03:45:37.750590 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ServerDiskConfigTestJSON-2106504994-project Oct 27 03:45:37.750590 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:45:37.750590 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:45:37.750590 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 9454949c8d794b6093d7d4fc64d12c33 Oct 27 03:45:37.750590 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ServerDiskConfigTestJSON-2106504994-project Oct 27 03:45:37.750590 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:45:37.750590 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 55152bbe-5a47-4916-ad12-5f1640f0be61 could not be found. Oct 27 03:45:37.750590 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '55152bbe-5a47-4916-ad12-5f1640f0be61'} Oct 27 03:45:37.750590 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:45:37.750590 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:45:37.750590 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:45:37.750590 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:45:37.750590 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:45:37.750590 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:45:37.750590 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:45:37.750590 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:45:37.750590 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:45:37.750590 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:45:37.750590 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55152bbe-5a47-4916-ad12-5f1640f0be61 could not be found. Oct 27 03:45:37.750590 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:45:37.750590 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:45:37.750590 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:45:37.750590 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:45:37.750590 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:45:37.750590 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:45:37.750590 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:45:37.750590 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:45:37.750590 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:45:37.750590 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:45:37.750590 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:45:37.750590 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:45:37.750590 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:45:37.750590 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:45:37.750590 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:45:37.750590 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:45:37.750590 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55152bbe-5a47-4916-ad12-5f1640f0be61 could not be found. Oct 27 03:45:37.750590 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:45:37.750590 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:45:37.750590 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:45:37.757405 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:45:37.757405 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:45:37.757405 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:45:37.757405 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:45:37.757405 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:45:37.757405 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55152bbe-5a47-4916-ad12-5f1640f0be61 could not be found. Oct 27 03:45:37.757405 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:45:37.759927 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-87206214-a734-4fa1-8324-0818eed44db9 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] Returning 404 to user: Instance 55152bbe-5a47-4916-ad12-5f1640f0be61 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:45:37.761093 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-87206214-a734-4fa1-8324-0818eed44db9 tempest-ServerDiskConfigTestJSON-2106504994 tempest-ServerDiskConfigTestJSON-2106504994-project] 10.222.0.20 "GET /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61" status: 404 len: 111 microversion: 2.1 time: 0.058348 Oct 27 03:45:37.761691 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2658/5602] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:45:37 2022] GET /compute/v2.1/servers/55152bbe-5a47-4916-ad12-5f1640f0be61 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:45:37.771771 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-51c6adad-87c5-47e3-b30b-214995e57e1c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:37.772402 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-51c6adad-87c5-47e3-b30b-214995e57e1c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 1db2318e-9ac7-4994-8daa-14ae22537d5d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:37.782122 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-51c6adad-87c5-47e3-b30b-214995e57e1c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:37.782636 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-51c6adad-87c5-47e3-b30b-214995e57e1c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:37.783115 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-51c6adad-87c5-47e3-b30b-214995e57e1c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:37.785356 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-51c6adad-87c5-47e3-b30b-214995e57e1c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:37.785833 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-51c6adad-87c5-47e3-b30b-214995e57e1c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:37.786307 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-51c6adad-87c5-47e3-b30b-214995e57e1c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:38.151560 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-51c6adad-87c5-47e3-b30b-214995e57e1c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:38.180186 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-51c6adad-87c5-47e3-b30b-214995e57e1c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:38.185290 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-51c6adad-87c5-47e3-b30b-214995e57e1c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:38.195733 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-51c6adad-87c5-47e3-b30b-214995e57e1c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d" status: 200 len: 1731 microversion: 2.20 time: 0.428869 Oct 27 03:45:38.199106 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2945/5603] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:45:37 2022] GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d => generated 1731 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:45:38.376472 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ccf6bae8-7246-4159-b2f8-abf2bb29b890 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:38.377678 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ccf6bae8-7246-4159-b2f8-abf2bb29b890 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 1b2e58e9-cd92-4a71-91f6-1e77ad99a685] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:38.404946 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ccf6bae8-7246-4159-b2f8-abf2bb29b890 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:38.405467 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ccf6bae8-7246-4159-b2f8-abf2bb29b890 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:38.405915 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ccf6bae8-7246-4159-b2f8-abf2bb29b890 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:38.406660 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ccf6bae8-7246-4159-b2f8-abf2bb29b890 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:38.409340 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ccf6bae8-7246-4159-b2f8-abf2bb29b890 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:38.409808 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ccf6bae8-7246-4159-b2f8-abf2bb29b890 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:39.232986 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8207816e-a523-45c5-9572-6e858fd8a00e tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:39.233688 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8207816e-a523-45c5-9572-6e858fd8a00e tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 1db2318e-9ac7-4994-8daa-14ae22537d5d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:39.251243 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8207816e-a523-45c5-9572-6e858fd8a00e tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:39.251243 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8207816e-a523-45c5-9572-6e858fd8a00e tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:39.251243 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8207816e-a523-45c5-9572-6e858fd8a00e tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:39.258936 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8207816e-a523-45c5-9572-6e858fd8a00e tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:39.259645 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8207816e-a523-45c5-9572-6e858fd8a00e tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:39.260275 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8207816e-a523-45c5-9572-6e858fd8a00e tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:39.455762 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ccf6bae8-7246-4159-b2f8-abf2bb29b890 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:39.470353 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ccf6bae8-7246-4159-b2f8-abf2bb29b890 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/1b2e58e9-cd92-4a71-91f6-1e77ad99a685" status: 200 len: 1293 microversion: 2.1 time: 1.100285 Oct 27 03:45:39.471508 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2659/5604] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:45:38 2022] GET /compute/v2.1/servers/1b2e58e9-cd92-4a71-91f6-1e77ad99a685 => generated 1293 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:45:39.551704 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8207816e-a523-45c5-9572-6e858fd8a00e tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:39.561044 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8207816e-a523-45c5-9572-6e858fd8a00e tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:39.562618 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8207816e-a523-45c5-9572-6e858fd8a00e tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:39.564151 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8207816e-a523-45c5-9572-6e858fd8a00e tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d" status: 200 len: 1731 microversion: 2.20 time: 0.335374 Oct 27 03:45:39.578630 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2946/5605] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:45:39 2022] GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d => generated 1731 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:45:39.881131 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ccf6bae8-7246-4159-b2f8-abf2bb29b890 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:39.894736 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ccf6bae8-7246-4159-b2f8-abf2bb29b890 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001508 Oct 27 03:45:39.894736 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2660/5606] 10.222.0.20 () {56 vars in 886 bytes} [Thu Oct 27 03:45:39 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 27 03:45:40.494651 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0e8cb2d2-a583-4932-aa6d-5b0c6e54e6aa tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:40.496202 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0e8cb2d2-a583-4932-aa6d-5b0c6e54e6aa tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 1b2e58e9-cd92-4a71-91f6-1e77ad99a685] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:40.508684 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:45:40.518614 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0e8cb2d2-a583-4932-aa6d-5b0c6e54e6aa tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:40.518614 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0e8cb2d2-a583-4932-aa6d-5b0c6e54e6aa tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:40.518614 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0e8cb2d2-a583-4932-aa6d-5b0c6e54e6aa tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:40.518934 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0e8cb2d2-a583-4932-aa6d-5b0c6e54e6aa tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:40.519235 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0e8cb2d2-a583-4932-aa6d-5b0c6e54e6aa tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:40.519669 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0e8cb2d2-a583-4932-aa6d-5b0c6e54e6aa tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:40.592642 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2e0c17f0-86fb-4e60-91ab-0977aaf01289 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:40.593335 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-2e0c17f0-86fb-4e60-91ab-0977aaf01289 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 1db2318e-9ac7-4994-8daa-14ae22537d5d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:40.601134 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2e0c17f0-86fb-4e60-91ab-0977aaf01289 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:40.602010 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2e0c17f0-86fb-4e60-91ab-0977aaf01289 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:40.602692 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2e0c17f0-86fb-4e60-91ab-0977aaf01289 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:40.603597 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2e0c17f0-86fb-4e60-91ab-0977aaf01289 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:40.604246 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2e0c17f0-86fb-4e60-91ab-0977aaf01289 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:40.604882 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2e0c17f0-86fb-4e60-91ab-0977aaf01289 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:41.013640 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0e8cb2d2-a583-4932-aa6d-5b0c6e54e6aa tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:41.025599 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0e8cb2d2-a583-4932-aa6d-5b0c6e54e6aa tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/1b2e58e9-cd92-4a71-91f6-1e77ad99a685" status: 200 len: 1293 microversion: 2.1 time: 0.536528 Oct 27 03:45:41.026872 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2947/5607] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:45:40 2022] GET /compute/v2.1/servers/1b2e58e9-cd92-4a71-91f6-1e77ad99a685 => generated 1293 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:45:41.045272 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2e0c17f0-86fb-4e60-91ab-0977aaf01289 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:41.055766 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2e0c17f0-86fb-4e60-91ab-0977aaf01289 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:41.060117 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2e0c17f0-86fb-4e60-91ab-0977aaf01289 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:41.063530 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2e0c17f0-86fb-4e60-91ab-0977aaf01289 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d" status: 200 len: 1731 microversion: 2.20 time: 0.475773 Oct 27 03:45:41.084238 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2661/5608] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:45:40 2022] GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d => generated 1731 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:45:41.297943 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-de82e275-5b90-44c4-a330-0751b58e0a37 req-e78b8ac7-45b8-44f1-bae1-56c32a064685 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b2e58e9-cd92-4a71-91f6-1e77ad99a685", "tag": "2bedc222-56b4-48c9-870c-302a1370b2be"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:45:41.320744 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-de82e275-5b90-44c4-a330-0751b58e0a37 req-e78b8ac7-45b8-44f1-bae1-56c32a064685 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:41.321242 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-de82e275-5b90-44c4-a330-0751b58e0a37 req-e78b8ac7-45b8-44f1-bae1-56c32a064685 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:41.321687 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-de82e275-5b90-44c4-a330-0751b58e0a37 req-e78b8ac7-45b8-44f1-bae1-56c32a064685 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:41.357017 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-de82e275-5b90-44c4-a330-0751b58e0a37 req-e78b8ac7-45b8-44f1-bae1-56c32a064685 service nova] Creating event network-changed:2bedc222-56b4-48c9-870c-302a1370b2be for instance 1b2e58e9-cd92-4a71-91f6-1e77ad99a685 on n-h2-862769-1 Oct 27 03:45:41.374840 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-de82e275-5b90-44c4-a330-0751b58e0a37 req-e78b8ac7-45b8-44f1-bae1-56c32a064685 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081993 Oct 27 03:45:41.376147 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2948/5609] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:45:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:45:42.049866 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6c2cac5c-0e06-4a7f-8830-1d68bbf15989 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:42.050743 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6c2cac5c-0e06-4a7f-8830-1d68bbf15989 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 1b2e58e9-cd92-4a71-91f6-1e77ad99a685] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:42.064984 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:45:42.067095 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6c2cac5c-0e06-4a7f-8830-1d68bbf15989 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:42.067752 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6c2cac5c-0e06-4a7f-8830-1d68bbf15989 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:42.068458 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6c2cac5c-0e06-4a7f-8830-1d68bbf15989 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:42.076209 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6c2cac5c-0e06-4a7f-8830-1d68bbf15989 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:42.076957 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6c2cac5c-0e06-4a7f-8830-1d68bbf15989 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:42.077629 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6c2cac5c-0e06-4a7f-8830-1d68bbf15989 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:42.098870 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b1b259b5-b791-4201-8c2c-dafa8f41fb0c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:42.099612 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b1b259b5-b791-4201-8c2c-dafa8f41fb0c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 1db2318e-9ac7-4994-8daa-14ae22537d5d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:42.113627 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b1b259b5-b791-4201-8c2c-dafa8f41fb0c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:42.114167 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b1b259b5-b791-4201-8c2c-dafa8f41fb0c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:42.114637 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b1b259b5-b791-4201-8c2c-dafa8f41fb0c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:42.115386 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b1b259b5-b791-4201-8c2c-dafa8f41fb0c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:42.115849 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b1b259b5-b791-4201-8c2c-dafa8f41fb0c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:42.116293 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b1b259b5-b791-4201-8c2c-dafa8f41fb0c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:42.355231 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=8 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:45:42.655431 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b1b259b5-b791-4201-8c2c-dafa8f41fb0c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:42.681882 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b1b259b5-b791-4201-8c2c-dafa8f41fb0c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:42.685537 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b1b259b5-b791-4201-8c2c-dafa8f41fb0c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:42.688823 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b1b259b5-b791-4201-8c2c-dafa8f41fb0c tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d" status: 200 len: 1718 microversion: 2.20 time: 0.597087 Oct 27 03:45:42.690739 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2949/5610] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:45:42 2022] GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d => generated 1718 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:45:42.795324 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-6c2cac5c-0e06-4a7f-8830-1d68bbf15989 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:42.807431 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6c2cac5c-0e06-4a7f-8830-1d68bbf15989 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/1b2e58e9-cd92-4a71-91f6-1e77ad99a685" status: 200 len: 1293 microversion: 2.1 time: 0.762096 Oct 27 03:45:42.821233 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2662/5611] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:45:42 2022] GET /compute/v2.1/servers/1b2e58e9-cd92-4a71-91f6-1e77ad99a685 => generated 1293 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:45:43.833783 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d1cc3f02-a7d0-402a-b598-33dc73d94cbf tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:43.835291 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d1cc3f02-a7d0-402a-b598-33dc73d94cbf tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 1b2e58e9-cd92-4a71-91f6-1e77ad99a685] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:43.847837 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:45:43.851148 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d1cc3f02-a7d0-402a-b598-33dc73d94cbf tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:43.852818 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d1cc3f02-a7d0-402a-b598-33dc73d94cbf tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:43.853961 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d1cc3f02-a7d0-402a-b598-33dc73d94cbf tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:43.857443 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d1cc3f02-a7d0-402a-b598-33dc73d94cbf tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:43.858242 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d1cc3f02-a7d0-402a-b598-33dc73d94cbf tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:43.858993 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d1cc3f02-a7d0-402a-b598-33dc73d94cbf tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:44.143998 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d1cc3f02-a7d0-402a-b598-33dc73d94cbf tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:44.161641 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d1cc3f02-a7d0-402a-b598-33dc73d94cbf tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/1b2e58e9-cd92-4a71-91f6-1e77ad99a685" status: 200 len: 1293 microversion: 2.1 time: 0.332256 Oct 27 03:45:44.163985 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2950/5612] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:45:43 2022] GET /compute/v2.1/servers/1b2e58e9-cd92-4a71-91f6-1e77ad99a685 => generated 1293 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:45:45.198588 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-376736da-7035-4e55-a6ab-07aae61a3da2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:45.199797 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-376736da-7035-4e55-a6ab-07aae61a3da2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 1b2e58e9-cd92-4a71-91f6-1e77ad99a685] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:45.208243 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-376736da-7035-4e55-a6ab-07aae61a3da2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:45.208981 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-376736da-7035-4e55-a6ab-07aae61a3da2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:45.209600 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-376736da-7035-4e55-a6ab-07aae61a3da2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:45.210545 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-376736da-7035-4e55-a6ab-07aae61a3da2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:45.211182 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-376736da-7035-4e55-a6ab-07aae61a3da2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:45.211784 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-376736da-7035-4e55-a6ab-07aae61a3da2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:45.709698 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-376736da-7035-4e55-a6ab-07aae61a3da2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:45.725036 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-376736da-7035-4e55-a6ab-07aae61a3da2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/1b2e58e9-cd92-4a71-91f6-1e77ad99a685" status: 200 len: 1293 microversion: 2.1 time: 0.530262 Oct 27 03:45:45.744453 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2663/5613] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:45:45 2022] GET /compute/v2.1/servers/1b2e58e9-cd92-4a71-91f6-1e77ad99a685 => generated 1293 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:45:46.758334 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-965f795c-5a99-4500-9568-98884fb30cb2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:46.759423 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-965f795c-5a99-4500-9568-98884fb30cb2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 1b2e58e9-cd92-4a71-91f6-1e77ad99a685] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:46.767899 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-965f795c-5a99-4500-9568-98884fb30cb2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:46.769198 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-965f795c-5a99-4500-9568-98884fb30cb2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:46.769841 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-965f795c-5a99-4500-9568-98884fb30cb2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:46.771359 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-965f795c-5a99-4500-9568-98884fb30cb2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:46.771989 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-965f795c-5a99-4500-9568-98884fb30cb2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:46.775197 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-965f795c-5a99-4500-9568-98884fb30cb2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:47.000619 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-965f795c-5a99-4500-9568-98884fb30cb2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:47.014365 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-965f795c-5a99-4500-9568-98884fb30cb2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/1b2e58e9-cd92-4a71-91f6-1e77ad99a685" status: 200 len: 1293 microversion: 2.1 time: 0.261114 Oct 27 03:45:47.027390 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2951/5614] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:45:46 2022] GET /compute/v2.1/servers/1b2e58e9-cd92-4a71-91f6-1e77ad99a685 => generated 1293 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:45:48.053561 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d997bf3b-13e4-4c93-97de-b053413ec550 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:48.054258 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d997bf3b-13e4-4c93-97de-b053413ec550 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 1b2e58e9-cd92-4a71-91f6-1e77ad99a685] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:48.094344 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:45:48.101937 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d997bf3b-13e4-4c93-97de-b053413ec550 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:48.103139 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d997bf3b-13e4-4c93-97de-b053413ec550 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:48.107986 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d997bf3b-13e4-4c93-97de-b053413ec550 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:48.107986 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d997bf3b-13e4-4c93-97de-b053413ec550 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:48.108828 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d997bf3b-13e4-4c93-97de-b053413ec550 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:48.109081 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d997bf3b-13e4-4c93-97de-b053413ec550 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:48.434300 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d997bf3b-13e4-4c93-97de-b053413ec550 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:48.447048 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d997bf3b-13e4-4c93-97de-b053413ec550 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/1b2e58e9-cd92-4a71-91f6-1e77ad99a685" status: 200 len: 1293 microversion: 2.1 time: 0.408005 Oct 27 03:45:48.448298 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2664/5615] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:45:48 2022] GET /compute/v2.1/servers/1b2e58e9-cd92-4a71-91f6-1e77ad99a685 => generated 1293 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:45:48.806339 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-a337a14b-0910-48df-a55e-8c087d062856 req-a2ef670d-9d46-48b5-8422-60a649360a2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b2e58e9-cd92-4a71-91f6-1e77ad99a685", "name": "network-vif-plugged", "status": "completed", "tag": "2bedc222-56b4-48c9-870c-302a1370b2be"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:45:48.827011 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-a337a14b-0910-48df-a55e-8c087d062856 req-a2ef670d-9d46-48b5-8422-60a649360a2b service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:48.827973 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-a337a14b-0910-48df-a55e-8c087d062856 req-a2ef670d-9d46-48b5-8422-60a649360a2b service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:48.828435 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-a337a14b-0910-48df-a55e-8c087d062856 req-a2ef670d-9d46-48b5-8422-60a649360a2b service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:48.857876 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-a337a14b-0910-48df-a55e-8c087d062856 req-a2ef670d-9d46-48b5-8422-60a649360a2b service nova] Creating event network-vif-plugged:2bedc222-56b4-48c9-870c-302a1370b2be for instance 1b2e58e9-cd92-4a71-91f6-1e77ad99a685 on n-h2-862769-1 Oct 27 03:45:48.867681 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-a337a14b-0910-48df-a55e-8c087d062856 req-a2ef670d-9d46-48b5-8422-60a649360a2b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065639 Oct 27 03:45:48.871803 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2952/5616] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:45:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:45:49.041797 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-bfd5000e-8bc0-4daf-9924-7dfea729d0f2 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:49.042352 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-bfd5000e-8bc0-4daf-9924-7dfea729d0f2 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: dbdbec9a-f4bf-4740-ab67-3c8891e341a1] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:49.062653 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bfd5000e-8bc0-4daf-9924-7dfea729d0f2 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:49.063227 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bfd5000e-8bc0-4daf-9924-7dfea729d0f2 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:49.063606 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bfd5000e-8bc0-4daf-9924-7dfea729d0f2 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:49.064379 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bfd5000e-8bc0-4daf-9924-7dfea729d0f2 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:49.064852 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bfd5000e-8bc0-4daf-9924-7dfea729d0f2 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:49.065289 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bfd5000e-8bc0-4daf-9924-7dfea729d0f2 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:49.238124 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-bfd5000e-8bc0-4daf-9924-7dfea729d0f2 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lazy-loading 'services' on Instance uuid dbdbec9a-f4bf-4740-ab67-3c8891e341a1 {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:45:49.473114 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f6f1df29-0722-48b1-b24e-b09c817ff28d tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:49.473837 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f6f1df29-0722-48b1-b24e-b09c817ff28d tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 1b2e58e9-cd92-4a71-91f6-1e77ad99a685] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:49.480847 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f6f1df29-0722-48b1-b24e-b09c817ff28d tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:49.481477 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f6f1df29-0722-48b1-b24e-b09c817ff28d tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:49.482156 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f6f1df29-0722-48b1-b24e-b09c817ff28d tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:49.482883 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f6f1df29-0722-48b1-b24e-b09c817ff28d tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:49.483384 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f6f1df29-0722-48b1-b24e-b09c817ff28d tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:49.489311 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f6f1df29-0722-48b1-b24e-b09c817ff28d tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:49.491081 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-bfd5000e-8bc0-4daf-9924-7dfea729d0f2 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "DELETE /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1/os-volume_attachments/c7f5d06b-4c82-4323-989e-6306c263cb6f" status: 202 len: 0 microversion: 2.1 time: 0.453415 Oct 27 03:45:49.492354 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2665/5617] 10.222.0.20 () {58 vars in 1416 bytes} [Thu Oct 27 03:45:49 2022] DELETE /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1/os-volume_attachments/c7f5d06b-4c82-4323-989e-6306c263cb6f => generated 0 bytes in 456 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:45:49.501383 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-15f5d492-fee7-41b2-8f9e-ab32119930ab tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:49.505807 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-15f5d492-fee7-41b2-8f9e-ab32119930ab tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: dbdbec9a-f4bf-4740-ab67-3c8891e341a1] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:49.518707 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-15f5d492-fee7-41b2-8f9e-ab32119930ab tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:49.524071 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-15f5d492-fee7-41b2-8f9e-ab32119930ab tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:49.524844 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-15f5d492-fee7-41b2-8f9e-ab32119930ab tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:49.525839 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-15f5d492-fee7-41b2-8f9e-ab32119930ab tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:49.526554 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-15f5d492-fee7-41b2-8f9e-ab32119930ab tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:49.527228 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-15f5d492-fee7-41b2-8f9e-ab32119930ab tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:49.564681 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-15f5d492-fee7-41b2-8f9e-ab32119930ab tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066764 Oct 27 03:45:49.565209 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2666/5618] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 27 03:45:49 2022] GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:45:49.815467 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f6f1df29-0722-48b1-b24e-b09c817ff28d tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:49.830387 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f6f1df29-0722-48b1-b24e-b09c817ff28d tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/1b2e58e9-cd92-4a71-91f6-1e77ad99a685" status: 200 len: 1293 microversion: 2.1 time: 0.361591 Oct 27 03:45:49.831001 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2953/5619] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:45:49 2022] GET /compute/v2.1/servers/1b2e58e9-cd92-4a71-91f6-1e77ad99a685 => generated 1293 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:45:50.578135 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-060ae6b2-37e2-4ae4-aca0-4e6ba8b5c629 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:50.580720 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-060ae6b2-37e2-4ae4-aca0-4e6ba8b5c629 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: dbdbec9a-f4bf-4740-ab67-3c8891e341a1] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:50.588766 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-060ae6b2-37e2-4ae4-aca0-4e6ba8b5c629 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:50.589258 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-060ae6b2-37e2-4ae4-aca0-4e6ba8b5c629 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:50.590010 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-060ae6b2-37e2-4ae4-aca0-4e6ba8b5c629 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:50.596459 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-060ae6b2-37e2-4ae4-aca0-4e6ba8b5c629 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:50.596459 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-060ae6b2-37e2-4ae4-aca0-4e6ba8b5c629 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:50.596459 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-060ae6b2-37e2-4ae4-aca0-4e6ba8b5c629 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:50.655037 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-060ae6b2-37e2-4ae4-aca0-4e6ba8b5c629 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081308 Oct 27 03:45:50.655743 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2667/5620] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 27 03:45:50 2022] GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:45:50.854099 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4e46c286-41c5-4759-b823-51a95fe2ef5c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:50.855195 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4e46c286-41c5-4759-b823-51a95fe2ef5c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 1b2e58e9-cd92-4a71-91f6-1e77ad99a685] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:50.862964 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4e46c286-41c5-4759-b823-51a95fe2ef5c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:50.863352 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4e46c286-41c5-4759-b823-51a95fe2ef5c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:50.863935 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4e46c286-41c5-4759-b823-51a95fe2ef5c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:50.864666 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4e46c286-41c5-4759-b823-51a95fe2ef5c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:50.865271 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4e46c286-41c5-4759-b823-51a95fe2ef5c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:50.865718 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4e46c286-41c5-4759-b823-51a95fe2ef5c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:51.013460 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4e46c286-41c5-4759-b823-51a95fe2ef5c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:51.024105 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4e46c286-41c5-4759-b823-51a95fe2ef5c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/1b2e58e9-cd92-4a71-91f6-1e77ad99a685" status: 200 len: 1474 microversion: 2.1 time: 0.173891 Oct 27 03:45:51.024797 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2954/5621] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:45:50 2022] GET /compute/v2.1/servers/1b2e58e9-cd92-4a71-91f6-1e77ad99a685 => generated 1474 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:45:51.621108 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-95126854-b755-4897-b535-e0e80766fc3c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-836523696", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:45:51.669836 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-57719b9e-3d37-44ca-baf5-c456ebd516e1 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:51.674014 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-57719b9e-3d37-44ca-baf5-c456ebd516e1 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: dbdbec9a-f4bf-4740-ab67-3c8891e341a1] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:51.684395 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-57719b9e-3d37-44ca-baf5-c456ebd516e1 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:51.685623 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-57719b9e-3d37-44ca-baf5-c456ebd516e1 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:51.690853 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-57719b9e-3d37-44ca-baf5-c456ebd516e1 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:51.702185 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-57719b9e-3d37-44ca-baf5-c456ebd516e1 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:51.702185 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-57719b9e-3d37-44ca-baf5-c456ebd516e1 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:51.702185 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-57719b9e-3d37-44ca-baf5-c456ebd516e1 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:51.712942 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-95126854-b755-4897-b535-e0e80766fc3c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] validate_networks() for [('6ad05158-ac44-4c49-b5d6-443f42165c93', None, None, None, None, None)] {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:45:51.760481 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-57719b9e-3d37-44ca-baf5-c456ebd516e1 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096397 Oct 27 03:45:51.761468 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2955/5622] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 27 03:45:51 2022] GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:45:52.242819 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-95126854-b755-4897-b535-e0e80766fc3c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:45:52.243473 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-95126854-b755-4897-b535-e0e80766fc3c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:45:52.244046 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-95126854-b755-4897-b535-e0e80766fc3c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:45:52.244579 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-95126854-b755-4897-b535-e0e80766fc3c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:45:52.245140 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-95126854-b755-4897-b535-e0e80766fc3c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:45:52.256402 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-95126854-b755-4897-b535-e0e80766fc3c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:52.257013 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-95126854-b755-4897-b535-e0e80766fc3c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:52.261255 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-95126854-b755-4897-b535-e0e80766fc3c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:52.261255 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-95126854-b755-4897-b535-e0e80766fc3c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:52.261255 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-95126854-b755-4897-b535-e0e80766fc3c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:52.261255 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-95126854-b755-4897-b535-e0e80766fc3c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:52.281122 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-95126854-b755-4897-b535-e0e80766fc3c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Getting quotas for project 86b90d4cb5eb42958248b6f82516ce19. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:45:52.287200 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-95126854-b755-4897-b535-e0e80766fc3c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Getting quotas for user ca2da57f02884a968d685b53a5399e46 and project 86b90d4cb5eb42958248b6f82516ce19. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:45:52.301642 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-95126854-b755-4897-b535-e0e80766fc3c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:45:52.304165 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-95126854-b755-4897-b535-e0e80766fc3c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: de89920a-61c7-4e66-8f1f-26182d99464f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:45:52.442703 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-95126854-b755-4897-b535-e0e80766fc3c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.825687 Oct 27 03:45:52.443778 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2668/5623] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:45:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 827 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 03:45:52.455403 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-23920c9c-87b4-4e0e-a729-10a203956bba tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:52.456708 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-23920c9c-87b4-4e0e-a729-10a203956bba tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: de89920a-61c7-4e66-8f1f-26182d99464f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:52.480186 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-23920c9c-87b4-4e0e-a729-10a203956bba tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: de89920a-61c7-4e66-8f1f-26182d99464f] Going to try to terminate instance {{(pid=121001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:45:52.776838 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-47f183d9-86c4-42fd-9504-92379bda1446 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:52.779804 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-47f183d9-86c4-42fd-9504-92379bda1446 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: dbdbec9a-f4bf-4740-ab67-3c8891e341a1] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:52.787248 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-47f183d9-86c4-42fd-9504-92379bda1446 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:52.787768 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-47f183d9-86c4-42fd-9504-92379bda1446 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:52.788290 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-47f183d9-86c4-42fd-9504-92379bda1446 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:52.789055 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-47f183d9-86c4-42fd-9504-92379bda1446 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:52.789580 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-47f183d9-86c4-42fd-9504-92379bda1446 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:52.790102 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-47f183d9-86c4-42fd-9504-92379bda1446 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:52.823701 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-47f183d9-86c4-42fd-9504-92379bda1446 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052022 Oct 27 03:45:52.824914 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2669/5624] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 27 03:45:52 2022] GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:45:53.352271 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.scheduler.client.report [None req-23920c9c-87b4-4e0e-a729-10a203956bba tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Deleted allocations for instance de89920a-61c7-4e66-8f1f-26182d99464f Oct 27 03:45:53.362999 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.compute.api [None req-23920c9c-87b4-4e0e-a729-10a203956bba tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: de89920a-61c7-4e66-8f1f-26182d99464f] Instance Mapping does not exist while attempting local delete cleanup. Oct 27 03:45:53.364784 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-23920c9c-87b4-4e0e-a729-10a203956bba tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "DELETE /compute/v2.1/servers/de89920a-61c7-4e66-8f1f-26182d99464f" status: 204 len: 0 microversion: 2.1 time: 0.912940 Oct 27 03:45:53.365972 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2956/5625] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:45:52 2022] DELETE /compute/v2.1/servers/de89920a-61c7-4e66-8f1f-26182d99464f => generated 0 bytes in 915 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 03:45:53.375601 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2864505a-0a72-458a-96b4-0e7105cbaace tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:53.378580 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-2864505a-0a72-458a-96b4-0e7105cbaace tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: de89920a-61c7-4e66-8f1f-26182d99464f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:53.386337 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-2864505a-0a72-458a-96b4-0e7105cbaace tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] HTTP exception thrown: Instance de89920a-61c7-4e66-8f1f-26182d99464f could not be found. Oct 27 03:45:53.389799 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2864505a-0a72-458a-96b4-0e7105cbaace tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Request method failure captured: Oct 27 03:45:53.389799 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/de89920a-61c7-4e66-8f1f-26182d99464f HTTP/1.1 Oct 27 03:45:53.389799 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:45:53.389799 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:45:53.389799 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:45:53.389799 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:45:53.389799 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:45:53.389799 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:45:53.389799 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:45:53.389799 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:45:53.389799 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWf7ao454EXpcvqw57oZ6kUl55rrrabqqRcgdR7_bXGBd3EhUlwYyYuxAfl-nrBiMviq2ipmr2mbr4b0cgBTMbKDOZJ9TP7cenW0zaGDKmMe2aswh3Oogol3Ct9m8LHYZYqPWmhLSqvB2K7fCZP-q-SBCjWA9jL7HEZxBqgIhBaRnNcs Oct 27 03:45:53.389799 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:45:53.389799 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:45:53.389799 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:45:53.389799 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:45:53.389799 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:45:53.389799 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:45:53.389799 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 86b90d4cb5eb42958248b6f82516ce19 Oct 27 03:45:53.389799 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ServersTestJSON-1724631621 Oct 27 03:45:53.389799 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:45:53.389799 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:45:53.389799 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86b90d4cb5eb42958248b6f82516ce19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/86b90d4cb5eb42958248b6f82516ce19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86b90d4cb5eb42958248b6f82516ce19"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_86b90d4cb5eb42958248b6f82516ce19"}]}] Oct 27 03:45:53.389799 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ServersTestJSON-1724631621 Oct 27 03:45:53.389799 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 86b90d4cb5eb42958248b6f82516ce19 Oct 27 03:45:53.389799 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ServersTestJSON-1724631621 Oct 27 03:45:53.389799 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ServersTestJSON-1724631621-project Oct 27 03:45:53.389799 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:45:53.389799 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:45:53.389799 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: ca2da57f02884a968d685b53a5399e46 Oct 27 03:45:53.389799 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ServersTestJSON-1724631621-project Oct 27 03:45:53.389799 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:45:53.389799 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance de89920a-61c7-4e66-8f1f-26182d99464f could not be found. Oct 27 03:45:53.389799 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': 'de89920a-61c7-4e66-8f1f-26182d99464f'} Oct 27 03:45:53.389799 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:45:53.389799 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:45:53.389799 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:45:53.389799 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:45:53.389799 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:45:53.389799 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:45:53.389799 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 03:45:53.389799 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 03:45:53.389799 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de89920a-61c7-4e66-8f1f-26182d99464f could not be found. Oct 27 03:45:53.389799 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:45:53.389799 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:45:53.389799 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:45:53.389799 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:45:53.389799 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:45:53.389799 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:45:53.389799 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:45:53.389799 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:45:53.389799 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:45:53.389799 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:45:53.389799 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:45:53.389799 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:45:53.389799 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:45:53.389799 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:45:53.389799 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:45:53.389799 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:45:53.389799 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de89920a-61c7-4e66-8f1f-26182d99464f could not be found. Oct 27 03:45:53.389799 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:45:53.389799 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:45:53.389799 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:45:53.389799 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:45:53.389799 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:45:53.395927 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:45:53.395927 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:45:53.395927 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:45:53.395927 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de89920a-61c7-4e66-8f1f-26182d99464f could not be found. Oct 27 03:45:53.395927 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:45:53.397235 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2864505a-0a72-458a-96b4-0e7105cbaace tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Returning 404 to user: Instance de89920a-61c7-4e66-8f1f-26182d99464f could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:45:53.399407 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2864505a-0a72-458a-96b4-0e7105cbaace tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/de89920a-61c7-4e66-8f1f-26182d99464f" status: 404 len: 111 microversion: 2.1 time: 0.028172 Oct 27 03:45:53.400071 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2670/5626] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:45:53 2022] GET /compute/v2.1/servers/de89920a-61c7-4e66-8f1f-26182d99464f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:45:53.809858 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-468d73e7-0c61-4e0c-9953-40f724f3a54f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-850430473", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "6ad05158-ac44-4c49-b5d6-443f42165c93"}]}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:45:53.838934 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d003b772-9c0d-4735-934a-c80071667891 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:53.843596 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d003b772-9c0d-4735-934a-c80071667891 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: dbdbec9a-f4bf-4740-ab67-3c8891e341a1] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:53.862707 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d003b772-9c0d-4735-934a-c80071667891 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:53.868708 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d003b772-9c0d-4735-934a-c80071667891 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:53.869081 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d003b772-9c0d-4735-934a-c80071667891 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:53.869849 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d003b772-9c0d-4735-934a-c80071667891 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:53.870465 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d003b772-9c0d-4735-934a-c80071667891 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:53.870911 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d003b772-9c0d-4735-934a-c80071667891 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:53.897474 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.network.neutron [None req-468d73e7-0c61-4e0c-9953-40f724f3a54f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] validate_networks() for [('6ad05158-ac44-4c49-b5d6-443f42165c93', None, None, None, None, None)] {{(pid=121001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:45:53.916607 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d003b772-9c0d-4735-934a-c80071667891 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081175 Oct 27 03:45:53.917547 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2671/5627] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 27 03:45:53 2022] GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:45:54.491514 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-468d73e7-0c61-4e0c-9953-40f724f3a54f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Flavor limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:45:54.491953 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-468d73e7-0c61-4e0c-9953-40f724f3a54f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Image limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:45:54.492480 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-468d73e7-0c61-4e0c-9953-40f724f3a54f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Flavor pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:45:54.492910 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-468d73e7-0c61-4e0c-9953-40f724f3a54f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Image pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:45:54.493335 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-468d73e7-0c61-4e0c-9953-40f724f3a54f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:45:54.508795 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-468d73e7-0c61-4e0c-9953-40f724f3a54f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:54.509975 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-468d73e7-0c61-4e0c-9953-40f724f3a54f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:54.509975 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-468d73e7-0c61-4e0c-9953-40f724f3a54f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:54.510557 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-468d73e7-0c61-4e0c-9953-40f724f3a54f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:54.511124 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-468d73e7-0c61-4e0c-9953-40f724f3a54f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:54.511478 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-468d73e7-0c61-4e0c-9953-40f724f3a54f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:54.560761 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-468d73e7-0c61-4e0c-9953-40f724f3a54f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Getting quotas for project 86b90d4cb5eb42958248b6f82516ce19. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:45:54.567510 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-468d73e7-0c61-4e0c-9953-40f724f3a54f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Getting quotas for user ca2da57f02884a968d685b53a5399e46 and project 86b90d4cb5eb42958248b6f82516ce19. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:45:54.598852 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-468d73e7-0c61-4e0c-9953-40f724f3a54f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Going to run 1 instances... {{(pid=121001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:45:54.601644 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-468d73e7-0c61-4e0c-9953-40f724f3a54f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 18be006a-739d-4fe2-a04d-1db382b4aeeb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:45:54.807861 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-468d73e7-0c61-4e0c-9953-40f724f3a54f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.003957 Oct 27 03:45:54.816058 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2957/5628] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:45:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1013 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 03:45:54.821074 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-88812d44-1f59-4e17-826d-2bbb7654284e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:54.825005 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-88812d44-1f59-4e17-826d-2bbb7654284e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 18be006a-739d-4fe2-a04d-1db382b4aeeb] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:54.912708 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-88812d44-1f59-4e17-826d-2bbb7654284e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:54.922972 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-88812d44-1f59-4e17-826d-2bbb7654284e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/18be006a-739d-4fe2-a04d-1db382b4aeeb" status: 200 len: 1220 microversion: 2.1 time: 0.105477 Oct 27 03:45:54.938060 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2672/5629] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:45:54 2022] GET /compute/v2.1/servers/18be006a-739d-4fe2-a04d-1db382b4aeeb => generated 1220 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:45:54.949266 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d87a4c0e-8d50-4cf4-be54-2a2cd7f5c40b tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:54.957368 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d87a4c0e-8d50-4cf4-be54-2a2cd7f5c40b tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: dbdbec9a-f4bf-4740-ab67-3c8891e341a1] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:54.968936 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d87a4c0e-8d50-4cf4-be54-2a2cd7f5c40b tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:54.973254 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d87a4c0e-8d50-4cf4-be54-2a2cd7f5c40b tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:54.975383 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d87a4c0e-8d50-4cf4-be54-2a2cd7f5c40b tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:54.976694 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d87a4c0e-8d50-4cf4-be54-2a2cd7f5c40b tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:54.978366 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d87a4c0e-8d50-4cf4-be54-2a2cd7f5c40b tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:54.980383 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d87a4c0e-8d50-4cf4-be54-2a2cd7f5c40b tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:55.025477 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d87a4c0e-8d50-4cf4-be54-2a2cd7f5c40b tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085218 Oct 27 03:45:55.027040 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2958/5630] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 27 03:45:54 2022] GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:45:55.056918 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-88812d44-1f59-4e17-826d-2bbb7654284e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:55.058614 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-88812d44-1f59-4e17-826d-2bbb7654284e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002019 Oct 27 03:45:55.059233 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2673/5631] 10.222.0.20 () {56 vars in 886 bytes} [Thu Oct 27 03:45:55 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 27 03:45:55.950881 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-aa0fc6fb-72e0-4a58-99b5-69345039c489 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:55.951563 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-aa0fc6fb-72e0-4a58-99b5-69345039c489 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 18be006a-739d-4fe2-a04d-1db382b4aeeb] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:56.039878 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-dbc85cc0-0d89-44ba-a124-595e48b218e6 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:56.041734 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-aa0fc6fb-72e0-4a58-99b5-69345039c489 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:56.042909 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-dbc85cc0-0d89-44ba-a124-595e48b218e6 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: dbdbec9a-f4bf-4740-ab67-3c8891e341a1] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:56.054921 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dbc85cc0-0d89-44ba-a124-595e48b218e6 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:56.056378 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dbc85cc0-0d89-44ba-a124-595e48b218e6 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:56.056525 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-aa0fc6fb-72e0-4a58-99b5-69345039c489 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/18be006a-739d-4fe2-a04d-1db382b4aeeb" status: 200 len: 1220 microversion: 2.1 time: 0.109993 Oct 27 03:45:56.057131 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dbc85cc0-0d89-44ba-a124-595e48b218e6 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:56.061490 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dbc85cc0-0d89-44ba-a124-595e48b218e6 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:56.061490 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dbc85cc0-0d89-44ba-a124-595e48b218e6 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:56.061490 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dbc85cc0-0d89-44ba-a124-595e48b218e6 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:56.062188 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2959/5632] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:45:55 2022] GET /compute/v2.1/servers/18be006a-739d-4fe2-a04d-1db382b4aeeb => generated 1220 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:45:56.095987 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-dbc85cc0-0d89-44ba-a124-595e48b218e6 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060247 Oct 27 03:45:56.097292 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2674/5633] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 27 03:45:56 2022] GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 03:45:56.258365 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-50d45f09-0e4a-4b1f-9a78-97a7ba2d63c8 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:45:56.262315 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-50d45f09-0e4a-4b1f-9a78-97a7ba2d63c8 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: c9e02344-a91a-40c8-b8c0-c0abe503204c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:56.286385 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-50d45f09-0e4a-4b1f-9a78-97a7ba2d63c8 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:56.286385 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-50d45f09-0e4a-4b1f-9a78-97a7ba2d63c8 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:56.286385 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-50d45f09-0e4a-4b1f-9a78-97a7ba2d63c8 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:56.286385 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-50d45f09-0e4a-4b1f-9a78-97a7ba2d63c8 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:56.287050 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-50d45f09-0e4a-4b1f-9a78-97a7ba2d63c8 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:56.287544 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-50d45f09-0e4a-4b1f-9a78-97a7ba2d63c8 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:56.292913 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=100 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:45:56.319455 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-50d45f09-0e4a-4b1f-9a78-97a7ba2d63c8 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] HTTP exception thrown: Cannot 'reboot' instance c9e02344-a91a-40c8-b8c0-c0abe503204c while it is in vm_state rescued Oct 27 03:45:56.321364 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-50d45f09-0e4a-4b1f-9a78-97a7ba2d63c8 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Request method failure captured: Oct 27 03:45:56.321364 n-d-862769-1 devstack@n-api.service[121001]: request: POST /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c/action HTTP/1.1 Oct 27 03:45:56.321364 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:45:56.321364 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:45:56.321364 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:45:56.321364 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 28 Oct 27 03:45:56.321364 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:45:56.321364 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:45:56.321364 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:45:56.321364 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:45:56.321364 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWf3uUTnEN6JEj9qTF9cAY0BLnY-YCL30UQa3hBWeUb1dNx6UaDGQTlfRNfawcK1WUPI3AVcIhTKI_7viSsI0VCiS7DswtiywtZ-RbWwufMeio2Ivv3GBrhAaC4UKKUNrtl6wYtdRVU_yfZaWJd2e4jOiCo3IliQOw95nmGOg5mVlF04 Oct 27 03:45:56.321364 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:45:56.321364 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:45:56.321364 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:45:56.321364 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:45:56.321364 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:45:56.321364 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:45:56.321364 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: e1f3ed7ef6c648c9ac771fbaadde1d0c Oct 27 03:45:56.321364 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-143118573 Oct 27 03:45:56.321364 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:45:56.321364 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:45:56.321364 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e1f3ed7ef6c648c9ac771fbaadde1d0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e1f3ed7ef6c648c9ac771fbaadde1d0c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e1f3ed7ef6c648c9ac771fbaadde1d0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e1f3ed7ef6c648c9ac771fbaadde1d0c"}]}] Oct 27 03:45:56.321364 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServerRescueNegativeTestJSON-143118573 Oct 27 03:45:56.321364 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: e1f3ed7ef6c648c9ac771fbaadde1d0c Oct 27 03:45:56.321364 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-143118573 Oct 27 03:45:56.321364 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServerRescueNegativeTestJSON-143118573-project Oct 27 03:45:56.321364 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:45:56.321364 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:45:56.321364 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 43172c9e71704c869a25181574d67b35 Oct 27 03:45:56.321364 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServerRescueNegativeTestJSON-143118573-project Oct 27 03:45:56.321364 n-d-862769-1 devstack@n-api.service[121001]: Oct 27 03:45:56.321364 n-d-862769-1 devstack@n-api.service[121001]: {"reboot": {"type": "HARD"}} Oct 27 03:45:56.321364 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:45:56.321364 n-d-862769-1 devstack@n-api.service[121001]: exception: Cannot 'reboot' instance c9e02344-a91a-40c8-b8c0-c0abe503204c while it is in vm_state rescued Oct 27 03:45:56.321364 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': 'c9e02344-a91a-40c8-b8c0-c0abe503204c', 'body': {'reboot': {'type': 'HARD'}}} Oct 27 03:45:56.321364 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:45:56.321364 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:45:56.321364 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Oct 27 03:45:56.321364 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Oct 27 03:45:56.321364 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 03:45:56.321364 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 03:45:56.321364 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Oct 27 03:45:56.321364 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Oct 27 03:45:56.321364 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 27 03:45:56.321364 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 27 03:45:56.321364 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c9e02344-a91a-40c8-b8c0-c0abe503204c in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Oct 27 03:45:56.321364 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:45:56.321364 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:45:56.321364 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:45:56.321364 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:45:56.321364 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:45:56.321364 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:45:56.321364 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:45:56.321364 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:45:56.321364 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:45:56.321364 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:45:56.321364 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:45:56.321364 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:45:56.321364 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Oct 27 03:45:56.321364 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 27 03:45:56.321364 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 27 03:45:56.321364 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 27 03:45:56.326683 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance c9e02344-a91a-40c8-b8c0-c0abe503204c while it is in vm_state rescued Oct 27 03:45:56.326683 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:45:56.326683 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:45:56.326683 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:45:56.326683 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:45:56.326683 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:45:56.326683 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:45:56.326683 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:45:56.326683 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:45:56.326683 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance c9e02344-a91a-40c8-b8c0-c0abe503204c while it is in vm_state rescued Oct 27 03:45:56.326683 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:45:56.326683 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-50d45f09-0e4a-4b1f-9a78-97a7ba2d63c8 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Returning 409 to user: Cannot 'reboot' instance c9e02344-a91a-40c8-b8c0-c0abe503204c while it is in vm_state rescued {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:45:56.333906 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-50d45f09-0e4a-4b1f-9a78-97a7ba2d63c8 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "POST /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c/action" status: 409 len: 145 microversion: 2.1 time: 0.080734 Oct 27 03:45:56.333906 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2960/5634] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:45:56 2022] POST /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c/action => generated 145 bytes in 83 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 27 03:45:56.340207 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-937bc768-819b-4481-846d-27f88c5b8b20 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:45:56.343164 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-937bc768-819b-4481-846d-27f88c5b8b20 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: c9e02344-a91a-40c8-b8c0-c0abe503204c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:56.351241 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-937bc768-819b-4481-846d-27f88c5b8b20 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:56.352891 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-937bc768-819b-4481-846d-27f88c5b8b20 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:56.353551 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-937bc768-819b-4481-846d-27f88c5b8b20 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:56.354942 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-937bc768-819b-4481-846d-27f88c5b8b20 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:56.356276 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-937bc768-819b-4481-846d-27f88c5b8b20 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:56.356915 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-937bc768-819b-4481-846d-27f88c5b8b20 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:56.393490 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-937bc768-819b-4481-846d-27f88c5b8b20 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] HTTP exception thrown: Cannot 'rebuild' instance c9e02344-a91a-40c8-b8c0-c0abe503204c while it is in vm_state rescued Oct 27 03:45:56.393607 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-937bc768-819b-4481-846d-27f88c5b8b20 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Request method failure captured: Oct 27 03:45:56.393607 n-d-862769-1 devstack@n-api.service[121000]: request: POST /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c/action HTTP/1.1 Oct 27 03:45:56.393607 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:45:56.393607 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:45:56.393607 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:45:56.393607 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 65 Oct 27 03:45:56.393607 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:45:56.393607 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:45:56.393607 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:45:56.393607 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:45:56.393607 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWf3uUTnEN6JEj9qTF9cAY0BLnY-YCL30UQa3hBWeUb1dNx6UaDGQTlfRNfawcK1WUPI3AVcIhTKI_7viSsI0VCiS7DswtiywtZ-RbWwufMeio2Ivv3GBrhAaC4UKKUNrtl6wYtdRVU_yfZaWJd2e4jOiCo3IliQOw95nmGOg5mVlF04 Oct 27 03:45:56.393607 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:45:56.393607 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:45:56.393607 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:45:56.393607 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:45:56.393607 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:45:56.393607 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:45:56.393607 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: e1f3ed7ef6c648c9ac771fbaadde1d0c Oct 27 03:45:56.393607 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-143118573 Oct 27 03:45:56.393607 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:45:56.393607 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:45:56.393607 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e1f3ed7ef6c648c9ac771fbaadde1d0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e1f3ed7ef6c648c9ac771fbaadde1d0c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e1f3ed7ef6c648c9ac771fbaadde1d0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e1f3ed7ef6c648c9ac771fbaadde1d0c"}]}] Oct 27 03:45:56.393607 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ServerRescueNegativeTestJSON-143118573 Oct 27 03:45:56.393607 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: e1f3ed7ef6c648c9ac771fbaadde1d0c Oct 27 03:45:56.393607 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-143118573 Oct 27 03:45:56.393607 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ServerRescueNegativeTestJSON-143118573-project Oct 27 03:45:56.393607 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:45:56.393607 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:45:56.393607 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 43172c9e71704c869a25181574d67b35 Oct 27 03:45:56.393607 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ServerRescueNegativeTestJSON-143118573-project Oct 27 03:45:56.393607 n-d-862769-1 devstack@n-api.service[121000]: Oct 27 03:45:56.393607 n-d-862769-1 devstack@n-api.service[121000]: {"rebuild": {"imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917"}} Oct 27 03:45:56.393607 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:45:56.393607 n-d-862769-1 devstack@n-api.service[121000]: exception: Cannot 'rebuild' instance c9e02344-a91a-40c8-b8c0-c0abe503204c while it is in vm_state rescued Oct 27 03:45:56.393607 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': 'c9e02344-a91a-40c8-b8c0-c0abe503204c', 'body': {'rebuild': {'imageRef': 'c40fb871-5877-4b59-ab69-d9fd23b7a917'}}} Oct 27 03:45:56.393607 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:45:56.393607 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:45:56.393607 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Oct 27 03:45:56.393607 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Oct 27 03:45:56.393607 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 27 03:45:56.393607 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 27 03:45:56.393607 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 27 03:45:56.393607 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 27 03:45:56.393607 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 03:45:56.393607 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 03:45:56.393607 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 27 03:45:56.393607 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 27 03:45:56.393607 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c9e02344-a91a-40c8-b8c0-c0abe503204c in vm_state rescued. Cannot rebuild while the instance is in this state. Oct 27 03:45:56.393607 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:45:56.393607 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:45:56.393607 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:45:56.393607 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:45:56.393607 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:45:56.393607 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:45:56.393607 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:45:56.393607 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:45:56.393607 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:45:56.393607 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:45:56.393607 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:45:56.393607 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:45:56.393607 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:45:56.393607 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:45:56.393607 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:45:56.399073 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:45:56.399073 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 27 03:45:56.399073 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Oct 27 03:45:56.399073 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 27 03:45:56.399073 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 27 03:45:56.399073 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 27 03:45:56.399073 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance c9e02344-a91a-40c8-b8c0-c0abe503204c while it is in vm_state rescued Oct 27 03:45:56.399073 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:45:56.399073 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:45:56.399073 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:45:56.399073 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:45:56.399073 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:45:56.399073 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:45:56.399073 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:45:56.399073 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:45:56.399073 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance c9e02344-a91a-40c8-b8c0-c0abe503204c while it is in vm_state rescued Oct 27 03:45:56.399073 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:45:56.399073 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-937bc768-819b-4481-846d-27f88c5b8b20 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Returning 409 to user: Cannot 'rebuild' instance c9e02344-a91a-40c8-b8c0-c0abe503204c while it is in vm_state rescued {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:45:56.399073 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-937bc768-819b-4481-846d-27f88c5b8b20 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "POST /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c/action" status: 409 len: 146 microversion: 2.1 time: 0.059515 Oct 27 03:45:56.400924 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2675/5635] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:45:56 2022] POST /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c/action => generated 146 bytes in 66 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 27 03:45:56.405924 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-90d72cb6-6471-41ce-9e18-c5e185a9b2fa tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:56.406467 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-90d72cb6-6471-41ce-9e18-c5e185a9b2fa tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: dbdbec9a-f4bf-4740-ab67-3c8891e341a1] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:56.413811 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-90d72cb6-6471-41ce-9e18-c5e185a9b2fa tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:56.416690 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-90d72cb6-6471-41ce-9e18-c5e185a9b2fa tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:56.416690 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-90d72cb6-6471-41ce-9e18-c5e185a9b2fa tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:56.416690 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-90d72cb6-6471-41ce-9e18-c5e185a9b2fa tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:56.416690 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-90d72cb6-6471-41ce-9e18-c5e185a9b2fa tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:56.416690 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-90d72cb6-6471-41ce-9e18-c5e185a9b2fa tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:56.445177 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-90d72cb6-6471-41ce-9e18-c5e185a9b2fa tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: dbdbec9a-f4bf-4740-ab67-3c8891e341a1] Going to try to terminate instance {{(pid=121001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:45:56.804263 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-90d72cb6-6471-41ce-9e18-c5e185a9b2fa tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "DELETE /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1" status: 204 len: 0 microversion: 2.1 time: 0.401131 Oct 27 03:45:56.805333 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2961/5636] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:45:56 2022] DELETE /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:45:56.813594 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2e92feb6-9f7e-43cf-b6ac-054cd6308fe9 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:56.814762 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-2e92feb6-9f7e-43cf-b6ac-054cd6308fe9 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: dbdbec9a-f4bf-4740-ab67-3c8891e341a1] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:56.833145 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2e92feb6-9f7e-43cf-b6ac-054cd6308fe9 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:56.833664 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2e92feb6-9f7e-43cf-b6ac-054cd6308fe9 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:56.834152 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2e92feb6-9f7e-43cf-b6ac-054cd6308fe9 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:56.835078 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2e92feb6-9f7e-43cf-b6ac-054cd6308fe9 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:56.835900 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2e92feb6-9f7e-43cf-b6ac-054cd6308fe9 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:56.836804 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2e92feb6-9f7e-43cf-b6ac-054cd6308fe9 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:57.083291 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-bbd08824-8c46-47e4-bb98-534310addc57 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:57.084800 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-bbd08824-8c46-47e4-bb98-534310addc57 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 18be006a-739d-4fe2-a04d-1db382b4aeeb] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:57.101585 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bbd08824-8c46-47e4-bb98-534310addc57 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:57.102396 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bbd08824-8c46-47e4-bb98-534310addc57 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:57.104649 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bbd08824-8c46-47e4-bb98-534310addc57 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:57.105579 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bbd08824-8c46-47e4-bb98-534310addc57 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:57.109107 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bbd08824-8c46-47e4-bb98-534310addc57 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:57.111220 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bbd08824-8c46-47e4-bb98-534310addc57 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:57.210892 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2e92feb6-9f7e-43cf-b6ac-054cd6308fe9 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:57.220869 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-bbd08824-8c46-47e4-bb98-534310addc57 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:57.229212 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2e92feb6-9f7e-43cf-b6ac-054cd6308fe9 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1" status: 200 len: 1688 microversion: 2.1 time: 0.419930 Oct 27 03:45:57.242800 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2676/5637] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:45:56 2022] GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1 => generated 1688 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:45:57.243009 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-bbd08824-8c46-47e4-bb98-534310addc57 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/18be006a-739d-4fe2-a04d-1db382b4aeeb" status: 200 len: 1272 microversion: 2.1 time: 0.159433 Oct 27 03:45:57.243009 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2962/5638] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:45:57 2022] GET /compute/v2.1/servers/18be006a-739d-4fe2-a04d-1db382b4aeeb => generated 1272 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:45:58.259095 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f25e850f-a90b-4363-8630-6358d235584e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:58.259716 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f25e850f-a90b-4363-8630-6358d235584e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 18be006a-739d-4fe2-a04d-1db382b4aeeb] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:58.263365 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ef6a958e-8df5-40b8-8867-7c692859f6de tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:58.264308 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ef6a958e-8df5-40b8-8867-7c692859f6de tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: dbdbec9a-f4bf-4740-ab67-3c8891e341a1] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:58.267449 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f25e850f-a90b-4363-8630-6358d235584e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:58.267948 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f25e850f-a90b-4363-8630-6358d235584e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:58.268392 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f25e850f-a90b-4363-8630-6358d235584e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:58.272634 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f25e850f-a90b-4363-8630-6358d235584e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:58.272634 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f25e850f-a90b-4363-8630-6358d235584e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:58.272634 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f25e850f-a90b-4363-8630-6358d235584e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:58.278997 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ef6a958e-8df5-40b8-8867-7c692859f6de tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:58.279731 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ef6a958e-8df5-40b8-8867-7c692859f6de tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:58.280364 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ef6a958e-8df5-40b8-8867-7c692859f6de tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:58.281523 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ef6a958e-8df5-40b8-8867-7c692859f6de tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:58.282344 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ef6a958e-8df5-40b8-8867-7c692859f6de tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:58.283482 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ef6a958e-8df5-40b8-8867-7c692859f6de tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:58.296982 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:45:58.509235 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ef6a958e-8df5-40b8-8867-7c692859f6de tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:58.519083 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ef6a958e-8df5-40b8-8867-7c692859f6de tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1" status: 200 len: 1688 microversion: 2.1 time: 0.261764 Oct 27 03:45:58.521349 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f25e850f-a90b-4363-8630-6358d235584e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:58.531919 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2963/5639] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:45:58 2022] GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1 => generated 1688 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:45:58.535417 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f25e850f-a90b-4363-8630-6358d235584e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/18be006a-739d-4fe2-a04d-1db382b4aeeb" status: 200 len: 1290 microversion: 2.1 time: 0.278995 Oct 27 03:45:58.537044 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2677/5640] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:45:58 2022] GET /compute/v2.1/servers/18be006a-739d-4fe2-a04d-1db382b4aeeb => generated 1290 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:45:59.544980 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9520bc57-4667-42f3-baec-6fbb4aacdcf6 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:59.546780 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-9520bc57-4667-42f3-baec-6fbb4aacdcf6 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: dbdbec9a-f4bf-4740-ab67-3c8891e341a1] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:59.565602 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7b0841f0-81ae-4ea1-b3bc-b4ba2e20a0f5 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:45:59.566407 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7b0841f0-81ae-4ea1-b3bc-b4ba2e20a0f5 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 18be006a-739d-4fe2-a04d-1db382b4aeeb] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:45:59.581723 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9520bc57-4667-42f3-baec-6fbb4aacdcf6 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:59.582513 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9520bc57-4667-42f3-baec-6fbb4aacdcf6 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:59.583154 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9520bc57-4667-42f3-baec-6fbb4aacdcf6 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:59.584046 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9520bc57-4667-42f3-baec-6fbb4aacdcf6 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:59.584666 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9520bc57-4667-42f3-baec-6fbb4aacdcf6 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:59.585778 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9520bc57-4667-42f3-baec-6fbb4aacdcf6 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:59.596703 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7b0841f0-81ae-4ea1-b3bc-b4ba2e20a0f5 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:59.598006 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7b0841f0-81ae-4ea1-b3bc-b4ba2e20a0f5 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:59.598817 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7b0841f0-81ae-4ea1-b3bc-b4ba2e20a0f5 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:59.599975 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7b0841f0-81ae-4ea1-b3bc-b4ba2e20a0f5 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:45:59.602999 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7b0841f0-81ae-4ea1-b3bc-b4ba2e20a0f5 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:45:59.603711 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7b0841f0-81ae-4ea1-b3bc-b4ba2e20a0f5 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:45:59.889625 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9520bc57-4667-42f3-baec-6fbb4aacdcf6 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:45:59.912166 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9520bc57-4667-42f3-baec-6fbb4aacdcf6 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1" status: 200 len: 1688 microversion: 2.1 time: 0.371972 Oct 27 03:45:59.926093 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2964/5641] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:45:59 2022] GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1 => generated 1688 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:46:00.100927 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7b0841f0-81ae-4ea1-b3bc-b4ba2e20a0f5 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:00.109467 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7b0841f0-81ae-4ea1-b3bc-b4ba2e20a0f5 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/18be006a-739d-4fe2-a04d-1db382b4aeeb" status: 200 len: 1320 microversion: 2.1 time: 0.551248 Oct 27 03:46:00.110078 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2678/5642] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:45:59 2022] GET /compute/v2.1/servers/18be006a-739d-4fe2-a04d-1db382b4aeeb => generated 1320 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:46:00.872115 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9520bc57-4667-42f3-baec-6fbb4aacdcf6 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:00.873104 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9520bc57-4667-42f3-baec-6fbb4aacdcf6 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001324 Oct 27 03:46:00.882609 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7b0841f0-81ae-4ea1-b3bc-b4ba2e20a0f5 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:00.884528 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7b0841f0-81ae-4ea1-b3bc-b4ba2e20a0f5 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.002446 Oct 27 03:46:00.885142 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2965/5643] 10.222.0.20 () {56 vars in 886 bytes} [Thu Oct 27 03:46:00 2022] GET /compute/ => generated 377 bytes in 13 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 27 03:46:00.896224 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2679/5644] 10.222.0.20 () {54 vars in 1035 bytes} [Thu Oct 27 03:46:00 2022] GET /compute/v2/ => generated 379 bytes in 14 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Oct 27 03:46:00.897988 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9520bc57-4667-42f3-baec-6fbb4aacdcf6 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:00.899315 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9520bc57-4667-42f3-baec-6fbb4aacdcf6 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.003465 Oct 27 03:46:00.911149 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7b0841f0-81ae-4ea1-b3bc-b4ba2e20a0f5 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:00.912987 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7b0841f0-81ae-4ea1-b3bc-b4ba2e20a0f5 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002217 Oct 27 03:46:00.914335 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2966/5645] 10.222.0.20 () {54 vars in 1041 bytes} [Thu Oct 27 03:46:00 2022] GET /compute/v2.1/ => generated 388 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:46:00.914962 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2680/5646] 10.222.0.20 () {56 vars in 886 bytes} [Thu Oct 27 03:46:00 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 27 03:46:00.944912 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-212b0f4b-7060-41ea-b40a-fbbaee7dacf4 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:00.946933 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-212b0f4b-7060-41ea-b40a-fbbaee7dacf4 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: dbdbec9a-f4bf-4740-ab67-3c8891e341a1] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:00.974376 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-212b0f4b-7060-41ea-b40a-fbbaee7dacf4 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:00.975295 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-212b0f4b-7060-41ea-b40a-fbbaee7dacf4 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:00.979976 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-212b0f4b-7060-41ea-b40a-fbbaee7dacf4 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:00.981071 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-212b0f4b-7060-41ea-b40a-fbbaee7dacf4 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:00.983048 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-212b0f4b-7060-41ea-b40a-fbbaee7dacf4 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:00.983515 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-212b0f4b-7060-41ea-b40a-fbbaee7dacf4 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:01.144198 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2ae395d7-7abc-4b9a-84f1-365d42dc010d tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:01.145333 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-2ae395d7-7abc-4b9a-84f1-365d42dc010d tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 18be006a-739d-4fe2-a04d-1db382b4aeeb] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:01.159618 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2ae395d7-7abc-4b9a-84f1-365d42dc010d tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:01.162428 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2ae395d7-7abc-4b9a-84f1-365d42dc010d tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:01.163015 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2ae395d7-7abc-4b9a-84f1-365d42dc010d tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:01.164206 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2ae395d7-7abc-4b9a-84f1-365d42dc010d tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:01.167364 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2ae395d7-7abc-4b9a-84f1-365d42dc010d tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:01.167949 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2ae395d7-7abc-4b9a-84f1-365d42dc010d tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:01.516378 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2ae395d7-7abc-4b9a-84f1-365d42dc010d tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:01.529286 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2ae395d7-7abc-4b9a-84f1-365d42dc010d tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/18be006a-739d-4fe2-a04d-1db382b4aeeb" status: 200 len: 1320 microversion: 2.1 time: 0.390282 Oct 27 03:46:01.535556 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2681/5647] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:46:01 2022] GET /compute/v2.1/servers/18be006a-739d-4fe2-a04d-1db382b4aeeb => generated 1320 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:46:02.141832 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-212b0f4b-7060-41ea-b40a-fbbaee7dacf4 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:02.151359 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-212b0f4b-7060-41ea-b40a-fbbaee7dacf4 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1" status: 200 len: 1688 microversion: 2.1 time: 1.218265 Oct 27 03:46:02.158377 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2967/5648] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:46:00 2022] GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1 => generated 1688 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:46:02.555758 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-875af346-9b3c-4716-abf5-5e18758363e3 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:02.556400 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-875af346-9b3c-4716-abf5-5e18758363e3 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 18be006a-739d-4fe2-a04d-1db382b4aeeb] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:02.567735 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:02.573362 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-875af346-9b3c-4716-abf5-5e18758363e3 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:02.574177 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-875af346-9b3c-4716-abf5-5e18758363e3 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:02.574769 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-875af346-9b3c-4716-abf5-5e18758363e3 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:02.575668 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-875af346-9b3c-4716-abf5-5e18758363e3 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:02.576151 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-875af346-9b3c-4716-abf5-5e18758363e3 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:02.576606 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-875af346-9b3c-4716-abf5-5e18758363e3 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:02.790641 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-323588d8-89d0-403c-961e-d5791278d975 req-6d80e58d-ea67-4971-a227-6e31f08c48f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18be006a-739d-4fe2-a04d-1db382b4aeeb", "tag": "1232f5e9-8a21-488d-b0b7-38aaec3f0008"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:46:02.826624 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-323588d8-89d0-403c-961e-d5791278d975 req-6d80e58d-ea67-4971-a227-6e31f08c48f3 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:02.829934 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-323588d8-89d0-403c-961e-d5791278d975 req-6d80e58d-ea67-4971-a227-6e31f08c48f3 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:02.835416 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-323588d8-89d0-403c-961e-d5791278d975 req-6d80e58d-ea67-4971-a227-6e31f08c48f3 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:02.855825 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-323588d8-89d0-403c-961e-d5791278d975 req-6d80e58d-ea67-4971-a227-6e31f08c48f3 service nova] Creating event network-changed:1232f5e9-8a21-488d-b0b7-38aaec3f0008 for instance 18be006a-739d-4fe2-a04d-1db382b4aeeb on n-h1-862769-1 Oct 27 03:46:02.863787 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-323588d8-89d0-403c-961e-d5791278d975 req-6d80e58d-ea67-4971-a227-6e31f08c48f3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081393 Oct 27 03:46:02.865192 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2968/5649] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:46:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:46:03.128590 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-875af346-9b3c-4716-abf5-5e18758363e3 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:03.141136 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-875af346-9b3c-4716-abf5-5e18758363e3 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/18be006a-739d-4fe2-a04d-1db382b4aeeb" status: 200 len: 1320 microversion: 2.1 time: 0.591004 Oct 27 03:46:03.141774 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2682/5650] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:46:02 2022] GET /compute/v2.1/servers/18be006a-739d-4fe2-a04d-1db382b4aeeb => generated 1320 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:46:03.188696 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0f7ee66b-6155-46eb-99f9-126e64c810ea tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:03.190198 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0f7ee66b-6155-46eb-99f9-126e64c810ea tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: dbdbec9a-f4bf-4740-ab67-3c8891e341a1] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:03.197061 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0f7ee66b-6155-46eb-99f9-126e64c810ea tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:03.197891 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0f7ee66b-6155-46eb-99f9-126e64c810ea tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:03.198758 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0f7ee66b-6155-46eb-99f9-126e64c810ea tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:03.204223 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0f7ee66b-6155-46eb-99f9-126e64c810ea tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:03.204223 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0f7ee66b-6155-46eb-99f9-126e64c810ea tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:03.204223 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0f7ee66b-6155-46eb-99f9-126e64c810ea tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:03.278065 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0f7ee66b-6155-46eb-99f9-126e64c810ea tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:03.303879 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0f7ee66b-6155-46eb-99f9-126e64c810ea tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1" status: 200 len: 1620 microversion: 2.1 time: 0.120029 Oct 27 03:46:03.307626 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2969/5651] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:46:03 2022] GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1 => generated 1620 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:46:03.986518 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6c22ac9f-7aeb-4b8a-8263-df8bb0f618ac tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-732591580", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": [{"uuid": "061dc6f0-042f-475c-95c2-153f2660e9ac"}]}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:46:04.120264 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-6c22ac9f-7aeb-4b8a-8263-df8bb0f618ac tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] validate_networks() for [('061dc6f0-042f-475c-95c2-153f2660e9ac', None, None, None, None, None)] {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:46:04.166504 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6bcfd0db-3688-49b5-aa7b-2e0d292c4620 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:04.167481 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-6bcfd0db-3688-49b5-aa7b-2e0d292c4620 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 18be006a-739d-4fe2-a04d-1db382b4aeeb] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:04.183850 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6bcfd0db-3688-49b5-aa7b-2e0d292c4620 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:04.186906 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6bcfd0db-3688-49b5-aa7b-2e0d292c4620 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:04.186906 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6bcfd0db-3688-49b5-aa7b-2e0d292c4620 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:04.186906 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6bcfd0db-3688-49b5-aa7b-2e0d292c4620 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:04.190607 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6bcfd0db-3688-49b5-aa7b-2e0d292c4620 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:04.192509 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6bcfd0db-3688-49b5-aa7b-2e0d292c4620 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:04.496271 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6bcfd0db-3688-49b5-aa7b-2e0d292c4620 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:04.511279 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6bcfd0db-3688-49b5-aa7b-2e0d292c4620 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/18be006a-739d-4fe2-a04d-1db382b4aeeb" status: 200 len: 1320 microversion: 2.1 time: 0.349359 Oct 27 03:46:04.515199 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2970/5652] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:46:04 2022] GET /compute/v2.1/servers/18be006a-739d-4fe2-a04d-1db382b4aeeb => generated 1320 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:46:04.527750 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-981ff9c6-c7cd-45c3-9153-b55950de6467 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:04.528712 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-981ff9c6-c7cd-45c3-9153-b55950de6467 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: dbdbec9a-f4bf-4740-ab67-3c8891e341a1] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:04.555661 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:04.580530 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-981ff9c6-c7cd-45c3-9153-b55950de6467 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:04.581324 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-981ff9c6-c7cd-45c3-9153-b55950de6467 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:04.582341 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-981ff9c6-c7cd-45c3-9153-b55950de6467 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:04.585928 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-981ff9c6-c7cd-45c3-9153-b55950de6467 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:04.587210 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-981ff9c6-c7cd-45c3-9153-b55950de6467 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:04.588641 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-981ff9c6-c7cd-45c3-9153-b55950de6467 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:04.646019 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-981ff9c6-c7cd-45c3-9153-b55950de6467 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:04.646539 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-981ff9c6-c7cd-45c3-9153-b55950de6467 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:04.646989 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-981ff9c6-c7cd-45c3-9153-b55950de6467 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:04.647910 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-981ff9c6-c7cd-45c3-9153-b55950de6467 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lazy-loading 'fault' on Instance uuid dbdbec9a-f4bf-4740-ab67-3c8891e341a1 {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:46:04.723396 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-981ff9c6-c7cd-45c3-9153-b55950de6467 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:04.749539 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-981ff9c6-c7cd-45c3-9153-b55950de6467 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1" status: 200 len: 1334 microversion: 2.1 time: 0.233576 Oct 27 03:46:04.751858 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2971/5653] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:46:04 2022] GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1 => generated 1334 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:46:04.899607 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-e77f525f-2ad6-4cc5-b57c-4179e857b06a req-c85ef078-f5cd-46bd-8034-c4fa58ae8d3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbdbec9a-f4bf-4740-ab67-3c8891e341a1", "name": "network-vif-deleted", "tag": "833035a3-c97d-4212-b516-f56e8d9754b6"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:46:04.917253 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=8 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:04.928375 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-e77f525f-2ad6-4cc5-b57c-4179e857b06a req-c85ef078-f5cd-46bd-8034-c4fa58ae8d3e service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:04.928891 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-e77f525f-2ad6-4cc5-b57c-4179e857b06a req-c85ef078-f5cd-46bd-8034-c4fa58ae8d3e service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:04.933158 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-e77f525f-2ad6-4cc5-b57c-4179e857b06a req-c85ef078-f5cd-46bd-8034-c4fa58ae8d3e service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:04.961996 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-e77f525f-2ad6-4cc5-b57c-4179e857b06a req-c85ef078-f5cd-46bd-8034-c4fa58ae8d3e service nova] Creating event network-vif-deleted:833035a3-c97d-4212-b516-f56e8d9754b6 for instance dbdbec9a-f4bf-4740-ab67-3c8891e341a1 on n-h2-862769-1 Oct 27 03:46:04.975649 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-e77f525f-2ad6-4cc5-b57c-4179e857b06a req-c85ef078-f5cd-46bd-8034-c4fa58ae8d3e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089628 Oct 27 03:46:04.981884 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2972/5654] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:46:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:46:05.543690 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3389058c-5dd9-49f3-b925-9e41d99efe69 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:05.545377 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3389058c-5dd9-49f3-b925-9e41d99efe69 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 18be006a-739d-4fe2-a04d-1db382b4aeeb] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:05.561385 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3389058c-5dd9-49f3-b925-9e41d99efe69 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:05.561948 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3389058c-5dd9-49f3-b925-9e41d99efe69 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:05.562539 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3389058c-5dd9-49f3-b925-9e41d99efe69 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:05.564071 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3389058c-5dd9-49f3-b925-9e41d99efe69 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:05.564584 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3389058c-5dd9-49f3-b925-9e41d99efe69 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:05.565038 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3389058c-5dd9-49f3-b925-9e41d99efe69 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:05.797216 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3389058c-5dd9-49f3-b925-9e41d99efe69 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:05.814274 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3389058c-5dd9-49f3-b925-9e41d99efe69 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/18be006a-739d-4fe2-a04d-1db382b4aeeb" status: 200 len: 1320 microversion: 2.1 time: 0.268520 Oct 27 03:46:05.814274 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2973/5655] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:46:05 2022] GET /compute/v2.1/servers/18be006a-739d-4fe2-a04d-1db382b4aeeb => generated 1320 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:46:05.816722 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-26f36cf9-812f-4e32-b545-f37e3bfe6a5b tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:05.822307 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-26f36cf9-812f-4e32-b545-f37e3bfe6a5b tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: dbdbec9a-f4bf-4740-ab67-3c8891e341a1] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:05.843629 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-26f36cf9-812f-4e32-b545-f37e3bfe6a5b tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:05.850425 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-26f36cf9-812f-4e32-b545-f37e3bfe6a5b tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:05.851108 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-26f36cf9-812f-4e32-b545-f37e3bfe6a5b tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:05.853137 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-26f36cf9-812f-4e32-b545-f37e3bfe6a5b tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:05.858907 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-26f36cf9-812f-4e32-b545-f37e3bfe6a5b tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:05.859830 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-26f36cf9-812f-4e32-b545-f37e3bfe6a5b tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:05.914713 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-26f36cf9-812f-4e32-b545-f37e3bfe6a5b tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] HTTP exception thrown: Instance dbdbec9a-f4bf-4740-ab67-3c8891e341a1 could not be found. Oct 27 03:46:05.916547 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-26f36cf9-812f-4e32-b545-f37e3bfe6a5b tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Request method failure captured: Oct 27 03:46:05.916547 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1 HTTP/1.1 Oct 27 03:46:05.916547 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:46:05.916547 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:46:05.916547 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:46:05.916547 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:46:05.916547 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:46:05.916547 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:46:05.916547 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:46:05.916547 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:46:05.916547 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWf3uUTnEN6JEj9qTF9cAY0BLnY-YCL30UQa3hBWeUb1dNx6UaDGQTlfRNfawcK1WUPI3AVcIhTKI_7viSsI0VCiS7DswtiywtZ-RbWwufMeio2Ivv3GBrhAaC4UKKUNrtl6wYtdRVU_yfZaWJd2e4jOiCo3IliQOw95nmGOg5mVlF04 Oct 27 03:46:05.916547 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:46:05.916547 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:46:05.916547 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:46:05.916547 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:46:05.916547 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:46:05.916547 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:46:05.916547 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: e1f3ed7ef6c648c9ac771fbaadde1d0c Oct 27 03:46:05.916547 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-143118573 Oct 27 03:46:05.916547 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:46:05.916547 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:46:05.916547 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e1f3ed7ef6c648c9ac771fbaadde1d0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e1f3ed7ef6c648c9ac771fbaadde1d0c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e1f3ed7ef6c648c9ac771fbaadde1d0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e1f3ed7ef6c648c9ac771fbaadde1d0c"}]}] Oct 27 03:46:05.916547 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServerRescueNegativeTestJSON-143118573 Oct 27 03:46:05.916547 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: e1f3ed7ef6c648c9ac771fbaadde1d0c Oct 27 03:46:05.916547 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-143118573 Oct 27 03:46:05.916547 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServerRescueNegativeTestJSON-143118573-project Oct 27 03:46:05.916547 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:46:05.916547 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:46:05.916547 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 43172c9e71704c869a25181574d67b35 Oct 27 03:46:05.916547 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServerRescueNegativeTestJSON-143118573-project Oct 27 03:46:05.916547 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:46:05.916547 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance dbdbec9a-f4bf-4740-ab67-3c8891e341a1 could not be found. Oct 27 03:46:05.916547 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': 'dbdbec9a-f4bf-4740-ab67-3c8891e341a1'} Oct 27 03:46:05.916547 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:46:05.916547 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:46:05.916547 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:46:05.916547 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:46:05.916547 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:46:05.916547 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:46:05.916547 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:46:05.916547 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:46:05.916547 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:46:05.916547 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:46:05.916547 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbdbec9a-f4bf-4740-ab67-3c8891e341a1 could not be found. Oct 27 03:46:05.916547 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:46:05.916547 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:46:05.916547 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:46:05.916547 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:46:05.916547 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:46:05.916547 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:46:05.916547 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:46:05.916547 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:46:05.916547 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:46:05.916547 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:46:05.916547 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:46:05.916547 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:46:05.916547 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:46:05.916547 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:46:05.916547 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:46:05.916547 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:46:05.916547 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbdbec9a-f4bf-4740-ab67-3c8891e341a1 could not be found. Oct 27 03:46:05.916547 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:46:05.916547 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:46:05.922068 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:46:05.922068 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:46:05.922068 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:46:05.922068 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:46:05.922068 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:46:05.922068 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:46:05.922068 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbdbec9a-f4bf-4740-ab67-3c8891e341a1 could not be found. Oct 27 03:46:05.922068 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:46:05.922068 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-26f36cf9-812f-4e32-b545-f37e3bfe6a5b tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Returning 404 to user: Instance dbdbec9a-f4bf-4740-ab67-3c8891e341a1 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:46:05.922068 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-26f36cf9-812f-4e32-b545-f37e3bfe6a5b tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1" status: 404 len: 111 microversion: 2.1 time: 0.108119 Oct 27 03:46:05.937795 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2974/5656] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:46:05 2022] GET /compute/v2.1/servers/dbdbec9a-f4bf-4740-ab67-3c8891e341a1 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:46:05.947438 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-cabdcd2f-2dfd-41f0-82c4-e8e55023bfc9 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '.version_select at 0x7f7ddede71f0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:06.046014 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=10 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:06.090206 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-6c22ac9f-7aeb-4b8a-8263-df8bb0f618ac tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:46:06.090799 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-6c22ac9f-7aeb-4b8a-8263-df8bb0f618ac tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:46:06.091175 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-6c22ac9f-7aeb-4b8a-8263-df8bb0f618ac tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:46:06.091873 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-6c22ac9f-7aeb-4b8a-8263-df8bb0f618ac tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:46:06.092514 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-6c22ac9f-7aeb-4b8a-8263-df8bb0f618ac tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:46:06.093599 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-cabdcd2f-2dfd-41f0-82c4-e8e55023bfc9 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-859936746" status: 202 len: 0 microversion: 2.1 time: 0.154538 Oct 27 03:46:06.102334 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2975/5657] 10.222.0.20 () {58 vars in 1218 bytes} [Thu Oct 27 03:46:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-859936746 => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:46:06.104368 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6c22ac9f-7aeb-4b8a-8263-df8bb0f618ac tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:06.104890 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6c22ac9f-7aeb-4b8a-8263-df8bb0f618ac tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:06.105514 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6c22ac9f-7aeb-4b8a-8263-df8bb0f618ac tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:06.106312 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6c22ac9f-7aeb-4b8a-8263-df8bb0f618ac tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:06.106979 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6c22ac9f-7aeb-4b8a-8263-df8bb0f618ac tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:06.107404 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6c22ac9f-7aeb-4b8a-8263-df8bb0f618ac tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:06.159006 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-6c22ac9f-7aeb-4b8a-8263-df8bb0f618ac tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Getting quotas for project 63fc6a536b2f46b19fa2e6ab35917332. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:46:06.175200 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-6c22ac9f-7aeb-4b8a-8263-df8bb0f618ac tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Getting quotas for user b983494c36da483d9f626522f74d9963 and project 63fc6a536b2f46b19fa2e6ab35917332. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:46:06.205273 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6c22ac9f-7aeb-4b8a-8263-df8bb0f618ac tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:46:06.209097 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6c22ac9f-7aeb-4b8a-8263-df8bb0f618ac tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] [instance: aadb6c19-2ed0-412f-a666-72a64b56c4ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:46:06.447019 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6c22ac9f-7aeb-4b8a-8263-df8bb0f618ac tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.722611 Oct 27 03:46:06.450221 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2683/5658] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:46:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 2726 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 03:46:06.463102 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e378f194-2c4a-416f-a291-e46d03f945dd tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:06.463798 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e378f194-2c4a-416f-a291-e46d03f945dd tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] [instance: aadb6c19-2ed0-412f-a666-72a64b56c4ec] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:06.587396 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e378f194-2c4a-416f-a291-e46d03f945dd tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b983494c36da483d9f626522f74d9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc6a536b2f46b19fa2e6ab35917332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:06.600499 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e378f194-2c4a-416f-a291-e46d03f945dd tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] 10.222.0.20 "GET /compute/v2.1/servers/aadb6c19-2ed0-412f-a666-72a64b56c4ec" status: 200 len: 1224 microversion: 2.1 time: 0.141528 Oct 27 03:46:06.606627 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2976/5659] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:46:06 2022] GET /compute/v2.1/servers/aadb6c19-2ed0-412f-a666-72a64b56c4ec => generated 1224 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:46:06.839784 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-57dde62c-f3b7-4c1f-b3b7-4260da8cef8f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:06.847180 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-57dde62c-f3b7-4c1f-b3b7-4260da8cef8f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 18be006a-739d-4fe2-a04d-1db382b4aeeb] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:06.861640 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-57dde62c-f3b7-4c1f-b3b7-4260da8cef8f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:06.863351 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-57dde62c-f3b7-4c1f-b3b7-4260da8cef8f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:06.864603 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-57dde62c-f3b7-4c1f-b3b7-4260da8cef8f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:06.865868 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-57dde62c-f3b7-4c1f-b3b7-4260da8cef8f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:06.867293 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-57dde62c-f3b7-4c1f-b3b7-4260da8cef8f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:06.937047 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-57dde62c-f3b7-4c1f-b3b7-4260da8cef8f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:07.487844 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-57dde62c-f3b7-4c1f-b3b7-4260da8cef8f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:07.508393 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-57dde62c-f3b7-4c1f-b3b7-4260da8cef8f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/18be006a-739d-4fe2-a04d-1db382b4aeeb" status: 200 len: 1320 microversion: 2.1 time: 0.673210 Oct 27 03:46:07.532652 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2684/5660] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:46:06 2022] GET /compute/v2.1/servers/18be006a-739d-4fe2-a04d-1db382b4aeeb => generated 1320 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:46:07.630872 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3ead52f1-b166-411a-adba-1b6f4194b2a3 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:07.632194 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3ead52f1-b166-411a-adba-1b6f4194b2a3 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] [instance: aadb6c19-2ed0-412f-a666-72a64b56c4ec] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:07.892857 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3ead52f1-b166-411a-adba-1b6f4194b2a3 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b983494c36da483d9f626522f74d9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc6a536b2f46b19fa2e6ab35917332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:07.908009 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3ead52f1-b166-411a-adba-1b6f4194b2a3 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] 10.222.0.20 "GET /compute/v2.1/servers/aadb6c19-2ed0-412f-a666-72a64b56c4ec" status: 200 len: 1224 microversion: 2.1 time: 0.275011 Oct 27 03:46:07.914892 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2977/5661] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:46:07 2022] GET /compute/v2.1/servers/aadb6c19-2ed0-412f-a666-72a64b56c4ec => generated 1224 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:46:08.547429 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-77624d32-f9fb-4525-81cd-afa52de7648a tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:08.549212 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-77624d32-f9fb-4525-81cd-afa52de7648a tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 18be006a-739d-4fe2-a04d-1db382b4aeeb] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:08.566600 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-77624d32-f9fb-4525-81cd-afa52de7648a tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:08.568590 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-77624d32-f9fb-4525-81cd-afa52de7648a tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:08.573526 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-77624d32-f9fb-4525-81cd-afa52de7648a tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:08.577922 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-77624d32-f9fb-4525-81cd-afa52de7648a tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:08.578648 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-77624d32-f9fb-4525-81cd-afa52de7648a tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:08.579958 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-77624d32-f9fb-4525-81cd-afa52de7648a tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:08.913037 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-77624d32-f9fb-4525-81cd-afa52de7648a tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:08.921877 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-77624d32-f9fb-4525-81cd-afa52de7648a tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/18be006a-739d-4fe2-a04d-1db382b4aeeb" status: 200 len: 1320 microversion: 2.1 time: 0.379127 Oct 27 03:46:08.938783 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2685/5662] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:46:08 2022] GET /compute/v2.1/servers/18be006a-739d-4fe2-a04d-1db382b4aeeb => generated 1320 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:46:08.938931 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d16346aa-5aef-416e-af77-01668db8006c tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:08.938931 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d16346aa-5aef-416e-af77-01668db8006c tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] [instance: aadb6c19-2ed0-412f-a666-72a64b56c4ec] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:08.963179 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d16346aa-5aef-416e-af77-01668db8006c tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:08.972742 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d16346aa-5aef-416e-af77-01668db8006c tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:08.974675 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d16346aa-5aef-416e-af77-01668db8006c tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:08.978003 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d16346aa-5aef-416e-af77-01668db8006c tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:08.986508 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d16346aa-5aef-416e-af77-01668db8006c tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:08.987552 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d16346aa-5aef-416e-af77-01668db8006c tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:09.210089 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d16346aa-5aef-416e-af77-01668db8006c tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b983494c36da483d9f626522f74d9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc6a536b2f46b19fa2e6ab35917332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:09.219189 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d16346aa-5aef-416e-af77-01668db8006c tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] 10.222.0.20 "GET /compute/v2.1/servers/aadb6c19-2ed0-412f-a666-72a64b56c4ec" status: 200 len: 1220 microversion: 2.1 time: 0.290648 Oct 27 03:46:09.224484 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2978/5663] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:46:08 2022] GET /compute/v2.1/servers/aadb6c19-2ed0-412f-a666-72a64b56c4ec => generated 1220 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:46:09.947366 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-091adcb9-5401-4fb6-810a-7e677f49c2a4 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:09.948603 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-091adcb9-5401-4fb6-810a-7e677f49c2a4 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 18be006a-739d-4fe2-a04d-1db382b4aeeb] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:09.957892 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-091adcb9-5401-4fb6-810a-7e677f49c2a4 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:09.960756 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-091adcb9-5401-4fb6-810a-7e677f49c2a4 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:09.961387 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-091adcb9-5401-4fb6-810a-7e677f49c2a4 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:09.963757 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-091adcb9-5401-4fb6-810a-7e677f49c2a4 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:09.964452 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-091adcb9-5401-4fb6-810a-7e677f49c2a4 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:09.965086 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-091adcb9-5401-4fb6-810a-7e677f49c2a4 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:10.247096 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-bbcf220d-21f3-4676-a06e-f4269ba775f5 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:10.248249 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-bbcf220d-21f3-4676-a06e-f4269ba775f5 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] [instance: aadb6c19-2ed0-412f-a666-72a64b56c4ec] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:10.252152 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=2,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:10.255259 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-091adcb9-5401-4fb6-810a-7e677f49c2a4 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:10.265065 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-091adcb9-5401-4fb6-810a-7e677f49c2a4 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/18be006a-739d-4fe2-a04d-1db382b4aeeb" status: 200 len: 1320 microversion: 2.1 time: 0.323063 Oct 27 03:46:10.267333 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bbcf220d-21f3-4676-a06e-f4269ba775f5 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:10.268038 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bbcf220d-21f3-4676-a06e-f4269ba775f5 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:10.268871 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bbcf220d-21f3-4676-a06e-f4269ba775f5 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:10.269872 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2686/5664] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:46:09 2022] GET /compute/v2.1/servers/18be006a-739d-4fe2-a04d-1db382b4aeeb => generated 1320 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:46:10.270008 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bbcf220d-21f3-4676-a06e-f4269ba775f5 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:10.271233 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bbcf220d-21f3-4676-a06e-f4269ba775f5 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:10.273863 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bbcf220d-21f3-4676-a06e-f4269ba775f5 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:10.438919 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-bbcf220d-21f3-4676-a06e-f4269ba775f5 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b983494c36da483d9f626522f74d9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc6a536b2f46b19fa2e6ab35917332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:10.447994 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-bbcf220d-21f3-4676-a06e-f4269ba775f5 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] 10.222.0.20 "GET /compute/v2.1/servers/aadb6c19-2ed0-412f-a666-72a64b56c4ec" status: 200 len: 1276 microversion: 2.1 time: 0.205333 Oct 27 03:46:10.456260 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2979/5665] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:46:10 2022] GET /compute/v2.1/servers/aadb6c19-2ed0-412f-a666-72a64b56c4ec => generated 1276 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:46:11.299385 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-38ae9b9a-0fe9-4088-9e83-73bbc45c3bb5 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:11.300952 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-38ae9b9a-0fe9-4088-9e83-73bbc45c3bb5 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 18be006a-739d-4fe2-a04d-1db382b4aeeb] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:11.311866 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-38ae9b9a-0fe9-4088-9e83-73bbc45c3bb5 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:11.314115 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-38ae9b9a-0fe9-4088-9e83-73bbc45c3bb5 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:11.319370 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-38ae9b9a-0fe9-4088-9e83-73bbc45c3bb5 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:11.320463 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-38ae9b9a-0fe9-4088-9e83-73bbc45c3bb5 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:11.321328 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-38ae9b9a-0fe9-4088-9e83-73bbc45c3bb5 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:11.321997 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-38ae9b9a-0fe9-4088-9e83-73bbc45c3bb5 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:11.477293 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5a28b664-dc85-476f-9993-a6e7bd023dae tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:11.478766 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5a28b664-dc85-476f-9993-a6e7bd023dae tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] [instance: aadb6c19-2ed0-412f-a666-72a64b56c4ec] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:11.490622 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5a28b664-dc85-476f-9993-a6e7bd023dae tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:11.493877 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5a28b664-dc85-476f-9993-a6e7bd023dae tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:11.497315 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5a28b664-dc85-476f-9993-a6e7bd023dae tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:11.498579 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5a28b664-dc85-476f-9993-a6e7bd023dae tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:11.499393 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5a28b664-dc85-476f-9993-a6e7bd023dae tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:11.504096 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5a28b664-dc85-476f-9993-a6e7bd023dae tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:11.741656 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5a28b664-dc85-476f-9993-a6e7bd023dae tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b983494c36da483d9f626522f74d9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc6a536b2f46b19fa2e6ab35917332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:11.756515 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5a28b664-dc85-476f-9993-a6e7bd023dae tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] 10.222.0.20 "GET /compute/v2.1/servers/aadb6c19-2ed0-412f-a666-72a64b56c4ec" status: 200 len: 1282 microversion: 2.1 time: 0.279270 Oct 27 03:46:11.760686 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2980/5666] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:46:11 2022] GET /compute/v2.1/servers/aadb6c19-2ed0-412f-a666-72a64b56c4ec => generated 1282 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:46:11.947263 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-38ae9b9a-0fe9-4088-9e83-73bbc45c3bb5 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:11.970691 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-38ae9b9a-0fe9-4088-9e83-73bbc45c3bb5 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/18be006a-739d-4fe2-a04d-1db382b4aeeb" status: 200 len: 1320 microversion: 2.1 time: 0.675169 Oct 27 03:46:11.979570 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2687/5667] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:46:11 2022] GET /compute/v2.1/servers/18be006a-739d-4fe2-a04d-1db382b4aeeb => generated 1320 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:46:12.783292 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-345a1806-e7c0-4ee1-9fe7-0eb6cd9a2c69 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:12.783932 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-345a1806-e7c0-4ee1-9fe7-0eb6cd9a2c69 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] [instance: aadb6c19-2ed0-412f-a666-72a64b56c4ec] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:12.808188 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-345a1806-e7c0-4ee1-9fe7-0eb6cd9a2c69 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:12.809419 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-345a1806-e7c0-4ee1-9fe7-0eb6cd9a2c69 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:12.814179 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-345a1806-e7c0-4ee1-9fe7-0eb6cd9a2c69 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:12.818290 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-345a1806-e7c0-4ee1-9fe7-0eb6cd9a2c69 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:12.821213 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-345a1806-e7c0-4ee1-9fe7-0eb6cd9a2c69 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:12.822414 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-345a1806-e7c0-4ee1-9fe7-0eb6cd9a2c69 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:12.835854 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6fb8b2a1-3b0a-4c93-ab9e-033040705a7d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:12.839448 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6fb8b2a1-3b0a-4c93-ab9e-033040705a7d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 1db2318e-9ac7-4994-8daa-14ae22537d5d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:12.856992 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6fb8b2a1-3b0a-4c93-ab9e-033040705a7d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:12.856992 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6fb8b2a1-3b0a-4c93-ab9e-033040705a7d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:12.856992 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6fb8b2a1-3b0a-4c93-ab9e-033040705a7d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:12.860557 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6fb8b2a1-3b0a-4c93-ab9e-033040705a7d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:12.860655 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6fb8b2a1-3b0a-4c93-ab9e-033040705a7d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:12.862747 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6fb8b2a1-3b0a-4c93-ab9e-033040705a7d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:12.946385 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6fb8b2a1-3b0a-4c93-ab9e-033040705a7d tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.119782 Oct 27 03:46:12.954489 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2688/5668] 10.222.0.20 () {60 vars in 1343 bytes} [Thu Oct 27 03:46:12 2022] GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d/os-volume_attachments => generated 25 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:46:12.997900 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0d0a07c5-1ac5-495e-a8a1-48f04965b81b tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:12.999534 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0d0a07c5-1ac5-495e-a8a1-48f04965b81b tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 18be006a-739d-4fe2-a04d-1db382b4aeeb] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:13.010723 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0d0a07c5-1ac5-495e-a8a1-48f04965b81b tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:13.013015 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0d0a07c5-1ac5-495e-a8a1-48f04965b81b tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:13.014256 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0d0a07c5-1ac5-495e-a8a1-48f04965b81b tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:13.017025 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0d0a07c5-1ac5-495e-a8a1-48f04965b81b tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:13.018928 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0d0a07c5-1ac5-495e-a8a1-48f04965b81b tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:13.021446 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0d0a07c5-1ac5-495e-a8a1-48f04965b81b tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:13.191710 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-345a1806-e7c0-4ee1-9fe7-0eb6cd9a2c69 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b983494c36da483d9f626522f74d9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc6a536b2f46b19fa2e6ab35917332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:13.203016 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-345a1806-e7c0-4ee1-9fe7-0eb6cd9a2c69 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] 10.222.0.20 "GET /compute/v2.1/servers/aadb6c19-2ed0-412f-a666-72a64b56c4ec" status: 200 len: 1324 microversion: 2.1 time: 0.422518 Oct 27 03:46:13.214064 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2981/5669] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:46:12 2022] GET /compute/v2.1/servers/aadb6c19-2ed0-412f-a666-72a64b56c4ec => generated 1324 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:46:13.225031 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3619ae66-cf6d-453d-859a-8028d99b2a1e tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:13.228014 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3619ae66-cf6d-453d-859a-8028d99b2a1e tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 1db2318e-9ac7-4994-8daa-14ae22537d5d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:13.246758 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3619ae66-cf6d-453d-859a-8028d99b2a1e tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:13.252709 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3619ae66-cf6d-453d-859a-8028d99b2a1e tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:13.254166 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3619ae66-cf6d-453d-859a-8028d99b2a1e tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:13.255238 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3619ae66-cf6d-453d-859a-8028d99b2a1e tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:13.255848 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3619ae66-cf6d-453d-859a-8028d99b2a1e tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:13.257663 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3619ae66-cf6d-453d-859a-8028d99b2a1e tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:13.263735 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:13.291803 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3619ae66-cf6d-453d-859a-8028d99b2a1e tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 1db2318e-9ac7-4994-8daa-14ae22537d5d] Going to try to terminate instance {{(pid=121001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:46:13.512811 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0d0a07c5-1ac5-495e-a8a1-48f04965b81b tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:13.523779 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0d0a07c5-1ac5-495e-a8a1-48f04965b81b tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/18be006a-739d-4fe2-a04d-1db382b4aeeb" status: 200 len: 1320 microversion: 2.1 time: 0.530657 Oct 27 03:46:13.535285 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2689/5670] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:46:12 2022] GET /compute/v2.1/servers/18be006a-739d-4fe2-a04d-1db382b4aeeb => generated 1320 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:46:13.543605 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-23628154-348a-465e-8fb9-ddd43d09a62c req-5d1207cf-7948-4548-b48e-648623fbd262 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18be006a-739d-4fe2-a04d-1db382b4aeeb", "name": "network-vif-plugged", "status": "completed", "tag": "1232f5e9-8a21-488d-b0b7-38aaec3f0008"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:46:13.577479 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-23628154-348a-465e-8fb9-ddd43d09a62c req-5d1207cf-7948-4548-b48e-648623fbd262 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:13.577963 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-23628154-348a-465e-8fb9-ddd43d09a62c req-5d1207cf-7948-4548-b48e-648623fbd262 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:13.578424 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-23628154-348a-465e-8fb9-ddd43d09a62c req-5d1207cf-7948-4548-b48e-648623fbd262 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:13.618446 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-23628154-348a-465e-8fb9-ddd43d09a62c req-5d1207cf-7948-4548-b48e-648623fbd262 service nova] Creating event network-vif-plugged:1232f5e9-8a21-488d-b0b7-38aaec3f0008 for instance 18be006a-739d-4fe2-a04d-1db382b4aeeb on n-h1-862769-1 Oct 27 03:46:13.631176 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-23628154-348a-465e-8fb9-ddd43d09a62c req-5d1207cf-7948-4548-b48e-648623fbd262 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094194 Oct 27 03:46:13.632375 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2690/5671] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:46:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:46:13.792229 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3619ae66-cf6d-453d-859a-8028d99b2a1e tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d" status: 204 len: 0 microversion: 2.20 time: 0.579098 Oct 27 03:46:13.793530 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2982/5672] 10.222.0.20 () {60 vars in 1280 bytes} [Thu Oct 27 03:46:13 2022] DELETE /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d => generated 0 bytes in 582 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 03:46:13.803387 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5b8df656-c9db-4b47-a660-969a784e2032 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:13.804091 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5b8df656-c9db-4b47-a660-969a784e2032 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 1db2318e-9ac7-4994-8daa-14ae22537d5d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:13.815153 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5b8df656-c9db-4b47-a660-969a784e2032 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:13.822565 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5b8df656-c9db-4b47-a660-969a784e2032 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:13.823345 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5b8df656-c9db-4b47-a660-969a784e2032 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:13.824267 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5b8df656-c9db-4b47-a660-969a784e2032 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:13.824906 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5b8df656-c9db-4b47-a660-969a784e2032 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:13.825512 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5b8df656-c9db-4b47-a660-969a784e2032 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:14.228479 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9e75f4e3-a430-4c9a-8372-fd8719711c85 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:14.229409 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-9e75f4e3-a430-4c9a-8372-fd8719711c85 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] [instance: aadb6c19-2ed0-412f-a666-72a64b56c4ec] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:14.249141 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9e75f4e3-a430-4c9a-8372-fd8719711c85 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:14.249658 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9e75f4e3-a430-4c9a-8372-fd8719711c85 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:14.250114 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9e75f4e3-a430-4c9a-8372-fd8719711c85 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:14.251370 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9e75f4e3-a430-4c9a-8372-fd8719711c85 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:14.251830 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9e75f4e3-a430-4c9a-8372-fd8719711c85 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:14.252260 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9e75f4e3-a430-4c9a-8372-fd8719711c85 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:14.321923 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5b8df656-c9db-4b47-a660-969a784e2032 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:14.330853 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5b8df656-c9db-4b47-a660-969a784e2032 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:14.335972 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5b8df656-c9db-4b47-a660-969a784e2032 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:14.337439 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5b8df656-c9db-4b47-a660-969a784e2032 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d" status: 200 len: 1724 microversion: 2.20 time: 0.538918 Oct 27 03:46:14.338191 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2691/5673] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:46:13 2022] GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d => generated 1724 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:46:14.550765 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2f13bdcd-0885-45d2-930a-6f6ce01ee1ed tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:14.551387 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-2f13bdcd-0885-45d2-930a-6f6ce01ee1ed tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 18be006a-739d-4fe2-a04d-1db382b4aeeb] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:14.564224 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2f13bdcd-0885-45d2-930a-6f6ce01ee1ed tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:14.568930 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2f13bdcd-0885-45d2-930a-6f6ce01ee1ed tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:14.569800 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2f13bdcd-0885-45d2-930a-6f6ce01ee1ed tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:14.573552 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2f13bdcd-0885-45d2-930a-6f6ce01ee1ed tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:14.575696 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2f13bdcd-0885-45d2-930a-6f6ce01ee1ed tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:14.577090 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2f13bdcd-0885-45d2-930a-6f6ce01ee1ed tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:15.432424 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2f13bdcd-0885-45d2-930a-6f6ce01ee1ed tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:15.465057 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2f13bdcd-0885-45d2-930a-6f6ce01ee1ed tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/18be006a-739d-4fe2-a04d-1db382b4aeeb" status: 200 len: 1320 microversion: 2.1 time: 0.918811 Oct 27 03:46:15.468825 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2692/5674] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:46:14 2022] GET /compute/v2.1/servers/18be006a-739d-4fe2-a04d-1db382b4aeeb => generated 1320 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:46:15.477141 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-11db7bbb-1dd0-4028-9ea4-0ab6d2e98418 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:15.481258 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-11db7bbb-1dd0-4028-9ea4-0ab6d2e98418 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 1db2318e-9ac7-4994-8daa-14ae22537d5d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:15.499888 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-11db7bbb-1dd0-4028-9ea4-0ab6d2e98418 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:15.501628 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-11db7bbb-1dd0-4028-9ea4-0ab6d2e98418 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:15.502357 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-11db7bbb-1dd0-4028-9ea4-0ab6d2e98418 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:15.507942 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-11db7bbb-1dd0-4028-9ea4-0ab6d2e98418 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:15.508975 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-11db7bbb-1dd0-4028-9ea4-0ab6d2e98418 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:15.510078 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-11db7bbb-1dd0-4028-9ea4-0ab6d2e98418 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:15.685991 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9e75f4e3-a430-4c9a-8372-fd8719711c85 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b983494c36da483d9f626522f74d9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc6a536b2f46b19fa2e6ab35917332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:15.701921 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9e75f4e3-a430-4c9a-8372-fd8719711c85 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] 10.222.0.20 "GET /compute/v2.1/servers/aadb6c19-2ed0-412f-a666-72a64b56c4ec" status: 200 len: 1324 microversion: 2.1 time: 1.476422 Oct 27 03:46:15.711237 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2983/5675] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:46:14 2022] GET /compute/v2.1/servers/aadb6c19-2ed0-412f-a666-72a64b56c4ec => generated 1324 bytes in 1481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:46:15.979360 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-11db7bbb-1dd0-4028-9ea4-0ab6d2e98418 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:15.990269 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-11db7bbb-1dd0-4028-9ea4-0ab6d2e98418 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:15.992352 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-11db7bbb-1dd0-4028-9ea4-0ab6d2e98418 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:15.994921 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-11db7bbb-1dd0-4028-9ea4-0ab6d2e98418 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d" status: 200 len: 1724 microversion: 2.20 time: 0.521723 Oct 27 03:46:15.995993 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2693/5676] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:46:15 2022] GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d => generated 1724 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:46:16.158442 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-e6550362-fa3f-4e0a-82a8-30fadc016aa8 req-57d6e392-35ed-4c67-9f62-4e253b5fab74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aadb6c19-2ed0-412f-a666-72a64b56c4ec", "tag": "59efc190-82eb-4453-8d3b-d1283e07d44d"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:46:16.173420 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-e6550362-fa3f-4e0a-82a8-30fadc016aa8 req-57d6e392-35ed-4c67-9f62-4e253b5fab74 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:16.173911 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-e6550362-fa3f-4e0a-82a8-30fadc016aa8 req-57d6e392-35ed-4c67-9f62-4e253b5fab74 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:16.176083 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-e6550362-fa3f-4e0a-82a8-30fadc016aa8 req-57d6e392-35ed-4c67-9f62-4e253b5fab74 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:16.219156 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-e6550362-fa3f-4e0a-82a8-30fadc016aa8 req-57d6e392-35ed-4c67-9f62-4e253b5fab74 service nova] Creating event network-changed:59efc190-82eb-4453-8d3b-d1283e07d44d for instance aadb6c19-2ed0-412f-a666-72a64b56c4ec on n-h2-862769-1 Oct 27 03:46:16.256942 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-e6550362-fa3f-4e0a-82a8-30fadc016aa8 req-57d6e392-35ed-4c67-9f62-4e253b5fab74 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088171 Oct 27 03:46:16.261858 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2984/5677] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:46:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:46:16.495156 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-34b8c70b-40f4-4bb6-a245-d058b2323cfa tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:16.496374 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-34b8c70b-40f4-4bb6-a245-d058b2323cfa tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 18be006a-739d-4fe2-a04d-1db382b4aeeb] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:16.502186 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:16.503223 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=6 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:16.504942 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-34b8c70b-40f4-4bb6-a245-d058b2323cfa tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:16.505705 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-34b8c70b-40f4-4bb6-a245-d058b2323cfa tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:16.506435 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-34b8c70b-40f4-4bb6-a245-d058b2323cfa tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:16.518160 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-34b8c70b-40f4-4bb6-a245-d058b2323cfa tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:16.523264 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-34b8c70b-40f4-4bb6-a245-d058b2323cfa tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:16.531202 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-34b8c70b-40f4-4bb6-a245-d058b2323cfa tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:16.732923 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b2ad6bc9-a096-44b4-82f1-d1762a754325 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:16.734531 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b2ad6bc9-a096-44b4-82f1-d1762a754325 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] [instance: aadb6c19-2ed0-412f-a666-72a64b56c4ec] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:16.745064 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b2ad6bc9-a096-44b4-82f1-d1762a754325 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:16.746270 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b2ad6bc9-a096-44b4-82f1-d1762a754325 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:16.749164 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b2ad6bc9-a096-44b4-82f1-d1762a754325 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:16.750318 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b2ad6bc9-a096-44b4-82f1-d1762a754325 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:16.751915 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b2ad6bc9-a096-44b4-82f1-d1762a754325 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:16.752746 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b2ad6bc9-a096-44b4-82f1-d1762a754325 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:17.071045 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-34b8c70b-40f4-4bb6-a245-d058b2323cfa tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:17.079977 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-34b8c70b-40f4-4bb6-a245-d058b2323cfa tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/18be006a-739d-4fe2-a04d-1db382b4aeeb" status: 200 len: 1501 microversion: 2.1 time: 0.589575 Oct 27 03:46:17.080575 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2694/5678] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:46:16 2022] GET /compute/v2.1/servers/18be006a-739d-4fe2-a04d-1db382b4aeeb => generated 1501 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:46:17.096590 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b2ad6bc9-a096-44b4-82f1-d1762a754325 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b983494c36da483d9f626522f74d9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc6a536b2f46b19fa2e6ab35917332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:17.104667 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-432b2d9c-7093-4c9c-b9ff-d846abe71aca tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:17.105327 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-432b2d9c-7093-4c9c-b9ff-d846abe71aca tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 1db2318e-9ac7-4994-8daa-14ae22537d5d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:17.119717 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b2ad6bc9-a096-44b4-82f1-d1762a754325 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] 10.222.0.20 "GET /compute/v2.1/servers/aadb6c19-2ed0-412f-a666-72a64b56c4ec" status: 200 len: 1324 microversion: 2.1 time: 0.391569 Oct 27 03:46:17.124457 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-432b2d9c-7093-4c9c-b9ff-d846abe71aca tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:17.124457 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-432b2d9c-7093-4c9c-b9ff-d846abe71aca tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:17.124457 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-432b2d9c-7093-4c9c-b9ff-d846abe71aca tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:17.124457 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-432b2d9c-7093-4c9c-b9ff-d846abe71aca tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:17.124873 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2985/5679] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:46:16 2022] GET /compute/v2.1/servers/aadb6c19-2ed0-412f-a666-72a64b56c4ec => generated 1324 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:46:17.124988 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-432b2d9c-7093-4c9c-b9ff-d846abe71aca tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:17.124988 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-432b2d9c-7093-4c9c-b9ff-d846abe71aca tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:17.133164 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f5b9eae6-f2a9-40a2-a944-858e6c0621f8 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:17.138226 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f5b9eae6-f2a9-40a2-a944-858e6c0621f8 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 18be006a-739d-4fe2-a04d-1db382b4aeeb] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:17.150719 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f5b9eae6-f2a9-40a2-a944-858e6c0621f8 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:17.151652 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f5b9eae6-f2a9-40a2-a944-858e6c0621f8 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:17.152288 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f5b9eae6-f2a9-40a2-a944-858e6c0621f8 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:17.155937 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f5b9eae6-f2a9-40a2-a944-858e6c0621f8 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:17.155937 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f5b9eae6-f2a9-40a2-a944-858e6c0621f8 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:17.155937 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f5b9eae6-f2a9-40a2-a944-858e6c0621f8 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:17.450163 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f5b9eae6-f2a9-40a2-a944-858e6c0621f8 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:17.459502 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f5b9eae6-f2a9-40a2-a944-858e6c0621f8 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/18be006a-739d-4fe2-a04d-1db382b4aeeb" status: 200 len: 1501 microversion: 2.1 time: 0.335361 Oct 27 03:46:17.463133 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2986/5680] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:46:17 2022] GET /compute/v2.1/servers/18be006a-739d-4fe2-a04d-1db382b4aeeb => generated 1501 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:46:17.488682 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-821e7c58-be1c-4887-812b-be426d1eead1 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:17.489375 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-821e7c58-be1c-4887-812b-be426d1eead1 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 18be006a-739d-4fe2-a04d-1db382b4aeeb] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:17.519165 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-821e7c58-be1c-4887-812b-be426d1eead1 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:17.519674 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-821e7c58-be1c-4887-812b-be426d1eead1 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:17.520131 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-821e7c58-be1c-4887-812b-be426d1eead1 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:17.520870 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-821e7c58-be1c-4887-812b-be426d1eead1 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:17.521340 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-821e7c58-be1c-4887-812b-be426d1eead1 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:17.521789 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-821e7c58-be1c-4887-812b-be426d1eead1 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:17.569765 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-821e7c58-be1c-4887-812b-be426d1eead1 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 18be006a-739d-4fe2-a04d-1db382b4aeeb] Going to try to terminate instance {{(pid=121001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:46:17.615421 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-432b2d9c-7093-4c9c-b9ff-d846abe71aca tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:17.625741 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-432b2d9c-7093-4c9c-b9ff-d846abe71aca tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:17.628335 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-432b2d9c-7093-4c9c-b9ff-d846abe71aca tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:17.630568 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-432b2d9c-7093-4c9c-b9ff-d846abe71aca tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d" status: 200 len: 1724 microversion: 2.20 time: 0.533964 Oct 27 03:46:17.631139 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2695/5681] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:46:17 2022] GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d => generated 1724 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:46:17.902319 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=4 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:17.941613 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-821e7c58-be1c-4887-812b-be426d1eead1 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "DELETE /compute/v2.1/servers/18be006a-739d-4fe2-a04d-1db382b4aeeb" status: 204 len: 0 microversion: 2.1 time: 0.459889 Oct 27 03:46:17.942516 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2987/5682] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:46:17 2022] DELETE /compute/v2.1/servers/18be006a-739d-4fe2-a04d-1db382b4aeeb => generated 0 bytes in 463 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:46:17.951451 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6d85779c-d786-4b84-8b89-642869f4017f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:17.952712 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6d85779c-d786-4b84-8b89-642869f4017f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 18be006a-739d-4fe2-a04d-1db382b4aeeb] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:17.971223 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6d85779c-d786-4b84-8b89-642869f4017f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:17.971223 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6d85779c-d786-4b84-8b89-642869f4017f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:17.972629 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6d85779c-d786-4b84-8b89-642869f4017f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:17.972629 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6d85779c-d786-4b84-8b89-642869f4017f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:17.972811 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6d85779c-d786-4b84-8b89-642869f4017f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:17.973334 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6d85779c-d786-4b84-8b89-642869f4017f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:18.149110 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-04b13e96-f3fc-4ee7-a471-c194ba312268 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:18.150447 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-04b13e96-f3fc-4ee7-a471-c194ba312268 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] [instance: aadb6c19-2ed0-412f-a666-72a64b56c4ec] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:18.167971 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-04b13e96-f3fc-4ee7-a471-c194ba312268 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:18.168816 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-04b13e96-f3fc-4ee7-a471-c194ba312268 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:18.173667 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-04b13e96-f3fc-4ee7-a471-c194ba312268 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:18.174022 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-04b13e96-f3fc-4ee7-a471-c194ba312268 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:18.175316 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-04b13e96-f3fc-4ee7-a471-c194ba312268 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:18.177498 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-04b13e96-f3fc-4ee7-a471-c194ba312268 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:18.325771 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-6d85779c-d786-4b84-8b89-642869f4017f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:18.342056 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6d85779c-d786-4b84-8b89-642869f4017f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/18be006a-739d-4fe2-a04d-1db382b4aeeb" status: 200 len: 1507 microversion: 2.1 time: 0.387864 Oct 27 03:46:18.347026 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2696/5683] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:46:17 2022] GET /compute/v2.1/servers/18be006a-739d-4fe2-a04d-1db382b4aeeb => generated 1507 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:46:18.365751 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-5ab480db-a9ca-4ecb-aecb-108a4f620744 req-15a5146e-dc62-41e6-b79c-dc261ccfc79c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1db2318e-9ac7-4994-8daa-14ae22537d5d", "name": "network-vif-deleted", "tag": "162a3612-f72a-4eb0-9872-8b121e85445d"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:46:18.382322 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-5ab480db-a9ca-4ecb-aecb-108a4f620744 req-15a5146e-dc62-41e6-b79c-dc261ccfc79c service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:18.383114 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-5ab480db-a9ca-4ecb-aecb-108a4f620744 req-15a5146e-dc62-41e6-b79c-dc261ccfc79c service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:18.383898 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-5ab480db-a9ca-4ecb-aecb-108a4f620744 req-15a5146e-dc62-41e6-b79c-dc261ccfc79c service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:18.417057 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=100 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:18.445397 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-5ab480db-a9ca-4ecb-aecb-108a4f620744 req-15a5146e-dc62-41e6-b79c-dc261ccfc79c service nova] Creating event network-vif-deleted:162a3612-f72a-4eb0-9872-8b121e85445d for instance 1db2318e-9ac7-4994-8daa-14ae22537d5d on n-h2-862769-1 Oct 27 03:46:18.461178 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-5ab480db-a9ca-4ecb-aecb-108a4f620744 req-15a5146e-dc62-41e6-b79c-dc261ccfc79c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108993 Oct 27 03:46:18.461178 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2697/5684] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:46:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:46:18.662977 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-084c0f24-a5bf-4001-bae0-6e219c103e3e tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:18.665233 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-084c0f24-a5bf-4001-bae0-6e219c103e3e tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 1db2318e-9ac7-4994-8daa-14ae22537d5d] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:18.685117 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-084c0f24-a5bf-4001-bae0-6e219c103e3e tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:18.687171 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-084c0f24-a5bf-4001-bae0-6e219c103e3e tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:18.688738 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-084c0f24-a5bf-4001-bae0-6e219c103e3e tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:18.689722 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-084c0f24-a5bf-4001-bae0-6e219c103e3e tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:18.692552 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-084c0f24-a5bf-4001-bae0-6e219c103e3e tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:18.693022 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-084c0f24-a5bf-4001-bae0-6e219c103e3e tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:18.793304 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-04b13e96-f3fc-4ee7-a471-c194ba312268 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b983494c36da483d9f626522f74d9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc6a536b2f46b19fa2e6ab35917332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:18.820604 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-04b13e96-f3fc-4ee7-a471-c194ba312268 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] 10.222.0.20 "GET /compute/v2.1/servers/aadb6c19-2ed0-412f-a666-72a64b56c4ec" status: 200 len: 1324 microversion: 2.1 time: 0.675597 Oct 27 03:46:18.822695 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2988/5685] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:46:18 2022] GET /compute/v2.1/servers/aadb6c19-2ed0-412f-a666-72a64b56c4ec => generated 1324 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:46:18.845609 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-084c0f24-a5bf-4001-bae0-6e219c103e3e tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:18.863345 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-084c0f24-a5bf-4001-bae0-6e219c103e3e tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:18.863345 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-084c0f24-a5bf-4001-bae0-6e219c103e3e tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e8d6facd1460ab31a3ce4b24dd315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c48bca00e4d445918f030bf885424b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:18.867539 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-084c0f24-a5bf-4001-bae0-6e219c103e3e tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d" status: 200 len: 1366 microversion: 2.20 time: 0.209337 Oct 27 03:46:18.869643 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2698/5686] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:46:18 2022] GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d => generated 1366 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:46:19.371076 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-79e153c4-2fb6-4206-9160-f66af8be8926 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:19.371726 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-79e153c4-2fb6-4206-9160-f66af8be8926 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 18be006a-739d-4fe2-a04d-1db382b4aeeb] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:19.383070 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-79e153c4-2fb6-4206-9160-f66af8be8926 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:19.383583 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-79e153c4-2fb6-4206-9160-f66af8be8926 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:19.384039 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-79e153c4-2fb6-4206-9160-f66af8be8926 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:19.384766 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-79e153c4-2fb6-4206-9160-f66af8be8926 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:19.385237 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-79e153c4-2fb6-4206-9160-f66af8be8926 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:19.390763 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-79e153c4-2fb6-4206-9160-f66af8be8926 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:19.583605 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5698d5d1-8c37-4a18-87fc-e8296dd979e9 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:19.584123 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5698d5d1-8c37-4a18-87fc-e8296dd979e9 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: c9e02344-a91a-40c8-b8c0-c0abe503204c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:19.595069 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5698d5d1-8c37-4a18-87fc-e8296dd979e9 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:19.595581 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5698d5d1-8c37-4a18-87fc-e8296dd979e9 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:19.596042 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5698d5d1-8c37-4a18-87fc-e8296dd979e9 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:19.596785 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5698d5d1-8c37-4a18-87fc-e8296dd979e9 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:19.600689 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5698d5d1-8c37-4a18-87fc-e8296dd979e9 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:19.601227 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5698d5d1-8c37-4a18-87fc-e8296dd979e9 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:19.613881 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-79e153c4-2fb6-4206-9160-f66af8be8926 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:19.630482 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-79e153c4-2fb6-4206-9160-f66af8be8926 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/18be006a-739d-4fe2-a04d-1db382b4aeeb" status: 200 len: 1507 microversion: 2.1 time: 0.258513 Oct 27 03:46:19.631614 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2989/5687] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:46:19 2022] GET /compute/v2.1/servers/18be006a-739d-4fe2-a04d-1db382b4aeeb => generated 1507 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:46:19.680415 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5698d5d1-8c37-4a18-87fc-e8296dd979e9 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: c9e02344-a91a-40c8-b8c0-c0abe503204c] Going to try to terminate instance {{(pid=121000) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:46:19.848967 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ee10923e-1f24-4945-96b6-d03866cf4fcb tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:19.850243 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ee10923e-1f24-4945-96b6-d03866cf4fcb tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] [instance: aadb6c19-2ed0-412f-a666-72a64b56c4ec] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:19.860729 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ee10923e-1f24-4945-96b6-d03866cf4fcb tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:19.861644 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ee10923e-1f24-4945-96b6-d03866cf4fcb tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:19.862383 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ee10923e-1f24-4945-96b6-d03866cf4fcb tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:19.863444 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ee10923e-1f24-4945-96b6-d03866cf4fcb tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:19.864741 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ee10923e-1f24-4945-96b6-d03866cf4fcb tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:19.865673 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ee10923e-1f24-4945-96b6-d03866cf4fcb tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:20.076499 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:20.152194 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ee10923e-1f24-4945-96b6-d03866cf4fcb tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b983494c36da483d9f626522f74d9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc6a536b2f46b19fa2e6ab35917332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:20.163155 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ee10923e-1f24-4945-96b6-d03866cf4fcb tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] 10.222.0.20 "GET /compute/v2.1/servers/aadb6c19-2ed0-412f-a666-72a64b56c4ec" status: 200 len: 1324 microversion: 2.1 time: 0.320548 Oct 27 03:46:20.169265 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2990/5688] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:46:19 2022] GET /compute/v2.1/servers/aadb6c19-2ed0-412f-a666-72a64b56c4ec => generated 1324 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:46:20.178399 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5698d5d1-8c37-4a18-87fc-e8296dd979e9 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c" status: 204 len: 0 microversion: 2.1 time: 0.599158 Oct 27 03:46:20.179394 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2699/5689] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:46:19 2022] DELETE /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c => generated 0 bytes in 601 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 03:46:20.181748 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-090494de-c0d4-4a32-ae38-60a0bbbd7f29 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:20.202291 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-02168460-f8c0-4324-ae3a-72bdeeaf1068 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:20.203494 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-02168460-f8c0-4324-ae3a-72bdeeaf1068 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: c9e02344-a91a-40c8-b8c0-c0abe503204c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:20.206727 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-090494de-c0d4-4a32-ae38-60a0bbbd7f29 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 1db2318e-9ac7-4994-8daa-14ae22537d5d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:20.231609 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-02168460-f8c0-4324-ae3a-72bdeeaf1068 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:20.234497 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-090494de-c0d4-4a32-ae38-60a0bbbd7f29 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:20.234844 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-02168460-f8c0-4324-ae3a-72bdeeaf1068 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:20.235918 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-02168460-f8c0-4324-ae3a-72bdeeaf1068 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:20.237505 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-02168460-f8c0-4324-ae3a-72bdeeaf1068 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:20.238347 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-090494de-c0d4-4a32-ae38-60a0bbbd7f29 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:20.239100 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-090494de-c0d4-4a32-ae38-60a0bbbd7f29 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:20.241109 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-02168460-f8c0-4324-ae3a-72bdeeaf1068 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:20.242840 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-02168460-f8c0-4324-ae3a-72bdeeaf1068 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:20.245903 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-090494de-c0d4-4a32-ae38-60a0bbbd7f29 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:20.247255 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-090494de-c0d4-4a32-ae38-60a0bbbd7f29 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:20.251624 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-090494de-c0d4-4a32-ae38-60a0bbbd7f29 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:20.308263 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-090494de-c0d4-4a32-ae38-60a0bbbd7f29 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] HTTP exception thrown: Instance 1db2318e-9ac7-4994-8daa-14ae22537d5d could not be found. Oct 27 03:46:20.314370 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-090494de-c0d4-4a32-ae38-60a0bbbd7f29 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Request method failure captured: Oct 27 03:46:20.314370 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d HTTP/1.1 Oct 27 03:46:20.314370 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:46:20.314370 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:46:20.314370 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:46:20.314370 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:46:20.314370 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:46:20.314370 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:46:20.314370 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:46:20.314370 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:46:20.314370 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWf1tpBFEbkvSK3SqNKiaBdt2iU4VU0up94oX5h2-dwelsBTcOMjAbogxTF1m6837ADQrTcsoRLUG6fwb1i91GnLWdY1HiMrerSGB8x7h0qmRtRJ0xxks9W3iJabiTHs4YSYs5Sa938DRiTXN21ja7qe0GdEoHSxnnRlw0wNIOnjEc_c Oct 27 03:46:20.314370 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:46:20.314370 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:46:20.314370 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:46:20.314370 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:46:20.314370 n-d-862769-1 devstack@n-api.service[121001]: X-Openstack-Nova-Api-Version: 2.20 Oct 27 03:46:20.314370 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:46:20.314370 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:46:20.314370 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: c48bca00e4d445918f030bf885424b40 Oct 27 03:46:20.314370 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-186270836 Oct 27 03:46:20.314370 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:46:20.314370 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:46:20.314370 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c48bca00e4d445918f030bf885424b40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c48bca00e4d445918f030bf885424b40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c48bca00e4d445918f030bf885424b40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c48bca00e4d445918f030bf885424b40"}]}] Oct 27 03:46:20.314370 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-AttachVolumeShelveTestJSON-186270836 Oct 27 03:46:20.314370 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: c48bca00e4d445918f030bf885424b40 Oct 27 03:46:20.314370 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-186270836 Oct 27 03:46:20.314370 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-AttachVolumeShelveTestJSON-186270836-project Oct 27 03:46:20.314370 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:46:20.314370 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:46:20.314370 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: b74e8d6facd1460ab31a3ce4b24dd315 Oct 27 03:46:20.314370 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-AttachVolumeShelveTestJSON-186270836-project Oct 27 03:46:20.314370 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:46:20.314370 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 1db2318e-9ac7-4994-8daa-14ae22537d5d could not be found. Oct 27 03:46:20.314370 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '1db2318e-9ac7-4994-8daa-14ae22537d5d'} Oct 27 03:46:20.314370 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:46:20.314370 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:46:20.314370 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:46:20.314370 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:46:20.314370 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:46:20.314370 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:46:20.314370 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:46:20.314370 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:46:20.314370 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:46:20.314370 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:46:20.314370 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1db2318e-9ac7-4994-8daa-14ae22537d5d could not be found. Oct 27 03:46:20.314370 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:46:20.314370 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:46:20.314370 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:46:20.314370 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:46:20.314370 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:46:20.314370 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:46:20.314370 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:46:20.314370 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:46:20.314370 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:46:20.314370 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:46:20.314370 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:46:20.314370 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:46:20.314370 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:46:20.314370 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:46:20.314370 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:46:20.314370 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:46:20.314370 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1db2318e-9ac7-4994-8daa-14ae22537d5d could not be found. Oct 27 03:46:20.314370 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:46:20.314370 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:46:20.333438 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:46:20.333438 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:46:20.333438 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:46:20.333438 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:46:20.333438 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:46:20.333438 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:46:20.333438 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1db2318e-9ac7-4994-8daa-14ae22537d5d could not be found. Oct 27 03:46:20.333438 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:46:20.333438 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-090494de-c0d4-4a32-ae38-60a0bbbd7f29 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Returning 404 to user: Instance 1db2318e-9ac7-4994-8daa-14ae22537d5d could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:46:20.333438 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-090494de-c0d4-4a32-ae38-60a0bbbd7f29 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d" status: 404 len: 111 microversion: 2.20 time: 0.148021 Oct 27 03:46:20.333438 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2991/5690] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:46:20 2022] GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d => generated 111 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 03:46:20.336157 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-90e0d077-0a79-48f0-a337-f51b6b487d55 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '.version_select at 0x7f7ddab7a550>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:20.493325 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-90e0d077-0a79-48f0-a337-f51b6b487d55 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-609591935" status: 204 len: 0 microversion: 2.20 time: 0.164311 Oct 27 03:46:20.494595 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2992/5691] 10.222.0.20 () {60 vars in 1259 bytes} [Thu Oct 27 03:46:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-609591935 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 27 03:46:20.655893 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8a67c6df-682d-4f28-9b98-3b99d3751dc4 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:20.656539 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8a67c6df-682d-4f28-9b98-3b99d3751dc4 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 18be006a-739d-4fe2-a04d-1db382b4aeeb] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:20.672526 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8a67c6df-682d-4f28-9b98-3b99d3751dc4 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:20.673032 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8a67c6df-682d-4f28-9b98-3b99d3751dc4 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:20.673480 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8a67c6df-682d-4f28-9b98-3b99d3751dc4 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:20.674231 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8a67c6df-682d-4f28-9b98-3b99d3751dc4 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:20.674690 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8a67c6df-682d-4f28-9b98-3b99d3751dc4 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:20.675121 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8a67c6df-682d-4f28-9b98-3b99d3751dc4 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:20.830271 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8a67c6df-682d-4f28-9b98-3b99d3751dc4 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:20.845666 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8a67c6df-682d-4f28-9b98-3b99d3751dc4 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/18be006a-739d-4fe2-a04d-1db382b4aeeb" status: 200 len: 1465 microversion: 2.1 time: 0.194573 Oct 27 03:46:20.867212 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2993/5692] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:46:20 2022] GET /compute/v2.1/servers/18be006a-739d-4fe2-a04d-1db382b4aeeb => generated 1465 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:46:21.036235 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-02168460-f8c0-4324-ae3a-72bdeeaf1068 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:21.049762 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-02168460-f8c0-4324-ae3a-72bdeeaf1068 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c" status: 200 len: 1507 microversion: 2.1 time: 0.866145 Oct 27 03:46:21.050408 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2700/5693] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:46:20 2022] GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c => generated 1507 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:46:21.204094 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0cd70c52-4a11-4f24-ad10-32e5b822d6ba tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:21.205093 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0cd70c52-4a11-4f24-ad10-32e5b822d6ba tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] [instance: aadb6c19-2ed0-412f-a666-72a64b56c4ec] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:21.223114 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-16f3c976-8971-4122-a767-4bd020c293ee req-fb9839ac-4140-4b19-a5f0-2915cf97c279 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18be006a-739d-4fe2-a04d-1db382b4aeeb", "name": "network-vif-deleted", "tag": "1232f5e9-8a21-488d-b0b7-38aaec3f0008"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:46:21.226886 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0cd70c52-4a11-4f24-ad10-32e5b822d6ba tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:21.227728 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0cd70c52-4a11-4f24-ad10-32e5b822d6ba tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:21.232936 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0cd70c52-4a11-4f24-ad10-32e5b822d6ba tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:21.235101 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-16f3c976-8971-4122-a767-4bd020c293ee req-fb9839ac-4140-4b19-a5f0-2915cf97c279 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:21.235451 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0cd70c52-4a11-4f24-ad10-32e5b822d6ba tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:21.235955 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0cd70c52-4a11-4f24-ad10-32e5b822d6ba tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:21.236484 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-16f3c976-8971-4122-a767-4bd020c293ee req-fb9839ac-4140-4b19-a5f0-2915cf97c279 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:21.237162 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-16f3c976-8971-4122-a767-4bd020c293ee req-fb9839ac-4140-4b19-a5f0-2915cf97c279 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:21.238715 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0cd70c52-4a11-4f24-ad10-32e5b822d6ba tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:21.263766 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-16f3c976-8971-4122-a767-4bd020c293ee req-fb9839ac-4140-4b19-a5f0-2915cf97c279 service nova] Creating event network-vif-deleted:1232f5e9-8a21-488d-b0b7-38aaec3f0008 for instance 18be006a-739d-4fe2-a04d-1db382b4aeeb on n-h1-862769-1 Oct 27 03:46:21.272339 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-16f3c976-8971-4122-a767-4bd020c293ee req-fb9839ac-4140-4b19-a5f0-2915cf97c279 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053694 Oct 27 03:46:21.278448 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2701/5694] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:46:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:46:21.672895 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0cd70c52-4a11-4f24-ad10-32e5b822d6ba tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b983494c36da483d9f626522f74d9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc6a536b2f46b19fa2e6ab35917332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:21.683581 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0cd70c52-4a11-4f24-ad10-32e5b822d6ba tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] 10.222.0.20 "GET /compute/v2.1/servers/aadb6c19-2ed0-412f-a666-72a64b56c4ec" status: 200 len: 1324 microversion: 2.1 time: 0.492868 Oct 27 03:46:21.688328 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2994/5695] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:46:21 2022] GET /compute/v2.1/servers/aadb6c19-2ed0-412f-a666-72a64b56c4ec => generated 1324 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:46:21.894755 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a1cbcf6a-df9d-4758-88a5-404943f381d6 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:21.895865 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a1cbcf6a-df9d-4758-88a5-404943f381d6 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 18be006a-739d-4fe2-a04d-1db382b4aeeb] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:21.907278 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a1cbcf6a-df9d-4758-88a5-404943f381d6 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:21.908025 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a1cbcf6a-df9d-4758-88a5-404943f381d6 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:21.908821 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a1cbcf6a-df9d-4758-88a5-404943f381d6 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:21.909842 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a1cbcf6a-df9d-4758-88a5-404943f381d6 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:21.910598 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a1cbcf6a-df9d-4758-88a5-404943f381d6 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:21.911787 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a1cbcf6a-df9d-4758-88a5-404943f381d6 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:21.996873 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a1cbcf6a-df9d-4758-88a5-404943f381d6 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:22.006146 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a1cbcf6a-df9d-4758-88a5-404943f381d6 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/18be006a-739d-4fe2-a04d-1db382b4aeeb" status: 200 len: 1465 microversion: 2.1 time: 0.128541 Oct 27 03:46:22.006750 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2702/5696] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:46:21 2022] GET /compute/v2.1/servers/18be006a-739d-4fe2-a04d-1db382b4aeeb => generated 1465 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:46:22.084858 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b1f33b57-8b22-4923-8d78-0175a6412010 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:22.085487 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b1f33b57-8b22-4923-8d78-0175a6412010 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: c9e02344-a91a-40c8-b8c0-c0abe503204c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:22.096034 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b1f33b57-8b22-4923-8d78-0175a6412010 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:22.100725 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b1f33b57-8b22-4923-8d78-0175a6412010 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:22.100725 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b1f33b57-8b22-4923-8d78-0175a6412010 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:22.100725 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b1f33b57-8b22-4923-8d78-0175a6412010 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:22.100725 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b1f33b57-8b22-4923-8d78-0175a6412010 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:22.100725 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b1f33b57-8b22-4923-8d78-0175a6412010 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:22.310728 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b1f33b57-8b22-4923-8d78-0175a6412010 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:22.320526 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b1f33b57-8b22-4923-8d78-0175a6412010 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c" status: 200 len: 1507 microversion: 2.1 time: 0.242400 Oct 27 03:46:22.327229 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2995/5697] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:46:22 2022] GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c => generated 1507 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:46:22.373430 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-6d42abde-41e0-4594-8b77-be075bcbb330 req-7a7b2a08-ce3f-40a5-9101-4721bdac7ef6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aadb6c19-2ed0-412f-a666-72a64b56c4ec", "name": "network-vif-plugged", "status": "completed", "tag": "59efc190-82eb-4453-8d3b-d1283e07d44d"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:46:22.384421 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-6d42abde-41e0-4594-8b77-be075bcbb330 req-7a7b2a08-ce3f-40a5-9101-4721bdac7ef6 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:22.385035 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-6d42abde-41e0-4594-8b77-be075bcbb330 req-7a7b2a08-ce3f-40a5-9101-4721bdac7ef6 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:22.385478 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-6d42abde-41e0-4594-8b77-be075bcbb330 req-7a7b2a08-ce3f-40a5-9101-4721bdac7ef6 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:22.398209 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-6d42abde-41e0-4594-8b77-be075bcbb330 req-7a7b2a08-ce3f-40a5-9101-4721bdac7ef6 service nova] Creating event network-vif-plugged:59efc190-82eb-4453-8d3b-d1283e07d44d for instance aadb6c19-2ed0-412f-a666-72a64b56c4ec on n-h2-862769-1 Oct 27 03:46:22.403272 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-6d42abde-41e0-4594-8b77-be075bcbb330 req-7a7b2a08-ce3f-40a5-9101-4721bdac7ef6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035192 Oct 27 03:46:22.403882 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2703/5698] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:46:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:46:22.708892 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a8cef9be-b3b2-4697-89db-aba28ac7d712 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:22.709519 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a8cef9be-b3b2-4697-89db-aba28ac7d712 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] [instance: aadb6c19-2ed0-412f-a666-72a64b56c4ec] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:22.724644 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a8cef9be-b3b2-4697-89db-aba28ac7d712 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:22.725141 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a8cef9be-b3b2-4697-89db-aba28ac7d712 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:22.725784 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a8cef9be-b3b2-4697-89db-aba28ac7d712 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:22.726745 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a8cef9be-b3b2-4697-89db-aba28ac7d712 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:22.727380 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a8cef9be-b3b2-4697-89db-aba28ac7d712 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:22.728199 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a8cef9be-b3b2-4697-89db-aba28ac7d712 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:22.977823 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a8cef9be-b3b2-4697-89db-aba28ac7d712 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b983494c36da483d9f626522f74d9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc6a536b2f46b19fa2e6ab35917332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:22.986919 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a8cef9be-b3b2-4697-89db-aba28ac7d712 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] 10.222.0.20 "GET /compute/v2.1/servers/aadb6c19-2ed0-412f-a666-72a64b56c4ec" status: 200 len: 1324 microversion: 2.1 time: 0.281665 Oct 27 03:46:22.987309 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2996/5699] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:46:22 2022] GET /compute/v2.1/servers/aadb6c19-2ed0-412f-a666-72a64b56c4ec => generated 1324 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:46:23.033261 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d3ed145c-818f-4d00-9311-0a6e4291b13d tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:23.034173 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d3ed145c-818f-4d00-9311-0a6e4291b13d tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 18be006a-739d-4fe2-a04d-1db382b4aeeb] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:23.045484 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d3ed145c-818f-4d00-9311-0a6e4291b13d tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:23.052160 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d3ed145c-818f-4d00-9311-0a6e4291b13d tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:23.060042 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d3ed145c-818f-4d00-9311-0a6e4291b13d tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:23.061789 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d3ed145c-818f-4d00-9311-0a6e4291b13d tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:23.063460 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d3ed145c-818f-4d00-9311-0a6e4291b13d tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:23.064368 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d3ed145c-818f-4d00-9311-0a6e4291b13d tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:23.136505 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d3ed145c-818f-4d00-9311-0a6e4291b13d tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:23.137892 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d3ed145c-818f-4d00-9311-0a6e4291b13d tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:23.139127 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d3ed145c-818f-4d00-9311-0a6e4291b13d tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:23.140596 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-d3ed145c-818f-4d00-9311-0a6e4291b13d tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lazy-loading 'fault' on Instance uuid 18be006a-739d-4fe2-a04d-1db382b4aeeb {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:46:23.348905 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-164aa1a8-a928-459f-8ddd-7ae045d7da39 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:23.350062 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-164aa1a8-a928-459f-8ddd-7ae045d7da39 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: c9e02344-a91a-40c8-b8c0-c0abe503204c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:23.357717 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-164aa1a8-a928-459f-8ddd-7ae045d7da39 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:23.358558 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-164aa1a8-a928-459f-8ddd-7ae045d7da39 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:23.359258 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-164aa1a8-a928-459f-8ddd-7ae045d7da39 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:23.360251 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-164aa1a8-a928-459f-8ddd-7ae045d7da39 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:23.360921 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-164aa1a8-a928-459f-8ddd-7ae045d7da39 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:23.361554 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-164aa1a8-a928-459f-8ddd-7ae045d7da39 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:23.460929 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-164aa1a8-a928-459f-8ddd-7ae045d7da39 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:23.464694 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:23.476036 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-164aa1a8-a928-459f-8ddd-7ae045d7da39 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c" status: 200 len: 1465 microversion: 2.1 time: 0.129766 Oct 27 03:46:23.486565 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2997/5700] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:46:23 2022] GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c => generated 1465 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:46:23.649689 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-dfb6a557-2a8a-4bbc-971b-1a47e5d83921 req-aaf7dde2-d92e-4a9e-9f13-3670b7d5b3ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9e02344-a91a-40c8-b8c0-c0abe503204c", "name": "network-vif-deleted", "tag": "e157ee23-ea0e-4581-bdfe-c2587fb6895a"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:46:23.663457 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-dfb6a557-2a8a-4bbc-971b-1a47e5d83921 req-aaf7dde2-d92e-4a9e-9f13-3670b7d5b3ad service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:23.670006 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-dfb6a557-2a8a-4bbc-971b-1a47e5d83921 req-aaf7dde2-d92e-4a9e-9f13-3670b7d5b3ad service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:23.670669 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-dfb6a557-2a8a-4bbc-971b-1a47e5d83921 req-aaf7dde2-d92e-4a9e-9f13-3670b7d5b3ad service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:23.702543 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-dfb6a557-2a8a-4bbc-971b-1a47e5d83921 req-aaf7dde2-d92e-4a9e-9f13-3670b7d5b3ad service nova] Creating event network-vif-deleted:e157ee23-ea0e-4581-bdfe-c2587fb6895a for instance c9e02344-a91a-40c8-b8c0-c0abe503204c on n-h1-862769-1 Oct 27 03:46:23.715782 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-dfb6a557-2a8a-4bbc-971b-1a47e5d83921 req-aaf7dde2-d92e-4a9e-9f13-3670b7d5b3ad service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070431 Oct 27 03:46:23.718586 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2998/5701] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:46:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:46:24.012179 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7344ae38-ead0-44da-aa2c-3d38da388858 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:24.015079 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7344ae38-ead0-44da-aa2c-3d38da388858 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] [instance: aadb6c19-2ed0-412f-a666-72a64b56c4ec] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:24.024446 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7344ae38-ead0-44da-aa2c-3d38da388858 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:24.027408 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7344ae38-ead0-44da-aa2c-3d38da388858 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:24.027408 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7344ae38-ead0-44da-aa2c-3d38da388858 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:24.027408 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7344ae38-ead0-44da-aa2c-3d38da388858 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:24.027408 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7344ae38-ead0-44da-aa2c-3d38da388858 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:24.027408 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7344ae38-ead0-44da-aa2c-3d38da388858 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:24.208288 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d3ed145c-818f-4d00-9311-0a6e4291b13d tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:24.217417 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d3ed145c-818f-4d00-9311-0a6e4291b13d tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/18be006a-739d-4fe2-a04d-1db382b4aeeb" status: 200 len: 1310 microversion: 2.1 time: 1.189758 Oct 27 03:46:24.241055 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2704/5702] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:46:23 2022] GET /compute/v2.1/servers/18be006a-739d-4fe2-a04d-1db382b4aeeb => generated 1310 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:46:24.247212 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7344ae38-ead0-44da-aa2c-3d38da388858 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b983494c36da483d9f626522f74d9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc6a536b2f46b19fa2e6ab35917332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:24.256027 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7344ae38-ead0-44da-aa2c-3d38da388858 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] 10.222.0.20 "GET /compute/v2.1/servers/aadb6c19-2ed0-412f-a666-72a64b56c4ec" status: 200 len: 1520 microversion: 2.1 time: 0.247977 Oct 27 03:46:24.256717 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 2999/5703] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:46:24 2022] GET /compute/v2.1/servers/aadb6c19-2ed0-412f-a666-72a64b56c4ec => generated 1520 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:46:24.282916 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c78f8770-2868-4f5e-af8f-810b68a364b3 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:24.283605 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c78f8770-2868-4f5e-af8f-810b68a364b3 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] [instance: aadb6c19-2ed0-412f-a666-72a64b56c4ec] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:24.290283 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c78f8770-2868-4f5e-af8f-810b68a364b3 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:24.291016 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c78f8770-2868-4f5e-af8f-810b68a364b3 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:24.291545 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c78f8770-2868-4f5e-af8f-810b68a364b3 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:24.292341 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c78f8770-2868-4f5e-af8f-810b68a364b3 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:24.292892 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c78f8770-2868-4f5e-af8f-810b68a364b3 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:24.293399 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c78f8770-2868-4f5e-af8f-810b68a364b3 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:24.328107 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-c78f8770-2868-4f5e-af8f-810b68a364b3 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] HTTP exception thrown: Action 999 not found Oct 27 03:46:24.337676 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c78f8770-2868-4f5e-af8f-810b68a364b3 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Request method failure captured: Oct 27 03:46:24.337676 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/aadb6c19-2ed0-412f-a666-72a64b56c4ec/os-instance-actions/999 HTTP/1.1 Oct 27 03:46:24.337676 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:46:24.337676 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:46:24.337676 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:46:24.337676 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:46:24.337676 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:46:24.337676 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:46:24.337676 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:46:24.337676 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:46:24.337676 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWf77EOaSeha1CgQ7SU0dKDupyJqZpJ-EPrF-2rZYI8oEOmMsVRKcK_3nF7aItGSUcFo3ZSUPMn9p8qu3WFckuCpMqESxIckC6UPMCJU_LaFemEHNYmcGLki94ii6MZ4f_sKNb6qvMTC0n5JqUiFB6-dNO7AqdptVQCM2w7T8a4lMZX8 Oct 27 03:46:24.337676 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:46:24.337676 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:46:24.337676 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:46:24.337676 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:46:24.337676 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:46:24.337676 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:46:24.337676 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 63fc6a536b2f46b19fa2e6ab35917332 Oct 27 03:46:24.337676 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-755445399 Oct 27 03:46:24.337676 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:46:24.337676 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:46:24.337676 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/63fc6a536b2f46b19fa2e6ab35917332"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/63fc6a536b2f46b19fa2e6ab35917332"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/63fc6a536b2f46b19fa2e6ab35917332"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_63fc6a536b2f46b19fa2e6ab35917332"}]}] Oct 27 03:46:24.337676 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-755445399 Oct 27 03:46:24.337676 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 63fc6a536b2f46b19fa2e6ab35917332 Oct 27 03:46:24.337676 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-755445399 Oct 27 03:46:24.337676 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-InstanceActionsNegativeTestJSON-755445399-project Oct 27 03:46:24.337676 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:46:24.337676 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:46:24.337676 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: b983494c36da483d9f626522f74d9963 Oct 27 03:46:24.337676 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-755445399-project Oct 27 03:46:24.337676 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:46:24.337676 n-d-862769-1 devstack@n-api.service[121000]: exception: Action 999 not found Oct 27 03:46:24.337676 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'server_id': 'aadb6c19-2ed0-412f-a666-72a64b56c4ec', 'id': '999'} Oct 27 03:46:24.337676 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:46:24.337676 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:46:24.337676 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:46:24.337676 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:46:24.337676 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:46:24.337676 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:46:24.337676 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:46:24.337676 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:46:24.337676 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Oct 27 03:46:24.337676 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 27 03:46:24.337676 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Oct 27 03:46:24.337676 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:46:24.337676 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:46:24.337676 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:46:24.337676 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:46:24.337676 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:46:24.337676 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:46:24.337676 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:46:24.337676 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:46:24.337676 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Oct 27 03:46:24.337676 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:46:24.342368 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c78f8770-2868-4f5e-af8f-810b68a364b3 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Returning 404 to user: Action 999 not found {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:46:24.342368 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c78f8770-2868-4f5e-af8f-810b68a364b3 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] 10.222.0.20 "GET /compute/v2.1/servers/aadb6c19-2ed0-412f-a666-72a64b56c4ec/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.061742 Oct 27 03:46:24.342368 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2705/5704] 10.222.0.20 () {58 vars in 1308 bytes} [Thu Oct 27 03:46:24 2022] GET /compute/v2.1/servers/aadb6c19-2ed0-412f-a666-72a64b56c4ec/os-instance-actions/999 => generated 66 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 03:46:24.351454 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-26631461-50a7-4d6b-86df-d7edb73cde31 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Calling method '.version_select at 0x7f7dd96f8940>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:24.352062 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-26631461-50a7-4d6b-86df-d7edb73cde31 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] [instance: 2ffda5e1-cb1b-46dd-86aa-ae02fbca290b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:24.358952 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-26631461-50a7-4d6b-86df-d7edb73cde31 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] HTTP exception thrown: Instance 2ffda5e1-cb1b-46dd-86aa-ae02fbca290b could not be found. Oct 27 03:46:24.361494 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-26631461-50a7-4d6b-86df-d7edb73cde31 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Request method failure captured: Oct 27 03:46:24.361494 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/2ffda5e1-cb1b-46dd-86aa-ae02fbca290b/os-instance-actions HTTP/1.1 Oct 27 03:46:24.361494 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:46:24.361494 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:46:24.361494 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:46:24.361494 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:46:24.361494 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:46:24.361494 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:46:24.361494 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:46:24.361494 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:46:24.361494 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWf77EOaSeha1CgQ7SU0dKDupyJqZpJ-EPrF-2rZYI8oEOmMsVRKcK_3nF7aItGSUcFo3ZSUPMn9p8qu3WFckuCpMqESxIckC6UPMCJU_LaFemEHNYmcGLki94ii6MZ4f_sKNb6qvMTC0n5JqUiFB6-dNO7AqdptVQCM2w7T8a4lMZX8 Oct 27 03:46:24.361494 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:46:24.361494 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:46:24.361494 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:46:24.361494 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:46:24.361494 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:46:24.361494 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:46:24.361494 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 63fc6a536b2f46b19fa2e6ab35917332 Oct 27 03:46:24.361494 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-755445399 Oct 27 03:46:24.361494 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:46:24.361494 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:46:24.361494 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/63fc6a536b2f46b19fa2e6ab35917332"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/63fc6a536b2f46b19fa2e6ab35917332"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/63fc6a536b2f46b19fa2e6ab35917332"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_63fc6a536b2f46b19fa2e6ab35917332"}]}] Oct 27 03:46:24.361494 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-755445399 Oct 27 03:46:24.361494 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 63fc6a536b2f46b19fa2e6ab35917332 Oct 27 03:46:24.361494 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-755445399 Oct 27 03:46:24.361494 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-InstanceActionsNegativeTestJSON-755445399-project Oct 27 03:46:24.361494 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:46:24.361494 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:46:24.361494 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: b983494c36da483d9f626522f74d9963 Oct 27 03:46:24.361494 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-755445399-project Oct 27 03:46:24.361494 n-d-862769-1 devstack@n-api.service[121001]: method: Oct 27 03:46:24.361494 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 2ffda5e1-cb1b-46dd-86aa-ae02fbca290b could not be found. Oct 27 03:46:24.361494 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'server_id': '2ffda5e1-cb1b-46dd-86aa-ae02fbca290b'} Oct 27 03:46:24.361494 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:46:24.361494 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:46:24.361494 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:46:24.361494 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:46:24.361494 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:46:24.361494 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:46:24.361494 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 03:46:24.361494 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 03:46:24.361494 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ffda5e1-cb1b-46dd-86aa-ae02fbca290b could not be found. Oct 27 03:46:24.361494 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:46:24.361494 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:46:24.361494 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:46:24.361494 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:46:24.361494 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:46:24.361494 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:46:24.361494 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:46:24.361494 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:46:24.361494 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:46:24.361494 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:46:24.361494 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:46:24.361494 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:46:24.361494 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Oct 27 03:46:24.361494 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Oct 27 03:46:24.361494 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:46:24.361494 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:46:24.361494 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Oct 27 03:46:24.361494 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Oct 27 03:46:24.361494 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:46:24.361494 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:46:24.366373 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ffda5e1-cb1b-46dd-86aa-ae02fbca290b could not be found. Oct 27 03:46:24.366373 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:46:24.366373 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:46:24.366373 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:46:24.366373 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:46:24.366373 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:46:24.366373 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:46:24.366373 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:46:24.366373 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:46:24.366373 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ffda5e1-cb1b-46dd-86aa-ae02fbca290b could not be found. Oct 27 03:46:24.366373 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:46:24.366373 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-26631461-50a7-4d6b-86df-d7edb73cde31 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Returning 404 to user: Instance 2ffda5e1-cb1b-46dd-86aa-ae02fbca290b could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:46:24.366373 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-26631461-50a7-4d6b-86df-d7edb73cde31 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] 10.222.0.20 "GET /compute/v2.1/servers/2ffda5e1-cb1b-46dd-86aa-ae02fbca290b/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.016298 Oct 27 03:46:24.366373 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3000/5705] 10.222.0.20 () {58 vars in 1296 bytes} [Thu Oct 27 03:46:24 2022] GET /compute/v2.1/servers/2ffda5e1-cb1b-46dd-86aa-ae02fbca290b/os-instance-actions => generated 111 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:46:24.374697 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-744b4795-1986-4c30-9117-53155b27467e tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:24.376310 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-744b4795-1986-4c30-9117-53155b27467e tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] [instance: aadb6c19-2ed0-412f-a666-72a64b56c4ec] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:24.386828 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-744b4795-1986-4c30-9117-53155b27467e tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:24.387584 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-744b4795-1986-4c30-9117-53155b27467e tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:24.388108 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-744b4795-1986-4c30-9117-53155b27467e tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:24.389018 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-744b4795-1986-4c30-9117-53155b27467e tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:24.389565 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-744b4795-1986-4c30-9117-53155b27467e tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:24.390093 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-744b4795-1986-4c30-9117-53155b27467e tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:24.428390 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-744b4795-1986-4c30-9117-53155b27467e tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] [instance: aadb6c19-2ed0-412f-a666-72a64b56c4ec] Going to try to terminate instance {{(pid=121000) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:46:24.501678 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a0649492-51c3-457e-a989-da8c3580cbd4 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:24.502502 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a0649492-51c3-457e-a989-da8c3580cbd4 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: c9e02344-a91a-40c8-b8c0-c0abe503204c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:24.510115 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a0649492-51c3-457e-a989-da8c3580cbd4 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:24.511091 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a0649492-51c3-457e-a989-da8c3580cbd4 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:24.511726 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a0649492-51c3-457e-a989-da8c3580cbd4 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:24.512543 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a0649492-51c3-457e-a989-da8c3580cbd4 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:24.513080 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a0649492-51c3-457e-a989-da8c3580cbd4 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:24.513580 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a0649492-51c3-457e-a989-da8c3580cbd4 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:24.549360 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a0649492-51c3-457e-a989-da8c3580cbd4 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:24.549888 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a0649492-51c3-457e-a989-da8c3580cbd4 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:24.550465 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a0649492-51c3-457e-a989-da8c3580cbd4 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:24.551152 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-a0649492-51c3-457e-a989-da8c3580cbd4 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lazy-loading 'fault' on Instance uuid c9e02344-a91a-40c8-b8c0-c0abe503204c {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:46:24.609108 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a0649492-51c3-457e-a989-da8c3580cbd4 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:24.618077 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a0649492-51c3-457e-a989-da8c3580cbd4 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c" status: 200 len: 1311 microversion: 2.1 time: 0.121185 Oct 27 03:46:24.622237 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3001/5706] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:46:24 2022] GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c => generated 1311 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:46:24.832095 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-744b4795-1986-4c30-9117-53155b27467e tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] 10.222.0.20 "DELETE /compute/v2.1/servers/aadb6c19-2ed0-412f-a666-72a64b56c4ec" status: 204 len: 0 microversion: 2.1 time: 0.461160 Oct 27 03:46:24.833061 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2706/5707] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:46:24 2022] DELETE /compute/v2.1/servers/aadb6c19-2ed0-412f-a666-72a64b56c4ec => generated 0 bytes in 463 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:46:24.842168 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-718a2596-ba2d-401d-bd69-f27d0a8b9d8b tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:24.842869 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-718a2596-ba2d-401d-bd69-f27d0a8b9d8b tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] [instance: aadb6c19-2ed0-412f-a666-72a64b56c4ec] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:24.852736 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-718a2596-ba2d-401d-bd69-f27d0a8b9d8b tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:24.853239 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-718a2596-ba2d-401d-bd69-f27d0a8b9d8b tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:24.853689 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-718a2596-ba2d-401d-bd69-f27d0a8b9d8b tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:24.854431 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-718a2596-ba2d-401d-bd69-f27d0a8b9d8b tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:24.855081 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-718a2596-ba2d-401d-bd69-f27d0a8b9d8b tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:24.855727 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-718a2596-ba2d-401d-bd69-f27d0a8b9d8b tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:25.056255 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-718a2596-ba2d-401d-bd69-f27d0a8b9d8b tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b983494c36da483d9f626522f74d9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc6a536b2f46b19fa2e6ab35917332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:25.068081 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-718a2596-ba2d-401d-bd69-f27d0a8b9d8b tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] 10.222.0.20 "GET /compute/v2.1/servers/aadb6c19-2ed0-412f-a666-72a64b56c4ec" status: 200 len: 1526 microversion: 2.1 time: 0.230472 Oct 27 03:46:25.071783 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3002/5708] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:46:24 2022] GET /compute/v2.1/servers/aadb6c19-2ed0-412f-a666-72a64b56c4ec => generated 1526 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:46:25.245952 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9d4e858a-5444-4d53-ae40-736d23831757 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:25.246795 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9d4e858a-5444-4d53-ae40-736d23831757 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 18be006a-739d-4fe2-a04d-1db382b4aeeb] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:25.262786 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9d4e858a-5444-4d53-ae40-736d23831757 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:25.264397 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9d4e858a-5444-4d53-ae40-736d23831757 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:25.266805 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9d4e858a-5444-4d53-ae40-736d23831757 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:25.267833 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9d4e858a-5444-4d53-ae40-736d23831757 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:25.269360 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9d4e858a-5444-4d53-ae40-736d23831757 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:25.269934 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9d4e858a-5444-4d53-ae40-736d23831757 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:25.286410 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-9d4e858a-5444-4d53-ae40-736d23831757 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] HTTP exception thrown: Instance 18be006a-739d-4fe2-a04d-1db382b4aeeb could not be found. Oct 27 03:46:25.288162 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9d4e858a-5444-4d53-ae40-736d23831757 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Request method failure captured: Oct 27 03:46:25.288162 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/18be006a-739d-4fe2-a04d-1db382b4aeeb HTTP/1.1 Oct 27 03:46:25.288162 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:46:25.288162 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:46:25.288162 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:46:25.288162 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:46:25.288162 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:46:25.288162 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:46:25.288162 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:46:25.288162 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:46:25.288162 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWf7ao454EXpcvqw57oZ6kUl55rrrabqqRcgdR7_bXGBd3EhUlwYyYuxAfl-nrBiMviq2ipmr2mbr4b0cgBTMbKDOZJ9TP7cenW0zaGDKmMe2aswh3Oogol3Ct9m8LHYZYqPWmhLSqvB2K7fCZP-q-SBCjWA9jL7HEZxBqgIhBaRnNcs Oct 27 03:46:25.288162 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:46:25.288162 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:46:25.288162 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:46:25.288162 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:46:25.288162 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:46:25.288162 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:46:25.288162 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 86b90d4cb5eb42958248b6f82516ce19 Oct 27 03:46:25.288162 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ServersTestJSON-1724631621 Oct 27 03:46:25.288162 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:46:25.288162 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:46:25.288162 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86b90d4cb5eb42958248b6f82516ce19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/86b90d4cb5eb42958248b6f82516ce19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86b90d4cb5eb42958248b6f82516ce19"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_86b90d4cb5eb42958248b6f82516ce19"}]}] Oct 27 03:46:25.288162 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ServersTestJSON-1724631621 Oct 27 03:46:25.288162 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 86b90d4cb5eb42958248b6f82516ce19 Oct 27 03:46:25.288162 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ServersTestJSON-1724631621 Oct 27 03:46:25.288162 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ServersTestJSON-1724631621-project Oct 27 03:46:25.288162 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:46:25.288162 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:46:25.288162 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: ca2da57f02884a968d685b53a5399e46 Oct 27 03:46:25.288162 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ServersTestJSON-1724631621-project Oct 27 03:46:25.288162 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:46:25.288162 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 18be006a-739d-4fe2-a04d-1db382b4aeeb could not be found. Oct 27 03:46:25.288162 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '18be006a-739d-4fe2-a04d-1db382b4aeeb'} Oct 27 03:46:25.288162 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:46:25.288162 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:46:25.288162 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:46:25.288162 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:46:25.288162 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:46:25.288162 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:46:25.288162 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:46:25.288162 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:46:25.288162 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:46:25.288162 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:46:25.288162 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18be006a-739d-4fe2-a04d-1db382b4aeeb could not be found. Oct 27 03:46:25.288162 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:46:25.288162 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:46:25.288162 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:46:25.288162 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:46:25.288162 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:46:25.288162 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:46:25.288162 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:46:25.288162 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:46:25.288162 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:46:25.288162 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:46:25.288162 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:46:25.288162 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:46:25.288162 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:46:25.288162 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:46:25.288162 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:46:25.288162 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:46:25.288162 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18be006a-739d-4fe2-a04d-1db382b4aeeb could not be found. Oct 27 03:46:25.288162 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:46:25.288162 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:46:25.288162 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:46:25.292603 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:46:25.292603 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:46:25.292603 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:46:25.292603 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:46:25.292603 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:46:25.292603 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18be006a-739d-4fe2-a04d-1db382b4aeeb could not be found. Oct 27 03:46:25.292603 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:46:25.294460 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9d4e858a-5444-4d53-ae40-736d23831757 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Returning 404 to user: Instance 18be006a-739d-4fe2-a04d-1db382b4aeeb could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:46:25.295863 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9d4e858a-5444-4d53-ae40-736d23831757 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/18be006a-739d-4fe2-a04d-1db382b4aeeb" status: 404 len: 111 microversion: 2.1 time: 0.054347 Oct 27 03:46:25.296958 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2707/5709] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:46:25 2022] GET /compute/v2.1/servers/18be006a-739d-4fe2-a04d-1db382b4aeeb => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:46:25.309969 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c251bc77-5cfa-4a1b-b7cb-f1a71d988631 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Action: 'create', calling method: .version_select at 0x7f7dda466820>, body: {"keypair": {"name": "tempest-key-1467740840", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNeJEK54lUyPvfYBM3pUma4zjtpdlt/qjf9ge/1acyoKk25oPC0LsXILGLZ8P/QY6DoaET6KlBCpq64ooggFlTKedTbo4KxiBErEQsyzlJMVbhVUfKkwMSzsZkgfwm3yCw=="}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:46:25.326048 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-c251bc77-5cfa-4a1b-b7cb-f1a71d988631 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Getting quotas for project 86b90d4cb5eb42958248b6f82516ce19. Resources: {'key_pairs'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:46:25.333635 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-c251bc77-5cfa-4a1b-b7cb-f1a71d988631 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Getting quotas for user ca2da57f02884a968d685b53a5399e46 and project 86b90d4cb5eb42958248b6f82516ce19. Resources: {'key_pairs'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:46:25.458988 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c251bc77-5cfa-4a1b-b7cb-f1a71d988631 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.152801 Oct 27 03:46:25.459614 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3003/5710] 10.222.0.20 () {60 vars in 1159 bytes} [Thu Oct 27 03:46:25 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:46:25.470144 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-25e9d940-c8ac-45be-aea1-5028ea76082a tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '.version_select at 0x7f7ddee06310>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:25.474081 n-d-862769-1 devstack@n-api.service[121000]: WARNING oslo_db.sqlalchemy.utils [None req-25e9d940-c8ac-45be-aea1-5028ea76082a tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 27 03:46:25.481366 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-25e9d940-c8ac-45be-aea1-5028ea76082a tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.012994 Oct 27 03:46:25.481366 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2708/5711] 10.222.0.20 () {58 vars in 1137 bytes} [Thu Oct 27 03:46:25 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:46:25.643787 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-46ebf54a-c7d4-43db-ab32-a44acb36e7c7 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:25.644718 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-46ebf54a-c7d4-43db-ab32-a44acb36e7c7 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: c9e02344-a91a-40c8-b8c0-c0abe503204c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:25.653146 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-46ebf54a-c7d4-43db-ab32-a44acb36e7c7 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:25.653676 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-46ebf54a-c7d4-43db-ab32-a44acb36e7c7 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:25.654598 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ae40ed19-72e6-4927-83a1-67411518fd42 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1534968880", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "key_name": "tempest-key-1467740840", "networks": [{"uuid": "6ad05158-ac44-4c49-b5d6-443f42165c93"}]}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:46:25.660165 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-46ebf54a-c7d4-43db-ab32-a44acb36e7c7 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:25.660165 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-46ebf54a-c7d4-43db-ab32-a44acb36e7c7 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:25.660165 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-46ebf54a-c7d4-43db-ab32-a44acb36e7c7 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:25.660165 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-46ebf54a-c7d4-43db-ab32-a44acb36e7c7 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:25.682583 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-46ebf54a-c7d4-43db-ab32-a44acb36e7c7 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] HTTP exception thrown: Instance c9e02344-a91a-40c8-b8c0-c0abe503204c could not be found. Oct 27 03:46:25.683366 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-46ebf54a-c7d4-43db-ab32-a44acb36e7c7 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Request method failure captured: Oct 27 03:46:25.683366 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c HTTP/1.1 Oct 27 03:46:25.683366 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:46:25.683366 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:46:25.683366 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:46:25.683366 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:46:25.683366 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:46:25.683366 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:46:25.683366 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:46:25.683366 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:46:25.683366 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWf3uUTnEN6JEj9qTF9cAY0BLnY-YCL30UQa3hBWeUb1dNx6UaDGQTlfRNfawcK1WUPI3AVcIhTKI_7viSsI0VCiS7DswtiywtZ-RbWwufMeio2Ivv3GBrhAaC4UKKUNrtl6wYtdRVU_yfZaWJd2e4jOiCo3IliQOw95nmGOg5mVlF04 Oct 27 03:46:25.683366 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:46:25.683366 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:46:25.683366 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:46:25.683366 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:46:25.683366 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:46:25.683366 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:46:25.683366 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: e1f3ed7ef6c648c9ac771fbaadde1d0c Oct 27 03:46:25.683366 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-143118573 Oct 27 03:46:25.683366 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:46:25.683366 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:46:25.683366 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e1f3ed7ef6c648c9ac771fbaadde1d0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e1f3ed7ef6c648c9ac771fbaadde1d0c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e1f3ed7ef6c648c9ac771fbaadde1d0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e1f3ed7ef6c648c9ac771fbaadde1d0c"}]}] Oct 27 03:46:25.683366 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServerRescueNegativeTestJSON-143118573 Oct 27 03:46:25.683366 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: e1f3ed7ef6c648c9ac771fbaadde1d0c Oct 27 03:46:25.683366 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-143118573 Oct 27 03:46:25.683366 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServerRescueNegativeTestJSON-143118573-project Oct 27 03:46:25.683366 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:46:25.683366 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:46:25.683366 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 43172c9e71704c869a25181574d67b35 Oct 27 03:46:25.683366 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServerRescueNegativeTestJSON-143118573-project Oct 27 03:46:25.683366 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:46:25.683366 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance c9e02344-a91a-40c8-b8c0-c0abe503204c could not be found. Oct 27 03:46:25.683366 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': 'c9e02344-a91a-40c8-b8c0-c0abe503204c'} Oct 27 03:46:25.683366 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:46:25.683366 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:46:25.683366 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:46:25.683366 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:46:25.683366 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:46:25.683366 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:46:25.683366 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:46:25.683366 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:46:25.683366 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:46:25.683366 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:46:25.683366 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9e02344-a91a-40c8-b8c0-c0abe503204c could not be found. Oct 27 03:46:25.683366 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:46:25.683366 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:46:25.683366 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:46:25.683366 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:46:25.683366 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:46:25.683366 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:46:25.683366 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:46:25.683366 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:46:25.683366 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:46:25.683366 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:46:25.683366 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:46:25.683366 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:46:25.683366 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:46:25.683366 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:46:25.683366 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:46:25.683366 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:46:25.683366 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9e02344-a91a-40c8-b8c0-c0abe503204c could not be found. Oct 27 03:46:25.683366 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:46:25.683366 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:46:25.692825 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:46:25.692825 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:46:25.692825 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:46:25.692825 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:46:25.692825 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:46:25.692825 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:46:25.692825 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9e02344-a91a-40c8-b8c0-c0abe503204c could not be found. Oct 27 03:46:25.692825 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:46:25.692825 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-46ebf54a-c7d4-43db-ab32-a44acb36e7c7 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Returning 404 to user: Instance c9e02344-a91a-40c8-b8c0-c0abe503204c could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:46:25.692825 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-46ebf54a-c7d4-43db-ab32-a44acb36e7c7 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c" status: 404 len: 111 microversion: 2.1 time: 0.045861 Oct 27 03:46:25.692825 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3004/5712] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:46:25 2022] GET /compute/v2.1/servers/c9e02344-a91a-40c8-b8c0-c0abe503204c => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:46:25.696124 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-cdef0f81-0254-442f-b51a-9c396ea0c6f5 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:25.696677 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-cdef0f81-0254-442f-b51a-9c396ea0c6f5 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: dda902a6-dcad-42bf-9b3c-ed716ea0af70] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:25.725359 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cdef0f81-0254-442f-b51a-9c396ea0c6f5 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:25.725937 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cdef0f81-0254-442f-b51a-9c396ea0c6f5 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:25.726520 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cdef0f81-0254-442f-b51a-9c396ea0c6f5 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:25.727341 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cdef0f81-0254-442f-b51a-9c396ea0c6f5 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:25.727879 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cdef0f81-0254-442f-b51a-9c396ea0c6f5 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:25.728384 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cdef0f81-0254-442f-b51a-9c396ea0c6f5 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:25.733014 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-ae40ed19-72e6-4927-83a1-67411518fd42 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] validate_networks() for [('6ad05158-ac44-4c49-b5d6-443f42165c93', None, None, None, None, None)] {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:46:25.759075 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-cdef0f81-0254-442f-b51a-9c396ea0c6f5 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: dda902a6-dcad-42bf-9b3c-ed716ea0af70] Going to try to terminate instance {{(pid=121001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:46:26.138713 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-cdef0f81-0254-442f-b51a-9c396ea0c6f5 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "DELETE /compute/v2.1/servers/dda902a6-dcad-42bf-9b3c-ed716ea0af70" status: 204 len: 0 microversion: 2.1 time: 0.444711 Oct 27 03:46:26.142466 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3005/5713] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:46:25 2022] DELETE /compute/v2.1/servers/dda902a6-dcad-42bf-9b3c-ed716ea0af70 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:46:26.156102 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f8878a7c-58a2-410b-8e7e-a58e206a4cc2 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:26.157700 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f8878a7c-58a2-410b-8e7e-a58e206a4cc2 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 1db2318e-9ac7-4994-8daa-14ae22537d5d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:26.175317 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f8878a7c-58a2-410b-8e7e-a58e206a4cc2 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:26.179655 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f8878a7c-58a2-410b-8e7e-a58e206a4cc2 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:26.179655 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f8878a7c-58a2-410b-8e7e-a58e206a4cc2 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:26.179655 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f8878a7c-58a2-410b-8e7e-a58e206a4cc2 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:26.179655 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f8878a7c-58a2-410b-8e7e-a58e206a4cc2 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:26.179655 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f8878a7c-58a2-410b-8e7e-a58e206a4cc2 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:26.273729 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-f8878a7c-58a2-410b-8e7e-a58e206a4cc2 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] HTTP exception thrown: Instance 1db2318e-9ac7-4994-8daa-14ae22537d5d could not be found. Oct 27 03:46:26.282153 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f8878a7c-58a2-410b-8e7e-a58e206a4cc2 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Request method failure captured: Oct 27 03:46:26.282153 n-d-862769-1 devstack@n-api.service[121001]: request: DELETE /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d HTTP/1.1 Oct 27 03:46:26.282153 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:46:26.282153 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:46:26.282153 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:46:26.282153 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:46:26.282153 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:46:26.282153 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:46:26.282153 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:46:26.282153 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:46:26.282153 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWf1tpBFEbkvSK3SqNKiaBdt2iU4VU0up94oX5h2-dwelsBTcOMjAbogxTF1m6837ADQrTcsoRLUG6fwb1i91GnLWdY1HiMrerSGB8x7h0qmRtRJ0xxks9W3iJabiTHs4YSYs5Sa938DRiTXN21ja7qe0GdEoHSxnnRlw0wNIOnjEc_c Oct 27 03:46:26.282153 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:46:26.282153 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:46:26.282153 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:46:26.282153 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:46:26.282153 n-d-862769-1 devstack@n-api.service[121001]: X-Openstack-Nova-Api-Version: 2.20 Oct 27 03:46:26.282153 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:46:26.282153 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:46:26.282153 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: c48bca00e4d445918f030bf885424b40 Oct 27 03:46:26.282153 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-186270836 Oct 27 03:46:26.282153 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:46:26.282153 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:46:26.282153 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c48bca00e4d445918f030bf885424b40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c48bca00e4d445918f030bf885424b40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c48bca00e4d445918f030bf885424b40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c48bca00e4d445918f030bf885424b40"}]}] Oct 27 03:46:26.282153 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-AttachVolumeShelveTestJSON-186270836 Oct 27 03:46:26.282153 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: c48bca00e4d445918f030bf885424b40 Oct 27 03:46:26.282153 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-186270836 Oct 27 03:46:26.282153 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-AttachVolumeShelveTestJSON-186270836-project Oct 27 03:46:26.282153 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:46:26.282153 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:46:26.282153 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: b74e8d6facd1460ab31a3ce4b24dd315 Oct 27 03:46:26.282153 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-AttachVolumeShelveTestJSON-186270836-project Oct 27 03:46:26.282153 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:46:26.282153 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 1db2318e-9ac7-4994-8daa-14ae22537d5d could not be found. Oct 27 03:46:26.282153 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '1db2318e-9ac7-4994-8daa-14ae22537d5d'} Oct 27 03:46:26.282153 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:46:26.282153 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:46:26.282153 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:46:26.282153 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:46:26.282153 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:46:26.282153 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:46:26.282153 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:46:26.282153 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:46:26.282153 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:46:26.282153 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:46:26.282153 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1db2318e-9ac7-4994-8daa-14ae22537d5d could not be found. Oct 27 03:46:26.282153 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:46:26.282153 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:46:26.282153 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:46:26.282153 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:46:26.282153 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:46:26.282153 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:46:26.282153 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:46:26.282153 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:46:26.282153 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:46:26.282153 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:46:26.282153 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 03:46:26.282153 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 03:46:26.282153 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 03:46:26.282153 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 03:46:26.282153 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:46:26.282153 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:46:26.282153 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:46:26.282153 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:46:26.287834 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1db2318e-9ac7-4994-8daa-14ae22537d5d could not be found. Oct 27 03:46:26.287834 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:46:26.287834 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:46:26.287834 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:46:26.287834 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:46:26.287834 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:46:26.287834 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:46:26.287834 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:46:26.287834 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:46:26.287834 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1db2318e-9ac7-4994-8daa-14ae22537d5d could not be found. Oct 27 03:46:26.287834 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:46:26.287834 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f8878a7c-58a2-410b-8e7e-a58e206a4cc2 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Returning 404 to user: Instance 1db2318e-9ac7-4994-8daa-14ae22537d5d could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:46:26.287834 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f8878a7c-58a2-410b-8e7e-a58e206a4cc2 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d" status: 404 len: 111 microversion: 2.20 time: 0.133319 Oct 27 03:46:26.287834 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3006/5714] 10.222.0.20 () {60 vars in 1280 bytes} [Thu Oct 27 03:46:26 2022] DELETE /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 03:46:26.296033 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-07cf6597-7f7f-4eb5-a2a7-c85dd540da5f tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:26.296662 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-07cf6597-7f7f-4eb5-a2a7-c85dd540da5f tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] [instance: aadb6c19-2ed0-412f-a666-72a64b56c4ec] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:26.330966 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-07cf6597-7f7f-4eb5-a2a7-c85dd540da5f tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:26.333676 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-07cf6597-7f7f-4eb5-a2a7-c85dd540da5f tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:26.333676 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-07cf6597-7f7f-4eb5-a2a7-c85dd540da5f tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:26.333676 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-07cf6597-7f7f-4eb5-a2a7-c85dd540da5f tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:26.333676 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-07cf6597-7f7f-4eb5-a2a7-c85dd540da5f tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:26.336390 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-07cf6597-7f7f-4eb5-a2a7-c85dd540da5f tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:26.338521 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-ae40ed19-72e6-4927-83a1-67411518fd42 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:46:26.339022 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-ae40ed19-72e6-4927-83a1-67411518fd42 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:46:26.340410 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-ae40ed19-72e6-4927-83a1-67411518fd42 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:46:26.341207 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-ae40ed19-72e6-4927-83a1-67411518fd42 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:46:26.342167 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-ae40ed19-72e6-4927-83a1-67411518fd42 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:46:26.356732 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ae40ed19-72e6-4927-83a1-67411518fd42 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:26.357248 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ae40ed19-72e6-4927-83a1-67411518fd42 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:26.357962 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ae40ed19-72e6-4927-83a1-67411518fd42 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:26.358925 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ae40ed19-72e6-4927-83a1-67411518fd42 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:26.359552 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ae40ed19-72e6-4927-83a1-67411518fd42 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:26.360779 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ae40ed19-72e6-4927-83a1-67411518fd42 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:26.387320 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-ae40ed19-72e6-4927-83a1-67411518fd42 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Getting quotas for project 86b90d4cb5eb42958248b6f82516ce19. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:46:26.395741 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-ae40ed19-72e6-4927-83a1-67411518fd42 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Getting quotas for user ca2da57f02884a968d685b53a5399e46 and project 86b90d4cb5eb42958248b6f82516ce19. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:46:26.414644 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ae40ed19-72e6-4927-83a1-67411518fd42 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:46:26.418612 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ae40ed19-72e6-4927-83a1-67411518fd42 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 3f9f103d-1fb5-4ff3-bf0c-86f8db514b03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:46:26.573958 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ae40ed19-72e6-4927-83a1-67411518fd42 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.924050 Oct 27 03:46:26.579212 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2709/5715] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:46:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 930 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 03:46:26.589602 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ddfa8f3d-c6b2-436e-bba5-9ef13915fa7b tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:26.603557 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ddfa8f3d-c6b2-436e-bba5-9ef13915fa7b tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: dda902a6-dcad-42bf-9b3c-ed716ea0af70] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:26.620538 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ddfa8f3d-c6b2-436e-bba5-9ef13915fa7b tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:26.621047 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ddfa8f3d-c6b2-436e-bba5-9ef13915fa7b tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:26.621487 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ddfa8f3d-c6b2-436e-bba5-9ef13915fa7b tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:26.629692 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-07cf6597-7f7f-4eb5-a2a7-c85dd540da5f tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b983494c36da483d9f626522f74d9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc6a536b2f46b19fa2e6ab35917332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:26.630206 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ddfa8f3d-c6b2-436e-bba5-9ef13915fa7b tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:26.630940 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ddfa8f3d-c6b2-436e-bba5-9ef13915fa7b tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:26.631763 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ddfa8f3d-c6b2-436e-bba5-9ef13915fa7b tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:26.643951 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-07cf6597-7f7f-4eb5-a2a7-c85dd540da5f tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] 10.222.0.20 "GET /compute/v2.1/servers/aadb6c19-2ed0-412f-a666-72a64b56c4ec" status: 200 len: 1526 microversion: 2.1 time: 0.352309 Oct 27 03:46:26.658437 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3007/5716] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:46:26 2022] GET /compute/v2.1/servers/aadb6c19-2ed0-412f-a666-72a64b56c4ec => generated 1526 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:46:26.658437 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-993bcf62-f5d7-4fac-bcf8-8aed35cc512b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:26.658437 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-993bcf62-f5d7-4fac-bcf8-8aed35cc512b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 1db2318e-9ac7-4994-8daa-14ae22537d5d] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:26.660542 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-993bcf62-f5d7-4fac-bcf8-8aed35cc512b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:26.661149 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-993bcf62-f5d7-4fac-bcf8-8aed35cc512b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:26.663649 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-993bcf62-f5d7-4fac-bcf8-8aed35cc512b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:26.664756 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-993bcf62-f5d7-4fac-bcf8-8aed35cc512b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:26.665454 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-993bcf62-f5d7-4fac-bcf8-8aed35cc512b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:26.666245 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-993bcf62-f5d7-4fac-bcf8-8aed35cc512b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:26.685505 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-993bcf62-f5d7-4fac-bcf8-8aed35cc512b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] HTTP exception thrown: Instance 1db2318e-9ac7-4994-8daa-14ae22537d5d could not be found. Oct 27 03:46:26.687499 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-993bcf62-f5d7-4fac-bcf8-8aed35cc512b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Request method failure captured: Oct 27 03:46:26.687499 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d HTTP/1.1 Oct 27 03:46:26.687499 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:46:26.687499 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:46:26.687499 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:46:26.687499 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:46:26.687499 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:46:26.687499 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:46:26.687499 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:46:26.687499 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:46:26.687499 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWf1tpBFEbkvSK3SqNKiaBdt2iU4VU0up94oX5h2-dwelsBTcOMjAbogxTF1m6837ADQrTcsoRLUG6fwb1i91GnLWdY1HiMrerSGB8x7h0qmRtRJ0xxks9W3iJabiTHs4YSYs5Sa938DRiTXN21ja7qe0GdEoHSxnnRlw0wNIOnjEc_c Oct 27 03:46:26.687499 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:46:26.687499 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:46:26.687499 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:46:26.687499 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:46:26.687499 n-d-862769-1 devstack@n-api.service[121001]: X-Openstack-Nova-Api-Version: 2.20 Oct 27 03:46:26.687499 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:46:26.687499 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:46:26.687499 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: c48bca00e4d445918f030bf885424b40 Oct 27 03:46:26.687499 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-186270836 Oct 27 03:46:26.687499 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:46:26.687499 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:46:26.687499 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c48bca00e4d445918f030bf885424b40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c48bca00e4d445918f030bf885424b40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c48bca00e4d445918f030bf885424b40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c48bca00e4d445918f030bf885424b40"}]}] Oct 27 03:46:26.687499 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-AttachVolumeShelveTestJSON-186270836 Oct 27 03:46:26.687499 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: c48bca00e4d445918f030bf885424b40 Oct 27 03:46:26.687499 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-186270836 Oct 27 03:46:26.687499 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-AttachVolumeShelveTestJSON-186270836-project Oct 27 03:46:26.687499 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:46:26.687499 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:46:26.687499 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: b74e8d6facd1460ab31a3ce4b24dd315 Oct 27 03:46:26.687499 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-AttachVolumeShelveTestJSON-186270836-project Oct 27 03:46:26.687499 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:46:26.687499 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 1db2318e-9ac7-4994-8daa-14ae22537d5d could not be found. Oct 27 03:46:26.687499 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '1db2318e-9ac7-4994-8daa-14ae22537d5d'} Oct 27 03:46:26.687499 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:46:26.687499 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:46:26.687499 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:46:26.687499 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:46:26.687499 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:46:26.687499 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:46:26.687499 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:46:26.687499 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:46:26.687499 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:46:26.687499 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:46:26.687499 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1db2318e-9ac7-4994-8daa-14ae22537d5d could not be found. Oct 27 03:46:26.687499 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:46:26.687499 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:46:26.687499 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:46:26.687499 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:46:26.687499 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:46:26.687499 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:46:26.687499 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:46:26.687499 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:46:26.687499 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:46:26.687499 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:46:26.687499 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:46:26.687499 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:46:26.687499 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:46:26.687499 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:46:26.687499 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:46:26.687499 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:46:26.687499 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1db2318e-9ac7-4994-8daa-14ae22537d5d could not be found. Oct 27 03:46:26.687499 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:46:26.687499 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:46:26.693874 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:46:26.693874 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:46:26.693874 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:46:26.693874 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:46:26.693874 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:46:26.693874 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:46:26.693874 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1db2318e-9ac7-4994-8daa-14ae22537d5d could not be found. Oct 27 03:46:26.693874 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:46:26.697630 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-993bcf62-f5d7-4fac-bcf8-8aed35cc512b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Returning 404 to user: Instance 1db2318e-9ac7-4994-8daa-14ae22537d5d could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:46:26.698703 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-993bcf62-f5d7-4fac-bcf8-8aed35cc512b tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d" status: 404 len: 111 microversion: 2.20 time: 0.052896 Oct 27 03:46:26.703093 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3008/5717] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:46:26 2022] GET /compute/v2.1/servers/1db2318e-9ac7-4994-8daa-14ae22537d5d => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 03:46:26.712567 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-db6d3000-44a0-4247-9ff7-9a4fc7556721 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:26.713453 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-db6d3000-44a0-4247-9ff7-9a4fc7556721 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 3f9f103d-1fb5-4ff3-bf0c-86f8db514b03] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:26.956740 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ddfa8f3d-c6b2-436e-bba5-9ef13915fa7b tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:26.968751 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ddfa8f3d-c6b2-436e-bba5-9ef13915fa7b tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/dda902a6-dcad-42bf-9b3c-ed716ea0af70" status: 200 len: 1522 microversion: 2.1 time: 0.388451 Oct 27 03:46:26.989701 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2710/5718] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:46:26 2022] GET /compute/v2.1/servers/dda902a6-dcad-42bf-9b3c-ed716ea0af70 => generated 1522 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:46:27.035095 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-db6d3000-44a0-4247-9ff7-9a4fc7556721 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:27.046802 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-db6d3000-44a0-4247-9ff7-9a4fc7556721 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/3f9f103d-1fb5-4ff3-bf0c-86f8db514b03" status: 200 len: 1229 microversion: 2.1 time: 0.340349 Oct 27 03:46:27.061915 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3009/5719] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:46:26 2022] GET /compute/v2.1/servers/3f9f103d-1fb5-4ff3-bf0c-86f8db514b03 => generated 1229 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:46:27.577181 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-3b6fd979-b067-4f4c-9531-6c83c71dcb6a req-d8f22472-078f-47c7-bdd2-d61ea7eb6183 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aadb6c19-2ed0-412f-a666-72a64b56c4ec", "name": "network-vif-deleted", "tag": "59efc190-82eb-4453-8d3b-d1283e07d44d"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:46:27.592566 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-3b6fd979-b067-4f4c-9531-6c83c71dcb6a req-d8f22472-078f-47c7-bdd2-d61ea7eb6183 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:27.595160 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-3b6fd979-b067-4f4c-9531-6c83c71dcb6a req-d8f22472-078f-47c7-bdd2-d61ea7eb6183 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:27.599692 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-3b6fd979-b067-4f4c-9531-6c83c71dcb6a req-d8f22472-078f-47c7-bdd2-d61ea7eb6183 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:27.627112 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-3b6fd979-b067-4f4c-9531-6c83c71dcb6a req-d8f22472-078f-47c7-bdd2-d61ea7eb6183 service nova] Creating event network-vif-deleted:59efc190-82eb-4453-8d3b-d1283e07d44d for instance aadb6c19-2ed0-412f-a666-72a64b56c4ec on n-h2-862769-1 Oct 27 03:46:27.638794 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-3b6fd979-b067-4f4c-9531-6c83c71dcb6a req-d8f22472-078f-47c7-bdd2-d61ea7eb6183 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063998 Oct 27 03:46:27.645664 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2711/5720] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:46:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:46:27.675998 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8a99b462-a0a4-4f81-947b-d761b620a988 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:27.676618 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8a99b462-a0a4-4f81-947b-d761b620a988 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] [instance: aadb6c19-2ed0-412f-a666-72a64b56c4ec] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:27.688498 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8a99b462-a0a4-4f81-947b-d761b620a988 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:27.689007 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8a99b462-a0a4-4f81-947b-d761b620a988 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:27.689447 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8a99b462-a0a4-4f81-947b-d761b620a988 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:27.690193 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8a99b462-a0a4-4f81-947b-d761b620a988 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:27.690655 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8a99b462-a0a4-4f81-947b-d761b620a988 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:27.691254 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8a99b462-a0a4-4f81-947b-d761b620a988 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:27.818760 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8a99b462-a0a4-4f81-947b-d761b620a988 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b983494c36da483d9f626522f74d9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc6a536b2f46b19fa2e6ab35917332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:27.837901 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8a99b462-a0a4-4f81-947b-d761b620a988 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] 10.222.0.20 "GET /compute/v2.1/servers/aadb6c19-2ed0-412f-a666-72a64b56c4ec" status: 200 len: 1484 microversion: 2.1 time: 0.169167 Oct 27 03:46:27.839167 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3010/5721] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:46:27 2022] GET /compute/v2.1/servers/aadb6c19-2ed0-412f-a666-72a64b56c4ec => generated 1484 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:46:28.004777 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-babcea54-81cb-4d6a-917b-380a4390e6c6 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:28.005656 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-babcea54-81cb-4d6a-917b-380a4390e6c6 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: dda902a6-dcad-42bf-9b3c-ed716ea0af70] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:28.029506 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-babcea54-81cb-4d6a-917b-380a4390e6c6 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:28.045631 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-babcea54-81cb-4d6a-917b-380a4390e6c6 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:28.052536 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-babcea54-81cb-4d6a-917b-380a4390e6c6 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:28.056919 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-babcea54-81cb-4d6a-917b-380a4390e6c6 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:28.059914 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-babcea54-81cb-4d6a-917b-380a4390e6c6 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:28.060568 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-babcea54-81cb-4d6a-917b-380a4390e6c6 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:28.073061 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3df16b00-1a51-4c8b-9e1c-d211e0bc4ad7 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:28.074176 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3df16b00-1a51-4c8b-9e1c-d211e0bc4ad7 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 3f9f103d-1fb5-4ff3-bf0c-86f8db514b03] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:28.090542 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3df16b00-1a51-4c8b-9e1c-d211e0bc4ad7 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:28.091429 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3df16b00-1a51-4c8b-9e1c-d211e0bc4ad7 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:28.092345 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3df16b00-1a51-4c8b-9e1c-d211e0bc4ad7 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:28.106387 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3df16b00-1a51-4c8b-9e1c-d211e0bc4ad7 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:28.107025 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3df16b00-1a51-4c8b-9e1c-d211e0bc4ad7 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:28.107407 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3df16b00-1a51-4c8b-9e1c-d211e0bc4ad7 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:28.205087 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3df16b00-1a51-4c8b-9e1c-d211e0bc4ad7 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:28.213125 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3df16b00-1a51-4c8b-9e1c-d211e0bc4ad7 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/3f9f103d-1fb5-4ff3-bf0c-86f8db514b03" status: 200 len: 1233 microversion: 2.1 time: 0.145401 Oct 27 03:46:28.217400 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3011/5722] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:46:28 2022] GET /compute/v2.1/servers/3f9f103d-1fb5-4ff3-bf0c-86f8db514b03 => generated 1233 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:46:28.307617 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-babcea54-81cb-4d6a-917b-380a4390e6c6 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:28.318822 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-babcea54-81cb-4d6a-917b-380a4390e6c6 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/dda902a6-dcad-42bf-9b3c-ed716ea0af70" status: 200 len: 1522 microversion: 2.1 time: 0.318985 Oct 27 03:46:28.319915 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2712/5723] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:46:27 2022] GET /compute/v2.1/servers/dda902a6-dcad-42bf-9b3c-ed716ea0af70 => generated 1522 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:46:28.867239 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-bc4c3ac9-f93f-468c-9fe3-06f6a9f97bd9 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:28.868963 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-bc4c3ac9-f93f-468c-9fe3-06f6a9f97bd9 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] [instance: aadb6c19-2ed0-412f-a666-72a64b56c4ec] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:28.871942 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:28.883414 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bc4c3ac9-f93f-468c-9fe3-06f6a9f97bd9 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:28.884170 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bc4c3ac9-f93f-468c-9fe3-06f6a9f97bd9 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:28.885024 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bc4c3ac9-f93f-468c-9fe3-06f6a9f97bd9 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:28.885939 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bc4c3ac9-f93f-468c-9fe3-06f6a9f97bd9 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:28.886987 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bc4c3ac9-f93f-468c-9fe3-06f6a9f97bd9 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:28.887696 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bc4c3ac9-f93f-468c-9fe3-06f6a9f97bd9 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:28.910724 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-bc4c3ac9-f93f-468c-9fe3-06f6a9f97bd9 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] HTTP exception thrown: Instance aadb6c19-2ed0-412f-a666-72a64b56c4ec could not be found. Oct 27 03:46:28.912706 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-bc4c3ac9-f93f-468c-9fe3-06f6a9f97bd9 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Request method failure captured: Oct 27 03:46:28.912706 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/aadb6c19-2ed0-412f-a666-72a64b56c4ec HTTP/1.1 Oct 27 03:46:28.912706 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:46:28.912706 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:46:28.912706 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:46:28.912706 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:46:28.912706 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:46:28.912706 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:46:28.912706 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:46:28.912706 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:46:28.912706 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWf77EOaSeha1CgQ7SU0dKDupyJqZpJ-EPrF-2rZYI8oEOmMsVRKcK_3nF7aItGSUcFo3ZSUPMn9p8qu3WFckuCpMqESxIckC6UPMCJU_LaFemEHNYmcGLki94ii6MZ4f_sKNb6qvMTC0n5JqUiFB6-dNO7AqdptVQCM2w7T8a4lMZX8 Oct 27 03:46:28.912706 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:46:28.912706 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:46:28.912706 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:46:28.912706 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:46:28.912706 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:46:28.912706 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:46:28.912706 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 63fc6a536b2f46b19fa2e6ab35917332 Oct 27 03:46:28.912706 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-755445399 Oct 27 03:46:28.912706 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:46:28.912706 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:46:28.912706 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/63fc6a536b2f46b19fa2e6ab35917332"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/63fc6a536b2f46b19fa2e6ab35917332"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/63fc6a536b2f46b19fa2e6ab35917332"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_63fc6a536b2f46b19fa2e6ab35917332"}]}] Oct 27 03:46:28.912706 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-755445399 Oct 27 03:46:28.912706 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 63fc6a536b2f46b19fa2e6ab35917332 Oct 27 03:46:28.912706 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-755445399 Oct 27 03:46:28.912706 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-InstanceActionsNegativeTestJSON-755445399-project Oct 27 03:46:28.912706 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:46:28.912706 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:46:28.912706 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: b983494c36da483d9f626522f74d9963 Oct 27 03:46:28.912706 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-755445399-project Oct 27 03:46:28.912706 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:46:28.912706 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance aadb6c19-2ed0-412f-a666-72a64b56c4ec could not be found. Oct 27 03:46:28.912706 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': 'aadb6c19-2ed0-412f-a666-72a64b56c4ec'} Oct 27 03:46:28.912706 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:46:28.912706 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:46:28.912706 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:46:28.912706 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:46:28.912706 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:46:28.912706 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:46:28.912706 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:46:28.912706 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:46:28.912706 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:46:28.912706 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:46:28.912706 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aadb6c19-2ed0-412f-a666-72a64b56c4ec could not be found. Oct 27 03:46:28.912706 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:46:28.912706 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:46:28.912706 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:46:28.912706 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:46:28.912706 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:46:28.912706 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:46:28.912706 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:46:28.912706 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:46:28.912706 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:46:28.912706 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:46:28.912706 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:46:28.912706 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:46:28.912706 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:46:28.912706 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:46:28.912706 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:46:28.912706 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:46:28.912706 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aadb6c19-2ed0-412f-a666-72a64b56c4ec could not be found. Oct 27 03:46:28.912706 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:46:28.912706 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:46:28.922836 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:46:28.922836 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:46:28.922836 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:46:28.922836 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:46:28.922836 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:46:28.922836 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:46:28.922836 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aadb6c19-2ed0-412f-a666-72a64b56c4ec could not be found. Oct 27 03:46:28.922836 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:46:28.922836 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-bc4c3ac9-f93f-468c-9fe3-06f6a9f97bd9 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] Returning 404 to user: Instance aadb6c19-2ed0-412f-a666-72a64b56c4ec could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:46:28.922836 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-bc4c3ac9-f93f-468c-9fe3-06f6a9f97bd9 tempest-InstanceActionsNegativeTestJSON-755445399 tempest-InstanceActionsNegativeTestJSON-755445399-project] 10.222.0.20 "GET /compute/v2.1/servers/aadb6c19-2ed0-412f-a666-72a64b56c4ec" status: 404 len: 111 microversion: 2.1 time: 0.053788 Oct 27 03:46:28.922836 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3012/5724] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:46:28 2022] GET /compute/v2.1/servers/aadb6c19-2ed0-412f-a666-72a64b56c4ec => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:46:29.247319 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f5cbc865-382d-4f1c-9010-985af4eb9cd5 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:29.248911 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f5cbc865-382d-4f1c-9010-985af4eb9cd5 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 3f9f103d-1fb5-4ff3-bf0c-86f8db514b03] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:29.262262 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f5cbc865-382d-4f1c-9010-985af4eb9cd5 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:29.265134 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f5cbc865-382d-4f1c-9010-985af4eb9cd5 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:29.265879 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f5cbc865-382d-4f1c-9010-985af4eb9cd5 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:29.268199 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f5cbc865-382d-4f1c-9010-985af4eb9cd5 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:29.269314 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f5cbc865-382d-4f1c-9010-985af4eb9cd5 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:29.269974 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f5cbc865-382d-4f1c-9010-985af4eb9cd5 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:29.350296 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-aa9f5ed5-f1a1-4c4e-92e2-f2d7a9e15acd tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:29.351051 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-aa9f5ed5-f1a1-4c4e-92e2-f2d7a9e15acd tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: dda902a6-dcad-42bf-9b3c-ed716ea0af70] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:29.367573 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aa9f5ed5-f1a1-4c4e-92e2-f2d7a9e15acd tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:29.380649 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aa9f5ed5-f1a1-4c4e-92e2-f2d7a9e15acd tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:29.381188 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aa9f5ed5-f1a1-4c4e-92e2-f2d7a9e15acd tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:29.381975 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aa9f5ed5-f1a1-4c4e-92e2-f2d7a9e15acd tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:29.387571 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aa9f5ed5-f1a1-4c4e-92e2-f2d7a9e15acd tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:29.387571 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aa9f5ed5-f1a1-4c4e-92e2-f2d7a9e15acd tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:29.412358 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f5cbc865-382d-4f1c-9010-985af4eb9cd5 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:29.433012 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f5cbc865-382d-4f1c-9010-985af4eb9cd5 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/3f9f103d-1fb5-4ff3-bf0c-86f8db514b03" status: 200 len: 1233 microversion: 2.1 time: 0.184230 Oct 27 03:46:29.435609 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2713/5725] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:46:29 2022] GET /compute/v2.1/servers/3f9f103d-1fb5-4ff3-bf0c-86f8db514b03 => generated 1233 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:46:29.721740 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-aa9f5ed5-f1a1-4c4e-92e2-f2d7a9e15acd tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:29.752436 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-aa9f5ed5-f1a1-4c4e-92e2-f2d7a9e15acd tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/dda902a6-dcad-42bf-9b3c-ed716ea0af70" status: 200 len: 1522 microversion: 2.1 time: 0.412552 Oct 27 03:46:29.753453 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3013/5726] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:46:29 2022] GET /compute/v2.1/servers/dda902a6-dcad-42bf-9b3c-ed716ea0af70 => generated 1522 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:46:30.460253 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f97d8088-d21a-464d-ac76-a3db3ad99af6 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:30.461337 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f97d8088-d21a-464d-ac76-a3db3ad99af6 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 3f9f103d-1fb5-4ff3-bf0c-86f8db514b03] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:30.479167 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f97d8088-d21a-464d-ac76-a3db3ad99af6 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:30.481635 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f97d8088-d21a-464d-ac76-a3db3ad99af6 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:30.482234 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f97d8088-d21a-464d-ac76-a3db3ad99af6 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:30.482983 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f97d8088-d21a-464d-ac76-a3db3ad99af6 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:30.483465 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f97d8088-d21a-464d-ac76-a3db3ad99af6 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:30.486666 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f97d8088-d21a-464d-ac76-a3db3ad99af6 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:30.648995 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f97d8088-d21a-464d-ac76-a3db3ad99af6 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:30.660137 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f97d8088-d21a-464d-ac76-a3db3ad99af6 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/3f9f103d-1fb5-4ff3-bf0c-86f8db514b03" status: 200 len: 1225 microversion: 2.1 time: 0.204557 Oct 27 03:46:30.663154 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2714/5727] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:46:30 2022] GET /compute/v2.1/servers/3f9f103d-1fb5-4ff3-bf0c-86f8db514b03 => generated 1225 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:46:30.780107 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-aaa8e275-22ee-43bc-8907-4a12d5f13d8e tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:30.782390 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-aaa8e275-22ee-43bc-8907-4a12d5f13d8e tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: dda902a6-dcad-42bf-9b3c-ed716ea0af70] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:30.800987 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aaa8e275-22ee-43bc-8907-4a12d5f13d8e tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:30.806160 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aaa8e275-22ee-43bc-8907-4a12d5f13d8e tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:30.806916 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aaa8e275-22ee-43bc-8907-4a12d5f13d8e tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:30.808530 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aaa8e275-22ee-43bc-8907-4a12d5f13d8e tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:30.810598 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aaa8e275-22ee-43bc-8907-4a12d5f13d8e tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:30.811232 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aaa8e275-22ee-43bc-8907-4a12d5f13d8e tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:30.966737 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-aaa8e275-22ee-43bc-8907-4a12d5f13d8e tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:30.984123 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-aaa8e275-22ee-43bc-8907-4a12d5f13d8e tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/dda902a6-dcad-42bf-9b3c-ed716ea0af70" status: 200 len: 1480 microversion: 2.1 time: 0.211098 Oct 27 03:46:31.005931 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3014/5728] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:46:30 2022] GET /compute/v2.1/servers/dda902a6-dcad-42bf-9b3c-ed716ea0af70 => generated 1480 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:46:31.165959 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-beaeb698-ebc7-442b-8c97-96ff5ed6a8d3 req-7212297d-1121-46e9-871d-49c5f536bf0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dda902a6-dcad-42bf-9b3c-ed716ea0af70", "name": "network-vif-deleted", "tag": "9a88e217-8a33-468a-a33d-1530420fa236"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:46:31.224141 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-beaeb698-ebc7-442b-8c97-96ff5ed6a8d3 req-7212297d-1121-46e9-871d-49c5f536bf0e service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:31.224624 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-beaeb698-ebc7-442b-8c97-96ff5ed6a8d3 req-7212297d-1121-46e9-871d-49c5f536bf0e service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:31.230505 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-beaeb698-ebc7-442b-8c97-96ff5ed6a8d3 req-7212297d-1121-46e9-871d-49c5f536bf0e service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:31.230505 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:31.268463 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-beaeb698-ebc7-442b-8c97-96ff5ed6a8d3 req-7212297d-1121-46e9-871d-49c5f536bf0e service nova] Creating event network-vif-deleted:9a88e217-8a33-468a-a33d-1530420fa236 for instance dda902a6-dcad-42bf-9b3c-ed716ea0af70 on n-h1-862769-1 Oct 27 03:46:31.299674 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-beaeb698-ebc7-442b-8c97-96ff5ed6a8d3 req-7212297d-1121-46e9-871d-49c5f536bf0e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112769 Oct 27 03:46:31.299674 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2715/5729] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:46:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:46:31.700860 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c8b4cc62-98fd-497f-b81a-388ebde872d4 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:31.712056 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c8b4cc62-98fd-497f-b81a-388ebde872d4 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 3f9f103d-1fb5-4ff3-bf0c-86f8db514b03] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:31.719254 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c8b4cc62-98fd-497f-b81a-388ebde872d4 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:31.720223 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c8b4cc62-98fd-497f-b81a-388ebde872d4 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:31.721481 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c8b4cc62-98fd-497f-b81a-388ebde872d4 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:31.723679 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c8b4cc62-98fd-497f-b81a-388ebde872d4 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:31.777599 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c8b4cc62-98fd-497f-b81a-388ebde872d4 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.039s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:31.778309 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c8b4cc62-98fd-497f-b81a-388ebde872d4 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:31.996338 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c8b4cc62-98fd-497f-b81a-388ebde872d4 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:32.005986 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c8b4cc62-98fd-497f-b81a-388ebde872d4 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/3f9f103d-1fb5-4ff3-bf0c-86f8db514b03" status: 200 len: 1281 microversion: 2.1 time: 0.319458 Oct 27 03:46:32.014510 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e861fde6-0908-4952-bfea-293af4912c40 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:32.015270 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e861fde6-0908-4952-bfea-293af4912c40 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: dda902a6-dcad-42bf-9b3c-ed716ea0af70] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:32.025241 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3015/5730] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:46:31 2022] GET /compute/v2.1/servers/3f9f103d-1fb5-4ff3-bf0c-86f8db514b03 => generated 1281 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:46:32.032063 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e861fde6-0908-4952-bfea-293af4912c40 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:32.032063 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e861fde6-0908-4952-bfea-293af4912c40 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:32.032063 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e861fde6-0908-4952-bfea-293af4912c40 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:32.032063 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e861fde6-0908-4952-bfea-293af4912c40 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:32.034436 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e861fde6-0908-4952-bfea-293af4912c40 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:32.039351 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e861fde6-0908-4952-bfea-293af4912c40 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:32.115565 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e861fde6-0908-4952-bfea-293af4912c40 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:32.117858 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e861fde6-0908-4952-bfea-293af4912c40 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:32.118602 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e861fde6-0908-4952-bfea-293af4912c40 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:32.119831 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-e861fde6-0908-4952-bfea-293af4912c40 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lazy-loading 'fault' on Instance uuid dda902a6-dcad-42bf-9b3c-ed716ea0af70 {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:46:32.220194 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e861fde6-0908-4952-bfea-293af4912c40 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43172c9e71704c869a25181574d67b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f3ed7ef6c648c9ac771fbaadde1d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:32.231733 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e861fde6-0908-4952-bfea-293af4912c40 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/dda902a6-dcad-42bf-9b3c-ed716ea0af70" status: 200 len: 1312 microversion: 2.1 time: 0.222550 Oct 27 03:46:32.233636 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2716/5731] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:46:32 2022] GET /compute/v2.1/servers/dda902a6-dcad-42bf-9b3c-ed716ea0af70 => generated 1312 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:46:32.603666 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-04ff2dee-c111-48a7-8647-8522373b4df7 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:32.604914 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-04ff2dee-c111-48a7-8647-8522373b4df7 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:32.635718 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-04ff2dee-c111-48a7-8647-8522373b4df7 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:32.637442 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-04ff2dee-c111-48a7-8647-8522373b4df7 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:32.638550 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-04ff2dee-c111-48a7-8647-8522373b4df7 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:32.652257 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-04ff2dee-c111-48a7-8647-8522373b4df7 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:32.653089 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-04ff2dee-c111-48a7-8647-8522373b4df7 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:32.654058 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-04ff2dee-c111-48a7-8647-8522373b4df7 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:32.679834 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-04ff2dee-c111-48a7-8647-8522373b4df7 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] HTTP exception thrown: Instance 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 could not be found. Oct 27 03:46:32.682654 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-04ff2dee-c111-48a7-8647-8522373b4df7 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Request method failure captured: Oct 27 03:46:32.682654 n-d-862769-1 devstack@n-api.service[121001]: request: DELETE /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 HTTP/1.1 Oct 27 03:46:32.682654 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:46:32.682654 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:46:32.682654 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:46:32.682654 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:46:32.682654 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:46:32.682654 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:46:32.682654 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:46:32.682654 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:46:32.682654 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWf1tpBFEbkvSK3SqNKiaBdt2iU4VU0up94oX5h2-dwelsBTcOMjAbogxTF1m6837ADQrTcsoRLUG6fwb1i91GnLWdY1HiMrerSGB8x7h0qmRtRJ0xxks9W3iJabiTHs4YSYs5Sa938DRiTXN21ja7qe0GdEoHSxnnRlw0wNIOnjEc_c Oct 27 03:46:32.682654 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:46:32.682654 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:46:32.682654 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:46:32.682654 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:46:32.682654 n-d-862769-1 devstack@n-api.service[121001]: X-Openstack-Nova-Api-Version: 2.20 Oct 27 03:46:32.682654 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:46:32.682654 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:46:32.682654 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: c48bca00e4d445918f030bf885424b40 Oct 27 03:46:32.682654 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-186270836 Oct 27 03:46:32.682654 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:46:32.682654 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:46:32.682654 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c48bca00e4d445918f030bf885424b40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c48bca00e4d445918f030bf885424b40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c48bca00e4d445918f030bf885424b40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c48bca00e4d445918f030bf885424b40"}]}] Oct 27 03:46:32.682654 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-AttachVolumeShelveTestJSON-186270836 Oct 27 03:46:32.682654 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: c48bca00e4d445918f030bf885424b40 Oct 27 03:46:32.682654 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-186270836 Oct 27 03:46:32.682654 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-AttachVolumeShelveTestJSON-186270836-project Oct 27 03:46:32.682654 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:46:32.682654 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:46:32.682654 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: b74e8d6facd1460ab31a3ce4b24dd315 Oct 27 03:46:32.682654 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-AttachVolumeShelveTestJSON-186270836-project Oct 27 03:46:32.682654 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:46:32.682654 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 could not be found. Oct 27 03:46:32.682654 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '6854d7f3-0f6d-45c2-b46d-a5dc2922fe79'} Oct 27 03:46:32.682654 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:46:32.682654 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:46:32.682654 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:46:32.682654 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:46:32.682654 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:46:32.682654 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:46:32.682654 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:46:32.682654 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:46:32.682654 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:46:32.682654 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:46:32.682654 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 could not be found. Oct 27 03:46:32.682654 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:46:32.682654 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:46:32.682654 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:46:32.682654 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:46:32.682654 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:46:32.682654 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:46:32.682654 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:46:32.682654 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:46:32.682654 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:46:32.682654 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:46:32.682654 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 03:46:32.682654 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 03:46:32.682654 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 03:46:32.682654 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 03:46:32.682654 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:46:32.682654 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:46:32.682654 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:46:32.682654 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:46:32.690737 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 could not be found. Oct 27 03:46:32.690737 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:46:32.690737 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:46:32.690737 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:46:32.690737 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:46:32.690737 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:46:32.690737 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:46:32.690737 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:46:32.690737 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:46:32.690737 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 could not be found. Oct 27 03:46:32.690737 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:46:32.694165 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-04ff2dee-c111-48a7-8647-8522373b4df7 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Returning 404 to user: Instance 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:46:32.695392 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-04ff2dee-c111-48a7-8647-8522373b4df7 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79" status: 404 len: 111 microversion: 2.20 time: 0.105341 Oct 27 03:46:32.696619 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3016/5732] 10.222.0.20 () {60 vars in 1280 bytes} [Thu Oct 27 03:46:32 2022] DELETE /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 03:46:32.705537 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-632dc9fd-a4c4-4167-bbf0-12099dc69dc8 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:32.706202 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-632dc9fd-a4c4-4167-bbf0-12099dc69dc8 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] [instance: 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:32.717613 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-632dc9fd-a4c4-4167-bbf0-12099dc69dc8 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:32.718423 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-632dc9fd-a4c4-4167-bbf0-12099dc69dc8 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:32.719541 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-632dc9fd-a4c4-4167-bbf0-12099dc69dc8 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:32.740859 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-632dc9fd-a4c4-4167-bbf0-12099dc69dc8 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:32.742268 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-632dc9fd-a4c4-4167-bbf0-12099dc69dc8 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:32.742646 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-632dc9fd-a4c4-4167-bbf0-12099dc69dc8 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:32.788511 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-632dc9fd-a4c4-4167-bbf0-12099dc69dc8 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] HTTP exception thrown: Instance 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 could not be found. Oct 27 03:46:32.798293 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-632dc9fd-a4c4-4167-bbf0-12099dc69dc8 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Request method failure captured: Oct 27 03:46:32.798293 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 HTTP/1.1 Oct 27 03:46:32.798293 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:46:32.798293 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:46:32.798293 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:46:32.798293 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:46:32.798293 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:46:32.798293 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:46:32.798293 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:46:32.798293 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:46:32.798293 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWf1tpBFEbkvSK3SqNKiaBdt2iU4VU0up94oX5h2-dwelsBTcOMjAbogxTF1m6837ADQrTcsoRLUG6fwb1i91GnLWdY1HiMrerSGB8x7h0qmRtRJ0xxks9W3iJabiTHs4YSYs5Sa938DRiTXN21ja7qe0GdEoHSxnnRlw0wNIOnjEc_c Oct 27 03:46:32.798293 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:46:32.798293 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:46:32.798293 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:46:32.798293 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:46:32.798293 n-d-862769-1 devstack@n-api.service[121000]: X-Openstack-Nova-Api-Version: 2.20 Oct 27 03:46:32.798293 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:46:32.798293 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:46:32.798293 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: c48bca00e4d445918f030bf885424b40 Oct 27 03:46:32.798293 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-186270836 Oct 27 03:46:32.798293 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:46:32.798293 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:46:32.798293 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c48bca00e4d445918f030bf885424b40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c48bca00e4d445918f030bf885424b40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c48bca00e4d445918f030bf885424b40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c48bca00e4d445918f030bf885424b40"}]}] Oct 27 03:46:32.798293 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-AttachVolumeShelveTestJSON-186270836 Oct 27 03:46:32.798293 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: c48bca00e4d445918f030bf885424b40 Oct 27 03:46:32.798293 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-186270836 Oct 27 03:46:32.798293 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-AttachVolumeShelveTestJSON-186270836-project Oct 27 03:46:32.798293 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:46:32.798293 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:46:32.798293 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: b74e8d6facd1460ab31a3ce4b24dd315 Oct 27 03:46:32.798293 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-AttachVolumeShelveTestJSON-186270836-project Oct 27 03:46:32.798293 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:46:32.798293 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 could not be found. Oct 27 03:46:32.798293 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '6854d7f3-0f6d-45c2-b46d-a5dc2922fe79'} Oct 27 03:46:32.798293 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:46:32.798293 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:46:32.798293 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:46:32.798293 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:46:32.798293 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:46:32.798293 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:46:32.798293 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:46:32.798293 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:46:32.798293 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:46:32.798293 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:46:32.798293 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 could not be found. Oct 27 03:46:32.798293 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:46:32.798293 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:46:32.798293 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:46:32.798293 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:46:32.798293 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:46:32.798293 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:46:32.798293 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:46:32.798293 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:46:32.798293 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:46:32.798293 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:46:32.798293 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:46:32.798293 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:46:32.798293 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:46:32.798293 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:46:32.798293 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:46:32.798293 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:46:32.798293 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 could not be found. Oct 27 03:46:32.798293 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:46:32.798293 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:46:32.803594 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:46:32.803594 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:46:32.803594 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:46:32.803594 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:46:32.803594 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:46:32.803594 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:46:32.803594 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 could not be found. Oct 27 03:46:32.803594 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:46:32.803594 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-632dc9fd-a4c4-4167-bbf0-12099dc69dc8 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] Returning 404 to user: Instance 6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:46:32.803594 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-632dc9fd-a4c4-4167-bbf0-12099dc69dc8 tempest-AttachVolumeShelveTestJSON-186270836 tempest-AttachVolumeShelveTestJSON-186270836-project] 10.222.0.20 "GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79" status: 404 len: 111 microversion: 2.20 time: 0.099528 Oct 27 03:46:32.803594 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2717/5733] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:46:32 2022] GET /compute/v2.1/servers/6854d7f3-0f6d-45c2-b46d-a5dc2922fe79 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 03:46:33.049959 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-97fd5e64-acc2-4676-9382-9de20035a18b tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:33.050775 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-97fd5e64-acc2-4676-9382-9de20035a18b tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 3f9f103d-1fb5-4ff3-bf0c-86f8db514b03] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:33.061612 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-97fd5e64-acc2-4676-9382-9de20035a18b tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:33.065908 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-97fd5e64-acc2-4676-9382-9de20035a18b tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:33.066962 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-97fd5e64-acc2-4676-9382-9de20035a18b tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:33.068896 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-97fd5e64-acc2-4676-9382-9de20035a18b tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:33.070795 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-97fd5e64-acc2-4676-9382-9de20035a18b tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:33.074340 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-97fd5e64-acc2-4676-9382-9de20035a18b tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:33.258946 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5caa54c8-6b9b-4ad8-9308-a2a7dbf2eaa9 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:33.263308 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5caa54c8-6b9b-4ad8-9308-a2a7dbf2eaa9 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] [instance: dda902a6-dcad-42bf-9b3c-ed716ea0af70] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:33.273420 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5caa54c8-6b9b-4ad8-9308-a2a7dbf2eaa9 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:33.274120 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5caa54c8-6b9b-4ad8-9308-a2a7dbf2eaa9 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:33.277983 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5caa54c8-6b9b-4ad8-9308-a2a7dbf2eaa9 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:33.279854 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5caa54c8-6b9b-4ad8-9308-a2a7dbf2eaa9 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:33.284932 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5caa54c8-6b9b-4ad8-9308-a2a7dbf2eaa9 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:33.285587 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5caa54c8-6b9b-4ad8-9308-a2a7dbf2eaa9 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:33.330013 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-5caa54c8-6b9b-4ad8-9308-a2a7dbf2eaa9 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] HTTP exception thrown: Instance dda902a6-dcad-42bf-9b3c-ed716ea0af70 could not be found. Oct 27 03:46:33.332056 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5caa54c8-6b9b-4ad8-9308-a2a7dbf2eaa9 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Request method failure captured: Oct 27 03:46:33.332056 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/dda902a6-dcad-42bf-9b3c-ed716ea0af70 HTTP/1.1 Oct 27 03:46:33.332056 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:46:33.332056 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:46:33.332056 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:46:33.332056 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:46:33.332056 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:46:33.332056 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:46:33.332056 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:46:33.332056 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:46:33.332056 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWf3uUTnEN6JEj9qTF9cAY0BLnY-YCL30UQa3hBWeUb1dNx6UaDGQTlfRNfawcK1WUPI3AVcIhTKI_7viSsI0VCiS7DswtiywtZ-RbWwufMeio2Ivv3GBrhAaC4UKKUNrtl6wYtdRVU_yfZaWJd2e4jOiCo3IliQOw95nmGOg5mVlF04 Oct 27 03:46:33.332056 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:46:33.332056 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:46:33.332056 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:46:33.332056 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:46:33.332056 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:46:33.332056 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:46:33.332056 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: e1f3ed7ef6c648c9ac771fbaadde1d0c Oct 27 03:46:33.332056 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-143118573 Oct 27 03:46:33.332056 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:46:33.332056 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:46:33.332056 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e1f3ed7ef6c648c9ac771fbaadde1d0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e1f3ed7ef6c648c9ac771fbaadde1d0c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e1f3ed7ef6c648c9ac771fbaadde1d0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e1f3ed7ef6c648c9ac771fbaadde1d0c"}]}] Oct 27 03:46:33.332056 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ServerRescueNegativeTestJSON-143118573 Oct 27 03:46:33.332056 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: e1f3ed7ef6c648c9ac771fbaadde1d0c Oct 27 03:46:33.332056 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-143118573 Oct 27 03:46:33.332056 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ServerRescueNegativeTestJSON-143118573-project Oct 27 03:46:33.332056 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:46:33.332056 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:46:33.332056 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 43172c9e71704c869a25181574d67b35 Oct 27 03:46:33.332056 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ServerRescueNegativeTestJSON-143118573-project Oct 27 03:46:33.332056 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:46:33.332056 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance dda902a6-dcad-42bf-9b3c-ed716ea0af70 could not be found. Oct 27 03:46:33.332056 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': 'dda902a6-dcad-42bf-9b3c-ed716ea0af70'} Oct 27 03:46:33.332056 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:46:33.332056 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:46:33.332056 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:46:33.332056 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:46:33.332056 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:46:33.332056 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:46:33.332056 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:46:33.332056 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:46:33.332056 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:46:33.332056 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:46:33.332056 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dda902a6-dcad-42bf-9b3c-ed716ea0af70 could not be found. Oct 27 03:46:33.332056 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:46:33.332056 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:46:33.332056 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:46:33.332056 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:46:33.332056 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:46:33.332056 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:46:33.332056 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:46:33.332056 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:46:33.332056 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:46:33.332056 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:46:33.332056 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:46:33.332056 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:46:33.332056 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:46:33.332056 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:46:33.332056 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:46:33.332056 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:46:33.332056 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dda902a6-dcad-42bf-9b3c-ed716ea0af70 could not be found. Oct 27 03:46:33.332056 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:46:33.332056 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:46:33.336994 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:46:33.336994 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:46:33.336994 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:46:33.336994 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:46:33.336994 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:46:33.336994 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:46:33.336994 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dda902a6-dcad-42bf-9b3c-ed716ea0af70 could not be found. Oct 27 03:46:33.336994 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:46:33.339086 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5caa54c8-6b9b-4ad8-9308-a2a7dbf2eaa9 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] Returning 404 to user: Instance dda902a6-dcad-42bf-9b3c-ed716ea0af70 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:46:33.340281 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5caa54c8-6b9b-4ad8-9308-a2a7dbf2eaa9 tempest-ServerRescueNegativeTestJSON-143118573 tempest-ServerRescueNegativeTestJSON-143118573-project] 10.222.0.20 "GET /compute/v2.1/servers/dda902a6-dcad-42bf-9b3c-ed716ea0af70" status: 404 len: 111 microversion: 2.1 time: 0.085285 Oct 27 03:46:33.345824 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2718/5734] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:46:33 2022] GET /compute/v2.1/servers/dda902a6-dcad-42bf-9b3c-ed716ea0af70 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 03:46:33.352071 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-97fd5e64-acc2-4676-9382-9de20035a18b tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:33.362441 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-97fd5e64-acc2-4676-9382-9de20035a18b tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/3f9f103d-1fb5-4ff3-bf0c-86f8db514b03" status: 200 len: 1287 microversion: 2.1 time: 0.316224 Oct 27 03:46:33.363228 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3017/5735] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:46:33 2022] GET /compute/v2.1/servers/3f9f103d-1fb5-4ff3-bf0c-86f8db514b03 => generated 1287 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:46:34.391846 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1e86010f-2c03-4a36-afdc-8d2a18b491f3 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:34.393084 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1e86010f-2c03-4a36-afdc-8d2a18b491f3 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 3f9f103d-1fb5-4ff3-bf0c-86f8db514b03] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:34.409770 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1e86010f-2c03-4a36-afdc-8d2a18b491f3 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:34.410627 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1e86010f-2c03-4a36-afdc-8d2a18b491f3 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:34.411264 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1e86010f-2c03-4a36-afdc-8d2a18b491f3 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:34.412165 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1e86010f-2c03-4a36-afdc-8d2a18b491f3 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:34.412803 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1e86010f-2c03-4a36-afdc-8d2a18b491f3 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:34.413627 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1e86010f-2c03-4a36-afdc-8d2a18b491f3 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:34.496479 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1e86010f-2c03-4a36-afdc-8d2a18b491f3 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:34.512382 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1e86010f-2c03-4a36-afdc-8d2a18b491f3 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/3f9f103d-1fb5-4ff3-bf0c-86f8db514b03" status: 200 len: 1287 microversion: 2.1 time: 0.119623 Oct 27 03:46:34.512382 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2719/5736] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:46:34 2022] GET /compute/v2.1/servers/3f9f103d-1fb5-4ff3-bf0c-86f8db514b03 => generated 1287 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:46:35.535218 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-00ef82f8-0b42-49de-81cd-eec6d86b66c1 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:35.536633 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-00ef82f8-0b42-49de-81cd-eec6d86b66c1 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 3f9f103d-1fb5-4ff3-bf0c-86f8db514b03] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:35.548386 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-00ef82f8-0b42-49de-81cd-eec6d86b66c1 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:35.552899 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-00ef82f8-0b42-49de-81cd-eec6d86b66c1 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:35.554552 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-00ef82f8-0b42-49de-81cd-eec6d86b66c1 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:35.556559 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-00ef82f8-0b42-49de-81cd-eec6d86b66c1 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:35.558489 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-00ef82f8-0b42-49de-81cd-eec6d86b66c1 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:35.562309 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-00ef82f8-0b42-49de-81cd-eec6d86b66c1 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:36.021659 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-00ef82f8-0b42-49de-81cd-eec6d86b66c1 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:36.034821 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-00ef82f8-0b42-49de-81cd-eec6d86b66c1 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/3f9f103d-1fb5-4ff3-bf0c-86f8db514b03" status: 200 len: 1329 microversion: 2.1 time: 0.503792 Oct 27 03:46:36.046634 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3018/5737] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:46:35 2022] GET /compute/v2.1/servers/3f9f103d-1fb5-4ff3-bf0c-86f8db514b03 => generated 1329 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:46:37.061380 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d08b4fde-10b8-45a6-83f2-23ab7687da93 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:37.062014 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d08b4fde-10b8-45a6-83f2-23ab7687da93 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 3f9f103d-1fb5-4ff3-bf0c-86f8db514b03] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:37.069638 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:37.073950 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=6 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:37.095688 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d08b4fde-10b8-45a6-83f2-23ab7687da93 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:37.096759 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d08b4fde-10b8-45a6-83f2-23ab7687da93 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:37.097573 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d08b4fde-10b8-45a6-83f2-23ab7687da93 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:37.105677 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d08b4fde-10b8-45a6-83f2-23ab7687da93 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:37.107074 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d08b4fde-10b8-45a6-83f2-23ab7687da93 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:37.107361 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d08b4fde-10b8-45a6-83f2-23ab7687da93 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:37.694830 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d08b4fde-10b8-45a6-83f2-23ab7687da93 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:37.721957 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d08b4fde-10b8-45a6-83f2-23ab7687da93 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/3f9f103d-1fb5-4ff3-bf0c-86f8db514b03" status: 200 len: 1329 microversion: 2.1 time: 0.664655 Oct 27 03:46:37.724627 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2720/5738] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:46:37 2022] GET /compute/v2.1/servers/3f9f103d-1fb5-4ff3-bf0c-86f8db514b03 => generated 1329 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:46:38.756190 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b79e316c-5665-4a48-87cd-2ebdc717ada2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:38.759323 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b79e316c-5665-4a48-87cd-2ebdc717ada2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 3f9f103d-1fb5-4ff3-bf0c-86f8db514b03] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:38.770076 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=6 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:38.775815 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b79e316c-5665-4a48-87cd-2ebdc717ada2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:38.790379 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b79e316c-5665-4a48-87cd-2ebdc717ada2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:38.791428 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b79e316c-5665-4a48-87cd-2ebdc717ada2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:38.793755 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b79e316c-5665-4a48-87cd-2ebdc717ada2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:38.801463 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b79e316c-5665-4a48-87cd-2ebdc717ada2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:38.801463 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b79e316c-5665-4a48-87cd-2ebdc717ada2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:38.828962 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-6e2b86a9-7cec-4e65-8692-b5b050db7a36 req-8fcac1e2-ea85-4235-b3ee-f3a677ad44a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f9f103d-1fb5-4ff3-bf0c-86f8db514b03", "tag": "cbcb4190-019c-4165-ae03-d559f66c7fa3"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:46:38.844233 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-6e2b86a9-7cec-4e65-8692-b5b050db7a36 req-8fcac1e2-ea85-4235-b3ee-f3a677ad44a2 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:38.845306 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-6e2b86a9-7cec-4e65-8692-b5b050db7a36 req-8fcac1e2-ea85-4235-b3ee-f3a677ad44a2 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:38.845989 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-6e2b86a9-7cec-4e65-8692-b5b050db7a36 req-8fcac1e2-ea85-4235-b3ee-f3a677ad44a2 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:38.872664 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-6e2b86a9-7cec-4e65-8692-b5b050db7a36 req-8fcac1e2-ea85-4235-b3ee-f3a677ad44a2 service nova] Creating event network-changed:cbcb4190-019c-4165-ae03-d559f66c7fa3 for instance 3f9f103d-1fb5-4ff3-bf0c-86f8db514b03 on n-h1-862769-1 Oct 27 03:46:38.883383 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:38.884201 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-6e2b86a9-7cec-4e65-8692-b5b050db7a36 req-8fcac1e2-ea85-4235-b3ee-f3a677ad44a2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058638 Oct 27 03:46:38.887364 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2721/5739] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:46:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:46:39.712928 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b79e316c-5665-4a48-87cd-2ebdc717ada2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:39.731884 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b79e316c-5665-4a48-87cd-2ebdc717ada2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/3f9f103d-1fb5-4ff3-bf0c-86f8db514b03" status: 200 len: 1329 microversion: 2.1 time: 0.979594 Oct 27 03:46:39.731884 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3019/5740] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:46:38 2022] GET /compute/v2.1/servers/3f9f103d-1fb5-4ff3-bf0c-86f8db514b03 => generated 1329 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:46:40.757047 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4df61940-7c4f-489a-af64-58819e81828b tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:40.759273 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4df61940-7c4f-489a-af64-58819e81828b tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 3f9f103d-1fb5-4ff3-bf0c-86f8db514b03] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:40.773840 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4df61940-7c4f-489a-af64-58819e81828b tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:40.775786 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4df61940-7c4f-489a-af64-58819e81828b tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:40.776416 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4df61940-7c4f-489a-af64-58819e81828b tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:40.806249 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4df61940-7c4f-489a-af64-58819e81828b tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:40.806249 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4df61940-7c4f-489a-af64-58819e81828b tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:40.806249 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4df61940-7c4f-489a-af64-58819e81828b tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:41.663603 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4df61940-7c4f-489a-af64-58819e81828b tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:41.680751 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4df61940-7c4f-489a-af64-58819e81828b tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/3f9f103d-1fb5-4ff3-bf0c-86f8db514b03" status: 200 len: 1329 microversion: 2.1 time: 0.935376 Oct 27 03:46:41.684345 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2722/5741] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:46:40 2022] GET /compute/v2.1/servers/3f9f103d-1fb5-4ff3-bf0c-86f8db514b03 => generated 1329 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:46:42.705786 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f44c7c3a-977d-4e9f-9547-0cd319e5a9ed tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:42.708844 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f44c7c3a-977d-4e9f-9547-0cd319e5a9ed tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 3f9f103d-1fb5-4ff3-bf0c-86f8db514b03] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:42.736809 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f44c7c3a-977d-4e9f-9547-0cd319e5a9ed tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:42.737673 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f44c7c3a-977d-4e9f-9547-0cd319e5a9ed tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:42.738487 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f44c7c3a-977d-4e9f-9547-0cd319e5a9ed tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:42.739487 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f44c7c3a-977d-4e9f-9547-0cd319e5a9ed tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:42.740872 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f44c7c3a-977d-4e9f-9547-0cd319e5a9ed tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:42.741573 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f44c7c3a-977d-4e9f-9547-0cd319e5a9ed tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:43.475150 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f44c7c3a-977d-4e9f-9547-0cd319e5a9ed tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:43.488987 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f44c7c3a-977d-4e9f-9547-0cd319e5a9ed tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/3f9f103d-1fb5-4ff3-bf0c-86f8db514b03" status: 200 len: 1329 microversion: 2.1 time: 0.785213 Oct 27 03:46:43.503062 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3020/5742] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:46:42 2022] GET /compute/v2.1/servers/3f9f103d-1fb5-4ff3-bf0c-86f8db514b03 => generated 1329 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:46:44.517264 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a8ba3498-5c66-4e52-83dd-1b2c3fff67c8 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:44.519383 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a8ba3498-5c66-4e52-83dd-1b2c3fff67c8 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 3f9f103d-1fb5-4ff3-bf0c-86f8db514b03] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:44.539414 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a8ba3498-5c66-4e52-83dd-1b2c3fff67c8 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:44.539925 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a8ba3498-5c66-4e52-83dd-1b2c3fff67c8 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:44.540373 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a8ba3498-5c66-4e52-83dd-1b2c3fff67c8 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:44.543413 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a8ba3498-5c66-4e52-83dd-1b2c3fff67c8 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:44.543413 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a8ba3498-5c66-4e52-83dd-1b2c3fff67c8 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:44.543413 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a8ba3498-5c66-4e52-83dd-1b2c3fff67c8 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:44.821725 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a8ba3498-5c66-4e52-83dd-1b2c3fff67c8 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:44.832812 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a8ba3498-5c66-4e52-83dd-1b2c3fff67c8 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/3f9f103d-1fb5-4ff3-bf0c-86f8db514b03" status: 200 len: 1329 microversion: 2.1 time: 0.320593 Oct 27 03:46:44.841818 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2723/5743] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:46:44 2022] GET /compute/v2.1/servers/3f9f103d-1fb5-4ff3-bf0c-86f8db514b03 => generated 1329 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:46:45.559950 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3d3ac0b4-9bc7-47ad-b98c-43e787ac80bf tempest-MultipleCreateNegativeTestJSON-1405368254 tempest-MultipleCreateNegativeTestJSON-1405368254-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-379113124", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:46:45.565912 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-3d3ac0b4-9bc7-47ad-b98c-43e787ac80bf tempest-MultipleCreateNegativeTestJSON-1405368254 tempest-MultipleCreateNegativeTestJSON-1405368254-project] HTTP exception thrown: min_count must be <= max_count Oct 27 03:46:45.569697 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3d3ac0b4-9bc7-47ad-b98c-43e787ac80bf tempest-MultipleCreateNegativeTestJSON-1405368254 tempest-MultipleCreateNegativeTestJSON-1405368254-project] Request method failure captured: Oct 27 03:46:45.569697 n-d-862769-1 devstack@n-api.service[121001]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 03:46:45.569697 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:46:45.569697 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:46:45.569697 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:46:45.569697 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 183 Oct 27 03:46:45.569697 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:46:45.569697 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:46:45.569697 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:46:45.569697 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:46:45.569697 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWf8kGjlMu7TxRc3nzFd-0Lu91s0Cs8ppPQUbNrTNkw1dcUOwGdtAlvNKnrfwLU_MVsmfk6PKJPBGGp5cYvHME3upHNhMnRH9mJx0FxQebsurQwODMAFHZrYTLJffJFnliG4fVyvRRvyXzOViNBrMpXnnryDIYlvr59gIvKJpFXmtOMU Oct 27 03:46:45.569697 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:46:45.569697 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:46:45.569697 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:46:45.569697 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:46:45.569697 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:46:45.569697 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:46:45.569697 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: abf267ba6748402a97cbb16e7f1a0081 Oct 27 03:46:45.569697 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1405368254 Oct 27 03:46:45.569697 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:46:45.569697 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:46:45.569697 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abf267ba6748402a97cbb16e7f1a0081"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/abf267ba6748402a97cbb16e7f1a0081"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abf267ba6748402a97cbb16e7f1a0081"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_abf267ba6748402a97cbb16e7f1a0081"}]}] Oct 27 03:46:45.569697 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1405368254 Oct 27 03:46:45.569697 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: abf267ba6748402a97cbb16e7f1a0081 Oct 27 03:46:45.569697 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1405368254 Oct 27 03:46:45.569697 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-MultipleCreateNegativeTestJSON-1405368254-project Oct 27 03:46:45.569697 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:46:45.569697 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:46:45.569697 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: ba39251aae4446dcbe11d9407f3166c7 Oct 27 03:46:45.569697 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1405368254-project Oct 27 03:46:45.569697 n-d-862769-1 devstack@n-api.service[121001]: Oct 27 03:46:45.569697 n-d-862769-1 devstack@n-api.service[121001]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-379113124", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "min_count": 3, "max_count": 2}} Oct 27 03:46:45.569697 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:46:45.569697 n-d-862769-1 devstack@n-api.service[121001]: exception: min_count must be <= max_count Oct 27 03:46:45.569697 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-379113124', 'imageRef': 'c40fb871-5877-4b59-ab69-d9fd23b7a917', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Oct 27 03:46:45.569697 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:46:45.569697 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:46:45.569697 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:46:45.569697 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:46:45.569697 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:46:45.569697 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:46:45.569697 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:46:45.569697 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:46:45.569697 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:46:45.569697 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:46:45.569697 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:46:45.569697 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:46:45.569697 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:46:45.569697 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:46:45.569697 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 27 03:46:45.569697 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Oct 27 03:46:45.569697 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 27 03:46:45.569697 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Oct 27 03:46:45.569697 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:46:45.569697 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:46:45.569697 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:46:45.569697 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:46:45.569697 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:46:45.569697 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:46:45.569697 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:46:45.569697 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:46:45.569697 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Oct 27 03:46:45.569697 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:46:45.579738 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3d3ac0b4-9bc7-47ad-b98c-43e787ac80bf tempest-MultipleCreateNegativeTestJSON-1405368254 tempest-MultipleCreateNegativeTestJSON-1405368254-project] Returning 400 to user: min_count must be <= max_count {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:46:45.579738 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3d3ac0b4-9bc7-47ad-b98c-43e787ac80bf tempest-MultipleCreateNegativeTestJSON-1405368254 tempest-MultipleCreateNegativeTestJSON-1405368254-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.635771 Oct 27 03:46:45.579738 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3021/5744] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:46:44 2022] POST /compute/v2.1/servers => generated 74 bytes in 642 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 27 03:46:45.865617 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0ce85d8d-621c-4ea6-9207-890802f1bd4b tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:45.866304 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0ce85d8d-621c-4ea6-9207-890802f1bd4b tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 3f9f103d-1fb5-4ff3-bf0c-86f8db514b03] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:45.873676 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0ce85d8d-621c-4ea6-9207-890802f1bd4b tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:45.874265 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0ce85d8d-621c-4ea6-9207-890802f1bd4b tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:45.875284 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0ce85d8d-621c-4ea6-9207-890802f1bd4b tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:45.876013 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0ce85d8d-621c-4ea6-9207-890802f1bd4b tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:45.876481 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0ce85d8d-621c-4ea6-9207-890802f1bd4b tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:45.876915 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0ce85d8d-621c-4ea6-9207-890802f1bd4b tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:46.071528 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0ce85d8d-621c-4ea6-9207-890802f1bd4b tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:46.099202 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0ce85d8d-621c-4ea6-9207-890802f1bd4b tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/3f9f103d-1fb5-4ff3-bf0c-86f8db514b03" status: 200 len: 1329 microversion: 2.1 time: 0.237054 Oct 27 03:46:46.101185 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2724/5745] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:46:45 2022] GET /compute/v2.1/servers/3f9f103d-1fb5-4ff3-bf0c-86f8db514b03 => generated 1329 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:46:46.259413 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f2a0f3e5-0a24-4c27-8f0d-bebcac8a831a tempest-MultipleCreateNegativeTestJSON-1405368254 tempest-MultipleCreateNegativeTestJSON-1405368254-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1305867586", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "max_count": 0}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:46:46.264899 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f2a0f3e5-0a24-4c27-8f0d-bebcac8a831a tempest-MultipleCreateNegativeTestJSON-1405368254 tempest-MultipleCreateNegativeTestJSON-1405368254-project] Request method failure captured: Oct 27 03:46:46.264899 n-d-862769-1 devstack@n-api.service[121001]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 03:46:46.264899 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:46:46.264899 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:46:46.264899 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:46:46.264899 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 168 Oct 27 03:46:46.264899 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:46:46.264899 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:46:46.264899 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:46:46.264899 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:46:46.264899 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWf8kGjlMu7TxRc3nzFd-0Lu91s0Cs8ppPQUbNrTNkw1dcUOwGdtAlvNKnrfwLU_MVsmfk6PKJPBGGp5cYvHME3upHNhMnRH9mJx0FxQebsurQwODMAFHZrYTLJffJFnliG4fVyvRRvyXzOViNBrMpXnnryDIYlvr59gIvKJpFXmtOMU Oct 27 03:46:46.264899 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:46:46.264899 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:46:46.264899 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:46:46.264899 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:46:46.264899 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:46:46.264899 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:46:46.264899 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: abf267ba6748402a97cbb16e7f1a0081 Oct 27 03:46:46.264899 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1405368254 Oct 27 03:46:46.264899 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:46:46.264899 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:46:46.264899 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abf267ba6748402a97cbb16e7f1a0081"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/abf267ba6748402a97cbb16e7f1a0081"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abf267ba6748402a97cbb16e7f1a0081"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_abf267ba6748402a97cbb16e7f1a0081"}]}] Oct 27 03:46:46.264899 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1405368254 Oct 27 03:46:46.264899 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: abf267ba6748402a97cbb16e7f1a0081 Oct 27 03:46:46.264899 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1405368254 Oct 27 03:46:46.264899 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-MultipleCreateNegativeTestJSON-1405368254-project Oct 27 03:46:46.264899 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:46:46.264899 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:46:46.264899 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: ba39251aae4446dcbe11d9407f3166c7 Oct 27 03:46:46.264899 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1405368254-project Oct 27 03:46:46.264899 n-d-862769-1 devstack@n-api.service[121001]: Oct 27 03:46:46.264899 n-d-862769-1 devstack@n-api.service[121001]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1305867586", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "max_count": 0}} Oct 27 03:46:46.264899 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:46:46.264899 n-d-862769-1 devstack@n-api.service[121001]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 27 03:46:46.264899 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1305867586', 'imageRef': 'c40fb871-5877-4b59-ab69-d9fd23b7a917', 'flavorRef': '452', 'max_count': 0}}} Oct 27 03:46:46.264899 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:46:46.264899 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:46:46.264899 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 03:46:46.264899 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 03:46:46.264899 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 03:46:46.264899 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise error Oct 27 03:46:46.264899 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 27 03:46:46.264899 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:46:46.264899 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Oct 27 03:46:46.264899 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 27 03:46:46.264899 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 27 03:46:46.264899 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 27 03:46:46.264899 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 27 03:46:46.264899 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:46:46.264899 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 27 03:46:46.264899 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi 0 Oct 27 03:46:46.264899 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:46:46.264899 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:46:46.264899 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:46:46.264899 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:46:46.264899 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:46:46.264899 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:46:46.264899 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:46:46.264899 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:46:46.264899 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:46:46.264899 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:46:46.264899 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:46:46.264899 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:46:46.264899 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 03:46:46.264899 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 03:46:46.270101 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 03:46:46.270101 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 03:46:46.270101 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 03:46:46.270101 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 03:46:46.270101 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 27 03:46:46.270101 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:46:46.270101 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:46:46.270101 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:46:46.270101 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:46:46.270101 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:46:46.270101 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:46:46.270101 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 03:46:46.270101 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 03:46:46.270101 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 27 03:46:46.270101 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:46:46.273870 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f2a0f3e5-0a24-4c27-8f0d-bebcac8a831a tempest-MultipleCreateNegativeTestJSON-1405368254 tempest-MultipleCreateNegativeTestJSON-1405368254-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:46:46.275159 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f2a0f3e5-0a24-4c27-8f0d-bebcac8a831a tempest-MultipleCreateNegativeTestJSON-1405368254 tempest-MultipleCreateNegativeTestJSON-1405368254-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.042020 Oct 27 03:46:46.277090 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3022/5746] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:46:46 2022] POST /compute/v2.1/servers => generated 130 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 03:46:46.522364 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9a00106e-7c40-44fb-b5d1-09f65a339ecc tempest-MultipleCreateNegativeTestJSON-1405368254 tempest-MultipleCreateNegativeTestJSON-1405368254-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1789756499", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "max_count": 2.5}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:46:46.526940 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9a00106e-7c40-44fb-b5d1-09f65a339ecc tempest-MultipleCreateNegativeTestJSON-1405368254 tempest-MultipleCreateNegativeTestJSON-1405368254-project] Request method failure captured: Oct 27 03:46:46.526940 n-d-862769-1 devstack@n-api.service[121000]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 03:46:46.526940 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:46:46.526940 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:46:46.526940 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:46:46.526940 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 170 Oct 27 03:46:46.526940 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:46:46.526940 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:46:46.526940 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:46:46.526940 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:46:46.526940 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWf8kGjlMu7TxRc3nzFd-0Lu91s0Cs8ppPQUbNrTNkw1dcUOwGdtAlvNKnrfwLU_MVsmfk6PKJPBGGp5cYvHME3upHNhMnRH9mJx0FxQebsurQwODMAFHZrYTLJffJFnliG4fVyvRRvyXzOViNBrMpXnnryDIYlvr59gIvKJpFXmtOMU Oct 27 03:46:46.526940 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:46:46.526940 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:46:46.526940 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:46:46.526940 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:46:46.526940 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:46:46.526940 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:46:46.526940 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: abf267ba6748402a97cbb16e7f1a0081 Oct 27 03:46:46.526940 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1405368254 Oct 27 03:46:46.526940 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:46:46.526940 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:46:46.526940 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abf267ba6748402a97cbb16e7f1a0081"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/abf267ba6748402a97cbb16e7f1a0081"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abf267ba6748402a97cbb16e7f1a0081"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_abf267ba6748402a97cbb16e7f1a0081"}]}] Oct 27 03:46:46.526940 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1405368254 Oct 27 03:46:46.526940 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: abf267ba6748402a97cbb16e7f1a0081 Oct 27 03:46:46.526940 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1405368254 Oct 27 03:46:46.526940 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-MultipleCreateNegativeTestJSON-1405368254-project Oct 27 03:46:46.526940 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:46:46.526940 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:46:46.526940 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: ba39251aae4446dcbe11d9407f3166c7 Oct 27 03:46:46.526940 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1405368254-project Oct 27 03:46:46.526940 n-d-862769-1 devstack@n-api.service[121000]: Oct 27 03:46:46.526940 n-d-862769-1 devstack@n-api.service[121000]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1789756499", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "max_count": 2.5}} Oct 27 03:46:46.526940 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:46:46.526940 n-d-862769-1 devstack@n-api.service[121000]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 27 03:46:46.526940 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1789756499', 'imageRef': 'c40fb871-5877-4b59-ab69-d9fd23b7a917', 'flavorRef': '452', 'max_count': 2.5}}} Oct 27 03:46:46.526940 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:46:46.526940 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:46:46.526940 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 03:46:46.526940 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 03:46:46.526940 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 03:46:46.526940 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise error Oct 27 03:46:46.526940 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 27 03:46:46.526940 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:46:46.526940 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Oct 27 03:46:46.526940 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 27 03:46:46.526940 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 27 03:46:46.526940 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 27 03:46:46.526940 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 27 03:46:46.526940 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:46:46.526940 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 27 03:46:46.526940 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi 2.5 Oct 27 03:46:46.526940 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:46:46.526940 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:46:46.526940 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:46:46.526940 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:46:46.526940 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:46:46.526940 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:46:46.526940 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:46:46.526940 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:46:46.526940 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:46:46.526940 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:46:46.526940 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:46:46.526940 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:46:46.526940 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 03:46:46.526940 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 03:46:46.531733 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 03:46:46.531733 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 03:46:46.531733 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 03:46:46.531733 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 03:46:46.531733 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 27 03:46:46.531733 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:46:46.531733 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:46:46.531733 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:46:46.531733 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:46:46.531733 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:46:46.531733 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:46:46.531733 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 03:46:46.531733 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 03:46:46.531733 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 27 03:46:46.531733 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:46:46.537067 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9a00106e-7c40-44fb-b5d1-09f65a339ecc tempest-MultipleCreateNegativeTestJSON-1405368254 tempest-MultipleCreateNegativeTestJSON-1405368254-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:46:46.542995 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9a00106e-7c40-44fb-b5d1-09f65a339ecc tempest-MultipleCreateNegativeTestJSON-1405368254 tempest-MultipleCreateNegativeTestJSON-1405368254-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.024979 Oct 27 03:46:46.550708 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2725/5747] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:46:46 2022] POST /compute/v2.1/servers => generated 139 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 03:46:46.738654 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c9073227-bcab-496a-89d6-1a37e25eae49 tempest-MultipleCreateNegativeTestJSON-1405368254 tempest-MultipleCreateNegativeTestJSON-1405368254-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-254643005", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "min_count": 0}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:46:46.742674 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c9073227-bcab-496a-89d6-1a37e25eae49 tempest-MultipleCreateNegativeTestJSON-1405368254 tempest-MultipleCreateNegativeTestJSON-1405368254-project] Request method failure captured: Oct 27 03:46:46.742674 n-d-862769-1 devstack@n-api.service[121001]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 03:46:46.742674 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:46:46.742674 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:46:46.742674 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:46:46.742674 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 167 Oct 27 03:46:46.742674 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:46:46.742674 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:46:46.742674 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:46:46.742674 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:46:46.742674 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWf8kGjlMu7TxRc3nzFd-0Lu91s0Cs8ppPQUbNrTNkw1dcUOwGdtAlvNKnrfwLU_MVsmfk6PKJPBGGp5cYvHME3upHNhMnRH9mJx0FxQebsurQwODMAFHZrYTLJffJFnliG4fVyvRRvyXzOViNBrMpXnnryDIYlvr59gIvKJpFXmtOMU Oct 27 03:46:46.742674 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:46:46.742674 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:46:46.742674 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:46:46.742674 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:46:46.742674 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:46:46.742674 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:46:46.742674 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: abf267ba6748402a97cbb16e7f1a0081 Oct 27 03:46:46.742674 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1405368254 Oct 27 03:46:46.742674 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:46:46.742674 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:46:46.742674 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abf267ba6748402a97cbb16e7f1a0081"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/abf267ba6748402a97cbb16e7f1a0081"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abf267ba6748402a97cbb16e7f1a0081"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_abf267ba6748402a97cbb16e7f1a0081"}]}] Oct 27 03:46:46.742674 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1405368254 Oct 27 03:46:46.742674 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: abf267ba6748402a97cbb16e7f1a0081 Oct 27 03:46:46.742674 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1405368254 Oct 27 03:46:46.742674 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-MultipleCreateNegativeTestJSON-1405368254-project Oct 27 03:46:46.742674 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:46:46.742674 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:46:46.742674 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: ba39251aae4446dcbe11d9407f3166c7 Oct 27 03:46:46.742674 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1405368254-project Oct 27 03:46:46.742674 n-d-862769-1 devstack@n-api.service[121001]: Oct 27 03:46:46.742674 n-d-862769-1 devstack@n-api.service[121001]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-254643005", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "min_count": 0}} Oct 27 03:46:46.742674 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:46:46.742674 n-d-862769-1 devstack@n-api.service[121001]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 27 03:46:46.742674 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-254643005', 'imageRef': 'c40fb871-5877-4b59-ab69-d9fd23b7a917', 'flavorRef': '452', 'min_count': 0}}} Oct 27 03:46:46.742674 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:46:46.742674 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:46:46.742674 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 03:46:46.742674 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 03:46:46.742674 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 03:46:46.742674 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise error Oct 27 03:46:46.742674 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 27 03:46:46.742674 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:46:46.742674 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Oct 27 03:46:46.742674 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 27 03:46:46.742674 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 27 03:46:46.742674 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 27 03:46:46.742674 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 27 03:46:46.742674 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:46:46.742674 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 27 03:46:46.742674 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi 0 Oct 27 03:46:46.742674 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:46:46.742674 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:46:46.742674 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:46:46.742674 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:46:46.742674 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:46:46.742674 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:46:46.742674 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:46:46.742674 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:46:46.742674 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:46:46.742674 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:46:46.742674 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:46:46.742674 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:46:46.742674 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 03:46:46.742674 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 03:46:46.747787 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 03:46:46.747787 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 03:46:46.747787 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 03:46:46.747787 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 03:46:46.747787 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 27 03:46:46.747787 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:46:46.747787 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:46:46.747787 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:46:46.747787 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:46:46.747787 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:46:46.747787 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:46:46.747787 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 03:46:46.747787 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 03:46:46.747787 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 27 03:46:46.747787 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:46:46.747787 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c9073227-bcab-496a-89d6-1a37e25eae49 tempest-MultipleCreateNegativeTestJSON-1405368254 tempest-MultipleCreateNegativeTestJSON-1405368254-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:46:46.747787 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c9073227-bcab-496a-89d6-1a37e25eae49 tempest-MultipleCreateNegativeTestJSON-1405368254 tempest-MultipleCreateNegativeTestJSON-1405368254-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.010063 Oct 27 03:46:46.751639 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3023/5748] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:46:46 2022] POST /compute/v2.1/servers => generated 130 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 03:46:46.794257 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-3deb3223-d983-4a43-b11d-e8fbaf594ad1 req-e1a3b51b-e7fe-46f2-8f45-9f3dc9013af5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f9f103d-1fb5-4ff3-bf0c-86f8db514b03", "name": "network-vif-plugged", "status": "completed", "tag": "cbcb4190-019c-4165-ae03-d559f66c7fa3"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:46:46.811697 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-3deb3223-d983-4a43-b11d-e8fbaf594ad1 req-e1a3b51b-e7fe-46f2-8f45-9f3dc9013af5 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:46.812242 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-3deb3223-d983-4a43-b11d-e8fbaf594ad1 req-e1a3b51b-e7fe-46f2-8f45-9f3dc9013af5 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:46.812681 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-3deb3223-d983-4a43-b11d-e8fbaf594ad1 req-e1a3b51b-e7fe-46f2-8f45-9f3dc9013af5 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:46.823887 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-3deb3223-d983-4a43-b11d-e8fbaf594ad1 req-e1a3b51b-e7fe-46f2-8f45-9f3dc9013af5 service nova] Creating event network-vif-plugged:cbcb4190-019c-4165-ae03-d559f66c7fa3 for instance 3f9f103d-1fb5-4ff3-bf0c-86f8db514b03 on n-h1-862769-1 Oct 27 03:46:46.829439 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-3deb3223-d983-4a43-b11d-e8fbaf594ad1 req-e1a3b51b-e7fe-46f2-8f45-9f3dc9013af5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040205 Oct 27 03:46:46.830063 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2726/5749] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:46:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:46:47.128011 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c0cc5c21-75bf-48ee-98ad-f4bb64942fab tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:47.128011 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c0cc5c21-75bf-48ee-98ad-f4bb64942fab tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 3f9f103d-1fb5-4ff3-bf0c-86f8db514b03] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:47.133251 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c0cc5c21-75bf-48ee-98ad-f4bb64942fab tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:47.134015 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c0cc5c21-75bf-48ee-98ad-f4bb64942fab tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:47.134487 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c0cc5c21-75bf-48ee-98ad-f4bb64942fab tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:47.135219 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c0cc5c21-75bf-48ee-98ad-f4bb64942fab tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:47.135684 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c0cc5c21-75bf-48ee-98ad-f4bb64942fab tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:47.136125 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c0cc5c21-75bf-48ee-98ad-f4bb64942fab tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:47.370689 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c0cc5c21-75bf-48ee-98ad-f4bb64942fab tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:47.379974 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c0cc5c21-75bf-48ee-98ad-f4bb64942fab tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/3f9f103d-1fb5-4ff3-bf0c-86f8db514b03" status: 200 len: 1329 microversion: 2.1 time: 0.259310 Oct 27 03:46:47.381195 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3024/5750] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:46:47 2022] GET /compute/v2.1/servers/3f9f103d-1fb5-4ff3-bf0c-86f8db514b03 => generated 1329 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:46:47.523955 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c8866a29-f4c0-46a6-b3ba-d4715414581d tempest-MultipleCreateNegativeTestJSON-1405368254 tempest-MultipleCreateNegativeTestJSON-1405368254-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1278570982", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "min_count": 2.5}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:46:47.533114 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c8866a29-f4c0-46a6-b3ba-d4715414581d tempest-MultipleCreateNegativeTestJSON-1405368254 tempest-MultipleCreateNegativeTestJSON-1405368254-project] Request method failure captured: Oct 27 03:46:47.533114 n-d-862769-1 devstack@n-api.service[121000]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 03:46:47.533114 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:46:47.533114 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:46:47.533114 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:46:47.533114 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 170 Oct 27 03:46:47.533114 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:46:47.533114 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:46:47.533114 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:46:47.533114 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:46:47.533114 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWf8kGjlMu7TxRc3nzFd-0Lu91s0Cs8ppPQUbNrTNkw1dcUOwGdtAlvNKnrfwLU_MVsmfk6PKJPBGGp5cYvHME3upHNhMnRH9mJx0FxQebsurQwODMAFHZrYTLJffJFnliG4fVyvRRvyXzOViNBrMpXnnryDIYlvr59gIvKJpFXmtOMU Oct 27 03:46:47.533114 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:46:47.533114 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:46:47.533114 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:46:47.533114 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:46:47.533114 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:46:47.533114 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:46:47.533114 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: abf267ba6748402a97cbb16e7f1a0081 Oct 27 03:46:47.533114 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1405368254 Oct 27 03:46:47.533114 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:46:47.533114 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:46:47.533114 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abf267ba6748402a97cbb16e7f1a0081"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/abf267ba6748402a97cbb16e7f1a0081"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abf267ba6748402a97cbb16e7f1a0081"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_abf267ba6748402a97cbb16e7f1a0081"}]}] Oct 27 03:46:47.533114 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1405368254 Oct 27 03:46:47.533114 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: abf267ba6748402a97cbb16e7f1a0081 Oct 27 03:46:47.533114 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1405368254 Oct 27 03:46:47.533114 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-MultipleCreateNegativeTestJSON-1405368254-project Oct 27 03:46:47.533114 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:46:47.533114 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:46:47.533114 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: ba39251aae4446dcbe11d9407f3166c7 Oct 27 03:46:47.533114 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1405368254-project Oct 27 03:46:47.533114 n-d-862769-1 devstack@n-api.service[121000]: Oct 27 03:46:47.533114 n-d-862769-1 devstack@n-api.service[121000]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1278570982", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "min_count": 2.5}} Oct 27 03:46:47.533114 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:46:47.533114 n-d-862769-1 devstack@n-api.service[121000]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 27 03:46:47.533114 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1278570982', 'imageRef': 'c40fb871-5877-4b59-ab69-d9fd23b7a917', 'flavorRef': '452', 'min_count': 2.5}}} Oct 27 03:46:47.533114 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:46:47.533114 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:46:47.533114 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 03:46:47.533114 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 03:46:47.533114 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 03:46:47.533114 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise error Oct 27 03:46:47.533114 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 27 03:46:47.533114 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:46:47.533114 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Oct 27 03:46:47.533114 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 27 03:46:47.533114 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 27 03:46:47.533114 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 27 03:46:47.533114 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 27 03:46:47.533114 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:46:47.533114 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 27 03:46:47.533114 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi 2.5 Oct 27 03:46:47.533114 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:46:47.533114 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:46:47.533114 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:46:47.533114 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:46:47.533114 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:46:47.533114 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:46:47.533114 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:46:47.533114 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:46:47.533114 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:46:47.533114 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:46:47.533114 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:46:47.533114 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:46:47.533114 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 03:46:47.533114 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 03:46:47.538851 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 03:46:47.538851 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 03:46:47.538851 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 03:46:47.538851 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 03:46:47.538851 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 27 03:46:47.538851 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:46:47.538851 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:46:47.538851 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:46:47.538851 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:46:47.538851 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:46:47.538851 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:46:47.538851 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 03:46:47.538851 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 03:46:47.538851 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 27 03:46:47.538851 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:46:47.538851 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c8866a29-f4c0-46a6-b3ba-d4715414581d tempest-MultipleCreateNegativeTestJSON-1405368254 tempest-MultipleCreateNegativeTestJSON-1405368254-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:46:47.538851 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c8866a29-f4c0-46a6-b3ba-d4715414581d tempest-MultipleCreateNegativeTestJSON-1405368254 tempest-MultipleCreateNegativeTestJSON-1405368254-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.012064 Oct 27 03:46:47.540480 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2727/5751] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:46:47 2022] POST /compute/v2.1/servers => generated 139 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 03:46:48.405793 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8b7dc9d5-62f8-4e48-bed7-9af4c81f3ced tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:48.407005 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8b7dc9d5-62f8-4e48-bed7-9af4c81f3ced tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 3f9f103d-1fb5-4ff3-bf0c-86f8db514b03] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:48.414646 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8b7dc9d5-62f8-4e48-bed7-9af4c81f3ced tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:48.415358 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8b7dc9d5-62f8-4e48-bed7-9af4c81f3ced tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:48.416009 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8b7dc9d5-62f8-4e48-bed7-9af4c81f3ced tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:48.416722 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8b7dc9d5-62f8-4e48-bed7-9af4c81f3ced tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:48.417354 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8b7dc9d5-62f8-4e48-bed7-9af4c81f3ced tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:48.418019 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8b7dc9d5-62f8-4e48-bed7-9af4c81f3ced tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:48.584897 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8b7dc9d5-62f8-4e48-bed7-9af4c81f3ced tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:48.595620 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8b7dc9d5-62f8-4e48-bed7-9af4c81f3ced tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/3f9f103d-1fb5-4ff3-bf0c-86f8db514b03" status: 200 len: 1511 microversion: 2.1 time: 0.196364 Oct 27 03:46:48.596549 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3025/5752] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:46:48 2022] GET /compute/v2.1/servers/3f9f103d-1fb5-4ff3-bf0c-86f8db514b03 => generated 1511 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:46:48.630263 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-78623366-fb97-42e7-b753-e1effe22d35e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:48.631387 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-78623366-fb97-42e7-b753-e1effe22d35e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 3f9f103d-1fb5-4ff3-bf0c-86f8db514b03] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:48.639641 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-78623366-fb97-42e7-b753-e1effe22d35e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:48.641536 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-78623366-fb97-42e7-b753-e1effe22d35e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:48.642251 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-78623366-fb97-42e7-b753-e1effe22d35e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:48.643521 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-78623366-fb97-42e7-b753-e1effe22d35e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:48.644310 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-78623366-fb97-42e7-b753-e1effe22d35e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:48.644914 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-78623366-fb97-42e7-b753-e1effe22d35e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:48.806688 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-78623366-fb97-42e7-b753-e1effe22d35e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:48.817032 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-78623366-fb97-42e7-b753-e1effe22d35e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/3f9f103d-1fb5-4ff3-bf0c-86f8db514b03" status: 200 len: 1511 microversion: 2.1 time: 0.193620 Oct 27 03:46:48.818651 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2728/5753] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:46:48 2022] GET /compute/v2.1/servers/3f9f103d-1fb5-4ff3-bf0c-86f8db514b03 => generated 1511 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:46:48.841295 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4c8d1cc3-972c-40a4-b93c-6dd8f08f499f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:48.841880 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4c8d1cc3-972c-40a4-b93c-6dd8f08f499f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 3f9f103d-1fb5-4ff3-bf0c-86f8db514b03] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:48.853662 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4c8d1cc3-972c-40a4-b93c-6dd8f08f499f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:48.854196 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4c8d1cc3-972c-40a4-b93c-6dd8f08f499f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:48.854650 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4c8d1cc3-972c-40a4-b93c-6dd8f08f499f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:48.855376 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4c8d1cc3-972c-40a4-b93c-6dd8f08f499f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:48.855845 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4c8d1cc3-972c-40a4-b93c-6dd8f08f499f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:48.856282 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4c8d1cc3-972c-40a4-b93c-6dd8f08f499f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:48.892128 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4c8d1cc3-972c-40a4-b93c-6dd8f08f499f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 3f9f103d-1fb5-4ff3-bf0c-86f8db514b03] Going to try to terminate instance {{(pid=121001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:46:49.196322 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4c8d1cc3-972c-40a4-b93c-6dd8f08f499f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3f9f103d-1fb5-4ff3-bf0c-86f8db514b03" status: 204 len: 0 microversion: 2.1 time: 0.358933 Oct 27 03:46:49.199891 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3026/5754] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:46:48 2022] DELETE /compute/v2.1/servers/3f9f103d-1fb5-4ff3-bf0c-86f8db514b03 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:46:49.211351 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3202e6a2-38da-4ae4-bed8-0a2acbc43cc9 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:49.211974 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-3202e6a2-38da-4ae4-bed8-0a2acbc43cc9 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 3f9f103d-1fb5-4ff3-bf0c-86f8db514b03] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:49.219076 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3202e6a2-38da-4ae4-bed8-0a2acbc43cc9 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:49.220076 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3202e6a2-38da-4ae4-bed8-0a2acbc43cc9 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:49.220709 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3202e6a2-38da-4ae4-bed8-0a2acbc43cc9 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:49.221598 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3202e6a2-38da-4ae4-bed8-0a2acbc43cc9 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:49.222582 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3202e6a2-38da-4ae4-bed8-0a2acbc43cc9 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:49.223189 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3202e6a2-38da-4ae4-bed8-0a2acbc43cc9 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:49.439974 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-3202e6a2-38da-4ae4-bed8-0a2acbc43cc9 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:49.450291 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3202e6a2-38da-4ae4-bed8-0a2acbc43cc9 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/3f9f103d-1fb5-4ff3-bf0c-86f8db514b03" status: 200 len: 1517 microversion: 2.1 time: 0.243019 Oct 27 03:46:49.450799 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2729/5755] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:46:49 2022] GET /compute/v2.1/servers/3f9f103d-1fb5-4ff3-bf0c-86f8db514b03 => generated 1517 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:46:50.473303 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d4984c21-bd11-492b-9382-97037a1928c4 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:50.474146 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d4984c21-bd11-492b-9382-97037a1928c4 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 3f9f103d-1fb5-4ff3-bf0c-86f8db514b03] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:50.481100 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d4984c21-bd11-492b-9382-97037a1928c4 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:50.484437 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d4984c21-bd11-492b-9382-97037a1928c4 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:50.484437 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d4984c21-bd11-492b-9382-97037a1928c4 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:50.484437 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d4984c21-bd11-492b-9382-97037a1928c4 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:50.484437 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d4984c21-bd11-492b-9382-97037a1928c4 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:50.484437 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d4984c21-bd11-492b-9382-97037a1928c4 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:50.623245 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d4984c21-bd11-492b-9382-97037a1928c4 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:50.632080 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d4984c21-bd11-492b-9382-97037a1928c4 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/3f9f103d-1fb5-4ff3-bf0c-86f8db514b03" status: 200 len: 1517 microversion: 2.1 time: 0.162433 Oct 27 03:46:50.632080 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3027/5756] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:46:50 2022] GET /compute/v2.1/servers/3f9f103d-1fb5-4ff3-bf0c-86f8db514b03 => generated 1517 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:46:51.610247 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-67b0689e-7012-4855-ba7d-2f5ff9064434 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-180615204", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": "none"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:46:51.705276 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-67b0689e-7012-4855-ba7d-2f5ff9064434 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:46:51.705860 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-67b0689e-7012-4855-ba7d-2f5ff9064434 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:46:51.706652 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-67b0689e-7012-4855-ba7d-2f5ff9064434 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:46:51.707188 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-67b0689e-7012-4855-ba7d-2f5ff9064434 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:46:51.707719 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-67b0689e-7012-4855-ba7d-2f5ff9064434 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:46:51.736610 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-67b0689e-7012-4855-ba7d-2f5ff9064434 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:51.737467 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-67b0689e-7012-4855-ba7d-2f5ff9064434 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:51.739155 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-67b0689e-7012-4855-ba7d-2f5ff9064434 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:51.739155 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-67b0689e-7012-4855-ba7d-2f5ff9064434 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:51.739798 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-67b0689e-7012-4855-ba7d-2f5ff9064434 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:51.739798 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-67b0689e-7012-4855-ba7d-2f5ff9064434 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:51.787490 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-67b0689e-7012-4855-ba7d-2f5ff9064434 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Getting quotas for project 99b82766f45e4f8c8d207974abe7f19a. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:46:51.802135 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-67b0689e-7012-4855-ba7d-2f5ff9064434 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Getting quotas for user 966feb108a724a18919b3a106e9d9c8e and project 99b82766f45e4f8c8d207974abe7f19a. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:46:51.820242 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-67b0689e-7012-4855-ba7d-2f5ff9064434 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:46:51.823221 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-67b0689e-7012-4855-ba7d-2f5ff9064434 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] [instance: 91b09d24-f41f-474e-8820-1ee53e3aabd4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:46:51.885406 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-c00ed7b7-19ca-40bd-82b8-09d9a5cf72ac req-fc6b8f75-e8de-41d4-82a1-12830f452e23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f9f103d-1fb5-4ff3-bf0c-86f8db514b03", "name": "network-vif-deleted", "tag": "cbcb4190-019c-4165-ae03-d559f66c7fa3"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:46:51.899582 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-c00ed7b7-19ca-40bd-82b8-09d9a5cf72ac req-fc6b8f75-e8de-41d4-82a1-12830f452e23 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:51.900149 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-c00ed7b7-19ca-40bd-82b8-09d9a5cf72ac req-fc6b8f75-e8de-41d4-82a1-12830f452e23 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:51.900651 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-c00ed7b7-19ca-40bd-82b8-09d9a5cf72ac req-fc6b8f75-e8de-41d4-82a1-12830f452e23 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:51.915506 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-c00ed7b7-19ca-40bd-82b8-09d9a5cf72ac req-fc6b8f75-e8de-41d4-82a1-12830f452e23 service nova] Creating event network-vif-deleted:cbcb4190-019c-4165-ae03-d559f66c7fa3 for instance 3f9f103d-1fb5-4ff3-bf0c-86f8db514b03 on n-h1-862769-1 Oct 27 03:46:51.922728 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-c00ed7b7-19ca-40bd-82b8-09d9a5cf72ac req-fc6b8f75-e8de-41d4-82a1-12830f452e23 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.690753 Oct 27 03:46:51.927057 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3028/5757] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:46:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:46:51.932437 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a9946f0a-2ea0-4d99-ab82-15c2d4d5c694 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:51.933408 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a9946f0a-2ea0-4d99-ab82-15c2d4d5c694 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 3f9f103d-1fb5-4ff3-bf0c-86f8db514b03] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:51.940403 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a9946f0a-2ea0-4d99-ab82-15c2d4d5c694 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:51.940898 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a9946f0a-2ea0-4d99-ab82-15c2d4d5c694 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:51.941365 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a9946f0a-2ea0-4d99-ab82-15c2d4d5c694 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:51.942089 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a9946f0a-2ea0-4d99-ab82-15c2d4d5c694 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:51.942723 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a9946f0a-2ea0-4d99-ab82-15c2d4d5c694 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:51.943435 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a9946f0a-2ea0-4d99-ab82-15c2d4d5c694 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:51.959024 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-67b0689e-7012-4855-ba7d-2f5ff9064434 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 1.032938 Oct 27 03:46:51.959960 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2730/5758] 10.222.0.20 () {62 vars in 1188 bytes} [Thu Oct 27 03:46:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1035 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 27 03:46:51.976754 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c5114161-a58c-466a-b372-baa615d44fb9 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:51.976754 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c5114161-a58c-466a-b372-baa615d44fb9 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] [instance: 91b09d24-f41f-474e-8820-1ee53e3aabd4] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:51.976754 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:46:51.979867 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a9946f0a-2ea0-4d99-ab82-15c2d4d5c694 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:51.980524 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a9946f0a-2ea0-4d99-ab82-15c2d4d5c694 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:51.980970 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a9946f0a-2ea0-4d99-ab82-15c2d4d5c694 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:51.981423 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-a9946f0a-2ea0-4d99-ab82-15c2d4d5c694 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lazy-loading 'fault' on Instance uuid 3f9f103d-1fb5-4ff3-bf0c-86f8db514b03 {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:46:52.038239 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c5114161-a58c-466a-b372-baa615d44fb9 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:52.050133 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c5114161-a58c-466a-b372-baa615d44fb9 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:52.051866 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c5114161-a58c-466a-b372-baa615d44fb9 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:52.053036 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c5114161-a58c-466a-b372-baa615d44fb9 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] 10.222.0.20 "GET /compute/v2.1/servers/91b09d24-f41f-474e-8820-1ee53e3aabd4" status: 200 len: 1277 microversion: 2.47 time: 0.085791 Oct 27 03:46:52.053773 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2731/5759] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:46:51 2022] GET /compute/v2.1/servers/91b09d24-f41f-474e-8820-1ee53e3aabd4 => generated 1277 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:46:52.058211 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a9946f0a-2ea0-4d99-ab82-15c2d4d5c694 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:52.067090 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a9946f0a-2ea0-4d99-ab82-15c2d4d5c694 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/3f9f103d-1fb5-4ff3-bf0c-86f8db514b03" status: 200 len: 1319 microversion: 2.1 time: 0.138626 Oct 27 03:46:52.067639 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3029/5760] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:46:51 2022] GET /compute/v2.1/servers/3f9f103d-1fb5-4ff3-bf0c-86f8db514b03 => generated 1319 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:46:52.690516 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8d226bc4-2887-4040-a1bd-fc73a55bce77 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-634074073", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": "none"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:46:52.755275 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-8d226bc4-2887-4040-a1bd-fc73a55bce77 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:46:52.757372 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-8d226bc4-2887-4040-a1bd-fc73a55bce77 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:46:52.757372 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-8d226bc4-2887-4040-a1bd-fc73a55bce77 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:46:52.757372 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-8d226bc4-2887-4040-a1bd-fc73a55bce77 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:46:52.758793 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-8d226bc4-2887-4040-a1bd-fc73a55bce77 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:46:52.769115 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8d226bc4-2887-4040-a1bd-fc73a55bce77 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:52.769748 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8d226bc4-2887-4040-a1bd-fc73a55bce77 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:52.770227 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8d226bc4-2887-4040-a1bd-fc73a55bce77 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:52.771318 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8d226bc4-2887-4040-a1bd-fc73a55bce77 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:52.771794 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8d226bc4-2887-4040-a1bd-fc73a55bce77 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:52.772232 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8d226bc4-2887-4040-a1bd-fc73a55bce77 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:52.793315 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-8d226bc4-2887-4040-a1bd-fc73a55bce77 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Getting quotas for project 99b82766f45e4f8c8d207974abe7f19a. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:46:52.800044 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-8d226bc4-2887-4040-a1bd-fc73a55bce77 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Getting quotas for user 966feb108a724a18919b3a106e9d9c8e and project 99b82766f45e4f8c8d207974abe7f19a. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:46:52.820730 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8d226bc4-2887-4040-a1bd-fc73a55bce77 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:46:52.820730 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8d226bc4-2887-4040-a1bd-fc73a55bce77 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] [instance: 828cda24-b238-44bb-9007-142bbd02c041] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:46:52.986821 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8d226bc4-2887-4040-a1bd-fc73a55bce77 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.301319 Oct 27 03:46:52.988331 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2732/5761] 10.222.0.20 () {62 vars in 1188 bytes} [Thu Oct 27 03:46:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 303 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 27 03:46:52.999581 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5a256e0a-74b9-4edd-a5b9-b3d5086f3b36 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:46:53.004187 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5a256e0a-74b9-4edd-a5b9-b3d5086f3b36 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] [instance: 828cda24-b238-44bb-9007-142bbd02c041] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:53.051867 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5a256e0a-74b9-4edd-a5b9-b3d5086f3b36 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] 10.222.0.20 "PUT /compute/v2.1/servers/828cda24-b238-44bb-9007-142bbd02c041" status: 200 len: 991 microversion: 2.47 time: 0.056401 Oct 27 03:46:53.053322 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3030/5762] 10.222.0.20 () {62 vars in 1297 bytes} [Thu Oct 27 03:46:52 2022] PUT /compute/v2.1/servers/828cda24-b238-44bb-9007-142bbd02c041 => generated 991 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 03:46:53.077113 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6c7deda7-ca20-4226-ab96-fb5848ae123f tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:53.078743 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6c7deda7-ca20-4226-ab96-fb5848ae123f tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] [instance: 828cda24-b238-44bb-9007-142bbd02c041] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:53.101954 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e1ff16f2-f67c-484d-89cd-4f01539807dc tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:53.104138 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e1ff16f2-f67c-484d-89cd-4f01539807dc tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 3f9f103d-1fb5-4ff3-bf0c-86f8db514b03] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:53.120274 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e1ff16f2-f67c-484d-89cd-4f01539807dc tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:53.125201 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e1ff16f2-f67c-484d-89cd-4f01539807dc tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:53.125201 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e1ff16f2-f67c-484d-89cd-4f01539807dc tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:53.125201 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e1ff16f2-f67c-484d-89cd-4f01539807dc tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:53.127527 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e1ff16f2-f67c-484d-89cd-4f01539807dc tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:53.129229 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e1ff16f2-f67c-484d-89cd-4f01539807dc tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:53.150505 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-6c7deda7-ca20-4226-ab96-fb5848ae123f tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:53.160028 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-6c7deda7-ca20-4226-ab96-fb5848ae123f tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:53.162617 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-6c7deda7-ca20-4226-ab96-fb5848ae123f tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:53.163773 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-e1ff16f2-f67c-484d-89cd-4f01539807dc tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] HTTP exception thrown: Instance 3f9f103d-1fb5-4ff3-bf0c-86f8db514b03 could not be found. Oct 27 03:46:53.164302 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6c7deda7-ca20-4226-ab96-fb5848ae123f tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] 10.222.0.20 "GET /compute/v2.1/servers/828cda24-b238-44bb-9007-142bbd02c041" status: 200 len: 1277 microversion: 2.47 time: 0.092750 Oct 27 03:46:53.165401 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2733/5763] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:46:53 2022] GET /compute/v2.1/servers/828cda24-b238-44bb-9007-142bbd02c041 => generated 1277 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:46:53.166442 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e1ff16f2-f67c-484d-89cd-4f01539807dc tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Request method failure captured: Oct 27 03:46:53.166442 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/3f9f103d-1fb5-4ff3-bf0c-86f8db514b03 HTTP/1.1 Oct 27 03:46:53.166442 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:46:53.166442 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:46:53.166442 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:46:53.166442 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:46:53.166442 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:46:53.166442 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:46:53.166442 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:46:53.166442 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:46:53.166442 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWf7ao454EXpcvqw57oZ6kUl55rrrabqqRcgdR7_bXGBd3EhUlwYyYuxAfl-nrBiMviq2ipmr2mbr4b0cgBTMbKDOZJ9TP7cenW0zaGDKmMe2aswh3Oogol3Ct9m8LHYZYqPWmhLSqvB2K7fCZP-q-SBCjWA9jL7HEZxBqgIhBaRnNcs Oct 27 03:46:53.166442 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:46:53.166442 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:46:53.166442 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:46:53.166442 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:46:53.166442 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:46:53.166442 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:46:53.166442 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 86b90d4cb5eb42958248b6f82516ce19 Oct 27 03:46:53.166442 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServersTestJSON-1724631621 Oct 27 03:46:53.166442 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:46:53.166442 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:46:53.166442 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86b90d4cb5eb42958248b6f82516ce19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/86b90d4cb5eb42958248b6f82516ce19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86b90d4cb5eb42958248b6f82516ce19"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_86b90d4cb5eb42958248b6f82516ce19"}]}] Oct 27 03:46:53.166442 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServersTestJSON-1724631621 Oct 27 03:46:53.166442 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 86b90d4cb5eb42958248b6f82516ce19 Oct 27 03:46:53.166442 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServersTestJSON-1724631621 Oct 27 03:46:53.166442 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServersTestJSON-1724631621-project Oct 27 03:46:53.166442 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:46:53.166442 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:46:53.166442 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: ca2da57f02884a968d685b53a5399e46 Oct 27 03:46:53.166442 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServersTestJSON-1724631621-project Oct 27 03:46:53.166442 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:46:53.166442 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 3f9f103d-1fb5-4ff3-bf0c-86f8db514b03 could not be found. Oct 27 03:46:53.166442 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '3f9f103d-1fb5-4ff3-bf0c-86f8db514b03'} Oct 27 03:46:53.166442 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:46:53.166442 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:46:53.166442 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:46:53.166442 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:46:53.166442 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:46:53.166442 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:46:53.166442 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:46:53.166442 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:46:53.166442 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:46:53.166442 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:46:53.166442 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f9f103d-1fb5-4ff3-bf0c-86f8db514b03 could not be found. Oct 27 03:46:53.166442 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:46:53.166442 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:46:53.166442 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:46:53.166442 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:46:53.166442 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:46:53.166442 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:46:53.166442 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:46:53.166442 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:46:53.166442 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:46:53.166442 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:46:53.166442 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:46:53.166442 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:46:53.166442 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:46:53.166442 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:46:53.166442 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:46:53.166442 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:46:53.166442 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f9f103d-1fb5-4ff3-bf0c-86f8db514b03 could not be found. Oct 27 03:46:53.166442 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:46:53.166442 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:46:53.166442 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:46:53.173176 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:46:53.173176 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:46:53.173176 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:46:53.173176 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:46:53.173176 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:46:53.173176 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f9f103d-1fb5-4ff3-bf0c-86f8db514b03 could not be found. Oct 27 03:46:53.173176 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:46:53.198447 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e1ff16f2-f67c-484d-89cd-4f01539807dc tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Returning 404 to user: Instance 3f9f103d-1fb5-4ff3-bf0c-86f8db514b03 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:46:53.202861 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e1ff16f2-f67c-484d-89cd-4f01539807dc tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/3f9f103d-1fb5-4ff3-bf0c-86f8db514b03" status: 404 len: 111 microversion: 2.1 time: 0.110534 Oct 27 03:46:53.204940 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3031/5764] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:46:53 2022] GET /compute/v2.1/servers/3f9f103d-1fb5-4ff3-bf0c-86f8db514b03 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 03:46:53.215006 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-317f42ee-4f9b-4251-936d-835c67a5acfe tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '.version_select at 0x7f7dd9c6b790>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:53.314773 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-317f42ee-4f9b-4251-936d-835c67a5acfe tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-key-1467740840" status: 202 len: 0 microversion: 2.1 time: 0.096921 Oct 27 03:46:53.314773 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2734/5765] 10.222.0.20 () {58 vars in 1209 bytes} [Thu Oct 27 03:46:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-1467740840 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:46:53.745331 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b3397409-9119-46e1-b2f6-535717983ed7 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-2022649655", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": [{"uuid": "6ad05158-ac44-4c49-b5d6-443f42165c93"}]}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:46:53.818227 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.network.neutron [None req-b3397409-9119-46e1-b2f6-535717983ed7 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] validate_networks() for [('6ad05158-ac44-4c49-b5d6-443f42165c93', None, None, None, None, None)] {{(pid=121001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:46:54.205329 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-02b94cae-38a4-4b25-b874-7335acc225c0 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:54.205870 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-02b94cae-38a4-4b25-b874-7335acc225c0 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] [instance: 828cda24-b238-44bb-9007-142bbd02c041] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:54.273674 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-b3397409-9119-46e1-b2f6-535717983ed7 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Flavor limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:46:54.273674 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-b3397409-9119-46e1-b2f6-535717983ed7 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Image limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:46:54.274345 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-b3397409-9119-46e1-b2f6-535717983ed7 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Flavor pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:46:54.274961 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-b3397409-9119-46e1-b2f6-535717983ed7 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Image pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:46:54.275501 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-b3397409-9119-46e1-b2f6-535717983ed7 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:46:54.293253 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b3397409-9119-46e1-b2f6-535717983ed7 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:54.293253 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b3397409-9119-46e1-b2f6-535717983ed7 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:54.293253 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b3397409-9119-46e1-b2f6-535717983ed7 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:54.293253 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b3397409-9119-46e1-b2f6-535717983ed7 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:54.293253 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b3397409-9119-46e1-b2f6-535717983ed7 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:54.293253 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b3397409-9119-46e1-b2f6-535717983ed7 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:54.311922 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-02b94cae-38a4-4b25-b874-7335acc225c0 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:54.319293 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-b3397409-9119-46e1-b2f6-535717983ed7 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Getting quotas for project 86b90d4cb5eb42958248b6f82516ce19. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:46:54.328749 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-02b94cae-38a4-4b25-b874-7335acc225c0 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:54.333964 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-02b94cae-38a4-4b25-b874-7335acc225c0 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:54.335376 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-02b94cae-38a4-4b25-b874-7335acc225c0 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] 10.222.0.20 "GET /compute/v2.1/servers/828cda24-b238-44bb-9007-142bbd02c041" status: 200 len: 1277 microversion: 2.47 time: 0.138531 Oct 27 03:46:54.336341 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2735/5766] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:46:54 2022] GET /compute/v2.1/servers/828cda24-b238-44bb-9007-142bbd02c041 => generated 1277 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:46:54.349915 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-b3397409-9119-46e1-b2f6-535717983ed7 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Getting quotas for user ca2da57f02884a968d685b53a5399e46 and project 86b90d4cb5eb42958248b6f82516ce19. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:46:54.381448 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b3397409-9119-46e1-b2f6-535717983ed7 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Going to run 1 instances... {{(pid=121001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:46:54.384353 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b3397409-9119-46e1-b2f6-535717983ed7 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 971b44e4-41fc-40a8-907a-71f5345eaf01] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:46:54.578086 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b3397409-9119-46e1-b2f6-535717983ed7 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.837126 Oct 27 03:46:54.579540 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3032/5767] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:46:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 839 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 03:46:54.590783 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-01c67fd6-92c5-4eda-9a1f-288d7d9b72f6 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:54.598555 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-01c67fd6-92c5-4eda-9a1f-288d7d9b72f6 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 971b44e4-41fc-40a8-907a-71f5345eaf01] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:54.716733 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-01c67fd6-92c5-4eda-9a1f-288d7d9b72f6 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:54.725426 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-01c67fd6-92c5-4eda-9a1f-288d7d9b72f6 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/971b44e4-41fc-40a8-907a-71f5345eaf01" status: 200 len: 1209 microversion: 2.1 time: 0.138480 Oct 27 03:46:54.726887 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2736/5768] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:46:54 2022] GET /compute/v2.1/servers/971b44e4-41fc-40a8-907a-71f5345eaf01 => generated 1209 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:46:55.364102 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5c25105c-7824-4a62-bf93-47972bc29673 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:55.365351 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5c25105c-7824-4a62-bf93-47972bc29673 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] [instance: 828cda24-b238-44bb-9007-142bbd02c041] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:55.372762 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5c25105c-7824-4a62-bf93-47972bc29673 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:55.374982 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5c25105c-7824-4a62-bf93-47972bc29673 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:55.375650 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5c25105c-7824-4a62-bf93-47972bc29673 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:55.376744 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5c25105c-7824-4a62-bf93-47972bc29673 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:55.377408 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5c25105c-7824-4a62-bf93-47972bc29673 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:55.378013 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5c25105c-7824-4a62-bf93-47972bc29673 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:55.490237 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5c25105c-7824-4a62-bf93-47972bc29673 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:55.519906 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5c25105c-7824-4a62-bf93-47972bc29673 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:55.521480 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5c25105c-7824-4a62-bf93-47972bc29673 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:55.523743 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5c25105c-7824-4a62-bf93-47972bc29673 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] 10.222.0.20 "GET /compute/v2.1/servers/828cda24-b238-44bb-9007-142bbd02c041" status: 200 len: 1273 microversion: 2.47 time: 0.164669 Oct 27 03:46:55.530102 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3033/5769] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:46:55 2022] GET /compute/v2.1/servers/828cda24-b238-44bb-9007-142bbd02c041 => generated 1273 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:46:55.750964 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b735d806-2cb6-46f1-a2fe-c6461ba0f34e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:55.750964 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b735d806-2cb6-46f1-a2fe-c6461ba0f34e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 971b44e4-41fc-40a8-907a-71f5345eaf01] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:55.818698 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b735d806-2cb6-46f1-a2fe-c6461ba0f34e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:55.828760 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b735d806-2cb6-46f1-a2fe-c6461ba0f34e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/971b44e4-41fc-40a8-907a-71f5345eaf01" status: 200 len: 1209 microversion: 2.1 time: 0.081464 Oct 27 03:46:55.829406 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2737/5770] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:46:55 2022] GET /compute/v2.1/servers/971b44e4-41fc-40a8-907a-71f5345eaf01 => generated 1209 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:46:56.553385 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-fdfd1a1b-a82f-40d8-99ba-36b3cb86cdfe tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:56.555057 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-fdfd1a1b-a82f-40d8-99ba-36b3cb86cdfe tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] [instance: 828cda24-b238-44bb-9007-142bbd02c041] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:56.568599 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fdfd1a1b-a82f-40d8-99ba-36b3cb86cdfe tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:56.569488 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fdfd1a1b-a82f-40d8-99ba-36b3cb86cdfe tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:56.570272 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fdfd1a1b-a82f-40d8-99ba-36b3cb86cdfe tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:56.571849 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fdfd1a1b-a82f-40d8-99ba-36b3cb86cdfe tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:56.572587 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fdfd1a1b-a82f-40d8-99ba-36b3cb86cdfe tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:56.573292 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fdfd1a1b-a82f-40d8-99ba-36b3cb86cdfe tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:56.732181 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-fdfd1a1b-a82f-40d8-99ba-36b3cb86cdfe tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:56.744401 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-fdfd1a1b-a82f-40d8-99ba-36b3cb86cdfe tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:56.745876 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-fdfd1a1b-a82f-40d8-99ba-36b3cb86cdfe tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:56.747221 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-fdfd1a1b-a82f-40d8-99ba-36b3cb86cdfe tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] 10.222.0.20 "GET /compute/v2.1/servers/828cda24-b238-44bb-9007-142bbd02c041" status: 200 len: 1337 microversion: 2.47 time: 0.197682 Oct 27 03:46:56.764377 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3034/5771] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:46:56 2022] GET /compute/v2.1/servers/828cda24-b238-44bb-9007-142bbd02c041 => generated 1337 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:46:56.853198 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c6c7b7d8-bfd0-4da1-9b59-f48946aa753a tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:56.854456 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c6c7b7d8-bfd0-4da1-9b59-f48946aa753a tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 971b44e4-41fc-40a8-907a-71f5345eaf01] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:56.861302 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c6c7b7d8-bfd0-4da1-9b59-f48946aa753a tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:56.864764 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c6c7b7d8-bfd0-4da1-9b59-f48946aa753a tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:56.866996 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c6c7b7d8-bfd0-4da1-9b59-f48946aa753a tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:56.872281 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c6c7b7d8-bfd0-4da1-9b59-f48946aa753a tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:56.872281 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c6c7b7d8-bfd0-4da1-9b59-f48946aa753a tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:56.872762 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c6c7b7d8-bfd0-4da1-9b59-f48946aa753a tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:57.023763 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c6c7b7d8-bfd0-4da1-9b59-f48946aa753a tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:57.035835 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c6c7b7d8-bfd0-4da1-9b59-f48946aa753a tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/971b44e4-41fc-40a8-907a-71f5345eaf01" status: 200 len: 1261 microversion: 2.1 time: 0.186903 Oct 27 03:46:57.038360 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2738/5772] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:46:56 2022] GET /compute/v2.1/servers/971b44e4-41fc-40a8-907a-71f5345eaf01 => generated 1261 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:46:57.777844 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-679c1e3c-13b2-48c9-8c77-4c13e4677c9c tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:57.778537 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-679c1e3c-13b2-48c9-8c77-4c13e4677c9c tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] [instance: 828cda24-b238-44bb-9007-142bbd02c041] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:57.790741 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-679c1e3c-13b2-48c9-8c77-4c13e4677c9c tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:57.792903 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-679c1e3c-13b2-48c9-8c77-4c13e4677c9c tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:57.793552 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-679c1e3c-13b2-48c9-8c77-4c13e4677c9c tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:57.795335 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-679c1e3c-13b2-48c9-8c77-4c13e4677c9c tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:57.797259 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-679c1e3c-13b2-48c9-8c77-4c13e4677c9c tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:57.798783 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-679c1e3c-13b2-48c9-8c77-4c13e4677c9c tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:57.945750 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-679c1e3c-13b2-48c9-8c77-4c13e4677c9c tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:57.958243 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-679c1e3c-13b2-48c9-8c77-4c13e4677c9c tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:57.968376 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-679c1e3c-13b2-48c9-8c77-4c13e4677c9c tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:57.972204 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-679c1e3c-13b2-48c9-8c77-4c13e4677c9c tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] 10.222.0.20 "GET /compute/v2.1/servers/828cda24-b238-44bb-9007-142bbd02c041" status: 200 len: 1347 microversion: 2.47 time: 0.198380 Oct 27 03:46:57.973570 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3035/5773] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:46:57 2022] GET /compute/v2.1/servers/828cda24-b238-44bb-9007-142bbd02c041 => generated 1347 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:46:58.077513 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b2fdb744-e883-4f4c-89bc-2493d5a25d01 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:58.078191 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b2fdb744-e883-4f4c-89bc-2493d5a25d01 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 971b44e4-41fc-40a8-907a-71f5345eaf01] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:58.092995 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b2fdb744-e883-4f4c-89bc-2493d5a25d01 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:58.093755 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b2fdb744-e883-4f4c-89bc-2493d5a25d01 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:58.094392 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b2fdb744-e883-4f4c-89bc-2493d5a25d01 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:58.096791 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b2fdb744-e883-4f4c-89bc-2493d5a25d01 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:58.097470 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b2fdb744-e883-4f4c-89bc-2493d5a25d01 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:58.098613 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b2fdb744-e883-4f4c-89bc-2493d5a25d01 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:58.189396 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b2fdb744-e883-4f4c-89bc-2493d5a25d01 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:58.202086 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b2fdb744-e883-4f4c-89bc-2493d5a25d01 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/971b44e4-41fc-40a8-907a-71f5345eaf01" status: 200 len: 1279 microversion: 2.1 time: 0.129083 Oct 27 03:46:58.205002 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2739/5774] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:46:58 2022] GET /compute/v2.1/servers/971b44e4-41fc-40a8-907a-71f5345eaf01 => generated 1279 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:46:59.006233 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8add5935-37e5-4bc2-9c88-042065c8cc8a tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:59.006977 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8add5935-37e5-4bc2-9c88-042065c8cc8a tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] [instance: 828cda24-b238-44bb-9007-142bbd02c041] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:59.032105 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8add5935-37e5-4bc2-9c88-042065c8cc8a tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:59.034993 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8add5935-37e5-4bc2-9c88-042065c8cc8a tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:59.035512 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8add5935-37e5-4bc2-9c88-042065c8cc8a tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:59.039851 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8add5935-37e5-4bc2-9c88-042065c8cc8a tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:59.042123 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8add5935-37e5-4bc2-9c88-042065c8cc8a tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:59.046159 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8add5935-37e5-4bc2-9c88-042065c8cc8a tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:59.247737 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-fb794e97-5c1e-478c-b38d-98cf61b6820a tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:46:59.247737 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-fb794e97-5c1e-478c-b38d-98cf61b6820a tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 971b44e4-41fc-40a8-907a-71f5345eaf01] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:46:59.268948 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fb794e97-5c1e-478c-b38d-98cf61b6820a tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:59.269486 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fb794e97-5c1e-478c-b38d-98cf61b6820a tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:59.270346 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fb794e97-5c1e-478c-b38d-98cf61b6820a tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:59.282004 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fb794e97-5c1e-478c-b38d-98cf61b6820a tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:46:59.282004 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fb794e97-5c1e-478c-b38d-98cf61b6820a tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:46:59.282004 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fb794e97-5c1e-478c-b38d-98cf61b6820a tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:46:59.395116 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8add5935-37e5-4bc2-9c88-042065c8cc8a tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:59.407605 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8add5935-37e5-4bc2-9c88-042065c8cc8a tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:59.413424 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8add5935-37e5-4bc2-9c88-042065c8cc8a tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:59.414805 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8add5935-37e5-4bc2-9c88-042065c8cc8a tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] 10.222.0.20 "GET /compute/v2.1/servers/828cda24-b238-44bb-9007-142bbd02c041" status: 200 len: 1335 microversion: 2.47 time: 0.413338 Oct 27 03:46:59.428399 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3036/5775] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:46:59 2022] GET /compute/v2.1/servers/828cda24-b238-44bb-9007-142bbd02c041 => generated 1335 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:46:59.771665 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-fb794e97-5c1e-478c-b38d-98cf61b6820a tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:46:59.788091 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-fb794e97-5c1e-478c-b38d-98cf61b6820a tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/971b44e4-41fc-40a8-907a-71f5345eaf01" status: 200 len: 1309 microversion: 2.1 time: 0.557789 Oct 27 03:46:59.793532 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2740/5776] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:46:59 2022] GET /compute/v2.1/servers/971b44e4-41fc-40a8-907a-71f5345eaf01 => generated 1309 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:47:00.472800 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-997ab016-b41d-46f4-a4eb-2e54a3453aba tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:00.476092 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-997ab016-b41d-46f4-a4eb-2e54a3453aba tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] [instance: 828cda24-b238-44bb-9007-142bbd02c041] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:00.497097 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-997ab016-b41d-46f4-a4eb-2e54a3453aba tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:00.497704 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-997ab016-b41d-46f4-a4eb-2e54a3453aba tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:00.502482 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-997ab016-b41d-46f4-a4eb-2e54a3453aba tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:00.503369 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-997ab016-b41d-46f4-a4eb-2e54a3453aba tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:00.504059 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-997ab016-b41d-46f4-a4eb-2e54a3453aba tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:00.504677 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-997ab016-b41d-46f4-a4eb-2e54a3453aba tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:00.668228 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-997ab016-b41d-46f4-a4eb-2e54a3453aba tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:00.682343 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-997ab016-b41d-46f4-a4eb-2e54a3453aba tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:00.688294 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-997ab016-b41d-46f4-a4eb-2e54a3453aba tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:00.691506 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-997ab016-b41d-46f4-a4eb-2e54a3453aba tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] 10.222.0.20 "GET /compute/v2.1/servers/828cda24-b238-44bb-9007-142bbd02c041" status: 200 len: 1335 microversion: 2.47 time: 0.224367 Oct 27 03:47:00.692113 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3037/5777] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:47:00 2022] GET /compute/v2.1/servers/828cda24-b238-44bb-9007-142bbd02c041 => generated 1335 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:47:00.824642 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-eb13b8c8-66f9-4941-bba0-e690583ae30f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:00.829433 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-eb13b8c8-66f9-4941-bba0-e690583ae30f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 971b44e4-41fc-40a8-907a-71f5345eaf01] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:00.839081 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eb13b8c8-66f9-4941-bba0-e690583ae30f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:00.839081 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eb13b8c8-66f9-4941-bba0-e690583ae30f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:00.839081 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eb13b8c8-66f9-4941-bba0-e690583ae30f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:00.839081 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eb13b8c8-66f9-4941-bba0-e690583ae30f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:00.839081 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eb13b8c8-66f9-4941-bba0-e690583ae30f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:00.839081 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eb13b8c8-66f9-4941-bba0-e690583ae30f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:01.465024 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-eb13b8c8-66f9-4941-bba0-e690583ae30f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:01.477678 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-eb13b8c8-66f9-4941-bba0-e690583ae30f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/971b44e4-41fc-40a8-907a-71f5345eaf01" status: 200 len: 1309 microversion: 2.1 time: 0.660218 Oct 27 03:47:01.478327 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2741/5778] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:47:00 2022] GET /compute/v2.1/servers/971b44e4-41fc-40a8-907a-71f5345eaf01 => generated 1309 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:47:01.509641 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-c57a5a70-614a-4bb4-a64f-cc2777d9ece2 req-b585a8fd-7402-4bbc-9812-fbef6534287a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "971b44e4-41fc-40a8-907a-71f5345eaf01", "tag": "d2050a44-1676-4376-82f8-9669da31bb6c"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:47:01.532837 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-c57a5a70-614a-4bb4-a64f-cc2777d9ece2 req-b585a8fd-7402-4bbc-9812-fbef6534287a service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:01.535438 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-c57a5a70-614a-4bb4-a64f-cc2777d9ece2 req-b585a8fd-7402-4bbc-9812-fbef6534287a service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:01.535438 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-c57a5a70-614a-4bb4-a64f-cc2777d9ece2 req-b585a8fd-7402-4bbc-9812-fbef6534287a service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:01.575325 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-c57a5a70-614a-4bb4-a64f-cc2777d9ece2 req-b585a8fd-7402-4bbc-9812-fbef6534287a service nova] Creating event network-changed:d2050a44-1676-4376-82f8-9669da31bb6c for instance 971b44e4-41fc-40a8-907a-71f5345eaf01 on n-h2-862769-1 Oct 27 03:47:01.597480 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-c57a5a70-614a-4bb4-a64f-cc2777d9ece2 req-b585a8fd-7402-4bbc-9812-fbef6534287a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.468072 Oct 27 03:47:01.607939 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3038/5779] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:47:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:47:01.723645 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-521761c1-6cab-4e72-9c28-c21df5b64dc9 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:01.725508 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-521761c1-6cab-4e72-9c28-c21df5b64dc9 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] [instance: 828cda24-b238-44bb-9007-142bbd02c041] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:01.732070 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-521761c1-6cab-4e72-9c28-c21df5b64dc9 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:01.736793 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-521761c1-6cab-4e72-9c28-c21df5b64dc9 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:01.736793 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-521761c1-6cab-4e72-9c28-c21df5b64dc9 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:01.736793 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-521761c1-6cab-4e72-9c28-c21df5b64dc9 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:01.736793 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-521761c1-6cab-4e72-9c28-c21df5b64dc9 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:01.736793 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-521761c1-6cab-4e72-9c28-c21df5b64dc9 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:01.875603 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-521761c1-6cab-4e72-9c28-c21df5b64dc9 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:01.890568 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-521761c1-6cab-4e72-9c28-c21df5b64dc9 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:01.892416 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-521761c1-6cab-4e72-9c28-c21df5b64dc9 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:01.894483 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-521761c1-6cab-4e72-9c28-c21df5b64dc9 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] 10.222.0.20 "GET /compute/v2.1/servers/828cda24-b238-44bb-9007-142bbd02c041" status: 200 len: 1356 microversion: 2.47 time: 0.175485 Oct 27 03:47:01.906314 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2742/5780] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:47:01 2022] GET /compute/v2.1/servers/828cda24-b238-44bb-9007-142bbd02c041 => generated 1356 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:47:01.924132 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7b33bf53-26ff-47c4-aa15-d6c7e66eaa16 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:47:01.954901 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7b33bf53-26ff-47c4-aa15-d6c7e66eaa16 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] [instance: 828cda24-b238-44bb-9007-142bbd02c041] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:01.978832 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7b33bf53-26ff-47c4-aa15-d6c7e66eaa16 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:01.981709 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7b33bf53-26ff-47c4-aa15-d6c7e66eaa16 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:01.981709 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7b33bf53-26ff-47c4-aa15-d6c7e66eaa16 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:01.981709 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7b33bf53-26ff-47c4-aa15-d6c7e66eaa16 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:01.981709 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7b33bf53-26ff-47c4-aa15-d6c7e66eaa16 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:01.985548 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7b33bf53-26ff-47c4-aa15-d6c7e66eaa16 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:02.145295 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-7b33bf53-26ff-47c4-aa15-d6c7e66eaa16 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Flavor limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:47:02.146013 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-7b33bf53-26ff-47c4-aa15-d6c7e66eaa16 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Image limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:47:02.146712 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-7b33bf53-26ff-47c4-aa15-d6c7e66eaa16 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Flavor pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:47:02.147311 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-7b33bf53-26ff-47c4-aa15-d6c7e66eaa16 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Image pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:47:02.147911 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-7b33bf53-26ff-47c4-aa15-d6c7e66eaa16 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:47:02.237532 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:02.501795 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e4944937-30c5-4dd2-8c95-36dff3a2e34b tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:02.502823 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e4944937-30c5-4dd2-8c95-36dff3a2e34b tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 971b44e4-41fc-40a8-907a-71f5345eaf01] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:02.509858 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e4944937-30c5-4dd2-8c95-36dff3a2e34b tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:02.510949 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e4944937-30c5-4dd2-8c95-36dff3a2e34b tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:02.511791 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e4944937-30c5-4dd2-8c95-36dff3a2e34b tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:02.512757 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e4944937-30c5-4dd2-8c95-36dff3a2e34b tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:02.513445 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e4944937-30c5-4dd2-8c95-36dff3a2e34b tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:02.514154 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e4944937-30c5-4dd2-8c95-36dff3a2e34b tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:02.781872 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=4 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:02.822697 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7b33bf53-26ff-47c4-aa15-d6c7e66eaa16 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] [instance: 828cda24-b238-44bb-9007-142bbd02c041] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:02.839343 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:02.844885 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7b33bf53-26ff-47c4-aa15-d6c7e66eaa16 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:02.844885 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7b33bf53-26ff-47c4-aa15-d6c7e66eaa16 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:02.846518 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7b33bf53-26ff-47c4-aa15-d6c7e66eaa16 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:02.852179 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7b33bf53-26ff-47c4-aa15-d6c7e66eaa16 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:02.854127 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7b33bf53-26ff-47c4-aa15-d6c7e66eaa16 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:02.854771 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7b33bf53-26ff-47c4-aa15-d6c7e66eaa16 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:02.991066 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7b33bf53-26ff-47c4-aa15-d6c7e66eaa16 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] 10.222.0.20 "POST /compute/v2.1/servers/828cda24-b238-44bb-9007-142bbd02c041/action" status: 202 len: 1078 microversion: 2.47 time: 1.072233 Oct 27 03:47:02.992359 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3039/5781] 10.222.0.20 () {62 vars in 1319 bytes} [Thu Oct 27 03:47:01 2022] POST /compute/v2.1/servers/828cda24-b238-44bb-9007-142bbd02c041/action => generated 1078 bytes in 1074 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 27 03:47:03.018546 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-bbb4becb-67d1-4ed5-bd80-e4638733c838 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:03.019741 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-bbb4becb-67d1-4ed5-bd80-e4638733c838 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] [instance: 828cda24-b238-44bb-9007-142bbd02c041] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:03.039896 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bbb4becb-67d1-4ed5-bd80-e4638733c838 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:03.072496 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bbb4becb-67d1-4ed5-bd80-e4638733c838 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.034s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:03.081313 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bbb4becb-67d1-4ed5-bd80-e4638733c838 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:03.082786 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bbb4becb-67d1-4ed5-bd80-e4638733c838 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:03.086587 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bbb4becb-67d1-4ed5-bd80-e4638733c838 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:03.086587 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bbb4becb-67d1-4ed5-bd80-e4638733c838 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:03.242880 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e4944937-30c5-4dd2-8c95-36dff3a2e34b tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:03.269959 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e4944937-30c5-4dd2-8c95-36dff3a2e34b tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/971b44e4-41fc-40a8-907a-71f5345eaf01" status: 200 len: 1309 microversion: 2.1 time: 0.766305 Oct 27 03:47:03.269959 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2743/5782] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:47:02 2022] GET /compute/v2.1/servers/971b44e4-41fc-40a8-907a-71f5345eaf01 => generated 1309 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:47:03.283256 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-bbb4becb-67d1-4ed5-bd80-e4638733c838 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:03.303206 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-bbb4becb-67d1-4ed5-bd80-e4638733c838 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:03.309879 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-bbb4becb-67d1-4ed5-bd80-e4638733c838 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:03.332930 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-bbb4becb-67d1-4ed5-bd80-e4638733c838 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] 10.222.0.20 "GET /compute/v2.1/servers/828cda24-b238-44bb-9007-142bbd02c041" status: 200 len: 1365 microversion: 2.47 time: 0.315949 Oct 27 03:47:03.334371 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3040/5783] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:47:03 2022] GET /compute/v2.1/servers/828cda24-b238-44bb-9007-142bbd02c041 => generated 1365 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:47:04.294090 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8e5525ac-c490-4277-a562-e9413d9a401c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:04.295333 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8e5525ac-c490-4277-a562-e9413d9a401c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 971b44e4-41fc-40a8-907a-71f5345eaf01] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:04.324112 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8e5525ac-c490-4277-a562-e9413d9a401c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:04.325208 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8e5525ac-c490-4277-a562-e9413d9a401c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:04.334477 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8e5525ac-c490-4277-a562-e9413d9a401c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:04.335483 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8e5525ac-c490-4277-a562-e9413d9a401c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:04.341554 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8e5525ac-c490-4277-a562-e9413d9a401c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:04.343643 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8e5525ac-c490-4277-a562-e9413d9a401c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:04.363342 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=99 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:04.366682 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b53a22bf-85c7-4927-b0b1-b4f08838c613 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:04.370068 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b53a22bf-85c7-4927-b0b1-b4f08838c613 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] [instance: 828cda24-b238-44bb-9007-142bbd02c041] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:04.385228 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:04.395092 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=6 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:04.397188 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b53a22bf-85c7-4927-b0b1-b4f08838c613 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:04.397881 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b53a22bf-85c7-4927-b0b1-b4f08838c613 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:04.399128 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b53a22bf-85c7-4927-b0b1-b4f08838c613 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:04.403677 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b53a22bf-85c7-4927-b0b1-b4f08838c613 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:04.405014 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b53a22bf-85c7-4927-b0b1-b4f08838c613 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:04.407744 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b53a22bf-85c7-4927-b0b1-b4f08838c613 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:04.667149 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b53a22bf-85c7-4927-b0b1-b4f08838c613 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:04.687627 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b53a22bf-85c7-4927-b0b1-b4f08838c613 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:04.690426 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b53a22bf-85c7-4927-b0b1-b4f08838c613 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:04.692229 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b53a22bf-85c7-4927-b0b1-b4f08838c613 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] 10.222.0.20 "GET /compute/v2.1/servers/828cda24-b238-44bb-9007-142bbd02c041" status: 200 len: 1365 microversion: 2.47 time: 0.330918 Oct 27 03:47:04.708998 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3041/5784] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:47:04 2022] GET /compute/v2.1/servers/828cda24-b238-44bb-9007-142bbd02c041 => generated 1365 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:47:04.869691 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8e5525ac-c490-4277-a562-e9413d9a401c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:04.883812 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8e5525ac-c490-4277-a562-e9413d9a401c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/971b44e4-41fc-40a8-907a-71f5345eaf01" status: 200 len: 1309 microversion: 2.1 time: 0.593581 Oct 27 03:47:04.884432 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2744/5785] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:47:04 2022] GET /compute/v2.1/servers/971b44e4-41fc-40a8-907a-71f5345eaf01 => generated 1309 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:47:05.741281 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a29ff155-799b-434c-92a6-8f105aa32e3e tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:05.745569 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a29ff155-799b-434c-92a6-8f105aa32e3e tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] [instance: 828cda24-b238-44bb-9007-142bbd02c041] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:05.752322 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a29ff155-799b-434c-92a6-8f105aa32e3e tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:05.753121 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a29ff155-799b-434c-92a6-8f105aa32e3e tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:05.755415 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a29ff155-799b-434c-92a6-8f105aa32e3e tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:05.756282 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a29ff155-799b-434c-92a6-8f105aa32e3e tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:05.758815 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a29ff155-799b-434c-92a6-8f105aa32e3e tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:05.760588 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a29ff155-799b-434c-92a6-8f105aa32e3e tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:05.867010 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a29ff155-799b-434c-92a6-8f105aa32e3e tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:05.879553 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a29ff155-799b-434c-92a6-8f105aa32e3e tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:05.881966 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a29ff155-799b-434c-92a6-8f105aa32e3e tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:05.883759 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a29ff155-799b-434c-92a6-8f105aa32e3e tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] 10.222.0.20 "GET /compute/v2.1/servers/828cda24-b238-44bb-9007-142bbd02c041" status: 200 len: 1365 microversion: 2.47 time: 0.156169 Oct 27 03:47:05.884889 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3042/5786] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:47:05 2022] GET /compute/v2.1/servers/828cda24-b238-44bb-9007-142bbd02c041 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:47:05.897988 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=22 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:05.913993 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c5e4175d-df28-4260-9faa-f1abb41ffd00 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:05.915245 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c5e4175d-df28-4260-9faa-f1abb41ffd00 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 971b44e4-41fc-40a8-907a-71f5345eaf01] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:05.927503 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c5e4175d-df28-4260-9faa-f1abb41ffd00 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:05.928016 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c5e4175d-df28-4260-9faa-f1abb41ffd00 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:05.928464 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c5e4175d-df28-4260-9faa-f1abb41ffd00 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:05.929188 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c5e4175d-df28-4260-9faa-f1abb41ffd00 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:05.929659 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c5e4175d-df28-4260-9faa-f1abb41ffd00 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:05.930121 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c5e4175d-df28-4260-9faa-f1abb41ffd00 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:06.156431 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c5e4175d-df28-4260-9faa-f1abb41ffd00 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:06.168822 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c5e4175d-df28-4260-9faa-f1abb41ffd00 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/971b44e4-41fc-40a8-907a-71f5345eaf01" status: 200 len: 1309 microversion: 2.1 time: 0.260133 Oct 27 03:47:06.174437 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3043/5787] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:47:05 2022] GET /compute/v2.1/servers/971b44e4-41fc-40a8-907a-71f5345eaf01 => generated 1309 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:47:06.311242 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-265b9469-c568-4373-9cfe-9312b3af1909 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-876351449", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "f90a174d-8b5f-4312-ba5e-0dfae4fc1d82"}]}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:47:06.440987 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-265b9469-c568-4373-9cfe-9312b3af1909 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] validate_networks() for [('f90a174d-8b5f-4312-ba5e-0dfae4fc1d82', None, None, None, None, None)] {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:47:07.210221 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-265b9469-c568-4373-9cfe-9312b3af1909 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:47:07.212040 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-265b9469-c568-4373-9cfe-9312b3af1909 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:47:07.213157 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-265b9469-c568-4373-9cfe-9312b3af1909 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:47:07.213694 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-265b9469-c568-4373-9cfe-9312b3af1909 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:47:07.214396 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-265b9469-c568-4373-9cfe-9312b3af1909 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:47:07.228768 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-265b9469-c568-4373-9cfe-9312b3af1909 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:07.229127 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-265b9469-c568-4373-9cfe-9312b3af1909 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:07.230864 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-265b9469-c568-4373-9cfe-9312b3af1909 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:07.233958 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-265b9469-c568-4373-9cfe-9312b3af1909 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:07.246382 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-265b9469-c568-4373-9cfe-9312b3af1909 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:07.247061 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-265b9469-c568-4373-9cfe-9312b3af1909 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:07.296675 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-265b9469-c568-4373-9cfe-9312b3af1909 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Getting quotas for project 14a3cfa6aaa74174a706a759f692c113. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:47:07.323741 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-265b9469-c568-4373-9cfe-9312b3af1909 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Getting quotas for user b4dae167878b41699b8caae5a0386cf4 and project 14a3cfa6aaa74174a706a759f692c113. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:47:07.353635 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-b141fa28-8571-4b9b-a664-346c159cb505 req-39c80da0-d90d-4eee-884c-40185565d4da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "971b44e4-41fc-40a8-907a-71f5345eaf01", "name": "network-vif-plugged", "status": "completed", "tag": "d2050a44-1676-4376-82f8-9669da31bb6c"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:47:07.362655 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-265b9469-c568-4373-9cfe-9312b3af1909 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:47:07.371951 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-265b9469-c568-4373-9cfe-9312b3af1909 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] [instance: 4068c7d8-3bbf-47cf-93ef-fded8f5094fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:47:07.375670 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-b141fa28-8571-4b9b-a664-346c159cb505 req-39c80da0-d90d-4eee-884c-40185565d4da service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:07.376176 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-b141fa28-8571-4b9b-a664-346c159cb505 req-39c80da0-d90d-4eee-884c-40185565d4da service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:07.376658 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-b141fa28-8571-4b9b-a664-346c159cb505 req-39c80da0-d90d-4eee-884c-40185565d4da service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:07.410409 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-b141fa28-8571-4b9b-a664-346c159cb505 req-39c80da0-d90d-4eee-884c-40185565d4da service nova] Creating event network-vif-plugged:d2050a44-1676-4376-82f8-9669da31bb6c for instance 971b44e4-41fc-40a8-907a-71f5345eaf01 on n-h2-862769-1 Oct 27 03:47:07.424418 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-b141fa28-8571-4b9b-a664-346c159cb505 req-39c80da0-d90d-4eee-884c-40185565d4da service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.631672 Oct 27 03:47:07.425382 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3044/5788] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:47:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:47:07.437243 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6628ecb0-4f81-45fc-98c2-97b7efda76d3 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:07.438025 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-6628ecb0-4f81-45fc-98c2-97b7efda76d3 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] [instance: 828cda24-b238-44bb-9007-142bbd02c041] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:07.448930 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6628ecb0-4f81-45fc-98c2-97b7efda76d3 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:07.449354 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6628ecb0-4f81-45fc-98c2-97b7efda76d3 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:07.449809 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6628ecb0-4f81-45fc-98c2-97b7efda76d3 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:07.450552 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6628ecb0-4f81-45fc-98c2-97b7efda76d3 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:07.455902 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6628ecb0-4f81-45fc-98c2-97b7efda76d3 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:07.456599 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6628ecb0-4f81-45fc-98c2-97b7efda76d3 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:07.579972 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-265b9469-c568-4373-9cfe-9312b3af1909 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.690306 Oct 27 03:47:07.584243 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2745/5789] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:47:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1695 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 03:47:07.590164 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ccd8f3e1-3507-4e1a-8293-bb89c95b25fb tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:07.591174 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ccd8f3e1-3507-4e1a-8293-bb89c95b25fb tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 971b44e4-41fc-40a8-907a-71f5345eaf01] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:07.599074 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ccd8f3e1-3507-4e1a-8293-bb89c95b25fb tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:07.599908 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ccd8f3e1-3507-4e1a-8293-bb89c95b25fb tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:07.600674 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ccd8f3e1-3507-4e1a-8293-bb89c95b25fb tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:07.601677 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ccd8f3e1-3507-4e1a-8293-bb89c95b25fb tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:07.602416 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ccd8f3e1-3507-4e1a-8293-bb89c95b25fb tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:07.606490 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ccd8f3e1-3507-4e1a-8293-bb89c95b25fb tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:07.650811 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6628ecb0-4f81-45fc-98c2-97b7efda76d3 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:07.661861 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6628ecb0-4f81-45fc-98c2-97b7efda76d3 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:07.665500 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6628ecb0-4f81-45fc-98c2-97b7efda76d3 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:07.671055 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6628ecb0-4f81-45fc-98c2-97b7efda76d3 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] 10.222.0.20 "GET /compute/v2.1/servers/828cda24-b238-44bb-9007-142bbd02c041" status: 200 len: 1365 microversion: 2.47 time: 0.244376 Oct 27 03:47:07.692740 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3045/5790] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:47:07 2022] GET /compute/v2.1/servers/828cda24-b238-44bb-9007-142bbd02c041 => generated 1365 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:47:07.706756 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a9ca22ba-21c7-43ab-a6c6-f6303027da97 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:07.707394 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a9ca22ba-21c7-43ab-a6c6-f6303027da97 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] [instance: 4068c7d8-3bbf-47cf-93ef-fded8f5094fe] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:07.797866 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a9ca22ba-21c7-43ab-a6c6-f6303027da97 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4dae167878b41699b8caae5a0386cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a3cfa6aaa74174a706a759f692c113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:07.810983 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a9ca22ba-21c7-43ab-a6c6-f6303027da97 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] 10.222.0.20 "GET /compute/v2.1/servers/4068c7d8-3bbf-47cf-93ef-fded8f5094fe" status: 200 len: 1223 microversion: 2.1 time: 0.116824 Oct 27 03:47:07.813322 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3046/5791] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:47:07 2022] GET /compute/v2.1/servers/4068c7d8-3bbf-47cf-93ef-fded8f5094fe => generated 1223 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:47:08.022290 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ccd8f3e1-3507-4e1a-8293-bb89c95b25fb tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:08.032809 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ccd8f3e1-3507-4e1a-8293-bb89c95b25fb tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/971b44e4-41fc-40a8-907a-71f5345eaf01" status: 200 len: 1309 microversion: 2.1 time: 0.446968 Oct 27 03:47:08.034208 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2746/5792] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:47:07 2022] GET /compute/v2.1/servers/971b44e4-41fc-40a8-907a-71f5345eaf01 => generated 1309 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:47:08.703134 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-cd881c35-01ac-499b-a4ad-180557f83b30 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:08.703901 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-cd881c35-01ac-499b-a4ad-180557f83b30 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] [instance: 828cda24-b238-44bb-9007-142bbd02c041] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:08.719569 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cd881c35-01ac-499b-a4ad-180557f83b30 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:08.720595 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cd881c35-01ac-499b-a4ad-180557f83b30 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:08.721791 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cd881c35-01ac-499b-a4ad-180557f83b30 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:08.725715 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cd881c35-01ac-499b-a4ad-180557f83b30 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:08.728701 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cd881c35-01ac-499b-a4ad-180557f83b30 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:08.729098 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cd881c35-01ac-499b-a4ad-180557f83b30 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:08.842275 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-abe2d54e-d40f-4fd7-9d4c-b89cc38afe4c tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:08.845150 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-abe2d54e-d40f-4fd7-9d4c-b89cc38afe4c tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] [instance: 4068c7d8-3bbf-47cf-93ef-fded8f5094fe] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:08.871318 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-cd881c35-01ac-499b-a4ad-180557f83b30 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:08.902364 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-cd881c35-01ac-499b-a4ad-180557f83b30 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:08.912193 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-cd881c35-01ac-499b-a4ad-180557f83b30 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:08.918263 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-cd881c35-01ac-499b-a4ad-180557f83b30 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] 10.222.0.20 "GET /compute/v2.1/servers/828cda24-b238-44bb-9007-142bbd02c041" status: 200 len: 1365 microversion: 2.47 time: 0.219551 Oct 27 03:47:08.928887 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3047/5793] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:47:08 2022] GET /compute/v2.1/servers/828cda24-b238-44bb-9007-142bbd02c041 => generated 1365 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:47:09.002803 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-abe2d54e-d40f-4fd7-9d4c-b89cc38afe4c tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4dae167878b41699b8caae5a0386cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a3cfa6aaa74174a706a759f692c113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:09.022736 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-abe2d54e-d40f-4fd7-9d4c-b89cc38afe4c tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] 10.222.0.20 "GET /compute/v2.1/servers/4068c7d8-3bbf-47cf-93ef-fded8f5094fe" status: 200 len: 1223 microversion: 2.1 time: 0.187465 Oct 27 03:47:09.026547 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2747/5794] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:47:08 2022] GET /compute/v2.1/servers/4068c7d8-3bbf-47cf-93ef-fded8f5094fe => generated 1223 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:47:09.057015 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-bd8260d4-36bb-4318-9887-07bdf0d980f6 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:09.061133 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-bd8260d4-36bb-4318-9887-07bdf0d980f6 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 971b44e4-41fc-40a8-907a-71f5345eaf01] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:09.065152 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bd8260d4-36bb-4318-9887-07bdf0d980f6 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:09.065920 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bd8260d4-36bb-4318-9887-07bdf0d980f6 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:09.066555 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bd8260d4-36bb-4318-9887-07bdf0d980f6 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:09.067478 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bd8260d4-36bb-4318-9887-07bdf0d980f6 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:09.068122 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bd8260d4-36bb-4318-9887-07bdf0d980f6 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:09.068786 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bd8260d4-36bb-4318-9887-07bdf0d980f6 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:09.500514 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-bd8260d4-36bb-4318-9887-07bdf0d980f6 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:09.508370 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-bd8260d4-36bb-4318-9887-07bdf0d980f6 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/971b44e4-41fc-40a8-907a-71f5345eaf01" status: 200 len: 1491 microversion: 2.1 time: 0.455870 Oct 27 03:47:09.508975 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3048/5795] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:47:09 2022] GET /compute/v2.1/servers/971b44e4-41fc-40a8-907a-71f5345eaf01 => generated 1491 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:47:09.792682 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6f30f5be-5b0b-408f-a48a-1eb8a4121ab2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-2022649655", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": [{"uuid": "6ad05158-ac44-4c49-b5d6-443f42165c93"}]}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:47:09.918894 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-6f30f5be-5b0b-408f-a48a-1eb8a4121ab2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] validate_networks() for [('6ad05158-ac44-4c49-b5d6-443f42165c93', None, None, None, None, None)] {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:47:09.960479 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-56aedd6a-fb56-4b74-a1cb-8ad32b0d730e tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:09.964201 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-56aedd6a-fb56-4b74-a1cb-8ad32b0d730e tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] [instance: 828cda24-b238-44bb-9007-142bbd02c041] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:09.972439 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-56aedd6a-fb56-4b74-a1cb-8ad32b0d730e tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:09.974558 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-56aedd6a-fb56-4b74-a1cb-8ad32b0d730e tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:09.974558 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-56aedd6a-fb56-4b74-a1cb-8ad32b0d730e tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:09.974558 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-56aedd6a-fb56-4b74-a1cb-8ad32b0d730e tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:09.975010 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-56aedd6a-fb56-4b74-a1cb-8ad32b0d730e tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:09.975010 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-56aedd6a-fb56-4b74-a1cb-8ad32b0d730e tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:10.158903 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-56aedd6a-fb56-4b74-a1cb-8ad32b0d730e tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:10.162772 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-56aedd6a-fb56-4b74-a1cb-8ad32b0d730e tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:10.171783 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-56aedd6a-fb56-4b74-a1cb-8ad32b0d730e tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:10.173074 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-56aedd6a-fb56-4b74-a1cb-8ad32b0d730e tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] 10.222.0.20 "GET /compute/v2.1/servers/828cda24-b238-44bb-9007-142bbd02c041" status: 200 len: 1365 microversion: 2.47 time: 0.218398 Oct 27 03:47:10.182611 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3049/5796] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:47:09 2022] GET /compute/v2.1/servers/828cda24-b238-44bb-9007-142bbd02c041 => generated 1365 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:47:10.204168 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6b94b8c7-c276-449b-bb04-41ab103c139b tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:10.204818 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-6b94b8c7-c276-449b-bb04-41ab103c139b tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] [instance: 4068c7d8-3bbf-47cf-93ef-fded8f5094fe] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:10.220306 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6b94b8c7-c276-449b-bb04-41ab103c139b tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:10.221970 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6b94b8c7-c276-449b-bb04-41ab103c139b tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:10.221970 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6b94b8c7-c276-449b-bb04-41ab103c139b tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:10.221970 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6b94b8c7-c276-449b-bb04-41ab103c139b tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:10.222449 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6b94b8c7-c276-449b-bb04-41ab103c139b tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:10.222977 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6b94b8c7-c276-449b-bb04-41ab103c139b tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:10.408949 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6b94b8c7-c276-449b-bb04-41ab103c139b tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4dae167878b41699b8caae5a0386cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a3cfa6aaa74174a706a759f692c113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:10.427428 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6b94b8c7-c276-449b-bb04-41ab103c139b tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] 10.222.0.20 "GET /compute/v2.1/servers/4068c7d8-3bbf-47cf-93ef-fded8f5094fe" status: 200 len: 1219 microversion: 2.1 time: 0.252186 Oct 27 03:47:10.445843 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3050/5797] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:47:10 2022] GET /compute/v2.1/servers/4068c7d8-3bbf-47cf-93ef-fded8f5094fe => generated 1219 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:47:11.037713 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-6f30f5be-5b0b-408f-a48a-1eb8a4121ab2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:47:11.038310 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-6f30f5be-5b0b-408f-a48a-1eb8a4121ab2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:47:11.038705 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-6f30f5be-5b0b-408f-a48a-1eb8a4121ab2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:47:11.039283 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-6f30f5be-5b0b-408f-a48a-1eb8a4121ab2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:47:11.039619 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-6f30f5be-5b0b-408f-a48a-1eb8a4121ab2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:47:11.052775 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6f30f5be-5b0b-408f-a48a-1eb8a4121ab2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:11.053538 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6f30f5be-5b0b-408f-a48a-1eb8a4121ab2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:11.054213 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6f30f5be-5b0b-408f-a48a-1eb8a4121ab2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:11.055130 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6f30f5be-5b0b-408f-a48a-1eb8a4121ab2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:11.055787 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6f30f5be-5b0b-408f-a48a-1eb8a4121ab2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:11.056405 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6f30f5be-5b0b-408f-a48a-1eb8a4121ab2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:11.084293 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-6f30f5be-5b0b-408f-a48a-1eb8a4121ab2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Getting quotas for project 86b90d4cb5eb42958248b6f82516ce19. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:47:11.092808 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-6f30f5be-5b0b-408f-a48a-1eb8a4121ab2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Getting quotas for user ca2da57f02884a968d685b53a5399e46 and project 86b90d4cb5eb42958248b6f82516ce19. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:47:11.108162 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6f30f5be-5b0b-408f-a48a-1eb8a4121ab2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:47:11.111374 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6f30f5be-5b0b-408f-a48a-1eb8a4121ab2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 0d158876-42f7-42da-99f1-c9458db9919e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:47:11.204102 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-87ccdfbc-19a5-432a-ad35-d9b70eb32fe9 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:11.205696 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-87ccdfbc-19a5-432a-ad35-d9b70eb32fe9 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] [instance: 828cda24-b238-44bb-9007-142bbd02c041] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:11.215070 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-87ccdfbc-19a5-432a-ad35-d9b70eb32fe9 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:11.217196 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-87ccdfbc-19a5-432a-ad35-d9b70eb32fe9 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:11.218574 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-87ccdfbc-19a5-432a-ad35-d9b70eb32fe9 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:11.219776 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-87ccdfbc-19a5-432a-ad35-d9b70eb32fe9 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:11.220911 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-87ccdfbc-19a5-432a-ad35-d9b70eb32fe9 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:11.221603 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-87ccdfbc-19a5-432a-ad35-d9b70eb32fe9 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:11.340385 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6f30f5be-5b0b-408f-a48a-1eb8a4121ab2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.548473 Oct 27 03:47:11.341486 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2748/5798] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:47:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1553 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 03:47:11.354344 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1794dafc-5f23-4486-9cd7-7806d7a0bf8f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:11.354344 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1794dafc-5f23-4486-9cd7-7806d7a0bf8f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 0d158876-42f7-42da-99f1-c9458db9919e] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:11.598071 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1794dafc-5f23-4486-9cd7-7806d7a0bf8f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:11.609662 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1794dafc-5f23-4486-9cd7-7806d7a0bf8f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/0d158876-42f7-42da-99f1-c9458db9919e" status: 200 len: 1209 microversion: 2.1 time: 0.260353 Oct 27 03:47:11.611151 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2749/5799] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:47:11 2022] GET /compute/v2.1/servers/0d158876-42f7-42da-99f1-c9458db9919e => generated 1209 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:47:11.626940 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8a4310c2-0b5e-4816-8a77-145b727f06bb tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:11.628839 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8a4310c2-0b5e-4816-8a77-145b727f06bb tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] [instance: 4068c7d8-3bbf-47cf-93ef-fded8f5094fe] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:11.646894 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8a4310c2-0b5e-4816-8a77-145b727f06bb tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:11.647668 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8a4310c2-0b5e-4816-8a77-145b727f06bb tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:11.651636 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8a4310c2-0b5e-4816-8a77-145b727f06bb tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:11.652435 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8a4310c2-0b5e-4816-8a77-145b727f06bb tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:11.655528 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8a4310c2-0b5e-4816-8a77-145b727f06bb tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:11.656009 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8a4310c2-0b5e-4816-8a77-145b727f06bb tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:11.681645 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-87ccdfbc-19a5-432a-ad35-d9b70eb32fe9 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:11.693333 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-87ccdfbc-19a5-432a-ad35-d9b70eb32fe9 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:11.698048 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-87ccdfbc-19a5-432a-ad35-d9b70eb32fe9 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:11.701985 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-87ccdfbc-19a5-432a-ad35-d9b70eb32fe9 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] 10.222.0.20 "GET /compute/v2.1/servers/828cda24-b238-44bb-9007-142bbd02c041" status: 200 len: 1365 microversion: 2.47 time: 0.501709 Oct 27 03:47:11.710338 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3051/5800] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:47:11 2022] GET /compute/v2.1/servers/828cda24-b238-44bb-9007-142bbd02c041 => generated 1365 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:47:11.877914 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8a4310c2-0b5e-4816-8a77-145b727f06bb tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4dae167878b41699b8caae5a0386cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a3cfa6aaa74174a706a759f692c113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:11.916877 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8a4310c2-0b5e-4816-8a77-145b727f06bb tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] 10.222.0.20 "GET /compute/v2.1/servers/4068c7d8-3bbf-47cf-93ef-fded8f5094fe" status: 200 len: 1293 microversion: 2.1 time: 0.276794 Oct 27 03:47:11.916877 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2750/5801] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:47:11 2022] GET /compute/v2.1/servers/4068c7d8-3bbf-47cf-93ef-fded8f5094fe => generated 1293 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:47:12.633718 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a7c51d90-a37a-4848-9648-32506b18e032 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:12.634785 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a7c51d90-a37a-4848-9648-32506b18e032 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 0d158876-42f7-42da-99f1-c9458db9919e] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:12.718332 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a7c51d90-a37a-4848-9648-32506b18e032 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:12.728573 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a7c51d90-a37a-4848-9648-32506b18e032 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/0d158876-42f7-42da-99f1-c9458db9919e" status: 200 len: 1209 microversion: 2.1 time: 0.097885 Oct 27 03:47:12.734322 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6c926eb1-6e3c-4ffd-84cb-65634333d922 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:12.741210 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6c926eb1-6e3c-4ffd-84cb-65634333d922 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] [instance: 828cda24-b238-44bb-9007-142bbd02c041] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:12.743961 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3052/5802] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:47:12 2022] GET /compute/v2.1/servers/0d158876-42f7-42da-99f1-c9458db9919e => generated 1209 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:47:12.746519 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6c926eb1-6e3c-4ffd-84cb-65634333d922 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:12.749448 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6c926eb1-6e3c-4ffd-84cb-65634333d922 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:12.750144 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6c926eb1-6e3c-4ffd-84cb-65634333d922 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:12.751067 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6c926eb1-6e3c-4ffd-84cb-65634333d922 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:12.751746 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6c926eb1-6e3c-4ffd-84cb-65634333d922 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:12.752371 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6c926eb1-6e3c-4ffd-84cb-65634333d922 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:12.854665 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-6c926eb1-6e3c-4ffd-84cb-65634333d922 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:12.865567 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-6c926eb1-6e3c-4ffd-84cb-65634333d922 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:12.867081 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-6c926eb1-6e3c-4ffd-84cb-65634333d922 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:12.882672 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6c926eb1-6e3c-4ffd-84cb-65634333d922 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] 10.222.0.20 "GET /compute/v2.1/servers/828cda24-b238-44bb-9007-142bbd02c041" status: 200 len: 1365 microversion: 2.47 time: 0.138476 Oct 27 03:47:12.883612 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2751/5803] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:47:12 2022] GET /compute/v2.1/servers/828cda24-b238-44bb-9007-142bbd02c041 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:47:12.940841 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-cb88ee21-94fc-4ff3-a307-cd9dc6a25103 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:12.941572 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-cb88ee21-94fc-4ff3-a307-cd9dc6a25103 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] [instance: 4068c7d8-3bbf-47cf-93ef-fded8f5094fe] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:12.953835 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cb88ee21-94fc-4ff3-a307-cd9dc6a25103 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:12.955185 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cb88ee21-94fc-4ff3-a307-cd9dc6a25103 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:12.955925 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cb88ee21-94fc-4ff3-a307-cd9dc6a25103 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:12.956929 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cb88ee21-94fc-4ff3-a307-cd9dc6a25103 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:12.957633 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cb88ee21-94fc-4ff3-a307-cd9dc6a25103 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:12.958336 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cb88ee21-94fc-4ff3-a307-cd9dc6a25103 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:13.044062 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-cb88ee21-94fc-4ff3-a307-cd9dc6a25103 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4dae167878b41699b8caae5a0386cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a3cfa6aaa74174a706a759f692c113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:13.056210 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-cb88ee21-94fc-4ff3-a307-cd9dc6a25103 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] 10.222.0.20 "GET /compute/v2.1/servers/4068c7d8-3bbf-47cf-93ef-fded8f5094fe" status: 200 len: 1281 microversion: 2.1 time: 0.119767 Oct 27 03:47:13.062730 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3053/5804] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:47:12 2022] GET /compute/v2.1/servers/4068c7d8-3bbf-47cf-93ef-fded8f5094fe => generated 1281 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:47:13.768890 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c9518567-ec5a-4e6a-9bdf-5e1633540bcc tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:13.769570 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c9518567-ec5a-4e6a-9bdf-5e1633540bcc tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 0d158876-42f7-42da-99f1-c9458db9919e] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:13.775084 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:DELETE=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:13.780839 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c9518567-ec5a-4e6a-9bdf-5e1633540bcc tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:13.785495 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c9518567-ec5a-4e6a-9bdf-5e1633540bcc tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:13.786759 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c9518567-ec5a-4e6a-9bdf-5e1633540bcc tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:13.787449 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c9518567-ec5a-4e6a-9bdf-5e1633540bcc tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:13.788825 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c9518567-ec5a-4e6a-9bdf-5e1633540bcc tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:13.789265 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c9518567-ec5a-4e6a-9bdf-5e1633540bcc tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:13.870190 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c9518567-ec5a-4e6a-9bdf-5e1633540bcc tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:13.899460 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c9518567-ec5a-4e6a-9bdf-5e1633540bcc tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/0d158876-42f7-42da-99f1-c9458db9919e" status: 200 len: 1205 microversion: 2.1 time: 0.132216 Oct 27 03:47:13.899460 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2752/5805] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:47:13 2022] GET /compute/v2.1/servers/0d158876-42f7-42da-99f1-c9458db9919e => generated 1205 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:47:13.910543 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0ef078e7-869c-42b4-87e7-092e9347a74b tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:13.911178 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0ef078e7-869c-42b4-87e7-092e9347a74b tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] [instance: 828cda24-b238-44bb-9007-142bbd02c041] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:13.920276 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0ef078e7-869c-42b4-87e7-092e9347a74b tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:13.923261 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0ef078e7-869c-42b4-87e7-092e9347a74b tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:13.923261 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0ef078e7-869c-42b4-87e7-092e9347a74b tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:13.923261 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0ef078e7-869c-42b4-87e7-092e9347a74b tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:13.923261 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0ef078e7-869c-42b4-87e7-092e9347a74b tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:13.923261 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0ef078e7-869c-42b4-87e7-092e9347a74b tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:14.023402 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0ef078e7-869c-42b4-87e7-092e9347a74b tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:14.036706 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0ef078e7-869c-42b4-87e7-092e9347a74b tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:14.039038 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0ef078e7-869c-42b4-87e7-092e9347a74b tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:14.044251 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0ef078e7-869c-42b4-87e7-092e9347a74b tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] 10.222.0.20 "GET /compute/v2.1/servers/828cda24-b238-44bb-9007-142bbd02c041" status: 200 len: 1365 microversion: 2.47 time: 0.134941 Oct 27 03:47:14.044251 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3054/5806] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:47:13 2022] GET /compute/v2.1/servers/828cda24-b238-44bb-9007-142bbd02c041 => generated 1365 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:47:14.084732 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-49cabf93-3554-416b-a758-f0e7a3aafa8d tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:14.085356 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-49cabf93-3554-416b-a758-f0e7a3aafa8d tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] [instance: 4068c7d8-3bbf-47cf-93ef-fded8f5094fe] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:14.095773 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-49cabf93-3554-416b-a758-f0e7a3aafa8d tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:14.097494 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-49cabf93-3554-416b-a758-f0e7a3aafa8d tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:14.097961 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-49cabf93-3554-416b-a758-f0e7a3aafa8d tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:14.100002 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-49cabf93-3554-416b-a758-f0e7a3aafa8d tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:14.100482 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-49cabf93-3554-416b-a758-f0e7a3aafa8d tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:14.100995 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-49cabf93-3554-416b-a758-f0e7a3aafa8d tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:14.363991 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-49cabf93-3554-416b-a758-f0e7a3aafa8d tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4dae167878b41699b8caae5a0386cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a3cfa6aaa74174a706a759f692c113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:14.378743 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-49cabf93-3554-416b-a758-f0e7a3aafa8d tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] 10.222.0.20 "GET /compute/v2.1/servers/4068c7d8-3bbf-47cf-93ef-fded8f5094fe" status: 200 len: 1323 microversion: 2.1 time: 0.298282 Oct 27 03:47:14.379772 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2753/5807] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:47:14 2022] GET /compute/v2.1/servers/4068c7d8-3bbf-47cf-93ef-fded8f5094fe => generated 1323 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:47:14.655795 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-be47963d-6c41-4b75-a771-889161d4c9fa req-9e7c750e-87f8-4dfe-9676-83fb52a3b9e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4068c7d8-3bbf-47cf-93ef-fded8f5094fe", "tag": "f6fadc34-a9cc-45da-bdfc-c402c49fd0f6"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:47:14.673932 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-be47963d-6c41-4b75-a771-889161d4c9fa req-9e7c750e-87f8-4dfe-9676-83fb52a3b9e5 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:14.676055 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-be47963d-6c41-4b75-a771-889161d4c9fa req-9e7c750e-87f8-4dfe-9676-83fb52a3b9e5 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:14.679702 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-be47963d-6c41-4b75-a771-889161d4c9fa req-9e7c750e-87f8-4dfe-9676-83fb52a3b9e5 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:14.697319 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-be47963d-6c41-4b75-a771-889161d4c9fa req-9e7c750e-87f8-4dfe-9676-83fb52a3b9e5 service nova] Creating event network-changed:f6fadc34-a9cc-45da-bdfc-c402c49fd0f6 for instance 4068c7d8-3bbf-47cf-93ef-fded8f5094fe on n-h2-862769-1 Oct 27 03:47:14.714746 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-be47963d-6c41-4b75-a771-889161d4c9fa req-9e7c750e-87f8-4dfe-9676-83fb52a3b9e5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062958 Oct 27 03:47:14.717749 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3055/5808] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:47:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:47:14.926701 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5c9ec917-0680-48d5-80c2-3afc37a569d2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:14.927802 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5c9ec917-0680-48d5-80c2-3afc37a569d2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 0d158876-42f7-42da-99f1-c9458db9919e] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:14.954359 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5c9ec917-0680-48d5-80c2-3afc37a569d2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:14.954856 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5c9ec917-0680-48d5-80c2-3afc37a569d2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:14.955300 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5c9ec917-0680-48d5-80c2-3afc37a569d2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:14.956016 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5c9ec917-0680-48d5-80c2-3afc37a569d2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:14.956471 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5c9ec917-0680-48d5-80c2-3afc37a569d2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:14.971179 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5c9ec917-0680-48d5-80c2-3afc37a569d2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:15.081736 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-bfe088e9-b7eb-4a85-98b2-925827914718 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:15.091198 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-bfe088e9-b7eb-4a85-98b2-925827914718 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] [instance: 828cda24-b238-44bb-9007-142bbd02c041] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:15.110182 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bfe088e9-b7eb-4a85-98b2-925827914718 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:15.113130 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bfe088e9-b7eb-4a85-98b2-925827914718 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:15.113636 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bfe088e9-b7eb-4a85-98b2-925827914718 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:15.114632 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bfe088e9-b7eb-4a85-98b2-925827914718 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:15.117738 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bfe088e9-b7eb-4a85-98b2-925827914718 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:15.121689 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bfe088e9-b7eb-4a85-98b2-925827914718 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:15.260611 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5c9ec917-0680-48d5-80c2-3afc37a569d2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:15.270416 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5c9ec917-0680-48d5-80c2-3afc37a569d2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/0d158876-42f7-42da-99f1-c9458db9919e" status: 200 len: 1269 microversion: 2.1 time: 0.349050 Oct 27 03:47:15.276230 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2754/5809] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:47:14 2022] GET /compute/v2.1/servers/0d158876-42f7-42da-99f1-c9458db9919e => generated 1269 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:47:15.315501 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-bfe088e9-b7eb-4a85-98b2-925827914718 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:15.330170 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-bfe088e9-b7eb-4a85-98b2-925827914718 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:15.331686 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-bfe088e9-b7eb-4a85-98b2-925827914718 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:15.334113 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-bfe088e9-b7eb-4a85-98b2-925827914718 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] 10.222.0.20 "GET /compute/v2.1/servers/828cda24-b238-44bb-9007-142bbd02c041" status: 200 len: 1365 microversion: 2.47 time: 0.261927 Oct 27 03:47:15.335185 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3056/5810] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:47:15 2022] GET /compute/v2.1/servers/828cda24-b238-44bb-9007-142bbd02c041 => generated 1365 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:47:15.402285 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c4f23209-e652-4786-b2af-575d3ec24ccc tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:15.402921 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c4f23209-e652-4786-b2af-575d3ec24ccc tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] [instance: 4068c7d8-3bbf-47cf-93ef-fded8f5094fe] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:15.415826 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c4f23209-e652-4786-b2af-575d3ec24ccc tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:15.415826 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c4f23209-e652-4786-b2af-575d3ec24ccc tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:15.415826 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c4f23209-e652-4786-b2af-575d3ec24ccc tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:15.415826 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c4f23209-e652-4786-b2af-575d3ec24ccc tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:15.415826 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c4f23209-e652-4786-b2af-575d3ec24ccc tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:15.415826 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c4f23209-e652-4786-b2af-575d3ec24ccc tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:15.894460 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c4f23209-e652-4786-b2af-575d3ec24ccc tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4dae167878b41699b8caae5a0386cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a3cfa6aaa74174a706a759f692c113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:15.903545 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c4f23209-e652-4786-b2af-575d3ec24ccc tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] 10.222.0.20 "GET /compute/v2.1/servers/4068c7d8-3bbf-47cf-93ef-fded8f5094fe" status: 200 len: 1323 microversion: 2.1 time: 0.505850 Oct 27 03:47:15.906415 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2755/5811] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:47:15 2022] GET /compute/v2.1/servers/4068c7d8-3bbf-47cf-93ef-fded8f5094fe => generated 1323 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:47:16.302014 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-87a4b418-b9a3-4012-8b80-06d78f8a4f51 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:16.306998 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-87a4b418-b9a3-4012-8b80-06d78f8a4f51 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 0d158876-42f7-42da-99f1-c9458db9919e] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:16.314377 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-87a4b418-b9a3-4012-8b80-06d78f8a4f51 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:16.314881 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-87a4b418-b9a3-4012-8b80-06d78f8a4f51 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:16.315331 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-87a4b418-b9a3-4012-8b80-06d78f8a4f51 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:16.316086 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-87a4b418-b9a3-4012-8b80-06d78f8a4f51 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:16.316552 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-87a4b418-b9a3-4012-8b80-06d78f8a4f51 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:16.316987 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-87a4b418-b9a3-4012-8b80-06d78f8a4f51 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:16.364035 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7668d477-7303-4649-82bd-4ae4d153c64c tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:16.365411 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7668d477-7303-4649-82bd-4ae4d153c64c tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] [instance: 828cda24-b238-44bb-9007-142bbd02c041] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:16.372370 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7668d477-7303-4649-82bd-4ae4d153c64c tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:16.372862 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7668d477-7303-4649-82bd-4ae4d153c64c tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:16.373306 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7668d477-7303-4649-82bd-4ae4d153c64c tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:16.381017 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7668d477-7303-4649-82bd-4ae4d153c64c tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:16.387738 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7668d477-7303-4649-82bd-4ae4d153c64c tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:16.387738 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7668d477-7303-4649-82bd-4ae4d153c64c tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:16.444515 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-87a4b418-b9a3-4012-8b80-06d78f8a4f51 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:16.453716 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-87a4b418-b9a3-4012-8b80-06d78f8a4f51 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/0d158876-42f7-42da-99f1-c9458db9919e" status: 200 len: 1267 microversion: 2.1 time: 0.156145 Oct 27 03:47:16.454666 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3057/5812] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:47:16 2022] GET /compute/v2.1/servers/0d158876-42f7-42da-99f1-c9458db9919e => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:47:16.530777 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7668d477-7303-4649-82bd-4ae4d153c64c tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:16.542719 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7668d477-7303-4649-82bd-4ae4d153c64c tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:16.544242 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7668d477-7303-4649-82bd-4ae4d153c64c tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:16.546478 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7668d477-7303-4649-82bd-4ae4d153c64c tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] 10.222.0.20 "GET /compute/v2.1/servers/828cda24-b238-44bb-9007-142bbd02c041" status: 200 len: 1365 microversion: 2.47 time: 0.185655 Oct 27 03:47:16.547712 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2756/5813] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:47:16 2022] GET /compute/v2.1/servers/828cda24-b238-44bb-9007-142bbd02c041 => generated 1365 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:47:16.932654 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ce1718fb-f765-4e58-86f0-c38463cca1a8 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:16.933496 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ce1718fb-f765-4e58-86f0-c38463cca1a8 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] [instance: 4068c7d8-3bbf-47cf-93ef-fded8f5094fe] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:16.947815 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ce1718fb-f765-4e58-86f0-c38463cca1a8 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:16.949063 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ce1718fb-f765-4e58-86f0-c38463cca1a8 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:16.953509 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ce1718fb-f765-4e58-86f0-c38463cca1a8 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:16.958318 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ce1718fb-f765-4e58-86f0-c38463cca1a8 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:16.958318 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ce1718fb-f765-4e58-86f0-c38463cca1a8 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:16.958318 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ce1718fb-f765-4e58-86f0-c38463cca1a8 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:17.217695 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ce1718fb-f765-4e58-86f0-c38463cca1a8 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4dae167878b41699b8caae5a0386cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a3cfa6aaa74174a706a759f692c113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:17.221810 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:17.226593 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ce1718fb-f765-4e58-86f0-c38463cca1a8 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] 10.222.0.20 "GET /compute/v2.1/servers/4068c7d8-3bbf-47cf-93ef-fded8f5094fe" status: 200 len: 1323 microversion: 2.1 time: 0.297869 Oct 27 03:47:17.233798 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3058/5814] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:47:16 2022] GET /compute/v2.1/servers/4068c7d8-3bbf-47cf-93ef-fded8f5094fe => generated 1323 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:47:17.479268 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-79d27a13-dad5-4d90-85f2-7af61a3303d1 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:17.480153 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-79d27a13-dad5-4d90-85f2-7af61a3303d1 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 0d158876-42f7-42da-99f1-c9458db9919e] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:17.488390 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-79d27a13-dad5-4d90-85f2-7af61a3303d1 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:17.488893 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-79d27a13-dad5-4d90-85f2-7af61a3303d1 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:17.489337 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-79d27a13-dad5-4d90-85f2-7af61a3303d1 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:17.490114 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-79d27a13-dad5-4d90-85f2-7af61a3303d1 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:17.490778 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-79d27a13-dad5-4d90-85f2-7af61a3303d1 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:17.491391 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-79d27a13-dad5-4d90-85f2-7af61a3303d1 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:17.578972 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-33fde207-f2c6-4a7f-a590-5648da228256 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:17.580579 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-33fde207-f2c6-4a7f-a590-5648da228256 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] [instance: 828cda24-b238-44bb-9007-142bbd02c041] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:17.588639 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-33fde207-f2c6-4a7f-a590-5648da228256 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:17.589394 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-33fde207-f2c6-4a7f-a590-5648da228256 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:17.590288 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-33fde207-f2c6-4a7f-a590-5648da228256 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:17.595630 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-33fde207-f2c6-4a7f-a590-5648da228256 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:17.597442 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-33fde207-f2c6-4a7f-a590-5648da228256 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:17.598460 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-33fde207-f2c6-4a7f-a590-5648da228256 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:17.712557 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-79d27a13-dad5-4d90-85f2-7af61a3303d1 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:17.714352 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-33fde207-f2c6-4a7f-a590-5648da228256 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:17.725724 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-33fde207-f2c6-4a7f-a590-5648da228256 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:17.726334 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-79d27a13-dad5-4d90-85f2-7af61a3303d1 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/0d158876-42f7-42da-99f1-c9458db9919e" status: 200 len: 1309 microversion: 2.1 time: 0.251433 Oct 27 03:47:17.728065 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-33fde207-f2c6-4a7f-a590-5648da228256 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:17.729690 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-33fde207-f2c6-4a7f-a590-5648da228256 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] 10.222.0.20 "GET /compute/v2.1/servers/828cda24-b238-44bb-9007-142bbd02c041" status: 200 len: 1365 microversion: 2.47 time: 0.159033 Oct 27 03:47:17.750023 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2757/5815] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:47:17 2022] GET /compute/v2.1/servers/0d158876-42f7-42da-99f1-c9458db9919e => generated 1309 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:47:17.758323 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3059/5816] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:47:17 2022] GET /compute/v2.1/servers/828cda24-b238-44bb-9007-142bbd02c041 => generated 1365 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:47:18.257496 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5abfd6bb-ea39-47eb-aa7f-fc5b392e2362 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:18.258245 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5abfd6bb-ea39-47eb-aa7f-fc5b392e2362 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] [instance: 4068c7d8-3bbf-47cf-93ef-fded8f5094fe] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:18.266469 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5abfd6bb-ea39-47eb-aa7f-fc5b392e2362 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:18.266971 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5abfd6bb-ea39-47eb-aa7f-fc5b392e2362 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:18.267642 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5abfd6bb-ea39-47eb-aa7f-fc5b392e2362 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:18.268390 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5abfd6bb-ea39-47eb-aa7f-fc5b392e2362 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:18.268845 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5abfd6bb-ea39-47eb-aa7f-fc5b392e2362 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:18.269471 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5abfd6bb-ea39-47eb-aa7f-fc5b392e2362 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:18.365479 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-fdea1453-f9c9-4aa3-9703-5c2072702112 req-0669e86a-ddc4-412a-9c47-e160d9608798 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d158876-42f7-42da-99f1-c9458db9919e", "tag": "8b44a574-263f-43e0-b91b-4ab88b409f6a"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:47:18.388690 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-fdea1453-f9c9-4aa3-9703-5c2072702112 req-0669e86a-ddc4-412a-9c47-e160d9608798 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:18.405711 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-fdea1453-f9c9-4aa3-9703-5c2072702112 req-0669e86a-ddc4-412a-9c47-e160d9608798 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:18.405711 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-fdea1453-f9c9-4aa3-9703-5c2072702112 req-0669e86a-ddc4-412a-9c47-e160d9608798 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:18.427007 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-fdea1453-f9c9-4aa3-9703-5c2072702112 req-0669e86a-ddc4-412a-9c47-e160d9608798 service nova] Creating event network-changed:8b44a574-263f-43e0-b91b-4ab88b409f6a for instance 0d158876-42f7-42da-99f1-c9458db9919e on n-h2-862769-1 Oct 27 03:47:18.441096 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-fdea1453-f9c9-4aa3-9703-5c2072702112 req-0669e86a-ddc4-412a-9c47-e160d9608798 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080312 Oct 27 03:47:18.445096 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3060/5817] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:47:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:47:18.640716 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5abfd6bb-ea39-47eb-aa7f-fc5b392e2362 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4dae167878b41699b8caae5a0386cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a3cfa6aaa74174a706a759f692c113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:18.652288 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5abfd6bb-ea39-47eb-aa7f-fc5b392e2362 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] 10.222.0.20 "GET /compute/v2.1/servers/4068c7d8-3bbf-47cf-93ef-fded8f5094fe" status: 200 len: 1323 microversion: 2.1 time: 0.399931 Oct 27 03:47:18.654110 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2758/5818] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:47:18 2022] GET /compute/v2.1/servers/4068c7d8-3bbf-47cf-93ef-fded8f5094fe => generated 1323 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:47:18.756545 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e7d0a0a2-c4cd-4873-83d4-63ae9b94e74e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:18.758302 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e7d0a0a2-c4cd-4873-83d4-63ae9b94e74e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 0d158876-42f7-42da-99f1-c9458db9919e] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:18.767137 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-298f38bb-3e5d-4450-8d37-b6be827e5f3d tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:18.770729 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-298f38bb-3e5d-4450-8d37-b6be827e5f3d tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] [instance: 828cda24-b238-44bb-9007-142bbd02c041] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:18.776806 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e7d0a0a2-c4cd-4873-83d4-63ae9b94e74e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:18.780631 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-298f38bb-3e5d-4450-8d37-b6be827e5f3d tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:18.781306 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e7d0a0a2-c4cd-4873-83d4-63ae9b94e74e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:18.783294 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e7d0a0a2-c4cd-4873-83d4-63ae9b94e74e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:18.783741 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-298f38bb-3e5d-4450-8d37-b6be827e5f3d tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:18.784430 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-298f38bb-3e5d-4450-8d37-b6be827e5f3d tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:18.786149 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e7d0a0a2-c4cd-4873-83d4-63ae9b94e74e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:18.787469 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-298f38bb-3e5d-4450-8d37-b6be827e5f3d tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:18.788287 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-298f38bb-3e5d-4450-8d37-b6be827e5f3d tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:18.788450 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e7d0a0a2-c4cd-4873-83d4-63ae9b94e74e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:18.789111 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-298f38bb-3e5d-4450-8d37-b6be827e5f3d tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:18.789375 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e7d0a0a2-c4cd-4873-83d4-63ae9b94e74e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:18.967342 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-298f38bb-3e5d-4450-8d37-b6be827e5f3d tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:18.992300 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-298f38bb-3e5d-4450-8d37-b6be827e5f3d tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:19.002831 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-298f38bb-3e5d-4450-8d37-b6be827e5f3d tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:19.003105 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-298f38bb-3e5d-4450-8d37-b6be827e5f3d tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] 10.222.0.20 "GET /compute/v2.1/servers/828cda24-b238-44bb-9007-142bbd02c041" status: 200 len: 1365 microversion: 2.47 time: 0.246127 Oct 27 03:47:19.009891 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2759/5819] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:47:18 2022] GET /compute/v2.1/servers/828cda24-b238-44bb-9007-142bbd02c041 => generated 1365 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:47:19.053510 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e7d0a0a2-c4cd-4873-83d4-63ae9b94e74e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:19.063182 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e7d0a0a2-c4cd-4873-83d4-63ae9b94e74e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/0d158876-42f7-42da-99f1-c9458db9919e" status: 200 len: 1309 microversion: 2.1 time: 0.313222 Oct 27 03:47:19.072864 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3061/5820] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:47:18 2022] GET /compute/v2.1/servers/0d158876-42f7-42da-99f1-c9458db9919e => generated 1309 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:47:19.680604 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-60199b59-9723-45ab-90cb-307e9eda148b tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:19.683670 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-60199b59-9723-45ab-90cb-307e9eda148b tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] [instance: 4068c7d8-3bbf-47cf-93ef-fded8f5094fe] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:19.691706 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-60199b59-9723-45ab-90cb-307e9eda148b tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:19.692466 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-60199b59-9723-45ab-90cb-307e9eda148b tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:19.693007 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-60199b59-9723-45ab-90cb-307e9eda148b tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:19.693871 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-60199b59-9723-45ab-90cb-307e9eda148b tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:19.694478 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-60199b59-9723-45ab-90cb-307e9eda148b tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:19.695039 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-60199b59-9723-45ab-90cb-307e9eda148b tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:19.900244 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-60199b59-9723-45ab-90cb-307e9eda148b tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4dae167878b41699b8caae5a0386cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a3cfa6aaa74174a706a759f692c113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:19.908946 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-60199b59-9723-45ab-90cb-307e9eda148b tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] 10.222.0.20 "GET /compute/v2.1/servers/4068c7d8-3bbf-47cf-93ef-fded8f5094fe" status: 200 len: 1323 microversion: 2.1 time: 0.233220 Oct 27 03:47:19.911110 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2760/5821] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:47:19 2022] GET /compute/v2.1/servers/4068c7d8-3bbf-47cf-93ef-fded8f5094fe => generated 1323 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:47:20.037363 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-87a3edde-a58a-4d25-9485-64104ec7ced2 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:20.038060 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-87a3edde-a58a-4d25-9485-64104ec7ced2 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] [instance: 828cda24-b238-44bb-9007-142bbd02c041] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:20.047412 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-87a3edde-a58a-4d25-9485-64104ec7ced2 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:20.048204 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-87a3edde-a58a-4d25-9485-64104ec7ced2 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:20.048838 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-87a3edde-a58a-4d25-9485-64104ec7ced2 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:20.049755 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-87a3edde-a58a-4d25-9485-64104ec7ced2 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:20.050439 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-87a3edde-a58a-4d25-9485-64104ec7ced2 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:20.051036 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-87a3edde-a58a-4d25-9485-64104ec7ced2 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:20.090367 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-bbdc4c02-86a3-45f2-8a77-fb4b1e5ed968 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:20.091306 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-bbdc4c02-86a3-45f2-8a77-fb4b1e5ed968 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 0d158876-42f7-42da-99f1-c9458db9919e] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:20.098007 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bbdc4c02-86a3-45f2-8a77-fb4b1e5ed968 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:20.098596 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bbdc4c02-86a3-45f2-8a77-fb4b1e5ed968 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:20.099237 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bbdc4c02-86a3-45f2-8a77-fb4b1e5ed968 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:20.099982 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bbdc4c02-86a3-45f2-8a77-fb4b1e5ed968 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:20.100444 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bbdc4c02-86a3-45f2-8a77-fb4b1e5ed968 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:20.100896 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bbdc4c02-86a3-45f2-8a77-fb4b1e5ed968 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:20.131524 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-87a3edde-a58a-4d25-9485-64104ec7ced2 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:20.143160 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-87a3edde-a58a-4d25-9485-64104ec7ced2 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:20.144827 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-87a3edde-a58a-4d25-9485-64104ec7ced2 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:20.146291 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-87a3edde-a58a-4d25-9485-64104ec7ced2 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] 10.222.0.20 "GET /compute/v2.1/servers/828cda24-b238-44bb-9007-142bbd02c041" status: 200 len: 1365 microversion: 2.47 time: 0.112946 Oct 27 03:47:20.158980 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3062/5822] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:47:20 2022] GET /compute/v2.1/servers/828cda24-b238-44bb-9007-142bbd02c041 => generated 1365 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:47:20.307191 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-bbdc4c02-86a3-45f2-8a77-fb4b1e5ed968 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:20.315844 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-bbdc4c02-86a3-45f2-8a77-fb4b1e5ed968 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/0d158876-42f7-42da-99f1-c9458db9919e" status: 200 len: 1309 microversion: 2.1 time: 0.230259 Oct 27 03:47:20.316424 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2761/5823] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:47:20 2022] GET /compute/v2.1/servers/0d158876-42f7-42da-99f1-c9458db9919e => generated 1309 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:47:20.676182 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-594190b3-db23-41c4-a911-d40903cf2b85 req-4a7c4656-c11f-4dfe-bf93-1f82f63310ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4068c7d8-3bbf-47cf-93ef-fded8f5094fe", "name": "network-vif-plugged", "status": "completed", "tag": "f6fadc34-a9cc-45da-bdfc-c402c49fd0f6"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:47:20.690390 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-594190b3-db23-41c4-a911-d40903cf2b85 req-4a7c4656-c11f-4dfe-bf93-1f82f63310ad service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:20.690882 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-594190b3-db23-41c4-a911-d40903cf2b85 req-4a7c4656-c11f-4dfe-bf93-1f82f63310ad service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:20.691323 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-594190b3-db23-41c4-a911-d40903cf2b85 req-4a7c4656-c11f-4dfe-bf93-1f82f63310ad service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:20.705135 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-594190b3-db23-41c4-a911-d40903cf2b85 req-4a7c4656-c11f-4dfe-bf93-1f82f63310ad service nova] Creating event network-vif-plugged:f6fadc34-a9cc-45da-bdfc-c402c49fd0f6 for instance 4068c7d8-3bbf-47cf-93ef-fded8f5094fe on n-h2-862769-1 Oct 27 03:47:20.710349 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-594190b3-db23-41c4-a911-d40903cf2b85 req-4a7c4656-c11f-4dfe-bf93-1f82f63310ad service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042353 Oct 27 03:47:20.710960 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3063/5824] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:47:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:47:20.942997 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c3fad2a0-451f-4dc5-9f30-f2b0100d8ef6 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:20.943942 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c3fad2a0-451f-4dc5-9f30-f2b0100d8ef6 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] [instance: 4068c7d8-3bbf-47cf-93ef-fded8f5094fe] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:20.971570 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c3fad2a0-451f-4dc5-9f30-f2b0100d8ef6 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:20.972535 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c3fad2a0-451f-4dc5-9f30-f2b0100d8ef6 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:20.977791 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c3fad2a0-451f-4dc5-9f30-f2b0100d8ef6 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:20.978858 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c3fad2a0-451f-4dc5-9f30-f2b0100d8ef6 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:20.983827 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c3fad2a0-451f-4dc5-9f30-f2b0100d8ef6 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:20.991580 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c3fad2a0-451f-4dc5-9f30-f2b0100d8ef6 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:21.071821 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=4 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:21.176884 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e66492c3-db01-4184-99c2-6bf9be92fdef tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:21.177568 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e66492c3-db01-4184-99c2-6bf9be92fdef tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] [instance: 828cda24-b238-44bb-9007-142bbd02c041] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:21.193720 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e66492c3-db01-4184-99c2-6bf9be92fdef tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:21.202683 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e66492c3-db01-4184-99c2-6bf9be92fdef tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:21.202683 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e66492c3-db01-4184-99c2-6bf9be92fdef tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:21.202683 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e66492c3-db01-4184-99c2-6bf9be92fdef tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:21.202683 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e66492c3-db01-4184-99c2-6bf9be92fdef tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:21.202683 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e66492c3-db01-4184-99c2-6bf9be92fdef tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:21.306654 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c3fad2a0-451f-4dc5-9f30-f2b0100d8ef6 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4dae167878b41699b8caae5a0386cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a3cfa6aaa74174a706a759f692c113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:21.315322 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c3fad2a0-451f-4dc5-9f30-f2b0100d8ef6 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] 10.222.0.20 "GET /compute/v2.1/servers/4068c7d8-3bbf-47cf-93ef-fded8f5094fe" status: 200 len: 1323 microversion: 2.1 time: 0.381905 Oct 27 03:47:21.315891 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2762/5825] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:47:20 2022] GET /compute/v2.1/servers/4068c7d8-3bbf-47cf-93ef-fded8f5094fe => generated 1323 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:47:21.346080 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e66492c3-db01-4184-99c2-6bf9be92fdef tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:21.359504 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8164a3a3-d796-48a1-8741-a20cdc13cd94 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:21.364108 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8164a3a3-d796-48a1-8741-a20cdc13cd94 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 0d158876-42f7-42da-99f1-c9458db9919e] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:21.364364 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e66492c3-db01-4184-99c2-6bf9be92fdef tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:21.375060 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e66492c3-db01-4184-99c2-6bf9be92fdef tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:21.376461 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e66492c3-db01-4184-99c2-6bf9be92fdef tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] 10.222.0.20 "GET /compute/v2.1/servers/828cda24-b238-44bb-9007-142bbd02c041" status: 200 len: 1365 microversion: 2.47 time: 0.204195 Oct 27 03:47:21.385631 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8164a3a3-d796-48a1-8741-a20cdc13cd94 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:21.386655 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3064/5826] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:47:21 2022] GET /compute/v2.1/servers/828cda24-b238-44bb-9007-142bbd02c041 => generated 1365 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:47:21.388487 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8164a3a3-d796-48a1-8741-a20cdc13cd94 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:21.388953 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8164a3a3-d796-48a1-8741-a20cdc13cd94 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:21.394417 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8164a3a3-d796-48a1-8741-a20cdc13cd94 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:21.395212 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8164a3a3-d796-48a1-8741-a20cdc13cd94 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:21.396333 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8164a3a3-d796-48a1-8741-a20cdc13cd94 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:21.606358 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=16 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:21.636599 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8164a3a3-d796-48a1-8741-a20cdc13cd94 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:21.644609 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8164a3a3-d796-48a1-8741-a20cdc13cd94 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/0d158876-42f7-42da-99f1-c9458db9919e" status: 200 len: 1309 microversion: 2.1 time: 0.307891 Oct 27 03:47:21.646468 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2763/5827] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:47:21 2022] GET /compute/v2.1/servers/0d158876-42f7-42da-99f1-c9458db9919e => generated 1309 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:47:22.339383 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ab124616-e971-4072-90a5-e1fb0575832d tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:22.347006 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ab124616-e971-4072-90a5-e1fb0575832d tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] [instance: 4068c7d8-3bbf-47cf-93ef-fded8f5094fe] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:22.368100 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ab124616-e971-4072-90a5-e1fb0575832d tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:22.371049 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ab124616-e971-4072-90a5-e1fb0575832d tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:22.371694 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ab124616-e971-4072-90a5-e1fb0575832d tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:22.374972 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ab124616-e971-4072-90a5-e1fb0575832d tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:22.375575 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ab124616-e971-4072-90a5-e1fb0575832d tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:22.376222 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ab124616-e971-4072-90a5-e1fb0575832d tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:22.437080 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-803036cd-1a13-4e81-b312-9c6259bd88dd tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:22.438997 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-803036cd-1a13-4e81-b312-9c6259bd88dd tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] [instance: 828cda24-b238-44bb-9007-142bbd02c041] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:22.449412 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-803036cd-1a13-4e81-b312-9c6259bd88dd tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:22.450216 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-803036cd-1a13-4e81-b312-9c6259bd88dd tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:22.450828 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-803036cd-1a13-4e81-b312-9c6259bd88dd tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:22.452472 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-803036cd-1a13-4e81-b312-9c6259bd88dd tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:22.453135 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-803036cd-1a13-4e81-b312-9c6259bd88dd tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:22.453870 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-803036cd-1a13-4e81-b312-9c6259bd88dd tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:22.516419 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=100 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:22.622474 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-803036cd-1a13-4e81-b312-9c6259bd88dd tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:22.635497 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-803036cd-1a13-4e81-b312-9c6259bd88dd tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:22.637034 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-803036cd-1a13-4e81-b312-9c6259bd88dd tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:22.638377 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-803036cd-1a13-4e81-b312-9c6259bd88dd tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] 10.222.0.20 "GET /compute/v2.1/servers/828cda24-b238-44bb-9007-142bbd02c041" status: 200 len: 1365 microversion: 2.47 time: 0.214471 Oct 27 03:47:22.638952 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2764/5828] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:47:22 2022] GET /compute/v2.1/servers/828cda24-b238-44bb-9007-142bbd02c041 => generated 1365 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:47:22.673732 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ebacb962-8a4d-4635-a40e-0df242d83bd6 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:22.674064 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ab124616-e971-4072-90a5-e1fb0575832d tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4dae167878b41699b8caae5a0386cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a3cfa6aaa74174a706a759f692c113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:22.674974 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ebacb962-8a4d-4635-a40e-0df242d83bd6 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 0d158876-42f7-42da-99f1-c9458db9919e] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:22.684514 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ab124616-e971-4072-90a5-e1fb0575832d tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] 10.222.0.20 "GET /compute/v2.1/servers/4068c7d8-3bbf-47cf-93ef-fded8f5094fe" status: 200 len: 1518 microversion: 2.1 time: 0.349426 Oct 27 03:47:22.688259 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ebacb962-8a4d-4635-a40e-0df242d83bd6 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:22.689056 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ebacb962-8a4d-4635-a40e-0df242d83bd6 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:22.689741 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ebacb962-8a4d-4635-a40e-0df242d83bd6 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:22.690465 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3065/5829] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:47:22 2022] GET /compute/v2.1/servers/4068c7d8-3bbf-47cf-93ef-fded8f5094fe => generated 1518 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:47:22.692856 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ebacb962-8a4d-4635-a40e-0df242d83bd6 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:22.693638 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ebacb962-8a4d-4635-a40e-0df242d83bd6 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:22.694615 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ebacb962-8a4d-4635-a40e-0df242d83bd6 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:22.907207 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ebacb962-8a4d-4635-a40e-0df242d83bd6 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:22.915664 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ebacb962-8a4d-4635-a40e-0df242d83bd6 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/0d158876-42f7-42da-99f1-c9458db9919e" status: 200 len: 1309 microversion: 2.1 time: 0.248214 Oct 27 03:47:22.916830 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2765/5830] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:47:22 2022] GET /compute/v2.1/servers/0d158876-42f7-42da-99f1-c9458db9919e => generated 1309 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:47:23.098715 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-14a459b3-eaef-40e3-91c2-0808c94f1c7f tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1558513286", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "f90a174d-8b5f-4312-ba5e-0dfae4fc1d82"}]}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:47:23.103912 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-14a459b3-eaef-40e3-91c2-0808c94f1c7f tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Request method failure captured: Oct 27 03:47:23.103912 n-d-862769-1 devstack@n-api.service[121001]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 03:47:23.103912 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:47:23.103912 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:47:23.103912 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:47:23.103912 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 243 Oct 27 03:47:23.103912 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:47:23.103912 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:47:23.103912 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:47:23.103912 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:47:23.103912 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWf85sONR3AnWi-oRCG-wYAp7Y5x2vTiJUFlItcHe3gH43nG6LobqyZQcVndbXM_Imtr6hMGUnoCHFdTeGCMYLCBv_xB4wSNcwWBf_hHQJY561Y5pLtm-JxFOWBQtBHaFt5mzeJWIE1asvbMmec0h5jxO6gTEGzZDRwwjMVTAcSiSda8 Oct 27 03:47:23.103912 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:47:23.103912 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:47:23.103912 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:47:23.103912 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:47:23.103912 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:47:23.103912 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:47:23.103912 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 14a3cfa6aaa74174a706a759f692c113 Oct 27 03:47:23.103912 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1625756983 Oct 27 03:47:23.103912 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:47:23.103912 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:47:23.103912 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/14a3cfa6aaa74174a706a759f692c113"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/14a3cfa6aaa74174a706a759f692c113"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/14a3cfa6aaa74174a706a759f692c113"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_14a3cfa6aaa74174a706a759f692c113"}]}] Oct 27 03:47:23.103912 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1625756983 Oct 27 03:47:23.103912 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 14a3cfa6aaa74174a706a759f692c113 Oct 27 03:47:23.103912 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1625756983 Oct 27 03:47:23.103912 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServerMetadataNegativeTestJSON-1625756983-project Oct 27 03:47:23.103912 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:47:23.103912 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:47:23.103912 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: b4dae167878b41699b8caae5a0386cf4 Oct 27 03:47:23.103912 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1625756983-project Oct 27 03:47:23.103912 n-d-862769-1 devstack@n-api.service[121001]: Oct 27 03:47:23.103912 n-d-862769-1 devstack@n-api.service[121001]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1558513286", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "f90a174d-8b5f-4312-ba5e-0dfae4fc1d82"}]}} Oct 27 03:47:23.103912 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:47:23.103912 n-d-862769-1 devstack@n-api.service[121001]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 03:47:23.103912 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1558513286', 'imageRef': 'c40fb871-5877-4b59-ab69-d9fd23b7a917', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': 'f90a174d-8b5f-4312-ba5e-0dfae4fc1d82'}]}}} Oct 27 03:47:23.103912 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:47:23.103912 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:47:23.103912 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 03:47:23.103912 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 03:47:23.103912 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 03:47:23.103912 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise error Oct 27 03:47:23.103912 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 03:47:23.103912 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:47:23.103912 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 27 03:47:23.103912 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 27 03:47:23.103912 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 27 03:47:23.103912 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 27 03:47:23.103912 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 27 03:47:23.103912 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:47:23.103912 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 27 03:47:23.103912 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi {'': 'data1'} Oct 27 03:47:23.103912 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:47:23.103912 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:47:23.103912 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:47:23.103912 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:47:23.103912 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:47:23.103912 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:47:23.103912 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:47:23.103912 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:47:23.103912 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:47:23.103912 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:47:23.103912 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:47:23.111359 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:47:23.111359 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 03:47:23.111359 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 03:47:23.111359 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 03:47:23.111359 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 03:47:23.111359 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 03:47:23.111359 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 03:47:23.111359 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 03:47:23.111359 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:47:23.111359 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:47:23.111359 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:47:23.111359 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:47:23.111359 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:47:23.111359 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:47:23.111359 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 03:47:23.111359 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 03:47:23.111359 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 03:47:23.111359 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:47:23.111359 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-14a459b3-eaef-40e3-91c2-0808c94f1c7f tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:47:23.111359 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-14a459b3-eaef-40e3-91c2-0808c94f1c7f tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.014815 Oct 27 03:47:23.111359 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3066/5831] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:47:23 2022] POST /compute/v2.1/servers => generated 175 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 03:47:23.122007 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-07a4361b-03db-4f59-973b-182fa6a36e0b tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:23.122007 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-07a4361b-03db-4f59-973b-182fa6a36e0b tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] [instance: 58383fb7-4480-44fb-871e-82ab3a580e1f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:23.135297 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-07a4361b-03db-4f59-973b-182fa6a36e0b tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] HTTP exception thrown: Instance 58383fb7-4480-44fb-871e-82ab3a580e1f could not be found. Oct 27 03:47:23.146459 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-07a4361b-03db-4f59-973b-182fa6a36e0b tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Request method failure captured: Oct 27 03:47:23.146459 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/58383fb7-4480-44fb-871e-82ab3a580e1f/metadata HTTP/1.1 Oct 27 03:47:23.146459 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:47:23.146459 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:47:23.146459 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:47:23.146459 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:47:23.146459 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:47:23.146459 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:47:23.146459 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:47:23.146459 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:47:23.146459 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWf85sONR3AnWi-oRCG-wYAp7Y5x2vTiJUFlItcHe3gH43nG6LobqyZQcVndbXM_Imtr6hMGUnoCHFdTeGCMYLCBv_xB4wSNcwWBf_hHQJY561Y5pLtm-JxFOWBQtBHaFt5mzeJWIE1asvbMmec0h5jxO6gTEGzZDRwwjMVTAcSiSda8 Oct 27 03:47:23.146459 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:47:23.146459 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:47:23.146459 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:47:23.146459 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:47:23.146459 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:47:23.146459 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:47:23.146459 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 14a3cfa6aaa74174a706a759f692c113 Oct 27 03:47:23.146459 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1625756983 Oct 27 03:47:23.146459 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:47:23.146459 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:47:23.146459 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/14a3cfa6aaa74174a706a759f692c113"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/14a3cfa6aaa74174a706a759f692c113"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/14a3cfa6aaa74174a706a759f692c113"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_14a3cfa6aaa74174a706a759f692c113"}]}] Oct 27 03:47:23.146459 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1625756983 Oct 27 03:47:23.146459 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 14a3cfa6aaa74174a706a759f692c113 Oct 27 03:47:23.146459 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1625756983 Oct 27 03:47:23.146459 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ServerMetadataNegativeTestJSON-1625756983-project Oct 27 03:47:23.146459 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:47:23.146459 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:47:23.146459 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: b4dae167878b41699b8caae5a0386cf4 Oct 27 03:47:23.146459 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1625756983-project Oct 27 03:47:23.146459 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:47:23.146459 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 58383fb7-4480-44fb-871e-82ab3a580e1f could not be found. Oct 27 03:47:23.146459 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'server_id': '58383fb7-4480-44fb-871e-82ab3a580e1f'} Oct 27 03:47:23.146459 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:47:23.146459 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:47:23.146459 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:47:23.146459 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:47:23.146459 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:47:23.146459 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:47:23.146459 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 03:47:23.146459 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 03:47:23.146459 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58383fb7-4480-44fb-871e-82ab3a580e1f could not be found. Oct 27 03:47:23.146459 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:47:23.146459 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:47:23.146459 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:47:23.146459 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:47:23.146459 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:47:23.146459 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:47:23.146459 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:47:23.146459 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:47:23.146459 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:47:23.146459 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:47:23.146459 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Oct 27 03:47:23.146459 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 27 03:47:23.146459 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:47:23.146459 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:47:23.146459 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58383fb7-4480-44fb-871e-82ab3a580e1f could not be found. Oct 27 03:47:23.146459 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:47:23.146459 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:47:23.146459 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:47:23.146459 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:47:23.146459 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:47:23.146459 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:47:23.151970 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:47:23.151970 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:47:23.151970 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58383fb7-4480-44fb-871e-82ab3a580e1f could not be found. Oct 27 03:47:23.151970 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:47:23.151970 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-07a4361b-03db-4f59-973b-182fa6a36e0b tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Returning 404 to user: Instance 58383fb7-4480-44fb-871e-82ab3a580e1f could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:47:23.151970 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-07a4361b-03db-4f59-973b-182fa6a36e0b tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] 10.222.0.20 "GET /compute/v2.1/servers/58383fb7-4480-44fb-871e-82ab3a580e1f/metadata" status: 404 len: 111 microversion: 2.1 time: 0.030869 Oct 27 03:47:23.154076 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2766/5832] 10.222.0.20 () {58 vars in 1263 bytes} [Thu Oct 27 03:47:23 2022] GET /compute/v2.1/servers/58383fb7-4480-44fb-871e-82ab3a580e1f/metadata => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:47:23.328777 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=4 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:23.339294 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ae18f38d-8475-440e-91bf-f4182979c6d3 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1471718095", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "f90a174d-8b5f-4312-ba5e-0dfae4fc1d82"}]}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:47:23.345288 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ae18f38d-8475-440e-91bf-f4182979c6d3 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Request method failure captured: Oct 27 03:47:23.345288 n-d-862769-1 devstack@n-api.service[121001]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 03:47:23.345288 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:47:23.345288 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:47:23.345288 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:47:23.345288 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 499 Oct 27 03:47:23.345288 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:47:23.345288 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:47:23.345288 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:47:23.345288 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:47:23.345288 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWf85sONR3AnWi-oRCG-wYAp7Y5x2vTiJUFlItcHe3gH43nG6LobqyZQcVndbXM_Imtr6hMGUnoCHFdTeGCMYLCBv_xB4wSNcwWBf_hHQJY561Y5pLtm-JxFOWBQtBHaFt5mzeJWIE1asvbMmec0h5jxO6gTEGzZDRwwjMVTAcSiSda8 Oct 27 03:47:23.345288 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:47:23.345288 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:47:23.345288 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:47:23.345288 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:47:23.345288 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:47:23.345288 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:47:23.345288 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 14a3cfa6aaa74174a706a759f692c113 Oct 27 03:47:23.345288 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1625756983 Oct 27 03:47:23.345288 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:47:23.345288 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:47:23.345288 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/14a3cfa6aaa74174a706a759f692c113"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/14a3cfa6aaa74174a706a759f692c113"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/14a3cfa6aaa74174a706a759f692c113"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_14a3cfa6aaa74174a706a759f692c113"}]}] Oct 27 03:47:23.345288 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1625756983 Oct 27 03:47:23.345288 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 14a3cfa6aaa74174a706a759f692c113 Oct 27 03:47:23.345288 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1625756983 Oct 27 03:47:23.345288 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServerMetadataNegativeTestJSON-1625756983-project Oct 27 03:47:23.345288 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:47:23.345288 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:47:23.345288 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: b4dae167878b41699b8caae5a0386cf4 Oct 27 03:47:23.345288 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1625756983-project Oct 27 03:47:23.345288 n-d-862769-1 devstack@n-api.service[121001]: Oct 27 03:47:23.345288 n-d-862769-1 devstack@n-api.service[121001]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1471718095", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "f90a174d-8b5f-4312-ba5e-0dfae4fc1d82"}]}} Oct 27 03:47:23.345288 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:47:23.345288 n-d-862769-1 devstack@n-api.service[121001]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 03:47:23.345288 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1471718095', 'imageRef': 'c40fb871-5877-4b59-ab69-d9fd23b7a917', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'f90a174d-8b5f-4312-ba5e-0dfae4fc1d82'}]}}} Oct 27 03:47:23.345288 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:47:23.345288 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:47:23.345288 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 03:47:23.345288 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 03:47:23.345288 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 03:47:23.345288 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise error Oct 27 03:47:23.345288 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 03:47:23.345288 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:47:23.345288 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 27 03:47:23.345288 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 27 03:47:23.345288 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 27 03:47:23.345288 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 27 03:47:23.349621 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 27 03:47:23.349621 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:47:23.349621 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 27 03:47:23.349621 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 27 03:47:23.349621 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:47:23.349621 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:47:23.349621 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:47:23.349621 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:47:23.349621 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:47:23.349621 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:47:23.349621 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:47:23.349621 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:47:23.349621 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:47:23.349621 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:47:23.349621 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:47:23.349621 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:47:23.349621 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 03:47:23.349621 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 03:47:23.349621 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 03:47:23.349621 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 03:47:23.349621 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 03:47:23.349621 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 03:47:23.349621 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 03:47:23.349621 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:47:23.349621 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:47:23.349621 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:47:23.349621 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:47:23.349621 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:47:23.349621 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:47:23.349621 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 03:47:23.349621 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 03:47:23.349621 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 03:47:23.349621 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:47:23.349621 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ae18f38d-8475-440e-91bf-f4182979c6d3 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:47:23.363349 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ae18f38d-8475-440e-91bf-f4182979c6d3 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.029578 Oct 27 03:47:23.363349 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3067/5833] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:47:23 2022] POST /compute/v2.1/servers => generated 687 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 03:47:23.426490 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6a5d009b-1775-4565-a629-a3af509c6730 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-461336428", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "f90a174d-8b5f-4312-ba5e-0dfae4fc1d82"}]}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:47:23.430888 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6a5d009b-1775-4565-a629-a3af509c6730 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Request method failure captured: Oct 27 03:47:23.430888 n-d-862769-1 devstack@n-api.service[121000]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 03:47:23.430888 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:47:23.430888 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:47:23.430888 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:47:23.430888 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 499 Oct 27 03:47:23.430888 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:47:23.430888 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:47:23.430888 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:47:23.430888 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:47:23.430888 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWf85sONR3AnWi-oRCG-wYAp7Y5x2vTiJUFlItcHe3gH43nG6LobqyZQcVndbXM_Imtr6hMGUnoCHFdTeGCMYLCBv_xB4wSNcwWBf_hHQJY561Y5pLtm-JxFOWBQtBHaFt5mzeJWIE1asvbMmec0h5jxO6gTEGzZDRwwjMVTAcSiSda8 Oct 27 03:47:23.430888 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:47:23.430888 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:47:23.430888 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:47:23.430888 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:47:23.430888 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:47:23.430888 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:47:23.430888 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 14a3cfa6aaa74174a706a759f692c113 Oct 27 03:47:23.430888 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1625756983 Oct 27 03:47:23.430888 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:47:23.430888 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:47:23.430888 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/14a3cfa6aaa74174a706a759f692c113"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/14a3cfa6aaa74174a706a759f692c113"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/14a3cfa6aaa74174a706a759f692c113"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_14a3cfa6aaa74174a706a759f692c113"}]}] Oct 27 03:47:23.430888 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1625756983 Oct 27 03:47:23.430888 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 14a3cfa6aaa74174a706a759f692c113 Oct 27 03:47:23.430888 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1625756983 Oct 27 03:47:23.430888 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ServerMetadataNegativeTestJSON-1625756983-project Oct 27 03:47:23.430888 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:47:23.430888 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:47:23.430888 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: b4dae167878b41699b8caae5a0386cf4 Oct 27 03:47:23.430888 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1625756983-project Oct 27 03:47:23.430888 n-d-862769-1 devstack@n-api.service[121000]: Oct 27 03:47:23.430888 n-d-862769-1 devstack@n-api.service[121000]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-461336428", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "f90a174d-8b5f-4312-ba5e-0dfae4fc1d82"}]}} Oct 27 03:47:23.430888 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:47:23.430888 n-d-862769-1 devstack@n-api.service[121000]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 03:47:23.430888 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-461336428', 'imageRef': 'c40fb871-5877-4b59-ab69-d9fd23b7a917', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'f90a174d-8b5f-4312-ba5e-0dfae4fc1d82'}]}}} Oct 27 03:47:23.430888 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:47:23.430888 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:47:23.430888 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 03:47:23.430888 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 03:47:23.430888 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 03:47:23.430888 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise error Oct 27 03:47:23.430888 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 03:47:23.430888 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:47:23.430888 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 27 03:47:23.430888 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 27 03:47:23.430888 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 27 03:47:23.430888 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 27 03:47:23.437735 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 27 03:47:23.437735 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:47:23.437735 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 27 03:47:23.437735 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 27 03:47:23.437735 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:47:23.437735 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:47:23.437735 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:47:23.437735 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:47:23.437735 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:47:23.437735 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:47:23.437735 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:47:23.437735 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:47:23.437735 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:47:23.437735 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:47:23.437735 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:47:23.437735 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:47:23.437735 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 03:47:23.437735 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 03:47:23.437735 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 03:47:23.437735 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 03:47:23.437735 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 03:47:23.437735 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 03:47:23.437735 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 03:47:23.437735 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:47:23.437735 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:47:23.437735 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:47:23.437735 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:47:23.437735 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:47:23.437735 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:47:23.437735 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 03:47:23.437735 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 03:47:23.437735 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 03:47:23.437735 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:47:23.437735 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6a5d009b-1775-4565-a629-a3af509c6730 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:47:23.437735 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6a5d009b-1775-4565-a629-a3af509c6730 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.009964 Oct 27 03:47:23.442603 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2767/5834] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:47:23 2022] POST /compute/v2.1/servers => generated 689 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 03:47:23.671244 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-468bc17f-8805-4c61-8061-1096a8844185 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:23.671988 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-468bc17f-8805-4c61-8061-1096a8844185 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] [instance: 828cda24-b238-44bb-9007-142bbd02c041] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:23.694256 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-468bc17f-8805-4c61-8061-1096a8844185 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:23.694756 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-468bc17f-8805-4c61-8061-1096a8844185 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:23.698606 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-468bc17f-8805-4c61-8061-1096a8844185 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:23.699329 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-468bc17f-8805-4c61-8061-1096a8844185 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:23.699846 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-468bc17f-8805-4c61-8061-1096a8844185 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:23.700310 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-468bc17f-8805-4c61-8061-1096a8844185 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:23.728063 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-09ff187c-0be4-42aa-baee-f752595802aa tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1516889944", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "f90a174d-8b5f-4312-ba5e-0dfae4fc1d82"}]}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:47:23.738185 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-09ff187c-0be4-42aa-baee-f752595802aa tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Request method failure captured: Oct 27 03:47:23.738185 n-d-862769-1 devstack@n-api.service[121000]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 03:47:23.738185 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:47:23.738185 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:47:23.738185 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:47:23.738185 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 754 Oct 27 03:47:23.738185 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:47:23.738185 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:47:23.738185 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:47:23.738185 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:47:23.738185 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWf85sONR3AnWi-oRCG-wYAp7Y5x2vTiJUFlItcHe3gH43nG6LobqyZQcVndbXM_Imtr6hMGUnoCHFdTeGCMYLCBv_xB4wSNcwWBf_hHQJY561Y5pLtm-JxFOWBQtBHaFt5mzeJWIE1asvbMmec0h5jxO6gTEGzZDRwwjMVTAcSiSda8 Oct 27 03:47:23.738185 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:47:23.738185 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:47:23.738185 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:47:23.738185 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:47:23.738185 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:47:23.738185 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:47:23.738185 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 14a3cfa6aaa74174a706a759f692c113 Oct 27 03:47:23.738185 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1625756983 Oct 27 03:47:23.738185 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:47:23.738185 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:47:23.738185 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/14a3cfa6aaa74174a706a759f692c113"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/14a3cfa6aaa74174a706a759f692c113"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/14a3cfa6aaa74174a706a759f692c113"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_14a3cfa6aaa74174a706a759f692c113"}]}] Oct 27 03:47:23.738185 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1625756983 Oct 27 03:47:23.738185 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 14a3cfa6aaa74174a706a759f692c113 Oct 27 03:47:23.738185 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1625756983 Oct 27 03:47:23.738185 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ServerMetadataNegativeTestJSON-1625756983-project Oct 27 03:47:23.738185 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:47:23.738185 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:47:23.738185 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: b4dae167878b41699b8caae5a0386cf4 Oct 27 03:47:23.738185 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1625756983-project Oct 27 03:47:23.738185 n-d-862769-1 devstack@n-api.service[121000]: Oct 27 03:47:23.738185 n-d-862769-1 devstack@n-api.service[121000]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1516889944", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "f90a174d-8b5f-4312-ba5e-0dfae4fc1d82"}]}} Oct 27 03:47:23.738185 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:47:23.738185 n-d-862769-1 devstack@n-api.service[121000]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 03:47:23.738185 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1516889944', 'imageRef': 'c40fb871-5877-4b59-ab69-d9fd23b7a917', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'f90a174d-8b5f-4312-ba5e-0dfae4fc1d82'}]}}} Oct 27 03:47:23.738185 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:47:23.738185 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:47:23.738185 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 03:47:23.738185 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 03:47:23.745260 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 03:47:23.745260 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise error Oct 27 03:47:23.745260 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 03:47:23.745260 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:47:23.745260 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 27 03:47:23.745260 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 27 03:47:23.745260 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 27 03:47:23.745260 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 27 03:47:23.745260 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 27 03:47:23.745260 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:47:23.745260 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 27 03:47:23.745260 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 27 03:47:23.745260 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:47:23.745260 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:47:23.745260 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:47:23.745260 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:47:23.745260 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:47:23.745260 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:47:23.745260 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:47:23.745260 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:47:23.745260 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:47:23.745260 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:47:23.745260 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:47:23.745260 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:47:23.745260 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 03:47:23.745260 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 03:47:23.745260 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 03:47:23.745260 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 03:47:23.745260 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 03:47:23.745260 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 03:47:23.745260 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 03:47:23.745260 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:47:23.745260 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:47:23.745260 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:47:23.745260 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:47:23.745260 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:47:23.745260 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:47:23.745260 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 03:47:23.745260 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 03:47:23.750417 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 03:47:23.750417 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:47:23.750417 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-09ff187c-0be4-42aa-baee-f752595802aa tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:47:23.750417 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-09ff187c-0be4-42aa-baee-f752595802aa tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.017524 Oct 27 03:47:23.750417 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2768/5835] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:47:23 2022] POST /compute/v2.1/servers => generated 1197 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 382 bytes (2 switches on core 0) Oct 27 03:47:23.829576 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-468bc17f-8805-4c61-8061-1096a8844185 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:23.843105 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-468bc17f-8805-4c61-8061-1096a8844185 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:23.845221 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-468bc17f-8805-4c61-8061-1096a8844185 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:23.846526 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-468bc17f-8805-4c61-8061-1096a8844185 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] 10.222.0.20 "GET /compute/v2.1/servers/828cda24-b238-44bb-9007-142bbd02c041" status: 200 len: 1365 microversion: 2.47 time: 0.180997 Oct 27 03:47:23.858381 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3068/5836] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:47:23 2022] GET /compute/v2.1/servers/828cda24-b238-44bb-9007-142bbd02c041 => generated 1365 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:47:23.924777 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-99019abf-81d5-4c59-9270-866c074ad245 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1826057862", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "f90a174d-8b5f-4312-ba5e-0dfae4fc1d82"}]}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:47:23.929385 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-99019abf-81d5-4c59-9270-866c074ad245 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Request method failure captured: Oct 27 03:47:23.929385 n-d-862769-1 devstack@n-api.service[121000]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 03:47:23.929385 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:47:23.929385 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:47:23.929385 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:47:23.929385 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 1266 Oct 27 03:47:23.929385 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:47:23.929385 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:47:23.929385 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:47:23.929385 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:47:23.929385 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWf85sONR3AnWi-oRCG-wYAp7Y5x2vTiJUFlItcHe3gH43nG6LobqyZQcVndbXM_Imtr6hMGUnoCHFdTeGCMYLCBv_xB4wSNcwWBf_hHQJY561Y5pLtm-JxFOWBQtBHaFt5mzeJWIE1asvbMmec0h5jxO6gTEGzZDRwwjMVTAcSiSda8 Oct 27 03:47:23.929385 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:47:23.929385 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:47:23.929385 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:47:23.929385 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:47:23.929385 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:47:23.929385 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:47:23.929385 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 14a3cfa6aaa74174a706a759f692c113 Oct 27 03:47:23.929385 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1625756983 Oct 27 03:47:23.929385 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:47:23.929385 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:47:23.929385 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/14a3cfa6aaa74174a706a759f692c113"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/14a3cfa6aaa74174a706a759f692c113"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/14a3cfa6aaa74174a706a759f692c113"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_14a3cfa6aaa74174a706a759f692c113"}]}] Oct 27 03:47:23.929385 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1625756983 Oct 27 03:47:23.929385 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 14a3cfa6aaa74174a706a759f692c113 Oct 27 03:47:23.929385 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1625756983 Oct 27 03:47:23.929385 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ServerMetadataNegativeTestJSON-1625756983-project Oct 27 03:47:23.929385 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:47:23.929385 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:47:23.929385 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: b4dae167878b41699b8caae5a0386cf4 Oct 27 03:47:23.929385 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1625756983-project Oct 27 03:47:23.929385 n-d-862769-1 devstack@n-api.service[121000]: Oct 27 03:47:23.929385 n-d-862769-1 devstack@n-api.service[121000]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1826057862", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "f90a174d-8b5f-4312-ba5e-0dfae4fc1d82"}]}} Oct 27 03:47:23.929385 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:47:23.931904 n-d-862769-1 devstack@n-api.service[121000]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 03:47:23.931904 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1826057862', 'imageRef': 'c40fb871-5877-4b59-ab69-d9fd23b7a917', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'f90a174d-8b5f-4312-ba5e-0dfae4fc1d82'}]}}} Oct 27 03:47:23.931904 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:47:23.931904 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:47:23.931904 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 03:47:23.931904 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 03:47:23.931904 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 03:47:23.931904 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise error Oct 27 03:47:23.931904 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 03:47:23.931904 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:47:23.931904 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 27 03:47:23.931904 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 27 03:47:23.931904 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 27 03:47:23.931904 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 27 03:47:23.931904 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 27 03:47:23.931904 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:47:23.931904 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 27 03:47:23.933376 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 27 03:47:23.933376 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:47:23.933376 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:47:23.933376 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:47:23.933376 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:47:23.933376 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:47:23.933376 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:47:23.933376 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:47:23.933376 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:47:23.933376 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:47:23.933376 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:47:23.933376 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:47:23.933376 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:47:23.933376 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 03:47:23.933376 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 03:47:23.933376 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 03:47:23.933376 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 03:47:23.933376 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 03:47:23.933376 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 03:47:23.933376 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 03:47:23.933376 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:47:23.933376 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:47:23.933376 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:47:23.933376 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:47:23.933376 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:47:23.933376 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:47:23.933376 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 03:47:23.933376 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 03:47:23.937644 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 03:47:23.937644 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:47:23.937644 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-99019abf-81d5-4c59-9270-866c074ad245 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:47:23.937644 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-99019abf-81d5-4c59-9270-866c074ad245 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.012828 Oct 27 03:47:23.937644 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2769/5837] 10.222.0.20 () {60 vars in 1148 bytes} [Thu Oct 27 03:47:23 2022] POST /compute/v2.1/servers => generated 2221 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 27 03:47:23.940051 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d4fcabec-793a-49d3-8e0e-cd696ad1cf10 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:23.940689 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d4fcabec-793a-49d3-8e0e-cd696ad1cf10 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 0d158876-42f7-42da-99f1-c9458db9919e] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:23.947071 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8e7e75a4-8164-4d32-9d9d-2a837e2662aa tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:23.950116 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8e7e75a4-8164-4d32-9d9d-2a837e2662aa tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] [instance: 9c677e31-a71f-4f01-b124-3bc66349c9bf] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:23.950239 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d4fcabec-793a-49d3-8e0e-cd696ad1cf10 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:23.950239 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d4fcabec-793a-49d3-8e0e-cd696ad1cf10 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:23.950239 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d4fcabec-793a-49d3-8e0e-cd696ad1cf10 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:23.950239 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d4fcabec-793a-49d3-8e0e-cd696ad1cf10 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:23.950239 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d4fcabec-793a-49d3-8e0e-cd696ad1cf10 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:23.953638 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-8e7e75a4-8164-4d32-9d9d-2a837e2662aa tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] HTTP exception thrown: Instance 9c677e31-a71f-4f01-b124-3bc66349c9bf could not be found. Oct 27 03:47:23.955273 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8e7e75a4-8164-4d32-9d9d-2a837e2662aa tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Request method failure captured: Oct 27 03:47:23.955273 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/9c677e31-a71f-4f01-b124-3bc66349c9bf/metadata/test2 HTTP/1.1 Oct 27 03:47:23.955273 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:47:23.955273 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:47:23.955273 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:47:23.955273 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:47:23.955273 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:47:23.955273 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:47:23.955273 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:47:23.955273 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:47:23.955273 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWf85sONR3AnWi-oRCG-wYAp7Y5x2vTiJUFlItcHe3gH43nG6LobqyZQcVndbXM_Imtr6hMGUnoCHFdTeGCMYLCBv_xB4wSNcwWBf_hHQJY561Y5pLtm-JxFOWBQtBHaFt5mzeJWIE1asvbMmec0h5jxO6gTEGzZDRwwjMVTAcSiSda8 Oct 27 03:47:23.955273 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:47:23.955273 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:47:23.955273 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:47:23.955273 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:47:23.955273 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:47:23.955273 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:47:23.955273 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 14a3cfa6aaa74174a706a759f692c113 Oct 27 03:47:23.955273 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1625756983 Oct 27 03:47:23.955273 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:47:23.955273 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:47:23.955273 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/14a3cfa6aaa74174a706a759f692c113"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/14a3cfa6aaa74174a706a759f692c113"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/14a3cfa6aaa74174a706a759f692c113"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_14a3cfa6aaa74174a706a759f692c113"}]}] Oct 27 03:47:23.955273 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1625756983 Oct 27 03:47:23.955273 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 14a3cfa6aaa74174a706a759f692c113 Oct 27 03:47:23.955273 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1625756983 Oct 27 03:47:23.955273 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ServerMetadataNegativeTestJSON-1625756983-project Oct 27 03:47:23.955273 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:47:23.955273 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:47:23.955273 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: b4dae167878b41699b8caae5a0386cf4 Oct 27 03:47:23.955273 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1625756983-project Oct 27 03:47:23.955273 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:47:23.955273 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 9c677e31-a71f-4f01-b124-3bc66349c9bf could not be found. Oct 27 03:47:23.955273 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'server_id': '9c677e31-a71f-4f01-b124-3bc66349c9bf', 'id': 'test2'} Oct 27 03:47:23.955273 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:47:23.955273 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:47:23.955273 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:47:23.955273 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:47:23.955273 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:47:23.955273 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:47:23.955273 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 03:47:23.955273 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 03:47:23.955273 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c677e31-a71f-4f01-b124-3bc66349c9bf could not be found. Oct 27 03:47:23.955273 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:47:23.955273 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:47:23.955273 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:47:23.955273 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:47:23.955273 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:47:23.955273 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:47:23.955273 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:47:23.955273 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:47:23.955273 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:47:23.955273 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:47:23.955273 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Oct 27 03:47:23.955273 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 27 03:47:23.955273 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:47:23.955273 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:47:23.955273 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c677e31-a71f-4f01-b124-3bc66349c9bf could not be found. Oct 27 03:47:23.955273 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:47:23.955273 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:47:23.955273 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:47:23.955273 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:47:23.955273 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:47:23.955273 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:47:23.959711 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:47:23.959711 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:47:23.959711 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c677e31-a71f-4f01-b124-3bc66349c9bf could not be found. Oct 27 03:47:23.959711 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:47:23.960407 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d4fcabec-793a-49d3-8e0e-cd696ad1cf10 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:23.961961 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8e7e75a4-8164-4d32-9d9d-2a837e2662aa tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Returning 404 to user: Instance 9c677e31-a71f-4f01-b124-3bc66349c9bf could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:47:23.963344 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8e7e75a4-8164-4d32-9d9d-2a837e2662aa tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] 10.222.0.20 "GET /compute/v2.1/servers/9c677e31-a71f-4f01-b124-3bc66349c9bf/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.020803 Oct 27 03:47:23.975185 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2770/5838] 10.222.0.20 () {58 vars in 1281 bytes} [Thu Oct 27 03:47:23 2022] GET /compute/v2.1/servers/9c677e31-a71f-4f01-b124-3bc66349c9bf/metadata/test2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 03:47:23.980578 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4fa79172-ad55-4c38-81f5-3319797801cb tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:23.981703 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4fa79172-ad55-4c38-81f5-3319797801cb tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] [instance: 4068c7d8-3bbf-47cf-93ef-fded8f5094fe] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:23.989726 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4fa79172-ad55-4c38-81f5-3319797801cb tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:23.990867 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4fa79172-ad55-4c38-81f5-3319797801cb tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:23.991520 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4fa79172-ad55-4c38-81f5-3319797801cb tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:23.992440 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4fa79172-ad55-4c38-81f5-3319797801cb tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:23.993089 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4fa79172-ad55-4c38-81f5-3319797801cb tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:23.993717 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4fa79172-ad55-4c38-81f5-3319797801cb tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:24.023789 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4fa79172-ad55-4c38-81f5-3319797801cb tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] [instance: 4068c7d8-3bbf-47cf-93ef-fded8f5094fe] Going to try to terminate instance {{(pid=121000) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:47:24.125939 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d4fcabec-793a-49d3-8e0e-cd696ad1cf10 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:24.131438 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d4fcabec-793a-49d3-8e0e-cd696ad1cf10 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/0d158876-42f7-42da-99f1-c9458db9919e" status: 200 len: 1309 microversion: 2.1 time: 0.195803 Oct 27 03:47:24.132029 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3069/5839] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:47:23 2022] GET /compute/v2.1/servers/0d158876-42f7-42da-99f1-c9458db9919e => generated 1309 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:47:24.437168 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4fa79172-ad55-4c38-81f5-3319797801cb tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4068c7d8-3bbf-47cf-93ef-fded8f5094fe" status: 204 len: 0 microversion: 2.1 time: 0.459892 Oct 27 03:47:24.438915 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2771/5840] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:47:23 2022] DELETE /compute/v2.1/servers/4068c7d8-3bbf-47cf-93ef-fded8f5094fe => generated 0 bytes in 462 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:47:24.448251 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7efd4ef9-ab84-40ff-8907-ae311c2ca993 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:24.448960 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7efd4ef9-ab84-40ff-8907-ae311c2ca993 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] [instance: 4068c7d8-3bbf-47cf-93ef-fded8f5094fe] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:24.468678 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7efd4ef9-ab84-40ff-8907-ae311c2ca993 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:24.469174 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7efd4ef9-ab84-40ff-8907-ae311c2ca993 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:24.472790 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7efd4ef9-ab84-40ff-8907-ae311c2ca993 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:24.473797 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7efd4ef9-ab84-40ff-8907-ae311c2ca993 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:24.474470 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7efd4ef9-ab84-40ff-8907-ae311c2ca993 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:24.475074 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7efd4ef9-ab84-40ff-8907-ae311c2ca993 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:24.700162 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7efd4ef9-ab84-40ff-8907-ae311c2ca993 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4dae167878b41699b8caae5a0386cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a3cfa6aaa74174a706a759f692c113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:24.720769 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7efd4ef9-ab84-40ff-8907-ae311c2ca993 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] 10.222.0.20 "GET /compute/v2.1/servers/4068c7d8-3bbf-47cf-93ef-fded8f5094fe" status: 200 len: 1524 microversion: 2.1 time: 0.278491 Oct 27 03:47:24.724583 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3070/5841] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:47:24 2022] GET /compute/v2.1/servers/4068c7d8-3bbf-47cf-93ef-fded8f5094fe => generated 1524 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:47:24.875275 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f501afef-f0d7-4690-9ae9-864747b1f484 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:24.877337 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f501afef-f0d7-4690-9ae9-864747b1f484 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] [instance: 828cda24-b238-44bb-9007-142bbd02c041] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:24.883628 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-c2b7e8f8-876c-4757-90e0-3b8615105af3 req-f9d4a9ee-3072-4141-99dd-d1b621468b5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d158876-42f7-42da-99f1-c9458db9919e", "name": "network-vif-plugged", "status": "completed", "tag": "8b44a574-263f-43e0-b91b-4ab88b409f6a"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:47:24.905621 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f501afef-f0d7-4690-9ae9-864747b1f484 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:24.906162 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f501afef-f0d7-4690-9ae9-864747b1f484 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:24.906623 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f501afef-f0d7-4690-9ae9-864747b1f484 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:24.907365 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f501afef-f0d7-4690-9ae9-864747b1f484 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:24.907835 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f501afef-f0d7-4690-9ae9-864747b1f484 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:24.908266 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f501afef-f0d7-4690-9ae9-864747b1f484 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:24.915770 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-c2b7e8f8-876c-4757-90e0-3b8615105af3 req-f9d4a9ee-3072-4141-99dd-d1b621468b5b service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:24.919435 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-c2b7e8f8-876c-4757-90e0-3b8615105af3 req-f9d4a9ee-3072-4141-99dd-d1b621468b5b service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:24.920164 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-c2b7e8f8-876c-4757-90e0-3b8615105af3 req-f9d4a9ee-3072-4141-99dd-d1b621468b5b service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:24.957651 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-c2b7e8f8-876c-4757-90e0-3b8615105af3 req-f9d4a9ee-3072-4141-99dd-d1b621468b5b service nova] Creating event network-vif-plugged:8b44a574-263f-43e0-b91b-4ab88b409f6a for instance 0d158876-42f7-42da-99f1-c9458db9919e on n-h2-862769-1 Oct 27 03:47:24.966432 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-c2b7e8f8-876c-4757-90e0-3b8615105af3 req-f9d4a9ee-3072-4141-99dd-d1b621468b5b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086366 Oct 27 03:47:24.968209 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3071/5842] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:47:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:47:25.015354 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f501afef-f0d7-4690-9ae9-864747b1f484 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:25.024047 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f501afef-f0d7-4690-9ae9-864747b1f484 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:25.029419 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f501afef-f0d7-4690-9ae9-864747b1f484 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:25.033942 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f501afef-f0d7-4690-9ae9-864747b1f484 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] 10.222.0.20 "GET /compute/v2.1/servers/828cda24-b238-44bb-9007-142bbd02c041" status: 200 len: 1365 microversion: 2.47 time: 0.163901 Oct 27 03:47:25.039352 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2772/5843] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:47:24 2022] GET /compute/v2.1/servers/828cda24-b238-44bb-9007-142bbd02c041 => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:47:25.160136 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5d7762fb-9997-4da1-9750-55d16db31e38 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:25.160874 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5d7762fb-9997-4da1-9750-55d16db31e38 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 0d158876-42f7-42da-99f1-c9458db9919e] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:25.167280 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5d7762fb-9997-4da1-9750-55d16db31e38 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:25.167867 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5d7762fb-9997-4da1-9750-55d16db31e38 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:25.168317 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5d7762fb-9997-4da1-9750-55d16db31e38 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:25.169015 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5d7762fb-9997-4da1-9750-55d16db31e38 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:25.169473 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5d7762fb-9997-4da1-9750-55d16db31e38 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:25.170309 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5d7762fb-9997-4da1-9750-55d16db31e38 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:25.486292 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5d7762fb-9997-4da1-9750-55d16db31e38 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:25.499247 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5d7762fb-9997-4da1-9750-55d16db31e38 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/0d158876-42f7-42da-99f1-c9458db9919e" status: 200 len: 1309 microversion: 2.1 time: 0.342704 Oct 27 03:47:25.511128 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3072/5844] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:47:25 2022] GET /compute/v2.1/servers/0d158876-42f7-42da-99f1-c9458db9919e => generated 1309 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:47:25.750505 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-491e75a8-13ea-47c1-9919-704180ce3b89 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:25.751125 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-491e75a8-13ea-47c1-9919-704180ce3b89 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] [instance: 4068c7d8-3bbf-47cf-93ef-fded8f5094fe] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:25.767503 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-491e75a8-13ea-47c1-9919-704180ce3b89 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:25.769029 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-491e75a8-13ea-47c1-9919-704180ce3b89 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:25.770768 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-491e75a8-13ea-47c1-9919-704180ce3b89 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:25.774511 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-491e75a8-13ea-47c1-9919-704180ce3b89 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:25.775241 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-491e75a8-13ea-47c1-9919-704180ce3b89 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:25.775861 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-491e75a8-13ea-47c1-9919-704180ce3b89 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:25.986874 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-491e75a8-13ea-47c1-9919-704180ce3b89 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4dae167878b41699b8caae5a0386cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a3cfa6aaa74174a706a759f692c113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:26.015248 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-491e75a8-13ea-47c1-9919-704180ce3b89 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] 10.222.0.20 "GET /compute/v2.1/servers/4068c7d8-3bbf-47cf-93ef-fded8f5094fe" status: 200 len: 1524 microversion: 2.1 time: 0.269552 Oct 27 03:47:26.015886 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2773/5845] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:47:25 2022] GET /compute/v2.1/servers/4068c7d8-3bbf-47cf-93ef-fded8f5094fe => generated 1524 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:47:26.067819 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-cad0b842-677d-4ea8-82d5-ac14a283fbd4 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:26.068527 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-cad0b842-677d-4ea8-82d5-ac14a283fbd4 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] [instance: 828cda24-b238-44bb-9007-142bbd02c041] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:26.083888 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cad0b842-677d-4ea8-82d5-ac14a283fbd4 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:26.085351 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cad0b842-677d-4ea8-82d5-ac14a283fbd4 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:26.085806 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cad0b842-677d-4ea8-82d5-ac14a283fbd4 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:26.086569 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cad0b842-677d-4ea8-82d5-ac14a283fbd4 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:26.087959 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cad0b842-677d-4ea8-82d5-ac14a283fbd4 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:26.088415 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cad0b842-677d-4ea8-82d5-ac14a283fbd4 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:26.201770 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-cad0b842-677d-4ea8-82d5-ac14a283fbd4 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:26.215506 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-cad0b842-677d-4ea8-82d5-ac14a283fbd4 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:26.218172 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-cad0b842-677d-4ea8-82d5-ac14a283fbd4 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:26.219629 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-cad0b842-677d-4ea8-82d5-ac14a283fbd4 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] 10.222.0.20 "GET /compute/v2.1/servers/828cda24-b238-44bb-9007-142bbd02c041" status: 200 len: 1365 microversion: 2.47 time: 0.161327 Oct 27 03:47:26.237941 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3073/5846] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:47:26 2022] GET /compute/v2.1/servers/828cda24-b238-44bb-9007-142bbd02c041 => generated 1365 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:47:26.533778 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7ffb2dd5-2d6f-451f-b9c7-af1c9a9e0f9b tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:26.534710 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7ffb2dd5-2d6f-451f-b9c7-af1c9a9e0f9b tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 0d158876-42f7-42da-99f1-c9458db9919e] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:26.542485 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7ffb2dd5-2d6f-451f-b9c7-af1c9a9e0f9b tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:26.543168 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7ffb2dd5-2d6f-451f-b9c7-af1c9a9e0f9b tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:26.543715 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7ffb2dd5-2d6f-451f-b9c7-af1c9a9e0f9b tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:26.545076 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7ffb2dd5-2d6f-451f-b9c7-af1c9a9e0f9b tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:26.547305 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7ffb2dd5-2d6f-451f-b9c7-af1c9a9e0f9b tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:26.547846 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7ffb2dd5-2d6f-451f-b9c7-af1c9a9e0f9b tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:26.742450 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-34fa3cfd-b53a-4707-97c8-c85244c8bdf7 req-320fa745-a022-4d44-8de0-e270f9d2acbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4068c7d8-3bbf-47cf-93ef-fded8f5094fe", "name": "network-vif-deleted", "tag": "f6fadc34-a9cc-45da-bdfc-c402c49fd0f6"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:47:26.770447 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-34fa3cfd-b53a-4707-97c8-c85244c8bdf7 req-320fa745-a022-4d44-8de0-e270f9d2acbd service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:26.771256 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-34fa3cfd-b53a-4707-97c8-c85244c8bdf7 req-320fa745-a022-4d44-8de0-e270f9d2acbd service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:26.772001 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-34fa3cfd-b53a-4707-97c8-c85244c8bdf7 req-320fa745-a022-4d44-8de0-e270f9d2acbd service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:26.809086 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-34fa3cfd-b53a-4707-97c8-c85244c8bdf7 req-320fa745-a022-4d44-8de0-e270f9d2acbd service nova] Creating event network-vif-deleted:f6fadc34-a9cc-45da-bdfc-c402c49fd0f6 for instance 4068c7d8-3bbf-47cf-93ef-fded8f5094fe on n-h2-862769-1 Oct 27 03:47:26.815519 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-34fa3cfd-b53a-4707-97c8-c85244c8bdf7 req-320fa745-a022-4d44-8de0-e270f9d2acbd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094872 Oct 27 03:47:26.816137 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3074/5847] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:47:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:47:26.852424 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7ffb2dd5-2d6f-451f-b9c7-af1c9a9e0f9b tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:26.862497 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7ffb2dd5-2d6f-451f-b9c7-af1c9a9e0f9b tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/0d158876-42f7-42da-99f1-c9458db9919e" status: 200 len: 1309 microversion: 2.1 time: 0.333714 Oct 27 03:47:26.864664 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2774/5848] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:47:26 2022] GET /compute/v2.1/servers/0d158876-42f7-42da-99f1-c9458db9919e => generated 1309 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:47:27.041487 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-034964be-d41a-4d3c-9a00-5f71fcfc15c8 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:27.042551 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-034964be-d41a-4d3c-9a00-5f71fcfc15c8 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] [instance: 4068c7d8-3bbf-47cf-93ef-fded8f5094fe] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:27.050117 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-034964be-d41a-4d3c-9a00-5f71fcfc15c8 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:27.050611 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-034964be-d41a-4d3c-9a00-5f71fcfc15c8 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:27.051088 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-034964be-d41a-4d3c-9a00-5f71fcfc15c8 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:27.051792 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-034964be-d41a-4d3c-9a00-5f71fcfc15c8 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:27.052423 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-034964be-d41a-4d3c-9a00-5f71fcfc15c8 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:27.053044 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-034964be-d41a-4d3c-9a00-5f71fcfc15c8 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:27.125418 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-034964be-d41a-4d3c-9a00-5f71fcfc15c8 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4dae167878b41699b8caae5a0386cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a3cfa6aaa74174a706a759f692c113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:27.133459 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-034964be-d41a-4d3c-9a00-5f71fcfc15c8 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] 10.222.0.20 "GET /compute/v2.1/servers/4068c7d8-3bbf-47cf-93ef-fded8f5094fe" status: 200 len: 1308 microversion: 2.1 time: 0.097172 Oct 27 03:47:27.145282 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3075/5849] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:47:27 2022] GET /compute/v2.1/servers/4068c7d8-3bbf-47cf-93ef-fded8f5094fe => generated 1308 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:47:27.247587 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-44bb5323-6fe9-4d57-8897-a1b74a8722b0 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:27.249016 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-44bb5323-6fe9-4d57-8897-a1b74a8722b0 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] [instance: 828cda24-b238-44bb-9007-142bbd02c041] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:27.255779 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-44bb5323-6fe9-4d57-8897-a1b74a8722b0 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:27.256679 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-44bb5323-6fe9-4d57-8897-a1b74a8722b0 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:27.257346 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-44bb5323-6fe9-4d57-8897-a1b74a8722b0 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:27.258318 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-44bb5323-6fe9-4d57-8897-a1b74a8722b0 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:27.258925 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-44bb5323-6fe9-4d57-8897-a1b74a8722b0 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:27.263477 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-44bb5323-6fe9-4d57-8897-a1b74a8722b0 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:27.380916 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-44bb5323-6fe9-4d57-8897-a1b74a8722b0 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:27.390446 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-44bb5323-6fe9-4d57-8897-a1b74a8722b0 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:27.392316 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-44bb5323-6fe9-4d57-8897-a1b74a8722b0 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:27.393715 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-44bb5323-6fe9-4d57-8897-a1b74a8722b0 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] 10.222.0.20 "GET /compute/v2.1/servers/828cda24-b238-44bb-9007-142bbd02c041" status: 200 len: 1365 microversion: 2.47 time: 0.150724 Oct 27 03:47:27.394948 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2775/5850] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:47:27 2022] GET /compute/v2.1/servers/828cda24-b238-44bb-9007-142bbd02c041 => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:47:27.886654 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-360b9d93-653b-486f-aeb2-a66b0d64f140 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:27.887271 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-360b9d93-653b-486f-aeb2-a66b0d64f140 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 0d158876-42f7-42da-99f1-c9458db9919e] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:27.898874 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-360b9d93-653b-486f-aeb2-a66b0d64f140 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:27.899399 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-360b9d93-653b-486f-aeb2-a66b0d64f140 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:27.899958 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-360b9d93-653b-486f-aeb2-a66b0d64f140 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:27.900678 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-360b9d93-653b-486f-aeb2-a66b0d64f140 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:27.901150 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-360b9d93-653b-486f-aeb2-a66b0d64f140 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:27.901588 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-360b9d93-653b-486f-aeb2-a66b0d64f140 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:28.085761 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-360b9d93-653b-486f-aeb2-a66b0d64f140 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:28.094064 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-360b9d93-653b-486f-aeb2-a66b0d64f140 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/0d158876-42f7-42da-99f1-c9458db9919e" status: 200 len: 1491 microversion: 2.1 time: 0.211284 Oct 27 03:47:28.095580 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3076/5851] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:47:27 2022] GET /compute/v2.1/servers/0d158876-42f7-42da-99f1-c9458db9919e => generated 1491 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:47:28.124383 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7772dba9-cd8d-4ada-ae9b-abe0ee16d731 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:28.126413 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7772dba9-cd8d-4ada-ae9b-abe0ee16d731 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 971b44e4-41fc-40a8-907a-71f5345eaf01] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:28.132986 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7772dba9-cd8d-4ada-ae9b-abe0ee16d731 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:28.133810 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7772dba9-cd8d-4ada-ae9b-abe0ee16d731 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:28.134484 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7772dba9-cd8d-4ada-ae9b-abe0ee16d731 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:28.135405 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7772dba9-cd8d-4ada-ae9b-abe0ee16d731 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:28.135881 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7772dba9-cd8d-4ada-ae9b-abe0ee16d731 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:28.136320 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7772dba9-cd8d-4ada-ae9b-abe0ee16d731 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:28.172912 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c17d0296-e319-4978-a080-b3bce139fba0 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:28.174142 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c17d0296-e319-4978-a080-b3bce139fba0 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] [instance: 4068c7d8-3bbf-47cf-93ef-fded8f5094fe] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:28.190140 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c17d0296-e319-4978-a080-b3bce139fba0 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:28.191047 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c17d0296-e319-4978-a080-b3bce139fba0 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:28.193277 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c17d0296-e319-4978-a080-b3bce139fba0 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:28.196048 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c17d0296-e319-4978-a080-b3bce139fba0 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:28.200055 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c17d0296-e319-4978-a080-b3bce139fba0 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:28.200055 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c17d0296-e319-4978-a080-b3bce139fba0 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:28.231612 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-c17d0296-e319-4978-a080-b3bce139fba0 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] HTTP exception thrown: Instance 4068c7d8-3bbf-47cf-93ef-fded8f5094fe could not be found. Oct 27 03:47:28.240191 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c17d0296-e319-4978-a080-b3bce139fba0 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Request method failure captured: Oct 27 03:47:28.240191 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/4068c7d8-3bbf-47cf-93ef-fded8f5094fe HTTP/1.1 Oct 27 03:47:28.240191 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:47:28.240191 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:47:28.240191 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:47:28.240191 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:47:28.240191 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:47:28.240191 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:47:28.240191 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:47:28.240191 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:47:28.240191 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWf85sONR3AnWi-oRCG-wYAp7Y5x2vTiJUFlItcHe3gH43nG6LobqyZQcVndbXM_Imtr6hMGUnoCHFdTeGCMYLCBv_xB4wSNcwWBf_hHQJY561Y5pLtm-JxFOWBQtBHaFt5mzeJWIE1asvbMmec0h5jxO6gTEGzZDRwwjMVTAcSiSda8 Oct 27 03:47:28.240191 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:47:28.240191 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:47:28.240191 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:47:28.240191 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:47:28.240191 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:47:28.240191 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:47:28.240191 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 14a3cfa6aaa74174a706a759f692c113 Oct 27 03:47:28.240191 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1625756983 Oct 27 03:47:28.240191 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:47:28.240191 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:47:28.240191 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/14a3cfa6aaa74174a706a759f692c113"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/14a3cfa6aaa74174a706a759f692c113"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/14a3cfa6aaa74174a706a759f692c113"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_14a3cfa6aaa74174a706a759f692c113"}]}] Oct 27 03:47:28.240191 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1625756983 Oct 27 03:47:28.240191 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 14a3cfa6aaa74174a706a759f692c113 Oct 27 03:47:28.240191 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1625756983 Oct 27 03:47:28.240191 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServerMetadataNegativeTestJSON-1625756983-project Oct 27 03:47:28.240191 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:47:28.240191 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:47:28.240191 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: b4dae167878b41699b8caae5a0386cf4 Oct 27 03:47:28.240191 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1625756983-project Oct 27 03:47:28.240191 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:47:28.240191 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 4068c7d8-3bbf-47cf-93ef-fded8f5094fe could not be found. Oct 27 03:47:28.240191 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '4068c7d8-3bbf-47cf-93ef-fded8f5094fe'} Oct 27 03:47:28.240191 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:47:28.240191 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:47:28.240191 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:47:28.240191 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:47:28.240191 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:47:28.240191 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:47:28.240191 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:47:28.240191 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:47:28.240191 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:47:28.240191 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:47:28.240191 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4068c7d8-3bbf-47cf-93ef-fded8f5094fe could not be found. Oct 27 03:47:28.240191 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:47:28.240191 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:47:28.240191 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:47:28.240191 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:47:28.240191 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:47:28.240191 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:47:28.240191 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:47:28.240191 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:47:28.240191 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:47:28.240191 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:47:28.240191 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:47:28.240191 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:47:28.240191 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:47:28.240191 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:47:28.240191 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:47:28.240191 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:47:28.240191 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4068c7d8-3bbf-47cf-93ef-fded8f5094fe could not be found. Oct 27 03:47:28.240191 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:47:28.240191 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:47:28.246429 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:47:28.246429 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:47:28.246429 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:47:28.246429 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:47:28.246429 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:47:28.246429 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:47:28.246429 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4068c7d8-3bbf-47cf-93ef-fded8f5094fe could not be found. Oct 27 03:47:28.246429 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:47:28.250226 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c17d0296-e319-4978-a080-b3bce139fba0 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] Returning 404 to user: Instance 4068c7d8-3bbf-47cf-93ef-fded8f5094fe could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:47:28.251348 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c17d0296-e319-4978-a080-b3bce139fba0 tempest-ServerMetadataNegativeTestJSON-1625756983 tempest-ServerMetadataNegativeTestJSON-1625756983-project] 10.222.0.20 "GET /compute/v2.1/servers/4068c7d8-3bbf-47cf-93ef-fded8f5094fe" status: 404 len: 111 microversion: 2.1 time: 0.086085 Oct 27 03:47:28.252436 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3077/5852] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:47:28 2022] GET /compute/v2.1/servers/4068c7d8-3bbf-47cf-93ef-fded8f5094fe => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:47:28.346230 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7772dba9-cd8d-4ada-ae9b-abe0ee16d731 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:28.357202 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7772dba9-cd8d-4ada-ae9b-abe0ee16d731 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/971b44e4-41fc-40a8-907a-71f5345eaf01" status: 200 len: 1491 microversion: 2.1 time: 0.242613 Oct 27 03:47:28.358559 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2776/5853] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:47:28 2022] GET /compute/v2.1/servers/971b44e4-41fc-40a8-907a-71f5345eaf01 => generated 1491 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:47:28.381061 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d146f7f3-44af-4aa8-8613-09b4121e74c4 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:28.382108 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d146f7f3-44af-4aa8-8613-09b4121e74c4 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 0d158876-42f7-42da-99f1-c9458db9919e] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:28.396337 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d146f7f3-44af-4aa8-8613-09b4121e74c4 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:28.397307 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d146f7f3-44af-4aa8-8613-09b4121e74c4 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:28.399706 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d146f7f3-44af-4aa8-8613-09b4121e74c4 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:28.400908 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d146f7f3-44af-4aa8-8613-09b4121e74c4 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:28.401613 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d146f7f3-44af-4aa8-8613-09b4121e74c4 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:28.404700 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d146f7f3-44af-4aa8-8613-09b4121e74c4 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:28.425312 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4bea6dbc-d9a6-4d70-81ea-76f3ac097800 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:28.426313 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4bea6dbc-d9a6-4d70-81ea-76f3ac097800 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] [instance: 828cda24-b238-44bb-9007-142bbd02c041] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:28.442393 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4bea6dbc-d9a6-4d70-81ea-76f3ac097800 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:28.451217 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4bea6dbc-d9a6-4d70-81ea-76f3ac097800 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:28.453298 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4bea6dbc-d9a6-4d70-81ea-76f3ac097800 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:28.455509 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4bea6dbc-d9a6-4d70-81ea-76f3ac097800 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:28.456948 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4bea6dbc-d9a6-4d70-81ea-76f3ac097800 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:28.458160 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4bea6dbc-d9a6-4d70-81ea-76f3ac097800 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:28.616473 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4bea6dbc-d9a6-4d70-81ea-76f3ac097800 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:28.628451 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4bea6dbc-d9a6-4d70-81ea-76f3ac097800 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:28.632934 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4bea6dbc-d9a6-4d70-81ea-76f3ac097800 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:28.635216 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4bea6dbc-d9a6-4d70-81ea-76f3ac097800 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] 10.222.0.20 "GET /compute/v2.1/servers/828cda24-b238-44bb-9007-142bbd02c041" status: 200 len: 1365 microversion: 2.47 time: 0.215266 Oct 27 03:47:28.638846 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2777/5854] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:47:28 2022] GET /compute/v2.1/servers/828cda24-b238-44bb-9007-142bbd02c041 => generated 1365 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:47:28.836355 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d146f7f3-44af-4aa8-8613-09b4121e74c4 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:28.845144 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d146f7f3-44af-4aa8-8613-09b4121e74c4 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/0d158876-42f7-42da-99f1-c9458db9919e" status: 200 len: 1491 microversion: 2.1 time: 0.467898 Oct 27 03:47:28.846543 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3078/5855] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:47:28 2022] GET /compute/v2.1/servers/0d158876-42f7-42da-99f1-c9458db9919e => generated 1491 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:47:28.874119 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2faf2b23-bc54-4d91-9d5b-ba6760430b15 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:28.874896 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-2faf2b23-bc54-4d91-9d5b-ba6760430b15 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 0d158876-42f7-42da-99f1-c9458db9919e] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:28.896472 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2faf2b23-bc54-4d91-9d5b-ba6760430b15 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:28.896762 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2faf2b23-bc54-4d91-9d5b-ba6760430b15 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:28.897214 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2faf2b23-bc54-4d91-9d5b-ba6760430b15 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:28.897978 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2faf2b23-bc54-4d91-9d5b-ba6760430b15 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:28.910441 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2faf2b23-bc54-4d91-9d5b-ba6760430b15 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:28.911020 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2faf2b23-bc54-4d91-9d5b-ba6760430b15 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:28.967099 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-2faf2b23-bc54-4d91-9d5b-ba6760430b15 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 0d158876-42f7-42da-99f1-c9458db9919e] Going to try to terminate instance {{(pid=121000) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:47:29.380167 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2faf2b23-bc54-4d91-9d5b-ba6760430b15 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0d158876-42f7-42da-99f1-c9458db9919e" status: 204 len: 0 microversion: 2.1 time: 0.510883 Oct 27 03:47:29.387165 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2778/5856] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:47:28 2022] DELETE /compute/v2.1/servers/0d158876-42f7-42da-99f1-c9458db9919e => generated 0 bytes in 519 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 03:47:29.397720 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2ccc925e-46a7-4bc8-ac46-9b3bc476f2f2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:29.398588 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2ccc925e-46a7-4bc8-ac46-9b3bc476f2f2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 0d158876-42f7-42da-99f1-c9458db9919e] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:29.420787 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2ccc925e-46a7-4bc8-ac46-9b3bc476f2f2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:29.420787 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2ccc925e-46a7-4bc8-ac46-9b3bc476f2f2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:29.420787 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2ccc925e-46a7-4bc8-ac46-9b3bc476f2f2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:29.420787 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2ccc925e-46a7-4bc8-ac46-9b3bc476f2f2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:29.421892 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2ccc925e-46a7-4bc8-ac46-9b3bc476f2f2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:29.421892 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2ccc925e-46a7-4bc8-ac46-9b3bc476f2f2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:29.665960 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0b1ce230-8073-47f0-9bde-f0440b42bb05 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:29.667011 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0b1ce230-8073-47f0-9bde-f0440b42bb05 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] [instance: 828cda24-b238-44bb-9007-142bbd02c041] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:29.681977 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0b1ce230-8073-47f0-9bde-f0440b42bb05 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:29.682938 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0b1ce230-8073-47f0-9bde-f0440b42bb05 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:29.683715 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0b1ce230-8073-47f0-9bde-f0440b42bb05 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:29.684980 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0b1ce230-8073-47f0-9bde-f0440b42bb05 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:29.685621 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0b1ce230-8073-47f0-9bde-f0440b42bb05 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:29.686988 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0b1ce230-8073-47f0-9bde-f0440b42bb05 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:29.785118 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2ccc925e-46a7-4bc8-ac46-9b3bc476f2f2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:29.793060 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2ccc925e-46a7-4bc8-ac46-9b3bc476f2f2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/0d158876-42f7-42da-99f1-c9458db9919e" status: 200 len: 1497 microversion: 2.1 time: 0.400421 Oct 27 03:47:29.793659 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3079/5857] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:47:29 2022] GET /compute/v2.1/servers/0d158876-42f7-42da-99f1-c9458db9919e => generated 1497 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:47:29.844202 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0b1ce230-8073-47f0-9bde-f0440b42bb05 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:29.866001 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0b1ce230-8073-47f0-9bde-f0440b42bb05 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:29.867797 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0b1ce230-8073-47f0-9bde-f0440b42bb05 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:29.869070 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0b1ce230-8073-47f0-9bde-f0440b42bb05 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] 10.222.0.20 "GET /compute/v2.1/servers/828cda24-b238-44bb-9007-142bbd02c041" status: 200 len: 1365 microversion: 2.47 time: 0.208097 Oct 27 03:47:29.869646 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2779/5858] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:47:29 2022] GET /compute/v2.1/servers/828cda24-b238-44bb-9007-142bbd02c041 => generated 1365 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:47:30.818431 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-591c3368-6a87-4a72-9abe-0f5ba518b7a5 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:30.820325 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-591c3368-6a87-4a72-9abe-0f5ba518b7a5 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 0d158876-42f7-42da-99f1-c9458db9919e] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:30.831313 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-591c3368-6a87-4a72-9abe-0f5ba518b7a5 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:30.831313 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-591c3368-6a87-4a72-9abe-0f5ba518b7a5 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:30.831545 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-591c3368-6a87-4a72-9abe-0f5ba518b7a5 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:30.836097 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-591c3368-6a87-4a72-9abe-0f5ba518b7a5 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:30.837064 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-591c3368-6a87-4a72-9abe-0f5ba518b7a5 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:30.837768 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-591c3368-6a87-4a72-9abe-0f5ba518b7a5 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:30.898157 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3bcdab76-6d76-4046-90aa-0ad4ffffb3d8 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:30.899607 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-3bcdab76-6d76-4046-90aa-0ad4ffffb3d8 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] [instance: 828cda24-b238-44bb-9007-142bbd02c041] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:30.918664 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3bcdab76-6d76-4046-90aa-0ad4ffffb3d8 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:30.923957 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3bcdab76-6d76-4046-90aa-0ad4ffffb3d8 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:30.924731 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3bcdab76-6d76-4046-90aa-0ad4ffffb3d8 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:30.926561 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3bcdab76-6d76-4046-90aa-0ad4ffffb3d8 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:30.927052 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3bcdab76-6d76-4046-90aa-0ad4ffffb3d8 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:30.927493 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3bcdab76-6d76-4046-90aa-0ad4ffffb3d8 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:31.160658 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-3bcdab76-6d76-4046-90aa-0ad4ffffb3d8 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:31.172515 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-3bcdab76-6d76-4046-90aa-0ad4ffffb3d8 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:31.182012 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-3bcdab76-6d76-4046-90aa-0ad4ffffb3d8 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:31.184655 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3bcdab76-6d76-4046-90aa-0ad4ffffb3d8 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] 10.222.0.20 "GET /compute/v2.1/servers/828cda24-b238-44bb-9007-142bbd02c041" status: 200 len: 1365 microversion: 2.47 time: 0.290822 Oct 27 03:47:31.218769 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2780/5859] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:47:30 2022] GET /compute/v2.1/servers/828cda24-b238-44bb-9007-142bbd02c041 => generated 1365 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:47:31.420944 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-591c3368-6a87-4a72-9abe-0f5ba518b7a5 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:31.424845 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=100 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:31.447963 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-591c3368-6a87-4a72-9abe-0f5ba518b7a5 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/0d158876-42f7-42da-99f1-c9458db9919e" status: 200 len: 1497 microversion: 2.1 time: 0.633905 Oct 27 03:47:31.448746 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3080/5860] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:47:30 2022] GET /compute/v2.1/servers/0d158876-42f7-42da-99f1-c9458db9919e => generated 1497 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:47:32.218913 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-fbb33a8d-974f-4770-bd9a-e884d6d6cb89 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:32.219885 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-fbb33a8d-974f-4770-bd9a-e884d6d6cb89 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] [instance: 828cda24-b238-44bb-9007-142bbd02c041] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:32.227075 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fbb33a8d-974f-4770-bd9a-e884d6d6cb89 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:32.227580 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fbb33a8d-974f-4770-bd9a-e884d6d6cb89 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:32.236348 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fbb33a8d-974f-4770-bd9a-e884d6d6cb89 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:32.237304 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fbb33a8d-974f-4770-bd9a-e884d6d6cb89 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:32.237882 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fbb33a8d-974f-4770-bd9a-e884d6d6cb89 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:32.239484 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fbb33a8d-974f-4770-bd9a-e884d6d6cb89 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:32.474842 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c1993123-12be-4f29-b870-a0b6b5bcca4c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:32.477966 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c1993123-12be-4f29-b870-a0b6b5bcca4c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 0d158876-42f7-42da-99f1-c9458db9919e] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:32.489152 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c1993123-12be-4f29-b870-a0b6b5bcca4c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:32.490492 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c1993123-12be-4f29-b870-a0b6b5bcca4c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:32.491137 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c1993123-12be-4f29-b870-a0b6b5bcca4c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:32.492226 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c1993123-12be-4f29-b870-a0b6b5bcca4c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:32.492914 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c1993123-12be-4f29-b870-a0b6b5bcca4c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:32.501053 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c1993123-12be-4f29-b870-a0b6b5bcca4c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:32.667665 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-fbb33a8d-974f-4770-bd9a-e884d6d6cb89 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:32.689098 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-fbb33a8d-974f-4770-bd9a-e884d6d6cb89 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:32.690764 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-fbb33a8d-974f-4770-bd9a-e884d6d6cb89 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:32.692026 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-fbb33a8d-974f-4770-bd9a-e884d6d6cb89 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] 10.222.0.20 "GET /compute/v2.1/servers/828cda24-b238-44bb-9007-142bbd02c041" status: 200 len: 1365 microversion: 2.47 time: 0.477949 Oct 27 03:47:32.718735 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2781/5861] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:47:32 2022] GET /compute/v2.1/servers/828cda24-b238-44bb-9007-142bbd02c041 => generated 1365 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:47:32.735468 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c1993123-12be-4f29-b870-a0b6b5bcca4c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:32.768079 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-807cfb09-af40-476a-afa3-6f490aba5a84 req-7d8cfd3f-4cab-4982-a82d-68a3806fd0c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d158876-42f7-42da-99f1-c9458db9919e", "name": "network-vif-deleted", "tag": "8b44a574-263f-43e0-b91b-4ab88b409f6a"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:47:32.775163 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c1993123-12be-4f29-b870-a0b6b5bcca4c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/0d158876-42f7-42da-99f1-c9458db9919e" status: 200 len: 1455 microversion: 2.1 time: 0.299119 Oct 27 03:47:32.775163 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3081/5862] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:47:32 2022] GET /compute/v2.1/servers/0d158876-42f7-42da-99f1-c9458db9919e => generated 1455 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:47:32.782656 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-807cfb09-af40-476a-afa3-6f490aba5a84 req-7d8cfd3f-4cab-4982-a82d-68a3806fd0c0 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:32.783143 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-807cfb09-af40-476a-afa3-6f490aba5a84 req-7d8cfd3f-4cab-4982-a82d-68a3806fd0c0 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:32.783580 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-807cfb09-af40-476a-afa3-6f490aba5a84 req-7d8cfd3f-4cab-4982-a82d-68a3806fd0c0 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:32.813104 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-807cfb09-af40-476a-afa3-6f490aba5a84 req-7d8cfd3f-4cab-4982-a82d-68a3806fd0c0 service nova] Creating event network-vif-deleted:8b44a574-263f-43e0-b91b-4ab88b409f6a for instance 0d158876-42f7-42da-99f1-c9458db9919e on n-h2-862769-1 Oct 27 03:47:32.825051 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-807cfb09-af40-476a-afa3-6f490aba5a84 req-7d8cfd3f-4cab-4982-a82d-68a3806fd0c0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059534 Oct 27 03:47:32.825317 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2782/5863] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:47:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:47:33.740847 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-97f68036-e777-4bf5-8d4c-60fc7f72e8b4 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:33.742471 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-97f68036-e777-4bf5-8d4c-60fc7f72e8b4 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] [instance: 828cda24-b238-44bb-9007-142bbd02c041] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:33.758019 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-97f68036-e777-4bf5-8d4c-60fc7f72e8b4 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:33.759341 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-97f68036-e777-4bf5-8d4c-60fc7f72e8b4 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:33.760018 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-97f68036-e777-4bf5-8d4c-60fc7f72e8b4 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:33.762455 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-97f68036-e777-4bf5-8d4c-60fc7f72e8b4 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:33.763182 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-97f68036-e777-4bf5-8d4c-60fc7f72e8b4 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:33.766146 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-97f68036-e777-4bf5-8d4c-60fc7f72e8b4 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:33.806179 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-de8a98c2-de13-47a0-afa6-9900b5c647cb tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:33.815288 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-de8a98c2-de13-47a0-afa6-9900b5c647cb tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 0d158876-42f7-42da-99f1-c9458db9919e] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:33.826090 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-de8a98c2-de13-47a0-afa6-9900b5c647cb tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:33.827709 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-de8a98c2-de13-47a0-afa6-9900b5c647cb tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:33.828165 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-de8a98c2-de13-47a0-afa6-9900b5c647cb tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:33.830763 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-de8a98c2-de13-47a0-afa6-9900b5c647cb tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:33.831436 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-de8a98c2-de13-47a0-afa6-9900b5c647cb tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:33.834288 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-de8a98c2-de13-47a0-afa6-9900b5c647cb tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:33.898248 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:33.928503 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-de8a98c2-de13-47a0-afa6-9900b5c647cb tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:33.930150 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-de8a98c2-de13-47a0-afa6-9900b5c647cb tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:33.931580 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-de8a98c2-de13-47a0-afa6-9900b5c647cb tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:33.931733 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-97f68036-e777-4bf5-8d4c-60fc7f72e8b4 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:33.933932 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-de8a98c2-de13-47a0-afa6-9900b5c647cb tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lazy-loading 'fault' on Instance uuid 0d158876-42f7-42da-99f1-c9458db9919e {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:47:33.949856 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-97f68036-e777-4bf5-8d4c-60fc7f72e8b4 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:33.954986 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-97f68036-e777-4bf5-8d4c-60fc7f72e8b4 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:33.956230 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-97f68036-e777-4bf5-8d4c-60fc7f72e8b4 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] 10.222.0.20 "GET /compute/v2.1/servers/828cda24-b238-44bb-9007-142bbd02c041" status: 200 len: 1365 microversion: 2.47 time: 0.221594 Oct 27 03:47:33.970563 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3082/5864] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:47:33 2022] GET /compute/v2.1/servers/828cda24-b238-44bb-9007-142bbd02c041 => generated 1365 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:47:34.058534 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-de8a98c2-de13-47a0-afa6-9900b5c647cb tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:34.068570 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-de8a98c2-de13-47a0-afa6-9900b5c647cb tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/0d158876-42f7-42da-99f1-c9458db9919e" status: 200 len: 1299 microversion: 2.1 time: 0.271935 Oct 27 03:47:34.078694 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2783/5865] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:47:33 2022] GET /compute/v2.1/servers/0d158876-42f7-42da-99f1-c9458db9919e => generated 1299 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:47:34.986746 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1a49953b-08ec-4235-ad36-f9b7c87ef29b tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:34.987960 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1a49953b-08ec-4235-ad36-f9b7c87ef29b tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] [instance: 828cda24-b238-44bb-9007-142bbd02c041] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:35.005037 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1a49953b-08ec-4235-ad36-f9b7c87ef29b tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:35.005544 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1a49953b-08ec-4235-ad36-f9b7c87ef29b tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:35.005990 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1a49953b-08ec-4235-ad36-f9b7c87ef29b tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:35.006732 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1a49953b-08ec-4235-ad36-f9b7c87ef29b tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:35.007427 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1a49953b-08ec-4235-ad36-f9b7c87ef29b tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:35.008014 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1a49953b-08ec-4235-ad36-f9b7c87ef29b tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:35.078530 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1a49953b-08ec-4235-ad36-f9b7c87ef29b tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:35.086950 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1a49953b-08ec-4235-ad36-f9b7c87ef29b tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:35.094227 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-05d81f5a-4387-41b8-9525-1997b51020f2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:35.096937 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1a49953b-08ec-4235-ad36-f9b7c87ef29b tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:35.097210 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-05d81f5a-4387-41b8-9525-1997b51020f2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 0d158876-42f7-42da-99f1-c9458db9919e] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:35.097398 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1a49953b-08ec-4235-ad36-f9b7c87ef29b tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] 10.222.0.20 "GET /compute/v2.1/servers/828cda24-b238-44bb-9007-142bbd02c041" status: 200 len: 1365 microversion: 2.47 time: 0.113498 Oct 27 03:47:35.098936 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3083/5866] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:47:34 2022] GET /compute/v2.1/servers/828cda24-b238-44bb-9007-142bbd02c041 => generated 1365 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:47:35.120323 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-05d81f5a-4387-41b8-9525-1997b51020f2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:35.122957 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-05d81f5a-4387-41b8-9525-1997b51020f2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:35.130532 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-05d81f5a-4387-41b8-9525-1997b51020f2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:35.164391 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-05d81f5a-4387-41b8-9525-1997b51020f2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:35.166532 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-05d81f5a-4387-41b8-9525-1997b51020f2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.033s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:35.167702 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-05d81f5a-4387-41b8-9525-1997b51020f2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:35.209291 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-05d81f5a-4387-41b8-9525-1997b51020f2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] HTTP exception thrown: Instance 0d158876-42f7-42da-99f1-c9458db9919e could not be found. Oct 27 03:47:35.211216 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-05d81f5a-4387-41b8-9525-1997b51020f2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Request method failure captured: Oct 27 03:47:35.211216 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/0d158876-42f7-42da-99f1-c9458db9919e HTTP/1.1 Oct 27 03:47:35.211216 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:47:35.211216 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:47:35.211216 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:47:35.211216 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:47:35.211216 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:47:35.211216 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:47:35.211216 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:47:35.211216 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:47:35.211216 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWf7ao454EXpcvqw57oZ6kUl55rrrabqqRcgdR7_bXGBd3EhUlwYyYuxAfl-nrBiMviq2ipmr2mbr4b0cgBTMbKDOZJ9TP7cenW0zaGDKmMe2aswh3Oogol3Ct9m8LHYZYqPWmhLSqvB2K7fCZP-q-SBCjWA9jL7HEZxBqgIhBaRnNcs Oct 27 03:47:35.211216 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:47:35.211216 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:47:35.211216 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:47:35.211216 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:47:35.211216 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:47:35.211216 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:47:35.211216 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 86b90d4cb5eb42958248b6f82516ce19 Oct 27 03:47:35.211216 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ServersTestJSON-1724631621 Oct 27 03:47:35.211216 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:47:35.211216 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:47:35.211216 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86b90d4cb5eb42958248b6f82516ce19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/86b90d4cb5eb42958248b6f82516ce19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86b90d4cb5eb42958248b6f82516ce19"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_86b90d4cb5eb42958248b6f82516ce19"}]}] Oct 27 03:47:35.211216 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ServersTestJSON-1724631621 Oct 27 03:47:35.211216 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 86b90d4cb5eb42958248b6f82516ce19 Oct 27 03:47:35.211216 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ServersTestJSON-1724631621 Oct 27 03:47:35.211216 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ServersTestJSON-1724631621-project Oct 27 03:47:35.211216 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:47:35.211216 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:47:35.211216 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: ca2da57f02884a968d685b53a5399e46 Oct 27 03:47:35.211216 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ServersTestJSON-1724631621-project Oct 27 03:47:35.211216 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:47:35.211216 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 0d158876-42f7-42da-99f1-c9458db9919e could not be found. Oct 27 03:47:35.211216 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '0d158876-42f7-42da-99f1-c9458db9919e'} Oct 27 03:47:35.211216 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:47:35.211216 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:47:35.211216 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:47:35.211216 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:47:35.211216 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:47:35.211216 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:47:35.211216 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:47:35.211216 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:47:35.211216 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:47:35.211216 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:47:35.211216 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d158876-42f7-42da-99f1-c9458db9919e could not be found. Oct 27 03:47:35.211216 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:47:35.211216 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:47:35.211216 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:47:35.211216 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:47:35.211216 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:47:35.211216 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:47:35.211216 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:47:35.211216 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:47:35.211216 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:47:35.211216 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:47:35.211216 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:47:35.211216 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:47:35.211216 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:47:35.211216 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:47:35.211216 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:47:35.211216 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:47:35.211216 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d158876-42f7-42da-99f1-c9458db9919e could not be found. Oct 27 03:47:35.211216 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:47:35.211216 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:47:35.211216 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:47:35.220571 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:47:35.220571 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:47:35.220571 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:47:35.220571 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:47:35.220571 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:47:35.220571 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d158876-42f7-42da-99f1-c9458db9919e could not be found. Oct 27 03:47:35.220571 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:47:35.220571 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-05d81f5a-4387-41b8-9525-1997b51020f2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Returning 404 to user: Instance 0d158876-42f7-42da-99f1-c9458db9919e could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:47:35.220571 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-05d81f5a-4387-41b8-9525-1997b51020f2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/0d158876-42f7-42da-99f1-c9458db9919e" status: 404 len: 111 microversion: 2.1 time: 0.125683 Oct 27 03:47:35.220571 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2784/5867] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:47:35 2022] GET /compute/v2.1/servers/0d158876-42f7-42da-99f1-c9458db9919e => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 03:47:35.224901 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e83d50a9-e961-4d59-8ff7-f212f6c9b195 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:35.225558 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e83d50a9-e961-4d59-8ff7-f212f6c9b195 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 971b44e4-41fc-40a8-907a-71f5345eaf01] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:35.234741 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e83d50a9-e961-4d59-8ff7-f212f6c9b195 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:35.235387 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e83d50a9-e961-4d59-8ff7-f212f6c9b195 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:35.235837 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e83d50a9-e961-4d59-8ff7-f212f6c9b195 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:35.236727 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e83d50a9-e961-4d59-8ff7-f212f6c9b195 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:35.237256 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e83d50a9-e961-4d59-8ff7-f212f6c9b195 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:35.238409 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e83d50a9-e961-4d59-8ff7-f212f6c9b195 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:35.301922 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e83d50a9-e961-4d59-8ff7-f212f6c9b195 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 971b44e4-41fc-40a8-907a-71f5345eaf01] Going to try to terminate instance {{(pid=121001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:47:35.685373 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e83d50a9-e961-4d59-8ff7-f212f6c9b195 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "DELETE /compute/v2.1/servers/971b44e4-41fc-40a8-907a-71f5345eaf01" status: 204 len: 0 microversion: 2.1 time: 0.464430 Oct 27 03:47:35.687307 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3084/5868] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:47:35 2022] DELETE /compute/v2.1/servers/971b44e4-41fc-40a8-907a-71f5345eaf01 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:47:35.695032 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f33a2b0d-67f9-4f56-8cde-4d134eb261af tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:35.695651 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f33a2b0d-67f9-4f56-8cde-4d134eb261af tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 971b44e4-41fc-40a8-907a-71f5345eaf01] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:35.704792 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f33a2b0d-67f9-4f56-8cde-4d134eb261af tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:35.705290 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f33a2b0d-67f9-4f56-8cde-4d134eb261af tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:35.705728 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f33a2b0d-67f9-4f56-8cde-4d134eb261af tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:35.706687 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f33a2b0d-67f9-4f56-8cde-4d134eb261af tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:35.707785 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f33a2b0d-67f9-4f56-8cde-4d134eb261af tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:35.708406 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f33a2b0d-67f9-4f56-8cde-4d134eb261af tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:35.980849 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f33a2b0d-67f9-4f56-8cde-4d134eb261af tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:35.988686 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f33a2b0d-67f9-4f56-8cde-4d134eb261af tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/971b44e4-41fc-40a8-907a-71f5345eaf01" status: 200 len: 1497 microversion: 2.1 time: 0.297503 Oct 27 03:47:35.995254 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2785/5869] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:47:35 2022] GET /compute/v2.1/servers/971b44e4-41fc-40a8-907a-71f5345eaf01 => generated 1497 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:47:36.129316 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-bd51bb99-a04b-4146-bf3a-3742854e5f46 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:36.129316 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-bd51bb99-a04b-4146-bf3a-3742854e5f46 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] [instance: 828cda24-b238-44bb-9007-142bbd02c041] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:36.151726 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bd51bb99-a04b-4146-bf3a-3742854e5f46 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:36.152435 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bd51bb99-a04b-4146-bf3a-3742854e5f46 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:36.153633 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bd51bb99-a04b-4146-bf3a-3742854e5f46 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:36.154428 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bd51bb99-a04b-4146-bf3a-3742854e5f46 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:36.154906 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bd51bb99-a04b-4146-bf3a-3742854e5f46 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:36.158015 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bd51bb99-a04b-4146-bf3a-3742854e5f46 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:36.291924 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-bd51bb99-a04b-4146-bf3a-3742854e5f46 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:36.309764 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-bd51bb99-a04b-4146-bf3a-3742854e5f46 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:36.313866 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-bd51bb99-a04b-4146-bf3a-3742854e5f46 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:36.319231 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-bd51bb99-a04b-4146-bf3a-3742854e5f46 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] 10.222.0.20 "GET /compute/v2.1/servers/828cda24-b238-44bb-9007-142bbd02c041" status: 200 len: 1371 microversion: 2.47 time: 0.198154 Oct 27 03:47:36.321226 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3085/5870] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:47:36 2022] GET /compute/v2.1/servers/828cda24-b238-44bb-9007-142bbd02c041 => generated 1371 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:47:37.018987 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-40031969-13a9-47ab-a6e2-95c337d74941 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:37.022544 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-40031969-13a9-47ab-a6e2-95c337d74941 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 971b44e4-41fc-40a8-907a-71f5345eaf01] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:37.030047 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-40031969-13a9-47ab-a6e2-95c337d74941 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:37.030964 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-40031969-13a9-47ab-a6e2-95c337d74941 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:37.031656 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-40031969-13a9-47ab-a6e2-95c337d74941 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:37.032623 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-40031969-13a9-47ab-a6e2-95c337d74941 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:37.033357 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-40031969-13a9-47ab-a6e2-95c337d74941 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:37.034108 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-40031969-13a9-47ab-a6e2-95c337d74941 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:37.313224 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-40031969-13a9-47ab-a6e2-95c337d74941 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:37.321597 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-40031969-13a9-47ab-a6e2-95c337d74941 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/971b44e4-41fc-40a8-907a-71f5345eaf01" status: 200 len: 1497 microversion: 2.1 time: 0.308476 Oct 27 03:47:37.322224 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2786/5871] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:47:37 2022] GET /compute/v2.1/servers/971b44e4-41fc-40a8-907a-71f5345eaf01 => generated 1497 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:47:37.354200 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1bd10905-5eae-4281-a209-e4757fce8306 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:37.355593 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1bd10905-5eae-4281-a209-e4757fce8306 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] [instance: 828cda24-b238-44bb-9007-142bbd02c041] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:37.358866 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:37.371755 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1bd10905-5eae-4281-a209-e4757fce8306 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:37.372842 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1bd10905-5eae-4281-a209-e4757fce8306 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:37.374509 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1bd10905-5eae-4281-a209-e4757fce8306 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:37.376522 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1bd10905-5eae-4281-a209-e4757fce8306 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:37.378349 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1bd10905-5eae-4281-a209-e4757fce8306 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:37.378904 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1bd10905-5eae-4281-a209-e4757fce8306 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:37.573037 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1bd10905-5eae-4281-a209-e4757fce8306 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:37.586823 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1bd10905-5eae-4281-a209-e4757fce8306 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:37.591478 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1bd10905-5eae-4281-a209-e4757fce8306 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:37.598125 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1bd10905-5eae-4281-a209-e4757fce8306 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] 10.222.0.20 "GET /compute/v2.1/servers/828cda24-b238-44bb-9007-142bbd02c041" status: 200 len: 1371 microversion: 2.47 time: 0.249985 Oct 27 03:47:37.599168 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3086/5872] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:47:37 2022] GET /compute/v2.1/servers/828cda24-b238-44bb-9007-142bbd02c041 => generated 1371 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:47:38.352887 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d80d5dfe-5cf0-4c11-999e-43f54e14862b tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:38.353617 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d80d5dfe-5cf0-4c11-999e-43f54e14862b tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 971b44e4-41fc-40a8-907a-71f5345eaf01] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:38.377170 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d80d5dfe-5cf0-4c11-999e-43f54e14862b tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:38.384914 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d80d5dfe-5cf0-4c11-999e-43f54e14862b tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:38.386354 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d80d5dfe-5cf0-4c11-999e-43f54e14862b tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:38.389499 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d80d5dfe-5cf0-4c11-999e-43f54e14862b tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:38.394460 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d80d5dfe-5cf0-4c11-999e-43f54e14862b tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:38.396594 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d80d5dfe-5cf0-4c11-999e-43f54e14862b tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:38.475539 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-f8c2a304-3488-434a-8fbd-be769990da37 req-aba49771-92a3-46f4-8daf-cac607cff353 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "971b44e4-41fc-40a8-907a-71f5345eaf01", "name": "network-vif-deleted", "tag": "d2050a44-1676-4376-82f8-9669da31bb6c"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:47:38.488275 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-f8c2a304-3488-434a-8fbd-be769990da37 req-aba49771-92a3-46f4-8daf-cac607cff353 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:38.489515 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-f8c2a304-3488-434a-8fbd-be769990da37 req-aba49771-92a3-46f4-8daf-cac607cff353 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:38.490380 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-f8c2a304-3488-434a-8fbd-be769990da37 req-aba49771-92a3-46f4-8daf-cac607cff353 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:38.503458 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d80d5dfe-5cf0-4c11-999e-43f54e14862b tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:38.512778 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d80d5dfe-5cf0-4c11-999e-43f54e14862b tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/971b44e4-41fc-40a8-907a-71f5345eaf01" status: 200 len: 1455 microversion: 2.1 time: 0.164891 Oct 27 03:47:38.542027 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2787/5873] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:47:38 2022] GET /compute/v2.1/servers/971b44e4-41fc-40a8-907a-71f5345eaf01 => generated 1455 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:47:38.546608 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-f8c2a304-3488-434a-8fbd-be769990da37 req-aba49771-92a3-46f4-8daf-cac607cff353 service nova] Creating event network-vif-deleted:d2050a44-1676-4376-82f8-9669da31bb6c for instance 971b44e4-41fc-40a8-907a-71f5345eaf01 on n-h2-862769-1 Oct 27 03:47:38.556960 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-f8c2a304-3488-434a-8fbd-be769990da37 req-aba49771-92a3-46f4-8daf-cac607cff353 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085735 Oct 27 03:47:38.563267 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3087/5874] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:47:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:47:38.629362 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e8ac5097-b6fd-4b23-bf36-5d087720ce86 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:38.633880 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e8ac5097-b6fd-4b23-bf36-5d087720ce86 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] [instance: 828cda24-b238-44bb-9007-142bbd02c041] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:38.637324 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e8ac5097-b6fd-4b23-bf36-5d087720ce86 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:38.637809 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e8ac5097-b6fd-4b23-bf36-5d087720ce86 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:38.642189 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e8ac5097-b6fd-4b23-bf36-5d087720ce86 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:38.642933 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e8ac5097-b6fd-4b23-bf36-5d087720ce86 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:38.643404 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e8ac5097-b6fd-4b23-bf36-5d087720ce86 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:38.643843 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e8ac5097-b6fd-4b23-bf36-5d087720ce86 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:38.771218 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e8ac5097-b6fd-4b23-bf36-5d087720ce86 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:38.778221 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e8ac5097-b6fd-4b23-bf36-5d087720ce86 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:38.780466 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e8ac5097-b6fd-4b23-bf36-5d087720ce86 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:38.782023 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e8ac5097-b6fd-4b23-bf36-5d087720ce86 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] 10.222.0.20 "GET /compute/v2.1/servers/828cda24-b238-44bb-9007-142bbd02c041" status: 200 len: 1356 microversion: 2.47 time: 0.156632 Oct 27 03:47:38.782729 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2788/5875] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:47:38 2022] GET /compute/v2.1/servers/828cda24-b238-44bb-9007-142bbd02c041 => generated 1356 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:47:38.816524 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-78515422-5c30-42c4-a8be-e79b70246937 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:38.825600 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-78515422-5c30-42c4-a8be-e79b70246937 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:38.831011 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-78515422-5c30-42c4-a8be-e79b70246937 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Searching by: {'deleted': False, 'project_id': '99b82766f45e4f8c8d207974abe7f19a'} {{(pid=121001) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 03:47:38.846330 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-78515422-5c30-42c4-a8be-e79b70246937 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:38.846330 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-78515422-5c30-42c4-a8be-e79b70246937 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:38.846330 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-78515422-5c30-42c4-a8be-e79b70246937 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:38.846330 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-78515422-5c30-42c4-a8be-e79b70246937 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:38.846330 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-78515422-5c30-42c4-a8be-e79b70246937 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:38.846330 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-78515422-5c30-42c4-a8be-e79b70246937 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:39.097365 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.multi_cell_list [None req-78515422-5c30-42c4-a8be-e79b70246937 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=121001) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 03:47:39.212297 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-78515422-5c30-42c4-a8be-e79b70246937 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:39.221613 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-78515422-5c30-42c4-a8be-e79b70246937 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:39.222259 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-78515422-5c30-42c4-a8be-e79b70246937 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:39.222960 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-78515422-5c30-42c4-a8be-e79b70246937 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:39.239672 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-78515422-5c30-42c4-a8be-e79b70246937 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:39.242360 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-78515422-5c30-42c4-a8be-e79b70246937 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:39.303459 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-78515422-5c30-42c4-a8be-e79b70246937 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] 10.222.0.20 "GET /compute/v2.1/servers/detail" status: 200 len: 2705 microversion: 2.47 time: 0.485144 Oct 27 03:47:39.303459 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3088/5876] 10.222.0.20 () {60 vars in 1187 bytes} [Thu Oct 27 03:47:38 2022] GET /compute/v2.1/servers/detail => generated 2705 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:47:39.331945 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-09de7c62-67af-4c13-8822-11408a27f31d tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:39.332488 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-09de7c62-67af-4c13-8822-11408a27f31d tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] [instance: 828cda24-b238-44bb-9007-142bbd02c041] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:39.341389 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-09de7c62-67af-4c13-8822-11408a27f31d tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:39.347276 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-09de7c62-67af-4c13-8822-11408a27f31d tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:39.348096 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-09de7c62-67af-4c13-8822-11408a27f31d tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:39.349787 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-09de7c62-67af-4c13-8822-11408a27f31d tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:39.350797 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-09de7c62-67af-4c13-8822-11408a27f31d tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:39.360393 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-09de7c62-67af-4c13-8822-11408a27f31d tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:39.413915 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-09de7c62-67af-4c13-8822-11408a27f31d tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] [instance: 828cda24-b238-44bb-9007-142bbd02c041] Going to try to terminate instance {{(pid=121000) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:47:39.554614 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-91fd5741-3d23-46de-9899-3fbd7e314cc2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:39.557218 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-91fd5741-3d23-46de-9899-3fbd7e314cc2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 971b44e4-41fc-40a8-907a-71f5345eaf01] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:39.571767 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-91fd5741-3d23-46de-9899-3fbd7e314cc2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:39.573731 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-91fd5741-3d23-46de-9899-3fbd7e314cc2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:39.574819 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-91fd5741-3d23-46de-9899-3fbd7e314cc2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:39.578871 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-91fd5741-3d23-46de-9899-3fbd7e314cc2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:39.579567 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-91fd5741-3d23-46de-9899-3fbd7e314cc2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:39.581162 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-91fd5741-3d23-46de-9899-3fbd7e314cc2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:39.642688 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-91fd5741-3d23-46de-9899-3fbd7e314cc2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:39.643684 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-91fd5741-3d23-46de-9899-3fbd7e314cc2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:39.644422 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-91fd5741-3d23-46de-9899-3fbd7e314cc2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:39.646476 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-91fd5741-3d23-46de-9899-3fbd7e314cc2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lazy-loading 'fault' on Instance uuid 971b44e4-41fc-40a8-907a-71f5345eaf01 {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:47:39.815515 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-91fd5741-3d23-46de-9899-3fbd7e314cc2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:39.827276 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-91fd5741-3d23-46de-9899-3fbd7e314cc2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/971b44e4-41fc-40a8-907a-71f5345eaf01" status: 200 len: 1299 microversion: 2.1 time: 0.286915 Oct 27 03:47:39.827886 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3089/5877] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:47:39 2022] GET /compute/v2.1/servers/971b44e4-41fc-40a8-907a-71f5345eaf01 => generated 1299 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:47:40.025315 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-09de7c62-67af-4c13-8822-11408a27f31d tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] 10.222.0.20 "DELETE /compute/v2.1/servers/828cda24-b238-44bb-9007-142bbd02c041" status: 204 len: 0 microversion: 2.47 time: 0.693637 Oct 27 03:47:40.028006 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2789/5878] 10.222.0.20 () {60 vars in 1280 bytes} [Thu Oct 27 03:47:39 2022] DELETE /compute/v2.1/servers/828cda24-b238-44bb-9007-142bbd02c041 => generated 0 bytes in 702 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 27 03:47:40.042966 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-26ac2c86-6119-4828-bd1e-0464cadf9b9a tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:40.046115 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-26ac2c86-6119-4828-bd1e-0464cadf9b9a tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] [instance: 828cda24-b238-44bb-9007-142bbd02c041] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:40.063073 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-26ac2c86-6119-4828-bd1e-0464cadf9b9a tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:40.065326 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-26ac2c86-6119-4828-bd1e-0464cadf9b9a tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:40.065830 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-26ac2c86-6119-4828-bd1e-0464cadf9b9a tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:40.067932 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-26ac2c86-6119-4828-bd1e-0464cadf9b9a tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:40.068422 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-26ac2c86-6119-4828-bd1e-0464cadf9b9a tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:40.068872 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-26ac2c86-6119-4828-bd1e-0464cadf9b9a tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:40.234072 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-26ac2c86-6119-4828-bd1e-0464cadf9b9a tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:40.253708 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-26ac2c86-6119-4828-bd1e-0464cadf9b9a tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:40.264946 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-26ac2c86-6119-4828-bd1e-0464cadf9b9a tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:40.278161 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-26ac2c86-6119-4828-bd1e-0464cadf9b9a tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] 10.222.0.20 "GET /compute/v2.1/servers/828cda24-b238-44bb-9007-142bbd02c041" status: 200 len: 1362 microversion: 2.47 time: 0.234456 Oct 27 03:47:40.278161 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3090/5879] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:47:40 2022] GET /compute/v2.1/servers/828cda24-b238-44bb-9007-142bbd02c041 => generated 1362 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:47:40.855745 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-793cd958-f28e-4418-9b88-89dca5ced8db tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:40.856457 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-793cd958-f28e-4418-9b88-89dca5ced8db tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 971b44e4-41fc-40a8-907a-71f5345eaf01] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:40.871868 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-793cd958-f28e-4418-9b88-89dca5ced8db tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:40.872365 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-793cd958-f28e-4418-9b88-89dca5ced8db tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:40.872802 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-793cd958-f28e-4418-9b88-89dca5ced8db tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:40.873613 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-793cd958-f28e-4418-9b88-89dca5ced8db tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:40.874067 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-793cd958-f28e-4418-9b88-89dca5ced8db tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:40.874500 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-793cd958-f28e-4418-9b88-89dca5ced8db tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:40.928939 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-793cd958-f28e-4418-9b88-89dca5ced8db tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] HTTP exception thrown: Instance 971b44e4-41fc-40a8-907a-71f5345eaf01 could not be found. Oct 27 03:47:40.930854 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-793cd958-f28e-4418-9b88-89dca5ced8db tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Request method failure captured: Oct 27 03:47:40.930854 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/971b44e4-41fc-40a8-907a-71f5345eaf01 HTTP/1.1 Oct 27 03:47:40.930854 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:47:40.930854 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:47:40.930854 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:47:40.930854 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:47:40.930854 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:47:40.930854 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:47:40.930854 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:47:40.930854 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:47:40.930854 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWf7ao454EXpcvqw57oZ6kUl55rrrabqqRcgdR7_bXGBd3EhUlwYyYuxAfl-nrBiMviq2ipmr2mbr4b0cgBTMbKDOZJ9TP7cenW0zaGDKmMe2aswh3Oogol3Ct9m8LHYZYqPWmhLSqvB2K7fCZP-q-SBCjWA9jL7HEZxBqgIhBaRnNcs Oct 27 03:47:40.930854 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:47:40.930854 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:47:40.930854 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:47:40.930854 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:47:40.930854 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:47:40.930854 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:47:40.930854 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 86b90d4cb5eb42958248b6f82516ce19 Oct 27 03:47:40.930854 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ServersTestJSON-1724631621 Oct 27 03:47:40.930854 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:47:40.930854 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:47:40.930854 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86b90d4cb5eb42958248b6f82516ce19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/86b90d4cb5eb42958248b6f82516ce19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86b90d4cb5eb42958248b6f82516ce19"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_86b90d4cb5eb42958248b6f82516ce19"}]}] Oct 27 03:47:40.930854 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ServersTestJSON-1724631621 Oct 27 03:47:40.930854 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 86b90d4cb5eb42958248b6f82516ce19 Oct 27 03:47:40.930854 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ServersTestJSON-1724631621 Oct 27 03:47:40.930854 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ServersTestJSON-1724631621-project Oct 27 03:47:40.930854 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:47:40.930854 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:47:40.930854 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: ca2da57f02884a968d685b53a5399e46 Oct 27 03:47:40.930854 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ServersTestJSON-1724631621-project Oct 27 03:47:40.930854 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:47:40.930854 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 971b44e4-41fc-40a8-907a-71f5345eaf01 could not be found. Oct 27 03:47:40.930854 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '971b44e4-41fc-40a8-907a-71f5345eaf01'} Oct 27 03:47:40.930854 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:47:40.930854 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:47:40.930854 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:47:40.930854 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:47:40.930854 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:47:40.930854 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:47:40.930854 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:47:40.930854 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:47:40.930854 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:47:40.930854 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:47:40.930854 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 971b44e4-41fc-40a8-907a-71f5345eaf01 could not be found. Oct 27 03:47:40.930854 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:47:40.930854 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:47:40.930854 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:47:40.930854 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:47:40.930854 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:47:40.930854 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:47:40.930854 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:47:40.930854 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:47:40.930854 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:47:40.930854 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:47:40.930854 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:47:40.930854 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:47:40.930854 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:47:40.930854 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:47:40.930854 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:47:40.930854 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:47:40.930854 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 971b44e4-41fc-40a8-907a-71f5345eaf01 could not be found. Oct 27 03:47:40.930854 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:47:40.930854 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:47:40.930854 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:47:40.936970 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:47:40.936970 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:47:40.936970 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:47:40.936970 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:47:40.936970 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:47:40.936970 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 971b44e4-41fc-40a8-907a-71f5345eaf01 could not be found. Oct 27 03:47:40.936970 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:47:40.936970 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-793cd958-f28e-4418-9b88-89dca5ced8db tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Returning 404 to user: Instance 971b44e4-41fc-40a8-907a-71f5345eaf01 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:47:40.936970 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-793cd958-f28e-4418-9b88-89dca5ced8db tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/971b44e4-41fc-40a8-907a-71f5345eaf01" status: 404 len: 111 microversion: 2.1 time: 0.082070 Oct 27 03:47:40.936970 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2790/5880] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:47:40 2022] GET /compute/v2.1/servers/971b44e4-41fc-40a8-907a-71f5345eaf01 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:47:41.138610 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5c08b74c-0266-46f7-83bb-595a425f93a7 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1000132073", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": [{"uuid": "6ad05158-ac44-4c49-b5d6-443f42165c93"}]}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:47:41.217868 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.network.neutron [None req-5c08b74c-0266-46f7-83bb-595a425f93a7 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] validate_networks() for [('6ad05158-ac44-4c49-b5d6-443f42165c93', None, None, None, None, None)] {{(pid=121001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:47:41.303642 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7908d5db-d5a4-42fd-8144-6fe34dccf2aa tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:41.304414 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7908d5db-d5a4-42fd-8144-6fe34dccf2aa tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] [instance: 828cda24-b238-44bb-9007-142bbd02c041] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:41.316320 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7908d5db-d5a4-42fd-8144-6fe34dccf2aa tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:41.316320 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7908d5db-d5a4-42fd-8144-6fe34dccf2aa tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:41.316320 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7908d5db-d5a4-42fd-8144-6fe34dccf2aa tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:41.321262 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7908d5db-d5a4-42fd-8144-6fe34dccf2aa tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:41.321866 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7908d5db-d5a4-42fd-8144-6fe34dccf2aa tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:41.323368 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7908d5db-d5a4-42fd-8144-6fe34dccf2aa tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:41.639249 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7908d5db-d5a4-42fd-8144-6fe34dccf2aa tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:41.652853 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7908d5db-d5a4-42fd-8144-6fe34dccf2aa tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:41.655379 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7908d5db-d5a4-42fd-8144-6fe34dccf2aa tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:41.657248 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7908d5db-d5a4-42fd-8144-6fe34dccf2aa tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] 10.222.0.20 "GET /compute/v2.1/servers/828cda24-b238-44bb-9007-142bbd02c041" status: 200 len: 1362 microversion: 2.47 time: 0.358876 Oct 27 03:47:41.674804 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2791/5881] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:47:41 2022] GET /compute/v2.1/servers/828cda24-b238-44bb-9007-142bbd02c041 => generated 1362 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:47:42.416852 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-5c08b74c-0266-46f7-83bb-595a425f93a7 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Flavor limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:47:42.417456 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-5c08b74c-0266-46f7-83bb-595a425f93a7 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Image limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:47:42.417962 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-5c08b74c-0266-46f7-83bb-595a425f93a7 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Flavor pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:47:42.418463 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-5c08b74c-0266-46f7-83bb-595a425f93a7 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Image pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:47:42.418894 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-5c08b74c-0266-46f7-83bb-595a425f93a7 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:47:42.473534 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5c08b74c-0266-46f7-83bb-595a425f93a7 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:42.474058 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5c08b74c-0266-46f7-83bb-595a425f93a7 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:42.478486 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5c08b74c-0266-46f7-83bb-595a425f93a7 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:42.479712 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5c08b74c-0266-46f7-83bb-595a425f93a7 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:42.482635 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5c08b74c-0266-46f7-83bb-595a425f93a7 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:42.483607 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5c08b74c-0266-46f7-83bb-595a425f93a7 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:42.513461 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-5c08b74c-0266-46f7-83bb-595a425f93a7 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Getting quotas for project 86b90d4cb5eb42958248b6f82516ce19. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:47:42.521057 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-5c08b74c-0266-46f7-83bb-595a425f93a7 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Getting quotas for user ca2da57f02884a968d685b53a5399e46 and project 86b90d4cb5eb42958248b6f82516ce19. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:47:42.536512 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5c08b74c-0266-46f7-83bb-595a425f93a7 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Going to run 1 instances... {{(pid=121001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:47:42.539650 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5c08b74c-0266-46f7-83bb-595a425f93a7 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 39d1b0a9-6838-4b40-b786-ea685404db46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:47:42.691005 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5e805e1d-590f-431b-8c17-f16edb29bebf tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:42.692801 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5e805e1d-590f-431b-8c17-f16edb29bebf tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] [instance: 828cda24-b238-44bb-9007-142bbd02c041] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:42.711029 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5e805e1d-590f-431b-8c17-f16edb29bebf tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:42.715040 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5e805e1d-590f-431b-8c17-f16edb29bebf tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:42.716339 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5e805e1d-590f-431b-8c17-f16edb29bebf tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:42.718170 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5e805e1d-590f-431b-8c17-f16edb29bebf tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:42.718912 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5e805e1d-590f-431b-8c17-f16edb29bebf tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:42.719886 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5e805e1d-590f-431b-8c17-f16edb29bebf tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:42.763118 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5c08b74c-0266-46f7-83bb-595a425f93a7 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.624592 Oct 27 03:47:42.766602 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3091/5882] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:47:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1632 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 03:47:42.785338 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-680fad73-05ff-49e9-b510-f193fde7fee1 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:42.787098 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-680fad73-05ff-49e9-b510-f193fde7fee1 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 39d1b0a9-6838-4b40-b786-ea685404db46] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:42.838933 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5e805e1d-590f-431b-8c17-f16edb29bebf tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:42.839925 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5e805e1d-590f-431b-8c17-f16edb29bebf tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:42.840672 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5e805e1d-590f-431b-8c17-f16edb29bebf tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:42.841307 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-5e805e1d-590f-431b-8c17-f16edb29bebf tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lazy-loading 'fault' on Instance uuid 828cda24-b238-44bb-9007-142bbd02c041 {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:47:42.948739 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5e805e1d-590f-431b-8c17-f16edb29bebf tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:42.966204 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5e805e1d-590f-431b-8c17-f16edb29bebf tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:42.983399 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5e805e1d-590f-431b-8c17-f16edb29bebf tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:42.989228 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5e805e1d-590f-431b-8c17-f16edb29bebf tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] 10.222.0.20 "GET /compute/v2.1/servers/828cda24-b238-44bb-9007-142bbd02c041" status: 200 len: 1367 microversion: 2.47 time: 0.302600 Oct 27 03:47:42.992109 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2792/5883] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:47:42 2022] GET /compute/v2.1/servers/828cda24-b238-44bb-9007-142bbd02c041 => generated 1367 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:47:43.080998 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-680fad73-05ff-49e9-b510-f193fde7fee1 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:43.089670 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-680fad73-05ff-49e9-b510-f193fde7fee1 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/39d1b0a9-6838-4b40-b786-ea685404db46" status: 200 len: 1209 microversion: 2.1 time: 0.316267 Oct 27 03:47:43.094624 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3092/5884] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:47:42 2022] GET /compute/v2.1/servers/39d1b0a9-6838-4b40-b786-ea685404db46 => generated 1209 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:47:44.054212 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-cfec12b6-712c-4458-a898-d8bc24aceb00 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:44.065604 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-cfec12b6-712c-4458-a898-d8bc24aceb00 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] [instance: 828cda24-b238-44bb-9007-142bbd02c041] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:44.093573 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cfec12b6-712c-4458-a898-d8bc24aceb00 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:44.094771 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cfec12b6-712c-4458-a898-d8bc24aceb00 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:44.098239 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cfec12b6-712c-4458-a898-d8bc24aceb00 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:44.101692 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cfec12b6-712c-4458-a898-d8bc24aceb00 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:44.104656 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cfec12b6-712c-4458-a898-d8bc24aceb00 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:44.105158 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cfec12b6-712c-4458-a898-d8bc24aceb00 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:44.125565 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-99fb3c7e-c322-41e0-9148-18ea7ec5d93f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:44.126260 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-99fb3c7e-c322-41e0-9148-18ea7ec5d93f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 39d1b0a9-6838-4b40-b786-ea685404db46] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:44.139151 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-cfec12b6-712c-4458-a898-d8bc24aceb00 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] HTTP exception thrown: Instance 828cda24-b238-44bb-9007-142bbd02c041 could not be found. Oct 27 03:47:44.139151 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-cfec12b6-712c-4458-a898-d8bc24aceb00 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Request method failure captured: Oct 27 03:47:44.139151 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/828cda24-b238-44bb-9007-142bbd02c041 HTTP/1.1 Oct 27 03:47:44.139151 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:47:44.139151 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:47:44.139151 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:47:44.139151 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:47:44.139151 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:47:44.139151 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:47:44.139151 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:47:44.139151 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:47:44.139151 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWf8qHEeTgKYoHtffPiJby-NXRyQB5usYWl22U9TZVen2cmT9z0Gms3mWbz952ky7iAw276aIXhjHtBJXmKBRAcFn_OLAGXnp0k_RI44uYV9kzQoS_5Q_hkUyotrHCmDAHVBbXvSlYGqx8tVUQsyoXs4dpsNFKYDwgWfwbUpsohTX5qg Oct 27 03:47:44.139151 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:47:44.139151 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:47:44.139151 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:47:44.139151 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:47:44.139151 n-d-862769-1 devstack@n-api.service[121000]: X-Openstack-Nova-Api-Version: 2.47 Oct 27 03:47:44.139151 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:47:44.139151 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:47:44.139151 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 99b82766f45e4f8c8d207974abe7f19a Oct 27 03:47:44.139151 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ServerShowV247Test-821367319 Oct 27 03:47:44.139151 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:47:44.139151 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:47:44.139151 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/99b82766f45e4f8c8d207974abe7f19a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/99b82766f45e4f8c8d207974abe7f19a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/99b82766f45e4f8c8d207974abe7f19a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_99b82766f45e4f8c8d207974abe7f19a"}]}] Oct 27 03:47:44.139151 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ServerShowV247Test-821367319 Oct 27 03:47:44.139151 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 99b82766f45e4f8c8d207974abe7f19a Oct 27 03:47:44.139151 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ServerShowV247Test-821367319 Oct 27 03:47:44.139151 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ServerShowV247Test-821367319-project Oct 27 03:47:44.139151 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:47:44.139151 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:47:44.139151 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 966feb108a724a18919b3a106e9d9c8e Oct 27 03:47:44.139151 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ServerShowV247Test-821367319-project Oct 27 03:47:44.139151 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:47:44.139151 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 828cda24-b238-44bb-9007-142bbd02c041 could not be found. Oct 27 03:47:44.139151 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '828cda24-b238-44bb-9007-142bbd02c041'} Oct 27 03:47:44.139151 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:47:44.139151 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:47:44.139151 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:47:44.139151 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:47:44.139151 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:47:44.139151 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:47:44.139151 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:47:44.139151 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:47:44.139151 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:47:44.139151 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:47:44.139151 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 828cda24-b238-44bb-9007-142bbd02c041 could not be found. Oct 27 03:47:44.139151 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:47:44.139151 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:47:44.139151 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:47:44.139151 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:47:44.139151 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:47:44.139151 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:47:44.139151 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:47:44.139151 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:47:44.139151 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:47:44.139151 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:47:44.139151 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:47:44.139151 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:47:44.139151 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:47:44.139151 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:47:44.139151 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:47:44.139151 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:47:44.144612 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 828cda24-b238-44bb-9007-142bbd02c041 could not be found. Oct 27 03:47:44.144612 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:47:44.144612 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:47:44.144612 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:47:44.144612 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:47:44.144612 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:47:44.144612 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:47:44.144612 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:47:44.144612 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:47:44.144612 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 828cda24-b238-44bb-9007-142bbd02c041 could not be found. Oct 27 03:47:44.144612 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:47:44.144612 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-cfec12b6-712c-4458-a898-d8bc24aceb00 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Returning 404 to user: Instance 828cda24-b238-44bb-9007-142bbd02c041 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:47:44.144612 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-cfec12b6-712c-4458-a898-d8bc24aceb00 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] 10.222.0.20 "GET /compute/v2.1/servers/828cda24-b238-44bb-9007-142bbd02c041" status: 404 len: 111 microversion: 2.47 time: 0.118076 Oct 27 03:47:44.144612 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2793/5885] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:47:44 2022] GET /compute/v2.1/servers/828cda24-b238-44bb-9007-142bbd02c041 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 03:47:44.156723 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-56fd4749-94a2-4cbb-851a-51039168b8a5 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:44.157245 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-56fd4749-94a2-4cbb-851a-51039168b8a5 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] [instance: 91b09d24-f41f-474e-8820-1ee53e3aabd4] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:44.170546 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:44.172371 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-56fd4749-94a2-4cbb-851a-51039168b8a5 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:44.175536 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-56fd4749-94a2-4cbb-851a-51039168b8a5 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:44.176192 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-56fd4749-94a2-4cbb-851a-51039168b8a5 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:44.211609 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-56fd4749-94a2-4cbb-851a-51039168b8a5 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:44.212382 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-56fd4749-94a2-4cbb-851a-51039168b8a5 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:44.213040 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-56fd4749-94a2-4cbb-851a-51039168b8a5 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:44.284553 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-56fd4749-94a2-4cbb-851a-51039168b8a5 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] [instance: 91b09d24-f41f-474e-8820-1ee53e3aabd4] Going to try to terminate instance {{(pid=121000) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:47:44.402714 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-99fb3c7e-c322-41e0-9148-18ea7ec5d93f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:44.416351 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-99fb3c7e-c322-41e0-9148-18ea7ec5d93f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/39d1b0a9-6838-4b40-b786-ea685404db46" status: 200 len: 1209 microversion: 2.1 time: 0.294100 Oct 27 03:47:44.442323 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3093/5886] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:47:44 2022] GET /compute/v2.1/servers/39d1b0a9-6838-4b40-b786-ea685404db46 => generated 1209 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:47:44.760757 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-56fd4749-94a2-4cbb-851a-51039168b8a5 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] 10.222.0.20 "DELETE /compute/v2.1/servers/91b09d24-f41f-474e-8820-1ee53e3aabd4" status: 204 len: 0 microversion: 2.47 time: 0.615601 Oct 27 03:47:44.764565 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2794/5887] 10.222.0.20 () {60 vars in 1280 bytes} [Thu Oct 27 03:47:44 2022] DELETE /compute/v2.1/servers/91b09d24-f41f-474e-8820-1ee53e3aabd4 => generated 0 bytes in 617 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 27 03:47:44.772019 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-31ea1d80-e5d5-4e1e-938f-6df094892fdc tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:44.773013 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-31ea1d80-e5d5-4e1e-938f-6df094892fdc tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] [instance: 91b09d24-f41f-474e-8820-1ee53e3aabd4] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:44.789157 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-31ea1d80-e5d5-4e1e-938f-6df094892fdc tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:44.791759 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-31ea1d80-e5d5-4e1e-938f-6df094892fdc tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:44.796180 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-31ea1d80-e5d5-4e1e-938f-6df094892fdc tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:44.801516 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-31ea1d80-e5d5-4e1e-938f-6df094892fdc tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:44.806854 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-31ea1d80-e5d5-4e1e-938f-6df094892fdc tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:44.806854 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-31ea1d80-e5d5-4e1e-938f-6df094892fdc tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:45.209766 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-31ea1d80-e5d5-4e1e-938f-6df094892fdc tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:45.220283 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-31ea1d80-e5d5-4e1e-938f-6df094892fdc tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:45.235875 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-31ea1d80-e5d5-4e1e-938f-6df094892fdc tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:45.238526 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-31ea1d80-e5d5-4e1e-938f-6df094892fdc tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] 10.222.0.20 "GET /compute/v2.1/servers/91b09d24-f41f-474e-8820-1ee53e3aabd4" status: 200 len: 1362 microversion: 2.47 time: 0.471240 Oct 27 03:47:45.239375 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3094/5888] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:47:44 2022] GET /compute/v2.1/servers/91b09d24-f41f-474e-8820-1ee53e3aabd4 => generated 1362 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:47:45.445011 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6512c4fd-10ee-4560-9562-c7efbd372a33 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:45.446490 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6512c4fd-10ee-4560-9562-c7efbd372a33 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 39d1b0a9-6838-4b40-b786-ea685404db46] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:45.476178 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6512c4fd-10ee-4560-9562-c7efbd372a33 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:45.476178 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6512c4fd-10ee-4560-9562-c7efbd372a33 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:45.476178 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6512c4fd-10ee-4560-9562-c7efbd372a33 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:45.504190 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6512c4fd-10ee-4560-9562-c7efbd372a33 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:45.504190 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6512c4fd-10ee-4560-9562-c7efbd372a33 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:45.504190 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6512c4fd-10ee-4560-9562-c7efbd372a33 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:45.713377 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-6512c4fd-10ee-4560-9562-c7efbd372a33 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:45.738827 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6512c4fd-10ee-4560-9562-c7efbd372a33 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/39d1b0a9-6838-4b40-b786-ea685404db46" status: 200 len: 1261 microversion: 2.1 time: 0.284186 Oct 27 03:47:45.738827 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2795/5889] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:47:45 2022] GET /compute/v2.1/servers/39d1b0a9-6838-4b40-b786-ea685404db46 => generated 1261 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:47:46.268358 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6e5af6f1-7c8c-45cf-b3fd-0551efbc634a tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:46.268996 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-6e5af6f1-7c8c-45cf-b3fd-0551efbc634a tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] [instance: 91b09d24-f41f-474e-8820-1ee53e3aabd4] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:46.278774 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6e5af6f1-7c8c-45cf-b3fd-0551efbc634a tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:46.289424 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6e5af6f1-7c8c-45cf-b3fd-0551efbc634a tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:46.290337 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6e5af6f1-7c8c-45cf-b3fd-0551efbc634a tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:46.291430 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6e5af6f1-7c8c-45cf-b3fd-0551efbc634a tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:46.292104 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6e5af6f1-7c8c-45cf-b3fd-0551efbc634a tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:46.292722 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6e5af6f1-7c8c-45cf-b3fd-0551efbc634a tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:46.424258 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6e5af6f1-7c8c-45cf-b3fd-0551efbc634a tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:46.433449 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6e5af6f1-7c8c-45cf-b3fd-0551efbc634a tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:46.441181 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6e5af6f1-7c8c-45cf-b3fd-0551efbc634a tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:46.444559 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6e5af6f1-7c8c-45cf-b3fd-0551efbc634a tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] 10.222.0.20 "GET /compute/v2.1/servers/91b09d24-f41f-474e-8820-1ee53e3aabd4" status: 200 len: 1362 microversion: 2.47 time: 0.181034 Oct 27 03:47:46.446345 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3095/5890] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:47:46 2022] GET /compute/v2.1/servers/91b09d24-f41f-474e-8820-1ee53e3aabd4 => generated 1362 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:47:46.749955 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-46ab85eb-0e65-4dfc-a362-d2354d5eaa2e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:46.751277 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-46ab85eb-0e65-4dfc-a362-d2354d5eaa2e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 39d1b0a9-6838-4b40-b786-ea685404db46] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:46.788842 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-46ab85eb-0e65-4dfc-a362-d2354d5eaa2e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:46.799931 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-46ab85eb-0e65-4dfc-a362-d2354d5eaa2e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:46.799931 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-46ab85eb-0e65-4dfc-a362-d2354d5eaa2e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:46.799931 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-46ab85eb-0e65-4dfc-a362-d2354d5eaa2e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:46.799931 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-46ab85eb-0e65-4dfc-a362-d2354d5eaa2e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:46.799931 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-46ab85eb-0e65-4dfc-a362-d2354d5eaa2e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:47.153302 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-46ab85eb-0e65-4dfc-a362-d2354d5eaa2e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:47.168178 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-46ab85eb-0e65-4dfc-a362-d2354d5eaa2e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/39d1b0a9-6838-4b40-b786-ea685404db46" status: 200 len: 1267 microversion: 2.1 time: 0.422626 Oct 27 03:47:47.174172 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2796/5891] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:47:46 2022] GET /compute/v2.1/servers/39d1b0a9-6838-4b40-b786-ea685404db46 => generated 1267 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:47:47.475432 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9ef749e1-82c3-4ef2-bfcb-d6ee0bbdf442 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:47.476811 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-9ef749e1-82c3-4ef2-bfcb-d6ee0bbdf442 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] [instance: 91b09d24-f41f-474e-8820-1ee53e3aabd4] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:47.491611 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9ef749e1-82c3-4ef2-bfcb-d6ee0bbdf442 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:47.492531 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9ef749e1-82c3-4ef2-bfcb-d6ee0bbdf442 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:47.494204 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9ef749e1-82c3-4ef2-bfcb-d6ee0bbdf442 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:47.496240 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9ef749e1-82c3-4ef2-bfcb-d6ee0bbdf442 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:47.496941 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9ef749e1-82c3-4ef2-bfcb-d6ee0bbdf442 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:47.498900 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9ef749e1-82c3-4ef2-bfcb-d6ee0bbdf442 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:47.892050 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9ef749e1-82c3-4ef2-bfcb-d6ee0bbdf442 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:47.933498 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9ef749e1-82c3-4ef2-bfcb-d6ee0bbdf442 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:47.956679 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9ef749e1-82c3-4ef2-bfcb-d6ee0bbdf442 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:47.960792 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9ef749e1-82c3-4ef2-bfcb-d6ee0bbdf442 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] 10.222.0.20 "GET /compute/v2.1/servers/91b09d24-f41f-474e-8820-1ee53e3aabd4" status: 200 len: 1362 microversion: 2.47 time: 0.488750 Oct 27 03:47:47.961925 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3096/5892] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:47:47 2022] GET /compute/v2.1/servers/91b09d24-f41f-474e-8820-1ee53e3aabd4 => generated 1362 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:47:48.200066 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-95b92c38-e2fe-4564-ba2d-17fe876751ee tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:48.200805 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-95b92c38-e2fe-4564-ba2d-17fe876751ee tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 39d1b0a9-6838-4b40-b786-ea685404db46] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:48.212377 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-95b92c38-e2fe-4564-ba2d-17fe876751ee tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:48.215622 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-95b92c38-e2fe-4564-ba2d-17fe876751ee tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:48.216279 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-95b92c38-e2fe-4564-ba2d-17fe876751ee tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:48.217715 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-95b92c38-e2fe-4564-ba2d-17fe876751ee tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:48.219315 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-95b92c38-e2fe-4564-ba2d-17fe876751ee tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:48.231554 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-95b92c38-e2fe-4564-ba2d-17fe876751ee tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:48.506204 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-95b92c38-e2fe-4564-ba2d-17fe876751ee tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:48.532605 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:48.539323 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-95b92c38-e2fe-4564-ba2d-17fe876751ee tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/39d1b0a9-6838-4b40-b786-ea685404db46" status: 200 len: 1267 microversion: 2.1 time: 0.345042 Oct 27 03:47:48.561399 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2797/5893] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:47:48 2022] GET /compute/v2.1/servers/39d1b0a9-6838-4b40-b786-ea685404db46 => generated 1267 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:47:48.992039 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f0c3619e-b2b9-47cf-a930-1cdbcdaced85 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:48.992706 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f0c3619e-b2b9-47cf-a930-1cdbcdaced85 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] [instance: 91b09d24-f41f-474e-8820-1ee53e3aabd4] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:49.002678 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f0c3619e-b2b9-47cf-a930-1cdbcdaced85 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:49.005573 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f0c3619e-b2b9-47cf-a930-1cdbcdaced85 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:49.007015 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f0c3619e-b2b9-47cf-a930-1cdbcdaced85 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:49.009084 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f0c3619e-b2b9-47cf-a930-1cdbcdaced85 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:49.012124 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f0c3619e-b2b9-47cf-a930-1cdbcdaced85 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:49.012846 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f0c3619e-b2b9-47cf-a930-1cdbcdaced85 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:49.088035 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f0c3619e-b2b9-47cf-a930-1cdbcdaced85 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:49.094151 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f0c3619e-b2b9-47cf-a930-1cdbcdaced85 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:49.094831 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f0c3619e-b2b9-47cf-a930-1cdbcdaced85 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:49.095413 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-f0c3619e-b2b9-47cf-a930-1cdbcdaced85 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lazy-loading 'fault' on Instance uuid 91b09d24-f41f-474e-8820-1ee53e3aabd4 {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:47:49.143246 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f0c3619e-b2b9-47cf-a930-1cdbcdaced85 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:49.154817 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:49.171276 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f0c3619e-b2b9-47cf-a930-1cdbcdaced85 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:49.192612 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f0c3619e-b2b9-47cf-a930-1cdbcdaced85 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966feb108a724a18919b3a106e9d9c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b82766f45e4f8c8d207974abe7f19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:49.200706 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f0c3619e-b2b9-47cf-a930-1cdbcdaced85 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] 10.222.0.20 "GET /compute/v2.1/servers/91b09d24-f41f-474e-8820-1ee53e3aabd4" status: 200 len: 1367 microversion: 2.47 time: 0.212355 Oct 27 03:47:49.211702 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3097/5894] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:47:48 2022] GET /compute/v2.1/servers/91b09d24-f41f-474e-8820-1ee53e3aabd4 => generated 1367 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:47:49.569946 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2f3d516d-7635-49d8-a7e5-eb160cd27e24 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:49.570777 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-2f3d516d-7635-49d8-a7e5-eb160cd27e24 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 39d1b0a9-6838-4b40-b786-ea685404db46] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:49.591548 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2f3d516d-7635-49d8-a7e5-eb160cd27e24 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:49.598410 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2f3d516d-7635-49d8-a7e5-eb160cd27e24 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:49.598410 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2f3d516d-7635-49d8-a7e5-eb160cd27e24 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:49.598410 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2f3d516d-7635-49d8-a7e5-eb160cd27e24 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:49.601797 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2f3d516d-7635-49d8-a7e5-eb160cd27e24 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:49.603087 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2f3d516d-7635-49d8-a7e5-eb160cd27e24 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:50.021496 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2f3d516d-7635-49d8-a7e5-eb160cd27e24 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:50.035766 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2f3d516d-7635-49d8-a7e5-eb160cd27e24 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/39d1b0a9-6838-4b40-b786-ea685404db46" status: 200 len: 1309 microversion: 2.1 time: 0.469298 Oct 27 03:47:50.036369 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2798/5895] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:47:49 2022] GET /compute/v2.1/servers/39d1b0a9-6838-4b40-b786-ea685404db46 => generated 1309 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:47:50.436320 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b2dc2e4d-c3ad-4759-9c53-3b267aa136a4 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:50.436320 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b2dc2e4d-c3ad-4759-9c53-3b267aa136a4 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] [instance: 91b09d24-f41f-474e-8820-1ee53e3aabd4] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:50.436320 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b2dc2e4d-c3ad-4759-9c53-3b267aa136a4 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:50.436320 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b2dc2e4d-c3ad-4759-9c53-3b267aa136a4 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:50.436320 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b2dc2e4d-c3ad-4759-9c53-3b267aa136a4 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:50.436320 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b2dc2e4d-c3ad-4759-9c53-3b267aa136a4 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:50.436320 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b2dc2e4d-c3ad-4759-9c53-3b267aa136a4 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:50.436320 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b2dc2e4d-c3ad-4759-9c53-3b267aa136a4 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:50.436320 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-b2dc2e4d-c3ad-4759-9c53-3b267aa136a4 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] HTTP exception thrown: Instance 91b09d24-f41f-474e-8820-1ee53e3aabd4 could not be found. Oct 27 03:47:50.436320 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b2dc2e4d-c3ad-4759-9c53-3b267aa136a4 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Request method failure captured: Oct 27 03:47:50.436320 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/91b09d24-f41f-474e-8820-1ee53e3aabd4 HTTP/1.1 Oct 27 03:47:50.436320 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:47:50.436320 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:47:50.436320 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:47:50.436320 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:47:50.436320 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:47:50.436320 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:47:50.436320 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:47:50.436320 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:47:50.436320 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWf8qHEeTgKYoHtffPiJby-NXRyQB5usYWl22U9TZVen2cmT9z0Gms3mWbz952ky7iAw276aIXhjHtBJXmKBRAcFn_OLAGXnp0k_RI44uYV9kzQoS_5Q_hkUyotrHCmDAHVBbXvSlYGqx8tVUQsyoXs4dpsNFKYDwgWfwbUpsohTX5qg Oct 27 03:47:50.436320 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:47:50.436320 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:47:50.436320 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:47:50.436320 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:47:50.436320 n-d-862769-1 devstack@n-api.service[121001]: X-Openstack-Nova-Api-Version: 2.47 Oct 27 03:47:50.436320 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:47:50.436320 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:47:50.436320 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 99b82766f45e4f8c8d207974abe7f19a Oct 27 03:47:50.436320 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServerShowV247Test-821367319 Oct 27 03:47:50.436320 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:47:50.436320 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:47:50.448847 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/99b82766f45e4f8c8d207974abe7f19a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/99b82766f45e4f8c8d207974abe7f19a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/99b82766f45e4f8c8d207974abe7f19a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_99b82766f45e4f8c8d207974abe7f19a"}]}] Oct 27 03:47:50.448847 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServerShowV247Test-821367319 Oct 27 03:47:50.448847 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 99b82766f45e4f8c8d207974abe7f19a Oct 27 03:47:50.448847 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServerShowV247Test-821367319 Oct 27 03:47:50.448847 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServerShowV247Test-821367319-project Oct 27 03:47:50.448847 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:47:50.448847 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:47:50.448847 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 966feb108a724a18919b3a106e9d9c8e Oct 27 03:47:50.448847 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServerShowV247Test-821367319-project Oct 27 03:47:50.448847 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:47:50.448847 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 91b09d24-f41f-474e-8820-1ee53e3aabd4 could not be found. Oct 27 03:47:50.448847 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '91b09d24-f41f-474e-8820-1ee53e3aabd4'} Oct 27 03:47:50.448847 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:47:50.448847 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:47:50.448847 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:47:50.448847 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:47:50.448847 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:47:50.448847 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:47:50.448847 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:47:50.448847 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:47:50.448847 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:47:50.448847 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:47:50.448847 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91b09d24-f41f-474e-8820-1ee53e3aabd4 could not be found. Oct 27 03:47:50.448847 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:47:50.448847 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:47:50.448847 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:47:50.448847 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:47:50.448847 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:47:50.448847 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:47:50.448847 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:47:50.448847 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:47:50.448847 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:47:50.448847 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:47:50.448847 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:47:50.448847 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:47:50.448847 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:47:50.448847 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:47:50.448847 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:47:50.448847 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:47:50.448847 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91b09d24-f41f-474e-8820-1ee53e3aabd4 could not be found. Oct 27 03:47:50.448847 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:47:50.448847 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:47:50.448847 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:47:50.448847 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:47:50.448847 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:47:50.448847 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:47:50.448847 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:47:50.448847 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:47:50.448847 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91b09d24-f41f-474e-8820-1ee53e3aabd4 could not be found. Oct 27 03:47:50.448847 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:47:50.448847 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b2dc2e4d-c3ad-4759-9c53-3b267aa136a4 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] Returning 404 to user: Instance 91b09d24-f41f-474e-8820-1ee53e3aabd4 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:47:50.463303 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b2dc2e4d-c3ad-4759-9c53-3b267aa136a4 tempest-ServerShowV247Test-821367319 tempest-ServerShowV247Test-821367319-project] 10.222.0.20 "GET /compute/v2.1/servers/91b09d24-f41f-474e-8820-1ee53e3aabd4" status: 404 len: 111 microversion: 2.47 time: 0.060923 Oct 27 03:47:50.463303 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3098/5896] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:47:50 2022] GET /compute/v2.1/servers/91b09d24-f41f-474e-8820-1ee53e3aabd4 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 03:47:50.800807 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8e17ece7-918f-4d20-beb2-138e71abfc7d tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-769153705", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": [{"uuid": "59726d99-7765-41f1-8d52-5b59b7b769e1"}]}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:47:50.902808 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-8e17ece7-918f-4d20-beb2-138e71abfc7d tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] validate_networks() for [('59726d99-7765-41f1-8d52-5b59b7b769e1', None, None, None, None, None)] {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:47:51.067779 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a7f0d087-7daf-4e34-8fac-e7943f4639b3 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:51.071919 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a7f0d087-7daf-4e34-8fac-e7943f4639b3 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 39d1b0a9-6838-4b40-b786-ea685404db46] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:51.094368 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a7f0d087-7daf-4e34-8fac-e7943f4639b3 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:51.095108 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a7f0d087-7daf-4e34-8fac-e7943f4639b3 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:51.095818 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a7f0d087-7daf-4e34-8fac-e7943f4639b3 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:51.098522 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a7f0d087-7daf-4e34-8fac-e7943f4639b3 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:51.099163 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a7f0d087-7daf-4e34-8fac-e7943f4639b3 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:51.101300 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a7f0d087-7daf-4e34-8fac-e7943f4639b3 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:51.449705 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a7f0d087-7daf-4e34-8fac-e7943f4639b3 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:51.469430 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a7f0d087-7daf-4e34-8fac-e7943f4639b3 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/39d1b0a9-6838-4b40-b786-ea685404db46" status: 200 len: 1309 microversion: 2.1 time: 0.406427 Oct 27 03:47:51.473835 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3099/5897] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:47:51 2022] GET /compute/v2.1/servers/39d1b0a9-6838-4b40-b786-ea685404db46 => generated 1309 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:47:51.806827 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-50b84432-00a8-4663-8df3-b0143e5a4428 req-b441d4e6-2119-4704-b903-0975e322b19f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39d1b0a9-6838-4b40-b786-ea685404db46", "tag": "6a8c41a9-99d6-47db-ad6c-e0f59c1598e8"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:47:51.839700 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-50b84432-00a8-4663-8df3-b0143e5a4428 req-b441d4e6-2119-4704-b903-0975e322b19f service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:51.841202 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-50b84432-00a8-4663-8df3-b0143e5a4428 req-b441d4e6-2119-4704-b903-0975e322b19f service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:51.842563 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-50b84432-00a8-4663-8df3-b0143e5a4428 req-b441d4e6-2119-4704-b903-0975e322b19f service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:51.877645 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-50b84432-00a8-4663-8df3-b0143e5a4428 req-b441d4e6-2119-4704-b903-0975e322b19f service nova] Creating event network-changed:6a8c41a9-99d6-47db-ad6c-e0f59c1598e8 for instance 39d1b0a9-6838-4b40-b786-ea685404db46 on n-h1-862769-1 Oct 27 03:47:51.903380 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-50b84432-00a8-4663-8df3-b0143e5a4428 req-b441d4e6-2119-4704-b903-0975e322b19f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099887 Oct 27 03:47:51.931949 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3100/5898] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:47:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:47:52.205723 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-8e17ece7-918f-4d20-beb2-138e71abfc7d tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:47:52.206184 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-8e17ece7-918f-4d20-beb2-138e71abfc7d tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:47:52.206725 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-8e17ece7-918f-4d20-beb2-138e71abfc7d tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:47:52.207153 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-8e17ece7-918f-4d20-beb2-138e71abfc7d tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:47:52.207679 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-8e17ece7-918f-4d20-beb2-138e71abfc7d tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:47:52.227829 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8e17ece7-918f-4d20-beb2-138e71abfc7d tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:52.228589 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8e17ece7-918f-4d20-beb2-138e71abfc7d tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:52.229801 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8e17ece7-918f-4d20-beb2-138e71abfc7d tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:52.239618 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8e17ece7-918f-4d20-beb2-138e71abfc7d tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:52.239618 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8e17ece7-918f-4d20-beb2-138e71abfc7d tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:52.239618 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8e17ece7-918f-4d20-beb2-138e71abfc7d tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:52.318587 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-8e17ece7-918f-4d20-beb2-138e71abfc7d tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Getting quotas for project 22265a03de2d478988f7a5ae2561e719. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:47:52.340261 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-8e17ece7-918f-4d20-beb2-138e71abfc7d tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Getting quotas for user 18d3c87c204946ffad3feb05bc6dfd53 and project 22265a03de2d478988f7a5ae2561e719. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:47:52.391862 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8e17ece7-918f-4d20-beb2-138e71abfc7d tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:47:52.396186 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8e17ece7-918f-4d20-beb2-138e71abfc7d tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] [instance: fb92bc23-c330-4ca9-bc60-ff90de604199] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:47:52.500016 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d4e22b9f-3f9f-45cf-b6cc-1e5c9c8f50a2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:52.500661 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d4e22b9f-3f9f-45cf-b6cc-1e5c9c8f50a2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 39d1b0a9-6838-4b40-b786-ea685404db46] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:52.504757 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=4 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:52.512966 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d4e22b9f-3f9f-45cf-b6cc-1e5c9c8f50a2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:52.514190 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d4e22b9f-3f9f-45cf-b6cc-1e5c9c8f50a2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:52.514787 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d4e22b9f-3f9f-45cf-b6cc-1e5c9c8f50a2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:52.515670 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d4e22b9f-3f9f-45cf-b6cc-1e5c9c8f50a2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:52.516272 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d4e22b9f-3f9f-45cf-b6cc-1e5c9c8f50a2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:52.516868 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d4e22b9f-3f9f-45cf-b6cc-1e5c9c8f50a2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:52.610884 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8e17ece7-918f-4d20-beb2-138e71abfc7d tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 2.294751 Oct 27 03:47:52.612449 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2799/5899] 10.222.0.20 () {62 vars in 1188 bytes} [Thu Oct 27 03:47:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 2302 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 27 03:47:52.624769 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b2609576-ed83-45ac-80b6-99368285fab9 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:52.625661 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b2609576-ed83-45ac-80b6-99368285fab9 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] [instance: fb92bc23-c330-4ca9-bc60-ff90de604199] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:52.873796 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d4e22b9f-3f9f-45cf-b6cc-1e5c9c8f50a2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:52.883847 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d4e22b9f-3f9f-45cf-b6cc-1e5c9c8f50a2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/39d1b0a9-6838-4b40-b786-ea685404db46" status: 200 len: 1309 microversion: 2.1 time: 0.389387 Oct 27 03:47:52.888961 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3101/5900] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:47:52 2022] GET /compute/v2.1/servers/39d1b0a9-6838-4b40-b786-ea685404db46 => generated 1309 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:47:52.981295 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b2609576-ed83-45ac-80b6-99368285fab9 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d3c87c204946ffad3feb05bc6dfd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22265a03de2d478988f7a5ae2561e719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:52.998575 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b2609576-ed83-45ac-80b6-99368285fab9 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d3c87c204946ffad3feb05bc6dfd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22265a03de2d478988f7a5ae2561e719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:53.018679 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b2609576-ed83-45ac-80b6-99368285fab9 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d3c87c204946ffad3feb05bc6dfd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22265a03de2d478988f7a5ae2561e719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:53.027813 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b2609576-ed83-45ac-80b6-99368285fab9 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] 10.222.0.20 "GET /compute/v2.1/servers/fb92bc23-c330-4ca9-bc60-ff90de604199" status: 200 len: 1261 microversion: 2.26 time: 0.406911 Oct 27 03:47:53.027813 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2800/5901] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:47:52 2022] GET /compute/v2.1/servers/fb92bc23-c330-4ca9-bc60-ff90de604199 => generated 1261 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:47:53.911394 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2c96749b-0900-4802-a1e0-f054811991af tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:53.912007 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2c96749b-0900-4802-a1e0-f054811991af tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 39d1b0a9-6838-4b40-b786-ea685404db46] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:53.925347 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2c96749b-0900-4802-a1e0-f054811991af tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:53.926651 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2c96749b-0900-4802-a1e0-f054811991af tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:53.927295 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2c96749b-0900-4802-a1e0-f054811991af tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:53.928416 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2c96749b-0900-4802-a1e0-f054811991af tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:53.929071 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2c96749b-0900-4802-a1e0-f054811991af tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:53.930273 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2c96749b-0900-4802-a1e0-f054811991af tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:54.066340 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ebde9f7e-c571-49c0-b4ea-3fd5c2887ebb tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:54.066979 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ebde9f7e-c571-49c0-b4ea-3fd5c2887ebb tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] [instance: fb92bc23-c330-4ca9-bc60-ff90de604199] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:54.185109 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ebde9f7e-c571-49c0-b4ea-3fd5c2887ebb tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d3c87c204946ffad3feb05bc6dfd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22265a03de2d478988f7a5ae2561e719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:54.193459 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ebde9f7e-c571-49c0-b4ea-3fd5c2887ebb tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d3c87c204946ffad3feb05bc6dfd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22265a03de2d478988f7a5ae2561e719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:54.199865 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ebde9f7e-c571-49c0-b4ea-3fd5c2887ebb tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d3c87c204946ffad3feb05bc6dfd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22265a03de2d478988f7a5ae2561e719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:54.201659 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ebde9f7e-c571-49c0-b4ea-3fd5c2887ebb tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] 10.222.0.20 "GET /compute/v2.1/servers/fb92bc23-c330-4ca9-bc60-ff90de604199" status: 200 len: 1261 microversion: 2.26 time: 0.151471 Oct 27 03:47:54.204739 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2c96749b-0900-4802-a1e0-f054811991af tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:54.205081 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2801/5902] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:47:54 2022] GET /compute/v2.1/servers/fb92bc23-c330-4ca9-bc60-ff90de604199 => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:47:54.214275 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2c96749b-0900-4802-a1e0-f054811991af tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/39d1b0a9-6838-4b40-b786-ea685404db46" status: 200 len: 1309 microversion: 2.1 time: 0.307951 Oct 27 03:47:54.217795 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3102/5903] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:47:53 2022] GET /compute/v2.1/servers/39d1b0a9-6838-4b40-b786-ea685404db46 => generated 1309 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:47:55.243934 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-04618838-4689-46ab-960f-1aa3ceea852c tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:55.244563 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-04618838-4689-46ab-960f-1aa3ceea852c tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] [instance: fb92bc23-c330-4ca9-bc60-ff90de604199] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:55.250284 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=12 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:47:55.259984 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a5787e3d-f82e-4c3d-8791-6e4a268ca033 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:55.280629 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a5787e3d-f82e-4c3d-8791-6e4a268ca033 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 39d1b0a9-6838-4b40-b786-ea685404db46] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:55.280708 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-04618838-4689-46ab-960f-1aa3ceea852c tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:55.280708 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-04618838-4689-46ab-960f-1aa3ceea852c tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:55.280708 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-04618838-4689-46ab-960f-1aa3ceea852c tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:55.280708 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-04618838-4689-46ab-960f-1aa3ceea852c tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:55.280924 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a5787e3d-f82e-4c3d-8791-6e4a268ca033 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:55.280995 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-04618838-4689-46ab-960f-1aa3ceea852c tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:55.280995 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-04618838-4689-46ab-960f-1aa3ceea852c tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:55.281108 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a5787e3d-f82e-4c3d-8791-6e4a268ca033 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:55.281108 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a5787e3d-f82e-4c3d-8791-6e4a268ca033 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:55.286222 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a5787e3d-f82e-4c3d-8791-6e4a268ca033 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:55.287044 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a5787e3d-f82e-4c3d-8791-6e4a268ca033 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:55.287775 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a5787e3d-f82e-4c3d-8791-6e4a268ca033 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:55.426824 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-04618838-4689-46ab-960f-1aa3ceea852c tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d3c87c204946ffad3feb05bc6dfd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22265a03de2d478988f7a5ae2561e719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:55.462409 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-04618838-4689-46ab-960f-1aa3ceea852c tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d3c87c204946ffad3feb05bc6dfd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22265a03de2d478988f7a5ae2561e719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:55.468160 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-04618838-4689-46ab-960f-1aa3ceea852c tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d3c87c204946ffad3feb05bc6dfd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22265a03de2d478988f7a5ae2561e719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:55.471789 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-04618838-4689-46ab-960f-1aa3ceea852c tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] 10.222.0.20 "GET /compute/v2.1/servers/fb92bc23-c330-4ca9-bc60-ff90de604199" status: 200 len: 1313 microversion: 2.26 time: 0.230787 Oct 27 03:47:55.474505 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2802/5904] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:47:55 2022] GET /compute/v2.1/servers/fb92bc23-c330-4ca9-bc60-ff90de604199 => generated 1313 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:47:55.540322 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a5787e3d-f82e-4c3d-8791-6e4a268ca033 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:55.549984 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a5787e3d-f82e-4c3d-8791-6e4a268ca033 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/39d1b0a9-6838-4b40-b786-ea685404db46" status: 200 len: 1309 microversion: 2.1 time: 0.300258 Oct 27 03:47:55.550637 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3103/5905] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:47:55 2022] GET /compute/v2.1/servers/39d1b0a9-6838-4b40-b786-ea685404db46 => generated 1309 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:47:56.509788 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5c6a93f1-0727-4474-94d9-6a250cec2b3b tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:56.510662 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5c6a93f1-0727-4474-94d9-6a250cec2b3b tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] [instance: fb92bc23-c330-4ca9-bc60-ff90de604199] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:56.527750 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5c6a93f1-0727-4474-94d9-6a250cec2b3b tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:56.528529 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5c6a93f1-0727-4474-94d9-6a250cec2b3b tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:56.535324 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5c6a93f1-0727-4474-94d9-6a250cec2b3b tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:56.536461 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5c6a93f1-0727-4474-94d9-6a250cec2b3b tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:56.537144 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5c6a93f1-0727-4474-94d9-6a250cec2b3b tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:56.537790 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5c6a93f1-0727-4474-94d9-6a250cec2b3b tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:56.576807 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f539916f-a56e-4ac0-bc76-b440cabb8c35 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:56.578188 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f539916f-a56e-4ac0-bc76-b440cabb8c35 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 39d1b0a9-6838-4b40-b786-ea685404db46] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:56.592917 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f539916f-a56e-4ac0-bc76-b440cabb8c35 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:56.593784 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f539916f-a56e-4ac0-bc76-b440cabb8c35 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:56.594496 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f539916f-a56e-4ac0-bc76-b440cabb8c35 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:56.595510 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f539916f-a56e-4ac0-bc76-b440cabb8c35 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:56.596239 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f539916f-a56e-4ac0-bc76-b440cabb8c35 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:56.596863 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f539916f-a56e-4ac0-bc76-b440cabb8c35 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:56.734265 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5c6a93f1-0727-4474-94d9-6a250cec2b3b tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d3c87c204946ffad3feb05bc6dfd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22265a03de2d478988f7a5ae2561e719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:56.756504 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5c6a93f1-0727-4474-94d9-6a250cec2b3b tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d3c87c204946ffad3feb05bc6dfd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22265a03de2d478988f7a5ae2561e719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:56.761179 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5c6a93f1-0727-4474-94d9-6a250cec2b3b tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d3c87c204946ffad3feb05bc6dfd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22265a03de2d478988f7a5ae2561e719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:56.767661 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5c6a93f1-0727-4474-94d9-6a250cec2b3b tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] 10.222.0.20 "GET /compute/v2.1/servers/fb92bc23-c330-4ca9-bc60-ff90de604199" status: 200 len: 1331 microversion: 2.26 time: 0.262851 Oct 27 03:47:56.768924 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2803/5906] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:47:56 2022] GET /compute/v2.1/servers/fb92bc23-c330-4ca9-bc60-ff90de604199 => generated 1331 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:47:56.933073 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f539916f-a56e-4ac0-bc76-b440cabb8c35 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:56.945581 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f539916f-a56e-4ac0-bc76-b440cabb8c35 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/39d1b0a9-6838-4b40-b786-ea685404db46" status: 200 len: 1309 microversion: 2.1 time: 0.373396 Oct 27 03:47:56.946451 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3104/5907] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:47:56 2022] GET /compute/v2.1/servers/39d1b0a9-6838-4b40-b786-ea685404db46 => generated 1309 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:47:57.282963 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-20bd6fb5-6469-46f0-9fef-12d37b98ea22 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-2063442649", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": "none"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:47:57.385195 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-20bd6fb5-6469-46f0-9fef-12d37b98ea22 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:47:57.385909 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-20bd6fb5-6469-46f0-9fef-12d37b98ea22 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:47:57.386745 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-20bd6fb5-6469-46f0-9fef-12d37b98ea22 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:47:57.389621 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-20bd6fb5-6469-46f0-9fef-12d37b98ea22 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:47:57.390823 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-20bd6fb5-6469-46f0-9fef-12d37b98ea22 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:47:57.433085 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-20bd6fb5-6469-46f0-9fef-12d37b98ea22 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:57.439279 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-20bd6fb5-6469-46f0-9fef-12d37b98ea22 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:57.439279 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-20bd6fb5-6469-46f0-9fef-12d37b98ea22 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:57.439279 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-20bd6fb5-6469-46f0-9fef-12d37b98ea22 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:57.439279 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-20bd6fb5-6469-46f0-9fef-12d37b98ea22 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:57.444365 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-20bd6fb5-6469-46f0-9fef-12d37b98ea22 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:57.473509 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-20bd6fb5-6469-46f0-9fef-12d37b98ea22 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Getting quotas for project 115b85f8af8e491f85a80eeb979100a0. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:47:57.479792 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-20bd6fb5-6469-46f0-9fef-12d37b98ea22 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Getting quotas for user 3771098cc42a447eab2524a0682133e8 and project 115b85f8af8e491f85a80eeb979100a0. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:47:57.493826 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-20bd6fb5-6469-46f0-9fef-12d37b98ea22 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:47:57.496074 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-20bd6fb5-6469-46f0-9fef-12d37b98ea22 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] [instance: aaea6df3-ebe9-4a81-a8ec-e6bf9339283a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:47:57.656725 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-20bd6fb5-6469-46f0-9fef-12d37b98ea22 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.753641 Oct 27 03:47:57.663817 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2804/5908] 10.222.0.20 () {62 vars in 1188 bytes} [Thu Oct 27 03:47:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 762 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 27 03:47:57.674069 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5d7e8afd-796e-40fe-a995-a6a7412c9eab tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:57.674706 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5d7e8afd-796e-40fe-a995-a6a7412c9eab tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] [instance: aaea6df3-ebe9-4a81-a8ec-e6bf9339283a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:57.806779 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-098e0880-5e02-4722-b043-e2860ff70b9e tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:57.807649 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-098e0880-5e02-4722-b043-e2860ff70b9e tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] [instance: fb92bc23-c330-4ca9-bc60-ff90de604199] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:57.818437 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-098e0880-5e02-4722-b043-e2860ff70b9e tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:57.819198 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-098e0880-5e02-4722-b043-e2860ff70b9e tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:57.820014 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-098e0880-5e02-4722-b043-e2860ff70b9e tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:57.821561 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-098e0880-5e02-4722-b043-e2860ff70b9e tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:57.823059 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-098e0880-5e02-4722-b043-e2860ff70b9e tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:57.827071 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-098e0880-5e02-4722-b043-e2860ff70b9e tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:57.874889 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5d7e8afd-796e-40fe-a995-a6a7412c9eab tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:57.894787 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5d7e8afd-796e-40fe-a995-a6a7412c9eab tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:57.896545 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5d7e8afd-796e-40fe-a995-a6a7412c9eab tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:57.897436 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5d7e8afd-796e-40fe-a995-a6a7412c9eab tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] 10.222.0.20 "GET /compute/v2.1/servers/aaea6df3-ebe9-4a81-a8ec-e6bf9339283a" status: 200 len: 1278 microversion: 2.54 time: 0.231575 Oct 27 03:47:57.909875 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3105/5909] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:47:57 2022] GET /compute/v2.1/servers/aaea6df3-ebe9-4a81-a8ec-e6bf9339283a => generated 1278 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:47:57.968770 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-cc40a323-b873-4cba-8c39-d7540a10c647 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:57.969606 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-cc40a323-b873-4cba-8c39-d7540a10c647 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 39d1b0a9-6838-4b40-b786-ea685404db46] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:57.982958 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cc40a323-b873-4cba-8c39-d7540a10c647 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:57.983512 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cc40a323-b873-4cba-8c39-d7540a10c647 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:57.983890 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cc40a323-b873-4cba-8c39-d7540a10c647 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:57.998654 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cc40a323-b873-4cba-8c39-d7540a10c647 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:57.999150 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cc40a323-b873-4cba-8c39-d7540a10c647 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:58.001027 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cc40a323-b873-4cba-8c39-d7540a10c647 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:58.283016 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-098e0880-5e02-4722-b043-e2860ff70b9e tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d3c87c204946ffad3feb05bc6dfd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22265a03de2d478988f7a5ae2561e719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:58.291239 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-098e0880-5e02-4722-b043-e2860ff70b9e tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d3c87c204946ffad3feb05bc6dfd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22265a03de2d478988f7a5ae2561e719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:58.293271 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-098e0880-5e02-4722-b043-e2860ff70b9e tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d3c87c204946ffad3feb05bc6dfd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22265a03de2d478988f7a5ae2561e719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:58.298985 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-098e0880-5e02-4722-b043-e2860ff70b9e tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] 10.222.0.20 "GET /compute/v2.1/servers/fb92bc23-c330-4ca9-bc60-ff90de604199" status: 200 len: 1361 microversion: 2.26 time: 0.501605 Oct 27 03:47:58.299983 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2805/5910] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:47:57 2022] GET /compute/v2.1/servers/fb92bc23-c330-4ca9-bc60-ff90de604199 => generated 1361 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:47:58.434113 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-cc40a323-b873-4cba-8c39-d7540a10c647 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:58.445053 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-cc40a323-b873-4cba-8c39-d7540a10c647 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/39d1b0a9-6838-4b40-b786-ea685404db46" status: 200 len: 1309 microversion: 2.1 time: 0.480122 Oct 27 03:47:58.446101 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3106/5911] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:47:57 2022] GET /compute/v2.1/servers/39d1b0a9-6838-4b40-b786-ea685404db46 => generated 1309 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:47:58.940085 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-534e32fa-813a-49fb-8336-4b4173ecd8c6 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:58.940834 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-534e32fa-813a-49fb-8336-4b4173ecd8c6 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] [instance: aaea6df3-ebe9-4a81-a8ec-e6bf9339283a] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:59.061087 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-534e32fa-813a-49fb-8336-4b4173ecd8c6 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:59.074213 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-534e32fa-813a-49fb-8336-4b4173ecd8c6 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:59.076749 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-534e32fa-813a-49fb-8336-4b4173ecd8c6 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:59.083223 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-534e32fa-813a-49fb-8336-4b4173ecd8c6 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] 10.222.0.20 "GET /compute/v2.1/servers/aaea6df3-ebe9-4a81-a8ec-e6bf9339283a" status: 200 len: 1278 microversion: 2.54 time: 0.142640 Oct 27 03:47:59.084475 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2806/5912] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:47:58 2022] GET /compute/v2.1/servers/aaea6df3-ebe9-4a81-a8ec-e6bf9339283a => generated 1278 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:47:59.218410 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-5f817bb3-ee4d-4ff2-9ed2-5a34a9903f9a req-56583da4-bab4-4784-b778-7958e68a0435 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39d1b0a9-6838-4b40-b786-ea685404db46", "name": "network-vif-plugged", "status": "completed", "tag": "6a8c41a9-99d6-47db-ad6c-e0f59c1598e8"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:47:59.245455 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-5f817bb3-ee4d-4ff2-9ed2-5a34a9903f9a req-56583da4-bab4-4784-b778-7958e68a0435 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:59.246189 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-5f817bb3-ee4d-4ff2-9ed2-5a34a9903f9a req-56583da4-bab4-4784-b778-7958e68a0435 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:59.246940 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-5f817bb3-ee4d-4ff2-9ed2-5a34a9903f9a req-56583da4-bab4-4784-b778-7958e68a0435 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:59.266444 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-5f817bb3-ee4d-4ff2-9ed2-5a34a9903f9a req-56583da4-bab4-4784-b778-7958e68a0435 service nova] Creating event network-vif-plugged:6a8c41a9-99d6-47db-ad6c-e0f59c1598e8 for instance 39d1b0a9-6838-4b40-b786-ea685404db46 on n-h1-862769-1 Oct 27 03:47:59.270445 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-97d44773-4ac8-4f9b-a1dd-f77034d89312 req-305a51a3-e959-4f57-b0d1-ee38e72700b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb92bc23-c330-4ca9-bc60-ff90de604199", "tag": "9171b3d1-838c-49e8-9ac0-7ce8d2718e52"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:47:59.275333 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-5f817bb3-ee4d-4ff2-9ed2-5a34a9903f9a req-56583da4-bab4-4784-b778-7958e68a0435 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063794 Oct 27 03:47:59.275945 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3107/5913] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:47:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:47:59.293645 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-97d44773-4ac8-4f9b-a1dd-f77034d89312 req-305a51a3-e959-4f57-b0d1-ee38e72700b4 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:59.293645 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-97d44773-4ac8-4f9b-a1dd-f77034d89312 req-305a51a3-e959-4f57-b0d1-ee38e72700b4 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:59.293645 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-97d44773-4ac8-4f9b-a1dd-f77034d89312 req-305a51a3-e959-4f57-b0d1-ee38e72700b4 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:59.303851 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-97d44773-4ac8-4f9b-a1dd-f77034d89312 req-305a51a3-e959-4f57-b0d1-ee38e72700b4 service nova] Creating event network-changed:9171b3d1-838c-49e8-9ac0-7ce8d2718e52 for instance fb92bc23-c330-4ca9-bc60-ff90de604199 on n-h2-862769-1 Oct 27 03:47:59.312038 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-97d44773-4ac8-4f9b-a1dd-f77034d89312 req-305a51a3-e959-4f57-b0d1-ee38e72700b4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045087 Oct 27 03:47:59.313966 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2807/5914] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:47:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:47:59.328133 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b5151bf6-0f37-4519-afa3-02dad4f5658a tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:59.328968 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b5151bf6-0f37-4519-afa3-02dad4f5658a tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] [instance: fb92bc23-c330-4ca9-bc60-ff90de604199] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:59.337369 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b5151bf6-0f37-4519-afa3-02dad4f5658a tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:59.338168 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b5151bf6-0f37-4519-afa3-02dad4f5658a tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:59.338850 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b5151bf6-0f37-4519-afa3-02dad4f5658a tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:59.339801 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b5151bf6-0f37-4519-afa3-02dad4f5658a tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:59.340490 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b5151bf6-0f37-4519-afa3-02dad4f5658a tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:59.341919 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b5151bf6-0f37-4519-afa3-02dad4f5658a tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:59.480616 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5de2dda8-fda0-4082-8dde-313f497c127f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:47:59.481398 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5de2dda8-fda0-4082-8dde-313f497c127f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 39d1b0a9-6838-4b40-b786-ea685404db46] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:47:59.534641 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5de2dda8-fda0-4082-8dde-313f497c127f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:59.537579 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5de2dda8-fda0-4082-8dde-313f497c127f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:59.538321 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5de2dda8-fda0-4082-8dde-313f497c127f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:59.539555 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5de2dda8-fda0-4082-8dde-313f497c127f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:47:59.540111 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5de2dda8-fda0-4082-8dde-313f497c127f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:47:59.540757 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5de2dda8-fda0-4082-8dde-313f497c127f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:47:59.832428 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b5151bf6-0f37-4519-afa3-02dad4f5658a tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d3c87c204946ffad3feb05bc6dfd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22265a03de2d478988f7a5ae2561e719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:59.861018 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b5151bf6-0f37-4519-afa3-02dad4f5658a tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d3c87c204946ffad3feb05bc6dfd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22265a03de2d478988f7a5ae2561e719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:59.862920 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b5151bf6-0f37-4519-afa3-02dad4f5658a tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d3c87c204946ffad3feb05bc6dfd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22265a03de2d478988f7a5ae2561e719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:59.864281 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b5151bf6-0f37-4519-afa3-02dad4f5658a tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] 10.222.0.20 "GET /compute/v2.1/servers/fb92bc23-c330-4ca9-bc60-ff90de604199" status: 200 len: 1361 microversion: 2.26 time: 0.541941 Oct 27 03:47:59.865626 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3108/5915] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:47:59 2022] GET /compute/v2.1/servers/fb92bc23-c330-4ca9-bc60-ff90de604199 => generated 1361 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:47:59.917585 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5de2dda8-fda0-4082-8dde-313f497c127f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:47:59.927030 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5de2dda8-fda0-4082-8dde-313f497c127f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/39d1b0a9-6838-4b40-b786-ea685404db46" status: 200 len: 1309 microversion: 2.1 time: 0.453223 Oct 27 03:47:59.938681 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2808/5916] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:47:59 2022] GET /compute/v2.1/servers/39d1b0a9-6838-4b40-b786-ea685404db46 => generated 1309 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:48:00.111069 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-27ed1502-25bb-4d5f-ba15-3a44125a015c tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:00.111682 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-27ed1502-25bb-4d5f-ba15-3a44125a015c tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] [instance: aaea6df3-ebe9-4a81-a8ec-e6bf9339283a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:00.118344 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-27ed1502-25bb-4d5f-ba15-3a44125a015c tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:00.118998 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-27ed1502-25bb-4d5f-ba15-3a44125a015c tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:00.119737 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-27ed1502-25bb-4d5f-ba15-3a44125a015c tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:00.120526 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-27ed1502-25bb-4d5f-ba15-3a44125a015c tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:00.121160 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-27ed1502-25bb-4d5f-ba15-3a44125a015c tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:00.121767 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-27ed1502-25bb-4d5f-ba15-3a44125a015c tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:00.227169 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-27ed1502-25bb-4d5f-ba15-3a44125a015c tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:00.250636 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-27ed1502-25bb-4d5f-ba15-3a44125a015c tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:00.254799 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-27ed1502-25bb-4d5f-ba15-3a44125a015c tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:00.263110 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-27ed1502-25bb-4d5f-ba15-3a44125a015c tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] 10.222.0.20 "GET /compute/v2.1/servers/aaea6df3-ebe9-4a81-a8ec-e6bf9339283a" status: 200 len: 1282 microversion: 2.54 time: 0.150076 Oct 27 03:48:00.263110 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3109/5917] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:48:00 2022] GET /compute/v2.1/servers/aaea6df3-ebe9-4a81-a8ec-e6bf9339283a => generated 1282 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:48:00.897580 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4ac6ea42-57cb-4376-af79-33acb6d239db tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:00.898488 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4ac6ea42-57cb-4376-af79-33acb6d239db tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] [instance: fb92bc23-c330-4ca9-bc60-ff90de604199] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:00.912341 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4ac6ea42-57cb-4376-af79-33acb6d239db tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:00.912845 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4ac6ea42-57cb-4376-af79-33acb6d239db tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:00.913428 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4ac6ea42-57cb-4376-af79-33acb6d239db tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:00.914213 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4ac6ea42-57cb-4376-af79-33acb6d239db tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:00.914682 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4ac6ea42-57cb-4376-af79-33acb6d239db tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:00.915115 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4ac6ea42-57cb-4376-af79-33acb6d239db tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:00.951865 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-11694981-e2c2-4fa1-9195-75d253c4a3f0 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:00.952708 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-11694981-e2c2-4fa1-9195-75d253c4a3f0 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 39d1b0a9-6838-4b40-b786-ea685404db46] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:00.959205 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-11694981-e2c2-4fa1-9195-75d253c4a3f0 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:00.959885 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-11694981-e2c2-4fa1-9195-75d253c4a3f0 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:00.960400 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-11694981-e2c2-4fa1-9195-75d253c4a3f0 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:00.961452 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-11694981-e2c2-4fa1-9195-75d253c4a3f0 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:00.962134 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-11694981-e2c2-4fa1-9195-75d253c4a3f0 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:00.962749 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-11694981-e2c2-4fa1-9195-75d253c4a3f0 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:01.123233 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4ac6ea42-57cb-4376-af79-33acb6d239db tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d3c87c204946ffad3feb05bc6dfd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22265a03de2d478988f7a5ae2561e719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:01.132380 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4ac6ea42-57cb-4376-af79-33acb6d239db tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d3c87c204946ffad3feb05bc6dfd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22265a03de2d478988f7a5ae2561e719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:01.134320 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4ac6ea42-57cb-4376-af79-33acb6d239db tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d3c87c204946ffad3feb05bc6dfd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22265a03de2d478988f7a5ae2561e719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:01.135662 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4ac6ea42-57cb-4376-af79-33acb6d239db tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] 10.222.0.20 "GET /compute/v2.1/servers/fb92bc23-c330-4ca9-bc60-ff90de604199" status: 200 len: 1361 microversion: 2.26 time: 0.242519 Oct 27 03:48:01.136842 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2809/5918] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:48:00 2022] GET /compute/v2.1/servers/fb92bc23-c330-4ca9-bc60-ff90de604199 => generated 1361 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:48:01.191376 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-11694981-e2c2-4fa1-9195-75d253c4a3f0 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:01.204873 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-11694981-e2c2-4fa1-9195-75d253c4a3f0 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/39d1b0a9-6838-4b40-b786-ea685404db46" status: 200 len: 1309 microversion: 2.1 time: 0.258147 Oct 27 03:48:01.206518 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3110/5919] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:48:00 2022] GET /compute/v2.1/servers/39d1b0a9-6838-4b40-b786-ea685404db46 => generated 1309 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:48:01.285740 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-33a927e3-3576-4610-83fb-6cc5b4de36bd tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:01.286385 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-33a927e3-3576-4610-83fb-6cc5b4de36bd tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] [instance: aaea6df3-ebe9-4a81-a8ec-e6bf9339283a] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:01.292466 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-33a927e3-3576-4610-83fb-6cc5b4de36bd tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:01.292952 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-33a927e3-3576-4610-83fb-6cc5b4de36bd tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:01.293391 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-33a927e3-3576-4610-83fb-6cc5b4de36bd tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:01.294110 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-33a927e3-3576-4610-83fb-6cc5b4de36bd tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:01.294632 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-33a927e3-3576-4610-83fb-6cc5b4de36bd tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:01.295330 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-33a927e3-3576-4610-83fb-6cc5b4de36bd tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:01.399108 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-33a927e3-3576-4610-83fb-6cc5b4de36bd tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:01.409353 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-33a927e3-3576-4610-83fb-6cc5b4de36bd tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:01.411212 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-33a927e3-3576-4610-83fb-6cc5b4de36bd tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:01.418280 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-33a927e3-3576-4610-83fb-6cc5b4de36bd tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] 10.222.0.20 "GET /compute/v2.1/servers/aaea6df3-ebe9-4a81-a8ec-e6bf9339283a" status: 200 len: 1330 microversion: 2.54 time: 0.136581 Oct 27 03:48:01.425154 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2810/5920] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:48:01 2022] GET /compute/v2.1/servers/aaea6df3-ebe9-4a81-a8ec-e6bf9339283a => generated 1330 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:48:02.165174 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-920be1e6-bd45-497a-8e0b-856069572beb tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:02.165824 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-920be1e6-bd45-497a-8e0b-856069572beb tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] [instance: fb92bc23-c330-4ca9-bc60-ff90de604199] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:02.173739 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-920be1e6-bd45-497a-8e0b-856069572beb tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:02.174443 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-920be1e6-bd45-497a-8e0b-856069572beb tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:02.175058 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-920be1e6-bd45-497a-8e0b-856069572beb tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:02.175923 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-920be1e6-bd45-497a-8e0b-856069572beb tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:02.176400 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-920be1e6-bd45-497a-8e0b-856069572beb tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:02.176836 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-920be1e6-bd45-497a-8e0b-856069572beb tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:02.231248 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b9928405-7344-4821-a8bf-82b5d6bee86a tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:02.233142 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b9928405-7344-4821-a8bf-82b5d6bee86a tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 39d1b0a9-6838-4b40-b786-ea685404db46] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:02.244090 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b9928405-7344-4821-a8bf-82b5d6bee86a tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:02.244928 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b9928405-7344-4821-a8bf-82b5d6bee86a tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:02.245568 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b9928405-7344-4821-a8bf-82b5d6bee86a tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:02.246516 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b9928405-7344-4821-a8bf-82b5d6bee86a tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:02.247190 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b9928405-7344-4821-a8bf-82b5d6bee86a tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:02.248334 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b9928405-7344-4821-a8bf-82b5d6bee86a tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:02.378224 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-920be1e6-bd45-497a-8e0b-856069572beb tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d3c87c204946ffad3feb05bc6dfd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22265a03de2d478988f7a5ae2561e719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:02.390822 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-920be1e6-bd45-497a-8e0b-856069572beb tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d3c87c204946ffad3feb05bc6dfd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22265a03de2d478988f7a5ae2561e719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:02.392893 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-920be1e6-bd45-497a-8e0b-856069572beb tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d3c87c204946ffad3feb05bc6dfd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22265a03de2d478988f7a5ae2561e719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:02.394389 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-920be1e6-bd45-497a-8e0b-856069572beb tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] 10.222.0.20 "GET /compute/v2.1/servers/fb92bc23-c330-4ca9-bc60-ff90de604199" status: 200 len: 1361 microversion: 2.26 time: 0.234025 Oct 27 03:48:02.398300 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3111/5921] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:48:02 2022] GET /compute/v2.1/servers/fb92bc23-c330-4ca9-bc60-ff90de604199 => generated 1361 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:48:02.449608 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-464b3dab-2049-4ea4-a714-e673f9b17350 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:02.455476 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-464b3dab-2049-4ea4-a714-e673f9b17350 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] [instance: aaea6df3-ebe9-4a81-a8ec-e6bf9339283a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:02.463255 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-464b3dab-2049-4ea4-a714-e673f9b17350 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:02.463875 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-464b3dab-2049-4ea4-a714-e673f9b17350 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:02.464803 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-464b3dab-2049-4ea4-a714-e673f9b17350 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:02.465651 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-464b3dab-2049-4ea4-a714-e673f9b17350 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:02.466928 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-464b3dab-2049-4ea4-a714-e673f9b17350 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:02.467456 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-464b3dab-2049-4ea4-a714-e673f9b17350 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:02.587582 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-464b3dab-2049-4ea4-a714-e673f9b17350 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:02.600674 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-464b3dab-2049-4ea4-a714-e673f9b17350 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:02.602692 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-464b3dab-2049-4ea4-a714-e673f9b17350 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:02.604312 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-464b3dab-2049-4ea4-a714-e673f9b17350 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] 10.222.0.20 "GET /compute/v2.1/servers/aaea6df3-ebe9-4a81-a8ec-e6bf9339283a" status: 200 len: 1348 microversion: 2.54 time: 0.159508 Oct 27 03:48:02.623343 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3112/5922] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:48:02 2022] GET /compute/v2.1/servers/aaea6df3-ebe9-4a81-a8ec-e6bf9339283a => generated 1348 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:48:02.776205 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b9928405-7344-4821-a8bf-82b5d6bee86a tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:02.787835 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b9928405-7344-4821-a8bf-82b5d6bee86a tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/39d1b0a9-6838-4b40-b786-ea685404db46" status: 200 len: 1490 microversion: 2.1 time: 0.560351 Oct 27 03:48:02.800496 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2811/5923] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:48:02 2022] GET /compute/v2.1/servers/39d1b0a9-6838-4b40-b786-ea685404db46 => generated 1490 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:48:02.817540 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-85333e4d-7c1d-4fbb-b8a8-84382a7ee279 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:48:02.820308 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-85333e4d-7c1d-4fbb-b8a8-84382a7ee279 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 39d1b0a9-6838-4b40-b786-ea685404db46] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:02.827057 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-85333e4d-7c1d-4fbb-b8a8-84382a7ee279 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:02.827551 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-85333e4d-7c1d-4fbb-b8a8-84382a7ee279 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:02.828165 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-85333e4d-7c1d-4fbb-b8a8-84382a7ee279 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:02.829020 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-85333e4d-7c1d-4fbb-b8a8-84382a7ee279 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:02.829659 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-85333e4d-7c1d-4fbb-b8a8-84382a7ee279 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:02.830445 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-85333e4d-7c1d-4fbb-b8a8-84382a7ee279 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:02.999306 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-85333e4d-7c1d-4fbb-b8a8-84382a7ee279 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "PUT /compute/v2.1/servers/39d1b0a9-6838-4b40-b786-ea685404db46" status: 200 len: 1085 microversion: 2.1 time: 0.186585 Oct 27 03:48:03.003219 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3113/5924] 10.222.0.20 () {60 vars in 1256 bytes} [Thu Oct 27 03:48:02 2022] PUT /compute/v2.1/servers/39d1b0a9-6838-4b40-b786-ea685404db46 => generated 1085 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:48:03.020061 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-95a9576a-4b60-4290-80c7-1a78863dea0c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:03.023089 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-95a9576a-4b60-4290-80c7-1a78863dea0c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 39d1b0a9-6838-4b40-b786-ea685404db46] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:03.030523 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-95a9576a-4b60-4290-80c7-1a78863dea0c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:03.031028 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-95a9576a-4b60-4290-80c7-1a78863dea0c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:03.031479 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-95a9576a-4b60-4290-80c7-1a78863dea0c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:03.032194 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-95a9576a-4b60-4290-80c7-1a78863dea0c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:03.032820 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-95a9576a-4b60-4290-80c7-1a78863dea0c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:03.033253 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-95a9576a-4b60-4290-80c7-1a78863dea0c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:03.212447 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-95a9576a-4b60-4290-80c7-1a78863dea0c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:03.221406 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-95a9576a-4b60-4290-80c7-1a78863dea0c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/39d1b0a9-6838-4b40-b786-ea685404db46" status: 200 len: 1511 microversion: 2.1 time: 0.205686 Oct 27 03:48:03.221994 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2812/5925] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:48:03 2022] GET /compute/v2.1/servers/39d1b0a9-6838-4b40-b786-ea685404db46 => generated 1511 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:48:03.251440 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-78dbb0c1-eaf5-4e6c-84d1-15e17147cdfa tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:03.252095 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-78dbb0c1-eaf5-4e6c-84d1-15e17147cdfa tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 39d1b0a9-6838-4b40-b786-ea685404db46] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:03.259674 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-78dbb0c1-eaf5-4e6c-84d1-15e17147cdfa tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:03.260465 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-78dbb0c1-eaf5-4e6c-84d1-15e17147cdfa tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:03.260916 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-78dbb0c1-eaf5-4e6c-84d1-15e17147cdfa tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:03.261626 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-78dbb0c1-eaf5-4e6c-84d1-15e17147cdfa tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:03.262484 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-78dbb0c1-eaf5-4e6c-84d1-15e17147cdfa tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:03.262954 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-78dbb0c1-eaf5-4e6c-84d1-15e17147cdfa tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:03.430747 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4b342d7d-a1e6-4723-beca-3830252e54b0 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:03.436975 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4b342d7d-a1e6-4723-beca-3830252e54b0 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] [instance: fb92bc23-c330-4ca9-bc60-ff90de604199] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:03.472275 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-78dbb0c1-eaf5-4e6c-84d1-15e17147cdfa tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:03.493294 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4b342d7d-a1e6-4723-beca-3830252e54b0 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:03.493847 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4b342d7d-a1e6-4723-beca-3830252e54b0 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:03.494470 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4b342d7d-a1e6-4723-beca-3830252e54b0 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:03.495668 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4b342d7d-a1e6-4723-beca-3830252e54b0 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:03.496479 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4b342d7d-a1e6-4723-beca-3830252e54b0 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:03.496921 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-78dbb0c1-eaf5-4e6c-84d1-15e17147cdfa tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/39d1b0a9-6838-4b40-b786-ea685404db46" status: 200 len: 1511 microversion: 2.1 time: 0.240999 Oct 27 03:48:03.510431 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4b342d7d-a1e6-4723-beca-3830252e54b0 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:03.513642 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3114/5926] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:48:03 2022] GET /compute/v2.1/servers/39d1b0a9-6838-4b40-b786-ea685404db46 => generated 1511 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:48:03.525921 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3495cb45-da98-4aa1-a0f0-159805925335 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:03.527678 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3495cb45-da98-4aa1-a0f0-159805925335 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 39d1b0a9-6838-4b40-b786-ea685404db46] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:03.547606 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3495cb45-da98-4aa1-a0f0-159805925335 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:03.548118 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3495cb45-da98-4aa1-a0f0-159805925335 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:03.548577 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3495cb45-da98-4aa1-a0f0-159805925335 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:03.550414 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3495cb45-da98-4aa1-a0f0-159805925335 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:03.550888 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3495cb45-da98-4aa1-a0f0-159805925335 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:03.554132 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3495cb45-da98-4aa1-a0f0-159805925335 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:03.586566 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3495cb45-da98-4aa1-a0f0-159805925335 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 39d1b0a9-6838-4b40-b786-ea685404db46] Going to try to terminate instance {{(pid=121001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:48:03.634721 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:48:03.756014 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4b342d7d-a1e6-4723-beca-3830252e54b0 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d3c87c204946ffad3feb05bc6dfd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22265a03de2d478988f7a5ae2561e719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:03.768470 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4b342d7d-a1e6-4723-beca-3830252e54b0 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d3c87c204946ffad3feb05bc6dfd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22265a03de2d478988f7a5ae2561e719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:03.775948 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4b342d7d-a1e6-4723-beca-3830252e54b0 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d3c87c204946ffad3feb05bc6dfd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22265a03de2d478988f7a5ae2561e719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:03.777192 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4b342d7d-a1e6-4723-beca-3830252e54b0 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] 10.222.0.20 "GET /compute/v2.1/servers/fb92bc23-c330-4ca9-bc60-ff90de604199" status: 200 len: 1361 microversion: 2.26 time: 0.356132 Oct 27 03:48:03.786558 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2813/5927] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:48:03 2022] GET /compute/v2.1/servers/fb92bc23-c330-4ca9-bc60-ff90de604199 => generated 1361 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:48:03.802969 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c44c186c-f907-4f66-a5a5-a8170c4dca10 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:03.804363 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c44c186c-f907-4f66-a5a5-a8170c4dca10 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] [instance: aaea6df3-ebe9-4a81-a8ec-e6bf9339283a] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:03.817045 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c44c186c-f907-4f66-a5a5-a8170c4dca10 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:03.817045 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c44c186c-f907-4f66-a5a5-a8170c4dca10 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:03.817045 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c44c186c-f907-4f66-a5a5-a8170c4dca10 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:03.817045 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c44c186c-f907-4f66-a5a5-a8170c4dca10 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:03.817045 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c44c186c-f907-4f66-a5a5-a8170c4dca10 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:03.817045 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c44c186c-f907-4f66-a5a5-a8170c4dca10 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:03.901040 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c44c186c-f907-4f66-a5a5-a8170c4dca10 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:03.915959 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c44c186c-f907-4f66-a5a5-a8170c4dca10 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:03.917981 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c44c186c-f907-4f66-a5a5-a8170c4dca10 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:03.920714 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c44c186c-f907-4f66-a5a5-a8170c4dca10 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] 10.222.0.20 "GET /compute/v2.1/servers/aaea6df3-ebe9-4a81-a8ec-e6bf9339283a" status: 200 len: 1336 microversion: 2.54 time: 0.133058 Oct 27 03:48:03.921418 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2814/5928] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:48:03 2022] GET /compute/v2.1/servers/aaea6df3-ebe9-4a81-a8ec-e6bf9339283a => generated 1336 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:48:04.000150 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3495cb45-da98-4aa1-a0f0-159805925335 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "DELETE /compute/v2.1/servers/39d1b0a9-6838-4b40-b786-ea685404db46" status: 204 len: 0 microversion: 2.1 time: 0.480662 Oct 27 03:48:04.000782 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3115/5929] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:48:03 2022] DELETE /compute/v2.1/servers/39d1b0a9-6838-4b40-b786-ea685404db46 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:48:04.009391 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-50f7ab68-8fd5-4488-90e0-4c7432766066 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:04.010077 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-50f7ab68-8fd5-4488-90e0-4c7432766066 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 39d1b0a9-6838-4b40-b786-ea685404db46] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:04.016846 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-50f7ab68-8fd5-4488-90e0-4c7432766066 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:04.017436 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-50f7ab68-8fd5-4488-90e0-4c7432766066 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:04.017889 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-50f7ab68-8fd5-4488-90e0-4c7432766066 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:04.018626 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-50f7ab68-8fd5-4488-90e0-4c7432766066 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:04.019093 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-50f7ab68-8fd5-4488-90e0-4c7432766066 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:04.019532 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-50f7ab68-8fd5-4488-90e0-4c7432766066 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:04.260300 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-50f7ab68-8fd5-4488-90e0-4c7432766066 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:04.274839 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-50f7ab68-8fd5-4488-90e0-4c7432766066 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/39d1b0a9-6838-4b40-b786-ea685404db46" status: 200 len: 1517 microversion: 2.1 time: 0.269316 Oct 27 03:48:04.275429 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2815/5930] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:48:04 2022] GET /compute/v2.1/servers/39d1b0a9-6838-4b40-b786-ea685404db46 => generated 1517 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:48:04.811057 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4ed0575c-d497-4f11-a1fe-115b51f0ab42 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:04.811783 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4ed0575c-d497-4f11-a1fe-115b51f0ab42 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] [instance: fb92bc23-c330-4ca9-bc60-ff90de604199] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:04.832794 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4ed0575c-d497-4f11-a1fe-115b51f0ab42 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:04.832794 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4ed0575c-d497-4f11-a1fe-115b51f0ab42 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:04.832794 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4ed0575c-d497-4f11-a1fe-115b51f0ab42 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:04.832794 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4ed0575c-d497-4f11-a1fe-115b51f0ab42 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:04.832794 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4ed0575c-d497-4f11-a1fe-115b51f0ab42 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:04.832794 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4ed0575c-d497-4f11-a1fe-115b51f0ab42 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:04.959586 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d50f9e85-9ca1-4834-9ada-891bb7de6714 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:04.959586 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d50f9e85-9ca1-4834-9ada-891bb7de6714 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] [instance: aaea6df3-ebe9-4a81-a8ec-e6bf9339283a] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:04.963169 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d50f9e85-9ca1-4834-9ada-891bb7de6714 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:04.963776 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d50f9e85-9ca1-4834-9ada-891bb7de6714 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:04.964451 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d50f9e85-9ca1-4834-9ada-891bb7de6714 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:04.965507 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d50f9e85-9ca1-4834-9ada-891bb7de6714 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:04.966772 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d50f9e85-9ca1-4834-9ada-891bb7de6714 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:04.967327 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d50f9e85-9ca1-4834-9ada-891bb7de6714 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:05.088159 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d50f9e85-9ca1-4834-9ada-891bb7de6714 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:05.116301 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d50f9e85-9ca1-4834-9ada-891bb7de6714 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:05.125564 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d50f9e85-9ca1-4834-9ada-891bb7de6714 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:05.127410 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d50f9e85-9ca1-4834-9ada-891bb7de6714 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] 10.222.0.20 "GET /compute/v2.1/servers/aaea6df3-ebe9-4a81-a8ec-e6bf9339283a" status: 200 len: 1336 microversion: 2.54 time: 0.182123 Oct 27 03:48:05.128012 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2816/5931] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:48:04 2022] GET /compute/v2.1/servers/aaea6df3-ebe9-4a81-a8ec-e6bf9339283a => generated 1336 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:48:05.145499 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-6d54aae3-6f48-41f8-bd6f-c5a3b8f92775 req-3722007a-645b-49c4-b29b-1f1a8e48129f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb92bc23-c330-4ca9-bc60-ff90de604199", "name": "network-vif-plugged", "status": "completed", "tag": "9171b3d1-838c-49e8-9ac0-7ce8d2718e52"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:48:05.176875 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-6d54aae3-6f48-41f8-bd6f-c5a3b8f92775 req-3722007a-645b-49c4-b29b-1f1a8e48129f service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:05.177357 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-6d54aae3-6f48-41f8-bd6f-c5a3b8f92775 req-3722007a-645b-49c4-b29b-1f1a8e48129f service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:05.181493 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-6d54aae3-6f48-41f8-bd6f-c5a3b8f92775 req-3722007a-645b-49c4-b29b-1f1a8e48129f service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:05.202855 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-6d54aae3-6f48-41f8-bd6f-c5a3b8f92775 req-3722007a-645b-49c4-b29b-1f1a8e48129f service nova] Creating event network-vif-plugged:9171b3d1-838c-49e8-9ac0-7ce8d2718e52 for instance fb92bc23-c330-4ca9-bc60-ff90de604199 on n-h2-862769-1 Oct 27 03:48:05.209178 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-6d54aae3-6f48-41f8-bd6f-c5a3b8f92775 req-3722007a-645b-49c4-b29b-1f1a8e48129f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079920 Oct 27 03:48:05.209812 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2817/5932] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:48:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:48:05.301099 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-350d16fe-692a-4b8a-a2d6-f118eea1d7f3 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:05.302048 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-350d16fe-692a-4b8a-a2d6-f118eea1d7f3 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 39d1b0a9-6838-4b40-b786-ea685404db46] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:05.314221 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-350d16fe-692a-4b8a-a2d6-f118eea1d7f3 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:05.314867 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-350d16fe-692a-4b8a-a2d6-f118eea1d7f3 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:05.315416 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-350d16fe-692a-4b8a-a2d6-f118eea1d7f3 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:05.316239 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-350d16fe-692a-4b8a-a2d6-f118eea1d7f3 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:05.316806 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-350d16fe-692a-4b8a-a2d6-f118eea1d7f3 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:05.324410 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-350d16fe-692a-4b8a-a2d6-f118eea1d7f3 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:05.555047 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-350d16fe-692a-4b8a-a2d6-f118eea1d7f3 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:05.578336 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-350d16fe-692a-4b8a-a2d6-f118eea1d7f3 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/39d1b0a9-6838-4b40-b786-ea685404db46" status: 200 len: 1517 microversion: 2.1 time: 0.281186 Oct 27 03:48:05.590109 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2818/5933] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:48:05 2022] GET /compute/v2.1/servers/39d1b0a9-6838-4b40-b786-ea685404db46 => generated 1517 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:48:05.745200 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4ed0575c-d497-4f11-a1fe-115b51f0ab42 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d3c87c204946ffad3feb05bc6dfd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22265a03de2d478988f7a5ae2561e719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:05.756167 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4ed0575c-d497-4f11-a1fe-115b51f0ab42 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d3c87c204946ffad3feb05bc6dfd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22265a03de2d478988f7a5ae2561e719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:05.758067 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4ed0575c-d497-4f11-a1fe-115b51f0ab42 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d3c87c204946ffad3feb05bc6dfd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22265a03de2d478988f7a5ae2561e719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:05.759305 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4ed0575c-d497-4f11-a1fe-115b51f0ab42 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] 10.222.0.20 "GET /compute/v2.1/servers/fb92bc23-c330-4ca9-bc60-ff90de604199" status: 200 len: 1361 microversion: 2.26 time: 0.954043 Oct 27 03:48:05.760164 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3116/5934] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:48:04 2022] GET /compute/v2.1/servers/fb92bc23-c330-4ca9-bc60-ff90de604199 => generated 1361 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:48:06.162618 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a1b34678-10fa-4efb-bb81-baa43105221c tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:06.168340 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a1b34678-10fa-4efb-bb81-baa43105221c tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] [instance: aaea6df3-ebe9-4a81-a8ec-e6bf9339283a] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:06.177706 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a1b34678-10fa-4efb-bb81-baa43105221c tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:06.178875 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a1b34678-10fa-4efb-bb81-baa43105221c tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:06.179845 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a1b34678-10fa-4efb-bb81-baa43105221c tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:06.180953 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a1b34678-10fa-4efb-bb81-baa43105221c tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:06.181635 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a1b34678-10fa-4efb-bb81-baa43105221c tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:06.186363 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a1b34678-10fa-4efb-bb81-baa43105221c tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:06.336876 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a1b34678-10fa-4efb-bb81-baa43105221c tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:06.359119 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a1b34678-10fa-4efb-bb81-baa43105221c tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:06.364586 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a1b34678-10fa-4efb-bb81-baa43105221c tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:06.368928 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a1b34678-10fa-4efb-bb81-baa43105221c tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] 10.222.0.20 "GET /compute/v2.1/servers/aaea6df3-ebe9-4a81-a8ec-e6bf9339283a" status: 200 len: 1357 microversion: 2.54 time: 0.214191 Oct 27 03:48:06.370322 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2819/5935] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:48:06 2022] GET /compute/v2.1/servers/aaea6df3-ebe9-4a81-a8ec-e6bf9339283a => generated 1357 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:48:06.410712 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0870b2c2-cc09-4f13-8dbb-93feba41264e tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Action: 'create', calling method: .version_select at 0x7f7dda04c3a0>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-527192614", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMsPSLPnLwQ49DdhemmsLciiB8floBQkFxZkxu50Xb+QtGRIO6d6I7bO2+bHfht6FgN/sjD/7UtwO6W0Vfm1Wfc7moSc9Re5gZ5uWsIRiiVMqGhXWykBFrgjMXMKLE7kg=="}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:48:06.433701 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-0870b2c2-cc09-4f13-8dbb-93feba41264e tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Getting quotas for project 115b85f8af8e491f85a80eeb979100a0. Resources: {'key_pairs'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:48:06.439671 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-0870b2c2-cc09-4f13-8dbb-93feba41264e tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Getting quotas for user 3771098cc42a447eab2524a0682133e8 and project 115b85f8af8e491f85a80eeb979100a0. Resources: {'key_pairs'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:48:06.441216 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:48:06.609087 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f866f736-48e5-4954-8565-d08dea012d0a tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:06.609718 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f866f736-48e5-4954-8565-d08dea012d0a tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 39d1b0a9-6838-4b40-b786-ea685404db46] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:06.639003 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f866f736-48e5-4954-8565-d08dea012d0a tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:06.639003 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f866f736-48e5-4954-8565-d08dea012d0a tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:06.639003 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f866f736-48e5-4954-8565-d08dea012d0a tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:06.639003 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f866f736-48e5-4954-8565-d08dea012d0a tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:06.639003 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f866f736-48e5-4954-8565-d08dea012d0a tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:06.639003 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f866f736-48e5-4954-8565-d08dea012d0a tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:06.639003 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=100 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:48:06.664788 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0870b2c2-cc09-4f13-8dbb-93feba41264e tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 419 microversion: 2.54 time: 0.263710 Oct 27 03:48:06.673345 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3117/5936] 10.222.0.20 () {62 vars in 1200 bytes} [Thu Oct 27 03:48:06 2022] POST /compute/v2.1/os-keypairs => generated 419 bytes in 266 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 27 03:48:06.683297 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c08dfb73-95f2-42d9-8263-4065ff34d8c4 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-527192614", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:48:06.694472 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c08dfb73-95f2-42d9-8263-4065ff34d8c4 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] [instance: aaea6df3-ebe9-4a81-a8ec-e6bf9339283a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:06.716307 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c08dfb73-95f2-42d9-8263-4065ff34d8c4 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:06.716307 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c08dfb73-95f2-42d9-8263-4065ff34d8c4 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:06.716307 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c08dfb73-95f2-42d9-8263-4065ff34d8c4 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:06.716307 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c08dfb73-95f2-42d9-8263-4065ff34d8c4 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:06.716307 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c08dfb73-95f2-42d9-8263-4065ff34d8c4 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:06.716307 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c08dfb73-95f2-42d9-8263-4065ff34d8c4 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:06.905720 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-c08dfb73-95f2-42d9-8263-4065ff34d8c4 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Flavor limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:48:06.906463 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-c08dfb73-95f2-42d9-8263-4065ff34d8c4 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Image limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:48:06.906947 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-c08dfb73-95f2-42d9-8263-4065ff34d8c4 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Flavor pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:48:06.907363 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-c08dfb73-95f2-42d9-8263-4065ff34d8c4 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Image pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:48:06.907779 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-c08dfb73-95f2-42d9-8263-4065ff34d8c4 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:48:07.208874 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f866f736-48e5-4954-8565-d08dea012d0a tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:07.224327 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f866f736-48e5-4954-8565-d08dea012d0a tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/39d1b0a9-6838-4b40-b786-ea685404db46" status: 200 len: 1517 microversion: 2.1 time: 0.619749 Oct 27 03:48:07.225526 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2820/5937] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:48:06 2022] GET /compute/v2.1/servers/39d1b0a9-6838-4b40-b786-ea685404db46 => generated 1517 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:48:07.233422 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b0eb053c-cd3c-49bd-b3a5-5daacdffbc7b tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:07.234343 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b0eb053c-cd3c-49bd-b3a5-5daacdffbc7b tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] [instance: fb92bc23-c330-4ca9-bc60-ff90de604199] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:07.249168 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b0eb053c-cd3c-49bd-b3a5-5daacdffbc7b tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:07.250219 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b0eb053c-cd3c-49bd-b3a5-5daacdffbc7b tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:07.250820 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b0eb053c-cd3c-49bd-b3a5-5daacdffbc7b tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:07.251763 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b0eb053c-cd3c-49bd-b3a5-5daacdffbc7b tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:07.252271 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b0eb053c-cd3c-49bd-b3a5-5daacdffbc7b tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:07.252710 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b0eb053c-cd3c-49bd-b3a5-5daacdffbc7b tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:07.461117 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=4 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:48:07.471583 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c08dfb73-95f2-42d9-8263-4065ff34d8c4 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] [instance: aaea6df3-ebe9-4a81-a8ec-e6bf9339283a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:07.479366 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c08dfb73-95f2-42d9-8263-4065ff34d8c4 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:07.479961 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c08dfb73-95f2-42d9-8263-4065ff34d8c4 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:07.480485 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c08dfb73-95f2-42d9-8263-4065ff34d8c4 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:07.481288 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c08dfb73-95f2-42d9-8263-4065ff34d8c4 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:07.482417 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c08dfb73-95f2-42d9-8263-4065ff34d8c4 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:07.483157 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c08dfb73-95f2-42d9-8263-4065ff34d8c4 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:07.554865 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b0eb053c-cd3c-49bd-b3a5-5daacdffbc7b tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d3c87c204946ffad3feb05bc6dfd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22265a03de2d478988f7a5ae2561e719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:07.577143 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c08dfb73-95f2-42d9-8263-4065ff34d8c4 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] 10.222.0.20 "POST /compute/v2.1/servers/aaea6df3-ebe9-4a81-a8ec-e6bf9339283a/action" status: 202 len: 1139 microversion: 2.54 time: 0.901143 Oct 27 03:48:07.584316 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b0eb053c-cd3c-49bd-b3a5-5daacdffbc7b tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d3c87c204946ffad3feb05bc6dfd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22265a03de2d478988f7a5ae2561e719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:07.587819 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b0eb053c-cd3c-49bd-b3a5-5daacdffbc7b tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d3c87c204946ffad3feb05bc6dfd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22265a03de2d478988f7a5ae2561e719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:07.587819 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b0eb053c-cd3c-49bd-b3a5-5daacdffbc7b tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] 10.222.0.20 "GET /compute/v2.1/servers/fb92bc23-c330-4ca9-bc60-ff90de604199" status: 200 len: 1545 microversion: 2.26 time: 0.358363 Oct 27 03:48:07.587971 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3118/5938] 10.222.0.20 () {62 vars in 1320 bytes} [Thu Oct 27 03:48:06 2022] POST /compute/v2.1/servers/aaea6df3-ebe9-4a81-a8ec-e6bf9339283a/action => generated 1139 bytes in 906 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Oct 27 03:48:07.600817 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2821/5939] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:48:07 2022] GET /compute/v2.1/servers/fb92bc23-c330-4ca9-bc60-ff90de604199 => generated 1545 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:48:07.605893 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-a014ccfc-febd-4a7b-8c29-89ddb8de9d0b req-e72832ba-42b2-4a99-a0bf-c8bb00f596db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39d1b0a9-6838-4b40-b786-ea685404db46", "name": "network-vif-deleted", "tag": "6a8c41a9-99d6-47db-ad6c-e0f59c1598e8"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:48:07.627731 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-44370831-b729-461b-8e1b-18bea01bba6b tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:07.632618 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-44370831-b729-461b-8e1b-18bea01bba6b tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] [instance: aaea6df3-ebe9-4a81-a8ec-e6bf9339283a] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:07.637182 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-a014ccfc-febd-4a7b-8c29-89ddb8de9d0b req-e72832ba-42b2-4a99-a0bf-c8bb00f596db service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:07.637664 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-a014ccfc-febd-4a7b-8c29-89ddb8de9d0b req-e72832ba-42b2-4a99-a0bf-c8bb00f596db service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:07.647677 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-a014ccfc-febd-4a7b-8c29-89ddb8de9d0b req-e72832ba-42b2-4a99-a0bf-c8bb00f596db service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:07.652904 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-44370831-b729-461b-8e1b-18bea01bba6b tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:07.658477 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-44370831-b729-461b-8e1b-18bea01bba6b tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:07.664530 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-44370831-b729-461b-8e1b-18bea01bba6b tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:07.664530 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-44370831-b729-461b-8e1b-18bea01bba6b tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:07.664530 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-44370831-b729-461b-8e1b-18bea01bba6b tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:07.664530 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-44370831-b729-461b-8e1b-18bea01bba6b tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:07.688673 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-a014ccfc-febd-4a7b-8c29-89ddb8de9d0b req-e72832ba-42b2-4a99-a0bf-c8bb00f596db service nova] Creating event network-vif-deleted:6a8c41a9-99d6-47db-ad6c-e0f59c1598e8 for instance 39d1b0a9-6838-4b40-b786-ea685404db46 on n-h1-862769-1 Oct 27 03:48:07.695929 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-a014ccfc-febd-4a7b-8c29-89ddb8de9d0b req-e72832ba-42b2-4a99-a0bf-c8bb00f596db service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106733 Oct 27 03:48:07.696543 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3119/5940] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:48:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:48:07.707452 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-845a8677-624c-4f64-883f-02083ff36adc tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Calling method '.version_select at 0x7f7dda04caf0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:07.742818 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-845a8677-624c-4f64-883f-02083ff36adc tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:07.743322 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-845a8677-624c-4f64-883f-02083ff36adc tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:07.743745 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-845a8677-624c-4f64-883f-02083ff36adc tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:07.744325 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-845a8677-624c-4f64-883f-02083ff36adc tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] [instance: fb92bc23-c330-4ca9-bc60-ff90de604199] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:07.750838 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-845a8677-624c-4f64-883f-02083ff36adc tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:07.751517 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-845a8677-624c-4f64-883f-02083ff36adc tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:07.752146 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-845a8677-624c-4f64-883f-02083ff36adc tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:07.753619 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-845a8677-624c-4f64-883f-02083ff36adc tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:07.754275 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-845a8677-624c-4f64-883f-02083ff36adc tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:07.754847 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-845a8677-624c-4f64-883f-02083ff36adc tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:07.795377 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-44370831-b729-461b-8e1b-18bea01bba6b tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:07.813461 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-44370831-b729-461b-8e1b-18bea01bba6b tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:07.815537 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-44370831-b729-461b-8e1b-18bea01bba6b tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:07.817190 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-44370831-b729-461b-8e1b-18bea01bba6b tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] 10.222.0.20 "GET /compute/v2.1/servers/aaea6df3-ebe9-4a81-a8ec-e6bf9339283a" status: 200 len: 1408 microversion: 2.54 time: 0.215064 Oct 27 03:48:07.818423 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2822/5941] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:48:07 2022] GET /compute/v2.1/servers/aaea6df3-ebe9-4a81-a8ec-e6bf9339283a => generated 1408 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:48:07.836612 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-845a8677-624c-4f64-883f-02083ff36adc tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:07.837463 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-845a8677-624c-4f64-883f-02083ff36adc tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:07.837943 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-845a8677-624c-4f64-883f-02083ff36adc tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:07.865767 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-845a8677-624c-4f64-883f-02083ff36adc tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:07.865887 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-845a8677-624c-4f64-883f-02083ff36adc tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:07.866597 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-845a8677-624c-4f64-883f-02083ff36adc tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:08.103273 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-845a8677-624c-4f64-883f-02083ff36adc tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lazy-loading 'flavor' on Instance uuid fb92bc23-c330-4ca9-bc60-ff90de604199 {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:48:08.145825 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-845a8677-624c-4f64-883f-02083ff36adc tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] 10.222.0.20 "PUT /compute/v2.1/servers/fb92bc23-c330-4ca9-bc60-ff90de604199/tags/tempest-tag-854101108" status: 201 len: 0 microversion: 2.26 time: 0.447793 Oct 27 03:48:08.147339 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3120/5942] 10.222.0.20 () {62 vars in 1377 bytes} [Thu Oct 27 03:48:07 2022] PUT /compute/v2.1/servers/fb92bc23-c330-4ca9-bc60-ff90de604199/tags/tempest-tag-854101108 => generated 0 bytes in 450 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 27 03:48:08.164214 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a637a265-5428-4e3e-8e17-8b6f3fca5632 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Calling method '.version_select at 0x7f7dd98e4c10>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:08.176038 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a637a265-5428-4e3e-8e17-8b6f3fca5632 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:08.176713 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a637a265-5428-4e3e-8e17-8b6f3fca5632 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:08.177338 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a637a265-5428-4e3e-8e17-8b6f3fca5632 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:08.203232 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a637a265-5428-4e3e-8e17-8b6f3fca5632 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] 10.222.0.20 "GET /compute/v2.1/servers/fb92bc23-c330-4ca9-bc60-ff90de604199/tags/tempest-tag-854101108" status: 204 len: 0 microversion: 2.26 time: 0.050456 Oct 27 03:48:08.208192 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2823/5943] 10.222.0.20 () {60 vars in 1358 bytes} [Thu Oct 27 03:48:08 2022] GET /compute/v2.1/servers/fb92bc23-c330-4ca9-bc60-ff90de604199/tags/tempest-tag-854101108 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 03:48:08.213319 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-03619473-bcac-4a28-b657-ebd9e72ed9b2 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Calling method '.version_select at 0x7f7dd9b3f5e0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:08.228121 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-03619473-bcac-4a28-b657-ebd9e72ed9b2 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:08.228631 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-03619473-bcac-4a28-b657-ebd9e72ed9b2 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:08.229081 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-03619473-bcac-4a28-b657-ebd9e72ed9b2 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:08.229570 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-03619473-bcac-4a28-b657-ebd9e72ed9b2 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] [instance: fb92bc23-c330-4ca9-bc60-ff90de604199] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:08.243889 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-03619473-bcac-4a28-b657-ebd9e72ed9b2 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:08.244383 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-03619473-bcac-4a28-b657-ebd9e72ed9b2 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:08.244960 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-03619473-bcac-4a28-b657-ebd9e72ed9b2 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:08.252755 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-03619473-bcac-4a28-b657-ebd9e72ed9b2 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:08.257622 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f05db982-26c4-4a39-b89b-f056897096f9 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:08.258336 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f05db982-26c4-4a39-b89b-f056897096f9 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 39d1b0a9-6838-4b40-b786-ea685404db46] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:08.258859 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-03619473-bcac-4a28-b657-ebd9e72ed9b2 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:08.259460 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-03619473-bcac-4a28-b657-ebd9e72ed9b2 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:08.266570 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:48:08.268127 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f05db982-26c4-4a39-b89b-f056897096f9 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:08.268620 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f05db982-26c4-4a39-b89b-f056897096f9 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:08.269139 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f05db982-26c4-4a39-b89b-f056897096f9 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:08.269791 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f05db982-26c4-4a39-b89b-f056897096f9 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:08.271160 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f05db982-26c4-4a39-b89b-f056897096f9 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:08.275941 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f05db982-26c4-4a39-b89b-f056897096f9 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:08.308592 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-03619473-bcac-4a28-b657-ebd9e72ed9b2 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:08.312504 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-03619473-bcac-4a28-b657-ebd9e72ed9b2 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:08.313103 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-03619473-bcac-4a28-b657-ebd9e72ed9b2 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:08.368567 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f05db982-26c4-4a39-b89b-f056897096f9 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:08.369080 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f05db982-26c4-4a39-b89b-f056897096f9 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:08.369525 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f05db982-26c4-4a39-b89b-f056897096f9 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:08.370260 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-f05db982-26c4-4a39-b89b-f056897096f9 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lazy-loading 'fault' on Instance uuid 39d1b0a9-6838-4b40-b786-ea685404db46 {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:48:08.438936 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f05db982-26c4-4a39-b89b-f056897096f9 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:08.447660 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f05db982-26c4-4a39-b89b-f056897096f9 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/39d1b0a9-6838-4b40-b786-ea685404db46" status: 200 len: 1320 microversion: 2.1 time: 0.198342 Oct 27 03:48:08.468096 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2824/5944] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:48:08 2022] GET /compute/v2.1/servers/39d1b0a9-6838-4b40-b786-ea685404db46 => generated 1320 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:48:08.470542 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-03619473-bcac-4a28-b657-ebd9e72ed9b2 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lazy-loading 'flavor' on Instance uuid fb92bc23-c330-4ca9-bc60-ff90de604199 {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:48:08.539547 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-03619473-bcac-4a28-b657-ebd9e72ed9b2 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] 10.222.0.20 "DELETE /compute/v2.1/servers/fb92bc23-c330-4ca9-bc60-ff90de604199/tags" status: 204 len: 0 microversion: 2.26 time: 0.323369 Oct 27 03:48:08.540493 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3121/5945] 10.222.0.20 () {60 vars in 1295 bytes} [Thu Oct 27 03:48:08 2022] DELETE /compute/v2.1/servers/fb92bc23-c330-4ca9-bc60-ff90de604199/tags => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 27 03:48:08.555514 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6b3c324a-c9fa-4de7-8fab-faeccf3bdb29 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Calling method '.version_select at 0x7f7dd995fd30>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:08.563876 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6b3c324a-c9fa-4de7-8fab-faeccf3bdb29 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:08.564378 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6b3c324a-c9fa-4de7-8fab-faeccf3bdb29 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:08.564827 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6b3c324a-c9fa-4de7-8fab-faeccf3bdb29 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:08.605329 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6b3c324a-c9fa-4de7-8fab-faeccf3bdb29 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] 10.222.0.20 "GET /compute/v2.1/servers/fb92bc23-c330-4ca9-bc60-ff90de604199/tags" status: 200 len: 12 microversion: 2.26 time: 0.054317 Oct 27 03:48:08.613966 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2825/5946] 10.222.0.20 () {60 vars in 1292 bytes} [Thu Oct 27 03:48:08 2022] GET /compute/v2.1/servers/fb92bc23-c330-4ca9-bc60-ff90de604199/tags => generated 12 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:48:08.626736 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-bc841e2c-a460-45b0-9693-d121349861dd tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Calling method '.version_select at 0x7f7dd9fa1700>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:08.642697 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bc841e2c-a460-45b0-9693-d121349861dd tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:08.643183 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bc841e2c-a460-45b0-9693-d121349861dd tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:08.648943 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bc841e2c-a460-45b0-9693-d121349861dd tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:08.649558 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-bc841e2c-a460-45b0-9693-d121349861dd tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] [instance: fb92bc23-c330-4ca9-bc60-ff90de604199] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:08.661459 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bc841e2c-a460-45b0-9693-d121349861dd tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:08.661965 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bc841e2c-a460-45b0-9693-d121349861dd tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:08.662462 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bc841e2c-a460-45b0-9693-d121349861dd tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:08.663173 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bc841e2c-a460-45b0-9693-d121349861dd tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:08.663635 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bc841e2c-a460-45b0-9693-d121349861dd tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:08.664062 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bc841e2c-a460-45b0-9693-d121349861dd tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:08.708876 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bc841e2c-a460-45b0-9693-d121349861dd tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:08.710163 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bc841e2c-a460-45b0-9693-d121349861dd tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:08.710789 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bc841e2c-a460-45b0-9693-d121349861dd tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:08.729484 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bc841e2c-a460-45b0-9693-d121349861dd tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:08.729976 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bc841e2c-a460-45b0-9693-d121349861dd tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:08.730590 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bc841e2c-a460-45b0-9693-d121349861dd tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:08.857874 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-500a4518-6719-4327-aa23-0cb94b916c15 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:08.857874 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-500a4518-6719-4327-aa23-0cb94b916c15 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] [instance: aaea6df3-ebe9-4a81-a8ec-e6bf9339283a] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:08.866990 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-500a4518-6719-4327-aa23-0cb94b916c15 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:08.867485 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-500a4518-6719-4327-aa23-0cb94b916c15 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:08.867918 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-500a4518-6719-4327-aa23-0cb94b916c15 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:08.870782 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-500a4518-6719-4327-aa23-0cb94b916c15 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:08.871358 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-bc841e2c-a460-45b0-9693-d121349861dd tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lazy-loading 'flavor' on Instance uuid fb92bc23-c330-4ca9-bc60-ff90de604199 {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:48:08.876783 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-500a4518-6719-4327-aa23-0cb94b916c15 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:08.877425 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-500a4518-6719-4327-aa23-0cb94b916c15 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:08.891387 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-bc841e2c-a460-45b0-9693-d121349861dd tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] 10.222.0.20 "PUT /compute/v2.1/servers/fb92bc23-c330-4ca9-bc60-ff90de604199/tags/tempest-tag-1085640543" status: 201 len: 0 microversion: 2.26 time: 0.269634 Oct 27 03:48:08.892456 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3122/5947] 10.222.0.20 () {62 vars in 1380 bytes} [Thu Oct 27 03:48:08 2022] PUT /compute/v2.1/servers/fb92bc23-c330-4ca9-bc60-ff90de604199/tags/tempest-tag-1085640543 => generated 0 bytes in 271 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 27 03:48:08.902278 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8aa261bd-69f2-4db7-a300-6fe138613672 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Calling method '.version_select at 0x7f7dda43c3a0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:08.912103 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8aa261bd-69f2-4db7-a300-6fe138613672 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:08.912891 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8aa261bd-69f2-4db7-a300-6fe138613672 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:08.913495 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8aa261bd-69f2-4db7-a300-6fe138613672 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:08.929868 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8aa261bd-69f2-4db7-a300-6fe138613672 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] 10.222.0.20 "GET /compute/v2.1/servers/fb92bc23-c330-4ca9-bc60-ff90de604199/tags" status: 200 len: 36 microversion: 2.26 time: 0.031883 Oct 27 03:48:08.934094 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3123/5948] 10.222.0.20 () {60 vars in 1292 bytes} [Thu Oct 27 03:48:08 2022] GET /compute/v2.1/servers/fb92bc23-c330-4ca9-bc60-ff90de604199/tags => generated 36 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:48:08.943343 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-75bc15a8-00cb-4f63-8f27-7a25723d7a3c tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Calling method '.version_select at 0x7f7dd9b98790>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:08.951633 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-75bc15a8-00cb-4f63-8f27-7a25723d7a3c tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:08.952129 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-75bc15a8-00cb-4f63-8f27-7a25723d7a3c tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:08.952570 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-75bc15a8-00cb-4f63-8f27-7a25723d7a3c tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:08.958296 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-75bc15a8-00cb-4f63-8f27-7a25723d7a3c tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] [instance: fb92bc23-c330-4ca9-bc60-ff90de604199] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:08.958857 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-75bc15a8-00cb-4f63-8f27-7a25723d7a3c tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:08.959346 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-75bc15a8-00cb-4f63-8f27-7a25723d7a3c tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:08.959794 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-75bc15a8-00cb-4f63-8f27-7a25723d7a3c tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:08.960486 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-75bc15a8-00cb-4f63-8f27-7a25723d7a3c tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:08.960940 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-75bc15a8-00cb-4f63-8f27-7a25723d7a3c tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:08.961366 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-75bc15a8-00cb-4f63-8f27-7a25723d7a3c tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:08.970166 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-500a4518-6719-4327-aa23-0cb94b916c15 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:08.979617 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-500a4518-6719-4327-aa23-0cb94b916c15 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:08.982916 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-500a4518-6719-4327-aa23-0cb94b916c15 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:08.984223 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-500a4518-6719-4327-aa23-0cb94b916c15 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] 10.222.0.20 "GET /compute/v2.1/servers/aaea6df3-ebe9-4a81-a8ec-e6bf9339283a" status: 200 len: 1408 microversion: 2.54 time: 0.138978 Oct 27 03:48:08.984793 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2826/5949] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:48:08 2022] GET /compute/v2.1/servers/aaea6df3-ebe9-4a81-a8ec-e6bf9339283a => generated 1408 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:48:09.012081 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-75bc15a8-00cb-4f63-8f27-7a25723d7a3c tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:09.012585 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-75bc15a8-00cb-4f63-8f27-7a25723d7a3c tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:09.013112 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-75bc15a8-00cb-4f63-8f27-7a25723d7a3c tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:09.132587 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-75bc15a8-00cb-4f63-8f27-7a25723d7a3c tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lazy-loading 'flavor' on Instance uuid fb92bc23-c330-4ca9-bc60-ff90de604199 {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:48:09.147716 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-75bc15a8-00cb-4f63-8f27-7a25723d7a3c tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] 10.222.0.20 "DELETE /compute/v2.1/servers/fb92bc23-c330-4ca9-bc60-ff90de604199/tags/tempest-tag-1085640543" status: 204 len: 0 microversion: 2.26 time: 0.210545 Oct 27 03:48:09.148519 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3124/5950] 10.222.0.20 () {60 vars in 1364 bytes} [Thu Oct 27 03:48:08 2022] DELETE /compute/v2.1/servers/fb92bc23-c330-4ca9-bc60-ff90de604199/tags/tempest-tag-1085640543 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 27 03:48:09.157803 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a7ea6bbb-b2e1-49c2-a631-7997d1e2b776 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Calling method '.version_select at 0x7f7dd9e57c10>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:09.163341 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=18 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:48:09.166866 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a7ea6bbb-b2e1-49c2-a631-7997d1e2b776 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:09.167432 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a7ea6bbb-b2e1-49c2-a631-7997d1e2b776 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:09.167979 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a7ea6bbb-b2e1-49c2-a631-7997d1e2b776 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:09.184992 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a7ea6bbb-b2e1-49c2-a631-7997d1e2b776 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] 10.222.0.20 "GET /compute/v2.1/servers/fb92bc23-c330-4ca9-bc60-ff90de604199/tags" status: 200 len: 12 microversion: 2.26 time: 0.031909 Oct 27 03:48:09.191675 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2827/5951] 10.222.0.20 () {60 vars in 1292 bytes} [Thu Oct 27 03:48:09 2022] GET /compute/v2.1/servers/fb92bc23-c330-4ca9-bc60-ff90de604199/tags => generated 12 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:48:09.196343 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5dd7eb16-6275-431b-91cc-17e752f0acc2 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Calling method '.version_select at 0x7f7dd9dccb80>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:09.210981 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5dd7eb16-6275-431b-91cc-17e752f0acc2 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:09.211483 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5dd7eb16-6275-431b-91cc-17e752f0acc2 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:09.212326 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5dd7eb16-6275-431b-91cc-17e752f0acc2 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:09.212494 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5dd7eb16-6275-431b-91cc-17e752f0acc2 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] [instance: fb92bc23-c330-4ca9-bc60-ff90de604199] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:09.228797 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5dd7eb16-6275-431b-91cc-17e752f0acc2 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:09.228797 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5dd7eb16-6275-431b-91cc-17e752f0acc2 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:09.228797 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5dd7eb16-6275-431b-91cc-17e752f0acc2 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:09.230224 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5dd7eb16-6275-431b-91cc-17e752f0acc2 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:09.230979 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5dd7eb16-6275-431b-91cc-17e752f0acc2 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:09.232615 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5dd7eb16-6275-431b-91cc-17e752f0acc2 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:09.266850 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5dd7eb16-6275-431b-91cc-17e752f0acc2 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:09.267901 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5dd7eb16-6275-431b-91cc-17e752f0acc2 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:09.268033 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5dd7eb16-6275-431b-91cc-17e752f0acc2 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:09.284960 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-5dd7eb16-6275-431b-91cc-17e752f0acc2 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lazy-loading 'flavor' on Instance uuid fb92bc23-c330-4ca9-bc60-ff90de604199 {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:48:09.306395 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5dd7eb16-6275-431b-91cc-17e752f0acc2 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] 10.222.0.20 "DELETE /compute/v2.1/servers/fb92bc23-c330-4ca9-bc60-ff90de604199/tags" status: 204 len: 0 microversion: 2.26 time: 0.114518 Oct 27 03:48:09.312065 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3125/5952] 10.222.0.20 () {60 vars in 1295 bytes} [Thu Oct 27 03:48:09 2022] DELETE /compute/v2.1/servers/fb92bc23-c330-4ca9-bc60-ff90de604199/tags => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 27 03:48:09.320569 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1290c704-1b7f-474f-ada6-d1bd4e2dd540 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Calling method '.version_select at 0x7f7dd98e4c10>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:09.338521 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1290c704-1b7f-474f-ada6-d1bd4e2dd540 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:09.338996 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1290c704-1b7f-474f-ada6-d1bd4e2dd540 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:09.339673 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1290c704-1b7f-474f-ada6-d1bd4e2dd540 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:09.340154 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1290c704-1b7f-474f-ada6-d1bd4e2dd540 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] [instance: fb92bc23-c330-4ca9-bc60-ff90de604199] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:09.346632 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1290c704-1b7f-474f-ada6-d1bd4e2dd540 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:09.347127 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1290c704-1b7f-474f-ada6-d1bd4e2dd540 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:09.347564 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1290c704-1b7f-474f-ada6-d1bd4e2dd540 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:09.348264 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1290c704-1b7f-474f-ada6-d1bd4e2dd540 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:09.348722 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1290c704-1b7f-474f-ada6-d1bd4e2dd540 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:09.349151 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1290c704-1b7f-474f-ada6-d1bd4e2dd540 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:09.376646 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1290c704-1b7f-474f-ada6-d1bd4e2dd540 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:09.377100 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1290c704-1b7f-474f-ada6-d1bd4e2dd540 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:09.377543 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1290c704-1b7f-474f-ada6-d1bd4e2dd540 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:09.386799 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1290c704-1b7f-474f-ada6-d1bd4e2dd540 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:09.387284 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1290c704-1b7f-474f-ada6-d1bd4e2dd540 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:09.387719 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1290c704-1b7f-474f-ada6-d1bd4e2dd540 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:09.475175 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-acf25498-15b9-48e0-80c3-e995fdca2762 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:09.475987 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-acf25498-15b9-48e0-80c3-e995fdca2762 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 39d1b0a9-6838-4b40-b786-ea685404db46] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:09.482858 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-acf25498-15b9-48e0-80c3-e995fdca2762 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:09.483588 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-acf25498-15b9-48e0-80c3-e995fdca2762 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:09.484243 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-acf25498-15b9-48e0-80c3-e995fdca2762 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:09.485254 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-acf25498-15b9-48e0-80c3-e995fdca2762 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:09.489145 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-acf25498-15b9-48e0-80c3-e995fdca2762 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:09.489790 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-acf25498-15b9-48e0-80c3-e995fdca2762 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:09.494568 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=4,nova_cell1:UPDATE=2,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=3 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:48:09.510893 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-acf25498-15b9-48e0-80c3-e995fdca2762 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] HTTP exception thrown: Instance 39d1b0a9-6838-4b40-b786-ea685404db46 could not be found. Oct 27 03:48:09.513531 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-acf25498-15b9-48e0-80c3-e995fdca2762 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Request method failure captured: Oct 27 03:48:09.513531 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/39d1b0a9-6838-4b40-b786-ea685404db46 HTTP/1.1 Oct 27 03:48:09.513531 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:48:09.513531 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:48:09.513531 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:48:09.513531 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:48:09.513531 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:48:09.513531 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:48:09.513531 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:48:09.513531 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:48:09.513531 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWf7ao454EXpcvqw57oZ6kUl55rrrabqqRcgdR7_bXGBd3EhUlwYyYuxAfl-nrBiMviq2ipmr2mbr4b0cgBTMbKDOZJ9TP7cenW0zaGDKmMe2aswh3Oogol3Ct9m8LHYZYqPWmhLSqvB2K7fCZP-q-SBCjWA9jL7HEZxBqgIhBaRnNcs Oct 27 03:48:09.513531 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:48:09.513531 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:48:09.513531 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:48:09.513531 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:48:09.513531 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:48:09.513531 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:48:09.513531 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 86b90d4cb5eb42958248b6f82516ce19 Oct 27 03:48:09.513531 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServersTestJSON-1724631621 Oct 27 03:48:09.513531 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:48:09.513531 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:48:09.513531 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86b90d4cb5eb42958248b6f82516ce19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/86b90d4cb5eb42958248b6f82516ce19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86b90d4cb5eb42958248b6f82516ce19"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_86b90d4cb5eb42958248b6f82516ce19"}]}] Oct 27 03:48:09.513531 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServersTestJSON-1724631621 Oct 27 03:48:09.513531 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 86b90d4cb5eb42958248b6f82516ce19 Oct 27 03:48:09.513531 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServersTestJSON-1724631621 Oct 27 03:48:09.513531 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServersTestJSON-1724631621-project Oct 27 03:48:09.513531 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:48:09.513531 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:48:09.513531 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: ca2da57f02884a968d685b53a5399e46 Oct 27 03:48:09.513531 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServersTestJSON-1724631621-project Oct 27 03:48:09.513531 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:48:09.513531 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 39d1b0a9-6838-4b40-b786-ea685404db46 could not be found. Oct 27 03:48:09.513531 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '39d1b0a9-6838-4b40-b786-ea685404db46'} Oct 27 03:48:09.513531 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:48:09.513531 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:48:09.513531 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:48:09.513531 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:48:09.513531 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:48:09.513531 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:48:09.513531 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:48:09.513531 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:48:09.513531 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:48:09.513531 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:48:09.513531 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39d1b0a9-6838-4b40-b786-ea685404db46 could not be found. Oct 27 03:48:09.513531 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:48:09.513531 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:48:09.513531 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:48:09.513531 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:48:09.513531 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:48:09.513531 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:48:09.513531 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:48:09.513531 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:48:09.513531 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:48:09.513531 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:48:09.513531 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:48:09.513531 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:48:09.513531 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:48:09.513531 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:48:09.513531 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:48:09.513531 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:48:09.513531 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39d1b0a9-6838-4b40-b786-ea685404db46 could not be found. Oct 27 03:48:09.513531 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:48:09.513531 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:48:09.513531 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:48:09.518254 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:48:09.518254 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:48:09.518254 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:48:09.518254 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:48:09.518254 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:48:09.518254 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39d1b0a9-6838-4b40-b786-ea685404db46 could not be found. Oct 27 03:48:09.518254 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:48:09.527016 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-acf25498-15b9-48e0-80c3-e995fdca2762 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Returning 404 to user: Instance 39d1b0a9-6838-4b40-b786-ea685404db46 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:48:09.527016 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-acf25498-15b9-48e0-80c3-e995fdca2762 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/39d1b0a9-6838-4b40-b786-ea685404db46" status: 404 len: 111 microversion: 2.1 time: 0.051292 Oct 27 03:48:09.527016 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3126/5953] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:48:09 2022] GET /compute/v2.1/servers/39d1b0a9-6838-4b40-b786-ea685404db46 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 03:48:09.564567 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-1290c704-1b7f-474f-ada6-d1bd4e2dd540 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lazy-loading 'flavor' on Instance uuid fb92bc23-c330-4ca9-bc60-ff90de604199 {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:48:09.584487 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1290c704-1b7f-474f-ada6-d1bd4e2dd540 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] 10.222.0.20 "PUT /compute/v2.1/servers/fb92bc23-c330-4ca9-bc60-ff90de604199/tags/tempest-tag-108040504" status: 201 len: 0 microversion: 2.26 time: 0.267807 Oct 27 03:48:09.586827 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2828/5954] 10.222.0.20 () {62 vars in 1377 bytes} [Thu Oct 27 03:48:09 2022] PUT /compute/v2.1/servers/fb92bc23-c330-4ca9-bc60-ff90de604199/tags/tempest-tag-108040504 => generated 0 bytes in 274 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) Oct 27 03:48:09.599199 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2987767f-535c-4e63-8321-4408ddbdcc7f tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Calling method '.version_select at 0x7f7dd9dcc3a0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:09.613838 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2987767f-535c-4e63-8321-4408ddbdcc7f tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:09.615002 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2987767f-535c-4e63-8321-4408ddbdcc7f tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:09.615662 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2987767f-535c-4e63-8321-4408ddbdcc7f tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:09.616508 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2987767f-535c-4e63-8321-4408ddbdcc7f tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] [instance: fb92bc23-c330-4ca9-bc60-ff90de604199] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:09.626737 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2987767f-535c-4e63-8321-4408ddbdcc7f tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:09.627456 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2987767f-535c-4e63-8321-4408ddbdcc7f tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:09.628115 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2987767f-535c-4e63-8321-4408ddbdcc7f tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:09.629075 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2987767f-535c-4e63-8321-4408ddbdcc7f tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:09.629750 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2987767f-535c-4e63-8321-4408ddbdcc7f tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:09.630785 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2987767f-535c-4e63-8321-4408ddbdcc7f tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:09.681716 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2987767f-535c-4e63-8321-4408ddbdcc7f tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:09.682735 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2987767f-535c-4e63-8321-4408ddbdcc7f tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:09.683978 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2987767f-535c-4e63-8321-4408ddbdcc7f tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:09.704457 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2987767f-535c-4e63-8321-4408ddbdcc7f tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:09.705300 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2987767f-535c-4e63-8321-4408ddbdcc7f tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:09.706410 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2987767f-535c-4e63-8321-4408ddbdcc7f tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:09.727762 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-850bacc4-45e7-45e2-a672-45859067893a tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-873008307", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": [{"uuid": "6ad05158-ac44-4c49-b5d6-443f42165c93"}]}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:48:09.821043 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-850bacc4-45e7-45e2-a672-45859067893a tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] validate_networks() for [('6ad05158-ac44-4c49-b5d6-443f42165c93', None, None, None, None, None)] {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:48:09.886572 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-2987767f-535c-4e63-8321-4408ddbdcc7f tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lazy-loading 'flavor' on Instance uuid fb92bc23-c330-4ca9-bc60-ff90de604199 {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:48:09.928078 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2987767f-535c-4e63-8321-4408ddbdcc7f tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] 10.222.0.20 "PUT /compute/v2.1/servers/fb92bc23-c330-4ca9-bc60-ff90de604199/tags/tempest-tag-52975233" status: 201 len: 0 microversion: 2.26 time: 0.334388 Oct 27 03:48:09.932137 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3127/5955] 10.222.0.20 () {62 vars in 1374 bytes} [Thu Oct 27 03:48:09 2022] PUT /compute/v2.1/servers/fb92bc23-c330-4ca9-bc60-ff90de604199/tags/tempest-tag-52975233 => generated 0 bytes in 338 msecs (HTTP/1.1 201) 10 headers in 484 bytes (1 switches on core 0) Oct 27 03:48:09.958488 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-08ab26ee-5aa7-475c-b297-76fc3749ebf6 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Calling method '.version_select at 0x7f7dd9f91430>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:09.973741 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-08ab26ee-5aa7-475c-b297-76fc3749ebf6 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:09.978261 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-08ab26ee-5aa7-475c-b297-76fc3749ebf6 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:09.978885 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-08ab26ee-5aa7-475c-b297-76fc3749ebf6 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:09.979722 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-08ab26ee-5aa7-475c-b297-76fc3749ebf6 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] [instance: fb92bc23-c330-4ca9-bc60-ff90de604199] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:09.995091 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-08ab26ee-5aa7-475c-b297-76fc3749ebf6 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:09.996963 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-08ab26ee-5aa7-475c-b297-76fc3749ebf6 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:09.998174 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-08ab26ee-5aa7-475c-b297-76fc3749ebf6 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:09.999304 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-08ab26ee-5aa7-475c-b297-76fc3749ebf6 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:10.000566 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-08ab26ee-5aa7-475c-b297-76fc3749ebf6 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:10.002545 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-08ab26ee-5aa7-475c-b297-76fc3749ebf6 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:10.055959 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-08ab26ee-5aa7-475c-b297-76fc3749ebf6 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:10.056581 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-08ab26ee-5aa7-475c-b297-76fc3749ebf6 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:10.058804 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-08ab26ee-5aa7-475c-b297-76fc3749ebf6 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:10.208927 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-08ab26ee-5aa7-475c-b297-76fc3749ebf6 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lazy-loading 'flavor' on Instance uuid fb92bc23-c330-4ca9-bc60-ff90de604199 {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:48:10.241596 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-08ab26ee-5aa7-475c-b297-76fc3749ebf6 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] 10.222.0.20 "DELETE /compute/v2.1/servers/fb92bc23-c330-4ca9-bc60-ff90de604199/tags" status: 204 len: 0 microversion: 2.26 time: 0.297167 Oct 27 03:48:10.246259 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3128/5956] 10.222.0.20 () {60 vars in 1295 bytes} [Thu Oct 27 03:48:09 2022] DELETE /compute/v2.1/servers/fb92bc23-c330-4ca9-bc60-ff90de604199/tags => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 03:48:10.250069 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6d52044f-8519-4fe2-9f0a-87a9845cfc8c tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:10.250895 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-6d52044f-8519-4fe2-9f0a-87a9845cfc8c tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] [instance: aaea6df3-ebe9-4a81-a8ec-e6bf9339283a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:10.258310 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6d52044f-8519-4fe2-9f0a-87a9845cfc8c tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:10.258934 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6d52044f-8519-4fe2-9f0a-87a9845cfc8c tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:10.259442 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6d52044f-8519-4fe2-9f0a-87a9845cfc8c tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:10.260376 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6d52044f-8519-4fe2-9f0a-87a9845cfc8c tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:10.260951 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6d52044f-8519-4fe2-9f0a-87a9845cfc8c tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:10.261491 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6d52044f-8519-4fe2-9f0a-87a9845cfc8c tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:10.389721 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6d52044f-8519-4fe2-9f0a-87a9845cfc8c tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:10.389721 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6d52044f-8519-4fe2-9f0a-87a9845cfc8c tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:10.389721 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6d52044f-8519-4fe2-9f0a-87a9845cfc8c tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:10.389721 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6d52044f-8519-4fe2-9f0a-87a9845cfc8c tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] 10.222.0.20 "GET /compute/v2.1/servers/aaea6df3-ebe9-4a81-a8ec-e6bf9339283a" status: 200 len: 1408 microversion: 2.54 time: 0.142891 Oct 27 03:48:10.389721 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3129/5957] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:48:10 2022] GET /compute/v2.1/servers/aaea6df3-ebe9-4a81-a8ec-e6bf9339283a => generated 1408 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:48:10.412302 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a9bb5b85-1e6f-4568-ba9c-b8981fd2d3b6 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Calling method '.version_select at 0x7f7dd9694d30>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:10.422634 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a9bb5b85-1e6f-4568-ba9c-b8981fd2d3b6 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:10.423334 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a9bb5b85-1e6f-4568-ba9c-b8981fd2d3b6 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:10.423999 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a9bb5b85-1e6f-4568-ba9c-b8981fd2d3b6 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:10.434563 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a9bb5b85-1e6f-4568-ba9c-b8981fd2d3b6 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] 10.222.0.20 "GET /compute/v2.1/servers/fb92bc23-c330-4ca9-bc60-ff90de604199/tags" status: 200 len: 12 microversion: 2.26 time: 0.045002 Oct 27 03:48:10.435533 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3130/5958] 10.222.0.20 () {60 vars in 1292 bytes} [Thu Oct 27 03:48:10 2022] GET /compute/v2.1/servers/fb92bc23-c330-4ca9-bc60-ff90de604199/tags => generated 12 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:48:10.446894 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-203f8ba7-4d35-411d-ba27-1a7609493afa tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Calling method '.version_select at 0x7f7dda466040>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:10.459337 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-203f8ba7-4d35-411d-ba27-1a7609493afa tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:10.460111 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-203f8ba7-4d35-411d-ba27-1a7609493afa tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:10.466604 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-203f8ba7-4d35-411d-ba27-1a7609493afa tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:10.466604 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-203f8ba7-4d35-411d-ba27-1a7609493afa tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] [instance: fb92bc23-c330-4ca9-bc60-ff90de604199] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:10.470644 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-203f8ba7-4d35-411d-ba27-1a7609493afa tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:10.471263 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-203f8ba7-4d35-411d-ba27-1a7609493afa tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:10.473084 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-203f8ba7-4d35-411d-ba27-1a7609493afa tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:10.473084 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-203f8ba7-4d35-411d-ba27-1a7609493afa tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:10.473084 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-203f8ba7-4d35-411d-ba27-1a7609493afa tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:10.474287 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-203f8ba7-4d35-411d-ba27-1a7609493afa tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:10.506087 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-203f8ba7-4d35-411d-ba27-1a7609493afa tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:10.506874 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-203f8ba7-4d35-411d-ba27-1a7609493afa tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:10.509196 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-203f8ba7-4d35-411d-ba27-1a7609493afa tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:10.529074 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-203f8ba7-4d35-411d-ba27-1a7609493afa tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lazy-loading 'flavor' on Instance uuid fb92bc23-c330-4ca9-bc60-ff90de604199 {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:48:10.552957 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-203f8ba7-4d35-411d-ba27-1a7609493afa tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] 10.222.0.20 "DELETE /compute/v2.1/servers/fb92bc23-c330-4ca9-bc60-ff90de604199/tags" status: 204 len: 0 microversion: 2.26 time: 0.110684 Oct 27 03:48:10.553591 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3131/5959] 10.222.0.20 () {60 vars in 1295 bytes} [Thu Oct 27 03:48:10 2022] DELETE /compute/v2.1/servers/fb92bc23-c330-4ca9-bc60-ff90de604199/tags => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 03:48:10.566856 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2671c660-5a85-43eb-8e6f-a2a28a7be797 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Calling method '.version_select at 0x7f7dd96944c0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:10.581369 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2671c660-5a85-43eb-8e6f-a2a28a7be797 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:10.582394 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2671c660-5a85-43eb-8e6f-a2a28a7be797 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:10.596078 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2671c660-5a85-43eb-8e6f-a2a28a7be797 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:10.598451 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2671c660-5a85-43eb-8e6f-a2a28a7be797 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] [instance: fb92bc23-c330-4ca9-bc60-ff90de604199] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:10.609102 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2671c660-5a85-43eb-8e6f-a2a28a7be797 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:10.612574 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2671c660-5a85-43eb-8e6f-a2a28a7be797 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:10.613418 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2671c660-5a85-43eb-8e6f-a2a28a7be797 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:10.614320 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2671c660-5a85-43eb-8e6f-a2a28a7be797 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:10.615146 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2671c660-5a85-43eb-8e6f-a2a28a7be797 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:10.617773 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2671c660-5a85-43eb-8e6f-a2a28a7be797 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:10.667900 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2671c660-5a85-43eb-8e6f-a2a28a7be797 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:10.668375 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2671c660-5a85-43eb-8e6f-a2a28a7be797 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:10.669623 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2671c660-5a85-43eb-8e6f-a2a28a7be797 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:10.694689 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2671c660-5a85-43eb-8e6f-a2a28a7be797 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:10.695427 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2671c660-5a85-43eb-8e6f-a2a28a7be797 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:10.696521 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2671c660-5a85-43eb-8e6f-a2a28a7be797 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:10.774077 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-850bacc4-45e7-45e2-a672-45859067893a tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:48:10.774701 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-850bacc4-45e7-45e2-a672-45859067893a tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:48:10.774957 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-850bacc4-45e7-45e2-a672-45859067893a tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:48:10.775794 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-850bacc4-45e7-45e2-a672-45859067893a tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:48:10.776238 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-850bacc4-45e7-45e2-a672-45859067893a tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:48:10.789826 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-850bacc4-45e7-45e2-a672-45859067893a tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:10.790289 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-850bacc4-45e7-45e2-a672-45859067893a tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:10.790975 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-850bacc4-45e7-45e2-a672-45859067893a tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:10.791963 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-850bacc4-45e7-45e2-a672-45859067893a tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:10.792676 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-850bacc4-45e7-45e2-a672-45859067893a tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:10.793376 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-850bacc4-45e7-45e2-a672-45859067893a tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:10.814764 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-850bacc4-45e7-45e2-a672-45859067893a tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Getting quotas for project 86b90d4cb5eb42958248b6f82516ce19. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:48:10.820204 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-850bacc4-45e7-45e2-a672-45859067893a tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Getting quotas for user ca2da57f02884a968d685b53a5399e46 and project 86b90d4cb5eb42958248b6f82516ce19. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:48:10.833628 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-850bacc4-45e7-45e2-a672-45859067893a tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:48:10.836367 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-850bacc4-45e7-45e2-a672-45859067893a tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: f86189b0-f42f-4224-8d7a-07676ff60e22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:48:10.889447 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-2671c660-5a85-43eb-8e6f-a2a28a7be797 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lazy-loading 'flavor' on Instance uuid fb92bc23-c330-4ca9-bc60-ff90de604199 {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:48:10.912111 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2671c660-5a85-43eb-8e6f-a2a28a7be797 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] 10.222.0.20 "PUT /compute/v2.1/servers/fb92bc23-c330-4ca9-bc60-ff90de604199/tags/tempest-tag-782718983" status: 201 len: 0 microversion: 2.26 time: 0.346879 Oct 27 03:48:10.912111 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3132/5960] 10.222.0.20 () {62 vars in 1377 bytes} [Thu Oct 27 03:48:10 2022] PUT /compute/v2.1/servers/fb92bc23-c330-4ca9-bc60-ff90de604199/tags/tempest-tag-782718983 => generated 0 bytes in 349 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) Oct 27 03:48:10.921553 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-44d81ad5-d435-4009-a6b6-f33c29fada91 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Calling method '.version_select at 0x7f7dd9b98160>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:10.938855 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-44d81ad5-d435-4009-a6b6-f33c29fada91 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:10.939358 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-44d81ad5-d435-4009-a6b6-f33c29fada91 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:10.939802 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-44d81ad5-d435-4009-a6b6-f33c29fada91 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:10.940782 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-44d81ad5-d435-4009-a6b6-f33c29fada91 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] [instance: fb92bc23-c330-4ca9-bc60-ff90de604199] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:10.947105 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-44d81ad5-d435-4009-a6b6-f33c29fada91 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:10.947713 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-44d81ad5-d435-4009-a6b6-f33c29fada91 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:10.948276 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-44d81ad5-d435-4009-a6b6-f33c29fada91 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:10.949048 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-44d81ad5-d435-4009-a6b6-f33c29fada91 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:10.949663 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-44d81ad5-d435-4009-a6b6-f33c29fada91 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:10.950871 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-44d81ad5-d435-4009-a6b6-f33c29fada91 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:10.992248 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-44d81ad5-d435-4009-a6b6-f33c29fada91 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:10.992826 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-44d81ad5-d435-4009-a6b6-f33c29fada91 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:10.993375 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-44d81ad5-d435-4009-a6b6-f33c29fada91 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:11.008317 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-44d81ad5-d435-4009-a6b6-f33c29fada91 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:11.008317 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-44d81ad5-d435-4009-a6b6-f33c29fada91 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:11.008317 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-44d81ad5-d435-4009-a6b6-f33c29fada91 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:11.097780 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-850bacc4-45e7-45e2-a672-45859067893a tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.376450 Oct 27 03:48:11.106454 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2829/5961] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:48:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1386 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 03:48:11.124318 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-21a79d6d-a434-4be5-8531-ad8c6f612c91 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:11.125139 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-21a79d6d-a434-4be5-8531-ad8c6f612c91 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: f86189b0-f42f-4224-8d7a-07676ff60e22] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:11.178100 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-44d81ad5-d435-4009-a6b6-f33c29fada91 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lazy-loading 'flavor' on Instance uuid fb92bc23-c330-4ca9-bc60-ff90de604199 {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:48:11.299937 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-44d81ad5-d435-4009-a6b6-f33c29fada91 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] 10.222.0.20 "PUT /compute/v2.1/servers/fb92bc23-c330-4ca9-bc60-ff90de604199/tags/tempest-tag-1659968436" status: 201 len: 0 microversion: 2.26 time: 0.380799 Oct 27 03:48:11.302971 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3133/5962] 10.222.0.20 () {62 vars in 1380 bytes} [Thu Oct 27 03:48:10 2022] PUT /compute/v2.1/servers/fb92bc23-c330-4ca9-bc60-ff90de604199/tags/tempest-tag-1659968436 => generated 0 bytes in 387 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 27 03:48:11.324837 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c34c3fc9-dfe1-4b22-8c6a-a8094d07671a tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Action: 'update_all', calling method: .version_select at 0x7f7dd9b98f70>, body: {"tags": ["tempest-tag-1019181380", "tempest-tag-662438002"]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:48:11.361550 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c34c3fc9-dfe1-4b22-8c6a-a8094d07671a tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:11.362378 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c34c3fc9-dfe1-4b22-8c6a-a8094d07671a tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:11.362931 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c34c3fc9-dfe1-4b22-8c6a-a8094d07671a tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:11.363660 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c34c3fc9-dfe1-4b22-8c6a-a8094d07671a tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] [instance: fb92bc23-c330-4ca9-bc60-ff90de604199] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:11.370435 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c34c3fc9-dfe1-4b22-8c6a-a8094d07671a tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:11.371513 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c34c3fc9-dfe1-4b22-8c6a-a8094d07671a tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:11.373860 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c34c3fc9-dfe1-4b22-8c6a-a8094d07671a tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:11.375606 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c34c3fc9-dfe1-4b22-8c6a-a8094d07671a tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:11.376262 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c34c3fc9-dfe1-4b22-8c6a-a8094d07671a tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:11.378638 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c34c3fc9-dfe1-4b22-8c6a-a8094d07671a tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:11.426630 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c34c3fc9-dfe1-4b22-8c6a-a8094d07671a tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:11.427131 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c34c3fc9-dfe1-4b22-8c6a-a8094d07671a tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:11.427759 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c34c3fc9-dfe1-4b22-8c6a-a8094d07671a tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:11.438730 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-21a79d6d-a434-4be5-8531-ad8c6f612c91 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:11.447923 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-21a79d6d-a434-4be5-8531-ad8c6f612c91 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/f86189b0-f42f-4224-8d7a-07676ff60e22" status: 200 len: 1208 microversion: 2.1 time: 0.330307 Oct 27 03:48:11.448516 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2830/5963] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:48:11 2022] GET /compute/v2.1/servers/f86189b0-f42f-4224-8d7a-07676ff60e22 => generated 1208 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:48:11.454180 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c7e84ed9-eb97-4395-8404-5db1bff01fdc tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:11.454789 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c7e84ed9-eb97-4395-8404-5db1bff01fdc tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] [instance: aaea6df3-ebe9-4a81-a8ec-e6bf9339283a] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:11.460821 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c7e84ed9-eb97-4395-8404-5db1bff01fdc tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:11.461296 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c7e84ed9-eb97-4395-8404-5db1bff01fdc tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:11.461735 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c7e84ed9-eb97-4395-8404-5db1bff01fdc tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:11.462470 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c7e84ed9-eb97-4395-8404-5db1bff01fdc tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:11.462928 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c7e84ed9-eb97-4395-8404-5db1bff01fdc tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:11.463349 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c7e84ed9-eb97-4395-8404-5db1bff01fdc tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:11.546875 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c7e84ed9-eb97-4395-8404-5db1bff01fdc tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:11.558393 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-c34c3fc9-dfe1-4b22-8c6a-a8094d07671a tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lazy-loading 'flavor' on Instance uuid fb92bc23-c330-4ca9-bc60-ff90de604199 {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:48:11.565294 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c7e84ed9-eb97-4395-8404-5db1bff01fdc tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:11.567216 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c7e84ed9-eb97-4395-8404-5db1bff01fdc tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:11.569497 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c7e84ed9-eb97-4395-8404-5db1bff01fdc tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] 10.222.0.20 "GET /compute/v2.1/servers/aaea6df3-ebe9-4a81-a8ec-e6bf9339283a" status: 200 len: 1408 microversion: 2.54 time: 0.119931 Oct 27 03:48:11.584135 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2831/5964] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:48:11 2022] GET /compute/v2.1/servers/aaea6df3-ebe9-4a81-a8ec-e6bf9339283a => generated 1408 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:48:11.615834 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c34c3fc9-dfe1-4b22-8c6a-a8094d07671a tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] 10.222.0.20 "PUT /compute/v2.1/servers/fb92bc23-c330-4ca9-bc60-ff90de604199/tags" status: 200 len: 61 microversion: 2.26 time: 0.304596 Oct 27 03:48:11.618531 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3134/5965] 10.222.0.20 () {62 vars in 1312 bytes} [Thu Oct 27 03:48:11 2022] PUT /compute/v2.1/servers/fb92bc23-c330-4ca9-bc60-ff90de604199/tags => generated 61 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:48:11.629106 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-548c69fa-553d-4c1f-abf2-55d255945f67 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Calling method '.version_select at 0x7f7dd9dc7dc0>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:11.639979 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-548c69fa-553d-4c1f-abf2-55d255945f67 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:11.643070 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-548c69fa-553d-4c1f-abf2-55d255945f67 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:11.643522 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-548c69fa-553d-4c1f-abf2-55d255945f67 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:11.673514 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-548c69fa-553d-4c1f-abf2-55d255945f67 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] 10.222.0.20 "GET /compute/v2.1/servers/fb92bc23-c330-4ca9-bc60-ff90de604199/tags" status: 200 len: 61 microversion: 2.26 time: 0.048644 Oct 27 03:48:11.683045 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2832/5966] 10.222.0.20 () {60 vars in 1292 bytes} [Thu Oct 27 03:48:11 2022] GET /compute/v2.1/servers/fb92bc23-c330-4ca9-bc60-ff90de604199/tags => generated 61 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:48:11.707790 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-873905ad-4ef0-4209-80a2-11ca4898fa20 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Calling method '.version_select at 0x7f7dd9e91940>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:11.716578 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-873905ad-4ef0-4209-80a2-11ca4898fa20 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:11.717477 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-873905ad-4ef0-4209-80a2-11ca4898fa20 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:11.718147 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-873905ad-4ef0-4209-80a2-11ca4898fa20 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:11.719005 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-873905ad-4ef0-4209-80a2-11ca4898fa20 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] [instance: fb92bc23-c330-4ca9-bc60-ff90de604199] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:11.729773 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-873905ad-4ef0-4209-80a2-11ca4898fa20 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:11.742339 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-873905ad-4ef0-4209-80a2-11ca4898fa20 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:11.742339 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-873905ad-4ef0-4209-80a2-11ca4898fa20 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:11.742339 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-873905ad-4ef0-4209-80a2-11ca4898fa20 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:11.742339 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-873905ad-4ef0-4209-80a2-11ca4898fa20 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:11.742339 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-873905ad-4ef0-4209-80a2-11ca4898fa20 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:11.772474 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-873905ad-4ef0-4209-80a2-11ca4898fa20 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:11.774080 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-873905ad-4ef0-4209-80a2-11ca4898fa20 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:11.774080 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-873905ad-4ef0-4209-80a2-11ca4898fa20 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:12.023887 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-873905ad-4ef0-4209-80a2-11ca4898fa20 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lazy-loading 'flavor' on Instance uuid fb92bc23-c330-4ca9-bc60-ff90de604199 {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:48:12.038894 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-873905ad-4ef0-4209-80a2-11ca4898fa20 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] 10.222.0.20 "DELETE /compute/v2.1/servers/fb92bc23-c330-4ca9-bc60-ff90de604199/tags" status: 204 len: 0 microversion: 2.26 time: 0.344073 Oct 27 03:48:12.039812 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3135/5967] 10.222.0.20 () {60 vars in 1295 bytes} [Thu Oct 27 03:48:11 2022] DELETE /compute/v2.1/servers/fb92bc23-c330-4ca9-bc60-ff90de604199/tags => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 03:48:12.049315 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-186deaad-2c96-4719-982f-41a89334044e tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:12.049830 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-186deaad-2c96-4719-982f-41a89334044e tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] [instance: fb92bc23-c330-4ca9-bc60-ff90de604199] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:12.057599 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-186deaad-2c96-4719-982f-41a89334044e tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:12.058383 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-186deaad-2c96-4719-982f-41a89334044e tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:12.058715 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-186deaad-2c96-4719-982f-41a89334044e tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:12.060095 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-186deaad-2c96-4719-982f-41a89334044e tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:12.060495 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-186deaad-2c96-4719-982f-41a89334044e tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:12.060930 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-186deaad-2c96-4719-982f-41a89334044e tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:12.092902 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-186deaad-2c96-4719-982f-41a89334044e tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] [instance: fb92bc23-c330-4ca9-bc60-ff90de604199] Going to try to terminate instance {{(pid=121000) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:48:12.476043 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4c95cadd-6059-4fea-adac-ebeaf4e952ef tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:12.477100 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4c95cadd-6059-4fea-adac-ebeaf4e952ef tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: f86189b0-f42f-4224-8d7a-07676ff60e22] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:12.514149 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-186deaad-2c96-4719-982f-41a89334044e tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] 10.222.0.20 "DELETE /compute/v2.1/servers/fb92bc23-c330-4ca9-bc60-ff90de604199" status: 204 len: 0 microversion: 2.26 time: 0.468589 Oct 27 03:48:12.514867 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2833/5968] 10.222.0.20 () {60 vars in 1280 bytes} [Thu Oct 27 03:48:12 2022] DELETE /compute/v2.1/servers/fb92bc23-c330-4ca9-bc60-ff90de604199 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 03:48:12.525321 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ac101b29-d805-4350-ad23-193539ae7edd tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:12.526439 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ac101b29-d805-4350-ad23-193539ae7edd tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] [instance: fb92bc23-c330-4ca9-bc60-ff90de604199] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:12.535703 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ac101b29-d805-4350-ad23-193539ae7edd tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:12.537601 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ac101b29-d805-4350-ad23-193539ae7edd tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:12.538586 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ac101b29-d805-4350-ad23-193539ae7edd tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:12.539569 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ac101b29-d805-4350-ad23-193539ae7edd tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:12.540371 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ac101b29-d805-4350-ad23-193539ae7edd tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:12.541010 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ac101b29-d805-4350-ad23-193539ae7edd tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:12.544706 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4c95cadd-6059-4fea-adac-ebeaf4e952ef tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:12.559246 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4c95cadd-6059-4fea-adac-ebeaf4e952ef tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/f86189b0-f42f-4224-8d7a-07676ff60e22" status: 200 len: 1208 microversion: 2.1 time: 0.089394 Oct 27 03:48:12.561086 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3136/5969] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:48:12 2022] GET /compute/v2.1/servers/f86189b0-f42f-4224-8d7a-07676ff60e22 => generated 1208 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:48:12.599329 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1c198f83-7681-42ba-a13f-1d942fe6917f tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:12.600118 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1c198f83-7681-42ba-a13f-1d942fe6917f tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] [instance: aaea6df3-ebe9-4a81-a8ec-e6bf9339283a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:12.611390 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1c198f83-7681-42ba-a13f-1d942fe6917f tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:12.612146 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1c198f83-7681-42ba-a13f-1d942fe6917f tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:12.613100 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1c198f83-7681-42ba-a13f-1d942fe6917f tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:12.614066 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1c198f83-7681-42ba-a13f-1d942fe6917f tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:12.614821 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1c198f83-7681-42ba-a13f-1d942fe6917f tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:12.619241 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1c198f83-7681-42ba-a13f-1d942fe6917f tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:12.737352 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1c198f83-7681-42ba-a13f-1d942fe6917f tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:12.750564 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ac101b29-d805-4350-ad23-193539ae7edd tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d3c87c204946ffad3feb05bc6dfd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22265a03de2d478988f7a5ae2561e719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:12.751255 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1c198f83-7681-42ba-a13f-1d942fe6917f tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:12.759163 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ac101b29-d805-4350-ad23-193539ae7edd tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d3c87c204946ffad3feb05bc6dfd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22265a03de2d478988f7a5ae2561e719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:12.760642 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ac101b29-d805-4350-ad23-193539ae7edd tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d3c87c204946ffad3feb05bc6dfd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22265a03de2d478988f7a5ae2561e719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:12.761880 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ac101b29-d805-4350-ad23-193539ae7edd tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] 10.222.0.20 "GET /compute/v2.1/servers/fb92bc23-c330-4ca9-bc60-ff90de604199" status: 200 len: 1551 microversion: 2.26 time: 0.242621 Oct 27 03:48:12.762476 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2834/5970] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:48:12 2022] GET /compute/v2.1/servers/fb92bc23-c330-4ca9-bc60-ff90de604199 => generated 1551 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:48:12.779454 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1c198f83-7681-42ba-a13f-1d942fe6917f tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:12.786653 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1c198f83-7681-42ba-a13f-1d942fe6917f tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] 10.222.0.20 "GET /compute/v2.1/servers/aaea6df3-ebe9-4a81-a8ec-e6bf9339283a" status: 200 len: 1408 microversion: 2.54 time: 0.192198 Oct 27 03:48:12.794323 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3137/5971] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:48:12 2022] GET /compute/v2.1/servers/aaea6df3-ebe9-4a81-a8ec-e6bf9339283a => generated 1408 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:48:13.596726 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-974b431e-0ddf-4ca0-85e1-3f261e54ad91 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:13.599463 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-974b431e-0ddf-4ca0-85e1-3f261e54ad91 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: f86189b0-f42f-4224-8d7a-07676ff60e22] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:13.611472 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-974b431e-0ddf-4ca0-85e1-3f261e54ad91 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:13.612143 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-974b431e-0ddf-4ca0-85e1-3f261e54ad91 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:13.612943 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-974b431e-0ddf-4ca0-85e1-3f261e54ad91 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:13.613905 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-974b431e-0ddf-4ca0-85e1-3f261e54ad91 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:13.614691 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-974b431e-0ddf-4ca0-85e1-3f261e54ad91 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:13.615458 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-974b431e-0ddf-4ca0-85e1-3f261e54ad91 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:13.776726 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-974b431e-0ddf-4ca0-85e1-3f261e54ad91 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:13.792028 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-974b431e-0ddf-4ca0-85e1-3f261e54ad91 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/f86189b0-f42f-4224-8d7a-07676ff60e22" status: 200 len: 1260 microversion: 2.1 time: 0.202073 Oct 27 03:48:13.793115 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2835/5972] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:48:13 2022] GET /compute/v2.1/servers/f86189b0-f42f-4224-8d7a-07676ff60e22 => generated 1260 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:48:13.796387 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a2667f44-5946-4340-b08e-ef04d146c0dd tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:13.797631 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a2667f44-5946-4340-b08e-ef04d146c0dd tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] [instance: fb92bc23-c330-4ca9-bc60-ff90de604199] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:13.812427 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a2667f44-5946-4340-b08e-ef04d146c0dd tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:13.814261 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a2667f44-5946-4340-b08e-ef04d146c0dd tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:13.814261 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a2667f44-5946-4340-b08e-ef04d146c0dd tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:13.816159 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a2667f44-5946-4340-b08e-ef04d146c0dd tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:13.817470 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a2667f44-5946-4340-b08e-ef04d146c0dd tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:13.819299 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a2667f44-5946-4340-b08e-ef04d146c0dd tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:13.822848 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4e465b8f-62f2-4d77-8a59-910a36fe57f5 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:13.823603 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4e465b8f-62f2-4d77-8a59-910a36fe57f5 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] [instance: aaea6df3-ebe9-4a81-a8ec-e6bf9339283a] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:13.835500 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4e465b8f-62f2-4d77-8a59-910a36fe57f5 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:13.838470 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4e465b8f-62f2-4d77-8a59-910a36fe57f5 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:13.843045 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4e465b8f-62f2-4d77-8a59-910a36fe57f5 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:13.848169 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4e465b8f-62f2-4d77-8a59-910a36fe57f5 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:13.851433 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4e465b8f-62f2-4d77-8a59-910a36fe57f5 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:13.852013 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4e465b8f-62f2-4d77-8a59-910a36fe57f5 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:13.897775 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=2,nova_cell1:RELEASE=1,nova_cell1:UPDATE=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:48:14.086153 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4e465b8f-62f2-4d77-8a59-910a36fe57f5 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:14.106457 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4e465b8f-62f2-4d77-8a59-910a36fe57f5 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:14.112148 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4e465b8f-62f2-4d77-8a59-910a36fe57f5 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:14.115327 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4e465b8f-62f2-4d77-8a59-910a36fe57f5 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] 10.222.0.20 "GET /compute/v2.1/servers/aaea6df3-ebe9-4a81-a8ec-e6bf9339283a" status: 200 len: 1408 microversion: 2.54 time: 0.295839 Oct 27 03:48:14.119297 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2836/5973] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:48:13 2022] GET /compute/v2.1/servers/aaea6df3-ebe9-4a81-a8ec-e6bf9339283a => generated 1408 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:48:14.289998 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a2667f44-5946-4340-b08e-ef04d146c0dd tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d3c87c204946ffad3feb05bc6dfd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22265a03de2d478988f7a5ae2561e719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:14.306566 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a2667f44-5946-4340-b08e-ef04d146c0dd tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d3c87c204946ffad3feb05bc6dfd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22265a03de2d478988f7a5ae2561e719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:14.310509 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a2667f44-5946-4340-b08e-ef04d146c0dd tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d3c87c204946ffad3feb05bc6dfd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22265a03de2d478988f7a5ae2561e719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:14.317642 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a2667f44-5946-4340-b08e-ef04d146c0dd tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] 10.222.0.20 "GET /compute/v2.1/servers/fb92bc23-c330-4ca9-bc60-ff90de604199" status: 200 len: 1551 microversion: 2.26 time: 0.524158 Oct 27 03:48:14.317642 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3138/5974] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:48:13 2022] GET /compute/v2.1/servers/fb92bc23-c330-4ca9-bc60-ff90de604199 => generated 1551 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:48:14.822902 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c8d7fb00-f1e6-4cd9-9ce0-ca56ea1c5397 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:14.824275 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c8d7fb00-f1e6-4cd9-9ce0-ca56ea1c5397 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: f86189b0-f42f-4224-8d7a-07676ff60e22] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:14.845201 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c8d7fb00-f1e6-4cd9-9ce0-ca56ea1c5397 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:14.846132 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c8d7fb00-f1e6-4cd9-9ce0-ca56ea1c5397 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:14.846789 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c8d7fb00-f1e6-4cd9-9ce0-ca56ea1c5397 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:14.847734 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c8d7fb00-f1e6-4cd9-9ce0-ca56ea1c5397 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:14.848406 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c8d7fb00-f1e6-4cd9-9ce0-ca56ea1c5397 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:14.849043 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c8d7fb00-f1e6-4cd9-9ce0-ca56ea1c5397 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:15.126187 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c8d7fb00-f1e6-4cd9-9ce0-ca56ea1c5397 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:15.135443 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c8d7fb00-f1e6-4cd9-9ce0-ca56ea1c5397 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/f86189b0-f42f-4224-8d7a-07676ff60e22" status: 200 len: 1268 microversion: 2.1 time: 0.316902 Oct 27 03:48:15.154152 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2837/5975] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:48:14 2022] GET /compute/v2.1/servers/f86189b0-f42f-4224-8d7a-07676ff60e22 => generated 1268 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:48:15.154512 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-cfeba0c3-6102-4d24-ad85-e31983297b26 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:15.154512 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-cfeba0c3-6102-4d24-ad85-e31983297b26 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] [instance: aaea6df3-ebe9-4a81-a8ec-e6bf9339283a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:15.161708 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cfeba0c3-6102-4d24-ad85-e31983297b26 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:15.161708 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cfeba0c3-6102-4d24-ad85-e31983297b26 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:15.161708 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cfeba0c3-6102-4d24-ad85-e31983297b26 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:15.162075 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-7caefe95-8b5d-4aea-97ce-8e150be417e6 req-e490ff09-7395-46c8-ae35-9523ed73664d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb92bc23-c330-4ca9-bc60-ff90de604199", "name": "network-vif-deleted", "tag": "9171b3d1-838c-49e8-9ac0-7ce8d2718e52"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:48:15.163870 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cfeba0c3-6102-4d24-ad85-e31983297b26 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:15.163870 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cfeba0c3-6102-4d24-ad85-e31983297b26 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:15.180224 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-7caefe95-8b5d-4aea-97ce-8e150be417e6 req-e490ff09-7395-46c8-ae35-9523ed73664d service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:15.185015 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cfeba0c3-6102-4d24-ad85-e31983297b26 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:15.185156 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-7caefe95-8b5d-4aea-97ce-8e150be417e6 req-e490ff09-7395-46c8-ae35-9523ed73664d service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:15.185156 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-7caefe95-8b5d-4aea-97ce-8e150be417e6 req-e490ff09-7395-46c8-ae35-9523ed73664d service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:15.212199 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-7caefe95-8b5d-4aea-97ce-8e150be417e6 req-e490ff09-7395-46c8-ae35-9523ed73664d service nova] Creating event network-vif-deleted:9171b3d1-838c-49e8-9ac0-7ce8d2718e52 for instance fb92bc23-c330-4ca9-bc60-ff90de604199 on n-h2-862769-1 Oct 27 03:48:15.223126 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-7caefe95-8b5d-4aea-97ce-8e150be417e6 req-e490ff09-7395-46c8-ae35-9523ed73664d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065848 Oct 27 03:48:15.227433 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2838/5976] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:48:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:48:15.319087 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-cfeba0c3-6102-4d24-ad85-e31983297b26 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:15.347806 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-476a6a1d-fa05-428f-abcf-745308d30140 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:15.348670 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-476a6a1d-fa05-428f-abcf-745308d30140 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] [instance: fb92bc23-c330-4ca9-bc60-ff90de604199] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:15.361366 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-476a6a1d-fa05-428f-abcf-745308d30140 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:15.375935 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-476a6a1d-fa05-428f-abcf-745308d30140 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:15.378445 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-476a6a1d-fa05-428f-abcf-745308d30140 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:15.380955 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-476a6a1d-fa05-428f-abcf-745308d30140 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:15.383529 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-476a6a1d-fa05-428f-abcf-745308d30140 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:15.384756 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-476a6a1d-fa05-428f-abcf-745308d30140 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:15.389832 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-cfeba0c3-6102-4d24-ad85-e31983297b26 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:15.403933 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-cfeba0c3-6102-4d24-ad85-e31983297b26 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:15.414165 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-cfeba0c3-6102-4d24-ad85-e31983297b26 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] 10.222.0.20 "GET /compute/v2.1/servers/aaea6df3-ebe9-4a81-a8ec-e6bf9339283a" status: 200 len: 1408 microversion: 2.54 time: 0.270101 Oct 27 03:48:15.423811 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3139/5977] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:48:15 2022] GET /compute/v2.1/servers/aaea6df3-ebe9-4a81-a8ec-e6bf9339283a => generated 1408 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:48:15.651132 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-476a6a1d-fa05-428f-abcf-745308d30140 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d3c87c204946ffad3feb05bc6dfd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22265a03de2d478988f7a5ae2561e719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:15.686115 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-476a6a1d-fa05-428f-abcf-745308d30140 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d3c87c204946ffad3feb05bc6dfd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22265a03de2d478988f7a5ae2561e719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:15.688120 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-476a6a1d-fa05-428f-abcf-745308d30140 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d3c87c204946ffad3feb05bc6dfd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22265a03de2d478988f7a5ae2561e719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:15.690312 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-476a6a1d-fa05-428f-abcf-745308d30140 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] 10.222.0.20 "GET /compute/v2.1/servers/fb92bc23-c330-4ca9-bc60-ff90de604199" status: 200 len: 1346 microversion: 2.26 time: 0.347365 Oct 27 03:48:15.691446 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2839/5978] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:48:15 2022] GET /compute/v2.1/servers/fb92bc23-c330-4ca9-bc60-ff90de604199 => generated 1346 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:48:16.172587 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-984fdc70-d98c-4f72-b684-cbfd205ac5d7 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:16.177637 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-984fdc70-d98c-4f72-b684-cbfd205ac5d7 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: f86189b0-f42f-4224-8d7a-07676ff60e22] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:16.182283 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-984fdc70-d98c-4f72-b684-cbfd205ac5d7 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:16.183040 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-984fdc70-d98c-4f72-b684-cbfd205ac5d7 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:16.183622 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-984fdc70-d98c-4f72-b684-cbfd205ac5d7 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:16.185227 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-984fdc70-d98c-4f72-b684-cbfd205ac5d7 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:16.185853 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-984fdc70-d98c-4f72-b684-cbfd205ac5d7 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:16.186515 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-984fdc70-d98c-4f72-b684-cbfd205ac5d7 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:16.458989 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5183258a-d442-4635-abe6-2545e9041ca3 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:16.459619 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5183258a-d442-4635-abe6-2545e9041ca3 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] [instance: aaea6df3-ebe9-4a81-a8ec-e6bf9339283a] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:16.488821 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5183258a-d442-4635-abe6-2545e9041ca3 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:16.489241 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5183258a-d442-4635-abe6-2545e9041ca3 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:16.489691 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5183258a-d442-4635-abe6-2545e9041ca3 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:16.498827 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5183258a-d442-4635-abe6-2545e9041ca3 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:16.500250 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5183258a-d442-4635-abe6-2545e9041ca3 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:16.504437 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5183258a-d442-4635-abe6-2545e9041ca3 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:16.664727 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5183258a-d442-4635-abe6-2545e9041ca3 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:16.674973 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5183258a-d442-4635-abe6-2545e9041ca3 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:16.685141 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5183258a-d442-4635-abe6-2545e9041ca3 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:16.686871 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5183258a-d442-4635-abe6-2545e9041ca3 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] 10.222.0.20 "GET /compute/v2.1/servers/aaea6df3-ebe9-4a81-a8ec-e6bf9339283a" status: 200 len: 1408 microversion: 2.54 time: 0.231816 Oct 27 03:48:16.690824 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2840/5979] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:48:16 2022] GET /compute/v2.1/servers/aaea6df3-ebe9-4a81-a8ec-e6bf9339283a => generated 1408 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:48:16.722602 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1e44fff9-b84e-4ba9-9a0f-bea571cc46d5 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:16.723586 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1e44fff9-b84e-4ba9-9a0f-bea571cc46d5 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] [instance: fb92bc23-c330-4ca9-bc60-ff90de604199] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:16.736131 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1e44fff9-b84e-4ba9-9a0f-bea571cc46d5 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:16.736980 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1e44fff9-b84e-4ba9-9a0f-bea571cc46d5 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:16.738430 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1e44fff9-b84e-4ba9-9a0f-bea571cc46d5 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:16.740939 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1e44fff9-b84e-4ba9-9a0f-bea571cc46d5 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:16.742319 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1e44fff9-b84e-4ba9-9a0f-bea571cc46d5 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:16.744760 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1e44fff9-b84e-4ba9-9a0f-bea571cc46d5 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:16.779154 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-1e44fff9-b84e-4ba9-9a0f-bea571cc46d5 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] HTTP exception thrown: Instance fb92bc23-c330-4ca9-bc60-ff90de604199 could not be found. Oct 27 03:48:16.783486 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1e44fff9-b84e-4ba9-9a0f-bea571cc46d5 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Request method failure captured: Oct 27 03:48:16.783486 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/fb92bc23-c330-4ca9-bc60-ff90de604199 HTTP/1.1 Oct 27 03:48:16.783486 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:48:16.783486 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:48:16.783486 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:48:16.783486 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:48:16.783486 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:48:16.783486 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:48:16.783486 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:48:16.783486 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:48:16.783486 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWf9mv4lTaHhCGVWvhk9nXBvXP1sS9xrarkjPERwj4svheLV7aJgSJnSOWRuVxzh1-obrmpLvNqIB8iD2Q57xP1QVCbMlA32IWcw0MVP0tjshZfuFoWAn1fsv3S-A19yigBiBw5dwgygnp34PC93rfrS00MzyGfZ3uzz44apcy_eimcQ Oct 27 03:48:16.783486 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:48:16.783486 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:48:16.783486 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:48:16.783486 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:48:16.783486 n-d-862769-1 devstack@n-api.service[121000]: X-Openstack-Nova-Api-Version: 2.26 Oct 27 03:48:16.783486 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:48:16.783486 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:48:16.783486 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 22265a03de2d478988f7a5ae2561e719 Oct 27 03:48:16.783486 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ServerTagsTestJSON-1312686032 Oct 27 03:48:16.783486 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:48:16.783486 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:48:16.783486 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/22265a03de2d478988f7a5ae2561e719"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/22265a03de2d478988f7a5ae2561e719"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/22265a03de2d478988f7a5ae2561e719"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_22265a03de2d478988f7a5ae2561e719"}]}] Oct 27 03:48:16.783486 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ServerTagsTestJSON-1312686032 Oct 27 03:48:16.783486 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 22265a03de2d478988f7a5ae2561e719 Oct 27 03:48:16.783486 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ServerTagsTestJSON-1312686032 Oct 27 03:48:16.783486 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ServerTagsTestJSON-1312686032-project Oct 27 03:48:16.783486 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:48:16.783486 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:48:16.783486 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 18d3c87c204946ffad3feb05bc6dfd53 Oct 27 03:48:16.783486 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ServerTagsTestJSON-1312686032-project Oct 27 03:48:16.783486 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:48:16.783486 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance fb92bc23-c330-4ca9-bc60-ff90de604199 could not be found. Oct 27 03:48:16.783486 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': 'fb92bc23-c330-4ca9-bc60-ff90de604199'} Oct 27 03:48:16.783486 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:48:16.783486 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:48:16.783486 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:48:16.783486 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:48:16.783486 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:48:16.783486 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:48:16.783486 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:48:16.783486 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:48:16.783486 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:48:16.783486 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:48:16.783486 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb92bc23-c330-4ca9-bc60-ff90de604199 could not be found. Oct 27 03:48:16.783486 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:48:16.783486 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:48:16.783486 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:48:16.783486 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:48:16.783486 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:48:16.783486 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:48:16.783486 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:48:16.783486 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:48:16.783486 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:48:16.783486 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:48:16.783486 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:48:16.783486 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:48:16.783486 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:48:16.783486 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:48:16.783486 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:48:16.783486 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:48:16.783486 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb92bc23-c330-4ca9-bc60-ff90de604199 could not be found. Oct 27 03:48:16.783486 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:48:16.783486 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:48:16.783486 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:48:16.786916 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:48:16.786916 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:48:16.786916 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:48:16.786916 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:48:16.786916 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:48:16.786916 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb92bc23-c330-4ca9-bc60-ff90de604199 could not be found. Oct 27 03:48:16.786916 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:48:16.786916 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1e44fff9-b84e-4ba9-9a0f-bea571cc46d5 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] Returning 404 to user: Instance fb92bc23-c330-4ca9-bc60-ff90de604199 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:48:16.787591 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1e44fff9-b84e-4ba9-9a0f-bea571cc46d5 tempest-ServerTagsTestJSON-1312686032 tempest-ServerTagsTestJSON-1312686032-project] 10.222.0.20 "GET /compute/v2.1/servers/fb92bc23-c330-4ca9-bc60-ff90de604199" status: 404 len: 111 microversion: 2.26 time: 0.069533 Oct 27 03:48:16.790322 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2841/5980] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:48:16 2022] GET /compute/v2.1/servers/fb92bc23-c330-4ca9-bc60-ff90de604199 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 03:48:16.848568 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-984fdc70-d98c-4f72-b684-cbfd205ac5d7 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:16.861418 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-984fdc70-d98c-4f72-b684-cbfd205ac5d7 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/f86189b0-f42f-4224-8d7a-07676ff60e22" status: 200 len: 1308 microversion: 2.1 time: 0.692980 Oct 27 03:48:16.863841 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3140/5981] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:48:16 2022] GET /compute/v2.1/servers/f86189b0-f42f-4224-8d7a-07676ff60e22 => generated 1308 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:48:17.720085 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ca7b71bf-1809-4f72-bc3e-ce5584bbbf42 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:17.721538 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ca7b71bf-1809-4f72-bc3e-ce5584bbbf42 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] [instance: aaea6df3-ebe9-4a81-a8ec-e6bf9339283a] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:17.736159 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ca7b71bf-1809-4f72-bc3e-ce5584bbbf42 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:17.736661 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ca7b71bf-1809-4f72-bc3e-ce5584bbbf42 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:17.741292 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ca7b71bf-1809-4f72-bc3e-ce5584bbbf42 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:17.741963 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ca7b71bf-1809-4f72-bc3e-ce5584bbbf42 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:17.742475 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ca7b71bf-1809-4f72-bc3e-ce5584bbbf42 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:17.742911 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ca7b71bf-1809-4f72-bc3e-ce5584bbbf42 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:17.899516 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-feab1076-2418-43c8-9e6e-29ff544426c4 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:17.901440 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-feab1076-2418-43c8-9e6e-29ff544426c4 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: f86189b0-f42f-4224-8d7a-07676ff60e22] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:17.915043 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-feab1076-2418-43c8-9e6e-29ff544426c4 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:17.915908 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-feab1076-2418-43c8-9e6e-29ff544426c4 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:17.916775 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-feab1076-2418-43c8-9e6e-29ff544426c4 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:17.917958 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-feab1076-2418-43c8-9e6e-29ff544426c4 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:17.919802 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-feab1076-2418-43c8-9e6e-29ff544426c4 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:17.921547 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-feab1076-2418-43c8-9e6e-29ff544426c4 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:18.077912 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ca7b71bf-1809-4f72-bc3e-ce5584bbbf42 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:18.091883 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ca7b71bf-1809-4f72-bc3e-ce5584bbbf42 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:18.094485 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ca7b71bf-1809-4f72-bc3e-ce5584bbbf42 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:18.096134 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ca7b71bf-1809-4f72-bc3e-ce5584bbbf42 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] 10.222.0.20 "GET /compute/v2.1/servers/aaea6df3-ebe9-4a81-a8ec-e6bf9339283a" status: 200 len: 1408 microversion: 2.54 time: 0.384019 Oct 27 03:48:18.098204 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2842/5982] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:48:17 2022] GET /compute/v2.1/servers/aaea6df3-ebe9-4a81-a8ec-e6bf9339283a => generated 1408 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:48:18.452914 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-feab1076-2418-43c8-9e6e-29ff544426c4 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:18.465005 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-feab1076-2418-43c8-9e6e-29ff544426c4 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/f86189b0-f42f-4224-8d7a-07676ff60e22" status: 200 len: 1308 microversion: 2.1 time: 0.575216 Oct 27 03:48:18.467466 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3141/5983] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:48:17 2022] GET /compute/v2.1/servers/f86189b0-f42f-4224-8d7a-07676ff60e22 => generated 1308 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:48:18.781697 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-2f420a59-89ab-472d-87b0-583d3c6bf9b1 req-d12214d7-c74b-4e7f-91a1-55ede089494a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f86189b0-f42f-4224-8d7a-07676ff60e22", "tag": "b704190e-8542-446d-985b-25682d8ab69a"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:48:18.813349 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-2f420a59-89ab-472d-87b0-583d3c6bf9b1 req-d12214d7-c74b-4e7f-91a1-55ede089494a service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:18.823186 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-2f420a59-89ab-472d-87b0-583d3c6bf9b1 req-d12214d7-c74b-4e7f-91a1-55ede089494a service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:18.828026 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-2f420a59-89ab-472d-87b0-583d3c6bf9b1 req-d12214d7-c74b-4e7f-91a1-55ede089494a service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:18.861408 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-2f420a59-89ab-472d-87b0-583d3c6bf9b1 req-d12214d7-c74b-4e7f-91a1-55ede089494a service nova] Creating event network-changed:b704190e-8542-446d-985b-25682d8ab69a for instance f86189b0-f42f-4224-8d7a-07676ff60e22 on n-h1-862769-1 Oct 27 03:48:18.868589 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-2f420a59-89ab-472d-87b0-583d3c6bf9b1 req-d12214d7-c74b-4e7f-91a1-55ede089494a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091328 Oct 27 03:48:18.873559 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2843/5984] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:48:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:48:19.124444 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0969b6ee-576c-4c0c-ba9b-92126bd746c7 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:19.125850 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0969b6ee-576c-4c0c-ba9b-92126bd746c7 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] [instance: aaea6df3-ebe9-4a81-a8ec-e6bf9339283a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:19.142943 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0969b6ee-576c-4c0c-ba9b-92126bd746c7 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:19.143654 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0969b6ee-576c-4c0c-ba9b-92126bd746c7 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:19.144268 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0969b6ee-576c-4c0c-ba9b-92126bd746c7 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:19.149990 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0969b6ee-576c-4c0c-ba9b-92126bd746c7 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:19.149990 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0969b6ee-576c-4c0c-ba9b-92126bd746c7 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:19.149990 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0969b6ee-576c-4c0c-ba9b-92126bd746c7 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:19.161829 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=86,nova_cell1:SAVEPOINT=3,nova_cell1:INSERT=4,nova_cell1:RELEASE=3,nova_cell1:DELETE=4 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:48:19.349503 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0969b6ee-576c-4c0c-ba9b-92126bd746c7 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:19.362161 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0969b6ee-576c-4c0c-ba9b-92126bd746c7 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:19.362161 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0969b6ee-576c-4c0c-ba9b-92126bd746c7 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:19.363110 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0969b6ee-576c-4c0c-ba9b-92126bd746c7 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] 10.222.0.20 "GET /compute/v2.1/servers/aaea6df3-ebe9-4a81-a8ec-e6bf9339283a" status: 200 len: 1408 microversion: 2.54 time: 0.244043 Oct 27 03:48:19.364134 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3142/5985] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:48:19 2022] GET /compute/v2.1/servers/aaea6df3-ebe9-4a81-a8ec-e6bf9339283a => generated 1408 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:48:19.490726 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d5729483-54d0-4c70-8f30-5869926e45c5 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:19.491347 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d5729483-54d0-4c70-8f30-5869926e45c5 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: f86189b0-f42f-4224-8d7a-07676ff60e22] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:19.505586 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d5729483-54d0-4c70-8f30-5869926e45c5 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:19.506181 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d5729483-54d0-4c70-8f30-5869926e45c5 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:19.507439 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d5729483-54d0-4c70-8f30-5869926e45c5 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:19.508986 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d5729483-54d0-4c70-8f30-5869926e45c5 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:19.510775 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d5729483-54d0-4c70-8f30-5869926e45c5 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:19.514698 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d5729483-54d0-4c70-8f30-5869926e45c5 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:20.385938 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d5729483-54d0-4c70-8f30-5869926e45c5 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:20.391661 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9f7c2c5f-bed1-4195-af2a-46d85213028e tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:20.392211 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-9f7c2c5f-bed1-4195-af2a-46d85213028e tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] [instance: aaea6df3-ebe9-4a81-a8ec-e6bf9339283a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:20.397546 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d5729483-54d0-4c70-8f30-5869926e45c5 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/f86189b0-f42f-4224-8d7a-07676ff60e22" status: 200 len: 1308 microversion: 2.1 time: 0.911395 Oct 27 03:48:20.398175 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2844/5986] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:48:19 2022] GET /compute/v2.1/servers/f86189b0-f42f-4224-8d7a-07676ff60e22 => generated 1308 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:48:20.418509 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9f7c2c5f-bed1-4195-af2a-46d85213028e tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:20.419602 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9f7c2c5f-bed1-4195-af2a-46d85213028e tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:20.420315 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9f7c2c5f-bed1-4195-af2a-46d85213028e tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:20.421044 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9f7c2c5f-bed1-4195-af2a-46d85213028e tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:20.421511 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9f7c2c5f-bed1-4195-af2a-46d85213028e tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:20.421948 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9f7c2c5f-bed1-4195-af2a-46d85213028e tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:20.548688 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9f7c2c5f-bed1-4195-af2a-46d85213028e tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:20.560184 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9f7c2c5f-bed1-4195-af2a-46d85213028e tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:20.561980 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9f7c2c5f-bed1-4195-af2a-46d85213028e tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:20.563721 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9f7c2c5f-bed1-4195-af2a-46d85213028e tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] 10.222.0.20 "GET /compute/v2.1/servers/aaea6df3-ebe9-4a81-a8ec-e6bf9339283a" status: 200 len: 1408 microversion: 2.54 time: 0.176624 Oct 27 03:48:20.565085 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3143/5987] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:48:20 2022] GET /compute/v2.1/servers/aaea6df3-ebe9-4a81-a8ec-e6bf9339283a => generated 1408 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:48:21.426768 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-be16fca8-c86f-4984-be34-1740544b356d tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:21.427391 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-be16fca8-c86f-4984-be34-1740544b356d tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: f86189b0-f42f-4224-8d7a-07676ff60e22] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:21.429689 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:48:21.450507 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-be16fca8-c86f-4984-be34-1740544b356d tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:21.451324 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-be16fca8-c86f-4984-be34-1740544b356d tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:21.452582 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-be16fca8-c86f-4984-be34-1740544b356d tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:21.457274 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-be16fca8-c86f-4984-be34-1740544b356d tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:21.462237 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-be16fca8-c86f-4984-be34-1740544b356d tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:21.462793 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-be16fca8-c86f-4984-be34-1740544b356d tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:21.601512 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d8f64c89-5866-4386-9813-a045f2db3647 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:21.602395 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d8f64c89-5866-4386-9813-a045f2db3647 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] [instance: aaea6df3-ebe9-4a81-a8ec-e6bf9339283a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:21.633176 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d8f64c89-5866-4386-9813-a045f2db3647 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:21.635649 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d8f64c89-5866-4386-9813-a045f2db3647 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:21.636270 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d8f64c89-5866-4386-9813-a045f2db3647 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:21.637126 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d8f64c89-5866-4386-9813-a045f2db3647 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:21.637501 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=8 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:48:21.647365 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d8f64c89-5866-4386-9813-a045f2db3647 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:21.648125 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d8f64c89-5866-4386-9813-a045f2db3647 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:21.878701 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d8f64c89-5866-4386-9813-a045f2db3647 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:21.902215 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d8f64c89-5866-4386-9813-a045f2db3647 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:21.908800 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d8f64c89-5866-4386-9813-a045f2db3647 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:21.910589 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d8f64c89-5866-4386-9813-a045f2db3647 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] 10.222.0.20 "GET /compute/v2.1/servers/aaea6df3-ebe9-4a81-a8ec-e6bf9339283a" status: 200 len: 1408 microversion: 2.54 time: 0.322987 Oct 27 03:48:21.918587 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3144/5988] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:48:21 2022] GET /compute/v2.1/servers/aaea6df3-ebe9-4a81-a8ec-e6bf9339283a => generated 1408 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:48:22.442175 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-be16fca8-c86f-4984-be34-1740544b356d tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:22.459589 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-be16fca8-c86f-4984-be34-1740544b356d tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/f86189b0-f42f-4224-8d7a-07676ff60e22" status: 200 len: 1308 microversion: 2.1 time: 1.038049 Oct 27 03:48:22.460582 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2845/5989] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:48:21 2022] GET /compute/v2.1/servers/f86189b0-f42f-4224-8d7a-07676ff60e22 => generated 1308 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:48:22.945695 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-cd2d6b5b-4174-41c5-97f9-d8e37e6b6bf5 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:22.946390 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-cd2d6b5b-4174-41c5-97f9-d8e37e6b6bf5 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] [instance: aaea6df3-ebe9-4a81-a8ec-e6bf9339283a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:22.949677 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=8 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:48:22.956830 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cd2d6b5b-4174-41c5-97f9-d8e37e6b6bf5 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:22.957336 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cd2d6b5b-4174-41c5-97f9-d8e37e6b6bf5 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:22.957779 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cd2d6b5b-4174-41c5-97f9-d8e37e6b6bf5 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:22.958617 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cd2d6b5b-4174-41c5-97f9-d8e37e6b6bf5 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:22.959077 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cd2d6b5b-4174-41c5-97f9-d8e37e6b6bf5 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:22.959511 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cd2d6b5b-4174-41c5-97f9-d8e37e6b6bf5 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:23.063478 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-cd2d6b5b-4174-41c5-97f9-d8e37e6b6bf5 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:23.073044 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-cd2d6b5b-4174-41c5-97f9-d8e37e6b6bf5 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:23.077258 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-cd2d6b5b-4174-41c5-97f9-d8e37e6b6bf5 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:23.079898 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-cd2d6b5b-4174-41c5-97f9-d8e37e6b6bf5 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] 10.222.0.20 "GET /compute/v2.1/servers/aaea6df3-ebe9-4a81-a8ec-e6bf9339283a" status: 200 len: 1408 microversion: 2.54 time: 0.136919 Oct 27 03:48:23.079898 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3145/5990] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:48:22 2022] GET /compute/v2.1/servers/aaea6df3-ebe9-4a81-a8ec-e6bf9339283a => generated 1408 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:48:23.489127 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-257650f2-cdff-4d7f-9fa7-da6a3b0d7b94 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:23.489867 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-257650f2-cdff-4d7f-9fa7-da6a3b0d7b94 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: f86189b0-f42f-4224-8d7a-07676ff60e22] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:23.506109 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-257650f2-cdff-4d7f-9fa7-da6a3b0d7b94 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:23.507439 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-257650f2-cdff-4d7f-9fa7-da6a3b0d7b94 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:23.507891 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-257650f2-cdff-4d7f-9fa7-da6a3b0d7b94 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:23.508628 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-257650f2-cdff-4d7f-9fa7-da6a3b0d7b94 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:23.509105 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-257650f2-cdff-4d7f-9fa7-da6a3b0d7b94 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:23.509577 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-257650f2-cdff-4d7f-9fa7-da6a3b0d7b94 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:24.109758 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-dab1c25c-df64-441d-87e2-8000772bad22 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:24.110448 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-dab1c25c-df64-441d-87e2-8000772bad22 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] [instance: aaea6df3-ebe9-4a81-a8ec-e6bf9339283a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:24.118915 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dab1c25c-df64-441d-87e2-8000772bad22 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:24.119419 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dab1c25c-df64-441d-87e2-8000772bad22 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:24.125501 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dab1c25c-df64-441d-87e2-8000772bad22 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:24.125501 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dab1c25c-df64-441d-87e2-8000772bad22 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:24.125501 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dab1c25c-df64-441d-87e2-8000772bad22 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:24.125501 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dab1c25c-df64-441d-87e2-8000772bad22 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:24.153071 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-257650f2-cdff-4d7f-9fa7-da6a3b0d7b94 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:24.171141 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-257650f2-cdff-4d7f-9fa7-da6a3b0d7b94 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/f86189b0-f42f-4224-8d7a-07676ff60e22" status: 200 len: 1308 microversion: 2.1 time: 0.686159 Oct 27 03:48:24.171741 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2846/5991] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:48:23 2022] GET /compute/v2.1/servers/f86189b0-f42f-4224-8d7a-07676ff60e22 => generated 1308 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:48:24.308100 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-dab1c25c-df64-441d-87e2-8000772bad22 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:24.317629 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-dab1c25c-df64-441d-87e2-8000772bad22 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:24.319463 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-dab1c25c-df64-441d-87e2-8000772bad22 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:24.320977 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-dab1c25c-df64-441d-87e2-8000772bad22 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] 10.222.0.20 "GET /compute/v2.1/servers/aaea6df3-ebe9-4a81-a8ec-e6bf9339283a" status: 200 len: 1408 microversion: 2.54 time: 0.216217 Oct 27 03:48:24.321734 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3146/5992] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:48:24 2022] GET /compute/v2.1/servers/aaea6df3-ebe9-4a81-a8ec-e6bf9339283a => generated 1408 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:48:25.196617 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-fef3826e-5b16-4ad0-95b7-b6f9af000e61 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:25.197235 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-fef3826e-5b16-4ad0-95b7-b6f9af000e61 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: f86189b0-f42f-4224-8d7a-07676ff60e22] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:25.212228 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fef3826e-5b16-4ad0-95b7-b6f9af000e61 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:25.212228 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fef3826e-5b16-4ad0-95b7-b6f9af000e61 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:25.212228 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fef3826e-5b16-4ad0-95b7-b6f9af000e61 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:25.212228 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fef3826e-5b16-4ad0-95b7-b6f9af000e61 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:25.212228 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fef3826e-5b16-4ad0-95b7-b6f9af000e61 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:25.222197 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fef3826e-5b16-4ad0-95b7-b6f9af000e61 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:25.330939 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-9d0888ae-db34-4762-ba0d-864b2ff67856 req-5a7eafb3-53e5-42b0-9887-c575faba6f20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f86189b0-f42f-4224-8d7a-07676ff60e22", "name": "network-vif-plugged", "status": "completed", "tag": "b704190e-8542-446d-985b-25682d8ab69a"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:48:25.354712 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-9d0888ae-db34-4762-ba0d-864b2ff67856 req-5a7eafb3-53e5-42b0-9887-c575faba6f20 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:25.355638 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-9d0888ae-db34-4762-ba0d-864b2ff67856 req-5a7eafb3-53e5-42b0-9887-c575faba6f20 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:25.356579 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-9d0888ae-db34-4762-ba0d-864b2ff67856 req-5a7eafb3-53e5-42b0-9887-c575faba6f20 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:25.379070 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-9d0888ae-db34-4762-ba0d-864b2ff67856 req-5a7eafb3-53e5-42b0-9887-c575faba6f20 service nova] Creating event network-vif-plugged:b704190e-8542-446d-985b-25682d8ab69a for instance f86189b0-f42f-4224-8d7a-07676ff60e22 on n-h1-862769-1 Oct 27 03:48:25.392666 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-9d0888ae-db34-4762-ba0d-864b2ff67856 req-5a7eafb3-53e5-42b0-9887-c575faba6f20 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064225 Oct 27 03:48:25.394201 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3147/5993] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:48:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:48:25.406288 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e4868e30-ae70-486b-9208-b96e1ac19e3d tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:25.408125 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e4868e30-ae70-486b-9208-b96e1ac19e3d tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] [instance: aaea6df3-ebe9-4a81-a8ec-e6bf9339283a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:25.418906 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e4868e30-ae70-486b-9208-b96e1ac19e3d tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:25.421932 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e4868e30-ae70-486b-9208-b96e1ac19e3d tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:25.423535 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e4868e30-ae70-486b-9208-b96e1ac19e3d tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:25.424682 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e4868e30-ae70-486b-9208-b96e1ac19e3d tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:25.426242 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e4868e30-ae70-486b-9208-b96e1ac19e3d tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:25.429371 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e4868e30-ae70-486b-9208-b96e1ac19e3d tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:25.532379 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-fef3826e-5b16-4ad0-95b7-b6f9af000e61 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:25.547168 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-fef3826e-5b16-4ad0-95b7-b6f9af000e61 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/f86189b0-f42f-4224-8d7a-07676ff60e22" status: 200 len: 1308 microversion: 2.1 time: 0.354238 Oct 27 03:48:25.549371 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2847/5994] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:48:25 2022] GET /compute/v2.1/servers/f86189b0-f42f-4224-8d7a-07676ff60e22 => generated 1308 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:48:25.656101 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e4868e30-ae70-486b-9208-b96e1ac19e3d tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:25.672865 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e4868e30-ae70-486b-9208-b96e1ac19e3d tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:25.674609 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e4868e30-ae70-486b-9208-b96e1ac19e3d tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:25.675563 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e4868e30-ae70-486b-9208-b96e1ac19e3d tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] 10.222.0.20 "GET /compute/v2.1/servers/aaea6df3-ebe9-4a81-a8ec-e6bf9339283a" status: 200 len: 1408 microversion: 2.54 time: 0.275989 Oct 27 03:48:25.676138 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3148/5995] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:48:25 2022] GET /compute/v2.1/servers/aaea6df3-ebe9-4a81-a8ec-e6bf9339283a => generated 1408 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:48:26.573826 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ef4480a3-db81-46b2-afb2-f80ff6314488 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:26.575269 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ef4480a3-db81-46b2-afb2-f80ff6314488 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: f86189b0-f42f-4224-8d7a-07676ff60e22] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:26.584673 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ef4480a3-db81-46b2-afb2-f80ff6314488 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:26.587020 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ef4480a3-db81-46b2-afb2-f80ff6314488 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:26.587876 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ef4480a3-db81-46b2-afb2-f80ff6314488 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:26.591549 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ef4480a3-db81-46b2-afb2-f80ff6314488 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:26.594741 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ef4480a3-db81-46b2-afb2-f80ff6314488 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:26.596455 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ef4480a3-db81-46b2-afb2-f80ff6314488 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:26.702272 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c31be51b-d77e-44ca-b343-0f1aa8b99275 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:26.702710 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c31be51b-d77e-44ca-b343-0f1aa8b99275 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] [instance: aaea6df3-ebe9-4a81-a8ec-e6bf9339283a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:26.706506 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:48:26.723687 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c31be51b-d77e-44ca-b343-0f1aa8b99275 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:26.724465 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c31be51b-d77e-44ca-b343-0f1aa8b99275 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:26.725164 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c31be51b-d77e-44ca-b343-0f1aa8b99275 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:26.726119 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c31be51b-d77e-44ca-b343-0f1aa8b99275 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:26.736848 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c31be51b-d77e-44ca-b343-0f1aa8b99275 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:26.736848 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c31be51b-d77e-44ca-b343-0f1aa8b99275 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:26.862374 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c31be51b-d77e-44ca-b343-0f1aa8b99275 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:26.872747 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c31be51b-d77e-44ca-b343-0f1aa8b99275 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:26.874656 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c31be51b-d77e-44ca-b343-0f1aa8b99275 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:26.875916 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c31be51b-d77e-44ca-b343-0f1aa8b99275 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] 10.222.0.20 "GET /compute/v2.1/servers/aaea6df3-ebe9-4a81-a8ec-e6bf9339283a" status: 200 len: 1408 microversion: 2.54 time: 0.178592 Oct 27 03:48:26.886075 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3149/5996] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:48:26 2022] GET /compute/v2.1/servers/aaea6df3-ebe9-4a81-a8ec-e6bf9339283a => generated 1408 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:48:26.903327 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ef4480a3-db81-46b2-afb2-f80ff6314488 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:26.911221 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ef4480a3-db81-46b2-afb2-f80ff6314488 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/f86189b0-f42f-4224-8d7a-07676ff60e22" status: 200 len: 1308 microversion: 2.1 time: 0.341126 Oct 27 03:48:26.926437 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2848/5997] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:48:26 2022] GET /compute/v2.1/servers/f86189b0-f42f-4224-8d7a-07676ff60e22 => generated 1308 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:48:27.901757 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2cb2e163-0592-415a-a7cd-fd1f701e1804 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:27.902402 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2cb2e163-0592-415a-a7cd-fd1f701e1804 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] [instance: aaea6df3-ebe9-4a81-a8ec-e6bf9339283a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:27.911513 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2cb2e163-0592-415a-a7cd-fd1f701e1804 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:27.917280 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2cb2e163-0592-415a-a7cd-fd1f701e1804 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:27.917280 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2cb2e163-0592-415a-a7cd-fd1f701e1804 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:27.917280 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2cb2e163-0592-415a-a7cd-fd1f701e1804 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:27.917280 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2cb2e163-0592-415a-a7cd-fd1f701e1804 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:27.917280 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2cb2e163-0592-415a-a7cd-fd1f701e1804 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:27.935033 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0d3e4a84-4369-4657-a63f-cbffe7e69f59 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:27.936251 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0d3e4a84-4369-4657-a63f-cbffe7e69f59 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: f86189b0-f42f-4224-8d7a-07676ff60e22] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:27.951625 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0d3e4a84-4369-4657-a63f-cbffe7e69f59 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:27.952490 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0d3e4a84-4369-4657-a63f-cbffe7e69f59 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:27.953129 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0d3e4a84-4369-4657-a63f-cbffe7e69f59 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:27.954460 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0d3e4a84-4369-4657-a63f-cbffe7e69f59 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:27.955144 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0d3e4a84-4369-4657-a63f-cbffe7e69f59 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:27.955792 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0d3e4a84-4369-4657-a63f-cbffe7e69f59 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:28.070829 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2cb2e163-0592-415a-a7cd-fd1f701e1804 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:28.079630 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2cb2e163-0592-415a-a7cd-fd1f701e1804 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:28.081072 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2cb2e163-0592-415a-a7cd-fd1f701e1804 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:28.095768 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2cb2e163-0592-415a-a7cd-fd1f701e1804 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] 10.222.0.20 "GET /compute/v2.1/servers/aaea6df3-ebe9-4a81-a8ec-e6bf9339283a" status: 200 len: 1408 microversion: 2.54 time: 0.184340 Oct 27 03:48:28.096564 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3150/5998] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:48:27 2022] GET /compute/v2.1/servers/aaea6df3-ebe9-4a81-a8ec-e6bf9339283a => generated 1408 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:48:28.301994 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0d3e4a84-4369-4657-a63f-cbffe7e69f59 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:28.312087 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0d3e4a84-4369-4657-a63f-cbffe7e69f59 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/f86189b0-f42f-4224-8d7a-07676ff60e22" status: 200 len: 1490 microversion: 2.1 time: 0.381253 Oct 27 03:48:28.312682 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2849/5999] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:48:27 2022] GET /compute/v2.1/servers/f86189b0-f42f-4224-8d7a-07676ff60e22 => generated 1490 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:48:28.335354 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2a79a764-fd43-4c03-9a11-de3bd6282062 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1383195041"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:48:28.337866 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2a79a764-fd43-4c03-9a11-de3bd6282062 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: f86189b0-f42f-4224-8d7a-07676ff60e22] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:28.344177 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2a79a764-fd43-4c03-9a11-de3bd6282062 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:28.344679 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2a79a764-fd43-4c03-9a11-de3bd6282062 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:28.345121 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2a79a764-fd43-4c03-9a11-de3bd6282062 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:28.345985 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2a79a764-fd43-4c03-9a11-de3bd6282062 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:28.346615 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2a79a764-fd43-4c03-9a11-de3bd6282062 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:28.347196 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2a79a764-fd43-4c03-9a11-de3bd6282062 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:28.518375 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2a79a764-fd43-4c03-9a11-de3bd6282062 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "PUT /compute/v2.1/servers/f86189b0-f42f-4224-8d7a-07676ff60e22" status: 200 len: 1076 microversion: 2.1 time: 0.187119 Oct 27 03:48:28.519420 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3151/6000] 10.222.0.20 () {60 vars in 1256 bytes} [Thu Oct 27 03:48:28 2022] PUT /compute/v2.1/servers/f86189b0-f42f-4224-8d7a-07676ff60e22 => generated 1076 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:48:28.542905 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e150203a-6f3c-4ee7-b0ca-9d4ff453fd64 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:28.546135 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e150203a-6f3c-4ee7-b0ca-9d4ff453fd64 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: f86189b0-f42f-4224-8d7a-07676ff60e22] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:28.601371 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e150203a-6f3c-4ee7-b0ca-9d4ff453fd64 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:28.607374 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e150203a-6f3c-4ee7-b0ca-9d4ff453fd64 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:28.607900 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e150203a-6f3c-4ee7-b0ca-9d4ff453fd64 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:28.610860 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e150203a-6f3c-4ee7-b0ca-9d4ff453fd64 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:28.613956 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e150203a-6f3c-4ee7-b0ca-9d4ff453fd64 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:28.614781 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e150203a-6f3c-4ee7-b0ca-9d4ff453fd64 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:28.954907 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e150203a-6f3c-4ee7-b0ca-9d4ff453fd64 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:28.963439 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e150203a-6f3c-4ee7-b0ca-9d4ff453fd64 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/f86189b0-f42f-4224-8d7a-07676ff60e22" status: 200 len: 1502 microversion: 2.1 time: 0.426647 Oct 27 03:48:28.964183 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2850/6001] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:48:28 2022] GET /compute/v2.1/servers/f86189b0-f42f-4224-8d7a-07676ff60e22 => generated 1502 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:48:28.987426 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-243495a3-386f-4893-b626-8b8fcfa0e3bd tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:28.988064 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-243495a3-386f-4893-b626-8b8fcfa0e3bd tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: f86189b0-f42f-4224-8d7a-07676ff60e22] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:28.995329 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-243495a3-386f-4893-b626-8b8fcfa0e3bd tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:28.995830 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-243495a3-386f-4893-b626-8b8fcfa0e3bd tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:28.996469 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-243495a3-386f-4893-b626-8b8fcfa0e3bd tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:28.997928 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-243495a3-386f-4893-b626-8b8fcfa0e3bd tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:28.998575 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-243495a3-386f-4893-b626-8b8fcfa0e3bd tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:28.999168 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-243495a3-386f-4893-b626-8b8fcfa0e3bd tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:29.127275 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-df5bfec3-4a31-421d-bb8c-251873c16cb1 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:29.127686 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-df5bfec3-4a31-421d-bb8c-251873c16cb1 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] [instance: aaea6df3-ebe9-4a81-a8ec-e6bf9339283a] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:29.138502 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-df5bfec3-4a31-421d-bb8c-251873c16cb1 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:29.140245 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-df5bfec3-4a31-421d-bb8c-251873c16cb1 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:29.143121 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-df5bfec3-4a31-421d-bb8c-251873c16cb1 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:29.145179 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-df5bfec3-4a31-421d-bb8c-251873c16cb1 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:29.150163 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-df5bfec3-4a31-421d-bb8c-251873c16cb1 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:29.150163 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-df5bfec3-4a31-421d-bb8c-251873c16cb1 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:29.245564 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-243495a3-386f-4893-b626-8b8fcfa0e3bd tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:29.256514 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-243495a3-386f-4893-b626-8b8fcfa0e3bd tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/f86189b0-f42f-4224-8d7a-07676ff60e22" status: 200 len: 1502 microversion: 2.1 time: 0.273073 Oct 27 03:48:29.259680 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3152/6002] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:48:28 2022] GET /compute/v2.1/servers/f86189b0-f42f-4224-8d7a-07676ff60e22 => generated 1502 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:48:29.287470 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8b657b2b-0bb9-4ea7-8f7d-edcec92480d5 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:48:29.299046 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8b657b2b-0bb9-4ea7-8f7d-edcec92480d5 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:29.301410 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8b657b2b-0bb9-4ea7-8f7d-edcec92480d5 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:29.302054 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8b657b2b-0bb9-4ea7-8f7d-edcec92480d5 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:29.312457 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-df5bfec3-4a31-421d-bb8c-251873c16cb1 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:29.321839 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-df5bfec3-4a31-421d-bb8c-251873c16cb1 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:29.326990 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-df5bfec3-4a31-421d-bb8c-251873c16cb1 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:29.334566 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-df5bfec3-4a31-421d-bb8c-251873c16cb1 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] 10.222.0.20 "GET /compute/v2.1/servers/aaea6df3-ebe9-4a81-a8ec-e6bf9339283a" status: 200 len: 1408 microversion: 2.54 time: 0.214678 Oct 27 03:48:29.339382 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:48:29.346804 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2851/6003] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:48:29 2022] GET /compute/v2.1/servers/aaea6df3-ebe9-4a81-a8ec-e6bf9339283a => generated 1408 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:48:29.349115 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8b657b2b-0bb9-4ea7-8f7d-edcec92480d5 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: f86189b0-f42f-4224-8d7a-07676ff60e22] Going to try to stop instance {{(pid=121001) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 27 03:48:29.582679 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8b657b2b-0bb9-4ea7-8f7d-edcec92480d5 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "POST /compute/v2.1/servers/f86189b0-f42f-4224-8d7a-07676ff60e22/action" status: 202 len: 0 microversion: 2.1 time: 0.298957 Oct 27 03:48:29.584839 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3153/6004] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:48:29 2022] POST /compute/v2.1/servers/f86189b0-f42f-4224-8d7a-07676ff60e22/action => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 03:48:29.592733 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5f6dbc9b-3156-4ee7-bb2d-a3b773e07a53 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:29.602692 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5f6dbc9b-3156-4ee7-bb2d-a3b773e07a53 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: f86189b0-f42f-4224-8d7a-07676ff60e22] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:29.616149 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5f6dbc9b-3156-4ee7-bb2d-a3b773e07a53 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:29.620308 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5f6dbc9b-3156-4ee7-bb2d-a3b773e07a53 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:29.624812 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5f6dbc9b-3156-4ee7-bb2d-a3b773e07a53 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:29.624812 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5f6dbc9b-3156-4ee7-bb2d-a3b773e07a53 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:29.624812 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5f6dbc9b-3156-4ee7-bb2d-a3b773e07a53 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:29.625420 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5f6dbc9b-3156-4ee7-bb2d-a3b773e07a53 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:30.016618 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5f6dbc9b-3156-4ee7-bb2d-a3b773e07a53 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:30.028813 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5f6dbc9b-3156-4ee7-bb2d-a3b773e07a53 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/f86189b0-f42f-4224-8d7a-07676ff60e22" status: 200 len: 1512 microversion: 2.1 time: 0.439981 Oct 27 03:48:30.033314 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2852/6005] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:48:29 2022] GET /compute/v2.1/servers/f86189b0-f42f-4224-8d7a-07676ff60e22 => generated 1512 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:48:30.365969 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d1d60878-ae7d-4d45-96da-fb226a7e2d0f tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:30.366882 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d1d60878-ae7d-4d45-96da-fb226a7e2d0f tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] [instance: aaea6df3-ebe9-4a81-a8ec-e6bf9339283a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:30.375583 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d1d60878-ae7d-4d45-96da-fb226a7e2d0f tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:30.376532 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d1d60878-ae7d-4d45-96da-fb226a7e2d0f tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:30.377178 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d1d60878-ae7d-4d45-96da-fb226a7e2d0f tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:30.378328 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d1d60878-ae7d-4d45-96da-fb226a7e2d0f tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:30.378976 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d1d60878-ae7d-4d45-96da-fb226a7e2d0f tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:30.379712 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d1d60878-ae7d-4d45-96da-fb226a7e2d0f tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:30.452432 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d1d60878-ae7d-4d45-96da-fb226a7e2d0f tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:30.463685 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d1d60878-ae7d-4d45-96da-fb226a7e2d0f tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:30.463685 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d1d60878-ae7d-4d45-96da-fb226a7e2d0f tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:30.463685 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d1d60878-ae7d-4d45-96da-fb226a7e2d0f tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] 10.222.0.20 "GET /compute/v2.1/servers/aaea6df3-ebe9-4a81-a8ec-e6bf9339283a" status: 200 len: 1408 microversion: 2.54 time: 0.102548 Oct 27 03:48:30.464203 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3154/6006] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:48:30 2022] GET /compute/v2.1/servers/aaea6df3-ebe9-4a81-a8ec-e6bf9339283a => generated 1408 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:48:31.056496 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7a936699-d3b5-451a-b518-f1b4c9843b35 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:31.057117 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7a936699-d3b5-451a-b518-f1b4c9843b35 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: f86189b0-f42f-4224-8d7a-07676ff60e22] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:31.064822 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7a936699-d3b5-451a-b518-f1b4c9843b35 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:31.065253 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7a936699-d3b5-451a-b518-f1b4c9843b35 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:31.065696 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7a936699-d3b5-451a-b518-f1b4c9843b35 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:31.066422 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7a936699-d3b5-451a-b518-f1b4c9843b35 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:31.066883 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7a936699-d3b5-451a-b518-f1b4c9843b35 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:31.067313 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7a936699-d3b5-451a-b518-f1b4c9843b35 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:31.290064 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7a936699-d3b5-451a-b518-f1b4c9843b35 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:31.300703 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7a936699-d3b5-451a-b518-f1b4c9843b35 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/f86189b0-f42f-4224-8d7a-07676ff60e22" status: 200 len: 1512 microversion: 2.1 time: 0.248037 Oct 27 03:48:31.301303 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2853/6007] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:48:31 2022] GET /compute/v2.1/servers/f86189b0-f42f-4224-8d7a-07676ff60e22 => generated 1512 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:48:31.494551 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7d8769e7-92e7-481c-abf8-95b040386d9c tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:31.494551 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7d8769e7-92e7-481c-abf8-95b040386d9c tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] [instance: aaea6df3-ebe9-4a81-a8ec-e6bf9339283a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:31.503272 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7d8769e7-92e7-481c-abf8-95b040386d9c tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:31.503807 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7d8769e7-92e7-481c-abf8-95b040386d9c tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:31.504368 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7d8769e7-92e7-481c-abf8-95b040386d9c tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:31.505109 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7d8769e7-92e7-481c-abf8-95b040386d9c tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:31.505755 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7d8769e7-92e7-481c-abf8-95b040386d9c tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:31.506432 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7d8769e7-92e7-481c-abf8-95b040386d9c tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:31.629794 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7d8769e7-92e7-481c-abf8-95b040386d9c tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:31.643282 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7d8769e7-92e7-481c-abf8-95b040386d9c tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:31.644773 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7d8769e7-92e7-481c-abf8-95b040386d9c tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:31.646334 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7d8769e7-92e7-481c-abf8-95b040386d9c tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] 10.222.0.20 "GET /compute/v2.1/servers/aaea6df3-ebe9-4a81-a8ec-e6bf9339283a" status: 200 len: 1408 microversion: 2.54 time: 0.159739 Oct 27 03:48:31.647387 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3155/6008] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:48:31 2022] GET /compute/v2.1/servers/aaea6df3-ebe9-4a81-a8ec-e6bf9339283a => generated 1408 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:48:32.332262 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e31bd3ef-41a1-49fc-b818-2b680458973f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:32.335894 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e31bd3ef-41a1-49fc-b818-2b680458973f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: f86189b0-f42f-4224-8d7a-07676ff60e22] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:32.355728 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e31bd3ef-41a1-49fc-b818-2b680458973f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:32.362562 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e31bd3ef-41a1-49fc-b818-2b680458973f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:32.362562 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e31bd3ef-41a1-49fc-b818-2b680458973f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:32.362562 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e31bd3ef-41a1-49fc-b818-2b680458973f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:32.364696 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e31bd3ef-41a1-49fc-b818-2b680458973f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:32.365913 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e31bd3ef-41a1-49fc-b818-2b680458973f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:32.638231 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e31bd3ef-41a1-49fc-b818-2b680458973f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:32.663181 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e31bd3ef-41a1-49fc-b818-2b680458973f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/f86189b0-f42f-4224-8d7a-07676ff60e22" status: 200 len: 1512 microversion: 2.1 time: 0.340701 Oct 27 03:48:32.682058 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2854/6009] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:48:32 2022] GET /compute/v2.1/servers/f86189b0-f42f-4224-8d7a-07676ff60e22 => generated 1512 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:48:32.704039 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-40d1c96b-dc58-4712-9373-150485a9353d tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:32.712643 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-40d1c96b-dc58-4712-9373-150485a9353d tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] [instance: aaea6df3-ebe9-4a81-a8ec-e6bf9339283a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:32.735562 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-40d1c96b-dc58-4712-9373-150485a9353d tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:32.736085 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-40d1c96b-dc58-4712-9373-150485a9353d tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:32.736537 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-40d1c96b-dc58-4712-9373-150485a9353d tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:32.737298 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-40d1c96b-dc58-4712-9373-150485a9353d tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:32.742176 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-40d1c96b-dc58-4712-9373-150485a9353d tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:32.742578 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-40d1c96b-dc58-4712-9373-150485a9353d tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:32.845825 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-40d1c96b-dc58-4712-9373-150485a9353d tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:32.889045 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-40d1c96b-dc58-4712-9373-150485a9353d tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:32.891307 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-40d1c96b-dc58-4712-9373-150485a9353d tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:32.892544 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-40d1c96b-dc58-4712-9373-150485a9353d tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] 10.222.0.20 "GET /compute/v2.1/servers/aaea6df3-ebe9-4a81-a8ec-e6bf9339283a" status: 200 len: 1408 microversion: 2.54 time: 0.199382 Oct 27 03:48:32.895050 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3156/6010] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:48:32 2022] GET /compute/v2.1/servers/aaea6df3-ebe9-4a81-a8ec-e6bf9339283a => generated 1408 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:48:33.697453 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e10026d3-c5c5-4965-8684-f9e44960c28c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:33.698559 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e10026d3-c5c5-4965-8684-f9e44960c28c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: f86189b0-f42f-4224-8d7a-07676ff60e22] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:33.715425 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e10026d3-c5c5-4965-8684-f9e44960c28c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:33.716027 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e10026d3-c5c5-4965-8684-f9e44960c28c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:33.716483 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e10026d3-c5c5-4965-8684-f9e44960c28c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:33.717263 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e10026d3-c5c5-4965-8684-f9e44960c28c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:33.717736 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e10026d3-c5c5-4965-8684-f9e44960c28c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:33.722383 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e10026d3-c5c5-4965-8684-f9e44960c28c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:33.728401 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=100 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:48:33.924525 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5f505f0d-8e7e-4b3e-8e93-85479a6d0ec5 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:33.926728 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5f505f0d-8e7e-4b3e-8e93-85479a6d0ec5 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] [instance: aaea6df3-ebe9-4a81-a8ec-e6bf9339283a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:33.938336 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5f505f0d-8e7e-4b3e-8e93-85479a6d0ec5 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:33.943399 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5f505f0d-8e7e-4b3e-8e93-85479a6d0ec5 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:33.946545 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5f505f0d-8e7e-4b3e-8e93-85479a6d0ec5 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:33.947547 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5f505f0d-8e7e-4b3e-8e93-85479a6d0ec5 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:33.949446 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5f505f0d-8e7e-4b3e-8e93-85479a6d0ec5 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:33.950775 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5f505f0d-8e7e-4b3e-8e93-85479a6d0ec5 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:34.097427 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5f505f0d-8e7e-4b3e-8e93-85479a6d0ec5 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:34.107272 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e10026d3-c5c5-4965-8684-f9e44960c28c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:34.117167 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5f505f0d-8e7e-4b3e-8e93-85479a6d0ec5 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:34.120692 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e10026d3-c5c5-4965-8684-f9e44960c28c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/f86189b0-f42f-4224-8d7a-07676ff60e22" status: 200 len: 1512 microversion: 2.1 time: 0.422403 Oct 27 03:48:34.121763 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2855/6011] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:48:33 2022] GET /compute/v2.1/servers/f86189b0-f42f-4224-8d7a-07676ff60e22 => generated 1512 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:48:34.146954 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5f505f0d-8e7e-4b3e-8e93-85479a6d0ec5 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:34.147640 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5f505f0d-8e7e-4b3e-8e93-85479a6d0ec5 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] 10.222.0.20 "GET /compute/v2.1/servers/aaea6df3-ebe9-4a81-a8ec-e6bf9339283a" status: 200 len: 1408 microversion: 2.54 time: 0.226281 Oct 27 03:48:34.163802 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3157/6012] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:48:33 2022] GET /compute/v2.1/servers/aaea6df3-ebe9-4a81-a8ec-e6bf9339283a => generated 1408 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:48:35.151834 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b4d178b0-e8d3-4cc6-b842-be15c3d44755 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:35.152714 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b4d178b0-e8d3-4cc6-b842-be15c3d44755 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: f86189b0-f42f-4224-8d7a-07676ff60e22] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:35.206718 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b4d178b0-e8d3-4cc6-b842-be15c3d44755 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:35.206718 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b4d178b0-e8d3-4cc6-b842-be15c3d44755 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:35.206718 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b4d178b0-e8d3-4cc6-b842-be15c3d44755 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:35.206718 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b4d178b0-e8d3-4cc6-b842-be15c3d44755 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:35.206718 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b4d178b0-e8d3-4cc6-b842-be15c3d44755 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:35.206718 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b4d178b0-e8d3-4cc6-b842-be15c3d44755 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:35.207185 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a58d474b-a6e5-4e50-8f48-e7cda1623f5d tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:35.207185 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a58d474b-a6e5-4e50-8f48-e7cda1623f5d tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] [instance: aaea6df3-ebe9-4a81-a8ec-e6bf9339283a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:35.207185 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a58d474b-a6e5-4e50-8f48-e7cda1623f5d tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:35.207185 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a58d474b-a6e5-4e50-8f48-e7cda1623f5d tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:35.207185 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a58d474b-a6e5-4e50-8f48-e7cda1623f5d tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:35.207185 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a58d474b-a6e5-4e50-8f48-e7cda1623f5d tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:35.207939 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a58d474b-a6e5-4e50-8f48-e7cda1623f5d tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:35.215312 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a58d474b-a6e5-4e50-8f48-e7cda1623f5d tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:35.398352 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a58d474b-a6e5-4e50-8f48-e7cda1623f5d tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:35.415069 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a58d474b-a6e5-4e50-8f48-e7cda1623f5d tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:35.417224 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a58d474b-a6e5-4e50-8f48-e7cda1623f5d tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:35.423206 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a58d474b-a6e5-4e50-8f48-e7cda1623f5d tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] 10.222.0.20 "GET /compute/v2.1/servers/aaea6df3-ebe9-4a81-a8ec-e6bf9339283a" status: 200 len: 1408 microversion: 2.54 time: 0.248617 Oct 27 03:48:35.428586 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3158/6013] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:48:35 2022] GET /compute/v2.1/servers/aaea6df3-ebe9-4a81-a8ec-e6bf9339283a => generated 1408 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:48:35.662483 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b4d178b0-e8d3-4cc6-b842-be15c3d44755 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:35.672606 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b4d178b0-e8d3-4cc6-b842-be15c3d44755 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/f86189b0-f42f-4224-8d7a-07676ff60e22" status: 200 len: 1512 microversion: 2.1 time: 0.525440 Oct 27 03:48:35.673706 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2856/6014] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:48:35 2022] GET /compute/v2.1/servers/f86189b0-f42f-4224-8d7a-07676ff60e22 => generated 1512 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:48:36.459566 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-43c77ab7-c8ff-4119-a542-70c651b7e076 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:36.460523 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-43c77ab7-c8ff-4119-a542-70c651b7e076 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] [instance: aaea6df3-ebe9-4a81-a8ec-e6bf9339283a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:36.472282 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-43c77ab7-c8ff-4119-a542-70c651b7e076 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:36.478077 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-43c77ab7-c8ff-4119-a542-70c651b7e076 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:36.478077 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-43c77ab7-c8ff-4119-a542-70c651b7e076 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:36.478077 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-43c77ab7-c8ff-4119-a542-70c651b7e076 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:36.479674 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-43c77ab7-c8ff-4119-a542-70c651b7e076 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:36.480220 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-43c77ab7-c8ff-4119-a542-70c651b7e076 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:36.702974 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2e5d3938-5b6f-4229-b2a3-2d26869bf1a0 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:36.704327 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-2e5d3938-5b6f-4229-b2a3-2d26869bf1a0 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: f86189b0-f42f-4224-8d7a-07676ff60e22] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:36.716568 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2e5d3938-5b6f-4229-b2a3-2d26869bf1a0 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:36.717511 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2e5d3938-5b6f-4229-b2a3-2d26869bf1a0 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:36.718214 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2e5d3938-5b6f-4229-b2a3-2d26869bf1a0 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:36.718339 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-43c77ab7-c8ff-4119-a542-70c651b7e076 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:36.719404 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2e5d3938-5b6f-4229-b2a3-2d26869bf1a0 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:36.720140 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2e5d3938-5b6f-4229-b2a3-2d26869bf1a0 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:36.720794 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2e5d3938-5b6f-4229-b2a3-2d26869bf1a0 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:36.738918 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-43c77ab7-c8ff-4119-a542-70c651b7e076 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:36.744341 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-43c77ab7-c8ff-4119-a542-70c651b7e076 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:36.745613 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-43c77ab7-c8ff-4119-a542-70c651b7e076 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] 10.222.0.20 "GET /compute/v2.1/servers/aaea6df3-ebe9-4a81-a8ec-e6bf9339283a" status: 200 len: 1414 microversion: 2.54 time: 0.291322 Oct 27 03:48:36.802672 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3159/6015] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:48:36 2022] GET /compute/v2.1/servers/aaea6df3-ebe9-4a81-a8ec-e6bf9339283a => generated 1414 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:48:37.158876 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2e5d3938-5b6f-4229-b2a3-2d26869bf1a0 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:37.173934 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2e5d3938-5b6f-4229-b2a3-2d26869bf1a0 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/f86189b0-f42f-4224-8d7a-07676ff60e22" status: 200 len: 1512 microversion: 2.1 time: 0.476676 Oct 27 03:48:37.191978 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2857/6016] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:48:36 2022] GET /compute/v2.1/servers/f86189b0-f42f-4224-8d7a-07676ff60e22 => generated 1512 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:48:37.780907 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e349e4ff-189c-4af7-96dd-285be9514971 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:37.781593 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e349e4ff-189c-4af7-96dd-285be9514971 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] [instance: aaea6df3-ebe9-4a81-a8ec-e6bf9339283a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:37.795721 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e349e4ff-189c-4af7-96dd-285be9514971 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:37.797595 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e349e4ff-189c-4af7-96dd-285be9514971 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:37.799099 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e349e4ff-189c-4af7-96dd-285be9514971 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:37.802022 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e349e4ff-189c-4af7-96dd-285be9514971 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:37.803612 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e349e4ff-189c-4af7-96dd-285be9514971 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:37.805089 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e349e4ff-189c-4af7-96dd-285be9514971 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:37.983981 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e349e4ff-189c-4af7-96dd-285be9514971 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:38.005062 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e349e4ff-189c-4af7-96dd-285be9514971 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:38.006777 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e349e4ff-189c-4af7-96dd-285be9514971 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:38.008719 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e349e4ff-189c-4af7-96dd-285be9514971 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] 10.222.0.20 "GET /compute/v2.1/servers/aaea6df3-ebe9-4a81-a8ec-e6bf9339283a" status: 200 len: 1414 microversion: 2.54 time: 0.231728 Oct 27 03:48:38.022698 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3160/6017] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:48:37 2022] GET /compute/v2.1/servers/aaea6df3-ebe9-4a81-a8ec-e6bf9339283a => generated 1414 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:48:38.199187 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c7cfc378-7a4b-4cd6-9ffa-365e8bbd7119 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:38.200956 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c7cfc378-7a4b-4cd6-9ffa-365e8bbd7119 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: f86189b0-f42f-4224-8d7a-07676ff60e22] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:38.217598 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c7cfc378-7a4b-4cd6-9ffa-365e8bbd7119 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:38.217598 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c7cfc378-7a4b-4cd6-9ffa-365e8bbd7119 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:38.217598 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c7cfc378-7a4b-4cd6-9ffa-365e8bbd7119 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:38.217598 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c7cfc378-7a4b-4cd6-9ffa-365e8bbd7119 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:38.221886 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c7cfc378-7a4b-4cd6-9ffa-365e8bbd7119 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:38.222659 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c7cfc378-7a4b-4cd6-9ffa-365e8bbd7119 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:39.036927 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9035f918-2945-4c0e-aafc-68ca5e78cb18 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:39.037561 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-9035f918-2945-4c0e-aafc-68ca5e78cb18 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] [instance: aaea6df3-ebe9-4a81-a8ec-e6bf9339283a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:39.059785 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9035f918-2945-4c0e-aafc-68ca5e78cb18 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:39.060778 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9035f918-2945-4c0e-aafc-68ca5e78cb18 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:39.061501 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9035f918-2945-4c0e-aafc-68ca5e78cb18 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:39.067576 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9035f918-2945-4c0e-aafc-68ca5e78cb18 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:39.068151 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9035f918-2945-4c0e-aafc-68ca5e78cb18 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:39.068820 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9035f918-2945-4c0e-aafc-68ca5e78cb18 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:39.170477 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c7cfc378-7a4b-4cd6-9ffa-365e8bbd7119 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:39.189554 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c7cfc378-7a4b-4cd6-9ffa-365e8bbd7119 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/f86189b0-f42f-4224-8d7a-07676ff60e22" status: 200 len: 1512 microversion: 2.1 time: 0.992868 Oct 27 03:48:39.195051 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2858/6018] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:48:38 2022] GET /compute/v2.1/servers/f86189b0-f42f-4224-8d7a-07676ff60e22 => generated 1512 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:48:39.280428 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9035f918-2945-4c0e-aafc-68ca5e78cb18 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:39.292353 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9035f918-2945-4c0e-aafc-68ca5e78cb18 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:39.299987 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9035f918-2945-4c0e-aafc-68ca5e78cb18 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:39.302764 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9035f918-2945-4c0e-aafc-68ca5e78cb18 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] 10.222.0.20 "GET /compute/v2.1/servers/aaea6df3-ebe9-4a81-a8ec-e6bf9339283a" status: 200 len: 1399 microversion: 2.54 time: 0.269862 Oct 27 03:48:39.303368 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3161/6019] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:48:39 2022] GET /compute/v2.1/servers/aaea6df3-ebe9-4a81-a8ec-e6bf9339283a => generated 1399 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:48:39.333292 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-de93bb0d-dc7d-4872-b48e-a8549746ddaa tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Calling method '.version_select at 0x7f7dd9d95790>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:39.807234 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-de93bb0d-dc7d-4872-b48e-a8549746ddaa tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-527192614" status: 204 len: 0 microversion: 2.54 time: 0.473180 Oct 27 03:48:39.807234 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2859/6020] 10.222.0.20 () {60 vars in 1316 bytes} [Thu Oct 27 03:48:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-527192614 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 03:48:39.819301 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4dca8d3f-fae5-401d-b043-183e39d7a70a tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:39.819815 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4dca8d3f-fae5-401d-b043-183e39d7a70a tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] [instance: aaea6df3-ebe9-4a81-a8ec-e6bf9339283a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:39.826323 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4dca8d3f-fae5-401d-b043-183e39d7a70a tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:39.826907 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4dca8d3f-fae5-401d-b043-183e39d7a70a tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:39.827446 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4dca8d3f-fae5-401d-b043-183e39d7a70a tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:39.828240 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4dca8d3f-fae5-401d-b043-183e39d7a70a tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:39.828781 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4dca8d3f-fae5-401d-b043-183e39d7a70a tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:39.829316 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4dca8d3f-fae5-401d-b043-183e39d7a70a tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:39.856767 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4dca8d3f-fae5-401d-b043-183e39d7a70a tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] [instance: aaea6df3-ebe9-4a81-a8ec-e6bf9339283a] Going to try to terminate instance {{(pid=121001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:48:40.237800 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f93dab31-62d3-4195-a4d7-e2029d3851b0 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:40.240336 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f93dab31-62d3-4195-a4d7-e2029d3851b0 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: f86189b0-f42f-4224-8d7a-07676ff60e22] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:40.265118 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:48:40.267105 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f93dab31-62d3-4195-a4d7-e2029d3851b0 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:40.267810 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f93dab31-62d3-4195-a4d7-e2029d3851b0 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:40.268455 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f93dab31-62d3-4195-a4d7-e2029d3851b0 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:40.269368 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f93dab31-62d3-4195-a4d7-e2029d3851b0 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:40.270060 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f93dab31-62d3-4195-a4d7-e2029d3851b0 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:40.270717 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f93dab31-62d3-4195-a4d7-e2029d3851b0 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:40.366735 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4dca8d3f-fae5-401d-b043-183e39d7a70a tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] 10.222.0.20 "DELETE /compute/v2.1/servers/aaea6df3-ebe9-4a81-a8ec-e6bf9339283a" status: 204 len: 0 microversion: 2.54 time: 0.551111 Oct 27 03:48:40.368380 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3162/6021] 10.222.0.20 () {60 vars in 1280 bytes} [Thu Oct 27 03:48:39 2022] DELETE /compute/v2.1/servers/aaea6df3-ebe9-4a81-a8ec-e6bf9339283a => generated 0 bytes in 554 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 03:48:40.378531 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5f66aa83-b19d-48be-8b9c-184493b0f308 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:40.386198 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5f66aa83-b19d-48be-8b9c-184493b0f308 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] [instance: aaea6df3-ebe9-4a81-a8ec-e6bf9339283a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:40.408104 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5f66aa83-b19d-48be-8b9c-184493b0f308 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:40.408620 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5f66aa83-b19d-48be-8b9c-184493b0f308 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:40.409069 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5f66aa83-b19d-48be-8b9c-184493b0f308 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:40.409810 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5f66aa83-b19d-48be-8b9c-184493b0f308 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:40.410301 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5f66aa83-b19d-48be-8b9c-184493b0f308 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:40.410740 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5f66aa83-b19d-48be-8b9c-184493b0f308 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:40.624041 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5f66aa83-b19d-48be-8b9c-184493b0f308 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:40.639316 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5f66aa83-b19d-48be-8b9c-184493b0f308 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:40.647667 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5f66aa83-b19d-48be-8b9c-184493b0f308 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:40.651936 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5f66aa83-b19d-48be-8b9c-184493b0f308 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] 10.222.0.20 "GET /compute/v2.1/servers/aaea6df3-ebe9-4a81-a8ec-e6bf9339283a" status: 200 len: 1405 microversion: 2.54 time: 0.278030 Oct 27 03:48:40.658218 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3163/6022] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:48:40 2022] GET /compute/v2.1/servers/aaea6df3-ebe9-4a81-a8ec-e6bf9339283a => generated 1405 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 03:48:41.132235 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f93dab31-62d3-4195-a4d7-e2029d3851b0 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:41.142538 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f93dab31-62d3-4195-a4d7-e2029d3851b0 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/f86189b0-f42f-4224-8d7a-07676ff60e22" status: 200 len: 1512 microversion: 2.1 time: 0.928980 Oct 27 03:48:41.143162 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2860/6023] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:48:40 2022] GET /compute/v2.1/servers/f86189b0-f42f-4224-8d7a-07676ff60e22 => generated 1512 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:48:41.683886 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c681cab0-568c-4bba-bccf-fcad95b0b131 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:41.685070 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c681cab0-568c-4bba-bccf-fcad95b0b131 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] [instance: aaea6df3-ebe9-4a81-a8ec-e6bf9339283a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:41.699189 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c681cab0-568c-4bba-bccf-fcad95b0b131 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:41.700508 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c681cab0-568c-4bba-bccf-fcad95b0b131 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:41.701171 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c681cab0-568c-4bba-bccf-fcad95b0b131 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:41.711837 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c681cab0-568c-4bba-bccf-fcad95b0b131 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:41.712624 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c681cab0-568c-4bba-bccf-fcad95b0b131 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:41.713264 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c681cab0-568c-4bba-bccf-fcad95b0b131 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:42.176180 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f71e043f-efee-4fe9-81df-2f203aaccf1a tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:42.176919 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f71e043f-efee-4fe9-81df-2f203aaccf1a tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: f86189b0-f42f-4224-8d7a-07676ff60e22] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:42.192268 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f71e043f-efee-4fe9-81df-2f203aaccf1a tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:42.194004 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f71e043f-efee-4fe9-81df-2f203aaccf1a tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:42.194784 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f71e043f-efee-4fe9-81df-2f203aaccf1a tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:42.196852 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f71e043f-efee-4fe9-81df-2f203aaccf1a tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:42.198923 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f71e043f-efee-4fe9-81df-2f203aaccf1a tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:42.200489 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f71e043f-efee-4fe9-81df-2f203aaccf1a tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:42.525215 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c681cab0-568c-4bba-bccf-fcad95b0b131 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:42.536474 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c681cab0-568c-4bba-bccf-fcad95b0b131 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:42.542854 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c681cab0-568c-4bba-bccf-fcad95b0b131 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:42.545737 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c681cab0-568c-4bba-bccf-fcad95b0b131 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] 10.222.0.20 "GET /compute/v2.1/servers/aaea6df3-ebe9-4a81-a8ec-e6bf9339283a" status: 200 len: 1405 microversion: 2.54 time: 0.865816 Oct 27 03:48:42.554304 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3164/6024] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:48:41 2022] GET /compute/v2.1/servers/aaea6df3-ebe9-4a81-a8ec-e6bf9339283a => generated 1405 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:48:42.703738 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f71e043f-efee-4fe9-81df-2f203aaccf1a tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:42.712977 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f71e043f-efee-4fe9-81df-2f203aaccf1a tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/f86189b0-f42f-4224-8d7a-07676ff60e22" status: 200 len: 1512 microversion: 2.1 time: 0.541673 Oct 27 03:48:42.715989 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2861/6025] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:48:42 2022] GET /compute/v2.1/servers/f86189b0-f42f-4224-8d7a-07676ff60e22 => generated 1512 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:48:43.578152 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-18af5fa6-8833-4543-95d9-e28df3f6e3ce tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:43.578793 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-18af5fa6-8833-4543-95d9-e28df3f6e3ce tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] [instance: aaea6df3-ebe9-4a81-a8ec-e6bf9339283a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:43.601602 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-18af5fa6-8833-4543-95d9-e28df3f6e3ce tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:43.602160 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-18af5fa6-8833-4543-95d9-e28df3f6e3ce tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:43.602626 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-18af5fa6-8833-4543-95d9-e28df3f6e3ce tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:43.605104 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-18af5fa6-8833-4543-95d9-e28df3f6e3ce tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:43.606179 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-18af5fa6-8833-4543-95d9-e28df3f6e3ce tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:43.606637 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-18af5fa6-8833-4543-95d9-e28df3f6e3ce tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:43.670958 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-18af5fa6-8833-4543-95d9-e28df3f6e3ce tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:43.671454 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-18af5fa6-8833-4543-95d9-e28df3f6e3ce tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:43.674675 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-18af5fa6-8833-4543-95d9-e28df3f6e3ce tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:43.674675 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-18af5fa6-8833-4543-95d9-e28df3f6e3ce tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lazy-loading 'fault' on Instance uuid aaea6df3-ebe9-4a81-a8ec-e6bf9339283a {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:48:43.741696 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-03dd34a9-fb7c-4adc-b034-b3ff562c6f01 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:43.745740 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-18af5fa6-8833-4543-95d9-e28df3f6e3ce tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:43.749792 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-03dd34a9-fb7c-4adc-b034-b3ff562c6f01 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: f86189b0-f42f-4224-8d7a-07676ff60e22] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:43.760872 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-18af5fa6-8833-4543-95d9-e28df3f6e3ce tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:43.763911 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-18af5fa6-8833-4543-95d9-e28df3f6e3ce tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3771098cc42a447eab2524a0682133e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115b85f8af8e491f85a80eeb979100a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:43.767036 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-03dd34a9-fb7c-4adc-b034-b3ff562c6f01 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:43.768185 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-03dd34a9-fb7c-4adc-b034-b3ff562c6f01 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:43.769661 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-03dd34a9-fb7c-4adc-b034-b3ff562c6f01 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:43.770285 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-18af5fa6-8833-4543-95d9-e28df3f6e3ce tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] 10.222.0.20 "GET /compute/v2.1/servers/aaea6df3-ebe9-4a81-a8ec-e6bf9339283a" status: 200 len: 1410 microversion: 2.54 time: 0.195695 Oct 27 03:48:43.771237 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-03dd34a9-fb7c-4adc-b034-b3ff562c6f01 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:43.772354 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3165/6026] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:48:43 2022] GET /compute/v2.1/servers/aaea6df3-ebe9-4a81-a8ec-e6bf9339283a => generated 1410 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 03:48:43.773258 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-03dd34a9-fb7c-4adc-b034-b3ff562c6f01 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:43.774235 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-03dd34a9-fb7c-4adc-b034-b3ff562c6f01 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:44.584041 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-03dd34a9-fb7c-4adc-b034-b3ff562c6f01 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:44.595953 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-03dd34a9-fb7c-4adc-b034-b3ff562c6f01 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/f86189b0-f42f-4224-8d7a-07676ff60e22" status: 200 len: 1512 microversion: 2.1 time: 0.857891 Oct 27 03:48:44.598661 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2862/6027] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:48:43 2022] GET /compute/v2.1/servers/f86189b0-f42f-4224-8d7a-07676ff60e22 => generated 1512 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:48:44.804036 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4b1f556b-f28a-4ddd-a1fe-70f58b180d07 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:44.805237 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4b1f556b-f28a-4ddd-a1fe-70f58b180d07 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] [instance: aaea6df3-ebe9-4a81-a8ec-e6bf9339283a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:44.818647 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4b1f556b-f28a-4ddd-a1fe-70f58b180d07 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:44.819447 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4b1f556b-f28a-4ddd-a1fe-70f58b180d07 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:44.819890 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4b1f556b-f28a-4ddd-a1fe-70f58b180d07 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:44.820627 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4b1f556b-f28a-4ddd-a1fe-70f58b180d07 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:44.821094 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4b1f556b-f28a-4ddd-a1fe-70f58b180d07 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:44.821530 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4b1f556b-f28a-4ddd-a1fe-70f58b180d07 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:44.849201 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-4b1f556b-f28a-4ddd-a1fe-70f58b180d07 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] HTTP exception thrown: Instance aaea6df3-ebe9-4a81-a8ec-e6bf9339283a could not be found. Oct 27 03:48:44.851300 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4b1f556b-f28a-4ddd-a1fe-70f58b180d07 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Request method failure captured: Oct 27 03:48:44.851300 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/aaea6df3-ebe9-4a81-a8ec-e6bf9339283a HTTP/1.1 Oct 27 03:48:44.851300 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:48:44.851300 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:48:44.851300 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:48:44.851300 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:48:44.851300 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:48:44.851300 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:48:44.851300 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:48:44.851300 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:48:44.851300 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWf9s-caQpTxDe48hP_bER5T16zAJGOVL1xGFKlxc-NQX-CqD1J-rzjUzi53NZbl2r6Pd8kMjdGFF78NuvB6srJ7F9qnR-dYFATktRRlwZWq21zvZG-11DqaynyHXsEVpY5hIoeswNZ3CUNZawJJyIwYpwkCIULPRO6SxMJ_dGTnNXAg Oct 27 03:48:44.851300 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:48:44.851300 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:48:44.851300 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:48:44.851300 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:48:44.851300 n-d-862769-1 devstack@n-api.service[121001]: X-Openstack-Nova-Api-Version: 2.54 Oct 27 03:48:44.851300 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:48:44.851300 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:48:44.851300 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 115b85f8af8e491f85a80eeb979100a0 Oct 27 03:48:44.851300 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServerShowV254Test-92217892 Oct 27 03:48:44.851300 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:48:44.851300 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:48:44.851300 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/115b85f8af8e491f85a80eeb979100a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/115b85f8af8e491f85a80eeb979100a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/115b85f8af8e491f85a80eeb979100a0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_115b85f8af8e491f85a80eeb979100a0"}]}] Oct 27 03:48:44.851300 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServerShowV254Test-92217892 Oct 27 03:48:44.851300 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 115b85f8af8e491f85a80eeb979100a0 Oct 27 03:48:44.851300 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServerShowV254Test-92217892 Oct 27 03:48:44.851300 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServerShowV254Test-92217892-project Oct 27 03:48:44.851300 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:48:44.851300 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:48:44.851300 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 3771098cc42a447eab2524a0682133e8 Oct 27 03:48:44.851300 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServerShowV254Test-92217892-project Oct 27 03:48:44.851300 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:48:44.851300 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance aaea6df3-ebe9-4a81-a8ec-e6bf9339283a could not be found. Oct 27 03:48:44.851300 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': 'aaea6df3-ebe9-4a81-a8ec-e6bf9339283a'} Oct 27 03:48:44.851300 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:48:44.851300 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:48:44.851300 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:48:44.851300 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:48:44.851300 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:48:44.851300 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:48:44.851300 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:48:44.851300 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:48:44.851300 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:48:44.851300 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:48:44.851300 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaea6df3-ebe9-4a81-a8ec-e6bf9339283a could not be found. Oct 27 03:48:44.851300 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:48:44.851300 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:48:44.851300 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:48:44.851300 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:48:44.851300 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:48:44.851300 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:48:44.851300 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:48:44.851300 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:48:44.851300 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:48:44.851300 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:48:44.851300 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:48:44.851300 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:48:44.851300 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:48:44.851300 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:48:44.851300 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:48:44.851300 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:48:44.851300 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaea6df3-ebe9-4a81-a8ec-e6bf9339283a could not be found. Oct 27 03:48:44.851300 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:48:44.851300 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:48:44.851300 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:48:44.854903 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:48:44.854903 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:48:44.854903 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:48:44.854903 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:48:44.854903 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:48:44.854903 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaea6df3-ebe9-4a81-a8ec-e6bf9339283a could not be found. Oct 27 03:48:44.854903 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:48:44.856798 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4b1f556b-f28a-4ddd-a1fe-70f58b180d07 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] Returning 404 to user: Instance aaea6df3-ebe9-4a81-a8ec-e6bf9339283a could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:48:44.857889 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4b1f556b-f28a-4ddd-a1fe-70f58b180d07 tempest-ServerShowV254Test-92217892 tempest-ServerShowV254Test-92217892-project] 10.222.0.20 "GET /compute/v2.1/servers/aaea6df3-ebe9-4a81-a8ec-e6bf9339283a" status: 404 len: 111 microversion: 2.54 time: 0.058397 Oct 27 03:48:44.859025 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3166/6028] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 27 03:48:44 2022] GET /compute/v2.1/servers/aaea6df3-ebe9-4a81-a8ec-e6bf9339283a => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 03:48:45.623792 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-69f9c6f7-7111-4b40-b234-b6b54f162ee7 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:45.624630 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-69f9c6f7-7111-4b40-b234-b6b54f162ee7 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: f86189b0-f42f-4224-8d7a-07676ff60e22] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:45.678949 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-69f9c6f7-7111-4b40-b234-b6b54f162ee7 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:45.679706 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-69f9c6f7-7111-4b40-b234-b6b54f162ee7 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:45.682620 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-69f9c6f7-7111-4b40-b234-b6b54f162ee7 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:45.688445 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-69f9c6f7-7111-4b40-b234-b6b54f162ee7 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:45.690519 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-69f9c6f7-7111-4b40-b234-b6b54f162ee7 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:45.691770 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-69f9c6f7-7111-4b40-b234-b6b54f162ee7 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:46.280140 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-69f9c6f7-7111-4b40-b234-b6b54f162ee7 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:46.317270 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-69f9c6f7-7111-4b40-b234-b6b54f162ee7 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/f86189b0-f42f-4224-8d7a-07676ff60e22" status: 200 len: 1512 microversion: 2.1 time: 0.700033 Oct 27 03:48:46.321637 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2863/6029] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:48:45 2022] GET /compute/v2.1/servers/f86189b0-f42f-4224-8d7a-07676ff60e22 => generated 1512 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:48:47.350425 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ddd5cb70-fd89-4853-9761-786fc5bf60ee tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:47.350984 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ddd5cb70-fd89-4853-9761-786fc5bf60ee tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: f86189b0-f42f-4224-8d7a-07676ff60e22] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:47.357855 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ddd5cb70-fd89-4853-9761-786fc5bf60ee tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:47.358390 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ddd5cb70-fd89-4853-9761-786fc5bf60ee tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:47.358855 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ddd5cb70-fd89-4853-9761-786fc5bf60ee tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:47.359549 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ddd5cb70-fd89-4853-9761-786fc5bf60ee tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:47.360013 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ddd5cb70-fd89-4853-9761-786fc5bf60ee tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:47.360450 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ddd5cb70-fd89-4853-9761-786fc5bf60ee tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:48.060676 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ddd5cb70-fd89-4853-9761-786fc5bf60ee tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:48.089305 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:48:48.117177 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ddd5cb70-fd89-4853-9761-786fc5bf60ee tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/f86189b0-f42f-4224-8d7a-07676ff60e22" status: 200 len: 1512 microversion: 2.1 time: 0.770319 Oct 27 03:48:48.117799 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3167/6030] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:48:47 2022] GET /compute/v2.1/servers/f86189b0-f42f-4224-8d7a-07676ff60e22 => generated 1512 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:48:49.154220 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-adf8038a-2272-436c-afb0-25276a1e5c6e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:49.156287 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-adf8038a-2272-436c-afb0-25276a1e5c6e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: f86189b0-f42f-4224-8d7a-07676ff60e22] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:49.177254 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-adf8038a-2272-436c-afb0-25276a1e5c6e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:49.177254 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-adf8038a-2272-436c-afb0-25276a1e5c6e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:49.177254 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-adf8038a-2272-436c-afb0-25276a1e5c6e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:49.181817 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-adf8038a-2272-436c-afb0-25276a1e5c6e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:49.184837 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-adf8038a-2272-436c-afb0-25276a1e5c6e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:49.185889 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-adf8038a-2272-436c-afb0-25276a1e5c6e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:49.497923 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-adf8038a-2272-436c-afb0-25276a1e5c6e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:49.508756 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-adf8038a-2272-436c-afb0-25276a1e5c6e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/f86189b0-f42f-4224-8d7a-07676ff60e22" status: 200 len: 1512 microversion: 2.1 time: 0.365096 Oct 27 03:48:49.514832 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2864/6031] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:48:49 2022] GET /compute/v2.1/servers/f86189b0-f42f-4224-8d7a-07676ff60e22 => generated 1512 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:48:50.545595 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b0ab6d7a-b9d6-4382-8454-1d38e2374c4c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:50.546259 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b0ab6d7a-b9d6-4382-8454-1d38e2374c4c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: f86189b0-f42f-4224-8d7a-07676ff60e22] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:50.578493 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b0ab6d7a-b9d6-4382-8454-1d38e2374c4c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:50.581104 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b0ab6d7a-b9d6-4382-8454-1d38e2374c4c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:50.592932 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b0ab6d7a-b9d6-4382-8454-1d38e2374c4c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:50.592932 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b0ab6d7a-b9d6-4382-8454-1d38e2374c4c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:50.592932 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b0ab6d7a-b9d6-4382-8454-1d38e2374c4c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:50.592932 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b0ab6d7a-b9d6-4382-8454-1d38e2374c4c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:50.895061 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-260ddc79-d343-4019-8eb5-8a2a806504af tempest-VolumesSnapshotsTestJSON-621552700 tempest-VolumesSnapshotsTestJSON-621552700-project] Action: 'create', calling method: .version_select at 0x7f7dd98b0670>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-950021299"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:48:51.380724 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b0ab6d7a-b9d6-4382-8454-1d38e2374c4c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:51.389830 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b0ab6d7a-b9d6-4382-8454-1d38e2374c4c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/f86189b0-f42f-4224-8d7a-07676ff60e22" status: 200 len: 1512 microversion: 2.1 time: 0.850206 Oct 27 03:48:51.392334 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3168/6032] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:48:50 2022] GET /compute/v2.1/servers/f86189b0-f42f-4224-8d7a-07676ff60e22 => generated 1512 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:48:51.943356 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-260ddc79-d343-4019-8eb5-8a2a806504af tempest-VolumesSnapshotsTestJSON-621552700 tempest-VolumesSnapshotsTestJSON-621552700-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 1.350329 Oct 27 03:48:51.944020 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2865/6033] 10.222.0.20 () {60 vars in 1155 bytes} [Thu Oct 27 03:48:50 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 1352 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 27 03:48:51.958949 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5c4c3d92-56f5-4b56-8fb7-7625c65664a6 tempest-VolumesSnapshotsTestJSON-621552700 tempest-VolumesSnapshotsTestJSON-621552700-project] Calling method '.version_select at 0x7f7dd9632160>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:52.064803 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5c4c3d92-56f5-4b56-8fb7-7625c65664a6 tempest-VolumesSnapshotsTestJSON-621552700 tempest-VolumesSnapshotsTestJSON-621552700-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/a19115bc-701f-4b10-b148-28de308616bd" status: 200 len: 344 microversion: 2.1 time: 0.110878 Oct 27 03:48:52.069613 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3169/6034] 10.222.0.20 () {58 vars in 1245 bytes} [Thu Oct 27 03:48:51 2022] GET /compute/v2.1/os-volumes/a19115bc-701f-4b10-b148-28de308616bd => generated 344 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:48:52.420930 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ad974b5f-fc4d-4030-8f42-59a7fb2a76a0 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:52.421649 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ad974b5f-fc4d-4030-8f42-59a7fb2a76a0 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: f86189b0-f42f-4224-8d7a-07676ff60e22] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:52.432311 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ad974b5f-fc4d-4030-8f42-59a7fb2a76a0 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:52.432842 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ad974b5f-fc4d-4030-8f42-59a7fb2a76a0 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:52.433286 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ad974b5f-fc4d-4030-8f42-59a7fb2a76a0 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:52.440530 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ad974b5f-fc4d-4030-8f42-59a7fb2a76a0 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:52.442789 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ad974b5f-fc4d-4030-8f42-59a7fb2a76a0 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:52.449808 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ad974b5f-fc4d-4030-8f42-59a7fb2a76a0 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:53.080671 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f6513960-1fc7-4b4d-9194-195d0b51cfb7 tempest-VolumesSnapshotsTestJSON-621552700 tempest-VolumesSnapshotsTestJSON-621552700-project] Calling method '.version_select at 0x7f7dd9dccb80>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:53.225071 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ad974b5f-fc4d-4030-8f42-59a7fb2a76a0 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:53.256903 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ad974b5f-fc4d-4030-8f42-59a7fb2a76a0 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/f86189b0-f42f-4224-8d7a-07676ff60e22" status: 200 len: 1512 microversion: 2.1 time: 0.824411 Oct 27 03:48:53.257348 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f6513960-1fc7-4b4d-9194-195d0b51cfb7 tempest-VolumesSnapshotsTestJSON-621552700 tempest-VolumesSnapshotsTestJSON-621552700-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/a19115bc-701f-4b10-b148-28de308616bd" status: 200 len: 344 microversion: 2.1 time: 0.181475 Oct 27 03:48:53.259622 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3170/6035] 10.222.0.20 () {58 vars in 1245 bytes} [Thu Oct 27 03:48:53 2022] GET /compute/v2.1/os-volumes/a19115bc-701f-4b10-b148-28de308616bd => generated 344 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:48:53.260623 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2866/6036] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:48:52 2022] GET /compute/v2.1/servers/f86189b0-f42f-4224-8d7a-07676ff60e22 => generated 1512 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:48:54.279987 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5395e149-924c-45b4-a43a-b22845fd69b7 tempest-VolumesSnapshotsTestJSON-621552700 tempest-VolumesSnapshotsTestJSON-621552700-project] Calling method '.version_select at 0x7f7dd9f91430>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:54.287727 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e50a6377-8b58-4191-80d6-f30618675bb8 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:54.288891 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e50a6377-8b58-4191-80d6-f30618675bb8 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: f86189b0-f42f-4224-8d7a-07676ff60e22] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:54.307110 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e50a6377-8b58-4191-80d6-f30618675bb8 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:54.307898 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e50a6377-8b58-4191-80d6-f30618675bb8 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:54.310142 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e50a6377-8b58-4191-80d6-f30618675bb8 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:54.310142 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e50a6377-8b58-4191-80d6-f30618675bb8 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:54.310447 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e50a6377-8b58-4191-80d6-f30618675bb8 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:54.311130 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e50a6377-8b58-4191-80d6-f30618675bb8 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:54.383007 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5395e149-924c-45b4-a43a-b22845fd69b7 tempest-VolumesSnapshotsTestJSON-621552700 tempest-VolumesSnapshotsTestJSON-621552700-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/a19115bc-701f-4b10-b148-28de308616bd" status: 200 len: 345 microversion: 2.1 time: 0.106702 Oct 27 03:48:54.383753 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3171/6037] 10.222.0.20 () {58 vars in 1245 bytes} [Thu Oct 27 03:48:54 2022] GET /compute/v2.1/os-volumes/a19115bc-701f-4b10-b148-28de308616bd => generated 345 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:48:54.403220 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2d075f55-10ed-4ee4-90fe-432a1a5ebe27 tempest-VolumesSnapshotsTestJSON-621552700 tempest-VolumesSnapshotsTestJSON-621552700-project] Action: 'create', calling method: .version_select at 0x7f7dd95a9940>, body: {"snapshot": {"volume_id": "a19115bc-701f-4b10-b148-28de308616bd", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-219833261"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:48:54.838438 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e50a6377-8b58-4191-80d6-f30618675bb8 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:54.850672 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e50a6377-8b58-4191-80d6-f30618675bb8 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/f86189b0-f42f-4224-8d7a-07676ff60e22" status: 200 len: 1512 microversion: 2.1 time: 0.566830 Oct 27 03:48:54.856572 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2867/6038] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:48:54 2022] GET /compute/v2.1/servers/f86189b0-f42f-4224-8d7a-07676ff60e22 => generated 1512 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:48:55.177139 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2d075f55-10ed-4ee4-90fe-432a1a5ebe27 tempest-VolumesSnapshotsTestJSON-621552700 tempest-VolumesSnapshotsTestJSON-621552700-project] 10.222.0.20 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.778176 Oct 27 03:48:55.177911 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3172/6039] 10.222.0.20 () {60 vars in 1162 bytes} [Thu Oct 27 03:48:54 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:48:55.205398 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2d092107-5693-4ddb-a0cc-cd8a75e9681b tempest-VolumesSnapshotsTestJSON-621552700 tempest-VolumesSnapshotsTestJSON-621552700-project] Calling method '.version_select at 0x7f7dd9e57d30>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:55.259918 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2d092107-5693-4ddb-a0cc-cd8a75e9681b tempest-VolumesSnapshotsTestJSON-621552700 tempest-VolumesSnapshotsTestJSON-621552700-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/d39e93d2-2abc-4c16-89b5-2f350e9c41fe" status: 200 len: 286 microversion: 2.1 time: 0.060540 Oct 27 03:48:55.260683 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2868/6040] 10.222.0.20 () {58 vars in 1251 bytes} [Thu Oct 27 03:48:55 2022] GET /compute/v2.1/os-snapshots/d39e93d2-2abc-4c16-89b5-2f350e9c41fe => generated 286 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:48:55.272618 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2d7cb093-9be7-4233-8c9e-1b0ef36c5d0e tempest-VolumesSnapshotsTestJSON-621552700 tempest-VolumesSnapshotsTestJSON-621552700-project] Calling method '.version_select at 0x7f7dd95a9ca0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:55.376192 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2d7cb093-9be7-4233-8c9e-1b0ef36c5d0e tempest-VolumesSnapshotsTestJSON-621552700 tempest-VolumesSnapshotsTestJSON-621552700-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.107484 Oct 27 03:48:55.377846 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3173/6041] 10.222.0.20 () {58 vars in 1140 bytes} [Thu Oct 27 03:48:55 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:48:55.391001 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3b1be869-b67b-41f7-8c6a-c8bcf3a3a8b5 tempest-VolumesSnapshotsTestJSON-621552700 tempest-VolumesSnapshotsTestJSON-621552700-project] Calling method '.version_select at 0x7f7dd98ac280>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:55.473832 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3b1be869-b67b-41f7-8c6a-c8bcf3a3a8b5 tempest-VolumesSnapshotsTestJSON-621552700 tempest-VolumesSnapshotsTestJSON-621552700-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/d39e93d2-2abc-4c16-89b5-2f350e9c41fe" status: 200 len: 286 microversion: 2.1 time: 0.088598 Oct 27 03:48:55.476751 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2869/6042] 10.222.0.20 () {58 vars in 1251 bytes} [Thu Oct 27 03:48:55 2022] GET /compute/v2.1/os-snapshots/d39e93d2-2abc-4c16-89b5-2f350e9c41fe => generated 286 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:48:55.886087 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-fa3d0279-38a8-42a1-a641-7ac30757ae69 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:55.889166 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-fa3d0279-38a8-42a1-a641-7ac30757ae69 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: f86189b0-f42f-4224-8d7a-07676ff60e22] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:55.939303 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fa3d0279-38a8-42a1-a641-7ac30757ae69 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:55.950122 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fa3d0279-38a8-42a1-a641-7ac30757ae69 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:55.951766 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fa3d0279-38a8-42a1-a641-7ac30757ae69 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:55.952704 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fa3d0279-38a8-42a1-a641-7ac30757ae69 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:55.955597 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fa3d0279-38a8-42a1-a641-7ac30757ae69 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:55.958594 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fa3d0279-38a8-42a1-a641-7ac30757ae69 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:56.447020 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-fa3d0279-38a8-42a1-a641-7ac30757ae69 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:56.461082 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-fa3d0279-38a8-42a1-a641-7ac30757ae69 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/f86189b0-f42f-4224-8d7a-07676ff60e22" status: 200 len: 1489 microversion: 2.1 time: 0.579832 Oct 27 03:48:56.493652 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9cf90b74-4594-4d1b-acb4-9a9a1c31278c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-164912623"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:48:56.496752 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3174/6043] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:48:55 2022] GET /compute/v2.1/servers/f86189b0-f42f-4224-8d7a-07676ff60e22 => generated 1489 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:48:56.500385 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9cf90b74-4594-4d1b-acb4-9a9a1c31278c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: f86189b0-f42f-4224-8d7a-07676ff60e22] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:56.504117 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-908a337d-5770-48b2-bd53-e0c4712e382b tempest-VolumesSnapshotsTestJSON-621552700 tempest-VolumesSnapshotsTestJSON-621552700-project] Calling method '.version_select at 0x7f7dd95a9280>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:56.529573 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9cf90b74-4594-4d1b-acb4-9a9a1c31278c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:56.530361 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9cf90b74-4594-4d1b-acb4-9a9a1c31278c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:56.534026 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9cf90b74-4594-4d1b-acb4-9a9a1c31278c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:56.534914 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9cf90b74-4594-4d1b-acb4-9a9a1c31278c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:56.547734 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9cf90b74-4594-4d1b-acb4-9a9a1c31278c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:56.553044 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9cf90b74-4594-4d1b-acb4-9a9a1c31278c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:56.607804 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-908a337d-5770-48b2-bd53-e0c4712e382b tempest-VolumesSnapshotsTestJSON-621552700 tempest-VolumesSnapshotsTestJSON-621552700-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/d39e93d2-2abc-4c16-89b5-2f350e9c41fe" status: 200 len: 286 microversion: 2.1 time: 0.109735 Oct 27 03:48:56.615021 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3175/6044] 10.222.0.20 () {58 vars in 1251 bytes} [Thu Oct 27 03:48:56 2022] GET /compute/v2.1/os-snapshots/d39e93d2-2abc-4c16-89b5-2f350e9c41fe => generated 286 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:48:56.803525 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9cf90b74-4594-4d1b-acb4-9a9a1c31278c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "PUT /compute/v2.1/servers/f86189b0-f42f-4224-8d7a-07676ff60e22" status: 200 len: 1061 microversion: 2.1 time: 0.315787 Oct 27 03:48:56.803525 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2870/6045] 10.222.0.20 () {60 vars in 1256 bytes} [Thu Oct 27 03:48:56 2022] PUT /compute/v2.1/servers/f86189b0-f42f-4224-8d7a-07676ff60e22 => generated 1061 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:48:56.823745 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7022454b-25c0-4bce-8233-985f0c6c91fb tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:56.825046 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7022454b-25c0-4bce-8233-985f0c6c91fb tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: f86189b0-f42f-4224-8d7a-07676ff60e22] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:56.853628 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7022454b-25c0-4bce-8233-985f0c6c91fb tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:56.854521 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7022454b-25c0-4bce-8233-985f0c6c91fb tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:56.855186 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7022454b-25c0-4bce-8233-985f0c6c91fb tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:56.855905 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7022454b-25c0-4bce-8233-985f0c6c91fb tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:56.865327 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7022454b-25c0-4bce-8233-985f0c6c91fb tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:56.866073 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7022454b-25c0-4bce-8233-985f0c6c91fb tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:57.137450 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7022454b-25c0-4bce-8233-985f0c6c91fb tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:57.147785 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7022454b-25c0-4bce-8233-985f0c6c91fb tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/f86189b0-f42f-4224-8d7a-07676ff60e22" status: 200 len: 1488 microversion: 2.1 time: 0.328453 Oct 27 03:48:57.153944 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3176/6046] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:48:56 2022] GET /compute/v2.1/servers/f86189b0-f42f-4224-8d7a-07676ff60e22 => generated 1488 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:48:57.196699 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a962dd7d-5639-4ae2-b32c-87527351067b tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:57.197678 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a962dd7d-5639-4ae2-b32c-87527351067b tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: f86189b0-f42f-4224-8d7a-07676ff60e22] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:57.221858 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a962dd7d-5639-4ae2-b32c-87527351067b tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:57.224600 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a962dd7d-5639-4ae2-b32c-87527351067b tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:57.224600 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a962dd7d-5639-4ae2-b32c-87527351067b tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:57.229500 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a962dd7d-5639-4ae2-b32c-87527351067b tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:57.242870 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a962dd7d-5639-4ae2-b32c-87527351067b tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:57.245104 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a962dd7d-5639-4ae2-b32c-87527351067b tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:57.622058 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b2655070-87b6-412a-8359-cbf4ded88b83 tempest-VolumesSnapshotsTestJSON-621552700 tempest-VolumesSnapshotsTestJSON-621552700-project] Calling method '.version_select at 0x7f7dd95a11f0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:57.674850 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b2655070-87b6-412a-8359-cbf4ded88b83 tempest-VolumesSnapshotsTestJSON-621552700 tempest-VolumesSnapshotsTestJSON-621552700-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/d39e93d2-2abc-4c16-89b5-2f350e9c41fe" status: 200 len: 286 microversion: 2.1 time: 0.057771 Oct 27 03:48:57.675852 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3177/6047] 10.222.0.20 () {58 vars in 1251 bytes} [Thu Oct 27 03:48:57 2022] GET /compute/v2.1/os-snapshots/d39e93d2-2abc-4c16-89b5-2f350e9c41fe => generated 286 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:48:58.071351 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a962dd7d-5639-4ae2-b32c-87527351067b tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:58.098934 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a962dd7d-5639-4ae2-b32c-87527351067b tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/f86189b0-f42f-4224-8d7a-07676ff60e22" status: 200 len: 1488 microversion: 2.1 time: 0.908133 Oct 27 03:48:58.101421 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2871/6048] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:48:57 2022] GET /compute/v2.1/servers/f86189b0-f42f-4224-8d7a-07676ff60e22 => generated 1488 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:48:58.131291 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b50bff46-4225-4ee3-8018-16db24b9451c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:58.133501 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b50bff46-4225-4ee3-8018-16db24b9451c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: f86189b0-f42f-4224-8d7a-07676ff60e22] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:58.144722 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b50bff46-4225-4ee3-8018-16db24b9451c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:58.151463 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b50bff46-4225-4ee3-8018-16db24b9451c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:58.156687 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b50bff46-4225-4ee3-8018-16db24b9451c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:58.156687 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b50bff46-4225-4ee3-8018-16db24b9451c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:58.156687 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b50bff46-4225-4ee3-8018-16db24b9451c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:58.156687 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b50bff46-4225-4ee3-8018-16db24b9451c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:58.287861 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b50bff46-4225-4ee3-8018-16db24b9451c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: f86189b0-f42f-4224-8d7a-07676ff60e22] Going to try to terminate instance {{(pid=121001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:48:58.690124 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-55686af1-0824-4416-ad77-06c82673bc24 tempest-VolumesSnapshotsTestJSON-621552700 tempest-VolumesSnapshotsTestJSON-621552700-project] Calling method '.version_select at 0x7f7dd98a1f70>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:58.721794 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:48:58.747614 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-55686af1-0824-4416-ad77-06c82673bc24 tempest-VolumesSnapshotsTestJSON-621552700 tempest-VolumesSnapshotsTestJSON-621552700-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/d39e93d2-2abc-4c16-89b5-2f350e9c41fe" status: 200 len: 287 microversion: 2.1 time: 0.062106 Oct 27 03:48:58.762077 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2872/6049] 10.222.0.20 () {58 vars in 1251 bytes} [Thu Oct 27 03:48:58 2022] GET /compute/v2.1/os-snapshots/d39e93d2-2abc-4c16-89b5-2f350e9c41fe => generated 287 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:48:58.790238 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c13d87b7-f342-4585-ab4b-8067dcd6841e tempest-VolumesSnapshotsTestJSON-621552700 tempest-VolumesSnapshotsTestJSON-621552700-project] Calling method '.version_select at 0x7f7dd98b5790>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:58.853243 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b50bff46-4225-4ee3-8018-16db24b9451c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f86189b0-f42f-4224-8d7a-07676ff60e22" status: 204 len: 0 microversion: 2.1 time: 0.728625 Oct 27 03:48:58.858201 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3178/6050] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:48:58 2022] DELETE /compute/v2.1/servers/f86189b0-f42f-4224-8d7a-07676ff60e22 => generated 0 bytes in 731 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:48:58.869039 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-59da4bde-de1a-4def-b9f2-9a99d503aa40 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:58.869934 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-59da4bde-de1a-4def-b9f2-9a99d503aa40 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: f86189b0-f42f-4224-8d7a-07676ff60e22] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:48:58.889162 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-59da4bde-de1a-4def-b9f2-9a99d503aa40 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:58.891986 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-59da4bde-de1a-4def-b9f2-9a99d503aa40 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:58.892644 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-59da4bde-de1a-4def-b9f2-9a99d503aa40 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:58.898844 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-59da4bde-de1a-4def-b9f2-9a99d503aa40 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:48:58.899516 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-59da4bde-de1a-4def-b9f2-9a99d503aa40 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:48:58.904741 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-59da4bde-de1a-4def-b9f2-9a99d503aa40 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:48:59.090972 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c13d87b7-f342-4585-ab4b-8067dcd6841e tempest-VolumesSnapshotsTestJSON-621552700 tempest-VolumesSnapshotsTestJSON-621552700-project] 10.222.0.20 "DELETE /compute/v2.1/os-snapshots/d39e93d2-2abc-4c16-89b5-2f350e9c41fe" status: 202 len: 0 microversion: 2.1 time: 0.328957 Oct 27 03:48:59.091516 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2873/6051] 10.222.0.20 () {58 vars in 1254 bytes} [Thu Oct 27 03:48:58 2022] DELETE /compute/v2.1/os-snapshots/d39e93d2-2abc-4c16-89b5-2f350e9c41fe => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:48:59.104803 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-40ef8a33-20b3-4a66-b31e-be87b383daf3 tempest-VolumesSnapshotsTestJSON-621552700 tempest-VolumesSnapshotsTestJSON-621552700-project] Calling method '.version_select at 0x7f7dd98b5af0>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:48:59.159746 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-40ef8a33-20b3-4a66-b31e-be87b383daf3 tempest-VolumesSnapshotsTestJSON-621552700 tempest-VolumesSnapshotsTestJSON-621552700-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/d39e93d2-2abc-4c16-89b5-2f350e9c41fe" status: 200 len: 286 microversion: 2.1 time: 0.061585 Oct 27 03:48:59.160880 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2874/6052] 10.222.0.20 () {58 vars in 1251 bytes} [Thu Oct 27 03:48:59 2022] GET /compute/v2.1/os-snapshots/d39e93d2-2abc-4c16-89b5-2f350e9c41fe => generated 286 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:48:59.221034 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-59da4bde-de1a-4def-b9f2-9a99d503aa40 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:48:59.237498 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-59da4bde-de1a-4def-b9f2-9a99d503aa40 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/f86189b0-f42f-4224-8d7a-07676ff60e22" status: 200 len: 1494 microversion: 2.1 time: 0.377294 Oct 27 03:48:59.238356 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3179/6053] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:48:58 2022] GET /compute/v2.1/servers/f86189b0-f42f-4224-8d7a-07676ff60e22 => generated 1494 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:49:00.174427 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-bda34192-56fb-4106-921e-8e3f60fd5ab6 tempest-VolumesSnapshotsTestJSON-621552700 tempest-VolumesSnapshotsTestJSON-621552700-project] Calling method '.version_select at 0x7f7dd9dc7dc0>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:49:00.272892 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-dea73d90-2ac0-4cbe-93c4-e27f3df417f2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:49:00.272892 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-dea73d90-2ac0-4cbe-93c4-e27f3df417f2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: f86189b0-f42f-4224-8d7a-07676ff60e22] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:49:00.286324 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-bda34192-56fb-4106-921e-8e3f60fd5ab6 tempest-VolumesSnapshotsTestJSON-621552700 tempest-VolumesSnapshotsTestJSON-621552700-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/d39e93d2-2abc-4c16-89b5-2f350e9c41fe" status: 200 len: 286 microversion: 2.1 time: 0.116412 Oct 27 03:49:00.286982 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2875/6054] 10.222.0.20 () {58 vars in 1251 bytes} [Thu Oct 27 03:49:00 2022] GET /compute/v2.1/os-snapshots/d39e93d2-2abc-4c16-89b5-2f350e9c41fe => generated 286 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:49:00.301909 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dea73d90-2ac0-4cbe-93c4-e27f3df417f2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:00.302518 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dea73d90-2ac0-4cbe-93c4-e27f3df417f2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:00.302967 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dea73d90-2ac0-4cbe-93c4-e27f3df417f2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:00.303692 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dea73d90-2ac0-4cbe-93c4-e27f3df417f2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:00.306441 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dea73d90-2ac0-4cbe-93c4-e27f3df417f2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:00.306949 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dea73d90-2ac0-4cbe-93c4-e27f3df417f2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:01.283121 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-dea73d90-2ac0-4cbe-93c4-e27f3df417f2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:49:01.318508 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6ec95edf-ebe7-4f47-8f97-011bd1af5891 tempest-VolumesSnapshotsTestJSON-621552700 tempest-VolumesSnapshotsTestJSON-621552700-project] Calling method '.version_select at 0x7f7dd98a1af0>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:49:01.416912 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-dea73d90-2ac0-4cbe-93c4-e27f3df417f2 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/f86189b0-f42f-4224-8d7a-07676ff60e22" status: 200 len: 1494 microversion: 2.1 time: 1.145550 Oct 27 03:49:01.420994 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3180/6055] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:49:00 2022] GET /compute/v2.1/servers/f86189b0-f42f-4224-8d7a-07676ff60e22 => generated 1494 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:49:01.450552 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6ec95edf-ebe7-4f47-8f97-011bd1af5891 tempest-VolumesSnapshotsTestJSON-621552700 tempest-VolumesSnapshotsTestJSON-621552700-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/d39e93d2-2abc-4c16-89b5-2f350e9c41fe" status: 200 len: 286 microversion: 2.1 time: 0.153862 Oct 27 03:49:01.451331 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2876/6056] 10.222.0.20 () {58 vars in 1251 bytes} [Thu Oct 27 03:49:01 2022] GET /compute/v2.1/os-snapshots/d39e93d2-2abc-4c16-89b5-2f350e9c41fe => generated 286 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:49:02.445986 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9eec49da-a307-4395-a04a-69a9a513ec42 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:49:02.446636 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-9eec49da-a307-4395-a04a-69a9a513ec42 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: f86189b0-f42f-4224-8d7a-07676ff60e22] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:49:02.462436 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9eec49da-a307-4395-a04a-69a9a513ec42 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:02.465299 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9eec49da-a307-4395-a04a-69a9a513ec42 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:02.465756 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9eec49da-a307-4395-a04a-69a9a513ec42 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:02.473294 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3ebc3421-2ef3-4cfa-8064-66c9727cd06b tempest-VolumesSnapshotsTestJSON-621552700 tempest-VolumesSnapshotsTestJSON-621552700-project] Calling method '.version_select at 0x7f7dd98b5700>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:49:02.477131 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9eec49da-a307-4395-a04a-69a9a513ec42 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:02.480663 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9eec49da-a307-4395-a04a-69a9a513ec42 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:02.481302 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9eec49da-a307-4395-a04a-69a9a513ec42 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:02.532162 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-3ebc3421-2ef3-4cfa-8064-66c9727cd06b tempest-VolumesSnapshotsTestJSON-621552700 tempest-VolumesSnapshotsTestJSON-621552700-project] HTTP exception thrown: Snapshot d39e93d2-2abc-4c16-89b5-2f350e9c41fe could not be found. Oct 27 03:49:02.542921 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3ebc3421-2ef3-4cfa-8064-66c9727cd06b tempest-VolumesSnapshotsTestJSON-621552700 tempest-VolumesSnapshotsTestJSON-621552700-project] Request method failure captured: Oct 27 03:49:02.542921 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/os-snapshots/d39e93d2-2abc-4c16-89b5-2f350e9c41fe HTTP/1.1 Oct 27 03:49:02.542921 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:49:02.542921 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:49:02.542921 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:49:02.542921 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:49:02.542921 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:49:02.542921 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:49:02.542921 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:49:02.542921 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:49:02.542921 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWf-ip-kdPwp4iiL61NdGhjkvc_zalyJawbf5omtNOKoTZ40SpYFbcrU0kQFV1u-bieOhgg7I7vdz9IXlY70btK9jCSHFnoFehJFc8hmrSx3gRiUyxE1tNqcKgDboCDRLDlACTDnTPvV4Y-zuHgHg629tC0eDUI3CItQBRi7i-BiSzac Oct 27 03:49:02.542921 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:49:02.542921 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:49:02.542921 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:49:02.542921 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:49:02.542921 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:49:02.542921 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:49:02.542921 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: cc14a49f9b534978bf1ce77ce2e7bb59 Oct 27 03:49:02.542921 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-621552700 Oct 27 03:49:02.542921 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:49:02.542921 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:49:02.542921 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cc14a49f9b534978bf1ce77ce2e7bb59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/cc14a49f9b534978bf1ce77ce2e7bb59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cc14a49f9b534978bf1ce77ce2e7bb59"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_cc14a49f9b534978bf1ce77ce2e7bb59"}]}] Oct 27 03:49:02.542921 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-VolumesSnapshotsTestJSON-621552700 Oct 27 03:49:02.542921 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: cc14a49f9b534978bf1ce77ce2e7bb59 Oct 27 03:49:02.542921 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-621552700 Oct 27 03:49:02.542921 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-VolumesSnapshotsTestJSON-621552700-project Oct 27 03:49:02.542921 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:49:02.542921 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:49:02.542921 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 4ee93fdea79840e59dab1a8305116e78 Oct 27 03:49:02.542921 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-VolumesSnapshotsTestJSON-621552700-project Oct 27 03:49:02.542921 n-d-862769-1 devstack@n-api.service[121000]: method: Oct 27 03:49:02.542921 n-d-862769-1 devstack@n-api.service[121000]: exception: Snapshot d39e93d2-2abc-4c16-89b5-2f350e9c41fe could not be found. Oct 27 03:49:02.542921 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': 'd39e93d2-2abc-4c16-89b5-2f350e9c41fe'} Oct 27 03:49:02.542921 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:49:02.542921 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:49:02.542921 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 27 03:49:02.542921 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 27 03:49:02.542921 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 27 03:49:02.542921 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 27 03:49:02.542921 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 27 03:49:02.542921 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 27 03:49:02.542921 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 03:49:02.542921 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 03:49:02.542921 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 03:49:02.542921 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 03:49:02.542921 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 03:49:02.542921 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 03:49:02.542921 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 03:49:02.542921 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 03:49:02.542921 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot d39e93d2-2abc-4c16-89b5-2f350e9c41fe could not be found. (HTTP 404) (Request-ID: req-fa038c19-a300-494b-b22b-934d321a1ada) Oct 27 03:49:02.542921 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:02.542921 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:49:02.542921 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:02.542921 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:49:02.542921 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 27 03:49:02.542921 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 27 03:49:02.542921 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 27 03:49:02.542921 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 27 03:49:02.542921 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 27 03:49:02.542921 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 27 03:49:02.542921 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 27 03:49:02.542921 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 27 03:49:02.555883 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 27 03:49:02.555883 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 27 03:49:02.555883 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 27 03:49:02.555883 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 27 03:49:02.555883 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 27 03:49:02.555883 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 27 03:49:02.555883 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 03:49:02.555883 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 03:49:02.555883 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 03:49:02.555883 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 03:49:02.555883 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 03:49:02.555883 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 03:49:02.555883 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 03:49:02.555883 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 03:49:02.555883 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot d39e93d2-2abc-4c16-89b5-2f350e9c41fe could not be found. Oct 27 03:49:02.555883 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:02.555883 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:49:02.555883 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:02.555883 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:49:02.555883 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:49:02.555883 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:49:02.555883 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:49:02.555883 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:49:02.555883 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:49:02.555883 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:49:02.555883 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:49:02.555883 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:49:02.555883 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 27 03:49:02.555883 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:49:02.555883 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot d39e93d2-2abc-4c16-89b5-2f350e9c41fe could not be found. Oct 27 03:49:02.555883 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:02.555883 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:49:02.555883 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:02.555883 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:49:02.555883 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:49:02.555883 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:49:02.555883 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:49:02.555883 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:49:02.555883 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot d39e93d2-2abc-4c16-89b5-2f350e9c41fe could not be found. Oct 27 03:49:02.555883 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:02.555883 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3ebc3421-2ef3-4cfa-8064-66c9727cd06b tempest-VolumesSnapshotsTestJSON-621552700 tempest-VolumesSnapshotsTestJSON-621552700-project] Returning 404 to user: Snapshot d39e93d2-2abc-4c16-89b5-2f350e9c41fe could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:49:02.555883 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3ebc3421-2ef3-4cfa-8064-66c9727cd06b tempest-VolumesSnapshotsTestJSON-621552700 tempest-VolumesSnapshotsTestJSON-621552700-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/d39e93d2-2abc-4c16-89b5-2f350e9c41fe" status: 404 len: 111 microversion: 2.1 time: 0.085434 Oct 27 03:49:02.555883 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2877/6057] 10.222.0.20 () {58 vars in 1251 bytes} [Thu Oct 27 03:49:02 2022] GET /compute/v2.1/os-snapshots/d39e93d2-2abc-4c16-89b5-2f350e9c41fe => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 03:49:02.579182 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-da0f3d7e-1b30-422c-adfb-1c4e3e1a6317 tempest-VolumesSnapshotsTestJSON-621552700 tempest-VolumesSnapshotsTestJSON-621552700-project] Calling method '.version_select at 0x7f7dd98ace50>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:49:02.809515 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9eec49da-a307-4395-a04a-69a9a513ec42 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:49:02.820243 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9eec49da-a307-4395-a04a-69a9a513ec42 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/f86189b0-f42f-4224-8d7a-07676ff60e22" status: 200 len: 1452 microversion: 2.1 time: 0.378022 Oct 27 03:49:02.820967 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3181/6058] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:49:02 2022] GET /compute/v2.1/servers/f86189b0-f42f-4224-8d7a-07676ff60e22 => generated 1452 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:49:02.850123 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-aaf5ad82-284d-46ea-9b19-555382f63e87 req-cb0242f9-1207-4233-8474-c22eb76cd7a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f86189b0-f42f-4224-8d7a-07676ff60e22", "name": "network-vif-deleted", "tag": "b704190e-8542-446d-985b-25682d8ab69a"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:49:02.876265 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-aaf5ad82-284d-46ea-9b19-555382f63e87 req-cb0242f9-1207-4233-8474-c22eb76cd7a4 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:02.879742 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-aaf5ad82-284d-46ea-9b19-555382f63e87 req-cb0242f9-1207-4233-8474-c22eb76cd7a4 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:02.880965 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-aaf5ad82-284d-46ea-9b19-555382f63e87 req-cb0242f9-1207-4233-8474-c22eb76cd7a4 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:02.931677 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-aaf5ad82-284d-46ea-9b19-555382f63e87 req-cb0242f9-1207-4233-8474-c22eb76cd7a4 service nova] Creating event network-vif-deleted:b704190e-8542-446d-985b-25682d8ab69a for instance f86189b0-f42f-4224-8d7a-07676ff60e22 on n-h1-862769-1 Oct 27 03:49:02.943522 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-aaf5ad82-284d-46ea-9b19-555382f63e87 req-cb0242f9-1207-4233-8474-c22eb76cd7a4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121291 Oct 27 03:49:02.944341 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3182/6059] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:49:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:49:02.966009 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-da0f3d7e-1b30-422c-adfb-1c4e3e1a6317 tempest-VolumesSnapshotsTestJSON-621552700 tempest-VolumesSnapshotsTestJSON-621552700-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/a19115bc-701f-4b10-b148-28de308616bd" status: 202 len: 0 microversion: 2.1 time: 0.413994 Oct 27 03:49:02.966904 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2878/6060] 10.222.0.20 () {58 vars in 1248 bytes} [Thu Oct 27 03:49:02 2022] DELETE /compute/v2.1/os-volumes/a19115bc-701f-4b10-b148-28de308616bd => generated 0 bytes in 416 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:49:02.975911 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-64dc5827-2a57-4ac5-9ba6-1c2f3151cba1 tempest-VolumesSnapshotsTestJSON-621552700 tempest-VolumesSnapshotsTestJSON-621552700-project] Calling method '.version_select at 0x7f7dd962cee0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:49:03.127212 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-64dc5827-2a57-4ac5-9ba6-1c2f3151cba1 tempest-VolumesSnapshotsTestJSON-621552700 tempest-VolumesSnapshotsTestJSON-621552700-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/a19115bc-701f-4b10-b148-28de308616bd" status: 200 len: 344 microversion: 2.1 time: 0.154164 Oct 27 03:49:03.127212 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3183/6061] 10.222.0.20 () {58 vars in 1245 bytes} [Thu Oct 27 03:49:02 2022] GET /compute/v2.1/os-volumes/a19115bc-701f-4b10-b148-28de308616bd => generated 344 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:49:03.848579 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3aa3dd02-2293-4d03-89e5-79bc203e99fa tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:49:03.849853 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-3aa3dd02-2293-4d03-89e5-79bc203e99fa tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: f86189b0-f42f-4224-8d7a-07676ff60e22] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:49:03.864631 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3aa3dd02-2293-4d03-89e5-79bc203e99fa tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:03.866213 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3aa3dd02-2293-4d03-89e5-79bc203e99fa tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:03.868503 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3aa3dd02-2293-4d03-89e5-79bc203e99fa tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:03.869251 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3aa3dd02-2293-4d03-89e5-79bc203e99fa tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:03.869726 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3aa3dd02-2293-4d03-89e5-79bc203e99fa tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:03.870179 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3aa3dd02-2293-4d03-89e5-79bc203e99fa tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:03.962396 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3aa3dd02-2293-4d03-89e5-79bc203e99fa tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:03.963055 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3aa3dd02-2293-4d03-89e5-79bc203e99fa tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:03.963519 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3aa3dd02-2293-4d03-89e5-79bc203e99fa tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:03.971699 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-3aa3dd02-2293-4d03-89e5-79bc203e99fa tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lazy-loading 'fault' on Instance uuid f86189b0-f42f-4224-8d7a-07676ff60e22 {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:49:04.096680 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-3aa3dd02-2293-4d03-89e5-79bc203e99fa tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:49:04.111195 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3aa3dd02-2293-4d03-89e5-79bc203e99fa tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/f86189b0-f42f-4224-8d7a-07676ff60e22" status: 200 len: 1309 microversion: 2.1 time: 0.267474 Oct 27 03:49:04.111781 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2879/6062] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:49:03 2022] GET /compute/v2.1/servers/f86189b0-f42f-4224-8d7a-07676ff60e22 => generated 1309 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:49:04.150195 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-516a2030-1ee0-4890-b5e6-8874d6bbbd73 tempest-VolumesSnapshotsTestJSON-621552700 tempest-VolumesSnapshotsTestJSON-621552700-project] Calling method '.version_select at 0x7f7dd98c0b80>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:49:04.319829 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-516a2030-1ee0-4890-b5e6-8874d6bbbd73 tempest-VolumesSnapshotsTestJSON-621552700 tempest-VolumesSnapshotsTestJSON-621552700-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/a19115bc-701f-4b10-b148-28de308616bd" status: 200 len: 344 microversion: 2.1 time: 0.182858 Oct 27 03:49:04.320657 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2880/6063] 10.222.0.20 () {58 vars in 1245 bytes} [Thu Oct 27 03:49:04 2022] GET /compute/v2.1/os-volumes/a19115bc-701f-4b10-b148-28de308616bd => generated 344 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:49:04.376405 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-100774e8-bd4c-4f2e-800c-a83cbfb8634f tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-159779510", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": [{"uuid": "f01bbd84-8f25-427b-a979-3fc4398b6ff4"}]}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:49:04.583389 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.network.neutron [None req-100774e8-bd4c-4f2e-800c-a83cbfb8634f tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] validate_networks() for [('f01bbd84-8f25-427b-a979-3fc4398b6ff4', None, None, None, None, None)] {{(pid=121001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:49:05.143945 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d99ff0bd-3b22-48e4-9e65-421c432cc9c7 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:49:05.145942 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d99ff0bd-3b22-48e4-9e65-421c432cc9c7 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: f86189b0-f42f-4224-8d7a-07676ff60e22] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:49:05.155505 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d99ff0bd-3b22-48e4-9e65-421c432cc9c7 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:05.156326 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d99ff0bd-3b22-48e4-9e65-421c432cc9c7 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:05.157186 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d99ff0bd-3b22-48e4-9e65-421c432cc9c7 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:05.158246 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d99ff0bd-3b22-48e4-9e65-421c432cc9c7 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:05.158867 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d99ff0bd-3b22-48e4-9e65-421c432cc9c7 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:05.159443 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d99ff0bd-3b22-48e4-9e65-421c432cc9c7 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:05.211082 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-d99ff0bd-3b22-48e4-9e65-421c432cc9c7 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] HTTP exception thrown: Instance f86189b0-f42f-4224-8d7a-07676ff60e22 could not be found. Oct 27 03:49:05.211977 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d99ff0bd-3b22-48e4-9e65-421c432cc9c7 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Request method failure captured: Oct 27 03:49:05.211977 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/f86189b0-f42f-4224-8d7a-07676ff60e22 HTTP/1.1 Oct 27 03:49:05.211977 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:49:05.211977 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:49:05.211977 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:49:05.211977 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:49:05.211977 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:49:05.211977 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:49:05.211977 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:49:05.211977 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:49:05.211977 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWf7ao454EXpcvqw57oZ6kUl55rrrabqqRcgdR7_bXGBd3EhUlwYyYuxAfl-nrBiMviq2ipmr2mbr4b0cgBTMbKDOZJ9TP7cenW0zaGDKmMe2aswh3Oogol3Ct9m8LHYZYqPWmhLSqvB2K7fCZP-q-SBCjWA9jL7HEZxBqgIhBaRnNcs Oct 27 03:49:05.211977 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:49:05.211977 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:49:05.211977 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:49:05.211977 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:49:05.211977 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:49:05.211977 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:49:05.211977 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 86b90d4cb5eb42958248b6f82516ce19 Oct 27 03:49:05.211977 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ServersTestJSON-1724631621 Oct 27 03:49:05.211977 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:49:05.211977 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:49:05.211977 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86b90d4cb5eb42958248b6f82516ce19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/86b90d4cb5eb42958248b6f82516ce19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86b90d4cb5eb42958248b6f82516ce19"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_86b90d4cb5eb42958248b6f82516ce19"}]}] Oct 27 03:49:05.211977 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ServersTestJSON-1724631621 Oct 27 03:49:05.211977 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 86b90d4cb5eb42958248b6f82516ce19 Oct 27 03:49:05.211977 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ServersTestJSON-1724631621 Oct 27 03:49:05.211977 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ServersTestJSON-1724631621-project Oct 27 03:49:05.211977 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:49:05.211977 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:49:05.211977 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: ca2da57f02884a968d685b53a5399e46 Oct 27 03:49:05.211977 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ServersTestJSON-1724631621-project Oct 27 03:49:05.211977 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:49:05.211977 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance f86189b0-f42f-4224-8d7a-07676ff60e22 could not be found. Oct 27 03:49:05.211977 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': 'f86189b0-f42f-4224-8d7a-07676ff60e22'} Oct 27 03:49:05.211977 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:49:05.211977 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:49:05.211977 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:49:05.211977 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:49:05.211977 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:49:05.211977 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:49:05.211977 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:49:05.211977 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:49:05.211977 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:49:05.211977 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:49:05.211977 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f86189b0-f42f-4224-8d7a-07676ff60e22 could not be found. Oct 27 03:49:05.211977 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:05.211977 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:49:05.211977 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:05.211977 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:49:05.211977 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:49:05.211977 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:49:05.211977 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:49:05.211977 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:49:05.211977 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:49:05.211977 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:49:05.211977 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:49:05.211977 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:49:05.211977 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:49:05.211977 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:49:05.211977 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:49:05.211977 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:49:05.211977 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f86189b0-f42f-4224-8d7a-07676ff60e22 could not be found. Oct 27 03:49:05.211977 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:05.211977 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:49:05.211977 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:05.216881 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:49:05.216881 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:49:05.216881 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:49:05.216881 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:49:05.216881 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:49:05.216881 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f86189b0-f42f-4224-8d7a-07676ff60e22 could not be found. Oct 27 03:49:05.216881 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:05.218571 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d99ff0bd-3b22-48e4-9e65-421c432cc9c7 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Returning 404 to user: Instance f86189b0-f42f-4224-8d7a-07676ff60e22 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:49:05.219795 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d99ff0bd-3b22-48e4-9e65-421c432cc9c7 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/f86189b0-f42f-4224-8d7a-07676ff60e22" status: 404 len: 111 microversion: 2.1 time: 0.081114 Oct 27 03:49:05.224113 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2881/6064] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:49:05 2022] GET /compute/v2.1/servers/f86189b0-f42f-4224-8d7a-07676ff60e22 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 03:49:05.248249 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9274088c-4f9d-45d3-88ca-1e4cb7f16ff1 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:49:05.255143 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9274088c-4f9d-45d3-88ca-1e4cb7f16ff1 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: f86189b0-f42f-4224-8d7a-07676ff60e22] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:49:05.269939 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9274088c-4f9d-45d3-88ca-1e4cb7f16ff1 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:05.278860 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9274088c-4f9d-45d3-88ca-1e4cb7f16ff1 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:05.282232 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9274088c-4f9d-45d3-88ca-1e4cb7f16ff1 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:05.283409 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9274088c-4f9d-45d3-88ca-1e4cb7f16ff1 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:05.284220 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9274088c-4f9d-45d3-88ca-1e4cb7f16ff1 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:05.284937 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9274088c-4f9d-45d3-88ca-1e4cb7f16ff1 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:05.290688 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:05.301585 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-9274088c-4f9d-45d3-88ca-1e4cb7f16ff1 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] HTTP exception thrown: Instance f86189b0-f42f-4224-8d7a-07676ff60e22 could not be found. Oct 27 03:49:05.303510 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9274088c-4f9d-45d3-88ca-1e4cb7f16ff1 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Request method failure captured: Oct 27 03:49:05.303510 n-d-862769-1 devstack@n-api.service[121000]: request: DELETE /compute/v2.1/servers/f86189b0-f42f-4224-8d7a-07676ff60e22 HTTP/1.1 Oct 27 03:49:05.303510 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:49:05.303510 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:49:05.303510 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:49:05.303510 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:49:05.303510 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:49:05.303510 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:49:05.303510 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:49:05.303510 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:49:05.303510 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWf7ao454EXpcvqw57oZ6kUl55rrrabqqRcgdR7_bXGBd3EhUlwYyYuxAfl-nrBiMviq2ipmr2mbr4b0cgBTMbKDOZJ9TP7cenW0zaGDKmMe2aswh3Oogol3Ct9m8LHYZYqPWmhLSqvB2K7fCZP-q-SBCjWA9jL7HEZxBqgIhBaRnNcs Oct 27 03:49:05.303510 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:49:05.303510 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:49:05.303510 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:49:05.303510 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:49:05.303510 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:49:05.303510 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:49:05.303510 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 86b90d4cb5eb42958248b6f82516ce19 Oct 27 03:49:05.303510 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ServersTestJSON-1724631621 Oct 27 03:49:05.303510 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:49:05.303510 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:49:05.303510 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86b90d4cb5eb42958248b6f82516ce19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/86b90d4cb5eb42958248b6f82516ce19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86b90d4cb5eb42958248b6f82516ce19"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_86b90d4cb5eb42958248b6f82516ce19"}]}] Oct 27 03:49:05.303510 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ServersTestJSON-1724631621 Oct 27 03:49:05.303510 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 86b90d4cb5eb42958248b6f82516ce19 Oct 27 03:49:05.303510 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ServersTestJSON-1724631621 Oct 27 03:49:05.303510 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ServersTestJSON-1724631621-project Oct 27 03:49:05.303510 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:49:05.303510 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:49:05.303510 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: ca2da57f02884a968d685b53a5399e46 Oct 27 03:49:05.303510 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ServersTestJSON-1724631621-project Oct 27 03:49:05.303510 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:49:05.303510 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance f86189b0-f42f-4224-8d7a-07676ff60e22 could not be found. Oct 27 03:49:05.303510 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': 'f86189b0-f42f-4224-8d7a-07676ff60e22'} Oct 27 03:49:05.303510 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:49:05.303510 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:49:05.303510 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:49:05.303510 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:49:05.303510 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:49:05.303510 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:49:05.303510 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:49:05.303510 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:49:05.303510 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:49:05.303510 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:49:05.303510 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f86189b0-f42f-4224-8d7a-07676ff60e22 could not be found. Oct 27 03:49:05.303510 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:05.303510 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:49:05.303510 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:05.303510 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:49:05.303510 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:49:05.303510 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:49:05.303510 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:49:05.303510 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:49:05.303510 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:49:05.303510 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:49:05.303510 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 03:49:05.303510 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 03:49:05.303510 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 03:49:05.303510 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 03:49:05.303510 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:49:05.303510 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:49:05.303510 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:49:05.303510 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:49:05.303510 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f86189b0-f42f-4224-8d7a-07676ff60e22 could not be found. Oct 27 03:49:05.306984 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:05.306984 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:49:05.306984 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:05.306984 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:49:05.306984 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:49:05.306984 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:49:05.306984 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:49:05.306984 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:49:05.306984 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f86189b0-f42f-4224-8d7a-07676ff60e22 could not be found. Oct 27 03:49:05.306984 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:05.312016 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9274088c-4f9d-45d3-88ca-1e4cb7f16ff1 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Returning 404 to user: Instance f86189b0-f42f-4224-8d7a-07676ff60e22 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:49:05.313162 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9274088c-4f9d-45d3-88ca-1e4cb7f16ff1 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f86189b0-f42f-4224-8d7a-07676ff60e22" status: 404 len: 111 microversion: 2.1 time: 0.077491 Oct 27 03:49:05.318870 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2882/6065] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:49:05 2022] DELETE /compute/v2.1/servers/f86189b0-f42f-4224-8d7a-07676ff60e22 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:49:05.325648 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8aa3d5e7-b499-40eb-98d7-e34c127ab12e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:49:05.326821 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8aa3d5e7-b499-40eb-98d7-e34c127ab12e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: f86189b0-f42f-4224-8d7a-07676ff60e22] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:49:05.336832 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8aa3d5e7-b499-40eb-98d7-e34c127ab12e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:05.337515 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8aa3d5e7-b499-40eb-98d7-e34c127ab12e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:05.338122 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8aa3d5e7-b499-40eb-98d7-e34c127ab12e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:05.339095 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8aa3d5e7-b499-40eb-98d7-e34c127ab12e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:05.339872 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8aa3d5e7-b499-40eb-98d7-e34c127ab12e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:05.340523 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8aa3d5e7-b499-40eb-98d7-e34c127ab12e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:05.367770 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-8aa3d5e7-b499-40eb-98d7-e34c127ab12e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] HTTP exception thrown: Instance f86189b0-f42f-4224-8d7a-07676ff60e22 could not be found. Oct 27 03:49:05.371161 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8aa3d5e7-b499-40eb-98d7-e34c127ab12e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Request method failure captured: Oct 27 03:49:05.371161 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/f86189b0-f42f-4224-8d7a-07676ff60e22 HTTP/1.1 Oct 27 03:49:05.371161 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:49:05.371161 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:49:05.371161 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:49:05.371161 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:49:05.371161 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:49:05.371161 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:49:05.371161 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:49:05.371161 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:49:05.371161 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWf7ao454EXpcvqw57oZ6kUl55rrrabqqRcgdR7_bXGBd3EhUlwYyYuxAfl-nrBiMviq2ipmr2mbr4b0cgBTMbKDOZJ9TP7cenW0zaGDKmMe2aswh3Oogol3Ct9m8LHYZYqPWmhLSqvB2K7fCZP-q-SBCjWA9jL7HEZxBqgIhBaRnNcs Oct 27 03:49:05.371161 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:49:05.371161 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:49:05.371161 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:49:05.371161 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:49:05.371161 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:49:05.371161 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:49:05.371161 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 86b90d4cb5eb42958248b6f82516ce19 Oct 27 03:49:05.371161 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ServersTestJSON-1724631621 Oct 27 03:49:05.371161 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:49:05.371161 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:49:05.371161 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86b90d4cb5eb42958248b6f82516ce19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/86b90d4cb5eb42958248b6f82516ce19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86b90d4cb5eb42958248b6f82516ce19"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_86b90d4cb5eb42958248b6f82516ce19"}]}] Oct 27 03:49:05.371161 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ServersTestJSON-1724631621 Oct 27 03:49:05.371161 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 86b90d4cb5eb42958248b6f82516ce19 Oct 27 03:49:05.371161 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ServersTestJSON-1724631621 Oct 27 03:49:05.371161 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ServersTestJSON-1724631621-project Oct 27 03:49:05.371161 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:49:05.371161 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:49:05.371161 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: ca2da57f02884a968d685b53a5399e46 Oct 27 03:49:05.371161 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ServersTestJSON-1724631621-project Oct 27 03:49:05.371161 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:49:05.371161 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance f86189b0-f42f-4224-8d7a-07676ff60e22 could not be found. Oct 27 03:49:05.371161 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': 'f86189b0-f42f-4224-8d7a-07676ff60e22'} Oct 27 03:49:05.371161 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:49:05.371161 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:49:05.371161 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:49:05.371161 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:49:05.371161 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:49:05.371161 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:49:05.371161 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:49:05.371161 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:49:05.371161 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:49:05.371161 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:49:05.371161 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f86189b0-f42f-4224-8d7a-07676ff60e22 could not be found. Oct 27 03:49:05.371161 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:05.371161 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:49:05.371161 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:05.371161 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:49:05.371161 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:49:05.371161 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:49:05.371161 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:49:05.371161 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:49:05.371161 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:49:05.371161 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:49:05.371161 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:49:05.371161 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:49:05.371161 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:49:05.371161 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:49:05.371161 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:49:05.371161 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:49:05.371161 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f86189b0-f42f-4224-8d7a-07676ff60e22 could not be found. Oct 27 03:49:05.371161 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:05.371161 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:49:05.371161 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:05.375483 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:49:05.375483 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:49:05.375483 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:49:05.375483 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:49:05.375483 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:49:05.375483 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f86189b0-f42f-4224-8d7a-07676ff60e22 could not be found. Oct 27 03:49:05.375483 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:05.375483 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8aa3d5e7-b499-40eb-98d7-e34c127ab12e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Returning 404 to user: Instance f86189b0-f42f-4224-8d7a-07676ff60e22 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:49:05.375483 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8aa3d5e7-b499-40eb-98d7-e34c127ab12e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/f86189b0-f42f-4224-8d7a-07676ff60e22" status: 404 len: 111 microversion: 2.1 time: 0.052673 Oct 27 03:49:05.375483 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2883/6066] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:49:05 2022] GET /compute/v2.1/servers/f86189b0-f42f-4224-8d7a-07676ff60e22 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:49:05.378843 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-631228f3-7fcf-472e-acb8-feb59817bf43 tempest-VolumesSnapshotsTestJSON-621552700 tempest-VolumesSnapshotsTestJSON-621552700-project] Calling method '.version_select at 0x7f7dd98c0310>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:49:05.475816 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-631228f3-7fcf-472e-acb8-feb59817bf43 tempest-VolumesSnapshotsTestJSON-621552700 tempest-VolumesSnapshotsTestJSON-621552700-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/a19115bc-701f-4b10-b148-28de308616bd" status: 200 len: 344 microversion: 2.1 time: 0.100541 Oct 27 03:49:05.476313 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2884/6067] 10.222.0.20 () {58 vars in 1245 bytes} [Thu Oct 27 03:49:05 2022] GET /compute/v2.1/os-volumes/a19115bc-701f-4b10-b148-28de308616bd => generated 344 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:49:05.483258 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7bf00c1e-6935-47c1-8ab2-e1a2119dd085 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:49:05.484120 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7bf00c1e-6935-47c1-8ab2-e1a2119dd085 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 39d1b0a9-6838-4b40-b786-ea685404db46] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:49:05.506877 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7bf00c1e-6935-47c1-8ab2-e1a2119dd085 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:05.506877 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7bf00c1e-6935-47c1-8ab2-e1a2119dd085 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:05.506877 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7bf00c1e-6935-47c1-8ab2-e1a2119dd085 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:05.506877 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7bf00c1e-6935-47c1-8ab2-e1a2119dd085 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:05.506877 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7bf00c1e-6935-47c1-8ab2-e1a2119dd085 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:05.510254 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7bf00c1e-6935-47c1-8ab2-e1a2119dd085 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:05.533720 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-7bf00c1e-6935-47c1-8ab2-e1a2119dd085 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] HTTP exception thrown: Instance 39d1b0a9-6838-4b40-b786-ea685404db46 could not be found. Oct 27 03:49:05.534400 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7bf00c1e-6935-47c1-8ab2-e1a2119dd085 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Request method failure captured: Oct 27 03:49:05.534400 n-d-862769-1 devstack@n-api.service[121000]: request: DELETE /compute/v2.1/servers/39d1b0a9-6838-4b40-b786-ea685404db46 HTTP/1.1 Oct 27 03:49:05.534400 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:49:05.534400 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:49:05.534400 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:49:05.534400 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:49:05.534400 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:49:05.534400 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:49:05.534400 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:49:05.534400 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:49:05.534400 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWf7ao454EXpcvqw57oZ6kUl55rrrabqqRcgdR7_bXGBd3EhUlwYyYuxAfl-nrBiMviq2ipmr2mbr4b0cgBTMbKDOZJ9TP7cenW0zaGDKmMe2aswh3Oogol3Ct9m8LHYZYqPWmhLSqvB2K7fCZP-q-SBCjWA9jL7HEZxBqgIhBaRnNcs Oct 27 03:49:05.534400 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:49:05.534400 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:49:05.534400 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:49:05.534400 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:49:05.534400 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:49:05.534400 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:49:05.534400 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 86b90d4cb5eb42958248b6f82516ce19 Oct 27 03:49:05.534400 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ServersTestJSON-1724631621 Oct 27 03:49:05.534400 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:49:05.534400 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:49:05.534400 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86b90d4cb5eb42958248b6f82516ce19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/86b90d4cb5eb42958248b6f82516ce19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86b90d4cb5eb42958248b6f82516ce19"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_86b90d4cb5eb42958248b6f82516ce19"}]}] Oct 27 03:49:05.534400 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ServersTestJSON-1724631621 Oct 27 03:49:05.534400 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 86b90d4cb5eb42958248b6f82516ce19 Oct 27 03:49:05.534400 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ServersTestJSON-1724631621 Oct 27 03:49:05.534400 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ServersTestJSON-1724631621-project Oct 27 03:49:05.534400 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:49:05.534400 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:49:05.534400 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: ca2da57f02884a968d685b53a5399e46 Oct 27 03:49:05.534400 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ServersTestJSON-1724631621-project Oct 27 03:49:05.534400 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:49:05.534400 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 39d1b0a9-6838-4b40-b786-ea685404db46 could not be found. Oct 27 03:49:05.534400 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '39d1b0a9-6838-4b40-b786-ea685404db46'} Oct 27 03:49:05.534400 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:49:05.534400 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:49:05.534400 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:49:05.534400 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:49:05.534400 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:49:05.534400 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:49:05.534400 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:49:05.534400 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:49:05.534400 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:49:05.534400 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:49:05.534400 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39d1b0a9-6838-4b40-b786-ea685404db46 could not be found. Oct 27 03:49:05.534400 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:05.534400 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:49:05.534400 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:05.534400 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:49:05.534400 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:49:05.534400 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:49:05.534400 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:49:05.534400 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:49:05.534400 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:49:05.534400 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:49:05.534400 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 03:49:05.534400 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 03:49:05.534400 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 03:49:05.534400 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 03:49:05.534400 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:49:05.534400 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:49:05.534400 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:49:05.534400 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:49:05.534400 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39d1b0a9-6838-4b40-b786-ea685404db46 could not be found. Oct 27 03:49:05.537822 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:05.537822 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:49:05.537822 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:05.537822 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:49:05.537822 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:49:05.537822 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:49:05.537822 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:49:05.537822 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:49:05.537822 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39d1b0a9-6838-4b40-b786-ea685404db46 could not be found. Oct 27 03:49:05.537822 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:05.540940 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7bf00c1e-6935-47c1-8ab2-e1a2119dd085 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Returning 404 to user: Instance 39d1b0a9-6838-4b40-b786-ea685404db46 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:49:05.542233 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7bf00c1e-6935-47c1-8ab2-e1a2119dd085 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "DELETE /compute/v2.1/servers/39d1b0a9-6838-4b40-b786-ea685404db46" status: 404 len: 111 microversion: 2.1 time: 0.064452 Oct 27 03:49:05.547069 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2885/6068] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:49:05 2022] DELETE /compute/v2.1/servers/39d1b0a9-6838-4b40-b786-ea685404db46 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:49:05.553640 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8f0f5992-283c-4079-bf04-de530c0eb655 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:49:05.555127 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8f0f5992-283c-4079-bf04-de530c0eb655 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 39d1b0a9-6838-4b40-b786-ea685404db46] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:49:05.561430 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8f0f5992-283c-4079-bf04-de530c0eb655 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:05.562204 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8f0f5992-283c-4079-bf04-de530c0eb655 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:05.564363 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8f0f5992-283c-4079-bf04-de530c0eb655 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:05.564363 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8f0f5992-283c-4079-bf04-de530c0eb655 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:05.564809 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8f0f5992-283c-4079-bf04-de530c0eb655 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:05.565369 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8f0f5992-283c-4079-bf04-de530c0eb655 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:05.593442 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-8f0f5992-283c-4079-bf04-de530c0eb655 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] HTTP exception thrown: Instance 39d1b0a9-6838-4b40-b786-ea685404db46 could not be found. Oct 27 03:49:05.607514 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8f0f5992-283c-4079-bf04-de530c0eb655 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Request method failure captured: Oct 27 03:49:05.607514 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/39d1b0a9-6838-4b40-b786-ea685404db46 HTTP/1.1 Oct 27 03:49:05.607514 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:49:05.607514 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:49:05.607514 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:49:05.607514 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:49:05.607514 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:49:05.607514 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:49:05.607514 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:49:05.607514 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:49:05.607514 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWf7ao454EXpcvqw57oZ6kUl55rrrabqqRcgdR7_bXGBd3EhUlwYyYuxAfl-nrBiMviq2ipmr2mbr4b0cgBTMbKDOZJ9TP7cenW0zaGDKmMe2aswh3Oogol3Ct9m8LHYZYqPWmhLSqvB2K7fCZP-q-SBCjWA9jL7HEZxBqgIhBaRnNcs Oct 27 03:49:05.607514 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:49:05.607514 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:49:05.607514 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:49:05.607514 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:49:05.607514 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:49:05.607514 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:49:05.607514 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 86b90d4cb5eb42958248b6f82516ce19 Oct 27 03:49:05.607514 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ServersTestJSON-1724631621 Oct 27 03:49:05.607514 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:49:05.607514 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:49:05.607514 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86b90d4cb5eb42958248b6f82516ce19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/86b90d4cb5eb42958248b6f82516ce19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86b90d4cb5eb42958248b6f82516ce19"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_86b90d4cb5eb42958248b6f82516ce19"}]}] Oct 27 03:49:05.607514 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ServersTestJSON-1724631621 Oct 27 03:49:05.607514 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 86b90d4cb5eb42958248b6f82516ce19 Oct 27 03:49:05.607514 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ServersTestJSON-1724631621 Oct 27 03:49:05.607514 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ServersTestJSON-1724631621-project Oct 27 03:49:05.607514 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:49:05.607514 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:49:05.607514 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: ca2da57f02884a968d685b53a5399e46 Oct 27 03:49:05.607514 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ServersTestJSON-1724631621-project Oct 27 03:49:05.607514 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:49:05.607514 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 39d1b0a9-6838-4b40-b786-ea685404db46 could not be found. Oct 27 03:49:05.607514 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '39d1b0a9-6838-4b40-b786-ea685404db46'} Oct 27 03:49:05.607514 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:49:05.607514 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:49:05.607514 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:49:05.607514 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:49:05.607514 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:49:05.607514 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:49:05.607514 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:49:05.607514 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:49:05.607514 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:49:05.607514 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:49:05.607514 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39d1b0a9-6838-4b40-b786-ea685404db46 could not be found. Oct 27 03:49:05.607514 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:05.607514 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:49:05.607514 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:05.607514 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:49:05.607514 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:49:05.607514 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:49:05.607514 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:49:05.607514 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:49:05.607514 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:49:05.607514 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:49:05.607514 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:49:05.607514 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:49:05.607514 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:49:05.607514 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:49:05.607514 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:49:05.607514 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:49:05.607514 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39d1b0a9-6838-4b40-b786-ea685404db46 could not be found. Oct 27 03:49:05.607514 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:05.607514 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:49:05.607514 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:05.611035 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:49:05.611035 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:49:05.611035 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:49:05.611035 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:49:05.611035 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:49:05.611035 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39d1b0a9-6838-4b40-b786-ea685404db46 could not be found. Oct 27 03:49:05.611035 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:05.614504 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8f0f5992-283c-4079-bf04-de530c0eb655 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Returning 404 to user: Instance 39d1b0a9-6838-4b40-b786-ea685404db46 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:49:05.616290 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8f0f5992-283c-4079-bf04-de530c0eb655 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/39d1b0a9-6838-4b40-b786-ea685404db46" status: 404 len: 111 microversion: 2.1 time: 0.067940 Oct 27 03:49:05.618251 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2886/6069] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:49:05 2022] GET /compute/v2.1/servers/39d1b0a9-6838-4b40-b786-ea685404db46 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:49:05.646394 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d89c04b3-5edb-43df-b7a8-0af6bcf27ce8 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:49:05.648118 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d89c04b3-5edb-43df-b7a8-0af6bcf27ce8 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 0d158876-42f7-42da-99f1-c9458db9919e] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:49:05.674548 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d89c04b3-5edb-43df-b7a8-0af6bcf27ce8 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:05.675149 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d89c04b3-5edb-43df-b7a8-0af6bcf27ce8 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:05.675701 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d89c04b3-5edb-43df-b7a8-0af6bcf27ce8 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:05.676536 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d89c04b3-5edb-43df-b7a8-0af6bcf27ce8 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:05.677114 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d89c04b3-5edb-43df-b7a8-0af6bcf27ce8 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:05.677666 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d89c04b3-5edb-43df-b7a8-0af6bcf27ce8 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:05.704026 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-d89c04b3-5edb-43df-b7a8-0af6bcf27ce8 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] HTTP exception thrown: Instance 0d158876-42f7-42da-99f1-c9458db9919e could not be found. Oct 27 03:49:05.706775 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d89c04b3-5edb-43df-b7a8-0af6bcf27ce8 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Request method failure captured: Oct 27 03:49:05.706775 n-d-862769-1 devstack@n-api.service[121000]: request: DELETE /compute/v2.1/servers/0d158876-42f7-42da-99f1-c9458db9919e HTTP/1.1 Oct 27 03:49:05.706775 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:49:05.706775 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:49:05.706775 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:49:05.706775 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:49:05.706775 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:49:05.706775 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:49:05.706775 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:49:05.706775 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:49:05.706775 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWf7ao454EXpcvqw57oZ6kUl55rrrabqqRcgdR7_bXGBd3EhUlwYyYuxAfl-nrBiMviq2ipmr2mbr4b0cgBTMbKDOZJ9TP7cenW0zaGDKmMe2aswh3Oogol3Ct9m8LHYZYqPWmhLSqvB2K7fCZP-q-SBCjWA9jL7HEZxBqgIhBaRnNcs Oct 27 03:49:05.706775 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:49:05.706775 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:49:05.706775 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:49:05.706775 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:49:05.706775 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:49:05.706775 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:49:05.706775 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 86b90d4cb5eb42958248b6f82516ce19 Oct 27 03:49:05.706775 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ServersTestJSON-1724631621 Oct 27 03:49:05.706775 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:49:05.706775 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:49:05.706775 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86b90d4cb5eb42958248b6f82516ce19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/86b90d4cb5eb42958248b6f82516ce19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86b90d4cb5eb42958248b6f82516ce19"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_86b90d4cb5eb42958248b6f82516ce19"}]}] Oct 27 03:49:05.706775 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ServersTestJSON-1724631621 Oct 27 03:49:05.706775 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 86b90d4cb5eb42958248b6f82516ce19 Oct 27 03:49:05.706775 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ServersTestJSON-1724631621 Oct 27 03:49:05.706775 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ServersTestJSON-1724631621-project Oct 27 03:49:05.706775 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:49:05.706775 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:49:05.706775 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: ca2da57f02884a968d685b53a5399e46 Oct 27 03:49:05.706775 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ServersTestJSON-1724631621-project Oct 27 03:49:05.706775 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:49:05.706775 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 0d158876-42f7-42da-99f1-c9458db9919e could not be found. Oct 27 03:49:05.706775 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '0d158876-42f7-42da-99f1-c9458db9919e'} Oct 27 03:49:05.706775 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:49:05.706775 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:49:05.706775 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:49:05.706775 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:49:05.706775 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:49:05.706775 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:49:05.706775 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:49:05.706775 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:49:05.706775 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:49:05.706775 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:49:05.706775 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d158876-42f7-42da-99f1-c9458db9919e could not be found. Oct 27 03:49:05.706775 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:05.706775 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:49:05.706775 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:05.706775 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:49:05.706775 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:49:05.706775 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:49:05.706775 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:49:05.706775 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:49:05.706775 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:49:05.706775 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:49:05.706775 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 03:49:05.706775 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 03:49:05.706775 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 03:49:05.706775 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 03:49:05.706775 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:49:05.706775 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:49:05.706775 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:49:05.706775 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:49:05.706775 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d158876-42f7-42da-99f1-c9458db9919e could not be found. Oct 27 03:49:05.710208 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:05.710208 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:49:05.710208 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:05.710208 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:49:05.710208 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:49:05.710208 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:49:05.710208 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:49:05.710208 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:49:05.710208 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d158876-42f7-42da-99f1-c9458db9919e could not be found. Oct 27 03:49:05.710208 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:05.715149 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d89c04b3-5edb-43df-b7a8-0af6bcf27ce8 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Returning 404 to user: Instance 0d158876-42f7-42da-99f1-c9458db9919e could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:49:05.717170 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d89c04b3-5edb-43df-b7a8-0af6bcf27ce8 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0d158876-42f7-42da-99f1-c9458db9919e" status: 404 len: 111 microversion: 2.1 time: 0.081633 Oct 27 03:49:05.722459 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2887/6070] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:49:05 2022] DELETE /compute/v2.1/servers/0d158876-42f7-42da-99f1-c9458db9919e => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:49:05.735205 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-43e54b93-e462-4222-af84-2d82681fcb71 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:49:05.738358 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-43e54b93-e462-4222-af84-2d82681fcb71 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 0d158876-42f7-42da-99f1-c9458db9919e] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:49:05.758000 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-43e54b93-e462-4222-af84-2d82681fcb71 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:05.764583 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-43e54b93-e462-4222-af84-2d82681fcb71 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:05.769032 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-43e54b93-e462-4222-af84-2d82681fcb71 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:05.769032 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-43e54b93-e462-4222-af84-2d82681fcb71 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:05.769032 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-43e54b93-e462-4222-af84-2d82681fcb71 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:05.772185 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-43e54b93-e462-4222-af84-2d82681fcb71 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:05.840878 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-43e54b93-e462-4222-af84-2d82681fcb71 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] HTTP exception thrown: Instance 0d158876-42f7-42da-99f1-c9458db9919e could not be found. Oct 27 03:49:05.851429 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-43e54b93-e462-4222-af84-2d82681fcb71 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Request method failure captured: Oct 27 03:49:05.851429 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/0d158876-42f7-42da-99f1-c9458db9919e HTTP/1.1 Oct 27 03:49:05.851429 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:49:05.851429 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:49:05.851429 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:49:05.851429 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:49:05.851429 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:49:05.851429 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:49:05.851429 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:49:05.851429 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:49:05.851429 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWf7ao454EXpcvqw57oZ6kUl55rrrabqqRcgdR7_bXGBd3EhUlwYyYuxAfl-nrBiMviq2ipmr2mbr4b0cgBTMbKDOZJ9TP7cenW0zaGDKmMe2aswh3Oogol3Ct9m8LHYZYqPWmhLSqvB2K7fCZP-q-SBCjWA9jL7HEZxBqgIhBaRnNcs Oct 27 03:49:05.851429 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:49:05.851429 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:49:05.851429 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:49:05.851429 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:49:05.851429 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:49:05.851429 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:49:05.851429 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 86b90d4cb5eb42958248b6f82516ce19 Oct 27 03:49:05.851429 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ServersTestJSON-1724631621 Oct 27 03:49:05.851429 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:49:05.851429 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:49:05.851429 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86b90d4cb5eb42958248b6f82516ce19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/86b90d4cb5eb42958248b6f82516ce19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86b90d4cb5eb42958248b6f82516ce19"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_86b90d4cb5eb42958248b6f82516ce19"}]}] Oct 27 03:49:05.851429 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ServersTestJSON-1724631621 Oct 27 03:49:05.851429 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 86b90d4cb5eb42958248b6f82516ce19 Oct 27 03:49:05.851429 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ServersTestJSON-1724631621 Oct 27 03:49:05.851429 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ServersTestJSON-1724631621-project Oct 27 03:49:05.851429 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:49:05.851429 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:49:05.851429 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: ca2da57f02884a968d685b53a5399e46 Oct 27 03:49:05.851429 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ServersTestJSON-1724631621-project Oct 27 03:49:05.851429 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:49:05.851429 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 0d158876-42f7-42da-99f1-c9458db9919e could not be found. Oct 27 03:49:05.851429 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '0d158876-42f7-42da-99f1-c9458db9919e'} Oct 27 03:49:05.851429 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:49:05.851429 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:49:05.851429 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:49:05.851429 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:49:05.851429 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:49:05.851429 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:49:05.851429 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:49:05.851429 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:49:05.851429 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:49:05.851429 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:49:05.851429 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d158876-42f7-42da-99f1-c9458db9919e could not be found. Oct 27 03:49:05.851429 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:05.851429 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:49:05.851429 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:05.851429 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:49:05.851429 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:49:05.851429 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:49:05.851429 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:49:05.851429 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:49:05.851429 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:49:05.851429 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:49:05.851429 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:49:05.851429 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:49:05.851429 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:49:05.851429 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:49:05.851429 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:49:05.851429 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:49:05.851429 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d158876-42f7-42da-99f1-c9458db9919e could not be found. Oct 27 03:49:05.851429 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:05.851429 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:49:05.851429 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:05.855440 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:49:05.855440 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:49:05.855440 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:49:05.855440 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:49:05.855440 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:49:05.855440 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d158876-42f7-42da-99f1-c9458db9919e could not be found. Oct 27 03:49:05.855440 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:05.861172 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-43e54b93-e462-4222-af84-2d82681fcb71 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Returning 404 to user: Instance 0d158876-42f7-42da-99f1-c9458db9919e could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:49:05.863673 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-43e54b93-e462-4222-af84-2d82681fcb71 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/0d158876-42f7-42da-99f1-c9458db9919e" status: 404 len: 111 microversion: 2.1 time: 0.139740 Oct 27 03:49:05.876788 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2888/6071] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:49:05 2022] GET /compute/v2.1/servers/0d158876-42f7-42da-99f1-c9458db9919e => generated 111 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:49:05.890312 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e245c2ca-67f5-4b98-9fd3-15acbb3e90db tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:49:05.896700 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e245c2ca-67f5-4b98-9fd3-15acbb3e90db tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 971b44e4-41fc-40a8-907a-71f5345eaf01] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:49:05.919878 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e245c2ca-67f5-4b98-9fd3-15acbb3e90db tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:05.922821 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e245c2ca-67f5-4b98-9fd3-15acbb3e90db tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:05.927138 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e245c2ca-67f5-4b98-9fd3-15acbb3e90db tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:05.927138 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e245c2ca-67f5-4b98-9fd3-15acbb3e90db tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:05.927407 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e245c2ca-67f5-4b98-9fd3-15acbb3e90db tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:05.927997 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e245c2ca-67f5-4b98-9fd3-15acbb3e90db tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:05.968860 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-e245c2ca-67f5-4b98-9fd3-15acbb3e90db tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] HTTP exception thrown: Instance 971b44e4-41fc-40a8-907a-71f5345eaf01 could not be found. Oct 27 03:49:05.972981 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e245c2ca-67f5-4b98-9fd3-15acbb3e90db tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Request method failure captured: Oct 27 03:49:05.972981 n-d-862769-1 devstack@n-api.service[121000]: request: DELETE /compute/v2.1/servers/971b44e4-41fc-40a8-907a-71f5345eaf01 HTTP/1.1 Oct 27 03:49:05.972981 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:49:05.972981 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:49:05.972981 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:49:05.972981 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:49:05.972981 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:49:05.972981 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:49:05.972981 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:49:05.972981 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:49:05.972981 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWf7ao454EXpcvqw57oZ6kUl55rrrabqqRcgdR7_bXGBd3EhUlwYyYuxAfl-nrBiMviq2ipmr2mbr4b0cgBTMbKDOZJ9TP7cenW0zaGDKmMe2aswh3Oogol3Ct9m8LHYZYqPWmhLSqvB2K7fCZP-q-SBCjWA9jL7HEZxBqgIhBaRnNcs Oct 27 03:49:05.972981 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:49:05.972981 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:49:05.972981 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:49:05.972981 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:49:05.972981 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:49:05.972981 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:49:05.972981 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 86b90d4cb5eb42958248b6f82516ce19 Oct 27 03:49:05.972981 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ServersTestJSON-1724631621 Oct 27 03:49:05.972981 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:49:05.972981 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:49:05.972981 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86b90d4cb5eb42958248b6f82516ce19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/86b90d4cb5eb42958248b6f82516ce19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86b90d4cb5eb42958248b6f82516ce19"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_86b90d4cb5eb42958248b6f82516ce19"}]}] Oct 27 03:49:05.972981 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ServersTestJSON-1724631621 Oct 27 03:49:05.972981 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 86b90d4cb5eb42958248b6f82516ce19 Oct 27 03:49:05.972981 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ServersTestJSON-1724631621 Oct 27 03:49:05.972981 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ServersTestJSON-1724631621-project Oct 27 03:49:05.972981 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:49:05.972981 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:49:05.972981 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: ca2da57f02884a968d685b53a5399e46 Oct 27 03:49:05.972981 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ServersTestJSON-1724631621-project Oct 27 03:49:05.972981 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:49:05.972981 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 971b44e4-41fc-40a8-907a-71f5345eaf01 could not be found. Oct 27 03:49:05.972981 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '971b44e4-41fc-40a8-907a-71f5345eaf01'} Oct 27 03:49:05.972981 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:49:05.972981 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:49:05.972981 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:49:05.972981 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:49:05.972981 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:49:05.972981 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:49:05.972981 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:49:05.972981 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:49:05.972981 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:49:05.972981 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:49:05.972981 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 971b44e4-41fc-40a8-907a-71f5345eaf01 could not be found. Oct 27 03:49:05.972981 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:05.972981 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:49:05.972981 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:05.972981 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:49:05.972981 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:49:05.972981 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:49:05.972981 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:49:05.972981 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:49:05.972981 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:49:05.972981 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:49:05.972981 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 03:49:05.972981 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 03:49:05.972981 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 03:49:05.972981 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 03:49:05.972981 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:49:05.972981 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:49:05.972981 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:49:05.972981 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:49:05.972981 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 971b44e4-41fc-40a8-907a-71f5345eaf01 could not be found. Oct 27 03:49:05.976465 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:05.976465 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:49:05.976465 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:05.976465 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:49:05.976465 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:49:05.976465 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:49:05.976465 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:49:05.976465 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:49:05.976465 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 971b44e4-41fc-40a8-907a-71f5345eaf01 could not be found. Oct 27 03:49:05.976465 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:05.978439 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e245c2ca-67f5-4b98-9fd3-15acbb3e90db tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Returning 404 to user: Instance 971b44e4-41fc-40a8-907a-71f5345eaf01 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:49:05.983336 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e245c2ca-67f5-4b98-9fd3-15acbb3e90db tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "DELETE /compute/v2.1/servers/971b44e4-41fc-40a8-907a-71f5345eaf01" status: 404 len: 111 microversion: 2.1 time: 0.102519 Oct 27 03:49:05.984468 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2889/6072] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:49:05 2022] DELETE /compute/v2.1/servers/971b44e4-41fc-40a8-907a-71f5345eaf01 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:49:05.993364 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ca8d13eb-ad43-4319-afe2-2fe4e066e46e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:49:06.000100 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ca8d13eb-ad43-4319-afe2-2fe4e066e46e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 971b44e4-41fc-40a8-907a-71f5345eaf01] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:49:06.015101 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ca8d13eb-ad43-4319-afe2-2fe4e066e46e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:06.015567 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ca8d13eb-ad43-4319-afe2-2fe4e066e46e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:06.016218 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ca8d13eb-ad43-4319-afe2-2fe4e066e46e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:06.017110 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ca8d13eb-ad43-4319-afe2-2fe4e066e46e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:06.017973 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ca8d13eb-ad43-4319-afe2-2fe4e066e46e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:06.018389 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ca8d13eb-ad43-4319-afe2-2fe4e066e46e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:06.041824 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-ca8d13eb-ad43-4319-afe2-2fe4e066e46e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] HTTP exception thrown: Instance 971b44e4-41fc-40a8-907a-71f5345eaf01 could not be found. Oct 27 03:49:06.045856 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ca8d13eb-ad43-4319-afe2-2fe4e066e46e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Request method failure captured: Oct 27 03:49:06.045856 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/971b44e4-41fc-40a8-907a-71f5345eaf01 HTTP/1.1 Oct 27 03:49:06.045856 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:49:06.045856 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:49:06.045856 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:49:06.045856 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:49:06.045856 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:49:06.045856 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:49:06.045856 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:49:06.045856 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:49:06.045856 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWf7ao454EXpcvqw57oZ6kUl55rrrabqqRcgdR7_bXGBd3EhUlwYyYuxAfl-nrBiMviq2ipmr2mbr4b0cgBTMbKDOZJ9TP7cenW0zaGDKmMe2aswh3Oogol3Ct9m8LHYZYqPWmhLSqvB2K7fCZP-q-SBCjWA9jL7HEZxBqgIhBaRnNcs Oct 27 03:49:06.045856 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:49:06.045856 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:49:06.045856 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:49:06.045856 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:49:06.045856 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:49:06.045856 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:49:06.045856 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 86b90d4cb5eb42958248b6f82516ce19 Oct 27 03:49:06.045856 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ServersTestJSON-1724631621 Oct 27 03:49:06.045856 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:49:06.045856 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:49:06.045856 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86b90d4cb5eb42958248b6f82516ce19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/86b90d4cb5eb42958248b6f82516ce19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86b90d4cb5eb42958248b6f82516ce19"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_86b90d4cb5eb42958248b6f82516ce19"}]}] Oct 27 03:49:06.045856 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ServersTestJSON-1724631621 Oct 27 03:49:06.045856 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 86b90d4cb5eb42958248b6f82516ce19 Oct 27 03:49:06.045856 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ServersTestJSON-1724631621 Oct 27 03:49:06.045856 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ServersTestJSON-1724631621-project Oct 27 03:49:06.045856 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:49:06.045856 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:49:06.045856 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: ca2da57f02884a968d685b53a5399e46 Oct 27 03:49:06.045856 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ServersTestJSON-1724631621-project Oct 27 03:49:06.045856 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:49:06.045856 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 971b44e4-41fc-40a8-907a-71f5345eaf01 could not be found. Oct 27 03:49:06.045856 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '971b44e4-41fc-40a8-907a-71f5345eaf01'} Oct 27 03:49:06.045856 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:49:06.045856 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:49:06.045856 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:49:06.045856 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:49:06.045856 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:49:06.045856 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:49:06.045856 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:49:06.045856 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:49:06.045856 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:49:06.045856 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:49:06.045856 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 971b44e4-41fc-40a8-907a-71f5345eaf01 could not be found. Oct 27 03:49:06.045856 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:06.045856 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:49:06.045856 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:06.045856 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:49:06.045856 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:49:06.045856 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:49:06.045856 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:49:06.045856 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:49:06.045856 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:49:06.045856 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:49:06.045856 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:49:06.045856 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:49:06.045856 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:49:06.045856 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:49:06.045856 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:49:06.045856 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:49:06.045856 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 971b44e4-41fc-40a8-907a-71f5345eaf01 could not be found. Oct 27 03:49:06.045856 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:06.045856 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:49:06.045856 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:06.050282 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:49:06.050282 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:49:06.050282 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:49:06.050282 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:49:06.050282 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:49:06.050282 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 971b44e4-41fc-40a8-907a-71f5345eaf01 could not be found. Oct 27 03:49:06.050282 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:06.050282 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ca8d13eb-ad43-4319-afe2-2fe4e066e46e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Returning 404 to user: Instance 971b44e4-41fc-40a8-907a-71f5345eaf01 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:49:06.050282 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ca8d13eb-ad43-4319-afe2-2fe4e066e46e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/971b44e4-41fc-40a8-907a-71f5345eaf01" status: 404 len: 111 microversion: 2.1 time: 0.057227 Oct 27 03:49:06.050282 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2890/6073] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:49:05 2022] GET /compute/v2.1/servers/971b44e4-41fc-40a8-907a-71f5345eaf01 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 03:49:06.055883 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-84b0ab87-46bd-4755-b4d4-ea14d030b085 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:49:06.056991 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-84b0ab87-46bd-4755-b4d4-ea14d030b085 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 3f9f103d-1fb5-4ff3-bf0c-86f8db514b03] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:49:06.067284 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-84b0ab87-46bd-4755-b4d4-ea14d030b085 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:06.067934 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-84b0ab87-46bd-4755-b4d4-ea14d030b085 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:06.068471 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-84b0ab87-46bd-4755-b4d4-ea14d030b085 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:06.069290 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-84b0ab87-46bd-4755-b4d4-ea14d030b085 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:06.070074 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-84b0ab87-46bd-4755-b4d4-ea14d030b085 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:06.074484 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-84b0ab87-46bd-4755-b4d4-ea14d030b085 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:06.128693 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-84b0ab87-46bd-4755-b4d4-ea14d030b085 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] HTTP exception thrown: Instance 3f9f103d-1fb5-4ff3-bf0c-86f8db514b03 could not be found. Oct 27 03:49:06.133336 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-84b0ab87-46bd-4755-b4d4-ea14d030b085 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Request method failure captured: Oct 27 03:49:06.133336 n-d-862769-1 devstack@n-api.service[121000]: request: DELETE /compute/v2.1/servers/3f9f103d-1fb5-4ff3-bf0c-86f8db514b03 HTTP/1.1 Oct 27 03:49:06.133336 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:49:06.133336 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:49:06.133336 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:49:06.133336 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:49:06.133336 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:49:06.133336 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:49:06.133336 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:49:06.133336 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:49:06.133336 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWf7ao454EXpcvqw57oZ6kUl55rrrabqqRcgdR7_bXGBd3EhUlwYyYuxAfl-nrBiMviq2ipmr2mbr4b0cgBTMbKDOZJ9TP7cenW0zaGDKmMe2aswh3Oogol3Ct9m8LHYZYqPWmhLSqvB2K7fCZP-q-SBCjWA9jL7HEZxBqgIhBaRnNcs Oct 27 03:49:06.133336 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:49:06.133336 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:49:06.133336 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:49:06.133336 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:49:06.133336 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:49:06.133336 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:49:06.133336 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 86b90d4cb5eb42958248b6f82516ce19 Oct 27 03:49:06.133336 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ServersTestJSON-1724631621 Oct 27 03:49:06.133336 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:49:06.133336 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:49:06.133336 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86b90d4cb5eb42958248b6f82516ce19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/86b90d4cb5eb42958248b6f82516ce19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86b90d4cb5eb42958248b6f82516ce19"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_86b90d4cb5eb42958248b6f82516ce19"}]}] Oct 27 03:49:06.133336 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ServersTestJSON-1724631621 Oct 27 03:49:06.133336 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 86b90d4cb5eb42958248b6f82516ce19 Oct 27 03:49:06.133336 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ServersTestJSON-1724631621 Oct 27 03:49:06.133336 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ServersTestJSON-1724631621-project Oct 27 03:49:06.133336 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:49:06.133336 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:49:06.133336 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: ca2da57f02884a968d685b53a5399e46 Oct 27 03:49:06.133336 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ServersTestJSON-1724631621-project Oct 27 03:49:06.133336 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:49:06.133336 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 3f9f103d-1fb5-4ff3-bf0c-86f8db514b03 could not be found. Oct 27 03:49:06.133336 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '3f9f103d-1fb5-4ff3-bf0c-86f8db514b03'} Oct 27 03:49:06.133336 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:49:06.133336 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:49:06.133336 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:49:06.133336 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:49:06.133336 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:49:06.133336 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:49:06.133336 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:49:06.133336 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:49:06.133336 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:49:06.133336 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:49:06.133336 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f9f103d-1fb5-4ff3-bf0c-86f8db514b03 could not be found. Oct 27 03:49:06.133336 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:06.133336 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:49:06.133336 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:06.133336 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:49:06.133336 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:49:06.133336 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:49:06.133336 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:49:06.133336 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:49:06.133336 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:49:06.133336 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:49:06.133336 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 03:49:06.133336 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 03:49:06.133336 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 03:49:06.133336 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 03:49:06.133336 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:49:06.133336 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:49:06.133336 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:49:06.133336 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:49:06.133336 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f9f103d-1fb5-4ff3-bf0c-86f8db514b03 could not be found. Oct 27 03:49:06.160594 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:06.160594 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:49:06.160594 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:06.160594 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:49:06.160594 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:49:06.160594 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:49:06.160594 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:49:06.160594 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:49:06.160594 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f9f103d-1fb5-4ff3-bf0c-86f8db514b03 could not be found. Oct 27 03:49:06.160594 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:06.160594 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-84b0ab87-46bd-4755-b4d4-ea14d030b085 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Returning 404 to user: Instance 3f9f103d-1fb5-4ff3-bf0c-86f8db514b03 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:49:06.160594 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-84b0ab87-46bd-4755-b4d4-ea14d030b085 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3f9f103d-1fb5-4ff3-bf0c-86f8db514b03" status: 404 len: 111 microversion: 2.1 time: 0.085652 Oct 27 03:49:06.160594 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2891/6074] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:49:06 2022] DELETE /compute/v2.1/servers/3f9f103d-1fb5-4ff3-bf0c-86f8db514b03 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:49:06.165575 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b1994f45-79cc-4240-a09e-8bb95c2dc70c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:49:06.168785 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b1994f45-79cc-4240-a09e-8bb95c2dc70c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 3f9f103d-1fb5-4ff3-bf0c-86f8db514b03] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:49:06.214296 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b1994f45-79cc-4240-a09e-8bb95c2dc70c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:06.224373 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b1994f45-79cc-4240-a09e-8bb95c2dc70c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:06.225321 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b1994f45-79cc-4240-a09e-8bb95c2dc70c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:06.227891 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b1994f45-79cc-4240-a09e-8bb95c2dc70c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:06.233585 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b1994f45-79cc-4240-a09e-8bb95c2dc70c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:06.235014 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b1994f45-79cc-4240-a09e-8bb95c2dc70c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:06.274574 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-100774e8-bd4c-4f2e-800c-a83cbfb8634f tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Flavor limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:49:06.275060 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-100774e8-bd4c-4f2e-800c-a83cbfb8634f tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Image limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:49:06.275818 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-100774e8-bd4c-4f2e-800c-a83cbfb8634f tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Flavor pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:49:06.276294 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-100774e8-bd4c-4f2e-800c-a83cbfb8634f tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Image pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:49:06.276766 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-100774e8-bd4c-4f2e-800c-a83cbfb8634f tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:49:06.301067 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-b1994f45-79cc-4240-a09e-8bb95c2dc70c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] HTTP exception thrown: Instance 3f9f103d-1fb5-4ff3-bf0c-86f8db514b03 could not be found. Oct 27 03:49:06.302977 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-100774e8-bd4c-4f2e-800c-a83cbfb8634f tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:06.303470 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-100774e8-bd4c-4f2e-800c-a83cbfb8634f tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:06.303914 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-100774e8-bd4c-4f2e-800c-a83cbfb8634f tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:06.304647 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-100774e8-bd4c-4f2e-800c-a83cbfb8634f tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:06.305102 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-100774e8-bd4c-4f2e-800c-a83cbfb8634f tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:06.305562 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-100774e8-bd4c-4f2e-800c-a83cbfb8634f tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:06.310724 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b1994f45-79cc-4240-a09e-8bb95c2dc70c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Request method failure captured: Oct 27 03:49:06.310724 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/3f9f103d-1fb5-4ff3-bf0c-86f8db514b03 HTTP/1.1 Oct 27 03:49:06.310724 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:49:06.310724 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:49:06.310724 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:49:06.310724 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:49:06.310724 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:49:06.310724 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:49:06.310724 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:49:06.310724 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:49:06.310724 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWf7ao454EXpcvqw57oZ6kUl55rrrabqqRcgdR7_bXGBd3EhUlwYyYuxAfl-nrBiMviq2ipmr2mbr4b0cgBTMbKDOZJ9TP7cenW0zaGDKmMe2aswh3Oogol3Ct9m8LHYZYqPWmhLSqvB2K7fCZP-q-SBCjWA9jL7HEZxBqgIhBaRnNcs Oct 27 03:49:06.310724 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:49:06.310724 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:49:06.310724 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:49:06.310724 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:49:06.310724 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:49:06.310724 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:49:06.310724 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 86b90d4cb5eb42958248b6f82516ce19 Oct 27 03:49:06.310724 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ServersTestJSON-1724631621 Oct 27 03:49:06.310724 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:49:06.310724 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:49:06.310724 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86b90d4cb5eb42958248b6f82516ce19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/86b90d4cb5eb42958248b6f82516ce19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86b90d4cb5eb42958248b6f82516ce19"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_86b90d4cb5eb42958248b6f82516ce19"}]}] Oct 27 03:49:06.310724 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ServersTestJSON-1724631621 Oct 27 03:49:06.310724 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 86b90d4cb5eb42958248b6f82516ce19 Oct 27 03:49:06.310724 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ServersTestJSON-1724631621 Oct 27 03:49:06.310724 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ServersTestJSON-1724631621-project Oct 27 03:49:06.310724 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:49:06.310724 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:49:06.310724 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: ca2da57f02884a968d685b53a5399e46 Oct 27 03:49:06.310724 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ServersTestJSON-1724631621-project Oct 27 03:49:06.310724 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:49:06.310724 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 3f9f103d-1fb5-4ff3-bf0c-86f8db514b03 could not be found. Oct 27 03:49:06.310724 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '3f9f103d-1fb5-4ff3-bf0c-86f8db514b03'} Oct 27 03:49:06.310724 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:49:06.310724 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:49:06.310724 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:49:06.310724 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:49:06.310724 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:49:06.310724 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:49:06.310724 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:49:06.310724 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:49:06.310724 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:49:06.310724 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:49:06.310724 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f9f103d-1fb5-4ff3-bf0c-86f8db514b03 could not be found. Oct 27 03:49:06.310724 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:06.310724 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:49:06.310724 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:06.310724 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:49:06.310724 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:49:06.310724 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:49:06.310724 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:49:06.310724 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:49:06.310724 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:49:06.310724 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:49:06.310724 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:49:06.310724 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:49:06.310724 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:49:06.310724 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:49:06.310724 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:49:06.310724 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:49:06.310724 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f9f103d-1fb5-4ff3-bf0c-86f8db514b03 could not be found. Oct 27 03:49:06.310724 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:06.310724 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:49:06.310724 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:06.326104 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:49:06.326104 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:49:06.326104 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:49:06.326104 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:49:06.326104 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:49:06.326104 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f9f103d-1fb5-4ff3-bf0c-86f8db514b03 could not be found. Oct 27 03:49:06.326104 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:06.326104 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b1994f45-79cc-4240-a09e-8bb95c2dc70c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Returning 404 to user: Instance 3f9f103d-1fb5-4ff3-bf0c-86f8db514b03 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:49:06.326104 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b1994f45-79cc-4240-a09e-8bb95c2dc70c tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/3f9f103d-1fb5-4ff3-bf0c-86f8db514b03" status: 404 len: 111 microversion: 2.1 time: 0.163786 Oct 27 03:49:06.326104 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2892/6075] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:49:06 2022] GET /compute/v2.1/servers/3f9f103d-1fb5-4ff3-bf0c-86f8db514b03 => generated 111 bytes in 165 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:49:06.342167 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b0c6e40e-b843-4667-af19-78aff08f7780 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:49:06.342678 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b0c6e40e-b843-4667-af19-78aff08f7780 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 18be006a-739d-4fe2-a04d-1db382b4aeeb] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:49:06.355581 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b0c6e40e-b843-4667-af19-78aff08f7780 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:06.356078 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b0c6e40e-b843-4667-af19-78aff08f7780 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:06.356522 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b0c6e40e-b843-4667-af19-78aff08f7780 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:06.357239 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b0c6e40e-b843-4667-af19-78aff08f7780 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:06.357695 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b0c6e40e-b843-4667-af19-78aff08f7780 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:06.361379 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-100774e8-bd4c-4f2e-800c-a83cbfb8634f tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Getting quotas for project a3d03faa410840e0ae6d7523188d63b6. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:49:06.363815 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b0c6e40e-b843-4667-af19-78aff08f7780 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:06.373695 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-100774e8-bd4c-4f2e-800c-a83cbfb8634f tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Getting quotas for user 2fc1e7eafd7948279f08eb5ad52f5609 and project a3d03faa410840e0ae6d7523188d63b6. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:49:06.397274 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-b0c6e40e-b843-4667-af19-78aff08f7780 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] HTTP exception thrown: Instance 18be006a-739d-4fe2-a04d-1db382b4aeeb could not be found. Oct 27 03:49:06.399074 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b0c6e40e-b843-4667-af19-78aff08f7780 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Request method failure captured: Oct 27 03:49:06.399074 n-d-862769-1 devstack@n-api.service[121000]: request: DELETE /compute/v2.1/servers/18be006a-739d-4fe2-a04d-1db382b4aeeb HTTP/1.1 Oct 27 03:49:06.399074 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:49:06.399074 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:49:06.399074 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:49:06.399074 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:49:06.399074 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:49:06.399074 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:49:06.399074 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:49:06.399074 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:49:06.399074 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWf7ao454EXpcvqw57oZ6kUl55rrrabqqRcgdR7_bXGBd3EhUlwYyYuxAfl-nrBiMviq2ipmr2mbr4b0cgBTMbKDOZJ9TP7cenW0zaGDKmMe2aswh3Oogol3Ct9m8LHYZYqPWmhLSqvB2K7fCZP-q-SBCjWA9jL7HEZxBqgIhBaRnNcs Oct 27 03:49:06.399074 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:49:06.399074 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:49:06.399074 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:49:06.399074 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:49:06.399074 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:49:06.399074 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:49:06.399074 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 86b90d4cb5eb42958248b6f82516ce19 Oct 27 03:49:06.399074 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ServersTestJSON-1724631621 Oct 27 03:49:06.399074 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:49:06.399074 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:49:06.399074 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86b90d4cb5eb42958248b6f82516ce19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/86b90d4cb5eb42958248b6f82516ce19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86b90d4cb5eb42958248b6f82516ce19"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_86b90d4cb5eb42958248b6f82516ce19"}]}] Oct 27 03:49:06.399074 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ServersTestJSON-1724631621 Oct 27 03:49:06.399074 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 86b90d4cb5eb42958248b6f82516ce19 Oct 27 03:49:06.399074 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ServersTestJSON-1724631621 Oct 27 03:49:06.399074 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ServersTestJSON-1724631621-project Oct 27 03:49:06.399074 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:49:06.399074 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:49:06.399074 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: ca2da57f02884a968d685b53a5399e46 Oct 27 03:49:06.399074 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ServersTestJSON-1724631621-project Oct 27 03:49:06.399074 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:49:06.399074 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 18be006a-739d-4fe2-a04d-1db382b4aeeb could not be found. Oct 27 03:49:06.399074 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '18be006a-739d-4fe2-a04d-1db382b4aeeb'} Oct 27 03:49:06.399074 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:49:06.399074 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:49:06.399074 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:49:06.399074 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:49:06.399074 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:49:06.399074 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:49:06.399074 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:49:06.399074 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:49:06.399074 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:49:06.399074 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:49:06.399074 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18be006a-739d-4fe2-a04d-1db382b4aeeb could not be found. Oct 27 03:49:06.399074 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:06.399074 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:49:06.399074 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:06.399074 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:49:06.399074 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:49:06.399074 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:49:06.399074 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:49:06.399074 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:49:06.399074 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:49:06.399074 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:49:06.399074 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 03:49:06.399074 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 03:49:06.399074 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 03:49:06.399074 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 03:49:06.399074 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:49:06.399074 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:49:06.399074 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:49:06.399074 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:49:06.399074 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18be006a-739d-4fe2-a04d-1db382b4aeeb could not be found. Oct 27 03:49:06.405970 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:06.405970 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:49:06.405970 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:06.405970 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:49:06.405970 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:49:06.405970 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:49:06.405970 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:49:06.405970 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:49:06.405970 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18be006a-739d-4fe2-a04d-1db382b4aeeb could not be found. Oct 27 03:49:06.405970 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:06.405970 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b0c6e40e-b843-4667-af19-78aff08f7780 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Returning 404 to user: Instance 18be006a-739d-4fe2-a04d-1db382b4aeeb could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:49:06.405970 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b0c6e40e-b843-4667-af19-78aff08f7780 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "DELETE /compute/v2.1/servers/18be006a-739d-4fe2-a04d-1db382b4aeeb" status: 404 len: 111 microversion: 2.1 time: 0.077146 Oct 27 03:49:06.405970 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2893/6076] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:49:06 2022] DELETE /compute/v2.1/servers/18be006a-739d-4fe2-a04d-1db382b4aeeb => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:49:06.418212 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4cc4a019-91b5-47b2-a488-ee64d439cb9e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:49:06.418929 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4cc4a019-91b5-47b2-a488-ee64d439cb9e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 18be006a-739d-4fe2-a04d-1db382b4aeeb] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:49:06.426913 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-100774e8-bd4c-4f2e-800c-a83cbfb8634f tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Going to run 1 instances... {{(pid=121001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:49:06.434808 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-100774e8-bd4c-4f2e-800c-a83cbfb8634f tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] [instance: dbac6549-6ae2-4521-b177-7e3ccba76d8e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:49:06.447672 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4cc4a019-91b5-47b2-a488-ee64d439cb9e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:06.448173 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4cc4a019-91b5-47b2-a488-ee64d439cb9e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:06.449218 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4cc4a019-91b5-47b2-a488-ee64d439cb9e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:06.449939 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4cc4a019-91b5-47b2-a488-ee64d439cb9e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:06.464093 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4cc4a019-91b5-47b2-a488-ee64d439cb9e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:06.469147 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4cc4a019-91b5-47b2-a488-ee64d439cb9e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:06.493808 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-4cc4a019-91b5-47b2-a488-ee64d439cb9e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] HTTP exception thrown: Instance 18be006a-739d-4fe2-a04d-1db382b4aeeb could not be found. Oct 27 03:49:06.495399 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4cc4a019-91b5-47b2-a488-ee64d439cb9e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Request method failure captured: Oct 27 03:49:06.495399 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/18be006a-739d-4fe2-a04d-1db382b4aeeb HTTP/1.1 Oct 27 03:49:06.495399 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:49:06.495399 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:49:06.495399 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:49:06.495399 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:49:06.495399 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:49:06.495399 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:49:06.495399 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:49:06.495399 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:49:06.495399 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWf7ao454EXpcvqw57oZ6kUl55rrrabqqRcgdR7_bXGBd3EhUlwYyYuxAfl-nrBiMviq2ipmr2mbr4b0cgBTMbKDOZJ9TP7cenW0zaGDKmMe2aswh3Oogol3Ct9m8LHYZYqPWmhLSqvB2K7fCZP-q-SBCjWA9jL7HEZxBqgIhBaRnNcs Oct 27 03:49:06.495399 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:49:06.495399 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:49:06.495399 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:49:06.495399 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:49:06.495399 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:49:06.495399 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:49:06.495399 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 86b90d4cb5eb42958248b6f82516ce19 Oct 27 03:49:06.495399 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ServersTestJSON-1724631621 Oct 27 03:49:06.495399 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:49:06.495399 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:49:06.495399 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86b90d4cb5eb42958248b6f82516ce19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/86b90d4cb5eb42958248b6f82516ce19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86b90d4cb5eb42958248b6f82516ce19"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_86b90d4cb5eb42958248b6f82516ce19"}]}] Oct 27 03:49:06.495399 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ServersTestJSON-1724631621 Oct 27 03:49:06.495399 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 86b90d4cb5eb42958248b6f82516ce19 Oct 27 03:49:06.495399 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ServersTestJSON-1724631621 Oct 27 03:49:06.495399 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ServersTestJSON-1724631621-project Oct 27 03:49:06.495399 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:49:06.495399 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:49:06.495399 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: ca2da57f02884a968d685b53a5399e46 Oct 27 03:49:06.495399 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ServersTestJSON-1724631621-project Oct 27 03:49:06.495399 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:49:06.495399 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 18be006a-739d-4fe2-a04d-1db382b4aeeb could not be found. Oct 27 03:49:06.495399 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '18be006a-739d-4fe2-a04d-1db382b4aeeb'} Oct 27 03:49:06.495399 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:49:06.495399 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:49:06.495399 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:49:06.495399 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:49:06.495399 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:49:06.495399 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:49:06.495399 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:49:06.495399 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:49:06.495399 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:49:06.495399 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:49:06.495399 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18be006a-739d-4fe2-a04d-1db382b4aeeb could not be found. Oct 27 03:49:06.495399 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:06.495399 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:49:06.495399 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:06.495399 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:49:06.495399 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:49:06.495399 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:49:06.495399 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:49:06.495399 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:49:06.495399 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:49:06.495399 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:49:06.495399 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:49:06.495399 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:49:06.495399 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:49:06.495399 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:49:06.495399 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:49:06.495399 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:49:06.495399 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18be006a-739d-4fe2-a04d-1db382b4aeeb could not be found. Oct 27 03:49:06.495399 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:06.495399 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:49:06.495399 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:06.500298 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:49:06.500298 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:49:06.500298 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:49:06.500298 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:49:06.500298 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:49:06.500298 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18be006a-739d-4fe2-a04d-1db382b4aeeb could not be found. Oct 27 03:49:06.500298 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:06.501599 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4cc4a019-91b5-47b2-a488-ee64d439cb9e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Returning 404 to user: Instance 18be006a-739d-4fe2-a04d-1db382b4aeeb could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:49:06.502527 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4cc4a019-91b5-47b2-a488-ee64d439cb9e tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/18be006a-739d-4fe2-a04d-1db382b4aeeb" status: 404 len: 111 microversion: 2.1 time: 0.094150 Oct 27 03:49:06.503222 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2894/6077] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:49:06 2022] GET /compute/v2.1/servers/18be006a-739d-4fe2-a04d-1db382b4aeeb => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:49:06.511608 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6660e54f-c409-4456-be3c-26e02f360d19 tempest-VolumesSnapshotsTestJSON-621552700 tempest-VolumesSnapshotsTestJSON-621552700-project] Calling method '.version_select at 0x7f7dd98b1040>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:49:06.586603 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6660e54f-c409-4456-be3c-26e02f360d19 tempest-VolumesSnapshotsTestJSON-621552700 tempest-VolumesSnapshotsTestJSON-621552700-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/a19115bc-701f-4b10-b148-28de308616bd" status: 200 len: 344 microversion: 2.1 time: 0.082127 Oct 27 03:49:06.594516 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2895/6078] 10.222.0.20 () {58 vars in 1245 bytes} [Thu Oct 27 03:49:06 2022] GET /compute/v2.1/os-volumes/a19115bc-701f-4b10-b148-28de308616bd => generated 344 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:49:06.599732 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4b5548d4-e5aa-4198-825a-6aa3516b2ee0 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:49:06.600490 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4b5548d4-e5aa-4198-825a-6aa3516b2ee0 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: de89920a-61c7-4e66-8f1f-26182d99464f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:49:06.616886 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-4b5548d4-e5aa-4198-825a-6aa3516b2ee0 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] HTTP exception thrown: Instance de89920a-61c7-4e66-8f1f-26182d99464f could not be found. Oct 27 03:49:06.623740 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4b5548d4-e5aa-4198-825a-6aa3516b2ee0 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Request method failure captured: Oct 27 03:49:06.623740 n-d-862769-1 devstack@n-api.service[121000]: request: DELETE /compute/v2.1/servers/de89920a-61c7-4e66-8f1f-26182d99464f HTTP/1.1 Oct 27 03:49:06.623740 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:49:06.623740 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:49:06.623740 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:49:06.623740 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:49:06.623740 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:49:06.623740 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:49:06.623740 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:49:06.623740 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:49:06.623740 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWf7ao454EXpcvqw57oZ6kUl55rrrabqqRcgdR7_bXGBd3EhUlwYyYuxAfl-nrBiMviq2ipmr2mbr4b0cgBTMbKDOZJ9TP7cenW0zaGDKmMe2aswh3Oogol3Ct9m8LHYZYqPWmhLSqvB2K7fCZP-q-SBCjWA9jL7HEZxBqgIhBaRnNcs Oct 27 03:49:06.623740 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:49:06.623740 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:49:06.623740 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:49:06.623740 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:49:06.623740 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:49:06.623740 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:49:06.623740 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 86b90d4cb5eb42958248b6f82516ce19 Oct 27 03:49:06.623740 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ServersTestJSON-1724631621 Oct 27 03:49:06.623740 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:49:06.623740 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:49:06.623740 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86b90d4cb5eb42958248b6f82516ce19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/86b90d4cb5eb42958248b6f82516ce19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86b90d4cb5eb42958248b6f82516ce19"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_86b90d4cb5eb42958248b6f82516ce19"}]}] Oct 27 03:49:06.623740 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ServersTestJSON-1724631621 Oct 27 03:49:06.623740 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 86b90d4cb5eb42958248b6f82516ce19 Oct 27 03:49:06.623740 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ServersTestJSON-1724631621 Oct 27 03:49:06.623740 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ServersTestJSON-1724631621-project Oct 27 03:49:06.623740 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:49:06.623740 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:49:06.623740 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: ca2da57f02884a968d685b53a5399e46 Oct 27 03:49:06.623740 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ServersTestJSON-1724631621-project Oct 27 03:49:06.623740 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:49:06.623740 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance de89920a-61c7-4e66-8f1f-26182d99464f could not be found. Oct 27 03:49:06.623740 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': 'de89920a-61c7-4e66-8f1f-26182d99464f'} Oct 27 03:49:06.623740 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:49:06.623740 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:49:06.623740 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:49:06.623740 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:49:06.623740 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:49:06.623740 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:49:06.623740 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 03:49:06.623740 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 03:49:06.623740 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de89920a-61c7-4e66-8f1f-26182d99464f could not be found. Oct 27 03:49:06.623740 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:06.623740 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:49:06.623740 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:06.623740 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:49:06.623740 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:49:06.623740 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:49:06.623740 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:49:06.623740 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:49:06.623740 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:49:06.623740 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:49:06.623740 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 03:49:06.623740 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 03:49:06.623740 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 03:49:06.623740 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 03:49:06.623740 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:49:06.623740 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:49:06.623740 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:49:06.623740 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:49:06.623740 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de89920a-61c7-4e66-8f1f-26182d99464f could not be found. Oct 27 03:49:06.623740 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:06.623740 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:49:06.623740 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:06.633774 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:49:06.633774 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:49:06.633774 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:49:06.633774 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:49:06.633774 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:49:06.633774 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de89920a-61c7-4e66-8f1f-26182d99464f could not be found. Oct 27 03:49:06.633774 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:06.633774 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4b5548d4-e5aa-4198-825a-6aa3516b2ee0 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Returning 404 to user: Instance de89920a-61c7-4e66-8f1f-26182d99464f could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:49:06.633774 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4b5548d4-e5aa-4198-825a-6aa3516b2ee0 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "DELETE /compute/v2.1/servers/de89920a-61c7-4e66-8f1f-26182d99464f" status: 404 len: 111 microversion: 2.1 time: 0.029287 Oct 27 03:49:06.633774 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2896/6079] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:49:06 2022] DELETE /compute/v2.1/servers/de89920a-61c7-4e66-8f1f-26182d99464f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:49:06.638972 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1e65f84a-9cd1-4bba-aa9c-24e30886096f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:49:06.644281 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1e65f84a-9cd1-4bba-aa9c-24e30886096f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: de89920a-61c7-4e66-8f1f-26182d99464f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:49:06.663312 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-1e65f84a-9cd1-4bba-aa9c-24e30886096f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] HTTP exception thrown: Instance de89920a-61c7-4e66-8f1f-26182d99464f could not be found. Oct 27 03:49:06.664879 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1e65f84a-9cd1-4bba-aa9c-24e30886096f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Request method failure captured: Oct 27 03:49:06.664879 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/de89920a-61c7-4e66-8f1f-26182d99464f HTTP/1.1 Oct 27 03:49:06.664879 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:49:06.664879 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:49:06.664879 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:49:06.664879 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:49:06.664879 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:49:06.664879 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:49:06.664879 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:49:06.664879 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:49:06.664879 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWf7ao454EXpcvqw57oZ6kUl55rrrabqqRcgdR7_bXGBd3EhUlwYyYuxAfl-nrBiMviq2ipmr2mbr4b0cgBTMbKDOZJ9TP7cenW0zaGDKmMe2aswh3Oogol3Ct9m8LHYZYqPWmhLSqvB2K7fCZP-q-SBCjWA9jL7HEZxBqgIhBaRnNcs Oct 27 03:49:06.664879 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:49:06.664879 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:49:06.664879 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:49:06.664879 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:49:06.664879 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:49:06.664879 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:49:06.664879 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 86b90d4cb5eb42958248b6f82516ce19 Oct 27 03:49:06.664879 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ServersTestJSON-1724631621 Oct 27 03:49:06.664879 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:49:06.664879 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:49:06.664879 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86b90d4cb5eb42958248b6f82516ce19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/86b90d4cb5eb42958248b6f82516ce19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86b90d4cb5eb42958248b6f82516ce19"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_86b90d4cb5eb42958248b6f82516ce19"}]}] Oct 27 03:49:06.664879 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ServersTestJSON-1724631621 Oct 27 03:49:06.664879 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 86b90d4cb5eb42958248b6f82516ce19 Oct 27 03:49:06.664879 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ServersTestJSON-1724631621 Oct 27 03:49:06.664879 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ServersTestJSON-1724631621-project Oct 27 03:49:06.664879 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:49:06.664879 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:49:06.664879 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: ca2da57f02884a968d685b53a5399e46 Oct 27 03:49:06.664879 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ServersTestJSON-1724631621-project Oct 27 03:49:06.664879 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:49:06.664879 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance de89920a-61c7-4e66-8f1f-26182d99464f could not be found. Oct 27 03:49:06.664879 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': 'de89920a-61c7-4e66-8f1f-26182d99464f'} Oct 27 03:49:06.664879 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:49:06.664879 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:49:06.664879 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:49:06.664879 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:49:06.664879 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:49:06.664879 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:49:06.664879 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 03:49:06.664879 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 03:49:06.664879 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de89920a-61c7-4e66-8f1f-26182d99464f could not be found. Oct 27 03:49:06.664879 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:06.664879 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:49:06.664879 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:06.664879 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:49:06.664879 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:49:06.664879 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:49:06.664879 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:49:06.664879 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:49:06.664879 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:49:06.664879 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:49:06.664879 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:49:06.664879 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:49:06.664879 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:49:06.664879 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:49:06.664879 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:49:06.664879 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:49:06.664879 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de89920a-61c7-4e66-8f1f-26182d99464f could not be found. Oct 27 03:49:06.664879 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:06.664879 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:49:06.664879 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:06.664879 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:49:06.664879 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:49:06.668551 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:49:06.668551 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:49:06.668551 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:49:06.668551 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de89920a-61c7-4e66-8f1f-26182d99464f could not be found. Oct 27 03:49:06.668551 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:06.676029 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1e65f84a-9cd1-4bba-aa9c-24e30886096f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Returning 404 to user: Instance de89920a-61c7-4e66-8f1f-26182d99464f could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:49:06.677235 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1e65f84a-9cd1-4bba-aa9c-24e30886096f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/de89920a-61c7-4e66-8f1f-26182d99464f" status: 404 len: 111 microversion: 2.1 time: 0.043641 Oct 27 03:49:06.678003 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2897/6080] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:49:06 2022] GET /compute/v2.1/servers/de89920a-61c7-4e66-8f1f-26182d99464f => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:49:06.686793 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e63843ad-6c55-4685-9115-5fdfd141b47d tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:49:06.690654 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e63843ad-6c55-4685-9115-5fdfd141b47d tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 1b2e58e9-cd92-4a71-91f6-1e77ad99a685] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:49:06.706991 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e63843ad-6c55-4685-9115-5fdfd141b47d tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:06.707973 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e63843ad-6c55-4685-9115-5fdfd141b47d tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:06.708421 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e63843ad-6c55-4685-9115-5fdfd141b47d tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:06.709148 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e63843ad-6c55-4685-9115-5fdfd141b47d tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:06.709606 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e63843ad-6c55-4685-9115-5fdfd141b47d tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:06.710068 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e63843ad-6c55-4685-9115-5fdfd141b47d tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:06.762077 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e63843ad-6c55-4685-9115-5fdfd141b47d tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 1b2e58e9-cd92-4a71-91f6-1e77ad99a685] Going to try to terminate instance {{(pid=121000) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:49:06.815885 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-100774e8-bd4c-4f2e-800c-a83cbfb8634f tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.915598 Oct 27 03:49:06.817765 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3184/6081] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:49:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 2918 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 03:49:06.833400 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-69900e8e-f07c-4cf0-8e07-e82373007e27 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:49:06.835216 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-69900e8e-f07c-4cf0-8e07-e82373007e27 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] [instance: dbac6549-6ae2-4521-b177-7e3ccba76d8e] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:49:06.914904 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-69900e8e-f07c-4cf0-8e07-e82373007e27 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc1e7eafd7948279f08eb5ad52f5609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d03faa410840e0ae6d7523188d63b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:49:06.923949 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-69900e8e-f07c-4cf0-8e07-e82373007e27 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] 10.222.0.20 "GET /compute/v2.1/servers/dbac6549-6ae2-4521-b177-7e3ccba76d8e" status: 200 len: 1227 microversion: 2.1 time: 0.100003 Oct 27 03:49:06.924521 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3185/6082] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:49:06 2022] GET /compute/v2.1/servers/dbac6549-6ae2-4521-b177-7e3ccba76d8e => generated 1227 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:49:07.294160 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e63843ad-6c55-4685-9115-5fdfd141b47d tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1b2e58e9-cd92-4a71-91f6-1e77ad99a685" status: 204 len: 0 microversion: 2.1 time: 0.608541 Oct 27 03:49:07.296183 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2898/6083] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:49:06 2022] DELETE /compute/v2.1/servers/1b2e58e9-cd92-4a71-91f6-1e77ad99a685 => generated 0 bytes in 614 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 03:49:07.304733 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d1f68197-702b-44a1-ae66-2323867943c6 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:49:07.306374 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d1f68197-702b-44a1-ae66-2323867943c6 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 1b2e58e9-cd92-4a71-91f6-1e77ad99a685] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:49:07.322281 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d1f68197-702b-44a1-ae66-2323867943c6 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:07.322281 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d1f68197-702b-44a1-ae66-2323867943c6 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:07.347882 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d1f68197-702b-44a1-ae66-2323867943c6 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:07.350639 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d1f68197-702b-44a1-ae66-2323867943c6 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:07.351435 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d1f68197-702b-44a1-ae66-2323867943c6 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:07.357440 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d1f68197-702b-44a1-ae66-2323867943c6 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:07.602921 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-eee883fe-ac31-49f7-afae-768faf9ddc46 tempest-VolumesSnapshotsTestJSON-621552700 tempest-VolumesSnapshotsTestJSON-621552700-project] Calling method '.version_select at 0x7f7dd9dc70d0>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:49:07.630996 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d1f68197-702b-44a1-ae66-2323867943c6 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:49:07.661633 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d1f68197-702b-44a1-ae66-2323867943c6 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/1b2e58e9-cd92-4a71-91f6-1e77ad99a685" status: 200 len: 1480 microversion: 2.1 time: 0.347315 Oct 27 03:49:07.661633 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3186/6084] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:49:07 2022] GET /compute/v2.1/servers/1b2e58e9-cd92-4a71-91f6-1e77ad99a685 => generated 1480 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:49:07.690232 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-eee883fe-ac31-49f7-afae-768faf9ddc46 tempest-VolumesSnapshotsTestJSON-621552700 tempest-VolumesSnapshotsTestJSON-621552700-project] HTTP exception thrown: Volume a19115bc-701f-4b10-b148-28de308616bd could not be found. Oct 27 03:49:07.690232 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-eee883fe-ac31-49f7-afae-768faf9ddc46 tempest-VolumesSnapshotsTestJSON-621552700 tempest-VolumesSnapshotsTestJSON-621552700-project] Request method failure captured: Oct 27 03:49:07.690232 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/os-volumes/a19115bc-701f-4b10-b148-28de308616bd HTTP/1.1 Oct 27 03:49:07.690232 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:49:07.690232 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:49:07.690232 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:49:07.690232 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:49:07.690232 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:49:07.690232 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:49:07.690232 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:49:07.690232 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:49:07.690232 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWf-ip-kdPwp4iiL61NdGhjkvc_zalyJawbf5omtNOKoTZ40SpYFbcrU0kQFV1u-bieOhgg7I7vdz9IXlY70btK9jCSHFnoFehJFc8hmrSx3gRiUyxE1tNqcKgDboCDRLDlACTDnTPvV4Y-zuHgHg629tC0eDUI3CItQBRi7i-BiSzac Oct 27 03:49:07.690232 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:49:07.690232 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:49:07.690232 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:49:07.690232 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:49:07.690232 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:49:07.690232 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:49:07.690232 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: cc14a49f9b534978bf1ce77ce2e7bb59 Oct 27 03:49:07.690232 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-621552700 Oct 27 03:49:07.690232 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:49:07.690232 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:49:07.690232 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cc14a49f9b534978bf1ce77ce2e7bb59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/cc14a49f9b534978bf1ce77ce2e7bb59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cc14a49f9b534978bf1ce77ce2e7bb59"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_cc14a49f9b534978bf1ce77ce2e7bb59"}]}] Oct 27 03:49:07.690232 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-VolumesSnapshotsTestJSON-621552700 Oct 27 03:49:07.690232 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: cc14a49f9b534978bf1ce77ce2e7bb59 Oct 27 03:49:07.690232 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-621552700 Oct 27 03:49:07.690232 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-VolumesSnapshotsTestJSON-621552700-project Oct 27 03:49:07.690232 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:49:07.690232 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:49:07.690232 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 4ee93fdea79840e59dab1a8305116e78 Oct 27 03:49:07.690232 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-VolumesSnapshotsTestJSON-621552700-project Oct 27 03:49:07.690232 n-d-862769-1 devstack@n-api.service[121000]: method: Oct 27 03:49:07.690232 n-d-862769-1 devstack@n-api.service[121000]: exception: Volume a19115bc-701f-4b10-b148-28de308616bd could not be found. Oct 27 03:49:07.690232 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': 'a19115bc-701f-4b10-b148-28de308616bd'} Oct 27 03:49:07.690232 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:49:07.690232 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:49:07.690232 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 03:49:07.690232 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 03:49:07.690232 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 27 03:49:07.690232 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 27 03:49:07.690232 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 27 03:49:07.690232 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 27 03:49:07.690232 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 03:49:07.690232 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 03:49:07.690232 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 03:49:07.690232 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 03:49:07.690232 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 03:49:07.690232 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 03:49:07.690232 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 03:49:07.690232 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 03:49:07.690232 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a19115bc-701f-4b10-b148-28de308616bd could not be found. (HTTP 404) (Request-ID: req-a80fd93f-2af3-4d73-8065-1978016a7438) Oct 27 03:49:07.690232 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:07.690232 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:49:07.690232 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:07.690232 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:49:07.690232 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 27 03:49:07.690232 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 27 03:49:07.690232 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 27 03:49:07.690232 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 27 03:49:07.690232 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 27 03:49:07.690232 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 27 03:49:07.696452 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 27 03:49:07.696452 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 27 03:49:07.696452 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 03:49:07.696452 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 03:49:07.696452 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 27 03:49:07.696452 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 27 03:49:07.696452 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 27 03:49:07.696452 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 27 03:49:07.696452 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 03:49:07.696452 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 03:49:07.696452 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 03:49:07.696452 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 03:49:07.696452 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 03:49:07.696452 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 03:49:07.696452 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 03:49:07.696452 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 03:49:07.696452 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a19115bc-701f-4b10-b148-28de308616bd could not be found. Oct 27 03:49:07.696452 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:07.696452 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:49:07.696452 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:07.696452 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:49:07.696452 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:49:07.696452 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:49:07.696452 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:49:07.696452 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:49:07.696452 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:49:07.696452 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:49:07.696452 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:49:07.696452 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:49:07.696452 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 27 03:49:07.696452 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:49:07.696452 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a19115bc-701f-4b10-b148-28de308616bd could not be found. Oct 27 03:49:07.696452 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:07.696452 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:49:07.696452 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:07.696452 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:49:07.696452 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:49:07.696452 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:49:07.696452 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:49:07.696452 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:49:07.696452 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a19115bc-701f-4b10-b148-28de308616bd could not be found. Oct 27 03:49:07.696452 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:07.696452 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-eee883fe-ac31-49f7-afae-768faf9ddc46 tempest-VolumesSnapshotsTestJSON-621552700 tempest-VolumesSnapshotsTestJSON-621552700-project] Returning 404 to user: Volume a19115bc-701f-4b10-b148-28de308616bd could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:49:07.696452 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-eee883fe-ac31-49f7-afae-768faf9ddc46 tempest-VolumesSnapshotsTestJSON-621552700 tempest-VolumesSnapshotsTestJSON-621552700-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/a19115bc-701f-4b10-b148-28de308616bd" status: 404 len: 109 microversion: 2.1 time: 0.092220 Oct 27 03:49:07.696452 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2899/6085] 10.222.0.20 () {58 vars in 1245 bytes} [Thu Oct 27 03:49:07 2022] GET /compute/v2.1/os-volumes/a19115bc-701f-4b10-b148-28de308616bd => generated 109 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:49:07.705391 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-68d22479-4bca-463b-a616-910c40b13e94 tempest-VolumesSnapshotsTestJSON-621552700 tempest-VolumesSnapshotsTestJSON-621552700-project] Calling method '.version_select at 0x7f7dd95a18b0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:49:07.764628 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-68d22479-4bca-463b-a616-910c40b13e94 tempest-VolumesSnapshotsTestJSON-621552700 tempest-VolumesSnapshotsTestJSON-621552700-project] HTTP exception thrown: Volume a19115bc-701f-4b10-b148-28de308616bd could not be found. Oct 27 03:49:07.766750 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-68d22479-4bca-463b-a616-910c40b13e94 tempest-VolumesSnapshotsTestJSON-621552700 tempest-VolumesSnapshotsTestJSON-621552700-project] Request method failure captured: Oct 27 03:49:07.766750 n-d-862769-1 devstack@n-api.service[121001]: request: DELETE /compute/v2.1/os-volumes/a19115bc-701f-4b10-b148-28de308616bd HTTP/1.1 Oct 27 03:49:07.766750 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:49:07.766750 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:49:07.766750 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:49:07.766750 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:49:07.766750 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:49:07.766750 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:49:07.766750 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:49:07.766750 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:49:07.766750 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWf-ip-kdPwp4iiL61NdGhjkvc_zalyJawbf5omtNOKoTZ40SpYFbcrU0kQFV1u-bieOhgg7I7vdz9IXlY70btK9jCSHFnoFehJFc8hmrSx3gRiUyxE1tNqcKgDboCDRLDlACTDnTPvV4Y-zuHgHg629tC0eDUI3CItQBRi7i-BiSzac Oct 27 03:49:07.766750 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:49:07.766750 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:49:07.766750 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:49:07.766750 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:49:07.766750 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:49:07.766750 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:49:07.766750 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: cc14a49f9b534978bf1ce77ce2e7bb59 Oct 27 03:49:07.766750 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-621552700 Oct 27 03:49:07.766750 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:49:07.766750 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:49:07.766750 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cc14a49f9b534978bf1ce77ce2e7bb59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/cc14a49f9b534978bf1ce77ce2e7bb59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cc14a49f9b534978bf1ce77ce2e7bb59"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_cc14a49f9b534978bf1ce77ce2e7bb59"}]}] Oct 27 03:49:07.766750 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-VolumesSnapshotsTestJSON-621552700 Oct 27 03:49:07.766750 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: cc14a49f9b534978bf1ce77ce2e7bb59 Oct 27 03:49:07.766750 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-621552700 Oct 27 03:49:07.766750 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-VolumesSnapshotsTestJSON-621552700-project Oct 27 03:49:07.766750 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:49:07.766750 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:49:07.766750 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 4ee93fdea79840e59dab1a8305116e78 Oct 27 03:49:07.766750 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-VolumesSnapshotsTestJSON-621552700-project Oct 27 03:49:07.766750 n-d-862769-1 devstack@n-api.service[121001]: method: Oct 27 03:49:07.766750 n-d-862769-1 devstack@n-api.service[121001]: exception: Volume a19115bc-701f-4b10-b148-28de308616bd could not be found. Oct 27 03:49:07.766750 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': 'a19115bc-701f-4b10-b148-28de308616bd'} Oct 27 03:49:07.766750 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:49:07.766750 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:49:07.766750 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 03:49:07.766750 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 03:49:07.766750 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 27 03:49:07.766750 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 27 03:49:07.766750 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 27 03:49:07.766750 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 27 03:49:07.766750 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 27 03:49:07.766750 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 27 03:49:07.766750 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 27 03:49:07.766750 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 27 03:49:07.766750 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 03:49:07.766750 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 03:49:07.766750 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 03:49:07.766750 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 03:49:07.766750 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a19115bc-701f-4b10-b148-28de308616bd could not be found. (HTTP 404) (Request-ID: req-58480d3e-9a3b-4ade-b4da-b96b5220a1c1) Oct 27 03:49:07.766750 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:49:07.766750 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:49:07.766750 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:49:07.766750 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:49:07.766750 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 27 03:49:07.766750 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 27 03:49:07.766750 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 27 03:49:07.766750 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 27 03:49:07.766750 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 27 03:49:07.766750 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 27 03:49:07.766750 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 27 03:49:07.766750 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 27 03:49:07.766750 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 03:49:07.771019 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 03:49:07.771019 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 27 03:49:07.771019 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 27 03:49:07.771019 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 27 03:49:07.771019 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 27 03:49:07.771019 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 27 03:49:07.771019 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 27 03:49:07.771019 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 27 03:49:07.771019 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 27 03:49:07.771019 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 03:49:07.771019 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 03:49:07.771019 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 03:49:07.771019 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 03:49:07.771019 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a19115bc-701f-4b10-b148-28de308616bd could not be found. Oct 27 03:49:07.771019 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:49:07.771019 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:49:07.771019 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:49:07.771019 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:49:07.771019 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:49:07.771019 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:49:07.771019 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:49:07.771019 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:49:07.771019 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:49:07.771019 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:49:07.771019 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:49:07.771019 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:49:07.771019 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 27 03:49:07.771019 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:49:07.771019 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a19115bc-701f-4b10-b148-28de308616bd could not be found. Oct 27 03:49:07.771019 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:49:07.771019 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:49:07.771019 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:49:07.771019 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:49:07.771019 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:49:07.771019 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:49:07.771019 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:49:07.771019 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:49:07.771019 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a19115bc-701f-4b10-b148-28de308616bd could not be found. Oct 27 03:49:07.771019 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:49:07.771019 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-68d22479-4bca-463b-a616-910c40b13e94 tempest-VolumesSnapshotsTestJSON-621552700 tempest-VolumesSnapshotsTestJSON-621552700-project] Returning 404 to user: Volume a19115bc-701f-4b10-b148-28de308616bd could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:49:07.771019 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-68d22479-4bca-463b-a616-910c40b13e94 tempest-VolumesSnapshotsTestJSON-621552700 tempest-VolumesSnapshotsTestJSON-621552700-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/a19115bc-701f-4b10-b148-28de308616bd" status: 404 len: 109 microversion: 2.1 time: 0.071056 Oct 27 03:49:07.773794 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3187/6086] 10.222.0.20 () {58 vars in 1248 bytes} [Thu Oct 27 03:49:07 2022] DELETE /compute/v2.1/os-volumes/a19115bc-701f-4b10-b148-28de308616bd => generated 109 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:49:07.778963 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f1f5563f-6752-45b9-8022-37ab72c1aa32 tempest-VolumesSnapshotsTestJSON-621552700 tempest-VolumesSnapshotsTestJSON-621552700-project] Calling method '.version_select at 0x7f7dd98c0dc0>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:49:07.853890 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-f1f5563f-6752-45b9-8022-37ab72c1aa32 tempest-VolumesSnapshotsTestJSON-621552700 tempest-VolumesSnapshotsTestJSON-621552700-project] HTTP exception thrown: Volume a19115bc-701f-4b10-b148-28de308616bd could not be found. Oct 27 03:49:07.856975 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f1f5563f-6752-45b9-8022-37ab72c1aa32 tempest-VolumesSnapshotsTestJSON-621552700 tempest-VolumesSnapshotsTestJSON-621552700-project] Request method failure captured: Oct 27 03:49:07.856975 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/os-volumes/a19115bc-701f-4b10-b148-28de308616bd HTTP/1.1 Oct 27 03:49:07.856975 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:49:07.856975 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:49:07.856975 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:49:07.856975 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:49:07.856975 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:49:07.856975 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:49:07.856975 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:49:07.856975 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:49:07.856975 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWf-ip-kdPwp4iiL61NdGhjkvc_zalyJawbf5omtNOKoTZ40SpYFbcrU0kQFV1u-bieOhgg7I7vdz9IXlY70btK9jCSHFnoFehJFc8hmrSx3gRiUyxE1tNqcKgDboCDRLDlACTDnTPvV4Y-zuHgHg629tC0eDUI3CItQBRi7i-BiSzac Oct 27 03:49:07.856975 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:49:07.856975 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:49:07.856975 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:49:07.856975 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:49:07.856975 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:49:07.856975 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:49:07.856975 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: cc14a49f9b534978bf1ce77ce2e7bb59 Oct 27 03:49:07.856975 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-621552700 Oct 27 03:49:07.856975 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:49:07.856975 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:49:07.856975 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cc14a49f9b534978bf1ce77ce2e7bb59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/cc14a49f9b534978bf1ce77ce2e7bb59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cc14a49f9b534978bf1ce77ce2e7bb59"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_cc14a49f9b534978bf1ce77ce2e7bb59"}]}] Oct 27 03:49:07.856975 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-VolumesSnapshotsTestJSON-621552700 Oct 27 03:49:07.856975 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: cc14a49f9b534978bf1ce77ce2e7bb59 Oct 27 03:49:07.856975 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-621552700 Oct 27 03:49:07.856975 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-VolumesSnapshotsTestJSON-621552700-project Oct 27 03:49:07.856975 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:49:07.856975 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:49:07.856975 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 4ee93fdea79840e59dab1a8305116e78 Oct 27 03:49:07.856975 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-VolumesSnapshotsTestJSON-621552700-project Oct 27 03:49:07.856975 n-d-862769-1 devstack@n-api.service[121000]: method: Oct 27 03:49:07.856975 n-d-862769-1 devstack@n-api.service[121000]: exception: Volume a19115bc-701f-4b10-b148-28de308616bd could not be found. Oct 27 03:49:07.856975 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': 'a19115bc-701f-4b10-b148-28de308616bd'} Oct 27 03:49:07.856975 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:49:07.856975 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:49:07.856975 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 03:49:07.856975 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 03:49:07.856975 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 27 03:49:07.856975 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 27 03:49:07.856975 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 27 03:49:07.856975 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 27 03:49:07.856975 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 03:49:07.856975 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 03:49:07.856975 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 03:49:07.856975 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 03:49:07.856975 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 03:49:07.856975 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 03:49:07.856975 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 03:49:07.856975 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 03:49:07.856975 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a19115bc-701f-4b10-b148-28de308616bd could not be found. (HTTP 404) (Request-ID: req-ebfb8e1c-1992-4141-beaf-832fd229da98) Oct 27 03:49:07.856975 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:07.856975 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:49:07.856975 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:07.856975 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:49:07.856975 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 27 03:49:07.856975 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 27 03:49:07.856975 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 27 03:49:07.856975 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 27 03:49:07.856975 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 27 03:49:07.856975 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 27 03:49:07.856975 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 27 03:49:07.856975 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 27 03:49:07.856975 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 03:49:07.861183 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 03:49:07.861183 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 27 03:49:07.861183 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 27 03:49:07.861183 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 27 03:49:07.861183 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 27 03:49:07.861183 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 03:49:07.861183 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 03:49:07.861183 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 03:49:07.861183 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 03:49:07.861183 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 03:49:07.861183 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 03:49:07.861183 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 03:49:07.861183 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 03:49:07.861183 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a19115bc-701f-4b10-b148-28de308616bd could not be found. Oct 27 03:49:07.861183 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:07.861183 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:49:07.861183 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:07.861183 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:49:07.861183 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:49:07.861183 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:49:07.861183 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:49:07.861183 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:49:07.861183 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 03:49:07.861183 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 03:49:07.861183 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:49:07.861183 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:49:07.861183 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 27 03:49:07.861183 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:49:07.861183 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a19115bc-701f-4b10-b148-28de308616bd could not be found. Oct 27 03:49:07.861183 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:07.861183 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:49:07.861183 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:07.861183 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:49:07.861183 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:49:07.861183 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:49:07.861183 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:49:07.861183 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:49:07.861183 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a19115bc-701f-4b10-b148-28de308616bd could not be found. Oct 27 03:49:07.861183 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:07.867552 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f1f5563f-6752-45b9-8022-37ab72c1aa32 tempest-VolumesSnapshotsTestJSON-621552700 tempest-VolumesSnapshotsTestJSON-621552700-project] Returning 404 to user: Volume a19115bc-701f-4b10-b148-28de308616bd could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:49:07.867552 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f1f5563f-6752-45b9-8022-37ab72c1aa32 tempest-VolumesSnapshotsTestJSON-621552700 tempest-VolumesSnapshotsTestJSON-621552700-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/a19115bc-701f-4b10-b148-28de308616bd" status: 404 len: 109 microversion: 2.1 time: 0.092166 Oct 27 03:49:07.867552 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2900/6087] 10.222.0.20 () {58 vars in 1245 bytes} [Thu Oct 27 03:49:07 2022] GET /compute/v2.1/os-volumes/a19115bc-701f-4b10-b148-28de308616bd => generated 109 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:49:07.957044 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e9fd2440-b869-4fd5-8cf4-838383d022f3 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:49:07.957781 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e9fd2440-b869-4fd5-8cf4-838383d022f3 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] [instance: dbac6549-6ae2-4521-b177-7e3ccba76d8e] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:49:08.168417 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e9fd2440-b869-4fd5-8cf4-838383d022f3 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc1e7eafd7948279f08eb5ad52f5609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d03faa410840e0ae6d7523188d63b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:49:08.193994 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e9fd2440-b869-4fd5-8cf4-838383d022f3 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] 10.222.0.20 "GET /compute/v2.1/servers/dbac6549-6ae2-4521-b177-7e3ccba76d8e" status: 200 len: 1227 microversion: 2.1 time: 0.246671 Oct 27 03:49:08.200457 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3188/6088] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:49:07 2022] GET /compute/v2.1/servers/dbac6549-6ae2-4521-b177-7e3ccba76d8e => generated 1227 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:49:08.679411 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ba6fc34c-3a4d-40f9-b2a0-5040a49a85e1 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:49:08.680149 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ba6fc34c-3a4d-40f9-b2a0-5040a49a85e1 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 1b2e58e9-cd92-4a71-91f6-1e77ad99a685] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:49:08.692720 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ba6fc34c-3a4d-40f9-b2a0-5040a49a85e1 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:08.693230 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ba6fc34c-3a4d-40f9-b2a0-5040a49a85e1 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:08.705796 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ba6fc34c-3a4d-40f9-b2a0-5040a49a85e1 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:08.706751 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ba6fc34c-3a4d-40f9-b2a0-5040a49a85e1 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:08.707258 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ba6fc34c-3a4d-40f9-b2a0-5040a49a85e1 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:08.707701 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ba6fc34c-3a4d-40f9-b2a0-5040a49a85e1 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:09.177938 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ba6fc34c-3a4d-40f9-b2a0-5040a49a85e1 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:49:09.210243 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ba6fc34c-3a4d-40f9-b2a0-5040a49a85e1 tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/1b2e58e9-cd92-4a71-91f6-1e77ad99a685" status: 200 len: 1480 microversion: 2.1 time: 0.529131 Oct 27 03:49:09.224983 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2901/6089] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:49:08 2022] GET /compute/v2.1/servers/1b2e58e9-cd92-4a71-91f6-1e77ad99a685 => generated 1480 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:49:09.228216 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9399a404-f4de-43e4-814a-a91e6b21f1f6 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:49:09.229601 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-9399a404-f4de-43e4-814a-a91e6b21f1f6 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] [instance: dbac6549-6ae2-4521-b177-7e3ccba76d8e] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:49:09.248329 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9399a404-f4de-43e4-814a-a91e6b21f1f6 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:09.255045 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9399a404-f4de-43e4-814a-a91e6b21f1f6 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:09.259155 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9399a404-f4de-43e4-814a-a91e6b21f1f6 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:09.259708 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9399a404-f4de-43e4-814a-a91e6b21f1f6 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:09.264538 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9399a404-f4de-43e4-814a-a91e6b21f1f6 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:09.266551 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9399a404-f4de-43e4-814a-a91e6b21f1f6 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:09.368748 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9399a404-f4de-43e4-814a-a91e6b21f1f6 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc1e7eafd7948279f08eb5ad52f5609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d03faa410840e0ae6d7523188d63b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:49:09.381458 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9399a404-f4de-43e4-814a-a91e6b21f1f6 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] 10.222.0.20 "GET /compute/v2.1/servers/dbac6549-6ae2-4521-b177-7e3ccba76d8e" status: 200 len: 1231 microversion: 2.1 time: 0.160431 Oct 27 03:49:09.398635 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3189/6090] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:49:09 2022] GET /compute/v2.1/servers/dbac6549-6ae2-4521-b177-7e3ccba76d8e => generated 1231 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:49:09.674852 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-b60064e7-dad2-47ba-8bf1-e2d823996070 req-2b5c0961-2a1a-4b27-9b8d-10d277a36936 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b2e58e9-cd92-4a71-91f6-1e77ad99a685", "name": "network-vif-deleted", "tag": "2bedc222-56b4-48c9-870c-302a1370b2be"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:49:09.693106 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-b60064e7-dad2-47ba-8bf1-e2d823996070 req-2b5c0961-2a1a-4b27-9b8d-10d277a36936 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:09.694281 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-b60064e7-dad2-47ba-8bf1-e2d823996070 req-2b5c0961-2a1a-4b27-9b8d-10d277a36936 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:09.694912 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-b60064e7-dad2-47ba-8bf1-e2d823996070 req-2b5c0961-2a1a-4b27-9b8d-10d277a36936 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:09.716389 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-b60064e7-dad2-47ba-8bf1-e2d823996070 req-2b5c0961-2a1a-4b27-9b8d-10d277a36936 service nova] Creating event network-vif-deleted:2bedc222-56b4-48c9-870c-302a1370b2be for instance 1b2e58e9-cd92-4a71-91f6-1e77ad99a685 on n-h2-862769-1 Oct 27 03:49:09.723829 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-b60064e7-dad2-47ba-8bf1-e2d823996070 req-2b5c0961-2a1a-4b27-9b8d-10d277a36936 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053023 Oct 27 03:49:09.731856 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2902/6091] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:49:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:49:10.278281 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-89763892-4f2b-4419-bd01-49eb6a455b2f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:49:10.281708 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-89763892-4f2b-4419-bd01-49eb6a455b2f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 1b2e58e9-cd92-4a71-91f6-1e77ad99a685] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:49:10.327140 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-89763892-4f2b-4419-bd01-49eb6a455b2f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:10.331715 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-89763892-4f2b-4419-bd01-49eb6a455b2f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:10.333211 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-89763892-4f2b-4419-bd01-49eb6a455b2f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:10.334840 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-89763892-4f2b-4419-bd01-49eb6a455b2f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:10.341792 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-89763892-4f2b-4419-bd01-49eb6a455b2f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:10.342734 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-89763892-4f2b-4419-bd01-49eb6a455b2f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:10.412463 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9319aa23-72b5-4d6f-8084-54e907bae1b3 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:49:10.416354 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9319aa23-72b5-4d6f-8084-54e907bae1b3 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] [instance: dbac6549-6ae2-4521-b177-7e3ccba76d8e] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:49:10.432748 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9319aa23-72b5-4d6f-8084-54e907bae1b3 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:10.433328 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9319aa23-72b5-4d6f-8084-54e907bae1b3 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:10.433748 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9319aa23-72b5-4d6f-8084-54e907bae1b3 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:10.442916 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9319aa23-72b5-4d6f-8084-54e907bae1b3 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:10.449315 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9319aa23-72b5-4d6f-8084-54e907bae1b3 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:10.449315 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9319aa23-72b5-4d6f-8084-54e907bae1b3 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:10.492234 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-89763892-4f2b-4419-bd01-49eb6a455b2f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:10.492746 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-89763892-4f2b-4419-bd01-49eb6a455b2f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:10.497097 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-89763892-4f2b-4419-bd01-49eb6a455b2f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:10.497690 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-89763892-4f2b-4419-bd01-49eb6a455b2f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lazy-loading 'fault' on Instance uuid 1b2e58e9-cd92-4a71-91f6-1e77ad99a685 {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:49:10.598842 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-89763892-4f2b-4419-bd01-49eb6a455b2f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2da57f02884a968d685b53a5399e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b90d4cb5eb42958248b6f82516ce19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:49:10.607979 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-89763892-4f2b-4419-bd01-49eb6a455b2f tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/1b2e58e9-cd92-4a71-91f6-1e77ad99a685" status: 200 len: 1283 microversion: 2.1 time: 0.370050 Oct 27 03:49:10.608572 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3190/6092] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:49:10 2022] GET /compute/v2.1/servers/1b2e58e9-cd92-4a71-91f6-1e77ad99a685 => generated 1283 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:49:10.697490 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9319aa23-72b5-4d6f-8084-54e907bae1b3 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc1e7eafd7948279f08eb5ad52f5609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d03faa410840e0ae6d7523188d63b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:49:10.711912 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9319aa23-72b5-4d6f-8084-54e907bae1b3 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] 10.222.0.20 "GET /compute/v2.1/servers/dbac6549-6ae2-4521-b177-7e3ccba76d8e" status: 200 len: 1279 microversion: 2.1 time: 0.305093 Oct 27 03:49:10.722637 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2903/6093] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:49:10 2022] GET /compute/v2.1/servers/dbac6549-6ae2-4521-b177-7e3ccba76d8e => generated 1279 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:49:11.633278 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2c163e14-5381-442a-b970-c86b0330a1eb tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:49:11.635029 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2c163e14-5381-442a-b970-c86b0330a1eb tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] [instance: 1b2e58e9-cd92-4a71-91f6-1e77ad99a685] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:49:11.642661 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2c163e14-5381-442a-b970-c86b0330a1eb tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:11.643154 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2c163e14-5381-442a-b970-c86b0330a1eb tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:11.643598 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2c163e14-5381-442a-b970-c86b0330a1eb tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:11.644325 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2c163e14-5381-442a-b970-c86b0330a1eb tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:11.644788 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2c163e14-5381-442a-b970-c86b0330a1eb tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:11.645252 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2c163e14-5381-442a-b970-c86b0330a1eb tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:11.659322 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-2c163e14-5381-442a-b970-c86b0330a1eb tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] HTTP exception thrown: Instance 1b2e58e9-cd92-4a71-91f6-1e77ad99a685 could not be found. Oct 27 03:49:11.660887 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2c163e14-5381-442a-b970-c86b0330a1eb tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Request method failure captured: Oct 27 03:49:11.660887 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/1b2e58e9-cd92-4a71-91f6-1e77ad99a685 HTTP/1.1 Oct 27 03:49:11.660887 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:49:11.660887 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:49:11.660887 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:49:11.660887 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:49:11.660887 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:49:11.660887 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:49:11.660887 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:49:11.660887 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:49:11.660887 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWf7ao454EXpcvqw57oZ6kUl55rrrabqqRcgdR7_bXGBd3EhUlwYyYuxAfl-nrBiMviq2ipmr2mbr4b0cgBTMbKDOZJ9TP7cenW0zaGDKmMe2aswh3Oogol3Ct9m8LHYZYqPWmhLSqvB2K7fCZP-q-SBCjWA9jL7HEZxBqgIhBaRnNcs Oct 27 03:49:11.660887 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:49:11.660887 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:49:11.660887 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:49:11.660887 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:49:11.660887 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:49:11.660887 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:49:11.660887 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 86b90d4cb5eb42958248b6f82516ce19 Oct 27 03:49:11.660887 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServersTestJSON-1724631621 Oct 27 03:49:11.660887 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:49:11.660887 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:49:11.660887 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86b90d4cb5eb42958248b6f82516ce19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/86b90d4cb5eb42958248b6f82516ce19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86b90d4cb5eb42958248b6f82516ce19"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_86b90d4cb5eb42958248b6f82516ce19"}]}] Oct 27 03:49:11.660887 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServersTestJSON-1724631621 Oct 27 03:49:11.660887 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 86b90d4cb5eb42958248b6f82516ce19 Oct 27 03:49:11.660887 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServersTestJSON-1724631621 Oct 27 03:49:11.660887 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServersTestJSON-1724631621-project Oct 27 03:49:11.660887 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:49:11.660887 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:49:11.660887 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: ca2da57f02884a968d685b53a5399e46 Oct 27 03:49:11.660887 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServersTestJSON-1724631621-project Oct 27 03:49:11.660887 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:49:11.660887 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 1b2e58e9-cd92-4a71-91f6-1e77ad99a685 could not be found. Oct 27 03:49:11.660887 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '1b2e58e9-cd92-4a71-91f6-1e77ad99a685'} Oct 27 03:49:11.660887 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:49:11.660887 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:49:11.660887 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:49:11.660887 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:49:11.660887 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:49:11.660887 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:49:11.660887 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:49:11.660887 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:49:11.660887 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:49:11.660887 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:49:11.660887 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b2e58e9-cd92-4a71-91f6-1e77ad99a685 could not be found. Oct 27 03:49:11.660887 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:49:11.660887 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:49:11.660887 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:49:11.660887 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:49:11.660887 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:49:11.660887 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:49:11.660887 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:49:11.660887 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:49:11.660887 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:49:11.660887 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:49:11.660887 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:49:11.660887 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:49:11.660887 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:49:11.660887 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:49:11.660887 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:49:11.660887 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:49:11.660887 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b2e58e9-cd92-4a71-91f6-1e77ad99a685 could not be found. Oct 27 03:49:11.660887 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:49:11.660887 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:49:11.660887 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:49:11.665019 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:49:11.665019 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:49:11.665019 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:49:11.665019 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:49:11.665019 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:49:11.665019 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b2e58e9-cd92-4a71-91f6-1e77ad99a685 could not be found. Oct 27 03:49:11.665019 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:49:11.665019 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2c163e14-5381-442a-b970-c86b0330a1eb tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] Returning 404 to user: Instance 1b2e58e9-cd92-4a71-91f6-1e77ad99a685 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:49:11.665019 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2c163e14-5381-442a-b970-c86b0330a1eb tempest-ServersTestJSON-1724631621 tempest-ServersTestJSON-1724631621-project] 10.222.0.20 "GET /compute/v2.1/servers/1b2e58e9-cd92-4a71-91f6-1e77ad99a685" status: 404 len: 111 microversion: 2.1 time: 0.033146 Oct 27 03:49:11.665938 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3191/6094] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:49:11 2022] GET /compute/v2.1/servers/1b2e58e9-cd92-4a71-91f6-1e77ad99a685 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:49:11.738011 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ea5ddcb2-f788-4a46-a809-fb80e99f78d7 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:49:11.742129 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ea5ddcb2-f788-4a46-a809-fb80e99f78d7 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] [instance: dbac6549-6ae2-4521-b177-7e3ccba76d8e] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:49:11.749976 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ea5ddcb2-f788-4a46-a809-fb80e99f78d7 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:11.752663 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ea5ddcb2-f788-4a46-a809-fb80e99f78d7 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:11.753230 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ea5ddcb2-f788-4a46-a809-fb80e99f78d7 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:11.754104 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ea5ddcb2-f788-4a46-a809-fb80e99f78d7 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:11.755871 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ea5ddcb2-f788-4a46-a809-fb80e99f78d7 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:11.756862 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ea5ddcb2-f788-4a46-a809-fb80e99f78d7 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:11.882723 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ea5ddcb2-f788-4a46-a809-fb80e99f78d7 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc1e7eafd7948279f08eb5ad52f5609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d03faa410840e0ae6d7523188d63b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:49:11.909906 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ea5ddcb2-f788-4a46-a809-fb80e99f78d7 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] 10.222.0.20 "GET /compute/v2.1/servers/dbac6549-6ae2-4521-b177-7e3ccba76d8e" status: 200 len: 1285 microversion: 2.1 time: 0.176982 Oct 27 03:49:11.931041 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2904/6095] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:49:11 2022] GET /compute/v2.1/servers/dbac6549-6ae2-4521-b177-7e3ccba76d8e => generated 1285 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:49:12.947940 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-461a545e-4228-47ea-9a23-d99c953734bb tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:49:12.949930 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-461a545e-4228-47ea-9a23-d99c953734bb tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] [instance: dbac6549-6ae2-4521-b177-7e3ccba76d8e] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:49:12.978343 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-461a545e-4228-47ea-9a23-d99c953734bb tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:12.978950 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-461a545e-4228-47ea-9a23-d99c953734bb tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:12.981166 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-461a545e-4228-47ea-9a23-d99c953734bb tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:12.982480 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-461a545e-4228-47ea-9a23-d99c953734bb tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:12.984227 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-461a545e-4228-47ea-9a23-d99c953734bb tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:12.986314 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-461a545e-4228-47ea-9a23-d99c953734bb tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:13.379466 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-461a545e-4228-47ea-9a23-d99c953734bb tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc1e7eafd7948279f08eb5ad52f5609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d03faa410840e0ae6d7523188d63b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:49:13.423146 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-461a545e-4228-47ea-9a23-d99c953734bb tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] 10.222.0.20 "GET /compute/v2.1/servers/dbac6549-6ae2-4521-b177-7e3ccba76d8e" status: 200 len: 1327 microversion: 2.1 time: 0.479277 Oct 27 03:49:13.426884 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3192/6096] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:49:12 2022] GET /compute/v2.1/servers/dbac6549-6ae2-4521-b177-7e3ccba76d8e => generated 1327 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:49:14.453730 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ae2704c3-8733-4f29-a125-56c06569c2b6 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:49:14.455009 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-004e0313-18d9-4937-aee8-dd68289acb82 req-dba8a27e-13b7-4be4-8d9f-d744ea3d2d0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbac6549-6ae2-4521-b177-7e3ccba76d8e", "tag": "c3edbb75-a44d-41de-b982-8cd3a36d4b9f"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:49:14.460241 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ae2704c3-8733-4f29-a125-56c06569c2b6 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] [instance: dbac6549-6ae2-4521-b177-7e3ccba76d8e] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:49:14.487735 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ae2704c3-8733-4f29-a125-56c06569c2b6 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:14.489923 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:14.492264 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ae2704c3-8733-4f29-a125-56c06569c2b6 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:14.492900 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ae2704c3-8733-4f29-a125-56c06569c2b6 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:14.495975 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ae2704c3-8733-4f29-a125-56c06569c2b6 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:14.497729 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-004e0313-18d9-4937-aee8-dd68289acb82 req-dba8a27e-13b7-4be4-8d9f-d744ea3d2d0e service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:14.509059 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ae2704c3-8733-4f29-a125-56c06569c2b6 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:14.509977 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ae2704c3-8733-4f29-a125-56c06569c2b6 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:14.513675 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-004e0313-18d9-4937-aee8-dd68289acb82 req-dba8a27e-13b7-4be4-8d9f-d744ea3d2d0e service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:14.522742 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-004e0313-18d9-4937-aee8-dd68289acb82 req-dba8a27e-13b7-4be4-8d9f-d744ea3d2d0e service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:14.579562 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-004e0313-18d9-4937-aee8-dd68289acb82 req-dba8a27e-13b7-4be4-8d9f-d744ea3d2d0e service nova] Creating event network-changed:c3edbb75-a44d-41de-b982-8cd3a36d4b9f for instance dbac6549-6ae2-4521-b177-7e3ccba76d8e on n-h1-862769-1 Oct 27 03:49:14.599559 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-004e0313-18d9-4937-aee8-dd68289acb82 req-dba8a27e-13b7-4be4-8d9f-d744ea3d2d0e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.154045 Oct 27 03:49:14.614823 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2905/6097] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:49:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:49:16.043457 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ae2704c3-8733-4f29-a125-56c06569c2b6 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc1e7eafd7948279f08eb5ad52f5609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d03faa410840e0ae6d7523188d63b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:49:16.068090 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ae2704c3-8733-4f29-a125-56c06569c2b6 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] 10.222.0.20 "GET /compute/v2.1/servers/dbac6549-6ae2-4521-b177-7e3ccba76d8e" status: 200 len: 1327 microversion: 2.1 time: 1.616198 Oct 27 03:49:16.072026 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3193/6098] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:49:14 2022] GET /compute/v2.1/servers/dbac6549-6ae2-4521-b177-7e3ccba76d8e => generated 1327 bytes in 1623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:49:17.106676 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3eb9f689-73ae-4b6d-8ff9-f8711b7a0916 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:49:17.110425 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-3eb9f689-73ae-4b6d-8ff9-f8711b7a0916 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] [instance: dbac6549-6ae2-4521-b177-7e3ccba76d8e] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:49:17.144017 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3eb9f689-73ae-4b6d-8ff9-f8711b7a0916 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:17.169284 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3eb9f689-73ae-4b6d-8ff9-f8711b7a0916 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:17.171742 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3eb9f689-73ae-4b6d-8ff9-f8711b7a0916 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:17.174332 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3eb9f689-73ae-4b6d-8ff9-f8711b7a0916 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:17.174974 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3eb9f689-73ae-4b6d-8ff9-f8711b7a0916 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:17.175427 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3eb9f689-73ae-4b6d-8ff9-f8711b7a0916 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:18.002971 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-3eb9f689-73ae-4b6d-8ff9-f8711b7a0916 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc1e7eafd7948279f08eb5ad52f5609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d03faa410840e0ae6d7523188d63b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:49:18.012227 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3eb9f689-73ae-4b6d-8ff9-f8711b7a0916 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] 10.222.0.20 "GET /compute/v2.1/servers/dbac6549-6ae2-4521-b177-7e3ccba76d8e" status: 200 len: 1327 microversion: 2.1 time: 0.914502 Oct 27 03:49:18.020247 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2906/6099] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:49:17 2022] GET /compute/v2.1/servers/dbac6549-6ae2-4521-b177-7e3ccba76d8e => generated 1327 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:49:19.056083 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-880b88e7-11bf-463f-92d1-dba1cd67dbfc tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:49:19.057416 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-880b88e7-11bf-463f-92d1-dba1cd67dbfc tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] [instance: dbac6549-6ae2-4521-b177-7e3ccba76d8e] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:49:19.060572 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:19.062398 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=10 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:19.086806 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-880b88e7-11bf-463f-92d1-dba1cd67dbfc tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:19.086806 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-880b88e7-11bf-463f-92d1-dba1cd67dbfc tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:19.086806 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-880b88e7-11bf-463f-92d1-dba1cd67dbfc tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:19.092299 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-880b88e7-11bf-463f-92d1-dba1cd67dbfc tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:19.093028 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-880b88e7-11bf-463f-92d1-dba1cd67dbfc tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:19.093693 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-880b88e7-11bf-463f-92d1-dba1cd67dbfc tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:19.584018 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-880b88e7-11bf-463f-92d1-dba1cd67dbfc tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc1e7eafd7948279f08eb5ad52f5609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d03faa410840e0ae6d7523188d63b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:49:19.594019 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-880b88e7-11bf-463f-92d1-dba1cd67dbfc tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] 10.222.0.20 "GET /compute/v2.1/servers/dbac6549-6ae2-4521-b177-7e3ccba76d8e" status: 200 len: 1327 microversion: 2.1 time: 0.551560 Oct 27 03:49:19.595222 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3194/6100] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:49:19 2022] GET /compute/v2.1/servers/dbac6549-6ae2-4521-b177-7e3ccba76d8e => generated 1327 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:49:20.621942 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e3af6353-25d7-4ba9-9dd4-ec53aa4e4d56 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:49:20.623775 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e3af6353-25d7-4ba9-9dd4-ec53aa4e4d56 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] [instance: dbac6549-6ae2-4521-b177-7e3ccba76d8e] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:49:20.659406 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e3af6353-25d7-4ba9-9dd4-ec53aa4e4d56 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:20.660178 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e3af6353-25d7-4ba9-9dd4-ec53aa4e4d56 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:20.661388 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e3af6353-25d7-4ba9-9dd4-ec53aa4e4d56 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:20.662408 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e3af6353-25d7-4ba9-9dd4-ec53aa4e4d56 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:20.663187 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e3af6353-25d7-4ba9-9dd4-ec53aa4e4d56 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:20.664374 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e3af6353-25d7-4ba9-9dd4-ec53aa4e4d56 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:21.478382 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e3af6353-25d7-4ba9-9dd4-ec53aa4e4d56 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc1e7eafd7948279f08eb5ad52f5609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d03faa410840e0ae6d7523188d63b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:49:21.498286 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e3af6353-25d7-4ba9-9dd4-ec53aa4e4d56 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] 10.222.0.20 "GET /compute/v2.1/servers/dbac6549-6ae2-4521-b177-7e3ccba76d8e" status: 200 len: 1327 microversion: 2.1 time: 0.879064 Oct 27 03:49:21.499033 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2907/6101] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:49:20 2022] GET /compute/v2.1/servers/dbac6549-6ae2-4521-b177-7e3ccba76d8e => generated 1327 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:49:22.542582 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f166bb7f-6676-4503-98e1-0d658e776a2c tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:49:22.544270 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f166bb7f-6676-4503-98e1-0d658e776a2c tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] [instance: dbac6549-6ae2-4521-b177-7e3ccba76d8e] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:49:22.554463 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f166bb7f-6676-4503-98e1-0d658e776a2c tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:22.555372 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f166bb7f-6676-4503-98e1-0d658e776a2c tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:22.556202 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f166bb7f-6676-4503-98e1-0d658e776a2c tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:22.557221 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f166bb7f-6676-4503-98e1-0d658e776a2c tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:22.558519 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f166bb7f-6676-4503-98e1-0d658e776a2c tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:22.559343 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f166bb7f-6676-4503-98e1-0d658e776a2c tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:22.594824 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:22.957438 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f166bb7f-6676-4503-98e1-0d658e776a2c tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc1e7eafd7948279f08eb5ad52f5609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d03faa410840e0ae6d7523188d63b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:49:22.971965 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f166bb7f-6676-4503-98e1-0d658e776a2c tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] 10.222.0.20 "GET /compute/v2.1/servers/dbac6549-6ae2-4521-b177-7e3ccba76d8e" status: 200 len: 1327 microversion: 2.1 time: 0.434921 Oct 27 03:49:22.991060 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3195/6102] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:49:22 2022] GET /compute/v2.1/servers/dbac6549-6ae2-4521-b177-7e3ccba76d8e => generated 1327 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:49:23.554389 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-ed99af80-8c4a-4daa-b516-702b4f0c1786 req-3c9f77b2-7820-406b-bc87-b578e718679d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbac6549-6ae2-4521-b177-7e3ccba76d8e", "name": "network-vif-plugged", "status": "completed", "tag": "c3edbb75-a44d-41de-b982-8cd3a36d4b9f"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:49:23.580273 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-ed99af80-8c4a-4daa-b516-702b4f0c1786 req-3c9f77b2-7820-406b-bc87-b578e718679d service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:23.594311 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-ed99af80-8c4a-4daa-b516-702b4f0c1786 req-3c9f77b2-7820-406b-bc87-b578e718679d service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:23.595181 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-ed99af80-8c4a-4daa-b516-702b4f0c1786 req-3c9f77b2-7820-406b-bc87-b578e718679d service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:23.619127 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-ed99af80-8c4a-4daa-b516-702b4f0c1786 req-3c9f77b2-7820-406b-bc87-b578e718679d service nova] Creating event network-vif-plugged:c3edbb75-a44d-41de-b982-8cd3a36d4b9f for instance dbac6549-6ae2-4521-b177-7e3ccba76d8e on n-h1-862769-1 Oct 27 03:49:23.628670 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-ed99af80-8c4a-4daa-b516-702b4f0c1786 req-3c9f77b2-7820-406b-bc87-b578e718679d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080006 Oct 27 03:49:23.638847 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2908/6103] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:49:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:49:23.996833 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-cb8e4067-4a05-4d28-a276-d5bc8fdb4eae tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:49:23.998273 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-cb8e4067-4a05-4d28-a276-d5bc8fdb4eae tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] [instance: dbac6549-6ae2-4521-b177-7e3ccba76d8e] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:49:24.008629 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cb8e4067-4a05-4d28-a276-d5bc8fdb4eae tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:24.009127 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cb8e4067-4a05-4d28-a276-d5bc8fdb4eae tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:24.009598 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cb8e4067-4a05-4d28-a276-d5bc8fdb4eae tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:24.010303 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cb8e4067-4a05-4d28-a276-d5bc8fdb4eae tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:24.011153 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cb8e4067-4a05-4d28-a276-d5bc8fdb4eae tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:24.011722 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cb8e4067-4a05-4d28-a276-d5bc8fdb4eae tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:24.295704 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-cb8e4067-4a05-4d28-a276-d5bc8fdb4eae tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc1e7eafd7948279f08eb5ad52f5609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d03faa410840e0ae6d7523188d63b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:49:24.322265 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-cb8e4067-4a05-4d28-a276-d5bc8fdb4eae tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] 10.222.0.20 "GET /compute/v2.1/servers/dbac6549-6ae2-4521-b177-7e3ccba76d8e" status: 200 len: 1327 microversion: 2.1 time: 0.329457 Oct 27 03:49:24.341880 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3196/6104] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:49:23 2022] GET /compute/v2.1/servers/dbac6549-6ae2-4521-b177-7e3ccba76d8e => generated 1327 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:49:25.365096 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b6ac91e4-05d9-471d-ab4c-659fec2a69b2 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:49:25.365831 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b6ac91e4-05d9-471d-ab4c-659fec2a69b2 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] [instance: dbac6549-6ae2-4521-b177-7e3ccba76d8e] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:49:25.393307 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b6ac91e4-05d9-471d-ab4c-659fec2a69b2 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:25.394966 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b6ac91e4-05d9-471d-ab4c-659fec2a69b2 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:25.396643 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b6ac91e4-05d9-471d-ab4c-659fec2a69b2 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:25.397831 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b6ac91e4-05d9-471d-ab4c-659fec2a69b2 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:25.399833 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b6ac91e4-05d9-471d-ab4c-659fec2a69b2 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:25.401867 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b6ac91e4-05d9-471d-ab4c-659fec2a69b2 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:25.720165 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b6ac91e4-05d9-471d-ab4c-659fec2a69b2 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc1e7eafd7948279f08eb5ad52f5609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d03faa410840e0ae6d7523188d63b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:49:25.726272 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b6ac91e4-05d9-471d-ab4c-659fec2a69b2 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] 10.222.0.20 "GET /compute/v2.1/servers/dbac6549-6ae2-4521-b177-7e3ccba76d8e" status: 200 len: 1525 microversion: 2.1 time: 0.380351 Oct 27 03:49:25.728501 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2909/6105] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:49:25 2022] GET /compute/v2.1/servers/dbac6549-6ae2-4521-b177-7e3ccba76d8e => generated 1525 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:49:25.756056 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d240a869-2970-4533-ba19-ce2647083013 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:49:25.756847 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d240a869-2970-4533-ba19-ce2647083013 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] [instance: dbac6549-6ae2-4521-b177-7e3ccba76d8e] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:49:25.777710 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d240a869-2970-4533-ba19-ce2647083013 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:25.782102 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d240a869-2970-4533-ba19-ce2647083013 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:25.785361 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d240a869-2970-4533-ba19-ce2647083013 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:25.786507 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d240a869-2970-4533-ba19-ce2647083013 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:25.788200 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d240a869-2970-4533-ba19-ce2647083013 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:25.788905 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d240a869-2970-4533-ba19-ce2647083013 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:26.125098 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d240a869-2970-4533-ba19-ce2647083013 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc1e7eafd7948279f08eb5ad52f5609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d03faa410840e0ae6d7523188d63b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:49:26.134540 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d240a869-2970-4533-ba19-ce2647083013 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] 10.222.0.20 "GET /compute/v2.1/servers/dbac6549-6ae2-4521-b177-7e3ccba76d8e" status: 200 len: 1525 microversion: 2.1 time: 0.382395 Oct 27 03:49:26.139716 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3197/6106] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:49:25 2022] GET /compute/v2.1/servers/dbac6549-6ae2-4521-b177-7e3ccba76d8e => generated 1525 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:49:26.736950 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-dc84319a-8d22-49fc-9b76-d843eaa173be tempest-ServersNegativeTestMultiTenantJSON-1512434804 tempest-ServersNegativeTestMultiTenantJSON-1512434804-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:49:26.741534 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-dc84319a-8d22-49fc-9b76-d843eaa173be tempest-ServersNegativeTestMultiTenantJSON-1512434804 tempest-ServersNegativeTestMultiTenantJSON-1512434804-project] [instance: dbac6549-6ae2-4521-b177-7e3ccba76d8e] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:49:26.752431 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dc84319a-8d22-49fc-9b76-d843eaa173be tempest-ServersNegativeTestMultiTenantJSON-1512434804 tempest-ServersNegativeTestMultiTenantJSON-1512434804-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:26.767256 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dc84319a-8d22-49fc-9b76-d843eaa173be tempest-ServersNegativeTestMultiTenantJSON-1512434804 tempest-ServersNegativeTestMultiTenantJSON-1512434804-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:26.767256 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dc84319a-8d22-49fc-9b76-d843eaa173be tempest-ServersNegativeTestMultiTenantJSON-1512434804 tempest-ServersNegativeTestMultiTenantJSON-1512434804-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:26.767256 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dc84319a-8d22-49fc-9b76-d843eaa173be tempest-ServersNegativeTestMultiTenantJSON-1512434804 tempest-ServersNegativeTestMultiTenantJSON-1512434804-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:26.767256 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dc84319a-8d22-49fc-9b76-d843eaa173be tempest-ServersNegativeTestMultiTenantJSON-1512434804 tempest-ServersNegativeTestMultiTenantJSON-1512434804-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:26.767256 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dc84319a-8d22-49fc-9b76-d843eaa173be tempest-ServersNegativeTestMultiTenantJSON-1512434804 tempest-ServersNegativeTestMultiTenantJSON-1512434804-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:26.775345 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-dc84319a-8d22-49fc-9b76-d843eaa173be tempest-ServersNegativeTestMultiTenantJSON-1512434804 tempest-ServersNegativeTestMultiTenantJSON-1512434804-project] HTTP exception thrown: Instance dbac6549-6ae2-4521-b177-7e3ccba76d8e could not be found. Oct 27 03:49:26.777260 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-dc84319a-8d22-49fc-9b76-d843eaa173be tempest-ServersNegativeTestMultiTenantJSON-1512434804 tempest-ServersNegativeTestMultiTenantJSON-1512434804-project] Request method failure captured: Oct 27 03:49:26.777260 n-d-862769-1 devstack@n-api.service[121000]: request: DELETE /compute/v2.1/servers/dbac6549-6ae2-4521-b177-7e3ccba76d8e HTTP/1.1 Oct 27 03:49:26.777260 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:49:26.777260 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:49:26.777260 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:49:26.777260 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:49:26.777260 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:49:26.777260 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:49:26.777260 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:49:26.777260 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:49:26.777260 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWf-va2NhmcNNFQiA2rdABtPysp-CUnNM3oVb7UuCD--JU-xqpMaqP8AfXVwkGO-PJ4hBx2kWW2bpN1OXj25igJ0VrHOWlF-YJiy8CJGe6ICmcbQhkOfrZ6ghERqmSaBFWjAcMlE20d2nmu0QxBlzpDb-hQCkJyHeDW_y94iinVgC-oA Oct 27 03:49:26.777260 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:49:26.777260 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:49:26.777260 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:49:26.777260 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:49:26.777260 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:49:26.777260 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:49:26.777260 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: ae6bd97041d843879dc0988741e0732a Oct 27 03:49:26.777260 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1512434804 Oct 27 03:49:26.777260 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:49:26.777260 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:49:26.777260 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ae6bd97041d843879dc0988741e0732a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ae6bd97041d843879dc0988741e0732a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ae6bd97041d843879dc0988741e0732a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ae6bd97041d843879dc0988741e0732a"}]}] Oct 27 03:49:26.777260 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1512434804 Oct 27 03:49:26.777260 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: ae6bd97041d843879dc0988741e0732a Oct 27 03:49:26.777260 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1512434804 Oct 27 03:49:26.777260 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1512434804-project Oct 27 03:49:26.777260 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:49:26.777260 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:49:26.777260 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 530d04ccbfb7413790c8311a10c8cbee Oct 27 03:49:26.777260 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1512434804-project Oct 27 03:49:26.777260 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:49:26.777260 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance dbac6549-6ae2-4521-b177-7e3ccba76d8e could not be found. Oct 27 03:49:26.777260 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': 'dbac6549-6ae2-4521-b177-7e3ccba76d8e'} Oct 27 03:49:26.777260 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:49:26.777260 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:49:26.777260 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:49:26.777260 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:49:26.777260 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:49:26.777260 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:49:26.777260 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:49:26.777260 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:49:26.777260 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:49:26.777260 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:49:26.777260 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbac6549-6ae2-4521-b177-7e3ccba76d8e could not be found. Oct 27 03:49:26.777260 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:26.777260 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:49:26.777260 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:26.777260 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:49:26.777260 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:49:26.777260 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:49:26.777260 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:49:26.777260 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:49:26.777260 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:49:26.777260 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:49:26.777260 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 03:49:26.777260 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 03:49:26.777260 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 03:49:26.777260 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 03:49:26.777260 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:49:26.777260 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:49:26.777260 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:49:26.777260 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:49:26.786407 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbac6549-6ae2-4521-b177-7e3ccba76d8e could not be found. Oct 27 03:49:26.786407 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:26.786407 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:49:26.786407 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:26.786407 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:49:26.786407 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:49:26.786407 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:49:26.786407 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:49:26.786407 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:49:26.786407 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbac6549-6ae2-4521-b177-7e3ccba76d8e could not be found. Oct 27 03:49:26.786407 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:26.786407 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-dc84319a-8d22-49fc-9b76-d843eaa173be tempest-ServersNegativeTestMultiTenantJSON-1512434804 tempest-ServersNegativeTestMultiTenantJSON-1512434804-project] Returning 404 to user: Instance dbac6549-6ae2-4521-b177-7e3ccba76d8e could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:49:26.786407 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-dc84319a-8d22-49fc-9b76-d843eaa173be tempest-ServersNegativeTestMultiTenantJSON-1512434804 tempest-ServersNegativeTestMultiTenantJSON-1512434804-project] 10.222.0.20 "DELETE /compute/v2.1/servers/dbac6549-6ae2-4521-b177-7e3ccba76d8e" status: 404 len: 111 microversion: 2.1 time: 0.621403 Oct 27 03:49:26.786407 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2910/6107] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:49:26 2022] DELETE /compute/v2.1/servers/dbac6549-6ae2-4521-b177-7e3ccba76d8e => generated 111 bytes in 623 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:49:26.789825 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-38f4125c-f47c-4edd-b92d-2e74c031b989 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:49:26.792420 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-38f4125c-f47c-4edd-b92d-2e74c031b989 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] [instance: dbac6549-6ae2-4521-b177-7e3ccba76d8e] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:49:26.800827 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-38f4125c-f47c-4edd-b92d-2e74c031b989 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:26.801329 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-38f4125c-f47c-4edd-b92d-2e74c031b989 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:26.801773 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-38f4125c-f47c-4edd-b92d-2e74c031b989 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:26.802520 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-38f4125c-f47c-4edd-b92d-2e74c031b989 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:26.803836 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-38f4125c-f47c-4edd-b92d-2e74c031b989 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:26.805076 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-38f4125c-f47c-4edd-b92d-2e74c031b989 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:27.128948 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-38f4125c-f47c-4edd-b92d-2e74c031b989 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc1e7eafd7948279f08eb5ad52f5609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d03faa410840e0ae6d7523188d63b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:49:27.143373 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-38f4125c-f47c-4edd-b92d-2e74c031b989 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] 10.222.0.20 "GET /compute/v2.1/servers/dbac6549-6ae2-4521-b177-7e3ccba76d8e" status: 200 len: 1525 microversion: 2.1 time: 0.358053 Oct 27 03:49:27.144033 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3198/6108] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:49:26 2022] GET /compute/v2.1/servers/dbac6549-6ae2-4521-b177-7e3ccba76d8e => generated 1525 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:49:27.168715 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-10d9191c-d478-4336-accb-bd125657b73e tempest-ServersNegativeTestMultiTenantJSON-1512434804 tempest-ServersNegativeTestMultiTenantJSON-1512434804-project] Action: 'update', calling method: >, body: {"server": {"name": "dbac6549-6ae2-4521-b177-7e3ccba76d8e_new"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:49:27.172387 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-10d9191c-d478-4336-accb-bd125657b73e tempest-ServersNegativeTestMultiTenantJSON-1512434804 tempest-ServersNegativeTestMultiTenantJSON-1512434804-project] [instance: dbac6549-6ae2-4521-b177-7e3ccba76d8e] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:49:27.180677 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-10d9191c-d478-4336-accb-bd125657b73e tempest-ServersNegativeTestMultiTenantJSON-1512434804 tempest-ServersNegativeTestMultiTenantJSON-1512434804-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:27.181329 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-10d9191c-d478-4336-accb-bd125657b73e tempest-ServersNegativeTestMultiTenantJSON-1512434804 tempest-ServersNegativeTestMultiTenantJSON-1512434804-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:27.181786 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-10d9191c-d478-4336-accb-bd125657b73e tempest-ServersNegativeTestMultiTenantJSON-1512434804 tempest-ServersNegativeTestMultiTenantJSON-1512434804-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:27.182567 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-10d9191c-d478-4336-accb-bd125657b73e tempest-ServersNegativeTestMultiTenantJSON-1512434804 tempest-ServersNegativeTestMultiTenantJSON-1512434804-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:27.183184 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-10d9191c-d478-4336-accb-bd125657b73e tempest-ServersNegativeTestMultiTenantJSON-1512434804 tempest-ServersNegativeTestMultiTenantJSON-1512434804-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:27.184210 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-10d9191c-d478-4336-accb-bd125657b73e tempest-ServersNegativeTestMultiTenantJSON-1512434804 tempest-ServersNegativeTestMultiTenantJSON-1512434804-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:27.204576 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-10d9191c-d478-4336-accb-bd125657b73e tempest-ServersNegativeTestMultiTenantJSON-1512434804 tempest-ServersNegativeTestMultiTenantJSON-1512434804-project] HTTP exception thrown: Instance dbac6549-6ae2-4521-b177-7e3ccba76d8e could not be found. Oct 27 03:49:27.222901 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-10d9191c-d478-4336-accb-bd125657b73e tempest-ServersNegativeTestMultiTenantJSON-1512434804 tempest-ServersNegativeTestMultiTenantJSON-1512434804-project] Request method failure captured: Oct 27 03:49:27.222901 n-d-862769-1 devstack@n-api.service[121000]: request: PUT /compute/v2.1/servers/dbac6549-6ae2-4521-b177-7e3ccba76d8e HTTP/1.1 Oct 27 03:49:27.222901 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:49:27.222901 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:49:27.222901 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:49:27.222901 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 64 Oct 27 03:49:27.222901 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:49:27.222901 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:49:27.222901 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:49:27.222901 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:49:27.222901 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWf-va2NhmcNNFQiA2rdABtPysp-CUnNM3oVb7UuCD--JU-xqpMaqP8AfXVwkGO-PJ4hBx2kWW2bpN1OXj25igJ0VrHOWlF-YJiy8CJGe6ICmcbQhkOfrZ6ghERqmSaBFWjAcMlE20d2nmu0QxBlzpDb-hQCkJyHeDW_y94iinVgC-oA Oct 27 03:49:27.222901 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:49:27.222901 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:49:27.222901 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:49:27.222901 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:49:27.222901 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:49:27.222901 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:49:27.222901 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: ae6bd97041d843879dc0988741e0732a Oct 27 03:49:27.222901 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1512434804 Oct 27 03:49:27.222901 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:49:27.222901 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:49:27.222901 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ae6bd97041d843879dc0988741e0732a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ae6bd97041d843879dc0988741e0732a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ae6bd97041d843879dc0988741e0732a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ae6bd97041d843879dc0988741e0732a"}]}] Oct 27 03:49:27.222901 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1512434804 Oct 27 03:49:27.222901 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: ae6bd97041d843879dc0988741e0732a Oct 27 03:49:27.222901 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1512434804 Oct 27 03:49:27.222901 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1512434804-project Oct 27 03:49:27.222901 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:49:27.222901 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:49:27.222901 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 530d04ccbfb7413790c8311a10c8cbee Oct 27 03:49:27.222901 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1512434804-project Oct 27 03:49:27.222901 n-d-862769-1 devstack@n-api.service[121000]: Oct 27 03:49:27.222901 n-d-862769-1 devstack@n-api.service[121000]: {"server": {"name": "dbac6549-6ae2-4521-b177-7e3ccba76d8e_new"}} Oct 27 03:49:27.222901 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:49:27.222901 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance dbac6549-6ae2-4521-b177-7e3ccba76d8e could not be found. Oct 27 03:49:27.222901 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': 'dbac6549-6ae2-4521-b177-7e3ccba76d8e', 'body': {'server': {'name': 'dbac6549-6ae2-4521-b177-7e3ccba76d8e_new'}}} Oct 27 03:49:27.222901 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:49:27.222901 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:49:27.222901 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:49:27.222901 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:49:27.222901 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:49:27.222901 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:49:27.222901 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:49:27.222901 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:49:27.222901 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:49:27.222901 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:49:27.222901 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbac6549-6ae2-4521-b177-7e3ccba76d8e could not be found. Oct 27 03:49:27.222901 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:27.222901 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:49:27.222901 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:27.222901 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:49:27.222901 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:49:27.222901 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:49:27.222901 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:49:27.222901 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:49:27.222901 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:49:27.222901 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:49:27.222901 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:49:27.222901 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:49:27.222901 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:49:27.222901 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:49:27.222901 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 03:49:27.222901 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 03:49:27.222901 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 27 03:49:27.229123 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 27 03:49:27.229123 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 27 03:49:27.229123 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:49:27.229123 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:49:27.229123 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:49:27.229123 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:49:27.229123 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbac6549-6ae2-4521-b177-7e3ccba76d8e could not be found. Oct 27 03:49:27.229123 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:27.229123 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:49:27.229123 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:27.229123 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:49:27.229123 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:49:27.229123 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:49:27.229123 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:49:27.229123 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:49:27.229123 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbac6549-6ae2-4521-b177-7e3ccba76d8e could not be found. Oct 27 03:49:27.229123 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:27.229123 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-10d9191c-d478-4336-accb-bd125657b73e tempest-ServersNegativeTestMultiTenantJSON-1512434804 tempest-ServersNegativeTestMultiTenantJSON-1512434804-project] Returning 404 to user: Instance dbac6549-6ae2-4521-b177-7e3ccba76d8e could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:49:27.229123 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-10d9191c-d478-4336-accb-bd125657b73e tempest-ServersNegativeTestMultiTenantJSON-1512434804 tempest-ServersNegativeTestMultiTenantJSON-1512434804-project] 10.222.0.20 "PUT /compute/v2.1/servers/dbac6549-6ae2-4521-b177-7e3ccba76d8e" status: 404 len: 111 microversion: 2.1 time: 0.057162 Oct 27 03:49:27.229123 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2911/6109] 10.222.0.20 () {60 vars in 1256 bytes} [Thu Oct 27 03:49:27 2022] PUT /compute/v2.1/servers/dbac6549-6ae2-4521-b177-7e3ccba76d8e => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 03:49:27.240055 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c8870bd1-af3a-45b3-ac1f-f4cdda2a5771 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:49:27.240823 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c8870bd1-af3a-45b3-ac1f-f4cdda2a5771 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] [instance: dbac6549-6ae2-4521-b177-7e3ccba76d8e] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:49:27.251702 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c8870bd1-af3a-45b3-ac1f-f4cdda2a5771 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:27.251702 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c8870bd1-af3a-45b3-ac1f-f4cdda2a5771 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:27.251702 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c8870bd1-af3a-45b3-ac1f-f4cdda2a5771 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:27.251702 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c8870bd1-af3a-45b3-ac1f-f4cdda2a5771 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:27.252646 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c8870bd1-af3a-45b3-ac1f-f4cdda2a5771 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:27.253277 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c8870bd1-af3a-45b3-ac1f-f4cdda2a5771 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:27.282194 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c8870bd1-af3a-45b3-ac1f-f4cdda2a5771 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] [instance: dbac6549-6ae2-4521-b177-7e3ccba76d8e] Going to try to terminate instance {{(pid=121001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:49:27.734823 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c8870bd1-af3a-45b3-ac1f-f4cdda2a5771 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] 10.222.0.20 "DELETE /compute/v2.1/servers/dbac6549-6ae2-4521-b177-7e3ccba76d8e" status: 204 len: 0 microversion: 2.1 time: 0.499478 Oct 27 03:49:27.735651 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3199/6110] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:49:27 2022] DELETE /compute/v2.1/servers/dbac6549-6ae2-4521-b177-7e3ccba76d8e => generated 0 bytes in 502 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:49:27.744024 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-04666a25-804b-4f92-9ac5-ccac50ff3b28 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:49:27.744660 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-04666a25-804b-4f92-9ac5-ccac50ff3b28 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] [instance: dbac6549-6ae2-4521-b177-7e3ccba76d8e] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:49:27.752141 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-04666a25-804b-4f92-9ac5-ccac50ff3b28 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:27.752805 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-04666a25-804b-4f92-9ac5-ccac50ff3b28 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:27.753256 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-04666a25-804b-4f92-9ac5-ccac50ff3b28 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:27.753963 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-04666a25-804b-4f92-9ac5-ccac50ff3b28 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:27.754505 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-04666a25-804b-4f92-9ac5-ccac50ff3b28 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:27.754954 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-04666a25-804b-4f92-9ac5-ccac50ff3b28 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:28.050166 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-04666a25-804b-4f92-9ac5-ccac50ff3b28 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc1e7eafd7948279f08eb5ad52f5609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d03faa410840e0ae6d7523188d63b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:49:28.078091 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-04666a25-804b-4f92-9ac5-ccac50ff3b28 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] 10.222.0.20 "GET /compute/v2.1/servers/dbac6549-6ae2-4521-b177-7e3ccba76d8e" status: 200 len: 1531 microversion: 2.1 time: 0.338134 Oct 27 03:49:28.083582 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2912/6111] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:49:27 2022] GET /compute/v2.1/servers/dbac6549-6ae2-4521-b177-7e3ccba76d8e => generated 1531 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:49:29.113596 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-53e4fa4e-72d6-4929-ace0-b0161495fe57 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:49:29.122126 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-53e4fa4e-72d6-4929-ace0-b0161495fe57 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] [instance: dbac6549-6ae2-4521-b177-7e3ccba76d8e] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:49:29.128984 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-53e4fa4e-72d6-4929-ace0-b0161495fe57 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:29.129480 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-53e4fa4e-72d6-4929-ace0-b0161495fe57 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:29.129936 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-53e4fa4e-72d6-4929-ace0-b0161495fe57 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:29.130696 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-53e4fa4e-72d6-4929-ace0-b0161495fe57 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:29.131164 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-53e4fa4e-72d6-4929-ace0-b0161495fe57 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:29.131602 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-53e4fa4e-72d6-4929-ace0-b0161495fe57 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:29.463959 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-53e4fa4e-72d6-4929-ace0-b0161495fe57 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc1e7eafd7948279f08eb5ad52f5609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d03faa410840e0ae6d7523188d63b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:49:29.479797 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-53e4fa4e-72d6-4929-ace0-b0161495fe57 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] 10.222.0.20 "GET /compute/v2.1/servers/dbac6549-6ae2-4521-b177-7e3ccba76d8e" status: 200 len: 1531 microversion: 2.1 time: 0.367058 Oct 27 03:49:29.480907 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3200/6112] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:49:29 2022] GET /compute/v2.1/servers/dbac6549-6ae2-4521-b177-7e3ccba76d8e => generated 1531 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:49:30.221993 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f1855684-7b6c-4cea-a4e1-c821d82b2f4a tempest-VolumesTestJSON-388566726 tempest-VolumesTestJSON-388566726-project] Calling method '.version_select at 0x7f7dd9c4fca0>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:49:30.341615 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f1855684-7b6c-4cea-a4e1-c821d82b2f4a tempest-VolumesTestJSON-388566726 tempest-VolumesTestJSON-388566726-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/f13a2586-d894-42a0-a6ee-47aa8a0f53a1" status: 200 len: 350 microversion: 2.1 time: 0.124101 Oct 27 03:49:30.351201 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2913/6113] 10.222.0.20 () {58 vars in 1245 bytes} [Thu Oct 27 03:49:30 2022] GET /compute/v2.1/os-volumes/f13a2586-d894-42a0-a6ee-47aa8a0f53a1 => generated 350 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:49:30.507496 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-76959549-b03d-4421-bc41-2dbf616136b4 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:49:30.508249 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-76959549-b03d-4421-bc41-2dbf616136b4 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] [instance: dbac6549-6ae2-4521-b177-7e3ccba76d8e] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:49:30.521825 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:30.534467 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-76959549-b03d-4421-bc41-2dbf616136b4 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:30.534854 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-76959549-b03d-4421-bc41-2dbf616136b4 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:30.535655 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-76959549-b03d-4421-bc41-2dbf616136b4 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:30.537498 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-76959549-b03d-4421-bc41-2dbf616136b4 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:30.539919 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-76959549-b03d-4421-bc41-2dbf616136b4 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:30.543106 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-76959549-b03d-4421-bc41-2dbf616136b4 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:31.012689 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-76959549-b03d-4421-bc41-2dbf616136b4 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc1e7eafd7948279f08eb5ad52f5609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d03faa410840e0ae6d7523188d63b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:49:31.029167 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-76959549-b03d-4421-bc41-2dbf616136b4 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] 10.222.0.20 "GET /compute/v2.1/servers/dbac6549-6ae2-4521-b177-7e3ccba76d8e" status: 200 len: 1489 microversion: 2.1 time: 0.521329 Oct 27 03:49:31.035550 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3201/6114] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:49:30 2022] GET /compute/v2.1/servers/dbac6549-6ae2-4521-b177-7e3ccba76d8e => generated 1489 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:49:31.074846 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-66c32c5d-52f0-4aeb-9817-725263e828b3 req-933856fc-5de1-4469-aa62-1d48626bc2ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbac6549-6ae2-4521-b177-7e3ccba76d8e", "name": "network-vif-deleted", "tag": "c3edbb75-a44d-41de-b982-8cd3a36d4b9f"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:49:31.102785 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-66c32c5d-52f0-4aeb-9817-725263e828b3 req-933856fc-5de1-4469-aa62-1d48626bc2ed service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:31.103393 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-66c32c5d-52f0-4aeb-9817-725263e828b3 req-933856fc-5de1-4469-aa62-1d48626bc2ed service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:31.103834 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-66c32c5d-52f0-4aeb-9817-725263e828b3 req-933856fc-5de1-4469-aa62-1d48626bc2ed service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:31.122898 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-66c32c5d-52f0-4aeb-9817-725263e828b3 req-933856fc-5de1-4469-aa62-1d48626bc2ed service nova] Creating event network-vif-deleted:c3edbb75-a44d-41de-b982-8cd3a36d4b9f for instance dbac6549-6ae2-4521-b177-7e3ccba76d8e on n-h1-862769-1 Oct 27 03:49:31.131147 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-66c32c5d-52f0-4aeb-9817-725263e828b3 req-933856fc-5de1-4469-aa62-1d48626bc2ed service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061960 Oct 27 03:49:31.132961 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2914/6115] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:49:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:49:32.058539 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1faf0631-8b77-4eeb-86a6-4ca8822edae1 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:49:32.059326 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1faf0631-8b77-4eeb-86a6-4ca8822edae1 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] [instance: dbac6549-6ae2-4521-b177-7e3ccba76d8e] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:49:32.072473 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1faf0631-8b77-4eeb-86a6-4ca8822edae1 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:32.073534 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1faf0631-8b77-4eeb-86a6-4ca8822edae1 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:32.073987 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1faf0631-8b77-4eeb-86a6-4ca8822edae1 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:32.074741 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1faf0631-8b77-4eeb-86a6-4ca8822edae1 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:32.075205 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1faf0631-8b77-4eeb-86a6-4ca8822edae1 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:32.075658 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1faf0631-8b77-4eeb-86a6-4ca8822edae1 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:32.129284 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1faf0631-8b77-4eeb-86a6-4ca8822edae1 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:32.129914 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1faf0631-8b77-4eeb-86a6-4ca8822edae1 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:32.130593 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1faf0631-8b77-4eeb-86a6-4ca8822edae1 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:32.131077 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-1faf0631-8b77-4eeb-86a6-4ca8822edae1 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Lazy-loading 'fault' on Instance uuid dbac6549-6ae2-4521-b177-7e3ccba76d8e {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:49:32.236177 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1faf0631-8b77-4eeb-86a6-4ca8822edae1 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc1e7eafd7948279f08eb5ad52f5609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d03faa410840e0ae6d7523188d63b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:49:32.246751 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1faf0631-8b77-4eeb-86a6-4ca8822edae1 tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] 10.222.0.20 "GET /compute/v2.1/servers/dbac6549-6ae2-4521-b177-7e3ccba76d8e" status: 200 len: 1317 microversion: 2.1 time: 0.193742 Oct 27 03:49:32.247908 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3202/6116] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:49:32 2022] GET /compute/v2.1/servers/dbac6549-6ae2-4521-b177-7e3ccba76d8e => generated 1317 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:49:33.276374 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0f693102-0fdd-483a-a39c-f3a943b4615e tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:49:33.276374 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0f693102-0fdd-483a-a39c-f3a943b4615e tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] [instance: dbac6549-6ae2-4521-b177-7e3ccba76d8e] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:49:33.300933 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0f693102-0fdd-483a-a39c-f3a943b4615e tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:33.304510 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0f693102-0fdd-483a-a39c-f3a943b4615e tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:33.305733 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0f693102-0fdd-483a-a39c-f3a943b4615e tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:33.310105 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0f693102-0fdd-483a-a39c-f3a943b4615e tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:33.310779 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0f693102-0fdd-483a-a39c-f3a943b4615e tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:33.311554 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0f693102-0fdd-483a-a39c-f3a943b4615e tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:33.338210 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-0f693102-0fdd-483a-a39c-f3a943b4615e tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] HTTP exception thrown: Instance dbac6549-6ae2-4521-b177-7e3ccba76d8e could not be found. Oct 27 03:49:33.346568 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0f693102-0fdd-483a-a39c-f3a943b4615e tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Request method failure captured: Oct 27 03:49:33.346568 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/dbac6549-6ae2-4521-b177-7e3ccba76d8e HTTP/1.1 Oct 27 03:49:33.346568 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:49:33.346568 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:49:33.346568 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:49:33.346568 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:49:33.346568 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:49:33.346568 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:49:33.346568 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:49:33.346568 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:49:33.346568 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWf-clCyUKBchNsIC789_H6g-LzP2ax-Q7hPCvf7LO3_e0X46JaxgL1tfwkGw6zMdZFo_7tykG9PCvaV9YuShaYPbsb3tqO1b_8ck2fPHPxbdWa6Jo-KpS5JxcMmyunWJ40xiI47u9f3lI5XfqsR_cB7YioZkf0w31xJKb0Vr3cCtfaE Oct 27 03:49:33.346568 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:49:33.346568 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:49:33.346568 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:49:33.346568 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:49:33.346568 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:49:33.346568 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:49:33.346568 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: a3d03faa410840e0ae6d7523188d63b6 Oct 27 03:49:33.346568 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-111390223 Oct 27 03:49:33.346568 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:49:33.346568 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:49:33.346568 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a3d03faa410840e0ae6d7523188d63b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a3d03faa410840e0ae6d7523188d63b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a3d03faa410840e0ae6d7523188d63b6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a3d03faa410840e0ae6d7523188d63b6"}]}] Oct 27 03:49:33.346568 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-111390223 Oct 27 03:49:33.346568 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: a3d03faa410840e0ae6d7523188d63b6 Oct 27 03:49:33.346568 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-111390223 Oct 27 03:49:33.346568 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ServersNegativeTestMultiTenantJSON-111390223-project Oct 27 03:49:33.346568 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:49:33.346568 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:49:33.346568 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 2fc1e7eafd7948279f08eb5ad52f5609 Oct 27 03:49:33.346568 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-111390223-project Oct 27 03:49:33.346568 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:49:33.346568 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance dbac6549-6ae2-4521-b177-7e3ccba76d8e could not be found. Oct 27 03:49:33.346568 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': 'dbac6549-6ae2-4521-b177-7e3ccba76d8e'} Oct 27 03:49:33.346568 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:49:33.346568 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:49:33.346568 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:49:33.346568 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:49:33.346568 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:49:33.346568 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:49:33.346568 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:49:33.346568 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:49:33.346568 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:49:33.346568 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:49:33.346568 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbac6549-6ae2-4521-b177-7e3ccba76d8e could not be found. Oct 27 03:49:33.346568 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:33.346568 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:49:33.346568 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:33.346568 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:49:33.346568 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:49:33.346568 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:49:33.346568 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:49:33.346568 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:49:33.346568 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:49:33.346568 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:49:33.346568 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:49:33.346568 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:49:33.346568 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:49:33.346568 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:49:33.346568 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:49:33.346568 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:49:33.346568 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbac6549-6ae2-4521-b177-7e3ccba76d8e could not be found. Oct 27 03:49:33.346568 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:33.350231 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:49:33.350231 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:33.350231 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:49:33.350231 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:49:33.350231 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:49:33.350231 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:49:33.350231 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:49:33.350231 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbac6549-6ae2-4521-b177-7e3ccba76d8e could not be found. Oct 27 03:49:33.350231 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:49:33.353255 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0f693102-0fdd-483a-a39c-f3a943b4615e tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] Returning 404 to user: Instance dbac6549-6ae2-4521-b177-7e3ccba76d8e could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:49:33.355463 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0f693102-0fdd-483a-a39c-f3a943b4615e tempest-ServersNegativeTestMultiTenantJSON-111390223 tempest-ServersNegativeTestMultiTenantJSON-111390223-project] 10.222.0.20 "GET /compute/v2.1/servers/dbac6549-6ae2-4521-b177-7e3ccba76d8e" status: 404 len: 111 microversion: 2.1 time: 0.086830 Oct 27 03:49:33.356637 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2915/6117] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:49:33 2022] GET /compute/v2.1/servers/dbac6549-6ae2-4521-b177-7e3ccba76d8e => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:49:33.581034 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9eaa060e-1b63-4298-a7a7-b84c4e5d8698 tempest-VolumesTestJSON-388566726 tempest-VolumesTestJSON-388566726-project] Calling method '.version_select at 0x7f7dd95d30d0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:49:33.753906 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9eaa060e-1b63-4298-a7a7-b84c4e5d8698 tempest-VolumesTestJSON-388566726 tempest-VolumesTestJSON-388566726-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/318213fc-0c44-432f-ab89-043358fb5bab" status: 200 len: 351 microversion: 2.1 time: 0.177784 Oct 27 03:49:33.763073 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3203/6118] 10.222.0.20 () {58 vars in 1245 bytes} [Thu Oct 27 03:49:33 2022] GET /compute/v2.1/os-volumes/318213fc-0c44-432f-ab89-043358fb5bab => generated 351 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:49:38.301595 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b5223e96-21e7-49b0-a88f-445d2b230c1e tempest-VolumesTestJSON-388566726 tempest-VolumesTestJSON-388566726-project] Calling method '.version_select at 0x7f7ddecaee50>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:49:38.436828 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b5223e96-21e7-49b0-a88f-445d2b230c1e tempest-VolumesTestJSON-388566726 tempest-VolumesTestJSON-388566726-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/f3f88f46-de90-43f3-b020-ce5dc56d2e05" status: 200 len: 351 microversion: 2.1 time: 0.139000 Oct 27 03:49:38.445507 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2916/6119] 10.222.0.20 () {58 vars in 1245 bytes} [Thu Oct 27 03:49:38 2022] GET /compute/v2.1/os-volumes/f3f88f46-de90-43f3-b020-ce5dc56d2e05 => generated 351 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:49:38.452970 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-61892fdb-1012-4c98-abf5-5bf6d1e8b698 tempest-VolumesTestJSON-388566726 tempest-VolumesTestJSON-388566726-project] Calling method '.version_select at 0x7f7dd95cd1f0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:49:38.692541 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-61892fdb-1012-4c98-abf5-5bf6d1e8b698 tempest-VolumesTestJSON-388566726 tempest-VolumesTestJSON-388566726-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.245516 Oct 27 03:49:38.694835 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3204/6120] 10.222.0.20 () {58 vars in 1134 bytes} [Thu Oct 27 03:49:38 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:49:38.711425 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3b17da11-db20-4b13-8fd1-2a682c14ea45 tempest-VolumesTestJSON-388566726 tempest-VolumesTestJSON-388566726-project] Calling method '.version_select at 0x7f7dd98b05e0>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:49:38.840286 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3b17da11-db20-4b13-8fd1-2a682c14ea45 tempest-VolumesTestJSON-388566726 tempest-VolumesTestJSON-388566726-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.133418 Oct 27 03:49:38.841776 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2917/6121] 10.222.0.20 () {58 vars in 1149 bytes} [Thu Oct 27 03:49:38 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:49:38.859538 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0d5246b3-d88f-49a7-be94-d6e4444d7cb7 tempest-VolumesTestJSON-388566726 tempest-VolumesTestJSON-388566726-project] Calling method '.version_select at 0x7f7dd95d6280>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:49:39.087159 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0d5246b3-d88f-49a7-be94-d6e4444d7cb7 tempest-VolumesTestJSON-388566726 tempest-VolumesTestJSON-388566726-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.234804 Oct 27 03:49:39.088425 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3205/6122] 10.222.0.20 () {58 vars in 1134 bytes} [Thu Oct 27 03:49:38 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:49:39.101443 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6dbbb921-2ddc-4c63-bb5a-b48716832b35 tempest-VolumesTestJSON-388566726 tempest-VolumesTestJSON-388566726-project] Calling method '.version_select at 0x7f7dd98b5940>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:49:39.241489 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6dbbb921-2ddc-4c63-bb5a-b48716832b35 tempest-VolumesTestJSON-388566726 tempest-VolumesTestJSON-388566726-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.143859 Oct 27 03:49:39.252509 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2918/6123] 10.222.0.20 () {58 vars in 1167 bytes} [Thu Oct 27 03:49:39 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:49:39.257105 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a5795858-07f6-4148-92d8-f4ff303c7dc9 tempest-VolumesTestJSON-388566726 tempest-VolumesTestJSON-388566726-project] Calling method '.version_select at 0x7f7dd95d3d30>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:49:39.534195 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a5795858-07f6-4148-92d8-f4ff303c7dc9 tempest-VolumesTestJSON-388566726 tempest-VolumesTestJSON-388566726-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.281230 Oct 27 03:49:39.535395 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3206/6124] 10.222.0.20 () {58 vars in 1170 bytes} [Thu Oct 27 03:49:39 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:49:39.551924 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b1d42910-382e-46c8-8edc-82c39bedf001 tempest-VolumesTestJSON-388566726 tempest-VolumesTestJSON-388566726-project] Calling method '.version_select at 0x7f7dd9903d30>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:49:39.776464 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b1d42910-382e-46c8-8edc-82c39bedf001 tempest-VolumesTestJSON-388566726 tempest-VolumesTestJSON-388566726-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.230370 Oct 27 03:49:39.777153 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2919/6125] 10.222.0.20 () {58 vars in 1155 bytes} [Thu Oct 27 03:49:39 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:49:39.791170 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9ec7d9a1-fc14-4cfc-a229-7b7c2556d7f0 tempest-VolumesTestJSON-388566726 tempest-VolumesTestJSON-388566726-project] Calling method '.version_select at 0x7f7dd95d3160>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:49:40.046498 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9ec7d9a1-fc14-4cfc-a229-7b7c2556d7f0 tempest-VolumesTestJSON-388566726 tempest-VolumesTestJSON-388566726-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.259594 Oct 27 03:49:40.061054 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3207/6126] 10.222.0.20 () {58 vars in 1188 bytes} [Thu Oct 27 03:49:39 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:49:40.062503 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-20d0b0f4-3f15-458e-a164-59d4d2aadf7f tempest-VolumesTestJSON-388566726 tempest-VolumesTestJSON-388566726-project] Calling method '.version_select at 0x7f7dd9892a60>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:49:40.357274 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-20d0b0f4-3f15-458e-a164-59d4d2aadf7f tempest-VolumesTestJSON-388566726 tempest-VolumesTestJSON-388566726-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.300154 Oct 27 03:49:40.362086 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2920/6127] 10.222.0.20 () {58 vars in 1155 bytes} [Thu Oct 27 03:49:40 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:49:54.316716 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:54.318291 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=5 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:54.323697 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5b8644d7-f259-49d3-b460-bf95109f2b58 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1886710686", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": [{"uuid": "7a96d3fe-16c2-401d-a01a-edb460477099"}]}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:49:54.482969 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.network.neutron [None req-5b8644d7-f259-49d3-b460-bf95109f2b58 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] validate_networks() for [('7a96d3fe-16c2-401d-a01a-edb460477099', None, None, None, None, None)] {{(pid=121001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:49:55.591387 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-5b8644d7-f259-49d3-b460-bf95109f2b58 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Flavor limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:49:55.592624 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-5b8644d7-f259-49d3-b460-bf95109f2b58 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Image limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:49:55.594115 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-5b8644d7-f259-49d3-b460-bf95109f2b58 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Flavor pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:49:55.598726 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-5b8644d7-f259-49d3-b460-bf95109f2b58 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Image pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:49:55.598726 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-5b8644d7-f259-49d3-b460-bf95109f2b58 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:49:55.643242 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5b8644d7-f259-49d3-b460-bf95109f2b58 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:55.646999 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5b8644d7-f259-49d3-b460-bf95109f2b58 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:55.647968 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5b8644d7-f259-49d3-b460-bf95109f2b58 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:55.649390 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5b8644d7-f259-49d3-b460-bf95109f2b58 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:55.657090 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5b8644d7-f259-49d3-b460-bf95109f2b58 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:55.657697 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5b8644d7-f259-49d3-b460-bf95109f2b58 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:55.722250 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-5b8644d7-f259-49d3-b460-bf95109f2b58 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Getting quotas for project aead91140df544faa492b8fd1952db8c. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:49:55.734738 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-5b8644d7-f259-49d3-b460-bf95109f2b58 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Getting quotas for user 66ba627e73834b84b1ee6514e1facd1c and project aead91140df544faa492b8fd1952db8c. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:49:55.845179 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5b8644d7-f259-49d3-b460-bf95109f2b58 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Going to run 1 instances... {{(pid=121001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:49:55.855258 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5b8644d7-f259-49d3-b460-bf95109f2b58 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] [instance: 8bd45399-6397-4a2a-b5b2-d2b7f86ef406] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:49:56.001295 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5b8644d7-f259-49d3-b460-bf95109f2b58 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.686055 Oct 27 03:49:56.004682 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3208/6128] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:49:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1690 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 03:49:56.013660 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=19 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:56.014596 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:49:56.020105 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0a536ba2-ce3c-4e97-909d-83f1ad5cb70f tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:49:56.021134 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0a536ba2-ce3c-4e97-909d-83f1ad5cb70f tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] [instance: 8bd45399-6397-4a2a-b5b2-d2b7f86ef406] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:49:56.172891 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0a536ba2-ce3c-4e97-909d-83f1ad5cb70f tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ba627e73834b84b1ee6514e1facd1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aead91140df544faa492b8fd1952db8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:49:56.187108 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0a536ba2-ce3c-4e97-909d-83f1ad5cb70f tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] 10.222.0.20 "GET /compute/v2.1/servers/8bd45399-6397-4a2a-b5b2-d2b7f86ef406" status: 200 len: 1219 microversion: 2.1 time: 0.175331 Oct 27 03:49:56.196101 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2921/6129] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:49:56 2022] GET /compute/v2.1/servers/8bd45399-6397-4a2a-b5b2-d2b7f86ef406 => generated 1219 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:49:57.225767 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-891c3ea4-5fcd-4618-be3e-aecd79df65e0 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:49:57.226982 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-891c3ea4-5fcd-4618-be3e-aecd79df65e0 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] [instance: 8bd45399-6397-4a2a-b5b2-d2b7f86ef406] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:49:57.453499 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-891c3ea4-5fcd-4618-be3e-aecd79df65e0 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ba627e73834b84b1ee6514e1facd1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aead91140df544faa492b8fd1952db8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:49:57.463628 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-891c3ea4-5fcd-4618-be3e-aecd79df65e0 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] 10.222.0.20 "GET /compute/v2.1/servers/8bd45399-6397-4a2a-b5b2-d2b7f86ef406" status: 200 len: 1219 microversion: 2.1 time: 0.246877 Oct 27 03:49:57.480806 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3209/6130] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:49:57 2022] GET /compute/v2.1/servers/8bd45399-6397-4a2a-b5b2-d2b7f86ef406 => generated 1219 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:49:58.488834 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-47569f4c-882d-4ab0-9cfa-48f67a7adaa7 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:49:58.489468 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-47569f4c-882d-4ab0-9cfa-48f67a7adaa7 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] [instance: 8bd45399-6397-4a2a-b5b2-d2b7f86ef406] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:49:58.518070 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-47569f4c-882d-4ab0-9cfa-48f67a7adaa7 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:58.519593 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-47569f4c-882d-4ab0-9cfa-48f67a7adaa7 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:58.521748 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-47569f4c-882d-4ab0-9cfa-48f67a7adaa7 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:58.528713 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-47569f4c-882d-4ab0-9cfa-48f67a7adaa7 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:58.529445 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-47569f4c-882d-4ab0-9cfa-48f67a7adaa7 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:58.532304 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-47569f4c-882d-4ab0-9cfa-48f67a7adaa7 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:58.864071 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-47569f4c-882d-4ab0-9cfa-48f67a7adaa7 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ba627e73834b84b1ee6514e1facd1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aead91140df544faa492b8fd1952db8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:49:58.877175 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-47569f4c-882d-4ab0-9cfa-48f67a7adaa7 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] 10.222.0.20 "GET /compute/v2.1/servers/8bd45399-6397-4a2a-b5b2-d2b7f86ef406" status: 200 len: 1215 microversion: 2.1 time: 0.394236 Oct 27 03:49:58.901422 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2922/6131] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:49:58 2022] GET /compute/v2.1/servers/8bd45399-6397-4a2a-b5b2-d2b7f86ef406 => generated 1215 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:49:59.915231 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2351f10e-ae6d-4b05-8937-8bcb12c38599 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:49:59.917705 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2351f10e-ae6d-4b05-8937-8bcb12c38599 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] [instance: 8bd45399-6397-4a2a-b5b2-d2b7f86ef406] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:49:59.948204 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2351f10e-ae6d-4b05-8937-8bcb12c38599 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:59.951961 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2351f10e-ae6d-4b05-8937-8bcb12c38599 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:59.953665 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2351f10e-ae6d-4b05-8937-8bcb12c38599 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:49:59.955240 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2351f10e-ae6d-4b05-8937-8bcb12c38599 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:49:59.955790 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2351f10e-ae6d-4b05-8937-8bcb12c38599 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:49:59.960954 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2351f10e-ae6d-4b05-8937-8bcb12c38599 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:50:00.146438 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2351f10e-ae6d-4b05-8937-8bcb12c38599 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ba627e73834b84b1ee6514e1facd1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aead91140df544faa492b8fd1952db8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:50:00.146438 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2351f10e-ae6d-4b05-8937-8bcb12c38599 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] 10.222.0.20 "GET /compute/v2.1/servers/8bd45399-6397-4a2a-b5b2-d2b7f86ef406" status: 200 len: 1279 microversion: 2.1 time: 0.206030 Oct 27 03:50:00.146438 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3210/6132] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:49:59 2022] GET /compute/v2.1/servers/8bd45399-6397-4a2a-b5b2-d2b7f86ef406 => generated 1279 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:50:01.180071 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2577ad2c-6a34-48d6-9209-dfaf31dd5537 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:50:01.185894 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-2577ad2c-6a34-48d6-9209-dfaf31dd5537 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] [instance: 8bd45399-6397-4a2a-b5b2-d2b7f86ef406] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:50:01.213402 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2577ad2c-6a34-48d6-9209-dfaf31dd5537 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:50:01.214117 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2577ad2c-6a34-48d6-9209-dfaf31dd5537 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:50:01.214787 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2577ad2c-6a34-48d6-9209-dfaf31dd5537 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:50:01.215922 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2577ad2c-6a34-48d6-9209-dfaf31dd5537 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:50:01.216715 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2577ad2c-6a34-48d6-9209-dfaf31dd5537 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:50:01.217342 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2577ad2c-6a34-48d6-9209-dfaf31dd5537 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:50:01.319496 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2577ad2c-6a34-48d6-9209-dfaf31dd5537 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ba627e73834b84b1ee6514e1facd1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aead91140df544faa492b8fd1952db8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:50:01.338927 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2577ad2c-6a34-48d6-9209-dfaf31dd5537 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] 10.222.0.20 "GET /compute/v2.1/servers/8bd45399-6397-4a2a-b5b2-d2b7f86ef406" status: 200 len: 1289 microversion: 2.1 time: 0.175943 Oct 27 03:50:01.350594 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2923/6133] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:50:01 2022] GET /compute/v2.1/servers/8bd45399-6397-4a2a-b5b2-d2b7f86ef406 => generated 1289 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:50:02.373104 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-cee04e80-7b7c-4f69-9af4-82f8c4ed6d92 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:50:02.374483 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-cee04e80-7b7c-4f69-9af4-82f8c4ed6d92 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] [instance: 8bd45399-6397-4a2a-b5b2-d2b7f86ef406] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:50:02.395556 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cee04e80-7b7c-4f69-9af4-82f8c4ed6d92 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:50:02.396163 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cee04e80-7b7c-4f69-9af4-82f8c4ed6d92 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:50:02.398784 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cee04e80-7b7c-4f69-9af4-82f8c4ed6d92 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:50:02.400729 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cee04e80-7b7c-4f69-9af4-82f8c4ed6d92 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:50:02.401375 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cee04e80-7b7c-4f69-9af4-82f8c4ed6d92 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:50:02.401964 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cee04e80-7b7c-4f69-9af4-82f8c4ed6d92 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:50:03.147100 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-cee04e80-7b7c-4f69-9af4-82f8c4ed6d92 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ba627e73834b84b1ee6514e1facd1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aead91140df544faa492b8fd1952db8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:50:03.158529 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-cee04e80-7b7c-4f69-9af4-82f8c4ed6d92 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] 10.222.0.20 "GET /compute/v2.1/servers/8bd45399-6397-4a2a-b5b2-d2b7f86ef406" status: 200 len: 1319 microversion: 2.1 time: 0.790711 Oct 27 03:50:03.179140 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2924/6134] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:50:02 2022] GET /compute/v2.1/servers/8bd45399-6397-4a2a-b5b2-d2b7f86ef406 => generated 1319 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:50:03.262232 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e8f9f86e-07cb-45bf-bc4c-8ad45a9505a7 tempest-ExtensionsTest-1620027210 tempest-ExtensionsTest-1620027210-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:50:03.262232 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e8f9f86e-07cb-45bf-bc4c-8ad45a9505a7 tempest-ExtensionsTest-1620027210 tempest-ExtensionsTest-1620027210-project] 10.222.0.20 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.952304 Oct 27 03:50:03.262232 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3211/6135] 10.222.0.20 () {58 vars in 1170 bytes} [Thu Oct 27 03:50:02 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:50:03.268107 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8158339f-4543-4f5e-a320-0462f263a981 tempest-ExtensionsTest-1620027210 tempest-ExtensionsTest-1620027210-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:50:03.270625 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8158339f-4543-4f5e-a320-0462f263a981 tempest-ExtensionsTest-1620027210 tempest-ExtensionsTest-1620027210-project] 10.222.0.20 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.006541 Oct 27 03:50:03.287334 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2925/6136] 10.222.0.20 () {58 vars in 1134 bytes} [Thu Oct 27 03:50:03 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 03:50:04.203635 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-934ff78e-2c75-42d6-9d10-181555e1d531 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:50:04.203635 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-934ff78e-2c75-42d6-9d10-181555e1d531 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] [instance: 8bd45399-6397-4a2a-b5b2-d2b7f86ef406] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:50:04.216172 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-934ff78e-2c75-42d6-9d10-181555e1d531 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:50:04.216782 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-934ff78e-2c75-42d6-9d10-181555e1d531 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:50:04.230775 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-934ff78e-2c75-42d6-9d10-181555e1d531 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:50:04.231673 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-934ff78e-2c75-42d6-9d10-181555e1d531 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:50:04.236948 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-934ff78e-2c75-42d6-9d10-181555e1d531 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:50:04.237417 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-934ff78e-2c75-42d6-9d10-181555e1d531 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:50:04.821394 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-934ff78e-2c75-42d6-9d10-181555e1d531 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ba627e73834b84b1ee6514e1facd1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aead91140df544faa492b8fd1952db8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:50:04.835048 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-934ff78e-2c75-42d6-9d10-181555e1d531 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] 10.222.0.20 "GET /compute/v2.1/servers/8bd45399-6397-4a2a-b5b2-d2b7f86ef406" status: 200 len: 1319 microversion: 2.1 time: 0.644336 Oct 27 03:50:04.851823 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3212/6137] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:50:04 2022] GET /compute/v2.1/servers/8bd45399-6397-4a2a-b5b2-d2b7f86ef406 => generated 1319 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:50:05.168166 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-72d86a8f-e6ff-43ef-bd7f-59d489dce41c req-bb4e2ebd-71b0-4b1c-9fee-8c81bf4e203f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8bd45399-6397-4a2a-b5b2-d2b7f86ef406", "tag": "8e72db64-97c6-4efc-8e7a-76925de99931"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:50:05.231712 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-72d86a8f-e6ff-43ef-bd7f-59d489dce41c req-bb4e2ebd-71b0-4b1c-9fee-8c81bf4e203f service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:50:05.232391 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-72d86a8f-e6ff-43ef-bd7f-59d489dce41c req-bb4e2ebd-71b0-4b1c-9fee-8c81bf4e203f service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:50:05.233088 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-72d86a8f-e6ff-43ef-bd7f-59d489dce41c req-bb4e2ebd-71b0-4b1c-9fee-8c81bf4e203f service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:50:05.267908 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-72d86a8f-e6ff-43ef-bd7f-59d489dce41c req-bb4e2ebd-71b0-4b1c-9fee-8c81bf4e203f service nova] Creating event network-changed:8e72db64-97c6-4efc-8e7a-76925de99931 for instance 8bd45399-6397-4a2a-b5b2-d2b7f86ef406 on n-h1-862769-1 Oct 27 03:50:05.291607 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-72d86a8f-e6ff-43ef-bd7f-59d489dce41c req-bb4e2ebd-71b0-4b1c-9fee-8c81bf4e203f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128766 Oct 27 03:50:05.292259 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2926/6138] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:50:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:50:05.865342 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-bf60fd3c-e360-480c-8aeb-9cf27a5f2e44 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:50:05.865976 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-bf60fd3c-e360-480c-8aeb-9cf27a5f2e44 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] [instance: 8bd45399-6397-4a2a-b5b2-d2b7f86ef406] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:50:05.888885 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:05.890552 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bf60fd3c-e360-480c-8aeb-9cf27a5f2e44 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:50:05.891101 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bf60fd3c-e360-480c-8aeb-9cf27a5f2e44 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:50:05.902934 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bf60fd3c-e360-480c-8aeb-9cf27a5f2e44 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:50:05.905476 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bf60fd3c-e360-480c-8aeb-9cf27a5f2e44 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:50:05.907037 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bf60fd3c-e360-480c-8aeb-9cf27a5f2e44 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:50:05.908525 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bf60fd3c-e360-480c-8aeb-9cf27a5f2e44 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:50:06.500686 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-bf60fd3c-e360-480c-8aeb-9cf27a5f2e44 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ba627e73834b84b1ee6514e1facd1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aead91140df544faa492b8fd1952db8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:50:06.511765 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-bf60fd3c-e360-480c-8aeb-9cf27a5f2e44 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] 10.222.0.20 "GET /compute/v2.1/servers/8bd45399-6397-4a2a-b5b2-d2b7f86ef406" status: 200 len: 1319 microversion: 2.1 time: 0.650214 Oct 27 03:50:06.512370 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3213/6139] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:50:05 2022] GET /compute/v2.1/servers/8bd45399-6397-4a2a-b5b2-d2b7f86ef406 => generated 1319 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:50:07.676079 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c798562a-7750-4ebb-b282-d616b8e8e542 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:50:07.676918 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c798562a-7750-4ebb-b282-d616b8e8e542 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] [instance: 8bd45399-6397-4a2a-b5b2-d2b7f86ef406] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:50:07.693928 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:07.711642 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c798562a-7750-4ebb-b282-d616b8e8e542 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:50:07.712121 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c798562a-7750-4ebb-b282-d616b8e8e542 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:50:07.713096 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c798562a-7750-4ebb-b282-d616b8e8e542 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:50:07.715437 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c798562a-7750-4ebb-b282-d616b8e8e542 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:50:07.719084 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c798562a-7750-4ebb-b282-d616b8e8e542 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:50:07.722235 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c798562a-7750-4ebb-b282-d616b8e8e542 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:50:08.186554 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c798562a-7750-4ebb-b282-d616b8e8e542 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ba627e73834b84b1ee6514e1facd1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aead91140df544faa492b8fd1952db8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:50:08.206829 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c798562a-7750-4ebb-b282-d616b8e8e542 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] 10.222.0.20 "GET /compute/v2.1/servers/8bd45399-6397-4a2a-b5b2-d2b7f86ef406" status: 200 len: 1319 microversion: 2.1 time: 0.528078 Oct 27 03:50:08.211352 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2927/6140] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:50:07 2022] GET /compute/v2.1/servers/8bd45399-6397-4a2a-b5b2-d2b7f86ef406 => generated 1319 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:50:09.233776 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-acd7aa56-e97f-4267-ae19-d343a59a98b0 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:50:09.234483 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-acd7aa56-e97f-4267-ae19-d343a59a98b0 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] [instance: 8bd45399-6397-4a2a-b5b2-d2b7f86ef406] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:50:09.247445 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=8 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:50:09.258145 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-acd7aa56-e97f-4267-ae19-d343a59a98b0 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:50:09.258145 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-acd7aa56-e97f-4267-ae19-d343a59a98b0 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:50:09.258145 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-acd7aa56-e97f-4267-ae19-d343a59a98b0 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:50:09.258145 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-acd7aa56-e97f-4267-ae19-d343a59a98b0 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:50:09.258145 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-acd7aa56-e97f-4267-ae19-d343a59a98b0 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:50:09.258145 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-acd7aa56-e97f-4267-ae19-d343a59a98b0 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:50:10.214870 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-acd7aa56-e97f-4267-ae19-d343a59a98b0 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ba627e73834b84b1ee6514e1facd1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aead91140df544faa492b8fd1952db8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:50:10.229268 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-acd7aa56-e97f-4267-ae19-d343a59a98b0 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] 10.222.0.20 "GET /compute/v2.1/servers/8bd45399-6397-4a2a-b5b2-d2b7f86ef406" status: 200 len: 1319 microversion: 2.1 time: 0.999582 Oct 27 03:50:10.233832 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3214/6141] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:50:09 2022] GET /compute/v2.1/servers/8bd45399-6397-4a2a-b5b2-d2b7f86ef406 => generated 1319 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:50:11.268335 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-67f5503a-5ee1-4081-b5c6-b5c7d028d1fe tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:50:11.268983 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-67f5503a-5ee1-4081-b5c6-b5c7d028d1fe tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] [instance: 8bd45399-6397-4a2a-b5b2-d2b7f86ef406] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:50:11.298260 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-67f5503a-5ee1-4081-b5c6-b5c7d028d1fe tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:50:11.299430 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-67f5503a-5ee1-4081-b5c6-b5c7d028d1fe tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:50:11.302581 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-67f5503a-5ee1-4081-b5c6-b5c7d028d1fe tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:50:11.305831 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-67f5503a-5ee1-4081-b5c6-b5c7d028d1fe tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:50:11.311724 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-67f5503a-5ee1-4081-b5c6-b5c7d028d1fe tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:50:11.316323 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-67f5503a-5ee1-4081-b5c6-b5c7d028d1fe tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:50:12.090415 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-67f5503a-5ee1-4081-b5c6-b5c7d028d1fe tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ba627e73834b84b1ee6514e1facd1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aead91140df544faa492b8fd1952db8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:50:12.108670 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-67f5503a-5ee1-4081-b5c6-b5c7d028d1fe tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] 10.222.0.20 "GET /compute/v2.1/servers/8bd45399-6397-4a2a-b5b2-d2b7f86ef406" status: 200 len: 1319 microversion: 2.1 time: 0.854965 Oct 27 03:50:12.111295 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2928/6142] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:50:11 2022] GET /compute/v2.1/servers/8bd45399-6397-4a2a-b5b2-d2b7f86ef406 => generated 1319 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:50:12.148685 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-c0315bb2-bc3a-4af0-bbd0-51b7351f809d req-54cb7e8f-0d50-42b6-be08-148b69ae844f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bd45399-6397-4a2a-b5b2-d2b7f86ef406", "name": "network-vif-plugged", "status": "completed", "tag": "8e72db64-97c6-4efc-8e7a-76925de99931"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:50:12.175283 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-c0315bb2-bc3a-4af0-bbd0-51b7351f809d req-54cb7e8f-0d50-42b6-be08-148b69ae844f service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:50:12.176076 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-c0315bb2-bc3a-4af0-bbd0-51b7351f809d req-54cb7e8f-0d50-42b6-be08-148b69ae844f service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:50:12.176723 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-c0315bb2-bc3a-4af0-bbd0-51b7351f809d req-54cb7e8f-0d50-42b6-be08-148b69ae844f service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:50:12.226141 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-c0315bb2-bc3a-4af0-bbd0-51b7351f809d req-54cb7e8f-0d50-42b6-be08-148b69ae844f service nova] Creating event network-vif-plugged:8e72db64-97c6-4efc-8e7a-76925de99931 for instance 8bd45399-6397-4a2a-b5b2-d2b7f86ef406 on n-h1-862769-1 Oct 27 03:50:12.245791 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-c0315bb2-bc3a-4af0-bbd0-51b7351f809d req-54cb7e8f-0d50-42b6-be08-148b69ae844f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100634 Oct 27 03:50:12.248612 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3215/6143] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:50:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:50:13.132815 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-99624dc5-ebcf-4ee0-b603-d620f1235ada tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:50:13.133756 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-99624dc5-ebcf-4ee0-b603-d620f1235ada tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] [instance: 8bd45399-6397-4a2a-b5b2-d2b7f86ef406] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:50:13.153565 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-99624dc5-ebcf-4ee0-b603-d620f1235ada tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:50:13.154069 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-99624dc5-ebcf-4ee0-b603-d620f1235ada tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:50:13.154504 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-99624dc5-ebcf-4ee0-b603-d620f1235ada tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:50:13.156551 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-99624dc5-ebcf-4ee0-b603-d620f1235ada tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:50:13.160693 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-99624dc5-ebcf-4ee0-b603-d620f1235ada tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:50:13.161810 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-99624dc5-ebcf-4ee0-b603-d620f1235ada tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:50:13.513575 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-99624dc5-ebcf-4ee0-b603-d620f1235ada tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ba627e73834b84b1ee6514e1facd1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aead91140df544faa492b8fd1952db8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:50:13.522382 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-99624dc5-ebcf-4ee0-b603-d620f1235ada tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] 10.222.0.20 "GET /compute/v2.1/servers/8bd45399-6397-4a2a-b5b2-d2b7f86ef406" status: 200 len: 1319 microversion: 2.1 time: 0.393734 Oct 27 03:50:13.525555 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2929/6144] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:50:13 2022] GET /compute/v2.1/servers/8bd45399-6397-4a2a-b5b2-d2b7f86ef406 => generated 1319 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:50:14.552883 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1a73fd1b-1012-40a5-87ae-21e3887c6ed6 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:50:14.554104 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1a73fd1b-1012-40a5-87ae-21e3887c6ed6 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] [instance: 8bd45399-6397-4a2a-b5b2-d2b7f86ef406] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:50:14.569005 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1a73fd1b-1012-40a5-87ae-21e3887c6ed6 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:50:14.569517 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1a73fd1b-1012-40a5-87ae-21e3887c6ed6 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:50:14.572751 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1a73fd1b-1012-40a5-87ae-21e3887c6ed6 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:50:14.573926 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1a73fd1b-1012-40a5-87ae-21e3887c6ed6 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:50:14.574446 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1a73fd1b-1012-40a5-87ae-21e3887c6ed6 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:50:14.574885 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1a73fd1b-1012-40a5-87ae-21e3887c6ed6 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:50:15.298506 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1a73fd1b-1012-40a5-87ae-21e3887c6ed6 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ba627e73834b84b1ee6514e1facd1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aead91140df544faa492b8fd1952db8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:50:15.315917 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1a73fd1b-1012-40a5-87ae-21e3887c6ed6 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] 10.222.0.20 "GET /compute/v2.1/servers/8bd45399-6397-4a2a-b5b2-d2b7f86ef406" status: 200 len: 1508 microversion: 2.1 time: 0.768808 Oct 27 03:50:15.316537 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3216/6145] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:50:14 2022] GET /compute/v2.1/servers/8bd45399-6397-4a2a-b5b2-d2b7f86ef406 => generated 1508 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:51:00.845309 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-93ef8237-97d0-4a3b-af7b-2af8d3fb55e0 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ef9990d0-cb8c-4962-8fa9-c1454c6368d6", "device": "/dev/sdb"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:51:00.848627 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-93ef8237-97d0-4a3b-af7b-2af8d3fb55e0 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] [instance: 8bd45399-6397-4a2a-b5b2-d2b7f86ef406] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:51:00.855873 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=18 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:00.857075 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=38 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:00.858275 n-d-862769-1 devstack@n-api.service[121000]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 03:51:00.858429 n-d-862769-1 devstack@n-api.service[121000]: Thu Oct 27 03:51:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8bd45399-6397-4a2a-b5b2-d2b7f86ef406/os-volume_attachments (ip 10.222.0.20) !!! Oct 27 03:51:00.862995 n-d-862769-1 devstack@n-api.service[121000]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 03:51:00.863311 n-d-862769-1 devstack@n-api.service[121000]: Thu Oct 27 03:51:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8bd45399-6397-4a2a-b5b2-d2b7f86ef406/os-volume_attachments (ip 10.222.0.20) !!! Oct 27 03:51:00.870621 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-93ef8237-97d0-4a3b-af7b-2af8d3fb55e0 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:51:00.871330 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-93ef8237-97d0-4a3b-af7b-2af8d3fb55e0 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:51:00.871936 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-93ef8237-97d0-4a3b-af7b-2af8d3fb55e0 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:51:00.872997 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-93ef8237-97d0-4a3b-af7b-2af8d3fb55e0 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:51:00.873827 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-93ef8237-97d0-4a3b-af7b-2af8d3fb55e0 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:51:00.874700 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-93ef8237-97d0-4a3b-af7b-2af8d3fb55e0 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:51:01.903709 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-93ef8237-97d0-4a3b-af7b-2af8d3fb55e0 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] 10.222.0.20 "POST /compute/v2.1/servers/8bd45399-6397-4a2a-b5b2-d2b7f86ef406/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.063581 Oct 27 03:51:01.905843 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2930/6146] 10.222.0.20 () {60 vars in 1323 bytes} [Thu Oct 27 03:51:00 2022] POST /compute/v2.1/servers/8bd45399-6397-4a2a-b5b2-d2b7f86ef406/os-volume_attachments => generated 194 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:51:44.951058 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:44.951956 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=34 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:44.953255 n-d-862769-1 devstack@n-api.service[121001]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 03:51:44.953506 n-d-862769-1 devstack@n-api.service[121001]: Thu Oct 27 03:51:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8bd45399-6397-4a2a-b5b2-d2b7f86ef406/os-volume_attachments/ef9990d0-cb8c-4962-8fa9-c1454c6368d6 (ip 10.222.0.20) !!! Oct 27 03:51:44.959206 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-fb624dfa-a64b-4d9e-97c1-fd28161d33dd tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:51:44.960558 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-fb624dfa-a64b-4d9e-97c1-fd28161d33dd tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] [instance: 8bd45399-6397-4a2a-b5b2-d2b7f86ef406] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:51:44.969492 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fb624dfa-a64b-4d9e-97c1-fd28161d33dd tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:51:44.970379 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fb624dfa-a64b-4d9e-97c1-fd28161d33dd tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:51:44.971594 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fb624dfa-a64b-4d9e-97c1-fd28161d33dd tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:51:44.972563 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fb624dfa-a64b-4d9e-97c1-fd28161d33dd tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:51:44.973717 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fb624dfa-a64b-4d9e-97c1-fd28161d33dd tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:51:44.974398 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fb624dfa-a64b-4d9e-97c1-fd28161d33dd tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:51:45.571323 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-fb624dfa-a64b-4d9e-97c1-fd28161d33dd tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lazy-loading 'services' on Instance uuid 8bd45399-6397-4a2a-b5b2-d2b7f86ef406 {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:51:45.927242 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-fb624dfa-a64b-4d9e-97c1-fd28161d33dd tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8bd45399-6397-4a2a-b5b2-d2b7f86ef406/os-volume_attachments/ef9990d0-cb8c-4962-8fa9-c1454c6368d6" status: 202 len: 0 microversion: 2.1 time: 0.977967 Oct 27 03:51:45.930908 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3217/6147] 10.222.0.20 () {58 vars in 1416 bytes} [Thu Oct 27 03:51:44 2022] DELETE /compute/v2.1/servers/8bd45399-6397-4a2a-b5b2-d2b7f86ef406/os-volume_attachments/ef9990d0-cb8c-4962-8fa9-c1454c6368d6 => generated 0 bytes in 983 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:51:53.879460 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9d3faabe-84cf-4d10-b605-4be5cce6ae90 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:51:53.886910 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9d3faabe-84cf-4d10-b605-4be5cce6ae90 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] [instance: 8bd45399-6397-4a2a-b5b2-d2b7f86ef406] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:51:53.904707 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:53.905776 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:51:53.908868 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9d3faabe-84cf-4d10-b605-4be5cce6ae90 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:51:53.911898 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9d3faabe-84cf-4d10-b605-4be5cce6ae90 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:51:53.913596 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9d3faabe-84cf-4d10-b605-4be5cce6ae90 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:51:53.915772 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9d3faabe-84cf-4d10-b605-4be5cce6ae90 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:51:53.916535 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9d3faabe-84cf-4d10-b605-4be5cce6ae90 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:51:53.917217 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9d3faabe-84cf-4d10-b605-4be5cce6ae90 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:51:53.978503 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9d3faabe-84cf-4d10-b605-4be5cce6ae90 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] [instance: 8bd45399-6397-4a2a-b5b2-d2b7f86ef406] Going to try to terminate instance {{(pid=121000) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:51:54.412539 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9d3faabe-84cf-4d10-b605-4be5cce6ae90 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8bd45399-6397-4a2a-b5b2-d2b7f86ef406" status: 204 len: 0 microversion: 2.1 time: 0.538262 Oct 27 03:51:54.414071 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2931/6148] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:51:53 2022] DELETE /compute/v2.1/servers/8bd45399-6397-4a2a-b5b2-d2b7f86ef406 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:51:54.423701 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-379021aa-2b11-4efc-942d-47e154c9c71c tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:51:54.425013 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-379021aa-2b11-4efc-942d-47e154c9c71c tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] [instance: 8bd45399-6397-4a2a-b5b2-d2b7f86ef406] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:51:54.445143 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-379021aa-2b11-4efc-942d-47e154c9c71c tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:51:54.445856 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-379021aa-2b11-4efc-942d-47e154c9c71c tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:51:54.446514 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-379021aa-2b11-4efc-942d-47e154c9c71c tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:51:54.447440 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-379021aa-2b11-4efc-942d-47e154c9c71c tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:51:54.448070 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-379021aa-2b11-4efc-942d-47e154c9c71c tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:51:54.448508 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-379021aa-2b11-4efc-942d-47e154c9c71c tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:51:55.437664 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-379021aa-2b11-4efc-942d-47e154c9c71c tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ba627e73834b84b1ee6514e1facd1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aead91140df544faa492b8fd1952db8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:51:55.454386 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-379021aa-2b11-4efc-942d-47e154c9c71c tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] 10.222.0.20 "GET /compute/v2.1/servers/8bd45399-6397-4a2a-b5b2-d2b7f86ef406" status: 200 len: 1514 microversion: 2.1 time: 1.032641 Oct 27 03:51:55.455499 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3218/6149] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:51:54 2022] GET /compute/v2.1/servers/8bd45399-6397-4a2a-b5b2-d2b7f86ef406 => generated 1514 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:51:56.490867 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4e21ff88-2b8f-43a1-99d9-d1f4350cd865 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:51:56.491661 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4e21ff88-2b8f-43a1-99d9-d1f4350cd865 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] [instance: 8bd45399-6397-4a2a-b5b2-d2b7f86ef406] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:51:56.511789 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4e21ff88-2b8f-43a1-99d9-d1f4350cd865 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:51:56.522305 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4e21ff88-2b8f-43a1-99d9-d1f4350cd865 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:51:56.522892 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4e21ff88-2b8f-43a1-99d9-d1f4350cd865 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:51:56.523737 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4e21ff88-2b8f-43a1-99d9-d1f4350cd865 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:51:56.526429 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4e21ff88-2b8f-43a1-99d9-d1f4350cd865 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:51:56.527352 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4e21ff88-2b8f-43a1-99d9-d1f4350cd865 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:51:57.202138 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4e21ff88-2b8f-43a1-99d9-d1f4350cd865 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ba627e73834b84b1ee6514e1facd1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aead91140df544faa492b8fd1952db8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:51:57.218593 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4e21ff88-2b8f-43a1-99d9-d1f4350cd865 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] 10.222.0.20 "GET /compute/v2.1/servers/8bd45399-6397-4a2a-b5b2-d2b7f86ef406" status: 200 len: 1514 microversion: 2.1 time: 0.731678 Oct 27 03:51:57.220136 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2932/6150] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:51:56 2022] GET /compute/v2.1/servers/8bd45399-6397-4a2a-b5b2-d2b7f86ef406 => generated 1514 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:51:58.253580 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d7e760cb-5465-4d78-adab-04a077d9cc49 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:51:58.254485 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d7e760cb-5465-4d78-adab-04a077d9cc49 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] [instance: 8bd45399-6397-4a2a-b5b2-d2b7f86ef406] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:51:58.269419 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d7e760cb-5465-4d78-adab-04a077d9cc49 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:51:58.270063 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d7e760cb-5465-4d78-adab-04a077d9cc49 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:51:58.270579 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d7e760cb-5465-4d78-adab-04a077d9cc49 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:51:58.271386 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d7e760cb-5465-4d78-adab-04a077d9cc49 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:51:58.272668 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d7e760cb-5465-4d78-adab-04a077d9cc49 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:51:58.279813 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d7e760cb-5465-4d78-adab-04a077d9cc49 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:51:58.851618 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d7e760cb-5465-4d78-adab-04a077d9cc49 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ba627e73834b84b1ee6514e1facd1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aead91140df544faa492b8fd1952db8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:51:58.868362 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d7e760cb-5465-4d78-adab-04a077d9cc49 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] 10.222.0.20 "GET /compute/v2.1/servers/8bd45399-6397-4a2a-b5b2-d2b7f86ef406" status: 200 len: 1514 microversion: 2.1 time: 0.617536 Oct 27 03:51:58.871566 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3219/6151] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:51:58 2022] GET /compute/v2.1/servers/8bd45399-6397-4a2a-b5b2-d2b7f86ef406 => generated 1514 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:51:59.014706 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-7456407d-30d4-4fcb-a943-297e191d840f req-25e72a07-71e5-40a2-baef-846c8c6fdf2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bd45399-6397-4a2a-b5b2-d2b7f86ef406", "name": "network-vif-deleted", "tag": "8e72db64-97c6-4efc-8e7a-76925de99931"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:51:59.039495 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-7456407d-30d4-4fcb-a943-297e191d840f req-25e72a07-71e5-40a2-baef-846c8c6fdf2b service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:51:59.039927 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-7456407d-30d4-4fcb-a943-297e191d840f req-25e72a07-71e5-40a2-baef-846c8c6fdf2b service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:51:59.040444 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-7456407d-30d4-4fcb-a943-297e191d840f req-25e72a07-71e5-40a2-baef-846c8c6fdf2b service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:51:59.111374 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-7456407d-30d4-4fcb-a943-297e191d840f req-25e72a07-71e5-40a2-baef-846c8c6fdf2b service nova] Creating event network-vif-deleted:8e72db64-97c6-4efc-8e7a-76925de99931 for instance 8bd45399-6397-4a2a-b5b2-d2b7f86ef406 on n-h1-862769-1 Oct 27 03:51:59.124408 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-7456407d-30d4-4fcb-a943-297e191d840f req-25e72a07-71e5-40a2-baef-846c8c6fdf2b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113825 Oct 27 03:51:59.133983 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2933/6152] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:51:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:51:59.894561 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6bf80f58-043c-4c18-b08c-e303923b8a51 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:51:59.896450 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-6bf80f58-043c-4c18-b08c-e303923b8a51 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] [instance: 8bd45399-6397-4a2a-b5b2-d2b7f86ef406] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:51:59.924271 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6bf80f58-043c-4c18-b08c-e303923b8a51 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:51:59.927241 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6bf80f58-043c-4c18-b08c-e303923b8a51 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:51:59.927885 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6bf80f58-043c-4c18-b08c-e303923b8a51 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:51:59.929524 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6bf80f58-043c-4c18-b08c-e303923b8a51 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:51:59.931509 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6bf80f58-043c-4c18-b08c-e303923b8a51 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:51:59.935693 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6bf80f58-043c-4c18-b08c-e303923b8a51 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:51:59.996463 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6bf80f58-043c-4c18-b08c-e303923b8a51 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:51:59.997375 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6bf80f58-043c-4c18-b08c-e303923b8a51 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:51:59.998108 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6bf80f58-043c-4c18-b08c-e303923b8a51 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:51:59.998801 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-6bf80f58-043c-4c18-b08c-e303923b8a51 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lazy-loading 'fault' on Instance uuid 8bd45399-6397-4a2a-b5b2-d2b7f86ef406 {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:52:00.122442 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6bf80f58-043c-4c18-b08c-e303923b8a51 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ba627e73834b84b1ee6514e1facd1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aead91140df544faa492b8fd1952db8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:52:00.144515 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6bf80f58-043c-4c18-b08c-e303923b8a51 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] 10.222.0.20 "GET /compute/v2.1/servers/8bd45399-6397-4a2a-b5b2-d2b7f86ef406" status: 200 len: 1309 microversion: 2.1 time: 0.252792 Oct 27 03:52:00.150461 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3220/6153] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:51:59 2022] GET /compute/v2.1/servers/8bd45399-6397-4a2a-b5b2-d2b7f86ef406 => generated 1309 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:52:01.172096 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5dc079e1-dc2e-4084-a866-75d596fb04d1 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:52:01.172812 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5dc079e1-dc2e-4084-a866-75d596fb04d1 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] [instance: 8bd45399-6397-4a2a-b5b2-d2b7f86ef406] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:52:01.183528 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5dc079e1-dc2e-4084-a866-75d596fb04d1 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:52:01.185401 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5dc079e1-dc2e-4084-a866-75d596fb04d1 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:52:01.186156 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5dc079e1-dc2e-4084-a866-75d596fb04d1 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:52:01.188548 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5dc079e1-dc2e-4084-a866-75d596fb04d1 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:52:01.189968 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5dc079e1-dc2e-4084-a866-75d596fb04d1 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:52:01.190808 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5dc079e1-dc2e-4084-a866-75d596fb04d1 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:52:01.223181 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-5dc079e1-dc2e-4084-a866-75d596fb04d1 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] HTTP exception thrown: Instance 8bd45399-6397-4a2a-b5b2-d2b7f86ef406 could not be found. Oct 27 03:52:01.233328 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5dc079e1-dc2e-4084-a866-75d596fb04d1 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Request method failure captured: Oct 27 03:52:01.233328 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/8bd45399-6397-4a2a-b5b2-d2b7f86ef406 HTTP/1.1 Oct 27 03:52:01.233328 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:52:01.233328 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:52:01.233328 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:52:01.233328 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:52:01.233328 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:52:01.233328 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:52:01.233328 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:52:01.233328 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:52:01.233328 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWf9Z8AWu-9AtY7xde6y3ALCJlGMARVgxTfOLSMxRaGecHl7nCRHEt3rUMZrEU8X3Jaq2CHz-LjHDneOyn9d-llFK-ATuhJ_8R5aMGIGBBQQx2jRggmsg38-BUXM7eWDy8hxqwrFvTjygte49bEoY7lsYFaCR0JBlGd4L3kFReFOrtWE Oct 27 03:52:01.233328 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:52:01.233328 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:52:01.233328 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:52:01.233328 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:52:01.233328 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:52:01.233328 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:52:01.233328 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: aead91140df544faa492b8fd1952db8c Oct 27 03:52:01.233328 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1169448723 Oct 27 03:52:01.233328 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:52:01.233328 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:52:01.233328 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aead91140df544faa492b8fd1952db8c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/aead91140df544faa492b8fd1952db8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aead91140df544faa492b8fd1952db8c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_aead91140df544faa492b8fd1952db8c"}]}] Oct 27 03:52:01.233328 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-VolumesSnapshotTestJSON-1169448723 Oct 27 03:52:01.233328 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: aead91140df544faa492b8fd1952db8c Oct 27 03:52:01.233328 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1169448723 Oct 27 03:52:01.233328 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-VolumesSnapshotTestJSON-1169448723-project Oct 27 03:52:01.233328 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:52:01.233328 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:52:01.233328 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 66ba627e73834b84b1ee6514e1facd1c Oct 27 03:52:01.233328 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-VolumesSnapshotTestJSON-1169448723-project Oct 27 03:52:01.233328 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:52:01.233328 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 8bd45399-6397-4a2a-b5b2-d2b7f86ef406 could not be found. Oct 27 03:52:01.233328 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '8bd45399-6397-4a2a-b5b2-d2b7f86ef406'} Oct 27 03:52:01.233328 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:52:01.233328 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:52:01.233328 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:52:01.233328 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:52:01.233328 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:52:01.233328 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:52:01.233328 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:52:01.233328 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:52:01.233328 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:52:01.233328 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:52:01.233328 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bd45399-6397-4a2a-b5b2-d2b7f86ef406 could not be found. Oct 27 03:52:01.233328 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:52:01.233328 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:52:01.233328 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:52:01.233328 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:52:01.233328 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:52:01.233328 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:52:01.233328 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:52:01.233328 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:52:01.233328 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:52:01.233328 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:52:01.233328 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:52:01.233328 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:52:01.233328 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:52:01.233328 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:52:01.233328 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:52:01.233328 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:52:01.233328 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bd45399-6397-4a2a-b5b2-d2b7f86ef406 could not be found. Oct 27 03:52:01.233328 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:52:01.233328 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:52:01.233328 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:52:01.237666 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:52:01.237666 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:52:01.237666 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:52:01.237666 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:52:01.237666 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:52:01.237666 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bd45399-6397-4a2a-b5b2-d2b7f86ef406 could not be found. Oct 27 03:52:01.237666 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:52:01.240780 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5dc079e1-dc2e-4084-a866-75d596fb04d1 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Returning 404 to user: Instance 8bd45399-6397-4a2a-b5b2-d2b7f86ef406 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:52:01.241913 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5dc079e1-dc2e-4084-a866-75d596fb04d1 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] 10.222.0.20 "GET /compute/v2.1/servers/8bd45399-6397-4a2a-b5b2-d2b7f86ef406" status: 404 len: 111 microversion: 2.1 time: 0.074205 Oct 27 03:52:01.242333 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2934/6154] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:52:01 2022] GET /compute/v2.1/servers/8bd45399-6397-4a2a-b5b2-d2b7f86ef406 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:52:13.815198 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5023b8af-1a2f-4f52-bbcc-f27bc7a058ea tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1685061297", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": [{"uuid": "7a96d3fe-16c2-401d-a01a-edb460477099"}]}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:52:13.833092 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=10 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:52:13.835432 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:52:13.902468 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.network.neutron [None req-5023b8af-1a2f-4f52-bbcc-f27bc7a058ea tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] validate_networks() for [('7a96d3fe-16c2-401d-a01a-edb460477099', None, None, None, None, None)] {{(pid=121001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:52:15.865094 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-5023b8af-1a2f-4f52-bbcc-f27bc7a058ea tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Flavor limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:52:15.865094 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-5023b8af-1a2f-4f52-bbcc-f27bc7a058ea tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Image limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:52:15.865849 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-5023b8af-1a2f-4f52-bbcc-f27bc7a058ea tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Flavor pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:52:15.865927 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-5023b8af-1a2f-4f52-bbcc-f27bc7a058ea tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Image pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:52:15.866468 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-5023b8af-1a2f-4f52-bbcc-f27bc7a058ea tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:52:15.885057 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5023b8af-1a2f-4f52-bbcc-f27bc7a058ea tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:52:15.893671 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5023b8af-1a2f-4f52-bbcc-f27bc7a058ea tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:52:15.898171 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5023b8af-1a2f-4f52-bbcc-f27bc7a058ea tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:52:15.899727 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5023b8af-1a2f-4f52-bbcc-f27bc7a058ea tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:52:15.899943 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5023b8af-1a2f-4f52-bbcc-f27bc7a058ea tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:52:15.900973 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5023b8af-1a2f-4f52-bbcc-f27bc7a058ea tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:52:15.959433 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-5023b8af-1a2f-4f52-bbcc-f27bc7a058ea tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Getting quotas for project aead91140df544faa492b8fd1952db8c. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:52:15.972494 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-5023b8af-1a2f-4f52-bbcc-f27bc7a058ea tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Getting quotas for user 66ba627e73834b84b1ee6514e1facd1c and project aead91140df544faa492b8fd1952db8c. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:52:16.018999 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5023b8af-1a2f-4f52-bbcc-f27bc7a058ea tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Going to run 1 instances... {{(pid=121001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:52:16.022534 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5023b8af-1a2f-4f52-bbcc-f27bc7a058ea tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] [instance: e15c3d21-45a5-4628-936e-8580d12613b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:52:16.264682 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5023b8af-1a2f-4f52-bbcc-f27bc7a058ea tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.458673 Oct 27 03:52:16.271835 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3221/6155] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:52:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 2467 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 03:52:16.292716 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f9622d85-6735-4360-b14a-a19390c258e3 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:52:16.293429 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f9622d85-6735-4360-b14a-a19390c258e3 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] [instance: e15c3d21-45a5-4628-936e-8580d12613b1] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:52:16.300058 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:52:16.336307 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:52:17.052970 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f9622d85-6735-4360-b14a-a19390c258e3 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ba627e73834b84b1ee6514e1facd1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aead91140df544faa492b8fd1952db8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:52:17.070049 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f9622d85-6735-4360-b14a-a19390c258e3 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] 10.222.0.20 "GET /compute/v2.1/servers/e15c3d21-45a5-4628-936e-8580d12613b1" status: 200 len: 1219 microversion: 2.1 time: 0.784771 Oct 27 03:52:17.075623 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2935/6156] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:52:16 2022] GET /compute/v2.1/servers/e15c3d21-45a5-4628-936e-8580d12613b1 => generated 1219 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:52:18.103411 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4bbf6ab3-0ba4-488b-bd30-8f616a096810 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:52:18.105147 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4bbf6ab3-0ba4-488b-bd30-8f616a096810 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] [instance: e15c3d21-45a5-4628-936e-8580d12613b1] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:52:18.191866 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4bbf6ab3-0ba4-488b-bd30-8f616a096810 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:52:18.193972 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4bbf6ab3-0ba4-488b-bd30-8f616a096810 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:52:18.195035 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4bbf6ab3-0ba4-488b-bd30-8f616a096810 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:52:18.200877 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4bbf6ab3-0ba4-488b-bd30-8f616a096810 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:52:18.203729 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4bbf6ab3-0ba4-488b-bd30-8f616a096810 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:52:18.204902 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4bbf6ab3-0ba4-488b-bd30-8f616a096810 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:52:18.353191 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4bbf6ab3-0ba4-488b-bd30-8f616a096810 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ba627e73834b84b1ee6514e1facd1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aead91140df544faa492b8fd1952db8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:52:18.368101 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4bbf6ab3-0ba4-488b-bd30-8f616a096810 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] 10.222.0.20 "GET /compute/v2.1/servers/e15c3d21-45a5-4628-936e-8580d12613b1" status: 200 len: 1223 microversion: 2.1 time: 0.271801 Oct 27 03:52:18.371411 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3222/6157] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:52:18 2022] GET /compute/v2.1/servers/e15c3d21-45a5-4628-936e-8580d12613b1 => generated 1223 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:52:19.402717 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2f35f01f-20d1-4b69-a9b0-a9df3ca65658 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:52:19.403595 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-2f35f01f-20d1-4b69-a9b0-a9df3ca65658 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] [instance: e15c3d21-45a5-4628-936e-8580d12613b1] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:52:19.419304 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2f35f01f-20d1-4b69-a9b0-a9df3ca65658 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:52:19.431341 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2f35f01f-20d1-4b69-a9b0-a9df3ca65658 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:52:19.432073 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2f35f01f-20d1-4b69-a9b0-a9df3ca65658 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:52:19.432951 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2f35f01f-20d1-4b69-a9b0-a9df3ca65658 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:52:19.433673 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2f35f01f-20d1-4b69-a9b0-a9df3ca65658 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:52:19.434528 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2f35f01f-20d1-4b69-a9b0-a9df3ca65658 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:52:19.550781 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2f35f01f-20d1-4b69-a9b0-a9df3ca65658 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ba627e73834b84b1ee6514e1facd1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aead91140df544faa492b8fd1952db8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:52:19.570993 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2f35f01f-20d1-4b69-a9b0-a9df3ca65658 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] 10.222.0.20 "GET /compute/v2.1/servers/e15c3d21-45a5-4628-936e-8580d12613b1" status: 200 len: 1279 microversion: 2.1 time: 0.162691 Oct 27 03:52:19.570993 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2936/6158] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:52:19 2022] GET /compute/v2.1/servers/e15c3d21-45a5-4628-936e-8580d12613b1 => generated 1279 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:52:20.588441 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f5937aba-2564-4653-bcf3-cb110bc560fc tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:52:20.589082 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f5937aba-2564-4653-bcf3-cb110bc560fc tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] [instance: e15c3d21-45a5-4628-936e-8580d12613b1] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:52:20.602157 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f5937aba-2564-4653-bcf3-cb110bc560fc tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:52:20.602751 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f5937aba-2564-4653-bcf3-cb110bc560fc tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:52:20.605012 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f5937aba-2564-4653-bcf3-cb110bc560fc tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:52:20.605775 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f5937aba-2564-4653-bcf3-cb110bc560fc tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:52:20.606352 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f5937aba-2564-4653-bcf3-cb110bc560fc tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:52:20.606797 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f5937aba-2564-4653-bcf3-cb110bc560fc tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:52:20.852103 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f5937aba-2564-4653-bcf3-cb110bc560fc tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ba627e73834b84b1ee6514e1facd1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aead91140df544faa492b8fd1952db8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:52:20.863447 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f5937aba-2564-4653-bcf3-cb110bc560fc tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] 10.222.0.20 "GET /compute/v2.1/servers/e15c3d21-45a5-4628-936e-8580d12613b1" status: 200 len: 1277 microversion: 2.1 time: 0.279857 Oct 27 03:52:20.864057 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3223/6159] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:52:20 2022] GET /compute/v2.1/servers/e15c3d21-45a5-4628-936e-8580d12613b1 => generated 1277 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:52:21.890851 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-fb60896b-3b03-4c2b-8504-46a8e7539747 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:52:21.890851 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-fb60896b-3b03-4c2b-8504-46a8e7539747 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] [instance: e15c3d21-45a5-4628-936e-8580d12613b1] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:52:21.898951 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fb60896b-3b03-4c2b-8504-46a8e7539747 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:52:21.899455 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fb60896b-3b03-4c2b-8504-46a8e7539747 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:52:21.899902 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fb60896b-3b03-4c2b-8504-46a8e7539747 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:52:21.900710 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fb60896b-3b03-4c2b-8504-46a8e7539747 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:52:21.901178 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fb60896b-3b03-4c2b-8504-46a8e7539747 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:52:21.901617 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fb60896b-3b03-4c2b-8504-46a8e7539747 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:52:22.230966 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-fb60896b-3b03-4c2b-8504-46a8e7539747 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ba627e73834b84b1ee6514e1facd1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aead91140df544faa492b8fd1952db8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:52:22.246699 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-fb60896b-3b03-4c2b-8504-46a8e7539747 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] 10.222.0.20 "GET /compute/v2.1/servers/e15c3d21-45a5-4628-936e-8580d12613b1" status: 200 len: 1319 microversion: 2.1 time: 0.361379 Oct 27 03:52:22.248955 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2937/6160] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:52:21 2022] GET /compute/v2.1/servers/e15c3d21-45a5-4628-936e-8580d12613b1 => generated 1319 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:52:23.277988 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2ce5f07f-94ae-47f5-8d3e-bfad781c5916 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:52:23.278773 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2ce5f07f-94ae-47f5-8d3e-bfad781c5916 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] [instance: e15c3d21-45a5-4628-936e-8580d12613b1] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:52:23.296364 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2ce5f07f-94ae-47f5-8d3e-bfad781c5916 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:52:23.296867 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2ce5f07f-94ae-47f5-8d3e-bfad781c5916 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:52:23.297314 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2ce5f07f-94ae-47f5-8d3e-bfad781c5916 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:52:23.298070 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2ce5f07f-94ae-47f5-8d3e-bfad781c5916 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:52:23.298968 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2ce5f07f-94ae-47f5-8d3e-bfad781c5916 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:52:23.299417 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2ce5f07f-94ae-47f5-8d3e-bfad781c5916 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:52:24.095277 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2ce5f07f-94ae-47f5-8d3e-bfad781c5916 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ba627e73834b84b1ee6514e1facd1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aead91140df544faa492b8fd1952db8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:52:24.105702 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2ce5f07f-94ae-47f5-8d3e-bfad781c5916 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] 10.222.0.20 "GET /compute/v2.1/servers/e15c3d21-45a5-4628-936e-8580d12613b1" status: 200 len: 1319 microversion: 2.1 time: 0.832511 Oct 27 03:52:24.107132 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3224/6161] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:52:23 2022] GET /compute/v2.1/servers/e15c3d21-45a5-4628-936e-8580d12613b1 => generated 1319 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:52:25.131856 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-80277c9a-36b5-4a4e-a5b4-6ede019171a2 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:52:25.132413 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-80277c9a-36b5-4a4e-a5b4-6ede019171a2 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] [instance: e15c3d21-45a5-4628-936e-8580d12613b1] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:52:25.147770 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-80277c9a-36b5-4a4e-a5b4-6ede019171a2 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:52:25.148373 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-80277c9a-36b5-4a4e-a5b4-6ede019171a2 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:52:25.151399 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-80277c9a-36b5-4a4e-a5b4-6ede019171a2 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:52:25.152180 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-80277c9a-36b5-4a4e-a5b4-6ede019171a2 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:52:25.152666 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-80277c9a-36b5-4a4e-a5b4-6ede019171a2 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:52:25.153115 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-80277c9a-36b5-4a4e-a5b4-6ede019171a2 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:52:25.680650 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-80277c9a-36b5-4a4e-a5b4-6ede019171a2 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ba627e73834b84b1ee6514e1facd1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aead91140df544faa492b8fd1952db8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:52:25.697407 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-80277c9a-36b5-4a4e-a5b4-6ede019171a2 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] 10.222.0.20 "GET /compute/v2.1/servers/e15c3d21-45a5-4628-936e-8580d12613b1" status: 200 len: 1319 microversion: 2.1 time: 0.565281 Oct 27 03:52:25.698605 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2938/6162] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:52:25 2022] GET /compute/v2.1/servers/e15c3d21-45a5-4628-936e-8580d12613b1 => generated 1319 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:52:26.722515 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-341ecf1e-6579-47b4-a3b4-4f929c6e4120 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:52:26.724060 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-341ecf1e-6579-47b4-a3b4-4f929c6e4120 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] [instance: e15c3d21-45a5-4628-936e-8580d12613b1] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:52:26.734956 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:52:26.736269 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=6 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:52:26.738534 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-341ecf1e-6579-47b4-a3b4-4f929c6e4120 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:52:26.739653 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-341ecf1e-6579-47b4-a3b4-4f929c6e4120 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:52:26.740402 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-341ecf1e-6579-47b4-a3b4-4f929c6e4120 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:52:26.741405 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-341ecf1e-6579-47b4-a3b4-4f929c6e4120 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:52:26.742262 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-341ecf1e-6579-47b4-a3b4-4f929c6e4120 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:52:26.742932 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-341ecf1e-6579-47b4-a3b4-4f929c6e4120 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:52:27.144682 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:52:27.374298 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-341ecf1e-6579-47b4-a3b4-4f929c6e4120 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ba627e73834b84b1ee6514e1facd1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aead91140df544faa492b8fd1952db8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:52:27.383108 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-341ecf1e-6579-47b4-a3b4-4f929c6e4120 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] 10.222.0.20 "GET /compute/v2.1/servers/e15c3d21-45a5-4628-936e-8580d12613b1" status: 200 len: 1319 microversion: 2.1 time: 0.666462 Oct 27 03:52:27.385376 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3225/6163] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:52:26 2022] GET /compute/v2.1/servers/e15c3d21-45a5-4628-936e-8580d12613b1 => generated 1319 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:52:27.412187 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-1f5f0930-cf3d-443b-ab18-0c64b59c2342 req-d5a4c714-22ab-420d-b100-43724e79daa5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e15c3d21-45a5-4628-936e-8580d12613b1", "tag": "2bb0c7a1-33be-4aaa-acc5-e0753d46b2be"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:52:27.446524 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-1f5f0930-cf3d-443b-ab18-0c64b59c2342 req-d5a4c714-22ab-420d-b100-43724e79daa5 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:52:27.451665 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-1f5f0930-cf3d-443b-ab18-0c64b59c2342 req-d5a4c714-22ab-420d-b100-43724e79daa5 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:52:27.452413 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-1f5f0930-cf3d-443b-ab18-0c64b59c2342 req-d5a4c714-22ab-420d-b100-43724e79daa5 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:52:27.482729 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-1f5f0930-cf3d-443b-ab18-0c64b59c2342 req-d5a4c714-22ab-420d-b100-43724e79daa5 service nova] Creating event network-changed:2bb0c7a1-33be-4aaa-acc5-e0753d46b2be for instance e15c3d21-45a5-4628-936e-8580d12613b1 on n-h2-862769-1 Oct 27 03:52:27.498358 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-1f5f0930-cf3d-443b-ab18-0c64b59c2342 req-d5a4c714-22ab-420d-b100-43724e79daa5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.361217 Oct 27 03:52:27.504559 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2939/6164] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:52:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:52:28.416478 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-bfa99665-adce-4f9b-8795-c37cc7d85e9c tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:52:28.417501 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-bfa99665-adce-4f9b-8795-c37cc7d85e9c tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] [instance: e15c3d21-45a5-4628-936e-8580d12613b1] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:52:28.430664 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bfa99665-adce-4f9b-8795-c37cc7d85e9c tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:52:28.432325 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bfa99665-adce-4f9b-8795-c37cc7d85e9c tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:52:28.432781 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bfa99665-adce-4f9b-8795-c37cc7d85e9c tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:52:28.433934 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bfa99665-adce-4f9b-8795-c37cc7d85e9c tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:52:28.436162 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bfa99665-adce-4f9b-8795-c37cc7d85e9c tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:52:28.437933 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bfa99665-adce-4f9b-8795-c37cc7d85e9c tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:52:29.051328 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-bfa99665-adce-4f9b-8795-c37cc7d85e9c tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ba627e73834b84b1ee6514e1facd1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aead91140df544faa492b8fd1952db8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:52:29.062527 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-bfa99665-adce-4f9b-8795-c37cc7d85e9c tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] 10.222.0.20 "GET /compute/v2.1/servers/e15c3d21-45a5-4628-936e-8580d12613b1" status: 200 len: 1319 microversion: 2.1 time: 0.650233 Oct 27 03:52:29.063132 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3226/6165] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:52:28 2022] GET /compute/v2.1/servers/e15c3d21-45a5-4628-936e-8580d12613b1 => generated 1319 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:52:30.088616 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5764a296-1d43-41ad-99bd-cd5520e2edda tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:52:30.089995 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5764a296-1d43-41ad-99bd-cd5520e2edda tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] [instance: e15c3d21-45a5-4628-936e-8580d12613b1] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:52:30.097894 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5764a296-1d43-41ad-99bd-cd5520e2edda tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:52:30.099287 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5764a296-1d43-41ad-99bd-cd5520e2edda tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:52:30.100004 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5764a296-1d43-41ad-99bd-cd5520e2edda tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:52:30.100977 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5764a296-1d43-41ad-99bd-cd5520e2edda tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:52:30.101666 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5764a296-1d43-41ad-99bd-cd5520e2edda tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:52:30.102346 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5764a296-1d43-41ad-99bd-cd5520e2edda tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:52:30.497638 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5764a296-1d43-41ad-99bd-cd5520e2edda tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ba627e73834b84b1ee6514e1facd1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aead91140df544faa492b8fd1952db8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:52:30.514931 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5764a296-1d43-41ad-99bd-cd5520e2edda tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] 10.222.0.20 "GET /compute/v2.1/servers/e15c3d21-45a5-4628-936e-8580d12613b1" status: 200 len: 1319 microversion: 2.1 time: 0.430470 Oct 27 03:52:30.520604 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2940/6166] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:52:30 2022] GET /compute/v2.1/servers/e15c3d21-45a5-4628-936e-8580d12613b1 => generated 1319 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:52:31.544932 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4b1ad65a-b050-4d36-86b5-2b5b751b4533 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:52:31.545559 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4b1ad65a-b050-4d36-86b5-2b5b751b4533 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] [instance: e15c3d21-45a5-4628-936e-8580d12613b1] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:52:31.563297 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4b1ad65a-b050-4d36-86b5-2b5b751b4533 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:52:31.563297 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4b1ad65a-b050-4d36-86b5-2b5b751b4533 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:52:31.563297 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4b1ad65a-b050-4d36-86b5-2b5b751b4533 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:52:31.563297 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4b1ad65a-b050-4d36-86b5-2b5b751b4533 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:52:31.563297 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4b1ad65a-b050-4d36-86b5-2b5b751b4533 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:52:31.563808 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4b1ad65a-b050-4d36-86b5-2b5b751b4533 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:52:31.819567 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4b1ad65a-b050-4d36-86b5-2b5b751b4533 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ba627e73834b84b1ee6514e1facd1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aead91140df544faa492b8fd1952db8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:52:31.832450 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4b1ad65a-b050-4d36-86b5-2b5b751b4533 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] 10.222.0.20 "GET /compute/v2.1/servers/e15c3d21-45a5-4628-936e-8580d12613b1" status: 200 len: 1319 microversion: 2.1 time: 0.291394 Oct 27 03:52:31.833583 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3227/6167] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:52:31 2022] GET /compute/v2.1/servers/e15c3d21-45a5-4628-936e-8580d12613b1 => generated 1319 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:52:32.857272 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1c6778f6-5eea-452e-8b68-72fa7562d95d tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:52:32.858559 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1c6778f6-5eea-452e-8b68-72fa7562d95d tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] [instance: e15c3d21-45a5-4628-936e-8580d12613b1] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:52:32.872415 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1c6778f6-5eea-452e-8b68-72fa7562d95d tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:52:32.873123 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1c6778f6-5eea-452e-8b68-72fa7562d95d tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:52:32.876511 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1c6778f6-5eea-452e-8b68-72fa7562d95d tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:52:32.877304 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1c6778f6-5eea-452e-8b68-72fa7562d95d tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:52:32.877780 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1c6778f6-5eea-452e-8b68-72fa7562d95d tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:52:32.881233 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1c6778f6-5eea-452e-8b68-72fa7562d95d tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:52:33.766948 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1c6778f6-5eea-452e-8b68-72fa7562d95d tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ba627e73834b84b1ee6514e1facd1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aead91140df544faa492b8fd1952db8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:52:33.778366 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1c6778f6-5eea-452e-8b68-72fa7562d95d tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] 10.222.0.20 "GET /compute/v2.1/servers/e15c3d21-45a5-4628-936e-8580d12613b1" status: 200 len: 1319 microversion: 2.1 time: 0.925107 Oct 27 03:52:33.781123 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2941/6168] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:52:32 2022] GET /compute/v2.1/servers/e15c3d21-45a5-4628-936e-8580d12613b1 => generated 1319 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:52:34.805843 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-51edf24d-4366-486a-8332-e96fe10adcde tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:52:34.806897 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-98f7f086-f6f3-40e2-a603-3d7ee8374da0 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Action: 'create', calling method: .version_select at 0x7f7dd95d3d30>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1286590270", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNBiOpfl6u3InBwXn2P+xWhlourva3YFva4evXkG7ZUosvrtA4Mg10UNIvFuoAFJC6V1TsnazriE/RefTQe3rHiDpFtI2swg8rVjc0/R2qmsSovUZHQ+7Yo9a6NXPuP/FA=="}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:52:34.807389 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-51edf24d-4366-486a-8332-e96fe10adcde tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] [instance: e15c3d21-45a5-4628-936e-8580d12613b1] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:52:34.821585 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-51edf24d-4366-486a-8332-e96fe10adcde tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:52:34.822107 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-51edf24d-4366-486a-8332-e96fe10adcde tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:52:34.822851 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-51edf24d-4366-486a-8332-e96fe10adcde tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:52:34.823769 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-51edf24d-4366-486a-8332-e96fe10adcde tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:52:34.824427 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-51edf24d-4366-486a-8332-e96fe10adcde tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:52:34.825050 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-51edf24d-4366-486a-8332-e96fe10adcde tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:52:34.837286 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-98f7f086-f6f3-40e2-a603-3d7ee8374da0 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Getting quotas for project a432dda4903145278d79210121b3f77d. Resources: {'key_pairs'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:52:34.845500 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-98f7f086-f6f3-40e2-a603-3d7ee8374da0 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Getting quotas for user a2ea55b400c24827a28e816ea2a225aa and project a432dda4903145278d79210121b3f77d. Resources: {'key_pairs'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:52:34.978073 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-98f7f086-f6f3-40e2-a603-3d7ee8374da0 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.421669 Oct 27 03:52:34.978955 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3228/6169] 10.222.0.20 () {60 vars in 1159 bytes} [Thu Oct 27 03:52:34 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:52:35.234315 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-51edf24d-4366-486a-8332-e96fe10adcde tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ba627e73834b84b1ee6514e1facd1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aead91140df544faa492b8fd1952db8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:52:35.245557 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-51edf24d-4366-486a-8332-e96fe10adcde tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] 10.222.0.20 "GET /compute/v2.1/servers/e15c3d21-45a5-4628-936e-8580d12613b1" status: 200 len: 1319 microversion: 2.1 time: 0.444151 Oct 27 03:52:35.251761 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2942/6170] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:52:34 2022] GET /compute/v2.1/servers/e15c3d21-45a5-4628-936e-8580d12613b1 => generated 1319 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:52:36.278216 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-10279283-76ab-473d-b446-aa9416ac1529 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:52:36.279585 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-10279283-76ab-473d-b446-aa9416ac1529 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] [instance: e15c3d21-45a5-4628-936e-8580d12613b1] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:52:36.290452 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-10279283-76ab-473d-b446-aa9416ac1529 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:52:36.296022 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-10279283-76ab-473d-b446-aa9416ac1529 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:52:36.296022 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-10279283-76ab-473d-b446-aa9416ac1529 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:52:36.296022 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-10279283-76ab-473d-b446-aa9416ac1529 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:52:36.299119 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-10279283-76ab-473d-b446-aa9416ac1529 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:52:36.299995 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-10279283-76ab-473d-b446-aa9416ac1529 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:52:36.759571 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-10279283-76ab-473d-b446-aa9416ac1529 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ba627e73834b84b1ee6514e1facd1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aead91140df544faa492b8fd1952db8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:52:36.768174 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-10279283-76ab-473d-b446-aa9416ac1529 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] 10.222.0.20 "GET /compute/v2.1/servers/e15c3d21-45a5-4628-936e-8580d12613b1" status: 200 len: 1319 microversion: 2.1 time: 0.494971 Oct 27 03:52:36.773540 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-dae9a2d7-c72b-4dd4-b616-c909cda8e5ed req-92966d34-a0a9-4a12-bae0-7d47616a2f7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e15c3d21-45a5-4628-936e-8580d12613b1", "name": "network-vif-plugged", "status": "completed", "tag": "2bb0c7a1-33be-4aaa-acc5-e0753d46b2be"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:52:36.782986 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3229/6171] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:52:36 2022] GET /compute/v2.1/servers/e15c3d21-45a5-4628-936e-8580d12613b1 => generated 1319 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:52:36.786858 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-dae9a2d7-c72b-4dd4-b616-c909cda8e5ed req-92966d34-a0a9-4a12-bae0-7d47616a2f7d service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:52:36.787916 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-dae9a2d7-c72b-4dd4-b616-c909cda8e5ed req-92966d34-a0a9-4a12-bae0-7d47616a2f7d service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:52:36.788531 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-dae9a2d7-c72b-4dd4-b616-c909cda8e5ed req-92966d34-a0a9-4a12-bae0-7d47616a2f7d service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:52:36.804369 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-dae9a2d7-c72b-4dd4-b616-c909cda8e5ed req-92966d34-a0a9-4a12-bae0-7d47616a2f7d service nova] Creating event network-vif-plugged:2bb0c7a1-33be-4aaa-acc5-e0753d46b2be for instance e15c3d21-45a5-4628-936e-8580d12613b1 on n-h2-862769-1 Oct 27 03:52:36.815860 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-dae9a2d7-c72b-4dd4-b616-c909cda8e5ed req-92966d34-a0a9-4a12-bae0-7d47616a2f7d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.220340 Oct 27 03:52:36.816765 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2943/6172] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:52:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:52:37.956294 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-740aed17-f98e-49b9-9180-73a586ddb653 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:52:37.957558 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-740aed17-f98e-49b9-9180-73a586ddb653 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] [instance: e15c3d21-45a5-4628-936e-8580d12613b1] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:52:37.965836 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-740aed17-f98e-49b9-9180-73a586ddb653 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:52:37.966614 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-740aed17-f98e-49b9-9180-73a586ddb653 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:52:37.967247 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-740aed17-f98e-49b9-9180-73a586ddb653 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:52:37.968156 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-740aed17-f98e-49b9-9180-73a586ddb653 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:52:37.968782 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-740aed17-f98e-49b9-9180-73a586ddb653 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:52:37.969377 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-740aed17-f98e-49b9-9180-73a586ddb653 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:52:38.623342 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-740aed17-f98e-49b9-9180-73a586ddb653 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ba627e73834b84b1ee6514e1facd1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aead91140df544faa492b8fd1952db8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:52:38.638128 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-740aed17-f98e-49b9-9180-73a586ddb653 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] 10.222.0.20 "GET /compute/v2.1/servers/e15c3d21-45a5-4628-936e-8580d12613b1" status: 200 len: 1319 microversion: 2.1 time: 0.845685 Oct 27 03:52:38.654909 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3230/6173] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:52:37 2022] GET /compute/v2.1/servers/e15c3d21-45a5-4628-936e-8580d12613b1 => generated 1319 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:52:39.666511 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f74f96c0-43a9-4d2a-a541-d262735ef29e tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:52:39.667995 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f74f96c0-43a9-4d2a-a541-d262735ef29e tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] [instance: e15c3d21-45a5-4628-936e-8580d12613b1] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:52:39.680744 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f74f96c0-43a9-4d2a-a541-d262735ef29e tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:52:39.686103 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f74f96c0-43a9-4d2a-a541-d262735ef29e tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:52:39.692817 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f74f96c0-43a9-4d2a-a541-d262735ef29e tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:52:39.692817 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f74f96c0-43a9-4d2a-a541-d262735ef29e tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:52:39.692817 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f74f96c0-43a9-4d2a-a541-d262735ef29e tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:52:39.692817 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f74f96c0-43a9-4d2a-a541-d262735ef29e tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:52:40.306538 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f74f96c0-43a9-4d2a-a541-d262735ef29e tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ba627e73834b84b1ee6514e1facd1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aead91140df544faa492b8fd1952db8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:52:40.319420 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f74f96c0-43a9-4d2a-a541-d262735ef29e tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] 10.222.0.20 "GET /compute/v2.1/servers/e15c3d21-45a5-4628-936e-8580d12613b1" status: 200 len: 1508 microversion: 2.1 time: 0.661212 Oct 27 03:52:40.320678 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2944/6174] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:52:39 2022] GET /compute/v2.1/servers/e15c3d21-45a5-4628-936e-8580d12613b1 => generated 1508 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:52:40.343225 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-bdba5f66-5cf7-44de-9354-bb7940cf41e6 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7b098b0c-004a-46ed-96b4-1d6d0e3331d0", "device": "/dev/sdb"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:52:40.346497 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-bdba5f66-5cf7-44de-9354-bb7940cf41e6 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] [instance: e15c3d21-45a5-4628-936e-8580d12613b1] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:52:40.354315 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bdba5f66-5cf7-44de-9354-bb7940cf41e6 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:52:40.355099 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bdba5f66-5cf7-44de-9354-bb7940cf41e6 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:52:40.355783 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bdba5f66-5cf7-44de-9354-bb7940cf41e6 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:52:40.356729 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bdba5f66-5cf7-44de-9354-bb7940cf41e6 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:52:40.357412 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bdba5f66-5cf7-44de-9354-bb7940cf41e6 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:52:40.358073 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bdba5f66-5cf7-44de-9354-bb7940cf41e6 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:52:41.252877 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-bdba5f66-5cf7-44de-9354-bb7940cf41e6 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] 10.222.0.20 "POST /compute/v2.1/servers/e15c3d21-45a5-4628-936e-8580d12613b1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.913538 Oct 27 03:52:41.253791 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3231/6175] 10.222.0.20 () {60 vars in 1323 bytes} [Thu Oct 27 03:52:40 2022] POST /compute/v2.1/servers/e15c3d21-45a5-4628-936e-8580d12613b1/os-volume_attachments => generated 194 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:52:57.757519 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f9ca6200-ba04-4371-9fda-ee305a1eb532 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1546116318", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": [{"uuid": "9dfea1e8-94a2-4866-ae1d-0a5b1c93c990"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1286590270", "security_groups": [{"name": "tempest-secgroup-smoke-1914199213"}]}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:52:57.768005 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=22 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:52:57.768655 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=46 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:52:58.046093 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-f9ca6200-ba04-4371-9fda-ee305a1eb532 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] validate_networks() for [('9dfea1e8-94a2-4866-ae1d-0a5b1c93c990', None, None, None, None, None)] {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:52:59.601775 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-f9ca6200-ba04-4371-9fda-ee305a1eb532 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:52:59.604686 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-f9ca6200-ba04-4371-9fda-ee305a1eb532 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:52:59.605779 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-f9ca6200-ba04-4371-9fda-ee305a1eb532 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:52:59.606559 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-f9ca6200-ba04-4371-9fda-ee305a1eb532 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:52:59.607453 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-f9ca6200-ba04-4371-9fda-ee305a1eb532 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:52:59.633376 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f9ca6200-ba04-4371-9fda-ee305a1eb532 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:52:59.638508 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f9ca6200-ba04-4371-9fda-ee305a1eb532 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:52:59.644040 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f9ca6200-ba04-4371-9fda-ee305a1eb532 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:52:59.645906 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f9ca6200-ba04-4371-9fda-ee305a1eb532 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:52:59.646672 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f9ca6200-ba04-4371-9fda-ee305a1eb532 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:52:59.647338 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f9ca6200-ba04-4371-9fda-ee305a1eb532 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:52:59.682622 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-f9ca6200-ba04-4371-9fda-ee305a1eb532 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Getting quotas for project a432dda4903145278d79210121b3f77d. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:52:59.695637 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-f9ca6200-ba04-4371-9fda-ee305a1eb532 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Getting quotas for user a2ea55b400c24827a28e816ea2a225aa and project a432dda4903145278d79210121b3f77d. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:52:59.727367 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f9ca6200-ba04-4371-9fda-ee305a1eb532 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:52:59.730098 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f9ca6200-ba04-4371-9fda-ee305a1eb532 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:52:59.881217 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f9ca6200-ba04-4371-9fda-ee305a1eb532 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.128055 Oct 27 03:52:59.890301 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2945/6176] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:52:57 2022] POST /compute/v2.1/servers => generated 406 bytes in 2136 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 03:52:59.891780 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=4 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:52:59.892859 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=4 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:52:59.893529 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:52:59.900325 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2f73afdd-f5fc-4693-9e5e-e200ed89c959 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:52:59.903672 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2f73afdd-f5fc-4693-9e5e-e200ed89c959 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:53:00.624839 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2f73afdd-f5fc-4693-9e5e-e200ed89c959 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:53:00.635258 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2f73afdd-f5fc-4693-9e5e-e200ed89c959 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa" status: 200 len: 1267 microversion: 2.1 time: 0.745309 Oct 27 03:53:00.637242 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3232/6177] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:52:59 2022] GET /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa => generated 1267 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:53:01.664703 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-78783c65-94bf-4df3-b9d4-cf2fb7801c88 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:53:01.665888 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-78783c65-94bf-4df3-b9d4-cf2fb7801c88 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:53:01.675191 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-78783c65-94bf-4df3-b9d4-cf2fb7801c88 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:53:01.676006 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-78783c65-94bf-4df3-b9d4-cf2fb7801c88 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:53:01.676461 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-78783c65-94bf-4df3-b9d4-cf2fb7801c88 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:53:01.677225 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-78783c65-94bf-4df3-b9d4-cf2fb7801c88 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:53:01.677693 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-78783c65-94bf-4df3-b9d4-cf2fb7801c88 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:53:01.678178 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-78783c65-94bf-4df3-b9d4-cf2fb7801c88 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:53:02.063034 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-78783c65-94bf-4df3-b9d4-cf2fb7801c88 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:53:02.081266 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-78783c65-94bf-4df3-b9d4-cf2fb7801c88 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa" status: 200 len: 1271 microversion: 2.1 time: 0.423338 Oct 27 03:53:02.081869 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2946/6178] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:53:01 2022] GET /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa => generated 1271 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:53:03.116130 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c02f0e38-7313-475d-9225-e0e769051744 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:53:03.116778 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c02f0e38-7313-475d-9225-e0e769051744 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:53:03.156710 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c02f0e38-7313-475d-9225-e0e769051744 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:53:03.172563 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c02f0e38-7313-475d-9225-e0e769051744 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:53:03.172563 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c02f0e38-7313-475d-9225-e0e769051744 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:53:03.172563 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c02f0e38-7313-475d-9225-e0e769051744 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:53:03.172563 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c02f0e38-7313-475d-9225-e0e769051744 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:53:03.194868 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c02f0e38-7313-475d-9225-e0e769051744 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:53:03.426458 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c02f0e38-7313-475d-9225-e0e769051744 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:53:03.435028 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c02f0e38-7313-475d-9225-e0e769051744 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa" status: 200 len: 1319 microversion: 2.1 time: 0.328068 Oct 27 03:53:03.451322 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3233/6179] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:53:03 2022] GET /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa => generated 1319 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:53:04.459937 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9e0b0fec-d8c3-40b8-abc8-4c10dafe4b02 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:53:04.460618 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9e0b0fec-d8c3-40b8-abc8-4c10dafe4b02 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:53:04.475056 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9e0b0fec-d8c3-40b8-abc8-4c10dafe4b02 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:53:04.475056 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9e0b0fec-d8c3-40b8-abc8-4c10dafe4b02 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:53:04.475056 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9e0b0fec-d8c3-40b8-abc8-4c10dafe4b02 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:53:04.475056 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9e0b0fec-d8c3-40b8-abc8-4c10dafe4b02 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:53:04.475056 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9e0b0fec-d8c3-40b8-abc8-4c10dafe4b02 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:53:04.475056 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9e0b0fec-d8c3-40b8-abc8-4c10dafe4b02 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:53:04.831794 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9e0b0fec-d8c3-40b8-abc8-4c10dafe4b02 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:53:04.857509 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9e0b0fec-d8c3-40b8-abc8-4c10dafe4b02 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa" status: 200 len: 1325 microversion: 2.1 time: 0.401143 Oct 27 03:53:04.860183 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2947/6180] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:53:04 2022] GET /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa => generated 1325 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:53:05.884888 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-78c1a09d-2101-4363-befc-d80281ee497f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:53:05.885517 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-78c1a09d-2101-4363-befc-d80281ee497f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:53:05.903750 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-78c1a09d-2101-4363-befc-d80281ee497f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:53:05.909089 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-78c1a09d-2101-4363-befc-d80281ee497f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:53:05.909788 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-78c1a09d-2101-4363-befc-d80281ee497f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:53:05.911411 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-78c1a09d-2101-4363-befc-d80281ee497f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:53:05.912119 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-78c1a09d-2101-4363-befc-d80281ee497f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:53:05.912795 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-78c1a09d-2101-4363-befc-d80281ee497f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:53:07.756300 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-78c1a09d-2101-4363-befc-d80281ee497f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:53:07.767413 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-78c1a09d-2101-4363-befc-d80281ee497f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa" status: 200 len: 1393 microversion: 2.1 time: 1.886422 Oct 27 03:53:07.768622 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3234/6181] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:53:05 2022] GET /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa => generated 1393 bytes in 1888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:53:08.793007 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-132d62f8-5e3a-4d33-9436-1b9d123ab17e tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:53:08.798962 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-132d62f8-5e3a-4d33-9436-1b9d123ab17e tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:53:08.807613 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-132d62f8-5e3a-4d33-9436-1b9d123ab17e tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:53:08.808606 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-132d62f8-5e3a-4d33-9436-1b9d123ab17e tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:53:08.809347 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-132d62f8-5e3a-4d33-9436-1b9d123ab17e tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:53:08.810438 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-132d62f8-5e3a-4d33-9436-1b9d123ab17e tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:53:08.811101 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-132d62f8-5e3a-4d33-9436-1b9d123ab17e tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:53:08.811722 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-132d62f8-5e3a-4d33-9436-1b9d123ab17e tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:53:09.408844 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-132d62f8-5e3a-4d33-9436-1b9d123ab17e tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:53:09.429342 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-132d62f8-5e3a-4d33-9436-1b9d123ab17e tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa" status: 200 len: 1393 microversion: 2.1 time: 0.640444 Oct 27 03:53:09.431783 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2948/6182] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:53:08 2022] GET /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa => generated 1393 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:53:10.459037 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-eabb9a9f-3c3a-4dee-9e89-c42e92e686dd tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:53:10.459781 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-eabb9a9f-3c3a-4dee-9e89-c42e92e686dd tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:53:10.470811 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eabb9a9f-3c3a-4dee-9e89-c42e92e686dd tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:53:10.471208 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eabb9a9f-3c3a-4dee-9e89-c42e92e686dd tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:53:10.471728 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eabb9a9f-3c3a-4dee-9e89-c42e92e686dd tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:53:10.473277 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eabb9a9f-3c3a-4dee-9e89-c42e92e686dd tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:53:10.473825 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eabb9a9f-3c3a-4dee-9e89-c42e92e686dd tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:53:10.474387 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eabb9a9f-3c3a-4dee-9e89-c42e92e686dd tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:53:10.629492 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:53:11.047881 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-eabb9a9f-3c3a-4dee-9e89-c42e92e686dd tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:53:11.059505 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-eabb9a9f-3c3a-4dee-9e89-c42e92e686dd tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa" status: 200 len: 1393 microversion: 2.1 time: 0.606033 Oct 27 03:53:11.070739 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3235/6183] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:53:10 2022] GET /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa => generated 1393 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:53:11.798969 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-bd2cf6fb-0f81-45f6-b6a6-4690ccf6d327 req-24f5864c-2dde-4552-8f8b-9f8970f114df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa", "tag": "bba702ac-b41d-4188-9510-3b36b88fbfb7"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:53:11.818391 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:53:11.820013 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=6 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:53:11.824666 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-bd2cf6fb-0f81-45f6-b6a6-4690ccf6d327 req-24f5864c-2dde-4552-8f8b-9f8970f114df service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:53:11.826273 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-bd2cf6fb-0f81-45f6-b6a6-4690ccf6d327 req-24f5864c-2dde-4552-8f8b-9f8970f114df service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:53:11.826973 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-bd2cf6fb-0f81-45f6-b6a6-4690ccf6d327 req-24f5864c-2dde-4552-8f8b-9f8970f114df service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:53:11.847542 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-bd2cf6fb-0f81-45f6-b6a6-4690ccf6d327 req-24f5864c-2dde-4552-8f8b-9f8970f114df service nova] Creating event network-changed:bba702ac-b41d-4188-9510-3b36b88fbfb7 for instance 5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa on n-h1-862769-1 Oct 27 03:53:11.856335 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-bd2cf6fb-0f81-45f6-b6a6-4690ccf6d327 req-24f5864c-2dde-4552-8f8b-9f8970f114df service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062781 Oct 27 03:53:11.863501 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2949/6184] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:53:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:53:12.096096 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-790bb1a1-ffef-44b8-9901-dd39d7efee40 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:53:12.096795 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-790bb1a1-ffef-44b8-9901-dd39d7efee40 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:53:12.106184 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-790bb1a1-ffef-44b8-9901-dd39d7efee40 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:53:12.106931 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-790bb1a1-ffef-44b8-9901-dd39d7efee40 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:53:12.107549 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-790bb1a1-ffef-44b8-9901-dd39d7efee40 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:53:12.108597 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-790bb1a1-ffef-44b8-9901-dd39d7efee40 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:53:12.109404 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-790bb1a1-ffef-44b8-9901-dd39d7efee40 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:53:12.109994 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-790bb1a1-ffef-44b8-9901-dd39d7efee40 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:53:12.822570 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-790bb1a1-ffef-44b8-9901-dd39d7efee40 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:53:12.830984 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-790bb1a1-ffef-44b8-9901-dd39d7efee40 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa" status: 200 len: 1393 microversion: 2.1 time: 0.739519 Oct 27 03:53:12.831592 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3236/6185] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:53:12 2022] GET /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa => generated 1393 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:53:13.717550 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-03c81870-d81d-4408-8220-26b4f94596d2 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:53:13.718880 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-03c81870-d81d-4408-8220-26b4f94596d2 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] [instance: e15c3d21-45a5-4628-936e-8580d12613b1] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:53:13.729754 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-03c81870-d81d-4408-8220-26b4f94596d2 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:53:13.730579 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-03c81870-d81d-4408-8220-26b4f94596d2 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:53:13.731900 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-03c81870-d81d-4408-8220-26b4f94596d2 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:53:13.732805 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-03c81870-d81d-4408-8220-26b4f94596d2 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:53:13.734883 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-03c81870-d81d-4408-8220-26b4f94596d2 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:53:13.736041 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-03c81870-d81d-4408-8220-26b4f94596d2 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:53:13.857682 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9b868bfc-79bd-410f-bf22-3c19efda9277 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:53:13.858458 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-9b868bfc-79bd-410f-bf22-3c19efda9277 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:53:13.869992 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9b868bfc-79bd-410f-bf22-3c19efda9277 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:53:13.870798 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9b868bfc-79bd-410f-bf22-3c19efda9277 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:53:13.871474 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9b868bfc-79bd-410f-bf22-3c19efda9277 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:53:13.872375 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9b868bfc-79bd-410f-bf22-3c19efda9277 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:53:13.873002 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9b868bfc-79bd-410f-bf22-3c19efda9277 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:53:13.875119 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9b868bfc-79bd-410f-bf22-3c19efda9277 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:53:13.901275 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-03c81870-d81d-4408-8220-26b4f94596d2 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lazy-loading 'services' on Instance uuid e15c3d21-45a5-4628-936e-8580d12613b1 {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:53:14.219555 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-03c81870-d81d-4408-8220-26b4f94596d2 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e15c3d21-45a5-4628-936e-8580d12613b1/os-volume_attachments/7b098b0c-004a-46ed-96b4-1d6d0e3331d0" status: 202 len: 0 microversion: 2.1 time: 0.507958 Oct 27 03:53:14.220467 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2950/6186] 10.222.0.20 () {58 vars in 1416 bytes} [Thu Oct 27 03:53:13 2022] DELETE /compute/v2.1/servers/e15c3d21-45a5-4628-936e-8580d12613b1/os-volume_attachments/7b098b0c-004a-46ed-96b4-1d6d0e3331d0 => generated 0 bytes in 510 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:53:14.438435 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9b868bfc-79bd-410f-bf22-3c19efda9277 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:53:14.450465 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9b868bfc-79bd-410f-bf22-3c19efda9277 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa" status: 200 len: 1393 microversion: 2.1 time: 0.596365 Oct 27 03:53:14.457664 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3237/6187] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:53:13 2022] GET /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa => generated 1393 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:53:15.483662 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-49ada53c-8661-492a-a4d5-7449282154f0 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:53:15.484475 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-49ada53c-8661-492a-a4d5-7449282154f0 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:53:15.496410 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-49ada53c-8661-492a-a4d5-7449282154f0 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:53:15.499516 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-49ada53c-8661-492a-a4d5-7449282154f0 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:53:15.499516 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-49ada53c-8661-492a-a4d5-7449282154f0 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:53:15.500464 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-49ada53c-8661-492a-a4d5-7449282154f0 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:53:15.505839 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-49ada53c-8661-492a-a4d5-7449282154f0 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:53:15.506415 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-49ada53c-8661-492a-a4d5-7449282154f0 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:53:15.840952 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-49ada53c-8661-492a-a4d5-7449282154f0 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:53:15.854133 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-49ada53c-8661-492a-a4d5-7449282154f0 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa" status: 200 len: 1393 microversion: 2.1 time: 0.376693 Oct 27 03:53:15.855201 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2951/6188] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:53:15 2022] GET /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa => generated 1393 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:53:16.882021 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e6e3e1cb-e357-4b0c-bfbe-2e63f3751175 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:53:16.883516 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e6e3e1cb-e357-4b0c-bfbe-2e63f3751175 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:53:16.899021 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e6e3e1cb-e357-4b0c-bfbe-2e63f3751175 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:53:16.900134 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e6e3e1cb-e357-4b0c-bfbe-2e63f3751175 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:53:16.901190 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e6e3e1cb-e357-4b0c-bfbe-2e63f3751175 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:53:16.902185 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e6e3e1cb-e357-4b0c-bfbe-2e63f3751175 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:53:16.903808 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e6e3e1cb-e357-4b0c-bfbe-2e63f3751175 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:53:16.904476 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e6e3e1cb-e357-4b0c-bfbe-2e63f3751175 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:53:17.655145 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e6e3e1cb-e357-4b0c-bfbe-2e63f3751175 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:53:17.664613 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e6e3e1cb-e357-4b0c-bfbe-2e63f3751175 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa" status: 200 len: 1393 microversion: 2.1 time: 0.791462 Oct 27 03:53:17.665257 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3238/6189] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:53:16 2022] GET /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa => generated 1393 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:53:18.689151 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-81d62e99-bedd-4c95-95bf-02aa46ec75ac tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:53:18.689793 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-81d62e99-bedd-4c95-95bf-02aa46ec75ac tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:53:18.709763 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-81d62e99-bedd-4c95-95bf-02aa46ec75ac tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:53:18.710326 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-81d62e99-bedd-4c95-95bf-02aa46ec75ac tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:53:18.710784 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-81d62e99-bedd-4c95-95bf-02aa46ec75ac tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:53:18.711674 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-81d62e99-bedd-4c95-95bf-02aa46ec75ac tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:53:18.712145 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-81d62e99-bedd-4c95-95bf-02aa46ec75ac tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:53:18.712586 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-81d62e99-bedd-4c95-95bf-02aa46ec75ac tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:53:19.165677 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-81d62e99-bedd-4c95-95bf-02aa46ec75ac tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:53:19.187467 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-81d62e99-bedd-4c95-95bf-02aa46ec75ac tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa" status: 200 len: 1393 microversion: 2.1 time: 0.502741 Oct 27 03:53:19.191566 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2952/6190] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:53:18 2022] GET /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa => generated 1393 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:53:20.220700 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ddd95523-23a6-4d3d-8b36-ef1efa12e647 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:53:20.221604 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ddd95523-23a6-4d3d-8b36-ef1efa12e647 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:53:20.251335 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ddd95523-23a6-4d3d-8b36-ef1efa12e647 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:53:20.253102 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ddd95523-23a6-4d3d-8b36-ef1efa12e647 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:53:20.257926 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ddd95523-23a6-4d3d-8b36-ef1efa12e647 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:53:20.259286 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ddd95523-23a6-4d3d-8b36-ef1efa12e647 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:53:20.259781 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ddd95523-23a6-4d3d-8b36-ef1efa12e647 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:53:20.260873 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ddd95523-23a6-4d3d-8b36-ef1efa12e647 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:53:20.723108 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ddd95523-23a6-4d3d-8b36-ef1efa12e647 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:53:20.732144 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ddd95523-23a6-4d3d-8b36-ef1efa12e647 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa" status: 200 len: 1393 microversion: 2.1 time: 0.517845 Oct 27 03:53:20.736082 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3239/6191] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:53:20 2022] GET /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa => generated 1393 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:53:21.019068 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-34a85a6f-413d-488a-857d-359b94f10f34 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:53:21.019068 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-34a85a6f-413d-488a-857d-359b94f10f34 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] [instance: e15c3d21-45a5-4628-936e-8580d12613b1] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:53:21.029187 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-34a85a6f-413d-488a-857d-359b94f10f34 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:53:21.030519 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-34a85a6f-413d-488a-857d-359b94f10f34 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:53:21.031242 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-34a85a6f-413d-488a-857d-359b94f10f34 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:53:21.032777 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-34a85a6f-413d-488a-857d-359b94f10f34 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:53:21.033661 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-34a85a6f-413d-488a-857d-359b94f10f34 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:53:21.034373 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-34a85a6f-413d-488a-857d-359b94f10f34 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:53:21.074671 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-34a85a6f-413d-488a-857d-359b94f10f34 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] [instance: e15c3d21-45a5-4628-936e-8580d12613b1] Going to try to terminate instance {{(pid=121000) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:53:21.453485 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-34a85a6f-413d-488a-857d-359b94f10f34 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e15c3d21-45a5-4628-936e-8580d12613b1" status: 204 len: 0 microversion: 2.1 time: 0.441186 Oct 27 03:53:21.458849 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2953/6192] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:53:21 2022] DELETE /compute/v2.1/servers/e15c3d21-45a5-4628-936e-8580d12613b1 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:53:21.464560 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-92abc351-af2b-4f9d-9815-2c7b15e60496 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:53:21.465197 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-92abc351-af2b-4f9d-9815-2c7b15e60496 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] [instance: e15c3d21-45a5-4628-936e-8580d12613b1] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:53:21.471795 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-92abc351-af2b-4f9d-9815-2c7b15e60496 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:53:21.472327 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-92abc351-af2b-4f9d-9815-2c7b15e60496 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:53:21.472901 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-92abc351-af2b-4f9d-9815-2c7b15e60496 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:53:21.473521 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-92abc351-af2b-4f9d-9815-2c7b15e60496 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:53:21.473988 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-92abc351-af2b-4f9d-9815-2c7b15e60496 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:53:21.478146 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-92abc351-af2b-4f9d-9815-2c7b15e60496 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:53:21.763205 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8e6a788b-5e0f-44de-859f-4e633b8fa7d9 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:53:21.763959 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8e6a788b-5e0f-44de-859f-4e633b8fa7d9 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:53:21.775998 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8e6a788b-5e0f-44de-859f-4e633b8fa7d9 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:53:21.776894 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8e6a788b-5e0f-44de-859f-4e633b8fa7d9 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:53:21.777558 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8e6a788b-5e0f-44de-859f-4e633b8fa7d9 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:53:21.780044 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8e6a788b-5e0f-44de-859f-4e633b8fa7d9 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:53:21.780461 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8e6a788b-5e0f-44de-859f-4e633b8fa7d9 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:53:21.780982 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8e6a788b-5e0f-44de-859f-4e633b8fa7d9 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:53:21.829459 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-92abc351-af2b-4f9d-9815-2c7b15e60496 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ba627e73834b84b1ee6514e1facd1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aead91140df544faa492b8fd1952db8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:53:21.854807 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-92abc351-af2b-4f9d-9815-2c7b15e60496 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] 10.222.0.20 "GET /compute/v2.1/servers/e15c3d21-45a5-4628-936e-8580d12613b1" status: 200 len: 1514 microversion: 2.1 time: 0.389437 Oct 27 03:53:21.855908 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3240/6193] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:53:21 2022] GET /compute/v2.1/servers/e15c3d21-45a5-4628-936e-8580d12613b1 => generated 1514 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:53:22.400124 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8e6a788b-5e0f-44de-859f-4e633b8fa7d9 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:53:22.417305 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8e6a788b-5e0f-44de-859f-4e633b8fa7d9 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa" status: 200 len: 1393 microversion: 2.1 time: 0.658977 Oct 27 03:53:22.424318 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2954/6194] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:53:21 2022] GET /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa => generated 1393 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:53:22.583263 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-86c87240-86a6-41bb-900c-eba2ec92201e req-81b68f5a-8b1f-42aa-87e3-b999f51fa61f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa", "name": "network-vif-plugged", "status": "completed", "tag": "bba702ac-b41d-4188-9510-3b36b88fbfb7"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:53:22.614513 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-86c87240-86a6-41bb-900c-eba2ec92201e req-81b68f5a-8b1f-42aa-87e3-b999f51fa61f service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:53:22.615765 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-86c87240-86a6-41bb-900c-eba2ec92201e req-81b68f5a-8b1f-42aa-87e3-b999f51fa61f service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:53:22.616501 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-86c87240-86a6-41bb-900c-eba2ec92201e req-81b68f5a-8b1f-42aa-87e3-b999f51fa61f service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:53:22.645899 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-86c87240-86a6-41bb-900c-eba2ec92201e req-81b68f5a-8b1f-42aa-87e3-b999f51fa61f service nova] Creating event network-vif-plugged:bba702ac-b41d-4188-9510-3b36b88fbfb7 for instance 5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa on n-h1-862769-1 Oct 27 03:53:22.655887 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-86c87240-86a6-41bb-900c-eba2ec92201e req-81b68f5a-8b1f-42aa-87e3-b999f51fa61f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081028 Oct 27 03:53:22.656995 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3241/6195] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:53:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:53:22.882315 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2d85dee2-5641-4c48-9e0a-f5e6bdf34190 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:53:22.884997 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-2d85dee2-5641-4c48-9e0a-f5e6bdf34190 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] [instance: e15c3d21-45a5-4628-936e-8580d12613b1] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:53:22.902147 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2d85dee2-5641-4c48-9e0a-f5e6bdf34190 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:53:22.902983 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2d85dee2-5641-4c48-9e0a-f5e6bdf34190 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:53:22.903666 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2d85dee2-5641-4c48-9e0a-f5e6bdf34190 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:53:22.909469 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2d85dee2-5641-4c48-9e0a-f5e6bdf34190 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:53:22.910244 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2d85dee2-5641-4c48-9e0a-f5e6bdf34190 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:53:22.910907 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2d85dee2-5641-4c48-9e0a-f5e6bdf34190 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:53:23.447275 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-73d26fa6-8017-44bd-98b3-29c1e8beddab tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:53:23.448372 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-73d26fa6-8017-44bd-98b3-29c1e8beddab tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:53:23.455502 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-73d26fa6-8017-44bd-98b3-29c1e8beddab tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:53:23.456801 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-73d26fa6-8017-44bd-98b3-29c1e8beddab tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:53:23.457408 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-73d26fa6-8017-44bd-98b3-29c1e8beddab tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:53:23.458904 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-73d26fa6-8017-44bd-98b3-29c1e8beddab tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:53:23.459541 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-73d26fa6-8017-44bd-98b3-29c1e8beddab tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:53:23.460569 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-73d26fa6-8017-44bd-98b3-29c1e8beddab tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:53:23.510256 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2d85dee2-5641-4c48-9e0a-f5e6bdf34190 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ba627e73834b84b1ee6514e1facd1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aead91140df544faa492b8fd1952db8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:53:23.519636 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2d85dee2-5641-4c48-9e0a-f5e6bdf34190 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] 10.222.0.20 "GET /compute/v2.1/servers/e15c3d21-45a5-4628-936e-8580d12613b1" status: 200 len: 1514 microversion: 2.1 time: 0.642713 Oct 27 03:53:23.526699 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2955/6196] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:53:22 2022] GET /compute/v2.1/servers/e15c3d21-45a5-4628-936e-8580d12613b1 => generated 1514 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:53:23.782998 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-73d26fa6-8017-44bd-98b3-29c1e8beddab tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:53:23.792851 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-73d26fa6-8017-44bd-98b3-29c1e8beddab tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa" status: 200 len: 1393 microversion: 2.1 time: 0.349761 Oct 27 03:53:23.803747 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3242/6197] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:53:23 2022] GET /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa => generated 1393 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:53:24.082281 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-33d019ce-c33f-4bd3-b5d8-b8a43cce340e req-c2cb5e8d-163f-4a91-a25d-d338c7835313 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e15c3d21-45a5-4628-936e-8580d12613b1", "name": "network-vif-deleted", "tag": "2bb0c7a1-33be-4aaa-acc5-e0753d46b2be"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:53:24.104354 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-33d019ce-c33f-4bd3-b5d8-b8a43cce340e req-c2cb5e8d-163f-4a91-a25d-d338c7835313 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:53:24.105071 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-33d019ce-c33f-4bd3-b5d8-b8a43cce340e req-c2cb5e8d-163f-4a91-a25d-d338c7835313 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:53:24.105833 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-33d019ce-c33f-4bd3-b5d8-b8a43cce340e req-c2cb5e8d-163f-4a91-a25d-d338c7835313 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:53:24.121249 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-33d019ce-c33f-4bd3-b5d8-b8a43cce340e req-c2cb5e8d-163f-4a91-a25d-d338c7835313 service nova] Creating event network-vif-deleted:2bb0c7a1-33be-4aaa-acc5-e0753d46b2be for instance e15c3d21-45a5-4628-936e-8580d12613b1 on n-h2-862769-1 Oct 27 03:53:24.126805 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-33d019ce-c33f-4bd3-b5d8-b8a43cce340e req-c2cb5e8d-163f-4a91-a25d-d338c7835313 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048622 Oct 27 03:53:24.127769 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2956/6198] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:53:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:53:24.554373 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d141d1f0-f434-465f-a533-52814618f195 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:53:24.556242 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d141d1f0-f434-465f-a533-52814618f195 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] [instance: e15c3d21-45a5-4628-936e-8580d12613b1] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:53:24.581194 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d141d1f0-f434-465f-a533-52814618f195 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:53:24.583099 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d141d1f0-f434-465f-a533-52814618f195 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:53:24.583948 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d141d1f0-f434-465f-a533-52814618f195 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:53:24.584832 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d141d1f0-f434-465f-a533-52814618f195 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:53:24.585996 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d141d1f0-f434-465f-a533-52814618f195 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:53:24.586644 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d141d1f0-f434-465f-a533-52814618f195 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:53:24.637066 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d141d1f0-f434-465f-a533-52814618f195 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:53:24.637786 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d141d1f0-f434-465f-a533-52814618f195 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:53:24.638559 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d141d1f0-f434-465f-a533-52814618f195 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:53:24.639367 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-d141d1f0-f434-465f-a533-52814618f195 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lazy-loading 'fault' on Instance uuid e15c3d21-45a5-4628-936e-8580d12613b1 {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:53:24.716611 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d141d1f0-f434-465f-a533-52814618f195 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ba627e73834b84b1ee6514e1facd1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aead91140df544faa492b8fd1952db8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:53:24.730823 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d141d1f0-f434-465f-a533-52814618f195 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] 10.222.0.20 "GET /compute/v2.1/servers/e15c3d21-45a5-4628-936e-8580d12613b1" status: 200 len: 1309 microversion: 2.1 time: 0.183230 Oct 27 03:53:24.731767 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3243/6199] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:53:24 2022] GET /compute/v2.1/servers/e15c3d21-45a5-4628-936e-8580d12613b1 => generated 1309 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:53:24.822464 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-071c7435-1082-4d12-9703-0027de30bab6 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:53:24.823715 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-071c7435-1082-4d12-9703-0027de30bab6 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:53:24.831247 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-071c7435-1082-4d12-9703-0027de30bab6 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:53:24.832589 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-071c7435-1082-4d12-9703-0027de30bab6 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:53:24.833036 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-071c7435-1082-4d12-9703-0027de30bab6 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:53:24.834348 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-071c7435-1082-4d12-9703-0027de30bab6 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:53:24.835165 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-071c7435-1082-4d12-9703-0027de30bab6 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:53:24.835778 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-071c7435-1082-4d12-9703-0027de30bab6 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:53:25.168966 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-071c7435-1082-4d12-9703-0027de30bab6 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:53:25.181448 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-071c7435-1082-4d12-9703-0027de30bab6 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa" status: 200 len: 1566 microversion: 2.1 time: 0.365290 Oct 27 03:53:25.184481 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2957/6200] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:53:24 2022] GET /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa => generated 1566 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:53:25.217361 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3256ab46-674f-4dac-9545-3528a661c23e tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:53:25.222680 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3256ab46-674f-4dac-9545-3528a661c23e tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:53:25.233961 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3256ab46-674f-4dac-9545-3528a661c23e tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:53:25.240309 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3256ab46-674f-4dac-9545-3528a661c23e tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:53:25.240309 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3256ab46-674f-4dac-9545-3528a661c23e tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:53:25.240309 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3256ab46-674f-4dac-9545-3528a661c23e tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:53:25.240309 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3256ab46-674f-4dac-9545-3528a661c23e tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:53:25.240309 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3256ab46-674f-4dac-9545-3528a661c23e tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:53:25.587386 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3256ab46-674f-4dac-9545-3528a661c23e tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:53:25.598709 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3256ab46-674f-4dac-9545-3528a661c23e tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa" status: 200 len: 1566 microversion: 2.1 time: 0.385187 Oct 27 03:53:25.599264 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3244/6201] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:53:25 2022] GET /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa => generated 1566 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:53:25.759239 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1ebabcd7-f165-454c-acae-e378e3334844 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:53:25.760615 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1ebabcd7-f165-454c-acae-e378e3334844 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] [instance: e15c3d21-45a5-4628-936e-8580d12613b1] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:53:25.771680 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1ebabcd7-f165-454c-acae-e378e3334844 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:53:25.778447 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1ebabcd7-f165-454c-acae-e378e3334844 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:53:25.779195 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1ebabcd7-f165-454c-acae-e378e3334844 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:53:25.780115 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1ebabcd7-f165-454c-acae-e378e3334844 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:53:25.780769 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1ebabcd7-f165-454c-acae-e378e3334844 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:53:25.781363 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1ebabcd7-f165-454c-acae-e378e3334844 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:53:25.812005 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-1ebabcd7-f165-454c-acae-e378e3334844 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] HTTP exception thrown: Instance e15c3d21-45a5-4628-936e-8580d12613b1 could not be found. Oct 27 03:53:25.813743 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1ebabcd7-f165-454c-acae-e378e3334844 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Request method failure captured: Oct 27 03:53:25.813743 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/e15c3d21-45a5-4628-936e-8580d12613b1 HTTP/1.1 Oct 27 03:53:25.813743 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:53:25.813743 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:53:25.813743 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:53:25.813743 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:53:25.813743 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:53:25.813743 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:53:25.813743 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:53:25.813743 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:53:25.813743 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWf9Z8AWu-9AtY7xde6y3ALCJlGMARVgxTfOLSMxRaGecHl7nCRHEt3rUMZrEU8X3Jaq2CHz-LjHDneOyn9d-llFK-ATuhJ_8R5aMGIGBBQQx2jRggmsg38-BUXM7eWDy8hxqwrFvTjygte49bEoY7lsYFaCR0JBlGd4L3kFReFOrtWE Oct 27 03:53:25.813743 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:53:25.813743 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:53:25.813743 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:53:25.813743 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:53:25.813743 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:53:25.813743 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:53:25.813743 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: aead91140df544faa492b8fd1952db8c Oct 27 03:53:25.813743 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1169448723 Oct 27 03:53:25.813743 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:53:25.813743 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:53:25.813743 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aead91140df544faa492b8fd1952db8c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/aead91140df544faa492b8fd1952db8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aead91140df544faa492b8fd1952db8c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_aead91140df544faa492b8fd1952db8c"}]}] Oct 27 03:53:25.813743 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-VolumesSnapshotTestJSON-1169448723 Oct 27 03:53:25.813743 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: aead91140df544faa492b8fd1952db8c Oct 27 03:53:25.813743 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1169448723 Oct 27 03:53:25.813743 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-VolumesSnapshotTestJSON-1169448723-project Oct 27 03:53:25.813743 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:53:25.813743 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:53:25.813743 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 66ba627e73834b84b1ee6514e1facd1c Oct 27 03:53:25.813743 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-VolumesSnapshotTestJSON-1169448723-project Oct 27 03:53:25.813743 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:53:25.813743 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance e15c3d21-45a5-4628-936e-8580d12613b1 could not be found. Oct 27 03:53:25.813743 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': 'e15c3d21-45a5-4628-936e-8580d12613b1'} Oct 27 03:53:25.813743 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:53:25.813743 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:53:25.813743 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:53:25.813743 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:53:25.813743 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:53:25.813743 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:53:25.813743 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:53:25.813743 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:53:25.813743 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:53:25.813743 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:53:25.813743 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e15c3d21-45a5-4628-936e-8580d12613b1 could not be found. Oct 27 03:53:25.813743 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:53:25.813743 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:53:25.813743 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:53:25.813743 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:53:25.813743 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:53:25.813743 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:53:25.813743 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:53:25.813743 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:53:25.813743 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:53:25.813743 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:53:25.813743 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:53:25.813743 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:53:25.813743 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:53:25.813743 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:53:25.813743 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:53:25.813743 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:53:25.813743 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e15c3d21-45a5-4628-936e-8580d12613b1 could not be found. Oct 27 03:53:25.813743 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:53:25.813743 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:53:25.813743 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:53:25.819991 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:53:25.819991 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:53:25.819991 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:53:25.819991 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:53:25.819991 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:53:25.819991 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e15c3d21-45a5-4628-936e-8580d12613b1 could not be found. Oct 27 03:53:25.819991 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:53:25.819991 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1ebabcd7-f165-454c-acae-e378e3334844 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] Returning 404 to user: Instance e15c3d21-45a5-4628-936e-8580d12613b1 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:53:25.819991 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1ebabcd7-f165-454c-acae-e378e3334844 tempest-VolumesSnapshotTestJSON-1169448723 tempest-VolumesSnapshotTestJSON-1169448723-project] 10.222.0.20 "GET /compute/v2.1/servers/e15c3d21-45a5-4628-936e-8580d12613b1" status: 404 len: 111 microversion: 2.1 time: 0.060649 Oct 27 03:53:25.827492 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2958/6202] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:53:25 2022] GET /compute/v2.1/servers/e15c3d21-45a5-4628-936e-8580d12613b1 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:53:26.223923 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3a84b753-549e-4bde-a963-121dcf422caf tempest-PortsAdminExtendedAttrsTestJSON-835384917 tempest-PortsAdminExtendedAttrsTestJSON-835384917-project-admin] Calling method '.version_select at 0x7f7dd955c940>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:53:26.228511 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3a84b753-549e-4bde-a963-121dcf422caf tempest-PortsAdminExtendedAttrsTestJSON-835384917 tempest-PortsAdminExtendedAttrsTestJSON-835384917-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:53:26.228511 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3a84b753-549e-4bde-a963-121dcf422caf tempest-PortsAdminExtendedAttrsTestJSON-835384917 tempest-PortsAdminExtendedAttrsTestJSON-835384917-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:53:26.228511 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3a84b753-549e-4bde-a963-121dcf422caf tempest-PortsAdminExtendedAttrsTestJSON-835384917 tempest-PortsAdminExtendedAttrsTestJSON-835384917-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:53:26.246583 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3a84b753-549e-4bde-a963-121dcf422caf tempest-PortsAdminExtendedAttrsTestJSON-835384917 tempest-PortsAdminExtendedAttrsTestJSON-835384917-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:53:26.247231 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3a84b753-549e-4bde-a963-121dcf422caf tempest-PortsAdminExtendedAttrsTestJSON-835384917 tempest-PortsAdminExtendedAttrsTestJSON-835384917-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:53:26.247768 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3a84b753-549e-4bde-a963-121dcf422caf tempest-PortsAdminExtendedAttrsTestJSON-835384917 tempest-PortsAdminExtendedAttrsTestJSON-835384917-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:53:26.260703 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3a84b753-549e-4bde-a963-121dcf422caf tempest-PortsAdminExtendedAttrsTestJSON-835384917 tempest-PortsAdminExtendedAttrsTestJSON-835384917-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:53:26.261494 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3a84b753-549e-4bde-a963-121dcf422caf tempest-PortsAdminExtendedAttrsTestJSON-835384917 tempest-PortsAdminExtendedAttrsTestJSON-835384917-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:53:26.262012 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3a84b753-549e-4bde-a963-121dcf422caf tempest-PortsAdminExtendedAttrsTestJSON-835384917 tempest-PortsAdminExtendedAttrsTestJSON-835384917-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:53:26.269760 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3a84b753-549e-4bde-a963-121dcf422caf tempest-PortsAdminExtendedAttrsTestJSON-835384917 tempest-PortsAdminExtendedAttrsTestJSON-835384917-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.353937 Oct 27 03:53:26.271205 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3245/6203] 10.222.0.20 () {58 vars in 1146 bytes} [Thu Oct 27 03:53:25 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:53:30.823856 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d1363445-50d0-4878-91b2-d8c619e8920d tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:53:30.824483 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d1363445-50d0-4878-91b2-d8c619e8920d tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:53:30.827459 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:53:30.852081 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d1363445-50d0-4878-91b2-d8c619e8920d tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:53:30.852604 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d1363445-50d0-4878-91b2-d8c619e8920d tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:53:30.853248 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d1363445-50d0-4878-91b2-d8c619e8920d tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:53:30.853996 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d1363445-50d0-4878-91b2-d8c619e8920d tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:53:30.859946 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d1363445-50d0-4878-91b2-d8c619e8920d tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:53:30.860464 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d1363445-50d0-4878-91b2-d8c619e8920d tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:53:30.889107 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=80,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:53:30.937684 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-e701d0f9-d402-4eee-a66d-4c784a66c410 req-04671de9-f4ce-45db-83b6-9de2abdbaea9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa", "tag": "bba702ac-b41d-4188-9510-3b36b88fbfb7"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:53:30.967800 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-e701d0f9-d402-4eee-a66d-4c784a66c410 req-04671de9-f4ce-45db-83b6-9de2abdbaea9 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:53:30.971293 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-e701d0f9-d402-4eee-a66d-4c784a66c410 req-04671de9-f4ce-45db-83b6-9de2abdbaea9 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:53:30.972656 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-e701d0f9-d402-4eee-a66d-4c784a66c410 req-04671de9-f4ce-45db-83b6-9de2abdbaea9 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:53:31.021013 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-e701d0f9-d402-4eee-a66d-4c784a66c410 req-04671de9-f4ce-45db-83b6-9de2abdbaea9 service nova] Creating event network-changed:bba702ac-b41d-4188-9510-3b36b88fbfb7 for instance 5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa on n-h1-862769-1 Oct 27 03:53:31.033370 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-e701d0f9-d402-4eee-a66d-4c784a66c410 req-04671de9-f4ce-45db-83b6-9de2abdbaea9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099906 Oct 27 03:53:31.034792 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3246/6204] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:53:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:53:31.586667 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d1363445-50d0-4878-91b2-d8c619e8920d tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:53:31.598439 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d1363445-50d0-4878-91b2-d8c619e8920d tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa" status: 200 len: 1566 microversion: 2.1 time: 0.778812 Oct 27 03:53:31.603165 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2959/6205] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:53:30 2022] GET /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa => generated 1566 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:53:50.119904 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=36 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:53:50.122700 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=78 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:53:50.129486 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b621b605-5733-48dd-94f0-95eb1b090536 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:53:50.160794 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b621b605-5733-48dd-94f0-95eb1b090536 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:53:50.190398 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b621b605-5733-48dd-94f0-95eb1b090536 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:53:50.190810 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b621b605-5733-48dd-94f0-95eb1b090536 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:53:50.191483 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b621b605-5733-48dd-94f0-95eb1b090536 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:53:50.192450 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b621b605-5733-48dd-94f0-95eb1b090536 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:53:50.193229 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b621b605-5733-48dd-94f0-95eb1b090536 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:53:50.193877 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b621b605-5733-48dd-94f0-95eb1b090536 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:53:50.265345 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b621b605-5733-48dd-94f0-95eb1b090536 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "POST /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa/action" status: 200 len: 24567 microversion: 2.1 time: 0.153090 Oct 27 03:53:50.275379 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3247/6206] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:53:50 2022] POST /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa/action => generated 24567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 03:54:01.145684 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2f4dcb22-1197-4223-9cde-a0faadfc9a43 tempest-TestNetworkAdvancedServerOps-1624832099 tempest-TestNetworkAdvancedServerOps-1624832099-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:54:01.146510 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-2f4dcb22-1197-4223-9cde-a0faadfc9a43 tempest-TestNetworkAdvancedServerOps-1624832099 tempest-TestNetworkAdvancedServerOps-1624832099-project-admin] [instance: 5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:54:01.163971 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2f4dcb22-1197-4223-9cde-a0faadfc9a43 tempest-TestNetworkAdvancedServerOps-1624832099 tempest-TestNetworkAdvancedServerOps-1624832099-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:54:01.164877 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2f4dcb22-1197-4223-9cde-a0faadfc9a43 tempest-TestNetworkAdvancedServerOps-1624832099 tempest-TestNetworkAdvancedServerOps-1624832099-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:54:01.165585 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2f4dcb22-1197-4223-9cde-a0faadfc9a43 tempest-TestNetworkAdvancedServerOps-1624832099 tempest-TestNetworkAdvancedServerOps-1624832099-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:54:01.166595 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2f4dcb22-1197-4223-9cde-a0faadfc9a43 tempest-TestNetworkAdvancedServerOps-1624832099 tempest-TestNetworkAdvancedServerOps-1624832099-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:54:01.167289 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2f4dcb22-1197-4223-9cde-a0faadfc9a43 tempest-TestNetworkAdvancedServerOps-1624832099 tempest-TestNetworkAdvancedServerOps-1624832099-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:54:01.167977 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2f4dcb22-1197-4223-9cde-a0faadfc9a43 tempest-TestNetworkAdvancedServerOps-1624832099 tempest-TestNetworkAdvancedServerOps-1624832099-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:54:02.094997 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2f4dcb22-1197-4223-9cde-a0faadfc9a43 tempest-TestNetworkAdvancedServerOps-1624832099 tempest-TestNetworkAdvancedServerOps-1624832099-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa" status: 200 len: 1835 microversion: 2.1 time: 0.953424 Oct 27 03:54:02.097851 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2960/6207] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:54:01 2022] GET /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa => generated 1835 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:54:02.125484 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-cf03c308-a4f4-4683-a223-974711e31867 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:54:02.126289 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-cf03c308-a4f4-4683-a223-974711e31867 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:54:02.140627 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cf03c308-a4f4-4683-a223-974711e31867 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:54:02.143467 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cf03c308-a4f4-4683-a223-974711e31867 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:54:02.144948 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cf03c308-a4f4-4683-a223-974711e31867 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:54:02.146840 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cf03c308-a4f4-4683-a223-974711e31867 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:54:02.147389 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cf03c308-a4f4-4683-a223-974711e31867 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:54:02.147762 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cf03c308-a4f4-4683-a223-974711e31867 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:54:02.472618 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-cf03c308-a4f4-4683-a223-974711e31867 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:54:02.481039 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-cf03c308-a4f4-4683-a223-974711e31867 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa" status: 200 len: 1684 microversion: 2.1 time: 0.361663 Oct 27 03:54:02.498199 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3248/6208] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:54:02 2022] GET /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa => generated 1684 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:54:02.622558 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-33a88c55-5431-4fdd-aef1-54b2fea72542 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:54:02.627812 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-33a88c55-5431-4fdd-aef1-54b2fea72542 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:54:02.640182 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-33a88c55-5431-4fdd-aef1-54b2fea72542 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:54:02.640692 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-33a88c55-5431-4fdd-aef1-54b2fea72542 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:54:02.641139 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-33a88c55-5431-4fdd-aef1-54b2fea72542 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:54:02.641862 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-33a88c55-5431-4fdd-aef1-54b2fea72542 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:54:02.645516 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-33a88c55-5431-4fdd-aef1-54b2fea72542 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:54:02.645987 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-33a88c55-5431-4fdd-aef1-54b2fea72542 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:54:02.755495 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-33a88c55-5431-4fdd-aef1-54b2fea72542 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "POST /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa/action" status: 200 len: 32629 microversion: 2.1 time: 0.136582 Oct 27 03:54:02.756458 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2961/6209] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:54:02 2022] POST /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa/action => generated 32629 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 03:54:02.902007 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5db97c56-b144-4783-b36f-9e4b34a5759d tempest-TestNetworkAdvancedServerOps-1624832099 tempest-TestNetworkAdvancedServerOps-1624832099-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:54:02.903057 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5db97c56-b144-4783-b36f-9e4b34a5759d tempest-TestNetworkAdvancedServerOps-1624832099 tempest-TestNetworkAdvancedServerOps-1624832099-project-admin] [instance: 5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:54:02.927369 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5db97c56-b144-4783-b36f-9e4b34a5759d tempest-TestNetworkAdvancedServerOps-1624832099 tempest-TestNetworkAdvancedServerOps-1624832099-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:54:02.931301 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5db97c56-b144-4783-b36f-9e4b34a5759d tempest-TestNetworkAdvancedServerOps-1624832099 tempest-TestNetworkAdvancedServerOps-1624832099-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:54:02.932047 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5db97c56-b144-4783-b36f-9e4b34a5759d tempest-TestNetworkAdvancedServerOps-1624832099 tempest-TestNetworkAdvancedServerOps-1624832099-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:54:02.935206 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5db97c56-b144-4783-b36f-9e4b34a5759d tempest-TestNetworkAdvancedServerOps-1624832099 tempest-TestNetworkAdvancedServerOps-1624832099-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:54:02.936571 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5db97c56-b144-4783-b36f-9e4b34a5759d tempest-TestNetworkAdvancedServerOps-1624832099 tempest-TestNetworkAdvancedServerOps-1624832099-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:54:02.948596 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5db97c56-b144-4783-b36f-9e4b34a5759d tempest-TestNetworkAdvancedServerOps-1624832099 tempest-TestNetworkAdvancedServerOps-1624832099-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:54:03.050412 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5db97c56-b144-4783-b36f-9e4b34a5759d tempest-TestNetworkAdvancedServerOps-1624832099 tempest-TestNetworkAdvancedServerOps-1624832099-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'b4c62e547884403f8f5f4820a845c757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9151e0cac8482384bd1629d6227841', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:54:03.051153 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5db97c56-b144-4783-b36f-9e4b34a5759d tempest-TestNetworkAdvancedServerOps-1624832099 tempest-TestNetworkAdvancedServerOps-1624832099-project-admin] [instance: 5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa] flavor_id is None. Assuming migration. {{(pid=121001) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 27 03:54:03.072877 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5db97c56-b144-4783-b36f-9e4b34a5759d tempest-TestNetworkAdvancedServerOps-1624832099 tempest-TestNetworkAdvancedServerOps-1624832099-project-admin] [instance: 5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=121001) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 27 03:54:04.070402 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5db97c56-b144-4783-b36f-9e4b34a5759d tempest-TestNetworkAdvancedServerOps-1624832099 tempest-TestNetworkAdvancedServerOps-1624832099-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa/action" status: 202 len: 0 microversion: 2.1 time: 1.168297 Oct 27 03:54:04.075707 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3249/6210] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:54:02 2022] POST /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa/action => generated 0 bytes in 1178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:54:04.087482 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-76a296e6-05fe-4aef-84ca-e94afa44faf8 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:54:04.087482 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-76a296e6-05fe-4aef-84ca-e94afa44faf8 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:54:04.103242 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-76a296e6-05fe-4aef-84ca-e94afa44faf8 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:54:04.104149 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-76a296e6-05fe-4aef-84ca-e94afa44faf8 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:54:04.109796 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-76a296e6-05fe-4aef-84ca-e94afa44faf8 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:54:04.112239 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-76a296e6-05fe-4aef-84ca-e94afa44faf8 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:54:04.114916 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-76a296e6-05fe-4aef-84ca-e94afa44faf8 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:54:04.117278 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-76a296e6-05fe-4aef-84ca-e94afa44faf8 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:54:04.442939 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-76a296e6-05fe-4aef-84ca-e94afa44faf8 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:54:04.454460 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-76a296e6-05fe-4aef-84ca-e94afa44faf8 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa" status: 200 len: 1693 microversion: 2.1 time: 0.371326 Oct 27 03:54:04.459203 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2962/6211] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:54:04 2022] GET /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa => generated 1693 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:54:05.482679 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-09cc6dfb-23aa-4a4d-b9b9-45265790af3c tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:54:05.483313 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-09cc6dfb-23aa-4a4d-b9b9-45265790af3c tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:54:05.511394 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-09cc6dfb-23aa-4a4d-b9b9-45265790af3c tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:54:05.512221 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-09cc6dfb-23aa-4a4d-b9b9-45265790af3c tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:54:05.513749 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-09cc6dfb-23aa-4a4d-b9b9-45265790af3c tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:54:05.516756 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-09cc6dfb-23aa-4a4d-b9b9-45265790af3c tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:54:05.517840 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-09cc6dfb-23aa-4a4d-b9b9-45265790af3c tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:54:05.520052 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-09cc6dfb-23aa-4a4d-b9b9-45265790af3c tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:54:05.962709 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-09cc6dfb-23aa-4a4d-b9b9-45265790af3c tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:54:05.983047 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-09cc6dfb-23aa-4a4d-b9b9-45265790af3c tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa" status: 200 len: 1693 microversion: 2.1 time: 0.495039 Oct 27 03:54:05.984695 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3250/6212] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:54:05 2022] GET /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa => generated 1693 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:54:07.023081 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-48ef6134-e6cf-4a65-9f59-97ddbf1df4cb tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:54:07.029699 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-48ef6134-e6cf-4a65-9f59-97ddbf1df4cb tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:54:07.053264 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-48ef6134-e6cf-4a65-9f59-97ddbf1df4cb tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:54:07.053785 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-48ef6134-e6cf-4a65-9f59-97ddbf1df4cb tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:54:07.054376 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-48ef6134-e6cf-4a65-9f59-97ddbf1df4cb tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:54:07.055121 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-48ef6134-e6cf-4a65-9f59-97ddbf1df4cb tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:54:07.055587 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-48ef6134-e6cf-4a65-9f59-97ddbf1df4cb tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:54:07.056018 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-48ef6134-e6cf-4a65-9f59-97ddbf1df4cb tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:54:08.001448 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-48ef6134-e6cf-4a65-9f59-97ddbf1df4cb tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:54:08.014803 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-48ef6134-e6cf-4a65-9f59-97ddbf1df4cb tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa" status: 200 len: 1693 microversion: 2.1 time: 1.003670 Oct 27 03:54:08.016171 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2963/6213] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:54:07 2022] GET /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa => generated 1693 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:54:09.046295 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1cfbcb9f-0481-486a-b537-d6d130d3750b tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:54:09.046695 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1cfbcb9f-0481-486a-b537-d6d130d3750b tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:54:09.062773 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1cfbcb9f-0481-486a-b537-d6d130d3750b tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:54:09.063287 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1cfbcb9f-0481-486a-b537-d6d130d3750b tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:54:09.068544 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1cfbcb9f-0481-486a-b537-d6d130d3750b tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:54:09.068544 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1cfbcb9f-0481-486a-b537-d6d130d3750b tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:54:09.068544 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1cfbcb9f-0481-486a-b537-d6d130d3750b tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:54:09.068544 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1cfbcb9f-0481-486a-b537-d6d130d3750b tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:54:09.411451 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1cfbcb9f-0481-486a-b537-d6d130d3750b tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:54:09.420345 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1cfbcb9f-0481-486a-b537-d6d130d3750b tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa" status: 200 len: 1693 microversion: 2.1 time: 0.381390 Oct 27 03:54:09.421878 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3251/6214] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:54:09 2022] GET /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa => generated 1693 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:54:10.447659 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-686e15eb-3cde-4aa9-951f-72ece3de431b tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:54:10.447659 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-686e15eb-3cde-4aa9-951f-72ece3de431b tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:54:10.453293 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-686e15eb-3cde-4aa9-951f-72ece3de431b tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:54:10.454195 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-686e15eb-3cde-4aa9-951f-72ece3de431b tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:54:10.454621 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-686e15eb-3cde-4aa9-951f-72ece3de431b tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:54:10.456753 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-686e15eb-3cde-4aa9-951f-72ece3de431b tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:54:10.457577 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-686e15eb-3cde-4aa9-951f-72ece3de431b tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:54:10.458329 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-686e15eb-3cde-4aa9-951f-72ece3de431b tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:54:10.937923 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-686e15eb-3cde-4aa9-951f-72ece3de431b tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:54:10.955817 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-686e15eb-3cde-4aa9-951f-72ece3de431b tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa" status: 200 len: 1698 microversion: 2.1 time: 0.515344 Oct 27 03:54:10.962694 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2964/6215] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:54:10 2022] GET /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa => generated 1698 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:54:11.993028 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ae435b61-1780-468b-b705-38e57f9bb0a7 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:54:11.994434 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ae435b61-1780-468b-b705-38e57f9bb0a7 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:54:12.005915 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ae435b61-1780-468b-b705-38e57f9bb0a7 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:54:12.007995 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ae435b61-1780-468b-b705-38e57f9bb0a7 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:54:12.008579 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ae435b61-1780-468b-b705-38e57f9bb0a7 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:54:12.024062 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ae435b61-1780-468b-b705-38e57f9bb0a7 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:54:12.024895 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ae435b61-1780-468b-b705-38e57f9bb0a7 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:54:12.032628 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ae435b61-1780-468b-b705-38e57f9bb0a7 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:54:12.782506 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ae435b61-1780-468b-b705-38e57f9bb0a7 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:54:12.810827 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ae435b61-1780-468b-b705-38e57f9bb0a7 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa" status: 200 len: 1698 microversion: 2.1 time: 0.815012 Oct 27 03:54:12.811542 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3252/6216] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:54:11 2022] GET /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa => generated 1698 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:54:13.839151 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4165994e-fd90-440a-9146-f715119c6f4c tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:54:13.840375 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4165994e-fd90-440a-9146-f715119c6f4c tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:54:13.848352 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4165994e-fd90-440a-9146-f715119c6f4c tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:54:13.849358 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4165994e-fd90-440a-9146-f715119c6f4c tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:54:13.850213 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4165994e-fd90-440a-9146-f715119c6f4c tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:54:13.851246 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4165994e-fd90-440a-9146-f715119c6f4c tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:54:13.851924 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4165994e-fd90-440a-9146-f715119c6f4c tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:54:13.852743 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4165994e-fd90-440a-9146-f715119c6f4c tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:54:14.163967 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4165994e-fd90-440a-9146-f715119c6f4c tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:54:14.178168 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4165994e-fd90-440a-9146-f715119c6f4c tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa" status: 200 len: 1698 microversion: 2.1 time: 0.342831 Oct 27 03:54:14.178788 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2965/6217] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:54:13 2022] GET /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa => generated 1698 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:54:15.202819 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-53c4e230-0fcc-464c-94d7-844824982087 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:54:15.218362 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-53c4e230-0fcc-464c-94d7-844824982087 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:54:15.218362 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-53c4e230-0fcc-464c-94d7-844824982087 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:54:15.218362 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-53c4e230-0fcc-464c-94d7-844824982087 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:54:15.218362 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-53c4e230-0fcc-464c-94d7-844824982087 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:54:15.218362 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-53c4e230-0fcc-464c-94d7-844824982087 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:54:15.218362 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-53c4e230-0fcc-464c-94d7-844824982087 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:54:15.218362 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-53c4e230-0fcc-464c-94d7-844824982087 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:54:15.800776 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-53c4e230-0fcc-464c-94d7-844824982087 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:54:15.809254 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-53c4e230-0fcc-464c-94d7-844824982087 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa" status: 200 len: 1698 microversion: 2.1 time: 0.610793 Oct 27 03:54:15.822399 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3253/6218] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:54:15 2022] GET /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa => generated 1698 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:54:16.838456 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f8602739-6936-46c0-acdd-6c9b29692d6e tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:54:16.846720 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f8602739-6936-46c0-acdd-6c9b29692d6e tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:54:16.871339 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f8602739-6936-46c0-acdd-6c9b29692d6e tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:54:16.875666 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f8602739-6936-46c0-acdd-6c9b29692d6e tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:54:16.877375 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f8602739-6936-46c0-acdd-6c9b29692d6e tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:54:16.878908 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f8602739-6936-46c0-acdd-6c9b29692d6e tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:54:16.883904 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f8602739-6936-46c0-acdd-6c9b29692d6e tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:54:16.884577 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f8602739-6936-46c0-acdd-6c9b29692d6e tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:54:17.416607 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f8602739-6936-46c0-acdd-6c9b29692d6e tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:54:17.427024 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f8602739-6936-46c0-acdd-6c9b29692d6e tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa" status: 200 len: 1698 microversion: 2.1 time: 0.593163 Oct 27 03:54:17.428397 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2966/6219] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:54:16 2022] GET /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa => generated 1698 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:54:18.473200 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-eeba3f43-53d9-4e8a-85db-21f5ab77a77f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:54:18.473200 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-eeba3f43-53d9-4e8a-85db-21f5ab77a77f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:54:18.481430 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eeba3f43-53d9-4e8a-85db-21f5ab77a77f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:54:18.482123 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eeba3f43-53d9-4e8a-85db-21f5ab77a77f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:54:18.482830 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eeba3f43-53d9-4e8a-85db-21f5ab77a77f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:54:18.483865 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eeba3f43-53d9-4e8a-85db-21f5ab77a77f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:54:18.483865 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eeba3f43-53d9-4e8a-85db-21f5ab77a77f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:54:18.485882 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eeba3f43-53d9-4e8a-85db-21f5ab77a77f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:54:18.855467 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-eeba3f43-53d9-4e8a-85db-21f5ab77a77f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:54:18.879353 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-eeba3f43-53d9-4e8a-85db-21f5ab77a77f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa" status: 200 len: 1698 microversion: 2.1 time: 0.410829 Oct 27 03:54:18.902425 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3254/6220] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:54:18 2022] GET /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa => generated 1698 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:54:19.909987 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-cd7237f8-9b8d-4e44-adb3-65bb37ef6f20 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:54:19.910763 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-cd7237f8-9b8d-4e44-adb3-65bb37ef6f20 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:54:19.933078 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cd7237f8-9b8d-4e44-adb3-65bb37ef6f20 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:54:19.933582 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cd7237f8-9b8d-4e44-adb3-65bb37ef6f20 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:54:19.934122 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cd7237f8-9b8d-4e44-adb3-65bb37ef6f20 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:54:19.943185 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cd7237f8-9b8d-4e44-adb3-65bb37ef6f20 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:54:19.949130 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cd7237f8-9b8d-4e44-adb3-65bb37ef6f20 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:54:19.949811 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cd7237f8-9b8d-4e44-adb3-65bb37ef6f20 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:54:20.660340 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-cd7237f8-9b8d-4e44-adb3-65bb37ef6f20 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:54:20.690275 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-cd7237f8-9b8d-4e44-adb3-65bb37ef6f20 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa" status: 200 len: 1698 microversion: 2.1 time: 0.771455 Oct 27 03:54:20.691030 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2967/6221] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:54:19 2022] GET /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa => generated 1698 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:54:21.719474 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-68c903b9-3c1e-4272-884c-27d903337f82 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:54:21.719924 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-68c903b9-3c1e-4272-884c-27d903337f82 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:54:21.739629 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-68c903b9-3c1e-4272-884c-27d903337f82 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:54:21.741966 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-68c903b9-3c1e-4272-884c-27d903337f82 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:54:21.742715 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-68c903b9-3c1e-4272-884c-27d903337f82 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:54:21.743644 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-68c903b9-3c1e-4272-884c-27d903337f82 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:54:21.747707 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-68c903b9-3c1e-4272-884c-27d903337f82 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:54:21.749084 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-68c903b9-3c1e-4272-884c-27d903337f82 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:54:22.090508 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-68c903b9-3c1e-4272-884c-27d903337f82 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:54:22.101200 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-68c903b9-3c1e-4272-884c-27d903337f82 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa" status: 200 len: 1698 microversion: 2.1 time: 0.386647 Oct 27 03:54:22.114380 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3255/6222] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:54:21 2022] GET /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa => generated 1698 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:54:23.129048 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-23288bb6-08cd-44ed-b175-50f535f7804f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:54:23.130430 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-23288bb6-08cd-44ed-b175-50f535f7804f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:54:23.154425 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-23288bb6-08cd-44ed-b175-50f535f7804f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:54:23.154950 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-23288bb6-08cd-44ed-b175-50f535f7804f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:54:23.155403 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-23288bb6-08cd-44ed-b175-50f535f7804f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:54:23.156141 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-23288bb6-08cd-44ed-b175-50f535f7804f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:54:23.158485 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-23288bb6-08cd-44ed-b175-50f535f7804f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:54:23.158962 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-23288bb6-08cd-44ed-b175-50f535f7804f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:54:23.944703 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-23288bb6-08cd-44ed-b175-50f535f7804f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:54:23.961391 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-23288bb6-08cd-44ed-b175-50f535f7804f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa" status: 200 len: 1697 microversion: 2.1 time: 0.836460 Oct 27 03:54:23.962273 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2968/6223] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:54:23 2022] GET /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa => generated 1697 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:54:24.956137 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-e91f483f-0c1b-4731-bf0e-86f27b315747 req-94cc5f9f-4528-43e0-a52f-77f6308107e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa", "name": "network-vif-unplugged", "status": "completed", "tag": "bba702ac-b41d-4188-9510-3b36b88fbfb7"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:54:24.986289 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-abe79191-a392-4c31-8ba4-470c4a43b198 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:54:24.987522 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-abe79191-a392-4c31-8ba4-470c4a43b198 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:54:24.991685 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-e91f483f-0c1b-4731-bf0e-86f27b315747 req-94cc5f9f-4528-43e0-a52f-77f6308107e7 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:54:24.994379 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-e91f483f-0c1b-4731-bf0e-86f27b315747 req-94cc5f9f-4528-43e0-a52f-77f6308107e7 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:54:24.994995 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-e91f483f-0c1b-4731-bf0e-86f27b315747 req-94cc5f9f-4528-43e0-a52f-77f6308107e7 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:54:24.999174 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-abe79191-a392-4c31-8ba4-470c4a43b198 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:54:24.999675 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-abe79191-a392-4c31-8ba4-470c4a43b198 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:54:25.000106 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-abe79191-a392-4c31-8ba4-470c4a43b198 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:54:25.003200 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-abe79191-a392-4c31-8ba4-470c4a43b198 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:54:25.003891 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-abe79191-a392-4c31-8ba4-470c4a43b198 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:54:25.005070 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-abe79191-a392-4c31-8ba4-470c4a43b198 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:54:25.029523 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-e91f483f-0c1b-4731-bf0e-86f27b315747 req-94cc5f9f-4528-43e0-a52f-77f6308107e7 service nova] Creating event network-vif-unplugged:bba702ac-b41d-4188-9510-3b36b88fbfb7 for instance 5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa on n-h2-862769-1 Oct 27 03:54:25.040804 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [req-e91f483f-0c1b-4731-bf0e-86f27b315747 req-94cc5f9f-4528-43e0-a52f-77f6308107e7 service nova] Instance 5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862769-1', 'n-h1-862769-1'} {{(pid=121001) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 03:54:25.063583 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-e91f483f-0c1b-4731-bf0e-86f27b315747 req-94cc5f9f-4528-43e0-a52f-77f6308107e7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.111112 Oct 27 03:54:25.064812 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3256/6224] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:54:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:54:25.405282 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-abe79191-a392-4c31-8ba4-470c4a43b198 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:54:25.424930 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-abe79191-a392-4c31-8ba4-470c4a43b198 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa" status: 200 len: 1697 microversion: 2.1 time: 0.442566 Oct 27 03:54:25.425516 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2969/6225] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:54:24 2022] GET /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa => generated 1697 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:54:26.455893 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b8a6f8c1-54b7-4745-b804-60d5654cae13 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:54:26.457969 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b8a6f8c1-54b7-4745-b804-60d5654cae13 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:54:26.476113 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b8a6f8c1-54b7-4745-b804-60d5654cae13 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:54:26.481667 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b8a6f8c1-54b7-4745-b804-60d5654cae13 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:54:26.484512 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b8a6f8c1-54b7-4745-b804-60d5654cae13 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:54:26.485555 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b8a6f8c1-54b7-4745-b804-60d5654cae13 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:54:26.486832 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b8a6f8c1-54b7-4745-b804-60d5654cae13 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:54:26.498661 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b8a6f8c1-54b7-4745-b804-60d5654cae13 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:54:27.055838 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b8a6f8c1-54b7-4745-b804-60d5654cae13 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:54:27.068798 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b8a6f8c1-54b7-4745-b804-60d5654cae13 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa" status: 200 len: 1697 microversion: 2.1 time: 0.620770 Oct 27 03:54:27.070405 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3257/6226] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:54:26 2022] GET /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa => generated 1697 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:54:27.080766 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-8040bdd9-a931-410c-bd1b-a3c4aaf29081 req-06e75e20-7ddd-407a-8b22-8c6e552cd885 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa", "tag": "bba702ac-b41d-4188-9510-3b36b88fbfb7"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:54:27.106338 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-8040bdd9-a931-410c-bd1b-a3c4aaf29081 req-06e75e20-7ddd-407a-8b22-8c6e552cd885 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:54:27.106842 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-8040bdd9-a931-410c-bd1b-a3c4aaf29081 req-06e75e20-7ddd-407a-8b22-8c6e552cd885 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:54:27.107285 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-8040bdd9-a931-410c-bd1b-a3c4aaf29081 req-06e75e20-7ddd-407a-8b22-8c6e552cd885 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:54:27.120066 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-8040bdd9-a931-410c-bd1b-a3c4aaf29081 req-06e75e20-7ddd-407a-8b22-8c6e552cd885 service nova] Creating event network-changed:bba702ac-b41d-4188-9510-3b36b88fbfb7 for instance 5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa on n-h2-862769-1 Oct 27 03:54:27.126539 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [req-8040bdd9-a931-410c-bd1b-a3c4aaf29081 req-06e75e20-7ddd-407a-8b22-8c6e552cd885 service nova] Instance 5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862769-1', 'n-h1-862769-1'} {{(pid=121000) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 03:54:27.138425 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-8040bdd9-a931-410c-bd1b-a3c4aaf29081 req-06e75e20-7ddd-407a-8b22-8c6e552cd885 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061848 Oct 27 03:54:27.139575 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2970/6227] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:54:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:54:28.096343 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-dc25d1c4-73c2-4f4b-aa64-6451a84129a1 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:54:28.098122 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-dc25d1c4-73c2-4f4b-aa64-6451a84129a1 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:54:28.112290 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dc25d1c4-73c2-4f4b-aa64-6451a84129a1 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:54:28.115808 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dc25d1c4-73c2-4f4b-aa64-6451a84129a1 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:54:28.116477 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dc25d1c4-73c2-4f4b-aa64-6451a84129a1 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:54:28.117880 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dc25d1c4-73c2-4f4b-aa64-6451a84129a1 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:54:28.119389 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dc25d1c4-73c2-4f4b-aa64-6451a84129a1 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:54:28.121604 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dc25d1c4-73c2-4f4b-aa64-6451a84129a1 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:54:28.488770 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-dc25d1c4-73c2-4f4b-aa64-6451a84129a1 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:54:28.497395 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-dc25d1c4-73c2-4f4b-aa64-6451a84129a1 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa" status: 200 len: 1695 microversion: 2.1 time: 0.405030 Oct 27 03:54:28.502935 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3258/6228] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:54:28 2022] GET /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa => generated 1695 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:54:29.536827 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4b38afb4-8439-4851-80c4-f94251675ef5 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:54:29.538244 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4b38afb4-8439-4851-80c4-f94251675ef5 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:54:29.555533 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4b38afb4-8439-4851-80c4-f94251675ef5 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:54:29.556422 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4b38afb4-8439-4851-80c4-f94251675ef5 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:54:29.557128 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4b38afb4-8439-4851-80c4-f94251675ef5 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:54:29.558251 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4b38afb4-8439-4851-80c4-f94251675ef5 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:54:29.561248 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4b38afb4-8439-4851-80c4-f94251675ef5 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:54:29.564950 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4b38afb4-8439-4851-80c4-f94251675ef5 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:54:30.017186 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4b38afb4-8439-4851-80c4-f94251675ef5 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:54:30.031949 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4b38afb4-8439-4851-80c4-f94251675ef5 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa" status: 200 len: 1695 microversion: 2.1 time: 0.494593 Oct 27 03:54:30.033225 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2971/6229] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:54:29 2022] GET /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa => generated 1695 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:54:31.063624 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-29968795-b30e-4d9f-bead-df1fa504f777 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:54:31.063624 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-29968795-b30e-4d9f-bead-df1fa504f777 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:54:31.084851 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-29968795-b30e-4d9f-bead-df1fa504f777 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:54:31.088513 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-29968795-b30e-4d9f-bead-df1fa504f777 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:54:31.089321 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-29968795-b30e-4d9f-bead-df1fa504f777 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:54:31.090897 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-29968795-b30e-4d9f-bead-df1fa504f777 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:54:31.092713 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-29968795-b30e-4d9f-bead-df1fa504f777 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:54:31.094520 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-29968795-b30e-4d9f-bead-df1fa504f777 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:54:32.058241 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-29968795-b30e-4d9f-bead-df1fa504f777 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:54:32.069012 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-29968795-b30e-4d9f-bead-df1fa504f777 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa" status: 200 len: 1692 microversion: 2.1 time: 1.013725 Oct 27 03:54:32.073798 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3259/6230] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:54:31 2022] GET /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa => generated 1692 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:54:32.102619 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-930263fc-953d-423d-94dc-1fc53d749707 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:54:32.104016 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-930263fc-953d-423d-94dc-1fc53d749707 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:54:32.137896 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-930263fc-953d-423d-94dc-1fc53d749707 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:54:32.145507 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-930263fc-953d-423d-94dc-1fc53d749707 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:54:32.153941 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-930263fc-953d-423d-94dc-1fc53d749707 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:54:32.154431 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-930263fc-953d-423d-94dc-1fc53d749707 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:54:32.155396 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-930263fc-953d-423d-94dc-1fc53d749707 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:54:32.162505 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-930263fc-953d-423d-94dc-1fc53d749707 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:54:32.483526 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-930263fc-953d-423d-94dc-1fc53d749707 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "POST /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa/action" status: 204 len: 0 microversion: 2.1 time: 0.385376 Oct 27 03:54:32.485944 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2972/6231] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:54:32 2022] POST /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa/action => generated 0 bytes in 387 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:54:32.494165 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-24366a17-c687-4265-9e43-1cd4542ecba6 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:54:32.494954 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-24366a17-c687-4265-9e43-1cd4542ecba6 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:54:32.498816 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=29 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:54:32.524141 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-24366a17-c687-4265-9e43-1cd4542ecba6 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:54:32.524793 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-24366a17-c687-4265-9e43-1cd4542ecba6 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:54:32.526721 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-24366a17-c687-4265-9e43-1cd4542ecba6 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:54:32.528737 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-24366a17-c687-4265-9e43-1cd4542ecba6 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:54:32.530565 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-24366a17-c687-4265-9e43-1cd4542ecba6 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:54:32.531241 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-24366a17-c687-4265-9e43-1cd4542ecba6 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:54:32.542589 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:54:33.580642 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-24366a17-c687-4265-9e43-1cd4542ecba6 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:54:33.589790 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-24366a17-c687-4265-9e43-1cd4542ecba6 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa" status: 200 len: 1692 microversion: 2.1 time: 1.101089 Oct 27 03:54:33.598849 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3260/6232] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:54:32 2022] GET /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa => generated 1692 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:54:34.632836 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-db729078-630d-4b6b-88f7-f65aecdf77a8 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:54:34.640333 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-db729078-630d-4b6b-88f7-f65aecdf77a8 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:54:34.643576 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=28 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:54:34.651690 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-db729078-630d-4b6b-88f7-f65aecdf77a8 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:54:34.652450 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-db729078-630d-4b6b-88f7-f65aecdf77a8 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:54:34.653114 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-db729078-630d-4b6b-88f7-f65aecdf77a8 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:54:34.654598 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-db729078-630d-4b6b-88f7-f65aecdf77a8 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:54:34.655320 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-db729078-630d-4b6b-88f7-f65aecdf77a8 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:54:34.656001 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-db729078-630d-4b6b-88f7-f65aecdf77a8 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:54:34.682496 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:54:34.903842 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-db729078-630d-4b6b-88f7-f65aecdf77a8 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:54:34.913166 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-db729078-630d-4b6b-88f7-f65aecdf77a8 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa" status: 200 len: 1692 microversion: 2.1 time: 0.285608 Oct 27 03:54:34.916990 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2973/6233] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:54:34 2022] GET /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa => generated 1692 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:54:34.984232 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-41f75a55-97eb-41b1-a101-41ed4cc206d0 req-b6a43d46-34b1-47b5-bfbd-f3c00c61331f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa", "name": "network-vif-plugged", "status": "completed", "tag": "bba702ac-b41d-4188-9510-3b36b88fbfb7"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:54:34.998005 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-41f75a55-97eb-41b1-a101-41ed4cc206d0 req-b6a43d46-34b1-47b5-bfbd-f3c00c61331f service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:54:34.998738 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-41f75a55-97eb-41b1-a101-41ed4cc206d0 req-b6a43d46-34b1-47b5-bfbd-f3c00c61331f service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:54:34.999404 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-41f75a55-97eb-41b1-a101-41ed4cc206d0 req-b6a43d46-34b1-47b5-bfbd-f3c00c61331f service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:54:35.016416 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-41f75a55-97eb-41b1-a101-41ed4cc206d0 req-b6a43d46-34b1-47b5-bfbd-f3c00c61331f service nova] Creating event network-vif-plugged:bba702ac-b41d-4188-9510-3b36b88fbfb7 for instance 5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa on n-h2-862769-1 Oct 27 03:54:35.026974 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [req-41f75a55-97eb-41b1-a101-41ed4cc206d0 req-b6a43d46-34b1-47b5-bfbd-f3c00c61331f service nova] Instance 5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862769-1', 'n-h1-862769-1'} {{(pid=121001) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 03:54:35.047378 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-41f75a55-97eb-41b1-a101-41ed4cc206d0 req-b6a43d46-34b1-47b5-bfbd-f3c00c61331f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067208 Oct 27 03:54:35.053425 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3261/6234] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:54:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:54:35.941487 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e2a842a4-196c-42e8-8a77-e601df5dbceb tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:54:35.942911 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e2a842a4-196c-42e8-8a77-e601df5dbceb tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:54:35.955586 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e2a842a4-196c-42e8-8a77-e601df5dbceb tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:54:35.956314 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e2a842a4-196c-42e8-8a77-e601df5dbceb tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:54:35.958067 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e2a842a4-196c-42e8-8a77-e601df5dbceb tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:54:35.959181 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e2a842a4-196c-42e8-8a77-e601df5dbceb tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:54:35.965459 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e2a842a4-196c-42e8-8a77-e601df5dbceb tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:54:35.966738 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e2a842a4-196c-42e8-8a77-e601df5dbceb tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:54:36.494776 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e2a842a4-196c-42e8-8a77-e601df5dbceb tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:54:36.513763 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e2a842a4-196c-42e8-8a77-e601df5dbceb tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa" status: 200 len: 1692 microversion: 2.1 time: 0.573426 Oct 27 03:54:36.518314 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2974/6235] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:54:35 2022] GET /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa => generated 1692 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:54:37.537343 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a1f82d8b-4a56-4b18-95ed-44cbd3415505 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:54:37.538266 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a1f82d8b-4a56-4b18-95ed-44cbd3415505 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:54:37.571008 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a1f82d8b-4a56-4b18-95ed-44cbd3415505 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:54:37.571518 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a1f82d8b-4a56-4b18-95ed-44cbd3415505 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:54:37.571971 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a1f82d8b-4a56-4b18-95ed-44cbd3415505 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:54:37.572701 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a1f82d8b-4a56-4b18-95ed-44cbd3415505 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:54:37.573167 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a1f82d8b-4a56-4b18-95ed-44cbd3415505 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:54:37.573601 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a1f82d8b-4a56-4b18-95ed-44cbd3415505 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:54:37.916515 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a1f82d8b-4a56-4b18-95ed-44cbd3415505 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:54:37.938117 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a1f82d8b-4a56-4b18-95ed-44cbd3415505 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa" status: 200 len: 1684 microversion: 2.1 time: 0.405507 Oct 27 03:54:37.955403 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3262/6236] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:54:37 2022] GET /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa => generated 1684 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:54:54.284558 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-331a9d8e-732b-42a7-8a56-9463fd6d014d tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:54:54.287786 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-331a9d8e-732b-42a7-8a56-9463fd6d014d tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:54:54.296457 n-d-862769-1 devstack@n-api.service[121000]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 03:54:54.300761 n-d-862769-1 devstack@n-api.service[121000]: Thu Oct 27 03:54:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa/action (ip 10.222.0.20) !!! Oct 27 03:54:54.307432 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=3 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:54:54.336543 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-331a9d8e-732b-42a7-8a56-9463fd6d014d tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:54:54.337278 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-331a9d8e-732b-42a7-8a56-9463fd6d014d tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:54:54.337881 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-331a9d8e-732b-42a7-8a56-9463fd6d014d tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:54:54.338554 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-331a9d8e-732b-42a7-8a56-9463fd6d014d tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:54:54.341185 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-331a9d8e-732b-42a7-8a56-9463fd6d014d tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:54:54.353205 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-331a9d8e-732b-42a7-8a56-9463fd6d014d tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:54:54.525354 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-331a9d8e-732b-42a7-8a56-9463fd6d014d tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "POST /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa/action" status: 200 len: 24572 microversion: 2.1 time: 0.254304 Oct 27 03:54:54.526787 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2975/6237] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:54:54 2022] POST /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa/action => generated 24572 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 03:55:00.805134 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a0e34704-72da-4592-a58d-9168cc3d4357 tempest-TestNetworkAdvancedServerOps-1624832099 tempest-TestNetworkAdvancedServerOps-1624832099-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:55:00.805820 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a0e34704-72da-4592-a58d-9168cc3d4357 tempest-TestNetworkAdvancedServerOps-1624832099 tempest-TestNetworkAdvancedServerOps-1624832099-project-admin] [instance: 5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:55:00.809177 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=5 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:55:00.809900 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=15 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:55:00.831443 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a0e34704-72da-4592-a58d-9168cc3d4357 tempest-TestNetworkAdvancedServerOps-1624832099 tempest-TestNetworkAdvancedServerOps-1624832099-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:55:00.831986 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a0e34704-72da-4592-a58d-9168cc3d4357 tempest-TestNetworkAdvancedServerOps-1624832099 tempest-TestNetworkAdvancedServerOps-1624832099-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:55:00.836725 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a0e34704-72da-4592-a58d-9168cc3d4357 tempest-TestNetworkAdvancedServerOps-1624832099 tempest-TestNetworkAdvancedServerOps-1624832099-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:55:00.838746 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a0e34704-72da-4592-a58d-9168cc3d4357 tempest-TestNetworkAdvancedServerOps-1624832099 tempest-TestNetworkAdvancedServerOps-1624832099-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:55:00.841548 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a0e34704-72da-4592-a58d-9168cc3d4357 tempest-TestNetworkAdvancedServerOps-1624832099 tempest-TestNetworkAdvancedServerOps-1624832099-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:55:00.841548 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a0e34704-72da-4592-a58d-9168cc3d4357 tempest-TestNetworkAdvancedServerOps-1624832099 tempest-TestNetworkAdvancedServerOps-1624832099-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:55:01.230856 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a0e34704-72da-4592-a58d-9168cc3d4357 tempest-TestNetworkAdvancedServerOps-1624832099 tempest-TestNetworkAdvancedServerOps-1624832099-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa" status: 200 len: 1835 microversion: 2.1 time: 0.430077 Oct 27 03:55:01.233412 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3263/6238] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:55:00 2022] GET /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa => generated 1835 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:55:03.354138 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1d7b131d-6b14-4a1a-bebc-f46476a1bb8a tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:55:03.355476 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1d7b131d-6b14-4a1a-bebc-f46476a1bb8a tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:55:03.362196 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-2a38e3e3-35a8-4615-ba44-a06cca4ba942 req-ac118e78-9610-44f9-ac51-ae91315a79ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa", "tag": "bba702ac-b41d-4188-9510-3b36b88fbfb7"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:55:03.374700 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1d7b131d-6b14-4a1a-bebc-f46476a1bb8a tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:55:03.376319 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1d7b131d-6b14-4a1a-bebc-f46476a1bb8a tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:55:03.377929 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1d7b131d-6b14-4a1a-bebc-f46476a1bb8a tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:55:03.379112 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-2a38e3e3-35a8-4615-ba44-a06cca4ba942 req-ac118e78-9610-44f9-ac51-ae91315a79ca service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:55:03.382082 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1d7b131d-6b14-4a1a-bebc-f46476a1bb8a tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:55:03.383052 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-2a38e3e3-35a8-4615-ba44-a06cca4ba942 req-ac118e78-9610-44f9-ac51-ae91315a79ca service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:55:03.383769 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-2a38e3e3-35a8-4615-ba44-a06cca4ba942 req-ac118e78-9610-44f9-ac51-ae91315a79ca service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:55:03.384481 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1d7b131d-6b14-4a1a-bebc-f46476a1bb8a tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:55:03.387233 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1d7b131d-6b14-4a1a-bebc-f46476a1bb8a tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:55:03.433718 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-2a38e3e3-35a8-4615-ba44-a06cca4ba942 req-ac118e78-9610-44f9-ac51-ae91315a79ca service nova] Creating event network-changed:bba702ac-b41d-4188-9510-3b36b88fbfb7 for instance 5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa on n-h2-862769-1 Oct 27 03:55:03.448240 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-2a38e3e3-35a8-4615-ba44-a06cca4ba942 req-ac118e78-9610-44f9-ac51-ae91315a79ca service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091641 Oct 27 03:55:03.455192 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3264/6239] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:55:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 27 03:55:03.505195 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1d7b131d-6b14-4a1a-bebc-f46476a1bb8a tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa] Going to try to terminate instance {{(pid=121000) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:55:03.951718 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1d7b131d-6b14-4a1a-bebc-f46476a1bb8a tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa" status: 204 len: 0 microversion: 2.1 time: 0.599056 Oct 27 03:55:03.953796 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2976/6240] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:55:03 2022] DELETE /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa => generated 0 bytes in 606 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:55:03.963280 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-866c5827-1c32-442d-b67f-3d380509a29a tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:55:03.964337 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-866c5827-1c32-442d-b67f-3d380509a29a tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:55:03.972753 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-866c5827-1c32-442d-b67f-3d380509a29a tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:55:03.973536 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-866c5827-1c32-442d-b67f-3d380509a29a tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:55:03.974363 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-866c5827-1c32-442d-b67f-3d380509a29a tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:55:03.975422 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-866c5827-1c32-442d-b67f-3d380509a29a tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:55:03.976306 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-866c5827-1c32-442d-b67f-3d380509a29a tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:55:03.976945 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-866c5827-1c32-442d-b67f-3d380509a29a tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:55:04.312981 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-866c5827-1c32-442d-b67f-3d380509a29a tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:55:04.319513 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-866c5827-1c32-442d-b67f-3d380509a29a tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa" status: 200 len: 1690 microversion: 2.1 time: 0.360965 Oct 27 03:55:04.320103 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3265/6241] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:55:03 2022] GET /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa => generated 1690 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:55:05.354773 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-dc5cf2e4-f2c8-4c8c-a881-46622f04514a tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:55:05.355667 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-dc5cf2e4-f2c8-4c8c-a881-46622f04514a tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:55:05.369247 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dc5cf2e4-f2c8-4c8c-a881-46622f04514a tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:55:05.373875 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dc5cf2e4-f2c8-4c8c-a881-46622f04514a tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:55:05.374704 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dc5cf2e4-f2c8-4c8c-a881-46622f04514a tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:55:05.376272 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dc5cf2e4-f2c8-4c8c-a881-46622f04514a tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:55:05.376984 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dc5cf2e4-f2c8-4c8c-a881-46622f04514a tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:55:05.382059 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dc5cf2e4-f2c8-4c8c-a881-46622f04514a tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:55:06.176986 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-dc5cf2e4-f2c8-4c8c-a881-46622f04514a tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:55:06.190559 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-dc5cf2e4-f2c8-4c8c-a881-46622f04514a tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa" status: 200 len: 1572 microversion: 2.1 time: 0.835626 Oct 27 03:55:06.191149 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2977/6242] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:55:05 2022] GET /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa => generated 1572 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:55:07.215194 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-34bf00d2-b977-4537-b954-fcbbbb047e3a tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:55:07.217197 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-34bf00d2-b977-4537-b954-fcbbbb047e3a tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:55:07.238755 n-d-862769-1 devstack@n-api.service[121001]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 03:55:07.239187 n-d-862769-1 devstack@n-api.service[121001]: Thu Oct 27 03:55:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa (ip 10.222.0.20) !!! Oct 27 03:55:07.241247 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-34bf00d2-b977-4537-b954-fcbbbb047e3a tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:55:07.247015 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-34bf00d2-b977-4537-b954-fcbbbb047e3a tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:55:07.248054 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-34bf00d2-b977-4537-b954-fcbbbb047e3a tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:55:07.255154 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-34bf00d2-b977-4537-b954-fcbbbb047e3a tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:55:07.255154 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-34bf00d2-b977-4537-b954-fcbbbb047e3a tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:55:07.255154 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-34bf00d2-b977-4537-b954-fcbbbb047e3a tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:55:07.453789 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-34bf00d2-b977-4537-b954-fcbbbb047e3a tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:55:07.471498 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-34bf00d2-b977-4537-b954-fcbbbb047e3a tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa" status: 200 len: 1504 microversion: 2.1 time: 0.251345 Oct 27 03:55:07.474121 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3266/6243] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:55:07 2022] GET /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa => generated 1504 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:55:07.892042 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-3e24549f-6976-495d-97d4-cd5d403165b5 req-1912eba1-ab98-4169-815b-a139f5bb43e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa", "name": "network-vif-deleted", "tag": "bba702ac-b41d-4188-9510-3b36b88fbfb7"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:55:07.910784 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-3e24549f-6976-495d-97d4-cd5d403165b5 req-1912eba1-ab98-4169-815b-a139f5bb43e1 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:55:07.917937 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-3e24549f-6976-495d-97d4-cd5d403165b5 req-1912eba1-ab98-4169-815b-a139f5bb43e1 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:55:07.918682 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-3e24549f-6976-495d-97d4-cd5d403165b5 req-1912eba1-ab98-4169-815b-a139f5bb43e1 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:55:07.946385 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-3e24549f-6976-495d-97d4-cd5d403165b5 req-1912eba1-ab98-4169-815b-a139f5bb43e1 service nova] Creating event network-vif-deleted:bba702ac-b41d-4188-9510-3b36b88fbfb7 for instance 5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa on n-h2-862769-1 Oct 27 03:55:07.965133 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-3e24549f-6976-495d-97d4-cd5d403165b5 req-1912eba1-ab98-4169-815b-a139f5bb43e1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.579981 Oct 27 03:55:07.966335 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2978/6244] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:55:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:55:08.506668 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a690bb05-4616-4d36-bf82-d6567a0f47fb tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:55:08.507610 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a690bb05-4616-4d36-bf82-d6567a0f47fb tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:55:08.533096 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a690bb05-4616-4d36-bf82-d6567a0f47fb tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:55:08.536111 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a690bb05-4616-4d36-bf82-d6567a0f47fb tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:55:08.538799 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a690bb05-4616-4d36-bf82-d6567a0f47fb tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:55:08.540853 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a690bb05-4616-4d36-bf82-d6567a0f47fb tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:55:08.543204 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a690bb05-4616-4d36-bf82-d6567a0f47fb tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:55:08.548609 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a690bb05-4616-4d36-bf82-d6567a0f47fb tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:55:08.611315 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-a690bb05-4616-4d36-bf82-d6567a0f47fb tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] HTTP exception thrown: Instance 5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa could not be found. Oct 27 03:55:08.619240 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a690bb05-4616-4d36-bf82-d6567a0f47fb tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Request method failure captured: Oct 27 03:55:08.619240 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa HTTP/1.1 Oct 27 03:55:08.619240 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:55:08.619240 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:55:08.619240 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:55:08.619240 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:55:08.619240 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:55:08.619240 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:55:08.619240 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:55:08.619240 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:55:08.619240 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWgCBfAAwg6CX6jDfTtZPKjU4IWrIPYNtoTX74Z0294jlmpA1hscNVPpQCZKJL8OTT0mEifdIsaGagx_vQ0B8uGp3mqvS5WXv14Q21L8zoEIglWon1GOJtZ7gJgUVC645n40NoZhGr_naOfvzanpfLwOaaEk7i8HP5LshJWpyWvY3Sp0 Oct 27 03:55:08.619240 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:55:08.619240 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:55:08.619240 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:55:08.619240 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:55:08.619240 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:55:08.619240 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:55:08.619240 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: a432dda4903145278d79210121b3f77d Oct 27 03:55:08.619240 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-505113127 Oct 27 03:55:08.619240 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:55:08.619240 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:55:08.619240 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a432dda4903145278d79210121b3f77d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a432dda4903145278d79210121b3f77d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a432dda4903145278d79210121b3f77d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a432dda4903145278d79210121b3f77d"}]}] Oct 27 03:55:08.619240 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-TestNetworkAdvancedServerOps-505113127 Oct 27 03:55:08.619240 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: a432dda4903145278d79210121b3f77d Oct 27 03:55:08.619240 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-505113127 Oct 27 03:55:08.619240 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-TestNetworkAdvancedServerOps-505113127-project Oct 27 03:55:08.619240 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:55:08.619240 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:55:08.619240 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: a2ea55b400c24827a28e816ea2a225aa Oct 27 03:55:08.619240 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-TestNetworkAdvancedServerOps-505113127-project Oct 27 03:55:08.619240 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:55:08.619240 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa could not be found. Oct 27 03:55:08.619240 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa'} Oct 27 03:55:08.619240 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:55:08.619240 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:55:08.619240 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:55:08.619240 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:55:08.619240 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:55:08.619240 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:55:08.619240 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:55:08.619240 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:55:08.619240 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:55:08.619240 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:55:08.619240 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa could not be found. Oct 27 03:55:08.619240 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:55:08.619240 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:55:08.619240 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:55:08.619240 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:55:08.619240 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:55:08.619240 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:55:08.619240 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:55:08.619240 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:55:08.619240 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:55:08.619240 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:55:08.619240 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:55:08.619240 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:55:08.619240 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:55:08.619240 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:55:08.619240 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:55:08.619240 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:55:08.619240 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa could not be found. Oct 27 03:55:08.619240 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:55:08.619240 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:55:08.626373 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:55:08.626373 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:55:08.626373 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:55:08.626373 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:55:08.626373 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:55:08.626373 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:55:08.626373 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa could not be found. Oct 27 03:55:08.626373 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:55:08.632499 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a690bb05-4616-4d36-bf82-d6567a0f47fb tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Returning 404 to user: Instance 5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:55:08.636189 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a690bb05-4616-4d36-bf82-d6567a0f47fb tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa" status: 404 len: 111 microversion: 2.1 time: 0.135685 Oct 27 03:55:08.640224 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3267/6245] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:55:08 2022] GET /compute/v2.1/servers/5e7de317-3ab2-4e1f-83f7-9a6dad8dd5fa => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:55:17.482512 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d41ce084-49c2-4231-a08b-7b9f3d07af4e tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '.version_select at 0x7f7dd98468b0>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:55:17.634549 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d41ce084-49c2-4231-a08b-7b9f3d07af4e tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1286590270" status: 202 len: 0 microversion: 2.1 time: 0.159515 Oct 27 03:55:17.648419 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2979/6246] 10.222.0.20 () {58 vars in 1284 bytes} [Thu Oct 27 03:55:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1286590270 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:55:17.677309 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-90772691-aa7e-4bec-a307-81b37e8f6fb1 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Action: 'create', calling method: .version_select at 0x7f7dd95cdca0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1138222693", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGqJnqCJmGDonyrfgmceFaepU+nwAbNr4uuQ4W0Rxbkxa25H0nuM5jUCWsDwOHvy1rFIQfHFW6JZovLHpPqhteGzUkIxv82gqXjkw5k5twiglsYcoM31K8Rcy9MdCaQ1CQ=="}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:55:17.731489 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-90772691-aa7e-4bec-a307-81b37e8f6fb1 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Getting quotas for project a432dda4903145278d79210121b3f77d. Resources: {'key_pairs'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:55:17.761798 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-90772691-aa7e-4bec-a307-81b37e8f6fb1 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Getting quotas for user a2ea55b400c24827a28e816ea2a225aa and project a432dda4903145278d79210121b3f77d. Resources: {'key_pairs'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:55:17.917073 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-90772691-aa7e-4bec-a307-81b37e8f6fb1 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.246822 Oct 27 03:55:17.918050 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3268/6247] 10.222.0.20 () {60 vars in 1159 bytes} [Thu Oct 27 03:55:17 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:55:43.477182 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:55:43.478338 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:55:43.485886 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-442dc421-1bbc-4cb8-b708-d2d7d77f9cdd tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-822329887", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": [{"uuid": "9245dfde-97b2-4b41-b090-fd2427a39da6"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1138222693", "security_groups": [{"name": "tempest-secgroup-smoke-1750159141"}]}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:55:43.813134 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-442dc421-1bbc-4cb8-b708-d2d7d77f9cdd tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] validate_networks() for [('9245dfde-97b2-4b41-b090-fd2427a39da6', None, None, None, None, None)] {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:55:45.157985 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-442dc421-1bbc-4cb8-b708-d2d7d77f9cdd tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:55:45.159266 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-442dc421-1bbc-4cb8-b708-d2d7d77f9cdd tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:55:45.159924 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-442dc421-1bbc-4cb8-b708-d2d7d77f9cdd tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:55:45.160507 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-442dc421-1bbc-4cb8-b708-d2d7d77f9cdd tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:55:45.161467 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-442dc421-1bbc-4cb8-b708-d2d7d77f9cdd tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:55:45.207312 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-442dc421-1bbc-4cb8-b708-d2d7d77f9cdd tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:55:45.207832 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-442dc421-1bbc-4cb8-b708-d2d7d77f9cdd tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:55:45.213812 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-442dc421-1bbc-4cb8-b708-d2d7d77f9cdd tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:55:45.213812 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-442dc421-1bbc-4cb8-b708-d2d7d77f9cdd tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:55:45.213812 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-442dc421-1bbc-4cb8-b708-d2d7d77f9cdd tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:55:45.214281 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-442dc421-1bbc-4cb8-b708-d2d7d77f9cdd tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:55:45.256222 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-442dc421-1bbc-4cb8-b708-d2d7d77f9cdd tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Getting quotas for project a432dda4903145278d79210121b3f77d. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:55:45.269854 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-442dc421-1bbc-4cb8-b708-d2d7d77f9cdd tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Getting quotas for user a2ea55b400c24827a28e816ea2a225aa and project a432dda4903145278d79210121b3f77d. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:55:45.301498 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-442dc421-1bbc-4cb8-b708-d2d7d77f9cdd tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:55:45.306818 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-442dc421-1bbc-4cb8-b708-d2d7d77f9cdd tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 81aa9d61-7bd5-4e07-9101-e981526f00c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:55:45.788519 n-d-862769-1 devstack@n-api.service[121000]: ERROR oslo.messaging._drivers.impl_rabbit [None req-442dc421-1bbc-4cb8-b708-d2d7d77f9cdd tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [d1e0fee0-c007-4f4b-8cac-c2d0a8595428] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 27 03:55:46.799582 n-d-862769-1 devstack@n-api.service[121000]: INFO oslo.messaging._drivers.impl_rabbit [None req-442dc421-1bbc-4cb8-b708-d2d7d77f9cdd tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [d1e0fee0-c007-4f4b-8cac-c2d0a8595428] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 36674. Oct 27 03:55:46.804931 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-442dc421-1bbc-4cb8-b708-d2d7d77f9cdd tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.330839 Oct 27 03:55:46.813398 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2980/6248] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:55:43 2022] POST /compute/v2.1/servers => generated 406 bytes in 3340 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 03:55:46.818356 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d61abae8-2736-48be-93b0-254aff07dd4e tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:55:46.818980 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d61abae8-2736-48be-93b0-254aff07dd4e tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 81aa9d61-7bd5-4e07-9101-e981526f00c9] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:55:46.828902 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=22 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:55:46.837523 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=4 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:55:46.838616 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:55:47.038614 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d61abae8-2736-48be-93b0-254aff07dd4e tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:55:47.052741 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d61abae8-2736-48be-93b0-254aff07dd4e tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9" status: 200 len: 1266 microversion: 2.1 time: 0.231601 Oct 27 03:55:47.053546 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3269/6249] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:55:46 2022] GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9 => generated 1266 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:55:48.083281 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ab09f413-23d5-4777-93b3-f0b48042f278 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:55:48.083951 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ab09f413-23d5-4777-93b3-f0b48042f278 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 81aa9d61-7bd5-4e07-9101-e981526f00c9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:55:48.338710 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ab09f413-23d5-4777-93b3-f0b48042f278 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:55:48.347653 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ab09f413-23d5-4777-93b3-f0b48042f278 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9" status: 200 len: 1266 microversion: 2.1 time: 0.275492 Oct 27 03:55:48.369450 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2981/6250] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:55:48 2022] GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9 => generated 1266 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:55:49.413976 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d58bb61e-00f5-4c7b-9658-3e30e45a5403 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:55:49.414680 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d58bb61e-00f5-4c7b-9658-3e30e45a5403 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 81aa9d61-7bd5-4e07-9101-e981526f00c9] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:55:49.984570 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d58bb61e-00f5-4c7b-9658-3e30e45a5403 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:55:49.993814 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d58bb61e-00f5-4c7b-9658-3e30e45a5403 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9" status: 200 len: 1266 microversion: 2.1 time: 0.602183 Oct 27 03:55:50.016469 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3270/6251] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:55:49 2022] GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9 => generated 1266 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:55:51.044923 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9562a1b1-b260-4fa1-9e29-98a82b678cf7 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:55:51.045588 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9562a1b1-b260-4fa1-9e29-98a82b678cf7 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 81aa9d61-7bd5-4e07-9101-e981526f00c9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:55:51.495146 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9562a1b1-b260-4fa1-9e29-98a82b678cf7 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:55:51.526823 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9562a1b1-b260-4fa1-9e29-98a82b678cf7 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9" status: 200 len: 1266 microversion: 2.1 time: 0.486124 Oct 27 03:55:51.540336 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2982/6252] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:55:51 2022] GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9 => generated 1266 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:55:52.558079 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0297a788-2d76-49c9-884f-39146eac5c44 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:55:52.559398 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0297a788-2d76-49c9-884f-39146eac5c44 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 81aa9d61-7bd5-4e07-9101-e981526f00c9] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:55:52.580321 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0297a788-2d76-49c9-884f-39146eac5c44 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:55:52.583097 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0297a788-2d76-49c9-884f-39146eac5c44 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:55:52.583392 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0297a788-2d76-49c9-884f-39146eac5c44 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:55:52.584523 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0297a788-2d76-49c9-884f-39146eac5c44 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:55:52.586577 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0297a788-2d76-49c9-884f-39146eac5c44 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:55:52.588467 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0297a788-2d76-49c9-884f-39146eac5c44 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:55:52.763196 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0297a788-2d76-49c9-884f-39146eac5c44 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:55:52.778860 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0297a788-2d76-49c9-884f-39146eac5c44 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9" status: 200 len: 1270 microversion: 2.1 time: 0.223994 Oct 27 03:55:52.796475 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3271/6253] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:55:52 2022] GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9 => generated 1270 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:55:53.810909 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f5ea4147-227e-43dd-a3c0-29bef355abb3 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:55:53.812095 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f5ea4147-227e-43dd-a3c0-29bef355abb3 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 81aa9d61-7bd5-4e07-9101-e981526f00c9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:55:53.836401 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f5ea4147-227e-43dd-a3c0-29bef355abb3 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:55:53.838312 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f5ea4147-227e-43dd-a3c0-29bef355abb3 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:55:53.839756 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f5ea4147-227e-43dd-a3c0-29bef355abb3 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:55:53.843044 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f5ea4147-227e-43dd-a3c0-29bef355abb3 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:55:53.843736 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f5ea4147-227e-43dd-a3c0-29bef355abb3 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:55:53.844367 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f5ea4147-227e-43dd-a3c0-29bef355abb3 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:55:54.071613 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f5ea4147-227e-43dd-a3c0-29bef355abb3 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:55:54.081135 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f5ea4147-227e-43dd-a3c0-29bef355abb3 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9" status: 200 len: 1262 microversion: 2.1 time: 0.274016 Oct 27 03:55:54.081729 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2983/6254] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:55:53 2022] GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9 => generated 1262 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:55:55.107741 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-00f277bd-a68a-49e5-a78a-736964ade157 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:55:55.108955 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-00f277bd-a68a-49e5-a78a-736964ade157 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 81aa9d61-7bd5-4e07-9101-e981526f00c9] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:55:55.132821 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-00f277bd-a68a-49e5-a78a-736964ade157 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:55:55.133383 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-00f277bd-a68a-49e5-a78a-736964ade157 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:55:55.133849 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-00f277bd-a68a-49e5-a78a-736964ade157 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:55:55.138601 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-00f277bd-a68a-49e5-a78a-736964ade157 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:55:55.139737 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-00f277bd-a68a-49e5-a78a-736964ade157 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:55:55.140342 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-00f277bd-a68a-49e5-a78a-736964ade157 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:55:55.742748 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-00f277bd-a68a-49e5-a78a-736964ade157 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:55:55.755598 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-00f277bd-a68a-49e5-a78a-736964ade157 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9" status: 200 len: 1326 microversion: 2.1 time: 0.652046 Oct 27 03:55:55.758777 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3272/6255] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:55:55 2022] GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9 => generated 1326 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:55:56.782142 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-989c5ce3-856a-4663-ab3d-eb9bd69f42c6 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:55:56.782856 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-989c5ce3-856a-4663-ab3d-eb9bd69f42c6 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 81aa9d61-7bd5-4e07-9101-e981526f00c9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:55:56.792313 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:55:56.805752 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-989c5ce3-856a-4663-ab3d-eb9bd69f42c6 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:55:56.806357 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-989c5ce3-856a-4663-ab3d-eb9bd69f42c6 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:55:56.806822 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-989c5ce3-856a-4663-ab3d-eb9bd69f42c6 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:55:56.818723 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-989c5ce3-856a-4663-ab3d-eb9bd69f42c6 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:55:56.819235 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-989c5ce3-856a-4663-ab3d-eb9bd69f42c6 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:55:56.819702 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-989c5ce3-856a-4663-ab3d-eb9bd69f42c6 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:55:56.944038 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-989c5ce3-856a-4663-ab3d-eb9bd69f42c6 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:55:56.959796 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-989c5ce3-856a-4663-ab3d-eb9bd69f42c6 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9" status: 200 len: 1324 microversion: 2.1 time: 0.182098 Oct 27 03:55:56.962451 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2984/6256] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:55:56 2022] GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9 => generated 1324 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:55:57.987508 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-37baaa24-8e99-4f53-8a4f-4ed24c466278 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:55:57.988736 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-37baaa24-8e99-4f53-8a4f-4ed24c466278 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 81aa9d61-7bd5-4e07-9101-e981526f00c9] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:55:58.009596 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-37baaa24-8e99-4f53-8a4f-4ed24c466278 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:55:58.010940 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-37baaa24-8e99-4f53-8a4f-4ed24c466278 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:55:58.011976 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-37baaa24-8e99-4f53-8a4f-4ed24c466278 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:55:58.012919 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-37baaa24-8e99-4f53-8a4f-4ed24c466278 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:55:58.013622 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-37baaa24-8e99-4f53-8a4f-4ed24c466278 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:55:58.014787 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-37baaa24-8e99-4f53-8a4f-4ed24c466278 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:55:58.293835 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-37baaa24-8e99-4f53-8a4f-4ed24c466278 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:55:58.307871 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-37baaa24-8e99-4f53-8a4f-4ed24c466278 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9" status: 200 len: 1324 microversion: 2.1 time: 0.325341 Oct 27 03:55:58.318226 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3273/6257] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:55:57 2022] GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9 => generated 1324 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:55:59.346588 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5f6ff877-ba86-44be-b2c8-2e83dc10b471 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:55:59.349036 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5f6ff877-ba86-44be-b2c8-2e83dc10b471 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 81aa9d61-7bd5-4e07-9101-e981526f00c9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:55:59.368261 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5f6ff877-ba86-44be-b2c8-2e83dc10b471 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:55:59.369954 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5f6ff877-ba86-44be-b2c8-2e83dc10b471 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:55:59.373158 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5f6ff877-ba86-44be-b2c8-2e83dc10b471 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:55:59.374112 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5f6ff877-ba86-44be-b2c8-2e83dc10b471 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:55:59.375283 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5f6ff877-ba86-44be-b2c8-2e83dc10b471 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:55:59.376164 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5f6ff877-ba86-44be-b2c8-2e83dc10b471 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:56:00.082347 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5f6ff877-ba86-44be-b2c8-2e83dc10b471 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:56:00.093532 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5f6ff877-ba86-44be-b2c8-2e83dc10b471 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9" status: 200 len: 1392 microversion: 2.1 time: 0.760166 Oct 27 03:56:00.094167 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2985/6258] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:55:59 2022] GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9 => generated 1392 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:56:01.059989 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-7dc92eab-d0fa-4463-8c12-07fe63ae8a82 req-460e18ea-a385-4bc5-9b79-e8981a953ca3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81aa9d61-7bd5-4e07-9101-e981526f00c9", "tag": "e4aaef65-1861-4030-81f6-20ddb632987e"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:56:01.076630 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=4 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:56:01.097254 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-7dc92eab-d0fa-4463-8c12-07fe63ae8a82 req-460e18ea-a385-4bc5-9b79-e8981a953ca3 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:56:01.100398 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-7dc92eab-d0fa-4463-8c12-07fe63ae8a82 req-460e18ea-a385-4bc5-9b79-e8981a953ca3 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:56:01.102573 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-7dc92eab-d0fa-4463-8c12-07fe63ae8a82 req-460e18ea-a385-4bc5-9b79-e8981a953ca3 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:56:01.120878 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b7d3eeae-b7c5-42f4-b226-432b9e44bea6 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:56:01.121522 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b7d3eeae-b7c5-42f4-b226-432b9e44bea6 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 81aa9d61-7bd5-4e07-9101-e981526f00c9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:56:01.156323 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-7dc92eab-d0fa-4463-8c12-07fe63ae8a82 req-460e18ea-a385-4bc5-9b79-e8981a953ca3 service nova] Creating event network-changed:e4aaef65-1861-4030-81f6-20ddb632987e for instance 81aa9d61-7bd5-4e07-9101-e981526f00c9 on n-h1-862769-1 Oct 27 03:56:01.165172 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-7dc92eab-d0fa-4463-8c12-07fe63ae8a82 req-460e18ea-a385-4bc5-9b79-e8981a953ca3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111360 Oct 27 03:56:01.166332 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3274/6259] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:56:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:56:01.173137 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b7d3eeae-b7c5-42f4-b226-432b9e44bea6 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:56:01.174385 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b7d3eeae-b7c5-42f4-b226-432b9e44bea6 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:56:01.176138 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b7d3eeae-b7c5-42f4-b226-432b9e44bea6 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:56:01.177299 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b7d3eeae-b7c5-42f4-b226-432b9e44bea6 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:56:01.177729 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b7d3eeae-b7c5-42f4-b226-432b9e44bea6 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:56:01.179114 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b7d3eeae-b7c5-42f4-b226-432b9e44bea6 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:56:01.410143 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b7d3eeae-b7c5-42f4-b226-432b9e44bea6 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:56:01.422946 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b7d3eeae-b7c5-42f4-b226-432b9e44bea6 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9" status: 200 len: 1392 microversion: 2.1 time: 0.307250 Oct 27 03:56:01.424446 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2986/6260] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:56:01 2022] GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9 => generated 1392 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:56:02.461211 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-522a6da7-8bda-46e8-b668-33f996bd4643 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:56:02.462231 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-522a6da7-8bda-46e8-b668-33f996bd4643 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 81aa9d61-7bd5-4e07-9101-e981526f00c9] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:56:02.473453 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-522a6da7-8bda-46e8-b668-33f996bd4643 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:56:02.477800 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-522a6da7-8bda-46e8-b668-33f996bd4643 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:56:02.478923 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-522a6da7-8bda-46e8-b668-33f996bd4643 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:56:02.483232 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-522a6da7-8bda-46e8-b668-33f996bd4643 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:56:02.483971 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-522a6da7-8bda-46e8-b668-33f996bd4643 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:56:02.490751 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-522a6da7-8bda-46e8-b668-33f996bd4643 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:56:02.700219 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-522a6da7-8bda-46e8-b668-33f996bd4643 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:56:02.709205 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-522a6da7-8bda-46e8-b668-33f996bd4643 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9" status: 200 len: 1392 microversion: 2.1 time: 0.263516 Oct 27 03:56:02.709829 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3275/6261] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:56:02 2022] GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9 => generated 1392 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:56:03.734484 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8753cc2e-2faf-4900-8b6b-c3db2a7fe287 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:56:03.735123 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8753cc2e-2faf-4900-8b6b-c3db2a7fe287 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 81aa9d61-7bd5-4e07-9101-e981526f00c9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:56:03.737443 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=10 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:56:03.751202 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8753cc2e-2faf-4900-8b6b-c3db2a7fe287 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:56:03.751802 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8753cc2e-2faf-4900-8b6b-c3db2a7fe287 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:56:03.752272 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8753cc2e-2faf-4900-8b6b-c3db2a7fe287 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:56:03.753576 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8753cc2e-2faf-4900-8b6b-c3db2a7fe287 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:56:03.757210 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8753cc2e-2faf-4900-8b6b-c3db2a7fe287 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:56:03.757856 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8753cc2e-2faf-4900-8b6b-c3db2a7fe287 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:56:04.252252 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8753cc2e-2faf-4900-8b6b-c3db2a7fe287 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:56:04.263687 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8753cc2e-2faf-4900-8b6b-c3db2a7fe287 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9" status: 200 len: 1392 microversion: 2.1 time: 0.534602 Oct 27 03:56:04.264333 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2987/6262] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:56:03 2022] GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9 => generated 1392 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:56:05.292238 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3282ad69-9f0d-4c1f-98f7-39f287387302 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:56:05.294539 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3282ad69-9f0d-4c1f-98f7-39f287387302 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 81aa9d61-7bd5-4e07-9101-e981526f00c9] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:56:05.305200 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3282ad69-9f0d-4c1f-98f7-39f287387302 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:56:05.307115 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3282ad69-9f0d-4c1f-98f7-39f287387302 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:56:05.308416 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3282ad69-9f0d-4c1f-98f7-39f287387302 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:56:05.309603 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3282ad69-9f0d-4c1f-98f7-39f287387302 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:56:05.310265 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3282ad69-9f0d-4c1f-98f7-39f287387302 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:56:05.311691 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3282ad69-9f0d-4c1f-98f7-39f287387302 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:56:05.732141 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3282ad69-9f0d-4c1f-98f7-39f287387302 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:56:05.765420 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3282ad69-9f0d-4c1f-98f7-39f287387302 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9" status: 200 len: 1392 microversion: 2.1 time: 0.480280 Oct 27 03:56:05.769190 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3276/6263] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:56:05 2022] GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9 => generated 1392 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:56:06.794448 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-38b366db-9e8d-4678-872a-09e7ef70cd2d tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:56:06.797178 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-38b366db-9e8d-4678-872a-09e7ef70cd2d tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 81aa9d61-7bd5-4e07-9101-e981526f00c9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:56:06.807187 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-38b366db-9e8d-4678-872a-09e7ef70cd2d tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:56:06.807786 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-38b366db-9e8d-4678-872a-09e7ef70cd2d tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:56:06.808681 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-38b366db-9e8d-4678-872a-09e7ef70cd2d tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:56:06.809549 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-38b366db-9e8d-4678-872a-09e7ef70cd2d tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:56:06.810021 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-38b366db-9e8d-4678-872a-09e7ef70cd2d tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:56:06.810547 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-38b366db-9e8d-4678-872a-09e7ef70cd2d tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:56:07.013132 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-38b366db-9e8d-4678-872a-09e7ef70cd2d tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:56:07.030911 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-38b366db-9e8d-4678-872a-09e7ef70cd2d tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9" status: 200 len: 1392 microversion: 2.1 time: 0.241402 Oct 27 03:56:07.031552 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2988/6264] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:56:06 2022] GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9 => generated 1392 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:56:07.286258 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-6e820b21-a3ad-4a3b-b42e-f8317c088a7e req-34950fbb-94b5-4fec-a3ba-fa7c8ebc4377 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81aa9d61-7bd5-4e07-9101-e981526f00c9", "name": "network-vif-plugged", "status": "completed", "tag": "e4aaef65-1861-4030-81f6-20ddb632987e"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:56:07.301860 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-6e820b21-a3ad-4a3b-b42e-f8317c088a7e req-34950fbb-94b5-4fec-a3ba-fa7c8ebc4377 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:56:07.302559 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-6e820b21-a3ad-4a3b-b42e-f8317c088a7e req-34950fbb-94b5-4fec-a3ba-fa7c8ebc4377 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:56:07.303340 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-6e820b21-a3ad-4a3b-b42e-f8317c088a7e req-34950fbb-94b5-4fec-a3ba-fa7c8ebc4377 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:56:07.322565 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-6e820b21-a3ad-4a3b-b42e-f8317c088a7e req-34950fbb-94b5-4fec-a3ba-fa7c8ebc4377 service nova] Creating event network-vif-plugged:e4aaef65-1861-4030-81f6-20ddb632987e for instance 81aa9d61-7bd5-4e07-9101-e981526f00c9 on n-h1-862769-1 Oct 27 03:56:07.331461 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-6e820b21-a3ad-4a3b-b42e-f8317c088a7e req-34950fbb-94b5-4fec-a3ba-fa7c8ebc4377 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050124 Oct 27 03:56:07.334268 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3277/6265] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:56:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:56:08.060645 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-fdff9126-45a3-4807-8feb-b3daf1c6be26 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:56:08.062211 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-fdff9126-45a3-4807-8feb-b3daf1c6be26 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 81aa9d61-7bd5-4e07-9101-e981526f00c9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:56:08.071389 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fdff9126-45a3-4807-8feb-b3daf1c6be26 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:56:08.072232 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fdff9126-45a3-4807-8feb-b3daf1c6be26 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:56:08.072896 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fdff9126-45a3-4807-8feb-b3daf1c6be26 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:56:08.096590 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fdff9126-45a3-4807-8feb-b3daf1c6be26 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:56:08.098720 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fdff9126-45a3-4807-8feb-b3daf1c6be26 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:56:08.099372 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fdff9126-45a3-4807-8feb-b3daf1c6be26 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:56:08.339180 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-fdff9126-45a3-4807-8feb-b3daf1c6be26 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:56:08.365665 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-fdff9126-45a3-4807-8feb-b3daf1c6be26 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9" status: 200 len: 1392 microversion: 2.1 time: 0.310712 Oct 27 03:56:08.367243 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2989/6266] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:56:08 2022] GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9 => generated 1392 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:56:09.393174 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-db3c4145-3092-4da1-80b0-2798f0c932b0 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:56:09.394195 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-db3c4145-3092-4da1-80b0-2798f0c932b0 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 81aa9d61-7bd5-4e07-9101-e981526f00c9] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:56:09.408838 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-db3c4145-3092-4da1-80b0-2798f0c932b0 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:56:09.412982 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-db3c4145-3092-4da1-80b0-2798f0c932b0 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:56:09.413501 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-db3c4145-3092-4da1-80b0-2798f0c932b0 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:56:09.414815 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-db3c4145-3092-4da1-80b0-2798f0c932b0 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:56:09.417484 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-db3c4145-3092-4da1-80b0-2798f0c932b0 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:56:09.418904 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-db3c4145-3092-4da1-80b0-2798f0c932b0 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:56:09.822052 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-db3c4145-3092-4da1-80b0-2798f0c932b0 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:56:09.833421 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-db3c4145-3092-4da1-80b0-2798f0c932b0 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9" status: 200 len: 1564 microversion: 2.1 time: 0.448002 Oct 27 03:56:09.834353 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3278/6267] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:56:09 2022] GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9 => generated 1564 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:56:09.866074 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-719fe2d5-0fa1-401b-b5a8-6839bea6a52d tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:56:09.867379 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-719fe2d5-0fa1-401b-b5a8-6839bea6a52d tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 81aa9d61-7bd5-4e07-9101-e981526f00c9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:56:09.885848 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-719fe2d5-0fa1-401b-b5a8-6839bea6a52d tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:56:09.885848 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-719fe2d5-0fa1-401b-b5a8-6839bea6a52d tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:56:09.885848 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-719fe2d5-0fa1-401b-b5a8-6839bea6a52d tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:56:09.885848 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-719fe2d5-0fa1-401b-b5a8-6839bea6a52d tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:56:09.885848 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-719fe2d5-0fa1-401b-b5a8-6839bea6a52d tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:56:09.885848 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-719fe2d5-0fa1-401b-b5a8-6839bea6a52d tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:56:10.714289 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-719fe2d5-0fa1-401b-b5a8-6839bea6a52d tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:56:10.724406 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-719fe2d5-0fa1-401b-b5a8-6839bea6a52d tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9" status: 200 len: 1564 microversion: 2.1 time: 0.863012 Oct 27 03:56:10.725006 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2990/6268] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:56:09 2022] GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9 => generated 1564 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:56:15.974872 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d526f1c3-83cd-45d9-a8a3-ba8f45b6375c tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:56:15.975510 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d526f1c3-83cd-45d9-a8a3-ba8f45b6375c tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 81aa9d61-7bd5-4e07-9101-e981526f00c9] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:56:15.992023 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d526f1c3-83cd-45d9-a8a3-ba8f45b6375c tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:56:15.996477 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d526f1c3-83cd-45d9-a8a3-ba8f45b6375c tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:56:16.001745 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d526f1c3-83cd-45d9-a8a3-ba8f45b6375c tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:56:16.002728 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d526f1c3-83cd-45d9-a8a3-ba8f45b6375c tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:56:16.011008 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-4bdd2f04-3344-4d05-aea5-647cc28c3778 req-7b9b1a9e-d919-4aef-992f-ae0483e6eb80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81aa9d61-7bd5-4e07-9101-e981526f00c9", "tag": "e4aaef65-1861-4030-81f6-20ddb632987e"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:56:16.018437 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d526f1c3-83cd-45d9-a8a3-ba8f45b6375c tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:56:16.022755 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d526f1c3-83cd-45d9-a8a3-ba8f45b6375c tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:56:16.057073 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:56:16.066262 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-4bdd2f04-3344-4d05-aea5-647cc28c3778 req-7b9b1a9e-d919-4aef-992f-ae0483e6eb80 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:56:16.067571 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-4bdd2f04-3344-4d05-aea5-647cc28c3778 req-7b9b1a9e-d919-4aef-992f-ae0483e6eb80 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:56:16.068584 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-4bdd2f04-3344-4d05-aea5-647cc28c3778 req-7b9b1a9e-d919-4aef-992f-ae0483e6eb80 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:56:16.079579 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=51 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:56:16.099908 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-4bdd2f04-3344-4d05-aea5-647cc28c3778 req-7b9b1a9e-d919-4aef-992f-ae0483e6eb80 service nova] Creating event network-changed:e4aaef65-1861-4030-81f6-20ddb632987e for instance 81aa9d61-7bd5-4e07-9101-e981526f00c9 on n-h1-862769-1 Oct 27 03:56:16.111060 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-4bdd2f04-3344-4d05-aea5-647cc28c3778 req-7b9b1a9e-d919-4aef-992f-ae0483e6eb80 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105297 Oct 27 03:56:16.112310 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2991/6269] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:56:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:56:16.386803 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d526f1c3-83cd-45d9-a8a3-ba8f45b6375c tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:56:16.396759 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d526f1c3-83cd-45d9-a8a3-ba8f45b6375c tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9" status: 200 len: 1564 microversion: 2.1 time: 0.425914 Oct 27 03:56:16.400516 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3279/6270] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:56:15 2022] GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9 => generated 1564 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:56:36.306676 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1f1ddb8e-576e-4efe-b2c2-2ac4c36355ee tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:56:36.311038 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1f1ddb8e-576e-4efe-b2c2-2ac4c36355ee tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 81aa9d61-7bd5-4e07-9101-e981526f00c9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:56:36.319908 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1f1ddb8e-576e-4efe-b2c2-2ac4c36355ee tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:56:36.320427 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1f1ddb8e-576e-4efe-b2c2-2ac4c36355ee tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:56:36.320878 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1f1ddb8e-576e-4efe-b2c2-2ac4c36355ee tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:56:36.321605 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1f1ddb8e-576e-4efe-b2c2-2ac4c36355ee tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:56:36.328626 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1f1ddb8e-576e-4efe-b2c2-2ac4c36355ee tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:56:36.328626 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1f1ddb8e-576e-4efe-b2c2-2ac4c36355ee tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:56:36.379619 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1f1ddb8e-576e-4efe-b2c2-2ac4c36355ee tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "POST /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9/action" status: 200 len: 24561 microversion: 2.1 time: 0.079432 Oct 27 03:56:36.388245 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2992/6271] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:56:36 2022] POST /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9/action => generated 24561 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 03:56:47.464859 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a36083af-912f-42ec-85bc-76c82dbcc995 tempest-TestNetworkAdvancedServerOps-1624832099 tempest-TestNetworkAdvancedServerOps-1624832099-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:56:47.465494 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a36083af-912f-42ec-85bc-76c82dbcc995 tempest-TestNetworkAdvancedServerOps-1624832099 tempest-TestNetworkAdvancedServerOps-1624832099-project-admin] [instance: 81aa9d61-7bd5-4e07-9101-e981526f00c9] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:56:47.472743 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=26 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:56:47.473805 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=46 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:56:47.480097 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a36083af-912f-42ec-85bc-76c82dbcc995 tempest-TestNetworkAdvancedServerOps-1624832099 tempest-TestNetworkAdvancedServerOps-1624832099-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:56:47.480097 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a36083af-912f-42ec-85bc-76c82dbcc995 tempest-TestNetworkAdvancedServerOps-1624832099 tempest-TestNetworkAdvancedServerOps-1624832099-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:56:47.480097 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a36083af-912f-42ec-85bc-76c82dbcc995 tempest-TestNetworkAdvancedServerOps-1624832099 tempest-TestNetworkAdvancedServerOps-1624832099-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:56:47.480097 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a36083af-912f-42ec-85bc-76c82dbcc995 tempest-TestNetworkAdvancedServerOps-1624832099 tempest-TestNetworkAdvancedServerOps-1624832099-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:56:47.480097 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a36083af-912f-42ec-85bc-76c82dbcc995 tempest-TestNetworkAdvancedServerOps-1624832099 tempest-TestNetworkAdvancedServerOps-1624832099-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:56:47.480097 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a36083af-912f-42ec-85bc-76c82dbcc995 tempest-TestNetworkAdvancedServerOps-1624832099 tempest-TestNetworkAdvancedServerOps-1624832099-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:56:48.261801 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a36083af-912f-42ec-85bc-76c82dbcc995 tempest-TestNetworkAdvancedServerOps-1624832099 tempest-TestNetworkAdvancedServerOps-1624832099-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9" status: 200 len: 1834 microversion: 2.1 time: 0.800442 Oct 27 03:56:48.263285 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3280/6272] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:56:47 2022] GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9 => generated 1834 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:56:48.289760 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1d652f7e-8148-4d66-837a-f5d5312b64aa tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:56:48.290447 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1d652f7e-8148-4d66-837a-f5d5312b64aa tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 81aa9d61-7bd5-4e07-9101-e981526f00c9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:56:48.302742 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=5 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:56:48.315936 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1d652f7e-8148-4d66-837a-f5d5312b64aa tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:56:48.320744 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1d652f7e-8148-4d66-837a-f5d5312b64aa tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:56:48.331074 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1d652f7e-8148-4d66-837a-f5d5312b64aa tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:56:48.332276 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1d652f7e-8148-4d66-837a-f5d5312b64aa tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:56:48.336776 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1d652f7e-8148-4d66-837a-f5d5312b64aa tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:56:48.337635 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1d652f7e-8148-4d66-837a-f5d5312b64aa tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:56:48.738415 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1d652f7e-8148-4d66-837a-f5d5312b64aa tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:56:48.757178 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1d652f7e-8148-4d66-837a-f5d5312b64aa tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9" status: 200 len: 1683 microversion: 2.1 time: 0.472460 Oct 27 03:56:48.758762 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2993/6273] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:56:48 2022] GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9 => generated 1683 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:56:48.959967 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d1d656db-7677-4ecd-980f-f14e7a32f728 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:56:48.963107 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d1d656db-7677-4ecd-980f-f14e7a32f728 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 81aa9d61-7bd5-4e07-9101-e981526f00c9] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:56:48.980443 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d1d656db-7677-4ecd-980f-f14e7a32f728 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:56:48.981091 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d1d656db-7677-4ecd-980f-f14e7a32f728 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:56:48.981561 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d1d656db-7677-4ecd-980f-f14e7a32f728 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:56:48.982344 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d1d656db-7677-4ecd-980f-f14e7a32f728 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:56:48.986362 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d1d656db-7677-4ecd-980f-f14e7a32f728 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:56:48.986870 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d1d656db-7677-4ecd-980f-f14e7a32f728 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:56:49.064872 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d1d656db-7677-4ecd-980f-f14e7a32f728 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "POST /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9/action" status: 200 len: 32636 microversion: 2.1 time: 0.109853 Oct 27 03:56:49.066483 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3281/6274] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:56:48 2022] POST /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9/action => generated 32636 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 03:56:49.242215 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-51c3b40f-23cc-453f-acd4-611987b1669d tempest-TestNetworkAdvancedServerOps-1624832099 tempest-TestNetworkAdvancedServerOps-1624832099-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:56:49.243972 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-51c3b40f-23cc-453f-acd4-611987b1669d tempest-TestNetworkAdvancedServerOps-1624832099 tempest-TestNetworkAdvancedServerOps-1624832099-project-admin] [instance: 81aa9d61-7bd5-4e07-9101-e981526f00c9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:56:49.259164 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-51c3b40f-23cc-453f-acd4-611987b1669d tempest-TestNetworkAdvancedServerOps-1624832099 tempest-TestNetworkAdvancedServerOps-1624832099-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:56:49.259925 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-51c3b40f-23cc-453f-acd4-611987b1669d tempest-TestNetworkAdvancedServerOps-1624832099 tempest-TestNetworkAdvancedServerOps-1624832099-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:56:49.260542 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-51c3b40f-23cc-453f-acd4-611987b1669d tempest-TestNetworkAdvancedServerOps-1624832099 tempest-TestNetworkAdvancedServerOps-1624832099-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:56:49.261461 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-51c3b40f-23cc-453f-acd4-611987b1669d tempest-TestNetworkAdvancedServerOps-1624832099 tempest-TestNetworkAdvancedServerOps-1624832099-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:56:49.262166 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-51c3b40f-23cc-453f-acd4-611987b1669d tempest-TestNetworkAdvancedServerOps-1624832099 tempest-TestNetworkAdvancedServerOps-1624832099-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:56:49.262808 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-51c3b40f-23cc-453f-acd4-611987b1669d tempest-TestNetworkAdvancedServerOps-1624832099 tempest-TestNetworkAdvancedServerOps-1624832099-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:56:49.600714 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-51c3b40f-23cc-453f-acd4-611987b1669d tempest-TestNetworkAdvancedServerOps-1624832099 tempest-TestNetworkAdvancedServerOps-1624832099-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'b4c62e547884403f8f5f4820a845c757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9151e0cac8482384bd1629d6227841', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:56:49.606095 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-51c3b40f-23cc-453f-acd4-611987b1669d tempest-TestNetworkAdvancedServerOps-1624832099 tempest-TestNetworkAdvancedServerOps-1624832099-project-admin] [instance: 81aa9d61-7bd5-4e07-9101-e981526f00c9] flavor_id is None. Assuming migration. {{(pid=121000) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 27 03:56:49.606095 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-51c3b40f-23cc-453f-acd4-611987b1669d tempest-TestNetworkAdvancedServerOps-1624832099 tempest-TestNetworkAdvancedServerOps-1624832099-project-admin] [instance: 81aa9d61-7bd5-4e07-9101-e981526f00c9] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=121000) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 27 03:56:50.327404 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-51c3b40f-23cc-453f-acd4-611987b1669d tempest-TestNetworkAdvancedServerOps-1624832099 tempest-TestNetworkAdvancedServerOps-1624832099-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9/action" status: 202 len: 0 microversion: 2.1 time: 1.089177 Oct 27 03:56:50.339836 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2994/6275] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:56:49 2022] POST /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9/action => generated 0 bytes in 1102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:56:50.343494 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-bca75a80-d76c-4212-979b-72557092c9c5 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:56:50.344230 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-bca75a80-d76c-4212-979b-72557092c9c5 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 81aa9d61-7bd5-4e07-9101-e981526f00c9] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:56:50.397065 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bca75a80-d76c-4212-979b-72557092c9c5 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:56:50.415019 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bca75a80-d76c-4212-979b-72557092c9c5 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:56:50.418910 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bca75a80-d76c-4212-979b-72557092c9c5 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:56:50.424264 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bca75a80-d76c-4212-979b-72557092c9c5 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:56:50.427504 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bca75a80-d76c-4212-979b-72557092c9c5 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:56:50.428172 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bca75a80-d76c-4212-979b-72557092c9c5 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:56:50.872179 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-bca75a80-d76c-4212-979b-72557092c9c5 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:56:50.884617 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-bca75a80-d76c-4212-979b-72557092c9c5 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9" status: 200 len: 1692 microversion: 2.1 time: 0.546163 Oct 27 03:56:50.898614 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3282/6276] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:56:50 2022] GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9 => generated 1692 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:56:51.521506 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9209176a-5321-49ac-8042-527e541f0cbb tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-3826106", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": [{"uuid": "9f4ec41f-9897-4836-8bd7-240101313484"}]}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:56:51.588192 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-9209176a-5321-49ac-8042-527e541f0cbb tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] validate_networks() for [('9f4ec41f-9897-4836-8bd7-240101313484', None, None, None, None, None)] {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:56:51.944662 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-63c1bcf7-30fa-4670-b8d7-6668773c7cdd tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:56:51.944662 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-63c1bcf7-30fa-4670-b8d7-6668773c7cdd tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 81aa9d61-7bd5-4e07-9101-e981526f00c9] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:56:51.966568 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-63c1bcf7-30fa-4670-b8d7-6668773c7cdd tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:56:51.969713 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-63c1bcf7-30fa-4670-b8d7-6668773c7cdd tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:56:51.970536 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-63c1bcf7-30fa-4670-b8d7-6668773c7cdd tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:56:51.971338 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-63c1bcf7-30fa-4670-b8d7-6668773c7cdd tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:56:51.974667 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-63c1bcf7-30fa-4670-b8d7-6668773c7cdd tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:56:51.978535 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-63c1bcf7-30fa-4670-b8d7-6668773c7cdd tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:56:52.346590 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-9209176a-5321-49ac-8042-527e541f0cbb tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:56:52.346590 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-9209176a-5321-49ac-8042-527e541f0cbb tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:56:52.346590 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-9209176a-5321-49ac-8042-527e541f0cbb tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:56:52.346590 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-9209176a-5321-49ac-8042-527e541f0cbb tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:56:52.346590 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-9209176a-5321-49ac-8042-527e541f0cbb tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:56:52.360386 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9209176a-5321-49ac-8042-527e541f0cbb tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:56:52.361768 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9209176a-5321-49ac-8042-527e541f0cbb tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:56:52.361768 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9209176a-5321-49ac-8042-527e541f0cbb tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:56:52.362082 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9209176a-5321-49ac-8042-527e541f0cbb tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:56:52.376494 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9209176a-5321-49ac-8042-527e541f0cbb tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:56:52.376958 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9209176a-5321-49ac-8042-527e541f0cbb tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:56:52.408338 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-9209176a-5321-49ac-8042-527e541f0cbb tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Getting quotas for project 4f2348420e184649abcd3b2cf05c5fff. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:56:52.416173 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-9209176a-5321-49ac-8042-527e541f0cbb tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Getting quotas for user bd550aaeb0454a95a29b0bb575092d85 and project 4f2348420e184649abcd3b2cf05c5fff. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:56:52.437925 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9209176a-5321-49ac-8042-527e541f0cbb tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:56:52.458340 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9209176a-5321-49ac-8042-527e541f0cbb tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] [instance: 87044e4a-6da2-4df9-8148-f65756b22e2b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:56:52.653025 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9209176a-5321-49ac-8042-527e541f0cbb tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.398231 Oct 27 03:56:52.656234 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2995/6277] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:56:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1402 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 03:56:52.677379 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-387cb3d2-ddaa-4663-89d8-660b34a305ca tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:56:52.678431 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-387cb3d2-ddaa-4663-89d8-660b34a305ca tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] [instance: 87044e4a-6da2-4df9-8148-f65756b22e2b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:56:52.868089 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-387cb3d2-ddaa-4663-89d8-660b34a305ca tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd550aaeb0454a95a29b0bb575092d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2348420e184649abcd3b2cf05c5fff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:56:52.881609 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-387cb3d2-ddaa-4663-89d8-660b34a305ca tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] 10.222.0.20 "GET /compute/v2.1/servers/87044e4a-6da2-4df9-8148-f65756b22e2b" status: 200 len: 1211 microversion: 2.1 time: 0.200830 Oct 27 03:56:52.886949 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2996/6278] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:56:52 2022] GET /compute/v2.1/servers/87044e4a-6da2-4df9-8148-f65756b22e2b => generated 1211 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:56:52.951417 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-63c1bcf7-30fa-4670-b8d7-6668773c7cdd tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:56:52.972655 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-63c1bcf7-30fa-4670-b8d7-6668773c7cdd tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9" status: 200 len: 1692 microversion: 2.1 time: 1.037436 Oct 27 03:56:52.992482 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3283/6279] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:56:51 2022] GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9 => generated 1692 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:56:53.909160 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a25eb006-4ca8-43f4-b32c-7b40d0501bfe tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:56:53.910501 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a25eb006-4ca8-43f4-b32c-7b40d0501bfe tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] [instance: 87044e4a-6da2-4df9-8148-f65756b22e2b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:56:53.966728 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a25eb006-4ca8-43f4-b32c-7b40d0501bfe tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd550aaeb0454a95a29b0bb575092d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2348420e184649abcd3b2cf05c5fff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:56:53.975680 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a25eb006-4ca8-43f4-b32c-7b40d0501bfe tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] 10.222.0.20 "GET /compute/v2.1/servers/87044e4a-6da2-4df9-8148-f65756b22e2b" status: 200 len: 1211 microversion: 2.1 time: 0.071075 Oct 27 03:56:53.976562 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2997/6280] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:56:53 2022] GET /compute/v2.1/servers/87044e4a-6da2-4df9-8148-f65756b22e2b => generated 1211 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:56:54.000980 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-affa8a66-c9fe-47bb-b29d-f988244e8db5 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:56:54.001929 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-affa8a66-c9fe-47bb-b29d-f988244e8db5 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 81aa9d61-7bd5-4e07-9101-e981526f00c9] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:56:54.008421 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-affa8a66-c9fe-47bb-b29d-f988244e8db5 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:56:54.009246 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-affa8a66-c9fe-47bb-b29d-f988244e8db5 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:56:54.010111 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-affa8a66-c9fe-47bb-b29d-f988244e8db5 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:56:54.011313 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-affa8a66-c9fe-47bb-b29d-f988244e8db5 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:56:54.026268 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-affa8a66-c9fe-47bb-b29d-f988244e8db5 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:56:54.026268 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-affa8a66-c9fe-47bb-b29d-f988244e8db5 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:56:54.161838 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-affa8a66-c9fe-47bb-b29d-f988244e8db5 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:56:54.169859 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-affa8a66-c9fe-47bb-b29d-f988244e8db5 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9" status: 200 len: 1692 microversion: 2.1 time: 0.175137 Oct 27 03:56:54.170964 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3284/6281] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:56:53 2022] GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9 => generated 1692 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:56:55.000734 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0eaa37a7-6e56-4b0d-b4e8-f7643bccff88 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:56:55.001916 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0eaa37a7-6e56-4b0d-b4e8-f7643bccff88 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] [instance: 87044e4a-6da2-4df9-8148-f65756b22e2b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:56:55.145469 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0eaa37a7-6e56-4b0d-b4e8-f7643bccff88 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd550aaeb0454a95a29b0bb575092d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2348420e184649abcd3b2cf05c5fff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:56:55.156356 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0eaa37a7-6e56-4b0d-b4e8-f7643bccff88 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] 10.222.0.20 "GET /compute/v2.1/servers/87044e4a-6da2-4df9-8148-f65756b22e2b" status: 200 len: 1211 microversion: 2.1 time: 0.158756 Oct 27 03:56:55.166142 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2998/6282] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:56:54 2022] GET /compute/v2.1/servers/87044e4a-6da2-4df9-8148-f65756b22e2b => generated 1211 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:56:55.215264 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f05e7f6e-28f3-44b8-9965-4ef841a79a9d tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:56:55.216352 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f05e7f6e-28f3-44b8-9965-4ef841a79a9d tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 81aa9d61-7bd5-4e07-9101-e981526f00c9] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:56:55.224749 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f05e7f6e-28f3-44b8-9965-4ef841a79a9d tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:56:55.225265 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f05e7f6e-28f3-44b8-9965-4ef841a79a9d tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:56:55.225860 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f05e7f6e-28f3-44b8-9965-4ef841a79a9d tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:56:55.226617 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f05e7f6e-28f3-44b8-9965-4ef841a79a9d tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:56:55.227132 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f05e7f6e-28f3-44b8-9965-4ef841a79a9d tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:56:55.227726 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f05e7f6e-28f3-44b8-9965-4ef841a79a9d tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:56:55.674115 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f05e7f6e-28f3-44b8-9965-4ef841a79a9d tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:56:55.708359 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f05e7f6e-28f3-44b8-9965-4ef841a79a9d tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9" status: 200 len: 1692 microversion: 2.1 time: 0.487457 Oct 27 03:56:55.708935 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3285/6283] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:56:55 2022] GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9 => generated 1692 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:56:56.182612 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2a347330-386d-436c-8afb-905955e8fad5 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:56:56.183294 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-2a347330-386d-436c-8afb-905955e8fad5 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] [instance: 87044e4a-6da2-4df9-8148-f65756b22e2b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:56:56.193297 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2a347330-386d-436c-8afb-905955e8fad5 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:56:56.193954 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2a347330-386d-436c-8afb-905955e8fad5 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:56:56.195006 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2a347330-386d-436c-8afb-905955e8fad5 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:56:56.196083 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2a347330-386d-436c-8afb-905955e8fad5 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:56:56.196760 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2a347330-386d-436c-8afb-905955e8fad5 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:56:56.197332 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2a347330-386d-436c-8afb-905955e8fad5 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:56:56.607882 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2a347330-386d-436c-8afb-905955e8fad5 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd550aaeb0454a95a29b0bb575092d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2348420e184649abcd3b2cf05c5fff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:56:56.619134 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2a347330-386d-436c-8afb-905955e8fad5 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] 10.222.0.20 "GET /compute/v2.1/servers/87044e4a-6da2-4df9-8148-f65756b22e2b" status: 200 len: 1215 microversion: 2.1 time: 0.437824 Oct 27 03:56:56.619959 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 2999/6284] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:56:56 2022] GET /compute/v2.1/servers/87044e4a-6da2-4df9-8148-f65756b22e2b => generated 1215 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:56:56.762141 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f848b556-6491-4e10-a7b1-765422d651bb tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:56:56.762785 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f848b556-6491-4e10-a7b1-765422d651bb tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 81aa9d61-7bd5-4e07-9101-e981526f00c9] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:56:56.770884 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f848b556-6491-4e10-a7b1-765422d651bb tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:56:56.771450 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f848b556-6491-4e10-a7b1-765422d651bb tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:56:56.772506 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f848b556-6491-4e10-a7b1-765422d651bb tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:56:56.772609 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f848b556-6491-4e10-a7b1-765422d651bb tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:56:56.773113 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f848b556-6491-4e10-a7b1-765422d651bb tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:56:56.773550 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f848b556-6491-4e10-a7b1-765422d651bb tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:56:56.957461 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f848b556-6491-4e10-a7b1-765422d651bb tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:56:56.968688 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f848b556-6491-4e10-a7b1-765422d651bb tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9" status: 200 len: 1692 microversion: 2.1 time: 0.237830 Oct 27 03:56:56.970085 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3286/6285] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:56:56 2022] GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9 => generated 1692 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:56:57.645354 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-fab8590f-7fbe-48cb-bc29-c8215d511318 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:56:57.645994 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-fab8590f-7fbe-48cb-bc29-c8215d511318 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] [instance: 87044e4a-6da2-4df9-8148-f65756b22e2b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:56:57.668693 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fab8590f-7fbe-48cb-bc29-c8215d511318 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:56:57.668693 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fab8590f-7fbe-48cb-bc29-c8215d511318 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:56:57.668693 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fab8590f-7fbe-48cb-bc29-c8215d511318 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:56:57.672944 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fab8590f-7fbe-48cb-bc29-c8215d511318 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:56:57.673954 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fab8590f-7fbe-48cb-bc29-c8215d511318 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:56:57.678904 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fab8590f-7fbe-48cb-bc29-c8215d511318 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:56:57.917105 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-fab8590f-7fbe-48cb-bc29-c8215d511318 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd550aaeb0454a95a29b0bb575092d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2348420e184649abcd3b2cf05c5fff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:56:57.936717 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-fab8590f-7fbe-48cb-bc29-c8215d511318 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] 10.222.0.20 "GET /compute/v2.1/servers/87044e4a-6da2-4df9-8148-f65756b22e2b" status: 200 len: 1271 microversion: 2.1 time: 0.294895 Oct 27 03:56:57.937614 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3000/6286] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:56:57 2022] GET /compute/v2.1/servers/87044e4a-6da2-4df9-8148-f65756b22e2b => generated 1271 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:56:57.997866 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-436c9d27-5582-4e9b-ba86-9ee0d0bfa52b tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:56:58.000104 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-436c9d27-5582-4e9b-ba86-9ee0d0bfa52b tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 81aa9d61-7bd5-4e07-9101-e981526f00c9] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:56:58.019682 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-436c9d27-5582-4e9b-ba86-9ee0d0bfa52b tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:56:58.021269 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-436c9d27-5582-4e9b-ba86-9ee0d0bfa52b tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:56:58.021746 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-436c9d27-5582-4e9b-ba86-9ee0d0bfa52b tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:56:58.022928 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-436c9d27-5582-4e9b-ba86-9ee0d0bfa52b tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:56:58.024374 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-436c9d27-5582-4e9b-ba86-9ee0d0bfa52b tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:56:58.026734 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-436c9d27-5582-4e9b-ba86-9ee0d0bfa52b tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:56:58.332522 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-436c9d27-5582-4e9b-ba86-9ee0d0bfa52b tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:56:58.357675 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-436c9d27-5582-4e9b-ba86-9ee0d0bfa52b tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9" status: 200 len: 1697 microversion: 2.1 time: 0.366611 Oct 27 03:56:58.374069 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3287/6287] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:56:57 2022] GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9 => generated 1697 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:56:58.962522 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d72ad0a1-03d4-447e-957f-af3a4d431f1e tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:56:58.964081 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d72ad0a1-03d4-447e-957f-af3a4d431f1e tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] [instance: 87044e4a-6da2-4df9-8148-f65756b22e2b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:56:58.975273 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d72ad0a1-03d4-447e-957f-af3a4d431f1e tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:56:58.976169 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d72ad0a1-03d4-447e-957f-af3a4d431f1e tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:56:58.976847 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d72ad0a1-03d4-447e-957f-af3a4d431f1e tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:56:58.977900 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d72ad0a1-03d4-447e-957f-af3a4d431f1e tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:56:58.979173 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d72ad0a1-03d4-447e-957f-af3a4d431f1e tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:56:58.979780 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d72ad0a1-03d4-447e-957f-af3a4d431f1e tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:56:59.355777 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d72ad0a1-03d4-447e-957f-af3a4d431f1e tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd550aaeb0454a95a29b0bb575092d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2348420e184649abcd3b2cf05c5fff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:56:59.367798 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d72ad0a1-03d4-447e-957f-af3a4d431f1e tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] 10.222.0.20 "GET /compute/v2.1/servers/87044e4a-6da2-4df9-8148-f65756b22e2b" status: 200 len: 1311 microversion: 2.1 time: 0.410668 Oct 27 03:56:59.370610 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3001/6288] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:56:58 2022] GET /compute/v2.1/servers/87044e4a-6da2-4df9-8148-f65756b22e2b => generated 1311 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:56:59.387297 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a0c4e8a5-4dec-4c74-9da3-2baef8316482 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:56:59.388569 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a0c4e8a5-4dec-4c74-9da3-2baef8316482 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 81aa9d61-7bd5-4e07-9101-e981526f00c9] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:56:59.396732 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a0c4e8a5-4dec-4c74-9da3-2baef8316482 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:56:59.397462 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a0c4e8a5-4dec-4c74-9da3-2baef8316482 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:56:59.398152 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a0c4e8a5-4dec-4c74-9da3-2baef8316482 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:56:59.399304 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a0c4e8a5-4dec-4c74-9da3-2baef8316482 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:56:59.399968 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a0c4e8a5-4dec-4c74-9da3-2baef8316482 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:56:59.400613 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a0c4e8a5-4dec-4c74-9da3-2baef8316482 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:56:59.682334 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a0c4e8a5-4dec-4c74-9da3-2baef8316482 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:56:59.705036 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a0c4e8a5-4dec-4c74-9da3-2baef8316482 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9" status: 200 len: 1697 microversion: 2.1 time: 0.321948 Oct 27 03:56:59.715982 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3288/6289] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:56:59 2022] GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9 => generated 1697 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:57:00.394823 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-af160cf7-1b0d-4fbe-af1c-77e09a85a7c2 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:57:00.396167 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-af160cf7-1b0d-4fbe-af1c-77e09a85a7c2 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] [instance: 87044e4a-6da2-4df9-8148-f65756b22e2b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:57:00.407773 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-af160cf7-1b0d-4fbe-af1c-77e09a85a7c2 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:00.408603 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-af160cf7-1b0d-4fbe-af1c-77e09a85a7c2 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:00.409447 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-af160cf7-1b0d-4fbe-af1c-77e09a85a7c2 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:00.410625 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-af160cf7-1b0d-4fbe-af1c-77e09a85a7c2 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:00.411340 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-af160cf7-1b0d-4fbe-af1c-77e09a85a7c2 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:00.412001 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-af160cf7-1b0d-4fbe-af1c-77e09a85a7c2 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:00.735809 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-33c7bdd5-47ec-4fa8-8e18-603fc48b2581 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:57:00.736457 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-33c7bdd5-47ec-4fa8-8e18-603fc48b2581 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 81aa9d61-7bd5-4e07-9101-e981526f00c9] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:57:00.750491 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-33c7bdd5-47ec-4fa8-8e18-603fc48b2581 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:00.756591 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-33c7bdd5-47ec-4fa8-8e18-603fc48b2581 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:00.757069 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-33c7bdd5-47ec-4fa8-8e18-603fc48b2581 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:00.758226 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-33c7bdd5-47ec-4fa8-8e18-603fc48b2581 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:00.758703 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-33c7bdd5-47ec-4fa8-8e18-603fc48b2581 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:00.759149 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-33c7bdd5-47ec-4fa8-8e18-603fc48b2581 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:00.965871 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-af160cf7-1b0d-4fbe-af1c-77e09a85a7c2 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd550aaeb0454a95a29b0bb575092d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2348420e184649abcd3b2cf05c5fff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:57:00.981633 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-af160cf7-1b0d-4fbe-af1c-77e09a85a7c2 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] 10.222.0.20 "GET /compute/v2.1/servers/87044e4a-6da2-4df9-8148-f65756b22e2b" status: 200 len: 1311 microversion: 2.1 time: 0.591084 Oct 27 03:57:00.989423 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3002/6290] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:57:00 2022] GET /compute/v2.1/servers/87044e4a-6da2-4df9-8148-f65756b22e2b => generated 1311 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:57:01.012805 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-33c7bdd5-47ec-4fa8-8e18-603fc48b2581 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:57:01.022905 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-33c7bdd5-47ec-4fa8-8e18-603fc48b2581 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9" status: 200 len: 1697 microversion: 2.1 time: 0.292625 Oct 27 03:57:01.023323 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3289/6291] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:57:00 2022] GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9 => generated 1697 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:57:01.179180 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-ecbb208e-3e15-4f5e-9c29-695cbad3f188 req-a9a2cdea-1649-4b1a-a029-7cc50aab3643 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87044e4a-6da2-4df9-8148-f65756b22e2b", "tag": "6348cfba-1a8a-4d2b-b9e9-19c54463cceb"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:57:01.212408 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-ecbb208e-3e15-4f5e-9c29-695cbad3f188 req-a9a2cdea-1649-4b1a-a029-7cc50aab3643 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:01.212408 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-ecbb208e-3e15-4f5e-9c29-695cbad3f188 req-a9a2cdea-1649-4b1a-a029-7cc50aab3643 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:01.212408 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-ecbb208e-3e15-4f5e-9c29-695cbad3f188 req-a9a2cdea-1649-4b1a-a029-7cc50aab3643 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:01.231679 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-ecbb208e-3e15-4f5e-9c29-695cbad3f188 req-a9a2cdea-1649-4b1a-a029-7cc50aab3643 service nova] Creating event network-changed:6348cfba-1a8a-4d2b-b9e9-19c54463cceb for instance 87044e4a-6da2-4df9-8148-f65756b22e2b on n-h2-862769-1 Oct 27 03:57:01.240354 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-ecbb208e-3e15-4f5e-9c29-695cbad3f188 req-a9a2cdea-1649-4b1a-a029-7cc50aab3643 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064044 Oct 27 03:57:01.240354 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3003/6292] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:57:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:57:02.012443 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-da62a56e-6b5a-4610-adea-e397e06bc274 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:57:02.013084 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-da62a56e-6b5a-4610-adea-e397e06bc274 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] [instance: 87044e4a-6da2-4df9-8148-f65756b22e2b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:57:02.034953 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-da62a56e-6b5a-4610-adea-e397e06bc274 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:02.037308 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-da62a56e-6b5a-4610-adea-e397e06bc274 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:02.038773 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-da62a56e-6b5a-4610-adea-e397e06bc274 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:02.041109 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-da62a56e-6b5a-4610-adea-e397e06bc274 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:02.049539 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d096bac0-20c1-4c49-bcad-5e7ab6cc009b tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:57:02.051168 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d096bac0-20c1-4c49-bcad-5e7ab6cc009b tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 81aa9d61-7bd5-4e07-9101-e981526f00c9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:57:02.055202 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-da62a56e-6b5a-4610-adea-e397e06bc274 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:02.058273 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-da62a56e-6b5a-4610-adea-e397e06bc274 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:02.070633 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d096bac0-20c1-4c49-bcad-5e7ab6cc009b tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:02.071524 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d096bac0-20c1-4c49-bcad-5e7ab6cc009b tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:02.072220 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d096bac0-20c1-4c49-bcad-5e7ab6cc009b tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:02.073475 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d096bac0-20c1-4c49-bcad-5e7ab6cc009b tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:02.074195 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d096bac0-20c1-4c49-bcad-5e7ab6cc009b tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:02.074847 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d096bac0-20c1-4c49-bcad-5e7ab6cc009b tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:02.357196 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-da62a56e-6b5a-4610-adea-e397e06bc274 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd550aaeb0454a95a29b0bb575092d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2348420e184649abcd3b2cf05c5fff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:57:02.375793 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-da62a56e-6b5a-4610-adea-e397e06bc274 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] 10.222.0.20 "GET /compute/v2.1/servers/87044e4a-6da2-4df9-8148-f65756b22e2b" status: 200 len: 1311 microversion: 2.1 time: 0.367991 Oct 27 03:57:02.376646 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3290/6293] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:57:02 2022] GET /compute/v2.1/servers/87044e4a-6da2-4df9-8148-f65756b22e2b => generated 1311 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:57:02.391121 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:57:02.659628 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d096bac0-20c1-4c49-bcad-5e7ab6cc009b tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:57:02.670565 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d096bac0-20c1-4c49-bcad-5e7ab6cc009b tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9" status: 200 len: 1697 microversion: 2.1 time: 0.627441 Oct 27 03:57:02.673185 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3004/6294] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:57:02 2022] GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9 => generated 1697 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:57:03.405755 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2e8f2288-af13-4e14-8ce5-19d2fbf562ec tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:57:03.412116 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2e8f2288-af13-4e14-8ce5-19d2fbf562ec tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] [instance: 87044e4a-6da2-4df9-8148-f65756b22e2b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:57:03.416116 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2e8f2288-af13-4e14-8ce5-19d2fbf562ec tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:03.416610 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2e8f2288-af13-4e14-8ce5-19d2fbf562ec tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:03.417054 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2e8f2288-af13-4e14-8ce5-19d2fbf562ec tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:03.417840 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2e8f2288-af13-4e14-8ce5-19d2fbf562ec tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:03.418325 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2e8f2288-af13-4e14-8ce5-19d2fbf562ec tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:03.418749 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2e8f2288-af13-4e14-8ce5-19d2fbf562ec tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:03.633795 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2e8f2288-af13-4e14-8ce5-19d2fbf562ec tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd550aaeb0454a95a29b0bb575092d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2348420e184649abcd3b2cf05c5fff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:57:03.642218 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2e8f2288-af13-4e14-8ce5-19d2fbf562ec tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] 10.222.0.20 "GET /compute/v2.1/servers/87044e4a-6da2-4df9-8148-f65756b22e2b" status: 200 len: 1311 microversion: 2.1 time: 0.240926 Oct 27 03:57:03.642916 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3291/6295] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:57:03 2022] GET /compute/v2.1/servers/87044e4a-6da2-4df9-8148-f65756b22e2b => generated 1311 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:57:03.698708 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-45ae8e59-3bbd-431a-b7bb-a7369ac64167 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:57:03.699279 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-45ae8e59-3bbd-431a-b7bb-a7369ac64167 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 81aa9d61-7bd5-4e07-9101-e981526f00c9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:57:03.709182 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-45ae8e59-3bbd-431a-b7bb-a7369ac64167 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:03.709680 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-45ae8e59-3bbd-431a-b7bb-a7369ac64167 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:03.710369 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-45ae8e59-3bbd-431a-b7bb-a7369ac64167 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:03.711620 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-45ae8e59-3bbd-431a-b7bb-a7369ac64167 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:03.720221 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-45ae8e59-3bbd-431a-b7bb-a7369ac64167 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:03.720221 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-45ae8e59-3bbd-431a-b7bb-a7369ac64167 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:04.023640 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-45ae8e59-3bbd-431a-b7bb-a7369ac64167 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:57:04.037976 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-45ae8e59-3bbd-431a-b7bb-a7369ac64167 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9" status: 200 len: 1697 microversion: 2.1 time: 0.343362 Oct 27 03:57:04.039004 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3005/6296] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:57:03 2022] GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9 => generated 1697 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:57:04.669689 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-403b74a9-e4c4-433a-8487-eee16946c178 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:57:04.671415 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-403b74a9-e4c4-433a-8487-eee16946c178 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] [instance: 87044e4a-6da2-4df9-8148-f65756b22e2b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:57:04.681831 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-403b74a9-e4c4-433a-8487-eee16946c178 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:04.682658 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-403b74a9-e4c4-433a-8487-eee16946c178 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:04.683676 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-403b74a9-e4c4-433a-8487-eee16946c178 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:04.685358 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-403b74a9-e4c4-433a-8487-eee16946c178 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:04.686065 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-403b74a9-e4c4-433a-8487-eee16946c178 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:04.687753 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-403b74a9-e4c4-433a-8487-eee16946c178 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:05.036284 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-403b74a9-e4c4-433a-8487-eee16946c178 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd550aaeb0454a95a29b0bb575092d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2348420e184649abcd3b2cf05c5fff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:57:05.049902 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-403b74a9-e4c4-433a-8487-eee16946c178 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] 10.222.0.20 "GET /compute/v2.1/servers/87044e4a-6da2-4df9-8148-f65756b22e2b" status: 200 len: 1311 microversion: 2.1 time: 0.387659 Oct 27 03:57:05.052630 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3292/6297] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:57:04 2022] GET /compute/v2.1/servers/87044e4a-6da2-4df9-8148-f65756b22e2b => generated 1311 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:57:05.072569 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8217319e-f5f3-4ceb-b26a-85fe60e7e164 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:57:05.073746 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8217319e-f5f3-4ceb-b26a-85fe60e7e164 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 81aa9d61-7bd5-4e07-9101-e981526f00c9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:57:05.082301 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8217319e-f5f3-4ceb-b26a-85fe60e7e164 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:05.083076 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8217319e-f5f3-4ceb-b26a-85fe60e7e164 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:05.083755 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8217319e-f5f3-4ceb-b26a-85fe60e7e164 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:05.084617 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8217319e-f5f3-4ceb-b26a-85fe60e7e164 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:05.085219 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8217319e-f5f3-4ceb-b26a-85fe60e7e164 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:05.085860 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8217319e-f5f3-4ceb-b26a-85fe60e7e164 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:05.150725 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=12 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:57:05.253762 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8217319e-f5f3-4ceb-b26a-85fe60e7e164 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:57:05.262563 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8217319e-f5f3-4ceb-b26a-85fe60e7e164 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9" status: 200 len: 1697 microversion: 2.1 time: 0.193732 Oct 27 03:57:05.263068 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3006/6298] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:57:05 2022] GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9 => generated 1697 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:57:06.076118 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2d54e915-36aa-4dd6-91e0-1bb2607c8d8e tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:57:06.076752 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2d54e915-36aa-4dd6-91e0-1bb2607c8d8e tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] [instance: 87044e4a-6da2-4df9-8148-f65756b22e2b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:57:06.085641 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2d54e915-36aa-4dd6-91e0-1bb2607c8d8e tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:06.086408 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2d54e915-36aa-4dd6-91e0-1bb2607c8d8e tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:06.087039 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2d54e915-36aa-4dd6-91e0-1bb2607c8d8e tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:06.087917 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2d54e915-36aa-4dd6-91e0-1bb2607c8d8e tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:06.088547 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2d54e915-36aa-4dd6-91e0-1bb2607c8d8e tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:06.089142 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2d54e915-36aa-4dd6-91e0-1bb2607c8d8e tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:06.268771 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2d54e915-36aa-4dd6-91e0-1bb2607c8d8e tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd550aaeb0454a95a29b0bb575092d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2348420e184649abcd3b2cf05c5fff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:57:06.276894 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2d54e915-36aa-4dd6-91e0-1bb2607c8d8e tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] 10.222.0.20 "GET /compute/v2.1/servers/87044e4a-6da2-4df9-8148-f65756b22e2b" status: 200 len: 1311 microversion: 2.1 time: 0.205339 Oct 27 03:57:06.277483 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3293/6299] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:57:06 2022] GET /compute/v2.1/servers/87044e4a-6da2-4df9-8148-f65756b22e2b => generated 1311 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:57:06.298123 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9e623f2d-f495-4b18-bf5b-35b5eb47d3de tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:57:06.298123 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9e623f2d-f495-4b18-bf5b-35b5eb47d3de tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 81aa9d61-7bd5-4e07-9101-e981526f00c9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:57:06.302954 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9e623f2d-f495-4b18-bf5b-35b5eb47d3de tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:06.303500 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9e623f2d-f495-4b18-bf5b-35b5eb47d3de tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:06.303951 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9e623f2d-f495-4b18-bf5b-35b5eb47d3de tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:06.304660 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9e623f2d-f495-4b18-bf5b-35b5eb47d3de tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:06.305122 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9e623f2d-f495-4b18-bf5b-35b5eb47d3de tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:06.305550 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9e623f2d-f495-4b18-bf5b-35b5eb47d3de tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:06.491383 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9e623f2d-f495-4b18-bf5b-35b5eb47d3de tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:57:06.529827 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9e623f2d-f495-4b18-bf5b-35b5eb47d3de tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9" status: 200 len: 1697 microversion: 2.1 time: 0.233640 Oct 27 03:57:06.529827 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3007/6300] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:57:06 2022] GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9 => generated 1697 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:57:07.301760 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b3c37cf3-f9fa-4dcd-96cf-992f7e983463 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:57:07.302556 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b3c37cf3-f9fa-4dcd-96cf-992f7e983463 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] [instance: 87044e4a-6da2-4df9-8148-f65756b22e2b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:57:07.310414 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b3c37cf3-f9fa-4dcd-96cf-992f7e983463 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:07.310920 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b3c37cf3-f9fa-4dcd-96cf-992f7e983463 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:07.311371 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b3c37cf3-f9fa-4dcd-96cf-992f7e983463 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:07.312711 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b3c37cf3-f9fa-4dcd-96cf-992f7e983463 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:07.313330 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b3c37cf3-f9fa-4dcd-96cf-992f7e983463 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:07.313762 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b3c37cf3-f9fa-4dcd-96cf-992f7e983463 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:07.468823 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b3c37cf3-f9fa-4dcd-96cf-992f7e983463 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd550aaeb0454a95a29b0bb575092d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2348420e184649abcd3b2cf05c5fff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:57:07.476997 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b3c37cf3-f9fa-4dcd-96cf-992f7e983463 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] 10.222.0.20 "GET /compute/v2.1/servers/87044e4a-6da2-4df9-8148-f65756b22e2b" status: 200 len: 1311 microversion: 2.1 time: 0.179926 Oct 27 03:57:07.477576 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3294/6301] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:57:07 2022] GET /compute/v2.1/servers/87044e4a-6da2-4df9-8148-f65756b22e2b => generated 1311 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:57:07.567828 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-758e22cc-53db-4c5c-80f1-362950a1a682 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:57:07.567828 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-758e22cc-53db-4c5c-80f1-362950a1a682 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 81aa9d61-7bd5-4e07-9101-e981526f00c9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:57:07.591901 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-758e22cc-53db-4c5c-80f1-362950a1a682 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:07.593737 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-758e22cc-53db-4c5c-80f1-362950a1a682 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:07.594083 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-758e22cc-53db-4c5c-80f1-362950a1a682 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:07.594850 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-758e22cc-53db-4c5c-80f1-362950a1a682 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:07.598117 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-758e22cc-53db-4c5c-80f1-362950a1a682 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:07.598686 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-758e22cc-53db-4c5c-80f1-362950a1a682 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:07.913838 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-758e22cc-53db-4c5c-80f1-362950a1a682 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:57:07.923414 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-758e22cc-53db-4c5c-80f1-362950a1a682 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9" status: 200 len: 1697 microversion: 2.1 time: 0.364369 Oct 27 03:57:07.928458 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3008/6302] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:57:07 2022] GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9 => generated 1697 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:57:08.517326 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3ef07a9a-1f51-4af8-b24e-4c89604be635 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:57:08.518113 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3ef07a9a-1f51-4af8-b24e-4c89604be635 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] [instance: 87044e4a-6da2-4df9-8148-f65756b22e2b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:57:08.547132 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3ef07a9a-1f51-4af8-b24e-4c89604be635 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:08.547637 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3ef07a9a-1f51-4af8-b24e-4c89604be635 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:08.548085 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3ef07a9a-1f51-4af8-b24e-4c89604be635 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:08.548808 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3ef07a9a-1f51-4af8-b24e-4c89604be635 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:08.549528 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3ef07a9a-1f51-4af8-b24e-4c89604be635 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:08.549963 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3ef07a9a-1f51-4af8-b24e-4c89604be635 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:08.838581 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3ef07a9a-1f51-4af8-b24e-4c89604be635 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd550aaeb0454a95a29b0bb575092d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2348420e184649abcd3b2cf05c5fff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:57:08.847375 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3ef07a9a-1f51-4af8-b24e-4c89604be635 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] 10.222.0.20 "GET /compute/v2.1/servers/87044e4a-6da2-4df9-8148-f65756b22e2b" status: 200 len: 1311 microversion: 2.1 time: 0.347974 Oct 27 03:57:08.847968 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3295/6303] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:57:08 2022] GET /compute/v2.1/servers/87044e4a-6da2-4df9-8148-f65756b22e2b => generated 1311 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:57:08.957285 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-fa71d010-75de-4f54-84be-b151ab438102 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:57:08.958202 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-fa71d010-75de-4f54-84be-b151ab438102 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 81aa9d61-7bd5-4e07-9101-e981526f00c9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:57:08.973854 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fa71d010-75de-4f54-84be-b151ab438102 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:08.974403 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fa71d010-75de-4f54-84be-b151ab438102 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:08.974866 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fa71d010-75de-4f54-84be-b151ab438102 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:08.975615 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fa71d010-75de-4f54-84be-b151ab438102 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:08.976091 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fa71d010-75de-4f54-84be-b151ab438102 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:08.976537 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fa71d010-75de-4f54-84be-b151ab438102 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:09.257417 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-fa71d010-75de-4f54-84be-b151ab438102 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:57:09.271948 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-fa71d010-75de-4f54-84be-b151ab438102 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9" status: 200 len: 1697 microversion: 2.1 time: 0.319871 Oct 27 03:57:09.290069 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3009/6304] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:57:08 2022] GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9 => generated 1697 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:57:09.667234 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-7a3a9a1f-3ca5-4885-bbc3-e8261b70713f req-5df57adc-202a-4452-af32-cf0d2052c337 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87044e4a-6da2-4df9-8148-f65756b22e2b", "name": "network-vif-plugged", "status": "completed", "tag": "6348cfba-1a8a-4d2b-b9e9-19c54463cceb"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:57:09.709909 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-7a3a9a1f-3ca5-4885-bbc3-e8261b70713f req-5df57adc-202a-4452-af32-cf0d2052c337 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:09.710333 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-7a3a9a1f-3ca5-4885-bbc3-e8261b70713f req-5df57adc-202a-4452-af32-cf0d2052c337 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:09.711126 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-7a3a9a1f-3ca5-4885-bbc3-e8261b70713f req-5df57adc-202a-4452-af32-cf0d2052c337 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:09.742027 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-7a3a9a1f-3ca5-4885-bbc3-e8261b70713f req-5df57adc-202a-4452-af32-cf0d2052c337 service nova] Creating event network-vif-plugged:6348cfba-1a8a-4d2b-b9e9-19c54463cceb for instance 87044e4a-6da2-4df9-8148-f65756b22e2b on n-h2-862769-1 Oct 27 03:57:09.767530 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-7a3a9a1f-3ca5-4885-bbc3-e8261b70713f req-5df57adc-202a-4452-af32-cf0d2052c337 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094761 Oct 27 03:57:09.768541 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3296/6305] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:57:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:57:09.873902 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d1c9542f-18d5-4b4d-9fb6-867c783cb1bf tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:57:09.878607 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d1c9542f-18d5-4b4d-9fb6-867c783cb1bf tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] [instance: 87044e4a-6da2-4df9-8148-f65756b22e2b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:57:09.886067 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d1c9542f-18d5-4b4d-9fb6-867c783cb1bf tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:09.892183 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d1c9542f-18d5-4b4d-9fb6-867c783cb1bf tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:09.894533 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d1c9542f-18d5-4b4d-9fb6-867c783cb1bf tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:09.897684 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d1c9542f-18d5-4b4d-9fb6-867c783cb1bf tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:09.898226 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d1c9542f-18d5-4b4d-9fb6-867c783cb1bf tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:09.898680 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d1c9542f-18d5-4b4d-9fb6-867c783cb1bf tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:10.309793 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b52c9b58-aa46-41d1-9fa0-df6faf44bf52 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:57:10.311159 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b52c9b58-aa46-41d1-9fa0-df6faf44bf52 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 81aa9d61-7bd5-4e07-9101-e981526f00c9] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:57:10.341519 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b52c9b58-aa46-41d1-9fa0-df6faf44bf52 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:10.342324 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b52c9b58-aa46-41d1-9fa0-df6faf44bf52 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:10.342794 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b52c9b58-aa46-41d1-9fa0-df6faf44bf52 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:10.343714 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b52c9b58-aa46-41d1-9fa0-df6faf44bf52 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:10.344191 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b52c9b58-aa46-41d1-9fa0-df6faf44bf52 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:10.344632 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b52c9b58-aa46-41d1-9fa0-df6faf44bf52 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:10.411047 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=100 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:57:10.519025 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d1c9542f-18d5-4b4d-9fb6-867c783cb1bf tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd550aaeb0454a95a29b0bb575092d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2348420e184649abcd3b2cf05c5fff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:57:10.535432 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d1c9542f-18d5-4b4d-9fb6-867c783cb1bf tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] 10.222.0.20 "GET /compute/v2.1/servers/87044e4a-6da2-4df9-8148-f65756b22e2b" status: 200 len: 1311 microversion: 2.1 time: 0.665327 Oct 27 03:57:10.560547 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3010/6306] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:57:09 2022] GET /compute/v2.1/servers/87044e4a-6da2-4df9-8148-f65756b22e2b => generated 1311 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:57:10.629771 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b52c9b58-aa46-41d1-9fa0-df6faf44bf52 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:57:10.635817 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b52c9b58-aa46-41d1-9fa0-df6faf44bf52 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9" status: 200 len: 1696 microversion: 2.1 time: 0.330726 Oct 27 03:57:10.641307 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3297/6307] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:57:10 2022] GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9 => generated 1696 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:57:11.028412 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-5c15b58d-20a3-4e93-b414-8d1628344cef req-e20d6525-1af3-481d-95c5-21eafe9163e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81aa9d61-7bd5-4e07-9101-e981526f00c9", "name": "network-vif-unplugged", "status": "completed", "tag": "e4aaef65-1861-4030-81f6-20ddb632987e"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:57:11.040291 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-5c15b58d-20a3-4e93-b414-8d1628344cef req-e20d6525-1af3-481d-95c5-21eafe9163e8 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:11.041994 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-5c15b58d-20a3-4e93-b414-8d1628344cef req-e20d6525-1af3-481d-95c5-21eafe9163e8 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:11.041994 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-5c15b58d-20a3-4e93-b414-8d1628344cef req-e20d6525-1af3-481d-95c5-21eafe9163e8 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:11.056863 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-5c15b58d-20a3-4e93-b414-8d1628344cef req-e20d6525-1af3-481d-95c5-21eafe9163e8 service nova] Creating event network-vif-unplugged:e4aaef65-1861-4030-81f6-20ddb632987e for instance 81aa9d61-7bd5-4e07-9101-e981526f00c9 on n-h2-862769-1 Oct 27 03:57:11.085837 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [req-5c15b58d-20a3-4e93-b414-8d1628344cef req-e20d6525-1af3-481d-95c5-21eafe9163e8 service nova] Instance 81aa9d61-7bd5-4e07-9101-e981526f00c9 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862769-1', 'n-h1-862769-1'} {{(pid=121000) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 03:57:11.105825 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-5c15b58d-20a3-4e93-b414-8d1628344cef req-e20d6525-1af3-481d-95c5-21eafe9163e8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081172 Oct 27 03:57:11.107178 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3011/6308] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:57:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:57:11.585528 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-01128bfa-8ebe-46d3-8036-b5b4b54308a9 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:57:11.586206 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-01128bfa-8ebe-46d3-8036-b5b4b54308a9 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] [instance: 87044e4a-6da2-4df9-8148-f65756b22e2b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:57:11.613145 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-01128bfa-8ebe-46d3-8036-b5b4b54308a9 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:11.614564 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-01128bfa-8ebe-46d3-8036-b5b4b54308a9 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:11.615235 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-01128bfa-8ebe-46d3-8036-b5b4b54308a9 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:11.616196 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-01128bfa-8ebe-46d3-8036-b5b4b54308a9 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:11.616859 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-01128bfa-8ebe-46d3-8036-b5b4b54308a9 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:11.623290 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-01128bfa-8ebe-46d3-8036-b5b4b54308a9 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:11.672534 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-78f0d64c-e23a-4a1b-b4f5-170031d94c36 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:57:11.673248 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-78f0d64c-e23a-4a1b-b4f5-170031d94c36 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 81aa9d61-7bd5-4e07-9101-e981526f00c9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:57:11.692468 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-78f0d64c-e23a-4a1b-b4f5-170031d94c36 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:11.693355 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-78f0d64c-e23a-4a1b-b4f5-170031d94c36 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:11.694093 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-78f0d64c-e23a-4a1b-b4f5-170031d94c36 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:11.696856 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-78f0d64c-e23a-4a1b-b4f5-170031d94c36 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:11.697816 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-78f0d64c-e23a-4a1b-b4f5-170031d94c36 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:11.699393 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-78f0d64c-e23a-4a1b-b4f5-170031d94c36 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:11.753096 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:57:11.943098 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-01128bfa-8ebe-46d3-8036-b5b4b54308a9 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd550aaeb0454a95a29b0bb575092d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2348420e184649abcd3b2cf05c5fff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:57:11.953981 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-01128bfa-8ebe-46d3-8036-b5b4b54308a9 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] 10.222.0.20 "GET /compute/v2.1/servers/87044e4a-6da2-4df9-8148-f65756b22e2b" status: 200 len: 1495 microversion: 2.1 time: 0.372908 Oct 27 03:57:11.957785 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3298/6309] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:57:11 2022] GET /compute/v2.1/servers/87044e4a-6da2-4df9-8148-f65756b22e2b => generated 1495 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:57:12.559221 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-78f0d64c-e23a-4a1b-b4f5-170031d94c36 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:57:12.575017 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-78f0d64c-e23a-4a1b-b4f5-170031d94c36 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9" status: 200 len: 1696 microversion: 2.1 time: 0.904515 Oct 27 03:57:12.575667 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3012/6310] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:57:11 2022] GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9 => generated 1696 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:57:13.316850 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-0472be2d-2dd0-4d59-8020-016d1d1e8aa3 req-9f3a868c-8cb2-4794-b6a3-e109b0e9001e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81aa9d61-7bd5-4e07-9101-e981526f00c9", "tag": "e4aaef65-1861-4030-81f6-20ddb632987e"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:57:13.334076 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-0472be2d-2dd0-4d59-8020-016d1d1e8aa3 req-9f3a868c-8cb2-4794-b6a3-e109b0e9001e service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:13.334076 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-0472be2d-2dd0-4d59-8020-016d1d1e8aa3 req-9f3a868c-8cb2-4794-b6a3-e109b0e9001e service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:13.334076 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-0472be2d-2dd0-4d59-8020-016d1d1e8aa3 req-9f3a868c-8cb2-4794-b6a3-e109b0e9001e service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:13.373148 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-0472be2d-2dd0-4d59-8020-016d1d1e8aa3 req-9f3a868c-8cb2-4794-b6a3-e109b0e9001e service nova] Creating event network-changed:e4aaef65-1861-4030-81f6-20ddb632987e for instance 81aa9d61-7bd5-4e07-9101-e981526f00c9 on n-h2-862769-1 Oct 27 03:57:13.381975 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [req-0472be2d-2dd0-4d59-8020-016d1d1e8aa3 req-9f3a868c-8cb2-4794-b6a3-e109b0e9001e service nova] Instance 81aa9d61-7bd5-4e07-9101-e981526f00c9 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862769-1', 'n-h1-862769-1'} {{(pid=121001) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 03:57:13.407402 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-0472be2d-2dd0-4d59-8020-016d1d1e8aa3 req-9f3a868c-8cb2-4794-b6a3-e109b0e9001e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096242 Oct 27 03:57:13.408358 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3299/6311] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:57:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:57:13.603520 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-de73261e-a2b0-4adc-bfca-3aedeec72079 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:57:13.604911 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-de73261e-a2b0-4adc-bfca-3aedeec72079 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 81aa9d61-7bd5-4e07-9101-e981526f00c9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:57:13.616491 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-de73261e-a2b0-4adc-bfca-3aedeec72079 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:13.621495 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-de73261e-a2b0-4adc-bfca-3aedeec72079 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:13.622526 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-de73261e-a2b0-4adc-bfca-3aedeec72079 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:13.623543 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-de73261e-a2b0-4adc-bfca-3aedeec72079 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:13.624393 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-de73261e-a2b0-4adc-bfca-3aedeec72079 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:13.625104 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-de73261e-a2b0-4adc-bfca-3aedeec72079 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:14.494358 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-de73261e-a2b0-4adc-bfca-3aedeec72079 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:57:14.510214 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-de73261e-a2b0-4adc-bfca-3aedeec72079 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9" status: 200 len: 1696 microversion: 2.1 time: 0.909119 Oct 27 03:57:14.512582 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3013/6312] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:57:13 2022] GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9 => generated 1696 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:57:15.538463 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0fcadb10-fc87-4c75-9f99-bc0a3f6e4254 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:57:15.539182 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0fcadb10-fc87-4c75-9f99-bc0a3f6e4254 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 81aa9d61-7bd5-4e07-9101-e981526f00c9] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:57:15.571185 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0fcadb10-fc87-4c75-9f99-bc0a3f6e4254 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:15.571724 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0fcadb10-fc87-4c75-9f99-bc0a3f6e4254 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:15.578883 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0fcadb10-fc87-4c75-9f99-bc0a3f6e4254 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:15.582412 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0fcadb10-fc87-4c75-9f99-bc0a3f6e4254 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:15.582916 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0fcadb10-fc87-4c75-9f99-bc0a3f6e4254 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:15.588298 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0fcadb10-fc87-4c75-9f99-bc0a3f6e4254 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:15.970621 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0fcadb10-fc87-4c75-9f99-bc0a3f6e4254 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:57:15.980167 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0fcadb10-fc87-4c75-9f99-bc0a3f6e4254 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9" status: 200 len: 1696 microversion: 2.1 time: 0.447258 Oct 27 03:57:16.003794 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3300/6313] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:57:15 2022] GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9 => generated 1696 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:57:17.031825 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4d827dd0-b95b-48eb-90cf-c4af32983093 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:57:17.036106 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4d827dd0-b95b-48eb-90cf-c4af32983093 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 81aa9d61-7bd5-4e07-9101-e981526f00c9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:57:17.049423 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4d827dd0-b95b-48eb-90cf-c4af32983093 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:17.050245 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4d827dd0-b95b-48eb-90cf-c4af32983093 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:17.050771 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4d827dd0-b95b-48eb-90cf-c4af32983093 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:17.051585 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4d827dd0-b95b-48eb-90cf-c4af32983093 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:17.052217 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4d827dd0-b95b-48eb-90cf-c4af32983093 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:17.056520 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4d827dd0-b95b-48eb-90cf-c4af32983093 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:17.582297 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4d827dd0-b95b-48eb-90cf-c4af32983093 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:57:17.595744 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4d827dd0-b95b-48eb-90cf-c4af32983093 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9" status: 200 len: 1694 microversion: 2.1 time: 0.585519 Oct 27 03:57:17.596680 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3014/6314] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:57:17 2022] GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9 => generated 1694 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:57:17.826471 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-89875a3c-a793-4bcb-9173-31249ee78f31 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:57:17.828136 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-89875a3c-a793-4bcb-9173-31249ee78f31 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] [instance: 87044e4a-6da2-4df9-8148-f65756b22e2b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:57:17.842165 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-89875a3c-a793-4bcb-9173-31249ee78f31 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:17.842863 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-89875a3c-a793-4bcb-9173-31249ee78f31 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:17.843694 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-89875a3c-a793-4bcb-9173-31249ee78f31 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:17.844584 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-89875a3c-a793-4bcb-9173-31249ee78f31 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:17.849562 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-89875a3c-a793-4bcb-9173-31249ee78f31 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:17.850242 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-89875a3c-a793-4bcb-9173-31249ee78f31 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:17.915871 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-89875a3c-a793-4bcb-9173-31249ee78f31 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] [instance: 87044e4a-6da2-4df9-8148-f65756b22e2b] Going to try to terminate instance {{(pid=121001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:57:18.130312 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=45 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:57:18.238024 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-89875a3c-a793-4bcb-9173-31249ee78f31 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] 10.222.0.20 "DELETE /compute/v2.1/servers/87044e4a-6da2-4df9-8148-f65756b22e2b" status: 204 len: 0 microversion: 2.1 time: 0.415263 Oct 27 03:57:18.238648 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3301/6315] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:57:17 2022] DELETE /compute/v2.1/servers/87044e4a-6da2-4df9-8148-f65756b22e2b => generated 0 bytes in 417 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:57:18.247771 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ba95d9df-1fc7-45de-ab65-a0fd0a5756d1 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:57:18.248216 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ba95d9df-1fc7-45de-ab65-a0fd0a5756d1 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] [instance: 87044e4a-6da2-4df9-8148-f65756b22e2b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:57:18.267156 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ba95d9df-1fc7-45de-ab65-a0fd0a5756d1 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:18.267980 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ba95d9df-1fc7-45de-ab65-a0fd0a5756d1 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:18.270234 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ba95d9df-1fc7-45de-ab65-a0fd0a5756d1 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:18.270234 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ba95d9df-1fc7-45de-ab65-a0fd0a5756d1 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:18.270234 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ba95d9df-1fc7-45de-ab65-a0fd0a5756d1 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:18.270234 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ba95d9df-1fc7-45de-ab65-a0fd0a5756d1 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:18.527621 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ba95d9df-1fc7-45de-ab65-a0fd0a5756d1 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd550aaeb0454a95a29b0bb575092d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2348420e184649abcd3b2cf05c5fff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:57:18.548441 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ba95d9df-1fc7-45de-ab65-a0fd0a5756d1 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] 10.222.0.20 "GET /compute/v2.1/servers/87044e4a-6da2-4df9-8148-f65756b22e2b" status: 200 len: 1501 microversion: 2.1 time: 0.305380 Oct 27 03:57:18.560891 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3015/6316] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:57:18 2022] GET /compute/v2.1/servers/87044e4a-6da2-4df9-8148-f65756b22e2b => generated 1501 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:57:18.591436 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d264c327-36ee-4acb-a3a9-11d03dcb1f54 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1871599314", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": [{"uuid": "df6b0f7e-8ec3-46da-9928-13b049e68218"}]}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:57:18.620829 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6ccbb698-3418-48c2-a92f-fdc346db0327 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:57:18.625890 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6ccbb698-3418-48c2-a92f-fdc346db0327 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 81aa9d61-7bd5-4e07-9101-e981526f00c9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:57:18.634151 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:57:18.636123 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6ccbb698-3418-48c2-a92f-fdc346db0327 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:18.636626 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6ccbb698-3418-48c2-a92f-fdc346db0327 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:18.641858 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6ccbb698-3418-48c2-a92f-fdc346db0327 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:18.642913 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6ccbb698-3418-48c2-a92f-fdc346db0327 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:18.644176 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6ccbb698-3418-48c2-a92f-fdc346db0327 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:18.645005 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6ccbb698-3418-48c2-a92f-fdc346db0327 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:18.696132 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.network.neutron [None req-d264c327-36ee-4acb-a3a9-11d03dcb1f54 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] validate_networks() for [('df6b0f7e-8ec3-46da-9928-13b049e68218', None, None, None, None, None)] {{(pid=121001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:57:18.865183 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-6ccbb698-3418-48c2-a92f-fdc346db0327 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:57:18.877914 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6ccbb698-3418-48c2-a92f-fdc346db0327 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9" status: 200 len: 1691 microversion: 2.1 time: 0.261187 Oct 27 03:57:18.879092 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3016/6317] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:57:18 2022] GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9 => generated 1691 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:57:18.905006 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2a19d657-d9e5-4372-bca9-99029e485286 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:57:18.906566 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-2a19d657-d9e5-4372-bca9-99029e485286 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 81aa9d61-7bd5-4e07-9101-e981526f00c9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:57:18.923040 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2a19d657-d9e5-4372-bca9-99029e485286 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:18.924003 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2a19d657-d9e5-4372-bca9-99029e485286 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:18.925658 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2a19d657-d9e5-4372-bca9-99029e485286 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:18.929544 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2a19d657-d9e5-4372-bca9-99029e485286 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:18.931468 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2a19d657-d9e5-4372-bca9-99029e485286 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:18.931637 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2a19d657-d9e5-4372-bca9-99029e485286 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:19.344232 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2a19d657-d9e5-4372-bca9-99029e485286 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "POST /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9/action" status: 202 len: 0 microversion: 2.1 time: 0.442194 Oct 27 03:57:19.346424 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3017/6318] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:57:18 2022] POST /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9/action => generated 0 bytes in 447 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 03:57:19.390576 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d04c015d-c1ea-4a9b-9e75-5f328816340b tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:57:19.391303 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d04c015d-c1ea-4a9b-9e75-5f328816340b tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 81aa9d61-7bd5-4e07-9101-e981526f00c9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:57:19.405574 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d04c015d-c1ea-4a9b-9e75-5f328816340b tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:19.407510 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d04c015d-c1ea-4a9b-9e75-5f328816340b tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:19.407968 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d04c015d-c1ea-4a9b-9e75-5f328816340b tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:19.408757 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d04c015d-c1ea-4a9b-9e75-5f328816340b tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:19.409222 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d04c015d-c1ea-4a9b-9e75-5f328816340b tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:19.409654 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d04c015d-c1ea-4a9b-9e75-5f328816340b tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:19.886508 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-d264c327-36ee-4acb-a3a9-11d03dcb1f54 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Flavor limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:57:19.887369 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-d264c327-36ee-4acb-a3a9-11d03dcb1f54 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Image limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:57:19.887860 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-d264c327-36ee-4acb-a3a9-11d03dcb1f54 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Flavor pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:57:19.888522 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-d264c327-36ee-4acb-a3a9-11d03dcb1f54 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Image pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:57:19.889164 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-d264c327-36ee-4acb-a3a9-11d03dcb1f54 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:57:19.908892 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d264c327-36ee-4acb-a3a9-11d03dcb1f54 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:19.911662 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d264c327-36ee-4acb-a3a9-11d03dcb1f54 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:19.912259 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d264c327-36ee-4acb-a3a9-11d03dcb1f54 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:19.915569 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d264c327-36ee-4acb-a3a9-11d03dcb1f54 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:19.916177 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d264c327-36ee-4acb-a3a9-11d03dcb1f54 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:19.918018 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d264c327-36ee-4acb-a3a9-11d03dcb1f54 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:19.967592 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-d264c327-36ee-4acb-a3a9-11d03dcb1f54 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Getting quotas for project 57b587e152514b0f99c5e14e842d6ffc. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:57:19.986617 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-d264c327-36ee-4acb-a3a9-11d03dcb1f54 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Getting quotas for user 323c30f244f24b0897ec0631a33d91e0 and project 57b587e152514b0f99c5e14e842d6ffc. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:57:20.019970 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d264c327-36ee-4acb-a3a9-11d03dcb1f54 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Going to run 1 instances... {{(pid=121001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:57:20.024864 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d264c327-36ee-4acb-a3a9-11d03dcb1f54 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] [instance: de10d316-c43e-4ee9-b80b-131388bc91aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:57:20.064914 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d04c015d-c1ea-4a9b-9e75-5f328816340b tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:57:20.073713 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d04c015d-c1ea-4a9b-9e75-5f328816340b tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9" status: 200 len: 1690 microversion: 2.1 time: 0.698215 Oct 27 03:57:20.079359 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3018/6319] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:57:19 2022] GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9 => generated 1690 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:57:20.090535 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c4e22ace-6b20-4a73-97be-a2f1def39ac8 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:57:20.090535 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c4e22ace-6b20-4a73-97be-a2f1def39ac8 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] [instance: 87044e4a-6da2-4df9-8148-f65756b22e2b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:57:20.105666 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c4e22ace-6b20-4a73-97be-a2f1def39ac8 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:20.107728 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c4e22ace-6b20-4a73-97be-a2f1def39ac8 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:20.108329 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c4e22ace-6b20-4a73-97be-a2f1def39ac8 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:20.113105 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c4e22ace-6b20-4a73-97be-a2f1def39ac8 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:20.113749 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c4e22ace-6b20-4a73-97be-a2f1def39ac8 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:20.114460 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c4e22ace-6b20-4a73-97be-a2f1def39ac8 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:20.215604 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d264c327-36ee-4acb-a3a9-11d03dcb1f54 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.839538 Oct 27 03:57:20.218837 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3302/6320] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:57:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1844 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 03:57:20.231075 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6da7076b-a124-41e3-9ae3-4615f12fda5d tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:57:20.231902 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-6da7076b-a124-41e3-9ae3-4615f12fda5d tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] [instance: de10d316-c43e-4ee9-b80b-131388bc91aa] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:57:20.642619 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c4e22ace-6b20-4a73-97be-a2f1def39ac8 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd550aaeb0454a95a29b0bb575092d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2348420e184649abcd3b2cf05c5fff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:57:20.660487 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c4e22ace-6b20-4a73-97be-a2f1def39ac8 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] 10.222.0.20 "GET /compute/v2.1/servers/87044e4a-6da2-4df9-8148-f65756b22e2b" status: 200 len: 1501 microversion: 2.1 time: 0.579657 Oct 27 03:57:20.667791 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3019/6321] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:57:20 2022] GET /compute/v2.1/servers/87044e4a-6da2-4df9-8148-f65756b22e2b => generated 1501 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:57:20.986773 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6da7076b-a124-41e3-9ae3-4615f12fda5d tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c30f244f24b0897ec0631a33d91e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b587e152514b0f99c5e14e842d6ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:57:20.998836 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6da7076b-a124-41e3-9ae3-4615f12fda5d tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] 10.222.0.20 "GET /compute/v2.1/servers/de10d316-c43e-4ee9-b80b-131388bc91aa" status: 200 len: 1215 microversion: 2.1 time: 0.769861 Oct 27 03:57:21.003169 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3303/6322] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:57:20 2022] GET /compute/v2.1/servers/de10d316-c43e-4ee9-b80b-131388bc91aa => generated 1215 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:57:21.110344 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-490eb003-c223-4ead-89b1-9373ed878dde tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:57:21.114249 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-490eb003-c223-4ead-89b1-9373ed878dde tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 81aa9d61-7bd5-4e07-9101-e981526f00c9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:57:21.137164 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-490eb003-c223-4ead-89b1-9373ed878dde tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:21.137858 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-490eb003-c223-4ead-89b1-9373ed878dde tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:21.147884 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-490eb003-c223-4ead-89b1-9373ed878dde tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:21.148662 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-490eb003-c223-4ead-89b1-9373ed878dde tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:21.149141 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-490eb003-c223-4ead-89b1-9373ed878dde tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:21.149770 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-490eb003-c223-4ead-89b1-9373ed878dde tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:21.342299 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-554312e0-5190-4f25-93b5-33521f75d4fe req-f1ad3599-2c49-4e44-80a0-90d53ec075c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87044e4a-6da2-4df9-8148-f65756b22e2b", "name": "network-vif-deleted", "tag": "6348cfba-1a8a-4d2b-b9e9-19c54463cceb"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:57:21.353324 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-554312e0-5190-4f25-93b5-33521f75d4fe req-f1ad3599-2c49-4e44-80a0-90d53ec075c7 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:21.353811 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-554312e0-5190-4f25-93b5-33521f75d4fe req-f1ad3599-2c49-4e44-80a0-90d53ec075c7 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:21.354294 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-554312e0-5190-4f25-93b5-33521f75d4fe req-f1ad3599-2c49-4e44-80a0-90d53ec075c7 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:21.380602 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-554312e0-5190-4f25-93b5-33521f75d4fe req-f1ad3599-2c49-4e44-80a0-90d53ec075c7 service nova] Creating event network-vif-deleted:6348cfba-1a8a-4d2b-b9e9-19c54463cceb for instance 87044e4a-6da2-4df9-8148-f65756b22e2b on n-h2-862769-1 Oct 27 03:57:21.386150 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-554312e0-5190-4f25-93b5-33521f75d4fe req-f1ad3599-2c49-4e44-80a0-90d53ec075c7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047435 Oct 27 03:57:21.390818 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3304/6323] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:57:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:57:21.521330 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-490eb003-c223-4ead-89b1-9373ed878dde tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:57:21.534264 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-490eb003-c223-4ead-89b1-9373ed878dde tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9" status: 200 len: 1690 microversion: 2.1 time: 0.429830 Oct 27 03:57:21.537156 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3020/6324] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:57:21 2022] GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9 => generated 1690 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:57:21.702007 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8e1c24d5-b38f-4c65-bf7b-cf7bc91bd27e tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:57:21.703311 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8e1c24d5-b38f-4c65-bf7b-cf7bc91bd27e tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] [instance: 87044e4a-6da2-4df9-8148-f65756b22e2b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:57:21.717994 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8e1c24d5-b38f-4c65-bf7b-cf7bc91bd27e tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:21.718838 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8e1c24d5-b38f-4c65-bf7b-cf7bc91bd27e tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:21.736137 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8e1c24d5-b38f-4c65-bf7b-cf7bc91bd27e tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:21.739236 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8e1c24d5-b38f-4c65-bf7b-cf7bc91bd27e tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:21.742074 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8e1c24d5-b38f-4c65-bf7b-cf7bc91bd27e tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:21.742746 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8e1c24d5-b38f-4c65-bf7b-cf7bc91bd27e tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:21.810969 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8e1c24d5-b38f-4c65-bf7b-cf7bc91bd27e tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:21.812002 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8e1c24d5-b38f-4c65-bf7b-cf7bc91bd27e tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:21.813400 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8e1c24d5-b38f-4c65-bf7b-cf7bc91bd27e tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:21.814075 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-8e1c24d5-b38f-4c65-bf7b-cf7bc91bd27e tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Lazy-loading 'fault' on Instance uuid 87044e4a-6da2-4df9-8148-f65756b22e2b {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:57:21.883645 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-4bb93876-4b57-45e4-b235-d9ead5bc63d7 req-3ddd5d26-d26b-49f2-94f4-d9ee91e5c5df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81aa9d61-7bd5-4e07-9101-e981526f00c9", "name": "network-vif-plugged", "status": "completed", "tag": "e4aaef65-1861-4030-81f6-20ddb632987e"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:57:21.898535 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-4bb93876-4b57-45e4-b235-d9ead5bc63d7 req-3ddd5d26-d26b-49f2-94f4-d9ee91e5c5df service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:21.899170 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-4bb93876-4b57-45e4-b235-d9ead5bc63d7 req-3ddd5d26-d26b-49f2-94f4-d9ee91e5c5df service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:21.899787 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-4bb93876-4b57-45e4-b235-d9ead5bc63d7 req-3ddd5d26-d26b-49f2-94f4-d9ee91e5c5df service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:21.911398 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8e1c24d5-b38f-4c65-bf7b-cf7bc91bd27e tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd550aaeb0454a95a29b0bb575092d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2348420e184649abcd3b2cf05c5fff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:57:21.917996 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-4bb93876-4b57-45e4-b235-d9ead5bc63d7 req-3ddd5d26-d26b-49f2-94f4-d9ee91e5c5df service nova] Creating event network-vif-plugged:e4aaef65-1861-4030-81f6-20ddb632987e for instance 81aa9d61-7bd5-4e07-9101-e981526f00c9 on n-h2-862769-1 Oct 27 03:57:21.925253 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8e1c24d5-b38f-4c65-bf7b-cf7bc91bd27e tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] 10.222.0.20 "GET /compute/v2.1/servers/87044e4a-6da2-4df9-8148-f65756b22e2b" status: 200 len: 1301 microversion: 2.1 time: 0.227846 Oct 27 03:57:21.926450 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3305/6325] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:57:21 2022] GET /compute/v2.1/servers/87044e4a-6da2-4df9-8148-f65756b22e2b => generated 1301 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:57:21.926912 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [req-4bb93876-4b57-45e4-b235-d9ead5bc63d7 req-3ddd5d26-d26b-49f2-94f4-d9ee91e5c5df service nova] Instance 81aa9d61-7bd5-4e07-9101-e981526f00c9 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862769-1', 'n-h1-862769-1'} {{(pid=121000) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 03:57:21.949815 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-4bb93876-4b57-45e4-b235-d9ead5bc63d7 req-3ddd5d26-d26b-49f2-94f4-d9ee91e5c5df service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077292 Oct 27 03:57:21.950983 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3021/6326] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:57:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:57:22.023289 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5dcb71ec-fc8a-44b0-9a36-3206d4b0aed6 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:57:22.023923 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5dcb71ec-fc8a-44b0-9a36-3206d4b0aed6 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] [instance: de10d316-c43e-4ee9-b80b-131388bc91aa] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:57:22.102607 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5dcb71ec-fc8a-44b0-9a36-3206d4b0aed6 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c30f244f24b0897ec0631a33d91e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b587e152514b0f99c5e14e842d6ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:57:22.123658 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5dcb71ec-fc8a-44b0-9a36-3206d4b0aed6 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] 10.222.0.20 "GET /compute/v2.1/servers/de10d316-c43e-4ee9-b80b-131388bc91aa" status: 200 len: 1215 microversion: 2.1 time: 0.101608 Oct 27 03:57:22.123658 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3306/6327] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:57:22 2022] GET /compute/v2.1/servers/de10d316-c43e-4ee9-b80b-131388bc91aa => generated 1215 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:57:22.567948 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2845fc27-9ac8-441c-b92c-1a25ebdf198b tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:57:22.568901 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-2845fc27-9ac8-441c-b92c-1a25ebdf198b tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 81aa9d61-7bd5-4e07-9101-e981526f00c9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:57:22.585551 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2845fc27-9ac8-441c-b92c-1a25ebdf198b tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:22.586142 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2845fc27-9ac8-441c-b92c-1a25ebdf198b tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:22.586793 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2845fc27-9ac8-441c-b92c-1a25ebdf198b tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:22.587549 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2845fc27-9ac8-441c-b92c-1a25ebdf198b tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:22.588015 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2845fc27-9ac8-441c-b92c-1a25ebdf198b tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:22.588454 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2845fc27-9ac8-441c-b92c-1a25ebdf198b tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:22.891314 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2845fc27-9ac8-441c-b92c-1a25ebdf198b tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:57:22.908626 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2845fc27-9ac8-441c-b92c-1a25ebdf198b tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9" status: 200 len: 1690 microversion: 2.1 time: 0.340078 Oct 27 03:57:22.908626 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3022/6328] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:57:22 2022] GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9 => generated 1690 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:57:22.948782 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-238bb44b-c4b0-4f5b-bfe3-2c0ff9894c5e tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:57:22.949616 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-238bb44b-c4b0-4f5b-bfe3-2c0ff9894c5e tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] [instance: 87044e4a-6da2-4df9-8148-f65756b22e2b] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:57:22.966064 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-238bb44b-c4b0-4f5b-bfe3-2c0ff9894c5e tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:22.966568 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-238bb44b-c4b0-4f5b-bfe3-2c0ff9894c5e tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:22.967015 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-238bb44b-c4b0-4f5b-bfe3-2c0ff9894c5e tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:22.967938 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-238bb44b-c4b0-4f5b-bfe3-2c0ff9894c5e tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:22.968561 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-238bb44b-c4b0-4f5b-bfe3-2c0ff9894c5e tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:22.969313 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-238bb44b-c4b0-4f5b-bfe3-2c0ff9894c5e tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:23.065248 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-238bb44b-c4b0-4f5b-bfe3-2c0ff9894c5e tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:23.065925 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-238bb44b-c4b0-4f5b-bfe3-2c0ff9894c5e tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:23.066227 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-238bb44b-c4b0-4f5b-bfe3-2c0ff9894c5e tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:23.066699 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-238bb44b-c4b0-4f5b-bfe3-2c0ff9894c5e tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Lazy-loading 'fault' on Instance uuid 87044e4a-6da2-4df9-8148-f65756b22e2b {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:57:23.145185 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2b3b4304-2deb-4e6e-87f7-a266a8b52bbf tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:57:23.146611 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-2b3b4304-2deb-4e6e-87f7-a266a8b52bbf tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] [instance: de10d316-c43e-4ee9-b80b-131388bc91aa] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:57:23.153750 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2b3b4304-2deb-4e6e-87f7-a266a8b52bbf tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:23.153870 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2b3b4304-2deb-4e6e-87f7-a266a8b52bbf tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:23.154973 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2b3b4304-2deb-4e6e-87f7-a266a8b52bbf tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:23.156514 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2b3b4304-2deb-4e6e-87f7-a266a8b52bbf tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:23.157191 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2b3b4304-2deb-4e6e-87f7-a266a8b52bbf tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:23.157704 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2b3b4304-2deb-4e6e-87f7-a266a8b52bbf tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:23.174720 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-238bb44b-c4b0-4f5b-bfe3-2c0ff9894c5e tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd550aaeb0454a95a29b0bb575092d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2348420e184649abcd3b2cf05c5fff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:57:23.193445 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-238bb44b-c4b0-4f5b-bfe3-2c0ff9894c5e tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] 10.222.0.20 "GET /compute/v2.1/servers/87044e4a-6da2-4df9-8148-f65756b22e2b" status: 200 len: 1301 microversion: 2.1 time: 0.247236 Oct 27 03:57:23.194111 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3307/6329] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:57:22 2022] GET /compute/v2.1/servers/87044e4a-6da2-4df9-8148-f65756b22e2b => generated 1301 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:57:23.273072 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2b3b4304-2deb-4e6e-87f7-a266a8b52bbf tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c30f244f24b0897ec0631a33d91e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b587e152514b0f99c5e14e842d6ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:57:23.283938 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2b3b4304-2deb-4e6e-87f7-a266a8b52bbf tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] 10.222.0.20 "GET /compute/v2.1/servers/de10d316-c43e-4ee9-b80b-131388bc91aa" status: 200 len: 1267 microversion: 2.1 time: 0.140892 Oct 27 03:57:23.283938 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3023/6330] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:57:23 2022] GET /compute/v2.1/servers/de10d316-c43e-4ee9-b80b-131388bc91aa => generated 1267 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:57:23.956071 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-143c51ce-d75b-4476-8d9a-7bb43e861f82 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:57:23.960366 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-143c51ce-d75b-4476-8d9a-7bb43e861f82 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 81aa9d61-7bd5-4e07-9101-e981526f00c9] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:57:23.996477 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-143c51ce-d75b-4476-8d9a-7bb43e861f82 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:23.996988 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-143c51ce-d75b-4476-8d9a-7bb43e861f82 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:23.997440 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-143c51ce-d75b-4476-8d9a-7bb43e861f82 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:24.006342 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-143c51ce-d75b-4476-8d9a-7bb43e861f82 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:24.011277 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-143c51ce-d75b-4476-8d9a-7bb43e861f82 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:24.013898 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-143c51ce-d75b-4476-8d9a-7bb43e861f82 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:24.228335 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-cb3ba045-bcd3-4fbf-b120-949071bc4962 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:57:24.229562 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-cb3ba045-bcd3-4fbf-b120-949071bc4962 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] [instance: 87044e4a-6da2-4df9-8148-f65756b22e2b] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:57:24.238942 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cb3ba045-bcd3-4fbf-b120-949071bc4962 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:24.239699 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cb3ba045-bcd3-4fbf-b120-949071bc4962 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:24.240294 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cb3ba045-bcd3-4fbf-b120-949071bc4962 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:24.241326 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cb3ba045-bcd3-4fbf-b120-949071bc4962 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:24.241984 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cb3ba045-bcd3-4fbf-b120-949071bc4962 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:24.242587 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cb3ba045-bcd3-4fbf-b120-949071bc4962 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:24.280306 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-cb3ba045-bcd3-4fbf-b120-949071bc4962 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] HTTP exception thrown: Instance 87044e4a-6da2-4df9-8148-f65756b22e2b could not be found. Oct 27 03:57:24.285332 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-cb3ba045-bcd3-4fbf-b120-949071bc4962 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Request method failure captured: Oct 27 03:57:24.285332 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/87044e4a-6da2-4df9-8148-f65756b22e2b HTTP/1.1 Oct 27 03:57:24.285332 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:57:24.285332 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:57:24.285332 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:57:24.285332 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:57:24.285332 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:57:24.285332 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:57:24.285332 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:57:24.285332 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:57:24.285332 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWgF-v8Jfs_0q0z-pmeuUfJp4ByPjiMmu5N0PzxlQHhWP9w-j24njXxoqDddOX3ZT_pZCMCElBO6xliI99dSc-IQjHdY6jbsuCV9m-LD25-5cdAibKVVzx0ZxHxTaqcetYEkOL5mrwCMGZCO1nKYZ74xNzrdTHOLqqb_mdkOJ9_RxKBM Oct 27 03:57:24.285332 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:57:24.285332 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:57:24.285332 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:57:24.285332 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:57:24.285332 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:57:24.285332 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:57:24.285332 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 4f2348420e184649abcd3b2cf05c5fff Oct 27 03:57:24.285332 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-VolumesActionsTest-2070018148 Oct 27 03:57:24.285332 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:57:24.285332 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:57:24.285332 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4f2348420e184649abcd3b2cf05c5fff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4f2348420e184649abcd3b2cf05c5fff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4f2348420e184649abcd3b2cf05c5fff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4f2348420e184649abcd3b2cf05c5fff"}]}] Oct 27 03:57:24.285332 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-VolumesActionsTest-2070018148 Oct 27 03:57:24.285332 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 4f2348420e184649abcd3b2cf05c5fff Oct 27 03:57:24.285332 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-VolumesActionsTest-2070018148 Oct 27 03:57:24.285332 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-VolumesActionsTest-2070018148-project Oct 27 03:57:24.285332 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:57:24.285332 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:57:24.285332 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: bd550aaeb0454a95a29b0bb575092d85 Oct 27 03:57:24.285332 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-VolumesActionsTest-2070018148-project Oct 27 03:57:24.285332 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:57:24.285332 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 87044e4a-6da2-4df9-8148-f65756b22e2b could not be found. Oct 27 03:57:24.285332 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '87044e4a-6da2-4df9-8148-f65756b22e2b'} Oct 27 03:57:24.285332 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:57:24.285332 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:57:24.285332 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:57:24.285332 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:57:24.285332 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:57:24.285332 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:57:24.285332 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:57:24.285332 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:57:24.285332 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:57:24.285332 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:57:24.285332 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87044e4a-6da2-4df9-8148-f65756b22e2b could not be found. Oct 27 03:57:24.285332 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:57:24.285332 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:57:24.285332 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:57:24.285332 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:57:24.285332 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:57:24.285332 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:57:24.285332 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:57:24.285332 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:57:24.285332 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:57:24.285332 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:57:24.285332 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:57:24.285332 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:57:24.285332 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:57:24.285332 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:57:24.285332 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:57:24.285332 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:57:24.285332 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87044e4a-6da2-4df9-8148-f65756b22e2b could not be found. Oct 27 03:57:24.285332 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:57:24.285332 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:57:24.285332 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:57:24.294240 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:57:24.294240 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:57:24.294240 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:57:24.294240 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:57:24.294240 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:57:24.294240 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87044e4a-6da2-4df9-8148-f65756b22e2b could not be found. Oct 27 03:57:24.294240 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:57:24.294240 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-cb3ba045-bcd3-4fbf-b120-949071bc4962 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] Returning 404 to user: Instance 87044e4a-6da2-4df9-8148-f65756b22e2b could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:57:24.294240 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-cb3ba045-bcd3-4fbf-b120-949071bc4962 tempest-VolumesActionsTest-2070018148 tempest-VolumesActionsTest-2070018148-project] 10.222.0.20 "GET /compute/v2.1/servers/87044e4a-6da2-4df9-8148-f65756b22e2b" status: 404 len: 111 microversion: 2.1 time: 0.065538 Oct 27 03:57:24.294240 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3024/6331] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:57:24 2022] GET /compute/v2.1/servers/87044e4a-6da2-4df9-8148-f65756b22e2b => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:57:24.307244 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-150b1bef-4fe5-44d3-9186-c983d42f1b7e tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:57:24.308016 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-150b1bef-4fe5-44d3-9186-c983d42f1b7e tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] [instance: de10d316-c43e-4ee9-b80b-131388bc91aa] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:57:24.322226 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-150b1bef-4fe5-44d3-9186-c983d42f1b7e tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:24.322810 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-150b1bef-4fe5-44d3-9186-c983d42f1b7e tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:24.323442 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-150b1bef-4fe5-44d3-9186-c983d42f1b7e tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:24.324300 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-150b1bef-4fe5-44d3-9186-c983d42f1b7e tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:24.324827 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-150b1bef-4fe5-44d3-9186-c983d42f1b7e tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:24.325599 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-150b1bef-4fe5-44d3-9186-c983d42f1b7e tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:24.423584 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-150b1bef-4fe5-44d3-9186-c983d42f1b7e tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c30f244f24b0897ec0631a33d91e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b587e152514b0f99c5e14e842d6ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:57:24.444724 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-150b1bef-4fe5-44d3-9186-c983d42f1b7e tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] 10.222.0.20 "GET /compute/v2.1/servers/de10d316-c43e-4ee9-b80b-131388bc91aa" status: 200 len: 1285 microversion: 2.1 time: 0.141322 Oct 27 03:57:24.447870 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3025/6332] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:57:24 2022] GET /compute/v2.1/servers/de10d316-c43e-4ee9-b80b-131388bc91aa => generated 1285 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:57:24.607808 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-143c51ce-d75b-4476-8d9a-7bb43e861f82 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:57:24.643106 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-143c51ce-d75b-4476-8d9a-7bb43e861f82 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9" status: 200 len: 1690 microversion: 2.1 time: 0.715441 Oct 27 03:57:24.658075 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3308/6333] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:57:23 2022] GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9 => generated 1690 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:57:25.472493 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-145367d9-8800-4d95-8f56-05a5ccedf787 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:57:25.473867 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-145367d9-8800-4d95-8f56-05a5ccedf787 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] [instance: de10d316-c43e-4ee9-b80b-131388bc91aa] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:57:25.482411 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-145367d9-8800-4d95-8f56-05a5ccedf787 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:25.483046 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-145367d9-8800-4d95-8f56-05a5ccedf787 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:25.483656 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-145367d9-8800-4d95-8f56-05a5ccedf787 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:25.484526 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-145367d9-8800-4d95-8f56-05a5ccedf787 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:25.485056 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-145367d9-8800-4d95-8f56-05a5ccedf787 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:25.485675 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-145367d9-8800-4d95-8f56-05a5ccedf787 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:25.622894 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-145367d9-8800-4d95-8f56-05a5ccedf787 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c30f244f24b0897ec0631a33d91e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b587e152514b0f99c5e14e842d6ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:57:25.634837 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-145367d9-8800-4d95-8f56-05a5ccedf787 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] 10.222.0.20 "GET /compute/v2.1/servers/de10d316-c43e-4ee9-b80b-131388bc91aa" status: 200 len: 1273 microversion: 2.1 time: 0.166918 Oct 27 03:57:25.643910 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3026/6334] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:57:25 2022] GET /compute/v2.1/servers/de10d316-c43e-4ee9-b80b-131388bc91aa => generated 1273 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:57:25.673873 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-38eacc43-05eb-4bf4-8243-b39b2aad43a1 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:57:25.674655 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-38eacc43-05eb-4bf4-8243-b39b2aad43a1 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 81aa9d61-7bd5-4e07-9101-e981526f00c9] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:57:25.695999 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-38eacc43-05eb-4bf4-8243-b39b2aad43a1 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:25.703540 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-38eacc43-05eb-4bf4-8243-b39b2aad43a1 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:25.704797 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-38eacc43-05eb-4bf4-8243-b39b2aad43a1 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:25.707801 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-38eacc43-05eb-4bf4-8243-b39b2aad43a1 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:25.709827 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-38eacc43-05eb-4bf4-8243-b39b2aad43a1 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:25.711338 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-38eacc43-05eb-4bf4-8243-b39b2aad43a1 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:25.949209 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-38eacc43-05eb-4bf4-8243-b39b2aad43a1 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:57:25.958222 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-38eacc43-05eb-4bf4-8243-b39b2aad43a1 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9" status: 200 len: 1690 microversion: 2.1 time: 0.288869 Oct 27 03:57:25.959248 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3309/6335] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:57:25 2022] GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9 => generated 1690 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:57:25.985296 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-fb30c071-af59-463d-a0d3-abf9f490f50c req-3574636d-cda8-44fb-abd3-643d163ac75b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81aa9d61-7bd5-4e07-9101-e981526f00c9", "name": "network-vif-unplugged", "status": "completed", "tag": "e4aaef65-1861-4030-81f6-20ddb632987e"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:57:26.022540 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-fb30c071-af59-463d-a0d3-abf9f490f50c req-3574636d-cda8-44fb-abd3-643d163ac75b service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:26.023057 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-fb30c071-af59-463d-a0d3-abf9f490f50c req-3574636d-cda8-44fb-abd3-643d163ac75b service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:26.026572 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-fb30c071-af59-463d-a0d3-abf9f490f50c req-3574636d-cda8-44fb-abd3-643d163ac75b service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:26.074648 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-fb30c071-af59-463d-a0d3-abf9f490f50c req-3574636d-cda8-44fb-abd3-643d163ac75b service nova] Creating event network-vif-unplugged:e4aaef65-1861-4030-81f6-20ddb632987e for instance 81aa9d61-7bd5-4e07-9101-e981526f00c9 on n-h1-862769-1 Oct 27 03:57:26.098589 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [req-fb30c071-af59-463d-a0d3-abf9f490f50c req-3574636d-cda8-44fb-abd3-643d163ac75b service nova] Instance 81aa9d61-7bd5-4e07-9101-e981526f00c9 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862769-1', 'n-h1-862769-1'} {{(pid=121000) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 03:57:26.131021 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-fb30c071-af59-463d-a0d3-abf9f490f50c req-3574636d-cda8-44fb-abd3-643d163ac75b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.153614 Oct 27 03:57:26.132913 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3027/6336] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:57:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:57:26.672525 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5a0393c2-bd44-413b-adc9-797993b8302f tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:57:26.673450 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5a0393c2-bd44-413b-adc9-797993b8302f tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] [instance: de10d316-c43e-4ee9-b80b-131388bc91aa] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:57:26.680654 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5a0393c2-bd44-413b-adc9-797993b8302f tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:26.681913 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5a0393c2-bd44-413b-adc9-797993b8302f tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:26.682570 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5a0393c2-bd44-413b-adc9-797993b8302f tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:26.683494 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5a0393c2-bd44-413b-adc9-797993b8302f tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:26.684162 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5a0393c2-bd44-413b-adc9-797993b8302f tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:26.684810 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5a0393c2-bd44-413b-adc9-797993b8302f tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:26.986256 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-811faa68-5cbf-4c55-8797-7deb99430ab5 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:57:26.986979 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-811faa68-5cbf-4c55-8797-7deb99430ab5 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 81aa9d61-7bd5-4e07-9101-e981526f00c9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:57:27.009317 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-811faa68-5cbf-4c55-8797-7deb99430ab5 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:27.013597 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-811faa68-5cbf-4c55-8797-7deb99430ab5 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:27.018392 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-811faa68-5cbf-4c55-8797-7deb99430ab5 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:27.019097 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-811faa68-5cbf-4c55-8797-7deb99430ab5 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:27.019715 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-811faa68-5cbf-4c55-8797-7deb99430ab5 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:27.020181 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-811faa68-5cbf-4c55-8797-7deb99430ab5 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:27.209100 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5a0393c2-bd44-413b-adc9-797993b8302f tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c30f244f24b0897ec0631a33d91e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b587e152514b0f99c5e14e842d6ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:57:27.220350 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5a0393c2-bd44-413b-adc9-797993b8302f tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] 10.222.0.20 "GET /compute/v2.1/servers/de10d316-c43e-4ee9-b80b-131388bc91aa" status: 200 len: 1315 microversion: 2.1 time: 0.549287 Oct 27 03:57:27.221597 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3310/6337] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:57:26 2022] GET /compute/v2.1/servers/de10d316-c43e-4ee9-b80b-131388bc91aa => generated 1315 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:57:27.309837 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-811faa68-5cbf-4c55-8797-7deb99430ab5 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:57:27.313692 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:57:27.322419 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-811faa68-5cbf-4c55-8797-7deb99430ab5 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9" status: 200 len: 1690 microversion: 2.1 time: 0.341269 Oct 27 03:57:27.323022 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3028/6338] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:57:26 2022] GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9 => generated 1690 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:57:28.252613 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f4cbac9a-60d6-43f4-8d05-9996940e78f6 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:57:28.253922 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f4cbac9a-60d6-43f4-8d05-9996940e78f6 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] [instance: de10d316-c43e-4ee9-b80b-131388bc91aa] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:57:28.274353 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-7859f90b-f51f-4b70-aecf-5271dbd5b9bf req-0b76f18c-a520-49e3-93ee-32fb64c487c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81aa9d61-7bd5-4e07-9101-e981526f00c9", "tag": "e4aaef65-1861-4030-81f6-20ddb632987e"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:57:28.279550 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f4cbac9a-60d6-43f4-8d05-9996940e78f6 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:28.282650 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f4cbac9a-60d6-43f4-8d05-9996940e78f6 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:28.284957 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f4cbac9a-60d6-43f4-8d05-9996940e78f6 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:28.285939 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f4cbac9a-60d6-43f4-8d05-9996940e78f6 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:28.287108 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f4cbac9a-60d6-43f4-8d05-9996940e78f6 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:28.288636 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f4cbac9a-60d6-43f4-8d05-9996940e78f6 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:28.304513 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-7859f90b-f51f-4b70-aecf-5271dbd5b9bf req-0b76f18c-a520-49e3-93ee-32fb64c487c3 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:28.305285 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-7859f90b-f51f-4b70-aecf-5271dbd5b9bf req-0b76f18c-a520-49e3-93ee-32fb64c487c3 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:28.308921 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-7859f90b-f51f-4b70-aecf-5271dbd5b9bf req-0b76f18c-a520-49e3-93ee-32fb64c487c3 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:28.335818 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-7859f90b-f51f-4b70-aecf-5271dbd5b9bf req-0b76f18c-a520-49e3-93ee-32fb64c487c3 service nova] Creating event network-changed:e4aaef65-1861-4030-81f6-20ddb632987e for instance 81aa9d61-7bd5-4e07-9101-e981526f00c9 on n-h1-862769-1 Oct 27 03:57:28.351266 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [req-7859f90b-f51f-4b70-aecf-5271dbd5b9bf req-0b76f18c-a520-49e3-93ee-32fb64c487c3 service nova] Instance 81aa9d61-7bd5-4e07-9101-e981526f00c9 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862769-1', 'n-h1-862769-1'} {{(pid=121000) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 03:57:28.372019 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-7859f90b-f51f-4b70-aecf-5271dbd5b9bf req-0b76f18c-a520-49e3-93ee-32fb64c487c3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102222 Oct 27 03:57:28.373330 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3029/6339] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:57:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:57:28.379674 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-79c44f25-e0fb-4143-9bdf-d38b28ae0d6f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:57:28.380790 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-79c44f25-e0fb-4143-9bdf-d38b28ae0d6f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 81aa9d61-7bd5-4e07-9101-e981526f00c9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:57:28.388250 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-79c44f25-e0fb-4143-9bdf-d38b28ae0d6f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:28.389281 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-79c44f25-e0fb-4143-9bdf-d38b28ae0d6f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:28.389911 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-79c44f25-e0fb-4143-9bdf-d38b28ae0d6f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:28.391150 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-79c44f25-e0fb-4143-9bdf-d38b28ae0d6f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:28.391839 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-79c44f25-e0fb-4143-9bdf-d38b28ae0d6f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:28.392417 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-79c44f25-e0fb-4143-9bdf-d38b28ae0d6f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:28.779180 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-79c44f25-e0fb-4143-9bdf-d38b28ae0d6f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:57:28.794323 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-79c44f25-e0fb-4143-9bdf-d38b28ae0d6f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9" status: 200 len: 1690 microversion: 2.1 time: 0.419437 Oct 27 03:57:28.798066 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3030/6340] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:57:28 2022] GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9 => generated 1690 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:57:28.929971 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-7f272799-999d-41fe-bd82-d80f9c9ff970 req-8f235d24-f617-4e4b-824f-9dd2f974ecb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de10d316-c43e-4ee9-b80b-131388bc91aa", "tag": "e101c25c-d75b-47cb-9ef7-2130a824cf00"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:57:28.940981 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f4cbac9a-60d6-43f4-8d05-9996940e78f6 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c30f244f24b0897ec0631a33d91e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b587e152514b0f99c5e14e842d6ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:57:28.946324 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-7f272799-999d-41fe-bd82-d80f9c9ff970 req-8f235d24-f617-4e4b-824f-9dd2f974ecb3 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:28.947223 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-7f272799-999d-41fe-bd82-d80f9c9ff970 req-8f235d24-f617-4e4b-824f-9dd2f974ecb3 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:28.947825 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-7f272799-999d-41fe-bd82-d80f9c9ff970 req-8f235d24-f617-4e4b-824f-9dd2f974ecb3 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:28.953346 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f4cbac9a-60d6-43f4-8d05-9996940e78f6 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] 10.222.0.20 "GET /compute/v2.1/servers/de10d316-c43e-4ee9-b80b-131388bc91aa" status: 200 len: 1315 microversion: 2.1 time: 0.703175 Oct 27 03:57:28.954072 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3311/6341] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:57:28 2022] GET /compute/v2.1/servers/de10d316-c43e-4ee9-b80b-131388bc91aa => generated 1315 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:57:28.973462 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-7f272799-999d-41fe-bd82-d80f9c9ff970 req-8f235d24-f617-4e4b-824f-9dd2f974ecb3 service nova] Creating event network-changed:e101c25c-d75b-47cb-9ef7-2130a824cf00 for instance de10d316-c43e-4ee9-b80b-131388bc91aa on n-h1-862769-1 Oct 27 03:57:28.979976 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-7f272799-999d-41fe-bd82-d80f9c9ff970 req-8f235d24-f617-4e4b-824f-9dd2f974ecb3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.180452 Oct 27 03:57:28.980790 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3031/6342] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:57:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:57:29.831869 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b976a8e7-5b8b-4d94-b0b8-4456c16f6c71 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:57:29.833141 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b976a8e7-5b8b-4d94-b0b8-4456c16f6c71 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 81aa9d61-7bd5-4e07-9101-e981526f00c9] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:57:29.843045 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b976a8e7-5b8b-4d94-b0b8-4456c16f6c71 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:29.843580 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b976a8e7-5b8b-4d94-b0b8-4456c16f6c71 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:29.844025 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b976a8e7-5b8b-4d94-b0b8-4456c16f6c71 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:29.845157 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b976a8e7-5b8b-4d94-b0b8-4456c16f6c71 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:29.845787 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b976a8e7-5b8b-4d94-b0b8-4456c16f6c71 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:29.846489 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b976a8e7-5b8b-4d94-b0b8-4456c16f6c71 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:29.940651 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:57:29.981627 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8bf2d6e4-950a-453e-a5cb-6c9df705dd2b tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:57:29.982384 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8bf2d6e4-950a-453e-a5cb-6c9df705dd2b tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] [instance: de10d316-c43e-4ee9-b80b-131388bc91aa] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:57:29.991247 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8bf2d6e4-950a-453e-a5cb-6c9df705dd2b tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:29.991754 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8bf2d6e4-950a-453e-a5cb-6c9df705dd2b tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:29.992209 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8bf2d6e4-950a-453e-a5cb-6c9df705dd2b tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:29.992946 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8bf2d6e4-950a-453e-a5cb-6c9df705dd2b tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:29.993559 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8bf2d6e4-950a-453e-a5cb-6c9df705dd2b tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:29.994007 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8bf2d6e4-950a-453e-a5cb-6c9df705dd2b tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:30.057174 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b976a8e7-5b8b-4d94-b0b8-4456c16f6c71 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:57:30.075946 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b976a8e7-5b8b-4d94-b0b8-4456c16f6c71 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9" status: 200 len: 1690 microversion: 2.1 time: 0.244466 Oct 27 03:57:30.076597 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3312/6343] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:57:29 2022] GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9 => generated 1690 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:57:30.265485 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8bf2d6e4-950a-453e-a5cb-6c9df705dd2b tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c30f244f24b0897ec0631a33d91e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b587e152514b0f99c5e14e842d6ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:57:30.276739 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8bf2d6e4-950a-453e-a5cb-6c9df705dd2b tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] 10.222.0.20 "GET /compute/v2.1/servers/de10d316-c43e-4ee9-b80b-131388bc91aa" status: 200 len: 1315 microversion: 2.1 time: 0.299170 Oct 27 03:57:30.292340 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3032/6344] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:57:29 2022] GET /compute/v2.1/servers/de10d316-c43e-4ee9-b80b-131388bc91aa => generated 1315 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:57:31.104028 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-14f97e33-d493-4379-afa9-e498f6f2fde6 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:57:31.104785 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-14f97e33-d493-4379-afa9-e498f6f2fde6 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 81aa9d61-7bd5-4e07-9101-e981526f00c9] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:57:31.122581 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-14f97e33-d493-4379-afa9-e498f6f2fde6 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:31.123095 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-14f97e33-d493-4379-afa9-e498f6f2fde6 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:31.123558 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-14f97e33-d493-4379-afa9-e498f6f2fde6 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:31.124338 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-14f97e33-d493-4379-afa9-e498f6f2fde6 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:31.125325 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-14f97e33-d493-4379-afa9-e498f6f2fde6 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:31.125836 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-14f97e33-d493-4379-afa9-e498f6f2fde6 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:31.304832 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6d732103-4883-46bc-91d0-9ac216a2607b tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:57:31.305513 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6d732103-4883-46bc-91d0-9ac216a2607b tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] [instance: de10d316-c43e-4ee9-b80b-131388bc91aa] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:57:31.339430 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6d732103-4883-46bc-91d0-9ac216a2607b tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:31.342710 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6d732103-4883-46bc-91d0-9ac216a2607b tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:31.347492 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6d732103-4883-46bc-91d0-9ac216a2607b tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:31.348611 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6d732103-4883-46bc-91d0-9ac216a2607b tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:31.350756 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6d732103-4883-46bc-91d0-9ac216a2607b tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:31.356181 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6d732103-4883-46bc-91d0-9ac216a2607b tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:31.963382 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-14f97e33-d493-4379-afa9-e498f6f2fde6 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:57:31.991444 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-14f97e33-d493-4379-afa9-e498f6f2fde6 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9" status: 200 len: 1690 microversion: 2.1 time: 0.889434 Oct 27 03:57:31.995354 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3313/6345] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:57:31 2022] GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9 => generated 1690 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:57:32.080470 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-6d732103-4883-46bc-91d0-9ac216a2607b tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c30f244f24b0897ec0631a33d91e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b587e152514b0f99c5e14e842d6ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:57:32.101000 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6d732103-4883-46bc-91d0-9ac216a2607b tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] 10.222.0.20 "GET /compute/v2.1/servers/de10d316-c43e-4ee9-b80b-131388bc91aa" status: 200 len: 1315 microversion: 2.1 time: 0.800956 Oct 27 03:57:32.110929 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3033/6346] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:57:31 2022] GET /compute/v2.1/servers/de10d316-c43e-4ee9-b80b-131388bc91aa => generated 1315 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:57:33.053625 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3050c9f6-83cf-402e-ba48-bbe66a97547f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:57:33.055504 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3050c9f6-83cf-402e-ba48-bbe66a97547f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 81aa9d61-7bd5-4e07-9101-e981526f00c9] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:57:33.096628 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=10 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:57:33.096628 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3050c9f6-83cf-402e-ba48-bbe66a97547f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:33.096628 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3050c9f6-83cf-402e-ba48-bbe66a97547f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:33.096628 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3050c9f6-83cf-402e-ba48-bbe66a97547f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:33.103580 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3050c9f6-83cf-402e-ba48-bbe66a97547f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:33.106284 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3050c9f6-83cf-402e-ba48-bbe66a97547f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:33.116252 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3050c9f6-83cf-402e-ba48-bbe66a97547f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:33.139715 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-96c5873e-48c0-4bb1-b801-3ead25d55ba8 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:57:33.143867 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-96c5873e-48c0-4bb1-b801-3ead25d55ba8 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] [instance: de10d316-c43e-4ee9-b80b-131388bc91aa] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:57:33.175496 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-96c5873e-48c0-4bb1-b801-3ead25d55ba8 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:33.184354 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-96c5873e-48c0-4bb1-b801-3ead25d55ba8 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:33.186823 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-96c5873e-48c0-4bb1-b801-3ead25d55ba8 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:33.200289 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-96c5873e-48c0-4bb1-b801-3ead25d55ba8 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:33.204702 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-96c5873e-48c0-4bb1-b801-3ead25d55ba8 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:33.208781 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-96c5873e-48c0-4bb1-b801-3ead25d55ba8 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:33.564074 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3050c9f6-83cf-402e-ba48-bbe66a97547f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:57:33.592676 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3050c9f6-83cf-402e-ba48-bbe66a97547f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9" status: 200 len: 1683 microversion: 2.1 time: 0.556666 Oct 27 03:57:33.593366 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3314/6347] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:57:33 2022] GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9 => generated 1683 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:57:33.804698 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-96c5873e-48c0-4bb1-b801-3ead25d55ba8 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c30f244f24b0897ec0631a33d91e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b587e152514b0f99c5e14e842d6ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:57:33.837356 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-96c5873e-48c0-4bb1-b801-3ead25d55ba8 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] 10.222.0.20 "GET /compute/v2.1/servers/de10d316-c43e-4ee9-b80b-131388bc91aa" status: 200 len: 1315 microversion: 2.1 time: 0.701819 Oct 27 03:57:33.841181 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3034/6348] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:57:33 2022] GET /compute/v2.1/servers/de10d316-c43e-4ee9-b80b-131388bc91aa => generated 1315 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:57:33.845926 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-4b3ac9d9-cf1d-47cc-b76a-77097dd40bc3 req-be2da881-b7b8-429a-bb41-83caf7747010 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81aa9d61-7bd5-4e07-9101-e981526f00c9", "name": "network-vif-plugged", "status": "completed", "tag": "e4aaef65-1861-4030-81f6-20ddb632987e"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:57:33.865050 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-4b3ac9d9-cf1d-47cc-b76a-77097dd40bc3 req-be2da881-b7b8-429a-bb41-83caf7747010 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:33.865875 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-4b3ac9d9-cf1d-47cc-b76a-77097dd40bc3 req-be2da881-b7b8-429a-bb41-83caf7747010 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:33.866582 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-4b3ac9d9-cf1d-47cc-b76a-77097dd40bc3 req-be2da881-b7b8-429a-bb41-83caf7747010 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:33.888522 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-4b3ac9d9-cf1d-47cc-b76a-77097dd40bc3 req-be2da881-b7b8-429a-bb41-83caf7747010 service nova] Creating event network-vif-plugged:e4aaef65-1861-4030-81f6-20ddb632987e for instance 81aa9d61-7bd5-4e07-9101-e981526f00c9 on n-h1-862769-1 Oct 27 03:57:33.897307 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-4b3ac9d9-cf1d-47cc-b76a-77097dd40bc3 req-be2da881-b7b8-429a-bb41-83caf7747010 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062860 Oct 27 03:57:33.899756 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3315/6349] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:57:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:57:34.871155 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4266e87e-f6cc-4fed-a831-3c514f6f7926 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:57:34.872496 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4266e87e-f6cc-4fed-a831-3c514f6f7926 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] [instance: de10d316-c43e-4ee9-b80b-131388bc91aa] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:57:34.885327 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4266e87e-f6cc-4fed-a831-3c514f6f7926 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:34.893151 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4266e87e-f6cc-4fed-a831-3c514f6f7926 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:34.893943 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4266e87e-f6cc-4fed-a831-3c514f6f7926 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:34.897271 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4266e87e-f6cc-4fed-a831-3c514f6f7926 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:34.897271 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4266e87e-f6cc-4fed-a831-3c514f6f7926 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:34.897763 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4266e87e-f6cc-4fed-a831-3c514f6f7926 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:35.073825 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4266e87e-f6cc-4fed-a831-3c514f6f7926 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c30f244f24b0897ec0631a33d91e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b587e152514b0f99c5e14e842d6ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:57:35.099100 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4266e87e-f6cc-4fed-a831-3c514f6f7926 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] 10.222.0.20 "GET /compute/v2.1/servers/de10d316-c43e-4ee9-b80b-131388bc91aa" status: 200 len: 1315 microversion: 2.1 time: 0.226639 Oct 27 03:57:35.099738 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3035/6350] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:57:34 2022] GET /compute/v2.1/servers/de10d316-c43e-4ee9-b80b-131388bc91aa => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:57:36.145424 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-37c807ea-799b-419e-826c-b89a2a594eec tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:57:36.146093 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-37c807ea-799b-419e-826c-b89a2a594eec tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] [instance: de10d316-c43e-4ee9-b80b-131388bc91aa] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:57:36.178228 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-37c807ea-799b-419e-826c-b89a2a594eec tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:36.179475 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-37c807ea-799b-419e-826c-b89a2a594eec tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:36.181550 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-37c807ea-799b-419e-826c-b89a2a594eec tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:36.183474 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-37c807ea-799b-419e-826c-b89a2a594eec tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:36.184327 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-37c807ea-799b-419e-826c-b89a2a594eec tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:36.186145 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-37c807ea-799b-419e-826c-b89a2a594eec tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:36.197379 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:57:36.599458 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-37c807ea-799b-419e-826c-b89a2a594eec tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c30f244f24b0897ec0631a33d91e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b587e152514b0f99c5e14e842d6ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:57:36.612359 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-37c807ea-799b-419e-826c-b89a2a594eec tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] 10.222.0.20 "GET /compute/v2.1/servers/de10d316-c43e-4ee9-b80b-131388bc91aa" status: 200 len: 1315 microversion: 2.1 time: 0.490604 Oct 27 03:57:36.613311 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3316/6351] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:57:36 2022] GET /compute/v2.1/servers/de10d316-c43e-4ee9-b80b-131388bc91aa => generated 1315 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:57:37.640099 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9f806d47-1aa6-40b4-9824-6bf32d23db7f tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:57:37.645892 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9f806d47-1aa6-40b4-9824-6bf32d23db7f tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] [instance: de10d316-c43e-4ee9-b80b-131388bc91aa] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:57:37.655155 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9f806d47-1aa6-40b4-9824-6bf32d23db7f tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:37.655670 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9f806d47-1aa6-40b4-9824-6bf32d23db7f tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:37.656119 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9f806d47-1aa6-40b4-9824-6bf32d23db7f tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:37.657449 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9f806d47-1aa6-40b4-9824-6bf32d23db7f tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:37.657902 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9f806d47-1aa6-40b4-9824-6bf32d23db7f tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:37.658634 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9f806d47-1aa6-40b4-9824-6bf32d23db7f tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:37.942574 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9f806d47-1aa6-40b4-9824-6bf32d23db7f tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c30f244f24b0897ec0631a33d91e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b587e152514b0f99c5e14e842d6ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:57:37.952014 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9f806d47-1aa6-40b4-9824-6bf32d23db7f tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] 10.222.0.20 "GET /compute/v2.1/servers/de10d316-c43e-4ee9-b80b-131388bc91aa" status: 200 len: 1315 microversion: 2.1 time: 0.316665 Oct 27 03:57:37.957198 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3036/6352] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:57:37 2022] GET /compute/v2.1/servers/de10d316-c43e-4ee9-b80b-131388bc91aa => generated 1315 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:57:38.100204 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-bb040f73-4f34-493b-9b57-78a4d32baa34 req-3ec9211e-d907-46ad-895c-42297dbcf927 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de10d316-c43e-4ee9-b80b-131388bc91aa", "name": "network-vif-plugged", "status": "completed", "tag": "e101c25c-d75b-47cb-9ef7-2130a824cf00"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:57:38.113554 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-bb040f73-4f34-493b-9b57-78a4d32baa34 req-3ec9211e-d907-46ad-895c-42297dbcf927 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:38.114057 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-bb040f73-4f34-493b-9b57-78a4d32baa34 req-3ec9211e-d907-46ad-895c-42297dbcf927 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:38.114633 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-bb040f73-4f34-493b-9b57-78a4d32baa34 req-3ec9211e-d907-46ad-895c-42297dbcf927 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:38.127119 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-bb040f73-4f34-493b-9b57-78a4d32baa34 req-3ec9211e-d907-46ad-895c-42297dbcf927 service nova] Creating event network-vif-plugged:e101c25c-d75b-47cb-9ef7-2130a824cf00 for instance de10d316-c43e-4ee9-b80b-131388bc91aa on n-h1-862769-1 Oct 27 03:57:38.132064 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-bb040f73-4f34-493b-9b57-78a4d32baa34 req-3ec9211e-d907-46ad-895c-42297dbcf927 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135146 Oct 27 03:57:38.133104 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3317/6353] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:57:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:57:38.981360 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a6eacc4f-2d7c-466e-ad7d-77f278b7a402 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:57:38.982541 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a6eacc4f-2d7c-466e-ad7d-77f278b7a402 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] [instance: de10d316-c43e-4ee9-b80b-131388bc91aa] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:57:38.992055 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a6eacc4f-2d7c-466e-ad7d-77f278b7a402 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:38.992782 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a6eacc4f-2d7c-466e-ad7d-77f278b7a402 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:38.993616 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a6eacc4f-2d7c-466e-ad7d-77f278b7a402 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:38.994551 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a6eacc4f-2d7c-466e-ad7d-77f278b7a402 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:38.995393 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a6eacc4f-2d7c-466e-ad7d-77f278b7a402 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:38.995974 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a6eacc4f-2d7c-466e-ad7d-77f278b7a402 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:39.720828 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a6eacc4f-2d7c-466e-ad7d-77f278b7a402 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c30f244f24b0897ec0631a33d91e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b587e152514b0f99c5e14e842d6ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:57:39.730987 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a6eacc4f-2d7c-466e-ad7d-77f278b7a402 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] 10.222.0.20 "GET /compute/v2.1/servers/de10d316-c43e-4ee9-b80b-131388bc91aa" status: 200 len: 1315 microversion: 2.1 time: 0.753081 Oct 27 03:57:39.730987 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3037/6354] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:57:38 2022] GET /compute/v2.1/servers/de10d316-c43e-4ee9-b80b-131388bc91aa => generated 1315 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:57:40.755469 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8ec1309d-9af0-414e-9dca-61ca28b29eb5 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:57:40.756492 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8ec1309d-9af0-414e-9dca-61ca28b29eb5 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] [instance: de10d316-c43e-4ee9-b80b-131388bc91aa] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:57:40.763442 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8ec1309d-9af0-414e-9dca-61ca28b29eb5 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:40.764150 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8ec1309d-9af0-414e-9dca-61ca28b29eb5 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:40.764642 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8ec1309d-9af0-414e-9dca-61ca28b29eb5 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:40.765356 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8ec1309d-9af0-414e-9dca-61ca28b29eb5 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:40.765840 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8ec1309d-9af0-414e-9dca-61ca28b29eb5 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:40.766704 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8ec1309d-9af0-414e-9dca-61ca28b29eb5 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:40.938868 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8ec1309d-9af0-414e-9dca-61ca28b29eb5 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c30f244f24b0897ec0631a33d91e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b587e152514b0f99c5e14e842d6ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:57:40.947627 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8ec1309d-9af0-414e-9dca-61ca28b29eb5 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] 10.222.0.20 "GET /compute/v2.1/servers/de10d316-c43e-4ee9-b80b-131388bc91aa" status: 200 len: 1501 microversion: 2.1 time: 0.198227 Oct 27 03:57:40.948499 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3318/6355] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:57:40 2022] GET /compute/v2.1/servers/de10d316-c43e-4ee9-b80b-131388bc91aa => generated 1501 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:57:40.972512 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-aafbb888-fbd0-494b-a551-d580bf96574b tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:57:40.973155 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-aafbb888-fbd0-494b-a551-d580bf96574b tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] [instance: de10d316-c43e-4ee9-b80b-131388bc91aa] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:57:40.980832 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aafbb888-fbd0-494b-a551-d580bf96574b tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:40.981580 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aafbb888-fbd0-494b-a551-d580bf96574b tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:40.982224 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aafbb888-fbd0-494b-a551-d580bf96574b tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:40.982872 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aafbb888-fbd0-494b-a551-d580bf96574b tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:40.983521 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aafbb888-fbd0-494b-a551-d580bf96574b tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:40.984001 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aafbb888-fbd0-494b-a551-d580bf96574b tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:41.141984 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-aafbb888-fbd0-494b-a551-d580bf96574b tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c30f244f24b0897ec0631a33d91e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b587e152514b0f99c5e14e842d6ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:57:41.150526 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-aafbb888-fbd0-494b-a551-d580bf96574b tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] 10.222.0.20 "GET /compute/v2.1/servers/de10d316-c43e-4ee9-b80b-131388bc91aa" status: 200 len: 1501 microversion: 2.1 time: 0.182273 Oct 27 03:57:41.151107 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3038/6356] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:57:40 2022] GET /compute/v2.1/servers/de10d316-c43e-4ee9-b80b-131388bc91aa => generated 1501 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:57:41.175308 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-bec958bc-13f3-404b-8b90-ffcf06a28129 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:57:41.175860 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-bec958bc-13f3-404b-8b90-ffcf06a28129 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] [instance: de10d316-c43e-4ee9-b80b-131388bc91aa] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:57:41.186284 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bec958bc-13f3-404b-8b90-ffcf06a28129 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:41.186284 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bec958bc-13f3-404b-8b90-ffcf06a28129 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:41.186284 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bec958bc-13f3-404b-8b90-ffcf06a28129 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:41.186284 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bec958bc-13f3-404b-8b90-ffcf06a28129 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:41.186284 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bec958bc-13f3-404b-8b90-ffcf06a28129 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:41.186284 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bec958bc-13f3-404b-8b90-ffcf06a28129 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:41.216972 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-bec958bc-13f3-404b-8b90-ffcf06a28129 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lazy-loading 'flavor' on Instance uuid de10d316-c43e-4ee9-b80b-131388bc91aa {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:57:41.936455 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-bec958bc-13f3-404b-8b90-ffcf06a28129 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] 10.222.0.20 "POST /compute/v2.1/servers/de10d316-c43e-4ee9-b80b-131388bc91aa/action" status: 202 len: 0 microversion: 2.1 time: 0.765657 Oct 27 03:57:41.944388 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3319/6357] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:57:41 2022] POST /compute/v2.1/servers/de10d316-c43e-4ee9-b80b-131388bc91aa/action => generated 0 bytes in 775 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:57:41.954433 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2909dada-f4a9-4ae5-9643-bb56efbd94d4 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:57:41.955429 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-2909dada-f4a9-4ae5-9643-bb56efbd94d4 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] [instance: de10d316-c43e-4ee9-b80b-131388bc91aa] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:57:41.962766 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2909dada-f4a9-4ae5-9643-bb56efbd94d4 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:41.963805 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2909dada-f4a9-4ae5-9643-bb56efbd94d4 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:41.964496 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2909dada-f4a9-4ae5-9643-bb56efbd94d4 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:41.965526 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2909dada-f4a9-4ae5-9643-bb56efbd94d4 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:41.966409 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2909dada-f4a9-4ae5-9643-bb56efbd94d4 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:41.967585 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2909dada-f4a9-4ae5-9643-bb56efbd94d4 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:42.281109 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2909dada-f4a9-4ae5-9643-bb56efbd94d4 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c30f244f24b0897ec0631a33d91e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b587e152514b0f99c5e14e842d6ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:57:42.295465 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2909dada-f4a9-4ae5-9643-bb56efbd94d4 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] 10.222.0.20 "GET /compute/v2.1/servers/de10d316-c43e-4ee9-b80b-131388bc91aa" status: 200 len: 1509 microversion: 2.1 time: 0.345840 Oct 27 03:57:42.309837 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3039/6358] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:57:41 2022] GET /compute/v2.1/servers/de10d316-c43e-4ee9-b80b-131388bc91aa => generated 1509 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:57:43.323422 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4d099f7c-0a8c-4675-a5fe-12202636bee2 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:57:43.325275 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4d099f7c-0a8c-4675-a5fe-12202636bee2 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] [instance: de10d316-c43e-4ee9-b80b-131388bc91aa] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:57:43.335709 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4d099f7c-0a8c-4675-a5fe-12202636bee2 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:43.336698 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4d099f7c-0a8c-4675-a5fe-12202636bee2 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:43.337554 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4d099f7c-0a8c-4675-a5fe-12202636bee2 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:43.339678 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4d099f7c-0a8c-4675-a5fe-12202636bee2 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:43.340353 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4d099f7c-0a8c-4675-a5fe-12202636bee2 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:43.341076 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4d099f7c-0a8c-4675-a5fe-12202636bee2 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:43.536305 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4d099f7c-0a8c-4675-a5fe-12202636bee2 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c30f244f24b0897ec0631a33d91e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b587e152514b0f99c5e14e842d6ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:57:43.545525 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4d099f7c-0a8c-4675-a5fe-12202636bee2 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] 10.222.0.20 "GET /compute/v2.1/servers/de10d316-c43e-4ee9-b80b-131388bc91aa" status: 200 len: 1492 microversion: 2.1 time: 0.226801 Oct 27 03:57:43.549138 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3320/6359] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:57:43 2022] GET /compute/v2.1/servers/de10d316-c43e-4ee9-b80b-131388bc91aa => generated 1492 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:57:43.571380 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8baedf01-c028-4201-95fd-7446b6767197 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:57:43.572569 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8baedf01-c028-4201-95fd-7446b6767197 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] [instance: de10d316-c43e-4ee9-b80b-131388bc91aa] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:57:43.580462 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8baedf01-c028-4201-95fd-7446b6767197 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:43.581171 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8baedf01-c028-4201-95fd-7446b6767197 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:43.581762 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8baedf01-c028-4201-95fd-7446b6767197 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:43.582655 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8baedf01-c028-4201-95fd-7446b6767197 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:43.583285 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8baedf01-c028-4201-95fd-7446b6767197 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:43.583865 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8baedf01-c028-4201-95fd-7446b6767197 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:43.836872 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8baedf01-c028-4201-95fd-7446b6767197 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] 10.222.0.20 "POST /compute/v2.1/servers/de10d316-c43e-4ee9-b80b-131388bc91aa/action" status: 202 len: 0 microversion: 2.1 time: 0.269014 Oct 27 03:57:43.838104 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3040/6360] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:57:43 2022] POST /compute/v2.1/servers/de10d316-c43e-4ee9-b80b-131388bc91aa/action => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:57:43.861424 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e7408c2c-b9da-4b51-8013-467c991f4712 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:57:43.861424 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e7408c2c-b9da-4b51-8013-467c991f4712 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] [instance: de10d316-c43e-4ee9-b80b-131388bc91aa] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:57:43.872525 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e7408c2c-b9da-4b51-8013-467c991f4712 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:43.873437 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e7408c2c-b9da-4b51-8013-467c991f4712 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:43.874077 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e7408c2c-b9da-4b51-8013-467c991f4712 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:43.874810 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e7408c2c-b9da-4b51-8013-467c991f4712 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:43.875906 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e7408c2c-b9da-4b51-8013-467c991f4712 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:43.876350 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e7408c2c-b9da-4b51-8013-467c991f4712 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:44.108554 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e7408c2c-b9da-4b51-8013-467c991f4712 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c30f244f24b0897ec0631a33d91e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b587e152514b0f99c5e14e842d6ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:57:44.117562 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e7408c2c-b9da-4b51-8013-467c991f4712 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] 10.222.0.20 "GET /compute/v2.1/servers/de10d316-c43e-4ee9-b80b-131388bc91aa" status: 200 len: 1498 microversion: 2.1 time: 0.275484 Oct 27 03:57:44.130403 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3321/6361] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:57:43 2022] GET /compute/v2.1/servers/de10d316-c43e-4ee9-b80b-131388bc91aa => generated 1498 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:57:45.142181 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ae9d8c0a-8c21-4b40-8c03-d8480acea5bd tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:57:45.143650 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ae9d8c0a-8c21-4b40-8c03-d8480acea5bd tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] [instance: de10d316-c43e-4ee9-b80b-131388bc91aa] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:57:45.154770 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ae9d8c0a-8c21-4b40-8c03-d8480acea5bd tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:45.159213 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ae9d8c0a-8c21-4b40-8c03-d8480acea5bd tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:45.163908 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ae9d8c0a-8c21-4b40-8c03-d8480acea5bd tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:45.164956 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ae9d8c0a-8c21-4b40-8c03-d8480acea5bd tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:45.165578 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ae9d8c0a-8c21-4b40-8c03-d8480acea5bd tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:45.166190 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ae9d8c0a-8c21-4b40-8c03-d8480acea5bd tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:45.376418 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ae9d8c0a-8c21-4b40-8c03-d8480acea5bd tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c30f244f24b0897ec0631a33d91e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b587e152514b0f99c5e14e842d6ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:57:45.384781 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ae9d8c0a-8c21-4b40-8c03-d8480acea5bd tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] 10.222.0.20 "GET /compute/v2.1/servers/de10d316-c43e-4ee9-b80b-131388bc91aa" status: 200 len: 1498 microversion: 2.1 time: 0.247730 Oct 27 03:57:45.401882 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3041/6362] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:57:45 2022] GET /compute/v2.1/servers/de10d316-c43e-4ee9-b80b-131388bc91aa => generated 1498 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:57:46.416391 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8da31df0-63ae-4e80-a5d1-a2c488cf3b8f tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:57:46.418893 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8da31df0-63ae-4e80-a5d1-a2c488cf3b8f tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] [instance: de10d316-c43e-4ee9-b80b-131388bc91aa] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:57:46.451825 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8da31df0-63ae-4e80-a5d1-a2c488cf3b8f tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:46.452869 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8da31df0-63ae-4e80-a5d1-a2c488cf3b8f tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:46.454532 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8da31df0-63ae-4e80-a5d1-a2c488cf3b8f tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:46.455524 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8da31df0-63ae-4e80-a5d1-a2c488cf3b8f tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:46.456190 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8da31df0-63ae-4e80-a5d1-a2c488cf3b8f tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:46.456855 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8da31df0-63ae-4e80-a5d1-a2c488cf3b8f tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:46.889102 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8da31df0-63ae-4e80-a5d1-a2c488cf3b8f tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c30f244f24b0897ec0631a33d91e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b587e152514b0f99c5e14e842d6ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:57:46.899538 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8da31df0-63ae-4e80-a5d1-a2c488cf3b8f tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] 10.222.0.20 "GET /compute/v2.1/servers/de10d316-c43e-4ee9-b80b-131388bc91aa" status: 200 len: 1501 microversion: 2.1 time: 0.494630 Oct 27 03:57:46.900136 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3322/6363] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:57:46 2022] GET /compute/v2.1/servers/de10d316-c43e-4ee9-b80b-131388bc91aa => generated 1501 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:57:46.930661 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2596bc05-cdd9-4ccb-8e7d-1373ed7d39ea tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:57:46.933798 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-2596bc05-cdd9-4ccb-8e7d-1373ed7d39ea tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] [instance: de10d316-c43e-4ee9-b80b-131388bc91aa] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:57:46.945450 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2596bc05-cdd9-4ccb-8e7d-1373ed7d39ea tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:46.947225 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2596bc05-cdd9-4ccb-8e7d-1373ed7d39ea tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:46.948439 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2596bc05-cdd9-4ccb-8e7d-1373ed7d39ea tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:46.951828 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2596bc05-cdd9-4ccb-8e7d-1373ed7d39ea tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:46.953825 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2596bc05-cdd9-4ccb-8e7d-1373ed7d39ea tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:46.954466 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2596bc05-cdd9-4ccb-8e7d-1373ed7d39ea tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:47.028659 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-2596bc05-cdd9-4ccb-8e7d-1373ed7d39ea tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lazy-loading 'flavor' on Instance uuid de10d316-c43e-4ee9-b80b-131388bc91aa {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:57:47.406237 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2596bc05-cdd9-4ccb-8e7d-1373ed7d39ea tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] 10.222.0.20 "POST /compute/v2.1/servers/de10d316-c43e-4ee9-b80b-131388bc91aa/action" status: 202 len: 0 microversion: 2.1 time: 0.481846 Oct 27 03:57:47.417107 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-dba39ade-a146-4619-9d1a-3e86d9054a00 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:57:47.418294 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-dba39ade-a146-4619-9d1a-3e86d9054a00 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] [instance: de10d316-c43e-4ee9-b80b-131388bc91aa] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:57:47.424427 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3042/6364] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:57:46 2022] POST /compute/v2.1/servers/de10d316-c43e-4ee9-b80b-131388bc91aa/action => generated 0 bytes in 501 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:57:47.430860 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dba39ade-a146-4619-9d1a-3e86d9054a00 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:47.431516 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dba39ade-a146-4619-9d1a-3e86d9054a00 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:47.432878 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dba39ade-a146-4619-9d1a-3e86d9054a00 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:47.434127 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dba39ade-a146-4619-9d1a-3e86d9054a00 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:47.434832 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dba39ade-a146-4619-9d1a-3e86d9054a00 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:47.435444 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dba39ade-a146-4619-9d1a-3e86d9054a00 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:47.665839 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-dba39ade-a146-4619-9d1a-3e86d9054a00 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c30f244f24b0897ec0631a33d91e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b587e152514b0f99c5e14e842d6ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:57:47.676792 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-dba39ade-a146-4619-9d1a-3e86d9054a00 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] 10.222.0.20 "GET /compute/v2.1/servers/de10d316-c43e-4ee9-b80b-131388bc91aa" status: 200 len: 1509 microversion: 2.1 time: 0.263724 Oct 27 03:57:47.679777 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3323/6365] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:57:47 2022] GET /compute/v2.1/servers/de10d316-c43e-4ee9-b80b-131388bc91aa => generated 1509 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:57:48.704879 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6409a989-0b95-4d3b-afa3-d7921fe96844 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:57:48.706272 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6409a989-0b95-4d3b-afa3-d7921fe96844 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] [instance: de10d316-c43e-4ee9-b80b-131388bc91aa] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:57:48.714655 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6409a989-0b95-4d3b-afa3-d7921fe96844 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:48.715293 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6409a989-0b95-4d3b-afa3-d7921fe96844 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:48.715910 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6409a989-0b95-4d3b-afa3-d7921fe96844 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:48.717628 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6409a989-0b95-4d3b-afa3-d7921fe96844 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:48.718278 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6409a989-0b95-4d3b-afa3-d7921fe96844 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:48.718868 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6409a989-0b95-4d3b-afa3-d7921fe96844 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:48.909329 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-6409a989-0b95-4d3b-afa3-d7921fe96844 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c30f244f24b0897ec0631a33d91e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b587e152514b0f99c5e14e842d6ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:57:48.912155 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:57:48.924202 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6409a989-0b95-4d3b-afa3-d7921fe96844 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] 10.222.0.20 "GET /compute/v2.1/servers/de10d316-c43e-4ee9-b80b-131388bc91aa" status: 200 len: 1492 microversion: 2.1 time: 0.222523 Oct 27 03:57:48.940718 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3043/6366] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:57:48 2022] GET /compute/v2.1/servers/de10d316-c43e-4ee9-b80b-131388bc91aa => generated 1492 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:57:48.951422 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ae1af906-31c9-417a-8606-e54faa0994f0 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:57:48.952528 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ae1af906-31c9-417a-8606-e54faa0994f0 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] [instance: de10d316-c43e-4ee9-b80b-131388bc91aa] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:57:48.961452 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:57:48.963378 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ae1af906-31c9-417a-8606-e54faa0994f0 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:48.964027 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ae1af906-31c9-417a-8606-e54faa0994f0 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:48.964889 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ae1af906-31c9-417a-8606-e54faa0994f0 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:48.966301 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ae1af906-31c9-417a-8606-e54faa0994f0 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:48.967773 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ae1af906-31c9-417a-8606-e54faa0994f0 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:48.968221 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ae1af906-31c9-417a-8606-e54faa0994f0 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:49.205888 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ae1af906-31c9-417a-8606-e54faa0994f0 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] 10.222.0.20 "POST /compute/v2.1/servers/de10d316-c43e-4ee9-b80b-131388bc91aa/action" status: 202 len: 0 microversion: 2.1 time: 0.258396 Oct 27 03:57:49.207269 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3324/6367] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:57:48 2022] POST /compute/v2.1/servers/de10d316-c43e-4ee9-b80b-131388bc91aa/action => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:57:49.221928 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3977422f-c909-44c8-8017-0be424c5919f tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:57:49.226437 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-3977422f-c909-44c8-8017-0be424c5919f tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] [instance: de10d316-c43e-4ee9-b80b-131388bc91aa] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:57:49.243537 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=60 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:57:49.250925 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3977422f-c909-44c8-8017-0be424c5919f tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:49.251797 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3977422f-c909-44c8-8017-0be424c5919f tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:49.252714 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3977422f-c909-44c8-8017-0be424c5919f tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:49.253965 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3977422f-c909-44c8-8017-0be424c5919f tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:49.254653 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3977422f-c909-44c8-8017-0be424c5919f tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:49.255609 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3977422f-c909-44c8-8017-0be424c5919f tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:49.588947 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-3977422f-c909-44c8-8017-0be424c5919f tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c30f244f24b0897ec0631a33d91e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b587e152514b0f99c5e14e842d6ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:57:49.598519 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3977422f-c909-44c8-8017-0be424c5919f tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] 10.222.0.20 "GET /compute/v2.1/servers/de10d316-c43e-4ee9-b80b-131388bc91aa" status: 200 len: 1498 microversion: 2.1 time: 0.387266 Oct 27 03:57:49.602815 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3044/6368] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:57:49 2022] GET /compute/v2.1/servers/de10d316-c43e-4ee9-b80b-131388bc91aa => generated 1498 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:57:50.629135 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1e4a565e-7fdf-4dbe-9776-ab91299e3c22 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:57:50.629855 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1e4a565e-7fdf-4dbe-9776-ab91299e3c22 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] [instance: de10d316-c43e-4ee9-b80b-131388bc91aa] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:57:50.645858 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1e4a565e-7fdf-4dbe-9776-ab91299e3c22 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:50.650318 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1e4a565e-7fdf-4dbe-9776-ab91299e3c22 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:50.650811 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1e4a565e-7fdf-4dbe-9776-ab91299e3c22 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:50.651671 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1e4a565e-7fdf-4dbe-9776-ab91299e3c22 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:50.652028 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1e4a565e-7fdf-4dbe-9776-ab91299e3c22 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:50.653940 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1e4a565e-7fdf-4dbe-9776-ab91299e3c22 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:50.867362 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1e4a565e-7fdf-4dbe-9776-ab91299e3c22 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c30f244f24b0897ec0631a33d91e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b587e152514b0f99c5e14e842d6ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:57:50.872543 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1e4a565e-7fdf-4dbe-9776-ab91299e3c22 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] 10.222.0.20 "GET /compute/v2.1/servers/de10d316-c43e-4ee9-b80b-131388bc91aa" status: 200 len: 1498 microversion: 2.1 time: 0.249126 Oct 27 03:57:50.873426 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3325/6369] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:57:50 2022] GET /compute/v2.1/servers/de10d316-c43e-4ee9-b80b-131388bc91aa => generated 1498 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:57:51.906485 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-aaffe7d6-0ec4-4ac2-aff2-622b39257134 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:57:51.907171 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-aaffe7d6-0ec4-4ac2-aff2-622b39257134 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] [instance: de10d316-c43e-4ee9-b80b-131388bc91aa] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:57:51.918811 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aaffe7d6-0ec4-4ac2-aff2-622b39257134 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:51.919405 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aaffe7d6-0ec4-4ac2-aff2-622b39257134 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:51.920145 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aaffe7d6-0ec4-4ac2-aff2-622b39257134 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:51.921055 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aaffe7d6-0ec4-4ac2-aff2-622b39257134 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:51.921536 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aaffe7d6-0ec4-4ac2-aff2-622b39257134 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:51.921981 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aaffe7d6-0ec4-4ac2-aff2-622b39257134 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:52.082859 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-aaffe7d6-0ec4-4ac2-aff2-622b39257134 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c30f244f24b0897ec0631a33d91e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b587e152514b0f99c5e14e842d6ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:57:52.091218 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-aaffe7d6-0ec4-4ac2-aff2-622b39257134 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] 10.222.0.20 "GET /compute/v2.1/servers/de10d316-c43e-4ee9-b80b-131388bc91aa" status: 200 len: 1501 microversion: 2.1 time: 0.190708 Oct 27 03:57:52.096703 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3045/6370] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:57:51 2022] GET /compute/v2.1/servers/de10d316-c43e-4ee9-b80b-131388bc91aa => generated 1501 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:57:52.120453 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d320cf47-c45a-4a38-9b33-ef025b69efd8 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:57:52.121052 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d320cf47-c45a-4a38-9b33-ef025b69efd8 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] [instance: de10d316-c43e-4ee9-b80b-131388bc91aa] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:57:52.129999 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d320cf47-c45a-4a38-9b33-ef025b69efd8 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:52.130535 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d320cf47-c45a-4a38-9b33-ef025b69efd8 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:52.131215 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d320cf47-c45a-4a38-9b33-ef025b69efd8 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:52.132898 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d320cf47-c45a-4a38-9b33-ef025b69efd8 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:52.133645 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d320cf47-c45a-4a38-9b33-ef025b69efd8 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:52.134124 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d320cf47-c45a-4a38-9b33-ef025b69efd8 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:52.180871 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d320cf47-c45a-4a38-9b33-ef025b69efd8 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] [instance: de10d316-c43e-4ee9-b80b-131388bc91aa] Going to try to terminate instance {{(pid=121001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:57:52.566390 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d320cf47-c45a-4a38-9b33-ef025b69efd8 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] 10.222.0.20 "DELETE /compute/v2.1/servers/de10d316-c43e-4ee9-b80b-131388bc91aa" status: 204 len: 0 microversion: 2.1 time: 0.449792 Oct 27 03:57:52.567397 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3326/6371] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:57:52 2022] DELETE /compute/v2.1/servers/de10d316-c43e-4ee9-b80b-131388bc91aa => generated 0 bytes in 452 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:57:52.585537 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-26a1583c-9ae7-4c7f-a87e-d694a196dac1 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:57:52.585537 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-26a1583c-9ae7-4c7f-a87e-d694a196dac1 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] [instance: de10d316-c43e-4ee9-b80b-131388bc91aa] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:57:52.600233 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-26a1583c-9ae7-4c7f-a87e-d694a196dac1 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:52.600503 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-26a1583c-9ae7-4c7f-a87e-d694a196dac1 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:52.601041 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-26a1583c-9ae7-4c7f-a87e-d694a196dac1 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:52.601986 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-26a1583c-9ae7-4c7f-a87e-d694a196dac1 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:52.613507 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-26a1583c-9ae7-4c7f-a87e-d694a196dac1 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:52.613507 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-26a1583c-9ae7-4c7f-a87e-d694a196dac1 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:52.870761 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-26a1583c-9ae7-4c7f-a87e-d694a196dac1 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c30f244f24b0897ec0631a33d91e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b587e152514b0f99c5e14e842d6ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:57:52.893516 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-26a1583c-9ae7-4c7f-a87e-d694a196dac1 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] 10.222.0.20 "GET /compute/v2.1/servers/de10d316-c43e-4ee9-b80b-131388bc91aa" status: 200 len: 1507 microversion: 2.1 time: 0.321693 Oct 27 03:57:52.914730 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3046/6372] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:57:52 2022] GET /compute/v2.1/servers/de10d316-c43e-4ee9-b80b-131388bc91aa => generated 1507 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:57:53.929148 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-543c2a2a-39b4-4e28-b13a-e501d5600711 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:57:53.929941 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-543c2a2a-39b4-4e28-b13a-e501d5600711 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] [instance: de10d316-c43e-4ee9-b80b-131388bc91aa] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:57:53.944011 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-543c2a2a-39b4-4e28-b13a-e501d5600711 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:53.944557 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-543c2a2a-39b4-4e28-b13a-e501d5600711 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:53.945098 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-543c2a2a-39b4-4e28-b13a-e501d5600711 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:53.945894 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-543c2a2a-39b4-4e28-b13a-e501d5600711 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:53.946451 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-543c2a2a-39b4-4e28-b13a-e501d5600711 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:53.947094 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-543c2a2a-39b4-4e28-b13a-e501d5600711 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:54.217876 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-543c2a2a-39b4-4e28-b13a-e501d5600711 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c30f244f24b0897ec0631a33d91e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b587e152514b0f99c5e14e842d6ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:57:54.231572 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-543c2a2a-39b4-4e28-b13a-e501d5600711 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] 10.222.0.20 "GET /compute/v2.1/servers/de10d316-c43e-4ee9-b80b-131388bc91aa" status: 200 len: 1507 microversion: 2.1 time: 0.311939 Oct 27 03:57:54.232251 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3327/6373] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:57:53 2022] GET /compute/v2.1/servers/de10d316-c43e-4ee9-b80b-131388bc91aa => generated 1507 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:57:55.255517 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6ebccfca-2b2a-4ff7-884e-1a94a292755c tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:57:55.256762 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6ebccfca-2b2a-4ff7-884e-1a94a292755c tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] [instance: de10d316-c43e-4ee9-b80b-131388bc91aa] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:57:55.269359 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6ebccfca-2b2a-4ff7-884e-1a94a292755c tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:55.269910 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6ebccfca-2b2a-4ff7-884e-1a94a292755c tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:55.270540 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6ebccfca-2b2a-4ff7-884e-1a94a292755c tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:55.271263 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6ebccfca-2b2a-4ff7-884e-1a94a292755c tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:55.275119 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6ebccfca-2b2a-4ff7-884e-1a94a292755c tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:55.275119 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6ebccfca-2b2a-4ff7-884e-1a94a292755c tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:55.597411 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-6ebccfca-2b2a-4ff7-884e-1a94a292755c tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c30f244f24b0897ec0631a33d91e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b587e152514b0f99c5e14e842d6ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:57:55.606674 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6ebccfca-2b2a-4ff7-884e-1a94a292755c tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] 10.222.0.20 "GET /compute/v2.1/servers/de10d316-c43e-4ee9-b80b-131388bc91aa" status: 200 len: 1507 microversion: 2.1 time: 0.355032 Oct 27 03:57:55.608822 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3047/6374] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:57:55 2022] GET /compute/v2.1/servers/de10d316-c43e-4ee9-b80b-131388bc91aa => generated 1507 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:57:55.682417 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-5dbe057a-02d7-44dc-8f95-7b36eff91082 req-aaee4e4c-3245-42a7-8f2e-81b1000032d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de10d316-c43e-4ee9-b80b-131388bc91aa", "name": "network-vif-deleted", "tag": "e101c25c-d75b-47cb-9ef7-2130a824cf00"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:57:55.702114 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-5dbe057a-02d7-44dc-8f95-7b36eff91082 req-aaee4e4c-3245-42a7-8f2e-81b1000032d1 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:55.702806 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-5dbe057a-02d7-44dc-8f95-7b36eff91082 req-aaee4e4c-3245-42a7-8f2e-81b1000032d1 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:55.703241 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-5dbe057a-02d7-44dc-8f95-7b36eff91082 req-aaee4e4c-3245-42a7-8f2e-81b1000032d1 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:55.732297 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-5dbe057a-02d7-44dc-8f95-7b36eff91082 req-aaee4e4c-3245-42a7-8f2e-81b1000032d1 service nova] Creating event network-vif-deleted:e101c25c-d75b-47cb-9ef7-2130a824cf00 for instance de10d316-c43e-4ee9-b80b-131388bc91aa on n-h1-862769-1 Oct 27 03:57:55.741438 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-5dbe057a-02d7-44dc-8f95-7b36eff91082 req-aaee4e4c-3245-42a7-8f2e-81b1000032d1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064557 Oct 27 03:57:55.742249 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3328/6375] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:57:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:57:56.641185 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ed828f24-4e1d-4903-9556-a73b1af7326b tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:57:56.641929 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ed828f24-4e1d-4903-9556-a73b1af7326b tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] [instance: de10d316-c43e-4ee9-b80b-131388bc91aa] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:57:56.660060 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ed828f24-4e1d-4903-9556-a73b1af7326b tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:56.663271 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ed828f24-4e1d-4903-9556-a73b1af7326b tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:56.664001 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ed828f24-4e1d-4903-9556-a73b1af7326b tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:56.667426 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ed828f24-4e1d-4903-9556-a73b1af7326b tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:56.668089 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ed828f24-4e1d-4903-9556-a73b1af7326b tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:56.668765 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ed828f24-4e1d-4903-9556-a73b1af7326b tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:56.762708 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ed828f24-4e1d-4903-9556-a73b1af7326b tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:56.763468 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ed828f24-4e1d-4903-9556-a73b1af7326b tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:56.764095 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ed828f24-4e1d-4903-9556-a73b1af7326b tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:56.764718 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-ed828f24-4e1d-4903-9556-a73b1af7326b tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lazy-loading 'fault' on Instance uuid de10d316-c43e-4ee9-b80b-131388bc91aa {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:57:56.826005 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ed828f24-4e1d-4903-9556-a73b1af7326b tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c30f244f24b0897ec0631a33d91e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b587e152514b0f99c5e14e842d6ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:57:56.835215 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ed828f24-4e1d-4903-9556-a73b1af7326b tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] 10.222.0.20 "GET /compute/v2.1/servers/de10d316-c43e-4ee9-b80b-131388bc91aa" status: 200 len: 1305 microversion: 2.1 time: 0.206662 Oct 27 03:57:56.835842 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3048/6376] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:57:56 2022] GET /compute/v2.1/servers/de10d316-c43e-4ee9-b80b-131388bc91aa => generated 1305 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:57:57.862911 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-51cdec9c-6e97-4efb-91ac-26c113839b93 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:57:57.864020 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-51cdec9c-6e97-4efb-91ac-26c113839b93 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] [instance: de10d316-c43e-4ee9-b80b-131388bc91aa] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:57:57.896095 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-51cdec9c-6e97-4efb-91ac-26c113839b93 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:57.897863 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-51cdec9c-6e97-4efb-91ac-26c113839b93 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:57.898643 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-51cdec9c-6e97-4efb-91ac-26c113839b93 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:57.900843 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-51cdec9c-6e97-4efb-91ac-26c113839b93 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:57.903782 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-51cdec9c-6e97-4efb-91ac-26c113839b93 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:57.905550 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-51cdec9c-6e97-4efb-91ac-26c113839b93 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:57.940268 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-51cdec9c-6e97-4efb-91ac-26c113839b93 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] HTTP exception thrown: Instance de10d316-c43e-4ee9-b80b-131388bc91aa could not be found. Oct 27 03:57:57.942571 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-51cdec9c-6e97-4efb-91ac-26c113839b93 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Request method failure captured: Oct 27 03:57:57.942571 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/de10d316-c43e-4ee9-b80b-131388bc91aa HTTP/1.1 Oct 27 03:57:57.942571 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:57:57.942571 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:57:57.942571 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:57:57.942571 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:57:57.942571 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:57:57.942571 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:57:57.942571 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:57:57.942571 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:57:57.942571 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWgGaXraKqswwi-_QK246Y8kLuw9T4IHIutYN0QfAdEOCYHsILm7uFgnFiEtUxnaswfQQUlNUoOFGq4bCePqF0jPxsE5Y3S6kI4mJwVJPjQ3cSAHvigJH748Eyy2CZWUkDRbtrPhfv27CJlU_5DAr2dVKONudBg5SiO7Z6PVkpOW1Cxk Oct 27 03:57:57.942571 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:57:57.942571 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:57:57.942571 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:57:57.942571 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:57:57.942571 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:57:57.942571 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:57:57.942571 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 57b587e152514b0f99c5e14e842d6ffc Oct 27 03:57:57.942571 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-TestServerAdvancedOps-1554793976 Oct 27 03:57:57.942571 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:57:57.942571 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:57:57.942571 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/57b587e152514b0f99c5e14e842d6ffc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/57b587e152514b0f99c5e14e842d6ffc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/57b587e152514b0f99c5e14e842d6ffc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_57b587e152514b0f99c5e14e842d6ffc"}]}] Oct 27 03:57:57.942571 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-TestServerAdvancedOps-1554793976 Oct 27 03:57:57.942571 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 57b587e152514b0f99c5e14e842d6ffc Oct 27 03:57:57.942571 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-TestServerAdvancedOps-1554793976 Oct 27 03:57:57.942571 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-TestServerAdvancedOps-1554793976-project Oct 27 03:57:57.942571 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:57:57.942571 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:57:57.942571 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 323c30f244f24b0897ec0631a33d91e0 Oct 27 03:57:57.942571 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-TestServerAdvancedOps-1554793976-project Oct 27 03:57:57.942571 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:57:57.942571 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance de10d316-c43e-4ee9-b80b-131388bc91aa could not be found. Oct 27 03:57:57.942571 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': 'de10d316-c43e-4ee9-b80b-131388bc91aa'} Oct 27 03:57:57.942571 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:57:57.942571 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:57:57.942571 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:57:57.942571 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:57:57.942571 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:57:57.942571 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:57:57.942571 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:57:57.942571 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:57:57.942571 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:57:57.942571 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:57:57.942571 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de10d316-c43e-4ee9-b80b-131388bc91aa could not be found. Oct 27 03:57:57.942571 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:57:57.942571 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:57:57.942571 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:57:57.942571 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:57:57.942571 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:57:57.942571 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:57:57.942571 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:57:57.942571 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:57:57.942571 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:57:57.942571 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:57:57.942571 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:57:57.942571 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:57:57.942571 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:57:57.942571 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:57:57.942571 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:57:57.942571 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:57:57.942571 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de10d316-c43e-4ee9-b80b-131388bc91aa could not be found. Oct 27 03:57:57.942571 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:57:57.942571 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:57:57.942571 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:57:57.946859 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:57:57.946859 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:57:57.946859 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:57:57.946859 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:57:57.946859 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:57:57.946859 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de10d316-c43e-4ee9-b80b-131388bc91aa could not be found. Oct 27 03:57:57.946859 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:57:57.948766 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-51cdec9c-6e97-4efb-91ac-26c113839b93 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] Returning 404 to user: Instance de10d316-c43e-4ee9-b80b-131388bc91aa could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:57:57.950540 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-51cdec9c-6e97-4efb-91ac-26c113839b93 tempest-TestServerAdvancedOps-1554793976 tempest-TestServerAdvancedOps-1554793976-project] 10.222.0.20 "GET /compute/v2.1/servers/de10d316-c43e-4ee9-b80b-131388bc91aa" status: 404 len: 111 microversion: 2.1 time: 0.094885 Oct 27 03:57:57.951832 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3329/6377] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:57:57 2022] GET /compute/v2.1/servers/de10d316-c43e-4ee9-b80b-131388bc91aa => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:57:58.308135 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-33afc681-efa6-4323-9ce1-d4187fb59133 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:57:58.310636 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-33afc681-efa6-4323-9ce1-d4187fb59133 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 81aa9d61-7bd5-4e07-9101-e981526f00c9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:57:58.318988 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-33afc681-efa6-4323-9ce1-d4187fb59133 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:58.319489 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-33afc681-efa6-4323-9ce1-d4187fb59133 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:58.319929 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-33afc681-efa6-4323-9ce1-d4187fb59133 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:58.320651 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-33afc681-efa6-4323-9ce1-d4187fb59133 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:57:58.321175 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-33afc681-efa6-4323-9ce1-d4187fb59133 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:57:58.321885 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-33afc681-efa6-4323-9ce1-d4187fb59133 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:57:58.473573 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-33afc681-efa6-4323-9ce1-d4187fb59133 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "POST /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9/action" status: 200 len: 63183 microversion: 2.1 time: 0.491437 Oct 27 03:57:58.475874 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3049/6378] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:57:57 2022] POST /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9/action => generated 63183 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 03:58:05.331157 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-aca5d0c8-456a-418d-b7e9-0371c2df2dbc tempest-TestNetworkAdvancedServerOps-1624832099 tempest-TestNetworkAdvancedServerOps-1624832099-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:58:05.331891 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-aca5d0c8-456a-418d-b7e9-0371c2df2dbc tempest-TestNetworkAdvancedServerOps-1624832099 tempest-TestNetworkAdvancedServerOps-1624832099-project-admin] [instance: 81aa9d61-7bd5-4e07-9101-e981526f00c9] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:58:05.341779 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aca5d0c8-456a-418d-b7e9-0371c2df2dbc tempest-TestNetworkAdvancedServerOps-1624832099 tempest-TestNetworkAdvancedServerOps-1624832099-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:58:05.341779 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aca5d0c8-456a-418d-b7e9-0371c2df2dbc tempest-TestNetworkAdvancedServerOps-1624832099 tempest-TestNetworkAdvancedServerOps-1624832099-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:58:05.342302 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aca5d0c8-456a-418d-b7e9-0371c2df2dbc tempest-TestNetworkAdvancedServerOps-1624832099 tempest-TestNetworkAdvancedServerOps-1624832099-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:58:05.342929 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aca5d0c8-456a-418d-b7e9-0371c2df2dbc tempest-TestNetworkAdvancedServerOps-1624832099 tempest-TestNetworkAdvancedServerOps-1624832099-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:58:05.343334 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aca5d0c8-456a-418d-b7e9-0371c2df2dbc tempest-TestNetworkAdvancedServerOps-1624832099 tempest-TestNetworkAdvancedServerOps-1624832099-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:58:05.347057 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aca5d0c8-456a-418d-b7e9-0371c2df2dbc tempest-TestNetworkAdvancedServerOps-1624832099 tempest-TestNetworkAdvancedServerOps-1624832099-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:58:05.385601 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:58:05.936995 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-aca5d0c8-456a-418d-b7e9-0371c2df2dbc tempest-TestNetworkAdvancedServerOps-1624832099 tempest-TestNetworkAdvancedServerOps-1624832099-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9" status: 200 len: 1834 microversion: 2.1 time: 1.037447 Oct 27 03:58:05.951327 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3330/6379] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:58:04 2022] GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9 => generated 1834 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:58:08.782630 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d0b2ea8a-13ff-4ef0-8ac6-3cc7811d9ae1 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:58:08.783817 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d0b2ea8a-13ff-4ef0-8ac6-3cc7811d9ae1 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 81aa9d61-7bd5-4e07-9101-e981526f00c9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:58:08.789636 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=13 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:58:08.790673 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=37 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:58:08.796368 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d0b2ea8a-13ff-4ef0-8ac6-3cc7811d9ae1 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:58:08.808478 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-e824516d-f7bf-4e61-b2a7-5881e1459d96 req-446c77fd-5b48-410d-9fe5-9ed2761794db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81aa9d61-7bd5-4e07-9101-e981526f00c9", "tag": "e4aaef65-1861-4030-81f6-20ddb632987e"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:58:08.815427 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d0b2ea8a-13ff-4ef0-8ac6-3cc7811d9ae1 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:58:08.817999 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d0b2ea8a-13ff-4ef0-8ac6-3cc7811d9ae1 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:58:08.820639 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d0b2ea8a-13ff-4ef0-8ac6-3cc7811d9ae1 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:58:08.821286 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d0b2ea8a-13ff-4ef0-8ac6-3cc7811d9ae1 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:58:08.826800 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d0b2ea8a-13ff-4ef0-8ac6-3cc7811d9ae1 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:58:08.843364 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-e824516d-f7bf-4e61-b2a7-5881e1459d96 req-446c77fd-5b48-410d-9fe5-9ed2761794db service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:58:08.844153 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-e824516d-f7bf-4e61-b2a7-5881e1459d96 req-446c77fd-5b48-410d-9fe5-9ed2761794db service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:58:08.847195 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-e824516d-f7bf-4e61-b2a7-5881e1459d96 req-446c77fd-5b48-410d-9fe5-9ed2761794db service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:58:08.885398 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-e824516d-f7bf-4e61-b2a7-5881e1459d96 req-446c77fd-5b48-410d-9fe5-9ed2761794db service nova] Creating event network-changed:e4aaef65-1861-4030-81f6-20ddb632987e for instance 81aa9d61-7bd5-4e07-9101-e981526f00c9 on n-h1-862769-1 Oct 27 03:58:08.895076 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-e824516d-f7bf-4e61-b2a7-5881e1459d96 req-446c77fd-5b48-410d-9fe5-9ed2761794db service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090544 Oct 27 03:58:08.897563 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3331/6380] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:58:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:58:08.917800 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d0b2ea8a-13ff-4ef0-8ac6-3cc7811d9ae1 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 81aa9d61-7bd5-4e07-9101-e981526f00c9] Going to try to terminate instance {{(pid=121000) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:58:09.395591 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d0b2ea8a-13ff-4ef0-8ac6-3cc7811d9ae1 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "DELETE /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9" status: 204 len: 0 microversion: 2.1 time: 0.603628 Oct 27 03:58:09.395591 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3050/6381] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:58:08 2022] DELETE /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9 => generated 0 bytes in 606 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:58:09.395748 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5153c0a5-1d96-479b-8e94-d53f6a1f183c tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:58:09.395748 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5153c0a5-1d96-479b-8e94-d53f6a1f183c tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 81aa9d61-7bd5-4e07-9101-e981526f00c9] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:58:09.417548 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5153c0a5-1d96-479b-8e94-d53f6a1f183c tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:58:09.417548 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5153c0a5-1d96-479b-8e94-d53f6a1f183c tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:58:09.417548 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5153c0a5-1d96-479b-8e94-d53f6a1f183c tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:58:09.436174 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5153c0a5-1d96-479b-8e94-d53f6a1f183c tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:58:09.436707 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5153c0a5-1d96-479b-8e94-d53f6a1f183c tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:58:09.437163 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5153c0a5-1d96-479b-8e94-d53f6a1f183c tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:58:09.969197 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5153c0a5-1d96-479b-8e94-d53f6a1f183c tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:58:09.980433 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5153c0a5-1d96-479b-8e94-d53f6a1f183c tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9" status: 200 len: 1689 microversion: 2.1 time: 0.593435 Oct 27 03:58:09.984326 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3332/6382] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:58:09 2022] GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9 => generated 1689 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:58:11.011281 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-279ddf50-11b2-41c9-969e-21a94205adf1 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:58:11.012067 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-279ddf50-11b2-41c9-969e-21a94205adf1 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 81aa9d61-7bd5-4e07-9101-e981526f00c9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:58:11.034293 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-279ddf50-11b2-41c9-969e-21a94205adf1 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:58:11.034806 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-279ddf50-11b2-41c9-969e-21a94205adf1 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:58:11.035261 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-279ddf50-11b2-41c9-969e-21a94205adf1 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:58:11.035989 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-279ddf50-11b2-41c9-969e-21a94205adf1 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:58:11.036452 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-279ddf50-11b2-41c9-969e-21a94205adf1 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:58:11.036887 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-279ddf50-11b2-41c9-969e-21a94205adf1 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:58:11.794263 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-279ddf50-11b2-41c9-969e-21a94205adf1 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:58:11.826562 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-279ddf50-11b2-41c9-969e-21a94205adf1 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9" status: 200 len: 1689 microversion: 2.1 time: 0.821204 Oct 27 03:58:11.849640 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3051/6383] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:58:11 2022] GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9 => generated 1689 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:58:12.264695 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-388810fa-17c3-41de-9a8b-091d9c9c9e30 req-01fd989d-5681-41df-b376-cd340807472e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81aa9d61-7bd5-4e07-9101-e981526f00c9", "name": "network-vif-deleted", "tag": "e4aaef65-1861-4030-81f6-20ddb632987e"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:58:12.277756 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-388810fa-17c3-41de-9a8b-091d9c9c9e30 req-01fd989d-5681-41df-b376-cd340807472e service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:58:12.278288 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-388810fa-17c3-41de-9a8b-091d9c9c9e30 req-01fd989d-5681-41df-b376-cd340807472e service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:58:12.278735 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-388810fa-17c3-41de-9a8b-091d9c9c9e30 req-01fd989d-5681-41df-b376-cd340807472e service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:58:12.291317 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-388810fa-17c3-41de-9a8b-091d9c9c9e30 req-01fd989d-5681-41df-b376-cd340807472e service nova] Creating event network-vif-deleted:e4aaef65-1861-4030-81f6-20ddb632987e for instance 81aa9d61-7bd5-4e07-9101-e981526f00c9 on n-h1-862769-1 Oct 27 03:58:12.296607 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-388810fa-17c3-41de-9a8b-091d9c9c9e30 req-01fd989d-5681-41df-b376-cd340807472e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042135 Oct 27 03:58:12.298640 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3333/6384] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:58:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:58:12.853921 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8960fc10-d153-4e8b-92a6-9f3d631b9e3f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:58:12.861980 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8960fc10-d153-4e8b-92a6-9f3d631b9e3f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 81aa9d61-7bd5-4e07-9101-e981526f00c9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:58:12.862350 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8960fc10-d153-4e8b-92a6-9f3d631b9e3f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:58:12.862848 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8960fc10-d153-4e8b-92a6-9f3d631b9e3f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:58:12.863297 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8960fc10-d153-4e8b-92a6-9f3d631b9e3f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:58:12.864010 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8960fc10-d153-4e8b-92a6-9f3d631b9e3f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:58:12.864473 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8960fc10-d153-4e8b-92a6-9f3d631b9e3f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:58:12.864954 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8960fc10-d153-4e8b-92a6-9f3d631b9e3f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:58:12.901012 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8960fc10-d153-4e8b-92a6-9f3d631b9e3f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:58:12.901511 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8960fc10-d153-4e8b-92a6-9f3d631b9e3f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:58:12.902207 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8960fc10-d153-4e8b-92a6-9f3d631b9e3f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:58:12.902859 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-8960fc10-d153-4e8b-92a6-9f3d631b9e3f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lazy-loading 'fault' on Instance uuid 81aa9d61-7bd5-4e07-9101-e981526f00c9 {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:58:12.949832 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8960fc10-d153-4e8b-92a6-9f3d631b9e3f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:58:12.958806 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8960fc10-d153-4e8b-92a6-9f3d631b9e3f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9" status: 200 len: 1356 microversion: 2.1 time: 0.108962 Oct 27 03:58:12.959417 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3052/6385] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:58:12 2022] GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9 => generated 1356 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:58:13.984123 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-11f8612a-73ad-4ee7-b319-59dfb3910ce6 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:58:13.984844 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-11f8612a-73ad-4ee7-b319-59dfb3910ce6 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 81aa9d61-7bd5-4e07-9101-e981526f00c9] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:58:13.996260 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-11f8612a-73ad-4ee7-b319-59dfb3910ce6 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:58:14.000106 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-11f8612a-73ad-4ee7-b319-59dfb3910ce6 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:58:14.000928 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-11f8612a-73ad-4ee7-b319-59dfb3910ce6 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:58:14.004074 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-11f8612a-73ad-4ee7-b319-59dfb3910ce6 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:58:14.006166 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-11f8612a-73ad-4ee7-b319-59dfb3910ce6 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:58:14.010057 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-11f8612a-73ad-4ee7-b319-59dfb3910ce6 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:58:14.029407 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-11f8612a-73ad-4ee7-b319-59dfb3910ce6 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] HTTP exception thrown: Instance 81aa9d61-7bd5-4e07-9101-e981526f00c9 could not be found. Oct 27 03:58:14.031539 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-11f8612a-73ad-4ee7-b319-59dfb3910ce6 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Request method failure captured: Oct 27 03:58:14.031539 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9 HTTP/1.1 Oct 27 03:58:14.031539 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 03:58:14.031539 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 03:58:14.031539 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 03:58:14.031539 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 03:58:14.031539 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 03:58:14.031539 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 03:58:14.031539 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 03:58:14.031539 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 03:58:14.031539 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWgCBfAAwg6CX6jDfTtZPKjU4IWrIPYNtoTX74Z0294jlmpA1hscNVPpQCZKJL8OTT0mEifdIsaGagx_vQ0B8uGp3mqvS5WXv14Q21L8zoEIglWon1GOJtZ7gJgUVC645n40NoZhGr_naOfvzanpfLwOaaEk7i8HP5LshJWpyWvY3Sp0 Oct 27 03:58:14.031539 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 03:58:14.031539 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 03:58:14.031539 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 03:58:14.031539 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 03:58:14.031539 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 03:58:14.031539 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 03:58:14.031539 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: a432dda4903145278d79210121b3f77d Oct 27 03:58:14.031539 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-505113127 Oct 27 03:58:14.031539 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 03:58:14.031539 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 03:58:14.031539 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a432dda4903145278d79210121b3f77d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a432dda4903145278d79210121b3f77d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a432dda4903145278d79210121b3f77d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a432dda4903145278d79210121b3f77d"}]}] Oct 27 03:58:14.031539 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-TestNetworkAdvancedServerOps-505113127 Oct 27 03:58:14.031539 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: a432dda4903145278d79210121b3f77d Oct 27 03:58:14.031539 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-505113127 Oct 27 03:58:14.031539 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-TestNetworkAdvancedServerOps-505113127-project Oct 27 03:58:14.031539 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 03:58:14.031539 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 03:58:14.031539 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: a2ea55b400c24827a28e816ea2a225aa Oct 27 03:58:14.031539 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-TestNetworkAdvancedServerOps-505113127-project Oct 27 03:58:14.031539 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 03:58:14.031539 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 81aa9d61-7bd5-4e07-9101-e981526f00c9 could not be found. Oct 27 03:58:14.031539 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '81aa9d61-7bd5-4e07-9101-e981526f00c9'} Oct 27 03:58:14.031539 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:58:14.031539 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:58:14.031539 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:58:14.031539 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:58:14.031539 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:58:14.031539 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:58:14.031539 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:58:14.031539 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:58:14.031539 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:58:14.031539 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:58:14.031539 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81aa9d61-7bd5-4e07-9101-e981526f00c9 could not be found. Oct 27 03:58:14.031539 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:58:14.031539 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:58:14.031539 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:58:14.031539 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:58:14.031539 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:58:14.031539 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:58:14.031539 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:58:14.031539 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:58:14.031539 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:58:14.031539 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:58:14.031539 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:58:14.031539 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:58:14.031539 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:58:14.031539 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:58:14.031539 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:58:14.031539 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:58:14.031539 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81aa9d61-7bd5-4e07-9101-e981526f00c9 could not be found. Oct 27 03:58:14.031539 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:58:14.031539 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:58:14.036029 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:58:14.036029 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:58:14.036029 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:58:14.036029 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:58:14.036029 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:58:14.036029 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:58:14.036029 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81aa9d61-7bd5-4e07-9101-e981526f00c9 could not be found. Oct 27 03:58:14.036029 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 03:58:14.039073 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-11f8612a-73ad-4ee7-b319-59dfb3910ce6 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Returning 404 to user: Instance 81aa9d61-7bd5-4e07-9101-e981526f00c9 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:58:14.040485 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-11f8612a-73ad-4ee7-b319-59dfb3910ce6 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9" status: 404 len: 111 microversion: 2.1 time: 0.060800 Oct 27 03:58:14.044345 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3334/6386] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:58:13 2022] GET /compute/v2.1/servers/81aa9d61-7bd5-4e07-9101-e981526f00c9 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:58:23.275883 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ed076d6b-bd15-483f-92f4-36b22e3e0ed8 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '.version_select at 0x7f7ddaf5f1f0>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:58:23.291118 n-d-862769-1 devstack@n-api.service[121000]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ed076d6b-bd15-483f-92f4-36b22e3e0ed8 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [bc5cc820-22d4-4c61-b33e-040cb7304259] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 27 03:58:23.293707 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:58:23.299748 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:58:24.302231 n-d-862769-1 devstack@n-api.service[121000]: INFO oslo.messaging._drivers.impl_rabbit [None req-ed076d6b-bd15-483f-92f4-36b22e3e0ed8 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [bc5cc820-22d4-4c61-b33e-040cb7304259] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 41006. Oct 27 03:58:24.425562 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ed076d6b-bd15-483f-92f4-36b22e3e0ed8 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1138222693" status: 202 len: 0 microversion: 2.1 time: 1.154828 Oct 27 03:58:24.441377 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3053/6387] 10.222.0.20 () {58 vars in 1284 bytes} [Thu Oct 27 03:58:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1138222693 => generated 0 bytes in 1159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:58:24.489946 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-cc65cda7-3ec4-42fa-9f58-63f4d538f9f9 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Action: 'create', calling method: .version_select at 0x7f7dd95cd940>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-174810317", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBk8nN4UsKvSlsvzo2mgezckr54KXhYHxCjTXw1zEHSls/2dIwM4jboyzRwE0ltAhlJtVSBFlsks53ZoJgE/eFSi4H3O/8AOEguGCSMUGRcwJRpadqMM2S6v/rrlYPJyPg=="}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:58:24.498158 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:58:24.499025 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=14 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:58:24.532143 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-cc65cda7-3ec4-42fa-9f58-63f4d538f9f9 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Getting quotas for project a432dda4903145278d79210121b3f77d. Resources: {'key_pairs'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:58:24.556073 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-cc65cda7-3ec4-42fa-9f58-63f4d538f9f9 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Getting quotas for user a2ea55b400c24827a28e816ea2a225aa and project a432dda4903145278d79210121b3f77d. Resources: {'key_pairs'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:58:24.575006 n-d-862769-1 devstack@n-api.service[121001]: ERROR oslo.messaging._drivers.impl_rabbit [None req-cc65cda7-3ec4-42fa-9f58-63f4d538f9f9 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [119cb6cf-0f2a-475d-be14-9995ea4abc39] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 27 03:58:25.590620 n-d-862769-1 devstack@n-api.service[121001]: INFO oslo.messaging._drivers.impl_rabbit [None req-cc65cda7-3ec4-42fa-9f58-63f4d538f9f9 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [119cb6cf-0f2a-475d-be14-9995ea4abc39] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 41026. Oct 27 03:58:25.660215 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-cc65cda7-3ec4-42fa-9f58-63f4d538f9f9 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 1.174724 Oct 27 03:58:25.661147 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3335/6388] 10.222.0.20 () {60 vars in 1159 bytes} [Thu Oct 27 03:58:24 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:58:31.533120 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f074b2dd-cbe5-4d06-aa95-fc887fc66801 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:58:31.535202 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f074b2dd-cbe5-4d06-aa95-fc887fc66801 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:58:31.538314 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f074b2dd-cbe5-4d06-aa95-fc887fc66801 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:58:31.538804 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f074b2dd-cbe5-4d06-aa95-fc887fc66801 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:58:31.539638 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f074b2dd-cbe5-4d06-aa95-fc887fc66801 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:58:31.541305 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f074b2dd-cbe5-4d06-aa95-fc887fc66801 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:58:31.541865 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f074b2dd-cbe5-4d06-aa95-fc887fc66801 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:58:31.595832 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f074b2dd-cbe5-4d06-aa95-fc887fc66801 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] 10.222.0.20 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.505916 Oct 27 03:58:31.596959 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3054/6389] 10.222.0.20 () {58 vars in 1185 bytes} [Thu Oct 27 03:58:31 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:58:31.810849 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8a93ca38-6cd2-4e86-8e36-0ed8a499b1fc tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-764007820", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "availability_zone": "nova:n-h2-862769-1", "networks": [{"uuid": "e3097ed5-73dd-458c-a255-7a409f72f805"}]}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:58:31.901534 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.network.neutron [None req-8a93ca38-6cd2-4e86-8e36-0ed8a499b1fc tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] validate_networks() for [('e3097ed5-73dd-458c-a255-7a409f72f805', None, None, None, None, None)] {{(pid=121001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:58:32.771719 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-8a93ca38-6cd2-4e86-8e36-0ed8a499b1fc tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Flavor limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:58:32.772333 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-8a93ca38-6cd2-4e86-8e36-0ed8a499b1fc tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Image limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:58:32.773025 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-8a93ca38-6cd2-4e86-8e36-0ed8a499b1fc tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Flavor pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:58:32.773513 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-8a93ca38-6cd2-4e86-8e36-0ed8a499b1fc tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Image pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:58:32.774050 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-8a93ca38-6cd2-4e86-8e36-0ed8a499b1fc tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:58:32.813179 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8a93ca38-6cd2-4e86-8e36-0ed8a499b1fc tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:58:32.815386 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8a93ca38-6cd2-4e86-8e36-0ed8a499b1fc tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:58:32.816054 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8a93ca38-6cd2-4e86-8e36-0ed8a499b1fc tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:58:32.817078 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8a93ca38-6cd2-4e86-8e36-0ed8a499b1fc tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:58:32.817887 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8a93ca38-6cd2-4e86-8e36-0ed8a499b1fc tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:58:32.822726 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8a93ca38-6cd2-4e86-8e36-0ed8a499b1fc tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:58:32.865454 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-8a93ca38-6cd2-4e86-8e36-0ed8a499b1fc tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Getting quotas for project 57742c85c58c458495524da0b5f78f93. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:58:32.921971 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-8a93ca38-6cd2-4e86-8e36-0ed8a499b1fc tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Getting quotas for user a1552fd790d342e29fa8deef441fbfc8 and project 57742c85c58c458495524da0b5f78f93. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:58:32.961982 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8a93ca38-6cd2-4e86-8e36-0ed8a499b1fc tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Going to run 1 instances... {{(pid=121001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:58:32.964579 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8a93ca38-6cd2-4e86-8e36-0ed8a499b1fc tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] [instance: 6d3618b4-d458-4283-9be6-38bd764377c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:58:33.238681 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8a93ca38-6cd2-4e86-8e36-0ed8a499b1fc tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.431451 Oct 27 03:58:33.242388 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3336/6390] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:58:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1436 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 03:58:33.256055 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6d5509ee-b688-4fdf-8db6-fa51a82ef91d tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:58:33.257272 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6d5509ee-b688-4fdf-8db6-fa51a82ef91d tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] [instance: 6d3618b4-d458-4283-9be6-38bd764377c4] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:58:33.588916 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6d5509ee-b688-4fdf-8db6-fa51a82ef91d tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/6d3618b4-d458-4283-9be6-38bd764377c4" status: 200 len: 1328 microversion: 2.1 time: 0.338651 Oct 27 03:58:33.594898 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3055/6391] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:58:33 2022] GET /compute/v2.1/servers/6d3618b4-d458-4283-9be6-38bd764377c4 => generated 1328 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:58:34.625815 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-123d41ac-43fc-49de-96af-6e09b78289a3 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:58:34.628408 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-123d41ac-43fc-49de-96af-6e09b78289a3 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] [instance: 6d3618b4-d458-4283-9be6-38bd764377c4] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:58:34.840478 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-123d41ac-43fc-49de-96af-6e09b78289a3 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/6d3618b4-d458-4283-9be6-38bd764377c4" status: 200 len: 1328 microversion: 2.1 time: 0.218669 Oct 27 03:58:34.843608 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3337/6392] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:58:34 2022] GET /compute/v2.1/servers/6d3618b4-d458-4283-9be6-38bd764377c4 => generated 1328 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:58:35.871434 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e8063336-45e6-4463-840f-c0ef0856f79a tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:58:35.872073 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e8063336-45e6-4463-840f-c0ef0856f79a tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] [instance: 6d3618b4-d458-4283-9be6-38bd764377c4] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:58:35.891355 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e8063336-45e6-4463-840f-c0ef0856f79a tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:58:35.894284 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e8063336-45e6-4463-840f-c0ef0856f79a tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:58:35.894933 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e8063336-45e6-4463-840f-c0ef0856f79a tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:58:35.897156 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e8063336-45e6-4463-840f-c0ef0856f79a tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:58:35.917424 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e8063336-45e6-4463-840f-c0ef0856f79a tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:58:35.918350 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e8063336-45e6-4463-840f-c0ef0856f79a tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:58:36.862941 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e8063336-45e6-4463-840f-c0ef0856f79a tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/6d3618b4-d458-4283-9be6-38bd764377c4" status: 200 len: 1337 microversion: 2.1 time: 0.996457 Oct 27 03:58:36.864293 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3056/6393] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:58:35 2022] GET /compute/v2.1/servers/6d3618b4-d458-4283-9be6-38bd764377c4 => generated 1337 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:58:37.890460 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5b710fb4-070a-4873-bcc2-db0c60cfc6b6 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:58:37.898931 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5b710fb4-070a-4873-bcc2-db0c60cfc6b6 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] [instance: 6d3618b4-d458-4283-9be6-38bd764377c4] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:58:37.927329 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5b710fb4-070a-4873-bcc2-db0c60cfc6b6 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:58:37.928083 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5b710fb4-070a-4873-bcc2-db0c60cfc6b6 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:58:37.929682 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5b710fb4-070a-4873-bcc2-db0c60cfc6b6 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:58:37.932794 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5b710fb4-070a-4873-bcc2-db0c60cfc6b6 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:58:37.933464 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5b710fb4-070a-4873-bcc2-db0c60cfc6b6 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:58:37.934569 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5b710fb4-070a-4873-bcc2-db0c60cfc6b6 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:58:39.240039 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5b710fb4-070a-4873-bcc2-db0c60cfc6b6 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/6d3618b4-d458-4283-9be6-38bd764377c4" status: 200 len: 1463 microversion: 2.1 time: 1.353716 Oct 27 03:58:39.244719 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3338/6394] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:58:37 2022] GET /compute/v2.1/servers/6d3618b4-d458-4283-9be6-38bd764377c4 => generated 1463 bytes in 1359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:58:40.272815 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-34e542b4-1d61-42d4-b8f0-a80ef674f502 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:58:40.273582 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-34e542b4-1d61-42d4-b8f0-a80ef674f502 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] [instance: 6d3618b4-d458-4283-9be6-38bd764377c4] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:58:40.288274 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-34e542b4-1d61-42d4-b8f0-a80ef674f502 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:58:40.289682 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-34e542b4-1d61-42d4-b8f0-a80ef674f502 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:58:40.291125 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-34e542b4-1d61-42d4-b8f0-a80ef674f502 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:58:40.295403 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-34e542b4-1d61-42d4-b8f0-a80ef674f502 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:58:40.295403 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-34e542b4-1d61-42d4-b8f0-a80ef674f502 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:58:40.295794 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-34e542b4-1d61-42d4-b8f0-a80ef674f502 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:58:40.695544 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-34e542b4-1d61-42d4-b8f0-a80ef674f502 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/6d3618b4-d458-4283-9be6-38bd764377c4" status: 200 len: 1463 microversion: 2.1 time: 0.425088 Oct 27 03:58:40.699022 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3057/6395] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:58:40 2022] GET /compute/v2.1/servers/6d3618b4-d458-4283-9be6-38bd764377c4 => generated 1463 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:58:41.460593 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-e0a15f17-fa66-466f-b280-0ffde6f3ff2f req-d6ef64ec-95fd-4318-af39-b7e1cd743e0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d3618b4-d458-4283-9be6-38bd764377c4", "tag": "19501bc4-c54e-48e0-a3cc-841c281a5572"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:58:41.487231 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-e0a15f17-fa66-466f-b280-0ffde6f3ff2f req-d6ef64ec-95fd-4318-af39-b7e1cd743e0c service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:58:41.492447 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-e0a15f17-fa66-466f-b280-0ffde6f3ff2f req-d6ef64ec-95fd-4318-af39-b7e1cd743e0c service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:58:41.493171 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-e0a15f17-fa66-466f-b280-0ffde6f3ff2f req-d6ef64ec-95fd-4318-af39-b7e1cd743e0c service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:58:41.537897 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-e0a15f17-fa66-466f-b280-0ffde6f3ff2f req-d6ef64ec-95fd-4318-af39-b7e1cd743e0c service nova] Creating event network-changed:19501bc4-c54e-48e0-a3cc-841c281a5572 for instance 6d3618b4-d458-4283-9be6-38bd764377c4 on n-h2-862769-1 Oct 27 03:58:41.550711 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-e0a15f17-fa66-466f-b280-0ffde6f3ff2f req-d6ef64ec-95fd-4318-af39-b7e1cd743e0c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096245 Oct 27 03:58:41.553972 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3339/6396] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:58:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:58:41.726584 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-276133ae-9f8e-4b1c-8d09-de841c6bbc3c tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:58:41.728708 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-276133ae-9f8e-4b1c-8d09-de841c6bbc3c tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] [instance: 6d3618b4-d458-4283-9be6-38bd764377c4] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:58:41.742400 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:58:41.745638 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-276133ae-9f8e-4b1c-8d09-de841c6bbc3c tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:58:41.745638 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-276133ae-9f8e-4b1c-8d09-de841c6bbc3c tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:58:41.745638 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-276133ae-9f8e-4b1c-8d09-de841c6bbc3c tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:58:41.746737 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-276133ae-9f8e-4b1c-8d09-de841c6bbc3c tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:58:41.747423 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-276133ae-9f8e-4b1c-8d09-de841c6bbc3c tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:58:41.749259 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-276133ae-9f8e-4b1c-8d09-de841c6bbc3c tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:58:42.596005 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-276133ae-9f8e-4b1c-8d09-de841c6bbc3c tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/6d3618b4-d458-4283-9be6-38bd764377c4" status: 200 len: 1463 microversion: 2.1 time: 0.873195 Oct 27 03:58:42.597292 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3058/6397] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:58:41 2022] GET /compute/v2.1/servers/6d3618b4-d458-4283-9be6-38bd764377c4 => generated 1463 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:58:43.624240 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-85dbf1be-371a-4967-8ddd-5f0add21e5f2 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:58:43.624959 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-85dbf1be-371a-4967-8ddd-5f0add21e5f2 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] [instance: 6d3618b4-d458-4283-9be6-38bd764377c4] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:58:43.628674 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:58:43.640219 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-85dbf1be-371a-4967-8ddd-5f0add21e5f2 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:58:43.640727 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-85dbf1be-371a-4967-8ddd-5f0add21e5f2 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:58:43.652047 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-85dbf1be-371a-4967-8ddd-5f0add21e5f2 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:58:43.655352 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-85dbf1be-371a-4967-8ddd-5f0add21e5f2 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:58:43.657864 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-85dbf1be-371a-4967-8ddd-5f0add21e5f2 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:58:43.659930 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-85dbf1be-371a-4967-8ddd-5f0add21e5f2 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:58:44.310637 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-85dbf1be-371a-4967-8ddd-5f0add21e5f2 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/6d3618b4-d458-4283-9be6-38bd764377c4" status: 200 len: 1463 microversion: 2.1 time: 0.685927 Oct 27 03:58:44.313317 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3340/6398] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:58:43 2022] GET /compute/v2.1/servers/6d3618b4-d458-4283-9be6-38bd764377c4 => generated 1463 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:58:45.338958 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ed41e22b-7513-4266-a59a-3c055cdd94b3 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:58:45.340241 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ed41e22b-7513-4266-a59a-3c055cdd94b3 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] [instance: 6d3618b4-d458-4283-9be6-38bd764377c4] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:58:45.350123 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:58:45.363314 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ed41e22b-7513-4266-a59a-3c055cdd94b3 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:58:45.364097 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ed41e22b-7513-4266-a59a-3c055cdd94b3 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:58:45.370108 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ed41e22b-7513-4266-a59a-3c055cdd94b3 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:58:45.371197 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ed41e22b-7513-4266-a59a-3c055cdd94b3 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:58:45.371854 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ed41e22b-7513-4266-a59a-3c055cdd94b3 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:58:45.372568 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ed41e22b-7513-4266-a59a-3c055cdd94b3 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:58:45.904447 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ed41e22b-7513-4266-a59a-3c055cdd94b3 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/6d3618b4-d458-4283-9be6-38bd764377c4" status: 200 len: 1463 microversion: 2.1 time: 0.568989 Oct 27 03:58:45.916971 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3059/6399] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:58:45 2022] GET /compute/v2.1/servers/6d3618b4-d458-4283-9be6-38bd764377c4 => generated 1463 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:58:46.932983 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-53de1cc4-ea42-4099-9040-75bd3cdbf182 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:58:46.934047 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-53de1cc4-ea42-4099-9040-75bd3cdbf182 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] [instance: 6d3618b4-d458-4283-9be6-38bd764377c4] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:58:46.951053 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=12 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:58:46.959360 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-53de1cc4-ea42-4099-9040-75bd3cdbf182 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:58:46.959872 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-53de1cc4-ea42-4099-9040-75bd3cdbf182 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:58:46.960318 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-53de1cc4-ea42-4099-9040-75bd3cdbf182 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:58:46.961399 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-53de1cc4-ea42-4099-9040-75bd3cdbf182 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:58:46.961521 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-53de1cc4-ea42-4099-9040-75bd3cdbf182 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:58:46.969818 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-53de1cc4-ea42-4099-9040-75bd3cdbf182 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:58:47.413555 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-53de1cc4-ea42-4099-9040-75bd3cdbf182 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/6d3618b4-d458-4283-9be6-38bd764377c4" status: 200 len: 1463 microversion: 2.1 time: 0.482245 Oct 27 03:58:47.421446 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3341/6400] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:58:46 2022] GET /compute/v2.1/servers/6d3618b4-d458-4283-9be6-38bd764377c4 => generated 1463 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:58:47.944271 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3b317e68-596e-4587-a183-86087e5bedcd tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-237410102", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": [{"uuid": "e1011ea0-4c0f-412c-87e7-27aa3d7c6027"}], "key_name": "tempest-TestNetworkAdvancedServerOps-174810317", "security_groups": [{"name": "tempest-secgroup-smoke-1384109882"}]}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:58:48.328460 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-3b317e68-596e-4587-a183-86087e5bedcd tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] validate_networks() for [('e1011ea0-4c0f-412c-87e7-27aa3d7c6027', None, None, None, None, None)] {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:58:48.452255 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ecb2733a-fc02-422f-a50e-a5b8118fdb33 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:58:48.453069 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ecb2733a-fc02-422f-a50e-a5b8118fdb33 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] [instance: 6d3618b4-d458-4283-9be6-38bd764377c4] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:58:48.490526 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ecb2733a-fc02-422f-a50e-a5b8118fdb33 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:58:48.496334 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ecb2733a-fc02-422f-a50e-a5b8118fdb33 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:58:48.498860 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ecb2733a-fc02-422f-a50e-a5b8118fdb33 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:58:48.507030 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ecb2733a-fc02-422f-a50e-a5b8118fdb33 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:58:48.509103 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ecb2733a-fc02-422f-a50e-a5b8118fdb33 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:58:48.510897 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ecb2733a-fc02-422f-a50e-a5b8118fdb33 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:58:48.888009 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ecb2733a-fc02-422f-a50e-a5b8118fdb33 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/6d3618b4-d458-4283-9be6-38bd764377c4" status: 200 len: 1463 microversion: 2.1 time: 0.445410 Oct 27 03:58:48.888606 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3342/6401] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:58:48 2022] GET /compute/v2.1/servers/6d3618b4-d458-4283-9be6-38bd764377c4 => generated 1463 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:58:49.911654 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b9b91e4f-5c98-47a5-9b67-52739c8ed232 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:58:49.914725 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b9b91e4f-5c98-47a5-9b67-52739c8ed232 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] [instance: 6d3618b4-d458-4283-9be6-38bd764377c4] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:58:49.938466 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b9b91e4f-5c98-47a5-9b67-52739c8ed232 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:58:49.941849 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b9b91e4f-5c98-47a5-9b67-52739c8ed232 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:58:49.947124 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b9b91e4f-5c98-47a5-9b67-52739c8ed232 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:58:49.948146 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b9b91e4f-5c98-47a5-9b67-52739c8ed232 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:58:49.951752 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b9b91e4f-5c98-47a5-9b67-52739c8ed232 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:58:49.953167 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b9b91e4f-5c98-47a5-9b67-52739c8ed232 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:58:50.442629 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b9b91e4f-5c98-47a5-9b67-52739c8ed232 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/6d3618b4-d458-4283-9be6-38bd764377c4" status: 200 len: 1463 microversion: 2.1 time: 0.535392 Oct 27 03:58:50.443848 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3343/6402] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:58:49 2022] GET /compute/v2.1/servers/6d3618b4-d458-4283-9be6-38bd764377c4 => generated 1463 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:58:50.747775 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-3b317e68-596e-4587-a183-86087e5bedcd tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:58:50.748251 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-3b317e68-596e-4587-a183-86087e5bedcd tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:58:50.748691 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-3b317e68-596e-4587-a183-86087e5bedcd tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:58:50.749125 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-3b317e68-596e-4587-a183-86087e5bedcd tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:58:50.749538 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-3b317e68-596e-4587-a183-86087e5bedcd tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:58:50.769271 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3b317e68-596e-4587-a183-86087e5bedcd tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:58:50.769866 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3b317e68-596e-4587-a183-86087e5bedcd tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:58:50.772452 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3b317e68-596e-4587-a183-86087e5bedcd tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:58:50.773315 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3b317e68-596e-4587-a183-86087e5bedcd tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:58:50.773839 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3b317e68-596e-4587-a183-86087e5bedcd tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:58:50.801061 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3b317e68-596e-4587-a183-86087e5bedcd tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:58:50.892368 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-3b317e68-596e-4587-a183-86087e5bedcd tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Getting quotas for project a432dda4903145278d79210121b3f77d. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:58:50.916827 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-3b317e68-596e-4587-a183-86087e5bedcd tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Getting quotas for user a2ea55b400c24827a28e816ea2a225aa and project a432dda4903145278d79210121b3f77d. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:58:50.977170 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-3b317e68-596e-4587-a183-86087e5bedcd tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:58:50.985380 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-8a7e92b7-1753-4b94-8ad0-dce1b59a3431 req-627381cc-05e2-478d-b0c0-516157dcf07f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d3618b4-d458-4283-9be6-38bd764377c4", "name": "network-vif-plugged", "status": "completed", "tag": "19501bc4-c54e-48e0-a3cc-841c281a5572"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:58:50.990019 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-3b317e68-596e-4587-a183-86087e5bedcd tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: b3de2208-af44-465e-bcd6-62cb7c5198be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:58:51.016645 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-8a7e92b7-1753-4b94-8ad0-dce1b59a3431 req-627381cc-05e2-478d-b0c0-516157dcf07f service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:58:51.026283 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-8a7e92b7-1753-4b94-8ad0-dce1b59a3431 req-627381cc-05e2-478d-b0c0-516157dcf07f service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:58:51.026817 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-8a7e92b7-1753-4b94-8ad0-dce1b59a3431 req-627381cc-05e2-478d-b0c0-516157dcf07f service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:58:51.103001 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-8a7e92b7-1753-4b94-8ad0-dce1b59a3431 req-627381cc-05e2-478d-b0c0-516157dcf07f service nova] Creating event network-vif-plugged:19501bc4-c54e-48e0-a3cc-841c281a5572 for instance 6d3618b4-d458-4283-9be6-38bd764377c4 on n-h2-862769-1 Oct 27 03:58:51.118923 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-8a7e92b7-1753-4b94-8ad0-dce1b59a3431 req-627381cc-05e2-478d-b0c0-516157dcf07f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137698 Oct 27 03:58:51.129959 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3344/6403] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:58:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:58:51.258646 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3b317e68-596e-4587-a183-86087e5bedcd tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.318703 Oct 27 03:58:51.278158 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-44dd0d6c-92d1-4011-b228-a2557a48806c tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:58:51.278924 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-44dd0d6c-92d1-4011-b228-a2557a48806c tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: b3de2208-af44-465e-bcd6-62cb7c5198be] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:58:51.298351 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3060/6404] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:58:47 2022] POST /compute/v2.1/servers => generated 406 bytes in 3359 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 03:58:51.478426 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-bd04f1c4-b36b-46f1-94ed-cf3a175946e3 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:58:51.479514 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-bd04f1c4-b36b-46f1-94ed-cf3a175946e3 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] [instance: 6d3618b4-d458-4283-9be6-38bd764377c4] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:58:51.488016 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bd04f1c4-b36b-46f1-94ed-cf3a175946e3 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:58:51.490723 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bd04f1c4-b36b-46f1-94ed-cf3a175946e3 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:58:51.494611 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bd04f1c4-b36b-46f1-94ed-cf3a175946e3 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:58:51.498310 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bd04f1c4-b36b-46f1-94ed-cf3a175946e3 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:58:51.499143 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bd04f1c4-b36b-46f1-94ed-cf3a175946e3 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:58:51.501575 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bd04f1c4-b36b-46f1-94ed-cf3a175946e3 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:58:51.511728 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-44dd0d6c-92d1-4011-b228-a2557a48806c tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:58:51.525509 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-44dd0d6c-92d1-4011-b228-a2557a48806c tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/b3de2208-af44-465e-bcd6-62cb7c5198be" status: 200 len: 1265 microversion: 2.1 time: 0.258292 Oct 27 03:58:51.526135 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3345/6405] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:58:51 2022] GET /compute/v2.1/servers/b3de2208-af44-465e-bcd6-62cb7c5198be => generated 1265 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:58:52.555574 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e3e3a91e-c73d-47ee-a240-a854f97ffc10 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:58:52.557033 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e3e3a91e-c73d-47ee-a240-a854f97ffc10 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: b3de2208-af44-465e-bcd6-62cb7c5198be] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:58:52.717264 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e3e3a91e-c73d-47ee-a240-a854f97ffc10 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:58:52.729845 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e3e3a91e-c73d-47ee-a240-a854f97ffc10 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/b3de2208-af44-465e-bcd6-62cb7c5198be" status: 200 len: 1265 microversion: 2.1 time: 0.177123 Oct 27 03:58:52.732291 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3346/6406] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:58:52 2022] GET /compute/v2.1/servers/b3de2208-af44-465e-bcd6-62cb7c5198be => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:58:52.943124 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-bd04f1c4-b36b-46f1-94ed-cf3a175946e3 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/6d3618b4-d458-4283-9be6-38bd764377c4" status: 200 len: 1463 microversion: 2.1 time: 1.469033 Oct 27 03:58:52.943743 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3061/6407] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:58:51 2022] GET /compute/v2.1/servers/6d3618b4-d458-4283-9be6-38bd764377c4 => generated 1463 bytes in 1473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:58:53.762311 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a547d48d-0ec4-4a19-8083-6bc01533234f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:58:53.762950 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a547d48d-0ec4-4a19-8083-6bc01533234f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: b3de2208-af44-465e-bcd6-62cb7c5198be] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:58:53.774059 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a547d48d-0ec4-4a19-8083-6bc01533234f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:58:53.774909 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a547d48d-0ec4-4a19-8083-6bc01533234f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:58:53.776218 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a547d48d-0ec4-4a19-8083-6bc01533234f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:58:53.777205 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a547d48d-0ec4-4a19-8083-6bc01533234f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:58:53.778252 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a547d48d-0ec4-4a19-8083-6bc01533234f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:58:53.778851 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a547d48d-0ec4-4a19-8083-6bc01533234f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:58:53.879777 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a547d48d-0ec4-4a19-8083-6bc01533234f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:58:53.901189 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a547d48d-0ec4-4a19-8083-6bc01533234f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/b3de2208-af44-465e-bcd6-62cb7c5198be" status: 200 len: 1317 microversion: 2.1 time: 0.145664 Oct 27 03:58:53.904267 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3347/6408] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:58:53 2022] GET /compute/v2.1/servers/b3de2208-af44-465e-bcd6-62cb7c5198be => generated 1317 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:58:53.973084 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ecf89a94-47c6-43dc-8f05-098bd8b3a68e tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:58:53.973950 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ecf89a94-47c6-43dc-8f05-098bd8b3a68e tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] [instance: 6d3618b4-d458-4283-9be6-38bd764377c4] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:58:53.977693 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:58:53.982997 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ecf89a94-47c6-43dc-8f05-098bd8b3a68e tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:58:53.983824 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ecf89a94-47c6-43dc-8f05-098bd8b3a68e tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:58:53.984476 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ecf89a94-47c6-43dc-8f05-098bd8b3a68e tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:58:53.985334 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ecf89a94-47c6-43dc-8f05-098bd8b3a68e tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:58:53.985945 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ecf89a94-47c6-43dc-8f05-098bd8b3a68e tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:58:53.993328 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ecf89a94-47c6-43dc-8f05-098bd8b3a68e tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:58:54.013054 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=35 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:58:54.230008 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ecf89a94-47c6-43dc-8f05-098bd8b3a68e tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/6d3618b4-d458-4283-9be6-38bd764377c4" status: 200 len: 1463 microversion: 2.1 time: 0.263181 Oct 27 03:58:54.233813 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3062/6409] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:58:53 2022] GET /compute/v2.1/servers/6d3618b4-d458-4283-9be6-38bd764377c4 => generated 1463 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:58:54.935314 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6b240959-09bd-45b9-adf3-fbac2392f295 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:58:54.938169 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-6b240959-09bd-45b9-adf3-fbac2392f295 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: b3de2208-af44-465e-bcd6-62cb7c5198be] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:58:54.959668 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6b240959-09bd-45b9-adf3-fbac2392f295 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:58:54.962226 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6b240959-09bd-45b9-adf3-fbac2392f295 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:58:54.962709 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6b240959-09bd-45b9-adf3-fbac2392f295 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:58:54.967804 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6b240959-09bd-45b9-adf3-fbac2392f295 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:58:54.969412 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6b240959-09bd-45b9-adf3-fbac2392f295 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:58:54.970161 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6b240959-09bd-45b9-adf3-fbac2392f295 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:58:55.007909 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=43 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:58:55.152966 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6b240959-09bd-45b9-adf3-fbac2392f295 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:58:55.166605 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6b240959-09bd-45b9-adf3-fbac2392f295 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/b3de2208-af44-465e-bcd6-62cb7c5198be" status: 200 len: 1323 microversion: 2.1 time: 0.238209 Oct 27 03:58:55.181001 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3348/6410] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:58:54 2022] GET /compute/v2.1/servers/b3de2208-af44-465e-bcd6-62cb7c5198be => generated 1323 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:58:55.258209 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-aa22c1d2-f714-4f87-9ac7-80da0a49ca67 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:58:55.259400 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-aa22c1d2-f714-4f87-9ac7-80da0a49ca67 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] [instance: 6d3618b4-d458-4283-9be6-38bd764377c4] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:58:55.271314 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aa22c1d2-f714-4f87-9ac7-80da0a49ca67 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:58:55.271807 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aa22c1d2-f714-4f87-9ac7-80da0a49ca67 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:58:55.275596 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aa22c1d2-f714-4f87-9ac7-80da0a49ca67 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:58:55.276518 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aa22c1d2-f714-4f87-9ac7-80da0a49ca67 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:58:55.277141 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aa22c1d2-f714-4f87-9ac7-80da0a49ca67 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:58:55.279228 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aa22c1d2-f714-4f87-9ac7-80da0a49ca67 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:58:55.609279 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-aa22c1d2-f714-4f87-9ac7-80da0a49ca67 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/6d3618b4-d458-4283-9be6-38bd764377c4" status: 200 len: 1648 microversion: 2.1 time: 0.354797 Oct 27 03:58:55.611205 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3063/6411] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:58:55 2022] GET /compute/v2.1/servers/6d3618b4-d458-4283-9be6-38bd764377c4 => generated 1648 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:58:55.634928 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8a04cc53-a770-44a1-9318-beab4f19fc39 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:58:55.635851 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8a04cc53-a770-44a1-9318-beab4f19fc39 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] [instance: 6d3618b4-d458-4283-9be6-38bd764377c4] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:58:55.649381 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=4 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:58:55.651324 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8a04cc53-a770-44a1-9318-beab4f19fc39 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:58:55.653960 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8a04cc53-a770-44a1-9318-beab4f19fc39 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:58:55.655661 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8a04cc53-a770-44a1-9318-beab4f19fc39 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:58:55.656779 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8a04cc53-a770-44a1-9318-beab4f19fc39 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:58:55.659579 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8a04cc53-a770-44a1-9318-beab4f19fc39 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:58:55.660224 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8a04cc53-a770-44a1-9318-beab4f19fc39 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:58:56.198421 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e010c115-a36f-4b36-8063-bdd90eb54a67 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:58:56.199834 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e010c115-a36f-4b36-8063-bdd90eb54a67 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: b3de2208-af44-465e-bcd6-62cb7c5198be] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:58:56.210874 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8a04cc53-a770-44a1-9318-beab4f19fc39 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/6d3618b4-d458-4283-9be6-38bd764377c4" status: 200 len: 1648 microversion: 2.1 time: 0.576816 Oct 27 03:58:56.211836 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3349/6412] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:58:55 2022] GET /compute/v2.1/servers/6d3618b4-d458-4283-9be6-38bd764377c4 => generated 1648 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:58:56.236256 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e010c115-a36f-4b36-8063-bdd90eb54a67 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:58:56.240279 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e010c115-a36f-4b36-8063-bdd90eb54a67 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:58:56.252118 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-75563c08-71a7-4f01-8054-545b28d046be tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:58:56.255719 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-75563c08-71a7-4f01-8054-545b28d046be tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] [instance: 6d3618b4-d458-4283-9be6-38bd764377c4] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:58:56.262815 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e010c115-a36f-4b36-8063-bdd90eb54a67 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:58:56.271054 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e010c115-a36f-4b36-8063-bdd90eb54a67 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:58:56.272143 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e010c115-a36f-4b36-8063-bdd90eb54a67 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:58:56.273105 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e010c115-a36f-4b36-8063-bdd90eb54a67 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:58:56.274955 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-75563c08-71a7-4f01-8054-545b28d046be tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:58:56.275815 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-75563c08-71a7-4f01-8054-545b28d046be tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:58:56.280460 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-75563c08-71a7-4f01-8054-545b28d046be tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:58:56.281663 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-75563c08-71a7-4f01-8054-545b28d046be tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:58:56.282493 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-75563c08-71a7-4f01-8054-545b28d046be tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:58:56.283942 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-75563c08-71a7-4f01-8054-545b28d046be tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:58:56.416398 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e010c115-a36f-4b36-8063-bdd90eb54a67 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:58:56.449271 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e010c115-a36f-4b36-8063-bdd90eb54a67 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/b3de2208-af44-465e-bcd6-62cb7c5198be" status: 200 len: 1323 microversion: 2.1 time: 0.260073 Oct 27 03:58:56.452068 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3064/6413] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:58:56 2022] GET /compute/v2.1/servers/b3de2208-af44-465e-bcd6-62cb7c5198be => generated 1323 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:58:56.804656 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-75563c08-71a7-4f01-8054-545b28d046be tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/6d3618b4-d458-4283-9be6-38bd764377c4" status: 200 len: 1648 microversion: 2.1 time: 0.559965 Oct 27 03:58:56.807335 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3350/6414] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:58:56 2022] GET /compute/v2.1/servers/6d3618b4-d458-4283-9be6-38bd764377c4 => generated 1648 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:58:57.097732 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5bacb9d8-3ab1-4bea-902e-3255d2cc0af9 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1211054984", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "availability_zone": "nova:n-h1-862769-1", "networks": [{"uuid": "e3097ed5-73dd-458c-a255-7a409f72f805"}]}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:58:57.221553 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-5bacb9d8-3ab1-4bea-902e-3255d2cc0af9 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] validate_networks() for [('e3097ed5-73dd-458c-a255-7a409f72f805', None, None, None, None, None)] {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:58:57.477808 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-15b4c88d-e439-4438-afcd-293560e0cddd tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:58:57.478663 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-15b4c88d-e439-4438-afcd-293560e0cddd tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: b3de2208-af44-465e-bcd6-62cb7c5198be] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:58:57.498396 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-15b4c88d-e439-4438-afcd-293560e0cddd tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:58:57.506772 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-15b4c88d-e439-4438-afcd-293560e0cddd tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:58:57.509390 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-15b4c88d-e439-4438-afcd-293560e0cddd tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:58:57.510312 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-15b4c88d-e439-4438-afcd-293560e0cddd tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:58:57.511780 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-15b4c88d-e439-4438-afcd-293560e0cddd tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:58:57.513481 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-15b4c88d-e439-4438-afcd-293560e0cddd tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:58:57.977609 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-15b4c88d-e439-4438-afcd-293560e0cddd tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:58:57.990301 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-15b4c88d-e439-4438-afcd-293560e0cddd tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/b3de2208-af44-465e-bcd6-62cb7c5198be" status: 200 len: 1391 microversion: 2.1 time: 0.519238 Oct 27 03:58:57.991615 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3351/6415] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:58:57 2022] GET /compute/v2.1/servers/b3de2208-af44-465e-bcd6-62cb7c5198be => generated 1391 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:58:58.013268 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-5bacb9d8-3ab1-4bea-902e-3255d2cc0af9 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:58:58.014733 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-5bacb9d8-3ab1-4bea-902e-3255d2cc0af9 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:58:58.015456 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-5bacb9d8-3ab1-4bea-902e-3255d2cc0af9 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:58:58.016101 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-5bacb9d8-3ab1-4bea-902e-3255d2cc0af9 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:58:58.016974 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-5bacb9d8-3ab1-4bea-902e-3255d2cc0af9 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:58:58.036218 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5bacb9d8-3ab1-4bea-902e-3255d2cc0af9 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:58:58.037116 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5bacb9d8-3ab1-4bea-902e-3255d2cc0af9 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:58:58.041213 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5bacb9d8-3ab1-4bea-902e-3255d2cc0af9 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:58:58.041213 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5bacb9d8-3ab1-4bea-902e-3255d2cc0af9 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:58:58.041842 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5bacb9d8-3ab1-4bea-902e-3255d2cc0af9 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:58:58.042526 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5bacb9d8-3ab1-4bea-902e-3255d2cc0af9 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:58:58.065426 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-5bacb9d8-3ab1-4bea-902e-3255d2cc0af9 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Getting quotas for project 57742c85c58c458495524da0b5f78f93. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:58:58.071905 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-5bacb9d8-3ab1-4bea-902e-3255d2cc0af9 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Getting quotas for user a1552fd790d342e29fa8deef441fbfc8 and project 57742c85c58c458495524da0b5f78f93. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:58:58.087107 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5bacb9d8-3ab1-4bea-902e-3255d2cc0af9 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:58:58.089924 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5bacb9d8-3ab1-4bea-902e-3255d2cc0af9 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] [instance: 6b9fb8d1-7efd-49ce-bfdf-544b047819d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:58:58.232308 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5bacb9d8-3ab1-4bea-902e-3255d2cc0af9 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.141204 Oct 27 03:58:58.239549 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3065/6416] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:58:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1149 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 03:58:58.244410 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0d95b956-f729-4f0f-8926-8ed515ae1304 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:58:58.245045 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0d95b956-f729-4f0f-8926-8ed515ae1304 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] [instance: 6b9fb8d1-7efd-49ce-bfdf-544b047819d5] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:58:58.494109 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0d95b956-f729-4f0f-8926-8ed515ae1304 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/6b9fb8d1-7efd-49ce-bfdf-544b047819d5" status: 200 len: 1329 microversion: 2.1 time: 0.253333 Oct 27 03:58:58.495112 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3352/6417] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:58:58 2022] GET /compute/v2.1/servers/6b9fb8d1-7efd-49ce-bfdf-544b047819d5 => generated 1329 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:58:58.761796 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-da380457-c334-4642-871f-a107ead798d5 req-f67c9de3-f05e-40a4-a6a1-952282a5a65a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3de2208-af44-465e-bcd6-62cb7c5198be", "tag": "e8963538-23cd-4279-bd63-a8af0f0f838c"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:58:58.813678 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-da380457-c334-4642-871f-a107ead798d5 req-f67c9de3-f05e-40a4-a6a1-952282a5a65a service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:58:58.815762 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-da380457-c334-4642-871f-a107ead798d5 req-f67c9de3-f05e-40a4-a6a1-952282a5a65a service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:58:58.822540 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-da380457-c334-4642-871f-a107ead798d5 req-f67c9de3-f05e-40a4-a6a1-952282a5a65a service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:58:58.865702 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-da380457-c334-4642-871f-a107ead798d5 req-f67c9de3-f05e-40a4-a6a1-952282a5a65a service nova] Creating event network-changed:e8963538-23cd-4279-bd63-a8af0f0f838c for instance b3de2208-af44-465e-bcd6-62cb7c5198be on n-h1-862769-1 Oct 27 03:58:58.880779 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-da380457-c334-4642-871f-a107ead798d5 req-f67c9de3-f05e-40a4-a6a1-952282a5a65a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124550 Oct 27 03:58:58.886275 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3066/6418] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:58:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:58:59.018472 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b2209354-9828-4201-a344-c6abad715ec1 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:58:59.020125 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b2209354-9828-4201-a344-c6abad715ec1 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: b3de2208-af44-465e-bcd6-62cb7c5198be] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:58:59.038438 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b2209354-9828-4201-a344-c6abad715ec1 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:58:59.038963 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b2209354-9828-4201-a344-c6abad715ec1 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:58:59.039420 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b2209354-9828-4201-a344-c6abad715ec1 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:58:59.040166 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b2209354-9828-4201-a344-c6abad715ec1 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:58:59.045423 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b2209354-9828-4201-a344-c6abad715ec1 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:58:59.047766 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b2209354-9828-4201-a344-c6abad715ec1 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:58:59.521911 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b2209354-9828-4201-a344-c6abad715ec1 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:58:59.525564 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a43f8b50-9219-43c2-b616-01b4bee10412 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:58:59.529200 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a43f8b50-9219-43c2-b616-01b4bee10412 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] [instance: 6b9fb8d1-7efd-49ce-bfdf-544b047819d5] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:58:59.544996 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b2209354-9828-4201-a344-c6abad715ec1 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/b3de2208-af44-465e-bcd6-62cb7c5198be" status: 200 len: 1391 microversion: 2.1 time: 0.532648 Oct 27 03:58:59.546161 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a43f8b50-9219-43c2-b616-01b4bee10412 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:58:59.546888 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3353/6419] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:58:59 2022] GET /compute/v2.1/servers/b3de2208-af44-465e-bcd6-62cb7c5198be => generated 1391 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:58:59.572325 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a43f8b50-9219-43c2-b616-01b4bee10412 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:58:59.573250 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a43f8b50-9219-43c2-b616-01b4bee10412 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:58:59.574293 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a43f8b50-9219-43c2-b616-01b4bee10412 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:58:59.574932 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a43f8b50-9219-43c2-b616-01b4bee10412 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:58:59.575529 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a43f8b50-9219-43c2-b616-01b4bee10412 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:58:59.690815 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a43f8b50-9219-43c2-b616-01b4bee10412 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/6b9fb8d1-7efd-49ce-bfdf-544b047819d5" status: 200 len: 1346 microversion: 2.1 time: 0.173405 Oct 27 03:58:59.691721 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3067/6420] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:58:59 2022] GET /compute/v2.1/servers/6b9fb8d1-7efd-49ce-bfdf-544b047819d5 => generated 1346 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:59:00.574296 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-694ab836-5686-4771-9d73-7be13194fe67 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:59:00.574922 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-694ab836-5686-4771-9d73-7be13194fe67 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: b3de2208-af44-465e-bcd6-62cb7c5198be] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:59:00.584601 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-694ab836-5686-4771-9d73-7be13194fe67 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:00.585078 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-694ab836-5686-4771-9d73-7be13194fe67 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:00.609095 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-694ab836-5686-4771-9d73-7be13194fe67 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:00.610308 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-694ab836-5686-4771-9d73-7be13194fe67 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:00.619501 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-694ab836-5686-4771-9d73-7be13194fe67 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:00.625384 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-694ab836-5686-4771-9d73-7be13194fe67 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:00.718337 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e1390be0-1429-4549-8776-105042a3e8db tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:59:00.718960 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e1390be0-1429-4549-8776-105042a3e8db tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] [instance: 6b9fb8d1-7efd-49ce-bfdf-544b047819d5] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:59:00.736012 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e1390be0-1429-4549-8776-105042a3e8db tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:00.738243 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e1390be0-1429-4549-8776-105042a3e8db tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:00.742542 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e1390be0-1429-4549-8776-105042a3e8db tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:00.744248 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e1390be0-1429-4549-8776-105042a3e8db tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:00.747132 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e1390be0-1429-4549-8776-105042a3e8db tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:00.747764 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e1390be0-1429-4549-8776-105042a3e8db tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:00.953558 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e1390be0-1429-4549-8776-105042a3e8db tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/6b9fb8d1-7efd-49ce-bfdf-544b047819d5" status: 200 len: 1338 microversion: 2.1 time: 0.240691 Oct 27 03:59:00.957006 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3068/6421] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:59:00 2022] GET /compute/v2.1/servers/6b9fb8d1-7efd-49ce-bfdf-544b047819d5 => generated 1338 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:59:01.022941 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-694ab836-5686-4771-9d73-7be13194fe67 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:59:01.033251 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-694ab836-5686-4771-9d73-7be13194fe67 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/b3de2208-af44-465e-bcd6-62cb7c5198be" status: 200 len: 1391 microversion: 2.1 time: 0.466404 Oct 27 03:59:01.035173 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3354/6422] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:59:00 2022] GET /compute/v2.1/servers/b3de2208-af44-465e-bcd6-62cb7c5198be => generated 1391 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:59:01.771912 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-33269f91-aa55-4be4-a7b6-23059ef84824 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Action: 'create', calling method: .version_select at 0x7f7ddec5cd30>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-1085734455", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEES/eEAkgeR++1cWUnWqIyL+QjepLkitNh0h9rhYQbpcfVHLH6p3O4rh5SfSVnlMqJdVxTgjOmR9A8zQnhnwUOCommkonHhjV2zXLxw4HYDXgDTrlMmMuyxp029xRtPCQ=="}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:59:01.806242 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-33269f91-aa55-4be4-a7b6-23059ef84824 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Getting quotas for project 038d0cade5d540d399e5d237ed07419f. Resources: {'key_pairs'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:59:01.817544 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-33269f91-aa55-4be4-a7b6-23059ef84824 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Getting quotas for user 3e7ffbb437004d379258425747bf1521 and project 038d0cade5d540d399e5d237ed07419f. Resources: {'key_pairs'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:59:01.940017 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-33269f91-aa55-4be4-a7b6-23059ef84824 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.867326 Oct 27 03:59:01.941061 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3069/6423] 10.222.0.20 () {60 vars in 1159 bytes} [Thu Oct 27 03:59:01 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:59:01.987610 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f890fb70-b1cf-496a-bb1e-0e5d68594ffb tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:59:01.989670 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f890fb70-b1cf-496a-bb1e-0e5d68594ffb tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] [instance: 6b9fb8d1-7efd-49ce-bfdf-544b047819d5] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:59:02.003239 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f890fb70-b1cf-496a-bb1e-0e5d68594ffb tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:02.008954 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f890fb70-b1cf-496a-bb1e-0e5d68594ffb tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:02.011913 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f890fb70-b1cf-496a-bb1e-0e5d68594ffb tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:02.016771 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f890fb70-b1cf-496a-bb1e-0e5d68594ffb tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:02.017781 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f890fb70-b1cf-496a-bb1e-0e5d68594ffb tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:02.020164 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f890fb70-b1cf-496a-bb1e-0e5d68594ffb tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:02.062334 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6f335543-1189-4e2c-8b77-073ac673bc6d tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:59:02.063312 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6f335543-1189-4e2c-8b77-073ac673bc6d tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: b3de2208-af44-465e-bcd6-62cb7c5198be] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:59:02.079727 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6f335543-1189-4e2c-8b77-073ac673bc6d tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:02.090205 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6f335543-1189-4e2c-8b77-073ac673bc6d tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:02.090205 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6f335543-1189-4e2c-8b77-073ac673bc6d tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:02.090205 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6f335543-1189-4e2c-8b77-073ac673bc6d tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:02.090205 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6f335543-1189-4e2c-8b77-073ac673bc6d tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:02.090205 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6f335543-1189-4e2c-8b77-073ac673bc6d tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:02.167688 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f890fb70-b1cf-496a-bb1e-0e5d68594ffb tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/6b9fb8d1-7efd-49ce-bfdf-544b047819d5" status: 200 len: 1416 microversion: 2.1 time: 0.187738 Oct 27 03:59:02.168747 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3355/6424] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:59:01 2022] GET /compute/v2.1/servers/6b9fb8d1-7efd-49ce-bfdf-544b047819d5 => generated 1416 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:59:02.404154 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-6f335543-1189-4e2c-8b77-073ac673bc6d tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:59:02.413483 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6f335543-1189-4e2c-8b77-073ac673bc6d tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/b3de2208-af44-465e-bcd6-62cb7c5198be" status: 200 len: 1391 microversion: 2.1 time: 0.358396 Oct 27 03:59:02.422921 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3070/6425] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:59:02 2022] GET /compute/v2.1/servers/b3de2208-af44-465e-bcd6-62cb7c5198be => generated 1391 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:59:03.202171 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-bfd9aa65-8659-434a-ade2-a2271ee902d5 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:59:03.203813 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-bfd9aa65-8659-434a-ade2-a2271ee902d5 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] [instance: 6b9fb8d1-7efd-49ce-bfdf-544b047819d5] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:59:03.225607 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bfd9aa65-8659-434a-ade2-a2271ee902d5 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:03.228840 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bfd9aa65-8659-434a-ade2-a2271ee902d5 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:03.229425 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bfd9aa65-8659-434a-ade2-a2271ee902d5 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:03.230329 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bfd9aa65-8659-434a-ade2-a2271ee902d5 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:03.232371 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bfd9aa65-8659-434a-ade2-a2271ee902d5 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:03.233250 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bfd9aa65-8659-434a-ade2-a2271ee902d5 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:03.438489 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-845fe0f0-3a0a-42f4-8fcd-4509ea1faeeb tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:59:03.443638 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-845fe0f0-3a0a-42f4-8fcd-4509ea1faeeb tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: b3de2208-af44-465e-bcd6-62cb7c5198be] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:59:03.471627 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-845fe0f0-3a0a-42f4-8fcd-4509ea1faeeb tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:03.474897 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-845fe0f0-3a0a-42f4-8fcd-4509ea1faeeb tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:03.475728 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-845fe0f0-3a0a-42f4-8fcd-4509ea1faeeb tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:03.479798 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-845fe0f0-3a0a-42f4-8fcd-4509ea1faeeb tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:03.482952 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-845fe0f0-3a0a-42f4-8fcd-4509ea1faeeb tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:03.482952 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-845fe0f0-3a0a-42f4-8fcd-4509ea1faeeb tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:03.690869 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-bfd9aa65-8659-434a-ade2-a2271ee902d5 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/6b9fb8d1-7efd-49ce-bfdf-544b047819d5" status: 200 len: 1464 microversion: 2.1 time: 0.494900 Oct 27 03:59:03.713624 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3356/6426] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:59:03 2022] GET /compute/v2.1/servers/6b9fb8d1-7efd-49ce-bfdf-544b047819d5 => generated 1464 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:59:04.229921 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-845fe0f0-3a0a-42f4-8fcd-4509ea1faeeb tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:59:04.249921 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-845fe0f0-3a0a-42f4-8fcd-4509ea1faeeb tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/b3de2208-af44-465e-bcd6-62cb7c5198be" status: 200 len: 1391 microversion: 2.1 time: 0.815213 Oct 27 03:59:04.252567 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3071/6427] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:59:03 2022] GET /compute/v2.1/servers/b3de2208-af44-465e-bcd6-62cb7c5198be => generated 1391 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:59:04.392223 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-dac41459-7596-44a6-86f8-b93b1934b8c1 req-b26a51b8-691a-46e1-b4de-947b7360b343 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3de2208-af44-465e-bcd6-62cb7c5198be", "name": "network-vif-plugged", "status": "completed", "tag": "e8963538-23cd-4279-bd63-a8af0f0f838c"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:59:04.411730 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-dac41459-7596-44a6-86f8-b93b1934b8c1 req-b26a51b8-691a-46e1-b4de-947b7360b343 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:04.413651 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-dac41459-7596-44a6-86f8-b93b1934b8c1 req-b26a51b8-691a-46e1-b4de-947b7360b343 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:04.414316 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-dac41459-7596-44a6-86f8-b93b1934b8c1 req-b26a51b8-691a-46e1-b4de-947b7360b343 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:04.429229 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-dac41459-7596-44a6-86f8-b93b1934b8c1 req-b26a51b8-691a-46e1-b4de-947b7360b343 service nova] Creating event network-vif-plugged:e8963538-23cd-4279-bd63-a8af0f0f838c for instance b3de2208-af44-465e-bcd6-62cb7c5198be on n-h1-862769-1 Oct 27 03:59:04.444148 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-dac41459-7596-44a6-86f8-b93b1934b8c1 req-b26a51b8-691a-46e1-b4de-947b7360b343 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056967 Oct 27 03:59:04.445153 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3357/6428] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:59:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:59:04.718973 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2efbe41d-a132-4de1-9742-747b48012a39 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:59:04.720682 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-2efbe41d-a132-4de1-9742-747b48012a39 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] [instance: 6b9fb8d1-7efd-49ce-bfdf-544b047819d5] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:59:04.729920 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2efbe41d-a132-4de1-9742-747b48012a39 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:04.730840 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2efbe41d-a132-4de1-9742-747b48012a39 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:04.735098 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2efbe41d-a132-4de1-9742-747b48012a39 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:04.735899 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2efbe41d-a132-4de1-9742-747b48012a39 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:04.736378 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2efbe41d-a132-4de1-9742-747b48012a39 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:04.737879 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2efbe41d-a132-4de1-9742-747b48012a39 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:04.941972 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2efbe41d-a132-4de1-9742-747b48012a39 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/6b9fb8d1-7efd-49ce-bfdf-544b047819d5" status: 200 len: 1464 microversion: 2.1 time: 0.228687 Oct 27 03:59:04.961217 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3072/6429] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:59:04 2022] GET /compute/v2.1/servers/6b9fb8d1-7efd-49ce-bfdf-544b047819d5 => generated 1464 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:59:05.276764 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0c004ca8-deed-47ef-90e6-c76ad85dc8d5 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:59:05.277596 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0c004ca8-deed-47ef-90e6-c76ad85dc8d5 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: b3de2208-af44-465e-bcd6-62cb7c5198be] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:59:05.287801 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0c004ca8-deed-47ef-90e6-c76ad85dc8d5 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:05.297908 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-98d6b672-eac1-4636-934d-3afb254797f6 req-31d42f83-1bb5-4e90-bb64-f99aa172ab09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b9fb8d1-7efd-49ce-bfdf-544b047819d5", "tag": "e0c903e2-ff15-4081-b6a2-3e15f8a56daf"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:59:05.307647 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0c004ca8-deed-47ef-90e6-c76ad85dc8d5 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:05.310429 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0c004ca8-deed-47ef-90e6-c76ad85dc8d5 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:05.311355 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0c004ca8-deed-47ef-90e6-c76ad85dc8d5 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:05.311907 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0c004ca8-deed-47ef-90e6-c76ad85dc8d5 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:05.313399 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0c004ca8-deed-47ef-90e6-c76ad85dc8d5 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:05.326423 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-98d6b672-eac1-4636-934d-3afb254797f6 req-31d42f83-1bb5-4e90-bb64-f99aa172ab09 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:05.327721 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-98d6b672-eac1-4636-934d-3afb254797f6 req-31d42f83-1bb5-4e90-bb64-f99aa172ab09 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:05.329156 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-98d6b672-eac1-4636-934d-3afb254797f6 req-31d42f83-1bb5-4e90-bb64-f99aa172ab09 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:05.348804 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-98d6b672-eac1-4636-934d-3afb254797f6 req-31d42f83-1bb5-4e90-bb64-f99aa172ab09 service nova] Creating event network-changed:e0c903e2-ff15-4081-b6a2-3e15f8a56daf for instance 6b9fb8d1-7efd-49ce-bfdf-544b047819d5 on n-h1-862769-1 Oct 27 03:59:05.354555 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-98d6b672-eac1-4636-934d-3afb254797f6 req-31d42f83-1bb5-4e90-bb64-f99aa172ab09 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062026 Oct 27 03:59:05.355501 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3073/6430] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:59:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:59:05.972102 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-67ee2a3f-2e48-420a-977d-aa13c47cefa4 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:59:05.972969 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-67ee2a3f-2e48-420a-977d-aa13c47cefa4 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] [instance: 6b9fb8d1-7efd-49ce-bfdf-544b047819d5] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:59:05.984011 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-67ee2a3f-2e48-420a-977d-aa13c47cefa4 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:05.992358 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-67ee2a3f-2e48-420a-977d-aa13c47cefa4 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:05.992358 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-67ee2a3f-2e48-420a-977d-aa13c47cefa4 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:05.992358 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-67ee2a3f-2e48-420a-977d-aa13c47cefa4 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:05.992358 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-67ee2a3f-2e48-420a-977d-aa13c47cefa4 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:05.992358 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-67ee2a3f-2e48-420a-977d-aa13c47cefa4 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:06.202212 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0c004ca8-deed-47ef-90e6-c76ad85dc8d5 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:59:06.214366 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0c004ca8-deed-47ef-90e6-c76ad85dc8d5 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/b3de2208-af44-465e-bcd6-62cb7c5198be" status: 200 len: 1391 microversion: 2.1 time: 0.943071 Oct 27 03:59:06.218848 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3358/6431] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:59:05 2022] GET /compute/v2.1/servers/b3de2208-af44-465e-bcd6-62cb7c5198be => generated 1391 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:59:06.363471 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-67ee2a3f-2e48-420a-977d-aa13c47cefa4 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/6b9fb8d1-7efd-49ce-bfdf-544b047819d5" status: 200 len: 1464 microversion: 2.1 time: 0.398057 Oct 27 03:59:06.364833 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3074/6432] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:59:05 2022] GET /compute/v2.1/servers/6b9fb8d1-7efd-49ce-bfdf-544b047819d5 => generated 1464 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:59:07.243627 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8d85bcfb-3db0-49a9-b953-5c1ef205e2d8 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:59:07.244272 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8d85bcfb-3db0-49a9-b953-5c1ef205e2d8 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: b3de2208-af44-465e-bcd6-62cb7c5198be] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:59:07.254485 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8d85bcfb-3db0-49a9-b953-5c1ef205e2d8 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:07.255408 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8d85bcfb-3db0-49a9-b953-5c1ef205e2d8 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:07.256118 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8d85bcfb-3db0-49a9-b953-5c1ef205e2d8 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:07.257096 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8d85bcfb-3db0-49a9-b953-5c1ef205e2d8 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:07.257784 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8d85bcfb-3db0-49a9-b953-5c1ef205e2d8 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:07.258492 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8d85bcfb-3db0-49a9-b953-5c1ef205e2d8 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:07.391162 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a1998f74-3be5-4941-8b54-ba2d2fd9d634 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:59:07.392056 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a1998f74-3be5-4941-8b54-ba2d2fd9d634 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] [instance: 6b9fb8d1-7efd-49ce-bfdf-544b047819d5] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:59:07.399789 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a1998f74-3be5-4941-8b54-ba2d2fd9d634 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:07.401967 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a1998f74-3be5-4941-8b54-ba2d2fd9d634 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:07.402465 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a1998f74-3be5-4941-8b54-ba2d2fd9d634 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:07.403447 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a1998f74-3be5-4941-8b54-ba2d2fd9d634 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:07.403917 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a1998f74-3be5-4941-8b54-ba2d2fd9d634 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:07.404510 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a1998f74-3be5-4941-8b54-ba2d2fd9d634 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:07.473642 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8d85bcfb-3db0-49a9-b953-5c1ef205e2d8 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:59:07.481729 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8d85bcfb-3db0-49a9-b953-5c1ef205e2d8 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/b3de2208-af44-465e-bcd6-62cb7c5198be" status: 200 len: 1562 microversion: 2.1 time: 0.244926 Oct 27 03:59:07.482360 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3359/6433] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:59:07 2022] GET /compute/v2.1/servers/b3de2208-af44-465e-bcd6-62cb7c5198be => generated 1562 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:59:07.505429 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8af8fecc-c623-4030-b911-508b3bc3c78a tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:59:07.506136 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8af8fecc-c623-4030-b911-508b3bc3c78a tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: b3de2208-af44-465e-bcd6-62cb7c5198be] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:59:07.512927 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8af8fecc-c623-4030-b911-508b3bc3c78a tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:07.513631 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8af8fecc-c623-4030-b911-508b3bc3c78a tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:07.516046 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8af8fecc-c623-4030-b911-508b3bc3c78a tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:07.516046 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8af8fecc-c623-4030-b911-508b3bc3c78a tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:07.516046 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8af8fecc-c623-4030-b911-508b3bc3c78a tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:07.516046 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8af8fecc-c623-4030-b911-508b3bc3c78a tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:07.595024 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a1998f74-3be5-4941-8b54-ba2d2fd9d634 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/6b9fb8d1-7efd-49ce-bfdf-544b047819d5" status: 200 len: 1464 microversion: 2.1 time: 0.207905 Oct 27 03:59:07.606845 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3075/6434] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:59:07 2022] GET /compute/v2.1/servers/6b9fb8d1-7efd-49ce-bfdf-544b047819d5 => generated 1464 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:59:07.832231 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8af8fecc-c623-4030-b911-508b3bc3c78a tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:59:07.842635 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8af8fecc-c623-4030-b911-508b3bc3c78a tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/b3de2208-af44-465e-bcd6-62cb7c5198be" status: 200 len: 1562 microversion: 2.1 time: 0.341449 Oct 27 03:59:07.843236 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3360/6435] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:59:07 2022] GET /compute/v2.1/servers/b3de2208-af44-465e-bcd6-62cb7c5198be => generated 1562 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:59:08.625633 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=4 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:59:08.634609 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6c923df8-abf4-4b47-850e-7c106aec770e tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:59:08.635591 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6c923df8-abf4-4b47-850e-7c106aec770e tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] [instance: 6b9fb8d1-7efd-49ce-bfdf-544b047819d5] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:59:08.653715 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6c923df8-abf4-4b47-850e-7c106aec770e tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:08.656969 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6c923df8-abf4-4b47-850e-7c106aec770e tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:08.657638 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6c923df8-abf4-4b47-850e-7c106aec770e tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:08.660627 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6c923df8-abf4-4b47-850e-7c106aec770e tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:08.662019 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6c923df8-abf4-4b47-850e-7c106aec770e tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:08.663823 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6c923df8-abf4-4b47-850e-7c106aec770e tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:09.348969 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6c923df8-abf4-4b47-850e-7c106aec770e tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/6b9fb8d1-7efd-49ce-bfdf-544b047819d5" status: 200 len: 1464 microversion: 2.1 time: 0.722514 Oct 27 03:59:09.351590 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3076/6436] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:59:08 2022] GET /compute/v2.1/servers/6b9fb8d1-7efd-49ce-bfdf-544b047819d5 => generated 1464 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:59:10.375233 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-07aa3b32-11c7-4fe1-8fb5-e8df9e9cdb91 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:59:10.376557 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-07aa3b32-11c7-4fe1-8fb5-e8df9e9cdb91 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] [instance: 6b9fb8d1-7efd-49ce-bfdf-544b047819d5] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:59:10.397808 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=6 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:59:10.401014 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-07aa3b32-11c7-4fe1-8fb5-e8df9e9cdb91 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:10.401703 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-07aa3b32-11c7-4fe1-8fb5-e8df9e9cdb91 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:10.402602 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-07aa3b32-11c7-4fe1-8fb5-e8df9e9cdb91 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:10.404337 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-07aa3b32-11c7-4fe1-8fb5-e8df9e9cdb91 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:10.404996 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-07aa3b32-11c7-4fe1-8fb5-e8df9e9cdb91 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:10.406875 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-07aa3b32-11c7-4fe1-8fb5-e8df9e9cdb91 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:11.565341 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-07aa3b32-11c7-4fe1-8fb5-e8df9e9cdb91 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/6b9fb8d1-7efd-49ce-bfdf-544b047819d5" status: 200 len: 1464 microversion: 2.1 time: 1.193864 Oct 27 03:59:11.590498 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3361/6437] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:59:10 2022] GET /compute/v2.1/servers/6b9fb8d1-7efd-49ce-bfdf-544b047819d5 => generated 1464 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:59:12.468260 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-481aa76c-f3e4-4df7-89b5-c33e0abc3de6 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:59:12.468260 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-481aa76c-f3e4-4df7-89b5-c33e0abc3de6 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: b3de2208-af44-465e-bcd6-62cb7c5198be] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:59:12.468260 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=16 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:59:12.468808 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-e84b394e-25da-415c-b203-2f5f5b17bb3d req-4a2911b9-6630-4b73-83bf-39bf160a19b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3de2208-af44-465e-bcd6-62cb7c5198be", "tag": "e8963538-23cd-4279-bd63-a8af0f0f838c"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:59:12.468903 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-481aa76c-f3e4-4df7-89b5-c33e0abc3de6 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:12.468903 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-481aa76c-f3e4-4df7-89b5-c33e0abc3de6 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:12.468903 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-481aa76c-f3e4-4df7-89b5-c33e0abc3de6 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:12.474753 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-481aa76c-f3e4-4df7-89b5-c33e0abc3de6 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:12.478431 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-481aa76c-f3e4-4df7-89b5-c33e0abc3de6 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:12.481599 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-481aa76c-f3e4-4df7-89b5-c33e0abc3de6 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:12.509070 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-e84b394e-25da-415c-b203-2f5f5b17bb3d req-4a2911b9-6630-4b73-83bf-39bf160a19b1 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:12.510111 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-e84b394e-25da-415c-b203-2f5f5b17bb3d req-4a2911b9-6630-4b73-83bf-39bf160a19b1 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:12.513163 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-e84b394e-25da-415c-b203-2f5f5b17bb3d req-4a2911b9-6630-4b73-83bf-39bf160a19b1 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:12.545583 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-e84b394e-25da-415c-b203-2f5f5b17bb3d req-4a2911b9-6630-4b73-83bf-39bf160a19b1 service nova] Creating event network-changed:e8963538-23cd-4279-bd63-a8af0f0f838c for instance b3de2208-af44-465e-bcd6-62cb7c5198be on n-h1-862769-1 Oct 27 03:59:12.567010 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-e84b394e-25da-415c-b203-2f5f5b17bb3d req-4a2911b9-6630-4b73-83bf-39bf160a19b1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111201 Oct 27 03:59:12.576488 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3362/6438] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:59:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:59:12.596733 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-24dfbc2a-75c5-4b37-840c-b938b3741841 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:59:12.600395 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-24dfbc2a-75c5-4b37-840c-b938b3741841 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] [instance: 6b9fb8d1-7efd-49ce-bfdf-544b047819d5] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:59:12.623042 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-24dfbc2a-75c5-4b37-840c-b938b3741841 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:12.623928 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-24dfbc2a-75c5-4b37-840c-b938b3741841 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:12.626015 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-24dfbc2a-75c5-4b37-840c-b938b3741841 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:12.632640 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-24dfbc2a-75c5-4b37-840c-b938b3741841 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:12.634089 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-24dfbc2a-75c5-4b37-840c-b938b3741841 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:12.634878 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-24dfbc2a-75c5-4b37-840c-b938b3741841 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:13.124015 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-481aa76c-f3e4-4df7-89b5-c33e0abc3de6 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:59:13.148895 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-481aa76c-f3e4-4df7-89b5-c33e0abc3de6 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/b3de2208-af44-465e-bcd6-62cb7c5198be" status: 200 len: 1562 microversion: 2.1 time: 0.704477 Oct 27 03:59:13.150732 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3077/6439] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:59:12 2022] GET /compute/v2.1/servers/b3de2208-af44-465e-bcd6-62cb7c5198be => generated 1562 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:59:13.839279 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-24dfbc2a-75c5-4b37-840c-b938b3741841 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/6b9fb8d1-7efd-49ce-bfdf-544b047819d5" status: 200 len: 1464 microversion: 2.1 time: 1.253787 Oct 27 03:59:13.843857 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3363/6440] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:59:12 2022] GET /compute/v2.1/servers/6b9fb8d1-7efd-49ce-bfdf-544b047819d5 => generated 1464 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:59:14.873198 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ab0c3463-ece1-4a58-9069-849efbe0b46c tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:59:14.875070 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ab0c3463-ece1-4a58-9069-849efbe0b46c tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] [instance: 6b9fb8d1-7efd-49ce-bfdf-544b047819d5] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:59:14.901668 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ab0c3463-ece1-4a58-9069-849efbe0b46c tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:14.902503 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ab0c3463-ece1-4a58-9069-849efbe0b46c tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:14.903379 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ab0c3463-ece1-4a58-9069-849efbe0b46c tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:14.906084 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ab0c3463-ece1-4a58-9069-849efbe0b46c tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:14.906755 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ab0c3463-ece1-4a58-9069-849efbe0b46c tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:14.907428 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ab0c3463-ece1-4a58-9069-849efbe0b46c tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:15.300921 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-253ed06b-ec3c-4ff2-a4d0-c5cc51e6e2fd req-0eb0375d-2b9c-4c0f-b724-21c533c39457 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b9fb8d1-7efd-49ce-bfdf-544b047819d5", "name": "network-vif-plugged", "status": "completed", "tag": "e0c903e2-ff15-4081-b6a2-3e15f8a56daf"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:59:15.326789 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-253ed06b-ec3c-4ff2-a4d0-c5cc51e6e2fd req-0eb0375d-2b9c-4c0f-b724-21c533c39457 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:15.330223 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-253ed06b-ec3c-4ff2-a4d0-c5cc51e6e2fd req-0eb0375d-2b9c-4c0f-b724-21c533c39457 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:15.330915 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-253ed06b-ec3c-4ff2-a4d0-c5cc51e6e2fd req-0eb0375d-2b9c-4c0f-b724-21c533c39457 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:15.360861 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-253ed06b-ec3c-4ff2-a4d0-c5cc51e6e2fd req-0eb0375d-2b9c-4c0f-b724-21c533c39457 service nova] Creating event network-vif-plugged:e0c903e2-ff15-4081-b6a2-3e15f8a56daf for instance 6b9fb8d1-7efd-49ce-bfdf-544b047819d5 on n-h1-862769-1 Oct 27 03:59:15.381713 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-253ed06b-ec3c-4ff2-a4d0-c5cc51e6e2fd req-0eb0375d-2b9c-4c0f-b724-21c533c39457 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086950 Oct 27 03:59:15.382848 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3364/6441] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:59:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:59:15.500354 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ab0c3463-ece1-4a58-9069-849efbe0b46c tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/6b9fb8d1-7efd-49ce-bfdf-544b047819d5" status: 200 len: 1464 microversion: 2.1 time: 0.626079 Oct 27 03:59:15.529062 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3078/6442] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:59:14 2022] GET /compute/v2.1/servers/6b9fb8d1-7efd-49ce-bfdf-544b047819d5 => generated 1464 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:59:16.544370 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b53107f9-fbe2-4247-8d0c-63e6f9e863bb tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:59:16.546484 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b53107f9-fbe2-4247-8d0c-63e6f9e863bb tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] [instance: 6b9fb8d1-7efd-49ce-bfdf-544b047819d5] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:59:16.564238 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b53107f9-fbe2-4247-8d0c-63e6f9e863bb tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:16.566539 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b53107f9-fbe2-4247-8d0c-63e6f9e863bb tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:16.570190 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b53107f9-fbe2-4247-8d0c-63e6f9e863bb tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:16.570190 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b53107f9-fbe2-4247-8d0c-63e6f9e863bb tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:16.570190 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b53107f9-fbe2-4247-8d0c-63e6f9e863bb tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:16.570190 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b53107f9-fbe2-4247-8d0c-63e6f9e863bb tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:16.958410 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b53107f9-fbe2-4247-8d0c-63e6f9e863bb tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/6b9fb8d1-7efd-49ce-bfdf-544b047819d5" status: 200 len: 1464 microversion: 2.1 time: 0.428583 Oct 27 03:59:16.963930 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3365/6443] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:59:16 2022] GET /compute/v2.1/servers/6b9fb8d1-7efd-49ce-bfdf-544b047819d5 => generated 1464 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:59:17.985805 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-33250855-0771-4b12-ba53-7b10249cc6f6 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:59:17.985805 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-33250855-0771-4b12-ba53-7b10249cc6f6 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] [instance: 6b9fb8d1-7efd-49ce-bfdf-544b047819d5] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:59:18.000166 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-33250855-0771-4b12-ba53-7b10249cc6f6 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:18.000984 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-33250855-0771-4b12-ba53-7b10249cc6f6 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:18.003110 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-33250855-0771-4b12-ba53-7b10249cc6f6 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:18.006226 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-33250855-0771-4b12-ba53-7b10249cc6f6 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:18.010858 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-33250855-0771-4b12-ba53-7b10249cc6f6 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:18.012251 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-33250855-0771-4b12-ba53-7b10249cc6f6 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:18.337147 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-33250855-0771-4b12-ba53-7b10249cc6f6 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/6b9fb8d1-7efd-49ce-bfdf-544b047819d5" status: 200 len: 1648 microversion: 2.1 time: 0.357541 Oct 27 03:59:18.344202 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3079/6444] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:59:17 2022] GET /compute/v2.1/servers/6b9fb8d1-7efd-49ce-bfdf-544b047819d5 => generated 1648 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:59:18.362129 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e4728beb-c5a6-4b66-9ab6-83c0714a117f tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:59:18.364020 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e4728beb-c5a6-4b66-9ab6-83c0714a117f tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] [instance: 6b9fb8d1-7efd-49ce-bfdf-544b047819d5] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:59:18.378145 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e4728beb-c5a6-4b66-9ab6-83c0714a117f tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:18.379761 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e4728beb-c5a6-4b66-9ab6-83c0714a117f tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:18.380512 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e4728beb-c5a6-4b66-9ab6-83c0714a117f tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:18.381997 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e4728beb-c5a6-4b66-9ab6-83c0714a117f tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:18.382752 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e4728beb-c5a6-4b66-9ab6-83c0714a117f tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:18.383430 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e4728beb-c5a6-4b66-9ab6-83c0714a117f tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:18.805053 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e4728beb-c5a6-4b66-9ab6-83c0714a117f tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/6b9fb8d1-7efd-49ce-bfdf-544b047819d5" status: 200 len: 1648 microversion: 2.1 time: 0.447321 Oct 27 03:59:18.808177 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3366/6445] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:59:18 2022] GET /compute/v2.1/servers/6b9fb8d1-7efd-49ce-bfdf-544b047819d5 => generated 1648 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:59:18.831854 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-425a3a1d-b2d4-4ce8-8d59-2d25e00f1ba0 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:59:18.832883 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-425a3a1d-b2d4-4ce8-8d59-2d25e00f1ba0 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] [instance: 6b9fb8d1-7efd-49ce-bfdf-544b047819d5] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:59:18.841084 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-425a3a1d-b2d4-4ce8-8d59-2d25e00f1ba0 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:18.841964 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-425a3a1d-b2d4-4ce8-8d59-2d25e00f1ba0 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:18.846439 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-425a3a1d-b2d4-4ce8-8d59-2d25e00f1ba0 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:18.847585 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-425a3a1d-b2d4-4ce8-8d59-2d25e00f1ba0 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:18.848319 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-425a3a1d-b2d4-4ce8-8d59-2d25e00f1ba0 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:18.849691 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-425a3a1d-b2d4-4ce8-8d59-2d25e00f1ba0 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:19.044349 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-425a3a1d-b2d4-4ce8-8d59-2d25e00f1ba0 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/6b9fb8d1-7efd-49ce-bfdf-544b047819d5" status: 200 len: 1648 microversion: 2.1 time: 0.215728 Oct 27 03:59:19.044349 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3080/6446] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:59:18 2022] GET /compute/v2.1/servers/6b9fb8d1-7efd-49ce-bfdf-544b047819d5 => generated 1648 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:59:19.070858 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a0771161-5551-4837-9f80-8ba8e5b28345 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:59:19.071651 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a0771161-5551-4837-9f80-8ba8e5b28345 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] [instance: 6b9fb8d1-7efd-49ce-bfdf-544b047819d5] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:59:19.078601 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a0771161-5551-4837-9f80-8ba8e5b28345 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:19.083475 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a0771161-5551-4837-9f80-8ba8e5b28345 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:19.084279 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a0771161-5551-4837-9f80-8ba8e5b28345 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:19.085718 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a0771161-5551-4837-9f80-8ba8e5b28345 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:19.086451 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a0771161-5551-4837-9f80-8ba8e5b28345 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:19.087135 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a0771161-5551-4837-9f80-8ba8e5b28345 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:19.114627 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a0771161-5551-4837-9f80-8ba8e5b28345 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] [instance: 6b9fb8d1-7efd-49ce-bfdf-544b047819d5] Going to try to terminate instance {{(pid=121001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:59:19.125321 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=100 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:59:19.757097 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a0771161-5551-4837-9f80-8ba8e5b28345 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] 10.222.0.20 "DELETE /compute/v2.1/servers/6b9fb8d1-7efd-49ce-bfdf-544b047819d5" status: 204 len: 0 microversion: 2.1 time: 0.689515 Oct 27 03:59:19.771205 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3367/6447] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:59:19 2022] DELETE /compute/v2.1/servers/6b9fb8d1-7efd-49ce-bfdf-544b047819d5 => generated 0 bytes in 692 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 03:59:19.782138 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7f14bd7c-7a19-455b-81b1-7090c9e0c77e tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:59:19.787240 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7f14bd7c-7a19-455b-81b1-7090c9e0c77e tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] [instance: 6b9fb8d1-7efd-49ce-bfdf-544b047819d5] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:59:19.802065 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7f14bd7c-7a19-455b-81b1-7090c9e0c77e tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:19.802693 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7f14bd7c-7a19-455b-81b1-7090c9e0c77e tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:19.803249 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7f14bd7c-7a19-455b-81b1-7090c9e0c77e tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:19.804109 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7f14bd7c-7a19-455b-81b1-7090c9e0c77e tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:19.804714 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7f14bd7c-7a19-455b-81b1-7090c9e0c77e tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:19.805218 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7f14bd7c-7a19-455b-81b1-7090c9e0c77e tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:20.108562 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=100 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:59:20.121255 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7f14bd7c-7a19-455b-81b1-7090c9e0c77e tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/6b9fb8d1-7efd-49ce-bfdf-544b047819d5" status: 200 len: 1654 microversion: 2.1 time: 0.342921 Oct 27 03:59:20.121864 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3081/6448] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:59:19 2022] GET /compute/v2.1/servers/6b9fb8d1-7efd-49ce-bfdf-544b047819d5 => generated 1654 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:59:20.622916 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-272f7859-621b-4791-b5eb-270aef588729 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-722980985-access_point-1927314572", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": [{"uuid": "ce461a58-ceb3-4d8e-ab89-125bc8150b39"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1085734455", "security_groups": [{"name": "tempest-secgroup_access--1207743565"}, {"name": "tempest-secgroup_general--936265705"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:59:20.981504 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.network.neutron [None req-272f7859-621b-4791-b5eb-270aef588729 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] validate_networks() for [('ce461a58-ceb3-4d8e-ab89-125bc8150b39', None, None, None, None, None)] {{(pid=121001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:59:21.147661 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-82bbf854-e4f8-41aa-8948-edc06b425010 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:59:21.148298 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-82bbf854-e4f8-41aa-8948-edc06b425010 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] [instance: 6b9fb8d1-7efd-49ce-bfdf-544b047819d5] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:59:21.165682 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-82bbf854-e4f8-41aa-8948-edc06b425010 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:21.166310 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-82bbf854-e4f8-41aa-8948-edc06b425010 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:21.166751 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-82bbf854-e4f8-41aa-8948-edc06b425010 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:21.167473 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-82bbf854-e4f8-41aa-8948-edc06b425010 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:21.167941 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-82bbf854-e4f8-41aa-8948-edc06b425010 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:21.168360 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-82bbf854-e4f8-41aa-8948-edc06b425010 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:21.497747 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-82bbf854-e4f8-41aa-8948-edc06b425010 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/6b9fb8d1-7efd-49ce-bfdf-544b047819d5" status: 200 len: 1654 microversion: 2.1 time: 0.344714 Oct 27 03:59:21.505945 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3082/6449] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:59:21 2022] GET /compute/v2.1/servers/6b9fb8d1-7efd-49ce-bfdf-544b047819d5 => generated 1654 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:59:22.318715 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-272f7859-621b-4791-b5eb-270aef588729 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Flavor limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:59:22.319674 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-272f7859-621b-4791-b5eb-270aef588729 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Image limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:59:22.320394 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-272f7859-621b-4791-b5eb-270aef588729 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Flavor pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:59:22.321016 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-272f7859-621b-4791-b5eb-270aef588729 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Image pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:59:22.321666 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-272f7859-621b-4791-b5eb-270aef588729 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:59:22.345867 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-272f7859-621b-4791-b5eb-270aef588729 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:22.351768 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-272f7859-621b-4791-b5eb-270aef588729 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:22.353808 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-272f7859-621b-4791-b5eb-270aef588729 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:22.356084 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-272f7859-621b-4791-b5eb-270aef588729 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:22.358868 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-272f7859-621b-4791-b5eb-270aef588729 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:22.360084 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-272f7859-621b-4791-b5eb-270aef588729 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:22.394363 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-272f7859-621b-4791-b5eb-270aef588729 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Getting quotas for project 038d0cade5d540d399e5d237ed07419f. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:59:22.401128 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-272f7859-621b-4791-b5eb-270aef588729 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Getting quotas for user 3e7ffbb437004d379258425747bf1521 and project 038d0cade5d540d399e5d237ed07419f. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:59:22.441041 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-272f7859-621b-4791-b5eb-270aef588729 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Going to run 1 instances... {{(pid=121001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:59:22.443899 n-d-862769-1 devstack@n-api.service[121001]: WARNING nova.utils [None req-272f7859-621b-4791-b5eb-270aef588729 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-722980985-access_point-1927314572 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-722980985-acc Oct 27 03:59:22.444919 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-272f7859-621b-4791-b5eb-270aef588729 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] [instance: 0b884037-d633-4e3d-a52e-813cc319a6e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:59:22.525516 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2c4ec494-efc6-4169-adc8-49e3565dbbe5 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:59:22.526197 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-2c4ec494-efc6-4169-adc8-49e3565dbbe5 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] [instance: 6b9fb8d1-7efd-49ce-bfdf-544b047819d5] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:59:22.537215 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2c4ec494-efc6-4169-adc8-49e3565dbbe5 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:22.547089 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2c4ec494-efc6-4169-adc8-49e3565dbbe5 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:22.547718 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2c4ec494-efc6-4169-adc8-49e3565dbbe5 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:22.548651 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2c4ec494-efc6-4169-adc8-49e3565dbbe5 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:22.549302 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2c4ec494-efc6-4169-adc8-49e3565dbbe5 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:22.549919 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2c4ec494-efc6-4169-adc8-49e3565dbbe5 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:22.647963 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-272f7859-621b-4791-b5eb-270aef588729 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 457 microversion: 2.1 time: 2.020198 Oct 27 03:59:22.648883 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3368/6450] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:59:20 2022] POST /compute/v2.1/servers => generated 457 bytes in 2031 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 03:59:22.665687 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f43c916b-8190-4920-bd9c-40dc637ab208 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:59:22.666839 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f43c916b-8190-4920-bd9c-40dc637ab208 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] [instance: 0b884037-d633-4e3d-a52e-813cc319a6e9] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:59:22.724761 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2c4ec494-efc6-4169-adc8-49e3565dbbe5 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/6b9fb8d1-7efd-49ce-bfdf-544b047819d5" status: 200 len: 1612 microversion: 2.1 time: 0.202543 Oct 27 03:59:22.726016 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3083/6451] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:59:22 2022] GET /compute/v2.1/servers/6b9fb8d1-7efd-49ce-bfdf-544b047819d5 => generated 1612 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:59:23.176572 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f43c916b-8190-4920-bd9c-40dc637ab208 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7ffbb437004d379258425747bf1521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038d0cade5d540d399e5d237ed07419f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:59:23.212375 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f43c916b-8190-4920-bd9c-40dc637ab208 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] 10.222.0.20 "GET /compute/v2.1/servers/0b884037-d633-4e3d-a52e-813cc319a6e9" status: 200 len: 1294 microversion: 2.1 time: 0.552298 Oct 27 03:59:23.212915 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3369/6452] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:59:22 2022] GET /compute/v2.1/servers/0b884037-d633-4e3d-a52e-813cc319a6e9 => generated 1294 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:59:23.277015 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-89a0f496-a2ec-4123-9191-94811c7fb765 req-848c6ab1-32d0-4ef1-95e0-b584b1fea0d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b9fb8d1-7efd-49ce-bfdf-544b047819d5", "name": "network-vif-deleted", "tag": "e0c903e2-ff15-4081-b6a2-3e15f8a56daf"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:59:23.318355 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-89a0f496-a2ec-4123-9191-94811c7fb765 req-848c6ab1-32d0-4ef1-95e0-b584b1fea0d3 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:23.319188 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-89a0f496-a2ec-4123-9191-94811c7fb765 req-848c6ab1-32d0-4ef1-95e0-b584b1fea0d3 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:23.321279 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-89a0f496-a2ec-4123-9191-94811c7fb765 req-848c6ab1-32d0-4ef1-95e0-b584b1fea0d3 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:23.339093 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-89a0f496-a2ec-4123-9191-94811c7fb765 req-848c6ab1-32d0-4ef1-95e0-b584b1fea0d3 service nova] Creating event network-vif-deleted:e0c903e2-ff15-4081-b6a2-3e15f8a56daf for instance 6b9fb8d1-7efd-49ce-bfdf-544b047819d5 on n-h1-862769-1 Oct 27 03:59:23.369204 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-89a0f496-a2ec-4123-9191-94811c7fb765 req-848c6ab1-32d0-4ef1-95e0-b584b1fea0d3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104520 Oct 27 03:59:23.369844 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3084/6453] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:59:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:59:23.461825 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ed8fd027-33d3-4bd7-9b1d-eeaed83edd47 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1503952406", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:59:23.573079 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.network.neutron [None req-ed8fd027-33d3-4bd7-9b1d-eeaed83edd47 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] validate_networks() for None {{(pid=121001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 03:59:23.755062 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-50307bb2-0f65-4b9a-92c6-5ae9f769b063 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:59:23.770098 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-50307bb2-0f65-4b9a-92c6-5ae9f769b063 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] [instance: 6b9fb8d1-7efd-49ce-bfdf-544b047819d5] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:59:23.779782 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-50307bb2-0f65-4b9a-92c6-5ae9f769b063 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:23.780530 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-50307bb2-0f65-4b9a-92c6-5ae9f769b063 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:23.781166 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-50307bb2-0f65-4b9a-92c6-5ae9f769b063 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:23.782145 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-50307bb2-0f65-4b9a-92c6-5ae9f769b063 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:23.782772 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-50307bb2-0f65-4b9a-92c6-5ae9f769b063 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:23.783392 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-50307bb2-0f65-4b9a-92c6-5ae9f769b063 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:23.866806 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-50307bb2-0f65-4b9a-92c6-5ae9f769b063 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:23.880482 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-50307bb2-0f65-4b9a-92c6-5ae9f769b063 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:23.884272 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-50307bb2-0f65-4b9a-92c6-5ae9f769b063 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:23.884272 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-50307bb2-0f65-4b9a-92c6-5ae9f769b063 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lazy-loading 'fault' on Instance uuid 6b9fb8d1-7efd-49ce-bfdf-544b047819d5 {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:59:24.012926 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-50307bb2-0f65-4b9a-92c6-5ae9f769b063 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/6b9fb8d1-7efd-49ce-bfdf-544b047819d5" status: 200 len: 1454 microversion: 2.1 time: 0.263480 Oct 27 03:59:24.015561 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3085/6454] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:59:23 2022] GET /compute/v2.1/servers/6b9fb8d1-7efd-49ce-bfdf-544b047819d5 => generated 1454 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:59:24.119218 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-ed8fd027-33d3-4bd7-9b1d-eeaed83edd47 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Flavor limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 03:59:24.120087 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-ed8fd027-33d3-4bd7-9b1d-eeaed83edd47 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Image limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 03:59:24.122879 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-ed8fd027-33d3-4bd7-9b1d-eeaed83edd47 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Flavor pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 03:59:24.122879 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-ed8fd027-33d3-4bd7-9b1d-eeaed83edd47 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Image pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 03:59:24.122879 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-ed8fd027-33d3-4bd7-9b1d-eeaed83edd47 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 03:59:24.133768 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ed8fd027-33d3-4bd7-9b1d-eeaed83edd47 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:24.134659 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ed8fd027-33d3-4bd7-9b1d-eeaed83edd47 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:24.135325 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ed8fd027-33d3-4bd7-9b1d-eeaed83edd47 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:24.136250 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ed8fd027-33d3-4bd7-9b1d-eeaed83edd47 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:24.136882 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ed8fd027-33d3-4bd7-9b1d-eeaed83edd47 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:24.137732 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ed8fd027-33d3-4bd7-9b1d-eeaed83edd47 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:24.160019 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-ed8fd027-33d3-4bd7-9b1d-eeaed83edd47 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Getting quotas for project 73fd07c6375c4fca9465d351eb2ba7f6. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 03:59:24.166684 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-ed8fd027-33d3-4bd7-9b1d-eeaed83edd47 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Getting quotas for user 32640280c29e408fbf5579d7f12a5a6b and project 73fd07c6375c4fca9465d351eb2ba7f6. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 03:59:24.191456 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ed8fd027-33d3-4bd7-9b1d-eeaed83edd47 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Going to run 1 instances... {{(pid=121001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 03:59:24.194381 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ed8fd027-33d3-4bd7-9b1d-eeaed83edd47 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] [instance: 08d7054d-2d62-4302-a10c-d6875a7871fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 03:59:24.241771 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-667981aa-9a92-4759-8384-55fed37c950b tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:59:24.243203 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-667981aa-9a92-4759-8384-55fed37c950b tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] [instance: 0b884037-d633-4e3d-a52e-813cc319a6e9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:59:24.249103 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-667981aa-9a92-4759-8384-55fed37c950b tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:24.249585 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-667981aa-9a92-4759-8384-55fed37c950b tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:24.250473 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-667981aa-9a92-4759-8384-55fed37c950b tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:24.251187 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-667981aa-9a92-4759-8384-55fed37c950b tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:24.251843 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-667981aa-9a92-4759-8384-55fed37c950b tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:24.252564 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-667981aa-9a92-4759-8384-55fed37c950b tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:24.354484 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ed8fd027-33d3-4bd7-9b1d-eeaed83edd47 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.898513 Oct 27 03:59:24.357164 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3370/6455] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 03:59:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 902 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 03:59:24.371165 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-91158f48-f0fa-45ff-8fcf-5daff6e5333f tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:59:24.371165 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-91158f48-f0fa-45ff-8fcf-5daff6e5333f tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] [instance: 08d7054d-2d62-4302-a10c-d6875a7871fa] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:59:24.418169 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-667981aa-9a92-4759-8384-55fed37c950b tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7ffbb437004d379258425747bf1521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038d0cade5d540d399e5d237ed07419f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:59:24.434296 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-667981aa-9a92-4759-8384-55fed37c950b tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] 10.222.0.20 "GET /compute/v2.1/servers/0b884037-d633-4e3d-a52e-813cc319a6e9" status: 200 len: 1298 microversion: 2.1 time: 0.197208 Oct 27 03:59:24.435278 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3086/6456] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:59:24 2022] GET /compute/v2.1/servers/0b884037-d633-4e3d-a52e-813cc319a6e9 => generated 1298 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:59:24.560949 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-91158f48-f0fa-45ff-8fcf-5daff6e5333f tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32640280c29e408fbf5579d7f12a5a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fd07c6375c4fca9465d351eb2ba7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:59:24.570263 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-91158f48-f0fa-45ff-8fcf-5daff6e5333f tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] 10.222.0.20 "GET /compute/v2.1/servers/08d7054d-2d62-4302-a10c-d6875a7871fa" status: 200 len: 1215 microversion: 2.1 time: 0.207484 Oct 27 03:59:24.571893 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3371/6457] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:59:24 2022] GET /compute/v2.1/servers/08d7054d-2d62-4302-a10c-d6875a7871fa => generated 1215 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:59:25.040698 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2fbc3707-e1f8-4cf9-8df3-134f43378975 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:59:25.041910 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-2fbc3707-e1f8-4cf9-8df3-134f43378975 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] [instance: 6b9fb8d1-7efd-49ce-bfdf-544b047819d5] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:59:25.082473 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2fbc3707-e1f8-4cf9-8df3-134f43378975 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:25.084692 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2fbc3707-e1f8-4cf9-8df3-134f43378975 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:25.085350 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2fbc3707-e1f8-4cf9-8df3-134f43378975 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:25.086358 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2fbc3707-e1f8-4cf9-8df3-134f43378975 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:25.089053 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2fbc3707-e1f8-4cf9-8df3-134f43378975 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:25.091040 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2fbc3707-e1f8-4cf9-8df3-134f43378975 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:25.118982 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-2fbc3707-e1f8-4cf9-8df3-134f43378975 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] HTTP exception thrown: Instance 6b9fb8d1-7efd-49ce-bfdf-544b047819d5 could not be found. Oct 27 03:59:25.121890 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2fbc3707-e1f8-4cf9-8df3-134f43378975 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Request method failure captured: Oct 27 03:59:25.121890 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/6b9fb8d1-7efd-49ce-bfdf-544b047819d5 HTTP/1.1 Oct 27 03:59:25.121890 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:59:25.121890 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:59:25.121890 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:59:25.121890 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:59:25.121890 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:59:25.121890 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:59:25.121890 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:59:25.121890 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:59:25.121890 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWgHmWzjtB0urjdJoQELfv4vVxlxbOdUAZ_06y-Jav24JWzL7wy4i8Clw5jYOlVR8N-XZoicfOTqfCN1dBe9YwmIgVTPYpb_muNuwcPYz6lMdJE9NLgjl3w_kpiorXw_zJbcIPvXzN0KScv9wtW_QsEK2oowV_T4fVd5wAqempcWuQDQ Oct 27 03:59:25.121890 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:59:25.121890 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:59:25.121890 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:59:25.121890 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:59:25.121890 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:59:25.121890 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:59:25.121890 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 57742c85c58c458495524da0b5f78f93 Oct 27 03:59:25.121890 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-TestServerMultinode-1099833883 Oct 27 03:59:25.121890 n-d-862769-1 devstack@n-api.service[121000]: X-Role: admin,member,reader Oct 27 03:59:25.121890 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: admin,member,reader Oct 27 03:59:25.121890 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/57742c85c58c458495524da0b5f78f93"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/57742c85c58c458495524da0b5f78f93"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/57742c85c58c458495524da0b5f78f93"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_57742c85c58c458495524da0b5f78f93"}]}] Oct 27 03:59:25.121890 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-TestServerMultinode-1099833883 Oct 27 03:59:25.121890 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 57742c85c58c458495524da0b5f78f93 Oct 27 03:59:25.121890 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-TestServerMultinode-1099833883 Oct 27 03:59:25.121890 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-TestServerMultinode-1099833883-project-admin Oct 27 03:59:25.121890 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:59:25.121890 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:59:25.121890 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: a1552fd790d342e29fa8deef441fbfc8 Oct 27 03:59:25.121890 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-TestServerMultinode-1099833883-project-admin Oct 27 03:59:25.121890 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:59:25.121890 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 6b9fb8d1-7efd-49ce-bfdf-544b047819d5 could not be found. Oct 27 03:59:25.121890 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '6b9fb8d1-7efd-49ce-bfdf-544b047819d5'} Oct 27 03:59:25.121890 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:59:25.121890 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:59:25.121890 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:59:25.121890 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:59:25.121890 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:59:25.121890 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:59:25.121890 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:59:25.121890 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:59:25.121890 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:59:25.121890 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:59:25.121890 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b9fb8d1-7efd-49ce-bfdf-544b047819d5 could not be found. Oct 27 03:59:25.121890 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:59:25.121890 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:59:25.121890 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:59:25.121890 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:59:25.121890 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:59:25.121890 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:59:25.121890 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:59:25.121890 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:59:25.121890 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:59:25.121890 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:59:25.121890 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:59:25.121890 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:59:25.121890 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:59:25.121890 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:59:25.121890 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:59:25.121890 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:59:25.121890 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b9fb8d1-7efd-49ce-bfdf-544b047819d5 could not be found. Oct 27 03:59:25.121890 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:59:25.121890 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:59:25.121890 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:59:25.127063 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:59:25.127063 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:59:25.127063 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:59:25.127063 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:59:25.127063 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:59:25.127063 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b9fb8d1-7efd-49ce-bfdf-544b047819d5 could not be found. Oct 27 03:59:25.127063 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:59:25.129550 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2fbc3707-e1f8-4cf9-8df3-134f43378975 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Returning 404 to user: Instance 6b9fb8d1-7efd-49ce-bfdf-544b047819d5 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:59:25.131496 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2fbc3707-e1f8-4cf9-8df3-134f43378975 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/6b9fb8d1-7efd-49ce-bfdf-544b047819d5" status: 404 len: 111 microversion: 2.1 time: 0.094640 Oct 27 03:59:25.132785 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3087/6458] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:59:25 2022] GET /compute/v2.1/servers/6b9fb8d1-7efd-49ce-bfdf-544b047819d5 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:59:25.142246 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-213e82f2-c2e2-40d5-b9e4-f521b8108974 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:59:25.142845 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-213e82f2-c2e2-40d5-b9e4-f521b8108974 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] [instance: 6d3618b4-d458-4283-9be6-38bd764377c4] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:59:25.159804 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-213e82f2-c2e2-40d5-b9e4-f521b8108974 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:25.164270 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-213e82f2-c2e2-40d5-b9e4-f521b8108974 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:25.164270 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-213e82f2-c2e2-40d5-b9e4-f521b8108974 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:25.164270 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-213e82f2-c2e2-40d5-b9e4-f521b8108974 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:25.165203 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-213e82f2-c2e2-40d5-b9e4-f521b8108974 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:25.165716 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-213e82f2-c2e2-40d5-b9e4-f521b8108974 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:25.209023 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-213e82f2-c2e2-40d5-b9e4-f521b8108974 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] [instance: 6d3618b4-d458-4283-9be6-38bd764377c4] Going to try to terminate instance {{(pid=121001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:59:25.458615 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d23cfc31-6944-4065-ab86-5e74037c0cf4 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:59:25.459367 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d23cfc31-6944-4065-ab86-5e74037c0cf4 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] [instance: 0b884037-d633-4e3d-a52e-813cc319a6e9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:59:25.461904 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=4 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:59:25.467421 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d23cfc31-6944-4065-ab86-5e74037c0cf4 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:25.468190 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d23cfc31-6944-4065-ab86-5e74037c0cf4 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:25.468705 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d23cfc31-6944-4065-ab86-5e74037c0cf4 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:25.469518 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d23cfc31-6944-4065-ab86-5e74037c0cf4 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:25.470081 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d23cfc31-6944-4065-ab86-5e74037c0cf4 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:25.470580 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d23cfc31-6944-4065-ab86-5e74037c0cf4 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:25.574237 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d23cfc31-6944-4065-ab86-5e74037c0cf4 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7ffbb437004d379258425747bf1521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038d0cade5d540d399e5d237ed07419f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:59:25.574782 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d23cfc31-6944-4065-ab86-5e74037c0cf4 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] 10.222.0.20 "GET /compute/v2.1/servers/0b884037-d633-4e3d-a52e-813cc319a6e9" status: 200 len: 1346 microversion: 2.1 time: 0.119422 Oct 27 03:59:25.576380 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3088/6459] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:59:25 2022] GET /compute/v2.1/servers/0b884037-d633-4e3d-a52e-813cc319a6e9 => generated 1346 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:59:25.614977 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-81fa220e-7fd9-4776-a7e7-93e5ce8e8e29 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:59:25.615973 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-81fa220e-7fd9-4776-a7e7-93e5ce8e8e29 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] [instance: 08d7054d-2d62-4302-a10c-d6875a7871fa] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:59:25.735132 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-213e82f2-c2e2-40d5-b9e4-f521b8108974 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] 10.222.0.20 "DELETE /compute/v2.1/servers/6d3618b4-d458-4283-9be6-38bd764377c4" status: 204 len: 0 microversion: 2.1 time: 0.597383 Oct 27 03:59:25.736696 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3372/6460] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:59:25 2022] DELETE /compute/v2.1/servers/6d3618b4-d458-4283-9be6-38bd764377c4 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:59:25.747345 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7b93c690-043a-47a4-9bae-4289796b9e9b tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:59:25.748286 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7b93c690-043a-47a4-9bae-4289796b9e9b tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] [instance: 6d3618b4-d458-4283-9be6-38bd764377c4] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:59:25.761573 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7b93c690-043a-47a4-9bae-4289796b9e9b tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:25.764466 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7b93c690-043a-47a4-9bae-4289796b9e9b tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:25.764466 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7b93c690-043a-47a4-9bae-4289796b9e9b tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:25.764466 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7b93c690-043a-47a4-9bae-4289796b9e9b tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:25.764466 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7b93c690-043a-47a4-9bae-4289796b9e9b tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:25.764466 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7b93c690-043a-47a4-9bae-4289796b9e9b tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:25.832741 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-81fa220e-7fd9-4776-a7e7-93e5ce8e8e29 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32640280c29e408fbf5579d7f12a5a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fd07c6375c4fca9465d351eb2ba7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:59:25.847347 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-81fa220e-7fd9-4776-a7e7-93e5ce8e8e29 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] 10.222.0.20 "GET /compute/v2.1/servers/08d7054d-2d62-4302-a10c-d6875a7871fa" status: 200 len: 1215 microversion: 2.1 time: 0.254267 Oct 27 03:59:25.847958 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3089/6461] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:59:25 2022] GET /compute/v2.1/servers/08d7054d-2d62-4302-a10c-d6875a7871fa => generated 1215 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:59:26.031680 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7b93c690-043a-47a4-9bae-4289796b9e9b tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/6d3618b4-d458-4283-9be6-38bd764377c4" status: 200 len: 1654 microversion: 2.1 time: 0.290141 Oct 27 03:59:26.032289 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3373/6462] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:59:25 2022] GET /compute/v2.1/servers/6d3618b4-d458-4283-9be6-38bd764377c4 => generated 1654 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:59:26.600281 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1c1fc2a0-30bd-45f9-94ee-43a2ea8d579a tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:59:26.601609 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1c1fc2a0-30bd-45f9-94ee-43a2ea8d579a tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] [instance: 0b884037-d633-4e3d-a52e-813cc319a6e9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:59:26.609634 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1c1fc2a0-30bd-45f9-94ee-43a2ea8d579a tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:26.610081 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1c1fc2a0-30bd-45f9-94ee-43a2ea8d579a tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:26.610641 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1c1fc2a0-30bd-45f9-94ee-43a2ea8d579a tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:26.611429 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1c1fc2a0-30bd-45f9-94ee-43a2ea8d579a tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:26.611974 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1c1fc2a0-30bd-45f9-94ee-43a2ea8d579a tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:26.612931 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1c1fc2a0-30bd-45f9-94ee-43a2ea8d579a tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:26.703388 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1c1fc2a0-30bd-45f9-94ee-43a2ea8d579a tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7ffbb437004d379258425747bf1521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038d0cade5d540d399e5d237ed07419f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:59:26.716401 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1c1fc2a0-30bd-45f9-94ee-43a2ea8d579a tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] 10.222.0.20 "GET /compute/v2.1/servers/0b884037-d633-4e3d-a52e-813cc319a6e9" status: 200 len: 1354 microversion: 2.1 time: 0.120511 Oct 27 03:59:26.733467 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3090/6463] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:59:26 2022] GET /compute/v2.1/servers/0b884037-d633-4e3d-a52e-813cc319a6e9 => generated 1354 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:59:26.874201 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-240131f8-7270-4c3c-b029-eee415306bd5 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:59:26.875359 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-240131f8-7270-4c3c-b029-eee415306bd5 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] [instance: 08d7054d-2d62-4302-a10c-d6875a7871fa] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:59:26.878426 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:59:26.890346 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-240131f8-7270-4c3c-b029-eee415306bd5 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:26.890863 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-240131f8-7270-4c3c-b029-eee415306bd5 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:26.891454 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-240131f8-7270-4c3c-b029-eee415306bd5 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:26.892768 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-240131f8-7270-4c3c-b029-eee415306bd5 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:26.893779 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-240131f8-7270-4c3c-b029-eee415306bd5 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:26.894590 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-240131f8-7270-4c3c-b029-eee415306bd5 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:26.976098 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-240131f8-7270-4c3c-b029-eee415306bd5 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32640280c29e408fbf5579d7f12a5a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fd07c6375c4fca9465d351eb2ba7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:59:26.985396 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-240131f8-7270-4c3c-b029-eee415306bd5 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] 10.222.0.20 "GET /compute/v2.1/servers/08d7054d-2d62-4302-a10c-d6875a7871fa" status: 200 len: 1211 microversion: 2.1 time: 0.118113 Oct 27 03:59:26.986191 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3374/6464] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:59:26 2022] GET /compute/v2.1/servers/08d7054d-2d62-4302-a10c-d6875a7871fa => generated 1211 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:59:27.056812 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-71ed9c7d-23e7-450d-9041-9b20da57382d tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:59:27.057854 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-71ed9c7d-23e7-450d-9041-9b20da57382d tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] [instance: 6d3618b4-d458-4283-9be6-38bd764377c4] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:59:27.066896 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-71ed9c7d-23e7-450d-9041-9b20da57382d tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:27.076775 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-71ed9c7d-23e7-450d-9041-9b20da57382d tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:27.076775 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-71ed9c7d-23e7-450d-9041-9b20da57382d tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:27.076775 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-71ed9c7d-23e7-450d-9041-9b20da57382d tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:27.076775 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-71ed9c7d-23e7-450d-9041-9b20da57382d tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:27.076775 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-71ed9c7d-23e7-450d-9041-9b20da57382d tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:27.337386 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-71ed9c7d-23e7-450d-9041-9b20da57382d tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/6d3618b4-d458-4283-9be6-38bd764377c4" status: 200 len: 1654 microversion: 2.1 time: 0.285354 Oct 27 03:59:27.338133 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3091/6465] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:59:27 2022] GET /compute/v2.1/servers/6d3618b4-d458-4283-9be6-38bd764377c4 => generated 1654 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:59:27.743902 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-fecf9262-23e8-440a-b3b1-abc56e118b0b tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:59:27.750144 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-fecf9262-23e8-440a-b3b1-abc56e118b0b tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] [instance: 0b884037-d633-4e3d-a52e-813cc319a6e9] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:59:27.751026 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fecf9262-23e8-440a-b3b1-abc56e118b0b tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:27.751533 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fecf9262-23e8-440a-b3b1-abc56e118b0b tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:27.752099 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fecf9262-23e8-440a-b3b1-abc56e118b0b tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:27.753202 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fecf9262-23e8-440a-b3b1-abc56e118b0b tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:27.753672 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fecf9262-23e8-440a-b3b1-abc56e118b0b tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:27.754144 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fecf9262-23e8-440a-b3b1-abc56e118b0b tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:27.777905 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-7d42506d-09ca-4793-ac91-85dde5c0acd2 req-edfd1914-1b0d-4922-a978-9444a83f877c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d3618b4-d458-4283-9be6-38bd764377c4", "name": "network-vif-deleted", "tag": "19501bc4-c54e-48e0-a3cc-841c281a5572"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:59:27.789808 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-7d42506d-09ca-4793-ac91-85dde5c0acd2 req-edfd1914-1b0d-4922-a978-9444a83f877c service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:27.793506 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-7d42506d-09ca-4793-ac91-85dde5c0acd2 req-edfd1914-1b0d-4922-a978-9444a83f877c service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:27.793506 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-7d42506d-09ca-4793-ac91-85dde5c0acd2 req-edfd1914-1b0d-4922-a978-9444a83f877c service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:27.805043 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-7d42506d-09ca-4793-ac91-85dde5c0acd2 req-edfd1914-1b0d-4922-a978-9444a83f877c service nova] Creating event network-vif-deleted:19501bc4-c54e-48e0-a3cc-841c281a5572 for instance 6d3618b4-d458-4283-9be6-38bd764377c4 on n-h2-862769-1 Oct 27 03:59:27.811502 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-7d42506d-09ca-4793-ac91-85dde5c0acd2 req-edfd1914-1b0d-4922-a978-9444a83f877c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037344 Oct 27 03:59:27.812537 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3092/6466] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:59:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:59:27.844628 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-fecf9262-23e8-440a-b3b1-abc56e118b0b tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7ffbb437004d379258425747bf1521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038d0cade5d540d399e5d237ed07419f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:59:27.855083 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-fecf9262-23e8-440a-b3b1-abc56e118b0b tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] 10.222.0.20 "GET /compute/v2.1/servers/0b884037-d633-4e3d-a52e-813cc319a6e9" status: 200 len: 1364 microversion: 2.1 time: 0.116135 Oct 27 03:59:27.856372 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3375/6467] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:59:27 2022] GET /compute/v2.1/servers/0b884037-d633-4e3d-a52e-813cc319a6e9 => generated 1364 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:59:28.013070 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a6fb7a9b-7cac-42bd-a64e-a9b92db16a95 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:59:28.013759 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a6fb7a9b-7cac-42bd-a64e-a9b92db16a95 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] [instance: 08d7054d-2d62-4302-a10c-d6875a7871fa] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:59:28.020740 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a6fb7a9b-7cac-42bd-a64e-a9b92db16a95 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:28.021248 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a6fb7a9b-7cac-42bd-a64e-a9b92db16a95 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:28.021752 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a6fb7a9b-7cac-42bd-a64e-a9b92db16a95 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:28.022643 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a6fb7a9b-7cac-42bd-a64e-a9b92db16a95 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:28.023119 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a6fb7a9b-7cac-42bd-a64e-a9b92db16a95 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:28.023558 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a6fb7a9b-7cac-42bd-a64e-a9b92db16a95 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:28.314343 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a6fb7a9b-7cac-42bd-a64e-a9b92db16a95 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32640280c29e408fbf5579d7f12a5a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fd07c6375c4fca9465d351eb2ba7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:59:28.329014 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a6fb7a9b-7cac-42bd-a64e-a9b92db16a95 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] 10.222.0.20 "GET /compute/v2.1/servers/08d7054d-2d62-4302-a10c-d6875a7871fa" status: 200 len: 1267 microversion: 2.1 time: 0.320600 Oct 27 03:59:28.340948 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3093/6468] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:59:28 2022] GET /compute/v2.1/servers/08d7054d-2d62-4302-a10c-d6875a7871fa => generated 1267 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:59:28.362415 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-24424e18-fb0c-43b2-9d24-d8dcc14e4742 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:59:28.363359 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-24424e18-fb0c-43b2-9d24-d8dcc14e4742 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] [instance: 6d3618b4-d458-4283-9be6-38bd764377c4] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:59:28.371600 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-24424e18-fb0c-43b2-9d24-d8dcc14e4742 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:28.372273 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-24424e18-fb0c-43b2-9d24-d8dcc14e4742 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:28.373148 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-24424e18-fb0c-43b2-9d24-d8dcc14e4742 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:28.374151 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-24424e18-fb0c-43b2-9d24-d8dcc14e4742 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:28.374828 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-24424e18-fb0c-43b2-9d24-d8dcc14e4742 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:28.375471 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-24424e18-fb0c-43b2-9d24-d8dcc14e4742 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:28.411431 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-24424e18-fb0c-43b2-9d24-d8dcc14e4742 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:28.412260 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-24424e18-fb0c-43b2-9d24-d8dcc14e4742 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:28.412913 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-24424e18-fb0c-43b2-9d24-d8dcc14e4742 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:28.413720 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-24424e18-fb0c-43b2-9d24-d8dcc14e4742 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lazy-loading 'fault' on Instance uuid 6d3618b4-d458-4283-9be6-38bd764377c4 {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:59:28.471988 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-24424e18-fb0c-43b2-9d24-d8dcc14e4742 tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/6d3618b4-d458-4283-9be6-38bd764377c4" status: 200 len: 1453 microversion: 2.1 time: 0.114303 Oct 27 03:59:28.486676 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3376/6469] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:59:28 2022] GET /compute/v2.1/servers/6d3618b4-d458-4283-9be6-38bd764377c4 => generated 1453 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:59:28.879295 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e535eedc-c49f-430a-bac3-f149fe100b7e tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:59:28.880463 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e535eedc-c49f-430a-bac3-f149fe100b7e tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] [instance: 0b884037-d633-4e3d-a52e-813cc319a6e9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:59:28.892779 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e535eedc-c49f-430a-bac3-f149fe100b7e tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:28.893862 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e535eedc-c49f-430a-bac3-f149fe100b7e tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:28.894332 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e535eedc-c49f-430a-bac3-f149fe100b7e tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:28.907434 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e535eedc-c49f-430a-bac3-f149fe100b7e tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:28.908364 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e535eedc-c49f-430a-bac3-f149fe100b7e tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:28.911578 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e535eedc-c49f-430a-bac3-f149fe100b7e tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:29.218759 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e535eedc-c49f-430a-bac3-f149fe100b7e tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7ffbb437004d379258425747bf1521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038d0cade5d540d399e5d237ed07419f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:59:29.245240 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e535eedc-c49f-430a-bac3-f149fe100b7e tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] 10.222.0.20 "GET /compute/v2.1/servers/0b884037-d633-4e3d-a52e-813cc319a6e9" status: 200 len: 1471 microversion: 2.1 time: 0.370658 Oct 27 03:59:29.248779 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3094/6470] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:59:28 2022] GET /compute/v2.1/servers/0b884037-d633-4e3d-a52e-813cc319a6e9 => generated 1471 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:59:29.352916 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1529cf6e-29e1-474d-bce3-8de6ef65ebbd tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:59:29.354177 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1529cf6e-29e1-474d-bce3-8de6ef65ebbd tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] [instance: 08d7054d-2d62-4302-a10c-d6875a7871fa] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:59:29.371217 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1529cf6e-29e1-474d-bce3-8de6ef65ebbd tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:29.371878 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1529cf6e-29e1-474d-bce3-8de6ef65ebbd tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:29.372165 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1529cf6e-29e1-474d-bce3-8de6ef65ebbd tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:29.373660 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1529cf6e-29e1-474d-bce3-8de6ef65ebbd tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:29.374157 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1529cf6e-29e1-474d-bce3-8de6ef65ebbd tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:29.375527 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1529cf6e-29e1-474d-bce3-8de6ef65ebbd tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:29.488426 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1529cf6e-29e1-474d-bce3-8de6ef65ebbd tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32640280c29e408fbf5579d7f12a5a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fd07c6375c4fca9465d351eb2ba7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:59:29.498249 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b7769223-e228-4ede-9711-d6e7563c862c tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:59:29.498543 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b7769223-e228-4ede-9711-d6e7563c862c tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] [instance: 6d3618b4-d458-4283-9be6-38bd764377c4] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:59:29.511510 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b7769223-e228-4ede-9711-d6e7563c862c tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:29.512613 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b7769223-e228-4ede-9711-d6e7563c862c tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:29.513366 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b7769223-e228-4ede-9711-d6e7563c862c tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:29.515202 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b7769223-e228-4ede-9711-d6e7563c862c tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:29.516308 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1529cf6e-29e1-474d-bce3-8de6ef65ebbd tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] 10.222.0.20 "GET /compute/v2.1/servers/08d7054d-2d62-4302-a10c-d6875a7871fa" status: 200 len: 1273 microversion: 2.1 time: 0.167660 Oct 27 03:59:29.520503 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b7769223-e228-4ede-9711-d6e7563c862c tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:29.522774 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b7769223-e228-4ede-9711-d6e7563c862c tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:29.530784 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3377/6471] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:59:29 2022] GET /compute/v2.1/servers/08d7054d-2d62-4302-a10c-d6875a7871fa => generated 1273 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:59:29.546795 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-b7769223-e228-4ede-9711-d6e7563c862c tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] HTTP exception thrown: Instance 6d3618b4-d458-4283-9be6-38bd764377c4 could not be found. Oct 27 03:59:29.554272 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b7769223-e228-4ede-9711-d6e7563c862c tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Request method failure captured: Oct 27 03:59:29.554272 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/6d3618b4-d458-4283-9be6-38bd764377c4 HTTP/1.1 Oct 27 03:59:29.554272 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:59:29.554272 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:59:29.554272 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:59:29.554272 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:59:29.554272 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:59:29.554272 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:59:29.554272 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:59:29.554272 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:59:29.554272 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWgHmWzjtB0urjdJoQELfv4vVxlxbOdUAZ_06y-Jav24JWzL7wy4i8Clw5jYOlVR8N-XZoicfOTqfCN1dBe9YwmIgVTPYpb_muNuwcPYz6lMdJE9NLgjl3w_kpiorXw_zJbcIPvXzN0KScv9wtW_QsEK2oowV_T4fVd5wAqempcWuQDQ Oct 27 03:59:29.554272 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:59:29.554272 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:59:29.554272 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:59:29.554272 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:59:29.554272 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:59:29.554272 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:59:29.554272 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 57742c85c58c458495524da0b5f78f93 Oct 27 03:59:29.554272 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-TestServerMultinode-1099833883 Oct 27 03:59:29.554272 n-d-862769-1 devstack@n-api.service[121000]: X-Role: admin,member,reader Oct 27 03:59:29.554272 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: admin,member,reader Oct 27 03:59:29.554272 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/57742c85c58c458495524da0b5f78f93"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/57742c85c58c458495524da0b5f78f93"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/57742c85c58c458495524da0b5f78f93"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_57742c85c58c458495524da0b5f78f93"}]}] Oct 27 03:59:29.554272 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-TestServerMultinode-1099833883 Oct 27 03:59:29.554272 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 57742c85c58c458495524da0b5f78f93 Oct 27 03:59:29.554272 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-TestServerMultinode-1099833883 Oct 27 03:59:29.554272 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-TestServerMultinode-1099833883-project-admin Oct 27 03:59:29.554272 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:59:29.554272 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:59:29.554272 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: a1552fd790d342e29fa8deef441fbfc8 Oct 27 03:59:29.554272 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-TestServerMultinode-1099833883-project-admin Oct 27 03:59:29.554272 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:59:29.554272 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 6d3618b4-d458-4283-9be6-38bd764377c4 could not be found. Oct 27 03:59:29.554272 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '6d3618b4-d458-4283-9be6-38bd764377c4'} Oct 27 03:59:29.554272 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:59:29.554272 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:59:29.554272 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:59:29.554272 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:59:29.554272 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:59:29.554272 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:59:29.554272 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:59:29.554272 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:59:29.554272 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:59:29.554272 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:59:29.554272 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d3618b4-d458-4283-9be6-38bd764377c4 could not be found. Oct 27 03:59:29.554272 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:59:29.554272 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:59:29.554272 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:59:29.554272 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:59:29.554272 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:59:29.554272 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:59:29.554272 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:59:29.554272 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:59:29.554272 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:59:29.554272 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:59:29.554272 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:59:29.554272 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:59:29.554272 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:59:29.554272 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:59:29.554272 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:59:29.554272 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:59:29.554272 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d3618b4-d458-4283-9be6-38bd764377c4 could not be found. Oct 27 03:59:29.554272 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:59:29.554272 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:59:29.554272 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:59:29.560356 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:59:29.560356 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:59:29.560356 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:59:29.560356 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:59:29.560356 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:59:29.560356 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d3618b4-d458-4283-9be6-38bd764377c4 could not be found. Oct 27 03:59:29.560356 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:59:29.564488 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b7769223-e228-4ede-9711-d6e7563c862c tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] Returning 404 to user: Instance 6d3618b4-d458-4283-9be6-38bd764377c4 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:59:29.567217 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b7769223-e228-4ede-9711-d6e7563c862c tempest-TestServerMultinode-1099833883 tempest-TestServerMultinode-1099833883-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/6d3618b4-d458-4283-9be6-38bd764377c4" status: 404 len: 111 microversion: 2.1 time: 0.074591 Oct 27 03:59:29.569844 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3095/6472] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:59:29 2022] GET /compute/v2.1/servers/6d3618b4-d458-4283-9be6-38bd764377c4 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:59:30.271123 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-fb8ad577-6292-4111-986d-864d13a23daa tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:59:30.271764 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-fb8ad577-6292-4111-986d-864d13a23daa tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] [instance: 0b884037-d633-4e3d-a52e-813cc319a6e9] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:59:30.277778 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fb8ad577-6292-4111-986d-864d13a23daa tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:30.278304 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fb8ad577-6292-4111-986d-864d13a23daa tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:30.278742 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fb8ad577-6292-4111-986d-864d13a23daa tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:30.279440 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fb8ad577-6292-4111-986d-864d13a23daa tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:30.280265 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fb8ad577-6292-4111-986d-864d13a23daa tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:30.280701 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fb8ad577-6292-4111-986d-864d13a23daa tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:30.485539 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-fb8ad577-6292-4111-986d-864d13a23daa tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7ffbb437004d379258425747bf1521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038d0cade5d540d399e5d237ed07419f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:59:30.495837 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-fb8ad577-6292-4111-986d-864d13a23daa tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] 10.222.0.20 "GET /compute/v2.1/servers/0b884037-d633-4e3d-a52e-813cc319a6e9" status: 200 len: 1471 microversion: 2.1 time: 0.228820 Oct 27 03:59:30.511639 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3378/6473] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:59:30 2022] GET /compute/v2.1/servers/0b884037-d633-4e3d-a52e-813cc319a6e9 => generated 1471 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:59:30.540577 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a5d7653f-8036-4090-beae-b03a7604dcad tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:59:30.542260 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a5d7653f-8036-4090-beae-b03a7604dcad tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] [instance: 08d7054d-2d62-4302-a10c-d6875a7871fa] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:59:30.555587 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a5d7653f-8036-4090-beae-b03a7604dcad tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:30.556425 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a5d7653f-8036-4090-beae-b03a7604dcad tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:30.560707 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a5d7653f-8036-4090-beae-b03a7604dcad tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:30.560707 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a5d7653f-8036-4090-beae-b03a7604dcad tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:30.560707 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a5d7653f-8036-4090-beae-b03a7604dcad tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:30.560707 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a5d7653f-8036-4090-beae-b03a7604dcad tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:30.965759 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-c80f9b2a-0035-44c0-8ac8-f4bd5d5ebdaa req-9e3a1313-0c63-4094-8b76-1dbdc1c7a053 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08d7054d-2d62-4302-a10c-d6875a7871fa", "tag": "24c6847b-d1aa-4f70-ad36-dfac9835cc10"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:59:30.979945 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-c80f9b2a-0035-44c0-8ac8-f4bd5d5ebdaa req-9e3a1313-0c63-4094-8b76-1dbdc1c7a053 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:30.980445 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-c80f9b2a-0035-44c0-8ac8-f4bd5d5ebdaa req-9e3a1313-0c63-4094-8b76-1dbdc1c7a053 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:30.980965 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-c80f9b2a-0035-44c0-8ac8-f4bd5d5ebdaa req-9e3a1313-0c63-4094-8b76-1dbdc1c7a053 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:30.994603 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-c80f9b2a-0035-44c0-8ac8-f4bd5d5ebdaa req-9e3a1313-0c63-4094-8b76-1dbdc1c7a053 service nova] Creating event network-changed:24c6847b-d1aa-4f70-ad36-dfac9835cc10 for instance 08d7054d-2d62-4302-a10c-d6875a7871fa on n-h1-862769-1 Oct 27 03:59:31.002647 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-c80f9b2a-0035-44c0-8ac8-f4bd5d5ebdaa req-9e3a1313-0c63-4094-8b76-1dbdc1c7a053 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041679 Oct 27 03:59:31.004015 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3379/6474] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:59:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:59:31.029552 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a5d7653f-8036-4090-beae-b03a7604dcad tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32640280c29e408fbf5579d7f12a5a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fd07c6375c4fca9465d351eb2ba7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:59:31.041908 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a5d7653f-8036-4090-beae-b03a7604dcad tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] 10.222.0.20 "GET /compute/v2.1/servers/08d7054d-2d62-4302-a10c-d6875a7871fa" status: 200 len: 1315 microversion: 2.1 time: 0.505147 Oct 27 03:59:31.042673 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3096/6475] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:59:30 2022] GET /compute/v2.1/servers/08d7054d-2d62-4302-a10c-d6875a7871fa => generated 1315 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:59:31.395516 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-bdedd18d-5034-4cd8-bd6b-6ac9f89a90e7 req-f8377ee3-b739-4568-9a20-d2fdf9c90f8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b884037-d633-4e3d-a52e-813cc319a6e9", "tag": "2faddf5b-d4a3-4a36-94a3-7aa99ced5696"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:59:31.410773 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-bdedd18d-5034-4cd8-bd6b-6ac9f89a90e7 req-f8377ee3-b739-4568-9a20-d2fdf9c90f8e service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:31.416536 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-bdedd18d-5034-4cd8-bd6b-6ac9f89a90e7 req-f8377ee3-b739-4568-9a20-d2fdf9c90f8e service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:31.416536 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-bdedd18d-5034-4cd8-bd6b-6ac9f89a90e7 req-f8377ee3-b739-4568-9a20-d2fdf9c90f8e service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:31.435953 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-bdedd18d-5034-4cd8-bd6b-6ac9f89a90e7 req-f8377ee3-b739-4568-9a20-d2fdf9c90f8e service nova] Creating event network-changed:2faddf5b-d4a3-4a36-94a3-7aa99ced5696 for instance 0b884037-d633-4e3d-a52e-813cc319a6e9 on n-h2-862769-1 Oct 27 03:59:31.450550 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-bdedd18d-5034-4cd8-bd6b-6ac9f89a90e7 req-f8377ee3-b739-4568-9a20-d2fdf9c90f8e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062732 Oct 27 03:59:31.451565 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3380/6476] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:59:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:59:31.523386 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-356a1772-3779-4452-afa2-5ba88bba10f8 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:59:31.527124 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-356a1772-3779-4452-afa2-5ba88bba10f8 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] [instance: 0b884037-d633-4e3d-a52e-813cc319a6e9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:59:31.540524 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-356a1772-3779-4452-afa2-5ba88bba10f8 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:31.541157 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-356a1772-3779-4452-afa2-5ba88bba10f8 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:31.541773 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-356a1772-3779-4452-afa2-5ba88bba10f8 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:31.542443 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-356a1772-3779-4452-afa2-5ba88bba10f8 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:31.549054 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-356a1772-3779-4452-afa2-5ba88bba10f8 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:31.550356 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-356a1772-3779-4452-afa2-5ba88bba10f8 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:32.067556 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-bdec58f7-db40-4be3-a09c-a43df45c9250 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:59:32.068411 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-bdec58f7-db40-4be3-a09c-a43df45c9250 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] [instance: 08d7054d-2d62-4302-a10c-d6875a7871fa] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:59:32.075210 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bdec58f7-db40-4be3-a09c-a43df45c9250 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:32.075711 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bdec58f7-db40-4be3-a09c-a43df45c9250 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:32.076195 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bdec58f7-db40-4be3-a09c-a43df45c9250 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:32.077116 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bdec58f7-db40-4be3-a09c-a43df45c9250 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:32.077587 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bdec58f7-db40-4be3-a09c-a43df45c9250 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:32.078077 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bdec58f7-db40-4be3-a09c-a43df45c9250 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:32.227282 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-bdec58f7-db40-4be3-a09c-a43df45c9250 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32640280c29e408fbf5579d7f12a5a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fd07c6375c4fca9465d351eb2ba7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:59:32.236098 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-bdec58f7-db40-4be3-a09c-a43df45c9250 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] 10.222.0.20 "GET /compute/v2.1/servers/08d7054d-2d62-4302-a10c-d6875a7871fa" status: 200 len: 1315 microversion: 2.1 time: 0.173411 Oct 27 03:59:32.236697 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3381/6477] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:59:32 2022] GET /compute/v2.1/servers/08d7054d-2d62-4302-a10c-d6875a7871fa => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:59:32.338278 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-356a1772-3779-4452-afa2-5ba88bba10f8 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7ffbb437004d379258425747bf1521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038d0cade5d540d399e5d237ed07419f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:59:32.346169 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-356a1772-3779-4452-afa2-5ba88bba10f8 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] 10.222.0.20 "GET /compute/v2.1/servers/0b884037-d633-4e3d-a52e-813cc319a6e9" status: 200 len: 1471 microversion: 2.1 time: 0.826670 Oct 27 03:59:32.346805 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3097/6478] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:59:31 2022] GET /compute/v2.1/servers/0b884037-d633-4e3d-a52e-813cc319a6e9 => generated 1471 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:59:33.260818 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-49d2e95d-be36-4fea-941d-66d88215c8e7 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:59:33.261366 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-49d2e95d-be36-4fea-941d-66d88215c8e7 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] [instance: 08d7054d-2d62-4302-a10c-d6875a7871fa] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:59:33.273527 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-49d2e95d-be36-4fea-941d-66d88215c8e7 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:33.274062 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-49d2e95d-be36-4fea-941d-66d88215c8e7 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:33.274519 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-49d2e95d-be36-4fea-941d-66d88215c8e7 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:33.275306 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-49d2e95d-be36-4fea-941d-66d88215c8e7 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:33.275780 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-49d2e95d-be36-4fea-941d-66d88215c8e7 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:33.276218 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-49d2e95d-be36-4fea-941d-66d88215c8e7 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:33.369664 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ec4497cb-dfd4-45a3-bff7-44d08ac86b9b tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:59:33.370955 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ec4497cb-dfd4-45a3-bff7-44d08ac86b9b tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] [instance: 0b884037-d633-4e3d-a52e-813cc319a6e9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:59:33.386343 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ec4497cb-dfd4-45a3-bff7-44d08ac86b9b tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:33.387118 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ec4497cb-dfd4-45a3-bff7-44d08ac86b9b tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:33.387777 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ec4497cb-dfd4-45a3-bff7-44d08ac86b9b tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:33.388925 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ec4497cb-dfd4-45a3-bff7-44d08ac86b9b tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:33.389621 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ec4497cb-dfd4-45a3-bff7-44d08ac86b9b tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:33.390303 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ec4497cb-dfd4-45a3-bff7-44d08ac86b9b tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:33.552004 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-49d2e95d-be36-4fea-941d-66d88215c8e7 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32640280c29e408fbf5579d7f12a5a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fd07c6375c4fca9465d351eb2ba7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:59:33.567355 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-49d2e95d-be36-4fea-941d-66d88215c8e7 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] 10.222.0.20 "GET /compute/v2.1/servers/08d7054d-2d62-4302-a10c-d6875a7871fa" status: 200 len: 1315 microversion: 2.1 time: 0.310531 Oct 27 03:59:33.567953 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3382/6479] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:59:33 2022] GET /compute/v2.1/servers/08d7054d-2d62-4302-a10c-d6875a7871fa => generated 1315 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:59:33.622677 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7e7b512e-342c-424c-adc5-3dcbf1844e3b tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:59:33.625963 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7e7b512e-342c-424c-adc5-3dcbf1844e3b tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: b3de2208-af44-465e-bcd6-62cb7c5198be] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:59:33.637802 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7e7b512e-342c-424c-adc5-3dcbf1844e3b tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:33.638547 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7e7b512e-342c-424c-adc5-3dcbf1844e3b tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:33.639338 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7e7b512e-342c-424c-adc5-3dcbf1844e3b tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:33.641198 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7e7b512e-342c-424c-adc5-3dcbf1844e3b tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:33.641867 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7e7b512e-342c-424c-adc5-3dcbf1844e3b tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:33.646020 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7e7b512e-342c-424c-adc5-3dcbf1844e3b tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:33.718544 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7e7b512e-342c-424c-adc5-3dcbf1844e3b tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "POST /compute/v2.1/servers/b3de2208-af44-465e-bcd6-62cb7c5198be/action" status: 200 len: 24549 microversion: 2.1 time: 0.114530 Oct 27 03:59:33.726785 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3383/6480] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:59:33 2022] POST /compute/v2.1/servers/b3de2208-af44-465e-bcd6-62cb7c5198be/action => generated 24549 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 03:59:33.756473 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ec4497cb-dfd4-45a3-bff7-44d08ac86b9b tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7ffbb437004d379258425747bf1521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038d0cade5d540d399e5d237ed07419f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:59:33.773229 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ec4497cb-dfd4-45a3-bff7-44d08ac86b9b tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] 10.222.0.20 "GET /compute/v2.1/servers/0b884037-d633-4e3d-a52e-813cc319a6e9" status: 200 len: 1471 microversion: 2.1 time: 0.407554 Oct 27 03:59:33.775391 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3098/6481] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:59:33 2022] GET /compute/v2.1/servers/0b884037-d633-4e3d-a52e-813cc319a6e9 => generated 1471 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:59:34.592979 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-898fc9c5-95ca-4780-aef3-ab33f3d13043 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:59:34.593927 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-898fc9c5-95ca-4780-aef3-ab33f3d13043 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] [instance: 08d7054d-2d62-4302-a10c-d6875a7871fa] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:59:34.597812 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=4 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:59:34.606386 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=16 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:59:34.617238 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-898fc9c5-95ca-4780-aef3-ab33f3d13043 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:34.617741 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-898fc9c5-95ca-4780-aef3-ab33f3d13043 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:34.618223 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-898fc9c5-95ca-4780-aef3-ab33f3d13043 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:34.618945 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-898fc9c5-95ca-4780-aef3-ab33f3d13043 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:34.619403 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-898fc9c5-95ca-4780-aef3-ab33f3d13043 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:34.619835 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-898fc9c5-95ca-4780-aef3-ab33f3d13043 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:34.812554 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d2109fd3-2028-487b-81e1-49044e604fd2 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:59:34.814973 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d2109fd3-2028-487b-81e1-49044e604fd2 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] [instance: 0b884037-d633-4e3d-a52e-813cc319a6e9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:59:34.821606 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d2109fd3-2028-487b-81e1-49044e604fd2 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:34.822172 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d2109fd3-2028-487b-81e1-49044e604fd2 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:34.822697 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d2109fd3-2028-487b-81e1-49044e604fd2 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:34.823317 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d2109fd3-2028-487b-81e1-49044e604fd2 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:34.823969 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d2109fd3-2028-487b-81e1-49044e604fd2 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:34.824739 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d2109fd3-2028-487b-81e1-49044e604fd2 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:34.896614 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-898fc9c5-95ca-4780-aef3-ab33f3d13043 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32640280c29e408fbf5579d7f12a5a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fd07c6375c4fca9465d351eb2ba7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:59:34.905618 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-898fc9c5-95ca-4780-aef3-ab33f3d13043 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] 10.222.0.20 "GET /compute/v2.1/servers/08d7054d-2d62-4302-a10c-d6875a7871fa" status: 200 len: 1315 microversion: 2.1 time: 0.317561 Oct 27 03:59:34.906246 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3384/6482] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:59:34 2022] GET /compute/v2.1/servers/08d7054d-2d62-4302-a10c-d6875a7871fa => generated 1315 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:59:34.993685 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d2109fd3-2028-487b-81e1-49044e604fd2 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7ffbb437004d379258425747bf1521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038d0cade5d540d399e5d237ed07419f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:59:35.003498 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d2109fd3-2028-487b-81e1-49044e604fd2 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] 10.222.0.20 "GET /compute/v2.1/servers/0b884037-d633-4e3d-a52e-813cc319a6e9" status: 200 len: 1471 microversion: 2.1 time: 0.197389 Oct 27 03:59:35.004895 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3099/6483] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:59:34 2022] GET /compute/v2.1/servers/0b884037-d633-4e3d-a52e-813cc319a6e9 => generated 1471 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:59:35.929017 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-759e0daa-dcc8-4d7a-bd32-1bea994720a0 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:59:35.929654 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-759e0daa-dcc8-4d7a-bd32-1bea994720a0 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] [instance: 08d7054d-2d62-4302-a10c-d6875a7871fa] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:59:35.938407 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-759e0daa-dcc8-4d7a-bd32-1bea994720a0 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:35.938911 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-759e0daa-dcc8-4d7a-bd32-1bea994720a0 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:35.939367 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-759e0daa-dcc8-4d7a-bd32-1bea994720a0 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:35.940090 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-759e0daa-dcc8-4d7a-bd32-1bea994720a0 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:35.941343 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-759e0daa-dcc8-4d7a-bd32-1bea994720a0 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:35.941874 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-759e0daa-dcc8-4d7a-bd32-1bea994720a0 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:36.028196 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4affe7fb-fc48-46f2-842e-8225ed5f5c50 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:59:36.029284 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4affe7fb-fc48-46f2-842e-8225ed5f5c50 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] [instance: 0b884037-d633-4e3d-a52e-813cc319a6e9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:59:36.035552 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:59:36.039181 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4affe7fb-fc48-46f2-842e-8225ed5f5c50 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:36.039844 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4affe7fb-fc48-46f2-842e-8225ed5f5c50 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:36.040502 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4affe7fb-fc48-46f2-842e-8225ed5f5c50 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:36.041388 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4affe7fb-fc48-46f2-842e-8225ed5f5c50 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:36.041999 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4affe7fb-fc48-46f2-842e-8225ed5f5c50 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:36.042601 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4affe7fb-fc48-46f2-842e-8225ed5f5c50 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:36.092389 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-759e0daa-dcc8-4d7a-bd32-1bea994720a0 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32640280c29e408fbf5579d7f12a5a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fd07c6375c4fca9465d351eb2ba7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:59:36.106231 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:59:36.113619 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-759e0daa-dcc8-4d7a-bd32-1bea994720a0 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] 10.222.0.20 "GET /compute/v2.1/servers/08d7054d-2d62-4302-a10c-d6875a7871fa" status: 200 len: 1315 microversion: 2.1 time: 0.189221 Oct 27 03:59:36.119059 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3385/6484] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:59:35 2022] GET /compute/v2.1/servers/08d7054d-2d62-4302-a10c-d6875a7871fa => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:59:36.358225 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4affe7fb-fc48-46f2-842e-8225ed5f5c50 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7ffbb437004d379258425747bf1521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038d0cade5d540d399e5d237ed07419f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:59:36.372591 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4affe7fb-fc48-46f2-842e-8225ed5f5c50 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] 10.222.0.20 "GET /compute/v2.1/servers/0b884037-d633-4e3d-a52e-813cc319a6e9" status: 200 len: 1471 microversion: 2.1 time: 0.348842 Oct 27 03:59:36.392206 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3100/6485] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:59:36 2022] GET /compute/v2.1/servers/0b884037-d633-4e3d-a52e-813cc319a6e9 => generated 1471 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:59:36.989862 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-1d67b8f5-ba2e-4b29-b26e-9e546b782d58 req-bf56f332-d976-4f18-93c1-23096a62654a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08d7054d-2d62-4302-a10c-d6875a7871fa", "name": "network-vif-plugged", "status": "completed", "tag": "24c6847b-d1aa-4f70-ad36-dfac9835cc10"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:59:37.011968 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-1d67b8f5-ba2e-4b29-b26e-9e546b782d58 req-bf56f332-d976-4f18-93c1-23096a62654a service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:37.012445 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-1d67b8f5-ba2e-4b29-b26e-9e546b782d58 req-bf56f332-d976-4f18-93c1-23096a62654a service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:37.012889 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-1d67b8f5-ba2e-4b29-b26e-9e546b782d58 req-bf56f332-d976-4f18-93c1-23096a62654a service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:37.028262 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-1d67b8f5-ba2e-4b29-b26e-9e546b782d58 req-bf56f332-d976-4f18-93c1-23096a62654a service nova] Creating event network-vif-plugged:24c6847b-d1aa-4f70-ad36-dfac9835cc10 for instance 08d7054d-2d62-4302-a10c-d6875a7871fa on n-h1-862769-1 Oct 27 03:59:37.046028 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-1d67b8f5-ba2e-4b29-b26e-9e546b782d58 req-bf56f332-d976-4f18-93c1-23096a62654a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060362 Oct 27 03:59:37.047789 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3386/6486] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:59:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:59:37.138912 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b2c5f70f-318c-4f30-8b5d-5d8f420f9ecc tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:59:37.139719 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b2c5f70f-318c-4f30-8b5d-5d8f420f9ecc tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] [instance: 08d7054d-2d62-4302-a10c-d6875a7871fa] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:59:37.150384 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b2c5f70f-318c-4f30-8b5d-5d8f420f9ecc tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:37.151045 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b2c5f70f-318c-4f30-8b5d-5d8f420f9ecc tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:37.151938 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b2c5f70f-318c-4f30-8b5d-5d8f420f9ecc tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:37.153514 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b2c5f70f-318c-4f30-8b5d-5d8f420f9ecc tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:37.153514 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b2c5f70f-318c-4f30-8b5d-5d8f420f9ecc tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:37.154185 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b2c5f70f-318c-4f30-8b5d-5d8f420f9ecc tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:37.397384 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e4962b4a-ffe5-4a2e-b8c0-bba5d205a391 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:59:37.398489 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e4962b4a-ffe5-4a2e-b8c0-bba5d205a391 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] [instance: 0b884037-d633-4e3d-a52e-813cc319a6e9] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:59:37.405928 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e4962b4a-ffe5-4a2e-b8c0-bba5d205a391 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:37.407267 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e4962b4a-ffe5-4a2e-b8c0-bba5d205a391 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:37.407923 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e4962b4a-ffe5-4a2e-b8c0-bba5d205a391 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:37.408850 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e4962b4a-ffe5-4a2e-b8c0-bba5d205a391 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:37.410447 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e4962b4a-ffe5-4a2e-b8c0-bba5d205a391 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:37.411201 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e4962b4a-ffe5-4a2e-b8c0-bba5d205a391 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:37.478271 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b2c5f70f-318c-4f30-8b5d-5d8f420f9ecc tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32640280c29e408fbf5579d7f12a5a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fd07c6375c4fca9465d351eb2ba7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:59:37.480788 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=100 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:59:37.488329 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b2c5f70f-318c-4f30-8b5d-5d8f420f9ecc tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] 10.222.0.20 "GET /compute/v2.1/servers/08d7054d-2d62-4302-a10c-d6875a7871fa" status: 200 len: 1315 microversion: 2.1 time: 0.354016 Oct 27 03:59:37.492281 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3101/6487] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:59:37 2022] GET /compute/v2.1/servers/08d7054d-2d62-4302-a10c-d6875a7871fa => generated 1315 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:59:37.667097 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e4962b4a-ffe5-4a2e-b8c0-bba5d205a391 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7ffbb437004d379258425747bf1521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038d0cade5d540d399e5d237ed07419f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:59:37.678285 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e4962b4a-ffe5-4a2e-b8c0-bba5d205a391 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] 10.222.0.20 "GET /compute/v2.1/servers/0b884037-d633-4e3d-a52e-813cc319a6e9" status: 200 len: 1471 microversion: 2.1 time: 0.285810 Oct 27 03:59:37.680652 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3387/6488] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:59:37 2022] GET /compute/v2.1/servers/0b884037-d633-4e3d-a52e-813cc319a6e9 => generated 1471 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:59:38.514852 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-73b36346-b02a-4709-b4a0-552c8a442f97 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:59:38.516048 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-73b36346-b02a-4709-b4a0-552c8a442f97 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] [instance: 08d7054d-2d62-4302-a10c-d6875a7871fa] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:59:38.563902 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-73b36346-b02a-4709-b4a0-552c8a442f97 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:38.566712 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-73b36346-b02a-4709-b4a0-552c8a442f97 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.032s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:38.571268 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-73b36346-b02a-4709-b4a0-552c8a442f97 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:38.575757 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-73b36346-b02a-4709-b4a0-552c8a442f97 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:38.576406 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-73b36346-b02a-4709-b4a0-552c8a442f97 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:38.576972 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-73b36346-b02a-4709-b4a0-552c8a442f97 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:38.704962 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5e55be1f-56e1-4d44-8608-931b5efaf25e tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:59:38.707021 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5e55be1f-56e1-4d44-8608-931b5efaf25e tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] [instance: 0b884037-d633-4e3d-a52e-813cc319a6e9] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:59:38.720307 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5e55be1f-56e1-4d44-8608-931b5efaf25e tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:38.721134 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5e55be1f-56e1-4d44-8608-931b5efaf25e tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:38.727859 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5e55be1f-56e1-4d44-8608-931b5efaf25e tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:38.728940 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5e55be1f-56e1-4d44-8608-931b5efaf25e tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:38.729707 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5e55be1f-56e1-4d44-8608-931b5efaf25e tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:38.730402 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5e55be1f-56e1-4d44-8608-931b5efaf25e tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:38.928670 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-73b36346-b02a-4709-b4a0-552c8a442f97 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32640280c29e408fbf5579d7f12a5a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fd07c6375c4fca9465d351eb2ba7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:59:38.937518 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-73b36346-b02a-4709-b4a0-552c8a442f97 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] 10.222.0.20 "GET /compute/v2.1/servers/08d7054d-2d62-4302-a10c-d6875a7871fa" status: 200 len: 1315 microversion: 2.1 time: 0.428385 Oct 27 03:59:38.953466 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5e55be1f-56e1-4d44-8608-931b5efaf25e tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7ffbb437004d379258425747bf1521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038d0cade5d540d399e5d237ed07419f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:59:38.953932 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3102/6489] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:59:38 2022] GET /compute/v2.1/servers/08d7054d-2d62-4302-a10c-d6875a7871fa => generated 1315 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:59:38.957346 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5e55be1f-56e1-4d44-8608-931b5efaf25e tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] 10.222.0.20 "GET /compute/v2.1/servers/0b884037-d633-4e3d-a52e-813cc319a6e9" status: 200 len: 1471 microversion: 2.1 time: 0.256380 Oct 27 03:59:38.959302 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3388/6490] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:59:38 2022] GET /compute/v2.1/servers/0b884037-d633-4e3d-a52e-813cc319a6e9 => generated 1471 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:59:39.075338 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-99c231af-9256-4273-a73e-50e4edba997f req-097f7f2f-9417-4d97-bbcf-08f57171dc1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b884037-d633-4e3d-a52e-813cc319a6e9", "name": "network-vif-plugged", "status": "completed", "tag": "2faddf5b-d4a3-4a36-94a3-7aa99ced5696"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:59:39.110198 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-99c231af-9256-4273-a73e-50e4edba997f req-097f7f2f-9417-4d97-bbcf-08f57171dc1a service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:39.110692 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-99c231af-9256-4273-a73e-50e4edba997f req-097f7f2f-9417-4d97-bbcf-08f57171dc1a service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:39.111129 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-99c231af-9256-4273-a73e-50e4edba997f req-097f7f2f-9417-4d97-bbcf-08f57171dc1a service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:39.123960 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-99c231af-9256-4273-a73e-50e4edba997f req-097f7f2f-9417-4d97-bbcf-08f57171dc1a service nova] Creating event network-vif-plugged:2faddf5b-d4a3-4a36-94a3-7aa99ced5696 for instance 0b884037-d633-4e3d-a52e-813cc319a6e9 on n-h2-862769-1 Oct 27 03:59:39.130458 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-99c231af-9256-4273-a73e-50e4edba997f req-097f7f2f-9417-4d97-bbcf-08f57171dc1a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057898 Oct 27 03:59:39.131130 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3103/6491] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:59:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:59:39.960554 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-23259fa6-7986-4be5-8178-3fec082b9631 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:59:39.961179 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-23259fa6-7986-4be5-8178-3fec082b9631 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] [instance: 08d7054d-2d62-4302-a10c-d6875a7871fa] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:59:39.968579 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-23259fa6-7986-4be5-8178-3fec082b9631 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:39.969056 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-23259fa6-7986-4be5-8178-3fec082b9631 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:39.969506 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-23259fa6-7986-4be5-8178-3fec082b9631 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:39.970295 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-23259fa6-7986-4be5-8178-3fec082b9631 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:39.970763 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-23259fa6-7986-4be5-8178-3fec082b9631 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:39.971208 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-23259fa6-7986-4be5-8178-3fec082b9631 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:39.992979 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-cb8fa91e-87d2-4482-9d12-3284a77a4032 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:59:39.993700 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-cb8fa91e-87d2-4482-9d12-3284a77a4032 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] [instance: 0b884037-d633-4e3d-a52e-813cc319a6e9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:59:40.000390 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cb8fa91e-87d2-4482-9d12-3284a77a4032 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:40.000898 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cb8fa91e-87d2-4482-9d12-3284a77a4032 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:40.001343 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cb8fa91e-87d2-4482-9d12-3284a77a4032 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:40.002146 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cb8fa91e-87d2-4482-9d12-3284a77a4032 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:40.002548 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cb8fa91e-87d2-4482-9d12-3284a77a4032 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:40.003662 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cb8fa91e-87d2-4482-9d12-3284a77a4032 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:40.293038 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-cb8fa91e-87d2-4482-9d12-3284a77a4032 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7ffbb437004d379258425747bf1521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038d0cade5d540d399e5d237ed07419f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:59:40.306676 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-cb8fa91e-87d2-4482-9d12-3284a77a4032 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] 10.222.0.20 "GET /compute/v2.1/servers/0b884037-d633-4e3d-a52e-813cc319a6e9" status: 200 len: 1471 microversion: 2.1 time: 0.319442 Oct 27 03:59:40.307688 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3104/6492] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:59:39 2022] GET /compute/v2.1/servers/0b884037-d633-4e3d-a52e-813cc319a6e9 => generated 1471 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:59:40.567630 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-23259fa6-7986-4be5-8178-3fec082b9631 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32640280c29e408fbf5579d7f12a5a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fd07c6375c4fca9465d351eb2ba7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:59:40.577164 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-23259fa6-7986-4be5-8178-3fec082b9631 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] 10.222.0.20 "GET /compute/v2.1/servers/08d7054d-2d62-4302-a10c-d6875a7871fa" status: 200 len: 1465 microversion: 2.1 time: 0.620578 Oct 27 03:59:40.578114 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3389/6493] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:59:39 2022] GET /compute/v2.1/servers/08d7054d-2d62-4302-a10c-d6875a7871fa => generated 1465 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:59:40.637557 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-751e9231-786b-440d-9bcf-02a949c13584 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:59:40.638347 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-751e9231-786b-440d-9bcf-02a949c13584 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] [instance: 08d7054d-2d62-4302-a10c-d6875a7871fa] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:59:40.644901 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-751e9231-786b-440d-9bcf-02a949c13584 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:40.645626 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-751e9231-786b-440d-9bcf-02a949c13584 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:40.646353 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-751e9231-786b-440d-9bcf-02a949c13584 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:40.655860 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-751e9231-786b-440d-9bcf-02a949c13584 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:40.655860 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-751e9231-786b-440d-9bcf-02a949c13584 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:40.655860 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-751e9231-786b-440d-9bcf-02a949c13584 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:40.694957 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-751e9231-786b-440d-9bcf-02a949c13584 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] [instance: 08d7054d-2d62-4302-a10c-d6875a7871fa] Going to try to terminate instance {{(pid=121000) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 03:59:41.196411 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-751e9231-786b-440d-9bcf-02a949c13584 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] 10.222.0.20 "DELETE /compute/v2.1/servers/08d7054d-2d62-4302-a10c-d6875a7871fa" status: 204 len: 0 microversion: 2.1 time: 0.562394 Oct 27 03:59:41.198003 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3105/6494] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 03:59:40 2022] DELETE /compute/v2.1/servers/08d7054d-2d62-4302-a10c-d6875a7871fa => generated 0 bytes in 565 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 03:59:41.219844 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-31f1b0ff-e55f-4eab-856b-82847b24f5e8 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:59:41.220483 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-31f1b0ff-e55f-4eab-856b-82847b24f5e8 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] [instance: 08d7054d-2d62-4302-a10c-d6875a7871fa] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:59:41.247267 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-31f1b0ff-e55f-4eab-856b-82847b24f5e8 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:41.250710 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-31f1b0ff-e55f-4eab-856b-82847b24f5e8 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:41.251396 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-31f1b0ff-e55f-4eab-856b-82847b24f5e8 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:41.256670 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-31f1b0ff-e55f-4eab-856b-82847b24f5e8 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:41.259460 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-31f1b0ff-e55f-4eab-856b-82847b24f5e8 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:41.261541 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-31f1b0ff-e55f-4eab-856b-82847b24f5e8 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:41.347260 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c0c778d5-e354-4cb7-bf8b-9698fa2f8a34 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:59:41.348423 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c0c778d5-e354-4cb7-bf8b-9698fa2f8a34 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] [instance: 0b884037-d633-4e3d-a52e-813cc319a6e9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:59:41.358153 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c0c778d5-e354-4cb7-bf8b-9698fa2f8a34 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:41.358921 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c0c778d5-e354-4cb7-bf8b-9698fa2f8a34 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:41.359544 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c0c778d5-e354-4cb7-bf8b-9698fa2f8a34 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:41.360422 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c0c778d5-e354-4cb7-bf8b-9698fa2f8a34 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:41.361051 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c0c778d5-e354-4cb7-bf8b-9698fa2f8a34 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:41.361752 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c0c778d5-e354-4cb7-bf8b-9698fa2f8a34 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:41.560501 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-31f1b0ff-e55f-4eab-856b-82847b24f5e8 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32640280c29e408fbf5579d7f12a5a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fd07c6375c4fca9465d351eb2ba7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:59:41.574795 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-31f1b0ff-e55f-4eab-856b-82847b24f5e8 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] 10.222.0.20 "GET /compute/v2.1/servers/08d7054d-2d62-4302-a10c-d6875a7871fa" status: 200 len: 1471 microversion: 2.1 time: 0.367401 Oct 27 03:59:41.582174 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3390/6495] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:59:41 2022] GET /compute/v2.1/servers/08d7054d-2d62-4302-a10c-d6875a7871fa => generated 1471 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:59:41.699433 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c0c778d5-e354-4cb7-bf8b-9698fa2f8a34 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7ffbb437004d379258425747bf1521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038d0cade5d540d399e5d237ed07419f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:59:41.711293 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c0c778d5-e354-4cb7-bf8b-9698fa2f8a34 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] 10.222.0.20 "GET /compute/v2.1/servers/0b884037-d633-4e3d-a52e-813cc319a6e9" status: 200 len: 1643 microversion: 2.1 time: 0.376305 Oct 27 03:59:41.712108 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3106/6496] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:59:41 2022] GET /compute/v2.1/servers/0b884037-d633-4e3d-a52e-813cc319a6e9 => generated 1643 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:59:41.735115 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-37111c98-b403-4132-9882-009c2747c934 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:59:41.741050 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-37111c98-b403-4132-9882-009c2747c934 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] [instance: 0b884037-d633-4e3d-a52e-813cc319a6e9] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:59:41.744147 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-37111c98-b403-4132-9882-009c2747c934 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:41.744871 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-37111c98-b403-4132-9882-009c2747c934 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:41.745546 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-37111c98-b403-4132-9882-009c2747c934 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:41.746529 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-37111c98-b403-4132-9882-009c2747c934 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:41.747226 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-37111c98-b403-4132-9882-009c2747c934 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:41.747926 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-37111c98-b403-4132-9882-009c2747c934 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:42.080306 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-37111c98-b403-4132-9882-009c2747c934 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7ffbb437004d379258425747bf1521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038d0cade5d540d399e5d237ed07419f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:59:42.096377 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-37111c98-b403-4132-9882-009c2747c934 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] 10.222.0.20 "GET /compute/v2.1/servers/0b884037-d633-4e3d-a52e-813cc319a6e9" status: 200 len: 1643 microversion: 2.1 time: 0.365792 Oct 27 03:59:42.099847 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3391/6497] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:59:41 2022] GET /compute/v2.1/servers/0b884037-d633-4e3d-a52e-813cc319a6e9 => generated 1643 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:59:42.132495 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7e08b15c-89d2-436f-aff2-3f209a78fa7f tempest-TestSecurityGroupsBasicOps-962471415 tempest-TestSecurityGroupsBasicOps-962471415-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:59:42.133501 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7e08b15c-89d2-436f-aff2-3f209a78fa7f tempest-TestSecurityGroupsBasicOps-962471415 tempest-TestSecurityGroupsBasicOps-962471415-project-admin] [instance: 0b884037-d633-4e3d-a52e-813cc319a6e9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:59:42.142422 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7e08b15c-89d2-436f-aff2-3f209a78fa7f tempest-TestSecurityGroupsBasicOps-962471415 tempest-TestSecurityGroupsBasicOps-962471415-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:42.145364 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7e08b15c-89d2-436f-aff2-3f209a78fa7f tempest-TestSecurityGroupsBasicOps-962471415 tempest-TestSecurityGroupsBasicOps-962471415-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:42.145364 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7e08b15c-89d2-436f-aff2-3f209a78fa7f tempest-TestSecurityGroupsBasicOps-962471415 tempest-TestSecurityGroupsBasicOps-962471415-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:42.145364 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7e08b15c-89d2-436f-aff2-3f209a78fa7f tempest-TestSecurityGroupsBasicOps-962471415 tempest-TestSecurityGroupsBasicOps-962471415-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:42.146209 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7e08b15c-89d2-436f-aff2-3f209a78fa7f tempest-TestSecurityGroupsBasicOps-962471415 tempest-TestSecurityGroupsBasicOps-962471415-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:42.160223 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7e08b15c-89d2-436f-aff2-3f209a78fa7f tempest-TestSecurityGroupsBasicOps-962471415 tempest-TestSecurityGroupsBasicOps-962471415-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:42.608950 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f5369ee0-831f-4f30-b498-8da891154f24 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:59:42.609588 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f5369ee0-831f-4f30-b498-8da891154f24 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] [instance: 08d7054d-2d62-4302-a10c-d6875a7871fa] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:59:42.617954 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f5369ee0-831f-4f30-b498-8da891154f24 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:42.618837 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f5369ee0-831f-4f30-b498-8da891154f24 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:42.619783 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f5369ee0-831f-4f30-b498-8da891154f24 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:42.621557 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f5369ee0-831f-4f30-b498-8da891154f24 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:42.622544 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f5369ee0-831f-4f30-b498-8da891154f24 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:42.623168 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f5369ee0-831f-4f30-b498-8da891154f24 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:42.701008 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7e08b15c-89d2-436f-aff2-3f209a78fa7f tempest-TestSecurityGroupsBasicOps-962471415 tempest-TestSecurityGroupsBasicOps-962471415-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/0b884037-d633-4e3d-a52e-813cc319a6e9" status: 200 len: 1794 microversion: 2.1 time: 0.573350 Oct 27 03:59:42.702139 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3107/6498] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:59:42 2022] GET /compute/v2.1/servers/0b884037-d633-4e3d-a52e-813cc319a6e9 => generated 1794 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:59:43.000659 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f5369ee0-831f-4f30-b498-8da891154f24 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32640280c29e408fbf5579d7f12a5a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fd07c6375c4fca9465d351eb2ba7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:59:43.010444 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f5369ee0-831f-4f30-b498-8da891154f24 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] 10.222.0.20 "GET /compute/v2.1/servers/08d7054d-2d62-4302-a10c-d6875a7871fa" status: 200 len: 1471 microversion: 2.1 time: 0.405321 Oct 27 03:59:43.022782 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3392/6499] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:59:42 2022] GET /compute/v2.1/servers/08d7054d-2d62-4302-a10c-d6875a7871fa => generated 1471 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:59:43.637481 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-cbf4f190-8730-4cc4-a21c-9d0056a16fb9 req-e0912b88-dfef-4f75-9eae-52eabe1f4046 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08d7054d-2d62-4302-a10c-d6875a7871fa", "name": "network-vif-deleted", "tag": "24c6847b-d1aa-4f70-ad36-dfac9835cc10"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:59:43.695727 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-cbf4f190-8730-4cc4-a21c-9d0056a16fb9 req-e0912b88-dfef-4f75-9eae-52eabe1f4046 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:43.698500 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-cbf4f190-8730-4cc4-a21c-9d0056a16fb9 req-e0912b88-dfef-4f75-9eae-52eabe1f4046 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:43.699773 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-cbf4f190-8730-4cc4-a21c-9d0056a16fb9 req-e0912b88-dfef-4f75-9eae-52eabe1f4046 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:43.760207 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-cbf4f190-8730-4cc4-a21c-9d0056a16fb9 req-e0912b88-dfef-4f75-9eae-52eabe1f4046 service nova] Creating event network-vif-deleted:24c6847b-d1aa-4f70-ad36-dfac9835cc10 for instance 08d7054d-2d62-4302-a10c-d6875a7871fa on n-h1-862769-1 Oct 27 03:59:43.773787 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-cbf4f190-8730-4cc4-a21c-9d0056a16fb9 req-e0912b88-dfef-4f75-9eae-52eabe1f4046 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142556 Oct 27 03:59:43.788289 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3108/6500] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:59:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:59:44.053552 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-bd1b2893-4b81-47fa-98ad-967b4e31bef5 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:59:44.055136 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-bd1b2893-4b81-47fa-98ad-967b4e31bef5 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] [instance: 08d7054d-2d62-4302-a10c-d6875a7871fa] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:59:44.070259 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bd1b2893-4b81-47fa-98ad-967b4e31bef5 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:44.070791 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bd1b2893-4b81-47fa-98ad-967b4e31bef5 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:44.071346 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bd1b2893-4b81-47fa-98ad-967b4e31bef5 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:44.072126 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bd1b2893-4b81-47fa-98ad-967b4e31bef5 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:44.072604 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bd1b2893-4b81-47fa-98ad-967b4e31bef5 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:44.075456 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bd1b2893-4b81-47fa-98ad-967b4e31bef5 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:44.111926 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bd1b2893-4b81-47fa-98ad-967b4e31bef5 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:44.112995 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bd1b2893-4b81-47fa-98ad-967b4e31bef5 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:44.113836 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bd1b2893-4b81-47fa-98ad-967b4e31bef5 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:44.114569 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-bd1b2893-4b81-47fa-98ad-967b4e31bef5 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Lazy-loading 'fault' on Instance uuid 08d7054d-2d62-4302-a10c-d6875a7871fa {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:59:44.183168 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-bd1b2893-4b81-47fa-98ad-967b4e31bef5 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32640280c29e408fbf5579d7f12a5a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fd07c6375c4fca9465d351eb2ba7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:59:44.198272 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-bd1b2893-4b81-47fa-98ad-967b4e31bef5 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] 10.222.0.20 "GET /compute/v2.1/servers/08d7054d-2d62-4302-a10c-d6875a7871fa" status: 200 len: 1305 microversion: 2.1 time: 0.153095 Oct 27 03:59:44.211096 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3393/6501] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:59:44 2022] GET /compute/v2.1/servers/08d7054d-2d62-4302-a10c-d6875a7871fa => generated 1305 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:59:44.651719 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-bac2220b-7016-4642-b82f-ef9cd5440e1f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:59:44.651719 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-bac2220b-7016-4642-b82f-ef9cd5440e1f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: b3de2208-af44-465e-bcd6-62cb7c5198be] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:59:44.651719 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bac2220b-7016-4642-b82f-ef9cd5440e1f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:44.651719 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bac2220b-7016-4642-b82f-ef9cd5440e1f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:44.651719 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bac2220b-7016-4642-b82f-ef9cd5440e1f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:44.651719 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bac2220b-7016-4642-b82f-ef9cd5440e1f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:44.651719 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bac2220b-7016-4642-b82f-ef9cd5440e1f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:44.651719 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bac2220b-7016-4642-b82f-ef9cd5440e1f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:44.958313 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-bac2220b-7016-4642-b82f-ef9cd5440e1f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:59:44.967116 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-bac2220b-7016-4642-b82f-ef9cd5440e1f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/b3de2208-af44-465e-bcd6-62cb7c5198be" status: 200 len: 1681 microversion: 2.1 time: 0.344971 Oct 27 03:59:44.967756 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3109/6502] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:59:44 2022] GET /compute/v2.1/servers/b3de2208-af44-465e-bcd6-62cb7c5198be => generated 1681 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:59:45.098298 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-75bc7450-c29c-4d29-b3ed-39b4f094479f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:59:45.101030 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-75bc7450-c29c-4d29-b3ed-39b4f094479f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: b3de2208-af44-465e-bcd6-62cb7c5198be] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:59:45.116300 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-75bc7450-c29c-4d29-b3ed-39b4f094479f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:45.116955 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-75bc7450-c29c-4d29-b3ed-39b4f094479f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:45.119251 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-75bc7450-c29c-4d29-b3ed-39b4f094479f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:45.120161 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-75bc7450-c29c-4d29-b3ed-39b4f094479f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:45.121791 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-75bc7450-c29c-4d29-b3ed-39b4f094479f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:45.122487 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-75bc7450-c29c-4d29-b3ed-39b4f094479f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:45.210720 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-75bc7450-c29c-4d29-b3ed-39b4f094479f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "POST /compute/v2.1/servers/b3de2208-af44-465e-bcd6-62cb7c5198be/action" status: 200 len: 32617 microversion: 2.1 time: 0.116282 Oct 27 03:59:45.218455 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3394/6503] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:59:45 2022] POST /compute/v2.1/servers/b3de2208-af44-465e-bcd6-62cb7c5198be/action => generated 32617 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 03:59:45.223666 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ab460542-c6d4-488c-be07-9cb957e33678 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:59:45.226006 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ab460542-c6d4-488c-be07-9cb957e33678 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] [instance: 08d7054d-2d62-4302-a10c-d6875a7871fa] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:59:45.230529 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ab460542-c6d4-488c-be07-9cb957e33678 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:45.231248 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ab460542-c6d4-488c-be07-9cb957e33678 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:45.231702 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ab460542-c6d4-488c-be07-9cb957e33678 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:45.232415 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ab460542-c6d4-488c-be07-9cb957e33678 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:45.232876 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ab460542-c6d4-488c-be07-9cb957e33678 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:45.233309 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ab460542-c6d4-488c-be07-9cb957e33678 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:45.247743 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-ab460542-c6d4-488c-be07-9cb957e33678 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] HTTP exception thrown: Instance 08d7054d-2d62-4302-a10c-d6875a7871fa could not be found. Oct 27 03:59:45.249965 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ab460542-c6d4-488c-be07-9cb957e33678 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Request method failure captured: Oct 27 03:59:45.249965 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/08d7054d-2d62-4302-a10c-d6875a7871fa HTTP/1.1 Oct 27 03:59:45.249965 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 03:59:45.249965 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 03:59:45.249965 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 03:59:45.249965 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 03:59:45.249965 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 03:59:45.249965 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 03:59:45.249965 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 03:59:45.249965 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 03:59:45.249965 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWgIXtTmEdBgok5G6IoVSbrmgV36-NpugMMq9T7GGPq83bJJVZhpdusw4bhle1iiAIZqmSVWXZo8zKqLMu4WNpX2i1yvAzt3y-zp1o2uMCViqtGbPVhGZhHEVlxEcRpatyEMrc2GQE5jwp4268kvk_-hsrC6C-N62NjYa5JHWy4JQJ1E Oct 27 03:59:45.249965 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 03:59:45.249965 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 03:59:45.249965 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 03:59:45.249965 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 03:59:45.249965 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 03:59:45.249965 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 03:59:45.249965 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 73fd07c6375c4fca9465d351eb2ba7f6 Oct 27 03:59:45.249965 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-VolumesNegativeTest-625888547 Oct 27 03:59:45.249965 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 03:59:45.249965 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 03:59:45.249965 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/73fd07c6375c4fca9465d351eb2ba7f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/73fd07c6375c4fca9465d351eb2ba7f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/73fd07c6375c4fca9465d351eb2ba7f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_73fd07c6375c4fca9465d351eb2ba7f6"}]}] Oct 27 03:59:45.249965 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-VolumesNegativeTest-625888547 Oct 27 03:59:45.249965 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 73fd07c6375c4fca9465d351eb2ba7f6 Oct 27 03:59:45.249965 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-VolumesNegativeTest-625888547 Oct 27 03:59:45.249965 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-VolumesNegativeTest-625888547-project Oct 27 03:59:45.249965 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 03:59:45.249965 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 03:59:45.249965 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 32640280c29e408fbf5579d7f12a5a6b Oct 27 03:59:45.249965 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-VolumesNegativeTest-625888547-project Oct 27 03:59:45.249965 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 03:59:45.249965 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 08d7054d-2d62-4302-a10c-d6875a7871fa could not be found. Oct 27 03:59:45.249965 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '08d7054d-2d62-4302-a10c-d6875a7871fa'} Oct 27 03:59:45.249965 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 03:59:45.249965 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:59:45.249965 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 03:59:45.249965 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 03:59:45.249965 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 03:59:45.249965 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 03:59:45.249965 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 03:59:45.249965 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 03:59:45.249965 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 03:59:45.249965 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 03:59:45.249965 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08d7054d-2d62-4302-a10c-d6875a7871fa could not be found. Oct 27 03:59:45.249965 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:59:45.249965 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:59:45.249965 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:59:45.249965 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:59:45.249965 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:59:45.249965 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:59:45.249965 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 03:59:45.249965 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 03:59:45.249965 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 03:59:45.249965 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 03:59:45.249965 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 03:59:45.249965 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 03:59:45.249965 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 03:59:45.249965 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 03:59:45.249965 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 03:59:45.249965 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 03:59:45.249965 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08d7054d-2d62-4302-a10c-d6875a7871fa could not be found. Oct 27 03:59:45.249965 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:59:45.249965 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 03:59:45.249965 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:59:45.255230 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 03:59:45.255230 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 03:59:45.255230 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 03:59:45.255230 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 03:59:45.255230 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 03:59:45.255230 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08d7054d-2d62-4302-a10c-d6875a7871fa could not be found. Oct 27 03:59:45.255230 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 03:59:45.256577 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ab460542-c6d4-488c-be07-9cb957e33678 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] Returning 404 to user: Instance 08d7054d-2d62-4302-a10c-d6875a7871fa could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 03:59:45.257792 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ab460542-c6d4-488c-be07-9cb957e33678 tempest-VolumesNegativeTest-625888547 tempest-VolumesNegativeTest-625888547-project] 10.222.0.20 "GET /compute/v2.1/servers/08d7054d-2d62-4302-a10c-d6875a7871fa" status: 404 len: 111 microversion: 2.1 time: 0.038764 Oct 27 03:59:45.269454 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3110/6504] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:59:45 2022] GET /compute/v2.1/servers/08d7054d-2d62-4302-a10c-d6875a7871fa => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 03:59:45.390758 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-938ff709-103b-42b1-b3f1-c8d0ae25485c tempest-TestNetworkAdvancedServerOps-1624832099 tempest-TestNetworkAdvancedServerOps-1624832099-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:59:45.396053 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-938ff709-103b-42b1-b3f1-c8d0ae25485c tempest-TestNetworkAdvancedServerOps-1624832099 tempest-TestNetworkAdvancedServerOps-1624832099-project-admin] [instance: b3de2208-af44-465e-bcd6-62cb7c5198be] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:59:45.406184 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-938ff709-103b-42b1-b3f1-c8d0ae25485c tempest-TestNetworkAdvancedServerOps-1624832099 tempest-TestNetworkAdvancedServerOps-1624832099-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:45.406687 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-938ff709-103b-42b1-b3f1-c8d0ae25485c tempest-TestNetworkAdvancedServerOps-1624832099 tempest-TestNetworkAdvancedServerOps-1624832099-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:45.407127 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-938ff709-103b-42b1-b3f1-c8d0ae25485c tempest-TestNetworkAdvancedServerOps-1624832099 tempest-TestNetworkAdvancedServerOps-1624832099-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:45.408636 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-938ff709-103b-42b1-b3f1-c8d0ae25485c tempest-TestNetworkAdvancedServerOps-1624832099 tempest-TestNetworkAdvancedServerOps-1624832099-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:45.409892 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-938ff709-103b-42b1-b3f1-c8d0ae25485c tempest-TestNetworkAdvancedServerOps-1624832099 tempest-TestNetworkAdvancedServerOps-1624832099-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:45.410793 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-938ff709-103b-42b1-b3f1-c8d0ae25485c tempest-TestNetworkAdvancedServerOps-1624832099 tempest-TestNetworkAdvancedServerOps-1624832099-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:45.631702 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-938ff709-103b-42b1-b3f1-c8d0ae25485c tempest-TestNetworkAdvancedServerOps-1624832099 tempest-TestNetworkAdvancedServerOps-1624832099-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/b3de2208-af44-465e-bcd6-62cb7c5198be" status: 200 len: 1832 microversion: 2.1 time: 0.257006 Oct 27 03:59:45.632740 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3395/6505] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:59:45 2022] GET /compute/v2.1/servers/b3de2208-af44-465e-bcd6-62cb7c5198be => generated 1832 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:59:45.665650 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-122ebea6-9085-4aad-804a-d0c0fe531bff tempest-TestNetworkAdvancedServerOps-1624832099 tempest-TestNetworkAdvancedServerOps-1624832099-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:59:45.672568 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-122ebea6-9085-4aad-804a-d0c0fe531bff tempest-TestNetworkAdvancedServerOps-1624832099 tempest-TestNetworkAdvancedServerOps-1624832099-project-admin] [instance: b3de2208-af44-465e-bcd6-62cb7c5198be] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:59:45.693126 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-122ebea6-9085-4aad-804a-d0c0fe531bff tempest-TestNetworkAdvancedServerOps-1624832099 tempest-TestNetworkAdvancedServerOps-1624832099-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:45.694795 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-122ebea6-9085-4aad-804a-d0c0fe531bff tempest-TestNetworkAdvancedServerOps-1624832099 tempest-TestNetworkAdvancedServerOps-1624832099-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:45.697506 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-122ebea6-9085-4aad-804a-d0c0fe531bff tempest-TestNetworkAdvancedServerOps-1624832099 tempest-TestNetworkAdvancedServerOps-1624832099-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:45.700685 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-122ebea6-9085-4aad-804a-d0c0fe531bff tempest-TestNetworkAdvancedServerOps-1624832099 tempest-TestNetworkAdvancedServerOps-1624832099-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:45.702908 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-122ebea6-9085-4aad-804a-d0c0fe531bff tempest-TestNetworkAdvancedServerOps-1624832099 tempest-TestNetworkAdvancedServerOps-1624832099-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:45.708501 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-122ebea6-9085-4aad-804a-d0c0fe531bff tempest-TestNetworkAdvancedServerOps-1624832099 tempest-TestNetworkAdvancedServerOps-1624832099-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:45.822544 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-122ebea6-9085-4aad-804a-d0c0fe531bff tempest-TestNetworkAdvancedServerOps-1624832099 tempest-TestNetworkAdvancedServerOps-1624832099-project-admin] Lazy-loading 'flavor' on Instance uuid b3de2208-af44-465e-bcd6-62cb7c5198be {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 03:59:45.853249 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-122ebea6-9085-4aad-804a-d0c0fe531bff tempest-TestNetworkAdvancedServerOps-1624832099 tempest-TestNetworkAdvancedServerOps-1624832099-project-admin] [instance: b3de2208-af44-465e-bcd6-62cb7c5198be] Going to try to live migrate instance to another host {{(pid=121000) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 27 03:59:47.510429 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-7ed9e6fa-b24a-4211-8f2e-42b304453ca0 req-b617a6ac-ab3a-4584-8c99-b41fece62eab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b884037-d633-4e3d-a52e-813cc319a6e9", "tag": "2faddf5b-d4a3-4a36-94a3-7aa99ced5696"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:59:47.531833 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-7ed9e6fa-b24a-4211-8f2e-42b304453ca0 req-b617a6ac-ab3a-4584-8c99-b41fece62eab service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:47.532320 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-7ed9e6fa-b24a-4211-8f2e-42b304453ca0 req-b617a6ac-ab3a-4584-8c99-b41fece62eab service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:47.532763 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-7ed9e6fa-b24a-4211-8f2e-42b304453ca0 req-b617a6ac-ab3a-4584-8c99-b41fece62eab service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:47.556618 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-7ed9e6fa-b24a-4211-8f2e-42b304453ca0 req-b617a6ac-ab3a-4584-8c99-b41fece62eab service nova] Creating event network-changed:2faddf5b-d4a3-4a36-94a3-7aa99ced5696 for instance 0b884037-d633-4e3d-a52e-813cc319a6e9 on n-h2-862769-1 Oct 27 03:59:47.572734 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-7ed9e6fa-b24a-4211-8f2e-42b304453ca0 req-b617a6ac-ab3a-4584-8c99-b41fece62eab service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066331 Oct 27 03:59:47.573663 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3396/6506] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:59:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 03:59:50.531278 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-122ebea6-9085-4aad-804a-d0c0fe531bff tempest-TestNetworkAdvancedServerOps-1624832099 tempest-TestNetworkAdvancedServerOps-1624832099-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/b3de2208-af44-465e-bcd6-62cb7c5198be/action" status: 202 len: 0 microversion: 2.1 time: 4.869482 Oct 27 03:59:50.531915 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3111/6507] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 03:59:45 2022] POST /compute/v2.1/servers/b3de2208-af44-465e-bcd6-62cb7c5198be/action => generated 0 bytes in 4871 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 03:59:50.543465 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-63c0be34-6c54-4c6b-95fe-b4bf272b8975 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:59:50.546717 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-63c0be34-6c54-4c6b-95fe-b4bf272b8975 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: b3de2208-af44-465e-bcd6-62cb7c5198be] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:59:50.554939 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-63c0be34-6c54-4c6b-95fe-b4bf272b8975 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:50.555433 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-63c0be34-6c54-4c6b-95fe-b4bf272b8975 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:50.555880 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-63c0be34-6c54-4c6b-95fe-b4bf272b8975 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:50.558507 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-63c0be34-6c54-4c6b-95fe-b4bf272b8975 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:50.559158 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-63c0be34-6c54-4c6b-95fe-b4bf272b8975 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:50.559776 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-63c0be34-6c54-4c6b-95fe-b4bf272b8975 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:50.720100 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-63c0be34-6c54-4c6b-95fe-b4bf272b8975 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:59:50.729069 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-63c0be34-6c54-4c6b-95fe-b4bf272b8975 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/b3de2208-af44-465e-bcd6-62cb7c5198be" status: 200 len: 1691 microversion: 2.1 time: 0.190823 Oct 27 03:59:50.729644 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3397/6508] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:59:50 2022] GET /compute/v2.1/servers/b3de2208-af44-465e-bcd6-62cb7c5198be => generated 1691 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:59:51.776612 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-77fa2b8f-865c-4f28-b33b-73249cfa1a8d tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:59:51.777479 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-77fa2b8f-865c-4f28-b33b-73249cfa1a8d tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: b3de2208-af44-465e-bcd6-62cb7c5198be] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:59:51.794668 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-77fa2b8f-865c-4f28-b33b-73249cfa1a8d tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:51.794668 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-77fa2b8f-865c-4f28-b33b-73249cfa1a8d tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:51.794668 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-77fa2b8f-865c-4f28-b33b-73249cfa1a8d tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:51.794668 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-77fa2b8f-865c-4f28-b33b-73249cfa1a8d tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:51.794668 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-77fa2b8f-865c-4f28-b33b-73249cfa1a8d tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:51.794668 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-77fa2b8f-865c-4f28-b33b-73249cfa1a8d tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:52.053480 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-77fa2b8f-865c-4f28-b33b-73249cfa1a8d tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:59:52.063659 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-77fa2b8f-865c-4f28-b33b-73249cfa1a8d tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/b3de2208-af44-465e-bcd6-62cb7c5198be" status: 200 len: 1691 microversion: 2.1 time: 0.292980 Oct 27 03:59:52.064252 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3112/6509] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:59:51 2022] GET /compute/v2.1/servers/b3de2208-af44-465e-bcd6-62cb7c5198be => generated 1691 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:59:52.200391 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-df257785-c6a6-45a1-a43b-7439ebb0ccb0 req-0bc2aca5-e59c-4410-8d2e-b07498e6c619 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3de2208-af44-465e-bcd6-62cb7c5198be", "name": "network-vif-unplugged", "status": "completed", "tag": "e8963538-23cd-4279-bd63-a8af0f0f838c"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:59:52.210707 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-df257785-c6a6-45a1-a43b-7439ebb0ccb0 req-0bc2aca5-e59c-4410-8d2e-b07498e6c619 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:52.211186 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-df257785-c6a6-45a1-a43b-7439ebb0ccb0 req-0bc2aca5-e59c-4410-8d2e-b07498e6c619 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:52.211626 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-df257785-c6a6-45a1-a43b-7439ebb0ccb0 req-0bc2aca5-e59c-4410-8d2e-b07498e6c619 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:52.224721 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-df257785-c6a6-45a1-a43b-7439ebb0ccb0 req-0bc2aca5-e59c-4410-8d2e-b07498e6c619 service nova] Creating event network-vif-unplugged:e8963538-23cd-4279-bd63-a8af0f0f838c for instance b3de2208-af44-465e-bcd6-62cb7c5198be on n-h1-862769-1 Oct 27 03:59:52.229662 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-df257785-c6a6-45a1-a43b-7439ebb0ccb0 req-0bc2aca5-e59c-4410-8d2e-b07498e6c619 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033525 Oct 27 03:59:52.230296 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3398/6510] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:59:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:59:53.093059 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-bd8bfdb7-09ad-48de-8e29-01b1e69e5132 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:59:53.093744 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-bd8bfdb7-09ad-48de-8e29-01b1e69e5132 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: b3de2208-af44-465e-bcd6-62cb7c5198be] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:59:53.101893 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bd8bfdb7-09ad-48de-8e29-01b1e69e5132 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:53.102442 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bd8bfdb7-09ad-48de-8e29-01b1e69e5132 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:53.102939 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bd8bfdb7-09ad-48de-8e29-01b1e69e5132 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:53.103654 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bd8bfdb7-09ad-48de-8e29-01b1e69e5132 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:53.104119 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bd8bfdb7-09ad-48de-8e29-01b1e69e5132 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:53.104557 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bd8bfdb7-09ad-48de-8e29-01b1e69e5132 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:53.339183 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-bd8bfdb7-09ad-48de-8e29-01b1e69e5132 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:59:53.348267 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-bd8bfdb7-09ad-48de-8e29-01b1e69e5132 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/b3de2208-af44-465e-bcd6-62cb7c5198be" status: 200 len: 1691 microversion: 2.1 time: 0.259311 Oct 27 03:59:53.349460 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3113/6511] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:59:53 2022] GET /compute/v2.1/servers/b3de2208-af44-465e-bcd6-62cb7c5198be => generated 1691 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 03:59:54.246654 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-042b6d74-f198-4abd-bc48-0c93b87bf00d req-82c134fa-364a-4cbb-b645-cb75d576dfd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3de2208-af44-465e-bcd6-62cb7c5198be", "tag": "e8963538-23cd-4279-bd63-a8af0f0f838c"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 03:59:54.264577 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-042b6d74-f198-4abd-bc48-0c93b87bf00d req-82c134fa-364a-4cbb-b645-cb75d576dfd4 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:54.265061 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-042b6d74-f198-4abd-bc48-0c93b87bf00d req-82c134fa-364a-4cbb-b645-cb75d576dfd4 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:54.265502 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-042b6d74-f198-4abd-bc48-0c93b87bf00d req-82c134fa-364a-4cbb-b645-cb75d576dfd4 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:54.277766 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-042b6d74-f198-4abd-bc48-0c93b87bf00d req-82c134fa-364a-4cbb-b645-cb75d576dfd4 service nova] Creating event network-changed:e8963538-23cd-4279-bd63-a8af0f0f838c for instance b3de2208-af44-465e-bcd6-62cb7c5198be on n-h1-862769-1 Oct 27 03:59:54.283598 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-042b6d74-f198-4abd-bc48-0c93b87bf00d req-82c134fa-364a-4cbb-b645-cb75d576dfd4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041653 Oct 27 03:59:54.285333 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3399/6512] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 03:59:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 03:59:54.373150 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ea0b2498-5871-4cad-bfef-6c58229cdc40 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:59:54.374625 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ea0b2498-5871-4cad-bfef-6c58229cdc40 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: b3de2208-af44-465e-bcd6-62cb7c5198be] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:59:54.389422 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ea0b2498-5871-4cad-bfef-6c58229cdc40 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:54.390442 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ea0b2498-5871-4cad-bfef-6c58229cdc40 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:54.396801 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ea0b2498-5871-4cad-bfef-6c58229cdc40 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:54.396801 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ea0b2498-5871-4cad-bfef-6c58229cdc40 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:54.396801 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ea0b2498-5871-4cad-bfef-6c58229cdc40 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:54.396801 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ea0b2498-5871-4cad-bfef-6c58229cdc40 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:54.680714 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ea0b2498-5871-4cad-bfef-6c58229cdc40 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:59:54.698706 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ea0b2498-5871-4cad-bfef-6c58229cdc40 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/b3de2208-af44-465e-bcd6-62cb7c5198be" status: 200 len: 1691 microversion: 2.1 time: 0.329884 Oct 27 03:59:54.711446 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3114/6513] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:59:54 2022] GET /compute/v2.1/servers/b3de2208-af44-465e-bcd6-62cb7c5198be => generated 1691 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:59:55.726828 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2f7d61b7-125e-4b3e-8824-28bcb8cf5d47 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:59:55.727613 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2f7d61b7-125e-4b3e-8824-28bcb8cf5d47 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: b3de2208-af44-465e-bcd6-62cb7c5198be] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:59:55.780024 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2f7d61b7-125e-4b3e-8824-28bcb8cf5d47 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:55.780536 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2f7d61b7-125e-4b3e-8824-28bcb8cf5d47 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:55.780986 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2f7d61b7-125e-4b3e-8824-28bcb8cf5d47 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:55.785249 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2f7d61b7-125e-4b3e-8824-28bcb8cf5d47 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:55.785249 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2f7d61b7-125e-4b3e-8824-28bcb8cf5d47 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:55.786463 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2f7d61b7-125e-4b3e-8824-28bcb8cf5d47 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:55.958237 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2f7d61b7-125e-4b3e-8824-28bcb8cf5d47 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:59:55.970994 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2f7d61b7-125e-4b3e-8824-28bcb8cf5d47 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/b3de2208-af44-465e-bcd6-62cb7c5198be" status: 200 len: 1691 microversion: 2.1 time: 0.246710 Oct 27 03:59:55.974880 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3400/6514] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:59:55 2022] GET /compute/v2.1/servers/b3de2208-af44-465e-bcd6-62cb7c5198be => generated 1691 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:59:56.995912 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-76a1c0eb-6141-411c-b079-e06b8f0455df tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:59:56.996532 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-76a1c0eb-6141-411c-b079-e06b8f0455df tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: b3de2208-af44-465e-bcd6-62cb7c5198be] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:59:57.012353 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-76a1c0eb-6141-411c-b079-e06b8f0455df tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:57.012353 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-76a1c0eb-6141-411c-b079-e06b8f0455df tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:57.012353 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-76a1c0eb-6141-411c-b079-e06b8f0455df tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:57.014466 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-76a1c0eb-6141-411c-b079-e06b8f0455df tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:57.014945 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-76a1c0eb-6141-411c-b079-e06b8f0455df tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:57.015392 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-76a1c0eb-6141-411c-b079-e06b8f0455df tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:57.385343 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-76a1c0eb-6141-411c-b079-e06b8f0455df tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:59:57.398367 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-76a1c0eb-6141-411c-b079-e06b8f0455df tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/b3de2208-af44-465e-bcd6-62cb7c5198be" status: 200 len: 1691 microversion: 2.1 time: 0.406200 Oct 27 03:59:57.399289 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3115/6515] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:59:56 2022] GET /compute/v2.1/servers/b3de2208-af44-465e-bcd6-62cb7c5198be => generated 1691 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:59:58.424385 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-03fe413a-a4cf-44b8-b619-7f8fbe6e53a9 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:59:58.426672 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-03fe413a-a4cf-44b8-b619-7f8fbe6e53a9 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: b3de2208-af44-465e-bcd6-62cb7c5198be] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:59:58.445175 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-03fe413a-a4cf-44b8-b619-7f8fbe6e53a9 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:58.445805 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-03fe413a-a4cf-44b8-b619-7f8fbe6e53a9 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:58.456759 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-03fe413a-a4cf-44b8-b619-7f8fbe6e53a9 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:58.459075 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-03fe413a-a4cf-44b8-b619-7f8fbe6e53a9 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:58.459679 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-03fe413a-a4cf-44b8-b619-7f8fbe6e53a9 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:58.460502 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-03fe413a-a4cf-44b8-b619-7f8fbe6e53a9 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:58.815906 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-03fe413a-a4cf-44b8-b619-7f8fbe6e53a9 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 03:59:58.827361 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-03fe413a-a4cf-44b8-b619-7f8fbe6e53a9 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/b3de2208-af44-465e-bcd6-62cb7c5198be" status: 200 len: 1691 microversion: 2.1 time: 0.406792 Oct 27 03:59:58.828692 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3401/6516] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:59:58 2022] GET /compute/v2.1/servers/b3de2208-af44-465e-bcd6-62cb7c5198be => generated 1691 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 03:59:59.853858 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3f6e661e-fb73-4e14-b180-29183fea464e tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 03:59:59.854524 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-3f6e661e-fb73-4e14-b180-29183fea464e tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: b3de2208-af44-465e-bcd6-62cb7c5198be] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 03:59:59.863019 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 03:59:59.864814 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3f6e661e-fb73-4e14-b180-29183fea464e tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:59.865324 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3f6e661e-fb73-4e14-b180-29183fea464e tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:59.865776 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3f6e661e-fb73-4e14-b180-29183fea464e tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 03:59:59.866546 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3f6e661e-fb73-4e14-b180-29183fea464e tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 03:59:59.867014 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3f6e661e-fb73-4e14-b180-29183fea464e tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 03:59:59.867451 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3f6e661e-fb73-4e14-b180-29183fea464e tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:00.228558 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-3f6e661e-fb73-4e14-b180-29183fea464e tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:00:00.237682 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3f6e661e-fb73-4e14-b180-29183fea464e tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/b3de2208-af44-465e-bcd6-62cb7c5198be" status: 200 len: 1691 microversion: 2.1 time: 0.388694 Oct 27 04:00:00.238930 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3116/6517] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 03:59:59 2022] GET /compute/v2.1/servers/b3de2208-af44-465e-bcd6-62cb7c5198be => generated 1691 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 04:00:01.262625 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0709d5c7-26a2-4800-b965-c75b3bc5f15f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:00:01.263921 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0709d5c7-26a2-4800-b965-c75b3bc5f15f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: b3de2208-af44-465e-bcd6-62cb7c5198be] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:00:01.266638 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=60 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:00:01.272210 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0709d5c7-26a2-4800-b965-c75b3bc5f15f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:01.273046 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0709d5c7-26a2-4800-b965-c75b3bc5f15f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:01.273722 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0709d5c7-26a2-4800-b965-c75b3bc5f15f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:01.274658 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0709d5c7-26a2-4800-b965-c75b3bc5f15f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:01.275286 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0709d5c7-26a2-4800-b965-c75b3bc5f15f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:01.275886 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0709d5c7-26a2-4800-b965-c75b3bc5f15f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:01.439480 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0709d5c7-26a2-4800-b965-c75b3bc5f15f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:00:01.449126 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0709d5c7-26a2-4800-b965-c75b3bc5f15f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/b3de2208-af44-465e-bcd6-62cb7c5198be" status: 200 len: 1691 microversion: 2.1 time: 0.190521 Oct 27 04:00:01.457036 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3402/6518] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:00:01 2022] GET /compute/v2.1/servers/b3de2208-af44-465e-bcd6-62cb7c5198be => generated 1691 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:00:02.473224 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-de3c4845-1e03-4485-afa1-09613dbc65fd tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:00:02.474142 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-de3c4845-1e03-4485-afa1-09613dbc65fd tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: b3de2208-af44-465e-bcd6-62cb7c5198be] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:00:02.483084 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-de3c4845-1e03-4485-afa1-09613dbc65fd tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:02.483956 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-de3c4845-1e03-4485-afa1-09613dbc65fd tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:02.484417 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-de3c4845-1e03-4485-afa1-09613dbc65fd tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:02.485869 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-de3c4845-1e03-4485-afa1-09613dbc65fd tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:02.486397 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-de3c4845-1e03-4485-afa1-09613dbc65fd tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:02.486997 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-de3c4845-1e03-4485-afa1-09613dbc65fd tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:02.522741 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:00:02.691936 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-de3c4845-1e03-4485-afa1-09613dbc65fd tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:00:02.701970 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-de3c4845-1e03-4485-afa1-09613dbc65fd tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/b3de2208-af44-465e-bcd6-62cb7c5198be" status: 200 len: 1681 microversion: 2.1 time: 0.232299 Oct 27 04:00:02.702794 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3117/6519] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:00:02 2022] GET /compute/v2.1/servers/b3de2208-af44-465e-bcd6-62cb7c5198be => generated 1681 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:00:02.725838 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9f9db81a-759e-4dc5-b520-27344f6c94fd tempest-TestNetworkAdvancedServerOps-1624832099 tempest-TestNetworkAdvancedServerOps-1624832099-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:00:02.726490 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-9f9db81a-759e-4dc5-b520-27344f6c94fd tempest-TestNetworkAdvancedServerOps-1624832099 tempest-TestNetworkAdvancedServerOps-1624832099-project-admin] [instance: b3de2208-af44-465e-bcd6-62cb7c5198be] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:00:02.735185 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9f9db81a-759e-4dc5-b520-27344f6c94fd tempest-TestNetworkAdvancedServerOps-1624832099 tempest-TestNetworkAdvancedServerOps-1624832099-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:02.735699 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9f9db81a-759e-4dc5-b520-27344f6c94fd tempest-TestNetworkAdvancedServerOps-1624832099 tempest-TestNetworkAdvancedServerOps-1624832099-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:02.736168 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9f9db81a-759e-4dc5-b520-27344f6c94fd tempest-TestNetworkAdvancedServerOps-1624832099 tempest-TestNetworkAdvancedServerOps-1624832099-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:02.736885 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9f9db81a-759e-4dc5-b520-27344f6c94fd tempest-TestNetworkAdvancedServerOps-1624832099 tempest-TestNetworkAdvancedServerOps-1624832099-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:02.737355 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9f9db81a-759e-4dc5-b520-27344f6c94fd tempest-TestNetworkAdvancedServerOps-1624832099 tempest-TestNetworkAdvancedServerOps-1624832099-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:02.738386 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9f9db81a-759e-4dc5-b520-27344f6c94fd tempest-TestNetworkAdvancedServerOps-1624832099 tempest-TestNetworkAdvancedServerOps-1624832099-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:03.209717 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9f9db81a-759e-4dc5-b520-27344f6c94fd tempest-TestNetworkAdvancedServerOps-1624832099 tempest-TestNetworkAdvancedServerOps-1624832099-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/b3de2208-af44-465e-bcd6-62cb7c5198be" status: 200 len: 1832 microversion: 2.1 time: 0.488058 Oct 27 04:00:03.223126 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3403/6520] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:00:02 2022] GET /compute/v2.1/servers/b3de2208-af44-465e-bcd6-62cb7c5198be => generated 1832 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:00:03.251765 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7ee3751e-113a-4ce3-a91f-c2915a3be297 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:00:03.252383 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7ee3751e-113a-4ce3-a91f-c2915a3be297 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: b3de2208-af44-465e-bcd6-62cb7c5198be] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:00:03.266115 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7ee3751e-113a-4ce3-a91f-c2915a3be297 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:03.266723 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7ee3751e-113a-4ce3-a91f-c2915a3be297 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:03.267191 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7ee3751e-113a-4ce3-a91f-c2915a3be297 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:03.272233 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7ee3751e-113a-4ce3-a91f-c2915a3be297 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:03.272766 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7ee3751e-113a-4ce3-a91f-c2915a3be297 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:03.273223 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7ee3751e-113a-4ce3-a91f-c2915a3be297 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:03.518189 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7ee3751e-113a-4ce3-a91f-c2915a3be297 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:00:03.539908 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7ee3751e-113a-4ce3-a91f-c2915a3be297 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/b3de2208-af44-465e-bcd6-62cb7c5198be" status: 200 len: 1681 microversion: 2.1 time: 0.292676 Oct 27 04:00:03.556791 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3118/6521] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:00:03 2022] GET /compute/v2.1/servers/b3de2208-af44-465e-bcd6-62cb7c5198be => generated 1681 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:00:05.687762 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-56aae67a-19ef-4a7d-9947-9b331b3b3246 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:00:05.690696 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-56aae67a-19ef-4a7d-9947-9b331b3b3246 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: b3de2208-af44-465e-bcd6-62cb7c5198be] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:00:05.698410 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-56aae67a-19ef-4a7d-9947-9b331b3b3246 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:05.699110 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-56aae67a-19ef-4a7d-9947-9b331b3b3246 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:05.699738 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-56aae67a-19ef-4a7d-9947-9b331b3b3246 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:05.700641 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-56aae67a-19ef-4a7d-9947-9b331b3b3246 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:05.701109 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-56aae67a-19ef-4a7d-9947-9b331b3b3246 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:05.701550 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-56aae67a-19ef-4a7d-9947-9b331b3b3246 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:05.760964 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-56aae67a-19ef-4a7d-9947-9b331b3b3246 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "POST /compute/v2.1/servers/b3de2208-af44-465e-bcd6-62cb7c5198be/action" status: 200 len: 38602 microversion: 2.1 time: 0.077492 Oct 27 04:00:05.761630 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3404/6522] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 04:00:05 2022] POST /compute/v2.1/servers/b3de2208-af44-465e-bcd6-62cb7c5198be/action => generated 38602 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 04:00:07.589548 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4873f59e-4f73-48e4-96ea-214414ebdae9 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:00:07.590229 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4873f59e-4f73-48e4-96ea-214414ebdae9 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: b3de2208-af44-465e-bcd6-62cb7c5198be] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:00:07.599289 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4873f59e-4f73-48e4-96ea-214414ebdae9 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:07.600781 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4873f59e-4f73-48e4-96ea-214414ebdae9 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:07.602677 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4873f59e-4f73-48e4-96ea-214414ebdae9 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:07.604275 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4873f59e-4f73-48e4-96ea-214414ebdae9 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:07.604921 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4873f59e-4f73-48e4-96ea-214414ebdae9 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:07.605529 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4873f59e-4f73-48e4-96ea-214414ebdae9 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:07.668846 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4873f59e-4f73-48e4-96ea-214414ebdae9 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: b3de2208-af44-465e-bcd6-62cb7c5198be] Going to try to terminate instance {{(pid=121000) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 04:00:08.073954 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-a2627651-3e6f-4776-9f12-7bc7d91bc9ad req-5ef90b1f-8fe1-4ce9-bfdc-9b706ff88649 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3de2208-af44-465e-bcd6-62cb7c5198be", "tag": "e8963538-23cd-4279-bd63-a8af0f0f838c"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:00:08.105957 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-a2627651-3e6f-4776-9f12-7bc7d91bc9ad req-5ef90b1f-8fe1-4ce9-bfdc-9b706ff88649 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:08.106618 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-a2627651-3e6f-4776-9f12-7bc7d91bc9ad req-5ef90b1f-8fe1-4ce9-bfdc-9b706ff88649 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:08.107074 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-a2627651-3e6f-4776-9f12-7bc7d91bc9ad req-5ef90b1f-8fe1-4ce9-bfdc-9b706ff88649 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:08.117441 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4873f59e-4f73-48e4-96ea-214414ebdae9 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b3de2208-af44-465e-bcd6-62cb7c5198be" status: 204 len: 0 microversion: 2.1 time: 0.536496 Oct 27 04:00:08.118386 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3119/6523] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 04:00:07 2022] DELETE /compute/v2.1/servers/b3de2208-af44-465e-bcd6-62cb7c5198be => generated 0 bytes in 538 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 04:00:08.135477 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c44a055d-39e7-4a14-a24c-46aed3e9dee5 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:00:08.137866 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c44a055d-39e7-4a14-a24c-46aed3e9dee5 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: b3de2208-af44-465e-bcd6-62cb7c5198be] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:00:08.146771 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-a2627651-3e6f-4776-9f12-7bc7d91bc9ad req-5ef90b1f-8fe1-4ce9-bfdc-9b706ff88649 service nova] Creating event network-changed:e8963538-23cd-4279-bd63-a8af0f0f838c for instance b3de2208-af44-465e-bcd6-62cb7c5198be on n-h2-862769-1 Oct 27 04:00:08.156740 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c44a055d-39e7-4a14-a24c-46aed3e9dee5 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:08.157014 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-a2627651-3e6f-4776-9f12-7bc7d91bc9ad req-5ef90b1f-8fe1-4ce9-bfdc-9b706ff88649 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.572697 Oct 27 04:00:08.157255 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c44a055d-39e7-4a14-a24c-46aed3e9dee5 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:08.157710 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c44a055d-39e7-4a14-a24c-46aed3e9dee5 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:08.158470 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c44a055d-39e7-4a14-a24c-46aed3e9dee5 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:08.158939 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c44a055d-39e7-4a14-a24c-46aed3e9dee5 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:08.164781 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c44a055d-39e7-4a14-a24c-46aed3e9dee5 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:08.165157 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3405/6524] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:00:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 04:00:08.536802 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c44a055d-39e7-4a14-a24c-46aed3e9dee5 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:00:08.556734 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c44a055d-39e7-4a14-a24c-46aed3e9dee5 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/b3de2208-af44-465e-bcd6-62cb7c5198be" status: 200 len: 1687 microversion: 2.1 time: 0.431792 Oct 27 04:00:08.576201 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3120/6525] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:00:08 2022] GET /compute/v2.1/servers/b3de2208-af44-465e-bcd6-62cb7c5198be => generated 1687 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:00:09.584721 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b087df81-9540-4d47-9833-9d6f7e475f3f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:00:09.586218 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b087df81-9540-4d47-9833-9d6f7e475f3f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: b3de2208-af44-465e-bcd6-62cb7c5198be] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:00:09.610001 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b087df81-9540-4d47-9833-9d6f7e475f3f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:09.610509 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b087df81-9540-4d47-9833-9d6f7e475f3f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:09.611105 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b087df81-9540-4d47-9833-9d6f7e475f3f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:09.612076 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b087df81-9540-4d47-9833-9d6f7e475f3f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:09.613637 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b087df81-9540-4d47-9833-9d6f7e475f3f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:09.614890 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b087df81-9540-4d47-9833-9d6f7e475f3f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:09.620036 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=100 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:00:09.742812 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b087df81-9540-4d47-9833-9d6f7e475f3f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:00:09.755779 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b087df81-9540-4d47-9833-9d6f7e475f3f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/b3de2208-af44-465e-bcd6-62cb7c5198be" status: 200 len: 1500 microversion: 2.1 time: 0.176515 Oct 27 04:00:09.759022 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3406/6526] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:00:09 2022] GET /compute/v2.1/servers/b3de2208-af44-465e-bcd6-62cb7c5198be => generated 1500 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:00:10.017941 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-72d915cc-288e-4362-bd8c-17142fd5f938 req-899fa928-f3bf-4669-a3e9-bbd063f219df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3de2208-af44-465e-bcd6-62cb7c5198be", "name": "network-vif-deleted", "tag": "e8963538-23cd-4279-bd63-a8af0f0f838c"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:00:10.027831 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-72d915cc-288e-4362-bd8c-17142fd5f938 req-899fa928-f3bf-4669-a3e9-bbd063f219df service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:10.028564 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-72d915cc-288e-4362-bd8c-17142fd5f938 req-899fa928-f3bf-4669-a3e9-bbd063f219df service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:10.029199 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-72d915cc-288e-4362-bd8c-17142fd5f938 req-899fa928-f3bf-4669-a3e9-bbd063f219df service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:10.042822 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-72d915cc-288e-4362-bd8c-17142fd5f938 req-899fa928-f3bf-4669-a3e9-bbd063f219df service nova] Creating event network-vif-deleted:e8963538-23cd-4279-bd63-a8af0f0f838c for instance b3de2208-af44-465e-bcd6-62cb7c5198be on n-h2-862769-1 Oct 27 04:00:10.049174 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-72d915cc-288e-4362-bd8c-17142fd5f938 req-899fa928-f3bf-4669-a3e9-bbd063f219df service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035939 Oct 27 04:00:10.050086 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3121/6527] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:00:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:00:10.784798 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f1d79e97-faab-4beb-aa1c-bb3553b284ee tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:00:10.787019 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f1d79e97-faab-4beb-aa1c-bb3553b284ee tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: b3de2208-af44-465e-bcd6-62cb7c5198be] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:00:10.795057 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f1d79e97-faab-4beb-aa1c-bb3553b284ee tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:10.795559 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f1d79e97-faab-4beb-aa1c-bb3553b284ee tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:10.796081 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f1d79e97-faab-4beb-aa1c-bb3553b284ee tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:10.797009 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f1d79e97-faab-4beb-aa1c-bb3553b284ee tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:10.797534 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f1d79e97-faab-4beb-aa1c-bb3553b284ee tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:10.797971 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f1d79e97-faab-4beb-aa1c-bb3553b284ee tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:10.813407 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-f1d79e97-faab-4beb-aa1c-bb3553b284ee tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] HTTP exception thrown: Instance b3de2208-af44-465e-bcd6-62cb7c5198be could not be found. Oct 27 04:00:10.815133 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f1d79e97-faab-4beb-aa1c-bb3553b284ee tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Request method failure captured: Oct 27 04:00:10.815133 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/b3de2208-af44-465e-bcd6-62cb7c5198be HTTP/1.1 Oct 27 04:00:10.815133 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 04:00:10.815133 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 04:00:10.815133 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 04:00:10.815133 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 04:00:10.815133 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 04:00:10.815133 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 04:00:10.815133 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 04:00:10.815133 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 04:00:10.815133 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWgCBfAAwg6CX6jDfTtZPKjU4IWrIPYNtoTX74Z0294jlmpA1hscNVPpQCZKJL8OTT0mEifdIsaGagx_vQ0B8uGp3mqvS5WXv14Q21L8zoEIglWon1GOJtZ7gJgUVC645n40NoZhGr_naOfvzanpfLwOaaEk7i8HP5LshJWpyWvY3Sp0 Oct 27 04:00:10.815133 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 04:00:10.815133 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 04:00:10.815133 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 04:00:10.815133 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 04:00:10.815133 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 04:00:10.815133 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 04:00:10.815133 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: a432dda4903145278d79210121b3f77d Oct 27 04:00:10.815133 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-505113127 Oct 27 04:00:10.815133 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 04:00:10.815133 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 04:00:10.815133 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a432dda4903145278d79210121b3f77d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a432dda4903145278d79210121b3f77d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a432dda4903145278d79210121b3f77d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a432dda4903145278d79210121b3f77d"}]}] Oct 27 04:00:10.815133 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-TestNetworkAdvancedServerOps-505113127 Oct 27 04:00:10.815133 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: a432dda4903145278d79210121b3f77d Oct 27 04:00:10.815133 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-505113127 Oct 27 04:00:10.815133 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-TestNetworkAdvancedServerOps-505113127-project Oct 27 04:00:10.815133 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 04:00:10.815133 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 04:00:10.815133 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: a2ea55b400c24827a28e816ea2a225aa Oct 27 04:00:10.815133 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-TestNetworkAdvancedServerOps-505113127-project Oct 27 04:00:10.815133 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 04:00:10.815133 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance b3de2208-af44-465e-bcd6-62cb7c5198be could not be found. Oct 27 04:00:10.815133 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': 'b3de2208-af44-465e-bcd6-62cb7c5198be'} Oct 27 04:00:10.815133 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 04:00:10.815133 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:00:10.815133 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 04:00:10.815133 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 04:00:10.815133 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 04:00:10.815133 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 04:00:10.815133 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 04:00:10.815133 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 04:00:10.815133 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 04:00:10.815133 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 04:00:10.815133 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3de2208-af44-465e-bcd6-62cb7c5198be could not be found. Oct 27 04:00:10.815133 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:00:10.815133 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:00:10.815133 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:00:10.815133 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:00:10.815133 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:00:10.815133 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:00:10.815133 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 04:00:10.815133 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 04:00:10.815133 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 04:00:10.815133 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 04:00:10.815133 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 04:00:10.815133 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 04:00:10.815133 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 04:00:10.815133 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 04:00:10.815133 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 04:00:10.815133 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 04:00:10.815133 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3de2208-af44-465e-bcd6-62cb7c5198be could not be found. Oct 27 04:00:10.815133 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:00:10.815133 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:00:10.820257 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:00:10.820257 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:00:10.820257 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:00:10.820257 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:00:10.820257 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 04:00:10.820257 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 04:00:10.820257 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3de2208-af44-465e-bcd6-62cb7c5198be could not be found. Oct 27 04:00:10.820257 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:00:10.820257 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f1d79e97-faab-4beb-aa1c-bb3553b284ee tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Returning 404 to user: Instance b3de2208-af44-465e-bcd6-62cb7c5198be could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 04:00:10.820257 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f1d79e97-faab-4beb-aa1c-bb3553b284ee tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/b3de2208-af44-465e-bcd6-62cb7c5198be" status: 404 len: 111 microversion: 2.1 time: 0.037087 Oct 27 04:00:10.822061 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3407/6528] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:00:10 2022] GET /compute/v2.1/servers/b3de2208-af44-465e-bcd6-62cb7c5198be => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 04:00:17.004048 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-21615a53-c378-42aa-a5c8-cade1666994e tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '.version_select at 0x7f7ddb4a51f0>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:00:17.134195 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-21615a53-c378-42aa-a5c8-cade1666994e tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-174810317" status: 202 len: 0 microversion: 2.1 time: 0.137147 Oct 27 04:00:17.137700 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3122/6529] 10.222.0.20 () {58 vars in 1281 bytes} [Thu Oct 27 04:00:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-174810317 => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 04:00:17.171309 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d3046e02-928a-4b8c-949d-7263d3fb6dc9 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Action: 'create', calling method: .version_select at 0x7f7dd9649790>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-841902232", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBxMjWIqGaKJGZXAL8Ee/eIKdLBeZIU3ev+yES5IqYvxmQnhc7c/1Z4ahiYPfSasfneRVcq7toaBQHzFhcTZAncXWKFH6GSpd9p6Us3a5N+tv0aK6mNioqEwb/oKi84xdg=="}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:00:17.213655 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-d3046e02-928a-4b8c-949d-7263d3fb6dc9 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Getting quotas for project a432dda4903145278d79210121b3f77d. Resources: {'key_pairs'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 04:00:17.219978 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-d3046e02-928a-4b8c-949d-7263d3fb6dc9 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Getting quotas for user a2ea55b400c24827a28e816ea2a225aa and project a432dda4903145278d79210121b3f77d. Resources: {'key_pairs'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 04:00:17.337881 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d3046e02-928a-4b8c-949d-7263d3fb6dc9 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.170992 Oct 27 04:00:17.338841 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3408/6530] 10.222.0.20 () {60 vars in 1159 bytes} [Thu Oct 27 04:00:17 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:00:25.364289 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3252e3ce-a6e7-40ce-8d7d-58d75081db98 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-2000236575", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": [{"uuid": "06b2adf8-5003-4726-9ca3-b9cf871901a5"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1085734455", "security_groups": []}, "os:scheduler_hints": {"different_host": ["0b884037-d633-4e3d-a52e-813cc319a6e9"]}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:00:25.386181 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:00:25.462103 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-3252e3ce-a6e7-40ce-8d7d-58d75081db98 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] validate_networks() for [('06b2adf8-5003-4726-9ca3-b9cf871901a5', None, None, None, None, None)] {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 04:00:26.501083 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-3252e3ce-a6e7-40ce-8d7d-58d75081db98 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 04:00:26.502733 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-3252e3ce-a6e7-40ce-8d7d-58d75081db98 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 04:00:26.504315 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-3252e3ce-a6e7-40ce-8d7d-58d75081db98 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 04:00:26.505157 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-3252e3ce-a6e7-40ce-8d7d-58d75081db98 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 04:00:26.505792 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-3252e3ce-a6e7-40ce-8d7d-58d75081db98 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 04:00:26.518520 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3252e3ce-a6e7-40ce-8d7d-58d75081db98 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:26.520491 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3252e3ce-a6e7-40ce-8d7d-58d75081db98 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:26.521260 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3252e3ce-a6e7-40ce-8d7d-58d75081db98 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:26.523051 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3252e3ce-a6e7-40ce-8d7d-58d75081db98 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:26.523790 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3252e3ce-a6e7-40ce-8d7d-58d75081db98 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:26.524467 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3252e3ce-a6e7-40ce-8d7d-58d75081db98 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:26.571873 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-3252e3ce-a6e7-40ce-8d7d-58d75081db98 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Getting quotas for project 038d0cade5d540d399e5d237ed07419f. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 04:00:26.589358 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-3252e3ce-a6e7-40ce-8d7d-58d75081db98 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Getting quotas for user 3e7ffbb437004d379258425747bf1521 and project 038d0cade5d540d399e5d237ed07419f. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 04:00:26.606623 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-3252e3ce-a6e7-40ce-8d7d-58d75081db98 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 04:00:26.610646 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-3252e3ce-a6e7-40ce-8d7d-58d75081db98 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] [instance: 39e336a9-4b29-4a4c-b6cc-5021e79ebaef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 04:00:26.812088 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3252e3ce-a6e7-40ce-8d7d-58d75081db98 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 1.451913 Oct 27 04:00:26.816109 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3123/6531] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 04:00:25 2022] POST /compute/v2.1/servers => generated 361 bytes in 1457 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 04:00:26.824093 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=7 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:00:26.829169 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7cd0dccb-96b5-4b03-ad0c-0bf38935dce7 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:00:26.829886 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7cd0dccb-96b5-4b03-ad0c-0bf38935dce7 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] [instance: 39e336a9-4b29-4a4c-b6cc-5021e79ebaef] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:00:27.001834 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7cd0dccb-96b5-4b03-ad0c-0bf38935dce7 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7ffbb437004d379258425747bf1521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038d0cade5d540d399e5d237ed07419f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:00:27.018660 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7cd0dccb-96b5-4b03-ad0c-0bf38935dce7 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] 10.222.0.20 "GET /compute/v2.1/servers/39e336a9-4b29-4a4c-b6cc-5021e79ebaef" status: 200 len: 1242 microversion: 2.1 time: 0.194055 Oct 27 04:00:27.022120 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3409/6532] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:00:26 2022] GET /compute/v2.1/servers/39e336a9-4b29-4a4c-b6cc-5021e79ebaef => generated 1242 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:00:28.051711 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5678f4ee-bc91-4a46-afb6-3cc367d8d339 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:00:28.052343 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5678f4ee-bc91-4a46-afb6-3cc367d8d339 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] [instance: 39e336a9-4b29-4a4c-b6cc-5021e79ebaef] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:00:28.136286 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5678f4ee-bc91-4a46-afb6-3cc367d8d339 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7ffbb437004d379258425747bf1521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038d0cade5d540d399e5d237ed07419f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:00:28.144496 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5678f4ee-bc91-4a46-afb6-3cc367d8d339 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] 10.222.0.20 "GET /compute/v2.1/servers/39e336a9-4b29-4a4c-b6cc-5021e79ebaef" status: 200 len: 1242 microversion: 2.1 time: 0.099427 Oct 27 04:00:28.146396 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3124/6533] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:00:28 2022] GET /compute/v2.1/servers/39e336a9-4b29-4a4c-b6cc-5021e79ebaef => generated 1242 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:00:29.170388 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-213212a0-0bca-4e63-9eb9-5732885996d4 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:00:29.172503 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-213212a0-0bca-4e63-9eb9-5732885996d4 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] [instance: 39e336a9-4b29-4a4c-b6cc-5021e79ebaef] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:00:29.235737 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-213212a0-0bca-4e63-9eb9-5732885996d4 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:29.240726 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-213212a0-0bca-4e63-9eb9-5732885996d4 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:29.241470 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-213212a0-0bca-4e63-9eb9-5732885996d4 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:29.243172 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-213212a0-0bca-4e63-9eb9-5732885996d4 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:29.246022 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-213212a0-0bca-4e63-9eb9-5732885996d4 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:29.253372 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-213212a0-0bca-4e63-9eb9-5732885996d4 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:29.357877 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-213212a0-0bca-4e63-9eb9-5732885996d4 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7ffbb437004d379258425747bf1521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038d0cade5d540d399e5d237ed07419f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:00:29.365860 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-213212a0-0bca-4e63-9eb9-5732885996d4 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] 10.222.0.20 "GET /compute/v2.1/servers/39e336a9-4b29-4a4c-b6cc-5021e79ebaef" status: 200 len: 1294 microversion: 2.1 time: 0.201723 Oct 27 04:00:29.366861 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3410/6534] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:00:29 2022] GET /compute/v2.1/servers/39e336a9-4b29-4a4c-b6cc-5021e79ebaef => generated 1294 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:00:30.389625 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-173241a8-a07e-4338-89f0-4c475bf1235d tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:00:30.393311 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-173241a8-a07e-4338-89f0-4c475bf1235d tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] [instance: 39e336a9-4b29-4a4c-b6cc-5021e79ebaef] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:00:30.423202 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-173241a8-a07e-4338-89f0-4c475bf1235d tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:30.424460 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-173241a8-a07e-4338-89f0-4c475bf1235d tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:30.427767 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-173241a8-a07e-4338-89f0-4c475bf1235d tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:30.429968 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-173241a8-a07e-4338-89f0-4c475bf1235d tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:30.432893 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-173241a8-a07e-4338-89f0-4c475bf1235d tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:30.434801 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-173241a8-a07e-4338-89f0-4c475bf1235d tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:30.694445 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-173241a8-a07e-4338-89f0-4c475bf1235d tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7ffbb437004d379258425747bf1521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038d0cade5d540d399e5d237ed07419f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:00:30.705239 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-173241a8-a07e-4338-89f0-4c475bf1235d tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] 10.222.0.20 "GET /compute/v2.1/servers/39e336a9-4b29-4a4c-b6cc-5021e79ebaef" status: 200 len: 1312 microversion: 2.1 time: 0.319373 Oct 27 04:00:30.719297 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3125/6535] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:00:30 2022] GET /compute/v2.1/servers/39e336a9-4b29-4a4c-b6cc-5021e79ebaef => generated 1312 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:00:31.732575 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-aa4c792f-2467-4c9d-95ee-11eaf5769a31 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:00:31.733232 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-aa4c792f-2467-4c9d-95ee-11eaf5769a31 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] [instance: 39e336a9-4b29-4a4c-b6cc-5021e79ebaef] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:00:31.746167 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aa4c792f-2467-4c9d-95ee-11eaf5769a31 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:31.746167 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aa4c792f-2467-4c9d-95ee-11eaf5769a31 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:31.746167 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aa4c792f-2467-4c9d-95ee-11eaf5769a31 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:31.746167 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aa4c792f-2467-4c9d-95ee-11eaf5769a31 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:31.746167 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aa4c792f-2467-4c9d-95ee-11eaf5769a31 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:31.746167 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aa4c792f-2467-4c9d-95ee-11eaf5769a31 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:32.155721 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-aa4c792f-2467-4c9d-95ee-11eaf5769a31 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7ffbb437004d379258425747bf1521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038d0cade5d540d399e5d237ed07419f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:00:32.168733 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-aa4c792f-2467-4c9d-95ee-11eaf5769a31 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] 10.222.0.20 "GET /compute/v2.1/servers/39e336a9-4b29-4a4c-b6cc-5021e79ebaef" status: 200 len: 1300 microversion: 2.1 time: 0.441976 Oct 27 04:00:32.186805 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3411/6536] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:00:31 2022] GET /compute/v2.1/servers/39e336a9-4b29-4a4c-b6cc-5021e79ebaef => generated 1300 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:00:33.200166 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5abea0f1-3444-469e-9c94-66400a4e310d tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:00:33.200646 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5abea0f1-3444-469e-9c94-66400a4e310d tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] [instance: 39e336a9-4b29-4a4c-b6cc-5021e79ebaef] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:00:33.214630 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:00:33.216696 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5abea0f1-3444-469e-9c94-66400a4e310d tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:33.217426 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5abea0f1-3444-469e-9c94-66400a4e310d tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:33.217930 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5abea0f1-3444-469e-9c94-66400a4e310d tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:33.218868 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5abea0f1-3444-469e-9c94-66400a4e310d tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:33.220959 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5abea0f1-3444-469e-9c94-66400a4e310d tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:33.228186 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5abea0f1-3444-469e-9c94-66400a4e310d tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:33.453960 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5abea0f1-3444-469e-9c94-66400a4e310d tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7ffbb437004d379258425747bf1521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038d0cade5d540d399e5d237ed07419f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:00:33.464673 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5abea0f1-3444-469e-9c94-66400a4e310d tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] 10.222.0.20 "GET /compute/v2.1/servers/39e336a9-4b29-4a4c-b6cc-5021e79ebaef" status: 200 len: 1300 microversion: 2.1 time: 0.274310 Oct 27 04:00:33.474077 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3126/6537] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:00:33 2022] GET /compute/v2.1/servers/39e336a9-4b29-4a4c-b6cc-5021e79ebaef => generated 1300 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:00:34.494016 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-19cc6d79-a5cd-46be-a6d7-a502b353ed56 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:00:34.494722 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-19cc6d79-a5cd-46be-a6d7-a502b353ed56 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] [instance: 39e336a9-4b29-4a4c-b6cc-5021e79ebaef] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:00:34.496664 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:00:34.513512 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-19cc6d79-a5cd-46be-a6d7-a502b353ed56 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:34.518681 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-19cc6d79-a5cd-46be-a6d7-a502b353ed56 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:34.518681 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-19cc6d79-a5cd-46be-a6d7-a502b353ed56 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:34.518681 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-19cc6d79-a5cd-46be-a6d7-a502b353ed56 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:34.518681 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-19cc6d79-a5cd-46be-a6d7-a502b353ed56 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:34.518681 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-19cc6d79-a5cd-46be-a6d7-a502b353ed56 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:34.736845 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-19cc6d79-a5cd-46be-a6d7-a502b353ed56 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7ffbb437004d379258425747bf1521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038d0cade5d540d399e5d237ed07419f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:00:34.753409 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-19cc6d79-a5cd-46be-a6d7-a502b353ed56 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] 10.222.0.20 "GET /compute/v2.1/servers/39e336a9-4b29-4a4c-b6cc-5021e79ebaef" status: 200 len: 1300 microversion: 2.1 time: 0.264350 Oct 27 04:00:34.754916 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3412/6538] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:00:34 2022] GET /compute/v2.1/servers/39e336a9-4b29-4a4c-b6cc-5021e79ebaef => generated 1300 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:00:35.701499 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4be23163-b488-47dd-bf97-ea4a29a0b1dc tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-392228855", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": [{"uuid": "3856e3a4-d966-4fd7-b0a0-9f716b8c03e2"}], "key_name": "tempest-TestNetworkAdvancedServerOps-841902232", "security_groups": [{"name": "tempest-secgroup-smoke-628052568"}]}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:00:35.721506 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-923c7bf3-9891-4e35-9b95-738d881c74c9 req-770caa8f-c70a-4bd3-8bc3-b78d93677a19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39e336a9-4b29-4a4c-b6cc-5021e79ebaef", "tag": "8c53ac3b-f0f4-476c-b437-142469dd492a"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:00:35.740346 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-923c7bf3-9891-4e35-9b95-738d881c74c9 req-770caa8f-c70a-4bd3-8bc3-b78d93677a19 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:35.740981 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-923c7bf3-9891-4e35-9b95-738d881c74c9 req-770caa8f-c70a-4bd3-8bc3-b78d93677a19 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:35.741658 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-923c7bf3-9891-4e35-9b95-738d881c74c9 req-770caa8f-c70a-4bd3-8bc3-b78d93677a19 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:35.767825 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-923c7bf3-9891-4e35-9b95-738d881c74c9 req-770caa8f-c70a-4bd3-8bc3-b78d93677a19 service nova] Creating event network-changed:8c53ac3b-f0f4-476c-b437-142469dd492a for instance 39e336a9-4b29-4a4c-b6cc-5021e79ebaef on n-h1-862769-1 Oct 27 04:00:35.773516 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-923c7bf3-9891-4e35-9b95-738d881c74c9 req-770caa8f-c70a-4bd3-8bc3-b78d93677a19 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057868 Oct 27 04:00:35.778350 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3413/6539] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:00:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:00:35.785407 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7b4523fd-9743-41f1-845b-262e575d2d70 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:00:35.786427 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7b4523fd-9743-41f1-845b-262e575d2d70 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] [instance: 39e336a9-4b29-4a4c-b6cc-5021e79ebaef] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:00:35.793898 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7b4523fd-9743-41f1-845b-262e575d2d70 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:35.794855 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7b4523fd-9743-41f1-845b-262e575d2d70 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:35.795531 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7b4523fd-9743-41f1-845b-262e575d2d70 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:35.796581 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7b4523fd-9743-41f1-845b-262e575d2d70 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:35.797297 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7b4523fd-9743-41f1-845b-262e575d2d70 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:35.797966 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7b4523fd-9743-41f1-845b-262e575d2d70 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:36.030138 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7b4523fd-9743-41f1-845b-262e575d2d70 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7ffbb437004d379258425747bf1521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038d0cade5d540d399e5d237ed07419f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:00:36.042052 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-4be23163-b488-47dd-bf97-ea4a29a0b1dc tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] validate_networks() for [('3856e3a4-d966-4fd7-b0a0-9f716b8c03e2', None, None, None, None, None)] {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 04:00:36.044515 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7b4523fd-9743-41f1-845b-262e575d2d70 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] 10.222.0.20 "GET /compute/v2.1/servers/39e336a9-4b29-4a4c-b6cc-5021e79ebaef" status: 200 len: 1300 microversion: 2.1 time: 0.264668 Oct 27 04:00:36.045231 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3414/6540] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:00:35 2022] GET /compute/v2.1/servers/39e336a9-4b29-4a4c-b6cc-5021e79ebaef => generated 1300 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:00:36.541799 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:00:36.803953 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-4be23163-b488-47dd-bf97-ea4a29a0b1dc tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 04:00:36.805286 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-4be23163-b488-47dd-bf97-ea4a29a0b1dc tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 04:00:36.806958 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-4be23163-b488-47dd-bf97-ea4a29a0b1dc tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 04:00:36.808822 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-4be23163-b488-47dd-bf97-ea4a29a0b1dc tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 04:00:36.809503 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-4be23163-b488-47dd-bf97-ea4a29a0b1dc tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 04:00:36.826425 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4be23163-b488-47dd-bf97-ea4a29a0b1dc tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:36.827176 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4be23163-b488-47dd-bf97-ea4a29a0b1dc tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:36.828376 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4be23163-b488-47dd-bf97-ea4a29a0b1dc tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:36.829387 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4be23163-b488-47dd-bf97-ea4a29a0b1dc tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:36.830056 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4be23163-b488-47dd-bf97-ea4a29a0b1dc tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:36.830665 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4be23163-b488-47dd-bf97-ea4a29a0b1dc tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:36.857993 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-4be23163-b488-47dd-bf97-ea4a29a0b1dc tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Getting quotas for project a432dda4903145278d79210121b3f77d. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 04:00:36.866612 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-4be23163-b488-47dd-bf97-ea4a29a0b1dc tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Getting quotas for user a2ea55b400c24827a28e816ea2a225aa and project a432dda4903145278d79210121b3f77d. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 04:00:36.881656 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4be23163-b488-47dd-bf97-ea4a29a0b1dc tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 04:00:36.886404 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4be23163-b488-47dd-bf97-ea4a29a0b1dc tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 16fe7721-d002-42e7-b7c5-8080841127f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 04:00:37.052434 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4be23163-b488-47dd-bf97-ea4a29a0b1dc tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.355309 Oct 27 04:00:37.053397 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3127/6541] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 04:00:35 2022] POST /compute/v2.1/servers => generated 405 bytes in 1357 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 04:00:37.062991 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=6 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:00:37.068419 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-65e7b07d-ca4a-4d43-9f45-c9d714f0c571 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:00:37.069366 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-65e7b07d-ca4a-4d43-9f45-c9d714f0c571 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 16fe7721-d002-42e7-b7c5-8080841127f7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:00:37.079399 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4d33b04a-2d0a-4062-babf-d62b6a4283a5 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:00:37.082854 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4d33b04a-2d0a-4062-babf-d62b6a4283a5 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] [instance: 39e336a9-4b29-4a4c-b6cc-5021e79ebaef] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:00:37.093349 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4d33b04a-2d0a-4062-babf-d62b6a4283a5 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:37.094165 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4d33b04a-2d0a-4062-babf-d62b6a4283a5 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:37.094788 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4d33b04a-2d0a-4062-babf-d62b6a4283a5 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:37.095663 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4d33b04a-2d0a-4062-babf-d62b6a4283a5 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:37.096737 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4d33b04a-2d0a-4062-babf-d62b6a4283a5 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:37.097588 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4d33b04a-2d0a-4062-babf-d62b6a4283a5 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:37.180535 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-65e7b07d-ca4a-4d43-9f45-c9d714f0c571 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:00:37.188005 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-65e7b07d-ca4a-4d43-9f45-c9d714f0c571 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/16fe7721-d002-42e7-b7c5-8080841127f7" status: 200 len: 1265 microversion: 2.1 time: 0.126750 Oct 27 04:00:37.188878 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3415/6542] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:00:37 2022] GET /compute/v2.1/servers/16fe7721-d002-42e7-b7c5-8080841127f7 => generated 1265 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:00:37.273820 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4d33b04a-2d0a-4062-babf-d62b6a4283a5 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7ffbb437004d379258425747bf1521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038d0cade5d540d399e5d237ed07419f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:00:37.287130 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4d33b04a-2d0a-4062-babf-d62b6a4283a5 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] 10.222.0.20 "GET /compute/v2.1/servers/39e336a9-4b29-4a4c-b6cc-5021e79ebaef" status: 200 len: 1300 microversion: 2.1 time: 0.222665 Oct 27 04:00:37.303512 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3128/6543] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:00:37 2022] GET /compute/v2.1/servers/39e336a9-4b29-4a4c-b6cc-5021e79ebaef => generated 1300 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 04:00:38.215105 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-635b3a93-bc30-4255-8cc8-c72ef28d294e tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:00:38.216435 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-635b3a93-bc30-4255-8cc8-c72ef28d294e tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 16fe7721-d002-42e7-b7c5-8080841127f7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:00:38.223859 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-635b3a93-bc30-4255-8cc8-c72ef28d294e tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:38.224631 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-635b3a93-bc30-4255-8cc8-c72ef28d294e tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:38.225413 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-635b3a93-bc30-4255-8cc8-c72ef28d294e tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:38.225788 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-635b3a93-bc30-4255-8cc8-c72ef28d294e tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:38.226520 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-635b3a93-bc30-4255-8cc8-c72ef28d294e tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:38.226962 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-635b3a93-bc30-4255-8cc8-c72ef28d294e tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:38.298934 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-635b3a93-bc30-4255-8cc8-c72ef28d294e tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:00:38.315358 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0ebe2c50-6240-41f4-a264-f7f192aa0173 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:00:38.316722 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0ebe2c50-6240-41f4-a264-f7f192aa0173 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] [instance: 39e336a9-4b29-4a4c-b6cc-5021e79ebaef] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:00:38.324673 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-635b3a93-bc30-4255-8cc8-c72ef28d294e tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/16fe7721-d002-42e7-b7c5-8080841127f7" status: 200 len: 1269 microversion: 2.1 time: 0.114361 Oct 27 04:00:38.332609 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3416/6544] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:00:38 2022] GET /compute/v2.1/servers/16fe7721-d002-42e7-b7c5-8080841127f7 => generated 1269 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:00:38.349674 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0ebe2c50-6240-41f4-a264-f7f192aa0173 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:38.350566 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0ebe2c50-6240-41f4-a264-f7f192aa0173 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:38.351195 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0ebe2c50-6240-41f4-a264-f7f192aa0173 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:38.352192 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0ebe2c50-6240-41f4-a264-f7f192aa0173 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:38.353090 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0ebe2c50-6240-41f4-a264-f7f192aa0173 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:38.353821 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0ebe2c50-6240-41f4-a264-f7f192aa0173 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:38.523026 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0ebe2c50-6240-41f4-a264-f7f192aa0173 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7ffbb437004d379258425747bf1521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038d0cade5d540d399e5d237ed07419f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:00:38.534354 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0ebe2c50-6240-41f4-a264-f7f192aa0173 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] 10.222.0.20 "GET /compute/v2.1/servers/39e336a9-4b29-4a4c-b6cc-5021e79ebaef" status: 200 len: 1300 microversion: 2.1 time: 0.223728 Oct 27 04:00:38.553104 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3129/6545] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:00:38 2022] GET /compute/v2.1/servers/39e336a9-4b29-4a4c-b6cc-5021e79ebaef => generated 1300 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:00:39.358509 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c1da4378-48a6-42b4-a73c-6ec92a794837 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:00:39.362759 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c1da4378-48a6-42b4-a73c-6ec92a794837 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 16fe7721-d002-42e7-b7c5-8080841127f7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:00:39.368462 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c1da4378-48a6-42b4-a73c-6ec92a794837 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:39.369203 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c1da4378-48a6-42b4-a73c-6ec92a794837 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:39.370210 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c1da4378-48a6-42b4-a73c-6ec92a794837 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:39.371158 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c1da4378-48a6-42b4-a73c-6ec92a794837 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:39.371988 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c1da4378-48a6-42b4-a73c-6ec92a794837 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:39.372629 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c1da4378-48a6-42b4-a73c-6ec92a794837 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:39.471238 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c1da4378-48a6-42b4-a73c-6ec92a794837 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:00:39.481491 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c1da4378-48a6-42b4-a73c-6ec92a794837 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/16fe7721-d002-42e7-b7c5-8080841127f7" status: 200 len: 1325 microversion: 2.1 time: 0.128485 Oct 27 04:00:39.482549 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3417/6546] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:00:39 2022] GET /compute/v2.1/servers/16fe7721-d002-42e7-b7c5-8080841127f7 => generated 1325 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 04:00:39.565415 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ab70a89f-25a7-4559-9483-f199ac3022e1 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:00:39.566862 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ab70a89f-25a7-4559-9483-f199ac3022e1 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] [instance: 39e336a9-4b29-4a4c-b6cc-5021e79ebaef] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:00:39.580799 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ab70a89f-25a7-4559-9483-f199ac3022e1 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:39.581326 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ab70a89f-25a7-4559-9483-f199ac3022e1 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:39.582436 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ab70a89f-25a7-4559-9483-f199ac3022e1 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:39.583204 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ab70a89f-25a7-4559-9483-f199ac3022e1 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:39.583697 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ab70a89f-25a7-4559-9483-f199ac3022e1 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:39.585508 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ab70a89f-25a7-4559-9483-f199ac3022e1 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:39.714131 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ab70a89f-25a7-4559-9483-f199ac3022e1 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7ffbb437004d379258425747bf1521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038d0cade5d540d399e5d237ed07419f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:00:39.725048 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ab70a89f-25a7-4559-9483-f199ac3022e1 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] 10.222.0.20 "GET /compute/v2.1/servers/39e336a9-4b29-4a4c-b6cc-5021e79ebaef" status: 200 len: 1300 microversion: 2.1 time: 0.169584 Oct 27 04:00:39.725653 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3130/6547] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:00:39 2022] GET /compute/v2.1/servers/39e336a9-4b29-4a4c-b6cc-5021e79ebaef => generated 1300 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:00:40.505357 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3f40029b-be83-4ae4-adae-d712f2bff680 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:00:40.506781 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3f40029b-be83-4ae4-adae-d712f2bff680 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 16fe7721-d002-42e7-b7c5-8080841127f7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:00:40.520081 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3f40029b-be83-4ae4-adae-d712f2bff680 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:40.520710 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3f40029b-be83-4ae4-adae-d712f2bff680 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:40.523210 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3f40029b-be83-4ae4-adae-d712f2bff680 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:40.524072 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3f40029b-be83-4ae4-adae-d712f2bff680 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:40.524560 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3f40029b-be83-4ae4-adae-d712f2bff680 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:40.525016 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3f40029b-be83-4ae4-adae-d712f2bff680 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:40.722664 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3f40029b-be83-4ae4-adae-d712f2bff680 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:00:40.737770 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3f40029b-be83-4ae4-adae-d712f2bff680 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/16fe7721-d002-42e7-b7c5-8080841127f7" status: 200 len: 1390 microversion: 2.1 time: 0.233003 Oct 27 04:00:40.737770 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3418/6548] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:00:40 2022] GET /compute/v2.1/servers/16fe7721-d002-42e7-b7c5-8080841127f7 => generated 1390 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:00:40.751482 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d6aec40f-203a-4665-a5c9-efecfc234d86 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:00:40.752199 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d6aec40f-203a-4665-a5c9-efecfc234d86 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] [instance: 39e336a9-4b29-4a4c-b6cc-5021e79ebaef] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:00:40.767083 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d6aec40f-203a-4665-a5c9-efecfc234d86 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:40.768037 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d6aec40f-203a-4665-a5c9-efecfc234d86 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:40.768037 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d6aec40f-203a-4665-a5c9-efecfc234d86 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:40.777613 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d6aec40f-203a-4665-a5c9-efecfc234d86 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:40.778504 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d6aec40f-203a-4665-a5c9-efecfc234d86 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:40.779262 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d6aec40f-203a-4665-a5c9-efecfc234d86 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:40.939740 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d6aec40f-203a-4665-a5c9-efecfc234d86 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7ffbb437004d379258425747bf1521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038d0cade5d540d399e5d237ed07419f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:00:40.950937 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d6aec40f-203a-4665-a5c9-efecfc234d86 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] 10.222.0.20 "GET /compute/v2.1/servers/39e336a9-4b29-4a4c-b6cc-5021e79ebaef" status: 200 len: 1300 microversion: 2.1 time: 0.206053 Oct 27 04:00:40.951643 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3131/6549] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:00:40 2022] GET /compute/v2.1/servers/39e336a9-4b29-4a4c-b6cc-5021e79ebaef => generated 1300 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:00:41.761542 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a179bffe-6e17-4fb8-99c4-051cc588b4e6 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:00:41.762633 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a179bffe-6e17-4fb8-99c4-051cc588b4e6 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 16fe7721-d002-42e7-b7c5-8080841127f7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:00:41.770904 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a179bffe-6e17-4fb8-99c4-051cc588b4e6 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:41.771407 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a179bffe-6e17-4fb8-99c4-051cc588b4e6 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:41.771861 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a179bffe-6e17-4fb8-99c4-051cc588b4e6 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:41.772895 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a179bffe-6e17-4fb8-99c4-051cc588b4e6 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:41.773540 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a179bffe-6e17-4fb8-99c4-051cc588b4e6 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:41.773993 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a179bffe-6e17-4fb8-99c4-051cc588b4e6 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:41.975335 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-70c9909b-fbb4-4787-aa62-9a4777a3bc2e tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:00:41.976312 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-70c9909b-fbb4-4787-aa62-9a4777a3bc2e tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] [instance: 39e336a9-4b29-4a4c-b6cc-5021e79ebaef] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:00:41.988904 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-70c9909b-fbb4-4787-aa62-9a4777a3bc2e tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:41.989995 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-70c9909b-fbb4-4787-aa62-9a4777a3bc2e tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:41.990663 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-70c9909b-fbb4-4787-aa62-9a4777a3bc2e tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:41.991695 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-70c9909b-fbb4-4787-aa62-9a4777a3bc2e tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:41.992423 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-70c9909b-fbb4-4787-aa62-9a4777a3bc2e tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:41.993062 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-70c9909b-fbb4-4787-aa62-9a4777a3bc2e tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:42.079382 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-70c9909b-fbb4-4787-aa62-9a4777a3bc2e tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7ffbb437004d379258425747bf1521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038d0cade5d540d399e5d237ed07419f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:00:42.088716 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-70c9909b-fbb4-4787-aa62-9a4777a3bc2e tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] 10.222.0.20 "GET /compute/v2.1/servers/39e336a9-4b29-4a4c-b6cc-5021e79ebaef" status: 200 len: 1300 microversion: 2.1 time: 0.118406 Oct 27 04:00:42.089882 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3132/6550] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:00:41 2022] GET /compute/v2.1/servers/39e336a9-4b29-4a4c-b6cc-5021e79ebaef => generated 1300 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 04:00:42.285470 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a179bffe-6e17-4fb8-99c4-051cc588b4e6 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:00:42.294252 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a179bffe-6e17-4fb8-99c4-051cc588b4e6 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/16fe7721-d002-42e7-b7c5-8080841127f7" status: 200 len: 1390 microversion: 2.1 time: 0.537061 Oct 27 04:00:42.311639 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3419/6551] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:00:41 2022] GET /compute/v2.1/servers/16fe7721-d002-42e7-b7c5-8080841127f7 => generated 1390 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:00:42.544943 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-06e80326-d2c9-41f7-972b-b5de3af19c6a req-65831dff-4bdd-483c-be31-0eaafb055053 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16fe7721-d002-42e7-b7c5-8080841127f7", "tag": "20903b19-c0a8-472f-8a32-42afa7526441"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:00:42.556104 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-06e80326-d2c9-41f7-972b-b5de3af19c6a req-65831dff-4bdd-483c-be31-0eaafb055053 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:42.556838 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-06e80326-d2c9-41f7-972b-b5de3af19c6a req-65831dff-4bdd-483c-be31-0eaafb055053 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:42.557281 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-06e80326-d2c9-41f7-972b-b5de3af19c6a req-65831dff-4bdd-483c-be31-0eaafb055053 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:42.569868 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-06e80326-d2c9-41f7-972b-b5de3af19c6a req-65831dff-4bdd-483c-be31-0eaafb055053 service nova] Creating event network-changed:20903b19-c0a8-472f-8a32-42afa7526441 for instance 16fe7721-d002-42e7-b7c5-8080841127f7 on n-h2-862769-1 Oct 27 04:00:42.574975 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-06e80326-d2c9-41f7-972b-b5de3af19c6a req-65831dff-4bdd-483c-be31-0eaafb055053 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033731 Oct 27 04:00:42.575590 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3133/6552] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:00:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:00:42.875077 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-2702e0c2-e81a-483b-b21b-528bcda57012 req-11c9710e-45a8-40c3-8c4c-545964cbeea8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39e336a9-4b29-4a4c-b6cc-5021e79ebaef", "name": "network-vif-plugged", "status": "completed", "tag": "8c53ac3b-f0f4-476c-b437-142469dd492a"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:00:42.886051 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-2702e0c2-e81a-483b-b21b-528bcda57012 req-11c9710e-45a8-40c3-8c4c-545964cbeea8 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:42.886949 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-2702e0c2-e81a-483b-b21b-528bcda57012 req-11c9710e-45a8-40c3-8c4c-545964cbeea8 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:42.887454 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-2702e0c2-e81a-483b-b21b-528bcda57012 req-11c9710e-45a8-40c3-8c4c-545964cbeea8 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:42.899722 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-2702e0c2-e81a-483b-b21b-528bcda57012 req-11c9710e-45a8-40c3-8c4c-545964cbeea8 service nova] Creating event network-vif-plugged:8c53ac3b-f0f4-476c-b437-142469dd492a for instance 39e336a9-4b29-4a4c-b6cc-5021e79ebaef on n-h1-862769-1 Oct 27 04:00:42.904902 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-2702e0c2-e81a-483b-b21b-528bcda57012 req-11c9710e-45a8-40c3-8c4c-545964cbeea8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033597 Oct 27 04:00:42.905501 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3420/6553] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:00:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:00:43.114425 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3d90f170-d47d-48c9-bf81-67731dcaaf0c tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:00:43.115507 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-3d90f170-d47d-48c9-bf81-67731dcaaf0c tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] [instance: 39e336a9-4b29-4a4c-b6cc-5021e79ebaef] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:00:43.121984 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3d90f170-d47d-48c9-bf81-67731dcaaf0c tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:43.122627 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3d90f170-d47d-48c9-bf81-67731dcaaf0c tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:43.123068 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3d90f170-d47d-48c9-bf81-67731dcaaf0c tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:43.124043 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3d90f170-d47d-48c9-bf81-67731dcaaf0c tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:43.124230 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3d90f170-d47d-48c9-bf81-67731dcaaf0c tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:43.124660 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3d90f170-d47d-48c9-bf81-67731dcaaf0c tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:43.214017 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-3d90f170-d47d-48c9-bf81-67731dcaaf0c tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7ffbb437004d379258425747bf1521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038d0cade5d540d399e5d237ed07419f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:00:43.221972 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3d90f170-d47d-48c9-bf81-67731dcaaf0c tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] 10.222.0.20 "GET /compute/v2.1/servers/39e336a9-4b29-4a4c-b6cc-5021e79ebaef" status: 200 len: 1300 microversion: 2.1 time: 0.113343 Oct 27 04:00:43.223622 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3134/6554] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:00:43 2022] GET /compute/v2.1/servers/39e336a9-4b29-4a4c-b6cc-5021e79ebaef => generated 1300 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:00:43.320227 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3877fe73-3277-4e8c-9c8f-c9a42a732fb1 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:00:43.321012 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3877fe73-3277-4e8c-9c8f-c9a42a732fb1 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 16fe7721-d002-42e7-b7c5-8080841127f7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:00:43.327299 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3877fe73-3277-4e8c-9c8f-c9a42a732fb1 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:43.327923 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3877fe73-3277-4e8c-9c8f-c9a42a732fb1 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:43.332594 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3877fe73-3277-4e8c-9c8f-c9a42a732fb1 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:43.332594 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3877fe73-3277-4e8c-9c8f-c9a42a732fb1 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:43.332594 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3877fe73-3277-4e8c-9c8f-c9a42a732fb1 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:43.332594 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3877fe73-3277-4e8c-9c8f-c9a42a732fb1 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:43.641285 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3877fe73-3277-4e8c-9c8f-c9a42a732fb1 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:00:43.669638 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3877fe73-3277-4e8c-9c8f-c9a42a732fb1 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/16fe7721-d002-42e7-b7c5-8080841127f7" status: 200 len: 1390 microversion: 2.1 time: 0.354747 Oct 27 04:00:43.688293 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3421/6555] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:00:43 2022] GET /compute/v2.1/servers/16fe7721-d002-42e7-b7c5-8080841127f7 => generated 1390 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:00:44.253250 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0248794d-8c15-4306-a077-b312952ad87f tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:00:44.253822 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0248794d-8c15-4306-a077-b312952ad87f tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] [instance: 39e336a9-4b29-4a4c-b6cc-5021e79ebaef] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:00:44.265212 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0248794d-8c15-4306-a077-b312952ad87f tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:44.265718 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0248794d-8c15-4306-a077-b312952ad87f tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:44.266228 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0248794d-8c15-4306-a077-b312952ad87f tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:44.266953 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0248794d-8c15-4306-a077-b312952ad87f tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:44.267401 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0248794d-8c15-4306-a077-b312952ad87f tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:44.267836 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0248794d-8c15-4306-a077-b312952ad87f tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:44.368073 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0248794d-8c15-4306-a077-b312952ad87f tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7ffbb437004d379258425747bf1521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038d0cade5d540d399e5d237ed07419f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:00:44.376053 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0248794d-8c15-4306-a077-b312952ad87f tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] 10.222.0.20 "GET /compute/v2.1/servers/39e336a9-4b29-4a4c-b6cc-5021e79ebaef" status: 200 len: 1300 microversion: 2.1 time: 0.126842 Oct 27 04:00:44.376717 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3135/6556] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:00:44 2022] GET /compute/v2.1/servers/39e336a9-4b29-4a4c-b6cc-5021e79ebaef => generated 1300 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 04:00:44.696207 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1f769bd3-1d6e-4e2b-8de8-1368c6c97102 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:00:44.697715 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1f769bd3-1d6e-4e2b-8de8-1368c6c97102 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 16fe7721-d002-42e7-b7c5-8080841127f7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:00:44.706451 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1f769bd3-1d6e-4e2b-8de8-1368c6c97102 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:44.707154 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1f769bd3-1d6e-4e2b-8de8-1368c6c97102 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:44.709816 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1f769bd3-1d6e-4e2b-8de8-1368c6c97102 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:44.711171 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1f769bd3-1d6e-4e2b-8de8-1368c6c97102 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:44.713985 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1f769bd3-1d6e-4e2b-8de8-1368c6c97102 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:44.714659 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1f769bd3-1d6e-4e2b-8de8-1368c6c97102 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:44.905496 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1f769bd3-1d6e-4e2b-8de8-1368c6c97102 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:00:44.914078 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1f769bd3-1d6e-4e2b-8de8-1368c6c97102 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/16fe7721-d002-42e7-b7c5-8080841127f7" status: 200 len: 1390 microversion: 2.1 time: 0.222611 Oct 27 04:00:44.914783 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3422/6557] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:00:44 2022] GET /compute/v2.1/servers/16fe7721-d002-42e7-b7c5-8080841127f7 => generated 1390 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:00:45.399249 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f3996803-107a-498e-a403-ee24f30e4738 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:00:45.399879 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f3996803-107a-498e-a403-ee24f30e4738 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] [instance: 39e336a9-4b29-4a4c-b6cc-5021e79ebaef] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:00:45.407855 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f3996803-107a-498e-a403-ee24f30e4738 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:45.408575 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f3996803-107a-498e-a403-ee24f30e4738 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:45.409184 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f3996803-107a-498e-a403-ee24f30e4738 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:45.410646 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f3996803-107a-498e-a403-ee24f30e4738 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:45.411275 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f3996803-107a-498e-a403-ee24f30e4738 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:45.411876 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f3996803-107a-498e-a403-ee24f30e4738 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:45.543360 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f3996803-107a-498e-a403-ee24f30e4738 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7ffbb437004d379258425747bf1521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038d0cade5d540d399e5d237ed07419f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:00:45.553447 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f3996803-107a-498e-a403-ee24f30e4738 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] 10.222.0.20 "GET /compute/v2.1/servers/39e336a9-4b29-4a4c-b6cc-5021e79ebaef" status: 200 len: 1472 microversion: 2.1 time: 0.156238 Oct 27 04:00:45.553447 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3136/6558] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:00:45 2022] GET /compute/v2.1/servers/39e336a9-4b29-4a4c-b6cc-5021e79ebaef => generated 1472 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:00:45.578888 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-479e1b18-e4a7-4552-aa69-1ddffd366483 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:00:45.583124 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-479e1b18-e4a7-4552-aa69-1ddffd366483 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] [instance: 39e336a9-4b29-4a4c-b6cc-5021e79ebaef] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:00:45.588661 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-479e1b18-e4a7-4552-aa69-1ddffd366483 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:45.589478 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-479e1b18-e4a7-4552-aa69-1ddffd366483 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:45.590134 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-479e1b18-e4a7-4552-aa69-1ddffd366483 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:45.591058 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-479e1b18-e4a7-4552-aa69-1ddffd366483 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:45.591672 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-479e1b18-e4a7-4552-aa69-1ddffd366483 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:45.592281 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-479e1b18-e4a7-4552-aa69-1ddffd366483 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:45.685111 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-479e1b18-e4a7-4552-aa69-1ddffd366483 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7ffbb437004d379258425747bf1521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038d0cade5d540d399e5d237ed07419f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:00:45.695875 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-479e1b18-e4a7-4552-aa69-1ddffd366483 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] 10.222.0.20 "GET /compute/v2.1/servers/39e336a9-4b29-4a4c-b6cc-5021e79ebaef" status: 200 len: 1472 microversion: 2.1 time: 0.124888 Oct 27 04:00:45.697150 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3423/6559] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:00:45 2022] GET /compute/v2.1/servers/39e336a9-4b29-4a4c-b6cc-5021e79ebaef => generated 1472 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:00:45.718642 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c59ed251-71d3-4ec6-a844-705148f6b2d7 tempest-TestSecurityGroupsBasicOps-962471415 tempest-TestSecurityGroupsBasicOps-962471415-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:00:45.719393 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c59ed251-71d3-4ec6-a844-705148f6b2d7 tempest-TestSecurityGroupsBasicOps-962471415 tempest-TestSecurityGroupsBasicOps-962471415-project-admin] [instance: 39e336a9-4b29-4a4c-b6cc-5021e79ebaef] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:00:45.726647 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c59ed251-71d3-4ec6-a844-705148f6b2d7 tempest-TestSecurityGroupsBasicOps-962471415 tempest-TestSecurityGroupsBasicOps-962471415-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:45.727292 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c59ed251-71d3-4ec6-a844-705148f6b2d7 tempest-TestSecurityGroupsBasicOps-962471415 tempest-TestSecurityGroupsBasicOps-962471415-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:45.727846 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c59ed251-71d3-4ec6-a844-705148f6b2d7 tempest-TestSecurityGroupsBasicOps-962471415 tempest-TestSecurityGroupsBasicOps-962471415-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:45.728644 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c59ed251-71d3-4ec6-a844-705148f6b2d7 tempest-TestSecurityGroupsBasicOps-962471415 tempest-TestSecurityGroupsBasicOps-962471415-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:45.729168 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c59ed251-71d3-4ec6-a844-705148f6b2d7 tempest-TestSecurityGroupsBasicOps-962471415 tempest-TestSecurityGroupsBasicOps-962471415-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:45.730403 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c59ed251-71d3-4ec6-a844-705148f6b2d7 tempest-TestSecurityGroupsBasicOps-962471415 tempest-TestSecurityGroupsBasicOps-962471415-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:45.856319 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c59ed251-71d3-4ec6-a844-705148f6b2d7 tempest-TestSecurityGroupsBasicOps-962471415 tempest-TestSecurityGroupsBasicOps-962471415-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/39e336a9-4b29-4a4c-b6cc-5021e79ebaef" status: 200 len: 1623 microversion: 2.1 time: 0.141526 Oct 27 04:00:45.856889 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3137/6560] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:00:45 2022] GET /compute/v2.1/servers/39e336a9-4b29-4a4c-b6cc-5021e79ebaef => generated 1623 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:00:45.879796 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a6952923-8ee5-4589-8e13-34fce4ffb424 tempest-TestSecurityGroupsBasicOps-962471415 tempest-TestSecurityGroupsBasicOps-962471415-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:00:45.880507 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a6952923-8ee5-4589-8e13-34fce4ffb424 tempest-TestSecurityGroupsBasicOps-962471415 tempest-TestSecurityGroupsBasicOps-962471415-project-admin] [instance: 0b884037-d633-4e3d-a52e-813cc319a6e9] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:00:45.897774 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a6952923-8ee5-4589-8e13-34fce4ffb424 tempest-TestSecurityGroupsBasicOps-962471415 tempest-TestSecurityGroupsBasicOps-962471415-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:45.898808 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a6952923-8ee5-4589-8e13-34fce4ffb424 tempest-TestSecurityGroupsBasicOps-962471415 tempest-TestSecurityGroupsBasicOps-962471415-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:45.899263 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a6952923-8ee5-4589-8e13-34fce4ffb424 tempest-TestSecurityGroupsBasicOps-962471415 tempest-TestSecurityGroupsBasicOps-962471415-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:45.901113 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a6952923-8ee5-4589-8e13-34fce4ffb424 tempest-TestSecurityGroupsBasicOps-962471415 tempest-TestSecurityGroupsBasicOps-962471415-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:45.901596 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a6952923-8ee5-4589-8e13-34fce4ffb424 tempest-TestSecurityGroupsBasicOps-962471415 tempest-TestSecurityGroupsBasicOps-962471415-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:45.902267 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a6952923-8ee5-4589-8e13-34fce4ffb424 tempest-TestSecurityGroupsBasicOps-962471415 tempest-TestSecurityGroupsBasicOps-962471415-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:45.938008 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-227d3a8d-2154-40f1-96f7-9c9e4d827f5e tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:00:45.938660 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-227d3a8d-2154-40f1-96f7-9c9e4d827f5e tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 16fe7721-d002-42e7-b7c5-8080841127f7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:00:45.947889 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-227d3a8d-2154-40f1-96f7-9c9e4d827f5e tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:45.948803 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-227d3a8d-2154-40f1-96f7-9c9e4d827f5e tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:45.949593 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-227d3a8d-2154-40f1-96f7-9c9e4d827f5e tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:45.950733 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-227d3a8d-2154-40f1-96f7-9c9e4d827f5e tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:45.951514 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-227d3a8d-2154-40f1-96f7-9c9e4d827f5e tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:45.952119 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-227d3a8d-2154-40f1-96f7-9c9e4d827f5e tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:46.068955 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a6952923-8ee5-4589-8e13-34fce4ffb424 tempest-TestSecurityGroupsBasicOps-962471415 tempest-TestSecurityGroupsBasicOps-962471415-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/0b884037-d633-4e3d-a52e-813cc319a6e9" status: 200 len: 1912 microversion: 2.1 time: 0.193408 Oct 27 04:00:46.069882 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3424/6561] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:00:45 2022] GET /compute/v2.1/servers/0b884037-d633-4e3d-a52e-813cc319a6e9 => generated 1912 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:00:46.146354 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3ae2caa7-64f8-4d2b-ac91-8869ca496c03 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:00:46.146875 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3ae2caa7-64f8-4d2b-ac91-8869ca496c03 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] [instance: 39e336a9-4b29-4a4c-b6cc-5021e79ebaef] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:00:46.155906 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3ae2caa7-64f8-4d2b-ac91-8869ca496c03 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:46.159508 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3ae2caa7-64f8-4d2b-ac91-8869ca496c03 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:46.159508 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3ae2caa7-64f8-4d2b-ac91-8869ca496c03 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:46.159508 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3ae2caa7-64f8-4d2b-ac91-8869ca496c03 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:46.159508 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3ae2caa7-64f8-4d2b-ac91-8869ca496c03 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:46.159508 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3ae2caa7-64f8-4d2b-ac91-8869ca496c03 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:46.205061 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3ae2caa7-64f8-4d2b-ac91-8869ca496c03 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] [instance: 39e336a9-4b29-4a4c-b6cc-5021e79ebaef] Going to try to terminate instance {{(pid=121001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 04:00:46.217975 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-227d3a8d-2154-40f1-96f7-9c9e4d827f5e tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:00:46.226274 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-227d3a8d-2154-40f1-96f7-9c9e4d827f5e tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/16fe7721-d002-42e7-b7c5-8080841127f7" status: 200 len: 1390 microversion: 2.1 time: 0.292294 Oct 27 04:00:46.227231 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3138/6562] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:00:45 2022] GET /compute/v2.1/servers/16fe7721-d002-42e7-b7c5-8080841127f7 => generated 1390 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:00:46.791380 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3ae2caa7-64f8-4d2b-ac91-8869ca496c03 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] 10.222.0.20 "DELETE /compute/v2.1/servers/39e336a9-4b29-4a4c-b6cc-5021e79ebaef" status: 204 len: 0 microversion: 2.1 time: 0.645469 Oct 27 04:00:46.791380 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3425/6563] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 04:00:46 2022] DELETE /compute/v2.1/servers/39e336a9-4b29-4a4c-b6cc-5021e79ebaef => generated 0 bytes in 648 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 04:00:46.797216 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-83f675dc-7a51-499b-a924-7d160585828b tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:00:46.797846 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-83f675dc-7a51-499b-a924-7d160585828b tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] [instance: 39e336a9-4b29-4a4c-b6cc-5021e79ebaef] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:00:46.805713 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-83f675dc-7a51-499b-a924-7d160585828b tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:46.806258 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-83f675dc-7a51-499b-a924-7d160585828b tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:46.806819 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-83f675dc-7a51-499b-a924-7d160585828b tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:46.807480 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-83f675dc-7a51-499b-a924-7d160585828b tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:46.807942 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-83f675dc-7a51-499b-a924-7d160585828b tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:46.808375 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-83f675dc-7a51-499b-a924-7d160585828b tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:46.853172 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:00:46.878440 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=14 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:00:47.254544 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-218da9c0-b107-45d9-896e-f7b4838d9460 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:00:47.255687 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-218da9c0-b107-45d9-896e-f7b4838d9460 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 16fe7721-d002-42e7-b7c5-8080841127f7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:00:47.266870 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-218da9c0-b107-45d9-896e-f7b4838d9460 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:47.267644 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-218da9c0-b107-45d9-896e-f7b4838d9460 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:47.268255 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-218da9c0-b107-45d9-896e-f7b4838d9460 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:47.269875 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-218da9c0-b107-45d9-896e-f7b4838d9460 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:47.271096 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-218da9c0-b107-45d9-896e-f7b4838d9460 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:47.271538 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-218da9c0-b107-45d9-896e-f7b4838d9460 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:47.293602 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-83f675dc-7a51-499b-a924-7d160585828b tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7ffbb437004d379258425747bf1521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038d0cade5d540d399e5d237ed07419f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:00:47.301798 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-83f675dc-7a51-499b-a924-7d160585828b tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] 10.222.0.20 "GET /compute/v2.1/servers/39e336a9-4b29-4a4c-b6cc-5021e79ebaef" status: 200 len: 1478 microversion: 2.1 time: 0.508772 Oct 27 04:00:47.303095 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3139/6564] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:00:46 2022] GET /compute/v2.1/servers/39e336a9-4b29-4a4c-b6cc-5021e79ebaef => generated 1478 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:00:47.499950 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-218da9c0-b107-45d9-896e-f7b4838d9460 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:00:47.512148 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-218da9c0-b107-45d9-896e-f7b4838d9460 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/16fe7721-d002-42e7-b7c5-8080841127f7" status: 200 len: 1390 microversion: 2.1 time: 0.264179 Oct 27 04:00:47.512787 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3426/6565] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:00:47 2022] GET /compute/v2.1/servers/16fe7721-d002-42e7-b7c5-8080841127f7 => generated 1390 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:00:48.331390 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-92cb5194-4994-4cec-b7ec-7e3180f079d2 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:00:48.332047 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-92cb5194-4994-4cec-b7ec-7e3180f079d2 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] [instance: 39e336a9-4b29-4a4c-b6cc-5021e79ebaef] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:00:48.348510 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-92cb5194-4994-4cec-b7ec-7e3180f079d2 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:48.349208 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-92cb5194-4994-4cec-b7ec-7e3180f079d2 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:48.349965 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-92cb5194-4994-4cec-b7ec-7e3180f079d2 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:48.355966 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-92cb5194-4994-4cec-b7ec-7e3180f079d2 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:48.356614 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-92cb5194-4994-4cec-b7ec-7e3180f079d2 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:48.357226 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-92cb5194-4994-4cec-b7ec-7e3180f079d2 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:48.540798 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8e074202-696e-46db-8584-6a5a3e4231c7 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:00:48.541398 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8e074202-696e-46db-8584-6a5a3e4231c7 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 16fe7721-d002-42e7-b7c5-8080841127f7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:00:48.543906 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:00:48.554730 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8e074202-696e-46db-8584-6a5a3e4231c7 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:48.556297 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8e074202-696e-46db-8584-6a5a3e4231c7 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:48.564303 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8e074202-696e-46db-8584-6a5a3e4231c7 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:48.564303 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8e074202-696e-46db-8584-6a5a3e4231c7 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:48.564303 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8e074202-696e-46db-8584-6a5a3e4231c7 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:48.564303 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8e074202-696e-46db-8584-6a5a3e4231c7 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:48.591774 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:00:48.652083 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-92cb5194-4994-4cec-b7ec-7e3180f079d2 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7ffbb437004d379258425747bf1521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038d0cade5d540d399e5d237ed07419f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:00:48.662814 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-92cb5194-4994-4cec-b7ec-7e3180f079d2 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] 10.222.0.20 "GET /compute/v2.1/servers/39e336a9-4b29-4a4c-b6cc-5021e79ebaef" status: 200 len: 1478 microversion: 2.1 time: 0.337314 Oct 27 04:00:48.663748 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3140/6566] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:00:48 2022] GET /compute/v2.1/servers/39e336a9-4b29-4a4c-b6cc-5021e79ebaef => generated 1478 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:00:48.712105 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-e7237df2-ae90-42dd-a376-38289679329a req-3f7a5b8b-976a-4d53-af65-64f48f898e2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16fe7721-d002-42e7-b7c5-8080841127f7", "name": "network-vif-plugged", "status": "completed", "tag": "20903b19-c0a8-472f-8a32-42afa7526441"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:00:48.731751 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-e7237df2-ae90-42dd-a376-38289679329a req-3f7a5b8b-976a-4d53-af65-64f48f898e2f service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:48.732351 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-e7237df2-ae90-42dd-a376-38289679329a req-3f7a5b8b-976a-4d53-af65-64f48f898e2f service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:48.732879 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-e7237df2-ae90-42dd-a376-38289679329a req-3f7a5b8b-976a-4d53-af65-64f48f898e2f service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:48.752103 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-e7237df2-ae90-42dd-a376-38289679329a req-3f7a5b8b-976a-4d53-af65-64f48f898e2f service nova] Creating event network-vif-plugged:20903b19-c0a8-472f-8a32-42afa7526441 for instance 16fe7721-d002-42e7-b7c5-8080841127f7 on n-h2-862769-1 Oct 27 04:00:48.771813 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-e7237df2-ae90-42dd-a376-38289679329a req-3f7a5b8b-976a-4d53-af65-64f48f898e2f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063499 Oct 27 04:00:48.776605 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3141/6567] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:00:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 04:00:48.793574 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8e074202-696e-46db-8584-6a5a3e4231c7 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:00:48.810843 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8e074202-696e-46db-8584-6a5a3e4231c7 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/16fe7721-d002-42e7-b7c5-8080841127f7" status: 200 len: 1390 microversion: 2.1 time: 0.275338 Oct 27 04:00:48.838604 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3427/6568] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:00:48 2022] GET /compute/v2.1/servers/16fe7721-d002-42e7-b7c5-8080841127f7 => generated 1390 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 04:00:49.119165 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-00374282-2c59-4117-a15b-2ede22846ecb req-6e6e0600-4a7c-4183-a74b-6863430138e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39e336a9-4b29-4a4c-b6cc-5021e79ebaef", "name": "network-vif-deleted", "tag": "8c53ac3b-f0f4-476c-b437-142469dd492a"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:00:49.141885 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-00374282-2c59-4117-a15b-2ede22846ecb req-6e6e0600-4a7c-4183-a74b-6863430138e2 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:49.142694 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-00374282-2c59-4117-a15b-2ede22846ecb req-6e6e0600-4a7c-4183-a74b-6863430138e2 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:49.143147 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-00374282-2c59-4117-a15b-2ede22846ecb req-6e6e0600-4a7c-4183-a74b-6863430138e2 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:49.155880 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-00374282-2c59-4117-a15b-2ede22846ecb req-6e6e0600-4a7c-4183-a74b-6863430138e2 service nova] Creating event network-vif-deleted:8c53ac3b-f0f4-476c-b437-142469dd492a for instance 39e336a9-4b29-4a4c-b6cc-5021e79ebaef on n-h1-862769-1 Oct 27 04:00:49.162100 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-00374282-2c59-4117-a15b-2ede22846ecb req-6e6e0600-4a7c-4183-a74b-6863430138e2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046787 Oct 27 04:00:49.163082 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3142/6569] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:00:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:00:49.688840 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6905070f-c73b-4233-a995-58caddcc4853 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:00:49.689480 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-6905070f-c73b-4233-a995-58caddcc4853 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] [instance: 39e336a9-4b29-4a4c-b6cc-5021e79ebaef] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:00:49.697633 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6905070f-c73b-4233-a995-58caddcc4853 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:49.698245 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6905070f-c73b-4233-a995-58caddcc4853 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:49.698912 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6905070f-c73b-4233-a995-58caddcc4853 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:49.704193 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6905070f-c73b-4233-a995-58caddcc4853 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:49.704193 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6905070f-c73b-4233-a995-58caddcc4853 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:49.704193 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6905070f-c73b-4233-a995-58caddcc4853 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:49.743688 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6905070f-c73b-4233-a995-58caddcc4853 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:49.744523 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6905070f-c73b-4233-a995-58caddcc4853 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:49.745217 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6905070f-c73b-4233-a995-58caddcc4853 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:49.745985 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-6905070f-c73b-4233-a995-58caddcc4853 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lazy-loading 'fault' on Instance uuid 39e336a9-4b29-4a4c-b6cc-5021e79ebaef {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 04:00:49.807428 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6905070f-c73b-4233-a995-58caddcc4853 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7ffbb437004d379258425747bf1521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038d0cade5d540d399e5d237ed07419f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:00:49.817730 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6905070f-c73b-4233-a995-58caddcc4853 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] 10.222.0.20 "GET /compute/v2.1/servers/39e336a9-4b29-4a4c-b6cc-5021e79ebaef" status: 200 len: 1332 microversion: 2.1 time: 0.132911 Oct 27 04:00:49.818565 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3428/6570] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:00:49 2022] GET /compute/v2.1/servers/39e336a9-4b29-4a4c-b6cc-5021e79ebaef => generated 1332 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:00:49.843328 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-713661dc-eb64-4b6b-ad2c-30b0dc038c5c tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:00:49.845148 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-713661dc-eb64-4b6b-ad2c-30b0dc038c5c tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 16fe7721-d002-42e7-b7c5-8080841127f7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:00:49.871442 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-713661dc-eb64-4b6b-ad2c-30b0dc038c5c tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:49.872672 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-713661dc-eb64-4b6b-ad2c-30b0dc038c5c tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:49.874100 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-713661dc-eb64-4b6b-ad2c-30b0dc038c5c tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:49.875042 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-713661dc-eb64-4b6b-ad2c-30b0dc038c5c tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:49.875916 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-713661dc-eb64-4b6b-ad2c-30b0dc038c5c tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:49.880363 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-713661dc-eb64-4b6b-ad2c-30b0dc038c5c tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:50.249363 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-713661dc-eb64-4b6b-ad2c-30b0dc038c5c tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:00:50.253104 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=100 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:00:50.258309 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-713661dc-eb64-4b6b-ad2c-30b0dc038c5c tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/16fe7721-d002-42e7-b7c5-8080841127f7" status: 200 len: 1390 microversion: 2.1 time: 0.419580 Oct 27 04:00:50.258899 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3143/6571] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:00:49 2022] GET /compute/v2.1/servers/16fe7721-d002-42e7-b7c5-8080841127f7 => generated 1390 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:00:50.841170 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4c7e394c-97b4-4fe9-862e-4ff882a03400 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:00:50.842973 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4c7e394c-97b4-4fe9-862e-4ff882a03400 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] [instance: 39e336a9-4b29-4a4c-b6cc-5021e79ebaef] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:00:50.850908 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4c7e394c-97b4-4fe9-862e-4ff882a03400 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:50.853204 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4c7e394c-97b4-4fe9-862e-4ff882a03400 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:50.853204 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4c7e394c-97b4-4fe9-862e-4ff882a03400 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:50.853690 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4c7e394c-97b4-4fe9-862e-4ff882a03400 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:50.854328 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4c7e394c-97b4-4fe9-862e-4ff882a03400 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:50.854921 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4c7e394c-97b4-4fe9-862e-4ff882a03400 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:50.871057 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-4c7e394c-97b4-4fe9-862e-4ff882a03400 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] HTTP exception thrown: Instance 39e336a9-4b29-4a4c-b6cc-5021e79ebaef could not be found. Oct 27 04:00:50.873389 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4c7e394c-97b4-4fe9-862e-4ff882a03400 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Request method failure captured: Oct 27 04:00:50.873389 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/39e336a9-4b29-4a4c-b6cc-5021e79ebaef HTTP/1.1 Oct 27 04:00:50.873389 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 04:00:50.873389 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 04:00:50.873389 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 04:00:50.873389 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 04:00:50.873389 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 04:00:50.873389 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 04:00:50.873389 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 04:00:50.873389 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 04:00:50.873389 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWgICP9RmEqp6gL3SGc-bERcCFviGHTCTjx3mgIEtyKLMGDEy0FAbYc558tSTxDXoPKKFe8cwNVPO6OFaoG3IM-m_oeB7ugJsqbXaagw-sa89ncM9t0jwO2MTGbkLQ2hBPyCcdtVEYc2TYOSSuj12pXHKMjII3aD-c1Uxz9jXUmzCW3M Oct 27 04:00:50.873389 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 04:00:50.873389 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 04:00:50.873389 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 04:00:50.873389 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 04:00:50.873389 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 04:00:50.873389 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 04:00:50.873389 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 038d0cade5d540d399e5d237ed07419f Oct 27 04:00:50.873389 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-722980985 Oct 27 04:00:50.873389 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 04:00:50.873389 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 04:00:50.873389 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/038d0cade5d540d399e5d237ed07419f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/038d0cade5d540d399e5d237ed07419f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/038d0cade5d540d399e5d237ed07419f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_038d0cade5d540d399e5d237ed07419f"}]}] Oct 27 04:00:50.873389 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-TestSecurityGroupsBasicOps-722980985 Oct 27 04:00:50.873389 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 038d0cade5d540d399e5d237ed07419f Oct 27 04:00:50.873389 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-722980985 Oct 27 04:00:50.873389 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-TestSecurityGroupsBasicOps-722980985-project Oct 27 04:00:50.873389 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 04:00:50.873389 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 04:00:50.873389 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 3e7ffbb437004d379258425747bf1521 Oct 27 04:00:50.873389 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-TestSecurityGroupsBasicOps-722980985-project Oct 27 04:00:50.873389 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 04:00:50.873389 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 39e336a9-4b29-4a4c-b6cc-5021e79ebaef could not be found. Oct 27 04:00:50.873389 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '39e336a9-4b29-4a4c-b6cc-5021e79ebaef'} Oct 27 04:00:50.873389 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 04:00:50.873389 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:00:50.873389 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 04:00:50.873389 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 04:00:50.873389 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 04:00:50.873389 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 04:00:50.873389 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 04:00:50.873389 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 04:00:50.873389 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 04:00:50.873389 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 04:00:50.873389 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39e336a9-4b29-4a4c-b6cc-5021e79ebaef could not be found. Oct 27 04:00:50.873389 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:00:50.873389 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:00:50.873389 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:00:50.873389 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:00:50.873389 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:00:50.873389 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:00:50.873389 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 04:00:50.873389 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 04:00:50.873389 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 04:00:50.873389 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 04:00:50.873389 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 04:00:50.873389 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 04:00:50.873389 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 04:00:50.873389 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 04:00:50.873389 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 04:00:50.873389 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 04:00:50.873389 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39e336a9-4b29-4a4c-b6cc-5021e79ebaef could not be found. Oct 27 04:00:50.873389 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:00:50.873389 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:00:50.873389 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:00:50.881445 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:00:50.881445 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:00:50.881445 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:00:50.881445 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 04:00:50.881445 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 04:00:50.881445 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39e336a9-4b29-4a4c-b6cc-5021e79ebaef could not be found. Oct 27 04:00:50.881445 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:00:50.881445 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4c7e394c-97b4-4fe9-862e-4ff882a03400 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Returning 404 to user: Instance 39e336a9-4b29-4a4c-b6cc-5021e79ebaef could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 04:00:50.882129 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4c7e394c-97b4-4fe9-862e-4ff882a03400 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] 10.222.0.20 "GET /compute/v2.1/servers/39e336a9-4b29-4a4c-b6cc-5021e79ebaef" status: 404 len: 111 microversion: 2.1 time: 0.038609 Oct 27 04:00:50.883471 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3429/6572] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:00:50 2022] GET /compute/v2.1/servers/39e336a9-4b29-4a4c-b6cc-5021e79ebaef => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 04:00:51.283006 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f53a3791-98b0-4dcf-b3e2-336ecfd8c915 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:00:51.287796 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f53a3791-98b0-4dcf-b3e2-336ecfd8c915 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 16fe7721-d002-42e7-b7c5-8080841127f7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:00:51.316189 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f53a3791-98b0-4dcf-b3e2-336ecfd8c915 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:51.317616 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f53a3791-98b0-4dcf-b3e2-336ecfd8c915 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:51.318104 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f53a3791-98b0-4dcf-b3e2-336ecfd8c915 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:51.319707 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f53a3791-98b0-4dcf-b3e2-336ecfd8c915 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:51.325372 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f53a3791-98b0-4dcf-b3e2-336ecfd8c915 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:51.326075 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f53a3791-98b0-4dcf-b3e2-336ecfd8c915 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:51.615883 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f53a3791-98b0-4dcf-b3e2-336ecfd8c915 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:00:51.628116 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f53a3791-98b0-4dcf-b3e2-336ecfd8c915 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/16fe7721-d002-42e7-b7c5-8080841127f7" status: 200 len: 1562 microversion: 2.1 time: 0.350687 Oct 27 04:00:51.646058 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3144/6573] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:00:51 2022] GET /compute/v2.1/servers/16fe7721-d002-42e7-b7c5-8080841127f7 => generated 1562 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:00:51.655292 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8514566a-787c-4f3d-82e0-b076c346a0f9 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:00:51.657515 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8514566a-787c-4f3d-82e0-b076c346a0f9 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 16fe7721-d002-42e7-b7c5-8080841127f7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:00:51.665074 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8514566a-787c-4f3d-82e0-b076c346a0f9 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:51.665863 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8514566a-787c-4f3d-82e0-b076c346a0f9 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:51.666560 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8514566a-787c-4f3d-82e0-b076c346a0f9 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:51.670108 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8514566a-787c-4f3d-82e0-b076c346a0f9 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:51.670108 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8514566a-787c-4f3d-82e0-b076c346a0f9 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:51.670108 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8514566a-787c-4f3d-82e0-b076c346a0f9 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:51.827457 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8514566a-787c-4f3d-82e0-b076c346a0f9 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:00:51.836397 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8514566a-787c-4f3d-82e0-b076c346a0f9 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/16fe7721-d002-42e7-b7c5-8080841127f7" status: 200 len: 1562 microversion: 2.1 time: 0.187747 Oct 27 04:00:51.837303 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3430/6574] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:00:51 2022] GET /compute/v2.1/servers/16fe7721-d002-42e7-b7c5-8080841127f7 => generated 1562 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:00:56.345668 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a6895360-d1b3-4d4b-aa40-a3b246d966f8 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:00:56.351187 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a6895360-d1b3-4d4b-aa40-a3b246d966f8 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 16fe7721-d002-42e7-b7c5-8080841127f7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:00:56.353735 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-4ac65a51-d265-4737-bbf2-7bba94a83cc0 req-ce913058-8469-4369-87a4-445427248302 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16fe7721-d002-42e7-b7c5-8080841127f7", "tag": "20903b19-c0a8-472f-8a32-42afa7526441"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:00:56.364894 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a6895360-d1b3-4d4b-aa40-a3b246d966f8 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:56.365867 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a6895360-d1b3-4d4b-aa40-a3b246d966f8 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:56.366573 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a6895360-d1b3-4d4b-aa40-a3b246d966f8 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:56.367570 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a6895360-d1b3-4d4b-aa40-a3b246d966f8 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:56.368279 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a6895360-d1b3-4d4b-aa40-a3b246d966f8 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:56.368939 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a6895360-d1b3-4d4b-aa40-a3b246d966f8 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:56.369362 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-4ac65a51-d265-4737-bbf2-7bba94a83cc0 req-ce913058-8469-4369-87a4-445427248302 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:56.372432 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-4ac65a51-d265-4737-bbf2-7bba94a83cc0 req-ce913058-8469-4369-87a4-445427248302 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:56.372923 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-4ac65a51-d265-4737-bbf2-7bba94a83cc0 req-ce913058-8469-4369-87a4-445427248302 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:56.405719 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-4ac65a51-d265-4737-bbf2-7bba94a83cc0 req-ce913058-8469-4369-87a4-445427248302 service nova] Creating event network-changed:20903b19-c0a8-472f-8a32-42afa7526441 for instance 16fe7721-d002-42e7-b7c5-8080841127f7 on n-h2-862769-1 Oct 27 04:00:56.422251 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-4ac65a51-d265-4737-bbf2-7bba94a83cc0 req-ce913058-8469-4369-87a4-445427248302 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069460 Oct 27 04:00:56.423364 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3431/6575] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:00:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:00:56.741798 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a6895360-d1b3-4d4b-aa40-a3b246d966f8 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:00:56.752089 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a6895360-d1b3-4d4b-aa40-a3b246d966f8 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/16fe7721-d002-42e7-b7c5-8080841127f7" status: 200 len: 1562 microversion: 2.1 time: 0.410571 Oct 27 04:00:56.755077 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3145/6576] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:00:56 2022] GET /compute/v2.1/servers/16fe7721-d002-42e7-b7c5-8080841127f7 => generated 1562 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:00:59.941057 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-b00e3e1d-8dd2-409b-b1c0-993b02eae972 req-8a7a45df-071a-43f5-a08a-74cf0edfb29e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b884037-d633-4e3d-a52e-813cc319a6e9", "tag": "2faddf5b-d4a3-4a36-94a3-7aa99ced5696"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:00:59.945599 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d7efe45a-d564-4cf3-aa76-0d836b8fa50c tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:00:59.946243 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d7efe45a-d564-4cf3-aa76-0d836b8fa50c tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] [instance: 0b884037-d633-4e3d-a52e-813cc319a6e9] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:00:59.961076 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d7efe45a-d564-4cf3-aa76-0d836b8fa50c tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:59.961590 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d7efe45a-d564-4cf3-aa76-0d836b8fa50c tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:59.962072 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d7efe45a-d564-4cf3-aa76-0d836b8fa50c tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:59.962382 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-b00e3e1d-8dd2-409b-b1c0-993b02eae972 req-8a7a45df-071a-43f5-a08a-74cf0edfb29e service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:59.962786 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d7efe45a-d564-4cf3-aa76-0d836b8fa50c tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:00:59.963068 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-b00e3e1d-8dd2-409b-b1c0-993b02eae972 req-8a7a45df-071a-43f5-a08a-74cf0edfb29e service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:59.963515 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-b00e3e1d-8dd2-409b-b1c0-993b02eae972 req-8a7a45df-071a-43f5-a08a-74cf0edfb29e service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:59.963773 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d7efe45a-d564-4cf3-aa76-0d836b8fa50c tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:00:59.964640 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d7efe45a-d564-4cf3-aa76-0d836b8fa50c tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:00:59.979435 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-b00e3e1d-8dd2-409b-b1c0-993b02eae972 req-8a7a45df-071a-43f5-a08a-74cf0edfb29e service nova] Creating event network-changed:2faddf5b-d4a3-4a36-94a3-7aa99ced5696 for instance 0b884037-d633-4e3d-a52e-813cc319a6e9 on n-h2-862769-1 Oct 27 04:00:59.985411 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-b00e3e1d-8dd2-409b-b1c0-993b02eae972 req-8a7a45df-071a-43f5-a08a-74cf0edfb29e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047935 Oct 27 04:00:59.986336 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3146/6577] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:00:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:00:59.995951 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d7efe45a-d564-4cf3-aa76-0d836b8fa50c tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] [instance: 0b884037-d633-4e3d-a52e-813cc319a6e9] Going to try to terminate instance {{(pid=121001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 04:01:00.324293 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d7efe45a-d564-4cf3-aa76-0d836b8fa50c tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0b884037-d633-4e3d-a52e-813cc319a6e9" status: 204 len: 0 microversion: 2.1 time: 0.390461 Oct 27 04:01:00.325509 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3432/6578] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 04:00:59 2022] DELETE /compute/v2.1/servers/0b884037-d633-4e3d-a52e-813cc319a6e9 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 04:01:00.335099 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ec874f63-941c-4615-8ff0-aeaaab323b62 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:01:00.335850 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ec874f63-941c-4615-8ff0-aeaaab323b62 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] [instance: 0b884037-d633-4e3d-a52e-813cc319a6e9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:01:00.346970 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ec874f63-941c-4615-8ff0-aeaaab323b62 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:01:00.347506 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ec874f63-941c-4615-8ff0-aeaaab323b62 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:01:00.348511 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ec874f63-941c-4615-8ff0-aeaaab323b62 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:01:00.349262 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ec874f63-941c-4615-8ff0-aeaaab323b62 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:01:00.349794 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ec874f63-941c-4615-8ff0-aeaaab323b62 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:01:00.353053 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ec874f63-941c-4615-8ff0-aeaaab323b62 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:01:00.593005 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ec874f63-941c-4615-8ff0-aeaaab323b62 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7ffbb437004d379258425747bf1521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038d0cade5d540d399e5d237ed07419f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:01:00.603320 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ec874f63-941c-4615-8ff0-aeaaab323b62 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] 10.222.0.20 "GET /compute/v2.1/servers/0b884037-d633-4e3d-a52e-813cc319a6e9" status: 200 len: 1767 microversion: 2.1 time: 0.272907 Oct 27 04:01:00.604080 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3147/6579] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:01:00 2022] GET /compute/v2.1/servers/0b884037-d633-4e3d-a52e-813cc319a6e9 => generated 1767 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:01:01.631970 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8b6625c6-1a9b-4248-8426-f4bd5b2348b9 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:01:01.633355 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8b6625c6-1a9b-4248-8426-f4bd5b2348b9 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] [instance: 0b884037-d633-4e3d-a52e-813cc319a6e9] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:01:01.643154 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8b6625c6-1a9b-4248-8426-f4bd5b2348b9 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:01:01.646448 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8b6625c6-1a9b-4248-8426-f4bd5b2348b9 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:01:01.680881 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8b6625c6-1a9b-4248-8426-f4bd5b2348b9 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:01:01.680881 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8b6625c6-1a9b-4248-8426-f4bd5b2348b9 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:01:01.680881 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8b6625c6-1a9b-4248-8426-f4bd5b2348b9 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:01:01.680881 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8b6625c6-1a9b-4248-8426-f4bd5b2348b9 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:01:02.140210 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8b6625c6-1a9b-4248-8426-f4bd5b2348b9 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7ffbb437004d379258425747bf1521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038d0cade5d540d399e5d237ed07419f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:01:02.150405 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8b6625c6-1a9b-4248-8426-f4bd5b2348b9 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] 10.222.0.20 "GET /compute/v2.1/servers/0b884037-d633-4e3d-a52e-813cc319a6e9" status: 200 len: 1767 microversion: 2.1 time: 0.526159 Oct 27 04:01:02.151485 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3433/6580] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:01:01 2022] GET /compute/v2.1/servers/0b884037-d633-4e3d-a52e-813cc319a6e9 => generated 1767 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:01:02.543512 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-e1b4b1ff-249c-456a-a1f1-d990b06bc02a req-b985423a-e89b-4830-b99f-4e9e96f6e55b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b884037-d633-4e3d-a52e-813cc319a6e9", "name": "network-vif-deleted", "tag": "2faddf5b-d4a3-4a36-94a3-7aa99ced5696"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:01:02.555601 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-e1b4b1ff-249c-456a-a1f1-d990b06bc02a req-b985423a-e89b-4830-b99f-4e9e96f6e55b service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:01:02.556156 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-e1b4b1ff-249c-456a-a1f1-d990b06bc02a req-b985423a-e89b-4830-b99f-4e9e96f6e55b service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:01:02.560251 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-e1b4b1ff-249c-456a-a1f1-d990b06bc02a req-b985423a-e89b-4830-b99f-4e9e96f6e55b service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:01:02.572418 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-e1b4b1ff-249c-456a-a1f1-d990b06bc02a req-b985423a-e89b-4830-b99f-4e9e96f6e55b service nova] Creating event network-vif-deleted:2faddf5b-d4a3-4a36-94a3-7aa99ced5696 for instance 0b884037-d633-4e3d-a52e-813cc319a6e9 on n-h2-862769-1 Oct 27 04:01:02.591552 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-e1b4b1ff-249c-456a-a1f1-d990b06bc02a req-b985423a-e89b-4830-b99f-4e9e96f6e55b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052610 Oct 27 04:01:02.592891 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3148/6581] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:01:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:01:03.177568 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-cdd87cc9-449c-4f10-9483-1c9ec1a50ea1 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:01:03.178223 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-cdd87cc9-449c-4f10-9483-1c9ec1a50ea1 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] [instance: 0b884037-d633-4e3d-a52e-813cc319a6e9] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:01:03.185601 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cdd87cc9-449c-4f10-9483-1c9ec1a50ea1 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:01:03.186378 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cdd87cc9-449c-4f10-9483-1c9ec1a50ea1 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:01:03.187508 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cdd87cc9-449c-4f10-9483-1c9ec1a50ea1 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:01:03.189021 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cdd87cc9-449c-4f10-9483-1c9ec1a50ea1 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:01:03.189645 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cdd87cc9-449c-4f10-9483-1c9ec1a50ea1 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:01:03.190260 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cdd87cc9-449c-4f10-9483-1c9ec1a50ea1 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:01:03.225825 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cdd87cc9-449c-4f10-9483-1c9ec1a50ea1 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:01:03.226354 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cdd87cc9-449c-4f10-9483-1c9ec1a50ea1 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:01:03.226833 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cdd87cc9-449c-4f10-9483-1c9ec1a50ea1 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:01:03.227297 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-cdd87cc9-449c-4f10-9483-1c9ec1a50ea1 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lazy-loading 'fault' on Instance uuid 0b884037-d633-4e3d-a52e-813cc319a6e9 {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 04:01:03.286000 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-cdd87cc9-449c-4f10-9483-1c9ec1a50ea1 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7ffbb437004d379258425747bf1521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038d0cade5d540d399e5d237ed07419f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:01:03.297808 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-cdd87cc9-449c-4f10-9483-1c9ec1a50ea1 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] 10.222.0.20 "GET /compute/v2.1/servers/0b884037-d633-4e3d-a52e-813cc319a6e9" status: 200 len: 1384 microversion: 2.1 time: 0.124520 Oct 27 04:01:03.299233 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3434/6582] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:01:03 2022] GET /compute/v2.1/servers/0b884037-d633-4e3d-a52e-813cc319a6e9 => generated 1384 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:01:04.322370 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3c240792-4146-499a-8125-ff1b347db463 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:01:04.323201 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-3c240792-4146-499a-8125-ff1b347db463 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] [instance: 0b884037-d633-4e3d-a52e-813cc319a6e9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:01:04.347437 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3c240792-4146-499a-8125-ff1b347db463 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:01:04.351361 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3c240792-4146-499a-8125-ff1b347db463 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:01:04.351361 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3c240792-4146-499a-8125-ff1b347db463 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:01:04.351960 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3c240792-4146-499a-8125-ff1b347db463 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:01:04.352438 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3c240792-4146-499a-8125-ff1b347db463 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:01:04.352882 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3c240792-4146-499a-8125-ff1b347db463 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:01:04.390994 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-3c240792-4146-499a-8125-ff1b347db463 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] HTTP exception thrown: Instance 0b884037-d633-4e3d-a52e-813cc319a6e9 could not be found. Oct 27 04:01:04.421791 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3c240792-4146-499a-8125-ff1b347db463 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Request method failure captured: Oct 27 04:01:04.421791 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/0b884037-d633-4e3d-a52e-813cc319a6e9 HTTP/1.1 Oct 27 04:01:04.421791 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 04:01:04.421791 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 04:01:04.421791 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 04:01:04.421791 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 04:01:04.421791 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 04:01:04.421791 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 04:01:04.421791 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 04:01:04.421791 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 04:01:04.421791 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWgICP9RmEqp6gL3SGc-bERcCFviGHTCTjx3mgIEtyKLMGDEy0FAbYc558tSTxDXoPKKFe8cwNVPO6OFaoG3IM-m_oeB7ugJsqbXaagw-sa89ncM9t0jwO2MTGbkLQ2hBPyCcdtVEYc2TYOSSuj12pXHKMjII3aD-c1Uxz9jXUmzCW3M Oct 27 04:01:04.421791 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 04:01:04.421791 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 04:01:04.421791 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 04:01:04.421791 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 04:01:04.421791 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 04:01:04.421791 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 04:01:04.421791 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 038d0cade5d540d399e5d237ed07419f Oct 27 04:01:04.421791 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-722980985 Oct 27 04:01:04.421791 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 04:01:04.421791 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 04:01:04.421791 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/038d0cade5d540d399e5d237ed07419f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/038d0cade5d540d399e5d237ed07419f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/038d0cade5d540d399e5d237ed07419f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_038d0cade5d540d399e5d237ed07419f"}]}] Oct 27 04:01:04.421791 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-TestSecurityGroupsBasicOps-722980985 Oct 27 04:01:04.421791 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 038d0cade5d540d399e5d237ed07419f Oct 27 04:01:04.421791 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-722980985 Oct 27 04:01:04.421791 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-TestSecurityGroupsBasicOps-722980985-project Oct 27 04:01:04.421791 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 04:01:04.421791 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 04:01:04.421791 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 3e7ffbb437004d379258425747bf1521 Oct 27 04:01:04.421791 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-TestSecurityGroupsBasicOps-722980985-project Oct 27 04:01:04.421791 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 04:01:04.421791 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 0b884037-d633-4e3d-a52e-813cc319a6e9 could not be found. Oct 27 04:01:04.421791 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '0b884037-d633-4e3d-a52e-813cc319a6e9'} Oct 27 04:01:04.421791 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 04:01:04.421791 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:01:04.421791 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 04:01:04.421791 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 04:01:04.421791 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 04:01:04.421791 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 04:01:04.421791 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 04:01:04.421791 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 04:01:04.421791 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 04:01:04.421791 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 04:01:04.421791 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b884037-d633-4e3d-a52e-813cc319a6e9 could not be found. Oct 27 04:01:04.421791 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:01:04.421791 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:01:04.421791 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:01:04.421791 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:01:04.421791 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:01:04.421791 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:01:04.421791 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 04:01:04.421791 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 04:01:04.421791 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 04:01:04.421791 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 04:01:04.421791 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 04:01:04.421791 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 04:01:04.421791 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 04:01:04.421791 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 04:01:04.421791 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 04:01:04.421791 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 04:01:04.421791 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b884037-d633-4e3d-a52e-813cc319a6e9 could not be found. Oct 27 04:01:04.421791 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:01:04.421791 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:01:04.421791 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:01:04.427400 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:01:04.427400 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:01:04.427400 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:01:04.427400 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 04:01:04.427400 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 04:01:04.427400 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b884037-d633-4e3d-a52e-813cc319a6e9 could not be found. Oct 27 04:01:04.427400 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:01:04.427400 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3c240792-4146-499a-8125-ff1b347db463 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Returning 404 to user: Instance 0b884037-d633-4e3d-a52e-813cc319a6e9 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 04:01:04.427400 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3c240792-4146-499a-8125-ff1b347db463 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] 10.222.0.20 "GET /compute/v2.1/servers/0b884037-d633-4e3d-a52e-813cc319a6e9" status: 404 len: 111 microversion: 2.1 time: 0.102983 Oct 27 04:01:04.431879 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3149/6583] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:01:04 2022] GET /compute/v2.1/servers/0b884037-d633-4e3d-a52e-813cc319a6e9 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 04:01:11.635981 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ebefeede-e60a-4896-957b-a57107ae4278 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] Calling method '.version_select at 0x7f7dd9b5e8b0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:01:11.681244 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:01:11.771935 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ebefeede-e60a-4896-957b-a57107ae4278 tempest-TestSecurityGroupsBasicOps-722980985 tempest-TestSecurityGroupsBasicOps-722980985-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1085734455" status: 202 len: 0 microversion: 2.1 time: 0.140027 Oct 27 04:01:11.772578 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3435/6584] 10.222.0.20 () {58 vars in 1278 bytes} [Thu Oct 27 04:01:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1085734455 => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 04:01:15.421457 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-03c5d5a1-a5be-4078-816e-f0d583659821 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:01:15.428556 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-03c5d5a1-a5be-4078-816e-f0d583659821 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 16fe7721-d002-42e7-b7c5-8080841127f7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:01:15.465517 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:01:15.467054 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=24 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:01:15.470290 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-03c5d5a1-a5be-4078-816e-f0d583659821 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:01:15.472494 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-03c5d5a1-a5be-4078-816e-f0d583659821 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:01:15.475161 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-03c5d5a1-a5be-4078-816e-f0d583659821 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:01:15.476166 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-03c5d5a1-a5be-4078-816e-f0d583659821 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:01:15.477187 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-03c5d5a1-a5be-4078-816e-f0d583659821 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:01:15.478064 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-03c5d5a1-a5be-4078-816e-f0d583659821 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:01:15.582584 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-03c5d5a1-a5be-4078-816e-f0d583659821 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "POST /compute/v2.1/servers/16fe7721-d002-42e7-b7c5-8080841127f7/action" status: 200 len: 24571 microversion: 2.1 time: 0.169251 Oct 27 04:01:15.583590 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3150/6585] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 04:01:15 2022] POST /compute/v2.1/servers/16fe7721-d002-42e7-b7c5-8080841127f7/action => generated 24571 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 04:01:21.965648 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c02e7130-483a-4013-8afa-1c0020844f93 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:01:21.968718 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c02e7130-483a-4013-8afa-1c0020844f93 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 16fe7721-d002-42e7-b7c5-8080841127f7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:01:21.976423 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:01:21.978614 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c02e7130-483a-4013-8afa-1c0020844f93 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:01:21.979164 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c02e7130-483a-4013-8afa-1c0020844f93 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:01:21.979672 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c02e7130-483a-4013-8afa-1c0020844f93 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:01:21.980401 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c02e7130-483a-4013-8afa-1c0020844f93 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:01:21.980868 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c02e7130-483a-4013-8afa-1c0020844f93 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:01:21.981461 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c02e7130-483a-4013-8afa-1c0020844f93 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:01:22.075940 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-c02e7130-483a-4013-8afa-1c0020844f93 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Flavor limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 04:01:22.078891 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-c02e7130-483a-4013-8afa-1c0020844f93 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Image limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 04:01:22.078891 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-c02e7130-483a-4013-8afa-1c0020844f93 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Flavor pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 04:01:22.078891 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-c02e7130-483a-4013-8afa-1c0020844f93 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Image pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 04:01:22.078891 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-c02e7130-483a-4013-8afa-1c0020844f93 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 04:01:22.370890 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c02e7130-483a-4013-8afa-1c0020844f93 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 16fe7721-d002-42e7-b7c5-8080841127f7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:01:22.386370 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c02e7130-483a-4013-8afa-1c0020844f93 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:01:22.387803 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c02e7130-483a-4013-8afa-1c0020844f93 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:01:22.388790 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c02e7130-483a-4013-8afa-1c0020844f93 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:01:22.389718 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c02e7130-483a-4013-8afa-1c0020844f93 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:01:22.395978 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c02e7130-483a-4013-8afa-1c0020844f93 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:01:22.396706 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c02e7130-483a-4013-8afa-1c0020844f93 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:01:22.451189 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c02e7130-483a-4013-8afa-1c0020844f93 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "POST /compute/v2.1/servers/16fe7721-d002-42e7-b7c5-8080841127f7/action" status: 202 len: 1137 microversion: 2.1 time: 0.489873 Oct 27 04:01:22.476429 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3436/6586] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 04:01:21 2022] POST /compute/v2.1/servers/16fe7721-d002-42e7-b7c5-8080841127f7/action => generated 1137 bytes in 515 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 27 04:01:22.482729 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-55772917-d2ef-46ec-baea-dc1772ecb823 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:01:22.483591 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-55772917-d2ef-46ec-baea-dc1772ecb823 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 16fe7721-d002-42e7-b7c5-8080841127f7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:01:22.520197 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-55772917-d2ef-46ec-baea-dc1772ecb823 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:01:22.520708 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-55772917-d2ef-46ec-baea-dc1772ecb823 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:01:22.521161 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-55772917-d2ef-46ec-baea-dc1772ecb823 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:01:22.521906 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-55772917-d2ef-46ec-baea-dc1772ecb823 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:01:22.522410 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-55772917-d2ef-46ec-baea-dc1772ecb823 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:01:22.522852 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-55772917-d2ef-46ec-baea-dc1772ecb823 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:01:22.786568 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-55772917-d2ef-46ec-baea-dc1772ecb823 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:01:22.796990 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-55772917-d2ef-46ec-baea-dc1772ecb823 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/16fe7721-d002-42e7-b7c5-8080841127f7" status: 200 len: 1690 microversion: 2.1 time: 0.319329 Oct 27 04:01:22.801127 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3151/6587] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:01:22 2022] GET /compute/v2.1/servers/16fe7721-d002-42e7-b7c5-8080841127f7 => generated 1690 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:01:23.825773 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5cae73fb-0f25-4a07-9b5e-65419ac71f59 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:01:23.830547 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5cae73fb-0f25-4a07-9b5e-65419ac71f59 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 16fe7721-d002-42e7-b7c5-8080841127f7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:01:23.850136 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5cae73fb-0f25-4a07-9b5e-65419ac71f59 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:01:23.850136 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5cae73fb-0f25-4a07-9b5e-65419ac71f59 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:01:23.852570 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5cae73fb-0f25-4a07-9b5e-65419ac71f59 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:01:23.856231 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5cae73fb-0f25-4a07-9b5e-65419ac71f59 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:01:23.858735 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5cae73fb-0f25-4a07-9b5e-65419ac71f59 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:01:23.861745 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5cae73fb-0f25-4a07-9b5e-65419ac71f59 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:01:24.192701 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5cae73fb-0f25-4a07-9b5e-65419ac71f59 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:01:24.208487 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5cae73fb-0f25-4a07-9b5e-65419ac71f59 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/16fe7721-d002-42e7-b7c5-8080841127f7" status: 200 len: 1690 microversion: 2.1 time: 0.387041 Oct 27 04:01:24.209949 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3437/6588] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:01:23 2022] GET /compute/v2.1/servers/16fe7721-d002-42e7-b7c5-8080841127f7 => generated 1690 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:01:25.235513 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-153f9d6a-5c78-45dd-9a54-379b4a20f3bf tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:01:25.238143 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-153f9d6a-5c78-45dd-9a54-379b4a20f3bf tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 16fe7721-d002-42e7-b7c5-8080841127f7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:01:25.251954 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-153f9d6a-5c78-45dd-9a54-379b4a20f3bf tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:01:25.255159 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-153f9d6a-5c78-45dd-9a54-379b4a20f3bf tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:01:25.255957 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-153f9d6a-5c78-45dd-9a54-379b4a20f3bf tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:01:25.258387 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-153f9d6a-5c78-45dd-9a54-379b4a20f3bf tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:01:25.260643 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-153f9d6a-5c78-45dd-9a54-379b4a20f3bf tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:01:25.261317 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-153f9d6a-5c78-45dd-9a54-379b4a20f3bf tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:01:25.780061 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-153f9d6a-5c78-45dd-9a54-379b4a20f3bf tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:01:25.793979 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-153f9d6a-5c78-45dd-9a54-379b4a20f3bf tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/16fe7721-d002-42e7-b7c5-8080841127f7" status: 200 len: 1690 microversion: 2.1 time: 0.564536 Oct 27 04:01:25.808538 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3152/6589] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:01:25 2022] GET /compute/v2.1/servers/16fe7721-d002-42e7-b7c5-8080841127f7 => generated 1690 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:01:26.835230 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-dbfe3039-b144-4983-bab3-ecc33db63413 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:01:26.837205 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-dbfe3039-b144-4983-bab3-ecc33db63413 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 16fe7721-d002-42e7-b7c5-8080841127f7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:01:26.869577 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dbfe3039-b144-4983-bab3-ecc33db63413 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:01:26.872799 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dbfe3039-b144-4983-bab3-ecc33db63413 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:01:26.875404 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dbfe3039-b144-4983-bab3-ecc33db63413 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:01:26.878898 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dbfe3039-b144-4983-bab3-ecc33db63413 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:01:26.880572 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dbfe3039-b144-4983-bab3-ecc33db63413 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:01:26.883436 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dbfe3039-b144-4983-bab3-ecc33db63413 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:01:27.807237 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-dbfe3039-b144-4983-bab3-ecc33db63413 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:01:27.825009 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-dbfe3039-b144-4983-bab3-ecc33db63413 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/16fe7721-d002-42e7-b7c5-8080841127f7" status: 200 len: 1690 microversion: 2.1 time: 1.006323 Oct 27 04:01:27.827544 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3438/6590] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:01:26 2022] GET /compute/v2.1/servers/16fe7721-d002-42e7-b7c5-8080841127f7 => generated 1690 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:01:28.852568 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-973d927a-b26a-4010-aed6-22259688442e tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:01:28.853186 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-973d927a-b26a-4010-aed6-22259688442e tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 16fe7721-d002-42e7-b7c5-8080841127f7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:01:28.860679 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-973d927a-b26a-4010-aed6-22259688442e tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:01:28.861205 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-973d927a-b26a-4010-aed6-22259688442e tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:01:28.861659 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-973d927a-b26a-4010-aed6-22259688442e tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:01:28.862429 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-973d927a-b26a-4010-aed6-22259688442e tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:01:28.862898 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-973d927a-b26a-4010-aed6-22259688442e tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:01:28.863340 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-973d927a-b26a-4010-aed6-22259688442e tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:01:29.035162 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-973d927a-b26a-4010-aed6-22259688442e tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:01:29.045689 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-973d927a-b26a-4010-aed6-22259688442e tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/16fe7721-d002-42e7-b7c5-8080841127f7" status: 200 len: 1690 microversion: 2.1 time: 0.197681 Oct 27 04:01:29.046962 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3153/6591] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:01:28 2022] GET /compute/v2.1/servers/16fe7721-d002-42e7-b7c5-8080841127f7 => generated 1690 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:01:30.069782 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b07e9610-8772-4352-95fe-b0c9b32ac34c tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:01:30.074469 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b07e9610-8772-4352-95fe-b0c9b32ac34c tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 16fe7721-d002-42e7-b7c5-8080841127f7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:01:30.084363 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b07e9610-8772-4352-95fe-b0c9b32ac34c tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:01:30.085831 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b07e9610-8772-4352-95fe-b0c9b32ac34c tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:01:30.086895 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b07e9610-8772-4352-95fe-b0c9b32ac34c tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:01:30.088115 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b07e9610-8772-4352-95fe-b0c9b32ac34c tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:01:30.089036 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b07e9610-8772-4352-95fe-b0c9b32ac34c tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:01:30.089672 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b07e9610-8772-4352-95fe-b0c9b32ac34c tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:01:30.453439 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b07e9610-8772-4352-95fe-b0c9b32ac34c tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:01:30.462565 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b07e9610-8772-4352-95fe-b0c9b32ac34c tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/16fe7721-d002-42e7-b7c5-8080841127f7" status: 200 len: 1690 microversion: 2.1 time: 0.397323 Oct 27 04:01:30.465490 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3439/6592] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:01:30 2022] GET /compute/v2.1/servers/16fe7721-d002-42e7-b7c5-8080841127f7 => generated 1690 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:01:31.487501 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c611105c-0e07-482c-b74a-f6dee642694e tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:01:31.488140 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c611105c-0e07-482c-b74a-f6dee642694e tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 16fe7721-d002-42e7-b7c5-8080841127f7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:01:31.495250 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c611105c-0e07-482c-b74a-f6dee642694e tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:01:31.496071 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c611105c-0e07-482c-b74a-f6dee642694e tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:01:31.496744 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c611105c-0e07-482c-b74a-f6dee642694e tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:01:31.497497 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c611105c-0e07-482c-b74a-f6dee642694e tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:01:31.498181 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c611105c-0e07-482c-b74a-f6dee642694e tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:01:31.498782 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c611105c-0e07-482c-b74a-f6dee642694e tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:01:31.741741 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c611105c-0e07-482c-b74a-f6dee642694e tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:01:31.757013 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c611105c-0e07-482c-b74a-f6dee642694e tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/16fe7721-d002-42e7-b7c5-8080841127f7" status: 200 len: 1690 microversion: 2.1 time: 0.269098 Oct 27 04:01:31.757013 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3154/6593] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:01:31 2022] GET /compute/v2.1/servers/16fe7721-d002-42e7-b7c5-8080841127f7 => generated 1690 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:01:32.818193 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-78ab6b17-0317-4bdf-b2d7-68419ce7ad2c tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:01:32.820062 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-78ab6b17-0317-4bdf-b2d7-68419ce7ad2c tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 16fe7721-d002-42e7-b7c5-8080841127f7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:01:32.838162 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-78ab6b17-0317-4bdf-b2d7-68419ce7ad2c tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:01:32.838670 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-78ab6b17-0317-4bdf-b2d7-68419ce7ad2c tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:01:32.839119 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-78ab6b17-0317-4bdf-b2d7-68419ce7ad2c tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:01:32.840008 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-78ab6b17-0317-4bdf-b2d7-68419ce7ad2c tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:01:32.840471 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-78ab6b17-0317-4bdf-b2d7-68419ce7ad2c tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:01:32.840908 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-78ab6b17-0317-4bdf-b2d7-68419ce7ad2c tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:01:33.034405 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-78ab6b17-0317-4bdf-b2d7-68419ce7ad2c tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:01:33.045873 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-78ab6b17-0317-4bdf-b2d7-68419ce7ad2c tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/16fe7721-d002-42e7-b7c5-8080841127f7" status: 200 len: 1690 microversion: 2.1 time: 0.254219 Oct 27 04:01:33.055862 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3440/6594] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:01:32 2022] GET /compute/v2.1/servers/16fe7721-d002-42e7-b7c5-8080841127f7 => generated 1690 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:01:34.083398 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-08227f5b-a70b-4406-b3cc-56596f909560 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:01:34.084554 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-08227f5b-a70b-4406-b3cc-56596f909560 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 16fe7721-d002-42e7-b7c5-8080841127f7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:01:34.099304 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-08227f5b-a70b-4406-b3cc-56596f909560 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:01:34.101740 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-08227f5b-a70b-4406-b3cc-56596f909560 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:01:34.102243 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-08227f5b-a70b-4406-b3cc-56596f909560 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:01:34.105385 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-08227f5b-a70b-4406-b3cc-56596f909560 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:01:34.105958 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-08227f5b-a70b-4406-b3cc-56596f909560 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:01:34.106334 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-08227f5b-a70b-4406-b3cc-56596f909560 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:01:34.629648 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-08227f5b-a70b-4406-b3cc-56596f909560 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:01:34.641051 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-08227f5b-a70b-4406-b3cc-56596f909560 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/16fe7721-d002-42e7-b7c5-8080841127f7" status: 200 len: 1690 microversion: 2.1 time: 0.562002 Oct 27 04:01:34.641658 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3155/6595] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:01:34 2022] GET /compute/v2.1/servers/16fe7721-d002-42e7-b7c5-8080841127f7 => generated 1690 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:01:35.671107 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-51bd7686-ed03-416c-8ffc-1a6042ca1d82 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:01:35.671747 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-51bd7686-ed03-416c-8ffc-1a6042ca1d82 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 16fe7721-d002-42e7-b7c5-8080841127f7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:01:35.680842 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-51bd7686-ed03-416c-8ffc-1a6042ca1d82 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:01:35.681346 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-51bd7686-ed03-416c-8ffc-1a6042ca1d82 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:01:35.681801 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-51bd7686-ed03-416c-8ffc-1a6042ca1d82 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:01:35.684633 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-51bd7686-ed03-416c-8ffc-1a6042ca1d82 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:01:35.694076 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-51bd7686-ed03-416c-8ffc-1a6042ca1d82 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:01:35.694871 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-51bd7686-ed03-416c-8ffc-1a6042ca1d82 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:01:36.377115 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-51bd7686-ed03-416c-8ffc-1a6042ca1d82 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:01:36.388178 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-51bd7686-ed03-416c-8ffc-1a6042ca1d82 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/16fe7721-d002-42e7-b7c5-8080841127f7" status: 200 len: 1696 microversion: 2.1 time: 0.721090 Oct 27 04:01:36.394194 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3441/6596] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:01:35 2022] GET /compute/v2.1/servers/16fe7721-d002-42e7-b7c5-8080841127f7 => generated 1696 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:01:37.419847 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ed565f0e-bbd5-4bb0-91d3-bbc80e976c09 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:01:37.419847 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ed565f0e-bbd5-4bb0-91d3-bbc80e976c09 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 16fe7721-d002-42e7-b7c5-8080841127f7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:01:37.433989 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ed565f0e-bbd5-4bb0-91d3-bbc80e976c09 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:01:37.435099 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ed565f0e-bbd5-4bb0-91d3-bbc80e976c09 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:01:37.437303 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ed565f0e-bbd5-4bb0-91d3-bbc80e976c09 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:01:37.450502 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ed565f0e-bbd5-4bb0-91d3-bbc80e976c09 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:01:37.451178 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ed565f0e-bbd5-4bb0-91d3-bbc80e976c09 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:01:37.455062 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ed565f0e-bbd5-4bb0-91d3-bbc80e976c09 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:01:37.753434 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ed565f0e-bbd5-4bb0-91d3-bbc80e976c09 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:01:37.766151 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ed565f0e-bbd5-4bb0-91d3-bbc80e976c09 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/16fe7721-d002-42e7-b7c5-8080841127f7" status: 200 len: 1681 microversion: 2.1 time: 0.354007 Oct 27 04:01:37.767573 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3156/6597] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:01:37 2022] GET /compute/v2.1/servers/16fe7721-d002-42e7-b7c5-8080841127f7 => generated 1681 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:01:38.815497 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-11ee6a42-d5a1-4c87-a05c-ec978c862bec req-e04ff223-87b2-4502-8097-adcd07a7e724 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16fe7721-d002-42e7-b7c5-8080841127f7", "name": "network-vif-unplugged", "status": "completed", "tag": "20903b19-c0a8-472f-8a32-42afa7526441"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:01:38.840604 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-11ee6a42-d5a1-4c87-a05c-ec978c862bec req-e04ff223-87b2-4502-8097-adcd07a7e724 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:01:38.842012 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-11ee6a42-d5a1-4c87-a05c-ec978c862bec req-e04ff223-87b2-4502-8097-adcd07a7e724 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:01:38.843216 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-11ee6a42-d5a1-4c87-a05c-ec978c862bec req-e04ff223-87b2-4502-8097-adcd07a7e724 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:01:38.862573 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-11ee6a42-d5a1-4c87-a05c-ec978c862bec req-e04ff223-87b2-4502-8097-adcd07a7e724 service nova] Creating event network-vif-unplugged:20903b19-c0a8-472f-8a32-42afa7526441 for instance 16fe7721-d002-42e7-b7c5-8080841127f7 on n-h2-862769-1 Oct 27 04:01:38.871297 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-11ee6a42-d5a1-4c87-a05c-ec978c862bec req-e04ff223-87b2-4502-8097-adcd07a7e724 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060441 Oct 27 04:01:38.872433 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3157/6598] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:01:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 04:01:39.073803 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0b8562d3-e1fd-49e7-be33-6fd4c98f5379 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Action: 'create', calling method: .version_select at 0x7f7dd95031f0>, body: {"keypair": {"name": "tempest-TestServerBasicOps-1354028845", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPyXCOandIFOlS4LMCqBRHF465HhXnkPw5YnrABnrQZqpneeG+35gT+eK1fyoJ5wb6FKEOK8GKDL7tKLo5I4gkSXDhsCOjelrhZsSioIr1NYiBmMtfFINhgIlMOhSal+gQ=="}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:01:39.098649 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-0b8562d3-e1fd-49e7-be33-6fd4c98f5379 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Getting quotas for project 586d194e60ee461197b124db7501f8be. Resources: {'key_pairs'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 04:01:39.106203 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-0b8562d3-e1fd-49e7-be33-6fd4c98f5379 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Getting quotas for user 25ee3a8fd93c4ad8b83c7e4ef94f4c8a and project 586d194e60ee461197b124db7501f8be. Resources: {'key_pairs'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 04:01:39.212486 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0b8562d3-e1fd-49e7-be33-6fd4c98f5379 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.571748 Oct 27 04:01:39.213371 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3442/6599] 10.222.0.20 () {60 vars in 1159 bytes} [Thu Oct 27 04:01:38 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:01:41.154637 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-5745a4d6-a535-4ce8-b864-5de0ba18d0c8 req-73b63756-409f-4b1a-a1c7-7996fe75f691 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16fe7721-d002-42e7-b7c5-8080841127f7", "name": "network-vif-plugged", "status": "completed", "tag": "20903b19-c0a8-472f-8a32-42afa7526441"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:01:41.166358 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-5745a4d6-a535-4ce8-b864-5de0ba18d0c8 req-73b63756-409f-4b1a-a1c7-7996fe75f691 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:01:41.168344 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-5745a4d6-a535-4ce8-b864-5de0ba18d0c8 req-73b63756-409f-4b1a-a1c7-7996fe75f691 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:01:41.168344 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-5745a4d6-a535-4ce8-b864-5de0ba18d0c8 req-73b63756-409f-4b1a-a1c7-7996fe75f691 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:01:41.186326 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-5745a4d6-a535-4ce8-b864-5de0ba18d0c8 req-73b63756-409f-4b1a-a1c7-7996fe75f691 service nova] Creating event network-vif-plugged:20903b19-c0a8-472f-8a32-42afa7526441 for instance 16fe7721-d002-42e7-b7c5-8080841127f7 on n-h2-862769-1 Oct 27 04:01:41.193498 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-5745a4d6-a535-4ce8-b864-5de0ba18d0c8 req-73b63756-409f-4b1a-a1c7-7996fe75f691 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048309 Oct 27 04:01:41.194490 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3158/6600] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:01:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:01:42.698316 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-db95e903-ce17-4d87-980f-a89f083e3e3c tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1701236227", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-1354028845", "security_groups": [{"name": "tempest-secgroup-smoke-1682180173"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "f033bcc3-d041-4dbc-abe7-e2891b9a65f9"}]}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:01:42.901351 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.network.neutron [None req-db95e903-ce17-4d87-980f-a89f083e3e3c tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] validate_networks() for [('f033bcc3-d041-4dbc-abe7-e2891b9a65f9', None, None, None, None, None)] {{(pid=121001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 04:01:43.424046 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-db95e903-ce17-4d87-980f-a89f083e3e3c tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Getting quotas for project 586d194e60ee461197b124db7501f8be. Resources: dict_keys(['metadata_items']) {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 04:01:43.431469 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-db95e903-ce17-4d87-980f-a89f083e3e3c tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Getting quotas for user 25ee3a8fd93c4ad8b83c7e4ef94f4c8a and project 586d194e60ee461197b124db7501f8be. Resources: dict_keys(['metadata_items']) {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 04:01:43.445482 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-db95e903-ce17-4d87-980f-a89f083e3e3c tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Flavor limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 04:01:43.445918 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-db95e903-ce17-4d87-980f-a89f083e3e3c tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Image limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 04:01:43.446512 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-db95e903-ce17-4d87-980f-a89f083e3e3c tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Flavor pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 04:01:43.446828 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-db95e903-ce17-4d87-980f-a89f083e3e3c tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Image pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 04:01:43.447249 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-db95e903-ce17-4d87-980f-a89f083e3e3c tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 04:01:43.456238 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-db95e903-ce17-4d87-980f-a89f083e3e3c tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:01:43.456735 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-db95e903-ce17-4d87-980f-a89f083e3e3c tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:01:43.457186 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-db95e903-ce17-4d87-980f-a89f083e3e3c tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:01:43.458498 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-db95e903-ce17-4d87-980f-a89f083e3e3c tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:01:43.458975 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-db95e903-ce17-4d87-980f-a89f083e3e3c tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:01:43.459408 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-db95e903-ce17-4d87-980f-a89f083e3e3c tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:01:43.478858 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-db95e903-ce17-4d87-980f-a89f083e3e3c tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Getting quotas for project 586d194e60ee461197b124db7501f8be. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 04:01:43.484468 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-db95e903-ce17-4d87-980f-a89f083e3e3c tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Getting quotas for user 25ee3a8fd93c4ad8b83c7e4ef94f4c8a and project 586d194e60ee461197b124db7501f8be. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 04:01:43.501151 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-db95e903-ce17-4d87-980f-a89f083e3e3c tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Going to run 1 instances... {{(pid=121001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 04:01:43.505166 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-db95e903-ce17-4d87-980f-a89f083e3e3c tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] [instance: 296dbea5-186c-4051-b5bd-88cb39abffbd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 04:01:43.668603 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-db95e903-ce17-4d87-980f-a89f083e3e3c tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.975873 Oct 27 04:01:43.669437 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3443/6601] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 04:01:42 2022] POST /compute/v2.1/servers => generated 406 bytes in 977 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 04:01:43.685208 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-202f4cce-7046-4129-91f8-2bc3c769f47a tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:01:43.685940 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-202f4cce-7046-4129-91f8-2bc3c769f47a tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] [instance: 296dbea5-186c-4051-b5bd-88cb39abffbd] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:01:43.756564 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-202f4cce-7046-4129-91f8-2bc3c769f47a tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ee3a8fd93c4ad8b83c7e4ef94f4c8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '586d194e60ee461197b124db7501f8be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:01:43.765126 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-202f4cce-7046-4129-91f8-2bc3c769f47a tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] 10.222.0.20 "GET /compute/v2.1/servers/296dbea5-186c-4051-b5bd-88cb39abffbd" status: 200 len: 1303 microversion: 2.1 time: 0.087854 Oct 27 04:01:43.765918 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3159/6602] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:01:43 2022] GET /compute/v2.1/servers/296dbea5-186c-4051-b5bd-88cb39abffbd => generated 1303 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:01:44.793279 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f39a78e8-f610-4a56-86e8-65290e3cc302 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:01:44.793896 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f39a78e8-f610-4a56-86e8-65290e3cc302 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] [instance: 296dbea5-186c-4051-b5bd-88cb39abffbd] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:01:44.866231 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f39a78e8-f610-4a56-86e8-65290e3cc302 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ee3a8fd93c4ad8b83c7e4ef94f4c8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '586d194e60ee461197b124db7501f8be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:01:44.876779 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f39a78e8-f610-4a56-86e8-65290e3cc302 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] 10.222.0.20 "GET /compute/v2.1/servers/296dbea5-186c-4051-b5bd-88cb39abffbd" status: 200 len: 1303 microversion: 2.1 time: 0.089184 Oct 27 04:01:44.877905 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3444/6603] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:01:44 2022] GET /compute/v2.1/servers/296dbea5-186c-4051-b5bd-88cb39abffbd => generated 1303 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:01:45.903478 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-fef8a330-382a-4b6a-96b8-87da28616797 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:01:45.905951 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-fef8a330-382a-4b6a-96b8-87da28616797 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] [instance: 296dbea5-186c-4051-b5bd-88cb39abffbd] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:01:45.920571 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fef8a330-382a-4b6a-96b8-87da28616797 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:01:45.921081 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fef8a330-382a-4b6a-96b8-87da28616797 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:01:45.926954 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fef8a330-382a-4b6a-96b8-87da28616797 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:01:45.926954 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fef8a330-382a-4b6a-96b8-87da28616797 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:01:45.926954 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fef8a330-382a-4b6a-96b8-87da28616797 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:01:45.926954 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fef8a330-382a-4b6a-96b8-87da28616797 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:01:46.091841 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-fef8a330-382a-4b6a-96b8-87da28616797 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ee3a8fd93c4ad8b83c7e4ef94f4c8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '586d194e60ee461197b124db7501f8be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:01:46.102017 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-fef8a330-382a-4b6a-96b8-87da28616797 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] 10.222.0.20 "GET /compute/v2.1/servers/296dbea5-186c-4051-b5bd-88cb39abffbd" status: 200 len: 1299 microversion: 2.1 time: 0.204184 Oct 27 04:01:46.124852 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3160/6604] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:01:45 2022] GET /compute/v2.1/servers/296dbea5-186c-4051-b5bd-88cb39abffbd => generated 1299 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:01:47.134527 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-776bd230-27e6-46e9-a490-296144202039 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:01:47.135063 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-776bd230-27e6-46e9-a490-296144202039 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] [instance: 296dbea5-186c-4051-b5bd-88cb39abffbd] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:01:47.145765 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-776bd230-27e6-46e9-a490-296144202039 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:01:47.146568 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-776bd230-27e6-46e9-a490-296144202039 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:01:47.147178 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-776bd230-27e6-46e9-a490-296144202039 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:01:47.148328 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-776bd230-27e6-46e9-a490-296144202039 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:01:47.149038 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-776bd230-27e6-46e9-a490-296144202039 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:01:47.149648 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-776bd230-27e6-46e9-a490-296144202039 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:01:47.483033 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-776bd230-27e6-46e9-a490-296144202039 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ee3a8fd93c4ad8b83c7e4ef94f4c8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '586d194e60ee461197b124db7501f8be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:01:47.498353 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-776bd230-27e6-46e9-a490-296144202039 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] 10.222.0.20 "GET /compute/v2.1/servers/296dbea5-186c-4051-b5bd-88cb39abffbd" status: 200 len: 1373 microversion: 2.1 time: 0.370992 Oct 27 04:01:47.501475 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3445/6605] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:01:47 2022] GET /compute/v2.1/servers/296dbea5-186c-4051-b5bd-88cb39abffbd => generated 1373 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:01:48.533918 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b508b7d3-3b7d-4099-a884-8811c609606a tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:01:48.533918 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b508b7d3-3b7d-4099-a884-8811c609606a tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] [instance: 296dbea5-186c-4051-b5bd-88cb39abffbd] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:01:48.546808 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b508b7d3-3b7d-4099-a884-8811c609606a tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:01:48.548338 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b508b7d3-3b7d-4099-a884-8811c609606a tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:01:48.549040 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b508b7d3-3b7d-4099-a884-8811c609606a tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:01:48.550153 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b508b7d3-3b7d-4099-a884-8811c609606a tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:01:48.550855 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b508b7d3-3b7d-4099-a884-8811c609606a tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:01:48.552209 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b508b7d3-3b7d-4099-a884-8811c609606a tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:01:48.969193 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b508b7d3-3b7d-4099-a884-8811c609606a tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ee3a8fd93c4ad8b83c7e4ef94f4c8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '586d194e60ee461197b124db7501f8be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:01:48.980972 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b508b7d3-3b7d-4099-a884-8811c609606a tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] 10.222.0.20 "GET /compute/v2.1/servers/296dbea5-186c-4051-b5bd-88cb39abffbd" status: 200 len: 1429 microversion: 2.1 time: 0.459986 Oct 27 04:01:48.990786 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3161/6606] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:01:48 2022] GET /compute/v2.1/servers/296dbea5-186c-4051-b5bd-88cb39abffbd => generated 1429 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:01:50.008539 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6371fbba-e29e-4082-afe7-b437ea55d788 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:01:50.009783 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-6371fbba-e29e-4082-afe7-b437ea55d788 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] [instance: 296dbea5-186c-4051-b5bd-88cb39abffbd] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:01:50.018510 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6371fbba-e29e-4082-afe7-b437ea55d788 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:01:50.019300 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6371fbba-e29e-4082-afe7-b437ea55d788 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:01:50.020560 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6371fbba-e29e-4082-afe7-b437ea55d788 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:01:50.021525 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6371fbba-e29e-4082-afe7-b437ea55d788 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:01:50.022536 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6371fbba-e29e-4082-afe7-b437ea55d788 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:01:50.023194 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6371fbba-e29e-4082-afe7-b437ea55d788 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:01:50.242198 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-215cbc46-a91f-44bb-92b9-36879b44ea61 req-9ab1b889-9579-4e1c-a2cb-c707627b2cfb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "296dbea5-186c-4051-b5bd-88cb39abffbd", "tag": "f62a30b7-1bd5-45bc-a70e-28c54740fc84"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:01:50.260345 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-215cbc46-a91f-44bb-92b9-36879b44ea61 req-9ab1b889-9579-4e1c-a2cb-c707627b2cfb service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:01:50.260939 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-215cbc46-a91f-44bb-92b9-36879b44ea61 req-9ab1b889-9579-4e1c-a2cb-c707627b2cfb service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:01:50.262396 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-215cbc46-a91f-44bb-92b9-36879b44ea61 req-9ab1b889-9579-4e1c-a2cb-c707627b2cfb service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:01:50.292091 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6371fbba-e29e-4082-afe7-b437ea55d788 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ee3a8fd93c4ad8b83c7e4ef94f4c8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '586d194e60ee461197b124db7501f8be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:01:50.308789 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6371fbba-e29e-4082-afe7-b437ea55d788 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] 10.222.0.20 "GET /compute/v2.1/servers/296dbea5-186c-4051-b5bd-88cb39abffbd" status: 200 len: 1429 microversion: 2.1 time: 0.303459 Oct 27 04:01:50.315056 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3446/6607] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:01:50 2022] GET /compute/v2.1/servers/296dbea5-186c-4051-b5bd-88cb39abffbd => generated 1429 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:01:50.319738 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-215cbc46-a91f-44bb-92b9-36879b44ea61 req-9ab1b889-9579-4e1c-a2cb-c707627b2cfb service nova] Creating event network-changed:f62a30b7-1bd5-45bc-a70e-28c54740fc84 for instance 296dbea5-186c-4051-b5bd-88cb39abffbd on n-h1-862769-1 Oct 27 04:01:50.325541 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-215cbc46-a91f-44bb-92b9-36879b44ea61 req-9ab1b889-9579-4e1c-a2cb-c707627b2cfb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087942 Oct 27 04:01:50.326364 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3162/6608] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:01:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 04:01:51.335900 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e958c163-564c-4370-82bd-ba126426e6c3 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:01:51.336444 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e958c163-564c-4370-82bd-ba126426e6c3 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] [instance: 296dbea5-186c-4051-b5bd-88cb39abffbd] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:01:51.347787 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e958c163-564c-4370-82bd-ba126426e6c3 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:01:51.348348 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e958c163-564c-4370-82bd-ba126426e6c3 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:01:51.348804 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e958c163-564c-4370-82bd-ba126426e6c3 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:01:51.349532 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e958c163-564c-4370-82bd-ba126426e6c3 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:01:51.349997 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e958c163-564c-4370-82bd-ba126426e6c3 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:01:51.350468 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e958c163-564c-4370-82bd-ba126426e6c3 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:01:51.575664 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e958c163-564c-4370-82bd-ba126426e6c3 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ee3a8fd93c4ad8b83c7e4ef94f4c8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '586d194e60ee461197b124db7501f8be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:01:51.583610 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e958c163-564c-4370-82bd-ba126426e6c3 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] 10.222.0.20 "GET /compute/v2.1/servers/296dbea5-186c-4051-b5bd-88cb39abffbd" status: 200 len: 1429 microversion: 2.1 time: 0.252449 Oct 27 04:01:51.584214 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3447/6609] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:01:51 2022] GET /compute/v2.1/servers/296dbea5-186c-4051-b5bd-88cb39abffbd => generated 1429 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:01:52.611113 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2192ebe9-ab2d-4667-8998-1159fcaf5d04 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:01:52.612714 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-2192ebe9-ab2d-4667-8998-1159fcaf5d04 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] [instance: 296dbea5-186c-4051-b5bd-88cb39abffbd] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:01:52.619677 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2192ebe9-ab2d-4667-8998-1159fcaf5d04 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:01:52.620239 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2192ebe9-ab2d-4667-8998-1159fcaf5d04 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:01:52.622093 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2192ebe9-ab2d-4667-8998-1159fcaf5d04 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:01:52.622093 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2192ebe9-ab2d-4667-8998-1159fcaf5d04 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:01:52.622093 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2192ebe9-ab2d-4667-8998-1159fcaf5d04 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:01:52.622871 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2192ebe9-ab2d-4667-8998-1159fcaf5d04 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:01:52.625852 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=59 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:01:52.786741 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2192ebe9-ab2d-4667-8998-1159fcaf5d04 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ee3a8fd93c4ad8b83c7e4ef94f4c8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '586d194e60ee461197b124db7501f8be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:01:52.795988 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2192ebe9-ab2d-4667-8998-1159fcaf5d04 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] 10.222.0.20 "GET /compute/v2.1/servers/296dbea5-186c-4051-b5bd-88cb39abffbd" status: 200 len: 1429 microversion: 2.1 time: 0.191621 Oct 27 04:01:52.806664 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3163/6610] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:01:52 2022] GET /compute/v2.1/servers/296dbea5-186c-4051-b5bd-88cb39abffbd => generated 1429 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:01:53.824437 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-fff92617-92c8-4555-a901-6cf5e976cc10 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:01:53.825295 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-fff92617-92c8-4555-a901-6cf5e976cc10 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] [instance: 296dbea5-186c-4051-b5bd-88cb39abffbd] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:01:53.829759 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:01:53.830418 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=63,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:01:53.841298 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fff92617-92c8-4555-a901-6cf5e976cc10 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:01:53.841803 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fff92617-92c8-4555-a901-6cf5e976cc10 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:01:53.842846 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fff92617-92c8-4555-a901-6cf5e976cc10 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:01:53.843564 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fff92617-92c8-4555-a901-6cf5e976cc10 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:01:53.845760 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fff92617-92c8-4555-a901-6cf5e976cc10 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:01:53.846249 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fff92617-92c8-4555-a901-6cf5e976cc10 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:01:53.851189 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:01:54.115058 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-fff92617-92c8-4555-a901-6cf5e976cc10 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ee3a8fd93c4ad8b83c7e4ef94f4c8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '586d194e60ee461197b124db7501f8be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:01:54.125381 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-fff92617-92c8-4555-a901-6cf5e976cc10 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] 10.222.0.20 "GET /compute/v2.1/servers/296dbea5-186c-4051-b5bd-88cb39abffbd" status: 200 len: 1429 microversion: 2.1 time: 0.304784 Oct 27 04:01:54.125972 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3448/6611] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:01:53 2022] GET /compute/v2.1/servers/296dbea5-186c-4051-b5bd-88cb39abffbd => generated 1429 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:01:55.149104 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7bcbbf2d-0d17-48c5-9cac-d37091a4818c tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:01:55.149744 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7bcbbf2d-0d17-48c5-9cac-d37091a4818c tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] [instance: 296dbea5-186c-4051-b5bd-88cb39abffbd] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:01:55.152802 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:01:55.153686 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=31 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:01:55.159193 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7bcbbf2d-0d17-48c5-9cac-d37091a4818c tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:01:55.159710 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7bcbbf2d-0d17-48c5-9cac-d37091a4818c tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:01:55.160173 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7bcbbf2d-0d17-48c5-9cac-d37091a4818c tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:01:55.161581 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7bcbbf2d-0d17-48c5-9cac-d37091a4818c tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:01:55.162243 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7bcbbf2d-0d17-48c5-9cac-d37091a4818c tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:01:55.162513 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7bcbbf2d-0d17-48c5-9cac-d37091a4818c tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:01:55.316549 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7bcbbf2d-0d17-48c5-9cac-d37091a4818c tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ee3a8fd93c4ad8b83c7e4ef94f4c8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '586d194e60ee461197b124db7501f8be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:01:55.323172 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-84fb0861-cc91-4d20-8fa1-5ab8ab198122 req-6625f671-35a5-4804-accb-4036dc15783c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "296dbea5-186c-4051-b5bd-88cb39abffbd", "name": "network-vif-plugged", "status": "completed", "tag": "f62a30b7-1bd5-45bc-a70e-28c54740fc84"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:01:55.326301 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7bcbbf2d-0d17-48c5-9cac-d37091a4818c tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] 10.222.0.20 "GET /compute/v2.1/servers/296dbea5-186c-4051-b5bd-88cb39abffbd" status: 200 len: 1429 microversion: 2.1 time: 0.181043 Oct 27 04:01:55.326907 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3164/6612] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:01:55 2022] GET /compute/v2.1/servers/296dbea5-186c-4051-b5bd-88cb39abffbd => generated 1429 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:01:55.348755 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=16 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:01:55.351214 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-84fb0861-cc91-4d20-8fa1-5ab8ab198122 req-6625f671-35a5-4804-accb-4036dc15783c service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:01:55.352229 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-84fb0861-cc91-4d20-8fa1-5ab8ab198122 req-6625f671-35a5-4804-accb-4036dc15783c service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:01:55.353316 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-84fb0861-cc91-4d20-8fa1-5ab8ab198122 req-6625f671-35a5-4804-accb-4036dc15783c service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:01:55.369146 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-84fb0861-cc91-4d20-8fa1-5ab8ab198122 req-6625f671-35a5-4804-accb-4036dc15783c service nova] Creating event network-vif-plugged:f62a30b7-1bd5-45bc-a70e-28c54740fc84 for instance 296dbea5-186c-4051-b5bd-88cb39abffbd on n-h1-862769-1 Oct 27 04:01:55.382400 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-84fb0861-cc91-4d20-8fa1-5ab8ab198122 req-6625f671-35a5-4804-accb-4036dc15783c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065782 Oct 27 04:01:55.386362 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3449/6613] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:01:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:01:56.352665 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b18157e1-ce43-4a81-8107-15992f50257e tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:01:56.353290 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b18157e1-ce43-4a81-8107-15992f50257e tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] [instance: 296dbea5-186c-4051-b5bd-88cb39abffbd] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:01:56.360757 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b18157e1-ce43-4a81-8107-15992f50257e tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:01:56.361458 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b18157e1-ce43-4a81-8107-15992f50257e tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:01:56.362162 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b18157e1-ce43-4a81-8107-15992f50257e tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:01:56.362928 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b18157e1-ce43-4a81-8107-15992f50257e tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:01:56.364884 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b18157e1-ce43-4a81-8107-15992f50257e tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:01:56.364884 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b18157e1-ce43-4a81-8107-15992f50257e tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:01:56.564677 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b18157e1-ce43-4a81-8107-15992f50257e tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ee3a8fd93c4ad8b83c7e4ef94f4c8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '586d194e60ee461197b124db7501f8be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:01:56.575784 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b18157e1-ce43-4a81-8107-15992f50257e tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] 10.222.0.20 "GET /compute/v2.1/servers/296dbea5-186c-4051-b5bd-88cb39abffbd" status: 200 len: 1429 microversion: 2.1 time: 0.227004 Oct 27 04:01:56.576389 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3165/6614] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:01:56 2022] GET /compute/v2.1/servers/296dbea5-186c-4051-b5bd-88cb39abffbd => generated 1429 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:01:57.606127 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-66f91c96-b6f8-49d8-8aff-dfd4590a2d0c tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:01:57.607398 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-66f91c96-b6f8-49d8-8aff-dfd4590a2d0c tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] [instance: 296dbea5-186c-4051-b5bd-88cb39abffbd] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:01:57.616255 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-66f91c96-b6f8-49d8-8aff-dfd4590a2d0c tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:01:57.617143 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-66f91c96-b6f8-49d8-8aff-dfd4590a2d0c tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:01:57.618004 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-66f91c96-b6f8-49d8-8aff-dfd4590a2d0c tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:01:57.618842 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-66f91c96-b6f8-49d8-8aff-dfd4590a2d0c tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:01:57.619380 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-66f91c96-b6f8-49d8-8aff-dfd4590a2d0c tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:01:57.619881 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-66f91c96-b6f8-49d8-8aff-dfd4590a2d0c tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:01:57.867810 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-66f91c96-b6f8-49d8-8aff-dfd4590a2d0c tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ee3a8fd93c4ad8b83c7e4ef94f4c8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '586d194e60ee461197b124db7501f8be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:01:57.877013 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-66f91c96-b6f8-49d8-8aff-dfd4590a2d0c tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] 10.222.0.20 "GET /compute/v2.1/servers/296dbea5-186c-4051-b5bd-88cb39abffbd" status: 200 len: 1609 microversion: 2.1 time: 0.277627 Oct 27 04:01:57.877615 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3450/6615] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:01:57 2022] GET /compute/v2.1/servers/296dbea5-186c-4051-b5bd-88cb39abffbd => generated 1609 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:01:57.900044 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-97179d7e-7ad5-4ccf-84f1-db9239fac35f tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:01:57.900671 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-97179d7e-7ad5-4ccf-84f1-db9239fac35f tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] [instance: 296dbea5-186c-4051-b5bd-88cb39abffbd] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:01:57.907722 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-97179d7e-7ad5-4ccf-84f1-db9239fac35f tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:01:57.916428 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-97179d7e-7ad5-4ccf-84f1-db9239fac35f tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:01:57.916428 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-97179d7e-7ad5-4ccf-84f1-db9239fac35f tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:01:57.916428 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-97179d7e-7ad5-4ccf-84f1-db9239fac35f tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:01:57.916428 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-97179d7e-7ad5-4ccf-84f1-db9239fac35f tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:01:57.916428 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-97179d7e-7ad5-4ccf-84f1-db9239fac35f tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:01:58.076773 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-97179d7e-7ad5-4ccf-84f1-db9239fac35f tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ee3a8fd93c4ad8b83c7e4ef94f4c8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '586d194e60ee461197b124db7501f8be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:01:58.093811 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-97179d7e-7ad5-4ccf-84f1-db9239fac35f tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] 10.222.0.20 "GET /compute/v2.1/servers/296dbea5-186c-4051-b5bd-88cb39abffbd" status: 200 len: 1609 microversion: 2.1 time: 0.197643 Oct 27 04:01:58.095067 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3166/6616] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:01:57 2022] GET /compute/v2.1/servers/296dbea5-186c-4051-b5bd-88cb39abffbd => generated 1609 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:01:58.117278 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5240de96-d65d-4ba4-aee9-dbbceaa35be0 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:01:58.118203 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5240de96-d65d-4ba4-aee9-dbbceaa35be0 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] [instance: 296dbea5-186c-4051-b5bd-88cb39abffbd] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:01:58.124520 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5240de96-d65d-4ba4-aee9-dbbceaa35be0 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:01:58.125164 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5240de96-d65d-4ba4-aee9-dbbceaa35be0 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:01:58.125604 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5240de96-d65d-4ba4-aee9-dbbceaa35be0 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:01:58.126529 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5240de96-d65d-4ba4-aee9-dbbceaa35be0 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:01:58.127001 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5240de96-d65d-4ba4-aee9-dbbceaa35be0 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:01:58.127614 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5240de96-d65d-4ba4-aee9-dbbceaa35be0 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:01:58.356441 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5240de96-d65d-4ba4-aee9-dbbceaa35be0 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ee3a8fd93c4ad8b83c7e4ef94f4c8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '586d194e60ee461197b124db7501f8be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:01:58.366901 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5240de96-d65d-4ba4-aee9-dbbceaa35be0 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] 10.222.0.20 "GET /compute/v2.1/servers/296dbea5-186c-4051-b5bd-88cb39abffbd" status: 200 len: 1609 microversion: 2.1 time: 0.254185 Oct 27 04:01:58.368144 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3451/6617] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:01:58 2022] GET /compute/v2.1/servers/296dbea5-186c-4051-b5bd-88cb39abffbd => generated 1609 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 04:02:01.648211 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-7c52706a-b2c2-4621-a091-e0072330d387 req-b554f81d-e0db-4f33-be81-fc75ac3a3fe3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "296dbea5-186c-4051-b5bd-88cb39abffbd", "tag": "f62a30b7-1bd5-45bc-a70e-28c54740fc84"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:02:01.661445 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-7c52706a-b2c2-4621-a091-e0072330d387 req-b554f81d-e0db-4f33-be81-fc75ac3a3fe3 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:02:01.662200 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-7c52706a-b2c2-4621-a091-e0072330d387 req-b554f81d-e0db-4f33-be81-fc75ac3a3fe3 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:02:01.662729 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-7c52706a-b2c2-4621-a091-e0072330d387 req-b554f81d-e0db-4f33-be81-fc75ac3a3fe3 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:02:01.689444 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-7c52706a-b2c2-4621-a091-e0072330d387 req-b554f81d-e0db-4f33-be81-fc75ac3a3fe3 service nova] Creating event network-changed:f62a30b7-1bd5-45bc-a70e-28c54740fc84 for instance 296dbea5-186c-4051-b5bd-88cb39abffbd on n-h1-862769-1 Oct 27 04:02:01.701024 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-7c52706a-b2c2-4621-a091-e0072330d387 req-b554f81d-e0db-4f33-be81-fc75ac3a3fe3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056727 Oct 27 04:02:01.702269 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3167/6618] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:02:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:02:01.997326 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3bd755ba-062c-4804-8dee-83c4d1f6b9c7 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:02:02.001376 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3bd755ba-062c-4804-8dee-83c4d1f6b9c7 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 16fe7721-d002-42e7-b7c5-8080841127f7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:02:02.013083 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3bd755ba-062c-4804-8dee-83c4d1f6b9c7 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:02:02.018432 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3bd755ba-062c-4804-8dee-83c4d1f6b9c7 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:02:02.019416 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3bd755ba-062c-4804-8dee-83c4d1f6b9c7 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:02:02.021113 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3bd755ba-062c-4804-8dee-83c4d1f6b9c7 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:02:02.023251 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3bd755ba-062c-4804-8dee-83c4d1f6b9c7 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:02:02.025674 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3bd755ba-062c-4804-8dee-83c4d1f6b9c7 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:02:02.132978 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3bd755ba-062c-4804-8dee-83c4d1f6b9c7 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "POST /compute/v2.1/servers/16fe7721-d002-42e7-b7c5-8080841127f7/action" status: 200 len: 24572 microversion: 2.1 time: 0.140114 Oct 27 04:02:02.135067 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3452/6619] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 04:02:01 2022] POST /compute/v2.1/servers/16fe7721-d002-42e7-b7c5-8080841127f7/action => generated 24572 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 04:02:14.297201 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=7 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:02:14.298785 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=25 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:02:14.303325 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-505f5229-4be4-4249-b2d5-932d10a1dfeb tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:02:14.304115 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-505f5229-4be4-4249-b2d5-932d10a1dfeb tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 16fe7721-d002-42e7-b7c5-8080841127f7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:02:14.312403 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-c17fbb75-fad1-4194-9923-b4374c258822 req-8c590479-6ad3-403b-8040-aa335815cc71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16fe7721-d002-42e7-b7c5-8080841127f7", "tag": "20903b19-c0a8-472f-8a32-42afa7526441"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:02:14.323219 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-505f5229-4be4-4249-b2d5-932d10a1dfeb tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:02:14.323722 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-505f5229-4be4-4249-b2d5-932d10a1dfeb tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:02:14.324013 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=9 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:02:14.324180 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-505f5229-4be4-4249-b2d5-932d10a1dfeb tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:02:14.325200 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-505f5229-4be4-4249-b2d5-932d10a1dfeb tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:02:14.325325 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=23 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:02:14.326141 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-505f5229-4be4-4249-b2d5-932d10a1dfeb tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:02:14.326750 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-505f5229-4be4-4249-b2d5-932d10a1dfeb tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:02:14.327638 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-c17fbb75-fad1-4194-9923-b4374c258822 req-8c590479-6ad3-403b-8040-aa335815cc71 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:02:14.328339 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-c17fbb75-fad1-4194-9923-b4374c258822 req-8c590479-6ad3-403b-8040-aa335815cc71 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:02:14.328873 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-c17fbb75-fad1-4194-9923-b4374c258822 req-8c590479-6ad3-403b-8040-aa335815cc71 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:02:14.347233 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-c17fbb75-fad1-4194-9923-b4374c258822 req-8c590479-6ad3-403b-8040-aa335815cc71 service nova] Creating event network-changed:20903b19-c0a8-472f-8a32-42afa7526441 for instance 16fe7721-d002-42e7-b7c5-8080841127f7 on n-h2-862769-1 Oct 27 04:02:14.354130 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-c17fbb75-fad1-4194-9923-b4374c258822 req-8c590479-6ad3-403b-8040-aa335815cc71 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046044 Oct 27 04:02:14.360715 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3453/6620] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:02:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 04:02:14.372152 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-505f5229-4be4-4249-b2d5-932d10a1dfeb tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 16fe7721-d002-42e7-b7c5-8080841127f7] Going to try to terminate instance {{(pid=121000) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 04:02:14.729440 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-505f5229-4be4-4249-b2d5-932d10a1dfeb tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "DELETE /compute/v2.1/servers/16fe7721-d002-42e7-b7c5-8080841127f7" status: 204 len: 0 microversion: 2.1 time: 0.433876 Oct 27 04:02:14.730451 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3168/6621] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 04:02:14 2022] DELETE /compute/v2.1/servers/16fe7721-d002-42e7-b7c5-8080841127f7 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 04:02:14.746549 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5d262d78-5621-4d35-aff4-d74e261d0388 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:02:14.748363 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5d262d78-5621-4d35-aff4-d74e261d0388 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 16fe7721-d002-42e7-b7c5-8080841127f7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:02:14.756254 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5d262d78-5621-4d35-aff4-d74e261d0388 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:02:14.757024 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5d262d78-5621-4d35-aff4-d74e261d0388 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:02:14.757655 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5d262d78-5621-4d35-aff4-d74e261d0388 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:02:14.758579 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5d262d78-5621-4d35-aff4-d74e261d0388 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:02:14.759187 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5d262d78-5621-4d35-aff4-d74e261d0388 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:02:14.762725 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5d262d78-5621-4d35-aff4-d74e261d0388 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:02:15.028253 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5d262d78-5621-4d35-aff4-d74e261d0388 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:02:15.037265 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5d262d78-5621-4d35-aff4-d74e261d0388 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/16fe7721-d002-42e7-b7c5-8080841127f7" status: 200 len: 1687 microversion: 2.1 time: 0.295769 Oct 27 04:02:15.043452 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3454/6622] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:02:14 2022] GET /compute/v2.1/servers/16fe7721-d002-42e7-b7c5-8080841127f7 => generated 1687 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:02:16.075295 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-da65ac33-e8d6-400d-9f10-528191855149 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:02:16.076823 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-da65ac33-e8d6-400d-9f10-528191855149 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 16fe7721-d002-42e7-b7c5-8080841127f7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:02:16.092894 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-da65ac33-e8d6-400d-9f10-528191855149 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:02:16.093803 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-da65ac33-e8d6-400d-9f10-528191855149 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:02:16.094525 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-da65ac33-e8d6-400d-9f10-528191855149 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:02:16.095542 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-da65ac33-e8d6-400d-9f10-528191855149 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:02:16.097401 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-da65ac33-e8d6-400d-9f10-528191855149 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:02:16.099445 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-da65ac33-e8d6-400d-9f10-528191855149 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:02:16.367070 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-da65ac33-e8d6-400d-9f10-528191855149 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:02:16.378262 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-da65ac33-e8d6-400d-9f10-528191855149 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/16fe7721-d002-42e7-b7c5-8080841127f7" status: 200 len: 1687 microversion: 2.1 time: 0.310301 Oct 27 04:02:16.390364 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3169/6623] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:02:16 2022] GET /compute/v2.1/servers/16fe7721-d002-42e7-b7c5-8080841127f7 => generated 1687 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:02:16.818236 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-d15ebfe2-fccf-4229-80d9-2c0464a0356a req-f5f41a82-c439-4b13-9a76-2c7696661979 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16fe7721-d002-42e7-b7c5-8080841127f7", "name": "network-vif-deleted", "tag": "20903b19-c0a8-472f-8a32-42afa7526441"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:02:16.828383 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-d15ebfe2-fccf-4229-80d9-2c0464a0356a req-f5f41a82-c439-4b13-9a76-2c7696661979 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:02:16.829219 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-d15ebfe2-fccf-4229-80d9-2c0464a0356a req-f5f41a82-c439-4b13-9a76-2c7696661979 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:02:16.832181 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-d15ebfe2-fccf-4229-80d9-2c0464a0356a req-f5f41a82-c439-4b13-9a76-2c7696661979 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:02:16.850590 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-d15ebfe2-fccf-4229-80d9-2c0464a0356a req-f5f41a82-c439-4b13-9a76-2c7696661979 service nova] Creating event network-vif-deleted:20903b19-c0a8-472f-8a32-42afa7526441 for instance 16fe7721-d002-42e7-b7c5-8080841127f7 on n-h2-862769-1 Oct 27 04:02:16.856368 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-d15ebfe2-fccf-4229-80d9-2c0464a0356a req-f5f41a82-c439-4b13-9a76-2c7696661979 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043025 Oct 27 04:02:16.857998 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3455/6624] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:02:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 04:02:17.402451 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ca87144c-96ff-48ad-a5c0-abe4c34d083f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:02:17.403072 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ca87144c-96ff-48ad-a5c0-abe4c34d083f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 16fe7721-d002-42e7-b7c5-8080841127f7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:02:17.410549 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ca87144c-96ff-48ad-a5c0-abe4c34d083f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:02:17.413868 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ca87144c-96ff-48ad-a5c0-abe4c34d083f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:02:17.414341 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ca87144c-96ff-48ad-a5c0-abe4c34d083f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:02:17.415261 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ca87144c-96ff-48ad-a5c0-abe4c34d083f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:02:17.415849 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ca87144c-96ff-48ad-a5c0-abe4c34d083f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:02:17.416367 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ca87144c-96ff-48ad-a5c0-abe4c34d083f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:02:17.459775 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ca87144c-96ff-48ad-a5c0-abe4c34d083f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:02:17.460273 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ca87144c-96ff-48ad-a5c0-abe4c34d083f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:02:17.460718 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ca87144c-96ff-48ad-a5c0-abe4c34d083f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:02:17.461175 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-ca87144c-96ff-48ad-a5c0-abe4c34d083f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lazy-loading 'fault' on Instance uuid 16fe7721-d002-42e7-b7c5-8080841127f7 {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 04:02:17.516564 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ca87144c-96ff-48ad-a5c0-abe4c34d083f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea55b400c24827a28e816ea2a225aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a432dda4903145278d79210121b3f77d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:02:17.527831 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ca87144c-96ff-48ad-a5c0-abe4c34d083f tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/16fe7721-d002-42e7-b7c5-8080841127f7" status: 200 len: 1355 microversion: 2.1 time: 0.129260 Oct 27 04:02:17.528738 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3170/6625] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:02:17 2022] GET /compute/v2.1/servers/16fe7721-d002-42e7-b7c5-8080841127f7 => generated 1355 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:02:18.558681 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3c671550-daf2-4786-bc17-7a1a729d34c4 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:02:18.559319 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3c671550-daf2-4786-bc17-7a1a729d34c4 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] [instance: 16fe7721-d002-42e7-b7c5-8080841127f7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:02:18.566657 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3c671550-daf2-4786-bc17-7a1a729d34c4 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:02:18.567805 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3c671550-daf2-4786-bc17-7a1a729d34c4 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:02:18.568380 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3c671550-daf2-4786-bc17-7a1a729d34c4 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:02:18.569234 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3c671550-daf2-4786-bc17-7a1a729d34c4 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:02:18.571356 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3c671550-daf2-4786-bc17-7a1a729d34c4 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:02:18.571356 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3c671550-daf2-4786-bc17-7a1a729d34c4 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:02:18.584745 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-3c671550-daf2-4786-bc17-7a1a729d34c4 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] HTTP exception thrown: Instance 16fe7721-d002-42e7-b7c5-8080841127f7 could not be found. Oct 27 04:02:18.586520 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3c671550-daf2-4786-bc17-7a1a729d34c4 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Request method failure captured: Oct 27 04:02:18.586520 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/16fe7721-d002-42e7-b7c5-8080841127f7 HTTP/1.1 Oct 27 04:02:18.586520 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 04:02:18.586520 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 04:02:18.586520 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 04:02:18.586520 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 04:02:18.586520 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 04:02:18.586520 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 04:02:18.586520 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 04:02:18.586520 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 04:02:18.586520 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWgCBfAAwg6CX6jDfTtZPKjU4IWrIPYNtoTX74Z0294jlmpA1hscNVPpQCZKJL8OTT0mEifdIsaGagx_vQ0B8uGp3mqvS5WXv14Q21L8zoEIglWon1GOJtZ7gJgUVC645n40NoZhGr_naOfvzanpfLwOaaEk7i8HP5LshJWpyWvY3Sp0 Oct 27 04:02:18.586520 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 04:02:18.586520 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 04:02:18.586520 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 04:02:18.586520 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 04:02:18.586520 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 04:02:18.586520 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 04:02:18.586520 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: a432dda4903145278d79210121b3f77d Oct 27 04:02:18.586520 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-505113127 Oct 27 04:02:18.586520 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 04:02:18.586520 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 04:02:18.586520 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a432dda4903145278d79210121b3f77d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a432dda4903145278d79210121b3f77d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a432dda4903145278d79210121b3f77d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a432dda4903145278d79210121b3f77d"}]}] Oct 27 04:02:18.586520 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-TestNetworkAdvancedServerOps-505113127 Oct 27 04:02:18.586520 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: a432dda4903145278d79210121b3f77d Oct 27 04:02:18.586520 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-505113127 Oct 27 04:02:18.586520 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-TestNetworkAdvancedServerOps-505113127-project Oct 27 04:02:18.586520 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 04:02:18.586520 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 04:02:18.586520 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: a2ea55b400c24827a28e816ea2a225aa Oct 27 04:02:18.586520 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-TestNetworkAdvancedServerOps-505113127-project Oct 27 04:02:18.586520 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 04:02:18.586520 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 16fe7721-d002-42e7-b7c5-8080841127f7 could not be found. Oct 27 04:02:18.586520 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '16fe7721-d002-42e7-b7c5-8080841127f7'} Oct 27 04:02:18.586520 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 04:02:18.586520 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:02:18.586520 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 04:02:18.586520 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 04:02:18.586520 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 04:02:18.586520 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 04:02:18.586520 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 04:02:18.586520 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 04:02:18.586520 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 04:02:18.586520 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 04:02:18.586520 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16fe7721-d002-42e7-b7c5-8080841127f7 could not be found. Oct 27 04:02:18.586520 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:02:18.586520 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:02:18.586520 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:02:18.586520 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:02:18.586520 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:02:18.586520 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:02:18.586520 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 04:02:18.586520 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 04:02:18.586520 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 04:02:18.586520 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 04:02:18.586520 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 04:02:18.586520 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 04:02:18.586520 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 04:02:18.586520 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 04:02:18.586520 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 04:02:18.586520 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 04:02:18.586520 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16fe7721-d002-42e7-b7c5-8080841127f7 could not be found. Oct 27 04:02:18.586520 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:02:18.586520 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:02:18.590582 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:02:18.590582 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:02:18.590582 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:02:18.590582 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:02:18.590582 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 04:02:18.590582 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 04:02:18.590582 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16fe7721-d002-42e7-b7c5-8080841127f7 could not be found. Oct 27 04:02:18.590582 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:02:18.592354 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3c671550-daf2-4786-bc17-7a1a729d34c4 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Returning 404 to user: Instance 16fe7721-d002-42e7-b7c5-8080841127f7 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 04:02:18.593478 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3c671550-daf2-4786-bc17-7a1a729d34c4 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "GET /compute/v2.1/servers/16fe7721-d002-42e7-b7c5-8080841127f7" status: 404 len: 111 microversion: 2.1 time: 0.044540 Oct 27 04:02:18.594444 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3456/6626] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:02:18 2022] GET /compute/v2.1/servers/16fe7721-d002-42e7-b7c5-8080841127f7 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 04:02:23.247410 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-36a44105-df8d-4d48-a0bd-4a9608be3e53 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] Calling method '.version_select at 0x7f7ddec435e0>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:02:23.392143 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-36a44105-df8d-4d48-a0bd-4a9608be3e53 tempest-TestNetworkAdvancedServerOps-505113127 tempest-TestNetworkAdvancedServerOps-505113127-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-841902232" status: 202 len: 0 microversion: 2.1 time: 0.148589 Oct 27 04:02:23.392751 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3171/6627] 10.222.0.20 () {58 vars in 1281 bytes} [Thu Oct 27 04:02:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-841902232 => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 04:02:37.545256 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-321ecae7-84f8-42f7-aa22-07626f4844ff tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:02:37.545755 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-321ecae7-84f8-42f7-aa22-07626f4844ff tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] [instance: 296dbea5-186c-4051-b5bd-88cb39abffbd] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:02:37.549809 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=8 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:02:37.550506 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=12 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:02:37.564999 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-321ecae7-84f8-42f7-aa22-07626f4844ff tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:02:37.564999 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-321ecae7-84f8-42f7-aa22-07626f4844ff tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:02:37.564999 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-321ecae7-84f8-42f7-aa22-07626f4844ff tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:02:37.566627 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-321ecae7-84f8-42f7-aa22-07626f4844ff tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:02:37.567841 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-321ecae7-84f8-42f7-aa22-07626f4844ff tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:02:37.570300 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-321ecae7-84f8-42f7-aa22-07626f4844ff tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:02:37.674007 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-321ecae7-84f8-42f7-aa22-07626f4844ff tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] 10.222.0.20 "GET /compute/v2.1/servers/296dbea5-186c-4051-b5bd-88cb39abffbd/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.132704 Oct 27 04:02:37.679714 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3457/6628] 10.222.0.20 () {58 vars in 1293 bytes} [Thu Oct 27 04:02:37 2022] GET /compute/v2.1/servers/296dbea5-186c-4051-b5bd-88cb39abffbd/os-server-password => generated 116 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:02:48.956714 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:02:48.957478 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:02:48.962097 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-714226e6-1e03-4a74-9e0d-28ba0a4c6aff tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Action: 'create', calling method: .version_select at 0x7f7ddaa88280>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1178891351", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCqSR4x+FARitzsd8GoWAoxoH/Emb0fGIaecRRGmsjqk2XkXwi8JsNMTZiohEelSgkT+MR/pxstZau9fdpn3qGUobxy1H1tuufdfuV0RuqRbuDBg1yfANVTDICMSY0h62g=="}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:02:48.986843 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-714226e6-1e03-4a74-9e0d-28ba0a4c6aff tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Getting quotas for project 9c921299382141f99cd9c4b6b11927a4. Resources: {'key_pairs'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 04:02:48.993460 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-714226e6-1e03-4a74-9e0d-28ba0a4c6aff tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Getting quotas for user 98bf808aeff6462794e5d6c653c72ae2 and project 9c921299382141f99cd9c4b6b11927a4. Resources: {'key_pairs'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 04:02:49.139311 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-714226e6-1e03-4a74-9e0d-28ba0a4c6aff tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.184566 Oct 27 04:02:49.140868 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3172/6629] 10.222.0.20 () {60 vars in 1159 bytes} [Thu Oct 27 04:02:48 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:02:52.194594 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e6314753-7c7f-482d-bed8-dc54aa7b6ef1 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1084937367", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": [{"uuid": "154a33b5-87fa-4228-91df-fa0375d45cae"}], "key_name": "tempest-TestNetworkBasicOps-1178891351", "security_groups": [{"name": "tempest-secgroup-smoke-964827187"}]}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:02:52.329505 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.network.neutron [None req-e6314753-7c7f-482d-bed8-dc54aa7b6ef1 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] validate_networks() for [('154a33b5-87fa-4228-91df-fa0375d45cae', None, None, None, None, None)] {{(pid=121001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 04:02:52.874805 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-e6314753-7c7f-482d-bed8-dc54aa7b6ef1 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Flavor limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 04:02:52.875239 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-e6314753-7c7f-482d-bed8-dc54aa7b6ef1 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Image limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 04:02:52.875916 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-e6314753-7c7f-482d-bed8-dc54aa7b6ef1 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Flavor pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 04:02:52.876340 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-e6314753-7c7f-482d-bed8-dc54aa7b6ef1 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Image pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 04:02:52.876779 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-e6314753-7c7f-482d-bed8-dc54aa7b6ef1 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 04:02:52.887757 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e6314753-7c7f-482d-bed8-dc54aa7b6ef1 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:02:52.888505 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e6314753-7c7f-482d-bed8-dc54aa7b6ef1 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:02:52.889120 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e6314753-7c7f-482d-bed8-dc54aa7b6ef1 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:02:52.889864 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e6314753-7c7f-482d-bed8-dc54aa7b6ef1 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:02:52.890536 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e6314753-7c7f-482d-bed8-dc54aa7b6ef1 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:02:52.891133 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e6314753-7c7f-482d-bed8-dc54aa7b6ef1 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:02:52.912364 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-e6314753-7c7f-482d-bed8-dc54aa7b6ef1 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Getting quotas for project 9c921299382141f99cd9c4b6b11927a4. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 04:02:52.923543 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-e6314753-7c7f-482d-bed8-dc54aa7b6ef1 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Getting quotas for user 98bf808aeff6462794e5d6c653c72ae2 and project 9c921299382141f99cd9c4b6b11927a4. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 04:02:52.938056 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e6314753-7c7f-482d-bed8-dc54aa7b6ef1 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Going to run 1 instances... {{(pid=121001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 04:02:52.940906 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e6314753-7c7f-482d-bed8-dc54aa7b6ef1 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] [instance: 23264674-8d93-4940-85c1-1b966018a9bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 04:02:53.068063 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e6314753-7c7f-482d-bed8-dc54aa7b6ef1 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.883367 Oct 27 04:02:53.068719 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3458/6630] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 04:02:52 2022] POST /compute/v2.1/servers => generated 405 bytes in 885 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 04:02:53.081871 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4a6fa935-b58b-4d3e-bfe7-63494912cb96 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:02:53.084407 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4a6fa935-b58b-4d3e-bfe7-63494912cb96 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] [instance: 23264674-8d93-4940-85c1-1b966018a9bd] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:02:53.154966 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4a6fa935-b58b-4d3e-bfe7-63494912cb96 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bf808aeff6462794e5d6c653c72ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c921299382141f99cd9c4b6b11927a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:02:53.169830 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4a6fa935-b58b-4d3e-bfe7-63494912cb96 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] 10.222.0.20 "GET /compute/v2.1/servers/23264674-8d93-4940-85c1-1b966018a9bd" status: 200 len: 1249 microversion: 2.1 time: 0.093347 Oct 27 04:02:53.171545 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3173/6631] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:02:53 2022] GET /compute/v2.1/servers/23264674-8d93-4940-85c1-1b966018a9bd => generated 1249 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:02:54.195573 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2c47d3a3-4307-416d-8f2e-cd98beb6436d tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:02:54.196513 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2c47d3a3-4307-416d-8f2e-cd98beb6436d tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] [instance: 23264674-8d93-4940-85c1-1b966018a9bd] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:02:54.252381 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2c47d3a3-4307-416d-8f2e-cd98beb6436d tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bf808aeff6462794e5d6c653c72ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c921299382141f99cd9c4b6b11927a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:02:54.262838 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2c47d3a3-4307-416d-8f2e-cd98beb6436d tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] 10.222.0.20 "GET /compute/v2.1/servers/23264674-8d93-4940-85c1-1b966018a9bd" status: 200 len: 1249 microversion: 2.1 time: 0.072458 Oct 27 04:02:54.263419 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3459/6632] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:02:54 2022] GET /compute/v2.1/servers/23264674-8d93-4940-85c1-1b966018a9bd => generated 1249 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:02:55.286511 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ec3f5077-093d-4563-9c0a-cb82c7ddfecb tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:02:55.287136 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ec3f5077-093d-4563-9c0a-cb82c7ddfecb tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] [instance: 23264674-8d93-4940-85c1-1b966018a9bd] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:02:55.295290 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ec3f5077-093d-4563-9c0a-cb82c7ddfecb tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:02:55.296057 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ec3f5077-093d-4563-9c0a-cb82c7ddfecb tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:02:55.296685 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ec3f5077-093d-4563-9c0a-cb82c7ddfecb tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:02:55.297424 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ec3f5077-093d-4563-9c0a-cb82c7ddfecb tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:02:55.297890 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ec3f5077-093d-4563-9c0a-cb82c7ddfecb tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:02:55.298390 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ec3f5077-093d-4563-9c0a-cb82c7ddfecb tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:02:55.371143 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ec3f5077-093d-4563-9c0a-cb82c7ddfecb tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bf808aeff6462794e5d6c653c72ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c921299382141f99cd9c4b6b11927a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:02:55.379331 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ec3f5077-093d-4563-9c0a-cb82c7ddfecb tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] 10.222.0.20 "GET /compute/v2.1/servers/23264674-8d93-4940-85c1-1b966018a9bd" status: 200 len: 1301 microversion: 2.1 time: 0.097588 Oct 27 04:02:55.379951 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3174/6633] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:02:55 2022] GET /compute/v2.1/servers/23264674-8d93-4940-85c1-1b966018a9bd => generated 1301 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:02:56.402747 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b692d169-f3e6-45dc-a08f-d9c323a2ab8a tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:02:56.403401 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b692d169-f3e6-45dc-a08f-d9c323a2ab8a tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] [instance: 23264674-8d93-4940-85c1-1b966018a9bd] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:02:56.410426 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b692d169-f3e6-45dc-a08f-d9c323a2ab8a tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:02:56.410929 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b692d169-f3e6-45dc-a08f-d9c323a2ab8a tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:02:56.411944 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b692d169-f3e6-45dc-a08f-d9c323a2ab8a tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:02:56.412652 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b692d169-f3e6-45dc-a08f-d9c323a2ab8a tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:02:56.413115 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b692d169-f3e6-45dc-a08f-d9c323a2ab8a tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:02:56.413546 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b692d169-f3e6-45dc-a08f-d9c323a2ab8a tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:02:56.479854 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b692d169-f3e6-45dc-a08f-d9c323a2ab8a tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bf808aeff6462794e5d6c653c72ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c921299382141f99cd9c4b6b11927a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:02:56.487987 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b692d169-f3e6-45dc-a08f-d9c323a2ab8a tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] 10.222.0.20 "GET /compute/v2.1/servers/23264674-8d93-4940-85c1-1b966018a9bd" status: 200 len: 1319 microversion: 2.1 time: 0.089004 Oct 27 04:02:56.488672 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3460/6634] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:02:56 2022] GET /compute/v2.1/servers/23264674-8d93-4940-85c1-1b966018a9bd => generated 1319 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:02:57.512282 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a67cf564-d571-416f-b4d1-ff3231917bf8 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:02:57.513528 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a67cf564-d571-416f-b4d1-ff3231917bf8 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] [instance: 23264674-8d93-4940-85c1-1b966018a9bd] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:02:57.521714 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a67cf564-d571-416f-b4d1-ff3231917bf8 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:02:57.522170 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a67cf564-d571-416f-b4d1-ff3231917bf8 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:02:57.522623 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a67cf564-d571-416f-b4d1-ff3231917bf8 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:02:57.523343 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a67cf564-d571-416f-b4d1-ff3231917bf8 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:02:57.523807 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a67cf564-d571-416f-b4d1-ff3231917bf8 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:02:57.524239 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a67cf564-d571-416f-b4d1-ff3231917bf8 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:02:57.667203 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0829c092-bc87-4e56-9acc-6b3acb9e356a tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1236741750", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": [{"uuid": "379591cd-f262-4404-bac2-3659aebababd"}]}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:02:57.673174 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a67cf564-d571-416f-b4d1-ff3231917bf8 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bf808aeff6462794e5d6c653c72ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c921299382141f99cd9c4b6b11927a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:02:57.682712 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a67cf564-d571-416f-b4d1-ff3231917bf8 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] 10.222.0.20 "GET /compute/v2.1/servers/23264674-8d93-4940-85c1-1b966018a9bd" status: 200 len: 1374 microversion: 2.1 time: 0.174381 Oct 27 04:02:57.683351 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3175/6635] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:02:57 2022] GET /compute/v2.1/servers/23264674-8d93-4940-85c1-1b966018a9bd => generated 1374 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:02:57.728882 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.network.neutron [None req-0829c092-bc87-4e56-9acc-6b3acb9e356a tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] validate_networks() for [('379591cd-f262-4404-bac2-3659aebababd', None, None, None, None, None)] {{(pid=121001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 04:02:58.572853 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-0829c092-bc87-4e56-9acc-6b3acb9e356a tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Flavor limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 04:02:58.573297 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-0829c092-bc87-4e56-9acc-6b3acb9e356a tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Image limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 04:02:58.573789 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-0829c092-bc87-4e56-9acc-6b3acb9e356a tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Flavor pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 04:02:58.574245 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-0829c092-bc87-4e56-9acc-6b3acb9e356a tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Image pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 04:02:58.575618 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-0829c092-bc87-4e56-9acc-6b3acb9e356a tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 04:02:58.584191 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0829c092-bc87-4e56-9acc-6b3acb9e356a tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:02:58.584694 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0829c092-bc87-4e56-9acc-6b3acb9e356a tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:02:58.585152 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0829c092-bc87-4e56-9acc-6b3acb9e356a tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:02:58.585907 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0829c092-bc87-4e56-9acc-6b3acb9e356a tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:02:58.586413 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0829c092-bc87-4e56-9acc-6b3acb9e356a tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:02:58.586856 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0829c092-bc87-4e56-9acc-6b3acb9e356a tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:02:58.604272 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-0829c092-bc87-4e56-9acc-6b3acb9e356a tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Getting quotas for project 7839538936e24003bfb69cf2efabc29f. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 04:02:58.609497 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-0829c092-bc87-4e56-9acc-6b3acb9e356a tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Getting quotas for user 53ab6fd880a3424693ce9c71f77ff40c and project 7839538936e24003bfb69cf2efabc29f. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 04:02:58.623106 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0829c092-bc87-4e56-9acc-6b3acb9e356a tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Going to run 1 instances... {{(pid=121001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 04:02:58.625386 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0829c092-bc87-4e56-9acc-6b3acb9e356a tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] [instance: d2bc8eb5-9eba-4963-a6b6-90774b577454] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 04:02:58.777194 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0829c092-bc87-4e56-9acc-6b3acb9e356a tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.115771 Oct 27 04:02:58.779026 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3461/6636] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 04:02:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1118 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 04:02:58.785253 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-21e22564-1aae-4908-9946-16526befdc84 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:02:58.786350 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-21e22564-1aae-4908-9946-16526befdc84 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] [instance: 23264674-8d93-4940-85c1-1b966018a9bd] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:02:58.793092 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-21e22564-1aae-4908-9946-16526befdc84 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:02:58.793797 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-21e22564-1aae-4908-9946-16526befdc84 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:02:58.794398 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-21e22564-1aae-4908-9946-16526befdc84 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:02:58.795170 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-21e22564-1aae-4908-9946-16526befdc84 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:02:58.795630 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-21e22564-1aae-4908-9946-16526befdc84 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:02:58.796066 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-21e22564-1aae-4908-9946-16526befdc84 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:02:58.929986 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-2337d0cc-9c27-4be4-b0d1-2142392ccef5 req-2d1a5ff6-eade-40d7-b3fa-ce16e29e3c7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23264674-8d93-4940-85c1-1b966018a9bd", "tag": "0c136851-16a1-41cc-810e-35dcd67481cf"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:02:58.939952 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-2337d0cc-9c27-4be4-b0d1-2142392ccef5 req-2d1a5ff6-eade-40d7-b3fa-ce16e29e3c7f service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:02:58.940480 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-2337d0cc-9c27-4be4-b0d1-2142392ccef5 req-2d1a5ff6-eade-40d7-b3fa-ce16e29e3c7f service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:02:58.940922 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-2337d0cc-9c27-4be4-b0d1-2142392ccef5 req-2d1a5ff6-eade-40d7-b3fa-ce16e29e3c7f service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:02:58.953541 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-2337d0cc-9c27-4be4-b0d1-2142392ccef5 req-2d1a5ff6-eade-40d7-b3fa-ce16e29e3c7f service nova] Creating event network-changed:0c136851-16a1-41cc-810e-35dcd67481cf for instance 23264674-8d93-4940-85c1-1b966018a9bd on n-h2-862769-1 Oct 27 04:02:58.959339 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-2337d0cc-9c27-4be4-b0d1-2142392ccef5 req-2d1a5ff6-eade-40d7-b3fa-ce16e29e3c7f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.256502 Oct 27 04:02:58.960263 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3176/6637] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:02:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 04:02:58.965436 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1b452ac4-af76-4abc-9c76-0c78ad7682fa tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:02:58.966374 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1b452ac4-af76-4abc-9c76-0c78ad7682fa tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] [instance: d2bc8eb5-9eba-4963-a6b6-90774b577454] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:02:59.025241 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1b452ac4-af76-4abc-9c76-0c78ad7682fa tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53ab6fd880a3424693ce9c71f77ff40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7839538936e24003bfb69cf2efabc29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:02:59.029660 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-21e22564-1aae-4908-9946-16526befdc84 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bf808aeff6462794e5d6c653c72ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c921299382141f99cd9c4b6b11927a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:02:59.033054 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1b452ac4-af76-4abc-9c76-0c78ad7682fa tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] 10.222.0.20 "GET /compute/v2.1/servers/d2bc8eb5-9eba-4963-a6b6-90774b577454" status: 200 len: 1214 microversion: 2.1 time: 0.071550 Oct 27 04:02:59.045873 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3177/6638] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:02:58 2022] GET /compute/v2.1/servers/d2bc8eb5-9eba-4963-a6b6-90774b577454 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:02:59.048752 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-21e22564-1aae-4908-9946-16526befdc84 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] 10.222.0.20 "GET /compute/v2.1/servers/23264674-8d93-4940-85c1-1b966018a9bd" status: 200 len: 1374 microversion: 2.1 time: 0.267296 Oct 27 04:02:59.049372 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3462/6639] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:02:58 2022] GET /compute/v2.1/servers/23264674-8d93-4940-85c1-1b966018a9bd => generated 1374 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:03:00.057447 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4aaa7b2d-7eed-4bf4-8894-0f0620e37ebb tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:03:00.058094 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4aaa7b2d-7eed-4bf4-8894-0f0620e37ebb tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] [instance: d2bc8eb5-9eba-4963-a6b6-90774b577454] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:03:00.073792 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-784caaa5-513b-471a-bee7-e8456a5df98e tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:03:00.074638 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-784caaa5-513b-471a-bee7-e8456a5df98e tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] [instance: 23264674-8d93-4940-85c1-1b966018a9bd] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:03:00.082021 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-784caaa5-513b-471a-bee7-e8456a5df98e tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:00.082729 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-784caaa5-513b-471a-bee7-e8456a5df98e tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:00.083216 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-784caaa5-513b-471a-bee7-e8456a5df98e tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:00.084082 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-784caaa5-513b-471a-bee7-e8456a5df98e tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:00.084509 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-784caaa5-513b-471a-bee7-e8456a5df98e tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:00.085069 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-784caaa5-513b-471a-bee7-e8456a5df98e tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:00.116580 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4aaa7b2d-7eed-4bf4-8894-0f0620e37ebb tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53ab6fd880a3424693ce9c71f77ff40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7839538936e24003bfb69cf2efabc29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:03:00.124931 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4aaa7b2d-7eed-4bf4-8894-0f0620e37ebb tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] 10.222.0.20 "GET /compute/v2.1/servers/d2bc8eb5-9eba-4963-a6b6-90774b577454" status: 200 len: 1214 microversion: 2.1 time: 0.071645 Oct 27 04:03:00.127534 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3178/6640] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:03:00 2022] GET /compute/v2.1/servers/d2bc8eb5-9eba-4963-a6b6-90774b577454 => generated 1214 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:03:00.220421 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-784caaa5-513b-471a-bee7-e8456a5df98e tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bf808aeff6462794e5d6c653c72ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c921299382141f99cd9c4b6b11927a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:03:00.228476 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-784caaa5-513b-471a-bee7-e8456a5df98e tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] 10.222.0.20 "GET /compute/v2.1/servers/23264674-8d93-4940-85c1-1b966018a9bd" status: 200 len: 1374 microversion: 2.1 time: 0.158712 Oct 27 04:03:00.229226 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3463/6641] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:03:00 2022] GET /compute/v2.1/servers/23264674-8d93-4940-85c1-1b966018a9bd => generated 1374 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 04:03:01.150212 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7f33e03d-0851-44af-93eb-b35521c5833c tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:03:01.150841 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7f33e03d-0851-44af-93eb-b35521c5833c tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] [instance: d2bc8eb5-9eba-4963-a6b6-90774b577454] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:03:01.157863 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7f33e03d-0851-44af-93eb-b35521c5833c tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:01.161573 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7f33e03d-0851-44af-93eb-b35521c5833c tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:01.161573 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7f33e03d-0851-44af-93eb-b35521c5833c tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:01.161573 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7f33e03d-0851-44af-93eb-b35521c5833c tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:01.161573 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7f33e03d-0851-44af-93eb-b35521c5833c tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:01.161573 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7f33e03d-0851-44af-93eb-b35521c5833c tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:01.252193 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-82e3f3d7-093f-45b3-91d6-a4a4cb435c4d tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:03:01.252822 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-82e3f3d7-093f-45b3-91d6-a4a4cb435c4d tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] [instance: 23264674-8d93-4940-85c1-1b966018a9bd] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:03:01.265081 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7f33e03d-0851-44af-93eb-b35521c5833c tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53ab6fd880a3424693ce9c71f77ff40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7839538936e24003bfb69cf2efabc29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:03:01.266520 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-82e3f3d7-093f-45b3-91d6-a4a4cb435c4d tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:01.267444 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-82e3f3d7-093f-45b3-91d6-a4a4cb435c4d tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:01.267895 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-82e3f3d7-093f-45b3-91d6-a4a4cb435c4d tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:01.269604 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-82e3f3d7-093f-45b3-91d6-a4a4cb435c4d tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:01.270341 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-82e3f3d7-093f-45b3-91d6-a4a4cb435c4d tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:01.271545 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-82e3f3d7-093f-45b3-91d6-a4a4cb435c4d tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:01.276268 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7f33e03d-0851-44af-93eb-b35521c5833c tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] 10.222.0.20 "GET /compute/v2.1/servers/d2bc8eb5-9eba-4963-a6b6-90774b577454" status: 200 len: 1218 microversion: 2.1 time: 0.128142 Oct 27 04:03:01.291085 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3179/6642] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:03:01 2022] GET /compute/v2.1/servers/d2bc8eb5-9eba-4963-a6b6-90774b577454 => generated 1218 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:03:01.509104 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-82e3f3d7-093f-45b3-91d6-a4a4cb435c4d tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bf808aeff6462794e5d6c653c72ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c921299382141f99cd9c4b6b11927a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:03:01.524798 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-82e3f3d7-093f-45b3-91d6-a4a4cb435c4d tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] 10.222.0.20 "GET /compute/v2.1/servers/23264674-8d93-4940-85c1-1b966018a9bd" status: 200 len: 1374 microversion: 2.1 time: 0.276514 Oct 27 04:03:01.525535 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3464/6643] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:03:01 2022] GET /compute/v2.1/servers/23264674-8d93-4940-85c1-1b966018a9bd => generated 1374 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 04:03:02.304343 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-af07adc7-156e-4e1e-b3c0-9bca346c844f tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:03:02.304961 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-af07adc7-156e-4e1e-b3c0-9bca346c844f tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] [instance: d2bc8eb5-9eba-4963-a6b6-90774b577454] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:03:02.311816 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-af07adc7-156e-4e1e-b3c0-9bca346c844f tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:02.312365 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-af07adc7-156e-4e1e-b3c0-9bca346c844f tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:02.312800 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-af07adc7-156e-4e1e-b3c0-9bca346c844f tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:02.313800 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-af07adc7-156e-4e1e-b3c0-9bca346c844f tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:02.314286 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-af07adc7-156e-4e1e-b3c0-9bca346c844f tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:02.314716 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-af07adc7-156e-4e1e-b3c0-9bca346c844f tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:02.380651 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-af07adc7-156e-4e1e-b3c0-9bca346c844f tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53ab6fd880a3424693ce9c71f77ff40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7839538936e24003bfb69cf2efabc29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:03:02.389507 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-af07adc7-156e-4e1e-b3c0-9bca346c844f tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] 10.222.0.20 "GET /compute/v2.1/servers/d2bc8eb5-9eba-4963-a6b6-90774b577454" status: 200 len: 1266 microversion: 2.1 time: 0.089478 Oct 27 04:03:02.390238 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3180/6644] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:03:02 2022] GET /compute/v2.1/servers/d2bc8eb5-9eba-4963-a6b6-90774b577454 => generated 1266 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:03:02.548724 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0a9d2bd9-ff1c-45d1-ae9b-0d33f05ce7b2 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:03:02.556041 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0a9d2bd9-ff1c-45d1-ae9b-0d33f05ce7b2 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] [instance: 23264674-8d93-4940-85c1-1b966018a9bd] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:03:02.557346 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0a9d2bd9-ff1c-45d1-ae9b-0d33f05ce7b2 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:02.557886 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0a9d2bd9-ff1c-45d1-ae9b-0d33f05ce7b2 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:02.558368 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0a9d2bd9-ff1c-45d1-ae9b-0d33f05ce7b2 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:02.559090 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0a9d2bd9-ff1c-45d1-ae9b-0d33f05ce7b2 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:02.559581 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0a9d2bd9-ff1c-45d1-ae9b-0d33f05ce7b2 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:02.560018 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0a9d2bd9-ff1c-45d1-ae9b-0d33f05ce7b2 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:02.740661 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0a9d2bd9-ff1c-45d1-ae9b-0d33f05ce7b2 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bf808aeff6462794e5d6c653c72ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c921299382141f99cd9c4b6b11927a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:03:02.750982 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0a9d2bd9-ff1c-45d1-ae9b-0d33f05ce7b2 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] 10.222.0.20 "GET /compute/v2.1/servers/23264674-8d93-4940-85c1-1b966018a9bd" status: 200 len: 1374 microversion: 2.1 time: 0.206680 Oct 27 04:03:02.751646 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3465/6645] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:03:02 2022] GET /compute/v2.1/servers/23264674-8d93-4940-85c1-1b966018a9bd => generated 1374 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:03:03.416079 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4bac0db1-2ad9-489f-a6f3-3495da3ae8e9 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:03:03.418359 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4bac0db1-2ad9-489f-a6f3-3495da3ae8e9 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] [instance: d2bc8eb5-9eba-4963-a6b6-90774b577454] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:03:03.426386 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4bac0db1-2ad9-489f-a6f3-3495da3ae8e9 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:03.427759 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4bac0db1-2ad9-489f-a6f3-3495da3ae8e9 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:03.428202 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4bac0db1-2ad9-489f-a6f3-3495da3ae8e9 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:03.428908 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4bac0db1-2ad9-489f-a6f3-3495da3ae8e9 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:03.429625 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4bac0db1-2ad9-489f-a6f3-3495da3ae8e9 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:03.430844 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4bac0db1-2ad9-489f-a6f3-3495da3ae8e9 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:03.588860 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4bac0db1-2ad9-489f-a6f3-3495da3ae8e9 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53ab6fd880a3424693ce9c71f77ff40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7839538936e24003bfb69cf2efabc29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:03:03.597108 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4bac0db1-2ad9-489f-a6f3-3495da3ae8e9 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] 10.222.0.20 "GET /compute/v2.1/servers/d2bc8eb5-9eba-4963-a6b6-90774b577454" status: 200 len: 1314 microversion: 2.1 time: 0.188168 Oct 27 04:03:03.597928 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3181/6646] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:03:03 2022] GET /compute/v2.1/servers/d2bc8eb5-9eba-4963-a6b6-90774b577454 => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 04:03:03.776024 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7f37b31b-f374-4754-be90-ecebfdbe86fd tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:03:03.776978 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7f37b31b-f374-4754-be90-ecebfdbe86fd tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] [instance: 23264674-8d93-4940-85c1-1b966018a9bd] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:03:03.785478 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7f37b31b-f374-4754-be90-ecebfdbe86fd tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:03.789319 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7f37b31b-f374-4754-be90-ecebfdbe86fd tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:03.789319 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7f37b31b-f374-4754-be90-ecebfdbe86fd tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:03.789319 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7f37b31b-f374-4754-be90-ecebfdbe86fd tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:03.789960 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7f37b31b-f374-4754-be90-ecebfdbe86fd tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:03.790631 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7f37b31b-f374-4754-be90-ecebfdbe86fd tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:04.033266 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7f37b31b-f374-4754-be90-ecebfdbe86fd tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bf808aeff6462794e5d6c653c72ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c921299382141f99cd9c4b6b11927a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:03:04.042494 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7f37b31b-f374-4754-be90-ecebfdbe86fd tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] 10.222.0.20 "GET /compute/v2.1/servers/23264674-8d93-4940-85c1-1b966018a9bd" status: 200 len: 1374 microversion: 2.1 time: 0.271604 Oct 27 04:03:04.043088 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3466/6647] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:03:03 2022] GET /compute/v2.1/servers/23264674-8d93-4940-85c1-1b966018a9bd => generated 1374 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:03:04.329097 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-2b29708a-eae1-48e7-bd1b-c1e02d574fce req-576e8d99-f92c-4d74-bca0-fa350bcb3e5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2bc8eb5-9eba-4963-a6b6-90774b577454", "tag": "a6ba1314-2c0e-4446-8b8b-f039a4366a9f"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:03:04.341479 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-2b29708a-eae1-48e7-bd1b-c1e02d574fce req-576e8d99-f92c-4d74-bca0-fa350bcb3e5b service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:04.341964 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-2b29708a-eae1-48e7-bd1b-c1e02d574fce req-576e8d99-f92c-4d74-bca0-fa350bcb3e5b service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:04.342727 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-2b29708a-eae1-48e7-bd1b-c1e02d574fce req-576e8d99-f92c-4d74-bca0-fa350bcb3e5b service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:04.354588 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-2b29708a-eae1-48e7-bd1b-c1e02d574fce req-576e8d99-f92c-4d74-bca0-fa350bcb3e5b service nova] Creating event network-changed:a6ba1314-2c0e-4446-8b8b-f039a4366a9f for instance d2bc8eb5-9eba-4963-a6b6-90774b577454 on n-h1-862769-1 Oct 27 04:03:04.360115 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-2b29708a-eae1-48e7-bd1b-c1e02d574fce req-576e8d99-f92c-4d74-bca0-fa350bcb3e5b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035288 Oct 27 04:03:04.360797 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3182/6648] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:03:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:03:04.621085 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5c1e0782-1f84-49cb-a7ce-46bbf8d539a1 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:03:04.621728 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5c1e0782-1f84-49cb-a7ce-46bbf8d539a1 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] [instance: d2bc8eb5-9eba-4963-a6b6-90774b577454] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:03:04.629672 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5c1e0782-1f84-49cb-a7ce-46bbf8d539a1 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:04.630170 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5c1e0782-1f84-49cb-a7ce-46bbf8d539a1 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:04.630620 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5c1e0782-1f84-49cb-a7ce-46bbf8d539a1 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:04.631343 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5c1e0782-1f84-49cb-a7ce-46bbf8d539a1 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:04.632062 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5c1e0782-1f84-49cb-a7ce-46bbf8d539a1 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:04.632664 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5c1e0782-1f84-49cb-a7ce-46bbf8d539a1 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:04.881232 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5c1e0782-1f84-49cb-a7ce-46bbf8d539a1 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53ab6fd880a3424693ce9c71f77ff40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7839538936e24003bfb69cf2efabc29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:03:04.899056 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5c1e0782-1f84-49cb-a7ce-46bbf8d539a1 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] 10.222.0.20 "GET /compute/v2.1/servers/d2bc8eb5-9eba-4963-a6b6-90774b577454" status: 200 len: 1314 microversion: 2.1 time: 0.281874 Oct 27 04:03:04.908588 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3467/6649] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:03:04 2022] GET /compute/v2.1/servers/d2bc8eb5-9eba-4963-a6b6-90774b577454 => generated 1314 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:03:05.066461 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-41c86224-2ec0-40db-a143-b62954314818 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:03:05.067567 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-41c86224-2ec0-40db-a143-b62954314818 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] [instance: 23264674-8d93-4940-85c1-1b966018a9bd] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:03:05.073953 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-41c86224-2ec0-40db-a143-b62954314818 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:05.074548 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-41c86224-2ec0-40db-a143-b62954314818 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:05.075094 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-41c86224-2ec0-40db-a143-b62954314818 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:05.075815 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-41c86224-2ec0-40db-a143-b62954314818 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:05.076289 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-41c86224-2ec0-40db-a143-b62954314818 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:05.076783 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-41c86224-2ec0-40db-a143-b62954314818 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:05.226304 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-41c86224-2ec0-40db-a143-b62954314818 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bf808aeff6462794e5d6c653c72ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c921299382141f99cd9c4b6b11927a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:03:05.236274 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-41c86224-2ec0-40db-a143-b62954314818 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] 10.222.0.20 "GET /compute/v2.1/servers/23264674-8d93-4940-85c1-1b966018a9bd" status: 200 len: 1374 microversion: 2.1 time: 0.175071 Oct 27 04:03:05.243632 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3183/6650] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:03:05 2022] GET /compute/v2.1/servers/23264674-8d93-4940-85c1-1b966018a9bd => generated 1374 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:03:05.561243 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-015260d9-bad3-480c-a710-67f2906a8e97 req-7cd83ec9-3314-42b3-a856-e27f23f28f0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23264674-8d93-4940-85c1-1b966018a9bd", "name": "network-vif-plugged", "status": "completed", "tag": "0c136851-16a1-41cc-810e-35dcd67481cf"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:03:05.571774 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-015260d9-bad3-480c-a710-67f2906a8e97 req-7cd83ec9-3314-42b3-a856-e27f23f28f0b service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:05.572281 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-015260d9-bad3-480c-a710-67f2906a8e97 req-7cd83ec9-3314-42b3-a856-e27f23f28f0b service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:05.572717 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-015260d9-bad3-480c-a710-67f2906a8e97 req-7cd83ec9-3314-42b3-a856-e27f23f28f0b service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:05.584467 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-015260d9-bad3-480c-a710-67f2906a8e97 req-7cd83ec9-3314-42b3-a856-e27f23f28f0b service nova] Creating event network-vif-plugged:0c136851-16a1-41cc-810e-35dcd67481cf for instance 23264674-8d93-4940-85c1-1b966018a9bd on n-h2-862769-1 Oct 27 04:03:05.591462 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-015260d9-bad3-480c-a710-67f2906a8e97 req-7cd83ec9-3314-42b3-a856-e27f23f28f0b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108295 Oct 27 04:03:05.591462 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3468/6651] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:03:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:03:05.921897 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-488b8115-2583-404e-8de5-efd9c5f37f3f tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:03:05.922553 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-488b8115-2583-404e-8de5-efd9c5f37f3f tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] [instance: d2bc8eb5-9eba-4963-a6b6-90774b577454] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:03:05.928748 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-488b8115-2583-404e-8de5-efd9c5f37f3f tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:05.929237 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-488b8115-2583-404e-8de5-efd9c5f37f3f tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:05.929669 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-488b8115-2583-404e-8de5-efd9c5f37f3f tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:05.930401 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-488b8115-2583-404e-8de5-efd9c5f37f3f tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:05.930856 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-488b8115-2583-404e-8de5-efd9c5f37f3f tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:05.931288 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-488b8115-2583-404e-8de5-efd9c5f37f3f tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:06.068699 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-488b8115-2583-404e-8de5-efd9c5f37f3f tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53ab6fd880a3424693ce9c71f77ff40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7839538936e24003bfb69cf2efabc29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:03:06.076635 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-488b8115-2583-404e-8de5-efd9c5f37f3f tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] 10.222.0.20 "GET /compute/v2.1/servers/d2bc8eb5-9eba-4963-a6b6-90774b577454" status: 200 len: 1314 microversion: 2.1 time: 0.158608 Oct 27 04:03:06.077218 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3184/6652] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:03:05 2022] GET /compute/v2.1/servers/d2bc8eb5-9eba-4963-a6b6-90774b577454 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:03:06.262542 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4932691c-e358-467a-b554-f62356f13838 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:03:06.263422 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4932691c-e358-467a-b554-f62356f13838 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] [instance: 23264674-8d93-4940-85c1-1b966018a9bd] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:03:06.269726 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4932691c-e358-467a-b554-f62356f13838 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:06.270204 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4932691c-e358-467a-b554-f62356f13838 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:06.270727 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4932691c-e358-467a-b554-f62356f13838 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:06.271443 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4932691c-e358-467a-b554-f62356f13838 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:06.271910 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4932691c-e358-467a-b554-f62356f13838 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:06.272344 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4932691c-e358-467a-b554-f62356f13838 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:06.405747 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4932691c-e358-467a-b554-f62356f13838 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bf808aeff6462794e5d6c653c72ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c921299382141f99cd9c4b6b11927a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:03:06.414217 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4932691c-e358-467a-b554-f62356f13838 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] 10.222.0.20 "GET /compute/v2.1/servers/23264674-8d93-4940-85c1-1b966018a9bd" status: 200 len: 1374 microversion: 2.1 time: 0.157008 Oct 27 04:03:06.414791 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3469/6653] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:03:06 2022] GET /compute/v2.1/servers/23264674-8d93-4940-85c1-1b966018a9bd => generated 1374 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 04:03:07.100886 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4e60ee17-4550-4655-bdb7-4266d9dbbe41 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:03:07.101567 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4e60ee17-4550-4655-bdb7-4266d9dbbe41 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] [instance: d2bc8eb5-9eba-4963-a6b6-90774b577454] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:03:07.108697 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4e60ee17-4550-4655-bdb7-4266d9dbbe41 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:07.109189 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4e60ee17-4550-4655-bdb7-4266d9dbbe41 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:07.109631 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4e60ee17-4550-4655-bdb7-4266d9dbbe41 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:07.110372 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4e60ee17-4550-4655-bdb7-4266d9dbbe41 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:07.110827 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4e60ee17-4550-4655-bdb7-4266d9dbbe41 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:07.111252 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4e60ee17-4550-4655-bdb7-4266d9dbbe41 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:07.246016 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4e60ee17-4550-4655-bdb7-4266d9dbbe41 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53ab6fd880a3424693ce9c71f77ff40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7839538936e24003bfb69cf2efabc29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:03:07.253776 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4e60ee17-4550-4655-bdb7-4266d9dbbe41 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] 10.222.0.20 "GET /compute/v2.1/servers/d2bc8eb5-9eba-4963-a6b6-90774b577454" status: 200 len: 1314 microversion: 2.1 time: 0.157320 Oct 27 04:03:07.254376 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3185/6654] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:03:07 2022] GET /compute/v2.1/servers/d2bc8eb5-9eba-4963-a6b6-90774b577454 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:03:07.437279 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-96526028-5977-4e85-8bd1-71b004ab9d4d tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:03:07.437938 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-96526028-5977-4e85-8bd1-71b004ab9d4d tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] [instance: 23264674-8d93-4940-85c1-1b966018a9bd] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:03:07.445085 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-96526028-5977-4e85-8bd1-71b004ab9d4d tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:07.445577 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-96526028-5977-4e85-8bd1-71b004ab9d4d tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:07.446043 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-96526028-5977-4e85-8bd1-71b004ab9d4d tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:07.446769 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-96526028-5977-4e85-8bd1-71b004ab9d4d tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:07.447234 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-96526028-5977-4e85-8bd1-71b004ab9d4d tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:07.447668 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-96526028-5977-4e85-8bd1-71b004ab9d4d tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:07.586482 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-96526028-5977-4e85-8bd1-71b004ab9d4d tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bf808aeff6462794e5d6c653c72ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c921299382141f99cd9c4b6b11927a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:03:07.594373 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-96526028-5977-4e85-8bd1-71b004ab9d4d tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] 10.222.0.20 "GET /compute/v2.1/servers/23264674-8d93-4940-85c1-1b966018a9bd" status: 200 len: 1546 microversion: 2.1 time: 0.161059 Oct 27 04:03:07.594951 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3470/6655] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:03:07 2022] GET /compute/v2.1/servers/23264674-8d93-4940-85c1-1b966018a9bd => generated 1546 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:03:07.617018 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-85565108-27a4-44bc-a0ad-020274506862 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:03:07.617654 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-85565108-27a4-44bc-a0ad-020274506862 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] [instance: 23264674-8d93-4940-85c1-1b966018a9bd] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:03:07.623628 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-85565108-27a4-44bc-a0ad-020274506862 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:07.624117 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-85565108-27a4-44bc-a0ad-020274506862 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:07.624554 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-85565108-27a4-44bc-a0ad-020274506862 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:07.625245 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-85565108-27a4-44bc-a0ad-020274506862 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:07.625702 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-85565108-27a4-44bc-a0ad-020274506862 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:07.626153 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-85565108-27a4-44bc-a0ad-020274506862 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:07.759848 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-85565108-27a4-44bc-a0ad-020274506862 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bf808aeff6462794e5d6c653c72ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c921299382141f99cd9c4b6b11927a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:03:07.767807 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-85565108-27a4-44bc-a0ad-020274506862 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] 10.222.0.20 "GET /compute/v2.1/servers/23264674-8d93-4940-85c1-1b966018a9bd" status: 200 len: 1546 microversion: 2.1 time: 0.154683 Oct 27 04:03:07.768394 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3186/6656] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:03:07 2022] GET /compute/v2.1/servers/23264674-8d93-4940-85c1-1b966018a9bd => generated 1546 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:03:08.277615 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ea9e4f11-444d-4d30-bec4-5613114e72e3 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:03:08.278377 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ea9e4f11-444d-4d30-bec4-5613114e72e3 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] [instance: d2bc8eb5-9eba-4963-a6b6-90774b577454] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:03:08.285322 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ea9e4f11-444d-4d30-bec4-5613114e72e3 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:08.285822 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ea9e4f11-444d-4d30-bec4-5613114e72e3 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:08.286506 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ea9e4f11-444d-4d30-bec4-5613114e72e3 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:08.287238 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ea9e4f11-444d-4d30-bec4-5613114e72e3 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:08.287745 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ea9e4f11-444d-4d30-bec4-5613114e72e3 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:08.288184 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ea9e4f11-444d-4d30-bec4-5613114e72e3 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:08.426470 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ea9e4f11-444d-4d30-bec4-5613114e72e3 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53ab6fd880a3424693ce9c71f77ff40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7839538936e24003bfb69cf2efabc29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:03:08.434440 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ea9e4f11-444d-4d30-bec4-5613114e72e3 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] 10.222.0.20 "GET /compute/v2.1/servers/d2bc8eb5-9eba-4963-a6b6-90774b577454" status: 200 len: 1314 microversion: 2.1 time: 0.161325 Oct 27 04:03:08.440599 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3471/6657] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:03:08 2022] GET /compute/v2.1/servers/d2bc8eb5-9eba-4963-a6b6-90774b577454 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:03:09.459330 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6debdc75-7f81-4df2-8e99-00def7ed4399 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:03:09.462492 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6debdc75-7f81-4df2-8e99-00def7ed4399 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] [instance: d2bc8eb5-9eba-4963-a6b6-90774b577454] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:03:09.470627 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6debdc75-7f81-4df2-8e99-00def7ed4399 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:09.471192 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6debdc75-7f81-4df2-8e99-00def7ed4399 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:09.471701 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6debdc75-7f81-4df2-8e99-00def7ed4399 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:09.472622 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6debdc75-7f81-4df2-8e99-00def7ed4399 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:09.473173 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6debdc75-7f81-4df2-8e99-00def7ed4399 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:09.473691 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6debdc75-7f81-4df2-8e99-00def7ed4399 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:09.678117 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-123ef110-9850-47ed-824f-26052bbbbff8 req-bc6b38e0-ada9-4643-9b31-260e1faeddfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2bc8eb5-9eba-4963-a6b6-90774b577454", "name": "network-vif-plugged", "status": "completed", "tag": "a6ba1314-2c0e-4446-8b8b-f039a4366a9f"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:03:09.691113 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=4 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:03:09.692075 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=14 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:03:09.699556 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-123ef110-9850-47ed-824f-26052bbbbff8 req-bc6b38e0-ada9-4643-9b31-260e1faeddfc service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:09.699964 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-123ef110-9850-47ed-824f-26052bbbbff8 req-bc6b38e0-ada9-4643-9b31-260e1faeddfc service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:09.700588 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-123ef110-9850-47ed-824f-26052bbbbff8 req-bc6b38e0-ada9-4643-9b31-260e1faeddfc service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:09.712698 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-123ef110-9850-47ed-824f-26052bbbbff8 req-bc6b38e0-ada9-4643-9b31-260e1faeddfc service nova] Creating event network-vif-plugged:a6ba1314-2c0e-4446-8b8b-f039a4366a9f for instance d2bc8eb5-9eba-4963-a6b6-90774b577454 on n-h1-862769-1 Oct 27 04:03:09.718054 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-123ef110-9850-47ed-824f-26052bbbbff8 req-bc6b38e0-ada9-4643-9b31-260e1faeddfc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044908 Oct 27 04:03:09.721334 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3472/6658] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:03:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:03:09.753291 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-6debdc75-7f81-4df2-8e99-00def7ed4399 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53ab6fd880a3424693ce9c71f77ff40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7839538936e24003bfb69cf2efabc29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:03:09.762513 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6debdc75-7f81-4df2-8e99-00def7ed4399 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] 10.222.0.20 "GET /compute/v2.1/servers/d2bc8eb5-9eba-4963-a6b6-90774b577454" status: 200 len: 1314 microversion: 2.1 time: 0.307982 Oct 27 04:03:09.767340 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3187/6659] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:03:09 2022] GET /compute/v2.1/servers/d2bc8eb5-9eba-4963-a6b6-90774b577454 => generated 1314 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:03:10.240998 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-d4bcf11d-9f41-41ec-bc82-fd44cb1c2840 req-7099ede3-2c86-4cf0-8bbe-a52fd49adf12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23264674-8d93-4940-85c1-1b966018a9bd", "tag": "0c136851-16a1-41cc-810e-35dcd67481cf"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:03:10.250183 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-d4bcf11d-9f41-41ec-bc82-fd44cb1c2840 req-7099ede3-2c86-4cf0-8bbe-a52fd49adf12 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:10.250607 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-d4bcf11d-9f41-41ec-bc82-fd44cb1c2840 req-7099ede3-2c86-4cf0-8bbe-a52fd49adf12 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:10.251052 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-d4bcf11d-9f41-41ec-bc82-fd44cb1c2840 req-7099ede3-2c86-4cf0-8bbe-a52fd49adf12 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:10.263344 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-d4bcf11d-9f41-41ec-bc82-fd44cb1c2840 req-7099ede3-2c86-4cf0-8bbe-a52fd49adf12 service nova] Creating event network-changed:0c136851-16a1-41cc-810e-35dcd67481cf for instance 23264674-8d93-4940-85c1-1b966018a9bd on n-h2-862769-1 Oct 27 04:03:10.268436 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-d4bcf11d-9f41-41ec-bc82-fd44cb1c2840 req-7099ede3-2c86-4cf0-8bbe-a52fd49adf12 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033185 Oct 27 04:03:10.269285 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3473/6660] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:03:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:03:10.788889 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d01895f9-b2e4-440f-a120-d1a7bba5dfdb tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:03:10.789536 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d01895f9-b2e4-440f-a120-d1a7bba5dfdb tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] [instance: d2bc8eb5-9eba-4963-a6b6-90774b577454] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:03:10.791626 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=10 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:03:10.798114 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d01895f9-b2e4-440f-a120-d1a7bba5dfdb tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:10.798838 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d01895f9-b2e4-440f-a120-d1a7bba5dfdb tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:10.799494 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d01895f9-b2e4-440f-a120-d1a7bba5dfdb tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:10.800566 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d01895f9-b2e4-440f-a120-d1a7bba5dfdb tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:10.801053 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d01895f9-b2e4-440f-a120-d1a7bba5dfdb tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:10.801492 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d01895f9-b2e4-440f-a120-d1a7bba5dfdb tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:10.942986 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d01895f9-b2e4-440f-a120-d1a7bba5dfdb tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53ab6fd880a3424693ce9c71f77ff40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7839538936e24003bfb69cf2efabc29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:03:10.953060 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d01895f9-b2e4-440f-a120-d1a7bba5dfdb tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] 10.222.0.20 "GET /compute/v2.1/servers/d2bc8eb5-9eba-4963-a6b6-90774b577454" status: 200 len: 1314 microversion: 2.1 time: 0.166932 Oct 27 04:03:10.953060 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3188/6661] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:03:10 2022] GET /compute/v2.1/servers/d2bc8eb5-9eba-4963-a6b6-90774b577454 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:03:11.976343 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5a29318b-60dd-4553-9640-05d218723ede tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:03:11.981795 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5a29318b-60dd-4553-9640-05d218723ede tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] [instance: d2bc8eb5-9eba-4963-a6b6-90774b577454] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:03:11.983509 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5a29318b-60dd-4553-9640-05d218723ede tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:11.984000 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5a29318b-60dd-4553-9640-05d218723ede tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:11.984444 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5a29318b-60dd-4553-9640-05d218723ede tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:11.985148 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5a29318b-60dd-4553-9640-05d218723ede tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:11.985611 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5a29318b-60dd-4553-9640-05d218723ede tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:11.986073 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5a29318b-60dd-4553-9640-05d218723ede tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:12.118289 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5a29318b-60dd-4553-9640-05d218723ede tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53ab6fd880a3424693ce9c71f77ff40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7839538936e24003bfb69cf2efabc29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:03:12.127226 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5a29318b-60dd-4553-9640-05d218723ede tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] 10.222.0.20 "GET /compute/v2.1/servers/d2bc8eb5-9eba-4963-a6b6-90774b577454" status: 200 len: 1498 microversion: 2.1 time: 0.156155 Oct 27 04:03:12.127801 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3474/6662] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:03:11 2022] GET /compute/v2.1/servers/d2bc8eb5-9eba-4963-a6b6-90774b577454 => generated 1498 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:03:13.073185 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3c1e2ebe-93f0-40e0-bfd2-94a796a548fc tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:03:13.073825 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-3c1e2ebe-93f0-40e0-bfd2-94a796a548fc tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] [instance: d2bc8eb5-9eba-4963-a6b6-90774b577454] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:03:13.081178 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3c1e2ebe-93f0-40e0-bfd2-94a796a548fc tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:13.081667 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3c1e2ebe-93f0-40e0-bfd2-94a796a548fc tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:13.082170 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3c1e2ebe-93f0-40e0-bfd2-94a796a548fc tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:13.082879 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3c1e2ebe-93f0-40e0-bfd2-94a796a548fc tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:13.083338 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3c1e2ebe-93f0-40e0-bfd2-94a796a548fc tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:13.084388 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3c1e2ebe-93f0-40e0-bfd2-94a796a548fc tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:13.111034 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-3c1e2ebe-93f0-40e0-bfd2-94a796a548fc tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] [instance: d2bc8eb5-9eba-4963-a6b6-90774b577454] Going to try to terminate instance {{(pid=121000) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 04:03:13.522619 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3c1e2ebe-93f0-40e0-bfd2-94a796a548fc tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d2bc8eb5-9eba-4963-a6b6-90774b577454" status: 204 len: 0 microversion: 2.1 time: 0.453084 Oct 27 04:03:13.523385 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3189/6663] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 04:03:13 2022] DELETE /compute/v2.1/servers/d2bc8eb5-9eba-4963-a6b6-90774b577454 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 04:03:13.531831 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-13c74c2e-933e-4840-bef0-a539d00a79a0 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:03:13.532568 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-13c74c2e-933e-4840-bef0-a539d00a79a0 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] [instance: d2bc8eb5-9eba-4963-a6b6-90774b577454] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:03:13.539479 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-13c74c2e-933e-4840-bef0-a539d00a79a0 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:13.539987 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-13c74c2e-933e-4840-bef0-a539d00a79a0 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:13.540422 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-13c74c2e-933e-4840-bef0-a539d00a79a0 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:13.541130 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-13c74c2e-933e-4840-bef0-a539d00a79a0 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:13.541600 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-13c74c2e-933e-4840-bef0-a539d00a79a0 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:13.542046 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-13c74c2e-933e-4840-bef0-a539d00a79a0 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:13.677176 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-13c74c2e-933e-4840-bef0-a539d00a79a0 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53ab6fd880a3424693ce9c71f77ff40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7839538936e24003bfb69cf2efabc29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:03:13.685847 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-13c74c2e-933e-4840-bef0-a539d00a79a0 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] 10.222.0.20 "GET /compute/v2.1/servers/d2bc8eb5-9eba-4963-a6b6-90774b577454" status: 200 len: 1504 microversion: 2.1 time: 0.157960 Oct 27 04:03:13.690766 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3475/6664] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:03:13 2022] GET /compute/v2.1/servers/d2bc8eb5-9eba-4963-a6b6-90774b577454 => generated 1504 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:03:14.711557 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1e1b5d06-314e-4659-9e33-bfdbd472290f tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:03:14.712280 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1e1b5d06-314e-4659-9e33-bfdbd472290f tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] [instance: d2bc8eb5-9eba-4963-a6b6-90774b577454] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:03:14.719961 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1e1b5d06-314e-4659-9e33-bfdbd472290f tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:14.720483 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1e1b5d06-314e-4659-9e33-bfdbd472290f tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:14.720932 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1e1b5d06-314e-4659-9e33-bfdbd472290f tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:14.721669 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1e1b5d06-314e-4659-9e33-bfdbd472290f tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:14.722346 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1e1b5d06-314e-4659-9e33-bfdbd472290f tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:14.722787 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1e1b5d06-314e-4659-9e33-bfdbd472290f tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:14.863722 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1e1b5d06-314e-4659-9e33-bfdbd472290f tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53ab6fd880a3424693ce9c71f77ff40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7839538936e24003bfb69cf2efabc29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:03:14.872477 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1e1b5d06-314e-4659-9e33-bfdbd472290f tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] 10.222.0.20 "GET /compute/v2.1/servers/d2bc8eb5-9eba-4963-a6b6-90774b577454" status: 200 len: 1504 microversion: 2.1 time: 0.166067 Oct 27 04:03:14.873098 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3190/6665] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:03:14 2022] GET /compute/v2.1/servers/d2bc8eb5-9eba-4963-a6b6-90774b577454 => generated 1504 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:03:15.480012 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-74f541cc-9e82-406e-909c-0f76c7369e29 req-dd72d3a0-bd7f-44b8-b6a4-f68aa7bd8a0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2bc8eb5-9eba-4963-a6b6-90774b577454", "name": "network-vif-deleted", "tag": "a6ba1314-2c0e-4446-8b8b-f039a4366a9f"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:03:15.491835 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-74f541cc-9e82-406e-909c-0f76c7369e29 req-dd72d3a0-bd7f-44b8-b6a4-f68aa7bd8a0b service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:15.492326 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-74f541cc-9e82-406e-909c-0f76c7369e29 req-dd72d3a0-bd7f-44b8-b6a4-f68aa7bd8a0b service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:15.494180 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-74f541cc-9e82-406e-909c-0f76c7369e29 req-dd72d3a0-bd7f-44b8-b6a4-f68aa7bd8a0b service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:15.504163 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-74f541cc-9e82-406e-909c-0f76c7369e29 req-dd72d3a0-bd7f-44b8-b6a4-f68aa7bd8a0b service nova] Creating event network-vif-deleted:a6ba1314-2c0e-4446-8b8b-f039a4366a9f for instance d2bc8eb5-9eba-4963-a6b6-90774b577454 on n-h1-862769-1 Oct 27 04:03:15.509331 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-74f541cc-9e82-406e-909c-0f76c7369e29 req-dd72d3a0-bd7f-44b8-b6a4-f68aa7bd8a0b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033067 Oct 27 04:03:15.509962 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3476/6666] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:03:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 04:03:15.896894 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-784083b7-7c55-4e25-8d94-86efe59ef6b0 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:03:15.897522 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-784083b7-7c55-4e25-8d94-86efe59ef6b0 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] [instance: d2bc8eb5-9eba-4963-a6b6-90774b577454] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:03:15.904683 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-784083b7-7c55-4e25-8d94-86efe59ef6b0 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:15.905177 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-784083b7-7c55-4e25-8d94-86efe59ef6b0 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:15.905616 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-784083b7-7c55-4e25-8d94-86efe59ef6b0 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:15.906380 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-784083b7-7c55-4e25-8d94-86efe59ef6b0 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:15.906843 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-784083b7-7c55-4e25-8d94-86efe59ef6b0 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:15.907275 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-784083b7-7c55-4e25-8d94-86efe59ef6b0 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:15.940148 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-784083b7-7c55-4e25-8d94-86efe59ef6b0 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:15.940534 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-784083b7-7c55-4e25-8d94-86efe59ef6b0 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:15.941016 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-784083b7-7c55-4e25-8d94-86efe59ef6b0 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:15.941474 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-784083b7-7c55-4e25-8d94-86efe59ef6b0 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lazy-loading 'fault' on Instance uuid d2bc8eb5-9eba-4963-a6b6-90774b577454 {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 04:03:15.988951 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-784083b7-7c55-4e25-8d94-86efe59ef6b0 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53ab6fd880a3424693ce9c71f77ff40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7839538936e24003bfb69cf2efabc29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:03:15.993482 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:03:15.998426 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-784083b7-7c55-4e25-8d94-86efe59ef6b0 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] 10.222.0.20 "GET /compute/v2.1/servers/d2bc8eb5-9eba-4963-a6b6-90774b577454" status: 200 len: 1304 microversion: 2.1 time: 0.105973 Oct 27 04:03:15.999006 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3191/6667] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:03:15 2022] GET /compute/v2.1/servers/d2bc8eb5-9eba-4963-a6b6-90774b577454 => generated 1304 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:03:17.029280 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0f5b1543-45f6-4267-83d9-976b050afdfd tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:03:17.030093 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0f5b1543-45f6-4267-83d9-976b050afdfd tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] [instance: d2bc8eb5-9eba-4963-a6b6-90774b577454] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:03:17.036764 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0f5b1543-45f6-4267-83d9-976b050afdfd tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:17.037541 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0f5b1543-45f6-4267-83d9-976b050afdfd tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:17.038116 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0f5b1543-45f6-4267-83d9-976b050afdfd tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:17.038871 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0f5b1543-45f6-4267-83d9-976b050afdfd tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:17.039368 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0f5b1543-45f6-4267-83d9-976b050afdfd tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:17.039944 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0f5b1543-45f6-4267-83d9-976b050afdfd tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:17.054614 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-0f5b1543-45f6-4267-83d9-976b050afdfd tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] HTTP exception thrown: Instance d2bc8eb5-9eba-4963-a6b6-90774b577454 could not be found. Oct 27 04:03:17.056308 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0f5b1543-45f6-4267-83d9-976b050afdfd tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Request method failure captured: Oct 27 04:03:17.056308 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/d2bc8eb5-9eba-4963-a6b6-90774b577454 HTTP/1.1 Oct 27 04:03:17.056308 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 04:03:17.056308 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 04:03:17.056308 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 04:03:17.056308 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 04:03:17.056308 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 04:03:17.056308 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 04:03:17.056308 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 04:03:17.056308 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 04:03:17.056308 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWgLublvih3j870ZP9GY5qdEpeu-M7AsvsVPWo1v9mJqMKB2ISnu912-EPIf5M-o-UHUocmSwbO4_HQlFxhpIDMt2TZ4VlvWxfZujo09u2ZoKRwL5YRIQRuPvilbTPN0c2u4UWKm388nA2nKjpEgwkkdpxqTyCQcnhB1idurx1tL4EwQ Oct 27 04:03:17.056308 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 04:03:17.056308 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 04:03:17.056308 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 04:03:17.056308 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 04:03:17.056308 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 04:03:17.056308 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 04:03:17.056308 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 7839538936e24003bfb69cf2efabc29f Oct 27 04:03:17.056308 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-VolumesActionsTest-384505979 Oct 27 04:03:17.056308 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 04:03:17.056308 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 04:03:17.056308 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7839538936e24003bfb69cf2efabc29f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7839538936e24003bfb69cf2efabc29f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7839538936e24003bfb69cf2efabc29f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7839538936e24003bfb69cf2efabc29f"}]}] Oct 27 04:03:17.056308 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-VolumesActionsTest-384505979 Oct 27 04:03:17.056308 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 7839538936e24003bfb69cf2efabc29f Oct 27 04:03:17.056308 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-VolumesActionsTest-384505979 Oct 27 04:03:17.056308 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-VolumesActionsTest-384505979-project Oct 27 04:03:17.056308 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 04:03:17.056308 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 04:03:17.056308 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 53ab6fd880a3424693ce9c71f77ff40c Oct 27 04:03:17.056308 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-VolumesActionsTest-384505979-project Oct 27 04:03:17.056308 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 04:03:17.056308 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance d2bc8eb5-9eba-4963-a6b6-90774b577454 could not be found. Oct 27 04:03:17.056308 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': 'd2bc8eb5-9eba-4963-a6b6-90774b577454'} Oct 27 04:03:17.056308 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 04:03:17.056308 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:03:17.056308 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 04:03:17.056308 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 04:03:17.056308 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 04:03:17.056308 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 04:03:17.056308 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 04:03:17.056308 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 04:03:17.056308 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 04:03:17.056308 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 04:03:17.056308 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2bc8eb5-9eba-4963-a6b6-90774b577454 could not be found. Oct 27 04:03:17.056308 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:03:17.056308 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:03:17.056308 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:03:17.056308 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:03:17.056308 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:03:17.056308 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:03:17.056308 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 04:03:17.056308 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 04:03:17.056308 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 04:03:17.056308 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 04:03:17.056308 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 04:03:17.056308 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 04:03:17.056308 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 04:03:17.056308 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 04:03:17.056308 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 04:03:17.056308 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 04:03:17.056308 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2bc8eb5-9eba-4963-a6b6-90774b577454 could not be found. Oct 27 04:03:17.056308 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:03:17.056308 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:03:17.056308 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:03:17.061027 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:03:17.061027 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:03:17.061027 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:03:17.061027 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 04:03:17.061027 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 04:03:17.061027 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2bc8eb5-9eba-4963-a6b6-90774b577454 could not be found. Oct 27 04:03:17.061027 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:03:17.061027 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0f5b1543-45f6-4267-83d9-976b050afdfd tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Returning 404 to user: Instance d2bc8eb5-9eba-4963-a6b6-90774b577454 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 04:03:17.061027 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0f5b1543-45f6-4267-83d9-976b050afdfd tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] 10.222.0.20 "GET /compute/v2.1/servers/d2bc8eb5-9eba-4963-a6b6-90774b577454" status: 404 len: 111 microversion: 2.1 time: 0.033833 Oct 27 04:03:17.061027 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3477/6668] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:03:17 2022] GET /compute/v2.1/servers/d2bc8eb5-9eba-4963-a6b6-90774b577454 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 04:03:17.126138 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-56523f75-97e7-4a9c-b662-a4ca79777709 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1018083445", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": [{"uuid": "379591cd-f262-4404-bac2-3659aebababd"}]}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:03:17.165185 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-56523f75-97e7-4a9c-b662-a4ca79777709 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] validate_networks() for [('379591cd-f262-4404-bac2-3659aebababd', None, None, None, None, None)] {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 04:03:17.529063 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-56523f75-97e7-4a9c-b662-a4ca79777709 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 04:03:17.529536 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-56523f75-97e7-4a9c-b662-a4ca79777709 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 04:03:17.530025 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-56523f75-97e7-4a9c-b662-a4ca79777709 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 04:03:17.530472 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-56523f75-97e7-4a9c-b662-a4ca79777709 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 04:03:17.530896 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-56523f75-97e7-4a9c-b662-a4ca79777709 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 04:03:17.540750 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-56523f75-97e7-4a9c-b662-a4ca79777709 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:17.541509 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-56523f75-97e7-4a9c-b662-a4ca79777709 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:17.542007 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-56523f75-97e7-4a9c-b662-a4ca79777709 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:17.543290 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-56523f75-97e7-4a9c-b662-a4ca79777709 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:17.543392 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-56523f75-97e7-4a9c-b662-a4ca79777709 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:17.543749 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-56523f75-97e7-4a9c-b662-a4ca79777709 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:17.561147 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-56523f75-97e7-4a9c-b662-a4ca79777709 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Getting quotas for project 7839538936e24003bfb69cf2efabc29f. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 04:03:17.568094 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-56523f75-97e7-4a9c-b662-a4ca79777709 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Getting quotas for user 53ab6fd880a3424693ce9c71f77ff40c and project 7839538936e24003bfb69cf2efabc29f. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 04:03:17.581619 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-56523f75-97e7-4a9c-b662-a4ca79777709 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 04:03:17.584617 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-56523f75-97e7-4a9c-b662-a4ca79777709 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] [instance: 5fef1b3d-4ffc-46d3-ab12-54d29e475cd9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 04:03:17.687981 n-d-862769-1 devstack@n-api.service[121000]: ERROR oslo.messaging._drivers.impl_rabbit [None req-56523f75-97e7-4a9c-b662-a4ca79777709 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] [d1e0fee0-c007-4f4b-8cac-c2d0a8595428] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 27 04:03:18.697587 n-d-862769-1 devstack@n-api.service[121000]: INFO oslo.messaging._drivers.impl_rabbit [None req-56523f75-97e7-4a9c-b662-a4ca79777709 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] [d1e0fee0-c007-4f4b-8cac-c2d0a8595428] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 45844. Oct 27 04:03:18.702658 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-56523f75-97e7-4a9c-b662-a4ca79777709 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.596766 Oct 27 04:03:18.709998 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3192/6669] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 04:03:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1598 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 04:03:18.715744 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-bb9a2c15-30fc-4524-b0b4-83fa4cde3ce0 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:03:18.716384 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-bb9a2c15-30fc-4524-b0b4-83fa4cde3ce0 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] [instance: 5fef1b3d-4ffc-46d3-ab12-54d29e475cd9] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:03:18.774858 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-bb9a2c15-30fc-4524-b0b4-83fa4cde3ce0 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53ab6fd880a3424693ce9c71f77ff40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7839538936e24003bfb69cf2efabc29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:03:18.783300 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-bb9a2c15-30fc-4524-b0b4-83fa4cde3ce0 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] 10.222.0.20 "GET /compute/v2.1/servers/5fef1b3d-4ffc-46d3-ab12-54d29e475cd9" status: 200 len: 1214 microversion: 2.1 time: 0.072044 Oct 27 04:03:18.784203 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3478/6670] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:03:18 2022] GET /compute/v2.1/servers/5fef1b3d-4ffc-46d3-ab12-54d29e475cd9 => generated 1214 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:03:19.810593 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f6e27979-e38e-479d-84ef-5dedf29f7553 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:03:19.811208 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f6e27979-e38e-479d-84ef-5dedf29f7553 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] [instance: 5fef1b3d-4ffc-46d3-ab12-54d29e475cd9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:03:19.818008 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f6e27979-e38e-479d-84ef-5dedf29f7553 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:19.818530 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f6e27979-e38e-479d-84ef-5dedf29f7553 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:19.818970 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f6e27979-e38e-479d-84ef-5dedf29f7553 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:19.819670 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f6e27979-e38e-479d-84ef-5dedf29f7553 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:19.820124 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f6e27979-e38e-479d-84ef-5dedf29f7553 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:19.820551 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f6e27979-e38e-479d-84ef-5dedf29f7553 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:19.887551 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f6e27979-e38e-479d-84ef-5dedf29f7553 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53ab6fd880a3424693ce9c71f77ff40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7839538936e24003bfb69cf2efabc29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:03:19.897459 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f6e27979-e38e-479d-84ef-5dedf29f7553 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] 10.222.0.20 "GET /compute/v2.1/servers/5fef1b3d-4ffc-46d3-ab12-54d29e475cd9" status: 200 len: 1218 microversion: 2.1 time: 0.091952 Oct 27 04:03:19.898999 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3193/6671] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:03:19 2022] GET /compute/v2.1/servers/5fef1b3d-4ffc-46d3-ab12-54d29e475cd9 => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:03:20.921498 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5352e39e-42ac-4563-af25-d9a2fde37e39 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:03:20.922170 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5352e39e-42ac-4563-af25-d9a2fde37e39 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] [instance: 5fef1b3d-4ffc-46d3-ab12-54d29e475cd9] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:03:20.931176 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5352e39e-42ac-4563-af25-d9a2fde37e39 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:20.931969 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5352e39e-42ac-4563-af25-d9a2fde37e39 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:20.932426 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5352e39e-42ac-4563-af25-d9a2fde37e39 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:20.933160 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5352e39e-42ac-4563-af25-d9a2fde37e39 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:20.933629 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5352e39e-42ac-4563-af25-d9a2fde37e39 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:20.934092 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5352e39e-42ac-4563-af25-d9a2fde37e39 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:21.007453 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5352e39e-42ac-4563-af25-d9a2fde37e39 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53ab6fd880a3424693ce9c71f77ff40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7839538936e24003bfb69cf2efabc29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:03:21.015861 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5352e39e-42ac-4563-af25-d9a2fde37e39 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] 10.222.0.20 "GET /compute/v2.1/servers/5fef1b3d-4ffc-46d3-ab12-54d29e475cd9" status: 200 len: 1274 microversion: 2.1 time: 0.098460 Oct 27 04:03:21.016649 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3479/6672] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:03:20 2022] GET /compute/v2.1/servers/5fef1b3d-4ffc-46d3-ab12-54d29e475cd9 => generated 1274 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:03:22.040186 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1f4fead3-2dc5-42ed-a545-ea0f083e5476 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:03:22.041521 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1f4fead3-2dc5-42ed-a545-ea0f083e5476 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] [instance: 5fef1b3d-4ffc-46d3-ab12-54d29e475cd9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:03:22.049970 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1f4fead3-2dc5-42ed-a545-ea0f083e5476 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:22.050508 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1f4fead3-2dc5-42ed-a545-ea0f083e5476 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:22.051231 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1f4fead3-2dc5-42ed-a545-ea0f083e5476 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:22.052020 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1f4fead3-2dc5-42ed-a545-ea0f083e5476 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:22.053037 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1f4fead3-2dc5-42ed-a545-ea0f083e5476 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:22.053489 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1f4fead3-2dc5-42ed-a545-ea0f083e5476 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:22.206705 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1f4fead3-2dc5-42ed-a545-ea0f083e5476 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53ab6fd880a3424693ce9c71f77ff40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7839538936e24003bfb69cf2efabc29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:03:22.214850 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1f4fead3-2dc5-42ed-a545-ea0f083e5476 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] 10.222.0.20 "GET /compute/v2.1/servers/5fef1b3d-4ffc-46d3-ab12-54d29e475cd9" status: 200 len: 1314 microversion: 2.1 time: 0.178990 Oct 27 04:03:22.215380 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3194/6673] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:03:22 2022] GET /compute/v2.1/servers/5fef1b3d-4ffc-46d3-ab12-54d29e475cd9 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 04:03:22.730594 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-3bc22cc1-0ba0-425b-9393-7078f029e470 req-ed831d7f-44bd-4233-bad9-0ad5a9753008 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fef1b3d-4ffc-46d3-ab12-54d29e475cd9", "tag": "51233bda-ed61-4dca-af27-8c48116a3f17"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:03:22.736585 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=6 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:03:22.742578 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-3bc22cc1-0ba0-425b-9393-7078f029e470 req-ed831d7f-44bd-4233-bad9-0ad5a9753008 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:22.744427 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-3bc22cc1-0ba0-425b-9393-7078f029e470 req-ed831d7f-44bd-4233-bad9-0ad5a9753008 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:22.744427 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-3bc22cc1-0ba0-425b-9393-7078f029e470 req-ed831d7f-44bd-4233-bad9-0ad5a9753008 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:22.748527 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=97 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:03:22.756780 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-3bc22cc1-0ba0-425b-9393-7078f029e470 req-ed831d7f-44bd-4233-bad9-0ad5a9753008 service nova] Creating event network-changed:51233bda-ed61-4dca-af27-8c48116a3f17 for instance 5fef1b3d-4ffc-46d3-ab12-54d29e475cd9 on n-h1-862769-1 Oct 27 04:03:22.763022 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-3bc22cc1-0ba0-425b-9393-7078f029e470 req-ed831d7f-44bd-4233-bad9-0ad5a9753008 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036161 Oct 27 04:03:22.764070 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3480/6674] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:03:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:03:23.238166 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3266dc96-0c79-4855-9db2-59e4ef8724e5 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:03:23.238791 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-3266dc96-0c79-4855-9db2-59e4ef8724e5 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] [instance: 5fef1b3d-4ffc-46d3-ab12-54d29e475cd9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:03:23.246354 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3266dc96-0c79-4855-9db2-59e4ef8724e5 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:23.246851 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3266dc96-0c79-4855-9db2-59e4ef8724e5 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:23.247300 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3266dc96-0c79-4855-9db2-59e4ef8724e5 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:23.248015 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3266dc96-0c79-4855-9db2-59e4ef8724e5 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:23.248475 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3266dc96-0c79-4855-9db2-59e4ef8724e5 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:23.248905 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3266dc96-0c79-4855-9db2-59e4ef8724e5 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:23.382856 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-3266dc96-0c79-4855-9db2-59e4ef8724e5 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53ab6fd880a3424693ce9c71f77ff40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7839538936e24003bfb69cf2efabc29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:03:23.390666 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3266dc96-0c79-4855-9db2-59e4ef8724e5 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] 10.222.0.20 "GET /compute/v2.1/servers/5fef1b3d-4ffc-46d3-ab12-54d29e475cd9" status: 200 len: 1314 microversion: 2.1 time: 0.156479 Oct 27 04:03:23.391629 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3195/6675] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:03:23 2022] GET /compute/v2.1/servers/5fef1b3d-4ffc-46d3-ab12-54d29e475cd9 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:03:24.416555 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-28014d3a-63ed-4296-bcc1-30a9eb7ad1cd tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:03:24.417666 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-28014d3a-63ed-4296-bcc1-30a9eb7ad1cd tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] [instance: 5fef1b3d-4ffc-46d3-ab12-54d29e475cd9] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:03:24.425059 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-28014d3a-63ed-4296-bcc1-30a9eb7ad1cd tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:24.425553 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-28014d3a-63ed-4296-bcc1-30a9eb7ad1cd tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:24.426004 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-28014d3a-63ed-4296-bcc1-30a9eb7ad1cd tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:24.426739 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-28014d3a-63ed-4296-bcc1-30a9eb7ad1cd tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:24.427198 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-28014d3a-63ed-4296-bcc1-30a9eb7ad1cd tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:24.428150 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-28014d3a-63ed-4296-bcc1-30a9eb7ad1cd tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:24.570576 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-28014d3a-63ed-4296-bcc1-30a9eb7ad1cd tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53ab6fd880a3424693ce9c71f77ff40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7839538936e24003bfb69cf2efabc29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:03:24.578304 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-28014d3a-63ed-4296-bcc1-30a9eb7ad1cd tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] 10.222.0.20 "GET /compute/v2.1/servers/5fef1b3d-4ffc-46d3-ab12-54d29e475cd9" status: 200 len: 1314 microversion: 2.1 time: 0.169195 Oct 27 04:03:24.578873 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3481/6676] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:03:24 2022] GET /compute/v2.1/servers/5fef1b3d-4ffc-46d3-ab12-54d29e475cd9 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:03:25.601545 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-929e13ba-99ac-4358-bd59-39386420156e tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:03:25.602009 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-929e13ba-99ac-4358-bd59-39386420156e tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] [instance: 5fef1b3d-4ffc-46d3-ab12-54d29e475cd9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:03:25.605032 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:03:25.610663 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-929e13ba-99ac-4358-bd59-39386420156e tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:25.611070 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-929e13ba-99ac-4358-bd59-39386420156e tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:25.611512 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-929e13ba-99ac-4358-bd59-39386420156e tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:25.612220 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-929e13ba-99ac-4358-bd59-39386420156e tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:25.612684 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-929e13ba-99ac-4358-bd59-39386420156e tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:25.613109 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-929e13ba-99ac-4358-bd59-39386420156e tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:25.751905 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-929e13ba-99ac-4358-bd59-39386420156e tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53ab6fd880a3424693ce9c71f77ff40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7839538936e24003bfb69cf2efabc29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:03:25.761721 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-929e13ba-99ac-4358-bd59-39386420156e tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] 10.222.0.20 "GET /compute/v2.1/servers/5fef1b3d-4ffc-46d3-ab12-54d29e475cd9" status: 200 len: 1314 microversion: 2.1 time: 0.164246 Oct 27 04:03:25.762852 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3196/6677] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:03:25 2022] GET /compute/v2.1/servers/5fef1b3d-4ffc-46d3-ab12-54d29e475cd9 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:03:26.784980 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a0ce2b15-0a14-4efe-b0f7-3c5608465d6c tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:03:26.785633 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a0ce2b15-0a14-4efe-b0f7-3c5608465d6c tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] [instance: 5fef1b3d-4ffc-46d3-ab12-54d29e475cd9] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:03:26.792605 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a0ce2b15-0a14-4efe-b0f7-3c5608465d6c tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:26.793094 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a0ce2b15-0a14-4efe-b0f7-3c5608465d6c tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:26.793539 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a0ce2b15-0a14-4efe-b0f7-3c5608465d6c tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:26.794294 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a0ce2b15-0a14-4efe-b0f7-3c5608465d6c tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:26.794759 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a0ce2b15-0a14-4efe-b0f7-3c5608465d6c tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:26.795220 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a0ce2b15-0a14-4efe-b0f7-3c5608465d6c tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:26.923401 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a0ce2b15-0a14-4efe-b0f7-3c5608465d6c tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53ab6fd880a3424693ce9c71f77ff40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7839538936e24003bfb69cf2efabc29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:03:26.931830 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a0ce2b15-0a14-4efe-b0f7-3c5608465d6c tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] 10.222.0.20 "GET /compute/v2.1/servers/5fef1b3d-4ffc-46d3-ab12-54d29e475cd9" status: 200 len: 1314 microversion: 2.1 time: 0.150842 Oct 27 04:03:26.932400 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3482/6678] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:03:26 2022] GET /compute/v2.1/servers/5fef1b3d-4ffc-46d3-ab12-54d29e475cd9 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:03:27.708035 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-b23ffe1a-4590-4fe6-b360-0a9e877e1ba6 req-f9966081-4e20-4272-a1bb-9ce164c8bed4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fef1b3d-4ffc-46d3-ab12-54d29e475cd9", "name": "network-vif-plugged", "status": "completed", "tag": "51233bda-ed61-4dca-af27-8c48116a3f17"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:03:27.713843 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:03:27.715143 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=6 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:03:27.720362 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-b23ffe1a-4590-4fe6-b360-0a9e877e1ba6 req-f9966081-4e20-4272-a1bb-9ce164c8bed4 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:27.720845 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-b23ffe1a-4590-4fe6-b360-0a9e877e1ba6 req-f9966081-4e20-4272-a1bb-9ce164c8bed4 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:27.721281 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-b23ffe1a-4590-4fe6-b360-0a9e877e1ba6 req-f9966081-4e20-4272-a1bb-9ce164c8bed4 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:27.732697 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-b23ffe1a-4590-4fe6-b360-0a9e877e1ba6 req-f9966081-4e20-4272-a1bb-9ce164c8bed4 service nova] Creating event network-vif-plugged:51233bda-ed61-4dca-af27-8c48116a3f17 for instance 5fef1b3d-4ffc-46d3-ab12-54d29e475cd9 on n-h1-862769-1 Oct 27 04:03:27.737687 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-b23ffe1a-4590-4fe6-b360-0a9e877e1ba6 req-f9966081-4e20-4272-a1bb-9ce164c8bed4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033357 Oct 27 04:03:27.738326 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3197/6679] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:03:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:03:27.956819 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1a186317-3130-48fa-ac2b-29bd7a7db60e tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:03:27.957443 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1a186317-3130-48fa-ac2b-29bd7a7db60e tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] [instance: 5fef1b3d-4ffc-46d3-ab12-54d29e475cd9] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:03:27.964395 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1a186317-3130-48fa-ac2b-29bd7a7db60e tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:27.964883 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1a186317-3130-48fa-ac2b-29bd7a7db60e tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:27.965328 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1a186317-3130-48fa-ac2b-29bd7a7db60e tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:27.966050 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1a186317-3130-48fa-ac2b-29bd7a7db60e tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:27.966515 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1a186317-3130-48fa-ac2b-29bd7a7db60e tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:27.966949 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1a186317-3130-48fa-ac2b-29bd7a7db60e tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:28.100066 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1a186317-3130-48fa-ac2b-29bd7a7db60e tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53ab6fd880a3424693ce9c71f77ff40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7839538936e24003bfb69cf2efabc29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:03:28.108071 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1a186317-3130-48fa-ac2b-29bd7a7db60e tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] 10.222.0.20 "GET /compute/v2.1/servers/5fef1b3d-4ffc-46d3-ab12-54d29e475cd9" status: 200 len: 1314 microversion: 2.1 time: 0.156055 Oct 27 04:03:28.108736 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3483/6680] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:03:27 2022] GET /compute/v2.1/servers/5fef1b3d-4ffc-46d3-ab12-54d29e475cd9 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:03:29.133447 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f66c568c-d366-477b-8040-9f98351c86de tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:03:29.134993 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f66c568c-d366-477b-8040-9f98351c86de tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] [instance: 5fef1b3d-4ffc-46d3-ab12-54d29e475cd9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:03:29.144483 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f66c568c-d366-477b-8040-9f98351c86de tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:29.145088 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f66c568c-d366-477b-8040-9f98351c86de tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:29.145599 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f66c568c-d366-477b-8040-9f98351c86de tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:29.147104 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f66c568c-d366-477b-8040-9f98351c86de tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:29.147640 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f66c568c-d366-477b-8040-9f98351c86de tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:29.148146 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f66c568c-d366-477b-8040-9f98351c86de tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:29.305814 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f66c568c-d366-477b-8040-9f98351c86de tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53ab6fd880a3424693ce9c71f77ff40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7839538936e24003bfb69cf2efabc29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:03:29.320707 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f66c568c-d366-477b-8040-9f98351c86de tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] 10.222.0.20 "GET /compute/v2.1/servers/5fef1b3d-4ffc-46d3-ab12-54d29e475cd9" status: 200 len: 1314 microversion: 2.1 time: 0.191969 Oct 27 04:03:29.334233 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3198/6681] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:03:29 2022] GET /compute/v2.1/servers/5fef1b3d-4ffc-46d3-ab12-54d29e475cd9 => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:03:30.344511 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-953aa40e-b0e1-44d5-875f-38365532bb5f tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:03:30.345078 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-953aa40e-b0e1-44d5-875f-38365532bb5f tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] [instance: 5fef1b3d-4ffc-46d3-ab12-54d29e475cd9] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:03:30.347091 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:03:30.353228 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-953aa40e-b0e1-44d5-875f-38365532bb5f tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:30.353725 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-953aa40e-b0e1-44d5-875f-38365532bb5f tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:30.354455 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-953aa40e-b0e1-44d5-875f-38365532bb5f tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:30.354899 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-953aa40e-b0e1-44d5-875f-38365532bb5f tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:30.355378 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-953aa40e-b0e1-44d5-875f-38365532bb5f tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:30.355808 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-953aa40e-b0e1-44d5-875f-38365532bb5f tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:30.493707 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-953aa40e-b0e1-44d5-875f-38365532bb5f tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53ab6fd880a3424693ce9c71f77ff40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7839538936e24003bfb69cf2efabc29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:03:30.501733 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-953aa40e-b0e1-44d5-875f-38365532bb5f tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] 10.222.0.20 "GET /compute/v2.1/servers/5fef1b3d-4ffc-46d3-ab12-54d29e475cd9" status: 200 len: 1499 microversion: 2.1 time: 0.161158 Oct 27 04:03:30.502724 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3484/6682] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:03:30 2022] GET /compute/v2.1/servers/5fef1b3d-4ffc-46d3-ab12-54d29e475cd9 => generated 1499 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:03:31.453284 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c995a8f8-a645-4ed7-a667-f0dfe6244806 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:03:31.453881 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c995a8f8-a645-4ed7-a667-f0dfe6244806 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] [instance: 5fef1b3d-4ffc-46d3-ab12-54d29e475cd9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:03:31.466278 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c995a8f8-a645-4ed7-a667-f0dfe6244806 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:31.466784 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c995a8f8-a645-4ed7-a667-f0dfe6244806 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:31.467439 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c995a8f8-a645-4ed7-a667-f0dfe6244806 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:31.468412 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c995a8f8-a645-4ed7-a667-f0dfe6244806 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:31.468987 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c995a8f8-a645-4ed7-a667-f0dfe6244806 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:31.469427 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c995a8f8-a645-4ed7-a667-f0dfe6244806 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:31.497717 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c995a8f8-a645-4ed7-a667-f0dfe6244806 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] [instance: 5fef1b3d-4ffc-46d3-ab12-54d29e475cd9] Going to try to terminate instance {{(pid=121000) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 04:03:31.823472 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c995a8f8-a645-4ed7-a667-f0dfe6244806 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5fef1b3d-4ffc-46d3-ab12-54d29e475cd9" status: 204 len: 0 microversion: 2.1 time: 0.374148 Oct 27 04:03:31.824090 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3199/6683] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 04:03:31 2022] DELETE /compute/v2.1/servers/5fef1b3d-4ffc-46d3-ab12-54d29e475cd9 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 04:03:31.832609 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c5205759-3867-42e2-a4ac-1b66149261a8 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:03:31.833240 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c5205759-3867-42e2-a4ac-1b66149261a8 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] [instance: 5fef1b3d-4ffc-46d3-ab12-54d29e475cd9] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:03:31.840500 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c5205759-3867-42e2-a4ac-1b66149261a8 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:31.840992 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c5205759-3867-42e2-a4ac-1b66149261a8 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:31.841433 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c5205759-3867-42e2-a4ac-1b66149261a8 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:31.842168 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c5205759-3867-42e2-a4ac-1b66149261a8 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:31.842630 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c5205759-3867-42e2-a4ac-1b66149261a8 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:31.843069 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c5205759-3867-42e2-a4ac-1b66149261a8 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:32.025901 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c5205759-3867-42e2-a4ac-1b66149261a8 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53ab6fd880a3424693ce9c71f77ff40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7839538936e24003bfb69cf2efabc29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:03:32.034080 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c5205759-3867-42e2-a4ac-1b66149261a8 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] 10.222.0.20 "GET /compute/v2.1/servers/5fef1b3d-4ffc-46d3-ab12-54d29e475cd9" status: 200 len: 1505 microversion: 2.1 time: 0.205445 Oct 27 04:03:32.034658 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3485/6684] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:03:31 2022] GET /compute/v2.1/servers/5fef1b3d-4ffc-46d3-ab12-54d29e475cd9 => generated 1505 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:03:32.536607 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6d996573-2890-4f02-9c6a-9061420e5583 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:03:32.543218 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6d996573-2890-4f02-9c6a-9061420e5583 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] [instance: 23264674-8d93-4940-85c1-1b966018a9bd] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:03:32.549898 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6d996573-2890-4f02-9c6a-9061420e5583 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:32.550560 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6d996573-2890-4f02-9c6a-9061420e5583 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:32.551014 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6d996573-2890-4f02-9c6a-9061420e5583 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:32.551730 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6d996573-2890-4f02-9c6a-9061420e5583 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:32.552194 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6d996573-2890-4f02-9c6a-9061420e5583 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:32.553272 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6d996573-2890-4f02-9c6a-9061420e5583 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:32.607286 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6d996573-2890-4f02-9c6a-9061420e5583 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] 10.222.0.20 "POST /compute/v2.1/servers/23264674-8d93-4940-85c1-1b966018a9bd/action" status: 200 len: 24562 microversion: 2.1 time: 0.075117 Oct 27 04:03:32.608019 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3200/6685] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 04:03:32 2022] POST /compute/v2.1/servers/23264674-8d93-4940-85c1-1b966018a9bd/action => generated 24562 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 04:03:33.058452 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-47df5836-cca7-44fa-9e16-812d98b629f0 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:03:33.059145 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-47df5836-cca7-44fa-9e16-812d98b629f0 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] [instance: 5fef1b3d-4ffc-46d3-ab12-54d29e475cd9] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:03:33.066198 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-47df5836-cca7-44fa-9e16-812d98b629f0 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:33.066763 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-47df5836-cca7-44fa-9e16-812d98b629f0 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:33.067289 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-47df5836-cca7-44fa-9e16-812d98b629f0 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:33.068893 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-47df5836-cca7-44fa-9e16-812d98b629f0 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:33.069446 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-47df5836-cca7-44fa-9e16-812d98b629f0 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:33.069950 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-47df5836-cca7-44fa-9e16-812d98b629f0 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:33.202774 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-47df5836-cca7-44fa-9e16-812d98b629f0 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53ab6fd880a3424693ce9c71f77ff40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7839538936e24003bfb69cf2efabc29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:03:33.211338 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-47df5836-cca7-44fa-9e16-812d98b629f0 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] 10.222.0.20 "GET /compute/v2.1/servers/5fef1b3d-4ffc-46d3-ab12-54d29e475cd9" status: 200 len: 1505 microversion: 2.1 time: 0.157207 Oct 27 04:03:33.212006 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3486/6686] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:03:33 2022] GET /compute/v2.1/servers/5fef1b3d-4ffc-46d3-ab12-54d29e475cd9 => generated 1505 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:03:34.027297 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-fa38c5e9-0399-4579-9686-34251034e7e0 req-4efdee6b-62e8-4726-a2b1-8e69ebc7970f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fef1b3d-4ffc-46d3-ab12-54d29e475cd9", "name": "network-vif-deleted", "tag": "51233bda-ed61-4dca-af27-8c48116a3f17"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:03:34.038215 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-fa38c5e9-0399-4579-9686-34251034e7e0 req-4efdee6b-62e8-4726-a2b1-8e69ebc7970f service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:34.038703 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-fa38c5e9-0399-4579-9686-34251034e7e0 req-4efdee6b-62e8-4726-a2b1-8e69ebc7970f service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:34.039141 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-fa38c5e9-0399-4579-9686-34251034e7e0 req-4efdee6b-62e8-4726-a2b1-8e69ebc7970f service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:34.050955 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-fa38c5e9-0399-4579-9686-34251034e7e0 req-4efdee6b-62e8-4726-a2b1-8e69ebc7970f service nova] Creating event network-vif-deleted:51233bda-ed61-4dca-af27-8c48116a3f17 for instance 5fef1b3d-4ffc-46d3-ab12-54d29e475cd9 on n-h1-862769-1 Oct 27 04:03:34.056449 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-fa38c5e9-0399-4579-9686-34251034e7e0 req-4efdee6b-62e8-4726-a2b1-8e69ebc7970f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033135 Oct 27 04:03:34.057340 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3201/6687] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:03:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:03:34.234878 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-df0db973-ec50-4d9c-8b69-cbd5f8fa256d tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:03:34.235595 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-df0db973-ec50-4d9c-8b69-cbd5f8fa256d tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] [instance: 5fef1b3d-4ffc-46d3-ab12-54d29e475cd9] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:03:34.243332 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-df0db973-ec50-4d9c-8b69-cbd5f8fa256d tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:34.243822 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-df0db973-ec50-4d9c-8b69-cbd5f8fa256d tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:34.244278 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-df0db973-ec50-4d9c-8b69-cbd5f8fa256d tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:34.244994 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-df0db973-ec50-4d9c-8b69-cbd5f8fa256d tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:34.245461 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-df0db973-ec50-4d9c-8b69-cbd5f8fa256d tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:34.245901 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-df0db973-ec50-4d9c-8b69-cbd5f8fa256d tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:34.310482 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-df0db973-ec50-4d9c-8b69-cbd5f8fa256d tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53ab6fd880a3424693ce9c71f77ff40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7839538936e24003bfb69cf2efabc29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:03:34.319634 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-df0db973-ec50-4d9c-8b69-cbd5f8fa256d tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] 10.222.0.20 "GET /compute/v2.1/servers/5fef1b3d-4ffc-46d3-ab12-54d29e475cd9" status: 200 len: 1299 microversion: 2.1 time: 0.088668 Oct 27 04:03:34.320233 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3487/6688] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:03:34 2022] GET /compute/v2.1/servers/5fef1b3d-4ffc-46d3-ab12-54d29e475cd9 => generated 1299 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:03:35.347636 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a00b64ef-0e20-4dd1-a262-c9cc716e4323 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:03:35.348265 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a00b64ef-0e20-4dd1-a262-c9cc716e4323 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] [instance: 5fef1b3d-4ffc-46d3-ab12-54d29e475cd9] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:03:35.354494 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a00b64ef-0e20-4dd1-a262-c9cc716e4323 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:35.354980 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a00b64ef-0e20-4dd1-a262-c9cc716e4323 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:35.355418 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a00b64ef-0e20-4dd1-a262-c9cc716e4323 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:35.356097 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a00b64ef-0e20-4dd1-a262-c9cc716e4323 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:35.356554 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a00b64ef-0e20-4dd1-a262-c9cc716e4323 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:35.357064 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a00b64ef-0e20-4dd1-a262-c9cc716e4323 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:35.370230 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-a00b64ef-0e20-4dd1-a262-c9cc716e4323 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] HTTP exception thrown: Instance 5fef1b3d-4ffc-46d3-ab12-54d29e475cd9 could not be found. Oct 27 04:03:35.371823 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a00b64ef-0e20-4dd1-a262-c9cc716e4323 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Request method failure captured: Oct 27 04:03:35.371823 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/5fef1b3d-4ffc-46d3-ab12-54d29e475cd9 HTTP/1.1 Oct 27 04:03:35.371823 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 04:03:35.371823 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 04:03:35.371823 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 04:03:35.371823 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 04:03:35.371823 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 04:03:35.371823 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 04:03:35.371823 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 04:03:35.371823 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 04:03:35.371823 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWgLublvih3j870ZP9GY5qdEpeu-M7AsvsVPWo1v9mJqMKB2ISnu912-EPIf5M-o-UHUocmSwbO4_HQlFxhpIDMt2TZ4VlvWxfZujo09u2ZoKRwL5YRIQRuPvilbTPN0c2u4UWKm388nA2nKjpEgwkkdpxqTyCQcnhB1idurx1tL4EwQ Oct 27 04:03:35.371823 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 04:03:35.371823 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 04:03:35.371823 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 04:03:35.371823 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 04:03:35.371823 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 04:03:35.371823 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 04:03:35.371823 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 7839538936e24003bfb69cf2efabc29f Oct 27 04:03:35.371823 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-VolumesActionsTest-384505979 Oct 27 04:03:35.371823 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 04:03:35.371823 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 04:03:35.371823 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7839538936e24003bfb69cf2efabc29f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7839538936e24003bfb69cf2efabc29f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7839538936e24003bfb69cf2efabc29f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7839538936e24003bfb69cf2efabc29f"}]}] Oct 27 04:03:35.371823 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-VolumesActionsTest-384505979 Oct 27 04:03:35.371823 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 7839538936e24003bfb69cf2efabc29f Oct 27 04:03:35.371823 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-VolumesActionsTest-384505979 Oct 27 04:03:35.371823 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-VolumesActionsTest-384505979-project Oct 27 04:03:35.371823 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 04:03:35.371823 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 04:03:35.371823 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 53ab6fd880a3424693ce9c71f77ff40c Oct 27 04:03:35.371823 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-VolumesActionsTest-384505979-project Oct 27 04:03:35.371823 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 04:03:35.371823 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 5fef1b3d-4ffc-46d3-ab12-54d29e475cd9 could not be found. Oct 27 04:03:35.371823 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '5fef1b3d-4ffc-46d3-ab12-54d29e475cd9'} Oct 27 04:03:35.371823 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 04:03:35.371823 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:03:35.371823 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 04:03:35.371823 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 04:03:35.371823 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 04:03:35.371823 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 04:03:35.371823 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 04:03:35.371823 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 04:03:35.371823 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 04:03:35.371823 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 04:03:35.371823 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fef1b3d-4ffc-46d3-ab12-54d29e475cd9 could not be found. Oct 27 04:03:35.371823 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:03:35.371823 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:03:35.371823 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:03:35.371823 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:03:35.371823 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:03:35.371823 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:03:35.371823 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 04:03:35.371823 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 04:03:35.371823 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 04:03:35.371823 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 04:03:35.371823 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 04:03:35.371823 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 04:03:35.371823 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 04:03:35.371823 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 04:03:35.371823 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 04:03:35.371823 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 04:03:35.371823 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fef1b3d-4ffc-46d3-ab12-54d29e475cd9 could not be found. Oct 27 04:03:35.371823 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:03:35.371823 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:03:35.371823 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:03:35.376441 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:03:35.376441 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:03:35.376441 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:03:35.376441 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 04:03:35.376441 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 04:03:35.376441 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fef1b3d-4ffc-46d3-ab12-54d29e475cd9 could not be found. Oct 27 04:03:35.376441 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:03:35.376441 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a00b64ef-0e20-4dd1-a262-c9cc716e4323 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] Returning 404 to user: Instance 5fef1b3d-4ffc-46d3-ab12-54d29e475cd9 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 04:03:35.376441 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a00b64ef-0e20-4dd1-a262-c9cc716e4323 tempest-VolumesActionsTest-384505979 tempest-VolumesActionsTest-384505979-project] 10.222.0.20 "GET /compute/v2.1/servers/5fef1b3d-4ffc-46d3-ab12-54d29e475cd9" status: 404 len: 111 microversion: 2.1 time: 0.030878 Oct 27 04:03:35.376441 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3202/6689] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:03:35 2022] GET /compute/v2.1/servers/5fef1b3d-4ffc-46d3-ab12-54d29e475cd9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 04:03:46.185538 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a3e51205-aaf8-45d4-b865-bca21a52287b tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Action: 'create', calling method: .version_select at 0x7f7dd9503820>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1604997581", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOHsF5tfPJDZKI/zq+gIFwFewf2d8gJYMN0NpCtbPioOO9WKS6Z+DVS16JCQgpd1utEsRxk7v+9sXHNUJKVpwucTjcB1vU93gKdwCKcPe6fd6VXSOKmOSeQMClEvw2smlA=="}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:03:46.211950 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=15 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:03:46.215773 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=43 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:03:46.223315 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-a3e51205-aaf8-45d4-b865-bca21a52287b tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Getting quotas for project 9c921299382141f99cd9c4b6b11927a4. Resources: {'key_pairs'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 04:03:46.229283 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-a3e51205-aaf8-45d4-b865-bca21a52287b tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Getting quotas for user 98bf808aeff6462794e5d6c653c72ae2 and project 9c921299382141f99cd9c4b6b11927a4. Resources: {'key_pairs'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 04:03:46.346633 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a3e51205-aaf8-45d4-b865-bca21a52287b tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.164995 Oct 27 04:03:46.358560 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3488/6690] 10.222.0.20 () {60 vars in 1159 bytes} [Thu Oct 27 04:03:46 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:03:50.253363 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-39d405c1-33fe-422a-ae30-cf8eb22b0975 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1094724201", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": [{"uuid": "d089351f-118b-429c-af5b-4a4c6f46b268"}], "key_name": "tempest-TestNetworkBasicOps-1604997581", "security_groups": [{"name": "tempest-secgroup-smoke-113076110"}]}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:03:50.264547 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:03:50.265386 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:03:50.404013 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-39d405c1-33fe-422a-ae30-cf8eb22b0975 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] validate_networks() for [('d089351f-118b-429c-af5b-4a4c6f46b268', None, None, None, None, None)] {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 04:03:51.174210 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-39d405c1-33fe-422a-ae30-cf8eb22b0975 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 04:03:51.174882 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-39d405c1-33fe-422a-ae30-cf8eb22b0975 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 04:03:51.175392 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-39d405c1-33fe-422a-ae30-cf8eb22b0975 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 04:03:51.179346 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-39d405c1-33fe-422a-ae30-cf8eb22b0975 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 04:03:51.180001 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-39d405c1-33fe-422a-ae30-cf8eb22b0975 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 04:03:51.197372 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-39d405c1-33fe-422a-ae30-cf8eb22b0975 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:51.197868 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-39d405c1-33fe-422a-ae30-cf8eb22b0975 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:51.204429 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-39d405c1-33fe-422a-ae30-cf8eb22b0975 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:51.205557 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-39d405c1-33fe-422a-ae30-cf8eb22b0975 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:51.206332 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-39d405c1-33fe-422a-ae30-cf8eb22b0975 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:51.207025 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-39d405c1-33fe-422a-ae30-cf8eb22b0975 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:51.243808 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-39d405c1-33fe-422a-ae30-cf8eb22b0975 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Getting quotas for project 9c921299382141f99cd9c4b6b11927a4. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 04:03:51.249406 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-39d405c1-33fe-422a-ae30-cf8eb22b0975 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Getting quotas for user 98bf808aeff6462794e5d6c653c72ae2 and project 9c921299382141f99cd9c4b6b11927a4. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 04:03:51.277314 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-39d405c1-33fe-422a-ae30-cf8eb22b0975 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 04:03:51.281116 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-39d405c1-33fe-422a-ae30-cf8eb22b0975 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] [instance: 826b1d59-bc93-4e01-a34d-e0f504e47c27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 04:03:51.471320 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-39d405c1-33fe-422a-ae30-cf8eb22b0975 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.221063 Oct 27 04:03:51.482165 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3203/6691] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 04:03:50 2022] POST /compute/v2.1/servers => generated 405 bytes in 1234 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 04:03:51.487559 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-30ff76de-ebd4-4d65-ae23-fa4af83409cf tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:03:51.489808 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-30ff76de-ebd4-4d65-ae23-fa4af83409cf tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] [instance: 826b1d59-bc93-4e01-a34d-e0f504e47c27] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:03:51.594955 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-30ff76de-ebd4-4d65-ae23-fa4af83409cf tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bf808aeff6462794e5d6c653c72ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c921299382141f99cd9c4b6b11927a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:03:51.605559 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-30ff76de-ebd4-4d65-ae23-fa4af83409cf tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] 10.222.0.20 "GET /compute/v2.1/servers/826b1d59-bc93-4e01-a34d-e0f504e47c27" status: 200 len: 1249 microversion: 2.1 time: 0.123137 Oct 27 04:03:51.611401 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3489/6692] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:03:51 2022] GET /compute/v2.1/servers/826b1d59-bc93-4e01-a34d-e0f504e47c27 => generated 1249 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:03:52.635142 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-81a13f40-8046-4bfb-bfbd-1726df68d31d tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:03:52.637154 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-81a13f40-8046-4bfb-bfbd-1726df68d31d tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] [instance: 826b1d59-bc93-4e01-a34d-e0f504e47c27] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:03:52.667413 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-81a13f40-8046-4bfb-bfbd-1726df68d31d tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:52.668274 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-81a13f40-8046-4bfb-bfbd-1726df68d31d tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:52.669003 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-81a13f40-8046-4bfb-bfbd-1726df68d31d tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:52.669812 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-81a13f40-8046-4bfb-bfbd-1726df68d31d tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:52.670903 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-81a13f40-8046-4bfb-bfbd-1726df68d31d tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:52.671568 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-81a13f40-8046-4bfb-bfbd-1726df68d31d tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:52.771038 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-81a13f40-8046-4bfb-bfbd-1726df68d31d tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bf808aeff6462794e5d6c653c72ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c921299382141f99cd9c4b6b11927a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:03:52.790077 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-81a13f40-8046-4bfb-bfbd-1726df68d31d tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] 10.222.0.20 "GET /compute/v2.1/servers/826b1d59-bc93-4e01-a34d-e0f504e47c27" status: 200 len: 1253 microversion: 2.1 time: 0.160937 Oct 27 04:03:52.807576 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3204/6693] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:03:52 2022] GET /compute/v2.1/servers/826b1d59-bc93-4e01-a34d-e0f504e47c27 => generated 1253 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:03:53.816563 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-87657ba6-fe44-4e82-ba8a-63f0ea181f86 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:03:53.817396 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-87657ba6-fe44-4e82-ba8a-63f0ea181f86 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] [instance: 826b1d59-bc93-4e01-a34d-e0f504e47c27] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:03:53.828194 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-87657ba6-fe44-4e82-ba8a-63f0ea181f86 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:53.829230 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-87657ba6-fe44-4e82-ba8a-63f0ea181f86 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:53.830465 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-87657ba6-fe44-4e82-ba8a-63f0ea181f86 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:53.831449 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-87657ba6-fe44-4e82-ba8a-63f0ea181f86 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:53.832526 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-87657ba6-fe44-4e82-ba8a-63f0ea181f86 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:53.833261 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-87657ba6-fe44-4e82-ba8a-63f0ea181f86 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:53.955750 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-87657ba6-fe44-4e82-ba8a-63f0ea181f86 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bf808aeff6462794e5d6c653c72ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c921299382141f99cd9c4b6b11927a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:03:53.965431 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-87657ba6-fe44-4e82-ba8a-63f0ea181f86 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] 10.222.0.20 "GET /compute/v2.1/servers/826b1d59-bc93-4e01-a34d-e0f504e47c27" status: 200 len: 1301 microversion: 2.1 time: 0.152746 Oct 27 04:03:53.969323 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3490/6694] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:03:53 2022] GET /compute/v2.1/servers/826b1d59-bc93-4e01-a34d-e0f504e47c27 => generated 1301 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:03:54.992316 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d738959a-ccb2-4b77-8b92-15972d3e1050 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:03:54.994025 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d738959a-ccb2-4b77-8b92-15972d3e1050 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] [instance: 826b1d59-bc93-4e01-a34d-e0f504e47c27] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:03:55.006757 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d738959a-ccb2-4b77-8b92-15972d3e1050 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:55.007800 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d738959a-ccb2-4b77-8b92-15972d3e1050 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:55.008439 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d738959a-ccb2-4b77-8b92-15972d3e1050 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:55.010252 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d738959a-ccb2-4b77-8b92-15972d3e1050 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:55.012798 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d738959a-ccb2-4b77-8b92-15972d3e1050 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:55.013709 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d738959a-ccb2-4b77-8b92-15972d3e1050 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:55.105231 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d738959a-ccb2-4b77-8b92-15972d3e1050 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bf808aeff6462794e5d6c653c72ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c921299382141f99cd9c4b6b11927a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:03:55.119550 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d738959a-ccb2-4b77-8b92-15972d3e1050 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] 10.222.0.20 "GET /compute/v2.1/servers/826b1d59-bc93-4e01-a34d-e0f504e47c27" status: 200 len: 1307 microversion: 2.1 time: 0.133352 Oct 27 04:03:55.121212 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3205/6695] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:03:54 2022] GET /compute/v2.1/servers/826b1d59-bc93-4e01-a34d-e0f504e47c27 => generated 1307 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:03:56.152852 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d11d95a3-f7d3-4d31-b915-446b39c181fa tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:03:56.167507 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d11d95a3-f7d3-4d31-b915-446b39c181fa tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] [instance: 826b1d59-bc93-4e01-a34d-e0f504e47c27] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:03:56.200172 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d11d95a3-f7d3-4d31-b915-446b39c181fa tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:56.201143 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d11d95a3-f7d3-4d31-b915-446b39c181fa tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:56.202711 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d11d95a3-f7d3-4d31-b915-446b39c181fa tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:56.204121 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d11d95a3-f7d3-4d31-b915-446b39c181fa tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:56.205160 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d11d95a3-f7d3-4d31-b915-446b39c181fa tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:56.205908 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d11d95a3-f7d3-4d31-b915-446b39c181fa tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:56.504660 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d11d95a3-f7d3-4d31-b915-446b39c181fa tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bf808aeff6462794e5d6c653c72ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c921299382141f99cd9c4b6b11927a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:03:56.517478 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d11d95a3-f7d3-4d31-b915-446b39c181fa tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] 10.222.0.20 "GET /compute/v2.1/servers/826b1d59-bc93-4e01-a34d-e0f504e47c27" status: 200 len: 1374 microversion: 2.1 time: 0.373150 Oct 27 04:03:56.518956 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3491/6696] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:03:56 2022] GET /compute/v2.1/servers/826b1d59-bc93-4e01-a34d-e0f504e47c27 => generated 1374 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:03:57.220182 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-7f2960e6-60b8-4e8b-9a40-9e7aa4e60df8 req-d5f01901-8404-4e67-af76-a0008360553e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "826b1d59-bc93-4e01-a34d-e0f504e47c27", "tag": "1c897302-bf1a-42c2-899d-4837429a533c"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:03:57.235722 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-7f2960e6-60b8-4e8b-9a40-9e7aa4e60df8 req-d5f01901-8404-4e67-af76-a0008360553e service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:57.236436 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-7f2960e6-60b8-4e8b-9a40-9e7aa4e60df8 req-d5f01901-8404-4e67-af76-a0008360553e service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:57.242672 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-7f2960e6-60b8-4e8b-9a40-9e7aa4e60df8 req-d5f01901-8404-4e67-af76-a0008360553e service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:57.273981 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-7f2960e6-60b8-4e8b-9a40-9e7aa4e60df8 req-d5f01901-8404-4e67-af76-a0008360553e service nova] Creating event network-changed:1c897302-bf1a-42c2-899d-4837429a533c for instance 826b1d59-bc93-4e01-a34d-e0f504e47c27 on n-h1-862769-1 Oct 27 04:03:57.280845 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-7f2960e6-60b8-4e8b-9a40-9e7aa4e60df8 req-d5f01901-8404-4e67-af76-a0008360553e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067393 Oct 27 04:03:57.291600 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3206/6697] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:03:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:03:57.542273 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6f87e562-5588-461e-8486-01a245600a52 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:03:57.543564 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-6f87e562-5588-461e-8486-01a245600a52 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] [instance: 826b1d59-bc93-4e01-a34d-e0f504e47c27] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:03:57.553553 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6f87e562-5588-461e-8486-01a245600a52 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:57.558537 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6f87e562-5588-461e-8486-01a245600a52 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:57.559619 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6f87e562-5588-461e-8486-01a245600a52 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:57.561318 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6f87e562-5588-461e-8486-01a245600a52 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:57.562788 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6f87e562-5588-461e-8486-01a245600a52 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:57.564432 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6f87e562-5588-461e-8486-01a245600a52 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:57.794075 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6f87e562-5588-461e-8486-01a245600a52 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bf808aeff6462794e5d6c653c72ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c921299382141f99cd9c4b6b11927a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:03:57.814575 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6f87e562-5588-461e-8486-01a245600a52 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] 10.222.0.20 "GET /compute/v2.1/servers/826b1d59-bc93-4e01-a34d-e0f504e47c27" status: 200 len: 1374 microversion: 2.1 time: 0.277452 Oct 27 04:03:57.818633 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3492/6698] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:03:57 2022] GET /compute/v2.1/servers/826b1d59-bc93-4e01-a34d-e0f504e47c27 => generated 1374 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:03:58.839949 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-27345696-f70f-4dba-b670-0ebabcaa5c61 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:03:58.840681 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-27345696-f70f-4dba-b670-0ebabcaa5c61 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] [instance: 826b1d59-bc93-4e01-a34d-e0f504e47c27] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:03:58.846989 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-27345696-f70f-4dba-b670-0ebabcaa5c61 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:58.847478 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-27345696-f70f-4dba-b670-0ebabcaa5c61 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:58.847914 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-27345696-f70f-4dba-b670-0ebabcaa5c61 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:58.848613 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-27345696-f70f-4dba-b670-0ebabcaa5c61 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:03:58.849067 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-27345696-f70f-4dba-b670-0ebabcaa5c61 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:03:58.849495 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-27345696-f70f-4dba-b670-0ebabcaa5c61 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:03:58.989355 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-27345696-f70f-4dba-b670-0ebabcaa5c61 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bf808aeff6462794e5d6c653c72ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c921299382141f99cd9c4b6b11927a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:03:58.998187 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-27345696-f70f-4dba-b670-0ebabcaa5c61 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] 10.222.0.20 "GET /compute/v2.1/servers/826b1d59-bc93-4e01-a34d-e0f504e47c27" status: 200 len: 1374 microversion: 2.1 time: 0.163318 Oct 27 04:03:59.004970 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3207/6699] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:03:58 2022] GET /compute/v2.1/servers/826b1d59-bc93-4e01-a34d-e0f504e47c27 => generated 1374 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:04:00.023522 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-fe5a05b4-4b28-44f3-934e-43befa06d8da tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:04:00.024126 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-fe5a05b4-4b28-44f3-934e-43befa06d8da tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] [instance: 826b1d59-bc93-4e01-a34d-e0f504e47c27] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:04:00.031372 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fe5a05b4-4b28-44f3-934e-43befa06d8da tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:04:00.031874 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fe5a05b4-4b28-44f3-934e-43befa06d8da tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:04:00.032379 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fe5a05b4-4b28-44f3-934e-43befa06d8da tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:04:00.033075 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fe5a05b4-4b28-44f3-934e-43befa06d8da tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:04:00.033541 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fe5a05b4-4b28-44f3-934e-43befa06d8da tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:04:00.034026 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fe5a05b4-4b28-44f3-934e-43befa06d8da tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:04:00.174216 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-fe5a05b4-4b28-44f3-934e-43befa06d8da tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bf808aeff6462794e5d6c653c72ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c921299382141f99cd9c4b6b11927a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:04:00.182942 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-fe5a05b4-4b28-44f3-934e-43befa06d8da tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] 10.222.0.20 "GET /compute/v2.1/servers/826b1d59-bc93-4e01-a34d-e0f504e47c27" status: 200 len: 1374 microversion: 2.1 time: 0.164168 Oct 27 04:04:00.183648 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3493/6700] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:04:00 2022] GET /compute/v2.1/servers/826b1d59-bc93-4e01-a34d-e0f504e47c27 => generated 1374 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:04:01.207122 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-792893bb-21ad-49b4-b8d5-7b60739b1db7 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:04:01.207752 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-792893bb-21ad-49b4-b8d5-7b60739b1db7 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] [instance: 826b1d59-bc93-4e01-a34d-e0f504e47c27] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:04:01.214939 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-792893bb-21ad-49b4-b8d5-7b60739b1db7 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:04:01.215431 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-792893bb-21ad-49b4-b8d5-7b60739b1db7 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:04:01.215877 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-792893bb-21ad-49b4-b8d5-7b60739b1db7 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:04:01.216585 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-792893bb-21ad-49b4-b8d5-7b60739b1db7 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:04:01.217084 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-792893bb-21ad-49b4-b8d5-7b60739b1db7 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:04:01.217683 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-792893bb-21ad-49b4-b8d5-7b60739b1db7 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:04:01.221833 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:04:01.257427 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=6 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:04:01.352381 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-792893bb-21ad-49b4-b8d5-7b60739b1db7 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bf808aeff6462794e5d6c653c72ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c921299382141f99cd9c4b6b11927a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:04:01.360396 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-792893bb-21ad-49b4-b8d5-7b60739b1db7 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] 10.222.0.20 "GET /compute/v2.1/servers/826b1d59-bc93-4e01-a34d-e0f504e47c27" status: 200 len: 1374 microversion: 2.1 time: 0.157397 Oct 27 04:04:01.360972 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3208/6701] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:04:01 2022] GET /compute/v2.1/servers/826b1d59-bc93-4e01-a34d-e0f504e47c27 => generated 1374 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:04:01.887018 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-180aec79-e062-4337-b736-fec52818ebd3 req-d25da603-245e-4822-9090-38710ad9ce5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "826b1d59-bc93-4e01-a34d-e0f504e47c27", "name": "network-vif-plugged", "status": "completed", "tag": "1c897302-bf1a-42c2-899d-4837429a533c"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:04:01.893667 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=6 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:04:01.899283 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-180aec79-e062-4337-b736-fec52818ebd3 req-d25da603-245e-4822-9090-38710ad9ce5b service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:04:01.899781 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-180aec79-e062-4337-b736-fec52818ebd3 req-d25da603-245e-4822-9090-38710ad9ce5b service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:04:01.900257 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-180aec79-e062-4337-b736-fec52818ebd3 req-d25da603-245e-4822-9090-38710ad9ce5b service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:04:01.911463 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-180aec79-e062-4337-b736-fec52818ebd3 req-d25da603-245e-4822-9090-38710ad9ce5b service nova] Creating event network-vif-plugged:1c897302-bf1a-42c2-899d-4837429a533c for instance 826b1d59-bc93-4e01-a34d-e0f504e47c27 on n-h1-862769-1 Oct 27 04:04:01.916565 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-180aec79-e062-4337-b736-fec52818ebd3 req-d25da603-245e-4822-9090-38710ad9ce5b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034143 Oct 27 04:04:01.917213 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3494/6702] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:04:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:04:02.383144 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-19e4b9f2-4877-4c5b-9bd8-6d2f9b478a7a tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:04:02.384037 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-19e4b9f2-4877-4c5b-9bd8-6d2f9b478a7a tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] [instance: 826b1d59-bc93-4e01-a34d-e0f504e47c27] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:04:02.392726 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-19e4b9f2-4877-4c5b-9bd8-6d2f9b478a7a tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:04:02.393356 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-19e4b9f2-4877-4c5b-9bd8-6d2f9b478a7a tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:04:02.393960 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-19e4b9f2-4877-4c5b-9bd8-6d2f9b478a7a tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:04:02.394869 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-19e4b9f2-4877-4c5b-9bd8-6d2f9b478a7a tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:04:02.395429 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-19e4b9f2-4877-4c5b-9bd8-6d2f9b478a7a tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:04:02.395932 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-19e4b9f2-4877-4c5b-9bd8-6d2f9b478a7a tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:04:02.543640 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-19e4b9f2-4877-4c5b-9bd8-6d2f9b478a7a tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bf808aeff6462794e5d6c653c72ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c921299382141f99cd9c4b6b11927a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:04:02.552517 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-19e4b9f2-4877-4c5b-9bd8-6d2f9b478a7a tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] 10.222.0.20 "GET /compute/v2.1/servers/826b1d59-bc93-4e01-a34d-e0f504e47c27" status: 200 len: 1374 microversion: 2.1 time: 0.173290 Oct 27 04:04:02.558702 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3209/6703] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:04:02 2022] GET /compute/v2.1/servers/826b1d59-bc93-4e01-a34d-e0f504e47c27 => generated 1374 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:04:03.577611 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8bbe35c4-4ee6-4828-8066-3370adcd1c14 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:04:03.580859 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8bbe35c4-4ee6-4828-8066-3370adcd1c14 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] [instance: 826b1d59-bc93-4e01-a34d-e0f504e47c27] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:04:03.588741 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8bbe35c4-4ee6-4828-8066-3370adcd1c14 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:04:03.589240 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8bbe35c4-4ee6-4828-8066-3370adcd1c14 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:04:03.589688 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8bbe35c4-4ee6-4828-8066-3370adcd1c14 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:04:03.590461 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8bbe35c4-4ee6-4828-8066-3370adcd1c14 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:04:03.590926 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8bbe35c4-4ee6-4828-8066-3370adcd1c14 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:04:03.591362 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8bbe35c4-4ee6-4828-8066-3370adcd1c14 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:04:03.730104 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8bbe35c4-4ee6-4828-8066-3370adcd1c14 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bf808aeff6462794e5d6c653c72ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c921299382141f99cd9c4b6b11927a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:04:03.741269 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8bbe35c4-4ee6-4828-8066-3370adcd1c14 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] 10.222.0.20 "GET /compute/v2.1/servers/826b1d59-bc93-4e01-a34d-e0f504e47c27" status: 200 len: 1546 microversion: 2.1 time: 0.169057 Oct 27 04:04:03.742942 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3495/6704] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:04:03 2022] GET /compute/v2.1/servers/826b1d59-bc93-4e01-a34d-e0f504e47c27 => generated 1546 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:04:03.764706 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3c3daa0d-0950-4ba5-8bda-86e6fc619ddb tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:04:03.767042 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-3c3daa0d-0950-4ba5-8bda-86e6fc619ddb tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] [instance: 826b1d59-bc93-4e01-a34d-e0f504e47c27] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:04:03.774072 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3c3daa0d-0950-4ba5-8bda-86e6fc619ddb tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:04:03.774571 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3c3daa0d-0950-4ba5-8bda-86e6fc619ddb tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:04:03.775014 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3c3daa0d-0950-4ba5-8bda-86e6fc619ddb tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:04:03.775727 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3c3daa0d-0950-4ba5-8bda-86e6fc619ddb tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:04:03.776183 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3c3daa0d-0950-4ba5-8bda-86e6fc619ddb tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:04:03.776617 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3c3daa0d-0950-4ba5-8bda-86e6fc619ddb tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:04:03.929468 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-3c3daa0d-0950-4ba5-8bda-86e6fc619ddb tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bf808aeff6462794e5d6c653c72ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c921299382141f99cd9c4b6b11927a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:04:03.937483 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3c3daa0d-0950-4ba5-8bda-86e6fc619ddb tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] 10.222.0.20 "GET /compute/v2.1/servers/826b1d59-bc93-4e01-a34d-e0f504e47c27" status: 200 len: 1546 microversion: 2.1 time: 0.176660 Oct 27 04:04:03.940956 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3210/6705] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:04:03 2022] GET /compute/v2.1/servers/826b1d59-bc93-4e01-a34d-e0f504e47c27 => generated 1546 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:04:10.677003 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ea911571-15c9-4753-93f1-b4b9a50fd346 tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-2011894106", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:04:10.730667 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.network.neutron [None req-ea911571-15c9-4753-93f1-b4b9a50fd346 tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] validate_networks() for None {{(pid=121001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 04:04:11.007060 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-ea911571-15c9-4753-93f1-b4b9a50fd346 tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Flavor limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 04:04:11.007548 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-ea911571-15c9-4753-93f1-b4b9a50fd346 tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Image limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 04:04:11.008029 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-ea911571-15c9-4753-93f1-b4b9a50fd346 tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Flavor pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 04:04:11.008442 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-ea911571-15c9-4753-93f1-b4b9a50fd346 tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Image pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 04:04:11.008860 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-ea911571-15c9-4753-93f1-b4b9a50fd346 tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 04:04:11.018414 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ea911571-15c9-4753-93f1-b4b9a50fd346 tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:04:11.018910 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ea911571-15c9-4753-93f1-b4b9a50fd346 tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:04:11.019363 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ea911571-15c9-4753-93f1-b4b9a50fd346 tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:04:11.020133 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ea911571-15c9-4753-93f1-b4b9a50fd346 tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:04:11.020599 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ea911571-15c9-4753-93f1-b4b9a50fd346 tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:04:11.021039 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ea911571-15c9-4753-93f1-b4b9a50fd346 tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:04:11.038916 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-ea911571-15c9-4753-93f1-b4b9a50fd346 tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Getting quotas for project 38158a663ff04f19afebd7054ed4b2c4. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 04:04:11.044297 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-ea911571-15c9-4753-93f1-b4b9a50fd346 tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Getting quotas for user d5f2bbf4fa7a4768ba0d395217b3397e and project 38158a663ff04f19afebd7054ed4b2c4. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 04:04:11.056485 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ea911571-15c9-4753-93f1-b4b9a50fd346 tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Going to run 1 instances... {{(pid=121001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 04:04:11.058841 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ea911571-15c9-4753-93f1-b4b9a50fd346 tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] [instance: b2e26972-0eb6-44da-8ae0-10aee7463e0c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 04:04:11.165863 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ea911571-15c9-4753-93f1-b4b9a50fd346 tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.492722 Oct 27 04:04:11.167023 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3496/6706] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 04:04:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 495 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 04:04:11.178924 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-70d1ddc0-b8be-4253-ac47-f1a6f9d00bc3 tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:04:11.180140 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-70d1ddc0-b8be-4253-ac47-f1a6f9d00bc3 tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] [instance: b2e26972-0eb6-44da-8ae0-10aee7463e0c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:04:11.239049 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-70d1ddc0-b8be-4253-ac47-f1a6f9d00bc3 tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5f2bbf4fa7a4768ba0d395217b3397e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38158a663ff04f19afebd7054ed4b2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:04:11.246446 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-70d1ddc0-b8be-4253-ac47-f1a6f9d00bc3 tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] 10.222.0.20 "GET /compute/v2.1/servers/b2e26972-0eb6-44da-8ae0-10aee7463e0c" status: 200 len: 1214 microversion: 2.1 time: 0.071754 Oct 27 04:04:11.247024 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3211/6707] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:04:11 2022] GET /compute/v2.1/servers/b2e26972-0eb6-44da-8ae0-10aee7463e0c => generated 1214 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:04:12.271821 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f053a97e-47e1-4a06-b91f-1b316e66e18b tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:04:12.272451 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f053a97e-47e1-4a06-b91f-1b316e66e18b tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] [instance: b2e26972-0eb6-44da-8ae0-10aee7463e0c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:04:12.279786 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f053a97e-47e1-4a06-b91f-1b316e66e18b tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:04:12.280280 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f053a97e-47e1-4a06-b91f-1b316e66e18b tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:04:12.280736 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f053a97e-47e1-4a06-b91f-1b316e66e18b tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:04:12.281450 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f053a97e-47e1-4a06-b91f-1b316e66e18b tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:04:12.281914 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f053a97e-47e1-4a06-b91f-1b316e66e18b tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:04:12.282378 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f053a97e-47e1-4a06-b91f-1b316e66e18b tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:04:12.343267 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f053a97e-47e1-4a06-b91f-1b316e66e18b tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5f2bbf4fa7a4768ba0d395217b3397e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38158a663ff04f19afebd7054ed4b2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:04:12.351607 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f053a97e-47e1-4a06-b91f-1b316e66e18b tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] 10.222.0.20 "GET /compute/v2.1/servers/b2e26972-0eb6-44da-8ae0-10aee7463e0c" status: 200 len: 1218 microversion: 2.1 time: 0.084651 Oct 27 04:04:12.352200 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3497/6708] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:04:12 2022] GET /compute/v2.1/servers/b2e26972-0eb6-44da-8ae0-10aee7463e0c => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 04:04:13.375715 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8308457f-2afb-42d4-8ffe-1a1d10e7dced tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:04:13.376320 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8308457f-2afb-42d4-8ffe-1a1d10e7dced tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] [instance: b2e26972-0eb6-44da-8ae0-10aee7463e0c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:04:13.384965 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8308457f-2afb-42d4-8ffe-1a1d10e7dced tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:04:13.385695 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8308457f-2afb-42d4-8ffe-1a1d10e7dced tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:04:13.386403 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8308457f-2afb-42d4-8ffe-1a1d10e7dced tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:04:13.387585 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8308457f-2afb-42d4-8ffe-1a1d10e7dced tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:04:13.388262 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8308457f-2afb-42d4-8ffe-1a1d10e7dced tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:04:13.388905 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8308457f-2afb-42d4-8ffe-1a1d10e7dced tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:04:13.453712 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8308457f-2afb-42d4-8ffe-1a1d10e7dced tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5f2bbf4fa7a4768ba0d395217b3397e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38158a663ff04f19afebd7054ed4b2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:04:13.462643 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8308457f-2afb-42d4-8ffe-1a1d10e7dced tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] 10.222.0.20 "GET /compute/v2.1/servers/b2e26972-0eb6-44da-8ae0-10aee7463e0c" status: 200 len: 1284 microversion: 2.1 time: 0.090694 Oct 27 04:04:13.463193 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3212/6709] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:04:13 2022] GET /compute/v2.1/servers/b2e26972-0eb6-44da-8ae0-10aee7463e0c => generated 1284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 04:04:14.486124 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-29e72639-d70a-49ff-a7e9-948296ea5f32 tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:04:14.487610 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-29e72639-d70a-49ff-a7e9-948296ea5f32 tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] [instance: b2e26972-0eb6-44da-8ae0-10aee7463e0c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:04:14.496813 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-29e72639-d70a-49ff-a7e9-948296ea5f32 tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:04:14.497543 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-29e72639-d70a-49ff-a7e9-948296ea5f32 tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:04:14.498806 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-29e72639-d70a-49ff-a7e9-948296ea5f32 tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:04:14.500083 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-29e72639-d70a-49ff-a7e9-948296ea5f32 tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:04:14.500766 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-29e72639-d70a-49ff-a7e9-948296ea5f32 tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:04:14.501643 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-29e72639-d70a-49ff-a7e9-948296ea5f32 tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:04:14.717938 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-29e72639-d70a-49ff-a7e9-948296ea5f32 tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5f2bbf4fa7a4768ba0d395217b3397e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38158a663ff04f19afebd7054ed4b2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:04:14.727822 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-29e72639-d70a-49ff-a7e9-948296ea5f32 tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] 10.222.0.20 "GET /compute/v2.1/servers/b2e26972-0eb6-44da-8ae0-10aee7463e0c" status: 200 len: 1314 microversion: 2.1 time: 0.245621 Oct 27 04:04:14.728906 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3498/6710] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:04:14 2022] GET /compute/v2.1/servers/b2e26972-0eb6-44da-8ae0-10aee7463e0c => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:04:15.202114 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-da722215-392d-448a-b760-455aedced297 req-d6650a69-4f24-4b3c-80e9-6df76bc9f656 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2e26972-0eb6-44da-8ae0-10aee7463e0c", "tag": "70ffca0e-4e24-44e4-a4f9-33034e171786"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:04:15.217922 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-da722215-392d-448a-b760-455aedced297 req-d6650a69-4f24-4b3c-80e9-6df76bc9f656 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:04:15.219329 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-da722215-392d-448a-b760-455aedced297 req-d6650a69-4f24-4b3c-80e9-6df76bc9f656 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:04:15.220279 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-da722215-392d-448a-b760-455aedced297 req-d6650a69-4f24-4b3c-80e9-6df76bc9f656 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:04:15.237622 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-da722215-392d-448a-b760-455aedced297 req-d6650a69-4f24-4b3c-80e9-6df76bc9f656 service nova] Creating event network-changed:70ffca0e-4e24-44e4-a4f9-33034e171786 for instance b2e26972-0eb6-44da-8ae0-10aee7463e0c on n-h2-862769-1 Oct 27 04:04:15.249367 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-da722215-392d-448a-b760-455aedced297 req-d6650a69-4f24-4b3c-80e9-6df76bc9f656 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053328 Oct 27 04:04:15.251361 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3213/6711] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:04:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:04:15.751976 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2adaa7bf-9c4d-4a76-9e78-b52974fba252 tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:04:15.753199 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2adaa7bf-9c4d-4a76-9e78-b52974fba252 tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] [instance: b2e26972-0eb6-44da-8ae0-10aee7463e0c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:04:15.761413 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2adaa7bf-9c4d-4a76-9e78-b52974fba252 tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:04:15.762068 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2adaa7bf-9c4d-4a76-9e78-b52974fba252 tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:04:15.762691 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2adaa7bf-9c4d-4a76-9e78-b52974fba252 tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:04:15.763568 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2adaa7bf-9c4d-4a76-9e78-b52974fba252 tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:04:15.764187 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2adaa7bf-9c4d-4a76-9e78-b52974fba252 tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:04:15.764773 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2adaa7bf-9c4d-4a76-9e78-b52974fba252 tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:04:15.971026 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2adaa7bf-9c4d-4a76-9e78-b52974fba252 tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5f2bbf4fa7a4768ba0d395217b3397e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38158a663ff04f19afebd7054ed4b2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:04:15.979628 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2adaa7bf-9c4d-4a76-9e78-b52974fba252 tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] 10.222.0.20 "GET /compute/v2.1/servers/b2e26972-0eb6-44da-8ae0-10aee7463e0c" status: 200 len: 1314 microversion: 2.1 time: 0.232145 Oct 27 04:04:15.980211 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3499/6712] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:04:15 2022] GET /compute/v2.1/servers/b2e26972-0eb6-44da-8ae0-10aee7463e0c => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:04:17.003054 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1d4bae8f-f628-40c3-b824-2e2107e785b5 tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:04:17.003791 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1d4bae8f-f628-40c3-b824-2e2107e785b5 tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] [instance: b2e26972-0eb6-44da-8ae0-10aee7463e0c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:04:17.011727 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1d4bae8f-f628-40c3-b824-2e2107e785b5 tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:04:17.012248 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1d4bae8f-f628-40c3-b824-2e2107e785b5 tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:04:17.012690 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1d4bae8f-f628-40c3-b824-2e2107e785b5 tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:04:17.013431 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1d4bae8f-f628-40c3-b824-2e2107e785b5 tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:04:17.013891 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1d4bae8f-f628-40c3-b824-2e2107e785b5 tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:04:17.014366 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1d4bae8f-f628-40c3-b824-2e2107e785b5 tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:04:17.143227 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1d4bae8f-f628-40c3-b824-2e2107e785b5 tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5f2bbf4fa7a4768ba0d395217b3397e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38158a663ff04f19afebd7054ed4b2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:04:17.150935 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1d4bae8f-f628-40c3-b824-2e2107e785b5 tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] 10.222.0.20 "GET /compute/v2.1/servers/b2e26972-0eb6-44da-8ae0-10aee7463e0c" status: 200 len: 1314 microversion: 2.1 time: 0.152109 Oct 27 04:04:17.151521 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3214/6713] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:04:16 2022] GET /compute/v2.1/servers/b2e26972-0eb6-44da-8ae0-10aee7463e0c => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:04:18.175357 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9bfc990b-2bfd-48f6-8d1d-4f6bb361680b tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:04:18.175943 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-9bfc990b-2bfd-48f6-8d1d-4f6bb361680b tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] [instance: b2e26972-0eb6-44da-8ae0-10aee7463e0c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:04:18.178563 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=4 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:04:18.183525 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9bfc990b-2bfd-48f6-8d1d-4f6bb361680b tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:04:18.189092 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9bfc990b-2bfd-48f6-8d1d-4f6bb361680b tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:04:18.190814 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9bfc990b-2bfd-48f6-8d1d-4f6bb361680b tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:04:18.190814 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9bfc990b-2bfd-48f6-8d1d-4f6bb361680b tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:04:18.191326 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9bfc990b-2bfd-48f6-8d1d-4f6bb361680b tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:04:18.191326 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9bfc990b-2bfd-48f6-8d1d-4f6bb361680b tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:04:18.323878 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9bfc990b-2bfd-48f6-8d1d-4f6bb361680b tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5f2bbf4fa7a4768ba0d395217b3397e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38158a663ff04f19afebd7054ed4b2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:04:18.331749 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9bfc990b-2bfd-48f6-8d1d-4f6bb361680b tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] 10.222.0.20 "GET /compute/v2.1/servers/b2e26972-0eb6-44da-8ae0-10aee7463e0c" status: 200 len: 1314 microversion: 2.1 time: 0.160506 Oct 27 04:04:18.332334 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3500/6714] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:04:18 2022] GET /compute/v2.1/servers/b2e26972-0eb6-44da-8ae0-10aee7463e0c => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:04:19.354545 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e250533a-b26e-4ec1-8979-8b7404996dde tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:04:19.355411 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e250533a-b26e-4ec1-8979-8b7404996dde tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] [instance: b2e26972-0eb6-44da-8ae0-10aee7463e0c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:04:19.362422 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e250533a-b26e-4ec1-8979-8b7404996dde tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:04:19.362988 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e250533a-b26e-4ec1-8979-8b7404996dde tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:04:19.363503 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e250533a-b26e-4ec1-8979-8b7404996dde tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:04:19.364272 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e250533a-b26e-4ec1-8979-8b7404996dde tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:04:19.364804 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e250533a-b26e-4ec1-8979-8b7404996dde tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:04:19.365362 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e250533a-b26e-4ec1-8979-8b7404996dde tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:04:19.501561 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e250533a-b26e-4ec1-8979-8b7404996dde tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5f2bbf4fa7a4768ba0d395217b3397e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38158a663ff04f19afebd7054ed4b2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:04:19.510005 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e250533a-b26e-4ec1-8979-8b7404996dde tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] 10.222.0.20 "GET /compute/v2.1/servers/b2e26972-0eb6-44da-8ae0-10aee7463e0c" status: 200 len: 1314 microversion: 2.1 time: 0.160104 Oct 27 04:04:19.510604 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3215/6715] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:04:19 2022] GET /compute/v2.1/servers/b2e26972-0eb6-44da-8ae0-10aee7463e0c => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:04:20.533637 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e793a359-77d8-419e-aeb8-1a2826662822 tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:04:20.534299 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e793a359-77d8-419e-aeb8-1a2826662822 tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] [instance: b2e26972-0eb6-44da-8ae0-10aee7463e0c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:04:20.541924 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e793a359-77d8-419e-aeb8-1a2826662822 tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:04:20.542501 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e793a359-77d8-419e-aeb8-1a2826662822 tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:04:20.542955 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e793a359-77d8-419e-aeb8-1a2826662822 tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:04:20.543661 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e793a359-77d8-419e-aeb8-1a2826662822 tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:04:20.544123 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e793a359-77d8-419e-aeb8-1a2826662822 tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:04:20.544559 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e793a359-77d8-419e-aeb8-1a2826662822 tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:04:20.676647 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e793a359-77d8-419e-aeb8-1a2826662822 tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5f2bbf4fa7a4768ba0d395217b3397e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38158a663ff04f19afebd7054ed4b2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:04:20.686807 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e793a359-77d8-419e-aeb8-1a2826662822 tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] 10.222.0.20 "GET /compute/v2.1/servers/b2e26972-0eb6-44da-8ae0-10aee7463e0c" status: 200 len: 1314 microversion: 2.1 time: 0.156194 Oct 27 04:04:20.687229 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3501/6716] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:04:20 2022] GET /compute/v2.1/servers/b2e26972-0eb6-44da-8ae0-10aee7463e0c => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:04:21.712808 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4432cd08-0344-478b-bee5-45909ccf64dc tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:04:21.713428 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4432cd08-0344-478b-bee5-45909ccf64dc tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] [instance: b2e26972-0eb6-44da-8ae0-10aee7463e0c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:04:21.716317 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:04:21.717895 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:04:21.722194 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4432cd08-0344-478b-bee5-45909ccf64dc tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:04:21.722695 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4432cd08-0344-478b-bee5-45909ccf64dc tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:04:21.723151 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4432cd08-0344-478b-bee5-45909ccf64dc tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:04:21.723947 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4432cd08-0344-478b-bee5-45909ccf64dc tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:04:21.724266 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4432cd08-0344-478b-bee5-45909ccf64dc tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:04:21.724704 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4432cd08-0344-478b-bee5-45909ccf64dc tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:04:21.730078 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=61 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:04:21.771563 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-c74fc744-2080-4755-b4d2-07367abea97c req-a1bf437e-f21c-4622-a68d-6694e9d592a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2e26972-0eb6-44da-8ae0-10aee7463e0c", "name": "network-vif-plugged", "status": "completed", "tag": "70ffca0e-4e24-44e4-a4f9-33034e171786"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:04:21.789895 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:04:21.790692 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=6 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:04:21.797860 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-c74fc744-2080-4755-b4d2-07367abea97c req-a1bf437e-f21c-4622-a68d-6694e9d592a7 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:04:21.798381 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-c74fc744-2080-4755-b4d2-07367abea97c req-a1bf437e-f21c-4622-a68d-6694e9d592a7 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:04:21.798999 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-c74fc744-2080-4755-b4d2-07367abea97c req-a1bf437e-f21c-4622-a68d-6694e9d592a7 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:04:21.802960 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=65 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:04:21.810670 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-c74fc744-2080-4755-b4d2-07367abea97c req-a1bf437e-f21c-4622-a68d-6694e9d592a7 service nova] Creating event network-vif-plugged:70ffca0e-4e24-44e4-a4f9-33034e171786 for instance b2e26972-0eb6-44da-8ae0-10aee7463e0c on n-h2-862769-1 Oct 27 04:04:21.816475 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-c74fc744-2080-4755-b4d2-07367abea97c req-a1bf437e-f21c-4622-a68d-6694e9d592a7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049391 Oct 27 04:04:21.822101 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3502/6717] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:04:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:04:21.870910 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4432cd08-0344-478b-bee5-45909ccf64dc tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5f2bbf4fa7a4768ba0d395217b3397e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38158a663ff04f19afebd7054ed4b2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:04:21.881977 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4432cd08-0344-478b-bee5-45909ccf64dc tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] 10.222.0.20 "GET /compute/v2.1/servers/b2e26972-0eb6-44da-8ae0-10aee7463e0c" status: 200 len: 1314 microversion: 2.1 time: 0.173697 Oct 27 04:04:21.883840 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3216/6718] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:04:21 2022] GET /compute/v2.1/servers/b2e26972-0eb6-44da-8ae0-10aee7463e0c => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 04:04:22.915152 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-87c02d6d-0020-4fe5-aa73-93d6c7381a83 tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:04:22.915895 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-87c02d6d-0020-4fe5-aa73-93d6c7381a83 tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] [instance: b2e26972-0eb6-44da-8ae0-10aee7463e0c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:04:22.924378 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-87c02d6d-0020-4fe5-aa73-93d6c7381a83 tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:04:22.924878 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-87c02d6d-0020-4fe5-aa73-93d6c7381a83 tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:04:22.925329 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-87c02d6d-0020-4fe5-aa73-93d6c7381a83 tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:04:22.926099 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-87c02d6d-0020-4fe5-aa73-93d6c7381a83 tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:04:22.926561 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-87c02d6d-0020-4fe5-aa73-93d6c7381a83 tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:04:22.926999 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-87c02d6d-0020-4fe5-aa73-93d6c7381a83 tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:04:23.062510 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-87c02d6d-0020-4fe5-aa73-93d6c7381a83 tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5f2bbf4fa7a4768ba0d395217b3397e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38158a663ff04f19afebd7054ed4b2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:04:23.070999 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-87c02d6d-0020-4fe5-aa73-93d6c7381a83 tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] 10.222.0.20 "GET /compute/v2.1/servers/b2e26972-0eb6-44da-8ae0-10aee7463e0c" status: 200 len: 1314 microversion: 2.1 time: 0.162001 Oct 27 04:04:23.071664 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3503/6719] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:04:22 2022] GET /compute/v2.1/servers/b2e26972-0eb6-44da-8ae0-10aee7463e0c => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:04:24.094819 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e87cce5c-93b8-471d-a2a1-bc1fb833dde0 tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:04:24.095408 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e87cce5c-93b8-471d-a2a1-bc1fb833dde0 tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] [instance: b2e26972-0eb6-44da-8ae0-10aee7463e0c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:04:24.103278 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e87cce5c-93b8-471d-a2a1-bc1fb833dde0 tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:04:24.103768 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e87cce5c-93b8-471d-a2a1-bc1fb833dde0 tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:04:24.104206 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e87cce5c-93b8-471d-a2a1-bc1fb833dde0 tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:04:24.104902 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e87cce5c-93b8-471d-a2a1-bc1fb833dde0 tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:04:24.105390 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e87cce5c-93b8-471d-a2a1-bc1fb833dde0 tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:04:24.105820 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e87cce5c-93b8-471d-a2a1-bc1fb833dde0 tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:04:24.249962 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e87cce5c-93b8-471d-a2a1-bc1fb833dde0 tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5f2bbf4fa7a4768ba0d395217b3397e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38158a663ff04f19afebd7054ed4b2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:04:24.258135 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e87cce5c-93b8-471d-a2a1-bc1fb833dde0 tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] 10.222.0.20 "GET /compute/v2.1/servers/b2e26972-0eb6-44da-8ae0-10aee7463e0c" status: 200 len: 1464 microversion: 2.1 time: 0.167481 Oct 27 04:04:24.258812 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3217/6720] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:04:24 2022] GET /compute/v2.1/servers/b2e26972-0eb6-44da-8ae0-10aee7463e0c => generated 1464 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:04:24.283349 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-fc4eaf3f-83be-423e-b9cb-059b6374b544 tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7f015ebd-2e38-4e10-8e1d-bfef0334174d", "device": "/dev/sdb"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:04:24.285763 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-fc4eaf3f-83be-423e-b9cb-059b6374b544 tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] [instance: b2e26972-0eb6-44da-8ae0-10aee7463e0c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:04:24.293269 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fc4eaf3f-83be-423e-b9cb-059b6374b544 tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:04:24.293768 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fc4eaf3f-83be-423e-b9cb-059b6374b544 tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:04:24.294246 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fc4eaf3f-83be-423e-b9cb-059b6374b544 tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:04:24.294953 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fc4eaf3f-83be-423e-b9cb-059b6374b544 tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:04:24.295416 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fc4eaf3f-83be-423e-b9cb-059b6374b544 tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:04:24.295852 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fc4eaf3f-83be-423e-b9cb-059b6374b544 tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:04:25.059758 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-fc4eaf3f-83be-423e-b9cb-059b6374b544 tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] 10.222.0.20 "POST /compute/v2.1/servers/b2e26972-0eb6-44da-8ae0-10aee7463e0c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.780185 Oct 27 04:04:25.060400 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3504/6721] 10.222.0.20 () {60 vars in 1323 bytes} [Thu Oct 27 04:04:24 2022] POST /compute/v2.1/servers/b2e26972-0eb6-44da-8ae0-10aee7463e0c/os-volume_attachments => generated 194 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:04:32.892080 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5e56e88a-802f-4f1c-8035-9b8d2d2b43ac tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:04:32.892600 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5e56e88a-802f-4f1c-8035-9b8d2d2b43ac tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] [instance: 826b1d59-bc93-4e01-a34d-e0f504e47c27] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:04:32.900189 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5e56e88a-802f-4f1c-8035-9b8d2d2b43ac tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:04:32.900680 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5e56e88a-802f-4f1c-8035-9b8d2d2b43ac tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:04:32.901124 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5e56e88a-802f-4f1c-8035-9b8d2d2b43ac tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:04:32.901837 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5e56e88a-802f-4f1c-8035-9b8d2d2b43ac tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:04:32.902390 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5e56e88a-802f-4f1c-8035-9b8d2d2b43ac tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:04:32.902828 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5e56e88a-802f-4f1c-8035-9b8d2d2b43ac tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:04:32.933945 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5e56e88a-802f-4f1c-8035-9b8d2d2b43ac tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] [instance: 826b1d59-bc93-4e01-a34d-e0f504e47c27] Going to try to terminate instance {{(pid=121000) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 04:04:33.185629 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5e56e88a-802f-4f1c-8035-9b8d2d2b43ac tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] 10.222.0.20 "DELETE /compute/v2.1/servers/826b1d59-bc93-4e01-a34d-e0f504e47c27" status: 204 len: 0 microversion: 2.1 time: 0.297180 Oct 27 04:04:33.186392 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3218/6722] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 04:04:32 2022] DELETE /compute/v2.1/servers/826b1d59-bc93-4e01-a34d-e0f504e47c27 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 04:04:33.200315 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c0b4451c-8b8e-449d-81fc-6fb94a1eea26 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:04:33.201033 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c0b4451c-8b8e-449d-81fc-6fb94a1eea26 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] [instance: 826b1d59-bc93-4e01-a34d-e0f504e47c27] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:04:33.215615 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c0b4451c-8b8e-449d-81fc-6fb94a1eea26 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:04:33.216395 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c0b4451c-8b8e-449d-81fc-6fb94a1eea26 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:04:33.217549 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c0b4451c-8b8e-449d-81fc-6fb94a1eea26 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:04:33.219123 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c0b4451c-8b8e-449d-81fc-6fb94a1eea26 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:04:33.220449 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c0b4451c-8b8e-449d-81fc-6fb94a1eea26 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:04:33.221080 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c0b4451c-8b8e-449d-81fc-6fb94a1eea26 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:04:33.389675 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c0b4451c-8b8e-449d-81fc-6fb94a1eea26 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bf808aeff6462794e5d6c653c72ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c921299382141f99cd9c4b6b11927a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:04:33.399720 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c0b4451c-8b8e-449d-81fc-6fb94a1eea26 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] 10.222.0.20 "GET /compute/v2.1/servers/826b1d59-bc93-4e01-a34d-e0f504e47c27" status: 200 len: 1552 microversion: 2.1 time: 0.203780 Oct 27 04:04:33.401169 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3505/6723] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:04:33 2022] GET /compute/v2.1/servers/826b1d59-bc93-4e01-a34d-e0f504e47c27 => generated 1552 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:04:34.424283 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-73e008e6-d05b-48b3-8662-9fc91242db31 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:04:34.426293 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-73e008e6-d05b-48b3-8662-9fc91242db31 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] [instance: 826b1d59-bc93-4e01-a34d-e0f504e47c27] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:04:34.434439 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-73e008e6-d05b-48b3-8662-9fc91242db31 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:04:34.434950 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-73e008e6-d05b-48b3-8662-9fc91242db31 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:04:34.435407 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-73e008e6-d05b-48b3-8662-9fc91242db31 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:04:34.436141 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-73e008e6-d05b-48b3-8662-9fc91242db31 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:04:34.436608 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-73e008e6-d05b-48b3-8662-9fc91242db31 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:04:34.437049 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-73e008e6-d05b-48b3-8662-9fc91242db31 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:04:34.575843 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-73e008e6-d05b-48b3-8662-9fc91242db31 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bf808aeff6462794e5d6c653c72ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c921299382141f99cd9c4b6b11927a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:04:34.583876 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-73e008e6-d05b-48b3-8662-9fc91242db31 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] 10.222.0.20 "GET /compute/v2.1/servers/826b1d59-bc93-4e01-a34d-e0f504e47c27" status: 200 len: 1552 microversion: 2.1 time: 0.164171 Oct 27 04:04:34.584466 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3219/6724] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:04:34 2022] GET /compute/v2.1/servers/826b1d59-bc93-4e01-a34d-e0f504e47c27 => generated 1552 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:04:35.185732 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-af9fc64c-8983-4bb0-a74f-1e7871af9f2f req-1488fa4d-ceef-4e0e-b453-15854d0b77ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "826b1d59-bc93-4e01-a34d-e0f504e47c27", "name": "network-vif-deleted", "tag": "1c897302-bf1a-42c2-899d-4837429a533c"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:04:35.200241 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-af9fc64c-8983-4bb0-a74f-1e7871af9f2f req-1488fa4d-ceef-4e0e-b453-15854d0b77ff service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:04:35.202309 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-af9fc64c-8983-4bb0-a74f-1e7871af9f2f req-1488fa4d-ceef-4e0e-b453-15854d0b77ff service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:04:35.202309 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-af9fc64c-8983-4bb0-a74f-1e7871af9f2f req-1488fa4d-ceef-4e0e-b453-15854d0b77ff service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:04:35.213461 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-af9fc64c-8983-4bb0-a74f-1e7871af9f2f req-1488fa4d-ceef-4e0e-b453-15854d0b77ff service nova] Creating event network-vif-deleted:1c897302-bf1a-42c2-899d-4837429a533c for instance 826b1d59-bc93-4e01-a34d-e0f504e47c27 on n-h1-862769-1 Oct 27 04:04:35.218639 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-af9fc64c-8983-4bb0-a74f-1e7871af9f2f req-1488fa4d-ceef-4e0e-b453-15854d0b77ff service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037515 Oct 27 04:04:35.224226 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3506/6725] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:04:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:04:35.613226 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-bf07856a-8a3f-4313-a92c-a2e9235f3d02 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:04:35.614571 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-bf07856a-8a3f-4313-a92c-a2e9235f3d02 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] [instance: 826b1d59-bc93-4e01-a34d-e0f504e47c27] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:04:35.622324 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bf07856a-8a3f-4313-a92c-a2e9235f3d02 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:04:35.623176 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bf07856a-8a3f-4313-a92c-a2e9235f3d02 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:04:35.623796 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bf07856a-8a3f-4313-a92c-a2e9235f3d02 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:04:35.624726 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bf07856a-8a3f-4313-a92c-a2e9235f3d02 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:04:35.625731 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bf07856a-8a3f-4313-a92c-a2e9235f3d02 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:04:35.626470 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bf07856a-8a3f-4313-a92c-a2e9235f3d02 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:04:35.666471 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bf07856a-8a3f-4313-a92c-a2e9235f3d02 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:04:35.667212 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bf07856a-8a3f-4313-a92c-a2e9235f3d02 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:04:35.667654 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bf07856a-8a3f-4313-a92c-a2e9235f3d02 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:04:35.668107 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-bf07856a-8a3f-4313-a92c-a2e9235f3d02 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lazy-loading 'fault' on Instance uuid 826b1d59-bc93-4e01-a34d-e0f504e47c27 {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 04:04:35.712712 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-bf07856a-8a3f-4313-a92c-a2e9235f3d02 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bf808aeff6462794e5d6c653c72ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c921299382141f99cd9c4b6b11927a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:04:35.727005 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-bf07856a-8a3f-4313-a92c-a2e9235f3d02 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] 10.222.0.20 "GET /compute/v2.1/servers/826b1d59-bc93-4e01-a34d-e0f504e47c27" status: 200 len: 1339 microversion: 2.1 time: 0.122757 Oct 27 04:04:35.729181 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3220/6726] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:04:35 2022] GET /compute/v2.1/servers/826b1d59-bc93-4e01-a34d-e0f504e47c27 => generated 1339 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:04:36.754501 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-293a0ebf-bacb-4adb-9304-4452cd7a1927 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:04:36.755161 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-293a0ebf-bacb-4adb-9304-4452cd7a1927 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] [instance: 826b1d59-bc93-4e01-a34d-e0f504e47c27] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:04:36.762615 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-293a0ebf-bacb-4adb-9304-4452cd7a1927 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:04:36.763104 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-293a0ebf-bacb-4adb-9304-4452cd7a1927 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:04:36.763547 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-293a0ebf-bacb-4adb-9304-4452cd7a1927 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:04:36.764249 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-293a0ebf-bacb-4adb-9304-4452cd7a1927 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:04:36.764723 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-293a0ebf-bacb-4adb-9304-4452cd7a1927 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:04:36.765141 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-293a0ebf-bacb-4adb-9304-4452cd7a1927 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:04:36.779292 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-293a0ebf-bacb-4adb-9304-4452cd7a1927 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] HTTP exception thrown: Instance 826b1d59-bc93-4e01-a34d-e0f504e47c27 could not be found. Oct 27 04:04:36.780982 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-293a0ebf-bacb-4adb-9304-4452cd7a1927 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Request method failure captured: Oct 27 04:04:36.780982 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/826b1d59-bc93-4e01-a34d-e0f504e47c27 HTTP/1.1 Oct 27 04:04:36.780982 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 04:04:36.780982 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 04:04:36.780982 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 04:04:36.780982 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 04:04:36.780982 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 04:04:36.780982 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 04:04:36.780982 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 04:04:36.780982 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 04:04:36.780982 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWgLdrMEnhoO8AegDn0YZKRNA5IK7Cm0iiw04H26wQZCw3bRQksYhpbMh_lBkTWEXTmVDbO4BMuQ24TunIeg8EwFZxUPqOYztP-l3CXue8drga5HyDPVE0JrJ5G6iGTDgT_vwr2oE4LbYggYst_ivqWaz7JYjwtrSSw6pM7yIOdk0mf4 Oct 27 04:04:36.780982 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 04:04:36.780982 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 04:04:36.780982 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 04:04:36.780982 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 04:04:36.780982 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 04:04:36.780982 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 04:04:36.780982 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 9c921299382141f99cd9c4b6b11927a4 Oct 27 04:04:36.780982 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-TestNetworkBasicOps-1974434160 Oct 27 04:04:36.780982 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 04:04:36.780982 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 04:04:36.780982 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9c921299382141f99cd9c4b6b11927a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9c921299382141f99cd9c4b6b11927a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9c921299382141f99cd9c4b6b11927a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9c921299382141f99cd9c4b6b11927a4"}]}] Oct 27 04:04:36.780982 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-TestNetworkBasicOps-1974434160 Oct 27 04:04:36.780982 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 9c921299382141f99cd9c4b6b11927a4 Oct 27 04:04:36.780982 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-TestNetworkBasicOps-1974434160 Oct 27 04:04:36.780982 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-TestNetworkBasicOps-1974434160-project Oct 27 04:04:36.780982 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 04:04:36.780982 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 04:04:36.780982 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 98bf808aeff6462794e5d6c653c72ae2 Oct 27 04:04:36.780982 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-TestNetworkBasicOps-1974434160-project Oct 27 04:04:36.780982 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 04:04:36.780982 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 826b1d59-bc93-4e01-a34d-e0f504e47c27 could not be found. Oct 27 04:04:36.780982 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '826b1d59-bc93-4e01-a34d-e0f504e47c27'} Oct 27 04:04:36.780982 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 04:04:36.780982 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:04:36.780982 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 04:04:36.780982 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 04:04:36.780982 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 04:04:36.780982 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 04:04:36.780982 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 04:04:36.780982 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 04:04:36.780982 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 04:04:36.780982 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 04:04:36.780982 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 826b1d59-bc93-4e01-a34d-e0f504e47c27 could not be found. Oct 27 04:04:36.780982 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:04:36.780982 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:04:36.780982 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:04:36.780982 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:04:36.780982 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:04:36.780982 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:04:36.780982 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 04:04:36.780982 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 04:04:36.780982 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 04:04:36.780982 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 04:04:36.780982 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 04:04:36.780982 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 04:04:36.780982 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 04:04:36.780982 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 04:04:36.780982 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 04:04:36.780982 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 04:04:36.780982 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 826b1d59-bc93-4e01-a34d-e0f504e47c27 could not be found. Oct 27 04:04:36.780982 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:04:36.780982 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:04:36.780982 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:04:36.786370 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:04:36.786370 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:04:36.786370 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:04:36.786370 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 04:04:36.786370 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 04:04:36.786370 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 826b1d59-bc93-4e01-a34d-e0f504e47c27 could not be found. Oct 27 04:04:36.786370 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:04:36.786370 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-293a0ebf-bacb-4adb-9304-4452cd7a1927 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Returning 404 to user: Instance 826b1d59-bc93-4e01-a34d-e0f504e47c27 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 04:04:36.786370 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-293a0ebf-bacb-4adb-9304-4452cd7a1927 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] 10.222.0.20 "GET /compute/v2.1/servers/826b1d59-bc93-4e01-a34d-e0f504e47c27" status: 404 len: 111 microversion: 2.1 time: 0.033155 Oct 27 04:04:36.786370 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3507/6727] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:04:36 2022] GET /compute/v2.1/servers/826b1d59-bc93-4e01-a34d-e0f504e47c27 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 04:04:37.097290 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-81c1c0b2-4419-4721-a752-a7c208bb5566 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Calling method '.version_select at 0x7f7dd9d59280>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:04:37.169079 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-81c1c0b2-4419-4721-a752-a7c208bb5566 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1604997581" status: 202 len: 0 microversion: 2.1 time: 0.075665 Oct 27 04:04:37.169937 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3221/6728] 10.222.0.20 () {58 vars in 1257 bytes} [Thu Oct 27 04:04:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1604997581 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 04:04:39.421552 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-60b88e54-6c7f-40b2-a141-7c142f988cff req-bff0bf8a-6825-4599-b2e1-6ae90f566e0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23264674-8d93-4940-85c1-1b966018a9bd", "tag": "0c136851-16a1-41cc-810e-35dcd67481cf"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:04:39.424521 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4b8a9b97-2869-4d37-b994-a8e47aa0a0cf tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:04:39.432411 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4b8a9b97-2869-4d37-b994-a8e47aa0a0cf tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] [instance: 23264674-8d93-4940-85c1-1b966018a9bd] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:04:39.439654 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4b8a9b97-2869-4d37-b994-a8e47aa0a0cf tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:04:39.441926 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4b8a9b97-2869-4d37-b994-a8e47aa0a0cf tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:04:39.443665 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4b8a9b97-2869-4d37-b994-a8e47aa0a0cf tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:04:39.445184 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4b8a9b97-2869-4d37-b994-a8e47aa0a0cf tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:04:39.447188 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-60b88e54-6c7f-40b2-a141-7c142f988cff req-bff0bf8a-6825-4599-b2e1-6ae90f566e0e service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:04:39.447892 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4b8a9b97-2869-4d37-b994-a8e47aa0a0cf tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:04:39.448905 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4b8a9b97-2869-4d37-b994-a8e47aa0a0cf tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:04:39.450207 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-60b88e54-6c7f-40b2-a141-7c142f988cff req-bff0bf8a-6825-4599-b2e1-6ae90f566e0e service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:04:39.453171 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-60b88e54-6c7f-40b2-a141-7c142f988cff req-bff0bf8a-6825-4599-b2e1-6ae90f566e0e service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:04:39.475646 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-60b88e54-6c7f-40b2-a141-7c142f988cff req-bff0bf8a-6825-4599-b2e1-6ae90f566e0e service nova] Creating event network-changed:0c136851-16a1-41cc-810e-35dcd67481cf for instance 23264674-8d93-4940-85c1-1b966018a9bd on n-h2-862769-1 Oct 27 04:04:39.489947 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-60b88e54-6c7f-40b2-a141-7c142f988cff req-bff0bf8a-6825-4599-b2e1-6ae90f566e0e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071995 Oct 27 04:04:39.493332 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3222/6729] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:04:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:04:39.500739 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4b8a9b97-2869-4d37-b994-a8e47aa0a0cf tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] [instance: 23264674-8d93-4940-85c1-1b966018a9bd] Going to try to terminate instance {{(pid=121001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 04:04:39.871476 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4b8a9b97-2869-4d37-b994-a8e47aa0a0cf tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] 10.222.0.20 "DELETE /compute/v2.1/servers/23264674-8d93-4940-85c1-1b966018a9bd" status: 204 len: 0 microversion: 2.1 time: 0.457659 Oct 27 04:04:39.872068 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3508/6730] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 04:04:39 2022] DELETE /compute/v2.1/servers/23264674-8d93-4940-85c1-1b966018a9bd => generated 0 bytes in 459 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 04:04:39.889266 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-eb79e16d-24c9-4530-b68a-b466b6ff6b00 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:04:39.889266 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-eb79e16d-24c9-4530-b68a-b466b6ff6b00 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] [instance: 23264674-8d93-4940-85c1-1b966018a9bd] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:04:39.901544 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eb79e16d-24c9-4530-b68a-b466b6ff6b00 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:04:39.902227 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eb79e16d-24c9-4530-b68a-b466b6ff6b00 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:04:39.902684 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eb79e16d-24c9-4530-b68a-b466b6ff6b00 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:04:39.905944 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eb79e16d-24c9-4530-b68a-b466b6ff6b00 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:04:39.907462 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eb79e16d-24c9-4530-b68a-b466b6ff6b00 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:04:39.907924 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eb79e16d-24c9-4530-b68a-b466b6ff6b00 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:04:40.105153 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-eb79e16d-24c9-4530-b68a-b466b6ff6b00 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bf808aeff6462794e5d6c653c72ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c921299382141f99cd9c4b6b11927a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:04:40.123376 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-eb79e16d-24c9-4530-b68a-b466b6ff6b00 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] 10.222.0.20 "GET /compute/v2.1/servers/23264674-8d93-4940-85c1-1b966018a9bd" status: 200 len: 1671 microversion: 2.1 time: 0.246523 Oct 27 04:04:40.126454 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3223/6731] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:04:39 2022] GET /compute/v2.1/servers/23264674-8d93-4940-85c1-1b966018a9bd => generated 1671 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:04:41.150107 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9a695b1b-a365-4666-8b5d-aefab52305ed tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:04:41.150754 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-9a695b1b-a365-4666-8b5d-aefab52305ed tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] [instance: 23264674-8d93-4940-85c1-1b966018a9bd] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:04:41.158352 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9a695b1b-a365-4666-8b5d-aefab52305ed tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:04:41.158852 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9a695b1b-a365-4666-8b5d-aefab52305ed tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:04:41.165785 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9a695b1b-a365-4666-8b5d-aefab52305ed tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:04:41.165785 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9a695b1b-a365-4666-8b5d-aefab52305ed tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:04:41.165785 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9a695b1b-a365-4666-8b5d-aefab52305ed tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:04:41.165785 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9a695b1b-a365-4666-8b5d-aefab52305ed tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:04:41.372898 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9a695b1b-a365-4666-8b5d-aefab52305ed tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bf808aeff6462794e5d6c653c72ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c921299382141f99cd9c4b6b11927a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:04:41.384707 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9a695b1b-a365-4666-8b5d-aefab52305ed tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] 10.222.0.20 "GET /compute/v2.1/servers/23264674-8d93-4940-85c1-1b966018a9bd" status: 200 len: 1671 microversion: 2.1 time: 0.239381 Oct 27 04:04:41.385927 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3509/6732] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:04:41 2022] GET /compute/v2.1/servers/23264674-8d93-4940-85c1-1b966018a9bd => generated 1671 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:04:41.884924 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-59518b40-4bc4-4c4b-ad02-e968dec4bc4c req-b63edc95-0118-469f-b75f-40fe795c5fb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23264674-8d93-4940-85c1-1b966018a9bd", "name": "network-vif-deleted", "tag": "0c136851-16a1-41cc-810e-35dcd67481cf"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:04:41.896286 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-59518b40-4bc4-4c4b-ad02-e968dec4bc4c req-b63edc95-0118-469f-b75f-40fe795c5fb1 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:04:41.898602 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-59518b40-4bc4-4c4b-ad02-e968dec4bc4c req-b63edc95-0118-469f-b75f-40fe795c5fb1 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:04:41.898602 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-59518b40-4bc4-4c4b-ad02-e968dec4bc4c req-b63edc95-0118-469f-b75f-40fe795c5fb1 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:04:41.911185 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-59518b40-4bc4-4c4b-ad02-e968dec4bc4c req-b63edc95-0118-469f-b75f-40fe795c5fb1 service nova] Creating event network-vif-deleted:0c136851-16a1-41cc-810e-35dcd67481cf for instance 23264674-8d93-4940-85c1-1b966018a9bd on n-h2-862769-1 Oct 27 04:04:41.920029 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-59518b40-4bc4-4c4b-ad02-e968dec4bc4c req-b63edc95-0118-469f-b75f-40fe795c5fb1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039078 Oct 27 04:04:41.922225 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3224/6733] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:04:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:04:42.411672 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d0056ce7-bf9b-40a7-92c2-ea26248463ec tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:04:42.413666 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d0056ce7-bf9b-40a7-92c2-ea26248463ec tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] [instance: 23264674-8d93-4940-85c1-1b966018a9bd] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:04:42.421487 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d0056ce7-bf9b-40a7-92c2-ea26248463ec tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:04:42.422091 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d0056ce7-bf9b-40a7-92c2-ea26248463ec tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:04:42.422675 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d0056ce7-bf9b-40a7-92c2-ea26248463ec tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:04:42.423491 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d0056ce7-bf9b-40a7-92c2-ea26248463ec tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:04:42.424058 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d0056ce7-bf9b-40a7-92c2-ea26248463ec tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:04:42.424627 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d0056ce7-bf9b-40a7-92c2-ea26248463ec tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:04:42.460821 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d0056ce7-bf9b-40a7-92c2-ea26248463ec tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:04:42.461468 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d0056ce7-bf9b-40a7-92c2-ea26248463ec tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:04:42.462602 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d0056ce7-bf9b-40a7-92c2-ea26248463ec tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:04:42.463165 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-d0056ce7-bf9b-40a7-92c2-ea26248463ec tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lazy-loading 'fault' on Instance uuid 23264674-8d93-4940-85c1-1b966018a9bd {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 04:04:42.504514 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d0056ce7-bf9b-40a7-92c2-ea26248463ec tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bf808aeff6462794e5d6c653c72ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c921299382141f99cd9c4b6b11927a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:04:42.512967 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d0056ce7-bf9b-40a7-92c2-ea26248463ec tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] 10.222.0.20 "GET /compute/v2.1/servers/23264674-8d93-4940-85c1-1b966018a9bd" status: 200 len: 1339 microversion: 2.1 time: 0.108058 Oct 27 04:04:42.513645 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3510/6734] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:04:42 2022] GET /compute/v2.1/servers/23264674-8d93-4940-85c1-1b966018a9bd => generated 1339 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:04:43.537957 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-bacc1be9-fa16-402f-9f8b-3c6b7d6b54f5 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:04:43.538694 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-bacc1be9-fa16-402f-9f8b-3c6b7d6b54f5 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] [instance: 23264674-8d93-4940-85c1-1b966018a9bd] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:04:43.546876 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bacc1be9-fa16-402f-9f8b-3c6b7d6b54f5 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:04:43.547554 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bacc1be9-fa16-402f-9f8b-3c6b7d6b54f5 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:04:43.548121 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bacc1be9-fa16-402f-9f8b-3c6b7d6b54f5 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:04:43.549076 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bacc1be9-fa16-402f-9f8b-3c6b7d6b54f5 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:04:43.549559 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bacc1be9-fa16-402f-9f8b-3c6b7d6b54f5 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:04:43.550042 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bacc1be9-fa16-402f-9f8b-3c6b7d6b54f5 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:04:43.564758 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-bacc1be9-fa16-402f-9f8b-3c6b7d6b54f5 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] HTTP exception thrown: Instance 23264674-8d93-4940-85c1-1b966018a9bd could not be found. Oct 27 04:04:43.566923 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-bacc1be9-fa16-402f-9f8b-3c6b7d6b54f5 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Request method failure captured: Oct 27 04:04:43.566923 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/23264674-8d93-4940-85c1-1b966018a9bd HTTP/1.1 Oct 27 04:04:43.566923 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 04:04:43.566923 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 04:04:43.566923 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 04:04:43.566923 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 04:04:43.566923 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 04:04:43.566923 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 04:04:43.566923 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 04:04:43.566923 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 04:04:43.566923 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWgLdrMEnhoO8AegDn0YZKRNA5IK7Cm0iiw04H26wQZCw3bRQksYhpbMh_lBkTWEXTmVDbO4BMuQ24TunIeg8EwFZxUPqOYztP-l3CXue8drga5HyDPVE0JrJ5G6iGTDgT_vwr2oE4LbYggYst_ivqWaz7JYjwtrSSw6pM7yIOdk0mf4 Oct 27 04:04:43.566923 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 04:04:43.566923 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 04:04:43.566923 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 04:04:43.566923 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 04:04:43.566923 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 04:04:43.566923 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 04:04:43.566923 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 9c921299382141f99cd9c4b6b11927a4 Oct 27 04:04:43.566923 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-TestNetworkBasicOps-1974434160 Oct 27 04:04:43.566923 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 04:04:43.566923 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 04:04:43.566923 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9c921299382141f99cd9c4b6b11927a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9c921299382141f99cd9c4b6b11927a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9c921299382141f99cd9c4b6b11927a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9c921299382141f99cd9c4b6b11927a4"}]}] Oct 27 04:04:43.566923 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-TestNetworkBasicOps-1974434160 Oct 27 04:04:43.566923 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 9c921299382141f99cd9c4b6b11927a4 Oct 27 04:04:43.566923 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-TestNetworkBasicOps-1974434160 Oct 27 04:04:43.566923 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-TestNetworkBasicOps-1974434160-project Oct 27 04:04:43.566923 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 04:04:43.566923 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 04:04:43.566923 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 98bf808aeff6462794e5d6c653c72ae2 Oct 27 04:04:43.566923 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-TestNetworkBasicOps-1974434160-project Oct 27 04:04:43.566923 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 04:04:43.566923 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 23264674-8d93-4940-85c1-1b966018a9bd could not be found. Oct 27 04:04:43.566923 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '23264674-8d93-4940-85c1-1b966018a9bd'} Oct 27 04:04:43.566923 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 04:04:43.566923 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:04:43.566923 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 04:04:43.566923 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 04:04:43.566923 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 04:04:43.566923 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 04:04:43.566923 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 04:04:43.566923 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 04:04:43.566923 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 04:04:43.566923 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 04:04:43.566923 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23264674-8d93-4940-85c1-1b966018a9bd could not be found. Oct 27 04:04:43.566923 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:04:43.566923 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:04:43.566923 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:04:43.566923 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:04:43.566923 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:04:43.566923 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:04:43.566923 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 04:04:43.566923 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 04:04:43.566923 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 04:04:43.566923 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 04:04:43.566923 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 04:04:43.566923 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 04:04:43.566923 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 04:04:43.566923 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 04:04:43.566923 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 04:04:43.566923 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 04:04:43.566923 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23264674-8d93-4940-85c1-1b966018a9bd could not be found. Oct 27 04:04:43.566923 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:04:43.566923 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:04:43.566923 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:04:43.572723 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:04:43.572723 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:04:43.572723 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:04:43.572723 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 04:04:43.572723 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 04:04:43.572723 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23264674-8d93-4940-85c1-1b966018a9bd could not be found. Oct 27 04:04:43.572723 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:04:43.572723 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-bacc1be9-fa16-402f-9f8b-3c6b7d6b54f5 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Returning 404 to user: Instance 23264674-8d93-4940-85c1-1b966018a9bd could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 04:04:43.572723 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-bacc1be9-fa16-402f-9f8b-3c6b7d6b54f5 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] 10.222.0.20 "GET /compute/v2.1/servers/23264674-8d93-4940-85c1-1b966018a9bd" status: 404 len: 111 microversion: 2.1 time: 0.034721 Oct 27 04:04:43.572723 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3225/6735] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:04:43 2022] GET /compute/v2.1/servers/23264674-8d93-4940-85c1-1b966018a9bd => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 04:04:43.824842 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f1247945-331f-4564-9ec6-c5c056313e0b tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Calling method '.version_select at 0x7f7dded2c670>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:04:43.906603 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f1247945-331f-4564-9ec6-c5c056313e0b tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1178891351" status: 202 len: 0 microversion: 2.1 time: 0.085770 Oct 27 04:04:43.907136 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3511/6736] 10.222.0.20 () {58 vars in 1257 bytes} [Thu Oct 27 04:04:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1178891351 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 04:04:55.914718 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-de795008-f22c-4c3d-ba6e-49304952d126 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Action: 'create', calling method: .version_select at 0x7f7dda27f8b0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-2099103138", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBfQCLqeAbLuF7Ar9/pnaFGJT4EzLsw26dcEGI0yGcOhd3Yj2UOTAN2ADf4+JnKSd/TGgFx2ejElBTv1EMcYpUPkIjBZbfl8gUeDue0ZtRw1NrpW+VXcqPKTwZjP4YpfYQ=="}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:04:55.922880 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:04:55.923581 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:04:55.941001 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-de795008-f22c-4c3d-ba6e-49304952d126 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Getting quotas for project 9c921299382141f99cd9c4b6b11927a4. Resources: {'key_pairs'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 04:04:55.948125 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-de795008-f22c-4c3d-ba6e-49304952d126 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Getting quotas for user 98bf808aeff6462794e5d6c653c72ae2 and project 9c921299382141f99cd9c4b6b11927a4. Resources: {'key_pairs'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 04:04:56.060880 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-de795008-f22c-4c3d-ba6e-49304952d126 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.150785 Oct 27 04:04:56.061528 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3226/6737] 10.222.0.20 () {60 vars in 1159 bytes} [Thu Oct 27 04:04:55 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:04:59.521580 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:04:59.522480 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:04:59.527087 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2b04c41b-07fa-4910-95e2-bec356346dc1 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-972453123", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": [{"uuid": "9a372d60-d32d-487b-bc01-d2ca2dd3ca62"}], "key_name": "tempest-TestNetworkBasicOps-2099103138", "security_groups": [{"name": "tempest-secgroup-smoke-1027200133"}]}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:04:59.644219 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.network.neutron [None req-2b04c41b-07fa-4910-95e2-bec356346dc1 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] validate_networks() for [('9a372d60-d32d-487b-bc01-d2ca2dd3ca62', None, None, None, None, None)] {{(pid=121001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 04:05:00.055176 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-2b04c41b-07fa-4910-95e2-bec356346dc1 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Flavor limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 04:05:00.059701 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-2b04c41b-07fa-4910-95e2-bec356346dc1 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Image limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 04:05:00.061008 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-2b04c41b-07fa-4910-95e2-bec356346dc1 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Flavor pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 04:05:00.062425 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-2b04c41b-07fa-4910-95e2-bec356346dc1 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Image pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 04:05:00.065142 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-2b04c41b-07fa-4910-95e2-bec356346dc1 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 04:05:00.076467 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2b04c41b-07fa-4910-95e2-bec356346dc1 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:05:00.076965 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2b04c41b-07fa-4910-95e2-bec356346dc1 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:05:00.077427 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2b04c41b-07fa-4910-95e2-bec356346dc1 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:05:00.078187 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2b04c41b-07fa-4910-95e2-bec356346dc1 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:05:00.078638 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2b04c41b-07fa-4910-95e2-bec356346dc1 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:05:00.079289 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2b04c41b-07fa-4910-95e2-bec356346dc1 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:05:00.108408 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-2b04c41b-07fa-4910-95e2-bec356346dc1 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Getting quotas for project 9c921299382141f99cd9c4b6b11927a4. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 04:05:00.114312 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-2b04c41b-07fa-4910-95e2-bec356346dc1 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Getting quotas for user 98bf808aeff6462794e5d6c653c72ae2 and project 9c921299382141f99cd9c4b6b11927a4. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 04:05:00.127551 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2b04c41b-07fa-4910-95e2-bec356346dc1 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Going to run 1 instances... {{(pid=121001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 04:05:00.130023 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2b04c41b-07fa-4910-95e2-bec356346dc1 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] [instance: e798145c-d2a8-4321-8295-949e3a8ba88a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 04:05:00.322405 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2b04c41b-07fa-4910-95e2-bec356346dc1 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.802459 Oct 27 04:05:00.323235 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3512/6738] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 04:04:59 2022] POST /compute/v2.1/servers => generated 406 bytes in 804 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 04:05:00.335602 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-df9584c8-3466-4aa5-afdf-3367fc198f29 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:05:00.336176 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-df9584c8-3466-4aa5-afdf-3367fc198f29 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] [instance: e798145c-d2a8-4321-8295-949e3a8ba88a] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:05:00.424875 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-df9584c8-3466-4aa5-afdf-3367fc198f29 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bf808aeff6462794e5d6c653c72ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c921299382141f99cd9c4b6b11927a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:05:00.439099 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-df9584c8-3466-4aa5-afdf-3367fc198f29 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] 10.222.0.20 "GET /compute/v2.1/servers/e798145c-d2a8-4321-8295-949e3a8ba88a" status: 200 len: 1248 microversion: 2.1 time: 0.108226 Oct 27 04:05:00.439976 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3227/6739] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:05:00 2022] GET /compute/v2.1/servers/e798145c-d2a8-4321-8295-949e3a8ba88a => generated 1248 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:05:01.463000 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-64c20343-872e-4cbe-8254-7f1c3e9189ba tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:05:01.463619 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-64c20343-872e-4cbe-8254-7f1c3e9189ba tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] [instance: e798145c-d2a8-4321-8295-949e3a8ba88a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:05:01.471536 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-64c20343-872e-4cbe-8254-7f1c3e9189ba tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:05:01.472029 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-64c20343-872e-4cbe-8254-7f1c3e9189ba tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:05:01.472473 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-64c20343-872e-4cbe-8254-7f1c3e9189ba tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:05:01.473180 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-64c20343-872e-4cbe-8254-7f1c3e9189ba tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:05:01.473635 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-64c20343-872e-4cbe-8254-7f1c3e9189ba tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:05:01.474142 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-64c20343-872e-4cbe-8254-7f1c3e9189ba tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:05:01.539990 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-64c20343-872e-4cbe-8254-7f1c3e9189ba tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bf808aeff6462794e5d6c653c72ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c921299382141f99cd9c4b6b11927a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:05:01.548202 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-64c20343-872e-4cbe-8254-7f1c3e9189ba tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] 10.222.0.20 "GET /compute/v2.1/servers/e798145c-d2a8-4321-8295-949e3a8ba88a" status: 200 len: 1252 microversion: 2.1 time: 0.089977 Oct 27 04:05:01.548779 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3513/6740] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:05:01 2022] GET /compute/v2.1/servers/e798145c-d2a8-4321-8295-949e3a8ba88a => generated 1252 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:05:02.573084 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-139ac198-a216-4d5d-9b9e-c6521aaf5328 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:05:02.573722 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-139ac198-a216-4d5d-9b9e-c6521aaf5328 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] [instance: e798145c-d2a8-4321-8295-949e3a8ba88a] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:05:02.582537 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-139ac198-a216-4d5d-9b9e-c6521aaf5328 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:05:02.583034 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-139ac198-a216-4d5d-9b9e-c6521aaf5328 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:05:02.583480 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-139ac198-a216-4d5d-9b9e-c6521aaf5328 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:05:02.584193 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-139ac198-a216-4d5d-9b9e-c6521aaf5328 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:05:02.584655 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-139ac198-a216-4d5d-9b9e-c6521aaf5328 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:05:02.585088 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-139ac198-a216-4d5d-9b9e-c6521aaf5328 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:05:02.672138 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-139ac198-a216-4d5d-9b9e-c6521aaf5328 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bf808aeff6462794e5d6c653c72ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c921299382141f99cd9c4b6b11927a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:05:02.680293 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-139ac198-a216-4d5d-9b9e-c6521aaf5328 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] 10.222.0.20 "GET /compute/v2.1/servers/e798145c-d2a8-4321-8295-949e3a8ba88a" status: 200 len: 1300 microversion: 2.1 time: 0.112703 Oct 27 04:05:02.680828 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3228/6741] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:05:02 2022] GET /compute/v2.1/servers/e798145c-d2a8-4321-8295-949e3a8ba88a => generated 1300 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:05:03.703566 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-de882c7e-9349-462d-b1d0-0f636f4d5974 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:05:03.704769 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-de882c7e-9349-462d-b1d0-0f636f4d5974 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] [instance: e798145c-d2a8-4321-8295-949e3a8ba88a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:05:03.713083 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-de882c7e-9349-462d-b1d0-0f636f4d5974 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:05:03.713583 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-de882c7e-9349-462d-b1d0-0f636f4d5974 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:05:03.714268 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-de882c7e-9349-462d-b1d0-0f636f4d5974 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:05:03.715203 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-de882c7e-9349-462d-b1d0-0f636f4d5974 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:05:03.715836 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-de882c7e-9349-462d-b1d0-0f636f4d5974 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:05:03.716430 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-de882c7e-9349-462d-b1d0-0f636f4d5974 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:05:03.870594 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-de882c7e-9349-462d-b1d0-0f636f4d5974 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bf808aeff6462794e5d6c653c72ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c921299382141f99cd9c4b6b11927a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:05:03.884404 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-de882c7e-9349-462d-b1d0-0f636f4d5974 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] 10.222.0.20 "GET /compute/v2.1/servers/e798145c-d2a8-4321-8295-949e3a8ba88a" status: 200 len: 1374 microversion: 2.1 time: 0.184612 Oct 27 04:05:03.885019 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3514/6742] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:05:03 2022] GET /compute/v2.1/servers/e798145c-d2a8-4321-8295-949e3a8ba88a => generated 1374 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:05:04.797100 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-d1a9aa61-da74-4620-9527-46fe3c086071 req-7b6bac6a-2bba-4cc3-9ad6-0036c0a6a073 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e798145c-d2a8-4321-8295-949e3a8ba88a", "tag": "a870529a-18aa-4c91-8131-fd4c192b53f2"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:05:04.808127 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-d1a9aa61-da74-4620-9527-46fe3c086071 req-7b6bac6a-2bba-4cc3-9ad6-0036c0a6a073 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:05:04.815948 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-d1a9aa61-da74-4620-9527-46fe3c086071 req-7b6bac6a-2bba-4cc3-9ad6-0036c0a6a073 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:05:04.815948 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-d1a9aa61-da74-4620-9527-46fe3c086071 req-7b6bac6a-2bba-4cc3-9ad6-0036c0a6a073 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:05:04.821246 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-d1a9aa61-da74-4620-9527-46fe3c086071 req-7b6bac6a-2bba-4cc3-9ad6-0036c0a6a073 service nova] Creating event network-changed:a870529a-18aa-4c91-8131-fd4c192b53f2 for instance e798145c-d2a8-4321-8295-949e3a8ba88a on n-h1-862769-1 Oct 27 04:05:04.826654 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-d1a9aa61-da74-4620-9527-46fe3c086071 req-7b6bac6a-2bba-4cc3-9ad6-0036c0a6a073 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033330 Oct 27 04:05:04.827648 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3229/6743] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:05:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:05:04.909880 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a14e0ca5-eabc-4c76-89e6-a0399662ad08 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:05:04.910583 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a14e0ca5-eabc-4c76-89e6-a0399662ad08 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] [instance: e798145c-d2a8-4321-8295-949e3a8ba88a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:05:04.921076 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a14e0ca5-eabc-4c76-89e6-a0399662ad08 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:05:04.921581 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a14e0ca5-eabc-4c76-89e6-a0399662ad08 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:05:04.922053 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a14e0ca5-eabc-4c76-89e6-a0399662ad08 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:05:04.922775 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a14e0ca5-eabc-4c76-89e6-a0399662ad08 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:05:04.923238 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a14e0ca5-eabc-4c76-89e6-a0399662ad08 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:05:04.928228 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a14e0ca5-eabc-4c76-89e6-a0399662ad08 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:05:05.163944 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a14e0ca5-eabc-4c76-89e6-a0399662ad08 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bf808aeff6462794e5d6c653c72ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c921299382141f99cd9c4b6b11927a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:05:05.174546 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a14e0ca5-eabc-4c76-89e6-a0399662ad08 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] 10.222.0.20 "GET /compute/v2.1/servers/e798145c-d2a8-4321-8295-949e3a8ba88a" status: 200 len: 1374 microversion: 2.1 time: 0.270255 Oct 27 04:05:05.175658 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3515/6744] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:05:04 2022] GET /compute/v2.1/servers/e798145c-d2a8-4321-8295-949e3a8ba88a => generated 1374 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:05:06.200590 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f10e5085-3754-48a2-82d4-dae27e2ce9ea tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:05:06.201307 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f10e5085-3754-48a2-82d4-dae27e2ce9ea tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] [instance: e798145c-d2a8-4321-8295-949e3a8ba88a] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:05:06.208951 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f10e5085-3754-48a2-82d4-dae27e2ce9ea tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:05:06.209444 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f10e5085-3754-48a2-82d4-dae27e2ce9ea tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:05:06.209889 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f10e5085-3754-48a2-82d4-dae27e2ce9ea tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:05:06.210679 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f10e5085-3754-48a2-82d4-dae27e2ce9ea tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:05:06.211090 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f10e5085-3754-48a2-82d4-dae27e2ce9ea tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:05:06.214919 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f10e5085-3754-48a2-82d4-dae27e2ce9ea tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:05:06.391753 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f10e5085-3754-48a2-82d4-dae27e2ce9ea tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bf808aeff6462794e5d6c653c72ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c921299382141f99cd9c4b6b11927a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:05:06.395205 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f10e5085-3754-48a2-82d4-dae27e2ce9ea tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] 10.222.0.20 "GET /compute/v2.1/servers/e798145c-d2a8-4321-8295-949e3a8ba88a" status: 200 len: 1374 microversion: 2.1 time: 0.200966 Oct 27 04:05:06.395799 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3230/6745] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:05:06 2022] GET /compute/v2.1/servers/e798145c-d2a8-4321-8295-949e3a8ba88a => generated 1374 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:05:07.422537 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-91001219-7c2d-4421-a679-c226056770da tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:05:07.423381 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-91001219-7c2d-4421-a679-c226056770da tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] [instance: e798145c-d2a8-4321-8295-949e3a8ba88a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:05:07.432074 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-91001219-7c2d-4421-a679-c226056770da tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:05:07.432074 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-91001219-7c2d-4421-a679-c226056770da tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:05:07.432557 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-91001219-7c2d-4421-a679-c226056770da tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:05:07.433350 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-91001219-7c2d-4421-a679-c226056770da tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:05:07.434264 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-91001219-7c2d-4421-a679-c226056770da tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:05:07.434373 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-91001219-7c2d-4421-a679-c226056770da tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:05:07.580477 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-91001219-7c2d-4421-a679-c226056770da tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bf808aeff6462794e5d6c653c72ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c921299382141f99cd9c4b6b11927a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:05:07.589238 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-91001219-7c2d-4421-a679-c226056770da tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] 10.222.0.20 "GET /compute/v2.1/servers/e798145c-d2a8-4321-8295-949e3a8ba88a" status: 200 len: 1374 microversion: 2.1 time: 0.170654 Oct 27 04:05:07.590087 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3516/6746] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:05:07 2022] GET /compute/v2.1/servers/e798145c-d2a8-4321-8295-949e3a8ba88a => generated 1374 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:05:08.612594 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-91b1a73e-5c6d-46db-acc1-c4c142a80174 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:05:08.613557 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-91b1a73e-5c6d-46db-acc1-c4c142a80174 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] [instance: e798145c-d2a8-4321-8295-949e3a8ba88a] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:05:08.621728 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-91b1a73e-5c6d-46db-acc1-c4c142a80174 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:05:08.622337 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-91b1a73e-5c6d-46db-acc1-c4c142a80174 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:05:08.622847 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-91b1a73e-5c6d-46db-acc1-c4c142a80174 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:05:08.623761 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-91b1a73e-5c6d-46db-acc1-c4c142a80174 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:05:08.624423 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-91b1a73e-5c6d-46db-acc1-c4c142a80174 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:05:08.624898 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-91b1a73e-5c6d-46db-acc1-c4c142a80174 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:05:08.765593 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-91b1a73e-5c6d-46db-acc1-c4c142a80174 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bf808aeff6462794e5d6c653c72ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c921299382141f99cd9c4b6b11927a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:05:08.774696 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-91b1a73e-5c6d-46db-acc1-c4c142a80174 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] 10.222.0.20 "GET /compute/v2.1/servers/e798145c-d2a8-4321-8295-949e3a8ba88a" status: 200 len: 1374 microversion: 2.1 time: 0.166072 Oct 27 04:05:08.775436 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3231/6747] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:05:08 2022] GET /compute/v2.1/servers/e798145c-d2a8-4321-8295-949e3a8ba88a => generated 1374 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:05:09.798639 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-44da9400-c0ed-4c52-a635-36bed3874934 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:05:09.800126 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-44da9400-c0ed-4c52-a635-36bed3874934 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] [instance: e798145c-d2a8-4321-8295-949e3a8ba88a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:05:09.817035 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-44da9400-c0ed-4c52-a635-36bed3874934 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:05:09.817499 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-44da9400-c0ed-4c52-a635-36bed3874934 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:05:09.817957 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-44da9400-c0ed-4c52-a635-36bed3874934 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:05:09.818740 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-44da9400-c0ed-4c52-a635-36bed3874934 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:05:09.819205 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-44da9400-c0ed-4c52-a635-36bed3874934 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:05:09.819647 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-44da9400-c0ed-4c52-a635-36bed3874934 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:05:09.959973 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-44da9400-c0ed-4c52-a635-36bed3874934 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bf808aeff6462794e5d6c653c72ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c921299382141f99cd9c4b6b11927a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:05:09.970758 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-44da9400-c0ed-4c52-a635-36bed3874934 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] 10.222.0.20 "GET /compute/v2.1/servers/e798145c-d2a8-4321-8295-949e3a8ba88a" status: 200 len: 1374 microversion: 2.1 time: 0.176327 Oct 27 04:05:09.988109 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3517/6748] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:05:09 2022] GET /compute/v2.1/servers/e798145c-d2a8-4321-8295-949e3a8ba88a => generated 1374 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:05:10.995212 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c6b4ef5f-6680-427b-b00b-c997c85a5d51 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:05:10.995762 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c6b4ef5f-6680-427b-b00b-c997c85a5d51 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] [instance: e798145c-d2a8-4321-8295-949e3a8ba88a] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:05:10.998691 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=6 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:05:11.003503 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c6b4ef5f-6680-427b-b00b-c997c85a5d51 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:05:11.004497 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c6b4ef5f-6680-427b-b00b-c997c85a5d51 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:05:11.004497 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c6b4ef5f-6680-427b-b00b-c997c85a5d51 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:05:11.005120 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c6b4ef5f-6680-427b-b00b-c997c85a5d51 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:05:11.005575 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c6b4ef5f-6680-427b-b00b-c997c85a5d51 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:05:11.006000 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c6b4ef5f-6680-427b-b00b-c997c85a5d51 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:05:11.150923 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c6b4ef5f-6680-427b-b00b-c997c85a5d51 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bf808aeff6462794e5d6c653c72ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c921299382141f99cd9c4b6b11927a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:05:11.158598 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c6b4ef5f-6680-427b-b00b-c997c85a5d51 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] 10.222.0.20 "GET /compute/v2.1/servers/e798145c-d2a8-4321-8295-949e3a8ba88a" status: 200 len: 1374 microversion: 2.1 time: 0.167618 Oct 27 04:05:11.159166 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3232/6749] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:05:10 2022] GET /compute/v2.1/servers/e798145c-d2a8-4321-8295-949e3a8ba88a => generated 1374 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:05:12.169166 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-b932e819-1d2e-4cc5-8001-71f32c2d05b3 req-5006f919-222b-4d83-aba5-e17dfc7ef1d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e798145c-d2a8-4321-8295-949e3a8ba88a", "name": "network-vif-plugged", "status": "completed", "tag": "a870529a-18aa-4c91-8131-fd4c192b53f2"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:05:12.174376 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:05:12.176538 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=6 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:05:12.183036 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9757b36b-2bab-4907-b2d2-956118d02da0 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:05:12.183665 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9757b36b-2bab-4907-b2d2-956118d02da0 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] [instance: e798145c-d2a8-4321-8295-949e3a8ba88a] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:05:12.193375 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9757b36b-2bab-4907-b2d2-956118d02da0 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:05:12.203865 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9757b36b-2bab-4907-b2d2-956118d02da0 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:05:12.203865 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9757b36b-2bab-4907-b2d2-956118d02da0 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:05:12.203865 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9757b36b-2bab-4907-b2d2-956118d02da0 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:05:12.203865 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9757b36b-2bab-4907-b2d2-956118d02da0 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:05:12.203865 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9757b36b-2bab-4907-b2d2-956118d02da0 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:05:12.204392 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-b932e819-1d2e-4cc5-8001-71f32c2d05b3 req-5006f919-222b-4d83-aba5-e17dfc7ef1d4 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:05:12.204392 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-b932e819-1d2e-4cc5-8001-71f32c2d05b3 req-5006f919-222b-4d83-aba5-e17dfc7ef1d4 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:05:12.204392 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-b932e819-1d2e-4cc5-8001-71f32c2d05b3 req-5006f919-222b-4d83-aba5-e17dfc7ef1d4 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:05:12.214704 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-b932e819-1d2e-4cc5-8001-71f32c2d05b3 req-5006f919-222b-4d83-aba5-e17dfc7ef1d4 service nova] Creating event network-vif-plugged:a870529a-18aa-4c91-8131-fd4c192b53f2 for instance e798145c-d2a8-4321-8295-949e3a8ba88a on n-h1-862769-1 Oct 27 04:05:12.220765 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-b932e819-1d2e-4cc5-8001-71f32c2d05b3 req-5006f919-222b-4d83-aba5-e17dfc7ef1d4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056288 Oct 27 04:05:12.221372 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3518/6750] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:05:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:05:12.394223 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9757b36b-2bab-4907-b2d2-956118d02da0 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bf808aeff6462794e5d6c653c72ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c921299382141f99cd9c4b6b11927a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:05:12.403676 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9757b36b-2bab-4907-b2d2-956118d02da0 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] 10.222.0.20 "GET /compute/v2.1/servers/e798145c-d2a8-4321-8295-949e3a8ba88a" status: 200 len: 1374 microversion: 2.1 time: 0.225581 Oct 27 04:05:12.404382 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3233/6751] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:05:12 2022] GET /compute/v2.1/servers/e798145c-d2a8-4321-8295-949e3a8ba88a => generated 1374 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:05:13.429564 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-82656550-d38a-4c37-aea1-55a5ec8c73d4 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:05:13.430313 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-82656550-d38a-4c37-aea1-55a5ec8c73d4 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] [instance: e798145c-d2a8-4321-8295-949e3a8ba88a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:05:13.437639 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-82656550-d38a-4c37-aea1-55a5ec8c73d4 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:05:13.438290 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-82656550-d38a-4c37-aea1-55a5ec8c73d4 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:05:13.438850 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-82656550-d38a-4c37-aea1-55a5ec8c73d4 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:05:13.439565 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-82656550-d38a-4c37-aea1-55a5ec8c73d4 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:05:13.440025 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-82656550-d38a-4c37-aea1-55a5ec8c73d4 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:05:13.440455 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-82656550-d38a-4c37-aea1-55a5ec8c73d4 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:05:13.594591 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-82656550-d38a-4c37-aea1-55a5ec8c73d4 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bf808aeff6462794e5d6c653c72ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c921299382141f99cd9c4b6b11927a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:05:13.607772 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-82656550-d38a-4c37-aea1-55a5ec8c73d4 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] 10.222.0.20 "GET /compute/v2.1/servers/e798145c-d2a8-4321-8295-949e3a8ba88a" status: 200 len: 1374 microversion: 2.1 time: 0.184302 Oct 27 04:05:13.612997 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3519/6752] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:05:13 2022] GET /compute/v2.1/servers/e798145c-d2a8-4321-8295-949e3a8ba88a => generated 1374 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:05:14.636179 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-62ea2a3b-3c12-4b5c-8c1d-d0927dda9645 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:05:14.636819 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-62ea2a3b-3c12-4b5c-8c1d-d0927dda9645 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] [instance: e798145c-d2a8-4321-8295-949e3a8ba88a] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:05:14.644502 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-62ea2a3b-3c12-4b5c-8c1d-d0927dda9645 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:05:14.645341 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-62ea2a3b-3c12-4b5c-8c1d-d0927dda9645 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:05:14.645958 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-62ea2a3b-3c12-4b5c-8c1d-d0927dda9645 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:05:14.646754 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-62ea2a3b-3c12-4b5c-8c1d-d0927dda9645 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:05:14.647210 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-62ea2a3b-3c12-4b5c-8c1d-d0927dda9645 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:05:14.647848 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-62ea2a3b-3c12-4b5c-8c1d-d0927dda9645 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:05:14.814968 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-62ea2a3b-3c12-4b5c-8c1d-d0927dda9645 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bf808aeff6462794e5d6c653c72ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c921299382141f99cd9c4b6b11927a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:05:14.839697 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-62ea2a3b-3c12-4b5c-8c1d-d0927dda9645 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] 10.222.0.20 "GET /compute/v2.1/servers/e798145c-d2a8-4321-8295-949e3a8ba88a" status: 200 len: 1547 microversion: 2.1 time: 0.208419 Oct 27 04:05:14.840569 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3234/6753] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:05:14 2022] GET /compute/v2.1/servers/e798145c-d2a8-4321-8295-949e3a8ba88a => generated 1547 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:05:14.864624 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-44e1c0df-ab5c-4ce5-907c-8dea9baf758a tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:05:14.865265 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-44e1c0df-ab5c-4ce5-907c-8dea9baf758a tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] [instance: e798145c-d2a8-4321-8295-949e3a8ba88a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:05:14.876553 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-44e1c0df-ab5c-4ce5-907c-8dea9baf758a tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:05:14.877457 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-44e1c0df-ab5c-4ce5-907c-8dea9baf758a tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:05:14.878443 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-44e1c0df-ab5c-4ce5-907c-8dea9baf758a tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:05:14.879475 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-44e1c0df-ab5c-4ce5-907c-8dea9baf758a tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:05:14.880370 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-44e1c0df-ab5c-4ce5-907c-8dea9baf758a tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:05:14.880968 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-44e1c0df-ab5c-4ce5-907c-8dea9baf758a tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:05:15.064391 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-44e1c0df-ab5c-4ce5-907c-8dea9baf758a tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bf808aeff6462794e5d6c653c72ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c921299382141f99cd9c4b6b11927a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:05:15.073301 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-44e1c0df-ab5c-4ce5-907c-8dea9baf758a tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] 10.222.0.20 "GET /compute/v2.1/servers/e798145c-d2a8-4321-8295-949e3a8ba88a" status: 200 len: 1547 microversion: 2.1 time: 0.212607 Oct 27 04:05:15.073893 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3520/6754] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:05:14 2022] GET /compute/v2.1/servers/e798145c-d2a8-4321-8295-949e3a8ba88a => generated 1547 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:05:17.534206 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-e2afbb3e-c231-47a4-b129-08e2a055922a req-e6d89688-770b-4c28-8ecd-04db06dbd9d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e798145c-d2a8-4321-8295-949e3a8ba88a", "tag": "a870529a-18aa-4c91-8131-fd4c192b53f2"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:05:17.547358 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-e2afbb3e-c231-47a4-b129-08e2a055922a req-e6d89688-770b-4c28-8ecd-04db06dbd9d5 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:05:17.555166 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-e2afbb3e-c231-47a4-b129-08e2a055922a req-e6d89688-770b-4c28-8ecd-04db06dbd9d5 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:05:17.555166 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-e2afbb3e-c231-47a4-b129-08e2a055922a req-e6d89688-770b-4c28-8ecd-04db06dbd9d5 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:05:17.564663 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-e2afbb3e-c231-47a4-b129-08e2a055922a req-e6d89688-770b-4c28-8ecd-04db06dbd9d5 service nova] Creating event network-changed:a870529a-18aa-4c91-8131-fd4c192b53f2 for instance e798145c-d2a8-4321-8295-949e3a8ba88a on n-h1-862769-1 Oct 27 04:05:17.575762 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-e2afbb3e-c231-47a4-b129-08e2a055922a req-e6d89688-770b-4c28-8ecd-04db06dbd9d5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048503 Oct 27 04:05:17.584065 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3235/6755] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:05:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:05:23.011234 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a5e08fcb-d02c-4d08-871b-660a7ec350ae tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Action: 'create', calling method: .version_select at 0x7f7dd9f3f670>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-1376036212", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFwycYyIf4p4bnUF3Daph5DuOlTflZbZMVqgkcpXYmNKEX2jW96CRaJPCN4hwVB3fxzPgazlU/2zAK4az2BdigfxUoRq0QrcHHrkmgfiLSrRXHirLyrDn/nrODUjRvO1JA=="}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:05:23.029809 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-a5e08fcb-d02c-4d08-871b-660a7ec350ae tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Getting quotas for project ed478a90b637419e8a1ec46a5ec15414. Resources: {'key_pairs'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 04:05:23.035138 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-a5e08fcb-d02c-4d08-871b-660a7ec350ae tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Getting quotas for user aac6c0276fa842738263e8aed290bf19 and project ed478a90b637419e8a1ec46a5ec15414. Resources: {'key_pairs'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 04:05:23.117245 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a5e08fcb-d02c-4d08-871b-660a7ec350ae tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.110363 Oct 27 04:05:23.117791 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3521/6756] 10.222.0.20 () {60 vars in 1159 bytes} [Thu Oct 27 04:05:23 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:05:25.472719 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-af7e84c8-082e-4e2e-ad63-bb939e857fc6 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1560103045", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "0863d8c6-9026-472f-99f7-f2d867a3804e", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-1376036212", "security_groups": [{"name": "tempest-secgroup-smoke-101948819"}], "networks": [{"uuid": "e9f74e5f-d006-4c10-b98a-a6199785b241"}]}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:05:25.593162 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-af7e84c8-082e-4e2e-ad63-bb939e857fc6 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] validate_networks() for [('e9f74e5f-d006-4c10-b98a-a6199785b241', None, None, None, None, None)] {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 04:05:25.973575 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-af7e84c8-082e-4e2e-ad63-bb939e857fc6 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 04:05:25.974068 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-af7e84c8-082e-4e2e-ad63-bb939e857fc6 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 04:05:25.975277 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-af7e84c8-082e-4e2e-ad63-bb939e857fc6 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 04:05:25.975720 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-af7e84c8-082e-4e2e-ad63-bb939e857fc6 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 04:05:25.976807 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-af7e84c8-082e-4e2e-ad63-bb939e857fc6 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 04:05:25.990804 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-af7e84c8-082e-4e2e-ad63-bb939e857fc6 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:05:25.991415 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-af7e84c8-082e-4e2e-ad63-bb939e857fc6 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:05:25.992027 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-af7e84c8-082e-4e2e-ad63-bb939e857fc6 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:05:25.992841 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-af7e84c8-082e-4e2e-ad63-bb939e857fc6 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:05:25.993316 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-af7e84c8-082e-4e2e-ad63-bb939e857fc6 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:05:25.993856 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-af7e84c8-082e-4e2e-ad63-bb939e857fc6 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:05:26.014550 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-af7e84c8-082e-4e2e-ad63-bb939e857fc6 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Getting quotas for project ed478a90b637419e8a1ec46a5ec15414. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 04:05:26.020180 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-af7e84c8-082e-4e2e-ad63-bb939e857fc6 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Getting quotas for user aac6c0276fa842738263e8aed290bf19 and project ed478a90b637419e8a1ec46a5ec15414. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 04:05:26.080968 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-af7e84c8-082e-4e2e-ad63-bb939e857fc6 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 04:05:26.083273 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-af7e84c8-082e-4e2e-ad63-bb939e857fc6 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] [instance: 7d470632-cd1e-4fa8-98dc-4250c3ed482e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0863d8c6-9026-472f-99f7-f2d867a3804e',volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 04:05:26.451084 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-af7e84c8-082e-4e2e-ad63-bb939e857fc6 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.982449 Oct 27 04:05:26.457828 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3236/6757] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 04:05:25 2022] POST /compute/v2.1/servers => generated 405 bytes in 984 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 04:05:26.461078 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=46 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:05:26.466519 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-400f75d0-8e0a-4951-8fc9-76a1e8937714 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:05:26.474163 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-400f75d0-8e0a-4951-8fc9-76a1e8937714 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] [instance: 7d470632-cd1e-4fa8-98dc-4250c3ed482e] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:05:26.526301 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-400f75d0-8e0a-4951-8fc9-76a1e8937714 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac6c0276fa842738263e8aed290bf19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed478a90b637419e8a1ec46a5ec15414', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:05:26.534652 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-400f75d0-8e0a-4951-8fc9-76a1e8937714 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] 10.222.0.20 "GET /compute/v2.1/servers/7d470632-cd1e-4fa8-98dc-4250c3ed482e" status: 200 len: 1099 microversion: 2.1 time: 0.075423 Oct 27 04:05:26.535449 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3522/6758] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:05:26 2022] GET /compute/v2.1/servers/7d470632-cd1e-4fa8-98dc-4250c3ed482e => generated 1099 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:05:27.559242 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-cf98098f-f08e-4605-ac37-63f4d1793761 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:05:27.559823 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-cf98098f-f08e-4605-ac37-63f4d1793761 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] [instance: 7d470632-cd1e-4fa8-98dc-4250c3ed482e] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:05:27.566023 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cf98098f-f08e-4605-ac37-63f4d1793761 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:05:27.566533 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cf98098f-f08e-4605-ac37-63f4d1793761 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:05:27.568262 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cf98098f-f08e-4605-ac37-63f4d1793761 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:05:27.568262 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cf98098f-f08e-4605-ac37-63f4d1793761 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:05:27.568262 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cf98098f-f08e-4605-ac37-63f4d1793761 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:05:27.568561 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cf98098f-f08e-4605-ac37-63f4d1793761 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:05:27.631716 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-cf98098f-f08e-4605-ac37-63f4d1793761 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac6c0276fa842738263e8aed290bf19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed478a90b637419e8a1ec46a5ec15414', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:05:27.640837 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-cf98098f-f08e-4605-ac37-63f4d1793761 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] 10.222.0.20 "GET /compute/v2.1/servers/7d470632-cd1e-4fa8-98dc-4250c3ed482e" status: 200 len: 1149 microversion: 2.1 time: 0.086860 Oct 27 04:05:27.641442 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3237/6759] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:05:27 2022] GET /compute/v2.1/servers/7d470632-cd1e-4fa8-98dc-4250c3ed482e => generated 1149 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:05:28.664729 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7ec5bf9d-7e2d-444d-831d-98678110cd3e tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:05:28.665376 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7ec5bf9d-7e2d-444d-831d-98678110cd3e tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] [instance: 7d470632-cd1e-4fa8-98dc-4250c3ed482e] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:05:28.673157 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7ec5bf9d-7e2d-444d-831d-98678110cd3e tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:05:28.673893 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7ec5bf9d-7e2d-444d-831d-98678110cd3e tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:05:28.674392 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7ec5bf9d-7e2d-444d-831d-98678110cd3e tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:05:28.675451 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7ec5bf9d-7e2d-444d-831d-98678110cd3e tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:05:28.675920 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7ec5bf9d-7e2d-444d-831d-98678110cd3e tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:05:28.676365 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7ec5bf9d-7e2d-444d-831d-98678110cd3e tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:05:28.772335 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7ec5bf9d-7e2d-444d-831d-98678110cd3e tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac6c0276fa842738263e8aed290bf19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed478a90b637419e8a1ec46a5ec15414', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:05:28.779525 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7ec5bf9d-7e2d-444d-831d-98678110cd3e tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] 10.222.0.20 "GET /compute/v2.1/servers/7d470632-cd1e-4fa8-98dc-4250c3ed482e" status: 200 len: 1205 microversion: 2.1 time: 0.119533 Oct 27 04:05:28.780290 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3523/6760] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:05:28 2022] GET /compute/v2.1/servers/7d470632-cd1e-4fa8-98dc-4250c3ed482e => generated 1205 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:05:29.804023 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6bbfd0ea-7d66-47c0-82dc-0ab629894221 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:05:29.805158 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6bbfd0ea-7d66-47c0-82dc-0ab629894221 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] [instance: 7d470632-cd1e-4fa8-98dc-4250c3ed482e] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:05:29.821018 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6bbfd0ea-7d66-47c0-82dc-0ab629894221 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:05:29.822192 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6bbfd0ea-7d66-47c0-82dc-0ab629894221 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:05:29.822852 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6bbfd0ea-7d66-47c0-82dc-0ab629894221 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:05:29.826867 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6bbfd0ea-7d66-47c0-82dc-0ab629894221 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:05:29.828112 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6bbfd0ea-7d66-47c0-82dc-0ab629894221 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:05:29.830646 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6bbfd0ea-7d66-47c0-82dc-0ab629894221 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:05:30.078689 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-6bbfd0ea-7d66-47c0-82dc-0ab629894221 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac6c0276fa842738263e8aed290bf19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed478a90b637419e8a1ec46a5ec15414', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:05:30.092054 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6bbfd0ea-7d66-47c0-82dc-0ab629894221 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] 10.222.0.20 "GET /compute/v2.1/servers/7d470632-cd1e-4fa8-98dc-4250c3ed482e" status: 200 len: 1282 microversion: 2.1 time: 0.291153 Oct 27 04:05:30.093157 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3238/6761] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:05:29 2022] GET /compute/v2.1/servers/7d470632-cd1e-4fa8-98dc-4250c3ed482e => generated 1282 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:05:30.781111 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-ea15f0dd-e74b-4fbe-9323-22df8881de84 req-22840ca8-9d05-4d87-b632-f08ba32ae8ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d470632-cd1e-4fa8-98dc-4250c3ed482e", "tag": "dfce8b32-768c-4dce-a68b-237f1ff60963"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:05:30.786256 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=4 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:05:30.792950 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-ea15f0dd-e74b-4fbe-9323-22df8881de84 req-22840ca8-9d05-4d87-b632-f08ba32ae8ae service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:05:30.793442 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-ea15f0dd-e74b-4fbe-9323-22df8881de84 req-22840ca8-9d05-4d87-b632-f08ba32ae8ae service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:05:30.793881 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-ea15f0dd-e74b-4fbe-9323-22df8881de84 req-22840ca8-9d05-4d87-b632-f08ba32ae8ae service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:05:30.804708 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-ea15f0dd-e74b-4fbe-9323-22df8881de84 req-22840ca8-9d05-4d87-b632-f08ba32ae8ae service nova] Creating event network-changed:dfce8b32-768c-4dce-a68b-237f1ff60963 for instance 7d470632-cd1e-4fa8-98dc-4250c3ed482e on n-h2-862769-1 Oct 27 04:05:30.811218 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-ea15f0dd-e74b-4fbe-9323-22df8881de84 req-22840ca8-9d05-4d87-b632-f08ba32ae8ae service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.186496 Oct 27 04:05:30.811970 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3524/6762] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:05:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:05:31.117003 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-062c42fa-4876-43ff-8d42-96e161d3b502 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:05:31.117827 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-062c42fa-4876-43ff-8d42-96e161d3b502 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] [instance: 7d470632-cd1e-4fa8-98dc-4250c3ed482e] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:05:31.125238 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-062c42fa-4876-43ff-8d42-96e161d3b502 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:05:31.125865 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-062c42fa-4876-43ff-8d42-96e161d3b502 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:05:31.126402 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-062c42fa-4876-43ff-8d42-96e161d3b502 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:05:31.127374 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-062c42fa-4876-43ff-8d42-96e161d3b502 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:05:31.128056 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-062c42fa-4876-43ff-8d42-96e161d3b502 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:05:31.128566 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-062c42fa-4876-43ff-8d42-96e161d3b502 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:05:31.363479 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-062c42fa-4876-43ff-8d42-96e161d3b502 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac6c0276fa842738263e8aed290bf19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed478a90b637419e8a1ec46a5ec15414', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:05:31.373076 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-062c42fa-4876-43ff-8d42-96e161d3b502 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] 10.222.0.20 "GET /compute/v2.1/servers/7d470632-cd1e-4fa8-98dc-4250c3ed482e" status: 200 len: 1282 microversion: 2.1 time: 0.260317 Oct 27 04:05:31.373688 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3239/6763] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:05:31 2022] GET /compute/v2.1/servers/7d470632-cd1e-4fa8-98dc-4250c3ed482e => generated 1282 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:05:32.398432 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b72a65e4-32fb-40f3-b581-983134ccf050 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:05:32.399168 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b72a65e4-32fb-40f3-b581-983134ccf050 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] [instance: 7d470632-cd1e-4fa8-98dc-4250c3ed482e] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:05:32.406800 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b72a65e4-32fb-40f3-b581-983134ccf050 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:05:32.407300 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b72a65e4-32fb-40f3-b581-983134ccf050 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:05:32.407754 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b72a65e4-32fb-40f3-b581-983134ccf050 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:05:32.408482 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b72a65e4-32fb-40f3-b581-983134ccf050 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:05:32.408946 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b72a65e4-32fb-40f3-b581-983134ccf050 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:05:32.409382 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b72a65e4-32fb-40f3-b581-983134ccf050 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:05:32.583823 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b72a65e4-32fb-40f3-b581-983134ccf050 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac6c0276fa842738263e8aed290bf19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed478a90b637419e8a1ec46a5ec15414', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:05:32.592895 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b72a65e4-32fb-40f3-b581-983134ccf050 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] 10.222.0.20 "GET /compute/v2.1/servers/7d470632-cd1e-4fa8-98dc-4250c3ed482e" status: 200 len: 1282 microversion: 2.1 time: 0.199817 Oct 27 04:05:32.593587 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3525/6764] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:05:32 2022] GET /compute/v2.1/servers/7d470632-cd1e-4fa8-98dc-4250c3ed482e => generated 1282 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:05:33.616963 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-cd221eb3-39de-4808-80dc-beb11f0e79ef tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:05:33.619051 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-cd221eb3-39de-4808-80dc-beb11f0e79ef tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] [instance: 7d470632-cd1e-4fa8-98dc-4250c3ed482e] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:05:33.626892 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=4 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:05:33.628933 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cd221eb3-39de-4808-80dc-beb11f0e79ef tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:05:33.629636 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cd221eb3-39de-4808-80dc-beb11f0e79ef tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:05:33.630336 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cd221eb3-39de-4808-80dc-beb11f0e79ef tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:05:33.631517 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cd221eb3-39de-4808-80dc-beb11f0e79ef tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:05:33.632145 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cd221eb3-39de-4808-80dc-beb11f0e79ef tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:05:33.632745 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cd221eb3-39de-4808-80dc-beb11f0e79ef tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:05:33.638151 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=61 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:05:33.790402 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-cd221eb3-39de-4808-80dc-beb11f0e79ef tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac6c0276fa842738263e8aed290bf19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed478a90b637419e8a1ec46a5ec15414', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:05:33.799334 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-cd221eb3-39de-4808-80dc-beb11f0e79ef tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] 10.222.0.20 "GET /compute/v2.1/servers/7d470632-cd1e-4fa8-98dc-4250c3ed482e" status: 200 len: 1282 microversion: 2.1 time: 0.186986 Oct 27 04:05:33.802756 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3240/6765] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:05:33 2022] GET /compute/v2.1/servers/7d470632-cd1e-4fa8-98dc-4250c3ed482e => generated 1282 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:05:34.828108 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-27a394d6-8e31-4b75-8adc-89759c05aa1b tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:05:34.828816 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-27a394d6-8e31-4b75-8adc-89759c05aa1b tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] [instance: 7d470632-cd1e-4fa8-98dc-4250c3ed482e] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:05:34.836088 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-27a394d6-8e31-4b75-8adc-89759c05aa1b tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:05:34.836544 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-27a394d6-8e31-4b75-8adc-89759c05aa1b tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:05:34.837162 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-27a394d6-8e31-4b75-8adc-89759c05aa1b tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:05:34.838093 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-27a394d6-8e31-4b75-8adc-89759c05aa1b tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:05:34.838555 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-27a394d6-8e31-4b75-8adc-89759c05aa1b tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:05:34.844541 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-27a394d6-8e31-4b75-8adc-89759c05aa1b tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:05:34.977079 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-27a394d6-8e31-4b75-8adc-89759c05aa1b tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac6c0276fa842738263e8aed290bf19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed478a90b637419e8a1ec46a5ec15414', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:05:34.985717 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-27a394d6-8e31-4b75-8adc-89759c05aa1b tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] 10.222.0.20 "GET /compute/v2.1/servers/7d470632-cd1e-4fa8-98dc-4250c3ed482e" status: 200 len: 1282 microversion: 2.1 time: 0.162522 Oct 27 04:05:34.987149 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3526/6766] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:05:34 2022] GET /compute/v2.1/servers/7d470632-cd1e-4fa8-98dc-4250c3ed482e => generated 1282 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:05:36.009312 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ebed27b8-bc69-4d1a-ad3e-e1fb314f9e18 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:05:36.010111 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ebed27b8-bc69-4d1a-ad3e-e1fb314f9e18 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] [instance: 7d470632-cd1e-4fa8-98dc-4250c3ed482e] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:05:36.013264 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:05:36.018578 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ebed27b8-bc69-4d1a-ad3e-e1fb314f9e18 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:05:36.019109 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ebed27b8-bc69-4d1a-ad3e-e1fb314f9e18 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:05:36.021774 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ebed27b8-bc69-4d1a-ad3e-e1fb314f9e18 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:05:36.021774 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ebed27b8-bc69-4d1a-ad3e-e1fb314f9e18 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:05:36.021774 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ebed27b8-bc69-4d1a-ad3e-e1fb314f9e18 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:05:36.021774 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ebed27b8-bc69-4d1a-ad3e-e1fb314f9e18 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:05:36.036847 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=6 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:05:36.159059 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ebed27b8-bc69-4d1a-ad3e-e1fb314f9e18 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac6c0276fa842738263e8aed290bf19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed478a90b637419e8a1ec46a5ec15414', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:05:36.167702 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ebed27b8-bc69-4d1a-ad3e-e1fb314f9e18 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] 10.222.0.20 "GET /compute/v2.1/servers/7d470632-cd1e-4fa8-98dc-4250c3ed482e" status: 200 len: 1270 microversion: 2.1 time: 0.161994 Oct 27 04:05:36.168287 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3241/6767] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:05:36 2022] GET /compute/v2.1/servers/7d470632-cd1e-4fa8-98dc-4250c3ed482e => generated 1270 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:05:37.192746 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0f4d576e-8b5d-48cc-bef5-ce9cc66d3737 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:05:37.193143 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0f4d576e-8b5d-48cc-bef5-ce9cc66d3737 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] [instance: 7d470632-cd1e-4fa8-98dc-4250c3ed482e] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:05:37.197209 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=6 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:05:37.202189 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0f4d576e-8b5d-48cc-bef5-ce9cc66d3737 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:05:37.202689 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0f4d576e-8b5d-48cc-bef5-ce9cc66d3737 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:05:37.203161 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0f4d576e-8b5d-48cc-bef5-ce9cc66d3737 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:05:37.203874 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0f4d576e-8b5d-48cc-bef5-ce9cc66d3737 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:05:37.204372 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0f4d576e-8b5d-48cc-bef5-ce9cc66d3737 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:05:37.204809 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0f4d576e-8b5d-48cc-bef5-ce9cc66d3737 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:05:37.338182 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0f4d576e-8b5d-48cc-bef5-ce9cc66d3737 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac6c0276fa842738263e8aed290bf19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed478a90b637419e8a1ec46a5ec15414', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:05:37.346440 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0f4d576e-8b5d-48cc-bef5-ce9cc66d3737 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] 10.222.0.20 "GET /compute/v2.1/servers/7d470632-cd1e-4fa8-98dc-4250c3ed482e" status: 200 len: 1270 microversion: 2.1 time: 0.158109 Oct 27 04:05:37.347135 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3527/6768] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:05:37 2022] GET /compute/v2.1/servers/7d470632-cd1e-4fa8-98dc-4250c3ed482e => generated 1270 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:05:38.369098 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-590cbc78-d243-4688-8012-5312aad18476 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:05:38.370796 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-590cbc78-d243-4688-8012-5312aad18476 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] [instance: 7d470632-cd1e-4fa8-98dc-4250c3ed482e] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:05:38.376874 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-590cbc78-d243-4688-8012-5312aad18476 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:05:38.377509 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-590cbc78-d243-4688-8012-5312aad18476 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:05:38.377960 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-590cbc78-d243-4688-8012-5312aad18476 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:05:38.378723 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-590cbc78-d243-4688-8012-5312aad18476 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:05:38.379186 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-590cbc78-d243-4688-8012-5312aad18476 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:05:38.379623 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-590cbc78-d243-4688-8012-5312aad18476 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:05:38.519366 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-590cbc78-d243-4688-8012-5312aad18476 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac6c0276fa842738263e8aed290bf19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed478a90b637419e8a1ec46a5ec15414', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:05:38.527375 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-590cbc78-d243-4688-8012-5312aad18476 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] 10.222.0.20 "GET /compute/v2.1/servers/7d470632-cd1e-4fa8-98dc-4250c3ed482e" status: 200 len: 1270 microversion: 2.1 time: 0.162462 Oct 27 04:05:38.527960 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3242/6769] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:05:38 2022] GET /compute/v2.1/servers/7d470632-cd1e-4fa8-98dc-4250c3ed482e => generated 1270 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:05:39.550466 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f365b9a2-bd4b-4d49-aaae-ebbcabdc7b55 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:05:39.551126 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f365b9a2-bd4b-4d49-aaae-ebbcabdc7b55 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] [instance: 7d470632-cd1e-4fa8-98dc-4250c3ed482e] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:05:39.558129 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f365b9a2-bd4b-4d49-aaae-ebbcabdc7b55 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:05:39.559154 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f365b9a2-bd4b-4d49-aaae-ebbcabdc7b55 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:05:39.559616 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f365b9a2-bd4b-4d49-aaae-ebbcabdc7b55 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:05:39.560324 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f365b9a2-bd4b-4d49-aaae-ebbcabdc7b55 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:05:39.560821 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f365b9a2-bd4b-4d49-aaae-ebbcabdc7b55 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:05:39.561262 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f365b9a2-bd4b-4d49-aaae-ebbcabdc7b55 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:05:39.700816 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f365b9a2-bd4b-4d49-aaae-ebbcabdc7b55 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac6c0276fa842738263e8aed290bf19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed478a90b637419e8a1ec46a5ec15414', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:05:39.708774 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f365b9a2-bd4b-4d49-aaae-ebbcabdc7b55 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] 10.222.0.20 "GET /compute/v2.1/servers/7d470632-cd1e-4fa8-98dc-4250c3ed482e" status: 200 len: 1270 microversion: 2.1 time: 0.162237 Oct 27 04:05:39.709447 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3528/6770] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:05:39 2022] GET /compute/v2.1/servers/7d470632-cd1e-4fa8-98dc-4250c3ed482e => generated 1270 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:05:39.880448 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ac9eec0e-c4cf-4ca6-8f8b-cc5ccabecc9d tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:05:39.882915 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ac9eec0e-c4cf-4ca6-8f8b-cc5ccabecc9d tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] [instance: e798145c-d2a8-4321-8295-949e3a8ba88a] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:05:39.890337 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ac9eec0e-c4cf-4ca6-8f8b-cc5ccabecc9d tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:05:39.890830 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ac9eec0e-c4cf-4ca6-8f8b-cc5ccabecc9d tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:05:39.891274 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ac9eec0e-c4cf-4ca6-8f8b-cc5ccabecc9d tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:05:39.891988 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ac9eec0e-c4cf-4ca6-8f8b-cc5ccabecc9d tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:05:39.892428 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ac9eec0e-c4cf-4ca6-8f8b-cc5ccabecc9d tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:05:39.892858 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ac9eec0e-c4cf-4ca6-8f8b-cc5ccabecc9d tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:05:39.958788 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ac9eec0e-c4cf-4ca6-8f8b-cc5ccabecc9d tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] 10.222.0.20 "POST /compute/v2.1/servers/e798145c-d2a8-4321-8295-949e3a8ba88a/action" status: 200 len: 24574 microversion: 2.1 time: 0.082123 Oct 27 04:05:39.959494 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3243/6771] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 04:05:39 2022] POST /compute/v2.1/servers/e798145c-d2a8-4321-8295-949e3a8ba88a/action => generated 24574 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 04:05:40.732096 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6422f5b0-19de-4c4c-ac04-44a812c8b594 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:05:40.732650 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-6422f5b0-19de-4c4c-ac04-44a812c8b594 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] [instance: 7d470632-cd1e-4fa8-98dc-4250c3ed482e] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:05:40.739457 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6422f5b0-19de-4c4c-ac04-44a812c8b594 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:05:40.739937 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6422f5b0-19de-4c4c-ac04-44a812c8b594 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:05:40.740374 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6422f5b0-19de-4c4c-ac04-44a812c8b594 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:05:40.741064 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6422f5b0-19de-4c4c-ac04-44a812c8b594 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:05:40.741518 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6422f5b0-19de-4c4c-ac04-44a812c8b594 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:05:40.741946 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6422f5b0-19de-4c4c-ac04-44a812c8b594 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:05:40.879297 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6422f5b0-19de-4c4c-ac04-44a812c8b594 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac6c0276fa842738263e8aed290bf19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed478a90b637419e8a1ec46a5ec15414', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:05:40.890127 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6422f5b0-19de-4c4c-ac04-44a812c8b594 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] 10.222.0.20 "GET /compute/v2.1/servers/7d470632-cd1e-4fa8-98dc-4250c3ed482e" status: 200 len: 1270 microversion: 2.1 time: 0.162514 Oct 27 04:05:40.890756 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3529/6772] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:05:40 2022] GET /compute/v2.1/servers/7d470632-cd1e-4fa8-98dc-4250c3ed482e => generated 1270 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:05:41.913936 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-89204a9f-dd89-45eb-84b7-e6fef3d3b593 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:05:41.914804 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-89204a9f-dd89-45eb-84b7-e6fef3d3b593 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] [instance: 7d470632-cd1e-4fa8-98dc-4250c3ed482e] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:05:41.922364 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-89204a9f-dd89-45eb-84b7-e6fef3d3b593 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:05:41.922864 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-89204a9f-dd89-45eb-84b7-e6fef3d3b593 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:05:41.923315 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-89204a9f-dd89-45eb-84b7-e6fef3d3b593 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:05:41.924030 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-89204a9f-dd89-45eb-84b7-e6fef3d3b593 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:05:41.924495 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-89204a9f-dd89-45eb-84b7-e6fef3d3b593 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:05:41.924933 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-89204a9f-dd89-45eb-84b7-e6fef3d3b593 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:05:42.068145 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-89204a9f-dd89-45eb-84b7-e6fef3d3b593 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac6c0276fa842738263e8aed290bf19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed478a90b637419e8a1ec46a5ec15414', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:05:42.076655 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-89204a9f-dd89-45eb-84b7-e6fef3d3b593 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] 10.222.0.20 "GET /compute/v2.1/servers/7d470632-cd1e-4fa8-98dc-4250c3ed482e" status: 200 len: 1270 microversion: 2.1 time: 0.167062 Oct 27 04:05:42.077224 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3244/6773] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:05:41 2022] GET /compute/v2.1/servers/7d470632-cd1e-4fa8-98dc-4250c3ed482e => generated 1270 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:05:43.100314 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1f0a94bd-6561-4304-86a9-c7124a4ab0e6 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:05:43.100949 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1f0a94bd-6561-4304-86a9-c7124a4ab0e6 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] [instance: 7d470632-cd1e-4fa8-98dc-4250c3ed482e] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:05:43.107969 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1f0a94bd-6561-4304-86a9-c7124a4ab0e6 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:05:43.108464 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1f0a94bd-6561-4304-86a9-c7124a4ab0e6 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:05:43.108927 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1f0a94bd-6561-4304-86a9-c7124a4ab0e6 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:05:43.109627 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1f0a94bd-6561-4304-86a9-c7124a4ab0e6 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:05:43.110119 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1f0a94bd-6561-4304-86a9-c7124a4ab0e6 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:05:43.110562 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1f0a94bd-6561-4304-86a9-c7124a4ab0e6 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:05:43.247945 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1f0a94bd-6561-4304-86a9-c7124a4ab0e6 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac6c0276fa842738263e8aed290bf19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed478a90b637419e8a1ec46a5ec15414', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:05:43.255908 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1f0a94bd-6561-4304-86a9-c7124a4ab0e6 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] 10.222.0.20 "GET /compute/v2.1/servers/7d470632-cd1e-4fa8-98dc-4250c3ed482e" status: 200 len: 1270 microversion: 2.1 time: 0.159584 Oct 27 04:05:43.256483 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3530/6774] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:05:43 2022] GET /compute/v2.1/servers/7d470632-cd1e-4fa8-98dc-4250c3ed482e => generated 1270 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:05:44.277870 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ffd3cc92-6ae4-4e41-94ae-df9b345b7f2f tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:05:44.279106 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ffd3cc92-6ae4-4e41-94ae-df9b345b7f2f tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] [instance: 7d470632-cd1e-4fa8-98dc-4250c3ed482e] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:05:44.287859 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ffd3cc92-6ae4-4e41-94ae-df9b345b7f2f tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:05:44.287859 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ffd3cc92-6ae4-4e41-94ae-df9b345b7f2f tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:05:44.288078 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ffd3cc92-6ae4-4e41-94ae-df9b345b7f2f tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:05:44.289690 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ffd3cc92-6ae4-4e41-94ae-df9b345b7f2f tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:05:44.290185 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ffd3cc92-6ae4-4e41-94ae-df9b345b7f2f tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:05:44.291076 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ffd3cc92-6ae4-4e41-94ae-df9b345b7f2f tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:05:44.440636 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ffd3cc92-6ae4-4e41-94ae-df9b345b7f2f tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac6c0276fa842738263e8aed290bf19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed478a90b637419e8a1ec46a5ec15414', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:05:44.448884 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ffd3cc92-6ae4-4e41-94ae-df9b345b7f2f tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] 10.222.0.20 "GET /compute/v2.1/servers/7d470632-cd1e-4fa8-98dc-4250c3ed482e" status: 200 len: 1270 microversion: 2.1 time: 0.175023 Oct 27 04:05:44.449472 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3245/6775] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:05:44 2022] GET /compute/v2.1/servers/7d470632-cd1e-4fa8-98dc-4250c3ed482e => generated 1270 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:05:45.472675 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-90641487-0938-4e0d-9ba2-8af8f92576ab tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:05:45.473495 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-90641487-0938-4e0d-9ba2-8af8f92576ab tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] [instance: 7d470632-cd1e-4fa8-98dc-4250c3ed482e] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:05:45.480252 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-90641487-0938-4e0d-9ba2-8af8f92576ab tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:05:45.480751 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-90641487-0938-4e0d-9ba2-8af8f92576ab tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:05:45.481204 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-90641487-0938-4e0d-9ba2-8af8f92576ab tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:05:45.482613 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-90641487-0938-4e0d-9ba2-8af8f92576ab tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:05:45.483684 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-90641487-0938-4e0d-9ba2-8af8f92576ab tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:05:45.484606 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-90641487-0938-4e0d-9ba2-8af8f92576ab tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:05:45.620595 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-90641487-0938-4e0d-9ba2-8af8f92576ab tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac6c0276fa842738263e8aed290bf19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed478a90b637419e8a1ec46a5ec15414', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:05:45.629308 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-90641487-0938-4e0d-9ba2-8af8f92576ab tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] 10.222.0.20 "GET /compute/v2.1/servers/7d470632-cd1e-4fa8-98dc-4250c3ed482e" status: 200 len: 1270 microversion: 2.1 time: 0.160571 Oct 27 04:05:45.629967 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3531/6776] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:05:45 2022] GET /compute/v2.1/servers/7d470632-cd1e-4fa8-98dc-4250c3ed482e => generated 1270 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:05:46.247466 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-dff30550-d27a-4d05-a883-71d8e43e6635 req-42154efe-9a9e-47ff-8462-b7b8f8184f5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d470632-cd1e-4fa8-98dc-4250c3ed482e", "name": "network-vif-plugged", "status": "completed", "tag": "dfce8b32-768c-4dce-a68b-237f1ff60963"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:05:46.258050 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-dff30550-d27a-4d05-a883-71d8e43e6635 req-42154efe-9a9e-47ff-8462-b7b8f8184f5b service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:05:46.258618 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-dff30550-d27a-4d05-a883-71d8e43e6635 req-42154efe-9a9e-47ff-8462-b7b8f8184f5b service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:05:46.259123 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-dff30550-d27a-4d05-a883-71d8e43e6635 req-42154efe-9a9e-47ff-8462-b7b8f8184f5b service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:05:46.270693 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-dff30550-d27a-4d05-a883-71d8e43e6635 req-42154efe-9a9e-47ff-8462-b7b8f8184f5b service nova] Creating event network-vif-plugged:dfce8b32-768c-4dce-a68b-237f1ff60963 for instance 7d470632-cd1e-4fa8-98dc-4250c3ed482e on n-h2-862769-1 Oct 27 04:05:46.276355 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-dff30550-d27a-4d05-a883-71d8e43e6635 req-42154efe-9a9e-47ff-8462-b7b8f8184f5b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033263 Oct 27 04:05:46.277353 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3246/6777] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:05:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:05:46.662411 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3aaa6737-1caf-43b4-847a-02b3042a9f77 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:05:46.663606 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3aaa6737-1caf-43b4-847a-02b3042a9f77 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] [instance: 7d470632-cd1e-4fa8-98dc-4250c3ed482e] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:05:46.676345 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3aaa6737-1caf-43b4-847a-02b3042a9f77 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:05:46.676856 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3aaa6737-1caf-43b4-847a-02b3042a9f77 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:05:46.677325 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3aaa6737-1caf-43b4-847a-02b3042a9f77 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:05:46.678069 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3aaa6737-1caf-43b4-847a-02b3042a9f77 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:05:46.678537 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3aaa6737-1caf-43b4-847a-02b3042a9f77 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:05:46.678974 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3aaa6737-1caf-43b4-847a-02b3042a9f77 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:05:46.821162 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3aaa6737-1caf-43b4-847a-02b3042a9f77 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac6c0276fa842738263e8aed290bf19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed478a90b637419e8a1ec46a5ec15414', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:05:46.830200 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3aaa6737-1caf-43b4-847a-02b3042a9f77 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] 10.222.0.20 "GET /compute/v2.1/servers/7d470632-cd1e-4fa8-98dc-4250c3ed482e" status: 200 len: 1270 microversion: 2.1 time: 0.181749 Oct 27 04:05:46.830819 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3532/6778] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:05:46 2022] GET /compute/v2.1/servers/7d470632-cd1e-4fa8-98dc-4250c3ed482e => generated 1270 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:05:47.853615 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ec3330a7-3fa9-4bfe-9557-cb2fbd717403 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:05:47.854450 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ec3330a7-3fa9-4bfe-9557-cb2fbd717403 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] [instance: 7d470632-cd1e-4fa8-98dc-4250c3ed482e] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:05:47.862293 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ec3330a7-3fa9-4bfe-9557-cb2fbd717403 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:05:47.862815 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ec3330a7-3fa9-4bfe-9557-cb2fbd717403 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:05:47.863258 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ec3330a7-3fa9-4bfe-9557-cb2fbd717403 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:05:47.863985 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ec3330a7-3fa9-4bfe-9557-cb2fbd717403 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:05:47.864782 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ec3330a7-3fa9-4bfe-9557-cb2fbd717403 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:05:47.865220 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ec3330a7-3fa9-4bfe-9557-cb2fbd717403 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:05:48.007429 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ec3330a7-3fa9-4bfe-9557-cb2fbd717403 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac6c0276fa842738263e8aed290bf19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed478a90b637419e8a1ec46a5ec15414', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:05:48.016203 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ec3330a7-3fa9-4bfe-9557-cb2fbd717403 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] 10.222.0.20 "GET /compute/v2.1/servers/7d470632-cd1e-4fa8-98dc-4250c3ed482e" status: 200 len: 1459 microversion: 2.1 time: 0.167041 Oct 27 04:05:48.016974 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3247/6779] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:05:47 2022] GET /compute/v2.1/servers/7d470632-cd1e-4fa8-98dc-4250c3ed482e => generated 1459 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:05:48.040214 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2c7eafd8-a425-4199-9c32-43e9369d0fbe tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:05:48.040832 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2c7eafd8-a425-4199-9c32-43e9369d0fbe tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] [instance: 7d470632-cd1e-4fa8-98dc-4250c3ed482e] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:05:48.047865 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2c7eafd8-a425-4199-9c32-43e9369d0fbe tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:05:48.048349 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2c7eafd8-a425-4199-9c32-43e9369d0fbe tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:05:48.048792 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2c7eafd8-a425-4199-9c32-43e9369d0fbe tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:05:48.049487 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2c7eafd8-a425-4199-9c32-43e9369d0fbe tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:05:48.049942 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2c7eafd8-a425-4199-9c32-43e9369d0fbe tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:05:48.050398 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2c7eafd8-a425-4199-9c32-43e9369d0fbe tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:05:48.189724 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2c7eafd8-a425-4199-9c32-43e9369d0fbe tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac6c0276fa842738263e8aed290bf19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed478a90b637419e8a1ec46a5ec15414', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:05:48.199653 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2c7eafd8-a425-4199-9c32-43e9369d0fbe tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] 10.222.0.20 "GET /compute/v2.1/servers/7d470632-cd1e-4fa8-98dc-4250c3ed482e" status: 200 len: 1459 microversion: 2.1 time: 0.163207 Oct 27 04:05:48.200246 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3533/6780] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:05:48 2022] GET /compute/v2.1/servers/7d470632-cd1e-4fa8-98dc-4250c3ed482e => generated 1459 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:05:50.330804 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-97574dc0-04a3-4fe3-9855-7d24ea99738a req-0da293af-6573-4b5c-bae9-29df85324087 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d470632-cd1e-4fa8-98dc-4250c3ed482e", "tag": "dfce8b32-768c-4dce-a68b-237f1ff60963"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:05:50.344269 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-97574dc0-04a3-4fe3-9855-7d24ea99738a req-0da293af-6573-4b5c-bae9-29df85324087 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:05:50.345524 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-97574dc0-04a3-4fe3-9855-7d24ea99738a req-0da293af-6573-4b5c-bae9-29df85324087 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:05:50.346300 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-97574dc0-04a3-4fe3-9855-7d24ea99738a req-0da293af-6573-4b5c-bae9-29df85324087 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:05:50.363107 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-97574dc0-04a3-4fe3-9855-7d24ea99738a req-0da293af-6573-4b5c-bae9-29df85324087 service nova] Creating event network-changed:dfce8b32-768c-4dce-a68b-237f1ff60963 for instance 7d470632-cd1e-4fa8-98dc-4250c3ed482e on n-h2-862769-1 Oct 27 04:05:50.371786 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-97574dc0-04a3-4fe3-9855-7d24ea99738a req-0da293af-6573-4b5c-bae9-29df85324087 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050223 Oct 27 04:05:50.373098 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3248/6781] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:05:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:05:50.831883 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-dd06f8ff-c77b-4d78-bee2-745b18b2ec6b tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:05:50.834863 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-dd06f8ff-c77b-4d78-bee2-745b18b2ec6b tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] [instance: e798145c-d2a8-4321-8295-949e3a8ba88a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:05:50.842113 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dd06f8ff-c77b-4d78-bee2-745b18b2ec6b tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:05:50.843535 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dd06f8ff-c77b-4d78-bee2-745b18b2ec6b tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:05:50.844222 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dd06f8ff-c77b-4d78-bee2-745b18b2ec6b tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:05:50.845165 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dd06f8ff-c77b-4d78-bee2-745b18b2ec6b tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:05:50.845848 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dd06f8ff-c77b-4d78-bee2-745b18b2ec6b tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:05:50.846521 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dd06f8ff-c77b-4d78-bee2-745b18b2ec6b tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:05:50.906100 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-dd06f8ff-c77b-4d78-bee2-745b18b2ec6b tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] 10.222.0.20 "POST /compute/v2.1/servers/e798145c-d2a8-4321-8295-949e3a8ba88a/action" status: 200 len: 32640 microversion: 2.1 time: 0.077837 Oct 27 04:05:50.907375 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3534/6782] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 04:05:50 2022] POST /compute/v2.1/servers/e798145c-d2a8-4321-8295-949e3a8ba88a/action => generated 32640 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 04:05:52.419203 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-7fcba4a4-076f-4cae-854b-895a858387d1 req-758191b7-c379-4b40-bc2a-4a8ad2ab9c7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d470632-cd1e-4fa8-98dc-4250c3ed482e", "tag": "dfce8b32-768c-4dce-a68b-237f1ff60963"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:05:52.430545 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-7fcba4a4-076f-4cae-854b-895a858387d1 req-758191b7-c379-4b40-bc2a-4a8ad2ab9c7e service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:05:52.431358 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-7fcba4a4-076f-4cae-854b-895a858387d1 req-758191b7-c379-4b40-bc2a-4a8ad2ab9c7e service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:05:52.432126 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-7fcba4a4-076f-4cae-854b-895a858387d1 req-758191b7-c379-4b40-bc2a-4a8ad2ab9c7e service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:05:52.444842 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-7fcba4a4-076f-4cae-854b-895a858387d1 req-758191b7-c379-4b40-bc2a-4a8ad2ab9c7e service nova] Creating event network-changed:dfce8b32-768c-4dce-a68b-237f1ff60963 for instance 7d470632-cd1e-4fa8-98dc-4250c3ed482e on n-h2-862769-1 Oct 27 04:05:52.450245 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-7fcba4a4-076f-4cae-854b-895a858387d1 req-758191b7-c379-4b40-bc2a-4a8ad2ab9c7e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035589 Oct 27 04:05:52.451224 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3249/6783] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:05:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:05:53.363912 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-18dbd60c-34e6-4954-99fd-bef7563814be tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:05:53.365233 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-18dbd60c-34e6-4954-99fd-bef7563814be tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] [instance: e798145c-d2a8-4321-8295-949e3a8ba88a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:05:53.372893 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-18dbd60c-34e6-4954-99fd-bef7563814be tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:05:53.384700 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-18dbd60c-34e6-4954-99fd-bef7563814be tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:05:53.385438 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-18dbd60c-34e6-4954-99fd-bef7563814be tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:05:53.386502 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-18dbd60c-34e6-4954-99fd-bef7563814be tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:05:53.387239 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-18dbd60c-34e6-4954-99fd-bef7563814be tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:05:53.387971 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-18dbd60c-34e6-4954-99fd-bef7563814be tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:05:53.420905 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-18dbd60c-34e6-4954-99fd-bef7563814be tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] [instance: e798145c-d2a8-4321-8295-949e3a8ba88a] Going to try to terminate instance {{(pid=121001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 04:05:53.779119 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-18dbd60c-34e6-4954-99fd-bef7563814be tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e798145c-d2a8-4321-8295-949e3a8ba88a" status: 204 len: 0 microversion: 2.1 time: 0.419199 Oct 27 04:05:53.780148 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3535/6784] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 04:05:53 2022] DELETE /compute/v2.1/servers/e798145c-d2a8-4321-8295-949e3a8ba88a => generated 0 bytes in 421 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 04:05:53.789941 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-fad4ec5e-1bcc-43bc-a021-6d92dc17365e tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:05:53.790716 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-fad4ec5e-1bcc-43bc-a021-6d92dc17365e tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] [instance: e798145c-d2a8-4321-8295-949e3a8ba88a] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:05:53.797716 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fad4ec5e-1bcc-43bc-a021-6d92dc17365e tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:05:53.798243 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fad4ec5e-1bcc-43bc-a021-6d92dc17365e tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:05:53.798684 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fad4ec5e-1bcc-43bc-a021-6d92dc17365e tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:05:53.799387 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fad4ec5e-1bcc-43bc-a021-6d92dc17365e tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:05:53.800026 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fad4ec5e-1bcc-43bc-a021-6d92dc17365e tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:05:53.800626 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fad4ec5e-1bcc-43bc-a021-6d92dc17365e tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:05:53.964828 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-fad4ec5e-1bcc-43bc-a021-6d92dc17365e tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bf808aeff6462794e5d6c653c72ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c921299382141f99cd9c4b6b11927a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:05:53.973211 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-fad4ec5e-1bcc-43bc-a021-6d92dc17365e tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] 10.222.0.20 "GET /compute/v2.1/servers/e798145c-d2a8-4321-8295-949e3a8ba88a" status: 200 len: 1672 microversion: 2.1 time: 0.188342 Oct 27 04:05:53.973797 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3250/6785] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:05:53 2022] GET /compute/v2.1/servers/e798145c-d2a8-4321-8295-949e3a8ba88a => generated 1672 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:05:54.469076 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-76a57628-1135-43b2-b7d2-3159b74f73c1 req-3d75e74c-b4c6-4aa2-8447-80e8f2bd421e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d470632-cd1e-4fa8-98dc-4250c3ed482e", "tag": "dfce8b32-768c-4dce-a68b-237f1ff60963"}, {"name": "network-changed", "server_uuid": "e798145c-d2a8-4321-8295-949e3a8ba88a", "tag": "a870529a-18aa-4c91-8131-fd4c192b53f2"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:05:54.482641 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-76a57628-1135-43b2-b7d2-3159b74f73c1 req-3d75e74c-b4c6-4aa2-8447-80e8f2bd421e service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:05:54.483145 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-76a57628-1135-43b2-b7d2-3159b74f73c1 req-3d75e74c-b4c6-4aa2-8447-80e8f2bd421e service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:05:54.483598 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-76a57628-1135-43b2-b7d2-3159b74f73c1 req-3d75e74c-b4c6-4aa2-8447-80e8f2bd421e service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:05:54.497227 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-76a57628-1135-43b2-b7d2-3159b74f73c1 req-3d75e74c-b4c6-4aa2-8447-80e8f2bd421e service nova] Creating event network-changed:dfce8b32-768c-4dce-a68b-237f1ff60963 for instance 7d470632-cd1e-4fa8-98dc-4250c3ed482e on n-h2-862769-1 Oct 27 04:05:54.497759 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-76a57628-1135-43b2-b7d2-3159b74f73c1 req-3d75e74c-b4c6-4aa2-8447-80e8f2bd421e service nova] Creating event network-changed:a870529a-18aa-4c91-8131-fd4c192b53f2 for instance e798145c-d2a8-4321-8295-949e3a8ba88a on n-h1-862769-1 Oct 27 04:05:54.508519 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-76a57628-1135-43b2-b7d2-3159b74f73c1 req-3d75e74c-b4c6-4aa2-8447-80e8f2bd421e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.044070 Oct 27 04:05:54.509150 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3536/6786] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:05:54 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 04:05:54.997259 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0998c472-e396-45ca-a1e3-b8a4539bd945 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:05:54.999140 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0998c472-e396-45ca-a1e3-b8a4539bd945 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] [instance: e798145c-d2a8-4321-8295-949e3a8ba88a] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:05:55.006080 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0998c472-e396-45ca-a1e3-b8a4539bd945 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:05:55.006576 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0998c472-e396-45ca-a1e3-b8a4539bd945 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:05:55.007014 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0998c472-e396-45ca-a1e3-b8a4539bd945 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:05:55.007727 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0998c472-e396-45ca-a1e3-b8a4539bd945 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:05:55.008184 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0998c472-e396-45ca-a1e3-b8a4539bd945 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:05:55.008612 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0998c472-e396-45ca-a1e3-b8a4539bd945 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:05:55.255270 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0998c472-e396-45ca-a1e3-b8a4539bd945 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bf808aeff6462794e5d6c653c72ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c921299382141f99cd9c4b6b11927a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:05:55.265228 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0998c472-e396-45ca-a1e3-b8a4539bd945 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] 10.222.0.20 "GET /compute/v2.1/servers/e798145c-d2a8-4321-8295-949e3a8ba88a" status: 200 len: 1672 microversion: 2.1 time: 0.271061 Oct 27 04:05:55.266822 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3251/6787] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:05:54 2022] GET /compute/v2.1/servers/e798145c-d2a8-4321-8295-949e3a8ba88a => generated 1672 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:05:56.290148 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-387ad1c6-dfd1-48ae-977b-89e86899d266 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:05:56.290929 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-387ad1c6-dfd1-48ae-977b-89e86899d266 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] [instance: e798145c-d2a8-4321-8295-949e3a8ba88a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:05:56.299273 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-387ad1c6-dfd1-48ae-977b-89e86899d266 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:05:56.299767 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-387ad1c6-dfd1-48ae-977b-89e86899d266 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:05:56.300204 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-387ad1c6-dfd1-48ae-977b-89e86899d266 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:05:56.300916 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-387ad1c6-dfd1-48ae-977b-89e86899d266 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:05:56.301465 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-387ad1c6-dfd1-48ae-977b-89e86899d266 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:05:56.301900 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-387ad1c6-dfd1-48ae-977b-89e86899d266 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:05:56.344453 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-387ad1c6-dfd1-48ae-977b-89e86899d266 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:05:56.344949 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-387ad1c6-dfd1-48ae-977b-89e86899d266 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:05:56.345396 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-387ad1c6-dfd1-48ae-977b-89e86899d266 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:05:56.345887 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-387ad1c6-dfd1-48ae-977b-89e86899d266 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lazy-loading 'fault' on Instance uuid e798145c-d2a8-4321-8295-949e3a8ba88a {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 04:05:56.405512 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-387ad1c6-dfd1-48ae-977b-89e86899d266 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bf808aeff6462794e5d6c653c72ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c921299382141f99cd9c4b6b11927a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:05:56.415143 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-387ad1c6-dfd1-48ae-977b-89e86899d266 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] 10.222.0.20 "GET /compute/v2.1/servers/e798145c-d2a8-4321-8295-949e3a8ba88a" status: 200 len: 1338 microversion: 2.1 time: 0.129774 Oct 27 04:05:56.417204 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3537/6788] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:05:56 2022] GET /compute/v2.1/servers/e798145c-d2a8-4321-8295-949e3a8ba88a => generated 1338 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:05:56.523122 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-4c4c5929-b8d2-420e-b2c9-935672563b18 req-5dfd24b0-835f-48f1-aecd-91b92bb3ffa7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e798145c-d2a8-4321-8295-949e3a8ba88a", "name": "network-vif-deleted", "tag": "a870529a-18aa-4c91-8131-fd4c192b53f2"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:05:56.533558 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-4c4c5929-b8d2-420e-b2c9-935672563b18 req-5dfd24b0-835f-48f1-aecd-91b92bb3ffa7 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:05:56.534057 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-4c4c5929-b8d2-420e-b2c9-935672563b18 req-5dfd24b0-835f-48f1-aecd-91b92bb3ffa7 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:05:56.534502 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-4c4c5929-b8d2-420e-b2c9-935672563b18 req-5dfd24b0-835f-48f1-aecd-91b92bb3ffa7 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:05:56.546017 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-4c4c5929-b8d2-420e-b2c9-935672563b18 req-5dfd24b0-835f-48f1-aecd-91b92bb3ffa7 service nova] Creating event network-vif-deleted:a870529a-18aa-4c91-8131-fd4c192b53f2 for instance e798145c-d2a8-4321-8295-949e3a8ba88a on n-h1-862769-1 Oct 27 04:05:56.551069 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-4c4c5929-b8d2-420e-b2c9-935672563b18 req-5dfd24b0-835f-48f1-aecd-91b92bb3ffa7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031699 Oct 27 04:05:56.551900 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3252/6789] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:05:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:05:57.440848 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b6da7123-fac7-4e22-8053-8153251e07f4 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:05:57.441413 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b6da7123-fac7-4e22-8053-8153251e07f4 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] [instance: e798145c-d2a8-4321-8295-949e3a8ba88a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:05:57.448534 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b6da7123-fac7-4e22-8053-8153251e07f4 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:05:57.449027 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b6da7123-fac7-4e22-8053-8153251e07f4 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:05:57.449472 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b6da7123-fac7-4e22-8053-8153251e07f4 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:05:57.450204 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b6da7123-fac7-4e22-8053-8153251e07f4 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:05:57.450667 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b6da7123-fac7-4e22-8053-8153251e07f4 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:05:57.451099 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b6da7123-fac7-4e22-8053-8153251e07f4 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:05:57.454279 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:05:57.465768 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-b6da7123-fac7-4e22-8053-8153251e07f4 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] HTTP exception thrown: Instance e798145c-d2a8-4321-8295-949e3a8ba88a could not be found. Oct 27 04:05:57.468069 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b6da7123-fac7-4e22-8053-8153251e07f4 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Request method failure captured: Oct 27 04:05:57.468069 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/e798145c-d2a8-4321-8295-949e3a8ba88a HTTP/1.1 Oct 27 04:05:57.468069 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 04:05:57.468069 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 04:05:57.468069 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 04:05:57.468069 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 04:05:57.468069 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 04:05:57.468069 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 04:05:57.468069 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 04:05:57.468069 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 04:05:57.468069 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWgLdrMEnhoO8AegDn0YZKRNA5IK7Cm0iiw04H26wQZCw3bRQksYhpbMh_lBkTWEXTmVDbO4BMuQ24TunIeg8EwFZxUPqOYztP-l3CXue8drga5HyDPVE0JrJ5G6iGTDgT_vwr2oE4LbYggYst_ivqWaz7JYjwtrSSw6pM7yIOdk0mf4 Oct 27 04:05:57.468069 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 04:05:57.468069 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 04:05:57.468069 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 04:05:57.468069 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 04:05:57.468069 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 04:05:57.468069 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 04:05:57.468069 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 9c921299382141f99cd9c4b6b11927a4 Oct 27 04:05:57.468069 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-TestNetworkBasicOps-1974434160 Oct 27 04:05:57.468069 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 04:05:57.468069 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 04:05:57.468069 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9c921299382141f99cd9c4b6b11927a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9c921299382141f99cd9c4b6b11927a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9c921299382141f99cd9c4b6b11927a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9c921299382141f99cd9c4b6b11927a4"}]}] Oct 27 04:05:57.468069 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-TestNetworkBasicOps-1974434160 Oct 27 04:05:57.468069 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 9c921299382141f99cd9c4b6b11927a4 Oct 27 04:05:57.468069 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-TestNetworkBasicOps-1974434160 Oct 27 04:05:57.468069 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-TestNetworkBasicOps-1974434160-project Oct 27 04:05:57.468069 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 04:05:57.468069 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 04:05:57.468069 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 98bf808aeff6462794e5d6c653c72ae2 Oct 27 04:05:57.468069 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-TestNetworkBasicOps-1974434160-project Oct 27 04:05:57.468069 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 04:05:57.468069 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance e798145c-d2a8-4321-8295-949e3a8ba88a could not be found. Oct 27 04:05:57.468069 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': 'e798145c-d2a8-4321-8295-949e3a8ba88a'} Oct 27 04:05:57.468069 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 04:05:57.468069 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:05:57.468069 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 04:05:57.468069 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 04:05:57.468069 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 04:05:57.468069 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 04:05:57.468069 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 04:05:57.468069 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 04:05:57.468069 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 04:05:57.468069 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 04:05:57.468069 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e798145c-d2a8-4321-8295-949e3a8ba88a could not be found. Oct 27 04:05:57.468069 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:05:57.468069 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:05:57.468069 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:05:57.468069 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:05:57.468069 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:05:57.468069 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:05:57.468069 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 04:05:57.468069 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 04:05:57.468069 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 04:05:57.468069 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 04:05:57.468069 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 04:05:57.468069 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 04:05:57.468069 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 04:05:57.468069 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 04:05:57.468069 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 04:05:57.468069 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 04:05:57.468069 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e798145c-d2a8-4321-8295-949e3a8ba88a could not be found. Oct 27 04:05:57.468069 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:05:57.468069 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:05:57.468069 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:05:57.477686 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:05:57.477686 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:05:57.477686 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:05:57.477686 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 04:05:57.477686 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 04:05:57.477686 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e798145c-d2a8-4321-8295-949e3a8ba88a could not be found. Oct 27 04:05:57.477686 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:05:57.477686 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b6da7123-fac7-4e22-8053-8153251e07f4 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Returning 404 to user: Instance e798145c-d2a8-4321-8295-949e3a8ba88a could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 04:05:57.477686 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b6da7123-fac7-4e22-8053-8153251e07f4 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] 10.222.0.20 "GET /compute/v2.1/servers/e798145c-d2a8-4321-8295-949e3a8ba88a" status: 404 len: 111 microversion: 2.1 time: 0.032701 Oct 27 04:05:57.477686 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3538/6790] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:05:57 2022] GET /compute/v2.1/servers/e798145c-d2a8-4321-8295-949e3a8ba88a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 04:05:57.682697 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ebebf6e6-09da-43fc-b6cc-95db60f0da52 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] Calling method '.version_select at 0x7f7dda27f280>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:05:57.757560 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ebebf6e6-09da-43fc-b6cc-95db60f0da52 tempest-TestNetworkBasicOps-1974434160 tempest-TestNetworkBasicOps-1974434160-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2099103138" status: 202 len: 0 microversion: 2.1 time: 0.080040 Oct 27 04:05:57.758379 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3253/6791] 10.222.0.20 () {58 vars in 1257 bytes} [Thu Oct 27 04:05:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2099103138 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 04:06:08.910547 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-64fd141a-a229-41f9-bcd7-76c26c1cbe3b tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:06:08.910547 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-64fd141a-a229-41f9-bcd7-76c26c1cbe3b tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] [instance: b2e26972-0eb6-44da-8ae0-10aee7463e0c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:06:08.910547 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:06:08.910547 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-64fd141a-a229-41f9-bcd7-76c26c1cbe3b tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:08.910547 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-64fd141a-a229-41f9-bcd7-76c26c1cbe3b tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:08.910547 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-64fd141a-a229-41f9-bcd7-76c26c1cbe3b tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:08.910547 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-64fd141a-a229-41f9-bcd7-76c26c1cbe3b tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:08.910547 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-64fd141a-a229-41f9-bcd7-76c26c1cbe3b tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:08.910547 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-64fd141a-a229-41f9-bcd7-76c26c1cbe3b tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:08.910547 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-64fd141a-a229-41f9-bcd7-76c26c1cbe3b tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Lazy-loading 'services' on Instance uuid b2e26972-0eb6-44da-8ae0-10aee7463e0c {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 04:06:09.389864 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-64fd141a-a229-41f9-bcd7-76c26c1cbe3b tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b2e26972-0eb6-44da-8ae0-10aee7463e0c/os-volume_attachments/7f015ebd-2e38-4e10-8e1d-bfef0334174d" status: 202 len: 0 microversion: 2.1 time: 0.722368 Oct 27 04:06:09.390677 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3539/6792] 10.222.0.20 () {58 vars in 1416 bytes} [Thu Oct 27 04:06:08 2022] DELETE /compute/v2.1/servers/b2e26972-0eb6-44da-8ae0-10aee7463e0c/os-volume_attachments/7f015ebd-2e38-4e10-8e1d-bfef0334174d => generated 0 bytes in 724 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 04:06:15.971177 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-731fab0c-35ea-41e6-9359-81eda3209e0e tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:06:15.971823 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-731fab0c-35ea-41e6-9359-81eda3209e0e tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] [instance: b2e26972-0eb6-44da-8ae0-10aee7463e0c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:06:15.979705 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=59 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:06:15.980770 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=28,nova_api:DELETE=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:06:15.982980 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-731fab0c-35ea-41e6-9359-81eda3209e0e tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:15.983724 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-731fab0c-35ea-41e6-9359-81eda3209e0e tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:15.984379 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-731fab0c-35ea-41e6-9359-81eda3209e0e tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:15.985307 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-731fab0c-35ea-41e6-9359-81eda3209e0e tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:15.985775 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-731fab0c-35ea-41e6-9359-81eda3209e0e tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:15.986239 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-731fab0c-35ea-41e6-9359-81eda3209e0e tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:16.018566 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-731fab0c-35ea-41e6-9359-81eda3209e0e tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] [instance: b2e26972-0eb6-44da-8ae0-10aee7463e0c] Going to try to terminate instance {{(pid=121000) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 04:06:16.305087 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-731fab0c-35ea-41e6-9359-81eda3209e0e tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b2e26972-0eb6-44da-8ae0-10aee7463e0c" status: 204 len: 0 microversion: 2.1 time: 0.337786 Oct 27 04:06:16.305804 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3254/6793] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 04:06:15 2022] DELETE /compute/v2.1/servers/b2e26972-0eb6-44da-8ae0-10aee7463e0c => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 04:06:16.314986 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4cee6d58-b23f-41c9-977a-755ea2ec7e4c tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:06:16.315806 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4cee6d58-b23f-41c9-977a-755ea2ec7e4c tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] [instance: b2e26972-0eb6-44da-8ae0-10aee7463e0c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:06:16.325146 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4cee6d58-b23f-41c9-977a-755ea2ec7e4c tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:16.326105 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4cee6d58-b23f-41c9-977a-755ea2ec7e4c tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:16.326829 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4cee6d58-b23f-41c9-977a-755ea2ec7e4c tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:16.327754 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4cee6d58-b23f-41c9-977a-755ea2ec7e4c tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:16.328223 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4cee6d58-b23f-41c9-977a-755ea2ec7e4c tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:16.328657 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4cee6d58-b23f-41c9-977a-755ea2ec7e4c tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:16.475418 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4cee6d58-b23f-41c9-977a-755ea2ec7e4c tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5f2bbf4fa7a4768ba0d395217b3397e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38158a663ff04f19afebd7054ed4b2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:06:16.485041 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4cee6d58-b23f-41c9-977a-755ea2ec7e4c tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] 10.222.0.20 "GET /compute/v2.1/servers/b2e26972-0eb6-44da-8ae0-10aee7463e0c" status: 200 len: 1470 microversion: 2.1 time: 0.174916 Oct 27 04:06:16.494592 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3540/6794] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:06:16 2022] GET /compute/v2.1/servers/b2e26972-0eb6-44da-8ae0-10aee7463e0c => generated 1470 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:06:17.509392 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3f293e4d-edcf-4707-ab5f-4e6cc6c59bbf tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:06:17.510522 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-3f293e4d-edcf-4707-ab5f-4e6cc6c59bbf tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] [instance: b2e26972-0eb6-44da-8ae0-10aee7463e0c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:06:17.519438 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3f293e4d-edcf-4707-ab5f-4e6cc6c59bbf tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:17.520072 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3f293e4d-edcf-4707-ab5f-4e6cc6c59bbf tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:17.523427 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3f293e4d-edcf-4707-ab5f-4e6cc6c59bbf tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:17.524573 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3f293e4d-edcf-4707-ab5f-4e6cc6c59bbf tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:17.525645 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3f293e4d-edcf-4707-ab5f-4e6cc6c59bbf tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:17.526335 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3f293e4d-edcf-4707-ab5f-4e6cc6c59bbf tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:17.766664 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-3f293e4d-edcf-4707-ab5f-4e6cc6c59bbf tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5f2bbf4fa7a4768ba0d395217b3397e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38158a663ff04f19afebd7054ed4b2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:06:17.779281 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3f293e4d-edcf-4707-ab5f-4e6cc6c59bbf tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] 10.222.0.20 "GET /compute/v2.1/servers/b2e26972-0eb6-44da-8ae0-10aee7463e0c" status: 200 len: 1470 microversion: 2.1 time: 0.274006 Oct 27 04:06:17.781078 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3255/6795] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:06:17 2022] GET /compute/v2.1/servers/b2e26972-0eb6-44da-8ae0-10aee7463e0c => generated 1470 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:06:18.439365 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-7d4b879a-b709-4178-9b75-6fc5614679d7 req-28fd03b1-4f8d-4a7b-a5e4-798ffa2c2a1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2e26972-0eb6-44da-8ae0-10aee7463e0c", "name": "network-vif-deleted", "tag": "70ffca0e-4e24-44e4-a4f9-33034e171786"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:06:18.460750 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-7d4b879a-b709-4178-9b75-6fc5614679d7 req-28fd03b1-4f8d-4a7b-a5e4-798ffa2c2a1f service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:18.461240 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-7d4b879a-b709-4178-9b75-6fc5614679d7 req-28fd03b1-4f8d-4a7b-a5e4-798ffa2c2a1f service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:18.461684 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-7d4b879a-b709-4178-9b75-6fc5614679d7 req-28fd03b1-4f8d-4a7b-a5e4-798ffa2c2a1f service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:18.475674 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-7d4b879a-b709-4178-9b75-6fc5614679d7 req-28fd03b1-4f8d-4a7b-a5e4-798ffa2c2a1f service nova] Creating event network-vif-deleted:70ffca0e-4e24-44e4-a4f9-33034e171786 for instance b2e26972-0eb6-44da-8ae0-10aee7463e0c on n-h2-862769-1 Oct 27 04:06:18.480958 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-7d4b879a-b709-4178-9b75-6fc5614679d7 req-28fd03b1-4f8d-4a7b-a5e4-798ffa2c2a1f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046085 Oct 27 04:06:18.482021 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3541/6796] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:06:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:06:18.804030 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b4aaa212-aa3b-4b5f-9d9f-8898f8d77a3b tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:06:18.804709 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b4aaa212-aa3b-4b5f-9d9f-8898f8d77a3b tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] [instance: b2e26972-0eb6-44da-8ae0-10aee7463e0c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:06:18.819833 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b4aaa212-aa3b-4b5f-9d9f-8898f8d77a3b tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:18.819833 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b4aaa212-aa3b-4b5f-9d9f-8898f8d77a3b tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:18.819833 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b4aaa212-aa3b-4b5f-9d9f-8898f8d77a3b tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:18.820635 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b4aaa212-aa3b-4b5f-9d9f-8898f8d77a3b tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:18.821098 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b4aaa212-aa3b-4b5f-9d9f-8898f8d77a3b tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:18.821532 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b4aaa212-aa3b-4b5f-9d9f-8898f8d77a3b tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:18.861005 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b4aaa212-aa3b-4b5f-9d9f-8898f8d77a3b tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:18.861599 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b4aaa212-aa3b-4b5f-9d9f-8898f8d77a3b tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:18.862411 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b4aaa212-aa3b-4b5f-9d9f-8898f8d77a3b tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:18.863046 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-b4aaa212-aa3b-4b5f-9d9f-8898f8d77a3b tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Lazy-loading 'fault' on Instance uuid b2e26972-0eb6-44da-8ae0-10aee7463e0c {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 04:06:18.918354 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b4aaa212-aa3b-4b5f-9d9f-8898f8d77a3b tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5f2bbf4fa7a4768ba0d395217b3397e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38158a663ff04f19afebd7054ed4b2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:06:18.926997 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b4aaa212-aa3b-4b5f-9d9f-8898f8d77a3b tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] 10.222.0.20 "GET /compute/v2.1/servers/b2e26972-0eb6-44da-8ae0-10aee7463e0c" status: 200 len: 1304 microversion: 2.1 time: 0.127664 Oct 27 04:06:18.934221 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3256/6797] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:06:18 2022] GET /compute/v2.1/servers/b2e26972-0eb6-44da-8ae0-10aee7463e0c => generated 1304 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:06:19.957109 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3514e119-1d5e-4f5a-8b31-8092d2764cba tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:06:19.957809 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3514e119-1d5e-4f5a-8b31-8092d2764cba tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] [instance: b2e26972-0eb6-44da-8ae0-10aee7463e0c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:06:19.964443 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3514e119-1d5e-4f5a-8b31-8092d2764cba tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:19.964931 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3514e119-1d5e-4f5a-8b31-8092d2764cba tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:19.965469 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3514e119-1d5e-4f5a-8b31-8092d2764cba tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:19.966282 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3514e119-1d5e-4f5a-8b31-8092d2764cba tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:19.966740 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3514e119-1d5e-4f5a-8b31-8092d2764cba tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:19.967174 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3514e119-1d5e-4f5a-8b31-8092d2764cba tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:19.981211 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-3514e119-1d5e-4f5a-8b31-8092d2764cba tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] HTTP exception thrown: Instance b2e26972-0eb6-44da-8ae0-10aee7463e0c could not be found. Oct 27 04:06:19.983459 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3514e119-1d5e-4f5a-8b31-8092d2764cba tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Request method failure captured: Oct 27 04:06:19.983459 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/b2e26972-0eb6-44da-8ae0-10aee7463e0c HTTP/1.1 Oct 27 04:06:19.983459 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 04:06:19.983459 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 04:06:19.983459 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 04:06:19.983459 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 04:06:19.983459 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 04:06:19.983459 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 04:06:19.983459 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 04:06:19.983459 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 04:06:19.983459 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWgM31T4JnxZk3orpjM9k7_sEdS3YGmEhTBKJEtE_-yaGiFizZ5fNTCGs2NhwDWEqYVxyb29YP3ZUHrG1-k9gPH6CmQ0iMH-duSzQpKLz546pjJZ3nVg_LOMO6BtveSADkhYA4G2s2SNlIlcbD4g9erAiBMD_c7BZ0rKIZ_PS3qm4TVQ Oct 27 04:06:19.983459 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 04:06:19.983459 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 04:06:19.983459 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 04:06:19.983459 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 04:06:19.983459 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 04:06:19.983459 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 04:06:19.983459 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 38158a663ff04f19afebd7054ed4b2c4 Oct 27 04:06:19.983459 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-VolumesBackupsTest-228413811 Oct 27 04:06:19.983459 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 04:06:19.983459 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 04:06:19.983459 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/38158a663ff04f19afebd7054ed4b2c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/38158a663ff04f19afebd7054ed4b2c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/38158a663ff04f19afebd7054ed4b2c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_38158a663ff04f19afebd7054ed4b2c4"}]}] Oct 27 04:06:19.983459 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-VolumesBackupsTest-228413811 Oct 27 04:06:19.983459 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 38158a663ff04f19afebd7054ed4b2c4 Oct 27 04:06:19.983459 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-VolumesBackupsTest-228413811 Oct 27 04:06:19.983459 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-VolumesBackupsTest-228413811-project Oct 27 04:06:19.983459 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 04:06:19.983459 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 04:06:19.983459 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: d5f2bbf4fa7a4768ba0d395217b3397e Oct 27 04:06:19.983459 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-VolumesBackupsTest-228413811-project Oct 27 04:06:19.983459 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 04:06:19.983459 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance b2e26972-0eb6-44da-8ae0-10aee7463e0c could not be found. Oct 27 04:06:19.983459 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': 'b2e26972-0eb6-44da-8ae0-10aee7463e0c'} Oct 27 04:06:19.983459 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 04:06:19.983459 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:06:19.983459 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 04:06:19.983459 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 04:06:19.983459 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 04:06:19.983459 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 04:06:19.983459 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 04:06:19.983459 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 04:06:19.983459 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 04:06:19.983459 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 04:06:19.983459 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2e26972-0eb6-44da-8ae0-10aee7463e0c could not be found. Oct 27 04:06:19.983459 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:06:19.983459 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:06:19.983459 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:06:19.983459 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:06:19.983459 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:06:19.983459 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:06:19.983459 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 04:06:19.983459 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 04:06:19.983459 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 04:06:19.983459 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 04:06:19.983459 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 04:06:19.983459 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 04:06:19.983459 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 04:06:19.983459 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 04:06:19.983459 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 04:06:19.983459 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 04:06:19.983459 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2e26972-0eb6-44da-8ae0-10aee7463e0c could not be found. Oct 27 04:06:19.983459 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:06:19.983459 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:06:19.983459 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:06:19.988643 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:06:19.988643 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:06:19.988643 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:06:19.988643 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 04:06:19.988643 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 04:06:19.988643 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2e26972-0eb6-44da-8ae0-10aee7463e0c could not be found. Oct 27 04:06:19.988643 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:06:19.988643 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3514e119-1d5e-4f5a-8b31-8092d2764cba tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] Returning 404 to user: Instance b2e26972-0eb6-44da-8ae0-10aee7463e0c could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 04:06:19.988643 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3514e119-1d5e-4f5a-8b31-8092d2764cba tempest-VolumesBackupsTest-228413811 tempest-VolumesBackupsTest-228413811-project] 10.222.0.20 "GET /compute/v2.1/servers/b2e26972-0eb6-44da-8ae0-10aee7463e0c" status: 404 len: 111 microversion: 2.1 time: 0.033631 Oct 27 04:06:19.988643 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3542/6798] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:06:19 2022] GET /compute/v2.1/servers/b2e26972-0eb6-44da-8ae0-10aee7463e0c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 04:06:21.412093 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ee6acf10-5ce7-4470-8923-71e9be22fe2b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1882771347", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "680d454e-c137-40cf-a253-bee22f6c4420", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b49d136e-c9db-4b4f-8210-57f6cfd2ff95"}]}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:06:21.479067 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-ee6acf10-5ce7-4470-8923-71e9be22fe2b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] validate_networks() for [('b49d136e-c9db-4b4f-8210-57f6cfd2ff95', None, None, None, None, None)] {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 04:06:21.891340 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-ee6acf10-5ce7-4470-8923-71e9be22fe2b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 04:06:21.892160 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-ee6acf10-5ce7-4470-8923-71e9be22fe2b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 04:06:21.892501 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-ee6acf10-5ce7-4470-8923-71e9be22fe2b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 04:06:21.892921 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-ee6acf10-5ce7-4470-8923-71e9be22fe2b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 04:06:21.893349 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-ee6acf10-5ce7-4470-8923-71e9be22fe2b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 04:06:21.902694 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ee6acf10-5ce7-4470-8923-71e9be22fe2b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:21.903194 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ee6acf10-5ce7-4470-8923-71e9be22fe2b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:21.903676 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ee6acf10-5ce7-4470-8923-71e9be22fe2b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:21.904425 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ee6acf10-5ce7-4470-8923-71e9be22fe2b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:21.905428 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ee6acf10-5ce7-4470-8923-71e9be22fe2b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:21.905866 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ee6acf10-5ce7-4470-8923-71e9be22fe2b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:21.923636 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-ee6acf10-5ce7-4470-8923-71e9be22fe2b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Getting quotas for project 6a6a4f0161c94dc19682d70af00ba684. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 04:06:21.928910 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-ee6acf10-5ce7-4470-8923-71e9be22fe2b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Getting quotas for user b7f5c179e8844542bca46d76042a6897 and project 6a6a4f0161c94dc19682d70af00ba684. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 04:06:21.990250 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ee6acf10-5ce7-4470-8923-71e9be22fe2b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 04:06:21.992405 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ee6acf10-5ce7-4470-8923-71e9be22fe2b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 4b022b95-f548-4374-99c1-2d2dad222ed6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='680d454e-c137-40cf-a253-bee22f6c4420',volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 04:06:22.469647 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ee6acf10-5ce7-4470-8923-71e9be22fe2b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.062190 Oct 27 04:06:22.482417 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f5e3e785-c867-4e45-83e0-39538d994012 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:06:22.483723 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f5e3e785-c867-4e45-83e0-39538d994012 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 4b022b95-f548-4374-99c1-2d2dad222ed6] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:06:22.515323 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3257/6799] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 04:06:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1098 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 04:06:22.590301 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f5e3e785-c867-4e45-83e0-39538d994012 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:06:22.606690 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f5e3e785-c867-4e45-83e0-39538d994012 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/4b022b95-f548-4374-99c1-2d2dad222ed6" status: 200 len: 1057 microversion: 2.1 time: 0.128668 Oct 27 04:06:22.608017 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3543/6800] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:06:22 2022] GET /compute/v2.1/servers/4b022b95-f548-4374-99c1-2d2dad222ed6 => generated 1057 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 04:06:23.633580 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ec444e7f-5f70-4b45-81ba-a8e75cb1c5ce tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:06:23.635615 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ec444e7f-5f70-4b45-81ba-a8e75cb1c5ce tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 4b022b95-f548-4374-99c1-2d2dad222ed6] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:06:23.641542 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ec444e7f-5f70-4b45-81ba-a8e75cb1c5ce tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:23.642123 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ec444e7f-5f70-4b45-81ba-a8e75cb1c5ce tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:23.642567 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ec444e7f-5f70-4b45-81ba-a8e75cb1c5ce tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:23.643396 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ec444e7f-5f70-4b45-81ba-a8e75cb1c5ce tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:23.643918 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ec444e7f-5f70-4b45-81ba-a8e75cb1c5ce tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:23.644414 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ec444e7f-5f70-4b45-81ba-a8e75cb1c5ce tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:23.709388 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ec444e7f-5f70-4b45-81ba-a8e75cb1c5ce tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:06:23.719087 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ec444e7f-5f70-4b45-81ba-a8e75cb1c5ce tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/4b022b95-f548-4374-99c1-2d2dad222ed6" status: 200 len: 1107 microversion: 2.1 time: 0.089537 Oct 27 04:06:23.719734 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3258/6801] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:06:23 2022] GET /compute/v2.1/servers/4b022b95-f548-4374-99c1-2d2dad222ed6 => generated 1107 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:06:24.743994 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-72b862b3-b415-4ea6-8b3b-83b9a7c1b4d0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:06:24.745135 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-72b862b3-b415-4ea6-8b3b-83b9a7c1b4d0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 4b022b95-f548-4374-99c1-2d2dad222ed6] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:06:24.753345 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-72b862b3-b415-4ea6-8b3b-83b9a7c1b4d0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:24.754024 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-72b862b3-b415-4ea6-8b3b-83b9a7c1b4d0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:24.754505 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-72b862b3-b415-4ea6-8b3b-83b9a7c1b4d0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:24.755215 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-72b862b3-b415-4ea6-8b3b-83b9a7c1b4d0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:24.755675 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-72b862b3-b415-4ea6-8b3b-83b9a7c1b4d0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:24.763140 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-72b862b3-b415-4ea6-8b3b-83b9a7c1b4d0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:24.823014 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-72b862b3-b415-4ea6-8b3b-83b9a7c1b4d0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:06:24.831462 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-72b862b3-b415-4ea6-8b3b-83b9a7c1b4d0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/4b022b95-f548-4374-99c1-2d2dad222ed6" status: 200 len: 1155 microversion: 2.1 time: 0.093383 Oct 27 04:06:24.832078 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3544/6802] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:06:24 2022] GET /compute/v2.1/servers/4b022b95-f548-4374-99c1-2d2dad222ed6 => generated 1155 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:06:25.857159 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5c62336f-db83-41aa-adcd-f66e9fc8f845 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:06:25.857943 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5c62336f-db83-41aa-adcd-f66e9fc8f845 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 4b022b95-f548-4374-99c1-2d2dad222ed6] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:06:25.866606 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5c62336f-db83-41aa-adcd-f66e9fc8f845 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:25.875288 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5c62336f-db83-41aa-adcd-f66e9fc8f845 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:25.875802 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5c62336f-db83-41aa-adcd-f66e9fc8f845 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:25.877526 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5c62336f-db83-41aa-adcd-f66e9fc8f845 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:25.878187 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5c62336f-db83-41aa-adcd-f66e9fc8f845 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:25.878526 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5c62336f-db83-41aa-adcd-f66e9fc8f845 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:26.131184 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5c62336f-db83-41aa-adcd-f66e9fc8f845 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:06:26.150198 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5c62336f-db83-41aa-adcd-f66e9fc8f845 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/4b022b95-f548-4374-99c1-2d2dad222ed6" status: 200 len: 1215 microversion: 2.1 time: 0.297848 Oct 27 04:06:26.151254 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3259/6803] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:06:25 2022] GET /compute/v2.1/servers/4b022b95-f548-4374-99c1-2d2dad222ed6 => generated 1215 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:06:26.879726 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-3385b869-ca58-425c-aba1-128a98a51fd5 req-1295ac18-bff4-4f2d-9c7c-0abd882fc256 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b022b95-f548-4374-99c1-2d2dad222ed6", "tag": "7300100a-deb3-4444-80f1-3d31c0a282fb"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:06:26.896382 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-3385b869-ca58-425c-aba1-128a98a51fd5 req-1295ac18-bff4-4f2d-9c7c-0abd882fc256 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:26.897171 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-3385b869-ca58-425c-aba1-128a98a51fd5 req-1295ac18-bff4-4f2d-9c7c-0abd882fc256 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:26.897858 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-3385b869-ca58-425c-aba1-128a98a51fd5 req-1295ac18-bff4-4f2d-9c7c-0abd882fc256 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:26.911667 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-3385b869-ca58-425c-aba1-128a98a51fd5 req-1295ac18-bff4-4f2d-9c7c-0abd882fc256 service nova] Creating event network-changed:7300100a-deb3-4444-80f1-3d31c0a282fb for instance 4b022b95-f548-4374-99c1-2d2dad222ed6 on n-h1-862769-1 Oct 27 04:06:26.921126 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-3385b869-ca58-425c-aba1-128a98a51fd5 req-1295ac18-bff4-4f2d-9c7c-0abd882fc256 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044729 Oct 27 04:06:26.921860 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3545/6804] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:06:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:06:27.175335 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-bebf83f1-2fcf-45b3-bd39-491dfbb91a9f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:06:27.175881 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-bebf83f1-2fcf-45b3-bd39-491dfbb91a9f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 4b022b95-f548-4374-99c1-2d2dad222ed6] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:06:27.183652 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bebf83f1-2fcf-45b3-bd39-491dfbb91a9f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:27.184537 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bebf83f1-2fcf-45b3-bd39-491dfbb91a9f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:27.185209 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bebf83f1-2fcf-45b3-bd39-491dfbb91a9f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:27.186316 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bebf83f1-2fcf-45b3-bd39-491dfbb91a9f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:27.187015 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bebf83f1-2fcf-45b3-bd39-491dfbb91a9f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:27.190407 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bebf83f1-2fcf-45b3-bd39-491dfbb91a9f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:27.814857 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-bebf83f1-2fcf-45b3-bd39-491dfbb91a9f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:06:27.823363 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-bebf83f1-2fcf-45b3-bd39-491dfbb91a9f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/4b022b95-f548-4374-99c1-2d2dad222ed6" status: 200 len: 1215 microversion: 2.1 time: 0.651680 Oct 27 04:06:27.824195 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3260/6805] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:06:27 2022] GET /compute/v2.1/servers/4b022b95-f548-4374-99c1-2d2dad222ed6 => generated 1215 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:06:28.849421 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-fd58f42e-dd26-45e1-8f67-f3e75c7d7128 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:06:28.850424 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-fd58f42e-dd26-45e1-8f67-f3e75c7d7128 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 4b022b95-f548-4374-99c1-2d2dad222ed6] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:06:28.857001 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fd58f42e-dd26-45e1-8f67-f3e75c7d7128 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:28.857557 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fd58f42e-dd26-45e1-8f67-f3e75c7d7128 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:28.858016 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fd58f42e-dd26-45e1-8f67-f3e75c7d7128 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:28.858747 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fd58f42e-dd26-45e1-8f67-f3e75c7d7128 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:28.859208 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fd58f42e-dd26-45e1-8f67-f3e75c7d7128 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:28.859638 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fd58f42e-dd26-45e1-8f67-f3e75c7d7128 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:29.000394 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-fd58f42e-dd26-45e1-8f67-f3e75c7d7128 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:06:29.009782 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-fd58f42e-dd26-45e1-8f67-f3e75c7d7128 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/4b022b95-f548-4374-99c1-2d2dad222ed6" status: 200 len: 1215 microversion: 2.1 time: 0.166003 Oct 27 04:06:29.010630 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3546/6806] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:06:28 2022] GET /compute/v2.1/servers/4b022b95-f548-4374-99c1-2d2dad222ed6 => generated 1215 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:06:30.037796 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7429562f-e22b-4839-8750-efb9aa27aa8f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:06:30.038619 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7429562f-e22b-4839-8750-efb9aa27aa8f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 4b022b95-f548-4374-99c1-2d2dad222ed6] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:06:30.046690 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7429562f-e22b-4839-8750-efb9aa27aa8f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:30.047186 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7429562f-e22b-4839-8750-efb9aa27aa8f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:30.047623 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7429562f-e22b-4839-8750-efb9aa27aa8f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:30.048326 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7429562f-e22b-4839-8750-efb9aa27aa8f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:30.049119 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7429562f-e22b-4839-8750-efb9aa27aa8f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:30.049547 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7429562f-e22b-4839-8750-efb9aa27aa8f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:30.220949 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7429562f-e22b-4839-8750-efb9aa27aa8f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:06:30.230613 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7429562f-e22b-4839-8750-efb9aa27aa8f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/4b022b95-f548-4374-99c1-2d2dad222ed6" status: 200 len: 1215 microversion: 2.1 time: 0.201553 Oct 27 04:06:30.238083 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3261/6807] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:06:30 2022] GET /compute/v2.1/servers/4b022b95-f548-4374-99c1-2d2dad222ed6 => generated 1215 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:06:31.253331 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-47b780b6-e81b-419d-aa8a-2fca8051abb9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:06:31.253966 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-47b780b6-e81b-419d-aa8a-2fca8051abb9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 4b022b95-f548-4374-99c1-2d2dad222ed6] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:06:31.260664 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-47b780b6-e81b-419d-aa8a-2fca8051abb9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:31.261175 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-47b780b6-e81b-419d-aa8a-2fca8051abb9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:31.261839 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-47b780b6-e81b-419d-aa8a-2fca8051abb9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:31.262597 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-47b780b6-e81b-419d-aa8a-2fca8051abb9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:31.263238 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-47b780b6-e81b-419d-aa8a-2fca8051abb9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:31.263679 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-47b780b6-e81b-419d-aa8a-2fca8051abb9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:31.400767 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-47b780b6-e81b-419d-aa8a-2fca8051abb9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:06:31.414007 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-47b780b6-e81b-419d-aa8a-2fca8051abb9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/4b022b95-f548-4374-99c1-2d2dad222ed6" status: 200 len: 1215 microversion: 2.1 time: 0.164752 Oct 27 04:06:31.414643 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3547/6808] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:06:31 2022] GET /compute/v2.1/servers/4b022b95-f548-4374-99c1-2d2dad222ed6 => generated 1215 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:06:32.437129 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d6b1b941-4aa5-440f-9dcb-f9d5711cbdc4 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:06:32.437791 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d6b1b941-4aa5-440f-9dcb-f9d5711cbdc4 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 4b022b95-f548-4374-99c1-2d2dad222ed6] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:06:32.440708 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:06:32.441391 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=6 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:06:32.446476 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d6b1b941-4aa5-440f-9dcb-f9d5711cbdc4 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:32.446974 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d6b1b941-4aa5-440f-9dcb-f9d5711cbdc4 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:32.447416 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d6b1b941-4aa5-440f-9dcb-f9d5711cbdc4 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:32.448390 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d6b1b941-4aa5-440f-9dcb-f9d5711cbdc4 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:32.448848 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d6b1b941-4aa5-440f-9dcb-f9d5711cbdc4 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:32.449272 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d6b1b941-4aa5-440f-9dcb-f9d5711cbdc4 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:32.589026 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d6b1b941-4aa5-440f-9dcb-f9d5711cbdc4 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:06:32.597647 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d6b1b941-4aa5-440f-9dcb-f9d5711cbdc4 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/4b022b95-f548-4374-99c1-2d2dad222ed6" status: 200 len: 1203 microversion: 2.1 time: 0.164747 Oct 27 04:06:32.598296 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3262/6809] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:06:32 2022] GET /compute/v2.1/servers/4b022b95-f548-4374-99c1-2d2dad222ed6 => generated 1203 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:06:33.623926 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:06:33.628686 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-45a34f57-fda4-47c0-a027-d1203fb94d14 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:06:33.629311 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-45a34f57-fda4-47c0-a027-d1203fb94d14 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 4b022b95-f548-4374-99c1-2d2dad222ed6] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:06:33.635336 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-45a34f57-fda4-47c0-a027-d1203fb94d14 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:33.635833 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-45a34f57-fda4-47c0-a027-d1203fb94d14 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:33.636284 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-45a34f57-fda4-47c0-a027-d1203fb94d14 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:33.637014 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-45a34f57-fda4-47c0-a027-d1203fb94d14 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:33.637483 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-45a34f57-fda4-47c0-a027-d1203fb94d14 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:33.637919 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-45a34f57-fda4-47c0-a027-d1203fb94d14 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:33.774306 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-45a34f57-fda4-47c0-a027-d1203fb94d14 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:06:33.782512 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-45a34f57-fda4-47c0-a027-d1203fb94d14 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/4b022b95-f548-4374-99c1-2d2dad222ed6" status: 200 len: 1203 microversion: 2.1 time: 0.160317 Oct 27 04:06:33.783100 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3548/6810] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:06:33 2022] GET /compute/v2.1/servers/4b022b95-f548-4374-99c1-2d2dad222ed6 => generated 1203 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:06:34.805250 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9c29d1bd-09ee-4c91-a9a3-df3a4e48f34c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:06:34.805872 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9c29d1bd-09ee-4c91-a9a3-df3a4e48f34c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 4b022b95-f548-4374-99c1-2d2dad222ed6] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:06:34.814669 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9c29d1bd-09ee-4c91-a9a3-df3a4e48f34c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:34.815160 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9c29d1bd-09ee-4c91-a9a3-df3a4e48f34c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:34.815608 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9c29d1bd-09ee-4c91-a9a3-df3a4e48f34c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:34.816301 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9c29d1bd-09ee-4c91-a9a3-df3a4e48f34c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:34.818834 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9c29d1bd-09ee-4c91-a9a3-df3a4e48f34c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:34.818834 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9c29d1bd-09ee-4c91-a9a3-df3a4e48f34c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:34.967571 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9c29d1bd-09ee-4c91-a9a3-df3a4e48f34c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:06:34.974744 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9c29d1bd-09ee-4c91-a9a3-df3a4e48f34c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/4b022b95-f548-4374-99c1-2d2dad222ed6" status: 200 len: 1203 microversion: 2.1 time: 0.173514 Oct 27 04:06:34.975468 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3263/6811] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:06:34 2022] GET /compute/v2.1/servers/4b022b95-f548-4374-99c1-2d2dad222ed6 => generated 1203 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:06:35.997856 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-bca0cea4-6ec9-4b26-9512-92a968db1ff8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:06:35.998515 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-bca0cea4-6ec9-4b26-9512-92a968db1ff8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 4b022b95-f548-4374-99c1-2d2dad222ed6] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:06:36.006713 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bca0cea4-6ec9-4b26-9512-92a968db1ff8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:36.011585 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bca0cea4-6ec9-4b26-9512-92a968db1ff8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:36.011585 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bca0cea4-6ec9-4b26-9512-92a968db1ff8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:36.011585 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bca0cea4-6ec9-4b26-9512-92a968db1ff8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:36.011585 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bca0cea4-6ec9-4b26-9512-92a968db1ff8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:36.011585 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bca0cea4-6ec9-4b26-9512-92a968db1ff8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:36.143291 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-bca0cea4-6ec9-4b26-9512-92a968db1ff8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:06:36.151793 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-bca0cea4-6ec9-4b26-9512-92a968db1ff8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/4b022b95-f548-4374-99c1-2d2dad222ed6" status: 200 len: 1203 microversion: 2.1 time: 0.157991 Oct 27 04:06:36.152381 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3549/6812] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:06:35 2022] GET /compute/v2.1/servers/4b022b95-f548-4374-99c1-2d2dad222ed6 => generated 1203 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:06:37.176570 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-62dc19e0-62d9-4fae-89dc-2149d1484f56 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:06:37.177168 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-62dc19e0-62d9-4fae-89dc-2149d1484f56 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 4b022b95-f548-4374-99c1-2d2dad222ed6] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:06:37.184699 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-62dc19e0-62d9-4fae-89dc-2149d1484f56 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:37.185192 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-62dc19e0-62d9-4fae-89dc-2149d1484f56 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:37.185631 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-62dc19e0-62d9-4fae-89dc-2149d1484f56 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:37.186995 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-62dc19e0-62d9-4fae-89dc-2149d1484f56 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:37.187459 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-62dc19e0-62d9-4fae-89dc-2149d1484f56 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:37.188525 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-62dc19e0-62d9-4fae-89dc-2149d1484f56 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:37.337140 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-62dc19e0-62d9-4fae-89dc-2149d1484f56 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:06:37.345003 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-62dc19e0-62d9-4fae-89dc-2149d1484f56 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/4b022b95-f548-4374-99c1-2d2dad222ed6" status: 200 len: 1203 microversion: 2.1 time: 0.173001 Oct 27 04:06:37.345580 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3264/6813] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:06:37 2022] GET /compute/v2.1/servers/4b022b95-f548-4374-99c1-2d2dad222ed6 => generated 1203 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:06:38.369583 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-bc15203d-cf9f-470f-b44e-c3671b433f57 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:06:38.370279 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-bc15203d-cf9f-470f-b44e-c3671b433f57 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 4b022b95-f548-4374-99c1-2d2dad222ed6] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:06:38.377560 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bc15203d-cf9f-470f-b44e-c3671b433f57 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:38.378124 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bc15203d-cf9f-470f-b44e-c3671b433f57 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:38.378599 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bc15203d-cf9f-470f-b44e-c3671b433f57 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:38.379311 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bc15203d-cf9f-470f-b44e-c3671b433f57 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:38.379810 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bc15203d-cf9f-470f-b44e-c3671b433f57 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:38.380215 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bc15203d-cf9f-470f-b44e-c3671b433f57 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:38.513599 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-bc15203d-cf9f-470f-b44e-c3671b433f57 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:06:38.521989 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-bc15203d-cf9f-470f-b44e-c3671b433f57 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/4b022b95-f548-4374-99c1-2d2dad222ed6" status: 200 len: 1203 microversion: 2.1 time: 0.157180 Oct 27 04:06:38.526508 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3550/6814] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:06:38 2022] GET /compute/v2.1/servers/4b022b95-f548-4374-99c1-2d2dad222ed6 => generated 1203 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:06:39.544943 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4d40feb7-4309-4d8a-956d-49037a58b78d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:06:39.545589 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4d40feb7-4309-4d8a-956d-49037a58b78d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 4b022b95-f548-4374-99c1-2d2dad222ed6] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:06:39.553256 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4d40feb7-4309-4d8a-956d-49037a58b78d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:39.553669 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4d40feb7-4309-4d8a-956d-49037a58b78d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:39.554178 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4d40feb7-4309-4d8a-956d-49037a58b78d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:39.554855 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4d40feb7-4309-4d8a-956d-49037a58b78d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:39.555316 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4d40feb7-4309-4d8a-956d-49037a58b78d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:39.555751 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4d40feb7-4309-4d8a-956d-49037a58b78d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:39.694519 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4d40feb7-4309-4d8a-956d-49037a58b78d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:06:39.702813 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4d40feb7-4309-4d8a-956d-49037a58b78d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/4b022b95-f548-4374-99c1-2d2dad222ed6" status: 200 len: 1203 microversion: 2.1 time: 0.161792 Oct 27 04:06:39.703433 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3265/6815] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:06:39 2022] GET /compute/v2.1/servers/4b022b95-f548-4374-99c1-2d2dad222ed6 => generated 1203 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:06:40.726811 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f9907d5e-1213-4aff-b220-81bc5011db50 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:06:40.731983 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f9907d5e-1213-4aff-b220-81bc5011db50 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 4b022b95-f548-4374-99c1-2d2dad222ed6] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:06:40.736262 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f9907d5e-1213-4aff-b220-81bc5011db50 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:40.737171 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f9907d5e-1213-4aff-b220-81bc5011db50 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:40.737615 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f9907d5e-1213-4aff-b220-81bc5011db50 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:40.738370 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f9907d5e-1213-4aff-b220-81bc5011db50 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:40.739680 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f9907d5e-1213-4aff-b220-81bc5011db50 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:40.739680 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f9907d5e-1213-4aff-b220-81bc5011db50 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:40.880939 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f9907d5e-1213-4aff-b220-81bc5011db50 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:06:40.888893 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f9907d5e-1213-4aff-b220-81bc5011db50 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/4b022b95-f548-4374-99c1-2d2dad222ed6" status: 200 len: 1203 microversion: 2.1 time: 0.167826 Oct 27 04:06:40.889482 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3551/6816] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:06:40 2022] GET /compute/v2.1/servers/4b022b95-f548-4374-99c1-2d2dad222ed6 => generated 1203 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:06:41.767898 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-24654743-3484-4915-895e-f2b3830ab15c tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:06:41.769758 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-24654743-3484-4915-895e-f2b3830ab15c tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] [instance: 296dbea5-186c-4051-b5bd-88cb39abffbd] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:06:41.777438 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-24654743-3484-4915-895e-f2b3830ab15c tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:41.777932 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-24654743-3484-4915-895e-f2b3830ab15c tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:41.778449 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-24654743-3484-4915-895e-f2b3830ab15c tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:41.779161 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-24654743-3484-4915-895e-f2b3830ab15c tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:41.779619 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-24654743-3484-4915-895e-f2b3830ab15c tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:41.780052 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-24654743-3484-4915-895e-f2b3830ab15c tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:41.807924 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-24654743-3484-4915-895e-f2b3830ab15c tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] [instance: 296dbea5-186c-4051-b5bd-88cb39abffbd] Going to try to terminate instance {{(pid=121000) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 04:06:41.912068 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-198b4c49-2443-445c-b49b-536c7c244eb2 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:06:41.912616 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-198b4c49-2443-445c-b49b-536c7c244eb2 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 4b022b95-f548-4374-99c1-2d2dad222ed6] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:06:41.919765 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-198b4c49-2443-445c-b49b-536c7c244eb2 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:41.920262 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-198b4c49-2443-445c-b49b-536c7c244eb2 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:41.920706 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-198b4c49-2443-445c-b49b-536c7c244eb2 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:41.921410 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-198b4c49-2443-445c-b49b-536c7c244eb2 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:41.921901 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-198b4c49-2443-445c-b49b-536c7c244eb2 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:41.922384 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-198b4c49-2443-445c-b49b-536c7c244eb2 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:42.078816 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-198b4c49-2443-445c-b49b-536c7c244eb2 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:06:42.087616 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-198b4c49-2443-445c-b49b-536c7c244eb2 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/4b022b95-f548-4374-99c1-2d2dad222ed6" status: 200 len: 1203 microversion: 2.1 time: 0.179780 Oct 27 04:06:42.090170 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3552/6817] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:06:41 2022] GET /compute/v2.1/servers/4b022b95-f548-4374-99c1-2d2dad222ed6 => generated 1203 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 04:06:42.139496 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-24654743-3484-4915-895e-f2b3830ab15c tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] 10.222.0.20 "DELETE /compute/v2.1/servers/296dbea5-186c-4051-b5bd-88cb39abffbd" status: 204 len: 0 microversion: 2.1 time: 0.554499 Oct 27 04:06:42.140115 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3266/6818] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 04:06:41 2022] DELETE /compute/v2.1/servers/296dbea5-186c-4051-b5bd-88cb39abffbd => generated 0 bytes in 556 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 04:06:42.148768 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b21e0c64-7753-4f69-81c3-bb05b80faa37 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:06:42.149489 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b21e0c64-7753-4f69-81c3-bb05b80faa37 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] [instance: 296dbea5-186c-4051-b5bd-88cb39abffbd] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:06:42.156750 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b21e0c64-7753-4f69-81c3-bb05b80faa37 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:42.157334 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b21e0c64-7753-4f69-81c3-bb05b80faa37 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:42.157849 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b21e0c64-7753-4f69-81c3-bb05b80faa37 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:42.159743 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b21e0c64-7753-4f69-81c3-bb05b80faa37 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:42.160283 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b21e0c64-7753-4f69-81c3-bb05b80faa37 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:42.160788 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b21e0c64-7753-4f69-81c3-bb05b80faa37 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:42.332049 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b21e0c64-7753-4f69-81c3-bb05b80faa37 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ee3a8fd93c4ad8b83c7e4ef94f4c8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '586d194e60ee461197b124db7501f8be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:06:42.340777 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b21e0c64-7753-4f69-81c3-bb05b80faa37 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] 10.222.0.20 "GET /compute/v2.1/servers/296dbea5-186c-4051-b5bd-88cb39abffbd" status: 200 len: 1734 microversion: 2.1 time: 0.196295 Oct 27 04:06:42.341433 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3553/6819] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:06:42 2022] GET /compute/v2.1/servers/296dbea5-186c-4051-b5bd-88cb39abffbd => generated 1734 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:06:42.447323 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-85be8215-ca83-4014-98dd-df89cbec6bf9 req-4239be68-54fb-4a65-86ea-9305b4f02392 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b022b95-f548-4374-99c1-2d2dad222ed6", "name": "network-vif-plugged", "status": "completed", "tag": "7300100a-deb3-4444-80f1-3d31c0a282fb"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:06:42.458316 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-85be8215-ca83-4014-98dd-df89cbec6bf9 req-4239be68-54fb-4a65-86ea-9305b4f02392 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:42.461389 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-85be8215-ca83-4014-98dd-df89cbec6bf9 req-4239be68-54fb-4a65-86ea-9305b4f02392 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:42.461389 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-85be8215-ca83-4014-98dd-df89cbec6bf9 req-4239be68-54fb-4a65-86ea-9305b4f02392 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:42.473710 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-85be8215-ca83-4014-98dd-df89cbec6bf9 req-4239be68-54fb-4a65-86ea-9305b4f02392 service nova] Creating event network-vif-plugged:7300100a-deb3-4444-80f1-3d31c0a282fb for instance 4b022b95-f548-4374-99c1-2d2dad222ed6 on n-h1-862769-1 Oct 27 04:06:42.478888 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-85be8215-ca83-4014-98dd-df89cbec6bf9 req-4239be68-54fb-4a65-86ea-9305b4f02392 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035964 Oct 27 04:06:42.479816 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3267/6820] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:06:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:06:43.112446 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7e228711-f391-4497-bfc7-afc349779b6b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:06:43.113155 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7e228711-f391-4497-bfc7-afc349779b6b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 4b022b95-f548-4374-99c1-2d2dad222ed6] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:06:43.120468 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7e228711-f391-4497-bfc7-afc349779b6b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:43.120970 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7e228711-f391-4497-bfc7-afc349779b6b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:43.121425 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7e228711-f391-4497-bfc7-afc349779b6b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:43.122185 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7e228711-f391-4497-bfc7-afc349779b6b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:43.122649 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7e228711-f391-4497-bfc7-afc349779b6b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:43.123085 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7e228711-f391-4497-bfc7-afc349779b6b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:43.256643 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7e228711-f391-4497-bfc7-afc349779b6b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:06:43.264704 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7e228711-f391-4497-bfc7-afc349779b6b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/4b022b95-f548-4374-99c1-2d2dad222ed6" status: 200 len: 1203 microversion: 2.1 time: 0.156852 Oct 27 04:06:43.265293 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3554/6821] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:06:43 2022] GET /compute/v2.1/servers/4b022b95-f548-4374-99c1-2d2dad222ed6 => generated 1203 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:06:43.366540 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3a27558e-3de0-411b-8d96-287e336dced2 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:06:43.367302 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-3a27558e-3de0-411b-8d96-287e336dced2 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] [instance: 296dbea5-186c-4051-b5bd-88cb39abffbd] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:06:43.374826 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3a27558e-3de0-411b-8d96-287e336dced2 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:43.375319 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3a27558e-3de0-411b-8d96-287e336dced2 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:43.375764 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3a27558e-3de0-411b-8d96-287e336dced2 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:43.376559 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3a27558e-3de0-411b-8d96-287e336dced2 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:43.377706 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3a27558e-3de0-411b-8d96-287e336dced2 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:43.378285 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3a27558e-3de0-411b-8d96-287e336dced2 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:43.383675 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:06:43.534746 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-3a27558e-3de0-411b-8d96-287e336dced2 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ee3a8fd93c4ad8b83c7e4ef94f4c8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '586d194e60ee461197b124db7501f8be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:06:43.542188 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3a27558e-3de0-411b-8d96-287e336dced2 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] 10.222.0.20 "GET /compute/v2.1/servers/296dbea5-186c-4051-b5bd-88cb39abffbd" status: 200 len: 1734 microversion: 2.1 time: 0.180845 Oct 27 04:06:43.542795 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3268/6822] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:06:43 2022] GET /compute/v2.1/servers/296dbea5-186c-4051-b5bd-88cb39abffbd => generated 1734 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:06:44.287533 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4a00a07f-3808-4ef8-b5b7-cdb84b401aa3 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:06:44.288295 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4a00a07f-3808-4ef8-b5b7-cdb84b401aa3 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 4b022b95-f548-4374-99c1-2d2dad222ed6] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:06:44.295340 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4a00a07f-3808-4ef8-b5b7-cdb84b401aa3 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:44.295836 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4a00a07f-3808-4ef8-b5b7-cdb84b401aa3 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:44.296286 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4a00a07f-3808-4ef8-b5b7-cdb84b401aa3 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:44.297004 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4a00a07f-3808-4ef8-b5b7-cdb84b401aa3 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:44.297461 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4a00a07f-3808-4ef8-b5b7-cdb84b401aa3 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:44.297899 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4a00a07f-3808-4ef8-b5b7-cdb84b401aa3 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:44.441640 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4a00a07f-3808-4ef8-b5b7-cdb84b401aa3 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:06:44.449774 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4a00a07f-3808-4ef8-b5b7-cdb84b401aa3 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/4b022b95-f548-4374-99c1-2d2dad222ed6" status: 200 len: 1203 microversion: 2.1 time: 0.166353 Oct 27 04:06:44.450468 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3555/6823] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:06:44 2022] GET /compute/v2.1/servers/4b022b95-f548-4374-99c1-2d2dad222ed6 => generated 1203 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:06:44.568246 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9c3b73a0-a880-49aa-850e-206c23dfd0a7 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:06:44.568885 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9c3b73a0-a880-49aa-850e-206c23dfd0a7 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] [instance: 296dbea5-186c-4051-b5bd-88cb39abffbd] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:06:44.576352 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9c3b73a0-a880-49aa-850e-206c23dfd0a7 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:44.576841 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9c3b73a0-a880-49aa-850e-206c23dfd0a7 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:44.577280 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9c3b73a0-a880-49aa-850e-206c23dfd0a7 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:44.578064 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9c3b73a0-a880-49aa-850e-206c23dfd0a7 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:44.578727 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9c3b73a0-a880-49aa-850e-206c23dfd0a7 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:44.579159 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9c3b73a0-a880-49aa-850e-206c23dfd0a7 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:44.675834 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9c3b73a0-a880-49aa-850e-206c23dfd0a7 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ee3a8fd93c4ad8b83c7e4ef94f4c8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '586d194e60ee461197b124db7501f8be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:06:44.683218 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9c3b73a0-a880-49aa-850e-206c23dfd0a7 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] 10.222.0.20 "GET /compute/v2.1/servers/296dbea5-186c-4051-b5bd-88cb39abffbd" status: 200 len: 1666 microversion: 2.1 time: 0.119513 Oct 27 04:06:44.683983 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3269/6824] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:06:44 2022] GET /compute/v2.1/servers/296dbea5-186c-4051-b5bd-88cb39abffbd => generated 1666 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:06:44.803763 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-9c0955b6-d42b-40a4-8c51-d5194143186d req-21170ef9-4fcd-40c7-9148-33bb6e3cbb78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "296dbea5-186c-4051-b5bd-88cb39abffbd", "name": "network-vif-deleted", "tag": "f62a30b7-1bd5-45bc-a70e-28c54740fc84"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:06:44.814187 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-9c0955b6-d42b-40a4-8c51-d5194143186d req-21170ef9-4fcd-40c7-9148-33bb6e3cbb78 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:44.815550 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-9c0955b6-d42b-40a4-8c51-d5194143186d req-21170ef9-4fcd-40c7-9148-33bb6e3cbb78 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:44.816108 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-9c0955b6-d42b-40a4-8c51-d5194143186d req-21170ef9-4fcd-40c7-9148-33bb6e3cbb78 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:44.829721 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-9c0955b6-d42b-40a4-8c51-d5194143186d req-21170ef9-4fcd-40c7-9148-33bb6e3cbb78 service nova] Creating event network-vif-deleted:f62a30b7-1bd5-45bc-a70e-28c54740fc84 for instance 296dbea5-186c-4051-b5bd-88cb39abffbd on n-h1-862769-1 Oct 27 04:06:44.836673 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-9c0955b6-d42b-40a4-8c51-d5194143186d req-21170ef9-4fcd-40c7-9148-33bb6e3cbb78 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036959 Oct 27 04:06:44.837295 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3556/6825] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:06:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:06:45.475628 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3a872b6c-f92f-4b2e-b522-1c4a338725ea tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:06:45.477386 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-3a872b6c-f92f-4b2e-b522-1c4a338725ea tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 4b022b95-f548-4374-99c1-2d2dad222ed6] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:06:45.484932 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3a872b6c-f92f-4b2e-b522-1c4a338725ea tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:45.485445 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3a872b6c-f92f-4b2e-b522-1c4a338725ea tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:45.485893 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3a872b6c-f92f-4b2e-b522-1c4a338725ea tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:45.487163 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3a872b6c-f92f-4b2e-b522-1c4a338725ea tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:45.487633 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3a872b6c-f92f-4b2e-b522-1c4a338725ea tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:45.488104 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3a872b6c-f92f-4b2e-b522-1c4a338725ea tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:45.631736 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-3a872b6c-f92f-4b2e-b522-1c4a338725ea tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:06:45.640234 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3a872b6c-f92f-4b2e-b522-1c4a338725ea tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/4b022b95-f548-4374-99c1-2d2dad222ed6" status: 200 len: 1390 microversion: 2.1 time: 0.169162 Oct 27 04:06:45.640826 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3270/6826] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:06:45 2022] GET /compute/v2.1/servers/4b022b95-f548-4374-99c1-2d2dad222ed6 => generated 1390 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:06:45.664493 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0727a6fb-07e4-475e-bda5-d0d21eaa0085 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:06:45.665215 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0727a6fb-07e4-475e-bda5-d0d21eaa0085 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 4b022b95-f548-4374-99c1-2d2dad222ed6] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:06:45.673007 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0727a6fb-07e4-475e-bda5-d0d21eaa0085 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:45.673763 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0727a6fb-07e4-475e-bda5-d0d21eaa0085 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:45.675003 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0727a6fb-07e4-475e-bda5-d0d21eaa0085 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:45.687218 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0727a6fb-07e4-475e-bda5-d0d21eaa0085 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:45.687218 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0727a6fb-07e4-475e-bda5-d0d21eaa0085 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:45.687218 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0727a6fb-07e4-475e-bda5-d0d21eaa0085 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:45.709362 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e1b31088-fee2-4899-beea-0849dbaf2f07 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:06:45.710315 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e1b31088-fee2-4899-beea-0849dbaf2f07 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] [instance: 296dbea5-186c-4051-b5bd-88cb39abffbd] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:06:45.720991 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e1b31088-fee2-4899-beea-0849dbaf2f07 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:45.721556 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e1b31088-fee2-4899-beea-0849dbaf2f07 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:45.722262 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e1b31088-fee2-4899-beea-0849dbaf2f07 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:45.722986 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e1b31088-fee2-4899-beea-0849dbaf2f07 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:45.723494 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e1b31088-fee2-4899-beea-0849dbaf2f07 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:45.724721 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e1b31088-fee2-4899-beea-0849dbaf2f07 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:45.762942 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e1b31088-fee2-4899-beea-0849dbaf2f07 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:45.764312 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e1b31088-fee2-4899-beea-0849dbaf2f07 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:45.764759 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e1b31088-fee2-4899-beea-0849dbaf2f07 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:45.765215 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-e1b31088-fee2-4899-beea-0849dbaf2f07 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Lazy-loading 'fault' on Instance uuid 296dbea5-186c-4051-b5bd-88cb39abffbd {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 04:06:45.808021 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e1b31088-fee2-4899-beea-0849dbaf2f07 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ee3a8fd93c4ad8b83c7e4ef94f4c8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '586d194e60ee461197b124db7501f8be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:06:45.816542 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e1b31088-fee2-4899-beea-0849dbaf2f07 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] 10.222.0.20 "GET /compute/v2.1/servers/296dbea5-186c-4051-b5bd-88cb39abffbd" status: 200 len: 1389 microversion: 2.1 time: 0.112557 Oct 27 04:06:45.817923 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3271/6827] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:06:45 2022] GET /compute/v2.1/servers/296dbea5-186c-4051-b5bd-88cb39abffbd => generated 1389 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:06:45.840020 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0727a6fb-07e4-475e-bda5-d0d21eaa0085 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:06:45.848820 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0727a6fb-07e4-475e-bda5-d0d21eaa0085 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/4b022b95-f548-4374-99c1-2d2dad222ed6" status: 200 len: 1390 microversion: 2.1 time: 0.188730 Oct 27 04:06:45.849434 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3557/6828] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:06:45 2022] GET /compute/v2.1/servers/4b022b95-f548-4374-99c1-2d2dad222ed6 => generated 1390 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:06:45.874257 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-efc2ba07-e067-467c-ad57-cc2c7e0dacbc tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:06:45.874839 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-efc2ba07-e067-467c-ad57-cc2c7e0dacbc tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 4b022b95-f548-4374-99c1-2d2dad222ed6] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:06:45.881337 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-efc2ba07-e067-467c-ad57-cc2c7e0dacbc tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:45.881821 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-efc2ba07-e067-467c-ad57-cc2c7e0dacbc tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:45.882710 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-efc2ba07-e067-467c-ad57-cc2c7e0dacbc tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:45.883407 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-efc2ba07-e067-467c-ad57-cc2c7e0dacbc tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:45.883864 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-efc2ba07-e067-467c-ad57-cc2c7e0dacbc tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:45.884295 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-efc2ba07-e067-467c-ad57-cc2c7e0dacbc tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:46.020025 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-efc2ba07-e067-467c-ad57-cc2c7e0dacbc tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:06:46.029491 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-efc2ba07-e067-467c-ad57-cc2c7e0dacbc tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/4b022b95-f548-4374-99c1-2d2dad222ed6" status: 200 len: 1390 microversion: 2.1 time: 0.159162 Oct 27 04:06:46.043744 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3272/6829] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:06:45 2022] GET /compute/v2.1/servers/4b022b95-f548-4374-99c1-2d2dad222ed6 => generated 1390 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:06:46.053279 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-eed1d997-4552-4f89-8cac-9144b88f841e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:06:46.053825 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-eed1d997-4552-4f89-8cac-9144b88f841e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 4b022b95-f548-4374-99c1-2d2dad222ed6] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:06:46.060433 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eed1d997-4552-4f89-8cac-9144b88f841e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:46.061018 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eed1d997-4552-4f89-8cac-9144b88f841e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:46.061441 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eed1d997-4552-4f89-8cac-9144b88f841e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:46.062190 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eed1d997-4552-4f89-8cac-9144b88f841e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:46.062648 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eed1d997-4552-4f89-8cac-9144b88f841e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:46.072339 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eed1d997-4552-4f89-8cac-9144b88f841e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:46.080558 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:06:46.090532 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-eed1d997-4552-4f89-8cac-9144b88f841e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 4b022b95-f548-4374-99c1-2d2dad222ed6] Going to try to terminate instance {{(pid=121001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 04:06:46.375026 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=43 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:06:46.574201 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-eed1d997-4552-4f89-8cac-9144b88f841e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4b022b95-f548-4374-99c1-2d2dad222ed6" status: 204 len: 0 microversion: 2.1 time: 0.525490 Oct 27 04:06:46.574800 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3558/6830] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 04:06:46 2022] DELETE /compute/v2.1/servers/4b022b95-f548-4374-99c1-2d2dad222ed6 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 04:06:46.584264 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a0355298-4f5a-4684-a7bc-0823775e2113 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:06:46.584899 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a0355298-4f5a-4684-a7bc-0823775e2113 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 4b022b95-f548-4374-99c1-2d2dad222ed6] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:06:46.587772 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:06:46.592543 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a0355298-4f5a-4684-a7bc-0823775e2113 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:46.593032 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a0355298-4f5a-4684-a7bc-0823775e2113 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:46.593467 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a0355298-4f5a-4684-a7bc-0823775e2113 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:46.594207 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a0355298-4f5a-4684-a7bc-0823775e2113 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:46.594676 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a0355298-4f5a-4684-a7bc-0823775e2113 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:46.595105 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a0355298-4f5a-4684-a7bc-0823775e2113 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:46.729001 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a0355298-4f5a-4684-a7bc-0823775e2113 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:06:46.737133 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a0355298-4f5a-4684-a7bc-0823775e2113 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/4b022b95-f548-4374-99c1-2d2dad222ed6" status: 200 len: 1396 microversion: 2.1 time: 0.157389 Oct 27 04:06:46.737760 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3273/6831] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:06:46 2022] GET /compute/v2.1/servers/4b022b95-f548-4374-99c1-2d2dad222ed6 => generated 1396 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:06:46.841374 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1b0a4f03-99cb-4681-849b-4a228bb2ea8a tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:06:46.842750 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1b0a4f03-99cb-4681-849b-4a228bb2ea8a tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] [instance: 296dbea5-186c-4051-b5bd-88cb39abffbd] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:06:46.849345 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1b0a4f03-99cb-4681-849b-4a228bb2ea8a tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:46.849824 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1b0a4f03-99cb-4681-849b-4a228bb2ea8a tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:46.850317 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1b0a4f03-99cb-4681-849b-4a228bb2ea8a tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:46.851049 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1b0a4f03-99cb-4681-849b-4a228bb2ea8a tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:46.851716 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1b0a4f03-99cb-4681-849b-4a228bb2ea8a tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:46.852384 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1b0a4f03-99cb-4681-849b-4a228bb2ea8a tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:46.867048 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-1b0a4f03-99cb-4681-849b-4a228bb2ea8a tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] HTTP exception thrown: Instance 296dbea5-186c-4051-b5bd-88cb39abffbd could not be found. Oct 27 04:06:46.868705 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1b0a4f03-99cb-4681-849b-4a228bb2ea8a tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Request method failure captured: Oct 27 04:06:46.868705 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/296dbea5-186c-4051-b5bd-88cb39abffbd HTTP/1.1 Oct 27 04:06:46.868705 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 04:06:46.868705 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 04:06:46.868705 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 04:06:46.868705 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 04:06:46.868705 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 04:06:46.868705 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 04:06:46.868705 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 04:06:46.868705 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 04:06:46.868705 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWgKYECEduT0KNgdSYZd7kN-bd_0dHLrPa35oscVNKpIcc9MyGUolOOOk97cEsnOqkZHtCfbdxEDodtz6hs8cB1LT7UlZn5fjZL9g_EWxKu5xUNa2EkApZX7srcjfhuoPhzQHwepA7NjZqZXbNlel2rJ51VcOv9A2ub-pqfz5MVw8b2o Oct 27 04:06:46.868705 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 04:06:46.868705 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 04:06:46.868705 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 04:06:46.868705 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 04:06:46.868705 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 04:06:46.868705 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 04:06:46.868705 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 586d194e60ee461197b124db7501f8be Oct 27 04:06:46.868705 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-TestServerBasicOps-824279712 Oct 27 04:06:46.868705 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 04:06:46.868705 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 04:06:46.868705 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/586d194e60ee461197b124db7501f8be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/586d194e60ee461197b124db7501f8be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/586d194e60ee461197b124db7501f8be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_586d194e60ee461197b124db7501f8be"}]}] Oct 27 04:06:46.868705 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-TestServerBasicOps-824279712 Oct 27 04:06:46.868705 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 586d194e60ee461197b124db7501f8be Oct 27 04:06:46.868705 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-TestServerBasicOps-824279712 Oct 27 04:06:46.868705 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-TestServerBasicOps-824279712-project Oct 27 04:06:46.868705 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 04:06:46.868705 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 04:06:46.868705 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 25ee3a8fd93c4ad8b83c7e4ef94f4c8a Oct 27 04:06:46.868705 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-TestServerBasicOps-824279712-project Oct 27 04:06:46.868705 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 04:06:46.868705 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 296dbea5-186c-4051-b5bd-88cb39abffbd could not be found. Oct 27 04:06:46.868705 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '296dbea5-186c-4051-b5bd-88cb39abffbd'} Oct 27 04:06:46.868705 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 04:06:46.868705 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:06:46.868705 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 04:06:46.868705 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 04:06:46.868705 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 04:06:46.868705 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 04:06:46.868705 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 04:06:46.868705 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 04:06:46.868705 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 04:06:46.868705 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 04:06:46.868705 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 296dbea5-186c-4051-b5bd-88cb39abffbd could not be found. Oct 27 04:06:46.868705 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:06:46.868705 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:06:46.868705 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:06:46.868705 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:06:46.868705 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:06:46.868705 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:06:46.868705 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 04:06:46.868705 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 04:06:46.868705 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 04:06:46.868705 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 04:06:46.868705 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 04:06:46.868705 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 04:06:46.868705 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 04:06:46.868705 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 04:06:46.868705 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 04:06:46.868705 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 04:06:46.868705 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 296dbea5-186c-4051-b5bd-88cb39abffbd could not be found. Oct 27 04:06:46.868705 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:06:46.868705 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:06:46.868705 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:06:46.873977 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:06:46.873977 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:06:46.873977 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:06:46.873977 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 04:06:46.873977 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 04:06:46.873977 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 296dbea5-186c-4051-b5bd-88cb39abffbd could not be found. Oct 27 04:06:46.873977 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:06:46.873977 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1b0a4f03-99cb-4681-849b-4a228bb2ea8a tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Returning 404 to user: Instance 296dbea5-186c-4051-b5bd-88cb39abffbd could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 04:06:46.873977 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1b0a4f03-99cb-4681-849b-4a228bb2ea8a tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] 10.222.0.20 "GET /compute/v2.1/servers/296dbea5-186c-4051-b5bd-88cb39abffbd" status: 404 len: 111 microversion: 2.1 time: 0.033042 Oct 27 04:06:46.873977 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3559/6832] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:06:46 2022] GET /compute/v2.1/servers/296dbea5-186c-4051-b5bd-88cb39abffbd => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 04:06:47.435681 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-74647dd5-ec63-4977-a761-3367f74f854d tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:06:47.436200 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-74647dd5-ec63-4977-a761-3367f74f854d tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] [instance: 296dbea5-186c-4051-b5bd-88cb39abffbd] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:06:47.443016 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-74647dd5-ec63-4977-a761-3367f74f854d tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:47.443511 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-74647dd5-ec63-4977-a761-3367f74f854d tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:47.443963 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-74647dd5-ec63-4977-a761-3367f74f854d tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:47.445502 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-74647dd5-ec63-4977-a761-3367f74f854d tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:47.446069 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-74647dd5-ec63-4977-a761-3367f74f854d tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:47.446497 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-74647dd5-ec63-4977-a761-3367f74f854d tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:47.460684 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-74647dd5-ec63-4977-a761-3367f74f854d tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] HTTP exception thrown: Instance 296dbea5-186c-4051-b5bd-88cb39abffbd could not be found. Oct 27 04:06:47.462430 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-74647dd5-ec63-4977-a761-3367f74f854d tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Request method failure captured: Oct 27 04:06:47.462430 n-d-862769-1 devstack@n-api.service[121000]: request: DELETE /compute/v2.1/servers/296dbea5-186c-4051-b5bd-88cb39abffbd HTTP/1.1 Oct 27 04:06:47.462430 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 04:06:47.462430 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 04:06:47.462430 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 04:06:47.462430 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 04:06:47.462430 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 04:06:47.462430 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 04:06:47.462430 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 04:06:47.462430 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 04:06:47.462430 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWgKYECEduT0KNgdSYZd7kN-bd_0dHLrPa35oscVNKpIcc9MyGUolOOOk97cEsnOqkZHtCfbdxEDodtz6hs8cB1LT7UlZn5fjZL9g_EWxKu5xUNa2EkApZX7srcjfhuoPhzQHwepA7NjZqZXbNlel2rJ51VcOv9A2ub-pqfz5MVw8b2o Oct 27 04:06:47.462430 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 04:06:47.462430 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 04:06:47.462430 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 04:06:47.462430 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 04:06:47.462430 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 04:06:47.462430 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 04:06:47.462430 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 586d194e60ee461197b124db7501f8be Oct 27 04:06:47.462430 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-TestServerBasicOps-824279712 Oct 27 04:06:47.462430 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 04:06:47.462430 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 04:06:47.462430 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/586d194e60ee461197b124db7501f8be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/586d194e60ee461197b124db7501f8be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/586d194e60ee461197b124db7501f8be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_586d194e60ee461197b124db7501f8be"}]}] Oct 27 04:06:47.462430 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-TestServerBasicOps-824279712 Oct 27 04:06:47.462430 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 586d194e60ee461197b124db7501f8be Oct 27 04:06:47.462430 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-TestServerBasicOps-824279712 Oct 27 04:06:47.462430 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-TestServerBasicOps-824279712-project Oct 27 04:06:47.462430 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 04:06:47.462430 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 04:06:47.462430 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 25ee3a8fd93c4ad8b83c7e4ef94f4c8a Oct 27 04:06:47.462430 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-TestServerBasicOps-824279712-project Oct 27 04:06:47.462430 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 04:06:47.462430 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 296dbea5-186c-4051-b5bd-88cb39abffbd could not be found. Oct 27 04:06:47.462430 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '296dbea5-186c-4051-b5bd-88cb39abffbd'} Oct 27 04:06:47.462430 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 04:06:47.462430 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:06:47.462430 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 04:06:47.462430 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 04:06:47.462430 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 04:06:47.462430 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 04:06:47.462430 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 04:06:47.462430 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 04:06:47.462430 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 04:06:47.462430 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 04:06:47.462430 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 296dbea5-186c-4051-b5bd-88cb39abffbd could not be found. Oct 27 04:06:47.462430 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:06:47.462430 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:06:47.462430 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:06:47.462430 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:06:47.462430 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:06:47.462430 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:06:47.462430 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 04:06:47.462430 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 04:06:47.462430 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 04:06:47.462430 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 04:06:47.462430 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 04:06:47.462430 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 04:06:47.462430 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 04:06:47.462430 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 04:06:47.462430 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 04:06:47.462430 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 04:06:47.462430 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 04:06:47.462430 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 04:06:47.467508 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 296dbea5-186c-4051-b5bd-88cb39abffbd could not be found. Oct 27 04:06:47.467508 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:06:47.467508 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:06:47.467508 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:06:47.467508 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:06:47.467508 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:06:47.467508 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:06:47.467508 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 04:06:47.467508 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 04:06:47.467508 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 296dbea5-186c-4051-b5bd-88cb39abffbd could not be found. Oct 27 04:06:47.467508 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:06:47.467508 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-74647dd5-ec63-4977-a761-3367f74f854d tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Returning 404 to user: Instance 296dbea5-186c-4051-b5bd-88cb39abffbd could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 04:06:47.467508 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-74647dd5-ec63-4977-a761-3367f74f854d tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] 10.222.0.20 "DELETE /compute/v2.1/servers/296dbea5-186c-4051-b5bd-88cb39abffbd" status: 404 len: 111 microversion: 2.1 time: 0.032402 Oct 27 04:06:47.467508 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3274/6833] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 04:06:47 2022] DELETE /compute/v2.1/servers/296dbea5-186c-4051-b5bd-88cb39abffbd => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 04:06:47.473585 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a1c4d240-e739-481e-8e0f-41428c7d60f4 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:06:47.474290 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a1c4d240-e739-481e-8e0f-41428c7d60f4 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] [instance: 296dbea5-186c-4051-b5bd-88cb39abffbd] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:06:47.481114 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a1c4d240-e739-481e-8e0f-41428c7d60f4 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:47.481608 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a1c4d240-e739-481e-8e0f-41428c7d60f4 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:47.482077 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a1c4d240-e739-481e-8e0f-41428c7d60f4 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:47.482791 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a1c4d240-e739-481e-8e0f-41428c7d60f4 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:47.483261 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a1c4d240-e739-481e-8e0f-41428c7d60f4 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:47.483702 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a1c4d240-e739-481e-8e0f-41428c7d60f4 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:47.498892 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-a1c4d240-e739-481e-8e0f-41428c7d60f4 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] HTTP exception thrown: Instance 296dbea5-186c-4051-b5bd-88cb39abffbd could not be found. Oct 27 04:06:47.500453 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a1c4d240-e739-481e-8e0f-41428c7d60f4 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Request method failure captured: Oct 27 04:06:47.500453 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/296dbea5-186c-4051-b5bd-88cb39abffbd HTTP/1.1 Oct 27 04:06:47.500453 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 04:06:47.500453 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 04:06:47.500453 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 04:06:47.500453 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 04:06:47.500453 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 04:06:47.500453 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 04:06:47.500453 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 04:06:47.500453 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 04:06:47.500453 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWgKYECEduT0KNgdSYZd7kN-bd_0dHLrPa35oscVNKpIcc9MyGUolOOOk97cEsnOqkZHtCfbdxEDodtz6hs8cB1LT7UlZn5fjZL9g_EWxKu5xUNa2EkApZX7srcjfhuoPhzQHwepA7NjZqZXbNlel2rJ51VcOv9A2ub-pqfz5MVw8b2o Oct 27 04:06:47.500453 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 04:06:47.500453 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 04:06:47.500453 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 04:06:47.500453 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 04:06:47.500453 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 04:06:47.500453 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 04:06:47.500453 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 586d194e60ee461197b124db7501f8be Oct 27 04:06:47.500453 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-TestServerBasicOps-824279712 Oct 27 04:06:47.500453 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 04:06:47.500453 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 04:06:47.500453 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/586d194e60ee461197b124db7501f8be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/586d194e60ee461197b124db7501f8be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/586d194e60ee461197b124db7501f8be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_586d194e60ee461197b124db7501f8be"}]}] Oct 27 04:06:47.500453 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-TestServerBasicOps-824279712 Oct 27 04:06:47.500453 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 586d194e60ee461197b124db7501f8be Oct 27 04:06:47.500453 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-TestServerBasicOps-824279712 Oct 27 04:06:47.500453 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-TestServerBasicOps-824279712-project Oct 27 04:06:47.500453 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 04:06:47.500453 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 04:06:47.500453 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 25ee3a8fd93c4ad8b83c7e4ef94f4c8a Oct 27 04:06:47.500453 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-TestServerBasicOps-824279712-project Oct 27 04:06:47.500453 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 04:06:47.500453 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 296dbea5-186c-4051-b5bd-88cb39abffbd could not be found. Oct 27 04:06:47.500453 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '296dbea5-186c-4051-b5bd-88cb39abffbd'} Oct 27 04:06:47.500453 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 04:06:47.500453 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:06:47.500453 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 04:06:47.500453 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 04:06:47.500453 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 04:06:47.500453 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 04:06:47.500453 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 04:06:47.500453 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 04:06:47.500453 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 04:06:47.500453 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 04:06:47.500453 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 296dbea5-186c-4051-b5bd-88cb39abffbd could not be found. Oct 27 04:06:47.500453 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:06:47.500453 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:06:47.500453 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:06:47.500453 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:06:47.500453 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:06:47.500453 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:06:47.500453 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 04:06:47.500453 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 04:06:47.500453 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 04:06:47.500453 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 04:06:47.500453 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 04:06:47.500453 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 04:06:47.500453 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 04:06:47.500453 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 04:06:47.500453 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 04:06:47.500453 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 04:06:47.500453 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 296dbea5-186c-4051-b5bd-88cb39abffbd could not be found. Oct 27 04:06:47.500453 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:06:47.500453 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:06:47.500453 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:06:47.505846 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:06:47.505846 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:06:47.505846 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:06:47.505846 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 04:06:47.505846 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 04:06:47.505846 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 296dbea5-186c-4051-b5bd-88cb39abffbd could not be found. Oct 27 04:06:47.505846 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:06:47.505846 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a1c4d240-e739-481e-8e0f-41428c7d60f4 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Returning 404 to user: Instance 296dbea5-186c-4051-b5bd-88cb39abffbd could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 04:06:47.505846 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a1c4d240-e739-481e-8e0f-41428c7d60f4 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] 10.222.0.20 "GET /compute/v2.1/servers/296dbea5-186c-4051-b5bd-88cb39abffbd" status: 404 len: 111 microversion: 2.1 time: 0.032798 Oct 27 04:06:47.506616 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3560/6834] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:06:47 2022] GET /compute/v2.1/servers/296dbea5-186c-4051-b5bd-88cb39abffbd => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 04:06:47.756377 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c5c7f8a2-881a-4ba5-87e3-52c38babd3b1 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] Calling method '.version_select at 0x7f7dd9a0b430>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:06:47.763751 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f3c75be9-bd8a-467b-9a8f-223911957ce0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:06:47.764552 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f3c75be9-bd8a-467b-9a8f-223911957ce0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 4b022b95-f548-4374-99c1-2d2dad222ed6] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:06:47.779232 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f3c75be9-bd8a-467b-9a8f-223911957ce0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:47.780530 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f3c75be9-bd8a-467b-9a8f-223911957ce0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:47.784272 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f3c75be9-bd8a-467b-9a8f-223911957ce0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:47.784272 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f3c75be9-bd8a-467b-9a8f-223911957ce0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:47.784272 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f3c75be9-bd8a-467b-9a8f-223911957ce0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:47.784272 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f3c75be9-bd8a-467b-9a8f-223911957ce0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:47.896601 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c5c7f8a2-881a-4ba5-87e3-52c38babd3b1 tempest-TestServerBasicOps-824279712 tempest-TestServerBasicOps-824279712-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1354028845" status: 202 len: 0 microversion: 2.1 time: 0.144178 Oct 27 04:06:47.897126 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3275/6835] 10.222.0.20 () {58 vars in 1254 bytes} [Thu Oct 27 04:06:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1354028845 => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 04:06:47.933041 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f3c75be9-bd8a-467b-9a8f-223911957ce0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:06:47.936963 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f3c75be9-bd8a-467b-9a8f-223911957ce0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/4b022b95-f548-4374-99c1-2d2dad222ed6" status: 200 len: 1396 microversion: 2.1 time: 0.180145 Oct 27 04:06:47.937631 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3561/6836] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:06:47 2022] GET /compute/v2.1/servers/4b022b95-f548-4374-99c1-2d2dad222ed6 => generated 1396 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:06:48.961785 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-fdb15df3-197a-4117-affb-e810a5a0fcc7 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:06:48.962503 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-fdb15df3-197a-4117-affb-e810a5a0fcc7 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 4b022b95-f548-4374-99c1-2d2dad222ed6] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:06:48.970103 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fdb15df3-197a-4117-affb-e810a5a0fcc7 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:48.970620 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fdb15df3-197a-4117-affb-e810a5a0fcc7 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:48.971606 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fdb15df3-197a-4117-affb-e810a5a0fcc7 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:48.972337 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fdb15df3-197a-4117-affb-e810a5a0fcc7 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:48.972803 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fdb15df3-197a-4117-affb-e810a5a0fcc7 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:48.973239 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fdb15df3-197a-4117-affb-e810a5a0fcc7 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:49.273282 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-fdb15df3-197a-4117-affb-e810a5a0fcc7 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:06:49.281367 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-fdb15df3-197a-4117-affb-e810a5a0fcc7 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/4b022b95-f548-4374-99c1-2d2dad222ed6" status: 200 len: 1396 microversion: 2.1 time: 0.324229 Oct 27 04:06:49.281957 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3276/6837] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:06:48 2022] GET /compute/v2.1/servers/4b022b95-f548-4374-99c1-2d2dad222ed6 => generated 1396 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:06:49.458012 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-058d7b22-a71f-4e5b-aa76-6c82d7671520 req-c2ef1a68-c4d0-4f6e-99c0-089da66e5508 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b022b95-f548-4374-99c1-2d2dad222ed6", "name": "network-vif-deleted", "tag": "7300100a-deb3-4444-80f1-3d31c0a282fb"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:06:49.469421 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-058d7b22-a71f-4e5b-aa76-6c82d7671520 req-c2ef1a68-c4d0-4f6e-99c0-089da66e5508 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:49.469916 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-058d7b22-a71f-4e5b-aa76-6c82d7671520 req-c2ef1a68-c4d0-4f6e-99c0-089da66e5508 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:49.470621 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-058d7b22-a71f-4e5b-aa76-6c82d7671520 req-c2ef1a68-c4d0-4f6e-99c0-089da66e5508 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:49.483844 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-058d7b22-a71f-4e5b-aa76-6c82d7671520 req-c2ef1a68-c4d0-4f6e-99c0-089da66e5508 service nova] Creating event network-vif-deleted:7300100a-deb3-4444-80f1-3d31c0a282fb for instance 4b022b95-f548-4374-99c1-2d2dad222ed6 on n-h1-862769-1 Oct 27 04:06:49.489137 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-058d7b22-a71f-4e5b-aa76-6c82d7671520 req-c2ef1a68-c4d0-4f6e-99c0-089da66e5508 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038070 Oct 27 04:06:49.489762 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3562/6838] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:06:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 04:06:50.305515 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-afcf9bd3-8bd4-4fbd-93cb-93fc7420fd78 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:06:50.306905 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-afcf9bd3-8bd4-4fbd-93cb-93fc7420fd78 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 4b022b95-f548-4374-99c1-2d2dad222ed6] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:06:50.314593 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-afcf9bd3-8bd4-4fbd-93cb-93fc7420fd78 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:50.315692 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-afcf9bd3-8bd4-4fbd-93cb-93fc7420fd78 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:50.316418 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-afcf9bd3-8bd4-4fbd-93cb-93fc7420fd78 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:50.317391 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-afcf9bd3-8bd4-4fbd-93cb-93fc7420fd78 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:50.318104 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-afcf9bd3-8bd4-4fbd-93cb-93fc7420fd78 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:50.318754 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-afcf9bd3-8bd4-4fbd-93cb-93fc7420fd78 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:50.416313 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-afcf9bd3-8bd4-4fbd-93cb-93fc7420fd78 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:06:50.425909 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-afcf9bd3-8bd4-4fbd-93cb-93fc7420fd78 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/4b022b95-f548-4374-99c1-2d2dad222ed6" status: 200 len: 1188 microversion: 2.1 time: 0.124216 Oct 27 04:06:50.426882 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3277/6839] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:06:50 2022] GET /compute/v2.1/servers/4b022b95-f548-4374-99c1-2d2dad222ed6 => generated 1188 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 04:06:51.450751 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3202045d-d06d-4373-9e02-9c06d1874c5d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:06:51.451431 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3202045d-d06d-4373-9e02-9c06d1874c5d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 4b022b95-f548-4374-99c1-2d2dad222ed6] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:06:51.457998 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3202045d-d06d-4373-9e02-9c06d1874c5d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:51.458567 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3202045d-d06d-4373-9e02-9c06d1874c5d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:51.459016 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3202045d-d06d-4373-9e02-9c06d1874c5d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:51.459744 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3202045d-d06d-4373-9e02-9c06d1874c5d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:51.460200 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3202045d-d06d-4373-9e02-9c06d1874c5d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:51.460632 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3202045d-d06d-4373-9e02-9c06d1874c5d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:51.595251 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3202045d-d06d-4373-9e02-9c06d1874c5d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:06:51.604049 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3202045d-d06d-4373-9e02-9c06d1874c5d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/4b022b95-f548-4374-99c1-2d2dad222ed6" status: 200 len: 1188 microversion: 2.1 time: 0.158885 Oct 27 04:06:51.604950 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3563/6840] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:06:51 2022] GET /compute/v2.1/servers/4b022b95-f548-4374-99c1-2d2dad222ed6 => generated 1188 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:06:52.630958 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-eb4d2836-025c-40d7-b45e-59951abb20b2 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:06:52.632367 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-eb4d2836-025c-40d7-b45e-59951abb20b2 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 4b022b95-f548-4374-99c1-2d2dad222ed6] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:06:52.644757 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eb4d2836-025c-40d7-b45e-59951abb20b2 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:52.646277 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eb4d2836-025c-40d7-b45e-59951abb20b2 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:52.647092 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eb4d2836-025c-40d7-b45e-59951abb20b2 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:52.648504 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eb4d2836-025c-40d7-b45e-59951abb20b2 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:52.649154 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eb4d2836-025c-40d7-b45e-59951abb20b2 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:52.649791 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eb4d2836-025c-40d7-b45e-59951abb20b2 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:52.756581 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-eb4d2836-025c-40d7-b45e-59951abb20b2 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:06:52.765327 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-eb4d2836-025c-40d7-b45e-59951abb20b2 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/4b022b95-f548-4374-99c1-2d2dad222ed6" status: 200 len: 1188 microversion: 2.1 time: 0.140066 Oct 27 04:06:52.766769 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3278/6841] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:06:52 2022] GET /compute/v2.1/servers/4b022b95-f548-4374-99c1-2d2dad222ed6 => generated 1188 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:06:53.791413 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-300ec0d7-dfb3-4f6a-8a02-849873fc649c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:06:53.792129 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-300ec0d7-dfb3-4f6a-8a02-849873fc649c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 4b022b95-f548-4374-99c1-2d2dad222ed6] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:06:53.799559 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-300ec0d7-dfb3-4f6a-8a02-849873fc649c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:53.800114 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-300ec0d7-dfb3-4f6a-8a02-849873fc649c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:53.800767 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-300ec0d7-dfb3-4f6a-8a02-849873fc649c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:53.801490 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-300ec0d7-dfb3-4f6a-8a02-849873fc649c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:53.801955 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-300ec0d7-dfb3-4f6a-8a02-849873fc649c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:53.802419 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-300ec0d7-dfb3-4f6a-8a02-849873fc649c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:53.877256 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-300ec0d7-dfb3-4f6a-8a02-849873fc649c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:06:53.885348 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-300ec0d7-dfb3-4f6a-8a02-849873fc649c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/4b022b95-f548-4374-99c1-2d2dad222ed6" status: 200 len: 1188 microversion: 2.1 time: 0.097979 Oct 27 04:06:53.885933 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3564/6842] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:06:53 2022] GET /compute/v2.1/servers/4b022b95-f548-4374-99c1-2d2dad222ed6 => generated 1188 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:06:54.909557 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-19a7d531-04d0-4f8a-a753-4fda76f123b8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:06:54.910314 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-19a7d531-04d0-4f8a-a753-4fda76f123b8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 4b022b95-f548-4374-99c1-2d2dad222ed6] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:06:54.919550 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-19a7d531-04d0-4f8a-a753-4fda76f123b8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:54.920053 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-19a7d531-04d0-4f8a-a753-4fda76f123b8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:54.920574 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-19a7d531-04d0-4f8a-a753-4fda76f123b8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:54.921563 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-19a7d531-04d0-4f8a-a753-4fda76f123b8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:54.922051 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-19a7d531-04d0-4f8a-a753-4fda76f123b8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:54.922495 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-19a7d531-04d0-4f8a-a753-4fda76f123b8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:54.956359 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-19a7d531-04d0-4f8a-a753-4fda76f123b8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:54.956857 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-19a7d531-04d0-4f8a-a753-4fda76f123b8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:54.957300 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-19a7d531-04d0-4f8a-a753-4fda76f123b8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:54.957759 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-19a7d531-04d0-4f8a-a753-4fda76f123b8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lazy-loading 'fault' on Instance uuid 4b022b95-f548-4374-99c1-2d2dad222ed6 {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 04:06:55.009546 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-19a7d531-04d0-4f8a-a753-4fda76f123b8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:06:55.023314 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-19a7d531-04d0-4f8a-a753-4fda76f123b8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/4b022b95-f548-4374-99c1-2d2dad222ed6" status: 200 len: 1193 microversion: 2.1 time: 0.118207 Oct 27 04:06:55.023943 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3279/6843] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:06:54 2022] GET /compute/v2.1/servers/4b022b95-f548-4374-99c1-2d2dad222ed6 => generated 1193 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:06:56.051562 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-30cbd8bf-f686-4708-87a9-9547399bea97 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:06:56.052262 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-30cbd8bf-f686-4708-87a9-9547399bea97 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 4b022b95-f548-4374-99c1-2d2dad222ed6] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:06:56.059842 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-30cbd8bf-f686-4708-87a9-9547399bea97 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:56.060339 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-30cbd8bf-f686-4708-87a9-9547399bea97 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:56.060784 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-30cbd8bf-f686-4708-87a9-9547399bea97 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:56.061519 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-30cbd8bf-f686-4708-87a9-9547399bea97 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:56.061999 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-30cbd8bf-f686-4708-87a9-9547399bea97 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:56.062513 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-30cbd8bf-f686-4708-87a9-9547399bea97 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:56.078113 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-30cbd8bf-f686-4708-87a9-9547399bea97 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] HTTP exception thrown: Instance 4b022b95-f548-4374-99c1-2d2dad222ed6 could not be found. Oct 27 04:06:56.079999 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-30cbd8bf-f686-4708-87a9-9547399bea97 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Request method failure captured: Oct 27 04:06:56.079999 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/4b022b95-f548-4374-99c1-2d2dad222ed6 HTTP/1.1 Oct 27 04:06:56.079999 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 04:06:56.079999 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 04:06:56.079999 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 04:06:56.079999 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 04:06:56.079999 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 04:06:56.079999 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 04:06:56.079999 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 04:06:56.079999 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 04:06:56.079999 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWgOy2vyGIZvCPgeKqR-dxD7jsV8GSZftvWG3pi0psQTYPv81ATvFSgHi31EMgn0x5NItteNYikimeQ9zcCw_dYQg7rFsVn9VSH-YqZAmUJa-ncyxVumv4r6CMnFhSrRbs_K6XB3pjXRcA1nWSk0V8vccKKBeZUitsa2lCn2gYQAw5hI Oct 27 04:06:56.079999 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 04:06:56.079999 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 04:06:56.079999 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 04:06:56.079999 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 04:06:56.079999 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 04:06:56.079999 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 04:06:56.079999 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 6a6a4f0161c94dc19682d70af00ba684 Oct 27 04:06:56.079999 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-TestVolumeBootPattern-1489988074 Oct 27 04:06:56.079999 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 04:06:56.079999 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 04:06:56.079999 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6a6a4f0161c94dc19682d70af00ba684"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6a6a4f0161c94dc19682d70af00ba684"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6a6a4f0161c94dc19682d70af00ba684"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6a6a4f0161c94dc19682d70af00ba684"}]}] Oct 27 04:06:56.079999 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-TestVolumeBootPattern-1489988074 Oct 27 04:06:56.079999 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 6a6a4f0161c94dc19682d70af00ba684 Oct 27 04:06:56.079999 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-TestVolumeBootPattern-1489988074 Oct 27 04:06:56.079999 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-TestVolumeBootPattern-1489988074-project Oct 27 04:06:56.079999 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 04:06:56.079999 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 04:06:56.079999 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: b7f5c179e8844542bca46d76042a6897 Oct 27 04:06:56.079999 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-TestVolumeBootPattern-1489988074-project Oct 27 04:06:56.079999 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 04:06:56.079999 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 4b022b95-f548-4374-99c1-2d2dad222ed6 could not be found. Oct 27 04:06:56.079999 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '4b022b95-f548-4374-99c1-2d2dad222ed6'} Oct 27 04:06:56.079999 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 04:06:56.079999 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:06:56.079999 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 04:06:56.079999 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 04:06:56.079999 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 04:06:56.079999 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 04:06:56.079999 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 04:06:56.079999 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 04:06:56.079999 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 04:06:56.079999 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 04:06:56.079999 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b022b95-f548-4374-99c1-2d2dad222ed6 could not be found. Oct 27 04:06:56.079999 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:06:56.079999 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:06:56.079999 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:06:56.079999 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:06:56.079999 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:06:56.079999 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:06:56.079999 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 04:06:56.079999 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 04:06:56.079999 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 04:06:56.079999 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 04:06:56.079999 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 04:06:56.079999 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 04:06:56.079999 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 04:06:56.079999 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 04:06:56.079999 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 04:06:56.079999 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 04:06:56.079999 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b022b95-f548-4374-99c1-2d2dad222ed6 could not be found. Oct 27 04:06:56.079999 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:06:56.079999 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:06:56.079999 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:06:56.089166 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:06:56.089166 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:06:56.089166 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:06:56.089166 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 04:06:56.089166 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 04:06:56.089166 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b022b95-f548-4374-99c1-2d2dad222ed6 could not be found. Oct 27 04:06:56.089166 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:06:56.089166 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-30cbd8bf-f686-4708-87a9-9547399bea97 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Returning 404 to user: Instance 4b022b95-f548-4374-99c1-2d2dad222ed6 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 04:06:56.089166 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-30cbd8bf-f686-4708-87a9-9547399bea97 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/4b022b95-f548-4374-99c1-2d2dad222ed6" status: 404 len: 111 microversion: 2.1 time: 0.035012 Oct 27 04:06:56.089166 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3565/6844] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:06:56 2022] GET /compute/v2.1/servers/4b022b95-f548-4374-99c1-2d2dad222ed6 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 04:06:58.764901 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-92bb312e-aa76-4d1e-b116-9cd366f76945 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:06:58.772548 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-92bb312e-aa76-4d1e-b116-9cd366f76945 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] [instance: 7d470632-cd1e-4fa8-98dc-4250c3ed482e] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:06:58.786330 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-92bb312e-aa76-4d1e-b116-9cd366f76945 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:58.792558 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-cec26ada-ec52-4eb8-8b62-65b7d3195d27 req-8ae75dbb-cef4-432e-b933-51942624ab98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d470632-cd1e-4fa8-98dc-4250c3ed482e", "tag": "dfce8b32-768c-4dce-a68b-237f1ff60963"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:06:58.797623 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-92bb312e-aa76-4d1e-b116-9cd366f76945 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:58.798585 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-92bb312e-aa76-4d1e-b116-9cd366f76945 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:58.799422 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-92bb312e-aa76-4d1e-b116-9cd366f76945 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:58.800069 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-92bb312e-aa76-4d1e-b116-9cd366f76945 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:58.800515 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-92bb312e-aa76-4d1e-b116-9cd366f76945 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:58.807182 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-cec26ada-ec52-4eb8-8b62-65b7d3195d27 req-8ae75dbb-cef4-432e-b933-51942624ab98 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:58.807708 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-cec26ada-ec52-4eb8-8b62-65b7d3195d27 req-8ae75dbb-cef4-432e-b933-51942624ab98 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:58.808153 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-cec26ada-ec52-4eb8-8b62-65b7d3195d27 req-8ae75dbb-cef4-432e-b933-51942624ab98 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:58.846720 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-cec26ada-ec52-4eb8-8b62-65b7d3195d27 req-8ae75dbb-cef4-432e-b933-51942624ab98 service nova] Creating event network-changed:dfce8b32-768c-4dce-a68b-237f1ff60963 for instance 7d470632-cd1e-4fa8-98dc-4250c3ed482e on n-h2-862769-1 Oct 27 04:06:58.850664 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-92bb312e-aa76-4d1e-b116-9cd366f76945 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] [instance: 7d470632-cd1e-4fa8-98dc-4250c3ed482e] Going to try to terminate instance {{(pid=121000) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 04:06:58.858607 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-cec26ada-ec52-4eb8-8b62-65b7d3195d27 req-8ae75dbb-cef4-432e-b933-51942624ab98 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070426 Oct 27 04:06:58.863790 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3566/6845] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:06:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:06:59.203053 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-92bb312e-aa76-4d1e-b116-9cd366f76945 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7d470632-cd1e-4fa8-98dc-4250c3ed482e" status: 204 len: 0 microversion: 2.1 time: 0.444377 Oct 27 04:06:59.204883 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3280/6846] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 04:06:58 2022] DELETE /compute/v2.1/servers/7d470632-cd1e-4fa8-98dc-4250c3ed482e => generated 0 bytes in 449 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 04:06:59.231902 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3a68d916-d87a-45cb-8ccc-7ba298f33976 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:06:59.232655 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3a68d916-d87a-45cb-8ccc-7ba298f33976 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] [instance: 7d470632-cd1e-4fa8-98dc-4250c3ed482e] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:06:59.255954 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3a68d916-d87a-45cb-8ccc-7ba298f33976 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:59.256535 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3a68d916-d87a-45cb-8ccc-7ba298f33976 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:59.257023 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3a68d916-d87a-45cb-8ccc-7ba298f33976 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:59.257952 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3a68d916-d87a-45cb-8ccc-7ba298f33976 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:06:59.258393 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3a68d916-d87a-45cb-8ccc-7ba298f33976 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:06:59.258835 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3a68d916-d87a-45cb-8ccc-7ba298f33976 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:06:59.467505 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3a68d916-d87a-45cb-8ccc-7ba298f33976 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac6c0276fa842738263e8aed290bf19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed478a90b637419e8a1ec46a5ec15414', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:06:59.478171 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3a68d916-d87a-45cb-8ccc-7ba298f33976 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] 10.222.0.20 "GET /compute/v2.1/servers/7d470632-cd1e-4fa8-98dc-4250c3ed482e" status: 200 len: 1584 microversion: 2.1 time: 0.266258 Oct 27 04:06:59.479083 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3567/6847] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:06:59 2022] GET /compute/v2.1/servers/7d470632-cd1e-4fa8-98dc-4250c3ed482e => generated 1584 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:07:00.509662 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-31f7c072-8780-4ef5-bbc3-ddd8abc0cc64 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:07:00.511331 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-31f7c072-8780-4ef5-bbc3-ddd8abc0cc64 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] [instance: 7d470632-cd1e-4fa8-98dc-4250c3ed482e] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:07:00.530805 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-31f7c072-8780-4ef5-bbc3-ddd8abc0cc64 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:07:00.531533 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-31f7c072-8780-4ef5-bbc3-ddd8abc0cc64 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:07:00.532005 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-31f7c072-8780-4ef5-bbc3-ddd8abc0cc64 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:07:00.532957 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-31f7c072-8780-4ef5-bbc3-ddd8abc0cc64 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:07:00.533422 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-31f7c072-8780-4ef5-bbc3-ddd8abc0cc64 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:07:00.533882 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-31f7c072-8780-4ef5-bbc3-ddd8abc0cc64 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:07:01.114437 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-31f7c072-8780-4ef5-bbc3-ddd8abc0cc64 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac6c0276fa842738263e8aed290bf19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed478a90b637419e8a1ec46a5ec15414', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:07:01.128923 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-31f7c072-8780-4ef5-bbc3-ddd8abc0cc64 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] 10.222.0.20 "GET /compute/v2.1/servers/7d470632-cd1e-4fa8-98dc-4250c3ed482e" status: 200 len: 1584 microversion: 2.1 time: 0.621507 Oct 27 04:07:01.129651 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3281/6848] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:07:00 2022] GET /compute/v2.1/servers/7d470632-cd1e-4fa8-98dc-4250c3ed482e => generated 1584 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:07:01.537761 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-ab226922-cc37-4ba4-8dcc-9d18c74c3517 req-c57ebc6c-cfb7-4e48-90ae-5218315c1c93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d470632-cd1e-4fa8-98dc-4250c3ed482e", "name": "network-vif-deleted", "tag": "dfce8b32-768c-4dce-a68b-237f1ff60963"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:07:01.548765 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-ab226922-cc37-4ba4-8dcc-9d18c74c3517 req-c57ebc6c-cfb7-4e48-90ae-5218315c1c93 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:07:01.553678 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-ab226922-cc37-4ba4-8dcc-9d18c74c3517 req-c57ebc6c-cfb7-4e48-90ae-5218315c1c93 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:07:01.553678 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-ab226922-cc37-4ba4-8dcc-9d18c74c3517 req-c57ebc6c-cfb7-4e48-90ae-5218315c1c93 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:07:01.562845 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-ab226922-cc37-4ba4-8dcc-9d18c74c3517 req-c57ebc6c-cfb7-4e48-90ae-5218315c1c93 service nova] Creating event network-vif-deleted:dfce8b32-768c-4dce-a68b-237f1ff60963 for instance 7d470632-cd1e-4fa8-98dc-4250c3ed482e on n-h2-862769-1 Oct 27 04:07:01.568703 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-ab226922-cc37-4ba4-8dcc-9d18c74c3517 req-c57ebc6c-cfb7-4e48-90ae-5218315c1c93 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035490 Oct 27 04:07:01.569312 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3568/6849] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:07:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:07:02.155341 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5c8359d2-2e2e-4265-9312-6b762dc2c03f tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:07:02.155971 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5c8359d2-2e2e-4265-9312-6b762dc2c03f tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] [instance: 7d470632-cd1e-4fa8-98dc-4250c3ed482e] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:07:02.163052 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5c8359d2-2e2e-4265-9312-6b762dc2c03f tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:07:02.163615 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5c8359d2-2e2e-4265-9312-6b762dc2c03f tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:07:02.164134 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5c8359d2-2e2e-4265-9312-6b762dc2c03f tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:07:02.164905 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5c8359d2-2e2e-4265-9312-6b762dc2c03f tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:07:02.165430 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5c8359d2-2e2e-4265-9312-6b762dc2c03f tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:07:02.165923 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5c8359d2-2e2e-4265-9312-6b762dc2c03f tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:07:02.233639 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5c8359d2-2e2e-4265-9312-6b762dc2c03f tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac6c0276fa842738263e8aed290bf19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed478a90b637419e8a1ec46a5ec15414', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:07:02.242620 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5c8359d2-2e2e-4265-9312-6b762dc2c03f tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] 10.222.0.20 "GET /compute/v2.1/servers/7d470632-cd1e-4fa8-98dc-4250c3ed482e" status: 200 len: 1230 microversion: 2.1 time: 0.091514 Oct 27 04:07:02.249622 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3282/6850] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:07:02 2022] GET /compute/v2.1/servers/7d470632-cd1e-4fa8-98dc-4250c3ed482e => generated 1230 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:07:03.265664 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-79d503ce-7e16-4ad7-ac67-a560d6ec5aa9 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:07:03.266508 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-79d503ce-7e16-4ad7-ac67-a560d6ec5aa9 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] [instance: 7d470632-cd1e-4fa8-98dc-4250c3ed482e] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:07:03.274280 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-79d503ce-7e16-4ad7-ac67-a560d6ec5aa9 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:07:03.274770 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-79d503ce-7e16-4ad7-ac67-a560d6ec5aa9 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:07:03.275214 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-79d503ce-7e16-4ad7-ac67-a560d6ec5aa9 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:07:03.275907 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-79d503ce-7e16-4ad7-ac67-a560d6ec5aa9 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:07:03.276362 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-79d503ce-7e16-4ad7-ac67-a560d6ec5aa9 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:07:03.276792 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-79d503ce-7e16-4ad7-ac67-a560d6ec5aa9 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:07:03.342203 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-79d503ce-7e16-4ad7-ac67-a560d6ec5aa9 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac6c0276fa842738263e8aed290bf19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed478a90b637419e8a1ec46a5ec15414', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:07:03.350147 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-79d503ce-7e16-4ad7-ac67-a560d6ec5aa9 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] 10.222.0.20 "GET /compute/v2.1/servers/7d470632-cd1e-4fa8-98dc-4250c3ed482e" status: 200 len: 1230 microversion: 2.1 time: 0.088778 Oct 27 04:07:03.350741 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3569/6851] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:07:03 2022] GET /compute/v2.1/servers/7d470632-cd1e-4fa8-98dc-4250c3ed482e => generated 1230 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:07:04.200178 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1fdb2d5b-62fb-4df9-9765-ff00c1dcecf7 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-272015003", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "45915fd1-2e01-4b52-ae38-7ff93278794e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b49d136e-c9db-4b4f-8210-57f6cfd2ff95"}]}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:07:04.261491 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-1fdb2d5b-62fb-4df9-9765-ff00c1dcecf7 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] validate_networks() for [('b49d136e-c9db-4b4f-8210-57f6cfd2ff95', None, None, None, None, None)] {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 04:07:04.372968 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4ea8e0c5-1389-4428-8494-245e21098b74 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:07:04.373757 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4ea8e0c5-1389-4428-8494-245e21098b74 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] [instance: 7d470632-cd1e-4fa8-98dc-4250c3ed482e] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:07:04.384998 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4ea8e0c5-1389-4428-8494-245e21098b74 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:07:04.385982 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4ea8e0c5-1389-4428-8494-245e21098b74 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:07:04.388486 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4ea8e0c5-1389-4428-8494-245e21098b74 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:07:04.388486 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4ea8e0c5-1389-4428-8494-245e21098b74 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:07:04.388812 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4ea8e0c5-1389-4428-8494-245e21098b74 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:07:04.389191 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4ea8e0c5-1389-4428-8494-245e21098b74 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:07:04.462459 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4ea8e0c5-1389-4428-8494-245e21098b74 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac6c0276fa842738263e8aed290bf19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed478a90b637419e8a1ec46a5ec15414', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:07:04.472220 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4ea8e0c5-1389-4428-8494-245e21098b74 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] 10.222.0.20 "GET /compute/v2.1/servers/7d470632-cd1e-4fa8-98dc-4250c3ed482e" status: 200 len: 1230 microversion: 2.1 time: 0.102373 Oct 27 04:07:04.472811 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3570/6852] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:07:04 2022] GET /compute/v2.1/servers/7d470632-cd1e-4fa8-98dc-4250c3ed482e => generated 1230 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 04:07:04.647189 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-1fdb2d5b-62fb-4df9-9765-ff00c1dcecf7 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 04:07:04.647626 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-1fdb2d5b-62fb-4df9-9765-ff00c1dcecf7 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 04:07:04.648112 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-1fdb2d5b-62fb-4df9-9765-ff00c1dcecf7 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 04:07:04.648531 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-1fdb2d5b-62fb-4df9-9765-ff00c1dcecf7 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 04:07:04.648955 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-1fdb2d5b-62fb-4df9-9765-ff00c1dcecf7 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 04:07:04.657956 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1fdb2d5b-62fb-4df9-9765-ff00c1dcecf7 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:07:04.658551 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1fdb2d5b-62fb-4df9-9765-ff00c1dcecf7 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:07:04.659049 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1fdb2d5b-62fb-4df9-9765-ff00c1dcecf7 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:07:04.659793 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1fdb2d5b-62fb-4df9-9765-ff00c1dcecf7 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:07:04.660263 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1fdb2d5b-62fb-4df9-9765-ff00c1dcecf7 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:07:04.660695 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1fdb2d5b-62fb-4df9-9765-ff00c1dcecf7 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:07:04.677609 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-1fdb2d5b-62fb-4df9-9765-ff00c1dcecf7 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Getting quotas for project 6a6a4f0161c94dc19682d70af00ba684. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 04:07:04.682856 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-1fdb2d5b-62fb-4df9-9765-ff00c1dcecf7 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Getting quotas for user b7f5c179e8844542bca46d76042a6897 and project 6a6a4f0161c94dc19682d70af00ba684. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 04:07:04.740934 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1fdb2d5b-62fb-4df9-9765-ff00c1dcecf7 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 04:07:04.743065 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1fdb2d5b-62fb-4df9-9765-ff00c1dcecf7 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 3e03342d-57ef-4615-9eef-37e63af8bbae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='45915fd1-2e01-4b52-ae38-7ff93278794e',volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 04:07:05.066776 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1fdb2d5b-62fb-4df9-9765-ff00c1dcecf7 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.871763 Oct 27 04:07:05.073572 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3283/6853] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 04:07:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 873 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 04:07:05.078981 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2b26953b-6997-4d07-810f-75e1886ffeff tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:07:05.079623 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2b26953b-6997-4d07-810f-75e1886ffeff tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 3e03342d-57ef-4615-9eef-37e63af8bbae] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:07:05.147007 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2b26953b-6997-4d07-810f-75e1886ffeff tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:07:05.157238 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2b26953b-6997-4d07-810f-75e1886ffeff tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/3e03342d-57ef-4615-9eef-37e63af8bbae" status: 200 len: 1056 microversion: 2.1 time: 0.082117 Oct 27 04:07:05.170170 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3571/6854] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:07:05 2022] GET /compute/v2.1/servers/3e03342d-57ef-4615-9eef-37e63af8bbae => generated 1056 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:07:05.524473 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-25e4e74b-9073-4f1e-9408-4c1343b558cd tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:07:05.524473 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-25e4e74b-9073-4f1e-9408-4c1343b558cd tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] [instance: 7d470632-cd1e-4fa8-98dc-4250c3ed482e] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:07:05.524473 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-25e4e74b-9073-4f1e-9408-4c1343b558cd tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:07:05.524473 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-25e4e74b-9073-4f1e-9408-4c1343b558cd tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:07:05.524473 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-25e4e74b-9073-4f1e-9408-4c1343b558cd tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:07:05.524473 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-25e4e74b-9073-4f1e-9408-4c1343b558cd tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:07:05.524473 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-25e4e74b-9073-4f1e-9408-4c1343b558cd tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:07:05.524473 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-25e4e74b-9073-4f1e-9408-4c1343b558cd tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:07:05.582695 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-25e4e74b-9073-4f1e-9408-4c1343b558cd tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac6c0276fa842738263e8aed290bf19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed478a90b637419e8a1ec46a5ec15414', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:07:05.586808 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:07:05.591984 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-25e4e74b-9073-4f1e-9408-4c1343b558cd tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] 10.222.0.20 "GET /compute/v2.1/servers/7d470632-cd1e-4fa8-98dc-4250c3ed482e" status: 200 len: 1230 microversion: 2.1 time: 0.100838 Oct 27 04:07:05.592848 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3284/6855] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:07:05 2022] GET /compute/v2.1/servers/7d470632-cd1e-4fa8-98dc-4250c3ed482e => generated 1230 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:07:06.188466 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-db836ce5-36cc-4a92-9791-6cfa5a81c64b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:07:06.189102 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-db836ce5-36cc-4a92-9791-6cfa5a81c64b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 3e03342d-57ef-4615-9eef-37e63af8bbae] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:07:06.197822 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-db836ce5-36cc-4a92-9791-6cfa5a81c64b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:07:06.199299 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-db836ce5-36cc-4a92-9791-6cfa5a81c64b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:07:06.199299 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-db836ce5-36cc-4a92-9791-6cfa5a81c64b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:07:06.199812 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-db836ce5-36cc-4a92-9791-6cfa5a81c64b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:07:06.200280 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-db836ce5-36cc-4a92-9791-6cfa5a81c64b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:07:06.200715 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-db836ce5-36cc-4a92-9791-6cfa5a81c64b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:07:06.271115 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-db836ce5-36cc-4a92-9791-6cfa5a81c64b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:07:06.273301 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-db836ce5-36cc-4a92-9791-6cfa5a81c64b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/3e03342d-57ef-4615-9eef-37e63af8bbae" status: 200 len: 1106 microversion: 2.1 time: 0.094851 Oct 27 04:07:06.274153 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3572/6856] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:07:06 2022] GET /compute/v2.1/servers/3e03342d-57ef-4615-9eef-37e63af8bbae => generated 1106 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:07:06.641236 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-91cd0ea0-e009-4820-85d2-0a40f9255160 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:07:06.642292 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-91cd0ea0-e009-4820-85d2-0a40f9255160 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] [instance: 7d470632-cd1e-4fa8-98dc-4250c3ed482e] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:07:06.650227 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-91cd0ea0-e009-4820-85d2-0a40f9255160 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:07:06.650911 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-91cd0ea0-e009-4820-85d2-0a40f9255160 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:07:06.651393 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-91cd0ea0-e009-4820-85d2-0a40f9255160 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:07:06.652209 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-91cd0ea0-e009-4820-85d2-0a40f9255160 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:07:06.652749 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-91cd0ea0-e009-4820-85d2-0a40f9255160 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:07:06.653249 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-91cd0ea0-e009-4820-85d2-0a40f9255160 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:07:06.716867 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-91cd0ea0-e009-4820-85d2-0a40f9255160 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac6c0276fa842738263e8aed290bf19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed478a90b637419e8a1ec46a5ec15414', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:07:06.727741 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-91cd0ea0-e009-4820-85d2-0a40f9255160 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] 10.222.0.20 "GET /compute/v2.1/servers/7d470632-cd1e-4fa8-98dc-4250c3ed482e" status: 200 len: 1230 microversion: 2.1 time: 0.090711 Oct 27 04:07:06.729254 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3285/6857] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:07:06 2022] GET /compute/v2.1/servers/7d470632-cd1e-4fa8-98dc-4250c3ed482e => generated 1230 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:07:07.298694 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2b37778b-38c7-4958-800a-4b526ef25c25 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:07:07.300626 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2b37778b-38c7-4958-800a-4b526ef25c25 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 3e03342d-57ef-4615-9eef-37e63af8bbae] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:07:07.312187 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2b37778b-38c7-4958-800a-4b526ef25c25 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:07:07.313663 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2b37778b-38c7-4958-800a-4b526ef25c25 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:07:07.314442 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2b37778b-38c7-4958-800a-4b526ef25c25 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:07:07.315601 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2b37778b-38c7-4958-800a-4b526ef25c25 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:07:07.316151 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2b37778b-38c7-4958-800a-4b526ef25c25 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:07:07.316931 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2b37778b-38c7-4958-800a-4b526ef25c25 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:07:07.387190 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2b37778b-38c7-4958-800a-4b526ef25c25 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:07:07.396558 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2b37778b-38c7-4958-800a-4b526ef25c25 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/3e03342d-57ef-4615-9eef-37e63af8bbae" status: 200 len: 1154 microversion: 2.1 time: 0.104401 Oct 27 04:07:07.397395 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3573/6858] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:07:07 2022] GET /compute/v2.1/servers/3e03342d-57ef-4615-9eef-37e63af8bbae => generated 1154 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:07:07.753761 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-53674ceb-a873-4916-bd02-b3a98a4de91a tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:07:07.759427 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-53674ceb-a873-4916-bd02-b3a98a4de91a tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] [instance: 7d470632-cd1e-4fa8-98dc-4250c3ed482e] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:07:07.763255 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-53674ceb-a873-4916-bd02-b3a98a4de91a tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:07:07.763813 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-53674ceb-a873-4916-bd02-b3a98a4de91a tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:07:07.764293 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-53674ceb-a873-4916-bd02-b3a98a4de91a tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:07:07.766416 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-53674ceb-a873-4916-bd02-b3a98a4de91a tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:07:07.766416 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-53674ceb-a873-4916-bd02-b3a98a4de91a tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:07:07.766416 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-53674ceb-a873-4916-bd02-b3a98a4de91a tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:07:07.813786 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-53674ceb-a873-4916-bd02-b3a98a4de91a tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:07:07.814427 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-53674ceb-a873-4916-bd02-b3a98a4de91a tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:07:07.814980 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-53674ceb-a873-4916-bd02-b3a98a4de91a tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:07:07.816115 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-53674ceb-a873-4916-bd02-b3a98a4de91a tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lazy-loading 'fault' on Instance uuid 7d470632-cd1e-4fa8-98dc-4250c3ed482e {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 04:07:07.899501 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-53674ceb-a873-4916-bd02-b3a98a4de91a tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac6c0276fa842738263e8aed290bf19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed478a90b637419e8a1ec46a5ec15414', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:07:07.916824 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-53674ceb-a873-4916-bd02-b3a98a4de91a tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] 10.222.0.20 "GET /compute/v2.1/servers/7d470632-cd1e-4fa8-98dc-4250c3ed482e" status: 200 len: 1235 microversion: 2.1 time: 0.168403 Oct 27 04:07:07.920782 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3286/6859] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:07:07 2022] GET /compute/v2.1/servers/7d470632-cd1e-4fa8-98dc-4250c3ed482e => generated 1235 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:07:08.420819 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e514428f-2273-4f66-8573-370194294e81 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:07:08.422292 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e514428f-2273-4f66-8573-370194294e81 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 3e03342d-57ef-4615-9eef-37e63af8bbae] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:07:08.432826 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e514428f-2273-4f66-8573-370194294e81 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:07:08.433714 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e514428f-2273-4f66-8573-370194294e81 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:07:08.434501 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e514428f-2273-4f66-8573-370194294e81 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:07:08.435482 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e514428f-2273-4f66-8573-370194294e81 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:07:08.436135 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e514428f-2273-4f66-8573-370194294e81 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:07:08.436811 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e514428f-2273-4f66-8573-370194294e81 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:07:08.608641 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e514428f-2273-4f66-8573-370194294e81 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:07:08.616338 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e514428f-2273-4f66-8573-370194294e81 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/3e03342d-57ef-4615-9eef-37e63af8bbae" status: 200 len: 1214 microversion: 2.1 time: 0.200066 Oct 27 04:07:08.628543 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3574/6860] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:07:08 2022] GET /compute/v2.1/servers/3e03342d-57ef-4615-9eef-37e63af8bbae => generated 1214 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:07:08.941459 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d04a880a-20e1-4af9-a442-be0c7fc76ea9 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:07:08.942277 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d04a880a-20e1-4af9-a442-be0c7fc76ea9 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] [instance: 7d470632-cd1e-4fa8-98dc-4250c3ed482e] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:07:08.949148 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d04a880a-20e1-4af9-a442-be0c7fc76ea9 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:07:08.949649 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d04a880a-20e1-4af9-a442-be0c7fc76ea9 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:07:08.950120 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d04a880a-20e1-4af9-a442-be0c7fc76ea9 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:07:08.951050 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d04a880a-20e1-4af9-a442-be0c7fc76ea9 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:07:08.951694 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d04a880a-20e1-4af9-a442-be0c7fc76ea9 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:07:08.952123 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d04a880a-20e1-4af9-a442-be0c7fc76ea9 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:07:08.982091 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-d04a880a-20e1-4af9-a442-be0c7fc76ea9 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] HTTP exception thrown: Instance 7d470632-cd1e-4fa8-98dc-4250c3ed482e could not be found. Oct 27 04:07:08.982091 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d04a880a-20e1-4af9-a442-be0c7fc76ea9 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Request method failure captured: Oct 27 04:07:08.982091 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/7d470632-cd1e-4fa8-98dc-4250c3ed482e HTTP/1.1 Oct 27 04:07:08.982091 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 04:07:08.982091 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 04:07:08.982091 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 04:07:08.982091 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 04:07:08.982091 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 04:07:08.982091 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 04:07:08.982091 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 04:07:08.982091 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 04:07:08.982091 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWgLZ3G8eVdtTvVCQ1iKwKE61wxXTMHNs8TOAQSNrIPpBMTisZJssw_txaCfHMDY5rQ2fvomuhZvWOZ5qAbVky1_J-dRcBAanB_5JCLSuVc8Ng9-VN0ZvS7Trk4L5Bu70P9R5ZVKgAi20VonhWF4lnHF24Cx_medTmvZWUmingf5G3_U Oct 27 04:07:08.982091 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 04:07:08.982091 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 04:07:08.982091 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 04:07:08.982091 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 04:07:08.982091 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 04:07:08.982091 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 04:07:08.982091 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: ed478a90b637419e8a1ec46a5ec15414 Oct 27 04:07:08.982091 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-TestVolumeBackupRestore-2051031588 Oct 27 04:07:08.982091 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 04:07:08.982091 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 04:07:08.982091 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ed478a90b637419e8a1ec46a5ec15414"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ed478a90b637419e8a1ec46a5ec15414"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ed478a90b637419e8a1ec46a5ec15414"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ed478a90b637419e8a1ec46a5ec15414"}]}] Oct 27 04:07:08.982091 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-TestVolumeBackupRestore-2051031588 Oct 27 04:07:08.982091 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: ed478a90b637419e8a1ec46a5ec15414 Oct 27 04:07:08.982091 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-TestVolumeBackupRestore-2051031588 Oct 27 04:07:08.982091 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-TestVolumeBackupRestore-2051031588-project Oct 27 04:07:08.982091 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 04:07:08.982091 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 04:07:08.982091 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: aac6c0276fa842738263e8aed290bf19 Oct 27 04:07:08.982091 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-TestVolumeBackupRestore-2051031588-project Oct 27 04:07:08.982091 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 04:07:08.982091 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 7d470632-cd1e-4fa8-98dc-4250c3ed482e could not be found. Oct 27 04:07:08.982091 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '7d470632-cd1e-4fa8-98dc-4250c3ed482e'} Oct 27 04:07:08.982091 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 04:07:08.982091 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:07:08.982091 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 04:07:08.982091 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 04:07:08.982091 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 04:07:08.982091 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 04:07:08.982091 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 04:07:08.982091 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 04:07:08.982091 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 04:07:08.982091 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 04:07:08.982091 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d470632-cd1e-4fa8-98dc-4250c3ed482e could not be found. Oct 27 04:07:08.982091 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:07:08.982091 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:07:08.982091 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:07:08.982091 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:07:08.982091 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:07:08.982091 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:07:08.982091 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 04:07:08.982091 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 04:07:08.982091 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 04:07:08.982091 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 04:07:08.982091 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 04:07:08.982091 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 04:07:08.982091 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 04:07:08.982091 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 04:07:08.982091 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 04:07:08.982091 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 04:07:08.991776 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d470632-cd1e-4fa8-98dc-4250c3ed482e could not be found. Oct 27 04:07:08.991776 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:07:08.991776 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:07:08.991776 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:07:08.991776 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:07:08.991776 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:07:08.991776 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:07:08.991776 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 04:07:08.991776 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 04:07:08.991776 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d470632-cd1e-4fa8-98dc-4250c3ed482e could not be found. Oct 27 04:07:08.991776 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:07:08.991776 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d04a880a-20e1-4af9-a442-be0c7fc76ea9 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Returning 404 to user: Instance 7d470632-cd1e-4fa8-98dc-4250c3ed482e could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 04:07:08.991776 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d04a880a-20e1-4af9-a442-be0c7fc76ea9 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] 10.222.0.20 "GET /compute/v2.1/servers/7d470632-cd1e-4fa8-98dc-4250c3ed482e" status: 404 len: 111 microversion: 2.1 time: 0.048741 Oct 27 04:07:08.991776 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3287/6861] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:07:08 2022] GET /compute/v2.1/servers/7d470632-cd1e-4fa8-98dc-4250c3ed482e => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 04:07:09.374121 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3be8c3d9-a438-4179-a196-b8eaad36bcc2 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] Calling method '.version_select at 0x7f7dd9eb5550>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:07:09.449769 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3be8c3d9-a438-4179-a196-b8eaad36bcc2 tempest-TestVolumeBackupRestore-2051031588 tempest-TestVolumeBackupRestore-2051031588-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1376036212" status: 202 len: 0 microversion: 2.1 time: 0.079693 Oct 27 04:07:09.450613 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3575/6862] 10.222.0.20 () {58 vars in 1269 bytes} [Thu Oct 27 04:07:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1376036212 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 04:07:09.471398 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-b68c9295-2eac-46a5-aef6-49144c139e0b req-d9a5e8bd-5f46-4fd5-8842-dc7dfa4611e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e03342d-57ef-4615-9eef-37e63af8bbae", "tag": "5f9d826f-8703-4be6-a339-3eb11de55fea"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:07:09.487207 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-b68c9295-2eac-46a5-aef6-49144c139e0b req-d9a5e8bd-5f46-4fd5-8842-dc7dfa4611e8 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:07:09.491630 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-b68c9295-2eac-46a5-aef6-49144c139e0b req-d9a5e8bd-5f46-4fd5-8842-dc7dfa4611e8 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:07:09.491630 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-b68c9295-2eac-46a5-aef6-49144c139e0b req-d9a5e8bd-5f46-4fd5-8842-dc7dfa4611e8 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:07:09.509556 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-b68c9295-2eac-46a5-aef6-49144c139e0b req-d9a5e8bd-5f46-4fd5-8842-dc7dfa4611e8 service nova] Creating event network-changed:5f9d826f-8703-4be6-a339-3eb11de55fea for instance 3e03342d-57ef-4615-9eef-37e63af8bbae on n-h1-862769-1 Oct 27 04:07:09.517209 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-b68c9295-2eac-46a5-aef6-49144c139e0b req-d9a5e8bd-5f46-4fd5-8842-dc7dfa4611e8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049122 Oct 27 04:07:09.519775 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3288/6863] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:07:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:07:09.641247 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-25243e43-72c6-4d49-bfc8-49e25d61a198 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:07:09.641881 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-25243e43-72c6-4d49-bfc8-49e25d61a198 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 3e03342d-57ef-4615-9eef-37e63af8bbae] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:07:09.649517 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-25243e43-72c6-4d49-bfc8-49e25d61a198 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:07:09.650028 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-25243e43-72c6-4d49-bfc8-49e25d61a198 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:07:09.650512 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-25243e43-72c6-4d49-bfc8-49e25d61a198 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:07:09.651496 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-25243e43-72c6-4d49-bfc8-49e25d61a198 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:07:09.651971 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-25243e43-72c6-4d49-bfc8-49e25d61a198 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:07:09.652412 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-25243e43-72c6-4d49-bfc8-49e25d61a198 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:07:09.817614 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-25243e43-72c6-4d49-bfc8-49e25d61a198 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:07:09.850705 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-25243e43-72c6-4d49-bfc8-49e25d61a198 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/3e03342d-57ef-4615-9eef-37e63af8bbae" status: 200 len: 1214 microversion: 2.1 time: 0.211734 Oct 27 04:07:09.868939 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3576/6864] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:07:09 2022] GET /compute/v2.1/servers/3e03342d-57ef-4615-9eef-37e63af8bbae => generated 1214 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:07:10.880010 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c4b73c42-cc10-4b8f-a904-29c35a652871 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:07:10.880713 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c4b73c42-cc10-4b8f-a904-29c35a652871 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 3e03342d-57ef-4615-9eef-37e63af8bbae] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:07:10.887024 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c4b73c42-cc10-4b8f-a904-29c35a652871 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:07:10.887513 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c4b73c42-cc10-4b8f-a904-29c35a652871 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:07:10.887955 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c4b73c42-cc10-4b8f-a904-29c35a652871 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:07:10.888653 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c4b73c42-cc10-4b8f-a904-29c35a652871 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:07:10.889114 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c4b73c42-cc10-4b8f-a904-29c35a652871 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:07:10.889545 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c4b73c42-cc10-4b8f-a904-29c35a652871 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:07:11.207374 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c4b73c42-cc10-4b8f-a904-29c35a652871 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:07:11.207374 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c4b73c42-cc10-4b8f-a904-29c35a652871 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/3e03342d-57ef-4615-9eef-37e63af8bbae" status: 200 len: 1214 microversion: 2.1 time: 0.167375 Oct 27 04:07:11.207374 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3289/6865] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:07:10 2022] GET /compute/v2.1/servers/3e03342d-57ef-4615-9eef-37e63af8bbae => generated 1214 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:07:12.066105 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b179c3ac-ae8b-4fb5-b4ea-9180ba7d3ca0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:07:12.067317 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b179c3ac-ae8b-4fb5-b4ea-9180ba7d3ca0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 3e03342d-57ef-4615-9eef-37e63af8bbae] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:07:12.079378 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b179c3ac-ae8b-4fb5-b4ea-9180ba7d3ca0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:07:12.079955 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b179c3ac-ae8b-4fb5-b4ea-9180ba7d3ca0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:07:12.080419 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b179c3ac-ae8b-4fb5-b4ea-9180ba7d3ca0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:07:12.082275 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b179c3ac-ae8b-4fb5-b4ea-9180ba7d3ca0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:07:12.082755 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b179c3ac-ae8b-4fb5-b4ea-9180ba7d3ca0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:07:12.083204 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b179c3ac-ae8b-4fb5-b4ea-9180ba7d3ca0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:07:12.247867 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b179c3ac-ae8b-4fb5-b4ea-9180ba7d3ca0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:07:12.257996 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b179c3ac-ae8b-4fb5-b4ea-9180ba7d3ca0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/3e03342d-57ef-4615-9eef-37e63af8bbae" status: 200 len: 1214 microversion: 2.1 time: 0.197151 Oct 27 04:07:12.271109 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3577/6866] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:07:12 2022] GET /compute/v2.1/servers/3e03342d-57ef-4615-9eef-37e63af8bbae => generated 1214 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:07:13.283433 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-cb2d643b-eecc-4352-b8c1-371113b9b92b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:07:13.284840 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-cb2d643b-eecc-4352-b8c1-371113b9b92b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 3e03342d-57ef-4615-9eef-37e63af8bbae] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:07:13.297605 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cb2d643b-eecc-4352-b8c1-371113b9b92b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:07:13.298906 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cb2d643b-eecc-4352-b8c1-371113b9b92b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:07:13.300448 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cb2d643b-eecc-4352-b8c1-371113b9b92b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:07:13.302793 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cb2d643b-eecc-4352-b8c1-371113b9b92b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:07:13.305159 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cb2d643b-eecc-4352-b8c1-371113b9b92b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:07:13.305766 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cb2d643b-eecc-4352-b8c1-371113b9b92b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:07:13.663125 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-cb2d643b-eecc-4352-b8c1-371113b9b92b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:07:13.671932 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-cb2d643b-eecc-4352-b8c1-371113b9b92b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/3e03342d-57ef-4615-9eef-37e63af8bbae" status: 200 len: 1214 microversion: 2.1 time: 0.392709 Oct 27 04:07:13.685466 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3290/6867] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:07:13 2022] GET /compute/v2.1/servers/3e03342d-57ef-4615-9eef-37e63af8bbae => generated 1214 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:07:14.699511 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f526ddd1-01d4-4c71-94ef-d310b719ae89 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:07:14.702752 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f526ddd1-01d4-4c71-94ef-d310b719ae89 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 3e03342d-57ef-4615-9eef-37e63af8bbae] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:07:14.718677 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f526ddd1-01d4-4c71-94ef-d310b719ae89 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:07:14.719241 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f526ddd1-01d4-4c71-94ef-d310b719ae89 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:07:14.719702 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f526ddd1-01d4-4c71-94ef-d310b719ae89 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:07:14.721701 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f526ddd1-01d4-4c71-94ef-d310b719ae89 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:07:14.722269 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f526ddd1-01d4-4c71-94ef-d310b719ae89 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:07:14.722776 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f526ddd1-01d4-4c71-94ef-d310b719ae89 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:07:14.968897 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f526ddd1-01d4-4c71-94ef-d310b719ae89 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:07:14.980878 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f526ddd1-01d4-4c71-94ef-d310b719ae89 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/3e03342d-57ef-4615-9eef-37e63af8bbae" status: 200 len: 1214 microversion: 2.1 time: 0.287005 Oct 27 04:07:14.981492 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3578/6868] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:07:14 2022] GET /compute/v2.1/servers/3e03342d-57ef-4615-9eef-37e63af8bbae => generated 1214 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:07:16.004647 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1626e9cc-5816-4d24-8c80-462ddfb9aaed tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:07:16.005833 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1626e9cc-5816-4d24-8c80-462ddfb9aaed tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 3e03342d-57ef-4615-9eef-37e63af8bbae] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:07:16.012364 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:07:16.013235 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=6 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:07:16.014913 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1626e9cc-5816-4d24-8c80-462ddfb9aaed tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:07:16.015549 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1626e9cc-5816-4d24-8c80-462ddfb9aaed tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:07:16.016153 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1626e9cc-5816-4d24-8c80-462ddfb9aaed tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:07:16.017009 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1626e9cc-5816-4d24-8c80-462ddfb9aaed tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:07:16.017610 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1626e9cc-5816-4d24-8c80-462ddfb9aaed tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:07:16.018816 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1626e9cc-5816-4d24-8c80-462ddfb9aaed tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:07:16.294954 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1626e9cc-5816-4d24-8c80-462ddfb9aaed tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:07:16.308887 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1626e9cc-5816-4d24-8c80-462ddfb9aaed tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/3e03342d-57ef-4615-9eef-37e63af8bbae" status: 200 len: 1214 microversion: 2.1 time: 0.308626 Oct 27 04:07:16.309735 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3291/6869] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:07:15 2022] GET /compute/v2.1/servers/3e03342d-57ef-4615-9eef-37e63af8bbae => generated 1214 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:07:17.332445 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c4a22ba8-e33e-4be0-9bbd-947138e14b7c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:07:17.333208 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c4a22ba8-e33e-4be0-9bbd-947138e14b7c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 3e03342d-57ef-4615-9eef-37e63af8bbae] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:07:17.335488 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:07:17.337257 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:07:17.350130 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c4a22ba8-e33e-4be0-9bbd-947138e14b7c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:07:17.351010 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c4a22ba8-e33e-4be0-9bbd-947138e14b7c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:07:17.351589 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c4a22ba8-e33e-4be0-9bbd-947138e14b7c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:07:17.352427 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c4a22ba8-e33e-4be0-9bbd-947138e14b7c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:07:17.353596 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c4a22ba8-e33e-4be0-9bbd-947138e14b7c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:07:17.354274 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c4a22ba8-e33e-4be0-9bbd-947138e14b7c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:07:17.357216 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:07:17.588843 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c4a22ba8-e33e-4be0-9bbd-947138e14b7c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:07:17.605436 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c4a22ba8-e33e-4be0-9bbd-947138e14b7c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/3e03342d-57ef-4615-9eef-37e63af8bbae" status: 200 len: 1202 microversion: 2.1 time: 0.276629 Oct 27 04:07:17.606808 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3579/6870] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:07:17 2022] GET /compute/v2.1/servers/3e03342d-57ef-4615-9eef-37e63af8bbae => generated 1202 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:07:18.630184 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8e9d8802-9a43-47c4-a525-e596736531aa tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:07:18.630829 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8e9d8802-9a43-47c4-a525-e596736531aa tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 3e03342d-57ef-4615-9eef-37e63af8bbae] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:07:18.635319 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=59,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:07:18.639115 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8e9d8802-9a43-47c4-a525-e596736531aa tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:07:18.639771 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8e9d8802-9a43-47c4-a525-e596736531aa tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:07:18.640316 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8e9d8802-9a43-47c4-a525-e596736531aa tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:07:18.641188 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8e9d8802-9a43-47c4-a525-e596736531aa tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:07:18.641787 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8e9d8802-9a43-47c4-a525-e596736531aa tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:07:18.642416 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8e9d8802-9a43-47c4-a525-e596736531aa tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:07:18.865237 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8e9d8802-9a43-47c4-a525-e596736531aa tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:07:18.888156 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8e9d8802-9a43-47c4-a525-e596736531aa tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/3e03342d-57ef-4615-9eef-37e63af8bbae" status: 200 len: 1202 microversion: 2.1 time: 0.262504 Oct 27 04:07:18.888884 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3292/6871] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:07:18 2022] GET /compute/v2.1/servers/3e03342d-57ef-4615-9eef-37e63af8bbae => generated 1202 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:07:19.912043 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1289f668-924c-48d2-a957-50737a94fea0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:07:19.912602 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1289f668-924c-48d2-a957-50737a94fea0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 3e03342d-57ef-4615-9eef-37e63af8bbae] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:07:19.923446 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1289f668-924c-48d2-a957-50737a94fea0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:07:19.924011 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1289f668-924c-48d2-a957-50737a94fea0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:07:19.924783 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1289f668-924c-48d2-a957-50737a94fea0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:07:19.925767 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1289f668-924c-48d2-a957-50737a94fea0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:07:19.926515 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1289f668-924c-48d2-a957-50737a94fea0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:07:19.927041 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1289f668-924c-48d2-a957-50737a94fea0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:07:20.116867 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1289f668-924c-48d2-a957-50737a94fea0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:07:20.126133 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1289f668-924c-48d2-a957-50737a94fea0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/3e03342d-57ef-4615-9eef-37e63af8bbae" status: 200 len: 1202 microversion: 2.1 time: 0.218902 Oct 27 04:07:20.142123 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3580/6872] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:07:19 2022] GET /compute/v2.1/servers/3e03342d-57ef-4615-9eef-37e63af8bbae => generated 1202 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:07:21.151110 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c0e87c95-93f8-494b-b353-843430bb00cf tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:07:21.151984 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c0e87c95-93f8-494b-b353-843430bb00cf tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 3e03342d-57ef-4615-9eef-37e63af8bbae] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:07:21.159786 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c0e87c95-93f8-494b-b353-843430bb00cf tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:07:21.160639 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c0e87c95-93f8-494b-b353-843430bb00cf tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:07:21.161236 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c0e87c95-93f8-494b-b353-843430bb00cf tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:07:21.162167 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c0e87c95-93f8-494b-b353-843430bb00cf tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:07:21.162795 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c0e87c95-93f8-494b-b353-843430bb00cf tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:07:21.163385 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c0e87c95-93f8-494b-b353-843430bb00cf tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:07:21.328795 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c0e87c95-93f8-494b-b353-843430bb00cf tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:07:21.337794 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c0e87c95-93f8-494b-b353-843430bb00cf tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/3e03342d-57ef-4615-9eef-37e63af8bbae" status: 200 len: 1202 microversion: 2.1 time: 0.192327 Oct 27 04:07:21.338839 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3293/6873] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:07:21 2022] GET /compute/v2.1/servers/3e03342d-57ef-4615-9eef-37e63af8bbae => generated 1202 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 04:07:22.361270 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b1f0a27d-017f-4afd-bd2c-d004c81ca9ca tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:07:22.361968 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b1f0a27d-017f-4afd-bd2c-d004c81ca9ca tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 3e03342d-57ef-4615-9eef-37e63af8bbae] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:07:22.371239 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b1f0a27d-017f-4afd-bd2c-d004c81ca9ca tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:07:22.372157 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b1f0a27d-017f-4afd-bd2c-d004c81ca9ca tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:07:22.372492 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b1f0a27d-017f-4afd-bd2c-d004c81ca9ca tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:07:22.373234 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b1f0a27d-017f-4afd-bd2c-d004c81ca9ca tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:07:22.379572 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b1f0a27d-017f-4afd-bd2c-d004c81ca9ca tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:07:22.379572 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b1f0a27d-017f-4afd-bd2c-d004c81ca9ca tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:07:22.656480 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b1f0a27d-017f-4afd-bd2c-d004c81ca9ca tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:07:22.664640 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b1f0a27d-017f-4afd-bd2c-d004c81ca9ca tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/3e03342d-57ef-4615-9eef-37e63af8bbae" status: 200 len: 1202 microversion: 2.1 time: 0.307554 Oct 27 04:07:22.679891 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3581/6874] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:07:22 2022] GET /compute/v2.1/servers/3e03342d-57ef-4615-9eef-37e63af8bbae => generated 1202 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:07:23.687801 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-31240280-2456-454d-86b5-4b15ffdec9f5 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:07:23.689110 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-31240280-2456-454d-86b5-4b15ffdec9f5 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 3e03342d-57ef-4615-9eef-37e63af8bbae] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:07:23.697263 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-31240280-2456-454d-86b5-4b15ffdec9f5 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:07:23.697844 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-31240280-2456-454d-86b5-4b15ffdec9f5 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:07:23.698377 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-31240280-2456-454d-86b5-4b15ffdec9f5 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:07:23.699602 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-31240280-2456-454d-86b5-4b15ffdec9f5 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:07:23.700137 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-31240280-2456-454d-86b5-4b15ffdec9f5 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:07:23.700638 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-31240280-2456-454d-86b5-4b15ffdec9f5 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:07:23.886925 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-31240280-2456-454d-86b5-4b15ffdec9f5 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:07:23.896732 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-31240280-2456-454d-86b5-4b15ffdec9f5 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/3e03342d-57ef-4615-9eef-37e63af8bbae" status: 200 len: 1202 microversion: 2.1 time: 0.213074 Oct 27 04:07:23.910084 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3294/6875] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:07:23 2022] GET /compute/v2.1/servers/3e03342d-57ef-4615-9eef-37e63af8bbae => generated 1202 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:07:24.920891 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-467d3c9e-a987-42d8-87c2-754bb427d175 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:07:24.922341 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-467d3c9e-a987-42d8-87c2-754bb427d175 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 3e03342d-57ef-4615-9eef-37e63af8bbae] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:07:24.934365 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-467d3c9e-a987-42d8-87c2-754bb427d175 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:07:24.934365 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-467d3c9e-a987-42d8-87c2-754bb427d175 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:07:24.934365 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-467d3c9e-a987-42d8-87c2-754bb427d175 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:07:24.934365 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-467d3c9e-a987-42d8-87c2-754bb427d175 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:07:24.934365 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-467d3c9e-a987-42d8-87c2-754bb427d175 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:07:24.934365 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-467d3c9e-a987-42d8-87c2-754bb427d175 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:07:25.083841 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-467d3c9e-a987-42d8-87c2-754bb427d175 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:07:25.092248 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-467d3c9e-a987-42d8-87c2-754bb427d175 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/3e03342d-57ef-4615-9eef-37e63af8bbae" status: 200 len: 1202 microversion: 2.1 time: 0.175986 Oct 27 04:07:25.092846 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3582/6876] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:07:24 2022] GET /compute/v2.1/servers/3e03342d-57ef-4615-9eef-37e63af8bbae => generated 1202 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:07:26.116141 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-465a5ba6-0201-4637-8bd4-6f5e23afad81 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:07:26.116764 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-465a5ba6-0201-4637-8bd4-6f5e23afad81 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 3e03342d-57ef-4615-9eef-37e63af8bbae] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:07:26.123706 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-465a5ba6-0201-4637-8bd4-6f5e23afad81 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:07:26.124293 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-465a5ba6-0201-4637-8bd4-6f5e23afad81 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:07:26.124762 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-465a5ba6-0201-4637-8bd4-6f5e23afad81 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:07:26.125479 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-465a5ba6-0201-4637-8bd4-6f5e23afad81 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:07:26.125931 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-465a5ba6-0201-4637-8bd4-6f5e23afad81 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:07:26.126386 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-465a5ba6-0201-4637-8bd4-6f5e23afad81 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:07:26.286755 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-465a5ba6-0201-4637-8bd4-6f5e23afad81 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:07:26.295870 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-465a5ba6-0201-4637-8bd4-6f5e23afad81 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/3e03342d-57ef-4615-9eef-37e63af8bbae" status: 200 len: 1202 microversion: 2.1 time: 0.184339 Oct 27 04:07:26.296585 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3295/6877] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:07:26 2022] GET /compute/v2.1/servers/3e03342d-57ef-4615-9eef-37e63af8bbae => generated 1202 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:07:26.615081 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-08d811c0-f5b4-4536-957c-c0bdebd8b845 req-84f7c5aa-37fb-40e3-a84b-b67f1bfa7ad9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e03342d-57ef-4615-9eef-37e63af8bbae", "name": "network-vif-plugged", "status": "completed", "tag": "5f9d826f-8703-4be6-a339-3eb11de55fea"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:07:26.627487 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-08d811c0-f5b4-4536-957c-c0bdebd8b845 req-84f7c5aa-37fb-40e3-a84b-b67f1bfa7ad9 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:07:26.628062 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-08d811c0-f5b4-4536-957c-c0bdebd8b845 req-84f7c5aa-37fb-40e3-a84b-b67f1bfa7ad9 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:07:26.628463 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-08d811c0-f5b4-4536-957c-c0bdebd8b845 req-84f7c5aa-37fb-40e3-a84b-b67f1bfa7ad9 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:07:26.640667 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-08d811c0-f5b4-4536-957c-c0bdebd8b845 req-84f7c5aa-37fb-40e3-a84b-b67f1bfa7ad9 service nova] Creating event network-vif-plugged:5f9d826f-8703-4be6-a339-3eb11de55fea for instance 3e03342d-57ef-4615-9eef-37e63af8bbae on n-h1-862769-1 Oct 27 04:07:26.646938 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-08d811c0-f5b4-4536-957c-c0bdebd8b845 req-84f7c5aa-37fb-40e3-a84b-b67f1bfa7ad9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036664 Oct 27 04:07:26.647412 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3583/6878] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:07:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:07:27.319008 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5e132141-0d73-41da-9cf4-086db95bde15 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:07:27.319622 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5e132141-0d73-41da-9cf4-086db95bde15 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 3e03342d-57ef-4615-9eef-37e63af8bbae] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:07:27.326845 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5e132141-0d73-41da-9cf4-086db95bde15 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:07:27.327333 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5e132141-0d73-41da-9cf4-086db95bde15 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:07:27.327769 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5e132141-0d73-41da-9cf4-086db95bde15 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:07:27.328467 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5e132141-0d73-41da-9cf4-086db95bde15 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:07:27.328923 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5e132141-0d73-41da-9cf4-086db95bde15 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:07:27.329351 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5e132141-0d73-41da-9cf4-086db95bde15 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:07:27.461424 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5e132141-0d73-41da-9cf4-086db95bde15 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:07:27.469265 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5e132141-0d73-41da-9cf4-086db95bde15 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/3e03342d-57ef-4615-9eef-37e63af8bbae" status: 200 len: 1202 microversion: 2.1 time: 0.154810 Oct 27 04:07:27.469835 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3296/6879] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:07:27 2022] GET /compute/v2.1/servers/3e03342d-57ef-4615-9eef-37e63af8bbae => generated 1202 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:07:28.494460 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-44ed32fb-2df6-49a2-aebc-fecf45e40f6f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:07:28.495266 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-44ed32fb-2df6-49a2-aebc-fecf45e40f6f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 3e03342d-57ef-4615-9eef-37e63af8bbae] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:07:28.501582 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-44ed32fb-2df6-49a2-aebc-fecf45e40f6f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:07:28.502184 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-44ed32fb-2df6-49a2-aebc-fecf45e40f6f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:07:28.502704 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-44ed32fb-2df6-49a2-aebc-fecf45e40f6f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:07:28.503411 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-44ed32fb-2df6-49a2-aebc-fecf45e40f6f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:07:28.503870 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-44ed32fb-2df6-49a2-aebc-fecf45e40f6f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:07:28.504299 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-44ed32fb-2df6-49a2-aebc-fecf45e40f6f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:07:28.642909 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-44ed32fb-2df6-49a2-aebc-fecf45e40f6f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:07:28.650778 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-44ed32fb-2df6-49a2-aebc-fecf45e40f6f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/3e03342d-57ef-4615-9eef-37e63af8bbae" status: 200 len: 1389 microversion: 2.1 time: 0.161582 Oct 27 04:07:28.651371 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3584/6880] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:07:28 2022] GET /compute/v2.1/servers/3e03342d-57ef-4615-9eef-37e63af8bbae => generated 1389 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:07:28.673102 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-cbfd41a7-c418-4b6f-8ffe-80c073bb01c9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:07:28.673723 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-cbfd41a7-c418-4b6f-8ffe-80c073bb01c9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 3e03342d-57ef-4615-9eef-37e63af8bbae] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:07:28.681050 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cbfd41a7-c418-4b6f-8ffe-80c073bb01c9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:07:28.681538 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cbfd41a7-c418-4b6f-8ffe-80c073bb01c9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:07:28.681977 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cbfd41a7-c418-4b6f-8ffe-80c073bb01c9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:07:28.682704 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cbfd41a7-c418-4b6f-8ffe-80c073bb01c9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:07:28.683157 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cbfd41a7-c418-4b6f-8ffe-80c073bb01c9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:07:28.683582 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cbfd41a7-c418-4b6f-8ffe-80c073bb01c9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:07:28.816561 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-cbfd41a7-c418-4b6f-8ffe-80c073bb01c9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:07:28.825008 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-cbfd41a7-c418-4b6f-8ffe-80c073bb01c9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/3e03342d-57ef-4615-9eef-37e63af8bbae" status: 200 len: 1389 microversion: 2.1 time: 0.155544 Oct 27 04:07:28.825593 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3297/6881] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:07:28 2022] GET /compute/v2.1/servers/3e03342d-57ef-4615-9eef-37e63af8bbae => generated 1389 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:07:28.847152 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6ffecf3f-e810-4d9b-a206-cab8b011f8a8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:07:28.847800 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-6ffecf3f-e810-4d9b-a206-cab8b011f8a8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 3e03342d-57ef-4615-9eef-37e63af8bbae] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:07:28.853850 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6ffecf3f-e810-4d9b-a206-cab8b011f8a8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:07:28.854387 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6ffecf3f-e810-4d9b-a206-cab8b011f8a8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:07:28.854998 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6ffecf3f-e810-4d9b-a206-cab8b011f8a8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:07:28.855698 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6ffecf3f-e810-4d9b-a206-cab8b011f8a8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:07:28.856158 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6ffecf3f-e810-4d9b-a206-cab8b011f8a8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:07:28.856587 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6ffecf3f-e810-4d9b-a206-cab8b011f8a8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:07:28.984932 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6ffecf3f-e810-4d9b-a206-cab8b011f8a8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:07:28.993159 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6ffecf3f-e810-4d9b-a206-cab8b011f8a8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/3e03342d-57ef-4615-9eef-37e63af8bbae" status: 200 len: 1389 microversion: 2.1 time: 0.150446 Oct 27 04:07:28.993829 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3585/6882] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:07:28 2022] GET /compute/v2.1/servers/3e03342d-57ef-4615-9eef-37e63af8bbae => generated 1389 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:07:29.015858 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ac254990-a1e0-452a-b5e5-57b155353ec8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:07:29.016371 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ac254990-a1e0-452a-b5e5-57b155353ec8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 3e03342d-57ef-4615-9eef-37e63af8bbae] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:07:29.023048 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ac254990-a1e0-452a-b5e5-57b155353ec8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:07:29.023546 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ac254990-a1e0-452a-b5e5-57b155353ec8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:07:29.024020 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ac254990-a1e0-452a-b5e5-57b155353ec8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:07:29.024724 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ac254990-a1e0-452a-b5e5-57b155353ec8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:07:29.025491 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ac254990-a1e0-452a-b5e5-57b155353ec8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:07:29.025935 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ac254990-a1e0-452a-b5e5-57b155353ec8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:07:29.051274 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ac254990-a1e0-452a-b5e5-57b155353ec8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 3e03342d-57ef-4615-9eef-37e63af8bbae] Going to try to terminate instance {{(pid=121000) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 04:07:29.327392 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ac254990-a1e0-452a-b5e5-57b155353ec8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3e03342d-57ef-4615-9eef-37e63af8bbae" status: 204 len: 0 microversion: 2.1 time: 0.315078 Oct 27 04:07:29.327997 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3298/6883] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 04:07:29 2022] DELETE /compute/v2.1/servers/3e03342d-57ef-4615-9eef-37e63af8bbae => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 04:07:29.336557 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e6aba797-1b61-4d14-8829-70a4f4de3cae tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:07:29.337260 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e6aba797-1b61-4d14-8829-70a4f4de3cae tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 3e03342d-57ef-4615-9eef-37e63af8bbae] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:07:29.343473 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e6aba797-1b61-4d14-8829-70a4f4de3cae tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:07:29.343964 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e6aba797-1b61-4d14-8829-70a4f4de3cae tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:07:29.344412 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e6aba797-1b61-4d14-8829-70a4f4de3cae tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:07:29.345122 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e6aba797-1b61-4d14-8829-70a4f4de3cae tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:07:29.345599 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e6aba797-1b61-4d14-8829-70a4f4de3cae tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:07:29.346077 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e6aba797-1b61-4d14-8829-70a4f4de3cae tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:07:29.482430 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e6aba797-1b61-4d14-8829-70a4f4de3cae tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:07:29.490983 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e6aba797-1b61-4d14-8829-70a4f4de3cae tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/3e03342d-57ef-4615-9eef-37e63af8bbae" status: 200 len: 1395 microversion: 2.1 time: 0.158355 Oct 27 04:07:29.491566 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3586/6884] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:07:29 2022] GET /compute/v2.1/servers/3e03342d-57ef-4615-9eef-37e63af8bbae => generated 1395 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 04:07:30.514878 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ec17685f-9b29-4e9e-b337-ad286d21f206 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:07:30.515598 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ec17685f-9b29-4e9e-b337-ad286d21f206 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 3e03342d-57ef-4615-9eef-37e63af8bbae] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:07:30.523378 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ec17685f-9b29-4e9e-b337-ad286d21f206 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:07:30.523884 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ec17685f-9b29-4e9e-b337-ad286d21f206 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:07:30.524327 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ec17685f-9b29-4e9e-b337-ad286d21f206 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:07:30.525095 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ec17685f-9b29-4e9e-b337-ad286d21f206 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:07:30.525541 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ec17685f-9b29-4e9e-b337-ad286d21f206 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:07:30.526105 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ec17685f-9b29-4e9e-b337-ad286d21f206 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:07:30.678817 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ec17685f-9b29-4e9e-b337-ad286d21f206 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:07:30.686933 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ec17685f-9b29-4e9e-b337-ad286d21f206 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/3e03342d-57ef-4615-9eef-37e63af8bbae" status: 200 len: 1395 microversion: 2.1 time: 0.176462 Oct 27 04:07:30.687557 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3299/6885] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:07:30 2022] GET /compute/v2.1/servers/3e03342d-57ef-4615-9eef-37e63af8bbae => generated 1395 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:07:31.509581 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-df428d39-6943-44a3-8149-40ec67a4968b req-7a3b778f-6b7e-41a4-ac64-73258b0c1b98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e03342d-57ef-4615-9eef-37e63af8bbae", "name": "network-vif-deleted", "tag": "5f9d826f-8703-4be6-a339-3eb11de55fea"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:07:31.520447 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-df428d39-6943-44a3-8149-40ec67a4968b req-7a3b778f-6b7e-41a4-ac64-73258b0c1b98 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:07:31.521159 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-df428d39-6943-44a3-8149-40ec67a4968b req-7a3b778f-6b7e-41a4-ac64-73258b0c1b98 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:07:31.521749 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-df428d39-6943-44a3-8149-40ec67a4968b req-7a3b778f-6b7e-41a4-ac64-73258b0c1b98 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:07:31.534834 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-df428d39-6943-44a3-8149-40ec67a4968b req-7a3b778f-6b7e-41a4-ac64-73258b0c1b98 service nova] Creating event network-vif-deleted:5f9d826f-8703-4be6-a339-3eb11de55fea for instance 3e03342d-57ef-4615-9eef-37e63af8bbae on n-h1-862769-1 Oct 27 04:07:31.543502 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-df428d39-6943-44a3-8149-40ec67a4968b req-7a3b778f-6b7e-41a4-ac64-73258b0c1b98 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034990 Oct 27 04:07:31.543502 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3587/6886] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:07:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:07:31.711540 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-cb43c6fe-fb78-4b6c-97c2-3d0a3cb2b365 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:07:31.712320 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-cb43c6fe-fb78-4b6c-97c2-3d0a3cb2b365 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 3e03342d-57ef-4615-9eef-37e63af8bbae] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:07:31.719038 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cb43c6fe-fb78-4b6c-97c2-3d0a3cb2b365 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:07:31.719564 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cb43c6fe-fb78-4b6c-97c2-3d0a3cb2b365 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:07:31.720221 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cb43c6fe-fb78-4b6c-97c2-3d0a3cb2b365 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:07:31.721704 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cb43c6fe-fb78-4b6c-97c2-3d0a3cb2b365 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:07:31.722384 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cb43c6fe-fb78-4b6c-97c2-3d0a3cb2b365 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:07:31.722820 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cb43c6fe-fb78-4b6c-97c2-3d0a3cb2b365 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:07:31.814546 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-cb43c6fe-fb78-4b6c-97c2-3d0a3cb2b365 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:07:31.818573 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:07:31.823251 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-cb43c6fe-fb78-4b6c-97c2-3d0a3cb2b365 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/3e03342d-57ef-4615-9eef-37e63af8bbae" status: 200 len: 1187 microversion: 2.1 time: 0.115815 Oct 27 04:07:31.824276 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3300/6887] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:07:31 2022] GET /compute/v2.1/servers/3e03342d-57ef-4615-9eef-37e63af8bbae => generated 1187 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:07:32.848824 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c017d075-9e49-4a7d-9ad4-2de7f78fd2e8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:07:32.849605 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c017d075-9e49-4a7d-9ad4-2de7f78fd2e8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 3e03342d-57ef-4615-9eef-37e63af8bbae] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:07:32.856852 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c017d075-9e49-4a7d-9ad4-2de7f78fd2e8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:07:32.857352 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c017d075-9e49-4a7d-9ad4-2de7f78fd2e8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:07:32.857803 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c017d075-9e49-4a7d-9ad4-2de7f78fd2e8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:07:32.858558 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c017d075-9e49-4a7d-9ad4-2de7f78fd2e8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:07:32.859026 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c017d075-9e49-4a7d-9ad4-2de7f78fd2e8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:07:32.859464 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c017d075-9e49-4a7d-9ad4-2de7f78fd2e8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:07:32.925211 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c017d075-9e49-4a7d-9ad4-2de7f78fd2e8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:07:32.933572 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c017d075-9e49-4a7d-9ad4-2de7f78fd2e8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/3e03342d-57ef-4615-9eef-37e63af8bbae" status: 200 len: 1187 microversion: 2.1 time: 0.090443 Oct 27 04:07:32.944883 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3588/6888] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:07:32 2022] GET /compute/v2.1/servers/3e03342d-57ef-4615-9eef-37e63af8bbae => generated 1187 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:07:33.957681 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-316ba67d-925e-4690-8471-5f5e1df1255a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:07:33.958430 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-316ba67d-925e-4690-8471-5f5e1df1255a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 3e03342d-57ef-4615-9eef-37e63af8bbae] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:07:33.965645 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-316ba67d-925e-4690-8471-5f5e1df1255a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:07:33.966263 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-316ba67d-925e-4690-8471-5f5e1df1255a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:07:33.966775 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-316ba67d-925e-4690-8471-5f5e1df1255a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:07:33.967538 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-316ba67d-925e-4690-8471-5f5e1df1255a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:07:33.968078 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-316ba67d-925e-4690-8471-5f5e1df1255a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:07:33.968571 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-316ba67d-925e-4690-8471-5f5e1df1255a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:07:34.032320 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-316ba67d-925e-4690-8471-5f5e1df1255a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:07:34.040311 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-316ba67d-925e-4690-8471-5f5e1df1255a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/3e03342d-57ef-4615-9eef-37e63af8bbae" status: 200 len: 1187 microversion: 2.1 time: 0.087531 Oct 27 04:07:34.041018 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3301/6889] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:07:33 2022] GET /compute/v2.1/servers/3e03342d-57ef-4615-9eef-37e63af8bbae => generated 1187 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:07:35.063514 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1a66df07-c629-42cd-a7b6-01864c8b606e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:07:35.064296 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1a66df07-c629-42cd-a7b6-01864c8b606e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 3e03342d-57ef-4615-9eef-37e63af8bbae] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:07:35.071606 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1a66df07-c629-42cd-a7b6-01864c8b606e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:07:35.072104 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1a66df07-c629-42cd-a7b6-01864c8b606e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:07:35.072588 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1a66df07-c629-42cd-a7b6-01864c8b606e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:07:35.073472 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1a66df07-c629-42cd-a7b6-01864c8b606e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:07:35.074227 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1a66df07-c629-42cd-a7b6-01864c8b606e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:07:35.074959 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1a66df07-c629-42cd-a7b6-01864c8b606e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:07:35.146089 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1a66df07-c629-42cd-a7b6-01864c8b606e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:07:35.155608 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1a66df07-c629-42cd-a7b6-01864c8b606e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/3e03342d-57ef-4615-9eef-37e63af8bbae" status: 200 len: 1187 microversion: 2.1 time: 0.095982 Oct 27 04:07:35.157069 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3589/6890] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:07:35 2022] GET /compute/v2.1/servers/3e03342d-57ef-4615-9eef-37e63af8bbae => generated 1187 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:07:36.178531 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-36fa1a59-decf-4295-a7f3-fdd16f477f2f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:07:36.179205 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-36fa1a59-decf-4295-a7f3-fdd16f477f2f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 3e03342d-57ef-4615-9eef-37e63af8bbae] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:07:36.186231 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-36fa1a59-decf-4295-a7f3-fdd16f477f2f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:07:36.186729 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-36fa1a59-decf-4295-a7f3-fdd16f477f2f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:07:36.187214 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-36fa1a59-decf-4295-a7f3-fdd16f477f2f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:07:36.187925 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-36fa1a59-decf-4295-a7f3-fdd16f477f2f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:07:36.188387 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-36fa1a59-decf-4295-a7f3-fdd16f477f2f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:07:36.188818 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-36fa1a59-decf-4295-a7f3-fdd16f477f2f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:07:36.221705 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-36fa1a59-decf-4295-a7f3-fdd16f477f2f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:07:36.222249 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-36fa1a59-decf-4295-a7f3-fdd16f477f2f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:07:36.222718 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-36fa1a59-decf-4295-a7f3-fdd16f477f2f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:07:36.223166 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-36fa1a59-decf-4295-a7f3-fdd16f477f2f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lazy-loading 'fault' on Instance uuid 3e03342d-57ef-4615-9eef-37e63af8bbae {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 04:07:36.266717 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-36fa1a59-decf-4295-a7f3-fdd16f477f2f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:07:36.275186 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-36fa1a59-decf-4295-a7f3-fdd16f477f2f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/3e03342d-57ef-4615-9eef-37e63af8bbae" status: 200 len: 1192 microversion: 2.1 time: 0.100644 Oct 27 04:07:36.275760 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3302/6891] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:07:36 2022] GET /compute/v2.1/servers/3e03342d-57ef-4615-9eef-37e63af8bbae => generated 1192 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:07:37.298840 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-689d10d8-86a1-4c1e-937f-0a3c436d1557 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:07:37.299552 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-689d10d8-86a1-4c1e-937f-0a3c436d1557 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 3e03342d-57ef-4615-9eef-37e63af8bbae] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:07:37.306516 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-689d10d8-86a1-4c1e-937f-0a3c436d1557 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:07:37.307015 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-689d10d8-86a1-4c1e-937f-0a3c436d1557 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:07:37.307465 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-689d10d8-86a1-4c1e-937f-0a3c436d1557 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:07:37.308167 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-689d10d8-86a1-4c1e-937f-0a3c436d1557 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:07:37.308628 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-689d10d8-86a1-4c1e-937f-0a3c436d1557 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:07:37.309064 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-689d10d8-86a1-4c1e-937f-0a3c436d1557 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:07:37.322389 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-689d10d8-86a1-4c1e-937f-0a3c436d1557 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] HTTP exception thrown: Instance 3e03342d-57ef-4615-9eef-37e63af8bbae could not be found. Oct 27 04:07:37.324042 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-689d10d8-86a1-4c1e-937f-0a3c436d1557 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Request method failure captured: Oct 27 04:07:37.324042 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/3e03342d-57ef-4615-9eef-37e63af8bbae HTTP/1.1 Oct 27 04:07:37.324042 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 04:07:37.324042 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 04:07:37.324042 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 04:07:37.324042 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 04:07:37.324042 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 04:07:37.324042 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 04:07:37.324042 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 04:07:37.324042 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 04:07:37.324042 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWgOy2vyGIZvCPgeKqR-dxD7jsV8GSZftvWG3pi0psQTYPv81ATvFSgHi31EMgn0x5NItteNYikimeQ9zcCw_dYQg7rFsVn9VSH-YqZAmUJa-ncyxVumv4r6CMnFhSrRbs_K6XB3pjXRcA1nWSk0V8vccKKBeZUitsa2lCn2gYQAw5hI Oct 27 04:07:37.324042 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 04:07:37.324042 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 04:07:37.324042 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 04:07:37.324042 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 04:07:37.324042 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 04:07:37.324042 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 04:07:37.324042 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 6a6a4f0161c94dc19682d70af00ba684 Oct 27 04:07:37.324042 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-TestVolumeBootPattern-1489988074 Oct 27 04:07:37.324042 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 04:07:37.324042 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 04:07:37.324042 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6a6a4f0161c94dc19682d70af00ba684"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6a6a4f0161c94dc19682d70af00ba684"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6a6a4f0161c94dc19682d70af00ba684"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6a6a4f0161c94dc19682d70af00ba684"}]}] Oct 27 04:07:37.324042 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-TestVolumeBootPattern-1489988074 Oct 27 04:07:37.324042 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 6a6a4f0161c94dc19682d70af00ba684 Oct 27 04:07:37.324042 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-TestVolumeBootPattern-1489988074 Oct 27 04:07:37.324042 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-TestVolumeBootPattern-1489988074-project Oct 27 04:07:37.324042 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 04:07:37.324042 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 04:07:37.324042 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: b7f5c179e8844542bca46d76042a6897 Oct 27 04:07:37.324042 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-TestVolumeBootPattern-1489988074-project Oct 27 04:07:37.324042 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 04:07:37.324042 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 3e03342d-57ef-4615-9eef-37e63af8bbae could not be found. Oct 27 04:07:37.324042 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '3e03342d-57ef-4615-9eef-37e63af8bbae'} Oct 27 04:07:37.324042 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 04:07:37.324042 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:07:37.324042 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 04:07:37.324042 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 04:07:37.324042 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 04:07:37.324042 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 04:07:37.324042 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 04:07:37.324042 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 04:07:37.324042 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 04:07:37.324042 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 04:07:37.324042 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e03342d-57ef-4615-9eef-37e63af8bbae could not be found. Oct 27 04:07:37.324042 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:07:37.324042 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:07:37.324042 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:07:37.324042 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:07:37.324042 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:07:37.324042 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:07:37.324042 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 04:07:37.324042 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 04:07:37.324042 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 04:07:37.324042 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 04:07:37.324042 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 04:07:37.324042 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 04:07:37.324042 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 04:07:37.324042 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 04:07:37.324042 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 04:07:37.324042 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 04:07:37.324042 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e03342d-57ef-4615-9eef-37e63af8bbae could not be found. Oct 27 04:07:37.324042 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:07:37.324042 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:07:37.324042 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:07:37.331985 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:07:37.331985 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:07:37.331985 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:07:37.331985 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 04:07:37.331985 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 04:07:37.331985 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e03342d-57ef-4615-9eef-37e63af8bbae could not be found. Oct 27 04:07:37.331985 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:07:37.331985 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-689d10d8-86a1-4c1e-937f-0a3c436d1557 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Returning 404 to user: Instance 3e03342d-57ef-4615-9eef-37e63af8bbae could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 04:07:37.331985 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-689d10d8-86a1-4c1e-937f-0a3c436d1557 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/3e03342d-57ef-4615-9eef-37e63af8bbae" status: 404 len: 111 microversion: 2.1 time: 0.030833 Oct 27 04:07:37.331985 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3590/6892] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:07:37 2022] GET /compute/v2.1/servers/3e03342d-57ef-4615-9eef-37e63af8bbae => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 04:08:09.121596 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-98bc7ee7-a2bf-43cb-8019-e9abe939c71a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1417854848", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "4b4c4f78-0c07-438e-a22f-e36f5f3036e0", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "b49d136e-c9db-4b4f-8210-57f6cfd2ff95"}]}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:08:09.132302 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:08:09.132962 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=14 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:08:09.214680 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-98bc7ee7-a2bf-43cb-8019-e9abe939c71a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] validate_networks() for [('b49d136e-c9db-4b4f-8210-57f6cfd2ff95', None, None, None, None, None)] {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 04:08:09.586886 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-98bc7ee7-a2bf-43cb-8019-e9abe939c71a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 04:08:09.587418 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-98bc7ee7-a2bf-43cb-8019-e9abe939c71a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 04:08:09.587908 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-98bc7ee7-a2bf-43cb-8019-e9abe939c71a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 04:08:09.588335 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-98bc7ee7-a2bf-43cb-8019-e9abe939c71a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 04:08:09.588766 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-98bc7ee7-a2bf-43cb-8019-e9abe939c71a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 04:08:09.599392 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-98bc7ee7-a2bf-43cb-8019-e9abe939c71a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:08:09.599893 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-98bc7ee7-a2bf-43cb-8019-e9abe939c71a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:08:09.600425 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-98bc7ee7-a2bf-43cb-8019-e9abe939c71a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:08:09.601088 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-98bc7ee7-a2bf-43cb-8019-e9abe939c71a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:08:09.601586 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-98bc7ee7-a2bf-43cb-8019-e9abe939c71a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:08:09.602024 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-98bc7ee7-a2bf-43cb-8019-e9abe939c71a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:08:09.620106 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-98bc7ee7-a2bf-43cb-8019-e9abe939c71a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Getting quotas for project 6a6a4f0161c94dc19682d70af00ba684. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 04:08:09.625848 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-98bc7ee7-a2bf-43cb-8019-e9abe939c71a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Getting quotas for user b7f5c179e8844542bca46d76042a6897 and project 6a6a4f0161c94dc19682d70af00ba684. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 04:08:09.639084 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-98bc7ee7-a2bf-43cb-8019-e9abe939c71a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 04:08:09.641163 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-98bc7ee7-a2bf-43cb-8019-e9abe939c71a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 3756aa96-3eea-4752-a6eb-7866f03e4acc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='4b4c4f78-0c07-438e-a22f-e36f5f3036e0',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 04:08:09.763930 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-98bc7ee7-a2bf-43cb-8019-e9abe939c71a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.646154 Oct 27 04:08:09.764767 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3303/6893] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 04:08:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 648 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 04:08:09.776525 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-fad2302b-922c-42a8-b6c6-97bc6b12d0bc tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:08:09.777220 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-fad2302b-922c-42a8-b6c6-97bc6b12d0bc tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 3756aa96-3eea-4752-a6eb-7866f03e4acc] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:08:09.780204 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=23 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:08:09.780866 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=59 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:08:09.852192 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-fad2302b-922c-42a8-b6c6-97bc6b12d0bc tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:08:09.859888 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-fad2302b-922c-42a8-b6c6-97bc6b12d0bc tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc" status: 200 len: 1057 microversion: 2.1 time: 0.087952 Oct 27 04:08:09.860807 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3591/6894] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:08:09 2022] GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc => generated 1057 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:08:10.885441 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-20f00f1c-6728-4b1b-82b3-181ab5a3890c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:08:10.886221 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-20f00f1c-6728-4b1b-82b3-181ab5a3890c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 3756aa96-3eea-4752-a6eb-7866f03e4acc] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:08:10.892685 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-20f00f1c-6728-4b1b-82b3-181ab5a3890c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:08:10.893287 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-20f00f1c-6728-4b1b-82b3-181ab5a3890c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:08:10.900109 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-20f00f1c-6728-4b1b-82b3-181ab5a3890c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:08:10.900109 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-20f00f1c-6728-4b1b-82b3-181ab5a3890c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:08:10.900109 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-20f00f1c-6728-4b1b-82b3-181ab5a3890c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:08:10.900109 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-20f00f1c-6728-4b1b-82b3-181ab5a3890c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:08:10.959506 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-20f00f1c-6728-4b1b-82b3-181ab5a3890c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:08:10.967735 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-20f00f1c-6728-4b1b-82b3-181ab5a3890c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc" status: 200 len: 1061 microversion: 2.1 time: 0.088252 Oct 27 04:08:10.968383 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3304/6895] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:08:10 2022] GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc => generated 1061 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 04:08:11.991760 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-bf9b0c33-bb57-425c-a9ca-e040957b7477 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:08:11.992293 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-bf9b0c33-bb57-425c-a9ca-e040957b7477 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 3756aa96-3eea-4752-a6eb-7866f03e4acc] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:08:12.003421 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bf9b0c33-bb57-425c-a9ca-e040957b7477 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:08:12.003421 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bf9b0c33-bb57-425c-a9ca-e040957b7477 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:08:12.003421 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bf9b0c33-bb57-425c-a9ca-e040957b7477 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:08:12.003421 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bf9b0c33-bb57-425c-a9ca-e040957b7477 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:08:12.003421 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bf9b0c33-bb57-425c-a9ca-e040957b7477 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:08:12.004164 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bf9b0c33-bb57-425c-a9ca-e040957b7477 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:08:12.075384 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-bf9b0c33-bb57-425c-a9ca-e040957b7477 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:08:12.091465 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-bf9b0c33-bb57-425c-a9ca-e040957b7477 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc" status: 200 len: 1117 microversion: 2.1 time: 0.103671 Oct 27 04:08:12.092054 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3592/6896] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:08:11 2022] GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc => generated 1117 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:08:13.122931 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5d0d6636-4355-4f5d-89df-201acf375a8f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:08:13.123619 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5d0d6636-4355-4f5d-89df-201acf375a8f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 3756aa96-3eea-4752-a6eb-7866f03e4acc] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:08:13.132054 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5d0d6636-4355-4f5d-89df-201acf375a8f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:08:13.133056 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5d0d6636-4355-4f5d-89df-201acf375a8f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:08:13.134121 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5d0d6636-4355-4f5d-89df-201acf375a8f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:08:13.135544 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5d0d6636-4355-4f5d-89df-201acf375a8f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:08:13.136636 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5d0d6636-4355-4f5d-89df-201acf375a8f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:08:13.137570 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5d0d6636-4355-4f5d-89df-201acf375a8f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:08:13.397756 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5d0d6636-4355-4f5d-89df-201acf375a8f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:08:13.407058 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5d0d6636-4355-4f5d-89df-201acf375a8f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc" status: 200 len: 1169 microversion: 2.1 time: 0.288069 Oct 27 04:08:13.407794 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3305/6897] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:08:13 2022] GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc => generated 1169 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:08:14.149728 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-1baaaa77-6d92-44ce-88c9-26cf49cd2fc6 req-f514196a-83d1-424e-9742-8b5d43f6e9e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3756aa96-3eea-4752-a6eb-7866f03e4acc", "tag": "5a497869-d6ab-408c-b1ab-a4adfe563df1"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:08:14.164335 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-1baaaa77-6d92-44ce-88c9-26cf49cd2fc6 req-f514196a-83d1-424e-9742-8b5d43f6e9e1 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:08:14.164840 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-1baaaa77-6d92-44ce-88c9-26cf49cd2fc6 req-f514196a-83d1-424e-9742-8b5d43f6e9e1 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:08:14.165290 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-1baaaa77-6d92-44ce-88c9-26cf49cd2fc6 req-f514196a-83d1-424e-9742-8b5d43f6e9e1 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:08:14.181667 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-1baaaa77-6d92-44ce-88c9-26cf49cd2fc6 req-f514196a-83d1-424e-9742-8b5d43f6e9e1 service nova] Creating event network-changed:5a497869-d6ab-408c-b1ab-a4adfe563df1 for instance 3756aa96-3eea-4752-a6eb-7866f03e4acc on n-h1-862769-1 Oct 27 04:08:14.190862 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-1baaaa77-6d92-44ce-88c9-26cf49cd2fc6 req-f514196a-83d1-424e-9742-8b5d43f6e9e1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044517 Oct 27 04:08:14.192896 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3593/6898] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:08:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:08:14.433760 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9b9f8d7e-4594-46f9-9f5b-670d5d8227eb tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:08:14.434438 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9b9f8d7e-4594-46f9-9f5b-670d5d8227eb tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 3756aa96-3eea-4752-a6eb-7866f03e4acc] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:08:14.441736 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9b9f8d7e-4594-46f9-9f5b-670d5d8227eb tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:08:14.442461 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9b9f8d7e-4594-46f9-9f5b-670d5d8227eb tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:08:14.443055 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9b9f8d7e-4594-46f9-9f5b-670d5d8227eb tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:08:14.443912 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9b9f8d7e-4594-46f9-9f5b-670d5d8227eb tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:08:14.444514 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9b9f8d7e-4594-46f9-9f5b-670d5d8227eb tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:08:14.445089 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9b9f8d7e-4594-46f9-9f5b-670d5d8227eb tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:08:14.997365 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9b9f8d7e-4594-46f9-9f5b-670d5d8227eb tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:08:15.006693 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9b9f8d7e-4594-46f9-9f5b-670d5d8227eb tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc" status: 200 len: 1169 microversion: 2.1 time: 0.575752 Oct 27 04:08:15.007880 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3306/6899] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:08:14 2022] GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc => generated 1169 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:08:16.030723 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-544921ff-05d6-430c-803f-cdb8181f9bcd tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:08:16.031659 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-544921ff-05d6-430c-803f-cdb8181f9bcd tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 3756aa96-3eea-4752-a6eb-7866f03e4acc] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:08:16.038489 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-544921ff-05d6-430c-803f-cdb8181f9bcd tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:08:16.038997 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-544921ff-05d6-430c-803f-cdb8181f9bcd tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:08:16.039452 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-544921ff-05d6-430c-803f-cdb8181f9bcd tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:08:16.040243 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-544921ff-05d6-430c-803f-cdb8181f9bcd tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:08:16.040714 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-544921ff-05d6-430c-803f-cdb8181f9bcd tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:08:16.041161 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-544921ff-05d6-430c-803f-cdb8181f9bcd tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:08:16.192899 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-544921ff-05d6-430c-803f-cdb8181f9bcd tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:08:16.201565 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-544921ff-05d6-430c-803f-cdb8181f9bcd tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc" status: 200 len: 1169 microversion: 2.1 time: 0.176319 Oct 27 04:08:16.210738 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3594/6900] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:08:16 2022] GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc => generated 1169 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:08:17.224986 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-cb75a851-fe51-4fbc-9720-04e90d244f3c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:08:17.225598 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-cb75a851-fe51-4fbc-9720-04e90d244f3c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 3756aa96-3eea-4752-a6eb-7866f03e4acc] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:08:17.232601 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cb75a851-fe51-4fbc-9720-04e90d244f3c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:08:17.233096 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cb75a851-fe51-4fbc-9720-04e90d244f3c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:08:17.233538 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cb75a851-fe51-4fbc-9720-04e90d244f3c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:08:17.234277 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cb75a851-fe51-4fbc-9720-04e90d244f3c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:08:17.234737 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cb75a851-fe51-4fbc-9720-04e90d244f3c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:08:17.235162 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cb75a851-fe51-4fbc-9720-04e90d244f3c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:08:17.383634 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-cb75a851-fe51-4fbc-9720-04e90d244f3c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:08:17.391652 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-cb75a851-fe51-4fbc-9720-04e90d244f3c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc" status: 200 len: 1169 microversion: 2.1 time: 0.170757 Oct 27 04:08:17.392237 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3307/6901] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:08:17 2022] GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc => generated 1169 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:08:18.419755 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8ff4a979-afe9-40a2-92bc-b788636574d9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:08:18.420369 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8ff4a979-afe9-40a2-92bc-b788636574d9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 3756aa96-3eea-4752-a6eb-7866f03e4acc] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:08:18.427105 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8ff4a979-afe9-40a2-92bc-b788636574d9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:08:18.427709 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8ff4a979-afe9-40a2-92bc-b788636574d9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:08:18.428482 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8ff4a979-afe9-40a2-92bc-b788636574d9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:08:18.428724 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8ff4a979-afe9-40a2-92bc-b788636574d9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:08:18.429684 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8ff4a979-afe9-40a2-92bc-b788636574d9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:08:18.431047 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8ff4a979-afe9-40a2-92bc-b788636574d9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:08:18.569102 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8ff4a979-afe9-40a2-92bc-b788636574d9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:08:18.577552 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8ff4a979-afe9-40a2-92bc-b788636574d9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc" status: 200 len: 1169 microversion: 2.1 time: 0.161743 Oct 27 04:08:18.578183 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3595/6902] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:08:18 2022] GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc => generated 1169 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 04:08:19.600903 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9aa3c739-3f5e-4b9c-84c0-dc59fd7c0106 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:08:19.601555 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9aa3c739-3f5e-4b9c-84c0-dc59fd7c0106 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 3756aa96-3eea-4752-a6eb-7866f03e4acc] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:08:19.607787 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:08:19.609290 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9aa3c739-3f5e-4b9c-84c0-dc59fd7c0106 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:08:19.609777 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9aa3c739-3f5e-4b9c-84c0-dc59fd7c0106 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:08:19.610250 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9aa3c739-3f5e-4b9c-84c0-dc59fd7c0106 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:08:19.611043 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9aa3c739-3f5e-4b9c-84c0-dc59fd7c0106 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:08:19.611509 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9aa3c739-3f5e-4b9c-84c0-dc59fd7c0106 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:08:19.611944 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9aa3c739-3f5e-4b9c-84c0-dc59fd7c0106 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:08:19.632939 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=6 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:08:19.744903 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9aa3c739-3f5e-4b9c-84c0-dc59fd7c0106 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:08:19.752893 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9aa3c739-3f5e-4b9c-84c0-dc59fd7c0106 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc" status: 200 len: 1169 microversion: 2.1 time: 0.155931 Oct 27 04:08:19.754121 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3308/6903] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:08:19 2022] GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc => generated 1169 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:08:20.777369 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-605d111d-6243-42c6-bf66-d1bb398cc83d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:08:20.778134 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-605d111d-6243-42c6-bf66-d1bb398cc83d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 3756aa96-3eea-4752-a6eb-7866f03e4acc] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:08:20.780985 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:08:20.788609 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-605d111d-6243-42c6-bf66-d1bb398cc83d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:08:20.789111 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-605d111d-6243-42c6-bf66-d1bb398cc83d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:08:20.789558 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-605d111d-6243-42c6-bf66-d1bb398cc83d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:08:20.790372 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-605d111d-6243-42c6-bf66-d1bb398cc83d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:08:20.790830 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-605d111d-6243-42c6-bf66-d1bb398cc83d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:08:20.791262 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-605d111d-6243-42c6-bf66-d1bb398cc83d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:08:20.942887 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-605d111d-6243-42c6-bf66-d1bb398cc83d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:08:20.953251 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-605d111d-6243-42c6-bf66-d1bb398cc83d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc" status: 200 len: 1169 microversion: 2.1 time: 0.179895 Oct 27 04:08:20.953961 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3596/6904] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:08:20 2022] GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc => generated 1169 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 04:08:21.979796 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-cc44cbda-077f-4266-a966-5471c5b916c7 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:08:21.980424 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-cc44cbda-077f-4266-a966-5471c5b916c7 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 3756aa96-3eea-4752-a6eb-7866f03e4acc] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:08:21.988052 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cc44cbda-077f-4266-a966-5471c5b916c7 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:08:21.988625 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cc44cbda-077f-4266-a966-5471c5b916c7 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:08:21.989079 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cc44cbda-077f-4266-a966-5471c5b916c7 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:08:21.989806 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cc44cbda-077f-4266-a966-5471c5b916c7 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:08:21.990306 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cc44cbda-077f-4266-a966-5471c5b916c7 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:08:21.990790 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cc44cbda-077f-4266-a966-5471c5b916c7 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:08:22.135699 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-cc44cbda-077f-4266-a966-5471c5b916c7 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:08:22.143587 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-cc44cbda-077f-4266-a966-5471c5b916c7 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc" status: 200 len: 1169 microversion: 2.1 time: 0.167655 Oct 27 04:08:22.144452 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3309/6905] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:08:21 2022] GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc => generated 1169 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:08:23.170340 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-bb1fd55b-6d26-4cec-9af8-05cc110d6d34 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:08:23.170975 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-bb1fd55b-6d26-4cec-9af8-05cc110d6d34 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 3756aa96-3eea-4752-a6eb-7866f03e4acc] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:08:23.178016 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bb1fd55b-6d26-4cec-9af8-05cc110d6d34 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:08:23.178549 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bb1fd55b-6d26-4cec-9af8-05cc110d6d34 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:08:23.179000 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bb1fd55b-6d26-4cec-9af8-05cc110d6d34 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:08:23.179723 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bb1fd55b-6d26-4cec-9af8-05cc110d6d34 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:08:23.180187 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bb1fd55b-6d26-4cec-9af8-05cc110d6d34 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:08:23.180627 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bb1fd55b-6d26-4cec-9af8-05cc110d6d34 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:08:23.317392 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-bb1fd55b-6d26-4cec-9af8-05cc110d6d34 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:08:23.326167 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-bb1fd55b-6d26-4cec-9af8-05cc110d6d34 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc" status: 200 len: 1169 microversion: 2.1 time: 0.159788 Oct 27 04:08:23.326747 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3597/6906] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:08:23 2022] GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc => generated 1169 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:08:24.348985 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-bb0ed7ca-30d8-4ed0-bff7-ddf42e53b166 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:08:24.349621 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-bb0ed7ca-30d8-4ed0-bff7-ddf42e53b166 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 3756aa96-3eea-4752-a6eb-7866f03e4acc] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:08:24.357429 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bb0ed7ca-30d8-4ed0-bff7-ddf42e53b166 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:08:24.358280 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bb0ed7ca-30d8-4ed0-bff7-ddf42e53b166 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:08:24.358556 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bb0ed7ca-30d8-4ed0-bff7-ddf42e53b166 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:08:24.359449 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bb0ed7ca-30d8-4ed0-bff7-ddf42e53b166 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:08:24.359921 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bb0ed7ca-30d8-4ed0-bff7-ddf42e53b166 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:08:24.360362 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bb0ed7ca-30d8-4ed0-bff7-ddf42e53b166 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:08:24.510271 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-bb0ed7ca-30d8-4ed0-bff7-ddf42e53b166 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:08:24.518260 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-bb0ed7ca-30d8-4ed0-bff7-ddf42e53b166 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc" status: 200 len: 1169 microversion: 2.1 time: 0.173309 Oct 27 04:08:24.518837 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3310/6907] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:08:24 2022] GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc => generated 1169 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:08:25.543669 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2851fee6-64f9-448b-bb75-2ac31bdd1ac0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:08:25.544327 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2851fee6-64f9-448b-bb75-2ac31bdd1ac0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 3756aa96-3eea-4752-a6eb-7866f03e4acc] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:08:25.551850 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2851fee6-64f9-448b-bb75-2ac31bdd1ac0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:08:25.552349 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2851fee6-64f9-448b-bb75-2ac31bdd1ac0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:08:25.552801 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2851fee6-64f9-448b-bb75-2ac31bdd1ac0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:08:25.553515 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2851fee6-64f9-448b-bb75-2ac31bdd1ac0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:08:25.553979 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2851fee6-64f9-448b-bb75-2ac31bdd1ac0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:08:25.554446 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2851fee6-64f9-448b-bb75-2ac31bdd1ac0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:08:25.693644 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2851fee6-64f9-448b-bb75-2ac31bdd1ac0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:08:25.703442 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2851fee6-64f9-448b-bb75-2ac31bdd1ac0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc" status: 200 len: 1169 microversion: 2.1 time: 0.163683 Oct 27 04:08:25.704030 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3598/6908] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:08:25 2022] GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc => generated 1169 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 04:08:26.728793 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-076cd5a7-69be-4ca1-bae2-dec8a8ef9b67 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:08:26.729516 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-076cd5a7-69be-4ca1-bae2-dec8a8ef9b67 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 3756aa96-3eea-4752-a6eb-7866f03e4acc] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:08:26.739945 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-076cd5a7-69be-4ca1-bae2-dec8a8ef9b67 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:08:26.740663 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-076cd5a7-69be-4ca1-bae2-dec8a8ef9b67 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:08:26.741209 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-076cd5a7-69be-4ca1-bae2-dec8a8ef9b67 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:08:26.742233 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-076cd5a7-69be-4ca1-bae2-dec8a8ef9b67 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:08:26.742719 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-076cd5a7-69be-4ca1-bae2-dec8a8ef9b67 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:08:26.743146 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-076cd5a7-69be-4ca1-bae2-dec8a8ef9b67 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:08:26.891367 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-076cd5a7-69be-4ca1-bae2-dec8a8ef9b67 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:08:26.902695 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-076cd5a7-69be-4ca1-bae2-dec8a8ef9b67 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc" status: 200 len: 1169 microversion: 2.1 time: 0.178599 Oct 27 04:08:26.903282 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3311/6909] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:08:26 2022] GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc => generated 1169 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:08:27.927306 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7fc483d9-487c-4a1a-95eb-a9ccc1aacf25 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:08:27.928667 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7fc483d9-487c-4a1a-95eb-a9ccc1aacf25 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 3756aa96-3eea-4752-a6eb-7866f03e4acc] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:08:27.935904 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7fc483d9-487c-4a1a-95eb-a9ccc1aacf25 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:08:27.936406 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7fc483d9-487c-4a1a-95eb-a9ccc1aacf25 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:08:27.936852 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7fc483d9-487c-4a1a-95eb-a9ccc1aacf25 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:08:27.937592 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7fc483d9-487c-4a1a-95eb-a9ccc1aacf25 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:08:27.938073 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7fc483d9-487c-4a1a-95eb-a9ccc1aacf25 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:08:27.938511 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7fc483d9-487c-4a1a-95eb-a9ccc1aacf25 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:08:28.087372 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7fc483d9-487c-4a1a-95eb-a9ccc1aacf25 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:08:28.095600 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7fc483d9-487c-4a1a-95eb-a9ccc1aacf25 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc" status: 200 len: 1169 microversion: 2.1 time: 0.172836 Oct 27 04:08:28.107549 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3599/6910] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:08:27 2022] GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc => generated 1169 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:08:29.120763 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4146898d-ec30-457e-a152-0a96bd18816a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:08:29.121424 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4146898d-ec30-457e-a152-0a96bd18816a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 3756aa96-3eea-4752-a6eb-7866f03e4acc] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:08:29.128821 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4146898d-ec30-457e-a152-0a96bd18816a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:08:29.129319 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4146898d-ec30-457e-a152-0a96bd18816a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:08:29.129775 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4146898d-ec30-457e-a152-0a96bd18816a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:08:29.131041 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4146898d-ec30-457e-a152-0a96bd18816a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:08:29.131524 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4146898d-ec30-457e-a152-0a96bd18816a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:08:29.131961 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4146898d-ec30-457e-a152-0a96bd18816a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:08:29.279435 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4146898d-ec30-457e-a152-0a96bd18816a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:08:29.290811 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4146898d-ec30-457e-a152-0a96bd18816a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc" status: 200 len: 1169 microversion: 2.1 time: 0.174023 Oct 27 04:08:29.291404 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3312/6911] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:08:29 2022] GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc => generated 1169 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:08:30.313730 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-cc9572d0-8a50-4792-a1b0-2303d90645ae tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:08:30.314476 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-cc9572d0-8a50-4792-a1b0-2303d90645ae tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 3756aa96-3eea-4752-a6eb-7866f03e4acc] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:08:30.322106 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cc9572d0-8a50-4792-a1b0-2303d90645ae tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:08:30.322704 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cc9572d0-8a50-4792-a1b0-2303d90645ae tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:08:30.323231 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cc9572d0-8a50-4792-a1b0-2303d90645ae tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:08:30.324020 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cc9572d0-8a50-4792-a1b0-2303d90645ae tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:08:30.324568 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cc9572d0-8a50-4792-a1b0-2303d90645ae tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:08:30.325100 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cc9572d0-8a50-4792-a1b0-2303d90645ae tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:08:30.462962 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-cc9572d0-8a50-4792-a1b0-2303d90645ae tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:08:30.471749 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-cc9572d0-8a50-4792-a1b0-2303d90645ae tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc" status: 200 len: 1169 microversion: 2.1 time: 0.162089 Oct 27 04:08:30.472346 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3600/6912] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:08:30 2022] GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc => generated 1169 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:08:31.498766 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ca1b5787-e49c-45d7-8b94-d08925fb0360 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:08:31.499394 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ca1b5787-e49c-45d7-8b94-d08925fb0360 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 3756aa96-3eea-4752-a6eb-7866f03e4acc] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:08:31.506489 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ca1b5787-e49c-45d7-8b94-d08925fb0360 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:08:31.507496 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ca1b5787-e49c-45d7-8b94-d08925fb0360 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:08:31.507938 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ca1b5787-e49c-45d7-8b94-d08925fb0360 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:08:31.508643 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ca1b5787-e49c-45d7-8b94-d08925fb0360 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:08:31.509110 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ca1b5787-e49c-45d7-8b94-d08925fb0360 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:08:31.509548 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ca1b5787-e49c-45d7-8b94-d08925fb0360 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:08:31.649051 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ca1b5787-e49c-45d7-8b94-d08925fb0360 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:08:31.657008 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ca1b5787-e49c-45d7-8b94-d08925fb0360 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc" status: 200 len: 1169 microversion: 2.1 time: 0.164290 Oct 27 04:08:31.657599 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3313/6913] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:08:31 2022] GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc => generated 1169 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:08:32.682255 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0237dde6-cd77-42f4-a9d3-e276104da196 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:08:32.682915 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0237dde6-cd77-42f4-a9d3-e276104da196 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 3756aa96-3eea-4752-a6eb-7866f03e4acc] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:08:32.690404 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0237dde6-cd77-42f4-a9d3-e276104da196 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:08:32.690923 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0237dde6-cd77-42f4-a9d3-e276104da196 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:08:32.691380 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0237dde6-cd77-42f4-a9d3-e276104da196 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:08:32.692118 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0237dde6-cd77-42f4-a9d3-e276104da196 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:08:32.692614 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0237dde6-cd77-42f4-a9d3-e276104da196 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:08:32.693039 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0237dde6-cd77-42f4-a9d3-e276104da196 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:08:32.831582 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0237dde6-cd77-42f4-a9d3-e276104da196 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:08:32.840118 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0237dde6-cd77-42f4-a9d3-e276104da196 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc" status: 200 len: 1169 microversion: 2.1 time: 0.162754 Oct 27 04:08:32.855109 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3601/6914] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:08:32 2022] GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc => generated 1169 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:08:33.865465 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b6b0d881-4c98-4f95-b0a8-eac0488d0a23 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:08:33.865976 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b6b0d881-4c98-4f95-b0a8-eac0488d0a23 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 3756aa96-3eea-4752-a6eb-7866f03e4acc] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:08:33.873431 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b6b0d881-4c98-4f95-b0a8-eac0488d0a23 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:08:33.873923 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b6b0d881-4c98-4f95-b0a8-eac0488d0a23 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:08:33.874465 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b6b0d881-4c98-4f95-b0a8-eac0488d0a23 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:08:33.875174 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b6b0d881-4c98-4f95-b0a8-eac0488d0a23 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:08:33.875634 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b6b0d881-4c98-4f95-b0a8-eac0488d0a23 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:08:33.876070 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b6b0d881-4c98-4f95-b0a8-eac0488d0a23 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:08:34.015825 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b6b0d881-4c98-4f95-b0a8-eac0488d0a23 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:08:34.023768 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b6b0d881-4c98-4f95-b0a8-eac0488d0a23 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc" status: 200 len: 1169 microversion: 2.1 time: 0.162702 Oct 27 04:08:34.029081 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3314/6915] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:08:33 2022] GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc => generated 1169 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:08:35.046652 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3a556249-f06e-4810-81ae-a37fed9acd72 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:08:35.047319 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3a556249-f06e-4810-81ae-a37fed9acd72 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 3756aa96-3eea-4752-a6eb-7866f03e4acc] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:08:35.054223 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3a556249-f06e-4810-81ae-a37fed9acd72 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:08:35.054725 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3a556249-f06e-4810-81ae-a37fed9acd72 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:08:35.055202 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3a556249-f06e-4810-81ae-a37fed9acd72 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:08:35.055897 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3a556249-f06e-4810-81ae-a37fed9acd72 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:08:35.056361 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3a556249-f06e-4810-81ae-a37fed9acd72 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:08:35.056860 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3a556249-f06e-4810-81ae-a37fed9acd72 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:08:35.200333 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3a556249-f06e-4810-81ae-a37fed9acd72 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:08:35.208373 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3a556249-f06e-4810-81ae-a37fed9acd72 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc" status: 200 len: 1169 microversion: 2.1 time: 0.165737 Oct 27 04:08:35.208945 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3602/6916] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:08:35 2022] GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc => generated 1169 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:08:36.231738 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a4e22643-3efe-481e-80a9-2b287035cc00 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:08:36.232369 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a4e22643-3efe-481e-80a9-2b287035cc00 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 3756aa96-3eea-4752-a6eb-7866f03e4acc] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:08:36.238957 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a4e22643-3efe-481e-80a9-2b287035cc00 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:08:36.239538 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a4e22643-3efe-481e-80a9-2b287035cc00 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:08:36.239983 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a4e22643-3efe-481e-80a9-2b287035cc00 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:08:36.240677 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a4e22643-3efe-481e-80a9-2b287035cc00 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:08:36.241679 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a4e22643-3efe-481e-80a9-2b287035cc00 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:08:36.242132 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a4e22643-3efe-481e-80a9-2b287035cc00 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:08:36.387672 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a4e22643-3efe-481e-80a9-2b287035cc00 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:08:36.395720 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a4e22643-3efe-481e-80a9-2b287035cc00 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc" status: 200 len: 1169 microversion: 2.1 time: 0.168210 Oct 27 04:08:36.396477 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3315/6917] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:08:36 2022] GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc => generated 1169 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:08:37.418674 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a5f43e97-46be-4465-bcdd-79f950714162 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:08:37.419229 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a5f43e97-46be-4465-bcdd-79f950714162 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 3756aa96-3eea-4752-a6eb-7866f03e4acc] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:08:37.426277 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a5f43e97-46be-4465-bcdd-79f950714162 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:08:37.426772 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a5f43e97-46be-4465-bcdd-79f950714162 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:08:37.427219 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a5f43e97-46be-4465-bcdd-79f950714162 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:08:37.427921 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a5f43e97-46be-4465-bcdd-79f950714162 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:08:37.428387 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a5f43e97-46be-4465-bcdd-79f950714162 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:08:37.428870 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a5f43e97-46be-4465-bcdd-79f950714162 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:08:37.564661 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a5f43e97-46be-4465-bcdd-79f950714162 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:08:37.572998 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a5f43e97-46be-4465-bcdd-79f950714162 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc" status: 200 len: 1169 microversion: 2.1 time: 0.158547 Oct 27 04:08:37.573580 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3603/6918] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:08:37 2022] GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc => generated 1169 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:08:38.609892 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-637eb79b-25d9-4bb4-aa8b-bd26fea0efff tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:08:38.609892 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-637eb79b-25d9-4bb4-aa8b-bd26fea0efff tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 3756aa96-3eea-4752-a6eb-7866f03e4acc] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:08:38.609892 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-637eb79b-25d9-4bb4-aa8b-bd26fea0efff tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:08:38.609892 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-637eb79b-25d9-4bb4-aa8b-bd26fea0efff tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:08:38.609892 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-637eb79b-25d9-4bb4-aa8b-bd26fea0efff tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:08:38.609892 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-637eb79b-25d9-4bb4-aa8b-bd26fea0efff tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:08:38.609892 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-637eb79b-25d9-4bb4-aa8b-bd26fea0efff tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:08:38.609892 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-637eb79b-25d9-4bb4-aa8b-bd26fea0efff tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:08:38.762502 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-637eb79b-25d9-4bb4-aa8b-bd26fea0efff tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:08:38.771359 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-637eb79b-25d9-4bb4-aa8b-bd26fea0efff tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc" status: 200 len: 1169 microversion: 2.1 time: 0.178843 Oct 27 04:08:38.772154 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3316/6919] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:08:38 2022] GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc => generated 1169 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:08:39.794944 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f8ff9993-830a-4676-a0f4-3388625abc6d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:08:39.795574 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f8ff9993-830a-4676-a0f4-3388625abc6d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 3756aa96-3eea-4752-a6eb-7866f03e4acc] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:08:39.802914 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f8ff9993-830a-4676-a0f4-3388625abc6d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:08:39.803409 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f8ff9993-830a-4676-a0f4-3388625abc6d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:08:39.803880 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f8ff9993-830a-4676-a0f4-3388625abc6d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:08:39.804587 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f8ff9993-830a-4676-a0f4-3388625abc6d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:08:39.805054 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f8ff9993-830a-4676-a0f4-3388625abc6d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:08:39.805507 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f8ff9993-830a-4676-a0f4-3388625abc6d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:08:39.944899 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f8ff9993-830a-4676-a0f4-3388625abc6d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:08:39.947415 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=73 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:08:39.955230 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f8ff9993-830a-4676-a0f4-3388625abc6d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc" status: 200 len: 1169 microversion: 2.1 time: 0.164140 Oct 27 04:08:39.963379 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3604/6920] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:08:39 2022] GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc => generated 1169 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:08:40.978927 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-67b142ce-40d4-4efc-9d1a-70729b8f7a77 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:08:40.979551 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-67b142ce-40d4-4efc-9d1a-70729b8f7a77 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 3756aa96-3eea-4752-a6eb-7866f03e4acc] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:08:40.982368 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:08:40.987156 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-67b142ce-40d4-4efc-9d1a-70729b8f7a77 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:08:40.987668 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-67b142ce-40d4-4efc-9d1a-70729b8f7a77 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:08:40.988123 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-67b142ce-40d4-4efc-9d1a-70729b8f7a77 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:08:40.988831 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-67b142ce-40d4-4efc-9d1a-70729b8f7a77 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:08:40.989296 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-67b142ce-40d4-4efc-9d1a-70729b8f7a77 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:08:40.989727 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-67b142ce-40d4-4efc-9d1a-70729b8f7a77 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:08:40.992963 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=81 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:08:41.153052 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-67b142ce-40d4-4efc-9d1a-70729b8f7a77 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:08:41.161573 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-67b142ce-40d4-4efc-9d1a-70729b8f7a77 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc" status: 200 len: 1169 microversion: 2.1 time: 0.186658 Oct 27 04:08:41.162194 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3317/6921] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:08:40 2022] GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc => generated 1169 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:08:42.191615 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ea351d9b-b17f-4a53-8525-d1d723e16e63 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:08:42.192476 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ea351d9b-b17f-4a53-8525-d1d723e16e63 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 3756aa96-3eea-4752-a6eb-7866f03e4acc] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:08:42.195318 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=31 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:08:42.202069 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ea351d9b-b17f-4a53-8525-d1d723e16e63 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:08:42.202613 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ea351d9b-b17f-4a53-8525-d1d723e16e63 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:08:42.203123 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ea351d9b-b17f-4a53-8525-d1d723e16e63 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:08:42.203932 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ea351d9b-b17f-4a53-8525-d1d723e16e63 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:08:42.204399 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ea351d9b-b17f-4a53-8525-d1d723e16e63 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:08:42.204835 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ea351d9b-b17f-4a53-8525-d1d723e16e63 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:08:42.358909 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ea351d9b-b17f-4a53-8525-d1d723e16e63 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:08:42.367798 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ea351d9b-b17f-4a53-8525-d1d723e16e63 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc" status: 200 len: 1169 microversion: 2.1 time: 0.186508 Oct 27 04:08:42.368379 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3605/6922] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:08:42 2022] GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc => generated 1169 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 04:08:43.390851 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9343f85b-9e1c-47dc-b176-5e498fffaa45 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:08:43.391475 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9343f85b-9e1c-47dc-b176-5e498fffaa45 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 3756aa96-3eea-4752-a6eb-7866f03e4acc] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:08:43.399622 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9343f85b-9e1c-47dc-b176-5e498fffaa45 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:08:43.400052 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9343f85b-9e1c-47dc-b176-5e498fffaa45 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:08:43.400496 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9343f85b-9e1c-47dc-b176-5e498fffaa45 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:08:43.401219 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9343f85b-9e1c-47dc-b176-5e498fffaa45 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:08:43.401681 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9343f85b-9e1c-47dc-b176-5e498fffaa45 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:08:43.402325 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9343f85b-9e1c-47dc-b176-5e498fffaa45 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:08:43.551334 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9343f85b-9e1c-47dc-b176-5e498fffaa45 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:08:43.559275 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9343f85b-9e1c-47dc-b176-5e498fffaa45 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc" status: 200 len: 1215 microversion: 2.1 time: 0.172330 Oct 27 04:08:43.559842 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3318/6923] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:08:43 2022] GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc => generated 1215 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:08:44.584094 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0c030b70-ce4e-4834-87b9-ca63313fc9b6 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:08:44.584723 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0c030b70-ce4e-4834-87b9-ca63313fc9b6 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 3756aa96-3eea-4752-a6eb-7866f03e4acc] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:08:44.592367 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0c030b70-ce4e-4834-87b9-ca63313fc9b6 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:08:44.592864 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0c030b70-ce4e-4834-87b9-ca63313fc9b6 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:08:44.593315 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0c030b70-ce4e-4834-87b9-ca63313fc9b6 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:08:44.594016 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0c030b70-ce4e-4834-87b9-ca63313fc9b6 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:08:44.594506 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0c030b70-ce4e-4834-87b9-ca63313fc9b6 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:08:44.594942 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0c030b70-ce4e-4834-87b9-ca63313fc9b6 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:08:44.729454 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0c030b70-ce4e-4834-87b9-ca63313fc9b6 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:08:44.737462 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0c030b70-ce4e-4834-87b9-ca63313fc9b6 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc" status: 200 len: 1203 microversion: 2.1 time: 0.157333 Oct 27 04:08:44.738080 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3606/6924] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:08:44 2022] GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc => generated 1203 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:08:45.760547 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7caabf58-c73f-4b92-b22e-7067f2c8d6a9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:08:45.761200 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7caabf58-c73f-4b92-b22e-7067f2c8d6a9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 3756aa96-3eea-4752-a6eb-7866f03e4acc] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:08:45.768338 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7caabf58-c73f-4b92-b22e-7067f2c8d6a9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:08:45.768834 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7caabf58-c73f-4b92-b22e-7067f2c8d6a9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:08:45.769275 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7caabf58-c73f-4b92-b22e-7067f2c8d6a9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:08:45.769994 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7caabf58-c73f-4b92-b22e-7067f2c8d6a9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:08:45.770494 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7caabf58-c73f-4b92-b22e-7067f2c8d6a9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:08:45.770922 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7caabf58-c73f-4b92-b22e-7067f2c8d6a9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:08:45.911859 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7caabf58-c73f-4b92-b22e-7067f2c8d6a9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:08:45.921002 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7caabf58-c73f-4b92-b22e-7067f2c8d6a9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc" status: 200 len: 1203 microversion: 2.1 time: 0.164487 Oct 27 04:08:45.921609 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3319/6925] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:08:45 2022] GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc => generated 1203 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:08:46.945759 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e73576f6-c402-4518-9d46-33b97cf79457 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:08:46.946416 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e73576f6-c402-4518-9d46-33b97cf79457 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 3756aa96-3eea-4752-a6eb-7866f03e4acc] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:08:46.953425 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e73576f6-c402-4518-9d46-33b97cf79457 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:08:46.953957 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e73576f6-c402-4518-9d46-33b97cf79457 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:08:46.954442 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e73576f6-c402-4518-9d46-33b97cf79457 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:08:46.955178 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e73576f6-c402-4518-9d46-33b97cf79457 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:08:46.956590 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e73576f6-c402-4518-9d46-33b97cf79457 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:08:46.956590 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e73576f6-c402-4518-9d46-33b97cf79457 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:08:47.089284 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e73576f6-c402-4518-9d46-33b97cf79457 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:08:47.097238 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e73576f6-c402-4518-9d46-33b97cf79457 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc" status: 200 len: 1203 microversion: 2.1 time: 0.156255 Oct 27 04:08:47.098065 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3607/6926] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:08:46 2022] GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc => generated 1203 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:08:48.120644 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-aed6d165-d5b7-454b-9d1c-587d76900a67 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:08:48.121371 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-aed6d165-d5b7-454b-9d1c-587d76900a67 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 3756aa96-3eea-4752-a6eb-7866f03e4acc] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:08:48.128248 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aed6d165-d5b7-454b-9d1c-587d76900a67 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:08:48.128738 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aed6d165-d5b7-454b-9d1c-587d76900a67 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:08:48.129174 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aed6d165-d5b7-454b-9d1c-587d76900a67 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:08:48.129870 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aed6d165-d5b7-454b-9d1c-587d76900a67 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:08:48.130405 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aed6d165-d5b7-454b-9d1c-587d76900a67 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:08:48.130839 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aed6d165-d5b7-454b-9d1c-587d76900a67 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:08:48.270985 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-aed6d165-d5b7-454b-9d1c-587d76900a67 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:08:48.279597 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-aed6d165-d5b7-454b-9d1c-587d76900a67 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc" status: 200 len: 1203 microversion: 2.1 time: 0.163402 Oct 27 04:08:48.280361 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3320/6927] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:08:48 2022] GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc => generated 1203 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:08:49.304241 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f23bf849-a1b5-434c-b16a-4f0d1f8586fb tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:08:49.305520 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f23bf849-a1b5-434c-b16a-4f0d1f8586fb tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 3756aa96-3eea-4752-a6eb-7866f03e4acc] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:08:49.314086 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f23bf849-a1b5-434c-b16a-4f0d1f8586fb tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:08:49.314667 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f23bf849-a1b5-434c-b16a-4f0d1f8586fb tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:08:49.315120 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f23bf849-a1b5-434c-b16a-4f0d1f8586fb tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:08:49.315837 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f23bf849-a1b5-434c-b16a-4f0d1f8586fb tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:08:49.316299 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f23bf849-a1b5-434c-b16a-4f0d1f8586fb tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:08:49.316735 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f23bf849-a1b5-434c-b16a-4f0d1f8586fb tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:08:49.452016 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f23bf849-a1b5-434c-b16a-4f0d1f8586fb tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:08:49.459942 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f23bf849-a1b5-434c-b16a-4f0d1f8586fb tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc" status: 200 len: 1203 microversion: 2.1 time: 0.160765 Oct 27 04:08:49.460517 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3608/6928] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:08:49 2022] GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc => generated 1203 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:08:50.482759 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-acc2d1b9-114c-4162-834c-87ff57632c86 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:08:50.483426 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-acc2d1b9-114c-4162-834c-87ff57632c86 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 3756aa96-3eea-4752-a6eb-7866f03e4acc] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:08:50.490491 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-acc2d1b9-114c-4162-834c-87ff57632c86 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:08:50.490983 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-acc2d1b9-114c-4162-834c-87ff57632c86 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:08:50.492273 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-acc2d1b9-114c-4162-834c-87ff57632c86 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:08:50.492977 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-acc2d1b9-114c-4162-834c-87ff57632c86 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:08:50.493437 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-acc2d1b9-114c-4162-834c-87ff57632c86 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:08:50.493865 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-acc2d1b9-114c-4162-834c-87ff57632c86 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:08:50.636887 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-acc2d1b9-114c-4162-834c-87ff57632c86 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:08:50.644782 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-acc2d1b9-114c-4162-834c-87ff57632c86 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc" status: 200 len: 1203 microversion: 2.1 time: 0.165903 Oct 27 04:08:50.645366 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3321/6929] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:08:50 2022] GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc => generated 1203 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:08:51.669026 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-fb75ea2f-da35-4a2b-a5e2-22035a9d1928 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:08:51.669580 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-fb75ea2f-da35-4a2b-a5e2-22035a9d1928 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 3756aa96-3eea-4752-a6eb-7866f03e4acc] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:08:51.676608 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fb75ea2f-da35-4a2b-a5e2-22035a9d1928 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:08:51.677100 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fb75ea2f-da35-4a2b-a5e2-22035a9d1928 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:08:51.677543 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fb75ea2f-da35-4a2b-a5e2-22035a9d1928 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:08:51.678272 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fb75ea2f-da35-4a2b-a5e2-22035a9d1928 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:08:51.679393 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fb75ea2f-da35-4a2b-a5e2-22035a9d1928 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:08:51.679860 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fb75ea2f-da35-4a2b-a5e2-22035a9d1928 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:08:51.814771 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-fb75ea2f-da35-4a2b-a5e2-22035a9d1928 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:08:51.824807 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-fb75ea2f-da35-4a2b-a5e2-22035a9d1928 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc" status: 200 len: 1203 microversion: 2.1 time: 0.159757 Oct 27 04:08:51.825436 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3609/6930] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:08:51 2022] GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc => generated 1203 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:08:52.847732 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-de25e369-1810-4615-989b-d1571120a55a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:08:52.848287 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-de25e369-1810-4615-989b-d1571120a55a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 3756aa96-3eea-4752-a6eb-7866f03e4acc] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:08:52.855179 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-de25e369-1810-4615-989b-d1571120a55a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:08:52.855669 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-de25e369-1810-4615-989b-d1571120a55a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:08:52.856113 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-de25e369-1810-4615-989b-d1571120a55a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:08:52.856814 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-de25e369-1810-4615-989b-d1571120a55a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:08:52.857276 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-de25e369-1810-4615-989b-d1571120a55a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:08:52.857710 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-de25e369-1810-4615-989b-d1571120a55a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:08:53.020420 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-de25e369-1810-4615-989b-d1571120a55a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:08:53.028824 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-de25e369-1810-4615-989b-d1571120a55a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc" status: 200 len: 1203 microversion: 2.1 time: 0.185092 Oct 27 04:08:53.029411 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3322/6931] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:08:52 2022] GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc => generated 1203 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:08:53.179660 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-6551b30f-9591-42b4-9e8a-6d5df7898877 req-a4c46e34-0896-40fd-b1ee-38dd8fd89f3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3756aa96-3eea-4752-a6eb-7866f03e4acc", "name": "network-vif-plugged", "status": "completed", "tag": "5a497869-d6ab-408c-b1ab-a4adfe563df1"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:08:53.189855 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-6551b30f-9591-42b4-9e8a-6d5df7898877 req-a4c46e34-0896-40fd-b1ee-38dd8fd89f3a service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:08:53.190369 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-6551b30f-9591-42b4-9e8a-6d5df7898877 req-a4c46e34-0896-40fd-b1ee-38dd8fd89f3a service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:08:53.190813 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-6551b30f-9591-42b4-9e8a-6d5df7898877 req-a4c46e34-0896-40fd-b1ee-38dd8fd89f3a service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:08:53.202640 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-6551b30f-9591-42b4-9e8a-6d5df7898877 req-a4c46e34-0896-40fd-b1ee-38dd8fd89f3a service nova] Creating event network-vif-plugged:5a497869-d6ab-408c-b1ab-a4adfe563df1 for instance 3756aa96-3eea-4752-a6eb-7866f03e4acc on n-h1-862769-1 Oct 27 04:08:53.207904 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-6551b30f-9591-42b4-9e8a-6d5df7898877 req-a4c46e34-0896-40fd-b1ee-38dd8fd89f3a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165954 Oct 27 04:08:53.208537 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3610/6932] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:08:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:08:54.052535 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b194ae94-61fa-4d73-86c7-88741323c418 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:08:54.053179 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b194ae94-61fa-4d73-86c7-88741323c418 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 3756aa96-3eea-4752-a6eb-7866f03e4acc] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:08:54.060175 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b194ae94-61fa-4d73-86c7-88741323c418 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:08:54.060670 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b194ae94-61fa-4d73-86c7-88741323c418 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:08:54.061117 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b194ae94-61fa-4d73-86c7-88741323c418 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:08:54.061821 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b194ae94-61fa-4d73-86c7-88741323c418 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:08:54.062312 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b194ae94-61fa-4d73-86c7-88741323c418 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:08:54.062752 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b194ae94-61fa-4d73-86c7-88741323c418 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:08:54.199930 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b194ae94-61fa-4d73-86c7-88741323c418 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:08:54.208148 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b194ae94-61fa-4d73-86c7-88741323c418 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc" status: 200 len: 1203 microversion: 2.1 time: 0.159663 Oct 27 04:08:54.208734 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3323/6933] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:08:54 2022] GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc => generated 1203 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:08:55.232508 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-91b768c1-4270-41f0-90d5-d50c2c5c29dc tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:08:55.233224 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-91b768c1-4270-41f0-90d5-d50c2c5c29dc tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 3756aa96-3eea-4752-a6eb-7866f03e4acc] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:08:55.240690 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-91b768c1-4270-41f0-90d5-d50c2c5c29dc tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:08:55.241184 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-91b768c1-4270-41f0-90d5-d50c2c5c29dc tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:08:55.241686 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-91b768c1-4270-41f0-90d5-d50c2c5c29dc tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:08:55.242433 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-91b768c1-4270-41f0-90d5-d50c2c5c29dc tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:08:55.242895 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-91b768c1-4270-41f0-90d5-d50c2c5c29dc tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:08:55.243512 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-91b768c1-4270-41f0-90d5-d50c2c5c29dc tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:08:55.381115 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-91b768c1-4270-41f0-90d5-d50c2c5c29dc tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:08:55.389551 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-91b768c1-4270-41f0-90d5-d50c2c5c29dc tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc" status: 200 len: 1390 microversion: 2.1 time: 0.161240 Oct 27 04:08:55.390162 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3611/6934] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:08:55 2022] GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc => generated 1390 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:08:55.412901 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-518039e3-45fc-4f7c-96c5-4a5218f3c2d0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:08:55.413532 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-518039e3-45fc-4f7c-96c5-4a5218f3c2d0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 3756aa96-3eea-4752-a6eb-7866f03e4acc] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:08:55.421126 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-518039e3-45fc-4f7c-96c5-4a5218f3c2d0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:08:55.421631 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-518039e3-45fc-4f7c-96c5-4a5218f3c2d0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:08:55.422110 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-518039e3-45fc-4f7c-96c5-4a5218f3c2d0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:08:55.422854 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-518039e3-45fc-4f7c-96c5-4a5218f3c2d0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:08:55.423324 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-518039e3-45fc-4f7c-96c5-4a5218f3c2d0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:08:55.423774 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-518039e3-45fc-4f7c-96c5-4a5218f3c2d0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:08:55.563038 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-518039e3-45fc-4f7c-96c5-4a5218f3c2d0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:08:55.567041 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-518039e3-45fc-4f7c-96c5-4a5218f3c2d0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc" status: 200 len: 1390 microversion: 2.1 time: 0.158316 Oct 27 04:08:55.567631 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3324/6935] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:08:55 2022] GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc => generated 1390 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:08:55.590529 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-55bdd124-5c8c-43b3-9449-d47e239b7fcb tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:08:55.591195 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-55bdd124-5c8c-43b3-9449-d47e239b7fcb tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 3756aa96-3eea-4752-a6eb-7866f03e4acc] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:08:55.597144 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-55bdd124-5c8c-43b3-9449-d47e239b7fcb tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:08:55.597640 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-55bdd124-5c8c-43b3-9449-d47e239b7fcb tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:08:55.598115 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-55bdd124-5c8c-43b3-9449-d47e239b7fcb tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:08:55.598827 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-55bdd124-5c8c-43b3-9449-d47e239b7fcb tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:08:55.599291 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-55bdd124-5c8c-43b3-9449-d47e239b7fcb tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:08:55.599724 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-55bdd124-5c8c-43b3-9449-d47e239b7fcb tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:08:55.738010 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-55bdd124-5c8c-43b3-9449-d47e239b7fcb tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:08:55.747059 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-55bdd124-5c8c-43b3-9449-d47e239b7fcb tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc" status: 200 len: 1390 microversion: 2.1 time: 0.160382 Oct 27 04:08:55.747639 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3612/6936] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:08:55 2022] GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc => generated 1390 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:08:55.834613 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-701e7940-e7b3-4f4d-a9a4-31512b414d3c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:08:55.835151 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-701e7940-e7b3-4f4d-a9a4-31512b414d3c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 3756aa96-3eea-4752-a6eb-7866f03e4acc] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:08:55.841196 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-701e7940-e7b3-4f4d-a9a4-31512b414d3c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:08:55.841685 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-701e7940-e7b3-4f4d-a9a4-31512b414d3c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:08:55.842156 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-701e7940-e7b3-4f4d-a9a4-31512b414d3c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:08:55.842855 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-701e7940-e7b3-4f4d-a9a4-31512b414d3c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:08:55.843312 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-701e7940-e7b3-4f4d-a9a4-31512b414d3c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:08:55.843791 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-701e7940-e7b3-4f4d-a9a4-31512b414d3c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:08:55.868468 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-701e7940-e7b3-4f4d-a9a4-31512b414d3c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 3756aa96-3eea-4752-a6eb-7866f03e4acc] Going to try to terminate instance {{(pid=121000) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 04:08:56.173859 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-701e7940-e7b3-4f4d-a9a4-31512b414d3c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc" status: 204 len: 0 microversion: 2.1 time: 0.342893 Oct 27 04:08:56.174580 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3325/6937] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 04:08:55 2022] DELETE /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 04:08:56.183495 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f4c7af3d-c6fb-4fd5-ab6c-c3178bd5f3d6 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:08:56.184231 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f4c7af3d-c6fb-4fd5-ab6c-c3178bd5f3d6 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 3756aa96-3eea-4752-a6eb-7866f03e4acc] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:08:56.190725 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f4c7af3d-c6fb-4fd5-ab6c-c3178bd5f3d6 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:08:56.191231 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f4c7af3d-c6fb-4fd5-ab6c-c3178bd5f3d6 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:08:56.191685 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f4c7af3d-c6fb-4fd5-ab6c-c3178bd5f3d6 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:08:56.192410 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f4c7af3d-c6fb-4fd5-ab6c-c3178bd5f3d6 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:08:56.192875 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f4c7af3d-c6fb-4fd5-ab6c-c3178bd5f3d6 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:08:56.193308 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f4c7af3d-c6fb-4fd5-ab6c-c3178bd5f3d6 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:08:56.323669 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f4c7af3d-c6fb-4fd5-ab6c-c3178bd5f3d6 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:08:56.331811 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f4c7af3d-c6fb-4fd5-ab6c-c3178bd5f3d6 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc" status: 200 len: 1396 microversion: 2.1 time: 0.152993 Oct 27 04:08:56.332390 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3613/6938] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:08:56 2022] GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc => generated 1396 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:08:57.356392 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-210f4f09-8739-4063-ac2e-210dfa0141c0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:08:57.357446 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-210f4f09-8739-4063-ac2e-210dfa0141c0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 3756aa96-3eea-4752-a6eb-7866f03e4acc] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:08:57.364325 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-210f4f09-8739-4063-ac2e-210dfa0141c0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:08:57.364822 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-210f4f09-8739-4063-ac2e-210dfa0141c0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:08:57.365514 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-210f4f09-8739-4063-ac2e-210dfa0141c0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:08:57.367053 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-210f4f09-8739-4063-ac2e-210dfa0141c0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:08:57.367521 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-210f4f09-8739-4063-ac2e-210dfa0141c0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:08:57.367959 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-210f4f09-8739-4063-ac2e-210dfa0141c0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:08:57.503597 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-210f4f09-8739-4063-ac2e-210dfa0141c0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:08:57.516310 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-210f4f09-8739-4063-ac2e-210dfa0141c0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc" status: 200 len: 1396 microversion: 2.1 time: 0.164711 Oct 27 04:08:57.517006 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3326/6939] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:08:57 2022] GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc => generated 1396 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:08:58.368128 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-f1488120-3f39-4563-8b98-5c832ba055cb req-9cc2c61a-1b55-4362-8ac6-55a38ac1e5c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3756aa96-3eea-4752-a6eb-7866f03e4acc", "name": "network-vif-deleted", "tag": "5a497869-d6ab-408c-b1ab-a4adfe563df1"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:08:58.384660 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-f1488120-3f39-4563-8b98-5c832ba055cb req-9cc2c61a-1b55-4362-8ac6-55a38ac1e5c5 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:08:58.386938 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-f1488120-3f39-4563-8b98-5c832ba055cb req-9cc2c61a-1b55-4362-8ac6-55a38ac1e5c5 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:08:58.386938 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-f1488120-3f39-4563-8b98-5c832ba055cb req-9cc2c61a-1b55-4362-8ac6-55a38ac1e5c5 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:08:58.397191 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-f1488120-3f39-4563-8b98-5c832ba055cb req-9cc2c61a-1b55-4362-8ac6-55a38ac1e5c5 service nova] Creating event network-vif-deleted:5a497869-d6ab-408c-b1ab-a4adfe563df1 for instance 3756aa96-3eea-4752-a6eb-7866f03e4acc on n-h1-862769-1 Oct 27 04:08:58.403491 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-f1488120-3f39-4563-8b98-5c832ba055cb req-9cc2c61a-1b55-4362-8ac6-55a38ac1e5c5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039245 Oct 27 04:08:58.404124 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3614/6940] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:08:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:08:58.539336 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d1b5801b-94e8-452c-8e87-703b16d03ea9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:08:58.539961 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d1b5801b-94e8-452c-8e87-703b16d03ea9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 3756aa96-3eea-4752-a6eb-7866f03e4acc] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:08:58.546820 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d1b5801b-94e8-452c-8e87-703b16d03ea9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:08:58.547328 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d1b5801b-94e8-452c-8e87-703b16d03ea9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:08:58.547765 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d1b5801b-94e8-452c-8e87-703b16d03ea9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:08:58.548462 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d1b5801b-94e8-452c-8e87-703b16d03ea9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:08:58.548921 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d1b5801b-94e8-452c-8e87-703b16d03ea9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:08:58.549353 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d1b5801b-94e8-452c-8e87-703b16d03ea9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:08:58.611856 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d1b5801b-94e8-452c-8e87-703b16d03ea9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:08:58.620337 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d1b5801b-94e8-452c-8e87-703b16d03ea9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc" status: 200 len: 1188 microversion: 2.1 time: 0.084900 Oct 27 04:08:58.620918 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3327/6941] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:08:58 2022] GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc => generated 1188 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:08:59.644071 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-eae23820-609f-4cd2-ad68-4727f58f4216 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:08:59.644868 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-eae23820-609f-4cd2-ad68-4727f58f4216 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 3756aa96-3eea-4752-a6eb-7866f03e4acc] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:08:59.652665 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eae23820-609f-4cd2-ad68-4727f58f4216 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:08:59.653154 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eae23820-609f-4cd2-ad68-4727f58f4216 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:08:59.653596 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eae23820-609f-4cd2-ad68-4727f58f4216 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:08:59.654334 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eae23820-609f-4cd2-ad68-4727f58f4216 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:08:59.654790 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eae23820-609f-4cd2-ad68-4727f58f4216 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:08:59.655223 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eae23820-609f-4cd2-ad68-4727f58f4216 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:08:59.724447 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-eae23820-609f-4cd2-ad68-4727f58f4216 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:08:59.734306 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-eae23820-609f-4cd2-ad68-4727f58f4216 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc" status: 200 len: 1188 microversion: 2.1 time: 0.094621 Oct 27 04:08:59.734926 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3615/6942] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:08:59 2022] GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc => generated 1188 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:09:00.756977 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4948273f-6949-46a1-b5df-35a5dc5918bc tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:09:00.757665 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4948273f-6949-46a1-b5df-35a5dc5918bc tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 3756aa96-3eea-4752-a6eb-7866f03e4acc] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:09:00.764858 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4948273f-6949-46a1-b5df-35a5dc5918bc tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:09:00.765354 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4948273f-6949-46a1-b5df-35a5dc5918bc tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:09:00.765795 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4948273f-6949-46a1-b5df-35a5dc5918bc tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:09:00.766728 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4948273f-6949-46a1-b5df-35a5dc5918bc tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:09:00.767159 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4948273f-6949-46a1-b5df-35a5dc5918bc tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:09:00.767593 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4948273f-6949-46a1-b5df-35a5dc5918bc tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:09:00.832919 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4948273f-6949-46a1-b5df-35a5dc5918bc tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:09:00.841412 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4948273f-6949-46a1-b5df-35a5dc5918bc tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc" status: 200 len: 1188 microversion: 2.1 time: 0.088399 Oct 27 04:09:00.852240 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3328/6943] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:09:00 2022] GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc => generated 1188 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:09:01.864789 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4a9f5906-5efe-4468-99f9-df7a1a2bfb59 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:09:01.865520 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4a9f5906-5efe-4468-99f9-df7a1a2bfb59 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 3756aa96-3eea-4752-a6eb-7866f03e4acc] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:09:01.873201 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4a9f5906-5efe-4468-99f9-df7a1a2bfb59 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:09:01.881469 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4a9f5906-5efe-4468-99f9-df7a1a2bfb59 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:09:01.881469 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4a9f5906-5efe-4468-99f9-df7a1a2bfb59 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:09:01.881469 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4a9f5906-5efe-4468-99f9-df7a1a2bfb59 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:09:01.881469 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4a9f5906-5efe-4468-99f9-df7a1a2bfb59 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:09:01.881469 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4a9f5906-5efe-4468-99f9-df7a1a2bfb59 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:09:01.937205 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4a9f5906-5efe-4468-99f9-df7a1a2bfb59 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:09:01.945934 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4a9f5906-5efe-4468-99f9-df7a1a2bfb59 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc" status: 200 len: 1188 microversion: 2.1 time: 0.084640 Oct 27 04:09:01.946563 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3616/6944] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:09:01 2022] GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc => generated 1188 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:09:02.969120 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1caec3da-1369-48ff-8517-a6af8c862ad8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:09:02.969734 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1caec3da-1369-48ff-8517-a6af8c862ad8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 3756aa96-3eea-4752-a6eb-7866f03e4acc] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:09:02.976605 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1caec3da-1369-48ff-8517-a6af8c862ad8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:09:02.977100 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1caec3da-1369-48ff-8517-a6af8c862ad8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:09:02.977539 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1caec3da-1369-48ff-8517-a6af8c862ad8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:09:02.978283 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1caec3da-1369-48ff-8517-a6af8c862ad8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:09:02.988012 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1caec3da-1369-48ff-8517-a6af8c862ad8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:09:02.988589 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1caec3da-1369-48ff-8517-a6af8c862ad8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:09:03.059774 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1caec3da-1369-48ff-8517-a6af8c862ad8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:09:03.067997 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1caec3da-1369-48ff-8517-a6af8c862ad8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc" status: 200 len: 1188 microversion: 2.1 time: 0.103090 Oct 27 04:09:03.068580 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3329/6945] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:09:02 2022] GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc => generated 1188 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 04:09:04.092497 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-172fabcb-c1bd-44f0-8425-9974abb1fc5d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:09:04.093192 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-172fabcb-c1bd-44f0-8425-9974abb1fc5d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 3756aa96-3eea-4752-a6eb-7866f03e4acc] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:09:04.100060 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-172fabcb-c1bd-44f0-8425-9974abb1fc5d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:09:04.100550 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-172fabcb-c1bd-44f0-8425-9974abb1fc5d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:09:04.100995 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-172fabcb-c1bd-44f0-8425-9974abb1fc5d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:09:04.102350 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-172fabcb-c1bd-44f0-8425-9974abb1fc5d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:09:04.102810 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-172fabcb-c1bd-44f0-8425-9974abb1fc5d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:09:04.106252 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-172fabcb-c1bd-44f0-8425-9974abb1fc5d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:09:04.116773 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-172fabcb-c1bd-44f0-8425-9974abb1fc5d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] HTTP exception thrown: Instance 3756aa96-3eea-4752-a6eb-7866f03e4acc could not be found. Oct 27 04:09:04.118489 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-172fabcb-c1bd-44f0-8425-9974abb1fc5d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Request method failure captured: Oct 27 04:09:04.118489 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc HTTP/1.1 Oct 27 04:09:04.118489 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 04:09:04.118489 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 04:09:04.118489 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 04:09:04.118489 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 04:09:04.118489 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 04:09:04.118489 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 04:09:04.118489 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 04:09:04.118489 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 04:09:04.118489 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWgOy2vyGIZvCPgeKqR-dxD7jsV8GSZftvWG3pi0psQTYPv81ATvFSgHi31EMgn0x5NItteNYikimeQ9zcCw_dYQg7rFsVn9VSH-YqZAmUJa-ncyxVumv4r6CMnFhSrRbs_K6XB3pjXRcA1nWSk0V8vccKKBeZUitsa2lCn2gYQAw5hI Oct 27 04:09:04.118489 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 04:09:04.118489 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 04:09:04.118489 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 04:09:04.118489 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 04:09:04.118489 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 04:09:04.118489 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 04:09:04.118489 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 6a6a4f0161c94dc19682d70af00ba684 Oct 27 04:09:04.118489 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-TestVolumeBootPattern-1489988074 Oct 27 04:09:04.118489 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 04:09:04.118489 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 04:09:04.118489 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6a6a4f0161c94dc19682d70af00ba684"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6a6a4f0161c94dc19682d70af00ba684"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6a6a4f0161c94dc19682d70af00ba684"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6a6a4f0161c94dc19682d70af00ba684"}]}] Oct 27 04:09:04.118489 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-TestVolumeBootPattern-1489988074 Oct 27 04:09:04.118489 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 6a6a4f0161c94dc19682d70af00ba684 Oct 27 04:09:04.118489 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-TestVolumeBootPattern-1489988074 Oct 27 04:09:04.118489 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-TestVolumeBootPattern-1489988074-project Oct 27 04:09:04.118489 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 04:09:04.118489 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 04:09:04.118489 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: b7f5c179e8844542bca46d76042a6897 Oct 27 04:09:04.118489 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-TestVolumeBootPattern-1489988074-project Oct 27 04:09:04.118489 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 04:09:04.118489 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 3756aa96-3eea-4752-a6eb-7866f03e4acc could not be found. Oct 27 04:09:04.118489 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '3756aa96-3eea-4752-a6eb-7866f03e4acc'} Oct 27 04:09:04.118489 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 04:09:04.118489 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:09:04.118489 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 04:09:04.118489 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 04:09:04.118489 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 04:09:04.118489 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 04:09:04.118489 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 04:09:04.118489 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 04:09:04.118489 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 04:09:04.118489 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 04:09:04.118489 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3756aa96-3eea-4752-a6eb-7866f03e4acc could not be found. Oct 27 04:09:04.118489 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:09:04.118489 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:09:04.118489 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:09:04.118489 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:09:04.118489 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:09:04.118489 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:09:04.118489 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 04:09:04.118489 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 04:09:04.118489 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 04:09:04.118489 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 04:09:04.118489 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 04:09:04.118489 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 04:09:04.118489 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 04:09:04.118489 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 04:09:04.118489 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 04:09:04.118489 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 04:09:04.118489 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3756aa96-3eea-4752-a6eb-7866f03e4acc could not be found. Oct 27 04:09:04.118489 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:09:04.118489 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:09:04.118489 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:09:04.122596 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:09:04.122596 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:09:04.122596 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:09:04.122596 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 04:09:04.122596 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 04:09:04.122596 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3756aa96-3eea-4752-a6eb-7866f03e4acc could not be found. Oct 27 04:09:04.122596 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:09:04.122596 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-172fabcb-c1bd-44f0-8425-9974abb1fc5d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Returning 404 to user: Instance 3756aa96-3eea-4752-a6eb-7866f03e4acc could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 04:09:04.122596 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-172fabcb-c1bd-44f0-8425-9974abb1fc5d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc" status: 404 len: 111 microversion: 2.1 time: 0.031407 Oct 27 04:09:04.122596 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3617/6946] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:09:04 2022] GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 04:09:07.331661 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ac850fd9-0089-4aeb-9f0f-07ac8b7c95d8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:09:07.332177 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ac850fd9-0089-4aeb-9f0f-07ac8b7c95d8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 3756aa96-3eea-4752-a6eb-7866f03e4acc] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:09:07.339414 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ac850fd9-0089-4aeb-9f0f-07ac8b7c95d8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:09:07.339920 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ac850fd9-0089-4aeb-9f0f-07ac8b7c95d8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:09:07.340370 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ac850fd9-0089-4aeb-9f0f-07ac8b7c95d8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:09:07.341094 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ac850fd9-0089-4aeb-9f0f-07ac8b7c95d8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:09:07.341557 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ac850fd9-0089-4aeb-9f0f-07ac8b7c95d8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:09:07.341991 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ac850fd9-0089-4aeb-9f0f-07ac8b7c95d8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:09:07.357155 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-ac850fd9-0089-4aeb-9f0f-07ac8b7c95d8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] HTTP exception thrown: Instance 3756aa96-3eea-4752-a6eb-7866f03e4acc could not be found. Oct 27 04:09:07.358908 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ac850fd9-0089-4aeb-9f0f-07ac8b7c95d8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Request method failure captured: Oct 27 04:09:07.358908 n-d-862769-1 devstack@n-api.service[121000]: request: DELETE /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc HTTP/1.1 Oct 27 04:09:07.358908 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 04:09:07.358908 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 04:09:07.358908 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 04:09:07.358908 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 04:09:07.358908 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 04:09:07.358908 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 04:09:07.358908 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 04:09:07.358908 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 04:09:07.358908 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWgOy2vyGIZvCPgeKqR-dxD7jsV8GSZftvWG3pi0psQTYPv81ATvFSgHi31EMgn0x5NItteNYikimeQ9zcCw_dYQg7rFsVn9VSH-YqZAmUJa-ncyxVumv4r6CMnFhSrRbs_K6XB3pjXRcA1nWSk0V8vccKKBeZUitsa2lCn2gYQAw5hI Oct 27 04:09:07.358908 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 04:09:07.358908 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 04:09:07.358908 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 04:09:07.358908 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 04:09:07.358908 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 04:09:07.358908 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 04:09:07.358908 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 6a6a4f0161c94dc19682d70af00ba684 Oct 27 04:09:07.358908 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-TestVolumeBootPattern-1489988074 Oct 27 04:09:07.358908 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 04:09:07.358908 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 04:09:07.358908 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6a6a4f0161c94dc19682d70af00ba684"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6a6a4f0161c94dc19682d70af00ba684"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6a6a4f0161c94dc19682d70af00ba684"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6a6a4f0161c94dc19682d70af00ba684"}]}] Oct 27 04:09:07.358908 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-TestVolumeBootPattern-1489988074 Oct 27 04:09:07.358908 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 6a6a4f0161c94dc19682d70af00ba684 Oct 27 04:09:07.358908 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-TestVolumeBootPattern-1489988074 Oct 27 04:09:07.358908 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-TestVolumeBootPattern-1489988074-project Oct 27 04:09:07.358908 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 04:09:07.358908 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 04:09:07.358908 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: b7f5c179e8844542bca46d76042a6897 Oct 27 04:09:07.358908 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-TestVolumeBootPattern-1489988074-project Oct 27 04:09:07.358908 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 04:09:07.358908 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 3756aa96-3eea-4752-a6eb-7866f03e4acc could not be found. Oct 27 04:09:07.358908 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '3756aa96-3eea-4752-a6eb-7866f03e4acc'} Oct 27 04:09:07.358908 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 04:09:07.358908 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:09:07.358908 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 04:09:07.358908 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 04:09:07.358908 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 04:09:07.358908 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 04:09:07.358908 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 04:09:07.358908 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 04:09:07.358908 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 04:09:07.358908 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 04:09:07.358908 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3756aa96-3eea-4752-a6eb-7866f03e4acc could not be found. Oct 27 04:09:07.358908 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:09:07.358908 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:09:07.358908 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:09:07.358908 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:09:07.358908 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:09:07.358908 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:09:07.358908 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 04:09:07.358908 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 04:09:07.358908 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 04:09:07.358908 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 04:09:07.358908 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 04:09:07.358908 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 04:09:07.358908 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 04:09:07.358908 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 04:09:07.358908 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 04:09:07.358908 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 04:09:07.358908 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 04:09:07.358908 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 04:09:07.363102 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3756aa96-3eea-4752-a6eb-7866f03e4acc could not be found. Oct 27 04:09:07.363102 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:09:07.363102 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:09:07.363102 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:09:07.363102 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:09:07.363102 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:09:07.363102 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:09:07.363102 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 04:09:07.363102 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 04:09:07.363102 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3756aa96-3eea-4752-a6eb-7866f03e4acc could not be found. Oct 27 04:09:07.363102 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:09:07.363102 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ac850fd9-0089-4aeb-9f0f-07ac8b7c95d8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Returning 404 to user: Instance 3756aa96-3eea-4752-a6eb-7866f03e4acc could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 04:09:07.363102 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ac850fd9-0089-4aeb-9f0f-07ac8b7c95d8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc" status: 404 len: 111 microversion: 2.1 time: 0.032811 Oct 27 04:09:07.364166 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3330/6947] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 04:09:07 2022] DELETE /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 04:09:07.369464 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-96c39146-b444-4342-903a-06757cf141f8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:09:07.370284 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-96c39146-b444-4342-903a-06757cf141f8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 3756aa96-3eea-4752-a6eb-7866f03e4acc] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:09:07.378014 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-96c39146-b444-4342-903a-06757cf141f8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:09:07.378774 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-96c39146-b444-4342-903a-06757cf141f8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:09:07.379332 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-96c39146-b444-4342-903a-06757cf141f8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:09:07.380173 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-96c39146-b444-4342-903a-06757cf141f8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:09:07.380754 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-96c39146-b444-4342-903a-06757cf141f8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:09:07.381303 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-96c39146-b444-4342-903a-06757cf141f8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:09:07.397225 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-96c39146-b444-4342-903a-06757cf141f8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] HTTP exception thrown: Instance 3756aa96-3eea-4752-a6eb-7866f03e4acc could not be found. Oct 27 04:09:07.399837 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-96c39146-b444-4342-903a-06757cf141f8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Request method failure captured: Oct 27 04:09:07.399837 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc HTTP/1.1 Oct 27 04:09:07.399837 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 04:09:07.399837 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 04:09:07.399837 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 04:09:07.399837 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 04:09:07.399837 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 04:09:07.399837 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 04:09:07.399837 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 04:09:07.399837 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 04:09:07.399837 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWgOy2vyGIZvCPgeKqR-dxD7jsV8GSZftvWG3pi0psQTYPv81ATvFSgHi31EMgn0x5NItteNYikimeQ9zcCw_dYQg7rFsVn9VSH-YqZAmUJa-ncyxVumv4r6CMnFhSrRbs_K6XB3pjXRcA1nWSk0V8vccKKBeZUitsa2lCn2gYQAw5hI Oct 27 04:09:07.399837 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 04:09:07.399837 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 04:09:07.399837 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 04:09:07.399837 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 04:09:07.399837 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 04:09:07.399837 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 04:09:07.399837 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 6a6a4f0161c94dc19682d70af00ba684 Oct 27 04:09:07.399837 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-TestVolumeBootPattern-1489988074 Oct 27 04:09:07.399837 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 04:09:07.399837 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 04:09:07.399837 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6a6a4f0161c94dc19682d70af00ba684"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6a6a4f0161c94dc19682d70af00ba684"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6a6a4f0161c94dc19682d70af00ba684"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6a6a4f0161c94dc19682d70af00ba684"}]}] Oct 27 04:09:07.399837 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-TestVolumeBootPattern-1489988074 Oct 27 04:09:07.399837 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 6a6a4f0161c94dc19682d70af00ba684 Oct 27 04:09:07.399837 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-TestVolumeBootPattern-1489988074 Oct 27 04:09:07.399837 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-TestVolumeBootPattern-1489988074-project Oct 27 04:09:07.399837 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 04:09:07.399837 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 04:09:07.399837 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: b7f5c179e8844542bca46d76042a6897 Oct 27 04:09:07.399837 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-TestVolumeBootPattern-1489988074-project Oct 27 04:09:07.399837 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 04:09:07.399837 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 3756aa96-3eea-4752-a6eb-7866f03e4acc could not be found. Oct 27 04:09:07.399837 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '3756aa96-3eea-4752-a6eb-7866f03e4acc'} Oct 27 04:09:07.399837 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 04:09:07.399837 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:09:07.399837 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 04:09:07.399837 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 04:09:07.399837 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 04:09:07.399837 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 04:09:07.399837 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 04:09:07.399837 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 04:09:07.399837 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 04:09:07.399837 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 04:09:07.399837 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3756aa96-3eea-4752-a6eb-7866f03e4acc could not be found. Oct 27 04:09:07.399837 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:09:07.399837 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:09:07.399837 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:09:07.399837 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:09:07.399837 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:09:07.399837 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:09:07.399837 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 04:09:07.399837 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 04:09:07.399837 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 04:09:07.399837 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 04:09:07.399837 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 04:09:07.399837 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 04:09:07.399837 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 04:09:07.399837 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 04:09:07.399837 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 04:09:07.399837 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 04:09:07.399837 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3756aa96-3eea-4752-a6eb-7866f03e4acc could not be found. Oct 27 04:09:07.399837 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:09:07.399837 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:09:07.399837 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:09:07.404033 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:09:07.404033 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:09:07.404033 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:09:07.404033 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 04:09:07.404033 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 04:09:07.404033 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3756aa96-3eea-4752-a6eb-7866f03e4acc could not be found. Oct 27 04:09:07.404033 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:09:07.404635 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-96c39146-b444-4342-903a-06757cf141f8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Returning 404 to user: Instance 3756aa96-3eea-4752-a6eb-7866f03e4acc could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 04:09:07.405630 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-96c39146-b444-4342-903a-06757cf141f8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc" status: 404 len: 111 microversion: 2.1 time: 0.040324 Oct 27 04:09:07.406620 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3618/6948] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:09:07 2022] GET /compute/v2.1/servers/3756aa96-3eea-4752-a6eb-7866f03e4acc => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 04:09:41.400059 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-76cfa9ee-1275-4a6b-a865-1dfc7193dc40 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1797564495", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "efd86d34-9716-4c71-ab86-a5e9251f9ffe", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "b49d136e-c9db-4b4f-8210-57f6cfd2ff95"}]}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:09:41.410623 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:09:41.411238 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:09:41.463480 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-76cfa9ee-1275-4a6b-a865-1dfc7193dc40 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] validate_networks() for [('b49d136e-c9db-4b4f-8210-57f6cfd2ff95', None, None, None, None, None)] {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 04:09:41.963148 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-76cfa9ee-1275-4a6b-a865-1dfc7193dc40 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 04:09:41.963602 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-76cfa9ee-1275-4a6b-a865-1dfc7193dc40 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 04:09:41.964128 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-76cfa9ee-1275-4a6b-a865-1dfc7193dc40 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 04:09:41.964552 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-76cfa9ee-1275-4a6b-a865-1dfc7193dc40 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 04:09:41.964980 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-76cfa9ee-1275-4a6b-a865-1dfc7193dc40 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 04:09:41.973970 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-76cfa9ee-1275-4a6b-a865-1dfc7193dc40 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:09:41.974510 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-76cfa9ee-1275-4a6b-a865-1dfc7193dc40 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:09:41.974987 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-76cfa9ee-1275-4a6b-a865-1dfc7193dc40 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:09:41.975916 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-76cfa9ee-1275-4a6b-a865-1dfc7193dc40 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:09:41.976387 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-76cfa9ee-1275-4a6b-a865-1dfc7193dc40 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:09:41.976850 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-76cfa9ee-1275-4a6b-a865-1dfc7193dc40 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:09:41.996120 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-76cfa9ee-1275-4a6b-a865-1dfc7193dc40 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Getting quotas for project 6a6a4f0161c94dc19682d70af00ba684. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 04:09:42.002088 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-76cfa9ee-1275-4a6b-a865-1dfc7193dc40 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Getting quotas for user b7f5c179e8844542bca46d76042a6897 and project 6a6a4f0161c94dc19682d70af00ba684. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 04:09:42.062209 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-76cfa9ee-1275-4a6b-a865-1dfc7193dc40 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 04:09:42.064334 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-76cfa9ee-1275-4a6b-a865-1dfc7193dc40 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 1d1883a3-05ef-4d2b-b98f-70a18deb6602] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='efd86d34-9716-4c71-ab86-a5e9251f9ffe',volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 04:09:42.456790 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-76cfa9ee-1275-4a6b-a865-1dfc7193dc40 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.060601 Oct 27 04:09:42.462361 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3331/6949] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 04:09:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1063 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 04:09:42.469018 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a97ade93-ddac-40f4-a6db-762e6e15eb92 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:09:42.482852 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a97ade93-ddac-40f4-a6db-762e6e15eb92 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 1d1883a3-05ef-4d2b-b98f-70a18deb6602] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:09:42.485400 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=27 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:09:42.485950 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=69 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:09:42.542854 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a97ade93-ddac-40f4-a6db-762e6e15eb92 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:09:42.551107 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a97ade93-ddac-40f4-a6db-762e6e15eb92 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/1d1883a3-05ef-4d2b-b98f-70a18deb6602" status: 200 len: 1071 microversion: 2.1 time: 0.086426 Oct 27 04:09:42.555266 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3619/6950] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:09:42 2022] GET /compute/v2.1/servers/1d1883a3-05ef-4d2b-b98f-70a18deb6602 => generated 1071 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 04:09:43.575710 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d48afb1b-8227-4dee-8ae5-d9f82f8e7f48 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:09:43.576266 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d48afb1b-8227-4dee-8ae5-d9f82f8e7f48 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 1d1883a3-05ef-4d2b-b98f-70a18deb6602] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:09:43.582726 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d48afb1b-8227-4dee-8ae5-d9f82f8e7f48 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:09:43.583356 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d48afb1b-8227-4dee-8ae5-d9f82f8e7f48 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:09:43.583814 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d48afb1b-8227-4dee-8ae5-d9f82f8e7f48 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:09:43.584519 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d48afb1b-8227-4dee-8ae5-d9f82f8e7f48 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:09:43.584982 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d48afb1b-8227-4dee-8ae5-d9f82f8e7f48 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:09:43.585418 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d48afb1b-8227-4dee-8ae5-d9f82f8e7f48 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:09:43.652286 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d48afb1b-8227-4dee-8ae5-d9f82f8e7f48 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:09:43.660250 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d48afb1b-8227-4dee-8ae5-d9f82f8e7f48 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/1d1883a3-05ef-4d2b-b98f-70a18deb6602" status: 200 len: 1121 microversion: 2.1 time: 0.089637 Oct 27 04:09:43.660832 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3332/6951] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:09:43 2022] GET /compute/v2.1/servers/1d1883a3-05ef-4d2b-b98f-70a18deb6602 => generated 1121 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:09:44.684167 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d8b8e67e-3a10-4a39-8596-cc0258609f18 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:09:44.684959 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d8b8e67e-3a10-4a39-8596-cc0258609f18 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 1d1883a3-05ef-4d2b-b98f-70a18deb6602] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:09:44.693816 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d8b8e67e-3a10-4a39-8596-cc0258609f18 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:09:44.699687 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d8b8e67e-3a10-4a39-8596-cc0258609f18 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:09:44.699687 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d8b8e67e-3a10-4a39-8596-cc0258609f18 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:09:44.699687 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d8b8e67e-3a10-4a39-8596-cc0258609f18 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:09:44.699687 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d8b8e67e-3a10-4a39-8596-cc0258609f18 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:09:44.699687 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d8b8e67e-3a10-4a39-8596-cc0258609f18 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:09:44.762541 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d8b8e67e-3a10-4a39-8596-cc0258609f18 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:09:44.770974 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d8b8e67e-3a10-4a39-8596-cc0258609f18 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/1d1883a3-05ef-4d2b-b98f-70a18deb6602" status: 200 len: 1177 microversion: 2.1 time: 0.091515 Oct 27 04:09:44.771547 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3620/6952] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:09:44 2022] GET /compute/v2.1/servers/1d1883a3-05ef-4d2b-b98f-70a18deb6602 => generated 1177 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:09:45.803771 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0bc4bb55-ddee-40f0-a2b5-5e3d5f3f8251 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:09:45.804885 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0bc4bb55-ddee-40f0-a2b5-5e3d5f3f8251 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 1d1883a3-05ef-4d2b-b98f-70a18deb6602] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:09:45.815243 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0bc4bb55-ddee-40f0-a2b5-5e3d5f3f8251 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:09:45.815964 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0bc4bb55-ddee-40f0-a2b5-5e3d5f3f8251 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:09:45.816614 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0bc4bb55-ddee-40f0-a2b5-5e3d5f3f8251 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:09:45.817515 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0bc4bb55-ddee-40f0-a2b5-5e3d5f3f8251 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:09:45.818154 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0bc4bb55-ddee-40f0-a2b5-5e3d5f3f8251 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:09:45.818809 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0bc4bb55-ddee-40f0-a2b5-5e3d5f3f8251 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:09:46.032081 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0bc4bb55-ddee-40f0-a2b5-5e3d5f3f8251 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:09:46.055385 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0bc4bb55-ddee-40f0-a2b5-5e3d5f3f8251 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/1d1883a3-05ef-4d2b-b98f-70a18deb6602" status: 200 len: 1229 microversion: 2.1 time: 0.264533 Oct 27 04:09:46.056779 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3333/6953] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:09:45 2022] GET /compute/v2.1/servers/1d1883a3-05ef-4d2b-b98f-70a18deb6602 => generated 1229 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:09:46.353080 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-658b6916-9318-4319-afa3-b53ff0ec1592 req-464ec159-9a90-4e85-91ad-d15a2adfb09e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d1883a3-05ef-4d2b-b98f-70a18deb6602", "tag": "95a4180c-d68e-4017-9ae0-93a6903fd643"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:09:46.367724 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-658b6916-9318-4319-afa3-b53ff0ec1592 req-464ec159-9a90-4e85-91ad-d15a2adfb09e service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:09:46.369496 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-658b6916-9318-4319-afa3-b53ff0ec1592 req-464ec159-9a90-4e85-91ad-d15a2adfb09e service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:09:46.370073 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-658b6916-9318-4319-afa3-b53ff0ec1592 req-464ec159-9a90-4e85-91ad-d15a2adfb09e service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:09:46.383229 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-658b6916-9318-4319-afa3-b53ff0ec1592 req-464ec159-9a90-4e85-91ad-d15a2adfb09e service nova] Creating event network-changed:95a4180c-d68e-4017-9ae0-93a6903fd643 for instance 1d1883a3-05ef-4d2b-b98f-70a18deb6602 on n-h1-862769-1 Oct 27 04:09:46.389720 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-658b6916-9318-4319-afa3-b53ff0ec1592 req-464ec159-9a90-4e85-91ad-d15a2adfb09e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046263 Oct 27 04:09:46.390784 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3621/6954] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:09:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 04:09:47.080386 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a1acf74f-a482-4ca3-9b27-5ca06c33ff4c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:09:47.081004 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a1acf74f-a482-4ca3-9b27-5ca06c33ff4c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 1d1883a3-05ef-4d2b-b98f-70a18deb6602] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:09:47.089118 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a1acf74f-a482-4ca3-9b27-5ca06c33ff4c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:09:47.089642 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a1acf74f-a482-4ca3-9b27-5ca06c33ff4c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:09:47.090079 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a1acf74f-a482-4ca3-9b27-5ca06c33ff4c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:09:47.090796 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a1acf74f-a482-4ca3-9b27-5ca06c33ff4c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:09:47.091433 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a1acf74f-a482-4ca3-9b27-5ca06c33ff4c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:09:47.091866 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a1acf74f-a482-4ca3-9b27-5ca06c33ff4c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:09:47.329011 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a1acf74f-a482-4ca3-9b27-5ca06c33ff4c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:09:47.339081 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a1acf74f-a482-4ca3-9b27-5ca06c33ff4c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/1d1883a3-05ef-4d2b-b98f-70a18deb6602" status: 200 len: 1229 microversion: 2.1 time: 0.263037 Oct 27 04:09:47.342386 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3334/6955] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:09:47 2022] GET /compute/v2.1/servers/1d1883a3-05ef-4d2b-b98f-70a18deb6602 => generated 1229 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:09:48.363669 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c5d84827-8f6b-4121-994f-a737982e224c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:09:48.364486 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c5d84827-8f6b-4121-994f-a737982e224c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 1d1883a3-05ef-4d2b-b98f-70a18deb6602] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:09:48.371448 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c5d84827-8f6b-4121-994f-a737982e224c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:09:48.372024 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c5d84827-8f6b-4121-994f-a737982e224c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:09:48.372547 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c5d84827-8f6b-4121-994f-a737982e224c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:09:48.373334 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c5d84827-8f6b-4121-994f-a737982e224c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:09:48.373869 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c5d84827-8f6b-4121-994f-a737982e224c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:09:48.374409 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c5d84827-8f6b-4121-994f-a737982e224c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:09:48.516990 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c5d84827-8f6b-4121-994f-a737982e224c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:09:48.525558 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c5d84827-8f6b-4121-994f-a737982e224c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/1d1883a3-05ef-4d2b-b98f-70a18deb6602" status: 200 len: 1229 microversion: 2.1 time: 0.167185 Oct 27 04:09:48.530109 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3622/6956] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:09:48 2022] GET /compute/v2.1/servers/1d1883a3-05ef-4d2b-b98f-70a18deb6602 => generated 1229 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:09:49.548983 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5c913e99-058c-41b4-b925-eba09e807628 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:09:49.549950 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5c913e99-058c-41b4-b925-eba09e807628 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 1d1883a3-05ef-4d2b-b98f-70a18deb6602] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:09:49.557467 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5c913e99-058c-41b4-b925-eba09e807628 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:09:49.557955 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5c913e99-058c-41b4-b925-eba09e807628 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:09:49.558428 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5c913e99-058c-41b4-b925-eba09e807628 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:09:49.559331 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5c913e99-058c-41b4-b925-eba09e807628 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:09:49.559828 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5c913e99-058c-41b4-b925-eba09e807628 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:09:49.560259 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5c913e99-058c-41b4-b925-eba09e807628 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:09:49.695628 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5c913e99-058c-41b4-b925-eba09e807628 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:09:49.704478 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5c913e99-058c-41b4-b925-eba09e807628 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/1d1883a3-05ef-4d2b-b98f-70a18deb6602" status: 200 len: 1229 microversion: 2.1 time: 0.159503 Oct 27 04:09:49.705138 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3335/6957] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:09:49 2022] GET /compute/v2.1/servers/1d1883a3-05ef-4d2b-b98f-70a18deb6602 => generated 1229 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:09:50.727191 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0218d79e-5037-4b81-92be-a824ecc8146a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:09:50.728039 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0218d79e-5037-4b81-92be-a824ecc8146a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 1d1883a3-05ef-4d2b-b98f-70a18deb6602] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:09:50.735571 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0218d79e-5037-4b81-92be-a824ecc8146a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:09:50.736107 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0218d79e-5037-4b81-92be-a824ecc8146a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:09:50.736558 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0218d79e-5037-4b81-92be-a824ecc8146a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:09:50.737266 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0218d79e-5037-4b81-92be-a824ecc8146a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:09:50.737725 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0218d79e-5037-4b81-92be-a824ecc8146a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:09:50.738180 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0218d79e-5037-4b81-92be-a824ecc8146a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:09:50.870434 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0218d79e-5037-4b81-92be-a824ecc8146a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:09:50.879937 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0218d79e-5037-4b81-92be-a824ecc8146a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/1d1883a3-05ef-4d2b-b98f-70a18deb6602" status: 200 len: 1229 microversion: 2.1 time: 0.156831 Oct 27 04:09:50.880682 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3623/6958] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:09:50 2022] GET /compute/v2.1/servers/1d1883a3-05ef-4d2b-b98f-70a18deb6602 => generated 1229 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:09:51.903906 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f1addc5d-98b2-48ed-8259-9f6889859d81 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:09:51.904434 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f1addc5d-98b2-48ed-8259-9f6889859d81 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 1d1883a3-05ef-4d2b-b98f-70a18deb6602] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:09:51.911223 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f1addc5d-98b2-48ed-8259-9f6889859d81 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:09:51.911714 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f1addc5d-98b2-48ed-8259-9f6889859d81 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:09:51.912151 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f1addc5d-98b2-48ed-8259-9f6889859d81 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:09:51.912846 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f1addc5d-98b2-48ed-8259-9f6889859d81 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:09:51.913304 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f1addc5d-98b2-48ed-8259-9f6889859d81 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:09:51.913729 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f1addc5d-98b2-48ed-8259-9f6889859d81 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:09:51.986508 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:09:52.009185 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=6 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:09:52.047676 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f1addc5d-98b2-48ed-8259-9f6889859d81 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:09:52.055411 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f1addc5d-98b2-48ed-8259-9f6889859d81 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/1d1883a3-05ef-4d2b-b98f-70a18deb6602" status: 200 len: 1217 microversion: 2.1 time: 0.156039 Oct 27 04:09:52.055990 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3336/6959] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:09:51 2022] GET /compute/v2.1/servers/1d1883a3-05ef-4d2b-b98f-70a18deb6602 => generated 1217 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:09:53.079308 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-10986677-06ed-46d4-bee8-2d0bfe201022 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:09:53.080401 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-10986677-06ed-46d4-bee8-2d0bfe201022 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 1d1883a3-05ef-4d2b-b98f-70a18deb6602] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:09:53.083065 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:09:53.087975 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-10986677-06ed-46d4-bee8-2d0bfe201022 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:09:53.088470 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-10986677-06ed-46d4-bee8-2d0bfe201022 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:09:53.089612 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-10986677-06ed-46d4-bee8-2d0bfe201022 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:09:53.090539 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-10986677-06ed-46d4-bee8-2d0bfe201022 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:09:53.090999 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-10986677-06ed-46d4-bee8-2d0bfe201022 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:09:53.091435 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-10986677-06ed-46d4-bee8-2d0bfe201022 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:09:53.226317 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-10986677-06ed-46d4-bee8-2d0bfe201022 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:09:53.234382 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-10986677-06ed-46d4-bee8-2d0bfe201022 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/1d1883a3-05ef-4d2b-b98f-70a18deb6602" status: 200 len: 1217 microversion: 2.1 time: 0.159260 Oct 27 04:09:53.234927 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3624/6960] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:09:53 2022] GET /compute/v2.1/servers/1d1883a3-05ef-4d2b-b98f-70a18deb6602 => generated 1217 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:09:54.256734 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ba1e432d-d192-40ec-9395-90457bc8a08a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:09:54.257446 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ba1e432d-d192-40ec-9395-90457bc8a08a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 1d1883a3-05ef-4d2b-b98f-70a18deb6602] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:09:54.264798 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ba1e432d-d192-40ec-9395-90457bc8a08a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:09:54.265295 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ba1e432d-d192-40ec-9395-90457bc8a08a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:09:54.265742 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ba1e432d-d192-40ec-9395-90457bc8a08a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:09:54.266476 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ba1e432d-d192-40ec-9395-90457bc8a08a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:09:54.266938 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ba1e432d-d192-40ec-9395-90457bc8a08a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:09:54.267370 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ba1e432d-d192-40ec-9395-90457bc8a08a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:09:54.404112 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ba1e432d-d192-40ec-9395-90457bc8a08a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:09:54.405004 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ba1e432d-d192-40ec-9395-90457bc8a08a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/1d1883a3-05ef-4d2b-b98f-70a18deb6602" status: 200 len: 1217 microversion: 2.1 time: 0.152276 Oct 27 04:09:54.405573 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3337/6961] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:09:54 2022] GET /compute/v2.1/servers/1d1883a3-05ef-4d2b-b98f-70a18deb6602 => generated 1217 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 04:09:55.428457 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3dd18642-8e54-4033-9e4c-8bbbca8e37a4 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:09:55.429270 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3dd18642-8e54-4033-9e4c-8bbbca8e37a4 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 1d1883a3-05ef-4d2b-b98f-70a18deb6602] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:09:55.437048 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3dd18642-8e54-4033-9e4c-8bbbca8e37a4 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:09:55.437545 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3dd18642-8e54-4033-9e4c-8bbbca8e37a4 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:09:55.438061 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3dd18642-8e54-4033-9e4c-8bbbca8e37a4 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:09:55.438779 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3dd18642-8e54-4033-9e4c-8bbbca8e37a4 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:09:55.439250 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3dd18642-8e54-4033-9e4c-8bbbca8e37a4 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:09:55.439689 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3dd18642-8e54-4033-9e4c-8bbbca8e37a4 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:09:55.567981 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3dd18642-8e54-4033-9e4c-8bbbca8e37a4 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:09:55.575978 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3dd18642-8e54-4033-9e4c-8bbbca8e37a4 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/1d1883a3-05ef-4d2b-b98f-70a18deb6602" status: 200 len: 1217 microversion: 2.1 time: 0.151480 Oct 27 04:09:55.576568 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3625/6962] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:09:55 2022] GET /compute/v2.1/servers/1d1883a3-05ef-4d2b-b98f-70a18deb6602 => generated 1217 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:09:56.599180 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f3cfddc7-a1b8-48b6-b040-df8b31721443 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:09:56.599862 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f3cfddc7-a1b8-48b6-b040-df8b31721443 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 1d1883a3-05ef-4d2b-b98f-70a18deb6602] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:09:56.607216 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f3cfddc7-a1b8-48b6-b040-df8b31721443 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:09:56.607871 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f3cfddc7-a1b8-48b6-b040-df8b31721443 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:09:56.608199 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f3cfddc7-a1b8-48b6-b040-df8b31721443 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:09:56.608892 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f3cfddc7-a1b8-48b6-b040-df8b31721443 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:09:56.609348 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f3cfddc7-a1b8-48b6-b040-df8b31721443 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:09:56.609773 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f3cfddc7-a1b8-48b6-b040-df8b31721443 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:09:56.742012 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f3cfddc7-a1b8-48b6-b040-df8b31721443 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:09:56.750779 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f3cfddc7-a1b8-48b6-b040-df8b31721443 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/1d1883a3-05ef-4d2b-b98f-70a18deb6602" status: 200 len: 1217 microversion: 2.1 time: 0.155399 Oct 27 04:09:56.751886 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3338/6963] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:09:56 2022] GET /compute/v2.1/servers/1d1883a3-05ef-4d2b-b98f-70a18deb6602 => generated 1217 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:09:57.774840 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-54d97f77-6f95-47c8-ae92-b960fb4368e8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:09:57.775497 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-54d97f77-6f95-47c8-ae92-b960fb4368e8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 1d1883a3-05ef-4d2b-b98f-70a18deb6602] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:09:57.783186 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-54d97f77-6f95-47c8-ae92-b960fb4368e8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:09:57.783475 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-54d97f77-6f95-47c8-ae92-b960fb4368e8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:09:57.783916 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-54d97f77-6f95-47c8-ae92-b960fb4368e8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:09:57.784641 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-54d97f77-6f95-47c8-ae92-b960fb4368e8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:09:57.785095 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-54d97f77-6f95-47c8-ae92-b960fb4368e8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:09:57.785571 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-54d97f77-6f95-47c8-ae92-b960fb4368e8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:09:57.924962 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-54d97f77-6f95-47c8-ae92-b960fb4368e8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:09:57.932997 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-54d97f77-6f95-47c8-ae92-b960fb4368e8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/1d1883a3-05ef-4d2b-b98f-70a18deb6602" status: 200 len: 1217 microversion: 2.1 time: 0.162199 Oct 27 04:09:57.933575 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3626/6964] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:09:57 2022] GET /compute/v2.1/servers/1d1883a3-05ef-4d2b-b98f-70a18deb6602 => generated 1217 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:09:58.955886 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-89861bcb-6744-404f-bf5a-cfecf7643a27 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:09:58.956542 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-89861bcb-6744-404f-bf5a-cfecf7643a27 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 1d1883a3-05ef-4d2b-b98f-70a18deb6602] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:09:58.963431 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-89861bcb-6744-404f-bf5a-cfecf7643a27 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:09:58.963919 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-89861bcb-6744-404f-bf5a-cfecf7643a27 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:09:58.964358 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-89861bcb-6744-404f-bf5a-cfecf7643a27 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:09:58.965595 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-89861bcb-6744-404f-bf5a-cfecf7643a27 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:09:58.966068 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-89861bcb-6744-404f-bf5a-cfecf7643a27 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:09:58.966504 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-89861bcb-6744-404f-bf5a-cfecf7643a27 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:09:59.107541 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-89861bcb-6744-404f-bf5a-cfecf7643a27 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:09:59.115676 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-89861bcb-6744-404f-bf5a-cfecf7643a27 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/1d1883a3-05ef-4d2b-b98f-70a18deb6602" status: 200 len: 1217 microversion: 2.1 time: 0.163992 Oct 27 04:09:59.116263 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3339/6965] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:09:58 2022] GET /compute/v2.1/servers/1d1883a3-05ef-4d2b-b98f-70a18deb6602 => generated 1217 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:10:00.143477 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-641f95c6-c5e2-479a-9f42-3a5f124fcba1 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:10:00.143477 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-641f95c6-c5e2-479a-9f42-3a5f124fcba1 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 1d1883a3-05ef-4d2b-b98f-70a18deb6602] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:10:00.146602 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-641f95c6-c5e2-479a-9f42-3a5f124fcba1 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:00.147105 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-641f95c6-c5e2-479a-9f42-3a5f124fcba1 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:00.147557 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-641f95c6-c5e2-479a-9f42-3a5f124fcba1 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:00.148270 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-641f95c6-c5e2-479a-9f42-3a5f124fcba1 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:00.148738 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-641f95c6-c5e2-479a-9f42-3a5f124fcba1 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:00.149179 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-641f95c6-c5e2-479a-9f42-3a5f124fcba1 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:00.283366 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-641f95c6-c5e2-479a-9f42-3a5f124fcba1 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:10:00.291350 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-641f95c6-c5e2-479a-9f42-3a5f124fcba1 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/1d1883a3-05ef-4d2b-b98f-70a18deb6602" status: 200 len: 1217 microversion: 2.1 time: 0.156748 Oct 27 04:10:00.291942 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3627/6966] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:10:00 2022] GET /compute/v2.1/servers/1d1883a3-05ef-4d2b-b98f-70a18deb6602 => generated 1217 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:10:01.280132 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-3a711ffd-d2fd-48ef-b6ba-894ee9e3c06b req-7047d83b-0924-4257-9ff9-24b1141cf2fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d1883a3-05ef-4d2b-b98f-70a18deb6602", "name": "network-vif-plugged", "status": "completed", "tag": "95a4180c-d68e-4017-9ae0-93a6903fd643"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:10:01.290383 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-3a711ffd-d2fd-48ef-b6ba-894ee9e3c06b req-7047d83b-0924-4257-9ff9-24b1141cf2fa service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:01.290922 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-3a711ffd-d2fd-48ef-b6ba-894ee9e3c06b req-7047d83b-0924-4257-9ff9-24b1141cf2fa service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:01.291340 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-3a711ffd-d2fd-48ef-b6ba-894ee9e3c06b req-7047d83b-0924-4257-9ff9-24b1141cf2fa service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:01.302916 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-3a711ffd-d2fd-48ef-b6ba-894ee9e3c06b req-7047d83b-0924-4257-9ff9-24b1141cf2fa service nova] Creating event network-vif-plugged:95a4180c-d68e-4017-9ae0-93a6903fd643 for instance 1d1883a3-05ef-4d2b-b98f-70a18deb6602 on n-h1-862769-1 Oct 27 04:10:01.309776 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-3a711ffd-d2fd-48ef-b6ba-894ee9e3c06b req-7047d83b-0924-4257-9ff9-24b1141cf2fa service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032940 Oct 27 04:10:01.314247 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3340/6967] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:10:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 04:10:01.315174 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-98cc19ca-6f79-44cc-809e-92f4f87f4e42 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:10:01.318282 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-98cc19ca-6f79-44cc-809e-92f4f87f4e42 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 1d1883a3-05ef-4d2b-b98f-70a18deb6602] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:10:01.322540 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-98cc19ca-6f79-44cc-809e-92f4f87f4e42 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:01.323042 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-98cc19ca-6f79-44cc-809e-92f4f87f4e42 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:01.323494 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-98cc19ca-6f79-44cc-809e-92f4f87f4e42 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:01.324227 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-98cc19ca-6f79-44cc-809e-92f4f87f4e42 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:01.324713 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-98cc19ca-6f79-44cc-809e-92f4f87f4e42 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:01.325135 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-98cc19ca-6f79-44cc-809e-92f4f87f4e42 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:01.483696 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-98cc19ca-6f79-44cc-809e-92f4f87f4e42 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:10:01.491523 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-98cc19ca-6f79-44cc-809e-92f4f87f4e42 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/1d1883a3-05ef-4d2b-b98f-70a18deb6602" status: 200 len: 1217 microversion: 2.1 time: 0.180531 Oct 27 04:10:01.492097 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3628/6968] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:10:01 2022] GET /compute/v2.1/servers/1d1883a3-05ef-4d2b-b98f-70a18deb6602 => generated 1217 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 04:10:02.517010 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-98b561a2-afde-4234-b995-e4f8c73e823e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:10:02.517737 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-98b561a2-afde-4234-b995-e4f8c73e823e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 1d1883a3-05ef-4d2b-b98f-70a18deb6602] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:10:02.523920 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-98b561a2-afde-4234-b995-e4f8c73e823e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:02.524406 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-98b561a2-afde-4234-b995-e4f8c73e823e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:02.524840 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-98b561a2-afde-4234-b995-e4f8c73e823e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:02.525528 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-98b561a2-afde-4234-b995-e4f8c73e823e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:02.525981 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-98b561a2-afde-4234-b995-e4f8c73e823e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:02.526440 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-98b561a2-afde-4234-b995-e4f8c73e823e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:02.667307 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-98b561a2-afde-4234-b995-e4f8c73e823e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:10:02.675721 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-98b561a2-afde-4234-b995-e4f8c73e823e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/1d1883a3-05ef-4d2b-b98f-70a18deb6602" status: 200 len: 1217 microversion: 2.1 time: 0.164536 Oct 27 04:10:02.676554 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3341/6969] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:10:02 2022] GET /compute/v2.1/servers/1d1883a3-05ef-4d2b-b98f-70a18deb6602 => generated 1217 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:10:03.698627 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5c30d4ac-f55a-42cf-85e3-496b7eba2204 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:10:03.699255 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5c30d4ac-f55a-42cf-85e3-496b7eba2204 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 1d1883a3-05ef-4d2b-b98f-70a18deb6602] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:10:03.706664 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5c30d4ac-f55a-42cf-85e3-496b7eba2204 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:03.707153 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5c30d4ac-f55a-42cf-85e3-496b7eba2204 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:03.707629 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5c30d4ac-f55a-42cf-85e3-496b7eba2204 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:03.708332 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5c30d4ac-f55a-42cf-85e3-496b7eba2204 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:03.708797 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5c30d4ac-f55a-42cf-85e3-496b7eba2204 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:03.709231 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5c30d4ac-f55a-42cf-85e3-496b7eba2204 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:03.847797 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5c30d4ac-f55a-42cf-85e3-496b7eba2204 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:10:03.855843 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5c30d4ac-f55a-42cf-85e3-496b7eba2204 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/1d1883a3-05ef-4d2b-b98f-70a18deb6602" status: 200 len: 1405 microversion: 2.1 time: 0.161146 Oct 27 04:10:03.857138 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3629/6970] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:10:03 2022] GET /compute/v2.1/servers/1d1883a3-05ef-4d2b-b98f-70a18deb6602 => generated 1405 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:10:03.878761 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f2b2a4b2-5984-4afe-8aaa-2e4b3deff045 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:10:03.879433 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f2b2a4b2-5984-4afe-8aaa-2e4b3deff045 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 1d1883a3-05ef-4d2b-b98f-70a18deb6602] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:10:03.886362 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f2b2a4b2-5984-4afe-8aaa-2e4b3deff045 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:03.886840 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f2b2a4b2-5984-4afe-8aaa-2e4b3deff045 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:03.887813 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f2b2a4b2-5984-4afe-8aaa-2e4b3deff045 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:03.888503 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f2b2a4b2-5984-4afe-8aaa-2e4b3deff045 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:03.888957 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f2b2a4b2-5984-4afe-8aaa-2e4b3deff045 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:03.889383 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f2b2a4b2-5984-4afe-8aaa-2e4b3deff045 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:04.031335 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f2b2a4b2-5984-4afe-8aaa-2e4b3deff045 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:10:04.039242 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f2b2a4b2-5984-4afe-8aaa-2e4b3deff045 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/1d1883a3-05ef-4d2b-b98f-70a18deb6602" status: 200 len: 1405 microversion: 2.1 time: 0.164392 Oct 27 04:10:04.039847 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3342/6971] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:10:03 2022] GET /compute/v2.1/servers/1d1883a3-05ef-4d2b-b98f-70a18deb6602 => generated 1405 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:10:04.061569 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6d89753f-2974-4638-9d7a-e6b7c501fb71 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-255510191"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:10:04.064018 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-6d89753f-2974-4638-9d7a-e6b7c501fb71 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 1d1883a3-05ef-4d2b-b98f-70a18deb6602] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:10:04.070131 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6d89753f-2974-4638-9d7a-e6b7c501fb71 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:04.070658 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6d89753f-2974-4638-9d7a-e6b7c501fb71 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:04.071114 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6d89753f-2974-4638-9d7a-e6b7c501fb71 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:04.071832 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6d89753f-2974-4638-9d7a-e6b7c501fb71 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:04.072294 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6d89753f-2974-4638-9d7a-e6b7c501fb71 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:04.072734 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6d89753f-2974-4638-9d7a-e6b7c501fb71 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:04.166171 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.compute.api [None req-6d89753f-2974-4638-9d7a-e6b7c501fb71 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 1d1883a3-05ef-4d2b-b98f-70a18deb6602] Attempting to quiesce instance before volume snapshot. Oct 27 04:10:04.228473 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.compute.api [None req-6d89753f-2974-4638-9d7a-e6b7c501fb71 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 1d1883a3-05ef-4d2b-b98f-70a18deb6602] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Oct 27 04:10:04.412786 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-6d89753f-2974-4638-9d7a-e6b7c501fb71 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 1d1883a3-05ef-4d2b-b98f-70a18deb6602] Creating snapshot from volume efd86d34-9716-4c71-ab86-a5e9251f9ffe. {{(pid=121001) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Oct 27 04:10:06.002983 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6d89753f-2974-4638-9d7a-e6b7c501fb71 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "POST /compute/v2.1/servers/1d1883a3-05ef-4d2b-b98f-70a18deb6602/action" status: 202 len: 0 microversion: 2.1 time: 1.945308 Oct 27 04:10:06.003648 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3630/6972] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 04:10:04 2022] POST /compute/v2.1/servers/1d1883a3-05ef-4d2b-b98f-70a18deb6602/action => generated 0 bytes in 1947 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 27 04:10:07.159646 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0f80a5a7-2903-4c65-b21c-71d4243f56b2 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-366453349", "imageRef": "17f678d9-de6a-4625-b267-598f54ab0a72", "flavorRef": "452", "networks": [{"uuid": "b49d136e-c9db-4b4f-8210-57f6cfd2ff95"}]}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:10:07.224867 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-0f80a5a7-2903-4c65-b21c-71d4243f56b2 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] validate_networks() for [('b49d136e-c9db-4b4f-8210-57f6cfd2ff95', None, None, None, None, None)] {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 04:10:07.595450 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-0f80a5a7-2903-4c65-b21c-71d4243f56b2 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 04:10:07.595884 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-0f80a5a7-2903-4c65-b21c-71d4243f56b2 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 04:10:07.596395 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-0f80a5a7-2903-4c65-b21c-71d4243f56b2 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 04:10:07.596783 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-0f80a5a7-2903-4c65-b21c-71d4243f56b2 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 04:10:07.597203 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-0f80a5a7-2903-4c65-b21c-71d4243f56b2 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 04:10:07.608068 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0f80a5a7-2903-4c65-b21c-71d4243f56b2 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:07.608757 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0f80a5a7-2903-4c65-b21c-71d4243f56b2 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:07.609210 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0f80a5a7-2903-4c65-b21c-71d4243f56b2 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:07.609973 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0f80a5a7-2903-4c65-b21c-71d4243f56b2 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:07.610479 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0f80a5a7-2903-4c65-b21c-71d4243f56b2 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:07.610918 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0f80a5a7-2903-4c65-b21c-71d4243f56b2 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:07.628830 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-0f80a5a7-2903-4c65-b21c-71d4243f56b2 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Getting quotas for project 6a6a4f0161c94dc19682d70af00ba684. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 04:10:07.634288 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-0f80a5a7-2903-4c65-b21c-71d4243f56b2 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Getting quotas for user b7f5c179e8844542bca46d76042a6897 and project 6a6a4f0161c94dc19682d70af00ba684. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 04:10:07.647666 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0f80a5a7-2903-4c65-b21c-71d4243f56b2 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 04:10:07.650306 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0f80a5a7-2903-4c65-b21c-71d4243f56b2 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 60f45e37-e987-4aef-85d5-90e612460605] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='65845fa0-1a61-4be3-83d0-bd096e8b1853',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 04:10:07.810823 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0f80a5a7-2903-4c65-b21c-71d4243f56b2 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.655181 Oct 27 04:10:07.811506 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3343/6973] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 04:10:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 656 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 04:10:07.824014 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1cfbef12-2de5-4e36-a96d-0558f322aeea tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:10:07.825275 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1cfbef12-2de5-4e36-a96d-0558f322aeea tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 60f45e37-e987-4aef-85d5-90e612460605] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:10:07.879988 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1cfbef12-2de5-4e36-a96d-0558f322aeea tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:10:07.887080 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1cfbef12-2de5-4e36-a96d-0558f322aeea tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605" status: 200 len: 1229 microversion: 2.1 time: 0.068104 Oct 27 04:10:07.888173 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3631/6974] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:10:07 2022] GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605 => generated 1229 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:10:08.910602 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-49aaf64d-118d-4dab-8ab8-185e69e011b0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:10:08.911165 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-49aaf64d-118d-4dab-8ab8-185e69e011b0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 60f45e37-e987-4aef-85d5-90e612460605] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:10:08.919284 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-49aaf64d-118d-4dab-8ab8-185e69e011b0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:08.919284 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-49aaf64d-118d-4dab-8ab8-185e69e011b0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:08.919284 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-49aaf64d-118d-4dab-8ab8-185e69e011b0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:08.919284 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-49aaf64d-118d-4dab-8ab8-185e69e011b0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:08.919688 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-49aaf64d-118d-4dab-8ab8-185e69e011b0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:08.919964 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-49aaf64d-118d-4dab-8ab8-185e69e011b0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:08.992550 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-49aaf64d-118d-4dab-8ab8-185e69e011b0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:10:09.003453 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-49aaf64d-118d-4dab-8ab8-185e69e011b0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605" status: 200 len: 1233 microversion: 2.1 time: 0.097707 Oct 27 04:10:09.004313 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3344/6975] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:10:08 2022] GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605 => generated 1233 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:10:10.026786 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-40034e1a-90b3-4f6e-9005-85753d3d5c75 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:10:10.027429 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-40034e1a-90b3-4f6e-9005-85753d3d5c75 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 60f45e37-e987-4aef-85d5-90e612460605] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:10:10.035984 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-40034e1a-90b3-4f6e-9005-85753d3d5c75 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:10.036505 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-40034e1a-90b3-4f6e-9005-85753d3d5c75 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:10.036971 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-40034e1a-90b3-4f6e-9005-85753d3d5c75 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:10.037733 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-40034e1a-90b3-4f6e-9005-85753d3d5c75 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:10.038233 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-40034e1a-90b3-4f6e-9005-85753d3d5c75 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:10.038952 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-40034e1a-90b3-4f6e-9005-85753d3d5c75 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:10.110971 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-40034e1a-90b3-4f6e-9005-85753d3d5c75 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:10:10.120066 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-40034e1a-90b3-4f6e-9005-85753d3d5c75 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605" status: 200 len: 1299 microversion: 2.1 time: 0.097157 Oct 27 04:10:10.120671 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3632/6976] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:10:10 2022] GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605 => generated 1299 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:10:11.146118 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b3c2f901-7e45-4e0d-bd21-4507bb73446a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:10:11.153564 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b3c2f901-7e45-4e0d-bd21-4507bb73446a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 60f45e37-e987-4aef-85d5-90e612460605] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:10:11.157585 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b3c2f901-7e45-4e0d-bd21-4507bb73446a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:11.158353 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b3c2f901-7e45-4e0d-bd21-4507bb73446a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:11.158964 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b3c2f901-7e45-4e0d-bd21-4507bb73446a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:11.159876 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b3c2f901-7e45-4e0d-bd21-4507bb73446a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:11.160502 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b3c2f901-7e45-4e0d-bd21-4507bb73446a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:11.161195 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b3c2f901-7e45-4e0d-bd21-4507bb73446a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:11.409202 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b3c2f901-7e45-4e0d-bd21-4507bb73446a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:10:11.421961 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b3c2f901-7e45-4e0d-bd21-4507bb73446a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605" status: 200 len: 1341 microversion: 2.1 time: 0.281379 Oct 27 04:10:11.423690 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3345/6977] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:10:11 2022] GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605 => generated 1341 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:10:12.193801 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-7bdb79b7-edef-4d33-9dd1-84da66bf8522 req-d6f6ebef-af27-4a13-bdcc-3c4ada20ca02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60f45e37-e987-4aef-85d5-90e612460605", "tag": "f83fb1af-f1dd-4c1a-a4c1-957d812df300"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:10:12.213631 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-7bdb79b7-edef-4d33-9dd1-84da66bf8522 req-d6f6ebef-af27-4a13-bdcc-3c4ada20ca02 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:12.217395 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-7bdb79b7-edef-4d33-9dd1-84da66bf8522 req-d6f6ebef-af27-4a13-bdcc-3c4ada20ca02 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:12.217880 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-7bdb79b7-edef-4d33-9dd1-84da66bf8522 req-d6f6ebef-af27-4a13-bdcc-3c4ada20ca02 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:12.230147 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-7bdb79b7-edef-4d33-9dd1-84da66bf8522 req-d6f6ebef-af27-4a13-bdcc-3c4ada20ca02 service nova] Creating event network-changed:f83fb1af-f1dd-4c1a-a4c1-957d812df300 for instance 60f45e37-e987-4aef-85d5-90e612460605 on n-h2-862769-1 Oct 27 04:10:12.236174 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-7bdb79b7-edef-4d33-9dd1-84da66bf8522 req-d6f6ebef-af27-4a13-bdcc-3c4ada20ca02 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048683 Oct 27 04:10:12.236784 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3633/6978] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:10:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:10:12.444846 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-58ef7808-7190-4adb-a3f0-e0050263fd88 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:10:12.445614 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-58ef7808-7190-4adb-a3f0-e0050263fd88 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 60f45e37-e987-4aef-85d5-90e612460605] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:10:12.448693 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=6 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:10:12.466463 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-58ef7808-7190-4adb-a3f0-e0050263fd88 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:12.467209 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-58ef7808-7190-4adb-a3f0-e0050263fd88 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:12.467813 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-58ef7808-7190-4adb-a3f0-e0050263fd88 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:12.469017 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-58ef7808-7190-4adb-a3f0-e0050263fd88 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:12.469816 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-58ef7808-7190-4adb-a3f0-e0050263fd88 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:12.470622 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-58ef7808-7190-4adb-a3f0-e0050263fd88 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:12.474293 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=79 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:10:12.739421 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-58ef7808-7190-4adb-a3f0-e0050263fd88 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:10:12.749810 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-58ef7808-7190-4adb-a3f0-e0050263fd88 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605" status: 200 len: 1341 microversion: 2.1 time: 0.308729 Oct 27 04:10:12.751561 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3346/6979] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:10:12 2022] GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605 => generated 1341 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:10:13.775219 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4e6b4455-bce2-4442-a1cb-8a3ac3b52c1f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:10:13.776108 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4e6b4455-bce2-4442-a1cb-8a3ac3b52c1f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 60f45e37-e987-4aef-85d5-90e612460605] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:10:13.779103 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=35 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:10:13.785316 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4e6b4455-bce2-4442-a1cb-8a3ac3b52c1f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:13.786165 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4e6b4455-bce2-4442-a1cb-8a3ac3b52c1f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:13.786693 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4e6b4455-bce2-4442-a1cb-8a3ac3b52c1f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:13.787573 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4e6b4455-bce2-4442-a1cb-8a3ac3b52c1f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:13.788049 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4e6b4455-bce2-4442-a1cb-8a3ac3b52c1f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:13.788491 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4e6b4455-bce2-4442-a1cb-8a3ac3b52c1f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:13.791557 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=79,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:10:13.956651 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4e6b4455-bce2-4442-a1cb-8a3ac3b52c1f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:10:13.966234 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4e6b4455-bce2-4442-a1cb-8a3ac3b52c1f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605" status: 200 len: 1341 microversion: 2.1 time: 0.195828 Oct 27 04:10:13.967212 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3634/6980] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:10:13 2022] GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605 => generated 1341 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:10:14.990065 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-09b80ea9-bc6b-48b1-9983-329333d96995 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:10:14.993161 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-09b80ea9-bc6b-48b1-9983-329333d96995 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 60f45e37-e987-4aef-85d5-90e612460605] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:10:15.004211 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-09b80ea9-bc6b-48b1-9983-329333d96995 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:15.004824 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-09b80ea9-bc6b-48b1-9983-329333d96995 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:15.005402 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-09b80ea9-bc6b-48b1-9983-329333d96995 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:15.006251 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-09b80ea9-bc6b-48b1-9983-329333d96995 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:15.006921 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-09b80ea9-bc6b-48b1-9983-329333d96995 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:15.013579 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-09b80ea9-bc6b-48b1-9983-329333d96995 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:15.172525 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-09b80ea9-bc6b-48b1-9983-329333d96995 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:10:15.182997 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-09b80ea9-bc6b-48b1-9983-329333d96995 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605" status: 200 len: 1341 microversion: 2.1 time: 0.197122 Oct 27 04:10:15.184143 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3347/6981] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:10:14 2022] GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605 => generated 1341 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:10:16.207503 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4cede617-b82e-4320-9c9c-c00442ae23c9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:10:16.208283 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4cede617-b82e-4320-9c9c-c00442ae23c9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 60f45e37-e987-4aef-85d5-90e612460605] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:10:16.216190 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4cede617-b82e-4320-9c9c-c00442ae23c9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:16.216699 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4cede617-b82e-4320-9c9c-c00442ae23c9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:16.217159 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4cede617-b82e-4320-9c9c-c00442ae23c9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:16.217906 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4cede617-b82e-4320-9c9c-c00442ae23c9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:16.218402 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4cede617-b82e-4320-9c9c-c00442ae23c9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:16.218853 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4cede617-b82e-4320-9c9c-c00442ae23c9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:16.405742 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4cede617-b82e-4320-9c9c-c00442ae23c9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:10:16.405742 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4cede617-b82e-4320-9c9c-c00442ae23c9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605" status: 200 len: 1341 microversion: 2.1 time: 0.161323 Oct 27 04:10:16.405742 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3635/6982] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:10:16 2022] GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605 => generated 1341 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:10:17.385325 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ce5d6d5c-9884-4b34-bc28-e707e8c0a913 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:10:17.385945 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ce5d6d5c-9884-4b34-bc28-e707e8c0a913 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 60f45e37-e987-4aef-85d5-90e612460605] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:10:17.392825 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ce5d6d5c-9884-4b34-bc28-e707e8c0a913 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:17.393310 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ce5d6d5c-9884-4b34-bc28-e707e8c0a913 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:17.393750 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ce5d6d5c-9884-4b34-bc28-e707e8c0a913 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:17.394546 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ce5d6d5c-9884-4b34-bc28-e707e8c0a913 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:17.395008 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ce5d6d5c-9884-4b34-bc28-e707e8c0a913 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:17.396418 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ce5d6d5c-9884-4b34-bc28-e707e8c0a913 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:17.536435 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ce5d6d5c-9884-4b34-bc28-e707e8c0a913 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:10:17.544725 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ce5d6d5c-9884-4b34-bc28-e707e8c0a913 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605" status: 200 len: 1341 microversion: 2.1 time: 0.163355 Oct 27 04:10:17.545299 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3348/6983] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:10:17 2022] GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605 => generated 1341 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:10:18.568456 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f30b3626-79e6-4cbb-9cfc-a821697b877b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:10:18.569083 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f30b3626-79e6-4cbb-9cfc-a821697b877b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 60f45e37-e987-4aef-85d5-90e612460605] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:10:18.576354 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:10:18.586027 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f30b3626-79e6-4cbb-9cfc-a821697b877b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:18.586027 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f30b3626-79e6-4cbb-9cfc-a821697b877b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:18.586027 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f30b3626-79e6-4cbb-9cfc-a821697b877b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:18.586027 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f30b3626-79e6-4cbb-9cfc-a821697b877b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:18.586027 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f30b3626-79e6-4cbb-9cfc-a821697b877b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:18.586027 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f30b3626-79e6-4cbb-9cfc-a821697b877b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:18.721536 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f30b3626-79e6-4cbb-9cfc-a821697b877b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:10:18.729590 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f30b3626-79e6-4cbb-9cfc-a821697b877b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605" status: 200 len: 1341 microversion: 2.1 time: 0.165058 Oct 27 04:10:18.733544 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3636/6984] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:10:18 2022] GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605 => generated 1341 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 04:10:19.753464 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1c22f7bd-9b97-4d2b-aa54-ac167fdd9370 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:10:19.754017 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1c22f7bd-9b97-4d2b-aa54-ac167fdd9370 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 60f45e37-e987-4aef-85d5-90e612460605] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:10:19.755919 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:10:19.756614 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=6 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:10:19.763409 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1c22f7bd-9b97-4d2b-aa54-ac167fdd9370 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:19.763947 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1c22f7bd-9b97-4d2b-aa54-ac167fdd9370 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:19.764515 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1c22f7bd-9b97-4d2b-aa54-ac167fdd9370 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:19.765225 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1c22f7bd-9b97-4d2b-aa54-ac167fdd9370 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:19.765693 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1c22f7bd-9b97-4d2b-aa54-ac167fdd9370 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:19.766168 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1c22f7bd-9b97-4d2b-aa54-ac167fdd9370 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:19.903021 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1c22f7bd-9b97-4d2b-aa54-ac167fdd9370 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:10:19.910979 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1c22f7bd-9b97-4d2b-aa54-ac167fdd9370 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605" status: 200 len: 1341 microversion: 2.1 time: 0.161587 Oct 27 04:10:19.911557 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3349/6985] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:10:19 2022] GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605 => generated 1341 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:10:20.937980 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9f20b9a9-4afd-4dd8-8038-4ab61e563c19 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:10:20.938718 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-9f20b9a9-4afd-4dd8-8038-4ab61e563c19 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 60f45e37-e987-4aef-85d5-90e612460605] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:10:20.945782 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9f20b9a9-4afd-4dd8-8038-4ab61e563c19 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:20.946351 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9f20b9a9-4afd-4dd8-8038-4ab61e563c19 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:20.946815 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9f20b9a9-4afd-4dd8-8038-4ab61e563c19 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:20.947527 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9f20b9a9-4afd-4dd8-8038-4ab61e563c19 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:20.948026 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9f20b9a9-4afd-4dd8-8038-4ab61e563c19 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:20.948509 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9f20b9a9-4afd-4dd8-8038-4ab61e563c19 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:21.093868 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9f20b9a9-4afd-4dd8-8038-4ab61e563c19 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:10:21.102737 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9f20b9a9-4afd-4dd8-8038-4ab61e563c19 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605" status: 200 len: 1341 microversion: 2.1 time: 0.169334 Oct 27 04:10:21.103597 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3637/6986] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:10:20 2022] GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605 => generated 1341 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 04:10:22.127250 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0760ea46-33e3-4c0b-a31b-15dddbd7b992 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:10:22.127880 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0760ea46-33e3-4c0b-a31b-15dddbd7b992 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 60f45e37-e987-4aef-85d5-90e612460605] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:10:22.135327 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0760ea46-33e3-4c0b-a31b-15dddbd7b992 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:22.135819 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0760ea46-33e3-4c0b-a31b-15dddbd7b992 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:22.136263 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0760ea46-33e3-4c0b-a31b-15dddbd7b992 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:22.136963 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0760ea46-33e3-4c0b-a31b-15dddbd7b992 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:22.137426 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0760ea46-33e3-4c0b-a31b-15dddbd7b992 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:22.137857 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0760ea46-33e3-4c0b-a31b-15dddbd7b992 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:22.284290 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0760ea46-33e3-4c0b-a31b-15dddbd7b992 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:10:22.292493 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0760ea46-33e3-4c0b-a31b-15dddbd7b992 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605" status: 200 len: 1341 microversion: 2.1 time: 0.169100 Oct 27 04:10:22.293092 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3350/6987] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:10:22 2022] GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605 => generated 1341 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 04:10:23.314897 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-392e4280-f2fd-4712-8f11-5479daa386ef tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:10:23.315487 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-392e4280-f2fd-4712-8f11-5479daa386ef tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 60f45e37-e987-4aef-85d5-90e612460605] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:10:23.322374 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-392e4280-f2fd-4712-8f11-5479daa386ef tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:23.322880 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-392e4280-f2fd-4712-8f11-5479daa386ef tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:23.323338 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-392e4280-f2fd-4712-8f11-5479daa386ef tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:23.324051 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-392e4280-f2fd-4712-8f11-5479daa386ef tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:23.324526 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-392e4280-f2fd-4712-8f11-5479daa386ef tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:23.324970 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-392e4280-f2fd-4712-8f11-5479daa386ef tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:23.463571 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-392e4280-f2fd-4712-8f11-5479daa386ef tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:10:23.475406 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-392e4280-f2fd-4712-8f11-5479daa386ef tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605" status: 200 len: 1341 microversion: 2.1 time: 0.164299 Oct 27 04:10:23.476229 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3638/6988] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:10:23 2022] GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605 => generated 1341 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:10:24.498933 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f8ea9391-190b-4ba2-b304-a8c61785b165 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:10:24.499666 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f8ea9391-190b-4ba2-b304-a8c61785b165 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 60f45e37-e987-4aef-85d5-90e612460605] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:10:24.506704 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f8ea9391-190b-4ba2-b304-a8c61785b165 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:24.507203 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f8ea9391-190b-4ba2-b304-a8c61785b165 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:24.507654 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f8ea9391-190b-4ba2-b304-a8c61785b165 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:24.508381 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f8ea9391-190b-4ba2-b304-a8c61785b165 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:24.508827 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f8ea9391-190b-4ba2-b304-a8c61785b165 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:24.509261 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f8ea9391-190b-4ba2-b304-a8c61785b165 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:24.654909 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f8ea9391-190b-4ba2-b304-a8c61785b165 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:10:24.662717 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f8ea9391-190b-4ba2-b304-a8c61785b165 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605" status: 200 len: 1341 microversion: 2.1 time: 0.167873 Oct 27 04:10:24.663390 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3351/6989] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:10:24 2022] GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605 => generated 1341 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:10:25.688565 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c5aeba85-9dc3-4a10-a6e2-b2c8418db3a9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:10:25.689154 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c5aeba85-9dc3-4a10-a6e2-b2c8418db3a9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 60f45e37-e987-4aef-85d5-90e612460605] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:10:25.696784 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c5aeba85-9dc3-4a10-a6e2-b2c8418db3a9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:25.697288 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c5aeba85-9dc3-4a10-a6e2-b2c8418db3a9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:25.697747 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c5aeba85-9dc3-4a10-a6e2-b2c8418db3a9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:25.698602 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c5aeba85-9dc3-4a10-a6e2-b2c8418db3a9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:25.699071 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c5aeba85-9dc3-4a10-a6e2-b2c8418db3a9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:25.699517 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c5aeba85-9dc3-4a10-a6e2-b2c8418db3a9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:25.838653 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c5aeba85-9dc3-4a10-a6e2-b2c8418db3a9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:10:25.846626 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c5aeba85-9dc3-4a10-a6e2-b2c8418db3a9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605" status: 200 len: 1341 microversion: 2.1 time: 0.163817 Oct 27 04:10:25.855827 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3639/6990] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:10:25 2022] GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605 => generated 1341 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:10:26.869941 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-628a0476-42c0-4764-9f1b-8b8e0a43547b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:10:26.870608 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-628a0476-42c0-4764-9f1b-8b8e0a43547b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 60f45e37-e987-4aef-85d5-90e612460605] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:10:26.878892 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-628a0476-42c0-4764-9f1b-8b8e0a43547b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:26.879434 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-628a0476-42c0-4764-9f1b-8b8e0a43547b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:26.879944 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-628a0476-42c0-4764-9f1b-8b8e0a43547b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:26.880676 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-628a0476-42c0-4764-9f1b-8b8e0a43547b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:26.881145 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-628a0476-42c0-4764-9f1b-8b8e0a43547b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:26.881705 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-628a0476-42c0-4764-9f1b-8b8e0a43547b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:27.023207 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-628a0476-42c0-4764-9f1b-8b8e0a43547b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:10:27.150628 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-628a0476-42c0-4764-9f1b-8b8e0a43547b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605" status: 200 len: 1341 microversion: 2.1 time: 0.165975 Oct 27 04:10:27.150628 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3352/6991] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:10:26 2022] GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605 => generated 1341 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:10:28.059276 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1d3171d8-9a09-4623-960e-5a055e47cda4 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:10:28.061729 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1d3171d8-9a09-4623-960e-5a055e47cda4 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 60f45e37-e987-4aef-85d5-90e612460605] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:10:28.070828 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1d3171d8-9a09-4623-960e-5a055e47cda4 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:28.071822 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1d3171d8-9a09-4623-960e-5a055e47cda4 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:28.073196 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1d3171d8-9a09-4623-960e-5a055e47cda4 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:28.074705 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1d3171d8-9a09-4623-960e-5a055e47cda4 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:28.075594 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1d3171d8-9a09-4623-960e-5a055e47cda4 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:28.076941 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1d3171d8-9a09-4623-960e-5a055e47cda4 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:28.223192 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1d3171d8-9a09-4623-960e-5a055e47cda4 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:10:28.231032 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1d3171d8-9a09-4623-960e-5a055e47cda4 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605" status: 200 len: 1341 microversion: 2.1 time: 0.176288 Oct 27 04:10:28.231618 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3640/6992] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:10:28 2022] GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605 => generated 1341 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 04:10:29.255625 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-40744548-6a0a-49d6-817b-d8aa05c9c16e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:10:29.256245 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-40744548-6a0a-49d6-817b-d8aa05c9c16e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 60f45e37-e987-4aef-85d5-90e612460605] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:10:29.263503 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-40744548-6a0a-49d6-817b-d8aa05c9c16e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:29.264006 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-40744548-6a0a-49d6-817b-d8aa05c9c16e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:29.264448 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-40744548-6a0a-49d6-817b-d8aa05c9c16e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:29.265201 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-40744548-6a0a-49d6-817b-d8aa05c9c16e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:29.265658 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-40744548-6a0a-49d6-817b-d8aa05c9c16e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:29.266119 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-40744548-6a0a-49d6-817b-d8aa05c9c16e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:29.412064 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-40744548-6a0a-49d6-817b-d8aa05c9c16e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:10:29.420042 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-40744548-6a0a-49d6-817b-d8aa05c9c16e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605" status: 200 len: 1341 microversion: 2.1 time: 0.168652 Oct 27 04:10:29.420627 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3353/6993] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:10:29 2022] GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605 => generated 1341 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:10:30.443532 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8215b4b0-ea78-42cb-956c-c6b8c353a588 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:10:30.444115 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8215b4b0-ea78-42cb-956c-c6b8c353a588 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 60f45e37-e987-4aef-85d5-90e612460605] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:10:30.447110 n-d-862769-1 devstack@n-api.service[121001]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 04:10:30.447249 n-d-862769-1 devstack@n-api.service[121001]: Thu Oct 27 04:10:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605 (ip 10.222.0.20) !!! Oct 27 04:10:30.448486 n-d-862769-1 devstack@n-api.service[121001]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 04:10:30.448610 n-d-862769-1 devstack@n-api.service[121001]: Thu Oct 27 04:10:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605 (ip 10.222.0.20) !!! Oct 27 04:10:30.461419 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8215b4b0-ea78-42cb-956c-c6b8c353a588 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:30.462019 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8215b4b0-ea78-42cb-956c-c6b8c353a588 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:30.462403 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8215b4b0-ea78-42cb-956c-c6b8c353a588 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:30.463232 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8215b4b0-ea78-42cb-956c-c6b8c353a588 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:30.463716 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8215b4b0-ea78-42cb-956c-c6b8c353a588 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:30.464112 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8215b4b0-ea78-42cb-956c-c6b8c353a588 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:30.609690 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8215b4b0-ea78-42cb-956c-c6b8c353a588 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:10:30.617644 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8215b4b0-ea78-42cb-956c-c6b8c353a588 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605" status: 200 len: 1341 microversion: 2.1 time: 0.178195 Oct 27 04:10:30.618267 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3641/6994] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:10:30 2022] GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605 => generated 1341 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:10:31.642486 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ca64eb82-546f-4c24-bcc9-cf73eaf79993 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:10:31.645852 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ca64eb82-546f-4c24-bcc9-cf73eaf79993 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 60f45e37-e987-4aef-85d5-90e612460605] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:10:31.650652 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ca64eb82-546f-4c24-bcc9-cf73eaf79993 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:31.651302 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ca64eb82-546f-4c24-bcc9-cf73eaf79993 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:31.651898 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ca64eb82-546f-4c24-bcc9-cf73eaf79993 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:31.653095 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ca64eb82-546f-4c24-bcc9-cf73eaf79993 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:31.653567 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ca64eb82-546f-4c24-bcc9-cf73eaf79993 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:31.654008 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ca64eb82-546f-4c24-bcc9-cf73eaf79993 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:31.794709 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ca64eb82-546f-4c24-bcc9-cf73eaf79993 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:10:31.802403 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ca64eb82-546f-4c24-bcc9-cf73eaf79993 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605" status: 200 len: 1341 microversion: 2.1 time: 0.164252 Oct 27 04:10:31.803756 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3354/6995] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:10:31 2022] GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605 => generated 1341 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:10:32.825168 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-36221815-59f1-4b34-afd8-16f26a8b0740 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:10:32.825846 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-36221815-59f1-4b34-afd8-16f26a8b0740 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 60f45e37-e987-4aef-85d5-90e612460605] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:10:32.833190 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-36221815-59f1-4b34-afd8-16f26a8b0740 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:32.833706 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-36221815-59f1-4b34-afd8-16f26a8b0740 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:32.834204 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-36221815-59f1-4b34-afd8-16f26a8b0740 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:32.835032 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-36221815-59f1-4b34-afd8-16f26a8b0740 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:32.835501 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-36221815-59f1-4b34-afd8-16f26a8b0740 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:32.835961 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-36221815-59f1-4b34-afd8-16f26a8b0740 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:32.978528 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-36221815-59f1-4b34-afd8-16f26a8b0740 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:10:32.987236 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-36221815-59f1-4b34-afd8-16f26a8b0740 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605" status: 200 len: 1341 microversion: 2.1 time: 0.166029 Oct 27 04:10:32.987773 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3642/6996] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:10:32 2022] GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605 => generated 1341 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:10:34.012717 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b3750c0d-c88c-4ecc-9acc-c7c52c1a33db tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:10:34.013436 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b3750c0d-c88c-4ecc-9acc-c7c52c1a33db tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 60f45e37-e987-4aef-85d5-90e612460605] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:10:34.020663 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b3750c0d-c88c-4ecc-9acc-c7c52c1a33db tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:34.021226 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b3750c0d-c88c-4ecc-9acc-c7c52c1a33db tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:34.021668 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b3750c0d-c88c-4ecc-9acc-c7c52c1a33db tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:34.022401 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b3750c0d-c88c-4ecc-9acc-c7c52c1a33db tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:34.022857 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b3750c0d-c88c-4ecc-9acc-c7c52c1a33db tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:34.023284 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b3750c0d-c88c-4ecc-9acc-c7c52c1a33db tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:34.169773 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b3750c0d-c88c-4ecc-9acc-c7c52c1a33db tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:10:34.178109 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b3750c0d-c88c-4ecc-9acc-c7c52c1a33db tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605" status: 200 len: 1341 microversion: 2.1 time: 0.171193 Oct 27 04:10:34.178700 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3355/6997] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:10:34 2022] GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605 => generated 1341 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:10:35.201654 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-11a018bb-f430-41e8-bfd8-98835420d056 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:10:35.203799 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-11a018bb-f430-41e8-bfd8-98835420d056 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 60f45e37-e987-4aef-85d5-90e612460605] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:10:35.210795 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-11a018bb-f430-41e8-bfd8-98835420d056 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:35.211313 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-11a018bb-f430-41e8-bfd8-98835420d056 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:35.211816 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-11a018bb-f430-41e8-bfd8-98835420d056 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:35.212546 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-11a018bb-f430-41e8-bfd8-98835420d056 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:35.213057 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-11a018bb-f430-41e8-bfd8-98835420d056 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:35.213511 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-11a018bb-f430-41e8-bfd8-98835420d056 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:35.362106 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-11a018bb-f430-41e8-bfd8-98835420d056 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:10:35.372809 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-11a018bb-f430-41e8-bfd8-98835420d056 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605" status: 200 len: 1341 microversion: 2.1 time: 0.175126 Oct 27 04:10:35.375085 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3643/6998] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:10:35 2022] GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605 => generated 1341 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:10:36.396499 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b1c67af2-670d-48e6-ac11-d0fe5d93889f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:10:36.398181 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b1c67af2-670d-48e6-ac11-d0fe5d93889f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 60f45e37-e987-4aef-85d5-90e612460605] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:10:36.406113 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b1c67af2-670d-48e6-ac11-d0fe5d93889f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:36.406999 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b1c67af2-670d-48e6-ac11-d0fe5d93889f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:36.407675 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b1c67af2-670d-48e6-ac11-d0fe5d93889f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:36.411751 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b1c67af2-670d-48e6-ac11-d0fe5d93889f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:36.412796 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b1c67af2-670d-48e6-ac11-d0fe5d93889f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:36.413426 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b1c67af2-670d-48e6-ac11-d0fe5d93889f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:36.658745 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b1c67af2-670d-48e6-ac11-d0fe5d93889f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:10:36.667694 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b1c67af2-670d-48e6-ac11-d0fe5d93889f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605" status: 200 len: 1341 microversion: 2.1 time: 0.275748 Oct 27 04:10:36.682089 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3356/6999] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:10:36 2022] GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605 => generated 1341 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:10:37.693434 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9c6c38df-4b1b-4c76-b702-9b9f8bc62010 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:10:37.694120 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-9c6c38df-4b1b-4c76-b702-9b9f8bc62010 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 60f45e37-e987-4aef-85d5-90e612460605] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:10:37.705129 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9c6c38df-4b1b-4c76-b702-9b9f8bc62010 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:37.705876 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9c6c38df-4b1b-4c76-b702-9b9f8bc62010 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:37.706525 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9c6c38df-4b1b-4c76-b702-9b9f8bc62010 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:37.707417 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9c6c38df-4b1b-4c76-b702-9b9f8bc62010 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:37.708051 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9c6c38df-4b1b-4c76-b702-9b9f8bc62010 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:37.708777 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9c6c38df-4b1b-4c76-b702-9b9f8bc62010 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:37.850362 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9c6c38df-4b1b-4c76-b702-9b9f8bc62010 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:10:37.858931 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9c6c38df-4b1b-4c76-b702-9b9f8bc62010 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605" status: 200 len: 1341 microversion: 2.1 time: 0.169477 Oct 27 04:10:37.859563 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3644/7000] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:10:37 2022] GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605 => generated 1341 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:10:38.882489 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-dce3d2a6-23b4-49b0-8c1d-27d8b2936d75 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:10:38.883148 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-dce3d2a6-23b4-49b0-8c1d-27d8b2936d75 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 60f45e37-e987-4aef-85d5-90e612460605] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:10:38.890579 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dce3d2a6-23b4-49b0-8c1d-27d8b2936d75 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:38.891075 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dce3d2a6-23b4-49b0-8c1d-27d8b2936d75 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:38.891677 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dce3d2a6-23b4-49b0-8c1d-27d8b2936d75 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:38.892280 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dce3d2a6-23b4-49b0-8c1d-27d8b2936d75 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:38.892738 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dce3d2a6-23b4-49b0-8c1d-27d8b2936d75 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:38.893218 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dce3d2a6-23b4-49b0-8c1d-27d8b2936d75 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:39.039940 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-dce3d2a6-23b4-49b0-8c1d-27d8b2936d75 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:10:39.050766 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-dce3d2a6-23b4-49b0-8c1d-27d8b2936d75 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605" status: 200 len: 1341 microversion: 2.1 time: 0.172075 Oct 27 04:10:39.051408 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3357/7001] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:10:38 2022] GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605 => generated 1341 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:10:40.075440 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d316371f-263e-48f1-a394-73443eadb7b8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:10:40.076168 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d316371f-263e-48f1-a394-73443eadb7b8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 60f45e37-e987-4aef-85d5-90e612460605] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:10:40.083974 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d316371f-263e-48f1-a394-73443eadb7b8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:40.084418 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d316371f-263e-48f1-a394-73443eadb7b8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:40.084878 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d316371f-263e-48f1-a394-73443eadb7b8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:40.085809 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d316371f-263e-48f1-a394-73443eadb7b8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:40.086320 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d316371f-263e-48f1-a394-73443eadb7b8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:40.086864 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d316371f-263e-48f1-a394-73443eadb7b8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:40.238883 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d316371f-263e-48f1-a394-73443eadb7b8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:10:40.247194 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d316371f-263e-48f1-a394-73443eadb7b8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605" status: 200 len: 1341 microversion: 2.1 time: 0.175693 Oct 27 04:10:40.247777 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3645/7002] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:10:40 2022] GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605 => generated 1341 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:10:41.271294 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0290ea89-95da-4c09-b85e-25b1c094a02f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:10:41.271822 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0290ea89-95da-4c09-b85e-25b1c094a02f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 60f45e37-e987-4aef-85d5-90e612460605] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:10:41.278678 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0290ea89-95da-4c09-b85e-25b1c094a02f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:41.279157 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0290ea89-95da-4c09-b85e-25b1c094a02f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:41.279596 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0290ea89-95da-4c09-b85e-25b1c094a02f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:41.280409 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0290ea89-95da-4c09-b85e-25b1c094a02f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:41.281101 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0290ea89-95da-4c09-b85e-25b1c094a02f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:41.281538 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0290ea89-95da-4c09-b85e-25b1c094a02f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:41.436063 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0290ea89-95da-4c09-b85e-25b1c094a02f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:10:41.444471 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0290ea89-95da-4c09-b85e-25b1c094a02f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605" status: 200 len: 1341 microversion: 2.1 time: 0.177150 Oct 27 04:10:41.445053 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3358/7003] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:10:41 2022] GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605 => generated 1341 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:10:42.467515 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-dfe78d98-e5b3-4fad-91da-35ae65e86fdc tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:10:42.468428 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-dfe78d98-e5b3-4fad-91da-35ae65e86fdc tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 60f45e37-e987-4aef-85d5-90e612460605] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:10:42.475056 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dfe78d98-e5b3-4fad-91da-35ae65e86fdc tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:42.475568 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dfe78d98-e5b3-4fad-91da-35ae65e86fdc tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:42.476039 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dfe78d98-e5b3-4fad-91da-35ae65e86fdc tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:42.476751 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dfe78d98-e5b3-4fad-91da-35ae65e86fdc tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:42.477250 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dfe78d98-e5b3-4fad-91da-35ae65e86fdc tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:42.477698 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dfe78d98-e5b3-4fad-91da-35ae65e86fdc tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:42.622119 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-dfe78d98-e5b3-4fad-91da-35ae65e86fdc tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:10:42.630464 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-dfe78d98-e5b3-4fad-91da-35ae65e86fdc tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605" status: 200 len: 1341 microversion: 2.1 time: 0.166955 Oct 27 04:10:42.631214 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3646/7004] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:10:42 2022] GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605 => generated 1341 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:10:43.654202 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d014cbbf-67fb-492c-a0c8-6176b77fcc22 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:10:43.655543 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d014cbbf-67fb-492c-a0c8-6176b77fcc22 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 60f45e37-e987-4aef-85d5-90e612460605] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:10:43.658914 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=26 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:10:43.663914 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d014cbbf-67fb-492c-a0c8-6176b77fcc22 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:43.664525 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d014cbbf-67fb-492c-a0c8-6176b77fcc22 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:43.664982 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d014cbbf-67fb-492c-a0c8-6176b77fcc22 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:43.665704 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d014cbbf-67fb-492c-a0c8-6176b77fcc22 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:43.666202 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d014cbbf-67fb-492c-a0c8-6176b77fcc22 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:43.666786 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d014cbbf-67fb-492c-a0c8-6176b77fcc22 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:43.669725 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=78 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:10:43.814636 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d014cbbf-67fb-492c-a0c8-6176b77fcc22 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:10:43.823819 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d014cbbf-67fb-492c-a0c8-6176b77fcc22 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605" status: 200 len: 1341 microversion: 2.1 time: 0.173406 Oct 27 04:10:43.824674 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3359/7005] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:10:43 2022] GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605 => generated 1341 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:10:44.848865 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4542ed7b-6a25-48a5-8740-7bc201ab1d87 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:10:44.849542 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4542ed7b-6a25-48a5-8740-7bc201ab1d87 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 60f45e37-e987-4aef-85d5-90e612460605] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:10:44.852321 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=26 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:10:44.857630 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4542ed7b-6a25-48a5-8740-7bc201ab1d87 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:44.858729 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4542ed7b-6a25-48a5-8740-7bc201ab1d87 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:44.859199 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4542ed7b-6a25-48a5-8740-7bc201ab1d87 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:44.859957 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4542ed7b-6a25-48a5-8740-7bc201ab1d87 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:44.860444 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4542ed7b-6a25-48a5-8740-7bc201ab1d87 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:44.860898 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4542ed7b-6a25-48a5-8740-7bc201ab1d87 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:45.000675 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4542ed7b-6a25-48a5-8740-7bc201ab1d87 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:10:45.008669 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4542ed7b-6a25-48a5-8740-7bc201ab1d87 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605" status: 200 len: 1341 microversion: 2.1 time: 0.163826 Oct 27 04:10:45.009259 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3647/7006] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:10:44 2022] GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605 => generated 1341 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:10:46.032993 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-61d2f076-5a88-4aaa-8fec-743608811d25 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:10:46.033638 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-61d2f076-5a88-4aaa-8fec-743608811d25 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 60f45e37-e987-4aef-85d5-90e612460605] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:10:46.040844 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-61d2f076-5a88-4aaa-8fec-743608811d25 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:46.041343 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-61d2f076-5a88-4aaa-8fec-743608811d25 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:46.041822 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-61d2f076-5a88-4aaa-8fec-743608811d25 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:46.042558 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-61d2f076-5a88-4aaa-8fec-743608811d25 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:46.043025 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-61d2f076-5a88-4aaa-8fec-743608811d25 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:46.043464 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-61d2f076-5a88-4aaa-8fec-743608811d25 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:46.177750 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-61d2f076-5a88-4aaa-8fec-743608811d25 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:10:46.185753 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-61d2f076-5a88-4aaa-8fec-743608811d25 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605" status: 200 len: 1341 microversion: 2.1 time: 0.157400 Oct 27 04:10:46.190154 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3360/7007] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:10:46 2022] GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605 => generated 1341 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:10:47.215576 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-64e53dc0-99a8-4193-9d99-5393ea3adbbc tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:10:47.216223 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-64e53dc0-99a8-4193-9d99-5393ea3adbbc tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 60f45e37-e987-4aef-85d5-90e612460605] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:10:47.227927 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-64e53dc0-99a8-4193-9d99-5393ea3adbbc tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:47.232006 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-64e53dc0-99a8-4193-9d99-5393ea3adbbc tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:47.232006 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-64e53dc0-99a8-4193-9d99-5393ea3adbbc tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:47.232006 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-64e53dc0-99a8-4193-9d99-5393ea3adbbc tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:47.232006 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-64e53dc0-99a8-4193-9d99-5393ea3adbbc tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:47.232006 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-64e53dc0-99a8-4193-9d99-5393ea3adbbc tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:47.233201 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=84 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:10:47.370371 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-64e53dc0-99a8-4193-9d99-5393ea3adbbc tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:10:47.380236 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-64e53dc0-99a8-4193-9d99-5393ea3adbbc tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605" status: 200 len: 1341 microversion: 2.1 time: 0.168666 Oct 27 04:10:47.380819 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3648/7008] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:10:47 2022] GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605 => generated 1341 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:10:48.403175 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-aa6e7e7e-26dc-4085-830f-c97ab98541ae tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:10:48.403912 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-aa6e7e7e-26dc-4085-830f-c97ab98541ae tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 60f45e37-e987-4aef-85d5-90e612460605] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:10:48.411865 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aa6e7e7e-26dc-4085-830f-c97ab98541ae tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:48.412295 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aa6e7e7e-26dc-4085-830f-c97ab98541ae tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:48.412732 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aa6e7e7e-26dc-4085-830f-c97ab98541ae tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:48.413429 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aa6e7e7e-26dc-4085-830f-c97ab98541ae tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:48.413918 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aa6e7e7e-26dc-4085-830f-c97ab98541ae tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:48.414366 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aa6e7e7e-26dc-4085-830f-c97ab98541ae tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:48.555028 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-aa6e7e7e-26dc-4085-830f-c97ab98541ae tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:10:48.563816 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-aa6e7e7e-26dc-4085-830f-c97ab98541ae tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605" status: 200 len: 1341 microversion: 2.1 time: 0.164617 Oct 27 04:10:48.567460 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3361/7009] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:10:48 2022] GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605 => generated 1341 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:10:49.587691 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e410d0cd-b98b-4fae-addf-94afaf9b92c1 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:10:49.588353 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e410d0cd-b98b-4fae-addf-94afaf9b92c1 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 60f45e37-e987-4aef-85d5-90e612460605] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:10:49.595455 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e410d0cd-b98b-4fae-addf-94afaf9b92c1 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:49.595954 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e410d0cd-b98b-4fae-addf-94afaf9b92c1 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:49.596463 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e410d0cd-b98b-4fae-addf-94afaf9b92c1 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:49.597173 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e410d0cd-b98b-4fae-addf-94afaf9b92c1 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:49.597645 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e410d0cd-b98b-4fae-addf-94afaf9b92c1 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:49.598104 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e410d0cd-b98b-4fae-addf-94afaf9b92c1 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:49.736950 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e410d0cd-b98b-4fae-addf-94afaf9b92c1 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:10:49.745081 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e410d0cd-b98b-4fae-addf-94afaf9b92c1 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605" status: 200 len: 1341 microversion: 2.1 time: 0.161421 Oct 27 04:10:49.745661 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3649/7010] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:10:49 2022] GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605 => generated 1341 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:10:50.769038 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f09a8537-6e2f-403a-8b3f-6f763d60b4b7 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:10:50.769681 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f09a8537-6e2f-403a-8b3f-6f763d60b4b7 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 60f45e37-e987-4aef-85d5-90e612460605] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:10:50.776797 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f09a8537-6e2f-403a-8b3f-6f763d60b4b7 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:50.781074 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f09a8537-6e2f-403a-8b3f-6f763d60b4b7 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:50.781074 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f09a8537-6e2f-403a-8b3f-6f763d60b4b7 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:50.781074 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f09a8537-6e2f-403a-8b3f-6f763d60b4b7 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:50.781074 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f09a8537-6e2f-403a-8b3f-6f763d60b4b7 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:50.781074 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f09a8537-6e2f-403a-8b3f-6f763d60b4b7 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:50.917743 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f09a8537-6e2f-403a-8b3f-6f763d60b4b7 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:10:50.926600 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f09a8537-6e2f-403a-8b3f-6f763d60b4b7 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605" status: 200 len: 1341 microversion: 2.1 time: 0.161445 Oct 27 04:10:50.930518 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3362/7011] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:10:50 2022] GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605 => generated 1341 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:10:51.950341 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-07a3ee35-eb31-4a6c-8e6a-f0481156c036 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:10:51.951054 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-07a3ee35-eb31-4a6c-8e6a-f0481156c036 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 60f45e37-e987-4aef-85d5-90e612460605] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:10:51.959115 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-07a3ee35-eb31-4a6c-8e6a-f0481156c036 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:51.960583 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-07a3ee35-eb31-4a6c-8e6a-f0481156c036 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:51.961193 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-07a3ee35-eb31-4a6c-8e6a-f0481156c036 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:51.961952 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-07a3ee35-eb31-4a6c-8e6a-f0481156c036 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:51.971602 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-07a3ee35-eb31-4a6c-8e6a-f0481156c036 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:51.972028 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-07a3ee35-eb31-4a6c-8e6a-f0481156c036 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:52.106591 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-07a3ee35-eb31-4a6c-8e6a-f0481156c036 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:10:52.115361 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-07a3ee35-eb31-4a6c-8e6a-f0481156c036 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605" status: 200 len: 1341 microversion: 2.1 time: 0.169243 Oct 27 04:10:52.115950 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3650/7012] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:10:51 2022] GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605 => generated 1341 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:10:53.137353 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f8b01698-59ec-4042-9949-3ff17c36c258 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:10:53.138194 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f8b01698-59ec-4042-9949-3ff17c36c258 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 60f45e37-e987-4aef-85d5-90e612460605] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:10:53.145344 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f8b01698-59ec-4042-9949-3ff17c36c258 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:53.145838 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f8b01698-59ec-4042-9949-3ff17c36c258 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:53.146334 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f8b01698-59ec-4042-9949-3ff17c36c258 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:53.147024 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f8b01698-59ec-4042-9949-3ff17c36c258 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:53.147478 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f8b01698-59ec-4042-9949-3ff17c36c258 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:53.148096 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f8b01698-59ec-4042-9949-3ff17c36c258 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:53.295297 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f8b01698-59ec-4042-9949-3ff17c36c258 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:10:53.304409 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f8b01698-59ec-4042-9949-3ff17c36c258 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605" status: 200 len: 1341 microversion: 2.1 time: 0.170934 Oct 27 04:10:53.305255 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3363/7013] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:10:53 2022] GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605 => generated 1341 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:10:54.329667 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9333b682-dc4a-43a3-93c9-ef710efd09a3 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:10:54.330408 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-9333b682-dc4a-43a3-93c9-ef710efd09a3 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 60f45e37-e987-4aef-85d5-90e612460605] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:10:54.337414 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9333b682-dc4a-43a3-93c9-ef710efd09a3 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:54.337911 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9333b682-dc4a-43a3-93c9-ef710efd09a3 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:54.338398 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9333b682-dc4a-43a3-93c9-ef710efd09a3 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:54.339186 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9333b682-dc4a-43a3-93c9-ef710efd09a3 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:54.339657 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9333b682-dc4a-43a3-93c9-ef710efd09a3 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:54.340105 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9333b682-dc4a-43a3-93c9-ef710efd09a3 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:54.476796 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9333b682-dc4a-43a3-93c9-ef710efd09a3 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:10:54.486712 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9333b682-dc4a-43a3-93c9-ef710efd09a3 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605" status: 200 len: 1375 microversion: 2.1 time: 0.161414 Oct 27 04:10:54.487385 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3651/7014] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:10:54 2022] GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605 => generated 1375 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 04:10:55.512705 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-002ecbda-160a-4e28-921f-2ab9199ae419 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:10:55.513320 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-002ecbda-160a-4e28-921f-2ab9199ae419 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 60f45e37-e987-4aef-85d5-90e612460605] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:10:55.520285 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-002ecbda-160a-4e28-921f-2ab9199ae419 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:55.520761 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-002ecbda-160a-4e28-921f-2ab9199ae419 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:55.521196 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-002ecbda-160a-4e28-921f-2ab9199ae419 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:55.521881 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-002ecbda-160a-4e28-921f-2ab9199ae419 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:55.522380 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-002ecbda-160a-4e28-921f-2ab9199ae419 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:55.522876 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-002ecbda-160a-4e28-921f-2ab9199ae419 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:55.655697 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-002ecbda-160a-4e28-921f-2ab9199ae419 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:10:55.664032 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-002ecbda-160a-4e28-921f-2ab9199ae419 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605" status: 200 len: 1375 microversion: 2.1 time: 0.155135 Oct 27 04:10:55.664611 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3364/7015] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:10:55 2022] GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605 => generated 1375 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:10:56.687638 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-cbc86c47-4eba-464f-b09f-7cfdc8244442 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:10:56.688287 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-cbc86c47-4eba-464f-b09f-7cfdc8244442 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 60f45e37-e987-4aef-85d5-90e612460605] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:10:56.695332 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cbc86c47-4eba-464f-b09f-7cfdc8244442 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:56.695844 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cbc86c47-4eba-464f-b09f-7cfdc8244442 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:56.696356 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cbc86c47-4eba-464f-b09f-7cfdc8244442 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:56.697074 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cbc86c47-4eba-464f-b09f-7cfdc8244442 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:56.697556 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cbc86c47-4eba-464f-b09f-7cfdc8244442 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:56.698074 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cbc86c47-4eba-464f-b09f-7cfdc8244442 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:56.828245 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-cbc86c47-4eba-464f-b09f-7cfdc8244442 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:10:56.836492 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-cbc86c47-4eba-464f-b09f-7cfdc8244442 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605" status: 200 len: 1375 microversion: 2.1 time: 0.153009 Oct 27 04:10:56.837074 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3652/7016] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:10:56 2022] GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605 => generated 1375 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:10:57.860715 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2ace1be9-7e07-4819-a82a-15debbb04139 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:10:57.861345 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-2ace1be9-7e07-4819-a82a-15debbb04139 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 60f45e37-e987-4aef-85d5-90e612460605] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:10:57.868400 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2ace1be9-7e07-4819-a82a-15debbb04139 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:57.869049 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2ace1be9-7e07-4819-a82a-15debbb04139 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:57.869359 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2ace1be9-7e07-4819-a82a-15debbb04139 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:57.870086 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2ace1be9-7e07-4819-a82a-15debbb04139 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:57.870600 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2ace1be9-7e07-4819-a82a-15debbb04139 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:57.870986 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2ace1be9-7e07-4819-a82a-15debbb04139 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:58.002342 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2ace1be9-7e07-4819-a82a-15debbb04139 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:10:58.010173 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2ace1be9-7e07-4819-a82a-15debbb04139 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605" status: 200 len: 1375 microversion: 2.1 time: 0.153885 Oct 27 04:10:58.013768 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3365/7017] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:10:57 2022] GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605 => generated 1375 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:10:59.034067 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-96029ea3-93b1-4949-9fef-fd44f3d01700 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:10:59.035020 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-96029ea3-93b1-4949-9fef-fd44f3d01700 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 60f45e37-e987-4aef-85d5-90e612460605] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:10:59.043449 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-96029ea3-93b1-4949-9fef-fd44f3d01700 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:59.044052 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-96029ea3-93b1-4949-9fef-fd44f3d01700 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:59.044599 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-96029ea3-93b1-4949-9fef-fd44f3d01700 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:59.045410 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-96029ea3-93b1-4949-9fef-fd44f3d01700 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:10:59.046111 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-96029ea3-93b1-4949-9fef-fd44f3d01700 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:10:59.046689 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-96029ea3-93b1-4949-9fef-fd44f3d01700 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:10:59.180051 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-96029ea3-93b1-4949-9fef-fd44f3d01700 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:10:59.189140 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-96029ea3-93b1-4949-9fef-fd44f3d01700 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605" status: 200 len: 1375 microversion: 2.1 time: 0.159560 Oct 27 04:10:59.189722 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3653/7018] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:10:59 2022] GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605 => generated 1375 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:11:00.212724 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2970afed-1b50-49d8-8fab-510f54a4f132 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:11:00.213341 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-2970afed-1b50-49d8-8fab-510f54a4f132 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 60f45e37-e987-4aef-85d5-90e612460605] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:11:00.221012 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2970afed-1b50-49d8-8fab-510f54a4f132 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:11:00.221502 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2970afed-1b50-49d8-8fab-510f54a4f132 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:11:00.221939 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2970afed-1b50-49d8-8fab-510f54a4f132 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:11:00.222672 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2970afed-1b50-49d8-8fab-510f54a4f132 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:11:00.223129 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2970afed-1b50-49d8-8fab-510f54a4f132 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:11:00.223555 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2970afed-1b50-49d8-8fab-510f54a4f132 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:11:00.363529 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2970afed-1b50-49d8-8fab-510f54a4f132 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:11:00.368638 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2970afed-1b50-49d8-8fab-510f54a4f132 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605" status: 200 len: 1375 microversion: 2.1 time: 0.159651 Oct 27 04:11:00.369242 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3366/7019] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:11:00 2022] GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605 => generated 1375 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:11:01.391970 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9a1ee952-0dcb-43c2-99f6-5d1b07d2bbf3 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:11:01.392602 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-9a1ee952-0dcb-43c2-99f6-5d1b07d2bbf3 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 60f45e37-e987-4aef-85d5-90e612460605] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:11:01.399491 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9a1ee952-0dcb-43c2-99f6-5d1b07d2bbf3 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:11:01.400027 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9a1ee952-0dcb-43c2-99f6-5d1b07d2bbf3 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:11:01.400491 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9a1ee952-0dcb-43c2-99f6-5d1b07d2bbf3 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:11:01.401211 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9a1ee952-0dcb-43c2-99f6-5d1b07d2bbf3 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:11:01.401690 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9a1ee952-0dcb-43c2-99f6-5d1b07d2bbf3 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:11:01.402212 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9a1ee952-0dcb-43c2-99f6-5d1b07d2bbf3 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:11:01.536862 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9a1ee952-0dcb-43c2-99f6-5d1b07d2bbf3 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:11:01.544642 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9a1ee952-0dcb-43c2-99f6-5d1b07d2bbf3 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605" status: 200 len: 1375 microversion: 2.1 time: 0.156963 Oct 27 04:11:01.549988 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3654/7020] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:11:01 2022] GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605 => generated 1375 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:11:02.568118 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4d309b50-c9c2-49fd-93ad-a51ee83b1bc2 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:11:02.568740 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4d309b50-c9c2-49fd-93ad-a51ee83b1bc2 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 60f45e37-e987-4aef-85d5-90e612460605] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:11:02.575205 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4d309b50-c9c2-49fd-93ad-a51ee83b1bc2 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:11:02.575695 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4d309b50-c9c2-49fd-93ad-a51ee83b1bc2 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:11:02.582926 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4d309b50-c9c2-49fd-93ad-a51ee83b1bc2 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:11:02.582926 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4d309b50-c9c2-49fd-93ad-a51ee83b1bc2 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:11:02.582926 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4d309b50-c9c2-49fd-93ad-a51ee83b1bc2 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:11:02.582926 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4d309b50-c9c2-49fd-93ad-a51ee83b1bc2 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:11:02.710576 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4d309b50-c9c2-49fd-93ad-a51ee83b1bc2 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:11:02.719136 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4d309b50-c9c2-49fd-93ad-a51ee83b1bc2 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605" status: 200 len: 1375 microversion: 2.1 time: 0.155593 Oct 27 04:11:02.720286 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3367/7021] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:11:02 2022] GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605 => generated 1375 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:11:03.745093 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c3c6dac7-6d0c-4009-b4a5-7f80065d2eca tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:11:03.745767 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c3c6dac7-6d0c-4009-b4a5-7f80065d2eca tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 60f45e37-e987-4aef-85d5-90e612460605] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:11:03.757600 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c3c6dac7-6d0c-4009-b4a5-7f80065d2eca tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:11:03.758629 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c3c6dac7-6d0c-4009-b4a5-7f80065d2eca tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:11:03.758990 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c3c6dac7-6d0c-4009-b4a5-7f80065d2eca tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:11:03.759439 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c3c6dac7-6d0c-4009-b4a5-7f80065d2eca tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:11:03.759866 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c3c6dac7-6d0c-4009-b4a5-7f80065d2eca tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:11:03.760307 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c3c6dac7-6d0c-4009-b4a5-7f80065d2eca tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:11:03.761243 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-076bda7a-ff55-4770-8bbf-fd945f24e2f9 req-1ac7199e-83a1-4abb-bceb-a01505813847 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60f45e37-e987-4aef-85d5-90e612460605", "name": "network-vif-plugged", "status": "completed", "tag": "f83fb1af-f1dd-4c1a-a4c1-957d812df300"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:11:03.774126 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-076bda7a-ff55-4770-8bbf-fd945f24e2f9 req-1ac7199e-83a1-4abb-bceb-a01505813847 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:11:03.774650 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-076bda7a-ff55-4770-8bbf-fd945f24e2f9 req-1ac7199e-83a1-4abb-bceb-a01505813847 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:11:03.775092 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-076bda7a-ff55-4770-8bbf-fd945f24e2f9 req-1ac7199e-83a1-4abb-bceb-a01505813847 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:11:03.786633 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-076bda7a-ff55-4770-8bbf-fd945f24e2f9 req-1ac7199e-83a1-4abb-bceb-a01505813847 service nova] Creating event network-vif-plugged:f83fb1af-f1dd-4c1a-a4c1-957d812df300 for instance 60f45e37-e987-4aef-85d5-90e612460605 on n-h2-862769-1 Oct 27 04:11:03.791831 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-076bda7a-ff55-4770-8bbf-fd945f24e2f9 req-1ac7199e-83a1-4abb-bceb-a01505813847 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036072 Oct 27 04:11:03.792425 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3368/7022] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:11:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 04:11:03.900600 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c3c6dac7-6d0c-4009-b4a5-7f80065d2eca tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:11:03.912459 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c3c6dac7-6d0c-4009-b4a5-7f80065d2eca tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605" status: 200 len: 1375 microversion: 2.1 time: 0.172717 Oct 27 04:11:03.913606 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3655/7023] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:11:03 2022] GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605 => generated 1375 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:11:04.940937 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-569b7723-a1bd-48fe-b905-ee0d9427b092 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:11:04.942195 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-569b7723-a1bd-48fe-b905-ee0d9427b092 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 60f45e37-e987-4aef-85d5-90e612460605] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:11:04.948462 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-569b7723-a1bd-48fe-b905-ee0d9427b092 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:11:04.948958 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-569b7723-a1bd-48fe-b905-ee0d9427b092 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:11:04.949393 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-569b7723-a1bd-48fe-b905-ee0d9427b092 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:11:04.950296 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-569b7723-a1bd-48fe-b905-ee0d9427b092 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:11:04.950882 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-569b7723-a1bd-48fe-b905-ee0d9427b092 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:11:04.951267 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-569b7723-a1bd-48fe-b905-ee0d9427b092 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:11:05.091341 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-569b7723-a1bd-48fe-b905-ee0d9427b092 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:11:05.099195 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-569b7723-a1bd-48fe-b905-ee0d9427b092 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605" status: 200 len: 1375 microversion: 2.1 time: 0.164157 Oct 27 04:11:05.099772 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3369/7024] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:11:04 2022] GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605 => generated 1375 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:11:06.122220 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6ed167ff-a1e9-4d3b-a599-f9f33dd7d7fa tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:11:06.122861 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-6ed167ff-a1e9-4d3b-a599-f9f33dd7d7fa tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 60f45e37-e987-4aef-85d5-90e612460605] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:11:06.129773 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6ed167ff-a1e9-4d3b-a599-f9f33dd7d7fa tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:11:06.130321 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6ed167ff-a1e9-4d3b-a599-f9f33dd7d7fa tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:11:06.130772 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6ed167ff-a1e9-4d3b-a599-f9f33dd7d7fa tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:11:06.131496 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6ed167ff-a1e9-4d3b-a599-f9f33dd7d7fa tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:11:06.131971 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6ed167ff-a1e9-4d3b-a599-f9f33dd7d7fa tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:11:06.132418 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6ed167ff-a1e9-4d3b-a599-f9f33dd7d7fa tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:11:06.282778 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6ed167ff-a1e9-4d3b-a599-f9f33dd7d7fa tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:11:06.288608 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6ed167ff-a1e9-4d3b-a599-f9f33dd7d7fa tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605" status: 200 len: 1562 microversion: 2.1 time: 0.170392 Oct 27 04:11:06.289279 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3656/7025] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:11:06 2022] GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605 => generated 1562 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:11:06.315897 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0f5810b5-44b1-4e21-917a-7b99cfbb1455 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:11:06.315897 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0f5810b5-44b1-4e21-917a-7b99cfbb1455 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 60f45e37-e987-4aef-85d5-90e612460605] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:11:06.321054 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0f5810b5-44b1-4e21-917a-7b99cfbb1455 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:11:06.321577 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0f5810b5-44b1-4e21-917a-7b99cfbb1455 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:11:06.322025 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0f5810b5-44b1-4e21-917a-7b99cfbb1455 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:11:06.322765 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0f5810b5-44b1-4e21-917a-7b99cfbb1455 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:11:06.323231 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0f5810b5-44b1-4e21-917a-7b99cfbb1455 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:11:06.323667 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0f5810b5-44b1-4e21-917a-7b99cfbb1455 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:11:06.457041 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0f5810b5-44b1-4e21-917a-7b99cfbb1455 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:11:06.465514 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0f5810b5-44b1-4e21-917a-7b99cfbb1455 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605" status: 200 len: 1562 microversion: 2.1 time: 0.155985 Oct 27 04:11:06.466430 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3370/7026] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:11:06 2022] GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605 => generated 1562 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:11:06.548238 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2a663fa3-7b2b-4552-9909-7bb0243c9524 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:11:06.548755 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2a663fa3-7b2b-4552-9909-7bb0243c9524 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 60f45e37-e987-4aef-85d5-90e612460605] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:11:06.554858 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2a663fa3-7b2b-4552-9909-7bb0243c9524 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:11:06.555358 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2a663fa3-7b2b-4552-9909-7bb0243c9524 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:11:06.555910 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2a663fa3-7b2b-4552-9909-7bb0243c9524 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:11:06.556689 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2a663fa3-7b2b-4552-9909-7bb0243c9524 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:11:06.557279 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2a663fa3-7b2b-4552-9909-7bb0243c9524 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:11:06.557736 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2a663fa3-7b2b-4552-9909-7bb0243c9524 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:11:06.584818 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2a663fa3-7b2b-4552-9909-7bb0243c9524 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 60f45e37-e987-4aef-85d5-90e612460605] Going to try to terminate instance {{(pid=121001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 04:11:06.816215 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2a663fa3-7b2b-4552-9909-7bb0243c9524 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "DELETE /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605" status: 204 len: 0 microversion: 2.1 time: 0.271624 Oct 27 04:11:06.816829 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3657/7027] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 04:11:06 2022] DELETE /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 04:11:06.825537 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-27648291-8b5f-4c72-b8f9-4724f35aedee tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:11:06.826341 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-27648291-8b5f-4c72-b8f9-4724f35aedee tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 60f45e37-e987-4aef-85d5-90e612460605] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:11:06.832872 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-27648291-8b5f-4c72-b8f9-4724f35aedee tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:11:06.833357 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-27648291-8b5f-4c72-b8f9-4724f35aedee tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:11:06.833801 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-27648291-8b5f-4c72-b8f9-4724f35aedee tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:11:06.834545 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-27648291-8b5f-4c72-b8f9-4724f35aedee tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:11:06.835053 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-27648291-8b5f-4c72-b8f9-4724f35aedee tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:11:06.835429 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-27648291-8b5f-4c72-b8f9-4724f35aedee tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:11:06.974997 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-27648291-8b5f-4c72-b8f9-4724f35aedee tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:11:06.983153 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-27648291-8b5f-4c72-b8f9-4724f35aedee tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605" status: 200 len: 1568 microversion: 2.1 time: 0.162035 Oct 27 04:11:06.983780 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3371/7028] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:11:06 2022] GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:11:08.008522 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6763f571-25fa-4fc7-814e-02441bf4fd8b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:11:08.009245 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-6763f571-25fa-4fc7-814e-02441bf4fd8b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 60f45e37-e987-4aef-85d5-90e612460605] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:11:08.016917 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6763f571-25fa-4fc7-814e-02441bf4fd8b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:11:08.017427 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6763f571-25fa-4fc7-814e-02441bf4fd8b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:11:08.017888 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6763f571-25fa-4fc7-814e-02441bf4fd8b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:11:08.018713 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6763f571-25fa-4fc7-814e-02441bf4fd8b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:11:08.019251 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6763f571-25fa-4fc7-814e-02441bf4fd8b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:11:08.019699 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6763f571-25fa-4fc7-814e-02441bf4fd8b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:11:08.154602 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6763f571-25fa-4fc7-814e-02441bf4fd8b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:11:08.162737 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6763f571-25fa-4fc7-814e-02441bf4fd8b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605" status: 200 len: 1568 microversion: 2.1 time: 0.158663 Oct 27 04:11:08.164582 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3658/7029] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:11:08 2022] GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:11:08.988362 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-065b762c-015e-4d2d-9d9d-626ff5028f91 req-e101c775-e75f-4925-9f33-c8feccf5a65b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60f45e37-e987-4aef-85d5-90e612460605", "name": "network-vif-deleted", "tag": "f83fb1af-f1dd-4c1a-a4c1-957d812df300"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:11:09.012138 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-065b762c-015e-4d2d-9d9d-626ff5028f91 req-e101c775-e75f-4925-9f33-c8feccf5a65b service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:11:09.020697 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-065b762c-015e-4d2d-9d9d-626ff5028f91 req-e101c775-e75f-4925-9f33-c8feccf5a65b service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:11:09.021435 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-065b762c-015e-4d2d-9d9d-626ff5028f91 req-e101c775-e75f-4925-9f33-c8feccf5a65b service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:11:09.036256 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-065b762c-015e-4d2d-9d9d-626ff5028f91 req-e101c775-e75f-4925-9f33-c8feccf5a65b service nova] Creating event network-vif-deleted:f83fb1af-f1dd-4c1a-a4c1-957d812df300 for instance 60f45e37-e987-4aef-85d5-90e612460605 on n-h2-862769-1 Oct 27 04:11:09.042160 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-065b762c-015e-4d2d-9d9d-626ff5028f91 req-e101c775-e75f-4925-9f33-c8feccf5a65b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.189444 Oct 27 04:11:09.042836 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3372/7030] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:11:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:11:09.188660 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-be81e6a7-6c94-442a-b3ee-84db3447f70d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:11:09.189353 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-be81e6a7-6c94-442a-b3ee-84db3447f70d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 60f45e37-e987-4aef-85d5-90e612460605] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:11:09.196889 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-be81e6a7-6c94-442a-b3ee-84db3447f70d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:11:09.197477 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-be81e6a7-6c94-442a-b3ee-84db3447f70d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:11:09.198026 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-be81e6a7-6c94-442a-b3ee-84db3447f70d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:11:09.199112 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-be81e6a7-6c94-442a-b3ee-84db3447f70d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:11:09.199653 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-be81e6a7-6c94-442a-b3ee-84db3447f70d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:11:09.200167 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-be81e6a7-6c94-442a-b3ee-84db3447f70d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:11:09.268551 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-be81e6a7-6c94-442a-b3ee-84db3447f70d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:11:09.277700 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-be81e6a7-6c94-442a-b3ee-84db3447f70d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605" status: 200 len: 1360 microversion: 2.1 time: 0.095373 Oct 27 04:11:09.278388 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3659/7031] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:11:09 2022] GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605 => generated 1360 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:11:10.301917 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-06e27d05-4e98-48cb-a0d0-19d8e2dc5ae4 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:11:10.302763 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-06e27d05-4e98-48cb-a0d0-19d8e2dc5ae4 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 60f45e37-e987-4aef-85d5-90e612460605] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:11:10.310356 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-06e27d05-4e98-48cb-a0d0-19d8e2dc5ae4 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:11:10.310976 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-06e27d05-4e98-48cb-a0d0-19d8e2dc5ae4 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:11:10.311459 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-06e27d05-4e98-48cb-a0d0-19d8e2dc5ae4 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:11:10.312245 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-06e27d05-4e98-48cb-a0d0-19d8e2dc5ae4 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:11:10.312781 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-06e27d05-4e98-48cb-a0d0-19d8e2dc5ae4 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:11:10.313361 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-06e27d05-4e98-48cb-a0d0-19d8e2dc5ae4 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:11:10.382780 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-06e27d05-4e98-48cb-a0d0-19d8e2dc5ae4 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:11:10.391225 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-06e27d05-4e98-48cb-a0d0-19d8e2dc5ae4 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605" status: 200 len: 1360 microversion: 2.1 time: 0.094161 Oct 27 04:11:10.391897 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3373/7032] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:11:10 2022] GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605 => generated 1360 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 04:11:11.414580 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-bcc68197-817e-491f-a1f4-46560c13c8fd tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:11:11.415397 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-bcc68197-817e-491f-a1f4-46560c13c8fd tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 60f45e37-e987-4aef-85d5-90e612460605] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:11:11.423169 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bcc68197-817e-491f-a1f4-46560c13c8fd tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:11:11.423750 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bcc68197-817e-491f-a1f4-46560c13c8fd tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:11:11.424288 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bcc68197-817e-491f-a1f4-46560c13c8fd tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:11:11.425125 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bcc68197-817e-491f-a1f4-46560c13c8fd tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:11:11.425624 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bcc68197-817e-491f-a1f4-46560c13c8fd tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:11:11.426196 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bcc68197-817e-491f-a1f4-46560c13c8fd tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:11:11.494846 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-bcc68197-817e-491f-a1f4-46560c13c8fd tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:11:11.503553 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-bcc68197-817e-491f-a1f4-46560c13c8fd tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605" status: 200 len: 1360 microversion: 2.1 time: 0.093266 Oct 27 04:11:11.504128 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3660/7033] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:11:11 2022] GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605 => generated 1360 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:11:12.530564 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1e9a0067-d35a-43c5-8377-dd11f6be86de tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:11:12.531420 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1e9a0067-d35a-43c5-8377-dd11f6be86de tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 60f45e37-e987-4aef-85d5-90e612460605] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:11:12.541395 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1e9a0067-d35a-43c5-8377-dd11f6be86de tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:11:12.542178 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1e9a0067-d35a-43c5-8377-dd11f6be86de tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:11:12.543024 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1e9a0067-d35a-43c5-8377-dd11f6be86de tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:11:12.544025 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1e9a0067-d35a-43c5-8377-dd11f6be86de tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:11:12.544864 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1e9a0067-d35a-43c5-8377-dd11f6be86de tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:11:12.545932 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1e9a0067-d35a-43c5-8377-dd11f6be86de tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:11:12.642163 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1e9a0067-d35a-43c5-8377-dd11f6be86de tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:11:12.656663 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1e9a0067-d35a-43c5-8377-dd11f6be86de tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605" status: 200 len: 1360 microversion: 2.1 time: 0.132013 Oct 27 04:11:12.658883 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3374/7034] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:11:12 2022] GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605 => generated 1360 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:11:13.684141 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7b50f18c-623e-473b-9973-d0d9b99dc6ad tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:11:13.684784 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7b50f18c-623e-473b-9973-d0d9b99dc6ad tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 60f45e37-e987-4aef-85d5-90e612460605] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:11:13.691762 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7b50f18c-623e-473b-9973-d0d9b99dc6ad tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:11:13.692275 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7b50f18c-623e-473b-9973-d0d9b99dc6ad tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:11:13.692735 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7b50f18c-623e-473b-9973-d0d9b99dc6ad tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:11:13.693458 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7b50f18c-623e-473b-9973-d0d9b99dc6ad tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:11:13.693931 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7b50f18c-623e-473b-9973-d0d9b99dc6ad tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:11:13.694408 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7b50f18c-623e-473b-9973-d0d9b99dc6ad tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:11:13.773333 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7b50f18c-623e-473b-9973-d0d9b99dc6ad tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:11:13.783100 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7b50f18c-623e-473b-9973-d0d9b99dc6ad tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605" status: 200 len: 1360 microversion: 2.1 time: 0.101890 Oct 27 04:11:13.783711 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3661/7035] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:11:13 2022] GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605 => generated 1360 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:11:14.808214 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-405e83a4-b00b-48cf-b1fe-e9a8c1e0db7d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:11:14.809779 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-405e83a4-b00b-48cf-b1fe-e9a8c1e0db7d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 60f45e37-e987-4aef-85d5-90e612460605] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:11:14.816249 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=32 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:11:14.818866 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-405e83a4-b00b-48cf-b1fe-e9a8c1e0db7d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:11:14.819539 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-405e83a4-b00b-48cf-b1fe-e9a8c1e0db7d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:11:14.819845 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-405e83a4-b00b-48cf-b1fe-e9a8c1e0db7d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:11:14.820918 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-405e83a4-b00b-48cf-b1fe-e9a8c1e0db7d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:11:14.821081 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-405e83a4-b00b-48cf-b1fe-e9a8c1e0db7d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:11:14.821509 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-405e83a4-b00b-48cf-b1fe-e9a8c1e0db7d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:11:14.826175 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=88 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:11:14.856177 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-405e83a4-b00b-48cf-b1fe-e9a8c1e0db7d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:11:14.856930 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-405e83a4-b00b-48cf-b1fe-e9a8c1e0db7d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:11:14.857642 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-405e83a4-b00b-48cf-b1fe-e9a8c1e0db7d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:11:14.858313 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-405e83a4-b00b-48cf-b1fe-e9a8c1e0db7d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lazy-loading 'fault' on Instance uuid 60f45e37-e987-4aef-85d5-90e612460605 {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 04:11:14.905029 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-405e83a4-b00b-48cf-b1fe-e9a8c1e0db7d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:11:14.916160 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-405e83a4-b00b-48cf-b1fe-e9a8c1e0db7d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605" status: 200 len: 1365 microversion: 2.1 time: 0.113131 Oct 27 04:11:14.916968 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3375/7036] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:11:14 2022] GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605 => generated 1365 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:11:15.941006 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-33f74ff8-ea7d-4480-a6bf-068e80482e58 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:11:16.107083 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-33f74ff8-ea7d-4480-a6bf-068e80482e58 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 60f45e37-e987-4aef-85d5-90e612460605] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:11:16.107083 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:11:16.107083 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-33f74ff8-ea7d-4480-a6bf-068e80482e58 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:11:16.107083 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-33f74ff8-ea7d-4480-a6bf-068e80482e58 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:11:16.107083 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-33f74ff8-ea7d-4480-a6bf-068e80482e58 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:11:16.107083 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-33f74ff8-ea7d-4480-a6bf-068e80482e58 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:11:16.107083 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-33f74ff8-ea7d-4480-a6bf-068e80482e58 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:11:16.107083 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-33f74ff8-ea7d-4480-a6bf-068e80482e58 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:11:16.107083 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-33f74ff8-ea7d-4480-a6bf-068e80482e58 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] HTTP exception thrown: Instance 60f45e37-e987-4aef-85d5-90e612460605 could not be found. Oct 27 04:11:16.107083 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-33f74ff8-ea7d-4480-a6bf-068e80482e58 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Request method failure captured: Oct 27 04:11:16.107083 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605 HTTP/1.1 Oct 27 04:11:16.107083 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 04:11:16.107083 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 04:11:16.107083 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 04:11:16.107083 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 04:11:16.107083 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 04:11:16.107083 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 04:11:16.107083 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 04:11:16.107083 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 04:11:16.107083 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWgOy2vyGIZvCPgeKqR-dxD7jsV8GSZftvWG3pi0psQTYPv81ATvFSgHi31EMgn0x5NItteNYikimeQ9zcCw_dYQg7rFsVn9VSH-YqZAmUJa-ncyxVumv4r6CMnFhSrRbs_K6XB3pjXRcA1nWSk0V8vccKKBeZUitsa2lCn2gYQAw5hI Oct 27 04:11:16.107083 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 04:11:16.107083 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 04:11:16.107083 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 04:11:16.107083 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 04:11:16.107083 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 04:11:16.107083 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 04:11:16.107083 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 6a6a4f0161c94dc19682d70af00ba684 Oct 27 04:11:16.107083 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-TestVolumeBootPattern-1489988074 Oct 27 04:11:16.107083 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 04:11:16.107083 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 04:11:16.109325 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6a6a4f0161c94dc19682d70af00ba684"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6a6a4f0161c94dc19682d70af00ba684"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6a6a4f0161c94dc19682d70af00ba684"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6a6a4f0161c94dc19682d70af00ba684"}]}] Oct 27 04:11:16.109325 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-TestVolumeBootPattern-1489988074 Oct 27 04:11:16.109325 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 6a6a4f0161c94dc19682d70af00ba684 Oct 27 04:11:16.109325 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-TestVolumeBootPattern-1489988074 Oct 27 04:11:16.109325 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-TestVolumeBootPattern-1489988074-project Oct 27 04:11:16.109325 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 04:11:16.109325 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 04:11:16.109325 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: b7f5c179e8844542bca46d76042a6897 Oct 27 04:11:16.109325 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-TestVolumeBootPattern-1489988074-project Oct 27 04:11:16.109325 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 04:11:16.109325 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 60f45e37-e987-4aef-85d5-90e612460605 could not be found. Oct 27 04:11:16.109325 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '60f45e37-e987-4aef-85d5-90e612460605'} Oct 27 04:11:16.109325 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 04:11:16.109325 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:11:16.109325 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 04:11:16.109325 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 04:11:16.109325 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 04:11:16.109325 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 04:11:16.109325 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 04:11:16.109325 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 04:11:16.109325 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 04:11:16.109325 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 04:11:16.109325 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60f45e37-e987-4aef-85d5-90e612460605 could not be found. Oct 27 04:11:16.109325 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:11:16.109325 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:11:16.109325 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:11:16.109325 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:11:16.109325 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:11:16.109325 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:11:16.109325 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 04:11:16.109325 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 04:11:16.109325 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 04:11:16.109325 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 04:11:16.109325 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 04:11:16.109325 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 04:11:16.109325 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 04:11:16.109325 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 04:11:16.109325 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 04:11:16.109325 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 04:11:16.109325 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60f45e37-e987-4aef-85d5-90e612460605 could not be found. Oct 27 04:11:16.109325 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:11:16.109325 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:11:16.109325 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:11:16.109325 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:11:16.109325 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:11:16.109325 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:11:16.109325 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 04:11:16.109325 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 04:11:16.109325 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60f45e37-e987-4aef-85d5-90e612460605 could not be found. Oct 27 04:11:16.109325 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:11:16.109325 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-33f74ff8-ea7d-4480-a6bf-068e80482e58 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Returning 404 to user: Instance 60f45e37-e987-4aef-85d5-90e612460605 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 04:11:16.114204 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-33f74ff8-ea7d-4480-a6bf-068e80482e58 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605" status: 404 len: 111 microversion: 2.1 time: 0.032741 Oct 27 04:11:16.114204 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3662/7037] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:11:15 2022] GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 04:11:20.733384 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-890677b9-3dea-47cc-b9e9-ddc4b59bfda9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:11:20.733384 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-890677b9-3dea-47cc-b9e9-ddc4b59bfda9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 1d1883a3-05ef-4d2b-b98f-70a18deb6602] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:11:20.741132 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-890677b9-3dea-47cc-b9e9-ddc4b59bfda9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:11:20.741629 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-890677b9-3dea-47cc-b9e9-ddc4b59bfda9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:11:20.742097 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-890677b9-3dea-47cc-b9e9-ddc4b59bfda9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:11:20.742998 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-890677b9-3dea-47cc-b9e9-ddc4b59bfda9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:11:20.743618 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-890677b9-3dea-47cc-b9e9-ddc4b59bfda9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:11:20.744196 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-890677b9-3dea-47cc-b9e9-ddc4b59bfda9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:11:20.775467 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-890677b9-3dea-47cc-b9e9-ddc4b59bfda9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 1d1883a3-05ef-4d2b-b98f-70a18deb6602] Going to try to terminate instance {{(pid=121000) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 04:11:21.113253 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-890677b9-3dea-47cc-b9e9-ddc4b59bfda9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1d1883a3-05ef-4d2b-b98f-70a18deb6602" status: 204 len: 0 microversion: 2.1 time: 0.387888 Oct 27 04:11:21.114361 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3376/7038] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 04:11:20 2022] DELETE /compute/v2.1/servers/1d1883a3-05ef-4d2b-b98f-70a18deb6602 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 04:11:21.123597 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f9ac5a53-3275-412c-9be5-2de11b99b6c9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:11:21.124386 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f9ac5a53-3275-412c-9be5-2de11b99b6c9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 1d1883a3-05ef-4d2b-b98f-70a18deb6602] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:11:21.132063 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f9ac5a53-3275-412c-9be5-2de11b99b6c9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:11:21.132927 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f9ac5a53-3275-412c-9be5-2de11b99b6c9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:11:21.133494 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f9ac5a53-3275-412c-9be5-2de11b99b6c9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:11:21.134317 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f9ac5a53-3275-412c-9be5-2de11b99b6c9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:11:21.135006 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f9ac5a53-3275-412c-9be5-2de11b99b6c9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:11:21.135639 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f9ac5a53-3275-412c-9be5-2de11b99b6c9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:11:21.140242 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:11:21.343517 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f9ac5a53-3275-412c-9be5-2de11b99b6c9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:11:21.353397 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f9ac5a53-3275-412c-9be5-2de11b99b6c9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/1d1883a3-05ef-4d2b-b98f-70a18deb6602" status: 200 len: 1411 microversion: 2.1 time: 0.234544 Oct 27 04:11:21.354058 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3663/7039] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:11:21 2022] GET /compute/v2.1/servers/1d1883a3-05ef-4d2b-b98f-70a18deb6602 => generated 1411 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 04:11:22.378068 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-29e46c0c-e675-4e02-8caf-e35bb5ee071f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:11:22.379389 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-29e46c0c-e675-4e02-8caf-e35bb5ee071f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 1d1883a3-05ef-4d2b-b98f-70a18deb6602] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:11:22.386513 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-29e46c0c-e675-4e02-8caf-e35bb5ee071f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:11:22.387156 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-29e46c0c-e675-4e02-8caf-e35bb5ee071f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:11:22.387711 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-29e46c0c-e675-4e02-8caf-e35bb5ee071f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:11:22.388694 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-29e46c0c-e675-4e02-8caf-e35bb5ee071f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:11:22.389449 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-29e46c0c-e675-4e02-8caf-e35bb5ee071f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:11:22.389965 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-29e46c0c-e675-4e02-8caf-e35bb5ee071f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:11:22.544814 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-29e46c0c-e675-4e02-8caf-e35bb5ee071f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:11:22.554128 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-29e46c0c-e675-4e02-8caf-e35bb5ee071f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/1d1883a3-05ef-4d2b-b98f-70a18deb6602" status: 200 len: 1411 microversion: 2.1 time: 0.180813 Oct 27 04:11:22.555288 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3377/7040] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:11:22 2022] GET /compute/v2.1/servers/1d1883a3-05ef-4d2b-b98f-70a18deb6602 => generated 1411 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:11:23.480746 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-acfff4a0-67d5-4b4a-a17b-8dd8f6a35e14 req-04ba5d6e-90f5-41fd-b50b-6a5d4025daa2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d1883a3-05ef-4d2b-b98f-70a18deb6602", "name": "network-vif-deleted", "tag": "95a4180c-d68e-4017-9ae0-93a6903fd643"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:11:23.492461 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-acfff4a0-67d5-4b4a-a17b-8dd8f6a35e14 req-04ba5d6e-90f5-41fd-b50b-6a5d4025daa2 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:11:23.492972 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-acfff4a0-67d5-4b4a-a17b-8dd8f6a35e14 req-04ba5d6e-90f5-41fd-b50b-6a5d4025daa2 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:11:23.493428 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-acfff4a0-67d5-4b4a-a17b-8dd8f6a35e14 req-04ba5d6e-90f5-41fd-b50b-6a5d4025daa2 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:11:23.505059 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-acfff4a0-67d5-4b4a-a17b-8dd8f6a35e14 req-04ba5d6e-90f5-41fd-b50b-6a5d4025daa2 service nova] Creating event network-vif-deleted:95a4180c-d68e-4017-9ae0-93a6903fd643 for instance 1d1883a3-05ef-4d2b-b98f-70a18deb6602 on n-h1-862769-1 Oct 27 04:11:23.510368 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-acfff4a0-67d5-4b4a-a17b-8dd8f6a35e14 req-04ba5d6e-90f5-41fd-b50b-6a5d4025daa2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033754 Oct 27 04:11:23.511275 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3664/7041] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:11:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:11:23.579719 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e2bf525d-f4b4-44b7-9922-fb0e83ce9235 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:11:23.580832 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e2bf525d-f4b4-44b7-9922-fb0e83ce9235 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 1d1883a3-05ef-4d2b-b98f-70a18deb6602] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:11:23.588111 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e2bf525d-f4b4-44b7-9922-fb0e83ce9235 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:11:23.588840 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e2bf525d-f4b4-44b7-9922-fb0e83ce9235 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:11:23.589324 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e2bf525d-f4b4-44b7-9922-fb0e83ce9235 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:11:23.590133 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e2bf525d-f4b4-44b7-9922-fb0e83ce9235 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:11:23.590614 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e2bf525d-f4b4-44b7-9922-fb0e83ce9235 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:11:23.591252 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e2bf525d-f4b4-44b7-9922-fb0e83ce9235 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:11:23.657768 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e2bf525d-f4b4-44b7-9922-fb0e83ce9235 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:11:23.665857 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e2bf525d-f4b4-44b7-9922-fb0e83ce9235 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/1d1883a3-05ef-4d2b-b98f-70a18deb6602" status: 200 len: 1369 microversion: 2.1 time: 0.090998 Oct 27 04:11:23.666472 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3378/7042] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:11:23 2022] GET /compute/v2.1/servers/1d1883a3-05ef-4d2b-b98f-70a18deb6602 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:11:24.694118 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c2b9f670-66db-4d8e-8e83-37f4bbd13120 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:11:24.695446 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c2b9f670-66db-4d8e-8e83-37f4bbd13120 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 1d1883a3-05ef-4d2b-b98f-70a18deb6602] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:11:24.705439 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c2b9f670-66db-4d8e-8e83-37f4bbd13120 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:11:24.706204 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c2b9f670-66db-4d8e-8e83-37f4bbd13120 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:11:24.706719 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c2b9f670-66db-4d8e-8e83-37f4bbd13120 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:11:24.708756 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c2b9f670-66db-4d8e-8e83-37f4bbd13120 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:11:24.708756 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c2b9f670-66db-4d8e-8e83-37f4bbd13120 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:11:24.708756 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c2b9f670-66db-4d8e-8e83-37f4bbd13120 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:11:24.784216 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c2b9f670-66db-4d8e-8e83-37f4bbd13120 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:11:24.793662 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c2b9f670-66db-4d8e-8e83-37f4bbd13120 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/1d1883a3-05ef-4d2b-b98f-70a18deb6602" status: 200 len: 1202 microversion: 2.1 time: 0.107401 Oct 27 04:11:24.794491 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3665/7043] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:11:24 2022] GET /compute/v2.1/servers/1d1883a3-05ef-4d2b-b98f-70a18deb6602 => generated 1202 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:11:25.816731 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-77cd5b3c-58fc-4d8d-912c-10d00e72dba1 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:11:25.817259 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-77cd5b3c-58fc-4d8d-912c-10d00e72dba1 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 1d1883a3-05ef-4d2b-b98f-70a18deb6602] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:11:25.824232 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-77cd5b3c-58fc-4d8d-912c-10d00e72dba1 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:11:25.824727 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-77cd5b3c-58fc-4d8d-912c-10d00e72dba1 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:11:25.825167 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-77cd5b3c-58fc-4d8d-912c-10d00e72dba1 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:11:25.829068 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-77cd5b3c-58fc-4d8d-912c-10d00e72dba1 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:11:25.829853 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-77cd5b3c-58fc-4d8d-912c-10d00e72dba1 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:11:25.830322 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-77cd5b3c-58fc-4d8d-912c-10d00e72dba1 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:11:25.939680 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-77cd5b3c-58fc-4d8d-912c-10d00e72dba1 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:11:25.952979 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-77cd5b3c-58fc-4d8d-912c-10d00e72dba1 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/1d1883a3-05ef-4d2b-b98f-70a18deb6602" status: 200 len: 1202 microversion: 2.1 time: 0.140357 Oct 27 04:11:25.957023 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3379/7044] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:11:25 2022] GET /compute/v2.1/servers/1d1883a3-05ef-4d2b-b98f-70a18deb6602 => generated 1202 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:11:26.982023 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-553e1c7a-582f-44b4-aae2-3c1a421554ed tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:11:26.986262 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-553e1c7a-582f-44b4-aae2-3c1a421554ed tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 1d1883a3-05ef-4d2b-b98f-70a18deb6602] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:11:26.998372 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-553e1c7a-582f-44b4-aae2-3c1a421554ed tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:11:26.999277 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-553e1c7a-582f-44b4-aae2-3c1a421554ed tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:11:27.001503 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-553e1c7a-582f-44b4-aae2-3c1a421554ed tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:11:27.005998 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-553e1c7a-582f-44b4-aae2-3c1a421554ed tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:11:27.006975 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-553e1c7a-582f-44b4-aae2-3c1a421554ed tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:11:27.007634 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-553e1c7a-582f-44b4-aae2-3c1a421554ed tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:11:27.129728 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-553e1c7a-582f-44b4-aae2-3c1a421554ed tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:11:27.143011 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-553e1c7a-582f-44b4-aae2-3c1a421554ed tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/1d1883a3-05ef-4d2b-b98f-70a18deb6602" status: 200 len: 1202 microversion: 2.1 time: 0.165268 Oct 27 04:11:27.143719 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3666/7045] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:11:26 2022] GET /compute/v2.1/servers/1d1883a3-05ef-4d2b-b98f-70a18deb6602 => generated 1202 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:11:28.168716 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7b418227-043a-4b55-a4f4-964090ccedaa tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:11:28.170263 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7b418227-043a-4b55-a4f4-964090ccedaa tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 1d1883a3-05ef-4d2b-b98f-70a18deb6602] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:11:28.188736 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7b418227-043a-4b55-a4f4-964090ccedaa tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:11:28.193718 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7b418227-043a-4b55-a4f4-964090ccedaa tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:11:28.194495 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7b418227-043a-4b55-a4f4-964090ccedaa tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:11:28.195412 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7b418227-043a-4b55-a4f4-964090ccedaa tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:11:28.199298 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7b418227-043a-4b55-a4f4-964090ccedaa tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:11:28.200347 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7b418227-043a-4b55-a4f4-964090ccedaa tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:11:28.317750 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7b418227-043a-4b55-a4f4-964090ccedaa tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:11:28.328042 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7b418227-043a-4b55-a4f4-964090ccedaa tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/1d1883a3-05ef-4d2b-b98f-70a18deb6602" status: 200 len: 1202 microversion: 2.1 time: 0.162654 Oct 27 04:11:28.355260 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3380/7046] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:11:28 2022] GET /compute/v2.1/servers/1d1883a3-05ef-4d2b-b98f-70a18deb6602 => generated 1202 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:11:29.372096 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-57075814-2a54-444e-8025-ab24855b1ba0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:11:29.373988 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-57075814-2a54-444e-8025-ab24855b1ba0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 1d1883a3-05ef-4d2b-b98f-70a18deb6602] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:11:29.384135 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-57075814-2a54-444e-8025-ab24855b1ba0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:11:29.384910 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-57075814-2a54-444e-8025-ab24855b1ba0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:11:29.385602 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-57075814-2a54-444e-8025-ab24855b1ba0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:11:29.386584 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-57075814-2a54-444e-8025-ab24855b1ba0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:11:29.387223 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-57075814-2a54-444e-8025-ab24855b1ba0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:11:29.387923 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-57075814-2a54-444e-8025-ab24855b1ba0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:11:29.455123 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-57075814-2a54-444e-8025-ab24855b1ba0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:11:29.456145 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-57075814-2a54-444e-8025-ab24855b1ba0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:11:29.456968 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-57075814-2a54-444e-8025-ab24855b1ba0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:11:29.457650 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-57075814-2a54-444e-8025-ab24855b1ba0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lazy-loading 'fault' on Instance uuid 1d1883a3-05ef-4d2b-b98f-70a18deb6602 {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 04:11:29.544043 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-57075814-2a54-444e-8025-ab24855b1ba0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:11:29.559224 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-57075814-2a54-444e-8025-ab24855b1ba0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/1d1883a3-05ef-4d2b-b98f-70a18deb6602" status: 200 len: 1207 microversion: 2.1 time: 0.193609 Oct 27 04:11:29.590098 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3667/7047] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:11:29 2022] GET /compute/v2.1/servers/1d1883a3-05ef-4d2b-b98f-70a18deb6602 => generated 1207 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:11:30.032896 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-bcfa42df-1aa5-4097-af23-3980a47b3f5b tempest-TestAggregatesBasicOps-841745960 tempest-TestAggregatesBasicOps-841745960-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-1182132788", "availability_zone": "foo_zone"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:11:30.053713 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.aggregate [None req-bcfa42df-1aa5-4097-af23-3980a47b3f5b tempest-TestAggregatesBasicOps-841745960 tempest-TestAggregatesBasicOps-841745960-project-admin] Generated uuid d0deae05-76cc-4ec7-87e3-f4533249749a for aggregate {{(pid=121000) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 27 04:11:30.056002 n-d-862769-1 devstack@n-api.service[121000]: ERROR oslo.messaging._drivers.impl_rabbit [None req-bcfa42df-1aa5-4097-af23-3980a47b3f5b tempest-TestAggregatesBasicOps-841745960 tempest-TestAggregatesBasicOps-841745960-project-admin] [bc5cc820-22d4-4c61-b33e-040cb7304259] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 27 04:11:30.588718 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ca4735b2-ed35-4fc1-9247-4dd275030846 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:11:30.589415 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ca4735b2-ed35-4fc1-9247-4dd275030846 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 1d1883a3-05ef-4d2b-b98f-70a18deb6602] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:11:30.597374 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ca4735b2-ed35-4fc1-9247-4dd275030846 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:11:30.597973 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ca4735b2-ed35-4fc1-9247-4dd275030846 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:11:30.598493 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ca4735b2-ed35-4fc1-9247-4dd275030846 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:11:30.599265 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ca4735b2-ed35-4fc1-9247-4dd275030846 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:11:30.599746 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ca4735b2-ed35-4fc1-9247-4dd275030846 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:11:30.600229 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ca4735b2-ed35-4fc1-9247-4dd275030846 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:11:30.615532 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-ca4735b2-ed35-4fc1-9247-4dd275030846 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] HTTP exception thrown: Instance 1d1883a3-05ef-4d2b-b98f-70a18deb6602 could not be found. Oct 27 04:11:30.618931 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ca4735b2-ed35-4fc1-9247-4dd275030846 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Request method failure captured: Oct 27 04:11:30.618931 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/1d1883a3-05ef-4d2b-b98f-70a18deb6602 HTTP/1.1 Oct 27 04:11:30.618931 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 04:11:30.618931 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 04:11:30.618931 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 04:11:30.618931 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 04:11:30.618931 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 04:11:30.618931 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 04:11:30.618931 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 04:11:30.618931 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 04:11:30.618931 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWgOy2vyGIZvCPgeKqR-dxD7jsV8GSZftvWG3pi0psQTYPv81ATvFSgHi31EMgn0x5NItteNYikimeQ9zcCw_dYQg7rFsVn9VSH-YqZAmUJa-ncyxVumv4r6CMnFhSrRbs_K6XB3pjXRcA1nWSk0V8vccKKBeZUitsa2lCn2gYQAw5hI Oct 27 04:11:30.618931 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 04:11:30.618931 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 04:11:30.618931 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 04:11:30.618931 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 04:11:30.618931 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 04:11:30.618931 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 04:11:30.618931 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 6a6a4f0161c94dc19682d70af00ba684 Oct 27 04:11:30.618931 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-TestVolumeBootPattern-1489988074 Oct 27 04:11:30.618931 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 04:11:30.618931 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 04:11:30.618931 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6a6a4f0161c94dc19682d70af00ba684"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6a6a4f0161c94dc19682d70af00ba684"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6a6a4f0161c94dc19682d70af00ba684"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6a6a4f0161c94dc19682d70af00ba684"}]}] Oct 27 04:11:30.618931 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-TestVolumeBootPattern-1489988074 Oct 27 04:11:30.618931 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 6a6a4f0161c94dc19682d70af00ba684 Oct 27 04:11:30.618931 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-TestVolumeBootPattern-1489988074 Oct 27 04:11:30.618931 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-TestVolumeBootPattern-1489988074-project Oct 27 04:11:30.618931 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 04:11:30.618931 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 04:11:30.618931 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: b7f5c179e8844542bca46d76042a6897 Oct 27 04:11:30.618931 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-TestVolumeBootPattern-1489988074-project Oct 27 04:11:30.618931 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 04:11:30.618931 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 1d1883a3-05ef-4d2b-b98f-70a18deb6602 could not be found. Oct 27 04:11:30.618931 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '1d1883a3-05ef-4d2b-b98f-70a18deb6602'} Oct 27 04:11:30.618931 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 04:11:30.618931 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:11:30.618931 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 04:11:30.618931 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 04:11:30.618931 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 04:11:30.618931 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 04:11:30.618931 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 04:11:30.618931 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 04:11:30.618931 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 04:11:30.618931 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 04:11:30.618931 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d1883a3-05ef-4d2b-b98f-70a18deb6602 could not be found. Oct 27 04:11:30.618931 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:11:30.618931 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:11:30.618931 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:11:30.618931 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:11:30.618931 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:11:30.618931 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:11:30.618931 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 04:11:30.618931 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 04:11:30.618931 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 04:11:30.618931 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 04:11:30.618931 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 04:11:30.618931 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 04:11:30.618931 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 04:11:30.618931 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 04:11:30.618931 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 04:11:30.618931 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 04:11:30.618931 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d1883a3-05ef-4d2b-b98f-70a18deb6602 could not be found. Oct 27 04:11:30.618931 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:11:30.618931 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:11:30.618931 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:11:30.630096 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:11:30.630096 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:11:30.630096 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:11:30.630096 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 04:11:30.630096 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 04:11:30.630096 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d1883a3-05ef-4d2b-b98f-70a18deb6602 could not be found. Oct 27 04:11:30.630096 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:11:30.630096 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ca4735b2-ed35-4fc1-9247-4dd275030846 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Returning 404 to user: Instance 1d1883a3-05ef-4d2b-b98f-70a18deb6602 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 04:11:30.630096 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ca4735b2-ed35-4fc1-9247-4dd275030846 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/1d1883a3-05ef-4d2b-b98f-70a18deb6602" status: 404 len: 111 microversion: 2.1 time: 0.035980 Oct 27 04:11:30.630096 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3668/7048] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:11:30 2022] GET /compute/v2.1/servers/1d1883a3-05ef-4d2b-b98f-70a18deb6602 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 04:11:31.064781 n-d-862769-1 devstack@n-api.service[121000]: INFO oslo.messaging._drivers.impl_rabbit [None req-bcfa42df-1aa5-4097-af23-3980a47b3f5b tempest-TestAggregatesBasicOps-841745960 tempest-TestAggregatesBasicOps-841745960-project-admin] [bc5cc820-22d4-4c61-b33e-040cb7304259] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 53548. Oct 27 04:11:31.146009 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-bcfa42df-1aa5-4097-af23-3980a47b3f5b tempest-TestAggregatesBasicOps-841745960 tempest-TestAggregatesBasicOps-841745960-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 209 microversion: 2.1 time: 1.260926 Oct 27 04:11:31.158141 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9857ec39-1719-469d-920c-85f94884960b tempest-TestAggregatesBasicOps-841745960 tempest-TestAggregatesBasicOps-841745960-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:11:31.160780 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3381/7049] 10.222.0.20 () {60 vars in 1164 bytes} [Thu Oct 27 04:11:29 2022] POST /compute/v2.1/os-aggregates => generated 209 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:11:31.236866 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9857ec39-1719-469d-920c-85f94884960b tempest-TestAggregatesBasicOps-841745960 tempest-TestAggregatesBasicOps-841745960-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 319 microversion: 2.1 time: 0.082574 Oct 27 04:11:31.244089 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3669/7050] 10.222.0.20 () {60 vars in 1194 bytes} [Thu Oct 27 04:11:31 2022] POST /compute/v2.1/os-aggregates/19/action => generated 319 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:11:31.249757 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1bca80b6-a6d9-43db-9545-6bb617103426 tempest-TestAggregatesBasicOps-841745960 tempest-TestAggregatesBasicOps-841745960-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:11:31.254750 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1bca80b6-a6d9-43db-9545-6bb617103426 tempest-TestAggregatesBasicOps-841745960 tempest-TestAggregatesBasicOps-841745960-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:11:31.255505 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1bca80b6-a6d9-43db-9545-6bb617103426 tempest-TestAggregatesBasicOps-841745960 tempest-TestAggregatesBasicOps-841745960-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:11:31.256023 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1bca80b6-a6d9-43db-9545-6bb617103426 tempest-TestAggregatesBasicOps-841745960 tempest-TestAggregatesBasicOps-841745960-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:11:31.256931 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1bca80b6-a6d9-43db-9545-6bb617103426 tempest-TestAggregatesBasicOps-841745960 tempest-TestAggregatesBasicOps-841745960-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:11:31.257455 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1bca80b6-a6d9-43db-9545-6bb617103426 tempest-TestAggregatesBasicOps-841745960 tempest-TestAggregatesBasicOps-841745960-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:11:31.257949 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1bca80b6-a6d9-43db-9545-6bb617103426 tempest-TestAggregatesBasicOps-841745960 tempest-TestAggregatesBasicOps-841745960-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:11:31.284082 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1bca80b6-a6d9-43db-9545-6bb617103426 tempest-TestAggregatesBasicOps-841745960 tempest-TestAggregatesBasicOps-841745960-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.038334 Oct 27 04:11:31.284718 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3382/7051] 10.222.0.20 () {58 vars in 1176 bytes} [Thu Oct 27 04:11:31 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:11:31.297015 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4cc5bf75-7047-46ec-b58f-8414467c4c74 tempest-TestAggregatesBasicOps-841745960 tempest-TestAggregatesBasicOps-841745960-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:11:31.305862 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4cc5bf75-7047-46ec-b58f-8414467c4c74 tempest-TestAggregatesBasicOps-841745960 tempest-TestAggregatesBasicOps-841745960-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.013134 Oct 27 04:11:31.306555 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3670/7052] 10.222.0.20 () {58 vars in 1143 bytes} [Thu Oct 27 04:11:31 2022] GET /compute/v2.1/os-aggregates => generated 298 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:11:31.318844 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d17b80e6-919b-455c-8d6a-8e49778fe2d0 tempest-TestAggregatesBasicOps-841745960 tempest-TestAggregatesBasicOps-841745960-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-862769-1"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:11:31.330166 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d17b80e6-919b-455c-8d6a-8e49778fe2d0 tempest-TestAggregatesBasicOps-841745960 tempest-TestAggregatesBasicOps-841745960-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:11:31.330652 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d17b80e6-919b-455c-8d6a-8e49778fe2d0 tempest-TestAggregatesBasicOps-841745960 tempest-TestAggregatesBasicOps-841745960-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:11:31.331094 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d17b80e6-919b-455c-8d6a-8e49778fe2d0 tempest-TestAggregatesBasicOps-841745960 tempest-TestAggregatesBasicOps-841745960-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:11:31.690738 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d17b80e6-919b-455c-8d6a-8e49778fe2d0 tempest-TestAggregatesBasicOps-841745960 tempest-TestAggregatesBasicOps-841745960-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 310 microversion: 2.1 time: 0.375620 Oct 27 04:11:31.691402 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3383/7053] 10.222.0.20 () {60 vars in 1194 bytes} [Thu Oct 27 04:11:31 2022] POST /compute/v2.1/os-aggregates/19/action => generated 310 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:11:31.703446 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1265fcce-4154-4f08-810b-9776e528e3da tempest-TestAggregatesBasicOps-841745960 tempest-TestAggregatesBasicOps-841745960-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:11:31.714498 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1265fcce-4154-4f08-810b-9776e528e3da tempest-TestAggregatesBasicOps-841745960 tempest-TestAggregatesBasicOps-841745960-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 310 microversion: 2.1 time: 0.014829 Oct 27 04:11:31.715440 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3671/7054] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Oct 27 04:11:31 2022] GET /compute/v2.1/os-aggregates/19 => generated 310 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:11:31.726865 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b08e5ed6-b1b7-4d2c-b7e9-76b3bf59ba0a tempest-TestAggregatesBasicOps-841745960 tempest-TestAggregatesBasicOps-841745960-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1680483404", "availability_zone": "foo_zone"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:11:31.941569 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b08e5ed6-b1b7-4d2c-b7e9-76b3bf59ba0a tempest-TestAggregatesBasicOps-841745960 tempest-TestAggregatesBasicOps-841745960-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.218246 Oct 27 04:11:31.942569 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3384/7055] 10.222.0.20 () {60 vars in 1173 bytes} [Thu Oct 27 04:11:31 2022] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:11:31.954225 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5d839863-6634-4232-85f5-0a6d89eab9c3 tempest-TestAggregatesBasicOps-841745960 tempest-TestAggregatesBasicOps-841745960-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:11:32.051060 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5d839863-6634-4232-85f5-0a6d89eab9c3 tempest-TestAggregatesBasicOps-841745960 tempest-TestAggregatesBasicOps-841745960-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.100804 Oct 27 04:11:32.052082 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3672/7056] 10.222.0.20 () {60 vars in 1194 bytes} [Thu Oct 27 04:11:31 2022] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:11:32.064071 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-636c8451-b9cf-496a-afb2-a646a7b4ddc4 tempest-TestAggregatesBasicOps-841745960 tempest-TestAggregatesBasicOps-841745960-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:11:32.073687 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-636c8451-b9cf-496a-afb2-a646a7b4ddc4 tempest-TestAggregatesBasicOps-841745960 tempest-TestAggregatesBasicOps-841745960-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.013740 Oct 27 04:11:32.074341 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3385/7057] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Oct 27 04:11:32 2022] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:11:32.092410 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-068c50ae-7084-4f13-ba9c-7ee82ae49e54 tempest-TestAggregatesBasicOps-841745960 tempest-TestAggregatesBasicOps-841745960-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-862769-1"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:11:32.103481 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-068c50ae-7084-4f13-ba9c-7ee82ae49e54 tempest-TestAggregatesBasicOps-841745960 tempest-TestAggregatesBasicOps-841745960-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:11:32.103987 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-068c50ae-7084-4f13-ba9c-7ee82ae49e54 tempest-TestAggregatesBasicOps-841745960 tempest-TestAggregatesBasicOps-841745960-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:11:32.104445 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-068c50ae-7084-4f13-ba9c-7ee82ae49e54 tempest-TestAggregatesBasicOps-841745960 tempest-TestAggregatesBasicOps-841745960-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:11:32.498714 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-068c50ae-7084-4f13-ba9c-7ee82ae49e54 tempest-TestAggregatesBasicOps-841745960 tempest-TestAggregatesBasicOps-841745960-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.410167 Oct 27 04:11:32.499434 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3673/7058] 10.222.0.20 () {60 vars in 1194 bytes} [Thu Oct 27 04:11:32 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:11:32.517330 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-76080433-625c-4f11-939a-d46d9ec72e1a tempest-TestAggregatesBasicOps-841745960 tempest-TestAggregatesBasicOps-841745960-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:11:32.618590 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-76080433-625c-4f11-939a-d46d9ec72e1a tempest-TestAggregatesBasicOps-841745960 tempest-TestAggregatesBasicOps-841745960-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.108481 Oct 27 04:11:32.618590 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3386/7059] 10.222.0.20 () {58 vars in 1155 bytes} [Thu Oct 27 04:11:32 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 27 04:11:32.783543 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a70ef495-8f05-41ab-a63d-01b0e11b4279 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:11:32.784087 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a70ef495-8f05-41ab-a63d-01b0e11b4279 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 60f45e37-e987-4aef-85d5-90e612460605] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:11:32.792688 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a70ef495-8f05-41ab-a63d-01b0e11b4279 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:11:32.793330 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a70ef495-8f05-41ab-a63d-01b0e11b4279 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:11:32.793928 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a70ef495-8f05-41ab-a63d-01b0e11b4279 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:11:32.795015 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a70ef495-8f05-41ab-a63d-01b0e11b4279 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:11:32.795596 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a70ef495-8f05-41ab-a63d-01b0e11b4279 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:11:32.796813 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a70ef495-8f05-41ab-a63d-01b0e11b4279 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:11:32.816032 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-a70ef495-8f05-41ab-a63d-01b0e11b4279 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] HTTP exception thrown: Instance 60f45e37-e987-4aef-85d5-90e612460605 could not be found. Oct 27 04:11:32.817632 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a70ef495-8f05-41ab-a63d-01b0e11b4279 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Request method failure captured: Oct 27 04:11:32.817632 n-d-862769-1 devstack@n-api.service[121001]: request: DELETE /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605 HTTP/1.1 Oct 27 04:11:32.817632 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 04:11:32.817632 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 04:11:32.817632 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 04:11:32.817632 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 04:11:32.817632 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 04:11:32.817632 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 04:11:32.817632 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 04:11:32.817632 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 04:11:32.817632 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWgOy2vyGIZvCPgeKqR-dxD7jsV8GSZftvWG3pi0psQTYPv81ATvFSgHi31EMgn0x5NItteNYikimeQ9zcCw_dYQg7rFsVn9VSH-YqZAmUJa-ncyxVumv4r6CMnFhSrRbs_K6XB3pjXRcA1nWSk0V8vccKKBeZUitsa2lCn2gYQAw5hI Oct 27 04:11:32.817632 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 04:11:32.817632 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 04:11:32.817632 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 04:11:32.817632 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 04:11:32.817632 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 04:11:32.817632 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 04:11:32.817632 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 6a6a4f0161c94dc19682d70af00ba684 Oct 27 04:11:32.817632 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-TestVolumeBootPattern-1489988074 Oct 27 04:11:32.817632 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 04:11:32.817632 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 04:11:32.817632 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6a6a4f0161c94dc19682d70af00ba684"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6a6a4f0161c94dc19682d70af00ba684"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6a6a4f0161c94dc19682d70af00ba684"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6a6a4f0161c94dc19682d70af00ba684"}]}] Oct 27 04:11:32.817632 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-TestVolumeBootPattern-1489988074 Oct 27 04:11:32.817632 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 6a6a4f0161c94dc19682d70af00ba684 Oct 27 04:11:32.817632 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-TestVolumeBootPattern-1489988074 Oct 27 04:11:32.817632 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-TestVolumeBootPattern-1489988074-project Oct 27 04:11:32.817632 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 04:11:32.817632 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 04:11:32.817632 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: b7f5c179e8844542bca46d76042a6897 Oct 27 04:11:32.817632 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-TestVolumeBootPattern-1489988074-project Oct 27 04:11:32.817632 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 04:11:32.817632 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 60f45e37-e987-4aef-85d5-90e612460605 could not be found. Oct 27 04:11:32.817632 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '60f45e37-e987-4aef-85d5-90e612460605'} Oct 27 04:11:32.817632 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 04:11:32.817632 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:11:32.817632 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 04:11:32.817632 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 04:11:32.817632 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 04:11:32.817632 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 04:11:32.817632 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 04:11:32.817632 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 04:11:32.817632 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 04:11:32.817632 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 04:11:32.817632 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60f45e37-e987-4aef-85d5-90e612460605 could not be found. Oct 27 04:11:32.817632 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:11:32.817632 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:11:32.817632 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:11:32.817632 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:11:32.817632 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:11:32.817632 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:11:32.817632 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 04:11:32.817632 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 04:11:32.817632 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 04:11:32.817632 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 04:11:32.817632 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 04:11:32.817632 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 04:11:32.817632 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 04:11:32.817632 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 04:11:32.817632 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 04:11:32.817632 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 04:11:32.817632 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 04:11:32.817632 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 04:11:32.821445 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60f45e37-e987-4aef-85d5-90e612460605 could not be found. Oct 27 04:11:32.821445 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:11:32.821445 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:11:32.821445 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:11:32.821445 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:11:32.821445 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:11:32.821445 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:11:32.821445 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 04:11:32.821445 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 04:11:32.821445 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60f45e37-e987-4aef-85d5-90e612460605 could not be found. Oct 27 04:11:32.821445 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:11:32.821445 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a70ef495-8f05-41ab-a63d-01b0e11b4279 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Returning 404 to user: Instance 60f45e37-e987-4aef-85d5-90e612460605 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 04:11:32.821445 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a70ef495-8f05-41ab-a63d-01b0e11b4279 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "DELETE /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605" status: 404 len: 111 microversion: 2.1 time: 0.043076 Oct 27 04:11:32.821445 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3674/7060] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 04:11:32 2022] DELETE /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 04:11:32.829068 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0349bbef-6820-4ea6-83b8-299529d84192 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:11:32.832632 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0349bbef-6820-4ea6-83b8-299529d84192 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 60f45e37-e987-4aef-85d5-90e612460605] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:11:32.836831 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0349bbef-6820-4ea6-83b8-299529d84192 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:11:32.837801 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0349bbef-6820-4ea6-83b8-299529d84192 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:11:32.838338 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0349bbef-6820-4ea6-83b8-299529d84192 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:11:32.839138 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0349bbef-6820-4ea6-83b8-299529d84192 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:11:32.840318 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0349bbef-6820-4ea6-83b8-299529d84192 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:11:32.841422 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0349bbef-6820-4ea6-83b8-299529d84192 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:11:32.859482 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-0349bbef-6820-4ea6-83b8-299529d84192 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] HTTP exception thrown: Instance 60f45e37-e987-4aef-85d5-90e612460605 could not be found. Oct 27 04:11:32.861189 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0349bbef-6820-4ea6-83b8-299529d84192 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Request method failure captured: Oct 27 04:11:32.861189 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605 HTTP/1.1 Oct 27 04:11:32.861189 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 04:11:32.861189 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 04:11:32.861189 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 04:11:32.861189 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 04:11:32.861189 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 04:11:32.861189 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 04:11:32.861189 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 04:11:32.861189 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 04:11:32.861189 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWgOy2vyGIZvCPgeKqR-dxD7jsV8GSZftvWG3pi0psQTYPv81ATvFSgHi31EMgn0x5NItteNYikimeQ9zcCw_dYQg7rFsVn9VSH-YqZAmUJa-ncyxVumv4r6CMnFhSrRbs_K6XB3pjXRcA1nWSk0V8vccKKBeZUitsa2lCn2gYQAw5hI Oct 27 04:11:32.861189 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 04:11:32.861189 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 04:11:32.861189 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 04:11:32.861189 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 04:11:32.861189 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 04:11:32.861189 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 04:11:32.861189 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 6a6a4f0161c94dc19682d70af00ba684 Oct 27 04:11:32.861189 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-TestVolumeBootPattern-1489988074 Oct 27 04:11:32.861189 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 04:11:32.861189 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 04:11:32.861189 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6a6a4f0161c94dc19682d70af00ba684"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6a6a4f0161c94dc19682d70af00ba684"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6a6a4f0161c94dc19682d70af00ba684"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6a6a4f0161c94dc19682d70af00ba684"}]}] Oct 27 04:11:32.861189 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-TestVolumeBootPattern-1489988074 Oct 27 04:11:32.861189 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 6a6a4f0161c94dc19682d70af00ba684 Oct 27 04:11:32.861189 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-TestVolumeBootPattern-1489988074 Oct 27 04:11:32.861189 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-TestVolumeBootPattern-1489988074-project Oct 27 04:11:32.861189 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 04:11:32.861189 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 04:11:32.861189 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: b7f5c179e8844542bca46d76042a6897 Oct 27 04:11:32.861189 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-TestVolumeBootPattern-1489988074-project Oct 27 04:11:32.861189 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 04:11:32.861189 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 60f45e37-e987-4aef-85d5-90e612460605 could not be found. Oct 27 04:11:32.861189 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '60f45e37-e987-4aef-85d5-90e612460605'} Oct 27 04:11:32.861189 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 04:11:32.861189 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:11:32.861189 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 04:11:32.861189 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 04:11:32.861189 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 04:11:32.861189 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 04:11:32.861189 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 04:11:32.861189 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 04:11:32.861189 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 04:11:32.861189 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 04:11:32.861189 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60f45e37-e987-4aef-85d5-90e612460605 could not be found. Oct 27 04:11:32.861189 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:11:32.861189 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:11:32.861189 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:11:32.861189 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:11:32.861189 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:11:32.861189 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:11:32.861189 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 04:11:32.861189 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 04:11:32.861189 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 04:11:32.861189 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 04:11:32.861189 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 04:11:32.861189 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 04:11:32.861189 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 04:11:32.861189 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 04:11:32.861189 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 04:11:32.861189 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 04:11:32.861189 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60f45e37-e987-4aef-85d5-90e612460605 could not be found. Oct 27 04:11:32.861189 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:11:32.861189 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:11:32.861189 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:11:32.865713 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:11:32.865713 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:11:32.865713 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:11:32.865713 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 04:11:32.865713 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 04:11:32.865713 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60f45e37-e987-4aef-85d5-90e612460605 could not be found. Oct 27 04:11:32.865713 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:11:32.865713 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0349bbef-6820-4ea6-83b8-299529d84192 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Returning 404 to user: Instance 60f45e37-e987-4aef-85d5-90e612460605 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 04:11:32.865713 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0349bbef-6820-4ea6-83b8-299529d84192 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605" status: 404 len: 111 microversion: 2.1 time: 0.038201 Oct 27 04:11:32.865713 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3387/7061] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:11:32 2022] GET /compute/v2.1/servers/60f45e37-e987-4aef-85d5-90e612460605 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 04:11:33.866956 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6639094d-d167-42aa-aa54-5e4bccfead58 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:11:33.868268 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-6639094d-d167-42aa-aa54-5e4bccfead58 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 1d1883a3-05ef-4d2b-b98f-70a18deb6602] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:11:33.880011 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6639094d-d167-42aa-aa54-5e4bccfead58 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:11:33.881061 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6639094d-d167-42aa-aa54-5e4bccfead58 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:11:33.881695 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6639094d-d167-42aa-aa54-5e4bccfead58 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:11:33.882487 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6639094d-d167-42aa-aa54-5e4bccfead58 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:11:33.883721 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6639094d-d167-42aa-aa54-5e4bccfead58 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:11:33.884180 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6639094d-d167-42aa-aa54-5e4bccfead58 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:11:33.899890 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-6639094d-d167-42aa-aa54-5e4bccfead58 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] HTTP exception thrown: Instance 1d1883a3-05ef-4d2b-b98f-70a18deb6602 could not be found. Oct 27 04:11:33.901519 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6639094d-d167-42aa-aa54-5e4bccfead58 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Request method failure captured: Oct 27 04:11:33.901519 n-d-862769-1 devstack@n-api.service[121001]: request: DELETE /compute/v2.1/servers/1d1883a3-05ef-4d2b-b98f-70a18deb6602 HTTP/1.1 Oct 27 04:11:33.901519 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 04:11:33.901519 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 04:11:33.901519 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 04:11:33.901519 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 04:11:33.901519 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 04:11:33.901519 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 04:11:33.901519 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 04:11:33.901519 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 04:11:33.901519 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWgOy2vyGIZvCPgeKqR-dxD7jsV8GSZftvWG3pi0psQTYPv81ATvFSgHi31EMgn0x5NItteNYikimeQ9zcCw_dYQg7rFsVn9VSH-YqZAmUJa-ncyxVumv4r6CMnFhSrRbs_K6XB3pjXRcA1nWSk0V8vccKKBeZUitsa2lCn2gYQAw5hI Oct 27 04:11:33.901519 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 04:11:33.901519 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 04:11:33.901519 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 04:11:33.901519 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 04:11:33.901519 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 04:11:33.901519 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 04:11:33.901519 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 6a6a4f0161c94dc19682d70af00ba684 Oct 27 04:11:33.901519 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-TestVolumeBootPattern-1489988074 Oct 27 04:11:33.901519 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 04:11:33.901519 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 04:11:33.901519 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6a6a4f0161c94dc19682d70af00ba684"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6a6a4f0161c94dc19682d70af00ba684"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6a6a4f0161c94dc19682d70af00ba684"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6a6a4f0161c94dc19682d70af00ba684"}]}] Oct 27 04:11:33.901519 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-TestVolumeBootPattern-1489988074 Oct 27 04:11:33.901519 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 6a6a4f0161c94dc19682d70af00ba684 Oct 27 04:11:33.901519 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-TestVolumeBootPattern-1489988074 Oct 27 04:11:33.901519 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-TestVolumeBootPattern-1489988074-project Oct 27 04:11:33.901519 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 04:11:33.901519 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 04:11:33.901519 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: b7f5c179e8844542bca46d76042a6897 Oct 27 04:11:33.901519 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-TestVolumeBootPattern-1489988074-project Oct 27 04:11:33.901519 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 04:11:33.901519 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 1d1883a3-05ef-4d2b-b98f-70a18deb6602 could not be found. Oct 27 04:11:33.901519 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '1d1883a3-05ef-4d2b-b98f-70a18deb6602'} Oct 27 04:11:33.901519 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 04:11:33.901519 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:11:33.901519 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 04:11:33.901519 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 04:11:33.901519 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 04:11:33.901519 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 04:11:33.901519 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 04:11:33.901519 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 04:11:33.901519 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 04:11:33.901519 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 04:11:33.901519 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d1883a3-05ef-4d2b-b98f-70a18deb6602 could not be found. Oct 27 04:11:33.901519 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:11:33.901519 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:11:33.901519 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:11:33.901519 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:11:33.901519 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:11:33.901519 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:11:33.901519 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 04:11:33.901519 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 04:11:33.901519 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 04:11:33.901519 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 04:11:33.901519 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 04:11:33.901519 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 04:11:33.901519 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 04:11:33.901519 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 04:11:33.901519 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 04:11:33.901519 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 04:11:33.901519 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 04:11:33.901519 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 04:11:33.905185 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d1883a3-05ef-4d2b-b98f-70a18deb6602 could not be found. Oct 27 04:11:33.905185 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:11:33.905185 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:11:33.905185 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:11:33.905185 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:11:33.905185 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:11:33.905185 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:11:33.905185 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 04:11:33.905185 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 04:11:33.905185 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d1883a3-05ef-4d2b-b98f-70a18deb6602 could not be found. Oct 27 04:11:33.905185 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:11:33.905185 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6639094d-d167-42aa-aa54-5e4bccfead58 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Returning 404 to user: Instance 1d1883a3-05ef-4d2b-b98f-70a18deb6602 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 04:11:33.905185 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6639094d-d167-42aa-aa54-5e4bccfead58 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1d1883a3-05ef-4d2b-b98f-70a18deb6602" status: 404 len: 111 microversion: 2.1 time: 0.040302 Oct 27 04:11:33.905185 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3675/7062] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 04:11:33 2022] DELETE /compute/v2.1/servers/1d1883a3-05ef-4d2b-b98f-70a18deb6602 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 04:11:33.912834 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-82c0047f-ba32-44eb-89c9-4a2c44aa098a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:11:33.913382 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-82c0047f-ba32-44eb-89c9-4a2c44aa098a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 1d1883a3-05ef-4d2b-b98f-70a18deb6602] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:11:33.921302 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-82c0047f-ba32-44eb-89c9-4a2c44aa098a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:11:33.921302 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-82c0047f-ba32-44eb-89c9-4a2c44aa098a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:11:33.929137 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-82c0047f-ba32-44eb-89c9-4a2c44aa098a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:11:33.929137 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-82c0047f-ba32-44eb-89c9-4a2c44aa098a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:11:33.929137 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-82c0047f-ba32-44eb-89c9-4a2c44aa098a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:11:33.929137 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-82c0047f-ba32-44eb-89c9-4a2c44aa098a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:11:33.937586 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-82c0047f-ba32-44eb-89c9-4a2c44aa098a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] HTTP exception thrown: Instance 1d1883a3-05ef-4d2b-b98f-70a18deb6602 could not be found. Oct 27 04:11:33.939362 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-82c0047f-ba32-44eb-89c9-4a2c44aa098a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Request method failure captured: Oct 27 04:11:33.939362 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/1d1883a3-05ef-4d2b-b98f-70a18deb6602 HTTP/1.1 Oct 27 04:11:33.939362 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 04:11:33.939362 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 04:11:33.939362 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 04:11:33.939362 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 04:11:33.939362 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 04:11:33.939362 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 04:11:33.939362 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 04:11:33.939362 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 04:11:33.939362 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWgOy2vyGIZvCPgeKqR-dxD7jsV8GSZftvWG3pi0psQTYPv81ATvFSgHi31EMgn0x5NItteNYikimeQ9zcCw_dYQg7rFsVn9VSH-YqZAmUJa-ncyxVumv4r6CMnFhSrRbs_K6XB3pjXRcA1nWSk0V8vccKKBeZUitsa2lCn2gYQAw5hI Oct 27 04:11:33.939362 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 04:11:33.939362 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 04:11:33.939362 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 04:11:33.939362 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 04:11:33.939362 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 04:11:33.939362 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 04:11:33.939362 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 6a6a4f0161c94dc19682d70af00ba684 Oct 27 04:11:33.939362 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-TestVolumeBootPattern-1489988074 Oct 27 04:11:33.939362 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 04:11:33.939362 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 04:11:33.939362 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6a6a4f0161c94dc19682d70af00ba684"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6a6a4f0161c94dc19682d70af00ba684"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6a6a4f0161c94dc19682d70af00ba684"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6a6a4f0161c94dc19682d70af00ba684"}]}] Oct 27 04:11:33.939362 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-TestVolumeBootPattern-1489988074 Oct 27 04:11:33.939362 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 6a6a4f0161c94dc19682d70af00ba684 Oct 27 04:11:33.939362 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-TestVolumeBootPattern-1489988074 Oct 27 04:11:33.939362 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-TestVolumeBootPattern-1489988074-project Oct 27 04:11:33.939362 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 04:11:33.939362 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 04:11:33.939362 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: b7f5c179e8844542bca46d76042a6897 Oct 27 04:11:33.939362 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-TestVolumeBootPattern-1489988074-project Oct 27 04:11:33.939362 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 04:11:33.939362 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 1d1883a3-05ef-4d2b-b98f-70a18deb6602 could not be found. Oct 27 04:11:33.939362 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '1d1883a3-05ef-4d2b-b98f-70a18deb6602'} Oct 27 04:11:33.939362 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 04:11:33.939362 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:11:33.939362 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 04:11:33.939362 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 04:11:33.939362 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 04:11:33.939362 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 04:11:33.939362 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 04:11:33.939362 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 04:11:33.939362 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 04:11:33.939362 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 04:11:33.939362 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d1883a3-05ef-4d2b-b98f-70a18deb6602 could not be found. Oct 27 04:11:33.939362 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:11:33.939362 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:11:33.939362 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:11:33.939362 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:11:33.939362 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:11:33.939362 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:11:33.939362 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 04:11:33.939362 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 04:11:33.939362 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 04:11:33.939362 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 04:11:33.939362 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 04:11:33.939362 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 04:11:33.939362 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 04:11:33.939362 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 04:11:33.939362 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 04:11:33.939362 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 04:11:33.939362 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d1883a3-05ef-4d2b-b98f-70a18deb6602 could not be found. Oct 27 04:11:33.939362 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:11:33.939362 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:11:33.939362 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:11:33.943195 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:11:33.943195 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:11:33.943195 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:11:33.943195 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 04:11:33.943195 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 04:11:33.943195 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d1883a3-05ef-4d2b-b98f-70a18deb6602 could not be found. Oct 27 04:11:33.943195 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:11:33.943195 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-82c0047f-ba32-44eb-89c9-4a2c44aa098a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Returning 404 to user: Instance 1d1883a3-05ef-4d2b-b98f-70a18deb6602 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 04:11:33.943195 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-82c0047f-ba32-44eb-89c9-4a2c44aa098a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/1d1883a3-05ef-4d2b-b98f-70a18deb6602" status: 404 len: 111 microversion: 2.1 time: 0.032102 Oct 27 04:11:33.947685 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3388/7063] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:11:33 2022] GET /compute/v2.1/servers/1d1883a3-05ef-4d2b-b98f-70a18deb6602 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 04:11:34.026176 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c62669fc-4957-4acf-b6db-2243e525cb6a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Action: 'create', calling method: .version_select at 0x7f7dd94615e0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-784919494", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO6Xu3GYD/a7Y1Lie8nwh12QRdAdBU4pmsHB1lirG+cQIeHj385qInV7HWd+YteJi9tuC/ZgTGRwpq3e9pAKl/3OSVpKJ1/8WbI0qXFG10cbnMbSPFvm0AusHUItamR/Fg=="}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:11:34.044958 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-c62669fc-4957-4acf-b6db-2243e525cb6a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Getting quotas for project 6a6a4f0161c94dc19682d70af00ba684. Resources: {'key_pairs'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 04:11:34.052077 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-c62669fc-4957-4acf-b6db-2243e525cb6a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Getting quotas for user b7f5c179e8844542bca46d76042a6897 and project 6a6a4f0161c94dc19682d70af00ba684. Resources: {'key_pairs'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 04:11:34.165909 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c62669fc-4957-4acf-b6db-2243e525cb6a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.144023 Oct 27 04:11:34.166753 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3676/7064] 10.222.0.20 () {60 vars in 1159 bytes} [Thu Oct 27 04:11:34 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:12:02.495125 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1cef9d79-1886-4c74-a28d-52a85f96f3ee tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-25841359", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-784919494", "security_groups": [{"name": "tempest-secgroup-smoke-514301289"}], "block_device_mapping_v2": [{"uuid": "71480df3-b176-461e-8b3b-852ae36c25fd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b49d136e-c9db-4b4f-8210-57f6cfd2ff95"}]}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:12:02.505421 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:12:02.506191 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:12:02.506828 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:12:02.785486 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-1cef9d79-1886-4c74-a28d-52a85f96f3ee tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] validate_networks() for [('b49d136e-c9db-4b4f-8210-57f6cfd2ff95', None, None, None, None, None)] {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 04:12:03.152236 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-1cef9d79-1886-4c74-a28d-52a85f96f3ee tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 04:12:03.152664 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-1cef9d79-1886-4c74-a28d-52a85f96f3ee tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 04:12:03.153143 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-1cef9d79-1886-4c74-a28d-52a85f96f3ee tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 04:12:03.153556 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-1cef9d79-1886-4c74-a28d-52a85f96f3ee tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 04:12:03.153973 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-1cef9d79-1886-4c74-a28d-52a85f96f3ee tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 04:12:03.162874 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1cef9d79-1886-4c74-a28d-52a85f96f3ee tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:12:03.163357 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1cef9d79-1886-4c74-a28d-52a85f96f3ee tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:12:03.163793 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1cef9d79-1886-4c74-a28d-52a85f96f3ee tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:12:03.164517 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1cef9d79-1886-4c74-a28d-52a85f96f3ee tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:12:03.165476 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1cef9d79-1886-4c74-a28d-52a85f96f3ee tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:12:03.165903 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1cef9d79-1886-4c74-a28d-52a85f96f3ee tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:12:03.183423 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-1cef9d79-1886-4c74-a28d-52a85f96f3ee tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Getting quotas for project 6a6a4f0161c94dc19682d70af00ba684. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 04:12:03.189156 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-1cef9d79-1886-4c74-a28d-52a85f96f3ee tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Getting quotas for user b7f5c179e8844542bca46d76042a6897 and project 6a6a4f0161c94dc19682d70af00ba684. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 04:12:03.247238 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1cef9d79-1886-4c74-a28d-52a85f96f3ee tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 04:12:03.249378 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1cef9d79-1886-4c74-a28d-52a85f96f3ee tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='71480df3-b176-461e-8b3b-852ae36c25fd',volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 04:12:03.674051 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1cef9d79-1886-4c74-a28d-52a85f96f3ee tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.182904 Oct 27 04:12:03.675019 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3389/7065] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 04:12:02 2022] POST /compute/v2.1/servers => generated 405 bytes in 1184 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 04:12:03.686320 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2de8072e-efd9-41ba-9a43-c6efc87f03d4 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:12:03.692013 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2de8072e-efd9-41ba-9a43-c6efc87f03d4 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:12:03.692013 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=37 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:12:03.692013 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=4 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:12:03.692013 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:12:03.846953 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2de8072e-efd9-41ba-9a43-c6efc87f03d4 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:12:03.854923 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2de8072e-efd9-41ba-9a43-c6efc87f03d4 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0" status: 200 len: 1092 microversion: 2.1 time: 0.172909 Oct 27 04:12:03.855498 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3677/7066] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:12:03 2022] GET /compute/v2.1/servers/0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0 => generated 1092 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:12:04.877309 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b2f22505-1a4b-49a4-84cd-1b2c3aa1776e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:12:04.880820 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b2f22505-1a4b-49a4-84cd-1b2c3aa1776e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:12:04.932906 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b2f22505-1a4b-49a4-84cd-1b2c3aa1776e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:12:04.940372 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b2f22505-1a4b-49a4-84cd-1b2c3aa1776e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0" status: 200 len: 1092 microversion: 2.1 time: 0.067214 Oct 27 04:12:04.940952 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3390/7067] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:12:04 2022] GET /compute/v2.1/servers/0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0 => generated 1092 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:12:05.964401 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b4be5c2f-0fc3-4b6f-8bdf-1c9bd8d0e4a3 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:12:05.965072 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b4be5c2f-0fc3-4b6f-8bdf-1c9bd8d0e4a3 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:12:06.022946 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b4be5c2f-0fc3-4b6f-8bdf-1c9bd8d0e4a3 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:12:06.030656 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b4be5c2f-0fc3-4b6f-8bdf-1c9bd8d0e4a3 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0" status: 200 len: 1092 microversion: 2.1 time: 0.070839 Oct 27 04:12:06.031236 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3678/7068] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:12:05 2022] GET /compute/v2.1/servers/0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0 => generated 1092 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:12:07.053816 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9591ae55-9709-4769-988b-ba19e0b32563 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:12:07.054461 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9591ae55-9709-4769-988b-ba19e0b32563 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:12:07.113728 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9591ae55-9709-4769-988b-ba19e0b32563 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:12:07.121367 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9591ae55-9709-4769-988b-ba19e0b32563 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0" status: 200 len: 1092 microversion: 2.1 time: 0.071422 Oct 27 04:12:07.136370 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3391/7069] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:12:07 2022] GET /compute/v2.1/servers/0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0 => generated 1092 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:12:08.144210 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0a47dff3-af32-4511-811c-bcfcc2bf3d0d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:12:08.144857 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0a47dff3-af32-4511-811c-bcfcc2bf3d0d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:12:08.152701 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0a47dff3-af32-4511-811c-bcfcc2bf3d0d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:12:08.153209 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0a47dff3-af32-4511-811c-bcfcc2bf3d0d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:12:08.153674 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0a47dff3-af32-4511-811c-bcfcc2bf3d0d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:12:08.154771 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0a47dff3-af32-4511-811c-bcfcc2bf3d0d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:12:08.154956 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0a47dff3-af32-4511-811c-bcfcc2bf3d0d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:12:08.155417 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0a47dff3-af32-4511-811c-bcfcc2bf3d0d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:12:08.216923 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0a47dff3-af32-4511-811c-bcfcc2bf3d0d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:12:08.224746 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0a47dff3-af32-4511-811c-bcfcc2bf3d0d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0" status: 200 len: 1142 microversion: 2.1 time: 0.084561 Oct 27 04:12:08.225333 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3679/7070] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:12:08 2022] GET /compute/v2.1/servers/0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0 => generated 1142 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:12:09.247884 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-59490ec4-0acf-4364-809c-783a5356797f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:12:09.248507 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-59490ec4-0acf-4364-809c-783a5356797f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:12:09.255298 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-59490ec4-0acf-4364-809c-783a5356797f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:12:09.255790 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-59490ec4-0acf-4364-809c-783a5356797f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:12:09.256238 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-59490ec4-0acf-4364-809c-783a5356797f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:12:09.256940 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-59490ec4-0acf-4364-809c-783a5356797f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:12:09.257400 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-59490ec4-0acf-4364-809c-783a5356797f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:12:09.257867 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-59490ec4-0acf-4364-809c-783a5356797f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:12:09.325870 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-59490ec4-0acf-4364-809c-783a5356797f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:12:09.333810 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-59490ec4-0acf-4364-809c-783a5356797f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0" status: 200 len: 1190 microversion: 2.1 time: 0.090518 Oct 27 04:12:09.334414 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3392/7071] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:12:09 2022] GET /compute/v2.1/servers/0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0 => generated 1190 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:12:10.357374 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4b0b247e-5527-479b-985e-0433df770e9f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:12:10.359049 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4b0b247e-5527-479b-985e-0433df770e9f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:12:10.369336 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4b0b247e-5527-479b-985e-0433df770e9f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:12:10.370080 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4b0b247e-5527-479b-985e-0433df770e9f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:12:10.370778 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4b0b247e-5527-479b-985e-0433df770e9f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:12:10.371860 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4b0b247e-5527-479b-985e-0433df770e9f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:12:10.372503 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4b0b247e-5527-479b-985e-0433df770e9f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:12:10.373141 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4b0b247e-5527-479b-985e-0433df770e9f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:12:10.524245 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4b0b247e-5527-479b-985e-0433df770e9f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:12:10.533832 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4b0b247e-5527-479b-985e-0433df770e9f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0" status: 200 len: 1275 microversion: 2.1 time: 0.181213 Oct 27 04:12:10.535342 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3680/7072] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:12:10 2022] GET /compute/v2.1/servers/0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0 => generated 1275 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:12:11.416393 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-13ccc530-73bd-4d7c-9d1e-2332dd14ca88 req-ece32f32-4549-4cc1-b959-aef2c1b76444 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0", "tag": "5fa92ab3-c5c6-44fc-8bc7-41184ae29c87"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:12:11.428673 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-13ccc530-73bd-4d7c-9d1e-2332dd14ca88 req-ece32f32-4549-4cc1-b959-aef2c1b76444 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:12:11.429393 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-13ccc530-73bd-4d7c-9d1e-2332dd14ca88 req-ece32f32-4549-4cc1-b959-aef2c1b76444 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:12:11.429844 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-13ccc530-73bd-4d7c-9d1e-2332dd14ca88 req-ece32f32-4549-4cc1-b959-aef2c1b76444 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:12:11.441450 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-13ccc530-73bd-4d7c-9d1e-2332dd14ca88 req-ece32f32-4549-4cc1-b959-aef2c1b76444 service nova] Creating event network-changed:5fa92ab3-c5c6-44fc-8bc7-41184ae29c87 for instance 0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0 on n-h1-862769-1 Oct 27 04:12:11.447825 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-13ccc530-73bd-4d7c-9d1e-2332dd14ca88 req-ece32f32-4549-4cc1-b959-aef2c1b76444 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035817 Oct 27 04:12:11.448442 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3393/7073] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:12:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:12:11.557319 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c4f7e990-e5de-486a-8f1f-d317384ee9aa tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:12:11.558820 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c4f7e990-e5de-486a-8f1f-d317384ee9aa tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:12:11.566385 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c4f7e990-e5de-486a-8f1f-d317384ee9aa tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:12:11.566839 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c4f7e990-e5de-486a-8f1f-d317384ee9aa tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:12:11.567307 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c4f7e990-e5de-486a-8f1f-d317384ee9aa tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:12:11.568045 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c4f7e990-e5de-486a-8f1f-d317384ee9aa tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:12:11.568514 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c4f7e990-e5de-486a-8f1f-d317384ee9aa tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:12:11.568962 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c4f7e990-e5de-486a-8f1f-d317384ee9aa tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:12:11.718421 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c4f7e990-e5de-486a-8f1f-d317384ee9aa tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:12:11.727169 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c4f7e990-e5de-486a-8f1f-d317384ee9aa tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0" status: 200 len: 1275 microversion: 2.1 time: 0.174051 Oct 27 04:12:11.740403 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3681/7074] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:12:11 2022] GET /compute/v2.1/servers/0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0 => generated 1275 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:12:12.750741 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-19c170f1-1e06-4b89-b538-ad5d9e67a3f7 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:12:12.751472 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-19c170f1-1e06-4b89-b538-ad5d9e67a3f7 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:12:12.758137 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-19c170f1-1e06-4b89-b538-ad5d9e67a3f7 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:12:12.758677 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-19c170f1-1e06-4b89-b538-ad5d9e67a3f7 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:12:12.759124 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-19c170f1-1e06-4b89-b538-ad5d9e67a3f7 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:12:12.759834 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-19c170f1-1e06-4b89-b538-ad5d9e67a3f7 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:12:12.760365 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-19c170f1-1e06-4b89-b538-ad5d9e67a3f7 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:12:12.760834 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-19c170f1-1e06-4b89-b538-ad5d9e67a3f7 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:12:12.896952 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-19c170f1-1e06-4b89-b538-ad5d9e67a3f7 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:12:12.905858 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-19c170f1-1e06-4b89-b538-ad5d9e67a3f7 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0" status: 200 len: 1275 microversion: 2.1 time: 0.160248 Oct 27 04:12:12.906490 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3394/7075] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:12:12 2022] GET /compute/v2.1/servers/0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0 => generated 1275 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:12:13.928865 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6f8f19df-7b04-4ac0-b99a-d275217b6212 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:12:13.929622 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-6f8f19df-7b04-4ac0-b99a-d275217b6212 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:12:13.937285 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6f8f19df-7b04-4ac0-b99a-d275217b6212 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:12:13.937790 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6f8f19df-7b04-4ac0-b99a-d275217b6212 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:12:13.938383 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6f8f19df-7b04-4ac0-b99a-d275217b6212 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:12:13.939012 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6f8f19df-7b04-4ac0-b99a-d275217b6212 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:12:13.939519 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6f8f19df-7b04-4ac0-b99a-d275217b6212 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:12:13.939967 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6f8f19df-7b04-4ac0-b99a-d275217b6212 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:12:14.074507 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6f8f19df-7b04-4ac0-b99a-d275217b6212 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:12:14.085052 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6f8f19df-7b04-4ac0-b99a-d275217b6212 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0" status: 200 len: 1275 microversion: 2.1 time: 0.160120 Oct 27 04:12:14.085637 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3682/7076] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:12:13 2022] GET /compute/v2.1/servers/0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0 => generated 1275 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:12:15.108725 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-177170c7-5e1e-4d82-9acf-24081b91ac63 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:12:15.109438 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-177170c7-5e1e-4d82-9acf-24081b91ac63 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:12:15.111500 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:12:15.118788 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-177170c7-5e1e-4d82-9acf-24081b91ac63 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:12:15.119278 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-177170c7-5e1e-4d82-9acf-24081b91ac63 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:12:15.119715 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-177170c7-5e1e-4d82-9acf-24081b91ac63 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:12:15.120412 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-177170c7-5e1e-4d82-9acf-24081b91ac63 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:12:15.120866 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-177170c7-5e1e-4d82-9acf-24081b91ac63 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:12:15.121290 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-177170c7-5e1e-4d82-9acf-24081b91ac63 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:12:15.260886 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-177170c7-5e1e-4d82-9acf-24081b91ac63 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:12:15.270327 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-177170c7-5e1e-4d82-9acf-24081b91ac63 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0" status: 200 len: 1275 microversion: 2.1 time: 0.165595 Oct 27 04:12:15.270917 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3395/7077] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:12:15 2022] GET /compute/v2.1/servers/0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0 => generated 1275 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:12:16.292527 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-eab840f1-cef3-47bc-9f46-95436ab72baa tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:12:16.293171 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-eab840f1-cef3-47bc-9f46-95436ab72baa tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:12:16.295897 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=4 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:12:16.300758 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eab840f1-cef3-47bc-9f46-95436ab72baa tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:12:16.303878 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eab840f1-cef3-47bc-9f46-95436ab72baa tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:12:16.303878 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eab840f1-cef3-47bc-9f46-95436ab72baa tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:12:16.303878 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eab840f1-cef3-47bc-9f46-95436ab72baa tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:12:16.303878 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eab840f1-cef3-47bc-9f46-95436ab72baa tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:12:16.303878 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eab840f1-cef3-47bc-9f46-95436ab72baa tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:12:16.437197 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-eab840f1-cef3-47bc-9f46-95436ab72baa tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:12:16.444915 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-eab840f1-cef3-47bc-9f46-95436ab72baa tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0" status: 200 len: 1263 microversion: 2.1 time: 0.156411 Oct 27 04:12:16.445496 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3683/7078] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:12:16 2022] GET /compute/v2.1/servers/0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0 => generated 1263 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:12:17.468565 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-fe42330f-ed08-4be7-85ee-8879289d4e8b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:12:17.469196 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-fe42330f-ed08-4be7-85ee-8879289d4e8b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:12:17.471927 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=10 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:12:17.476756 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fe42330f-ed08-4be7-85ee-8879289d4e8b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:12:17.477859 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fe42330f-ed08-4be7-85ee-8879289d4e8b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:12:17.478255 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fe42330f-ed08-4be7-85ee-8879289d4e8b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:12:17.480793 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fe42330f-ed08-4be7-85ee-8879289d4e8b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:12:17.480793 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fe42330f-ed08-4be7-85ee-8879289d4e8b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:12:17.480793 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fe42330f-ed08-4be7-85ee-8879289d4e8b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:12:17.614395 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-fe42330f-ed08-4be7-85ee-8879289d4e8b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:12:17.622708 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-fe42330f-ed08-4be7-85ee-8879289d4e8b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0" status: 200 len: 1263 microversion: 2.1 time: 0.158116 Oct 27 04:12:17.623286 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3396/7079] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:12:17 2022] GET /compute/v2.1/servers/0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0 => generated 1263 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:12:18.644588 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0ed1147a-9d34-4568-95e3-f9e3b45f70aa tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:12:18.645160 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0ed1147a-9d34-4568-95e3-f9e3b45f70aa tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:12:18.652339 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0ed1147a-9d34-4568-95e3-f9e3b45f70aa tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:12:18.652847 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0ed1147a-9d34-4568-95e3-f9e3b45f70aa tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:12:18.653309 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0ed1147a-9d34-4568-95e3-f9e3b45f70aa tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:12:18.654024 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0ed1147a-9d34-4568-95e3-f9e3b45f70aa tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:12:18.654531 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0ed1147a-9d34-4568-95e3-f9e3b45f70aa tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:12:18.654977 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0ed1147a-9d34-4568-95e3-f9e3b45f70aa tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:12:18.787291 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0ed1147a-9d34-4568-95e3-f9e3b45f70aa tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:12:18.795660 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0ed1147a-9d34-4568-95e3-f9e3b45f70aa tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0" status: 200 len: 1263 microversion: 2.1 time: 0.155151 Oct 27 04:12:18.796259 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3684/7080] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:12:18 2022] GET /compute/v2.1/servers/0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0 => generated 1263 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:12:19.817696 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-554da582-18a5-45c8-b53b-ba18dcdcdd21 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:12:19.818351 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-554da582-18a5-45c8-b53b-ba18dcdcdd21 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:12:19.825241 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-554da582-18a5-45c8-b53b-ba18dcdcdd21 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:12:19.825765 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-554da582-18a5-45c8-b53b-ba18dcdcdd21 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:12:19.826251 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-554da582-18a5-45c8-b53b-ba18dcdcdd21 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:12:19.826960 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-554da582-18a5-45c8-b53b-ba18dcdcdd21 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:12:19.827423 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-554da582-18a5-45c8-b53b-ba18dcdcdd21 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:12:19.827861 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-554da582-18a5-45c8-b53b-ba18dcdcdd21 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:12:19.958860 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-554da582-18a5-45c8-b53b-ba18dcdcdd21 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:12:19.966598 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-554da582-18a5-45c8-b53b-ba18dcdcdd21 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0" status: 200 len: 1263 microversion: 2.1 time: 0.152789 Oct 27 04:12:19.967177 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3397/7081] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:12:19 2022] GET /compute/v2.1/servers/0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0 => generated 1263 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:12:20.988730 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-129bb6e5-52e4-4e7d-ba62-29d46abd9615 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:12:20.989371 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-129bb6e5-52e4-4e7d-ba62-29d46abd9615 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:12:20.996650 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-129bb6e5-52e4-4e7d-ba62-29d46abd9615 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:12:20.997149 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-129bb6e5-52e4-4e7d-ba62-29d46abd9615 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:12:20.997604 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-129bb6e5-52e4-4e7d-ba62-29d46abd9615 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:12:20.998341 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-129bb6e5-52e4-4e7d-ba62-29d46abd9615 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:12:20.998813 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-129bb6e5-52e4-4e7d-ba62-29d46abd9615 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:12:20.999256 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-129bb6e5-52e4-4e7d-ba62-29d46abd9615 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:12:21.129439 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-129bb6e5-52e4-4e7d-ba62-29d46abd9615 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:12:21.137743 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-129bb6e5-52e4-4e7d-ba62-29d46abd9615 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0" status: 200 len: 1263 microversion: 2.1 time: 0.152904 Oct 27 04:12:21.138346 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3685/7082] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:12:20 2022] GET /compute/v2.1/servers/0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0 => generated 1263 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:12:22.160453 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f6536ff0-5e4a-4820-994a-d54cf948c7ba tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:12:22.161073 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f6536ff0-5e4a-4820-994a-d54cf948c7ba tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:12:22.167934 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f6536ff0-5e4a-4820-994a-d54cf948c7ba tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:12:22.168419 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f6536ff0-5e4a-4820-994a-d54cf948c7ba tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:12:22.168862 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f6536ff0-5e4a-4820-994a-d54cf948c7ba tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:12:22.169559 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f6536ff0-5e4a-4820-994a-d54cf948c7ba tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:12:22.170022 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f6536ff0-5e4a-4820-994a-d54cf948c7ba tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:12:22.170481 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f6536ff0-5e4a-4820-994a-d54cf948c7ba tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:12:22.308597 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f6536ff0-5e4a-4820-994a-d54cf948c7ba tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:12:22.316314 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f6536ff0-5e4a-4820-994a-d54cf948c7ba tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0" status: 200 len: 1263 microversion: 2.1 time: 0.159830 Oct 27 04:12:22.316910 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3398/7083] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:12:22 2022] GET /compute/v2.1/servers/0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0 => generated 1263 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:12:23.340310 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7111ed33-414f-45a0-b5a1-7a5f7ef4ab9e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:12:23.340955 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7111ed33-414f-45a0-b5a1-7a5f7ef4ab9e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:12:23.347942 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7111ed33-414f-45a0-b5a1-7a5f7ef4ab9e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:12:23.348453 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7111ed33-414f-45a0-b5a1-7a5f7ef4ab9e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:12:23.348917 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7111ed33-414f-45a0-b5a1-7a5f7ef4ab9e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:12:23.349636 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7111ed33-414f-45a0-b5a1-7a5f7ef4ab9e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:12:23.350152 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7111ed33-414f-45a0-b5a1-7a5f7ef4ab9e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:12:23.350611 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7111ed33-414f-45a0-b5a1-7a5f7ef4ab9e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:12:23.483371 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7111ed33-414f-45a0-b5a1-7a5f7ef4ab9e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:12:23.491135 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7111ed33-414f-45a0-b5a1-7a5f7ef4ab9e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0" status: 200 len: 1263 microversion: 2.1 time: 0.155290 Oct 27 04:12:23.491725 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3686/7084] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:12:23 2022] GET /compute/v2.1/servers/0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0 => generated 1263 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:12:24.514853 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-68f63a9f-009f-412f-a6f0-77c57843fc81 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:12:24.515467 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-68f63a9f-009f-412f-a6f0-77c57843fc81 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:12:24.522318 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-68f63a9f-009f-412f-a6f0-77c57843fc81 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:12:24.522810 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-68f63a9f-009f-412f-a6f0-77c57843fc81 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:12:24.523257 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-68f63a9f-009f-412f-a6f0-77c57843fc81 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:12:24.523957 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-68f63a9f-009f-412f-a6f0-77c57843fc81 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:12:24.525073 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-68f63a9f-009f-412f-a6f0-77c57843fc81 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:12:24.525508 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-68f63a9f-009f-412f-a6f0-77c57843fc81 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:12:24.662598 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-68f63a9f-009f-412f-a6f0-77c57843fc81 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:12:24.670492 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-68f63a9f-009f-412f-a6f0-77c57843fc81 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0" status: 200 len: 1263 microversion: 2.1 time: 0.159517 Oct 27 04:12:24.671070 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3399/7085] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:12:24 2022] GET /compute/v2.1/servers/0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0 => generated 1263 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:12:25.694139 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a2c9262b-797c-4ec2-90f6-3e867877159c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:12:25.694794 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a2c9262b-797c-4ec2-90f6-3e867877159c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:12:25.702268 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a2c9262b-797c-4ec2-90f6-3e867877159c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:12:25.702776 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a2c9262b-797c-4ec2-90f6-3e867877159c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:12:25.703239 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a2c9262b-797c-4ec2-90f6-3e867877159c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:12:25.703957 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a2c9262b-797c-4ec2-90f6-3e867877159c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:12:25.704434 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a2c9262b-797c-4ec2-90f6-3e867877159c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:12:25.704886 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a2c9262b-797c-4ec2-90f6-3e867877159c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:12:25.837203 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a2c9262b-797c-4ec2-90f6-3e867877159c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:12:25.845296 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a2c9262b-797c-4ec2-90f6-3e867877159c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0" status: 200 len: 1263 microversion: 2.1 time: 0.155029 Oct 27 04:12:25.845932 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3687/7086] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:12:25 2022] GET /compute/v2.1/servers/0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0 => generated 1263 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:12:25.962984 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-764c3e8b-ede7-4875-bfbc-c8d3ac237d00 req-b75942a5-a6f1-4804-a0cf-d5ded5a40d91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0", "name": "network-vif-plugged", "status": "completed", "tag": "5fa92ab3-c5c6-44fc-8bc7-41184ae29c87"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:12:25.973438 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-764c3e8b-ede7-4875-bfbc-c8d3ac237d00 req-b75942a5-a6f1-4804-a0cf-d5ded5a40d91 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:12:25.973927 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-764c3e8b-ede7-4875-bfbc-c8d3ac237d00 req-b75942a5-a6f1-4804-a0cf-d5ded5a40d91 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:12:25.974413 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-764c3e8b-ede7-4875-bfbc-c8d3ac237d00 req-b75942a5-a6f1-4804-a0cf-d5ded5a40d91 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:12:25.985130 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-764c3e8b-ede7-4875-bfbc-c8d3ac237d00 req-b75942a5-a6f1-4804-a0cf-d5ded5a40d91 service nova] Creating event network-vif-plugged:5fa92ab3-c5c6-44fc-8bc7-41184ae29c87 for instance 0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0 on n-h1-862769-1 Oct 27 04:12:25.990221 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-764c3e8b-ede7-4875-bfbc-c8d3ac237d00 req-b75942a5-a6f1-4804-a0cf-d5ded5a40d91 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031742 Oct 27 04:12:25.990807 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3400/7087] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:12:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:12:26.868531 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-90c80c7e-ab5d-4144-82da-4dea7baaa338 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:12:26.869163 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-90c80c7e-ab5d-4144-82da-4dea7baaa338 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:12:26.876127 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-90c80c7e-ab5d-4144-82da-4dea7baaa338 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:12:26.876971 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-90c80c7e-ab5d-4144-82da-4dea7baaa338 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:12:26.877430 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-90c80c7e-ab5d-4144-82da-4dea7baaa338 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:12:26.878183 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-90c80c7e-ab5d-4144-82da-4dea7baaa338 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:12:26.878657 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-90c80c7e-ab5d-4144-82da-4dea7baaa338 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:12:26.879150 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-90c80c7e-ab5d-4144-82da-4dea7baaa338 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:12:27.013421 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-90c80c7e-ab5d-4144-82da-4dea7baaa338 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:12:27.021250 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-90c80c7e-ab5d-4144-82da-4dea7baaa338 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0" status: 200 len: 1263 microversion: 2.1 time: 0.156829 Oct 27 04:12:27.021827 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3688/7088] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:12:26 2022] GET /compute/v2.1/servers/0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0 => generated 1263 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:12:28.045907 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d0b29bd4-b6dd-47f5-8e36-8a1102f26a4b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:12:28.046638 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d0b29bd4-b6dd-47f5-8e36-8a1102f26a4b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:12:28.052802 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d0b29bd4-b6dd-47f5-8e36-8a1102f26a4b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:12:28.053286 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d0b29bd4-b6dd-47f5-8e36-8a1102f26a4b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:12:28.053725 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d0b29bd4-b6dd-47f5-8e36-8a1102f26a4b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:12:28.054448 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d0b29bd4-b6dd-47f5-8e36-8a1102f26a4b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:12:28.054916 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d0b29bd4-b6dd-47f5-8e36-8a1102f26a4b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:12:28.055370 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d0b29bd4-b6dd-47f5-8e36-8a1102f26a4b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:12:28.185923 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d0b29bd4-b6dd-47f5-8e36-8a1102f26a4b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:12:28.193849 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d0b29bd4-b6dd-47f5-8e36-8a1102f26a4b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0" status: 200 len: 1450 microversion: 2.1 time: 0.153111 Oct 27 04:12:28.194459 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3401/7089] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:12:28 2022] GET /compute/v2.1/servers/0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0 => generated 1450 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:12:28.217001 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-641dd1ca-2a14-4332-a73c-cb74fe69eba2 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:12:28.217620 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-641dd1ca-2a14-4332-a73c-cb74fe69eba2 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:12:28.224491 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-641dd1ca-2a14-4332-a73c-cb74fe69eba2 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:12:28.224984 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-641dd1ca-2a14-4332-a73c-cb74fe69eba2 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:12:28.225438 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-641dd1ca-2a14-4332-a73c-cb74fe69eba2 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:12:28.226181 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-641dd1ca-2a14-4332-a73c-cb74fe69eba2 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:12:28.226651 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-641dd1ca-2a14-4332-a73c-cb74fe69eba2 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:12:28.227101 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-641dd1ca-2a14-4332-a73c-cb74fe69eba2 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:12:28.354537 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-641dd1ca-2a14-4332-a73c-cb74fe69eba2 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:12:28.362264 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-641dd1ca-2a14-4332-a73c-cb74fe69eba2 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0" status: 200 len: 1450 microversion: 2.1 time: 0.149152 Oct 27 04:12:28.362839 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3689/7090] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:12:28 2022] GET /compute/v2.1/servers/0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0 => generated 1450 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:12:30.372512 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-a6ef8aae-c17a-4367-b935-112ce9f10518 req-e975fdb4-0274-4b78-a6a4-94eb4c00cc2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0", "tag": "5fa92ab3-c5c6-44fc-8bc7-41184ae29c87"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:12:30.382287 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-a6ef8aae-c17a-4367-b935-112ce9f10518 req-e975fdb4-0274-4b78-a6a4-94eb4c00cc2d service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:12:30.382799 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-a6ef8aae-c17a-4367-b935-112ce9f10518 req-e975fdb4-0274-4b78-a6a4-94eb4c00cc2d service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:12:30.383231 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-a6ef8aae-c17a-4367-b935-112ce9f10518 req-e975fdb4-0274-4b78-a6a4-94eb4c00cc2d service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:12:30.395342 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-a6ef8aae-c17a-4367-b935-112ce9f10518 req-e975fdb4-0274-4b78-a6a4-94eb4c00cc2d service nova] Creating event network-changed:5fa92ab3-c5c6-44fc-8bc7-41184ae29c87 for instance 0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0 on n-h1-862769-1 Oct 27 04:12:30.401191 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-a6ef8aae-c17a-4367-b935-112ce9f10518 req-e975fdb4-0274-4b78-a6a4-94eb4c00cc2d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100793 Oct 27 04:12:30.401901 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3402/7091] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:12:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:14:56.796428 n-d-862769-1 devstack@n-api.service[121001]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5b59dcc8-77e8-4f93-abf1-649e725dfb1c] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 27 04:14:56.797566 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=30 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:14:56.798415 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=66 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:14:56.799168 n-d-862769-1 devstack@n-api.service[121001]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 04:14:56.799312 n-d-862769-1 devstack@n-api.service[121001]: Thu Oct 27 04:14:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0 (ip 10.222.0.20) !!! Oct 27 04:14:56.801221 n-d-862769-1 devstack@n-api.service[121001]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 04:14:56.801362 n-d-862769-1 devstack@n-api.service[121001]: Thu Oct 27 04:14:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0 (ip 10.222.0.20) !!! Oct 27 04:14:56.802323 n-d-862769-1 devstack@n-api.service[121001]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 04:14:56.802432 n-d-862769-1 devstack@n-api.service[121001]: Thu Oct 27 04:14:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0 (ip 10.222.0.20) !!! Oct 27 04:14:56.807757 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2296f6ca-a1a7-408e-8ccd-9a0fb6e093e7 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:14:56.808267 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2296f6ca-a1a7-408e-8ccd-9a0fb6e093e7 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:14:56.817169 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2296f6ca-a1a7-408e-8ccd-9a0fb6e093e7 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:14:56.817674 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2296f6ca-a1a7-408e-8ccd-9a0fb6e093e7 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:14:56.818167 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2296f6ca-a1a7-408e-8ccd-9a0fb6e093e7 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:14:56.818881 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2296f6ca-a1a7-408e-8ccd-9a0fb6e093e7 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:14:56.819350 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2296f6ca-a1a7-408e-8ccd-9a0fb6e093e7 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:14:56.819793 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2296f6ca-a1a7-408e-8ccd-9a0fb6e093e7 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:14:56.850609 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2296f6ca-a1a7-408e-8ccd-9a0fb6e093e7 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0] Going to try to terminate instance {{(pid=121001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 04:14:57.076839 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2296f6ca-a1a7-408e-8ccd-9a0fb6e093e7 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0" status: 204 len: 0 microversion: 2.1 time: 0.282021 Oct 27 04:14:57.077491 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3690/7092] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 04:14:56 2022] DELETE /compute/v2.1/servers/0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 04:14:57.084230 n-d-862769-1 devstack@n-api.service[121000]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a40cf960-ae63-4112-9db5-88668ecbbc6d] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 27 04:14:57.086637 n-d-862769-1 devstack@n-api.service[121000]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5ec0dfad-6f0c-4686-8a67-f02607adfe50] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 27 04:14:57.086637 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:14:57.086637 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=56 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:14:57.088045 n-d-862769-1 devstack@n-api.service[121000]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 27 04:14:57.088191 n-d-862769-1 devstack@n-api.service[121000]: Thu Oct 27 04:14:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0 (ip 10.222.0.20) !!! Oct 27 04:14:57.089338 n-d-862769-1 devstack@n-api.service[121000]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 04:14:57.089459 n-d-862769-1 devstack@n-api.service[121000]: Thu Oct 27 04:14:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0 (ip 10.222.0.20) !!! Oct 27 04:14:57.095609 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2fc999d7-0be5-4328-aea4-171812ad3b32 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:14:57.096371 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-2fc999d7-0be5-4328-aea4-171812ad3b32 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:14:57.105952 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2fc999d7-0be5-4328-aea4-171812ad3b32 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:14:57.106479 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2fc999d7-0be5-4328-aea4-171812ad3b32 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:14:57.106920 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2fc999d7-0be5-4328-aea4-171812ad3b32 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:14:57.107625 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2fc999d7-0be5-4328-aea4-171812ad3b32 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:14:57.108089 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2fc999d7-0be5-4328-aea4-171812ad3b32 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:14:57.108523 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2fc999d7-0be5-4328-aea4-171812ad3b32 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:14:57.241211 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2fc999d7-0be5-4328-aea4-171812ad3b32 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:14:57.249484 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2fc999d7-0be5-4328-aea4-171812ad3b32 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0" status: 200 len: 1575 microversion: 2.1 time: 0.167360 Oct 27 04:14:57.250072 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3403/7093] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:14:57 2022] GET /compute/v2.1/servers/0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0 => generated 1575 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:14:58.273635 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-02a690d2-e234-4fff-b11f-68583b16b6df tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:14:58.274401 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-02a690d2-e234-4fff-b11f-68583b16b6df tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:14:58.282699 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-02a690d2-e234-4fff-b11f-68583b16b6df tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:14:58.283195 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-02a690d2-e234-4fff-b11f-68583b16b6df tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:14:58.283647 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-02a690d2-e234-4fff-b11f-68583b16b6df tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:14:58.284391 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-02a690d2-e234-4fff-b11f-68583b16b6df tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:14:58.284864 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-02a690d2-e234-4fff-b11f-68583b16b6df tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:14:58.285307 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-02a690d2-e234-4fff-b11f-68583b16b6df tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:14:58.292984 n-d-862769-1 devstack@n-api.service[121001]: INFO oslo.messaging._drivers.impl_rabbit [-] [5b59dcc8-77e8-4f93-abf1-649e725dfb1c] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 54164. Oct 27 04:14:58.418467 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-02a690d2-e234-4fff-b11f-68583b16b6df tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:14:58.426243 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-02a690d2-e234-4fff-b11f-68583b16b6df tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0" status: 200 len: 1575 microversion: 2.1 time: 0.156868 Oct 27 04:14:58.426834 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3691/7094] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:14:58 2022] GET /compute/v2.1/servers/0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0 => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:14:59.449505 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f50b7c14-4f6c-49d2-b15d-6a828c58c558 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:14:59.450093 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f50b7c14-4f6c-49d2-b15d-6a828c58c558 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:14:59.463374 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f50b7c14-4f6c-49d2-b15d-6a828c58c558 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:14:59.463965 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f50b7c14-4f6c-49d2-b15d-6a828c58c558 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:14:59.464491 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f50b7c14-4f6c-49d2-b15d-6a828c58c558 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:14:59.465405 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f50b7c14-4f6c-49d2-b15d-6a828c58c558 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:14:59.465863 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f50b7c14-4f6c-49d2-b15d-6a828c58c558 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:14:59.466321 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f50b7c14-4f6c-49d2-b15d-6a828c58c558 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:14:59.494408 n-d-862769-1 devstack@n-api.service[121000]: INFO oslo.messaging._drivers.impl_rabbit [-] [5ec0dfad-6f0c-4686-8a67-f02607adfe50] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 54172. Oct 27 04:14:59.495325 n-d-862769-1 devstack@n-api.service[121000]: INFO oslo.messaging._drivers.impl_rabbit [-] [a40cf960-ae63-4112-9db5-88668ecbbc6d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 54170. Oct 27 04:14:59.858322 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f50b7c14-4f6c-49d2-b15d-6a828c58c558 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:14:59.866577 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f50b7c14-4f6c-49d2-b15d-6a828c58c558 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0" status: 200 len: 1508 microversion: 2.1 time: 0.421630 Oct 27 04:14:59.867178 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3404/7095] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:14:59 2022] GET /compute/v2.1/servers/0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0 => generated 1508 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:15:00.041968 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-3b6cfe79-1425-4d3f-913b-d2f3245c3730 req-405422a1-99a7-45db-b424-86ea1d184ad7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0", "name": "network-vif-deleted", "tag": "5fa92ab3-c5c6-44fc-8bc7-41184ae29c87"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:15:00.052910 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-3b6cfe79-1425-4d3f-913b-d2f3245c3730 req-405422a1-99a7-45db-b424-86ea1d184ad7 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:15:00.054116 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-3b6cfe79-1425-4d3f-913b-d2f3245c3730 req-405422a1-99a7-45db-b424-86ea1d184ad7 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:15:00.054116 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-3b6cfe79-1425-4d3f-913b-d2f3245c3730 req-405422a1-99a7-45db-b424-86ea1d184ad7 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:15:00.065606 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-3b6cfe79-1425-4d3f-913b-d2f3245c3730 req-405422a1-99a7-45db-b424-86ea1d184ad7 service nova] Creating event network-vif-deleted:5fa92ab3-c5c6-44fc-8bc7-41184ae29c87 for instance 0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0 on n-h1-862769-1 Oct 27 04:15:00.070774 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-3b6cfe79-1425-4d3f-913b-d2f3245c3730 req-405422a1-99a7-45db-b424-86ea1d184ad7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032627 Oct 27 04:15:00.071387 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3692/7096] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:15:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 04:15:00.891294 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-17659fd0-b3cf-4498-a1a0-760f9f841825 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:15:00.892074 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-17659fd0-b3cf-4498-a1a0-760f9f841825 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:15:00.898797 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-17659fd0-b3cf-4498-a1a0-760f9f841825 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:15:00.899370 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-17659fd0-b3cf-4498-a1a0-760f9f841825 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:15:00.900009 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-17659fd0-b3cf-4498-a1a0-760f9f841825 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:15:00.901359 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-17659fd0-b3cf-4498-a1a0-760f9f841825 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:15:00.901359 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-17659fd0-b3cf-4498-a1a0-760f9f841825 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:15:00.903223 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-17659fd0-b3cf-4498-a1a0-760f9f841825 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:15:00.973534 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-17659fd0-b3cf-4498-a1a0-760f9f841825 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:15:00.982408 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-17659fd0-b3cf-4498-a1a0-760f9f841825 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0" status: 200 len: 1223 microversion: 2.1 time: 0.095267 Oct 27 04:15:00.983016 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3405/7097] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:15:00 2022] GET /compute/v2.1/servers/0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0 => generated 1223 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:15:02.007480 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b953b5ae-5152-47d8-adc5-28e5821ea3ac tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:15:02.008368 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b953b5ae-5152-47d8-adc5-28e5821ea3ac tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:15:02.015286 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b953b5ae-5152-47d8-adc5-28e5821ea3ac tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:15:02.015795 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b953b5ae-5152-47d8-adc5-28e5821ea3ac tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:15:02.016261 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b953b5ae-5152-47d8-adc5-28e5821ea3ac tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:15:02.016983 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b953b5ae-5152-47d8-adc5-28e5821ea3ac tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:15:02.017470 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b953b5ae-5152-47d8-adc5-28e5821ea3ac tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:15:02.017923 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b953b5ae-5152-47d8-adc5-28e5821ea3ac tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:15:02.084396 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b953b5ae-5152-47d8-adc5-28e5821ea3ac tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:15:02.092329 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b953b5ae-5152-47d8-adc5-28e5821ea3ac tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0" status: 200 len: 1223 microversion: 2.1 time: 0.090218 Oct 27 04:15:02.092908 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3693/7098] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:15:02 2022] GET /compute/v2.1/servers/0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0 => generated 1223 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:15:03.115038 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8f28824e-9728-4632-8389-28888f6eaa12 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:15:03.115666 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8f28824e-9728-4632-8389-28888f6eaa12 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:15:03.122742 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8f28824e-9728-4632-8389-28888f6eaa12 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:15:03.123233 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8f28824e-9728-4632-8389-28888f6eaa12 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:15:03.123674 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8f28824e-9728-4632-8389-28888f6eaa12 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:15:03.124380 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8f28824e-9728-4632-8389-28888f6eaa12 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:15:03.124844 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8f28824e-9728-4632-8389-28888f6eaa12 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:15:03.125277 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8f28824e-9728-4632-8389-28888f6eaa12 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:15:03.188970 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8f28824e-9728-4632-8389-28888f6eaa12 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:15:03.200909 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8f28824e-9728-4632-8389-28888f6eaa12 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0" status: 200 len: 1223 microversion: 2.1 time: 0.089727 Oct 27 04:15:03.201503 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3406/7099] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:15:03 2022] GET /compute/v2.1/servers/0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0 => generated 1223 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:15:04.229724 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d27a4302-177a-4ec1-aa50-e1d263d45124 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:15:04.230410 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d27a4302-177a-4ec1-aa50-e1d263d45124 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:15:04.237607 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d27a4302-177a-4ec1-aa50-e1d263d45124 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:15:04.238178 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d27a4302-177a-4ec1-aa50-e1d263d45124 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:15:04.238654 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d27a4302-177a-4ec1-aa50-e1d263d45124 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:15:04.239408 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d27a4302-177a-4ec1-aa50-e1d263d45124 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:15:04.239897 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d27a4302-177a-4ec1-aa50-e1d263d45124 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:15:04.240356 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d27a4302-177a-4ec1-aa50-e1d263d45124 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:15:04.304671 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d27a4302-177a-4ec1-aa50-e1d263d45124 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:15:04.312562 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d27a4302-177a-4ec1-aa50-e1d263d45124 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0" status: 200 len: 1223 microversion: 2.1 time: 0.087551 Oct 27 04:15:04.313341 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3694/7100] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:15:04 2022] GET /compute/v2.1/servers/0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0 => generated 1223 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:15:05.335199 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ac4a0b7d-9868-4e01-9845-6d4a54de7515 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:15:05.335818 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ac4a0b7d-9868-4e01-9845-6d4a54de7515 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:15:05.343226 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ac4a0b7d-9868-4e01-9845-6d4a54de7515 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:15:05.343713 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ac4a0b7d-9868-4e01-9845-6d4a54de7515 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:15:05.344152 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ac4a0b7d-9868-4e01-9845-6d4a54de7515 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:15:05.344847 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ac4a0b7d-9868-4e01-9845-6d4a54de7515 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:15:05.345305 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ac4a0b7d-9868-4e01-9845-6d4a54de7515 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:15:05.345731 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ac4a0b7d-9868-4e01-9845-6d4a54de7515 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:15:05.358879 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-ac4a0b7d-9868-4e01-9845-6d4a54de7515 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] HTTP exception thrown: Instance 0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0 could not be found. Oct 27 04:15:05.360514 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ac4a0b7d-9868-4e01-9845-6d4a54de7515 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Request method failure captured: Oct 27 04:15:05.360514 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0 HTTP/1.1 Oct 27 04:15:05.360514 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 04:15:05.360514 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 04:15:05.360514 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 04:15:05.360514 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 04:15:05.360514 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 04:15:05.360514 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 04:15:05.360514 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 04:15:05.360514 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 04:15:05.360514 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWgOy2vyGIZvCPgeKqR-dxD7jsV8GSZftvWG3pi0psQTYPv81ATvFSgHi31EMgn0x5NItteNYikimeQ9zcCw_dYQg7rFsVn9VSH-YqZAmUJa-ncyxVumv4r6CMnFhSrRbs_K6XB3pjXRcA1nWSk0V8vccKKBeZUitsa2lCn2gYQAw5hI Oct 27 04:15:05.360514 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 04:15:05.360514 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 04:15:05.360514 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 04:15:05.360514 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 04:15:05.360514 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 04:15:05.360514 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 04:15:05.360514 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 6a6a4f0161c94dc19682d70af00ba684 Oct 27 04:15:05.360514 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-TestVolumeBootPattern-1489988074 Oct 27 04:15:05.360514 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 04:15:05.360514 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 04:15:05.360514 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6a6a4f0161c94dc19682d70af00ba684"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6a6a4f0161c94dc19682d70af00ba684"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6a6a4f0161c94dc19682d70af00ba684"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6a6a4f0161c94dc19682d70af00ba684"}]}] Oct 27 04:15:05.360514 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-TestVolumeBootPattern-1489988074 Oct 27 04:15:05.360514 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 6a6a4f0161c94dc19682d70af00ba684 Oct 27 04:15:05.360514 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-TestVolumeBootPattern-1489988074 Oct 27 04:15:05.360514 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-TestVolumeBootPattern-1489988074-project Oct 27 04:15:05.360514 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 04:15:05.360514 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 04:15:05.360514 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: b7f5c179e8844542bca46d76042a6897 Oct 27 04:15:05.360514 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-TestVolumeBootPattern-1489988074-project Oct 27 04:15:05.360514 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 04:15:05.360514 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0 could not be found. Oct 27 04:15:05.360514 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0'} Oct 27 04:15:05.360514 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 04:15:05.360514 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:15:05.360514 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 04:15:05.360514 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 04:15:05.360514 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 04:15:05.360514 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 04:15:05.360514 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 04:15:05.360514 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 04:15:05.360514 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 04:15:05.360514 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 04:15:05.360514 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0 could not be found. Oct 27 04:15:05.360514 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:15:05.360514 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:15:05.360514 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:15:05.360514 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:15:05.360514 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:15:05.360514 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:15:05.360514 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 04:15:05.360514 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 04:15:05.360514 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 04:15:05.360514 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 04:15:05.360514 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 04:15:05.360514 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 04:15:05.360514 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 04:15:05.360514 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 04:15:05.360514 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 04:15:05.360514 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 04:15:05.360514 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0 could not be found. Oct 27 04:15:05.360514 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:15:05.360514 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:15:05.360514 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:15:05.364905 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:15:05.364905 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:15:05.364905 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:15:05.364905 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 04:15:05.364905 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 04:15:05.364905 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0 could not be found. Oct 27 04:15:05.364905 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:15:05.364905 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ac4a0b7d-9868-4e01-9845-6d4a54de7515 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Returning 404 to user: Instance 0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 04:15:05.364905 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ac4a0b7d-9868-4e01-9845-6d4a54de7515 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0" status: 404 len: 111 microversion: 2.1 time: 0.030914 Oct 27 04:15:05.364905 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3407/7101] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:15:05 2022] GET /compute/v2.1/servers/0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 04:15:05.410589 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1097ecdd-025f-4ae5-8887-549c1199a0ec tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-824906824", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-784919494", "security_groups": [{"name": "tempest-secgroup-smoke-514301289"}], "block_device_mapping_v2": [{"uuid": "71480df3-b176-461e-8b3b-852ae36c25fd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b49d136e-c9db-4b4f-8210-57f6cfd2ff95"}]}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:15:05.523590 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.network.neutron [None req-1097ecdd-025f-4ae5-8887-549c1199a0ec tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] validate_networks() for [('b49d136e-c9db-4b4f-8210-57f6cfd2ff95', None, None, None, None, None)] {{(pid=121001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 04:15:05.954307 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-1097ecdd-025f-4ae5-8887-549c1199a0ec tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Flavor limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 04:15:05.954781 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-1097ecdd-025f-4ae5-8887-549c1199a0ec tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Image limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 04:15:05.955278 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-1097ecdd-025f-4ae5-8887-549c1199a0ec tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Flavor pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 04:15:05.955737 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-1097ecdd-025f-4ae5-8887-549c1199a0ec tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Image pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 04:15:05.956351 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-1097ecdd-025f-4ae5-8887-549c1199a0ec tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 04:15:05.965493 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1097ecdd-025f-4ae5-8887-549c1199a0ec tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:15:05.966007 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1097ecdd-025f-4ae5-8887-549c1199a0ec tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:15:05.966503 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1097ecdd-025f-4ae5-8887-549c1199a0ec tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:15:05.967259 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1097ecdd-025f-4ae5-8887-549c1199a0ec tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:15:05.967753 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1097ecdd-025f-4ae5-8887-549c1199a0ec tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:15:05.968189 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1097ecdd-025f-4ae5-8887-549c1199a0ec tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:15:05.984908 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-1097ecdd-025f-4ae5-8887-549c1199a0ec tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Getting quotas for project 6a6a4f0161c94dc19682d70af00ba684. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 04:15:05.990180 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-1097ecdd-025f-4ae5-8887-549c1199a0ec tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Getting quotas for user b7f5c179e8844542bca46d76042a6897 and project 6a6a4f0161c94dc19682d70af00ba684. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 04:15:06.048119 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1097ecdd-025f-4ae5-8887-549c1199a0ec tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Going to run 1 instances... {{(pid=121001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 04:15:06.053270 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1097ecdd-025f-4ae5-8887-549c1199a0ec tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: b5db0af3-0257-46be-aa65-5bdc9bc28af8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='71480df3-b176-461e-8b3b-852ae36c25fd',volume_size=None,volume_type=None)] {{(pid=121001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 04:15:06.443238 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1097ecdd-025f-4ae5-8887-549c1199a0ec tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.036530 Oct 27 04:15:06.443913 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3695/7102] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 04:15:05 2022] POST /compute/v2.1/servers => generated 405 bytes in 1038 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 04:15:06.455140 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-35564b55-65ba-4b38-b1ab-1e6e4578c761 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:15:06.455766 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-35564b55-65ba-4b38-b1ab-1e6e4578c761 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: b5db0af3-0257-46be-aa65-5bdc9bc28af8] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:15:06.512941 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-35564b55-65ba-4b38-b1ab-1e6e4578c761 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:15:06.520837 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-35564b55-65ba-4b38-b1ab-1e6e4578c761 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/b5db0af3-0257-46be-aa65-5bdc9bc28af8" status: 200 len: 1093 microversion: 2.1 time: 0.069743 Oct 27 04:15:06.521400 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3408/7103] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:15:06 2022] GET /compute/v2.1/servers/b5db0af3-0257-46be-aa65-5bdc9bc28af8 => generated 1093 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:15:07.544689 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-477fb159-d131-4915-ba2b-0ef42ca0c5ef tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:15:07.545331 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-477fb159-d131-4915-ba2b-0ef42ca0c5ef tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: b5db0af3-0257-46be-aa65-5bdc9bc28af8] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:15:07.597541 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-477fb159-d131-4915-ba2b-0ef42ca0c5ef tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:15:07.605003 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-477fb159-d131-4915-ba2b-0ef42ca0c5ef tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/b5db0af3-0257-46be-aa65-5bdc9bc28af8" status: 200 len: 1093 microversion: 2.1 time: 0.065145 Oct 27 04:15:07.605573 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3696/7104] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:15:07 2022] GET /compute/v2.1/servers/b5db0af3-0257-46be-aa65-5bdc9bc28af8 => generated 1093 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:15:08.627114 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-95ee6d58-db04-4565-88c6-b6272c1d8f4a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:15:08.627866 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-95ee6d58-db04-4565-88c6-b6272c1d8f4a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: b5db0af3-0257-46be-aa65-5bdc9bc28af8] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:15:08.682239 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-95ee6d58-db04-4565-88c6-b6272c1d8f4a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:15:08.689539 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-95ee6d58-db04-4565-88c6-b6272c1d8f4a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/b5db0af3-0257-46be-aa65-5bdc9bc28af8" status: 200 len: 1093 microversion: 2.1 time: 0.066167 Oct 27 04:15:08.690154 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3409/7105] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:15:08 2022] GET /compute/v2.1/servers/b5db0af3-0257-46be-aa65-5bdc9bc28af8 => generated 1093 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:15:09.712946 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3ce4b6eb-5ab1-4803-aab5-c33eacd29ef8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:15:09.713589 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3ce4b6eb-5ab1-4803-aab5-c33eacd29ef8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: b5db0af3-0257-46be-aa65-5bdc9bc28af8] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:15:09.770362 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3ce4b6eb-5ab1-4803-aab5-c33eacd29ef8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:15:09.777267 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3ce4b6eb-5ab1-4803-aab5-c33eacd29ef8 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/b5db0af3-0257-46be-aa65-5bdc9bc28af8" status: 200 len: 1093 microversion: 2.1 time: 0.068245 Oct 27 04:15:09.777842 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3697/7106] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:15:09 2022] GET /compute/v2.1/servers/b5db0af3-0257-46be-aa65-5bdc9bc28af8 => generated 1093 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:15:10.800530 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-331354aa-3dd9-4e9c-ba8e-2bf2a2c1f4f4 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:15:10.801236 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-331354aa-3dd9-4e9c-ba8e-2bf2a2c1f4f4 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: b5db0af3-0257-46be-aa65-5bdc9bc28af8] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:15:10.808609 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-331354aa-3dd9-4e9c-ba8e-2bf2a2c1f4f4 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:15:10.809094 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-331354aa-3dd9-4e9c-ba8e-2bf2a2c1f4f4 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:15:10.809533 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-331354aa-3dd9-4e9c-ba8e-2bf2a2c1f4f4 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:15:10.810258 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-331354aa-3dd9-4e9c-ba8e-2bf2a2c1f4f4 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:15:10.810721 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-331354aa-3dd9-4e9c-ba8e-2bf2a2c1f4f4 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:15:10.811152 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-331354aa-3dd9-4e9c-ba8e-2bf2a2c1f4f4 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:15:10.870719 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-331354aa-3dd9-4e9c-ba8e-2bf2a2c1f4f4 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:15:10.878301 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-331354aa-3dd9-4e9c-ba8e-2bf2a2c1f4f4 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/b5db0af3-0257-46be-aa65-5bdc9bc28af8" status: 200 len: 1143 microversion: 2.1 time: 0.081678 Oct 27 04:15:10.878864 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3410/7107] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:15:10 2022] GET /compute/v2.1/servers/b5db0af3-0257-46be-aa65-5bdc9bc28af8 => generated 1143 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:15:11.900698 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0a9cb1e3-b1cb-481a-84d7-db2bea094e26 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:15:11.901361 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0a9cb1e3-b1cb-481a-84d7-db2bea094e26 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: b5db0af3-0257-46be-aa65-5bdc9bc28af8] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:15:11.908142 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0a9cb1e3-b1cb-481a-84d7-db2bea094e26 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:15:11.908639 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0a9cb1e3-b1cb-481a-84d7-db2bea094e26 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:15:11.909092 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0a9cb1e3-b1cb-481a-84d7-db2bea094e26 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:15:11.909796 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0a9cb1e3-b1cb-481a-84d7-db2bea094e26 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:15:11.910300 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0a9cb1e3-b1cb-481a-84d7-db2bea094e26 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:15:11.910743 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0a9cb1e3-b1cb-481a-84d7-db2bea094e26 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:15:11.976216 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0a9cb1e3-b1cb-481a-84d7-db2bea094e26 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:15:11.984087 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0a9cb1e3-b1cb-481a-84d7-db2bea094e26 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/b5db0af3-0257-46be-aa65-5bdc9bc28af8" status: 200 len: 1191 microversion: 2.1 time: 0.087247 Oct 27 04:15:11.984665 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3698/7108] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:15:11 2022] GET /compute/v2.1/servers/b5db0af3-0257-46be-aa65-5bdc9bc28af8 => generated 1191 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:15:13.009343 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-488a9bea-90c3-469c-8dcc-f596673df089 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:15:13.012453 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-488a9bea-90c3-469c-8dcc-f596673df089 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: b5db0af3-0257-46be-aa65-5bdc9bc28af8] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:15:13.019920 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-488a9bea-90c3-469c-8dcc-f596673df089 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:15:13.020448 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-488a9bea-90c3-469c-8dcc-f596673df089 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:15:13.020983 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-488a9bea-90c3-469c-8dcc-f596673df089 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:15:13.021795 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-488a9bea-90c3-469c-8dcc-f596673df089 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:15:13.022572 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-488a9bea-90c3-469c-8dcc-f596673df089 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:15:13.023384 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-488a9bea-90c3-469c-8dcc-f596673df089 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:15:13.196205 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-488a9bea-90c3-469c-8dcc-f596673df089 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:15:13.206271 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-488a9bea-90c3-469c-8dcc-f596673df089 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/b5db0af3-0257-46be-aa65-5bdc9bc28af8" status: 200 len: 1276 microversion: 2.1 time: 0.201672 Oct 27 04:15:13.207190 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3411/7109] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:15:13 2022] GET /compute/v2.1/servers/b5db0af3-0257-46be-aa65-5bdc9bc28af8 => generated 1276 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:15:14.055389 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-ad9eca0a-dbc0-4af8-b1ad-9dce90076d85 req-3ca3a175-f7e4-497c-b57e-066f8429db12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5db0af3-0257-46be-aa65-5bdc9bc28af8", "tag": "c541288e-bc2b-43cb-b3d8-781010214c9d"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:15:14.068172 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-ad9eca0a-dbc0-4af8-b1ad-9dce90076d85 req-3ca3a175-f7e4-497c-b57e-066f8429db12 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:15:14.068690 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-ad9eca0a-dbc0-4af8-b1ad-9dce90076d85 req-3ca3a175-f7e4-497c-b57e-066f8429db12 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:15:14.069162 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-ad9eca0a-dbc0-4af8-b1ad-9dce90076d85 req-3ca3a175-f7e4-497c-b57e-066f8429db12 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:15:14.081609 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-ad9eca0a-dbc0-4af8-b1ad-9dce90076d85 req-3ca3a175-f7e4-497c-b57e-066f8429db12 service nova] Creating event network-changed:c541288e-bc2b-43cb-b3d8-781010214c9d for instance b5db0af3-0257-46be-aa65-5bdc9bc28af8 on n-h2-862769-1 Oct 27 04:15:14.088236 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-ad9eca0a-dbc0-4af8-b1ad-9dce90076d85 req-3ca3a175-f7e4-497c-b57e-066f8429db12 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037149 Oct 27 04:15:14.093087 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3699/7110] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:15:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:15:14.230945 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0b095d05-60a8-4321-922e-904120486396 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:15:14.232295 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0b095d05-60a8-4321-922e-904120486396 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: b5db0af3-0257-46be-aa65-5bdc9bc28af8] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:15:14.239686 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0b095d05-60a8-4321-922e-904120486396 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:15:14.240466 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0b095d05-60a8-4321-922e-904120486396 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:15:14.241142 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0b095d05-60a8-4321-922e-904120486396 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:15:14.242091 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0b095d05-60a8-4321-922e-904120486396 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:15:14.242949 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0b095d05-60a8-4321-922e-904120486396 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:15:14.243592 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0b095d05-60a8-4321-922e-904120486396 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:15:14.469408 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0b095d05-60a8-4321-922e-904120486396 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:15:14.486007 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0b095d05-60a8-4321-922e-904120486396 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/b5db0af3-0257-46be-aa65-5bdc9bc28af8" status: 200 len: 1276 microversion: 2.1 time: 0.259564 Oct 27 04:15:14.501773 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3412/7111] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:15:14 2022] GET /compute/v2.1/servers/b5db0af3-0257-46be-aa65-5bdc9bc28af8 => generated 1276 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 04:15:15.510631 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f00b0bd7-2478-4ee5-b7da-c7330d6c0b32 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:15:15.511362 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f00b0bd7-2478-4ee5-b7da-c7330d6c0b32 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: b5db0af3-0257-46be-aa65-5bdc9bc28af8] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:15:15.517975 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f00b0bd7-2478-4ee5-b7da-c7330d6c0b32 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:15:15.518535 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f00b0bd7-2478-4ee5-b7da-c7330d6c0b32 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:15:15.518995 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f00b0bd7-2478-4ee5-b7da-c7330d6c0b32 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:15:15.519730 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f00b0bd7-2478-4ee5-b7da-c7330d6c0b32 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:15:15.520202 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f00b0bd7-2478-4ee5-b7da-c7330d6c0b32 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:15:15.520648 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f00b0bd7-2478-4ee5-b7da-c7330d6c0b32 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:15:15.656511 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f00b0bd7-2478-4ee5-b7da-c7330d6c0b32 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:15:15.664920 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f00b0bd7-2478-4ee5-b7da-c7330d6c0b32 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/b5db0af3-0257-46be-aa65-5bdc9bc28af8" status: 200 len: 1276 microversion: 2.1 time: 0.159728 Oct 27 04:15:15.665606 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3700/7112] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:15:15 2022] GET /compute/v2.1/servers/b5db0af3-0257-46be-aa65-5bdc9bc28af8 => generated 1276 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:15:16.689084 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f9e440b8-703c-4401-b373-b954c2addab7 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:15:16.689790 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f9e440b8-703c-4401-b373-b954c2addab7 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: b5db0af3-0257-46be-aa65-5bdc9bc28af8] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:15:16.696899 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f9e440b8-703c-4401-b373-b954c2addab7 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:15:16.697394 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f9e440b8-703c-4401-b373-b954c2addab7 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:15:16.697847 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f9e440b8-703c-4401-b373-b954c2addab7 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:15:16.698592 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f9e440b8-703c-4401-b373-b954c2addab7 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:15:16.699112 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f9e440b8-703c-4401-b373-b954c2addab7 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:15:16.699551 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f9e440b8-703c-4401-b373-b954c2addab7 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:15:16.838220 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f9e440b8-703c-4401-b373-b954c2addab7 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:15:16.845996 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f9e440b8-703c-4401-b373-b954c2addab7 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/b5db0af3-0257-46be-aa65-5bdc9bc28af8" status: 200 len: 1276 microversion: 2.1 time: 0.161005 Oct 27 04:15:16.846612 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3413/7113] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:15:16 2022] GET /compute/v2.1/servers/b5db0af3-0257-46be-aa65-5bdc9bc28af8 => generated 1276 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:15:17.868950 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3da0d841-3bd0-4125-860c-f76a815736e1 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:15:17.870128 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3da0d841-3bd0-4125-860c-f76a815736e1 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: b5db0af3-0257-46be-aa65-5bdc9bc28af8] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:15:17.872134 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:15:17.877813 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3da0d841-3bd0-4125-860c-f76a815736e1 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:15:17.878370 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3da0d841-3bd0-4125-860c-f76a815736e1 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:15:17.878842 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3da0d841-3bd0-4125-860c-f76a815736e1 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:15:17.879566 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3da0d841-3bd0-4125-860c-f76a815736e1 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:15:17.880045 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3da0d841-3bd0-4125-860c-f76a815736e1 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:15:17.880497 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3da0d841-3bd0-4125-860c-f76a815736e1 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:15:18.016215 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3da0d841-3bd0-4125-860c-f76a815736e1 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:15:18.024045 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3da0d841-3bd0-4125-860c-f76a815736e1 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/b5db0af3-0257-46be-aa65-5bdc9bc28af8" status: 200 len: 1276 microversion: 2.1 time: 0.159164 Oct 27 04:15:18.024622 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3701/7114] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:15:17 2022] GET /compute/v2.1/servers/b5db0af3-0257-46be-aa65-5bdc9bc28af8 => generated 1276 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:15:19.046656 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-35f0e9bd-8d5c-4fce-8f54-66b9eaca6be4 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:15:19.047279 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-35f0e9bd-8d5c-4fce-8f54-66b9eaca6be4 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: b5db0af3-0257-46be-aa65-5bdc9bc28af8] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:15:19.050018 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=4 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:15:19.054869 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-35f0e9bd-8d5c-4fce-8f54-66b9eaca6be4 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:15:19.055391 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-35f0e9bd-8d5c-4fce-8f54-66b9eaca6be4 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:15:19.055844 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-35f0e9bd-8d5c-4fce-8f54-66b9eaca6be4 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:15:19.056542 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-35f0e9bd-8d5c-4fce-8f54-66b9eaca6be4 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:15:19.057049 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-35f0e9bd-8d5c-4fce-8f54-66b9eaca6be4 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:15:19.057509 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-35f0e9bd-8d5c-4fce-8f54-66b9eaca6be4 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:15:19.190749 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-35f0e9bd-8d5c-4fce-8f54-66b9eaca6be4 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:15:19.199305 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-35f0e9bd-8d5c-4fce-8f54-66b9eaca6be4 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/b5db0af3-0257-46be-aa65-5bdc9bc28af8" status: 200 len: 1264 microversion: 2.1 time: 0.156590 Oct 27 04:15:19.199874 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3414/7115] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:15:19 2022] GET /compute/v2.1/servers/b5db0af3-0257-46be-aa65-5bdc9bc28af8 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:15:20.222548 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7734f7e9-7afb-450b-870d-7be4326183ba tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:15:20.223196 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7734f7e9-7afb-450b-870d-7be4326183ba tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: b5db0af3-0257-46be-aa65-5bdc9bc28af8] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:15:20.225979 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=10 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:15:20.231607 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7734f7e9-7afb-450b-870d-7be4326183ba tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:15:20.232109 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7734f7e9-7afb-450b-870d-7be4326183ba tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:15:20.232574 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7734f7e9-7afb-450b-870d-7be4326183ba tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:15:20.233293 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7734f7e9-7afb-450b-870d-7be4326183ba tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:15:20.233769 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7734f7e9-7afb-450b-870d-7be4326183ba tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:15:20.234265 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7734f7e9-7afb-450b-870d-7be4326183ba tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:15:20.365432 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7734f7e9-7afb-450b-870d-7be4326183ba tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:15:20.373214 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7734f7e9-7afb-450b-870d-7be4326183ba tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/b5db0af3-0257-46be-aa65-5bdc9bc28af8" status: 200 len: 1264 microversion: 2.1 time: 0.154801 Oct 27 04:15:20.373789 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3702/7116] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:15:20 2022] GET /compute/v2.1/servers/b5db0af3-0257-46be-aa65-5bdc9bc28af8 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:15:21.396366 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-45060ffd-5fba-44f9-8676-c7c85e115333 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:15:21.396892 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-45060ffd-5fba-44f9-8676-c7c85e115333 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: b5db0af3-0257-46be-aa65-5bdc9bc28af8] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:15:21.404664 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-45060ffd-5fba-44f9-8676-c7c85e115333 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:15:21.405147 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-45060ffd-5fba-44f9-8676-c7c85e115333 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:15:21.405585 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-45060ffd-5fba-44f9-8676-c7c85e115333 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:15:21.406303 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-45060ffd-5fba-44f9-8676-c7c85e115333 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:15:21.406761 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-45060ffd-5fba-44f9-8676-c7c85e115333 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:15:21.407192 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-45060ffd-5fba-44f9-8676-c7c85e115333 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:15:21.536460 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-45060ffd-5fba-44f9-8676-c7c85e115333 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:15:21.544852 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-45060ffd-5fba-44f9-8676-c7c85e115333 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/b5db0af3-0257-46be-aa65-5bdc9bc28af8" status: 200 len: 1264 microversion: 2.1 time: 0.152496 Oct 27 04:15:21.545428 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3415/7117] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:15:21 2022] GET /compute/v2.1/servers/b5db0af3-0257-46be-aa65-5bdc9bc28af8 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:15:22.567600 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-fbc0953a-c2e2-4b5a-9eed-e02dbe45a6b0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:15:22.568250 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-fbc0953a-c2e2-4b5a-9eed-e02dbe45a6b0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: b5db0af3-0257-46be-aa65-5bdc9bc28af8] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:15:22.575691 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fbc0953a-c2e2-4b5a-9eed-e02dbe45a6b0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:15:22.576201 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fbc0953a-c2e2-4b5a-9eed-e02dbe45a6b0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:15:22.576668 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fbc0953a-c2e2-4b5a-9eed-e02dbe45a6b0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:15:22.577391 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fbc0953a-c2e2-4b5a-9eed-e02dbe45a6b0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:15:22.577872 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fbc0953a-c2e2-4b5a-9eed-e02dbe45a6b0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:15:22.578350 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fbc0953a-c2e2-4b5a-9eed-e02dbe45a6b0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:15:22.709569 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-fbc0953a-c2e2-4b5a-9eed-e02dbe45a6b0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:15:22.717479 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-fbc0953a-c2e2-4b5a-9eed-e02dbe45a6b0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/b5db0af3-0257-46be-aa65-5bdc9bc28af8" status: 200 len: 1264 microversion: 2.1 time: 0.153835 Oct 27 04:15:22.718097 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3703/7118] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:15:22 2022] GET /compute/v2.1/servers/b5db0af3-0257-46be-aa65-5bdc9bc28af8 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:15:23.740762 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5f1502e4-3850-4e10-a24c-dc61c97c4bb1 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:15:23.741413 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5f1502e4-3850-4e10-a24c-dc61c97c4bb1 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: b5db0af3-0257-46be-aa65-5bdc9bc28af8] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:15:23.748889 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5f1502e4-3850-4e10-a24c-dc61c97c4bb1 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:15:23.749381 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5f1502e4-3850-4e10-a24c-dc61c97c4bb1 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:15:23.749821 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5f1502e4-3850-4e10-a24c-dc61c97c4bb1 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:15:23.750554 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5f1502e4-3850-4e10-a24c-dc61c97c4bb1 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:15:23.751014 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5f1502e4-3850-4e10-a24c-dc61c97c4bb1 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:15:23.751448 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5f1502e4-3850-4e10-a24c-dc61c97c4bb1 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:15:23.886772 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5f1502e4-3850-4e10-a24c-dc61c97c4bb1 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:15:23.894467 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5f1502e4-3850-4e10-a24c-dc61c97c4bb1 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/b5db0af3-0257-46be-aa65-5bdc9bc28af8" status: 200 len: 1264 microversion: 2.1 time: 0.157619 Oct 27 04:15:23.895049 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3416/7119] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:15:23 2022] GET /compute/v2.1/servers/b5db0af3-0257-46be-aa65-5bdc9bc28af8 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:15:24.917475 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ade57a06-0077-4f88-a200-2d1a46b659a3 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:15:24.918074 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ade57a06-0077-4f88-a200-2d1a46b659a3 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: b5db0af3-0257-46be-aa65-5bdc9bc28af8] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:15:24.924900 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ade57a06-0077-4f88-a200-2d1a46b659a3 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:15:24.925400 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ade57a06-0077-4f88-a200-2d1a46b659a3 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:15:24.925863 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ade57a06-0077-4f88-a200-2d1a46b659a3 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:15:24.926610 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ade57a06-0077-4f88-a200-2d1a46b659a3 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:15:24.927080 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ade57a06-0077-4f88-a200-2d1a46b659a3 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:15:24.927523 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ade57a06-0077-4f88-a200-2d1a46b659a3 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:15:25.070773 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ade57a06-0077-4f88-a200-2d1a46b659a3 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:15:25.079889 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ade57a06-0077-4f88-a200-2d1a46b659a3 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/b5db0af3-0257-46be-aa65-5bdc9bc28af8" status: 200 len: 1264 microversion: 2.1 time: 0.166878 Oct 27 04:15:25.080491 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3704/7120] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:15:24 2022] GET /compute/v2.1/servers/b5db0af3-0257-46be-aa65-5bdc9bc28af8 => generated 1264 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:15:26.103188 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9161e243-8146-4ca2-b2da-6be521c06258 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:15:26.103837 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9161e243-8146-4ca2-b2da-6be521c06258 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: b5db0af3-0257-46be-aa65-5bdc9bc28af8] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:15:26.111133 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9161e243-8146-4ca2-b2da-6be521c06258 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:15:26.111620 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9161e243-8146-4ca2-b2da-6be521c06258 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:15:26.112059 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9161e243-8146-4ca2-b2da-6be521c06258 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:15:26.112753 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9161e243-8146-4ca2-b2da-6be521c06258 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:15:26.113214 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9161e243-8146-4ca2-b2da-6be521c06258 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:15:26.113638 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9161e243-8146-4ca2-b2da-6be521c06258 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:15:26.243560 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9161e243-8146-4ca2-b2da-6be521c06258 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:15:26.251827 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9161e243-8146-4ca2-b2da-6be521c06258 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/b5db0af3-0257-46be-aa65-5bdc9bc28af8" status: 200 len: 1264 microversion: 2.1 time: 0.152565 Oct 27 04:15:26.252414 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3417/7121] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:15:26 2022] GET /compute/v2.1/servers/b5db0af3-0257-46be-aa65-5bdc9bc28af8 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:15:26.928232 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-49684cb9-0abd-40c6-899e-fe6bbc9856eb req-cd6f0c54-0f92-4760-8485-849ffaee6e9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5db0af3-0257-46be-aa65-5bdc9bc28af8", "name": "network-vif-plugged", "status": "completed", "tag": "c541288e-bc2b-43cb-b3d8-781010214c9d"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:15:26.933832 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:15:26.939065 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-49684cb9-0abd-40c6-899e-fe6bbc9856eb req-cd6f0c54-0f92-4760-8485-849ffaee6e9f service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:15:26.939587 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-49684cb9-0abd-40c6-899e-fe6bbc9856eb req-cd6f0c54-0f92-4760-8485-849ffaee6e9f service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:15:26.940034 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-49684cb9-0abd-40c6-899e-fe6bbc9856eb req-cd6f0c54-0f92-4760-8485-849ffaee6e9f service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:15:26.945340 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:15:26.953323 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-49684cb9-0abd-40c6-899e-fe6bbc9856eb req-cd6f0c54-0f92-4760-8485-849ffaee6e9f service nova] Creating event network-vif-plugged:c541288e-bc2b-43cb-b3d8-781010214c9d for instance b5db0af3-0257-46be-aa65-5bdc9bc28af8 on n-h2-862769-1 Oct 27 04:15:26.958840 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-49684cb9-0abd-40c6-899e-fe6bbc9856eb req-cd6f0c54-0f92-4760-8485-849ffaee6e9f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102078 Oct 27 04:15:26.959427 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3705/7122] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:15:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:15:27.275083 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-82e4380b-607d-464a-88fb-72171d5e4c4e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:15:27.275703 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-82e4380b-607d-464a-88fb-72171d5e4c4e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: b5db0af3-0257-46be-aa65-5bdc9bc28af8] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:15:27.278391 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=35 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:15:27.283131 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-82e4380b-607d-464a-88fb-72171d5e4c4e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:15:27.290567 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-82e4380b-607d-464a-88fb-72171d5e4c4e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:15:27.290567 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-82e4380b-607d-464a-88fb-72171d5e4c4e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:15:27.290567 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-82e4380b-607d-464a-88fb-72171d5e4c4e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:15:27.290567 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-82e4380b-607d-464a-88fb-72171d5e4c4e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:15:27.290567 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-82e4380b-607d-464a-88fb-72171d5e4c4e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:15:27.290567 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=75 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:15:27.417591 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-82e4380b-607d-464a-88fb-72171d5e4c4e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:15:27.425364 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-82e4380b-607d-464a-88fb-72171d5e4c4e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/b5db0af3-0257-46be-aa65-5bdc9bc28af8" status: 200 len: 1264 microversion: 2.1 time: 0.154215 Oct 27 04:15:27.425943 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3418/7123] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:15:27 2022] GET /compute/v2.1/servers/b5db0af3-0257-46be-aa65-5bdc9bc28af8 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:15:28.449648 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-be472e59-185c-46f2-b81d-1f3d7a89b4c2 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:15:28.450325 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-be472e59-185c-46f2-b81d-1f3d7a89b4c2 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: b5db0af3-0257-46be-aa65-5bdc9bc28af8] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:15:28.458975 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-be472e59-185c-46f2-b81d-1f3d7a89b4c2 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:15:28.459469 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-be472e59-185c-46f2-b81d-1f3d7a89b4c2 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:15:28.459917 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-be472e59-185c-46f2-b81d-1f3d7a89b4c2 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:15:28.460620 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-be472e59-185c-46f2-b81d-1f3d7a89b4c2 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:15:28.461088 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-be472e59-185c-46f2-b81d-1f3d7a89b4c2 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:15:28.461536 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-be472e59-185c-46f2-b81d-1f3d7a89b4c2 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:15:28.592544 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-be472e59-185c-46f2-b81d-1f3d7a89b4c2 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:15:28.600206 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-be472e59-185c-46f2-b81d-1f3d7a89b4c2 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/b5db0af3-0257-46be-aa65-5bdc9bc28af8" status: 200 len: 1452 microversion: 2.1 time: 0.155581 Oct 27 04:15:28.600790 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3706/7124] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:15:28 2022] GET /compute/v2.1/servers/b5db0af3-0257-46be-aa65-5bdc9bc28af8 => generated 1452 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:15:28.622946 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5f1e8ba4-a26f-4842-b424-c5bd5ebd012e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:15:28.623565 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5f1e8ba4-a26f-4842-b424-c5bd5ebd012e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: b5db0af3-0257-46be-aa65-5bdc9bc28af8] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:15:28.630297 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5f1e8ba4-a26f-4842-b424-c5bd5ebd012e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:15:28.630788 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5f1e8ba4-a26f-4842-b424-c5bd5ebd012e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:15:28.631234 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5f1e8ba4-a26f-4842-b424-c5bd5ebd012e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:15:28.631933 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5f1e8ba4-a26f-4842-b424-c5bd5ebd012e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:15:28.632394 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5f1e8ba4-a26f-4842-b424-c5bd5ebd012e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:15:28.632825 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5f1e8ba4-a26f-4842-b424-c5bd5ebd012e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:15:28.763753 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5f1e8ba4-a26f-4842-b424-c5bd5ebd012e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:15:28.771539 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5f1e8ba4-a26f-4842-b424-c5bd5ebd012e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/b5db0af3-0257-46be-aa65-5bdc9bc28af8" status: 200 len: 1452 microversion: 2.1 time: 0.153109 Oct 27 04:15:28.772123 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3419/7125] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:15:28 2022] GET /compute/v2.1/servers/b5db0af3-0257-46be-aa65-5bdc9bc28af8 => generated 1452 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:15:30.644058 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-521151af-169f-4ead-abc8-b83a436bf808 req-4dcd2467-444a-4ec6-abb7-65530e742216 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5db0af3-0257-46be-aa65-5bdc9bc28af8", "tag": "c541288e-bc2b-43cb-b3d8-781010214c9d"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:15:30.654715 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-521151af-169f-4ead-abc8-b83a436bf808 req-4dcd2467-444a-4ec6-abb7-65530e742216 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:15:30.655207 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-521151af-169f-4ead-abc8-b83a436bf808 req-4dcd2467-444a-4ec6-abb7-65530e742216 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:15:30.655661 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-521151af-169f-4ead-abc8-b83a436bf808 req-4dcd2467-444a-4ec6-abb7-65530e742216 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:15:30.667032 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-521151af-169f-4ead-abc8-b83a436bf808 req-4dcd2467-444a-4ec6-abb7-65530e742216 service nova] Creating event network-changed:c541288e-bc2b-43cb-b3d8-781010214c9d for instance b5db0af3-0257-46be-aa65-5bdc9bc28af8 on n-h2-862769-1 Oct 27 04:15:30.672273 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-521151af-169f-4ead-abc8-b83a436bf808 req-4dcd2467-444a-4ec6-abb7-65530e742216 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031850 Oct 27 04:15:30.672920 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3707/7126] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:15:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 04:17:56.493580 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=3 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:17:56.494378 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=11 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:17:56.495264 n-d-862769-1 devstack@n-api.service[121000]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 04:17:56.495413 n-d-862769-1 devstack@n-api.service[121000]: Thu Oct 27 04:17:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.20) !!! Oct 27 04:17:56.502527 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-59b7d61d-470a-4e7a-960c-4e8f9818cdec tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1989497670", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-784919494", "security_groups": [{"name": "tempest-secgroup-smoke-514301289"}], "block_device_mapping_v2": [{"uuid": "3c31f76e-3f49-47af-9e95-a0522c46bde2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b49d136e-c9db-4b4f-8210-57f6cfd2ff95"}]}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:17:56.669869 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-59b7d61d-470a-4e7a-960c-4e8f9818cdec tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] validate_networks() for [('b49d136e-c9db-4b4f-8210-57f6cfd2ff95', None, None, None, None, None)] {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 04:17:57.120673 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-59b7d61d-470a-4e7a-960c-4e8f9818cdec tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 04:17:57.121124 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-59b7d61d-470a-4e7a-960c-4e8f9818cdec tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 04:17:57.121633 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-59b7d61d-470a-4e7a-960c-4e8f9818cdec tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 04:17:57.122072 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-59b7d61d-470a-4e7a-960c-4e8f9818cdec tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 04:17:57.122529 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-59b7d61d-470a-4e7a-960c-4e8f9818cdec tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 04:17:57.131403 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-59b7d61d-470a-4e7a-960c-4e8f9818cdec tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:17:57.132499 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-59b7d61d-470a-4e7a-960c-4e8f9818cdec tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:17:57.132936 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-59b7d61d-470a-4e7a-960c-4e8f9818cdec tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:17:57.133664 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-59b7d61d-470a-4e7a-960c-4e8f9818cdec tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:17:57.134160 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-59b7d61d-470a-4e7a-960c-4e8f9818cdec tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:17:57.134589 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-59b7d61d-470a-4e7a-960c-4e8f9818cdec tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:17:57.151116 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-59b7d61d-470a-4e7a-960c-4e8f9818cdec tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Getting quotas for project 6a6a4f0161c94dc19682d70af00ba684. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 04:17:57.156688 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-59b7d61d-470a-4e7a-960c-4e8f9818cdec tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Getting quotas for user b7f5c179e8844542bca46d76042a6897 and project 6a6a4f0161c94dc19682d70af00ba684. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 04:17:57.217306 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-59b7d61d-470a-4e7a-960c-4e8f9818cdec tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 04:17:57.219528 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-59b7d61d-470a-4e7a-960c-4e8f9818cdec tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 96ffb989-8620-4fe9-96f1-682b0653b06c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3c31f76e-3f49-47af-9e95-a0522c46bde2',volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 04:17:57.610853 n-d-862769-1 devstack@n-api.service[121000]: ERROR oslo.messaging._drivers.impl_rabbit [None req-59b7d61d-470a-4e7a-960c-4e8f9818cdec tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [d1e0fee0-c007-4f4b-8cac-c2d0a8595428] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 27 04:17:58.617762 n-d-862769-1 devstack@n-api.service[121000]: INFO oslo.messaging._drivers.impl_rabbit [None req-59b7d61d-470a-4e7a-960c-4e8f9818cdec tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [d1e0fee0-c007-4f4b-8cac-c2d0a8595428] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 54416. Oct 27 04:17:58.621673 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-59b7d61d-470a-4e7a-960c-4e8f9818cdec tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.130302 Oct 27 04:17:58.622393 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3420/7127] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 04:17:56 2022] POST /compute/v2.1/servers => generated 405 bytes in 2132 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 04:17:58.632272 n-d-862769-1 devstack@n-api.service[121001]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5b59dcc8-77e8-4f93-abf1-649e725dfb1c] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 27 04:17:58.632816 n-d-862769-1 devstack@n-api.service[121001]: ERROR oslo.messaging._drivers.impl_rabbit [-] [74449df9-f77e-48cb-96a4-46691974a96d] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 27 04:17:58.633393 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=5 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:17:58.634190 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=9 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:17:58.635390 n-d-862769-1 devstack@n-api.service[121001]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 27 04:17:58.635532 n-d-862769-1 devstack@n-api.service[121001]: Thu Oct 27 04:17:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/96ffb989-8620-4fe9-96f1-682b0653b06c (ip 10.222.0.20) !!! Oct 27 04:17:58.638958 n-d-862769-1 devstack@n-api.service[121001]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 27 04:17:58.639101 n-d-862769-1 devstack@n-api.service[121001]: Thu Oct 27 04:17:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/96ffb989-8620-4fe9-96f1-682b0653b06c (ip 10.222.0.20) !!! Oct 27 04:17:58.640841 n-d-862769-1 devstack@n-api.service[121001]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 27 04:17:58.640972 n-d-862769-1 devstack@n-api.service[121001]: Thu Oct 27 04:17:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/96ffb989-8620-4fe9-96f1-682b0653b06c (ip 10.222.0.20) !!! Oct 27 04:17:58.662236 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-03877263-4fd9-4fd7-abea-b17ef92dba27 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:17:58.663671 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-03877263-4fd9-4fd7-abea-b17ef92dba27 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 96ffb989-8620-4fe9-96f1-682b0653b06c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:17:58.773279 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-03877263-4fd9-4fd7-abea-b17ef92dba27 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:17:58.780333 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-03877263-4fd9-4fd7-abea-b17ef92dba27 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/96ffb989-8620-4fe9-96f1-682b0653b06c" status: 200 len: 1094 microversion: 2.1 time: 0.150465 Oct 27 04:17:58.781121 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3708/7128] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:17:58 2022] GET /compute/v2.1/servers/96ffb989-8620-4fe9-96f1-682b0653b06c => generated 1094 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:17:59.804994 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-98e74b16-5dfa-4a68-b2e6-c377c8d765ca tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:17:59.805617 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-98e74b16-5dfa-4a68-b2e6-c377c8d765ca tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 96ffb989-8620-4fe9-96f1-682b0653b06c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:17:59.811731 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-98e74b16-5dfa-4a68-b2e6-c377c8d765ca tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:17:59.813901 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-98e74b16-5dfa-4a68-b2e6-c377c8d765ca tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:17:59.813901 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-98e74b16-5dfa-4a68-b2e6-c377c8d765ca tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:17:59.813901 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-98e74b16-5dfa-4a68-b2e6-c377c8d765ca tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:17:59.813901 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-98e74b16-5dfa-4a68-b2e6-c377c8d765ca tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:17:59.814285 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-98e74b16-5dfa-4a68-b2e6-c377c8d765ca tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:17:59.881023 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-98e74b16-5dfa-4a68-b2e6-c377c8d765ca tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:17:59.889140 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-98e74b16-5dfa-4a68-b2e6-c377c8d765ca tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/96ffb989-8620-4fe9-96f1-682b0653b06c" status: 200 len: 1144 microversion: 2.1 time: 0.089543 Oct 27 04:17:59.889664 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3421/7129] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:17:59 2022] GET /compute/v2.1/servers/96ffb989-8620-4fe9-96f1-682b0653b06c => generated 1144 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:18:00.912149 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-50ab629e-01ef-44e6-9118-14ecf1b9efdf tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:18:00.912800 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-50ab629e-01ef-44e6-9118-14ecf1b9efdf tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 96ffb989-8620-4fe9-96f1-682b0653b06c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:18:00.928810 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-50ab629e-01ef-44e6-9118-14ecf1b9efdf tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:18:00.929328 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-50ab629e-01ef-44e6-9118-14ecf1b9efdf tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:18:00.929781 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-50ab629e-01ef-44e6-9118-14ecf1b9efdf tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:18:00.930539 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-50ab629e-01ef-44e6-9118-14ecf1b9efdf tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:18:00.931012 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-50ab629e-01ef-44e6-9118-14ecf1b9efdf tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:18:00.931459 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-50ab629e-01ef-44e6-9118-14ecf1b9efdf tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:18:00.935250 n-d-862769-1 devstack@n-api.service[121001]: INFO oslo.messaging._drivers.impl_rabbit [-] [5b59dcc8-77e8-4f93-abf1-649e725dfb1c] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 54446. Oct 27 04:18:00.939176 n-d-862769-1 devstack@n-api.service[121001]: INFO oslo.messaging._drivers.impl_rabbit [-] [74449df9-f77e-48cb-96a4-46691974a96d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 54448. Oct 27 04:18:01.002480 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-50ab629e-01ef-44e6-9118-14ecf1b9efdf tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:18:01.011201 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-50ab629e-01ef-44e6-9118-14ecf1b9efdf tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/96ffb989-8620-4fe9-96f1-682b0653b06c" status: 200 len: 1200 microversion: 2.1 time: 0.103066 Oct 27 04:18:01.011777 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3709/7130] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:18:00 2022] GET /compute/v2.1/servers/96ffb989-8620-4fe9-96f1-682b0653b06c => generated 1200 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:18:02.034600 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-08c25ac6-ff6b-454f-b644-9cbc4ef69d29 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:18:02.035419 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-08c25ac6-ff6b-454f-b644-9cbc4ef69d29 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 96ffb989-8620-4fe9-96f1-682b0653b06c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:18:02.042724 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-08c25ac6-ff6b-454f-b644-9cbc4ef69d29 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:18:02.043341 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-08c25ac6-ff6b-454f-b644-9cbc4ef69d29 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:18:02.043925 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-08c25ac6-ff6b-454f-b644-9cbc4ef69d29 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:18:02.044730 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-08c25ac6-ff6b-454f-b644-9cbc4ef69d29 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:18:02.045433 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-08c25ac6-ff6b-454f-b644-9cbc4ef69d29 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:18:02.046018 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-08c25ac6-ff6b-454f-b644-9cbc4ef69d29 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:18:02.247383 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-08c25ac6-ff6b-454f-b644-9cbc4ef69d29 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:18:02.256307 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-08c25ac6-ff6b-454f-b644-9cbc4ef69d29 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/96ffb989-8620-4fe9-96f1-682b0653b06c" status: 200 len: 1277 microversion: 2.1 time: 0.225566 Oct 27 04:18:02.257531 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3422/7131] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:18:02 2022] GET /compute/v2.1/servers/96ffb989-8620-4fe9-96f1-682b0653b06c => generated 1277 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:18:02.866022 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-5e8acf54-7aa1-420d-a41d-06bcf2830b7b req-143f7d41-b9d1-4e0b-8c3e-f58f3e06cdc5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96ffb989-8620-4fe9-96f1-682b0653b06c", "tag": "18169b45-af10-491c-ba6f-cb4219bdb979"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:18:02.877208 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-5e8acf54-7aa1-420d-a41d-06bcf2830b7b req-143f7d41-b9d1-4e0b-8c3e-f58f3e06cdc5 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:18:02.877727 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-5e8acf54-7aa1-420d-a41d-06bcf2830b7b req-143f7d41-b9d1-4e0b-8c3e-f58f3e06cdc5 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:18:02.878219 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-5e8acf54-7aa1-420d-a41d-06bcf2830b7b req-143f7d41-b9d1-4e0b-8c3e-f58f3e06cdc5 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:18:02.890859 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-5e8acf54-7aa1-420d-a41d-06bcf2830b7b req-143f7d41-b9d1-4e0b-8c3e-f58f3e06cdc5 service nova] Creating event network-changed:18169b45-af10-491c-ba6f-cb4219bdb979 for instance 96ffb989-8620-4fe9-96f1-682b0653b06c on n-h1-862769-1 Oct 27 04:18:02.897001 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-5e8acf54-7aa1-420d-a41d-06bcf2830b7b req-143f7d41-b9d1-4e0b-8c3e-f58f3e06cdc5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103924 Oct 27 04:18:02.898351 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3710/7132] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:18:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:18:03.280946 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8c7e755b-a8c9-41d4-93af-9a21ede35a0d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:18:03.282244 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8c7e755b-a8c9-41d4-93af-9a21ede35a0d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 96ffb989-8620-4fe9-96f1-682b0653b06c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:18:03.289160 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8c7e755b-a8c9-41d4-93af-9a21ede35a0d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:18:03.289902 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8c7e755b-a8c9-41d4-93af-9a21ede35a0d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:18:03.290375 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8c7e755b-a8c9-41d4-93af-9a21ede35a0d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:18:03.291442 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8c7e755b-a8c9-41d4-93af-9a21ede35a0d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:18:03.291910 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8c7e755b-a8c9-41d4-93af-9a21ede35a0d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:18:03.292344 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8c7e755b-a8c9-41d4-93af-9a21ede35a0d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:18:03.440647 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8c7e755b-a8c9-41d4-93af-9a21ede35a0d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:18:03.450533 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8c7e755b-a8c9-41d4-93af-9a21ede35a0d tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/96ffb989-8620-4fe9-96f1-682b0653b06c" status: 200 len: 1277 microversion: 2.1 time: 0.173526 Oct 27 04:18:03.451145 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3423/7133] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:18:03 2022] GET /compute/v2.1/servers/96ffb989-8620-4fe9-96f1-682b0653b06c => generated 1277 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:18:04.475965 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-94111d88-128c-46ba-96e5-549db0bf65a9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:18:04.476723 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-94111d88-128c-46ba-96e5-549db0bf65a9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 96ffb989-8620-4fe9-96f1-682b0653b06c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:18:04.483054 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-94111d88-128c-46ba-96e5-549db0bf65a9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:18:04.483653 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-94111d88-128c-46ba-96e5-549db0bf65a9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:18:04.484108 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-94111d88-128c-46ba-96e5-549db0bf65a9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:18:04.484827 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-94111d88-128c-46ba-96e5-549db0bf65a9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:18:04.485301 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-94111d88-128c-46ba-96e5-549db0bf65a9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:18:04.485750 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-94111d88-128c-46ba-96e5-549db0bf65a9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:18:04.619686 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-94111d88-128c-46ba-96e5-549db0bf65a9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:18:04.627424 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-94111d88-128c-46ba-96e5-549db0bf65a9 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/96ffb989-8620-4fe9-96f1-682b0653b06c" status: 200 len: 1277 microversion: 2.1 time: 0.157215 Oct 27 04:18:04.628029 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3711/7134] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:18:04 2022] GET /compute/v2.1/servers/96ffb989-8620-4fe9-96f1-682b0653b06c => generated 1277 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:18:05.650173 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2aa5396d-abfc-431a-94f3-6f7162d8815b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:18:05.650794 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-2aa5396d-abfc-431a-94f3-6f7162d8815b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 96ffb989-8620-4fe9-96f1-682b0653b06c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:18:05.657791 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2aa5396d-abfc-431a-94f3-6f7162d8815b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:18:05.658321 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2aa5396d-abfc-431a-94f3-6f7162d8815b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:18:05.658769 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2aa5396d-abfc-431a-94f3-6f7162d8815b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:18:05.659478 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2aa5396d-abfc-431a-94f3-6f7162d8815b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:18:05.659939 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2aa5396d-abfc-431a-94f3-6f7162d8815b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:18:05.660366 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2aa5396d-abfc-431a-94f3-6f7162d8815b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:18:05.798048 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2aa5396d-abfc-431a-94f3-6f7162d8815b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:18:05.806715 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2aa5396d-abfc-431a-94f3-6f7162d8815b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/96ffb989-8620-4fe9-96f1-682b0653b06c" status: 200 len: 1277 microversion: 2.1 time: 0.160458 Oct 27 04:18:05.807316 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3424/7135] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:18:05 2022] GET /compute/v2.1/servers/96ffb989-8620-4fe9-96f1-682b0653b06c => generated 1277 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:18:06.829157 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5e6be0dc-96ea-4f6e-86e0-9c7418699d1e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:18:06.829771 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5e6be0dc-96ea-4f6e-86e0-9c7418699d1e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 96ffb989-8620-4fe9-96f1-682b0653b06c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:18:06.837146 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5e6be0dc-96ea-4f6e-86e0-9c7418699d1e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:18:06.837777 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5e6be0dc-96ea-4f6e-86e0-9c7418699d1e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:18:06.838405 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5e6be0dc-96ea-4f6e-86e0-9c7418699d1e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:18:06.843582 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5e6be0dc-96ea-4f6e-86e0-9c7418699d1e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:18:06.843582 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5e6be0dc-96ea-4f6e-86e0-9c7418699d1e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:18:06.843582 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5e6be0dc-96ea-4f6e-86e0-9c7418699d1e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:18:07.276528 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5e6be0dc-96ea-4f6e-86e0-9c7418699d1e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:18:07.284272 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5e6be0dc-96ea-4f6e-86e0-9c7418699d1e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/96ffb989-8620-4fe9-96f1-682b0653b06c" status: 200 len: 1277 microversion: 2.1 time: 0.459443 Oct 27 04:18:07.284869 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3712/7136] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:18:06 2022] GET /compute/v2.1/servers/96ffb989-8620-4fe9-96f1-682b0653b06c => generated 1277 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:18:08.305312 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:18:08.306581 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=6 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:18:08.310539 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-218b798e-1dba-4b86-b47f-f22027171510 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:18:08.311165 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-218b798e-1dba-4b86-b47f-f22027171510 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 96ffb989-8620-4fe9-96f1-682b0653b06c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:18:08.317063 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-218b798e-1dba-4b86-b47f-f22027171510 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:18:08.317582 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-218b798e-1dba-4b86-b47f-f22027171510 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:18:08.318052 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-218b798e-1dba-4b86-b47f-f22027171510 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:18:08.318754 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-218b798e-1dba-4b86-b47f-f22027171510 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:18:08.319292 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-218b798e-1dba-4b86-b47f-f22027171510 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:18:08.319732 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-218b798e-1dba-4b86-b47f-f22027171510 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:18:08.457618 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-218b798e-1dba-4b86-b47f-f22027171510 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:18:08.466098 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-218b798e-1dba-4b86-b47f-f22027171510 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/96ffb989-8620-4fe9-96f1-682b0653b06c" status: 200 len: 1265 microversion: 2.1 time: 0.163009 Oct 27 04:18:08.466684 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3425/7137] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:18:08 2022] GET /compute/v2.1/servers/96ffb989-8620-4fe9-96f1-682b0653b06c => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:18:09.489854 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-25a9536b-a2aa-4f83-8ee2-b7283383f987 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:18:09.490558 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-25a9536b-a2aa-4f83-8ee2-b7283383f987 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 96ffb989-8620-4fe9-96f1-682b0653b06c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:18:09.493397 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:18:09.498309 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-25a9536b-a2aa-4f83-8ee2-b7283383f987 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:18:09.498814 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-25a9536b-a2aa-4f83-8ee2-b7283383f987 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:18:09.499326 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-25a9536b-a2aa-4f83-8ee2-b7283383f987 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:18:09.500016 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-25a9536b-a2aa-4f83-8ee2-b7283383f987 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:18:09.500490 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-25a9536b-a2aa-4f83-8ee2-b7283383f987 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:18:09.500938 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-25a9536b-a2aa-4f83-8ee2-b7283383f987 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:18:09.631769 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-25a9536b-a2aa-4f83-8ee2-b7283383f987 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:18:09.640003 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-25a9536b-a2aa-4f83-8ee2-b7283383f987 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/96ffb989-8620-4fe9-96f1-682b0653b06c" status: 200 len: 1265 microversion: 2.1 time: 0.154139 Oct 27 04:18:09.640570 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3713/7138] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:18:09 2022] GET /compute/v2.1/servers/96ffb989-8620-4fe9-96f1-682b0653b06c => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:18:10.663189 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-242dfe2e-4945-4c08-983e-87da677b79af tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:18:10.664512 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-242dfe2e-4945-4c08-983e-87da677b79af tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 96ffb989-8620-4fe9-96f1-682b0653b06c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:18:10.671329 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-242dfe2e-4945-4c08-983e-87da677b79af tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:18:10.671813 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-242dfe2e-4945-4c08-983e-87da677b79af tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:18:10.672253 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-242dfe2e-4945-4c08-983e-87da677b79af tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:18:10.672945 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-242dfe2e-4945-4c08-983e-87da677b79af tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:18:10.673406 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-242dfe2e-4945-4c08-983e-87da677b79af tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:18:10.673832 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-242dfe2e-4945-4c08-983e-87da677b79af tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:18:10.803506 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-242dfe2e-4945-4c08-983e-87da677b79af tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:18:10.811285 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-242dfe2e-4945-4c08-983e-87da677b79af tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/96ffb989-8620-4fe9-96f1-682b0653b06c" status: 200 len: 1265 microversion: 2.1 time: 0.152056 Oct 27 04:18:10.811863 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3426/7139] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:18:10 2022] GET /compute/v2.1/servers/96ffb989-8620-4fe9-96f1-682b0653b06c => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:18:11.833842 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9fae901f-698c-4896-affe-e174f406d89f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:18:11.834529 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-9fae901f-698c-4896-affe-e174f406d89f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 96ffb989-8620-4fe9-96f1-682b0653b06c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:18:11.841641 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9fae901f-698c-4896-affe-e174f406d89f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:18:11.842184 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9fae901f-698c-4896-affe-e174f406d89f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:18:11.842644 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9fae901f-698c-4896-affe-e174f406d89f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:18:11.843355 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9fae901f-698c-4896-affe-e174f406d89f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:18:11.843825 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9fae901f-698c-4896-affe-e174f406d89f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:18:11.844270 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9fae901f-698c-4896-affe-e174f406d89f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:18:11.977878 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9fae901f-698c-4896-affe-e174f406d89f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:18:11.985666 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9fae901f-698c-4896-affe-e174f406d89f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/96ffb989-8620-4fe9-96f1-682b0653b06c" status: 200 len: 1265 microversion: 2.1 time: 0.155698 Oct 27 04:18:11.986281 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3714/7140] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:18:11 2022] GET /compute/v2.1/servers/96ffb989-8620-4fe9-96f1-682b0653b06c => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:18:13.008698 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c68f94c8-5491-4879-aa5a-02d4fadc2497 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:18:13.009958 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c68f94c8-5491-4879-aa5a-02d4fadc2497 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 96ffb989-8620-4fe9-96f1-682b0653b06c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:18:13.016723 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c68f94c8-5491-4879-aa5a-02d4fadc2497 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:18:13.017216 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c68f94c8-5491-4879-aa5a-02d4fadc2497 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:18:13.017654 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c68f94c8-5491-4879-aa5a-02d4fadc2497 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:18:13.018381 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c68f94c8-5491-4879-aa5a-02d4fadc2497 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:18:13.018842 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c68f94c8-5491-4879-aa5a-02d4fadc2497 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:18:13.019268 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c68f94c8-5491-4879-aa5a-02d4fadc2497 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:18:13.149789 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c68f94c8-5491-4879-aa5a-02d4fadc2497 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:18:13.157536 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c68f94c8-5491-4879-aa5a-02d4fadc2497 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/96ffb989-8620-4fe9-96f1-682b0653b06c" status: 200 len: 1265 microversion: 2.1 time: 0.152753 Oct 27 04:18:13.158132 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3427/7141] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:18:13 2022] GET /compute/v2.1/servers/96ffb989-8620-4fe9-96f1-682b0653b06c => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:18:14.182543 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9fba50bc-8654-4ff3-aaaa-7008a5f73b4b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:18:14.183207 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-9fba50bc-8654-4ff3-aaaa-7008a5f73b4b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 96ffb989-8620-4fe9-96f1-682b0653b06c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:18:14.190770 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9fba50bc-8654-4ff3-aaaa-7008a5f73b4b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:18:14.191408 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9fba50bc-8654-4ff3-aaaa-7008a5f73b4b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:18:14.191873 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9fba50bc-8654-4ff3-aaaa-7008a5f73b4b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:18:14.192604 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9fba50bc-8654-4ff3-aaaa-7008a5f73b4b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:18:14.193071 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9fba50bc-8654-4ff3-aaaa-7008a5f73b4b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:18:14.193513 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9fba50bc-8654-4ff3-aaaa-7008a5f73b4b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:18:14.326098 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9fba50bc-8654-4ff3-aaaa-7008a5f73b4b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:18:14.334094 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9fba50bc-8654-4ff3-aaaa-7008a5f73b4b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/96ffb989-8620-4fe9-96f1-682b0653b06c" status: 200 len: 1265 microversion: 2.1 time: 0.155541 Oct 27 04:18:14.334675 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3715/7142] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:18:14 2022] GET /compute/v2.1/servers/96ffb989-8620-4fe9-96f1-682b0653b06c => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:18:15.357883 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f8d629ef-2fe4-43d2-8bab-28f1ce138de2 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:18:15.358635 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f8d629ef-2fe4-43d2-8bab-28f1ce138de2 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 96ffb989-8620-4fe9-96f1-682b0653b06c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:18:15.365787 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f8d629ef-2fe4-43d2-8bab-28f1ce138de2 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:18:15.366325 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f8d629ef-2fe4-43d2-8bab-28f1ce138de2 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:18:15.366770 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f8d629ef-2fe4-43d2-8bab-28f1ce138de2 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:18:15.367497 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f8d629ef-2fe4-43d2-8bab-28f1ce138de2 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:18:15.368012 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f8d629ef-2fe4-43d2-8bab-28f1ce138de2 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:18:15.368486 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f8d629ef-2fe4-43d2-8bab-28f1ce138de2 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:18:15.516162 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f8d629ef-2fe4-43d2-8bab-28f1ce138de2 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:18:15.525531 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f8d629ef-2fe4-43d2-8bab-28f1ce138de2 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/96ffb989-8620-4fe9-96f1-682b0653b06c" status: 200 len: 1265 microversion: 2.1 time: 0.171582 Oct 27 04:18:15.526164 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3428/7143] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:18:15 2022] GET /compute/v2.1/servers/96ffb989-8620-4fe9-96f1-682b0653b06c => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:18:16.548647 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8422e832-e260-4fed-962c-f77b5624a0c3 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:18:16.549277 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8422e832-e260-4fed-962c-f77b5624a0c3 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 96ffb989-8620-4fe9-96f1-682b0653b06c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:18:16.556060 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8422e832-e260-4fed-962c-f77b5624a0c3 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:18:16.557066 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8422e832-e260-4fed-962c-f77b5624a0c3 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:18:16.557521 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8422e832-e260-4fed-962c-f77b5624a0c3 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:18:16.558262 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8422e832-e260-4fed-962c-f77b5624a0c3 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:18:16.558732 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8422e832-e260-4fed-962c-f77b5624a0c3 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:18:16.559174 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8422e832-e260-4fed-962c-f77b5624a0c3 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:18:16.693514 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8422e832-e260-4fed-962c-f77b5624a0c3 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:18:16.701882 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8422e832-e260-4fed-962c-f77b5624a0c3 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/96ffb989-8620-4fe9-96f1-682b0653b06c" status: 200 len: 1265 microversion: 2.1 time: 0.157178 Oct 27 04:18:16.707183 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3716/7144] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:18:16 2022] GET /compute/v2.1/servers/96ffb989-8620-4fe9-96f1-682b0653b06c => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 04:18:17.568650 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-e4165419-5dda-4ea5-9a37-032ee0be215d req-38fd3aeb-a80c-4cec-b0f8-3e759dadf119 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96ffb989-8620-4fe9-96f1-682b0653b06c", "name": "network-vif-plugged", "status": "completed", "tag": "18169b45-af10-491c-ba6f-cb4219bdb979"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:18:17.579092 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-e4165419-5dda-4ea5-9a37-032ee0be215d req-38fd3aeb-a80c-4cec-b0f8-3e759dadf119 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:18:17.579566 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-e4165419-5dda-4ea5-9a37-032ee0be215d req-38fd3aeb-a80c-4cec-b0f8-3e759dadf119 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:18:17.580002 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-e4165419-5dda-4ea5-9a37-032ee0be215d req-38fd3aeb-a80c-4cec-b0f8-3e759dadf119 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:18:17.591545 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-e4165419-5dda-4ea5-9a37-032ee0be215d req-38fd3aeb-a80c-4cec-b0f8-3e759dadf119 service nova] Creating event network-vif-plugged:18169b45-af10-491c-ba6f-cb4219bdb979 for instance 96ffb989-8620-4fe9-96f1-682b0653b06c on n-h1-862769-1 Oct 27 04:18:17.597516 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-e4165419-5dda-4ea5-9a37-032ee0be215d req-38fd3aeb-a80c-4cec-b0f8-3e759dadf119 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032660 Oct 27 04:18:17.598122 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3429/7145] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:18:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:18:17.724952 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-30238801-a146-456c-8baf-5d28e47d3bfb tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:18:17.726227 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-30238801-a146-456c-8baf-5d28e47d3bfb tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 96ffb989-8620-4fe9-96f1-682b0653b06c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:18:17.733268 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-30238801-a146-456c-8baf-5d28e47d3bfb tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:18:17.733783 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-30238801-a146-456c-8baf-5d28e47d3bfb tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:18:17.734281 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-30238801-a146-456c-8baf-5d28e47d3bfb tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:18:17.735022 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-30238801-a146-456c-8baf-5d28e47d3bfb tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:18:17.735499 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-30238801-a146-456c-8baf-5d28e47d3bfb tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:18:17.735948 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-30238801-a146-456c-8baf-5d28e47d3bfb tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:18:17.867965 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-30238801-a146-456c-8baf-5d28e47d3bfb tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:18:17.875792 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-30238801-a146-456c-8baf-5d28e47d3bfb tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/96ffb989-8620-4fe9-96f1-682b0653b06c" status: 200 len: 1265 microversion: 2.1 time: 0.154879 Oct 27 04:18:17.876367 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3717/7146] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:18:17 2022] GET /compute/v2.1/servers/96ffb989-8620-4fe9-96f1-682b0653b06c => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:18:18.899787 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b744916c-222b-485e-85d4-1c54222664e7 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:18:18.900558 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b744916c-222b-485e-85d4-1c54222664e7 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 96ffb989-8620-4fe9-96f1-682b0653b06c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:18:18.907312 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b744916c-222b-485e-85d4-1c54222664e7 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:18:18.907803 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b744916c-222b-485e-85d4-1c54222664e7 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:18:18.908263 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b744916c-222b-485e-85d4-1c54222664e7 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:18:18.909836 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b744916c-222b-485e-85d4-1c54222664e7 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:18:18.910333 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b744916c-222b-485e-85d4-1c54222664e7 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:18:18.910938 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b744916c-222b-485e-85d4-1c54222664e7 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:18:19.049953 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b744916c-222b-485e-85d4-1c54222664e7 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:18:19.058045 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b744916c-222b-485e-85d4-1c54222664e7 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/96ffb989-8620-4fe9-96f1-682b0653b06c" status: 200 len: 1265 microversion: 2.1 time: 0.163655 Oct 27 04:18:19.064514 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3430/7147] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:18:18 2022] GET /compute/v2.1/servers/96ffb989-8620-4fe9-96f1-682b0653b06c => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:18:20.079821 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0be32338-8595-4fe9-89ae-7017a10cc84f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:18:20.080450 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0be32338-8595-4fe9-89ae-7017a10cc84f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 96ffb989-8620-4fe9-96f1-682b0653b06c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:18:20.087668 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0be32338-8595-4fe9-89ae-7017a10cc84f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:18:20.088167 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0be32338-8595-4fe9-89ae-7017a10cc84f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:18:20.088653 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0be32338-8595-4fe9-89ae-7017a10cc84f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:18:20.089363 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0be32338-8595-4fe9-89ae-7017a10cc84f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:18:20.089835 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0be32338-8595-4fe9-89ae-7017a10cc84f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:18:20.090311 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0be32338-8595-4fe9-89ae-7017a10cc84f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:18:20.224877 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0be32338-8595-4fe9-89ae-7017a10cc84f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:18:20.233386 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0be32338-8595-4fe9-89ae-7017a10cc84f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/96ffb989-8620-4fe9-96f1-682b0653b06c" status: 200 len: 1452 microversion: 2.1 time: 0.157442 Oct 27 04:18:20.233971 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3718/7148] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:18:20 2022] GET /compute/v2.1/servers/96ffb989-8620-4fe9-96f1-682b0653b06c => generated 1452 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:18:20.255725 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d6249bf6-1384-49a2-9c4f-c87f7eda3889 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:18:20.256523 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d6249bf6-1384-49a2-9c4f-c87f7eda3889 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 96ffb989-8620-4fe9-96f1-682b0653b06c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:18:20.263620 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d6249bf6-1384-49a2-9c4f-c87f7eda3889 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:18:20.267232 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d6249bf6-1384-49a2-9c4f-c87f7eda3889 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:18:20.267232 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d6249bf6-1384-49a2-9c4f-c87f7eda3889 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:18:20.267232 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d6249bf6-1384-49a2-9c4f-c87f7eda3889 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:18:20.267232 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d6249bf6-1384-49a2-9c4f-c87f7eda3889 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:18:20.267232 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d6249bf6-1384-49a2-9c4f-c87f7eda3889 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:18:20.399797 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d6249bf6-1384-49a2-9c4f-c87f7eda3889 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:18:20.408216 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d6249bf6-1384-49a2-9c4f-c87f7eda3889 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/96ffb989-8620-4fe9-96f1-682b0653b06c" status: 200 len: 1452 microversion: 2.1 time: 0.156398 Oct 27 04:18:20.408801 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3431/7149] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:18:20 2022] GET /compute/v2.1/servers/96ffb989-8620-4fe9-96f1-682b0653b06c => generated 1452 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:18:22.758382 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-0842c0ee-6e1c-41bb-bd99-7701dde53a4f req-b570e3cc-7c74-4779-994a-37a55134ac84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96ffb989-8620-4fe9-96f1-682b0653b06c", "tag": "18169b45-af10-491c-ba6f-cb4219bdb979"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:18:22.773048 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-0842c0ee-6e1c-41bb-bd99-7701dde53a4f req-b570e3cc-7c74-4779-994a-37a55134ac84 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:18:22.773048 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-0842c0ee-6e1c-41bb-bd99-7701dde53a4f req-b570e3cc-7c74-4779-994a-37a55134ac84 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:18:22.773048 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-0842c0ee-6e1c-41bb-bd99-7701dde53a4f req-b570e3cc-7c74-4779-994a-37a55134ac84 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:18:22.781482 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-0842c0ee-6e1c-41bb-bd99-7701dde53a4f req-b570e3cc-7c74-4779-994a-37a55134ac84 service nova] Creating event network-changed:18169b45-af10-491c-ba6f-cb4219bdb979 for instance 96ffb989-8620-4fe9-96f1-682b0653b06c on n-h1-862769-1 Oct 27 04:18:22.786828 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-0842c0ee-6e1c-41bb-bd99-7701dde53a4f req-b570e3cc-7c74-4779-994a-37a55134ac84 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032218 Oct 27 04:18:22.788086 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3719/7150] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:18:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:20:26.039962 n-d-862769-1 devstack@n-api.service[121000]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5ec0dfad-6f0c-4686-8a67-f02607adfe50] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 27 04:20:26.040998 n-d-862769-1 devstack@n-api.service[121000]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a40cf960-ae63-4112-9db5-88668ecbbc6d] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 27 04:20:26.041632 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:20:26.042496 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=64 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:20:26.043656 n-d-862769-1 devstack@n-api.service[121000]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 04:20:26.043797 n-d-862769-1 devstack@n-api.service[121000]: Thu Oct 27 04:20:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/96ffb989-8620-4fe9-96f1-682b0653b06c (ip 10.222.0.20) !!! Oct 27 04:20:26.049553 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2b24d3c3-a921-4619-b24c-f7fca9db0d13 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:20:26.050787 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-2b24d3c3-a921-4619-b24c-f7fca9db0d13 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 96ffb989-8620-4fe9-96f1-682b0653b06c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:20:26.058124 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2b24d3c3-a921-4619-b24c-f7fca9db0d13 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:20:26.060326 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2b24d3c3-a921-4619-b24c-f7fca9db0d13 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:20:26.060326 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2b24d3c3-a921-4619-b24c-f7fca9db0d13 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:20:26.060326 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2b24d3c3-a921-4619-b24c-f7fca9db0d13 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:20:26.060326 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2b24d3c3-a921-4619-b24c-f7fca9db0d13 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:20:26.060879 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2b24d3c3-a921-4619-b24c-f7fca9db0d13 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:20:26.093789 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-2b24d3c3-a921-4619-b24c-f7fca9db0d13 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 96ffb989-8620-4fe9-96f1-682b0653b06c] Going to try to terminate instance {{(pid=121000) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 04:20:26.131035 n-d-862769-1 devstack@n-api.service[121001]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5b59dcc8-77e8-4f93-abf1-649e725dfb1c] AMQP server on 10.222.0.20:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 27 04:20:26.132980 n-d-862769-1 devstack@n-api.service[121001]: ERROR oslo.messaging._drivers.impl_rabbit [-] [74449df9-f77e-48cb-96a4-46691974a96d] AMQP server on 10.222.0.20:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 27 04:20:26.133801 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=26 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:20:26.135164 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=58 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:20:26.237132 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-c4ce629a-d4e8-4d3b-95de-03560ca032e6 req-1f9257a2-f247-441e-836b-6a491a090fa3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96ffb989-8620-4fe9-96f1-682b0653b06c", "tag": "18169b45-af10-491c-ba6f-cb4219bdb979"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:20:26.247319 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-c4ce629a-d4e8-4d3b-95de-03560ca032e6 req-1f9257a2-f247-441e-836b-6a491a090fa3 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:20:26.247822 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-c4ce629a-d4e8-4d3b-95de-03560ca032e6 req-1f9257a2-f247-441e-836b-6a491a090fa3 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:20:26.248276 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-c4ce629a-d4e8-4d3b-95de-03560ca032e6 req-1f9257a2-f247-441e-836b-6a491a090fa3 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:20:26.264011 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-c4ce629a-d4e8-4d3b-95de-03560ca032e6 req-1f9257a2-f247-441e-836b-6a491a090fa3 service nova] Creating event network-changed:18169b45-af10-491c-ba6f-cb4219bdb979 for instance 96ffb989-8620-4fe9-96f1-682b0653b06c on n-h1-862769-1 Oct 27 04:20:26.269229 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-c4ce629a-d4e8-4d3b-95de-03560ca032e6 req-1f9257a2-f247-441e-836b-6a491a090fa3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140334 Oct 27 04:20:26.270496 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3720/7151] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:20:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:20:26.422089 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2b24d3c3-a921-4619-b24c-f7fca9db0d13 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "DELETE /compute/v2.1/servers/96ffb989-8620-4fe9-96f1-682b0653b06c" status: 204 len: 0 microversion: 2.1 time: 0.384762 Oct 27 04:20:26.422909 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3432/7152] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 04:20:26 2022] DELETE /compute/v2.1/servers/96ffb989-8620-4fe9-96f1-682b0653b06c => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 04:20:26.431871 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-cef1b731-d1ae-412d-8b3c-5769f1e14cc0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:20:26.436956 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-cef1b731-d1ae-412d-8b3c-5769f1e14cc0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 96ffb989-8620-4fe9-96f1-682b0653b06c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:20:26.443528 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cef1b731-d1ae-412d-8b3c-5769f1e14cc0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:20:26.444045 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cef1b731-d1ae-412d-8b3c-5769f1e14cc0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:20:26.444511 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cef1b731-d1ae-412d-8b3c-5769f1e14cc0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:20:26.445256 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cef1b731-d1ae-412d-8b3c-5769f1e14cc0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:20:26.445733 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cef1b731-d1ae-412d-8b3c-5769f1e14cc0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:20:26.446234 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cef1b731-d1ae-412d-8b3c-5769f1e14cc0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:20:26.680557 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-cef1b731-d1ae-412d-8b3c-5769f1e14cc0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:20:26.688998 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-cef1b731-d1ae-412d-8b3c-5769f1e14cc0 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/96ffb989-8620-4fe9-96f1-682b0653b06c" status: 200 len: 1576 microversion: 2.1 time: 0.261566 Oct 27 04:20:26.689700 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3721/7153] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:20:26 2022] GET /compute/v2.1/servers/96ffb989-8620-4fe9-96f1-682b0653b06c => generated 1576 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:20:27.715719 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-492dfb9c-7b5d-49df-ae8c-3e63246afe16 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:20:27.716422 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-492dfb9c-7b5d-49df-ae8c-3e63246afe16 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 96ffb989-8620-4fe9-96f1-682b0653b06c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:20:27.727112 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-492dfb9c-7b5d-49df-ae8c-3e63246afe16 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:20:27.727652 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-492dfb9c-7b5d-49df-ae8c-3e63246afe16 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:20:27.728189 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-492dfb9c-7b5d-49df-ae8c-3e63246afe16 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:20:27.729419 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-492dfb9c-7b5d-49df-ae8c-3e63246afe16 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:20:27.729997 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-492dfb9c-7b5d-49df-ae8c-3e63246afe16 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:20:27.730591 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-492dfb9c-7b5d-49df-ae8c-3e63246afe16 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:20:27.748802 n-d-862769-1 devstack@n-api.service[121000]: INFO oslo.messaging._drivers.impl_rabbit [-] [a40cf960-ae63-4112-9db5-88668ecbbc6d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 54572. Oct 27 04:20:27.749503 n-d-862769-1 devstack@n-api.service[121000]: INFO oslo.messaging._drivers.impl_rabbit [-] [5ec0dfad-6f0c-4686-8a67-f02607adfe50] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 54570. Oct 27 04:20:28.404218 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-492dfb9c-7b5d-49df-ae8c-3e63246afe16 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:20:28.412989 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-492dfb9c-7b5d-49df-ae8c-3e63246afe16 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/96ffb989-8620-4fe9-96f1-682b0653b06c" status: 200 len: 1576 microversion: 2.1 time: 0.701795 Oct 27 04:20:28.413830 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3433/7154] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:20:27 2022] GET /compute/v2.1/servers/96ffb989-8620-4fe9-96f1-682b0653b06c => generated 1576 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:20:28.813809 n-d-862769-1 devstack@n-api.service[121001]: INFO oslo.messaging._drivers.impl_rabbit [-] [74449df9-f77e-48cb-96a4-46691974a96d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 54588. Oct 27 04:20:28.814691 n-d-862769-1 devstack@n-api.service[121001]: INFO oslo.messaging._drivers.impl_rabbit [-] [5b59dcc8-77e8-4f93-abf1-649e725dfb1c] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 54586. Oct 27 04:20:28.860263 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-c52b7d7b-22fd-4e4c-81cc-7627d203c4e4 req-b652dc5c-b431-4fcf-9186-70e1e5830ab8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96ffb989-8620-4fe9-96f1-682b0653b06c", "name": "network-vif-deleted", "tag": "18169b45-af10-491c-ba6f-cb4219bdb979"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:20:28.870294 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-c52b7d7b-22fd-4e4c-81cc-7627d203c4e4 req-b652dc5c-b431-4fcf-9186-70e1e5830ab8 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:20:28.870784 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-c52b7d7b-22fd-4e4c-81cc-7627d203c4e4 req-b652dc5c-b431-4fcf-9186-70e1e5830ab8 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:20:28.871237 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-c52b7d7b-22fd-4e4c-81cc-7627d203c4e4 req-b652dc5c-b431-4fcf-9186-70e1e5830ab8 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:20:28.882861 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-c52b7d7b-22fd-4e4c-81cc-7627d203c4e4 req-b652dc5c-b431-4fcf-9186-70e1e5830ab8 service nova] Creating event network-vif-deleted:18169b45-af10-491c-ba6f-cb4219bdb979 for instance 96ffb989-8620-4fe9-96f1-682b0653b06c on n-h1-862769-1 Oct 27 04:20:28.887947 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-c52b7d7b-22fd-4e4c-81cc-7627d203c4e4 req-b652dc5c-b431-4fcf-9186-70e1e5830ab8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090792 Oct 27 04:20:28.888532 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3722/7155] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:20:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 04:20:29.436656 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3de5b4fe-b284-45ce-af98-ebb39559c46c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:20:29.437186 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-3de5b4fe-b284-45ce-af98-ebb39559c46c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 96ffb989-8620-4fe9-96f1-682b0653b06c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:20:29.444224 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3de5b4fe-b284-45ce-af98-ebb39559c46c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:20:29.444721 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3de5b4fe-b284-45ce-af98-ebb39559c46c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:20:29.445166 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3de5b4fe-b284-45ce-af98-ebb39559c46c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:20:29.445880 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3de5b4fe-b284-45ce-af98-ebb39559c46c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:20:29.446367 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3de5b4fe-b284-45ce-af98-ebb39559c46c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:20:29.446804 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3de5b4fe-b284-45ce-af98-ebb39559c46c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:20:29.513083 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-3de5b4fe-b284-45ce-af98-ebb39559c46c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:20:29.521516 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3de5b4fe-b284-45ce-af98-ebb39559c46c tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/96ffb989-8620-4fe9-96f1-682b0653b06c" status: 200 len: 1225 microversion: 2.1 time: 0.088905 Oct 27 04:20:29.524731 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3434/7156] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:20:29 2022] GET /compute/v2.1/servers/96ffb989-8620-4fe9-96f1-682b0653b06c => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:20:30.549207 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0506d4bd-752d-4dea-9a6d-9d4b34bd9e5f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:20:30.550125 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0506d4bd-752d-4dea-9a6d-9d4b34bd9e5f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 96ffb989-8620-4fe9-96f1-682b0653b06c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:20:30.557327 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0506d4bd-752d-4dea-9a6d-9d4b34bd9e5f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:20:30.557868 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0506d4bd-752d-4dea-9a6d-9d4b34bd9e5f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:20:30.558403 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0506d4bd-752d-4dea-9a6d-9d4b34bd9e5f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:20:30.559134 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0506d4bd-752d-4dea-9a6d-9d4b34bd9e5f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:20:30.559617 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0506d4bd-752d-4dea-9a6d-9d4b34bd9e5f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:20:30.560093 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0506d4bd-752d-4dea-9a6d-9d4b34bd9e5f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:20:30.627257 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0506d4bd-752d-4dea-9a6d-9d4b34bd9e5f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:20:30.635767 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0506d4bd-752d-4dea-9a6d-9d4b34bd9e5f tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/96ffb989-8620-4fe9-96f1-682b0653b06c" status: 200 len: 1225 microversion: 2.1 time: 0.092038 Oct 27 04:20:30.636397 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3723/7157] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:20:30 2022] GET /compute/v2.1/servers/96ffb989-8620-4fe9-96f1-682b0653b06c => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:20:31.658222 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-cb93da4d-cf33-49a3-9472-30644f71deef tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:20:31.658771 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-cb93da4d-cf33-49a3-9472-30644f71deef tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 96ffb989-8620-4fe9-96f1-682b0653b06c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:20:31.665768 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cb93da4d-cf33-49a3-9472-30644f71deef tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:20:31.666295 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cb93da4d-cf33-49a3-9472-30644f71deef tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:20:31.666747 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cb93da4d-cf33-49a3-9472-30644f71deef tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:20:31.667455 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cb93da4d-cf33-49a3-9472-30644f71deef tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:20:31.667919 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cb93da4d-cf33-49a3-9472-30644f71deef tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:20:31.668360 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cb93da4d-cf33-49a3-9472-30644f71deef tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:20:31.730846 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-cb93da4d-cf33-49a3-9472-30644f71deef tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:20:31.740651 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-cb93da4d-cf33-49a3-9472-30644f71deef tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/96ffb989-8620-4fe9-96f1-682b0653b06c" status: 200 len: 1225 microversion: 2.1 time: 0.086387 Oct 27 04:20:31.741818 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3435/7158] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:20:31 2022] GET /compute/v2.1/servers/96ffb989-8620-4fe9-96f1-682b0653b06c => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:20:32.766953 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-bba51f79-05d6-439b-aea6-d5e21c1a97eb tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:20:32.767595 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-bba51f79-05d6-439b-aea6-d5e21c1a97eb tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 96ffb989-8620-4fe9-96f1-682b0653b06c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:20:32.775104 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bba51f79-05d6-439b-aea6-d5e21c1a97eb tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:20:32.775613 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bba51f79-05d6-439b-aea6-d5e21c1a97eb tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:20:32.776077 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bba51f79-05d6-439b-aea6-d5e21c1a97eb tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:20:32.776802 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bba51f79-05d6-439b-aea6-d5e21c1a97eb tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:20:32.777274 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bba51f79-05d6-439b-aea6-d5e21c1a97eb tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:20:32.777723 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bba51f79-05d6-439b-aea6-d5e21c1a97eb tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:20:32.840371 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-bba51f79-05d6-439b-aea6-d5e21c1a97eb tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:20:32.848241 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-bba51f79-05d6-439b-aea6-d5e21c1a97eb tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/96ffb989-8620-4fe9-96f1-682b0653b06c" status: 200 len: 1225 microversion: 2.1 time: 0.085266 Oct 27 04:20:32.852252 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3724/7159] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:20:32 2022] GET /compute/v2.1/servers/96ffb989-8620-4fe9-96f1-682b0653b06c => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:20:33.871346 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-138849d0-d2fb-408a-b397-36eabb06a2d2 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:20:33.871870 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-138849d0-d2fb-408a-b397-36eabb06a2d2 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 96ffb989-8620-4fe9-96f1-682b0653b06c] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:20:33.878776 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-138849d0-d2fb-408a-b397-36eabb06a2d2 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:20:33.879261 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-138849d0-d2fb-408a-b397-36eabb06a2d2 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:20:33.879696 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-138849d0-d2fb-408a-b397-36eabb06a2d2 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:20:33.880388 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-138849d0-d2fb-408a-b397-36eabb06a2d2 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:20:33.880844 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-138849d0-d2fb-408a-b397-36eabb06a2d2 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:20:33.881271 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-138849d0-d2fb-408a-b397-36eabb06a2d2 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:20:33.913887 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-138849d0-d2fb-408a-b397-36eabb06a2d2 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:20:33.915007 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-138849d0-d2fb-408a-b397-36eabb06a2d2 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:20:33.915678 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-138849d0-d2fb-408a-b397-36eabb06a2d2 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:20:33.916140 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-138849d0-d2fb-408a-b397-36eabb06a2d2 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lazy-loading 'fault' on Instance uuid 96ffb989-8620-4fe9-96f1-682b0653b06c {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 04:20:33.957312 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-138849d0-d2fb-408a-b397-36eabb06a2d2 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:20:33.964664 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-138849d0-d2fb-408a-b397-36eabb06a2d2 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/96ffb989-8620-4fe9-96f1-682b0653b06c" status: 200 len: 1184 microversion: 2.1 time: 0.097543 Oct 27 04:20:33.965235 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3436/7160] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:20:33 2022] GET /compute/v2.1/servers/96ffb989-8620-4fe9-96f1-682b0653b06c => generated 1184 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:20:34.987389 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8e4d1811-41eb-44bd-985f-c39e81c8347e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:20:34.988024 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8e4d1811-41eb-44bd-985f-c39e81c8347e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 96ffb989-8620-4fe9-96f1-682b0653b06c] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:20:34.995580 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8e4d1811-41eb-44bd-985f-c39e81c8347e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:20:34.996081 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8e4d1811-41eb-44bd-985f-c39e81c8347e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:20:34.996533 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8e4d1811-41eb-44bd-985f-c39e81c8347e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:20:34.997239 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8e4d1811-41eb-44bd-985f-c39e81c8347e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:20:34.997708 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8e4d1811-41eb-44bd-985f-c39e81c8347e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:20:34.998187 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8e4d1811-41eb-44bd-985f-c39e81c8347e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:20:35.011296 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-8e4d1811-41eb-44bd-985f-c39e81c8347e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] HTTP exception thrown: Instance 96ffb989-8620-4fe9-96f1-682b0653b06c could not be found. Oct 27 04:20:35.013002 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8e4d1811-41eb-44bd-985f-c39e81c8347e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Request method failure captured: Oct 27 04:20:35.013002 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/96ffb989-8620-4fe9-96f1-682b0653b06c HTTP/1.1 Oct 27 04:20:35.013002 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 04:20:35.013002 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 04:20:35.013002 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 04:20:35.013002 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 04:20:35.013002 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 04:20:35.013002 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 04:20:35.013002 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 04:20:35.013002 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 04:20:35.013002 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWgOy2vyGIZvCPgeKqR-dxD7jsV8GSZftvWG3pi0psQTYPv81ATvFSgHi31EMgn0x5NItteNYikimeQ9zcCw_dYQg7rFsVn9VSH-YqZAmUJa-ncyxVumv4r6CMnFhSrRbs_K6XB3pjXRcA1nWSk0V8vccKKBeZUitsa2lCn2gYQAw5hI Oct 27 04:20:35.013002 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 04:20:35.013002 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 04:20:35.013002 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 04:20:35.013002 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 04:20:35.013002 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 04:20:35.013002 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 04:20:35.013002 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 6a6a4f0161c94dc19682d70af00ba684 Oct 27 04:20:35.013002 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-TestVolumeBootPattern-1489988074 Oct 27 04:20:35.013002 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 04:20:35.013002 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 04:20:35.013002 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6a6a4f0161c94dc19682d70af00ba684"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6a6a4f0161c94dc19682d70af00ba684"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6a6a4f0161c94dc19682d70af00ba684"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6a6a4f0161c94dc19682d70af00ba684"}]}] Oct 27 04:20:35.013002 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-TestVolumeBootPattern-1489988074 Oct 27 04:20:35.013002 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 6a6a4f0161c94dc19682d70af00ba684 Oct 27 04:20:35.013002 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-TestVolumeBootPattern-1489988074 Oct 27 04:20:35.013002 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-TestVolumeBootPattern-1489988074-project Oct 27 04:20:35.013002 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 04:20:35.013002 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 04:20:35.013002 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: b7f5c179e8844542bca46d76042a6897 Oct 27 04:20:35.013002 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-TestVolumeBootPattern-1489988074-project Oct 27 04:20:35.013002 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 04:20:35.013002 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 96ffb989-8620-4fe9-96f1-682b0653b06c could not be found. Oct 27 04:20:35.013002 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '96ffb989-8620-4fe9-96f1-682b0653b06c'} Oct 27 04:20:35.013002 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 04:20:35.013002 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:20:35.013002 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 04:20:35.013002 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 04:20:35.013002 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 04:20:35.013002 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 04:20:35.013002 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 04:20:35.013002 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 04:20:35.013002 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 04:20:35.013002 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 04:20:35.013002 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96ffb989-8620-4fe9-96f1-682b0653b06c could not be found. Oct 27 04:20:35.013002 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:20:35.013002 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:20:35.013002 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:20:35.013002 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:20:35.013002 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:20:35.013002 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:20:35.013002 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 04:20:35.013002 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 04:20:35.013002 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 04:20:35.013002 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 04:20:35.013002 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 04:20:35.013002 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 04:20:35.013002 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 04:20:35.013002 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 04:20:35.013002 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 04:20:35.013002 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 04:20:35.013002 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96ffb989-8620-4fe9-96f1-682b0653b06c could not be found. Oct 27 04:20:35.013002 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:20:35.013002 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:20:35.013002 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:20:35.017862 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:20:35.017862 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:20:35.017862 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:20:35.017862 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 04:20:35.017862 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 04:20:35.017862 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96ffb989-8620-4fe9-96f1-682b0653b06c could not be found. Oct 27 04:20:35.017862 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:20:35.017862 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8e4d1811-41eb-44bd-985f-c39e81c8347e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Returning 404 to user: Instance 96ffb989-8620-4fe9-96f1-682b0653b06c could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 04:20:35.017862 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8e4d1811-41eb-44bd-985f-c39e81c8347e tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/96ffb989-8620-4fe9-96f1-682b0653b06c" status: 404 len: 111 microversion: 2.1 time: 0.030967 Oct 27 04:20:35.017862 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3725/7161] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:20:34 2022] GET /compute/v2.1/servers/96ffb989-8620-4fe9-96f1-682b0653b06c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 04:20:41.450912 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0a695f7c-2a7c-49e9-9ee3-bb9b76939342 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:20:41.451456 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0a695f7c-2a7c-49e9-9ee3-bb9b76939342 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: b5db0af3-0257-46be-aa65-5bdc9bc28af8] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:20:41.453022 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-e9f8a213-89a6-4dbd-a13f-2f3826eeb56c req-94926676-5ee7-41c9-a28e-4c910f4124ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5db0af3-0257-46be-aa65-5bdc9bc28af8", "tag": "c541288e-bc2b-43cb-b3d8-781010214c9d"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:20:41.458770 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0a695f7c-2a7c-49e9-9ee3-bb9b76939342 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:20:41.459281 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0a695f7c-2a7c-49e9-9ee3-bb9b76939342 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:20:41.459723 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0a695f7c-2a7c-49e9-9ee3-bb9b76939342 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:20:41.460435 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0a695f7c-2a7c-49e9-9ee3-bb9b76939342 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:20:41.461124 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0a695f7c-2a7c-49e9-9ee3-bb9b76939342 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:20:41.461561 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0a695f7c-2a7c-49e9-9ee3-bb9b76939342 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:20:41.465541 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-e9f8a213-89a6-4dbd-a13f-2f3826eeb56c req-94926676-5ee7-41c9-a28e-4c910f4124ad service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:20:41.466343 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-e9f8a213-89a6-4dbd-a13f-2f3826eeb56c req-94926676-5ee7-41c9-a28e-4c910f4124ad service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:20:41.466863 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-e9f8a213-89a6-4dbd-a13f-2f3826eeb56c req-94926676-5ee7-41c9-a28e-4c910f4124ad service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:20:41.477935 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-e9f8a213-89a6-4dbd-a13f-2f3826eeb56c req-94926676-5ee7-41c9-a28e-4c910f4124ad service nova] Creating event network-changed:c541288e-bc2b-43cb-b3d8-781010214c9d for instance b5db0af3-0257-46be-aa65-5bdc9bc28af8 on n-h2-862769-1 Oct 27 04:20:41.483335 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-e9f8a213-89a6-4dbd-a13f-2f3826eeb56c req-94926676-5ee7-41c9-a28e-4c910f4124ad service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034010 Oct 27 04:20:41.483940 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3726/7162] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:20:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:20:41.492849 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0a695f7c-2a7c-49e9-9ee3-bb9b76939342 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: b5db0af3-0257-46be-aa65-5bdc9bc28af8] Going to try to terminate instance {{(pid=121000) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 04:20:41.730275 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0a695f7c-2a7c-49e9-9ee3-bb9b76939342 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b5db0af3-0257-46be-aa65-5bdc9bc28af8" status: 204 len: 0 microversion: 2.1 time: 0.282948 Oct 27 04:20:41.731277 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3437/7163] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 04:20:41 2022] DELETE /compute/v2.1/servers/b5db0af3-0257-46be-aa65-5bdc9bc28af8 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 04:20:41.740774 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1569359c-9713-471d-868e-c07861503262 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:20:41.742434 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1569359c-9713-471d-868e-c07861503262 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: b5db0af3-0257-46be-aa65-5bdc9bc28af8] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:20:41.748805 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1569359c-9713-471d-868e-c07861503262 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:20:41.749321 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1569359c-9713-471d-868e-c07861503262 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:20:41.749787 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1569359c-9713-471d-868e-c07861503262 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:20:41.750610 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1569359c-9713-471d-868e-c07861503262 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:20:41.751089 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1569359c-9713-471d-868e-c07861503262 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:20:41.751540 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1569359c-9713-471d-868e-c07861503262 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:20:41.890554 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1569359c-9713-471d-868e-c07861503262 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:20:41.899114 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1569359c-9713-471d-868e-c07861503262 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/b5db0af3-0257-46be-aa65-5bdc9bc28af8" status: 200 len: 1577 microversion: 2.1 time: 0.163182 Oct 27 04:20:41.899810 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3727/7164] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:20:41 2022] GET /compute/v2.1/servers/b5db0af3-0257-46be-aa65-5bdc9bc28af8 => generated 1577 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:20:42.896655 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-02cd74f4-8d1d-4ed7-9010-538ace388ef8 req-50da7bba-78eb-492b-a106-ec22a94b295f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5db0af3-0257-46be-aa65-5bdc9bc28af8", "name": "network-vif-deleted", "tag": "c541288e-bc2b-43cb-b3d8-781010214c9d"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:20:42.907548 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-02cd74f4-8d1d-4ed7-9010-538ace388ef8 req-50da7bba-78eb-492b-a106-ec22a94b295f service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:20:42.910077 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-02cd74f4-8d1d-4ed7-9010-538ace388ef8 req-50da7bba-78eb-492b-a106-ec22a94b295f service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:20:42.910077 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-02cd74f4-8d1d-4ed7-9010-538ace388ef8 req-50da7bba-78eb-492b-a106-ec22a94b295f service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:20:42.918708 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-02cd74f4-8d1d-4ed7-9010-538ace388ef8 req-50da7bba-78eb-492b-a106-ec22a94b295f service nova] Creating event network-vif-deleted:c541288e-bc2b-43cb-b3d8-781010214c9d for instance b5db0af3-0257-46be-aa65-5bdc9bc28af8 on n-h2-862769-1 Oct 27 04:20:42.924175 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-02cd74f4-8d1d-4ed7-9010-538ace388ef8 req-50da7bba-78eb-492b-a106-ec22a94b295f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031507 Oct 27 04:20:42.924769 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3438/7165] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:20:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:20:42.932162 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-33bb5bdb-784a-4b73-bfcd-2427b837369b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:20:42.932162 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-33bb5bdb-784a-4b73-bfcd-2427b837369b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: b5db0af3-0257-46be-aa65-5bdc9bc28af8] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:20:42.937258 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-33bb5bdb-784a-4b73-bfcd-2427b837369b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:20:42.937790 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-33bb5bdb-784a-4b73-bfcd-2427b837369b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:20:42.938281 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-33bb5bdb-784a-4b73-bfcd-2427b837369b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:20:42.939008 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-33bb5bdb-784a-4b73-bfcd-2427b837369b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:20:42.939476 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-33bb5bdb-784a-4b73-bfcd-2427b837369b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:20:42.939918 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-33bb5bdb-784a-4b73-bfcd-2427b837369b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:20:43.006410 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-33bb5bdb-784a-4b73-bfcd-2427b837369b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:20:43.014472 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-33bb5bdb-784a-4b73-bfcd-2427b837369b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/b5db0af3-0257-46be-aa65-5bdc9bc28af8" status: 200 len: 1391 microversion: 2.1 time: 0.089371 Oct 27 04:20:43.015055 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3728/7166] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:20:42 2022] GET /compute/v2.1/servers/b5db0af3-0257-46be-aa65-5bdc9bc28af8 => generated 1391 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:20:44.038085 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-af5cee85-c070-43ca-8a0b-3242160fa1ce tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:20:44.038719 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-af5cee85-c070-43ca-8a0b-3242160fa1ce tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: b5db0af3-0257-46be-aa65-5bdc9bc28af8] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:20:44.046043 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-af5cee85-c070-43ca-8a0b-3242160fa1ce tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:20:44.046546 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-af5cee85-c070-43ca-8a0b-3242160fa1ce tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:20:44.046998 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-af5cee85-c070-43ca-8a0b-3242160fa1ce tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:20:44.047706 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-af5cee85-c070-43ca-8a0b-3242160fa1ce tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:20:44.048169 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-af5cee85-c070-43ca-8a0b-3242160fa1ce tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:20:44.048604 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-af5cee85-c070-43ca-8a0b-3242160fa1ce tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:20:44.111690 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-af5cee85-c070-43ca-8a0b-3242160fa1ce tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:20:44.120398 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-af5cee85-c070-43ca-8a0b-3242160fa1ce tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/b5db0af3-0257-46be-aa65-5bdc9bc28af8" status: 200 len: 1224 microversion: 2.1 time: 0.087168 Oct 27 04:20:44.120917 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3439/7167] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:20:44 2022] GET /compute/v2.1/servers/b5db0af3-0257-46be-aa65-5bdc9bc28af8 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:20:45.143609 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0682fc32-66e7-4486-8b4c-82f512e3b810 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:20:45.145549 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0682fc32-66e7-4486-8b4c-82f512e3b810 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: b5db0af3-0257-46be-aa65-5bdc9bc28af8] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:20:45.152466 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0682fc32-66e7-4486-8b4c-82f512e3b810 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:20:45.152971 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0682fc32-66e7-4486-8b4c-82f512e3b810 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:20:45.153429 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0682fc32-66e7-4486-8b4c-82f512e3b810 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:20:45.154170 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0682fc32-66e7-4486-8b4c-82f512e3b810 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:20:45.154645 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0682fc32-66e7-4486-8b4c-82f512e3b810 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:20:45.155090 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0682fc32-66e7-4486-8b4c-82f512e3b810 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:20:45.218274 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0682fc32-66e7-4486-8b4c-82f512e3b810 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:20:45.226773 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0682fc32-66e7-4486-8b4c-82f512e3b810 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/b5db0af3-0257-46be-aa65-5bdc9bc28af8" status: 200 len: 1224 microversion: 2.1 time: 0.087134 Oct 27 04:20:45.227351 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3729/7168] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:20:45 2022] GET /compute/v2.1/servers/b5db0af3-0257-46be-aa65-5bdc9bc28af8 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:20:46.249091 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-79c6500e-c872-46f5-ac9a-831ccea057d3 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:20:46.251724 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-79c6500e-c872-46f5-ac9a-831ccea057d3 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: b5db0af3-0257-46be-aa65-5bdc9bc28af8] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:20:46.259689 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-79c6500e-c872-46f5-ac9a-831ccea057d3 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:20:46.260204 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-79c6500e-c872-46f5-ac9a-831ccea057d3 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:20:46.260798 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-79c6500e-c872-46f5-ac9a-831ccea057d3 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:20:46.261535 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-79c6500e-c872-46f5-ac9a-831ccea057d3 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:20:46.262001 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-79c6500e-c872-46f5-ac9a-831ccea057d3 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:20:46.262456 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-79c6500e-c872-46f5-ac9a-831ccea057d3 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:20:46.341795 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-79c6500e-c872-46f5-ac9a-831ccea057d3 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:20:46.350971 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-79c6500e-c872-46f5-ac9a-831ccea057d3 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/b5db0af3-0257-46be-aa65-5bdc9bc28af8" status: 200 len: 1224 microversion: 2.1 time: 0.105917 Oct 27 04:20:46.351741 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3440/7169] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:20:46 2022] GET /compute/v2.1/servers/b5db0af3-0257-46be-aa65-5bdc9bc28af8 => generated 1224 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:20:47.373218 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8eefca91-b1e5-4e31-b90f-6ed073b25f3a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:20:47.373760 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8eefca91-b1e5-4e31-b90f-6ed073b25f3a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: b5db0af3-0257-46be-aa65-5bdc9bc28af8] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:20:47.381316 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8eefca91-b1e5-4e31-b90f-6ed073b25f3a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:20:47.381823 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8eefca91-b1e5-4e31-b90f-6ed073b25f3a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:20:47.382316 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8eefca91-b1e5-4e31-b90f-6ed073b25f3a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:20:47.383051 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8eefca91-b1e5-4e31-b90f-6ed073b25f3a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:20:47.383730 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8eefca91-b1e5-4e31-b90f-6ed073b25f3a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:20:47.384187 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8eefca91-b1e5-4e31-b90f-6ed073b25f3a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:20:47.415797 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8eefca91-b1e5-4e31-b90f-6ed073b25f3a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:20:47.417098 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8eefca91-b1e5-4e31-b90f-6ed073b25f3a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:20:47.417575 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8eefca91-b1e5-4e31-b90f-6ed073b25f3a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:20:47.418073 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-8eefca91-b1e5-4e31-b90f-6ed073b25f3a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lazy-loading 'fault' on Instance uuid b5db0af3-0257-46be-aa65-5bdc9bc28af8 {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 04:20:47.460814 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8eefca91-b1e5-4e31-b90f-6ed073b25f3a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5c179e8844542bca46d76042a6897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6a4f0161c94dc19682d70af00ba684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:20:47.469212 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8eefca91-b1e5-4e31-b90f-6ed073b25f3a tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/b5db0af3-0257-46be-aa65-5bdc9bc28af8" status: 200 len: 1229 microversion: 2.1 time: 0.099932 Oct 27 04:20:47.469747 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3730/7170] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:20:47 2022] GET /compute/v2.1/servers/b5db0af3-0257-46be-aa65-5bdc9bc28af8 => generated 1229 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:20:48.492931 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-070baf47-e52a-43d7-9e27-723dda6abc81 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:20:48.493545 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-070baf47-e52a-43d7-9e27-723dda6abc81 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: b5db0af3-0257-46be-aa65-5bdc9bc28af8] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:20:48.500428 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-070baf47-e52a-43d7-9e27-723dda6abc81 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:20:48.500910 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-070baf47-e52a-43d7-9e27-723dda6abc81 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:20:48.501347 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-070baf47-e52a-43d7-9e27-723dda6abc81 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:20:48.502060 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-070baf47-e52a-43d7-9e27-723dda6abc81 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:20:48.502528 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-070baf47-e52a-43d7-9e27-723dda6abc81 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:20:48.502954 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-070baf47-e52a-43d7-9e27-723dda6abc81 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:20:48.516004 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-070baf47-e52a-43d7-9e27-723dda6abc81 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] HTTP exception thrown: Instance b5db0af3-0257-46be-aa65-5bdc9bc28af8 could not be found. Oct 27 04:20:48.517681 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-070baf47-e52a-43d7-9e27-723dda6abc81 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Request method failure captured: Oct 27 04:20:48.517681 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/b5db0af3-0257-46be-aa65-5bdc9bc28af8 HTTP/1.1 Oct 27 04:20:48.517681 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 04:20:48.517681 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 04:20:48.517681 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 04:20:48.517681 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 04:20:48.517681 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 04:20:48.517681 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 04:20:48.517681 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 04:20:48.517681 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 04:20:48.517681 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWgOy2vyGIZvCPgeKqR-dxD7jsV8GSZftvWG3pi0psQTYPv81ATvFSgHi31EMgn0x5NItteNYikimeQ9zcCw_dYQg7rFsVn9VSH-YqZAmUJa-ncyxVumv4r6CMnFhSrRbs_K6XB3pjXRcA1nWSk0V8vccKKBeZUitsa2lCn2gYQAw5hI Oct 27 04:20:48.517681 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 04:20:48.517681 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 04:20:48.517681 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 04:20:48.517681 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 04:20:48.517681 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 04:20:48.517681 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 04:20:48.517681 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 6a6a4f0161c94dc19682d70af00ba684 Oct 27 04:20:48.517681 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-TestVolumeBootPattern-1489988074 Oct 27 04:20:48.517681 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 04:20:48.517681 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 04:20:48.517681 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6a6a4f0161c94dc19682d70af00ba684"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6a6a4f0161c94dc19682d70af00ba684"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6a6a4f0161c94dc19682d70af00ba684"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6a6a4f0161c94dc19682d70af00ba684"}]}] Oct 27 04:20:48.517681 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-TestVolumeBootPattern-1489988074 Oct 27 04:20:48.517681 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 6a6a4f0161c94dc19682d70af00ba684 Oct 27 04:20:48.517681 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-TestVolumeBootPattern-1489988074 Oct 27 04:20:48.517681 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-TestVolumeBootPattern-1489988074-project Oct 27 04:20:48.517681 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 04:20:48.517681 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 04:20:48.517681 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: b7f5c179e8844542bca46d76042a6897 Oct 27 04:20:48.517681 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-TestVolumeBootPattern-1489988074-project Oct 27 04:20:48.517681 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 04:20:48.517681 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance b5db0af3-0257-46be-aa65-5bdc9bc28af8 could not be found. Oct 27 04:20:48.517681 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': 'b5db0af3-0257-46be-aa65-5bdc9bc28af8'} Oct 27 04:20:48.517681 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 04:20:48.517681 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:20:48.517681 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 04:20:48.517681 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 04:20:48.517681 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 04:20:48.517681 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 04:20:48.517681 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 04:20:48.517681 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 04:20:48.517681 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 04:20:48.517681 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 04:20:48.517681 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5db0af3-0257-46be-aa65-5bdc9bc28af8 could not be found. Oct 27 04:20:48.517681 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:20:48.517681 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:20:48.517681 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:20:48.517681 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:20:48.517681 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:20:48.517681 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:20:48.517681 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 04:20:48.517681 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 04:20:48.517681 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 04:20:48.517681 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 04:20:48.517681 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 04:20:48.517681 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 04:20:48.517681 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 04:20:48.517681 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 04:20:48.517681 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 04:20:48.517681 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 04:20:48.517681 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5db0af3-0257-46be-aa65-5bdc9bc28af8 could not be found. Oct 27 04:20:48.517681 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:20:48.517681 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:20:48.517681 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:20:48.523131 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:20:48.523131 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:20:48.523131 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:20:48.523131 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 04:20:48.523131 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 04:20:48.523131 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5db0af3-0257-46be-aa65-5bdc9bc28af8 could not be found. Oct 27 04:20:48.523131 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:20:48.523131 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-070baf47-e52a-43d7-9e27-723dda6abc81 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Returning 404 to user: Instance b5db0af3-0257-46be-aa65-5bdc9bc28af8 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 04:20:48.523131 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-070baf47-e52a-43d7-9e27-723dda6abc81 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/b5db0af3-0257-46be-aa65-5bdc9bc28af8" status: 404 len: 111 microversion: 2.1 time: 0.030760 Oct 27 04:20:48.523131 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3441/7171] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:20:48 2022] GET /compute/v2.1/servers/b5db0af3-0257-46be-aa65-5bdc9bc28af8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 04:20:49.024477 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4c0a30fb-66ec-4601-9e0b-81ccb5c83299 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:20:49.025003 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4c0a30fb-66ec-4601-9e0b-81ccb5c83299 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:20:49.031839 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4c0a30fb-66ec-4601-9e0b-81ccb5c83299 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:20:49.032346 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4c0a30fb-66ec-4601-9e0b-81ccb5c83299 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:20:49.032805 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4c0a30fb-66ec-4601-9e0b-81ccb5c83299 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:20:49.033517 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4c0a30fb-66ec-4601-9e0b-81ccb5c83299 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:20:49.033993 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4c0a30fb-66ec-4601-9e0b-81ccb5c83299 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:20:49.034468 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4c0a30fb-66ec-4601-9e0b-81ccb5c83299 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:20:49.048237 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-4c0a30fb-66ec-4601-9e0b-81ccb5c83299 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] HTTP exception thrown: Instance 0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0 could not be found. Oct 27 04:20:49.049913 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4c0a30fb-66ec-4601-9e0b-81ccb5c83299 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Request method failure captured: Oct 27 04:20:49.049913 n-d-862769-1 devstack@n-api.service[121001]: request: DELETE /compute/v2.1/servers/0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0 HTTP/1.1 Oct 27 04:20:49.049913 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 04:20:49.049913 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 04:20:49.049913 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 04:20:49.049913 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 04:20:49.049913 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 04:20:49.049913 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 04:20:49.049913 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 04:20:49.049913 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 04:20:49.049913 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWgOy2vyGIZvCPgeKqR-dxD7jsV8GSZftvWG3pi0psQTYPv81ATvFSgHi31EMgn0x5NItteNYikimeQ9zcCw_dYQg7rFsVn9VSH-YqZAmUJa-ncyxVumv4r6CMnFhSrRbs_K6XB3pjXRcA1nWSk0V8vccKKBeZUitsa2lCn2gYQAw5hI Oct 27 04:20:49.049913 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 04:20:49.049913 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 04:20:49.049913 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 04:20:49.049913 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 04:20:49.049913 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 04:20:49.049913 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 04:20:49.049913 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 6a6a4f0161c94dc19682d70af00ba684 Oct 27 04:20:49.049913 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-TestVolumeBootPattern-1489988074 Oct 27 04:20:49.049913 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 04:20:49.049913 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 04:20:49.049913 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6a6a4f0161c94dc19682d70af00ba684"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6a6a4f0161c94dc19682d70af00ba684"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6a6a4f0161c94dc19682d70af00ba684"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6a6a4f0161c94dc19682d70af00ba684"}]}] Oct 27 04:20:49.049913 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-TestVolumeBootPattern-1489988074 Oct 27 04:20:49.049913 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 6a6a4f0161c94dc19682d70af00ba684 Oct 27 04:20:49.049913 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-TestVolumeBootPattern-1489988074 Oct 27 04:20:49.049913 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-TestVolumeBootPattern-1489988074-project Oct 27 04:20:49.049913 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 04:20:49.049913 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 04:20:49.049913 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: b7f5c179e8844542bca46d76042a6897 Oct 27 04:20:49.049913 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-TestVolumeBootPattern-1489988074-project Oct 27 04:20:49.049913 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 04:20:49.049913 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0 could not be found. Oct 27 04:20:49.049913 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0'} Oct 27 04:20:49.049913 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 04:20:49.049913 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:20:49.049913 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 04:20:49.049913 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 04:20:49.049913 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 04:20:49.049913 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 04:20:49.049913 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 04:20:49.049913 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 04:20:49.049913 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 04:20:49.049913 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 04:20:49.049913 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0 could not be found. Oct 27 04:20:49.049913 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:20:49.049913 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:20:49.049913 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:20:49.049913 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:20:49.049913 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:20:49.049913 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:20:49.049913 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 04:20:49.049913 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 04:20:49.049913 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 04:20:49.049913 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 04:20:49.049913 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 04:20:49.049913 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 04:20:49.049913 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 04:20:49.049913 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 04:20:49.049913 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 04:20:49.049913 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 04:20:49.049913 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 04:20:49.049913 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 04:20:49.054179 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0 could not be found. Oct 27 04:20:49.054179 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:20:49.054179 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:20:49.054179 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:20:49.054179 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:20:49.054179 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:20:49.054179 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:20:49.054179 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 04:20:49.054179 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 04:20:49.054179 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0 could not be found. Oct 27 04:20:49.054179 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:20:49.054179 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4c0a30fb-66ec-4601-9e0b-81ccb5c83299 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Returning 404 to user: Instance 0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 04:20:49.054179 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4c0a30fb-66ec-4601-9e0b-81ccb5c83299 tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0" status: 404 len: 111 microversion: 2.1 time: 0.031430 Oct 27 04:20:49.054179 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3731/7172] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 04:20:49 2022] DELETE /compute/v2.1/servers/0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 04:20:49.059932 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1ff8d2ac-0dae-4c75-b723-acd66a53e4dd tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:20:49.060560 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1ff8d2ac-0dae-4c75-b723-acd66a53e4dd tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] [instance: 0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:20:49.066498 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1ff8d2ac-0dae-4c75-b723-acd66a53e4dd tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:20:49.066988 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1ff8d2ac-0dae-4c75-b723-acd66a53e4dd tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:20:49.067435 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1ff8d2ac-0dae-4c75-b723-acd66a53e4dd tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:20:49.068162 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1ff8d2ac-0dae-4c75-b723-acd66a53e4dd tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:20:49.068622 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1ff8d2ac-0dae-4c75-b723-acd66a53e4dd tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:20:49.069055 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1ff8d2ac-0dae-4c75-b723-acd66a53e4dd tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:20:49.083100 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-1ff8d2ac-0dae-4c75-b723-acd66a53e4dd tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] HTTP exception thrown: Instance 0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0 could not be found. Oct 27 04:20:49.084615 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1ff8d2ac-0dae-4c75-b723-acd66a53e4dd tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Request method failure captured: Oct 27 04:20:49.084615 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0 HTTP/1.1 Oct 27 04:20:49.084615 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 04:20:49.084615 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 04:20:49.084615 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 04:20:49.084615 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 04:20:49.084615 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 04:20:49.084615 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 04:20:49.084615 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 04:20:49.084615 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 04:20:49.084615 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWgOy2vyGIZvCPgeKqR-dxD7jsV8GSZftvWG3pi0psQTYPv81ATvFSgHi31EMgn0x5NItteNYikimeQ9zcCw_dYQg7rFsVn9VSH-YqZAmUJa-ncyxVumv4r6CMnFhSrRbs_K6XB3pjXRcA1nWSk0V8vccKKBeZUitsa2lCn2gYQAw5hI Oct 27 04:20:49.084615 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 04:20:49.084615 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 04:20:49.084615 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 04:20:49.084615 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 04:20:49.084615 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 04:20:49.084615 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 04:20:49.084615 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 6a6a4f0161c94dc19682d70af00ba684 Oct 27 04:20:49.084615 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-TestVolumeBootPattern-1489988074 Oct 27 04:20:49.084615 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 04:20:49.084615 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 04:20:49.084615 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6a6a4f0161c94dc19682d70af00ba684"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6a6a4f0161c94dc19682d70af00ba684"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6a6a4f0161c94dc19682d70af00ba684"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6a6a4f0161c94dc19682d70af00ba684"}]}] Oct 27 04:20:49.084615 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-TestVolumeBootPattern-1489988074 Oct 27 04:20:49.084615 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 6a6a4f0161c94dc19682d70af00ba684 Oct 27 04:20:49.084615 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-TestVolumeBootPattern-1489988074 Oct 27 04:20:49.084615 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-TestVolumeBootPattern-1489988074-project Oct 27 04:20:49.084615 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 04:20:49.084615 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 04:20:49.084615 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: b7f5c179e8844542bca46d76042a6897 Oct 27 04:20:49.084615 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-TestVolumeBootPattern-1489988074-project Oct 27 04:20:49.084615 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 04:20:49.084615 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0 could not be found. Oct 27 04:20:49.084615 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0'} Oct 27 04:20:49.084615 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 04:20:49.084615 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:20:49.084615 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 04:20:49.084615 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 04:20:49.084615 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 04:20:49.084615 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 04:20:49.084615 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 04:20:49.084615 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 04:20:49.084615 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 04:20:49.084615 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 04:20:49.084615 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0 could not be found. Oct 27 04:20:49.084615 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:20:49.084615 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:20:49.084615 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:20:49.084615 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:20:49.084615 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:20:49.084615 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:20:49.084615 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 04:20:49.084615 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 04:20:49.084615 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 04:20:49.084615 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 04:20:49.084615 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 04:20:49.084615 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 04:20:49.084615 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 04:20:49.084615 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 04:20:49.084615 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 04:20:49.084615 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 04:20:49.084615 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0 could not be found. Oct 27 04:20:49.084615 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:20:49.084615 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:20:49.084615 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:20:49.089260 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:20:49.089260 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:20:49.089260 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:20:49.089260 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 04:20:49.089260 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 04:20:49.089260 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0 could not be found. Oct 27 04:20:49.089260 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:20:49.089260 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1ff8d2ac-0dae-4c75-b723-acd66a53e4dd tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Returning 404 to user: Instance 0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 04:20:49.089260 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1ff8d2ac-0dae-4c75-b723-acd66a53e4dd tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "GET /compute/v2.1/servers/0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0" status: 404 len: 111 microversion: 2.1 time: 0.029940 Oct 27 04:20:49.089260 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3442/7173] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:20:49 2022] GET /compute/v2.1/servers/0cf1e4e7-6ab7-44e0-bb35-20c3c80343e0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 04:20:52.690814 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-07465e91-1272-441f-b40a-1ffaf75aa47b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] Calling method '.version_select at 0x7f7dd94de5e0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:20:52.759866 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-07465e91-1272-441f-b40a-1ffaf75aa47b tempest-TestVolumeBootPattern-1489988074 tempest-TestVolumeBootPattern-1489988074-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-784919494" status: 202 len: 0 microversion: 2.1 time: 0.074059 Oct 27 04:20:52.760827 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3732/7174] 10.222.0.20 () {58 vars in 1260 bytes} [Thu Oct 27 04:20:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-784919494 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 04:21:12.731866 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:21:12.732615 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:21:12.853765 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d853f167-b6bd-46f1-b8cd-5b33d79965e3 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-60861107", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:21:12.911775 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-d853f167-b6bd-46f1-b8cd-5b33d79965e3 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] validate_networks() for None {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 04:21:13.188137 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-d853f167-b6bd-46f1-b8cd-5b33d79965e3 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 04:21:13.188571 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-d853f167-b6bd-46f1-b8cd-5b33d79965e3 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 04:21:13.189053 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-d853f167-b6bd-46f1-b8cd-5b33d79965e3 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 04:21:13.189499 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-d853f167-b6bd-46f1-b8cd-5b33d79965e3 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 04:21:13.189921 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-d853f167-b6bd-46f1-b8cd-5b33d79965e3 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 04:21:13.201762 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d853f167-b6bd-46f1-b8cd-5b33d79965e3 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:21:13.202360 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d853f167-b6bd-46f1-b8cd-5b33d79965e3 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:21:13.202803 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d853f167-b6bd-46f1-b8cd-5b33d79965e3 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:21:13.203539 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d853f167-b6bd-46f1-b8cd-5b33d79965e3 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:21:13.203997 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d853f167-b6bd-46f1-b8cd-5b33d79965e3 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:21:13.204429 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d853f167-b6bd-46f1-b8cd-5b33d79965e3 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:21:13.226124 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-d853f167-b6bd-46f1-b8cd-5b33d79965e3 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Getting quotas for project 14ade4cece8a49829db34346fbf571bf. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 04:21:13.231514 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-d853f167-b6bd-46f1-b8cd-5b33d79965e3 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Getting quotas for user 187cfa2c744f44b18764022a8304b108 and project 14ade4cece8a49829db34346fbf571bf. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 04:21:13.244091 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d853f167-b6bd-46f1-b8cd-5b33d79965e3 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 04:21:13.246499 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d853f167-b6bd-46f1-b8cd-5b33d79965e3 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] [instance: b252bea6-7f3c-4c05-b9bf-fe7eca27dc1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 04:21:13.373919 n-d-862769-1 devstack@n-api.service[121000]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d853f167-b6bd-46f1-b8cd-5b33d79965e3 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] [d1e0fee0-c007-4f4b-8cac-c2d0a8595428] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 27 04:21:14.381141 n-d-862769-1 devstack@n-api.service[121000]: INFO oslo.messaging._drivers.impl_rabbit [None req-d853f167-b6bd-46f1-b8cd-5b33d79965e3 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] [d1e0fee0-c007-4f4b-8cac-c2d0a8595428] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 54796. Oct 27 04:21:14.385569 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d853f167-b6bd-46f1-b8cd-5b33d79965e3 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.658899 Oct 27 04:21:14.389052 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3443/7175] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 04:21:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1663 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 04:21:14.399724 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2e90e0fc-b1c1-4e3f-a72f-28ea1abdca5c tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:21:14.400959 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2e90e0fc-b1c1-4e3f-a72f-28ea1abdca5c tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] [instance: b252bea6-7f3c-4c05-b9bf-fe7eca27dc1a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:21:14.404130 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=54 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:21:14.405087 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=29,nova_api:DELETE=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:21:14.468260 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2e90e0fc-b1c1-4e3f-a72f-28ea1abdca5c tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187cfa2c744f44b18764022a8304b108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ade4cece8a49829db34346fbf571bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:21:14.481391 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2e90e0fc-b1c1-4e3f-a72f-28ea1abdca5c tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] 10.222.0.20 "GET /compute/v2.1/servers/b252bea6-7f3c-4c05-b9bf-fe7eca27dc1a" status: 200 len: 1220 microversion: 2.1 time: 0.085786 Oct 27 04:21:14.489456 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3733/7176] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:21:14 2022] GET /compute/v2.1/servers/b252bea6-7f3c-4c05-b9bf-fe7eca27dc1a => generated 1220 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:21:15.505675 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e695323d-31ce-45be-977c-7fb3417f12ee tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:21:15.506333 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e695323d-31ce-45be-977c-7fb3417f12ee tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] [instance: b252bea6-7f3c-4c05-b9bf-fe7eca27dc1a] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:21:15.512482 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e695323d-31ce-45be-977c-7fb3417f12ee tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:21:15.512972 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e695323d-31ce-45be-977c-7fb3417f12ee tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:21:15.513415 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e695323d-31ce-45be-977c-7fb3417f12ee tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:21:15.514138 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e695323d-31ce-45be-977c-7fb3417f12ee tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:21:15.514616 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e695323d-31ce-45be-977c-7fb3417f12ee tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:21:15.515031 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e695323d-31ce-45be-977c-7fb3417f12ee tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:21:15.579817 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e695323d-31ce-45be-977c-7fb3417f12ee tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187cfa2c744f44b18764022a8304b108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ade4cece8a49829db34346fbf571bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:21:15.587962 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e695323d-31ce-45be-977c-7fb3417f12ee tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] 10.222.0.20 "GET /compute/v2.1/servers/b252bea6-7f3c-4c05-b9bf-fe7eca27dc1a" status: 200 len: 1224 microversion: 2.1 time: 0.086889 Oct 27 04:21:15.588606 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3444/7177] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:21:15 2022] GET /compute/v2.1/servers/b252bea6-7f3c-4c05-b9bf-fe7eca27dc1a => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:21:16.613264 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5474e5b9-cc89-4f7d-bc31-8c066c5d8614 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:21:16.613980 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5474e5b9-cc89-4f7d-bc31-8c066c5d8614 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] [instance: b252bea6-7f3c-4c05-b9bf-fe7eca27dc1a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:21:16.624286 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5474e5b9-cc89-4f7d-bc31-8c066c5d8614 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:21:16.624794 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5474e5b9-cc89-4f7d-bc31-8c066c5d8614 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:21:16.625252 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5474e5b9-cc89-4f7d-bc31-8c066c5d8614 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:21:16.627236 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5474e5b9-cc89-4f7d-bc31-8c066c5d8614 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:21:16.627732 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5474e5b9-cc89-4f7d-bc31-8c066c5d8614 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:21:16.628258 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5474e5b9-cc89-4f7d-bc31-8c066c5d8614 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:21:16.716838 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5474e5b9-cc89-4f7d-bc31-8c066c5d8614 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187cfa2c744f44b18764022a8304b108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ade4cece8a49829db34346fbf571bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:21:16.724858 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5474e5b9-cc89-4f7d-bc31-8c066c5d8614 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] 10.222.0.20 "GET /compute/v2.1/servers/b252bea6-7f3c-4c05-b9bf-fe7eca27dc1a" status: 200 len: 1280 microversion: 2.1 time: 0.116143 Oct 27 04:21:16.725679 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3734/7178] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:21:16 2022] GET /compute/v2.1/servers/b252bea6-7f3c-4c05-b9bf-fe7eca27dc1a => generated 1280 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:21:17.748242 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-840c6032-a755-4b05-ba8c-f65ed3459d97 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:21:17.748930 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-840c6032-a755-4b05-ba8c-f65ed3459d97 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] [instance: b252bea6-7f3c-4c05-b9bf-fe7eca27dc1a] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:21:17.756321 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-840c6032-a755-4b05-ba8c-f65ed3459d97 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:21:17.756820 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-840c6032-a755-4b05-ba8c-f65ed3459d97 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:21:17.757381 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-840c6032-a755-4b05-ba8c-f65ed3459d97 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:21:17.758120 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-840c6032-a755-4b05-ba8c-f65ed3459d97 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:21:17.758578 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-840c6032-a755-4b05-ba8c-f65ed3459d97 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:21:17.759009 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-840c6032-a755-4b05-ba8c-f65ed3459d97 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:21:17.901943 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-840c6032-a755-4b05-ba8c-f65ed3459d97 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187cfa2c744f44b18764022a8304b108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ade4cece8a49829db34346fbf571bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:21:17.909837 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-840c6032-a755-4b05-ba8c-f65ed3459d97 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] 10.222.0.20 "GET /compute/v2.1/servers/b252bea6-7f3c-4c05-b9bf-fe7eca27dc1a" status: 200 len: 1320 microversion: 2.1 time: 0.165539 Oct 27 04:21:17.910537 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3445/7179] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:21:17 2022] GET /compute/v2.1/servers/b252bea6-7f3c-4c05-b9bf-fe7eca27dc1a => generated 1320 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:21:18.546789 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-81755d0b-bec4-49fb-ac80-9a86b4a5dbc4 req-98052233-7a81-49c7-a389-5b69c785dfa1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b252bea6-7f3c-4c05-b9bf-fe7eca27dc1a", "tag": "569f1386-3ac2-4233-ba02-bd92872b25d3"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:21:18.557639 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-81755d0b-bec4-49fb-ac80-9a86b4a5dbc4 req-98052233-7a81-49c7-a389-5b69c785dfa1 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:21:18.558162 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-81755d0b-bec4-49fb-ac80-9a86b4a5dbc4 req-98052233-7a81-49c7-a389-5b69c785dfa1 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:21:18.562985 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-81755d0b-bec4-49fb-ac80-9a86b4a5dbc4 req-98052233-7a81-49c7-a389-5b69c785dfa1 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:21:18.569677 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-81755d0b-bec4-49fb-ac80-9a86b4a5dbc4 req-98052233-7a81-49c7-a389-5b69c785dfa1 service nova] Creating event network-changed:569f1386-3ac2-4233-ba02-bd92872b25d3 for instance b252bea6-7f3c-4c05-b9bf-fe7eca27dc1a on n-h1-862769-1 Oct 27 04:21:18.574932 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-81755d0b-bec4-49fb-ac80-9a86b4a5dbc4 req-98052233-7a81-49c7-a389-5b69c785dfa1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032395 Oct 27 04:21:18.575543 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3735/7180] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:21:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:21:18.935816 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2cadf596-bceb-4acd-bb8e-fae110c3960d tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:21:18.936348 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-2cadf596-bceb-4acd-bb8e-fae110c3960d tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] [instance: b252bea6-7f3c-4c05-b9bf-fe7eca27dc1a] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:21:18.943173 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2cadf596-bceb-4acd-bb8e-fae110c3960d tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:21:18.943670 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2cadf596-bceb-4acd-bb8e-fae110c3960d tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:21:18.944122 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2cadf596-bceb-4acd-bb8e-fae110c3960d tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:21:18.944834 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2cadf596-bceb-4acd-bb8e-fae110c3960d tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:21:18.945294 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2cadf596-bceb-4acd-bb8e-fae110c3960d tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:21:18.945737 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2cadf596-bceb-4acd-bb8e-fae110c3960d tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:21:19.075590 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2cadf596-bceb-4acd-bb8e-fae110c3960d tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187cfa2c744f44b18764022a8304b108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ade4cece8a49829db34346fbf571bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:21:19.083333 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2cadf596-bceb-4acd-bb8e-fae110c3960d tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] 10.222.0.20 "GET /compute/v2.1/servers/b252bea6-7f3c-4c05-b9bf-fe7eca27dc1a" status: 200 len: 1320 microversion: 2.1 time: 0.151516 Oct 27 04:21:19.083920 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3446/7181] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:21:18 2022] GET /compute/v2.1/servers/b252bea6-7f3c-4c05-b9bf-fe7eca27dc1a => generated 1320 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:21:20.106842 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c9b6b2e9-b7c9-483b-8f8b-04f5eda1b06c tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:21:20.107536 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c9b6b2e9-b7c9-483b-8f8b-04f5eda1b06c tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] [instance: b252bea6-7f3c-4c05-b9bf-fe7eca27dc1a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:21:20.114570 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c9b6b2e9-b7c9-483b-8f8b-04f5eda1b06c tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:21:20.115077 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c9b6b2e9-b7c9-483b-8f8b-04f5eda1b06c tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:21:20.115539 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c9b6b2e9-b7c9-483b-8f8b-04f5eda1b06c tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:21:20.116254 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c9b6b2e9-b7c9-483b-8f8b-04f5eda1b06c tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:21:20.116727 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c9b6b2e9-b7c9-483b-8f8b-04f5eda1b06c tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:21:20.117179 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c9b6b2e9-b7c9-483b-8f8b-04f5eda1b06c tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:21:20.249756 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c9b6b2e9-b7c9-483b-8f8b-04f5eda1b06c tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187cfa2c744f44b18764022a8304b108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ade4cece8a49829db34346fbf571bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:21:20.257506 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c9b6b2e9-b7c9-483b-8f8b-04f5eda1b06c tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] 10.222.0.20 "GET /compute/v2.1/servers/b252bea6-7f3c-4c05-b9bf-fe7eca27dc1a" status: 200 len: 1320 microversion: 2.1 time: 0.155099 Oct 27 04:21:20.260799 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3736/7182] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:21:20 2022] GET /compute/v2.1/servers/b252bea6-7f3c-4c05-b9bf-fe7eca27dc1a => generated 1320 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:21:21.282344 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7ae70337-e5ba-4331-9224-b4c4f65a59ad tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:21:21.282939 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7ae70337-e5ba-4331-9224-b4c4f65a59ad tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] [instance: b252bea6-7f3c-4c05-b9bf-fe7eca27dc1a] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:21:21.289690 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7ae70337-e5ba-4331-9224-b4c4f65a59ad tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:21:21.290224 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7ae70337-e5ba-4331-9224-b4c4f65a59ad tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:21:21.290738 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7ae70337-e5ba-4331-9224-b4c4f65a59ad tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:21:21.291458 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7ae70337-e5ba-4331-9224-b4c4f65a59ad tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:21:21.291913 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7ae70337-e5ba-4331-9224-b4c4f65a59ad tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:21:21.292339 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7ae70337-e5ba-4331-9224-b4c4f65a59ad tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:21:21.422224 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7ae70337-e5ba-4331-9224-b4c4f65a59ad tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187cfa2c744f44b18764022a8304b108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ade4cece8a49829db34346fbf571bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:21:21.429942 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7ae70337-e5ba-4331-9224-b4c4f65a59ad tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] 10.222.0.20 "GET /compute/v2.1/servers/b252bea6-7f3c-4c05-b9bf-fe7eca27dc1a" status: 200 len: 1320 microversion: 2.1 time: 0.151726 Oct 27 04:21:21.430551 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3447/7183] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:21:21 2022] GET /compute/v2.1/servers/b252bea6-7f3c-4c05-b9bf-fe7eca27dc1a => generated 1320 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:21:22.452969 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-00fcfc2e-1576-4d47-84b8-f38a9c19bc45 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:21:22.453615 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-00fcfc2e-1576-4d47-84b8-f38a9c19bc45 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] [instance: b252bea6-7f3c-4c05-b9bf-fe7eca27dc1a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:21:22.460873 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-00fcfc2e-1576-4d47-84b8-f38a9c19bc45 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:21:22.461515 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-00fcfc2e-1576-4d47-84b8-f38a9c19bc45 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:21:22.461987 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-00fcfc2e-1576-4d47-84b8-f38a9c19bc45 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:21:22.463526 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-00fcfc2e-1576-4d47-84b8-f38a9c19bc45 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:21:22.464128 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-00fcfc2e-1576-4d47-84b8-f38a9c19bc45 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:21:22.464585 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-00fcfc2e-1576-4d47-84b8-f38a9c19bc45 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:21:22.598859 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-00fcfc2e-1576-4d47-84b8-f38a9c19bc45 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187cfa2c744f44b18764022a8304b108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ade4cece8a49829db34346fbf571bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:21:22.607342 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-00fcfc2e-1576-4d47-84b8-f38a9c19bc45 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] 10.222.0.20 "GET /compute/v2.1/servers/b252bea6-7f3c-4c05-b9bf-fe7eca27dc1a" status: 200 len: 1320 microversion: 2.1 time: 0.158458 Oct 27 04:21:22.607913 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3737/7184] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:21:22 2022] GET /compute/v2.1/servers/b252bea6-7f3c-4c05-b9bf-fe7eca27dc1a => generated 1320 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:21:23.629943 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7a021237-d1c1-4b12-9f31-ecc50dddc5dd tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:21:23.630585 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7a021237-d1c1-4b12-9f31-ecc50dddc5dd tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] [instance: b252bea6-7f3c-4c05-b9bf-fe7eca27dc1a] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:21:23.633265 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:21:23.633942 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=6 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:21:23.639006 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7a021237-d1c1-4b12-9f31-ecc50dddc5dd tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:21:23.639489 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7a021237-d1c1-4b12-9f31-ecc50dddc5dd tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:21:23.640017 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7a021237-d1c1-4b12-9f31-ecc50dddc5dd tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:21:23.640718 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7a021237-d1c1-4b12-9f31-ecc50dddc5dd tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:21:23.641172 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7a021237-d1c1-4b12-9f31-ecc50dddc5dd tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:21:23.641597 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7a021237-d1c1-4b12-9f31-ecc50dddc5dd tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:21:23.768584 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7a021237-d1c1-4b12-9f31-ecc50dddc5dd tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187cfa2c744f44b18764022a8304b108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ade4cece8a49829db34346fbf571bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:21:23.776226 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7a021237-d1c1-4b12-9f31-ecc50dddc5dd tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] 10.222.0.20 "GET /compute/v2.1/servers/b252bea6-7f3c-4c05-b9bf-fe7eca27dc1a" status: 200 len: 1320 microversion: 2.1 time: 0.150230 Oct 27 04:21:23.776794 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3448/7185] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:21:23 2022] GET /compute/v2.1/servers/b252bea6-7f3c-4c05-b9bf-fe7eca27dc1a => generated 1320 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:21:24.498537 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:21:24.556971 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-110f8bfe-e250-49cf-a9b1-937c49b1e5e8 req-88cd293d-8479-474d-bf94-831bf2e4e8db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b252bea6-7f3c-4c05-b9bf-fe7eca27dc1a", "name": "network-vif-plugged", "status": "completed", "tag": "569f1386-3ac2-4233-ba02-bd92872b25d3"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:21:24.565765 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-110f8bfe-e250-49cf-a9b1-937c49b1e5e8 req-88cd293d-8479-474d-bf94-831bf2e4e8db service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:21:24.566295 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-110f8bfe-e250-49cf-a9b1-937c49b1e5e8 req-88cd293d-8479-474d-bf94-831bf2e4e8db service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:21:24.566838 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-110f8bfe-e250-49cf-a9b1-937c49b1e5e8 req-88cd293d-8479-474d-bf94-831bf2e4e8db service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:21:24.578966 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-110f8bfe-e250-49cf-a9b1-937c49b1e5e8 req-88cd293d-8479-474d-bf94-831bf2e4e8db service nova] Creating event network-vif-plugged:569f1386-3ac2-4233-ba02-bd92872b25d3 for instance b252bea6-7f3c-4c05-b9bf-fe7eca27dc1a on n-h1-862769-1 Oct 27 04:21:24.584062 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-110f8bfe-e250-49cf-a9b1-937c49b1e5e8 req-88cd293d-8479-474d-bf94-831bf2e4e8db service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091151 Oct 27 04:21:24.584761 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3738/7186] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:21:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:21:24.799309 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-794b5ebf-a0eb-4beb-a1a1-f19d239289a6 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:21:24.799933 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-794b5ebf-a0eb-4beb-a1a1-f19d239289a6 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] [instance: b252bea6-7f3c-4c05-b9bf-fe7eca27dc1a] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:21:24.807652 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-794b5ebf-a0eb-4beb-a1a1-f19d239289a6 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:21:24.808152 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-794b5ebf-a0eb-4beb-a1a1-f19d239289a6 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:21:24.808604 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-794b5ebf-a0eb-4beb-a1a1-f19d239289a6 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:21:24.809313 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-794b5ebf-a0eb-4beb-a1a1-f19d239289a6 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:21:24.809785 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-794b5ebf-a0eb-4beb-a1a1-f19d239289a6 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:21:24.810250 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-794b5ebf-a0eb-4beb-a1a1-f19d239289a6 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:21:24.941850 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-794b5ebf-a0eb-4beb-a1a1-f19d239289a6 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187cfa2c744f44b18764022a8304b108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ade4cece8a49829db34346fbf571bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:21:24.950024 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-794b5ebf-a0eb-4beb-a1a1-f19d239289a6 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] 10.222.0.20 "GET /compute/v2.1/servers/b252bea6-7f3c-4c05-b9bf-fe7eca27dc1a" status: 200 len: 1320 microversion: 2.1 time: 0.154619 Oct 27 04:21:24.950622 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3449/7187] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:21:24 2022] GET /compute/v2.1/servers/b252bea6-7f3c-4c05-b9bf-fe7eca27dc1a => generated 1320 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:21:25.974615 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7c3c572d-0a3a-4571-a6f9-814480d6f39f tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:21:25.975359 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7c3c572d-0a3a-4571-a6f9-814480d6f39f tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] [instance: b252bea6-7f3c-4c05-b9bf-fe7eca27dc1a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:21:25.982506 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7c3c572d-0a3a-4571-a6f9-814480d6f39f tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:21:25.983188 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7c3c572d-0a3a-4571-a6f9-814480d6f39f tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:21:25.983660 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7c3c572d-0a3a-4571-a6f9-814480d6f39f tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:21:25.984455 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7c3c572d-0a3a-4571-a6f9-814480d6f39f tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:21:25.984954 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7c3c572d-0a3a-4571-a6f9-814480d6f39f tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:21:25.985380 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7c3c572d-0a3a-4571-a6f9-814480d6f39f tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:21:26.122090 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7c3c572d-0a3a-4571-a6f9-814480d6f39f tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187cfa2c744f44b18764022a8304b108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ade4cece8a49829db34346fbf571bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:21:26.129822 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7c3c572d-0a3a-4571-a6f9-814480d6f39f tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] 10.222.0.20 "GET /compute/v2.1/servers/b252bea6-7f3c-4c05-b9bf-fe7eca27dc1a" status: 200 len: 1320 microversion: 2.1 time: 0.160640 Oct 27 04:21:26.130428 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3739/7188] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:21:25 2022] GET /compute/v2.1/servers/b252bea6-7f3c-4c05-b9bf-fe7eca27dc1a => generated 1320 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:21:27.153273 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-62d95316-b214-4b8f-b7a3-3404653b354f tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:21:27.153891 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-62d95316-b214-4b8f-b7a3-3404653b354f tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] [instance: b252bea6-7f3c-4c05-b9bf-fe7eca27dc1a] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:21:27.160794 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-62d95316-b214-4b8f-b7a3-3404653b354f tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:21:27.161278 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-62d95316-b214-4b8f-b7a3-3404653b354f tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:21:27.161716 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-62d95316-b214-4b8f-b7a3-3404653b354f tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:21:27.162445 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-62d95316-b214-4b8f-b7a3-3404653b354f tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:21:27.162896 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-62d95316-b214-4b8f-b7a3-3404653b354f tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:21:27.163322 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-62d95316-b214-4b8f-b7a3-3404653b354f tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:21:27.294856 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-62d95316-b214-4b8f-b7a3-3404653b354f tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187cfa2c744f44b18764022a8304b108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ade4cece8a49829db34346fbf571bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:21:27.302541 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-62d95316-b214-4b8f-b7a3-3404653b354f tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] 10.222.0.20 "GET /compute/v2.1/servers/b252bea6-7f3c-4c05-b9bf-fe7eca27dc1a" status: 200 len: 1470 microversion: 2.1 time: 0.153651 Oct 27 04:21:27.303140 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3450/7189] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:21:27 2022] GET /compute/v2.1/servers/b252bea6-7f3c-4c05-b9bf-fe7eca27dc1a => generated 1470 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:21:27.372885 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b49365df-0ac0-4d5e-82d5-8ae42a0cd4fa tempest-ServersAdminNegativeTestJSON-1778648256 tempest-ServersAdminNegativeTestJSON-1778648256-project-admin] Calling method '.version_select at 0x7f7dd9581430>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:21:27.435549 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b49365df-0ac0-4d5e-82d5-8ae42a0cd4fa tempest-ServersAdminNegativeTestJSON-1778648256 tempest-ServersAdminNegativeTestJSON-1778648256-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/d1df8199dcb24c33a7ac1cbba71b00ba" status: 200 len: 371 microversion: 2.1 time: 0.111659 Oct 27 04:21:27.436122 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3740/7190] 10.222.0.20 () {58 vars in 1242 bytes} [Thu Oct 27 04:21:27 2022] GET /compute/v2.1/os-quota-sets/d1df8199dcb24c33a7ac1cbba71b00ba => generated 371 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:21:27.456437 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e4c70215-c3cb-4c13-9680-477d0cf96b38 tempest-ServersAdminNegativeTestJSON-1778648256 tempest-ServersAdminNegativeTestJSON-1778648256-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1347214206", "id": 476445027, "os-flavor-access:is_public": "True"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:21:27.529280 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e4c70215-c3cb-4c13-9680-477d0cf96b38 tempest-ServersAdminNegativeTestJSON-1778648256 tempest-ServersAdminNegativeTestJSON-1778648256-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.076527 Oct 27 04:21:27.529867 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3451/7191] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 04:21:27 2022] POST /compute/v2.1/flavors => generated 435 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:21:27.542548 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-bad954bb-f1a2-4845-a259-e0bc5ffbeb18 tempest-ServersAdminNegativeTestJSON-1778648256 tempest-ServersAdminNegativeTestJSON-1778648256-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "476445027"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:21:27.544810 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-bad954bb-f1a2-4845-a259-e0bc5ffbeb18 tempest-ServersAdminNegativeTestJSON-1778648256 tempest-ServersAdminNegativeTestJSON-1778648256-project-admin] [instance: b252bea6-7f3c-4c05-b9bf-fe7eca27dc1a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:21:27.550799 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bad954bb-f1a2-4845-a259-e0bc5ffbeb18 tempest-ServersAdminNegativeTestJSON-1778648256 tempest-ServersAdminNegativeTestJSON-1778648256-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:21:27.557124 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bad954bb-f1a2-4845-a259-e0bc5ffbeb18 tempest-ServersAdminNegativeTestJSON-1778648256 tempest-ServersAdminNegativeTestJSON-1778648256-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:21:27.557124 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bad954bb-f1a2-4845-a259-e0bc5ffbeb18 tempest-ServersAdminNegativeTestJSON-1778648256 tempest-ServersAdminNegativeTestJSON-1778648256-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:21:27.557124 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bad954bb-f1a2-4845-a259-e0bc5ffbeb18 tempest-ServersAdminNegativeTestJSON-1778648256 tempest-ServersAdminNegativeTestJSON-1778648256-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:21:27.557124 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bad954bb-f1a2-4845-a259-e0bc5ffbeb18 tempest-ServersAdminNegativeTestJSON-1778648256 tempest-ServersAdminNegativeTestJSON-1778648256-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:21:27.557124 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bad954bb-f1a2-4845-a259-e0bc5ffbeb18 tempest-ServersAdminNegativeTestJSON-1778648256 tempest-ServersAdminNegativeTestJSON-1778648256-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:21:27.767317 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-bad954bb-f1a2-4845-a259-e0bc5ffbeb18 tempest-ServersAdminNegativeTestJSON-1778648256 tempest-ServersAdminNegativeTestJSON-1778648256-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '64590733e1b2419d95449277bc595587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1df8199dcb24c33a7ac1cbba71b00ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:21:27.773698 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-bad954bb-f1a2-4845-a259-e0bc5ffbeb18 tempest-ServersAdminNegativeTestJSON-1778648256 tempest-ServersAdminNegativeTestJSON-1778648256-project-admin] [instance: b252bea6-7f3c-4c05-b9bf-fe7eca27dc1a] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1347214206 {{(pid=121001) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 27 04:21:27.780381 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bad954bb-f1a2-4845-a259-e0bc5ffbeb18 tempest-ServersAdminNegativeTestJSON-1778648256 tempest-ServersAdminNegativeTestJSON-1778648256-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:21:27.780880 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bad954bb-f1a2-4845-a259-e0bc5ffbeb18 tempest-ServersAdminNegativeTestJSON-1778648256 tempest-ServersAdminNegativeTestJSON-1778648256-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:21:27.781333 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bad954bb-f1a2-4845-a259-e0bc5ffbeb18 tempest-ServersAdminNegativeTestJSON-1778648256 tempest-ServersAdminNegativeTestJSON-1778648256-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:21:27.782111 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bad954bb-f1a2-4845-a259-e0bc5ffbeb18 tempest-ServersAdminNegativeTestJSON-1778648256 tempest-ServersAdminNegativeTestJSON-1778648256-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:21:27.782583 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bad954bb-f1a2-4845-a259-e0bc5ffbeb18 tempest-ServersAdminNegativeTestJSON-1778648256 tempest-ServersAdminNegativeTestJSON-1778648256-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:21:27.783027 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bad954bb-f1a2-4845-a259-e0bc5ffbeb18 tempest-ServersAdminNegativeTestJSON-1778648256 tempest-ServersAdminNegativeTestJSON-1778648256-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:21:27.805069 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-bad954bb-f1a2-4845-a259-e0bc5ffbeb18 tempest-ServersAdminNegativeTestJSON-1778648256 tempest-ServersAdminNegativeTestJSON-1778648256-project-admin] Getting quotas for project 14ade4cece8a49829db34346fbf571bf. Resources: {'cores', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 04:21:27.810647 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-bad954bb-f1a2-4845-a259-e0bc5ffbeb18 tempest-ServersAdminNegativeTestJSON-1778648256 tempest-ServersAdminNegativeTestJSON-1778648256-project-admin] Getting quotas for user 187cfa2c744f44b18764022a8304b108 and project 14ade4cece8a49829db34346fbf571bf. Resources: {'cores', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 04:21:27.823485 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.compute.api [None req-bad954bb-f1a2-4845-a259-e0bc5ffbeb18 tempest-ServersAdminNegativeTestJSON-1778648256 tempest-ServersAdminNegativeTestJSON-1778648256-project-admin] ram quota exceeded for d1df8199dcb24c33a7ac1cbba71b00ba, tried to resize instance. Oct 27 04:21:27.824050 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-bad954bb-f1a2-4845-a259-e0bc5ffbeb18 tempest-ServersAdminNegativeTestJSON-1778648256 tempest-ServersAdminNegativeTestJSON-1778648256-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 27 04:21:27.826157 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-bad954bb-f1a2-4845-a259-e0bc5ffbeb18 tempest-ServersAdminNegativeTestJSON-1778648256 tempest-ServersAdminNegativeTestJSON-1778648256-project-admin] Request method failure captured: Oct 27 04:21:27.826157 n-d-862769-1 devstack@n-api.service[121001]: request: POST /compute/v2.1/servers/b252bea6-7f3c-4c05-b9bf-fe7eca27dc1a/action HTTP/1.1 Oct 27 04:21:27.826157 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 04:21:27.826157 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 04:21:27.826157 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 04:21:27.826157 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 38 Oct 27 04:21:27.826157 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 04:21:27.826157 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 04:21:27.826157 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 04:21:27.826157 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 04:21:27.826157 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWgc4tvt5bbbDnFV6kYs4kRbgtdpeJ0Mw4cPDAbtehdfyidvhKitWD6Gw-btrg6nvWa-FMchWQSBq9EL2jL4LEJ8STVZoo4ZfyxbNeGUyrsRq1vHBe8Ecq1CXn8Bf6RcEz1RmbDfZPY4IxGmZH_zX1UOh9OwZMJRD9vBZ8ixgYeehEW4 Oct 27 04:21:27.826157 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 04:21:27.826157 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 04:21:27.826157 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 04:21:27.826157 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 04:21:27.826157 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 04:21:27.826157 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 04:21:27.826157 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: d1df8199dcb24c33a7ac1cbba71b00ba Oct 27 04:21:27.826157 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1778648256 Oct 27 04:21:27.826157 n-d-862769-1 devstack@n-api.service[121001]: X-Role: admin,member,reader Oct 27 04:21:27.826157 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: admin,member,reader Oct 27 04:21:27.826157 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d1df8199dcb24c33a7ac1cbba71b00ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d1df8199dcb24c33a7ac1cbba71b00ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d1df8199dcb24c33a7ac1cbba71b00ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d1df8199dcb24c33a7ac1cbba71b00ba"}]}] Oct 27 04:21:27.826157 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1778648256 Oct 27 04:21:27.826157 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: d1df8199dcb24c33a7ac1cbba71b00ba Oct 27 04:21:27.826157 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1778648256 Oct 27 04:21:27.826157 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServersAdminNegativeTestJSON-1778648256-project-admin Oct 27 04:21:27.826157 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 04:21:27.826157 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 04:21:27.826157 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 64590733e1b2419d95449277bc595587 Oct 27 04:21:27.826157 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1778648256-project-admin Oct 27 04:21:27.826157 n-d-862769-1 devstack@n-api.service[121001]: Oct 27 04:21:27.826157 n-d-862769-1 devstack@n-api.service[121001]: {"resize": {"flavorRef": "476445027"}} Oct 27 04:21:27.826157 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 04:21:27.826157 n-d-862769-1 devstack@n-api.service[121001]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 27 04:21:27.826157 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': 'b252bea6-7f3c-4c05-b9bf-fe7eca27dc1a', 'body': {'resize': {'flavorRef': '476445027'}}} Oct 27 04:21:27.826157 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 04:21:27.826157 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:21:27.826157 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 27 04:21:27.826157 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 27 04:21:27.826157 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 04:21:27.826157 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 04:21:27.826157 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 27 04:21:27.826157 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc Oct 27 04:21:27.826157 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 27 04:21:27.826157 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 27 04:21:27.826157 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 04:21:27.826157 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 04:21:27.826157 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 27 04:21:27.826157 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 27 04:21:27.826157 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 27 04:21:27.826157 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 27 04:21:27.826157 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 27 04:21:27.826157 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 27 04:21:27.826157 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 27 04:21:27.826157 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:21:27.826157 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:21:27.826157 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:21:27.826157 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:21:27.826157 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 27 04:21:27.826157 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 27 04:21:27.826157 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 27 04:21:27.826157 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 04:21:27.826157 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 27 04:21:27.831048 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 27 04:21:27.831048 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 27 04:21:27.831048 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 27 04:21:27.831048 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 04:21:27.831048 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 04:21:27.831048 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 27 04:21:27.831048 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 27 04:21:27.831048 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 27 04:21:27.831048 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 04:21:27.831048 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 27 04:21:27.831048 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 27 04:21:27.831048 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 27 04:21:27.831048 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 27 04:21:27.831048 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 27 04:21:27.831048 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:21:27.831048 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:21:27.831048 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:21:27.831048 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:21:27.831048 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:21:27.831048 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:21:27.831048 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 04:21:27.831048 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 04:21:27.831048 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 04:21:27.831048 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 04:21:27.831048 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 04:21:27.831048 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 04:21:27.831048 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 27 04:21:27.831048 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 27 04:21:27.831048 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 27 04:21:27.831048 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 27 04:21:27.831048 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 27 04:21:27.831048 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:21:27.831048 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:21:27.831048 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:21:27.831048 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:21:27.831048 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:21:27.831048 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:21:27.831048 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 04:21:27.831048 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 04:21:27.831048 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 27 04:21:27.831048 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:21:27.831048 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-bad954bb-f1a2-4845-a259-e0bc5ffbeb18 tempest-ServersAdminNegativeTestJSON-1778648256 tempest-ServersAdminNegativeTestJSON-1778648256-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 04:21:27.831048 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-bad954bb-f1a2-4845-a259-e0bc5ffbeb18 tempest-ServersAdminNegativeTestJSON-1778648256 tempest-ServersAdminNegativeTestJSON-1778648256-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/b252bea6-7f3c-4c05-b9bf-fe7eca27dc1a/action" status: 403 len: 118 microversion: 2.1 time: 0.289199 Oct 27 04:21:27.831048 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3741/7192] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 04:21:27 2022] POST /compute/v2.1/servers/b252bea6-7f3c-4c05-b9bf-fe7eca27dc1a/action => generated 118 bytes in 290 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 04:21:27.836822 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b9440d6e-a1fd-4734-bb54-4308dadfaf3a tempest-ServersAdminNegativeTestJSON-1778648256 tempest-ServersAdminNegativeTestJSON-1778648256-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:21:27.906056 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b9440d6e-a1fd-4734-bb54-4308dadfaf3a tempest-ServersAdminNegativeTestJSON-1778648256 tempest-ServersAdminNegativeTestJSON-1778648256-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/476445027" status: 202 len: 0 microversion: 2.1 time: 0.073111 Oct 27 04:21:27.906649 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3452/7193] 10.222.0.20 () {58 vars in 1158 bytes} [Thu Oct 27 04:21:27 2022] DELETE /compute/v2.1/flavors/476445027 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 04:21:27.914589 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d2bc6e94-5aeb-44eb-aeb6-5394d887c6b1 tempest-ServersAdminNegativeTestJSON-1778648256 tempest-ServersAdminNegativeTestJSON-1778648256-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:21:27.939078 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d2bc6e94-5aeb-44eb-aeb6-5394d887c6b1 tempest-ServersAdminNegativeTestJSON-1778648256 tempest-ServersAdminNegativeTestJSON-1778648256-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028142 Oct 27 04:21:27.939629 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3742/7194] 10.222.0.20 () {58 vars in 1146 bytes} [Thu Oct 27 04:21:27 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:21:27.961973 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4c6191fc-5351-417b-920b-1835cce171b0 tempest-ServersAdminNegativeTestJSON-1778648256 tempest-ServersAdminNegativeTestJSON-1778648256-project-admin] Calling method '.version_select at 0x7f7dd988ec10>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:21:28.030271 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4c6191fc-5351-417b-920b-1835cce171b0 tempest-ServersAdminNegativeTestJSON-1778648256 tempest-ServersAdminNegativeTestJSON-1778648256-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/d1df8199dcb24c33a7ac1cbba71b00ba" status: 200 len: 371 microversion: 2.1 time: 0.071901 Oct 27 04:21:28.030851 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3453/7195] 10.222.0.20 () {58 vars in 1242 bytes} [Thu Oct 27 04:21:27 2022] GET /compute/v2.1/os-quota-sets/d1df8199dcb24c33a7ac1cbba71b00ba => generated 371 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:21:28.043220 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-cd6dc91f-9d68-422d-a091-14a406a7be11 tempest-ServersAdminNegativeTestJSON-1778648256 tempest-ServersAdminNegativeTestJSON-1778648256-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1510029879", "id": 480181939, "os-flavor-access:is_public": "True"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:21:28.134457 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-cd6dc91f-9d68-422d-a091-14a406a7be11 tempest-ServersAdminNegativeTestJSON-1778648256 tempest-ServersAdminNegativeTestJSON-1778648256-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.095434 Oct 27 04:21:28.135052 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3743/7196] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 04:21:28 2022] POST /compute/v2.1/flavors => generated 434 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:21:28.147646 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a8bc18a3-0aa9-48d9-8511-a097651933dc tempest-ServersAdminNegativeTestJSON-1778648256 tempest-ServersAdminNegativeTestJSON-1778648256-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "480181939"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:21:28.149998 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a8bc18a3-0aa9-48d9-8511-a097651933dc tempest-ServersAdminNegativeTestJSON-1778648256 tempest-ServersAdminNegativeTestJSON-1778648256-project-admin] [instance: b252bea6-7f3c-4c05-b9bf-fe7eca27dc1a] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:21:28.156091 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a8bc18a3-0aa9-48d9-8511-a097651933dc tempest-ServersAdminNegativeTestJSON-1778648256 tempest-ServersAdminNegativeTestJSON-1778648256-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:21:28.156681 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a8bc18a3-0aa9-48d9-8511-a097651933dc tempest-ServersAdminNegativeTestJSON-1778648256 tempest-ServersAdminNegativeTestJSON-1778648256-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:21:28.157021 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a8bc18a3-0aa9-48d9-8511-a097651933dc tempest-ServersAdminNegativeTestJSON-1778648256 tempest-ServersAdminNegativeTestJSON-1778648256-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:21:28.157744 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a8bc18a3-0aa9-48d9-8511-a097651933dc tempest-ServersAdminNegativeTestJSON-1778648256 tempest-ServersAdminNegativeTestJSON-1778648256-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:21:28.159922 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a8bc18a3-0aa9-48d9-8511-a097651933dc tempest-ServersAdminNegativeTestJSON-1778648256 tempest-ServersAdminNegativeTestJSON-1778648256-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:21:28.159922 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a8bc18a3-0aa9-48d9-8511-a097651933dc tempest-ServersAdminNegativeTestJSON-1778648256 tempest-ServersAdminNegativeTestJSON-1778648256-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:21:28.320152 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a8bc18a3-0aa9-48d9-8511-a097651933dc tempest-ServersAdminNegativeTestJSON-1778648256 tempest-ServersAdminNegativeTestJSON-1778648256-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '64590733e1b2419d95449277bc595587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1df8199dcb24c33a7ac1cbba71b00ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:21:28.326404 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a8bc18a3-0aa9-48d9-8511-a097651933dc tempest-ServersAdminNegativeTestJSON-1778648256 tempest-ServersAdminNegativeTestJSON-1778648256-project-admin] [instance: b252bea6-7f3c-4c05-b9bf-fe7eca27dc1a] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1510029879 {{(pid=121000) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 27 04:21:28.332811 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a8bc18a3-0aa9-48d9-8511-a097651933dc tempest-ServersAdminNegativeTestJSON-1778648256 tempest-ServersAdminNegativeTestJSON-1778648256-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:21:28.333299 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a8bc18a3-0aa9-48d9-8511-a097651933dc tempest-ServersAdminNegativeTestJSON-1778648256 tempest-ServersAdminNegativeTestJSON-1778648256-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:21:28.333739 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a8bc18a3-0aa9-48d9-8511-a097651933dc tempest-ServersAdminNegativeTestJSON-1778648256 tempest-ServersAdminNegativeTestJSON-1778648256-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:21:28.334513 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a8bc18a3-0aa9-48d9-8511-a097651933dc tempest-ServersAdminNegativeTestJSON-1778648256 tempest-ServersAdminNegativeTestJSON-1778648256-project-admin] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:21:28.334974 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a8bc18a3-0aa9-48d9-8511-a097651933dc tempest-ServersAdminNegativeTestJSON-1778648256 tempest-ServersAdminNegativeTestJSON-1778648256-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:21:28.335406 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a8bc18a3-0aa9-48d9-8511-a097651933dc tempest-ServersAdminNegativeTestJSON-1778648256 tempest-ServersAdminNegativeTestJSON-1778648256-project-admin] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:21:28.356747 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-a8bc18a3-0aa9-48d9-8511-a097651933dc tempest-ServersAdminNegativeTestJSON-1778648256 tempest-ServersAdminNegativeTestJSON-1778648256-project-admin] Getting quotas for project 14ade4cece8a49829db34346fbf571bf. Resources: {'cores', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 04:21:28.361749 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-a8bc18a3-0aa9-48d9-8511-a097651933dc tempest-ServersAdminNegativeTestJSON-1778648256 tempest-ServersAdminNegativeTestJSON-1778648256-project-admin] Getting quotas for user 187cfa2c744f44b18764022a8304b108 and project 14ade4cece8a49829db34346fbf571bf. Resources: {'cores', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 04:21:28.374543 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.compute.api [None req-a8bc18a3-0aa9-48d9-8511-a097651933dc tempest-ServersAdminNegativeTestJSON-1778648256 tempest-ServersAdminNegativeTestJSON-1778648256-project-admin] cores quota exceeded for d1df8199dcb24c33a7ac1cbba71b00ba, tried to resize instance. Oct 27 04:21:28.375091 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-a8bc18a3-0aa9-48d9-8511-a097651933dc tempest-ServersAdminNegativeTestJSON-1778648256 tempest-ServersAdminNegativeTestJSON-1778648256-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 27 04:21:28.377027 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a8bc18a3-0aa9-48d9-8511-a097651933dc tempest-ServersAdminNegativeTestJSON-1778648256 tempest-ServersAdminNegativeTestJSON-1778648256-project-admin] Request method failure captured: Oct 27 04:21:28.377027 n-d-862769-1 devstack@n-api.service[121000]: request: POST /compute/v2.1/servers/b252bea6-7f3c-4c05-b9bf-fe7eca27dc1a/action HTTP/1.1 Oct 27 04:21:28.377027 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 04:21:28.377027 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 04:21:28.377027 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 04:21:28.377027 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 38 Oct 27 04:21:28.377027 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 04:21:28.377027 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 04:21:28.377027 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 04:21:28.377027 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 04:21:28.377027 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWgc4tvt5bbbDnFV6kYs4kRbgtdpeJ0Mw4cPDAbtehdfyidvhKitWD6Gw-btrg6nvWa-FMchWQSBq9EL2jL4LEJ8STVZoo4ZfyxbNeGUyrsRq1vHBe8Ecq1CXn8Bf6RcEz1RmbDfZPY4IxGmZH_zX1UOh9OwZMJRD9vBZ8ixgYeehEW4 Oct 27 04:21:28.377027 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 04:21:28.377027 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 04:21:28.377027 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 04:21:28.377027 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 04:21:28.377027 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 04:21:28.377027 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 04:21:28.377027 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: d1df8199dcb24c33a7ac1cbba71b00ba Oct 27 04:21:28.377027 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1778648256 Oct 27 04:21:28.377027 n-d-862769-1 devstack@n-api.service[121000]: X-Role: admin,member,reader Oct 27 04:21:28.377027 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: admin,member,reader Oct 27 04:21:28.377027 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d1df8199dcb24c33a7ac1cbba71b00ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d1df8199dcb24c33a7ac1cbba71b00ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d1df8199dcb24c33a7ac1cbba71b00ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d1df8199dcb24c33a7ac1cbba71b00ba"}]}] Oct 27 04:21:28.377027 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1778648256 Oct 27 04:21:28.377027 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: d1df8199dcb24c33a7ac1cbba71b00ba Oct 27 04:21:28.377027 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1778648256 Oct 27 04:21:28.377027 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ServersAdminNegativeTestJSON-1778648256-project-admin Oct 27 04:21:28.377027 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 04:21:28.377027 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 04:21:28.377027 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 64590733e1b2419d95449277bc595587 Oct 27 04:21:28.377027 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1778648256-project-admin Oct 27 04:21:28.377027 n-d-862769-1 devstack@n-api.service[121000]: Oct 27 04:21:28.377027 n-d-862769-1 devstack@n-api.service[121000]: {"resize": {"flavorRef": "480181939"}} Oct 27 04:21:28.377027 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 04:21:28.377027 n-d-862769-1 devstack@n-api.service[121000]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 27 04:21:28.377027 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': 'b252bea6-7f3c-4c05-b9bf-fe7eca27dc1a', 'body': {'resize': {'flavorRef': '480181939'}}} Oct 27 04:21:28.377027 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 04:21:28.377027 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:21:28.377027 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 27 04:21:28.377027 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 27 04:21:28.377027 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 04:21:28.377027 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 04:21:28.377027 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 27 04:21:28.377027 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc Oct 27 04:21:28.377027 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 27 04:21:28.377027 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 27 04:21:28.377027 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 04:21:28.377027 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 04:21:28.377027 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 27 04:21:28.377027 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 27 04:21:28.377027 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 27 04:21:28.377027 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 27 04:21:28.377027 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 27 04:21:28.377027 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 27 04:21:28.377027 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 27 04:21:28.377027 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:21:28.377027 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:21:28.377027 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:21:28.377027 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:21:28.377027 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 27 04:21:28.377027 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 27 04:21:28.377027 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 27 04:21:28.377027 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 04:21:28.377027 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 27 04:21:28.381496 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 27 04:21:28.381496 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 27 04:21:28.381496 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 27 04:21:28.381496 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 04:21:28.381496 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 04:21:28.381496 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 27 04:21:28.381496 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 27 04:21:28.381496 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 27 04:21:28.381496 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 04:21:28.381496 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 27 04:21:28.381496 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 27 04:21:28.381496 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 27 04:21:28.381496 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 27 04:21:28.381496 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 27 04:21:28.381496 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:21:28.381496 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:21:28.381496 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:21:28.381496 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:21:28.381496 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:21:28.381496 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:21:28.381496 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 04:21:28.381496 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 04:21:28.381496 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 04:21:28.381496 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 04:21:28.381496 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 04:21:28.381496 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 04:21:28.381496 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 27 04:21:28.381496 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 27 04:21:28.381496 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 27 04:21:28.381496 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 27 04:21:28.381496 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 27 04:21:28.381496 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:21:28.381496 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:21:28.381496 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:21:28.381496 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:21:28.381496 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:21:28.381496 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:21:28.381496 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 04:21:28.381496 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 04:21:28.381496 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 27 04:21:28.381496 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:21:28.381496 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a8bc18a3-0aa9-48d9-8511-a097651933dc tempest-ServersAdminNegativeTestJSON-1778648256 tempest-ServersAdminNegativeTestJSON-1778648256-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 04:21:28.381496 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a8bc18a3-0aa9-48d9-8511-a097651933dc tempest-ServersAdminNegativeTestJSON-1778648256 tempest-ServersAdminNegativeTestJSON-1778648256-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/b252bea6-7f3c-4c05-b9bf-fe7eca27dc1a/action" status: 403 len: 113 microversion: 2.1 time: 0.234869 Oct 27 04:21:28.381496 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3454/7197] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 04:21:28 2022] POST /compute/v2.1/servers/b252bea6-7f3c-4c05-b9bf-fe7eca27dc1a/action => generated 113 bytes in 236 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 04:21:28.387157 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-92b5c4e5-19e2-4a5c-ac53-cd8612b514f6 tempest-ServersAdminNegativeTestJSON-1778648256 tempest-ServersAdminNegativeTestJSON-1778648256-project-admin] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:21:28.460359 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-92b5c4e5-19e2-4a5c-ac53-cd8612b514f6 tempest-ServersAdminNegativeTestJSON-1778648256 tempest-ServersAdminNegativeTestJSON-1778648256-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/480181939" status: 202 len: 0 microversion: 2.1 time: 0.076883 Oct 27 04:21:28.460936 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3744/7198] 10.222.0.20 () {58 vars in 1158 bytes} [Thu Oct 27 04:21:28 2022] DELETE /compute/v2.1/flavors/480181939 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 04:21:28.469750 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4c7133ed-0598-425c-8e12-6fb15dc72a35 tempest-ServersAdminNegativeTestJSON-1778648256 tempest-ServersAdminNegativeTestJSON-1778648256-project-admin] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:21:28.490384 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4c7133ed-0598-425c-8e12-6fb15dc72a35 tempest-ServersAdminNegativeTestJSON-1778648256 tempest-ServersAdminNegativeTestJSON-1778648256-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024211 Oct 27 04:21:28.490966 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3455/7199] 10.222.0.20 () {58 vars in 1146 bytes} [Thu Oct 27 04:21:28 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:21:28.511800 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-93dea4c2-f5a8-4ebc-bfdb-6e5c8fccd141 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:21:28.517640 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-93dea4c2-f5a8-4ebc-bfdb-6e5c8fccd141 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] [instance: b252bea6-7f3c-4c05-b9bf-fe7eca27dc1a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:21:28.519226 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-93dea4c2-f5a8-4ebc-bfdb-6e5c8fccd141 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:21:28.519760 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-93dea4c2-f5a8-4ebc-bfdb-6e5c8fccd141 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:21:28.520221 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-93dea4c2-f5a8-4ebc-bfdb-6e5c8fccd141 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:21:28.520972 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-93dea4c2-f5a8-4ebc-bfdb-6e5c8fccd141 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:21:28.521418 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-93dea4c2-f5a8-4ebc-bfdb-6e5c8fccd141 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:21:28.521871 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-93dea4c2-f5a8-4ebc-bfdb-6e5c8fccd141 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:21:28.547377 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-93dea4c2-f5a8-4ebc-bfdb-6e5c8fccd141 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] [instance: b252bea6-7f3c-4c05-b9bf-fe7eca27dc1a] Going to try to terminate instance {{(pid=121001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 04:21:28.752163 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-93dea4c2-f5a8-4ebc-bfdb-6e5c8fccd141 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b252bea6-7f3c-4c05-b9bf-fe7eca27dc1a" status: 204 len: 0 microversion: 2.1 time: 0.243984 Oct 27 04:21:28.752685 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3745/7200] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 04:21:28 2022] DELETE /compute/v2.1/servers/b252bea6-7f3c-4c05-b9bf-fe7eca27dc1a => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 04:21:28.761499 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d27b6d1c-1979-40e6-ab08-2c3d7e7c5494 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:21:28.762162 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d27b6d1c-1979-40e6-ab08-2c3d7e7c5494 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] [instance: b252bea6-7f3c-4c05-b9bf-fe7eca27dc1a] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:21:28.768232 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d27b6d1c-1979-40e6-ab08-2c3d7e7c5494 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:21:28.769055 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d27b6d1c-1979-40e6-ab08-2c3d7e7c5494 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:21:28.769514 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d27b6d1c-1979-40e6-ab08-2c3d7e7c5494 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:21:28.770389 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d27b6d1c-1979-40e6-ab08-2c3d7e7c5494 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:21:28.770864 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d27b6d1c-1979-40e6-ab08-2c3d7e7c5494 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:21:28.771304 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d27b6d1c-1979-40e6-ab08-2c3d7e7c5494 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:21:28.898916 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d27b6d1c-1979-40e6-ab08-2c3d7e7c5494 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187cfa2c744f44b18764022a8304b108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ade4cece8a49829db34346fbf571bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:21:28.907268 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d27b6d1c-1979-40e6-ab08-2c3d7e7c5494 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] 10.222.0.20 "GET /compute/v2.1/servers/b252bea6-7f3c-4c05-b9bf-fe7eca27dc1a" status: 200 len: 1476 microversion: 2.1 time: 0.150306 Oct 27 04:21:28.907834 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3456/7201] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:21:28 2022] GET /compute/v2.1/servers/b252bea6-7f3c-4c05-b9bf-fe7eca27dc1a => generated 1476 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:21:29.930843 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-386e8191-17a2-4749-a5cf-dd5a5ae9d2da tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:21:29.931572 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-386e8191-17a2-4749-a5cf-dd5a5ae9d2da tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] [instance: b252bea6-7f3c-4c05-b9bf-fe7eca27dc1a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:21:29.937828 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-386e8191-17a2-4749-a5cf-dd5a5ae9d2da tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:21:29.938424 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-386e8191-17a2-4749-a5cf-dd5a5ae9d2da tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:21:29.938881 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-386e8191-17a2-4749-a5cf-dd5a5ae9d2da tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:21:29.939582 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-386e8191-17a2-4749-a5cf-dd5a5ae9d2da tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:21:29.940054 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-386e8191-17a2-4749-a5cf-dd5a5ae9d2da tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:21:29.940495 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-386e8191-17a2-4749-a5cf-dd5a5ae9d2da tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:21:30.075017 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-386e8191-17a2-4749-a5cf-dd5a5ae9d2da tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187cfa2c744f44b18764022a8304b108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ade4cece8a49829db34346fbf571bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:21:30.082740 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-386e8191-17a2-4749-a5cf-dd5a5ae9d2da tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] 10.222.0.20 "GET /compute/v2.1/servers/b252bea6-7f3c-4c05-b9bf-fe7eca27dc1a" status: 200 len: 1476 microversion: 2.1 time: 0.156261 Oct 27 04:21:30.083323 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3746/7202] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:21:29 2022] GET /compute/v2.1/servers/b252bea6-7f3c-4c05-b9bf-fe7eca27dc1a => generated 1476 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:21:30.693823 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-347977d2-53fc-426e-8f5c-763ab8e76aab req-2b75d416-7d77-4b7a-b3bb-c034dc23f065 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b252bea6-7f3c-4c05-b9bf-fe7eca27dc1a", "name": "network-vif-deleted", "tag": "569f1386-3ac2-4233-ba02-bd92872b25d3"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:21:30.704911 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-347977d2-53fc-426e-8f5c-763ab8e76aab req-2b75d416-7d77-4b7a-b3bb-c034dc23f065 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:21:30.705403 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-347977d2-53fc-426e-8f5c-763ab8e76aab req-2b75d416-7d77-4b7a-b3bb-c034dc23f065 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:21:30.705837 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-347977d2-53fc-426e-8f5c-763ab8e76aab req-2b75d416-7d77-4b7a-b3bb-c034dc23f065 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:21:30.719604 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-347977d2-53fc-426e-8f5c-763ab8e76aab req-2b75d416-7d77-4b7a-b3bb-c034dc23f065 service nova] Creating event network-vif-deleted:569f1386-3ac2-4233-ba02-bd92872b25d3 for instance b252bea6-7f3c-4c05-b9bf-fe7eca27dc1a on n-h1-862769-1 Oct 27 04:21:30.725798 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-347977d2-53fc-426e-8f5c-763ab8e76aab req-2b75d416-7d77-4b7a-b3bb-c034dc23f065 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035655 Oct 27 04:21:30.726816 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3457/7203] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:21:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:21:31.105722 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2b185277-1484-4280-8719-9d2e3c96f235 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:21:31.106433 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2b185277-1484-4280-8719-9d2e3c96f235 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] [instance: b252bea6-7f3c-4c05-b9bf-fe7eca27dc1a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:21:31.113495 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2b185277-1484-4280-8719-9d2e3c96f235 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:21:31.114006 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2b185277-1484-4280-8719-9d2e3c96f235 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:21:31.114498 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2b185277-1484-4280-8719-9d2e3c96f235 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:21:31.115256 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2b185277-1484-4280-8719-9d2e3c96f235 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:21:31.115740 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2b185277-1484-4280-8719-9d2e3c96f235 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:21:31.116184 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2b185277-1484-4280-8719-9d2e3c96f235 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:21:31.148382 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2b185277-1484-4280-8719-9d2e3c96f235 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:21:31.148987 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2b185277-1484-4280-8719-9d2e3c96f235 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:21:31.149364 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2b185277-1484-4280-8719-9d2e3c96f235 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:21:31.150536 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-2b185277-1484-4280-8719-9d2e3c96f235 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Lazy-loading 'fault' on Instance uuid b252bea6-7f3c-4c05-b9bf-fe7eca27dc1a {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 04:21:31.191090 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2b185277-1484-4280-8719-9d2e3c96f235 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187cfa2c744f44b18764022a8304b108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ade4cece8a49829db34346fbf571bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:21:31.199482 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2b185277-1484-4280-8719-9d2e3c96f235 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] 10.222.0.20 "GET /compute/v2.1/servers/b252bea6-7f3c-4c05-b9bf-fe7eca27dc1a" status: 200 len: 1310 microversion: 2.1 time: 0.097985 Oct 27 04:21:31.200050 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3747/7204] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:21:31 2022] GET /compute/v2.1/servers/b252bea6-7f3c-4c05-b9bf-fe7eca27dc1a => generated 1310 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:21:32.224709 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-86275fb5-770f-416e-b0fa-897743291fa9 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:21:32.225425 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-86275fb5-770f-416e-b0fa-897743291fa9 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] [instance: b252bea6-7f3c-4c05-b9bf-fe7eca27dc1a] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:21:32.232281 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-86275fb5-770f-416e-b0fa-897743291fa9 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:21:32.232773 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-86275fb5-770f-416e-b0fa-897743291fa9 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:21:32.233223 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-86275fb5-770f-416e-b0fa-897743291fa9 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:21:32.233925 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-86275fb5-770f-416e-b0fa-897743291fa9 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:21:32.234417 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-86275fb5-770f-416e-b0fa-897743291fa9 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:21:32.234860 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-86275fb5-770f-416e-b0fa-897743291fa9 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:21:32.248277 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-86275fb5-770f-416e-b0fa-897743291fa9 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] HTTP exception thrown: Instance b252bea6-7f3c-4c05-b9bf-fe7eca27dc1a could not be found. Oct 27 04:21:32.249949 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-86275fb5-770f-416e-b0fa-897743291fa9 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Request method failure captured: Oct 27 04:21:32.249949 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/b252bea6-7f3c-4c05-b9bf-fe7eca27dc1a HTTP/1.1 Oct 27 04:21:32.249949 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 04:21:32.249949 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 04:21:32.249949 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 04:21:32.249949 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 04:21:32.249949 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 04:21:32.249949 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 04:21:32.249949 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 04:21:32.249949 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 04:21:32.249949 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWgc3zBpGJssil5KjB7bKhs1IK3AIrVjRlm3AEgSeYZ5b5OicjWNY66tnVikm4oAQQGcQ1IEoo3c4HopKYtupTU_i8isGgJRqnsaaVpKPyeK-bQZ6VM0sbDXQKYALf6r4CRT8o7zKaKnWmJ9lHZToEUz2RQdSaguHcMymBsX8dhZnMBQ Oct 27 04:21:32.249949 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 04:21:32.249949 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 04:21:32.249949 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 04:21:32.249949 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 04:21:32.249949 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 04:21:32.249949 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 04:21:32.249949 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 14ade4cece8a49829db34346fbf571bf Oct 27 04:21:32.249949 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1725004944 Oct 27 04:21:32.249949 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 04:21:32.249949 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 04:21:32.249949 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/14ade4cece8a49829db34346fbf571bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/14ade4cece8a49829db34346fbf571bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/14ade4cece8a49829db34346fbf571bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_14ade4cece8a49829db34346fbf571bf"}]}] Oct 27 04:21:32.249949 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1725004944 Oct 27 04:21:32.249949 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 14ade4cece8a49829db34346fbf571bf Oct 27 04:21:32.249949 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1725004944 Oct 27 04:21:32.249949 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ServersAdminNegativeTestJSON-1725004944-project Oct 27 04:21:32.249949 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 04:21:32.249949 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 04:21:32.249949 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 187cfa2c744f44b18764022a8304b108 Oct 27 04:21:32.249949 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1725004944-project Oct 27 04:21:32.249949 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 04:21:32.249949 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance b252bea6-7f3c-4c05-b9bf-fe7eca27dc1a could not be found. Oct 27 04:21:32.249949 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': 'b252bea6-7f3c-4c05-b9bf-fe7eca27dc1a'} Oct 27 04:21:32.249949 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 04:21:32.249949 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:21:32.249949 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 04:21:32.249949 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 04:21:32.249949 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 04:21:32.249949 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 04:21:32.249949 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 04:21:32.249949 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 04:21:32.249949 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 04:21:32.249949 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 04:21:32.249949 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b252bea6-7f3c-4c05-b9bf-fe7eca27dc1a could not be found. Oct 27 04:21:32.249949 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:21:32.249949 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:21:32.249949 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:21:32.249949 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:21:32.249949 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:21:32.249949 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:21:32.249949 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 04:21:32.249949 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 04:21:32.249949 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 04:21:32.249949 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 04:21:32.249949 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 04:21:32.249949 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 04:21:32.249949 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 04:21:32.249949 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 04:21:32.249949 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 04:21:32.249949 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 04:21:32.249949 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b252bea6-7f3c-4c05-b9bf-fe7eca27dc1a could not be found. Oct 27 04:21:32.249949 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:21:32.249949 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:21:32.254485 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:21:32.254485 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:21:32.254485 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:21:32.254485 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:21:32.254485 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 04:21:32.254485 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 04:21:32.254485 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b252bea6-7f3c-4c05-b9bf-fe7eca27dc1a could not be found. Oct 27 04:21:32.254485 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:21:32.254485 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-86275fb5-770f-416e-b0fa-897743291fa9 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] Returning 404 to user: Instance b252bea6-7f3c-4c05-b9bf-fe7eca27dc1a could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 04:21:32.254485 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-86275fb5-770f-416e-b0fa-897743291fa9 tempest-ServersAdminNegativeTestJSON-1725004944 tempest-ServersAdminNegativeTestJSON-1725004944-project] 10.222.0.20 "GET /compute/v2.1/servers/b252bea6-7f3c-4c05-b9bf-fe7eca27dc1a" status: 404 len: 111 microversion: 2.1 time: 0.031866 Oct 27 04:21:32.254485 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3458/7205] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:21:32 2022] GET /compute/v2.1/servers/b252bea6-7f3c-4c05-b9bf-fe7eca27dc1a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 04:21:40.462267 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:21:40.463782 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=3 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:21:40.590293 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e64edf56-1e35-4d2a-8107-58cfb8d30f0a tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-11627552", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": [{"uuid": "2a19140c-aff5-4f07-84a8-8095ad23e115"}]}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:21:40.658481 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.network.neutron [None req-e64edf56-1e35-4d2a-8107-58cfb8d30f0a tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] validate_networks() for [('2a19140c-aff5-4f07-84a8-8095ad23e115', None, None, None, None, None)] {{(pid=121001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 04:21:41.054555 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-e64edf56-1e35-4d2a-8107-58cfb8d30f0a tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Flavor limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 04:21:41.059004 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-e64edf56-1e35-4d2a-8107-58cfb8d30f0a tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Image limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 04:21:41.059730 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-e64edf56-1e35-4d2a-8107-58cfb8d30f0a tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Flavor pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 04:21:41.060203 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-e64edf56-1e35-4d2a-8107-58cfb8d30f0a tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Image pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 04:21:41.060650 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-e64edf56-1e35-4d2a-8107-58cfb8d30f0a tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 04:21:41.070495 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e64edf56-1e35-4d2a-8107-58cfb8d30f0a tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:21:41.071001 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e64edf56-1e35-4d2a-8107-58cfb8d30f0a tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:21:41.071493 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e64edf56-1e35-4d2a-8107-58cfb8d30f0a tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:21:41.072250 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e64edf56-1e35-4d2a-8107-58cfb8d30f0a tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:21:41.072730 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e64edf56-1e35-4d2a-8107-58cfb8d30f0a tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:21:41.073178 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e64edf56-1e35-4d2a-8107-58cfb8d30f0a tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:21:41.090929 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-e64edf56-1e35-4d2a-8107-58cfb8d30f0a tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Getting quotas for project 337d221cc6554437899bdcd6d509a655. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 04:21:41.096388 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-e64edf56-1e35-4d2a-8107-58cfb8d30f0a tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Getting quotas for user 80c7bf9767d0461f9556f74ff9a8a4f3 and project 337d221cc6554437899bdcd6d509a655. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 04:21:41.109911 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e64edf56-1e35-4d2a-8107-58cfb8d30f0a tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Going to run 1 instances... {{(pid=121001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 04:21:41.112351 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e64edf56-1e35-4d2a-8107-58cfb8d30f0a tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] [instance: 0e567aed-dba1-4010-bd80-de3c9f9b7c7e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 04:21:41.216032 n-d-862769-1 devstack@n-api.service[121001]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e64edf56-1e35-4d2a-8107-58cfb8d30f0a tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] [04e31e12-c8ab-4024-878c-d9593c3f0480] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 27 04:21:42.224861 n-d-862769-1 devstack@n-api.service[121001]: INFO oslo.messaging._drivers.impl_rabbit [None req-e64edf56-1e35-4d2a-8107-58cfb8d30f0a tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] [04e31e12-c8ab-4024-878c-d9593c3f0480] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 54980. Oct 27 04:21:42.230749 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e64edf56-1e35-4d2a-8107-58cfb8d30f0a tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.774457 Oct 27 04:21:42.231416 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3748/7206] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 04:21:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1776 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 04:21:42.242729 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5327523d-e579-49a8-af19-507165d7be5a tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:21:42.243851 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5327523d-e579-49a8-af19-507165d7be5a tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] [instance: 0e567aed-dba1-4010-bd80-de3c9f9b7c7e] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:21:42.247171 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:21:42.247952 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=3 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:21:42.248882 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:21:42.249616 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=67 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:21:42.310572 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5327523d-e579-49a8-af19-507165d7be5a tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c7bf9767d0461f9556f74ff9a8a4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337d221cc6554437899bdcd6d509a655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:21:42.319123 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5327523d-e579-49a8-af19-507165d7be5a tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] 10.222.0.20 "GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e" status: 200 len: 1213 microversion: 2.1 time: 0.080086 Oct 27 04:21:42.319711 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3459/7207] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:21:42 2022] GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:21:43.343347 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0acea865-afb5-4f5e-a53a-912aad7b853f tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:21:43.344059 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0acea865-afb5-4f5e-a53a-912aad7b853f tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] [instance: 0e567aed-dba1-4010-bd80-de3c9f9b7c7e] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:21:43.350382 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0acea865-afb5-4f5e-a53a-912aad7b853f tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:21:43.350897 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0acea865-afb5-4f5e-a53a-912aad7b853f tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:21:43.351364 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0acea865-afb5-4f5e-a53a-912aad7b853f tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:21:43.352102 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0acea865-afb5-4f5e-a53a-912aad7b853f tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:21:43.353088 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0acea865-afb5-4f5e-a53a-912aad7b853f tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:21:43.353553 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0acea865-afb5-4f5e-a53a-912aad7b853f tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:21:43.419926 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0acea865-afb5-4f5e-a53a-912aad7b853f tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c7bf9767d0461f9556f74ff9a8a4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337d221cc6554437899bdcd6d509a655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:21:43.428227 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0acea865-afb5-4f5e-a53a-912aad7b853f tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] 10.222.0.20 "GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e" status: 200 len: 1217 microversion: 2.1 time: 0.090091 Oct 27 04:21:43.428805 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3749/7208] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:21:43 2022] GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e => generated 1217 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:21:44.451666 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-71346691-370a-4f9d-a670-9e40305d759d tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:21:44.452206 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-71346691-370a-4f9d-a670-9e40305d759d tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] [instance: 0e567aed-dba1-4010-bd80-de3c9f9b7c7e] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:21:44.460208 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-71346691-370a-4f9d-a670-9e40305d759d tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:21:44.464879 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-71346691-370a-4f9d-a670-9e40305d759d tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:21:44.464879 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-71346691-370a-4f9d-a670-9e40305d759d tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:21:44.464879 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-71346691-370a-4f9d-a670-9e40305d759d tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:21:44.464879 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-71346691-370a-4f9d-a670-9e40305d759d tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:21:44.464879 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-71346691-370a-4f9d-a670-9e40305d759d tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:21:44.529561 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-71346691-370a-4f9d-a670-9e40305d759d tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c7bf9767d0461f9556f74ff9a8a4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337d221cc6554437899bdcd6d509a655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:21:44.538322 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-71346691-370a-4f9d-a670-9e40305d759d tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] 10.222.0.20 "GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e" status: 200 len: 1265 microversion: 2.1 time: 0.090638 Oct 27 04:21:44.538932 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3460/7209] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:21:44 2022] GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e => generated 1265 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:21:45.562806 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7b9266b6-bc43-4d60-95b0-11a9d2dd685b tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:21:45.563453 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7b9266b6-bc43-4d60-95b0-11a9d2dd685b tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] [instance: 0e567aed-dba1-4010-bd80-de3c9f9b7c7e] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:21:45.570346 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7b9266b6-bc43-4d60-95b0-11a9d2dd685b tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:21:45.570856 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7b9266b6-bc43-4d60-95b0-11a9d2dd685b tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:21:45.571820 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7b9266b6-bc43-4d60-95b0-11a9d2dd685b tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:21:45.572568 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7b9266b6-bc43-4d60-95b0-11a9d2dd685b tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:21:45.573042 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7b9266b6-bc43-4d60-95b0-11a9d2dd685b tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:21:45.573492 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7b9266b6-bc43-4d60-95b0-11a9d2dd685b tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:21:45.577636 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:21:45.739330 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7b9266b6-bc43-4d60-95b0-11a9d2dd685b tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c7bf9767d0461f9556f74ff9a8a4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337d221cc6554437899bdcd6d509a655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:21:45.747663 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7b9266b6-bc43-4d60-95b0-11a9d2dd685b tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] 10.222.0.20 "GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e" status: 200 len: 1313 microversion: 2.1 time: 0.188877 Oct 27 04:21:45.748680 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3750/7210] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:21:45 2022] GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e => generated 1313 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:21:46.559271 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-89d57781-afca-4684-9082-ffa73713b37c req-f5fda127-4305-403e-a700-6186fa144169 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e567aed-dba1-4010-bd80-de3c9f9b7c7e", "tag": "0404e152-442e-4e7f-b6fa-322bd19af82d"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:21:46.570242 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-89d57781-afca-4684-9082-ffa73713b37c req-f5fda127-4305-403e-a700-6186fa144169 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:21:46.570745 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-89d57781-afca-4684-9082-ffa73713b37c req-f5fda127-4305-403e-a700-6186fa144169 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:21:46.571172 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-89d57781-afca-4684-9082-ffa73713b37c req-f5fda127-4305-403e-a700-6186fa144169 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:21:46.583009 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-89d57781-afca-4684-9082-ffa73713b37c req-f5fda127-4305-403e-a700-6186fa144169 service nova] Creating event network-changed:0404e152-442e-4e7f-b6fa-322bd19af82d for instance 0e567aed-dba1-4010-bd80-de3c9f9b7c7e on n-h1-862769-1 Oct 27 04:21:46.588633 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-89d57781-afca-4684-9082-ffa73713b37c req-f5fda127-4305-403e-a700-6186fa144169 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034703 Oct 27 04:21:46.589678 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3461/7211] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:21:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:21:46.771398 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-27ff40e5-71ac-4fe5-8ed0-cb1c1e27a38f tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:21:46.772144 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-27ff40e5-71ac-4fe5-8ed0-cb1c1e27a38f tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] [instance: 0e567aed-dba1-4010-bd80-de3c9f9b7c7e] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:21:46.775516 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:21:46.780525 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-27ff40e5-71ac-4fe5-8ed0-cb1c1e27a38f tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:21:46.781101 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-27ff40e5-71ac-4fe5-8ed0-cb1c1e27a38f tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:21:46.783092 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-27ff40e5-71ac-4fe5-8ed0-cb1c1e27a38f tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:21:46.783092 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-27ff40e5-71ac-4fe5-8ed0-cb1c1e27a38f tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:21:46.783092 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-27ff40e5-71ac-4fe5-8ed0-cb1c1e27a38f tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:21:46.783370 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-27ff40e5-71ac-4fe5-8ed0-cb1c1e27a38f tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:21:46.952100 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-27ff40e5-71ac-4fe5-8ed0-cb1c1e27a38f tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c7bf9767d0461f9556f74ff9a8a4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337d221cc6554437899bdcd6d509a655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:21:46.960661 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-27ff40e5-71ac-4fe5-8ed0-cb1c1e27a38f tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] 10.222.0.20 "GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e" status: 200 len: 1313 microversion: 2.1 time: 0.193221 Oct 27 04:21:46.961303 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3751/7212] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:21:46 2022] GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e => generated 1313 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:21:47.986280 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-75573173-7112-4297-bb8e-7e31101e6e3e tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:21:47.987101 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-75573173-7112-4297-bb8e-7e31101e6e3e tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] [instance: 0e567aed-dba1-4010-bd80-de3c9f9b7c7e] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:21:47.993803 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-75573173-7112-4297-bb8e-7e31101e6e3e tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:21:47.994311 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-75573173-7112-4297-bb8e-7e31101e6e3e tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:21:47.994788 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-75573173-7112-4297-bb8e-7e31101e6e3e tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:21:47.995451 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-75573173-7112-4297-bb8e-7e31101e6e3e tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:21:47.995905 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-75573173-7112-4297-bb8e-7e31101e6e3e tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:21:47.996331 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-75573173-7112-4297-bb8e-7e31101e6e3e tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:21:48.129419 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-75573173-7112-4297-bb8e-7e31101e6e3e tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c7bf9767d0461f9556f74ff9a8a4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337d221cc6554437899bdcd6d509a655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:21:48.137677 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-75573173-7112-4297-bb8e-7e31101e6e3e tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] 10.222.0.20 "GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e" status: 200 len: 1313 microversion: 2.1 time: 0.156618 Oct 27 04:21:48.138283 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3462/7213] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:21:47 2022] GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:21:49.160702 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ce813f68-d300-43d8-9d32-db3afeb013c3 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:21:49.161344 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ce813f68-d300-43d8-9d32-db3afeb013c3 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] [instance: 0e567aed-dba1-4010-bd80-de3c9f9b7c7e] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:21:49.168345 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ce813f68-d300-43d8-9d32-db3afeb013c3 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:21:49.168851 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ce813f68-d300-43d8-9d32-db3afeb013c3 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:21:49.169331 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ce813f68-d300-43d8-9d32-db3afeb013c3 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:21:49.170056 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ce813f68-d300-43d8-9d32-db3afeb013c3 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:21:49.170656 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ce813f68-d300-43d8-9d32-db3afeb013c3 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:21:49.171121 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ce813f68-d300-43d8-9d32-db3afeb013c3 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:21:49.298920 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ce813f68-d300-43d8-9d32-db3afeb013c3 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c7bf9767d0461f9556f74ff9a8a4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337d221cc6554437899bdcd6d509a655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:21:49.306779 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ce813f68-d300-43d8-9d32-db3afeb013c3 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] 10.222.0.20 "GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e" status: 200 len: 1313 microversion: 2.1 time: 0.150011 Oct 27 04:21:49.307359 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3752/7214] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:21:49 2022] GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:21:50.330443 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-46df3236-2e69-471d-b588-21a824d9a0ad tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:21:50.331068 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-46df3236-2e69-471d-b588-21a824d9a0ad tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] [instance: 0e567aed-dba1-4010-bd80-de3c9f9b7c7e] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:21:50.337811 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-46df3236-2e69-471d-b588-21a824d9a0ad tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:21:50.338595 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-46df3236-2e69-471d-b588-21a824d9a0ad tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:21:50.339036 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-46df3236-2e69-471d-b588-21a824d9a0ad tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:21:50.339736 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-46df3236-2e69-471d-b588-21a824d9a0ad tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:21:50.340194 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-46df3236-2e69-471d-b588-21a824d9a0ad tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:21:50.340620 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-46df3236-2e69-471d-b588-21a824d9a0ad tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:21:50.479241 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-46df3236-2e69-471d-b588-21a824d9a0ad tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c7bf9767d0461f9556f74ff9a8a4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337d221cc6554437899bdcd6d509a655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:21:50.486921 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-46df3236-2e69-471d-b588-21a824d9a0ad tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] 10.222.0.20 "GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e" status: 200 len: 1313 microversion: 2.1 time: 0.160433 Oct 27 04:21:50.489463 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3463/7215] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:21:50 2022] GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:21:51.511945 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-50b5ae0d-3415-416a-9bee-5d1cfa57ba34 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:21:51.512583 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-50b5ae0d-3415-416a-9bee-5d1cfa57ba34 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] [instance: 0e567aed-dba1-4010-bd80-de3c9f9b7c7e] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:21:51.515304 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:21:51.516051 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=6 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:21:51.520765 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-50b5ae0d-3415-416a-9bee-5d1cfa57ba34 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:21:51.526494 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-50b5ae0d-3415-416a-9bee-5d1cfa57ba34 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:21:51.526494 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-50b5ae0d-3415-416a-9bee-5d1cfa57ba34 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:21:51.526494 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-50b5ae0d-3415-416a-9bee-5d1cfa57ba34 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:21:51.526494 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-50b5ae0d-3415-416a-9bee-5d1cfa57ba34 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:21:51.526494 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-50b5ae0d-3415-416a-9bee-5d1cfa57ba34 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:21:51.656552 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-50b5ae0d-3415-416a-9bee-5d1cfa57ba34 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c7bf9767d0461f9556f74ff9a8a4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337d221cc6554437899bdcd6d509a655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:21:51.664377 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-50b5ae0d-3415-416a-9bee-5d1cfa57ba34 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] 10.222.0.20 "GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e" status: 200 len: 1313 microversion: 2.1 time: 0.156908 Oct 27 04:21:51.664968 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3753/7216] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:21:51 2022] GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:21:52.558819 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-b2b40515-0f08-43f7-95f7-00fe67725218 req-52b78781-e9d0-49dd-a023-a6cbb4860264 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e567aed-dba1-4010-bd80-de3c9f9b7c7e", "name": "network-vif-plugged", "status": "completed", "tag": "0404e152-442e-4e7f-b6fa-322bd19af82d"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:21:52.564890 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:21:52.572498 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-b2b40515-0f08-43f7-95f7-00fe67725218 req-52b78781-e9d0-49dd-a023-a6cbb4860264 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:21:52.573041 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-b2b40515-0f08-43f7-95f7-00fe67725218 req-52b78781-e9d0-49dd-a023-a6cbb4860264 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:21:52.573478 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-b2b40515-0f08-43f7-95f7-00fe67725218 req-52b78781-e9d0-49dd-a023-a6cbb4860264 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:21:52.584435 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-b2b40515-0f08-43f7-95f7-00fe67725218 req-52b78781-e9d0-49dd-a023-a6cbb4860264 service nova] Creating event network-vif-plugged:0404e152-442e-4e7f-b6fa-322bd19af82d for instance 0e567aed-dba1-4010-bd80-de3c9f9b7c7e on n-h1-862769-1 Oct 27 04:21:52.590568 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-b2b40515-0f08-43f7-95f7-00fe67725218 req-52b78781-e9d0-49dd-a023-a6cbb4860264 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035275 Oct 27 04:21:52.593697 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3464/7217] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:21:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:21:52.687544 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f409db17-a765-4b58-8edb-4ad4a13d4552 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:21:52.688186 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f409db17-a765-4b58-8edb-4ad4a13d4552 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] [instance: 0e567aed-dba1-4010-bd80-de3c9f9b7c7e] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:21:52.695806 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f409db17-a765-4b58-8edb-4ad4a13d4552 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:21:52.696383 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f409db17-a765-4b58-8edb-4ad4a13d4552 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:21:52.696846 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f409db17-a765-4b58-8edb-4ad4a13d4552 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:21:52.697573 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f409db17-a765-4b58-8edb-4ad4a13d4552 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:21:52.698127 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f409db17-a765-4b58-8edb-4ad4a13d4552 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:21:52.698974 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f409db17-a765-4b58-8edb-4ad4a13d4552 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:21:52.839357 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f409db17-a765-4b58-8edb-4ad4a13d4552 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c7bf9767d0461f9556f74ff9a8a4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337d221cc6554437899bdcd6d509a655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:21:52.847050 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f409db17-a765-4b58-8edb-4ad4a13d4552 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] 10.222.0.20 "GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e" status: 200 len: 1313 microversion: 2.1 time: 0.163568 Oct 27 04:21:52.847620 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3754/7218] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:21:52 2022] GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:21:53.871969 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ac64d803-5149-4310-964d-6d418a32efd3 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:21:53.872688 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ac64d803-5149-4310-964d-6d418a32efd3 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] [instance: 0e567aed-dba1-4010-bd80-de3c9f9b7c7e] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:21:53.879003 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ac64d803-5149-4310-964d-6d418a32efd3 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:21:53.879494 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ac64d803-5149-4310-964d-6d418a32efd3 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:21:53.879940 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ac64d803-5149-4310-964d-6d418a32efd3 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:21:53.880642 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ac64d803-5149-4310-964d-6d418a32efd3 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:21:53.881137 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ac64d803-5149-4310-964d-6d418a32efd3 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:21:53.881570 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ac64d803-5149-4310-964d-6d418a32efd3 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:21:54.012833 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ac64d803-5149-4310-964d-6d418a32efd3 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c7bf9767d0461f9556f74ff9a8a4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337d221cc6554437899bdcd6d509a655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:21:54.020647 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ac64d803-5149-4310-964d-6d418a32efd3 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] 10.222.0.20 "GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e" status: 200 len: 1313 microversion: 2.1 time: 0.154754 Oct 27 04:21:54.021224 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3465/7219] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:21:53 2022] GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:21:55.044014 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f990e35f-e864-418d-8ae9-736505096194 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:21:55.044654 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f990e35f-e864-418d-8ae9-736505096194 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] [instance: 0e567aed-dba1-4010-bd80-de3c9f9b7c7e] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:21:55.051504 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f990e35f-e864-418d-8ae9-736505096194 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:21:55.052007 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f990e35f-e864-418d-8ae9-736505096194 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:21:55.052468 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f990e35f-e864-418d-8ae9-736505096194 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:21:55.053181 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f990e35f-e864-418d-8ae9-736505096194 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:21:55.053657 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f990e35f-e864-418d-8ae9-736505096194 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:21:55.054137 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f990e35f-e864-418d-8ae9-736505096194 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:21:55.186512 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f990e35f-e864-418d-8ae9-736505096194 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c7bf9767d0461f9556f74ff9a8a4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337d221cc6554437899bdcd6d509a655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:21:55.194599 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f990e35f-e864-418d-8ae9-736505096194 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] 10.222.0.20 "GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e" status: 200 len: 1498 microversion: 2.1 time: 0.154496 Oct 27 04:21:55.195181 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3755/7220] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:21:55 2022] GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e => generated 1498 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:21:55.217163 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a9a24f58-90f4-4142-a965-03c20e3cdba5 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:21:55.219483 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a9a24f58-90f4-4142-a965-03c20e3cdba5 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] [instance: 0e567aed-dba1-4010-bd80-de3c9f9b7c7e] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:21:55.226162 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a9a24f58-90f4-4142-a965-03c20e3cdba5 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:21:55.226645 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a9a24f58-90f4-4142-a965-03c20e3cdba5 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:21:55.227082 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a9a24f58-90f4-4142-a965-03c20e3cdba5 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:21:55.228273 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a9a24f58-90f4-4142-a965-03c20e3cdba5 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:21:55.228721 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a9a24f58-90f4-4142-a965-03c20e3cdba5 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:21:55.229145 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a9a24f58-90f4-4142-a965-03c20e3cdba5 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:21:55.256741 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a9a24f58-90f4-4142-a965-03c20e3cdba5 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '80c7bf9767d0461f9556f74ff9a8a4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337d221cc6554437899bdcd6d509a655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:21:55.264495 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a9a24f58-90f4-4142-a965-03c20e3cdba5 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] [instance: 0e567aed-dba1-4010-bd80-de3c9f9b7c7e] Old instance type m1.heat2, new instance type m1.heat {{(pid=121000) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 27 04:21:55.270874 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-a9a24f58-90f4-4142-a965-03c20e3cdba5 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 04:21:55.271298 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-a9a24f58-90f4-4142-a965-03c20e3cdba5 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 04:21:55.271772 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-a9a24f58-90f4-4142-a965-03c20e3cdba5 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 04:21:55.272178 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-a9a24f58-90f4-4142-a965-03c20e3cdba5 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 04:21:55.272589 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-a9a24f58-90f4-4142-a965-03c20e3cdba5 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 04:21:55.452788 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a9a24f58-90f4-4142-a965-03c20e3cdba5 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] 10.222.0.20 "POST /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e/action" status: 202 len: 0 microversion: 2.1 time: 0.239744 Oct 27 04:21:55.453435 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3466/7221] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 04:21:55 2022] POST /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e/action => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 04:21:55.462447 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-905f0631-bbb8-4c11-be7a-a22790739123 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:21:55.463111 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-905f0631-bbb8-4c11-be7a-a22790739123 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] [instance: 0e567aed-dba1-4010-bd80-de3c9f9b7c7e] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:21:55.469555 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-905f0631-bbb8-4c11-be7a-a22790739123 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:21:55.470092 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-905f0631-bbb8-4c11-be7a-a22790739123 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:21:55.470679 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-905f0631-bbb8-4c11-be7a-a22790739123 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:21:55.471396 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-905f0631-bbb8-4c11-be7a-a22790739123 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:21:55.471865 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-905f0631-bbb8-4c11-be7a-a22790739123 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:21:55.472309 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-905f0631-bbb8-4c11-be7a-a22790739123 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:21:55.604857 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-905f0631-bbb8-4c11-be7a-a22790739123 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c7bf9767d0461f9556f74ff9a8a4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337d221cc6554437899bdcd6d509a655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:21:55.612833 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-905f0631-bbb8-4c11-be7a-a22790739123 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] 10.222.0.20 "GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e" status: 200 len: 1507 microversion: 2.1 time: 0.154963 Oct 27 04:21:55.613412 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3756/7222] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:21:55 2022] GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:21:56.636946 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1ce71b7f-160d-42da-bc42-24f31cd58a8a tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:21:56.637566 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1ce71b7f-160d-42da-bc42-24f31cd58a8a tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] [instance: 0e567aed-dba1-4010-bd80-de3c9f9b7c7e] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:21:56.643545 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1ce71b7f-160d-42da-bc42-24f31cd58a8a tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:21:56.644033 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1ce71b7f-160d-42da-bc42-24f31cd58a8a tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:21:56.644481 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1ce71b7f-160d-42da-bc42-24f31cd58a8a tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:21:56.645174 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1ce71b7f-160d-42da-bc42-24f31cd58a8a tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:21:56.645634 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1ce71b7f-160d-42da-bc42-24f31cd58a8a tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:21:56.646083 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1ce71b7f-160d-42da-bc42-24f31cd58a8a tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:21:57.075844 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1ce71b7f-160d-42da-bc42-24f31cd58a8a tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c7bf9767d0461f9556f74ff9a8a4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337d221cc6554437899bdcd6d509a655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:21:57.085526 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1ce71b7f-160d-42da-bc42-24f31cd58a8a tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] 10.222.0.20 "GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e" status: 200 len: 1507 microversion: 2.1 time: 0.452564 Oct 27 04:21:57.085526 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3467/7223] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:21:56 2022] GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e => generated 1507 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:21:58.109403 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1be44105-c0a1-4353-ac74-119a6b194eb7 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:21:58.110066 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1be44105-c0a1-4353-ac74-119a6b194eb7 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] [instance: 0e567aed-dba1-4010-bd80-de3c9f9b7c7e] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:21:58.116877 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1be44105-c0a1-4353-ac74-119a6b194eb7 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:21:58.117383 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1be44105-c0a1-4353-ac74-119a6b194eb7 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:21:58.117932 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1be44105-c0a1-4353-ac74-119a6b194eb7 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:21:58.119177 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1be44105-c0a1-4353-ac74-119a6b194eb7 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:21:58.119655 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1be44105-c0a1-4353-ac74-119a6b194eb7 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:21:58.120103 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1be44105-c0a1-4353-ac74-119a6b194eb7 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:21:58.356122 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1be44105-c0a1-4353-ac74-119a6b194eb7 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c7bf9767d0461f9556f74ff9a8a4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337d221cc6554437899bdcd6d509a655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:21:58.363842 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1be44105-c0a1-4353-ac74-119a6b194eb7 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] 10.222.0.20 "GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e" status: 200 len: 1507 microversion: 2.1 time: 0.258393 Oct 27 04:21:58.364422 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3757/7224] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:21:58 2022] GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e => generated 1507 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:21:59.388192 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1c4ca461-4940-47e1-8c7b-a5ced99b316c tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:21:59.388837 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1c4ca461-4940-47e1-8c7b-a5ced99b316c tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] [instance: 0e567aed-dba1-4010-bd80-de3c9f9b7c7e] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:21:59.395006 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1c4ca461-4940-47e1-8c7b-a5ced99b316c tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:21:59.395497 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1c4ca461-4940-47e1-8c7b-a5ced99b316c tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:21:59.395933 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1c4ca461-4940-47e1-8c7b-a5ced99b316c tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:21:59.396622 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1c4ca461-4940-47e1-8c7b-a5ced99b316c tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:21:59.397078 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1c4ca461-4940-47e1-8c7b-a5ced99b316c tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:21:59.397505 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1c4ca461-4940-47e1-8c7b-a5ced99b316c tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:21:59.528413 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1c4ca461-4940-47e1-8c7b-a5ced99b316c tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c7bf9767d0461f9556f74ff9a8a4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337d221cc6554437899bdcd6d509a655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:21:59.536045 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1c4ca461-4940-47e1-8c7b-a5ced99b316c tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] 10.222.0.20 "GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e" status: 200 len: 1512 microversion: 2.1 time: 0.152361 Oct 27 04:21:59.536598 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3468/7225] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:21:59 2022] GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e => generated 1512 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:22:00.565057 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-af3d8982-f757-4d35-8c8c-449db1a55a44 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:22:00.565694 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-af3d8982-f757-4d35-8c8c-449db1a55a44 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] [instance: 0e567aed-dba1-4010-bd80-de3c9f9b7c7e] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:22:00.571749 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-af3d8982-f757-4d35-8c8c-449db1a55a44 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:00.572259 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-af3d8982-f757-4d35-8c8c-449db1a55a44 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:00.572760 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-af3d8982-f757-4d35-8c8c-449db1a55a44 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:00.573510 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-af3d8982-f757-4d35-8c8c-449db1a55a44 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:00.573988 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-af3d8982-f757-4d35-8c8c-449db1a55a44 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:00.574463 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-af3d8982-f757-4d35-8c8c-449db1a55a44 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:00.703873 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-af3d8982-f757-4d35-8c8c-449db1a55a44 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c7bf9767d0461f9556f74ff9a8a4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337d221cc6554437899bdcd6d509a655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:22:00.712104 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-af3d8982-f757-4d35-8c8c-449db1a55a44 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] 10.222.0.20 "GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e" status: 200 len: 1512 microversion: 2.1 time: 0.150895 Oct 27 04:22:00.712685 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3758/7226] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:22:00 2022] GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e => generated 1512 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:22:01.736694 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-873fc2f4-5f95-474a-85eb-2cd75360d838 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:22:01.737360 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-873fc2f4-5f95-474a-85eb-2cd75360d838 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] [instance: 0e567aed-dba1-4010-bd80-de3c9f9b7c7e] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:22:01.744461 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-873fc2f4-5f95-474a-85eb-2cd75360d838 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:01.745001 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-873fc2f4-5f95-474a-85eb-2cd75360d838 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:01.745455 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-873fc2f4-5f95-474a-85eb-2cd75360d838 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:01.746237 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-873fc2f4-5f95-474a-85eb-2cd75360d838 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:01.746713 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-873fc2f4-5f95-474a-85eb-2cd75360d838 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:01.747150 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-873fc2f4-5f95-474a-85eb-2cd75360d838 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:01.879284 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-873fc2f4-5f95-474a-85eb-2cd75360d838 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c7bf9767d0461f9556f74ff9a8a4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337d221cc6554437899bdcd6d509a655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:22:01.887494 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-873fc2f4-5f95-474a-85eb-2cd75360d838 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] 10.222.0.20 "GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e" status: 200 len: 1512 microversion: 2.1 time: 0.154991 Oct 27 04:22:01.888069 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3469/7227] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:22:01 2022] GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e => generated 1512 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 04:22:02.911608 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-fbb97f6a-62e5-4bb7-a341-ca1cf3922fdf tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:22:02.912207 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-fbb97f6a-62e5-4bb7-a341-ca1cf3922fdf tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] [instance: 0e567aed-dba1-4010-bd80-de3c9f9b7c7e] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:22:02.919632 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fbb97f6a-62e5-4bb7-a341-ca1cf3922fdf tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:02.920127 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fbb97f6a-62e5-4bb7-a341-ca1cf3922fdf tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:02.920581 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fbb97f6a-62e5-4bb7-a341-ca1cf3922fdf tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:02.921286 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fbb97f6a-62e5-4bb7-a341-ca1cf3922fdf tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:02.921756 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fbb97f6a-62e5-4bb7-a341-ca1cf3922fdf tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:02.922231 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fbb97f6a-62e5-4bb7-a341-ca1cf3922fdf tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:03.055320 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-fbb97f6a-62e5-4bb7-a341-ca1cf3922fdf tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c7bf9767d0461f9556f74ff9a8a4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337d221cc6554437899bdcd6d509a655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:22:03.063184 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-fbb97f6a-62e5-4bb7-a341-ca1cf3922fdf tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] 10.222.0.20 "GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e" status: 200 len: 1512 microversion: 2.1 time: 0.155685 Oct 27 04:22:03.063826 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3759/7228] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:22:02 2022] GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e => generated 1512 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:22:04.085381 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-544b8a02-ff47-4030-b02a-fb00e1cb708d tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:22:04.086052 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-544b8a02-ff47-4030-b02a-fb00e1cb708d tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] [instance: 0e567aed-dba1-4010-bd80-de3c9f9b7c7e] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:22:04.093382 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-544b8a02-ff47-4030-b02a-fb00e1cb708d tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:04.093875 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-544b8a02-ff47-4030-b02a-fb00e1cb708d tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:04.094353 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-544b8a02-ff47-4030-b02a-fb00e1cb708d tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:04.095054 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-544b8a02-ff47-4030-b02a-fb00e1cb708d tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:04.095521 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-544b8a02-ff47-4030-b02a-fb00e1cb708d tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:04.095952 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-544b8a02-ff47-4030-b02a-fb00e1cb708d tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:04.224595 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-544b8a02-ff47-4030-b02a-fb00e1cb708d tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c7bf9767d0461f9556f74ff9a8a4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337d221cc6554437899bdcd6d509a655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:22:04.232887 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-544b8a02-ff47-4030-b02a-fb00e1cb708d tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] 10.222.0.20 "GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e" status: 200 len: 1512 microversion: 2.1 time: 0.151463 Oct 27 04:22:04.233446 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3470/7229] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:22:04 2022] GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e => generated 1512 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:22:05.256690 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8ebc8706-c8cf-4123-bd02-497a9bfaad81 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:22:05.257342 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8ebc8706-c8cf-4123-bd02-497a9bfaad81 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] [instance: 0e567aed-dba1-4010-bd80-de3c9f9b7c7e] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:22:05.264239 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8ebc8706-c8cf-4123-bd02-497a9bfaad81 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:05.264750 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8ebc8706-c8cf-4123-bd02-497a9bfaad81 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:05.265214 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8ebc8706-c8cf-4123-bd02-497a9bfaad81 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:05.265942 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8ebc8706-c8cf-4123-bd02-497a9bfaad81 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:05.266448 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8ebc8706-c8cf-4123-bd02-497a9bfaad81 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:05.266902 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8ebc8706-c8cf-4123-bd02-497a9bfaad81 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:05.395548 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8ebc8706-c8cf-4123-bd02-497a9bfaad81 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c7bf9767d0461f9556f74ff9a8a4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337d221cc6554437899bdcd6d509a655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:22:05.403326 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8ebc8706-c8cf-4123-bd02-497a9bfaad81 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] 10.222.0.20 "GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e" status: 200 len: 1512 microversion: 2.1 time: 0.150588 Oct 27 04:22:05.403915 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3760/7230] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:22:05 2022] GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e => generated 1512 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:22:06.426533 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-646eb792-dfa3-4e4d-8bb4-f150561199e6 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:22:06.427192 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-646eb792-dfa3-4e4d-8bb4-f150561199e6 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] [instance: 0e567aed-dba1-4010-bd80-de3c9f9b7c7e] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:22:06.434610 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-646eb792-dfa3-4e4d-8bb4-f150561199e6 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:06.435142 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-646eb792-dfa3-4e4d-8bb4-f150561199e6 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:06.435591 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-646eb792-dfa3-4e4d-8bb4-f150561199e6 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:06.436295 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-646eb792-dfa3-4e4d-8bb4-f150561199e6 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:06.436811 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-646eb792-dfa3-4e4d-8bb4-f150561199e6 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:06.437198 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-646eb792-dfa3-4e4d-8bb4-f150561199e6 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:06.569685 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-646eb792-dfa3-4e4d-8bb4-f150561199e6 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c7bf9767d0461f9556f74ff9a8a4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337d221cc6554437899bdcd6d509a655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:22:06.578018 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-646eb792-dfa3-4e4d-8bb4-f150561199e6 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] 10.222.0.20 "GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e" status: 200 len: 1512 microversion: 2.1 time: 0.155391 Oct 27 04:22:06.578607 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3471/7231] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:22:06 2022] GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e => generated 1512 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:22:07.601970 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-186eb817-8b81-42b6-a276-0119e2a12391 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:22:07.603267 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-186eb817-8b81-42b6-a276-0119e2a12391 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] [instance: 0e567aed-dba1-4010-bd80-de3c9f9b7c7e] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:22:07.610609 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-186eb817-8b81-42b6-a276-0119e2a12391 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:07.611113 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-186eb817-8b81-42b6-a276-0119e2a12391 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:07.611575 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-186eb817-8b81-42b6-a276-0119e2a12391 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:07.612287 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-186eb817-8b81-42b6-a276-0119e2a12391 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:07.612762 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-186eb817-8b81-42b6-a276-0119e2a12391 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:07.613211 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-186eb817-8b81-42b6-a276-0119e2a12391 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:07.742508 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-186eb817-8b81-42b6-a276-0119e2a12391 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c7bf9767d0461f9556f74ff9a8a4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337d221cc6554437899bdcd6d509a655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:22:07.750189 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-186eb817-8b81-42b6-a276-0119e2a12391 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] 10.222.0.20 "GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e" status: 200 len: 1512 microversion: 2.1 time: 0.152107 Oct 27 04:22:07.750767 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3761/7232] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:22:07 2022] GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e => generated 1512 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:22:08.773728 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ab775a05-ff8f-4e41-8192-8e8302580795 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:22:08.774885 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ab775a05-ff8f-4e41-8192-8e8302580795 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] [instance: 0e567aed-dba1-4010-bd80-de3c9f9b7c7e] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:22:08.783826 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ab775a05-ff8f-4e41-8192-8e8302580795 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:08.784326 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ab775a05-ff8f-4e41-8192-8e8302580795 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:08.784770 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ab775a05-ff8f-4e41-8192-8e8302580795 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:08.785467 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ab775a05-ff8f-4e41-8192-8e8302580795 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:08.785925 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ab775a05-ff8f-4e41-8192-8e8302580795 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:08.786375 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ab775a05-ff8f-4e41-8192-8e8302580795 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:08.917523 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ab775a05-ff8f-4e41-8192-8e8302580795 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c7bf9767d0461f9556f74ff9a8a4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337d221cc6554437899bdcd6d509a655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:22:08.925641 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ab775a05-ff8f-4e41-8192-8e8302580795 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] 10.222.0.20 "GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e" status: 200 len: 1512 microversion: 2.1 time: 0.155869 Oct 27 04:22:08.926254 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3472/7233] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:22:08 2022] GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e => generated 1512 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:22:09.949952 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-dbaa3dce-29eb-4bc1-90a5-631129d696ba tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:22:09.950627 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-dbaa3dce-29eb-4bc1-90a5-631129d696ba tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] [instance: 0e567aed-dba1-4010-bd80-de3c9f9b7c7e] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:22:09.957471 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dbaa3dce-29eb-4bc1-90a5-631129d696ba tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:09.957979 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dbaa3dce-29eb-4bc1-90a5-631129d696ba tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:09.958471 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dbaa3dce-29eb-4bc1-90a5-631129d696ba tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:09.959194 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dbaa3dce-29eb-4bc1-90a5-631129d696ba tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:09.959671 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dbaa3dce-29eb-4bc1-90a5-631129d696ba tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:09.960129 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dbaa3dce-29eb-4bc1-90a5-631129d696ba tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:10.092234 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-dbaa3dce-29eb-4bc1-90a5-631129d696ba tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c7bf9767d0461f9556f74ff9a8a4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337d221cc6554437899bdcd6d509a655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:22:10.099953 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-dbaa3dce-29eb-4bc1-90a5-631129d696ba tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] 10.222.0.20 "GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e" status: 200 len: 1512 microversion: 2.1 time: 0.154513 Oct 27 04:22:10.100526 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3762/7234] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:22:09 2022] GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e => generated 1512 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:22:11.124317 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9ce269d3-ce0f-4a26-98f5-6d27387bcf3a tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:22:11.124966 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9ce269d3-ce0f-4a26-98f5-6d27387bcf3a tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] [instance: 0e567aed-dba1-4010-bd80-de3c9f9b7c7e] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:22:11.131701 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9ce269d3-ce0f-4a26-98f5-6d27387bcf3a tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:11.132182 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9ce269d3-ce0f-4a26-98f5-6d27387bcf3a tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:11.132618 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9ce269d3-ce0f-4a26-98f5-6d27387bcf3a tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:11.133310 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9ce269d3-ce0f-4a26-98f5-6d27387bcf3a tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:11.133766 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9ce269d3-ce0f-4a26-98f5-6d27387bcf3a tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:11.134231 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9ce269d3-ce0f-4a26-98f5-6d27387bcf3a tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:11.263123 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9ce269d3-ce0f-4a26-98f5-6d27387bcf3a tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c7bf9767d0461f9556f74ff9a8a4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337d221cc6554437899bdcd6d509a655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:22:11.270842 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9ce269d3-ce0f-4a26-98f5-6d27387bcf3a tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] 10.222.0.20 "GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e" status: 200 len: 1512 microversion: 2.1 time: 0.150483 Oct 27 04:22:11.271419 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3473/7235] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:22:11 2022] GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e => generated 1512 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:22:12.294911 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e54a9d17-8302-4167-938a-720270ae666a tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:22:12.295626 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e54a9d17-8302-4167-938a-720270ae666a tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] [instance: 0e567aed-dba1-4010-bd80-de3c9f9b7c7e] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:22:12.303429 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e54a9d17-8302-4167-938a-720270ae666a tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:12.303942 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e54a9d17-8302-4167-938a-720270ae666a tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:12.304405 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e54a9d17-8302-4167-938a-720270ae666a tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:12.305196 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e54a9d17-8302-4167-938a-720270ae666a tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:12.306253 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e54a9d17-8302-4167-938a-720270ae666a tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:12.306738 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e54a9d17-8302-4167-938a-720270ae666a tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:12.437403 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e54a9d17-8302-4167-938a-720270ae666a tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c7bf9767d0461f9556f74ff9a8a4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337d221cc6554437899bdcd6d509a655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:22:12.445358 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e54a9d17-8302-4167-938a-720270ae666a tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] 10.222.0.20 "GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e" status: 200 len: 1512 microversion: 2.1 time: 0.154350 Oct 27 04:22:12.445945 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3763/7236] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:22:12 2022] GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e => generated 1512 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:22:13.469024 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c28534d7-b99b-4546-a9ea-1e208ed81576 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:22:13.469656 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c28534d7-b99b-4546-a9ea-1e208ed81576 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] [instance: 0e567aed-dba1-4010-bd80-de3c9f9b7c7e] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:22:13.476581 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c28534d7-b99b-4546-a9ea-1e208ed81576 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:13.477690 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c28534d7-b99b-4546-a9ea-1e208ed81576 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:13.478165 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c28534d7-b99b-4546-a9ea-1e208ed81576 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:13.478869 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c28534d7-b99b-4546-a9ea-1e208ed81576 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:13.479327 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c28534d7-b99b-4546-a9ea-1e208ed81576 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:13.479759 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c28534d7-b99b-4546-a9ea-1e208ed81576 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:13.611642 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c28534d7-b99b-4546-a9ea-1e208ed81576 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c7bf9767d0461f9556f74ff9a8a4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337d221cc6554437899bdcd6d509a655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:22:13.619325 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c28534d7-b99b-4546-a9ea-1e208ed81576 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] 10.222.0.20 "GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e" status: 200 len: 1512 microversion: 2.1 time: 0.154206 Oct 27 04:22:13.619896 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3474/7237] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:22:13 2022] GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e => generated 1512 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:22:14.643022 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-424e6864-9cce-4219-a35b-c66e30c2def5 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:22:14.643663 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-424e6864-9cce-4219-a35b-c66e30c2def5 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] [instance: 0e567aed-dba1-4010-bd80-de3c9f9b7c7e] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:22:14.650806 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-424e6864-9cce-4219-a35b-c66e30c2def5 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:14.652932 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-424e6864-9cce-4219-a35b-c66e30c2def5 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:14.652932 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-424e6864-9cce-4219-a35b-c66e30c2def5 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:14.652932 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-424e6864-9cce-4219-a35b-c66e30c2def5 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:14.652932 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-424e6864-9cce-4219-a35b-c66e30c2def5 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:14.653388 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-424e6864-9cce-4219-a35b-c66e30c2def5 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:14.793111 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-424e6864-9cce-4219-a35b-c66e30c2def5 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c7bf9767d0461f9556f74ff9a8a4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337d221cc6554437899bdcd6d509a655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:22:14.801308 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-424e6864-9cce-4219-a35b-c66e30c2def5 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] 10.222.0.20 "GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e" status: 200 len: 1512 microversion: 2.1 time: 0.162153 Oct 27 04:22:14.801928 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3764/7238] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:22:14 2022] GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e => generated 1512 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:22:15.825189 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8dd87bba-39fe-4a39-9c49-3d1b2feebba4 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:22:15.825818 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8dd87bba-39fe-4a39-9c49-3d1b2feebba4 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] [instance: 0e567aed-dba1-4010-bd80-de3c9f9b7c7e] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:22:15.832893 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8dd87bba-39fe-4a39-9c49-3d1b2feebba4 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:15.833393 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8dd87bba-39fe-4a39-9c49-3d1b2feebba4 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:15.833839 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8dd87bba-39fe-4a39-9c49-3d1b2feebba4 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:15.834585 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8dd87bba-39fe-4a39-9c49-3d1b2feebba4 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:15.835083 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8dd87bba-39fe-4a39-9c49-3d1b2feebba4 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:15.835523 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8dd87bba-39fe-4a39-9c49-3d1b2feebba4 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:15.838191 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:22:15.967257 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8dd87bba-39fe-4a39-9c49-3d1b2feebba4 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c7bf9767d0461f9556f74ff9a8a4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337d221cc6554437899bdcd6d509a655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:22:15.975028 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8dd87bba-39fe-4a39-9c49-3d1b2feebba4 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] 10.222.0.20 "GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e" status: 200 len: 1512 microversion: 2.1 time: 0.154344 Oct 27 04:22:15.975607 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3475/7239] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:22:15 2022] GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e => generated 1512 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:22:16.999108 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a9b6b852-cd7a-4322-9478-bfb4d5e5a9fa tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:22:17.005374 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a9b6b852-cd7a-4322-9478-bfb4d5e5a9fa tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] [instance: 0e567aed-dba1-4010-bd80-de3c9f9b7c7e] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:22:17.005374 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=28 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:22:17.007185 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a9b6b852-cd7a-4322-9478-bfb4d5e5a9fa tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:17.007693 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a9b6b852-cd7a-4322-9478-bfb4d5e5a9fa tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:17.008157 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a9b6b852-cd7a-4322-9478-bfb4d5e5a9fa tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:17.008875 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a9b6b852-cd7a-4322-9478-bfb4d5e5a9fa tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:17.009861 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a9b6b852-cd7a-4322-9478-bfb4d5e5a9fa tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:17.010342 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a9b6b852-cd7a-4322-9478-bfb4d5e5a9fa tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:17.014389 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=90 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:22:17.140004 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a9b6b852-cd7a-4322-9478-bfb4d5e5a9fa tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c7bf9767d0461f9556f74ff9a8a4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337d221cc6554437899bdcd6d509a655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:22:17.147694 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a9b6b852-cd7a-4322-9478-bfb4d5e5a9fa tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] 10.222.0.20 "GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e" status: 200 len: 1512 microversion: 2.1 time: 0.152663 Oct 27 04:22:17.148266 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3765/7240] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:22:16 2022] GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e => generated 1512 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:22:18.170698 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-81221e25-99cd-4d5c-b3c2-76c4225f3a7a tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:22:18.171330 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-81221e25-99cd-4d5c-b3c2-76c4225f3a7a tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] [instance: 0e567aed-dba1-4010-bd80-de3c9f9b7c7e] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:22:18.173985 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=41 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:22:18.178689 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-81221e25-99cd-4d5c-b3c2-76c4225f3a7a tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:18.179179 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-81221e25-99cd-4d5c-b3c2-76c4225f3a7a tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:18.182606 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-81221e25-99cd-4d5c-b3c2-76c4225f3a7a tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:18.182606 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-81221e25-99cd-4d5c-b3c2-76c4225f3a7a tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:18.182606 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-81221e25-99cd-4d5c-b3c2-76c4225f3a7a tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:18.182606 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-81221e25-99cd-4d5c-b3c2-76c4225f3a7a tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:18.315205 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-81221e25-99cd-4d5c-b3c2-76c4225f3a7a tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c7bf9767d0461f9556f74ff9a8a4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337d221cc6554437899bdcd6d509a655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:22:18.322975 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-81221e25-99cd-4d5c-b3c2-76c4225f3a7a tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] 10.222.0.20 "GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e" status: 200 len: 1512 microversion: 2.1 time: 0.156209 Oct 27 04:22:18.323590 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3476/7241] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:22:18 2022] GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e => generated 1512 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:22:19.345778 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-058e2ad4-bff6-4f8b-9a0f-7e17436bfd8b tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:22:19.346436 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-058e2ad4-bff6-4f8b-9a0f-7e17436bfd8b tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] [instance: 0e567aed-dba1-4010-bd80-de3c9f9b7c7e] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:22:19.354176 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-058e2ad4-bff6-4f8b-9a0f-7e17436bfd8b tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:19.354703 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-058e2ad4-bff6-4f8b-9a0f-7e17436bfd8b tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:19.355157 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-058e2ad4-bff6-4f8b-9a0f-7e17436bfd8b tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:19.355863 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-058e2ad4-bff6-4f8b-9a0f-7e17436bfd8b tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:19.356331 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-058e2ad4-bff6-4f8b-9a0f-7e17436bfd8b tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:19.356773 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-058e2ad4-bff6-4f8b-9a0f-7e17436bfd8b tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:19.487226 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-058e2ad4-bff6-4f8b-9a0f-7e17436bfd8b tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c7bf9767d0461f9556f74ff9a8a4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337d221cc6554437899bdcd6d509a655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:22:19.491636 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-058e2ad4-bff6-4f8b-9a0f-7e17436bfd8b tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] 10.222.0.20 "GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e" status: 200 len: 1512 microversion: 2.1 time: 0.150090 Oct 27 04:22:19.492213 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3766/7242] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:22:19 2022] GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e => generated 1512 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:22:20.518534 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-64b96b4d-39b0-4a6f-a4a5-0e2c748416f3 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:22:20.518534 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-64b96b4d-39b0-4a6f-a4a5-0e2c748416f3 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] [instance: 0e567aed-dba1-4010-bd80-de3c9f9b7c7e] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:22:20.522106 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-64b96b4d-39b0-4a6f-a4a5-0e2c748416f3 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:20.522603 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-64b96b4d-39b0-4a6f-a4a5-0e2c748416f3 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:20.523040 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-64b96b4d-39b0-4a6f-a4a5-0e2c748416f3 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:20.523738 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-64b96b4d-39b0-4a6f-a4a5-0e2c748416f3 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:20.524196 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-64b96b4d-39b0-4a6f-a4a5-0e2c748416f3 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:20.524625 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-64b96b4d-39b0-4a6f-a4a5-0e2c748416f3 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:20.653130 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-64b96b4d-39b0-4a6f-a4a5-0e2c748416f3 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c7bf9767d0461f9556f74ff9a8a4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337d221cc6554437899bdcd6d509a655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:22:20.660775 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-64b96b4d-39b0-4a6f-a4a5-0e2c748416f3 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] 10.222.0.20 "GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e" status: 200 len: 1512 microversion: 2.1 time: 0.150002 Oct 27 04:22:20.661346 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3477/7243] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:22:20 2022] GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e => generated 1512 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:22:21.684542 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-767b6856-6690-4a4e-993f-aeff2db3ce6e tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:22:21.685195 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-767b6856-6690-4a4e-993f-aeff2db3ce6e tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] [instance: 0e567aed-dba1-4010-bd80-de3c9f9b7c7e] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:22:21.692026 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-767b6856-6690-4a4e-993f-aeff2db3ce6e tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:21.692527 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-767b6856-6690-4a4e-993f-aeff2db3ce6e tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:21.692987 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-767b6856-6690-4a4e-993f-aeff2db3ce6e tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:21.693692 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-767b6856-6690-4a4e-993f-aeff2db3ce6e tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:21.694199 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-767b6856-6690-4a4e-993f-aeff2db3ce6e tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:21.694662 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-767b6856-6690-4a4e-993f-aeff2db3ce6e tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:21.824829 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-767b6856-6690-4a4e-993f-aeff2db3ce6e tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c7bf9767d0461f9556f74ff9a8a4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337d221cc6554437899bdcd6d509a655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:22:21.832482 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-767b6856-6690-4a4e-993f-aeff2db3ce6e tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] 10.222.0.20 "GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e" status: 200 len: 1512 microversion: 2.1 time: 0.152029 Oct 27 04:22:21.833057 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3767/7244] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:22:21 2022] GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e => generated 1512 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:22:22.856951 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b63f315b-6dff-49b7-a6cf-b0837e0a6bd7 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:22:22.857509 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b63f315b-6dff-49b7-a6cf-b0837e0a6bd7 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] [instance: 0e567aed-dba1-4010-bd80-de3c9f9b7c7e] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:22:22.864346 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b63f315b-6dff-49b7-a6cf-b0837e0a6bd7 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:22.864840 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b63f315b-6dff-49b7-a6cf-b0837e0a6bd7 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:22.865287 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b63f315b-6dff-49b7-a6cf-b0837e0a6bd7 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:22.865996 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b63f315b-6dff-49b7-a6cf-b0837e0a6bd7 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:22.866484 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b63f315b-6dff-49b7-a6cf-b0837e0a6bd7 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:22.866926 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b63f315b-6dff-49b7-a6cf-b0837e0a6bd7 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:23.004303 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b63f315b-6dff-49b7-a6cf-b0837e0a6bd7 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c7bf9767d0461f9556f74ff9a8a4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337d221cc6554437899bdcd6d509a655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:22:23.012014 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b63f315b-6dff-49b7-a6cf-b0837e0a6bd7 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] 10.222.0.20 "GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e" status: 200 len: 1512 microversion: 2.1 time: 0.159690 Oct 27 04:22:23.012605 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3478/7245] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:22:22 2022] GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e => generated 1512 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:22:24.035312 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-233754ec-8bf7-4597-b38f-607dbd85e693 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:22:24.035945 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-233754ec-8bf7-4597-b38f-607dbd85e693 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] [instance: 0e567aed-dba1-4010-bd80-de3c9f9b7c7e] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:22:24.042754 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-233754ec-8bf7-4597-b38f-607dbd85e693 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:24.043250 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-233754ec-8bf7-4597-b38f-607dbd85e693 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:24.043710 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-233754ec-8bf7-4597-b38f-607dbd85e693 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:24.044415 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-233754ec-8bf7-4597-b38f-607dbd85e693 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:24.044884 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-233754ec-8bf7-4597-b38f-607dbd85e693 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:24.045323 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-233754ec-8bf7-4597-b38f-607dbd85e693 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:24.177001 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-233754ec-8bf7-4597-b38f-607dbd85e693 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c7bf9767d0461f9556f74ff9a8a4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337d221cc6554437899bdcd6d509a655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:22:24.185404 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-233754ec-8bf7-4597-b38f-607dbd85e693 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] 10.222.0.20 "GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e" status: 200 len: 1512 microversion: 2.1 time: 0.154000 Oct 27 04:22:24.186200 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3768/7246] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:22:24 2022] GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e => generated 1512 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:22:25.208978 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-fa93c6b3-4aaa-4c9f-bc3b-5e5c3e7b6b5e tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:22:25.209595 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-fa93c6b3-4aaa-4c9f-bc3b-5e5c3e7b6b5e tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] [instance: 0e567aed-dba1-4010-bd80-de3c9f9b7c7e] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:22:25.216595 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fa93c6b3-4aaa-4c9f-bc3b-5e5c3e7b6b5e tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:25.217096 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fa93c6b3-4aaa-4c9f-bc3b-5e5c3e7b6b5e tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:25.217517 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fa93c6b3-4aaa-4c9f-bc3b-5e5c3e7b6b5e tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:25.218238 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fa93c6b3-4aaa-4c9f-bc3b-5e5c3e7b6b5e tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:25.218700 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fa93c6b3-4aaa-4c9f-bc3b-5e5c3e7b6b5e tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:25.219131 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fa93c6b3-4aaa-4c9f-bc3b-5e5c3e7b6b5e tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:25.346941 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-fa93c6b3-4aaa-4c9f-bc3b-5e5c3e7b6b5e tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c7bf9767d0461f9556f74ff9a8a4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337d221cc6554437899bdcd6d509a655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:22:25.355141 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-fa93c6b3-4aaa-4c9f-bc3b-5e5c3e7b6b5e tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] 10.222.0.20 "GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e" status: 200 len: 1512 microversion: 2.1 time: 0.150019 Oct 27 04:22:25.355722 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3479/7247] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:22:25 2022] GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e => generated 1512 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 04:22:26.377648 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b703b2cf-9b72-4370-9ab5-ec466bfc2e25 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:22:26.378315 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b703b2cf-9b72-4370-9ab5-ec466bfc2e25 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] [instance: 0e567aed-dba1-4010-bd80-de3c9f9b7c7e] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:22:26.385796 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b703b2cf-9b72-4370-9ab5-ec466bfc2e25 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:26.386393 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b703b2cf-9b72-4370-9ab5-ec466bfc2e25 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:26.386853 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b703b2cf-9b72-4370-9ab5-ec466bfc2e25 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:26.387566 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b703b2cf-9b72-4370-9ab5-ec466bfc2e25 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:26.388043 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b703b2cf-9b72-4370-9ab5-ec466bfc2e25 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:26.388493 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b703b2cf-9b72-4370-9ab5-ec466bfc2e25 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:26.523765 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b703b2cf-9b72-4370-9ab5-ec466bfc2e25 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c7bf9767d0461f9556f74ff9a8a4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337d221cc6554437899bdcd6d509a655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:22:26.532218 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b703b2cf-9b72-4370-9ab5-ec466bfc2e25 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] 10.222.0.20 "GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e" status: 200 len: 1511 microversion: 2.1 time: 0.158275 Oct 27 04:22:26.532599 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3769/7248] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:22:26 2022] GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e => generated 1511 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:22:26.893704 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-dd2f3779-8f69-4a98-96d0-97cb96f6cb00 req-471a61e6-9b24-42a3-ac57-52f84261fef7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e567aed-dba1-4010-bd80-de3c9f9b7c7e", "name": "network-vif-unplugged", "status": "completed", "tag": "0404e152-442e-4e7f-b6fa-322bd19af82d"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:22:26.904253 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-dd2f3779-8f69-4a98-96d0-97cb96f6cb00 req-471a61e6-9b24-42a3-ac57-52f84261fef7 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:26.904738 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-dd2f3779-8f69-4a98-96d0-97cb96f6cb00 req-471a61e6-9b24-42a3-ac57-52f84261fef7 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:26.908477 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-dd2f3779-8f69-4a98-96d0-97cb96f6cb00 req-471a61e6-9b24-42a3-ac57-52f84261fef7 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:26.917250 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-dd2f3779-8f69-4a98-96d0-97cb96f6cb00 req-471a61e6-9b24-42a3-ac57-52f84261fef7 service nova] Creating event network-vif-unplugged:0404e152-442e-4e7f-b6fa-322bd19af82d for instance 0e567aed-dba1-4010-bd80-de3c9f9b7c7e on n-h2-862769-1 Oct 27 04:22:26.922487 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [req-dd2f3779-8f69-4a98-96d0-97cb96f6cb00 req-471a61e6-9b24-42a3-ac57-52f84261fef7 service nova] Instance 0e567aed-dba1-4010-bd80-de3c9f9b7c7e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862769-1', 'n-h1-862769-1'} {{(pid=121000) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 04:22:26.934487 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-dd2f3779-8f69-4a98-96d0-97cb96f6cb00 req-471a61e6-9b24-42a3-ac57-52f84261fef7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044368 Oct 27 04:22:26.935110 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3480/7249] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:22:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:22:27.556121 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e358799f-9c71-4122-86a6-f972dce94dd5 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:22:27.556774 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e358799f-9c71-4122-86a6-f972dce94dd5 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] [instance: 0e567aed-dba1-4010-bd80-de3c9f9b7c7e] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:22:27.563319 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e358799f-9c71-4122-86a6-f972dce94dd5 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:27.563832 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e358799f-9c71-4122-86a6-f972dce94dd5 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:27.564287 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e358799f-9c71-4122-86a6-f972dce94dd5 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:27.565004 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e358799f-9c71-4122-86a6-f972dce94dd5 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:27.565478 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e358799f-9c71-4122-86a6-f972dce94dd5 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:27.565920 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e358799f-9c71-4122-86a6-f972dce94dd5 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:27.696679 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e358799f-9c71-4122-86a6-f972dce94dd5 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c7bf9767d0461f9556f74ff9a8a4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337d221cc6554437899bdcd6d509a655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:22:27.704551 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e358799f-9c71-4122-86a6-f972dce94dd5 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] 10.222.0.20 "GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e" status: 200 len: 1511 microversion: 2.1 time: 0.152297 Oct 27 04:22:27.705163 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3770/7250] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:22:27 2022] GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e => generated 1511 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:22:28.730489 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e1b8385d-0931-4a32-b589-e2156cb61743 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:22:28.731202 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e1b8385d-0931-4a32-b589-e2156cb61743 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] [instance: 0e567aed-dba1-4010-bd80-de3c9f9b7c7e] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:22:28.737368 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e1b8385d-0931-4a32-b589-e2156cb61743 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:28.737861 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e1b8385d-0931-4a32-b589-e2156cb61743 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:28.738342 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e1b8385d-0931-4a32-b589-e2156cb61743 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:28.739046 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e1b8385d-0931-4a32-b589-e2156cb61743 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:28.739510 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e1b8385d-0931-4a32-b589-e2156cb61743 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:28.739947 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e1b8385d-0931-4a32-b589-e2156cb61743 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:28.872443 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e1b8385d-0931-4a32-b589-e2156cb61743 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c7bf9767d0461f9556f74ff9a8a4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337d221cc6554437899bdcd6d509a655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:22:28.880093 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e1b8385d-0931-4a32-b589-e2156cb61743 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] 10.222.0.20 "GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e" status: 200 len: 1509 microversion: 2.1 time: 0.155452 Oct 27 04:22:28.880663 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3481/7251] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:22:28 2022] GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:22:28.949653 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-5613ddfc-44ff-479a-8532-63f7e9399926 req-a508651e-1169-43b9-bd2b-c67f45a76be9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e567aed-dba1-4010-bd80-de3c9f9b7c7e", "tag": "0404e152-442e-4e7f-b6fa-322bd19af82d"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:22:28.959290 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-5613ddfc-44ff-479a-8532-63f7e9399926 req-a508651e-1169-43b9-bd2b-c67f45a76be9 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:28.959784 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-5613ddfc-44ff-479a-8532-63f7e9399926 req-a508651e-1169-43b9-bd2b-c67f45a76be9 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:28.960235 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-5613ddfc-44ff-479a-8532-63f7e9399926 req-a508651e-1169-43b9-bd2b-c67f45a76be9 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:28.972877 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-5613ddfc-44ff-479a-8532-63f7e9399926 req-a508651e-1169-43b9-bd2b-c67f45a76be9 service nova] Creating event network-changed:0404e152-442e-4e7f-b6fa-322bd19af82d for instance 0e567aed-dba1-4010-bd80-de3c9f9b7c7e on n-h2-862769-1 Oct 27 04:22:28.978311 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [req-5613ddfc-44ff-479a-8532-63f7e9399926 req-a508651e-1169-43b9-bd2b-c67f45a76be9 service nova] Instance 0e567aed-dba1-4010-bd80-de3c9f9b7c7e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862769-1', 'n-h1-862769-1'} {{(pid=121001) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 04:22:28.989637 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-5613ddfc-44ff-479a-8532-63f7e9399926 req-a508651e-1169-43b9-bd2b-c67f45a76be9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044201 Oct 27 04:22:28.990346 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3771/7252] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:22:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:22:29.904614 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e5041f0b-963d-410d-9351-89b155d81ca3 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:22:29.905237 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e5041f0b-963d-410d-9351-89b155d81ca3 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] [instance: 0e567aed-dba1-4010-bd80-de3c9f9b7c7e] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:22:29.912179 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e5041f0b-963d-410d-9351-89b155d81ca3 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:29.912701 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e5041f0b-963d-410d-9351-89b155d81ca3 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:29.913145 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e5041f0b-963d-410d-9351-89b155d81ca3 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:29.913842 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e5041f0b-963d-410d-9351-89b155d81ca3 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:29.914332 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e5041f0b-963d-410d-9351-89b155d81ca3 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:29.914765 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e5041f0b-963d-410d-9351-89b155d81ca3 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:30.043163 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e5041f0b-963d-410d-9351-89b155d81ca3 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c7bf9767d0461f9556f74ff9a8a4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337d221cc6554437899bdcd6d509a655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:22:30.050890 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e5041f0b-963d-410d-9351-89b155d81ca3 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] 10.222.0.20 "GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e" status: 200 len: 1506 microversion: 2.1 time: 0.150761 Oct 27 04:22:30.051476 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3482/7253] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:22:29 2022] GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e => generated 1506 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:22:30.073388 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b5154447-24cc-49df-be62-c854c57239a4 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:22:30.074019 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b5154447-24cc-49df-be62-c854c57239a4 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] [instance: 0e567aed-dba1-4010-bd80-de3c9f9b7c7e] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:22:30.080933 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b5154447-24cc-49df-be62-c854c57239a4 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:30.081427 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b5154447-24cc-49df-be62-c854c57239a4 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:30.081884 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b5154447-24cc-49df-be62-c854c57239a4 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:30.082612 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b5154447-24cc-49df-be62-c854c57239a4 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:30.083089 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b5154447-24cc-49df-be62-c854c57239a4 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:30.083533 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b5154447-24cc-49df-be62-c854c57239a4 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:30.109967 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b5154447-24cc-49df-be62-c854c57239a4 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] [instance: 0e567aed-dba1-4010-bd80-de3c9f9b7c7e] Going to try to terminate instance {{(pid=121001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 04:22:30.224397 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.compute.api [None req-b5154447-24cc-49df-be62-c854c57239a4 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] [instance: 0e567aed-dba1-4010-bd80-de3c9f9b7c7e] Found an unconfirmed migration during delete, id: 16, status: finished Oct 27 04:22:32.751511 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b5154447-24cc-49df-be62-c854c57239a4 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e" status: 204 len: 0 microversion: 2.1 time: 2.682017 Oct 27 04:22:32.752278 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3772/7254] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 04:22:30 2022] DELETE /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e => generated 0 bytes in 2684 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 04:22:32.760919 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-bd8a03e6-5b18-48b8-82f5-b960305c2e0a tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:22:32.763207 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-bd8a03e6-5b18-48b8-82f5-b960305c2e0a tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] [instance: 0e567aed-dba1-4010-bd80-de3c9f9b7c7e] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:22:32.768813 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bd8a03e6-5b18-48b8-82f5-b960305c2e0a tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:32.769307 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bd8a03e6-5b18-48b8-82f5-b960305c2e0a tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:32.769760 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bd8a03e6-5b18-48b8-82f5-b960305c2e0a tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:32.770488 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bd8a03e6-5b18-48b8-82f5-b960305c2e0a tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:32.770956 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bd8a03e6-5b18-48b8-82f5-b960305c2e0a tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:32.771435 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bd8a03e6-5b18-48b8-82f5-b960305c2e0a tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:32.902386 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-bd8a03e6-5b18-48b8-82f5-b960305c2e0a tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c7bf9767d0461f9556f74ff9a8a4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337d221cc6554437899bdcd6d509a655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:22:32.908192 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-9044b53b-ae2a-4a05-a085-1823e5532e16 req-b5574249-2cce-415e-a41e-e86720d726f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e567aed-dba1-4010-bd80-de3c9f9b7c7e", "name": "network-vif-plugged", "status": "completed", "tag": "0404e152-442e-4e7f-b6fa-322bd19af82d"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:22:32.921894 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-9044b53b-ae2a-4a05-a085-1823e5532e16 req-b5574249-2cce-415e-a41e-e86720d726f3 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:32.922125 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-bd8a03e6-5b18-48b8-82f5-b960305c2e0a tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] 10.222.0.20 "GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e" status: 200 len: 1498 microversion: 2.1 time: 0.165498 Oct 27 04:22:32.922441 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-9044b53b-ae2a-4a05-a085-1823e5532e16 req-b5574249-2cce-415e-a41e-e86720d726f3 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:32.922666 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3483/7255] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:22:32 2022] GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e => generated 1498 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:22:32.922901 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-9044b53b-ae2a-4a05-a085-1823e5532e16 req-b5574249-2cce-415e-a41e-e86720d726f3 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:32.934163 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-9044b53b-ae2a-4a05-a085-1823e5532e16 req-b5574249-2cce-415e-a41e-e86720d726f3 service nova] Creating event network-vif-plugged:0404e152-442e-4e7f-b6fa-322bd19af82d for instance 0e567aed-dba1-4010-bd80-de3c9f9b7c7e on n-h2-862769-1 Oct 27 04:22:32.940755 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-9044b53b-ae2a-4a05-a085-1823e5532e16 req-b5574249-2cce-415e-a41e-e86720d726f3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036589 Oct 27 04:22:32.941365 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3773/7256] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:22:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:22:33.946343 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f89bf757-eca1-4471-b182-d6a414a384d4 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:22:33.947699 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f89bf757-eca1-4471-b182-d6a414a384d4 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] [instance: 0e567aed-dba1-4010-bd80-de3c9f9b7c7e] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:22:33.954615 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f89bf757-eca1-4471-b182-d6a414a384d4 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:33.955131 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f89bf757-eca1-4471-b182-d6a414a384d4 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:33.955576 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f89bf757-eca1-4471-b182-d6a414a384d4 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:33.956273 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f89bf757-eca1-4471-b182-d6a414a384d4 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:33.956731 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f89bf757-eca1-4471-b182-d6a414a384d4 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:33.957159 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f89bf757-eca1-4471-b182-d6a414a384d4 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:34.132526 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f89bf757-eca1-4471-b182-d6a414a384d4 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c7bf9767d0461f9556f74ff9a8a4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337d221cc6554437899bdcd6d509a655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:22:34.140317 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f89bf757-eca1-4471-b182-d6a414a384d4 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] 10.222.0.20 "GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e" status: 200 len: 1498 microversion: 2.1 time: 0.197984 Oct 27 04:22:34.140892 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3484/7257] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:22:33 2022] GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e => generated 1498 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:22:34.651342 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-d2935ff0-a660-4f23-9bbd-fbfded9a6535 req-6a07907c-3865-47a8-a1fb-fd23ad9f4127 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e567aed-dba1-4010-bd80-de3c9f9b7c7e", "name": "network-vif-deleted", "tag": "0404e152-442e-4e7f-b6fa-322bd19af82d"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:22:34.660773 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-d2935ff0-a660-4f23-9bbd-fbfded9a6535 req-6a07907c-3865-47a8-a1fb-fd23ad9f4127 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:34.661273 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-d2935ff0-a660-4f23-9bbd-fbfded9a6535 req-6a07907c-3865-47a8-a1fb-fd23ad9f4127 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:34.661726 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-d2935ff0-a660-4f23-9bbd-fbfded9a6535 req-6a07907c-3865-47a8-a1fb-fd23ad9f4127 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:34.673171 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-d2935ff0-a660-4f23-9bbd-fbfded9a6535 req-6a07907c-3865-47a8-a1fb-fd23ad9f4127 service nova] Creating event network-vif-deleted:0404e152-442e-4e7f-b6fa-322bd19af82d for instance 0e567aed-dba1-4010-bd80-de3c9f9b7c7e on n-h2-862769-1 Oct 27 04:22:34.678026 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-d2935ff0-a660-4f23-9bbd-fbfded9a6535 req-6a07907c-3865-47a8-a1fb-fd23ad9f4127 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032284 Oct 27 04:22:34.678639 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3774/7258] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:22:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:22:35.163530 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-60baf47f-bd84-462a-a44e-4cc6ae8a323d tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:22:35.164067 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-60baf47f-bd84-462a-a44e-4cc6ae8a323d tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] [instance: 0e567aed-dba1-4010-bd80-de3c9f9b7c7e] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:22:35.170849 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-60baf47f-bd84-462a-a44e-4cc6ae8a323d tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:35.172782 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-60baf47f-bd84-462a-a44e-4cc6ae8a323d tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:35.172782 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-60baf47f-bd84-462a-a44e-4cc6ae8a323d tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:35.172782 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-60baf47f-bd84-462a-a44e-4cc6ae8a323d tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:35.173080 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-60baf47f-bd84-462a-a44e-4cc6ae8a323d tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:35.173285 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-60baf47f-bd84-462a-a44e-4cc6ae8a323d tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:35.208353 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-60baf47f-bd84-462a-a44e-4cc6ae8a323d tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:35.208839 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-60baf47f-bd84-462a-a44e-4cc6ae8a323d tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:35.209281 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-60baf47f-bd84-462a-a44e-4cc6ae8a323d tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:35.209734 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-60baf47f-bd84-462a-a44e-4cc6ae8a323d tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lazy-loading 'fault' on Instance uuid 0e567aed-dba1-4010-bd80-de3c9f9b7c7e {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 04:22:35.250923 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-60baf47f-bd84-462a-a44e-4cc6ae8a323d tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c7bf9767d0461f9556f74ff9a8a4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337d221cc6554437899bdcd6d509a655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:22:35.258023 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-60baf47f-bd84-462a-a44e-4cc6ae8a323d tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] 10.222.0.20 "GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e" status: 200 len: 1303 microversion: 2.1 time: 0.098489 Oct 27 04:22:35.259071 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3485/7259] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:22:35 2022] GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e => generated 1303 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:22:36.283611 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b1db8f75-6741-48a6-8d56-26be9fcb24cc tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:22:36.284278 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b1db8f75-6741-48a6-8d56-26be9fcb24cc tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] [instance: 0e567aed-dba1-4010-bd80-de3c9f9b7c7e] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:22:36.290508 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b1db8f75-6741-48a6-8d56-26be9fcb24cc tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:36.291007 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b1db8f75-6741-48a6-8d56-26be9fcb24cc tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:36.291462 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b1db8f75-6741-48a6-8d56-26be9fcb24cc tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:36.292172 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b1db8f75-6741-48a6-8d56-26be9fcb24cc tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:36.292641 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b1db8f75-6741-48a6-8d56-26be9fcb24cc tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:36.293084 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b1db8f75-6741-48a6-8d56-26be9fcb24cc tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:36.306220 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-b1db8f75-6741-48a6-8d56-26be9fcb24cc tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] HTTP exception thrown: Instance 0e567aed-dba1-4010-bd80-de3c9f9b7c7e could not be found. Oct 27 04:22:36.307837 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b1db8f75-6741-48a6-8d56-26be9fcb24cc tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Request method failure captured: Oct 27 04:22:36.307837 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e HTTP/1.1 Oct 27 04:22:36.307837 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 04:22:36.307837 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 04:22:36.307837 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 04:22:36.307837 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 04:22:36.307837 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 04:22:36.307837 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 04:22:36.307837 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 04:22:36.307837 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 04:22:36.307837 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWgdUMtHhfMxz3yIOLJrSSFIxO4duXmkOkR82eM4KWw1kdU99_Np7AOtlWTrEnrAqrLhhulT4AHXHtYpmLl-1XhxJWbY5mV4CKLNl2JLOK2Z4XEWzZoAEdjAiJo_VmkhG2U3wngzoqTutOu8pEn39oDlUIzJjrHZp56eut-jGTpKkBGM Oct 27 04:22:36.307837 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 04:22:36.307837 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 04:22:36.307837 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 04:22:36.307837 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 04:22:36.307837 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 04:22:36.307837 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 04:22:36.307837 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 337d221cc6554437899bdcd6d509a655 Oct 27 04:22:36.307837 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-DeleteServersTestJSON-1651889256 Oct 27 04:22:36.307837 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 04:22:36.307837 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 04:22:36.307837 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/337d221cc6554437899bdcd6d509a655"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/337d221cc6554437899bdcd6d509a655"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/337d221cc6554437899bdcd6d509a655"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_337d221cc6554437899bdcd6d509a655"}]}] Oct 27 04:22:36.307837 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-DeleteServersTestJSON-1651889256 Oct 27 04:22:36.307837 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 337d221cc6554437899bdcd6d509a655 Oct 27 04:22:36.307837 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-DeleteServersTestJSON-1651889256 Oct 27 04:22:36.307837 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-DeleteServersTestJSON-1651889256-project Oct 27 04:22:36.307837 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 04:22:36.307837 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 04:22:36.307837 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 80c7bf9767d0461f9556f74ff9a8a4f3 Oct 27 04:22:36.307837 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-DeleteServersTestJSON-1651889256-project Oct 27 04:22:36.307837 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 04:22:36.307837 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 0e567aed-dba1-4010-bd80-de3c9f9b7c7e could not be found. Oct 27 04:22:36.307837 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '0e567aed-dba1-4010-bd80-de3c9f9b7c7e'} Oct 27 04:22:36.307837 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 04:22:36.307837 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:22:36.307837 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 04:22:36.307837 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 04:22:36.307837 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 04:22:36.307837 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 04:22:36.307837 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 04:22:36.307837 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 04:22:36.307837 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 04:22:36.307837 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 04:22:36.307837 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e567aed-dba1-4010-bd80-de3c9f9b7c7e could not be found. Oct 27 04:22:36.307837 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:22:36.307837 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:22:36.307837 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:22:36.307837 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:22:36.307837 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:22:36.307837 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:22:36.307837 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 04:22:36.307837 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 04:22:36.307837 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 04:22:36.307837 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 04:22:36.307837 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 04:22:36.307837 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 04:22:36.307837 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 04:22:36.307837 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 04:22:36.307837 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 04:22:36.307837 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 04:22:36.307837 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e567aed-dba1-4010-bd80-de3c9f9b7c7e could not be found. Oct 27 04:22:36.307837 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:22:36.307837 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:22:36.307837 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:22:36.312990 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:22:36.312990 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:22:36.312990 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:22:36.312990 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 04:22:36.312990 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 04:22:36.312990 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e567aed-dba1-4010-bd80-de3c9f9b7c7e could not be found. Oct 27 04:22:36.312990 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:22:36.312990 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b1db8f75-6741-48a6-8d56-26be9fcb24cc tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Returning 404 to user: Instance 0e567aed-dba1-4010-bd80-de3c9f9b7c7e could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 04:22:36.312990 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b1db8f75-6741-48a6-8d56-26be9fcb24cc tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] 10.222.0.20 "GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e" status: 404 len: 111 microversion: 2.1 time: 0.030865 Oct 27 04:22:36.312990 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3775/7260] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:22:36 2022] GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 04:22:36.325442 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4e2aa367-9b9f-47c8-baed-e8f9a49eeac2 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:22:36.325962 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4e2aa367-9b9f-47c8-baed-e8f9a49eeac2 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] [instance: 0e567aed-dba1-4010-bd80-de3c9f9b7c7e] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:22:36.332748 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4e2aa367-9b9f-47c8-baed-e8f9a49eeac2 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:36.333236 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4e2aa367-9b9f-47c8-baed-e8f9a49eeac2 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:36.333671 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4e2aa367-9b9f-47c8-baed-e8f9a49eeac2 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:36.334397 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4e2aa367-9b9f-47c8-baed-e8f9a49eeac2 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:36.334854 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4e2aa367-9b9f-47c8-baed-e8f9a49eeac2 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:36.335578 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4e2aa367-9b9f-47c8-baed-e8f9a49eeac2 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:36.349792 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-4e2aa367-9b9f-47c8-baed-e8f9a49eeac2 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] HTTP exception thrown: Instance 0e567aed-dba1-4010-bd80-de3c9f9b7c7e could not be found. Oct 27 04:22:36.351527 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4e2aa367-9b9f-47c8-baed-e8f9a49eeac2 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Request method failure captured: Oct 27 04:22:36.351527 n-d-862769-1 devstack@n-api.service[121000]: request: DELETE /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e HTTP/1.1 Oct 27 04:22:36.351527 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 04:22:36.351527 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 04:22:36.351527 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 04:22:36.351527 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 04:22:36.351527 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 04:22:36.351527 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 04:22:36.351527 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 04:22:36.351527 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 04:22:36.351527 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWgdUMtHhfMxz3yIOLJrSSFIxO4duXmkOkR82eM4KWw1kdU99_Np7AOtlWTrEnrAqrLhhulT4AHXHtYpmLl-1XhxJWbY5mV4CKLNl2JLOK2Z4XEWzZoAEdjAiJo_VmkhG2U3wngzoqTutOu8pEn39oDlUIzJjrHZp56eut-jGTpKkBGM Oct 27 04:22:36.351527 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 04:22:36.351527 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 04:22:36.351527 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 04:22:36.351527 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 04:22:36.351527 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 04:22:36.351527 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 04:22:36.351527 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 337d221cc6554437899bdcd6d509a655 Oct 27 04:22:36.351527 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-DeleteServersTestJSON-1651889256 Oct 27 04:22:36.351527 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 04:22:36.351527 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 04:22:36.351527 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/337d221cc6554437899bdcd6d509a655"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/337d221cc6554437899bdcd6d509a655"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/337d221cc6554437899bdcd6d509a655"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_337d221cc6554437899bdcd6d509a655"}]}] Oct 27 04:22:36.351527 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-DeleteServersTestJSON-1651889256 Oct 27 04:22:36.351527 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 337d221cc6554437899bdcd6d509a655 Oct 27 04:22:36.351527 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-DeleteServersTestJSON-1651889256 Oct 27 04:22:36.351527 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-DeleteServersTestJSON-1651889256-project Oct 27 04:22:36.351527 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 04:22:36.351527 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 04:22:36.351527 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 80c7bf9767d0461f9556f74ff9a8a4f3 Oct 27 04:22:36.351527 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-DeleteServersTestJSON-1651889256-project Oct 27 04:22:36.351527 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 04:22:36.351527 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 0e567aed-dba1-4010-bd80-de3c9f9b7c7e could not be found. Oct 27 04:22:36.351527 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '0e567aed-dba1-4010-bd80-de3c9f9b7c7e'} Oct 27 04:22:36.351527 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 04:22:36.351527 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:22:36.351527 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 04:22:36.351527 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 04:22:36.351527 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 04:22:36.351527 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 04:22:36.351527 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 04:22:36.351527 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 04:22:36.351527 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 04:22:36.351527 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 04:22:36.351527 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e567aed-dba1-4010-bd80-de3c9f9b7c7e could not be found. Oct 27 04:22:36.351527 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:22:36.351527 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:22:36.351527 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:22:36.351527 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:22:36.351527 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:22:36.351527 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:22:36.351527 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 04:22:36.351527 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 04:22:36.351527 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 04:22:36.351527 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 04:22:36.351527 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 04:22:36.351527 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 04:22:36.351527 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 04:22:36.351527 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 04:22:36.351527 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 04:22:36.351527 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 04:22:36.351527 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 04:22:36.351527 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 04:22:36.355822 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e567aed-dba1-4010-bd80-de3c9f9b7c7e could not be found. Oct 27 04:22:36.355822 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:22:36.355822 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:22:36.355822 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:22:36.355822 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:22:36.355822 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:22:36.355822 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:22:36.355822 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 04:22:36.355822 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 04:22:36.355822 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e567aed-dba1-4010-bd80-de3c9f9b7c7e could not be found. Oct 27 04:22:36.355822 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:22:36.355822 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4e2aa367-9b9f-47c8-baed-e8f9a49eeac2 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Returning 404 to user: Instance 0e567aed-dba1-4010-bd80-de3c9f9b7c7e could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 04:22:36.355822 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4e2aa367-9b9f-47c8-baed-e8f9a49eeac2 tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e" status: 404 len: 111 microversion: 2.1 time: 0.031950 Oct 27 04:22:36.355822 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3486/7261] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 04:22:36 2022] DELETE /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 04:22:36.361524 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-02f743d9-16b7-48c9-9ad1-201ed5d11f7a tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:22:36.362196 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-02f743d9-16b7-48c9-9ad1-201ed5d11f7a tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] [instance: 0e567aed-dba1-4010-bd80-de3c9f9b7c7e] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:22:36.368092 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-02f743d9-16b7-48c9-9ad1-201ed5d11f7a tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:36.368601 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-02f743d9-16b7-48c9-9ad1-201ed5d11f7a tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:36.369059 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-02f743d9-16b7-48c9-9ad1-201ed5d11f7a tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:36.369771 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-02f743d9-16b7-48c9-9ad1-201ed5d11f7a tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:36.370351 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-02f743d9-16b7-48c9-9ad1-201ed5d11f7a tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:36.370794 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-02f743d9-16b7-48c9-9ad1-201ed5d11f7a tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:36.387351 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-02f743d9-16b7-48c9-9ad1-201ed5d11f7a tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] HTTP exception thrown: Instance 0e567aed-dba1-4010-bd80-de3c9f9b7c7e could not be found. Oct 27 04:22:36.388904 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-02f743d9-16b7-48c9-9ad1-201ed5d11f7a tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Request method failure captured: Oct 27 04:22:36.388904 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e HTTP/1.1 Oct 27 04:22:36.388904 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 04:22:36.388904 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 04:22:36.388904 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 04:22:36.388904 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 04:22:36.388904 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 04:22:36.388904 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 04:22:36.388904 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 04:22:36.388904 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 04:22:36.388904 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWgdUMtHhfMxz3yIOLJrSSFIxO4duXmkOkR82eM4KWw1kdU99_Np7AOtlWTrEnrAqrLhhulT4AHXHtYpmLl-1XhxJWbY5mV4CKLNl2JLOK2Z4XEWzZoAEdjAiJo_VmkhG2U3wngzoqTutOu8pEn39oDlUIzJjrHZp56eut-jGTpKkBGM Oct 27 04:22:36.388904 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 04:22:36.388904 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 04:22:36.388904 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 04:22:36.388904 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 04:22:36.388904 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 04:22:36.388904 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 04:22:36.388904 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 337d221cc6554437899bdcd6d509a655 Oct 27 04:22:36.388904 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-DeleteServersTestJSON-1651889256 Oct 27 04:22:36.388904 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 04:22:36.388904 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 04:22:36.388904 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/337d221cc6554437899bdcd6d509a655"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/337d221cc6554437899bdcd6d509a655"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/337d221cc6554437899bdcd6d509a655"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_337d221cc6554437899bdcd6d509a655"}]}] Oct 27 04:22:36.388904 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-DeleteServersTestJSON-1651889256 Oct 27 04:22:36.388904 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 337d221cc6554437899bdcd6d509a655 Oct 27 04:22:36.388904 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-DeleteServersTestJSON-1651889256 Oct 27 04:22:36.388904 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-DeleteServersTestJSON-1651889256-project Oct 27 04:22:36.388904 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 04:22:36.388904 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 04:22:36.388904 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 80c7bf9767d0461f9556f74ff9a8a4f3 Oct 27 04:22:36.388904 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-DeleteServersTestJSON-1651889256-project Oct 27 04:22:36.388904 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 04:22:36.388904 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 0e567aed-dba1-4010-bd80-de3c9f9b7c7e could not be found. Oct 27 04:22:36.388904 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '0e567aed-dba1-4010-bd80-de3c9f9b7c7e'} Oct 27 04:22:36.388904 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 04:22:36.388904 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:22:36.388904 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 04:22:36.388904 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 04:22:36.388904 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 04:22:36.388904 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 04:22:36.388904 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 04:22:36.388904 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 04:22:36.388904 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 04:22:36.388904 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 04:22:36.388904 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e567aed-dba1-4010-bd80-de3c9f9b7c7e could not be found. Oct 27 04:22:36.388904 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:22:36.388904 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:22:36.388904 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:22:36.388904 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:22:36.388904 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:22:36.388904 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:22:36.388904 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 04:22:36.388904 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 04:22:36.388904 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 04:22:36.388904 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 04:22:36.388904 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 04:22:36.388904 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 04:22:36.388904 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 04:22:36.388904 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 04:22:36.388904 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 04:22:36.388904 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 04:22:36.388904 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e567aed-dba1-4010-bd80-de3c9f9b7c7e could not be found. Oct 27 04:22:36.388904 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:22:36.388904 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:22:36.388904 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:22:36.393542 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:22:36.393542 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:22:36.393542 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:22:36.393542 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 04:22:36.393542 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 04:22:36.393542 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e567aed-dba1-4010-bd80-de3c9f9b7c7e could not be found. Oct 27 04:22:36.393542 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:22:36.393542 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-02f743d9-16b7-48c9-9ad1-201ed5d11f7a tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] Returning 404 to user: Instance 0e567aed-dba1-4010-bd80-de3c9f9b7c7e could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 04:22:36.393542 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-02f743d9-16b7-48c9-9ad1-201ed5d11f7a tempest-DeleteServersTestJSON-1651889256 tempest-DeleteServersTestJSON-1651889256-project] 10.222.0.20 "GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e" status: 404 len: 111 microversion: 2.1 time: 0.032690 Oct 27 04:22:36.393542 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3776/7262] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:22:36 2022] GET /compute/v2.1/servers/0e567aed-dba1-4010-bd80-de3c9f9b7c7e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 04:22:47.284433 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=23 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:22:47.285272 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=67 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:22:47.417267 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-932d4be9-cee5-4a06-b28e-374b43a94a42 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1365807624", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": [{"uuid": "f7aed6fe-b7bc-4445-88af-82f555f3f11e"}]}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:22:47.477602 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-932d4be9-cee5-4a06-b28e-374b43a94a42 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] validate_networks() for [('f7aed6fe-b7bc-4445-88af-82f555f3f11e', None, None, None, None, None)] {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 04:22:47.880226 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-932d4be9-cee5-4a06-b28e-374b43a94a42 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 04:22:47.880665 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-932d4be9-cee5-4a06-b28e-374b43a94a42 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 04:22:47.881159 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-932d4be9-cee5-4a06-b28e-374b43a94a42 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 04:22:47.881586 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-932d4be9-cee5-4a06-b28e-374b43a94a42 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 04:22:47.882011 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-932d4be9-cee5-4a06-b28e-374b43a94a42 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 04:22:47.891715 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-932d4be9-cee5-4a06-b28e-374b43a94a42 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:47.892209 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-932d4be9-cee5-4a06-b28e-374b43a94a42 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:47.892658 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-932d4be9-cee5-4a06-b28e-374b43a94a42 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:47.893404 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-932d4be9-cee5-4a06-b28e-374b43a94a42 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:47.893878 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-932d4be9-cee5-4a06-b28e-374b43a94a42 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:47.894344 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-932d4be9-cee5-4a06-b28e-374b43a94a42 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:47.912092 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-932d4be9-cee5-4a06-b28e-374b43a94a42 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Getting quotas for project 8f53f549cce04ce78df9a4b68ec35177. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 04:22:47.917739 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-932d4be9-cee5-4a06-b28e-374b43a94a42 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Getting quotas for user 0482d6b66ea34d34bed74fac32f55068 and project 8f53f549cce04ce78df9a4b68ec35177. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 04:22:47.930473 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-932d4be9-cee5-4a06-b28e-374b43a94a42 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 04:22:47.933454 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-932d4be9-cee5-4a06-b28e-374b43a94a42 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: 6c6d7869-b37b-4108-ac89-2bca489f4a1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 04:22:48.060320 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-932d4be9-cee5-4a06-b28e-374b43a94a42 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.781731 Oct 27 04:22:48.060987 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3487/7263] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 04:22:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 783 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 04:22:48.073084 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5c638c93-3cf4-4d0e-bfa3-dacd5226dbb4 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:22:48.073721 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5c638c93-3cf4-4d0e-bfa3-dacd5226dbb4 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: 6c6d7869-b37b-4108-ac89-2bca489f4a1f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:22:48.078710 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:22:48.079640 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:22:48.132869 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5c638c93-3cf4-4d0e-bfa3-dacd5226dbb4 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:22:48.140651 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5c638c93-3cf4-4d0e-bfa3-dacd5226dbb4 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f" status: 200 len: 1218 microversion: 2.1 time: 0.072184 Oct 27 04:22:48.144382 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3777/7264] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:22:48 2022] GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f => generated 1218 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:22:49.163686 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-940f5f88-fe63-4e1b-820c-fd6991022608 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:22:49.164318 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-940f5f88-fe63-4e1b-820c-fd6991022608 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: 6c6d7869-b37b-4108-ac89-2bca489f4a1f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:22:49.171860 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-940f5f88-fe63-4e1b-820c-fd6991022608 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:49.172597 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-940f5f88-fe63-4e1b-820c-fd6991022608 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:49.173231 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-940f5f88-fe63-4e1b-820c-fd6991022608 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:49.173969 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-940f5f88-fe63-4e1b-820c-fd6991022608 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:49.174449 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-940f5f88-fe63-4e1b-820c-fd6991022608 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:49.174886 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-940f5f88-fe63-4e1b-820c-fd6991022608 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:49.246752 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-940f5f88-fe63-4e1b-820c-fd6991022608 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:22:49.254543 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-940f5f88-fe63-4e1b-820c-fd6991022608 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f" status: 200 len: 1222 microversion: 2.1 time: 0.094812 Oct 27 04:22:49.255123 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3488/7265] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:22:49 2022] GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f => generated 1222 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:22:50.279212 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-19b95512-8a91-4b18-8514-204881fdb71c tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:22:50.279946 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-19b95512-8a91-4b18-8514-204881fdb71c tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: 6c6d7869-b37b-4108-ac89-2bca489f4a1f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:22:50.289517 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-19b95512-8a91-4b18-8514-204881fdb71c tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:50.290057 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-19b95512-8a91-4b18-8514-204881fdb71c tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:50.291175 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-19b95512-8a91-4b18-8514-204881fdb71c tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:50.291949 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-19b95512-8a91-4b18-8514-204881fdb71c tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:50.292879 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-19b95512-8a91-4b18-8514-204881fdb71c tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:50.293671 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-19b95512-8a91-4b18-8514-204881fdb71c tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:50.361151 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-19b95512-8a91-4b18-8514-204881fdb71c tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:22:50.369326 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-19b95512-8a91-4b18-8514-204881fdb71c tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f" status: 200 len: 1270 microversion: 2.1 time: 0.095239 Oct 27 04:22:50.369916 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3778/7266] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:22:50 2022] GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f => generated 1270 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:22:51.397451 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9915adc5-35e8-4e1f-a17e-0c4d55d3e1d0 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:22:51.398223 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9915adc5-35e8-4e1f-a17e-0c4d55d3e1d0 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: 6c6d7869-b37b-4108-ac89-2bca489f4a1f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:22:51.405587 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9915adc5-35e8-4e1f-a17e-0c4d55d3e1d0 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:51.406176 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9915adc5-35e8-4e1f-a17e-0c4d55d3e1d0 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:51.406627 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9915adc5-35e8-4e1f-a17e-0c4d55d3e1d0 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:51.407349 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9915adc5-35e8-4e1f-a17e-0c4d55d3e1d0 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:51.407812 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9915adc5-35e8-4e1f-a17e-0c4d55d3e1d0 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:51.408242 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9915adc5-35e8-4e1f-a17e-0c4d55d3e1d0 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:51.644993 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9915adc5-35e8-4e1f-a17e-0c4d55d3e1d0 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:22:51.654408 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9915adc5-35e8-4e1f-a17e-0c4d55d3e1d0 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f" status: 200 len: 1318 microversion: 2.1 time: 0.261224 Oct 27 04:22:51.655102 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3489/7267] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:22:51 2022] GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f => generated 1318 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:22:52.369388 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-c9df2597-3e12-4f63-92ff-f27bbc5946ab req-a4d87e22-34d8-42d6-aad3-058c11953c48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c6d7869-b37b-4108-ac89-2bca489f4a1f", "tag": "571286c8-fcb5-480c-b637-52edf5461988"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:22:52.380451 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-c9df2597-3e12-4f63-92ff-f27bbc5946ab req-a4d87e22-34d8-42d6-aad3-058c11953c48 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:52.380950 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-c9df2597-3e12-4f63-92ff-f27bbc5946ab req-a4d87e22-34d8-42d6-aad3-058c11953c48 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:52.381402 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-c9df2597-3e12-4f63-92ff-f27bbc5946ab req-a4d87e22-34d8-42d6-aad3-058c11953c48 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:52.393121 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-c9df2597-3e12-4f63-92ff-f27bbc5946ab req-a4d87e22-34d8-42d6-aad3-058c11953c48 service nova] Creating event network-changed:571286c8-fcb5-480c-b637-52edf5461988 for instance 6c6d7869-b37b-4108-ac89-2bca489f4a1f on n-h2-862769-1 Oct 27 04:22:52.398400 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-c9df2597-3e12-4f63-92ff-f27bbc5946ab req-a4d87e22-34d8-42d6-aad3-058c11953c48 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032930 Oct 27 04:22:52.399032 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3779/7268] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:22:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:22:52.683172 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d36541c3-3177-4a9b-8a71-ba5e57466a81 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:22:52.683831 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d36541c3-3177-4a9b-8a71-ba5e57466a81 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: 6c6d7869-b37b-4108-ac89-2bca489f4a1f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:22:52.691289 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d36541c3-3177-4a9b-8a71-ba5e57466a81 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:52.691785 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d36541c3-3177-4a9b-8a71-ba5e57466a81 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:52.692230 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d36541c3-3177-4a9b-8a71-ba5e57466a81 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:52.695011 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d36541c3-3177-4a9b-8a71-ba5e57466a81 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:52.695486 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d36541c3-3177-4a9b-8a71-ba5e57466a81 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:52.697091 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d36541c3-3177-4a9b-8a71-ba5e57466a81 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:52.931598 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d36541c3-3177-4a9b-8a71-ba5e57466a81 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:22:52.939502 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d36541c3-3177-4a9b-8a71-ba5e57466a81 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f" status: 200 len: 1318 microversion: 2.1 time: 0.262543 Oct 27 04:22:52.940180 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3490/7269] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:22:52 2022] GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f => generated 1318 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:22:53.964343 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-952aeae3-af92-42b5-a460-6365c83841e9 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:22:53.965064 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-952aeae3-af92-42b5-a460-6365c83841e9 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: 6c6d7869-b37b-4108-ac89-2bca489f4a1f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:22:53.971245 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-952aeae3-af92-42b5-a460-6365c83841e9 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:53.971742 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-952aeae3-af92-42b5-a460-6365c83841e9 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:53.972196 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-952aeae3-af92-42b5-a460-6365c83841e9 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:53.972901 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-952aeae3-af92-42b5-a460-6365c83841e9 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:53.973371 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-952aeae3-af92-42b5-a460-6365c83841e9 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:53.973816 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-952aeae3-af92-42b5-a460-6365c83841e9 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:54.104700 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-952aeae3-af92-42b5-a460-6365c83841e9 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:22:54.112494 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-952aeae3-af92-42b5-a460-6365c83841e9 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f" status: 200 len: 1318 microversion: 2.1 time: 0.153615 Oct 27 04:22:54.113071 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3780/7270] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:22:53 2022] GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:22:55.135769 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9a4be070-8f2b-4699-a3ed-ba9dd2a4a29a tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:22:55.136395 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9a4be070-8f2b-4699-a3ed-ba9dd2a4a29a tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: 6c6d7869-b37b-4108-ac89-2bca489f4a1f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:22:55.143405 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9a4be070-8f2b-4699-a3ed-ba9dd2a4a29a tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:55.144075 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9a4be070-8f2b-4699-a3ed-ba9dd2a4a29a tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:55.144529 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9a4be070-8f2b-4699-a3ed-ba9dd2a4a29a tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:55.145261 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9a4be070-8f2b-4699-a3ed-ba9dd2a4a29a tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:55.145725 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9a4be070-8f2b-4699-a3ed-ba9dd2a4a29a tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:55.146191 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9a4be070-8f2b-4699-a3ed-ba9dd2a4a29a tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:55.284543 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9a4be070-8f2b-4699-a3ed-ba9dd2a4a29a tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:22:55.292235 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9a4be070-8f2b-4699-a3ed-ba9dd2a4a29a tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f" status: 200 len: 1318 microversion: 2.1 time: 0.160865 Oct 27 04:22:55.292818 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3491/7271] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:22:55 2022] GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:22:56.316399 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-372ead65-3d91-4d86-bb12-b672b00b9efe tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:22:56.317078 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-372ead65-3d91-4d86-bb12-b672b00b9efe tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: 6c6d7869-b37b-4108-ac89-2bca489f4a1f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:22:56.324682 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-372ead65-3d91-4d86-bb12-b672b00b9efe tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:56.325190 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-372ead65-3d91-4d86-bb12-b672b00b9efe tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:56.325653 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-372ead65-3d91-4d86-bb12-b672b00b9efe tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:56.326408 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-372ead65-3d91-4d86-bb12-b672b00b9efe tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:56.326885 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-372ead65-3d91-4d86-bb12-b672b00b9efe tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:56.327336 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-372ead65-3d91-4d86-bb12-b672b00b9efe tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:56.454682 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-372ead65-3d91-4d86-bb12-b672b00b9efe tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:22:56.462355 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-372ead65-3d91-4d86-bb12-b672b00b9efe tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f" status: 200 len: 1318 microversion: 2.1 time: 0.149894 Oct 27 04:22:56.462924 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3781/7272] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:22:56 2022] GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:22:57.016204 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-32e91173-1bb3-4b4d-a657-8cc0e316a8f4 req-96f139d0-3b8c-4b61-be02-2dd9dfe2a52f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c6d7869-b37b-4108-ac89-2bca489f4a1f", "name": "network-vif-plugged", "status": "completed", "tag": "571286c8-fcb5-480c-b637-52edf5461988"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:22:57.026933 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-32e91173-1bb3-4b4d-a657-8cc0e316a8f4 req-96f139d0-3b8c-4b61-be02-2dd9dfe2a52f service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:57.027416 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-32e91173-1bb3-4b4d-a657-8cc0e316a8f4 req-96f139d0-3b8c-4b61-be02-2dd9dfe2a52f service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:57.027850 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-32e91173-1bb3-4b4d-a657-8cc0e316a8f4 req-96f139d0-3b8c-4b61-be02-2dd9dfe2a52f service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:57.042309 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-32e91173-1bb3-4b4d-a657-8cc0e316a8f4 req-96f139d0-3b8c-4b61-be02-2dd9dfe2a52f service nova] Creating event network-vif-plugged:571286c8-fcb5-480c-b637-52edf5461988 for instance 6c6d7869-b37b-4108-ac89-2bca489f4a1f on n-h2-862769-1 Oct 27 04:22:57.047512 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-32e91173-1bb3-4b4d-a657-8cc0e316a8f4 req-96f139d0-3b8c-4b61-be02-2dd9dfe2a52f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035116 Oct 27 04:22:57.048205 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3492/7273] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:22:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:22:57.485380 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0181f0b5-749e-476e-b45a-47f191320183 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:22:57.486018 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0181f0b5-749e-476e-b45a-47f191320183 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: 6c6d7869-b37b-4108-ac89-2bca489f4a1f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:22:57.492865 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0181f0b5-749e-476e-b45a-47f191320183 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:57.493366 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0181f0b5-749e-476e-b45a-47f191320183 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:57.493823 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0181f0b5-749e-476e-b45a-47f191320183 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:57.494566 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0181f0b5-749e-476e-b45a-47f191320183 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:57.495046 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0181f0b5-749e-476e-b45a-47f191320183 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:57.495494 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0181f0b5-749e-476e-b45a-47f191320183 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:57.628132 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0181f0b5-749e-476e-b45a-47f191320183 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:22:57.636452 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0181f0b5-749e-476e-b45a-47f191320183 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f" status: 200 len: 1318 microversion: 2.1 time: 0.154307 Oct 27 04:22:57.637018 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3782/7274] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:22:57 2022] GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:22:58.657814 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:22:58.658681 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=6 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:22:58.663753 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5f84fd5e-dfb2-405c-a2ed-52e642c4e6d5 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:22:58.664463 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5f84fd5e-dfb2-405c-a2ed-52e642c4e6d5 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: 6c6d7869-b37b-4108-ac89-2bca489f4a1f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:22:58.671133 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5f84fd5e-dfb2-405c-a2ed-52e642c4e6d5 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:58.671623 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5f84fd5e-dfb2-405c-a2ed-52e642c4e6d5 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:58.672069 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5f84fd5e-dfb2-405c-a2ed-52e642c4e6d5 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:58.672815 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5f84fd5e-dfb2-405c-a2ed-52e642c4e6d5 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:58.673284 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5f84fd5e-dfb2-405c-a2ed-52e642c4e6d5 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:58.673715 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5f84fd5e-dfb2-405c-a2ed-52e642c4e6d5 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:58.803864 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5f84fd5e-dfb2-405c-a2ed-52e642c4e6d5 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:22:58.811816 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5f84fd5e-dfb2-405c-a2ed-52e642c4e6d5 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f" status: 200 len: 1507 microversion: 2.1 time: 0.154978 Oct 27 04:22:58.812628 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3493/7275] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:22:58 2022] GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f => generated 1507 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:22:58.835467 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9ff9e138-e6b7-4af1-8472-13adb06b873c tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:22:58.836113 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-9ff9e138-e6b7-4af1-8472-13adb06b873c tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: 6c6d7869-b37b-4108-ac89-2bca489f4a1f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:22:58.838348 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:22:58.844256 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9ff9e138-e6b7-4af1-8472-13adb06b873c tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:58.844767 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9ff9e138-e6b7-4af1-8472-13adb06b873c tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:58.845230 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9ff9e138-e6b7-4af1-8472-13adb06b873c tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:58.845998 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9ff9e138-e6b7-4af1-8472-13adb06b873c tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:58.846506 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9ff9e138-e6b7-4af1-8472-13adb06b873c tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:58.846956 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9ff9e138-e6b7-4af1-8472-13adb06b873c tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:58.974408 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9ff9e138-e6b7-4af1-8472-13adb06b873c tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:22:58.982286 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9ff9e138-e6b7-4af1-8472-13adb06b873c tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f" status: 200 len: 1507 microversion: 2.1 time: 0.150758 Oct 27 04:22:58.982857 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3783/7276] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:22:58 2022] GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f => generated 1507 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:22:59.004031 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f695fd55-4009-49de-b024-66908563ae34 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:22:59.006489 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f695fd55-4009-49de-b024-66908563ae34 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: 6c6d7869-b37b-4108-ac89-2bca489f4a1f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:22:59.013212 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f695fd55-4009-49de-b024-66908563ae34 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:59.013694 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f695fd55-4009-49de-b024-66908563ae34 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:59.014175 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f695fd55-4009-49de-b024-66908563ae34 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:59.014870 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f695fd55-4009-49de-b024-66908563ae34 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:59.015329 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f695fd55-4009-49de-b024-66908563ae34 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:59.015759 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f695fd55-4009-49de-b024-66908563ae34 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:59.138623 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f695fd55-4009-49de-b024-66908563ae34 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "PUT /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f" status: 200 len: 1079 microversion: 2.1 time: 0.138455 Oct 27 04:22:59.139455 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3494/7277] 10.222.0.20 () {60 vars in 1256 bytes} [Thu Oct 27 04:22:58 2022] PUT /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f => generated 1079 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:22:59.157722 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-32b5339f-2cc4-48b5-88c9-613d508e472d tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:22:59.158410 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-32b5339f-2cc4-48b5-88c9-613d508e472d tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: 6c6d7869-b37b-4108-ac89-2bca489f4a1f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:22:59.164572 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-32b5339f-2cc4-48b5-88c9-613d508e472d tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:59.165075 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-32b5339f-2cc4-48b5-88c9-613d508e472d tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:59.165599 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-32b5339f-2cc4-48b5-88c9-613d508e472d tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:59.166338 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-32b5339f-2cc4-48b5-88c9-613d508e472d tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:59.166815 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-32b5339f-2cc4-48b5-88c9-613d508e472d tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:59.167265 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-32b5339f-2cc4-48b5-88c9-613d508e472d tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:59.302533 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-32b5339f-2cc4-48b5-88c9-613d508e472d tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:22:59.311000 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-32b5339f-2cc4-48b5-88c9-613d508e472d tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f" status: 200 len: 1505 microversion: 2.1 time: 0.157170 Oct 27 04:22:59.311524 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3784/7278] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:22:59 2022] GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f => generated 1505 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:22:59.333347 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8dc652ef-9f95-4398-953a-cfca550fc58f tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:22:59.334007 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8dc652ef-9f95-4398-953a-cfca550fc58f tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: 6c6d7869-b37b-4108-ac89-2bca489f4a1f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:22:59.340284 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8dc652ef-9f95-4398-953a-cfca550fc58f tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:59.340790 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8dc652ef-9f95-4398-953a-cfca550fc58f tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:59.341240 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8dc652ef-9f95-4398-953a-cfca550fc58f tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:59.341952 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8dc652ef-9f95-4398-953a-cfca550fc58f tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:59.342444 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8dc652ef-9f95-4398-953a-cfca550fc58f tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:59.342885 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8dc652ef-9f95-4398-953a-cfca550fc58f tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:59.475067 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8dc652ef-9f95-4398-953a-cfca550fc58f tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:22:59.483614 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8dc652ef-9f95-4398-953a-cfca550fc58f tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f" status: 200 len: 1505 microversion: 2.1 time: 0.154237 Oct 27 04:22:59.484193 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3495/7279] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:22:59 2022] GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:22:59.506210 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b30a5e9e-5989-4cc2-ab42-154bfa7163e7 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:22:59.508879 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b30a5e9e-5989-4cc2-ab42-154bfa7163e7 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: 6c6d7869-b37b-4108-ac89-2bca489f4a1f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:22:59.514829 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b30a5e9e-5989-4cc2-ab42-154bfa7163e7 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:59.515332 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b30a5e9e-5989-4cc2-ab42-154bfa7163e7 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:59.515787 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b30a5e9e-5989-4cc2-ab42-154bfa7163e7 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:59.516493 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b30a5e9e-5989-4cc2-ab42-154bfa7163e7 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:59.516962 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b30a5e9e-5989-4cc2-ab42-154bfa7163e7 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:59.517779 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b30a5e9e-5989-4cc2-ab42-154bfa7163e7 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:59.546123 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b30a5e9e-5989-4cc2-ab42-154bfa7163e7 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:22:59.551488 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b30a5e9e-5989-4cc2-ab42-154bfa7163e7 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: 6c6d7869-b37b-4108-ac89-2bca489f4a1f] Old instance type m1.heat2, new instance type m1.heat {{(pid=121001) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 27 04:22:59.558466 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-b30a5e9e-5989-4cc2-ab42-154bfa7163e7 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Flavor limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 04:22:59.558904 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-b30a5e9e-5989-4cc2-ab42-154bfa7163e7 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Image limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 04:22:59.559395 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-b30a5e9e-5989-4cc2-ab42-154bfa7163e7 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Flavor pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 04:22:59.559820 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-b30a5e9e-5989-4cc2-ab42-154bfa7163e7 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Image pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 04:22:59.560246 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-b30a5e9e-5989-4cc2-ab42-154bfa7163e7 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 04:22:59.760563 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b30a5e9e-5989-4cc2-ab42-154bfa7163e7 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "POST /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f/action" status: 202 len: 0 microversion: 2.1 time: 0.258191 Oct 27 04:22:59.764176 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3785/7280] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 04:22:59 2022] POST /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f/action => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 04:22:59.769776 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d41f7899-be52-4094-b9eb-8aaccda65234 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:22:59.770975 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d41f7899-be52-4094-b9eb-8aaccda65234 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: 6c6d7869-b37b-4108-ac89-2bca489f4a1f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:22:59.777691 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d41f7899-be52-4094-b9eb-8aaccda65234 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:59.778227 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d41f7899-be52-4094-b9eb-8aaccda65234 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:59.778671 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d41f7899-be52-4094-b9eb-8aaccda65234 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:59.779375 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d41f7899-be52-4094-b9eb-8aaccda65234 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:22:59.779834 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d41f7899-be52-4094-b9eb-8aaccda65234 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:22:59.780305 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d41f7899-be52-4094-b9eb-8aaccda65234 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:22:59.911326 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d41f7899-be52-4094-b9eb-8aaccda65234 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:22:59.919634 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d41f7899-be52-4094-b9eb-8aaccda65234 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f" status: 200 len: 1516 microversion: 2.1 time: 0.153973 Oct 27 04:22:59.920209 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3496/7281] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:22:59 2022] GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:23:00.943021 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4209501c-2951-4a54-abbb-41305a639bf5 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:23:00.943686 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4209501c-2951-4a54-abbb-41305a639bf5 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: 6c6d7869-b37b-4108-ac89-2bca489f4a1f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:23:00.951032 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4209501c-2951-4a54-abbb-41305a639bf5 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:00.951544 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4209501c-2951-4a54-abbb-41305a639bf5 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:00.951999 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4209501c-2951-4a54-abbb-41305a639bf5 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:00.959801 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4209501c-2951-4a54-abbb-41305a639bf5 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:00.959801 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4209501c-2951-4a54-abbb-41305a639bf5 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:00.959801 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4209501c-2951-4a54-abbb-41305a639bf5 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:01.085333 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4209501c-2951-4a54-abbb-41305a639bf5 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:23:01.093584 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4209501c-2951-4a54-abbb-41305a639bf5 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f" status: 200 len: 1516 microversion: 2.1 time: 0.155445 Oct 27 04:23:01.094191 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3786/7282] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:23:00 2022] GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:23:02.117506 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e69cedbb-4a3a-4f6a-8131-02ac795b9ce7 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:23:02.118162 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e69cedbb-4a3a-4f6a-8131-02ac795b9ce7 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: 6c6d7869-b37b-4108-ac89-2bca489f4a1f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:23:02.125592 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e69cedbb-4a3a-4f6a-8131-02ac795b9ce7 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:02.126121 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e69cedbb-4a3a-4f6a-8131-02ac795b9ce7 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:02.126572 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e69cedbb-4a3a-4f6a-8131-02ac795b9ce7 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:02.127286 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e69cedbb-4a3a-4f6a-8131-02ac795b9ce7 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:02.127752 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e69cedbb-4a3a-4f6a-8131-02ac795b9ce7 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:02.128187 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e69cedbb-4a3a-4f6a-8131-02ac795b9ce7 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:02.344877 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e69cedbb-4a3a-4f6a-8131-02ac795b9ce7 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:23:02.352806 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e69cedbb-4a3a-4f6a-8131-02ac795b9ce7 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f" status: 200 len: 1516 microversion: 2.1 time: 0.239878 Oct 27 04:23:02.353392 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3497/7283] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:23:02 2022] GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f => generated 1516 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:23:03.375870 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2fbab834-b292-47ac-a245-09308f886a16 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:23:03.376516 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2fbab834-b292-47ac-a245-09308f886a16 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: 6c6d7869-b37b-4108-ac89-2bca489f4a1f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:23:03.383451 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2fbab834-b292-47ac-a245-09308f886a16 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:03.383961 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2fbab834-b292-47ac-a245-09308f886a16 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:03.384425 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2fbab834-b292-47ac-a245-09308f886a16 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:03.385145 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2fbab834-b292-47ac-a245-09308f886a16 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:03.385625 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2fbab834-b292-47ac-a245-09308f886a16 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:03.386107 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2fbab834-b292-47ac-a245-09308f886a16 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:03.519148 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2fbab834-b292-47ac-a245-09308f886a16 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:23:03.526856 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2fbab834-b292-47ac-a245-09308f886a16 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f" status: 200 len: 1521 microversion: 2.1 time: 0.154926 Oct 27 04:23:03.527438 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3787/7284] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:23:03 2022] GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:23:04.550645 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f36abdae-692d-4948-94af-deb985026258 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:23:04.551261 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f36abdae-692d-4948-94af-deb985026258 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: 6c6d7869-b37b-4108-ac89-2bca489f4a1f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:23:04.558116 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f36abdae-692d-4948-94af-deb985026258 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:04.558599 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f36abdae-692d-4948-94af-deb985026258 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:04.559040 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f36abdae-692d-4948-94af-deb985026258 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:04.559797 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f36abdae-692d-4948-94af-deb985026258 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:04.560256 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f36abdae-692d-4948-94af-deb985026258 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:04.560685 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f36abdae-692d-4948-94af-deb985026258 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:04.690822 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f36abdae-692d-4948-94af-deb985026258 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:23:04.698419 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f36abdae-692d-4948-94af-deb985026258 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f" status: 200 len: 1521 microversion: 2.1 time: 0.151727 Oct 27 04:23:04.699018 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3498/7285] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:23:04 2022] GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:23:05.723060 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4372729d-e295-4e31-bd86-0880de0ac7fa tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:23:05.723696 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4372729d-e295-4e31-bd86-0880de0ac7fa tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: 6c6d7869-b37b-4108-ac89-2bca489f4a1f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:23:05.730628 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4372729d-e295-4e31-bd86-0880de0ac7fa tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:05.731138 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4372729d-e295-4e31-bd86-0880de0ac7fa tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:05.732108 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4372729d-e295-4e31-bd86-0880de0ac7fa tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:05.732821 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4372729d-e295-4e31-bd86-0880de0ac7fa tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:05.733298 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4372729d-e295-4e31-bd86-0880de0ac7fa tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:05.733743 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4372729d-e295-4e31-bd86-0880de0ac7fa tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:05.860655 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4372729d-e295-4e31-bd86-0880de0ac7fa tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:23:05.868392 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4372729d-e295-4e31-bd86-0880de0ac7fa tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f" status: 200 len: 1521 microversion: 2.1 time: 0.149303 Oct 27 04:23:05.868971 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3788/7286] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:23:05 2022] GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:23:06.891981 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8d45a3e7-ce6a-43cf-9800-1ce85db28bb9 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:23:06.892508 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8d45a3e7-ce6a-43cf-9800-1ce85db28bb9 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: 6c6d7869-b37b-4108-ac89-2bca489f4a1f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:23:06.899356 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8d45a3e7-ce6a-43cf-9800-1ce85db28bb9 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:06.899849 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8d45a3e7-ce6a-43cf-9800-1ce85db28bb9 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:06.900289 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8d45a3e7-ce6a-43cf-9800-1ce85db28bb9 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:06.900988 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8d45a3e7-ce6a-43cf-9800-1ce85db28bb9 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:06.901448 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8d45a3e7-ce6a-43cf-9800-1ce85db28bb9 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:06.901879 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8d45a3e7-ce6a-43cf-9800-1ce85db28bb9 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:07.034796 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8d45a3e7-ce6a-43cf-9800-1ce85db28bb9 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:23:07.042533 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8d45a3e7-ce6a-43cf-9800-1ce85db28bb9 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f" status: 200 len: 1521 microversion: 2.1 time: 0.155184 Oct 27 04:23:07.044609 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3499/7287] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:23:06 2022] GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:23:08.066246 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-49b2984e-60fe-49c2-9616-281ca920d534 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:23:08.066889 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-49b2984e-60fe-49c2-9616-281ca920d534 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: 6c6d7869-b37b-4108-ac89-2bca489f4a1f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:23:08.073834 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-49b2984e-60fe-49c2-9616-281ca920d534 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:08.074370 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-49b2984e-60fe-49c2-9616-281ca920d534 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:08.074836 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-49b2984e-60fe-49c2-9616-281ca920d534 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:08.076192 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-49b2984e-60fe-49c2-9616-281ca920d534 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:08.076673 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-49b2984e-60fe-49c2-9616-281ca920d534 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:08.077122 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-49b2984e-60fe-49c2-9616-281ca920d534 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:08.209441 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-49b2984e-60fe-49c2-9616-281ca920d534 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:23:08.217622 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-49b2984e-60fe-49c2-9616-281ca920d534 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f" status: 200 len: 1521 microversion: 2.1 time: 0.155488 Oct 27 04:23:08.218226 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3789/7288] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:23:08 2022] GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:23:09.240324 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-263c5d95-6e23-402d-8c0b-c8d18a2ee908 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:23:09.240942 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-263c5d95-6e23-402d-8c0b-c8d18a2ee908 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: 6c6d7869-b37b-4108-ac89-2bca489f4a1f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:23:09.247812 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-263c5d95-6e23-402d-8c0b-c8d18a2ee908 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:09.248299 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-263c5d95-6e23-402d-8c0b-c8d18a2ee908 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:09.248742 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-263c5d95-6e23-402d-8c0b-c8d18a2ee908 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:09.249433 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-263c5d95-6e23-402d-8c0b-c8d18a2ee908 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:09.249888 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-263c5d95-6e23-402d-8c0b-c8d18a2ee908 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:09.250352 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-263c5d95-6e23-402d-8c0b-c8d18a2ee908 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:09.378509 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-263c5d95-6e23-402d-8c0b-c8d18a2ee908 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:23:09.386214 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-263c5d95-6e23-402d-8c0b-c8d18a2ee908 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f" status: 200 len: 1521 microversion: 2.1 time: 0.149824 Oct 27 04:23:09.386785 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3500/7289] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:23:09 2022] GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:23:10.409064 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f5e8bc30-5a19-4547-b236-fa479c0efd68 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:23:10.409699 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f5e8bc30-5a19-4547-b236-fa479c0efd68 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: 6c6d7869-b37b-4108-ac89-2bca489f4a1f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:23:10.416679 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f5e8bc30-5a19-4547-b236-fa479c0efd68 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:10.417260 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f5e8bc30-5a19-4547-b236-fa479c0efd68 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:10.417686 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f5e8bc30-5a19-4547-b236-fa479c0efd68 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:10.418492 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f5e8bc30-5a19-4547-b236-fa479c0efd68 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:10.419011 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f5e8bc30-5a19-4547-b236-fa479c0efd68 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:10.419461 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f5e8bc30-5a19-4547-b236-fa479c0efd68 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:10.555188 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f5e8bc30-5a19-4547-b236-fa479c0efd68 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:23:10.563515 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f5e8bc30-5a19-4547-b236-fa479c0efd68 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f" status: 200 len: 1521 microversion: 2.1 time: 0.158632 Oct 27 04:23:10.564095 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3790/7290] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:23:10 2022] GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:23:11.587519 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4adca4f2-c26a-4a4e-8c9c-308c26e3b637 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:23:11.588134 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4adca4f2-c26a-4a4e-8c9c-308c26e3b637 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: 6c6d7869-b37b-4108-ac89-2bca489f4a1f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:23:11.595269 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4adca4f2-c26a-4a4e-8c9c-308c26e3b637 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:11.598466 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4adca4f2-c26a-4a4e-8c9c-308c26e3b637 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:11.598466 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4adca4f2-c26a-4a4e-8c9c-308c26e3b637 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:11.598466 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4adca4f2-c26a-4a4e-8c9c-308c26e3b637 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:11.598466 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4adca4f2-c26a-4a4e-8c9c-308c26e3b637 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:11.598466 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4adca4f2-c26a-4a4e-8c9c-308c26e3b637 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:11.725817 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4adca4f2-c26a-4a4e-8c9c-308c26e3b637 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:23:11.733953 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4adca4f2-c26a-4a4e-8c9c-308c26e3b637 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f" status: 200 len: 1521 microversion: 2.1 time: 0.150345 Oct 27 04:23:11.734556 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3501/7291] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:23:11 2022] GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:23:12.757780 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-931cbbd8-52ce-48f5-9c7f-00ec7db93a2b tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:23:12.758474 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-931cbbd8-52ce-48f5-9c7f-00ec7db93a2b tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: 6c6d7869-b37b-4108-ac89-2bca489f4a1f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:23:12.765528 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-931cbbd8-52ce-48f5-9c7f-00ec7db93a2b tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:12.766884 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-931cbbd8-52ce-48f5-9c7f-00ec7db93a2b tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:12.766884 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-931cbbd8-52ce-48f5-9c7f-00ec7db93a2b tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:12.767220 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-931cbbd8-52ce-48f5-9c7f-00ec7db93a2b tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:12.767697 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-931cbbd8-52ce-48f5-9c7f-00ec7db93a2b tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:12.768154 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-931cbbd8-52ce-48f5-9c7f-00ec7db93a2b tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:12.898091 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-931cbbd8-52ce-48f5-9c7f-00ec7db93a2b tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:23:12.905873 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-931cbbd8-52ce-48f5-9c7f-00ec7db93a2b tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f" status: 200 len: 1521 microversion: 2.1 time: 0.151969 Oct 27 04:23:12.906485 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3791/7292] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:23:12 2022] GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:23:13.929462 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-16de7ce4-1f7d-4c2b-988c-98190fa9e1b4 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:23:13.930123 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-16de7ce4-1f7d-4c2b-988c-98190fa9e1b4 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: 6c6d7869-b37b-4108-ac89-2bca489f4a1f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:23:13.937058 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-16de7ce4-1f7d-4c2b-988c-98190fa9e1b4 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:13.937553 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-16de7ce4-1f7d-4c2b-988c-98190fa9e1b4 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:13.938008 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-16de7ce4-1f7d-4c2b-988c-98190fa9e1b4 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:13.938805 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-16de7ce4-1f7d-4c2b-988c-98190fa9e1b4 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:13.939276 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-16de7ce4-1f7d-4c2b-988c-98190fa9e1b4 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:13.939715 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-16de7ce4-1f7d-4c2b-988c-98190fa9e1b4 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:14.071445 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-16de7ce4-1f7d-4c2b-988c-98190fa9e1b4 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:23:14.079814 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-16de7ce4-1f7d-4c2b-988c-98190fa9e1b4 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f" status: 200 len: 1521 microversion: 2.1 time: 0.154276 Oct 27 04:23:14.080390 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3502/7293] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:23:13 2022] GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:23:15.103016 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1752c6b8-660a-4cd0-b5d6-b7608569b2a5 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:23:15.103574 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1752c6b8-660a-4cd0-b5d6-b7608569b2a5 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: 6c6d7869-b37b-4108-ac89-2bca489f4a1f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:23:15.111144 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1752c6b8-660a-4cd0-b5d6-b7608569b2a5 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:15.111648 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1752c6b8-660a-4cd0-b5d6-b7608569b2a5 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:15.112120 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1752c6b8-660a-4cd0-b5d6-b7608569b2a5 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:15.112823 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1752c6b8-660a-4cd0-b5d6-b7608569b2a5 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:15.113291 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1752c6b8-660a-4cd0-b5d6-b7608569b2a5 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:15.113739 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1752c6b8-660a-4cd0-b5d6-b7608569b2a5 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:15.248365 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1752c6b8-660a-4cd0-b5d6-b7608569b2a5 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:23:15.256301 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1752c6b8-660a-4cd0-b5d6-b7608569b2a5 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f" status: 200 len: 1521 microversion: 2.1 time: 0.157310 Oct 27 04:23:15.256883 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3792/7294] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:23:15 2022] GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:23:16.280361 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6d6ef5a8-3fc3-4437-9a06-aec2609d702a tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:23:16.281023 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6d6ef5a8-3fc3-4437-9a06-aec2609d702a tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: 6c6d7869-b37b-4108-ac89-2bca489f4a1f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:23:16.287900 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6d6ef5a8-3fc3-4437-9a06-aec2609d702a tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:16.288399 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6d6ef5a8-3fc3-4437-9a06-aec2609d702a tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:16.288850 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6d6ef5a8-3fc3-4437-9a06-aec2609d702a tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:16.289563 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6d6ef5a8-3fc3-4437-9a06-aec2609d702a tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:16.290028 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6d6ef5a8-3fc3-4437-9a06-aec2609d702a tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:16.290496 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6d6ef5a8-3fc3-4437-9a06-aec2609d702a tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:16.423080 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-6d6ef5a8-3fc3-4437-9a06-aec2609d702a tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:23:16.430716 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6d6ef5a8-3fc3-4437-9a06-aec2609d702a tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f" status: 200 len: 1521 microversion: 2.1 time: 0.154858 Oct 27 04:23:16.431299 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3503/7295] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:23:16 2022] GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:23:17.454301 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8ca28db7-e115-4f7d-a2c0-9e6d440425d1 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:23:17.454941 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8ca28db7-e115-4f7d-a2c0-9e6d440425d1 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: 6c6d7869-b37b-4108-ac89-2bca489f4a1f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:23:17.461879 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8ca28db7-e115-4f7d-a2c0-9e6d440425d1 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:17.462459 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8ca28db7-e115-4f7d-a2c0-9e6d440425d1 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:17.462921 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8ca28db7-e115-4f7d-a2c0-9e6d440425d1 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:17.463632 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8ca28db7-e115-4f7d-a2c0-9e6d440425d1 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:17.464394 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8ca28db7-e115-4f7d-a2c0-9e6d440425d1 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:17.464836 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8ca28db7-e115-4f7d-a2c0-9e6d440425d1 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:17.594956 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8ca28db7-e115-4f7d-a2c0-9e6d440425d1 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:23:17.598395 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:23:17.602893 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8ca28db7-e115-4f7d-a2c0-9e6d440425d1 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f" status: 200 len: 1521 microversion: 2.1 time: 0.152673 Oct 27 04:23:17.603466 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3793/7296] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:23:17 2022] GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:23:18.626631 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b3434841-90f9-4377-a7e8-cabd36bf8344 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:23:18.627254 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b3434841-90f9-4377-a7e8-cabd36bf8344 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: 6c6d7869-b37b-4108-ac89-2bca489f4a1f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:23:18.629903 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:23:18.634589 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b3434841-90f9-4377-a7e8-cabd36bf8344 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:18.635074 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b3434841-90f9-4377-a7e8-cabd36bf8344 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:18.635515 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b3434841-90f9-4377-a7e8-cabd36bf8344 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:18.636211 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b3434841-90f9-4377-a7e8-cabd36bf8344 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:18.636671 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b3434841-90f9-4377-a7e8-cabd36bf8344 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:18.637102 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b3434841-90f9-4377-a7e8-cabd36bf8344 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:18.639636 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:23:18.772868 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b3434841-90f9-4377-a7e8-cabd36bf8344 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:23:18.780924 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b3434841-90f9-4377-a7e8-cabd36bf8344 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f" status: 200 len: 1521 microversion: 2.1 time: 0.158288 Oct 27 04:23:18.781518 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3504/7297] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:23:18 2022] GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:23:19.805072 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-395f423b-4b62-4079-b1b5-3224a2adbffc tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:23:19.805704 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-395f423b-4b62-4079-b1b5-3224a2adbffc tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: 6c6d7869-b37b-4108-ac89-2bca489f4a1f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:23:19.813483 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-395f423b-4b62-4079-b1b5-3224a2adbffc tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:19.813978 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-395f423b-4b62-4079-b1b5-3224a2adbffc tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:19.814465 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-395f423b-4b62-4079-b1b5-3224a2adbffc tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:19.815168 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-395f423b-4b62-4079-b1b5-3224a2adbffc tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:19.815669 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-395f423b-4b62-4079-b1b5-3224a2adbffc tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:19.816112 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-395f423b-4b62-4079-b1b5-3224a2adbffc tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:19.950191 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-395f423b-4b62-4079-b1b5-3224a2adbffc tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:23:19.958025 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-395f423b-4b62-4079-b1b5-3224a2adbffc tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f" status: 200 len: 1521 microversion: 2.1 time: 0.157192 Oct 27 04:23:19.958597 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3794/7298] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:23:19 2022] GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:23:20.980812 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-97d66210-6162-4e61-afa9-3b7650f7d52e tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:23:20.981447 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-97d66210-6162-4e61-afa9-3b7650f7d52e tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: 6c6d7869-b37b-4108-ac89-2bca489f4a1f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:23:20.988431 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-97d66210-6162-4e61-afa9-3b7650f7d52e tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:20.988922 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-97d66210-6162-4e61-afa9-3b7650f7d52e tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:20.989367 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-97d66210-6162-4e61-afa9-3b7650f7d52e tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:20.990128 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-97d66210-6162-4e61-afa9-3b7650f7d52e tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:20.990593 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-97d66210-6162-4e61-afa9-3b7650f7d52e tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:20.991027 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-97d66210-6162-4e61-afa9-3b7650f7d52e tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:21.119173 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-97d66210-6162-4e61-afa9-3b7650f7d52e tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:23:21.127491 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-97d66210-6162-4e61-afa9-3b7650f7d52e tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f" status: 200 len: 1521 microversion: 2.1 time: 0.150668 Oct 27 04:23:21.128058 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3505/7299] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:23:20 2022] GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:23:22.151157 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-87d550e7-ee1a-40f4-bedb-3eb49eded52f tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:23:22.151805 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-87d550e7-ee1a-40f4-bedb-3eb49eded52f tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: 6c6d7869-b37b-4108-ac89-2bca489f4a1f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:23:22.159500 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-87d550e7-ee1a-40f4-bedb-3eb49eded52f tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:22.160007 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-87d550e7-ee1a-40f4-bedb-3eb49eded52f tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:22.160474 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-87d550e7-ee1a-40f4-bedb-3eb49eded52f tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:22.161219 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-87d550e7-ee1a-40f4-bedb-3eb49eded52f tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:22.161710 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-87d550e7-ee1a-40f4-bedb-3eb49eded52f tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:22.162196 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-87d550e7-ee1a-40f4-bedb-3eb49eded52f tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:22.288746 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-87d550e7-ee1a-40f4-bedb-3eb49eded52f tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:23:22.296508 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-87d550e7-ee1a-40f4-bedb-3eb49eded52f tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f" status: 200 len: 1521 microversion: 2.1 time: 0.149288 Oct 27 04:23:22.297095 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3795/7300] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:23:22 2022] GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:23:23.320064 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5837f5f8-9507-48c6-976d-82a1cc9a27c1 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:23:23.320697 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5837f5f8-9507-48c6-976d-82a1cc9a27c1 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: 6c6d7869-b37b-4108-ac89-2bca489f4a1f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:23:23.328148 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5837f5f8-9507-48c6-976d-82a1cc9a27c1 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:23.328647 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5837f5f8-9507-48c6-976d-82a1cc9a27c1 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:23.329129 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5837f5f8-9507-48c6-976d-82a1cc9a27c1 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:23.329836 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5837f5f8-9507-48c6-976d-82a1cc9a27c1 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:23.330339 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5837f5f8-9507-48c6-976d-82a1cc9a27c1 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:23.330782 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5837f5f8-9507-48c6-976d-82a1cc9a27c1 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:23.458226 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5837f5f8-9507-48c6-976d-82a1cc9a27c1 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:23:23.466257 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5837f5f8-9507-48c6-976d-82a1cc9a27c1 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f" status: 200 len: 1521 microversion: 2.1 time: 0.150113 Oct 27 04:23:23.466844 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3506/7301] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:23:23 2022] GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:23:24.489181 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-74ee05fe-8f61-409c-ac6f-77eefbdaa1b0 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:23:24.489840 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-74ee05fe-8f61-409c-ac6f-77eefbdaa1b0 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: 6c6d7869-b37b-4108-ac89-2bca489f4a1f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:23:24.492544 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=45 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:23:24.497860 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-74ee05fe-8f61-409c-ac6f-77eefbdaa1b0 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:24.498643 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-74ee05fe-8f61-409c-ac6f-77eefbdaa1b0 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:24.499103 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-74ee05fe-8f61-409c-ac6f-77eefbdaa1b0 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:24.499809 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-74ee05fe-8f61-409c-ac6f-77eefbdaa1b0 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:24.500280 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-74ee05fe-8f61-409c-ac6f-77eefbdaa1b0 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:24.500720 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-74ee05fe-8f61-409c-ac6f-77eefbdaa1b0 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:24.633330 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-74ee05fe-8f61-409c-ac6f-77eefbdaa1b0 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:23:24.641811 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-74ee05fe-8f61-409c-ac6f-77eefbdaa1b0 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f" status: 200 len: 1521 microversion: 2.1 time: 0.156156 Oct 27 04:23:24.642436 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3796/7302] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:23:24 2022] GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:23:25.665452 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5d564c51-c111-4f89-add0-cb3c014ee436 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:23:25.666106 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5d564c51-c111-4f89-add0-cb3c014ee436 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: 6c6d7869-b37b-4108-ac89-2bca489f4a1f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:23:25.673512 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5d564c51-c111-4f89-add0-cb3c014ee436 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:25.674004 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5d564c51-c111-4f89-add0-cb3c014ee436 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:25.674474 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5d564c51-c111-4f89-add0-cb3c014ee436 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:25.675166 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5d564c51-c111-4f89-add0-cb3c014ee436 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:25.675620 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5d564c51-c111-4f89-add0-cb3c014ee436 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:25.676049 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5d564c51-c111-4f89-add0-cb3c014ee436 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:25.806649 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5d564c51-c111-4f89-add0-cb3c014ee436 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:23:25.815172 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5d564c51-c111-4f89-add0-cb3c014ee436 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f" status: 200 len: 1521 microversion: 2.1 time: 0.153613 Oct 27 04:23:25.815755 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3507/7303] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:23:25 2022] GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:23:26.837822 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-32070ecf-4cdc-44d5-9122-f44c05e89454 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:23:26.838424 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-32070ecf-4cdc-44d5-9122-f44c05e89454 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: 6c6d7869-b37b-4108-ac89-2bca489f4a1f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:23:26.846148 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-32070ecf-4cdc-44d5-9122-f44c05e89454 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:26.846656 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-32070ecf-4cdc-44d5-9122-f44c05e89454 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:26.847122 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-32070ecf-4cdc-44d5-9122-f44c05e89454 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:26.847837 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-32070ecf-4cdc-44d5-9122-f44c05e89454 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:26.848311 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-32070ecf-4cdc-44d5-9122-f44c05e89454 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:26.848763 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-32070ecf-4cdc-44d5-9122-f44c05e89454 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:26.981952 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-32070ecf-4cdc-44d5-9122-f44c05e89454 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:23:26.989800 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-32070ecf-4cdc-44d5-9122-f44c05e89454 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f" status: 200 len: 1521 microversion: 2.1 time: 0.156013 Oct 27 04:23:26.992358 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3797/7304] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:23:26 2022] GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:23:28.011973 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d4891bd8-cdc6-428e-8865-194ea2e0a9e9 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:23:28.013147 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d4891bd8-cdc6-428e-8865-194ea2e0a9e9 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: 6c6d7869-b37b-4108-ac89-2bca489f4a1f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:23:28.019399 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d4891bd8-cdc6-428e-8865-194ea2e0a9e9 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:28.019888 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d4891bd8-cdc6-428e-8865-194ea2e0a9e9 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:28.020327 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d4891bd8-cdc6-428e-8865-194ea2e0a9e9 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:28.021049 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d4891bd8-cdc6-428e-8865-194ea2e0a9e9 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:28.021508 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d4891bd8-cdc6-428e-8865-194ea2e0a9e9 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:28.021935 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d4891bd8-cdc6-428e-8865-194ea2e0a9e9 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:28.149665 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d4891bd8-cdc6-428e-8865-194ea2e0a9e9 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:23:28.157909 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d4891bd8-cdc6-428e-8865-194ea2e0a9e9 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f" status: 200 len: 1521 microversion: 2.1 time: 0.149866 Oct 27 04:23:28.158482 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3508/7305] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:23:28 2022] GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:23:29.181618 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-20f781d4-f392-4f6c-b941-bcc519ddc617 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:23:29.182299 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-20f781d4-f392-4f6c-b941-bcc519ddc617 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: 6c6d7869-b37b-4108-ac89-2bca489f4a1f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:23:29.189251 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-20f781d4-f392-4f6c-b941-bcc519ddc617 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:29.189765 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-20f781d4-f392-4f6c-b941-bcc519ddc617 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:29.190337 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-20f781d4-f392-4f6c-b941-bcc519ddc617 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:29.191125 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-20f781d4-f392-4f6c-b941-bcc519ddc617 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:29.191615 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-20f781d4-f392-4f6c-b941-bcc519ddc617 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:29.192075 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-20f781d4-f392-4f6c-b941-bcc519ddc617 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:29.319069 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-20f781d4-f392-4f6c-b941-bcc519ddc617 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:23:29.327343 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-20f781d4-f392-4f6c-b941-bcc519ddc617 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f" status: 200 len: 1521 microversion: 2.1 time: 0.149887 Oct 27 04:23:29.327912 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3798/7306] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:23:29 2022] GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:23:30.351308 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0e195a67-fde6-4f0e-a364-57c7a3e2b178 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:23:30.351976 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0e195a67-fde6-4f0e-a364-57c7a3e2b178 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: 6c6d7869-b37b-4108-ac89-2bca489f4a1f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:23:30.359453 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0e195a67-fde6-4f0e-a364-57c7a3e2b178 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:30.359952 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0e195a67-fde6-4f0e-a364-57c7a3e2b178 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:30.360406 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0e195a67-fde6-4f0e-a364-57c7a3e2b178 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:30.361115 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0e195a67-fde6-4f0e-a364-57c7a3e2b178 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:30.361575 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0e195a67-fde6-4f0e-a364-57c7a3e2b178 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:30.362008 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0e195a67-fde6-4f0e-a364-57c7a3e2b178 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:30.498946 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0e195a67-fde6-4f0e-a364-57c7a3e2b178 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:23:30.506835 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0e195a67-fde6-4f0e-a364-57c7a3e2b178 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f" status: 200 len: 1521 microversion: 2.1 time: 0.159771 Oct 27 04:23:30.507421 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3509/7307] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:23:30 2022] GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:23:31.529461 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e518bab2-afdc-405f-9335-96bcf9503316 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:23:31.530123 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e518bab2-afdc-405f-9335-96bcf9503316 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: 6c6d7869-b37b-4108-ac89-2bca489f4a1f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:23:31.537017 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e518bab2-afdc-405f-9335-96bcf9503316 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:31.537525 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e518bab2-afdc-405f-9335-96bcf9503316 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:31.537984 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e518bab2-afdc-405f-9335-96bcf9503316 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:31.538756 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e518bab2-afdc-405f-9335-96bcf9503316 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:31.539233 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e518bab2-afdc-405f-9335-96bcf9503316 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:31.539682 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e518bab2-afdc-405f-9335-96bcf9503316 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:31.670437 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e518bab2-afdc-405f-9335-96bcf9503316 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:23:31.678172 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e518bab2-afdc-405f-9335-96bcf9503316 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f" status: 200 len: 1521 microversion: 2.1 time: 0.152585 Oct 27 04:23:31.678751 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3799/7308] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:23:31 2022] GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:23:32.702499 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3f1be698-c383-461d-8c6d-142310a2a1a8 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:23:32.703157 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-3f1be698-c383-461d-8c6d-142310a2a1a8 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: 6c6d7869-b37b-4108-ac89-2bca489f4a1f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:23:32.709979 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3f1be698-c383-461d-8c6d-142310a2a1a8 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:32.710510 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3f1be698-c383-461d-8c6d-142310a2a1a8 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:32.710955 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3f1be698-c383-461d-8c6d-142310a2a1a8 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:32.711660 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3f1be698-c383-461d-8c6d-142310a2a1a8 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:32.712122 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3f1be698-c383-461d-8c6d-142310a2a1a8 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:32.712560 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3f1be698-c383-461d-8c6d-142310a2a1a8 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:32.840975 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-3f1be698-c383-461d-8c6d-142310a2a1a8 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:23:32.848609 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3f1be698-c383-461d-8c6d-142310a2a1a8 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f" status: 200 len: 1521 microversion: 2.1 time: 0.150710 Oct 27 04:23:32.849187 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3510/7309] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:23:32 2022] GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:23:33.871756 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d6f0b255-5918-4cb3-8137-8fd9b6048280 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:23:33.872444 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d6f0b255-5918-4cb3-8137-8fd9b6048280 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: 6c6d7869-b37b-4108-ac89-2bca489f4a1f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:23:33.879801 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d6f0b255-5918-4cb3-8137-8fd9b6048280 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:33.880305 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d6f0b255-5918-4cb3-8137-8fd9b6048280 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:33.880800 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d6f0b255-5918-4cb3-8137-8fd9b6048280 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:33.881673 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d6f0b255-5918-4cb3-8137-8fd9b6048280 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:33.882180 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d6f0b255-5918-4cb3-8137-8fd9b6048280 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:33.882628 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d6f0b255-5918-4cb3-8137-8fd9b6048280 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:34.012554 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d6f0b255-5918-4cb3-8137-8fd9b6048280 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:23:34.020509 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d6f0b255-5918-4cb3-8137-8fd9b6048280 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f" status: 200 len: 1521 microversion: 2.1 time: 0.152756 Oct 27 04:23:34.021084 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3800/7310] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:23:33 2022] GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:23:35.044191 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6bc1f001-d045-43e6-832b-174956e5b2e3 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:23:35.045456 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6bc1f001-d045-43e6-832b-174956e5b2e3 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: 6c6d7869-b37b-4108-ac89-2bca489f4a1f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:23:35.052482 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6bc1f001-d045-43e6-832b-174956e5b2e3 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:35.052978 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6bc1f001-d045-43e6-832b-174956e5b2e3 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:35.053434 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6bc1f001-d045-43e6-832b-174956e5b2e3 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:35.054169 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6bc1f001-d045-43e6-832b-174956e5b2e3 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:35.054639 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6bc1f001-d045-43e6-832b-174956e5b2e3 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:35.055084 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6bc1f001-d045-43e6-832b-174956e5b2e3 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:35.196056 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-6bc1f001-d045-43e6-832b-174956e5b2e3 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:23:35.204839 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6bc1f001-d045-43e6-832b-174956e5b2e3 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f" status: 200 len: 1520 microversion: 2.1 time: 0.164702 Oct 27 04:23:35.205442 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3511/7311] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:23:35 2022] GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:23:35.857937 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-98e5fe71-fd9c-432e-84e8-9304e080a19b req-62b57a3a-8a4f-43a9-aed9-c562dec6f51c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c6d7869-b37b-4108-ac89-2bca489f4a1f", "name": "network-vif-unplugged", "status": "completed", "tag": "571286c8-fcb5-480c-b637-52edf5461988"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:23:35.868581 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-98e5fe71-fd9c-432e-84e8-9304e080a19b req-62b57a3a-8a4f-43a9-aed9-c562dec6f51c service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:35.869121 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-98e5fe71-fd9c-432e-84e8-9304e080a19b req-62b57a3a-8a4f-43a9-aed9-c562dec6f51c service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:35.869584 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-98e5fe71-fd9c-432e-84e8-9304e080a19b req-62b57a3a-8a4f-43a9-aed9-c562dec6f51c service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:35.881862 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-98e5fe71-fd9c-432e-84e8-9304e080a19b req-62b57a3a-8a4f-43a9-aed9-c562dec6f51c service nova] Creating event network-vif-unplugged:571286c8-fcb5-480c-b637-52edf5461988 for instance 6c6d7869-b37b-4108-ac89-2bca489f4a1f on n-h1-862769-1 Oct 27 04:23:35.887378 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [req-98e5fe71-fd9c-432e-84e8-9304e080a19b req-62b57a3a-8a4f-43a9-aed9-c562dec6f51c service nova] Instance 6c6d7869-b37b-4108-ac89-2bca489f4a1f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862769-1', 'n-h1-862769-1'} {{(pid=121001) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 04:23:35.899210 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-98e5fe71-fd9c-432e-84e8-9304e080a19b req-62b57a3a-8a4f-43a9-aed9-c562dec6f51c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045144 Oct 27 04:23:35.899807 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3801/7312] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:23:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:23:36.228658 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-46e6f13d-e709-49d7-8c19-001faab94501 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:23:36.229275 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-46e6f13d-e709-49d7-8c19-001faab94501 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: 6c6d7869-b37b-4108-ac89-2bca489f4a1f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:23:36.236746 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-46e6f13d-e709-49d7-8c19-001faab94501 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:36.237229 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-46e6f13d-e709-49d7-8c19-001faab94501 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:36.237703 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-46e6f13d-e709-49d7-8c19-001faab94501 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:36.238436 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-46e6f13d-e709-49d7-8c19-001faab94501 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:36.238883 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-46e6f13d-e709-49d7-8c19-001faab94501 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:36.239312 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-46e6f13d-e709-49d7-8c19-001faab94501 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:36.375554 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-46e6f13d-e709-49d7-8c19-001faab94501 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:23:36.383992 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-46e6f13d-e709-49d7-8c19-001faab94501 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f" status: 200 len: 1520 microversion: 2.1 time: 0.159263 Oct 27 04:23:36.384785 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3512/7313] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:23:36 2022] GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:23:37.408997 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-961b2e2a-3ee3-490f-a4b2-752116467d22 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:23:37.409646 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-961b2e2a-3ee3-490f-a4b2-752116467d22 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: 6c6d7869-b37b-4108-ac89-2bca489f4a1f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:23:37.415829 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-961b2e2a-3ee3-490f-a4b2-752116467d22 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:37.416326 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-961b2e2a-3ee3-490f-a4b2-752116467d22 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:37.416783 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-961b2e2a-3ee3-490f-a4b2-752116467d22 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:37.417488 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-961b2e2a-3ee3-490f-a4b2-752116467d22 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:37.417957 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-961b2e2a-3ee3-490f-a4b2-752116467d22 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:37.418427 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-961b2e2a-3ee3-490f-a4b2-752116467d22 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:37.552820 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-961b2e2a-3ee3-490f-a4b2-752116467d22 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:23:37.561204 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-961b2e2a-3ee3-490f-a4b2-752116467d22 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f" status: 200 len: 1518 microversion: 2.1 time: 0.157396 Oct 27 04:23:37.561775 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3802/7314] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:23:37 2022] GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:23:37.914290 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-37837bda-9b9d-43a1-a4c1-1602d8e57ea6 req-48de0443-15ef-4bdc-916d-b0aa09959347 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c6d7869-b37b-4108-ac89-2bca489f4a1f", "tag": "571286c8-fcb5-480c-b637-52edf5461988"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:23:37.925017 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-37837bda-9b9d-43a1-a4c1-1602d8e57ea6 req-48de0443-15ef-4bdc-916d-b0aa09959347 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:37.925503 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-37837bda-9b9d-43a1-a4c1-1602d8e57ea6 req-48de0443-15ef-4bdc-916d-b0aa09959347 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:37.925945 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-37837bda-9b9d-43a1-a4c1-1602d8e57ea6 req-48de0443-15ef-4bdc-916d-b0aa09959347 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:37.937840 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-37837bda-9b9d-43a1-a4c1-1602d8e57ea6 req-48de0443-15ef-4bdc-916d-b0aa09959347 service nova] Creating event network-changed:571286c8-fcb5-480c-b637-52edf5461988 for instance 6c6d7869-b37b-4108-ac89-2bca489f4a1f on n-h1-862769-1 Oct 27 04:23:37.943062 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [req-37837bda-9b9d-43a1-a4c1-1602d8e57ea6 req-48de0443-15ef-4bdc-916d-b0aa09959347 service nova] Instance 6c6d7869-b37b-4108-ac89-2bca489f4a1f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862769-1', 'n-h1-862769-1'} {{(pid=121000) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 04:23:37.953854 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-37837bda-9b9d-43a1-a4c1-1602d8e57ea6 req-48de0443-15ef-4bdc-916d-b0aa09959347 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043395 Oct 27 04:23:37.954476 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3513/7315] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:23:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:23:38.585435 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f1642351-5ad1-443b-8ff7-31ced3a4fd45 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:23:38.587125 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f1642351-5ad1-443b-8ff7-31ced3a4fd45 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: 6c6d7869-b37b-4108-ac89-2bca489f4a1f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:23:38.594865 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f1642351-5ad1-443b-8ff7-31ced3a4fd45 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:38.595377 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f1642351-5ad1-443b-8ff7-31ced3a4fd45 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:38.595835 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f1642351-5ad1-443b-8ff7-31ced3a4fd45 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:38.596567 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f1642351-5ad1-443b-8ff7-31ced3a4fd45 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:38.597038 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f1642351-5ad1-443b-8ff7-31ced3a4fd45 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:38.597480 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f1642351-5ad1-443b-8ff7-31ced3a4fd45 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:38.802834 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f1642351-5ad1-443b-8ff7-31ced3a4fd45 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:23:38.813603 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f1642351-5ad1-443b-8ff7-31ced3a4fd45 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f" status: 200 len: 1518 microversion: 2.1 time: 0.232342 Oct 27 04:23:38.821715 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3803/7316] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:23:38 2022] GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f => generated 1518 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:23:39.839104 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c2dfaa14-4e25-4bc5-abb7-5fe053dcc213 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:23:39.840085 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c2dfaa14-4e25-4bc5-abb7-5fe053dcc213 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: 6c6d7869-b37b-4108-ac89-2bca489f4a1f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:23:39.846782 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c2dfaa14-4e25-4bc5-abb7-5fe053dcc213 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:39.847272 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c2dfaa14-4e25-4bc5-abb7-5fe053dcc213 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:39.847719 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c2dfaa14-4e25-4bc5-abb7-5fe053dcc213 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:39.848420 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c2dfaa14-4e25-4bc5-abb7-5fe053dcc213 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:39.848881 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c2dfaa14-4e25-4bc5-abb7-5fe053dcc213 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:39.849316 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c2dfaa14-4e25-4bc5-abb7-5fe053dcc213 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:39.983360 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c2dfaa14-4e25-4bc5-abb7-5fe053dcc213 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:23:39.991103 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c2dfaa14-4e25-4bc5-abb7-5fe053dcc213 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f" status: 200 len: 1515 microversion: 2.1 time: 0.157162 Oct 27 04:23:39.991679 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3514/7317] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:23:39 2022] GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:23:40.014691 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-10ec5ed4-4430-422c-9512-1cdee8180793 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:23:40.015249 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-10ec5ed4-4430-422c-9512-1cdee8180793 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: 6c6d7869-b37b-4108-ac89-2bca489f4a1f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:23:40.022110 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-10ec5ed4-4430-422c-9512-1cdee8180793 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:40.022622 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-10ec5ed4-4430-422c-9512-1cdee8180793 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:40.023076 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-10ec5ed4-4430-422c-9512-1cdee8180793 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:40.023783 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-10ec5ed4-4430-422c-9512-1cdee8180793 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:40.024250 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-10ec5ed4-4430-422c-9512-1cdee8180793 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:40.024694 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-10ec5ed4-4430-422c-9512-1cdee8180793 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:40.211622 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-10ec5ed4-4430-422c-9512-1cdee8180793 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "POST /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f/action" status: 204 len: 0 microversion: 2.1 time: 0.201280 Oct 27 04:23:40.212330 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3804/7318] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 04:23:40 2022] POST /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f/action => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 04:23:40.221683 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c74acd4d-d930-431d-b166-33da198c04a1 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:23:40.222380 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c74acd4d-d930-431d-b166-33da198c04a1 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: 6c6d7869-b37b-4108-ac89-2bca489f4a1f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:23:40.228561 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c74acd4d-d930-431d-b166-33da198c04a1 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:40.232793 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c74acd4d-d930-431d-b166-33da198c04a1 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:40.232793 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c74acd4d-d930-431d-b166-33da198c04a1 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:40.232793 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c74acd4d-d930-431d-b166-33da198c04a1 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:40.232793 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c74acd4d-d930-431d-b166-33da198c04a1 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:40.232793 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c74acd4d-d930-431d-b166-33da198c04a1 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:40.422397 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c74acd4d-d930-431d-b166-33da198c04a1 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:23:40.430271 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c74acd4d-d930-431d-b166-33da198c04a1 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f" status: 200 len: 1515 microversion: 2.1 time: 0.212424 Oct 27 04:23:40.430859 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3515/7319] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:23:40 2022] GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f => generated 1515 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 04:23:41.455744 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-554fa06c-9145-401a-9784-51a3a5d73531 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:23:41.456709 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-554fa06c-9145-401a-9784-51a3a5d73531 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: 6c6d7869-b37b-4108-ac89-2bca489f4a1f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:23:41.463848 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-554fa06c-9145-401a-9784-51a3a5d73531 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:41.464653 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-554fa06c-9145-401a-9784-51a3a5d73531 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:41.465117 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-554fa06c-9145-401a-9784-51a3a5d73531 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:41.465850 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-554fa06c-9145-401a-9784-51a3a5d73531 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:41.466409 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-554fa06c-9145-401a-9784-51a3a5d73531 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:41.466810 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-554fa06c-9145-401a-9784-51a3a5d73531 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:41.607884 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-554fa06c-9145-401a-9784-51a3a5d73531 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:23:41.615808 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-554fa06c-9145-401a-9784-51a3a5d73531 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f" status: 200 len: 1515 microversion: 2.1 time: 0.164395 Oct 27 04:23:41.616387 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3805/7320] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:23:41 2022] GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f => generated 1515 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:23:42.639771 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-08f26c2b-9b94-4581-8dc4-688be57f8731 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:23:42.640428 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-08f26c2b-9b94-4581-8dc4-688be57f8731 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: 6c6d7869-b37b-4108-ac89-2bca489f4a1f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:23:42.647215 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-08f26c2b-9b94-4581-8dc4-688be57f8731 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:42.647712 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-08f26c2b-9b94-4581-8dc4-688be57f8731 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:42.648157 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-08f26c2b-9b94-4581-8dc4-688be57f8731 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:42.648859 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-08f26c2b-9b94-4581-8dc4-688be57f8731 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:42.649320 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-08f26c2b-9b94-4581-8dc4-688be57f8731 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:42.649754 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-08f26c2b-9b94-4581-8dc4-688be57f8731 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:42.782833 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-08f26c2b-9b94-4581-8dc4-688be57f8731 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:23:42.790617 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-08f26c2b-9b94-4581-8dc4-688be57f8731 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f" status: 200 len: 1507 microversion: 2.1 time: 0.155469 Oct 27 04:23:42.791204 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3516/7321] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:23:42 2022] GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f => generated 1507 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:23:42.813477 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-fc11753c-2a3f-4063-a85b-1e327d9dd2dd tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:23:42.814064 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-fc11753c-2a3f-4063-a85b-1e327d9dd2dd tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: 6c6d7869-b37b-4108-ac89-2bca489f4a1f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:23:42.820755 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fc11753c-2a3f-4063-a85b-1e327d9dd2dd tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:42.821260 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fc11753c-2a3f-4063-a85b-1e327d9dd2dd tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:42.821709 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fc11753c-2a3f-4063-a85b-1e327d9dd2dd tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:42.822445 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fc11753c-2a3f-4063-a85b-1e327d9dd2dd tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:42.823505 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fc11753c-2a3f-4063-a85b-1e327d9dd2dd tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:42.823958 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fc11753c-2a3f-4063-a85b-1e327d9dd2dd tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:42.951764 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-fc11753c-2a3f-4063-a85b-1e327d9dd2dd tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:23:42.959456 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-fc11753c-2a3f-4063-a85b-1e327d9dd2dd tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f" status: 200 len: 1507 microversion: 2.1 time: 0.150057 Oct 27 04:23:42.960022 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3806/7322] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:23:42 2022] GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f => generated 1507 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:23:42.985725 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3016d3f8-c31a-4730-95bf-517feaa4642c tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Action: 'create', calling method: .version_select at 0x7f7dd9debe50>, body: {"keypair": {"name": "tempest-keypair-1864666895", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFaimRCvfnA7rkW4H8mftdRc9/2Ej41/oCNyNZtHXN3LEhamLbF0qETiT4Utnq2S6RsyYbrSheyZJ6czoW03DvYrdMi5dz0cgxovrUp1vycOby2/x3l4p4VFcad7DfNQ1A=="}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:23:43.001596 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-3016d3f8-c31a-4730-95bf-517feaa4642c tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Getting quotas for project 8f53f549cce04ce78df9a4b68ec35177. Resources: {'key_pairs'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 04:23:43.007791 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-3016d3f8-c31a-4730-95bf-517feaa4642c tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Getting quotas for user 0482d6b66ea34d34bed74fac32f55068 and project 8f53f549cce04ce78df9a4b68ec35177. Resources: {'key_pairs'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 04:23:43.021452 n-d-862769-1 devstack@n-api.service[121000]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3016d3f8-c31a-4730-95bf-517feaa4642c tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [bc5cc820-22d4-4c61-b33e-040cb7304259] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 27 04:23:43.330146 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-aa7141cd-93e2-4c67-9df3-4de461871d12 req-8ae11f39-343a-4687-a1f7-1f730b7d72c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c6d7869-b37b-4108-ac89-2bca489f4a1f", "name": "network-vif-plugged", "status": "completed", "tag": "571286c8-fcb5-480c-b637-52edf5461988"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:23:43.339626 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-aa7141cd-93e2-4c67-9df3-4de461871d12 req-8ae11f39-343a-4687-a1f7-1f730b7d72c5 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:43.340123 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-aa7141cd-93e2-4c67-9df3-4de461871d12 req-8ae11f39-343a-4687-a1f7-1f730b7d72c5 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:43.340576 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-aa7141cd-93e2-4c67-9df3-4de461871d12 req-8ae11f39-343a-4687-a1f7-1f730b7d72c5 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:43.351989 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-aa7141cd-93e2-4c67-9df3-4de461871d12 req-8ae11f39-343a-4687-a1f7-1f730b7d72c5 service nova] Creating event network-vif-plugged:571286c8-fcb5-480c-b637-52edf5461988 for instance 6c6d7869-b37b-4108-ac89-2bca489f4a1f on n-h1-862769-1 Oct 27 04:23:43.357615 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-aa7141cd-93e2-4c67-9df3-4de461871d12 req-8ae11f39-343a-4687-a1f7-1f730b7d72c5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030698 Oct 27 04:23:43.358298 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3807/7323] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:23:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 04:23:44.029581 n-d-862769-1 devstack@n-api.service[121000]: INFO oslo.messaging._drivers.impl_rabbit [None req-3016d3f8-c31a-4730-95bf-517feaa4642c tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [bc5cc820-22d4-4c61-b33e-040cb7304259] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 55382. Oct 27 04:23:44.089131 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3016d3f8-c31a-4730-95bf-517feaa4642c tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.107336 Oct 27 04:23:44.090063 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3517/7324] 10.222.0.20 () {60 vars in 1159 bytes} [Thu Oct 27 04:23:42 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:23:46.185364 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b767dd6c-1208-45b5-aadc-c291e33ab59c tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:23:46.186587 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b767dd6c-1208-45b5-aadc-c291e33ab59c tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: 6c6d7869-b37b-4108-ac89-2bca489f4a1f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:23:46.192797 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b767dd6c-1208-45b5-aadc-c291e33ab59c tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:46.193300 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b767dd6c-1208-45b5-aadc-c291e33ab59c tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:46.193757 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b767dd6c-1208-45b5-aadc-c291e33ab59c tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:46.194547 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b767dd6c-1208-45b5-aadc-c291e33ab59c tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:46.195029 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b767dd6c-1208-45b5-aadc-c291e33ab59c tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:46.195474 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b767dd6c-1208-45b5-aadc-c291e33ab59c tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:46.325192 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b767dd6c-1208-45b5-aadc-c291e33ab59c tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:23:46.333566 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b767dd6c-1208-45b5-aadc-c291e33ab59c tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f" status: 200 len: 1507 microversion: 2.1 time: 0.153715 Oct 27 04:23:46.334166 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3808/7325] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:23:46 2022] GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:23:46.357908 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-89d1d8be-0e48-442a-9c8f-0527a9d10f05 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:23:46.358472 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-89d1d8be-0e48-442a-9c8f-0527a9d10f05 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: 6c6d7869-b37b-4108-ac89-2bca489f4a1f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:23:46.364301 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-89d1d8be-0e48-442a-9c8f-0527a9d10f05 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:46.364786 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-89d1d8be-0e48-442a-9c8f-0527a9d10f05 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:46.365223 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-89d1d8be-0e48-442a-9c8f-0527a9d10f05 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:46.365919 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-89d1d8be-0e48-442a-9c8f-0527a9d10f05 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:46.366407 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-89d1d8be-0e48-442a-9c8f-0527a9d10f05 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:46.366839 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-89d1d8be-0e48-442a-9c8f-0527a9d10f05 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:46.393779 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-89d1d8be-0e48-442a-9c8f-0527a9d10f05 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: 6c6d7869-b37b-4108-ac89-2bca489f4a1f] Going to try to terminate instance {{(pid=121000) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 04:23:46.651668 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-89d1d8be-0e48-442a-9c8f-0527a9d10f05 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f" status: 204 len: 0 microversion: 2.1 time: 0.298954 Oct 27 04:23:46.652198 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3518/7326] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 04:23:46 2022] DELETE /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 04:23:46.712758 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-98766e95-6abf-42ec-ae98-5d01f4274c98 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1455894248", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": [{"uuid": "f7aed6fe-b7bc-4445-88af-82f555f3f11e"}]}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:23:46.765856 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.network.neutron [None req-98766e95-6abf-42ec-ae98-5d01f4274c98 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] validate_networks() for [('f7aed6fe-b7bc-4445-88af-82f555f3f11e', None, None, None, None, None)] {{(pid=121001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 04:23:47.136254 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-98766e95-6abf-42ec-ae98-5d01f4274c98 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Flavor limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 04:23:47.136687 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-98766e95-6abf-42ec-ae98-5d01f4274c98 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Image limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 04:23:47.137183 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-98766e95-6abf-42ec-ae98-5d01f4274c98 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Flavor pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 04:23:47.137617 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-98766e95-6abf-42ec-ae98-5d01f4274c98 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Image pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 04:23:47.138712 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-98766e95-6abf-42ec-ae98-5d01f4274c98 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 04:23:47.147828 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-98766e95-6abf-42ec-ae98-5d01f4274c98 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:47.148334 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-98766e95-6abf-42ec-ae98-5d01f4274c98 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:47.155223 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-98766e95-6abf-42ec-ae98-5d01f4274c98 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:47.155223 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-98766e95-6abf-42ec-ae98-5d01f4274c98 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:47.155223 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-98766e95-6abf-42ec-ae98-5d01f4274c98 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:47.155223 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-98766e95-6abf-42ec-ae98-5d01f4274c98 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:47.167074 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-98766e95-6abf-42ec-ae98-5d01f4274c98 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Getting quotas for project 8f53f549cce04ce78df9a4b68ec35177. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 04:23:47.173561 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-98766e95-6abf-42ec-ae98-5d01f4274c98 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Getting quotas for user 0482d6b66ea34d34bed74fac32f55068 and project 8f53f549cce04ce78df9a4b68ec35177. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 04:23:47.187102 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-98766e95-6abf-42ec-ae98-5d01f4274c98 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Going to run 1 instances... {{(pid=121001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 04:23:47.189441 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-98766e95-6abf-42ec-ae98-5d01f4274c98 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: ee41c278-cfd6-415e-b9e1-0aedf7784a46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 04:23:47.325173 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-98766e95-6abf-42ec-ae98-5d01f4274c98 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.616164 Oct 27 04:23:47.325832 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3809/7327] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 04:23:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 618 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 04:23:47.337759 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8a3a18a4-8fde-4e3b-a811-ffeb4b50dca0 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:23:47.338494 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8a3a18a4-8fde-4e3b-a811-ffeb4b50dca0 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: ee41c278-cfd6-415e-b9e1-0aedf7784a46] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:23:47.395881 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8a3a18a4-8fde-4e3b-a811-ffeb4b50dca0 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:23:47.403582 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8a3a18a4-8fde-4e3b-a811-ffeb4b50dca0 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46" status: 200 len: 1218 microversion: 2.1 time: 0.070247 Oct 27 04:23:47.404275 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3519/7328] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:23:47 2022] GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46 => generated 1218 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 04:23:48.426606 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-93d91be3-f7e8-432d-89db-55d45da2b517 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:23:48.427448 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-93d91be3-f7e8-432d-89db-55d45da2b517 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: ee41c278-cfd6-415e-b9e1-0aedf7784a46] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:23:48.430095 n-d-862769-1 devstack@n-api.service[121001]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 04:23:48.430457 n-d-862769-1 devstack@n-api.service[121001]: Thu Oct 27 04:23:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46 (ip 10.222.0.20) !!! Oct 27 04:23:48.446602 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-93d91be3-f7e8-432d-89db-55d45da2b517 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:48.447210 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-93d91be3-f7e8-432d-89db-55d45da2b517 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:48.447759 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-93d91be3-f7e8-432d-89db-55d45da2b517 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:48.448487 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-93d91be3-f7e8-432d-89db-55d45da2b517 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:48.448967 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-93d91be3-f7e8-432d-89db-55d45da2b517 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:48.449540 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-93d91be3-f7e8-432d-89db-55d45da2b517 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:48.516448 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-93d91be3-f7e8-432d-89db-55d45da2b517 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:23:48.524318 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-93d91be3-f7e8-432d-89db-55d45da2b517 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46" status: 200 len: 1222 microversion: 2.1 time: 0.102270 Oct 27 04:23:48.524908 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3810/7329] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:23:48 2022] GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46 => generated 1222 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:23:48.689267 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-dea4de24-9346-429a-b100-6cce5a6f1138 req-a9316b13-7d5e-4efe-84c9-232c1a48caef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c6d7869-b37b-4108-ac89-2bca489f4a1f", "name": "network-vif-deleted", "tag": "571286c8-fcb5-480c-b637-52edf5461988"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:23:48.700184 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-dea4de24-9346-429a-b100-6cce5a6f1138 req-a9316b13-7d5e-4efe-84c9-232c1a48caef service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:48.704100 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-dea4de24-9346-429a-b100-6cce5a6f1138 req-a9316b13-7d5e-4efe-84c9-232c1a48caef service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:48.704100 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-dea4de24-9346-429a-b100-6cce5a6f1138 req-a9316b13-7d5e-4efe-84c9-232c1a48caef service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:48.717019 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-dea4de24-9346-429a-b100-6cce5a6f1138 req-a9316b13-7d5e-4efe-84c9-232c1a48caef service nova] Creating event network-vif-deleted:571286c8-fcb5-480c-b637-52edf5461988 for instance 6c6d7869-b37b-4108-ac89-2bca489f4a1f on n-h1-862769-1 Oct 27 04:23:48.722187 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-dea4de24-9346-429a-b100-6cce5a6f1138 req-a9316b13-7d5e-4efe-84c9-232c1a48caef service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037058 Oct 27 04:23:48.722868 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3520/7330] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:23:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:23:49.553250 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-66ed4867-29e0-4612-bb1d-f6d9a903b490 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:23:49.553884 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-66ed4867-29e0-4612-bb1d-f6d9a903b490 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: ee41c278-cfd6-415e-b9e1-0aedf7784a46] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:23:49.562352 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-66ed4867-29e0-4612-bb1d-f6d9a903b490 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:49.562853 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-66ed4867-29e0-4612-bb1d-f6d9a903b490 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:49.563519 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-66ed4867-29e0-4612-bb1d-f6d9a903b490 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:49.564244 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-66ed4867-29e0-4612-bb1d-f6d9a903b490 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:49.564850 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-66ed4867-29e0-4612-bb1d-f6d9a903b490 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:49.565299 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-66ed4867-29e0-4612-bb1d-f6d9a903b490 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:49.569853 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:23:49.655387 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-66ed4867-29e0-4612-bb1d-f6d9a903b490 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:23:49.663492 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-66ed4867-29e0-4612-bb1d-f6d9a903b490 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46" status: 200 len: 1278 microversion: 2.1 time: 0.114881 Oct 27 04:23:49.664111 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3811/7331] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:23:49 2022] GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46 => generated 1278 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:23:50.688763 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-471237d6-4e2f-46f6-b48a-25c03cde89c4 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:23:50.689614 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-471237d6-4e2f-46f6-b48a-25c03cde89c4 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: ee41c278-cfd6-415e-b9e1-0aedf7784a46] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:23:50.691659 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:23:50.696509 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-471237d6-4e2f-46f6-b48a-25c03cde89c4 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:50.696996 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-471237d6-4e2f-46f6-b48a-25c03cde89c4 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:50.697436 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-471237d6-4e2f-46f6-b48a-25c03cde89c4 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:50.698165 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-471237d6-4e2f-46f6-b48a-25c03cde89c4 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:50.698625 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-471237d6-4e2f-46f6-b48a-25c03cde89c4 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:50.699053 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-471237d6-4e2f-46f6-b48a-25c03cde89c4 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:50.701668 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:23:50.842269 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-471237d6-4e2f-46f6-b48a-25c03cde89c4 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:23:50.849825 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-471237d6-4e2f-46f6-b48a-25c03cde89c4 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46" status: 200 len: 1318 microversion: 2.1 time: 0.166820 Oct 27 04:23:50.852397 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3521/7332] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:23:50 2022] GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:23:51.322655 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-701cb805-ba3c-453d-b5a7-6d093bc57e26 req-e8fb1f18-b664-4984-8bfe-00b900d2be25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee41c278-cfd6-415e-b9e1-0aedf7784a46", "tag": "98121ee1-4393-4af7-9afb-38c9c5390e23"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:23:51.333923 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-701cb805-ba3c-453d-b5a7-6d093bc57e26 req-e8fb1f18-b664-4984-8bfe-00b900d2be25 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:51.335964 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-701cb805-ba3c-453d-b5a7-6d093bc57e26 req-e8fb1f18-b664-4984-8bfe-00b900d2be25 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:51.335964 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-701cb805-ba3c-453d-b5a7-6d093bc57e26 req-e8fb1f18-b664-4984-8bfe-00b900d2be25 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:51.346651 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-701cb805-ba3c-453d-b5a7-6d093bc57e26 req-e8fb1f18-b664-4984-8bfe-00b900d2be25 service nova] Creating event network-changed:98121ee1-4393-4af7-9afb-38c9c5390e23 for instance ee41c278-cfd6-415e-b9e1-0aedf7784a46 on n-h1-862769-1 Oct 27 04:23:51.351710 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-701cb805-ba3c-453d-b5a7-6d093bc57e26 req-e8fb1f18-b664-4984-8bfe-00b900d2be25 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033306 Oct 27 04:23:51.352321 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3812/7333] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:23:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:23:51.873412 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5029e6cb-35a9-48f4-a4c1-81961eefdcdf tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:23:51.873960 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5029e6cb-35a9-48f4-a4c1-81961eefdcdf tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: ee41c278-cfd6-415e-b9e1-0aedf7784a46] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:23:51.881977 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5029e6cb-35a9-48f4-a4c1-81961eefdcdf tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:51.882504 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5029e6cb-35a9-48f4-a4c1-81961eefdcdf tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:51.882953 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5029e6cb-35a9-48f4-a4c1-81961eefdcdf tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:51.883666 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5029e6cb-35a9-48f4-a4c1-81961eefdcdf tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:51.884131 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5029e6cb-35a9-48f4-a4c1-81961eefdcdf tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:51.884568 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5029e6cb-35a9-48f4-a4c1-81961eefdcdf tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:52.015490 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5029e6cb-35a9-48f4-a4c1-81961eefdcdf tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:23:52.023569 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5029e6cb-35a9-48f4-a4c1-81961eefdcdf tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46" status: 200 len: 1318 microversion: 2.1 time: 0.154172 Oct 27 04:23:52.024151 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3522/7334] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:23:51 2022] GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:23:53.047415 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f4ed51b5-b115-417d-bbc1-b125fe24bbb2 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:23:53.048142 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f4ed51b5-b115-417d-bbc1-b125fe24bbb2 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: ee41c278-cfd6-415e-b9e1-0aedf7784a46] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:23:53.055814 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f4ed51b5-b115-417d-bbc1-b125fe24bbb2 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:53.056320 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f4ed51b5-b115-417d-bbc1-b125fe24bbb2 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:53.056780 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f4ed51b5-b115-417d-bbc1-b125fe24bbb2 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:53.057554 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f4ed51b5-b115-417d-bbc1-b125fe24bbb2 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:53.057984 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f4ed51b5-b115-417d-bbc1-b125fe24bbb2 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:53.064088 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f4ed51b5-b115-417d-bbc1-b125fe24bbb2 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:53.191140 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f4ed51b5-b115-417d-bbc1-b125fe24bbb2 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:23:53.198935 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f4ed51b5-b115-417d-bbc1-b125fe24bbb2 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46" status: 200 len: 1318 microversion: 2.1 time: 0.156467 Oct 27 04:23:53.199511 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3813/7335] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:23:53 2022] GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:23:54.221662 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f71fa988-708e-4be2-adf4-31dd19defe09 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:23:54.222340 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f71fa988-708e-4be2-adf4-31dd19defe09 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: ee41c278-cfd6-415e-b9e1-0aedf7784a46] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:23:54.229253 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f71fa988-708e-4be2-adf4-31dd19defe09 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:54.229740 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f71fa988-708e-4be2-adf4-31dd19defe09 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:54.230223 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f71fa988-708e-4be2-adf4-31dd19defe09 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:54.230916 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f71fa988-708e-4be2-adf4-31dd19defe09 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:54.231375 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f71fa988-708e-4be2-adf4-31dd19defe09 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:54.231820 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f71fa988-708e-4be2-adf4-31dd19defe09 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:54.359338 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f71fa988-708e-4be2-adf4-31dd19defe09 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:23:54.366869 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f71fa988-708e-4be2-adf4-31dd19defe09 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46" status: 200 len: 1318 microversion: 2.1 time: 0.149190 Oct 27 04:23:54.367439 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3523/7336] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:23:54 2022] GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:23:55.388728 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-77095842-3bf8-45b5-8e67-e31ed22b9ec1 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:23:55.389365 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-77095842-3bf8-45b5-8e67-e31ed22b9ec1 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: ee41c278-cfd6-415e-b9e1-0aedf7784a46] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:23:55.392215 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:23:55.396965 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-77095842-3bf8-45b5-8e67-e31ed22b9ec1 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:55.397471 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-77095842-3bf8-45b5-8e67-e31ed22b9ec1 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:55.397931 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-77095842-3bf8-45b5-8e67-e31ed22b9ec1 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:55.398683 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-77095842-3bf8-45b5-8e67-e31ed22b9ec1 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:55.399166 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-77095842-3bf8-45b5-8e67-e31ed22b9ec1 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:55.399616 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-77095842-3bf8-45b5-8e67-e31ed22b9ec1 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:55.531969 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-77095842-3bf8-45b5-8e67-e31ed22b9ec1 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:23:55.540387 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-77095842-3bf8-45b5-8e67-e31ed22b9ec1 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46" status: 200 len: 1318 microversion: 2.1 time: 0.155515 Oct 27 04:23:55.541013 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3814/7337] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:23:55 2022] GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:23:56.563879 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b66ddeec-b383-4e2b-907f-e12cc5e555d6 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:23:56.564511 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b66ddeec-b383-4e2b-907f-e12cc5e555d6 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: ee41c278-cfd6-415e-b9e1-0aedf7784a46] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:23:56.571502 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b66ddeec-b383-4e2b-907f-e12cc5e555d6 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:56.571997 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b66ddeec-b383-4e2b-907f-e12cc5e555d6 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:56.572448 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b66ddeec-b383-4e2b-907f-e12cc5e555d6 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:56.573148 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b66ddeec-b383-4e2b-907f-e12cc5e555d6 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:56.573613 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b66ddeec-b383-4e2b-907f-e12cc5e555d6 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:56.574069 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b66ddeec-b383-4e2b-907f-e12cc5e555d6 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:56.707967 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b66ddeec-b383-4e2b-907f-e12cc5e555d6 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:23:56.716563 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b66ddeec-b383-4e2b-907f-e12cc5e555d6 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46" status: 200 len: 1318 microversion: 2.1 time: 0.156885 Oct 27 04:23:56.717131 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3524/7338] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:23:56 2022] GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:23:57.207206 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-5e594a75-0333-4a17-b647-88fa835131de req-456fd514-1dbc-48a8-8c2b-5688dec074d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee41c278-cfd6-415e-b9e1-0aedf7784a46", "name": "network-vif-plugged", "status": "completed", "tag": "98121ee1-4393-4af7-9afb-38c9c5390e23"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:23:57.213080 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:23:57.213773 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=6 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:23:57.219777 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-5e594a75-0333-4a17-b647-88fa835131de req-456fd514-1dbc-48a8-8c2b-5688dec074d7 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:57.220272 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-5e594a75-0333-4a17-b647-88fa835131de req-456fd514-1dbc-48a8-8c2b-5688dec074d7 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:57.220719 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-5e594a75-0333-4a17-b647-88fa835131de req-456fd514-1dbc-48a8-8c2b-5688dec074d7 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:57.231497 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-5e594a75-0333-4a17-b647-88fa835131de req-456fd514-1dbc-48a8-8c2b-5688dec074d7 service nova] Creating event network-vif-plugged:98121ee1-4393-4af7-9afb-38c9c5390e23 for instance ee41c278-cfd6-415e-b9e1-0aedf7784a46 on n-h1-862769-1 Oct 27 04:23:57.236439 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-5e594a75-0333-4a17-b647-88fa835131de req-456fd514-1dbc-48a8-8c2b-5688dec074d7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033055 Oct 27 04:23:57.237053 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3815/7339] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:23:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:23:57.740469 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-dbed4c2f-7d23-4eec-b8ea-893c246beef3 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:23:57.741116 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-dbed4c2f-7d23-4eec-b8ea-893c246beef3 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: ee41c278-cfd6-415e-b9e1-0aedf7784a46] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:23:57.743159 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=6 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:23:57.748482 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dbed4c2f-7d23-4eec-b8ea-893c246beef3 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:57.748974 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dbed4c2f-7d23-4eec-b8ea-893c246beef3 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:57.749420 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dbed4c2f-7d23-4eec-b8ea-893c246beef3 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:57.750147 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dbed4c2f-7d23-4eec-b8ea-893c246beef3 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:57.750613 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dbed4c2f-7d23-4eec-b8ea-893c246beef3 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:57.751051 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dbed4c2f-7d23-4eec-b8ea-893c246beef3 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:57.881860 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-dbed4c2f-7d23-4eec-b8ea-893c246beef3 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:23:57.889504 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-dbed4c2f-7d23-4eec-b8ea-893c246beef3 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46" status: 200 len: 1318 microversion: 2.1 time: 0.153149 Oct 27 04:23:57.890113 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3525/7340] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:23:57 2022] GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:23:58.913960 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ceb0e1c7-ac7f-4929-addf-582bae2e2481 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:23:58.914631 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ceb0e1c7-ac7f-4929-addf-582bae2e2481 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: ee41c278-cfd6-415e-b9e1-0aedf7784a46] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:23:58.921275 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ceb0e1c7-ac7f-4929-addf-582bae2e2481 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:58.921783 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ceb0e1c7-ac7f-4929-addf-582bae2e2481 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:58.922281 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ceb0e1c7-ac7f-4929-addf-582bae2e2481 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:58.923002 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ceb0e1c7-ac7f-4929-addf-582bae2e2481 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:58.923480 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ceb0e1c7-ac7f-4929-addf-582bae2e2481 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:58.923936 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ceb0e1c7-ac7f-4929-addf-582bae2e2481 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:59.052435 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ceb0e1c7-ac7f-4929-addf-582bae2e2481 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:23:59.060793 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ceb0e1c7-ac7f-4929-addf-582bae2e2481 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46" status: 200 len: 1508 microversion: 2.1 time: 0.151767 Oct 27 04:23:59.061366 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3816/7341] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:23:58 2022] GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46 => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:23:59.083846 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d220f97e-7ffb-4ad8-962b-7055ec0b9562 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:23:59.084479 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d220f97e-7ffb-4ad8-962b-7055ec0b9562 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: ee41c278-cfd6-415e-b9e1-0aedf7784a46] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:23:59.091675 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d220f97e-7ffb-4ad8-962b-7055ec0b9562 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:59.092233 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d220f97e-7ffb-4ad8-962b-7055ec0b9562 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:59.092687 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d220f97e-7ffb-4ad8-962b-7055ec0b9562 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:59.093396 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d220f97e-7ffb-4ad8-962b-7055ec0b9562 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:59.093864 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d220f97e-7ffb-4ad8-962b-7055ec0b9562 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:59.094347 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d220f97e-7ffb-4ad8-962b-7055ec0b9562 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:59.227469 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d220f97e-7ffb-4ad8-962b-7055ec0b9562 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:23:59.235780 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d220f97e-7ffb-4ad8-962b-7055ec0b9562 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46" status: 200 len: 1508 microversion: 2.1 time: 0.155807 Oct 27 04:23:59.236362 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3526/7342] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:23:59 2022] GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46 => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:23:59.257589 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d55b07a4-21c9-4ff0-8786-03230e4eb3cc tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:23:59.259962 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d55b07a4-21c9-4ff0-8786-03230e4eb3cc tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: ee41c278-cfd6-415e-b9e1-0aedf7784a46] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:23:59.265933 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d55b07a4-21c9-4ff0-8786-03230e4eb3cc tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:59.266453 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d55b07a4-21c9-4ff0-8786-03230e4eb3cc tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:59.266914 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d55b07a4-21c9-4ff0-8786-03230e4eb3cc tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:59.267628 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d55b07a4-21c9-4ff0-8786-03230e4eb3cc tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:59.268097 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d55b07a4-21c9-4ff0-8786-03230e4eb3cc tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:59.268544 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d55b07a4-21c9-4ff0-8786-03230e4eb3cc tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:59.299639 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d55b07a4-21c9-4ff0-8786-03230e4eb3cc tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:23:59.305163 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d55b07a4-21c9-4ff0-8786-03230e4eb3cc tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: ee41c278-cfd6-415e-b9e1-0aedf7784a46] Old instance type m1.heat2, new instance type m1.heat {{(pid=121001) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 27 04:23:59.311859 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-d55b07a4-21c9-4ff0-8786-03230e4eb3cc tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Flavor limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 04:23:59.312299 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-d55b07a4-21c9-4ff0-8786-03230e4eb3cc tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Image limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 04:23:59.312790 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-d55b07a4-21c9-4ff0-8786-03230e4eb3cc tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Flavor pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 04:23:59.313214 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-d55b07a4-21c9-4ff0-8786-03230e4eb3cc tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Image pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 04:23:59.313640 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-d55b07a4-21c9-4ff0-8786-03230e4eb3cc tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 04:23:59.520041 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d55b07a4-21c9-4ff0-8786-03230e4eb3cc tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "POST /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46/action" status: 202 len: 0 microversion: 2.1 time: 0.266392 Oct 27 04:23:59.520690 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3817/7343] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 04:23:59 2022] POST /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46/action => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 04:23:59.528767 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b646d0c9-700d-4230-8b5c-26194aa9b3fb tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:23:59.530017 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b646d0c9-700d-4230-8b5c-26194aa9b3fb tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: ee41c278-cfd6-415e-b9e1-0aedf7784a46] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:23:59.536159 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b646d0c9-700d-4230-8b5c-26194aa9b3fb tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:59.536723 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b646d0c9-700d-4230-8b5c-26194aa9b3fb tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:59.537177 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b646d0c9-700d-4230-8b5c-26194aa9b3fb tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:59.537890 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b646d0c9-700d-4230-8b5c-26194aa9b3fb tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:23:59.538460 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b646d0c9-700d-4230-8b5c-26194aa9b3fb tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:23:59.538902 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b646d0c9-700d-4230-8b5c-26194aa9b3fb tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:23:59.667675 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b646d0c9-700d-4230-8b5c-26194aa9b3fb tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:23:59.675590 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b646d0c9-700d-4230-8b5c-26194aa9b3fb tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46" status: 200 len: 1515 microversion: 2.1 time: 0.150631 Oct 27 04:23:59.676179 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3527/7344] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:23:59 2022] GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46 => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 04:24:00.699296 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-907c309a-2982-4e6d-9600-e23d13997b5e tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:24:00.699940 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-907c309a-2982-4e6d-9600-e23d13997b5e tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: ee41c278-cfd6-415e-b9e1-0aedf7784a46] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:24:00.706851 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-907c309a-2982-4e6d-9600-e23d13997b5e tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:00.707389 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-907c309a-2982-4e6d-9600-e23d13997b5e tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:00.707859 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-907c309a-2982-4e6d-9600-e23d13997b5e tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:00.708581 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-907c309a-2982-4e6d-9600-e23d13997b5e tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:00.709064 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-907c309a-2982-4e6d-9600-e23d13997b5e tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:00.709517 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-907c309a-2982-4e6d-9600-e23d13997b5e tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:00.843385 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-907c309a-2982-4e6d-9600-e23d13997b5e tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:24:00.851335 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-907c309a-2982-4e6d-9600-e23d13997b5e tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46" status: 200 len: 1515 microversion: 2.1 time: 0.156958 Oct 27 04:24:00.851917 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3818/7345] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:24:00 2022] GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46 => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:24:01.875108 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-79b1a347-b9d7-4e5d-b482-660f527ecde6 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:24:01.875736 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-79b1a347-b9d7-4e5d-b482-660f527ecde6 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: ee41c278-cfd6-415e-b9e1-0aedf7784a46] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:24:01.882626 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-79b1a347-b9d7-4e5d-b482-660f527ecde6 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:01.883129 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-79b1a347-b9d7-4e5d-b482-660f527ecde6 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:01.883578 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-79b1a347-b9d7-4e5d-b482-660f527ecde6 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:01.884328 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-79b1a347-b9d7-4e5d-b482-660f527ecde6 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:01.884790 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-79b1a347-b9d7-4e5d-b482-660f527ecde6 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:01.885225 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-79b1a347-b9d7-4e5d-b482-660f527ecde6 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:02.021491 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-79b1a347-b9d7-4e5d-b482-660f527ecde6 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:24:02.029330 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-79b1a347-b9d7-4e5d-b482-660f527ecde6 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46" status: 200 len: 1515 microversion: 2.1 time: 0.158185 Oct 27 04:24:02.029921 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3528/7346] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:24:01 2022] GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:24:03.052592 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d9ce63d9-58d3-488b-b6a8-d80f190e5f3f tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:24:03.053227 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d9ce63d9-58d3-488b-b6a8-d80f190e5f3f tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: ee41c278-cfd6-415e-b9e1-0aedf7784a46] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:24:03.060584 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d9ce63d9-58d3-488b-b6a8-d80f190e5f3f tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:03.061089 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d9ce63d9-58d3-488b-b6a8-d80f190e5f3f tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:03.061547 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d9ce63d9-58d3-488b-b6a8-d80f190e5f3f tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:03.062283 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d9ce63d9-58d3-488b-b6a8-d80f190e5f3f tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:03.062754 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d9ce63d9-58d3-488b-b6a8-d80f190e5f3f tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:03.063199 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d9ce63d9-58d3-488b-b6a8-d80f190e5f3f tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:03.190960 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d9ce63d9-58d3-488b-b6a8-d80f190e5f3f tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:24:03.198636 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d9ce63d9-58d3-488b-b6a8-d80f190e5f3f tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46" status: 200 len: 1520 microversion: 2.1 time: 0.149967 Oct 27 04:24:03.199217 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3819/7347] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:24:03 2022] GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:24:04.222636 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-89073e63-7203-4be5-b6c7-fbe8faf7ec0e tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:24:04.223269 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-89073e63-7203-4be5-b6c7-fbe8faf7ec0e tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: ee41c278-cfd6-415e-b9e1-0aedf7784a46] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:24:04.230845 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-89073e63-7203-4be5-b6c7-fbe8faf7ec0e tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:04.231345 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-89073e63-7203-4be5-b6c7-fbe8faf7ec0e tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:04.231796 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-89073e63-7203-4be5-b6c7-fbe8faf7ec0e tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:04.232502 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-89073e63-7203-4be5-b6c7-fbe8faf7ec0e tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:04.232970 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-89073e63-7203-4be5-b6c7-fbe8faf7ec0e tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:04.233410 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-89073e63-7203-4be5-b6c7-fbe8faf7ec0e tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:04.362320 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-89073e63-7203-4be5-b6c7-fbe8faf7ec0e tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:24:04.370058 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-89073e63-7203-4be5-b6c7-fbe8faf7ec0e tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46" status: 200 len: 1520 microversion: 2.1 time: 0.151496 Oct 27 04:24:04.370642 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3529/7348] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:24:04 2022] GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:24:05.393316 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f363c49d-283d-4309-ab36-1f4959954dbe tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:24:05.393970 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f363c49d-283d-4309-ab36-1f4959954dbe tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: ee41c278-cfd6-415e-b9e1-0aedf7784a46] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:24:05.400821 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f363c49d-283d-4309-ab36-1f4959954dbe tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:05.401323 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f363c49d-283d-4309-ab36-1f4959954dbe tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:05.401776 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f363c49d-283d-4309-ab36-1f4959954dbe tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:05.402519 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f363c49d-283d-4309-ab36-1f4959954dbe tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:05.402989 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f363c49d-283d-4309-ab36-1f4959954dbe tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:05.403430 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f363c49d-283d-4309-ab36-1f4959954dbe tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:05.529793 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f363c49d-283d-4309-ab36-1f4959954dbe tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:24:05.537703 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f363c49d-283d-4309-ab36-1f4959954dbe tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46" status: 200 len: 1520 microversion: 2.1 time: 0.148329 Oct 27 04:24:05.538320 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3820/7349] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:24:05 2022] GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:24:06.560818 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-aae6cae4-a3af-47df-8a67-791910437495 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:24:06.561437 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-aae6cae4-a3af-47df-8a67-791910437495 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: ee41c278-cfd6-415e-b9e1-0aedf7784a46] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:24:06.568447 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aae6cae4-a3af-47df-8a67-791910437495 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:06.568962 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aae6cae4-a3af-47df-8a67-791910437495 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:06.569387 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aae6cae4-a3af-47df-8a67-791910437495 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:06.570118 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aae6cae4-a3af-47df-8a67-791910437495 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:06.570576 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aae6cae4-a3af-47df-8a67-791910437495 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:06.571008 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aae6cae4-a3af-47df-8a67-791910437495 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:06.706798 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-aae6cae4-a3af-47df-8a67-791910437495 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:24:06.714903 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-aae6cae4-a3af-47df-8a67-791910437495 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46" status: 200 len: 1520 microversion: 2.1 time: 0.157753 Oct 27 04:24:06.715472 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3530/7350] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:24:06 2022] GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:24:07.738875 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b4cb134d-9fbb-436b-9aff-78df7f30a3d4 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:24:07.739515 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b4cb134d-9fbb-436b-9aff-78df7f30a3d4 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: ee41c278-cfd6-415e-b9e1-0aedf7784a46] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:24:07.746336 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b4cb134d-9fbb-436b-9aff-78df7f30a3d4 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:07.746845 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b4cb134d-9fbb-436b-9aff-78df7f30a3d4 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:07.747304 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b4cb134d-9fbb-436b-9aff-78df7f30a3d4 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:07.748635 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b4cb134d-9fbb-436b-9aff-78df7f30a3d4 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:07.749112 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b4cb134d-9fbb-436b-9aff-78df7f30a3d4 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:07.749563 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b4cb134d-9fbb-436b-9aff-78df7f30a3d4 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:07.880069 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b4cb134d-9fbb-436b-9aff-78df7f30a3d4 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:24:07.887749 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b4cb134d-9fbb-436b-9aff-78df7f30a3d4 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46" status: 200 len: 1520 microversion: 2.1 time: 0.152779 Oct 27 04:24:07.888334 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3821/7351] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:24:07 2022] GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:24:08.911192 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-47f980f4-5627-4b9b-a7c5-b9204b4e1627 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:24:08.911765 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-47f980f4-5627-4b9b-a7c5-b9204b4e1627 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: ee41c278-cfd6-415e-b9e1-0aedf7784a46] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:24:08.918752 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-47f980f4-5627-4b9b-a7c5-b9204b4e1627 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:08.919247 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-47f980f4-5627-4b9b-a7c5-b9204b4e1627 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:08.920312 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-47f980f4-5627-4b9b-a7c5-b9204b4e1627 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:08.921014 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-47f980f4-5627-4b9b-a7c5-b9204b4e1627 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:08.921484 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-47f980f4-5627-4b9b-a7c5-b9204b4e1627 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:08.921919 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-47f980f4-5627-4b9b-a7c5-b9204b4e1627 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:09.050161 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-47f980f4-5627-4b9b-a7c5-b9204b4e1627 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:24:09.057905 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-47f980f4-5627-4b9b-a7c5-b9204b4e1627 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46" status: 200 len: 1520 microversion: 2.1 time: 0.150741 Oct 27 04:24:09.058523 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3531/7352] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:24:08 2022] GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:24:10.081768 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-49fa14a2-e96b-40d8-8c92-68fa2c64063d tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:24:10.082439 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-49fa14a2-e96b-40d8-8c92-68fa2c64063d tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: ee41c278-cfd6-415e-b9e1-0aedf7784a46] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:24:10.089336 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-49fa14a2-e96b-40d8-8c92-68fa2c64063d tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:10.090132 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-49fa14a2-e96b-40d8-8c92-68fa2c64063d tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:10.090587 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-49fa14a2-e96b-40d8-8c92-68fa2c64063d tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:10.091294 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-49fa14a2-e96b-40d8-8c92-68fa2c64063d tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:10.092374 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-49fa14a2-e96b-40d8-8c92-68fa2c64063d tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:10.092818 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-49fa14a2-e96b-40d8-8c92-68fa2c64063d tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:10.223503 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-49fa14a2-e96b-40d8-8c92-68fa2c64063d tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:24:10.231261 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-49fa14a2-e96b-40d8-8c92-68fa2c64063d tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46" status: 200 len: 1520 microversion: 2.1 time: 0.153381 Oct 27 04:24:10.231837 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3822/7353] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:24:10 2022] GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:24:11.254185 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d9b48ea8-839d-4e07-84ef-08637235bad6 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:24:11.254841 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d9b48ea8-839d-4e07-84ef-08637235bad6 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: ee41c278-cfd6-415e-b9e1-0aedf7784a46] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:24:11.261573 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d9b48ea8-839d-4e07-84ef-08637235bad6 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:11.262086 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d9b48ea8-839d-4e07-84ef-08637235bad6 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:11.262537 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d9b48ea8-839d-4e07-84ef-08637235bad6 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:11.263236 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d9b48ea8-839d-4e07-84ef-08637235bad6 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:11.264252 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d9b48ea8-839d-4e07-84ef-08637235bad6 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:11.264684 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d9b48ea8-839d-4e07-84ef-08637235bad6 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:11.394624 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d9b48ea8-839d-4e07-84ef-08637235bad6 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:24:11.402333 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d9b48ea8-839d-4e07-84ef-08637235bad6 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46" status: 200 len: 1520 microversion: 2.1 time: 0.152044 Oct 27 04:24:11.402918 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3532/7354] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:24:11 2022] GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 04:24:12.426271 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-bda6c3b3-14dc-4c5d-b219-70200c2d27cc tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:24:12.426910 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-bda6c3b3-14dc-4c5d-b219-70200c2d27cc tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: ee41c278-cfd6-415e-b9e1-0aedf7784a46] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:24:12.433739 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bda6c3b3-14dc-4c5d-b219-70200c2d27cc tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:12.434351 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bda6c3b3-14dc-4c5d-b219-70200c2d27cc tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:12.434812 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bda6c3b3-14dc-4c5d-b219-70200c2d27cc tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:12.436133 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bda6c3b3-14dc-4c5d-b219-70200c2d27cc tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:12.436656 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bda6c3b3-14dc-4c5d-b219-70200c2d27cc tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:12.437054 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bda6c3b3-14dc-4c5d-b219-70200c2d27cc tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:12.568202 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-bda6c3b3-14dc-4c5d-b219-70200c2d27cc tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:24:12.575541 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-bda6c3b3-14dc-4c5d-b219-70200c2d27cc tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46" status: 200 len: 1520 microversion: 2.1 time: 0.153219 Oct 27 04:24:12.576289 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3823/7355] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:24:12 2022] GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:24:13.599072 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1210af28-8517-417d-8254-58882e234cde tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:24:13.599719 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1210af28-8517-417d-8254-58882e234cde tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: ee41c278-cfd6-415e-b9e1-0aedf7784a46] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:24:13.606458 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1210af28-8517-417d-8254-58882e234cde tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:13.606948 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1210af28-8517-417d-8254-58882e234cde tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:13.607392 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1210af28-8517-417d-8254-58882e234cde tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:13.608091 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1210af28-8517-417d-8254-58882e234cde tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:13.608549 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1210af28-8517-417d-8254-58882e234cde tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:13.608986 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1210af28-8517-417d-8254-58882e234cde tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:13.739494 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1210af28-8517-417d-8254-58882e234cde tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:24:13.747096 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1210af28-8517-417d-8254-58882e234cde tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46" status: 200 len: 1520 microversion: 2.1 time: 0.152027 Oct 27 04:24:13.748284 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3533/7356] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:24:13 2022] GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:24:14.770578 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e4e861dd-7e7b-44b4-8d59-38e5cdc541b0 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:24:14.771229 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e4e861dd-7e7b-44b4-8d59-38e5cdc541b0 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: ee41c278-cfd6-415e-b9e1-0aedf7784a46] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:24:14.778490 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e4e861dd-7e7b-44b4-8d59-38e5cdc541b0 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:14.779557 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e4e861dd-7e7b-44b4-8d59-38e5cdc541b0 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:14.780022 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e4e861dd-7e7b-44b4-8d59-38e5cdc541b0 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:14.780768 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e4e861dd-7e7b-44b4-8d59-38e5cdc541b0 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:14.781243 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e4e861dd-7e7b-44b4-8d59-38e5cdc541b0 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:14.781692 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e4e861dd-7e7b-44b4-8d59-38e5cdc541b0 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:14.915698 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e4e861dd-7e7b-44b4-8d59-38e5cdc541b0 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:24:14.924243 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e4e861dd-7e7b-44b4-8d59-38e5cdc541b0 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46" status: 200 len: 1520 microversion: 2.1 time: 0.157810 Oct 27 04:24:14.924834 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3824/7357] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:24:14 2022] GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:24:15.947900 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-14e3d7ac-3f4f-4a08-92b4-702a8750d74a tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:24:15.948527 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-14e3d7ac-3f4f-4a08-92b4-702a8750d74a tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: ee41c278-cfd6-415e-b9e1-0aedf7784a46] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:24:15.955449 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-14e3d7ac-3f4f-4a08-92b4-702a8750d74a tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:15.955953 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-14e3d7ac-3f4f-4a08-92b4-702a8750d74a tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:15.956396 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-14e3d7ac-3f4f-4a08-92b4-702a8750d74a tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:15.957118 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-14e3d7ac-3f4f-4a08-92b4-702a8750d74a tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:15.957565 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-14e3d7ac-3f4f-4a08-92b4-702a8750d74a tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:15.958003 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-14e3d7ac-3f4f-4a08-92b4-702a8750d74a tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:16.087410 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-14e3d7ac-3f4f-4a08-92b4-702a8750d74a tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:24:16.095462 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-14e3d7ac-3f4f-4a08-92b4-702a8750d74a tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46" status: 200 len: 1520 microversion: 2.1 time: 0.151596 Oct 27 04:24:16.096045 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3534/7358] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:24:15 2022] GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:24:17.119358 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-65ce6d55-7e23-48fa-ae24-11eba549cf12 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:24:17.120002 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-65ce6d55-7e23-48fa-ae24-11eba549cf12 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: ee41c278-cfd6-415e-b9e1-0aedf7784a46] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:24:17.127440 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-65ce6d55-7e23-48fa-ae24-11eba549cf12 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:17.127941 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-65ce6d55-7e23-48fa-ae24-11eba549cf12 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:17.128401 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-65ce6d55-7e23-48fa-ae24-11eba549cf12 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:17.129113 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-65ce6d55-7e23-48fa-ae24-11eba549cf12 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:17.129590 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-65ce6d55-7e23-48fa-ae24-11eba549cf12 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:17.130055 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-65ce6d55-7e23-48fa-ae24-11eba549cf12 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:17.261828 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-65ce6d55-7e23-48fa-ae24-11eba549cf12 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:24:17.270194 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-65ce6d55-7e23-48fa-ae24-11eba549cf12 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46" status: 200 len: 1520 microversion: 2.1 time: 0.154863 Oct 27 04:24:17.270772 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3825/7359] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:24:17 2022] GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:24:18.293375 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-47ff7bd7-87cd-4364-a8ee-d619aaf2d7e4 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:24:18.293993 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-47ff7bd7-87cd-4364-a8ee-d619aaf2d7e4 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: ee41c278-cfd6-415e-b9e1-0aedf7784a46] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:24:18.301266 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-47ff7bd7-87cd-4364-a8ee-d619aaf2d7e4 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:18.301751 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-47ff7bd7-87cd-4364-a8ee-d619aaf2d7e4 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:18.302230 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-47ff7bd7-87cd-4364-a8ee-d619aaf2d7e4 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:18.302926 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-47ff7bd7-87cd-4364-a8ee-d619aaf2d7e4 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:18.303385 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-47ff7bd7-87cd-4364-a8ee-d619aaf2d7e4 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:18.303817 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-47ff7bd7-87cd-4364-a8ee-d619aaf2d7e4 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:18.437491 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-47ff7bd7-87cd-4364-a8ee-d619aaf2d7e4 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:24:18.445210 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-47ff7bd7-87cd-4364-a8ee-d619aaf2d7e4 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46" status: 200 len: 1520 microversion: 2.1 time: 0.155879 Oct 27 04:24:18.445788 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3535/7360] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:24:18 2022] GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:24:19.468994 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3a362bbf-82ff-4d2f-bb80-2cd91f30b45f tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:24:19.469641 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3a362bbf-82ff-4d2f-bb80-2cd91f30b45f tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: ee41c278-cfd6-415e-b9e1-0aedf7784a46] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:24:19.476647 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3a362bbf-82ff-4d2f-bb80-2cd91f30b45f tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:19.477156 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3a362bbf-82ff-4d2f-bb80-2cd91f30b45f tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:19.477624 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3a362bbf-82ff-4d2f-bb80-2cd91f30b45f tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:19.478376 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3a362bbf-82ff-4d2f-bb80-2cd91f30b45f tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:19.478858 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3a362bbf-82ff-4d2f-bb80-2cd91f30b45f tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:19.479313 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3a362bbf-82ff-4d2f-bb80-2cd91f30b45f tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:19.908611 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3a362bbf-82ff-4d2f-bb80-2cd91f30b45f tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:24:19.916395 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3a362bbf-82ff-4d2f-bb80-2cd91f30b45f tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46" status: 200 len: 1520 microversion: 2.1 time: 0.451777 Oct 27 04:24:19.917179 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3826/7361] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:24:19 2022] GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46 => generated 1520 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:24:20.940164 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0945b16f-8d18-413f-b290-9e2c209fc51c tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:24:20.940717 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0945b16f-8d18-413f-b290-9e2c209fc51c tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: ee41c278-cfd6-415e-b9e1-0aedf7784a46] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:24:20.947527 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0945b16f-8d18-413f-b290-9e2c209fc51c tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:20.948009 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0945b16f-8d18-413f-b290-9e2c209fc51c tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:20.948449 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0945b16f-8d18-413f-b290-9e2c209fc51c tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:20.949141 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0945b16f-8d18-413f-b290-9e2c209fc51c tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:20.949599 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0945b16f-8d18-413f-b290-9e2c209fc51c tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:20.950026 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0945b16f-8d18-413f-b290-9e2c209fc51c tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:21.077060 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0945b16f-8d18-413f-b290-9e2c209fc51c tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:24:21.084785 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0945b16f-8d18-413f-b290-9e2c209fc51c tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46" status: 200 len: 1520 microversion: 2.1 time: 0.148611 Oct 27 04:24:21.085344 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3536/7362] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:24:20 2022] GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:24:22.109305 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7cf7a96e-39d5-446e-b105-0883d35fcc4e tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:24:22.109946 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7cf7a96e-39d5-446e-b105-0883d35fcc4e tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: ee41c278-cfd6-415e-b9e1-0aedf7784a46] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:24:22.116947 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7cf7a96e-39d5-446e-b105-0883d35fcc4e tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:22.117447 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7cf7a96e-39d5-446e-b105-0883d35fcc4e tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:22.117912 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7cf7a96e-39d5-446e-b105-0883d35fcc4e tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:22.118691 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7cf7a96e-39d5-446e-b105-0883d35fcc4e tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:22.119196 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7cf7a96e-39d5-446e-b105-0883d35fcc4e tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:22.119645 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7cf7a96e-39d5-446e-b105-0883d35fcc4e tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:22.246229 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7cf7a96e-39d5-446e-b105-0883d35fcc4e tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:24:22.248606 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:24:22.254667 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7cf7a96e-39d5-446e-b105-0883d35fcc4e tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46" status: 200 len: 1520 microversion: 2.1 time: 0.149806 Oct 27 04:24:22.255249 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3827/7363] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:24:22 2022] GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:24:23.287336 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2f16e393-3916-4607-bf73-03139c3bb0bb tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:24:23.287952 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-2f16e393-3916-4607-bf73-03139c3bb0bb tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: ee41c278-cfd6-415e-b9e1-0aedf7784a46] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:24:23.290721 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=32 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:24:23.295422 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2f16e393-3916-4607-bf73-03139c3bb0bb tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:23.295912 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2f16e393-3916-4607-bf73-03139c3bb0bb tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:23.296356 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2f16e393-3916-4607-bf73-03139c3bb0bb tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:23.297053 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2f16e393-3916-4607-bf73-03139c3bb0bb tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:23.297509 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2f16e393-3916-4607-bf73-03139c3bb0bb tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:23.297937 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2f16e393-3916-4607-bf73-03139c3bb0bb tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:23.300530 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=96 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:24:23.431367 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2f16e393-3916-4607-bf73-03139c3bb0bb tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:24:23.439715 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2f16e393-3916-4607-bf73-03139c3bb0bb tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46" status: 200 len: 1520 microversion: 2.1 time: 0.156272 Oct 27 04:24:23.440234 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3537/7364] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:24:23 2022] GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:24:24.463357 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2334e5ea-daed-4add-bd37-6d86559cfd66 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:24:24.463989 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2334e5ea-daed-4add-bd37-6d86559cfd66 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: ee41c278-cfd6-415e-b9e1-0aedf7784a46] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:24:24.472471 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2334e5ea-daed-4add-bd37-6d86559cfd66 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:24.472972 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2334e5ea-daed-4add-bd37-6d86559cfd66 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:24.473433 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2334e5ea-daed-4add-bd37-6d86559cfd66 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:24.474178 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2334e5ea-daed-4add-bd37-6d86559cfd66 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:24.474648 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2334e5ea-daed-4add-bd37-6d86559cfd66 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:24.475112 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2334e5ea-daed-4add-bd37-6d86559cfd66 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:24.608558 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2334e5ea-daed-4add-bd37-6d86559cfd66 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:24:24.616309 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2334e5ea-daed-4add-bd37-6d86559cfd66 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46" status: 200 len: 1520 microversion: 2.1 time: 0.157320 Oct 27 04:24:24.616895 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3828/7365] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:24:24 2022] GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:24:25.640569 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-164c0234-c587-4525-8491-3aacebac05b5 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:24:25.641194 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-164c0234-c587-4525-8491-3aacebac05b5 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: ee41c278-cfd6-415e-b9e1-0aedf7784a46] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:24:25.648071 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-164c0234-c587-4525-8491-3aacebac05b5 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:25.648565 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-164c0234-c587-4525-8491-3aacebac05b5 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:25.649020 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-164c0234-c587-4525-8491-3aacebac05b5 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:25.649759 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-164c0234-c587-4525-8491-3aacebac05b5 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:25.650257 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-164c0234-c587-4525-8491-3aacebac05b5 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:25.650692 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-164c0234-c587-4525-8491-3aacebac05b5 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:25.781624 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-164c0234-c587-4525-8491-3aacebac05b5 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:24:25.789290 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-164c0234-c587-4525-8491-3aacebac05b5 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46" status: 200 len: 1520 microversion: 2.1 time: 0.153188 Oct 27 04:24:25.789877 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3538/7366] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:24:25 2022] GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:24:26.812687 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-727bba49-3e7b-4c56-b8e3-c2759b8cd376 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:24:26.813324 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-727bba49-3e7b-4c56-b8e3-c2759b8cd376 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: ee41c278-cfd6-415e-b9e1-0aedf7784a46] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:24:26.816024 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=34 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:24:26.820828 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-727bba49-3e7b-4c56-b8e3-c2759b8cd376 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:26.821328 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-727bba49-3e7b-4c56-b8e3-c2759b8cd376 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:26.821784 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-727bba49-3e7b-4c56-b8e3-c2759b8cd376 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:26.822531 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-727bba49-3e7b-4c56-b8e3-c2759b8cd376 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:26.823044 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-727bba49-3e7b-4c56-b8e3-c2759b8cd376 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:26.823485 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-727bba49-3e7b-4c56-b8e3-c2759b8cd376 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:26.953335 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-727bba49-3e7b-4c56-b8e3-c2759b8cd376 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:24:26.962202 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-727bba49-3e7b-4c56-b8e3-c2759b8cd376 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46" status: 200 len: 1520 microversion: 2.1 time: 0.153496 Oct 27 04:24:26.962786 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3829/7367] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:24:26 2022] GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:24:27.986897 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-061e8998-47fa-4dea-8461-20420c2da15c tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:24:27.987525 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-061e8998-47fa-4dea-8461-20420c2da15c tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: ee41c278-cfd6-415e-b9e1-0aedf7784a46] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:24:27.993637 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-061e8998-47fa-4dea-8461-20420c2da15c tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:27.994171 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-061e8998-47fa-4dea-8461-20420c2da15c tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:27.994608 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-061e8998-47fa-4dea-8461-20420c2da15c tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:27.995318 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-061e8998-47fa-4dea-8461-20420c2da15c tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:27.995780 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-061e8998-47fa-4dea-8461-20420c2da15c tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:27.996212 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-061e8998-47fa-4dea-8461-20420c2da15c tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:28.125202 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-061e8998-47fa-4dea-8461-20420c2da15c tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:24:28.132825 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-061e8998-47fa-4dea-8461-20420c2da15c tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46" status: 200 len: 1520 microversion: 2.1 time: 0.150126 Oct 27 04:24:28.133406 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3539/7368] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:24:27 2022] GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:24:29.156876 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-01242ae3-a70f-497b-9d29-98ea1b7bd1bb tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:24:29.157503 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-01242ae3-a70f-497b-9d29-98ea1b7bd1bb tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: ee41c278-cfd6-415e-b9e1-0aedf7784a46] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:24:29.163680 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-01242ae3-a70f-497b-9d29-98ea1b7bd1bb tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:29.164178 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-01242ae3-a70f-497b-9d29-98ea1b7bd1bb tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:29.164634 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-01242ae3-a70f-497b-9d29-98ea1b7bd1bb tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:29.165343 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-01242ae3-a70f-497b-9d29-98ea1b7bd1bb tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:29.165810 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-01242ae3-a70f-497b-9d29-98ea1b7bd1bb tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:29.166285 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-01242ae3-a70f-497b-9d29-98ea1b7bd1bb tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:29.295222 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-01242ae3-a70f-497b-9d29-98ea1b7bd1bb tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:24:29.303431 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-01242ae3-a70f-497b-9d29-98ea1b7bd1bb tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46" status: 200 len: 1520 microversion: 2.1 time: 0.150734 Oct 27 04:24:29.304004 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3830/7369] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:24:29 2022] GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:24:30.314605 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-6cdb043a-b351-4268-83f2-80366b20a847 req-9c7aa9bb-dea6-4cee-8f90-f4d6b6d7c138 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee41c278-cfd6-415e-b9e1-0aedf7784a46", "name": "network-vif-unplugged", "status": "completed", "tag": "98121ee1-4393-4af7-9afb-38c9c5390e23"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:24:30.325315 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-6cdb043a-b351-4268-83f2-80366b20a847 req-9c7aa9bb-dea6-4cee-8f90-f4d6b6d7c138 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:30.325874 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-6cdb043a-b351-4268-83f2-80366b20a847 req-9c7aa9bb-dea6-4cee-8f90-f4d6b6d7c138 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:30.326435 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-6cdb043a-b351-4268-83f2-80366b20a847 req-9c7aa9bb-dea6-4cee-8f90-f4d6b6d7c138 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:30.327026 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-643fd50e-48ea-4c29-8bc1-85d9470c5e5e tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:24:30.327672 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-643fd50e-48ea-4c29-8bc1-85d9470c5e5e tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: ee41c278-cfd6-415e-b9e1-0aedf7784a46] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:24:30.334533 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-643fd50e-48ea-4c29-8bc1-85d9470c5e5e tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:30.335041 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-643fd50e-48ea-4c29-8bc1-85d9470c5e5e tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:30.335502 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-643fd50e-48ea-4c29-8bc1-85d9470c5e5e tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:30.336225 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-643fd50e-48ea-4c29-8bc1-85d9470c5e5e tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:30.336697 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-643fd50e-48ea-4c29-8bc1-85d9470c5e5e tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:30.337146 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-643fd50e-48ea-4c29-8bc1-85d9470c5e5e tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:30.339144 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-6cdb043a-b351-4268-83f2-80366b20a847 req-9c7aa9bb-dea6-4cee-8f90-f4d6b6d7c138 service nova] Creating event network-vif-unplugged:98121ee1-4393-4af7-9afb-38c9c5390e23 for instance ee41c278-cfd6-415e-b9e1-0aedf7784a46 on n-h2-862769-1 Oct 27 04:24:30.344834 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [req-6cdb043a-b351-4268-83f2-80366b20a847 req-9c7aa9bb-dea6-4cee-8f90-f4d6b6d7c138 service nova] Instance ee41c278-cfd6-415e-b9e1-0aedf7784a46 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862769-1', 'n-h1-862769-1'} {{(pid=121000) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 04:24:30.356780 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-6cdb043a-b351-4268-83f2-80366b20a847 req-9c7aa9bb-dea6-4cee-8f90-f4d6b6d7c138 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046584 Oct 27 04:24:30.357394 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3540/7370] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:24:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:24:30.471490 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-643fd50e-48ea-4c29-8bc1-85d9470c5e5e tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:24:30.479850 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-643fd50e-48ea-4c29-8bc1-85d9470c5e5e tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46" status: 200 len: 1519 microversion: 2.1 time: 0.156537 Oct 27 04:24:30.480636 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3831/7371] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:24:30 2022] GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 04:24:31.505270 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b6a51278-7ecb-4621-b330-d46d94475a5c tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:24:31.505976 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b6a51278-7ecb-4621-b330-d46d94475a5c tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: ee41c278-cfd6-415e-b9e1-0aedf7784a46] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:24:31.512963 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b6a51278-7ecb-4621-b330-d46d94475a5c tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:31.513448 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b6a51278-7ecb-4621-b330-d46d94475a5c tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:31.513895 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b6a51278-7ecb-4621-b330-d46d94475a5c tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:31.514624 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b6a51278-7ecb-4621-b330-d46d94475a5c tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:31.515102 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b6a51278-7ecb-4621-b330-d46d94475a5c tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:31.515514 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b6a51278-7ecb-4621-b330-d46d94475a5c tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:31.650653 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b6a51278-7ecb-4621-b330-d46d94475a5c tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:24:31.658451 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b6a51278-7ecb-4621-b330-d46d94475a5c tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46" status: 200 len: 1519 microversion: 2.1 time: 0.158170 Oct 27 04:24:31.659024 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3541/7372] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:24:31 2022] GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:24:32.371416 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-32b7f7df-377c-476e-93f2-3ea703d8258f req-1de68c63-f96f-4f45-9722-741657e4a095 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee41c278-cfd6-415e-b9e1-0aedf7784a46", "tag": "98121ee1-4393-4af7-9afb-38c9c5390e23"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:24:32.381619 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-32b7f7df-377c-476e-93f2-3ea703d8258f req-1de68c63-f96f-4f45-9722-741657e4a095 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:32.382148 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-32b7f7df-377c-476e-93f2-3ea703d8258f req-1de68c63-f96f-4f45-9722-741657e4a095 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:32.382604 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-32b7f7df-377c-476e-93f2-3ea703d8258f req-1de68c63-f96f-4f45-9722-741657e4a095 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:32.394497 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-32b7f7df-377c-476e-93f2-3ea703d8258f req-1de68c63-f96f-4f45-9722-741657e4a095 service nova] Creating event network-changed:98121ee1-4393-4af7-9afb-38c9c5390e23 for instance ee41c278-cfd6-415e-b9e1-0aedf7784a46 on n-h2-862769-1 Oct 27 04:24:32.399807 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [req-32b7f7df-377c-476e-93f2-3ea703d8258f req-1de68c63-f96f-4f45-9722-741657e4a095 service nova] Instance ee41c278-cfd6-415e-b9e1-0aedf7784a46 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862769-1', 'n-h1-862769-1'} {{(pid=121001) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 04:24:32.411244 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-32b7f7df-377c-476e-93f2-3ea703d8258f req-1de68c63-f96f-4f45-9722-741657e4a095 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043477 Oct 27 04:24:32.411826 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3832/7373] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:24:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:24:32.684173 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-22455e44-3a45-4a0f-847d-5f43a155e6e5 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:24:32.688131 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-22455e44-3a45-4a0f-847d-5f43a155e6e5 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: ee41c278-cfd6-415e-b9e1-0aedf7784a46] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:24:32.705633 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-22455e44-3a45-4a0f-847d-5f43a155e6e5 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:32.706476 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-22455e44-3a45-4a0f-847d-5f43a155e6e5 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:32.707114 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-22455e44-3a45-4a0f-847d-5f43a155e6e5 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:32.708083 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-22455e44-3a45-4a0f-847d-5f43a155e6e5 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:32.708552 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-22455e44-3a45-4a0f-847d-5f43a155e6e5 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:32.708995 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-22455e44-3a45-4a0f-847d-5f43a155e6e5 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:32.886729 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-22455e44-3a45-4a0f-847d-5f43a155e6e5 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:24:32.895224 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-22455e44-3a45-4a0f-847d-5f43a155e6e5 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46" status: 200 len: 1517 microversion: 2.1 time: 0.215088 Oct 27 04:24:32.895801 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3542/7374] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:24:32 2022] GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46 => generated 1517 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:24:33.920344 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a7787ade-96cd-405d-a442-2fa20fe9e1f6 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:24:33.920985 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a7787ade-96cd-405d-a442-2fa20fe9e1f6 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: ee41c278-cfd6-415e-b9e1-0aedf7784a46] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:24:33.927247 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a7787ade-96cd-405d-a442-2fa20fe9e1f6 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:33.927748 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a7787ade-96cd-405d-a442-2fa20fe9e1f6 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:33.928204 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a7787ade-96cd-405d-a442-2fa20fe9e1f6 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:33.928915 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a7787ade-96cd-405d-a442-2fa20fe9e1f6 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:33.929392 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a7787ade-96cd-405d-a442-2fa20fe9e1f6 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:33.929839 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a7787ade-96cd-405d-a442-2fa20fe9e1f6 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:34.064841 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a7787ade-96cd-405d-a442-2fa20fe9e1f6 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:24:34.072633 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a7787ade-96cd-405d-a442-2fa20fe9e1f6 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46" status: 200 len: 1514 microversion: 2.1 time: 0.157641 Oct 27 04:24:34.073205 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3833/7375] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:24:33 2022] GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46 => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:24:34.095200 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-fdc3ba42-c9c6-4bce-8b60-2121a8adadfa tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:24:34.095759 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-fdc3ba42-c9c6-4bce-8b60-2121a8adadfa tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: ee41c278-cfd6-415e-b9e1-0aedf7784a46] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:24:34.102570 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fdc3ba42-c9c6-4bce-8b60-2121a8adadfa tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:34.103064 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fdc3ba42-c9c6-4bce-8b60-2121a8adadfa tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:34.103521 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fdc3ba42-c9c6-4bce-8b60-2121a8adadfa tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:34.104238 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fdc3ba42-c9c6-4bce-8b60-2121a8adadfa tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:34.104686 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fdc3ba42-c9c6-4bce-8b60-2121a8adadfa tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:34.105121 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fdc3ba42-c9c6-4bce-8b60-2121a8adadfa tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:34.289408 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-fdc3ba42-c9c6-4bce-8b60-2121a8adadfa tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "POST /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46/action" status: 204 len: 0 microversion: 2.1 time: 0.197922 Oct 27 04:24:34.290096 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3543/7376] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 04:24:34 2022] POST /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46/action => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 04:24:34.298936 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-145ca3aa-d8c2-4424-98aa-c9d060678ef2 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:24:34.299587 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-145ca3aa-d8c2-4424-98aa-c9d060678ef2 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: ee41c278-cfd6-415e-b9e1-0aedf7784a46] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:24:34.305583 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-145ca3aa-d8c2-4424-98aa-c9d060678ef2 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:34.306129 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-145ca3aa-d8c2-4424-98aa-c9d060678ef2 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:34.306588 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-145ca3aa-d8c2-4424-98aa-c9d060678ef2 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:34.307344 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-145ca3aa-d8c2-4424-98aa-c9d060678ef2 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:34.307817 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-145ca3aa-d8c2-4424-98aa-c9d060678ef2 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:34.308277 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-145ca3aa-d8c2-4424-98aa-c9d060678ef2 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:34.469539 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-145ca3aa-d8c2-4424-98aa-c9d060678ef2 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:24:34.477848 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-145ca3aa-d8c2-4424-98aa-c9d060678ef2 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46" status: 200 len: 1514 microversion: 2.1 time: 0.183473 Oct 27 04:24:34.478469 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3834/7377] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:24:34 2022] GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46 => generated 1514 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:24:35.502842 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-cfe52811-b085-4004-bf1e-5b41803ad84e tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:24:35.506778 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-cfe52811-b085-4004-bf1e-5b41803ad84e tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: ee41c278-cfd6-415e-b9e1-0aedf7784a46] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:24:35.509933 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cfe52811-b085-4004-bf1e-5b41803ad84e tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:35.510531 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cfe52811-b085-4004-bf1e-5b41803ad84e tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:35.511047 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cfe52811-b085-4004-bf1e-5b41803ad84e tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:35.511954 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cfe52811-b085-4004-bf1e-5b41803ad84e tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:35.512418 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cfe52811-b085-4004-bf1e-5b41803ad84e tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:35.512855 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cfe52811-b085-4004-bf1e-5b41803ad84e tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:35.593261 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-46cb4add-99a8-4f58-9e20-3c5f217f9dd3 req-0ee36724-5f6f-478f-9207-586b22964513 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee41c278-cfd6-415e-b9e1-0aedf7784a46", "name": "network-vif-plugged", "status": "completed", "tag": "98121ee1-4393-4af7-9afb-38c9c5390e23"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:24:35.610072 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-46cb4add-99a8-4f58-9e20-3c5f217f9dd3 req-0ee36724-5f6f-478f-9207-586b22964513 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:35.610628 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-46cb4add-99a8-4f58-9e20-3c5f217f9dd3 req-0ee36724-5f6f-478f-9207-586b22964513 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:35.611209 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-46cb4add-99a8-4f58-9e20-3c5f217f9dd3 req-0ee36724-5f6f-478f-9207-586b22964513 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:35.624933 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-46cb4add-99a8-4f58-9e20-3c5f217f9dd3 req-0ee36724-5f6f-478f-9207-586b22964513 service nova] Creating event network-vif-plugged:98121ee1-4393-4af7-9afb-38c9c5390e23 for instance ee41c278-cfd6-415e-b9e1-0aedf7784a46 on n-h2-862769-1 Oct 27 04:24:35.630984 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [req-46cb4add-99a8-4f58-9e20-3c5f217f9dd3 req-0ee36724-5f6f-478f-9207-586b22964513 service nova] Instance ee41c278-cfd6-415e-b9e1-0aedf7784a46 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862769-1', 'n-h1-862769-1'} {{(pid=121001) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 04:24:35.642513 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-46cb4add-99a8-4f58-9e20-3c5f217f9dd3 req-0ee36724-5f6f-478f-9207-586b22964513 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053815 Oct 27 04:24:35.644273 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3835/7378] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:24:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:24:35.655304 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-cfe52811-b085-4004-bf1e-5b41803ad84e tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:24:35.663701 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-cfe52811-b085-4004-bf1e-5b41803ad84e tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46" status: 200 len: 1514 microversion: 2.1 time: 0.166686 Oct 27 04:24:35.664287 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3544/7379] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:24:35 2022] GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46 => generated 1514 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:24:36.689000 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-88df8490-640c-418c-b7c0-a80f94bfdc40 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:24:36.689714 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-88df8490-640c-418c-b7c0-a80f94bfdc40 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: ee41c278-cfd6-415e-b9e1-0aedf7784a46] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:24:36.696850 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-88df8490-640c-418c-b7c0-a80f94bfdc40 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:36.697347 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-88df8490-640c-418c-b7c0-a80f94bfdc40 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:36.697801 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-88df8490-640c-418c-b7c0-a80f94bfdc40 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:36.698540 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-88df8490-640c-418c-b7c0-a80f94bfdc40 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:36.699013 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-88df8490-640c-418c-b7c0-a80f94bfdc40 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:36.699457 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-88df8490-640c-418c-b7c0-a80f94bfdc40 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:36.832747 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-88df8490-640c-418c-b7c0-a80f94bfdc40 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:24:36.840707 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-88df8490-640c-418c-b7c0-a80f94bfdc40 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46" status: 200 len: 1506 microversion: 2.1 time: 0.156518 Oct 27 04:24:36.841294 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3836/7380] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:24:36 2022] GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46 => generated 1506 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:24:36.863576 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f6f7147c-e229-4091-a32c-32af660b6179 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:24:36.864203 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f6f7147c-e229-4091-a32c-32af660b6179 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: ee41c278-cfd6-415e-b9e1-0aedf7784a46] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:24:36.871534 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f6f7147c-e229-4091-a32c-32af660b6179 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:36.872027 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f6f7147c-e229-4091-a32c-32af660b6179 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:36.872475 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f6f7147c-e229-4091-a32c-32af660b6179 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:36.873177 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f6f7147c-e229-4091-a32c-32af660b6179 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:36.873640 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f6f7147c-e229-4091-a32c-32af660b6179 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:36.874105 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f6f7147c-e229-4091-a32c-32af660b6179 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:37.007229 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f6f7147c-e229-4091-a32c-32af660b6179 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:24:37.015206 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f6f7147c-e229-4091-a32c-32af660b6179 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46" status: 200 len: 1506 microversion: 2.1 time: 0.156098 Oct 27 04:24:37.015802 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3545/7381] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:24:36 2022] GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46 => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 04:24:37.042895 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7315c809-ff5c-4a99-abe6-add8f54b70dc tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:24:37.043474 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7315c809-ff5c-4a99-abe6-add8f54b70dc tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: ee41c278-cfd6-415e-b9e1-0aedf7784a46] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:24:37.049952 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7315c809-ff5c-4a99-abe6-add8f54b70dc tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:37.050496 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7315c809-ff5c-4a99-abe6-add8f54b70dc tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:37.050960 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7315c809-ff5c-4a99-abe6-add8f54b70dc tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:37.051681 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7315c809-ff5c-4a99-abe6-add8f54b70dc tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:37.052158 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7315c809-ff5c-4a99-abe6-add8f54b70dc tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:37.052610 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7315c809-ff5c-4a99-abe6-add8f54b70dc tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:37.179163 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7315c809-ff5c-4a99-abe6-add8f54b70dc tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:24:37.187050 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7315c809-ff5c-4a99-abe6-add8f54b70dc tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46" status: 200 len: 1506 microversion: 2.1 time: 0.148232 Oct 27 04:24:37.187685 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3837/7382] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:24:37 2022] GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46 => generated 1506 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:24:37.209165 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-852c27d1-0b85-4c38-88b4-3e3c7292fcd6 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:24:37.209674 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-852c27d1-0b85-4c38-88b4-3e3c7292fcd6 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: ee41c278-cfd6-415e-b9e1-0aedf7784a46] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:24:37.215951 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-852c27d1-0b85-4c38-88b4-3e3c7292fcd6 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:37.216443 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-852c27d1-0b85-4c38-88b4-3e3c7292fcd6 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:37.216891 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-852c27d1-0b85-4c38-88b4-3e3c7292fcd6 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:37.217619 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-852c27d1-0b85-4c38-88b4-3e3c7292fcd6 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:37.218108 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-852c27d1-0b85-4c38-88b4-3e3c7292fcd6 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:37.218544 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-852c27d1-0b85-4c38-88b4-3e3c7292fcd6 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:37.243895 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-852c27d1-0b85-4c38-88b4-3e3c7292fcd6 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: ee41c278-cfd6-415e-b9e1-0aedf7784a46] Going to try to terminate instance {{(pid=121000) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 04:24:37.504464 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-852c27d1-0b85-4c38-88b4-3e3c7292fcd6 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46" status: 204 len: 0 microversion: 2.1 time: 0.298864 Oct 27 04:24:37.505075 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3546/7383] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 04:24:37 2022] DELETE /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 04:24:37.524142 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4ca6f4e9-4fd3-437d-b077-0155e69b73c7 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:24:37.524654 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4ca6f4e9-4fd3-437d-b077-0155e69b73c7 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: ee41c278-cfd6-415e-b9e1-0aedf7784a46] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:24:37.530622 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4ca6f4e9-4fd3-437d-b077-0155e69b73c7 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:37.531126 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4ca6f4e9-4fd3-437d-b077-0155e69b73c7 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:37.532198 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4ca6f4e9-4fd3-437d-b077-0155e69b73c7 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:37.532901 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4ca6f4e9-4fd3-437d-b077-0155e69b73c7 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:37.533366 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4ca6f4e9-4fd3-437d-b077-0155e69b73c7 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:37.533808 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4ca6f4e9-4fd3-437d-b077-0155e69b73c7 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:37.587721 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4ca6f4e9-4fd3-437d-b077-0155e69b73c7 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: ee41c278-cfd6-415e-b9e1-0aedf7784a46] Going to try to terminate instance {{(pid=121001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 04:24:37.698580 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.compute.api [None req-4ca6f4e9-4fd3-437d-b077-0155e69b73c7 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: ee41c278-cfd6-415e-b9e1-0aedf7784a46] Instance is already in deleting state, ignoring this request Oct 27 04:24:37.699444 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4ca6f4e9-4fd3-437d-b077-0155e69b73c7 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46" status: 204 len: 0 microversion: 2.1 time: 0.179190 Oct 27 04:24:37.700022 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3838/7384] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 04:24:37 2022] DELETE /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 04:24:37.709413 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1d569a64-716e-4e8a-8d8d-1742f2b0b4d5 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:24:37.710108 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1d569a64-716e-4e8a-8d8d-1742f2b0b4d5 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: ee41c278-cfd6-415e-b9e1-0aedf7784a46] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:24:37.716286 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1d569a64-716e-4e8a-8d8d-1742f2b0b4d5 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:37.716776 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1d569a64-716e-4e8a-8d8d-1742f2b0b4d5 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:37.717213 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1d569a64-716e-4e8a-8d8d-1742f2b0b4d5 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:37.717909 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1d569a64-716e-4e8a-8d8d-1742f2b0b4d5 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:37.718432 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1d569a64-716e-4e8a-8d8d-1742f2b0b4d5 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:37.719454 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1d569a64-716e-4e8a-8d8d-1742f2b0b4d5 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:37.846835 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1d569a64-716e-4e8a-8d8d-1742f2b0b4d5 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:24:37.854587 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1d569a64-716e-4e8a-8d8d-1742f2b0b4d5 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46" status: 200 len: 1512 microversion: 2.1 time: 0.149590 Oct 27 04:24:37.855245 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3547/7385] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:24:37 2022] GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46 => generated 1512 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:24:38.879097 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5a50be4b-c6bd-4871-b337-65957cdb8230 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:24:38.879550 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5a50be4b-c6bd-4871-b337-65957cdb8230 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: ee41c278-cfd6-415e-b9e1-0aedf7784a46] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:24:38.887077 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5a50be4b-c6bd-4871-b337-65957cdb8230 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:38.887587 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5a50be4b-c6bd-4871-b337-65957cdb8230 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:38.888050 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5a50be4b-c6bd-4871-b337-65957cdb8230 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:38.888804 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5a50be4b-c6bd-4871-b337-65957cdb8230 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:38.889285 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5a50be4b-c6bd-4871-b337-65957cdb8230 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:38.889736 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5a50be4b-c6bd-4871-b337-65957cdb8230 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:39.022747 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5a50be4b-c6bd-4871-b337-65957cdb8230 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0482d6b66ea34d34bed74fac32f55068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f53f549cce04ce78df9a4b68ec35177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:24:39.030612 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5a50be4b-c6bd-4871-b337-65957cdb8230 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46" status: 200 len: 1512 microversion: 2.1 time: 0.156641 Oct 27 04:24:39.031224 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3839/7386] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:24:38 2022] GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46 => generated 1512 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:24:39.354132 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-166d2317-dbdf-4dd0-8625-68025d75c1ac req-ed3ab3fc-d219-4c15-a96e-1ca8097d99b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee41c278-cfd6-415e-b9e1-0aedf7784a46", "name": "network-vif-deleted", "tag": "98121ee1-4393-4af7-9afb-38c9c5390e23"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:24:39.365837 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-166d2317-dbdf-4dd0-8625-68025d75c1ac req-ed3ab3fc-d219-4c15-a96e-1ca8097d99b0 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:39.366356 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-166d2317-dbdf-4dd0-8625-68025d75c1ac req-ed3ab3fc-d219-4c15-a96e-1ca8097d99b0 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:39.366803 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-166d2317-dbdf-4dd0-8625-68025d75c1ac req-ed3ab3fc-d219-4c15-a96e-1ca8097d99b0 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:39.379630 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-166d2317-dbdf-4dd0-8625-68025d75c1ac req-ed3ab3fc-d219-4c15-a96e-1ca8097d99b0 service nova] Creating event network-vif-deleted:98121ee1-4393-4af7-9afb-38c9c5390e23 for instance ee41c278-cfd6-415e-b9e1-0aedf7784a46 on n-h2-862769-1 Oct 27 04:24:39.383716 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-166d2317-dbdf-4dd0-8625-68025d75c1ac req-ed3ab3fc-d219-4c15-a96e-1ca8097d99b0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033575 Oct 27 04:24:39.384679 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3548/7387] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:24:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:24:40.054628 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8e5f7569-004b-40ef-8d9b-b82bc196796a tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:24:40.055176 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8e5f7569-004b-40ef-8d9b-b82bc196796a tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: ee41c278-cfd6-415e-b9e1-0aedf7784a46] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:24:40.061988 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8e5f7569-004b-40ef-8d9b-b82bc196796a tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:40.062519 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8e5f7569-004b-40ef-8d9b-b82bc196796a tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:40.062978 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8e5f7569-004b-40ef-8d9b-b82bc196796a tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:40.064187 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8e5f7569-004b-40ef-8d9b-b82bc196796a tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:40.064657 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8e5f7569-004b-40ef-8d9b-b82bc196796a tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:40.065101 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8e5f7569-004b-40ef-8d9b-b82bc196796a tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:40.078558 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-8e5f7569-004b-40ef-8d9b-b82bc196796a tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] HTTP exception thrown: Instance ee41c278-cfd6-415e-b9e1-0aedf7784a46 could not be found. Oct 27 04:24:40.080842 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8e5f7569-004b-40ef-8d9b-b82bc196796a tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Request method failure captured: Oct 27 04:24:40.080842 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46 HTTP/1.1 Oct 27 04:24:40.080842 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 04:24:40.080842 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 04:24:40.080842 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 04:24:40.080842 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 04:24:40.080842 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 04:24:40.080842 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 04:24:40.080842 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 04:24:40.080842 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 04:24:40.080842 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWgeX-Gty6eCcP9yZORxvTynQlDUPbjDUIRnyBWuXtbO9J6m4aoZDONZBN-QGXztNLuY_COUegXuDthzY9IoM0zr5iSPwKJ6zUA2PZMMKTjKbGcUWYVjsoYZEATv5coHBdMbojm7ckMqvc67BlC8PHdAjnm5UoNc6ft_E__PeErsHkZY Oct 27 04:24:40.080842 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 04:24:40.080842 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 04:24:40.080842 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 04:24:40.080842 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 04:24:40.080842 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 04:24:40.080842 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 04:24:40.080842 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 8f53f549cce04ce78df9a4b68ec35177 Oct 27 04:24:40.080842 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1325563780 Oct 27 04:24:40.080842 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 04:24:40.080842 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 04:24:40.080842 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8f53f549cce04ce78df9a4b68ec35177"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8f53f549cce04ce78df9a4b68ec35177"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8f53f549cce04ce78df9a4b68ec35177"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8f53f549cce04ce78df9a4b68ec35177"}]}] Oct 27 04:24:40.080842 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServerDiskConfigTestJSON-1325563780 Oct 27 04:24:40.080842 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 8f53f549cce04ce78df9a4b68ec35177 Oct 27 04:24:40.080842 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1325563780 Oct 27 04:24:40.080842 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServerDiskConfigTestJSON-1325563780-project Oct 27 04:24:40.080842 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 04:24:40.080842 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 04:24:40.080842 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 0482d6b66ea34d34bed74fac32f55068 Oct 27 04:24:40.080842 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServerDiskConfigTestJSON-1325563780-project Oct 27 04:24:40.080842 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 04:24:40.080842 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance ee41c278-cfd6-415e-b9e1-0aedf7784a46 could not be found. Oct 27 04:24:40.080842 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': 'ee41c278-cfd6-415e-b9e1-0aedf7784a46'} Oct 27 04:24:40.080842 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 04:24:40.080842 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:24:40.080842 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 04:24:40.080842 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 04:24:40.080842 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 04:24:40.080842 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 04:24:40.080842 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 04:24:40.080842 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 04:24:40.080842 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 04:24:40.080842 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 04:24:40.080842 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee41c278-cfd6-415e-b9e1-0aedf7784a46 could not be found. Oct 27 04:24:40.080842 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:24:40.080842 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:24:40.080842 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:24:40.080842 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:24:40.080842 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:24:40.080842 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:24:40.080842 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 04:24:40.080842 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 04:24:40.080842 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 04:24:40.080842 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 04:24:40.080842 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 04:24:40.080842 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 04:24:40.080842 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 04:24:40.080842 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 04:24:40.080842 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 04:24:40.080842 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 04:24:40.080842 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee41c278-cfd6-415e-b9e1-0aedf7784a46 could not be found. Oct 27 04:24:40.080842 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:24:40.080842 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:24:40.080842 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:24:40.085486 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:24:40.085486 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:24:40.085486 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:24:40.085486 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 04:24:40.085486 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 04:24:40.085486 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee41c278-cfd6-415e-b9e1-0aedf7784a46 could not be found. Oct 27 04:24:40.085486 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:24:40.085486 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8e5f7569-004b-40ef-8d9b-b82bc196796a tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Returning 404 to user: Instance ee41c278-cfd6-415e-b9e1-0aedf7784a46 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 04:24:40.085486 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8e5f7569-004b-40ef-8d9b-b82bc196796a tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46" status: 404 len: 111 microversion: 2.1 time: 0.031723 Oct 27 04:24:40.085486 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3840/7388] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:24:40 2022] GET /compute/v2.1/servers/ee41c278-cfd6-415e-b9e1-0aedf7784a46 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 04:24:40.091914 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-edd07653-8c0a-4843-b065-ea51cc30f476 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '.version_select at 0x7f7dda180280>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:24:40.183931 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-edd07653-8c0a-4843-b065-ea51cc30f476 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1864666895" status: 202 len: 0 microversion: 2.1 time: 0.096564 Oct 27 04:24:40.184535 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3549/7389] 10.222.0.20 () {58 vars in 1221 bytes} [Thu Oct 27 04:24:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1864666895 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 04:24:40.908644 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5ec47b8c-3b93-41a1-aad9-e2f12233fee7 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:24:40.909158 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5ec47b8c-3b93-41a1-aad9-e2f12233fee7 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: 6c6d7869-b37b-4108-ac89-2bca489f4a1f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:24:40.915160 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5ec47b8c-3b93-41a1-aad9-e2f12233fee7 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:40.915658 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5ec47b8c-3b93-41a1-aad9-e2f12233fee7 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:40.916118 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5ec47b8c-3b93-41a1-aad9-e2f12233fee7 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:40.916819 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5ec47b8c-3b93-41a1-aad9-e2f12233fee7 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:40.917289 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5ec47b8c-3b93-41a1-aad9-e2f12233fee7 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:40.917730 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5ec47b8c-3b93-41a1-aad9-e2f12233fee7 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:40.931492 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-5ec47b8c-3b93-41a1-aad9-e2f12233fee7 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] HTTP exception thrown: Instance 6c6d7869-b37b-4108-ac89-2bca489f4a1f could not be found. Oct 27 04:24:40.933098 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5ec47b8c-3b93-41a1-aad9-e2f12233fee7 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Request method failure captured: Oct 27 04:24:40.933098 n-d-862769-1 devstack@n-api.service[121001]: request: DELETE /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f HTTP/1.1 Oct 27 04:24:40.933098 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 04:24:40.933098 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 04:24:40.933098 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 04:24:40.933098 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 04:24:40.933098 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 04:24:40.933098 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 04:24:40.933098 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 04:24:40.933098 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 04:24:40.933098 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWgeX-Gty6eCcP9yZORxvTynQlDUPbjDUIRnyBWuXtbO9J6m4aoZDONZBN-QGXztNLuY_COUegXuDthzY9IoM0zr5iSPwKJ6zUA2PZMMKTjKbGcUWYVjsoYZEATv5coHBdMbojm7ckMqvc67BlC8PHdAjnm5UoNc6ft_E__PeErsHkZY Oct 27 04:24:40.933098 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 04:24:40.933098 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 04:24:40.933098 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 04:24:40.933098 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 04:24:40.933098 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 04:24:40.933098 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 04:24:40.933098 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 8f53f549cce04ce78df9a4b68ec35177 Oct 27 04:24:40.933098 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1325563780 Oct 27 04:24:40.933098 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 04:24:40.933098 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 04:24:40.933098 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8f53f549cce04ce78df9a4b68ec35177"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8f53f549cce04ce78df9a4b68ec35177"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8f53f549cce04ce78df9a4b68ec35177"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8f53f549cce04ce78df9a4b68ec35177"}]}] Oct 27 04:24:40.933098 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServerDiskConfigTestJSON-1325563780 Oct 27 04:24:40.933098 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 8f53f549cce04ce78df9a4b68ec35177 Oct 27 04:24:40.933098 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1325563780 Oct 27 04:24:40.933098 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServerDiskConfigTestJSON-1325563780-project Oct 27 04:24:40.933098 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 04:24:40.933098 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 04:24:40.933098 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 0482d6b66ea34d34bed74fac32f55068 Oct 27 04:24:40.933098 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServerDiskConfigTestJSON-1325563780-project Oct 27 04:24:40.933098 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 04:24:40.933098 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 6c6d7869-b37b-4108-ac89-2bca489f4a1f could not be found. Oct 27 04:24:40.933098 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '6c6d7869-b37b-4108-ac89-2bca489f4a1f'} Oct 27 04:24:40.933098 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 04:24:40.933098 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:24:40.933098 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 04:24:40.933098 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 04:24:40.933098 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 04:24:40.933098 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 04:24:40.933098 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 04:24:40.933098 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 04:24:40.933098 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 04:24:40.933098 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 04:24:40.933098 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c6d7869-b37b-4108-ac89-2bca489f4a1f could not be found. Oct 27 04:24:40.933098 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:24:40.933098 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:24:40.933098 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:24:40.933098 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:24:40.933098 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:24:40.933098 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:24:40.933098 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 04:24:40.933098 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 04:24:40.933098 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 04:24:40.933098 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 04:24:40.933098 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 04:24:40.933098 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 04:24:40.933098 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 04:24:40.933098 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 04:24:40.933098 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 04:24:40.933098 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 04:24:40.933098 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 04:24:40.933098 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 04:24:40.938087 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c6d7869-b37b-4108-ac89-2bca489f4a1f could not be found. Oct 27 04:24:40.938087 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:24:40.938087 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:24:40.938087 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:24:40.938087 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:24:40.938087 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:24:40.938087 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:24:40.938087 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 04:24:40.938087 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 04:24:40.938087 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c6d7869-b37b-4108-ac89-2bca489f4a1f could not be found. Oct 27 04:24:40.938087 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:24:40.938087 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5ec47b8c-3b93-41a1-aad9-e2f12233fee7 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Returning 404 to user: Instance 6c6d7869-b37b-4108-ac89-2bca489f4a1f could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 04:24:40.938087 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5ec47b8c-3b93-41a1-aad9-e2f12233fee7 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f" status: 404 len: 111 microversion: 2.1 time: 0.029799 Oct 27 04:24:40.938087 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3841/7390] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 04:24:40 2022] DELETE /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 04:24:40.944539 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4b6aa538-40d3-444e-9587-33e1d9c7c6d8 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:24:40.945297 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4b6aa538-40d3-444e-9587-33e1d9c7c6d8 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] [instance: 6c6d7869-b37b-4108-ac89-2bca489f4a1f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:24:40.951995 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4b6aa538-40d3-444e-9587-33e1d9c7c6d8 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:40.952487 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4b6aa538-40d3-444e-9587-33e1d9c7c6d8 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:40.952941 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4b6aa538-40d3-444e-9587-33e1d9c7c6d8 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:40.953640 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4b6aa538-40d3-444e-9587-33e1d9c7c6d8 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:40.954134 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4b6aa538-40d3-444e-9587-33e1d9c7c6d8 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:40.954572 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4b6aa538-40d3-444e-9587-33e1d9c7c6d8 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:40.967811 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-4b6aa538-40d3-444e-9587-33e1d9c7c6d8 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] HTTP exception thrown: Instance 6c6d7869-b37b-4108-ac89-2bca489f4a1f could not be found. Oct 27 04:24:40.969443 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4b6aa538-40d3-444e-9587-33e1d9c7c6d8 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Request method failure captured: Oct 27 04:24:40.969443 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f HTTP/1.1 Oct 27 04:24:40.969443 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 04:24:40.969443 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 04:24:40.969443 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 04:24:40.969443 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 04:24:40.969443 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 04:24:40.969443 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 04:24:40.969443 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 04:24:40.969443 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 04:24:40.969443 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWgeX-Gty6eCcP9yZORxvTynQlDUPbjDUIRnyBWuXtbO9J6m4aoZDONZBN-QGXztNLuY_COUegXuDthzY9IoM0zr5iSPwKJ6zUA2PZMMKTjKbGcUWYVjsoYZEATv5coHBdMbojm7ckMqvc67BlC8PHdAjnm5UoNc6ft_E__PeErsHkZY Oct 27 04:24:40.969443 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 04:24:40.969443 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 04:24:40.969443 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 04:24:40.969443 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 04:24:40.969443 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 04:24:40.969443 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 04:24:40.969443 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 8f53f549cce04ce78df9a4b68ec35177 Oct 27 04:24:40.969443 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1325563780 Oct 27 04:24:40.969443 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 04:24:40.969443 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 04:24:40.969443 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8f53f549cce04ce78df9a4b68ec35177"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8f53f549cce04ce78df9a4b68ec35177"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8f53f549cce04ce78df9a4b68ec35177"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8f53f549cce04ce78df9a4b68ec35177"}]}] Oct 27 04:24:40.969443 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ServerDiskConfigTestJSON-1325563780 Oct 27 04:24:40.969443 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 8f53f549cce04ce78df9a4b68ec35177 Oct 27 04:24:40.969443 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1325563780 Oct 27 04:24:40.969443 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ServerDiskConfigTestJSON-1325563780-project Oct 27 04:24:40.969443 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 04:24:40.969443 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 04:24:40.969443 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 0482d6b66ea34d34bed74fac32f55068 Oct 27 04:24:40.969443 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ServerDiskConfigTestJSON-1325563780-project Oct 27 04:24:40.969443 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 04:24:40.969443 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 6c6d7869-b37b-4108-ac89-2bca489f4a1f could not be found. Oct 27 04:24:40.969443 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '6c6d7869-b37b-4108-ac89-2bca489f4a1f'} Oct 27 04:24:40.969443 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 04:24:40.969443 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:24:40.969443 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 04:24:40.969443 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 04:24:40.969443 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 04:24:40.969443 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 04:24:40.969443 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 04:24:40.969443 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 04:24:40.969443 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 04:24:40.969443 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 04:24:40.969443 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c6d7869-b37b-4108-ac89-2bca489f4a1f could not be found. Oct 27 04:24:40.969443 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:24:40.969443 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:24:40.969443 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:24:40.969443 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:24:40.969443 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:24:40.969443 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:24:40.969443 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 04:24:40.969443 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 04:24:40.969443 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 04:24:40.969443 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 04:24:40.969443 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 04:24:40.969443 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 04:24:40.969443 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 04:24:40.969443 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 04:24:40.969443 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 04:24:40.969443 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 04:24:40.969443 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c6d7869-b37b-4108-ac89-2bca489f4a1f could not be found. Oct 27 04:24:40.969443 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:24:40.969443 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:24:40.969443 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:24:40.974063 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:24:40.974063 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:24:40.974063 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:24:40.974063 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 04:24:40.974063 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 04:24:40.974063 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c6d7869-b37b-4108-ac89-2bca489f4a1f could not be found. Oct 27 04:24:40.974063 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:24:40.974063 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4b6aa538-40d3-444e-9587-33e1d9c7c6d8 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] Returning 404 to user: Instance 6c6d7869-b37b-4108-ac89-2bca489f4a1f could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 04:24:40.974063 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4b6aa538-40d3-444e-9587-33e1d9c7c6d8 tempest-ServerDiskConfigTestJSON-1325563780 tempest-ServerDiskConfigTestJSON-1325563780-project] 10.222.0.20 "GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f" status: 404 len: 111 microversion: 2.1 time: 0.031197 Oct 27 04:24:40.974063 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3550/7391] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:24:40 2022] GET /compute/v2.1/servers/6c6d7869-b37b-4108-ac89-2bca489f4a1f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 04:24:51.712061 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=25 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:24:51.712829 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:24:51.836718 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3bb8f7f7-2106-496c-802d-e22b499e7f42 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Action: 'create', calling method: .version_select at 0x7f7dd8436ee0>, body: {"keypair": {"name": "tempest-keypair-673070032", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBElN+GKnPhhlKma5VMf8FB/NrpdCE9EnsA+TyZ+uuLr1ahZVZ7GybIpnSaIuAS5sGASOjmT5705TgIUYbuvYJBboQ19UudQUpgCvvcpaGfj5WqfzU2n1JJdmy9xCdP/zHQ=="}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:24:51.854577 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-3bb8f7f7-2106-496c-802d-e22b499e7f42 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Getting quotas for project 529ab4a5a66947aebb3f09a9842e5c9f. Resources: {'key_pairs'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 04:24:51.861514 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-3bb8f7f7-2106-496c-802d-e22b499e7f42 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Getting quotas for user 197669776fde4a6480f6cab6e5c8552f and project 529ab4a5a66947aebb3f09a9842e5c9f. Resources: {'key_pairs'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 04:24:51.949508 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3bb8f7f7-2106-496c-802d-e22b499e7f42 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.243368 Oct 27 04:24:51.950588 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3842/7392] 10.222.0.20 () {60 vars in 1159 bytes} [Thu Oct 27 04:24:51 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:24:54.187210 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-91b3a975-c17b-4bdc-b736-7cbf0684f1a7 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-682125631", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0b9e776d-e4d4-4487-af56-34380c1641ff"}], "security_groups": [{"name": "tempest-securitygroup--204964459"}], "key_name": "tempest-keypair-673070032", "user_data": "}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:24:54.197034 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:24:54.197532 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:24:54.297227 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-91b3a975-c17b-4bdc-b736-7cbf0684f1a7 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] validate_networks() for [('0b9e776d-e4d4-4487-af56-34380c1641ff', None, None, None, None, None)] {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 04:24:54.693335 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-91b3a975-c17b-4bdc-b736-7cbf0684f1a7 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 04:24:54.693772 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-91b3a975-c17b-4bdc-b736-7cbf0684f1a7 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 04:24:54.694462 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-91b3a975-c17b-4bdc-b736-7cbf0684f1a7 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 04:24:54.694895 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-91b3a975-c17b-4bdc-b736-7cbf0684f1a7 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 04:24:54.695513 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-91b3a975-c17b-4bdc-b736-7cbf0684f1a7 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 04:24:54.705124 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-91b3a975-c17b-4bdc-b736-7cbf0684f1a7 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:54.705613 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-91b3a975-c17b-4bdc-b736-7cbf0684f1a7 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:54.706267 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-91b3a975-c17b-4bdc-b736-7cbf0684f1a7 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:54.711781 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-91b3a975-c17b-4bdc-b736-7cbf0684f1a7 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:54.711781 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-91b3a975-c17b-4bdc-b736-7cbf0684f1a7 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:54.711781 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-91b3a975-c17b-4bdc-b736-7cbf0684f1a7 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:54.726492 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-91b3a975-c17b-4bdc-b736-7cbf0684f1a7 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Getting quotas for project 529ab4a5a66947aebb3f09a9842e5c9f. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 04:24:54.733043 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-91b3a975-c17b-4bdc-b736-7cbf0684f1a7 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Getting quotas for user 197669776fde4a6480f6cab6e5c8552f and project 529ab4a5a66947aebb3f09a9842e5c9f. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 04:24:54.745807 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-91b3a975-c17b-4bdc-b736-7cbf0684f1a7 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 04:24:54.748183 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-91b3a975-c17b-4bdc-b736-7cbf0684f1a7 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 2490098c-642b-48ba-9d81-510e1c2942cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 04:24:54.871491 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-91b3a975-c17b-4bdc-b736-7cbf0684f1a7 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.688395 Oct 27 04:24:54.879648 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3551/7393] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 04:24:54 2022] POST /compute/v2.1/servers => generated 408 bytes in 697 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 04:24:54.885216 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a93c5a44-dd66-4f33-ad96-9a02151be469 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:24:54.886971 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a93c5a44-dd66-4f33-ad96-9a02151be469 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 2490098c-642b-48ba-9d81-510e1c2942cb] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:24:54.968628 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a93c5a44-dd66-4f33-ad96-9a02151be469 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:24:54.978880 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a93c5a44-dd66-4f33-ad96-9a02151be469 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb" status: 200 len: 1237 microversion: 2.1 time: 0.098025 Oct 27 04:24:54.980612 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3843/7394] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:24:54 2022] GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb => generated 1237 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:24:56.002612 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a613515e-f7a4-428a-9b89-d587c92ff95d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:24:56.003234 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a613515e-f7a4-428a-9b89-d587c92ff95d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 2490098c-642b-48ba-9d81-510e1c2942cb] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:24:56.012690 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a613515e-f7a4-428a-9b89-d587c92ff95d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:56.013183 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a613515e-f7a4-428a-9b89-d587c92ff95d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:56.013629 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a613515e-f7a4-428a-9b89-d587c92ff95d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:56.014369 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a613515e-f7a4-428a-9b89-d587c92ff95d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:56.014831 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a613515e-f7a4-428a-9b89-d587c92ff95d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:56.015272 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a613515e-f7a4-428a-9b89-d587c92ff95d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:56.083853 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a613515e-f7a4-428a-9b89-d587c92ff95d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:24:56.091990 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a613515e-f7a4-428a-9b89-d587c92ff95d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb" status: 200 len: 1241 microversion: 2.1 time: 0.093349 Oct 27 04:24:56.092571 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3552/7395] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:24:55 2022] GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb => generated 1241 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:24:57.117406 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a1073b9b-9a1f-4beb-bcb5-6fed307e9877 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:24:57.122350 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a1073b9b-9a1f-4beb-bcb5-6fed307e9877 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 2490098c-642b-48ba-9d81-510e1c2942cb] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:24:57.125624 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a1073b9b-9a1f-4beb-bcb5-6fed307e9877 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:57.126207 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a1073b9b-9a1f-4beb-bcb5-6fed307e9877 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:57.126676 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a1073b9b-9a1f-4beb-bcb5-6fed307e9877 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:57.127397 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a1073b9b-9a1f-4beb-bcb5-6fed307e9877 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:57.127876 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a1073b9b-9a1f-4beb-bcb5-6fed307e9877 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:57.128331 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a1073b9b-9a1f-4beb-bcb5-6fed307e9877 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:57.195111 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a1073b9b-9a1f-4beb-bcb5-6fed307e9877 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:24:57.202920 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a1073b9b-9a1f-4beb-bcb5-6fed307e9877 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb" status: 200 len: 1289 microversion: 2.1 time: 0.089390 Oct 27 04:24:57.203497 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3844/7396] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:24:57 2022] GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb => generated 1289 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:24:58.226903 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-90fe2f2c-2caf-426e-8bbb-9faf0fdb7133 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:24:58.227769 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-90fe2f2c-2caf-426e-8bbb-9faf0fdb7133 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 2490098c-642b-48ba-9d81-510e1c2942cb] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:24:58.233797 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-90fe2f2c-2caf-426e-8bbb-9faf0fdb7133 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:58.234281 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-90fe2f2c-2caf-426e-8bbb-9faf0fdb7133 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:58.234735 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-90fe2f2c-2caf-426e-8bbb-9faf0fdb7133 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:58.235986 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-90fe2f2c-2caf-426e-8bbb-9faf0fdb7133 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:58.236454 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-90fe2f2c-2caf-426e-8bbb-9faf0fdb7133 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:58.236890 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-90fe2f2c-2caf-426e-8bbb-9faf0fdb7133 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:58.380431 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-90fe2f2c-2caf-426e-8bbb-9faf0fdb7133 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:24:58.388920 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-90fe2f2c-2caf-426e-8bbb-9faf0fdb7133 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb" status: 200 len: 1362 microversion: 2.1 time: 0.166348 Oct 27 04:24:58.389496 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3553/7397] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:24:58 2022] GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 04:24:59.057009 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-ab9d6248-1edb-4b0a-8f03-d40dc538387c req-a112f9f6-7bc5-4e39-b665-1a9d742d3dbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2490098c-642b-48ba-9d81-510e1c2942cb", "tag": "c8e780bf-9d0c-4f31-b3ba-a0f5191170a1"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:24:59.067030 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-ab9d6248-1edb-4b0a-8f03-d40dc538387c req-a112f9f6-7bc5-4e39-b665-1a9d742d3dbc service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:59.067589 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-ab9d6248-1edb-4b0a-8f03-d40dc538387c req-a112f9f6-7bc5-4e39-b665-1a9d742d3dbc service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:59.068048 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-ab9d6248-1edb-4b0a-8f03-d40dc538387c req-a112f9f6-7bc5-4e39-b665-1a9d742d3dbc service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:59.079709 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-ab9d6248-1edb-4b0a-8f03-d40dc538387c req-a112f9f6-7bc5-4e39-b665-1a9d742d3dbc service nova] Creating event network-changed:c8e780bf-9d0c-4f31-b3ba-a0f5191170a1 for instance 2490098c-642b-48ba-9d81-510e1c2942cb on n-h1-862769-1 Oct 27 04:24:59.084660 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-ab9d6248-1edb-4b0a-8f03-d40dc538387c req-a112f9f6-7bc5-4e39-b665-1a9d742d3dbc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031711 Oct 27 04:24:59.085261 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3845/7398] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:24:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:24:59.412250 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1364e1ff-ae26-4282-9a3f-9b3686c06411 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:24:59.412962 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1364e1ff-ae26-4282-9a3f-9b3686c06411 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 2490098c-642b-48ba-9d81-510e1c2942cb] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:24:59.419744 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1364e1ff-ae26-4282-9a3f-9b3686c06411 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:59.420435 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1364e1ff-ae26-4282-9a3f-9b3686c06411 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:59.420886 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1364e1ff-ae26-4282-9a3f-9b3686c06411 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:59.421598 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1364e1ff-ae26-4282-9a3f-9b3686c06411 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:24:59.422078 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1364e1ff-ae26-4282-9a3f-9b3686c06411 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:24:59.422526 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1364e1ff-ae26-4282-9a3f-9b3686c06411 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:24:59.552673 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1364e1ff-ae26-4282-9a3f-9b3686c06411 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:24:59.560455 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1364e1ff-ae26-4282-9a3f-9b3686c06411 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb" status: 200 len: 1362 microversion: 2.1 time: 0.152325 Oct 27 04:24:59.561037 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3554/7399] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:24:59 2022] GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:25:00.584739 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1620be9d-c5e7-4756-b13a-8f15a2f58361 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:25:00.585467 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1620be9d-c5e7-4756-b13a-8f15a2f58361 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 2490098c-642b-48ba-9d81-510e1c2942cb] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:25:00.591954 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1620be9d-c5e7-4756-b13a-8f15a2f58361 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:25:00.592472 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1620be9d-c5e7-4756-b13a-8f15a2f58361 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:25:00.592937 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1620be9d-c5e7-4756-b13a-8f15a2f58361 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:25:00.595840 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1620be9d-c5e7-4756-b13a-8f15a2f58361 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:25:00.596289 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1620be9d-c5e7-4756-b13a-8f15a2f58361 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:25:00.596751 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1620be9d-c5e7-4756-b13a-8f15a2f58361 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:25:00.727627 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1620be9d-c5e7-4756-b13a-8f15a2f58361 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:25:00.735437 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1620be9d-c5e7-4756-b13a-8f15a2f58361 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb" status: 200 len: 1362 microversion: 2.1 time: 0.156379 Oct 27 04:25:00.736021 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3846/7400] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:25:00 2022] GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:25:01.758151 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f261568f-e84e-4190-9cd0-9c58e90918ca tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:25:01.758795 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f261568f-e84e-4190-9cd0-9c58e90918ca tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 2490098c-642b-48ba-9d81-510e1c2942cb] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:25:01.765529 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f261568f-e84e-4190-9cd0-9c58e90918ca tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:25:01.766019 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f261568f-e84e-4190-9cd0-9c58e90918ca tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:25:01.767130 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f261568f-e84e-4190-9cd0-9c58e90918ca tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:25:01.767833 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f261568f-e84e-4190-9cd0-9c58e90918ca tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:25:01.768295 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f261568f-e84e-4190-9cd0-9c58e90918ca tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:25:01.768723 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f261568f-e84e-4190-9cd0-9c58e90918ca tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:25:01.897694 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f261568f-e84e-4190-9cd0-9c58e90918ca tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:25:01.905372 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f261568f-e84e-4190-9cd0-9c58e90918ca tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb" status: 200 len: 1362 microversion: 2.1 time: 0.151151 Oct 27 04:25:01.905936 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3555/7401] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:25:01 2022] GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:25:02.928518 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ecdefc69-9a95-4e6c-99f6-eb52f5b766dd tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:25:02.929190 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ecdefc69-9a95-4e6c-99f6-eb52f5b766dd tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 2490098c-642b-48ba-9d81-510e1c2942cb] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:25:02.936661 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ecdefc69-9a95-4e6c-99f6-eb52f5b766dd tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:25:02.937176 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ecdefc69-9a95-4e6c-99f6-eb52f5b766dd tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:25:02.937640 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ecdefc69-9a95-4e6c-99f6-eb52f5b766dd tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:25:02.938411 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ecdefc69-9a95-4e6c-99f6-eb52f5b766dd tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:25:02.938898 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ecdefc69-9a95-4e6c-99f6-eb52f5b766dd tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:25:02.939354 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ecdefc69-9a95-4e6c-99f6-eb52f5b766dd tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:25:03.065509 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ecdefc69-9a95-4e6c-99f6-eb52f5b766dd tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:25:03.073243 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ecdefc69-9a95-4e6c-99f6-eb52f5b766dd tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb" status: 200 len: 1362 microversion: 2.1 time: 0.148832 Oct 27 04:25:03.073818 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3847/7402] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:25:02 2022] GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:25:04.097152 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b196ad6b-e706-488f-8695-63e90c43fd8c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:25:04.097771 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b196ad6b-e706-488f-8695-63e90c43fd8c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 2490098c-642b-48ba-9d81-510e1c2942cb] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:25:04.104849 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b196ad6b-e706-488f-8695-63e90c43fd8c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:25:04.105342 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b196ad6b-e706-488f-8695-63e90c43fd8c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:25:04.105786 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b196ad6b-e706-488f-8695-63e90c43fd8c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:25:04.106529 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b196ad6b-e706-488f-8695-63e90c43fd8c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:25:04.107020 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b196ad6b-e706-488f-8695-63e90c43fd8c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:25:04.107480 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b196ad6b-e706-488f-8695-63e90c43fd8c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:25:04.243629 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b196ad6b-e706-488f-8695-63e90c43fd8c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:25:04.252003 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b196ad6b-e706-488f-8695-63e90c43fd8c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb" status: 200 len: 1362 microversion: 2.1 time: 0.159426 Oct 27 04:25:04.254654 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3556/7403] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:25:04 2022] GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:25:05.275968 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d7609bcc-2a77-4480-8e21-b38ba7da3fc8 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:25:05.276605 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d7609bcc-2a77-4480-8e21-b38ba7da3fc8 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 2490098c-642b-48ba-9d81-510e1c2942cb] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:25:05.279429 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=6 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:25:05.284730 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d7609bcc-2a77-4480-8e21-b38ba7da3fc8 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:25:05.285246 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d7609bcc-2a77-4480-8e21-b38ba7da3fc8 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:25:05.287588 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d7609bcc-2a77-4480-8e21-b38ba7da3fc8 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:25:05.287588 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d7609bcc-2a77-4480-8e21-b38ba7da3fc8 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:25:05.287588 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d7609bcc-2a77-4480-8e21-b38ba7da3fc8 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:25:05.287588 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d7609bcc-2a77-4480-8e21-b38ba7da3fc8 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:25:05.421945 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d7609bcc-2a77-4480-8e21-b38ba7da3fc8 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:25:05.430660 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d7609bcc-2a77-4480-8e21-b38ba7da3fc8 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb" status: 200 len: 1362 microversion: 2.1 time: 0.158585 Oct 27 04:25:05.431280 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3848/7404] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:25:05 2022] GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:25:05.460167 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-a9742279-9762-4ee7-954c-2687401305aa req-294b688c-a8ef-48eb-88d3-6f5dc982020e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2490098c-642b-48ba-9d81-510e1c2942cb", "name": "network-vif-plugged", "status": "completed", "tag": "c8e780bf-9d0c-4f31-b3ba-a0f5191170a1"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:25:05.465488 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:25:05.466410 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=6 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:25:05.472938 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-a9742279-9762-4ee7-954c-2687401305aa req-294b688c-a8ef-48eb-88d3-6f5dc982020e service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:25:05.473405 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-a9742279-9762-4ee7-954c-2687401305aa req-294b688c-a8ef-48eb-88d3-6f5dc982020e service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:25:05.473840 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-a9742279-9762-4ee7-954c-2687401305aa req-294b688c-a8ef-48eb-88d3-6f5dc982020e service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:25:05.484602 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-a9742279-9762-4ee7-954c-2687401305aa req-294b688c-a8ef-48eb-88d3-6f5dc982020e service nova] Creating event network-vif-plugged:c8e780bf-9d0c-4f31-b3ba-a0f5191170a1 for instance 2490098c-642b-48ba-9d81-510e1c2942cb on n-h1-862769-1 Oct 27 04:25:05.490226 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-a9742279-9762-4ee7-954c-2687401305aa req-294b688c-a8ef-48eb-88d3-6f5dc982020e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033767 Oct 27 04:25:05.490820 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3557/7405] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:25:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:25:06.453123 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-df8c4bea-a223-4a3a-8224-81fd68725c94 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:25:06.453771 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-df8c4bea-a223-4a3a-8224-81fd68725c94 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 2490098c-642b-48ba-9d81-510e1c2942cb] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:25:06.460697 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-df8c4bea-a223-4a3a-8224-81fd68725c94 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:25:06.461206 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-df8c4bea-a223-4a3a-8224-81fd68725c94 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:25:06.461670 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-df8c4bea-a223-4a3a-8224-81fd68725c94 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:25:06.462434 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-df8c4bea-a223-4a3a-8224-81fd68725c94 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:25:06.462908 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-df8c4bea-a223-4a3a-8224-81fd68725c94 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:25:06.463633 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-df8c4bea-a223-4a3a-8224-81fd68725c94 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:25:06.598376 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-df8c4bea-a223-4a3a-8224-81fd68725c94 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:25:06.606446 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-df8c4bea-a223-4a3a-8224-81fd68725c94 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb" status: 200 len: 1362 microversion: 2.1 time: 0.157351 Oct 27 04:25:06.607083 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3849/7406] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:25:06 2022] GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:25:07.632373 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f8e8a1c6-81ec-42c5-aab7-35bdc25f221e tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:25:07.633104 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f8e8a1c6-81ec-42c5-aab7-35bdc25f221e tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 2490098c-642b-48ba-9d81-510e1c2942cb] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:25:07.640254 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f8e8a1c6-81ec-42c5-aab7-35bdc25f221e tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:25:07.640756 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f8e8a1c6-81ec-42c5-aab7-35bdc25f221e tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:25:07.641210 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f8e8a1c6-81ec-42c5-aab7-35bdc25f221e tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:25:07.641934 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f8e8a1c6-81ec-42c5-aab7-35bdc25f221e tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:25:07.642503 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f8e8a1c6-81ec-42c5-aab7-35bdc25f221e tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:25:07.643516 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f8e8a1c6-81ec-42c5-aab7-35bdc25f221e tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:25:07.780895 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f8e8a1c6-81ec-42c5-aab7-35bdc25f221e tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:25:07.788652 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f8e8a1c6-81ec-42c5-aab7-35bdc25f221e tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb" status: 200 len: 1548 microversion: 2.1 time: 0.162460 Oct 27 04:25:07.789236 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3558/7407] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:25:07 2022] GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb => generated 1548 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:25:07.814063 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1516f11c-15b6-4354-b19f-e90563c97c1a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:25:07.815114 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1516f11c-15b6-4354-b19f-e90563c97c1a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 2490098c-642b-48ba-9d81-510e1c2942cb] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:25:07.821216 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1516f11c-15b6-4354-b19f-e90563c97c1a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:25:07.821728 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1516f11c-15b6-4354-b19f-e90563c97c1a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:25:07.822237 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1516f11c-15b6-4354-b19f-e90563c97c1a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:25:07.822955 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1516f11c-15b6-4354-b19f-e90563c97c1a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:25:07.823435 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1516f11c-15b6-4354-b19f-e90563c97c1a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:25:07.823882 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1516f11c-15b6-4354-b19f-e90563c97c1a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:25:07.900102 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1516f11c-15b6-4354-b19f-e90563c97c1a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092874 Oct 27 04:25:07.900702 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3850/7408] 10.222.0.20 () {58 vars in 1275 bytes} [Thu Oct 27 04:25:07 2022] GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:25:09.179080 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-5b79b85f-60b7-4c1a-a93c-61b6b28bcd78 req-c72a630a-5364-4e2c-b0c3-d604647fe4e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2490098c-642b-48ba-9d81-510e1c2942cb", "tag": "c8e780bf-9d0c-4f31-b3ba-a0f5191170a1"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:25:09.190630 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-5b79b85f-60b7-4c1a-a93c-61b6b28bcd78 req-c72a630a-5364-4e2c-b0c3-d604647fe4e0 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:25:09.191121 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-5b79b85f-60b7-4c1a-a93c-61b6b28bcd78 req-c72a630a-5364-4e2c-b0c3-d604647fe4e0 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:25:09.191556 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-5b79b85f-60b7-4c1a-a93c-61b6b28bcd78 req-c72a630a-5364-4e2c-b0c3-d604647fe4e0 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:25:09.202986 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-5b79b85f-60b7-4c1a-a93c-61b6b28bcd78 req-c72a630a-5364-4e2c-b0c3-d604647fe4e0 service nova] Creating event network-changed:c8e780bf-9d0c-4f31-b3ba-a0f5191170a1 for instance 2490098c-642b-48ba-9d81-510e1c2942cb on n-h1-862769-1 Oct 27 04:25:09.207775 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-5b79b85f-60b7-4c1a-a93c-61b6b28bcd78 req-c72a630a-5364-4e2c-b0c3-d604647fe4e0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032682 Oct 27 04:25:09.208393 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3559/7409] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:25:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:25:45.016125 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:25:45.016937 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=36 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:25:45.021390 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4392a475-b7f8-482e-858a-ff7f559ae494 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:25:45.022023 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4392a475-b7f8-482e-858a-ff7f559ae494 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 2490098c-642b-48ba-9d81-510e1c2942cb] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:25:45.028142 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4392a475-b7f8-482e-858a-ff7f559ae494 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:25:45.032942 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4392a475-b7f8-482e-858a-ff7f559ae494 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:25:45.032942 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4392a475-b7f8-482e-858a-ff7f559ae494 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:25:45.032942 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4392a475-b7f8-482e-858a-ff7f559ae494 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:25:45.032942 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4392a475-b7f8-482e-858a-ff7f559ae494 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:25:45.032942 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4392a475-b7f8-482e-858a-ff7f559ae494 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:25:45.210947 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4392a475-b7f8-482e-858a-ff7f559ae494 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:25:45.218870 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4392a475-b7f8-482e-858a-ff7f559ae494 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb" status: 200 len: 1667 microversion: 2.1 time: 0.204854 Oct 27 04:25:45.219436 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3851/7410] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:25:45 2022] GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb => generated 1667 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:25:45.240558 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:25:45.241309 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=42 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:25:45.245931 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-16e5a958-3860-4117-8249-667e0b44bf41 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:25:45.254144 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-16e5a958-3860-4117-8249-667e0b44bf41 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 2490098c-642b-48ba-9d81-510e1c2942cb] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:25:45.254144 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-16e5a958-3860-4117-8249-667e0b44bf41 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:25:45.254144 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-16e5a958-3860-4117-8249-667e0b44bf41 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:25:45.254453 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-16e5a958-3860-4117-8249-667e0b44bf41 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:25:45.255080 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-16e5a958-3860-4117-8249-667e0b44bf41 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:25:45.255540 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-16e5a958-3860-4117-8249-667e0b44bf41 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:25:45.255969 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-16e5a958-3860-4117-8249-667e0b44bf41 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:25:45.438457 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-16e5a958-3860-4117-8249-667e0b44bf41 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:25:45.446482 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-16e5a958-3860-4117-8249-667e0b44bf41 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb" status: 200 len: 1667 microversion: 2.1 time: 0.208767 Oct 27 04:25:45.447075 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3560/7411] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:25:45 2022] GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb => generated 1667 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:25:45.469178 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8ab130b8-5d74-4319-a312-80cb116dbe54 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:25:45.469915 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8ab130b8-5d74-4319-a312-80cb116dbe54 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 2490098c-642b-48ba-9d81-510e1c2942cb] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:25:45.476730 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8ab130b8-5d74-4319-a312-80cb116dbe54 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:25:45.477238 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8ab130b8-5d74-4319-a312-80cb116dbe54 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:25:45.477700 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8ab130b8-5d74-4319-a312-80cb116dbe54 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:25:45.478446 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8ab130b8-5d74-4319-a312-80cb116dbe54 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:25:45.478924 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8ab130b8-5d74-4319-a312-80cb116dbe54 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:25:45.479375 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8ab130b8-5d74-4319-a312-80cb116dbe54 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:25:45.607666 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8ab130b8-5d74-4319-a312-80cb116dbe54 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:25:45.615458 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8ab130b8-5d74-4319-a312-80cb116dbe54 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb" status: 200 len: 1667 microversion: 2.1 time: 0.150333 Oct 27 04:25:45.616048 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3852/7412] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:25:45 2022] GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb => generated 1667 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:25:45.637937 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9bf729f0-acb3-4d17-b378-59e04ea415c3 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:25:45.640211 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9bf729f0-acb3-4d17-b378-59e04ea415c3 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 2490098c-642b-48ba-9d81-510e1c2942cb] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:25:45.646698 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9bf729f0-acb3-4d17-b378-59e04ea415c3 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:25:45.647188 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9bf729f0-acb3-4d17-b378-59e04ea415c3 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:25:45.647630 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9bf729f0-acb3-4d17-b378-59e04ea415c3 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:25:45.648330 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9bf729f0-acb3-4d17-b378-59e04ea415c3 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:25:45.648788 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9bf729f0-acb3-4d17-b378-59e04ea415c3 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:25:45.649217 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9bf729f0-acb3-4d17-b378-59e04ea415c3 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:25:45.677271 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9bf729f0-acb3-4d17-b378-59e04ea415c3 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:25:45.689069 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9bf729f0-acb3-4d17-b378-59e04ea415c3 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 2490098c-642b-48ba-9d81-510e1c2942cb] Old instance type m1.heat2, new instance type m1.heat {{(pid=121000) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 27 04:25:45.689262 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-9bf729f0-acb3-4d17-b378-59e04ea415c3 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 04:25:45.689686 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-9bf729f0-acb3-4d17-b378-59e04ea415c3 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 04:25:45.690189 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-9bf729f0-acb3-4d17-b378-59e04ea415c3 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 04:25:45.690604 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-9bf729f0-acb3-4d17-b378-59e04ea415c3 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 04:25:45.691533 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-9bf729f0-acb3-4d17-b378-59e04ea415c3 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 04:25:45.896408 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9bf729f0-acb3-4d17-b378-59e04ea415c3 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "POST /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb/action" status: 202 len: 0 microversion: 2.1 time: 0.262311 Oct 27 04:25:45.897002 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3561/7413] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 04:25:45 2022] POST /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb/action => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 04:25:45.905139 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7123020a-6684-4f27-aa76-c16c43b356be tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:25:45.905769 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7123020a-6684-4f27-aa76-c16c43b356be tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 2490098c-642b-48ba-9d81-510e1c2942cb] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:25:45.912109 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7123020a-6684-4f27-aa76-c16c43b356be tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:25:45.928591 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7123020a-6684-4f27-aa76-c16c43b356be tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:25:45.928591 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7123020a-6684-4f27-aa76-c16c43b356be tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:25:45.928591 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7123020a-6684-4f27-aa76-c16c43b356be tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:25:45.928591 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7123020a-6684-4f27-aa76-c16c43b356be tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:25:45.928591 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7123020a-6684-4f27-aa76-c16c43b356be tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:25:46.046942 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7123020a-6684-4f27-aa76-c16c43b356be tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:25:46.055213 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7123020a-6684-4f27-aa76-c16c43b356be tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb" status: 200 len: 1676 microversion: 2.1 time: 0.153965 Oct 27 04:25:46.055787 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3853/7414] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:25:45 2022] GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:25:47.085952 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-002c7e20-adc8-4534-84a2-9f0704bb1baf tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:25:47.086548 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-002c7e20-adc8-4534-84a2-9f0704bb1baf tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 2490098c-642b-48ba-9d81-510e1c2942cb] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:25:47.093714 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-002c7e20-adc8-4534-84a2-9f0704bb1baf tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:25:47.094377 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-002c7e20-adc8-4534-84a2-9f0704bb1baf tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:25:47.094832 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-002c7e20-adc8-4534-84a2-9f0704bb1baf tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:25:47.095542 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-002c7e20-adc8-4534-84a2-9f0704bb1baf tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:25:47.096008 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-002c7e20-adc8-4534-84a2-9f0704bb1baf tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:25:47.096447 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-002c7e20-adc8-4534-84a2-9f0704bb1baf tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:25:47.230409 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-002c7e20-adc8-4534-84a2-9f0704bb1baf tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:25:47.239262 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-002c7e20-adc8-4534-84a2-9f0704bb1baf tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb" status: 200 len: 1676 microversion: 2.1 time: 0.158800 Oct 27 04:25:47.239855 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3562/7415] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:25:47 2022] GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb => generated 1676 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:25:48.262851 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c86d1784-9c96-45e0-882e-f56872320aae tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:25:48.263527 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c86d1784-9c96-45e0-882e-f56872320aae tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 2490098c-642b-48ba-9d81-510e1c2942cb] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:25:48.270931 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c86d1784-9c96-45e0-882e-f56872320aae tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:25:48.271443 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c86d1784-9c96-45e0-882e-f56872320aae tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:25:48.271903 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c86d1784-9c96-45e0-882e-f56872320aae tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:25:48.272656 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c86d1784-9c96-45e0-882e-f56872320aae tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:25:48.273138 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c86d1784-9c96-45e0-882e-f56872320aae tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:25:48.273590 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c86d1784-9c96-45e0-882e-f56872320aae tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:25:48.479020 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c86d1784-9c96-45e0-882e-f56872320aae tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:25:48.487035 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c86d1784-9c96-45e0-882e-f56872320aae tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb" status: 200 len: 1676 microversion: 2.1 time: 0.228093 Oct 27 04:25:48.487605 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3854/7416] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:25:48 2022] GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb => generated 1676 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:25:49.510470 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8fdc0cbf-33d3-430a-919e-b9dec5c50a58 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:25:49.511096 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8fdc0cbf-33d3-430a-919e-b9dec5c50a58 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 2490098c-642b-48ba-9d81-510e1c2942cb] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:25:49.517860 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8fdc0cbf-33d3-430a-919e-b9dec5c50a58 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:25:49.518386 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8fdc0cbf-33d3-430a-919e-b9dec5c50a58 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:25:49.518833 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8fdc0cbf-33d3-430a-919e-b9dec5c50a58 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:25:49.519536 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8fdc0cbf-33d3-430a-919e-b9dec5c50a58 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:25:49.520003 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8fdc0cbf-33d3-430a-919e-b9dec5c50a58 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:25:49.520469 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8fdc0cbf-33d3-430a-919e-b9dec5c50a58 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:25:49.974502 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8fdc0cbf-33d3-430a-919e-b9dec5c50a58 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:25:49.982227 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8fdc0cbf-33d3-430a-919e-b9dec5c50a58 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb" status: 200 len: 1681 microversion: 2.1 time: 0.475723 Oct 27 04:25:49.982802 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3563/7417] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:25:49 2022] GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb => generated 1681 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:25:51.006109 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-70c41f5f-5bad-443d-a6c8-2eaf021ea95f tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:25:51.006749 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-70c41f5f-5bad-443d-a6c8-2eaf021ea95f tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 2490098c-642b-48ba-9d81-510e1c2942cb] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:25:51.013619 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-70c41f5f-5bad-443d-a6c8-2eaf021ea95f tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:25:51.014163 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-70c41f5f-5bad-443d-a6c8-2eaf021ea95f tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:25:51.014620 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-70c41f5f-5bad-443d-a6c8-2eaf021ea95f tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:25:51.015390 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-70c41f5f-5bad-443d-a6c8-2eaf021ea95f tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:25:51.015845 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-70c41f5f-5bad-443d-a6c8-2eaf021ea95f tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:25:51.016286 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-70c41f5f-5bad-443d-a6c8-2eaf021ea95f tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:25:51.153046 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-70c41f5f-5bad-443d-a6c8-2eaf021ea95f tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:25:51.160992 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-70c41f5f-5bad-443d-a6c8-2eaf021ea95f tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb" status: 200 len: 1681 microversion: 2.1 time: 0.159739 Oct 27 04:25:51.161564 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3855/7418] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:25:51 2022] GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:25:52.184044 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-aa3fe532-2f49-41fc-ad6a-2e3997793698 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:25:52.184677 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-aa3fe532-2f49-41fc-ad6a-2e3997793698 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 2490098c-642b-48ba-9d81-510e1c2942cb] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:25:52.191306 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aa3fe532-2f49-41fc-ad6a-2e3997793698 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:25:52.191808 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aa3fe532-2f49-41fc-ad6a-2e3997793698 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:25:52.192259 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aa3fe532-2f49-41fc-ad6a-2e3997793698 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:25:52.192975 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aa3fe532-2f49-41fc-ad6a-2e3997793698 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:25:52.193453 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aa3fe532-2f49-41fc-ad6a-2e3997793698 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:25:52.193888 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aa3fe532-2f49-41fc-ad6a-2e3997793698 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:25:52.329466 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-aa3fe532-2f49-41fc-ad6a-2e3997793698 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:25:52.337743 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-aa3fe532-2f49-41fc-ad6a-2e3997793698 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb" status: 200 len: 1681 microversion: 2.1 time: 0.157693 Oct 27 04:25:52.338360 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3564/7419] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:25:52 2022] GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:25:53.362518 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f9c12b6c-d0b6-4b91-9da5-885f1925bd01 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:25:53.363782 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f9c12b6c-d0b6-4b91-9da5-885f1925bd01 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 2490098c-642b-48ba-9d81-510e1c2942cb] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:25:53.370749 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f9c12b6c-d0b6-4b91-9da5-885f1925bd01 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:25:53.371258 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f9c12b6c-d0b6-4b91-9da5-885f1925bd01 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:25:53.371723 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f9c12b6c-d0b6-4b91-9da5-885f1925bd01 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:25:53.372438 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f9c12b6c-d0b6-4b91-9da5-885f1925bd01 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:25:53.372916 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f9c12b6c-d0b6-4b91-9da5-885f1925bd01 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:25:53.373369 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f9c12b6c-d0b6-4b91-9da5-885f1925bd01 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:25:53.499837 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f9c12b6c-d0b6-4b91-9da5-885f1925bd01 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:25:53.507493 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f9c12b6c-d0b6-4b91-9da5-885f1925bd01 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb" status: 200 len: 1681 microversion: 2.1 time: 0.149028 Oct 27 04:25:53.508077 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3856/7420] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:25:53 2022] GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:25:54.531277 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b9f83575-66d4-48b7-97bd-6c5c46d9d0aa tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:25:54.531904 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b9f83575-66d4-48b7-97bd-6c5c46d9d0aa tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 2490098c-642b-48ba-9d81-510e1c2942cb] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:25:54.539425 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b9f83575-66d4-48b7-97bd-6c5c46d9d0aa tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:25:54.539916 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b9f83575-66d4-48b7-97bd-6c5c46d9d0aa tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:25:54.540365 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b9f83575-66d4-48b7-97bd-6c5c46d9d0aa tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:25:54.541071 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b9f83575-66d4-48b7-97bd-6c5c46d9d0aa tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:25:54.541537 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b9f83575-66d4-48b7-97bd-6c5c46d9d0aa tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:25:54.541975 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b9f83575-66d4-48b7-97bd-6c5c46d9d0aa tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:25:54.698441 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b9f83575-66d4-48b7-97bd-6c5c46d9d0aa tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:25:54.706066 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b9f83575-66d4-48b7-97bd-6c5c46d9d0aa tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb" status: 200 len: 1681 microversion: 2.1 time: 0.178720 Oct 27 04:25:54.706658 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3565/7421] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:25:54 2022] GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb => generated 1681 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:25:55.730258 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-af6d9ed2-84eb-4b99-bf94-cca81b526784 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:25:55.730898 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-af6d9ed2-84eb-4b99-bf94-cca81b526784 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 2490098c-642b-48ba-9d81-510e1c2942cb] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:25:55.738180 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-af6d9ed2-84eb-4b99-bf94-cca81b526784 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:25:55.742969 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-af6d9ed2-84eb-4b99-bf94-cca81b526784 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:25:55.742969 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-af6d9ed2-84eb-4b99-bf94-cca81b526784 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:25:55.742969 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-af6d9ed2-84eb-4b99-bf94-cca81b526784 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:25:55.742969 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-af6d9ed2-84eb-4b99-bf94-cca81b526784 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:25:55.742969 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-af6d9ed2-84eb-4b99-bf94-cca81b526784 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:25:55.871792 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-af6d9ed2-84eb-4b99-bf94-cca81b526784 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:25:55.880039 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-af6d9ed2-84eb-4b99-bf94-cca81b526784 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb" status: 200 len: 1681 microversion: 2.1 time: 0.153751 Oct 27 04:25:55.880642 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3857/7422] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:25:55 2022] GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:25:56.903545 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-efc79d7e-fbe9-419f-af55-6174a6ccb7b7 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:25:56.904080 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-efc79d7e-fbe9-419f-af55-6174a6ccb7b7 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 2490098c-642b-48ba-9d81-510e1c2942cb] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:25:56.911655 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-efc79d7e-fbe9-419f-af55-6174a6ccb7b7 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:25:56.912144 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-efc79d7e-fbe9-419f-af55-6174a6ccb7b7 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:25:56.912585 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-efc79d7e-fbe9-419f-af55-6174a6ccb7b7 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:25:56.913282 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-efc79d7e-fbe9-419f-af55-6174a6ccb7b7 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:25:56.913742 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-efc79d7e-fbe9-419f-af55-6174a6ccb7b7 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:25:56.914209 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-efc79d7e-fbe9-419f-af55-6174a6ccb7b7 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:25:57.049887 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-efc79d7e-fbe9-419f-af55-6174a6ccb7b7 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:25:57.057651 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-efc79d7e-fbe9-419f-af55-6174a6ccb7b7 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb" status: 200 len: 1681 microversion: 2.1 time: 0.158126 Oct 27 04:25:57.058251 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3566/7423] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:25:56 2022] GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:25:58.082109 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2dcb5dee-6583-4269-9e89-299804114b00 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:25:58.082748 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2dcb5dee-6583-4269-9e89-299804114b00 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 2490098c-642b-48ba-9d81-510e1c2942cb] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:25:58.090232 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2dcb5dee-6583-4269-9e89-299804114b00 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:25:58.091012 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2dcb5dee-6583-4269-9e89-299804114b00 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:25:58.091572 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2dcb5dee-6583-4269-9e89-299804114b00 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:25:58.092187 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2dcb5dee-6583-4269-9e89-299804114b00 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:25:58.092656 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2dcb5dee-6583-4269-9e89-299804114b00 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:25:58.093132 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2dcb5dee-6583-4269-9e89-299804114b00 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:25:58.230684 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2dcb5dee-6583-4269-9e89-299804114b00 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:25:58.239538 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2dcb5dee-6583-4269-9e89-299804114b00 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb" status: 200 len: 1681 microversion: 2.1 time: 0.161493 Oct 27 04:25:58.240128 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3858/7424] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:25:58 2022] GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:25:59.263697 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-59ec0309-c529-4820-b7ad-42de1f4111ea tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:25:59.264351 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-59ec0309-c529-4820-b7ad-42de1f4111ea tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 2490098c-642b-48ba-9d81-510e1c2942cb] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:25:59.273732 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-59ec0309-c529-4820-b7ad-42de1f4111ea tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:25:59.273732 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-59ec0309-c529-4820-b7ad-42de1f4111ea tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:25:59.273732 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-59ec0309-c529-4820-b7ad-42de1f4111ea tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:25:59.273732 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-59ec0309-c529-4820-b7ad-42de1f4111ea tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:25:59.273732 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-59ec0309-c529-4820-b7ad-42de1f4111ea tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:25:59.273732 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-59ec0309-c529-4820-b7ad-42de1f4111ea tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:25:59.404176 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-59ec0309-c529-4820-b7ad-42de1f4111ea tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:25:59.412401 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-59ec0309-c529-4820-b7ad-42de1f4111ea tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb" status: 200 len: 1681 microversion: 2.1 time: 0.152667 Oct 27 04:25:59.412977 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3567/7425] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:25:59 2022] GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:26:00.437809 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b590e56c-9b75-4fc1-851e-8136c2ca6f23 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:26:00.438391 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b590e56c-9b75-4fc1-851e-8136c2ca6f23 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 2490098c-642b-48ba-9d81-510e1c2942cb] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:26:00.444884 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b590e56c-9b75-4fc1-851e-8136c2ca6f23 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:26:00.445389 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b590e56c-9b75-4fc1-851e-8136c2ca6f23 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:26:00.445851 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b590e56c-9b75-4fc1-851e-8136c2ca6f23 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:26:00.446597 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b590e56c-9b75-4fc1-851e-8136c2ca6f23 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:26:00.447078 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b590e56c-9b75-4fc1-851e-8136c2ca6f23 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:26:00.447554 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b590e56c-9b75-4fc1-851e-8136c2ca6f23 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:26:00.575900 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b590e56c-9b75-4fc1-851e-8136c2ca6f23 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:26:00.583780 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b590e56c-9b75-4fc1-851e-8136c2ca6f23 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb" status: 200 len: 1681 microversion: 2.1 time: 0.150823 Oct 27 04:26:00.584364 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3859/7426] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:26:00 2022] GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:26:01.607828 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5fcb77a1-e91a-43cf-9f33-4332ed4abd5a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:26:01.608460 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5fcb77a1-e91a-43cf-9f33-4332ed4abd5a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 2490098c-642b-48ba-9d81-510e1c2942cb] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:26:01.615232 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5fcb77a1-e91a-43cf-9f33-4332ed4abd5a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:26:01.615723 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5fcb77a1-e91a-43cf-9f33-4332ed4abd5a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:26:01.616166 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5fcb77a1-e91a-43cf-9f33-4332ed4abd5a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:26:01.616865 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5fcb77a1-e91a-43cf-9f33-4332ed4abd5a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:26:01.617330 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5fcb77a1-e91a-43cf-9f33-4332ed4abd5a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:26:01.617762 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5fcb77a1-e91a-43cf-9f33-4332ed4abd5a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:26:01.745146 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5fcb77a1-e91a-43cf-9f33-4332ed4abd5a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:26:01.752854 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5fcb77a1-e91a-43cf-9f33-4332ed4abd5a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb" status: 200 len: 1681 microversion: 2.1 time: 0.148918 Oct 27 04:26:01.753422 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3568/7427] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:26:01 2022] GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:26:02.776741 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f71c73c9-663b-4e57-ad1f-c9a0ce16d1ba tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:26:02.777383 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f71c73c9-663b-4e57-ad1f-c9a0ce16d1ba tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 2490098c-642b-48ba-9d81-510e1c2942cb] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:26:02.784431 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f71c73c9-663b-4e57-ad1f-c9a0ce16d1ba tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:26:02.789104 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f71c73c9-663b-4e57-ad1f-c9a0ce16d1ba tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:26:02.789104 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f71c73c9-663b-4e57-ad1f-c9a0ce16d1ba tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:26:02.789104 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f71c73c9-663b-4e57-ad1f-c9a0ce16d1ba tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:26:02.789104 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f71c73c9-663b-4e57-ad1f-c9a0ce16d1ba tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:26:02.789104 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f71c73c9-663b-4e57-ad1f-c9a0ce16d1ba tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:26:02.920370 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f71c73c9-663b-4e57-ad1f-c9a0ce16d1ba tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:26:02.928288 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f71c73c9-663b-4e57-ad1f-c9a0ce16d1ba tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb" status: 200 len: 1681 microversion: 2.1 time: 0.155594 Oct 27 04:26:02.928867 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3860/7428] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:26:02 2022] GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:26:03.952664 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5f36c776-fc8c-4f3a-a88a-c3760c873994 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:26:03.953291 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5f36c776-fc8c-4f3a-a88a-c3760c873994 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 2490098c-642b-48ba-9d81-510e1c2942cb] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:26:03.960150 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5f36c776-fc8c-4f3a-a88a-c3760c873994 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:26:03.960643 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5f36c776-fc8c-4f3a-a88a-c3760c873994 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:26:03.961085 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5f36c776-fc8c-4f3a-a88a-c3760c873994 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:26:03.961785 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5f36c776-fc8c-4f3a-a88a-c3760c873994 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:26:03.962274 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5f36c776-fc8c-4f3a-a88a-c3760c873994 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:26:03.962708 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5f36c776-fc8c-4f3a-a88a-c3760c873994 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:26:04.092461 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5f36c776-fc8c-4f3a-a88a-c3760c873994 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:26:04.100130 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5f36c776-fc8c-4f3a-a88a-c3760c873994 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb" status: 200 len: 1681 microversion: 2.1 time: 0.151412 Oct 27 04:26:04.100701 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3569/7429] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:26:03 2022] GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:26:05.123666 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-14e6f777-6d67-46e4-80fb-842e934107fc tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:26:05.124311 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-14e6f777-6d67-46e4-80fb-842e934107fc tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 2490098c-642b-48ba-9d81-510e1c2942cb] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:26:05.131880 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-14e6f777-6d67-46e4-80fb-842e934107fc tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:26:05.132401 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-14e6f777-6d67-46e4-80fb-842e934107fc tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:26:05.132870 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-14e6f777-6d67-46e4-80fb-842e934107fc tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:26:05.133699 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-14e6f777-6d67-46e4-80fb-842e934107fc tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:26:05.134224 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-14e6f777-6d67-46e4-80fb-842e934107fc tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:26:05.134683 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-14e6f777-6d67-46e4-80fb-842e934107fc tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:26:05.265028 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-14e6f777-6d67-46e4-80fb-842e934107fc tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:26:05.273046 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-14e6f777-6d67-46e4-80fb-842e934107fc tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb" status: 200 len: 1681 microversion: 2.1 time: 0.153348 Oct 27 04:26:05.273626 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3861/7430] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:26:05 2022] GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:26:06.297110 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b6f4c87d-36a7-4365-907c-1a77d945d373 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:26:06.297777 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b6f4c87d-36a7-4365-907c-1a77d945d373 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 2490098c-642b-48ba-9d81-510e1c2942cb] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:26:06.305271 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b6f4c87d-36a7-4365-907c-1a77d945d373 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:26:06.305921 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b6f4c87d-36a7-4365-907c-1a77d945d373 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:26:06.306445 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b6f4c87d-36a7-4365-907c-1a77d945d373 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:26:06.307243 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b6f4c87d-36a7-4365-907c-1a77d945d373 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:26:06.307712 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b6f4c87d-36a7-4365-907c-1a77d945d373 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:26:06.308229 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b6f4c87d-36a7-4365-907c-1a77d945d373 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:26:06.448496 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b6f4c87d-36a7-4365-907c-1a77d945d373 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:26:06.456350 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b6f4c87d-36a7-4365-907c-1a77d945d373 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb" status: 200 len: 1681 microversion: 2.1 time: 0.163217 Oct 27 04:26:06.456940 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3570/7431] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:26:06 2022] GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:26:07.137294 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-5576e09b-654d-4031-873d-57a9ad8d0ff6 req-3add08aa-d124-4197-8aaa-c733743781ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2490098c-642b-48ba-9d81-510e1c2942cb", "name": "network-vif-unplugged", "status": "completed", "tag": "c8e780bf-9d0c-4f31-b3ba-a0f5191170a1"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:26:07.147426 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-5576e09b-654d-4031-873d-57a9ad8d0ff6 req-3add08aa-d124-4197-8aaa-c733743781ba service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:26:07.147923 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-5576e09b-654d-4031-873d-57a9ad8d0ff6 req-3add08aa-d124-4197-8aaa-c733743781ba service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:26:07.148373 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-5576e09b-654d-4031-873d-57a9ad8d0ff6 req-3add08aa-d124-4197-8aaa-c733743781ba service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:26:07.160423 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-5576e09b-654d-4031-873d-57a9ad8d0ff6 req-3add08aa-d124-4197-8aaa-c733743781ba service nova] Creating event network-vif-unplugged:c8e780bf-9d0c-4f31-b3ba-a0f5191170a1 for instance 2490098c-642b-48ba-9d81-510e1c2942cb on n-h2-862769-1 Oct 27 04:26:07.165606 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [req-5576e09b-654d-4031-873d-57a9ad8d0ff6 req-3add08aa-d124-4197-8aaa-c733743781ba service nova] Instance 2490098c-642b-48ba-9d81-510e1c2942cb is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862769-1', 'n-h1-862769-1'} {{(pid=121001) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 04:26:07.176490 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-5576e09b-654d-4031-873d-57a9ad8d0ff6 req-3add08aa-d124-4197-8aaa-c733743781ba service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.096648 Oct 27 04:26:07.177104 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3862/7432] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:26:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:26:07.480369 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-22f7cf3a-c5f8-4f5e-af28-f8ea19f9be23 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:26:07.481023 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-22f7cf3a-c5f8-4f5e-af28-f8ea19f9be23 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 2490098c-642b-48ba-9d81-510e1c2942cb] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:26:07.487913 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-22f7cf3a-c5f8-4f5e-af28-f8ea19f9be23 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:26:07.488409 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-22f7cf3a-c5f8-4f5e-af28-f8ea19f9be23 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:26:07.488852 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-22f7cf3a-c5f8-4f5e-af28-f8ea19f9be23 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:26:07.489548 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-22f7cf3a-c5f8-4f5e-af28-f8ea19f9be23 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:26:07.490062 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-22f7cf3a-c5f8-4f5e-af28-f8ea19f9be23 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:26:07.490489 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-22f7cf3a-c5f8-4f5e-af28-f8ea19f9be23 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:26:07.700950 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-22f7cf3a-c5f8-4f5e-af28-f8ea19f9be23 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:26:07.711520 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-22f7cf3a-c5f8-4f5e-af28-f8ea19f9be23 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb" status: 200 len: 1680 microversion: 2.1 time: 0.235287 Oct 27 04:26:07.712159 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3571/7433] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:26:07 2022] GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb => generated 1680 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:26:08.737907 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-29e88b2c-6b9c-42ee-9598-7cf1a943b2e0 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:26:08.738696 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-29e88b2c-6b9c-42ee-9598-7cf1a943b2e0 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 2490098c-642b-48ba-9d81-510e1c2942cb] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:26:08.744790 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-29e88b2c-6b9c-42ee-9598-7cf1a943b2e0 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:26:08.745635 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-29e88b2c-6b9c-42ee-9598-7cf1a943b2e0 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:26:08.746130 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-29e88b2c-6b9c-42ee-9598-7cf1a943b2e0 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:26:08.746834 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-29e88b2c-6b9c-42ee-9598-7cf1a943b2e0 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:26:08.747305 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-29e88b2c-6b9c-42ee-9598-7cf1a943b2e0 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:26:08.747748 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-29e88b2c-6b9c-42ee-9598-7cf1a943b2e0 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:26:08.877897 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-29e88b2c-6b9c-42ee-9598-7cf1a943b2e0 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:26:08.885738 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-29e88b2c-6b9c-42ee-9598-7cf1a943b2e0 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb" status: 200 len: 1678 microversion: 2.1 time: 0.152843 Oct 27 04:26:08.886362 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3863/7434] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:26:08 2022] GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:26:09.192798 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-c2af980a-dadc-4c60-a2c7-52651036ac32 req-2aa10272-8ec9-41a3-a0c2-1f24f385552b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2490098c-642b-48ba-9d81-510e1c2942cb", "tag": "c8e780bf-9d0c-4f31-b3ba-a0f5191170a1"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:26:09.203143 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-c2af980a-dadc-4c60-a2c7-52651036ac32 req-2aa10272-8ec9-41a3-a0c2-1f24f385552b service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:26:09.203627 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-c2af980a-dadc-4c60-a2c7-52651036ac32 req-2aa10272-8ec9-41a3-a0c2-1f24f385552b service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:26:09.204066 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-c2af980a-dadc-4c60-a2c7-52651036ac32 req-2aa10272-8ec9-41a3-a0c2-1f24f385552b service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:26:09.216534 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-c2af980a-dadc-4c60-a2c7-52651036ac32 req-2aa10272-8ec9-41a3-a0c2-1f24f385552b service nova] Creating event network-changed:c8e780bf-9d0c-4f31-b3ba-a0f5191170a1 for instance 2490098c-642b-48ba-9d81-510e1c2942cb on n-h2-862769-1 Oct 27 04:26:09.221614 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [req-c2af980a-dadc-4c60-a2c7-52651036ac32 req-2aa10272-8ec9-41a3-a0c2-1f24f385552b service nova] Instance 2490098c-642b-48ba-9d81-510e1c2942cb is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862769-1', 'n-h1-862769-1'} {{(pid=121000) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 04:26:09.232618 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-c2af980a-dadc-4c60-a2c7-52651036ac32 req-2aa10272-8ec9-41a3-a0c2-1f24f385552b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044094 Oct 27 04:26:09.233216 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3572/7435] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:26:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:26:09.911304 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-147b5693-1246-4050-b7c7-815963075921 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:26:09.911948 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-147b5693-1246-4050-b7c7-815963075921 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 2490098c-642b-48ba-9d81-510e1c2942cb] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:26:09.918833 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-147b5693-1246-4050-b7c7-815963075921 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:26:09.919347 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-147b5693-1246-4050-b7c7-815963075921 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:26:09.919810 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-147b5693-1246-4050-b7c7-815963075921 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:26:09.920535 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-147b5693-1246-4050-b7c7-815963075921 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:26:09.921011 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-147b5693-1246-4050-b7c7-815963075921 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:26:09.921462 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-147b5693-1246-4050-b7c7-815963075921 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:26:10.051496 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-147b5693-1246-4050-b7c7-815963075921 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:26:10.060953 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-147b5693-1246-4050-b7c7-815963075921 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb" status: 200 len: 1678 microversion: 2.1 time: 0.154128 Oct 27 04:26:10.061552 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3864/7436] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:26:09 2022] GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:26:11.085582 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f61fdfeb-a78a-4e3e-8851-c1a03bd747a3 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:26:11.086353 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f61fdfeb-a78a-4e3e-8851-c1a03bd747a3 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 2490098c-642b-48ba-9d81-510e1c2942cb] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:26:11.095011 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f61fdfeb-a78a-4e3e-8851-c1a03bd747a3 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:26:11.095516 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f61fdfeb-a78a-4e3e-8851-c1a03bd747a3 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:26:11.095960 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f61fdfeb-a78a-4e3e-8851-c1a03bd747a3 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:26:11.096672 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f61fdfeb-a78a-4e3e-8851-c1a03bd747a3 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:26:11.097792 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f61fdfeb-a78a-4e3e-8851-c1a03bd747a3 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:26:11.098262 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f61fdfeb-a78a-4e3e-8851-c1a03bd747a3 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:26:11.244924 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f61fdfeb-a78a-4e3e-8851-c1a03bd747a3 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:26:11.252697 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f61fdfeb-a78a-4e3e-8851-c1a03bd747a3 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb" status: 200 len: 1675 microversion: 2.1 time: 0.172783 Oct 27 04:26:11.253817 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3573/7437] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:26:11 2022] GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb => generated 1675 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:26:11.276978 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1701fe1f-b9f4-426f-898f-abd2bb3a2fe8 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:26:11.277646 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1701fe1f-b9f4-426f-898f-abd2bb3a2fe8 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 2490098c-642b-48ba-9d81-510e1c2942cb] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:26:11.284516 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1701fe1f-b9f4-426f-898f-abd2bb3a2fe8 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:26:11.285017 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1701fe1f-b9f4-426f-898f-abd2bb3a2fe8 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:26:11.285469 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1701fe1f-b9f4-426f-898f-abd2bb3a2fe8 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:26:11.286215 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1701fe1f-b9f4-426f-898f-abd2bb3a2fe8 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:26:11.286685 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1701fe1f-b9f4-426f-898f-abd2bb3a2fe8 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:26:11.287124 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1701fe1f-b9f4-426f-898f-abd2bb3a2fe8 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:26:11.473811 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1701fe1f-b9f4-426f-898f-abd2bb3a2fe8 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "POST /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb/action" status: 204 len: 0 microversion: 2.1 time: 0.200530 Oct 27 04:26:11.474494 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3865/7438] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 04:26:11 2022] POST /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb/action => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 04:26:11.482745 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4a8bf1fb-9c66-4e40-aa70-7e6d82e089cd tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:26:11.483486 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4a8bf1fb-9c66-4e40-aa70-7e6d82e089cd tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 2490098c-642b-48ba-9d81-510e1c2942cb] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:26:11.489510 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4a8bf1fb-9c66-4e40-aa70-7e6d82e089cd tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:26:11.490007 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4a8bf1fb-9c66-4e40-aa70-7e6d82e089cd tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:26:11.490486 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4a8bf1fb-9c66-4e40-aa70-7e6d82e089cd tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:26:11.491187 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4a8bf1fb-9c66-4e40-aa70-7e6d82e089cd tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:26:11.491648 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4a8bf1fb-9c66-4e40-aa70-7e6d82e089cd tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:26:11.492082 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4a8bf1fb-9c66-4e40-aa70-7e6d82e089cd tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:26:11.626827 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4a8bf1fb-9c66-4e40-aa70-7e6d82e089cd tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:26:11.635494 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4a8bf1fb-9c66-4e40-aa70-7e6d82e089cd tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb" status: 200 len: 1675 microversion: 2.1 time: 0.156779 Oct 27 04:26:11.636087 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3574/7439] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:26:11 2022] GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb => generated 1675 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:26:12.661162 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a03f857c-007d-4445-a125-0be64f7d8f12 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:26:12.661916 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a03f857c-007d-4445-a125-0be64f7d8f12 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 2490098c-642b-48ba-9d81-510e1c2942cb] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:26:12.668210 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a03f857c-007d-4445-a125-0be64f7d8f12 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:26:12.668728 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a03f857c-007d-4445-a125-0be64f7d8f12 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:26:12.669193 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a03f857c-007d-4445-a125-0be64f7d8f12 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:26:12.669913 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a03f857c-007d-4445-a125-0be64f7d8f12 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:26:12.670414 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a03f857c-007d-4445-a125-0be64f7d8f12 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:26:12.670866 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a03f857c-007d-4445-a125-0be64f7d8f12 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:26:12.806670 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a03f857c-007d-4445-a125-0be64f7d8f12 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:26:12.809109 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:26:12.815348 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a03f857c-007d-4445-a125-0be64f7d8f12 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb" status: 200 len: 1675 microversion: 2.1 time: 0.159937 Oct 27 04:26:12.815930 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3866/7440] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:26:12 2022] GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb => generated 1675 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:26:13.839037 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-05dff0e8-0e80-488b-ba2f-ed1021e4a66c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:26:13.840041 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-05dff0e8-0e80-488b-ba2f-ed1021e4a66c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 2490098c-642b-48ba-9d81-510e1c2942cb] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:26:13.847811 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-05dff0e8-0e80-488b-ba2f-ed1021e4a66c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:26:13.848300 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-05dff0e8-0e80-488b-ba2f-ed1021e4a66c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:26:13.848743 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-05dff0e8-0e80-488b-ba2f-ed1021e4a66c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:26:13.849484 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-05dff0e8-0e80-488b-ba2f-ed1021e4a66c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:26:13.849946 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-05dff0e8-0e80-488b-ba2f-ed1021e4a66c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:26:13.850408 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-05dff0e8-0e80-488b-ba2f-ed1021e4a66c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:26:13.869297 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:26:13.981997 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-05dff0e8-0e80-488b-ba2f-ed1021e4a66c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:26:13.990848 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-05dff0e8-0e80-488b-ba2f-ed1021e4a66c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb" status: 200 len: 1667 microversion: 2.1 time: 0.155787 Oct 27 04:26:13.991591 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3575/7441] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:26:13 2022] GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb => generated 1667 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:26:13.995273 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-a4ec0385-709e-4d71-8fc4-a77861dedbb3 req-2998ef9f-de79-4f48-8182-9d20435f5255 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2490098c-642b-48ba-9d81-510e1c2942cb", "name": "network-vif-plugged", "status": "completed", "tag": "c8e780bf-9d0c-4f31-b3ba-a0f5191170a1"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:26:14.007353 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-a4ec0385-709e-4d71-8fc4-a77861dedbb3 req-2998ef9f-de79-4f48-8182-9d20435f5255 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:26:14.007861 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-a4ec0385-709e-4d71-8fc4-a77861dedbb3 req-2998ef9f-de79-4f48-8182-9d20435f5255 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:26:14.008316 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-a4ec0385-709e-4d71-8fc4-a77861dedbb3 req-2998ef9f-de79-4f48-8182-9d20435f5255 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:26:14.014246 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4ad603ae-04a7-4a4e-8e36-8b2f09feed82 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:26:14.015016 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4ad603ae-04a7-4a4e-8e36-8b2f09feed82 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 2490098c-642b-48ba-9d81-510e1c2942cb] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:26:14.019740 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-a4ec0385-709e-4d71-8fc4-a77861dedbb3 req-2998ef9f-de79-4f48-8182-9d20435f5255 service nova] Creating event network-vif-plugged:c8e780bf-9d0c-4f31-b3ba-a0f5191170a1 for instance 2490098c-642b-48ba-9d81-510e1c2942cb on n-h2-862769-1 Oct 27 04:26:14.021024 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4ad603ae-04a7-4a4e-8e36-8b2f09feed82 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:26:14.021525 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4ad603ae-04a7-4a4e-8e36-8b2f09feed82 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:26:14.021977 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4ad603ae-04a7-4a4e-8e36-8b2f09feed82 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:26:14.022713 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4ad603ae-04a7-4a4e-8e36-8b2f09feed82 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:26:14.023182 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4ad603ae-04a7-4a4e-8e36-8b2f09feed82 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:26:14.023809 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4ad603ae-04a7-4a4e-8e36-8b2f09feed82 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:26:14.025098 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-a4ec0385-709e-4d71-8fc4-a77861dedbb3 req-2998ef9f-de79-4f48-8182-9d20435f5255 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034040 Oct 27 04:26:14.025707 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3867/7442] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:26:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 04:26:14.158762 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4ad603ae-04a7-4a4e-8e36-8b2f09feed82 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:26:14.167244 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4ad603ae-04a7-4a4e-8e36-8b2f09feed82 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb" status: 200 len: 1667 microversion: 2.1 time: 0.157094 Oct 27 04:26:14.167821 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3576/7443] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:26:14 2022] GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb => generated 1667 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 04:26:14.192519 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c3be90ef-cf25-471b-b74d-1a4d22fce201 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:26:14.193249 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c3be90ef-cf25-471b-b74d-1a4d22fce201 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 2490098c-642b-48ba-9d81-510e1c2942cb] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:26:14.200075 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c3be90ef-cf25-471b-b74d-1a4d22fce201 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:26:14.200581 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c3be90ef-cf25-471b-b74d-1a4d22fce201 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:26:14.201038 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c3be90ef-cf25-471b-b74d-1a4d22fce201 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:26:14.201816 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c3be90ef-cf25-471b-b74d-1a4d22fce201 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:26:14.208284 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c3be90ef-cf25-471b-b74d-1a4d22fce201 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:26:14.208284 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c3be90ef-cf25-471b-b74d-1a4d22fce201 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:26:14.338399 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c3be90ef-cf25-471b-b74d-1a4d22fce201 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:26:14.346433 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c3be90ef-cf25-471b-b74d-1a4d22fce201 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb" status: 200 len: 1667 microversion: 2.1 time: 0.158641 Oct 27 04:26:14.347507 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3868/7444] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:26:14 2022] GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb => generated 1667 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:26:14.369539 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-61a9f488-258c-4a6d-aacb-9066fc7b1087 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:26:14.370211 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-61a9f488-258c-4a6d-aacb-9066fc7b1087 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 2490098c-642b-48ba-9d81-510e1c2942cb] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:26:14.376253 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-61a9f488-258c-4a6d-aacb-9066fc7b1087 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:26:14.376745 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-61a9f488-258c-4a6d-aacb-9066fc7b1087 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:26:14.377186 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-61a9f488-258c-4a6d-aacb-9066fc7b1087 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:26:14.377887 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-61a9f488-258c-4a6d-aacb-9066fc7b1087 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:26:14.378431 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-61a9f488-258c-4a6d-aacb-9066fc7b1087 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:26:14.378865 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-61a9f488-258c-4a6d-aacb-9066fc7b1087 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:26:14.403839 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-61a9f488-258c-4a6d-aacb-9066fc7b1087 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 2490098c-642b-48ba-9d81-510e1c2942cb] Going to try to terminate instance {{(pid=121000) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 04:26:14.660549 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-61a9f488-258c-4a6d-aacb-9066fc7b1087 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb" status: 204 len: 0 microversion: 2.1 time: 0.293709 Oct 27 04:26:14.661161 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3577/7445] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 04:26:14 2022] DELETE /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 04:26:14.669903 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c555e8b6-3511-4ae8-ae12-5395448bf14f tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:26:14.670596 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c555e8b6-3511-4ae8-ae12-5395448bf14f tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 2490098c-642b-48ba-9d81-510e1c2942cb] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:26:14.676629 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c555e8b6-3511-4ae8-ae12-5395448bf14f tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:26:14.677145 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c555e8b6-3511-4ae8-ae12-5395448bf14f tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:26:14.677607 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c555e8b6-3511-4ae8-ae12-5395448bf14f tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:26:14.678422 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c555e8b6-3511-4ae8-ae12-5395448bf14f tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:26:14.678909 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c555e8b6-3511-4ae8-ae12-5395448bf14f tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:26:14.679362 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c555e8b6-3511-4ae8-ae12-5395448bf14f tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:26:14.811950 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c555e8b6-3511-4ae8-ae12-5395448bf14f tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:26:14.820245 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c555e8b6-3511-4ae8-ae12-5395448bf14f tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb" status: 200 len: 1673 microversion: 2.1 time: 0.154463 Oct 27 04:26:14.820840 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3869/7446] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:26:14 2022] GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb => generated 1673 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:26:15.845569 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-407ff2d6-a91f-41ef-8a55-0b62b48e242b tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:26:15.846315 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-407ff2d6-a91f-41ef-8a55-0b62b48e242b tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 2490098c-642b-48ba-9d81-510e1c2942cb] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:26:15.849094 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:26:15.853801 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-407ff2d6-a91f-41ef-8a55-0b62b48e242b tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:26:15.854349 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-407ff2d6-a91f-41ef-8a55-0b62b48e242b tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:26:15.854796 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-407ff2d6-a91f-41ef-8a55-0b62b48e242b tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:26:15.855500 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-407ff2d6-a91f-41ef-8a55-0b62b48e242b tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:26:15.855959 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-407ff2d6-a91f-41ef-8a55-0b62b48e242b tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:26:15.856391 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-407ff2d6-a91f-41ef-8a55-0b62b48e242b tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:26:15.988518 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-407ff2d6-a91f-41ef-8a55-0b62b48e242b tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:26:15.996866 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-407ff2d6-a91f-41ef-8a55-0b62b48e242b tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb" status: 200 len: 1673 microversion: 2.1 time: 0.155800 Oct 27 04:26:15.997666 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3578/7447] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:26:15 2022] GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb => generated 1673 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:26:16.876978 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-22d8b5f0-7fa3-4498-a2de-7e85acedd1d8 req-a0e9b780-b551-4484-8179-957330a6a615 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2490098c-642b-48ba-9d81-510e1c2942cb", "name": "network-vif-deleted", "tag": "c8e780bf-9d0c-4f31-b3ba-a0f5191170a1"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:26:16.883063 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=39 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:26:16.888738 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-22d8b5f0-7fa3-4498-a2de-7e85acedd1d8 req-a0e9b780-b551-4484-8179-957330a6a615 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:26:16.889403 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-22d8b5f0-7fa3-4498-a2de-7e85acedd1d8 req-a0e9b780-b551-4484-8179-957330a6a615 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:26:16.889840 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-22d8b5f0-7fa3-4498-a2de-7e85acedd1d8 req-a0e9b780-b551-4484-8179-957330a6a615 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:26:16.903004 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-22d8b5f0-7fa3-4498-a2de-7e85acedd1d8 req-a0e9b780-b551-4484-8179-957330a6a615 service nova] Creating event network-vif-deleted:c8e780bf-9d0c-4f31-b3ba-a0f5191170a1 for instance 2490098c-642b-48ba-9d81-510e1c2942cb on n-h2-862769-1 Oct 27 04:26:16.908898 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-22d8b5f0-7fa3-4498-a2de-7e85acedd1d8 req-a0e9b780-b551-4484-8179-957330a6a615 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035275 Oct 27 04:26:16.910566 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3870/7448] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:26:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:26:17.021208 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2382a6b2-08bd-4433-aff4-75a4b384e397 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:26:17.022172 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-2382a6b2-08bd-4433-aff4-75a4b384e397 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 2490098c-642b-48ba-9d81-510e1c2942cb] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:26:17.029100 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2382a6b2-08bd-4433-aff4-75a4b384e397 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:26:17.029608 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2382a6b2-08bd-4433-aff4-75a4b384e397 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:26:17.030073 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2382a6b2-08bd-4433-aff4-75a4b384e397 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:26:17.030797 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2382a6b2-08bd-4433-aff4-75a4b384e397 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:26:17.031264 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2382a6b2-08bd-4433-aff4-75a4b384e397 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:26:17.031701 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2382a6b2-08bd-4433-aff4-75a4b384e397 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:26:17.102382 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2382a6b2-08bd-4433-aff4-75a4b384e397 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:26:17.110563 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2382a6b2-08bd-4433-aff4-75a4b384e397 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb" status: 200 len: 1322 microversion: 2.1 time: 0.093919 Oct 27 04:26:17.111163 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3579/7449] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:26:17 2022] GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb => generated 1322 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:26:18.137733 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f1b463d7-5267-4b45-b5a1-98a5eaf26525 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:26:18.138527 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f1b463d7-5267-4b45-b5a1-98a5eaf26525 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 2490098c-642b-48ba-9d81-510e1c2942cb] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:26:18.145901 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f1b463d7-5267-4b45-b5a1-98a5eaf26525 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:26:18.146437 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f1b463d7-5267-4b45-b5a1-98a5eaf26525 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:26:18.146902 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f1b463d7-5267-4b45-b5a1-98a5eaf26525 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:26:18.147619 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f1b463d7-5267-4b45-b5a1-98a5eaf26525 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:26:18.148097 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f1b463d7-5267-4b45-b5a1-98a5eaf26525 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:26:18.148547 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f1b463d7-5267-4b45-b5a1-98a5eaf26525 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:26:18.162491 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-f1b463d7-5267-4b45-b5a1-98a5eaf26525 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] HTTP exception thrown: Instance 2490098c-642b-48ba-9d81-510e1c2942cb could not be found. Oct 27 04:26:18.164496 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f1b463d7-5267-4b45-b5a1-98a5eaf26525 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Request method failure captured: Oct 27 04:26:18.164496 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb HTTP/1.1 Oct 27 04:26:18.164496 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 04:26:18.164496 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 04:26:18.164496 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 04:26:18.164496 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 04:26:18.164496 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 04:26:18.164496 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 04:26:18.164496 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 04:26:18.164496 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 04:26:18.164496 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWggT1pShQ7YBK6vLEnUn4ThZkZHCmWwxudcjcX6Q_Qzyxxu4Tv9k9Mz8NdF1J-CqoCxrwqSYjXa2e5qz-_PVvAMi6WsvOj7WQPQINruTawh_9Huu8QwtjT2xusIZMY0glj9dlYg_3F0cuyrDKuyyLc3oA_TbX8qtqDNM9W1LEjJuGfY Oct 27 04:26:18.164496 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 04:26:18.164496 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 04:26:18.164496 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 04:26:18.164496 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 04:26:18.164496 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 04:26:18.164496 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 04:26:18.164496 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 529ab4a5a66947aebb3f09a9842e5c9f Oct 27 04:26:18.164496 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServerActionsTestJSON-403049074 Oct 27 04:26:18.164496 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 04:26:18.164496 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 04:26:18.164496 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/529ab4a5a66947aebb3f09a9842e5c9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/529ab4a5a66947aebb3f09a9842e5c9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/529ab4a5a66947aebb3f09a9842e5c9f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_529ab4a5a66947aebb3f09a9842e5c9f"}]}] Oct 27 04:26:18.164496 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServerActionsTestJSON-403049074 Oct 27 04:26:18.164496 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 529ab4a5a66947aebb3f09a9842e5c9f Oct 27 04:26:18.164496 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServerActionsTestJSON-403049074 Oct 27 04:26:18.164496 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServerActionsTestJSON-403049074-project Oct 27 04:26:18.164496 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 04:26:18.164496 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 04:26:18.164496 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 197669776fde4a6480f6cab6e5c8552f Oct 27 04:26:18.164496 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServerActionsTestJSON-403049074-project Oct 27 04:26:18.164496 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 04:26:18.164496 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 2490098c-642b-48ba-9d81-510e1c2942cb could not be found. Oct 27 04:26:18.164496 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '2490098c-642b-48ba-9d81-510e1c2942cb'} Oct 27 04:26:18.164496 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 04:26:18.164496 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:26:18.164496 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 04:26:18.164496 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 04:26:18.164496 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 04:26:18.164496 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 04:26:18.164496 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 04:26:18.164496 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 04:26:18.164496 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 04:26:18.164496 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 04:26:18.164496 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2490098c-642b-48ba-9d81-510e1c2942cb could not be found. Oct 27 04:26:18.164496 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:26:18.164496 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:26:18.164496 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:26:18.164496 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:26:18.164496 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:26:18.164496 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:26:18.164496 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 04:26:18.164496 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 04:26:18.164496 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 04:26:18.164496 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 04:26:18.164496 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 04:26:18.164496 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 04:26:18.164496 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 04:26:18.164496 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 04:26:18.164496 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 04:26:18.164496 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 04:26:18.164496 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2490098c-642b-48ba-9d81-510e1c2942cb could not be found. Oct 27 04:26:18.164496 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:26:18.164496 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:26:18.164496 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:26:18.169601 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:26:18.169601 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:26:18.169601 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:26:18.169601 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 04:26:18.169601 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 04:26:18.169601 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2490098c-642b-48ba-9d81-510e1c2942cb could not be found. Oct 27 04:26:18.169601 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:26:18.169601 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f1b463d7-5267-4b45-b5a1-98a5eaf26525 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Returning 404 to user: Instance 2490098c-642b-48ba-9d81-510e1c2942cb could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 04:26:18.169601 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f1b463d7-5267-4b45-b5a1-98a5eaf26525 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb" status: 404 len: 111 microversion: 2.1 time: 0.032924 Oct 27 04:26:18.169601 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3871/7450] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:26:18 2022] GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 04:26:18.181214 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d0f81208-dba1-4363-94e6-81fc83e65c63 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:26:18.181846 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d0f81208-dba1-4363-94e6-81fc83e65c63 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 2490098c-642b-48ba-9d81-510e1c2942cb] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:26:18.188951 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d0f81208-dba1-4363-94e6-81fc83e65c63 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:26:18.189648 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d0f81208-dba1-4363-94e6-81fc83e65c63 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:26:18.190130 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d0f81208-dba1-4363-94e6-81fc83e65c63 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:26:18.190846 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d0f81208-dba1-4363-94e6-81fc83e65c63 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:26:18.191307 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d0f81208-dba1-4363-94e6-81fc83e65c63 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:26:18.191740 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d0f81208-dba1-4363-94e6-81fc83e65c63 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:26:18.207568 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-d0f81208-dba1-4363-94e6-81fc83e65c63 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] HTTP exception thrown: Instance 2490098c-642b-48ba-9d81-510e1c2942cb could not be found. Oct 27 04:26:18.209240 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d0f81208-dba1-4363-94e6-81fc83e65c63 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Request method failure captured: Oct 27 04:26:18.209240 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb HTTP/1.1 Oct 27 04:26:18.209240 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 04:26:18.209240 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 04:26:18.209240 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 04:26:18.209240 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 04:26:18.209240 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 04:26:18.209240 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 04:26:18.209240 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 04:26:18.209240 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 04:26:18.209240 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWggT1pShQ7YBK6vLEnUn4ThZkZHCmWwxudcjcX6Q_Qzyxxu4Tv9k9Mz8NdF1J-CqoCxrwqSYjXa2e5qz-_PVvAMi6WsvOj7WQPQINruTawh_9Huu8QwtjT2xusIZMY0glj9dlYg_3F0cuyrDKuyyLc3oA_TbX8qtqDNM9W1LEjJuGfY Oct 27 04:26:18.209240 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 04:26:18.209240 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 04:26:18.209240 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 04:26:18.209240 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 04:26:18.209240 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 04:26:18.209240 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 04:26:18.209240 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 529ab4a5a66947aebb3f09a9842e5c9f Oct 27 04:26:18.209240 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ServerActionsTestJSON-403049074 Oct 27 04:26:18.209240 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 04:26:18.209240 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 04:26:18.209240 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/529ab4a5a66947aebb3f09a9842e5c9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/529ab4a5a66947aebb3f09a9842e5c9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/529ab4a5a66947aebb3f09a9842e5c9f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_529ab4a5a66947aebb3f09a9842e5c9f"}]}] Oct 27 04:26:18.209240 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ServerActionsTestJSON-403049074 Oct 27 04:26:18.209240 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 529ab4a5a66947aebb3f09a9842e5c9f Oct 27 04:26:18.209240 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ServerActionsTestJSON-403049074 Oct 27 04:26:18.209240 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ServerActionsTestJSON-403049074-project Oct 27 04:26:18.209240 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 04:26:18.209240 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 04:26:18.209240 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 197669776fde4a6480f6cab6e5c8552f Oct 27 04:26:18.209240 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ServerActionsTestJSON-403049074-project Oct 27 04:26:18.209240 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 04:26:18.209240 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 2490098c-642b-48ba-9d81-510e1c2942cb could not be found. Oct 27 04:26:18.209240 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '2490098c-642b-48ba-9d81-510e1c2942cb'} Oct 27 04:26:18.209240 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 04:26:18.209240 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:26:18.209240 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 04:26:18.209240 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 04:26:18.209240 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 04:26:18.209240 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 04:26:18.209240 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 04:26:18.209240 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 04:26:18.209240 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 04:26:18.209240 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 04:26:18.209240 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2490098c-642b-48ba-9d81-510e1c2942cb could not be found. Oct 27 04:26:18.209240 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:26:18.209240 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:26:18.209240 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:26:18.209240 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:26:18.209240 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:26:18.209240 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:26:18.209240 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 04:26:18.209240 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 04:26:18.209240 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 04:26:18.209240 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 04:26:18.209240 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 04:26:18.209240 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 04:26:18.209240 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 04:26:18.209240 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 04:26:18.209240 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 04:26:18.209240 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 04:26:18.209240 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2490098c-642b-48ba-9d81-510e1c2942cb could not be found. Oct 27 04:26:18.209240 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:26:18.209240 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:26:18.209240 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:26:18.213527 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:26:18.213527 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:26:18.213527 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:26:18.213527 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 04:26:18.213527 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 04:26:18.213527 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2490098c-642b-48ba-9d81-510e1c2942cb could not be found. Oct 27 04:26:18.213527 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:26:18.213527 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d0f81208-dba1-4363-94e6-81fc83e65c63 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Returning 404 to user: Instance 2490098c-642b-48ba-9d81-510e1c2942cb could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 04:26:18.213527 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d0f81208-dba1-4363-94e6-81fc83e65c63 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb" status: 404 len: 111 microversion: 2.1 time: 0.033602 Oct 27 04:26:18.213527 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3580/7451] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:26:18 2022] GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 04:26:18.260164 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e9c1ba8e-4fa2-42d2-a048-379dca069dcf tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1079870339", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": [{"uuid": "0b9e776d-e4d4-4487-af56-34380c1641ff"}], "security_groups": [{"name": "tempest-securitygroup--204964459"}], "key_name": "tempest-keypair-673070032", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:26:18.363823 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.network.neutron [None req-e9c1ba8e-4fa2-42d2-a048-379dca069dcf tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] validate_networks() for [('0b9e776d-e4d4-4487-af56-34380c1641ff', None, None, None, None, None)] {{(pid=121001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 04:26:18.739797 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-e9c1ba8e-4fa2-42d2-a048-379dca069dcf tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Flavor limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 04:26:18.740251 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-e9c1ba8e-4fa2-42d2-a048-379dca069dcf tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Image limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 04:26:18.740780 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-e9c1ba8e-4fa2-42d2-a048-379dca069dcf tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Flavor pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 04:26:18.741265 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-e9c1ba8e-4fa2-42d2-a048-379dca069dcf tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Image pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 04:26:18.741704 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-e9c1ba8e-4fa2-42d2-a048-379dca069dcf tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 04:26:18.750562 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e9c1ba8e-4fa2-42d2-a048-379dca069dcf tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:26:18.751066 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e9c1ba8e-4fa2-42d2-a048-379dca069dcf tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:26:18.751527 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e9c1ba8e-4fa2-42d2-a048-379dca069dcf tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:26:18.752284 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e9c1ba8e-4fa2-42d2-a048-379dca069dcf tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:26:18.752763 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e9c1ba8e-4fa2-42d2-a048-379dca069dcf tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:26:18.753733 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e9c1ba8e-4fa2-42d2-a048-379dca069dcf tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:26:18.770838 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-e9c1ba8e-4fa2-42d2-a048-379dca069dcf tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Getting quotas for project 529ab4a5a66947aebb3f09a9842e5c9f. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 04:26:18.776051 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-e9c1ba8e-4fa2-42d2-a048-379dca069dcf tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Getting quotas for user 197669776fde4a6480f6cab6e5c8552f and project 529ab4a5a66947aebb3f09a9842e5c9f. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 04:26:18.788189 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e9c1ba8e-4fa2-42d2-a048-379dca069dcf tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Going to run 1 instances... {{(pid=121001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 04:26:18.790541 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e9c1ba8e-4fa2-42d2-a048-379dca069dcf tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 140a45b7-622a-4009-97d0-d15266fd54ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 04:26:18.890423 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e9c1ba8e-4fa2-42d2-a048-379dca069dcf tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.633906 Oct 27 04:26:18.891003 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3872/7452] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 04:26:18 2022] POST /compute/v2.1/servers => generated 405 bytes in 635 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 04:26:18.903099 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-003dd93f-21c5-4dba-af59-5347b2dca904 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:26:18.903755 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-003dd93f-21c5-4dba-af59-5347b2dca904 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 140a45b7-622a-4009-97d0-d15266fd54ca] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:26:18.973561 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-003dd93f-21c5-4dba-af59-5347b2dca904 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:26:18.973561 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-003dd93f-21c5-4dba-af59-5347b2dca904 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca" status: 200 len: 1238 microversion: 2.1 time: 0.068625 Oct 27 04:26:18.973561 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3581/7453] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:26:18 2022] GET /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca => generated 1238 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 04:26:19.996015 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f8541e0d-6da7-40ba-80d9-518a61dc87b5 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:26:19.996689 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f8541e0d-6da7-40ba-80d9-518a61dc87b5 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 140a45b7-622a-4009-97d0-d15266fd54ca] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:26:20.004143 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f8541e0d-6da7-40ba-80d9-518a61dc87b5 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:26:20.006467 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f8541e0d-6da7-40ba-80d9-518a61dc87b5 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:26:20.006467 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f8541e0d-6da7-40ba-80d9-518a61dc87b5 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:26:20.006467 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f8541e0d-6da7-40ba-80d9-518a61dc87b5 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:26:20.006467 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f8541e0d-6da7-40ba-80d9-518a61dc87b5 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:26:20.007022 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f8541e0d-6da7-40ba-80d9-518a61dc87b5 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:26:20.072974 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f8541e0d-6da7-40ba-80d9-518a61dc87b5 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:26:20.080892 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f8541e0d-6da7-40ba-80d9-518a61dc87b5 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca" status: 200 len: 1234 microversion: 2.1 time: 0.089750 Oct 27 04:26:20.081463 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3873/7454] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:26:19 2022] GET /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca => generated 1234 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:26:21.105151 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ce23710b-cfc0-4de3-9501-3e0bc555c797 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:26:21.105859 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ce23710b-cfc0-4de3-9501-3e0bc555c797 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 140a45b7-622a-4009-97d0-d15266fd54ca] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:26:21.113765 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ce23710b-cfc0-4de3-9501-3e0bc555c797 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:26:21.114374 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ce23710b-cfc0-4de3-9501-3e0bc555c797 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:26:21.114889 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ce23710b-cfc0-4de3-9501-3e0bc555c797 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:26:21.115600 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ce23710b-cfc0-4de3-9501-3e0bc555c797 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:26:21.116063 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ce23710b-cfc0-4de3-9501-3e0bc555c797 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:26:21.116498 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ce23710b-cfc0-4de3-9501-3e0bc555c797 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:26:21.218705 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ce23710b-cfc0-4de3-9501-3e0bc555c797 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:26:21.229899 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ce23710b-cfc0-4de3-9501-3e0bc555c797 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca" status: 200 len: 1296 microversion: 2.1 time: 0.128776 Oct 27 04:26:21.230851 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3582/7455] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:26:21 2022] GET /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca => generated 1296 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:26:22.261786 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3bae31a5-4541-4194-9030-29dc5f9275de tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:26:22.262658 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3bae31a5-4541-4194-9030-29dc5f9275de tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 140a45b7-622a-4009-97d0-d15266fd54ca] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:26:22.269833 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3bae31a5-4541-4194-9030-29dc5f9275de tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:26:22.282084 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3bae31a5-4541-4194-9030-29dc5f9275de tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:26:22.282084 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3bae31a5-4541-4194-9030-29dc5f9275de tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:26:22.282084 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3bae31a5-4541-4194-9030-29dc5f9275de tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:26:22.282084 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3bae31a5-4541-4194-9030-29dc5f9275de tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:26:22.282084 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3bae31a5-4541-4194-9030-29dc5f9275de tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:26:22.411042 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3bae31a5-4541-4194-9030-29dc5f9275de tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:26:22.419179 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3bae31a5-4541-4194-9030-29dc5f9275de tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca" status: 200 len: 1363 microversion: 2.1 time: 0.161294 Oct 27 04:26:22.419777 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3874/7456] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:26:22 2022] GET /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 04:26:22.736679 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-f7ea75a4-6d4c-432b-be95-224426efea25 req-70f0b905-7c01-44c1-8ce9-565bd67240c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "140a45b7-622a-4009-97d0-d15266fd54ca", "tag": "fc9013f4-a467-4797-a1cd-634341f6714f"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:26:22.747108 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-f7ea75a4-6d4c-432b-be95-224426efea25 req-70f0b905-7c01-44c1-8ce9-565bd67240c0 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:26:22.747595 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-f7ea75a4-6d4c-432b-be95-224426efea25 req-70f0b905-7c01-44c1-8ce9-565bd67240c0 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:26:22.749763 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-f7ea75a4-6d4c-432b-be95-224426efea25 req-70f0b905-7c01-44c1-8ce9-565bd67240c0 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:26:22.759573 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-f7ea75a4-6d4c-432b-be95-224426efea25 req-70f0b905-7c01-44c1-8ce9-565bd67240c0 service nova] Creating event network-changed:fc9013f4-a467-4797-a1cd-634341f6714f for instance 140a45b7-622a-4009-97d0-d15266fd54ca on n-h2-862769-1 Oct 27 04:26:22.764921 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-f7ea75a4-6d4c-432b-be95-224426efea25 req-70f0b905-7c01-44c1-8ce9-565bd67240c0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031969 Oct 27 04:26:22.765817 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3583/7457] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:26:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:26:23.444312 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6179874b-fbc9-4d85-9869-7575f850a833 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:26:23.444955 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-6179874b-fbc9-4d85-9869-7575f850a833 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 140a45b7-622a-4009-97d0-d15266fd54ca] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:26:23.452029 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6179874b-fbc9-4d85-9869-7575f850a833 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:26:23.452611 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6179874b-fbc9-4d85-9869-7575f850a833 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:26:23.453075 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6179874b-fbc9-4d85-9869-7575f850a833 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:26:23.453802 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6179874b-fbc9-4d85-9869-7575f850a833 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:26:23.454309 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6179874b-fbc9-4d85-9869-7575f850a833 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:26:23.454762 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6179874b-fbc9-4d85-9869-7575f850a833 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:26:23.584240 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6179874b-fbc9-4d85-9869-7575f850a833 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:26:23.592270 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6179874b-fbc9-4d85-9869-7575f850a833 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca" status: 200 len: 1363 microversion: 2.1 time: 0.152529 Oct 27 04:26:23.593890 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3875/7458] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:26:23 2022] GET /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:26:24.618374 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6265fc01-224f-40fe-bb03-27385864a3e6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:26:24.619095 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6265fc01-224f-40fe-bb03-27385864a3e6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 140a45b7-622a-4009-97d0-d15266fd54ca] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:26:24.625246 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6265fc01-224f-40fe-bb03-27385864a3e6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:26:24.625754 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6265fc01-224f-40fe-bb03-27385864a3e6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:26:24.626302 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6265fc01-224f-40fe-bb03-27385864a3e6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:26:24.627006 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6265fc01-224f-40fe-bb03-27385864a3e6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:26:24.627475 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6265fc01-224f-40fe-bb03-27385864a3e6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:26:24.627911 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6265fc01-224f-40fe-bb03-27385864a3e6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:26:24.756732 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-6265fc01-224f-40fe-bb03-27385864a3e6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:26:24.764558 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6265fc01-224f-40fe-bb03-27385864a3e6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca" status: 200 len: 1363 microversion: 2.1 time: 0.151997 Oct 27 04:26:24.765144 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3584/7459] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:26:24 2022] GET /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:26:25.788139 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-85827a45-d943-4eab-9d8f-632e32d3527f tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:26:25.789392 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-85827a45-d943-4eab-9d8f-632e32d3527f tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 140a45b7-622a-4009-97d0-d15266fd54ca] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:26:25.796440 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-85827a45-d943-4eab-9d8f-632e32d3527f tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:26:25.796946 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-85827a45-d943-4eab-9d8f-632e32d3527f tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:26:25.797465 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-85827a45-d943-4eab-9d8f-632e32d3527f tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:26:25.798208 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-85827a45-d943-4eab-9d8f-632e32d3527f tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:26:25.798687 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-85827a45-d943-4eab-9d8f-632e32d3527f tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:26:25.799137 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-85827a45-d943-4eab-9d8f-632e32d3527f tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:26:25.930419 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-85827a45-d943-4eab-9d8f-632e32d3527f tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:26:25.938077 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-85827a45-d943-4eab-9d8f-632e32d3527f tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca" status: 200 len: 1363 microversion: 2.1 time: 0.153934 Oct 27 04:26:25.938639 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3876/7460] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:26:25 2022] GET /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:26:26.961991 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3dabd25c-9279-4887-801a-a32797957a4d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:26:26.962640 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-3dabd25c-9279-4887-801a-a32797957a4d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 140a45b7-622a-4009-97d0-d15266fd54ca] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:26:26.969661 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3dabd25c-9279-4887-801a-a32797957a4d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:26:26.970211 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3dabd25c-9279-4887-801a-a32797957a4d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:26:26.970658 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3dabd25c-9279-4887-801a-a32797957a4d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:26:26.971609 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3dabd25c-9279-4887-801a-a32797957a4d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:26:26.971809 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3dabd25c-9279-4887-801a-a32797957a4d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:26:26.972239 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3dabd25c-9279-4887-801a-a32797957a4d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:26:27.102848 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-3dabd25c-9279-4887-801a-a32797957a4d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:26:27.110651 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3dabd25c-9279-4887-801a-a32797957a4d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca" status: 200 len: 1363 microversion: 2.1 time: 0.152580 Oct 27 04:26:27.111225 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3585/7461] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:26:26 2022] GET /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:26:28.135358 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9ae79630-be8d-40a6-8881-e1b9cfb5cb31 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:26:28.136151 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-9ae79630-be8d-40a6-8881-e1b9cfb5cb31 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 140a45b7-622a-4009-97d0-d15266fd54ca] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:26:28.143135 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9ae79630-be8d-40a6-8881-e1b9cfb5cb31 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:26:28.143646 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9ae79630-be8d-40a6-8881-e1b9cfb5cb31 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:26:28.144106 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9ae79630-be8d-40a6-8881-e1b9cfb5cb31 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:26:28.144832 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9ae79630-be8d-40a6-8881-e1b9cfb5cb31 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:26:28.145310 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9ae79630-be8d-40a6-8881-e1b9cfb5cb31 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:26:28.145755 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9ae79630-be8d-40a6-8881-e1b9cfb5cb31 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:26:28.273668 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9ae79630-be8d-40a6-8881-e1b9cfb5cb31 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:26:28.281474 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9ae79630-be8d-40a6-8881-e1b9cfb5cb31 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca" status: 200 len: 1363 microversion: 2.1 time: 0.150058 Oct 27 04:26:28.282084 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3877/7462] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:26:28 2022] GET /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:26:29.306713 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-11ebf187-e033-45b8-9fb9-6887540cc779 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:26:29.307241 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-11ebf187-e033-45b8-9fb9-6887540cc779 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 140a45b7-622a-4009-97d0-d15266fd54ca] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:26:29.309620 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:26:29.314517 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-11ebf187-e033-45b8-9fb9-6887540cc779 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:26:29.315006 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-11ebf187-e033-45b8-9fb9-6887540cc779 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:26:29.315446 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-11ebf187-e033-45b8-9fb9-6887540cc779 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:26:29.316183 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-11ebf187-e033-45b8-9fb9-6887540cc779 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:26:29.316657 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-11ebf187-e033-45b8-9fb9-6887540cc779 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:26:29.317104 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-11ebf187-e033-45b8-9fb9-6887540cc779 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:26:29.449306 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-11ebf187-e033-45b8-9fb9-6887540cc779 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:26:29.457058 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-11ebf187-e033-45b8-9fb9-6887540cc779 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca" status: 200 len: 1363 microversion: 2.1 time: 0.154756 Oct 27 04:26:29.457642 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3586/7463] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:26:29 2022] GET /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:26:30.062554 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:26:30.063614 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=6 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:26:30.116074 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-b3412e3c-ed5a-4c7d-9c70-8fd296bb13b9 req-e6985e0b-0575-4281-9ae3-f3b7af5a9fcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "140a45b7-622a-4009-97d0-d15266fd54ca", "name": "network-vif-plugged", "status": "completed", "tag": "fc9013f4-a467-4797-a1cd-634341f6714f"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:26:30.125882 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-b3412e3c-ed5a-4c7d-9c70-8fd296bb13b9 req-e6985e0b-0575-4281-9ae3-f3b7af5a9fcc service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:26:30.126396 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-b3412e3c-ed5a-4c7d-9c70-8fd296bb13b9 req-e6985e0b-0575-4281-9ae3-f3b7af5a9fcc service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:26:30.126850 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-b3412e3c-ed5a-4c7d-9c70-8fd296bb13b9 req-e6985e0b-0575-4281-9ae3-f3b7af5a9fcc service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:26:30.137657 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-b3412e3c-ed5a-4c7d-9c70-8fd296bb13b9 req-e6985e0b-0575-4281-9ae3-f3b7af5a9fcc service nova] Creating event network-vif-plugged:fc9013f4-a467-4797-a1cd-634341f6714f for instance 140a45b7-622a-4009-97d0-d15266fd54ca on n-h2-862769-1 Oct 27 04:26:30.142858 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-b3412e3c-ed5a-4c7d-9c70-8fd296bb13b9 req-e6985e0b-0575-4281-9ae3-f3b7af5a9fcc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085120 Oct 27 04:26:30.143623 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3878/7464] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:26:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:26:30.480888 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6d40dff7-4e6f-41a0-9966-bc2b5a204a2c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:26:30.481427 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6d40dff7-4e6f-41a0-9966-bc2b5a204a2c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 140a45b7-622a-4009-97d0-d15266fd54ca] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:26:30.488338 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6d40dff7-4e6f-41a0-9966-bc2b5a204a2c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:26:30.488830 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6d40dff7-4e6f-41a0-9966-bc2b5a204a2c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:26:30.489284 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6d40dff7-4e6f-41a0-9966-bc2b5a204a2c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:26:30.489995 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6d40dff7-4e6f-41a0-9966-bc2b5a204a2c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:26:30.490494 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6d40dff7-4e6f-41a0-9966-bc2b5a204a2c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:26:30.490933 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6d40dff7-4e6f-41a0-9966-bc2b5a204a2c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:26:30.624772 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-6d40dff7-4e6f-41a0-9966-bc2b5a204a2c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:26:30.633108 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6d40dff7-4e6f-41a0-9966-bc2b5a204a2c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca" status: 200 len: 1363 microversion: 2.1 time: 0.156239 Oct 27 04:26:30.633681 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3587/7465] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:26:30 2022] GET /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:26:31.658761 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8a8396c7-4bc7-4f4a-87e1-f5b212140051 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:26:31.659490 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8a8396c7-4bc7-4f4a-87e1-f5b212140051 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 140a45b7-622a-4009-97d0-d15266fd54ca] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:26:31.665654 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8a8396c7-4bc7-4f4a-87e1-f5b212140051 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:26:31.666207 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8a8396c7-4bc7-4f4a-87e1-f5b212140051 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:26:31.666669 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8a8396c7-4bc7-4f4a-87e1-f5b212140051 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:26:31.667383 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8a8396c7-4bc7-4f4a-87e1-f5b212140051 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:26:31.667861 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8a8396c7-4bc7-4f4a-87e1-f5b212140051 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:26:31.668309 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8a8396c7-4bc7-4f4a-87e1-f5b212140051 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:26:31.798838 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8a8396c7-4bc7-4f4a-87e1-f5b212140051 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:26:31.807070 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8a8396c7-4bc7-4f4a-87e1-f5b212140051 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca" status: 200 len: 1550 microversion: 2.1 time: 0.153863 Oct 27 04:26:31.807642 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3879/7466] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:26:31 2022] GET /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca => generated 1550 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:26:31.830930 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-36c6eb7c-ad52-48dd-98a7-72f07294b37d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:26:31.831442 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-36c6eb7c-ad52-48dd-98a7-72f07294b37d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 140a45b7-622a-4009-97d0-d15266fd54ca] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:26:31.838330 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-36c6eb7c-ad52-48dd-98a7-72f07294b37d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:26:31.838827 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-36c6eb7c-ad52-48dd-98a7-72f07294b37d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:26:31.839311 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-36c6eb7c-ad52-48dd-98a7-72f07294b37d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:26:31.840030 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-36c6eb7c-ad52-48dd-98a7-72f07294b37d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:26:31.840500 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-36c6eb7c-ad52-48dd-98a7-72f07294b37d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:26:31.841197 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-36c6eb7c-ad52-48dd-98a7-72f07294b37d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:26:31.919090 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-36c6eb7c-ad52-48dd-98a7-72f07294b37d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092360 Oct 27 04:26:31.919746 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3588/7467] 10.222.0.20 () {58 vars in 1275 bytes} [Thu Oct 27 04:26:31 2022] GET /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:26:33.282727 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-e10e5030-7413-40d2-b9ae-aa531f65438c req-a0a03a75-f2bd-45f4-86da-bfaf7cf1d397 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "140a45b7-622a-4009-97d0-d15266fd54ca", "tag": "fc9013f4-a467-4797-a1cd-634341f6714f"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:26:33.295994 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-e10e5030-7413-40d2-b9ae-aa531f65438c req-a0a03a75-f2bd-45f4-86da-bfaf7cf1d397 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:26:33.296743 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-e10e5030-7413-40d2-b9ae-aa531f65438c req-a0a03a75-f2bd-45f4-86da-bfaf7cf1d397 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:26:33.298724 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-e10e5030-7413-40d2-b9ae-aa531f65438c req-a0a03a75-f2bd-45f4-86da-bfaf7cf1d397 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:26:33.309587 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-e10e5030-7413-40d2-b9ae-aa531f65438c req-a0a03a75-f2bd-45f4-86da-bfaf7cf1d397 service nova] Creating event network-changed:fc9013f4-a467-4797-a1cd-634341f6714f for instance 140a45b7-622a-4009-97d0-d15266fd54ca on n-h2-862769-1 Oct 27 04:26:33.314605 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-e10e5030-7413-40d2-b9ae-aa531f65438c req-a0a03a75-f2bd-45f4-86da-bfaf7cf1d397 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091469 Oct 27 04:26:33.315222 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3880/7468] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:26:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:27:06.155385 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=23 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:27:06.156158 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:27:06.160196 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5e63a0d4-b4a0-4b6e-95ae-3eaf06431467 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:27:06.166019 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5e63a0d4-b4a0-4b6e-95ae-3eaf06431467 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:06.170356 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5e63a0d4-b4a0-4b6e-95ae-3eaf06431467 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:06.170356 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5e63a0d4-b4a0-4b6e-95ae-3eaf06431467 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:06.190177 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5e63a0d4-b4a0-4b6e-95ae-3eaf06431467 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 140a45b7-622a-4009-97d0-d15266fd54ca] Going to try to stop instance {{(pid=121000) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 27 04:27:06.319050 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5e63a0d4-b4a0-4b6e-95ae-3eaf06431467 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "POST /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca/action" status: 202 len: 0 microversion: 2.1 time: 0.165462 Oct 27 04:27:06.319688 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3589/7469] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 04:27:06 2022] POST /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca/action => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 04:27:06.326725 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:27:06.327504 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=61 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:27:06.331673 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f5e79ffa-b08e-4d17-b200-dbe5936b6d11 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:27:06.332799 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f5e79ffa-b08e-4d17-b200-dbe5936b6d11 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 140a45b7-622a-4009-97d0-d15266fd54ca] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:27:06.338555 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f5e79ffa-b08e-4d17-b200-dbe5936b6d11 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:06.339064 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f5e79ffa-b08e-4d17-b200-dbe5936b6d11 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:06.339524 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f5e79ffa-b08e-4d17-b200-dbe5936b6d11 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:06.340239 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f5e79ffa-b08e-4d17-b200-dbe5936b6d11 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:06.340715 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f5e79ffa-b08e-4d17-b200-dbe5936b6d11 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:06.341161 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f5e79ffa-b08e-4d17-b200-dbe5936b6d11 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:06.476359 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f5e79ffa-b08e-4d17-b200-dbe5936b6d11 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:27:06.485117 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f5e79ffa-b08e-4d17-b200-dbe5936b6d11 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca" status: 200 len: 1679 microversion: 2.1 time: 0.160672 Oct 27 04:27:06.485968 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3881/7470] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:27:06 2022] GET /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:27:07.511516 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-27cd969e-352e-4989-99fc-79aa34dc085f tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:27:07.512238 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-27cd969e-352e-4989-99fc-79aa34dc085f tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 140a45b7-622a-4009-97d0-d15266fd54ca] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:27:07.518479 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-27cd969e-352e-4989-99fc-79aa34dc085f tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:07.518980 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-27cd969e-352e-4989-99fc-79aa34dc085f tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:07.519437 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-27cd969e-352e-4989-99fc-79aa34dc085f tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:07.520892 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-27cd969e-352e-4989-99fc-79aa34dc085f tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:07.521362 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-27cd969e-352e-4989-99fc-79aa34dc085f tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:07.521803 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-27cd969e-352e-4989-99fc-79aa34dc085f tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:07.653548 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-27cd969e-352e-4989-99fc-79aa34dc085f tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:27:07.661298 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-27cd969e-352e-4989-99fc-79aa34dc085f tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca" status: 200 len: 1679 microversion: 2.1 time: 0.154994 Oct 27 04:27:07.661877 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3590/7471] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:27:07 2022] GET /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:27:08.685585 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e1b3b1ec-800b-4a0a-b00e-bc5180189c93 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:27:08.686261 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e1b3b1ec-800b-4a0a-b00e-bc5180189c93 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 140a45b7-622a-4009-97d0-d15266fd54ca] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:27:08.693670 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e1b3b1ec-800b-4a0a-b00e-bc5180189c93 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:08.694206 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e1b3b1ec-800b-4a0a-b00e-bc5180189c93 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:08.694672 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e1b3b1ec-800b-4a0a-b00e-bc5180189c93 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:08.695390 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e1b3b1ec-800b-4a0a-b00e-bc5180189c93 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:08.695860 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e1b3b1ec-800b-4a0a-b00e-bc5180189c93 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:08.696308 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e1b3b1ec-800b-4a0a-b00e-bc5180189c93 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:08.822361 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e1b3b1ec-800b-4a0a-b00e-bc5180189c93 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:27:08.830124 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e1b3b1ec-800b-4a0a-b00e-bc5180189c93 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca" status: 200 len: 1679 microversion: 2.1 time: 0.148485 Oct 27 04:27:08.830699 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3882/7472] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:27:08 2022] GET /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca => generated 1679 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:27:09.852623 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0944efe7-1dbf-4678-b2a9-9952cc2686a3 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:27:09.853234 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0944efe7-1dbf-4678-b2a9-9952cc2686a3 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 140a45b7-622a-4009-97d0-d15266fd54ca] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:27:09.859959 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0944efe7-1dbf-4678-b2a9-9952cc2686a3 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:09.860447 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0944efe7-1dbf-4678-b2a9-9952cc2686a3 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:09.860890 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0944efe7-1dbf-4678-b2a9-9952cc2686a3 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:09.861597 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0944efe7-1dbf-4678-b2a9-9952cc2686a3 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:09.862060 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0944efe7-1dbf-4678-b2a9-9952cc2686a3 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:09.862500 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0944efe7-1dbf-4678-b2a9-9952cc2686a3 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:09.993401 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0944efe7-1dbf-4678-b2a9-9952cc2686a3 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:27:10.001211 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0944efe7-1dbf-4678-b2a9-9952cc2686a3 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca" status: 200 len: 1679 microversion: 2.1 time: 0.152483 Oct 27 04:27:10.001793 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3591/7473] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:27:09 2022] GET /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:27:11.025212 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-638592c2-51ba-407d-839d-f7248edd2498 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:27:11.025850 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-638592c2-51ba-407d-839d-f7248edd2498 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 140a45b7-622a-4009-97d0-d15266fd54ca] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:27:11.032667 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-638592c2-51ba-407d-839d-f7248edd2498 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:11.033163 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-638592c2-51ba-407d-839d-f7248edd2498 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:11.033615 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-638592c2-51ba-407d-839d-f7248edd2498 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:11.034351 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-638592c2-51ba-407d-839d-f7248edd2498 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:11.034822 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-638592c2-51ba-407d-839d-f7248edd2498 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:11.035882 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-638592c2-51ba-407d-839d-f7248edd2498 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:11.168422 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-638592c2-51ba-407d-839d-f7248edd2498 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:27:11.176088 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-638592c2-51ba-407d-839d-f7248edd2498 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca" status: 200 len: 1679 microversion: 2.1 time: 0.154796 Oct 27 04:27:11.176663 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3883/7474] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:27:11 2022] GET /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:27:12.199706 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b9a10874-4be4-486b-8ae3-74af839861ea tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:27:12.200327 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b9a10874-4be4-486b-8ae3-74af839861ea tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 140a45b7-622a-4009-97d0-d15266fd54ca] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:27:12.207218 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b9a10874-4be4-486b-8ae3-74af839861ea tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:12.207568 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b9a10874-4be4-486b-8ae3-74af839861ea tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:12.208011 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b9a10874-4be4-486b-8ae3-74af839861ea tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:12.208706 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b9a10874-4be4-486b-8ae3-74af839861ea tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:12.209172 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b9a10874-4be4-486b-8ae3-74af839861ea tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:12.209601 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b9a10874-4be4-486b-8ae3-74af839861ea tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:12.340953 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b9a10874-4be4-486b-8ae3-74af839861ea tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:27:12.349532 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b9a10874-4be4-486b-8ae3-74af839861ea tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca" status: 200 len: 1679 microversion: 2.1 time: 0.153745 Oct 27 04:27:12.350134 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3592/7475] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:27:12 2022] GET /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:27:13.372519 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-50722b15-0238-4020-8265-b3e41da7d83a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:27:13.373172 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-50722b15-0238-4020-8265-b3e41da7d83a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 140a45b7-622a-4009-97d0-d15266fd54ca] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:27:13.379984 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-50722b15-0238-4020-8265-b3e41da7d83a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:13.380487 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-50722b15-0238-4020-8265-b3e41da7d83a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:13.380948 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-50722b15-0238-4020-8265-b3e41da7d83a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:13.381664 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-50722b15-0238-4020-8265-b3e41da7d83a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:13.382173 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-50722b15-0238-4020-8265-b3e41da7d83a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:13.382623 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-50722b15-0238-4020-8265-b3e41da7d83a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:13.510213 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-50722b15-0238-4020-8265-b3e41da7d83a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:27:13.517838 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-50722b15-0238-4020-8265-b3e41da7d83a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca" status: 200 len: 1679 microversion: 2.1 time: 0.149282 Oct 27 04:27:13.518446 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3884/7476] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:27:13 2022] GET /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca => generated 1679 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:27:14.541417 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f8dbc2cc-a282-4419-8fd0-aec4793611e7 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:27:14.542064 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f8dbc2cc-a282-4419-8fd0-aec4793611e7 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 140a45b7-622a-4009-97d0-d15266fd54ca] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:27:14.548944 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f8dbc2cc-a282-4419-8fd0-aec4793611e7 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:14.549478 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f8dbc2cc-a282-4419-8fd0-aec4793611e7 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:14.550121 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f8dbc2cc-a282-4419-8fd0-aec4793611e7 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:14.550647 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f8dbc2cc-a282-4419-8fd0-aec4793611e7 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:14.551188 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f8dbc2cc-a282-4419-8fd0-aec4793611e7 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:14.551553 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f8dbc2cc-a282-4419-8fd0-aec4793611e7 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:14.682983 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f8dbc2cc-a282-4419-8fd0-aec4793611e7 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:27:14.690882 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f8dbc2cc-a282-4419-8fd0-aec4793611e7 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca" status: 200 len: 1679 microversion: 2.1 time: 0.153436 Oct 27 04:27:14.691459 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3593/7477] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:27:14 2022] GET /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:27:15.714321 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1012a7b1-eefe-4407-b88e-6c1926c5bed0 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:27:15.714992 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1012a7b1-eefe-4407-b88e-6c1926c5bed0 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 140a45b7-622a-4009-97d0-d15266fd54ca] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:27:15.722144 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1012a7b1-eefe-4407-b88e-6c1926c5bed0 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:15.723186 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1012a7b1-eefe-4407-b88e-6c1926c5bed0 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:15.723653 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1012a7b1-eefe-4407-b88e-6c1926c5bed0 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:15.724369 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1012a7b1-eefe-4407-b88e-6c1926c5bed0 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:15.724847 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1012a7b1-eefe-4407-b88e-6c1926c5bed0 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:15.725294 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1012a7b1-eefe-4407-b88e-6c1926c5bed0 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:15.855221 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1012a7b1-eefe-4407-b88e-6c1926c5bed0 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:27:15.863229 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1012a7b1-eefe-4407-b88e-6c1926c5bed0 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca" status: 200 len: 1679 microversion: 2.1 time: 0.152822 Oct 27 04:27:15.864324 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3885/7478] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:27:15 2022] GET /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:27:16.887590 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1ea1f89f-0eee-4b32-8443-58493fafee46 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:27:16.888118 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1ea1f89f-0eee-4b32-8443-58493fafee46 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 140a45b7-622a-4009-97d0-d15266fd54ca] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:27:16.895591 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1ea1f89f-0eee-4b32-8443-58493fafee46 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:16.896087 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1ea1f89f-0eee-4b32-8443-58493fafee46 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:16.896535 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1ea1f89f-0eee-4b32-8443-58493fafee46 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:16.897238 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1ea1f89f-0eee-4b32-8443-58493fafee46 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:16.897702 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1ea1f89f-0eee-4b32-8443-58493fafee46 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:16.898172 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1ea1f89f-0eee-4b32-8443-58493fafee46 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:17.031788 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1ea1f89f-0eee-4b32-8443-58493fafee46 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:27:17.039722 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1ea1f89f-0eee-4b32-8443-58493fafee46 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca" status: 200 len: 1656 microversion: 2.1 time: 0.156254 Oct 27 04:27:17.040316 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3594/7479] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:27:16 2022] GET /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca => generated 1656 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:27:17.063371 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-30d96933-686d-459e-93a2-b4fa296008a6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:27:17.065773 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-30d96933-686d-459e-93a2-b4fa296008a6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 140a45b7-622a-4009-97d0-d15266fd54ca] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:27:17.073237 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-30d96933-686d-459e-93a2-b4fa296008a6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:17.073736 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-30d96933-686d-459e-93a2-b4fa296008a6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:17.074227 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-30d96933-686d-459e-93a2-b4fa296008a6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:17.074938 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-30d96933-686d-459e-93a2-b4fa296008a6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:17.075431 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-30d96933-686d-459e-93a2-b4fa296008a6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:17.075874 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-30d96933-686d-459e-93a2-b4fa296008a6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:17.104216 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-30d96933-686d-459e-93a2-b4fa296008a6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:27:17.109505 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-30d96933-686d-459e-93a2-b4fa296008a6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 140a45b7-622a-4009-97d0-d15266fd54ca] Old instance type m1.heat2, new instance type m1.heat {{(pid=121001) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 27 04:27:17.116957 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-30d96933-686d-459e-93a2-b4fa296008a6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Flavor limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 04:27:17.117392 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-30d96933-686d-459e-93a2-b4fa296008a6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Image limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 04:27:17.117879 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-30d96933-686d-459e-93a2-b4fa296008a6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Flavor pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 04:27:17.118336 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-30d96933-686d-459e-93a2-b4fa296008a6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Image pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 04:27:17.118765 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-30d96933-686d-459e-93a2-b4fa296008a6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 04:27:17.267653 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-30d96933-686d-459e-93a2-b4fa296008a6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "POST /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca/action" status: 202 len: 0 microversion: 2.1 time: 0.208199 Oct 27 04:27:17.268303 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3886/7480] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 04:27:17 2022] POST /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca/action => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 04:27:17.276877 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-34633a96-b3b6-427b-ac1d-428372da49a9 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:27:17.277511 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-34633a96-b3b6-427b-ac1d-428372da49a9 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 140a45b7-622a-4009-97d0-d15266fd54ca] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:27:17.283898 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-34633a96-b3b6-427b-ac1d-428372da49a9 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:17.284405 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-34633a96-b3b6-427b-ac1d-428372da49a9 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:17.284851 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-34633a96-b3b6-427b-ac1d-428372da49a9 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:17.288122 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-34633a96-b3b6-427b-ac1d-428372da49a9 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:17.288620 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-34633a96-b3b6-427b-ac1d-428372da49a9 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:17.289535 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-34633a96-b3b6-427b-ac1d-428372da49a9 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:17.429082 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-34633a96-b3b6-427b-ac1d-428372da49a9 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:27:17.436914 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-34633a96-b3b6-427b-ac1d-428372da49a9 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca" status: 200 len: 1679 microversion: 2.1 time: 0.164172 Oct 27 04:27:17.438201 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3595/7481] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:27:17 2022] GET /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 04:27:18.467418 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5a330027-7ade-4a5e-9b2d-821fd2a0e78a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:27:18.467418 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5a330027-7ade-4a5e-9b2d-821fd2a0e78a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 140a45b7-622a-4009-97d0-d15266fd54ca] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:27:18.473600 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5a330027-7ade-4a5e-9b2d-821fd2a0e78a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:18.474168 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5a330027-7ade-4a5e-9b2d-821fd2a0e78a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:18.474635 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5a330027-7ade-4a5e-9b2d-821fd2a0e78a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:18.475365 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5a330027-7ade-4a5e-9b2d-821fd2a0e78a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:18.475842 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5a330027-7ade-4a5e-9b2d-821fd2a0e78a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:18.476294 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5a330027-7ade-4a5e-9b2d-821fd2a0e78a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:18.611606 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5a330027-7ade-4a5e-9b2d-821fd2a0e78a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:27:18.619693 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5a330027-7ade-4a5e-9b2d-821fd2a0e78a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca" status: 200 len: 1679 microversion: 2.1 time: 0.162644 Oct 27 04:27:18.620278 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3887/7482] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:27:18 2022] GET /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca => generated 1679 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:27:19.643349 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0ebebc13-f64a-425e-88c5-6c07afb08d12 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:27:19.644012 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0ebebc13-f64a-425e-88c5-6c07afb08d12 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 140a45b7-622a-4009-97d0-d15266fd54ca] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:27:19.651486 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0ebebc13-f64a-425e-88c5-6c07afb08d12 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:19.651976 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0ebebc13-f64a-425e-88c5-6c07afb08d12 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:19.652422 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0ebebc13-f64a-425e-88c5-6c07afb08d12 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:19.653115 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0ebebc13-f64a-425e-88c5-6c07afb08d12 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:19.653570 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0ebebc13-f64a-425e-88c5-6c07afb08d12 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:19.654000 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0ebebc13-f64a-425e-88c5-6c07afb08d12 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:19.842755 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0ebebc13-f64a-425e-88c5-6c07afb08d12 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:27:19.850821 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0ebebc13-f64a-425e-88c5-6c07afb08d12 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca" status: 200 len: 1679 microversion: 2.1 time: 0.211405 Oct 27 04:27:19.851418 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3596/7483] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:27:19 2022] GET /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca => generated 1679 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:27:20.875332 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0efd25a2-9afe-481d-a9f7-d2aa5310e568 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:27:20.875969 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0efd25a2-9afe-481d-a9f7-d2aa5310e568 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 140a45b7-622a-4009-97d0-d15266fd54ca] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:27:20.883426 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0efd25a2-9afe-481d-a9f7-d2aa5310e568 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:20.883926 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0efd25a2-9afe-481d-a9f7-d2aa5310e568 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:20.884387 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0efd25a2-9afe-481d-a9f7-d2aa5310e568 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:20.885101 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0efd25a2-9afe-481d-a9f7-d2aa5310e568 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:20.885575 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0efd25a2-9afe-481d-a9f7-d2aa5310e568 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:20.886024 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0efd25a2-9afe-481d-a9f7-d2aa5310e568 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:21.017917 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0efd25a2-9afe-481d-a9f7-d2aa5310e568 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:27:21.025628 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0efd25a2-9afe-481d-a9f7-d2aa5310e568 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca" status: 200 len: 1684 microversion: 2.1 time: 0.154229 Oct 27 04:27:21.026226 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3888/7484] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:27:20 2022] GET /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca => generated 1684 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:27:22.049669 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c5050f0f-4576-4ee8-b192-d148a65cddda tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:27:22.050318 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c5050f0f-4576-4ee8-b192-d148a65cddda tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 140a45b7-622a-4009-97d0-d15266fd54ca] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:27:22.057122 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c5050f0f-4576-4ee8-b192-d148a65cddda tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:22.057645 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c5050f0f-4576-4ee8-b192-d148a65cddda tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:22.058123 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c5050f0f-4576-4ee8-b192-d148a65cddda tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:22.058827 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c5050f0f-4576-4ee8-b192-d148a65cddda tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:22.059292 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c5050f0f-4576-4ee8-b192-d148a65cddda tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:22.059733 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c5050f0f-4576-4ee8-b192-d148a65cddda tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:22.226375 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c5050f0f-4576-4ee8-b192-d148a65cddda tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:27:22.234160 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c5050f0f-4576-4ee8-b192-d148a65cddda tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca" status: 200 len: 1684 microversion: 2.1 time: 0.188343 Oct 27 04:27:22.234745 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3597/7485] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:27:22 2022] GET /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca => generated 1684 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:27:23.133047 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-78112946-125e-47d2-954c-de535c3c49c5 req-7ff24b1c-f22a-4967-9668-6b5a8e813ce0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "140a45b7-622a-4009-97d0-d15266fd54ca", "name": "network-vif-unplugged", "status": "completed", "tag": "fc9013f4-a467-4797-a1cd-634341f6714f"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:27:23.143601 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-78112946-125e-47d2-954c-de535c3c49c5 req-7ff24b1c-f22a-4967-9668-6b5a8e813ce0 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:23.145754 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-78112946-125e-47d2-954c-de535c3c49c5 req-7ff24b1c-f22a-4967-9668-6b5a8e813ce0 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:23.145754 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-78112946-125e-47d2-954c-de535c3c49c5 req-7ff24b1c-f22a-4967-9668-6b5a8e813ce0 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:23.156985 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-78112946-125e-47d2-954c-de535c3c49c5 req-7ff24b1c-f22a-4967-9668-6b5a8e813ce0 service nova] Creating event network-vif-unplugged:fc9013f4-a467-4797-a1cd-634341f6714f for instance 140a45b7-622a-4009-97d0-d15266fd54ca on n-h1-862769-1 Oct 27 04:27:23.162832 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [req-78112946-125e-47d2-954c-de535c3c49c5 req-7ff24b1c-f22a-4967-9668-6b5a8e813ce0 service nova] Instance 140a45b7-622a-4009-97d0-d15266fd54ca is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862769-1', 'n-h1-862769-1'} {{(pid=121001) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 04:27:23.173627 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-78112946-125e-47d2-954c-de535c3c49c5 req-7ff24b1c-f22a-4967-9668-6b5a8e813ce0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044880 Oct 27 04:27:23.174261 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3889/7486] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:27:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:27:23.256943 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5189d252-3ebe-4f6a-a9df-01e5a28d0b26 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:27:23.257587 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5189d252-3ebe-4f6a-a9df-01e5a28d0b26 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 140a45b7-622a-4009-97d0-d15266fd54ca] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:27:23.264426 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5189d252-3ebe-4f6a-a9df-01e5a28d0b26 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:23.264923 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5189d252-3ebe-4f6a-a9df-01e5a28d0b26 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:23.265371 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5189d252-3ebe-4f6a-a9df-01e5a28d0b26 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:23.266106 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5189d252-3ebe-4f6a-a9df-01e5a28d0b26 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:23.266571 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5189d252-3ebe-4f6a-a9df-01e5a28d0b26 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:23.267005 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5189d252-3ebe-4f6a-a9df-01e5a28d0b26 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:23.410398 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5189d252-3ebe-4f6a-a9df-01e5a28d0b26 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:27:23.418500 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5189d252-3ebe-4f6a-a9df-01e5a28d0b26 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca" status: 200 len: 1683 microversion: 2.1 time: 0.165483 Oct 27 04:27:23.420466 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3598/7487] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:27:23 2022] GET /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca => generated 1683 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:27:24.444214 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-55bbabb6-ed80-403d-9457-677f39146992 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:27:24.444869 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-55bbabb6-ed80-403d-9457-677f39146992 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 140a45b7-622a-4009-97d0-d15266fd54ca] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:27:24.451170 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-55bbabb6-ed80-403d-9457-677f39146992 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:24.451679 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-55bbabb6-ed80-403d-9457-677f39146992 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:24.452145 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-55bbabb6-ed80-403d-9457-677f39146992 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:24.452868 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-55bbabb6-ed80-403d-9457-677f39146992 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:24.453348 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-55bbabb6-ed80-403d-9457-677f39146992 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:24.453830 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-55bbabb6-ed80-403d-9457-677f39146992 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:24.586060 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-55bbabb6-ed80-403d-9457-677f39146992 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:27:24.599099 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-55bbabb6-ed80-403d-9457-677f39146992 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca" status: 200 len: 1683 microversion: 2.1 time: 0.155899 Oct 27 04:27:24.599099 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3890/7488] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:27:24 2022] GET /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:27:25.189229 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-4ecf08e9-13a0-4a58-af42-1f0986a486b1 req-289eaa1a-2d48-4221-8f83-23d08370b666 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "140a45b7-622a-4009-97d0-d15266fd54ca", "tag": "fc9013f4-a467-4797-a1cd-634341f6714f"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:27:25.199433 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-4ecf08e9-13a0-4a58-af42-1f0986a486b1 req-289eaa1a-2d48-4221-8f83-23d08370b666 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:25.199918 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-4ecf08e9-13a0-4a58-af42-1f0986a486b1 req-289eaa1a-2d48-4221-8f83-23d08370b666 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:25.200358 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-4ecf08e9-13a0-4a58-af42-1f0986a486b1 req-289eaa1a-2d48-4221-8f83-23d08370b666 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:25.212439 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-4ecf08e9-13a0-4a58-af42-1f0986a486b1 req-289eaa1a-2d48-4221-8f83-23d08370b666 service nova] Creating event network-changed:fc9013f4-a467-4797-a1cd-634341f6714f for instance 140a45b7-622a-4009-97d0-d15266fd54ca on n-h1-862769-1 Oct 27 04:27:25.217850 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [req-4ecf08e9-13a0-4a58-af42-1f0986a486b1 req-289eaa1a-2d48-4221-8f83-23d08370b666 service nova] Instance 140a45b7-622a-4009-97d0-d15266fd54ca is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862769-1', 'n-h1-862769-1'} {{(pid=121000) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 04:27:25.229241 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-4ecf08e9-13a0-4a58-af42-1f0986a486b1 req-289eaa1a-2d48-4221-8f83-23d08370b666 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043788 Oct 27 04:27:25.229826 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3599/7489] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:27:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:27:25.617675 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f947bc1b-fc75-42ac-9216-84949005fa3c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:27:25.618342 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f947bc1b-fc75-42ac-9216-84949005fa3c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 140a45b7-622a-4009-97d0-d15266fd54ca] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:27:25.625937 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f947bc1b-fc75-42ac-9216-84949005fa3c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:25.626480 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f947bc1b-fc75-42ac-9216-84949005fa3c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:25.626940 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f947bc1b-fc75-42ac-9216-84949005fa3c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:25.627662 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f947bc1b-fc75-42ac-9216-84949005fa3c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:25.628134 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f947bc1b-fc75-42ac-9216-84949005fa3c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:25.629132 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f947bc1b-fc75-42ac-9216-84949005fa3c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:25.759897 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f947bc1b-fc75-42ac-9216-84949005fa3c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:27:25.767734 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f947bc1b-fc75-42ac-9216-84949005fa3c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca" status: 200 len: 1681 microversion: 2.1 time: 0.154119 Oct 27 04:27:25.768298 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3891/7490] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:27:25 2022] GET /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:27:26.789497 n-d-862769-1 devstack@n-api.service[121000]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 04:27:26.790005 n-d-862769-1 devstack@n-api.service[121000]: Thu Oct 27 04:27:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca (ip 10.222.0.20) !!! Oct 27 04:27:26.795238 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-adecb3b3-6ca0-46a5-9e06-2e3aa13f005e tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:27:26.795948 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-adecb3b3-6ca0-46a5-9e06-2e3aa13f005e tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 140a45b7-622a-4009-97d0-d15266fd54ca] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:27:26.803980 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-adecb3b3-6ca0-46a5-9e06-2e3aa13f005e tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:26.804474 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-adecb3b3-6ca0-46a5-9e06-2e3aa13f005e tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:26.804919 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-adecb3b3-6ca0-46a5-9e06-2e3aa13f005e tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:26.805623 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-adecb3b3-6ca0-46a5-9e06-2e3aa13f005e tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:26.806119 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-adecb3b3-6ca0-46a5-9e06-2e3aa13f005e tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:26.806558 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-adecb3b3-6ca0-46a5-9e06-2e3aa13f005e tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:26.935691 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-adecb3b3-6ca0-46a5-9e06-2e3aa13f005e tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:27:26.943902 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-adecb3b3-6ca0-46a5-9e06-2e3aa13f005e tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca" status: 200 len: 1677 microversion: 2.1 time: 0.155885 Oct 27 04:27:26.944481 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3600/7491] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:27:26 2022] GET /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:27:26.967504 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-28a2970a-26c0-4d2a-899b-355b8296e9a6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:27:26.968042 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-28a2970a-26c0-4d2a-899b-355b8296e9a6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 140a45b7-622a-4009-97d0-d15266fd54ca] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:27:26.974828 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-28a2970a-26c0-4d2a-899b-355b8296e9a6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:26.975330 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-28a2970a-26c0-4d2a-899b-355b8296e9a6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:26.975792 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-28a2970a-26c0-4d2a-899b-355b8296e9a6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:26.976852 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-28a2970a-26c0-4d2a-899b-355b8296e9a6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:26.976943 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-28a2970a-26c0-4d2a-899b-355b8296e9a6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:26.977377 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-28a2970a-26c0-4d2a-899b-355b8296e9a6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:27.194863 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-28a2970a-26c0-4d2a-899b-355b8296e9a6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "POST /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca/action" status: 204 len: 0 microversion: 2.1 time: 0.231299 Oct 27 04:27:27.195521 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3892/7492] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 04:27:26 2022] POST /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca/action => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 04:27:27.204119 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-acfcb355-5402-4345-82e3-d797a169979e tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:27:27.204750 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-acfcb355-5402-4345-82e3-d797a169979e tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 140a45b7-622a-4009-97d0-d15266fd54ca] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:27:27.211296 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-acfcb355-5402-4345-82e3-d797a169979e tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:27.211793 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-acfcb355-5402-4345-82e3-d797a169979e tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:27.212238 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-acfcb355-5402-4345-82e3-d797a169979e tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:27.212945 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-acfcb355-5402-4345-82e3-d797a169979e tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:27.213409 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-acfcb355-5402-4345-82e3-d797a169979e tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:27.213843 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-acfcb355-5402-4345-82e3-d797a169979e tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:27.393630 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-acfcb355-5402-4345-82e3-d797a169979e tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:27:27.401377 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-acfcb355-5402-4345-82e3-d797a169979e tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca" status: 200 len: 1677 microversion: 2.1 time: 0.201201 Oct 27 04:27:27.401972 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3601/7493] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:27:27 2022] GET /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca => generated 1677 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:27:28.426515 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a2620c0f-93ae-4348-a0bb-b066cc13541e tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:27:28.427233 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a2620c0f-93ae-4348-a0bb-b066cc13541e tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 140a45b7-622a-4009-97d0-d15266fd54ca] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:27:28.433729 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a2620c0f-93ae-4348-a0bb-b066cc13541e tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:28.434266 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a2620c0f-93ae-4348-a0bb-b066cc13541e tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:28.434727 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a2620c0f-93ae-4348-a0bb-b066cc13541e tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:28.435436 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a2620c0f-93ae-4348-a0bb-b066cc13541e tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:28.435907 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a2620c0f-93ae-4348-a0bb-b066cc13541e tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:28.436351 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a2620c0f-93ae-4348-a0bb-b066cc13541e tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:28.580469 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a2620c0f-93ae-4348-a0bb-b066cc13541e tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:27:28.588489 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a2620c0f-93ae-4348-a0bb-b066cc13541e tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca" status: 200 len: 1677 microversion: 2.1 time: 0.167837 Oct 27 04:27:28.589075 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3893/7494] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:27:28 2022] GET /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca => generated 1677 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:27:29.613044 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e3b0ddef-3305-499e-abfd-d1969e9ca7b6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:27:29.613671 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e3b0ddef-3305-499e-abfd-d1969e9ca7b6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 140a45b7-622a-4009-97d0-d15266fd54ca] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:27:29.619943 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e3b0ddef-3305-499e-abfd-d1969e9ca7b6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:29.620440 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e3b0ddef-3305-499e-abfd-d1969e9ca7b6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:29.620894 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e3b0ddef-3305-499e-abfd-d1969e9ca7b6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:29.621604 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e3b0ddef-3305-499e-abfd-d1969e9ca7b6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:29.622105 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e3b0ddef-3305-499e-abfd-d1969e9ca7b6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:29.622549 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e3b0ddef-3305-499e-abfd-d1969e9ca7b6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:29.752482 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e3b0ddef-3305-499e-abfd-d1969e9ca7b6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:27:29.760791 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e3b0ddef-3305-499e-abfd-d1969e9ca7b6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca" status: 200 len: 1656 microversion: 2.1 time: 0.151866 Oct 27 04:27:29.761380 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3602/7495] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:27:29 2022] GET /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca => generated 1656 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:27:29.783334 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-fb9746a9-8239-467e-8aa5-861c10d490d2 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:27:29.783972 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-fb9746a9-8239-467e-8aa5-861c10d490d2 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 140a45b7-622a-4009-97d0-d15266fd54ca] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:27:29.790112 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fb9746a9-8239-467e-8aa5-861c10d490d2 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:29.790620 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fb9746a9-8239-467e-8aa5-861c10d490d2 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:29.791076 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fb9746a9-8239-467e-8aa5-861c10d490d2 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:29.791789 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fb9746a9-8239-467e-8aa5-861c10d490d2 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:29.792265 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fb9746a9-8239-467e-8aa5-861c10d490d2 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:29.792714 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fb9746a9-8239-467e-8aa5-861c10d490d2 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:30.190356 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-fb9746a9-8239-467e-8aa5-861c10d490d2 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:27:30.198378 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-fb9746a9-8239-467e-8aa5-861c10d490d2 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca" status: 200 len: 1656 microversion: 2.1 time: 0.419139 Oct 27 04:27:30.198948 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3894/7496] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:27:29 2022] GET /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca => generated 1656 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:27:30.221261 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-23c53af1-ece5-43c7-914f-01fbc05cc4b1 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:27:30.227888 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-23c53af1-ece5-43c7-914f-01fbc05cc4b1 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:30.228390 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-23c53af1-ece5-43c7-914f-01fbc05cc4b1 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:30.228919 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-23c53af1-ece5-43c7-914f-01fbc05cc4b1 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:30.252143 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-23c53af1-ece5-43c7-914f-01fbc05cc4b1 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 140a45b7-622a-4009-97d0-d15266fd54ca] Going to try to start instance {{(pid=121000) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 27 04:27:30.335481 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:27:30.340811 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-c41782de-bd74-4b84-82cd-60ce58bd7ff2 req-9d9d52a0-0aec-44b6-a057-a955ad82f42c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "140a45b7-622a-4009-97d0-d15266fd54ca", "name": "network-vif-plugged", "status": "completed", "tag": "fc9013f4-a467-4797-a1cd-634341f6714f"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:27:30.350453 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-c41782de-bd74-4b84-82cd-60ce58bd7ff2 req-9d9d52a0-0aec-44b6-a057-a955ad82f42c service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:30.350952 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-c41782de-bd74-4b84-82cd-60ce58bd7ff2 req-9d9d52a0-0aec-44b6-a057-a955ad82f42c service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:30.351412 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-c41782de-bd74-4b84-82cd-60ce58bd7ff2 req-9d9d52a0-0aec-44b6-a057-a955ad82f42c service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:30.362496 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-c41782de-bd74-4b84-82cd-60ce58bd7ff2 req-9d9d52a0-0aec-44b6-a057-a955ad82f42c service nova] Creating event network-vif-plugged:fc9013f4-a467-4797-a1cd-634341f6714f for instance 140a45b7-622a-4009-97d0-d15266fd54ca on n-h1-862769-1 Oct 27 04:27:30.368099 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-c41782de-bd74-4b84-82cd-60ce58bd7ff2 req-9d9d52a0-0aec-44b6-a057-a955ad82f42c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030965 Oct 27 04:27:30.368663 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3895/7497] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:27:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:27:30.414669 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-23c53af1-ece5-43c7-914f-01fbc05cc4b1 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "POST /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca/action" status: 202 len: 0 microversion: 2.1 time: 0.197002 Oct 27 04:27:30.416274 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3603/7498] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 04:27:30 2022] POST /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca/action => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 04:27:30.427191 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-49c3ffa2-1b31-4f20-8ae0-1ef422015210 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:27:30.428251 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-49c3ffa2-1b31-4f20-8ae0-1ef422015210 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 140a45b7-622a-4009-97d0-d15266fd54ca] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:27:30.434822 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-49c3ffa2-1b31-4f20-8ae0-1ef422015210 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:30.435344 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-49c3ffa2-1b31-4f20-8ae0-1ef422015210 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:30.435814 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-49c3ffa2-1b31-4f20-8ae0-1ef422015210 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:30.436588 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-49c3ffa2-1b31-4f20-8ae0-1ef422015210 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:30.437177 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-49c3ffa2-1b31-4f20-8ae0-1ef422015210 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:30.437545 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-49c3ffa2-1b31-4f20-8ae0-1ef422015210 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:30.440591 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:27:30.594248 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-49c3ffa2-1b31-4f20-8ae0-1ef422015210 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:27:30.603188 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-49c3ffa2-1b31-4f20-8ae0-1ef422015210 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca" status: 200 len: 1665 microversion: 2.1 time: 0.180941 Oct 27 04:27:30.610570 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3896/7499] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:27:30 2022] GET /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca => generated 1665 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:27:31.630481 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3bf3f76e-8a5b-4f85-9c2e-641d1041d28a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:27:31.631242 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-3bf3f76e-8a5b-4f85-9c2e-641d1041d28a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 140a45b7-622a-4009-97d0-d15266fd54ca] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:27:31.638175 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3bf3f76e-8a5b-4f85-9c2e-641d1041d28a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:31.638664 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3bf3f76e-8a5b-4f85-9c2e-641d1041d28a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:31.639104 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3bf3f76e-8a5b-4f85-9c2e-641d1041d28a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:31.639804 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3bf3f76e-8a5b-4f85-9c2e-641d1041d28a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:31.640260 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3bf3f76e-8a5b-4f85-9c2e-641d1041d28a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:31.640689 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3bf3f76e-8a5b-4f85-9c2e-641d1041d28a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:31.774024 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-3bf3f76e-8a5b-4f85-9c2e-641d1041d28a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:27:31.782016 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3bf3f76e-8a5b-4f85-9c2e-641d1041d28a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca" status: 200 len: 1665 microversion: 2.1 time: 0.157359 Oct 27 04:27:31.782625 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3604/7500] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:27:31 2022] GET /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca => generated 1665 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:27:32.805873 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c26e9050-24a1-479d-8561-262a0344897a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:27:32.806446 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c26e9050-24a1-479d-8561-262a0344897a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 140a45b7-622a-4009-97d0-d15266fd54ca] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:27:32.814005 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c26e9050-24a1-479d-8561-262a0344897a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:32.814618 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c26e9050-24a1-479d-8561-262a0344897a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:32.815085 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c26e9050-24a1-479d-8561-262a0344897a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:32.815810 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c26e9050-24a1-479d-8561-262a0344897a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:32.816850 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c26e9050-24a1-479d-8561-262a0344897a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:32.817302 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c26e9050-24a1-479d-8561-262a0344897a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:32.945611 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c26e9050-24a1-479d-8561-262a0344897a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:27:32.953647 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c26e9050-24a1-479d-8561-262a0344897a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca" status: 200 len: 1669 microversion: 2.1 time: 0.152006 Oct 27 04:27:32.954252 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3897/7501] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:27:32 2022] GET /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca => generated 1669 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:27:32.977673 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-53611f53-557c-457b-b3df-6383d0b4d591 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:27:32.978289 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-53611f53-557c-457b-b3df-6383d0b4d591 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 140a45b7-622a-4009-97d0-d15266fd54ca] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:27:32.985069 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-53611f53-557c-457b-b3df-6383d0b4d591 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:32.985564 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-53611f53-557c-457b-b3df-6383d0b4d591 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:32.986017 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-53611f53-557c-457b-b3df-6383d0b4d591 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:32.986749 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-53611f53-557c-457b-b3df-6383d0b4d591 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:32.987229 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-53611f53-557c-457b-b3df-6383d0b4d591 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:32.987667 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-53611f53-557c-457b-b3df-6383d0b4d591 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:33.013545 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-53611f53-557c-457b-b3df-6383d0b4d591 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 140a45b7-622a-4009-97d0-d15266fd54ca] Going to try to terminate instance {{(pid=121000) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 04:27:33.331541 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-53611f53-557c-457b-b3df-6383d0b4d591 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "DELETE /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca" status: 204 len: 0 microversion: 2.1 time: 0.357594 Oct 27 04:27:33.332197 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3605/7502] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 04:27:32 2022] DELETE /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 04:27:33.340461 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-325db304-d30c-4f1f-81ef-cdda3f4f18eb tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:27:33.341139 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-325db304-d30c-4f1f-81ef-cdda3f4f18eb tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 140a45b7-622a-4009-97d0-d15266fd54ca] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:27:33.347551 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-325db304-d30c-4f1f-81ef-cdda3f4f18eb tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:33.348062 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-325db304-d30c-4f1f-81ef-cdda3f4f18eb tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:33.348525 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-325db304-d30c-4f1f-81ef-cdda3f4f18eb tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:33.349248 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-325db304-d30c-4f1f-81ef-cdda3f4f18eb tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:33.349729 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-325db304-d30c-4f1f-81ef-cdda3f4f18eb tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:33.350220 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-325db304-d30c-4f1f-81ef-cdda3f4f18eb tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:33.485880 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-325db304-d30c-4f1f-81ef-cdda3f4f18eb tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:27:33.494251 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-325db304-d30c-4f1f-81ef-cdda3f4f18eb tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca" status: 200 len: 1675 microversion: 2.1 time: 0.157745 Oct 27 04:27:33.494832 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3898/7503] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:27:33 2022] GET /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca => generated 1675 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:27:34.518847 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2e6cb34f-cf6d-45d7-aa7e-f8288b11c4be tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:27:34.520133 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-2e6cb34f-cf6d-45d7-aa7e-f8288b11c4be tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 140a45b7-622a-4009-97d0-d15266fd54ca] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:27:34.526986 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2e6cb34f-cf6d-45d7-aa7e-f8288b11c4be tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:34.527474 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2e6cb34f-cf6d-45d7-aa7e-f8288b11c4be tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:34.527952 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2e6cb34f-cf6d-45d7-aa7e-f8288b11c4be tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:34.528657 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2e6cb34f-cf6d-45d7-aa7e-f8288b11c4be tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:34.529121 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2e6cb34f-cf6d-45d7-aa7e-f8288b11c4be tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:34.529554 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2e6cb34f-cf6d-45d7-aa7e-f8288b11c4be tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:34.663851 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2e6cb34f-cf6d-45d7-aa7e-f8288b11c4be tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:27:34.671600 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2e6cb34f-cf6d-45d7-aa7e-f8288b11c4be tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca" status: 200 len: 1675 microversion: 2.1 time: 0.157042 Oct 27 04:27:34.672136 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3606/7504] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:27:34 2022] GET /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca => generated 1675 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:27:35.687551 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-75a9e389-f51f-408b-a44b-a47b6722836c req-3988211d-8d92-48bb-82b9-5d10a9a9b3cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "140a45b7-622a-4009-97d0-d15266fd54ca", "name": "network-vif-deleted", "tag": "fc9013f4-a467-4797-a1cd-634341f6714f"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:27:35.696658 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5ef128ea-794a-4997-9cae-231cd3fe4f7a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:27:35.701858 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5ef128ea-794a-4997-9cae-231cd3fe4f7a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 140a45b7-622a-4009-97d0-d15266fd54ca] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:27:35.701991 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-75a9e389-f51f-408b-a44b-a47b6722836c req-3988211d-8d92-48bb-82b9-5d10a9a9b3cd service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:35.701991 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-75a9e389-f51f-408b-a44b-a47b6722836c req-3988211d-8d92-48bb-82b9-5d10a9a9b3cd service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:35.701991 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-75a9e389-f51f-408b-a44b-a47b6722836c req-3988211d-8d92-48bb-82b9-5d10a9a9b3cd service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:35.705701 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5ef128ea-794a-4997-9cae-231cd3fe4f7a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:35.706402 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5ef128ea-794a-4997-9cae-231cd3fe4f7a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:35.706977 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5ef128ea-794a-4997-9cae-231cd3fe4f7a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:35.708193 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5ef128ea-794a-4997-9cae-231cd3fe4f7a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:35.708794 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5ef128ea-794a-4997-9cae-231cd3fe4f7a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:35.709462 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5ef128ea-794a-4997-9cae-231cd3fe4f7a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:35.711547 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-75a9e389-f51f-408b-a44b-a47b6722836c req-3988211d-8d92-48bb-82b9-5d10a9a9b3cd service nova] Creating event network-vif-deleted:fc9013f4-a467-4797-a1cd-634341f6714f for instance 140a45b7-622a-4009-97d0-d15266fd54ca on n-h1-862769-1 Oct 27 04:27:35.716982 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-75a9e389-f51f-408b-a44b-a47b6722836c req-3988211d-8d92-48bb-82b9-5d10a9a9b3cd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032775 Oct 27 04:27:35.717785 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3899/7505] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:27:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:27:35.785747 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5ef128ea-794a-4997-9cae-231cd3fe4f7a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:27:35.794141 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5ef128ea-794a-4997-9cae-231cd3fe4f7a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca" status: 200 len: 1608 microversion: 2.1 time: 0.102852 Oct 27 04:27:35.794642 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3607/7506] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:27:35 2022] GET /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca => generated 1608 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:27:36.819999 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-72f0d8d2-855e-4392-bd25-47504383bef2 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:27:36.820733 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-72f0d8d2-855e-4392-bd25-47504383bef2 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 140a45b7-622a-4009-97d0-d15266fd54ca] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:27:36.822710 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=43 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:27:36.827637 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-72f0d8d2-855e-4392-bd25-47504383bef2 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:36.828150 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-72f0d8d2-855e-4392-bd25-47504383bef2 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:36.828619 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-72f0d8d2-855e-4392-bd25-47504383bef2 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:36.829341 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-72f0d8d2-855e-4392-bd25-47504383bef2 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:36.829826 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-72f0d8d2-855e-4392-bd25-47504383bef2 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:36.830321 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-72f0d8d2-855e-4392-bd25-47504383bef2 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:36.843817 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-72f0d8d2-855e-4392-bd25-47504383bef2 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] HTTP exception thrown: Instance 140a45b7-622a-4009-97d0-d15266fd54ca could not be found. Oct 27 04:27:36.845470 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-72f0d8d2-855e-4392-bd25-47504383bef2 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Request method failure captured: Oct 27 04:27:36.845470 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca HTTP/1.1 Oct 27 04:27:36.845470 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 04:27:36.845470 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 04:27:36.845470 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 04:27:36.845470 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 04:27:36.845470 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 04:27:36.845470 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 04:27:36.845470 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 04:27:36.845470 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 04:27:36.845470 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWggT1pShQ7YBK6vLEnUn4ThZkZHCmWwxudcjcX6Q_Qzyxxu4Tv9k9Mz8NdF1J-CqoCxrwqSYjXa2e5qz-_PVvAMi6WsvOj7WQPQINruTawh_9Huu8QwtjT2xusIZMY0glj9dlYg_3F0cuyrDKuyyLc3oA_TbX8qtqDNM9W1LEjJuGfY Oct 27 04:27:36.845470 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 04:27:36.845470 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 04:27:36.845470 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 04:27:36.845470 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 04:27:36.845470 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 04:27:36.845470 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 04:27:36.845470 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 529ab4a5a66947aebb3f09a9842e5c9f Oct 27 04:27:36.845470 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServerActionsTestJSON-403049074 Oct 27 04:27:36.845470 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 04:27:36.845470 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 04:27:36.845470 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/529ab4a5a66947aebb3f09a9842e5c9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/529ab4a5a66947aebb3f09a9842e5c9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/529ab4a5a66947aebb3f09a9842e5c9f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_529ab4a5a66947aebb3f09a9842e5c9f"}]}] Oct 27 04:27:36.845470 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServerActionsTestJSON-403049074 Oct 27 04:27:36.845470 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 529ab4a5a66947aebb3f09a9842e5c9f Oct 27 04:27:36.845470 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServerActionsTestJSON-403049074 Oct 27 04:27:36.845470 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServerActionsTestJSON-403049074-project Oct 27 04:27:36.845470 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 04:27:36.845470 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 04:27:36.845470 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 197669776fde4a6480f6cab6e5c8552f Oct 27 04:27:36.845470 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServerActionsTestJSON-403049074-project Oct 27 04:27:36.845470 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 04:27:36.845470 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 140a45b7-622a-4009-97d0-d15266fd54ca could not be found. Oct 27 04:27:36.845470 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '140a45b7-622a-4009-97d0-d15266fd54ca'} Oct 27 04:27:36.845470 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 04:27:36.845470 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:27:36.845470 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 04:27:36.845470 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 04:27:36.845470 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 04:27:36.845470 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 04:27:36.845470 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 04:27:36.845470 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 04:27:36.845470 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 04:27:36.845470 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 04:27:36.845470 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 140a45b7-622a-4009-97d0-d15266fd54ca could not be found. Oct 27 04:27:36.845470 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:27:36.845470 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:27:36.845470 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:27:36.845470 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:27:36.845470 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:27:36.845470 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:27:36.845470 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 04:27:36.845470 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 04:27:36.845470 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 04:27:36.845470 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 04:27:36.845470 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 04:27:36.845470 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 04:27:36.845470 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 04:27:36.845470 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 04:27:36.845470 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 04:27:36.845470 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 04:27:36.845470 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 140a45b7-622a-4009-97d0-d15266fd54ca could not be found. Oct 27 04:27:36.845470 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:27:36.845470 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:27:36.845470 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:27:36.857397 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:27:36.857397 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:27:36.857397 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:27:36.857397 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 04:27:36.857397 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 04:27:36.857397 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 140a45b7-622a-4009-97d0-d15266fd54ca could not be found. Oct 27 04:27:36.857397 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:27:36.857397 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-72f0d8d2-855e-4392-bd25-47504383bef2 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Returning 404 to user: Instance 140a45b7-622a-4009-97d0-d15266fd54ca could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 04:27:36.857397 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-72f0d8d2-855e-4392-bd25-47504383bef2 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca" status: 404 len: 111 microversion: 2.1 time: 0.032297 Oct 27 04:27:36.857397 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3900/7507] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:27:36 2022] GET /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 04:27:36.865093 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-579ef0b2-e97a-4dae-bfc6-e5727dc7bc62 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:27:36.865718 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-579ef0b2-e97a-4dae-bfc6-e5727dc7bc62 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 140a45b7-622a-4009-97d0-d15266fd54ca] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:27:36.868611 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:27:36.873248 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-579ef0b2-e97a-4dae-bfc6-e5727dc7bc62 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:36.873772 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-579ef0b2-e97a-4dae-bfc6-e5727dc7bc62 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:36.874258 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-579ef0b2-e97a-4dae-bfc6-e5727dc7bc62 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:36.874999 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-579ef0b2-e97a-4dae-bfc6-e5727dc7bc62 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:36.875463 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-579ef0b2-e97a-4dae-bfc6-e5727dc7bc62 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:36.875897 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-579ef0b2-e97a-4dae-bfc6-e5727dc7bc62 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:36.889164 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-579ef0b2-e97a-4dae-bfc6-e5727dc7bc62 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] HTTP exception thrown: Instance 140a45b7-622a-4009-97d0-d15266fd54ca could not be found. Oct 27 04:27:36.890832 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-579ef0b2-e97a-4dae-bfc6-e5727dc7bc62 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Request method failure captured: Oct 27 04:27:36.890832 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca HTTP/1.1 Oct 27 04:27:36.890832 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 04:27:36.890832 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 04:27:36.890832 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 04:27:36.890832 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 04:27:36.890832 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 04:27:36.890832 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 04:27:36.890832 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 04:27:36.890832 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 04:27:36.890832 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWggT1pShQ7YBK6vLEnUn4ThZkZHCmWwxudcjcX6Q_Qzyxxu4Tv9k9Mz8NdF1J-CqoCxrwqSYjXa2e5qz-_PVvAMi6WsvOj7WQPQINruTawh_9Huu8QwtjT2xusIZMY0glj9dlYg_3F0cuyrDKuyyLc3oA_TbX8qtqDNM9W1LEjJuGfY Oct 27 04:27:36.890832 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 04:27:36.890832 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 04:27:36.890832 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 04:27:36.890832 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 04:27:36.890832 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 04:27:36.890832 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 04:27:36.890832 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 529ab4a5a66947aebb3f09a9842e5c9f Oct 27 04:27:36.890832 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ServerActionsTestJSON-403049074 Oct 27 04:27:36.890832 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 04:27:36.890832 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 04:27:36.890832 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/529ab4a5a66947aebb3f09a9842e5c9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/529ab4a5a66947aebb3f09a9842e5c9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/529ab4a5a66947aebb3f09a9842e5c9f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_529ab4a5a66947aebb3f09a9842e5c9f"}]}] Oct 27 04:27:36.890832 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ServerActionsTestJSON-403049074 Oct 27 04:27:36.890832 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 529ab4a5a66947aebb3f09a9842e5c9f Oct 27 04:27:36.890832 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ServerActionsTestJSON-403049074 Oct 27 04:27:36.890832 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ServerActionsTestJSON-403049074-project Oct 27 04:27:36.890832 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 04:27:36.890832 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 04:27:36.890832 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 197669776fde4a6480f6cab6e5c8552f Oct 27 04:27:36.890832 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ServerActionsTestJSON-403049074-project Oct 27 04:27:36.890832 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 04:27:36.890832 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 140a45b7-622a-4009-97d0-d15266fd54ca could not be found. Oct 27 04:27:36.890832 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '140a45b7-622a-4009-97d0-d15266fd54ca'} Oct 27 04:27:36.890832 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 04:27:36.890832 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:27:36.890832 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 04:27:36.890832 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 04:27:36.890832 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 04:27:36.890832 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 04:27:36.890832 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 04:27:36.890832 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 04:27:36.890832 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 04:27:36.890832 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 04:27:36.890832 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 140a45b7-622a-4009-97d0-d15266fd54ca could not be found. Oct 27 04:27:36.890832 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:27:36.890832 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:27:36.890832 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:27:36.890832 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:27:36.890832 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:27:36.890832 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:27:36.890832 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 04:27:36.890832 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 04:27:36.890832 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 04:27:36.890832 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 04:27:36.890832 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 04:27:36.890832 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 04:27:36.890832 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 04:27:36.890832 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 04:27:36.890832 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 04:27:36.890832 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 04:27:36.890832 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 140a45b7-622a-4009-97d0-d15266fd54ca could not be found. Oct 27 04:27:36.890832 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:27:36.890832 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:27:36.890832 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:27:36.895793 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:27:36.895793 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:27:36.895793 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:27:36.895793 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 04:27:36.895793 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 04:27:36.895793 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 140a45b7-622a-4009-97d0-d15266fd54ca could not be found. Oct 27 04:27:36.895793 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:27:36.895793 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-579ef0b2-e97a-4dae-bfc6-e5727dc7bc62 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Returning 404 to user: Instance 140a45b7-622a-4009-97d0-d15266fd54ca could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 04:27:36.895793 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-579ef0b2-e97a-4dae-bfc6-e5727dc7bc62 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca" status: 404 len: 111 microversion: 2.1 time: 0.031676 Oct 27 04:27:36.895793 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3608/7508] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:27:36 2022] GET /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 04:27:36.967239 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e1d261d3-870f-45ba-aec8-b0255ce951bb tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1544596395", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": [{"uuid": "0b9e776d-e4d4-4487-af56-34380c1641ff"}], "security_groups": [{"name": "tempest-securitygroup--204964459"}], "key_name": "tempest-keypair-673070032", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:27:37.070699 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.network.neutron [None req-e1d261d3-870f-45ba-aec8-b0255ce951bb tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] validate_networks() for [('0b9e776d-e4d4-4487-af56-34380c1641ff', None, None, None, None, None)] {{(pid=121001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 04:27:37.798726 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-e1d261d3-870f-45ba-aec8-b0255ce951bb tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Flavor limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 04:27:37.799209 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-e1d261d3-870f-45ba-aec8-b0255ce951bb tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Image limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 04:27:37.799712 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-e1d261d3-870f-45ba-aec8-b0255ce951bb tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Flavor pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 04:27:37.800644 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-e1d261d3-870f-45ba-aec8-b0255ce951bb tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Image pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 04:27:37.801111 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-e1d261d3-870f-45ba-aec8-b0255ce951bb tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 04:27:37.810085 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e1d261d3-870f-45ba-aec8-b0255ce951bb tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:37.810801 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e1d261d3-870f-45ba-aec8-b0255ce951bb tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:37.811266 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e1d261d3-870f-45ba-aec8-b0255ce951bb tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:37.812029 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e1d261d3-870f-45ba-aec8-b0255ce951bb tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:37.812515 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e1d261d3-870f-45ba-aec8-b0255ce951bb tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:37.812970 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e1d261d3-870f-45ba-aec8-b0255ce951bb tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:37.834549 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-e1d261d3-870f-45ba-aec8-b0255ce951bb tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Getting quotas for project 529ab4a5a66947aebb3f09a9842e5c9f. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 04:27:37.840487 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-e1d261d3-870f-45ba-aec8-b0255ce951bb tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Getting quotas for user 197669776fde4a6480f6cab6e5c8552f and project 529ab4a5a66947aebb3f09a9842e5c9f. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 04:27:37.853476 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e1d261d3-870f-45ba-aec8-b0255ce951bb tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Going to run 1 instances... {{(pid=121001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 04:27:37.855925 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e1d261d3-870f-45ba-aec8-b0255ce951bb tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 87631277-ef7c-4f32-ad28-b4be5c3314f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 04:27:37.951197 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e1d261d3-870f-45ba-aec8-b0255ce951bb tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.988510 Oct 27 04:27:37.951870 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3901/7509] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 04:27:36 2022] POST /compute/v2.1/servers => generated 405 bytes in 990 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 04:27:37.963090 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-eea4c9ac-3bef-43a6-ac51-b4c8edd6233f tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:27:37.963804 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-eea4c9ac-3bef-43a6-ac51-b4c8edd6233f tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 87631277-ef7c-4f32-ad28-b4be5c3314f7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:27:38.021481 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-eea4c9ac-3bef-43a6-ac51-b4c8edd6233f tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:27:38.030566 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-eea4c9ac-3bef-43a6-ac51-b4c8edd6233f tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7" status: 200 len: 1238 microversion: 2.1 time: 0.071213 Oct 27 04:27:38.031017 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3609/7510] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:27:37 2022] GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7 => generated 1238 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:27:39.053090 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-496fbc04-9ae7-4e2c-8ac7-c69a820a3b38 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:27:39.053759 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-496fbc04-9ae7-4e2c-8ac7-c69a820a3b38 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 87631277-ef7c-4f32-ad28-b4be5c3314f7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:27:39.060791 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-496fbc04-9ae7-4e2c-8ac7-c69a820a3b38 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:39.061300 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-496fbc04-9ae7-4e2c-8ac7-c69a820a3b38 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:39.061817 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-496fbc04-9ae7-4e2c-8ac7-c69a820a3b38 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:39.062497 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-496fbc04-9ae7-4e2c-8ac7-c69a820a3b38 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:39.062973 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-496fbc04-9ae7-4e2c-8ac7-c69a820a3b38 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:39.063423 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-496fbc04-9ae7-4e2c-8ac7-c69a820a3b38 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:39.126095 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-496fbc04-9ae7-4e2c-8ac7-c69a820a3b38 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:27:39.134518 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-496fbc04-9ae7-4e2c-8ac7-c69a820a3b38 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7" status: 200 len: 1242 microversion: 2.1 time: 0.085483 Oct 27 04:27:39.135395 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3902/7511] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:27:39 2022] GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7 => generated 1242 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:27:40.159175 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-db2b1076-f406-4bf8-a5c0-7ce1ce87b9ab tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:27:40.160419 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-db2b1076-f406-4bf8-a5c0-7ce1ce87b9ab tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 87631277-ef7c-4f32-ad28-b4be5c3314f7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:27:40.167991 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-db2b1076-f406-4bf8-a5c0-7ce1ce87b9ab tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:40.168580 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-db2b1076-f406-4bf8-a5c0-7ce1ce87b9ab tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:40.169227 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-db2b1076-f406-4bf8-a5c0-7ce1ce87b9ab tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:40.170017 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-db2b1076-f406-4bf8-a5c0-7ce1ce87b9ab tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:40.170637 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-db2b1076-f406-4bf8-a5c0-7ce1ce87b9ab tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:40.171157 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-db2b1076-f406-4bf8-a5c0-7ce1ce87b9ab tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:40.242242 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-db2b1076-f406-4bf8-a5c0-7ce1ce87b9ab tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:27:40.250125 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-db2b1076-f406-4bf8-a5c0-7ce1ce87b9ab tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7" status: 200 len: 1296 microversion: 2.1 time: 0.094990 Oct 27 04:27:40.251000 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3610/7512] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:27:40 2022] GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7 => generated 1296 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:27:41.273842 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-48332cbb-26f7-4726-bba5-f6cd521c3598 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:27:41.274525 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-48332cbb-26f7-4726-bba5-f6cd521c3598 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 87631277-ef7c-4f32-ad28-b4be5c3314f7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:27:41.281793 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-48332cbb-26f7-4726-bba5-f6cd521c3598 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:41.282360 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-48332cbb-26f7-4726-bba5-f6cd521c3598 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:41.282818 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-48332cbb-26f7-4726-bba5-f6cd521c3598 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:41.283576 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-48332cbb-26f7-4726-bba5-f6cd521c3598 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:41.284061 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-48332cbb-26f7-4726-bba5-f6cd521c3598 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:41.285046 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-48332cbb-26f7-4726-bba5-f6cd521c3598 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:41.429748 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-48332cbb-26f7-4726-bba5-f6cd521c3598 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:27:41.438627 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-48332cbb-26f7-4726-bba5-f6cd521c3598 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7" status: 200 len: 1363 microversion: 2.1 time: 0.168496 Oct 27 04:27:41.439136 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3903/7513] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:27:41 2022] GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7 => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:27:41.839918 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-25b98cf3-ac08-4b71-a840-0b910464cb0a req-8e432e0b-a352-4315-8401-50152a5f4e55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87631277-ef7c-4f32-ad28-b4be5c3314f7", "tag": "dd6723b9-ce60-4d37-9820-6a6a50693604"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:27:41.851206 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-25b98cf3-ac08-4b71-a840-0b910464cb0a req-8e432e0b-a352-4315-8401-50152a5f4e55 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:41.851695 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-25b98cf3-ac08-4b71-a840-0b910464cb0a req-8e432e0b-a352-4315-8401-50152a5f4e55 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:41.852251 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-25b98cf3-ac08-4b71-a840-0b910464cb0a req-8e432e0b-a352-4315-8401-50152a5f4e55 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:41.863635 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-25b98cf3-ac08-4b71-a840-0b910464cb0a req-8e432e0b-a352-4315-8401-50152a5f4e55 service nova] Creating event network-changed:dd6723b9-ce60-4d37-9820-6a6a50693604 for instance 87631277-ef7c-4f32-ad28-b4be5c3314f7 on n-h2-862769-1 Oct 27 04:27:41.868946 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-25b98cf3-ac08-4b71-a840-0b910464cb0a req-8e432e0b-a352-4315-8401-50152a5f4e55 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032705 Oct 27 04:27:41.874962 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3611/7514] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:27:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:27:42.463012 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4dcf213a-a97a-4cba-9135-bf4d713fcf28 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:27:42.463689 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4dcf213a-a97a-4cba-9135-bf4d713fcf28 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 87631277-ef7c-4f32-ad28-b4be5c3314f7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:27:42.470702 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4dcf213a-a97a-4cba-9135-bf4d713fcf28 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:42.471211 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4dcf213a-a97a-4cba-9135-bf4d713fcf28 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:42.471673 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4dcf213a-a97a-4cba-9135-bf4d713fcf28 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:42.472432 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4dcf213a-a97a-4cba-9135-bf4d713fcf28 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:42.472914 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4dcf213a-a97a-4cba-9135-bf4d713fcf28 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:42.473370 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4dcf213a-a97a-4cba-9135-bf4d713fcf28 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:42.601196 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4dcf213a-a97a-4cba-9135-bf4d713fcf28 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:27:42.609083 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4dcf213a-a97a-4cba-9135-bf4d713fcf28 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7" status: 200 len: 1363 microversion: 2.1 time: 0.150045 Oct 27 04:27:42.609663 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3904/7515] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:27:42 2022] GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:27:43.633991 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-98037fc5-5a59-4156-a17e-f199d2d2bacc tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:27:43.634736 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-98037fc5-5a59-4156-a17e-f199d2d2bacc tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 87631277-ef7c-4f32-ad28-b4be5c3314f7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:27:43.641807 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-98037fc5-5a59-4156-a17e-f199d2d2bacc tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:43.642350 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-98037fc5-5a59-4156-a17e-f199d2d2bacc tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:43.642801 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-98037fc5-5a59-4156-a17e-f199d2d2bacc tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:43.643510 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-98037fc5-5a59-4156-a17e-f199d2d2bacc tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:43.644665 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-98037fc5-5a59-4156-a17e-f199d2d2bacc tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:43.645117 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-98037fc5-5a59-4156-a17e-f199d2d2bacc tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:43.777607 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-98037fc5-5a59-4156-a17e-f199d2d2bacc tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:27:43.785204 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-98037fc5-5a59-4156-a17e-f199d2d2bacc tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7" status: 200 len: 1363 microversion: 2.1 time: 0.155523 Oct 27 04:27:43.785788 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3612/7516] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:27:43 2022] GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:27:44.809601 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0af89398-21f3-4bc6-b09e-b4a9f5b4d006 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:27:44.810287 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0af89398-21f3-4bc6-b09e-b4a9f5b4d006 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 87631277-ef7c-4f32-ad28-b4be5c3314f7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:27:44.817071 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0af89398-21f3-4bc6-b09e-b4a9f5b4d006 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:44.817580 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0af89398-21f3-4bc6-b09e-b4a9f5b4d006 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:44.818061 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0af89398-21f3-4bc6-b09e-b4a9f5b4d006 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:44.818795 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0af89398-21f3-4bc6-b09e-b4a9f5b4d006 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:44.819274 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0af89398-21f3-4bc6-b09e-b4a9f5b4d006 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:44.819728 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0af89398-21f3-4bc6-b09e-b4a9f5b4d006 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:44.950617 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0af89398-21f3-4bc6-b09e-b4a9f5b4d006 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:27:44.958800 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0af89398-21f3-4bc6-b09e-b4a9f5b4d006 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7" status: 200 len: 1363 microversion: 2.1 time: 0.153198 Oct 27 04:27:44.959378 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3905/7517] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:27:44 2022] GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:27:45.983142 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-30a2bb42-7f32-42c1-a221-4c00d582f252 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:27:45.983787 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-30a2bb42-7f32-42c1-a221-4c00d582f252 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 87631277-ef7c-4f32-ad28-b4be5c3314f7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:27:45.991188 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-30a2bb42-7f32-42c1-a221-4c00d582f252 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:45.991714 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-30a2bb42-7f32-42c1-a221-4c00d582f252 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:45.995662 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-30a2bb42-7f32-42c1-a221-4c00d582f252 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:45.995662 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-30a2bb42-7f32-42c1-a221-4c00d582f252 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:45.995662 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-30a2bb42-7f32-42c1-a221-4c00d582f252 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:45.995662 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-30a2bb42-7f32-42c1-a221-4c00d582f252 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:46.127940 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-30a2bb42-7f32-42c1-a221-4c00d582f252 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:27:46.137687 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-30a2bb42-7f32-42c1-a221-4c00d582f252 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7" status: 200 len: 1363 microversion: 2.1 time: 0.158389 Oct 27 04:27:46.138950 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3613/7518] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:27:45 2022] GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:27:47.161682 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2b455516-60f5-4bba-9bd6-a761e36056a2 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:27:47.162346 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2b455516-60f5-4bba-9bd6-a761e36056a2 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 87631277-ef7c-4f32-ad28-b4be5c3314f7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:27:47.169120 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2b455516-60f5-4bba-9bd6-a761e36056a2 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:47.169629 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2b455516-60f5-4bba-9bd6-a761e36056a2 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:47.170122 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2b455516-60f5-4bba-9bd6-a761e36056a2 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:47.170846 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2b455516-60f5-4bba-9bd6-a761e36056a2 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:47.171325 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2b455516-60f5-4bba-9bd6-a761e36056a2 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:47.171778 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2b455516-60f5-4bba-9bd6-a761e36056a2 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:47.302833 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2b455516-60f5-4bba-9bd6-a761e36056a2 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:27:47.310605 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2b455516-60f5-4bba-9bd6-a761e36056a2 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7" status: 200 len: 1363 microversion: 2.1 time: 0.152914 Oct 27 04:27:47.311173 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3906/7519] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:27:47 2022] GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:27:48.334801 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c86cd9ce-b51d-48a3-9d3c-3f3cf6ea330d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:27:48.335484 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c86cd9ce-b51d-48a3-9d3c-3f3cf6ea330d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 87631277-ef7c-4f32-ad28-b4be5c3314f7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:27:48.338557 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:27:48.343678 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c86cd9ce-b51d-48a3-9d3c-3f3cf6ea330d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:48.344228 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c86cd9ce-b51d-48a3-9d3c-3f3cf6ea330d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:48.344674 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c86cd9ce-b51d-48a3-9d3c-3f3cf6ea330d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:48.345384 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c86cd9ce-b51d-48a3-9d3c-3f3cf6ea330d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:48.345923 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c86cd9ce-b51d-48a3-9d3c-3f3cf6ea330d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:48.346403 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c86cd9ce-b51d-48a3-9d3c-3f3cf6ea330d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:48.352456 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-0336df3b-13a6-44b5-9edb-dd708f74b2c7 req-2e60dd09-bf11-452f-9a53-4941e1cabe00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87631277-ef7c-4f32-ad28-b4be5c3314f7", "name": "network-vif-plugged", "status": "completed", "tag": "dd6723b9-ce60-4d37-9820-6a6a50693604"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:27:48.357730 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:27:48.358398 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=6 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:27:48.364804 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-0336df3b-13a6-44b5-9edb-dd708f74b2c7 req-2e60dd09-bf11-452f-9a53-4941e1cabe00 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:48.365398 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-0336df3b-13a6-44b5-9edb-dd708f74b2c7 req-2e60dd09-bf11-452f-9a53-4941e1cabe00 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:48.365919 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-0336df3b-13a6-44b5-9edb-dd708f74b2c7 req-2e60dd09-bf11-452f-9a53-4941e1cabe00 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:48.377215 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-0336df3b-13a6-44b5-9edb-dd708f74b2c7 req-2e60dd09-bf11-452f-9a53-4941e1cabe00 service nova] Creating event network-vif-plugged:dd6723b9-ce60-4d37-9820-6a6a50693604 for instance 87631277-ef7c-4f32-ad28-b4be5c3314f7 on n-h2-862769-1 Oct 27 04:27:48.382454 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-0336df3b-13a6-44b5-9edb-dd708f74b2c7 req-2e60dd09-bf11-452f-9a53-4941e1cabe00 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034232 Oct 27 04:27:48.383062 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3907/7520] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:27:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:27:48.517745 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c86cd9ce-b51d-48a3-9d3c-3f3cf6ea330d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:27:48.526406 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c86cd9ce-b51d-48a3-9d3c-3f3cf6ea330d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7" status: 200 len: 1363 microversion: 2.1 time: 0.196145 Oct 27 04:27:48.530109 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3614/7521] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:27:48 2022] GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7 => generated 1363 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:27:49.553583 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-035e80be-2ca9-4df4-976a-d6e8574f38aa tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:27:49.554331 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-035e80be-2ca9-4df4-976a-d6e8574f38aa tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 87631277-ef7c-4f32-ad28-b4be5c3314f7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:27:49.561136 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-035e80be-2ca9-4df4-976a-d6e8574f38aa tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:49.561679 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-035e80be-2ca9-4df4-976a-d6e8574f38aa tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:49.562160 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-035e80be-2ca9-4df4-976a-d6e8574f38aa tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:49.562874 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-035e80be-2ca9-4df4-976a-d6e8574f38aa tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:49.563347 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-035e80be-2ca9-4df4-976a-d6e8574f38aa tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:49.563791 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-035e80be-2ca9-4df4-976a-d6e8574f38aa tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:49.705061 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-035e80be-2ca9-4df4-976a-d6e8574f38aa tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:27:49.713347 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-035e80be-2ca9-4df4-976a-d6e8574f38aa tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7" status: 200 len: 1363 microversion: 2.1 time: 0.166006 Oct 27 04:27:49.713936 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3908/7522] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:27:49 2022] GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:27:50.736853 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5ff0e815-b687-414c-b7a2-49fe5e2b96ac tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:27:50.737539 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5ff0e815-b687-414c-b7a2-49fe5e2b96ac tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 87631277-ef7c-4f32-ad28-b4be5c3314f7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:27:50.744365 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5ff0e815-b687-414c-b7a2-49fe5e2b96ac tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:50.744869 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5ff0e815-b687-414c-b7a2-49fe5e2b96ac tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:50.745294 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5ff0e815-b687-414c-b7a2-49fe5e2b96ac tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:50.745989 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5ff0e815-b687-414c-b7a2-49fe5e2b96ac tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:50.746484 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5ff0e815-b687-414c-b7a2-49fe5e2b96ac tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:50.746913 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5ff0e815-b687-414c-b7a2-49fe5e2b96ac tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:50.876532 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5ff0e815-b687-414c-b7a2-49fe5e2b96ac tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:27:50.884736 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5ff0e815-b687-414c-b7a2-49fe5e2b96ac tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7" status: 200 len: 1550 microversion: 2.1 time: 0.151812 Oct 27 04:27:50.885331 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3615/7523] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:27:50 2022] GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7 => generated 1550 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:27:50.908055 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-15c90603-8cb6-4331-824c-a67fa73819df tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:27:50.908569 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-15c90603-8cb6-4331-824c-a67fa73819df tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 87631277-ef7c-4f32-ad28-b4be5c3314f7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:27:50.915378 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-15c90603-8cb6-4331-824c-a67fa73819df tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:50.915890 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-15c90603-8cb6-4331-824c-a67fa73819df tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:50.916353 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-15c90603-8cb6-4331-824c-a67fa73819df tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:50.917074 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-15c90603-8cb6-4331-824c-a67fa73819df tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:50.917555 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-15c90603-8cb6-4331-824c-a67fa73819df tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:50.918009 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-15c90603-8cb6-4331-824c-a67fa73819df tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:50.997978 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-15c90603-8cb6-4331-824c-a67fa73819df tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093910 Oct 27 04:27:50.998647 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3909/7524] 10.222.0.20 () {58 vars in 1275 bytes} [Thu Oct 27 04:27:50 2022] GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:27:51.993875 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-53c4a5be-2008-4b4f-9264-e5ae063d7d47 req-b063f426-c73a-4ce6-8f16-cf7768330bfc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87631277-ef7c-4f32-ad28-b4be5c3314f7", "tag": "dd6723b9-ce60-4d37-9820-6a6a50693604"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:27:52.004557 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-53c4a5be-2008-4b4f-9264-e5ae063d7d47 req-b063f426-c73a-4ce6-8f16-cf7768330bfc service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:27:52.005050 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-53c4a5be-2008-4b4f-9264-e5ae063d7d47 req-b063f426-c73a-4ce6-8f16-cf7768330bfc service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:27:52.005497 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-53c4a5be-2008-4b4f-9264-e5ae063d7d47 req-b063f426-c73a-4ce6-8f16-cf7768330bfc service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:27:52.016516 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-53c4a5be-2008-4b4f-9264-e5ae063d7d47 req-b063f426-c73a-4ce6-8f16-cf7768330bfc service nova] Creating event network-changed:dd6723b9-ce60-4d37-9820-6a6a50693604 for instance 87631277-ef7c-4f32-ad28-b4be5c3314f7 on n-h2-862769-1 Oct 27 04:27:52.021613 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-53c4a5be-2008-4b4f-9264-e5ae063d7d47 req-b063f426-c73a-4ce6-8f16-cf7768330bfc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031460 Oct 27 04:27:52.022258 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3616/7525] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:27:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:28:24.918483 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:28:24.919272 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=65 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:28:24.923419 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a4743491-0b93-4ebe-88a5-0873d9c5136a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:28:24.931900 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a4743491-0b93-4ebe-88a5-0873d9c5136a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 87631277-ef7c-4f32-ad28-b4be5c3314f7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:28:24.931900 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a4743491-0b93-4ebe-88a5-0873d9c5136a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:28:24.932119 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a4743491-0b93-4ebe-88a5-0873d9c5136a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:28:24.932547 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a4743491-0b93-4ebe-88a5-0873d9c5136a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:28:24.933265 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a4743491-0b93-4ebe-88a5-0873d9c5136a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:28:24.933742 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a4743491-0b93-4ebe-88a5-0873d9c5136a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:28:24.934240 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a4743491-0b93-4ebe-88a5-0873d9c5136a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:28:24.963429 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a4743491-0b93-4ebe-88a5-0873d9c5136a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:28:24.969095 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a4743491-0b93-4ebe-88a5-0873d9c5136a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 87631277-ef7c-4f32-ad28-b4be5c3314f7] Old instance type m1.heat2, new instance type m1.heat {{(pid=121001) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 27 04:28:24.975813 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-a4743491-0b93-4ebe-88a5-0873d9c5136a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Flavor limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 04:28:24.976257 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-a4743491-0b93-4ebe-88a5-0873d9c5136a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Image limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 04:28:24.976753 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-a4743491-0b93-4ebe-88a5-0873d9c5136a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Flavor pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 04:28:24.977184 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-a4743491-0b93-4ebe-88a5-0873d9c5136a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Image pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 04:28:24.977616 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-a4743491-0b93-4ebe-88a5-0873d9c5136a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 04:28:25.180554 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a4743491-0b93-4ebe-88a5-0873d9c5136a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "POST /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7/action" status: 202 len: 0 microversion: 2.1 time: 0.264149 Oct 27 04:28:25.184457 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3910/7526] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 04:28:24 2022] POST /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7/action => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 04:28:25.188822 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=19 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:28:25.189586 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:28:25.194521 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-152ec398-213a-4f63-9b3f-5b1d93c52430 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:28:25.195230 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-152ec398-213a-4f63-9b3f-5b1d93c52430 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 87631277-ef7c-4f32-ad28-b4be5c3314f7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:28:25.201261 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-152ec398-213a-4f63-9b3f-5b1d93c52430 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:28:25.202719 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-152ec398-213a-4f63-9b3f-5b1d93c52430 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:28:25.202719 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-152ec398-213a-4f63-9b3f-5b1d93c52430 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:28:25.203024 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-152ec398-213a-4f63-9b3f-5b1d93c52430 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:28:25.203435 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-152ec398-213a-4f63-9b3f-5b1d93c52430 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:28:25.203866 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-152ec398-213a-4f63-9b3f-5b1d93c52430 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:28:25.349446 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-152ec398-213a-4f63-9b3f-5b1d93c52430 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:28:25.357176 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-152ec398-213a-4f63-9b3f-5b1d93c52430 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7" status: 200 len: 1678 microversion: 2.1 time: 0.171270 Oct 27 04:28:25.357754 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3617/7527] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:28:25 2022] GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7 => generated 1678 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:28:26.382274 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-bea59695-552e-4da6-a596-a0ba144e2743 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:28:26.382937 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-bea59695-552e-4da6-a596-a0ba144e2743 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 87631277-ef7c-4f32-ad28-b4be5c3314f7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:28:26.388939 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bea59695-552e-4da6-a596-a0ba144e2743 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:28:26.389444 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bea59695-552e-4da6-a596-a0ba144e2743 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:28:26.389901 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bea59695-552e-4da6-a596-a0ba144e2743 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:28:26.390640 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bea59695-552e-4da6-a596-a0ba144e2743 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:28:26.391115 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bea59695-552e-4da6-a596-a0ba144e2743 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:28:26.391558 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bea59695-552e-4da6-a596-a0ba144e2743 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:28:26.522413 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-bea59695-552e-4da6-a596-a0ba144e2743 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:28:26.532210 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-bea59695-552e-4da6-a596-a0ba144e2743 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7" status: 200 len: 1678 microversion: 2.1 time: 0.155285 Oct 27 04:28:26.532789 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3911/7528] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:28:26 2022] GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:28:27.557353 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-989bc74b-409e-4797-ba1f-54e2847f446b tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:28:27.558125 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-989bc74b-409e-4797-ba1f-54e2847f446b tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 87631277-ef7c-4f32-ad28-b4be5c3314f7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:28:27.565286 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-989bc74b-409e-4797-ba1f-54e2847f446b tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:28:27.565803 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-989bc74b-409e-4797-ba1f-54e2847f446b tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:28:27.566291 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-989bc74b-409e-4797-ba1f-54e2847f446b tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:28:27.566973 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-989bc74b-409e-4797-ba1f-54e2847f446b tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:28:27.567432 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-989bc74b-409e-4797-ba1f-54e2847f446b tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:28:27.567860 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-989bc74b-409e-4797-ba1f-54e2847f446b tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:28:27.781411 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-989bc74b-409e-4797-ba1f-54e2847f446b tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:28:27.789103 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-989bc74b-409e-4797-ba1f-54e2847f446b tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7" status: 200 len: 1678 microversion: 2.1 time: 0.235666 Oct 27 04:28:27.789687 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3618/7529] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:28:27 2022] GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7 => generated 1678 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:28:28.812547 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1bf2584a-c06b-40b3-a8fd-81f60f567895 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:28:28.813187 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1bf2584a-c06b-40b3-a8fd-81f60f567895 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 87631277-ef7c-4f32-ad28-b4be5c3314f7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:28:28.820065 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1bf2584a-c06b-40b3-a8fd-81f60f567895 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:28:28.820569 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1bf2584a-c06b-40b3-a8fd-81f60f567895 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:28:28.821016 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1bf2584a-c06b-40b3-a8fd-81f60f567895 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:28:28.821727 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1bf2584a-c06b-40b3-a8fd-81f60f567895 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:28:28.822235 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1bf2584a-c06b-40b3-a8fd-81f60f567895 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:28:28.822688 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1bf2584a-c06b-40b3-a8fd-81f60f567895 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:28:28.954509 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1bf2584a-c06b-40b3-a8fd-81f60f567895 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:28:28.962946 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1bf2584a-c06b-40b3-a8fd-81f60f567895 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7" status: 200 len: 1683 microversion: 2.1 time: 0.154335 Oct 27 04:28:28.967406 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3912/7530] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:28:28 2022] GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7 => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:28:29.987553 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f881e6e1-3801-4851-86c2-c0f57ef2c341 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:28:29.988169 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f881e6e1-3801-4851-86c2-c0f57ef2c341 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 87631277-ef7c-4f32-ad28-b4be5c3314f7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:28:29.995047 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f881e6e1-3801-4851-86c2-c0f57ef2c341 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:28:29.995538 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f881e6e1-3801-4851-86c2-c0f57ef2c341 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:28:29.995983 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f881e6e1-3801-4851-86c2-c0f57ef2c341 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:28:29.996678 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f881e6e1-3801-4851-86c2-c0f57ef2c341 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:28:29.997138 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f881e6e1-3801-4851-86c2-c0f57ef2c341 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:28:29.997569 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f881e6e1-3801-4851-86c2-c0f57ef2c341 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:28:30.130743 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f881e6e1-3801-4851-86c2-c0f57ef2c341 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:28:30.138370 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f881e6e1-3801-4851-86c2-c0f57ef2c341 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7" status: 200 len: 1683 microversion: 2.1 time: 0.154700 Oct 27 04:28:30.138948 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3619/7531] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:28:29 2022] GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7 => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:28:31.162887 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-117ad096-bc98-472a-9e49-e821a2b53482 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:28:31.163555 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-117ad096-bc98-472a-9e49-e821a2b53482 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 87631277-ef7c-4f32-ad28-b4be5c3314f7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:28:31.170506 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-117ad096-bc98-472a-9e49-e821a2b53482 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:28:31.171021 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-117ad096-bc98-472a-9e49-e821a2b53482 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:28:31.171484 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-117ad096-bc98-472a-9e49-e821a2b53482 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:28:31.172215 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-117ad096-bc98-472a-9e49-e821a2b53482 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:28:31.172702 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-117ad096-bc98-472a-9e49-e821a2b53482 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:28:31.173157 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-117ad096-bc98-472a-9e49-e821a2b53482 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:28:31.302757 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-117ad096-bc98-472a-9e49-e821a2b53482 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:28:31.310438 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-117ad096-bc98-472a-9e49-e821a2b53482 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7" status: 200 len: 1683 microversion: 2.1 time: 0.152061 Oct 27 04:28:31.311021 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3913/7532] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:28:31 2022] GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7 => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:28:32.333905 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c8e2dfbf-c070-41f4-815d-5a4cf83cf433 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:28:32.334561 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c8e2dfbf-c070-41f4-815d-5a4cf83cf433 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 87631277-ef7c-4f32-ad28-b4be5c3314f7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:28:32.341316 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c8e2dfbf-c070-41f4-815d-5a4cf83cf433 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:28:32.341811 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c8e2dfbf-c070-41f4-815d-5a4cf83cf433 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:28:32.342561 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c8e2dfbf-c070-41f4-815d-5a4cf83cf433 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:28:32.343281 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c8e2dfbf-c070-41f4-815d-5a4cf83cf433 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:28:32.343726 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c8e2dfbf-c070-41f4-815d-5a4cf83cf433 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:28:32.344161 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c8e2dfbf-c070-41f4-815d-5a4cf83cf433 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:28:32.471820 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c8e2dfbf-c070-41f4-815d-5a4cf83cf433 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:28:32.479484 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c8e2dfbf-c070-41f4-815d-5a4cf83cf433 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7" status: 200 len: 1683 microversion: 2.1 time: 0.149478 Oct 27 04:28:32.480060 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3620/7533] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:28:32 2022] GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7 => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:28:33.503483 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-fb705a69-ba0b-4d45-860d-000921c133a3 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:28:33.504146 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-fb705a69-ba0b-4d45-860d-000921c133a3 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 87631277-ef7c-4f32-ad28-b4be5c3314f7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:28:33.510997 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fb705a69-ba0b-4d45-860d-000921c133a3 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:28:33.511510 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fb705a69-ba0b-4d45-860d-000921c133a3 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:28:33.511974 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fb705a69-ba0b-4d45-860d-000921c133a3 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:28:33.512694 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fb705a69-ba0b-4d45-860d-000921c133a3 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:28:33.513174 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fb705a69-ba0b-4d45-860d-000921c133a3 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:28:33.513631 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fb705a69-ba0b-4d45-860d-000921c133a3 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:28:33.647122 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-fb705a69-ba0b-4d45-860d-000921c133a3 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:28:33.654854 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-fb705a69-ba0b-4d45-860d-000921c133a3 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7" status: 200 len: 1683 microversion: 2.1 time: 0.155918 Oct 27 04:28:33.655454 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3914/7534] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:28:33 2022] GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7 => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:28:34.678846 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ca3cc7e0-3e34-4a7c-9fad-a942a18e557f tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:28:34.679476 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ca3cc7e0-3e34-4a7c-9fad-a942a18e557f tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 87631277-ef7c-4f32-ad28-b4be5c3314f7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:28:34.686448 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ca3cc7e0-3e34-4a7c-9fad-a942a18e557f tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:28:34.686946 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ca3cc7e0-3e34-4a7c-9fad-a942a18e557f tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:28:34.687397 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ca3cc7e0-3e34-4a7c-9fad-a942a18e557f tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:28:34.688109 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ca3cc7e0-3e34-4a7c-9fad-a942a18e557f tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:28:34.688581 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ca3cc7e0-3e34-4a7c-9fad-a942a18e557f tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:28:34.689021 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ca3cc7e0-3e34-4a7c-9fad-a942a18e557f tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:28:34.826382 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ca3cc7e0-3e34-4a7c-9fad-a942a18e557f tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:28:34.834279 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ca3cc7e0-3e34-4a7c-9fad-a942a18e557f tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7" status: 200 len: 1683 microversion: 2.1 time: 0.159460 Oct 27 04:28:34.835153 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3621/7535] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:28:34 2022] GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7 => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:28:35.858151 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1ef87d5e-a169-408e-b915-94fa2917edc1 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:28:35.858863 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1ef87d5e-a169-408e-b915-94fa2917edc1 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 87631277-ef7c-4f32-ad28-b4be5c3314f7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:28:35.865698 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1ef87d5e-a169-408e-b915-94fa2917edc1 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:28:35.866237 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1ef87d5e-a169-408e-b915-94fa2917edc1 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:28:35.866696 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1ef87d5e-a169-408e-b915-94fa2917edc1 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:28:35.867411 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1ef87d5e-a169-408e-b915-94fa2917edc1 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:28:35.867882 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1ef87d5e-a169-408e-b915-94fa2917edc1 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:28:35.868330 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1ef87d5e-a169-408e-b915-94fa2917edc1 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:28:35.997215 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1ef87d5e-a169-408e-b915-94fa2917edc1 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:28:36.005753 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1ef87d5e-a169-408e-b915-94fa2917edc1 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7" status: 200 len: 1683 microversion: 2.1 time: 0.151669 Oct 27 04:28:36.006362 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3915/7536] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:28:35 2022] GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7 => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:28:37.029713 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b5b5fd34-6d7c-45aa-a656-8ac381a6f315 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:28:37.030389 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b5b5fd34-6d7c-45aa-a656-8ac381a6f315 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 87631277-ef7c-4f32-ad28-b4be5c3314f7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:28:37.038911 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b5b5fd34-6d7c-45aa-a656-8ac381a6f315 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:28:37.039441 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b5b5fd34-6d7c-45aa-a656-8ac381a6f315 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:28:37.039888 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b5b5fd34-6d7c-45aa-a656-8ac381a6f315 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:28:37.040601 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b5b5fd34-6d7c-45aa-a656-8ac381a6f315 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:28:37.041122 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b5b5fd34-6d7c-45aa-a656-8ac381a6f315 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:28:37.041556 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b5b5fd34-6d7c-45aa-a656-8ac381a6f315 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:28:37.173537 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b5b5fd34-6d7c-45aa-a656-8ac381a6f315 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:28:37.181401 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b5b5fd34-6d7c-45aa-a656-8ac381a6f315 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7" status: 200 len: 1683 microversion: 2.1 time: 0.155596 Oct 27 04:28:37.181987 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3622/7537] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:28:37 2022] GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7 => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:28:38.204834 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a9ad7d85-b261-4700-911a-1542ff5f3889 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:28:38.206361 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a9ad7d85-b261-4700-911a-1542ff5f3889 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 87631277-ef7c-4f32-ad28-b4be5c3314f7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:28:38.212347 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a9ad7d85-b261-4700-911a-1542ff5f3889 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:28:38.212848 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a9ad7d85-b261-4700-911a-1542ff5f3889 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:28:38.213312 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a9ad7d85-b261-4700-911a-1542ff5f3889 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:28:38.214013 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a9ad7d85-b261-4700-911a-1542ff5f3889 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:28:38.214507 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a9ad7d85-b261-4700-911a-1542ff5f3889 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:28:38.214952 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a9ad7d85-b261-4700-911a-1542ff5f3889 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:28:38.342596 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a9ad7d85-b261-4700-911a-1542ff5f3889 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:28:38.350903 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a9ad7d85-b261-4700-911a-1542ff5f3889 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7" status: 200 len: 1683 microversion: 2.1 time: 0.150078 Oct 27 04:28:38.351482 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3916/7538] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:28:38 2022] GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7 => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:28:39.374921 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5052ce2c-c2be-4191-a21b-479c626df551 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:28:39.375541 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5052ce2c-c2be-4191-a21b-479c626df551 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 87631277-ef7c-4f32-ad28-b4be5c3314f7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:28:39.382959 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5052ce2c-c2be-4191-a21b-479c626df551 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:28:39.383450 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5052ce2c-c2be-4191-a21b-479c626df551 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:28:39.383894 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5052ce2c-c2be-4191-a21b-479c626df551 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:28:39.384590 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5052ce2c-c2be-4191-a21b-479c626df551 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:28:39.385048 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5052ce2c-c2be-4191-a21b-479c626df551 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:28:39.385479 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5052ce2c-c2be-4191-a21b-479c626df551 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:28:39.514789 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5052ce2c-c2be-4191-a21b-479c626df551 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:28:39.522553 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5052ce2c-c2be-4191-a21b-479c626df551 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7" status: 200 len: 1683 microversion: 2.1 time: 0.151810 Oct 27 04:28:39.523136 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3623/7539] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:28:39 2022] GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7 => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:28:40.546376 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8f5fe334-4303-472f-8fac-c0ac534fd8ec tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:28:40.547017 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8f5fe334-4303-472f-8fac-c0ac534fd8ec tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 87631277-ef7c-4f32-ad28-b4be5c3314f7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:28:40.553905 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8f5fe334-4303-472f-8fac-c0ac534fd8ec tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:28:40.554444 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8f5fe334-4303-472f-8fac-c0ac534fd8ec tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:28:40.554906 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8f5fe334-4303-472f-8fac-c0ac534fd8ec tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:28:40.555619 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8f5fe334-4303-472f-8fac-c0ac534fd8ec tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:28:40.556092 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8f5fe334-4303-472f-8fac-c0ac534fd8ec tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:28:40.556537 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8f5fe334-4303-472f-8fac-c0ac534fd8ec tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:28:40.688138 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8f5fe334-4303-472f-8fac-c0ac534fd8ec tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:28:40.696698 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8f5fe334-4303-472f-8fac-c0ac534fd8ec tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7" status: 200 len: 1683 microversion: 2.1 time: 0.154225 Oct 27 04:28:40.697280 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3917/7540] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:28:40 2022] GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7 => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:28:41.720816 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8f9cbade-d64a-4ebe-abb9-8fdcfc00d2d7 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:28:41.721477 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8f9cbade-d64a-4ebe-abb9-8fdcfc00d2d7 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 87631277-ef7c-4f32-ad28-b4be5c3314f7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:28:41.728287 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8f9cbade-d64a-4ebe-abb9-8fdcfc00d2d7 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:28:41.728768 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8f9cbade-d64a-4ebe-abb9-8fdcfc00d2d7 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:28:41.729204 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8f9cbade-d64a-4ebe-abb9-8fdcfc00d2d7 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:28:41.729893 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8f9cbade-d64a-4ebe-abb9-8fdcfc00d2d7 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:28:41.730379 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8f9cbade-d64a-4ebe-abb9-8fdcfc00d2d7 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:28:41.730804 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8f9cbade-d64a-4ebe-abb9-8fdcfc00d2d7 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:28:41.860326 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8f9cbade-d64a-4ebe-abb9-8fdcfc00d2d7 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:28:41.870592 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8f9cbade-d64a-4ebe-abb9-8fdcfc00d2d7 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7" status: 200 len: 1683 microversion: 2.1 time: 0.154043 Oct 27 04:28:41.871171 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3624/7541] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:28:41 2022] GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7 => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:28:42.897407 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-082b5018-d00c-4118-83f4-dbd5085f41a6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:28:42.898080 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-082b5018-d00c-4118-83f4-dbd5085f41a6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 87631277-ef7c-4f32-ad28-b4be5c3314f7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:28:42.904945 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-082b5018-d00c-4118-83f4-dbd5085f41a6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:28:42.905459 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-082b5018-d00c-4118-83f4-dbd5085f41a6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:28:42.905926 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-082b5018-d00c-4118-83f4-dbd5085f41a6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:28:42.906682 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-082b5018-d00c-4118-83f4-dbd5085f41a6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:28:42.907171 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-082b5018-d00c-4118-83f4-dbd5085f41a6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:28:42.907627 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-082b5018-d00c-4118-83f4-dbd5085f41a6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:28:43.036205 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-082b5018-d00c-4118-83f4-dbd5085f41a6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:28:43.044185 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-082b5018-d00c-4118-83f4-dbd5085f41a6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7" status: 200 len: 1683 microversion: 2.1 time: 0.151348 Oct 27 04:28:43.044769 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3918/7542] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:28:42 2022] GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7 => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:28:44.068335 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4c72c513-f767-4522-9280-9d3058c61a8e tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:28:44.068943 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4c72c513-f767-4522-9280-9d3058c61a8e tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 87631277-ef7c-4f32-ad28-b4be5c3314f7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:28:44.075772 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4c72c513-f767-4522-9280-9d3058c61a8e tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:28:44.076262 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4c72c513-f767-4522-9280-9d3058c61a8e tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:28:44.076706 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4c72c513-f767-4522-9280-9d3058c61a8e tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:28:44.077409 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4c72c513-f767-4522-9280-9d3058c61a8e tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:28:44.077865 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4c72c513-f767-4522-9280-9d3058c61a8e tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:28:44.078332 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4c72c513-f767-4522-9280-9d3058c61a8e tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:28:44.207151 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4c72c513-f767-4522-9280-9d3058c61a8e tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:28:44.214996 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4c72c513-f767-4522-9280-9d3058c61a8e tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7" status: 200 len: 1683 microversion: 2.1 time: 0.151074 Oct 27 04:28:44.215582 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3625/7543] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:28:44 2022] GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7 => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:28:45.238980 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6588d3ae-fb09-4c65-afc6-dcb697d41bd9 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:28:45.239616 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-6588d3ae-fb09-4c65-afc6-dcb697d41bd9 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 87631277-ef7c-4f32-ad28-b4be5c3314f7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:28:45.246487 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6588d3ae-fb09-4c65-afc6-dcb697d41bd9 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:28:45.251630 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6588d3ae-fb09-4c65-afc6-dcb697d41bd9 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:28:45.251630 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6588d3ae-fb09-4c65-afc6-dcb697d41bd9 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:28:45.251630 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6588d3ae-fb09-4c65-afc6-dcb697d41bd9 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:28:45.251630 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6588d3ae-fb09-4c65-afc6-dcb697d41bd9 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:28:45.251630 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6588d3ae-fb09-4c65-afc6-dcb697d41bd9 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:28:45.384319 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6588d3ae-fb09-4c65-afc6-dcb697d41bd9 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:28:45.392278 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6588d3ae-fb09-4c65-afc6-dcb697d41bd9 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7" status: 200 len: 1682 microversion: 2.1 time: 0.157490 Oct 27 04:28:45.392869 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3919/7544] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:28:45 2022] GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:28:45.817849 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-8b20f4fb-6c7a-4b99-96f9-3070860ebac1 req-a1a92d30-9b5f-43dd-950b-b6c50a8dcb99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87631277-ef7c-4f32-ad28-b4be5c3314f7", "name": "network-vif-unplugged", "status": "completed", "tag": "dd6723b9-ce60-4d37-9820-6a6a50693604"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:28:45.828061 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-8b20f4fb-6c7a-4b99-96f9-3070860ebac1 req-a1a92d30-9b5f-43dd-950b-b6c50a8dcb99 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:28:45.828550 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-8b20f4fb-6c7a-4b99-96f9-3070860ebac1 req-a1a92d30-9b5f-43dd-950b-b6c50a8dcb99 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:28:45.828990 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-8b20f4fb-6c7a-4b99-96f9-3070860ebac1 req-a1a92d30-9b5f-43dd-950b-b6c50a8dcb99 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:28:45.841190 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-8b20f4fb-6c7a-4b99-96f9-3070860ebac1 req-a1a92d30-9b5f-43dd-950b-b6c50a8dcb99 service nova] Creating event network-vif-unplugged:dd6723b9-ce60-4d37-9820-6a6a50693604 for instance 87631277-ef7c-4f32-ad28-b4be5c3314f7 on n-h1-862769-1 Oct 27 04:28:45.846659 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [req-8b20f4fb-6c7a-4b99-96f9-3070860ebac1 req-a1a92d30-9b5f-43dd-950b-b6c50a8dcb99 service nova] Instance 87631277-ef7c-4f32-ad28-b4be5c3314f7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862769-1', 'n-h1-862769-1'} {{(pid=121000) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 04:28:45.857746 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-8b20f4fb-6c7a-4b99-96f9-3070860ebac1 req-a1a92d30-9b5f-43dd-950b-b6c50a8dcb99 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044097 Oct 27 04:28:45.858390 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3626/7545] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:28:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:28:46.419338 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f7d17ece-3d08-42d8-b532-f9d31ed0d471 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:28:46.420608 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f7d17ece-3d08-42d8-b532-f9d31ed0d471 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 87631277-ef7c-4f32-ad28-b4be5c3314f7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:28:46.428266 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f7d17ece-3d08-42d8-b532-f9d31ed0d471 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:28:46.428782 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f7d17ece-3d08-42d8-b532-f9d31ed0d471 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:28:46.429240 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f7d17ece-3d08-42d8-b532-f9d31ed0d471 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:28:46.430058 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f7d17ece-3d08-42d8-b532-f9d31ed0d471 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:28:46.430578 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f7d17ece-3d08-42d8-b532-f9d31ed0d471 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:28:46.431057 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f7d17ece-3d08-42d8-b532-f9d31ed0d471 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:28:46.644575 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f7d17ece-3d08-42d8-b532-f9d31ed0d471 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:28:46.651354 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f7d17ece-3d08-42d8-b532-f9d31ed0d471 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7" status: 200 len: 1682 microversion: 2.1 time: 0.236279 Oct 27 04:28:46.652076 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3920/7546] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:28:46 2022] GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7 => generated 1682 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:28:47.677623 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c325fb9e-1308-47bd-bd0e-89fa608a39be tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:28:47.678313 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c325fb9e-1308-47bd-bd0e-89fa608a39be tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 87631277-ef7c-4f32-ad28-b4be5c3314f7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:28:47.684578 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c325fb9e-1308-47bd-bd0e-89fa608a39be tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:28:47.685079 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c325fb9e-1308-47bd-bd0e-89fa608a39be tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:28:47.685528 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c325fb9e-1308-47bd-bd0e-89fa608a39be tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:28:47.686269 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c325fb9e-1308-47bd-bd0e-89fa608a39be tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:28:47.686740 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c325fb9e-1308-47bd-bd0e-89fa608a39be tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:28:47.687181 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c325fb9e-1308-47bd-bd0e-89fa608a39be tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:28:47.818082 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c325fb9e-1308-47bd-bd0e-89fa608a39be tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:28:47.825807 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c325fb9e-1308-47bd-bd0e-89fa608a39be tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7" status: 200 len: 1680 microversion: 2.1 time: 0.154106 Oct 27 04:28:47.826425 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3627/7547] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:28:47 2022] GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:28:47.872318 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-84b9af24-fe0d-42e5-ac1d-1d214a62e936 req-bbcf88b4-4c64-4fb5-86b6-4364301f0075 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87631277-ef7c-4f32-ad28-b4be5c3314f7", "tag": "dd6723b9-ce60-4d37-9820-6a6a50693604"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:28:47.882506 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-84b9af24-fe0d-42e5-ac1d-1d214a62e936 req-bbcf88b4-4c64-4fb5-86b6-4364301f0075 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:28:47.883011 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-84b9af24-fe0d-42e5-ac1d-1d214a62e936 req-bbcf88b4-4c64-4fb5-86b6-4364301f0075 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:28:47.883468 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-84b9af24-fe0d-42e5-ac1d-1d214a62e936 req-bbcf88b4-4c64-4fb5-86b6-4364301f0075 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:28:47.897301 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-84b9af24-fe0d-42e5-ac1d-1d214a62e936 req-bbcf88b4-4c64-4fb5-86b6-4364301f0075 service nova] Creating event network-changed:dd6723b9-ce60-4d37-9820-6a6a50693604 for instance 87631277-ef7c-4f32-ad28-b4be5c3314f7 on n-h1-862769-1 Oct 27 04:28:47.906788 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [req-84b9af24-fe0d-42e5-ac1d-1d214a62e936 req-bbcf88b4-4c64-4fb5-86b6-4364301f0075 service nova] Instance 87631277-ef7c-4f32-ad28-b4be5c3314f7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862769-1', 'n-h1-862769-1'} {{(pid=121001) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 04:28:47.918424 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-84b9af24-fe0d-42e5-ac1d-1d214a62e936 req-bbcf88b4-4c64-4fb5-86b6-4364301f0075 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049812 Oct 27 04:28:47.919037 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3921/7548] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:28:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:28:48.849552 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a670a7a0-397d-4c8b-93a8-b5141eb36b05 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:28:48.850213 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a670a7a0-397d-4c8b-93a8-b5141eb36b05 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 87631277-ef7c-4f32-ad28-b4be5c3314f7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:28:48.856857 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a670a7a0-397d-4c8b-93a8-b5141eb36b05 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:28:48.857730 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a670a7a0-397d-4c8b-93a8-b5141eb36b05 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:28:48.858203 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a670a7a0-397d-4c8b-93a8-b5141eb36b05 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:28:48.858909 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a670a7a0-397d-4c8b-93a8-b5141eb36b05 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:28:48.859400 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a670a7a0-397d-4c8b-93a8-b5141eb36b05 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:28:48.859832 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a670a7a0-397d-4c8b-93a8-b5141eb36b05 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:28:49.001899 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a670a7a0-397d-4c8b-93a8-b5141eb36b05 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:28:49.011882 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a670a7a0-397d-4c8b-93a8-b5141eb36b05 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7" status: 200 len: 1680 microversion: 2.1 time: 0.166142 Oct 27 04:28:49.014465 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3628/7549] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:28:48 2022] GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7 => generated 1680 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:28:50.037855 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-26922048-847c-4867-af94-2a32d6a3e889 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:28:50.038618 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-26922048-847c-4867-af94-2a32d6a3e889 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 87631277-ef7c-4f32-ad28-b4be5c3314f7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:28:50.044764 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-26922048-847c-4867-af94-2a32d6a3e889 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:28:50.045267 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-26922048-847c-4867-af94-2a32d6a3e889 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:28:50.045726 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-26922048-847c-4867-af94-2a32d6a3e889 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:28:50.046468 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-26922048-847c-4867-af94-2a32d6a3e889 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:28:50.046943 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-26922048-847c-4867-af94-2a32d6a3e889 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:28:50.047386 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-26922048-847c-4867-af94-2a32d6a3e889 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:28:50.527634 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-26922048-847c-4867-af94-2a32d6a3e889 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:28:50.536052 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-26922048-847c-4867-af94-2a32d6a3e889 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7" status: 200 len: 1677 microversion: 2.1 time: 0.503465 Oct 27 04:28:50.536641 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3922/7550] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:28:50 2022] GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7 => generated 1677 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:28:50.558860 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-bdd09223-d090-47f8-be4d-3e7af777a137 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:28:50.559444 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-bdd09223-d090-47f8-be4d-3e7af777a137 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 87631277-ef7c-4f32-ad28-b4be5c3314f7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:28:50.566099 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bdd09223-d090-47f8-be4d-3e7af777a137 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:28:50.582135 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bdd09223-d090-47f8-be4d-3e7af777a137 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:28:50.582135 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bdd09223-d090-47f8-be4d-3e7af777a137 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:28:50.582135 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bdd09223-d090-47f8-be4d-3e7af777a137 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:28:50.582135 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bdd09223-d090-47f8-be4d-3e7af777a137 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:28:50.582135 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bdd09223-d090-47f8-be4d-3e7af777a137 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:28:50.608723 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bdd09223-d090-47f8-be4d-3e7af777a137 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:28:50.610656 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bdd09223-d090-47f8-be4d-3e7af777a137 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:28:50.610656 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bdd09223-d090-47f8-be4d-3e7af777a137 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:28:50.610656 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bdd09223-d090-47f8-be4d-3e7af777a137 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:28:50.611032 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bdd09223-d090-47f8-be4d-3e7af777a137 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:28:50.611302 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bdd09223-d090-47f8-be4d-3e7af777a137 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:28:50.631542 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-bdd09223-d090-47f8-be4d-3e7af777a137 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Getting quotas for project 529ab4a5a66947aebb3f09a9842e5c9f. Resources: {'cores', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 04:28:50.639286 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-bdd09223-d090-47f8-be4d-3e7af777a137 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Getting quotas for user 197669776fde4a6480f6cab6e5c8552f and project 529ab4a5a66947aebb3f09a9842e5c9f. Resources: {'cores', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 04:28:51.009834 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-bdd09223-d090-47f8-be4d-3e7af777a137 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "POST /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7/action" status: 202 len: 0 microversion: 2.1 time: 0.454507 Oct 27 04:28:51.014179 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3629/7551] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 04:28:50 2022] POST /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7/action => generated 0 bytes in 457 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 04:28:51.019836 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e5e575da-777d-43f3-b484-6eedabf8ff0c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:28:51.020722 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e5e575da-777d-43f3-b484-6eedabf8ff0c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 87631277-ef7c-4f32-ad28-b4be5c3314f7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:28:51.027120 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e5e575da-777d-43f3-b484-6eedabf8ff0c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:28:51.027633 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e5e575da-777d-43f3-b484-6eedabf8ff0c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:28:51.028294 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e5e575da-777d-43f3-b484-6eedabf8ff0c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:28:51.029030 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e5e575da-777d-43f3-b484-6eedabf8ff0c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:28:51.029519 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e5e575da-777d-43f3-b484-6eedabf8ff0c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:28:51.029975 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e5e575da-777d-43f3-b484-6eedabf8ff0c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:28:51.254577 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e5e575da-777d-43f3-b484-6eedabf8ff0c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:28:51.262595 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e5e575da-777d-43f3-b484-6eedabf8ff0c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7" status: 200 len: 1676 microversion: 2.1 time: 0.247271 Oct 27 04:28:51.263176 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3923/7552] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:28:51 2022] GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7 => generated 1676 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:28:52.287826 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-574cbbf2-9d94-4c90-bb5d-a71ad8a2f65d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:28:52.288550 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-574cbbf2-9d94-4c90-bb5d-a71ad8a2f65d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 87631277-ef7c-4f32-ad28-b4be5c3314f7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:28:52.295618 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-574cbbf2-9d94-4c90-bb5d-a71ad8a2f65d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:28:52.296115 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-574cbbf2-9d94-4c90-bb5d-a71ad8a2f65d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:28:52.296569 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-574cbbf2-9d94-4c90-bb5d-a71ad8a2f65d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:28:52.297280 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-574cbbf2-9d94-4c90-bb5d-a71ad8a2f65d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:28:52.297768 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-574cbbf2-9d94-4c90-bb5d-a71ad8a2f65d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:28:52.298225 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-574cbbf2-9d94-4c90-bb5d-a71ad8a2f65d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:28:52.426688 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-574cbbf2-9d94-4c90-bb5d-a71ad8a2f65d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:28:52.430231 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:28:52.434864 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-574cbbf2-9d94-4c90-bb5d-a71ad8a2f65d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7" status: 200 len: 1676 microversion: 2.1 time: 0.152058 Oct 27 04:28:52.435451 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3630/7553] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:28:52 2022] GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7 => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:28:52.803870 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-d7c18832-be28-487e-9137-2c5dc10eb520 req-65af39fb-fe73-4b2c-ab83-8507575d81cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87631277-ef7c-4f32-ad28-b4be5c3314f7", "name": "network-vif-plugged", "status": "completed", "tag": "dd6723b9-ce60-4d37-9820-6a6a50693604"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:28:52.813667 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-d7c18832-be28-487e-9137-2c5dc10eb520 req-65af39fb-fe73-4b2c-ab83-8507575d81cf service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:28:52.814203 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-d7c18832-be28-487e-9137-2c5dc10eb520 req-65af39fb-fe73-4b2c-ab83-8507575d81cf service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:28:52.814663 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-d7c18832-be28-487e-9137-2c5dc10eb520 req-65af39fb-fe73-4b2c-ab83-8507575d81cf service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:28:52.826192 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-d7c18832-be28-487e-9137-2c5dc10eb520 req-65af39fb-fe73-4b2c-ab83-8507575d81cf service nova] Creating event network-vif-plugged:dd6723b9-ce60-4d37-9820-6a6a50693604 for instance 87631277-ef7c-4f32-ad28-b4be5c3314f7 on n-h1-862769-1 Oct 27 04:28:52.831957 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [req-d7c18832-be28-487e-9137-2c5dc10eb520 req-65af39fb-fe73-4b2c-ab83-8507575d81cf service nova] Instance 87631277-ef7c-4f32-ad28-b4be5c3314f7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862769-1', 'n-h1-862769-1'} {{(pid=121001) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 04:28:52.842894 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-d7c18832-be28-487e-9137-2c5dc10eb520 req-65af39fb-fe73-4b2c-ab83-8507575d81cf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042846 Oct 27 04:28:52.846806 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3924/7554] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:28:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:28:53.461496 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1f518e6d-7a2f-43e6-bae8-e571bc77466d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:28:53.462913 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1f518e6d-7a2f-43e6-bae8-e571bc77466d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 87631277-ef7c-4f32-ad28-b4be5c3314f7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:28:53.472194 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1f518e6d-7a2f-43e6-bae8-e571bc77466d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:28:53.472691 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1f518e6d-7a2f-43e6-bae8-e571bc77466d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:28:53.473130 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1f518e6d-7a2f-43e6-bae8-e571bc77466d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:28:53.473838 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1f518e6d-7a2f-43e6-bae8-e571bc77466d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:28:53.474327 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1f518e6d-7a2f-43e6-bae8-e571bc77466d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:28:53.474755 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1f518e6d-7a2f-43e6-bae8-e571bc77466d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:28:53.606259 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1f518e6d-7a2f-43e6-bae8-e571bc77466d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:28:53.614100 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1f518e6d-7a2f-43e6-bae8-e571bc77466d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7" status: 200 len: 1676 microversion: 2.1 time: 0.157241 Oct 27 04:28:53.614707 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3631/7555] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:28:53 2022] GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7 => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:28:54.638381 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-fc1d0ff6-c8ee-48d3-9ad6-9e73ff114376 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:28:54.639206 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-fc1d0ff6-c8ee-48d3-9ad6-9e73ff114376 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 87631277-ef7c-4f32-ad28-b4be5c3314f7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:28:54.646211 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fc1d0ff6-c8ee-48d3-9ad6-9e73ff114376 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:28:54.646743 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fc1d0ff6-c8ee-48d3-9ad6-9e73ff114376 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:28:54.647202 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fc1d0ff6-c8ee-48d3-9ad6-9e73ff114376 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:28:54.647921 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fc1d0ff6-c8ee-48d3-9ad6-9e73ff114376 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:28:54.648396 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fc1d0ff6-c8ee-48d3-9ad6-9e73ff114376 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:28:54.648844 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fc1d0ff6-c8ee-48d3-9ad6-9e73ff114376 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:28:54.783704 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-fc1d0ff6-c8ee-48d3-9ad6-9e73ff114376 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:28:54.787716 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:28:54.792987 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-fc1d0ff6-c8ee-48d3-9ad6-9e73ff114376 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7" status: 200 len: 1676 microversion: 2.1 time: 0.159893 Oct 27 04:28:54.803587 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3925/7556] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:28:54 2022] GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7 => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:28:54.806377 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-1d64cae3-6af0-4b53-bfc7-ebac095fd3de req-4f0c71b2-8fd0-44ca-8f3f-ae5f1a8500a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87631277-ef7c-4f32-ad28-b4be5c3314f7", "name": "network-vif-unplugged", "status": "completed", "tag": "dd6723b9-ce60-4d37-9820-6a6a50693604"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:28:54.816935 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-1d64cae3-6af0-4b53-bfc7-ebac095fd3de req-4f0c71b2-8fd0-44ca-8f3f-ae5f1a8500a5 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:28:54.817441 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-1d64cae3-6af0-4b53-bfc7-ebac095fd3de req-4f0c71b2-8fd0-44ca-8f3f-ae5f1a8500a5 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:28:54.817882 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-1d64cae3-6af0-4b53-bfc7-ebac095fd3de req-4f0c71b2-8fd0-44ca-8f3f-ae5f1a8500a5 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:28:54.829399 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-1d64cae3-6af0-4b53-bfc7-ebac095fd3de req-4f0c71b2-8fd0-44ca-8f3f-ae5f1a8500a5 service nova] Creating event network-vif-unplugged:dd6723b9-ce60-4d37-9820-6a6a50693604 for instance 87631277-ef7c-4f32-ad28-b4be5c3314f7 on n-h2-862769-1 Oct 27 04:28:54.835196 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [req-1d64cae3-6af0-4b53-bfc7-ebac095fd3de req-4f0c71b2-8fd0-44ca-8f3f-ae5f1a8500a5 service nova] Instance 87631277-ef7c-4f32-ad28-b4be5c3314f7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862769-1', 'n-h1-862769-1'} {{(pid=121000) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 04:28:54.846015 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-1d64cae3-6af0-4b53-bfc7-ebac095fd3de req-4f0c71b2-8fd0-44ca-8f3f-ae5f1a8500a5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054197 Oct 27 04:28:54.846657 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3632/7557] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:28:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:28:55.817899 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-db7eaa59-539f-4cf9-8058-42aaa96d6338 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:28:55.818486 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-db7eaa59-539f-4cf9-8058-42aaa96d6338 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 87631277-ef7c-4f32-ad28-b4be5c3314f7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:28:55.821351 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=37 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:28:55.826378 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-db7eaa59-539f-4cf9-8058-42aaa96d6338 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:28:55.826882 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-db7eaa59-539f-4cf9-8058-42aaa96d6338 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:28:55.827351 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-db7eaa59-539f-4cf9-8058-42aaa96d6338 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:28:55.828116 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-db7eaa59-539f-4cf9-8058-42aaa96d6338 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:28:55.828580 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-db7eaa59-539f-4cf9-8058-42aaa96d6338 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:28:55.829029 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-db7eaa59-539f-4cf9-8058-42aaa96d6338 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:28:55.974524 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-db7eaa59-539f-4cf9-8058-42aaa96d6338 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:28:55.982483 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-db7eaa59-539f-4cf9-8058-42aaa96d6338 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7" status: 200 len: 1676 microversion: 2.1 time: 0.168943 Oct 27 04:28:55.983060 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3926/7558] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:28:55 2022] GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7 => generated 1676 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:28:56.860680 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-5d0d8b9f-5599-49e0-b919-3e910b2891ed req-993ff215-ce63-44da-a0e3-97fb2c99eb87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87631277-ef7c-4f32-ad28-b4be5c3314f7", "tag": "dd6723b9-ce60-4d37-9820-6a6a50693604"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:28:56.866517 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:28:56.871937 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-5d0d8b9f-5599-49e0-b919-3e910b2891ed req-993ff215-ce63-44da-a0e3-97fb2c99eb87 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:28:56.875508 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-5d0d8b9f-5599-49e0-b919-3e910b2891ed req-993ff215-ce63-44da-a0e3-97fb2c99eb87 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:28:56.875508 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-5d0d8b9f-5599-49e0-b919-3e910b2891ed req-993ff215-ce63-44da-a0e3-97fb2c99eb87 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:28:56.884847 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-5d0d8b9f-5599-49e0-b919-3e910b2891ed req-993ff215-ce63-44da-a0e3-97fb2c99eb87 service nova] Creating event network-changed:dd6723b9-ce60-4d37-9820-6a6a50693604 for instance 87631277-ef7c-4f32-ad28-b4be5c3314f7 on n-h2-862769-1 Oct 27 04:28:56.889944 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [req-5d0d8b9f-5599-49e0-b919-3e910b2891ed req-993ff215-ce63-44da-a0e3-97fb2c99eb87 service nova] Instance 87631277-ef7c-4f32-ad28-b4be5c3314f7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862769-1', 'n-h1-862769-1'} {{(pid=121000) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 04:28:56.901448 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-5d0d8b9f-5599-49e0-b919-3e910b2891ed req-993ff215-ce63-44da-a0e3-97fb2c99eb87 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044859 Oct 27 04:28:56.904208 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3633/7559] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:28:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:28:57.007701 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4d87a67e-421a-490b-ac2c-a9cac6d56b57 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:28:57.008444 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4d87a67e-421a-490b-ac2c-a9cac6d56b57 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 87631277-ef7c-4f32-ad28-b4be5c3314f7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:28:57.015632 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4d87a67e-421a-490b-ac2c-a9cac6d56b57 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:28:57.016226 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4d87a67e-421a-490b-ac2c-a9cac6d56b57 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:28:57.016755 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4d87a67e-421a-490b-ac2c-a9cac6d56b57 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:28:57.017550 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4d87a67e-421a-490b-ac2c-a9cac6d56b57 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:28:57.018734 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4d87a67e-421a-490b-ac2c-a9cac6d56b57 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:28:57.019478 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4d87a67e-421a-490b-ac2c-a9cac6d56b57 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:28:57.228864 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4d87a67e-421a-490b-ac2c-a9cac6d56b57 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:28:57.238290 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4d87a67e-421a-490b-ac2c-a9cac6d56b57 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7" status: 200 len: 1676 microversion: 2.1 time: 0.234348 Oct 27 04:28:57.258002 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3927/7560] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:28:57 2022] GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7 => generated 1676 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:28:58.264438 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-59ece9bd-a894-4f44-9a98-6302724a0b1d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:28:58.265195 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-59ece9bd-a894-4f44-9a98-6302724a0b1d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 87631277-ef7c-4f32-ad28-b4be5c3314f7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:28:58.272413 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-59ece9bd-a894-4f44-9a98-6302724a0b1d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:28:58.272967 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-59ece9bd-a894-4f44-9a98-6302724a0b1d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:28:58.273395 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-59ece9bd-a894-4f44-9a98-6302724a0b1d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:28:58.274388 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-59ece9bd-a894-4f44-9a98-6302724a0b1d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:28:58.274698 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-59ece9bd-a894-4f44-9a98-6302724a0b1d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:28:58.275128 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-59ece9bd-a894-4f44-9a98-6302724a0b1d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:28:58.407211 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-59ece9bd-a894-4f44-9a98-6302724a0b1d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:28:58.415179 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-59ece9bd-a894-4f44-9a98-6302724a0b1d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7" status: 200 len: 1669 microversion: 2.1 time: 0.156003 Oct 27 04:28:58.415773 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3634/7561] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:28:58 2022] GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7 => generated 1669 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:28:58.437789 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-751c94c0-9e80-45bc-bb59-e2561d6ef3c6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:28:58.438401 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-751c94c0-9e80-45bc-bb59-e2561d6ef3c6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 87631277-ef7c-4f32-ad28-b4be5c3314f7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:28:58.445817 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-751c94c0-9e80-45bc-bb59-e2561d6ef3c6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:28:58.446397 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-751c94c0-9e80-45bc-bb59-e2561d6ef3c6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:28:58.446867 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-751c94c0-9e80-45bc-bb59-e2561d6ef3c6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:28:58.447602 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-751c94c0-9e80-45bc-bb59-e2561d6ef3c6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:28:58.448089 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-751c94c0-9e80-45bc-bb59-e2561d6ef3c6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:28:58.448545 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-751c94c0-9e80-45bc-bb59-e2561d6ef3c6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:28:58.586222 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-751c94c0-9e80-45bc-bb59-e2561d6ef3c6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:28:58.595475 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-751c94c0-9e80-45bc-bb59-e2561d6ef3c6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7" status: 200 len: 1669 microversion: 2.1 time: 0.161477 Oct 27 04:28:58.612814 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3928/7562] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:28:58 2022] GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7 => generated 1669 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:28:58.618384 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e64a90ba-d355-48fb-b999-40390dccdc77 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:28:58.619480 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e64a90ba-d355-48fb-b999-40390dccdc77 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 87631277-ef7c-4f32-ad28-b4be5c3314f7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:28:58.628760 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e64a90ba-d355-48fb-b999-40390dccdc77 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:28:58.629425 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e64a90ba-d355-48fb-b999-40390dccdc77 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:28:58.629893 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e64a90ba-d355-48fb-b999-40390dccdc77 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:28:58.631971 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e64a90ba-d355-48fb-b999-40390dccdc77 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:28:58.632523 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e64a90ba-d355-48fb-b999-40390dccdc77 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:28:58.632973 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e64a90ba-d355-48fb-b999-40390dccdc77 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:28:58.783363 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e64a90ba-d355-48fb-b999-40390dccdc77 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:28:58.794585 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e64a90ba-d355-48fb-b999-40390dccdc77 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7" status: 200 len: 1669 microversion: 2.1 time: 0.180105 Oct 27 04:28:58.795408 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3635/7563] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:28:58 2022] GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7 => generated 1669 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:28:58.816934 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3d86b112-cac2-47bb-aa0a-1f2bc79d8c30 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:28:58.817621 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3d86b112-cac2-47bb-aa0a-1f2bc79d8c30 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 87631277-ef7c-4f32-ad28-b4be5c3314f7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:28:58.823731 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3d86b112-cac2-47bb-aa0a-1f2bc79d8c30 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:28:58.824248 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3d86b112-cac2-47bb-aa0a-1f2bc79d8c30 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:28:58.824718 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3d86b112-cac2-47bb-aa0a-1f2bc79d8c30 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:28:58.825451 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3d86b112-cac2-47bb-aa0a-1f2bc79d8c30 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:28:58.825939 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3d86b112-cac2-47bb-aa0a-1f2bc79d8c30 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:28:58.826528 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3d86b112-cac2-47bb-aa0a-1f2bc79d8c30 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:28:58.855649 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3d86b112-cac2-47bb-aa0a-1f2bc79d8c30 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 87631277-ef7c-4f32-ad28-b4be5c3314f7] Going to try to terminate instance {{(pid=121001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 04:28:59.169708 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3d86b112-cac2-47bb-aa0a-1f2bc79d8c30 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "DELETE /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7" status: 204 len: 0 microversion: 2.1 time: 0.356404 Oct 27 04:28:59.170350 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3929/7564] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 04:28:58 2022] DELETE /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 04:28:59.179380 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d6009efb-80e9-428f-b428-295ca5099166 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:28:59.180995 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d6009efb-80e9-428f-b428-295ca5099166 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 87631277-ef7c-4f32-ad28-b4be5c3314f7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:28:59.186362 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d6009efb-80e9-428f-b428-295ca5099166 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:28:59.187082 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d6009efb-80e9-428f-b428-295ca5099166 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:28:59.187291 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d6009efb-80e9-428f-b428-295ca5099166 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:28:59.188000 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d6009efb-80e9-428f-b428-295ca5099166 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:28:59.188458 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d6009efb-80e9-428f-b428-295ca5099166 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:28:59.188889 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d6009efb-80e9-428f-b428-295ca5099166 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:28:59.316310 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d6009efb-80e9-428f-b428-295ca5099166 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:28:59.324000 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d6009efb-80e9-428f-b428-295ca5099166 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7" status: 200 len: 1675 microversion: 2.1 time: 0.148646 Oct 27 04:28:59.324585 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3636/7565] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:28:59 2022] GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7 => generated 1675 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:29:00.347584 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-205edba6-9278-495d-bfd0-1106faf175a8 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:29:00.348326 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-205edba6-9278-495d-bfd0-1106faf175a8 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 87631277-ef7c-4f32-ad28-b4be5c3314f7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:29:00.355187 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-205edba6-9278-495d-bfd0-1106faf175a8 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:29:00.355704 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-205edba6-9278-495d-bfd0-1106faf175a8 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:29:00.356177 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-205edba6-9278-495d-bfd0-1106faf175a8 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:29:00.356914 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-205edba6-9278-495d-bfd0-1106faf175a8 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:29:00.357400 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-205edba6-9278-495d-bfd0-1106faf175a8 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:29:00.357860 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-205edba6-9278-495d-bfd0-1106faf175a8 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:29:00.497923 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-205edba6-9278-495d-bfd0-1106faf175a8 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:29:00.507407 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-205edba6-9278-495d-bfd0-1106faf175a8 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7" status: 200 len: 1675 microversion: 2.1 time: 0.163722 Oct 27 04:29:00.507858 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3930/7566] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:29:00 2022] GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7 => generated 1675 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:29:00.676778 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-e6ef7636-b5c8-4755-818e-f97a4fee357c req-a6f9091a-ec4a-4f97-ab3c-571eb1fac81c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87631277-ef7c-4f32-ad28-b4be5c3314f7", "name": "network-vif-plugged", "status": "completed", "tag": "dd6723b9-ce60-4d37-9820-6a6a50693604"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:29:00.684200 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=3 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:29:00.690745 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-e6ef7636-b5c8-4755-818e-f97a4fee357c req-a6f9091a-ec4a-4f97-ab3c-571eb1fac81c service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:29:00.691239 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-e6ef7636-b5c8-4755-818e-f97a4fee357c req-a6f9091a-ec4a-4f97-ab3c-571eb1fac81c service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:29:00.691696 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-e6ef7636-b5c8-4755-818e-f97a4fee357c req-a6f9091a-ec4a-4f97-ab3c-571eb1fac81c service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:29:00.704210 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-e6ef7636-b5c8-4755-818e-f97a4fee357c req-a6f9091a-ec4a-4f97-ab3c-571eb1fac81c service nova] Creating event network-vif-plugged:dd6723b9-ce60-4d37-9820-6a6a50693604 for instance 87631277-ef7c-4f32-ad28-b4be5c3314f7 on n-h2-862769-1 Oct 27 04:29:00.711145 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-e6ef7636-b5c8-4755-818e-f97a4fee357c req-a6f9091a-ec4a-4f97-ab3c-571eb1fac81c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039245 Oct 27 04:29:00.711753 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3637/7567] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:29:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:29:01.540851 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c97a255b-699f-4b84-bfbc-7f00a8a6195c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:29:01.541504 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c97a255b-699f-4b84-bfbc-7f00a8a6195c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 87631277-ef7c-4f32-ad28-b4be5c3314f7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:29:01.548501 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c97a255b-699f-4b84-bfbc-7f00a8a6195c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:29:01.549077 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c97a255b-699f-4b84-bfbc-7f00a8a6195c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:29:01.549539 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c97a255b-699f-4b84-bfbc-7f00a8a6195c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:29:01.550523 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c97a255b-699f-4b84-bfbc-7f00a8a6195c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:29:01.551008 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c97a255b-699f-4b84-bfbc-7f00a8a6195c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:29:01.551457 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c97a255b-699f-4b84-bfbc-7f00a8a6195c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:29:01.616826 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c97a255b-699f-4b84-bfbc-7f00a8a6195c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:29:01.624780 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c97a255b-699f-4b84-bfbc-7f00a8a6195c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7" status: 200 len: 1608 microversion: 2.1 time: 0.087903 Oct 27 04:29:01.625360 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3931/7568] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:29:01 2022] GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7 => generated 1608 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:29:01.709526 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-52a8655c-8802-4440-b253-48fe56b54009 req-5bc139d5-8cc8-441a-af50-e44f2c5690af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87631277-ef7c-4f32-ad28-b4be5c3314f7", "name": "network-vif-deleted", "tag": "dd6723b9-ce60-4d37-9820-6a6a50693604"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:29:01.720066 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-52a8655c-8802-4440-b253-48fe56b54009 req-5bc139d5-8cc8-441a-af50-e44f2c5690af service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:29:01.720875 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-52a8655c-8802-4440-b253-48fe56b54009 req-5bc139d5-8cc8-441a-af50-e44f2c5690af service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:29:01.721780 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-52a8655c-8802-4440-b253-48fe56b54009 req-5bc139d5-8cc8-441a-af50-e44f2c5690af service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:29:01.733459 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-52a8655c-8802-4440-b253-48fe56b54009 req-5bc139d5-8cc8-441a-af50-e44f2c5690af service nova] Creating event network-vif-deleted:dd6723b9-ce60-4d37-9820-6a6a50693604 for instance 87631277-ef7c-4f32-ad28-b4be5c3314f7 on n-h2-862769-1 Oct 27 04:29:01.738704 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-52a8655c-8802-4440-b253-48fe56b54009 req-5bc139d5-8cc8-441a-af50-e44f2c5690af service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036393 Oct 27 04:29:01.739571 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3638/7569] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:29:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:29:02.649143 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1640ff63-5f76-4ab4-aef5-469fb763e99e tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:29:02.649780 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1640ff63-5f76-4ab4-aef5-469fb763e99e tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 87631277-ef7c-4f32-ad28-b4be5c3314f7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:29:02.657203 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1640ff63-5f76-4ab4-aef5-469fb763e99e tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:29:02.657735 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1640ff63-5f76-4ab4-aef5-469fb763e99e tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:29:02.658227 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1640ff63-5f76-4ab4-aef5-469fb763e99e tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:29:02.659531 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1640ff63-5f76-4ab4-aef5-469fb763e99e tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:29:02.660014 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1640ff63-5f76-4ab4-aef5-469fb763e99e tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:29:02.660475 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1640ff63-5f76-4ab4-aef5-469fb763e99e tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:29:02.675307 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-1640ff63-5f76-4ab4-aef5-469fb763e99e tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] HTTP exception thrown: Instance 87631277-ef7c-4f32-ad28-b4be5c3314f7 could not be found. Oct 27 04:29:02.677054 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1640ff63-5f76-4ab4-aef5-469fb763e99e tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Request method failure captured: Oct 27 04:29:02.677054 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7 HTTP/1.1 Oct 27 04:29:02.677054 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 04:29:02.677054 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 04:29:02.677054 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 04:29:02.677054 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 04:29:02.677054 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 04:29:02.677054 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 04:29:02.677054 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 04:29:02.677054 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 04:29:02.677054 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWggT1pShQ7YBK6vLEnUn4ThZkZHCmWwxudcjcX6Q_Qzyxxu4Tv9k9Mz8NdF1J-CqoCxrwqSYjXa2e5qz-_PVvAMi6WsvOj7WQPQINruTawh_9Huu8QwtjT2xusIZMY0glj9dlYg_3F0cuyrDKuyyLc3oA_TbX8qtqDNM9W1LEjJuGfY Oct 27 04:29:02.677054 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 04:29:02.677054 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 04:29:02.677054 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 04:29:02.677054 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 04:29:02.677054 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 04:29:02.677054 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 04:29:02.677054 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 529ab4a5a66947aebb3f09a9842e5c9f Oct 27 04:29:02.677054 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServerActionsTestJSON-403049074 Oct 27 04:29:02.677054 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 04:29:02.677054 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 04:29:02.677054 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/529ab4a5a66947aebb3f09a9842e5c9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/529ab4a5a66947aebb3f09a9842e5c9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/529ab4a5a66947aebb3f09a9842e5c9f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_529ab4a5a66947aebb3f09a9842e5c9f"}]}] Oct 27 04:29:02.677054 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServerActionsTestJSON-403049074 Oct 27 04:29:02.677054 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 529ab4a5a66947aebb3f09a9842e5c9f Oct 27 04:29:02.677054 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServerActionsTestJSON-403049074 Oct 27 04:29:02.677054 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServerActionsTestJSON-403049074-project Oct 27 04:29:02.677054 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 04:29:02.677054 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 04:29:02.677054 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 197669776fde4a6480f6cab6e5c8552f Oct 27 04:29:02.677054 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServerActionsTestJSON-403049074-project Oct 27 04:29:02.677054 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 04:29:02.677054 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 87631277-ef7c-4f32-ad28-b4be5c3314f7 could not be found. Oct 27 04:29:02.677054 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '87631277-ef7c-4f32-ad28-b4be5c3314f7'} Oct 27 04:29:02.677054 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 04:29:02.677054 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:29:02.677054 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 04:29:02.677054 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 04:29:02.677054 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 04:29:02.677054 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 04:29:02.677054 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 04:29:02.677054 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 04:29:02.677054 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 04:29:02.677054 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 04:29:02.677054 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87631277-ef7c-4f32-ad28-b4be5c3314f7 could not be found. Oct 27 04:29:02.677054 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:29:02.677054 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:29:02.677054 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:29:02.677054 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:29:02.677054 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:29:02.677054 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:29:02.677054 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 04:29:02.677054 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 04:29:02.677054 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 04:29:02.677054 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 04:29:02.677054 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 04:29:02.677054 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 04:29:02.677054 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 04:29:02.677054 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 04:29:02.677054 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 04:29:02.677054 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 04:29:02.677054 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87631277-ef7c-4f32-ad28-b4be5c3314f7 could not be found. Oct 27 04:29:02.677054 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:29:02.677054 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:29:02.677054 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:29:02.681953 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:29:02.681953 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:29:02.681953 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:29:02.681953 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 04:29:02.681953 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 04:29:02.681953 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87631277-ef7c-4f32-ad28-b4be5c3314f7 could not be found. Oct 27 04:29:02.681953 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:29:02.681953 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1640ff63-5f76-4ab4-aef5-469fb763e99e tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Returning 404 to user: Instance 87631277-ef7c-4f32-ad28-b4be5c3314f7 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 04:29:02.681953 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1640ff63-5f76-4ab4-aef5-469fb763e99e tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7" status: 404 len: 111 microversion: 2.1 time: 0.033528 Oct 27 04:29:02.681953 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3932/7570] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:29:02 2022] GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 04:29:02.696079 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-34628958-204c-4256-a2a9-5f80440b64cf tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:29:02.696848 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-34628958-204c-4256-a2a9-5f80440b64cf tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 87631277-ef7c-4f32-ad28-b4be5c3314f7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:29:02.702945 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-34628958-204c-4256-a2a9-5f80440b64cf tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:29:02.703434 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-34628958-204c-4256-a2a9-5f80440b64cf tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:29:02.703879 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-34628958-204c-4256-a2a9-5f80440b64cf tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:29:02.704572 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-34628958-204c-4256-a2a9-5f80440b64cf tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:29:02.705029 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-34628958-204c-4256-a2a9-5f80440b64cf tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:29:02.705490 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-34628958-204c-4256-a2a9-5f80440b64cf tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:29:02.722010 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-34628958-204c-4256-a2a9-5f80440b64cf tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] HTTP exception thrown: Instance 87631277-ef7c-4f32-ad28-b4be5c3314f7 could not be found. Oct 27 04:29:02.724510 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-34628958-204c-4256-a2a9-5f80440b64cf tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Request method failure captured: Oct 27 04:29:02.724510 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7 HTTP/1.1 Oct 27 04:29:02.724510 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 04:29:02.724510 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 04:29:02.724510 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 04:29:02.724510 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 04:29:02.724510 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 04:29:02.724510 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 04:29:02.724510 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 04:29:02.724510 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 04:29:02.724510 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWggT1pShQ7YBK6vLEnUn4ThZkZHCmWwxudcjcX6Q_Qzyxxu4Tv9k9Mz8NdF1J-CqoCxrwqSYjXa2e5qz-_PVvAMi6WsvOj7WQPQINruTawh_9Huu8QwtjT2xusIZMY0glj9dlYg_3F0cuyrDKuyyLc3oA_TbX8qtqDNM9W1LEjJuGfY Oct 27 04:29:02.724510 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 04:29:02.724510 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 04:29:02.724510 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 04:29:02.724510 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 04:29:02.724510 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 04:29:02.724510 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 04:29:02.724510 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 529ab4a5a66947aebb3f09a9842e5c9f Oct 27 04:29:02.724510 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ServerActionsTestJSON-403049074 Oct 27 04:29:02.724510 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 04:29:02.724510 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 04:29:02.724510 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/529ab4a5a66947aebb3f09a9842e5c9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/529ab4a5a66947aebb3f09a9842e5c9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/529ab4a5a66947aebb3f09a9842e5c9f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_529ab4a5a66947aebb3f09a9842e5c9f"}]}] Oct 27 04:29:02.724510 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ServerActionsTestJSON-403049074 Oct 27 04:29:02.724510 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 529ab4a5a66947aebb3f09a9842e5c9f Oct 27 04:29:02.724510 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ServerActionsTestJSON-403049074 Oct 27 04:29:02.724510 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ServerActionsTestJSON-403049074-project Oct 27 04:29:02.724510 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 04:29:02.724510 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 04:29:02.724510 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 197669776fde4a6480f6cab6e5c8552f Oct 27 04:29:02.724510 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ServerActionsTestJSON-403049074-project Oct 27 04:29:02.724510 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 04:29:02.724510 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 87631277-ef7c-4f32-ad28-b4be5c3314f7 could not be found. Oct 27 04:29:02.724510 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '87631277-ef7c-4f32-ad28-b4be5c3314f7'} Oct 27 04:29:02.724510 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 04:29:02.724510 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:29:02.724510 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 04:29:02.724510 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 04:29:02.724510 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 04:29:02.724510 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 04:29:02.724510 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 04:29:02.724510 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 04:29:02.724510 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 04:29:02.724510 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 04:29:02.724510 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87631277-ef7c-4f32-ad28-b4be5c3314f7 could not be found. Oct 27 04:29:02.724510 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:29:02.724510 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:29:02.724510 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:29:02.724510 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:29:02.724510 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:29:02.724510 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:29:02.724510 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 04:29:02.724510 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 04:29:02.724510 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 04:29:02.724510 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 04:29:02.724510 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 04:29:02.724510 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 04:29:02.724510 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 04:29:02.724510 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 04:29:02.724510 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 04:29:02.724510 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 04:29:02.724510 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87631277-ef7c-4f32-ad28-b4be5c3314f7 could not be found. Oct 27 04:29:02.724510 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:29:02.724510 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:29:02.724510 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:29:02.735070 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:29:02.735070 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:29:02.735070 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:29:02.735070 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 04:29:02.735070 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 04:29:02.735070 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87631277-ef7c-4f32-ad28-b4be5c3314f7 could not be found. Oct 27 04:29:02.735070 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:29:02.735070 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-34628958-204c-4256-a2a9-5f80440b64cf tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Returning 404 to user: Instance 87631277-ef7c-4f32-ad28-b4be5c3314f7 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 04:29:02.735070 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-34628958-204c-4256-a2a9-5f80440b64cf tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7" status: 404 len: 111 microversion: 2.1 time: 0.034407 Oct 27 04:29:02.735070 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3639/7571] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:29:02 2022] GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 04:29:02.785884 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b5340fb2-7c02-48fc-a32e-f01654c4aa2a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-402711902", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": [{"uuid": "0b9e776d-e4d4-4487-af56-34380c1641ff"}], "security_groups": [{"name": "tempest-securitygroup--204964459"}], "key_name": "tempest-keypair-673070032", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:29:02.889703 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.network.neutron [None req-b5340fb2-7c02-48fc-a32e-f01654c4aa2a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] validate_networks() for [('0b9e776d-e4d4-4487-af56-34380c1641ff', None, None, None, None, None)] {{(pid=121001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 04:29:03.254681 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-b5340fb2-7c02-48fc-a32e-f01654c4aa2a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Flavor limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 04:29:03.255131 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-b5340fb2-7c02-48fc-a32e-f01654c4aa2a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Image limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 04:29:03.255632 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-b5340fb2-7c02-48fc-a32e-f01654c4aa2a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Flavor pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 04:29:03.256061 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-b5340fb2-7c02-48fc-a32e-f01654c4aa2a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Image pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 04:29:03.256494 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-b5340fb2-7c02-48fc-a32e-f01654c4aa2a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 04:29:03.265325 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b5340fb2-7c02-48fc-a32e-f01654c4aa2a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:29:03.265830 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b5340fb2-7c02-48fc-a32e-f01654c4aa2a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:29:03.266381 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b5340fb2-7c02-48fc-a32e-f01654c4aa2a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:29:03.267137 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b5340fb2-7c02-48fc-a32e-f01654c4aa2a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:29:03.267616 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b5340fb2-7c02-48fc-a32e-f01654c4aa2a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:29:03.268671 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b5340fb2-7c02-48fc-a32e-f01654c4aa2a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:29:03.285032 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-b5340fb2-7c02-48fc-a32e-f01654c4aa2a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Getting quotas for project 529ab4a5a66947aebb3f09a9842e5c9f. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 04:29:03.290666 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-b5340fb2-7c02-48fc-a32e-f01654c4aa2a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Getting quotas for user 197669776fde4a6480f6cab6e5c8552f and project 529ab4a5a66947aebb3f09a9842e5c9f. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 04:29:03.303149 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b5340fb2-7c02-48fc-a32e-f01654c4aa2a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Going to run 1 instances... {{(pid=121001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 04:29:03.305525 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b5340fb2-7c02-48fc-a32e-f01654c4aa2a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: a2295c49-094c-4d51-88a5-9ae18aa17b04] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 04:29:03.417559 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b5340fb2-7c02-48fc-a32e-f01654c4aa2a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.636341 Oct 27 04:29:03.418249 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3933/7572] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 04:29:02 2022] POST /compute/v2.1/servers => generated 405 bytes in 638 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 04:29:03.429622 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c2f9986d-44cf-48ed-a75c-ac3be9e6cce4 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:29:03.430273 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c2f9986d-44cf-48ed-a75c-ac3be9e6cce4 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: a2295c49-094c-4d51-88a5-9ae18aa17b04] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:29:03.488169 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c2f9986d-44cf-48ed-a75c-ac3be9e6cce4 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:29:03.495199 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c2f9986d-44cf-48ed-a75c-ac3be9e6cce4 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04" status: 200 len: 1237 microversion: 2.1 time: 0.069457 Oct 27 04:29:03.495875 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3640/7573] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:29:03 2022] GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04 => generated 1237 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:29:04.520100 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f8dead8d-8442-49dc-a777-00a74d5b31eb tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:29:04.524132 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f8dead8d-8442-49dc-a777-00a74d5b31eb tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: a2295c49-094c-4d51-88a5-9ae18aa17b04] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:29:04.526925 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f8dead8d-8442-49dc-a777-00a74d5b31eb tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:29:04.527436 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f8dead8d-8442-49dc-a777-00a74d5b31eb tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:29:04.527905 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f8dead8d-8442-49dc-a777-00a74d5b31eb tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:29:04.528629 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f8dead8d-8442-49dc-a777-00a74d5b31eb tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:29:04.529110 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f8dead8d-8442-49dc-a777-00a74d5b31eb tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:29:04.529564 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f8dead8d-8442-49dc-a777-00a74d5b31eb tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:29:04.600289 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f8dead8d-8442-49dc-a777-00a74d5b31eb tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:29:04.608152 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f8dead8d-8442-49dc-a777-00a74d5b31eb tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04" status: 200 len: 1233 microversion: 2.1 time: 0.093359 Oct 27 04:29:04.608718 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3934/7574] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:29:04 2022] GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04 => generated 1233 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:29:05.631998 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-68ba32d9-b40f-4b72-b100-0b2cd2a95295 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:29:05.632617 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-68ba32d9-b40f-4b72-b100-0b2cd2a95295 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: a2295c49-094c-4d51-88a5-9ae18aa17b04] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:29:05.640302 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-68ba32d9-b40f-4b72-b100-0b2cd2a95295 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:29:05.640830 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-68ba32d9-b40f-4b72-b100-0b2cd2a95295 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:29:05.641288 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-68ba32d9-b40f-4b72-b100-0b2cd2a95295 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:29:05.641989 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-68ba32d9-b40f-4b72-b100-0b2cd2a95295 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:29:05.642476 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-68ba32d9-b40f-4b72-b100-0b2cd2a95295 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:29:05.642910 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-68ba32d9-b40f-4b72-b100-0b2cd2a95295 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:29:05.704463 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-68ba32d9-b40f-4b72-b100-0b2cd2a95295 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:29:05.712232 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-68ba32d9-b40f-4b72-b100-0b2cd2a95295 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04" status: 200 len: 1307 microversion: 2.1 time: 0.084201 Oct 27 04:29:05.712810 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3641/7575] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:29:05 2022] GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04 => generated 1307 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 04:29:06.736071 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8713729f-159f-4e11-9d1f-9c9cd730801a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:29:06.736753 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8713729f-159f-4e11-9d1f-9c9cd730801a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: a2295c49-094c-4d51-88a5-9ae18aa17b04] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:29:06.745596 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8713729f-159f-4e11-9d1f-9c9cd730801a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:29:06.746155 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8713729f-159f-4e11-9d1f-9c9cd730801a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:29:06.746621 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8713729f-159f-4e11-9d1f-9c9cd730801a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:29:06.747356 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8713729f-159f-4e11-9d1f-9c9cd730801a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:29:06.747838 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8713729f-159f-4e11-9d1f-9c9cd730801a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:29:06.748290 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8713729f-159f-4e11-9d1f-9c9cd730801a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:29:06.941721 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8713729f-159f-4e11-9d1f-9c9cd730801a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:29:06.949494 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8713729f-159f-4e11-9d1f-9c9cd730801a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04" status: 200 len: 1362 microversion: 2.1 time: 0.217418 Oct 27 04:29:06.950090 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3935/7576] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:29:06 2022] GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04 => generated 1362 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:29:07.021323 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-5487a305-a950-4efb-aeb3-08c54dfb130d req-b708ef32-df2e-42b0-b91b-5a8fe51cbc69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2295c49-094c-4d51-88a5-9ae18aa17b04", "tag": "975121d1-b03a-45d5-8a8b-3e8ad3eba408"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:29:07.029870 n-d-862769-1 devstack@n-api.service[121000]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 04:29:07.037269 n-d-862769-1 devstack@n-api.service[121000]: Thu Oct 27 04:29:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.20) !!! Oct 27 04:29:07.039066 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-5487a305-a950-4efb-aeb3-08c54dfb130d req-b708ef32-df2e-42b0-b91b-5a8fe51cbc69 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:29:07.039551 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-5487a305-a950-4efb-aeb3-08c54dfb130d req-b708ef32-df2e-42b0-b91b-5a8fe51cbc69 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:29:07.039987 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-5487a305-a950-4efb-aeb3-08c54dfb130d req-b708ef32-df2e-42b0-b91b-5a8fe51cbc69 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:29:07.051730 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-5487a305-a950-4efb-aeb3-08c54dfb130d req-b708ef32-df2e-42b0-b91b-5a8fe51cbc69 service nova] Creating event network-changed:975121d1-b03a-45d5-8a8b-3e8ad3eba408 for instance a2295c49-094c-4d51-88a5-9ae18aa17b04 on n-h1-862769-1 Oct 27 04:29:07.057690 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-5487a305-a950-4efb-aeb3-08c54dfb130d req-b708ef32-df2e-42b0-b91b-5a8fe51cbc69 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041825 Oct 27 04:29:07.058440 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3642/7577] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:29:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:29:07.975114 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b3425f87-a0c2-483d-ac12-f7718ba906f4 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:29:07.975764 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b3425f87-a0c2-483d-ac12-f7718ba906f4 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: a2295c49-094c-4d51-88a5-9ae18aa17b04] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:29:07.982847 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b3425f87-a0c2-483d-ac12-f7718ba906f4 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:29:07.983357 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b3425f87-a0c2-483d-ac12-f7718ba906f4 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:29:07.983824 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b3425f87-a0c2-483d-ac12-f7718ba906f4 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:29:07.984589 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b3425f87-a0c2-483d-ac12-f7718ba906f4 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:29:07.985064 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b3425f87-a0c2-483d-ac12-f7718ba906f4 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:29:07.985524 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b3425f87-a0c2-483d-ac12-f7718ba906f4 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:29:08.121905 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b3425f87-a0c2-483d-ac12-f7718ba906f4 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:29:08.130876 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b3425f87-a0c2-483d-ac12-f7718ba906f4 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04" status: 200 len: 1362 microversion: 2.1 time: 0.159897 Oct 27 04:29:08.131519 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3936/7578] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:29:07 2022] GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:29:09.155981 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-203df239-2585-4346-b84b-dc67c021417c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:29:09.156596 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-203df239-2585-4346-b84b-dc67c021417c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: a2295c49-094c-4d51-88a5-9ae18aa17b04] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:29:09.162798 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-203df239-2585-4346-b84b-dc67c021417c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:29:09.163286 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-203df239-2585-4346-b84b-dc67c021417c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:29:09.163726 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-203df239-2585-4346-b84b-dc67c021417c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:29:09.164422 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-203df239-2585-4346-b84b-dc67c021417c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:29:09.164883 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-203df239-2585-4346-b84b-dc67c021417c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:29:09.165312 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-203df239-2585-4346-b84b-dc67c021417c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:29:09.297150 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-203df239-2585-4346-b84b-dc67c021417c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:29:09.305349 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-203df239-2585-4346-b84b-dc67c021417c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04" status: 200 len: 1362 microversion: 2.1 time: 0.154614 Oct 27 04:29:09.305929 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3643/7579] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:29:09 2022] GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:29:10.328183 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0bca8778-0f88-48a6-82a6-8e2e708dd0f9 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:29:10.328839 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0bca8778-0f88-48a6-82a6-8e2e708dd0f9 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: a2295c49-094c-4d51-88a5-9ae18aa17b04] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:29:10.336303 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0bca8778-0f88-48a6-82a6-8e2e708dd0f9 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:29:10.336811 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0bca8778-0f88-48a6-82a6-8e2e708dd0f9 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:29:10.337277 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0bca8778-0f88-48a6-82a6-8e2e708dd0f9 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:29:10.337997 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0bca8778-0f88-48a6-82a6-8e2e708dd0f9 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:29:10.338506 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0bca8778-0f88-48a6-82a6-8e2e708dd0f9 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:29:10.338964 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0bca8778-0f88-48a6-82a6-8e2e708dd0f9 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:29:10.465410 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0bca8778-0f88-48a6-82a6-8e2e708dd0f9 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:29:10.474081 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0bca8778-0f88-48a6-82a6-8e2e708dd0f9 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04" status: 200 len: 1362 microversion: 2.1 time: 0.149867 Oct 27 04:29:10.474656 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3937/7580] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:29:10 2022] GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:29:11.496862 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8490a2e8-06fd-4aca-99dd-9901ad0bc0b0 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:29:11.497490 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8490a2e8-06fd-4aca-99dd-9901ad0bc0b0 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: a2295c49-094c-4d51-88a5-9ae18aa17b04] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:29:11.504843 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8490a2e8-06fd-4aca-99dd-9901ad0bc0b0 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:29:11.505327 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8490a2e8-06fd-4aca-99dd-9901ad0bc0b0 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:29:11.505775 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8490a2e8-06fd-4aca-99dd-9901ad0bc0b0 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:29:11.506506 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8490a2e8-06fd-4aca-99dd-9901ad0bc0b0 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:29:11.506976 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8490a2e8-06fd-4aca-99dd-9901ad0bc0b0 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:29:11.507408 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8490a2e8-06fd-4aca-99dd-9901ad0bc0b0 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:29:11.635766 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8490a2e8-06fd-4aca-99dd-9901ad0bc0b0 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:29:11.644016 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8490a2e8-06fd-4aca-99dd-9901ad0bc0b0 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04" status: 200 len: 1362 microversion: 2.1 time: 0.151197 Oct 27 04:29:11.644616 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3644/7581] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:29:11 2022] GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:29:12.667471 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1468a18c-0288-4006-9c19-53e5c40faee1 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:29:12.668119 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1468a18c-0288-4006-9c19-53e5c40faee1 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: a2295c49-094c-4d51-88a5-9ae18aa17b04] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:29:12.674990 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1468a18c-0288-4006-9c19-53e5c40faee1 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:29:12.675530 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1468a18c-0288-4006-9c19-53e5c40faee1 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:29:12.675968 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1468a18c-0288-4006-9c19-53e5c40faee1 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:29:12.676695 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1468a18c-0288-4006-9c19-53e5c40faee1 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:29:12.677179 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1468a18c-0288-4006-9c19-53e5c40faee1 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:29:12.677632 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1468a18c-0288-4006-9c19-53e5c40faee1 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:29:12.810071 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1468a18c-0288-4006-9c19-53e5c40faee1 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:29:12.818156 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1468a18c-0288-4006-9c19-53e5c40faee1 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04" status: 200 len: 1362 microversion: 2.1 time: 0.154506 Oct 27 04:29:12.818742 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3938/7582] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:29:12 2022] GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:29:12.847650 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-09399a7d-3215-4d77-bf2a-bef82a7b4ff0 req-9fe14d6c-f5ce-464d-bbc1-663574c8621f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2295c49-094c-4d51-88a5-9ae18aa17b04", "name": "network-vif-plugged", "status": "completed", "tag": "975121d1-b03a-45d5-8a8b-3e8ad3eba408"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:29:12.857702 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-09399a7d-3215-4d77-bf2a-bef82a7b4ff0 req-9fe14d6c-f5ce-464d-bbc1-663574c8621f service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:29:12.858235 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-09399a7d-3215-4d77-bf2a-bef82a7b4ff0 req-9fe14d6c-f5ce-464d-bbc1-663574c8621f service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:29:12.858713 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-09399a7d-3215-4d77-bf2a-bef82a7b4ff0 req-9fe14d6c-f5ce-464d-bbc1-663574c8621f service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:29:12.869493 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-09399a7d-3215-4d77-bf2a-bef82a7b4ff0 req-9fe14d6c-f5ce-464d-bbc1-663574c8621f service nova] Creating event network-vif-plugged:975121d1-b03a-45d5-8a8b-3e8ad3eba408 for instance a2295c49-094c-4d51-88a5-9ae18aa17b04 on n-h1-862769-1 Oct 27 04:29:12.874414 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-09399a7d-3215-4d77-bf2a-bef82a7b4ff0 req-9fe14d6c-f5ce-464d-bbc1-663574c8621f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031614 Oct 27 04:29:12.875002 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3645/7583] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:29:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:29:13.842903 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4da34f16-bac1-4182-b453-23d51d536a33 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:29:13.843469 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4da34f16-bac1-4182-b453-23d51d536a33 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: a2295c49-094c-4d51-88a5-9ae18aa17b04] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:29:13.845442 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:29:13.846644 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=6 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:29:13.852283 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4da34f16-bac1-4182-b453-23d51d536a33 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:29:13.852824 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4da34f16-bac1-4182-b453-23d51d536a33 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:29:13.853284 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4da34f16-bac1-4182-b453-23d51d536a33 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:29:13.854004 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4da34f16-bac1-4182-b453-23d51d536a33 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:29:13.854502 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4da34f16-bac1-4182-b453-23d51d536a33 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:29:13.854953 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4da34f16-bac1-4182-b453-23d51d536a33 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:29:13.982894 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4da34f16-bac1-4182-b453-23d51d536a33 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:29:13.994905 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4da34f16-bac1-4182-b453-23d51d536a33 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04" status: 200 len: 1362 microversion: 2.1 time: 0.156175 Oct 27 04:29:13.995497 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3939/7584] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:29:13 2022] GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:29:15.021407 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:29:15.026515 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5c760982-2512-4d53-912e-9f062ba39f68 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:29:15.027226 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5c760982-2512-4d53-912e-9f062ba39f68 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: a2295c49-094c-4d51-88a5-9ae18aa17b04] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:29:15.033295 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5c760982-2512-4d53-912e-9f062ba39f68 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:29:15.033790 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5c760982-2512-4d53-912e-9f062ba39f68 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:29:15.034269 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5c760982-2512-4d53-912e-9f062ba39f68 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:29:15.034972 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5c760982-2512-4d53-912e-9f062ba39f68 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:29:15.035436 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5c760982-2512-4d53-912e-9f062ba39f68 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:29:15.035900 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5c760982-2512-4d53-912e-9f062ba39f68 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:29:15.166954 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5c760982-2512-4d53-912e-9f062ba39f68 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:29:15.175439 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5c760982-2512-4d53-912e-9f062ba39f68 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04" status: 200 len: 1549 microversion: 2.1 time: 0.154963 Oct 27 04:29:15.176032 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3646/7585] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:29:15 2022] GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04 => generated 1549 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:29:15.199323 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e00390f0-1276-4c03-9a24-4710d610a5e4 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:29:15.199846 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e00390f0-1276-4c03-9a24-4710d610a5e4 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: a2295c49-094c-4d51-88a5-9ae18aa17b04] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:29:15.206700 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e00390f0-1276-4c03-9a24-4710d610a5e4 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:29:15.207209 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e00390f0-1276-4c03-9a24-4710d610a5e4 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:29:15.207678 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e00390f0-1276-4c03-9a24-4710d610a5e4 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:29:15.208400 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e00390f0-1276-4c03-9a24-4710d610a5e4 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:29:15.208883 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e00390f0-1276-4c03-9a24-4710d610a5e4 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:29:15.209335 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e00390f0-1276-4c03-9a24-4710d610a5e4 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:29:15.292013 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e00390f0-1276-4c03-9a24-4710d610a5e4 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096665 Oct 27 04:29:15.292667 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3940/7586] 10.222.0.20 () {58 vars in 1275 bytes} [Thu Oct 27 04:29:15 2022] GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:29:16.279010 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-eaec895c-0f47-4527-87b9-d8bcf9f1ec75 req-623d6fa8-7abc-4852-a098-e0c361c0be86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2295c49-094c-4d51-88a5-9ae18aa17b04", "tag": "975121d1-b03a-45d5-8a8b-3e8ad3eba408"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:29:16.289186 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-eaec895c-0f47-4527-87b9-d8bcf9f1ec75 req-623d6fa8-7abc-4852-a098-e0c361c0be86 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:29:16.289669 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-eaec895c-0f47-4527-87b9-d8bcf9f1ec75 req-623d6fa8-7abc-4852-a098-e0c361c0be86 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:29:16.290139 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-eaec895c-0f47-4527-87b9-d8bcf9f1ec75 req-623d6fa8-7abc-4852-a098-e0c361c0be86 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:29:16.301026 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-eaec895c-0f47-4527-87b9-d8bcf9f1ec75 req-623d6fa8-7abc-4852-a098-e0c361c0be86 service nova] Creating event network-changed:975121d1-b03a-45d5-8a8b-3e8ad3eba408 for instance a2295c49-094c-4d51-88a5-9ae18aa17b04 on n-h1-862769-1 Oct 27 04:29:16.305917 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-eaec895c-0f47-4527-87b9-d8bcf9f1ec75 req-623d6fa8-7abc-4852-a098-e0c361c0be86 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030762 Oct 27 04:29:16.306629 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3647/7587] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:29:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:29:54.318820 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:29:54.319606 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:29:54.323509 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-992eb1a5-448b-4179-b1ce-237090f9666a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:29:54.324152 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-992eb1a5-448b-4179-b1ce-237090f9666a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: a2295c49-094c-4d51-88a5-9ae18aa17b04] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:29:54.330101 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-992eb1a5-448b-4179-b1ce-237090f9666a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:29:54.330616 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-992eb1a5-448b-4179-b1ce-237090f9666a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:29:54.341623 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-992eb1a5-448b-4179-b1ce-237090f9666a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:29:54.341623 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-992eb1a5-448b-4179-b1ce-237090f9666a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:29:54.341623 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-992eb1a5-448b-4179-b1ce-237090f9666a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:29:54.341623 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-992eb1a5-448b-4179-b1ce-237090f9666a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:29:54.492190 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-992eb1a5-448b-4179-b1ce-237090f9666a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:29:54.499936 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-992eb1a5-448b-4179-b1ce-237090f9666a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04" status: 200 len: 1668 microversion: 2.1 time: 0.183684 Oct 27 04:29:54.500527 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3941/7588] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:29:54 2022] GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04 => generated 1668 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:29:54.522904 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=31 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:29:54.523742 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=68 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:29:54.528488 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-81c11876-ac82-4bcc-b424-be8012399f9a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1b9096d9-1112-4e7e-8587-f5ee3e4c4e7b"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:29:54.530985 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-81c11876-ac82-4bcc-b424-be8012399f9a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: a2295c49-094c-4d51-88a5-9ae18aa17b04] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:29:54.537405 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-81c11876-ac82-4bcc-b424-be8012399f9a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:29:54.537972 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-81c11876-ac82-4bcc-b424-be8012399f9a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:29:54.538424 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-81c11876-ac82-4bcc-b424-be8012399f9a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:29:54.539130 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-81c11876-ac82-4bcc-b424-be8012399f9a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:29:54.539591 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-81c11876-ac82-4bcc-b424-be8012399f9a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:29:54.540033 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-81c11876-ac82-4bcc-b424-be8012399f9a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:29:55.318486 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-81c11876-ac82-4bcc-b424-be8012399f9a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "POST /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.798768 Oct 27 04:29:55.319316 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3648/7589] 10.222.0.20 () {60 vars in 1323 bytes} [Thu Oct 27 04:29:54 2022] POST /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04/os-volume_attachments => generated 194 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:30:07.120012 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-cef47ef1-0259-4f55-b17c-ef9a7911e4e0 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:30:07.122551 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-cef47ef1-0259-4f55-b17c-ef9a7911e4e0 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: a2295c49-094c-4d51-88a5-9ae18aa17b04] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:30:07.124582 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:30:07.129650 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cef47ef1-0259-4f55-b17c-ef9a7911e4e0 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:07.130193 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cef47ef1-0259-4f55-b17c-ef9a7911e4e0 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:07.131192 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cef47ef1-0259-4f55-b17c-ef9a7911e4e0 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:07.131948 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cef47ef1-0259-4f55-b17c-ef9a7911e4e0 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:07.132427 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cef47ef1-0259-4f55-b17c-ef9a7911e4e0 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:07.132878 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cef47ef1-0259-4f55-b17c-ef9a7911e4e0 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:07.162681 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-cef47ef1-0259-4f55-b17c-ef9a7911e4e0 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:30:07.168373 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-cef47ef1-0259-4f55-b17c-ef9a7911e4e0 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: a2295c49-094c-4d51-88a5-9ae18aa17b04] Old instance type m1.heat2, new instance type m1.heat {{(pid=121001) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 27 04:30:07.175641 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-cef47ef1-0259-4f55-b17c-ef9a7911e4e0 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Flavor limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 04:30:07.176086 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-cef47ef1-0259-4f55-b17c-ef9a7911e4e0 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Image limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 04:30:07.176579 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-cef47ef1-0259-4f55-b17c-ef9a7911e4e0 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Flavor pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 04:30:07.177006 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-cef47ef1-0259-4f55-b17c-ef9a7911e4e0 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Image pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 04:30:07.177457 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-cef47ef1-0259-4f55-b17c-ef9a7911e4e0 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 04:30:07.378552 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-cef47ef1-0259-4f55-b17c-ef9a7911e4e0 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "POST /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04/action" status: 202 len: 0 microversion: 2.1 time: 0.263450 Oct 27 04:30:07.379073 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3942/7590] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 04:30:07 2022] POST /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 04:30:07.388556 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-03fed82c-11af-43ec-a9b9-b37c0c811a30 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:30:07.389268 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-03fed82c-11af-43ec-a9b9-b37c0c811a30 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: a2295c49-094c-4d51-88a5-9ae18aa17b04] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:30:07.391852 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:30:07.392432 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:30:07.397352 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-03fed82c-11af-43ec-a9b9-b37c0c811a30 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:07.397847 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-03fed82c-11af-43ec-a9b9-b37c0c811a30 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:07.398346 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-03fed82c-11af-43ec-a9b9-b37c0c811a30 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:07.399056 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-03fed82c-11af-43ec-a9b9-b37c0c811a30 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:07.399516 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-03fed82c-11af-43ec-a9b9-b37c0c811a30 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:07.399948 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-03fed82c-11af-43ec-a9b9-b37c0c811a30 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:07.530413 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-03fed82c-11af-43ec-a9b9-b37c0c811a30 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:30:07.538770 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-03fed82c-11af-43ec-a9b9-b37c0c811a30 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04" status: 200 len: 1723 microversion: 2.1 time: 0.154675 Oct 27 04:30:07.539365 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3649/7591] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:30:07 2022] GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:30:08.563125 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-80c3ca99-be7d-4f48-807a-210d9d08166c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:30:08.563889 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-80c3ca99-be7d-4f48-807a-210d9d08166c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: a2295c49-094c-4d51-88a5-9ae18aa17b04] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:30:08.571065 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-80c3ca99-be7d-4f48-807a-210d9d08166c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:08.571569 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-80c3ca99-be7d-4f48-807a-210d9d08166c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:08.572036 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-80c3ca99-be7d-4f48-807a-210d9d08166c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:08.572769 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-80c3ca99-be7d-4f48-807a-210d9d08166c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:08.573262 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-80c3ca99-be7d-4f48-807a-210d9d08166c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:08.573697 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-80c3ca99-be7d-4f48-807a-210d9d08166c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:08.709040 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-80c3ca99-be7d-4f48-807a-210d9d08166c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:30:08.718907 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-80c3ca99-be7d-4f48-807a-210d9d08166c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04" status: 200 len: 1723 microversion: 2.1 time: 0.160686 Oct 27 04:30:08.719490 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3943/7592] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:30:08 2022] GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:30:09.743773 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-27c6e7cf-e3f6-46d6-8636-43a40bca5e32 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:30:09.744433 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-27c6e7cf-e3f6-46d6-8636-43a40bca5e32 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: a2295c49-094c-4d51-88a5-9ae18aa17b04] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:30:09.751804 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-27c6e7cf-e3f6-46d6-8636-43a40bca5e32 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:09.752244 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-27c6e7cf-e3f6-46d6-8636-43a40bca5e32 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:09.752688 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-27c6e7cf-e3f6-46d6-8636-43a40bca5e32 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:09.753403 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-27c6e7cf-e3f6-46d6-8636-43a40bca5e32 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:09.753873 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-27c6e7cf-e3f6-46d6-8636-43a40bca5e32 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:09.754333 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-27c6e7cf-e3f6-46d6-8636-43a40bca5e32 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:09.888022 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-27c6e7cf-e3f6-46d6-8636-43a40bca5e32 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:30:09.896895 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-27c6e7cf-e3f6-46d6-8636-43a40bca5e32 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04" status: 200 len: 1723 microversion: 2.1 time: 0.156856 Oct 27 04:30:09.897477 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3650/7593] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:30:09 2022] GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:30:10.920398 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-01e826c7-5ba8-4461-8901-b1f488f83105 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:30:10.921036 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-01e826c7-5ba8-4461-8901-b1f488f83105 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: a2295c49-094c-4d51-88a5-9ae18aa17b04] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:30:10.928514 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-01e826c7-5ba8-4461-8901-b1f488f83105 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:10.929012 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-01e826c7-5ba8-4461-8901-b1f488f83105 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:10.929472 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-01e826c7-5ba8-4461-8901-b1f488f83105 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:10.930283 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-01e826c7-5ba8-4461-8901-b1f488f83105 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:10.930760 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-01e826c7-5ba8-4461-8901-b1f488f83105 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:10.931203 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-01e826c7-5ba8-4461-8901-b1f488f83105 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:11.058746 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-01e826c7-5ba8-4461-8901-b1f488f83105 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:30:11.067107 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-01e826c7-5ba8-4461-8901-b1f488f83105 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04" status: 200 len: 1728 microversion: 2.1 time: 0.150693 Oct 27 04:30:11.067682 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3944/7594] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:30:10 2022] GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04 => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:30:12.090873 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3997b8a1-0f08-4c4b-ac24-686f117c9e8b tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:30:12.091496 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-3997b8a1-0f08-4c4b-ac24-686f117c9e8b tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: a2295c49-094c-4d51-88a5-9ae18aa17b04] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:30:12.098789 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3997b8a1-0f08-4c4b-ac24-686f117c9e8b tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:12.099951 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3997b8a1-0f08-4c4b-ac24-686f117c9e8b tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:12.100432 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3997b8a1-0f08-4c4b-ac24-686f117c9e8b tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:12.101150 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3997b8a1-0f08-4c4b-ac24-686f117c9e8b tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:12.101607 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3997b8a1-0f08-4c4b-ac24-686f117c9e8b tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:12.102095 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3997b8a1-0f08-4c4b-ac24-686f117c9e8b tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:12.239850 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-3997b8a1-0f08-4c4b-ac24-686f117c9e8b tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:30:12.248785 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3997b8a1-0f08-4c4b-ac24-686f117c9e8b tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04" status: 200 len: 1728 microversion: 2.1 time: 0.161821 Oct 27 04:30:12.249374 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3651/7595] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:30:12 2022] GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04 => generated 1728 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:30:13.273039 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-219b88d9-030c-423a-8774-49671c256645 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:30:13.273686 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-219b88d9-030c-423a-8774-49671c256645 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: a2295c49-094c-4d51-88a5-9ae18aa17b04] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:30:13.280546 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-219b88d9-030c-423a-8774-49671c256645 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:13.281058 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-219b88d9-030c-423a-8774-49671c256645 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:13.281523 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-219b88d9-030c-423a-8774-49671c256645 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:13.282282 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-219b88d9-030c-423a-8774-49671c256645 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:13.282761 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-219b88d9-030c-423a-8774-49671c256645 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:13.283219 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-219b88d9-030c-423a-8774-49671c256645 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:13.408310 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-219b88d9-030c-423a-8774-49671c256645 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:30:13.416606 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-219b88d9-030c-423a-8774-49671c256645 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04" status: 200 len: 1728 microversion: 2.1 time: 0.147593 Oct 27 04:30:13.417185 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3945/7596] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:30:13 2022] GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04 => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:30:14.440344 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ec38e27d-f9c3-4da2-a8fe-e78bef2815fe tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:30:14.440925 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ec38e27d-f9c3-4da2-a8fe-e78bef2815fe tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: a2295c49-094c-4d51-88a5-9ae18aa17b04] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:30:14.448087 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ec38e27d-f9c3-4da2-a8fe-e78bef2815fe tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:14.448575 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ec38e27d-f9c3-4da2-a8fe-e78bef2815fe tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:14.449015 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ec38e27d-f9c3-4da2-a8fe-e78bef2815fe tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:14.449713 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ec38e27d-f9c3-4da2-a8fe-e78bef2815fe tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:14.450195 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ec38e27d-f9c3-4da2-a8fe-e78bef2815fe tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:14.450634 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ec38e27d-f9c3-4da2-a8fe-e78bef2815fe tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:14.586236 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ec38e27d-f9c3-4da2-a8fe-e78bef2815fe tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:30:14.594878 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ec38e27d-f9c3-4da2-a8fe-e78bef2815fe tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04" status: 200 len: 1728 microversion: 2.1 time: 0.158599 Oct 27 04:30:14.595681 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3652/7597] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:30:14 2022] GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04 => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:30:15.619360 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b7a49ca1-9b78-4692-bdd4-12e36357c01a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:30:15.619945 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b7a49ca1-9b78-4692-bdd4-12e36357c01a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: a2295c49-094c-4d51-88a5-9ae18aa17b04] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:30:15.626792 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b7a49ca1-9b78-4692-bdd4-12e36357c01a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:15.627296 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b7a49ca1-9b78-4692-bdd4-12e36357c01a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:15.627762 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b7a49ca1-9b78-4692-bdd4-12e36357c01a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:15.628475 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b7a49ca1-9b78-4692-bdd4-12e36357c01a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:15.628949 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b7a49ca1-9b78-4692-bdd4-12e36357c01a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:15.629393 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b7a49ca1-9b78-4692-bdd4-12e36357c01a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:15.765348 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b7a49ca1-9b78-4692-bdd4-12e36357c01a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:30:15.773622 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b7a49ca1-9b78-4692-bdd4-12e36357c01a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04" status: 200 len: 1728 microversion: 2.1 time: 0.158843 Oct 27 04:30:15.774217 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3946/7598] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:30:15 2022] GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04 => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:30:16.796915 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3e5823a5-dd91-4ae4-99c1-6256d6ba62ac tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:30:16.799800 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-3e5823a5-dd91-4ae4-99c1-6256d6ba62ac tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: a2295c49-094c-4d51-88a5-9ae18aa17b04] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:30:16.804462 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3e5823a5-dd91-4ae4-99c1-6256d6ba62ac tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:16.804948 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3e5823a5-dd91-4ae4-99c1-6256d6ba62ac tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:16.805393 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3e5823a5-dd91-4ae4-99c1-6256d6ba62ac tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:16.806148 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3e5823a5-dd91-4ae4-99c1-6256d6ba62ac tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:16.806612 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3e5823a5-dd91-4ae4-99c1-6256d6ba62ac tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:16.807044 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3e5823a5-dd91-4ae4-99c1-6256d6ba62ac tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:16.939323 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-3e5823a5-dd91-4ae4-99c1-6256d6ba62ac tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:30:16.948182 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3e5823a5-dd91-4ae4-99c1-6256d6ba62ac tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04" status: 200 len: 1728 microversion: 2.1 time: 0.155266 Oct 27 04:30:16.948762 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3653/7599] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:30:16 2022] GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04 => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 04:30:17.971642 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f549430e-a572-4a07-b345-ae5ae402a325 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:30:17.972290 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f549430e-a572-4a07-b345-ae5ae402a325 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: a2295c49-094c-4d51-88a5-9ae18aa17b04] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:30:17.979433 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f549430e-a572-4a07-b345-ae5ae402a325 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:17.979944 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f549430e-a572-4a07-b345-ae5ae402a325 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:17.980416 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f549430e-a572-4a07-b345-ae5ae402a325 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:17.981146 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f549430e-a572-4a07-b345-ae5ae402a325 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:17.981629 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f549430e-a572-4a07-b345-ae5ae402a325 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:17.982107 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f549430e-a572-4a07-b345-ae5ae402a325 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:18.113554 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f549430e-a572-4a07-b345-ae5ae402a325 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:30:18.122866 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f549430e-a572-4a07-b345-ae5ae402a325 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04" status: 200 len: 1728 microversion: 2.1 time: 0.155472 Oct 27 04:30:18.123446 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3947/7600] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:30:17 2022] GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04 => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:30:19.147232 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-313615d6-ff9a-4561-b4a2-b9424162e67b tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:30:19.147850 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-313615d6-ff9a-4561-b4a2-b9424162e67b tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: a2295c49-094c-4d51-88a5-9ae18aa17b04] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:30:19.154830 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-313615d6-ff9a-4561-b4a2-b9424162e67b tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:19.162414 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-313615d6-ff9a-4561-b4a2-b9424162e67b tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:19.162414 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-313615d6-ff9a-4561-b4a2-b9424162e67b tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:19.162414 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-313615d6-ff9a-4561-b4a2-b9424162e67b tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:19.162414 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-313615d6-ff9a-4561-b4a2-b9424162e67b tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:19.162414 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-313615d6-ff9a-4561-b4a2-b9424162e67b tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:19.287158 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-313615d6-ff9a-4561-b4a2-b9424162e67b tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:30:19.295342 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-313615d6-ff9a-4561-b4a2-b9424162e67b tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04" status: 200 len: 1728 microversion: 2.1 time: 0.152670 Oct 27 04:30:19.295921 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3654/7601] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:30:19 2022] GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04 => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:30:20.318413 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7af68947-dd70-4ea6-b6b2-e0baec32be65 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:30:20.319057 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7af68947-dd70-4ea6-b6b2-e0baec32be65 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: a2295c49-094c-4d51-88a5-9ae18aa17b04] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:30:20.325926 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7af68947-dd70-4ea6-b6b2-e0baec32be65 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:20.326462 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7af68947-dd70-4ea6-b6b2-e0baec32be65 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:20.326928 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7af68947-dd70-4ea6-b6b2-e0baec32be65 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:20.327649 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7af68947-dd70-4ea6-b6b2-e0baec32be65 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:20.328126 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7af68947-dd70-4ea6-b6b2-e0baec32be65 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:20.328577 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7af68947-dd70-4ea6-b6b2-e0baec32be65 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:20.461184 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7af68947-dd70-4ea6-b6b2-e0baec32be65 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:30:20.469687 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7af68947-dd70-4ea6-b6b2-e0baec32be65 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04" status: 200 len: 1728 microversion: 2.1 time: 0.155282 Oct 27 04:30:20.470294 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3948/7602] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:30:20 2022] GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04 => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 04:30:21.493790 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ae5247bd-be74-40f0-b556-bbad52575d4b tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:30:21.494456 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ae5247bd-be74-40f0-b556-bbad52575d4b tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: a2295c49-094c-4d51-88a5-9ae18aa17b04] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:30:21.501327 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ae5247bd-be74-40f0-b556-bbad52575d4b tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:21.501819 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ae5247bd-be74-40f0-b556-bbad52575d4b tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:21.502301 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ae5247bd-be74-40f0-b556-bbad52575d4b tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:21.503014 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ae5247bd-be74-40f0-b556-bbad52575d4b tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:21.503482 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ae5247bd-be74-40f0-b556-bbad52575d4b tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:21.503923 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ae5247bd-be74-40f0-b556-bbad52575d4b tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:21.634747 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ae5247bd-be74-40f0-b556-bbad52575d4b tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:30:21.642857 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ae5247bd-be74-40f0-b556-bbad52575d4b tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04" status: 200 len: 1728 microversion: 2.1 time: 0.153671 Oct 27 04:30:21.643453 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3655/7603] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:30:21 2022] GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04 => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:30:22.667334 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b0659740-8aad-4a5a-a113-993caa3aac80 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:30:22.667995 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b0659740-8aad-4a5a-a113-993caa3aac80 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: a2295c49-094c-4d51-88a5-9ae18aa17b04] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:30:22.674913 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b0659740-8aad-4a5a-a113-993caa3aac80 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:22.675424 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b0659740-8aad-4a5a-a113-993caa3aac80 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:22.675891 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b0659740-8aad-4a5a-a113-993caa3aac80 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:22.676609 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b0659740-8aad-4a5a-a113-993caa3aac80 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:22.677700 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b0659740-8aad-4a5a-a113-993caa3aac80 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:22.678177 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b0659740-8aad-4a5a-a113-993caa3aac80 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:22.808948 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b0659740-8aad-4a5a-a113-993caa3aac80 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:30:22.817256 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b0659740-8aad-4a5a-a113-993caa3aac80 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04" status: 200 len: 1728 microversion: 2.1 time: 0.153915 Oct 27 04:30:22.817826 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3949/7604] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:30:22 2022] GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04 => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:30:23.840219 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ae6cfbaa-6913-43c2-ad3d-e5352ec2974e tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:30:23.840842 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ae6cfbaa-6913-43c2-ad3d-e5352ec2974e tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: a2295c49-094c-4d51-88a5-9ae18aa17b04] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:30:23.847955 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ae6cfbaa-6913-43c2-ad3d-e5352ec2974e tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:23.848455 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ae6cfbaa-6913-43c2-ad3d-e5352ec2974e tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:23.849498 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ae6cfbaa-6913-43c2-ad3d-e5352ec2974e tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:23.850227 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ae6cfbaa-6913-43c2-ad3d-e5352ec2974e tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:23.850689 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ae6cfbaa-6913-43c2-ad3d-e5352ec2974e tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:23.851118 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ae6cfbaa-6913-43c2-ad3d-e5352ec2974e tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:23.978557 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ae6cfbaa-6913-43c2-ad3d-e5352ec2974e tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:30:23.986696 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ae6cfbaa-6913-43c2-ad3d-e5352ec2974e tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04" status: 200 len: 1728 microversion: 2.1 time: 0.150390 Oct 27 04:30:23.987270 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3656/7605] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:30:23 2022] GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04 => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:30:25.010227 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-76f5f01e-3841-47df-b305-367259a3b90d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:30:25.010930 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-76f5f01e-3841-47df-b305-367259a3b90d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: a2295c49-094c-4d51-88a5-9ae18aa17b04] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:30:25.017772 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-76f5f01e-3841-47df-b305-367259a3b90d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:25.018321 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-76f5f01e-3841-47df-b305-367259a3b90d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:25.018783 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-76f5f01e-3841-47df-b305-367259a3b90d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:25.019507 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-76f5f01e-3841-47df-b305-367259a3b90d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:25.019990 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-76f5f01e-3841-47df-b305-367259a3b90d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:25.020447 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-76f5f01e-3841-47df-b305-367259a3b90d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:25.146989 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-76f5f01e-3841-47df-b305-367259a3b90d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:30:25.155234 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-76f5f01e-3841-47df-b305-367259a3b90d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04" status: 200 len: 1728 microversion: 2.1 time: 0.148995 Oct 27 04:30:25.155812 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3950/7606] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:30:25 2022] GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04 => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:30:26.179558 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d9fbcb6d-7ee7-4496-9779-98045348827d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:30:26.180237 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d9fbcb6d-7ee7-4496-9779-98045348827d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: a2295c49-094c-4d51-88a5-9ae18aa17b04] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:30:26.187106 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d9fbcb6d-7ee7-4496-9779-98045348827d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:26.187601 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d9fbcb6d-7ee7-4496-9779-98045348827d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:26.188044 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d9fbcb6d-7ee7-4496-9779-98045348827d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:26.188754 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d9fbcb6d-7ee7-4496-9779-98045348827d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:26.189221 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d9fbcb6d-7ee7-4496-9779-98045348827d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:26.189654 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d9fbcb6d-7ee7-4496-9779-98045348827d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:26.330440 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d9fbcb6d-7ee7-4496-9779-98045348827d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:30:26.339185 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d9fbcb6d-7ee7-4496-9779-98045348827d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04" status: 200 len: 1728 microversion: 2.1 time: 0.163852 Oct 27 04:30:26.339761 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3657/7607] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:30:26 2022] GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04 => generated 1728 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:30:27.363741 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-814df2d0-c59a-46fe-a666-8f0b5d6410ff tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:30:27.364999 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-814df2d0-c59a-46fe-a666-8f0b5d6410ff tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: a2295c49-094c-4d51-88a5-9ae18aa17b04] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:30:27.371920 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-814df2d0-c59a-46fe-a666-8f0b5d6410ff tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:27.372427 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-814df2d0-c59a-46fe-a666-8f0b5d6410ff tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:27.372891 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-814df2d0-c59a-46fe-a666-8f0b5d6410ff tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:27.373611 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-814df2d0-c59a-46fe-a666-8f0b5d6410ff tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:27.374114 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-814df2d0-c59a-46fe-a666-8f0b5d6410ff tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:27.374564 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-814df2d0-c59a-46fe-a666-8f0b5d6410ff tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:27.504321 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-814df2d0-c59a-46fe-a666-8f0b5d6410ff tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:30:27.512565 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-814df2d0-c59a-46fe-a666-8f0b5d6410ff tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04" status: 200 len: 1728 microversion: 2.1 time: 0.152805 Oct 27 04:30:27.513156 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3951/7608] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:30:27 2022] GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04 => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:30:28.536727 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-54ab75d3-687f-4641-bd72-e1775433262d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:30:28.537396 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-54ab75d3-687f-4641-bd72-e1775433262d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: a2295c49-094c-4d51-88a5-9ae18aa17b04] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:30:28.543681 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-54ab75d3-687f-4641-bd72-e1775433262d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:28.544181 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-54ab75d3-687f-4641-bd72-e1775433262d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:28.544627 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-54ab75d3-687f-4641-bd72-e1775433262d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:28.545339 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-54ab75d3-687f-4641-bd72-e1775433262d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:28.545803 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-54ab75d3-687f-4641-bd72-e1775433262d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:28.546277 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-54ab75d3-687f-4641-bd72-e1775433262d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:28.683012 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-54ab75d3-687f-4641-bd72-e1775433262d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:30:28.691782 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-54ab75d3-687f-4641-bd72-e1775433262d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04" status: 200 len: 1728 microversion: 2.1 time: 0.159080 Oct 27 04:30:28.692388 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3658/7609] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:30:28 2022] GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04 => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:30:29.716411 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d74e172a-305c-4a08-94f6-a82b94a6d837 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:30:29.717054 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d74e172a-305c-4a08-94f6-a82b94a6d837 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: a2295c49-094c-4d51-88a5-9ae18aa17b04] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:30:29.724102 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d74e172a-305c-4a08-94f6-a82b94a6d837 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:29.724615 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d74e172a-305c-4a08-94f6-a82b94a6d837 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:29.725120 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d74e172a-305c-4a08-94f6-a82b94a6d837 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:29.725843 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d74e172a-305c-4a08-94f6-a82b94a6d837 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:29.726346 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d74e172a-305c-4a08-94f6-a82b94a6d837 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:29.726796 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d74e172a-305c-4a08-94f6-a82b94a6d837 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:29.873960 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d74e172a-305c-4a08-94f6-a82b94a6d837 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:30:29.882808 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d74e172a-305c-4a08-94f6-a82b94a6d837 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04" status: 200 len: 1728 microversion: 2.1 time: 0.171518 Oct 27 04:30:29.884167 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3952/7610] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:30:29 2022] GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04 => generated 1728 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:30:30.618663 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-805edd23-4db8-4b05-b029-91d076d2162d req-85f34b0e-7dca-44da-bb5c-49866bcd3788 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2295c49-094c-4d51-88a5-9ae18aa17b04", "name": "network-vif-unplugged", "status": "completed", "tag": "975121d1-b03a-45d5-8a8b-3e8ad3eba408"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:30:30.629076 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-805edd23-4db8-4b05-b029-91d076d2162d req-85f34b0e-7dca-44da-bb5c-49866bcd3788 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:30.629609 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-805edd23-4db8-4b05-b029-91d076d2162d req-85f34b0e-7dca-44da-bb5c-49866bcd3788 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:30.630668 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-805edd23-4db8-4b05-b029-91d076d2162d req-85f34b0e-7dca-44da-bb5c-49866bcd3788 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:30.642591 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-805edd23-4db8-4b05-b029-91d076d2162d req-85f34b0e-7dca-44da-bb5c-49866bcd3788 service nova] Creating event network-vif-unplugged:975121d1-b03a-45d5-8a8b-3e8ad3eba408 for instance a2295c49-094c-4d51-88a5-9ae18aa17b04 on n-h2-862769-1 Oct 27 04:30:30.647840 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [req-805edd23-4db8-4b05-b029-91d076d2162d req-85f34b0e-7dca-44da-bb5c-49866bcd3788 service nova] Instance a2295c49-094c-4d51-88a5-9ae18aa17b04 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862769-1', 'n-h1-862769-1'} {{(pid=121000) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 04:30:30.660859 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-805edd23-4db8-4b05-b029-91d076d2162d req-85f34b0e-7dca-44da-bb5c-49866bcd3788 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046642 Oct 27 04:30:30.661469 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3659/7611] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:30:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:30:30.907317 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-bf19252a-c7e3-4d03-bcfb-bba86c130168 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:30:30.907991 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-bf19252a-c7e3-4d03-bcfb-bba86c130168 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: a2295c49-094c-4d51-88a5-9ae18aa17b04] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:30:30.915393 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bf19252a-c7e3-4d03-bcfb-bba86c130168 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:30.915894 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bf19252a-c7e3-4d03-bcfb-bba86c130168 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:30.916353 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bf19252a-c7e3-4d03-bcfb-bba86c130168 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:30.917077 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bf19252a-c7e3-4d03-bcfb-bba86c130168 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:30.917551 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bf19252a-c7e3-4d03-bcfb-bba86c130168 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:30.917995 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bf19252a-c7e3-4d03-bcfb-bba86c130168 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:31.055024 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-bf19252a-c7e3-4d03-bcfb-bba86c130168 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:30:31.064732 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-bf19252a-c7e3-4d03-bcfb-bba86c130168 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04" status: 200 len: 1727 microversion: 2.1 time: 0.161291 Oct 27 04:30:31.067841 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3953/7612] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:30:30 2022] GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04 => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:30:32.089335 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-922a8d76-8f99-4ff6-b9cb-e723633fef25 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:30:32.090205 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-922a8d76-8f99-4ff6-b9cb-e723633fef25 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: a2295c49-094c-4d51-88a5-9ae18aa17b04] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:30:32.097678 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-922a8d76-8f99-4ff6-b9cb-e723633fef25 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:32.098207 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-922a8d76-8f99-4ff6-b9cb-e723633fef25 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:32.098686 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-922a8d76-8f99-4ff6-b9cb-e723633fef25 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:32.099401 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-922a8d76-8f99-4ff6-b9cb-e723633fef25 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:32.099860 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-922a8d76-8f99-4ff6-b9cb-e723633fef25 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:32.100319 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-922a8d76-8f99-4ff6-b9cb-e723633fef25 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:32.244923 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-922a8d76-8f99-4ff6-b9cb-e723633fef25 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:30:32.253429 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-922a8d76-8f99-4ff6-b9cb-e723633fef25 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04" status: 200 len: 1725 microversion: 2.1 time: 0.168505 Oct 27 04:30:32.254078 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3660/7613] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:30:32 2022] GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04 => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:30:32.675838 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-50f2c683-5b25-4997-b715-fd62d9d74152 req-fc779dba-77ca-4d1f-a04e-dfdd8981b22f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2295c49-094c-4d51-88a5-9ae18aa17b04", "tag": "975121d1-b03a-45d5-8a8b-3e8ad3eba408"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:30:32.686960 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-50f2c683-5b25-4997-b715-fd62d9d74152 req-fc779dba-77ca-4d1f-a04e-dfdd8981b22f service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:32.687469 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-50f2c683-5b25-4997-b715-fd62d9d74152 req-fc779dba-77ca-4d1f-a04e-dfdd8981b22f service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:32.687926 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-50f2c683-5b25-4997-b715-fd62d9d74152 req-fc779dba-77ca-4d1f-a04e-dfdd8981b22f service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:32.700982 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-50f2c683-5b25-4997-b715-fd62d9d74152 req-fc779dba-77ca-4d1f-a04e-dfdd8981b22f service nova] Creating event network-changed:975121d1-b03a-45d5-8a8b-3e8ad3eba408 for instance a2295c49-094c-4d51-88a5-9ae18aa17b04 on n-h2-862769-1 Oct 27 04:30:32.705805 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [req-50f2c683-5b25-4997-b715-fd62d9d74152 req-fc779dba-77ca-4d1f-a04e-dfdd8981b22f service nova] Instance a2295c49-094c-4d51-88a5-9ae18aa17b04 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862769-1', 'n-h1-862769-1'} {{(pid=121001) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 04:30:32.716676 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-50f2c683-5b25-4997-b715-fd62d9d74152 req-fc779dba-77ca-4d1f-a04e-dfdd8981b22f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044680 Oct 27 04:30:32.717284 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3954/7614] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:30:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:30:33.277462 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9a49a2be-a5bc-4f00-85d0-7e579db6422d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:30:33.278213 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9a49a2be-a5bc-4f00-85d0-7e579db6422d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: a2295c49-094c-4d51-88a5-9ae18aa17b04] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:30:33.285693 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9a49a2be-a5bc-4f00-85d0-7e579db6422d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:33.286599 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9a49a2be-a5bc-4f00-85d0-7e579db6422d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:33.287272 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9a49a2be-a5bc-4f00-85d0-7e579db6422d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:33.288210 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9a49a2be-a5bc-4f00-85d0-7e579db6422d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:33.288873 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9a49a2be-a5bc-4f00-85d0-7e579db6422d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:33.289508 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9a49a2be-a5bc-4f00-85d0-7e579db6422d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:33.425787 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9a49a2be-a5bc-4f00-85d0-7e579db6422d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:30:33.435301 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9a49a2be-a5bc-4f00-85d0-7e579db6422d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04" status: 200 len: 1725 microversion: 2.1 time: 0.161730 Oct 27 04:30:33.435920 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3661/7615] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:30:33 2022] GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:30:34.463138 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-50c838c1-996a-4879-a313-c99d13d9fa45 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:30:34.463908 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-50c838c1-996a-4879-a313-c99d13d9fa45 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: a2295c49-094c-4d51-88a5-9ae18aa17b04] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:30:34.470510 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-50c838c1-996a-4879-a313-c99d13d9fa45 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:34.471012 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-50c838c1-996a-4879-a313-c99d13d9fa45 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:34.471475 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-50c838c1-996a-4879-a313-c99d13d9fa45 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:34.472196 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-50c838c1-996a-4879-a313-c99d13d9fa45 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:34.472677 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-50c838c1-996a-4879-a313-c99d13d9fa45 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:34.473131 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-50c838c1-996a-4879-a313-c99d13d9fa45 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:34.604074 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-50c838c1-996a-4879-a313-c99d13d9fa45 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:30:34.612587 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-50c838c1-996a-4879-a313-c99d13d9fa45 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04" status: 200 len: 1725 microversion: 2.1 time: 0.155205 Oct 27 04:30:34.613170 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3955/7616] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:30:34 2022] GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:30:35.636377 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-81354566-a919-4ec5-bbad-40c1328862e2 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:30:35.637027 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-81354566-a919-4ec5-bbad-40c1328862e2 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: a2295c49-094c-4d51-88a5-9ae18aa17b04] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:30:35.643856 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-81354566-a919-4ec5-bbad-40c1328862e2 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:35.644342 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-81354566-a919-4ec5-bbad-40c1328862e2 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:35.644782 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-81354566-a919-4ec5-bbad-40c1328862e2 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:35.645483 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-81354566-a919-4ec5-bbad-40c1328862e2 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:35.645943 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-81354566-a919-4ec5-bbad-40c1328862e2 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:35.646401 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-81354566-a919-4ec5-bbad-40c1328862e2 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:35.777851 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-81354566-a919-4ec5-bbad-40c1328862e2 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:30:35.787340 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-81354566-a919-4ec5-bbad-40c1328862e2 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04" status: 200 len: 1725 microversion: 2.1 time: 0.154875 Oct 27 04:30:35.787976 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3662/7617] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:30:35 2022] GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:30:36.810939 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-083b2faf-ec0f-4fcf-9648-1e9d6187e5be tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:30:36.811587 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-083b2faf-ec0f-4fcf-9648-1e9d6187e5be tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: a2295c49-094c-4d51-88a5-9ae18aa17b04] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:30:36.819031 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-083b2faf-ec0f-4fcf-9648-1e9d6187e5be tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:36.821079 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-083b2faf-ec0f-4fcf-9648-1e9d6187e5be tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:36.821079 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-083b2faf-ec0f-4fcf-9648-1e9d6187e5be tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:36.821079 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-083b2faf-ec0f-4fcf-9648-1e9d6187e5be tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:36.821363 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-083b2faf-ec0f-4fcf-9648-1e9d6187e5be tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:36.821597 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-083b2faf-ec0f-4fcf-9648-1e9d6187e5be tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:36.841203 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:30:36.959031 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-083b2faf-ec0f-4fcf-9648-1e9d6187e5be tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:30:36.967693 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-083b2faf-ec0f-4fcf-9648-1e9d6187e5be tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04" status: 200 len: 1725 microversion: 2.1 time: 0.160832 Oct 27 04:30:36.970195 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3956/7618] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:30:36 2022] GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:30:37.992750 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-bf5bd86b-87a4-4f42-b9f5-5b6e63a5ca91 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:30:37.993372 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-bf5bd86b-87a4-4f42-b9f5-5b6e63a5ca91 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: a2295c49-094c-4d51-88a5-9ae18aa17b04] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:30:37.996170 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=29 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:30:38.000854 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bf5bd86b-87a4-4f42-b9f5-5b6e63a5ca91 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:38.001350 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bf5bd86b-87a4-4f42-b9f5-5b6e63a5ca91 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:38.001798 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bf5bd86b-87a4-4f42-b9f5-5b6e63a5ca91 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:38.002530 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bf5bd86b-87a4-4f42-b9f5-5b6e63a5ca91 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:38.002999 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bf5bd86b-87a4-4f42-b9f5-5b6e63a5ca91 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:38.003435 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bf5bd86b-87a4-4f42-b9f5-5b6e63a5ca91 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:38.141999 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-bf5bd86b-87a4-4f42-b9f5-5b6e63a5ca91 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:30:38.149409 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-bf5bd86b-87a4-4f42-b9f5-5b6e63a5ca91 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04" status: 200 len: 1725 microversion: 2.1 time: 0.161080 Oct 27 04:30:38.149987 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3663/7619] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:30:37 2022] GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:30:39.172953 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f50129df-151a-41a9-86c5-552e8ba11858 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:30:39.173593 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f50129df-151a-41a9-86c5-552e8ba11858 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: a2295c49-094c-4d51-88a5-9ae18aa17b04] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:30:39.176943 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=35 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:30:39.182757 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f50129df-151a-41a9-86c5-552e8ba11858 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:39.183263 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f50129df-151a-41a9-86c5-552e8ba11858 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:39.183722 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f50129df-151a-41a9-86c5-552e8ba11858 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:39.184448 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f50129df-151a-41a9-86c5-552e8ba11858 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:39.184931 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f50129df-151a-41a9-86c5-552e8ba11858 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:39.185382 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f50129df-151a-41a9-86c5-552e8ba11858 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:39.314415 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f50129df-151a-41a9-86c5-552e8ba11858 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:30:39.323489 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f50129df-151a-41a9-86c5-552e8ba11858 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04" status: 200 len: 1725 microversion: 2.1 time: 0.154580 Oct 27 04:30:39.324066 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3957/7620] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:30:39 2022] GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:30:40.347558 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9a10735b-43c5-42c0-88cb-7abfdbaaf30b tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:30:40.348171 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9a10735b-43c5-42c0-88cb-7abfdbaaf30b tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: a2295c49-094c-4d51-88a5-9ae18aa17b04] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:30:40.355578 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9a10735b-43c5-42c0-88cb-7abfdbaaf30b tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:40.356068 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9a10735b-43c5-42c0-88cb-7abfdbaaf30b tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:40.356509 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9a10735b-43c5-42c0-88cb-7abfdbaaf30b tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:40.357204 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9a10735b-43c5-42c0-88cb-7abfdbaaf30b tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:40.357663 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9a10735b-43c5-42c0-88cb-7abfdbaaf30b tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:40.358214 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9a10735b-43c5-42c0-88cb-7abfdbaaf30b tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:40.360638 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=89 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:30:40.489352 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9a10735b-43c5-42c0-88cb-7abfdbaaf30b tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:30:40.497573 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9a10735b-43c5-42c0-88cb-7abfdbaaf30b tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04" status: 200 len: 1725 microversion: 2.1 time: 0.154207 Oct 27 04:30:40.498186 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3664/7621] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:30:40 2022] GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:30:41.520483 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-587b5902-26e4-4786-b7ee-2cca2e745981 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:30:41.521135 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-587b5902-26e4-4786-b7ee-2cca2e745981 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: a2295c49-094c-4d51-88a5-9ae18aa17b04] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:30:41.528285 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-587b5902-26e4-4786-b7ee-2cca2e745981 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:41.528796 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-587b5902-26e4-4786-b7ee-2cca2e745981 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:41.529271 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-587b5902-26e4-4786-b7ee-2cca2e745981 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:41.529982 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-587b5902-26e4-4786-b7ee-2cca2e745981 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:41.530486 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-587b5902-26e4-4786-b7ee-2cca2e745981 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:41.530939 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-587b5902-26e4-4786-b7ee-2cca2e745981 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:41.663664 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-587b5902-26e4-4786-b7ee-2cca2e745981 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:30:41.671955 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-587b5902-26e4-4786-b7ee-2cca2e745981 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04" status: 200 len: 1725 microversion: 2.1 time: 0.155435 Oct 27 04:30:41.672532 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3958/7622] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:30:41 2022] GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:30:42.696572 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7a6f8b30-3c73-4920-9e47-b583b33c5f30 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:30:42.704893 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7a6f8b30-3c73-4920-9e47-b583b33c5f30 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: a2295c49-094c-4d51-88a5-9ae18aa17b04] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:30:42.704893 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7a6f8b30-3c73-4920-9e47-b583b33c5f30 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:42.704893 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7a6f8b30-3c73-4920-9e47-b583b33c5f30 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:42.705189 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7a6f8b30-3c73-4920-9e47-b583b33c5f30 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:42.705759 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7a6f8b30-3c73-4920-9e47-b583b33c5f30 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:42.706263 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7a6f8b30-3c73-4920-9e47-b583b33c5f30 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:42.706732 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7a6f8b30-3c73-4920-9e47-b583b33c5f30 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:42.841193 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7a6f8b30-3c73-4920-9e47-b583b33c5f30 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:30:42.850190 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7a6f8b30-3c73-4920-9e47-b583b33c5f30 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04" status: 200 len: 1725 microversion: 2.1 time: 0.157666 Oct 27 04:30:42.850740 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3665/7623] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:30:42 2022] GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:30:43.927367 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-26716478-60cc-4ad6-af41-58b293373655 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:30:43.928091 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-26716478-60cc-4ad6-af41-58b293373655 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: a2295c49-094c-4d51-88a5-9ae18aa17b04] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:30:43.934985 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-26716478-60cc-4ad6-af41-58b293373655 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:43.935489 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-26716478-60cc-4ad6-af41-58b293373655 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:43.935945 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-26716478-60cc-4ad6-af41-58b293373655 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:43.936654 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-26716478-60cc-4ad6-af41-58b293373655 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:43.937125 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-26716478-60cc-4ad6-af41-58b293373655 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:43.937566 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-26716478-60cc-4ad6-af41-58b293373655 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:44.069830 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-26716478-60cc-4ad6-af41-58b293373655 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:30:44.078179 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-26716478-60cc-4ad6-af41-58b293373655 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04" status: 200 len: 1725 microversion: 2.1 time: 0.154767 Oct 27 04:30:44.078776 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3959/7624] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:30:43 2022] GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:30:45.102880 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b2e70828-c566-4f4e-a2b3-3f3c8495e1f5 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:30:45.103459 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b2e70828-c566-4f4e-a2b3-3f3c8495e1f5 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: a2295c49-094c-4d51-88a5-9ae18aa17b04] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:30:45.110349 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b2e70828-c566-4f4e-a2b3-3f3c8495e1f5 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:45.110844 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b2e70828-c566-4f4e-a2b3-3f3c8495e1f5 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:45.111293 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b2e70828-c566-4f4e-a2b3-3f3c8495e1f5 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:45.111995 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b2e70828-c566-4f4e-a2b3-3f3c8495e1f5 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:45.112459 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b2e70828-c566-4f4e-a2b3-3f3c8495e1f5 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:45.112894 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b2e70828-c566-4f4e-a2b3-3f3c8495e1f5 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:45.297961 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b2e70828-c566-4f4e-a2b3-3f3c8495e1f5 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:30:45.307120 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b2e70828-c566-4f4e-a2b3-3f3c8495e1f5 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04" status: 200 len: 1722 microversion: 2.1 time: 0.208812 Oct 27 04:30:45.307716 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3666/7625] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:30:45 2022] GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04 => generated 1722 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:30:45.331751 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-026b99ca-ee4c-405c-98b6-777d29dd73a0 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:30:45.332321 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-026b99ca-ee4c-405c-98b6-777d29dd73a0 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: a2295c49-094c-4d51-88a5-9ae18aa17b04] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:30:45.339126 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-026b99ca-ee4c-405c-98b6-777d29dd73a0 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:45.339630 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-026b99ca-ee4c-405c-98b6-777d29dd73a0 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:45.340089 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-026b99ca-ee4c-405c-98b6-777d29dd73a0 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:45.340801 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-026b99ca-ee4c-405c-98b6-777d29dd73a0 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:45.341275 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-026b99ca-ee4c-405c-98b6-777d29dd73a0 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:45.341722 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-026b99ca-ee4c-405c-98b6-777d29dd73a0 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:45.379177 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-026b99ca-ee4c-405c-98b6-777d29dd73a0 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:45.379601 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-026b99ca-ee4c-405c-98b6-777d29dd73a0 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:45.380113 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-026b99ca-ee4c-405c-98b6-777d29dd73a0 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:45.380855 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-026b99ca-ee4c-405c-98b6-777d29dd73a0 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:45.381372 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-026b99ca-ee4c-405c-98b6-777d29dd73a0 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:45.381817 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-026b99ca-ee4c-405c-98b6-777d29dd73a0 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:45.401745 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-026b99ca-ee4c-405c-98b6-777d29dd73a0 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Getting quotas for project 529ab4a5a66947aebb3f09a9842e5c9f. Resources: {'cores', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 04:30:45.406938 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-026b99ca-ee4c-405c-98b6-777d29dd73a0 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Getting quotas for user 197669776fde4a6480f6cab6e5c8552f and project 529ab4a5a66947aebb3f09a9842e5c9f. Resources: {'cores', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 04:30:45.762167 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-026b99ca-ee4c-405c-98b6-777d29dd73a0 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "POST /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04/action" status: 202 len: 0 microversion: 2.1 time: 0.434155 Oct 27 04:30:45.762793 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3960/7626] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 04:30:45 2022] POST /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04/action => generated 0 bytes in 436 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 04:30:45.770891 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-edf86a69-2d91-45a3-b7b5-3307a62dfa25 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:30:45.772009 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-edf86a69-2d91-45a3-b7b5-3307a62dfa25 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: a2295c49-094c-4d51-88a5-9ae18aa17b04] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:30:45.778113 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-edf86a69-2d91-45a3-b7b5-3307a62dfa25 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:45.778616 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-edf86a69-2d91-45a3-b7b5-3307a62dfa25 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:45.779103 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-edf86a69-2d91-45a3-b7b5-3307a62dfa25 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:45.779814 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-edf86a69-2d91-45a3-b7b5-3307a62dfa25 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:45.780309 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-edf86a69-2d91-45a3-b7b5-3307a62dfa25 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:45.780761 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-edf86a69-2d91-45a3-b7b5-3307a62dfa25 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:45.979681 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-edf86a69-2d91-45a3-b7b5-3307a62dfa25 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:30:45.988488 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-edf86a69-2d91-45a3-b7b5-3307a62dfa25 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04" status: 200 len: 1721 microversion: 2.1 time: 0.221405 Oct 27 04:30:45.989476 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3667/7627] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:30:45 2022] GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04 => generated 1721 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 04:30:47.011248 n-d-862769-1 devstack@n-api.service[121001]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 04:30:47.011820 n-d-862769-1 devstack@n-api.service[121001]: Thu Oct 27 04:30:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04 (ip 10.222.0.20) !!! Oct 27 04:30:47.016730 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-080d497d-58f7-40cd-9eeb-dade87c6f9a9 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:30:47.017592 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-080d497d-58f7-40cd-9eeb-dade87c6f9a9 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: a2295c49-094c-4d51-88a5-9ae18aa17b04] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:30:47.029660 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-080d497d-58f7-40cd-9eeb-dade87c6f9a9 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:47.029660 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-080d497d-58f7-40cd-9eeb-dade87c6f9a9 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:47.029660 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-080d497d-58f7-40cd-9eeb-dade87c6f9a9 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:47.029660 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-080d497d-58f7-40cd-9eeb-dade87c6f9a9 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:47.029660 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-080d497d-58f7-40cd-9eeb-dade87c6f9a9 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:47.029660 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-080d497d-58f7-40cd-9eeb-dade87c6f9a9 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:47.208803 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-080d497d-58f7-40cd-9eeb-dade87c6f9a9 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:30:47.216683 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-080d497d-58f7-40cd-9eeb-dade87c6f9a9 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04" status: 200 len: 1721 microversion: 2.1 time: 0.207049 Oct 27 04:30:47.217265 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3961/7628] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:30:47 2022] GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04 => generated 1721 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:30:48.240471 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-036684a7-41ff-42a7-b367-9bb9fed6b8d1 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:30:48.241103 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-036684a7-41ff-42a7-b367-9bb9fed6b8d1 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: a2295c49-094c-4d51-88a5-9ae18aa17b04] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:30:48.244065 n-d-862769-1 devstack@n-api.service[121000]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 04:30:48.244196 n-d-862769-1 devstack@n-api.service[121000]: Thu Oct 27 04:30:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04 (ip 10.222.0.20) !!! Oct 27 04:30:48.250855 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-036684a7-41ff-42a7-b367-9bb9fed6b8d1 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:48.251355 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-036684a7-41ff-42a7-b367-9bb9fed6b8d1 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:48.251942 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-036684a7-41ff-42a7-b367-9bb9fed6b8d1 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:48.252664 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-036684a7-41ff-42a7-b367-9bb9fed6b8d1 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:48.253132 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-036684a7-41ff-42a7-b367-9bb9fed6b8d1 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:48.253578 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-036684a7-41ff-42a7-b367-9bb9fed6b8d1 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:48.399735 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-036684a7-41ff-42a7-b367-9bb9fed6b8d1 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:30:48.408367 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-036684a7-41ff-42a7-b367-9bb9fed6b8d1 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04" status: 200 len: 1721 microversion: 2.1 time: 0.172042 Oct 27 04:30:48.408957 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3668/7629] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:30:48 2022] GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04 => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:30:49.433499 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e29a0ece-d7a7-48af-925d-c971a19b03ff tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:30:49.434160 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e29a0ece-d7a7-48af-925d-c971a19b03ff tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: a2295c49-094c-4d51-88a5-9ae18aa17b04] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:30:49.441164 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e29a0ece-d7a7-48af-925d-c971a19b03ff tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:49.441674 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e29a0ece-d7a7-48af-925d-c971a19b03ff tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:49.442163 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e29a0ece-d7a7-48af-925d-c971a19b03ff tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:49.442879 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e29a0ece-d7a7-48af-925d-c971a19b03ff tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:49.443385 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e29a0ece-d7a7-48af-925d-c971a19b03ff tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:49.443831 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e29a0ece-d7a7-48af-925d-c971a19b03ff tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:49.578128 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e29a0ece-d7a7-48af-925d-c971a19b03ff tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:30:49.587028 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e29a0ece-d7a7-48af-925d-c971a19b03ff tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04" status: 200 len: 1721 microversion: 2.1 time: 0.157827 Oct 27 04:30:49.587616 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3962/7630] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:30:49 2022] GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:30:50.610264 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2e2875a9-da38-4b28-819f-537949314937 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:30:50.610893 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-2e2875a9-da38-4b28-819f-537949314937 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: a2295c49-094c-4d51-88a5-9ae18aa17b04] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:30:50.617892 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2e2875a9-da38-4b28-819f-537949314937 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:50.618427 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2e2875a9-da38-4b28-819f-537949314937 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:50.618882 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2e2875a9-da38-4b28-819f-537949314937 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:50.619592 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2e2875a9-da38-4b28-819f-537949314937 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:50.620066 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2e2875a9-da38-4b28-819f-537949314937 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:50.620509 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2e2875a9-da38-4b28-819f-537949314937 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:50.757988 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2e2875a9-da38-4b28-819f-537949314937 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:30:50.766646 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2e2875a9-da38-4b28-819f-537949314937 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04" status: 200 len: 1721 microversion: 2.1 time: 0.160373 Oct 27 04:30:50.767234 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3669/7631] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:30:50 2022] GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:30:51.791364 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-eb389eb3-2fb1-4d92-901d-f5648ec9656e tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:30:51.799853 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-eb389eb3-2fb1-4d92-901d-f5648ec9656e tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: a2295c49-094c-4d51-88a5-9ae18aa17b04] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:30:51.799853 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eb389eb3-2fb1-4d92-901d-f5648ec9656e tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:51.799853 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eb389eb3-2fb1-4d92-901d-f5648ec9656e tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:51.800301 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eb389eb3-2fb1-4d92-901d-f5648ec9656e tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:51.800679 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eb389eb3-2fb1-4d92-901d-f5648ec9656e tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:51.801160 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eb389eb3-2fb1-4d92-901d-f5648ec9656e tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:51.801617 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eb389eb3-2fb1-4d92-901d-f5648ec9656e tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:51.956251 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-eb389eb3-2fb1-4d92-901d-f5648ec9656e tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:30:51.965127 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-eb389eb3-2fb1-4d92-901d-f5648ec9656e tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04" status: 200 len: 1721 microversion: 2.1 time: 0.178535 Oct 27 04:30:51.965717 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3963/7632] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:30:51 2022] GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04 => generated 1721 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:30:52.516298 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-0dacda3c-b9ac-40d6-a7a9-75f175d60f09 req-3ec54bb1-b899-4587-a00b-5d357f576c82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2295c49-094c-4d51-88a5-9ae18aa17b04", "tag": "975121d1-b03a-45d5-8a8b-3e8ad3eba408"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:30:52.527086 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-0dacda3c-b9ac-40d6-a7a9-75f175d60f09 req-3ec54bb1-b899-4587-a00b-5d357f576c82 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:52.527573 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-0dacda3c-b9ac-40d6-a7a9-75f175d60f09 req-3ec54bb1-b899-4587-a00b-5d357f576c82 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:52.528013 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-0dacda3c-b9ac-40d6-a7a9-75f175d60f09 req-3ec54bb1-b899-4587-a00b-5d357f576c82 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:52.540530 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-0dacda3c-b9ac-40d6-a7a9-75f175d60f09 req-3ec54bb1-b899-4587-a00b-5d357f576c82 service nova] Creating event network-changed:975121d1-b03a-45d5-8a8b-3e8ad3eba408 for instance a2295c49-094c-4d51-88a5-9ae18aa17b04 on n-h1-862769-1 Oct 27 04:30:52.545925 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [req-0dacda3c-b9ac-40d6-a7a9-75f175d60f09 req-3ec54bb1-b899-4587-a00b-5d357f576c82 service nova] Instance a2295c49-094c-4d51-88a5-9ae18aa17b04 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862769-1', 'n-h1-862769-1'} {{(pid=121000) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 04:30:52.557662 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-0dacda3c-b9ac-40d6-a7a9-75f175d60f09 req-3ec54bb1-b899-4587-a00b-5d357f576c82 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045110 Oct 27 04:30:52.558322 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3670/7633] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:30:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:30:52.989037 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-19b56093-1622-45ae-ab0f-143662871a21 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:30:52.990490 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-19b56093-1622-45ae-ab0f-143662871a21 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: a2295c49-094c-4d51-88a5-9ae18aa17b04] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:30:52.998291 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-19b56093-1622-45ae-ab0f-143662871a21 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:52.999190 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-19b56093-1622-45ae-ab0f-143662871a21 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:52.999829 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-19b56093-1622-45ae-ab0f-143662871a21 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:53.000940 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-19b56093-1622-45ae-ab0f-143662871a21 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:53.001742 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-19b56093-1622-45ae-ab0f-143662871a21 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:53.002380 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-19b56093-1622-45ae-ab0f-143662871a21 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:53.164381 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-19b56093-1622-45ae-ab0f-143662871a21 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:30:53.172743 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-19b56093-1622-45ae-ab0f-143662871a21 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04" status: 200 len: 1721 microversion: 2.1 time: 0.187804 Oct 27 04:30:53.173326 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3964/7634] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:30:52 2022] GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04 => generated 1721 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:30:54.198425 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-82001cbb-e1cf-4c5b-bcff-f197f0683454 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:30:54.199132 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-82001cbb-e1cf-4c5b-bcff-f197f0683454 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: a2295c49-094c-4d51-88a5-9ae18aa17b04] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:30:54.205330 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-82001cbb-e1cf-4c5b-bcff-f197f0683454 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:54.205821 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-82001cbb-e1cf-4c5b-bcff-f197f0683454 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:54.206294 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-82001cbb-e1cf-4c5b-bcff-f197f0683454 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:54.206993 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-82001cbb-e1cf-4c5b-bcff-f197f0683454 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:54.207456 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-82001cbb-e1cf-4c5b-bcff-f197f0683454 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:54.207884 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-82001cbb-e1cf-4c5b-bcff-f197f0683454 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:54.344291 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-82001cbb-e1cf-4c5b-bcff-f197f0683454 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:30:54.353433 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-82001cbb-e1cf-4c5b-bcff-f197f0683454 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04" status: 200 len: 1721 microversion: 2.1 time: 0.160286 Oct 27 04:30:54.354023 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3671/7635] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:30:54 2022] GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:30:55.378359 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-fa812faa-2207-440b-97e1-2eb27b74ccc8 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:30:55.379044 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-fa812faa-2207-440b-97e1-2eb27b74ccc8 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: a2295c49-094c-4d51-88a5-9ae18aa17b04] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:30:55.386879 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fa812faa-2207-440b-97e1-2eb27b74ccc8 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:55.387399 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fa812faa-2207-440b-97e1-2eb27b74ccc8 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:55.387867 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fa812faa-2207-440b-97e1-2eb27b74ccc8 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:55.388609 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fa812faa-2207-440b-97e1-2eb27b74ccc8 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:55.389093 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fa812faa-2207-440b-97e1-2eb27b74ccc8 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:55.389554 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fa812faa-2207-440b-97e1-2eb27b74ccc8 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:55.392525 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=3 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:30:55.522203 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-fa812faa-2207-440b-97e1-2eb27b74ccc8 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:30:55.530638 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-fa812faa-2207-440b-97e1-2eb27b74ccc8 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04" status: 200 len: 1721 microversion: 2.1 time: 0.156405 Oct 27 04:30:55.531218 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3965/7636] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:30:55 2022] GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:30:56.554995 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-db3d776f-2992-4f52-8878-b72493c8cd85 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:30:56.555658 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-db3d776f-2992-4f52-8878-b72493c8cd85 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: a2295c49-094c-4d51-88a5-9ae18aa17b04] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:30:56.562662 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-db3d776f-2992-4f52-8878-b72493c8cd85 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:56.563159 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-db3d776f-2992-4f52-8878-b72493c8cd85 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:56.563606 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-db3d776f-2992-4f52-8878-b72493c8cd85 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:56.564315 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-db3d776f-2992-4f52-8878-b72493c8cd85 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:56.564781 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-db3d776f-2992-4f52-8878-b72493c8cd85 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:56.565217 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-db3d776f-2992-4f52-8878-b72493c8cd85 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:56.706791 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-db3d776f-2992-4f52-8878-b72493c8cd85 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:30:56.716542 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-db3d776f-2992-4f52-8878-b72493c8cd85 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04" status: 200 len: 1721 microversion: 2.1 time: 0.165423 Oct 27 04:30:56.717238 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3672/7637] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:30:56 2022] GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:30:57.741392 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d104ee23-5638-4679-a94b-ef8d9f2bd76a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:30:57.742049 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d104ee23-5638-4679-a94b-ef8d9f2bd76a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: a2295c49-094c-4d51-88a5-9ae18aa17b04] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:30:57.749485 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d104ee23-5638-4679-a94b-ef8d9f2bd76a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:57.754832 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d104ee23-5638-4679-a94b-ef8d9f2bd76a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:57.754832 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d104ee23-5638-4679-a94b-ef8d9f2bd76a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:57.754832 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d104ee23-5638-4679-a94b-ef8d9f2bd76a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:57.754832 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d104ee23-5638-4679-a94b-ef8d9f2bd76a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:57.754832 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d104ee23-5638-4679-a94b-ef8d9f2bd76a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:57.891387 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d104ee23-5638-4679-a94b-ef8d9f2bd76a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:30:57.900356 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d104ee23-5638-4679-a94b-ef8d9f2bd76a tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04" status: 200 len: 1721 microversion: 2.1 time: 0.163113 Oct 27 04:30:57.902008 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3966/7638] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:30:57 2022] GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:30:58.924245 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-158a9c96-ed67-440e-92d5-8d7e2d7ca0bf tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:30:58.924876 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-158a9c96-ed67-440e-92d5-8d7e2d7ca0bf tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: a2295c49-094c-4d51-88a5-9ae18aa17b04] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:30:58.931562 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-158a9c96-ed67-440e-92d5-8d7e2d7ca0bf tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:58.932114 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-158a9c96-ed67-440e-92d5-8d7e2d7ca0bf tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:58.932601 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-158a9c96-ed67-440e-92d5-8d7e2d7ca0bf tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:58.933397 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-158a9c96-ed67-440e-92d5-8d7e2d7ca0bf tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:30:58.933891 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-158a9c96-ed67-440e-92d5-8d7e2d7ca0bf tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:30:58.934402 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-158a9c96-ed67-440e-92d5-8d7e2d7ca0bf tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:30:59.062884 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-158a9c96-ed67-440e-92d5-8d7e2d7ca0bf tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:30:59.071170 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-158a9c96-ed67-440e-92d5-8d7e2d7ca0bf tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04" status: 200 len: 1721 microversion: 2.1 time: 0.151132 Oct 27 04:30:59.071757 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3673/7639] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:30:58 2022] GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04 => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:31:00.094841 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c786cd9d-741b-4220-ae25-5629d1e3a2f2 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:31:00.095381 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c786cd9d-741b-4220-ae25-5629d1e3a2f2 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: a2295c49-094c-4d51-88a5-9ae18aa17b04] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:31:00.101603 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c786cd9d-741b-4220-ae25-5629d1e3a2f2 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:00.102149 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c786cd9d-741b-4220-ae25-5629d1e3a2f2 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:00.102609 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c786cd9d-741b-4220-ae25-5629d1e3a2f2 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:00.103319 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c786cd9d-741b-4220-ae25-5629d1e3a2f2 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:00.103791 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c786cd9d-741b-4220-ae25-5629d1e3a2f2 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:00.104239 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c786cd9d-741b-4220-ae25-5629d1e3a2f2 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:00.232339 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c786cd9d-741b-4220-ae25-5629d1e3a2f2 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:31:00.240605 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c786cd9d-741b-4220-ae25-5629d1e3a2f2 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04" status: 200 len: 1721 microversion: 2.1 time: 0.150281 Oct 27 04:31:00.241186 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3967/7640] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:31:00 2022] GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:31:01.263890 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1f7d40e4-e4a9-4a3d-a0d3-0498044c7bf7 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:31:01.264512 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1f7d40e4-e4a9-4a3d-a0d3-0498044c7bf7 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: a2295c49-094c-4d51-88a5-9ae18aa17b04] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:31:01.271962 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1f7d40e4-e4a9-4a3d-a0d3-0498044c7bf7 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:01.271962 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1f7d40e4-e4a9-4a3d-a0d3-0498044c7bf7 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:01.272279 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1f7d40e4-e4a9-4a3d-a0d3-0498044c7bf7 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:01.273480 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1f7d40e4-e4a9-4a3d-a0d3-0498044c7bf7 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:01.273941 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1f7d40e4-e4a9-4a3d-a0d3-0498044c7bf7 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:01.274394 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1f7d40e4-e4a9-4a3d-a0d3-0498044c7bf7 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:01.404763 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1f7d40e4-e4a9-4a3d-a0d3-0498044c7bf7 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:31:01.412887 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1f7d40e4-e4a9-4a3d-a0d3-0498044c7bf7 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04" status: 200 len: 1721 microversion: 2.1 time: 0.152926 Oct 27 04:31:01.414076 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3674/7641] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:31:01 2022] GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:31:02.437072 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7aea45ae-19d4-4e81-bcc5-fbe52729e404 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:31:02.437621 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7aea45ae-19d4-4e81-bcc5-fbe52729e404 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: a2295c49-094c-4d51-88a5-9ae18aa17b04] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:31:02.445047 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7aea45ae-19d4-4e81-bcc5-fbe52729e404 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:02.445554 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7aea45ae-19d4-4e81-bcc5-fbe52729e404 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:02.446010 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7aea45ae-19d4-4e81-bcc5-fbe52729e404 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:02.446744 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7aea45ae-19d4-4e81-bcc5-fbe52729e404 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:02.447216 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7aea45ae-19d4-4e81-bcc5-fbe52729e404 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:02.447657 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7aea45ae-19d4-4e81-bcc5-fbe52729e404 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:02.584501 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7aea45ae-19d4-4e81-bcc5-fbe52729e404 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:31:02.593714 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7aea45ae-19d4-4e81-bcc5-fbe52729e404 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04" status: 200 len: 1721 microversion: 2.1 time: 0.160745 Oct 27 04:31:02.594577 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3968/7642] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:31:02 2022] GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:31:03.618408 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8ae9cfe5-754d-436b-b81b-562786d05a26 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:31:03.619035 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8ae9cfe5-754d-436b-b81b-562786d05a26 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: a2295c49-094c-4d51-88a5-9ae18aa17b04] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:31:03.625908 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8ae9cfe5-754d-436b-b81b-562786d05a26 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:03.626434 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8ae9cfe5-754d-436b-b81b-562786d05a26 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:03.626881 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8ae9cfe5-754d-436b-b81b-562786d05a26 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:03.627586 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8ae9cfe5-754d-436b-b81b-562786d05a26 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:03.628052 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8ae9cfe5-754d-436b-b81b-562786d05a26 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:03.628488 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8ae9cfe5-754d-436b-b81b-562786d05a26 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:03.760877 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8ae9cfe5-754d-436b-b81b-562786d05a26 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:31:03.769076 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8ae9cfe5-754d-436b-b81b-562786d05a26 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04" status: 200 len: 1721 microversion: 2.1 time: 0.155203 Oct 27 04:31:03.769655 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3675/7643] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:31:03 2022] GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:31:04.791935 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-09141f49-d4dd-46a1-8329-3dac844036f8 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:31:04.792582 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-09141f49-d4dd-46a1-8329-3dac844036f8 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: a2295c49-094c-4d51-88a5-9ae18aa17b04] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:31:04.799466 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-09141f49-d4dd-46a1-8329-3dac844036f8 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:04.799968 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-09141f49-d4dd-46a1-8329-3dac844036f8 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:04.800425 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-09141f49-d4dd-46a1-8329-3dac844036f8 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:04.801168 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-09141f49-d4dd-46a1-8329-3dac844036f8 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:04.801647 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-09141f49-d4dd-46a1-8329-3dac844036f8 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:04.802119 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-09141f49-d4dd-46a1-8329-3dac844036f8 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:04.932185 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-09141f49-d4dd-46a1-8329-3dac844036f8 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:31:04.940662 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-09141f49-d4dd-46a1-8329-3dac844036f8 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04" status: 200 len: 1721 microversion: 2.1 time: 0.152780 Oct 27 04:31:04.941242 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3969/7644] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:31:04 2022] GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:31:05.964087 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f0973cac-a3e5-4fc9-8e7e-e8e1a7293a27 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:31:05.964710 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f0973cac-a3e5-4fc9-8e7e-e8e1a7293a27 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: a2295c49-094c-4d51-88a5-9ae18aa17b04] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:31:05.972054 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f0973cac-a3e5-4fc9-8e7e-e8e1a7293a27 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:05.972553 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f0973cac-a3e5-4fc9-8e7e-e8e1a7293a27 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:05.973000 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f0973cac-a3e5-4fc9-8e7e-e8e1a7293a27 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:05.973707 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f0973cac-a3e5-4fc9-8e7e-e8e1a7293a27 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:05.974202 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f0973cac-a3e5-4fc9-8e7e-e8e1a7293a27 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:05.974641 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f0973cac-a3e5-4fc9-8e7e-e8e1a7293a27 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:06.105336 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f0973cac-a3e5-4fc9-8e7e-e8e1a7293a27 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:31:06.113614 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f0973cac-a3e5-4fc9-8e7e-e8e1a7293a27 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04" status: 200 len: 1714 microversion: 2.1 time: 0.153552 Oct 27 04:31:06.114223 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3676/7645] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:31:05 2022] GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04 => generated 1714 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:31:06.137084 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-298df653-9afa-4bcc-ad3e-15447a6a682d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:31:06.137763 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-298df653-9afa-4bcc-ad3e-15447a6a682d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: a2295c49-094c-4d51-88a5-9ae18aa17b04] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:31:06.144848 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-298df653-9afa-4bcc-ad3e-15447a6a682d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:06.145359 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-298df653-9afa-4bcc-ad3e-15447a6a682d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:06.145822 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-298df653-9afa-4bcc-ad3e-15447a6a682d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:06.146582 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-298df653-9afa-4bcc-ad3e-15447a6a682d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:06.147063 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-298df653-9afa-4bcc-ad3e-15447a6a682d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:06.147522 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-298df653-9afa-4bcc-ad3e-15447a6a682d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:06.151590 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:31:06.280846 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-298df653-9afa-4bcc-ad3e-15447a6a682d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:31:06.289786 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-298df653-9afa-4bcc-ad3e-15447a6a682d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04" status: 200 len: 1714 microversion: 2.1 time: 0.156611 Oct 27 04:31:06.290409 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3970/7646] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:31:06 2022] GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04 => generated 1714 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:31:06.312569 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-abeb160e-4caf-4220-b1e4-c522a37d3dd9 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:31:06.313126 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-abeb160e-4caf-4220-b1e4-c522a37d3dd9 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: a2295c49-094c-4d51-88a5-9ae18aa17b04] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:31:06.318977 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-abeb160e-4caf-4220-b1e4-c522a37d3dd9 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:06.319493 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-abeb160e-4caf-4220-b1e4-c522a37d3dd9 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:06.319936 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-abeb160e-4caf-4220-b1e4-c522a37d3dd9 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:06.320631 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-abeb160e-4caf-4220-b1e4-c522a37d3dd9 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:06.321093 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-abeb160e-4caf-4220-b1e4-c522a37d3dd9 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:06.321527 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-abeb160e-4caf-4220-b1e4-c522a37d3dd9 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:06.455336 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-abeb160e-4caf-4220-b1e4-c522a37d3dd9 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:31:06.464116 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-abeb160e-4caf-4220-b1e4-c522a37d3dd9 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04" status: 200 len: 1714 microversion: 2.1 time: 0.155489 Oct 27 04:31:06.464700 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3677/7647] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:31:06 2022] GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04 => generated 1714 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:31:06.487314 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-cba97e3a-01e9-4273-a5d0-43677cfb2790 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:31:06.487830 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-cba97e3a-01e9-4273-a5d0-43677cfb2790 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: a2295c49-094c-4d51-88a5-9ae18aa17b04] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:31:06.493760 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cba97e3a-01e9-4273-a5d0-43677cfb2790 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:06.494299 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cba97e3a-01e9-4273-a5d0-43677cfb2790 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:06.494764 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cba97e3a-01e9-4273-a5d0-43677cfb2790 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:06.495470 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cba97e3a-01e9-4273-a5d0-43677cfb2790 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:06.495950 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cba97e3a-01e9-4273-a5d0-43677cfb2790 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:06.496395 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cba97e3a-01e9-4273-a5d0-43677cfb2790 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:06.526528 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-cba97e3a-01e9-4273-a5d0-43677cfb2790 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: a2295c49-094c-4d51-88a5-9ae18aa17b04] Going to try to terminate instance {{(pid=121001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 04:31:06.854373 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-cba97e3a-01e9-4273-a5d0-43677cfb2790 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04" status: 204 len: 0 microversion: 2.1 time: 0.370534 Oct 27 04:31:06.854906 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3971/7648] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 04:31:06 2022] DELETE /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 04:31:06.863463 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0902ab9d-e7f0-42c6-850e-27ec509604f6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:31:06.864082 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0902ab9d-e7f0-42c6-850e-27ec509604f6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: a2295c49-094c-4d51-88a5-9ae18aa17b04] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:31:06.870019 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0902ab9d-e7f0-42c6-850e-27ec509604f6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:06.870523 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0902ab9d-e7f0-42c6-850e-27ec509604f6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:06.870964 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0902ab9d-e7f0-42c6-850e-27ec509604f6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:06.871664 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0902ab9d-e7f0-42c6-850e-27ec509604f6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:06.872125 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0902ab9d-e7f0-42c6-850e-27ec509604f6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:06.872556 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0902ab9d-e7f0-42c6-850e-27ec509604f6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:07.005765 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0902ab9d-e7f0-42c6-850e-27ec509604f6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:31:07.014627 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0902ab9d-e7f0-42c6-850e-27ec509604f6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04" status: 200 len: 1720 microversion: 2.1 time: 0.155185 Oct 27 04:31:07.015210 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3678/7649] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:31:06 2022] GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:31:07.402565 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-1f7b3e28-103a-47ca-ae96-b492a69f1f57 req-039ef6ad-5439-4cfa-b70f-cd4762d9fa03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2295c49-094c-4d51-88a5-9ae18aa17b04", "name": "network-vif-plugged", "status": "completed", "tag": "975121d1-b03a-45d5-8a8b-3e8ad3eba408"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:31:07.412893 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-1f7b3e28-103a-47ca-ae96-b492a69f1f57 req-039ef6ad-5439-4cfa-b70f-cd4762d9fa03 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:07.413416 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-1f7b3e28-103a-47ca-ae96-b492a69f1f57 req-039ef6ad-5439-4cfa-b70f-cd4762d9fa03 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:07.414000 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-1f7b3e28-103a-47ca-ae96-b492a69f1f57 req-039ef6ad-5439-4cfa-b70f-cd4762d9fa03 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:07.425318 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-1f7b3e28-103a-47ca-ae96-b492a69f1f57 req-039ef6ad-5439-4cfa-b70f-cd4762d9fa03 service nova] Creating event network-vif-plugged:975121d1-b03a-45d5-8a8b-3e8ad3eba408 for instance a2295c49-094c-4d51-88a5-9ae18aa17b04 on n-h1-862769-1 Oct 27 04:31:07.431143 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-1f7b3e28-103a-47ca-ae96-b492a69f1f57 req-039ef6ad-5439-4cfa-b70f-cd4762d9fa03 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032752 Oct 27 04:31:07.434433 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3972/7650] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:31:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:31:08.039692 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-83ea9afc-c79b-42e7-ab99-5fe234732a27 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:31:08.040313 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-83ea9afc-c79b-42e7-ab99-5fe234732a27 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: a2295c49-094c-4d51-88a5-9ae18aa17b04] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:31:08.043075 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=32 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:31:08.047743 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-83ea9afc-c79b-42e7-ab99-5fe234732a27 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:08.048237 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-83ea9afc-c79b-42e7-ab99-5fe234732a27 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:08.048686 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-83ea9afc-c79b-42e7-ab99-5fe234732a27 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:08.049392 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-83ea9afc-c79b-42e7-ab99-5fe234732a27 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:08.049853 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-83ea9afc-c79b-42e7-ab99-5fe234732a27 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:08.050316 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-83ea9afc-c79b-42e7-ab99-5fe234732a27 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:08.184200 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-83ea9afc-c79b-42e7-ab99-5fe234732a27 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:31:08.195960 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-83ea9afc-c79b-42e7-ab99-5fe234732a27 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04" status: 200 len: 1720 microversion: 2.1 time: 0.159221 Oct 27 04:31:08.195960 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3679/7651] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:31:08 2022] GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04 => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:31:09.226370 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-52596a98-9471-4a45-9f47-b81827252777 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:31:09.227035 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-52596a98-9471-4a45-9f47-b81827252777 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: a2295c49-094c-4d51-88a5-9ae18aa17b04] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:31:09.230695 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:31:09.237113 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-52596a98-9471-4a45-9f47-b81827252777 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:09.242424 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-52596a98-9471-4a45-9f47-b81827252777 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:09.242424 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-52596a98-9471-4a45-9f47-b81827252777 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:09.242424 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-52596a98-9471-4a45-9f47-b81827252777 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:09.242424 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-52596a98-9471-4a45-9f47-b81827252777 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:09.242424 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-52596a98-9471-4a45-9f47-b81827252777 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:09.328524 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-52596a98-9471-4a45-9f47-b81827252777 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:31:09.337565 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-52596a98-9471-4a45-9f47-b81827252777 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04" status: 200 len: 1653 microversion: 2.1 time: 0.116060 Oct 27 04:31:09.338379 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3973/7652] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:31:09 2022] GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04 => generated 1653 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:31:09.821622 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-274fed46-9c24-41c9-a079-fa4c96671def req-6cdfc7f0-02ba-4153-97f7-eb04503e53c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2295c49-094c-4d51-88a5-9ae18aa17b04", "name": "network-vif-deleted", "tag": "975121d1-b03a-45d5-8a8b-3e8ad3eba408"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:31:09.832218 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-274fed46-9c24-41c9-a079-fa4c96671def req-6cdfc7f0-02ba-4153-97f7-eb04503e53c6 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:09.832701 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-274fed46-9c24-41c9-a079-fa4c96671def req-6cdfc7f0-02ba-4153-97f7-eb04503e53c6 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:09.833172 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-274fed46-9c24-41c9-a079-fa4c96671def req-6cdfc7f0-02ba-4153-97f7-eb04503e53c6 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:09.845361 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-274fed46-9c24-41c9-a079-fa4c96671def req-6cdfc7f0-02ba-4153-97f7-eb04503e53c6 service nova] Creating event network-vif-deleted:975121d1-b03a-45d5-8a8b-3e8ad3eba408 for instance a2295c49-094c-4d51-88a5-9ae18aa17b04 on n-h1-862769-1 Oct 27 04:31:09.851040 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-274fed46-9c24-41c9-a079-fa4c96671def req-6cdfc7f0-02ba-4153-97f7-eb04503e53c6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035668 Oct 27 04:31:09.851824 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3680/7653] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:31:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:31:10.362416 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-277a29f4-0268-47da-a91a-38fefe04b2ae tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:31:10.363150 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-277a29f4-0268-47da-a91a-38fefe04b2ae tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: a2295c49-094c-4d51-88a5-9ae18aa17b04] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:31:10.371067 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-277a29f4-0268-47da-a91a-38fefe04b2ae tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:10.371660 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-277a29f4-0268-47da-a91a-38fefe04b2ae tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:10.372307 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-277a29f4-0268-47da-a91a-38fefe04b2ae tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:10.373037 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-277a29f4-0268-47da-a91a-38fefe04b2ae tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:10.373682 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-277a29f4-0268-47da-a91a-38fefe04b2ae tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:10.374157 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-277a29f4-0268-47da-a91a-38fefe04b2ae tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:10.448723 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-277a29f4-0268-47da-a91a-38fefe04b2ae tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:31:10.457480 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-277a29f4-0268-47da-a91a-38fefe04b2ae tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04" status: 200 len: 1368 microversion: 2.1 time: 0.099159 Oct 27 04:31:10.459425 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3974/7654] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:31:10 2022] GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04 => generated 1368 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:31:11.481360 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-48491909-7aad-492b-b907-abb4e0324568 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:31:11.482098 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-48491909-7aad-492b-b907-abb4e0324568 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: a2295c49-094c-4d51-88a5-9ae18aa17b04] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:31:11.489151 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-48491909-7aad-492b-b907-abb4e0324568 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:11.489647 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-48491909-7aad-492b-b907-abb4e0324568 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:11.490113 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-48491909-7aad-492b-b907-abb4e0324568 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:11.490820 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-48491909-7aad-492b-b907-abb4e0324568 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:11.491285 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-48491909-7aad-492b-b907-abb4e0324568 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:11.491717 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-48491909-7aad-492b-b907-abb4e0324568 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:11.494358 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=96 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:31:11.555515 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-48491909-7aad-492b-b907-abb4e0324568 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:31:11.564357 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-48491909-7aad-492b-b907-abb4e0324568 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04" status: 200 len: 1368 microversion: 2.1 time: 0.087171 Oct 27 04:31:11.564954 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3681/7655] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:31:11 2022] GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:31:12.588684 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-03dbaaef-dfec-40cf-ab86-6c2e86f7b3a6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:31:12.589323 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-03dbaaef-dfec-40cf-ab86-6c2e86f7b3a6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: a2295c49-094c-4d51-88a5-9ae18aa17b04] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:31:12.596649 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-03dbaaef-dfec-40cf-ab86-6c2e86f7b3a6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:12.597155 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-03dbaaef-dfec-40cf-ab86-6c2e86f7b3a6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:12.597608 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-03dbaaef-dfec-40cf-ab86-6c2e86f7b3a6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:12.598350 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-03dbaaef-dfec-40cf-ab86-6c2e86f7b3a6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:12.598824 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-03dbaaef-dfec-40cf-ab86-6c2e86f7b3a6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:12.599268 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-03dbaaef-dfec-40cf-ab86-6c2e86f7b3a6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:12.660792 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-03dbaaef-dfec-40cf-ab86-6c2e86f7b3a6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:31:12.669164 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-03dbaaef-dfec-40cf-ab86-6c2e86f7b3a6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04" status: 200 len: 1368 microversion: 2.1 time: 0.084518 Oct 27 04:31:12.669735 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3975/7656] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:31:12 2022] GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:31:13.693469 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f54d2f09-a2e8-4697-836b-1a0a78b1681c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:31:13.694115 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f54d2f09-a2e8-4697-836b-1a0a78b1681c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: a2295c49-094c-4d51-88a5-9ae18aa17b04] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:31:13.701602 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f54d2f09-a2e8-4697-836b-1a0a78b1681c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:13.708093 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f54d2f09-a2e8-4697-836b-1a0a78b1681c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:13.708093 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f54d2f09-a2e8-4697-836b-1a0a78b1681c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:13.708093 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f54d2f09-a2e8-4697-836b-1a0a78b1681c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:13.708093 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f54d2f09-a2e8-4697-836b-1a0a78b1681c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:13.708093 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f54d2f09-a2e8-4697-836b-1a0a78b1681c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:13.767077 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f54d2f09-a2e8-4697-836b-1a0a78b1681c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:31:13.776250 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f54d2f09-a2e8-4697-836b-1a0a78b1681c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04" status: 200 len: 1368 microversion: 2.1 time: 0.086763 Oct 27 04:31:13.776944 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3682/7657] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:31:13 2022] GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:31:14.799441 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-eeb221dc-ff53-4eb9-8a13-9994e956716b tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:31:14.800104 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-eeb221dc-ff53-4eb9-8a13-9994e956716b tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: a2295c49-094c-4d51-88a5-9ae18aa17b04] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:31:14.807331 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eeb221dc-ff53-4eb9-8a13-9994e956716b tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:14.807851 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eeb221dc-ff53-4eb9-8a13-9994e956716b tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:14.808321 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eeb221dc-ff53-4eb9-8a13-9994e956716b tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:14.809129 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eeb221dc-ff53-4eb9-8a13-9994e956716b tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:14.809624 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eeb221dc-ff53-4eb9-8a13-9994e956716b tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:14.810112 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eeb221dc-ff53-4eb9-8a13-9994e956716b tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:14.843573 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eeb221dc-ff53-4eb9-8a13-9994e956716b tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:14.844359 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eeb221dc-ff53-4eb9-8a13-9994e956716b tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:14.844832 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-eeb221dc-ff53-4eb9-8a13-9994e956716b tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:14.845379 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-eeb221dc-ff53-4eb9-8a13-9994e956716b tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lazy-loading 'fault' on Instance uuid a2295c49-094c-4d51-88a5-9ae18aa17b04 {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 04:31:14.890005 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-eeb221dc-ff53-4eb9-8a13-9994e956716b tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197669776fde4a6480f6cab6e5c8552f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ab4a5a66947aebb3f09a9842e5c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:31:14.899207 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-eeb221dc-ff53-4eb9-8a13-9994e956716b tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04" status: 200 len: 1373 microversion: 2.1 time: 0.103741 Oct 27 04:31:14.900115 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3976/7658] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:31:14 2022] GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04 => generated 1373 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:31:15.923783 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8e7f4fba-37ec-4e30-90a9-90a1a6a0892d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:31:15.924408 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8e7f4fba-37ec-4e30-90a9-90a1a6a0892d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: a2295c49-094c-4d51-88a5-9ae18aa17b04] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:31:15.931924 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8e7f4fba-37ec-4e30-90a9-90a1a6a0892d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:15.932477 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8e7f4fba-37ec-4e30-90a9-90a1a6a0892d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:15.932885 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8e7f4fba-37ec-4e30-90a9-90a1a6a0892d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:15.933589 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8e7f4fba-37ec-4e30-90a9-90a1a6a0892d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:15.934070 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8e7f4fba-37ec-4e30-90a9-90a1a6a0892d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:15.934513 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8e7f4fba-37ec-4e30-90a9-90a1a6a0892d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:15.947822 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-8e7f4fba-37ec-4e30-90a9-90a1a6a0892d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] HTTP exception thrown: Instance a2295c49-094c-4d51-88a5-9ae18aa17b04 could not be found. Oct 27 04:31:15.949413 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8e7f4fba-37ec-4e30-90a9-90a1a6a0892d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Request method failure captured: Oct 27 04:31:15.949413 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04 HTTP/1.1 Oct 27 04:31:15.949413 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 04:31:15.949413 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 04:31:15.949413 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 04:31:15.949413 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 04:31:15.949413 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 04:31:15.949413 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 04:31:15.949413 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 04:31:15.949413 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 04:31:15.949413 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWggT1pShQ7YBK6vLEnUn4ThZkZHCmWwxudcjcX6Q_Qzyxxu4Tv9k9Mz8NdF1J-CqoCxrwqSYjXa2e5qz-_PVvAMi6WsvOj7WQPQINruTawh_9Huu8QwtjT2xusIZMY0glj9dlYg_3F0cuyrDKuyyLc3oA_TbX8qtqDNM9W1LEjJuGfY Oct 27 04:31:15.949413 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 04:31:15.949413 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 04:31:15.949413 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 04:31:15.949413 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 04:31:15.949413 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 04:31:15.949413 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 04:31:15.949413 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 529ab4a5a66947aebb3f09a9842e5c9f Oct 27 04:31:15.949413 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ServerActionsTestJSON-403049074 Oct 27 04:31:15.949413 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 04:31:15.949413 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 04:31:15.949413 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/529ab4a5a66947aebb3f09a9842e5c9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/529ab4a5a66947aebb3f09a9842e5c9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/529ab4a5a66947aebb3f09a9842e5c9f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_529ab4a5a66947aebb3f09a9842e5c9f"}]}] Oct 27 04:31:15.949413 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ServerActionsTestJSON-403049074 Oct 27 04:31:15.949413 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 529ab4a5a66947aebb3f09a9842e5c9f Oct 27 04:31:15.949413 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ServerActionsTestJSON-403049074 Oct 27 04:31:15.949413 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ServerActionsTestJSON-403049074-project Oct 27 04:31:15.949413 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 04:31:15.949413 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 04:31:15.949413 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 197669776fde4a6480f6cab6e5c8552f Oct 27 04:31:15.949413 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ServerActionsTestJSON-403049074-project Oct 27 04:31:15.949413 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 04:31:15.949413 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance a2295c49-094c-4d51-88a5-9ae18aa17b04 could not be found. Oct 27 04:31:15.949413 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': 'a2295c49-094c-4d51-88a5-9ae18aa17b04'} Oct 27 04:31:15.949413 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 04:31:15.949413 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:31:15.949413 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 04:31:15.949413 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 04:31:15.949413 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 04:31:15.949413 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 04:31:15.949413 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 04:31:15.949413 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 04:31:15.949413 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 04:31:15.949413 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 04:31:15.949413 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2295c49-094c-4d51-88a5-9ae18aa17b04 could not be found. Oct 27 04:31:15.949413 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:31:15.949413 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:31:15.949413 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:31:15.949413 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:31:15.949413 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:31:15.949413 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:31:15.949413 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 04:31:15.949413 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 04:31:15.949413 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 04:31:15.949413 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 04:31:15.949413 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 04:31:15.949413 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 04:31:15.949413 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 04:31:15.949413 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 04:31:15.949413 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 04:31:15.949413 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 04:31:15.949413 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2295c49-094c-4d51-88a5-9ae18aa17b04 could not be found. Oct 27 04:31:15.949413 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:31:15.949413 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:31:15.949413 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:31:15.954703 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:31:15.954703 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:31:15.954703 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:31:15.954703 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 04:31:15.954703 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 04:31:15.954703 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2295c49-094c-4d51-88a5-9ae18aa17b04 could not be found. Oct 27 04:31:15.954703 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:31:15.954703 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8e7f4fba-37ec-4e30-90a9-90a1a6a0892d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Returning 404 to user: Instance a2295c49-094c-4d51-88a5-9ae18aa17b04 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 04:31:15.954703 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8e7f4fba-37ec-4e30-90a9-90a1a6a0892d tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04" status: 404 len: 111 microversion: 2.1 time: 0.030992 Oct 27 04:31:15.954703 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3683/7659] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:31:15 2022] GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 04:31:16.012605 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ef9f8b00-d0a5-404a-9ed5-86406f3ca110 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:31:16.016586 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ef9f8b00-d0a5-404a-9ed5-86406f3ca110 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: a2295c49-094c-4d51-88a5-9ae18aa17b04] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:31:16.021953 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ef9f8b00-d0a5-404a-9ed5-86406f3ca110 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:16.022507 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ef9f8b00-d0a5-404a-9ed5-86406f3ca110 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:16.022981 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ef9f8b00-d0a5-404a-9ed5-86406f3ca110 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:16.023706 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ef9f8b00-d0a5-404a-9ed5-86406f3ca110 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:16.024188 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ef9f8b00-d0a5-404a-9ed5-86406f3ca110 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:16.024683 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ef9f8b00-d0a5-404a-9ed5-86406f3ca110 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:16.037705 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-ef9f8b00-d0a5-404a-9ed5-86406f3ca110 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] HTTP exception thrown: Instance a2295c49-094c-4d51-88a5-9ae18aa17b04 could not be found. Oct 27 04:31:16.040014 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ef9f8b00-d0a5-404a-9ed5-86406f3ca110 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Request method failure captured: Oct 27 04:31:16.040014 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04/os-volume_attachments HTTP/1.1 Oct 27 04:31:16.040014 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 04:31:16.040014 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 04:31:16.040014 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 04:31:16.040014 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 04:31:16.040014 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 04:31:16.040014 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 04:31:16.040014 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 04:31:16.040014 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 04:31:16.040014 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWggT1pShQ7YBK6vLEnUn4ThZkZHCmWwxudcjcX6Q_Qzyxxu4Tv9k9Mz8NdF1J-CqoCxrwqSYjXa2e5qz-_PVvAMi6WsvOj7WQPQINruTawh_9Huu8QwtjT2xusIZMY0glj9dlYg_3F0cuyrDKuyyLc3oA_TbX8qtqDNM9W1LEjJuGfY Oct 27 04:31:16.040014 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 04:31:16.040014 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 04:31:16.040014 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 04:31:16.040014 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 04:31:16.040014 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 04:31:16.040014 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 04:31:16.040014 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 529ab4a5a66947aebb3f09a9842e5c9f Oct 27 04:31:16.040014 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServerActionsTestJSON-403049074 Oct 27 04:31:16.040014 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 04:31:16.040014 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 04:31:16.040014 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/529ab4a5a66947aebb3f09a9842e5c9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/529ab4a5a66947aebb3f09a9842e5c9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/529ab4a5a66947aebb3f09a9842e5c9f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_529ab4a5a66947aebb3f09a9842e5c9f"}]}] Oct 27 04:31:16.040014 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServerActionsTestJSON-403049074 Oct 27 04:31:16.040014 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 529ab4a5a66947aebb3f09a9842e5c9f Oct 27 04:31:16.040014 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServerActionsTestJSON-403049074 Oct 27 04:31:16.040014 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServerActionsTestJSON-403049074-project Oct 27 04:31:16.040014 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 04:31:16.040014 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 04:31:16.040014 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 197669776fde4a6480f6cab6e5c8552f Oct 27 04:31:16.040014 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServerActionsTestJSON-403049074-project Oct 27 04:31:16.040014 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 04:31:16.040014 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance a2295c49-094c-4d51-88a5-9ae18aa17b04 could not be found. Oct 27 04:31:16.040014 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'server_id': 'a2295c49-094c-4d51-88a5-9ae18aa17b04'} Oct 27 04:31:16.040014 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 04:31:16.040014 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:31:16.040014 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 04:31:16.040014 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 04:31:16.040014 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 04:31:16.040014 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 04:31:16.040014 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 04:31:16.040014 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 04:31:16.040014 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 04:31:16.040014 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 04:31:16.040014 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2295c49-094c-4d51-88a5-9ae18aa17b04 could not be found. Oct 27 04:31:16.040014 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:31:16.040014 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:31:16.040014 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:31:16.040014 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:31:16.040014 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:31:16.040014 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:31:16.040014 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 04:31:16.040014 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 04:31:16.040014 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 04:31:16.040014 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 04:31:16.040014 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 04:31:16.040014 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 04:31:16.040014 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 04:31:16.040014 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 04:31:16.040014 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 27 04:31:16.040014 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 27 04:31:16.040014 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 04:31:16.040014 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 04:31:16.050153 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2295c49-094c-4d51-88a5-9ae18aa17b04 could not be found. Oct 27 04:31:16.050153 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:31:16.050153 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:31:16.050153 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:31:16.050153 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:31:16.050153 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:31:16.050153 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:31:16.050153 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 04:31:16.050153 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 04:31:16.050153 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2295c49-094c-4d51-88a5-9ae18aa17b04 could not be found. Oct 27 04:31:16.050153 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:31:16.050153 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ef9f8b00-d0a5-404a-9ed5-86406f3ca110 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Returning 404 to user: Instance a2295c49-094c-4d51-88a5-9ae18aa17b04 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 04:31:16.050153 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ef9f8b00-d0a5-404a-9ed5-86406f3ca110 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032990 Oct 27 04:31:16.050153 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3977/7660] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 27 04:31:16 2022] GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 04:31:19.471229 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-288ef12f-7c90-43d4-802b-e8062045d7b6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:31:19.471833 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-288ef12f-7c90-43d4-802b-e8062045d7b6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: a2295c49-094c-4d51-88a5-9ae18aa17b04] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:31:19.479561 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-288ef12f-7c90-43d4-802b-e8062045d7b6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:19.480127 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-288ef12f-7c90-43d4-802b-e8062045d7b6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:19.480667 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-288ef12f-7c90-43d4-802b-e8062045d7b6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:19.481437 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-288ef12f-7c90-43d4-802b-e8062045d7b6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:19.481973 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-288ef12f-7c90-43d4-802b-e8062045d7b6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:19.482505 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-288ef12f-7c90-43d4-802b-e8062045d7b6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:19.495989 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-288ef12f-7c90-43d4-802b-e8062045d7b6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] HTTP exception thrown: Instance a2295c49-094c-4d51-88a5-9ae18aa17b04 could not be found. Oct 27 04:31:19.497568 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-288ef12f-7c90-43d4-802b-e8062045d7b6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Request method failure captured: Oct 27 04:31:19.497568 n-d-862769-1 devstack@n-api.service[121000]: request: DELETE /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04 HTTP/1.1 Oct 27 04:31:19.497568 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 04:31:19.497568 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 04:31:19.497568 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 04:31:19.497568 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 04:31:19.497568 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 04:31:19.497568 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 04:31:19.497568 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 04:31:19.497568 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 04:31:19.497568 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWggT1pShQ7YBK6vLEnUn4ThZkZHCmWwxudcjcX6Q_Qzyxxu4Tv9k9Mz8NdF1J-CqoCxrwqSYjXa2e5qz-_PVvAMi6WsvOj7WQPQINruTawh_9Huu8QwtjT2xusIZMY0glj9dlYg_3F0cuyrDKuyyLc3oA_TbX8qtqDNM9W1LEjJuGfY Oct 27 04:31:19.497568 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 04:31:19.497568 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 04:31:19.497568 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 04:31:19.497568 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 04:31:19.497568 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 04:31:19.497568 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 04:31:19.497568 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 529ab4a5a66947aebb3f09a9842e5c9f Oct 27 04:31:19.497568 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ServerActionsTestJSON-403049074 Oct 27 04:31:19.497568 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 04:31:19.497568 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 04:31:19.497568 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/529ab4a5a66947aebb3f09a9842e5c9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/529ab4a5a66947aebb3f09a9842e5c9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/529ab4a5a66947aebb3f09a9842e5c9f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_529ab4a5a66947aebb3f09a9842e5c9f"}]}] Oct 27 04:31:19.497568 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ServerActionsTestJSON-403049074 Oct 27 04:31:19.497568 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 529ab4a5a66947aebb3f09a9842e5c9f Oct 27 04:31:19.497568 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ServerActionsTestJSON-403049074 Oct 27 04:31:19.497568 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ServerActionsTestJSON-403049074-project Oct 27 04:31:19.497568 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 04:31:19.497568 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 04:31:19.497568 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 197669776fde4a6480f6cab6e5c8552f Oct 27 04:31:19.497568 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ServerActionsTestJSON-403049074-project Oct 27 04:31:19.497568 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 04:31:19.497568 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance a2295c49-094c-4d51-88a5-9ae18aa17b04 could not be found. Oct 27 04:31:19.497568 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': 'a2295c49-094c-4d51-88a5-9ae18aa17b04'} Oct 27 04:31:19.497568 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 04:31:19.497568 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:31:19.497568 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 04:31:19.497568 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 04:31:19.497568 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 04:31:19.497568 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 04:31:19.497568 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 04:31:19.497568 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 04:31:19.497568 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 04:31:19.497568 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 04:31:19.497568 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2295c49-094c-4d51-88a5-9ae18aa17b04 could not be found. Oct 27 04:31:19.497568 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:31:19.497568 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:31:19.497568 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:31:19.497568 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:31:19.497568 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:31:19.497568 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:31:19.497568 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 04:31:19.497568 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 04:31:19.497568 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 04:31:19.497568 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 04:31:19.497568 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 04:31:19.497568 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 04:31:19.497568 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 04:31:19.497568 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 04:31:19.497568 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 04:31:19.497568 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 04:31:19.497568 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 04:31:19.497568 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 04:31:19.502503 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2295c49-094c-4d51-88a5-9ae18aa17b04 could not be found. Oct 27 04:31:19.502503 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:31:19.502503 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:31:19.502503 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:31:19.502503 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:31:19.502503 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:31:19.502503 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:31:19.502503 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 04:31:19.502503 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 04:31:19.502503 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2295c49-094c-4d51-88a5-9ae18aa17b04 could not be found. Oct 27 04:31:19.502503 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:31:19.502503 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-288ef12f-7c90-43d4-802b-e8062045d7b6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Returning 404 to user: Instance a2295c49-094c-4d51-88a5-9ae18aa17b04 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 04:31:19.502503 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-288ef12f-7c90-43d4-802b-e8062045d7b6 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04" status: 404 len: 111 microversion: 2.1 time: 0.031993 Oct 27 04:31:19.502503 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3684/7661] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 04:31:19 2022] DELETE /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 04:31:19.507533 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-187d1007-3014-4a89-8f39-1d3a6cd50e2c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:31:19.508470 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-187d1007-3014-4a89-8f39-1d3a6cd50e2c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: a2295c49-094c-4d51-88a5-9ae18aa17b04] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:31:19.515143 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-187d1007-3014-4a89-8f39-1d3a6cd50e2c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:19.515654 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-187d1007-3014-4a89-8f39-1d3a6cd50e2c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:19.516121 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-187d1007-3014-4a89-8f39-1d3a6cd50e2c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:19.516841 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-187d1007-3014-4a89-8f39-1d3a6cd50e2c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:19.517385 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-187d1007-3014-4a89-8f39-1d3a6cd50e2c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:19.517850 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-187d1007-3014-4a89-8f39-1d3a6cd50e2c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:19.535389 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-187d1007-3014-4a89-8f39-1d3a6cd50e2c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] HTTP exception thrown: Instance a2295c49-094c-4d51-88a5-9ae18aa17b04 could not be found. Oct 27 04:31:19.536968 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-187d1007-3014-4a89-8f39-1d3a6cd50e2c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Request method failure captured: Oct 27 04:31:19.536968 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04 HTTP/1.1 Oct 27 04:31:19.536968 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 04:31:19.536968 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 04:31:19.536968 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 04:31:19.536968 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 04:31:19.536968 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 04:31:19.536968 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 04:31:19.536968 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 04:31:19.536968 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 04:31:19.536968 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWggT1pShQ7YBK6vLEnUn4ThZkZHCmWwxudcjcX6Q_Qzyxxu4Tv9k9Mz8NdF1J-CqoCxrwqSYjXa2e5qz-_PVvAMi6WsvOj7WQPQINruTawh_9Huu8QwtjT2xusIZMY0glj9dlYg_3F0cuyrDKuyyLc3oA_TbX8qtqDNM9W1LEjJuGfY Oct 27 04:31:19.536968 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 04:31:19.536968 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 04:31:19.536968 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 04:31:19.536968 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 04:31:19.536968 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 04:31:19.536968 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 04:31:19.536968 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 529ab4a5a66947aebb3f09a9842e5c9f Oct 27 04:31:19.536968 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServerActionsTestJSON-403049074 Oct 27 04:31:19.536968 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 04:31:19.536968 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 04:31:19.536968 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/529ab4a5a66947aebb3f09a9842e5c9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/529ab4a5a66947aebb3f09a9842e5c9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/529ab4a5a66947aebb3f09a9842e5c9f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_529ab4a5a66947aebb3f09a9842e5c9f"}]}] Oct 27 04:31:19.536968 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServerActionsTestJSON-403049074 Oct 27 04:31:19.536968 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 529ab4a5a66947aebb3f09a9842e5c9f Oct 27 04:31:19.536968 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServerActionsTestJSON-403049074 Oct 27 04:31:19.536968 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServerActionsTestJSON-403049074-project Oct 27 04:31:19.536968 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 04:31:19.536968 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 04:31:19.536968 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 197669776fde4a6480f6cab6e5c8552f Oct 27 04:31:19.536968 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServerActionsTestJSON-403049074-project Oct 27 04:31:19.536968 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 04:31:19.536968 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance a2295c49-094c-4d51-88a5-9ae18aa17b04 could not be found. Oct 27 04:31:19.536968 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': 'a2295c49-094c-4d51-88a5-9ae18aa17b04'} Oct 27 04:31:19.536968 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 04:31:19.536968 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:31:19.536968 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 04:31:19.536968 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 04:31:19.536968 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 04:31:19.536968 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 04:31:19.536968 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 04:31:19.536968 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 04:31:19.536968 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 04:31:19.536968 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 04:31:19.536968 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2295c49-094c-4d51-88a5-9ae18aa17b04 could not be found. Oct 27 04:31:19.536968 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:31:19.536968 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:31:19.536968 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:31:19.536968 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:31:19.536968 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:31:19.536968 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:31:19.536968 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 04:31:19.536968 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 04:31:19.536968 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 04:31:19.536968 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 04:31:19.536968 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 04:31:19.536968 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 04:31:19.536968 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 04:31:19.536968 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 04:31:19.536968 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 04:31:19.536968 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 04:31:19.536968 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2295c49-094c-4d51-88a5-9ae18aa17b04 could not be found. Oct 27 04:31:19.536968 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:31:19.536968 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:31:19.536968 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:31:19.542854 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:31:19.542854 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:31:19.542854 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:31:19.542854 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 04:31:19.542854 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 04:31:19.542854 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2295c49-094c-4d51-88a5-9ae18aa17b04 could not be found. Oct 27 04:31:19.542854 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:31:19.542854 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-187d1007-3014-4a89-8f39-1d3a6cd50e2c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Returning 404 to user: Instance a2295c49-094c-4d51-88a5-9ae18aa17b04 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 04:31:19.542854 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-187d1007-3014-4a89-8f39-1d3a6cd50e2c tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04" status: 404 len: 111 microversion: 2.1 time: 0.035586 Oct 27 04:31:19.546836 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3978/7662] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:31:19 2022] GET /compute/v2.1/servers/a2295c49-094c-4d51-88a5-9ae18aa17b04 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 04:31:19.548948 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-86bb2882-9106-4912-840f-b59d6becf065 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:31:19.549459 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-86bb2882-9106-4912-840f-b59d6becf065 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 87631277-ef7c-4f32-ad28-b4be5c3314f7] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:31:19.555388 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-86bb2882-9106-4912-840f-b59d6becf065 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:19.555878 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-86bb2882-9106-4912-840f-b59d6becf065 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:19.556316 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-86bb2882-9106-4912-840f-b59d6becf065 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:19.557012 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-86bb2882-9106-4912-840f-b59d6becf065 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:19.557498 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-86bb2882-9106-4912-840f-b59d6becf065 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:19.557927 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-86bb2882-9106-4912-840f-b59d6becf065 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:19.571920 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-86bb2882-9106-4912-840f-b59d6becf065 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] HTTP exception thrown: Instance 87631277-ef7c-4f32-ad28-b4be5c3314f7 could not be found. Oct 27 04:31:19.573451 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-86bb2882-9106-4912-840f-b59d6becf065 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Request method failure captured: Oct 27 04:31:19.573451 n-d-862769-1 devstack@n-api.service[121000]: request: DELETE /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7 HTTP/1.1 Oct 27 04:31:19.573451 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 04:31:19.573451 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 04:31:19.573451 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 04:31:19.573451 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 04:31:19.573451 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 04:31:19.573451 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 04:31:19.573451 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 04:31:19.573451 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 04:31:19.573451 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWggT1pShQ7YBK6vLEnUn4ThZkZHCmWwxudcjcX6Q_Qzyxxu4Tv9k9Mz8NdF1J-CqoCxrwqSYjXa2e5qz-_PVvAMi6WsvOj7WQPQINruTawh_9Huu8QwtjT2xusIZMY0glj9dlYg_3F0cuyrDKuyyLc3oA_TbX8qtqDNM9W1LEjJuGfY Oct 27 04:31:19.573451 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 04:31:19.573451 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 04:31:19.573451 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 04:31:19.573451 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 04:31:19.573451 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 04:31:19.573451 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 04:31:19.573451 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 529ab4a5a66947aebb3f09a9842e5c9f Oct 27 04:31:19.573451 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ServerActionsTestJSON-403049074 Oct 27 04:31:19.573451 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 04:31:19.573451 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 04:31:19.573451 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/529ab4a5a66947aebb3f09a9842e5c9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/529ab4a5a66947aebb3f09a9842e5c9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/529ab4a5a66947aebb3f09a9842e5c9f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_529ab4a5a66947aebb3f09a9842e5c9f"}]}] Oct 27 04:31:19.573451 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ServerActionsTestJSON-403049074 Oct 27 04:31:19.573451 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 529ab4a5a66947aebb3f09a9842e5c9f Oct 27 04:31:19.573451 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ServerActionsTestJSON-403049074 Oct 27 04:31:19.573451 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ServerActionsTestJSON-403049074-project Oct 27 04:31:19.573451 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 04:31:19.573451 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 04:31:19.573451 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 197669776fde4a6480f6cab6e5c8552f Oct 27 04:31:19.573451 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ServerActionsTestJSON-403049074-project Oct 27 04:31:19.573451 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 04:31:19.573451 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 87631277-ef7c-4f32-ad28-b4be5c3314f7 could not be found. Oct 27 04:31:19.573451 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '87631277-ef7c-4f32-ad28-b4be5c3314f7'} Oct 27 04:31:19.573451 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 04:31:19.573451 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:31:19.573451 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 04:31:19.573451 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 04:31:19.573451 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 04:31:19.573451 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 04:31:19.573451 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 04:31:19.573451 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 04:31:19.573451 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 04:31:19.573451 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 04:31:19.573451 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87631277-ef7c-4f32-ad28-b4be5c3314f7 could not be found. Oct 27 04:31:19.573451 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:31:19.573451 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:31:19.573451 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:31:19.573451 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:31:19.573451 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:31:19.573451 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:31:19.573451 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 04:31:19.573451 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 04:31:19.573451 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 04:31:19.573451 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 04:31:19.573451 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 04:31:19.573451 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 04:31:19.573451 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 04:31:19.573451 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 04:31:19.573451 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 04:31:19.573451 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 04:31:19.573451 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 04:31:19.573451 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 04:31:19.578251 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87631277-ef7c-4f32-ad28-b4be5c3314f7 could not be found. Oct 27 04:31:19.578251 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:31:19.578251 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:31:19.578251 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:31:19.578251 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:31:19.578251 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:31:19.578251 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:31:19.578251 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 04:31:19.578251 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 04:31:19.578251 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87631277-ef7c-4f32-ad28-b4be5c3314f7 could not be found. Oct 27 04:31:19.578251 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:31:19.578251 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-86bb2882-9106-4912-840f-b59d6becf065 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Returning 404 to user: Instance 87631277-ef7c-4f32-ad28-b4be5c3314f7 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 04:31:19.578251 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-86bb2882-9106-4912-840f-b59d6becf065 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "DELETE /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7" status: 404 len: 111 microversion: 2.1 time: 0.030790 Oct 27 04:31:19.578251 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3685/7663] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 04:31:19 2022] DELETE /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 04:31:19.583539 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-807b3ccf-0a25-4e9c-b7a7-2711cf79f12e tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:31:19.584178 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-807b3ccf-0a25-4e9c-b7a7-2711cf79f12e tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 87631277-ef7c-4f32-ad28-b4be5c3314f7] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:31:19.590887 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-807b3ccf-0a25-4e9c-b7a7-2711cf79f12e tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:19.591390 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-807b3ccf-0a25-4e9c-b7a7-2711cf79f12e tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:19.591846 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-807b3ccf-0a25-4e9c-b7a7-2711cf79f12e tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:19.592561 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-807b3ccf-0a25-4e9c-b7a7-2711cf79f12e tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:19.593033 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-807b3ccf-0a25-4e9c-b7a7-2711cf79f12e tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:19.593495 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-807b3ccf-0a25-4e9c-b7a7-2711cf79f12e tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:19.607562 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-807b3ccf-0a25-4e9c-b7a7-2711cf79f12e tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] HTTP exception thrown: Instance 87631277-ef7c-4f32-ad28-b4be5c3314f7 could not be found. Oct 27 04:31:19.609167 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-807b3ccf-0a25-4e9c-b7a7-2711cf79f12e tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Request method failure captured: Oct 27 04:31:19.609167 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7 HTTP/1.1 Oct 27 04:31:19.609167 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 04:31:19.609167 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 04:31:19.609167 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 04:31:19.609167 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 04:31:19.609167 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 04:31:19.609167 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 04:31:19.609167 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 04:31:19.609167 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 04:31:19.609167 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWggT1pShQ7YBK6vLEnUn4ThZkZHCmWwxudcjcX6Q_Qzyxxu4Tv9k9Mz8NdF1J-CqoCxrwqSYjXa2e5qz-_PVvAMi6WsvOj7WQPQINruTawh_9Huu8QwtjT2xusIZMY0glj9dlYg_3F0cuyrDKuyyLc3oA_TbX8qtqDNM9W1LEjJuGfY Oct 27 04:31:19.609167 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 04:31:19.609167 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 04:31:19.609167 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 04:31:19.609167 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 04:31:19.609167 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 04:31:19.609167 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 04:31:19.609167 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 529ab4a5a66947aebb3f09a9842e5c9f Oct 27 04:31:19.609167 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServerActionsTestJSON-403049074 Oct 27 04:31:19.609167 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 04:31:19.609167 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 04:31:19.609167 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/529ab4a5a66947aebb3f09a9842e5c9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/529ab4a5a66947aebb3f09a9842e5c9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/529ab4a5a66947aebb3f09a9842e5c9f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_529ab4a5a66947aebb3f09a9842e5c9f"}]}] Oct 27 04:31:19.609167 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServerActionsTestJSON-403049074 Oct 27 04:31:19.609167 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 529ab4a5a66947aebb3f09a9842e5c9f Oct 27 04:31:19.609167 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServerActionsTestJSON-403049074 Oct 27 04:31:19.609167 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServerActionsTestJSON-403049074-project Oct 27 04:31:19.609167 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 04:31:19.609167 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 04:31:19.609167 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 197669776fde4a6480f6cab6e5c8552f Oct 27 04:31:19.609167 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServerActionsTestJSON-403049074-project Oct 27 04:31:19.609167 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 04:31:19.609167 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 87631277-ef7c-4f32-ad28-b4be5c3314f7 could not be found. Oct 27 04:31:19.609167 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '87631277-ef7c-4f32-ad28-b4be5c3314f7'} Oct 27 04:31:19.609167 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 04:31:19.609167 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:31:19.609167 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 04:31:19.609167 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 04:31:19.609167 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 04:31:19.609167 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 04:31:19.609167 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 04:31:19.609167 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 04:31:19.609167 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 04:31:19.609167 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 04:31:19.609167 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87631277-ef7c-4f32-ad28-b4be5c3314f7 could not be found. Oct 27 04:31:19.609167 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:31:19.609167 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:31:19.609167 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:31:19.609167 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:31:19.609167 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:31:19.609167 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:31:19.609167 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 04:31:19.609167 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 04:31:19.609167 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 04:31:19.609167 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 04:31:19.609167 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 04:31:19.609167 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 04:31:19.609167 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 04:31:19.609167 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 04:31:19.609167 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 04:31:19.609167 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 04:31:19.609167 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87631277-ef7c-4f32-ad28-b4be5c3314f7 could not be found. Oct 27 04:31:19.609167 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:31:19.609167 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:31:19.609167 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:31:19.614183 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:31:19.614183 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:31:19.614183 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:31:19.614183 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 04:31:19.614183 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 04:31:19.614183 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87631277-ef7c-4f32-ad28-b4be5c3314f7 could not be found. Oct 27 04:31:19.614183 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:31:19.614183 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-807b3ccf-0a25-4e9c-b7a7-2711cf79f12e tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Returning 404 to user: Instance 87631277-ef7c-4f32-ad28-b4be5c3314f7 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 04:31:19.614183 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-807b3ccf-0a25-4e9c-b7a7-2711cf79f12e tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7" status: 404 len: 111 microversion: 2.1 time: 0.030986 Oct 27 04:31:19.614183 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3979/7664] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:31:19 2022] GET /compute/v2.1/servers/87631277-ef7c-4f32-ad28-b4be5c3314f7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 04:31:19.619735 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9c3008cc-cbfa-46ba-be71-a9d870a1fc81 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:31:19.620240 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9c3008cc-cbfa-46ba-be71-a9d870a1fc81 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 140a45b7-622a-4009-97d0-d15266fd54ca] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:31:19.626405 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9c3008cc-cbfa-46ba-be71-a9d870a1fc81 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:19.626900 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9c3008cc-cbfa-46ba-be71-a9d870a1fc81 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:19.627350 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9c3008cc-cbfa-46ba-be71-a9d870a1fc81 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:19.628048 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9c3008cc-cbfa-46ba-be71-a9d870a1fc81 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:19.628515 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9c3008cc-cbfa-46ba-be71-a9d870a1fc81 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:19.628954 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9c3008cc-cbfa-46ba-be71-a9d870a1fc81 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:19.643000 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-9c3008cc-cbfa-46ba-be71-a9d870a1fc81 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] HTTP exception thrown: Instance 140a45b7-622a-4009-97d0-d15266fd54ca could not be found. Oct 27 04:31:19.644580 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9c3008cc-cbfa-46ba-be71-a9d870a1fc81 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Request method failure captured: Oct 27 04:31:19.644580 n-d-862769-1 devstack@n-api.service[121000]: request: DELETE /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca HTTP/1.1 Oct 27 04:31:19.644580 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 04:31:19.644580 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 04:31:19.644580 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 04:31:19.644580 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 04:31:19.644580 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 04:31:19.644580 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 04:31:19.644580 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 04:31:19.644580 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 04:31:19.644580 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWggT1pShQ7YBK6vLEnUn4ThZkZHCmWwxudcjcX6Q_Qzyxxu4Tv9k9Mz8NdF1J-CqoCxrwqSYjXa2e5qz-_PVvAMi6WsvOj7WQPQINruTawh_9Huu8QwtjT2xusIZMY0glj9dlYg_3F0cuyrDKuyyLc3oA_TbX8qtqDNM9W1LEjJuGfY Oct 27 04:31:19.644580 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 04:31:19.644580 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 04:31:19.644580 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 04:31:19.644580 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 04:31:19.644580 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 04:31:19.644580 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 04:31:19.644580 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 529ab4a5a66947aebb3f09a9842e5c9f Oct 27 04:31:19.644580 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ServerActionsTestJSON-403049074 Oct 27 04:31:19.644580 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 04:31:19.644580 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 04:31:19.644580 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/529ab4a5a66947aebb3f09a9842e5c9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/529ab4a5a66947aebb3f09a9842e5c9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/529ab4a5a66947aebb3f09a9842e5c9f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_529ab4a5a66947aebb3f09a9842e5c9f"}]}] Oct 27 04:31:19.644580 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ServerActionsTestJSON-403049074 Oct 27 04:31:19.644580 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 529ab4a5a66947aebb3f09a9842e5c9f Oct 27 04:31:19.644580 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ServerActionsTestJSON-403049074 Oct 27 04:31:19.644580 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ServerActionsTestJSON-403049074-project Oct 27 04:31:19.644580 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 04:31:19.644580 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 04:31:19.644580 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 197669776fde4a6480f6cab6e5c8552f Oct 27 04:31:19.644580 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ServerActionsTestJSON-403049074-project Oct 27 04:31:19.644580 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 04:31:19.644580 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 140a45b7-622a-4009-97d0-d15266fd54ca could not be found. Oct 27 04:31:19.644580 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '140a45b7-622a-4009-97d0-d15266fd54ca'} Oct 27 04:31:19.644580 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 04:31:19.644580 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:31:19.644580 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 04:31:19.644580 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 04:31:19.644580 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 04:31:19.644580 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 04:31:19.644580 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 04:31:19.644580 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 04:31:19.644580 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 04:31:19.644580 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 04:31:19.644580 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 140a45b7-622a-4009-97d0-d15266fd54ca could not be found. Oct 27 04:31:19.644580 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:31:19.644580 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:31:19.644580 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:31:19.644580 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:31:19.644580 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:31:19.644580 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:31:19.644580 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 04:31:19.644580 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 04:31:19.644580 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 04:31:19.644580 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 04:31:19.644580 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 04:31:19.644580 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 04:31:19.644580 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 04:31:19.644580 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 04:31:19.644580 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 04:31:19.644580 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 04:31:19.644580 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 04:31:19.644580 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 04:31:19.649922 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 140a45b7-622a-4009-97d0-d15266fd54ca could not be found. Oct 27 04:31:19.649922 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:31:19.649922 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:31:19.649922 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:31:19.649922 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:31:19.649922 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:31:19.649922 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:31:19.649922 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 04:31:19.649922 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 04:31:19.649922 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 140a45b7-622a-4009-97d0-d15266fd54ca could not be found. Oct 27 04:31:19.649922 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:31:19.649922 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9c3008cc-cbfa-46ba-be71-a9d870a1fc81 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Returning 404 to user: Instance 140a45b7-622a-4009-97d0-d15266fd54ca could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 04:31:19.649922 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9c3008cc-cbfa-46ba-be71-a9d870a1fc81 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "DELETE /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca" status: 404 len: 111 microversion: 2.1 time: 0.030250 Oct 27 04:31:19.649922 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3686/7665] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 04:31:19 2022] DELETE /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 04:31:19.655970 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5c32f61d-4fee-4582-8b5e-8d11ce9cfb67 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:31:19.656741 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5c32f61d-4fee-4582-8b5e-8d11ce9cfb67 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 140a45b7-622a-4009-97d0-d15266fd54ca] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:31:19.662885 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5c32f61d-4fee-4582-8b5e-8d11ce9cfb67 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:19.663468 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5c32f61d-4fee-4582-8b5e-8d11ce9cfb67 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:19.664008 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5c32f61d-4fee-4582-8b5e-8d11ce9cfb67 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:19.664800 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5c32f61d-4fee-4582-8b5e-8d11ce9cfb67 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:19.665377 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5c32f61d-4fee-4582-8b5e-8d11ce9cfb67 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:19.665901 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5c32f61d-4fee-4582-8b5e-8d11ce9cfb67 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:19.679701 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-5c32f61d-4fee-4582-8b5e-8d11ce9cfb67 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] HTTP exception thrown: Instance 140a45b7-622a-4009-97d0-d15266fd54ca could not be found. Oct 27 04:31:19.681349 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5c32f61d-4fee-4582-8b5e-8d11ce9cfb67 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Request method failure captured: Oct 27 04:31:19.681349 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca HTTP/1.1 Oct 27 04:31:19.681349 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 04:31:19.681349 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 04:31:19.681349 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 04:31:19.681349 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 04:31:19.681349 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 04:31:19.681349 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 04:31:19.681349 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 04:31:19.681349 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 04:31:19.681349 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWggT1pShQ7YBK6vLEnUn4ThZkZHCmWwxudcjcX6Q_Qzyxxu4Tv9k9Mz8NdF1J-CqoCxrwqSYjXa2e5qz-_PVvAMi6WsvOj7WQPQINruTawh_9Huu8QwtjT2xusIZMY0glj9dlYg_3F0cuyrDKuyyLc3oA_TbX8qtqDNM9W1LEjJuGfY Oct 27 04:31:19.681349 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 04:31:19.681349 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 04:31:19.681349 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 04:31:19.681349 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 04:31:19.681349 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 04:31:19.681349 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 04:31:19.681349 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 529ab4a5a66947aebb3f09a9842e5c9f Oct 27 04:31:19.681349 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServerActionsTestJSON-403049074 Oct 27 04:31:19.681349 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 04:31:19.681349 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 04:31:19.681349 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/529ab4a5a66947aebb3f09a9842e5c9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/529ab4a5a66947aebb3f09a9842e5c9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/529ab4a5a66947aebb3f09a9842e5c9f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_529ab4a5a66947aebb3f09a9842e5c9f"}]}] Oct 27 04:31:19.681349 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServerActionsTestJSON-403049074 Oct 27 04:31:19.681349 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 529ab4a5a66947aebb3f09a9842e5c9f Oct 27 04:31:19.681349 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServerActionsTestJSON-403049074 Oct 27 04:31:19.681349 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServerActionsTestJSON-403049074-project Oct 27 04:31:19.681349 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 04:31:19.681349 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 04:31:19.681349 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 197669776fde4a6480f6cab6e5c8552f Oct 27 04:31:19.681349 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServerActionsTestJSON-403049074-project Oct 27 04:31:19.681349 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 04:31:19.681349 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 140a45b7-622a-4009-97d0-d15266fd54ca could not be found. Oct 27 04:31:19.681349 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '140a45b7-622a-4009-97d0-d15266fd54ca'} Oct 27 04:31:19.681349 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 04:31:19.681349 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:31:19.681349 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 04:31:19.681349 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 04:31:19.681349 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 04:31:19.681349 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 04:31:19.681349 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 04:31:19.681349 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 04:31:19.681349 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 04:31:19.681349 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 04:31:19.681349 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 140a45b7-622a-4009-97d0-d15266fd54ca could not be found. Oct 27 04:31:19.681349 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:31:19.681349 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:31:19.681349 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:31:19.681349 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:31:19.681349 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:31:19.681349 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:31:19.681349 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 04:31:19.681349 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 04:31:19.681349 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 04:31:19.681349 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 04:31:19.681349 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 04:31:19.681349 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 04:31:19.681349 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 04:31:19.681349 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 04:31:19.681349 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 04:31:19.681349 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 04:31:19.681349 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 140a45b7-622a-4009-97d0-d15266fd54ca could not be found. Oct 27 04:31:19.681349 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:31:19.681349 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:31:19.681349 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:31:19.686446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:31:19.686446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:31:19.686446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:31:19.686446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 04:31:19.686446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 04:31:19.686446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 140a45b7-622a-4009-97d0-d15266fd54ca could not be found. Oct 27 04:31:19.686446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:31:19.686446 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5c32f61d-4fee-4582-8b5e-8d11ce9cfb67 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Returning 404 to user: Instance 140a45b7-622a-4009-97d0-d15266fd54ca could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 04:31:19.686446 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5c32f61d-4fee-4582-8b5e-8d11ce9cfb67 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca" status: 404 len: 111 microversion: 2.1 time: 0.032326 Oct 27 04:31:19.686446 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3980/7666] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:31:19 2022] GET /compute/v2.1/servers/140a45b7-622a-4009-97d0-d15266fd54ca => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 04:31:19.693088 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f4a45190-09ce-438b-b4f6-52a96635e075 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:31:19.693601 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f4a45190-09ce-438b-b4f6-52a96635e075 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 2490098c-642b-48ba-9d81-510e1c2942cb] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:31:19.700313 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f4a45190-09ce-438b-b4f6-52a96635e075 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:19.700773 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f4a45190-09ce-438b-b4f6-52a96635e075 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:19.701210 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f4a45190-09ce-438b-b4f6-52a96635e075 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:19.701926 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f4a45190-09ce-438b-b4f6-52a96635e075 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:19.702422 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f4a45190-09ce-438b-b4f6-52a96635e075 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:19.702866 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f4a45190-09ce-438b-b4f6-52a96635e075 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:19.719878 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-f4a45190-09ce-438b-b4f6-52a96635e075 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] HTTP exception thrown: Instance 2490098c-642b-48ba-9d81-510e1c2942cb could not be found. Oct 27 04:31:19.721456 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f4a45190-09ce-438b-b4f6-52a96635e075 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Request method failure captured: Oct 27 04:31:19.721456 n-d-862769-1 devstack@n-api.service[121000]: request: DELETE /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb HTTP/1.1 Oct 27 04:31:19.721456 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 04:31:19.721456 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 04:31:19.721456 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 04:31:19.721456 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 04:31:19.721456 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 04:31:19.721456 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 04:31:19.721456 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 04:31:19.721456 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 04:31:19.721456 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWggT1pShQ7YBK6vLEnUn4ThZkZHCmWwxudcjcX6Q_Qzyxxu4Tv9k9Mz8NdF1J-CqoCxrwqSYjXa2e5qz-_PVvAMi6WsvOj7WQPQINruTawh_9Huu8QwtjT2xusIZMY0glj9dlYg_3F0cuyrDKuyyLc3oA_TbX8qtqDNM9W1LEjJuGfY Oct 27 04:31:19.721456 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 04:31:19.721456 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 04:31:19.721456 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 04:31:19.721456 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 04:31:19.721456 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 04:31:19.721456 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 04:31:19.721456 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 529ab4a5a66947aebb3f09a9842e5c9f Oct 27 04:31:19.721456 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ServerActionsTestJSON-403049074 Oct 27 04:31:19.721456 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 04:31:19.721456 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 04:31:19.721456 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/529ab4a5a66947aebb3f09a9842e5c9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/529ab4a5a66947aebb3f09a9842e5c9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/529ab4a5a66947aebb3f09a9842e5c9f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_529ab4a5a66947aebb3f09a9842e5c9f"}]}] Oct 27 04:31:19.721456 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ServerActionsTestJSON-403049074 Oct 27 04:31:19.721456 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 529ab4a5a66947aebb3f09a9842e5c9f Oct 27 04:31:19.721456 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ServerActionsTestJSON-403049074 Oct 27 04:31:19.721456 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ServerActionsTestJSON-403049074-project Oct 27 04:31:19.721456 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 04:31:19.721456 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 04:31:19.721456 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 197669776fde4a6480f6cab6e5c8552f Oct 27 04:31:19.721456 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ServerActionsTestJSON-403049074-project Oct 27 04:31:19.721456 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 04:31:19.721456 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 2490098c-642b-48ba-9d81-510e1c2942cb could not be found. Oct 27 04:31:19.721456 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '2490098c-642b-48ba-9d81-510e1c2942cb'} Oct 27 04:31:19.721456 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 04:31:19.721456 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:31:19.721456 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 04:31:19.721456 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 04:31:19.721456 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 04:31:19.721456 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 04:31:19.721456 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 04:31:19.721456 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 04:31:19.721456 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 04:31:19.721456 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 04:31:19.721456 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2490098c-642b-48ba-9d81-510e1c2942cb could not be found. Oct 27 04:31:19.721456 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:31:19.721456 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:31:19.721456 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:31:19.721456 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:31:19.721456 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:31:19.721456 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:31:19.721456 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 04:31:19.721456 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 04:31:19.721456 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 04:31:19.721456 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 04:31:19.721456 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 04:31:19.721456 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 04:31:19.721456 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 04:31:19.721456 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 04:31:19.721456 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 04:31:19.721456 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 04:31:19.721456 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 04:31:19.721456 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 04:31:19.726222 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2490098c-642b-48ba-9d81-510e1c2942cb could not be found. Oct 27 04:31:19.726222 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:31:19.726222 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:31:19.726222 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:31:19.726222 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:31:19.726222 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:31:19.726222 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:31:19.726222 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 04:31:19.726222 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 04:31:19.726222 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2490098c-642b-48ba-9d81-510e1c2942cb could not be found. Oct 27 04:31:19.726222 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:31:19.726222 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f4a45190-09ce-438b-b4f6-52a96635e075 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Returning 404 to user: Instance 2490098c-642b-48ba-9d81-510e1c2942cb could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 04:31:19.726222 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f4a45190-09ce-438b-b4f6-52a96635e075 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb" status: 404 len: 111 microversion: 2.1 time: 0.033779 Oct 27 04:31:19.727200 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3687/7667] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 04:31:19 2022] DELETE /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 04:31:19.732396 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-fbe31051-9691-458c-9f02-c0f5448edd25 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:31:19.733039 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-fbe31051-9691-458c-9f02-c0f5448edd25 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] [instance: 2490098c-642b-48ba-9d81-510e1c2942cb] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:31:19.738996 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fbe31051-9691-458c-9f02-c0f5448edd25 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:19.739500 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fbe31051-9691-458c-9f02-c0f5448edd25 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:19.739963 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fbe31051-9691-458c-9f02-c0f5448edd25 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:19.740671 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fbe31051-9691-458c-9f02-c0f5448edd25 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:19.741146 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fbe31051-9691-458c-9f02-c0f5448edd25 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:19.741596 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fbe31051-9691-458c-9f02-c0f5448edd25 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:19.754981 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-fbe31051-9691-458c-9f02-c0f5448edd25 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] HTTP exception thrown: Instance 2490098c-642b-48ba-9d81-510e1c2942cb could not be found. Oct 27 04:31:19.756550 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-fbe31051-9691-458c-9f02-c0f5448edd25 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Request method failure captured: Oct 27 04:31:19.756550 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb HTTP/1.1 Oct 27 04:31:19.756550 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 04:31:19.756550 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 04:31:19.756550 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 04:31:19.756550 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 04:31:19.756550 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 04:31:19.756550 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 04:31:19.756550 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 04:31:19.756550 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 04:31:19.756550 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWggT1pShQ7YBK6vLEnUn4ThZkZHCmWwxudcjcX6Q_Qzyxxu4Tv9k9Mz8NdF1J-CqoCxrwqSYjXa2e5qz-_PVvAMi6WsvOj7WQPQINruTawh_9Huu8QwtjT2xusIZMY0glj9dlYg_3F0cuyrDKuyyLc3oA_TbX8qtqDNM9W1LEjJuGfY Oct 27 04:31:19.756550 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 04:31:19.756550 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 04:31:19.756550 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 04:31:19.756550 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 04:31:19.756550 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 04:31:19.756550 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 04:31:19.756550 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 529ab4a5a66947aebb3f09a9842e5c9f Oct 27 04:31:19.756550 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServerActionsTestJSON-403049074 Oct 27 04:31:19.756550 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 04:31:19.756550 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 04:31:19.756550 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/529ab4a5a66947aebb3f09a9842e5c9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/529ab4a5a66947aebb3f09a9842e5c9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/529ab4a5a66947aebb3f09a9842e5c9f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_529ab4a5a66947aebb3f09a9842e5c9f"}]}] Oct 27 04:31:19.756550 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServerActionsTestJSON-403049074 Oct 27 04:31:19.756550 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 529ab4a5a66947aebb3f09a9842e5c9f Oct 27 04:31:19.756550 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServerActionsTestJSON-403049074 Oct 27 04:31:19.756550 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServerActionsTestJSON-403049074-project Oct 27 04:31:19.756550 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 04:31:19.756550 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 04:31:19.756550 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 197669776fde4a6480f6cab6e5c8552f Oct 27 04:31:19.756550 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServerActionsTestJSON-403049074-project Oct 27 04:31:19.756550 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 04:31:19.756550 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 2490098c-642b-48ba-9d81-510e1c2942cb could not be found. Oct 27 04:31:19.756550 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '2490098c-642b-48ba-9d81-510e1c2942cb'} Oct 27 04:31:19.756550 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 04:31:19.756550 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:31:19.756550 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 04:31:19.756550 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 04:31:19.756550 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 04:31:19.756550 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 04:31:19.756550 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 04:31:19.756550 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 04:31:19.756550 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 04:31:19.756550 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 04:31:19.756550 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2490098c-642b-48ba-9d81-510e1c2942cb could not be found. Oct 27 04:31:19.756550 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:31:19.756550 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:31:19.756550 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:31:19.756550 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:31:19.756550 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:31:19.756550 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:31:19.756550 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 04:31:19.756550 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 04:31:19.756550 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 04:31:19.756550 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 04:31:19.756550 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 04:31:19.756550 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 04:31:19.756550 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 04:31:19.756550 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 04:31:19.756550 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 04:31:19.756550 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 04:31:19.756550 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2490098c-642b-48ba-9d81-510e1c2942cb could not be found. Oct 27 04:31:19.756550 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:31:19.756550 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:31:19.756550 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:31:19.762088 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:31:19.762088 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:31:19.762088 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:31:19.762088 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 04:31:19.762088 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 04:31:19.762088 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2490098c-642b-48ba-9d81-510e1c2942cb could not be found. Oct 27 04:31:19.762088 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:31:19.762088 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-fbe31051-9691-458c-9f02-c0f5448edd25 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Returning 404 to user: Instance 2490098c-642b-48ba-9d81-510e1c2942cb could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 04:31:19.762088 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-fbe31051-9691-458c-9f02-c0f5448edd25 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb" status: 404 len: 111 microversion: 2.1 time: 0.030127 Oct 27 04:31:19.762088 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3981/7668] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:31:19 2022] GET /compute/v2.1/servers/2490098c-642b-48ba-9d81-510e1c2942cb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 04:31:19.767395 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0465546e-1e1a-460f-bc98-e4972d058063 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] Calling method '.version_select at 0x7f7dda873550>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:31:19.844858 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0465546e-1e1a-460f-bc98-e4972d058063 tempest-ServerActionsTestJSON-403049074 tempest-ServerActionsTestJSON-403049074-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-673070032" status: 202 len: 0 microversion: 2.1 time: 0.080993 Oct 27 04:31:19.845452 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3688/7669] 10.222.0.20 () {58 vars in 1218 bytes} [Thu Oct 27 04:31:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-673070032 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 04:31:31.646300 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=19 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:31:31.648173 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:31:31.779433 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-441358a7-b063-43b7-a29c-d86daeac0a10 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-780711052", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": [{"uuid": "8fc0b503-f209-412b-ac23-51e4f7cff822"}]}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:31:31.838132 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.network.neutron [None req-441358a7-b063-43b7-a29c-d86daeac0a10 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] validate_networks() for [('8fc0b503-f209-412b-ac23-51e4f7cff822', None, None, None, None, None)] {{(pid=121001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 04:31:32.201630 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-441358a7-b063-43b7-a29c-d86daeac0a10 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Flavor limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 04:31:32.202129 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-441358a7-b063-43b7-a29c-d86daeac0a10 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Image limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 04:31:32.202637 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-441358a7-b063-43b7-a29c-d86daeac0a10 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Flavor pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 04:31:32.203080 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-441358a7-b063-43b7-a29c-d86daeac0a10 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Image pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 04:31:32.203525 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-441358a7-b063-43b7-a29c-d86daeac0a10 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 04:31:32.212597 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-441358a7-b063-43b7-a29c-d86daeac0a10 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:32.213105 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-441358a7-b063-43b7-a29c-d86daeac0a10 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:32.213572 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-441358a7-b063-43b7-a29c-d86daeac0a10 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:32.214429 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-441358a7-b063-43b7-a29c-d86daeac0a10 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:32.214858 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-441358a7-b063-43b7-a29c-d86daeac0a10 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:32.215313 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-441358a7-b063-43b7-a29c-d86daeac0a10 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:32.232198 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-441358a7-b063-43b7-a29c-d86daeac0a10 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Getting quotas for project eba1782ef9544e6d9fb7da0a1389ef48. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 04:31:32.237426 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-441358a7-b063-43b7-a29c-d86daeac0a10 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Getting quotas for user 2b507cef618e4b7ea712a96f014b0b91 and project eba1782ef9544e6d9fb7da0a1389ef48. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 04:31:32.250298 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-441358a7-b063-43b7-a29c-d86daeac0a10 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Going to run 1 instances... {{(pid=121001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 04:31:32.252667 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-441358a7-b063-43b7-a29c-d86daeac0a10 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] [instance: 875ae006-5b22-49e0-b8d9-85652ee65f70] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 04:31:32.358225 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-441358a7-b063-43b7-a29c-d86daeac0a10 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.717002 Oct 27 04:31:32.358919 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3982/7670] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 04:31:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 719 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 04:31:32.371093 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b0b3a6de-45a5-4e5a-afe2-f375b4759fcf tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:31:32.371727 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b0b3a6de-45a5-4e5a-afe2-f375b4759fcf tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] [instance: 875ae006-5b22-49e0-b8d9-85652ee65f70] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:31:32.374883 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=21 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:31:32.375555 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=20,nova_api:DELETE=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:31:32.435990 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b0b3a6de-45a5-4e5a-afe2-f375b4759fcf tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b507cef618e4b7ea712a96f014b0b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba1782ef9544e6d9fb7da0a1389ef48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:31:32.446343 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b0b3a6de-45a5-4e5a-afe2-f375b4759fcf tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] 10.222.0.20 "GET /compute/v2.1/servers/875ae006-5b22-49e0-b8d9-85652ee65f70" status: 200 len: 1216 microversion: 2.1 time: 0.079734 Oct 27 04:31:32.459184 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3689/7671] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:31:32 2022] GET /compute/v2.1/servers/875ae006-5b22-49e0-b8d9-85652ee65f70 => generated 1216 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:31:33.471077 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-169b2a7b-29c0-4820-8218-5599a67f2f36 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:31:33.471735 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-169b2a7b-29c0-4820-8218-5599a67f2f36 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] [instance: 875ae006-5b22-49e0-b8d9-85652ee65f70] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:31:33.529322 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-169b2a7b-29c0-4820-8218-5599a67f2f36 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b507cef618e4b7ea712a96f014b0b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba1782ef9544e6d9fb7da0a1389ef48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:31:33.537253 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-169b2a7b-29c0-4820-8218-5599a67f2f36 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] 10.222.0.20 "GET /compute/v2.1/servers/875ae006-5b22-49e0-b8d9-85652ee65f70" status: 200 len: 1216 microversion: 2.1 time: 0.070467 Oct 27 04:31:33.537880 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3983/7672] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:31:33 2022] GET /compute/v2.1/servers/875ae006-5b22-49e0-b8d9-85652ee65f70 => generated 1216 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:31:34.561270 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8a6edff9-cc1e-451b-a1a2-12b37d51ee30 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:31:34.561900 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8a6edff9-cc1e-451b-a1a2-12b37d51ee30 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] [instance: 875ae006-5b22-49e0-b8d9-85652ee65f70] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:31:34.569358 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8a6edff9-cc1e-451b-a1a2-12b37d51ee30 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:34.569865 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8a6edff9-cc1e-451b-a1a2-12b37d51ee30 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:34.570350 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8a6edff9-cc1e-451b-a1a2-12b37d51ee30 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:34.571079 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8a6edff9-cc1e-451b-a1a2-12b37d51ee30 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:34.571543 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8a6edff9-cc1e-451b-a1a2-12b37d51ee30 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:34.571982 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8a6edff9-cc1e-451b-a1a2-12b37d51ee30 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:34.645818 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8a6edff9-cc1e-451b-a1a2-12b37d51ee30 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b507cef618e4b7ea712a96f014b0b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba1782ef9544e6d9fb7da0a1389ef48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:31:34.654279 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8a6edff9-cc1e-451b-a1a2-12b37d51ee30 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] 10.222.0.20 "GET /compute/v2.1/servers/875ae006-5b22-49e0-b8d9-85652ee65f70" status: 200 len: 1268 microversion: 2.1 time: 0.097022 Oct 27 04:31:34.654880 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3690/7673] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:31:34 2022] GET /compute/v2.1/servers/875ae006-5b22-49e0-b8d9-85652ee65f70 => generated 1268 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:31:35.680113 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-dcc2a1ef-14fc-4888-a568-568c5fd8fd69 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:31:35.680759 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-dcc2a1ef-14fc-4888-a568-568c5fd8fd69 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] [instance: 875ae006-5b22-49e0-b8d9-85652ee65f70] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:31:35.688094 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dcc2a1ef-14fc-4888-a568-568c5fd8fd69 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:35.688610 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dcc2a1ef-14fc-4888-a568-568c5fd8fd69 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:35.689075 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dcc2a1ef-14fc-4888-a568-568c5fd8fd69 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:35.689906 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dcc2a1ef-14fc-4888-a568-568c5fd8fd69 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:35.690435 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dcc2a1ef-14fc-4888-a568-568c5fd8fd69 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:35.690885 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dcc2a1ef-14fc-4888-a568-568c5fd8fd69 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:35.937837 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-dcc2a1ef-14fc-4888-a568-568c5fd8fd69 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b507cef618e4b7ea712a96f014b0b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba1782ef9544e6d9fb7da0a1389ef48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:31:35.945869 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-dcc2a1ef-14fc-4888-a568-568c5fd8fd69 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] 10.222.0.20 "GET /compute/v2.1/servers/875ae006-5b22-49e0-b8d9-85652ee65f70" status: 200 len: 1316 microversion: 2.1 time: 0.270400 Oct 27 04:31:35.946722 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3984/7674] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:31:35 2022] GET /compute/v2.1/servers/875ae006-5b22-49e0-b8d9-85652ee65f70 => generated 1316 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:31:36.519348 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-65a8c2cd-a0a0-4f99-8c52-b2dec41a741a req-1a8c2e55-7199-4017-a903-378a03fd6913 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "875ae006-5b22-49e0-b8d9-85652ee65f70", "tag": "1b05d6ac-f3b9-4f4b-8bea-2f1ac70a8243"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:31:36.528767 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-65a8c2cd-a0a0-4f99-8c52-b2dec41a741a req-1a8c2e55-7199-4017-a903-378a03fd6913 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:36.529259 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-65a8c2cd-a0a0-4f99-8c52-b2dec41a741a req-1a8c2e55-7199-4017-a903-378a03fd6913 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:36.529700 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-65a8c2cd-a0a0-4f99-8c52-b2dec41a741a req-1a8c2e55-7199-4017-a903-378a03fd6913 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:36.540553 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-65a8c2cd-a0a0-4f99-8c52-b2dec41a741a req-1a8c2e55-7199-4017-a903-378a03fd6913 service nova] Creating event network-changed:1b05d6ac-f3b9-4f4b-8bea-2f1ac70a8243 for instance 875ae006-5b22-49e0-b8d9-85652ee65f70 on n-h1-862769-1 Oct 27 04:31:36.545591 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-65a8c2cd-a0a0-4f99-8c52-b2dec41a741a req-1a8c2e55-7199-4017-a903-378a03fd6913 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093785 Oct 27 04:31:36.546225 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3691/7675] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:31:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:31:36.970216 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2a5b22dc-f913-4514-be2c-c47e03eee8e6 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:31:36.970884 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2a5b22dc-f913-4514-be2c-c47e03eee8e6 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] [instance: 875ae006-5b22-49e0-b8d9-85652ee65f70] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:31:36.978353 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2a5b22dc-f913-4514-be2c-c47e03eee8e6 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:36.985134 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2a5b22dc-f913-4514-be2c-c47e03eee8e6 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:36.985134 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2a5b22dc-f913-4514-be2c-c47e03eee8e6 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:36.985134 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2a5b22dc-f913-4514-be2c-c47e03eee8e6 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:36.985134 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2a5b22dc-f913-4514-be2c-c47e03eee8e6 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:36.985134 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2a5b22dc-f913-4514-be2c-c47e03eee8e6 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:37.116716 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2a5b22dc-f913-4514-be2c-c47e03eee8e6 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b507cef618e4b7ea712a96f014b0b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba1782ef9544e6d9fb7da0a1389ef48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:31:37.124631 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2a5b22dc-f913-4514-be2c-c47e03eee8e6 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] 10.222.0.20 "GET /compute/v2.1/servers/875ae006-5b22-49e0-b8d9-85652ee65f70" status: 200 len: 1316 microversion: 2.1 time: 0.158896 Oct 27 04:31:37.125208 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3985/7676] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:31:36 2022] GET /compute/v2.1/servers/875ae006-5b22-49e0-b8d9-85652ee65f70 => generated 1316 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:31:38.148612 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-856cc5b6-bfba-4453-83a5-67497353eeb9 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:31:38.149346 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-856cc5b6-bfba-4453-83a5-67497353eeb9 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] [instance: 875ae006-5b22-49e0-b8d9-85652ee65f70] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:31:38.156048 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-856cc5b6-bfba-4453-83a5-67497353eeb9 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:38.156552 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-856cc5b6-bfba-4453-83a5-67497353eeb9 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:38.157004 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-856cc5b6-bfba-4453-83a5-67497353eeb9 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:38.157809 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-856cc5b6-bfba-4453-83a5-67497353eeb9 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:38.158314 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-856cc5b6-bfba-4453-83a5-67497353eeb9 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:38.158759 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-856cc5b6-bfba-4453-83a5-67497353eeb9 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:38.295139 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-856cc5b6-bfba-4453-83a5-67497353eeb9 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b507cef618e4b7ea712a96f014b0b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba1782ef9544e6d9fb7da0a1389ef48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:31:38.303037 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-856cc5b6-bfba-4453-83a5-67497353eeb9 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] 10.222.0.20 "GET /compute/v2.1/servers/875ae006-5b22-49e0-b8d9-85652ee65f70" status: 200 len: 1316 microversion: 2.1 time: 0.159638 Oct 27 04:31:38.318056 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3692/7677] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:31:38 2022] GET /compute/v2.1/servers/875ae006-5b22-49e0-b8d9-85652ee65f70 => generated 1316 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:31:39.326344 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-208d64e9-2622-4cb6-84b4-99a042bd5252 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:31:39.326993 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-208d64e9-2622-4cb6-84b4-99a042bd5252 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] [instance: 875ae006-5b22-49e0-b8d9-85652ee65f70] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:31:39.333891 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-208d64e9-2622-4cb6-84b4-99a042bd5252 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:39.334447 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-208d64e9-2622-4cb6-84b4-99a042bd5252 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:39.335580 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-208d64e9-2622-4cb6-84b4-99a042bd5252 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:39.336296 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-208d64e9-2622-4cb6-84b4-99a042bd5252 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:39.336779 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-208d64e9-2622-4cb6-84b4-99a042bd5252 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:39.337231 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-208d64e9-2622-4cb6-84b4-99a042bd5252 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:39.470584 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-208d64e9-2622-4cb6-84b4-99a042bd5252 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b507cef618e4b7ea712a96f014b0b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba1782ef9544e6d9fb7da0a1389ef48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:31:39.478497 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-208d64e9-2622-4cb6-84b4-99a042bd5252 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] 10.222.0.20 "GET /compute/v2.1/servers/875ae006-5b22-49e0-b8d9-85652ee65f70" status: 200 len: 1316 microversion: 2.1 time: 0.156114 Oct 27 04:31:39.479073 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3986/7678] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:31:39 2022] GET /compute/v2.1/servers/875ae006-5b22-49e0-b8d9-85652ee65f70 => generated 1316 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:31:40.501708 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-746fb896-3a0e-46cd-a1e3-60b8cef079c5 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:31:40.502360 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-746fb896-3a0e-46cd-a1e3-60b8cef079c5 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] [instance: 875ae006-5b22-49e0-b8d9-85652ee65f70] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:31:40.509851 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-746fb896-3a0e-46cd-a1e3-60b8cef079c5 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:40.510380 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-746fb896-3a0e-46cd-a1e3-60b8cef079c5 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:40.510829 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-746fb896-3a0e-46cd-a1e3-60b8cef079c5 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:40.511531 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-746fb896-3a0e-46cd-a1e3-60b8cef079c5 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:40.511996 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-746fb896-3a0e-46cd-a1e3-60b8cef079c5 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:40.512431 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-746fb896-3a0e-46cd-a1e3-60b8cef079c5 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:40.647062 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-746fb896-3a0e-46cd-a1e3-60b8cef079c5 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b507cef618e4b7ea712a96f014b0b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba1782ef9544e6d9fb7da0a1389ef48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:31:40.655057 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-746fb896-3a0e-46cd-a1e3-60b8cef079c5 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] 10.222.0.20 "GET /compute/v2.1/servers/875ae006-5b22-49e0-b8d9-85652ee65f70" status: 200 len: 1316 microversion: 2.1 time: 0.157169 Oct 27 04:31:40.660901 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3693/7679] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:31:40 2022] GET /compute/v2.1/servers/875ae006-5b22-49e0-b8d9-85652ee65f70 => generated 1316 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:31:41.678860 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-85af7404-5964-4c9c-90bc-3cde7048b351 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:31:41.679558 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-85af7404-5964-4c9c-90bc-3cde7048b351 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] [instance: 875ae006-5b22-49e0-b8d9-85652ee65f70] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:31:41.686499 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-85af7404-5964-4c9c-90bc-3cde7048b351 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:41.687004 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-85af7404-5964-4c9c-90bc-3cde7048b351 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:41.687467 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-85af7404-5964-4c9c-90bc-3cde7048b351 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:41.688189 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-85af7404-5964-4c9c-90bc-3cde7048b351 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:41.688669 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-85af7404-5964-4c9c-90bc-3cde7048b351 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:41.689126 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-85af7404-5964-4c9c-90bc-3cde7048b351 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:41.823412 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-85af7404-5964-4c9c-90bc-3cde7048b351 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b507cef618e4b7ea712a96f014b0b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba1782ef9544e6d9fb7da0a1389ef48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:31:41.829701 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-85af7404-5964-4c9c-90bc-3cde7048b351 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] 10.222.0.20 "GET /compute/v2.1/servers/875ae006-5b22-49e0-b8d9-85652ee65f70" status: 200 len: 1316 microversion: 2.1 time: 0.154911 Oct 27 04:31:41.830349 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3987/7680] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:31:41 2022] GET /compute/v2.1/servers/875ae006-5b22-49e0-b8d9-85652ee65f70 => generated 1316 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:31:42.853768 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ff482e9c-83cf-4f20-9721-ee8526c93261 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:31:42.854457 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ff482e9c-83cf-4f20-9721-ee8526c93261 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] [instance: 875ae006-5b22-49e0-b8d9-85652ee65f70] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:31:42.857369 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:31:42.862303 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ff482e9c-83cf-4f20-9721-ee8526c93261 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:42.862800 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ff482e9c-83cf-4f20-9721-ee8526c93261 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:42.863297 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ff482e9c-83cf-4f20-9721-ee8526c93261 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:42.864000 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ff482e9c-83cf-4f20-9721-ee8526c93261 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:42.864460 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ff482e9c-83cf-4f20-9721-ee8526c93261 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:42.864892 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ff482e9c-83cf-4f20-9721-ee8526c93261 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:42.998139 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ff482e9c-83cf-4f20-9721-ee8526c93261 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b507cef618e4b7ea712a96f014b0b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba1782ef9544e6d9fb7da0a1389ef48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:31:43.005744 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ff482e9c-83cf-4f20-9721-ee8526c93261 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] 10.222.0.20 "GET /compute/v2.1/servers/875ae006-5b22-49e0-b8d9-85652ee65f70" status: 200 len: 1316 microversion: 2.1 time: 0.156507 Oct 27 04:31:43.006345 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3694/7681] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:31:42 2022] GET /compute/v2.1/servers/875ae006-5b22-49e0-b8d9-85652ee65f70 => generated 1316 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:31:43.591130 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:31:43.593101 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=8 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:31:43.645614 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-8432dd0d-45cf-44a1-ba37-2435b1095599 req-62ca744a-528c-429c-8426-3dbdb668d216 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "875ae006-5b22-49e0-b8d9-85652ee65f70", "name": "network-vif-plugged", "status": "completed", "tag": "1b05d6ac-f3b9-4f4b-8bea-2f1ac70a8243"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:31:43.655066 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-8432dd0d-45cf-44a1-ba37-2435b1095599 req-62ca744a-528c-429c-8426-3dbdb668d216 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:43.655567 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-8432dd0d-45cf-44a1-ba37-2435b1095599 req-62ca744a-528c-429c-8426-3dbdb668d216 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:43.656017 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-8432dd0d-45cf-44a1-ba37-2435b1095599 req-62ca744a-528c-429c-8426-3dbdb668d216 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:43.668191 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-8432dd0d-45cf-44a1-ba37-2435b1095599 req-62ca744a-528c-429c-8426-3dbdb668d216 service nova] Creating event network-vif-plugged:1b05d6ac-f3b9-4f4b-8bea-2f1ac70a8243 for instance 875ae006-5b22-49e0-b8d9-85652ee65f70 on n-h1-862769-1 Oct 27 04:31:43.673306 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-8432dd0d-45cf-44a1-ba37-2435b1095599 req-62ca744a-528c-429c-8426-3dbdb668d216 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086787 Oct 27 04:31:43.673906 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3988/7682] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:31:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:31:44.029167 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d5ec5f29-e0d0-452d-9c39-889f36e95baf tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:31:44.029715 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d5ec5f29-e0d0-452d-9c39-889f36e95baf tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] [instance: 875ae006-5b22-49e0-b8d9-85652ee65f70] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:31:44.036582 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d5ec5f29-e0d0-452d-9c39-889f36e95baf tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:44.037079 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d5ec5f29-e0d0-452d-9c39-889f36e95baf tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:44.037533 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d5ec5f29-e0d0-452d-9c39-889f36e95baf tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:44.038284 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d5ec5f29-e0d0-452d-9c39-889f36e95baf tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:44.039425 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d5ec5f29-e0d0-452d-9c39-889f36e95baf tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:44.039869 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d5ec5f29-e0d0-452d-9c39-889f36e95baf tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:44.170351 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d5ec5f29-e0d0-452d-9c39-889f36e95baf tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b507cef618e4b7ea712a96f014b0b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba1782ef9544e6d9fb7da0a1389ef48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:31:44.177971 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d5ec5f29-e0d0-452d-9c39-889f36e95baf tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] 10.222.0.20 "GET /compute/v2.1/servers/875ae006-5b22-49e0-b8d9-85652ee65f70" status: 200 len: 1316 microversion: 2.1 time: 0.152798 Oct 27 04:31:44.178609 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3695/7683] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:31:44 2022] GET /compute/v2.1/servers/875ae006-5b22-49e0-b8d9-85652ee65f70 => generated 1316 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:31:45.202768 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d5424c07-a669-40d6-94ed-b7c6dbf23177 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:31:45.203508 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d5424c07-a669-40d6-94ed-b7c6dbf23177 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] [instance: 875ae006-5b22-49e0-b8d9-85652ee65f70] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:31:45.211479 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d5424c07-a669-40d6-94ed-b7c6dbf23177 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:45.211991 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d5424c07-a669-40d6-94ed-b7c6dbf23177 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:45.212450 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d5424c07-a669-40d6-94ed-b7c6dbf23177 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:45.213173 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d5424c07-a669-40d6-94ed-b7c6dbf23177 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:45.213651 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d5424c07-a669-40d6-94ed-b7c6dbf23177 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:45.214130 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d5424c07-a669-40d6-94ed-b7c6dbf23177 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:45.343670 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d5424c07-a669-40d6-94ed-b7c6dbf23177 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b507cef618e4b7ea712a96f014b0b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba1782ef9544e6d9fb7da0a1389ef48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:31:45.351766 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d5424c07-a669-40d6-94ed-b7c6dbf23177 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] 10.222.0.20 "GET /compute/v2.1/servers/875ae006-5b22-49e0-b8d9-85652ee65f70" status: 200 len: 1504 microversion: 2.1 time: 0.154249 Oct 27 04:31:45.352339 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3989/7684] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:31:45 2022] GET /compute/v2.1/servers/875ae006-5b22-49e0-b8d9-85652ee65f70 => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:31:45.412897 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e3a9c990-f5f3-46b8-9cb7-ba914e5e75ce tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-192735991", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": [{"uuid": "8fc0b503-f209-412b-ac23-51e4f7cff822"}]}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:31:45.465960 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-e3a9c990-f5f3-46b8-9cb7-ba914e5e75ce tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] validate_networks() for [('8fc0b503-f209-412b-ac23-51e4f7cff822', None, None, None, None, None)] {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 04:31:45.892687 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-e3a9c990-f5f3-46b8-9cb7-ba914e5e75ce tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 04:31:45.893111 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-e3a9c990-f5f3-46b8-9cb7-ba914e5e75ce tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 04:31:45.893618 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-e3a9c990-f5f3-46b8-9cb7-ba914e5e75ce tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 04:31:45.894055 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-e3a9c990-f5f3-46b8-9cb7-ba914e5e75ce tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 04:31:45.894466 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-e3a9c990-f5f3-46b8-9cb7-ba914e5e75ce tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 04:31:45.903513 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e3a9c990-f5f3-46b8-9cb7-ba914e5e75ce tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:45.903995 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e3a9c990-f5f3-46b8-9cb7-ba914e5e75ce tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:45.904430 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e3a9c990-f5f3-46b8-9cb7-ba914e5e75ce tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:45.905198 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e3a9c990-f5f3-46b8-9cb7-ba914e5e75ce tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:45.905658 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e3a9c990-f5f3-46b8-9cb7-ba914e5e75ce tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:45.906219 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e3a9c990-f5f3-46b8-9cb7-ba914e5e75ce tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:45.923126 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-e3a9c990-f5f3-46b8-9cb7-ba914e5e75ce tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Getting quotas for project eba1782ef9544e6d9fb7da0a1389ef48. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 04:31:45.928359 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-e3a9c990-f5f3-46b8-9cb7-ba914e5e75ce tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Getting quotas for user 2b507cef618e4b7ea712a96f014b0b91 and project eba1782ef9544e6d9fb7da0a1389ef48. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 04:31:45.941343 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e3a9c990-f5f3-46b8-9cb7-ba914e5e75ce tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 04:31:45.943626 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e3a9c990-f5f3-46b8-9cb7-ba914e5e75ce tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] [instance: b3347a30-3bdb-4e3d-aaa4-080e0eadee21] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 04:31:46.040420 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e3a9c990-f5f3-46b8-9cb7-ba914e5e75ce tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.631271 Oct 27 04:31:46.040998 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3696/7685] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 04:31:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 633 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 04:31:46.052259 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-261ee99e-342a-4b37-8e43-179449549c12 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:31:46.053182 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-261ee99e-342a-4b37-8e43-179449549c12 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] [instance: b3347a30-3bdb-4e3d-aaa4-080e0eadee21] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:31:46.106943 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-261ee99e-342a-4b37-8e43-179449549c12 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b507cef618e4b7ea712a96f014b0b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba1782ef9544e6d9fb7da0a1389ef48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:31:46.113779 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-261ee99e-342a-4b37-8e43-179449549c12 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] 10.222.0.20 "GET /compute/v2.1/servers/b3347a30-3bdb-4e3d-aaa4-080e0eadee21" status: 200 len: 1216 microversion: 2.1 time: 0.065571 Oct 27 04:31:46.114393 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3990/7686] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:31:46 2022] GET /compute/v2.1/servers/b3347a30-3bdb-4e3d-aaa4-080e0eadee21 => generated 1216 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:31:47.138674 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8dba2834-d4af-4b32-a249-961a056e2bae tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:31:47.139335 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8dba2834-d4af-4b32-a249-961a056e2bae tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] [instance: b3347a30-3bdb-4e3d-aaa4-080e0eadee21] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:31:47.146391 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8dba2834-d4af-4b32-a249-961a056e2bae tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:47.146879 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8dba2834-d4af-4b32-a249-961a056e2bae tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:47.147321 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8dba2834-d4af-4b32-a249-961a056e2bae tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:47.148057 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8dba2834-d4af-4b32-a249-961a056e2bae tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:47.148584 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8dba2834-d4af-4b32-a249-961a056e2bae tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:47.149015 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8dba2834-d4af-4b32-a249-961a056e2bae tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:47.212201 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8dba2834-d4af-4b32-a249-961a056e2bae tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b507cef618e4b7ea712a96f014b0b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba1782ef9544e6d9fb7da0a1389ef48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:31:47.220558 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8dba2834-d4af-4b32-a249-961a056e2bae tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] 10.222.0.20 "GET /compute/v2.1/servers/b3347a30-3bdb-4e3d-aaa4-080e0eadee21" status: 200 len: 1220 microversion: 2.1 time: 0.086696 Oct 27 04:31:47.221107 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3697/7687] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:31:47 2022] GET /compute/v2.1/servers/b3347a30-3bdb-4e3d-aaa4-080e0eadee21 => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:31:48.243470 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1e0266fb-29f0-4763-82eb-7d99def1290b tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:31:48.244195 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1e0266fb-29f0-4763-82eb-7d99def1290b tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] [instance: b3347a30-3bdb-4e3d-aaa4-080e0eadee21] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:31:48.251827 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1e0266fb-29f0-4763-82eb-7d99def1290b tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:48.254600 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1e0266fb-29f0-4763-82eb-7d99def1290b tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:48.254600 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1e0266fb-29f0-4763-82eb-7d99def1290b tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:48.254600 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1e0266fb-29f0-4763-82eb-7d99def1290b tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:48.254600 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1e0266fb-29f0-4763-82eb-7d99def1290b tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:48.254600 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1e0266fb-29f0-4763-82eb-7d99def1290b tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:48.322322 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1e0266fb-29f0-4763-82eb-7d99def1290b tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b507cef618e4b7ea712a96f014b0b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba1782ef9544e6d9fb7da0a1389ef48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:31:48.330475 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1e0266fb-29f0-4763-82eb-7d99def1290b tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] 10.222.0.20 "GET /compute/v2.1/servers/b3347a30-3bdb-4e3d-aaa4-080e0eadee21" status: 200 len: 1286 microversion: 2.1 time: 0.090985 Oct 27 04:31:48.331270 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3991/7688] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:31:48 2022] GET /compute/v2.1/servers/b3347a30-3bdb-4e3d-aaa4-080e0eadee21 => generated 1286 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:31:49.355436 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8b7ad260-ba62-4e52-8f94-c6f41ea19413 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:31:49.356068 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8b7ad260-ba62-4e52-8f94-c6f41ea19413 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] [instance: b3347a30-3bdb-4e3d-aaa4-080e0eadee21] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:31:49.363017 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8b7ad260-ba62-4e52-8f94-c6f41ea19413 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:49.363514 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8b7ad260-ba62-4e52-8f94-c6f41ea19413 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:49.363959 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8b7ad260-ba62-4e52-8f94-c6f41ea19413 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:49.364671 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8b7ad260-ba62-4e52-8f94-c6f41ea19413 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:49.365128 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8b7ad260-ba62-4e52-8f94-c6f41ea19413 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:49.365557 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8b7ad260-ba62-4e52-8f94-c6f41ea19413 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:49.562954 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8b7ad260-ba62-4e52-8f94-c6f41ea19413 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b507cef618e4b7ea712a96f014b0b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba1782ef9544e6d9fb7da0a1389ef48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:31:49.570981 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8b7ad260-ba62-4e52-8f94-c6f41ea19413 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] 10.222.0.20 "GET /compute/v2.1/servers/b3347a30-3bdb-4e3d-aaa4-080e0eadee21" status: 200 len: 1316 microversion: 2.1 time: 0.220145 Oct 27 04:31:49.571563 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3698/7689] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:31:49 2022] GET /compute/v2.1/servers/b3347a30-3bdb-4e3d-aaa4-080e0eadee21 => generated 1316 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:31:49.790914 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-42b81d0b-3361-412b-8068-5cf32f8da34c req-a2599fab-1e59-4280-98cc-3f02f9fe59a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3347a30-3bdb-4e3d-aaa4-080e0eadee21", "tag": "f93199b3-eb72-4c3f-a261-828fff99d57e"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:31:49.801493 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-42b81d0b-3361-412b-8068-5cf32f8da34c req-a2599fab-1e59-4280-98cc-3f02f9fe59a4 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:49.802077 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-42b81d0b-3361-412b-8068-5cf32f8da34c req-a2599fab-1e59-4280-98cc-3f02f9fe59a4 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:49.802529 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-42b81d0b-3361-412b-8068-5cf32f8da34c req-a2599fab-1e59-4280-98cc-3f02f9fe59a4 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:49.817177 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-42b81d0b-3361-412b-8068-5cf32f8da34c req-a2599fab-1e59-4280-98cc-3f02f9fe59a4 service nova] Creating event network-changed:f93199b3-eb72-4c3f-a261-828fff99d57e for instance b3347a30-3bdb-4e3d-aaa4-080e0eadee21 on n-h2-862769-1 Oct 27 04:31:49.822908 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-42b81d0b-3361-412b-8068-5cf32f8da34c req-a2599fab-1e59-4280-98cc-3f02f9fe59a4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091679 Oct 27 04:31:49.823522 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3992/7690] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:31:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:31:50.598732 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9cd50ec4-ad75-448f-b30c-5ed774e0395d tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:31:50.599362 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9cd50ec4-ad75-448f-b30c-5ed774e0395d tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] [instance: b3347a30-3bdb-4e3d-aaa4-080e0eadee21] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:31:50.610089 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9cd50ec4-ad75-448f-b30c-5ed774e0395d tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:50.610671 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9cd50ec4-ad75-448f-b30c-5ed774e0395d tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:50.611124 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9cd50ec4-ad75-448f-b30c-5ed774e0395d tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:50.611904 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9cd50ec4-ad75-448f-b30c-5ed774e0395d tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:50.612375 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9cd50ec4-ad75-448f-b30c-5ed774e0395d tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:50.612851 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9cd50ec4-ad75-448f-b30c-5ed774e0395d tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:50.749503 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9cd50ec4-ad75-448f-b30c-5ed774e0395d tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b507cef618e4b7ea712a96f014b0b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba1782ef9544e6d9fb7da0a1389ef48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:31:50.753869 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9cd50ec4-ad75-448f-b30c-5ed774e0395d tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] 10.222.0.20 "GET /compute/v2.1/servers/b3347a30-3bdb-4e3d-aaa4-080e0eadee21" status: 200 len: 1316 microversion: 2.1 time: 0.159232 Oct 27 04:31:50.754605 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3699/7691] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:31:50 2022] GET /compute/v2.1/servers/b3347a30-3bdb-4e3d-aaa4-080e0eadee21 => generated 1316 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:31:51.780042 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-de9169d2-89ca-4faa-a3a0-a08158fca041 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:31:51.781066 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-de9169d2-89ca-4faa-a3a0-a08158fca041 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] [instance: b3347a30-3bdb-4e3d-aaa4-080e0eadee21] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:31:51.788564 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-de9169d2-89ca-4faa-a3a0-a08158fca041 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:51.789107 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-de9169d2-89ca-4faa-a3a0-a08158fca041 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:51.789569 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-de9169d2-89ca-4faa-a3a0-a08158fca041 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:51.790326 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-de9169d2-89ca-4faa-a3a0-a08158fca041 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:51.790804 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-de9169d2-89ca-4faa-a3a0-a08158fca041 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:51.791252 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-de9169d2-89ca-4faa-a3a0-a08158fca041 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:51.922281 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-de9169d2-89ca-4faa-a3a0-a08158fca041 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b507cef618e4b7ea712a96f014b0b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba1782ef9544e6d9fb7da0a1389ef48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:31:51.932754 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-de9169d2-89ca-4faa-a3a0-a08158fca041 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] 10.222.0.20 "GET /compute/v2.1/servers/b3347a30-3bdb-4e3d-aaa4-080e0eadee21" status: 200 len: 1316 microversion: 2.1 time: 0.157064 Oct 27 04:31:51.933352 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3993/7692] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:31:51 2022] GET /compute/v2.1/servers/b3347a30-3bdb-4e3d-aaa4-080e0eadee21 => generated 1316 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 04:31:52.956501 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1e5b9a1f-ba0c-49c9-bf94-a4ec86b61eea tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:31:52.957185 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1e5b9a1f-ba0c-49c9-bf94-a4ec86b61eea tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] [instance: b3347a30-3bdb-4e3d-aaa4-080e0eadee21] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:31:52.964025 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1e5b9a1f-ba0c-49c9-bf94-a4ec86b61eea tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:52.964518 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1e5b9a1f-ba0c-49c9-bf94-a4ec86b61eea tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:52.964964 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1e5b9a1f-ba0c-49c9-bf94-a4ec86b61eea tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:52.965666 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1e5b9a1f-ba0c-49c9-bf94-a4ec86b61eea tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:52.966165 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1e5b9a1f-ba0c-49c9-bf94-a4ec86b61eea tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:52.966604 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1e5b9a1f-ba0c-49c9-bf94-a4ec86b61eea tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:53.093822 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1e5b9a1f-ba0c-49c9-bf94-a4ec86b61eea tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b507cef618e4b7ea712a96f014b0b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba1782ef9544e6d9fb7da0a1389ef48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:31:53.101742 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1e5b9a1f-ba0c-49c9-bf94-a4ec86b61eea tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] 10.222.0.20 "GET /compute/v2.1/servers/b3347a30-3bdb-4e3d-aaa4-080e0eadee21" status: 200 len: 1316 microversion: 2.1 time: 0.149160 Oct 27 04:31:53.102351 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3700/7693] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:31:52 2022] GET /compute/v2.1/servers/b3347a30-3bdb-4e3d-aaa4-080e0eadee21 => generated 1316 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:31:54.124921 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3041f72f-d4ee-4608-a44f-4160594734be tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:31:54.125573 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3041f72f-d4ee-4608-a44f-4160594734be tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] [instance: b3347a30-3bdb-4e3d-aaa4-080e0eadee21] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:31:54.132510 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3041f72f-d4ee-4608-a44f-4160594734be tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:54.133024 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3041f72f-d4ee-4608-a44f-4160594734be tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:54.133492 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3041f72f-d4ee-4608-a44f-4160594734be tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:54.134255 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3041f72f-d4ee-4608-a44f-4160594734be tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:54.134740 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3041f72f-d4ee-4608-a44f-4160594734be tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:54.135198 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3041f72f-d4ee-4608-a44f-4160594734be tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:54.262774 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3041f72f-d4ee-4608-a44f-4160594734be tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b507cef618e4b7ea712a96f014b0b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba1782ef9544e6d9fb7da0a1389ef48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:31:54.270512 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3041f72f-d4ee-4608-a44f-4160594734be tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] 10.222.0.20 "GET /compute/v2.1/servers/b3347a30-3bdb-4e3d-aaa4-080e0eadee21" status: 200 len: 1316 microversion: 2.1 time: 0.149534 Oct 27 04:31:54.271091 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3994/7694] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:31:54 2022] GET /compute/v2.1/servers/b3347a30-3bdb-4e3d-aaa4-080e0eadee21 => generated 1316 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:31:55.292783 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8dbe64c4-1286-40e8-a9de-f732ad14c50f tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:31:55.293403 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8dbe64c4-1286-40e8-a9de-f732ad14c50f tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] [instance: b3347a30-3bdb-4e3d-aaa4-080e0eadee21] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:31:55.300284 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8dbe64c4-1286-40e8-a9de-f732ad14c50f tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:55.301829 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8dbe64c4-1286-40e8-a9de-f732ad14c50f tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:55.301829 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8dbe64c4-1286-40e8-a9de-f732ad14c50f tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:55.302124 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8dbe64c4-1286-40e8-a9de-f732ad14c50f tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:55.302410 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8dbe64c4-1286-40e8-a9de-f732ad14c50f tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:55.302846 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8dbe64c4-1286-40e8-a9de-f732ad14c50f tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:55.434009 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8dbe64c4-1286-40e8-a9de-f732ad14c50f tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b507cef618e4b7ea712a96f014b0b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba1782ef9544e6d9fb7da0a1389ef48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:31:55.441754 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8dbe64c4-1286-40e8-a9de-f732ad14c50f tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] 10.222.0.20 "GET /compute/v2.1/servers/b3347a30-3bdb-4e3d-aaa4-080e0eadee21" status: 200 len: 1316 microversion: 2.1 time: 0.152824 Oct 27 04:31:55.442438 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3701/7695] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:31:55 2022] GET /compute/v2.1/servers/b3347a30-3bdb-4e3d-aaa4-080e0eadee21 => generated 1316 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:31:55.475010 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-0074a879-cfcb-41f9-bbbf-7e28b9e30e31 req-379415ab-7317-4233-841a-4834e5e2c1b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3347a30-3bdb-4e3d-aaa4-080e0eadee21", "name": "network-vif-plugged", "status": "completed", "tag": "f93199b3-eb72-4c3f-a261-828fff99d57e"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:31:55.485613 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-0074a879-cfcb-41f9-bbbf-7e28b9e30e31 req-379415ab-7317-4233-841a-4834e5e2c1b2 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:55.486157 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-0074a879-cfcb-41f9-bbbf-7e28b9e30e31 req-379415ab-7317-4233-841a-4834e5e2c1b2 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:55.486621 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-0074a879-cfcb-41f9-bbbf-7e28b9e30e31 req-379415ab-7317-4233-841a-4834e5e2c1b2 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:55.501069 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-0074a879-cfcb-41f9-bbbf-7e28b9e30e31 req-379415ab-7317-4233-841a-4834e5e2c1b2 service nova] Creating event network-vif-plugged:f93199b3-eb72-4c3f-a261-828fff99d57e for instance b3347a30-3bdb-4e3d-aaa4-080e0eadee21 on n-h2-862769-1 Oct 27 04:31:55.506121 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-0074a879-cfcb-41f9-bbbf-7e28b9e30e31 req-379415ab-7317-4233-841a-4834e5e2c1b2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035022 Oct 27 04:31:55.506799 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3995/7696] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:31:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:31:56.465783 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4962b9aa-b01c-4b69-add6-d0fefffbbff1 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:31:56.466470 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4962b9aa-b01c-4b69-add6-d0fefffbbff1 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] [instance: b3347a30-3bdb-4e3d-aaa4-080e0eadee21] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:31:56.468346 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:31:56.469034 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=6 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:31:56.475027 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4962b9aa-b01c-4b69-add6-d0fefffbbff1 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:56.480459 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4962b9aa-b01c-4b69-add6-d0fefffbbff1 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:56.480459 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4962b9aa-b01c-4b69-add6-d0fefffbbff1 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:56.480459 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4962b9aa-b01c-4b69-add6-d0fefffbbff1 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:56.480459 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4962b9aa-b01c-4b69-add6-d0fefffbbff1 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:56.480459 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4962b9aa-b01c-4b69-add6-d0fefffbbff1 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:56.621474 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4962b9aa-b01c-4b69-add6-d0fefffbbff1 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b507cef618e4b7ea712a96f014b0b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba1782ef9544e6d9fb7da0a1389ef48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:31:56.629193 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4962b9aa-b01c-4b69-add6-d0fefffbbff1 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] 10.222.0.20 "GET /compute/v2.1/servers/b3347a30-3bdb-4e3d-aaa4-080e0eadee21" status: 200 len: 1316 microversion: 2.1 time: 0.167295 Oct 27 04:31:56.629787 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3702/7697] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:31:56 2022] GET /compute/v2.1/servers/b3347a30-3bdb-4e3d-aaa4-080e0eadee21 => generated 1316 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 04:31:57.649820 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:31:57.654909 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c8cda4f1-cf99-4d8a-8744-394611060dcf tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:31:57.659039 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c8cda4f1-cf99-4d8a-8744-394611060dcf tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] [instance: b3347a30-3bdb-4e3d-aaa4-080e0eadee21] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:31:57.661746 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c8cda4f1-cf99-4d8a-8744-394611060dcf tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:57.662294 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c8cda4f1-cf99-4d8a-8744-394611060dcf tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:57.662765 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c8cda4f1-cf99-4d8a-8744-394611060dcf tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:57.664142 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c8cda4f1-cf99-4d8a-8744-394611060dcf tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:57.664619 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c8cda4f1-cf99-4d8a-8744-394611060dcf tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:57.665071 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c8cda4f1-cf99-4d8a-8744-394611060dcf tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:57.800545 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c8cda4f1-cf99-4d8a-8744-394611060dcf tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b507cef618e4b7ea712a96f014b0b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba1782ef9544e6d9fb7da0a1389ef48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:31:57.808577 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c8cda4f1-cf99-4d8a-8744-394611060dcf tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] 10.222.0.20 "GET /compute/v2.1/servers/b3347a30-3bdb-4e3d-aaa4-080e0eadee21" status: 200 len: 1505 microversion: 2.1 time: 0.159705 Oct 27 04:31:57.814190 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3996/7698] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:31:57 2022] GET /compute/v2.1/servers/b3347a30-3bdb-4e3d-aaa4-080e0eadee21 => generated 1505 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:31:57.832019 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2cc83a55-0212-4c10-80df-3508a0abfd00 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:31:57.832553 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-2cc83a55-0212-4c10-80df-3508a0abfd00 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] [instance: b3347a30-3bdb-4e3d-aaa4-080e0eadee21] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:31:57.839219 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2cc83a55-0212-4c10-80df-3508a0abfd00 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:57.844564 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2cc83a55-0212-4c10-80df-3508a0abfd00 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:57.844564 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2cc83a55-0212-4c10-80df-3508a0abfd00 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:57.844564 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2cc83a55-0212-4c10-80df-3508a0abfd00 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:57.844564 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2cc83a55-0212-4c10-80df-3508a0abfd00 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:57.844564 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2cc83a55-0212-4c10-80df-3508a0abfd00 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:57.866856 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-2cc83a55-0212-4c10-80df-3508a0abfd00 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] [instance: b3347a30-3bdb-4e3d-aaa4-080e0eadee21] Going to try to terminate instance {{(pid=121000) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 04:31:58.145691 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2cc83a55-0212-4c10-80df-3508a0abfd00 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b3347a30-3bdb-4e3d-aaa4-080e0eadee21" status: 204 len: 0 microversion: 2.1 time: 0.317778 Oct 27 04:31:58.146341 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3703/7699] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 04:31:57 2022] DELETE /compute/v2.1/servers/b3347a30-3bdb-4e3d-aaa4-080e0eadee21 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 04:31:58.156273 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-138366b8-294a-4470-adc4-6eb4d9c162ca tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:31:58.159686 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-138366b8-294a-4470-adc4-6eb4d9c162ca tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] [instance: b3347a30-3bdb-4e3d-aaa4-080e0eadee21] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:31:58.163008 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-138366b8-294a-4470-adc4-6eb4d9c162ca tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:58.163545 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-138366b8-294a-4470-adc4-6eb4d9c162ca tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:58.164004 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-138366b8-294a-4470-adc4-6eb4d9c162ca tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:58.164726 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-138366b8-294a-4470-adc4-6eb4d9c162ca tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:58.165197 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-138366b8-294a-4470-adc4-6eb4d9c162ca tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:58.165637 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-138366b8-294a-4470-adc4-6eb4d9c162ca tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:58.294295 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-138366b8-294a-4470-adc4-6eb4d9c162ca tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b507cef618e4b7ea712a96f014b0b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba1782ef9544e6d9fb7da0a1389ef48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:31:58.302010 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-138366b8-294a-4470-adc4-6eb4d9c162ca tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] 10.222.0.20 "GET /compute/v2.1/servers/b3347a30-3bdb-4e3d-aaa4-080e0eadee21" status: 200 len: 1511 microversion: 2.1 time: 0.150893 Oct 27 04:31:58.302605 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3997/7700] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:31:58 2022] GET /compute/v2.1/servers/b3347a30-3bdb-4e3d-aaa4-080e0eadee21 => generated 1511 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:31:59.325899 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0bdd89e6-e6af-4ce8-a47b-915d3386c0e9 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:31:59.327352 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0bdd89e6-e6af-4ce8-a47b-915d3386c0e9 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] [instance: b3347a30-3bdb-4e3d-aaa4-080e0eadee21] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:31:59.334597 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0bdd89e6-e6af-4ce8-a47b-915d3386c0e9 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:59.335100 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0bdd89e6-e6af-4ce8-a47b-915d3386c0e9 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:59.336142 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0bdd89e6-e6af-4ce8-a47b-915d3386c0e9 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:59.336898 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0bdd89e6-e6af-4ce8-a47b-915d3386c0e9 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:31:59.337375 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0bdd89e6-e6af-4ce8-a47b-915d3386c0e9 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:31:59.337813 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0bdd89e6-e6af-4ce8-a47b-915d3386c0e9 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:31:59.480268 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0bdd89e6-e6af-4ce8-a47b-915d3386c0e9 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b507cef618e4b7ea712a96f014b0b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba1782ef9544e6d9fb7da0a1389ef48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:31:59.488538 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0bdd89e6-e6af-4ce8-a47b-915d3386c0e9 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] 10.222.0.20 "GET /compute/v2.1/servers/b3347a30-3bdb-4e3d-aaa4-080e0eadee21" status: 200 len: 1511 microversion: 2.1 time: 0.166862 Oct 27 04:31:59.489116 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3704/7701] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:31:59 2022] GET /compute/v2.1/servers/b3347a30-3bdb-4e3d-aaa4-080e0eadee21 => generated 1511 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:32:00.097662 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-a8da9662-034b-43de-bbe8-23528fd1f928 req-dc0c6d8a-c270-438f-8eb5-c2e8a705daba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3347a30-3bdb-4e3d-aaa4-080e0eadee21", "name": "network-vif-deleted", "tag": "f93199b3-eb72-4c3f-a261-828fff99d57e"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:32:00.114313 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-a8da9662-034b-43de-bbe8-23528fd1f928 req-dc0c6d8a-c270-438f-8eb5-c2e8a705daba service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:32:00.117581 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-a8da9662-034b-43de-bbe8-23528fd1f928 req-dc0c6d8a-c270-438f-8eb5-c2e8a705daba service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:32:00.117581 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-a8da9662-034b-43de-bbe8-23528fd1f928 req-dc0c6d8a-c270-438f-8eb5-c2e8a705daba service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:32:00.129016 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-a8da9662-034b-43de-bbe8-23528fd1f928 req-dc0c6d8a-c270-438f-8eb5-c2e8a705daba service nova] Creating event network-vif-deleted:f93199b3-eb72-4c3f-a261-828fff99d57e for instance b3347a30-3bdb-4e3d-aaa4-080e0eadee21 on n-h2-862769-1 Oct 27 04:32:00.134448 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-a8da9662-034b-43de-bbe8-23528fd1f928 req-dc0c6d8a-c270-438f-8eb5-c2e8a705daba service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040770 Oct 27 04:32:00.135318 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3998/7702] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:32:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 04:32:00.511179 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-26ea2d2f-cb4f-4eb6-8bc1-10b743c7fa4b tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:32:00.511807 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-26ea2d2f-cb4f-4eb6-8bc1-10b743c7fa4b tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] [instance: b3347a30-3bdb-4e3d-aaa4-080e0eadee21] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:32:00.518687 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-26ea2d2f-cb4f-4eb6-8bc1-10b743c7fa4b tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:32:00.519182 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-26ea2d2f-cb4f-4eb6-8bc1-10b743c7fa4b tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:32:00.519630 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-26ea2d2f-cb4f-4eb6-8bc1-10b743c7fa4b tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:32:00.520365 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-26ea2d2f-cb4f-4eb6-8bc1-10b743c7fa4b tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:32:00.520830 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-26ea2d2f-cb4f-4eb6-8bc1-10b743c7fa4b tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:32:00.521273 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-26ea2d2f-cb4f-4eb6-8bc1-10b743c7fa4b tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:32:00.553067 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-26ea2d2f-cb4f-4eb6-8bc1-10b743c7fa4b tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:32:00.553555 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-26ea2d2f-cb4f-4eb6-8bc1-10b743c7fa4b tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:32:00.554045 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-26ea2d2f-cb4f-4eb6-8bc1-10b743c7fa4b tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:32:00.554505 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-26ea2d2f-cb4f-4eb6-8bc1-10b743c7fa4b tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lazy-loading 'fault' on Instance uuid b3347a30-3bdb-4e3d-aaa4-080e0eadee21 {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 04:32:00.598779 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-26ea2d2f-cb4f-4eb6-8bc1-10b743c7fa4b tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b507cef618e4b7ea712a96f014b0b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba1782ef9544e6d9fb7da0a1389ef48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:32:00.602879 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:32:00.607526 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-26ea2d2f-cb4f-4eb6-8bc1-10b743c7fa4b tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] 10.222.0.20 "GET /compute/v2.1/servers/b3347a30-3bdb-4e3d-aaa4-080e0eadee21" status: 200 len: 1306 microversion: 2.1 time: 0.100518 Oct 27 04:32:00.608112 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3705/7703] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:32:00 2022] GET /compute/v2.1/servers/b3347a30-3bdb-4e3d-aaa4-080e0eadee21 => generated 1306 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:32:01.631971 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-216d801d-8af6-4b37-afc2-635f9e91530c tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:32:01.632714 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-216d801d-8af6-4b37-afc2-635f9e91530c tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] [instance: b3347a30-3bdb-4e3d-aaa4-080e0eadee21] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:32:01.639138 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-216d801d-8af6-4b37-afc2-635f9e91530c tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:32:01.639646 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-216d801d-8af6-4b37-afc2-635f9e91530c tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:32:01.640108 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-216d801d-8af6-4b37-afc2-635f9e91530c tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:32:01.640862 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-216d801d-8af6-4b37-afc2-635f9e91530c tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:32:01.641342 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-216d801d-8af6-4b37-afc2-635f9e91530c tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:32:01.641794 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-216d801d-8af6-4b37-afc2-635f9e91530c tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:32:01.655165 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-216d801d-8af6-4b37-afc2-635f9e91530c tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] HTTP exception thrown: Instance b3347a30-3bdb-4e3d-aaa4-080e0eadee21 could not be found. Oct 27 04:32:01.656905 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-216d801d-8af6-4b37-afc2-635f9e91530c tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Request method failure captured: Oct 27 04:32:01.656905 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/b3347a30-3bdb-4e3d-aaa4-080e0eadee21 HTTP/1.1 Oct 27 04:32:01.656905 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 04:32:01.656905 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 04:32:01.656905 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 04:32:01.656905 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 04:32:01.656905 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 04:32:01.656905 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 04:32:01.656905 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 04:32:01.656905 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 04:32:01.656905 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWgmjsIj8UPo89lksfzObKSwYLKgAWLQFbfdXMSQn_zeKTM6fvA3Ib8g5bxPtL9sBw182uwhjt2IV2dT4R9LLdN8c4RT8_e6KTDq61i7MgsGCJPXKVVX7YRhT0cAtZFsVFZwPescNvHrQedJuXU0P_YuASQjKCn-gJ677yVqEAOl1qxg Oct 27 04:32:01.656905 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 04:32:01.656905 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 04:32:01.656905 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 04:32:01.656905 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 04:32:01.656905 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 04:32:01.656905 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 04:32:01.656905 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: eba1782ef9544e6d9fb7da0a1389ef48 Oct 27 04:32:01.656905 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServersNegativeTestJSON-1024124087 Oct 27 04:32:01.656905 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 04:32:01.656905 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 04:32:01.656905 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eba1782ef9544e6d9fb7da0a1389ef48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/eba1782ef9544e6d9fb7da0a1389ef48"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eba1782ef9544e6d9fb7da0a1389ef48"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_eba1782ef9544e6d9fb7da0a1389ef48"}]}] Oct 27 04:32:01.656905 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServersNegativeTestJSON-1024124087 Oct 27 04:32:01.656905 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: eba1782ef9544e6d9fb7da0a1389ef48 Oct 27 04:32:01.656905 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1024124087 Oct 27 04:32:01.656905 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServersNegativeTestJSON-1024124087-project Oct 27 04:32:01.656905 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 04:32:01.656905 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 04:32:01.656905 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 2b507cef618e4b7ea712a96f014b0b91 Oct 27 04:32:01.656905 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServersNegativeTestJSON-1024124087-project Oct 27 04:32:01.656905 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 04:32:01.656905 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance b3347a30-3bdb-4e3d-aaa4-080e0eadee21 could not be found. Oct 27 04:32:01.656905 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': 'b3347a30-3bdb-4e3d-aaa4-080e0eadee21'} Oct 27 04:32:01.656905 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 04:32:01.656905 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:32:01.656905 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 04:32:01.656905 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 04:32:01.656905 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 04:32:01.656905 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 04:32:01.656905 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 04:32:01.656905 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 04:32:01.656905 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 04:32:01.656905 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 04:32:01.656905 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3347a30-3bdb-4e3d-aaa4-080e0eadee21 could not be found. Oct 27 04:32:01.656905 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:32:01.656905 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:32:01.656905 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:32:01.656905 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:32:01.656905 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:32:01.656905 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:32:01.656905 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 04:32:01.656905 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 04:32:01.656905 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 04:32:01.656905 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 04:32:01.656905 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 04:32:01.656905 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 04:32:01.656905 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 04:32:01.656905 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 04:32:01.656905 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 04:32:01.656905 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 04:32:01.656905 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3347a30-3bdb-4e3d-aaa4-080e0eadee21 could not be found. Oct 27 04:32:01.656905 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:32:01.656905 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:32:01.656905 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:32:01.662145 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:32:01.662145 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:32:01.662145 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:32:01.662145 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 04:32:01.662145 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 04:32:01.662145 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3347a30-3bdb-4e3d-aaa4-080e0eadee21 could not be found. Oct 27 04:32:01.662145 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:32:01.662145 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-216d801d-8af6-4b37-afc2-635f9e91530c tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Returning 404 to user: Instance b3347a30-3bdb-4e3d-aaa4-080e0eadee21 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 04:32:01.662145 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-216d801d-8af6-4b37-afc2-635f9e91530c tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] 10.222.0.20 "GET /compute/v2.1/servers/b3347a30-3bdb-4e3d-aaa4-080e0eadee21" status: 404 len: 111 microversion: 2.1 time: 0.031597 Oct 27 04:32:01.662145 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 3999/7704] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:32:01 2022] GET /compute/v2.1/servers/b3347a30-3bdb-4e3d-aaa4-080e0eadee21 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 04:32:01.668346 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-655ba3cb-c9bd-4cc7-aad2-8ce428e0e0d8 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:32:01.669005 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-655ba3cb-c9bd-4cc7-aad2-8ce428e0e0d8 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] [instance: 875ae006-5b22-49e0-b8d9-85652ee65f70] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:32:01.676498 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-655ba3cb-c9bd-4cc7-aad2-8ce428e0e0d8 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:32:01.676982 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-655ba3cb-c9bd-4cc7-aad2-8ce428e0e0d8 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:32:01.677427 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-655ba3cb-c9bd-4cc7-aad2-8ce428e0e0d8 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:32:01.678464 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-655ba3cb-c9bd-4cc7-aad2-8ce428e0e0d8 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:32:01.678927 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-655ba3cb-c9bd-4cc7-aad2-8ce428e0e0d8 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:32:01.680015 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-655ba3cb-c9bd-4cc7-aad2-8ce428e0e0d8 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:32:01.812204 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-655ba3cb-c9bd-4cc7-aad2-8ce428e0e0d8 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b507cef618e4b7ea712a96f014b0b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba1782ef9544e6d9fb7da0a1389ef48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:32:01.819918 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-655ba3cb-c9bd-4cc7-aad2-8ce428e0e0d8 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] 10.222.0.20 "GET /compute/v2.1/servers/875ae006-5b22-49e0-b8d9-85652ee65f70" status: 200 len: 1504 microversion: 2.1 time: 0.156357 Oct 27 04:32:01.820490 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3706/7705] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:32:01 2022] GET /compute/v2.1/servers/875ae006-5b22-49e0-b8d9-85652ee65f70 => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 04:32:01.842226 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-92219312-5727-4953-86a2-4cdefac1568c tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:32:01.844508 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-92219312-5727-4953-86a2-4cdefac1568c tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] [instance: 99fe0b06-b425-436d-808e-de0062d3968a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:32:01.846781 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:32:01.851796 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-92219312-5727-4953-86a2-4cdefac1568c tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] HTTP exception thrown: Instance 99fe0b06-b425-436d-808e-de0062d3968a could not be found. Oct 27 04:32:01.853422 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-92219312-5727-4953-86a2-4cdefac1568c tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Request method failure captured: Oct 27 04:32:01.853422 n-d-862769-1 devstack@n-api.service[121001]: request: POST /compute/v2.1/servers/99fe0b06-b425-436d-808e-de0062d3968a/action HTTP/1.1 Oct 27 04:32:01.853422 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 04:32:01.853422 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 04:32:01.853422 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 04:32:01.853422 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 32 Oct 27 04:32:01.853422 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 04:32:01.853422 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 04:32:01.853422 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 04:32:01.853422 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 04:32:01.853422 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWgmjsIj8UPo89lksfzObKSwYLKgAWLQFbfdXMSQn_zeKTM6fvA3Ib8g5bxPtL9sBw182uwhjt2IV2dT4R9LLdN8c4RT8_e6KTDq61i7MgsGCJPXKVVX7YRhT0cAtZFsVFZwPescNvHrQedJuXU0P_YuASQjKCn-gJ677yVqEAOl1qxg Oct 27 04:32:01.853422 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 04:32:01.853422 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 04:32:01.853422 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 04:32:01.853422 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 04:32:01.853422 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 04:32:01.853422 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 04:32:01.853422 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: eba1782ef9544e6d9fb7da0a1389ef48 Oct 27 04:32:01.853422 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServersNegativeTestJSON-1024124087 Oct 27 04:32:01.853422 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 04:32:01.853422 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 04:32:01.853422 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eba1782ef9544e6d9fb7da0a1389ef48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/eba1782ef9544e6d9fb7da0a1389ef48"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eba1782ef9544e6d9fb7da0a1389ef48"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_eba1782ef9544e6d9fb7da0a1389ef48"}]}] Oct 27 04:32:01.853422 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServersNegativeTestJSON-1024124087 Oct 27 04:32:01.853422 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: eba1782ef9544e6d9fb7da0a1389ef48 Oct 27 04:32:01.853422 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1024124087 Oct 27 04:32:01.853422 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServersNegativeTestJSON-1024124087-project Oct 27 04:32:01.853422 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 04:32:01.853422 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 04:32:01.853422 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 2b507cef618e4b7ea712a96f014b0b91 Oct 27 04:32:01.853422 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServersNegativeTestJSON-1024124087-project Oct 27 04:32:01.853422 n-d-862769-1 devstack@n-api.service[121001]: Oct 27 04:32:01.853422 n-d-862769-1 devstack@n-api.service[121001]: {"resize": {"flavorRef": "452"}} Oct 27 04:32:01.853422 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 04:32:01.853422 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 99fe0b06-b425-436d-808e-de0062d3968a could not be found. Oct 27 04:32:01.853422 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '99fe0b06-b425-436d-808e-de0062d3968a', 'body': {'resize': {'flavorRef': '452'}}} Oct 27 04:32:01.853422 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 04:32:01.853422 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:32:01.853422 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 04:32:01.853422 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 04:32:01.853422 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 04:32:01.853422 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 04:32:01.853422 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 04:32:01.853422 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 04:32:01.853422 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99fe0b06-b425-436d-808e-de0062d3968a could not be found. Oct 27 04:32:01.853422 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:32:01.853422 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:32:01.853422 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:32:01.853422 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:32:01.853422 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:32:01.853422 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:32:01.853422 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 04:32:01.853422 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 04:32:01.853422 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 04:32:01.853422 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 04:32:01.853422 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 04:32:01.853422 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 04:32:01.853422 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 27 04:32:01.853422 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 27 04:32:01.853422 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Oct 27 04:32:01.853422 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Oct 27 04:32:01.853422 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 04:32:01.853422 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 04:32:01.853422 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 04:32:01.853422 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 04:32:01.859600 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99fe0b06-b425-436d-808e-de0062d3968a could not be found. Oct 27 04:32:01.859600 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:32:01.859600 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:32:01.859600 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:32:01.859600 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:32:01.859600 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:32:01.859600 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:32:01.859600 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 04:32:01.859600 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 04:32:01.859600 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99fe0b06-b425-436d-808e-de0062d3968a could not be found. Oct 27 04:32:01.859600 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:32:01.859600 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-92219312-5727-4953-86a2-4cdefac1568c tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Returning 404 to user: Instance 99fe0b06-b425-436d-808e-de0062d3968a could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 04:32:01.859600 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-92219312-5727-4953-86a2-4cdefac1568c tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] 10.222.0.20 "POST /compute/v2.1/servers/99fe0b06-b425-436d-808e-de0062d3968a/action" status: 404 len: 111 microversion: 2.1 time: 0.016667 Oct 27 04:32:01.859600 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4000/7706] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 04:32:01 2022] POST /compute/v2.1/servers/99fe0b06-b425-436d-808e-de0062d3968a/action => generated 111 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 04:32:01.863393 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-98a4eccc-b814-4654-b1af-2b33ed8fb5f4 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:32:01.864017 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-98a4eccc-b814-4654-b1af-2b33ed8fb5f4 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] [instance: 875ae006-5b22-49e0-b8d9-85652ee65f70] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:32:01.870523 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-98a4eccc-b814-4654-b1af-2b33ed8fb5f4 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:32:01.871008 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-98a4eccc-b814-4654-b1af-2b33ed8fb5f4 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:32:01.871449 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-98a4eccc-b814-4654-b1af-2b33ed8fb5f4 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:32:01.872143 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-98a4eccc-b814-4654-b1af-2b33ed8fb5f4 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:32:01.872640 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-98a4eccc-b814-4654-b1af-2b33ed8fb5f4 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:32:01.873068 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-98a4eccc-b814-4654-b1af-2b33ed8fb5f4 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:32:02.000826 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-98a4eccc-b814-4654-b1af-2b33ed8fb5f4 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b507cef618e4b7ea712a96f014b0b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba1782ef9544e6d9fb7da0a1389ef48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:32:02.008896 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-98a4eccc-b814-4654-b1af-2b33ed8fb5f4 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] 10.222.0.20 "GET /compute/v2.1/servers/875ae006-5b22-49e0-b8d9-85652ee65f70" status: 200 len: 1504 microversion: 2.1 time: 0.149044 Oct 27 04:32:02.009488 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3707/7707] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:32:01 2022] GET /compute/v2.1/servers/875ae006-5b22-49e0-b8d9-85652ee65f70 => generated 1504 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 04:32:02.032211 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2cf68918-777b-4ed9-988f-9e62f465d607 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:32:02.032861 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2cf68918-777b-4ed9-988f-9e62f465d607 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] [instance: 875ae006-5b22-49e0-b8d9-85652ee65f70] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:32:02.040910 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2cf68918-777b-4ed9-988f-9e62f465d607 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:32:02.041417 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2cf68918-777b-4ed9-988f-9e62f465d607 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:32:02.041883 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2cf68918-777b-4ed9-988f-9e62f465d607 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:32:02.042647 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2cf68918-777b-4ed9-988f-9e62f465d607 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:32:02.043125 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2cf68918-777b-4ed9-988f-9e62f465d607 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:32:02.043578 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2cf68918-777b-4ed9-988f-9e62f465d607 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:32:02.046166 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=73 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:32:02.174673 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2cf68918-777b-4ed9-988f-9e62f465d607 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b507cef618e4b7ea712a96f014b0b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba1782ef9544e6d9fb7da0a1389ef48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:32:02.182595 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2cf68918-777b-4ed9-988f-9e62f465d607 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] 10.222.0.20 "GET /compute/v2.1/servers/875ae006-5b22-49e0-b8d9-85652ee65f70" status: 200 len: 1504 microversion: 2.1 time: 0.154236 Oct 27 04:32:02.183178 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4001/7708] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:32:02 2022] GET /compute/v2.1/servers/875ae006-5b22-49e0-b8d9-85652ee65f70 => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 04:32:02.206328 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-893224f2-27c0-42fa-a062-c4dd7aa54be6 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "862bdb8a-6275-45ef-a2cb-4b3604bfb114"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:32:02.208678 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-893224f2-27c0-42fa-a062-c4dd7aa54be6 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] [instance: 875ae006-5b22-49e0-b8d9-85652ee65f70] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:32:02.215436 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-893224f2-27c0-42fa-a062-c4dd7aa54be6 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:32:02.215935 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-893224f2-27c0-42fa-a062-c4dd7aa54be6 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:32:02.216373 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-893224f2-27c0-42fa-a062-c4dd7aa54be6 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:32:02.217070 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-893224f2-27c0-42fa-a062-c4dd7aa54be6 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:32:02.217529 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-893224f2-27c0-42fa-a062-c4dd7aa54be6 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:32:02.217956 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-893224f2-27c0-42fa-a062-c4dd7aa54be6 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:32:02.260688 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-893224f2-27c0-42fa-a062-c4dd7aa54be6 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '2b507cef618e4b7ea712a96f014b0b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba1782ef9544e6d9fb7da0a1389ef48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:32:02.265738 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-893224f2-27c0-42fa-a062-c4dd7aa54be6 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] HTTP exception thrown: Flavor 862bdb8a-6275-45ef-a2cb-4b3604bfb114 could not be found. Oct 27 04:32:02.267815 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-893224f2-27c0-42fa-a062-c4dd7aa54be6 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Request method failure captured: Oct 27 04:32:02.267815 n-d-862769-1 devstack@n-api.service[121000]: request: POST /compute/v2.1/servers/875ae006-5b22-49e0-b8d9-85652ee65f70/action HTTP/1.1 Oct 27 04:32:02.267815 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 04:32:02.267815 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 04:32:02.267815 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 04:32:02.267815 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 65 Oct 27 04:32:02.267815 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 04:32:02.267815 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 04:32:02.267815 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 04:32:02.267815 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 04:32:02.267815 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWgmjsIj8UPo89lksfzObKSwYLKgAWLQFbfdXMSQn_zeKTM6fvA3Ib8g5bxPtL9sBw182uwhjt2IV2dT4R9LLdN8c4RT8_e6KTDq61i7MgsGCJPXKVVX7YRhT0cAtZFsVFZwPescNvHrQedJuXU0P_YuASQjKCn-gJ677yVqEAOl1qxg Oct 27 04:32:02.267815 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 04:32:02.267815 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 04:32:02.267815 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 04:32:02.267815 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 04:32:02.267815 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 04:32:02.267815 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 04:32:02.267815 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: eba1782ef9544e6d9fb7da0a1389ef48 Oct 27 04:32:02.267815 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ServersNegativeTestJSON-1024124087 Oct 27 04:32:02.267815 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 04:32:02.267815 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 04:32:02.267815 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eba1782ef9544e6d9fb7da0a1389ef48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/eba1782ef9544e6d9fb7da0a1389ef48"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eba1782ef9544e6d9fb7da0a1389ef48"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_eba1782ef9544e6d9fb7da0a1389ef48"}]}] Oct 27 04:32:02.267815 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ServersNegativeTestJSON-1024124087 Oct 27 04:32:02.267815 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: eba1782ef9544e6d9fb7da0a1389ef48 Oct 27 04:32:02.267815 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1024124087 Oct 27 04:32:02.267815 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ServersNegativeTestJSON-1024124087-project Oct 27 04:32:02.267815 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 04:32:02.267815 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 04:32:02.267815 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 2b507cef618e4b7ea712a96f014b0b91 Oct 27 04:32:02.267815 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ServersNegativeTestJSON-1024124087-project Oct 27 04:32:02.267815 n-d-862769-1 devstack@n-api.service[121000]: Oct 27 04:32:02.267815 n-d-862769-1 devstack@n-api.service[121000]: {"resize": {"flavorRef": "862bdb8a-6275-45ef-a2cb-4b3604bfb114"}} Oct 27 04:32:02.267815 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 04:32:02.267815 n-d-862769-1 devstack@n-api.service[121000]: exception: Flavor 862bdb8a-6275-45ef-a2cb-4b3604bfb114 could not be found. Oct 27 04:32:02.267815 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '875ae006-5b22-49e0-b8d9-85652ee65f70', 'body': {'resize': {'flavorRef': '862bdb8a-6275-45ef-a2cb-4b3604bfb114'}}} Oct 27 04:32:02.267815 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 04:32:02.267815 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:32:02.267815 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 27 04:32:02.267815 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 27 04:32:02.267815 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 27 04:32:02.267815 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 04:32:02.267815 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 27 04:32:02.267815 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 27 04:32:02.267815 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 27 04:32:02.267815 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 27 04:32:02.267815 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 04:32:02.267815 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 04:32:02.267815 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 27 04:32:02.267815 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 27 04:32:02.267815 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 27 04:32:02.267815 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 04:32:02.267815 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4200, in resize Oct 27 04:32:02.267815 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Oct 27 04:32:02.267815 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 27 04:32:02.267815 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 27 04:32:02.267815 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 04:32:02.267815 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 04:32:02.267815 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 27 04:32:02.267815 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 27 04:32:02.267815 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 27 04:32:02.267815 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 04:32:02.267815 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 27 04:32:02.272604 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 27 04:32:02.272604 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 862bdb8a-6275-45ef-a2cb-4b3604bfb114 could not be found. Oct 27 04:32:02.272604 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:32:02.272604 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:32:02.272604 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:32:02.272604 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:32:02.272604 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:32:02.272604 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:32:02.272604 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 04:32:02.272604 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 04:32:02.272604 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 04:32:02.272604 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 04:32:02.272604 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 04:32:02.272604 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 04:32:02.272604 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 27 04:32:02.272604 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 27 04:32:02.272604 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Oct 27 04:32:02.272604 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 27 04:32:02.272604 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 862bdb8a-6275-45ef-a2cb-4b3604bfb114 could not be found. Oct 27 04:32:02.272604 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:32:02.272604 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:32:02.272604 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:32:02.272604 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:32:02.272604 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:32:02.272604 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:32:02.272604 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 04:32:02.272604 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 04:32:02.272604 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 862bdb8a-6275-45ef-a2cb-4b3604bfb114 could not be found. Oct 27 04:32:02.272604 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:32:02.272604 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-893224f2-27c0-42fa-a062-c4dd7aa54be6 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Returning 400 to user: Flavor 862bdb8a-6275-45ef-a2cb-4b3604bfb114 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 04:32:02.272604 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-893224f2-27c0-42fa-a062-c4dd7aa54be6 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] 10.222.0.20 "POST /compute/v2.1/servers/875ae006-5b22-49e0-b8d9-85652ee65f70/action" status: 400 len: 107 microversion: 2.1 time: 0.066923 Oct 27 04:32:02.272604 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3708/7709] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 04:32:02 2022] POST /compute/v2.1/servers/875ae006-5b22-49e0-b8d9-85652ee65f70/action => generated 107 bytes in 68 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 04:32:02.278788 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3238f6e7-beef-4967-8178-0bda1259d9d9 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:32:02.279439 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3238f6e7-beef-4967-8178-0bda1259d9d9 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] [instance: 875ae006-5b22-49e0-b8d9-85652ee65f70] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:32:02.285450 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3238f6e7-beef-4967-8178-0bda1259d9d9 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:32:02.285956 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3238f6e7-beef-4967-8178-0bda1259d9d9 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:32:02.286487 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3238f6e7-beef-4967-8178-0bda1259d9d9 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:32:02.287206 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3238f6e7-beef-4967-8178-0bda1259d9d9 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:32:02.287681 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3238f6e7-beef-4967-8178-0bda1259d9d9 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:32:02.288131 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3238f6e7-beef-4967-8178-0bda1259d9d9 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:32:02.413246 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3238f6e7-beef-4967-8178-0bda1259d9d9 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b507cef618e4b7ea712a96f014b0b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba1782ef9544e6d9fb7da0a1389ef48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:32:02.424828 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3238f6e7-beef-4967-8178-0bda1259d9d9 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] 10.222.0.20 "GET /compute/v2.1/servers/875ae006-5b22-49e0-b8d9-85652ee65f70" status: 200 len: 1504 microversion: 2.1 time: 0.150000 Oct 27 04:32:02.425419 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4002/7710] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:32:02 2022] GET /compute/v2.1/servers/875ae006-5b22-49e0-b8d9-85652ee65f70 => generated 1504 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:32:02.448337 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3850de8a-8e93-41e3-9dda-b13ea98e769a tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:32:02.448959 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-3850de8a-8e93-41e3-9dda-b13ea98e769a tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] [instance: 875ae006-5b22-49e0-b8d9-85652ee65f70] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:32:02.455170 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3850de8a-8e93-41e3-9dda-b13ea98e769a tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:32:02.455698 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3850de8a-8e93-41e3-9dda-b13ea98e769a tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:32:02.456182 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3850de8a-8e93-41e3-9dda-b13ea98e769a tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:32:02.456936 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3850de8a-8e93-41e3-9dda-b13ea98e769a tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:32:02.457345 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3850de8a-8e93-41e3-9dda-b13ea98e769a tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:32:02.457774 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3850de8a-8e93-41e3-9dda-b13ea98e769a tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:32:02.591507 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-3850de8a-8e93-41e3-9dda-b13ea98e769a tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b507cef618e4b7ea712a96f014b0b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba1782ef9544e6d9fb7da0a1389ef48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:32:02.600880 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3850de8a-8e93-41e3-9dda-b13ea98e769a tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] 10.222.0.20 "GET /compute/v2.1/servers/875ae006-5b22-49e0-b8d9-85652ee65f70" status: 200 len: 1504 microversion: 2.1 time: 0.156973 Oct 27 04:32:02.601468 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3709/7711] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:32:02 2022] GET /compute/v2.1/servers/875ae006-5b22-49e0-b8d9-85652ee65f70 => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:32:02.623338 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-63582768-2f6e-46f3-bab4-ed432b8f81ab tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:32:02.631365 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-63582768-2f6e-46f3-bab4-ed432b8f81ab tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Request method failure captured: Oct 27 04:32:02.631365 n-d-862769-1 devstack@n-api.service[121001]: request: POST /compute/v2.1/servers/875ae006-5b22-49e0-b8d9-85652ee65f70/action HTTP/1.1 Oct 27 04:32:02.631365 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 04:32:02.631365 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 04:32:02.631365 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 04:32:02.631365 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 29 Oct 27 04:32:02.631365 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 04:32:02.631365 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 04:32:02.631365 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 04:32:02.631365 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 04:32:02.631365 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWgmjsIj8UPo89lksfzObKSwYLKgAWLQFbfdXMSQn_zeKTM6fvA3Ib8g5bxPtL9sBw182uwhjt2IV2dT4R9LLdN8c4RT8_e6KTDq61i7MgsGCJPXKVVX7YRhT0cAtZFsVFZwPescNvHrQedJuXU0P_YuASQjKCn-gJ677yVqEAOl1qxg Oct 27 04:32:02.631365 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 04:32:02.631365 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 04:32:02.631365 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 04:32:02.631365 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 04:32:02.631365 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 04:32:02.631365 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 04:32:02.631365 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: eba1782ef9544e6d9fb7da0a1389ef48 Oct 27 04:32:02.631365 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServersNegativeTestJSON-1024124087 Oct 27 04:32:02.631365 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 04:32:02.631365 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 04:32:02.631365 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eba1782ef9544e6d9fb7da0a1389ef48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/eba1782ef9544e6d9fb7da0a1389ef48"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eba1782ef9544e6d9fb7da0a1389ef48"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_eba1782ef9544e6d9fb7da0a1389ef48"}]}] Oct 27 04:32:02.631365 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServersNegativeTestJSON-1024124087 Oct 27 04:32:02.631365 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: eba1782ef9544e6d9fb7da0a1389ef48 Oct 27 04:32:02.631365 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1024124087 Oct 27 04:32:02.631365 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServersNegativeTestJSON-1024124087-project Oct 27 04:32:02.631365 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 04:32:02.631365 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 04:32:02.631365 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 2b507cef618e4b7ea712a96f014b0b91 Oct 27 04:32:02.631365 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServersNegativeTestJSON-1024124087-project Oct 27 04:32:02.631365 n-d-862769-1 devstack@n-api.service[121001]: Oct 27 04:32:02.631365 n-d-862769-1 devstack@n-api.service[121001]: {"resize": {"flavorRef": ""}} Oct 27 04:32:02.631365 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 04:32:02.631365 n-d-862769-1 devstack@n-api.service[121001]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 27 04:32:02.631365 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '875ae006-5b22-49e0-b8d9-85652ee65f70', 'body': {'resize': {'flavorRef': ''}}} Oct 27 04:32:02.631365 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 04:32:02.631365 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:32:02.631365 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 04:32:02.631365 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 04:32:02.631365 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 04:32:02.631365 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise error Oct 27 04:32:02.631365 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 27 04:32:02.631365 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:32:02.631365 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Oct 27 04:32:02.631365 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Oct 27 04:32:02.631365 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:32:02.631365 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi On instance['resize']: Oct 27 04:32:02.631365 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi '' Oct 27 04:32:02.631365 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:32:02.631365 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:32:02.631365 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:32:02.631365 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:32:02.631365 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:32:02.631365 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:32:02.631365 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 04:32:02.631365 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 04:32:02.631365 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 04:32:02.631365 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 04:32:02.631365 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 04:32:02.631365 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 04:32:02.631365 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 04:32:02.631365 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 04:32:02.631365 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 04:32:02.631365 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 04:32:02.631365 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 27 04:32:02.631365 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:32:02.631365 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:32:02.637603 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:32:02.637603 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:32:02.637603 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:32:02.637603 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:32:02.637603 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 04:32:02.637603 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 04:32:02.637603 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 27 04:32:02.637603 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:32:02.637603 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-63582768-2f6e-46f3-bab4-ed432b8f81ab tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 04:32:02.637603 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-63582768-2f6e-46f3-bab4-ed432b8f81ab tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] 10.222.0.20 "POST /compute/v2.1/servers/875ae006-5b22-49e0-b8d9-85652ee65f70/action" status: 400 len: 113 microversion: 2.1 time: 0.009145 Oct 27 04:32:02.637603 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4003/7712] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 04:32:02 2022] POST /compute/v2.1/servers/875ae006-5b22-49e0-b8d9-85652ee65f70/action => generated 113 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 04:32:02.638614 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7c485df6-851d-458c-a298-e161ddf8d897 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:32:02.639150 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7c485df6-851d-458c-a298-e161ddf8d897 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] [instance: 875ae006-5b22-49e0-b8d9-85652ee65f70] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:32:02.645296 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7c485df6-851d-458c-a298-e161ddf8d897 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:32:02.645789 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7c485df6-851d-458c-a298-e161ddf8d897 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:32:02.646275 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7c485df6-851d-458c-a298-e161ddf8d897 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:32:02.646981 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7c485df6-851d-458c-a298-e161ddf8d897 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:32:02.647443 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7c485df6-851d-458c-a298-e161ddf8d897 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:32:02.648531 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7c485df6-851d-458c-a298-e161ddf8d897 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:32:02.782748 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7c485df6-851d-458c-a298-e161ddf8d897 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b507cef618e4b7ea712a96f014b0b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba1782ef9544e6d9fb7da0a1389ef48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:32:02.790595 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7c485df6-851d-458c-a298-e161ddf8d897 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] 10.222.0.20 "GET /compute/v2.1/servers/875ae006-5b22-49e0-b8d9-85652ee65f70" status: 200 len: 1504 microversion: 2.1 time: 0.155871 Oct 27 04:32:02.791401 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3710/7713] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:32:02 2022] GET /compute/v2.1/servers/875ae006-5b22-49e0-b8d9-85652ee65f70 => generated 1504 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:32:02.819215 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-bbbae41b-0104-456c-addd-27a982c0a451 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:32:02.820330 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-bbbae41b-0104-456c-addd-27a982c0a451 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] [instance: b3347a30-3bdb-4e3d-aaa4-080e0eadee21] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:32:02.827636 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bbbae41b-0104-456c-addd-27a982c0a451 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:32:02.828151 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bbbae41b-0104-456c-addd-27a982c0a451 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:32:02.828614 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bbbae41b-0104-456c-addd-27a982c0a451 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:32:02.829340 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bbbae41b-0104-456c-addd-27a982c0a451 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:32:02.829819 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bbbae41b-0104-456c-addd-27a982c0a451 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:32:02.830314 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bbbae41b-0104-456c-addd-27a982c0a451 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:32:02.843567 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-bbbae41b-0104-456c-addd-27a982c0a451 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] HTTP exception thrown: Instance b3347a30-3bdb-4e3d-aaa4-080e0eadee21 could not be found. Oct 27 04:32:02.845446 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-bbbae41b-0104-456c-addd-27a982c0a451 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Request method failure captured: Oct 27 04:32:02.845446 n-d-862769-1 devstack@n-api.service[121001]: request: DELETE /compute/v2.1/servers/b3347a30-3bdb-4e3d-aaa4-080e0eadee21 HTTP/1.1 Oct 27 04:32:02.845446 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 04:32:02.845446 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 04:32:02.845446 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 04:32:02.845446 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 04:32:02.845446 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 04:32:02.845446 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 04:32:02.845446 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 04:32:02.845446 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 04:32:02.845446 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWgmjsIj8UPo89lksfzObKSwYLKgAWLQFbfdXMSQn_zeKTM6fvA3Ib8g5bxPtL9sBw182uwhjt2IV2dT4R9LLdN8c4RT8_e6KTDq61i7MgsGCJPXKVVX7YRhT0cAtZFsVFZwPescNvHrQedJuXU0P_YuASQjKCn-gJ677yVqEAOl1qxg Oct 27 04:32:02.845446 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 04:32:02.845446 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 04:32:02.845446 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 04:32:02.845446 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 04:32:02.845446 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 04:32:02.845446 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 04:32:02.845446 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: eba1782ef9544e6d9fb7da0a1389ef48 Oct 27 04:32:02.845446 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-ServersNegativeTestJSON-1024124087 Oct 27 04:32:02.845446 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 04:32:02.845446 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 04:32:02.845446 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eba1782ef9544e6d9fb7da0a1389ef48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/eba1782ef9544e6d9fb7da0a1389ef48"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eba1782ef9544e6d9fb7da0a1389ef48"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_eba1782ef9544e6d9fb7da0a1389ef48"}]}] Oct 27 04:32:02.845446 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-ServersNegativeTestJSON-1024124087 Oct 27 04:32:02.845446 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: eba1782ef9544e6d9fb7da0a1389ef48 Oct 27 04:32:02.845446 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1024124087 Oct 27 04:32:02.845446 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-ServersNegativeTestJSON-1024124087-project Oct 27 04:32:02.845446 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 04:32:02.845446 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 04:32:02.845446 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 2b507cef618e4b7ea712a96f014b0b91 Oct 27 04:32:02.845446 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-ServersNegativeTestJSON-1024124087-project Oct 27 04:32:02.845446 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 04:32:02.845446 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance b3347a30-3bdb-4e3d-aaa4-080e0eadee21 could not be found. Oct 27 04:32:02.845446 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': 'b3347a30-3bdb-4e3d-aaa4-080e0eadee21'} Oct 27 04:32:02.845446 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 04:32:02.845446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:32:02.845446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 04:32:02.845446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 04:32:02.845446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 04:32:02.845446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 04:32:02.845446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 04:32:02.845446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 04:32:02.845446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 04:32:02.845446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 04:32:02.845446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3347a30-3bdb-4e3d-aaa4-080e0eadee21 could not be found. Oct 27 04:32:02.845446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:32:02.845446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:32:02.845446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:32:02.845446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:32:02.845446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:32:02.845446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:32:02.845446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 04:32:02.845446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 04:32:02.845446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 04:32:02.845446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 04:32:02.845446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 04:32:02.845446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 04:32:02.845446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 04:32:02.845446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 04:32:02.845446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 04:32:02.845446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 04:32:02.845446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 04:32:02.845446 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 04:32:02.850366 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3347a30-3bdb-4e3d-aaa4-080e0eadee21 could not be found. Oct 27 04:32:02.850366 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:32:02.850366 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:32:02.850366 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:32:02.850366 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:32:02.850366 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:32:02.850366 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:32:02.850366 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 04:32:02.850366 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 04:32:02.850366 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3347a30-3bdb-4e3d-aaa4-080e0eadee21 could not be found. Oct 27 04:32:02.850366 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:32:02.850366 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-bbbae41b-0104-456c-addd-27a982c0a451 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Returning 404 to user: Instance b3347a30-3bdb-4e3d-aaa4-080e0eadee21 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 04:32:02.850366 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-bbbae41b-0104-456c-addd-27a982c0a451 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b3347a30-3bdb-4e3d-aaa4-080e0eadee21" status: 404 len: 111 microversion: 2.1 time: 0.032733 Oct 27 04:32:02.850366 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4004/7714] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 04:32:02 2022] DELETE /compute/v2.1/servers/b3347a30-3bdb-4e3d-aaa4-080e0eadee21 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 04:32:02.855765 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2cc86d1b-270d-4521-94d6-d19fe6a5ff01 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:32:02.856467 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-2cc86d1b-270d-4521-94d6-d19fe6a5ff01 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] [instance: b3347a30-3bdb-4e3d-aaa4-080e0eadee21] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:32:02.862414 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2cc86d1b-270d-4521-94d6-d19fe6a5ff01 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:32:02.862899 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2cc86d1b-270d-4521-94d6-d19fe6a5ff01 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:32:02.863339 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2cc86d1b-270d-4521-94d6-d19fe6a5ff01 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:32:02.864062 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2cc86d1b-270d-4521-94d6-d19fe6a5ff01 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:32:02.864517 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2cc86d1b-270d-4521-94d6-d19fe6a5ff01 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:32:02.864942 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2cc86d1b-270d-4521-94d6-d19fe6a5ff01 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:32:02.879114 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-2cc86d1b-270d-4521-94d6-d19fe6a5ff01 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] HTTP exception thrown: Instance b3347a30-3bdb-4e3d-aaa4-080e0eadee21 could not be found. Oct 27 04:32:02.880628 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2cc86d1b-270d-4521-94d6-d19fe6a5ff01 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Request method failure captured: Oct 27 04:32:02.880628 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/b3347a30-3bdb-4e3d-aaa4-080e0eadee21 HTTP/1.1 Oct 27 04:32:02.880628 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 04:32:02.880628 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 04:32:02.880628 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 04:32:02.880628 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 04:32:02.880628 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 04:32:02.880628 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 04:32:02.880628 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 04:32:02.880628 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 04:32:02.880628 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWgmjsIj8UPo89lksfzObKSwYLKgAWLQFbfdXMSQn_zeKTM6fvA3Ib8g5bxPtL9sBw182uwhjt2IV2dT4R9LLdN8c4RT8_e6KTDq61i7MgsGCJPXKVVX7YRhT0cAtZFsVFZwPescNvHrQedJuXU0P_YuASQjKCn-gJ677yVqEAOl1qxg Oct 27 04:32:02.880628 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 04:32:02.880628 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 04:32:02.880628 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 04:32:02.880628 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 04:32:02.880628 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 04:32:02.880628 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 04:32:02.880628 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: eba1782ef9544e6d9fb7da0a1389ef48 Oct 27 04:32:02.880628 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ServersNegativeTestJSON-1024124087 Oct 27 04:32:02.880628 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 04:32:02.880628 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 04:32:02.880628 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eba1782ef9544e6d9fb7da0a1389ef48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/eba1782ef9544e6d9fb7da0a1389ef48"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eba1782ef9544e6d9fb7da0a1389ef48"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_eba1782ef9544e6d9fb7da0a1389ef48"}]}] Oct 27 04:32:02.880628 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ServersNegativeTestJSON-1024124087 Oct 27 04:32:02.880628 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: eba1782ef9544e6d9fb7da0a1389ef48 Oct 27 04:32:02.880628 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1024124087 Oct 27 04:32:02.880628 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ServersNegativeTestJSON-1024124087-project Oct 27 04:32:02.880628 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 04:32:02.880628 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 04:32:02.880628 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 2b507cef618e4b7ea712a96f014b0b91 Oct 27 04:32:02.880628 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ServersNegativeTestJSON-1024124087-project Oct 27 04:32:02.880628 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 04:32:02.880628 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance b3347a30-3bdb-4e3d-aaa4-080e0eadee21 could not be found. Oct 27 04:32:02.880628 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': 'b3347a30-3bdb-4e3d-aaa4-080e0eadee21'} Oct 27 04:32:02.880628 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 04:32:02.880628 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:32:02.880628 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 04:32:02.880628 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 04:32:02.880628 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 04:32:02.880628 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 04:32:02.880628 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 04:32:02.880628 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 04:32:02.880628 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 04:32:02.880628 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 04:32:02.880628 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3347a30-3bdb-4e3d-aaa4-080e0eadee21 could not be found. Oct 27 04:32:02.880628 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:32:02.880628 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:32:02.880628 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:32:02.880628 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:32:02.880628 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:32:02.880628 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:32:02.880628 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 04:32:02.880628 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 04:32:02.880628 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 04:32:02.880628 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 04:32:02.880628 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 04:32:02.880628 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 04:32:02.880628 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 04:32:02.880628 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 04:32:02.880628 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 04:32:02.880628 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 04:32:02.880628 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3347a30-3bdb-4e3d-aaa4-080e0eadee21 could not be found. Oct 27 04:32:02.880628 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:32:02.880628 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:32:02.880628 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:32:02.885831 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:32:02.885831 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:32:02.885831 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:32:02.885831 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 04:32:02.885831 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 04:32:02.885831 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3347a30-3bdb-4e3d-aaa4-080e0eadee21 could not be found. Oct 27 04:32:02.885831 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:32:02.885831 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2cc86d1b-270d-4521-94d6-d19fe6a5ff01 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Returning 404 to user: Instance b3347a30-3bdb-4e3d-aaa4-080e0eadee21 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 04:32:02.885831 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2cc86d1b-270d-4521-94d6-d19fe6a5ff01 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] 10.222.0.20 "GET /compute/v2.1/servers/b3347a30-3bdb-4e3d-aaa4-080e0eadee21" status: 404 len: 111 microversion: 2.1 time: 0.030186 Oct 27 04:32:02.885831 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3711/7715] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:32:02 2022] GET /compute/v2.1/servers/b3347a30-3bdb-4e3d-aaa4-080e0eadee21 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 04:32:02.895649 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4bd8ff70-08bf-4ad6-8fe6-094b09cb9791 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:32:02.896213 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4bd8ff70-08bf-4ad6-8fe6-094b09cb9791 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] [instance: 875ae006-5b22-49e0-b8d9-85652ee65f70] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:32:02.902301 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4bd8ff70-08bf-4ad6-8fe6-094b09cb9791 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:32:02.902808 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4bd8ff70-08bf-4ad6-8fe6-094b09cb9791 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:32:02.903270 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4bd8ff70-08bf-4ad6-8fe6-094b09cb9791 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:32:02.903995 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4bd8ff70-08bf-4ad6-8fe6-094b09cb9791 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:32:02.904481 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4bd8ff70-08bf-4ad6-8fe6-094b09cb9791 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:32:02.904930 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4bd8ff70-08bf-4ad6-8fe6-094b09cb9791 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:32:02.932579 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4bd8ff70-08bf-4ad6-8fe6-094b09cb9791 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] [instance: 875ae006-5b22-49e0-b8d9-85652ee65f70] Going to try to terminate instance {{(pid=121001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 04:32:03.220550 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4bd8ff70-08bf-4ad6-8fe6-094b09cb9791 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] 10.222.0.20 "DELETE /compute/v2.1/servers/875ae006-5b22-49e0-b8d9-85652ee65f70" status: 204 len: 0 microversion: 2.1 time: 0.328339 Oct 27 04:32:03.221173 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4005/7716] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 04:32:02 2022] DELETE /compute/v2.1/servers/875ae006-5b22-49e0-b8d9-85652ee65f70 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 04:32:03.229676 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4f254e0e-9290-49a7-8e5b-2784e52cd25e tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:32:03.230796 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4f254e0e-9290-49a7-8e5b-2784e52cd25e tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] [instance: 875ae006-5b22-49e0-b8d9-85652ee65f70] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:32:03.236410 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4f254e0e-9290-49a7-8e5b-2784e52cd25e tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:32:03.236905 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4f254e0e-9290-49a7-8e5b-2784e52cd25e tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:32:03.237359 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4f254e0e-9290-49a7-8e5b-2784e52cd25e tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:32:03.238096 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4f254e0e-9290-49a7-8e5b-2784e52cd25e tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:32:03.238569 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4f254e0e-9290-49a7-8e5b-2784e52cd25e tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:32:03.239009 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4f254e0e-9290-49a7-8e5b-2784e52cd25e tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:32:03.372749 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4f254e0e-9290-49a7-8e5b-2784e52cd25e tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b507cef618e4b7ea712a96f014b0b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba1782ef9544e6d9fb7da0a1389ef48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:32:03.380444 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4f254e0e-9290-49a7-8e5b-2784e52cd25e tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] 10.222.0.20 "GET /compute/v2.1/servers/875ae006-5b22-49e0-b8d9-85652ee65f70" status: 200 len: 1510 microversion: 2.1 time: 0.155120 Oct 27 04:32:03.381021 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3712/7717] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:32:03 2022] GET /compute/v2.1/servers/875ae006-5b22-49e0-b8d9-85652ee65f70 => generated 1510 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:32:04.404325 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0b0f9701-4d06-4e53-9cac-733629489420 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:32:04.405129 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0b0f9701-4d06-4e53-9cac-733629489420 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] [instance: 875ae006-5b22-49e0-b8d9-85652ee65f70] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:32:04.412456 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0b0f9701-4d06-4e53-9cac-733629489420 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:32:04.412959 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0b0f9701-4d06-4e53-9cac-733629489420 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:32:04.413419 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0b0f9701-4d06-4e53-9cac-733629489420 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:32:04.414164 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0b0f9701-4d06-4e53-9cac-733629489420 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:32:04.414642 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0b0f9701-4d06-4e53-9cac-733629489420 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:32:04.415088 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0b0f9701-4d06-4e53-9cac-733629489420 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:32:04.558218 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0b0f9701-4d06-4e53-9cac-733629489420 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b507cef618e4b7ea712a96f014b0b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba1782ef9544e6d9fb7da0a1389ef48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:32:04.566237 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0b0f9701-4d06-4e53-9cac-733629489420 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] 10.222.0.20 "GET /compute/v2.1/servers/875ae006-5b22-49e0-b8d9-85652ee65f70" status: 200 len: 1510 microversion: 2.1 time: 0.166272 Oct 27 04:32:04.566813 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4006/7718] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:32:04 2022] GET /compute/v2.1/servers/875ae006-5b22-49e0-b8d9-85652ee65f70 => generated 1510 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:32:05.221012 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-fb8d784d-2c0e-4ca4-ae60-f2ebbe8da31e req-f15c1d3d-7beb-485c-af88-da2197b9d54b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "875ae006-5b22-49e0-b8d9-85652ee65f70", "name": "network-vif-deleted", "tag": "1b05d6ac-f3b9-4f4b-8bea-2f1ac70a8243"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:32:05.227936 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:32:05.235041 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-fb8d784d-2c0e-4ca4-ae60-f2ebbe8da31e req-f15c1d3d-7beb-485c-af88-da2197b9d54b service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:32:05.235041 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-fb8d784d-2c0e-4ca4-ae60-f2ebbe8da31e req-f15c1d3d-7beb-485c-af88-da2197b9d54b service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:32:05.235041 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-fb8d784d-2c0e-4ca4-ae60-f2ebbe8da31e req-f15c1d3d-7beb-485c-af88-da2197b9d54b service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:32:05.246568 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-fb8d784d-2c0e-4ca4-ae60-f2ebbe8da31e req-f15c1d3d-7beb-485c-af88-da2197b9d54b service nova] Creating event network-vif-deleted:1b05d6ac-f3b9-4f4b-8bea-2f1ac70a8243 for instance 875ae006-5b22-49e0-b8d9-85652ee65f70 on n-h1-862769-1 Oct 27 04:32:05.251951 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-fb8d784d-2c0e-4ca4-ae60-f2ebbe8da31e req-f15c1d3d-7beb-485c-af88-da2197b9d54b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034998 Oct 27 04:32:05.252682 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3713/7719] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:32:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:32:05.590915 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-50360b23-3cf6-4ad6-ba6b-bbc605356245 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:32:05.591537 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-50360b23-3cf6-4ad6-ba6b-bbc605356245 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] [instance: 875ae006-5b22-49e0-b8d9-85652ee65f70] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:32:05.598773 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-50360b23-3cf6-4ad6-ba6b-bbc605356245 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:32:05.599273 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-50360b23-3cf6-4ad6-ba6b-bbc605356245 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:32:05.599733 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-50360b23-3cf6-4ad6-ba6b-bbc605356245 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:32:05.600443 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-50360b23-3cf6-4ad6-ba6b-bbc605356245 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:32:05.601421 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-50360b23-3cf6-4ad6-ba6b-bbc605356245 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:32:05.601865 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-50360b23-3cf6-4ad6-ba6b-bbc605356245 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:32:05.633474 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-50360b23-3cf6-4ad6-ba6b-bbc605356245 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:32:05.633987 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-50360b23-3cf6-4ad6-ba6b-bbc605356245 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:32:05.634481 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-50360b23-3cf6-4ad6-ba6b-bbc605356245 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:32:05.634971 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-50360b23-3cf6-4ad6-ba6b-bbc605356245 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lazy-loading 'fault' on Instance uuid 875ae006-5b22-49e0-b8d9-85652ee65f70 {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 04:32:05.677845 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-50360b23-3cf6-4ad6-ba6b-bbc605356245 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b507cef618e4b7ea712a96f014b0b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba1782ef9544e6d9fb7da0a1389ef48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:32:05.685901 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-50360b23-3cf6-4ad6-ba6b-bbc605356245 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] 10.222.0.20 "GET /compute/v2.1/servers/875ae006-5b22-49e0-b8d9-85652ee65f70" status: 200 len: 1306 microversion: 2.1 time: 0.098893 Oct 27 04:32:05.686683 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4007/7720] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:32:05 2022] GET /compute/v2.1/servers/875ae006-5b22-49e0-b8d9-85652ee65f70 => generated 1306 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:32:06.710942 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-43ba87c3-dce6-49cb-b7d8-27bad59a19b0 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:32:06.711665 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-43ba87c3-dce6-49cb-b7d8-27bad59a19b0 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] [instance: 875ae006-5b22-49e0-b8d9-85652ee65f70] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:32:06.718393 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-43ba87c3-dce6-49cb-b7d8-27bad59a19b0 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:32:06.718888 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-43ba87c3-dce6-49cb-b7d8-27bad59a19b0 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:32:06.719341 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-43ba87c3-dce6-49cb-b7d8-27bad59a19b0 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:32:06.720046 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-43ba87c3-dce6-49cb-b7d8-27bad59a19b0 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:32:06.720771 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-43ba87c3-dce6-49cb-b7d8-27bad59a19b0 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:32:06.721212 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-43ba87c3-dce6-49cb-b7d8-27bad59a19b0 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:32:06.735668 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-43ba87c3-dce6-49cb-b7d8-27bad59a19b0 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] HTTP exception thrown: Instance 875ae006-5b22-49e0-b8d9-85652ee65f70 could not be found. Oct 27 04:32:06.737301 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-43ba87c3-dce6-49cb-b7d8-27bad59a19b0 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Request method failure captured: Oct 27 04:32:06.737301 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/875ae006-5b22-49e0-b8d9-85652ee65f70 HTTP/1.1 Oct 27 04:32:06.737301 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 04:32:06.737301 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 04:32:06.737301 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 04:32:06.737301 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 04:32:06.737301 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 04:32:06.737301 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 04:32:06.737301 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 04:32:06.737301 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 04:32:06.737301 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWgmjsIj8UPo89lksfzObKSwYLKgAWLQFbfdXMSQn_zeKTM6fvA3Ib8g5bxPtL9sBw182uwhjt2IV2dT4R9LLdN8c4RT8_e6KTDq61i7MgsGCJPXKVVX7YRhT0cAtZFsVFZwPescNvHrQedJuXU0P_YuASQjKCn-gJ677yVqEAOl1qxg Oct 27 04:32:06.737301 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 04:32:06.737301 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 04:32:06.737301 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 04:32:06.737301 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 04:32:06.737301 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 04:32:06.737301 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 04:32:06.737301 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: eba1782ef9544e6d9fb7da0a1389ef48 Oct 27 04:32:06.737301 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-ServersNegativeTestJSON-1024124087 Oct 27 04:32:06.737301 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 04:32:06.737301 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 04:32:06.737301 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eba1782ef9544e6d9fb7da0a1389ef48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/eba1782ef9544e6d9fb7da0a1389ef48"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eba1782ef9544e6d9fb7da0a1389ef48"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_eba1782ef9544e6d9fb7da0a1389ef48"}]}] Oct 27 04:32:06.737301 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-ServersNegativeTestJSON-1024124087 Oct 27 04:32:06.737301 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: eba1782ef9544e6d9fb7da0a1389ef48 Oct 27 04:32:06.737301 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1024124087 Oct 27 04:32:06.737301 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-ServersNegativeTestJSON-1024124087-project Oct 27 04:32:06.737301 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 04:32:06.737301 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 04:32:06.737301 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 2b507cef618e4b7ea712a96f014b0b91 Oct 27 04:32:06.737301 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-ServersNegativeTestJSON-1024124087-project Oct 27 04:32:06.737301 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 04:32:06.737301 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 875ae006-5b22-49e0-b8d9-85652ee65f70 could not be found. Oct 27 04:32:06.737301 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '875ae006-5b22-49e0-b8d9-85652ee65f70'} Oct 27 04:32:06.737301 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 04:32:06.737301 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:32:06.737301 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 04:32:06.737301 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 04:32:06.737301 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 04:32:06.737301 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 04:32:06.737301 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 04:32:06.737301 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 04:32:06.737301 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 04:32:06.737301 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 04:32:06.737301 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 875ae006-5b22-49e0-b8d9-85652ee65f70 could not be found. Oct 27 04:32:06.737301 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:32:06.737301 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:32:06.737301 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:32:06.737301 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:32:06.737301 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:32:06.737301 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:32:06.737301 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 04:32:06.737301 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 04:32:06.737301 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 04:32:06.737301 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 04:32:06.737301 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 04:32:06.737301 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 04:32:06.737301 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 04:32:06.737301 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 04:32:06.737301 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 04:32:06.737301 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 04:32:06.737301 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 875ae006-5b22-49e0-b8d9-85652ee65f70 could not be found. Oct 27 04:32:06.737301 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:32:06.737301 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:32:06.737301 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:32:06.742580 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:32:06.742580 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:32:06.742580 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:32:06.742580 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 04:32:06.742580 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 04:32:06.742580 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 875ae006-5b22-49e0-b8d9-85652ee65f70 could not be found. Oct 27 04:32:06.742580 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:32:06.742580 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-43ba87c3-dce6-49cb-b7d8-27bad59a19b0 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] Returning 404 to user: Instance 875ae006-5b22-49e0-b8d9-85652ee65f70 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 04:32:06.742580 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-43ba87c3-dce6-49cb-b7d8-27bad59a19b0 tempest-ServersNegativeTestJSON-1024124087 tempest-ServersNegativeTestJSON-1024124087-project] 10.222.0.20 "GET /compute/v2.1/servers/875ae006-5b22-49e0-b8d9-85652ee65f70" status: 404 len: 111 microversion: 2.1 time: 0.033773 Oct 27 04:32:06.742580 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3714/7721] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:32:06 2022] GET /compute/v2.1/servers/875ae006-5b22-49e0-b8d9-85652ee65f70 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 04:32:51.766970 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:32:51.767682 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:32:51.961928 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-65b7e939-d797-4ad2-b584-0031b7e83894 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Action: 'create', calling method: .version_select at 0x7f7dda4da280>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1707111844", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLHJvDD8XCouB+N3ZHsOiBWgzMp4MyYMeLnMQusOh0yW96THZd2sOlVsKUb6MMi+5vN7U9kaw2htYC/E5unQDd0EeBhQk0rNs9K3VDIFxvzxs1XF0Pq+83NzsuCycXBFXA=="}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:32:51.979724 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-65b7e939-d797-4ad2-b584-0031b7e83894 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Getting quotas for project c4a8b90797b04f59bb513f5b6f4f6ba0. Resources: {'key_pairs'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 04:32:51.985293 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-65b7e939-d797-4ad2-b584-0031b7e83894 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Getting quotas for user aec3aa7aba49468e86caef89e306d01d and project c4a8b90797b04f59bb513f5b6f4f6ba0. Resources: {'key_pairs'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 04:32:52.102217 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-65b7e939-d797-4ad2-b584-0031b7e83894 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.340412 Oct 27 04:32:52.102765 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4008/7722] 10.222.0.20 () {60 vars in 1159 bytes} [Thu Oct 27 04:32:51 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:32:52.155874 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-53d93428-0ed2-4d91-b9bc-2d6678655abe tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1380677120", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1707111844", "networks": [{"uuid": "06806bc8-a4e7-445b-ac18-67263dd5b30c"}]}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:32:52.165509 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=40 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:32:52.230991 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-53d93428-0ed2-4d91-b9bc-2d6678655abe tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] validate_networks() for [('06806bc8-a4e7-445b-ac18-67263dd5b30c', None, None, None, None, None)] {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 04:32:52.656721 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-53d93428-0ed2-4d91-b9bc-2d6678655abe tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 04:32:52.657152 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-53d93428-0ed2-4d91-b9bc-2d6678655abe tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 04:32:52.657640 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-53d93428-0ed2-4d91-b9bc-2d6678655abe tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 04:32:52.658077 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-53d93428-0ed2-4d91-b9bc-2d6678655abe tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 04:32:52.658497 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-53d93428-0ed2-4d91-b9bc-2d6678655abe tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 04:32:52.668149 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-53d93428-0ed2-4d91-b9bc-2d6678655abe tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:32:52.668638 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-53d93428-0ed2-4d91-b9bc-2d6678655abe tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:32:52.669083 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-53d93428-0ed2-4d91-b9bc-2d6678655abe tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:32:52.669829 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-53d93428-0ed2-4d91-b9bc-2d6678655abe tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:32:52.670312 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-53d93428-0ed2-4d91-b9bc-2d6678655abe tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:32:52.674755 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-53d93428-0ed2-4d91-b9bc-2d6678655abe tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:32:52.689241 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-53d93428-0ed2-4d91-b9bc-2d6678655abe tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Getting quotas for project c4a8b90797b04f59bb513f5b6f4f6ba0. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 04:32:52.695116 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-53d93428-0ed2-4d91-b9bc-2d6678655abe tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Getting quotas for user aec3aa7aba49468e86caef89e306d01d and project c4a8b90797b04f59bb513f5b6f4f6ba0. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 04:32:52.709495 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-53d93428-0ed2-4d91-b9bc-2d6678655abe tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 04:32:52.711987 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-53d93428-0ed2-4d91-b9bc-2d6678655abe tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] [instance: af3938e2-5ae5-4d62-bde0-f5c62f067152] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 04:32:52.833993 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-53d93428-0ed2-4d91-b9bc-2d6678655abe tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.682472 Oct 27 04:32:52.835330 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3715/7723] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 04:32:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 684 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 04:32:52.847596 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c59e5dbe-2dac-4a28-b26f-562201248d10 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:32:52.849013 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c59e5dbe-2dac-4a28-b26f-562201248d10 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] [instance: af3938e2-5ae5-4d62-bde0-f5c62f067152] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:32:52.925635 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c59e5dbe-2dac-4a28-b26f-562201248d10 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec3aa7aba49468e86caef89e306d01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8b90797b04f59bb513f5b6f4f6ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:32:52.933901 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c59e5dbe-2dac-4a28-b26f-562201248d10 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] 10.222.0.20 "GET /compute/v2.1/servers/af3938e2-5ae5-4d62-bde0-f5c62f067152" status: 200 len: 1263 microversion: 2.1 time: 0.091542 Oct 27 04:32:52.935507 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4009/7724] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:32:52 2022] GET /compute/v2.1/servers/af3938e2-5ae5-4d62-bde0-f5c62f067152 => generated 1263 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:32:53.960114 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ed9a7b9e-0db0-4f6d-82f9-4fc8a16465f7 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:32:53.960114 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ed9a7b9e-0db0-4f6d-82f9-4fc8a16465f7 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] [instance: af3938e2-5ae5-4d62-bde0-f5c62f067152] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:32:53.968051 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ed9a7b9e-0db0-4f6d-82f9-4fc8a16465f7 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:32:53.968643 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ed9a7b9e-0db0-4f6d-82f9-4fc8a16465f7 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:32:53.969165 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ed9a7b9e-0db0-4f6d-82f9-4fc8a16465f7 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:32:53.969987 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ed9a7b9e-0db0-4f6d-82f9-4fc8a16465f7 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:32:53.970518 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ed9a7b9e-0db0-4f6d-82f9-4fc8a16465f7 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:32:53.971258 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ed9a7b9e-0db0-4f6d-82f9-4fc8a16465f7 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:32:54.035840 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ed9a7b9e-0db0-4f6d-82f9-4fc8a16465f7 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec3aa7aba49468e86caef89e306d01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8b90797b04f59bb513f5b6f4f6ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:32:54.044350 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ed9a7b9e-0db0-4f6d-82f9-4fc8a16465f7 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] 10.222.0.20 "GET /compute/v2.1/servers/af3938e2-5ae5-4d62-bde0-f5c62f067152" status: 200 len: 1267 microversion: 2.1 time: 0.089930 Oct 27 04:32:54.047020 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3716/7725] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:32:53 2022] GET /compute/v2.1/servers/af3938e2-5ae5-4d62-bde0-f5c62f067152 => generated 1267 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:32:55.068587 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-42fc5f29-f663-423d-b359-988476fc735c tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:32:55.070170 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-42fc5f29-f663-423d-b359-988476fc735c tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] [instance: af3938e2-5ae5-4d62-bde0-f5c62f067152] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:32:55.078613 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-42fc5f29-f663-423d-b359-988476fc735c tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:32:55.079338 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-42fc5f29-f663-423d-b359-988476fc735c tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:32:55.079991 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-42fc5f29-f663-423d-b359-988476fc735c tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:32:55.080913 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-42fc5f29-f663-423d-b359-988476fc735c tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:32:55.081576 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-42fc5f29-f663-423d-b359-988476fc735c tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:32:55.082027 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-42fc5f29-f663-423d-b359-988476fc735c tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:32:55.173178 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-42fc5f29-f663-423d-b359-988476fc735c tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec3aa7aba49468e86caef89e306d01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8b90797b04f59bb513f5b6f4f6ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:32:55.183869 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-42fc5f29-f663-423d-b359-988476fc735c tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] 10.222.0.20 "GET /compute/v2.1/servers/af3938e2-5ae5-4d62-bde0-f5c62f067152" status: 200 len: 1323 microversion: 2.1 time: 0.117522 Oct 27 04:32:55.202252 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4010/7726] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:32:55 2022] GET /compute/v2.1/servers/af3938e2-5ae5-4d62-bde0-f5c62f067152 => generated 1323 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:32:56.208308 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-db92dc15-cc05-43e8-9857-4028e0b931ad tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:32:56.209010 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-db92dc15-cc05-43e8-9857-4028e0b931ad tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] [instance: af3938e2-5ae5-4d62-bde0-f5c62f067152] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:32:56.215926 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-db92dc15-cc05-43e8-9857-4028e0b931ad tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:32:56.216675 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-db92dc15-cc05-43e8-9857-4028e0b931ad tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:32:56.217124 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-db92dc15-cc05-43e8-9857-4028e0b931ad tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:32:56.218542 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-db92dc15-cc05-43e8-9857-4028e0b931ad tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:32:56.220965 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-db92dc15-cc05-43e8-9857-4028e0b931ad tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:32:56.221911 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-db92dc15-cc05-43e8-9857-4028e0b931ad tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:32:56.359021 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-db92dc15-cc05-43e8-9857-4028e0b931ad tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec3aa7aba49468e86caef89e306d01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8b90797b04f59bb513f5b6f4f6ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:32:56.366774 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-db92dc15-cc05-43e8-9857-4028e0b931ad tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] 10.222.0.20 "GET /compute/v2.1/servers/af3938e2-5ae5-4d62-bde0-f5c62f067152" status: 200 len: 1363 microversion: 2.1 time: 0.163365 Oct 27 04:32:56.367371 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3717/7727] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:32:56 2022] GET /compute/v2.1/servers/af3938e2-5ae5-4d62-bde0-f5c62f067152 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:32:56.788237 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-a1c75733-b4b7-4e45-b8e9-8d321b74feb8 req-cb6bbe3a-01f6-42a6-940f-cc095553708b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af3938e2-5ae5-4d62-bde0-f5c62f067152", "tag": "986b9d8d-d5db-425d-b16e-1227c0872b83"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:32:56.798665 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-a1c75733-b4b7-4e45-b8e9-8d321b74feb8 req-cb6bbe3a-01f6-42a6-940f-cc095553708b service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:32:56.799170 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-a1c75733-b4b7-4e45-b8e9-8d321b74feb8 req-cb6bbe3a-01f6-42a6-940f-cc095553708b service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:32:56.799655 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-a1c75733-b4b7-4e45-b8e9-8d321b74feb8 req-cb6bbe3a-01f6-42a6-940f-cc095553708b service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:32:56.811136 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-a1c75733-b4b7-4e45-b8e9-8d321b74feb8 req-cb6bbe3a-01f6-42a6-940f-cc095553708b service nova] Creating event network-changed:986b9d8d-d5db-425d-b16e-1227c0872b83 for instance af3938e2-5ae5-4d62-bde0-f5c62f067152 on n-h1-862769-1 Oct 27 04:32:56.816110 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-a1c75733-b4b7-4e45-b8e9-8d321b74feb8 req-cb6bbe3a-01f6-42a6-940f-cc095553708b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031771 Oct 27 04:32:56.816789 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4011/7728] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:32:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:32:57.390541 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-aa8d05a4-1741-4f7a-a1c0-4e05f276f7ac tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:32:57.391194 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-aa8d05a4-1741-4f7a-a1c0-4e05f276f7ac tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] [instance: af3938e2-5ae5-4d62-bde0-f5c62f067152] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:32:57.397921 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aa8d05a4-1741-4f7a-a1c0-4e05f276f7ac tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:32:57.398448 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aa8d05a4-1741-4f7a-a1c0-4e05f276f7ac tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:32:57.398891 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aa8d05a4-1741-4f7a-a1c0-4e05f276f7ac tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:32:57.400099 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aa8d05a4-1741-4f7a-a1c0-4e05f276f7ac tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:32:57.400564 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aa8d05a4-1741-4f7a-a1c0-4e05f276f7ac tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:32:57.401003 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-aa8d05a4-1741-4f7a-a1c0-4e05f276f7ac tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:32:57.527276 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-aa8d05a4-1741-4f7a-a1c0-4e05f276f7ac tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec3aa7aba49468e86caef89e306d01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8b90797b04f59bb513f5b6f4f6ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:32:57.534977 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-aa8d05a4-1741-4f7a-a1c0-4e05f276f7ac tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] 10.222.0.20 "GET /compute/v2.1/servers/af3938e2-5ae5-4d62-bde0-f5c62f067152" status: 200 len: 1363 microversion: 2.1 time: 0.148382 Oct 27 04:32:57.535558 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3718/7729] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:32:57 2022] GET /compute/v2.1/servers/af3938e2-5ae5-4d62-bde0-f5c62f067152 => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:32:58.560380 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-de8002eb-55f9-41ad-b734-f14f05c746ec tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:32:58.561147 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-de8002eb-55f9-41ad-b734-f14f05c746ec tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] [instance: af3938e2-5ae5-4d62-bde0-f5c62f067152] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:32:58.567415 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-de8002eb-55f9-41ad-b734-f14f05c746ec tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:32:58.567917 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-de8002eb-55f9-41ad-b734-f14f05c746ec tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:32:58.568380 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-de8002eb-55f9-41ad-b734-f14f05c746ec tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:32:58.569092 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-de8002eb-55f9-41ad-b734-f14f05c746ec tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:32:58.569565 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-de8002eb-55f9-41ad-b734-f14f05c746ec tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:32:58.570024 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-de8002eb-55f9-41ad-b734-f14f05c746ec tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:32:58.701549 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-de8002eb-55f9-41ad-b734-f14f05c746ec tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec3aa7aba49468e86caef89e306d01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8b90797b04f59bb513f5b6f4f6ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:32:58.709496 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-de8002eb-55f9-41ad-b734-f14f05c746ec tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] 10.222.0.20 "GET /compute/v2.1/servers/af3938e2-5ae5-4d62-bde0-f5c62f067152" status: 200 len: 1363 microversion: 2.1 time: 0.154869 Oct 27 04:32:58.710095 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4012/7730] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:32:58 2022] GET /compute/v2.1/servers/af3938e2-5ae5-4d62-bde0-f5c62f067152 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:32:59.732626 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-efc8e8da-3b16-48d8-8e8e-1e3fed32a5d2 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:32:59.733246 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-efc8e8da-3b16-48d8-8e8e-1e3fed32a5d2 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] [instance: af3938e2-5ae5-4d62-bde0-f5c62f067152] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:32:59.739588 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-efc8e8da-3b16-48d8-8e8e-1e3fed32a5d2 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:32:59.740078 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-efc8e8da-3b16-48d8-8e8e-1e3fed32a5d2 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:32:59.740520 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-efc8e8da-3b16-48d8-8e8e-1e3fed32a5d2 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:32:59.741219 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-efc8e8da-3b16-48d8-8e8e-1e3fed32a5d2 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:32:59.741694 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-efc8e8da-3b16-48d8-8e8e-1e3fed32a5d2 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:32:59.742126 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-efc8e8da-3b16-48d8-8e8e-1e3fed32a5d2 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:32:59.877041 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-efc8e8da-3b16-48d8-8e8e-1e3fed32a5d2 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec3aa7aba49468e86caef89e306d01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8b90797b04f59bb513f5b6f4f6ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:32:59.885322 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-efc8e8da-3b16-48d8-8e8e-1e3fed32a5d2 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] 10.222.0.20 "GET /compute/v2.1/servers/af3938e2-5ae5-4d62-bde0-f5c62f067152" status: 200 len: 1363 microversion: 2.1 time: 0.156627 Oct 27 04:32:59.885926 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3719/7731] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:32:59 2022] GET /compute/v2.1/servers/af3938e2-5ae5-4d62-bde0-f5c62f067152 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 04:33:00.907941 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5e747ef0-f648-4e6a-b063-5299eac324d6 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:33:00.908591 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5e747ef0-f648-4e6a-b063-5299eac324d6 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] [instance: af3938e2-5ae5-4d62-bde0-f5c62f067152] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:33:00.915185 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5e747ef0-f648-4e6a-b063-5299eac324d6 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:33:00.915695 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5e747ef0-f648-4e6a-b063-5299eac324d6 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:33:00.916161 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5e747ef0-f648-4e6a-b063-5299eac324d6 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:33:00.916885 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5e747ef0-f648-4e6a-b063-5299eac324d6 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:33:00.917392 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5e747ef0-f648-4e6a-b063-5299eac324d6 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:33:00.917968 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5e747ef0-f648-4e6a-b063-5299eac324d6 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:33:01.048100 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5e747ef0-f648-4e6a-b063-5299eac324d6 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec3aa7aba49468e86caef89e306d01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8b90797b04f59bb513f5b6f4f6ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:33:01.056091 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5e747ef0-f648-4e6a-b063-5299eac324d6 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] 10.222.0.20 "GET /compute/v2.1/servers/af3938e2-5ae5-4d62-bde0-f5c62f067152" status: 200 len: 1363 microversion: 2.1 time: 0.152194 Oct 27 04:33:01.056671 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4013/7732] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:33:00 2022] GET /compute/v2.1/servers/af3938e2-5ae5-4d62-bde0-f5c62f067152 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:33:02.079039 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-72f0174c-296b-418a-ab12-71b15b7a0cdc tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:33:02.079658 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-72f0174c-296b-418a-ab12-71b15b7a0cdc tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] [instance: af3938e2-5ae5-4d62-bde0-f5c62f067152] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:33:02.086453 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-72f0174c-296b-418a-ab12-71b15b7a0cdc tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:33:02.086940 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-72f0174c-296b-418a-ab12-71b15b7a0cdc tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:33:02.087896 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-72f0174c-296b-418a-ab12-71b15b7a0cdc tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:33:02.088590 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-72f0174c-296b-418a-ab12-71b15b7a0cdc tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:33:02.089048 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-72f0174c-296b-418a-ab12-71b15b7a0cdc tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:33:02.089478 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-72f0174c-296b-418a-ab12-71b15b7a0cdc tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:33:02.220810 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-72f0174c-296b-418a-ab12-71b15b7a0cdc tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec3aa7aba49468e86caef89e306d01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8b90797b04f59bb513f5b6f4f6ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:33:02.230260 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-72f0174c-296b-418a-ab12-71b15b7a0cdc tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] 10.222.0.20 "GET /compute/v2.1/servers/af3938e2-5ae5-4d62-bde0-f5c62f067152" status: 200 len: 1363 microversion: 2.1 time: 0.155015 Oct 27 04:33:02.230837 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3720/7733] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:33:02 2022] GET /compute/v2.1/servers/af3938e2-5ae5-4d62-bde0-f5c62f067152 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:33:03.252876 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-17a98c57-e7d1-48e6-916a-1c937bfb22c5 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:33:03.253462 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-17a98c57-e7d1-48e6-916a-1c937bfb22c5 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] [instance: af3938e2-5ae5-4d62-bde0-f5c62f067152] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:33:03.256437 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=6 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:33:03.261230 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-17a98c57-e7d1-48e6-916a-1c937bfb22c5 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:33:03.261732 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-17a98c57-e7d1-48e6-916a-1c937bfb22c5 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:33:03.262222 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-17a98c57-e7d1-48e6-916a-1c937bfb22c5 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:33:03.262938 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-17a98c57-e7d1-48e6-916a-1c937bfb22c5 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:33:03.263423 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-17a98c57-e7d1-48e6-916a-1c937bfb22c5 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:33:03.263873 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-17a98c57-e7d1-48e6-916a-1c937bfb22c5 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:33:03.390626 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-17a98c57-e7d1-48e6-916a-1c937bfb22c5 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec3aa7aba49468e86caef89e306d01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8b90797b04f59bb513f5b6f4f6ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:33:03.398554 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-17a98c57-e7d1-48e6-916a-1c937bfb22c5 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] 10.222.0.20 "GET /compute/v2.1/servers/af3938e2-5ae5-4d62-bde0-f5c62f067152" status: 200 len: 1363 microversion: 2.1 time: 0.149691 Oct 27 04:33:03.399140 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4014/7734] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:33:03 2022] GET /compute/v2.1/servers/af3938e2-5ae5-4d62-bde0-f5c62f067152 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:33:04.058927 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-87ed4a01-cd6a-496b-bf24-7c6996f80950 req-33e54538-0c01-4e36-ad96-7b89214c6046 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af3938e2-5ae5-4d62-bde0-f5c62f067152", "name": "network-vif-plugged", "status": "completed", "tag": "986b9d8d-d5db-425d-b16e-1227c0872b83"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:33:04.063971 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:33:04.064655 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=6 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:33:04.071241 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-87ed4a01-cd6a-496b-bf24-7c6996f80950 req-33e54538-0c01-4e36-ad96-7b89214c6046 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:33:04.071734 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-87ed4a01-cd6a-496b-bf24-7c6996f80950 req-33e54538-0c01-4e36-ad96-7b89214c6046 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:33:04.072175 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-87ed4a01-cd6a-496b-bf24-7c6996f80950 req-33e54538-0c01-4e36-ad96-7b89214c6046 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:33:04.083534 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-87ed4a01-cd6a-496b-bf24-7c6996f80950 req-33e54538-0c01-4e36-ad96-7b89214c6046 service nova] Creating event network-vif-plugged:986b9d8d-d5db-425d-b16e-1227c0872b83 for instance af3938e2-5ae5-4d62-bde0-f5c62f067152 on n-h1-862769-1 Oct 27 04:33:04.089572 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-87ed4a01-cd6a-496b-bf24-7c6996f80950 req-33e54538-0c01-4e36-ad96-7b89214c6046 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035105 Oct 27 04:33:04.090188 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3721/7735] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:33:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 04:33:04.422642 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2f7c9c09-658a-49fd-9ddc-706cc270eb99 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:33:04.423210 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2f7c9c09-658a-49fd-9ddc-706cc270eb99 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] [instance: af3938e2-5ae5-4d62-bde0-f5c62f067152] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:33:04.430179 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2f7c9c09-658a-49fd-9ddc-706cc270eb99 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:33:04.430693 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2f7c9c09-658a-49fd-9ddc-706cc270eb99 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:33:04.431353 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2f7c9c09-658a-49fd-9ddc-706cc270eb99 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:33:04.432085 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2f7c9c09-658a-49fd-9ddc-706cc270eb99 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:33:04.432564 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2f7c9c09-658a-49fd-9ddc-706cc270eb99 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:33:04.433022 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2f7c9c09-658a-49fd-9ddc-706cc270eb99 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:33:04.567616 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2f7c9c09-658a-49fd-9ddc-706cc270eb99 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec3aa7aba49468e86caef89e306d01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8b90797b04f59bb513f5b6f4f6ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:33:04.576001 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2f7c9c09-658a-49fd-9ddc-706cc270eb99 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] 10.222.0.20 "GET /compute/v2.1/servers/af3938e2-5ae5-4d62-bde0-f5c62f067152" status: 200 len: 1363 microversion: 2.1 time: 0.157377 Oct 27 04:33:04.576586 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4015/7736] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:33:04 2022] GET /compute/v2.1/servers/af3938e2-5ae5-4d62-bde0-f5c62f067152 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:33:05.604387 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-23f9c08d-e2ef-49f4-afd2-fa9ce79090eb tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:33:05.605101 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-23f9c08d-e2ef-49f4-afd2-fa9ce79090eb tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] [instance: af3938e2-5ae5-4d62-bde0-f5c62f067152] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:33:05.612079 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-23f9c08d-e2ef-49f4-afd2-fa9ce79090eb tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:33:05.612579 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-23f9c08d-e2ef-49f4-afd2-fa9ce79090eb tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:33:05.613033 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-23f9c08d-e2ef-49f4-afd2-fa9ce79090eb tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:33:05.613743 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-23f9c08d-e2ef-49f4-afd2-fa9ce79090eb tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:33:05.614242 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-23f9c08d-e2ef-49f4-afd2-fa9ce79090eb tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:33:05.614680 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-23f9c08d-e2ef-49f4-afd2-fa9ce79090eb tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:33:05.745769 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-23f9c08d-e2ef-49f4-afd2-fa9ce79090eb tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec3aa7aba49468e86caef89e306d01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8b90797b04f59bb513f5b6f4f6ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:33:05.753591 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-23f9c08d-e2ef-49f4-afd2-fa9ce79090eb tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] 10.222.0.20 "GET /compute/v2.1/servers/af3938e2-5ae5-4d62-bde0-f5c62f067152" status: 200 len: 1554 microversion: 2.1 time: 0.155323 Oct 27 04:33:05.754215 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3722/7737] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:33:05 2022] GET /compute/v2.1/servers/af3938e2-5ae5-4d62-bde0-f5c62f067152 => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 04:33:05.777032 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-bed6afd8-4825-4e3b-9b36-8dd1079de5c7 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:33:05.777669 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-bed6afd8-4825-4e3b-9b36-8dd1079de5c7 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] [instance: af3938e2-5ae5-4d62-bde0-f5c62f067152] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:33:05.784640 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bed6afd8-4825-4e3b-9b36-8dd1079de5c7 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:33:05.785147 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bed6afd8-4825-4e3b-9b36-8dd1079de5c7 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:33:05.785607 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bed6afd8-4825-4e3b-9b36-8dd1079de5c7 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:33:05.786366 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bed6afd8-4825-4e3b-9b36-8dd1079de5c7 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:33:05.786839 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bed6afd8-4825-4e3b-9b36-8dd1079de5c7 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:33:05.787286 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bed6afd8-4825-4e3b-9b36-8dd1079de5c7 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:33:06.235873 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-bed6afd8-4825-4e3b-9b36-8dd1079de5c7 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec3aa7aba49468e86caef89e306d01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8b90797b04f59bb513f5b6f4f6ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:33:06.244393 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-bed6afd8-4825-4e3b-9b36-8dd1079de5c7 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] 10.222.0.20 "GET /compute/v2.1/servers/af3938e2-5ae5-4d62-bde0-f5c62f067152" status: 200 len: 1554 microversion: 2.1 time: 0.471978 Oct 27 04:33:06.244968 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4016/7738] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:33:05 2022] GET /compute/v2.1/servers/af3938e2-5ae5-4d62-bde0-f5c62f067152 => generated 1554 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:33:09.330751 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c5d68de1-4d07-4570-9578-dd112829e6d2 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2d414c74-cb77-440e-a1d7-158529085e3f"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:33:09.333193 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c5d68de1-4d07-4570-9578-dd112829e6d2 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] [instance: af3938e2-5ae5-4d62-bde0-f5c62f067152] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:33:09.340503 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c5d68de1-4d07-4570-9578-dd112829e6d2 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:33:09.340999 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c5d68de1-4d07-4570-9578-dd112829e6d2 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:33:09.341451 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c5d68de1-4d07-4570-9578-dd112829e6d2 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:33:09.342192 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c5d68de1-4d07-4570-9578-dd112829e6d2 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:33:09.342657 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c5d68de1-4d07-4570-9578-dd112829e6d2 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:33:09.343091 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c5d68de1-4d07-4570-9578-dd112829e6d2 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:33:10.017995 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c5d68de1-4d07-4570-9578-dd112829e6d2 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] 10.222.0.20 "POST /compute/v2.1/servers/af3938e2-5ae5-4d62-bde0-f5c62f067152/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.691056 Oct 27 04:33:10.018717 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3723/7739] 10.222.0.20 () {60 vars in 1323 bytes} [Thu Oct 27 04:33:09 2022] POST /compute/v2.1/servers/af3938e2-5ae5-4d62-bde0-f5c62f067152/os-volume_attachments => generated 194 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:33:21.786614 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e304d90e-7b7f-4b36-8571-727671f0cd48 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:33:21.787166 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e304d90e-7b7f-4b36-8571-727671f0cd48 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] [instance: af3938e2-5ae5-4d62-bde0-f5c62f067152] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:33:21.790136 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:33:21.795091 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=38 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:33:21.795537 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e304d90e-7b7f-4b36-8571-727671f0cd48 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:33:21.796049 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e304d90e-7b7f-4b36-8571-727671f0cd48 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:33:21.796515 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e304d90e-7b7f-4b36-8571-727671f0cd48 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:33:21.797234 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e304d90e-7b7f-4b36-8571-727671f0cd48 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:33:21.797711 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e304d90e-7b7f-4b36-8571-727671f0cd48 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:33:21.798196 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e304d90e-7b7f-4b36-8571-727671f0cd48 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:33:21.877557 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-e304d90e-7b7f-4b36-8571-727671f0cd48 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lazy-loading 'services' on Instance uuid af3938e2-5ae5-4d62-bde0-f5c62f067152 {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 04:33:22.061273 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e304d90e-7b7f-4b36-8571-727671f0cd48 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] 10.222.0.20 "DELETE /compute/v2.1/servers/af3938e2-5ae5-4d62-bde0-f5c62f067152/os-volume_attachments/2d414c74-cb77-440e-a1d7-158529085e3f" status: 202 len: 0 microversion: 2.1 time: 0.278526 Oct 27 04:33:22.061889 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4017/7740] 10.222.0.20 () {58 vars in 1416 bytes} [Thu Oct 27 04:33:21 2022] DELETE /compute/v2.1/servers/af3938e2-5ae5-4d62-bde0-f5c62f067152/os-volume_attachments/2d414c74-cb77-440e-a1d7-158529085e3f => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 04:33:22.068498 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:33:22.069285 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:33:22.073577 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ea5140b0-dccb-428a-a597-9b39798f61a1 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:33:22.075979 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ea5140b0-dccb-428a-a597-9b39798f61a1 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] [instance: af3938e2-5ae5-4d62-bde0-f5c62f067152] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:33:22.082054 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ea5140b0-dccb-428a-a597-9b39798f61a1 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:33:22.082561 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ea5140b0-dccb-428a-a597-9b39798f61a1 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:33:22.083003 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ea5140b0-dccb-428a-a597-9b39798f61a1 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:33:22.083704 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ea5140b0-dccb-428a-a597-9b39798f61a1 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:33:22.084165 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ea5140b0-dccb-428a-a597-9b39798f61a1 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:33:22.084601 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ea5140b0-dccb-428a-a597-9b39798f61a1 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:33:22.116070 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ea5140b0-dccb-428a-a597-9b39798f61a1 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] 10.222.0.20 "GET /compute/v2.1/servers/af3938e2-5ae5-4d62-bde0-f5c62f067152/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049437 Oct 27 04:33:22.116631 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3724/7741] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 27 04:33:22 2022] GET /compute/v2.1/servers/af3938e2-5ae5-4d62-bde0-f5c62f067152/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:33:23.130587 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4f8cef6d-8265-4b56-98ce-92a104a771f1 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:33:23.132944 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4f8cef6d-8265-4b56-98ce-92a104a771f1 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] [instance: af3938e2-5ae5-4d62-bde0-f5c62f067152] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:33:23.139282 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4f8cef6d-8265-4b56-98ce-92a104a771f1 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:33:23.139783 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4f8cef6d-8265-4b56-98ce-92a104a771f1 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:33:23.140238 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4f8cef6d-8265-4b56-98ce-92a104a771f1 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:33:23.140952 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4f8cef6d-8265-4b56-98ce-92a104a771f1 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:33:23.141422 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4f8cef6d-8265-4b56-98ce-92a104a771f1 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:33:23.141867 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4f8cef6d-8265-4b56-98ce-92a104a771f1 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:33:23.172428 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4f8cef6d-8265-4b56-98ce-92a104a771f1 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] 10.222.0.20 "GET /compute/v2.1/servers/af3938e2-5ae5-4d62-bde0-f5c62f067152/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047179 Oct 27 04:33:23.172990 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4018/7742] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 27 04:33:23 2022] GET /compute/v2.1/servers/af3938e2-5ae5-4d62-bde0-f5c62f067152/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:33:24.185074 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4127c32c-7d91-44df-bb16-e64cb4eca6c4 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:33:24.206326 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4127c32c-7d91-44df-bb16-e64cb4eca6c4 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] [instance: af3938e2-5ae5-4d62-bde0-f5c62f067152] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:33:24.206326 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4127c32c-7d91-44df-bb16-e64cb4eca6c4 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:33:24.206326 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4127c32c-7d91-44df-bb16-e64cb4eca6c4 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:33:24.206326 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4127c32c-7d91-44df-bb16-e64cb4eca6c4 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:33:24.206326 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4127c32c-7d91-44df-bb16-e64cb4eca6c4 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:33:24.206326 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4127c32c-7d91-44df-bb16-e64cb4eca6c4 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:33:24.206326 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4127c32c-7d91-44df-bb16-e64cb4eca6c4 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:33:24.228740 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4127c32c-7d91-44df-bb16-e64cb4eca6c4 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] 10.222.0.20 "GET /compute/v2.1/servers/af3938e2-5ae5-4d62-bde0-f5c62f067152/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047747 Oct 27 04:33:24.229511 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3725/7743] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 27 04:33:24 2022] GET /compute/v2.1/servers/af3938e2-5ae5-4d62-bde0-f5c62f067152/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 04:33:25.245147 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6481bfa2-ca37-4674-9885-7606af385f78 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:33:25.248019 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-6481bfa2-ca37-4674-9885-7606af385f78 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] [instance: af3938e2-5ae5-4d62-bde0-f5c62f067152] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:33:25.255296 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6481bfa2-ca37-4674-9885-7606af385f78 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:33:25.255810 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6481bfa2-ca37-4674-9885-7606af385f78 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:33:25.256279 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6481bfa2-ca37-4674-9885-7606af385f78 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:33:25.257012 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6481bfa2-ca37-4674-9885-7606af385f78 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:33:25.257489 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6481bfa2-ca37-4674-9885-7606af385f78 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:33:25.257940 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6481bfa2-ca37-4674-9885-7606af385f78 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:33:25.291802 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6481bfa2-ca37-4674-9885-7606af385f78 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] 10.222.0.20 "GET /compute/v2.1/servers/af3938e2-5ae5-4d62-bde0-f5c62f067152/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053802 Oct 27 04:33:25.292387 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4019/7744] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 27 04:33:25 2022] GET /compute/v2.1/servers/af3938e2-5ae5-4d62-bde0-f5c62f067152/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:33:26.304450 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7eff1f0b-3001-45c3-942c-3b0d09624ac9 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:33:26.307374 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7eff1f0b-3001-45c3-942c-3b0d09624ac9 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] [instance: af3938e2-5ae5-4d62-bde0-f5c62f067152] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:33:26.315378 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7eff1f0b-3001-45c3-942c-3b0d09624ac9 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:33:26.315873 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7eff1f0b-3001-45c3-942c-3b0d09624ac9 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:33:26.316320 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7eff1f0b-3001-45c3-942c-3b0d09624ac9 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:33:26.317030 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7eff1f0b-3001-45c3-942c-3b0d09624ac9 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:33:26.317496 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7eff1f0b-3001-45c3-942c-3b0d09624ac9 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:33:26.317935 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7eff1f0b-3001-45c3-942c-3b0d09624ac9 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:33:26.348700 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7eff1f0b-3001-45c3-942c-3b0d09624ac9 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] 10.222.0.20 "GET /compute/v2.1/servers/af3938e2-5ae5-4d62-bde0-f5c62f067152/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048288 Oct 27 04:33:26.349286 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3726/7745] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 27 04:33:26 2022] GET /compute/v2.1/servers/af3938e2-5ae5-4d62-bde0-f5c62f067152/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:33:27.361888 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a1577212-42aa-4d54-a128-b28dc9f79ac7 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:33:27.364153 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a1577212-42aa-4d54-a128-b28dc9f79ac7 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] [instance: af3938e2-5ae5-4d62-bde0-f5c62f067152] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:33:27.371518 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a1577212-42aa-4d54-a128-b28dc9f79ac7 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:33:27.372026 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a1577212-42aa-4d54-a128-b28dc9f79ac7 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:33:27.372487 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a1577212-42aa-4d54-a128-b28dc9f79ac7 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:33:27.373205 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a1577212-42aa-4d54-a128-b28dc9f79ac7 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:33:27.373686 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a1577212-42aa-4d54-a128-b28dc9f79ac7 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:33:27.374178 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a1577212-42aa-4d54-a128-b28dc9f79ac7 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:33:27.403647 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a1577212-42aa-4d54-a128-b28dc9f79ac7 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] 10.222.0.20 "GET /compute/v2.1/servers/af3938e2-5ae5-4d62-bde0-f5c62f067152/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045847 Oct 27 04:33:27.404210 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4020/7746] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 27 04:33:27 2022] GET /compute/v2.1/servers/af3938e2-5ae5-4d62-bde0-f5c62f067152/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 04:33:27.414798 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-65920208-0b2c-4d77-9403-4ed784a7f78e tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:33:27.415324 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-65920208-0b2c-4d77-9403-4ed784a7f78e tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] [instance: af3938e2-5ae5-4d62-bde0-f5c62f067152] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:33:27.421978 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-65920208-0b2c-4d77-9403-4ed784a7f78e tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:33:27.422494 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-65920208-0b2c-4d77-9403-4ed784a7f78e tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:33:27.422936 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-65920208-0b2c-4d77-9403-4ed784a7f78e tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:33:27.423629 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-65920208-0b2c-4d77-9403-4ed784a7f78e tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:33:27.424085 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-65920208-0b2c-4d77-9403-4ed784a7f78e tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:33:27.424535 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-65920208-0b2c-4d77-9403-4ed784a7f78e tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:33:27.498411 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-65920208-0b2c-4d77-9403-4ed784a7f78e tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] HTTP exception thrown: Instance af3938e2-5ae5-4d62-bde0-f5c62f067152 is not attached to volume 2d414c74-cb77-440e-a1d7-158529085e3f Oct 27 04:33:27.510668 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-65920208-0b2c-4d77-9403-4ed784a7f78e tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Request method failure captured: Oct 27 04:33:27.510668 n-d-862769-1 devstack@n-api.service[121000]: request: DELETE /compute/v2.1/servers/af3938e2-5ae5-4d62-bde0-f5c62f067152/os-volume_attachments/2d414c74-cb77-440e-a1d7-158529085e3f HTTP/1.1 Oct 27 04:33:27.510668 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 04:33:27.510668 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 04:33:27.510668 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 04:33:27.510668 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 04:33:27.510668 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 04:33:27.510668 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 04:33:27.510668 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 04:33:27.510668 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 04:33:27.510668 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWgntydcp5ucyHhbhzCFUw5z1Qa5I4ESWqPpfdPgOqm66QNd0jyTjtGd6eTxa7eImf2v1ba9CEyum0GiPKZG2hDfZxnvQtUQUD9-2xS88KBIMOAkwT-bueemeWQr6Ipcz8LM0YNs7A3Wbr85EKibgX9GYFE5tcNTEuszQ_S9andFdlBQ Oct 27 04:33:27.510668 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 04:33:27.510668 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 04:33:27.510668 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 04:33:27.510668 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 04:33:27.510668 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 04:33:27.510668 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 04:33:27.510668 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: c4a8b90797b04f59bb513f5b6f4f6ba0 Oct 27 04:33:27.510668 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-TestEncryptedCinderVolumes-186849876 Oct 27 04:33:27.510668 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 04:33:27.510668 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 04:33:27.510668 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c4a8b90797b04f59bb513f5b6f4f6ba0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c4a8b90797b04f59bb513f5b6f4f6ba0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c4a8b90797b04f59bb513f5b6f4f6ba0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c4a8b90797b04f59bb513f5b6f4f6ba0"}]}] Oct 27 04:33:27.510668 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-TestEncryptedCinderVolumes-186849876 Oct 27 04:33:27.510668 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: c4a8b90797b04f59bb513f5b6f4f6ba0 Oct 27 04:33:27.510668 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-186849876 Oct 27 04:33:27.510668 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-TestEncryptedCinderVolumes-186849876-project Oct 27 04:33:27.510668 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 04:33:27.510668 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 04:33:27.510668 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: aec3aa7aba49468e86caef89e306d01d Oct 27 04:33:27.510668 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-TestEncryptedCinderVolumes-186849876-project Oct 27 04:33:27.510668 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 04:33:27.510668 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance af3938e2-5ae5-4d62-bde0-f5c62f067152 is not attached to volume 2d414c74-cb77-440e-a1d7-158529085e3f Oct 27 04:33:27.510668 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'server_id': 'af3938e2-5ae5-4d62-bde0-f5c62f067152', 'id': '2d414c74-cb77-440e-a1d7-158529085e3f'} Oct 27 04:33:27.510668 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 04:33:27.510668 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:33:27.510668 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 27 04:33:27.510668 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 27 04:33:27.510668 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 04:33:27.510668 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 04:33:27.510668 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 27 04:33:27.510668 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 27 04:33:27.510668 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 2d414c74-cb77-440e-a1d7-158529085e3f. Oct 27 04:33:27.510668 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:33:27.510668 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:33:27.510668 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:33:27.510668 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:33:27.510668 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:33:27.510668 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:33:27.510668 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 04:33:27.510668 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 04:33:27.510668 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 04:33:27.510668 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 04:33:27.510668 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 27 04:33:27.510668 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 27 04:33:27.510668 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af3938e2-5ae5-4d62-bde0-f5c62f067152 is not attached to volume 2d414c74-cb77-440e-a1d7-158529085e3f Oct 27 04:33:27.510668 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:33:27.510668 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:33:27.510668 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:33:27.510668 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:33:27.510668 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:33:27.510668 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:33:27.516097 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 04:33:27.516097 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 04:33:27.516097 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af3938e2-5ae5-4d62-bde0-f5c62f067152 is not attached to volume 2d414c74-cb77-440e-a1d7-158529085e3f Oct 27 04:33:27.516097 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:33:27.516097 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-65920208-0b2c-4d77-9403-4ed784a7f78e tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Returning 404 to user: Instance af3938e2-5ae5-4d62-bde0-f5c62f067152 is not attached to volume 2d414c74-cb77-440e-a1d7-158529085e3f {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 04:33:27.516097 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-65920208-0b2c-4d77-9403-4ed784a7f78e tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] 10.222.0.20 "DELETE /compute/v2.1/servers/af3938e2-5ae5-4d62-bde0-f5c62f067152/os-volume_attachments/2d414c74-cb77-440e-a1d7-158529085e3f" status: 404 len: 154 microversion: 2.1 time: 0.101352 Oct 27 04:33:27.516097 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3727/7747] 10.222.0.20 () {58 vars in 1416 bytes} [Thu Oct 27 04:33:27 2022] DELETE /compute/v2.1/servers/af3938e2-5ae5-4d62-bde0-f5c62f067152/os-volume_attachments/2d414c74-cb77-440e-a1d7-158529085e3f => generated 154 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 04:33:31.056898 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e457d825-ece5-4d94-abda-c6d44f2bd9d0 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:33:31.062291 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e457d825-ece5-4d94-abda-c6d44f2bd9d0 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] [instance: af3938e2-5ae5-4d62-bde0-f5c62f067152] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:33:31.063739 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e457d825-ece5-4d94-abda-c6d44f2bd9d0 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:33:31.064245 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e457d825-ece5-4d94-abda-c6d44f2bd9d0 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:33:31.064704 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e457d825-ece5-4d94-abda-c6d44f2bd9d0 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:33:31.065425 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e457d825-ece5-4d94-abda-c6d44f2bd9d0 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:33:31.065902 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e457d825-ece5-4d94-abda-c6d44f2bd9d0 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:33:31.066390 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e457d825-ece5-4d94-abda-c6d44f2bd9d0 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:33:31.092366 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e457d825-ece5-4d94-abda-c6d44f2bd9d0 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] [instance: af3938e2-5ae5-4d62-bde0-f5c62f067152] Going to try to terminate instance {{(pid=121001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 04:33:31.380317 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e457d825-ece5-4d94-abda-c6d44f2bd9d0 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] 10.222.0.20 "DELETE /compute/v2.1/servers/af3938e2-5ae5-4d62-bde0-f5c62f067152" status: 204 len: 0 microversion: 2.1 time: 0.327835 Oct 27 04:33:31.380926 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4021/7748] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 04:33:31 2022] DELETE /compute/v2.1/servers/af3938e2-5ae5-4d62-bde0-f5c62f067152 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 04:33:31.389725 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-90c4eccc-ddc9-4268-b5ea-df5c3fb135a5 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:33:31.390380 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-90c4eccc-ddc9-4268-b5ea-df5c3fb135a5 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] [instance: af3938e2-5ae5-4d62-bde0-f5c62f067152] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:33:31.396958 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-90c4eccc-ddc9-4268-b5ea-df5c3fb135a5 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:33:31.397448 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-90c4eccc-ddc9-4268-b5ea-df5c3fb135a5 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:33:31.397910 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-90c4eccc-ddc9-4268-b5ea-df5c3fb135a5 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:33:31.398632 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-90c4eccc-ddc9-4268-b5ea-df5c3fb135a5 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:33:31.399172 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-90c4eccc-ddc9-4268-b5ea-df5c3fb135a5 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:33:31.399528 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-90c4eccc-ddc9-4268-b5ea-df5c3fb135a5 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:33:31.536489 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-90c4eccc-ddc9-4268-b5ea-df5c3fb135a5 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec3aa7aba49468e86caef89e306d01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8b90797b04f59bb513f5b6f4f6ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:33:31.545026 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-90c4eccc-ddc9-4268-b5ea-df5c3fb135a5 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] 10.222.0.20 "GET /compute/v2.1/servers/af3938e2-5ae5-4d62-bde0-f5c62f067152" status: 200 len: 1560 microversion: 2.1 time: 0.159189 Oct 27 04:33:31.545600 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3728/7749] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:33:31 2022] GET /compute/v2.1/servers/af3938e2-5ae5-4d62-bde0-f5c62f067152 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 04:33:32.569651 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4989a26b-632b-45d9-8136-4d63a2e526c9 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:33:32.570413 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4989a26b-632b-45d9-8136-4d63a2e526c9 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] [instance: af3938e2-5ae5-4d62-bde0-f5c62f067152] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:33:32.577354 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4989a26b-632b-45d9-8136-4d63a2e526c9 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:33:32.577862 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4989a26b-632b-45d9-8136-4d63a2e526c9 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:33:32.578359 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4989a26b-632b-45d9-8136-4d63a2e526c9 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:33:32.579078 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4989a26b-632b-45d9-8136-4d63a2e526c9 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:33:32.579559 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4989a26b-632b-45d9-8136-4d63a2e526c9 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:33:32.580013 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4989a26b-632b-45d9-8136-4d63a2e526c9 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:33:32.711414 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4989a26b-632b-45d9-8136-4d63a2e526c9 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec3aa7aba49468e86caef89e306d01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8b90797b04f59bb513f5b6f4f6ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:33:32.719954 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4989a26b-632b-45d9-8136-4d63a2e526c9 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] 10.222.0.20 "GET /compute/v2.1/servers/af3938e2-5ae5-4d62-bde0-f5c62f067152" status: 200 len: 1560 microversion: 2.1 time: 0.154652 Oct 27 04:33:32.720538 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4022/7750] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:33:32 2022] GET /compute/v2.1/servers/af3938e2-5ae5-4d62-bde0-f5c62f067152 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:33:33.607724 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-c282b06b-1f92-4a9a-a32b-1f6841d25ab0 req-d4d9903e-a289-4ba4-9641-8850f8992b34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af3938e2-5ae5-4d62-bde0-f5c62f067152", "name": "network-vif-deleted", "tag": "986b9d8d-d5db-425d-b16e-1227c0872b83"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:33:33.618134 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-c282b06b-1f92-4a9a-a32b-1f6841d25ab0 req-d4d9903e-a289-4ba4-9641-8850f8992b34 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:33:33.618615 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-c282b06b-1f92-4a9a-a32b-1f6841d25ab0 req-d4d9903e-a289-4ba4-9641-8850f8992b34 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:33:33.619553 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-c282b06b-1f92-4a9a-a32b-1f6841d25ab0 req-d4d9903e-a289-4ba4-9641-8850f8992b34 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:33:33.630560 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-c282b06b-1f92-4a9a-a32b-1f6841d25ab0 req-d4d9903e-a289-4ba4-9641-8850f8992b34 service nova] Creating event network-vif-deleted:986b9d8d-d5db-425d-b16e-1227c0872b83 for instance af3938e2-5ae5-4d62-bde0-f5c62f067152 on n-h1-862769-1 Oct 27 04:33:33.636088 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-c282b06b-1f92-4a9a-a32b-1f6841d25ab0 req-d4d9903e-a289-4ba4-9641-8850f8992b34 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032088 Oct 27 04:33:33.636677 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3729/7751] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:33:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:33:33.745274 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9b2da936-ec36-463d-8e02-a2c50dda493d tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:33:33.745923 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-9b2da936-ec36-463d-8e02-a2c50dda493d tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] [instance: af3938e2-5ae5-4d62-bde0-f5c62f067152] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:33:33.752811 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9b2da936-ec36-463d-8e02-a2c50dda493d tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:33:33.753264 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9b2da936-ec36-463d-8e02-a2c50dda493d tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:33:33.753728 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9b2da936-ec36-463d-8e02-a2c50dda493d tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:33:33.754485 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9b2da936-ec36-463d-8e02-a2c50dda493d tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:33:33.754968 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9b2da936-ec36-463d-8e02-a2c50dda493d tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:33:33.755419 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9b2da936-ec36-463d-8e02-a2c50dda493d tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:33:33.818476 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9b2da936-ec36-463d-8e02-a2c50dda493d tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec3aa7aba49468e86caef89e306d01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8b90797b04f59bb513f5b6f4f6ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:33:33.826686 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9b2da936-ec36-463d-8e02-a2c50dda493d tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] 10.222.0.20 "GET /compute/v2.1/servers/af3938e2-5ae5-4d62-bde0-f5c62f067152" status: 200 len: 1348 microversion: 2.1 time: 0.086061 Oct 27 04:33:33.827273 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4023/7752] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:33:33 2022] GET /compute/v2.1/servers/af3938e2-5ae5-4d62-bde0-f5c62f067152 => generated 1348 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:33:34.851578 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e3bc61fc-a2ed-43ae-94cc-cf54b362830a tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:33:34.852287 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e3bc61fc-a2ed-43ae-94cc-cf54b362830a tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] [instance: af3938e2-5ae5-4d62-bde0-f5c62f067152] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:33:34.858568 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e3bc61fc-a2ed-43ae-94cc-cf54b362830a tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:33:34.859056 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e3bc61fc-a2ed-43ae-94cc-cf54b362830a tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:33:34.859497 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e3bc61fc-a2ed-43ae-94cc-cf54b362830a tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:33:34.860189 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e3bc61fc-a2ed-43ae-94cc-cf54b362830a tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:33:34.860648 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e3bc61fc-a2ed-43ae-94cc-cf54b362830a tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:33:34.861074 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e3bc61fc-a2ed-43ae-94cc-cf54b362830a tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:33:34.874857 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-e3bc61fc-a2ed-43ae-94cc-cf54b362830a tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] HTTP exception thrown: Instance af3938e2-5ae5-4d62-bde0-f5c62f067152 could not be found. Oct 27 04:33:34.876364 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e3bc61fc-a2ed-43ae-94cc-cf54b362830a tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Request method failure captured: Oct 27 04:33:34.876364 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/af3938e2-5ae5-4d62-bde0-f5c62f067152 HTTP/1.1 Oct 27 04:33:34.876364 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 04:33:34.876364 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 04:33:34.876364 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 04:33:34.876364 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 04:33:34.876364 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 04:33:34.876364 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 04:33:34.876364 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 04:33:34.876364 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 04:33:34.876364 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWgntydcp5ucyHhbhzCFUw5z1Qa5I4ESWqPpfdPgOqm66QNd0jyTjtGd6eTxa7eImf2v1ba9CEyum0GiPKZG2hDfZxnvQtUQUD9-2xS88KBIMOAkwT-bueemeWQr6Ipcz8LM0YNs7A3Wbr85EKibgX9GYFE5tcNTEuszQ_S9andFdlBQ Oct 27 04:33:34.876364 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 04:33:34.876364 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 04:33:34.876364 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 04:33:34.876364 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 04:33:34.876364 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 04:33:34.876364 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 04:33:34.876364 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: c4a8b90797b04f59bb513f5b6f4f6ba0 Oct 27 04:33:34.876364 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-TestEncryptedCinderVolumes-186849876 Oct 27 04:33:34.876364 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 04:33:34.876364 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 04:33:34.876364 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c4a8b90797b04f59bb513f5b6f4f6ba0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c4a8b90797b04f59bb513f5b6f4f6ba0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c4a8b90797b04f59bb513f5b6f4f6ba0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c4a8b90797b04f59bb513f5b6f4f6ba0"}]}] Oct 27 04:33:34.876364 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-TestEncryptedCinderVolumes-186849876 Oct 27 04:33:34.876364 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: c4a8b90797b04f59bb513f5b6f4f6ba0 Oct 27 04:33:34.876364 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-186849876 Oct 27 04:33:34.876364 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-TestEncryptedCinderVolumes-186849876-project Oct 27 04:33:34.876364 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 04:33:34.876364 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 04:33:34.876364 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: aec3aa7aba49468e86caef89e306d01d Oct 27 04:33:34.876364 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-TestEncryptedCinderVolumes-186849876-project Oct 27 04:33:34.876364 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 04:33:34.876364 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance af3938e2-5ae5-4d62-bde0-f5c62f067152 could not be found. Oct 27 04:33:34.876364 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': 'af3938e2-5ae5-4d62-bde0-f5c62f067152'} Oct 27 04:33:34.876364 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 04:33:34.876364 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:33:34.876364 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 04:33:34.876364 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 04:33:34.876364 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 04:33:34.876364 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 04:33:34.876364 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 04:33:34.876364 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 04:33:34.876364 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 04:33:34.876364 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 04:33:34.876364 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af3938e2-5ae5-4d62-bde0-f5c62f067152 could not be found. Oct 27 04:33:34.876364 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:33:34.876364 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:33:34.876364 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:33:34.876364 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:33:34.876364 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:33:34.876364 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:33:34.876364 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 04:33:34.876364 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 04:33:34.876364 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 04:33:34.876364 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 04:33:34.876364 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 04:33:34.876364 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 04:33:34.876364 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 04:33:34.876364 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 04:33:34.876364 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 04:33:34.876364 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 04:33:34.876364 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af3938e2-5ae5-4d62-bde0-f5c62f067152 could not be found. Oct 27 04:33:34.876364 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:33:34.876364 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:33:34.876364 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:33:34.881334 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:33:34.881334 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:33:34.881334 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:33:34.881334 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 04:33:34.881334 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 04:33:34.881334 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af3938e2-5ae5-4d62-bde0-f5c62f067152 could not be found. Oct 27 04:33:34.881334 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:33:34.881334 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e3bc61fc-a2ed-43ae-94cc-cf54b362830a tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Returning 404 to user: Instance af3938e2-5ae5-4d62-bde0-f5c62f067152 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 04:33:34.881334 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e3bc61fc-a2ed-43ae-94cc-cf54b362830a tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] 10.222.0.20 "GET /compute/v2.1/servers/af3938e2-5ae5-4d62-bde0-f5c62f067152" status: 404 len: 111 microversion: 2.1 time: 0.031587 Oct 27 04:33:34.881334 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3730/7753] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:33:34 2022] GET /compute/v2.1/servers/af3938e2-5ae5-4d62-bde0-f5c62f067152 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 04:33:34.890484 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2a43e96e-7d9a-48bf-a133-589e70235285 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Calling method '.version_select at 0x7f7dda54e430>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:33:34.975751 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2a43e96e-7d9a-48bf-a133-589e70235285 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1707111844" status: 202 len: 0 microversion: 2.1 time: 0.092878 Oct 27 04:33:34.976343 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4024/7754] 10.222.0.20 () {58 vars in 1278 bytes} [Thu Oct 27 04:33:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1707111844 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 04:33:34.994495 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9b9cf568-cefc-4b09-a609-696b690d5e40 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Action: 'create', calling method: .version_select at 0x7f7dda8734c0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1502071940", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA1SmeaSmquQp85RqtUI3hn7AykrAxQLyyw7XXR1qAtWFtbGDpG9Yc/56jiYjyVjLEmTUFbcaBp/6TsibK3uAdK8zWGRiW4OJcrhpedPxU/BX+s9xky96fehvDW9MrU0mg=="}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:33:35.010245 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-9b9cf568-cefc-4b09-a609-696b690d5e40 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Getting quotas for project c4a8b90797b04f59bb513f5b6f4f6ba0. Resources: {'key_pairs'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 04:33:35.019012 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-9b9cf568-cefc-4b09-a609-696b690d5e40 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Getting quotas for user aec3aa7aba49468e86caef89e306d01d and project c4a8b90797b04f59bb513f5b6f4f6ba0. Resources: {'key_pairs'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 04:33:35.095853 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9b9cf568-cefc-4b09-a609-696b690d5e40 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.105716 Oct 27 04:33:35.096392 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3731/7755] 10.222.0.20 () {60 vars in 1159 bytes} [Thu Oct 27 04:33:34 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:33:35.147305 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d8b4826c-949a-46db-bae7-1055446b952a tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1695867806", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1502071940", "networks": [{"uuid": "06806bc8-a4e7-445b-ac18-67263dd5b30c"}]}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:33:35.200313 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.network.neutron [None req-d8b4826c-949a-46db-bae7-1055446b952a tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] validate_networks() for [('06806bc8-a4e7-445b-ac18-67263dd5b30c', None, None, None, None, None)] {{(pid=121001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 04:33:35.658486 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-d8b4826c-949a-46db-bae7-1055446b952a tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Flavor limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 04:33:35.658964 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-d8b4826c-949a-46db-bae7-1055446b952a tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Image limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 04:33:35.659456 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-d8b4826c-949a-46db-bae7-1055446b952a tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Flavor pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 04:33:35.659887 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-d8b4826c-949a-46db-bae7-1055446b952a tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Image pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 04:33:35.660316 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-d8b4826c-949a-46db-bae7-1055446b952a tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 04:33:35.669183 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d8b4826c-949a-46db-bae7-1055446b952a tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:33:35.669680 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d8b4826c-949a-46db-bae7-1055446b952a tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:33:35.670163 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d8b4826c-949a-46db-bae7-1055446b952a tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:33:35.670919 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d8b4826c-949a-46db-bae7-1055446b952a tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:33:35.671390 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d8b4826c-949a-46db-bae7-1055446b952a tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:33:35.671835 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d8b4826c-949a-46db-bae7-1055446b952a tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:33:35.689753 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-d8b4826c-949a-46db-bae7-1055446b952a tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Getting quotas for project c4a8b90797b04f59bb513f5b6f4f6ba0. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 04:33:35.695087 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-d8b4826c-949a-46db-bae7-1055446b952a tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Getting quotas for user aec3aa7aba49468e86caef89e306d01d and project c4a8b90797b04f59bb513f5b6f4f6ba0. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 04:33:35.707916 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d8b4826c-949a-46db-bae7-1055446b952a tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Going to run 1 instances... {{(pid=121001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 04:33:35.710270 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d8b4826c-949a-46db-bae7-1055446b952a tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] [instance: 10ed043d-729c-4fe5-aff6-e98d73b8c31f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 04:33:35.818207 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d8b4826c-949a-46db-bae7-1055446b952a tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.674841 Oct 27 04:33:35.818869 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4025/7756] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 04:33:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 676 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 04:33:35.830770 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5c86ad4f-8e4a-45be-af36-09e06d4ffcbe tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:33:35.831401 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5c86ad4f-8e4a-45be-af36-09e06d4ffcbe tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] [instance: 10ed043d-729c-4fe5-aff6-e98d73b8c31f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:33:35.886953 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5c86ad4f-8e4a-45be-af36-09e06d4ffcbe tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec3aa7aba49468e86caef89e306d01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8b90797b04f59bb513f5b6f4f6ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:33:35.894151 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5c86ad4f-8e4a-45be-af36-09e06d4ffcbe tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] 10.222.0.20 "GET /compute/v2.1/servers/10ed043d-729c-4fe5-aff6-e98d73b8c31f" status: 200 len: 1263 microversion: 2.1 time: 0.067256 Oct 27 04:33:35.894811 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3732/7757] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:33:35 2022] GET /compute/v2.1/servers/10ed043d-729c-4fe5-aff6-e98d73b8c31f => generated 1263 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:33:36.917817 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-56c2465e-9478-424d-8fdb-844aa93676f0 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:33:36.918493 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-56c2465e-9478-424d-8fdb-844aa93676f0 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] [instance: 10ed043d-729c-4fe5-aff6-e98d73b8c31f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:33:36.925507 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-56c2465e-9478-424d-8fdb-844aa93676f0 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:33:36.926014 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-56c2465e-9478-424d-8fdb-844aa93676f0 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:33:36.926612 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-56c2465e-9478-424d-8fdb-844aa93676f0 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:33:36.927369 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-56c2465e-9478-424d-8fdb-844aa93676f0 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:33:36.927845 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-56c2465e-9478-424d-8fdb-844aa93676f0 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:33:36.928333 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-56c2465e-9478-424d-8fdb-844aa93676f0 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:33:36.994662 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-56c2465e-9478-424d-8fdb-844aa93676f0 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec3aa7aba49468e86caef89e306d01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8b90797b04f59bb513f5b6f4f6ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:33:37.002318 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-56c2465e-9478-424d-8fdb-844aa93676f0 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] 10.222.0.20 "GET /compute/v2.1/servers/10ed043d-729c-4fe5-aff6-e98d73b8c31f" status: 200 len: 1267 microversion: 2.1 time: 0.089352 Oct 27 04:33:37.002898 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4026/7758] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:33:36 2022] GET /compute/v2.1/servers/10ed043d-729c-4fe5-aff6-e98d73b8c31f => generated 1267 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:33:38.026485 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-93447c7c-e3c8-4e1e-8f3c-9045c83b49e6 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:33:38.027727 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-93447c7c-e3c8-4e1e-8f3c-9045c83b49e6 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] [instance: 10ed043d-729c-4fe5-aff6-e98d73b8c31f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:33:38.036333 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-93447c7c-e3c8-4e1e-8f3c-9045c83b49e6 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:33:38.037032 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-93447c7c-e3c8-4e1e-8f3c-9045c83b49e6 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:33:38.037527 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-93447c7c-e3c8-4e1e-8f3c-9045c83b49e6 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:33:38.038478 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-93447c7c-e3c8-4e1e-8f3c-9045c83b49e6 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:33:38.038942 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-93447c7c-e3c8-4e1e-8f3c-9045c83b49e6 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:33:38.039371 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-93447c7c-e3c8-4e1e-8f3c-9045c83b49e6 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:33:38.102018 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-93447c7c-e3c8-4e1e-8f3c-9045c83b49e6 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec3aa7aba49468e86caef89e306d01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8b90797b04f59bb513f5b6f4f6ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:33:38.110747 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-93447c7c-e3c8-4e1e-8f3c-9045c83b49e6 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] 10.222.0.20 "GET /compute/v2.1/servers/10ed043d-729c-4fe5-aff6-e98d73b8c31f" status: 200 len: 1323 microversion: 2.1 time: 0.088749 Oct 27 04:33:38.114365 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3733/7759] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:33:38 2022] GET /compute/v2.1/servers/10ed043d-729c-4fe5-aff6-e98d73b8c31f => generated 1323 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:33:39.135266 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0e2cac83-e71a-4f39-a3a5-b3153bbee9c9 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:33:39.135917 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0e2cac83-e71a-4f39-a3a5-b3153bbee9c9 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] [instance: 10ed043d-729c-4fe5-aff6-e98d73b8c31f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:33:39.142866 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0e2cac83-e71a-4f39-a3a5-b3153bbee9c9 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:33:39.143386 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0e2cac83-e71a-4f39-a3a5-b3153bbee9c9 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:33:39.143855 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0e2cac83-e71a-4f39-a3a5-b3153bbee9c9 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:33:39.144591 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0e2cac83-e71a-4f39-a3a5-b3153bbee9c9 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:33:39.145074 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0e2cac83-e71a-4f39-a3a5-b3153bbee9c9 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:33:39.145532 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0e2cac83-e71a-4f39-a3a5-b3153bbee9c9 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:33:39.286782 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0e2cac83-e71a-4f39-a3a5-b3153bbee9c9 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec3aa7aba49468e86caef89e306d01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8b90797b04f59bb513f5b6f4f6ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:33:39.295417 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0e2cac83-e71a-4f39-a3a5-b3153bbee9c9 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] 10.222.0.20 "GET /compute/v2.1/servers/10ed043d-729c-4fe5-aff6-e98d73b8c31f" status: 200 len: 1363 microversion: 2.1 time: 0.164045 Oct 27 04:33:39.297690 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4027/7760] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:33:39 2022] GET /compute/v2.1/servers/10ed043d-729c-4fe5-aff6-e98d73b8c31f => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:33:39.677509 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-3f0a016a-4b16-4e93-b2df-8985fc45de77 req-a43dd79e-6dd0-4751-a843-7b58dee3a9d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10ed043d-729c-4fe5-aff6-e98d73b8c31f", "tag": "08721117-58f6-40fc-b201-61219486a43b"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:33:39.689054 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-3f0a016a-4b16-4e93-b2df-8985fc45de77 req-a43dd79e-6dd0-4751-a843-7b58dee3a9d6 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:33:39.689538 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-3f0a016a-4b16-4e93-b2df-8985fc45de77 req-a43dd79e-6dd0-4751-a843-7b58dee3a9d6 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:33:39.689969 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-3f0a016a-4b16-4e93-b2df-8985fc45de77 req-a43dd79e-6dd0-4751-a843-7b58dee3a9d6 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:33:39.701548 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-3f0a016a-4b16-4e93-b2df-8985fc45de77 req-a43dd79e-6dd0-4751-a843-7b58dee3a9d6 service nova] Creating event network-changed:08721117-58f6-40fc-b201-61219486a43b for instance 10ed043d-729c-4fe5-aff6-e98d73b8c31f on n-h1-862769-1 Oct 27 04:33:39.707277 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-3f0a016a-4b16-4e93-b2df-8985fc45de77 req-a43dd79e-6dd0-4751-a843-7b58dee3a9d6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032928 Oct 27 04:33:39.707542 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3734/7761] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:33:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:33:40.319391 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-787bbd52-e376-44a1-a97e-dde20382cb42 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:33:40.320033 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-787bbd52-e376-44a1-a97e-dde20382cb42 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] [instance: 10ed043d-729c-4fe5-aff6-e98d73b8c31f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:33:40.326797 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-787bbd52-e376-44a1-a97e-dde20382cb42 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:33:40.327299 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-787bbd52-e376-44a1-a97e-dde20382cb42 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:33:40.327757 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-787bbd52-e376-44a1-a97e-dde20382cb42 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:33:40.328497 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-787bbd52-e376-44a1-a97e-dde20382cb42 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:33:40.328977 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-787bbd52-e376-44a1-a97e-dde20382cb42 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:33:40.329421 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-787bbd52-e376-44a1-a97e-dde20382cb42 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:33:40.486218 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-787bbd52-e376-44a1-a97e-dde20382cb42 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec3aa7aba49468e86caef89e306d01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8b90797b04f59bb513f5b6f4f6ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:33:40.493826 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-787bbd52-e376-44a1-a97e-dde20382cb42 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] 10.222.0.20 "GET /compute/v2.1/servers/10ed043d-729c-4fe5-aff6-e98d73b8c31f" status: 200 len: 1363 microversion: 2.1 time: 0.178380 Oct 27 04:33:40.502066 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4028/7762] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:33:40 2022] GET /compute/v2.1/servers/10ed043d-729c-4fe5-aff6-e98d73b8c31f => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:33:41.518088 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-53c43fb0-6a22-4b95-80f6-54f7cecf70c2 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:33:41.518816 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-53c43fb0-6a22-4b95-80f6-54f7cecf70c2 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] [instance: 10ed043d-729c-4fe5-aff6-e98d73b8c31f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:33:41.525600 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-53c43fb0-6a22-4b95-80f6-54f7cecf70c2 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:33:41.526121 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-53c43fb0-6a22-4b95-80f6-54f7cecf70c2 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:33:41.526568 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-53c43fb0-6a22-4b95-80f6-54f7cecf70c2 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:33:41.527266 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-53c43fb0-6a22-4b95-80f6-54f7cecf70c2 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:33:41.527728 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-53c43fb0-6a22-4b95-80f6-54f7cecf70c2 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:33:41.528159 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-53c43fb0-6a22-4b95-80f6-54f7cecf70c2 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:33:41.659655 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-53c43fb0-6a22-4b95-80f6-54f7cecf70c2 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec3aa7aba49468e86caef89e306d01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8b90797b04f59bb513f5b6f4f6ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:33:41.667336 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-53c43fb0-6a22-4b95-80f6-54f7cecf70c2 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] 10.222.0.20 "GET /compute/v2.1/servers/10ed043d-729c-4fe5-aff6-e98d73b8c31f" status: 200 len: 1363 microversion: 2.1 time: 0.154458 Oct 27 04:33:41.667919 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3735/7763] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:33:41 2022] GET /compute/v2.1/servers/10ed043d-729c-4fe5-aff6-e98d73b8c31f => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:33:42.690473 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3f88ee9b-402c-4305-8b0f-3603cda54e17 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:33:42.691118 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3f88ee9b-402c-4305-8b0f-3603cda54e17 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] [instance: 10ed043d-729c-4fe5-aff6-e98d73b8c31f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:33:42.698643 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3f88ee9b-402c-4305-8b0f-3603cda54e17 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:33:42.699154 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3f88ee9b-402c-4305-8b0f-3603cda54e17 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:33:42.699618 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3f88ee9b-402c-4305-8b0f-3603cda54e17 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:33:42.700340 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3f88ee9b-402c-4305-8b0f-3603cda54e17 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:33:42.700819 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3f88ee9b-402c-4305-8b0f-3603cda54e17 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:33:42.701280 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3f88ee9b-402c-4305-8b0f-3603cda54e17 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:33:42.833287 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3f88ee9b-402c-4305-8b0f-3603cda54e17 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec3aa7aba49468e86caef89e306d01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8b90797b04f59bb513f5b6f4f6ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:33:42.841721 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3f88ee9b-402c-4305-8b0f-3603cda54e17 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] 10.222.0.20 "GET /compute/v2.1/servers/10ed043d-729c-4fe5-aff6-e98d73b8c31f" status: 200 len: 1363 microversion: 2.1 time: 0.155284 Oct 27 04:33:42.842337 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4029/7764] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:33:42 2022] GET /compute/v2.1/servers/10ed043d-729c-4fe5-aff6-e98d73b8c31f => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:33:43.864019 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-bc582dd4-d2be-42cb-9fe1-48b9fb8853bb tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:33:43.864640 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-bc582dd4-d2be-42cb-9fe1-48b9fb8853bb tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] [instance: 10ed043d-729c-4fe5-aff6-e98d73b8c31f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:33:43.872120 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bc582dd4-d2be-42cb-9fe1-48b9fb8853bb tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:33:43.872617 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bc582dd4-d2be-42cb-9fe1-48b9fb8853bb tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:33:43.873068 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bc582dd4-d2be-42cb-9fe1-48b9fb8853bb tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:33:43.873777 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bc582dd4-d2be-42cb-9fe1-48b9fb8853bb tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:33:43.874286 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bc582dd4-d2be-42cb-9fe1-48b9fb8853bb tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:33:43.874731 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bc582dd4-d2be-42cb-9fe1-48b9fb8853bb tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:33:44.002520 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-bc582dd4-d2be-42cb-9fe1-48b9fb8853bb tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec3aa7aba49468e86caef89e306d01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8b90797b04f59bb513f5b6f4f6ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:33:44.010823 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-bc582dd4-d2be-42cb-9fe1-48b9fb8853bb tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] 10.222.0.20 "GET /compute/v2.1/servers/10ed043d-729c-4fe5-aff6-e98d73b8c31f" status: 200 len: 1363 microversion: 2.1 time: 0.150734 Oct 27 04:33:44.011403 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3736/7765] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:33:43 2022] GET /compute/v2.1/servers/10ed043d-729c-4fe5-aff6-e98d73b8c31f => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:33:45.032854 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4dec83bc-88b2-4990-b2a3-3de44db2a672 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:33:45.033486 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4dec83bc-88b2-4990-b2a3-3de44db2a672 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] [instance: 10ed043d-729c-4fe5-aff6-e98d73b8c31f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:33:45.040469 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4dec83bc-88b2-4990-b2a3-3de44db2a672 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:33:45.040943 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4dec83bc-88b2-4990-b2a3-3de44db2a672 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:33:45.041397 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4dec83bc-88b2-4990-b2a3-3de44db2a672 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:33:45.042131 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4dec83bc-88b2-4990-b2a3-3de44db2a672 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:33:45.042606 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4dec83bc-88b2-4990-b2a3-3de44db2a672 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:33:45.043049 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4dec83bc-88b2-4990-b2a3-3de44db2a672 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:33:45.168506 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4dec83bc-88b2-4990-b2a3-3de44db2a672 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec3aa7aba49468e86caef89e306d01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8b90797b04f59bb513f5b6f4f6ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:33:45.176110 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4dec83bc-88b2-4990-b2a3-3de44db2a672 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] 10.222.0.20 "GET /compute/v2.1/servers/10ed043d-729c-4fe5-aff6-e98d73b8c31f" status: 200 len: 1363 microversion: 2.1 time: 0.147238 Oct 27 04:33:45.176685 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4030/7766] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:33:45 2022] GET /compute/v2.1/servers/10ed043d-729c-4fe5-aff6-e98d73b8c31f => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:33:46.199345 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-fb3ccb20-0f95-45e1-9a4b-f24e9d367779 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:33:46.200095 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-fb3ccb20-0f95-45e1-9a4b-f24e9d367779 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] [instance: 10ed043d-729c-4fe5-aff6-e98d73b8c31f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:33:46.202999 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=6 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:33:46.207758 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fb3ccb20-0f95-45e1-9a4b-f24e9d367779 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:33:46.211160 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fb3ccb20-0f95-45e1-9a4b-f24e9d367779 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:33:46.211160 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fb3ccb20-0f95-45e1-9a4b-f24e9d367779 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:33:46.211160 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fb3ccb20-0f95-45e1-9a4b-f24e9d367779 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:33:46.211160 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fb3ccb20-0f95-45e1-9a4b-f24e9d367779 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:33:46.211160 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fb3ccb20-0f95-45e1-9a4b-f24e9d367779 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:33:46.305142 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-95215f73-a724-4002-b6e4-4d20c56744a8 req-3a451d21-5ee3-4270-beac-43265ceeb6c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10ed043d-729c-4fe5-aff6-e98d73b8c31f", "name": "network-vif-plugged", "status": "completed", "tag": "08721117-58f6-40fc-b201-61219486a43b"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:33:46.313846 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:33:46.314591 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=6 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:33:46.317762 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-95215f73-a724-4002-b6e4-4d20c56744a8 req-3a451d21-5ee3-4270-beac-43265ceeb6c2 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:33:46.318291 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-95215f73-a724-4002-b6e4-4d20c56744a8 req-3a451d21-5ee3-4270-beac-43265ceeb6c2 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:33:46.318751 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-95215f73-a724-4002-b6e4-4d20c56744a8 req-3a451d21-5ee3-4270-beac-43265ceeb6c2 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:33:46.330200 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-95215f73-a724-4002-b6e4-4d20c56744a8 req-3a451d21-5ee3-4270-beac-43265ceeb6c2 service nova] Creating event network-vif-plugged:08721117-58f6-40fc-b201-61219486a43b for instance 10ed043d-729c-4fe5-aff6-e98d73b8c31f on n-h1-862769-1 Oct 27 04:33:46.335318 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-95215f73-a724-4002-b6e4-4d20c56744a8 req-3a451d21-5ee3-4270-beac-43265ceeb6c2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033839 Oct 27 04:33:46.335913 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4031/7767] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:33:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:33:46.344988 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-fb3ccb20-0f95-45e1-9a4b-f24e9d367779 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec3aa7aba49468e86caef89e306d01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8b90797b04f59bb513f5b6f4f6ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:33:46.353056 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-fb3ccb20-0f95-45e1-9a4b-f24e9d367779 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] 10.222.0.20 "GET /compute/v2.1/servers/10ed043d-729c-4fe5-aff6-e98d73b8c31f" status: 200 len: 1363 microversion: 2.1 time: 0.157640 Oct 27 04:33:46.354294 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3737/7768] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:33:46 2022] GET /compute/v2.1/servers/10ed043d-729c-4fe5-aff6-e98d73b8c31f => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:33:47.378958 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3d23e1d5-c222-41d8-9e79-37b8014868c0 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:33:47.379691 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3d23e1d5-c222-41d8-9e79-37b8014868c0 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] [instance: 10ed043d-729c-4fe5-aff6-e98d73b8c31f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:33:47.386337 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3d23e1d5-c222-41d8-9e79-37b8014868c0 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:33:47.386837 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3d23e1d5-c222-41d8-9e79-37b8014868c0 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:33:47.387305 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3d23e1d5-c222-41d8-9e79-37b8014868c0 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:33:47.388022 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3d23e1d5-c222-41d8-9e79-37b8014868c0 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:33:47.388501 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3d23e1d5-c222-41d8-9e79-37b8014868c0 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:33:47.390659 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3d23e1d5-c222-41d8-9e79-37b8014868c0 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:33:47.517583 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3d23e1d5-c222-41d8-9e79-37b8014868c0 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec3aa7aba49468e86caef89e306d01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8b90797b04f59bb513f5b6f4f6ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:33:47.525342 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3d23e1d5-c222-41d8-9e79-37b8014868c0 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] 10.222.0.20 "GET /compute/v2.1/servers/10ed043d-729c-4fe5-aff6-e98d73b8c31f" status: 200 len: 1363 microversion: 2.1 time: 0.152287 Oct 27 04:33:47.525916 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4032/7769] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:33:47 2022] GET /compute/v2.1/servers/10ed043d-729c-4fe5-aff6-e98d73b8c31f => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:33:48.548576 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-982e2366-22b4-41f7-9350-37f91275ec66 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:33:48.549198 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-982e2366-22b4-41f7-9350-37f91275ec66 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] [instance: 10ed043d-729c-4fe5-aff6-e98d73b8c31f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:33:48.556031 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-982e2366-22b4-41f7-9350-37f91275ec66 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:33:48.556521 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-982e2366-22b4-41f7-9350-37f91275ec66 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:33:48.556962 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-982e2366-22b4-41f7-9350-37f91275ec66 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:33:48.557664 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-982e2366-22b4-41f7-9350-37f91275ec66 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:33:48.558210 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-982e2366-22b4-41f7-9350-37f91275ec66 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:33:48.558642 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-982e2366-22b4-41f7-9350-37f91275ec66 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:33:48.686176 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-982e2366-22b4-41f7-9350-37f91275ec66 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec3aa7aba49468e86caef89e306d01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8b90797b04f59bb513f5b6f4f6ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:33:48.693807 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-982e2366-22b4-41f7-9350-37f91275ec66 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] 10.222.0.20 "GET /compute/v2.1/servers/10ed043d-729c-4fe5-aff6-e98d73b8c31f" status: 200 len: 1554 microversion: 2.1 time: 0.149294 Oct 27 04:33:48.694411 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3738/7770] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:33:48 2022] GET /compute/v2.1/servers/10ed043d-729c-4fe5-aff6-e98d73b8c31f => generated 1554 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:33:48.717119 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-aca319c5-cd49-4525-8df7-24334954e0ba tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:33:48.719116 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-aca319c5-cd49-4525-8df7-24334954e0ba tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] [instance: 10ed043d-729c-4fe5-aff6-e98d73b8c31f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:33:48.724698 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aca319c5-cd49-4525-8df7-24334954e0ba tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:33:48.725206 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aca319c5-cd49-4525-8df7-24334954e0ba tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:33:48.725667 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aca319c5-cd49-4525-8df7-24334954e0ba tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:33:48.726468 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aca319c5-cd49-4525-8df7-24334954e0ba tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:33:48.726943 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aca319c5-cd49-4525-8df7-24334954e0ba tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:33:48.727428 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aca319c5-cd49-4525-8df7-24334954e0ba tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:33:48.749961 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:33:48.858823 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-aca319c5-cd49-4525-8df7-24334954e0ba tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec3aa7aba49468e86caef89e306d01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8b90797b04f59bb513f5b6f4f6ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:33:48.866635 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-aca319c5-cd49-4525-8df7-24334954e0ba tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] 10.222.0.20 "GET /compute/v2.1/servers/10ed043d-729c-4fe5-aff6-e98d73b8c31f" status: 200 len: 1554 microversion: 2.1 time: 0.153927 Oct 27 04:33:48.867419 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4033/7771] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:33:48 2022] GET /compute/v2.1/servers/10ed043d-729c-4fe5-aff6-e98d73b8c31f => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:33:51.899391 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-346fc0e9-df63-4414-bc9d-a43839c7a546 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "62a8fffc-f12d-4f7a-9462-341bb29f1d9f"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:33:51.902577 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-346fc0e9-df63-4414-bc9d-a43839c7a546 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] [instance: 10ed043d-729c-4fe5-aff6-e98d73b8c31f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:33:51.909301 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-346fc0e9-df63-4414-bc9d-a43839c7a546 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:33:51.909788 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-346fc0e9-df63-4414-bc9d-a43839c7a546 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:33:51.910285 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-346fc0e9-df63-4414-bc9d-a43839c7a546 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:33:51.910979 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-346fc0e9-df63-4414-bc9d-a43839c7a546 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:33:51.911434 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-346fc0e9-df63-4414-bc9d-a43839c7a546 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:33:51.911859 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-346fc0e9-df63-4414-bc9d-a43839c7a546 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:33:52.619628 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-346fc0e9-df63-4414-bc9d-a43839c7a546 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] 10.222.0.20 "POST /compute/v2.1/servers/10ed043d-729c-4fe5-aff6-e98d73b8c31f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.724024 Oct 27 04:33:52.620256 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3739/7772] 10.222.0.20 () {60 vars in 1323 bytes} [Thu Oct 27 04:33:51 2022] POST /compute/v2.1/servers/10ed043d-729c-4fe5-aff6-e98d73b8c31f/os-volume_attachments => generated 194 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:34:04.398705 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e27570f4-0b75-4757-86fd-3bb359a4bf9e tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:34:04.399228 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e27570f4-0b75-4757-86fd-3bb359a4bf9e tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] [instance: 10ed043d-729c-4fe5-aff6-e98d73b8c31f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:34:04.401387 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:34:04.402129 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:34:04.406815 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e27570f4-0b75-4757-86fd-3bb359a4bf9e tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:34:04.407313 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e27570f4-0b75-4757-86fd-3bb359a4bf9e tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:34:04.407768 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e27570f4-0b75-4757-86fd-3bb359a4bf9e tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:34:04.408522 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e27570f4-0b75-4757-86fd-3bb359a4bf9e tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:34:04.408991 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e27570f4-0b75-4757-86fd-3bb359a4bf9e tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:34:04.409436 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e27570f4-0b75-4757-86fd-3bb359a4bf9e tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:34:04.490015 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-e27570f4-0b75-4757-86fd-3bb359a4bf9e tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lazy-loading 'services' on Instance uuid 10ed043d-729c-4fe5-aff6-e98d73b8c31f {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 04:34:04.775798 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e27570f4-0b75-4757-86fd-3bb359a4bf9e tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] 10.222.0.20 "DELETE /compute/v2.1/servers/10ed043d-729c-4fe5-aff6-e98d73b8c31f/os-volume_attachments/62a8fffc-f12d-4f7a-9462-341bb29f1d9f" status: 202 len: 0 microversion: 2.1 time: 0.381113 Oct 27 04:34:04.776405 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4034/7773] 10.222.0.20 () {58 vars in 1416 bytes} [Thu Oct 27 04:34:04 2022] DELETE /compute/v2.1/servers/10ed043d-729c-4fe5-aff6-e98d73b8c31f/os-volume_attachments/62a8fffc-f12d-4f7a-9462-341bb29f1d9f => generated 0 bytes in 383 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 04:34:04.785872 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:34:04.786937 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:34:04.791281 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3761c689-9569-4ca8-9ad9-281e19edff8e tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:34:04.793610 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-3761c689-9569-4ca8-9ad9-281e19edff8e tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] [instance: 10ed043d-729c-4fe5-aff6-e98d73b8c31f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:34:04.800374 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3761c689-9569-4ca8-9ad9-281e19edff8e tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:34:04.801723 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3761c689-9569-4ca8-9ad9-281e19edff8e tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:34:04.801723 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3761c689-9569-4ca8-9ad9-281e19edff8e tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:34:04.801968 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3761c689-9569-4ca8-9ad9-281e19edff8e tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:34:04.802467 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3761c689-9569-4ca8-9ad9-281e19edff8e tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:34:04.802893 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3761c689-9569-4ca8-9ad9-281e19edff8e tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:34:04.832176 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3761c689-9569-4ca8-9ad9-281e19edff8e tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] 10.222.0.20 "GET /compute/v2.1/servers/10ed043d-729c-4fe5-aff6-e98d73b8c31f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049680 Oct 27 04:34:04.832737 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3740/7774] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 27 04:34:04 2022] GET /compute/v2.1/servers/10ed043d-729c-4fe5-aff6-e98d73b8c31f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:34:05.848706 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-59ed1d1c-3f70-4d94-aa00-3db238578dcf tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:34:05.851107 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-59ed1d1c-3f70-4d94-aa00-3db238578dcf tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] [instance: 10ed043d-729c-4fe5-aff6-e98d73b8c31f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:34:05.858491 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-59ed1d1c-3f70-4d94-aa00-3db238578dcf tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:34:05.859003 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-59ed1d1c-3f70-4d94-aa00-3db238578dcf tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:34:05.859481 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-59ed1d1c-3f70-4d94-aa00-3db238578dcf tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:34:05.860214 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-59ed1d1c-3f70-4d94-aa00-3db238578dcf tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:34:05.860693 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-59ed1d1c-3f70-4d94-aa00-3db238578dcf tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:34:05.861145 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-59ed1d1c-3f70-4d94-aa00-3db238578dcf tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:34:05.893284 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-59ed1d1c-3f70-4d94-aa00-3db238578dcf tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] 10.222.0.20 "GET /compute/v2.1/servers/10ed043d-729c-4fe5-aff6-e98d73b8c31f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051467 Oct 27 04:34:05.894417 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4035/7775] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 27 04:34:05 2022] GET /compute/v2.1/servers/10ed043d-729c-4fe5-aff6-e98d73b8c31f/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:34:06.907555 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8fca0354-8b0f-4770-a7be-58be31b0e5c9 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:34:06.909825 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8fca0354-8b0f-4770-a7be-58be31b0e5c9 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] [instance: 10ed043d-729c-4fe5-aff6-e98d73b8c31f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:34:06.917796 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8fca0354-8b0f-4770-a7be-58be31b0e5c9 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:34:06.918310 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8fca0354-8b0f-4770-a7be-58be31b0e5c9 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:34:06.919296 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8fca0354-8b0f-4770-a7be-58be31b0e5c9 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:34:06.920003 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8fca0354-8b0f-4770-a7be-58be31b0e5c9 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:34:06.920462 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8fca0354-8b0f-4770-a7be-58be31b0e5c9 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:34:06.920886 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8fca0354-8b0f-4770-a7be-58be31b0e5c9 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:34:06.952538 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8fca0354-8b0f-4770-a7be-58be31b0e5c9 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] 10.222.0.20 "GET /compute/v2.1/servers/10ed043d-729c-4fe5-aff6-e98d73b8c31f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049420 Oct 27 04:34:06.953121 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3741/7776] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 27 04:34:06 2022] GET /compute/v2.1/servers/10ed043d-729c-4fe5-aff6-e98d73b8c31f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:34:07.965086 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-73b1a322-01aa-4c6b-9313-4fa0e438454c tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:34:07.967534 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-73b1a322-01aa-4c6b-9313-4fa0e438454c tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] [instance: 10ed043d-729c-4fe5-aff6-e98d73b8c31f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:34:07.974804 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-73b1a322-01aa-4c6b-9313-4fa0e438454c tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:34:07.975326 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-73b1a322-01aa-4c6b-9313-4fa0e438454c tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:34:07.975975 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-73b1a322-01aa-4c6b-9313-4fa0e438454c tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:34:07.976688 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-73b1a322-01aa-4c6b-9313-4fa0e438454c tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:34:07.977157 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-73b1a322-01aa-4c6b-9313-4fa0e438454c tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:34:07.977607 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-73b1a322-01aa-4c6b-9313-4fa0e438454c tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:34:08.008291 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-73b1a322-01aa-4c6b-9313-4fa0e438454c tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] 10.222.0.20 "GET /compute/v2.1/servers/10ed043d-729c-4fe5-aff6-e98d73b8c31f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047300 Oct 27 04:34:08.008867 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4036/7777] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 27 04:34:07 2022] GET /compute/v2.1/servers/10ed043d-729c-4fe5-aff6-e98d73b8c31f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:34:09.029273 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1061b03f-f0d7-4a50-91c2-75773a9752da tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:34:09.032199 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1061b03f-f0d7-4a50-91c2-75773a9752da tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] [instance: 10ed043d-729c-4fe5-aff6-e98d73b8c31f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:34:09.039552 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1061b03f-f0d7-4a50-91c2-75773a9752da tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:34:09.040047 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1061b03f-f0d7-4a50-91c2-75773a9752da tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:34:09.040496 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1061b03f-f0d7-4a50-91c2-75773a9752da tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:34:09.041205 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1061b03f-f0d7-4a50-91c2-75773a9752da tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:34:09.041670 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1061b03f-f0d7-4a50-91c2-75773a9752da tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:34:09.042267 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1061b03f-f0d7-4a50-91c2-75773a9752da tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:34:09.072519 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1061b03f-f0d7-4a50-91c2-75773a9752da tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] 10.222.0.20 "GET /compute/v2.1/servers/10ed043d-729c-4fe5-aff6-e98d73b8c31f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052264 Oct 27 04:34:09.073129 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3742/7778] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 27 04:34:09 2022] GET /compute/v2.1/servers/10ed043d-729c-4fe5-aff6-e98d73b8c31f/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:34:10.084969 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-531a8180-49f5-464e-99fa-e290bd620106 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:34:10.087276 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-531a8180-49f5-464e-99fa-e290bd620106 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] [instance: 10ed043d-729c-4fe5-aff6-e98d73b8c31f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:34:10.094731 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-531a8180-49f5-464e-99fa-e290bd620106 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:34:10.095238 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-531a8180-49f5-464e-99fa-e290bd620106 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:34:10.095697 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-531a8180-49f5-464e-99fa-e290bd620106 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:34:10.096417 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-531a8180-49f5-464e-99fa-e290bd620106 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:34:10.096899 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-531a8180-49f5-464e-99fa-e290bd620106 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:34:10.097345 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-531a8180-49f5-464e-99fa-e290bd620106 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:34:10.126979 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-531a8180-49f5-464e-99fa-e290bd620106 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] 10.222.0.20 "GET /compute/v2.1/servers/10ed043d-729c-4fe5-aff6-e98d73b8c31f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046050 Oct 27 04:34:10.127546 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4037/7779] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 27 04:34:10 2022] GET /compute/v2.1/servers/10ed043d-729c-4fe5-aff6-e98d73b8c31f/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 04:34:10.138694 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9fd033fa-982e-4fb3-9b41-6a7d66b35d01 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:34:10.139227 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9fd033fa-982e-4fb3-9b41-6a7d66b35d01 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] [instance: 10ed043d-729c-4fe5-aff6-e98d73b8c31f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:34:10.145867 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9fd033fa-982e-4fb3-9b41-6a7d66b35d01 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:34:10.146392 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9fd033fa-982e-4fb3-9b41-6a7d66b35d01 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:34:10.146835 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9fd033fa-982e-4fb3-9b41-6a7d66b35d01 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:34:10.147536 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9fd033fa-982e-4fb3-9b41-6a7d66b35d01 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:34:10.147992 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9fd033fa-982e-4fb3-9b41-6a7d66b35d01 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:34:10.148424 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9fd033fa-982e-4fb3-9b41-6a7d66b35d01 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:34:10.223255 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-9fd033fa-982e-4fb3-9b41-6a7d66b35d01 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] HTTP exception thrown: Instance 10ed043d-729c-4fe5-aff6-e98d73b8c31f is not attached to volume 62a8fffc-f12d-4f7a-9462-341bb29f1d9f Oct 27 04:34:10.224868 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9fd033fa-982e-4fb3-9b41-6a7d66b35d01 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Request method failure captured: Oct 27 04:34:10.224868 n-d-862769-1 devstack@n-api.service[121000]: request: DELETE /compute/v2.1/servers/10ed043d-729c-4fe5-aff6-e98d73b8c31f/os-volume_attachments/62a8fffc-f12d-4f7a-9462-341bb29f1d9f HTTP/1.1 Oct 27 04:34:10.224868 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 04:34:10.224868 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 04:34:10.224868 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 04:34:10.224868 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 04:34:10.224868 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 04:34:10.224868 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 04:34:10.224868 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 04:34:10.224868 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 04:34:10.224868 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWgntydcp5ucyHhbhzCFUw5z1Qa5I4ESWqPpfdPgOqm66QNd0jyTjtGd6eTxa7eImf2v1ba9CEyum0GiPKZG2hDfZxnvQtUQUD9-2xS88KBIMOAkwT-bueemeWQr6Ipcz8LM0YNs7A3Wbr85EKibgX9GYFE5tcNTEuszQ_S9andFdlBQ Oct 27 04:34:10.224868 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 04:34:10.224868 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 04:34:10.224868 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 04:34:10.224868 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 04:34:10.224868 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 04:34:10.224868 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 04:34:10.224868 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: c4a8b90797b04f59bb513f5b6f4f6ba0 Oct 27 04:34:10.224868 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-TestEncryptedCinderVolumes-186849876 Oct 27 04:34:10.224868 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 04:34:10.224868 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 04:34:10.224868 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c4a8b90797b04f59bb513f5b6f4f6ba0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c4a8b90797b04f59bb513f5b6f4f6ba0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c4a8b90797b04f59bb513f5b6f4f6ba0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c4a8b90797b04f59bb513f5b6f4f6ba0"}]}] Oct 27 04:34:10.224868 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-TestEncryptedCinderVolumes-186849876 Oct 27 04:34:10.224868 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: c4a8b90797b04f59bb513f5b6f4f6ba0 Oct 27 04:34:10.224868 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-186849876 Oct 27 04:34:10.224868 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-TestEncryptedCinderVolumes-186849876-project Oct 27 04:34:10.224868 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 04:34:10.224868 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 04:34:10.224868 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: aec3aa7aba49468e86caef89e306d01d Oct 27 04:34:10.224868 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-TestEncryptedCinderVolumes-186849876-project Oct 27 04:34:10.224868 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 04:34:10.224868 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 10ed043d-729c-4fe5-aff6-e98d73b8c31f is not attached to volume 62a8fffc-f12d-4f7a-9462-341bb29f1d9f Oct 27 04:34:10.224868 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'server_id': '10ed043d-729c-4fe5-aff6-e98d73b8c31f', 'id': '62a8fffc-f12d-4f7a-9462-341bb29f1d9f'} Oct 27 04:34:10.224868 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 04:34:10.224868 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:34:10.224868 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 27 04:34:10.224868 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 27 04:34:10.224868 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 04:34:10.224868 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 04:34:10.224868 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 27 04:34:10.224868 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 27 04:34:10.224868 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 62a8fffc-f12d-4f7a-9462-341bb29f1d9f. Oct 27 04:34:10.224868 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:34:10.224868 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:34:10.224868 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:34:10.224868 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:34:10.224868 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:34:10.224868 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:34:10.224868 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 04:34:10.224868 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 04:34:10.224868 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 04:34:10.224868 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 04:34:10.224868 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 27 04:34:10.224868 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 27 04:34:10.224868 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10ed043d-729c-4fe5-aff6-e98d73b8c31f is not attached to volume 62a8fffc-f12d-4f7a-9462-341bb29f1d9f Oct 27 04:34:10.224868 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:34:10.224868 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:34:10.224868 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:34:10.224868 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:34:10.224868 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:34:10.224868 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:34:10.229550 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 04:34:10.229550 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 04:34:10.229550 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10ed043d-729c-4fe5-aff6-e98d73b8c31f is not attached to volume 62a8fffc-f12d-4f7a-9462-341bb29f1d9f Oct 27 04:34:10.229550 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:34:10.229550 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9fd033fa-982e-4fb3-9b41-6a7d66b35d01 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Returning 404 to user: Instance 10ed043d-729c-4fe5-aff6-e98d73b8c31f is not attached to volume 62a8fffc-f12d-4f7a-9462-341bb29f1d9f {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 04:34:10.229550 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9fd033fa-982e-4fb3-9b41-6a7d66b35d01 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] 10.222.0.20 "DELETE /compute/v2.1/servers/10ed043d-729c-4fe5-aff6-e98d73b8c31f/os-volume_attachments/62a8fffc-f12d-4f7a-9462-341bb29f1d9f" status: 404 len: 154 microversion: 2.1 time: 0.092036 Oct 27 04:34:10.229550 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3743/7780] 10.222.0.20 () {58 vars in 1416 bytes} [Thu Oct 27 04:34:10 2022] DELETE /compute/v2.1/servers/10ed043d-729c-4fe5-aff6-e98d73b8c31f/os-volume_attachments/62a8fffc-f12d-4f7a-9462-341bb29f1d9f => generated 154 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 04:34:13.772394 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5e9c231b-f6cb-45d6-938a-2789311df3e3 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:34:13.775100 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5e9c231b-f6cb-45d6-938a-2789311df3e3 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] [instance: 10ed043d-729c-4fe5-aff6-e98d73b8c31f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:34:13.780130 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5e9c231b-f6cb-45d6-938a-2789311df3e3 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:34:13.780649 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5e9c231b-f6cb-45d6-938a-2789311df3e3 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:34:13.781109 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5e9c231b-f6cb-45d6-938a-2789311df3e3 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:34:13.781833 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5e9c231b-f6cb-45d6-938a-2789311df3e3 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:34:13.782341 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5e9c231b-f6cb-45d6-938a-2789311df3e3 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:34:13.782829 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5e9c231b-f6cb-45d6-938a-2789311df3e3 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:34:13.808301 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5e9c231b-f6cb-45d6-938a-2789311df3e3 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] [instance: 10ed043d-729c-4fe5-aff6-e98d73b8c31f] Going to try to terminate instance {{(pid=121001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 04:34:14.071380 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5e9c231b-f6cb-45d6-938a-2789311df3e3 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] 10.222.0.20 "DELETE /compute/v2.1/servers/10ed043d-729c-4fe5-aff6-e98d73b8c31f" status: 204 len: 0 microversion: 2.1 time: 0.302542 Oct 27 04:34:14.072180 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4038/7781] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 04:34:13 2022] DELETE /compute/v2.1/servers/10ed043d-729c-4fe5-aff6-e98d73b8c31f => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 04:34:14.081072 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a82378fd-8721-4dc9-8aff-9a8227a6f0c8 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:34:14.081699 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a82378fd-8721-4dc9-8aff-9a8227a6f0c8 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] [instance: 10ed043d-729c-4fe5-aff6-e98d73b8c31f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:34:14.089294 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a82378fd-8721-4dc9-8aff-9a8227a6f0c8 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:34:14.089792 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a82378fd-8721-4dc9-8aff-9a8227a6f0c8 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:34:14.090278 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a82378fd-8721-4dc9-8aff-9a8227a6f0c8 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:34:14.091007 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a82378fd-8721-4dc9-8aff-9a8227a6f0c8 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:34:14.091471 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a82378fd-8721-4dc9-8aff-9a8227a6f0c8 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:34:14.091907 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a82378fd-8721-4dc9-8aff-9a8227a6f0c8 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:34:14.225463 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a82378fd-8721-4dc9-8aff-9a8227a6f0c8 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec3aa7aba49468e86caef89e306d01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8b90797b04f59bb513f5b6f4f6ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:34:14.234078 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a82378fd-8721-4dc9-8aff-9a8227a6f0c8 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] 10.222.0.20 "GET /compute/v2.1/servers/10ed043d-729c-4fe5-aff6-e98d73b8c31f" status: 200 len: 1560 microversion: 2.1 time: 0.156895 Oct 27 04:34:14.234728 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3744/7782] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:34:14 2022] GET /compute/v2.1/servers/10ed043d-729c-4fe5-aff6-e98d73b8c31f => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:34:15.258632 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b7eed0f5-7d63-46ba-9b49-d0a2efa40ae7 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:34:15.259362 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b7eed0f5-7d63-46ba-9b49-d0a2efa40ae7 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] [instance: 10ed043d-729c-4fe5-aff6-e98d73b8c31f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:34:15.267046 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b7eed0f5-7d63-46ba-9b49-d0a2efa40ae7 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:34:15.267557 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b7eed0f5-7d63-46ba-9b49-d0a2efa40ae7 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:34:15.268010 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b7eed0f5-7d63-46ba-9b49-d0a2efa40ae7 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:34:15.268735 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b7eed0f5-7d63-46ba-9b49-d0a2efa40ae7 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:34:15.269206 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b7eed0f5-7d63-46ba-9b49-d0a2efa40ae7 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:34:15.269650 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b7eed0f5-7d63-46ba-9b49-d0a2efa40ae7 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:34:15.410701 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b7eed0f5-7d63-46ba-9b49-d0a2efa40ae7 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec3aa7aba49468e86caef89e306d01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8b90797b04f59bb513f5b6f4f6ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:34:15.419076 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b7eed0f5-7d63-46ba-9b49-d0a2efa40ae7 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] 10.222.0.20 "GET /compute/v2.1/servers/10ed043d-729c-4fe5-aff6-e98d73b8c31f" status: 200 len: 1560 microversion: 2.1 time: 0.164731 Oct 27 04:34:15.419539 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4039/7783] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:34:15 2022] GET /compute/v2.1/servers/10ed043d-729c-4fe5-aff6-e98d73b8c31f => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:34:16.260948 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-97ccf39b-c77c-4ba3-ac04-4641f1753437 req-50ff2d25-7ad1-4520-a7a0-a14cc41c95ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10ed043d-729c-4fe5-aff6-e98d73b8c31f", "name": "network-vif-deleted", "tag": "08721117-58f6-40fc-b201-61219486a43b"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:34:16.271275 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-97ccf39b-c77c-4ba3-ac04-4641f1753437 req-50ff2d25-7ad1-4520-a7a0-a14cc41c95ba service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:34:16.272053 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-97ccf39b-c77c-4ba3-ac04-4641f1753437 req-50ff2d25-7ad1-4520-a7a0-a14cc41c95ba service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:34:16.272176 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-97ccf39b-c77c-4ba3-ac04-4641f1753437 req-50ff2d25-7ad1-4520-a7a0-a14cc41c95ba service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:34:16.286236 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-97ccf39b-c77c-4ba3-ac04-4641f1753437 req-50ff2d25-7ad1-4520-a7a0-a14cc41c95ba service nova] Creating event network-vif-deleted:08721117-58f6-40fc-b201-61219486a43b for instance 10ed043d-729c-4fe5-aff6-e98d73b8c31f on n-h1-862769-1 Oct 27 04:34:16.291220 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-97ccf39b-c77c-4ba3-ac04-4641f1753437 req-50ff2d25-7ad1-4520-a7a0-a14cc41c95ba service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033994 Oct 27 04:34:16.291830 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3745/7784] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:34:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:34:16.443211 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8392a93a-7be5-4751-983d-76edc9553199 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:34:16.443757 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8392a93a-7be5-4751-983d-76edc9553199 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] [instance: 10ed043d-729c-4fe5-aff6-e98d73b8c31f] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:34:16.451182 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8392a93a-7be5-4751-983d-76edc9553199 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:34:16.455522 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8392a93a-7be5-4751-983d-76edc9553199 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:34:16.455522 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8392a93a-7be5-4751-983d-76edc9553199 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:34:16.455522 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8392a93a-7be5-4751-983d-76edc9553199 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:34:16.455522 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8392a93a-7be5-4751-983d-76edc9553199 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:34:16.455522 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8392a93a-7be5-4751-983d-76edc9553199 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:34:16.520442 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8392a93a-7be5-4751-983d-76edc9553199 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec3aa7aba49468e86caef89e306d01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8b90797b04f59bb513f5b6f4f6ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:34:16.530467 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8392a93a-7be5-4751-983d-76edc9553199 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] 10.222.0.20 "GET /compute/v2.1/servers/10ed043d-729c-4fe5-aff6-e98d73b8c31f" status: 200 len: 1348 microversion: 2.1 time: 0.091350 Oct 27 04:34:16.531410 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4040/7785] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:34:16 2022] GET /compute/v2.1/servers/10ed043d-729c-4fe5-aff6-e98d73b8c31f => generated 1348 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:34:17.554110 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-24321f2c-cb62-4d74-bc66-2faa46928276 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:34:17.554847 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-24321f2c-cb62-4d74-bc66-2faa46928276 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] [instance: 10ed043d-729c-4fe5-aff6-e98d73b8c31f] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:34:17.561009 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-24321f2c-cb62-4d74-bc66-2faa46928276 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:34:17.561499 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-24321f2c-cb62-4d74-bc66-2faa46928276 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:34:17.561937 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-24321f2c-cb62-4d74-bc66-2faa46928276 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:34:17.562659 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-24321f2c-cb62-4d74-bc66-2faa46928276 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:34:17.563118 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-24321f2c-cb62-4d74-bc66-2faa46928276 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:34:17.563552 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-24321f2c-cb62-4d74-bc66-2faa46928276 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:34:17.576732 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-24321f2c-cb62-4d74-bc66-2faa46928276 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] HTTP exception thrown: Instance 10ed043d-729c-4fe5-aff6-e98d73b8c31f could not be found. Oct 27 04:34:17.578403 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-24321f2c-cb62-4d74-bc66-2faa46928276 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Request method failure captured: Oct 27 04:34:17.578403 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/10ed043d-729c-4fe5-aff6-e98d73b8c31f HTTP/1.1 Oct 27 04:34:17.578403 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 04:34:17.578403 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 04:34:17.578403 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 04:34:17.578403 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 04:34:17.578403 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 04:34:17.578403 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 04:34:17.578403 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 04:34:17.578403 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 04:34:17.578403 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWgntydcp5ucyHhbhzCFUw5z1Qa5I4ESWqPpfdPgOqm66QNd0jyTjtGd6eTxa7eImf2v1ba9CEyum0GiPKZG2hDfZxnvQtUQUD9-2xS88KBIMOAkwT-bueemeWQr6Ipcz8LM0YNs7A3Wbr85EKibgX9GYFE5tcNTEuszQ_S9andFdlBQ Oct 27 04:34:17.578403 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 04:34:17.578403 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 04:34:17.578403 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 04:34:17.578403 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 04:34:17.578403 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 04:34:17.578403 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 04:34:17.578403 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: c4a8b90797b04f59bb513f5b6f4f6ba0 Oct 27 04:34:17.578403 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-TestEncryptedCinderVolumes-186849876 Oct 27 04:34:17.578403 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 04:34:17.578403 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 04:34:17.578403 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c4a8b90797b04f59bb513f5b6f4f6ba0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c4a8b90797b04f59bb513f5b6f4f6ba0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c4a8b90797b04f59bb513f5b6f4f6ba0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c4a8b90797b04f59bb513f5b6f4f6ba0"}]}] Oct 27 04:34:17.578403 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-TestEncryptedCinderVolumes-186849876 Oct 27 04:34:17.578403 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: c4a8b90797b04f59bb513f5b6f4f6ba0 Oct 27 04:34:17.578403 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-186849876 Oct 27 04:34:17.578403 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-TestEncryptedCinderVolumes-186849876-project Oct 27 04:34:17.578403 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 04:34:17.578403 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 04:34:17.578403 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: aec3aa7aba49468e86caef89e306d01d Oct 27 04:34:17.578403 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-TestEncryptedCinderVolumes-186849876-project Oct 27 04:34:17.578403 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 04:34:17.578403 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 10ed043d-729c-4fe5-aff6-e98d73b8c31f could not be found. Oct 27 04:34:17.578403 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '10ed043d-729c-4fe5-aff6-e98d73b8c31f'} Oct 27 04:34:17.578403 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 04:34:17.578403 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:34:17.578403 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 04:34:17.578403 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 04:34:17.578403 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 04:34:17.578403 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 04:34:17.578403 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 04:34:17.578403 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 04:34:17.578403 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 04:34:17.578403 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 04:34:17.578403 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10ed043d-729c-4fe5-aff6-e98d73b8c31f could not be found. Oct 27 04:34:17.578403 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:34:17.578403 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:34:17.578403 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:34:17.578403 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:34:17.578403 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:34:17.578403 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:34:17.578403 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 04:34:17.578403 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 04:34:17.578403 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 04:34:17.578403 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 04:34:17.578403 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 04:34:17.578403 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 04:34:17.578403 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 04:34:17.578403 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 04:34:17.578403 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 04:34:17.578403 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 04:34:17.578403 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10ed043d-729c-4fe5-aff6-e98d73b8c31f could not be found. Oct 27 04:34:17.578403 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:34:17.578403 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:34:17.578403 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:34:17.583551 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:34:17.583551 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:34:17.583551 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:34:17.583551 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 04:34:17.583551 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 04:34:17.583551 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10ed043d-729c-4fe5-aff6-e98d73b8c31f could not be found. Oct 27 04:34:17.583551 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:34:17.583551 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-24321f2c-cb62-4d74-bc66-2faa46928276 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Returning 404 to user: Instance 10ed043d-729c-4fe5-aff6-e98d73b8c31f could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 04:34:17.583551 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-24321f2c-cb62-4d74-bc66-2faa46928276 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] 10.222.0.20 "GET /compute/v2.1/servers/10ed043d-729c-4fe5-aff6-e98d73b8c31f" status: 404 len: 111 microversion: 2.1 time: 0.030803 Oct 27 04:34:17.583551 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3746/7786] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:34:17 2022] GET /compute/v2.1/servers/10ed043d-729c-4fe5-aff6-e98d73b8c31f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 04:34:17.588638 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ee0247ca-8868-4850-9f47-37e1c02c1e45 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Calling method '.version_select at 0x7f7dd9d76a60>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:34:17.667963 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ee0247ca-8868-4850-9f47-37e1c02c1e45 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1502071940" status: 202 len: 0 microversion: 2.1 time: 0.083142 Oct 27 04:34:17.668477 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4041/7787] 10.222.0.20 () {58 vars in 1278 bytes} [Thu Oct 27 04:34:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1502071940 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 04:34:17.687064 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7fa5005e-35c7-4be4-a932-bb6001e3d53e tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Action: 'create', calling method: .version_select at 0x7f7ddaa91ee0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-671003906", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPbHOrPY+Q6onHVQadKWrjiHTwPOCjtb0pZPY8/S6BUrzSwJN56Z/Hfd1O0yukC7yUirSQ3ys8C4b1DtvhnawgSddMqDktW9BdCa7icOfQeHch+Fh3vVXpmQzRkwPELk9w=="}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:34:17.702327 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-7fa5005e-35c7-4be4-a932-bb6001e3d53e tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Getting quotas for project c4a8b90797b04f59bb513f5b6f4f6ba0. Resources: {'key_pairs'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 04:34:17.707333 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-7fa5005e-35c7-4be4-a932-bb6001e3d53e tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Getting quotas for user aec3aa7aba49468e86caef89e306d01d and project c4a8b90797b04f59bb513f5b6f4f6ba0. Resources: {'key_pairs'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 04:34:17.788139 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7fa5005e-35c7-4be4-a932-bb6001e3d53e tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.105026 Oct 27 04:34:17.788774 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3747/7788] 10.222.0.20 () {60 vars in 1159 bytes} [Thu Oct 27 04:34:17 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:34:17.838063 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3fe5594b-6a46-46f0-90f2-9e2af608986e tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1188959604", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-671003906", "networks": [{"uuid": "06806bc8-a4e7-445b-ac18-67263dd5b30c"}]}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:34:17.892695 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.network.neutron [None req-3fe5594b-6a46-46f0-90f2-9e2af608986e tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] validate_networks() for [('06806bc8-a4e7-445b-ac18-67263dd5b30c', None, None, None, None, None)] {{(pid=121001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 04:34:18.259995 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-3fe5594b-6a46-46f0-90f2-9e2af608986e tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Flavor limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 04:34:18.260491 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-3fe5594b-6a46-46f0-90f2-9e2af608986e tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Image limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 04:34:18.260992 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-3fe5594b-6a46-46f0-90f2-9e2af608986e tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Flavor pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 04:34:18.261424 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-3fe5594b-6a46-46f0-90f2-9e2af608986e tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Image pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 04:34:18.261860 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-3fe5594b-6a46-46f0-90f2-9e2af608986e tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 04:34:18.271473 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3fe5594b-6a46-46f0-90f2-9e2af608986e tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:34:18.271974 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3fe5594b-6a46-46f0-90f2-9e2af608986e tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:34:18.272433 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3fe5594b-6a46-46f0-90f2-9e2af608986e tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:34:18.273189 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3fe5594b-6a46-46f0-90f2-9e2af608986e tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:34:18.273663 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3fe5594b-6a46-46f0-90f2-9e2af608986e tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:34:18.274153 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3fe5594b-6a46-46f0-90f2-9e2af608986e tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:34:18.290720 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-3fe5594b-6a46-46f0-90f2-9e2af608986e tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Getting quotas for project c4a8b90797b04f59bb513f5b6f4f6ba0. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 04:34:18.295936 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-3fe5594b-6a46-46f0-90f2-9e2af608986e tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Getting quotas for user aec3aa7aba49468e86caef89e306d01d and project c4a8b90797b04f59bb513f5b6f4f6ba0. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 04:34:18.308132 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3fe5594b-6a46-46f0-90f2-9e2af608986e tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Going to run 1 instances... {{(pid=121001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 04:34:18.310976 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3fe5594b-6a46-46f0-90f2-9e2af608986e tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] [instance: 2debbfcf-ca46-4698-aa7f-6e143c2a28a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 04:34:18.423356 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3fe5594b-6a46-46f0-90f2-9e2af608986e tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.589187 Oct 27 04:34:18.424124 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4042/7789] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 04:34:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 591 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 04:34:18.435752 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c046198b-4afa-476f-bed8-9d4e2df0b6f2 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:34:18.436381 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c046198b-4afa-476f-bed8-9d4e2df0b6f2 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] [instance: 2debbfcf-ca46-4698-aa7f-6e143c2a28a3] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:34:18.493807 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c046198b-4afa-476f-bed8-9d4e2df0b6f2 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec3aa7aba49468e86caef89e306d01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8b90797b04f59bb513f5b6f4f6ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:34:18.502523 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c046198b-4afa-476f-bed8-9d4e2df0b6f2 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] 10.222.0.20 "GET /compute/v2.1/servers/2debbfcf-ca46-4698-aa7f-6e143c2a28a3" status: 200 len: 1262 microversion: 2.1 time: 0.071105 Oct 27 04:34:18.503164 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3748/7790] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:34:18 2022] GET /compute/v2.1/servers/2debbfcf-ca46-4698-aa7f-6e143c2a28a3 => generated 1262 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:34:19.526866 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1a4233b0-02cc-439c-a480-7f35e3c924f7 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:34:19.527616 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1a4233b0-02cc-439c-a480-7f35e3c924f7 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] [instance: 2debbfcf-ca46-4698-aa7f-6e143c2a28a3] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:34:19.534290 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1a4233b0-02cc-439c-a480-7f35e3c924f7 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:34:19.534790 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1a4233b0-02cc-439c-a480-7f35e3c924f7 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:34:19.535254 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1a4233b0-02cc-439c-a480-7f35e3c924f7 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:34:19.535967 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1a4233b0-02cc-439c-a480-7f35e3c924f7 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:34:19.536433 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1a4233b0-02cc-439c-a480-7f35e3c924f7 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:34:19.536875 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1a4233b0-02cc-439c-a480-7f35e3c924f7 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:34:19.598930 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1a4233b0-02cc-439c-a480-7f35e3c924f7 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec3aa7aba49468e86caef89e306d01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8b90797b04f59bb513f5b6f4f6ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:34:19.606829 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1a4233b0-02cc-439c-a480-7f35e3c924f7 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] 10.222.0.20 "GET /compute/v2.1/servers/2debbfcf-ca46-4698-aa7f-6e143c2a28a3" status: 200 len: 1266 microversion: 2.1 time: 0.085295 Oct 27 04:34:19.607461 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4043/7791] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:34:19 2022] GET /compute/v2.1/servers/2debbfcf-ca46-4698-aa7f-6e143c2a28a3 => generated 1266 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:34:20.628928 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-457eaea2-cac8-470b-9441-e01f1a5aed84 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:34:20.629611 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-457eaea2-cac8-470b-9441-e01f1a5aed84 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] [instance: 2debbfcf-ca46-4698-aa7f-6e143c2a28a3] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:34:20.636433 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-457eaea2-cac8-470b-9441-e01f1a5aed84 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:34:20.636927 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-457eaea2-cac8-470b-9441-e01f1a5aed84 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:34:20.638644 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-457eaea2-cac8-470b-9441-e01f1a5aed84 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:34:20.638903 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-457eaea2-cac8-470b-9441-e01f1a5aed84 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:34:20.639378 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-457eaea2-cac8-470b-9441-e01f1a5aed84 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:34:20.639811 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-457eaea2-cac8-470b-9441-e01f1a5aed84 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:34:21.055896 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-457eaea2-cac8-470b-9441-e01f1a5aed84 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec3aa7aba49468e86caef89e306d01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8b90797b04f59bb513f5b6f4f6ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:34:21.064411 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-457eaea2-cac8-470b-9441-e01f1a5aed84 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] 10.222.0.20 "GET /compute/v2.1/servers/2debbfcf-ca46-4698-aa7f-6e143c2a28a3" status: 200 len: 1320 microversion: 2.1 time: 0.439301 Oct 27 04:34:21.064990 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3749/7792] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:34:20 2022] GET /compute/v2.1/servers/2debbfcf-ca46-4698-aa7f-6e143c2a28a3 => generated 1320 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:34:22.087824 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a3f79547-f5da-4bf1-b9d1-db618cab5cdc tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:34:22.088419 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a3f79547-f5da-4bf1-b9d1-db618cab5cdc tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] [instance: 2debbfcf-ca46-4698-aa7f-6e143c2a28a3] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:34:22.095273 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a3f79547-f5da-4bf1-b9d1-db618cab5cdc tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:34:22.095779 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a3f79547-f5da-4bf1-b9d1-db618cab5cdc tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:34:22.096230 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a3f79547-f5da-4bf1-b9d1-db618cab5cdc tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:34:22.096951 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a3f79547-f5da-4bf1-b9d1-db618cab5cdc tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:34:22.097420 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a3f79547-f5da-4bf1-b9d1-db618cab5cdc tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:34:22.098225 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a3f79547-f5da-4bf1-b9d1-db618cab5cdc tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:34:22.227521 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a3f79547-f5da-4bf1-b9d1-db618cab5cdc tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec3aa7aba49468e86caef89e306d01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8b90797b04f59bb513f5b6f4f6ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:34:22.235524 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a3f79547-f5da-4bf1-b9d1-db618cab5cdc tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] 10.222.0.20 "GET /compute/v2.1/servers/2debbfcf-ca46-4698-aa7f-6e143c2a28a3" status: 200 len: 1362 microversion: 2.1 time: 0.151731 Oct 27 04:34:22.236083 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4044/7793] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:34:22 2022] GET /compute/v2.1/servers/2debbfcf-ca46-4698-aa7f-6e143c2a28a3 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:34:22.284799 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-33ad2368-9456-4284-9313-cc06438d5f00 req-add8f9ee-8324-4241-8ce2-674c0ee77c30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2debbfcf-ca46-4698-aa7f-6e143c2a28a3", "tag": "05d52e02-fa06-443c-a6df-58a5e06e597c"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:34:22.295665 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-33ad2368-9456-4284-9313-cc06438d5f00 req-add8f9ee-8324-4241-8ce2-674c0ee77c30 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:34:22.296146 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-33ad2368-9456-4284-9313-cc06438d5f00 req-add8f9ee-8324-4241-8ce2-674c0ee77c30 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:34:22.296593 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-33ad2368-9456-4284-9313-cc06438d5f00 req-add8f9ee-8324-4241-8ce2-674c0ee77c30 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:34:22.307554 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-33ad2368-9456-4284-9313-cc06438d5f00 req-add8f9ee-8324-4241-8ce2-674c0ee77c30 service nova] Creating event network-changed:05d52e02-fa06-443c-a6df-58a5e06e597c for instance 2debbfcf-ca46-4698-aa7f-6e143c2a28a3 on n-h2-862769-1 Oct 27 04:34:22.313602 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-33ad2368-9456-4284-9313-cc06438d5f00 req-add8f9ee-8324-4241-8ce2-674c0ee77c30 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033273 Oct 27 04:34:22.314243 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3750/7794] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:34:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:34:23.258954 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-bb0b86b9-c9c3-4c73-a7eb-0a995e32f4d0 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:34:23.259596 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-bb0b86b9-c9c3-4c73-a7eb-0a995e32f4d0 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] [instance: 2debbfcf-ca46-4698-aa7f-6e143c2a28a3] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:34:23.267013 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bb0b86b9-c9c3-4c73-a7eb-0a995e32f4d0 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:34:23.267518 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bb0b86b9-c9c3-4c73-a7eb-0a995e32f4d0 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:34:23.267976 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bb0b86b9-c9c3-4c73-a7eb-0a995e32f4d0 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:34:23.268695 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bb0b86b9-c9c3-4c73-a7eb-0a995e32f4d0 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:34:23.269170 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bb0b86b9-c9c3-4c73-a7eb-0a995e32f4d0 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:34:23.269620 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bb0b86b9-c9c3-4c73-a7eb-0a995e32f4d0 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:34:23.400451 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-bb0b86b9-c9c3-4c73-a7eb-0a995e32f4d0 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec3aa7aba49468e86caef89e306d01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8b90797b04f59bb513f5b6f4f6ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:34:23.408871 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-bb0b86b9-c9c3-4c73-a7eb-0a995e32f4d0 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] 10.222.0.20 "GET /compute/v2.1/servers/2debbfcf-ca46-4698-aa7f-6e143c2a28a3" status: 200 len: 1362 microversion: 2.1 time: 0.153962 Oct 27 04:34:23.409453 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4045/7795] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:34:23 2022] GET /compute/v2.1/servers/2debbfcf-ca46-4698-aa7f-6e143c2a28a3 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:34:24.433783 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-51a0c453-3140-4ea2-81c5-d249954d02e5 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:34:24.434801 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-51a0c453-3140-4ea2-81c5-d249954d02e5 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] [instance: 2debbfcf-ca46-4698-aa7f-6e143c2a28a3] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:34:24.442492 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-51a0c453-3140-4ea2-81c5-d249954d02e5 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:34:24.442951 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-51a0c453-3140-4ea2-81c5-d249954d02e5 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:34:24.443392 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-51a0c453-3140-4ea2-81c5-d249954d02e5 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:34:24.444088 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-51a0c453-3140-4ea2-81c5-d249954d02e5 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:34:24.444542 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-51a0c453-3140-4ea2-81c5-d249954d02e5 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:34:24.444970 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-51a0c453-3140-4ea2-81c5-d249954d02e5 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:34:24.573572 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-51a0c453-3140-4ea2-81c5-d249954d02e5 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec3aa7aba49468e86caef89e306d01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8b90797b04f59bb513f5b6f4f6ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:34:24.581167 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-51a0c453-3140-4ea2-81c5-d249954d02e5 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] 10.222.0.20 "GET /compute/v2.1/servers/2debbfcf-ca46-4698-aa7f-6e143c2a28a3" status: 200 len: 1362 microversion: 2.1 time: 0.152455 Oct 27 04:34:24.581737 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3751/7796] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:34:24 2022] GET /compute/v2.1/servers/2debbfcf-ca46-4698-aa7f-6e143c2a28a3 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:34:25.604099 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0618c96e-d099-4069-99fe-2e2957786238 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:34:25.604740 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0618c96e-d099-4069-99fe-2e2957786238 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] [instance: 2debbfcf-ca46-4698-aa7f-6e143c2a28a3] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:34:25.612130 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0618c96e-d099-4069-99fe-2e2957786238 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:34:25.612630 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0618c96e-d099-4069-99fe-2e2957786238 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:34:25.613089 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0618c96e-d099-4069-99fe-2e2957786238 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:34:25.613795 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0618c96e-d099-4069-99fe-2e2957786238 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:34:25.614289 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0618c96e-d099-4069-99fe-2e2957786238 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:34:25.614736 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0618c96e-d099-4069-99fe-2e2957786238 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:34:25.745829 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0618c96e-d099-4069-99fe-2e2957786238 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec3aa7aba49468e86caef89e306d01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8b90797b04f59bb513f5b6f4f6ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:34:25.753534 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0618c96e-d099-4069-99fe-2e2957786238 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] 10.222.0.20 "GET /compute/v2.1/servers/2debbfcf-ca46-4698-aa7f-6e143c2a28a3" status: 200 len: 1362 microversion: 2.1 time: 0.153358 Oct 27 04:34:25.754141 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4046/7797] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:34:25 2022] GET /compute/v2.1/servers/2debbfcf-ca46-4698-aa7f-6e143c2a28a3 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:34:26.776640 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1ce79ce7-96f0-4430-9162-00e49bd214cf tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:34:26.777274 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1ce79ce7-96f0-4430-9162-00e49bd214cf tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] [instance: 2debbfcf-ca46-4698-aa7f-6e143c2a28a3] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:34:26.784711 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1ce79ce7-96f0-4430-9162-00e49bd214cf tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:34:26.785212 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1ce79ce7-96f0-4430-9162-00e49bd214cf tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:34:26.785661 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1ce79ce7-96f0-4430-9162-00e49bd214cf tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:34:26.786412 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1ce79ce7-96f0-4430-9162-00e49bd214cf tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:34:26.786875 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1ce79ce7-96f0-4430-9162-00e49bd214cf tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:34:26.787308 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1ce79ce7-96f0-4430-9162-00e49bd214cf tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:34:26.918238 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1ce79ce7-96f0-4430-9162-00e49bd214cf tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec3aa7aba49468e86caef89e306d01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8b90797b04f59bb513f5b6f4f6ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:34:26.926406 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1ce79ce7-96f0-4430-9162-00e49bd214cf tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] 10.222.0.20 "GET /compute/v2.1/servers/2debbfcf-ca46-4698-aa7f-6e143c2a28a3" status: 200 len: 1362 microversion: 2.1 time: 0.153776 Oct 27 04:34:26.926925 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3752/7798] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:34:26 2022] GET /compute/v2.1/servers/2debbfcf-ca46-4698-aa7f-6e143c2a28a3 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:34:27.950169 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a6cb651f-8335-4fa8-9828-7361cc2fa95f tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:34:27.950827 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a6cb651f-8335-4fa8-9828-7361cc2fa95f tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] [instance: 2debbfcf-ca46-4698-aa7f-6e143c2a28a3] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:34:27.958287 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a6cb651f-8335-4fa8-9828-7361cc2fa95f tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:34:27.958785 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a6cb651f-8335-4fa8-9828-7361cc2fa95f tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:34:27.959238 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a6cb651f-8335-4fa8-9828-7361cc2fa95f tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:34:27.959944 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a6cb651f-8335-4fa8-9828-7361cc2fa95f tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:34:27.960412 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a6cb651f-8335-4fa8-9828-7361cc2fa95f tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:34:27.960855 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a6cb651f-8335-4fa8-9828-7361cc2fa95f tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:34:28.093956 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a6cb651f-8335-4fa8-9828-7361cc2fa95f tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec3aa7aba49468e86caef89e306d01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8b90797b04f59bb513f5b6f4f6ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:34:28.102112 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a6cb651f-8335-4fa8-9828-7361cc2fa95f tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] 10.222.0.20 "GET /compute/v2.1/servers/2debbfcf-ca46-4698-aa7f-6e143c2a28a3" status: 200 len: 1362 microversion: 2.1 time: 0.156054 Oct 27 04:34:28.102707 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4047/7799] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:34:27 2022] GET /compute/v2.1/servers/2debbfcf-ca46-4698-aa7f-6e143c2a28a3 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:34:28.260461 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-52746739-5dd4-4393-b077-12fdeb14a679 req-7c8a8cab-65c4-4c51-8ab2-d14fe6bc6bed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2debbfcf-ca46-4698-aa7f-6e143c2a28a3", "name": "network-vif-plugged", "status": "completed", "tag": "05d52e02-fa06-443c-a6df-58a5e06e597c"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:34:28.270813 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-52746739-5dd4-4393-b077-12fdeb14a679 req-7c8a8cab-65c4-4c51-8ab2-d14fe6bc6bed service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:34:28.271367 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-52746739-5dd4-4393-b077-12fdeb14a679 req-7c8a8cab-65c4-4c51-8ab2-d14fe6bc6bed service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:34:28.271872 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-52746739-5dd4-4393-b077-12fdeb14a679 req-7c8a8cab-65c4-4c51-8ab2-d14fe6bc6bed service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:34:28.282837 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-52746739-5dd4-4393-b077-12fdeb14a679 req-7c8a8cab-65c4-4c51-8ab2-d14fe6bc6bed service nova] Creating event network-vif-plugged:05d52e02-fa06-443c-a6df-58a5e06e597c for instance 2debbfcf-ca46-4698-aa7f-6e143c2a28a3 on n-h2-862769-1 Oct 27 04:34:28.288371 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-52746739-5dd4-4393-b077-12fdeb14a679 req-7c8a8cab-65c4-4c51-8ab2-d14fe6bc6bed service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031793 Oct 27 04:34:28.288992 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3753/7800] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:34:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:34:29.126616 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6666d610-75ae-4322-a0fe-c25eb385d1b8 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:34:29.127259 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-6666d610-75ae-4322-a0fe-c25eb385d1b8 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] [instance: 2debbfcf-ca46-4698-aa7f-6e143c2a28a3] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:34:29.129390 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:34:29.130185 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=6 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:34:29.134994 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6666d610-75ae-4322-a0fe-c25eb385d1b8 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:34:29.140507 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6666d610-75ae-4322-a0fe-c25eb385d1b8 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:34:29.140507 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6666d610-75ae-4322-a0fe-c25eb385d1b8 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:34:29.140507 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6666d610-75ae-4322-a0fe-c25eb385d1b8 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:34:29.140507 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6666d610-75ae-4322-a0fe-c25eb385d1b8 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:34:29.140507 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6666d610-75ae-4322-a0fe-c25eb385d1b8 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:34:29.265791 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6666d610-75ae-4322-a0fe-c25eb385d1b8 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec3aa7aba49468e86caef89e306d01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8b90797b04f59bb513f5b6f4f6ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:34:29.273468 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6666d610-75ae-4322-a0fe-c25eb385d1b8 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] 10.222.0.20 "GET /compute/v2.1/servers/2debbfcf-ca46-4698-aa7f-6e143c2a28a3" status: 200 len: 1362 microversion: 2.1 time: 0.151093 Oct 27 04:34:29.274058 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4048/7801] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:34:29 2022] GET /compute/v2.1/servers/2debbfcf-ca46-4698-aa7f-6e143c2a28a3 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:34:30.297237 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d7e936a6-41f9-4709-9cb5-760a55b7bffc tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:34:30.297955 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d7e936a6-41f9-4709-9cb5-760a55b7bffc tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] [instance: 2debbfcf-ca46-4698-aa7f-6e143c2a28a3] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:34:30.299957 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=6 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:34:30.305707 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d7e936a6-41f9-4709-9cb5-760a55b7bffc tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:34:30.309125 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d7e936a6-41f9-4709-9cb5-760a55b7bffc tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:34:30.309125 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d7e936a6-41f9-4709-9cb5-760a55b7bffc tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:34:30.309125 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d7e936a6-41f9-4709-9cb5-760a55b7bffc tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:34:30.309125 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d7e936a6-41f9-4709-9cb5-760a55b7bffc tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:34:30.309125 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d7e936a6-41f9-4709-9cb5-760a55b7bffc tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:34:30.440515 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d7e936a6-41f9-4709-9cb5-760a55b7bffc tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec3aa7aba49468e86caef89e306d01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8b90797b04f59bb513f5b6f4f6ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:34:30.448235 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d7e936a6-41f9-4709-9cb5-760a55b7bffc tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] 10.222.0.20 "GET /compute/v2.1/servers/2debbfcf-ca46-4698-aa7f-6e143c2a28a3" status: 200 len: 1554 microversion: 2.1 time: 0.155243 Oct 27 04:34:30.448832 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3754/7802] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:34:30 2022] GET /compute/v2.1/servers/2debbfcf-ca46-4698-aa7f-6e143c2a28a3 => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:34:30.471345 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-36d5b834-c093-4848-8420-0bc7e16fa042 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:34:30.471992 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-36d5b834-c093-4848-8420-0bc7e16fa042 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] [instance: 2debbfcf-ca46-4698-aa7f-6e143c2a28a3] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:34:30.479398 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-36d5b834-c093-4848-8420-0bc7e16fa042 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:34:30.479921 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-36d5b834-c093-4848-8420-0bc7e16fa042 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:34:30.480386 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-36d5b834-c093-4848-8420-0bc7e16fa042 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:34:30.481115 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-36d5b834-c093-4848-8420-0bc7e16fa042 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:34:30.481593 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-36d5b834-c093-4848-8420-0bc7e16fa042 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:34:30.482068 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-36d5b834-c093-4848-8420-0bc7e16fa042 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:34:30.614755 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-36d5b834-c093-4848-8420-0bc7e16fa042 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec3aa7aba49468e86caef89e306d01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8b90797b04f59bb513f5b6f4f6ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:34:30.618245 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:34:30.622824 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-36d5b834-c093-4848-8420-0bc7e16fa042 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] 10.222.0.20 "GET /compute/v2.1/servers/2debbfcf-ca46-4698-aa7f-6e143c2a28a3" status: 200 len: 1554 microversion: 2.1 time: 0.155791 Oct 27 04:34:30.624072 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4049/7803] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:34:30 2022] GET /compute/v2.1/servers/2debbfcf-ca46-4698-aa7f-6e143c2a28a3 => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:34:33.604244 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f7223e42-fee0-43be-9648-5c3566c777d9 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5fd3a701-c83d-447a-af12-d94ba45d4728"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:34:33.607113 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f7223e42-fee0-43be-9648-5c3566c777d9 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] [instance: 2debbfcf-ca46-4698-aa7f-6e143c2a28a3] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:34:33.614912 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f7223e42-fee0-43be-9648-5c3566c777d9 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:34:33.615397 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f7223e42-fee0-43be-9648-5c3566c777d9 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:34:33.615833 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f7223e42-fee0-43be-9648-5c3566c777d9 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:34:33.616526 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f7223e42-fee0-43be-9648-5c3566c777d9 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:34:33.616979 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f7223e42-fee0-43be-9648-5c3566c777d9 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:34:33.617405 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f7223e42-fee0-43be-9648-5c3566c777d9 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:34:34.326609 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f7223e42-fee0-43be-9648-5c3566c777d9 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] 10.222.0.20 "POST /compute/v2.1/servers/2debbfcf-ca46-4698-aa7f-6e143c2a28a3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.726099 Oct 27 04:34:34.327235 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3755/7804] 10.222.0.20 () {60 vars in 1323 bytes} [Thu Oct 27 04:34:33 2022] POST /compute/v2.1/servers/2debbfcf-ca46-4698-aa7f-6e143c2a28a3/os-volume_attachments => generated 194 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:34:46.093703 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ac6e21c7-45f8-4725-bbb9-7a978a6815a9 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:34:46.096909 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ac6e21c7-45f8-4725-bbb9-7a978a6815a9 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] [instance: 2debbfcf-ca46-4698-aa7f-6e143c2a28a3] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:34:46.098511 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:34:46.104905 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ac6e21c7-45f8-4725-bbb9-7a978a6815a9 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:34:46.105603 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ac6e21c7-45f8-4725-bbb9-7a978a6815a9 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:34:46.106097 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ac6e21c7-45f8-4725-bbb9-7a978a6815a9 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:34:46.106937 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ac6e21c7-45f8-4725-bbb9-7a978a6815a9 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:34:46.107469 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ac6e21c7-45f8-4725-bbb9-7a978a6815a9 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:34:46.108021 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ac6e21c7-45f8-4725-bbb9-7a978a6815a9 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:34:46.189779 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-ac6e21c7-45f8-4725-bbb9-7a978a6815a9 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lazy-loading 'services' on Instance uuid 2debbfcf-ca46-4698-aa7f-6e143c2a28a3 {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 04:34:46.412714 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ac6e21c7-45f8-4725-bbb9-7a978a6815a9 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2debbfcf-ca46-4698-aa7f-6e143c2a28a3/os-volume_attachments/5fd3a701-c83d-447a-af12-d94ba45d4728" status: 202 len: 0 microversion: 2.1 time: 0.323827 Oct 27 04:34:46.413497 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4050/7805] 10.222.0.20 () {58 vars in 1416 bytes} [Thu Oct 27 04:34:46 2022] DELETE /compute/v2.1/servers/2debbfcf-ca46-4698-aa7f-6e143c2a28a3/os-volume_attachments/5fd3a701-c83d-447a-af12-d94ba45d4728 => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 04:34:46.424883 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:34:46.425674 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:34:46.429961 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1812b31d-ea9a-49b4-aef4-30ef6af50be1 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:34:46.432373 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1812b31d-ea9a-49b4-aef4-30ef6af50be1 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] [instance: 2debbfcf-ca46-4698-aa7f-6e143c2a28a3] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:34:46.438800 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1812b31d-ea9a-49b4-aef4-30ef6af50be1 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:34:46.446183 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1812b31d-ea9a-49b4-aef4-30ef6af50be1 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:34:46.446183 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1812b31d-ea9a-49b4-aef4-30ef6af50be1 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:34:46.446183 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1812b31d-ea9a-49b4-aef4-30ef6af50be1 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:34:46.446183 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1812b31d-ea9a-49b4-aef4-30ef6af50be1 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:34:46.446183 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1812b31d-ea9a-49b4-aef4-30ef6af50be1 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:34:46.472405 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1812b31d-ea9a-49b4-aef4-30ef6af50be1 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] 10.222.0.20 "GET /compute/v2.1/servers/2debbfcf-ca46-4698-aa7f-6e143c2a28a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049478 Oct 27 04:34:46.474892 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3756/7806] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 27 04:34:46 2022] GET /compute/v2.1/servers/2debbfcf-ca46-4698-aa7f-6e143c2a28a3/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 04:34:47.487995 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7e867913-aff5-44e2-ab82-009291c2b6ff tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:34:47.490459 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7e867913-aff5-44e2-ab82-009291c2b6ff tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] [instance: 2debbfcf-ca46-4698-aa7f-6e143c2a28a3] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:34:47.496995 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7e867913-aff5-44e2-ab82-009291c2b6ff tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:34:47.497510 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7e867913-aff5-44e2-ab82-009291c2b6ff tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:34:47.497965 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7e867913-aff5-44e2-ab82-009291c2b6ff tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:34:47.498706 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7e867913-aff5-44e2-ab82-009291c2b6ff tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:34:47.500080 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7e867913-aff5-44e2-ab82-009291c2b6ff tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:34:47.500539 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7e867913-aff5-44e2-ab82-009291c2b6ff tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:34:47.531776 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7e867913-aff5-44e2-ab82-009291c2b6ff tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] 10.222.0.20 "GET /compute/v2.1/servers/2debbfcf-ca46-4698-aa7f-6e143c2a28a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048727 Oct 27 04:34:47.531776 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4051/7807] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 27 04:34:47 2022] GET /compute/v2.1/servers/2debbfcf-ca46-4698-aa7f-6e143c2a28a3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:34:48.543446 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-08b9b412-a4fa-49eb-83de-0748346e4bce tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:34:48.545666 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-08b9b412-a4fa-49eb-83de-0748346e4bce tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] [instance: 2debbfcf-ca46-4698-aa7f-6e143c2a28a3] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:34:48.553754 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-08b9b412-a4fa-49eb-83de-0748346e4bce tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:34:48.554296 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-08b9b412-a4fa-49eb-83de-0748346e4bce tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:34:48.554743 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-08b9b412-a4fa-49eb-83de-0748346e4bce tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:34:48.555469 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-08b9b412-a4fa-49eb-83de-0748346e4bce tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:34:48.555932 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-08b9b412-a4fa-49eb-83de-0748346e4bce tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:34:48.556366 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-08b9b412-a4fa-49eb-83de-0748346e4bce tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:34:48.588048 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-08b9b412-a4fa-49eb-83de-0748346e4bce tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] 10.222.0.20 "GET /compute/v2.1/servers/2debbfcf-ca46-4698-aa7f-6e143c2a28a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048975 Oct 27 04:34:48.588633 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3757/7808] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 27 04:34:48 2022] GET /compute/v2.1/servers/2debbfcf-ca46-4698-aa7f-6e143c2a28a3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:34:49.601077 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-292c9bb3-0e6c-4e01-b18c-ee6f1f438ef0 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:34:49.603363 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-292c9bb3-0e6c-4e01-b18c-ee6f1f438ef0 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] [instance: 2debbfcf-ca46-4698-aa7f-6e143c2a28a3] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:34:49.610942 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-292c9bb3-0e6c-4e01-b18c-ee6f1f438ef0 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:34:49.611441 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-292c9bb3-0e6c-4e01-b18c-ee6f1f438ef0 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:34:49.611898 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-292c9bb3-0e6c-4e01-b18c-ee6f1f438ef0 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:34:49.612613 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-292c9bb3-0e6c-4e01-b18c-ee6f1f438ef0 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:34:49.613088 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-292c9bb3-0e6c-4e01-b18c-ee6f1f438ef0 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:34:49.613532 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-292c9bb3-0e6c-4e01-b18c-ee6f1f438ef0 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:34:49.643666 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-292c9bb3-0e6c-4e01-b18c-ee6f1f438ef0 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] 10.222.0.20 "GET /compute/v2.1/servers/2debbfcf-ca46-4698-aa7f-6e143c2a28a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046971 Oct 27 04:34:49.644238 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4052/7809] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 27 04:34:49 2022] GET /compute/v2.1/servers/2debbfcf-ca46-4698-aa7f-6e143c2a28a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:34:50.658134 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0be62405-c8b9-4bf4-b6a5-7ab531508384 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:34:50.660340 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0be62405-c8b9-4bf4-b6a5-7ab531508384 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] [instance: 2debbfcf-ca46-4698-aa7f-6e143c2a28a3] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:34:50.668274 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0be62405-c8b9-4bf4-b6a5-7ab531508384 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:34:50.668765 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0be62405-c8b9-4bf4-b6a5-7ab531508384 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:34:50.669210 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0be62405-c8b9-4bf4-b6a5-7ab531508384 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:34:50.669920 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0be62405-c8b9-4bf4-b6a5-7ab531508384 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:34:50.670416 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0be62405-c8b9-4bf4-b6a5-7ab531508384 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:34:50.671352 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0be62405-c8b9-4bf4-b6a5-7ab531508384 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:34:50.704242 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0be62405-c8b9-4bf4-b6a5-7ab531508384 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] 10.222.0.20 "GET /compute/v2.1/servers/2debbfcf-ca46-4698-aa7f-6e143c2a28a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051184 Oct 27 04:34:50.704811 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3758/7810] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 27 04:34:50 2022] GET /compute/v2.1/servers/2debbfcf-ca46-4698-aa7f-6e143c2a28a3/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:34:51.717101 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-644cd0a3-c9c3-48ce-875f-ba5f99683d80 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:34:51.719394 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-644cd0a3-c9c3-48ce-875f-ba5f99683d80 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] [instance: 2debbfcf-ca46-4698-aa7f-6e143c2a28a3] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:34:51.726440 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-644cd0a3-c9c3-48ce-875f-ba5f99683d80 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:34:51.726943 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-644cd0a3-c9c3-48ce-875f-ba5f99683d80 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:34:51.727402 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-644cd0a3-c9c3-48ce-875f-ba5f99683d80 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:34:51.728110 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-644cd0a3-c9c3-48ce-875f-ba5f99683d80 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:34:51.728581 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-644cd0a3-c9c3-48ce-875f-ba5f99683d80 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:34:51.729026 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-644cd0a3-c9c3-48ce-875f-ba5f99683d80 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:34:51.760107 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-644cd0a3-c9c3-48ce-875f-ba5f99683d80 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] 10.222.0.20 "GET /compute/v2.1/servers/2debbfcf-ca46-4698-aa7f-6e143c2a28a3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047160 Oct 27 04:34:51.760665 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4053/7811] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 27 04:34:51 2022] GET /compute/v2.1/servers/2debbfcf-ca46-4698-aa7f-6e143c2a28a3/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 04:34:51.771873 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a73e9daf-17af-4a1a-a4f4-fc1913ce52c0 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:34:51.772367 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a73e9daf-17af-4a1a-a4f4-fc1913ce52c0 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] [instance: 2debbfcf-ca46-4698-aa7f-6e143c2a28a3] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:34:51.779463 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a73e9daf-17af-4a1a-a4f4-fc1913ce52c0 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:34:51.779952 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a73e9daf-17af-4a1a-a4f4-fc1913ce52c0 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:34:51.780425 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a73e9daf-17af-4a1a-a4f4-fc1913ce52c0 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:34:51.781114 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a73e9daf-17af-4a1a-a4f4-fc1913ce52c0 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:34:51.781570 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a73e9daf-17af-4a1a-a4f4-fc1913ce52c0 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:34:51.781999 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a73e9daf-17af-4a1a-a4f4-fc1913ce52c0 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:34:51.855609 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-a73e9daf-17af-4a1a-a4f4-fc1913ce52c0 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] HTTP exception thrown: Instance 2debbfcf-ca46-4698-aa7f-6e143c2a28a3 is not attached to volume 5fd3a701-c83d-447a-af12-d94ba45d4728 Oct 27 04:34:51.857254 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a73e9daf-17af-4a1a-a4f4-fc1913ce52c0 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Request method failure captured: Oct 27 04:34:51.857254 n-d-862769-1 devstack@n-api.service[121000]: request: DELETE /compute/v2.1/servers/2debbfcf-ca46-4698-aa7f-6e143c2a28a3/os-volume_attachments/5fd3a701-c83d-447a-af12-d94ba45d4728 HTTP/1.1 Oct 27 04:34:51.857254 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 04:34:51.857254 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 04:34:51.857254 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 04:34:51.857254 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 04:34:51.857254 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 04:34:51.857254 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 04:34:51.857254 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 04:34:51.857254 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 04:34:51.857254 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWgntydcp5ucyHhbhzCFUw5z1Qa5I4ESWqPpfdPgOqm66QNd0jyTjtGd6eTxa7eImf2v1ba9CEyum0GiPKZG2hDfZxnvQtUQUD9-2xS88KBIMOAkwT-bueemeWQr6Ipcz8LM0YNs7A3Wbr85EKibgX9GYFE5tcNTEuszQ_S9andFdlBQ Oct 27 04:34:51.857254 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 04:34:51.857254 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 04:34:51.857254 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 04:34:51.857254 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 04:34:51.857254 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 04:34:51.857254 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 04:34:51.857254 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: c4a8b90797b04f59bb513f5b6f4f6ba0 Oct 27 04:34:51.857254 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-TestEncryptedCinderVolumes-186849876 Oct 27 04:34:51.857254 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 04:34:51.857254 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 04:34:51.857254 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c4a8b90797b04f59bb513f5b6f4f6ba0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c4a8b90797b04f59bb513f5b6f4f6ba0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c4a8b90797b04f59bb513f5b6f4f6ba0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c4a8b90797b04f59bb513f5b6f4f6ba0"}]}] Oct 27 04:34:51.857254 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-TestEncryptedCinderVolumes-186849876 Oct 27 04:34:51.857254 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: c4a8b90797b04f59bb513f5b6f4f6ba0 Oct 27 04:34:51.857254 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-186849876 Oct 27 04:34:51.857254 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-TestEncryptedCinderVolumes-186849876-project Oct 27 04:34:51.857254 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 04:34:51.857254 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 04:34:51.857254 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: aec3aa7aba49468e86caef89e306d01d Oct 27 04:34:51.857254 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-TestEncryptedCinderVolumes-186849876-project Oct 27 04:34:51.857254 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 04:34:51.857254 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 2debbfcf-ca46-4698-aa7f-6e143c2a28a3 is not attached to volume 5fd3a701-c83d-447a-af12-d94ba45d4728 Oct 27 04:34:51.857254 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'server_id': '2debbfcf-ca46-4698-aa7f-6e143c2a28a3', 'id': '5fd3a701-c83d-447a-af12-d94ba45d4728'} Oct 27 04:34:51.857254 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 04:34:51.857254 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:34:51.857254 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 27 04:34:51.857254 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 27 04:34:51.857254 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 04:34:51.857254 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 04:34:51.857254 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 27 04:34:51.857254 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 27 04:34:51.857254 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 5fd3a701-c83d-447a-af12-d94ba45d4728. Oct 27 04:34:51.857254 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:34:51.857254 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:34:51.857254 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:34:51.857254 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:34:51.857254 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:34:51.857254 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:34:51.857254 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 04:34:51.857254 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 04:34:51.857254 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 04:34:51.857254 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 04:34:51.857254 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 27 04:34:51.857254 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 27 04:34:51.857254 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2debbfcf-ca46-4698-aa7f-6e143c2a28a3 is not attached to volume 5fd3a701-c83d-447a-af12-d94ba45d4728 Oct 27 04:34:51.857254 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:34:51.857254 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:34:51.857254 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:34:51.857254 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:34:51.857254 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:34:51.857254 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:34:51.861941 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 04:34:51.861941 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 04:34:51.861941 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2debbfcf-ca46-4698-aa7f-6e143c2a28a3 is not attached to volume 5fd3a701-c83d-447a-af12-d94ba45d4728 Oct 27 04:34:51.861941 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:34:51.861941 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a73e9daf-17af-4a1a-a4f4-fc1913ce52c0 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Returning 404 to user: Instance 2debbfcf-ca46-4698-aa7f-6e143c2a28a3 is not attached to volume 5fd3a701-c83d-447a-af12-d94ba45d4728 {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 04:34:51.861941 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a73e9daf-17af-4a1a-a4f4-fc1913ce52c0 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2debbfcf-ca46-4698-aa7f-6e143c2a28a3/os-volume_attachments/5fd3a701-c83d-447a-af12-d94ba45d4728" status: 404 len: 154 microversion: 2.1 time: 0.090947 Oct 27 04:34:51.861941 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3759/7812] 10.222.0.20 () {58 vars in 1416 bytes} [Thu Oct 27 04:34:51 2022] DELETE /compute/v2.1/servers/2debbfcf-ca46-4698-aa7f-6e143c2a28a3/os-volume_attachments/5fd3a701-c83d-447a-af12-d94ba45d4728 => generated 154 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 04:34:55.359665 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-51f1c0a2-ae17-4525-8157-eda16c72c549 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:34:55.360203 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-51f1c0a2-ae17-4525-8157-eda16c72c549 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] [instance: 2debbfcf-ca46-4698-aa7f-6e143c2a28a3] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:34:55.367206 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-51f1c0a2-ae17-4525-8157-eda16c72c549 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:34:55.375501 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-51f1c0a2-ae17-4525-8157-eda16c72c549 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:34:55.375501 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-51f1c0a2-ae17-4525-8157-eda16c72c549 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:34:55.375501 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-51f1c0a2-ae17-4525-8157-eda16c72c549 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:34:55.375501 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-51f1c0a2-ae17-4525-8157-eda16c72c549 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:34:55.375501 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-51f1c0a2-ae17-4525-8157-eda16c72c549 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:34:55.395238 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-51f1c0a2-ae17-4525-8157-eda16c72c549 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] [instance: 2debbfcf-ca46-4698-aa7f-6e143c2a28a3] Going to try to terminate instance {{(pid=121001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 04:34:55.695175 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-51f1c0a2-ae17-4525-8157-eda16c72c549 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2debbfcf-ca46-4698-aa7f-6e143c2a28a3" status: 204 len: 0 microversion: 2.1 time: 0.339781 Oct 27 04:34:55.695781 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4054/7813] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 04:34:55 2022] DELETE /compute/v2.1/servers/2debbfcf-ca46-4698-aa7f-6e143c2a28a3 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 04:34:55.704684 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-fddca3d2-0746-4de8-a44b-b9300be36fec tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:34:55.705314 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-fddca3d2-0746-4de8-a44b-b9300be36fec tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] [instance: 2debbfcf-ca46-4698-aa7f-6e143c2a28a3] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:34:55.712886 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fddca3d2-0746-4de8-a44b-b9300be36fec tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:34:55.713378 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fddca3d2-0746-4de8-a44b-b9300be36fec tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:34:55.713821 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fddca3d2-0746-4de8-a44b-b9300be36fec tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:34:55.714602 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fddca3d2-0746-4de8-a44b-b9300be36fec tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:34:55.715051 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fddca3d2-0746-4de8-a44b-b9300be36fec tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:34:55.715511 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fddca3d2-0746-4de8-a44b-b9300be36fec tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:34:55.854164 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-fddca3d2-0746-4de8-a44b-b9300be36fec tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec3aa7aba49468e86caef89e306d01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8b90797b04f59bb513f5b6f4f6ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:34:55.861970 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-fddca3d2-0746-4de8-a44b-b9300be36fec tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] 10.222.0.20 "GET /compute/v2.1/servers/2debbfcf-ca46-4698-aa7f-6e143c2a28a3" status: 200 len: 1560 microversion: 2.1 time: 0.161750 Oct 27 04:34:55.862786 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3760/7814] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:34:55 2022] GET /compute/v2.1/servers/2debbfcf-ca46-4698-aa7f-6e143c2a28a3 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:34:56.885539 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2db2f7ab-2a97-4ac4-b07d-0347af51057d tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:34:56.886320 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2db2f7ab-2a97-4ac4-b07d-0347af51057d tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] [instance: 2debbfcf-ca46-4698-aa7f-6e143c2a28a3] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:34:56.893917 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2db2f7ab-2a97-4ac4-b07d-0347af51057d tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:34:56.894439 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2db2f7ab-2a97-4ac4-b07d-0347af51057d tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:34:56.894906 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2db2f7ab-2a97-4ac4-b07d-0347af51057d tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:34:56.895617 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2db2f7ab-2a97-4ac4-b07d-0347af51057d tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:34:56.896095 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2db2f7ab-2a97-4ac4-b07d-0347af51057d tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:34:56.896546 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2db2f7ab-2a97-4ac4-b07d-0347af51057d tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:34:57.024963 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2db2f7ab-2a97-4ac4-b07d-0347af51057d tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec3aa7aba49468e86caef89e306d01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8b90797b04f59bb513f5b6f4f6ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:34:57.032880 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2db2f7ab-2a97-4ac4-b07d-0347af51057d tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] 10.222.0.20 "GET /compute/v2.1/servers/2debbfcf-ca46-4698-aa7f-6e143c2a28a3" status: 200 len: 1560 microversion: 2.1 time: 0.151790 Oct 27 04:34:57.033460 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4055/7815] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:34:56 2022] GET /compute/v2.1/servers/2debbfcf-ca46-4698-aa7f-6e143c2a28a3 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:34:57.812130 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-210f3101-1f30-4759-b5ed-2c73bdd5b74c req-068b1e44-6f99-440f-a9a4-f602da7e1197 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2debbfcf-ca46-4698-aa7f-6e143c2a28a3", "name": "network-vif-deleted", "tag": "05d52e02-fa06-443c-a6df-58a5e06e597c"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:34:57.822250 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-210f3101-1f30-4759-b5ed-2c73bdd5b74c req-068b1e44-6f99-440f-a9a4-f602da7e1197 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:34:57.822736 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-210f3101-1f30-4759-b5ed-2c73bdd5b74c req-068b1e44-6f99-440f-a9a4-f602da7e1197 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:34:57.823170 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-210f3101-1f30-4759-b5ed-2c73bdd5b74c req-068b1e44-6f99-440f-a9a4-f602da7e1197 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:34:57.834254 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-210f3101-1f30-4759-b5ed-2c73bdd5b74c req-068b1e44-6f99-440f-a9a4-f602da7e1197 service nova] Creating event network-vif-deleted:05d52e02-fa06-443c-a6df-58a5e06e597c for instance 2debbfcf-ca46-4698-aa7f-6e143c2a28a3 on n-h2-862769-1 Oct 27 04:34:57.839461 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-210f3101-1f30-4759-b5ed-2c73bdd5b74c req-068b1e44-6f99-440f-a9a4-f602da7e1197 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031232 Oct 27 04:34:57.840054 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3761/7816] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:34:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:34:58.055434 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5b8ff8b5-f616-4c04-a471-7344317871c3 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:34:58.055980 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5b8ff8b5-f616-4c04-a471-7344317871c3 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] [instance: 2debbfcf-ca46-4698-aa7f-6e143c2a28a3] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:34:58.062940 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5b8ff8b5-f616-4c04-a471-7344317871c3 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:34:58.063453 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5b8ff8b5-f616-4c04-a471-7344317871c3 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:34:58.063919 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5b8ff8b5-f616-4c04-a471-7344317871c3 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:34:58.064660 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5b8ff8b5-f616-4c04-a471-7344317871c3 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:34:58.065142 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5b8ff8b5-f616-4c04-a471-7344317871c3 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:34:58.065597 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5b8ff8b5-f616-4c04-a471-7344317871c3 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:34:58.099721 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5b8ff8b5-f616-4c04-a471-7344317871c3 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:34:58.100242 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5b8ff8b5-f616-4c04-a471-7344317871c3 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:34:58.100711 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5b8ff8b5-f616-4c04-a471-7344317871c3 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:34:58.101204 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-5b8ff8b5-f616-4c04-a471-7344317871c3 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lazy-loading 'fault' on Instance uuid 2debbfcf-ca46-4698-aa7f-6e143c2a28a3 {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 04:34:58.144100 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5b8ff8b5-f616-4c04-a471-7344317871c3 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec3aa7aba49468e86caef89e306d01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8b90797b04f59bb513f5b6f4f6ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:34:58.162843 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5b8ff8b5-f616-4c04-a471-7344317871c3 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] 10.222.0.20 "GET /compute/v2.1/servers/2debbfcf-ca46-4698-aa7f-6e143c2a28a3" status: 200 len: 1352 microversion: 2.1 time: 0.102112 Oct 27 04:34:58.170402 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4056/7817] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:34:58 2022] GET /compute/v2.1/servers/2debbfcf-ca46-4698-aa7f-6e143c2a28a3 => generated 1352 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:34:59.181226 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4a6b808a-7edb-4a82-8f95-753304626654 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:34:59.181879 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4a6b808a-7edb-4a82-8f95-753304626654 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] [instance: 2debbfcf-ca46-4698-aa7f-6e143c2a28a3] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:34:59.188901 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4a6b808a-7edb-4a82-8f95-753304626654 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:34:59.189393 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4a6b808a-7edb-4a82-8f95-753304626654 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:34:59.189835 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4a6b808a-7edb-4a82-8f95-753304626654 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:34:59.190567 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4a6b808a-7edb-4a82-8f95-753304626654 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:34:59.191047 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4a6b808a-7edb-4a82-8f95-753304626654 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:34:59.191476 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4a6b808a-7edb-4a82-8f95-753304626654 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:34:59.205499 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-4a6b808a-7edb-4a82-8f95-753304626654 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] HTTP exception thrown: Instance 2debbfcf-ca46-4698-aa7f-6e143c2a28a3 could not be found. Oct 27 04:34:59.207187 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4a6b808a-7edb-4a82-8f95-753304626654 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Request method failure captured: Oct 27 04:34:59.207187 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/2debbfcf-ca46-4698-aa7f-6e143c2a28a3 HTTP/1.1 Oct 27 04:34:59.207187 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 04:34:59.207187 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 04:34:59.207187 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 04:34:59.207187 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 04:34:59.207187 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 04:34:59.207187 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 04:34:59.207187 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 04:34:59.207187 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 04:34:59.207187 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWgntydcp5ucyHhbhzCFUw5z1Qa5I4ESWqPpfdPgOqm66QNd0jyTjtGd6eTxa7eImf2v1ba9CEyum0GiPKZG2hDfZxnvQtUQUD9-2xS88KBIMOAkwT-bueemeWQr6Ipcz8LM0YNs7A3Wbr85EKibgX9GYFE5tcNTEuszQ_S9andFdlBQ Oct 27 04:34:59.207187 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 04:34:59.207187 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 04:34:59.207187 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 04:34:59.207187 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 04:34:59.207187 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 04:34:59.207187 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 04:34:59.207187 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: c4a8b90797b04f59bb513f5b6f4f6ba0 Oct 27 04:34:59.207187 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-TestEncryptedCinderVolumes-186849876 Oct 27 04:34:59.207187 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 04:34:59.207187 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 04:34:59.207187 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c4a8b90797b04f59bb513f5b6f4f6ba0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c4a8b90797b04f59bb513f5b6f4f6ba0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c4a8b90797b04f59bb513f5b6f4f6ba0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c4a8b90797b04f59bb513f5b6f4f6ba0"}]}] Oct 27 04:34:59.207187 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-TestEncryptedCinderVolumes-186849876 Oct 27 04:34:59.207187 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: c4a8b90797b04f59bb513f5b6f4f6ba0 Oct 27 04:34:59.207187 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-186849876 Oct 27 04:34:59.207187 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-TestEncryptedCinderVolumes-186849876-project Oct 27 04:34:59.207187 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 04:34:59.207187 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 04:34:59.207187 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: aec3aa7aba49468e86caef89e306d01d Oct 27 04:34:59.207187 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-TestEncryptedCinderVolumes-186849876-project Oct 27 04:34:59.207187 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 04:34:59.207187 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance 2debbfcf-ca46-4698-aa7f-6e143c2a28a3 could not be found. Oct 27 04:34:59.207187 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': '2debbfcf-ca46-4698-aa7f-6e143c2a28a3'} Oct 27 04:34:59.207187 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 04:34:59.207187 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:34:59.207187 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 04:34:59.207187 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 04:34:59.207187 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 04:34:59.207187 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 04:34:59.207187 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 04:34:59.207187 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 04:34:59.207187 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 04:34:59.207187 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 04:34:59.207187 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2debbfcf-ca46-4698-aa7f-6e143c2a28a3 could not be found. Oct 27 04:34:59.207187 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:34:59.207187 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:34:59.207187 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:34:59.207187 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:34:59.207187 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:34:59.207187 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:34:59.207187 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 04:34:59.207187 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 04:34:59.207187 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 04:34:59.207187 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 04:34:59.207187 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 04:34:59.207187 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 04:34:59.207187 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 04:34:59.207187 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 04:34:59.207187 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 04:34:59.207187 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 04:34:59.207187 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2debbfcf-ca46-4698-aa7f-6e143c2a28a3 could not be found. Oct 27 04:34:59.207187 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:34:59.207187 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:34:59.207187 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:34:59.212429 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:34:59.212429 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:34:59.212429 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:34:59.212429 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 04:34:59.212429 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 04:34:59.212429 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2debbfcf-ca46-4698-aa7f-6e143c2a28a3 could not be found. Oct 27 04:34:59.212429 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:34:59.212429 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4a6b808a-7edb-4a82-8f95-753304626654 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Returning 404 to user: Instance 2debbfcf-ca46-4698-aa7f-6e143c2a28a3 could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 04:34:59.212429 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4a6b808a-7edb-4a82-8f95-753304626654 tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] 10.222.0.20 "GET /compute/v2.1/servers/2debbfcf-ca46-4698-aa7f-6e143c2a28a3" status: 404 len: 111 microversion: 2.1 time: 0.032682 Oct 27 04:34:59.212429 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3762/7818] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:34:59 2022] GET /compute/v2.1/servers/2debbfcf-ca46-4698-aa7f-6e143c2a28a3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 04:34:59.217716 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9b0881c5-9b0d-4348-8ea4-bb4f96d8e59d tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] Calling method '.version_select at 0x7f7dda5868b0>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:34:59.290400 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9b0881c5-9b0d-4348-8ea4-bb4f96d8e59d tempest-TestEncryptedCinderVolumes-186849876 tempest-TestEncryptedCinderVolumes-186849876-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-671003906" status: 202 len: 0 microversion: 2.1 time: 0.076636 Oct 27 04:34:59.291000 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4057/7819] 10.222.0.20 () {58 vars in 1275 bytes} [Thu Oct 27 04:34:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-671003906 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 04:35:32.411221 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-96b13b2e-4336-4491-bb06-73439ae36334 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Action: 'create', calling method: .version_select at 0x7f7ddec55280>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-233251621", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKlA02ZNcGELUZHEX2G1eq+Ic1omOiAvmzu5APxgrjzYfQQNrJNvwBzYwZgbXimC2aLsTXLmW7W8wcUPXdy7gFrGynO43AjLWREzOD68X2yEySzlCjkX6ADTiEXM4gR7WA=="}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:35:32.416788 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=14 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:35:32.417486 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=34 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:35:32.428578 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-96b13b2e-4336-4491-bb06-73439ae36334 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Getting quotas for project e577cf747d5b4a12ba0ee81e686b8534. Resources: {'key_pairs'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 04:35:32.433619 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-96b13b2e-4336-4491-bb06-73439ae36334 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Getting quotas for user 81159cb7105b4f4e94527225ed45feeb and project e577cf747d5b4a12ba0ee81e686b8534. Resources: {'key_pairs'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 04:35:32.517986 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-96b13b2e-4336-4491-bb06-73439ae36334 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.110874 Oct 27 04:35:32.518630 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3763/7820] 10.222.0.20 () {60 vars in 1159 bytes} [Thu Oct 27 04:35:32 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:35:32.566305 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:35:32.567143 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:35:32.571159 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-33ce1cc2-553c-4f3e-93b0-c35b1b696e26 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-847506470", "imageRef": "63c4fbf4-4774-49ef-b647-e1d072a57ebb", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-233251621", "networks": [{"uuid": "4e172054-91aa-4379-b6cb-5f79a555d9a7"}]}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:35:32.623533 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.network.neutron [None req-33ce1cc2-553c-4f3e-93b0-c35b1b696e26 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] validate_networks() for [('4e172054-91aa-4379-b6cb-5f79a555d9a7', None, None, None, None, None)] {{(pid=121001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 04:35:33.006275 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-33ce1cc2-553c-4f3e-93b0-c35b1b696e26 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Flavor limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 04:35:33.006802 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-33ce1cc2-553c-4f3e-93b0-c35b1b696e26 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Image limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 04:35:33.007294 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-33ce1cc2-553c-4f3e-93b0-c35b1b696e26 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Flavor pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 04:35:33.007755 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-33ce1cc2-553c-4f3e-93b0-c35b1b696e26 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Image pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 04:35:33.008190 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-33ce1cc2-553c-4f3e-93b0-c35b1b696e26 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 04:35:33.017230 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-33ce1cc2-553c-4f3e-93b0-c35b1b696e26 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:35:33.017783 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-33ce1cc2-553c-4f3e-93b0-c35b1b696e26 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:35:33.018284 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-33ce1cc2-553c-4f3e-93b0-c35b1b696e26 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:35:33.019042 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-33ce1cc2-553c-4f3e-93b0-c35b1b696e26 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:35:33.019520 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-33ce1cc2-553c-4f3e-93b0-c35b1b696e26 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:35:33.019969 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-33ce1cc2-553c-4f3e-93b0-c35b1b696e26 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:35:33.037410 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-33ce1cc2-553c-4f3e-93b0-c35b1b696e26 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Getting quotas for project e577cf747d5b4a12ba0ee81e686b8534. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 04:35:33.042776 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-33ce1cc2-553c-4f3e-93b0-c35b1b696e26 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Getting quotas for user 81159cb7105b4f4e94527225ed45feeb and project e577cf747d5b4a12ba0ee81e686b8534. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 04:35:33.057470 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-33ce1cc2-553c-4f3e-93b0-c35b1b696e26 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Going to run 1 instances... {{(pid=121001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 04:35:33.059813 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-33ce1cc2-553c-4f3e-93b0-c35b1b696e26 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 7666781e-7ea5-4ab2-bc16-f07dcbbe0377] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63c4fbf4-4774-49ef-b647-e1d072a57ebb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 04:35:33.188707 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-33ce1cc2-553c-4f3e-93b0-c35b1b696e26 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.624374 Oct 27 04:35:33.189872 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4058/7821] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 04:35:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 626 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 04:35:33.200809 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-59550c82-d960-476a-a359-976a7c8c29f1 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:35:33.201437 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-59550c82-d960-476a-a359-976a7c8c29f1 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 7666781e-7ea5-4ab2-bc16-f07dcbbe0377] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:35:33.256655 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-59550c82-d960-476a-a359-976a7c8c29f1 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81159cb7105b4f4e94527225ed45feeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e577cf747d5b4a12ba0ee81e686b8534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:35:33.264443 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-59550c82-d960-476a-a359-976a7c8c29f1 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "GET /compute/v2.1/servers/7666781e-7ea5-4ab2-bc16-f07dcbbe0377" status: 200 len: 1257 microversion: 2.1 time: 0.067935 Oct 27 04:35:33.265007 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3764/7822] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:35:33 2022] GET /compute/v2.1/servers/7666781e-7ea5-4ab2-bc16-f07dcbbe0377 => generated 1257 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:35:34.288513 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4c1d4e63-c0a7-4ccc-8111-e0afd2a90e31 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:35:34.289179 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4c1d4e63-c0a7-4ccc-8111-e0afd2a90e31 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 7666781e-7ea5-4ab2-bc16-f07dcbbe0377] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:35:34.296164 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4c1d4e63-c0a7-4ccc-8111-e0afd2a90e31 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:35:34.296666 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4c1d4e63-c0a7-4ccc-8111-e0afd2a90e31 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:35:34.297165 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4c1d4e63-c0a7-4ccc-8111-e0afd2a90e31 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:35:34.297882 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4c1d4e63-c0a7-4ccc-8111-e0afd2a90e31 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:35:34.298379 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4c1d4e63-c0a7-4ccc-8111-e0afd2a90e31 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:35:34.298830 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4c1d4e63-c0a7-4ccc-8111-e0afd2a90e31 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:35:34.360837 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4c1d4e63-c0a7-4ccc-8111-e0afd2a90e31 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81159cb7105b4f4e94527225ed45feeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e577cf747d5b4a12ba0ee81e686b8534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:35:34.368980 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4c1d4e63-c0a7-4ccc-8111-e0afd2a90e31 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "GET /compute/v2.1/servers/7666781e-7ea5-4ab2-bc16-f07dcbbe0377" status: 200 len: 1261 microversion: 2.1 time: 0.085645 Oct 27 04:35:34.369553 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4059/7823] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:35:34 2022] GET /compute/v2.1/servers/7666781e-7ea5-4ab2-bc16-f07dcbbe0377 => generated 1261 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:35:35.392486 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-83e7019a-8de6-4f47-b315-536619440df0 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:35:35.393121 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-83e7019a-8de6-4f47-b315-536619440df0 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 7666781e-7ea5-4ab2-bc16-f07dcbbe0377] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:35:35.401049 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-83e7019a-8de6-4f47-b315-536619440df0 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:35:35.401540 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-83e7019a-8de6-4f47-b315-536619440df0 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:35:35.401984 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-83e7019a-8de6-4f47-b315-536619440df0 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:35:35.402758 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-83e7019a-8de6-4f47-b315-536619440df0 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:35:35.403211 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-83e7019a-8de6-4f47-b315-536619440df0 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:35:35.403639 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-83e7019a-8de6-4f47-b315-536619440df0 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:35:35.482931 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-83e7019a-8de6-4f47-b315-536619440df0 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81159cb7105b4f4e94527225ed45feeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e577cf747d5b4a12ba0ee81e686b8534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:35:35.490885 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-83e7019a-8de6-4f47-b315-536619440df0 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "GET /compute/v2.1/servers/7666781e-7ea5-4ab2-bc16-f07dcbbe0377" status: 200 len: 1317 microversion: 2.1 time: 0.102908 Oct 27 04:35:35.491668 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3765/7824] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:35:35 2022] GET /compute/v2.1/servers/7666781e-7ea5-4ab2-bc16-f07dcbbe0377 => generated 1317 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:35:36.514068 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9a0fd6f1-e457-4ca7-b9b1-a791df1f2271 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:35:36.515417 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-9a0fd6f1-e457-4ca7-b9b1-a791df1f2271 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 7666781e-7ea5-4ab2-bc16-f07dcbbe0377] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:35:36.523535 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9a0fd6f1-e457-4ca7-b9b1-a791df1f2271 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:35:36.524305 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9a0fd6f1-e457-4ca7-b9b1-a791df1f2271 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:35:36.524770 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9a0fd6f1-e457-4ca7-b9b1-a791df1f2271 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:35:36.525501 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9a0fd6f1-e457-4ca7-b9b1-a791df1f2271 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:35:36.525968 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9a0fd6f1-e457-4ca7-b9b1-a791df1f2271 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:35:36.526467 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9a0fd6f1-e457-4ca7-b9b1-a791df1f2271 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:35:36.698290 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-9a0fd6f1-e457-4ca7-b9b1-a791df1f2271 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81159cb7105b4f4e94527225ed45feeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e577cf747d5b4a12ba0ee81e686b8534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:35:36.710972 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9a0fd6f1-e457-4ca7-b9b1-a791df1f2271 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "GET /compute/v2.1/servers/7666781e-7ea5-4ab2-bc16-f07dcbbe0377" status: 200 len: 1357 microversion: 2.1 time: 0.200717 Oct 27 04:35:36.712095 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4060/7825] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:35:36 2022] GET /compute/v2.1/servers/7666781e-7ea5-4ab2-bc16-f07dcbbe0377 => generated 1357 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:35:37.742469 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ee07bbca-79b8-4795-8e39-b7b9441cf2ac tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:35:37.743095 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ee07bbca-79b8-4795-8e39-b7b9441cf2ac tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 7666781e-7ea5-4ab2-bc16-f07dcbbe0377] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:35:37.751001 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ee07bbca-79b8-4795-8e39-b7b9441cf2ac tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:35:37.751418 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ee07bbca-79b8-4795-8e39-b7b9441cf2ac tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:35:37.751668 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ee07bbca-79b8-4795-8e39-b7b9441cf2ac tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:35:37.752372 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ee07bbca-79b8-4795-8e39-b7b9441cf2ac tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:35:37.752834 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ee07bbca-79b8-4795-8e39-b7b9441cf2ac tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:35:37.753266 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ee07bbca-79b8-4795-8e39-b7b9441cf2ac tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:35:37.895475 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ee07bbca-79b8-4795-8e39-b7b9441cf2ac tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81159cb7105b4f4e94527225ed45feeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e577cf747d5b4a12ba0ee81e686b8534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:35:37.903763 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ee07bbca-79b8-4795-8e39-b7b9441cf2ac tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "GET /compute/v2.1/servers/7666781e-7ea5-4ab2-bc16-f07dcbbe0377" status: 200 len: 1357 microversion: 2.1 time: 0.165302 Oct 27 04:35:37.904435 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3766/7826] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:35:37 2022] GET /compute/v2.1/servers/7666781e-7ea5-4ab2-bc16-f07dcbbe0377 => generated 1357 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:35:38.927426 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-83563e05-613e-4a57-8fa8-280ea61b5772 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:35:38.928078 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-83563e05-613e-4a57-8fa8-280ea61b5772 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 7666781e-7ea5-4ab2-bc16-f07dcbbe0377] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:35:38.935701 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-83563e05-613e-4a57-8fa8-280ea61b5772 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:35:38.936241 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-83563e05-613e-4a57-8fa8-280ea61b5772 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:35:38.936943 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-83563e05-613e-4a57-8fa8-280ea61b5772 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:35:38.938453 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-83563e05-613e-4a57-8fa8-280ea61b5772 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:35:38.939069 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-83563e05-613e-4a57-8fa8-280ea61b5772 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:35:38.939664 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-83563e05-613e-4a57-8fa8-280ea61b5772 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:35:39.086405 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-83563e05-613e-4a57-8fa8-280ea61b5772 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81159cb7105b4f4e94527225ed45feeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e577cf747d5b4a12ba0ee81e686b8534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:35:39.096693 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-83563e05-613e-4a57-8fa8-280ea61b5772 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "GET /compute/v2.1/servers/7666781e-7ea5-4ab2-bc16-f07dcbbe0377" status: 200 len: 1357 microversion: 2.1 time: 0.173209 Oct 27 04:35:39.097251 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4061/7827] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:35:38 2022] GET /compute/v2.1/servers/7666781e-7ea5-4ab2-bc16-f07dcbbe0377 => generated 1357 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:35:40.122341 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e82145da-905a-40ec-8566-b7acc8d5f0c8 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:35:40.123005 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e82145da-905a-40ec-8566-b7acc8d5f0c8 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 7666781e-7ea5-4ab2-bc16-f07dcbbe0377] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:35:40.130669 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e82145da-905a-40ec-8566-b7acc8d5f0c8 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:35:40.131163 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e82145da-905a-40ec-8566-b7acc8d5f0c8 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:35:40.131609 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e82145da-905a-40ec-8566-b7acc8d5f0c8 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:35:40.132320 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e82145da-905a-40ec-8566-b7acc8d5f0c8 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:35:40.132787 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e82145da-905a-40ec-8566-b7acc8d5f0c8 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:35:40.133227 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e82145da-905a-40ec-8566-b7acc8d5f0c8 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:35:40.285514 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e82145da-905a-40ec-8566-b7acc8d5f0c8 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81159cb7105b4f4e94527225ed45feeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e577cf747d5b4a12ba0ee81e686b8534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:35:40.293407 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e82145da-905a-40ec-8566-b7acc8d5f0c8 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "GET /compute/v2.1/servers/7666781e-7ea5-4ab2-bc16-f07dcbbe0377" status: 200 len: 1357 microversion: 2.1 time: 0.175384 Oct 27 04:35:40.293991 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3767/7828] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:35:40 2022] GET /compute/v2.1/servers/7666781e-7ea5-4ab2-bc16-f07dcbbe0377 => generated 1357 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:35:41.319087 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e1de389b-ab43-4cb8-89a5-4ea569ec7cb8 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:35:41.319755 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e1de389b-ab43-4cb8-89a5-4ea569ec7cb8 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 7666781e-7ea5-4ab2-bc16-f07dcbbe0377] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:35:41.328761 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e1de389b-ab43-4cb8-89a5-4ea569ec7cb8 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:35:41.329427 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e1de389b-ab43-4cb8-89a5-4ea569ec7cb8 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:35:41.329884 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e1de389b-ab43-4cb8-89a5-4ea569ec7cb8 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:35:41.330664 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e1de389b-ab43-4cb8-89a5-4ea569ec7cb8 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:35:41.331136 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e1de389b-ab43-4cb8-89a5-4ea569ec7cb8 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:35:41.331606 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e1de389b-ab43-4cb8-89a5-4ea569ec7cb8 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:35:41.541676 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e1de389b-ab43-4cb8-89a5-4ea569ec7cb8 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81159cb7105b4f4e94527225ed45feeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e577cf747d5b4a12ba0ee81e686b8534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:35:41.554905 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e1de389b-ab43-4cb8-89a5-4ea569ec7cb8 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "GET /compute/v2.1/servers/7666781e-7ea5-4ab2-bc16-f07dcbbe0377" status: 200 len: 1357 microversion: 2.1 time: 0.239549 Oct 27 04:35:41.555590 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4062/7829] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:35:41 2022] GET /compute/v2.1/servers/7666781e-7ea5-4ab2-bc16-f07dcbbe0377 => generated 1357 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:35:42.326121 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-fb9d004d-b531-44b9-ac56-3c0eace45663 req-5de5f9bf-6a07-469f-9120-fef7055efd42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7666781e-7ea5-4ab2-bc16-f07dcbbe0377", "tag": "7bfb6043-2c61-40e2-a9c4-4b60b15be8d3"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:35:42.347828 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-fb9d004d-b531-44b9-ac56-3c0eace45663 req-5de5f9bf-6a07-469f-9120-fef7055efd42 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:35:42.348768 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-fb9d004d-b531-44b9-ac56-3c0eace45663 req-5de5f9bf-6a07-469f-9120-fef7055efd42 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:35:42.349756 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-fb9d004d-b531-44b9-ac56-3c0eace45663 req-5de5f9bf-6a07-469f-9120-fef7055efd42 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:35:42.362428 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-fb9d004d-b531-44b9-ac56-3c0eace45663 req-5de5f9bf-6a07-469f-9120-fef7055efd42 service nova] Creating event network-changed:7bfb6043-2c61-40e2-a9c4-4b60b15be8d3 for instance 7666781e-7ea5-4ab2-bc16-f07dcbbe0377 on n-h1-862769-1 Oct 27 04:35:42.368890 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-fb9d004d-b531-44b9-ac56-3c0eace45663 req-5de5f9bf-6a07-469f-9120-fef7055efd42 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046405 Oct 27 04:35:42.369520 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3768/7830] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:35:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:35:42.581837 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-df197373-dea6-4b86-9c69-b84f6837d9be tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:35:42.582670 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-df197373-dea6-4b86-9c69-b84f6837d9be tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 7666781e-7ea5-4ab2-bc16-f07dcbbe0377] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:35:42.589878 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-df197373-dea6-4b86-9c69-b84f6837d9be tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:35:42.590812 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-df197373-dea6-4b86-9c69-b84f6837d9be tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:35:42.591520 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-df197373-dea6-4b86-9c69-b84f6837d9be tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:35:42.592655 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-df197373-dea6-4b86-9c69-b84f6837d9be tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:35:42.593431 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-df197373-dea6-4b86-9c69-b84f6837d9be tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:35:42.594182 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-df197373-dea6-4b86-9c69-b84f6837d9be tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:35:42.761780 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-df197373-dea6-4b86-9c69-b84f6837d9be tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81159cb7105b4f4e94527225ed45feeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e577cf747d5b4a12ba0ee81e686b8534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:35:42.770472 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-df197373-dea6-4b86-9c69-b84f6837d9be tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "GET /compute/v2.1/servers/7666781e-7ea5-4ab2-bc16-f07dcbbe0377" status: 200 len: 1357 microversion: 2.1 time: 0.193030 Oct 27 04:35:42.771066 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4063/7831] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:35:42 2022] GET /compute/v2.1/servers/7666781e-7ea5-4ab2-bc16-f07dcbbe0377 => generated 1357 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:35:43.793988 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=6 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:35:43.799150 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b7afed8a-69d0-4e51-80f0-bcf636b814cb tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:35:43.799860 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b7afed8a-69d0-4e51-80f0-bcf636b814cb tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 7666781e-7ea5-4ab2-bc16-f07dcbbe0377] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:35:43.805947 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b7afed8a-69d0-4e51-80f0-bcf636b814cb tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:35:43.807480 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b7afed8a-69d0-4e51-80f0-bcf636b814cb tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:35:43.807480 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b7afed8a-69d0-4e51-80f0-bcf636b814cb tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:35:43.807792 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b7afed8a-69d0-4e51-80f0-bcf636b814cb tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:35:43.808030 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b7afed8a-69d0-4e51-80f0-bcf636b814cb tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:35:43.808485 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b7afed8a-69d0-4e51-80f0-bcf636b814cb tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:35:43.948005 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b7afed8a-69d0-4e51-80f0-bcf636b814cb tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81159cb7105b4f4e94527225ed45feeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e577cf747d5b4a12ba0ee81e686b8534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:35:43.956247 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b7afed8a-69d0-4e51-80f0-bcf636b814cb tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "GET /compute/v2.1/servers/7666781e-7ea5-4ab2-bc16-f07dcbbe0377" status: 200 len: 1357 microversion: 2.1 time: 0.163391 Oct 27 04:35:43.956835 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3769/7832] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:35:43 2022] GET /compute/v2.1/servers/7666781e-7ea5-4ab2-bc16-f07dcbbe0377 => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:35:44.980257 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1b4c759d-c571-4e10-b4af-c67bb6e4f6c6 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:35:44.980824 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1b4c759d-c571-4e10-b4af-c67bb6e4f6c6 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 7666781e-7ea5-4ab2-bc16-f07dcbbe0377] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:35:44.982720 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:35:44.983406 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=6 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:35:44.989059 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1b4c759d-c571-4e10-b4af-c67bb6e4f6c6 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:35:44.989561 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1b4c759d-c571-4e10-b4af-c67bb6e4f6c6 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:35:44.990012 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1b4c759d-c571-4e10-b4af-c67bb6e4f6c6 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:35:44.990894 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1b4c759d-c571-4e10-b4af-c67bb6e4f6c6 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:35:44.991195 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1b4c759d-c571-4e10-b4af-c67bb6e4f6c6 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:35:44.991638 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1b4c759d-c571-4e10-b4af-c67bb6e4f6c6 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:35:45.123907 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1b4c759d-c571-4e10-b4af-c67bb6e4f6c6 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81159cb7105b4f4e94527225ed45feeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e577cf747d5b4a12ba0ee81e686b8534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:35:45.132148 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1b4c759d-c571-4e10-b4af-c67bb6e4f6c6 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "GET /compute/v2.1/servers/7666781e-7ea5-4ab2-bc16-f07dcbbe0377" status: 200 len: 1357 microversion: 2.1 time: 0.155989 Oct 27 04:35:45.132725 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4064/7833] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:35:44 2022] GET /compute/v2.1/servers/7666781e-7ea5-4ab2-bc16-f07dcbbe0377 => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:35:46.155663 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4a589190-fe5c-4f8a-ab09-ece2dbb97b21 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:35:46.156868 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4a589190-fe5c-4f8a-ab09-ece2dbb97b21 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 7666781e-7ea5-4ab2-bc16-f07dcbbe0377] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:35:46.163645 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4a589190-fe5c-4f8a-ab09-ece2dbb97b21 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:35:46.164132 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4a589190-fe5c-4f8a-ab09-ece2dbb97b21 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:35:46.164576 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4a589190-fe5c-4f8a-ab09-ece2dbb97b21 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:35:46.165271 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4a589190-fe5c-4f8a-ab09-ece2dbb97b21 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:35:46.165780 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4a589190-fe5c-4f8a-ab09-ece2dbb97b21 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:35:46.166248 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4a589190-fe5c-4f8a-ab09-ece2dbb97b21 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:35:46.405107 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4a589190-fe5c-4f8a-ab09-ece2dbb97b21 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81159cb7105b4f4e94527225ed45feeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e577cf747d5b4a12ba0ee81e686b8534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:35:46.412603 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4a589190-fe5c-4f8a-ab09-ece2dbb97b21 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "GET /compute/v2.1/servers/7666781e-7ea5-4ab2-bc16-f07dcbbe0377" status: 200 len: 1357 microversion: 2.1 time: 0.260932 Oct 27 04:35:46.413207 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3770/7834] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:35:46 2022] GET /compute/v2.1/servers/7666781e-7ea5-4ab2-bc16-f07dcbbe0377 => generated 1357 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:35:47.435325 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-511ceb97-d665-4683-ba8b-81c08be797c9 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:35:47.435963 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-511ceb97-d665-4683-ba8b-81c08be797c9 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 7666781e-7ea5-4ab2-bc16-f07dcbbe0377] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:35:47.443404 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-511ceb97-d665-4683-ba8b-81c08be797c9 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:35:47.446488 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-511ceb97-d665-4683-ba8b-81c08be797c9 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:35:47.446488 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-511ceb97-d665-4683-ba8b-81c08be797c9 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:35:47.446488 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-511ceb97-d665-4683-ba8b-81c08be797c9 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:35:47.446488 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-511ceb97-d665-4683-ba8b-81c08be797c9 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:35:47.446488 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-511ceb97-d665-4683-ba8b-81c08be797c9 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:35:47.622529 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-511ceb97-d665-4683-ba8b-81c08be797c9 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81159cb7105b4f4e94527225ed45feeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e577cf747d5b4a12ba0ee81e686b8534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:35:47.630889 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-511ceb97-d665-4683-ba8b-81c08be797c9 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "GET /compute/v2.1/servers/7666781e-7ea5-4ab2-bc16-f07dcbbe0377" status: 200 len: 1357 microversion: 2.1 time: 0.199503 Oct 27 04:35:47.631475 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4065/7835] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:35:47 2022] GET /compute/v2.1/servers/7666781e-7ea5-4ab2-bc16-f07dcbbe0377 => generated 1357 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:35:48.652821 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7de9d5ce-9d1a-4696-89c9-a337dcf0c051 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:35:48.653471 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7de9d5ce-9d1a-4696-89c9-a337dcf0c051 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 7666781e-7ea5-4ab2-bc16-f07dcbbe0377] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:35:48.660832 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7de9d5ce-9d1a-4696-89c9-a337dcf0c051 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:35:48.661317 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7de9d5ce-9d1a-4696-89c9-a337dcf0c051 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:35:48.661751 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7de9d5ce-9d1a-4696-89c9-a337dcf0c051 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:35:48.662467 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7de9d5ce-9d1a-4696-89c9-a337dcf0c051 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:35:48.662957 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7de9d5ce-9d1a-4696-89c9-a337dcf0c051 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:35:48.663357 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7de9d5ce-9d1a-4696-89c9-a337dcf0c051 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:35:48.794702 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7de9d5ce-9d1a-4696-89c9-a337dcf0c051 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81159cb7105b4f4e94527225ed45feeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e577cf747d5b4a12ba0ee81e686b8534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:35:48.803041 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7de9d5ce-9d1a-4696-89c9-a337dcf0c051 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "GET /compute/v2.1/servers/7666781e-7ea5-4ab2-bc16-f07dcbbe0377" status: 200 len: 1357 microversion: 2.1 time: 0.154100 Oct 27 04:35:48.803623 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3771/7836] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:35:48 2022] GET /compute/v2.1/servers/7666781e-7ea5-4ab2-bc16-f07dcbbe0377 => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:35:49.825991 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-43ba0c39-c786-4f99-89dd-8739af6f1b69 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:35:49.826672 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-43ba0c39-c786-4f99-89dd-8739af6f1b69 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 7666781e-7ea5-4ab2-bc16-f07dcbbe0377] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:35:49.833563 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-43ba0c39-c786-4f99-89dd-8739af6f1b69 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:35:49.834092 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-43ba0c39-c786-4f99-89dd-8739af6f1b69 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:35:49.834552 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-43ba0c39-c786-4f99-89dd-8739af6f1b69 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:35:49.835263 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-43ba0c39-c786-4f99-89dd-8739af6f1b69 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:35:49.835735 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-43ba0c39-c786-4f99-89dd-8739af6f1b69 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:35:49.836180 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-43ba0c39-c786-4f99-89dd-8739af6f1b69 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:35:49.970906 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-43ba0c39-c786-4f99-89dd-8739af6f1b69 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81159cb7105b4f4e94527225ed45feeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e577cf747d5b4a12ba0ee81e686b8534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:35:49.978769 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-43ba0c39-c786-4f99-89dd-8739af6f1b69 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "GET /compute/v2.1/servers/7666781e-7ea5-4ab2-bc16-f07dcbbe0377" status: 200 len: 1357 microversion: 2.1 time: 0.156726 Oct 27 04:35:49.979367 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4066/7837] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:35:49 2022] GET /compute/v2.1/servers/7666781e-7ea5-4ab2-bc16-f07dcbbe0377 => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:35:51.001763 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5dc5da4b-cf73-4e9c-af51-48a2b8b8f49a tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:35:51.002442 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5dc5da4b-cf73-4e9c-af51-48a2b8b8f49a tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 7666781e-7ea5-4ab2-bc16-f07dcbbe0377] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:35:51.009218 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5dc5da4b-cf73-4e9c-af51-48a2b8b8f49a tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:35:51.009710 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5dc5da4b-cf73-4e9c-af51-48a2b8b8f49a tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:35:51.010191 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5dc5da4b-cf73-4e9c-af51-48a2b8b8f49a tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:35:51.010896 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5dc5da4b-cf73-4e9c-af51-48a2b8b8f49a tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:35:51.011355 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5dc5da4b-cf73-4e9c-af51-48a2b8b8f49a tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:35:51.011789 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5dc5da4b-cf73-4e9c-af51-48a2b8b8f49a tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:35:51.053827 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-6e732d4c-0519-4316-8a90-4cf4ebbb0660 req-03a237a6-2529-4c95-8242-79e68dc3f654 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7666781e-7ea5-4ab2-bc16-f07dcbbe0377", "name": "network-vif-plugged", "status": "completed", "tag": "7bfb6043-2c61-40e2-a9c4-4b60b15be8d3"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:35:51.065468 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-6e732d4c-0519-4316-8a90-4cf4ebbb0660 req-03a237a6-2529-4c95-8242-79e68dc3f654 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:35:51.066060 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-6e732d4c-0519-4316-8a90-4cf4ebbb0660 req-03a237a6-2529-4c95-8242-79e68dc3f654 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:35:51.066603 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-6e732d4c-0519-4316-8a90-4cf4ebbb0660 req-03a237a6-2529-4c95-8242-79e68dc3f654 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:35:51.078935 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-6e732d4c-0519-4316-8a90-4cf4ebbb0660 req-03a237a6-2529-4c95-8242-79e68dc3f654 service nova] Creating event network-vif-plugged:7bfb6043-2c61-40e2-a9c4-4b60b15be8d3 for instance 7666781e-7ea5-4ab2-bc16-f07dcbbe0377 on n-h1-862769-1 Oct 27 04:35:51.087495 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-6e732d4c-0519-4316-8a90-4cf4ebbb0660 req-03a237a6-2529-4c95-8242-79e68dc3f654 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034285 Oct 27 04:35:51.087495 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4067/7838] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:35:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 04:35:51.146196 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5dc5da4b-cf73-4e9c-af51-48a2b8b8f49a tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81159cb7105b4f4e94527225ed45feeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e577cf747d5b4a12ba0ee81e686b8534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:35:51.154420 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5dc5da4b-cf73-4e9c-af51-48a2b8b8f49a tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "GET /compute/v2.1/servers/7666781e-7ea5-4ab2-bc16-f07dcbbe0377" status: 200 len: 1357 microversion: 2.1 time: 0.157091 Oct 27 04:35:51.155387 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3772/7839] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:35:50 2022] GET /compute/v2.1/servers/7666781e-7ea5-4ab2-bc16-f07dcbbe0377 => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:35:52.179484 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-46006a8d-d1a8-498b-b9d3-cdd16f0eba1c tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:35:52.180213 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-46006a8d-d1a8-498b-b9d3-cdd16f0eba1c tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 7666781e-7ea5-4ab2-bc16-f07dcbbe0377] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:35:52.186637 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-46006a8d-d1a8-498b-b9d3-cdd16f0eba1c tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:35:52.187803 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-46006a8d-d1a8-498b-b9d3-cdd16f0eba1c tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:35:52.188252 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-46006a8d-d1a8-498b-b9d3-cdd16f0eba1c tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:35:52.188976 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-46006a8d-d1a8-498b-b9d3-cdd16f0eba1c tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:35:52.189452 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-46006a8d-d1a8-498b-b9d3-cdd16f0eba1c tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:35:52.189903 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-46006a8d-d1a8-498b-b9d3-cdd16f0eba1c tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:35:52.319384 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-46006a8d-d1a8-498b-b9d3-cdd16f0eba1c tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81159cb7105b4f4e94527225ed45feeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e577cf747d5b4a12ba0ee81e686b8534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:35:52.327218 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-46006a8d-d1a8-498b-b9d3-cdd16f0eba1c tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "GET /compute/v2.1/servers/7666781e-7ea5-4ab2-bc16-f07dcbbe0377" status: 200 len: 1357 microversion: 2.1 time: 0.152956 Oct 27 04:35:52.327843 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4068/7840] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:35:52 2022] GET /compute/v2.1/servers/7666781e-7ea5-4ab2-bc16-f07dcbbe0377 => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:35:53.350285 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0e6dcf2f-e962-4024-8363-8d3e9dee558c tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:35:53.350945 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0e6dcf2f-e962-4024-8363-8d3e9dee558c tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 7666781e-7ea5-4ab2-bc16-f07dcbbe0377] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:35:53.357760 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0e6dcf2f-e962-4024-8363-8d3e9dee558c tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:35:53.358289 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0e6dcf2f-e962-4024-8363-8d3e9dee558c tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:35:53.358742 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0e6dcf2f-e962-4024-8363-8d3e9dee558c tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:35:53.359498 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0e6dcf2f-e962-4024-8363-8d3e9dee558c tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:35:53.359971 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0e6dcf2f-e962-4024-8363-8d3e9dee558c tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:35:53.360415 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0e6dcf2f-e962-4024-8363-8d3e9dee558c tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:35:53.488395 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0e6dcf2f-e962-4024-8363-8d3e9dee558c tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81159cb7105b4f4e94527225ed45feeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e577cf747d5b4a12ba0ee81e686b8534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:35:53.496081 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0e6dcf2f-e962-4024-8363-8d3e9dee558c tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "GET /compute/v2.1/servers/7666781e-7ea5-4ab2-bc16-f07dcbbe0377" status: 200 len: 1546 microversion: 2.1 time: 0.150048 Oct 27 04:35:53.496660 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3773/7841] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:35:53 2022] GET /compute/v2.1/servers/7666781e-7ea5-4ab2-bc16-f07dcbbe0377 => generated 1546 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:35:53.518911 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2851593a-7096-49d6-ae6a-20bfe7d91d8b tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:35:53.519552 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2851593a-7096-49d6-ae6a-20bfe7d91d8b tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 7666781e-7ea5-4ab2-bc16-f07dcbbe0377] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:35:53.526339 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2851593a-7096-49d6-ae6a-20bfe7d91d8b tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:35:53.526859 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2851593a-7096-49d6-ae6a-20bfe7d91d8b tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:35:53.527297 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2851593a-7096-49d6-ae6a-20bfe7d91d8b tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:35:53.528036 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2851593a-7096-49d6-ae6a-20bfe7d91d8b tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:35:53.528517 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2851593a-7096-49d6-ae6a-20bfe7d91d8b tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:35:53.528959 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2851593a-7096-49d6-ae6a-20bfe7d91d8b tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:35:53.661876 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2851593a-7096-49d6-ae6a-20bfe7d91d8b tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81159cb7105b4f4e94527225ed45feeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e577cf747d5b4a12ba0ee81e686b8534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:35:53.669666 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2851593a-7096-49d6-ae6a-20bfe7d91d8b tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "GET /compute/v2.1/servers/7666781e-7ea5-4ab2-bc16-f07dcbbe0377" status: 200 len: 1546 microversion: 2.1 time: 0.154741 Oct 27 04:35:53.670278 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4069/7842] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:35:53 2022] GET /compute/v2.1/servers/7666781e-7ea5-4ab2-bc16-f07dcbbe0377 => generated 1546 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:35:53.693784 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8f5c3fc6-77dc-439b-8a05-6e6de5a30d79 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:35:53.698558 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8f5c3fc6-77dc-439b-8a05-6e6de5a30d79 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '81159cb7105b4f4e94527225ed45feeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e577cf747d5b4a12ba0ee81e686b8534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:35:53.699332 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8f5c3fc6-77dc-439b-8a05-6e6de5a30d79 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Searching by: {'deleted': False, 'project_id': 'e577cf747d5b4a12ba0ee81e686b8534'} {{(pid=121000) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 04:35:53.704674 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8f5c3fc6-77dc-439b-8a05-6e6de5a30d79 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:35:53.705156 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8f5c3fc6-77dc-439b-8a05-6e6de5a30d79 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:35:53.705592 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8f5c3fc6-77dc-439b-8a05-6e6de5a30d79 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:35:53.706370 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8f5c3fc6-77dc-439b-8a05-6e6de5a30d79 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:35:53.706826 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8f5c3fc6-77dc-439b-8a05-6e6de5a30d79 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:35:53.707254 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8f5c3fc6-77dc-439b-8a05-6e6de5a30d79 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:35:53.731088 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.multi_cell_list [None req-8f5c3fc6-77dc-439b-8a05-6e6de5a30d79 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121000) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 04:35:53.758621 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8f5c3fc6-77dc-439b-8a05-6e6de5a30d79 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.069414 Oct 27 04:35:53.759472 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3774/7843] 10.222.0.20 () {58 vars in 1125 bytes} [Thu Oct 27 04:35:53 2022] GET /compute/v2.1/servers => generated 342 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:35:53.770910 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f21c1fe7-21ef-454b-8664-60dfde3cd3b6 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:35:53.771550 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f21c1fe7-21ef-454b-8664-60dfde3cd3b6 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 7666781e-7ea5-4ab2-bc16-f07dcbbe0377] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:35:53.777418 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f21c1fe7-21ef-454b-8664-60dfde3cd3b6 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:35:53.777921 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f21c1fe7-21ef-454b-8664-60dfde3cd3b6 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:35:53.778424 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f21c1fe7-21ef-454b-8664-60dfde3cd3b6 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:35:53.779137 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f21c1fe7-21ef-454b-8664-60dfde3cd3b6 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:35:53.779618 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f21c1fe7-21ef-454b-8664-60dfde3cd3b6 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:35:53.780065 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f21c1fe7-21ef-454b-8664-60dfde3cd3b6 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:35:53.906383 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f21c1fe7-21ef-454b-8664-60dfde3cd3b6 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81159cb7105b4f4e94527225ed45feeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e577cf747d5b4a12ba0ee81e686b8534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:35:53.914144 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f21c1fe7-21ef-454b-8664-60dfde3cd3b6 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "GET /compute/v2.1/servers/7666781e-7ea5-4ab2-bc16-f07dcbbe0377" status: 200 len: 1546 microversion: 2.1 time: 0.147149 Oct 27 04:35:53.914720 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4070/7844] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:35:53 2022] GET /compute/v2.1/servers/7666781e-7ea5-4ab2-bc16-f07dcbbe0377 => generated 1546 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:35:56.802330 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9815abaf-6348-440a-b0bd-06f502ca4d4c tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5259cda8-f01c-4953-ad9a-965f4ff5ac3f"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:35:56.804693 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9815abaf-6348-440a-b0bd-06f502ca4d4c tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 7666781e-7ea5-4ab2-bc16-f07dcbbe0377] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:35:56.811520 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9815abaf-6348-440a-b0bd-06f502ca4d4c tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:35:56.812042 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9815abaf-6348-440a-b0bd-06f502ca4d4c tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:35:56.812493 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9815abaf-6348-440a-b0bd-06f502ca4d4c tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:35:56.813199 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9815abaf-6348-440a-b0bd-06f502ca4d4c tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:35:56.813662 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9815abaf-6348-440a-b0bd-06f502ca4d4c tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:35:56.814122 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9815abaf-6348-440a-b0bd-06f502ca4d4c tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:35:57.514556 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9815abaf-6348-440a-b0bd-06f502ca4d4c tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "POST /compute/v2.1/servers/7666781e-7ea5-4ab2-bc16-f07dcbbe0377/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.716103 Oct 27 04:35:57.515842 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3775/7845] 10.222.0.20 () {60 vars in 1323 bytes} [Thu Oct 27 04:35:56 2022] POST /compute/v2.1/servers/7666781e-7ea5-4ab2-bc16-f07dcbbe0377/os-volume_attachments => generated 194 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:36:11.887913 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-08ebe423-0391-4973-8424-d4af69bc7d76 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:36:11.890181 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-08ebe423-0391-4973-8424-d4af69bc7d76 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 7666781e-7ea5-4ab2-bc16-f07dcbbe0377] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:36:11.890734 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:36:11.891424 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=70 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:36:11.896091 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-08ebe423-0391-4973-8424-d4af69bc7d76 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:36:11.896589 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-08ebe423-0391-4973-8424-d4af69bc7d76 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:36:11.897048 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-08ebe423-0391-4973-8424-d4af69bc7d76 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:36:11.897760 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-08ebe423-0391-4973-8424-d4af69bc7d76 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:36:11.898274 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-08ebe423-0391-4973-8424-d4af69bc7d76 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:36:11.898720 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-08ebe423-0391-4973-8424-d4af69bc7d76 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:36:12.031105 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-08ebe423-0391-4973-8424-d4af69bc7d76 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81159cb7105b4f4e94527225ed45feeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e577cf747d5b4a12ba0ee81e686b8534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:36:12.039969 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-08ebe423-0391-4973-8424-d4af69bc7d76 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "GET /compute/v2.1/servers/7666781e-7ea5-4ab2-bc16-f07dcbbe0377" status: 200 len: 1592 microversion: 2.1 time: 0.156203 Oct 27 04:36:12.040552 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4071/7846] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:36:11 2022] GET /compute/v2.1/servers/7666781e-7ea5-4ab2-bc16-f07dcbbe0377 => generated 1592 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:36:14.083480 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:36:14.084400 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:36:14.085181 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:36:14.086332 n-d-862769-1 devstack@n-api.service[121000]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 04:36:14.086475 n-d-862769-1 devstack@n-api.service[121000]: Thu Oct 27 04:36:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.20) !!! Oct 27 04:36:14.092573 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-b3f810fa-f3ac-4b3c-b12a-e6364b188186 req-5bdeef8a-311d-4c17-b8fd-7df63090d50a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7666781e-7ea5-4ab2-bc16-f07dcbbe0377", "tag": "7bfb6043-2c61-40e2-a9c4-4b60b15be8d3"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:36:14.105218 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-b3f810fa-f3ac-4b3c-b12a-e6364b188186 req-5bdeef8a-311d-4c17-b8fd-7df63090d50a service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:36:14.105982 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-b3f810fa-f3ac-4b3c-b12a-e6364b188186 req-5bdeef8a-311d-4c17-b8fd-7df63090d50a service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:36:14.106443 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-b3f810fa-f3ac-4b3c-b12a-e6364b188186 req-5bdeef8a-311d-4c17-b8fd-7df63090d50a service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:36:14.117594 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-b3f810fa-f3ac-4b3c-b12a-e6364b188186 req-5bdeef8a-311d-4c17-b8fd-7df63090d50a service nova] Creating event network-changed:7bfb6043-2c61-40e2-a9c4-4b60b15be8d3 for instance 7666781e-7ea5-4ab2-bc16-f07dcbbe0377 on n-h1-862769-1 Oct 27 04:36:14.123174 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-b3f810fa-f3ac-4b3c-b12a-e6364b188186 req-5bdeef8a-311d-4c17-b8fd-7df63090d50a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041588 Oct 27 04:36:14.123855 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3776/7847] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:36:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:36:16.383491 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5a826e23-22d3-4b28-a2d8-1d3b6519dcf8 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1947194830"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:36:16.384075 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5a826e23-22d3-4b28-a2d8-1d3b6519dcf8 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 7666781e-7ea5-4ab2-bc16-f07dcbbe0377] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:36:16.390967 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5a826e23-22d3-4b28-a2d8-1d3b6519dcf8 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:36:16.391472 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5a826e23-22d3-4b28-a2d8-1d3b6519dcf8 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:36:16.391930 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5a826e23-22d3-4b28-a2d8-1d3b6519dcf8 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:36:16.392642 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5a826e23-22d3-4b28-a2d8-1d3b6519dcf8 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:36:16.393113 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5a826e23-22d3-4b28-a2d8-1d3b6519dcf8 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:36:16.393615 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5a826e23-22d3-4b28-a2d8-1d3b6519dcf8 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:36:16.516627 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.network.security_group_api [None req-5a826e23-22d3-4b28-a2d8-1d3b6519dcf8 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Adding security group 5a2e93c0-c210-40da-a642-9fabe74ea1df to port 7bfb6043-2c61-40e2-a9c4-4b60b15be8d3 Oct 27 04:36:16.888214 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5a826e23-22d3-4b28-a2d8-1d3b6519dcf8 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "POST /compute/v2.1/servers/7666781e-7ea5-4ab2-bc16-f07dcbbe0377/action" status: 202 len: 0 microversion: 2.1 time: 0.508696 Oct 27 04:36:16.888849 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4072/7848] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 04:36:16 2022] POST /compute/v2.1/servers/7666781e-7ea5-4ab2-bc16-f07dcbbe0377/action => generated 0 bytes in 510 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 04:36:16.901981 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-9d657853-8c5d-47b9-8755-f3f2d278d5ec req-33e03014-2ca1-430d-a02e-eea95f8b893a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7666781e-7ea5-4ab2-bc16-f07dcbbe0377", "tag": "7bfb6043-2c61-40e2-a9c4-4b60b15be8d3"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:36:16.902202 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e7f1b8fd-fb85-4014-a6eb-5a645136e2d6 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:36:16.902730 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e7f1b8fd-fb85-4014-a6eb-5a645136e2d6 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 7666781e-7ea5-4ab2-bc16-f07dcbbe0377] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:36:16.913133 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-9d657853-8c5d-47b9-8755-f3f2d278d5ec req-33e03014-2ca1-430d-a02e-eea95f8b893a service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:36:16.913871 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-9d657853-8c5d-47b9-8755-f3f2d278d5ec req-33e03014-2ca1-430d-a02e-eea95f8b893a service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:36:16.914440 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-9d657853-8c5d-47b9-8755-f3f2d278d5ec req-33e03014-2ca1-430d-a02e-eea95f8b893a service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:36:16.922722 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e7f1b8fd-fb85-4014-a6eb-5a645136e2d6 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:36:16.926165 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e7f1b8fd-fb85-4014-a6eb-5a645136e2d6 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:36:16.926165 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e7f1b8fd-fb85-4014-a6eb-5a645136e2d6 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:36:16.926165 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e7f1b8fd-fb85-4014-a6eb-5a645136e2d6 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:36:16.926165 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e7f1b8fd-fb85-4014-a6eb-5a645136e2d6 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:36:16.926165 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e7f1b8fd-fb85-4014-a6eb-5a645136e2d6 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:36:16.927596 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-9d657853-8c5d-47b9-8755-f3f2d278d5ec req-33e03014-2ca1-430d-a02e-eea95f8b893a service nova] Creating event network-changed:7bfb6043-2c61-40e2-a9c4-4b60b15be8d3 for instance 7666781e-7ea5-4ab2-bc16-f07dcbbe0377 on n-h1-862769-1 Oct 27 04:36:16.932806 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-9d657853-8c5d-47b9-8755-f3f2d278d5ec req-33e03014-2ca1-430d-a02e-eea95f8b893a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034542 Oct 27 04:36:16.933944 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4073/7849] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:36:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 04:36:17.087629 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e7f1b8fd-fb85-4014-a6eb-5a645136e2d6 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81159cb7105b4f4e94527225ed45feeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e577cf747d5b4a12ba0ee81e686b8534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:36:17.096280 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e7f1b8fd-fb85-4014-a6eb-5a645136e2d6 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "GET /compute/v2.1/servers/7666781e-7ea5-4ab2-bc16-f07dcbbe0377" status: 200 len: 1757 microversion: 2.1 time: 0.202347 Oct 27 04:36:17.097104 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3777/7850] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:36:16 2022] GET /compute/v2.1/servers/7666781e-7ea5-4ab2-bc16-f07dcbbe0377 => generated 1757 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:37:53.286626 n-d-862769-1 devstack@n-api.service[121001]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 27 04:37:53.287136 n-d-862769-1 devstack@n-api.service[121001]: Thu Oct 27 04:37:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7666781e-7ea5-4ab2-bc16-f07dcbbe0377/action (ip 10.222.0.20) !!! Oct 27 04:37:53.288506 n-d-862769-1 devstack@n-api.service[121001]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 27 04:37:53.288635 n-d-862769-1 devstack@n-api.service[121001]: Thu Oct 27 04:37:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7666781e-7ea5-4ab2-bc16-f07dcbbe0377/action (ip 10.222.0.20) !!! Oct 27 04:37:53.289937 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=6 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:37:53.290751 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=12 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:37:53.305219 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e2e36bf3-0504-4008-93d0-e553ac3e9c60 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:37:53.307622 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e2e36bf3-0504-4008-93d0-e553ac3e9c60 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 7666781e-7ea5-4ab2-bc16-f07dcbbe0377] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:37:53.314880 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e2e36bf3-0504-4008-93d0-e553ac3e9c60 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:37:53.316042 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e2e36bf3-0504-4008-93d0-e553ac3e9c60 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:37:53.316507 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e2e36bf3-0504-4008-93d0-e553ac3e9c60 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:37:53.317234 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e2e36bf3-0504-4008-93d0-e553ac3e9c60 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:37:53.317746 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e2e36bf3-0504-4008-93d0-e553ac3e9c60 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:37:53.318235 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e2e36bf3-0504-4008-93d0-e553ac3e9c60 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:37:53.525252 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e2e36bf3-0504-4008-93d0-e553ac3e9c60 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "POST /compute/v2.1/servers/7666781e-7ea5-4ab2-bc16-f07dcbbe0377/action" status: 202 len: 0 microversion: 2.1 time: 0.242218 Oct 27 04:37:53.525954 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4074/7851] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 04:37:53 2022] POST /compute/v2.1/servers/7666781e-7ea5-4ab2-bc16-f07dcbbe0377/action => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 04:37:53.532215 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=4 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:37:53.532975 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=8 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:37:53.536929 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-daff8922-a112-49db-91ec-6a8b1ad204d5 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:37:53.537554 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-daff8922-a112-49db-91ec-6a8b1ad204d5 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 7666781e-7ea5-4ab2-bc16-f07dcbbe0377] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:37:53.543433 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-daff8922-a112-49db-91ec-6a8b1ad204d5 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:37:53.543929 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-daff8922-a112-49db-91ec-6a8b1ad204d5 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:37:53.544393 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-daff8922-a112-49db-91ec-6a8b1ad204d5 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:37:53.545104 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-daff8922-a112-49db-91ec-6a8b1ad204d5 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:37:53.545563 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-daff8922-a112-49db-91ec-6a8b1ad204d5 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:37:53.545997 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-daff8922-a112-49db-91ec-6a8b1ad204d5 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:37:53.699341 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-daff8922-a112-49db-91ec-6a8b1ad204d5 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81159cb7105b4f4e94527225ed45feeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e577cf747d5b4a12ba0ee81e686b8534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:37:53.707778 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-daff8922-a112-49db-91ec-6a8b1ad204d5 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "GET /compute/v2.1/servers/7666781e-7ea5-4ab2-bc16-f07dcbbe0377" status: 200 len: 1759 microversion: 2.1 time: 0.177540 Oct 27 04:37:53.708370 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3778/7852] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:37:53 2022] GET /compute/v2.1/servers/7666781e-7ea5-4ab2-bc16-f07dcbbe0377 => generated 1759 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:37:54.733518 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a99e3edc-4f3d-4936-abfd-75294741c7d5 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:37:54.734268 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a99e3edc-4f3d-4936-abfd-75294741c7d5 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 7666781e-7ea5-4ab2-bc16-f07dcbbe0377] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:37:54.740496 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a99e3edc-4f3d-4936-abfd-75294741c7d5 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:37:54.740994 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a99e3edc-4f3d-4936-abfd-75294741c7d5 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:37:54.741449 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a99e3edc-4f3d-4936-abfd-75294741c7d5 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:37:54.742190 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a99e3edc-4f3d-4936-abfd-75294741c7d5 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:37:54.742689 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a99e3edc-4f3d-4936-abfd-75294741c7d5 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:37:54.743136 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a99e3edc-4f3d-4936-abfd-75294741c7d5 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:37:54.892025 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a99e3edc-4f3d-4936-abfd-75294741c7d5 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81159cb7105b4f4e94527225ed45feeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e577cf747d5b4a12ba0ee81e686b8534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:37:54.900820 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a99e3edc-4f3d-4936-abfd-75294741c7d5 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "GET /compute/v2.1/servers/7666781e-7ea5-4ab2-bc16-f07dcbbe0377" status: 200 len: 1764 microversion: 2.1 time: 0.172476 Oct 27 04:37:54.901603 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4075/7853] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:37:54 2022] GET /compute/v2.1/servers/7666781e-7ea5-4ab2-bc16-f07dcbbe0377 => generated 1764 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:37:55.924367 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-747d93e8-0d2d-42af-aef9-0fde4de66943 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:37:55.925092 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-747d93e8-0d2d-42af-aef9-0fde4de66943 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 7666781e-7ea5-4ab2-bc16-f07dcbbe0377] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:37:55.927342 n-d-862769-1 devstack@n-api.service[121000]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 04:37:55.927482 n-d-862769-1 devstack@n-api.service[121000]: Thu Oct 27 04:37:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7666781e-7ea5-4ab2-bc16-f07dcbbe0377 (ip 10.222.0.20) !!! Oct 27 04:37:55.936623 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-747d93e8-0d2d-42af-aef9-0fde4de66943 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:37:55.937116 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-747d93e8-0d2d-42af-aef9-0fde4de66943 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:37:55.937557 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-747d93e8-0d2d-42af-aef9-0fde4de66943 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:37:55.938292 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-747d93e8-0d2d-42af-aef9-0fde4de66943 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:37:55.938759 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-747d93e8-0d2d-42af-aef9-0fde4de66943 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:37:55.939191 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-747d93e8-0d2d-42af-aef9-0fde4de66943 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:37:56.084377 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-747d93e8-0d2d-42af-aef9-0fde4de66943 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81159cb7105b4f4e94527225ed45feeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e577cf747d5b4a12ba0ee81e686b8534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:37:56.093355 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-747d93e8-0d2d-42af-aef9-0fde4de66943 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "GET /compute/v2.1/servers/7666781e-7ea5-4ab2-bc16-f07dcbbe0377" status: 200 len: 1757 microversion: 2.1 time: 0.172885 Oct 27 04:37:56.093934 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3779/7854] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:37:55 2022] GET /compute/v2.1/servers/7666781e-7ea5-4ab2-bc16-f07dcbbe0377 => generated 1757 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:39:09.900421 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=4 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:39:09.902340 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:39:09.905199 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-060b9d17-f7cd-485d-912f-837989679ce3 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1947194830"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:39:09.905759 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-060b9d17-f7cd-485d-912f-837989679ce3 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 7666781e-7ea5-4ab2-bc16-f07dcbbe0377] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:39:09.911662 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-060b9d17-f7cd-485d-912f-837989679ce3 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:39:09.912158 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-060b9d17-f7cd-485d-912f-837989679ce3 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:39:09.912611 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-060b9d17-f7cd-485d-912f-837989679ce3 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:39:09.913317 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-060b9d17-f7cd-485d-912f-837989679ce3 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:39:09.913791 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-060b9d17-f7cd-485d-912f-837989679ce3 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:39:09.914258 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-060b9d17-f7cd-485d-912f-837989679ce3 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:39:10.044589 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.network.security_group_api [None req-060b9d17-f7cd-485d-912f-837989679ce3 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Removing security group 5a2e93c0-c210-40da-a642-9fabe74ea1df from port 7bfb6043-2c61-40e2-a9c4-4b60b15be8d3 Oct 27 04:39:10.397780 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-060b9d17-f7cd-485d-912f-837989679ce3 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "POST /compute/v2.1/servers/7666781e-7ea5-4ab2-bc16-f07dcbbe0377/action" status: 202 len: 0 microversion: 2.1 time: 0.498873 Oct 27 04:39:10.398472 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4076/7855] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 04:39:09 2022] POST /compute/v2.1/servers/7666781e-7ea5-4ab2-bc16-f07dcbbe0377/action => generated 0 bytes in 501 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 04:39:10.405012 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=4 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:39:10.406255 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=12 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:39:10.482512 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-45f7f3d8-ce23-4f11-b7f4-fc307438f452 req-f38afc2e-3b91-483b-bc1e-c64e082ca309 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7666781e-7ea5-4ab2-bc16-f07dcbbe0377", "tag": "7bfb6043-2c61-40e2-a9c4-4b60b15be8d3"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:39:10.492954 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-45f7f3d8-ce23-4f11-b7f4-fc307438f452 req-f38afc2e-3b91-483b-bc1e-c64e082ca309 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:39:10.493789 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-45f7f3d8-ce23-4f11-b7f4-fc307438f452 req-f38afc2e-3b91-483b-bc1e-c64e082ca309 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:39:10.494392 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-45f7f3d8-ce23-4f11-b7f4-fc307438f452 req-f38afc2e-3b91-483b-bc1e-c64e082ca309 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:39:10.508878 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-45f7f3d8-ce23-4f11-b7f4-fc307438f452 req-f38afc2e-3b91-483b-bc1e-c64e082ca309 service nova] Creating event network-changed:7bfb6043-2c61-40e2-a9c4-4b60b15be8d3 for instance 7666781e-7ea5-4ab2-bc16-f07dcbbe0377 on n-h1-862769-1 Oct 27 04:39:10.512816 n-d-862769-1 devstack@n-api.service[121000]: ERROR oslo.messaging._drivers.impl_rabbit [req-45f7f3d8-ce23-4f11-b7f4-fc307438f452 req-f38afc2e-3b91-483b-bc1e-c64e082ca309 service nova] [7137b554-06af-4493-bab9-14bbb924f6cb] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 27 04:39:11.521268 n-d-862769-1 devstack@n-api.service[121000]: INFO oslo.messaging._drivers.impl_rabbit [req-45f7f3d8-ce23-4f11-b7f4-fc307438f452 req-f38afc2e-3b91-483b-bc1e-c64e082ca309 service nova] [7137b554-06af-4493-bab9-14bbb924f6cb] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 57904. Oct 27 04:39:11.525169 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-45f7f3d8-ce23-4f11-b7f4-fc307438f452 req-f38afc2e-3b91-483b-bc1e-c64e082ca309 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.122046 Oct 27 04:39:11.525800 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3780/7856] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:39:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:39:11.656096 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6512ee38-7551-4663-b2c0-4e9311ab4ce1 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:39:11.656980 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6512ee38-7551-4663-b2c0-4e9311ab4ce1 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 7666781e-7ea5-4ab2-bc16-f07dcbbe0377] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:39:11.665617 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6512ee38-7551-4663-b2c0-4e9311ab4ce1 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:39:11.666274 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6512ee38-7551-4663-b2c0-4e9311ab4ce1 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:39:11.666980 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6512ee38-7551-4663-b2c0-4e9311ab4ce1 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:39:11.667806 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6512ee38-7551-4663-b2c0-4e9311ab4ce1 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:39:11.668410 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6512ee38-7551-4663-b2c0-4e9311ab4ce1 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:39:11.668947 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6512ee38-7551-4663-b2c0-4e9311ab4ce1 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:39:11.682104 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-737e9855-b154-4268-838f-ac82507a4400 req-e67e4c05-cd6d-4d9b-99f0-8d86a1b70f74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7666781e-7ea5-4ab2-bc16-f07dcbbe0377", "tag": "7bfb6043-2c61-40e2-a9c4-4b60b15be8d3"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:39:11.692623 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-737e9855-b154-4268-838f-ac82507a4400 req-e67e4c05-cd6d-4d9b-99f0-8d86a1b70f74 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:39:11.693404 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-737e9855-b154-4268-838f-ac82507a4400 req-e67e4c05-cd6d-4d9b-99f0-8d86a1b70f74 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:39:11.694201 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-737e9855-b154-4268-838f-ac82507a4400 req-e67e4c05-cd6d-4d9b-99f0-8d86a1b70f74 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:39:11.717707 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-737e9855-b154-4268-838f-ac82507a4400 req-e67e4c05-cd6d-4d9b-99f0-8d86a1b70f74 service nova] Creating event network-changed:7bfb6043-2c61-40e2-a9c4-4b60b15be8d3 for instance 7666781e-7ea5-4ab2-bc16-f07dcbbe0377 on n-h1-862769-1 Oct 27 04:39:11.724803 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-737e9855-b154-4268-838f-ac82507a4400 req-e67e4c05-cd6d-4d9b-99f0-8d86a1b70f74 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126734 Oct 27 04:39:11.728684 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4077/7857] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:39:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 04:39:11.767725 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-6512ee38-7551-4663-b2c0-4e9311ab4ce1 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lazy-loading 'services' on Instance uuid 7666781e-7ea5-4ab2-bc16-f07dcbbe0377 {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 04:39:11.982184 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6512ee38-7551-4663-b2c0-4e9311ab4ce1 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7666781e-7ea5-4ab2-bc16-f07dcbbe0377/os-volume_attachments/5259cda8-f01c-4953-ad9a-965f4ff5ac3f" status: 202 len: 0 microversion: 2.1 time: 0.327119 Oct 27 04:39:11.982184 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3781/7858] 10.222.0.20 () {58 vars in 1416 bytes} [Thu Oct 27 04:39:11 2022] DELETE /compute/v2.1/servers/7666781e-7ea5-4ab2-bc16-f07dcbbe0377/os-volume_attachments/5259cda8-f01c-4953-ad9a-965f4ff5ac3f => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 04:39:11.988813 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-db5ec8b4-3d46-4d96-90fb-672abcaef32e tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:39:11.991878 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-db5ec8b4-3d46-4d96-90fb-672abcaef32e tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 7666781e-7ea5-4ab2-bc16-f07dcbbe0377] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:39:11.998323 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-db5ec8b4-3d46-4d96-90fb-672abcaef32e tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:39:11.999078 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-db5ec8b4-3d46-4d96-90fb-672abcaef32e tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:39:11.999741 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-db5ec8b4-3d46-4d96-90fb-672abcaef32e tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:39:12.000671 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-db5ec8b4-3d46-4d96-90fb-672abcaef32e tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:39:12.001151 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-db5ec8b4-3d46-4d96-90fb-672abcaef32e tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:39:12.001788 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-db5ec8b4-3d46-4d96-90fb-672abcaef32e tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:39:12.033363 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-db5ec8b4-3d46-4d96-90fb-672abcaef32e tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "GET /compute/v2.1/servers/7666781e-7ea5-4ab2-bc16-f07dcbbe0377/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049017 Oct 27 04:39:12.034308 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4078/7859] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 27 04:39:11 2022] GET /compute/v2.1/servers/7666781e-7ea5-4ab2-bc16-f07dcbbe0377/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:39:13.048678 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-93e17677-0331-4c7a-b1ab-bb054d3341bc tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:39:13.051432 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-93e17677-0331-4c7a-b1ab-bb054d3341bc tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 7666781e-7ea5-4ab2-bc16-f07dcbbe0377] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:39:13.061113 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-93e17677-0331-4c7a-b1ab-bb054d3341bc tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:39:13.061608 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-93e17677-0331-4c7a-b1ab-bb054d3341bc tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:39:13.062058 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-93e17677-0331-4c7a-b1ab-bb054d3341bc tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:39:13.062879 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-93e17677-0331-4c7a-b1ab-bb054d3341bc tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:39:13.063340 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-93e17677-0331-4c7a-b1ab-bb054d3341bc tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:39:13.063819 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-93e17677-0331-4c7a-b1ab-bb054d3341bc tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:39:13.096447 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-93e17677-0331-4c7a-b1ab-bb054d3341bc tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "GET /compute/v2.1/servers/7666781e-7ea5-4ab2-bc16-f07dcbbe0377/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052732 Oct 27 04:39:13.097014 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3782/7860] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 27 04:39:13 2022] GET /compute/v2.1/servers/7666781e-7ea5-4ab2-bc16-f07dcbbe0377/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:39:14.110498 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-fa4d1ed9-a0a6-456f-a774-54a0a7d5b2b3 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:39:14.113901 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-fa4d1ed9-a0a6-456f-a774-54a0a7d5b2b3 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 7666781e-7ea5-4ab2-bc16-f07dcbbe0377] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:39:14.120583 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fa4d1ed9-a0a6-456f-a774-54a0a7d5b2b3 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:39:14.121095 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fa4d1ed9-a0a6-456f-a774-54a0a7d5b2b3 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:39:14.121563 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fa4d1ed9-a0a6-456f-a774-54a0a7d5b2b3 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:39:14.122383 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fa4d1ed9-a0a6-456f-a774-54a0a7d5b2b3 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:39:14.122867 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fa4d1ed9-a0a6-456f-a774-54a0a7d5b2b3 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:39:14.123327 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fa4d1ed9-a0a6-456f-a774-54a0a7d5b2b3 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:39:14.154876 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-fa4d1ed9-a0a6-456f-a774-54a0a7d5b2b3 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "GET /compute/v2.1/servers/7666781e-7ea5-4ab2-bc16-f07dcbbe0377/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049592 Oct 27 04:39:14.155487 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4079/7861] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 27 04:39:14 2022] GET /compute/v2.1/servers/7666781e-7ea5-4ab2-bc16-f07dcbbe0377/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:39:15.167759 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b1b064fe-fcbf-45a0-9185-11fc3310b492 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:39:15.170177 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b1b064fe-fcbf-45a0-9185-11fc3310b492 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 7666781e-7ea5-4ab2-bc16-f07dcbbe0377] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:39:15.177708 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b1b064fe-fcbf-45a0-9185-11fc3310b492 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:39:15.178266 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b1b064fe-fcbf-45a0-9185-11fc3310b492 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:39:15.178711 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b1b064fe-fcbf-45a0-9185-11fc3310b492 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:39:15.179430 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b1b064fe-fcbf-45a0-9185-11fc3310b492 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:39:15.179893 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b1b064fe-fcbf-45a0-9185-11fc3310b492 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:39:15.181213 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b1b064fe-fcbf-45a0-9185-11fc3310b492 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:39:15.217142 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b1b064fe-fcbf-45a0-9185-11fc3310b492 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "GET /compute/v2.1/servers/7666781e-7ea5-4ab2-bc16-f07dcbbe0377/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053444 Oct 27 04:39:15.217983 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3783/7862] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 27 04:39:15 2022] GET /compute/v2.1/servers/7666781e-7ea5-4ab2-bc16-f07dcbbe0377/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:39:16.229419 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-445b8c27-087f-4c4e-aad0-2839e53e43a2 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:39:16.231697 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-445b8c27-087f-4c4e-aad0-2839e53e43a2 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 7666781e-7ea5-4ab2-bc16-f07dcbbe0377] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:39:16.238699 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-445b8c27-087f-4c4e-aad0-2839e53e43a2 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:39:16.239204 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-445b8c27-087f-4c4e-aad0-2839e53e43a2 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:39:16.239660 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-445b8c27-087f-4c4e-aad0-2839e53e43a2 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:39:16.240376 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-445b8c27-087f-4c4e-aad0-2839e53e43a2 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:39:16.240845 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-445b8c27-087f-4c4e-aad0-2839e53e43a2 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:39:16.241288 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-445b8c27-087f-4c4e-aad0-2839e53e43a2 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:39:16.272984 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-445b8c27-087f-4c4e-aad0-2839e53e43a2 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "GET /compute/v2.1/servers/7666781e-7ea5-4ab2-bc16-f07dcbbe0377/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047879 Oct 27 04:39:16.273770 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4080/7863] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 27 04:39:16 2022] GET /compute/v2.1/servers/7666781e-7ea5-4ab2-bc16-f07dcbbe0377/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:39:17.284958 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-fff64039-027f-42e4-a343-bb8283edc707 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:39:17.287173 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-fff64039-027f-42e4-a343-bb8283edc707 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 7666781e-7ea5-4ab2-bc16-f07dcbbe0377] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:39:17.294118 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fff64039-027f-42e4-a343-bb8283edc707 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:39:17.294556 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fff64039-027f-42e4-a343-bb8283edc707 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:39:17.295002 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fff64039-027f-42e4-a343-bb8283edc707 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:39:17.295702 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fff64039-027f-42e4-a343-bb8283edc707 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:39:17.296162 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fff64039-027f-42e4-a343-bb8283edc707 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:39:17.296595 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fff64039-027f-42e4-a343-bb8283edc707 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:39:17.325636 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-fff64039-027f-42e4-a343-bb8283edc707 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "GET /compute/v2.1/servers/7666781e-7ea5-4ab2-bc16-f07dcbbe0377/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044701 Oct 27 04:39:17.326238 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3784/7864] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 27 04:39:17 2022] GET /compute/v2.1/servers/7666781e-7ea5-4ab2-bc16-f07dcbbe0377/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 04:39:17.336807 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5303da8c-f5ae-496c-8544-c5ab3a88a3f6 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:39:17.337330 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5303da8c-f5ae-496c-8544-c5ab3a88a3f6 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 7666781e-7ea5-4ab2-bc16-f07dcbbe0377] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:39:17.344077 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5303da8c-f5ae-496c-8544-c5ab3a88a3f6 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:39:17.344604 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5303da8c-f5ae-496c-8544-c5ab3a88a3f6 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:39:17.345058 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5303da8c-f5ae-496c-8544-c5ab3a88a3f6 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:39:17.345767 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5303da8c-f5ae-496c-8544-c5ab3a88a3f6 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:39:17.346278 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5303da8c-f5ae-496c-8544-c5ab3a88a3f6 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:39:17.346707 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5303da8c-f5ae-496c-8544-c5ab3a88a3f6 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:39:17.421545 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-5303da8c-f5ae-496c-8544-c5ab3a88a3f6 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] HTTP exception thrown: Instance 7666781e-7ea5-4ab2-bc16-f07dcbbe0377 is not attached to volume 5259cda8-f01c-4953-ad9a-965f4ff5ac3f Oct 27 04:39:17.423546 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5303da8c-f5ae-496c-8544-c5ab3a88a3f6 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Request method failure captured: Oct 27 04:39:17.423546 n-d-862769-1 devstack@n-api.service[121001]: request: DELETE /compute/v2.1/servers/7666781e-7ea5-4ab2-bc16-f07dcbbe0377/os-volume_attachments/5259cda8-f01c-4953-ad9a-965f4ff5ac3f HTTP/1.1 Oct 27 04:39:17.423546 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 04:39:17.423546 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 04:39:17.423546 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 04:39:17.423546 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 04:39:17.423546 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 04:39:17.423546 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 04:39:17.423546 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 04:39:17.423546 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 04:39:17.423546 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWgqCjQti08nR_2DR-dKVByhZGc9gh2B366WyLh9m_mIgx7KdUEg9zAEwBefXhiK40E84K798KXKXJcbwmeRhvLYN8J-j92vsp6XLaHfkvuYKf-CCqgegejdAlMWxOnoc9lydGVQC56J51KFSndLAVSoEu28Yo9C7x99-dOeM7kXLInk Oct 27 04:39:17.423546 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 04:39:17.423546 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 04:39:17.423546 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 04:39:17.423546 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 04:39:17.423546 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 04:39:17.423546 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 04:39:17.423546 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: e577cf747d5b4a12ba0ee81e686b8534 Oct 27 04:39:17.423546 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-TestMinimumBasicScenario-2056425032 Oct 27 04:39:17.423546 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 04:39:17.423546 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 04:39:17.423546 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e577cf747d5b4a12ba0ee81e686b8534"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e577cf747d5b4a12ba0ee81e686b8534"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e577cf747d5b4a12ba0ee81e686b8534"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e577cf747d5b4a12ba0ee81e686b8534"}]}] Oct 27 04:39:17.423546 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-TestMinimumBasicScenario-2056425032 Oct 27 04:39:17.423546 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: e577cf747d5b4a12ba0ee81e686b8534 Oct 27 04:39:17.423546 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2056425032 Oct 27 04:39:17.423546 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-TestMinimumBasicScenario-2056425032-project Oct 27 04:39:17.423546 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 04:39:17.423546 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 04:39:17.423546 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 81159cb7105b4f4e94527225ed45feeb Oct 27 04:39:17.423546 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-TestMinimumBasicScenario-2056425032-project Oct 27 04:39:17.423546 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 04:39:17.423546 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 7666781e-7ea5-4ab2-bc16-f07dcbbe0377 is not attached to volume 5259cda8-f01c-4953-ad9a-965f4ff5ac3f Oct 27 04:39:17.423546 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'server_id': '7666781e-7ea5-4ab2-bc16-f07dcbbe0377', 'id': '5259cda8-f01c-4953-ad9a-965f4ff5ac3f'} Oct 27 04:39:17.423546 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 04:39:17.423546 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:39:17.423546 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 27 04:39:17.423546 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 27 04:39:17.423546 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 04:39:17.423546 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 04:39:17.423546 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 27 04:39:17.423546 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 27 04:39:17.423546 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 5259cda8-f01c-4953-ad9a-965f4ff5ac3f. Oct 27 04:39:17.423546 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:39:17.423546 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:39:17.423546 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:39:17.423546 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:39:17.423546 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:39:17.423546 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:39:17.423546 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 04:39:17.423546 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 04:39:17.423546 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 04:39:17.423546 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 04:39:17.423546 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 27 04:39:17.423546 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 27 04:39:17.423546 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7666781e-7ea5-4ab2-bc16-f07dcbbe0377 is not attached to volume 5259cda8-f01c-4953-ad9a-965f4ff5ac3f Oct 27 04:39:17.423546 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:39:17.423546 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:39:17.423546 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:39:17.423546 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:39:17.423546 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:39:17.423546 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:39:17.429066 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 04:39:17.429066 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 04:39:17.429066 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7666781e-7ea5-4ab2-bc16-f07dcbbe0377 is not attached to volume 5259cda8-f01c-4953-ad9a-965f4ff5ac3f Oct 27 04:39:17.429066 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:39:17.429066 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5303da8c-f5ae-496c-8544-c5ab3a88a3f6 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Returning 404 to user: Instance 7666781e-7ea5-4ab2-bc16-f07dcbbe0377 is not attached to volume 5259cda8-f01c-4953-ad9a-965f4ff5ac3f {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 04:39:17.429066 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5303da8c-f5ae-496c-8544-c5ab3a88a3f6 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7666781e-7ea5-4ab2-bc16-f07dcbbe0377/os-volume_attachments/5259cda8-f01c-4953-ad9a-965f4ff5ac3f" status: 404 len: 154 microversion: 2.1 time: 0.092302 Oct 27 04:39:17.429066 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4081/7865] 10.222.0.20 () {58 vars in 1416 bytes} [Thu Oct 27 04:39:17 2022] DELETE /compute/v2.1/servers/7666781e-7ea5-4ab2-bc16-f07dcbbe0377/os-volume_attachments/5259cda8-f01c-4953-ad9a-965f4ff5ac3f => generated 154 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 04:39:20.945159 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-63a38f4e-2273-4b97-b8a8-ec0852121785 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:39:20.945668 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-63a38f4e-2273-4b97-b8a8-ec0852121785 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 7666781e-7ea5-4ab2-bc16-f07dcbbe0377] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:39:20.952707 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-63a38f4e-2273-4b97-b8a8-ec0852121785 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:39:20.953201 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-63a38f4e-2273-4b97-b8a8-ec0852121785 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:39:20.953649 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-63a38f4e-2273-4b97-b8a8-ec0852121785 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:39:20.954396 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-63a38f4e-2273-4b97-b8a8-ec0852121785 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:39:20.954858 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-63a38f4e-2273-4b97-b8a8-ec0852121785 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:39:20.955290 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-63a38f4e-2273-4b97-b8a8-ec0852121785 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:39:20.981763 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-63a38f4e-2273-4b97-b8a8-ec0852121785 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 7666781e-7ea5-4ab2-bc16-f07dcbbe0377] Going to try to terminate instance {{(pid=121000) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 04:39:21.244658 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-63a38f4e-2273-4b97-b8a8-ec0852121785 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7666781e-7ea5-4ab2-bc16-f07dcbbe0377" status: 204 len: 0 microversion: 2.1 time: 0.303046 Oct 27 04:39:21.245271 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3785/7866] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 04:39:20 2022] DELETE /compute/v2.1/servers/7666781e-7ea5-4ab2-bc16-f07dcbbe0377 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 04:39:21.253866 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6d2e4f4c-eb2e-46fc-a713-f5d9c885944e tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:39:21.255161 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-6d2e4f4c-eb2e-46fc-a713-f5d9c885944e tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 7666781e-7ea5-4ab2-bc16-f07dcbbe0377] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:39:21.266200 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6d2e4f4c-eb2e-46fc-a713-f5d9c885944e tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:39:21.266717 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6d2e4f4c-eb2e-46fc-a713-f5d9c885944e tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:39:21.267332 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6d2e4f4c-eb2e-46fc-a713-f5d9c885944e tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:39:21.268062 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6d2e4f4c-eb2e-46fc-a713-f5d9c885944e tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:39:21.268534 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6d2e4f4c-eb2e-46fc-a713-f5d9c885944e tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:39:21.269437 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6d2e4f4c-eb2e-46fc-a713-f5d9c885944e tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:39:21.401257 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6d2e4f4c-eb2e-46fc-a713-f5d9c885944e tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81159cb7105b4f4e94527225ed45feeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e577cf747d5b4a12ba0ee81e686b8534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:39:21.409221 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6d2e4f4c-eb2e-46fc-a713-f5d9c885944e tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "GET /compute/v2.1/servers/7666781e-7ea5-4ab2-bc16-f07dcbbe0377" status: 200 len: 1552 microversion: 2.1 time: 0.159585 Oct 27 04:39:21.409791 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4082/7867] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:39:21 2022] GET /compute/v2.1/servers/7666781e-7ea5-4ab2-bc16-f07dcbbe0377 => generated 1552 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:39:22.433944 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9c0afe45-f589-4cae-8349-0c4796fbc925 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:39:22.434683 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9c0afe45-f589-4cae-8349-0c4796fbc925 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 7666781e-7ea5-4ab2-bc16-f07dcbbe0377] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:39:22.441427 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9c0afe45-f589-4cae-8349-0c4796fbc925 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:39:22.441858 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9c0afe45-f589-4cae-8349-0c4796fbc925 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:39:22.442334 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9c0afe45-f589-4cae-8349-0c4796fbc925 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:39:22.443030 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9c0afe45-f589-4cae-8349-0c4796fbc925 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:39:22.443488 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9c0afe45-f589-4cae-8349-0c4796fbc925 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:39:22.443916 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9c0afe45-f589-4cae-8349-0c4796fbc925 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:39:22.574447 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9c0afe45-f589-4cae-8349-0c4796fbc925 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81159cb7105b4f4e94527225ed45feeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e577cf747d5b4a12ba0ee81e686b8534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:39:22.582003 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9c0afe45-f589-4cae-8349-0c4796fbc925 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "GET /compute/v2.1/servers/7666781e-7ea5-4ab2-bc16-f07dcbbe0377" status: 200 len: 1552 microversion: 2.1 time: 0.152326 Oct 27 04:39:22.582600 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3786/7868] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:39:22 2022] GET /compute/v2.1/servers/7666781e-7ea5-4ab2-bc16-f07dcbbe0377 => generated 1552 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:39:23.603108 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-0f6610b0-e6e9-49df-b522-21dcbb3f2cf9 req-f1d5ee50-6163-4dea-bcfa-711c792f7222 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7666781e-7ea5-4ab2-bc16-f07dcbbe0377", "name": "network-vif-deleted", "tag": "7bfb6043-2c61-40e2-a9c4-4b60b15be8d3"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:39:23.606636 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-11c1ef7f-4ff8-47f8-abac-d86416e1f19b tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:39:23.607270 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-11c1ef7f-4ff8-47f8-abac-d86416e1f19b tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 7666781e-7ea5-4ab2-bc16-f07dcbbe0377] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:39:23.613489 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-0f6610b0-e6e9-49df-b522-21dcbb3f2cf9 req-f1d5ee50-6163-4dea-bcfa-711c792f7222 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:39:23.613994 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-0f6610b0-e6e9-49df-b522-21dcbb3f2cf9 req-f1d5ee50-6163-4dea-bcfa-711c792f7222 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:39:23.614982 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-11c1ef7f-4ff8-47f8-abac-d86416e1f19b tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:39:23.615123 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-0f6610b0-e6e9-49df-b522-21dcbb3f2cf9 req-f1d5ee50-6163-4dea-bcfa-711c792f7222 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:39:23.615516 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-11c1ef7f-4ff8-47f8-abac-d86416e1f19b tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:39:23.615955 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-11c1ef7f-4ff8-47f8-abac-d86416e1f19b tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:39:23.616662 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-11c1ef7f-4ff8-47f8-abac-d86416e1f19b tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:39:23.617123 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-11c1ef7f-4ff8-47f8-abac-d86416e1f19b tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:39:23.617639 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-11c1ef7f-4ff8-47f8-abac-d86416e1f19b tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:39:23.629285 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-0f6610b0-e6e9-49df-b522-21dcbb3f2cf9 req-f1d5ee50-6163-4dea-bcfa-711c792f7222 service nova] Creating event network-vif-deleted:7bfb6043-2c61-40e2-a9c4-4b60b15be8d3 for instance 7666781e-7ea5-4ab2-bc16-f07dcbbe0377 on n-h1-862769-1 Oct 27 04:39:23.634960 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-0f6610b0-e6e9-49df-b522-21dcbb3f2cf9 req-f1d5ee50-6163-4dea-bcfa-711c792f7222 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036458 Oct 27 04:39:23.635586 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4083/7869] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:39:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:39:23.684189 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-11c1ef7f-4ff8-47f8-abac-d86416e1f19b tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81159cb7105b4f4e94527225ed45feeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e577cf747d5b4a12ba0ee81e686b8534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:39:23.691942 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-11c1ef7f-4ff8-47f8-abac-d86416e1f19b tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "GET /compute/v2.1/servers/7666781e-7ea5-4ab2-bc16-f07dcbbe0377" status: 200 len: 1510 microversion: 2.1 time: 0.089959 Oct 27 04:39:23.692559 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3787/7870] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:39:23 2022] GET /compute/v2.1/servers/7666781e-7ea5-4ab2-bc16-f07dcbbe0377 => generated 1510 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 04:39:24.716485 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a1a92503-4f9f-499d-a7e0-6901b82988a7 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:39:24.717245 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a1a92503-4f9f-499d-a7e0-6901b82988a7 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 7666781e-7ea5-4ab2-bc16-f07dcbbe0377] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:39:24.723492 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a1a92503-4f9f-499d-a7e0-6901b82988a7 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:39:24.724050 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a1a92503-4f9f-499d-a7e0-6901b82988a7 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:39:24.724457 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a1a92503-4f9f-499d-a7e0-6901b82988a7 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:39:24.725169 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a1a92503-4f9f-499d-a7e0-6901b82988a7 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:39:24.725642 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a1a92503-4f9f-499d-a7e0-6901b82988a7 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:39:24.726118 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a1a92503-4f9f-499d-a7e0-6901b82988a7 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:39:24.740290 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-a1a92503-4f9f-499d-a7e0-6901b82988a7 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] HTTP exception thrown: Instance 7666781e-7ea5-4ab2-bc16-f07dcbbe0377 could not be found. Oct 27 04:39:24.741997 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a1a92503-4f9f-499d-a7e0-6901b82988a7 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Request method failure captured: Oct 27 04:39:24.741997 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/7666781e-7ea5-4ab2-bc16-f07dcbbe0377 HTTP/1.1 Oct 27 04:39:24.741997 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 04:39:24.741997 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 04:39:24.741997 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 04:39:24.741997 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 04:39:24.741997 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 04:39:24.741997 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 04:39:24.741997 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 04:39:24.741997 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 04:39:24.741997 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWgqCjQti08nR_2DR-dKVByhZGc9gh2B366WyLh9m_mIgx7KdUEg9zAEwBefXhiK40E84K798KXKXJcbwmeRhvLYN8J-j92vsp6XLaHfkvuYKf-CCqgegejdAlMWxOnoc9lydGVQC56J51KFSndLAVSoEu28Yo9C7x99-dOeM7kXLInk Oct 27 04:39:24.741997 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 04:39:24.741997 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 04:39:24.741997 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 04:39:24.741997 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 04:39:24.741997 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 04:39:24.741997 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 04:39:24.741997 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: e577cf747d5b4a12ba0ee81e686b8534 Oct 27 04:39:24.741997 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-TestMinimumBasicScenario-2056425032 Oct 27 04:39:24.741997 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 04:39:24.741997 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 04:39:24.741997 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e577cf747d5b4a12ba0ee81e686b8534"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e577cf747d5b4a12ba0ee81e686b8534"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e577cf747d5b4a12ba0ee81e686b8534"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e577cf747d5b4a12ba0ee81e686b8534"}]}] Oct 27 04:39:24.741997 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-TestMinimumBasicScenario-2056425032 Oct 27 04:39:24.741997 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: e577cf747d5b4a12ba0ee81e686b8534 Oct 27 04:39:24.741997 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2056425032 Oct 27 04:39:24.741997 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-TestMinimumBasicScenario-2056425032-project Oct 27 04:39:24.741997 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 04:39:24.741997 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 04:39:24.741997 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 81159cb7105b4f4e94527225ed45feeb Oct 27 04:39:24.741997 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-TestMinimumBasicScenario-2056425032-project Oct 27 04:39:24.741997 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 04:39:24.741997 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 7666781e-7ea5-4ab2-bc16-f07dcbbe0377 could not be found. Oct 27 04:39:24.741997 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '7666781e-7ea5-4ab2-bc16-f07dcbbe0377'} Oct 27 04:39:24.741997 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 04:39:24.741997 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:39:24.741997 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 04:39:24.741997 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 04:39:24.741997 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 04:39:24.741997 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 04:39:24.741997 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 04:39:24.741997 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 04:39:24.741997 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 04:39:24.741997 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 04:39:24.741997 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7666781e-7ea5-4ab2-bc16-f07dcbbe0377 could not be found. Oct 27 04:39:24.741997 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:39:24.741997 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:39:24.741997 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:39:24.741997 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:39:24.741997 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:39:24.741997 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:39:24.741997 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 04:39:24.741997 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 04:39:24.741997 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 04:39:24.741997 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 04:39:24.741997 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 04:39:24.741997 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 04:39:24.741997 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 04:39:24.741997 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 04:39:24.741997 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 04:39:24.741997 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 04:39:24.741997 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7666781e-7ea5-4ab2-bc16-f07dcbbe0377 could not be found. Oct 27 04:39:24.741997 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:39:24.741997 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:39:24.741997 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:39:24.746747 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:39:24.746747 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:39:24.746747 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:39:24.746747 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 04:39:24.746747 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 04:39:24.746747 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7666781e-7ea5-4ab2-bc16-f07dcbbe0377 could not be found. Oct 27 04:39:24.746747 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:39:24.746747 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a1a92503-4f9f-499d-a7e0-6901b82988a7 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Returning 404 to user: Instance 7666781e-7ea5-4ab2-bc16-f07dcbbe0377 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 04:39:24.746747 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a1a92503-4f9f-499d-a7e0-6901b82988a7 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "GET /compute/v2.1/servers/7666781e-7ea5-4ab2-bc16-f07dcbbe0377" status: 404 len: 111 microversion: 2.1 time: 0.032262 Oct 27 04:39:24.746747 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4084/7871] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:39:24 2022] GET /compute/v2.1/servers/7666781e-7ea5-4ab2-bc16-f07dcbbe0377 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 04:39:24.752943 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f38d41b6-7a30-40cf-9d34-d14671cea2c4 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Calling method '.version_select at 0x7f7dd9c4fee0>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:39:24.842320 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f38d41b6-7a30-40cf-9d34-d14671cea2c4 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-233251621" status: 202 len: 0 microversion: 2.1 time: 0.093108 Oct 27 04:39:24.842923 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3788/7872] 10.222.0.20 () {58 vars in 1269 bytes} [Thu Oct 27 04:39:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-233251621 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 04:39:35.721635 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-10df3183-3ae1-4407-a9ad-656a8329d1c2 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Action: 'create', calling method: .version_select at 0x7f7ddb419c10>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1013895728", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI2aTi6ilu5blNUStpivrxFbPi08LboRuQ4QZx7P3bJokzrcM8tEcP0XKn9EsOb+RExLdYZxruSTOS81Q8dyFjCXc/kW4lKBEVGeWTF0NS/jpM9IS+3Or+4QhsZ7QrtZEA=="}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:39:35.728519 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=18 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:39:35.729237 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=40 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:39:35.739818 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-10df3183-3ae1-4407-a9ad-656a8329d1c2 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Getting quotas for project e577cf747d5b4a12ba0ee81e686b8534. Resources: {'key_pairs'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 04:39:35.746169 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-10df3183-3ae1-4407-a9ad-656a8329d1c2 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Getting quotas for user 81159cb7105b4f4e94527225ed45feeb and project e577cf747d5b4a12ba0ee81e686b8534. Resources: {'key_pairs'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 04:39:35.871018 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-10df3183-3ae1-4407-a9ad-656a8329d1c2 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.153163 Oct 27 04:39:35.871560 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4085/7873] 10.222.0.20 () {60 vars in 1159 bytes} [Thu Oct 27 04:39:35 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:39:35.920316 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:39:35.921069 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:39:35.925841 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f75f4ad8-0d7e-4680-b6ba-43b185c6e6a3 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-64790985", "imageRef": "2276cd75-26ff-4690-8884-0487058c5092", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1013895728", "networks": [{"uuid": "4e172054-91aa-4379-b6cb-5f79a555d9a7"}]}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:39:35.934851 n-d-862769-1 devstack@n-api.service[121000]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 04:39:35.934984 n-d-862769-1 devstack@n-api.service[121000]: Thu Oct 27 04:39:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.20) !!! Oct 27 04:39:35.980979 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-f75f4ad8-0d7e-4680-b6ba-43b185c6e6a3 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] validate_networks() for [('4e172054-91aa-4379-b6cb-5f79a555d9a7', None, None, None, None, None)] {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 04:39:36.395028 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-f75f4ad8-0d7e-4680-b6ba-43b185c6e6a3 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 04:39:36.395456 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-f75f4ad8-0d7e-4680-b6ba-43b185c6e6a3 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 04:39:36.395935 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-f75f4ad8-0d7e-4680-b6ba-43b185c6e6a3 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 04:39:36.396345 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-f75f4ad8-0d7e-4680-b6ba-43b185c6e6a3 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 04:39:36.396763 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-f75f4ad8-0d7e-4680-b6ba-43b185c6e6a3 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 04:39:36.405672 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f75f4ad8-0d7e-4680-b6ba-43b185c6e6a3 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:39:36.406198 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f75f4ad8-0d7e-4680-b6ba-43b185c6e6a3 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:39:36.406641 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f75f4ad8-0d7e-4680-b6ba-43b185c6e6a3 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:39:36.407367 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f75f4ad8-0d7e-4680-b6ba-43b185c6e6a3 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:39:36.407823 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f75f4ad8-0d7e-4680-b6ba-43b185c6e6a3 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:39:36.408253 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f75f4ad8-0d7e-4680-b6ba-43b185c6e6a3 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:39:36.424936 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-f75f4ad8-0d7e-4680-b6ba-43b185c6e6a3 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Getting quotas for project e577cf747d5b4a12ba0ee81e686b8534. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 04:39:36.430744 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-f75f4ad8-0d7e-4680-b6ba-43b185c6e6a3 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Getting quotas for user 81159cb7105b4f4e94527225ed45feeb and project e577cf747d5b4a12ba0ee81e686b8534. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 04:39:36.442716 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f75f4ad8-0d7e-4680-b6ba-43b185c6e6a3 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 04:39:36.444909 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f75f4ad8-0d7e-4680-b6ba-43b185c6e6a3 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 39df2a30-b7e4-4a1d-add4-2e750de7ca33] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2276cd75-26ff-4690-8884-0487058c5092',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 04:39:36.581068 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f75f4ad8-0d7e-4680-b6ba-43b185c6e6a3 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.662578 Oct 27 04:39:36.581820 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3789/7874] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 04:39:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 664 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 04:39:36.593205 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-dff0d4a8-912f-44b2-b836-d5cd27a3c1f1 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:39:36.593979 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-dff0d4a8-912f-44b2-b836-d5cd27a3c1f1 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 39df2a30-b7e4-4a1d-add4-2e750de7ca33] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:39:36.654557 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-dff0d4a8-912f-44b2-b836-d5cd27a3c1f1 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81159cb7105b4f4e94527225ed45feeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e577cf747d5b4a12ba0ee81e686b8534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:39:36.662370 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-dff0d4a8-912f-44b2-b836-d5cd27a3c1f1 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "GET /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33" status: 200 len: 1257 microversion: 2.1 time: 0.072671 Oct 27 04:39:36.663093 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4086/7875] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:39:36 2022] GET /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33 => generated 1257 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:39:37.685688 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f7ccfe29-6bfa-4af0-a6e1-1a82365e234b tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:39:37.686351 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f7ccfe29-6bfa-4af0-a6e1-1a82365e234b tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 39df2a30-b7e4-4a1d-add4-2e750de7ca33] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:39:37.696438 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f7ccfe29-6bfa-4af0-a6e1-1a82365e234b tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:39:37.696934 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f7ccfe29-6bfa-4af0-a6e1-1a82365e234b tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:39:37.697378 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f7ccfe29-6bfa-4af0-a6e1-1a82365e234b tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:39:37.698117 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f7ccfe29-6bfa-4af0-a6e1-1a82365e234b tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:39:37.698577 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f7ccfe29-6bfa-4af0-a6e1-1a82365e234b tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:39:37.699005 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f7ccfe29-6bfa-4af0-a6e1-1a82365e234b tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:39:37.760031 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f7ccfe29-6bfa-4af0-a6e1-1a82365e234b tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81159cb7105b4f4e94527225ed45feeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e577cf747d5b4a12ba0ee81e686b8534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:39:37.768658 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f7ccfe29-6bfa-4af0-a6e1-1a82365e234b tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "GET /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33" status: 200 len: 1261 microversion: 2.1 time: 0.087658 Oct 27 04:39:37.769268 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3790/7876] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:39:37 2022] GET /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33 => generated 1261 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:39:38.792004 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-160d651c-886c-4f11-b54d-20dbaef37153 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:39:38.792660 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-160d651c-886c-4f11-b54d-20dbaef37153 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 39df2a30-b7e4-4a1d-add4-2e750de7ca33] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:39:38.799553 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-160d651c-886c-4f11-b54d-20dbaef37153 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:39:38.800061 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-160d651c-886c-4f11-b54d-20dbaef37153 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:39:38.800512 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-160d651c-886c-4f11-b54d-20dbaef37153 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:39:38.801225 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-160d651c-886c-4f11-b54d-20dbaef37153 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:39:38.801695 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-160d651c-886c-4f11-b54d-20dbaef37153 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:39:38.802242 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-160d651c-886c-4f11-b54d-20dbaef37153 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:39:38.875194 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-160d651c-886c-4f11-b54d-20dbaef37153 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81159cb7105b4f4e94527225ed45feeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e577cf747d5b4a12ba0ee81e686b8534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:39:38.883210 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-160d651c-886c-4f11-b54d-20dbaef37153 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "GET /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33" status: 200 len: 1327 microversion: 2.1 time: 0.095553 Oct 27 04:39:38.883720 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4087/7877] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:39:38 2022] GET /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33 => generated 1327 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:39:39.906766 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-73bdae95-9c13-49ec-9310-d5f874fcf3cb tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:39:39.908335 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-73bdae95-9c13-49ec-9310-d5f874fcf3cb tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 39df2a30-b7e4-4a1d-add4-2e750de7ca33] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:39:39.917548 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-73bdae95-9c13-49ec-9310-d5f874fcf3cb tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:39:39.918352 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-73bdae95-9c13-49ec-9310-d5f874fcf3cb tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:39:39.919066 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-73bdae95-9c13-49ec-9310-d5f874fcf3cb tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:39:39.919859 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-73bdae95-9c13-49ec-9310-d5f874fcf3cb tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:39:39.920326 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-73bdae95-9c13-49ec-9310-d5f874fcf3cb tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:39:39.920817 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-73bdae95-9c13-49ec-9310-d5f874fcf3cb tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:39:40.065143 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-73bdae95-9c13-49ec-9310-d5f874fcf3cb tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81159cb7105b4f4e94527225ed45feeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e577cf747d5b4a12ba0ee81e686b8534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:39:40.073774 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-73bdae95-9c13-49ec-9310-d5f874fcf3cb tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "GET /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33" status: 200 len: 1357 microversion: 2.1 time: 0.170859 Oct 27 04:39:40.075004 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3791/7878] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:39:39 2022] GET /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33 => generated 1357 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:39:41.100349 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b1138e0b-c844-499a-88e0-953a33dad7f4 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:39:41.100978 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b1138e0b-c844-499a-88e0-953a33dad7f4 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 39df2a30-b7e4-4a1d-add4-2e750de7ca33] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:39:41.107654 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b1138e0b-c844-499a-88e0-953a33dad7f4 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:39:41.108157 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b1138e0b-c844-499a-88e0-953a33dad7f4 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:39:41.108641 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b1138e0b-c844-499a-88e0-953a33dad7f4 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:39:41.109429 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b1138e0b-c844-499a-88e0-953a33dad7f4 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:39:41.110109 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b1138e0b-c844-499a-88e0-953a33dad7f4 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:39:41.110600 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b1138e0b-c844-499a-88e0-953a33dad7f4 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:39:41.253906 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b1138e0b-c844-499a-88e0-953a33dad7f4 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81159cb7105b4f4e94527225ed45feeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e577cf747d5b4a12ba0ee81e686b8534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:39:41.262827 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b1138e0b-c844-499a-88e0-953a33dad7f4 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "GET /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33" status: 200 len: 1357 microversion: 2.1 time: 0.169152 Oct 27 04:39:41.263536 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4088/7879] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:39:41 2022] GET /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33 => generated 1357 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 04:39:42.286620 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3fc0c247-cd82-4255-ae7e-bbc42f577b60 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:39:42.287786 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-3fc0c247-cd82-4255-ae7e-bbc42f577b60 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 39df2a30-b7e4-4a1d-add4-2e750de7ca33] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:39:42.294699 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3fc0c247-cd82-4255-ae7e-bbc42f577b60 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:39:42.295199 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3fc0c247-cd82-4255-ae7e-bbc42f577b60 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:39:42.295634 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3fc0c247-cd82-4255-ae7e-bbc42f577b60 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:39:42.296343 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3fc0c247-cd82-4255-ae7e-bbc42f577b60 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:39:42.296799 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3fc0c247-cd82-4255-ae7e-bbc42f577b60 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:39:42.297356 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3fc0c247-cd82-4255-ae7e-bbc42f577b60 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:39:42.446184 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-3fc0c247-cd82-4255-ae7e-bbc42f577b60 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81159cb7105b4f4e94527225ed45feeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e577cf747d5b4a12ba0ee81e686b8534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:39:42.454169 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3fc0c247-cd82-4255-ae7e-bbc42f577b60 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "GET /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33" status: 200 len: 1357 microversion: 2.1 time: 0.171659 Oct 27 04:39:42.454754 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3792/7880] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:39:42 2022] GET /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33 => generated 1357 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:39:43.481676 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c23d43e6-b68f-4763-af8b-3c0e19cdc795 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:39:43.482370 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c23d43e6-b68f-4763-af8b-3c0e19cdc795 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 39df2a30-b7e4-4a1d-add4-2e750de7ca33] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:39:43.490183 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c23d43e6-b68f-4763-af8b-3c0e19cdc795 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:39:43.491027 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c23d43e6-b68f-4763-af8b-3c0e19cdc795 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:39:43.491739 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c23d43e6-b68f-4763-af8b-3c0e19cdc795 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:39:43.492735 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c23d43e6-b68f-4763-af8b-3c0e19cdc795 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:39:43.493282 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c23d43e6-b68f-4763-af8b-3c0e19cdc795 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:39:43.493810 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c23d43e6-b68f-4763-af8b-3c0e19cdc795 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:39:43.640746 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c23d43e6-b68f-4763-af8b-3c0e19cdc795 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81159cb7105b4f4e94527225ed45feeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e577cf747d5b4a12ba0ee81e686b8534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:39:43.652739 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c23d43e6-b68f-4763-af8b-3c0e19cdc795 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "GET /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33" status: 200 len: 1357 microversion: 2.1 time: 0.175132 Oct 27 04:39:43.653384 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4089/7881] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:39:43 2022] GET /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33 => generated 1357 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:39:44.676728 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f816cda1-0136-4512-a3aa-f385c9eb0aef tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:39:44.678883 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f816cda1-0136-4512-a3aa-f385c9eb0aef tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 39df2a30-b7e4-4a1d-add4-2e750de7ca33] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:39:44.686529 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f816cda1-0136-4512-a3aa-f385c9eb0aef tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:39:44.687433 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f816cda1-0136-4512-a3aa-f385c9eb0aef tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:39:44.688121 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f816cda1-0136-4512-a3aa-f385c9eb0aef tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:39:44.689088 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f816cda1-0136-4512-a3aa-f385c9eb0aef tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:39:44.689778 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f816cda1-0136-4512-a3aa-f385c9eb0aef tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:39:44.690296 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f816cda1-0136-4512-a3aa-f385c9eb0aef tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:39:44.832886 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f816cda1-0136-4512-a3aa-f385c9eb0aef tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81159cb7105b4f4e94527225ed45feeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e577cf747d5b4a12ba0ee81e686b8534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:39:44.840826 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f816cda1-0136-4512-a3aa-f385c9eb0aef tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "GET /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33" status: 200 len: 1357 microversion: 2.1 time: 0.168089 Oct 27 04:39:44.841419 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3793/7882] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:39:44 2022] GET /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33 => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:39:45.865249 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-10a43d4a-b0f1-43ae-8e8b-db7a2f90420e tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:39:45.865992 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-10a43d4a-b0f1-43ae-8e8b-db7a2f90420e tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 39df2a30-b7e4-4a1d-add4-2e750de7ca33] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:39:45.873961 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-10a43d4a-b0f1-43ae-8e8b-db7a2f90420e tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:39:45.874507 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-10a43d4a-b0f1-43ae-8e8b-db7a2f90420e tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:39:45.874978 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-10a43d4a-b0f1-43ae-8e8b-db7a2f90420e tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:39:45.875831 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-10a43d4a-b0f1-43ae-8e8b-db7a2f90420e tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:39:45.876317 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-10a43d4a-b0f1-43ae-8e8b-db7a2f90420e tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:39:45.876774 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-10a43d4a-b0f1-43ae-8e8b-db7a2f90420e tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:39:46.036448 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-10a43d4a-b0f1-43ae-8e8b-db7a2f90420e tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81159cb7105b4f4e94527225ed45feeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e577cf747d5b4a12ba0ee81e686b8534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:39:46.045236 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-10a43d4a-b0f1-43ae-8e8b-db7a2f90420e tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "GET /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33" status: 200 len: 1357 microversion: 2.1 time: 0.184232 Oct 27 04:39:46.046049 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4090/7883] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:39:45 2022] GET /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33 => generated 1357 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:39:47.069673 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a8753214-618c-4d91-8e36-5f382e96d229 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:39:47.072767 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a8753214-618c-4d91-8e36-5f382e96d229 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 39df2a30-b7e4-4a1d-add4-2e750de7ca33] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:39:47.072997 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:39:47.073872 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=6 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:39:47.078688 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a8753214-618c-4d91-8e36-5f382e96d229 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:39:47.079182 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a8753214-618c-4d91-8e36-5f382e96d229 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:39:47.079626 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a8753214-618c-4d91-8e36-5f382e96d229 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:39:47.080332 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a8753214-618c-4d91-8e36-5f382e96d229 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:39:47.080996 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a8753214-618c-4d91-8e36-5f382e96d229 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:39:47.081427 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a8753214-618c-4d91-8e36-5f382e96d229 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:39:47.258220 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a8753214-618c-4d91-8e36-5f382e96d229 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81159cb7105b4f4e94527225ed45feeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e577cf747d5b4a12ba0ee81e686b8534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:39:47.265798 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a8753214-618c-4d91-8e36-5f382e96d229 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "GET /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33" status: 200 len: 1357 microversion: 2.1 time: 0.200573 Oct 27 04:39:47.266407 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3794/7884] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:39:47 2022] GET /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33 => generated 1357 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:39:47.671991 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-2d373917-90a9-4b81-aab2-83431aa1558a req-b5360a9b-c940-4631-a8f3-3c6707ae4f80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39df2a30-b7e4-4a1d-add4-2e750de7ca33", "tag": "d204f963-898c-4124-86f4-e0f1a6fc7afa"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:39:47.678198 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=6 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:39:47.683015 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-2d373917-90a9-4b81-aab2-83431aa1558a req-b5360a9b-c940-4631-a8f3-3c6707ae4f80 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:39:47.683527 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-2d373917-90a9-4b81-aab2-83431aa1558a req-b5360a9b-c940-4631-a8f3-3c6707ae4f80 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:39:47.683983 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-2d373917-90a9-4b81-aab2-83431aa1558a req-b5360a9b-c940-4631-a8f3-3c6707ae4f80 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:39:47.695658 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-2d373917-90a9-4b81-aab2-83431aa1558a req-b5360a9b-c940-4631-a8f3-3c6707ae4f80 service nova] Creating event network-changed:d204f963-898c-4124-86f4-e0f1a6fc7afa for instance 39df2a30-b7e4-4a1d-add4-2e750de7ca33 on n-h2-862769-1 Oct 27 04:39:47.700940 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-2d373917-90a9-4b81-aab2-83431aa1558a req-b5360a9b-c940-4631-a8f3-3c6707ae4f80 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032873 Oct 27 04:39:47.701574 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4091/7885] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:39:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:39:48.316518 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c3e64fb9-759d-4ee6-9428-07610dd1f86c tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:39:48.316518 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c3e64fb9-759d-4ee6-9428-07610dd1f86c tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 39df2a30-b7e4-4a1d-add4-2e750de7ca33] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:39:48.316518 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c3e64fb9-759d-4ee6-9428-07610dd1f86c tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:39:48.316518 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c3e64fb9-759d-4ee6-9428-07610dd1f86c tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:39:48.316518 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c3e64fb9-759d-4ee6-9428-07610dd1f86c tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:39:48.316518 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c3e64fb9-759d-4ee6-9428-07610dd1f86c tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:39:48.316518 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c3e64fb9-759d-4ee6-9428-07610dd1f86c tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:39:48.316518 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c3e64fb9-759d-4ee6-9428-07610dd1f86c tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:39:48.544673 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c3e64fb9-759d-4ee6-9428-07610dd1f86c tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81159cb7105b4f4e94527225ed45feeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e577cf747d5b4a12ba0ee81e686b8534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:39:48.552512 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c3e64fb9-759d-4ee6-9428-07610dd1f86c tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "GET /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33" status: 200 len: 1357 microversion: 2.1 time: 0.267893 Oct 27 04:39:48.553726 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3795/7886] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:39:48 2022] GET /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33 => generated 1357 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:39:49.577915 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a8bb54c3-425c-48b1-8f00-c36aa0b48ed0 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:39:49.578670 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a8bb54c3-425c-48b1-8f00-c36aa0b48ed0 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 39df2a30-b7e4-4a1d-add4-2e750de7ca33] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:39:49.584927 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a8bb54c3-425c-48b1-8f00-c36aa0b48ed0 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:39:49.585429 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a8bb54c3-425c-48b1-8f00-c36aa0b48ed0 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:39:49.585889 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a8bb54c3-425c-48b1-8f00-c36aa0b48ed0 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:39:49.586637 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a8bb54c3-425c-48b1-8f00-c36aa0b48ed0 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:39:49.587113 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a8bb54c3-425c-48b1-8f00-c36aa0b48ed0 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:39:49.587565 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a8bb54c3-425c-48b1-8f00-c36aa0b48ed0 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:39:49.719387 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a8bb54c3-425c-48b1-8f00-c36aa0b48ed0 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81159cb7105b4f4e94527225ed45feeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e577cf747d5b4a12ba0ee81e686b8534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:39:49.727261 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a8bb54c3-425c-48b1-8f00-c36aa0b48ed0 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "GET /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33" status: 200 len: 1357 microversion: 2.1 time: 0.154979 Oct 27 04:39:49.728111 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4092/7887] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:39:49 2022] GET /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33 => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:39:50.750869 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b3ea22a6-3da8-46e1-8b74-6664505f67b6 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:39:50.751477 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b3ea22a6-3da8-46e1-8b74-6664505f67b6 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 39df2a30-b7e4-4a1d-add4-2e750de7ca33] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:39:50.758528 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b3ea22a6-3da8-46e1-8b74-6664505f67b6 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:39:50.759057 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b3ea22a6-3da8-46e1-8b74-6664505f67b6 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:39:50.759511 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b3ea22a6-3da8-46e1-8b74-6664505f67b6 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:39:50.760228 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b3ea22a6-3da8-46e1-8b74-6664505f67b6 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:39:50.760692 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b3ea22a6-3da8-46e1-8b74-6664505f67b6 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:39:50.761149 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b3ea22a6-3da8-46e1-8b74-6664505f67b6 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:39:50.894683 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b3ea22a6-3da8-46e1-8b74-6664505f67b6 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81159cb7105b4f4e94527225ed45feeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e577cf747d5b4a12ba0ee81e686b8534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:39:50.903535 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b3ea22a6-3da8-46e1-8b74-6664505f67b6 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "GET /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33" status: 200 len: 1357 microversion: 2.1 time: 0.156594 Oct 27 04:39:50.904174 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3796/7888] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:39:50 2022] GET /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33 => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:39:51.928073 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ae756544-6cc2-42da-b202-4d04bba79be2 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:39:51.928716 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ae756544-6cc2-42da-b202-4d04bba79be2 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 39df2a30-b7e4-4a1d-add4-2e750de7ca33] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:39:51.935616 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ae756544-6cc2-42da-b202-4d04bba79be2 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:39:51.936065 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ae756544-6cc2-42da-b202-4d04bba79be2 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:39:51.936526 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ae756544-6cc2-42da-b202-4d04bba79be2 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:39:51.937247 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ae756544-6cc2-42da-b202-4d04bba79be2 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:39:51.937723 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ae756544-6cc2-42da-b202-4d04bba79be2 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:39:51.938205 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ae756544-6cc2-42da-b202-4d04bba79be2 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:39:52.067929 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ae756544-6cc2-42da-b202-4d04bba79be2 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81159cb7105b4f4e94527225ed45feeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e577cf747d5b4a12ba0ee81e686b8534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:39:52.075659 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ae756544-6cc2-42da-b202-4d04bba79be2 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "GET /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33" status: 200 len: 1357 microversion: 2.1 time: 0.152188 Oct 27 04:39:52.076231 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4093/7889] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:39:51 2022] GET /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33 => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:39:53.098380 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-83e58f6e-56f2-4797-8deb-f1ac88cf384c tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:39:53.098941 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-83e58f6e-56f2-4797-8deb-f1ac88cf384c tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 39df2a30-b7e4-4a1d-add4-2e750de7ca33] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:39:53.105964 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-83e58f6e-56f2-4797-8deb-f1ac88cf384c tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:39:53.106478 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-83e58f6e-56f2-4797-8deb-f1ac88cf384c tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:39:53.106915 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-83e58f6e-56f2-4797-8deb-f1ac88cf384c tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:39:53.107602 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-83e58f6e-56f2-4797-8deb-f1ac88cf384c tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:39:53.108057 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-83e58f6e-56f2-4797-8deb-f1ac88cf384c tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:39:53.108483 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-83e58f6e-56f2-4797-8deb-f1ac88cf384c tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:39:53.235614 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-83e58f6e-56f2-4797-8deb-f1ac88cf384c tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81159cb7105b4f4e94527225ed45feeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e577cf747d5b4a12ba0ee81e686b8534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:39:53.243825 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-83e58f6e-56f2-4797-8deb-f1ac88cf384c tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "GET /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33" status: 200 len: 1357 microversion: 2.1 time: 0.149468 Oct 27 04:39:53.244406 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3797/7890] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:39:53 2022] GET /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33 => generated 1357 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:39:53.965347 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-b547db98-a5e5-4d51-8384-3553eac12400 req-28373add-b72d-4c52-a0d6-a8476c83167c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39df2a30-b7e4-4a1d-add4-2e750de7ca33", "name": "network-vif-plugged", "status": "completed", "tag": "d204f963-898c-4124-86f4-e0f1a6fc7afa"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:39:53.975554 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-b547db98-a5e5-4d51-8384-3553eac12400 req-28373add-b72d-4c52-a0d6-a8476c83167c service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:39:53.980644 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-b547db98-a5e5-4d51-8384-3553eac12400 req-28373add-b72d-4c52-a0d6-a8476c83167c service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:39:53.980644 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-b547db98-a5e5-4d51-8384-3553eac12400 req-28373add-b72d-4c52-a0d6-a8476c83167c service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:39:53.988140 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-b547db98-a5e5-4d51-8384-3553eac12400 req-28373add-b72d-4c52-a0d6-a8476c83167c service nova] Creating event network-vif-plugged:d204f963-898c-4124-86f4-e0f1a6fc7afa for instance 39df2a30-b7e4-4a1d-add4-2e750de7ca33 on n-h2-862769-1 Oct 27 04:39:53.993221 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-b547db98-a5e5-4d51-8384-3553eac12400 req-28373add-b72d-4c52-a0d6-a8476c83167c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084938 Oct 27 04:39:53.993818 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4094/7891] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:39:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:39:54.267433 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d4d0e9e1-7bbe-4ccc-bc8b-b1df9c7458d1 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:39:54.268063 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d4d0e9e1-7bbe-4ccc-bc8b-b1df9c7458d1 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 39df2a30-b7e4-4a1d-add4-2e750de7ca33] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:39:54.275483 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d4d0e9e1-7bbe-4ccc-bc8b-b1df9c7458d1 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:39:54.275980 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d4d0e9e1-7bbe-4ccc-bc8b-b1df9c7458d1 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:39:54.276428 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d4d0e9e1-7bbe-4ccc-bc8b-b1df9c7458d1 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:39:54.277135 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d4d0e9e1-7bbe-4ccc-bc8b-b1df9c7458d1 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:39:54.277604 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d4d0e9e1-7bbe-4ccc-bc8b-b1df9c7458d1 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:39:54.278063 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d4d0e9e1-7bbe-4ccc-bc8b-b1df9c7458d1 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:39:54.407980 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d4d0e9e1-7bbe-4ccc-bc8b-b1df9c7458d1 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81159cb7105b4f4e94527225ed45feeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e577cf747d5b4a12ba0ee81e686b8534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:39:54.415605 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d4d0e9e1-7bbe-4ccc-bc8b-b1df9c7458d1 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "GET /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33" status: 200 len: 1357 microversion: 2.1 time: 0.152178 Oct 27 04:39:54.416182 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3798/7892] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:39:54 2022] GET /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33 => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:39:55.440060 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ebb9aef8-b318-4350-9cb0-a9b702be4c3e tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:39:55.440747 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ebb9aef8-b318-4350-9cb0-a9b702be4c3e tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 39df2a30-b7e4-4a1d-add4-2e750de7ca33] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:39:55.447581 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ebb9aef8-b318-4350-9cb0-a9b702be4c3e tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:39:55.448082 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ebb9aef8-b318-4350-9cb0-a9b702be4c3e tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:39:55.448541 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ebb9aef8-b318-4350-9cb0-a9b702be4c3e tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:39:55.449248 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ebb9aef8-b318-4350-9cb0-a9b702be4c3e tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:39:55.449718 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ebb9aef8-b318-4350-9cb0-a9b702be4c3e tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:39:55.450203 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ebb9aef8-b318-4350-9cb0-a9b702be4c3e tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:39:55.898798 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ebb9aef8-b318-4350-9cb0-a9b702be4c3e tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81159cb7105b4f4e94527225ed45feeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e577cf747d5b4a12ba0ee81e686b8534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:39:55.906915 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ebb9aef8-b318-4350-9cb0-a9b702be4c3e tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "GET /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33" status: 200 len: 1547 microversion: 2.1 time: 0.472114 Oct 27 04:39:55.907497 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4095/7893] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:39:55 2022] GET /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33 => generated 1547 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:39:55.930575 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-def97be8-10d2-48a6-b499-cbab2a842788 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:39:55.931202 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-def97be8-10d2-48a6-b499-cbab2a842788 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 39df2a30-b7e4-4a1d-add4-2e750de7ca33] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:39:55.939241 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-def97be8-10d2-48a6-b499-cbab2a842788 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:39:55.939733 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-def97be8-10d2-48a6-b499-cbab2a842788 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:39:55.940177 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-def97be8-10d2-48a6-b499-cbab2a842788 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:39:55.940979 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-def97be8-10d2-48a6-b499-cbab2a842788 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:39:55.941443 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-def97be8-10d2-48a6-b499-cbab2a842788 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:39:55.941875 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-def97be8-10d2-48a6-b499-cbab2a842788 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:39:56.094107 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-def97be8-10d2-48a6-b499-cbab2a842788 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81159cb7105b4f4e94527225ed45feeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e577cf747d5b4a12ba0ee81e686b8534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:39:56.104041 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-def97be8-10d2-48a6-b499-cbab2a842788 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "GET /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33" status: 200 len: 1547 microversion: 2.1 time: 0.177904 Oct 27 04:39:56.104671 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3799/7894] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:39:55 2022] GET /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33 => generated 1547 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:39:56.129684 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2376f543-a504-4c4d-a623-3ef551442804 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:39:56.135329 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2376f543-a504-4c4d-a623-3ef551442804 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '81159cb7105b4f4e94527225ed45feeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e577cf747d5b4a12ba0ee81e686b8534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:39:56.136134 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2376f543-a504-4c4d-a623-3ef551442804 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Searching by: {'deleted': False, 'project_id': 'e577cf747d5b4a12ba0ee81e686b8534'} {{(pid=121001) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 04:39:56.142637 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2376f543-a504-4c4d-a623-3ef551442804 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:39:56.143415 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2376f543-a504-4c4d-a623-3ef551442804 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:39:56.143891 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2376f543-a504-4c4d-a623-3ef551442804 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:39:56.144645 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2376f543-a504-4c4d-a623-3ef551442804 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:39:56.145125 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2376f543-a504-4c4d-a623-3ef551442804 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:39:56.145600 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2376f543-a504-4c4d-a623-3ef551442804 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:39:56.171132 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.multi_cell_list [None req-2376f543-a504-4c4d-a623-3ef551442804 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121001) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 04:39:56.201865 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2376f543-a504-4c4d-a623-3ef551442804 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.077648 Oct 27 04:39:56.202936 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4096/7895] 10.222.0.20 () {58 vars in 1125 bytes} [Thu Oct 27 04:39:56 2022] GET /compute/v2.1/servers => generated 341 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:39:56.214778 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8b3a9c42-3e72-4552-8ac7-e063c2f1716d tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:39:56.215492 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8b3a9c42-3e72-4552-8ac7-e063c2f1716d tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 39df2a30-b7e4-4a1d-add4-2e750de7ca33] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:39:56.221680 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8b3a9c42-3e72-4552-8ac7-e063c2f1716d tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:39:56.222209 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8b3a9c42-3e72-4552-8ac7-e063c2f1716d tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:39:56.222653 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8b3a9c42-3e72-4552-8ac7-e063c2f1716d tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:39:56.223354 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8b3a9c42-3e72-4552-8ac7-e063c2f1716d tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:39:56.223810 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8b3a9c42-3e72-4552-8ac7-e063c2f1716d tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:39:56.224237 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8b3a9c42-3e72-4552-8ac7-e063c2f1716d tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:39:56.446028 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8b3a9c42-3e72-4552-8ac7-e063c2f1716d tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81159cb7105b4f4e94527225ed45feeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e577cf747d5b4a12ba0ee81e686b8534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:39:56.453911 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8b3a9c42-3e72-4552-8ac7-e063c2f1716d tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "GET /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33" status: 200 len: 1547 microversion: 2.1 time: 0.243056 Oct 27 04:39:56.454531 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3800/7896] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:39:56 2022] GET /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33 => generated 1547 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:39:59.306103 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2c0518c8-5cde-447f-8100-5c981012023f tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a51c0400-9596-41dd-ba0a-f0b841555d1f"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:39:59.308602 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2c0518c8-5cde-447f-8100-5c981012023f tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 39df2a30-b7e4-4a1d-add4-2e750de7ca33] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:39:59.314736 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2c0518c8-5cde-447f-8100-5c981012023f tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:39:59.315237 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2c0518c8-5cde-447f-8100-5c981012023f tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:39:59.315695 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2c0518c8-5cde-447f-8100-5c981012023f tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:39:59.316399 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2c0518c8-5cde-447f-8100-5c981012023f tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:39:59.316873 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2c0518c8-5cde-447f-8100-5c981012023f tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:39:59.317317 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2c0518c8-5cde-447f-8100-5c981012023f tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:40:00.069928 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2c0518c8-5cde-447f-8100-5c981012023f tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "POST /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.768543 Oct 27 04:40:00.071297 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4097/7897] 10.222.0.20 () {60 vars in 1323 bytes} [Thu Oct 27 04:39:59 2022] POST /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33/os-volume_attachments => generated 194 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:40:11.897227 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ebf3c37f-12e9-4fb5-ae50-baaf9b71ede2 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:40:11.897854 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ebf3c37f-12e9-4fb5-ae50-baaf9b71ede2 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 39df2a30-b7e4-4a1d-add4-2e750de7ca33] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:40:11.900115 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:40:11.900793 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=68 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:40:11.905501 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ebf3c37f-12e9-4fb5-ae50-baaf9b71ede2 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:40:11.905992 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ebf3c37f-12e9-4fb5-ae50-baaf9b71ede2 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:40:11.906470 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ebf3c37f-12e9-4fb5-ae50-baaf9b71ede2 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:40:11.907181 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ebf3c37f-12e9-4fb5-ae50-baaf9b71ede2 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:40:11.907645 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ebf3c37f-12e9-4fb5-ae50-baaf9b71ede2 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:40:11.908080 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ebf3c37f-12e9-4fb5-ae50-baaf9b71ede2 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:40:12.037762 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ebf3c37f-12e9-4fb5-ae50-baaf9b71ede2 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81159cb7105b4f4e94527225ed45feeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e577cf747d5b4a12ba0ee81e686b8534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:40:12.045908 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ebf3c37f-12e9-4fb5-ae50-baaf9b71ede2 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "GET /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33" status: 200 len: 1593 microversion: 2.1 time: 0.153499 Oct 27 04:40:12.046504 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3801/7898] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:40:11 2022] GET /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33 => generated 1593 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:40:13.935491 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:40:13.936414 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:40:13.937142 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:40:13.941957 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-72fa0b98-4a97-414a-8710-b3eb3eb92cdd req-b9732cc9-dee8-4d2b-b8f9-2108a3451c86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39df2a30-b7e4-4a1d-add4-2e750de7ca33", "tag": "d204f963-898c-4124-86f4-e0f1a6fc7afa"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:40:13.954505 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-72fa0b98-4a97-414a-8710-b3eb3eb92cdd req-b9732cc9-dee8-4d2b-b8f9-2108a3451c86 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:40:13.954505 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-72fa0b98-4a97-414a-8710-b3eb3eb92cdd req-b9732cc9-dee8-4d2b-b8f9-2108a3451c86 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:40:13.954505 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-72fa0b98-4a97-414a-8710-b3eb3eb92cdd req-b9732cc9-dee8-4d2b-b8f9-2108a3451c86 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:40:13.966516 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-72fa0b98-4a97-414a-8710-b3eb3eb92cdd req-b9732cc9-dee8-4d2b-b8f9-2108a3451c86 service nova] Creating event network-changed:d204f963-898c-4124-86f4-e0f1a6fc7afa for instance 39df2a30-b7e4-4a1d-add4-2e750de7ca33 on n-h2-862769-1 Oct 27 04:40:13.971738 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-72fa0b98-4a97-414a-8710-b3eb3eb92cdd req-b9732cc9-dee8-4d2b-b8f9-2108a3451c86 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038289 Oct 27 04:40:13.972732 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4098/7899] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:40:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:40:16.465807 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d93cee98-2484-497a-9130-d5b9f1a54f03 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-250808698"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:40:16.466394 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d93cee98-2484-497a-9130-d5b9f1a54f03 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 39df2a30-b7e4-4a1d-add4-2e750de7ca33] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:40:16.473601 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d93cee98-2484-497a-9130-d5b9f1a54f03 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:40:16.474780 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d93cee98-2484-497a-9130-d5b9f1a54f03 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:40:16.475281 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d93cee98-2484-497a-9130-d5b9f1a54f03 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:40:16.475998 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d93cee98-2484-497a-9130-d5b9f1a54f03 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:40:16.476453 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d93cee98-2484-497a-9130-d5b9f1a54f03 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:40:16.476880 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d93cee98-2484-497a-9130-d5b9f1a54f03 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:40:16.603722 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.network.security_group_api [None req-d93cee98-2484-497a-9130-d5b9f1a54f03 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Adding security group 77cb1ebe-cd3d-46c4-abbb-11f7c8bf6933 to port d204f963-898c-4124-86f4-e0f1a6fc7afa Oct 27 04:40:16.954190 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d93cee98-2484-497a-9130-d5b9f1a54f03 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "POST /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33/action" status: 202 len: 0 microversion: 2.1 time: 0.492313 Oct 27 04:40:16.955045 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3802/7900] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 04:40:16 2022] POST /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33/action => generated 0 bytes in 494 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 04:40:16.963631 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-2ad5619f-ee1b-44e0-bc75-a9ee427eee9c req-699e587b-52ab-40f3-8f82-e9a77637d1e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39df2a30-b7e4-4a1d-add4-2e750de7ca33", "tag": "d204f963-898c-4124-86f4-e0f1a6fc7afa"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:40:16.971424 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b4963a92-a917-4f9a-90d3-8fab2ffde660 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:40:16.974222 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b4963a92-a917-4f9a-90d3-8fab2ffde660 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 39df2a30-b7e4-4a1d-add4-2e750de7ca33] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:40:16.984945 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b4963a92-a917-4f9a-90d3-8fab2ffde660 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:40:16.985452 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b4963a92-a917-4f9a-90d3-8fab2ffde660 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:40:16.988824 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-2ad5619f-ee1b-44e0-bc75-a9ee427eee9c req-699e587b-52ab-40f3-8f82-e9a77637d1e8 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:40:16.989340 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-2ad5619f-ee1b-44e0-bc75-a9ee427eee9c req-699e587b-52ab-40f3-8f82-e9a77637d1e8 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:40:16.989829 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-2ad5619f-ee1b-44e0-bc75-a9ee427eee9c req-699e587b-52ab-40f3-8f82-e9a77637d1e8 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:40:16.994124 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b4963a92-a917-4f9a-90d3-8fab2ffde660 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:40:16.994890 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b4963a92-a917-4f9a-90d3-8fab2ffde660 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:40:16.996019 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b4963a92-a917-4f9a-90d3-8fab2ffde660 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:40:16.996019 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b4963a92-a917-4f9a-90d3-8fab2ffde660 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:40:17.020261 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-2ad5619f-ee1b-44e0-bc75-a9ee427eee9c req-699e587b-52ab-40f3-8f82-e9a77637d1e8 service nova] Creating event network-changed:d204f963-898c-4124-86f4-e0f1a6fc7afa for instance 39df2a30-b7e4-4a1d-add4-2e750de7ca33 on n-h2-862769-1 Oct 27 04:40:17.036343 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-2ad5619f-ee1b-44e0-bc75-a9ee427eee9c req-699e587b-52ab-40f3-8f82-e9a77637d1e8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077585 Oct 27 04:40:17.036983 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4099/7901] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:40:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:40:17.253421 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b4963a92-a917-4f9a-90d3-8fab2ffde660 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81159cb7105b4f4e94527225ed45feeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e577cf747d5b4a12ba0ee81e686b8534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:40:17.264152 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b4963a92-a917-4f9a-90d3-8fab2ffde660 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "GET /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33" status: 200 len: 1758 microversion: 2.1 time: 0.296492 Oct 27 04:40:17.265053 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3803/7902] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:40:16 2022] GET /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33 => generated 1758 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:40:31.447971 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3a25ac7a-e7c2-487b-b4ad-461c33a46b88 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:40:31.450478 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3a25ac7a-e7c2-487b-b4ad-461c33a46b88 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 39df2a30-b7e4-4a1d-add4-2e750de7ca33] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:40:31.457350 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3a25ac7a-e7c2-487b-b4ad-461c33a46b88 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:40:31.457850 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3a25ac7a-e7c2-487b-b4ad-461c33a46b88 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:40:31.458594 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3a25ac7a-e7c2-487b-b4ad-461c33a46b88 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:40:31.459305 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3a25ac7a-e7c2-487b-b4ad-461c33a46b88 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:40:31.459775 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3a25ac7a-e7c2-487b-b4ad-461c33a46b88 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:40:31.460220 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3a25ac7a-e7c2-487b-b4ad-461c33a46b88 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:40:31.712882 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3a25ac7a-e7c2-487b-b4ad-461c33a46b88 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "POST /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33/action" status: 202 len: 0 microversion: 2.1 time: 0.317665 Oct 27 04:40:31.716512 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4100/7903] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 04:40:31 2022] POST /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33/action => generated 0 bytes in 319 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 04:40:31.722929 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8ea60983-cb3c-4a56-b8f0-399464713f2a tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:40:31.723575 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8ea60983-cb3c-4a56-b8f0-399464713f2a tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 39df2a30-b7e4-4a1d-add4-2e750de7ca33] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:40:31.726492 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=6 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:40:31.727302 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=16 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:40:31.732331 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8ea60983-cb3c-4a56-b8f0-399464713f2a tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:40:31.733751 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8ea60983-cb3c-4a56-b8f0-399464713f2a tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:40:31.733751 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8ea60983-cb3c-4a56-b8f0-399464713f2a tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:40:31.734025 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8ea60983-cb3c-4a56-b8f0-399464713f2a tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:40:31.734519 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8ea60983-cb3c-4a56-b8f0-399464713f2a tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:40:31.734930 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8ea60983-cb3c-4a56-b8f0-399464713f2a tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:40:31.895450 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8ea60983-cb3c-4a56-b8f0-399464713f2a tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81159cb7105b4f4e94527225ed45feeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e577cf747d5b4a12ba0ee81e686b8534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:40:31.903827 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8ea60983-cb3c-4a56-b8f0-399464713f2a tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "GET /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33" status: 200 len: 1750 microversion: 2.1 time: 0.186026 Oct 27 04:40:31.905853 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3804/7904] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:40:31 2022] GET /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33 => generated 1750 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:40:32.929423 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a14cebb5-6965-4fb7-a354-721b06d91911 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:40:32.930176 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a14cebb5-6965-4fb7-a354-721b06d91911 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 39df2a30-b7e4-4a1d-add4-2e750de7ca33] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:40:32.936377 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a14cebb5-6965-4fb7-a354-721b06d91911 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:40:32.936877 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a14cebb5-6965-4fb7-a354-721b06d91911 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:40:32.937329 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a14cebb5-6965-4fb7-a354-721b06d91911 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:40:32.938226 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a14cebb5-6965-4fb7-a354-721b06d91911 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:40:32.938699 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a14cebb5-6965-4fb7-a354-721b06d91911 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:40:32.939148 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a14cebb5-6965-4fb7-a354-721b06d91911 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:40:33.085650 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a14cebb5-6965-4fb7-a354-721b06d91911 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81159cb7105b4f4e94527225ed45feeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e577cf747d5b4a12ba0ee81e686b8534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:40:33.094782 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a14cebb5-6965-4fb7-a354-721b06d91911 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "GET /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33" status: 200 len: 1755 microversion: 2.1 time: 0.171107 Oct 27 04:40:33.095369 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4101/7905] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:40:32 2022] GET /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33 => generated 1755 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:40:34.119316 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5e0c001b-8db2-46b8-9dbf-74770581f39c tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:40:34.119945 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5e0c001b-8db2-46b8-9dbf-74770581f39c tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 39df2a30-b7e4-4a1d-add4-2e750de7ca33] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:40:34.126964 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5e0c001b-8db2-46b8-9dbf-74770581f39c tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:40:34.127462 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5e0c001b-8db2-46b8-9dbf-74770581f39c tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:40:34.127912 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5e0c001b-8db2-46b8-9dbf-74770581f39c tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:40:34.128615 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5e0c001b-8db2-46b8-9dbf-74770581f39c tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:40:34.129081 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5e0c001b-8db2-46b8-9dbf-74770581f39c tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:40:34.129518 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5e0c001b-8db2-46b8-9dbf-74770581f39c tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:40:34.274992 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5e0c001b-8db2-46b8-9dbf-74770581f39c tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81159cb7105b4f4e94527225ed45feeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e577cf747d5b4a12ba0ee81e686b8534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:40:34.283317 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5e0c001b-8db2-46b8-9dbf-74770581f39c tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "GET /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33" status: 200 len: 1755 microversion: 2.1 time: 0.168027 Oct 27 04:40:34.283904 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3805/7906] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:40:34 2022] GET /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33 => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:40:35.308143 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5591c3c4-0be9-48b5-be25-51bd450588fd tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:40:35.308783 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5591c3c4-0be9-48b5-be25-51bd450588fd tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 39df2a30-b7e4-4a1d-add4-2e750de7ca33] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:40:35.315623 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5591c3c4-0be9-48b5-be25-51bd450588fd tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:40:35.316127 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5591c3c4-0be9-48b5-be25-51bd450588fd tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:40:35.316585 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5591c3c4-0be9-48b5-be25-51bd450588fd tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:40:35.317291 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5591c3c4-0be9-48b5-be25-51bd450588fd tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:40:35.317776 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5591c3c4-0be9-48b5-be25-51bd450588fd tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:40:35.318238 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5591c3c4-0be9-48b5-be25-51bd450588fd tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:40:35.461296 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5591c3c4-0be9-48b5-be25-51bd450588fd tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81159cb7105b4f4e94527225ed45feeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e577cf747d5b4a12ba0ee81e686b8534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:40:35.469697 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5591c3c4-0be9-48b5-be25-51bd450588fd tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "GET /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33" status: 200 len: 1755 microversion: 2.1 time: 0.166209 Oct 27 04:40:35.470306 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4102/7907] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:40:35 2022] GET /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33 => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:40:36.494096 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-432dcec9-813b-4770-9fd1-1caf0738146e tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:40:36.494721 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-432dcec9-813b-4770-9fd1-1caf0738146e tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 39df2a30-b7e4-4a1d-add4-2e750de7ca33] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:40:36.501498 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-432dcec9-813b-4770-9fd1-1caf0738146e tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:40:36.501980 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-432dcec9-813b-4770-9fd1-1caf0738146e tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:40:36.502454 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-432dcec9-813b-4770-9fd1-1caf0738146e tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:40:36.503142 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-432dcec9-813b-4770-9fd1-1caf0738146e tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:40:36.503593 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-432dcec9-813b-4770-9fd1-1caf0738146e tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:40:36.504021 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-432dcec9-813b-4770-9fd1-1caf0738146e tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:40:36.649097 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-432dcec9-813b-4770-9fd1-1caf0738146e tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81159cb7105b4f4e94527225ed45feeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e577cf747d5b4a12ba0ee81e686b8534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:40:36.657301 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-432dcec9-813b-4770-9fd1-1caf0738146e tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "GET /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33" status: 200 len: 1755 microversion: 2.1 time: 0.167182 Oct 27 04:40:36.657874 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3806/7908] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:40:36 2022] GET /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33 => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:40:37.680651 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-92d981a8-ab03-45ef-aef3-2f28c0ef4053 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:40:37.681288 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-92d981a8-ab03-45ef-aef3-2f28c0ef4053 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 39df2a30-b7e4-4a1d-add4-2e750de7ca33] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:40:37.688214 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-92d981a8-ab03-45ef-aef3-2f28c0ef4053 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:40:37.688715 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-92d981a8-ab03-45ef-aef3-2f28c0ef4053 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:40:37.689179 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-92d981a8-ab03-45ef-aef3-2f28c0ef4053 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:40:37.689890 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-92d981a8-ab03-45ef-aef3-2f28c0ef4053 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:40:37.690398 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-92d981a8-ab03-45ef-aef3-2f28c0ef4053 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:40:37.690844 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-92d981a8-ab03-45ef-aef3-2f28c0ef4053 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:40:37.831443 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-92d981a8-ab03-45ef-aef3-2f28c0ef4053 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81159cb7105b4f4e94527225ed45feeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e577cf747d5b4a12ba0ee81e686b8534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:40:37.840354 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-92d981a8-ab03-45ef-aef3-2f28c0ef4053 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "GET /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33" status: 200 len: 1755 microversion: 2.1 time: 0.163675 Oct 27 04:40:37.840938 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4103/7909] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:40:37 2022] GET /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33 => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:40:38.864391 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a03afaba-7ffe-4bad-b536-125ecdebcfd6 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:40:38.865040 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a03afaba-7ffe-4bad-b536-125ecdebcfd6 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 39df2a30-b7e4-4a1d-add4-2e750de7ca33] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:40:38.872450 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a03afaba-7ffe-4bad-b536-125ecdebcfd6 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:40:38.872933 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a03afaba-7ffe-4bad-b536-125ecdebcfd6 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:40:38.873370 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a03afaba-7ffe-4bad-b536-125ecdebcfd6 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:40:38.874084 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a03afaba-7ffe-4bad-b536-125ecdebcfd6 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:40:38.874543 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a03afaba-7ffe-4bad-b536-125ecdebcfd6 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:40:38.874972 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a03afaba-7ffe-4bad-b536-125ecdebcfd6 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:40:39.014762 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a03afaba-7ffe-4bad-b536-125ecdebcfd6 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81159cb7105b4f4e94527225ed45feeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e577cf747d5b4a12ba0ee81e686b8534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:40:39.022873 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a03afaba-7ffe-4bad-b536-125ecdebcfd6 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "GET /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33" status: 200 len: 1755 microversion: 2.1 time: 0.162396 Oct 27 04:40:39.023437 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3807/7910] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:40:38 2022] GET /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33 => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:40:40.047009 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a4fa3777-910f-4198-a5e7-85008e2fb00a tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:40:40.047628 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a4fa3777-910f-4198-a5e7-85008e2fb00a tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 39df2a30-b7e4-4a1d-add4-2e750de7ca33] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:40:40.054825 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a4fa3777-910f-4198-a5e7-85008e2fb00a tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:40:40.055333 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a4fa3777-910f-4198-a5e7-85008e2fb00a tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:40:40.055795 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a4fa3777-910f-4198-a5e7-85008e2fb00a tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:40:40.056518 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a4fa3777-910f-4198-a5e7-85008e2fb00a tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:40:40.056987 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a4fa3777-910f-4198-a5e7-85008e2fb00a tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:40:40.057432 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a4fa3777-910f-4198-a5e7-85008e2fb00a tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:40:40.202326 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a4fa3777-910f-4198-a5e7-85008e2fb00a tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81159cb7105b4f4e94527225ed45feeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e577cf747d5b4a12ba0ee81e686b8534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:40:40.211225 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a4fa3777-910f-4198-a5e7-85008e2fb00a tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "GET /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33" status: 200 len: 1755 microversion: 2.1 time: 0.168251 Oct 27 04:40:40.211802 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4104/7911] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:40:40 2022] GET /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33 => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:40:41.235057 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5fe10868-5ff3-4f2d-b8de-c9ad60e69eb9 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:40:41.235692 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5fe10868-5ff3-4f2d-b8de-c9ad60e69eb9 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 39df2a30-b7e4-4a1d-add4-2e750de7ca33] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:40:41.242521 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5fe10868-5ff3-4f2d-b8de-c9ad60e69eb9 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:40:41.243017 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5fe10868-5ff3-4f2d-b8de-c9ad60e69eb9 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:40:41.243465 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5fe10868-5ff3-4f2d-b8de-c9ad60e69eb9 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:40:41.244169 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5fe10868-5ff3-4f2d-b8de-c9ad60e69eb9 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:40:41.244633 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5fe10868-5ff3-4f2d-b8de-c9ad60e69eb9 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:40:41.245105 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5fe10868-5ff3-4f2d-b8de-c9ad60e69eb9 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:40:41.388360 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5fe10868-5ff3-4f2d-b8de-c9ad60e69eb9 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81159cb7105b4f4e94527225ed45feeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e577cf747d5b4a12ba0ee81e686b8534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:40:41.396632 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5fe10868-5ff3-4f2d-b8de-c9ad60e69eb9 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "GET /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33" status: 200 len: 1755 microversion: 2.1 time: 0.165473 Oct 27 04:40:41.397736 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3808/7912] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:40:41 2022] GET /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33 => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:40:42.421839 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8a7910da-9403-44a1-8434-89ffe4f6386e tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:40:42.422518 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8a7910da-9403-44a1-8434-89ffe4f6386e tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 39df2a30-b7e4-4a1d-add4-2e750de7ca33] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:40:42.429472 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8a7910da-9403-44a1-8434-89ffe4f6386e tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:40:42.429981 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8a7910da-9403-44a1-8434-89ffe4f6386e tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:40:42.430496 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8a7910da-9403-44a1-8434-89ffe4f6386e tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:40:42.431199 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8a7910da-9403-44a1-8434-89ffe4f6386e tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:40:42.431672 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8a7910da-9403-44a1-8434-89ffe4f6386e tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:40:42.432123 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8a7910da-9403-44a1-8434-89ffe4f6386e tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:40:42.574895 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8a7910da-9403-44a1-8434-89ffe4f6386e tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81159cb7105b4f4e94527225ed45feeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e577cf747d5b4a12ba0ee81e686b8534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:40:42.583210 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8a7910da-9403-44a1-8434-89ffe4f6386e tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "GET /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33" status: 200 len: 1755 microversion: 2.1 time: 0.165345 Oct 27 04:40:42.583795 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4105/7913] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:40:42 2022] GET /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33 => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 04:40:43.606931 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7d0341e9-af77-4dfb-88b6-59b2a8bb5544 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:40:43.607550 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7d0341e9-af77-4dfb-88b6-59b2a8bb5544 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 39df2a30-b7e4-4a1d-add4-2e750de7ca33] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:40:43.614453 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7d0341e9-af77-4dfb-88b6-59b2a8bb5544 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:40:43.614940 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7d0341e9-af77-4dfb-88b6-59b2a8bb5544 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:40:43.615380 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7d0341e9-af77-4dfb-88b6-59b2a8bb5544 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:40:43.616583 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7d0341e9-af77-4dfb-88b6-59b2a8bb5544 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:40:43.617042 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7d0341e9-af77-4dfb-88b6-59b2a8bb5544 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:40:43.617468 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7d0341e9-af77-4dfb-88b6-59b2a8bb5544 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:40:43.759230 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7d0341e9-af77-4dfb-88b6-59b2a8bb5544 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81159cb7105b4f4e94527225ed45feeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e577cf747d5b4a12ba0ee81e686b8534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:40:43.767459 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7d0341e9-af77-4dfb-88b6-59b2a8bb5544 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "GET /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33" status: 200 len: 1755 microversion: 2.1 time: 0.164639 Oct 27 04:40:43.768032 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3809/7914] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:40:43 2022] GET /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:40:44.790924 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5073dbea-e53e-4597-8a80-a78a45902db1 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:40:44.791565 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5073dbea-e53e-4597-8a80-a78a45902db1 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 39df2a30-b7e4-4a1d-add4-2e750de7ca33] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:40:44.798440 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5073dbea-e53e-4597-8a80-a78a45902db1 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:40:44.802134 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5073dbea-e53e-4597-8a80-a78a45902db1 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:40:44.802134 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5073dbea-e53e-4597-8a80-a78a45902db1 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:40:44.802134 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5073dbea-e53e-4597-8a80-a78a45902db1 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:40:44.802134 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5073dbea-e53e-4597-8a80-a78a45902db1 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:40:44.802134 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5073dbea-e53e-4597-8a80-a78a45902db1 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:40:44.943409 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5073dbea-e53e-4597-8a80-a78a45902db1 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81159cb7105b4f4e94527225ed45feeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e577cf747d5b4a12ba0ee81e686b8534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:40:44.952479 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5073dbea-e53e-4597-8a80-a78a45902db1 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "GET /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33" status: 200 len: 1755 microversion: 2.1 time: 0.165626 Oct 27 04:40:44.953057 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4106/7915] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:40:44 2022] GET /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33 => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:40:45.976014 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-69ccc7e9-9888-4ab0-85aa-80d5b138cebd tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:40:45.976666 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-69ccc7e9-9888-4ab0-85aa-80d5b138cebd tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 39df2a30-b7e4-4a1d-add4-2e750de7ca33] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:40:45.983670 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-69ccc7e9-9888-4ab0-85aa-80d5b138cebd tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:40:45.984152 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-69ccc7e9-9888-4ab0-85aa-80d5b138cebd tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:40:45.984589 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-69ccc7e9-9888-4ab0-85aa-80d5b138cebd tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:40:45.985280 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-69ccc7e9-9888-4ab0-85aa-80d5b138cebd tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:40:45.985737 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-69ccc7e9-9888-4ab0-85aa-80d5b138cebd tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:40:45.986194 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-69ccc7e9-9888-4ab0-85aa-80d5b138cebd tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:40:46.180647 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-69ccc7e9-9888-4ab0-85aa-80d5b138cebd tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81159cb7105b4f4e94527225ed45feeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e577cf747d5b4a12ba0ee81e686b8534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:40:46.189734 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-69ccc7e9-9888-4ab0-85aa-80d5b138cebd tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "GET /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33" status: 200 len: 1755 microversion: 2.1 time: 0.218117 Oct 27 04:40:46.190444 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3810/7916] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:40:45 2022] GET /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33 => generated 1755 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:40:47.214176 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-839136a2-a8f6-4a72-afe2-56908638188b tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:40:47.214820 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-839136a2-a8f6-4a72-afe2-56908638188b tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 39df2a30-b7e4-4a1d-add4-2e750de7ca33] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:40:47.221779 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-839136a2-a8f6-4a72-afe2-56908638188b tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:40:47.222322 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-839136a2-a8f6-4a72-afe2-56908638188b tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:40:47.222784 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-839136a2-a8f6-4a72-afe2-56908638188b tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:40:47.223502 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-839136a2-a8f6-4a72-afe2-56908638188b tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:40:47.223983 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-839136a2-a8f6-4a72-afe2-56908638188b tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:40:47.224429 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-839136a2-a8f6-4a72-afe2-56908638188b tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:40:47.413241 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-839136a2-a8f6-4a72-afe2-56908638188b tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81159cb7105b4f4e94527225ed45feeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e577cf747d5b4a12ba0ee81e686b8534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:40:47.421601 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-839136a2-a8f6-4a72-afe2-56908638188b tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "GET /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33" status: 200 len: 1755 microversion: 2.1 time: 0.211910 Oct 27 04:40:47.422208 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4107/7917] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:40:47 2022] GET /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33 => generated 1755 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:40:48.445382 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2eb61ef3-5563-41cc-8784-5f729dac916d tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:40:48.445921 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-2eb61ef3-5563-41cc-8784-5f729dac916d tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 39df2a30-b7e4-4a1d-add4-2e750de7ca33] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:40:48.452795 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2eb61ef3-5563-41cc-8784-5f729dac916d tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:40:48.453276 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2eb61ef3-5563-41cc-8784-5f729dac916d tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:40:48.453721 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2eb61ef3-5563-41cc-8784-5f729dac916d tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:40:48.454455 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2eb61ef3-5563-41cc-8784-5f729dac916d tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:40:48.454908 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2eb61ef3-5563-41cc-8784-5f729dac916d tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:40:48.455335 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2eb61ef3-5563-41cc-8784-5f729dac916d tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:40:48.932409 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2eb61ef3-5563-41cc-8784-5f729dac916d tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81159cb7105b4f4e94527225ed45feeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e577cf747d5b4a12ba0ee81e686b8534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:40:48.940599 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2eb61ef3-5563-41cc-8784-5f729dac916d tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "GET /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33" status: 200 len: 1758 microversion: 2.1 time: 0.499788 Oct 27 04:40:48.941184 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3811/7918] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:40:48 2022] GET /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33 => generated 1758 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:41:20.914528 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-663c030d-16c8-482b-af71-d5069fc16fe8 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-250808698"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:41:20.915343 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-663c030d-16c8-482b-af71-d5069fc16fe8 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 39df2a30-b7e4-4a1d-add4-2e750de7ca33] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:41:20.917233 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=20 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:41:20.917938 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:41:20.918749 n-d-862769-1 devstack@n-api.service[121001]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 04:41:20.918897 n-d-862769-1 devstack@n-api.service[121001]: Thu Oct 27 04:41:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33/action (ip 10.222.0.20) !!! Oct 27 04:41:20.928942 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-663c030d-16c8-482b-af71-d5069fc16fe8 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:41:20.929446 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-663c030d-16c8-482b-af71-d5069fc16fe8 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:41:20.929904 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-663c030d-16c8-482b-af71-d5069fc16fe8 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:41:20.930648 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-663c030d-16c8-482b-af71-d5069fc16fe8 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:41:20.931123 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-663c030d-16c8-482b-af71-d5069fc16fe8 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:41:20.931567 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-663c030d-16c8-482b-af71-d5069fc16fe8 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:41:21.059384 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.network.security_group_api [None req-663c030d-16c8-482b-af71-d5069fc16fe8 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Removing security group 77cb1ebe-cd3d-46c4-abbb-11f7c8bf6933 from port d204f963-898c-4124-86f4-e0f1a6fc7afa Oct 27 04:41:21.415172 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-663c030d-16c8-482b-af71-d5069fc16fe8 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "POST /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33/action" status: 202 len: 0 microversion: 2.1 time: 0.505490 Oct 27 04:41:21.415932 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4108/7919] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 04:41:20 2022] POST /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33/action => generated 0 bytes in 507 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 04:41:21.428082 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-0caf8e83-1166-4881-88e3-85a575f3d33b req-1fd08a56-4313-46dd-b448-bccb3426139f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39df2a30-b7e4-4a1d-add4-2e750de7ca33", "tag": "d204f963-898c-4124-86f4-e0f1a6fc7afa"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:41:21.433396 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=16 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:41:21.434113 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=48 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:41:21.440709 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-0caf8e83-1166-4881-88e3-85a575f3d33b req-1fd08a56-4313-46dd-b448-bccb3426139f service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:41:21.441133 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-0caf8e83-1166-4881-88e3-85a575f3d33b req-1fd08a56-4313-46dd-b448-bccb3426139f service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:41:21.441577 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-0caf8e83-1166-4881-88e3-85a575f3d33b req-1fd08a56-4313-46dd-b448-bccb3426139f service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:41:21.457117 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-0caf8e83-1166-4881-88e3-85a575f3d33b req-1fd08a56-4313-46dd-b448-bccb3426139f service nova] Creating event network-changed:d204f963-898c-4124-86f4-e0f1a6fc7afa for instance 39df2a30-b7e4-4a1d-add4-2e750de7ca33 on n-h2-862769-1 Oct 27 04:41:21.465200 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-0caf8e83-1166-4881-88e3-85a575f3d33b req-1fd08a56-4313-46dd-b448-bccb3426139f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040399 Oct 27 04:41:21.466582 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3812/7920] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:41:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:41:22.676297 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-78296dd1-a02c-4d7d-b171-b963f3421326 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:41:22.676837 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-78296dd1-a02c-4d7d-b171-b963f3421326 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 39df2a30-b7e4-4a1d-add4-2e750de7ca33] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:41:22.682919 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-78296dd1-a02c-4d7d-b171-b963f3421326 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:41:22.683430 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-78296dd1-a02c-4d7d-b171-b963f3421326 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:41:22.683892 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-78296dd1-a02c-4d7d-b171-b963f3421326 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:41:22.684606 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-78296dd1-a02c-4d7d-b171-b963f3421326 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:41:22.685078 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-78296dd1-a02c-4d7d-b171-b963f3421326 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:41:22.685520 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-78296dd1-a02c-4d7d-b171-b963f3421326 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:41:22.768602 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-78296dd1-a02c-4d7d-b171-b963f3421326 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lazy-loading 'services' on Instance uuid 39df2a30-b7e4-4a1d-add4-2e750de7ca33 {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 04:41:22.962300 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-78296dd1-a02c-4d7d-b171-b963f3421326 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "DELETE /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33/os-volume_attachments/a51c0400-9596-41dd-ba0a-f0b841555d1f" status: 202 len: 0 microversion: 2.1 time: 0.290691 Oct 27 04:41:22.965958 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4109/7921] 10.222.0.20 () {58 vars in 1416 bytes} [Thu Oct 27 04:41:22 2022] DELETE /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33/os-volume_attachments/a51c0400-9596-41dd-ba0a-f0b841555d1f => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 04:41:22.973184 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2df610e8-530a-4e9b-98fa-c8f3b4bc69ef tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:41:22.975540 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-2df610e8-530a-4e9b-98fa-c8f3b4bc69ef tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 39df2a30-b7e4-4a1d-add4-2e750de7ca33] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:41:22.982924 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2df610e8-530a-4e9b-98fa-c8f3b4bc69ef tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:41:22.983418 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2df610e8-530a-4e9b-98fa-c8f3b4bc69ef tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:41:22.983865 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2df610e8-530a-4e9b-98fa-c8f3b4bc69ef tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:41:22.984578 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2df610e8-530a-4e9b-98fa-c8f3b4bc69ef tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:41:22.985037 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2df610e8-530a-4e9b-98fa-c8f3b4bc69ef tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:41:22.985497 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2df610e8-530a-4e9b-98fa-c8f3b4bc69ef tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:41:23.015364 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2df610e8-530a-4e9b-98fa-c8f3b4bc69ef tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "GET /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047771 Oct 27 04:41:23.015939 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3813/7922] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 27 04:41:22 2022] GET /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:41:23.486446 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-b3f620e5-2f2a-4795-bd11-99e5c0060d25 req-cd65fc4b-e490-4350-ab4c-f39888d80569 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39df2a30-b7e4-4a1d-add4-2e750de7ca33", "tag": "d204f963-898c-4124-86f4-e0f1a6fc7afa"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:41:23.497117 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-b3f620e5-2f2a-4795-bd11-99e5c0060d25 req-cd65fc4b-e490-4350-ab4c-f39888d80569 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:41:23.497618 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-b3f620e5-2f2a-4795-bd11-99e5c0060d25 req-cd65fc4b-e490-4350-ab4c-f39888d80569 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:41:23.498088 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-b3f620e5-2f2a-4795-bd11-99e5c0060d25 req-cd65fc4b-e490-4350-ab4c-f39888d80569 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:41:23.509809 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-b3f620e5-2f2a-4795-bd11-99e5c0060d25 req-cd65fc4b-e490-4350-ab4c-f39888d80569 service nova] Creating event network-changed:d204f963-898c-4124-86f4-e0f1a6fc7afa for instance 39df2a30-b7e4-4a1d-add4-2e750de7ca33 on n-h2-862769-1 Oct 27 04:41:23.514961 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-b3f620e5-2f2a-4795-bd11-99e5c0060d25 req-cd65fc4b-e490-4350-ab4c-f39888d80569 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032734 Oct 27 04:41:23.515643 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4110/7923] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:41:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 04:41:24.028982 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7ea41956-a1b9-4490-8182-fbd266cfcb8f tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:41:24.031388 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7ea41956-a1b9-4490-8182-fbd266cfcb8f tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 39df2a30-b7e4-4a1d-add4-2e750de7ca33] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:41:24.038849 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7ea41956-a1b9-4490-8182-fbd266cfcb8f tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:41:24.040468 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7ea41956-a1b9-4490-8182-fbd266cfcb8f tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:41:24.040468 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7ea41956-a1b9-4490-8182-fbd266cfcb8f tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:41:24.040468 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7ea41956-a1b9-4490-8182-fbd266cfcb8f tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:41:24.040886 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7ea41956-a1b9-4490-8182-fbd266cfcb8f tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:41:24.041314 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7ea41956-a1b9-4490-8182-fbd266cfcb8f tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:41:24.071230 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7ea41956-a1b9-4490-8182-fbd266cfcb8f tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "GET /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046264 Oct 27 04:41:24.071805 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3814/7924] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 27 04:41:24 2022] GET /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 04:41:25.084750 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0cf5c6ad-88eb-41a2-894a-dbc5e725752c tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:41:25.087150 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0cf5c6ad-88eb-41a2-894a-dbc5e725752c tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 39df2a30-b7e4-4a1d-add4-2e750de7ca33] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:41:25.093668 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0cf5c6ad-88eb-41a2-894a-dbc5e725752c tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:41:25.094216 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0cf5c6ad-88eb-41a2-894a-dbc5e725752c tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:41:25.094683 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0cf5c6ad-88eb-41a2-894a-dbc5e725752c tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:41:25.095435 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0cf5c6ad-88eb-41a2-894a-dbc5e725752c tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:41:25.095895 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0cf5c6ad-88eb-41a2-894a-dbc5e725752c tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:41:25.096346 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0cf5c6ad-88eb-41a2-894a-dbc5e725752c tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:41:25.129796 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0cf5c6ad-88eb-41a2-894a-dbc5e725752c tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "GET /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050121 Oct 27 04:41:25.130442 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4111/7925] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 27 04:41:25 2022] GET /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:41:26.142920 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8fc86351-1475-41a4-a422-68e8dfec9d94 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:41:26.145131 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8fc86351-1475-41a4-a422-68e8dfec9d94 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 39df2a30-b7e4-4a1d-add4-2e750de7ca33] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:41:26.152661 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8fc86351-1475-41a4-a422-68e8dfec9d94 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:41:26.153158 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8fc86351-1475-41a4-a422-68e8dfec9d94 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:41:26.153607 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8fc86351-1475-41a4-a422-68e8dfec9d94 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:41:26.154337 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8fc86351-1475-41a4-a422-68e8dfec9d94 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:41:26.154802 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8fc86351-1475-41a4-a422-68e8dfec9d94 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:41:26.155234 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8fc86351-1475-41a4-a422-68e8dfec9d94 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:41:26.186169 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8fc86351-1475-41a4-a422-68e8dfec9d94 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "GET /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047277 Oct 27 04:41:26.186970 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3815/7926] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 27 04:41:26 2022] GET /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:41:27.199189 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e6cf730f-ee5e-472b-bbbc-fff57a07970d tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:41:27.201510 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e6cf730f-ee5e-472b-bbbc-fff57a07970d tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 39df2a30-b7e4-4a1d-add4-2e750de7ca33] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:41:27.208485 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e6cf730f-ee5e-472b-bbbc-fff57a07970d tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:41:27.208990 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e6cf730f-ee5e-472b-bbbc-fff57a07970d tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:41:27.209448 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e6cf730f-ee5e-472b-bbbc-fff57a07970d tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:41:27.210188 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e6cf730f-ee5e-472b-bbbc-fff57a07970d tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:41:27.210664 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e6cf730f-ee5e-472b-bbbc-fff57a07970d tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:41:27.211109 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e6cf730f-ee5e-472b-bbbc-fff57a07970d tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:41:27.244338 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e6cf730f-ee5e-472b-bbbc-fff57a07970d tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "GET /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049142 Oct 27 04:41:27.244920 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4112/7927] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 27 04:41:27 2022] GET /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:41:28.257543 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-dfa6ba5d-815c-4c35-a391-fac75a5cbf32 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:41:28.259804 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-dfa6ba5d-815c-4c35-a391-fac75a5cbf32 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 39df2a30-b7e4-4a1d-add4-2e750de7ca33] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:41:28.266208 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dfa6ba5d-815c-4c35-a391-fac75a5cbf32 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:41:28.266709 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dfa6ba5d-815c-4c35-a391-fac75a5cbf32 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:41:28.267160 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dfa6ba5d-815c-4c35-a391-fac75a5cbf32 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:41:28.267871 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dfa6ba5d-815c-4c35-a391-fac75a5cbf32 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:41:28.268328 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dfa6ba5d-815c-4c35-a391-fac75a5cbf32 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:41:28.268761 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dfa6ba5d-815c-4c35-a391-fac75a5cbf32 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:41:28.298057 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-dfa6ba5d-815c-4c35-a391-fac75a5cbf32 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "GET /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045179 Oct 27 04:41:28.298632 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3816/7928] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 27 04:41:28 2022] GET /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 04:41:28.309741 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5630f580-a9f0-46cc-b8e2-03377b360002 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:41:28.310305 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5630f580-a9f0-46cc-b8e2-03377b360002 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 39df2a30-b7e4-4a1d-add4-2e750de7ca33] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:41:28.317450 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5630f580-a9f0-46cc-b8e2-03377b360002 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:41:28.317963 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5630f580-a9f0-46cc-b8e2-03377b360002 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:41:28.318970 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5630f580-a9f0-46cc-b8e2-03377b360002 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:41:28.319829 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5630f580-a9f0-46cc-b8e2-03377b360002 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:41:28.320229 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5630f580-a9f0-46cc-b8e2-03377b360002 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:41:28.320685 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5630f580-a9f0-46cc-b8e2-03377b360002 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:41:28.396637 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-5630f580-a9f0-46cc-b8e2-03377b360002 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] HTTP exception thrown: Instance 39df2a30-b7e4-4a1d-add4-2e750de7ca33 is not attached to volume a51c0400-9596-41dd-ba0a-f0b841555d1f Oct 27 04:41:28.398317 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5630f580-a9f0-46cc-b8e2-03377b360002 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Request method failure captured: Oct 27 04:41:28.398317 n-d-862769-1 devstack@n-api.service[121001]: request: DELETE /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33/os-volume_attachments/a51c0400-9596-41dd-ba0a-f0b841555d1f HTTP/1.1 Oct 27 04:41:28.398317 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 04:41:28.398317 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 04:41:28.398317 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 04:41:28.398317 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 04:41:28.398317 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 04:41:28.398317 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 04:41:28.398317 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 04:41:28.398317 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 04:41:28.398317 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWgqCjQti08nR_2DR-dKVByhZGc9gh2B366WyLh9m_mIgx7KdUEg9zAEwBefXhiK40E84K798KXKXJcbwmeRhvLYN8J-j92vsp6XLaHfkvuYKf-CCqgegejdAlMWxOnoc9lydGVQC56J51KFSndLAVSoEu28Yo9C7x99-dOeM7kXLInk Oct 27 04:41:28.398317 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 04:41:28.398317 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 04:41:28.398317 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 04:41:28.398317 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 04:41:28.398317 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 04:41:28.398317 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 04:41:28.398317 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: e577cf747d5b4a12ba0ee81e686b8534 Oct 27 04:41:28.398317 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-TestMinimumBasicScenario-2056425032 Oct 27 04:41:28.398317 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 04:41:28.398317 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 04:41:28.398317 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e577cf747d5b4a12ba0ee81e686b8534"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e577cf747d5b4a12ba0ee81e686b8534"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e577cf747d5b4a12ba0ee81e686b8534"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e577cf747d5b4a12ba0ee81e686b8534"}]}] Oct 27 04:41:28.398317 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-TestMinimumBasicScenario-2056425032 Oct 27 04:41:28.398317 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: e577cf747d5b4a12ba0ee81e686b8534 Oct 27 04:41:28.398317 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2056425032 Oct 27 04:41:28.398317 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-TestMinimumBasicScenario-2056425032-project Oct 27 04:41:28.398317 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 04:41:28.398317 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 04:41:28.398317 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 81159cb7105b4f4e94527225ed45feeb Oct 27 04:41:28.398317 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-TestMinimumBasicScenario-2056425032-project Oct 27 04:41:28.398317 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 04:41:28.398317 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 39df2a30-b7e4-4a1d-add4-2e750de7ca33 is not attached to volume a51c0400-9596-41dd-ba0a-f0b841555d1f Oct 27 04:41:28.398317 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'server_id': '39df2a30-b7e4-4a1d-add4-2e750de7ca33', 'id': 'a51c0400-9596-41dd-ba0a-f0b841555d1f'} Oct 27 04:41:28.398317 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 04:41:28.398317 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:41:28.398317 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 27 04:41:28.398317 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 27 04:41:28.398317 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 04:41:28.398317 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 04:41:28.398317 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 27 04:41:28.398317 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 27 04:41:28.398317 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id a51c0400-9596-41dd-ba0a-f0b841555d1f. Oct 27 04:41:28.398317 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:41:28.398317 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:41:28.398317 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:41:28.398317 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:41:28.398317 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:41:28.398317 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:41:28.398317 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 04:41:28.398317 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 04:41:28.398317 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 04:41:28.398317 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 04:41:28.398317 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 27 04:41:28.398317 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 27 04:41:28.398317 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39df2a30-b7e4-4a1d-add4-2e750de7ca33 is not attached to volume a51c0400-9596-41dd-ba0a-f0b841555d1f Oct 27 04:41:28.398317 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:41:28.398317 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:41:28.398317 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:41:28.398317 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:41:28.398317 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:41:28.398317 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:41:28.403690 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 04:41:28.403690 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 04:41:28.403690 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39df2a30-b7e4-4a1d-add4-2e750de7ca33 is not attached to volume a51c0400-9596-41dd-ba0a-f0b841555d1f Oct 27 04:41:28.403690 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:41:28.403690 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5630f580-a9f0-46cc-b8e2-03377b360002 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Returning 404 to user: Instance 39df2a30-b7e4-4a1d-add4-2e750de7ca33 is not attached to volume a51c0400-9596-41dd-ba0a-f0b841555d1f {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 04:41:28.403690 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5630f580-a9f0-46cc-b8e2-03377b360002 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "DELETE /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33/os-volume_attachments/a51c0400-9596-41dd-ba0a-f0b841555d1f" status: 404 len: 154 microversion: 2.1 time: 0.094378 Oct 27 04:41:28.403690 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4113/7929] 10.222.0.20 () {58 vars in 1416 bytes} [Thu Oct 27 04:41:28 2022] DELETE /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33/os-volume_attachments/a51c0400-9596-41dd-ba0a-f0b841555d1f => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 04:41:31.757056 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-919f11e2-c307-405b-8260-49b2f8920556 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:41:31.757569 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-919f11e2-c307-405b-8260-49b2f8920556 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 39df2a30-b7e4-4a1d-add4-2e750de7ca33] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:41:31.764589 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-919f11e2-c307-405b-8260-49b2f8920556 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:41:31.765080 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-919f11e2-c307-405b-8260-49b2f8920556 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:41:31.765532 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-919f11e2-c307-405b-8260-49b2f8920556 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:41:31.766267 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-919f11e2-c307-405b-8260-49b2f8920556 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:41:31.766736 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-919f11e2-c307-405b-8260-49b2f8920556 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:41:31.767169 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-919f11e2-c307-405b-8260-49b2f8920556 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:41:31.792945 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-919f11e2-c307-405b-8260-49b2f8920556 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 39df2a30-b7e4-4a1d-add4-2e750de7ca33] Going to try to terminate instance {{(pid=121000) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 04:41:32.036360 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-919f11e2-c307-405b-8260-49b2f8920556 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "DELETE /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33" status: 204 len: 0 microversion: 2.1 time: 0.282610 Oct 27 04:41:32.037519 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3817/7930] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 04:41:31 2022] DELETE /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 04:41:32.046352 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ce938966-bc9d-45db-9d89-4e49ea674d42 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:41:32.047106 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ce938966-bc9d-45db-9d89-4e49ea674d42 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 39df2a30-b7e4-4a1d-add4-2e750de7ca33] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:41:32.053963 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ce938966-bc9d-45db-9d89-4e49ea674d42 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:41:32.054496 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ce938966-bc9d-45db-9d89-4e49ea674d42 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:41:32.054957 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ce938966-bc9d-45db-9d89-4e49ea674d42 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:41:32.055682 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ce938966-bc9d-45db-9d89-4e49ea674d42 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:41:32.056152 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ce938966-bc9d-45db-9d89-4e49ea674d42 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:41:32.056791 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ce938966-bc9d-45db-9d89-4e49ea674d42 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:41:32.199292 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ce938966-bc9d-45db-9d89-4e49ea674d42 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81159cb7105b4f4e94527225ed45feeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e577cf747d5b4a12ba0ee81e686b8534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:41:32.207728 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ce938966-bc9d-45db-9d89-4e49ea674d42 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "GET /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33" status: 200 len: 1553 microversion: 2.1 time: 0.165622 Oct 27 04:41:32.208329 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4114/7931] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:41:32 2022] GET /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33 => generated 1553 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:41:33.232452 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ce924362-3bbd-47c4-b3d9-3fa01c72c15d tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:41:33.233155 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ce924362-3bbd-47c4-b3d9-3fa01c72c15d tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 39df2a30-b7e4-4a1d-add4-2e750de7ca33] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:41:33.241198 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ce924362-3bbd-47c4-b3d9-3fa01c72c15d tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:41:33.241720 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ce924362-3bbd-47c4-b3d9-3fa01c72c15d tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:41:33.242191 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ce924362-3bbd-47c4-b3d9-3fa01c72c15d tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:41:33.242880 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ce924362-3bbd-47c4-b3d9-3fa01c72c15d tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:41:33.243336 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ce924362-3bbd-47c4-b3d9-3fa01c72c15d tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:41:33.243758 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ce924362-3bbd-47c4-b3d9-3fa01c72c15d tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:41:33.371790 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ce924362-3bbd-47c4-b3d9-3fa01c72c15d tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81159cb7105b4f4e94527225ed45feeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e577cf747d5b4a12ba0ee81e686b8534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:41:33.379472 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ce924362-3bbd-47c4-b3d9-3fa01c72c15d tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "GET /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33" status: 200 len: 1553 microversion: 2.1 time: 0.151603 Oct 27 04:41:33.380054 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3818/7932] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:41:33 2022] GET /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33 => generated 1553 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:41:34.252872 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-afbff060-3269-4763-b16a-5b1149277e22 req-be3d67ef-05ac-49f5-943b-cd79586d186a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39df2a30-b7e4-4a1d-add4-2e750de7ca33", "name": "network-vif-deleted", "tag": "d204f963-898c-4124-86f4-e0f1a6fc7afa"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:41:34.264011 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-afbff060-3269-4763-b16a-5b1149277e22 req-be3d67ef-05ac-49f5-943b-cd79586d186a service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:41:34.265429 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-afbff060-3269-4763-b16a-5b1149277e22 req-be3d67ef-05ac-49f5-943b-cd79586d186a service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:41:34.265429 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-afbff060-3269-4763-b16a-5b1149277e22 req-be3d67ef-05ac-49f5-943b-cd79586d186a service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:41:34.276681 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-afbff060-3269-4763-b16a-5b1149277e22 req-be3d67ef-05ac-49f5-943b-cd79586d186a service nova] Creating event network-vif-deleted:d204f963-898c-4124-86f4-e0f1a6fc7afa for instance 39df2a30-b7e4-4a1d-add4-2e750de7ca33 on n-h2-862769-1 Oct 27 04:41:34.281892 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-afbff060-3269-4763-b16a-5b1149277e22 req-be3d67ef-05ac-49f5-943b-cd79586d186a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032974 Oct 27 04:41:34.282525 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4115/7933] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:41:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:41:34.403055 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8b9a389b-68af-4339-a963-0cd7591bae41 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:41:34.403587 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8b9a389b-68af-4339-a963-0cd7591bae41 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 39df2a30-b7e4-4a1d-add4-2e750de7ca33] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:41:34.410571 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8b9a389b-68af-4339-a963-0cd7591bae41 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:41:34.411052 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8b9a389b-68af-4339-a963-0cd7591bae41 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:41:34.411490 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8b9a389b-68af-4339-a963-0cd7591bae41 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:41:34.412185 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8b9a389b-68af-4339-a963-0cd7591bae41 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:41:34.412633 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8b9a389b-68af-4339-a963-0cd7591bae41 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:41:34.413061 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8b9a389b-68af-4339-a963-0cd7591bae41 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:41:34.477544 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8b9a389b-68af-4339-a963-0cd7591bae41 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81159cb7105b4f4e94527225ed45feeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e577cf747d5b4a12ba0ee81e686b8534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:41:34.485742 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8b9a389b-68af-4339-a963-0cd7591bae41 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "GET /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33" status: 200 len: 1342 microversion: 2.1 time: 0.086733 Oct 27 04:41:34.486360 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3819/7934] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:41:34 2022] GET /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33 => generated 1342 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:41:35.510836 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9387c700-6bba-45a1-9bfd-1b391cd6f6d1 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:41:35.511567 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-9387c700-6bba-45a1-9bfd-1b391cd6f6d1 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] [instance: 39df2a30-b7e4-4a1d-add4-2e750de7ca33] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:41:35.517792 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9387c700-6bba-45a1-9bfd-1b391cd6f6d1 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:41:35.518329 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9387c700-6bba-45a1-9bfd-1b391cd6f6d1 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:41:35.518793 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9387c700-6bba-45a1-9bfd-1b391cd6f6d1 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:41:35.519507 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9387c700-6bba-45a1-9bfd-1b391cd6f6d1 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:41:35.519987 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9387c700-6bba-45a1-9bfd-1b391cd6f6d1 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:41:35.520433 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-9387c700-6bba-45a1-9bfd-1b391cd6f6d1 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:41:35.533651 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-9387c700-6bba-45a1-9bfd-1b391cd6f6d1 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] HTTP exception thrown: Instance 39df2a30-b7e4-4a1d-add4-2e750de7ca33 could not be found. Oct 27 04:41:35.535310 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9387c700-6bba-45a1-9bfd-1b391cd6f6d1 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Request method failure captured: Oct 27 04:41:35.535310 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33 HTTP/1.1 Oct 27 04:41:35.535310 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 04:41:35.535310 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 04:41:35.535310 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 04:41:35.535310 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 04:41:35.535310 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 04:41:35.535310 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 04:41:35.535310 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 04:41:35.535310 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 04:41:35.535310 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWgqCjQti08nR_2DR-dKVByhZGc9gh2B366WyLh9m_mIgx7KdUEg9zAEwBefXhiK40E84K798KXKXJcbwmeRhvLYN8J-j92vsp6XLaHfkvuYKf-CCqgegejdAlMWxOnoc9lydGVQC56J51KFSndLAVSoEu28Yo9C7x99-dOeM7kXLInk Oct 27 04:41:35.535310 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 04:41:35.535310 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 04:41:35.535310 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 04:41:35.535310 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 04:41:35.535310 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 04:41:35.535310 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 04:41:35.535310 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: e577cf747d5b4a12ba0ee81e686b8534 Oct 27 04:41:35.535310 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-TestMinimumBasicScenario-2056425032 Oct 27 04:41:35.535310 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 04:41:35.535310 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 04:41:35.535310 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e577cf747d5b4a12ba0ee81e686b8534"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e577cf747d5b4a12ba0ee81e686b8534"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e577cf747d5b4a12ba0ee81e686b8534"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e577cf747d5b4a12ba0ee81e686b8534"}]}] Oct 27 04:41:35.535310 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-TestMinimumBasicScenario-2056425032 Oct 27 04:41:35.535310 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: e577cf747d5b4a12ba0ee81e686b8534 Oct 27 04:41:35.535310 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2056425032 Oct 27 04:41:35.535310 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-TestMinimumBasicScenario-2056425032-project Oct 27 04:41:35.535310 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 04:41:35.535310 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 04:41:35.535310 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 81159cb7105b4f4e94527225ed45feeb Oct 27 04:41:35.535310 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-TestMinimumBasicScenario-2056425032-project Oct 27 04:41:35.535310 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 04:41:35.535310 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 39df2a30-b7e4-4a1d-add4-2e750de7ca33 could not be found. Oct 27 04:41:35.535310 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '39df2a30-b7e4-4a1d-add4-2e750de7ca33'} Oct 27 04:41:35.535310 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 04:41:35.535310 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:41:35.535310 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 04:41:35.535310 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 04:41:35.535310 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 04:41:35.535310 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 04:41:35.535310 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 04:41:35.535310 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 04:41:35.535310 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 04:41:35.535310 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 04:41:35.535310 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39df2a30-b7e4-4a1d-add4-2e750de7ca33 could not be found. Oct 27 04:41:35.535310 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:41:35.535310 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:41:35.535310 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:41:35.535310 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:41:35.535310 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:41:35.535310 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:41:35.535310 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 04:41:35.535310 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 04:41:35.535310 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 04:41:35.535310 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 04:41:35.535310 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 04:41:35.535310 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 04:41:35.535310 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 04:41:35.535310 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 04:41:35.535310 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 04:41:35.535310 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 04:41:35.535310 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39df2a30-b7e4-4a1d-add4-2e750de7ca33 could not be found. Oct 27 04:41:35.535310 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:41:35.535310 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:41:35.535310 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:41:35.541432 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:41:35.541432 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:41:35.541432 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:41:35.541432 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 04:41:35.541432 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 04:41:35.541432 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39df2a30-b7e4-4a1d-add4-2e750de7ca33 could not be found. Oct 27 04:41:35.541432 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:41:35.541432 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9387c700-6bba-45a1-9bfd-1b391cd6f6d1 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Returning 404 to user: Instance 39df2a30-b7e4-4a1d-add4-2e750de7ca33 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 04:41:35.541432 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9387c700-6bba-45a1-9bfd-1b391cd6f6d1 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "GET /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33" status: 404 len: 111 microversion: 2.1 time: 0.031265 Oct 27 04:41:35.541432 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4116/7935] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:41:35 2022] GET /compute/v2.1/servers/39df2a30-b7e4-4a1d-add4-2e750de7ca33 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 04:41:35.545812 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7cc15f3f-0e6b-43d7-84de-e47782bb7940 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] Calling method '.version_select at 0x7f7dda27fe50>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:41:35.623950 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7cc15f3f-0e6b-43d7-84de-e47782bb7940 tempest-TestMinimumBasicScenario-2056425032 tempest-TestMinimumBasicScenario-2056425032-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1013895728" status: 202 len: 0 microversion: 2.1 time: 0.081834 Oct 27 04:41:35.624568 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3820/7936] 10.222.0.20 () {58 vars in 1272 bytes} [Thu Oct 27 04:41:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1013895728 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 04:41:46.945409 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=18 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:41:46.946189 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:41:47.121154 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d6c93400-593a-454c-b6b9-da61a237a572 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Action: 'create', calling method: .version_select at 0x7f7dd9f7eaf0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-436086441", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKwRweB254o9Mm+8Zm8M0xcjCfd3OL+hBIdw4I7q7w5DvcUDUDfChPgRrPKm6aOG6Zh4rA4OJX3IvYtd17T3jDePRh9e1e+n8v9yqQ7BgXZKMiUkK+dSjjQQyhpLadua1A=="}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:41:47.138159 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-d6c93400-593a-454c-b6b9-da61a237a572 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Getting quotas for project 67648db046c54ee3b314904c8338cd61. Resources: {'key_pairs'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 04:41:47.143567 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-d6c93400-593a-454c-b6b9-da61a237a572 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Getting quotas for user 91e2c2dd9af848e5941d979683201c70 and project 67648db046c54ee3b314904c8338cd61. Resources: {'key_pairs'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 04:41:47.220179 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d6c93400-593a-454c-b6b9-da61a237a572 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.280873 Oct 27 04:41:47.220874 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4117/7937] 10.222.0.20 () {60 vars in 1159 bytes} [Thu Oct 27 04:41:46 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:41:55.587867 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:41:55.589307 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:41:55.595268 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b17b8eb3-7638-42be-9896-717423c1af7c tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-151561565", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": [{"uuid": "81b8f811-5843-41a4-856d-d7c290f1a467"}], "key_name": "tempest-TestNetworkAdvancedServerOps-436086441", "security_groups": [{"name": "tempest-secgroup-smoke-1301793224"}]}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:41:55.714427 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-b17b8eb3-7638-42be-9896-717423c1af7c tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] validate_networks() for [('81b8f811-5843-41a4-856d-d7c290f1a467', None, None, None, None, None)] {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 04:41:56.222872 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-b17b8eb3-7638-42be-9896-717423c1af7c tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 04:41:56.223314 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-b17b8eb3-7638-42be-9896-717423c1af7c tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 04:41:56.223846 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-b17b8eb3-7638-42be-9896-717423c1af7c tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 04:41:56.224266 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-b17b8eb3-7638-42be-9896-717423c1af7c tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 04:41:56.224681 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-b17b8eb3-7638-42be-9896-717423c1af7c tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 04:41:56.235094 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b17b8eb3-7638-42be-9896-717423c1af7c tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:41:56.235584 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b17b8eb3-7638-42be-9896-717423c1af7c tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:41:56.236025 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b17b8eb3-7638-42be-9896-717423c1af7c tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:41:56.236755 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b17b8eb3-7638-42be-9896-717423c1af7c tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:41:56.237215 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b17b8eb3-7638-42be-9896-717423c1af7c tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:41:56.237644 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b17b8eb3-7638-42be-9896-717423c1af7c tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:41:56.255545 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-b17b8eb3-7638-42be-9896-717423c1af7c tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Getting quotas for project 67648db046c54ee3b314904c8338cd61. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 04:41:56.261059 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-b17b8eb3-7638-42be-9896-717423c1af7c tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Getting quotas for user 91e2c2dd9af848e5941d979683201c70 and project 67648db046c54ee3b314904c8338cd61. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 04:41:56.276194 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b17b8eb3-7638-42be-9896-717423c1af7c tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 04:41:56.276194 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b17b8eb3-7638-42be-9896-717423c1af7c tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: dce2af84-5c5e-4e65-9047-212dda347fca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 04:41:56.392086 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b17b8eb3-7638-42be-9896-717423c1af7c tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.806587 Oct 27 04:41:56.397790 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3821/7938] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 04:41:55 2022] POST /compute/v2.1/servers => generated 406 bytes in 808 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 04:41:56.408128 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ef135a56-a373-46f4-a96e-f50d2f44313e tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:41:56.408788 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ef135a56-a373-46f4-a96e-f50d2f44313e tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: dce2af84-5c5e-4e65-9047-212dda347fca] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:41:56.472384 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ef135a56-a373-46f4-a96e-f50d2f44313e tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:41:56.480814 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ef135a56-a373-46f4-a96e-f50d2f44313e tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/dce2af84-5c5e-4e65-9047-212dda347fca" status: 200 len: 1265 microversion: 2.1 time: 0.080106 Oct 27 04:41:56.481438 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4118/7939] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:41:56 2022] GET /compute/v2.1/servers/dce2af84-5c5e-4e65-9047-212dda347fca => generated 1265 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:41:57.504823 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-98d4c23a-74ae-4d59-a126-b9d247e809ee tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:41:57.505639 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-98d4c23a-74ae-4d59-a126-b9d247e809ee tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: dce2af84-5c5e-4e65-9047-212dda347fca] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:41:57.565780 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-98d4c23a-74ae-4d59-a126-b9d247e809ee tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:41:57.573257 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-98d4c23a-74ae-4d59-a126-b9d247e809ee tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/dce2af84-5c5e-4e65-9047-212dda347fca" status: 200 len: 1265 microversion: 2.1 time: 0.072467 Oct 27 04:41:57.578437 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3822/7940] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:41:57 2022] GET /compute/v2.1/servers/dce2af84-5c5e-4e65-9047-212dda347fca => generated 1265 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 04:41:58.596798 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-56ece687-3ee2-47e2-8f3d-cf86cea97c42 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:41:58.597445 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-56ece687-3ee2-47e2-8f3d-cf86cea97c42 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: dce2af84-5c5e-4e65-9047-212dda347fca] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:41:58.605509 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-56ece687-3ee2-47e2-8f3d-cf86cea97c42 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:41:58.606017 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-56ece687-3ee2-47e2-8f3d-cf86cea97c42 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:41:58.606542 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-56ece687-3ee2-47e2-8f3d-cf86cea97c42 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:41:58.607269 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-56ece687-3ee2-47e2-8f3d-cf86cea97c42 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:41:58.607750 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-56ece687-3ee2-47e2-8f3d-cf86cea97c42 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:41:58.608204 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-56ece687-3ee2-47e2-8f3d-cf86cea97c42 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:41:58.672057 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-56ece687-3ee2-47e2-8f3d-cf86cea97c42 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:41:58.681265 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-56ece687-3ee2-47e2-8f3d-cf86cea97c42 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/dce2af84-5c5e-4e65-9047-212dda347fca" status: 200 len: 1317 microversion: 2.1 time: 0.088348 Oct 27 04:41:58.681856 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4119/7941] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:41:58 2022] GET /compute/v2.1/servers/dce2af84-5c5e-4e65-9047-212dda347fca => generated 1317 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:41:59.705114 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1b0b9b38-724a-44d0-8fdc-245e0dd413d2 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:41:59.706151 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1b0b9b38-724a-44d0-8fdc-245e0dd413d2 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: dce2af84-5c5e-4e65-9047-212dda347fca] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:41:59.714083 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1b0b9b38-724a-44d0-8fdc-245e0dd413d2 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:41:59.714083 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1b0b9b38-724a-44d0-8fdc-245e0dd413d2 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:41:59.714083 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1b0b9b38-724a-44d0-8fdc-245e0dd413d2 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:41:59.714605 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1b0b9b38-724a-44d0-8fdc-245e0dd413d2 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:41:59.715071 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1b0b9b38-724a-44d0-8fdc-245e0dd413d2 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:41:59.715510 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1b0b9b38-724a-44d0-8fdc-245e0dd413d2 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:41:59.866886 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1b0b9b38-724a-44d0-8fdc-245e0dd413d2 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:41:59.874947 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1b0b9b38-724a-44d0-8fdc-245e0dd413d2 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/dce2af84-5c5e-4e65-9047-212dda347fca" status: 200 len: 1391 microversion: 2.1 time: 0.173971 Oct 27 04:41:59.875543 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3823/7942] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:41:59 2022] GET /compute/v2.1/servers/dce2af84-5c5e-4e65-9047-212dda347fca => generated 1391 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:42:00.731988 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-913c5bfb-8643-419f-a872-66484cf6f316 req-686fa755-5f58-48e2-ae4c-e7005ced1931 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dce2af84-5c5e-4e65-9047-212dda347fca", "tag": "25f1bbbd-7135-4aa2-b125-33e7355091e1"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:42:00.742239 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-913c5bfb-8643-419f-a872-66484cf6f316 req-686fa755-5f58-48e2-ae4c-e7005ced1931 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:42:00.742735 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-913c5bfb-8643-419f-a872-66484cf6f316 req-686fa755-5f58-48e2-ae4c-e7005ced1931 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:42:00.743187 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-913c5bfb-8643-419f-a872-66484cf6f316 req-686fa755-5f58-48e2-ae4c-e7005ced1931 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:42:00.755785 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-913c5bfb-8643-419f-a872-66484cf6f316 req-686fa755-5f58-48e2-ae4c-e7005ced1931 service nova] Creating event network-changed:25f1bbbd-7135-4aa2-b125-33e7355091e1 for instance dce2af84-5c5e-4e65-9047-212dda347fca on n-h1-862769-1 Oct 27 04:42:00.761487 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-913c5bfb-8643-419f-a872-66484cf6f316 req-686fa755-5f58-48e2-ae4c-e7005ced1931 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033640 Oct 27 04:42:00.762144 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4120/7943] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:42:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:42:00.899609 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-714b6a64-1db7-4bd3-b4d7-82238d75d645 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:42:00.900246 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-714b6a64-1db7-4bd3-b4d7-82238d75d645 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: dce2af84-5c5e-4e65-9047-212dda347fca] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:42:00.907337 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-714b6a64-1db7-4bd3-b4d7-82238d75d645 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:42:00.907837 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-714b6a64-1db7-4bd3-b4d7-82238d75d645 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:42:00.908290 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-714b6a64-1db7-4bd3-b4d7-82238d75d645 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:42:00.909006 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-714b6a64-1db7-4bd3-b4d7-82238d75d645 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:42:00.909469 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-714b6a64-1db7-4bd3-b4d7-82238d75d645 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:42:00.909909 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-714b6a64-1db7-4bd3-b4d7-82238d75d645 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:42:01.048514 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-714b6a64-1db7-4bd3-b4d7-82238d75d645 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:42:01.056852 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-714b6a64-1db7-4bd3-b4d7-82238d75d645 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/dce2af84-5c5e-4e65-9047-212dda347fca" status: 200 len: 1391 microversion: 2.1 time: 0.161870 Oct 27 04:42:01.057437 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3824/7944] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:42:00 2022] GET /compute/v2.1/servers/dce2af84-5c5e-4e65-9047-212dda347fca => generated 1391 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:42:02.081573 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4d7b9238-b15c-48c2-a640-0d52be2307df tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:42:02.082338 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4d7b9238-b15c-48c2-a640-0d52be2307df tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: dce2af84-5c5e-4e65-9047-212dda347fca] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:42:02.089239 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4d7b9238-b15c-48c2-a640-0d52be2307df tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:42:02.089738 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4d7b9238-b15c-48c2-a640-0d52be2307df tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:42:02.090234 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4d7b9238-b15c-48c2-a640-0d52be2307df tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:42:02.090946 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4d7b9238-b15c-48c2-a640-0d52be2307df tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:42:02.091415 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4d7b9238-b15c-48c2-a640-0d52be2307df tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:42:02.091859 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4d7b9238-b15c-48c2-a640-0d52be2307df tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:42:02.225392 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4d7b9238-b15c-48c2-a640-0d52be2307df tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:42:02.233333 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4d7b9238-b15c-48c2-a640-0d52be2307df tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/dce2af84-5c5e-4e65-9047-212dda347fca" status: 200 len: 1391 microversion: 2.1 time: 0.156909 Oct 27 04:42:02.233915 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4121/7945] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:42:02 2022] GET /compute/v2.1/servers/dce2af84-5c5e-4e65-9047-212dda347fca => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:42:03.256316 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ca0271bb-e057-436e-9962-3c9c860c3671 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:42:03.257001 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ca0271bb-e057-436e-9962-3c9c860c3671 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: dce2af84-5c5e-4e65-9047-212dda347fca] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:42:03.263834 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ca0271bb-e057-436e-9962-3c9c860c3671 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:42:03.264329 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ca0271bb-e057-436e-9962-3c9c860c3671 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:42:03.264779 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ca0271bb-e057-436e-9962-3c9c860c3671 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:42:03.265492 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ca0271bb-e057-436e-9962-3c9c860c3671 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:42:03.265961 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ca0271bb-e057-436e-9962-3c9c860c3671 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:42:03.266423 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ca0271bb-e057-436e-9962-3c9c860c3671 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:42:03.404233 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ca0271bb-e057-436e-9962-3c9c860c3671 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:42:03.411930 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ca0271bb-e057-436e-9962-3c9c860c3671 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/dce2af84-5c5e-4e65-9047-212dda347fca" status: 200 len: 1391 microversion: 2.1 time: 0.159682 Oct 27 04:42:03.412502 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3825/7946] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:42:03 2022] GET /compute/v2.1/servers/dce2af84-5c5e-4e65-9047-212dda347fca => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:42:04.435155 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c0261bc9-10b5-4918-8914-9545aaf3c7c5 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:42:04.435839 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c0261bc9-10b5-4918-8914-9545aaf3c7c5 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: dce2af84-5c5e-4e65-9047-212dda347fca] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:42:04.442712 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c0261bc9-10b5-4918-8914-9545aaf3c7c5 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:42:04.443214 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c0261bc9-10b5-4918-8914-9545aaf3c7c5 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:42:04.443676 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c0261bc9-10b5-4918-8914-9545aaf3c7c5 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:42:04.444390 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c0261bc9-10b5-4918-8914-9545aaf3c7c5 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:42:04.444866 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c0261bc9-10b5-4918-8914-9545aaf3c7c5 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:42:04.445313 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c0261bc9-10b5-4918-8914-9545aaf3c7c5 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:42:04.578300 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c0261bc9-10b5-4918-8914-9545aaf3c7c5 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:42:04.585945 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c0261bc9-10b5-4918-8914-9545aaf3c7c5 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/dce2af84-5c5e-4e65-9047-212dda347fca" status: 200 len: 1391 microversion: 2.1 time: 0.154742 Oct 27 04:42:04.587184 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4122/7947] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:42:04 2022] GET /compute/v2.1/servers/dce2af84-5c5e-4e65-9047-212dda347fca => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:42:05.609352 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-58dce09b-7960-48c8-b89a-5322a6dcc199 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:42:05.609998 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-58dce09b-7960-48c8-b89a-5322a6dcc199 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: dce2af84-5c5e-4e65-9047-212dda347fca] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:42:05.616788 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-58dce09b-7960-48c8-b89a-5322a6dcc199 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:42:05.617272 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-58dce09b-7960-48c8-b89a-5322a6dcc199 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:42:05.618305 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-58dce09b-7960-48c8-b89a-5322a6dcc199 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:42:05.619000 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-58dce09b-7960-48c8-b89a-5322a6dcc199 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:42:05.619454 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-58dce09b-7960-48c8-b89a-5322a6dcc199 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:42:05.619878 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-58dce09b-7960-48c8-b89a-5322a6dcc199 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:42:05.750933 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-58dce09b-7960-48c8-b89a-5322a6dcc199 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:42:05.758491 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-58dce09b-7960-48c8-b89a-5322a6dcc199 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/dce2af84-5c5e-4e65-9047-212dda347fca" status: 200 len: 1391 microversion: 2.1 time: 0.153163 Oct 27 04:42:05.759067 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3826/7948] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:42:05 2022] GET /compute/v2.1/servers/dce2af84-5c5e-4e65-9047-212dda347fca => generated 1391 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:42:06.781090 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2a9c10c3-fa47-45aa-b8a1-f34299d87e01 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:42:06.781788 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2a9c10c3-fa47-45aa-b8a1-f34299d87e01 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: dce2af84-5c5e-4e65-9047-212dda347fca] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:42:06.784966 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=6 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:42:06.790483 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2a9c10c3-fa47-45aa-b8a1-f34299d87e01 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:42:06.790985 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2a9c10c3-fa47-45aa-b8a1-f34299d87e01 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:42:06.791443 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2a9c10c3-fa47-45aa-b8a1-f34299d87e01 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:42:06.792507 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2a9c10c3-fa47-45aa-b8a1-f34299d87e01 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:42:06.792692 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2a9c10c3-fa47-45aa-b8a1-f34299d87e01 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:42:06.793089 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2a9c10c3-fa47-45aa-b8a1-f34299d87e01 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:42:06.925223 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2a9c10c3-fa47-45aa-b8a1-f34299d87e01 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:42:06.933119 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2a9c10c3-fa47-45aa-b8a1-f34299d87e01 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/dce2af84-5c5e-4e65-9047-212dda347fca" status: 200 len: 1391 microversion: 2.1 time: 0.156037 Oct 27 04:42:06.933743 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4123/7949] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:42:06 2022] GET /compute/v2.1/servers/dce2af84-5c5e-4e65-9047-212dda347fca => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:42:06.950188 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-f733b06c-51d7-4f1d-9c80-d937f1da4dca req-7e528f9f-95c2-490b-b8e3-3126e1fc8c41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dce2af84-5c5e-4e65-9047-212dda347fca", "name": "network-vif-plugged", "status": "completed", "tag": "25f1bbbd-7135-4aa2-b125-33e7355091e1"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:42:06.956262 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:42:06.961131 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-f733b06c-51d7-4f1d-9c80-d937f1da4dca req-7e528f9f-95c2-490b-b8e3-3126e1fc8c41 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:42:06.962253 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-f733b06c-51d7-4f1d-9c80-d937f1da4dca req-7e528f9f-95c2-490b-b8e3-3126e1fc8c41 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:42:06.962698 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-f733b06c-51d7-4f1d-9c80-d937f1da4dca req-7e528f9f-95c2-490b-b8e3-3126e1fc8c41 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:42:06.973812 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-f733b06c-51d7-4f1d-9c80-d937f1da4dca req-7e528f9f-95c2-490b-b8e3-3126e1fc8c41 service nova] Creating event network-vif-plugged:25f1bbbd-7135-4aa2-b125-33e7355091e1 for instance dce2af84-5c5e-4e65-9047-212dda347fca on n-h1-862769-1 Oct 27 04:42:06.979264 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-f733b06c-51d7-4f1d-9c80-d937f1da4dca req-7e528f9f-95c2-490b-b8e3-3126e1fc8c41 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033453 Oct 27 04:42:06.980131 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3827/7950] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:42:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 04:42:07.956929 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f66cb9fc-6737-47fb-98b1-8efe0c8afc89 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:42:07.957578 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f66cb9fc-6737-47fb-98b1-8efe0c8afc89 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: dce2af84-5c5e-4e65-9047-212dda347fca] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:42:07.965070 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f66cb9fc-6737-47fb-98b1-8efe0c8afc89 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:42:07.965576 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f66cb9fc-6737-47fb-98b1-8efe0c8afc89 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:42:07.966057 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f66cb9fc-6737-47fb-98b1-8efe0c8afc89 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:42:07.966787 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f66cb9fc-6737-47fb-98b1-8efe0c8afc89 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:42:07.967274 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f66cb9fc-6737-47fb-98b1-8efe0c8afc89 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:42:07.967723 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f66cb9fc-6737-47fb-98b1-8efe0c8afc89 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:42:08.101002 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f66cb9fc-6737-47fb-98b1-8efe0c8afc89 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:42:08.109962 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f66cb9fc-6737-47fb-98b1-8efe0c8afc89 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/dce2af84-5c5e-4e65-9047-212dda347fca" status: 200 len: 1391 microversion: 2.1 time: 0.156904 Oct 27 04:42:08.115771 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4124/7951] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:42:07 2022] GET /compute/v2.1/servers/dce2af84-5c5e-4e65-9047-212dda347fca => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:42:09.134636 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a90d3ce9-4cbd-4ca5-aad2-0f98cd2d86b2 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:42:09.135342 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a90d3ce9-4cbd-4ca5-aad2-0f98cd2d86b2 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: dce2af84-5c5e-4e65-9047-212dda347fca] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:42:09.137265 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=8 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:42:09.143180 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a90d3ce9-4cbd-4ca5-aad2-0f98cd2d86b2 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:42:09.143666 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a90d3ce9-4cbd-4ca5-aad2-0f98cd2d86b2 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:42:09.144105 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a90d3ce9-4cbd-4ca5-aad2-0f98cd2d86b2 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:42:09.144853 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a90d3ce9-4cbd-4ca5-aad2-0f98cd2d86b2 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:42:09.145310 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a90d3ce9-4cbd-4ca5-aad2-0f98cd2d86b2 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:42:09.145736 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a90d3ce9-4cbd-4ca5-aad2-0f98cd2d86b2 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:42:09.283047 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a90d3ce9-4cbd-4ca5-aad2-0f98cd2d86b2 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:42:09.291322 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a90d3ce9-4cbd-4ca5-aad2-0f98cd2d86b2 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/dce2af84-5c5e-4e65-9047-212dda347fca" status: 200 len: 1564 microversion: 2.1 time: 0.161322 Oct 27 04:42:09.291911 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3828/7952] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:42:09 2022] GET /compute/v2.1/servers/dce2af84-5c5e-4e65-9047-212dda347fca => generated 1564 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:42:09.314108 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f2bdcc85-aa4f-458f-a740-dec4ae2dfd50 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:42:09.314788 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f2bdcc85-aa4f-458f-a740-dec4ae2dfd50 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: dce2af84-5c5e-4e65-9047-212dda347fca] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:42:09.321865 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f2bdcc85-aa4f-458f-a740-dec4ae2dfd50 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:42:09.322409 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f2bdcc85-aa4f-458f-a740-dec4ae2dfd50 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:42:09.322881 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f2bdcc85-aa4f-458f-a740-dec4ae2dfd50 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:42:09.323602 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f2bdcc85-aa4f-458f-a740-dec4ae2dfd50 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:42:09.324084 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f2bdcc85-aa4f-458f-a740-dec4ae2dfd50 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:42:09.324537 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f2bdcc85-aa4f-458f-a740-dec4ae2dfd50 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:42:09.458069 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f2bdcc85-aa4f-458f-a740-dec4ae2dfd50 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:42:09.465844 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f2bdcc85-aa4f-458f-a740-dec4ae2dfd50 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/dce2af84-5c5e-4e65-9047-212dda347fca" status: 200 len: 1564 microversion: 2.1 time: 0.155728 Oct 27 04:42:09.466455 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4125/7953] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:42:09 2022] GET /compute/v2.1/servers/dce2af84-5c5e-4e65-9047-212dda347fca => generated 1564 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:42:11.281658 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-13aa718e-1302-47b5-a309-a0ab1ec870ca tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:42:11.282359 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-13aa718e-1302-47b5-a309-a0ab1ec870ca tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: dce2af84-5c5e-4e65-9047-212dda347fca] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:42:11.284637 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-b24613aa-f5c4-4126-9fb0-cfcd1adb24ef req-04544890-d1d8-4949-b510-cb098233c9e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dce2af84-5c5e-4e65-9047-212dda347fca", "tag": "25f1bbbd-7135-4aa2-b125-33e7355091e1"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:42:11.290606 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-13aa718e-1302-47b5-a309-a0ab1ec870ca tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:42:11.291360 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-13aa718e-1302-47b5-a309-a0ab1ec870ca tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:42:11.291571 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-13aa718e-1302-47b5-a309-a0ab1ec870ca tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:42:11.292746 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-13aa718e-1302-47b5-a309-a0ab1ec870ca tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:42:11.292746 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-13aa718e-1302-47b5-a309-a0ab1ec870ca tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:42:11.293196 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-13aa718e-1302-47b5-a309-a0ab1ec870ca tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:42:11.294868 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-b24613aa-f5c4-4126-9fb0-cfcd1adb24ef req-04544890-d1d8-4949-b510-cb098233c9e9 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:42:11.295375 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-b24613aa-f5c4-4126-9fb0-cfcd1adb24ef req-04544890-d1d8-4949-b510-cb098233c9e9 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:42:11.295837 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-b24613aa-f5c4-4126-9fb0-cfcd1adb24ef req-04544890-d1d8-4949-b510-cb098233c9e9 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:42:11.308423 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-b24613aa-f5c4-4126-9fb0-cfcd1adb24ef req-04544890-d1d8-4949-b510-cb098233c9e9 service nova] Creating event network-changed:25f1bbbd-7135-4aa2-b125-33e7355091e1 for instance dce2af84-5c5e-4e65-9047-212dda347fca on n-h1-862769-1 Oct 27 04:42:11.313800 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-b24613aa-f5c4-4126-9fb0-cfcd1adb24ef req-04544890-d1d8-4949-b510-cb098233c9e9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033799 Oct 27 04:42:11.314619 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4126/7954] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:42:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 04:42:11.447952 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-13aa718e-1302-47b5-a309-a0ab1ec870ca tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:42:11.455849 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-13aa718e-1302-47b5-a309-a0ab1ec870ca tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/dce2af84-5c5e-4e65-9047-212dda347fca" status: 200 len: 1564 microversion: 2.1 time: 0.178432 Oct 27 04:42:11.456534 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3829/7955] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:42:11 2022] GET /compute/v2.1/servers/dce2af84-5c5e-4e65-9047-212dda347fca => generated 1564 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:42:34.766792 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:42:34.767581 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=40 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:42:34.771877 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d3c5c273-b377-4f32-ba06-1cc7786fb7eb tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:42:34.774231 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d3c5c273-b377-4f32-ba06-1cc7786fb7eb tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: dce2af84-5c5e-4e65-9047-212dda347fca] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:42:34.780456 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d3c5c273-b377-4f32-ba06-1cc7786fb7eb tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:42:34.780962 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d3c5c273-b377-4f32-ba06-1cc7786fb7eb tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:42:34.781425 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d3c5c273-b377-4f32-ba06-1cc7786fb7eb tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:42:34.782181 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d3c5c273-b377-4f32-ba06-1cc7786fb7eb tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:42:34.782663 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d3c5c273-b377-4f32-ba06-1cc7786fb7eb tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:42:34.783112 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d3c5c273-b377-4f32-ba06-1cc7786fb7eb tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:42:34.835712 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d3c5c273-b377-4f32-ba06-1cc7786fb7eb tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "POST /compute/v2.1/servers/dce2af84-5c5e-4e65-9047-212dda347fca/action" status: 200 len: 24564 microversion: 2.1 time: 0.070810 Oct 27 04:42:34.836457 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4127/7956] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 04:42:34 2022] POST /compute/v2.1/servers/dce2af84-5c5e-4e65-9047-212dda347fca/action => generated 24564 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 04:42:45.762267 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d70926c1-b05c-4ec8-8701-06e7626c2d3e tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:42:45.762872 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d70926c1-b05c-4ec8-8701-06e7626c2d3e tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: dce2af84-5c5e-4e65-9047-212dda347fca] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:42:45.764929 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:42:45.765600 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=40 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:42:45.770230 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d70926c1-b05c-4ec8-8701-06e7626c2d3e tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:42:45.770724 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d70926c1-b05c-4ec8-8701-06e7626c2d3e tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:42:45.771167 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d70926c1-b05c-4ec8-8701-06e7626c2d3e tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:42:45.771887 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d70926c1-b05c-4ec8-8701-06e7626c2d3e tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:42:45.772349 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d70926c1-b05c-4ec8-8701-06e7626c2d3e tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:42:45.772786 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d70926c1-b05c-4ec8-8701-06e7626c2d3e tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:42:45.963733 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d70926c1-b05c-4ec8-8701-06e7626c2d3e tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "POST /compute/v2.1/servers/dce2af84-5c5e-4e65-9047-212dda347fca/action" status: 202 len: 0 microversion: 2.1 time: 0.205851 Oct 27 04:42:45.964475 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3830/7957] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 04:42:45 2022] POST /compute/v2.1/servers/dce2af84-5c5e-4e65-9047-212dda347fca/action => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 04:42:45.973868 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-873c6163-6868-4f40-affa-ef415a4eb220 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:42:45.978783 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-873c6163-6868-4f40-affa-ef415a4eb220 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: dce2af84-5c5e-4e65-9047-212dda347fca] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:42:45.984072 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-873c6163-6868-4f40-affa-ef415a4eb220 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:42:45.984585 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-873c6163-6868-4f40-affa-ef415a4eb220 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:42:45.985050 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-873c6163-6868-4f40-affa-ef415a4eb220 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:42:45.985778 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-873c6163-6868-4f40-affa-ef415a4eb220 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:42:45.986287 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-873c6163-6868-4f40-affa-ef415a4eb220 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:42:45.986742 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-873c6163-6868-4f40-affa-ef415a4eb220 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:42:46.127464 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-873c6163-6868-4f40-affa-ef415a4eb220 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:42:46.135467 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-873c6163-6868-4f40-affa-ef415a4eb220 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/dce2af84-5c5e-4e65-9047-212dda347fca" status: 200 len: 1688 microversion: 2.1 time: 0.166565 Oct 27 04:42:46.136619 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4128/7958] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:42:45 2022] GET /compute/v2.1/servers/dce2af84-5c5e-4e65-9047-212dda347fca => generated 1688 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:42:47.159860 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e1df6721-a073-4368-99b3-8e06b8073753 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:42:47.160571 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e1df6721-a073-4368-99b3-8e06b8073753 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: dce2af84-5c5e-4e65-9047-212dda347fca] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:42:47.167995 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e1df6721-a073-4368-99b3-8e06b8073753 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:42:47.168481 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e1df6721-a073-4368-99b3-8e06b8073753 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:42:47.168986 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e1df6721-a073-4368-99b3-8e06b8073753 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:42:47.169682 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e1df6721-a073-4368-99b3-8e06b8073753 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:42:47.170160 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e1df6721-a073-4368-99b3-8e06b8073753 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:42:47.170591 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e1df6721-a073-4368-99b3-8e06b8073753 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:42:47.305226 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e1df6721-a073-4368-99b3-8e06b8073753 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:42:47.312963 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e1df6721-a073-4368-99b3-8e06b8073753 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/dce2af84-5c5e-4e65-9047-212dda347fca" status: 200 len: 1668 microversion: 2.1 time: 0.157634 Oct 27 04:42:47.313546 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3831/7959] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:42:47 2022] GET /compute/v2.1/servers/dce2af84-5c5e-4e65-9047-212dda347fca => generated 1668 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:42:48.408870 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6e9bfbde-2d23-4200-85c8-47b083e1936f tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:42:48.411286 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-6e9bfbde-2d23-4200-85c8-47b083e1936f tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: dce2af84-5c5e-4e65-9047-212dda347fca] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:42:48.418182 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6e9bfbde-2d23-4200-85c8-47b083e1936f tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:42:48.418696 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6e9bfbde-2d23-4200-85c8-47b083e1936f tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:42:48.419155 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6e9bfbde-2d23-4200-85c8-47b083e1936f tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:42:48.419876 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6e9bfbde-2d23-4200-85c8-47b083e1936f tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:42:48.420352 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6e9bfbde-2d23-4200-85c8-47b083e1936f tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:42:48.420805 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6e9bfbde-2d23-4200-85c8-47b083e1936f tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:42:48.492418 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6e9bfbde-2d23-4200-85c8-47b083e1936f tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "POST /compute/v2.1/servers/dce2af84-5c5e-4e65-9047-212dda347fca/action" status: 200 len: 32639 microversion: 2.1 time: 0.087685 Oct 27 04:42:48.493079 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4129/7960] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 04:42:48 2022] POST /compute/v2.1/servers/dce2af84-5c5e-4e65-9047-212dda347fca/action => generated 32639 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 04:42:48.505142 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e305f773-5bd1-4047-85ba-31c5c2055542 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:42:48.507599 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e305f773-5bd1-4047-85ba-31c5c2055542 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: dce2af84-5c5e-4e65-9047-212dda347fca] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:42:48.513189 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e305f773-5bd1-4047-85ba-31c5c2055542 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:42:48.513635 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e305f773-5bd1-4047-85ba-31c5c2055542 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:42:48.514099 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e305f773-5bd1-4047-85ba-31c5c2055542 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:42:48.514803 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e305f773-5bd1-4047-85ba-31c5c2055542 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:42:48.515267 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e305f773-5bd1-4047-85ba-31c5c2055542 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:42:48.515735 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e305f773-5bd1-4047-85ba-31c5c2055542 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:42:48.654768 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e305f773-5bd1-4047-85ba-31c5c2055542 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "POST /compute/v2.1/servers/dce2af84-5c5e-4e65-9047-212dda347fca/action" status: 202 len: 0 microversion: 2.1 time: 0.153306 Oct 27 04:42:48.655415 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3832/7961] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 04:42:48 2022] POST /compute/v2.1/servers/dce2af84-5c5e-4e65-9047-212dda347fca/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 04:42:48.664623 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7d9c7219-d3b4-47f3-a502-e4247a5ad256 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:42:48.665366 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7d9c7219-d3b4-47f3-a502-e4247a5ad256 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: dce2af84-5c5e-4e65-9047-212dda347fca] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:42:48.673993 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7d9c7219-d3b4-47f3-a502-e4247a5ad256 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:42:48.674591 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7d9c7219-d3b4-47f3-a502-e4247a5ad256 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:42:48.675045 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7d9c7219-d3b4-47f3-a502-e4247a5ad256 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:42:48.675786 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7d9c7219-d3b4-47f3-a502-e4247a5ad256 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:42:48.676267 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7d9c7219-d3b4-47f3-a502-e4247a5ad256 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:42:48.676722 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7d9c7219-d3b4-47f3-a502-e4247a5ad256 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:42:48.815956 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7d9c7219-d3b4-47f3-a502-e4247a5ad256 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:42:48.823986 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7d9c7219-d3b4-47f3-a502-e4247a5ad256 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/dce2af84-5c5e-4e65-9047-212dda347fca" status: 200 len: 1675 microversion: 2.1 time: 0.163989 Oct 27 04:42:48.824583 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4130/7962] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:42:48 2022] GET /compute/v2.1/servers/dce2af84-5c5e-4e65-9047-212dda347fca => generated 1675 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:42:49.848661 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7c10cac6-8eb3-4dd9-a66d-68282d746391 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:42:49.849367 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7c10cac6-8eb3-4dd9-a66d-68282d746391 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: dce2af84-5c5e-4e65-9047-212dda347fca] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:42:49.857288 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7c10cac6-8eb3-4dd9-a66d-68282d746391 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:42:49.857773 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7c10cac6-8eb3-4dd9-a66d-68282d746391 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:42:49.858246 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7c10cac6-8eb3-4dd9-a66d-68282d746391 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:42:49.858938 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7c10cac6-8eb3-4dd9-a66d-68282d746391 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:42:49.859420 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7c10cac6-8eb3-4dd9-a66d-68282d746391 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:42:49.859822 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7c10cac6-8eb3-4dd9-a66d-68282d746391 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:42:49.990214 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7c10cac6-8eb3-4dd9-a66d-68282d746391 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:42:49.998907 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7c10cac6-8eb3-4dd9-a66d-68282d746391 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/dce2af84-5c5e-4e65-9047-212dda347fca" status: 200 len: 1683 microversion: 2.1 time: 0.153546 Oct 27 04:42:49.998907 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3833/7963] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:42:49 2022] GET /compute/v2.1/servers/dce2af84-5c5e-4e65-9047-212dda347fca => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:42:50.092509 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6fe9426a-15f8-4dea-be2b-4de277940ca5 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:42:50.094774 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-6fe9426a-15f8-4dea-be2b-4de277940ca5 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: dce2af84-5c5e-4e65-9047-212dda347fca] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:42:50.102594 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6fe9426a-15f8-4dea-be2b-4de277940ca5 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:42:50.103048 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6fe9426a-15f8-4dea-be2b-4de277940ca5 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:42:50.103513 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6fe9426a-15f8-4dea-be2b-4de277940ca5 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:42:50.104235 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6fe9426a-15f8-4dea-be2b-4de277940ca5 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:42:50.104710 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6fe9426a-15f8-4dea-be2b-4de277940ca5 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:42:50.105429 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6fe9426a-15f8-4dea-be2b-4de277940ca5 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:42:50.157338 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6fe9426a-15f8-4dea-be2b-4de277940ca5 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "POST /compute/v2.1/servers/dce2af84-5c5e-4e65-9047-212dda347fca/action" status: 200 len: 37936 microversion: 2.1 time: 0.069295 Oct 27 04:42:50.157990 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4131/7964] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 04:42:50 2022] POST /compute/v2.1/servers/dce2af84-5c5e-4e65-9047-212dda347fca/action => generated 37936 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 04:42:51.218899 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c9e9c26b-a7df-4753-a5da-eda77dedbe01 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:42:51.219585 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c9e9c26b-a7df-4753-a5da-eda77dedbe01 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: dce2af84-5c5e-4e65-9047-212dda347fca] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:42:51.222264 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-da81ca64-eb30-4275-afc7-e8280ba6bba9 req-4b225053-778f-4237-9fed-47e8c008dba9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dce2af84-5c5e-4e65-9047-212dda347fca", "tag": "25f1bbbd-7135-4aa2-b125-33e7355091e1"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:42:51.226676 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c9e9c26b-a7df-4753-a5da-eda77dedbe01 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:42:51.227168 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c9e9c26b-a7df-4753-a5da-eda77dedbe01 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:42:51.227611 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c9e9c26b-a7df-4753-a5da-eda77dedbe01 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:42:51.228651 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c9e9c26b-a7df-4753-a5da-eda77dedbe01 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:42:51.229112 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c9e9c26b-a7df-4753-a5da-eda77dedbe01 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:42:51.230779 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c9e9c26b-a7df-4753-a5da-eda77dedbe01 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:42:51.235794 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-da81ca64-eb30-4275-afc7-e8280ba6bba9 req-4b225053-778f-4237-9fed-47e8c008dba9 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:42:51.236379 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-da81ca64-eb30-4275-afc7-e8280ba6bba9 req-4b225053-778f-4237-9fed-47e8c008dba9 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:42:51.237105 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-da81ca64-eb30-4275-afc7-e8280ba6bba9 req-4b225053-778f-4237-9fed-47e8c008dba9 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:42:51.249221 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-da81ca64-eb30-4275-afc7-e8280ba6bba9 req-4b225053-778f-4237-9fed-47e8c008dba9 service nova] Creating event network-changed:25f1bbbd-7135-4aa2-b125-33e7355091e1 for instance dce2af84-5c5e-4e65-9047-212dda347fca on n-h1-862769-1 Oct 27 04:42:51.256067 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-da81ca64-eb30-4275-afc7-e8280ba6bba9 req-4b225053-778f-4237-9fed-47e8c008dba9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037268 Oct 27 04:42:51.256067 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4132/7965] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:42:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:42:51.261427 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c9e9c26b-a7df-4753-a5da-eda77dedbe01 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: dce2af84-5c5e-4e65-9047-212dda347fca] Going to try to terminate instance {{(pid=121000) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 04:42:51.594755 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c9e9c26b-a7df-4753-a5da-eda77dedbe01 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "DELETE /compute/v2.1/servers/dce2af84-5c5e-4e65-9047-212dda347fca" status: 204 len: 0 microversion: 2.1 time: 0.379587 Oct 27 04:42:51.595283 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3834/7966] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 04:42:51 2022] DELETE /compute/v2.1/servers/dce2af84-5c5e-4e65-9047-212dda347fca => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 04:42:51.604964 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3d08aa71-707e-4ef3-aa7f-3c1138f72d15 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:42:51.606079 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3d08aa71-707e-4ef3-aa7f-3c1138f72d15 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: dce2af84-5c5e-4e65-9047-212dda347fca] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:42:51.612422 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3d08aa71-707e-4ef3-aa7f-3c1138f72d15 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:42:51.621205 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3d08aa71-707e-4ef3-aa7f-3c1138f72d15 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:42:51.621205 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3d08aa71-707e-4ef3-aa7f-3c1138f72d15 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:42:51.621205 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3d08aa71-707e-4ef3-aa7f-3c1138f72d15 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:42:51.621205 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3d08aa71-707e-4ef3-aa7f-3c1138f72d15 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:42:51.621205 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3d08aa71-707e-4ef3-aa7f-3c1138f72d15 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:42:51.756779 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3d08aa71-707e-4ef3-aa7f-3c1138f72d15 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:42:51.764731 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3d08aa71-707e-4ef3-aa7f-3c1138f72d15 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/dce2af84-5c5e-4e65-9047-212dda347fca" status: 200 len: 1689 microversion: 2.1 time: 0.164746 Oct 27 04:42:51.765325 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4133/7967] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:42:51 2022] GET /compute/v2.1/servers/dce2af84-5c5e-4e65-9047-212dda347fca => generated 1689 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:42:52.791336 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b0adee8e-bd9a-48f1-9594-f08259a330db tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:42:52.792087 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b0adee8e-bd9a-48f1-9594-f08259a330db tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: dce2af84-5c5e-4e65-9047-212dda347fca] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:42:52.798822 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b0adee8e-bd9a-48f1-9594-f08259a330db tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:42:52.799306 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b0adee8e-bd9a-48f1-9594-f08259a330db tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:42:52.799745 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b0adee8e-bd9a-48f1-9594-f08259a330db tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:42:52.800436 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b0adee8e-bd9a-48f1-9594-f08259a330db tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:42:52.800890 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b0adee8e-bd9a-48f1-9594-f08259a330db tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:42:52.801316 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b0adee8e-bd9a-48f1-9594-f08259a330db tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:42:52.935603 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b0adee8e-bd9a-48f1-9594-f08259a330db tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:42:52.943464 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b0adee8e-bd9a-48f1-9594-f08259a330db tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/dce2af84-5c5e-4e65-9047-212dda347fca" status: 200 len: 1689 microversion: 2.1 time: 0.156396 Oct 27 04:42:52.944087 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3835/7968] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:42:52 2022] GET /compute/v2.1/servers/dce2af84-5c5e-4e65-9047-212dda347fca => generated 1689 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:42:53.857532 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-d4359978-949f-46f1-ba03-097900953f5b req-ca240aa6-8053-4ca3-acc6-d4e9d89416e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dce2af84-5c5e-4e65-9047-212dda347fca", "name": "network-vif-deleted", "tag": "25f1bbbd-7135-4aa2-b125-33e7355091e1"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:42:53.867673 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-d4359978-949f-46f1-ba03-097900953f5b req-ca240aa6-8053-4ca3-acc6-d4e9d89416e4 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:42:53.868176 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-d4359978-949f-46f1-ba03-097900953f5b req-ca240aa6-8053-4ca3-acc6-d4e9d89416e4 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:42:53.868634 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-d4359978-949f-46f1-ba03-097900953f5b req-ca240aa6-8053-4ca3-acc6-d4e9d89416e4 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:42:53.880359 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-d4359978-949f-46f1-ba03-097900953f5b req-ca240aa6-8053-4ca3-acc6-d4e9d89416e4 service nova] Creating event network-vif-deleted:25f1bbbd-7135-4aa2-b125-33e7355091e1 for instance dce2af84-5c5e-4e65-9047-212dda347fca on n-h1-862769-1 Oct 27 04:42:53.885431 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-d4359978-949f-46f1-ba03-097900953f5b req-ca240aa6-8053-4ca3-acc6-d4e9d89416e4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032405 Oct 27 04:42:53.886022 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4134/7969] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:42:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:42:53.967716 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8e4c6a1f-0f8f-4e4e-9683-68b62b30c6a1 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:42:53.968323 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8e4c6a1f-0f8f-4e4e-9683-68b62b30c6a1 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: dce2af84-5c5e-4e65-9047-212dda347fca] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:42:53.975241 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8e4c6a1f-0f8f-4e4e-9683-68b62b30c6a1 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:42:53.975738 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8e4c6a1f-0f8f-4e4e-9683-68b62b30c6a1 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:42:53.976186 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8e4c6a1f-0f8f-4e4e-9683-68b62b30c6a1 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:42:53.976881 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8e4c6a1f-0f8f-4e4e-9683-68b62b30c6a1 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:42:53.977343 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8e4c6a1f-0f8f-4e4e-9683-68b62b30c6a1 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:42:53.977773 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8e4c6a1f-0f8f-4e4e-9683-68b62b30c6a1 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:42:54.042401 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8e4c6a1f-0f8f-4e4e-9683-68b62b30c6a1 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:42:54.050336 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8e4c6a1f-0f8f-4e4e-9683-68b62b30c6a1 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/dce2af84-5c5e-4e65-9047-212dda347fca" status: 200 len: 1502 microversion: 2.1 time: 0.086408 Oct 27 04:42:54.050863 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3836/7970] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:42:53 2022] GET /compute/v2.1/servers/dce2af84-5c5e-4e65-9047-212dda347fca => generated 1502 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:42:55.075514 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-bca9918e-d394-4e9b-a8ad-3420bccb671c tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:42:55.076263 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-bca9918e-d394-4e9b-a8ad-3420bccb671c tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: dce2af84-5c5e-4e65-9047-212dda347fca] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:42:55.082463 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bca9918e-d394-4e9b-a8ad-3420bccb671c tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:42:55.082991 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bca9918e-d394-4e9b-a8ad-3420bccb671c tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:42:55.083492 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bca9918e-d394-4e9b-a8ad-3420bccb671c tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:42:55.084200 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bca9918e-d394-4e9b-a8ad-3420bccb671c tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:42:55.084671 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bca9918e-d394-4e9b-a8ad-3420bccb671c tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:42:55.085114 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bca9918e-d394-4e9b-a8ad-3420bccb671c tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:42:55.101183 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-bca9918e-d394-4e9b-a8ad-3420bccb671c tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] HTTP exception thrown: Instance dce2af84-5c5e-4e65-9047-212dda347fca could not be found. Oct 27 04:42:55.102849 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-bca9918e-d394-4e9b-a8ad-3420bccb671c tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Request method failure captured: Oct 27 04:42:55.102849 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/dce2af84-5c5e-4e65-9047-212dda347fca HTTP/1.1 Oct 27 04:42:55.102849 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 04:42:55.102849 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 04:42:55.102849 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 04:42:55.102849 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 04:42:55.102849 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 04:42:55.102849 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 04:42:55.102849 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 04:42:55.102849 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 04:42:55.102849 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWgwK8Ydq2cZdl_qrXrzRt_-NHDs7Lbtyx3d1dP6RHEGcXjkmaGVWHwtmDAl_U5lub8Vu3EmSakuDoQfbZk0S8adwgJ-moO1z1C17My_hnWBVYQWYzYJdyvYOBGBq4h4dKTwzNOCKugh1J2CSdPdxb32D5VZEm2rfYKUP1FoiK7m3nt8 Oct 27 04:42:55.102849 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 04:42:55.102849 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 04:42:55.102849 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 04:42:55.102849 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 04:42:55.102849 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 04:42:55.102849 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 04:42:55.102849 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 67648db046c54ee3b314904c8338cd61 Oct 27 04:42:55.102849 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-952256618 Oct 27 04:42:55.102849 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 04:42:55.102849 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 04:42:55.102849 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/67648db046c54ee3b314904c8338cd61"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/67648db046c54ee3b314904c8338cd61"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/67648db046c54ee3b314904c8338cd61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_67648db046c54ee3b314904c8338cd61"}]}] Oct 27 04:42:55.102849 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-TestNetworkAdvancedServerOps-952256618 Oct 27 04:42:55.102849 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 67648db046c54ee3b314904c8338cd61 Oct 27 04:42:55.102849 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-952256618 Oct 27 04:42:55.102849 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-TestNetworkAdvancedServerOps-952256618-project Oct 27 04:42:55.102849 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 04:42:55.102849 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 04:42:55.102849 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 91e2c2dd9af848e5941d979683201c70 Oct 27 04:42:55.102849 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-TestNetworkAdvancedServerOps-952256618-project Oct 27 04:42:55.102849 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 04:42:55.102849 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance dce2af84-5c5e-4e65-9047-212dda347fca could not be found. Oct 27 04:42:55.102849 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': 'dce2af84-5c5e-4e65-9047-212dda347fca'} Oct 27 04:42:55.102849 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 04:42:55.102849 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:42:55.102849 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 04:42:55.102849 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 04:42:55.102849 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 04:42:55.102849 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 04:42:55.102849 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 04:42:55.102849 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 04:42:55.102849 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 04:42:55.102849 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 04:42:55.102849 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dce2af84-5c5e-4e65-9047-212dda347fca could not be found. Oct 27 04:42:55.102849 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:42:55.102849 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:42:55.102849 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:42:55.102849 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:42:55.102849 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:42:55.102849 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:42:55.102849 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 04:42:55.102849 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 04:42:55.102849 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 04:42:55.102849 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 04:42:55.102849 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 04:42:55.102849 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 04:42:55.102849 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 04:42:55.102849 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 04:42:55.102849 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 04:42:55.102849 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 04:42:55.102849 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dce2af84-5c5e-4e65-9047-212dda347fca could not be found. Oct 27 04:42:55.102849 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:42:55.102849 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:42:55.113977 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:42:55.113977 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:42:55.113977 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:42:55.113977 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:42:55.113977 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 04:42:55.113977 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 04:42:55.113977 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dce2af84-5c5e-4e65-9047-212dda347fca could not be found. Oct 27 04:42:55.113977 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:42:55.113977 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-bca9918e-d394-4e9b-a8ad-3420bccb671c tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Returning 404 to user: Instance dce2af84-5c5e-4e65-9047-212dda347fca could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 04:42:55.113977 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-bca9918e-d394-4e9b-a8ad-3420bccb671c tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/dce2af84-5c5e-4e65-9047-212dda347fca" status: 404 len: 111 microversion: 2.1 time: 0.034603 Oct 27 04:42:55.113977 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4135/7971] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:42:55 2022] GET /compute/v2.1/servers/dce2af84-5c5e-4e65-9047-212dda347fca => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 04:42:59.004927 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1157983c-5808-4789-adc5-1d82733c1e45 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '.version_select at 0x7f7dda075790>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:42:59.093069 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1157983c-5808-4789-adc5-1d82733c1e45 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-436086441" status: 202 len: 0 microversion: 2.1 time: 0.091944 Oct 27 04:42:59.093708 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3837/7972] 10.222.0.20 () {58 vars in 1281 bytes} [Thu Oct 27 04:42:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-436086441 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 04:42:59.122098 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a7c6c586-6eac-4932-9ed5-fe42a5f2d59e tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Action: 'create', calling method: .version_select at 0x7f7dda43cb80>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1978972209", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKiOG/GCSpx4FHdWu8uo8sLiuP+85g9WWEVFmhKr5CQ2S/gdnxHLMqwm1q6BM7KUEqHrav+DblpFoIplD4aFlPDD88GZOafJ/sivnsA80JlrXVHR/tU1hVpj/CZxqMKDjA=="}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:42:59.138875 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-a7c6c586-6eac-4932-9ed5-fe42a5f2d59e tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Getting quotas for project 67648db046c54ee3b314904c8338cd61. Resources: {'key_pairs'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 04:42:59.144172 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-a7c6c586-6eac-4932-9ed5-fe42a5f2d59e tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Getting quotas for user 91e2c2dd9af848e5941d979683201c70 and project 67648db046c54ee3b314904c8338cd61. Resources: {'key_pairs'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 04:42:59.264798 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a7c6c586-6eac-4932-9ed5-fe42a5f2d59e tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.146747 Oct 27 04:42:59.265535 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4136/7973] 10.222.0.20 () {60 vars in 1159 bytes} [Thu Oct 27 04:42:59 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:43:07.127703 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:43:07.132581 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4e81fc06-0409-4c71-90d2-7ba92c5ce973 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1721354850", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": [{"uuid": "2118a6fb-5fa4-483b-a772-12d59c2314ca"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1978972209", "security_groups": [{"name": "tempest-secgroup-smoke-561185729"}]}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:43:07.303513 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-4e81fc06-0409-4c71-90d2-7ba92c5ce973 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] validate_networks() for [('2118a6fb-5fa4-483b-a772-12d59c2314ca', None, None, None, None, None)] {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 04:43:07.706824 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-4e81fc06-0409-4c71-90d2-7ba92c5ce973 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 04:43:07.707262 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-4e81fc06-0409-4c71-90d2-7ba92c5ce973 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 04:43:07.707752 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-4e81fc06-0409-4c71-90d2-7ba92c5ce973 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 04:43:07.708174 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-4e81fc06-0409-4c71-90d2-7ba92c5ce973 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 04:43:07.708793 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-4e81fc06-0409-4c71-90d2-7ba92c5ce973 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 04:43:07.719140 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4e81fc06-0409-4c71-90d2-7ba92c5ce973 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:43:07.719800 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4e81fc06-0409-4c71-90d2-7ba92c5ce973 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:43:07.720254 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4e81fc06-0409-4c71-90d2-7ba92c5ce973 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:43:07.721005 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4e81fc06-0409-4c71-90d2-7ba92c5ce973 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:43:07.721471 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4e81fc06-0409-4c71-90d2-7ba92c5ce973 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:43:07.722061 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4e81fc06-0409-4c71-90d2-7ba92c5ce973 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:43:07.744283 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-4e81fc06-0409-4c71-90d2-7ba92c5ce973 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Getting quotas for project 67648db046c54ee3b314904c8338cd61. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 04:43:07.750273 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-4e81fc06-0409-4c71-90d2-7ba92c5ce973 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Getting quotas for user 91e2c2dd9af848e5941d979683201c70 and project 67648db046c54ee3b314904c8338cd61. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 04:43:07.763129 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4e81fc06-0409-4c71-90d2-7ba92c5ce973 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 04:43:07.765474 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4e81fc06-0409-4c71-90d2-7ba92c5ce973 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: 4a776a29-1ae7-41ef-8b23-3c662aaddcab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 04:43:07.888973 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4e81fc06-0409-4c71-90d2-7ba92c5ce973 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.763435 Oct 27 04:43:07.896029 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3838/7974] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 04:43:07 2022] POST /compute/v2.1/servers => generated 405 bytes in 765 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 04:43:07.903170 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-06dc89c0-73f1-4e5a-ad14-fbc3ed674ce3 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:43:07.903817 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-06dc89c0-73f1-4e5a-ad14-fbc3ed674ce3 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: 4a776a29-1ae7-41ef-8b23-3c662aaddcab] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:43:07.907598 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=36 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:43:07.973366 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-06dc89c0-73f1-4e5a-ad14-fbc3ed674ce3 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:43:07.982343 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-06dc89c0-73f1-4e5a-ad14-fbc3ed674ce3 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/4a776a29-1ae7-41ef-8b23-3c662aaddcab" status: 200 len: 1267 microversion: 2.1 time: 0.084166 Oct 27 04:43:07.983021 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4137/7975] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:43:07 2022] GET /compute/v2.1/servers/4a776a29-1ae7-41ef-8b23-3c662aaddcab => generated 1267 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 04:43:09.006989 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-af78dfac-ebca-4913-a9ed-dfce56caed1e tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:43:09.007727 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-af78dfac-ebca-4913-a9ed-dfce56caed1e tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: 4a776a29-1ae7-41ef-8b23-3c662aaddcab] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:43:09.014158 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-af78dfac-ebca-4913-a9ed-dfce56caed1e tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:43:09.024729 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-af78dfac-ebca-4913-a9ed-dfce56caed1e tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:43:09.024729 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-af78dfac-ebca-4913-a9ed-dfce56caed1e tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:43:09.024729 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-af78dfac-ebca-4913-a9ed-dfce56caed1e tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:43:09.024729 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-af78dfac-ebca-4913-a9ed-dfce56caed1e tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:43:09.024729 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-af78dfac-ebca-4913-a9ed-dfce56caed1e tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:43:09.083428 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-af78dfac-ebca-4913-a9ed-dfce56caed1e tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:43:09.091586 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-af78dfac-ebca-4913-a9ed-dfce56caed1e tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/4a776a29-1ae7-41ef-8b23-3c662aaddcab" status: 200 len: 1271 microversion: 2.1 time: 0.089969 Oct 27 04:43:09.092274 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3839/7976] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:43:09 2022] GET /compute/v2.1/servers/4a776a29-1ae7-41ef-8b23-3c662aaddcab => generated 1271 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:43:10.115602 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-644aec46-acde-47ae-ab19-cbad14cbb8e3 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:43:10.116317 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-644aec46-acde-47ae-ab19-cbad14cbb8e3 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: 4a776a29-1ae7-41ef-8b23-3c662aaddcab] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:43:10.123732 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-644aec46-acde-47ae-ab19-cbad14cbb8e3 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:43:10.124235 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-644aec46-acde-47ae-ab19-cbad14cbb8e3 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:43:10.127912 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-644aec46-acde-47ae-ab19-cbad14cbb8e3 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:43:10.127912 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-644aec46-acde-47ae-ab19-cbad14cbb8e3 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:43:10.127912 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-644aec46-acde-47ae-ab19-cbad14cbb8e3 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:43:10.127912 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-644aec46-acde-47ae-ab19-cbad14cbb8e3 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:43:10.199910 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-644aec46-acde-47ae-ab19-cbad14cbb8e3 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:43:10.207922 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-644aec46-acde-47ae-ab19-cbad14cbb8e3 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/4a776a29-1ae7-41ef-8b23-3c662aaddcab" status: 200 len: 1327 microversion: 2.1 time: 0.096493 Oct 27 04:43:10.208847 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4138/7977] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:43:10 2022] GET /compute/v2.1/servers/4a776a29-1ae7-41ef-8b23-3c662aaddcab => generated 1327 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:43:11.233392 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-deddf8b9-f3fa-419b-93e3-b8a4a8603a48 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:43:11.235104 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-deddf8b9-f3fa-419b-93e3-b8a4a8603a48 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: 4a776a29-1ae7-41ef-8b23-3c662aaddcab] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:43:11.242580 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-deddf8b9-f3fa-419b-93e3-b8a4a8603a48 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:43:11.243126 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-deddf8b9-f3fa-419b-93e3-b8a4a8603a48 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:43:11.243560 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-deddf8b9-f3fa-419b-93e3-b8a4a8603a48 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:43:11.244479 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-deddf8b9-f3fa-419b-93e3-b8a4a8603a48 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:43:11.245109 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-deddf8b9-f3fa-419b-93e3-b8a4a8603a48 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:43:11.246322 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-deddf8b9-f3fa-419b-93e3-b8a4a8603a48 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:43:11.395751 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-deddf8b9-f3fa-419b-93e3-b8a4a8603a48 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:43:11.404067 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-deddf8b9-f3fa-419b-93e3-b8a4a8603a48 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/4a776a29-1ae7-41ef-8b23-3c662aaddcab" status: 200 len: 1392 microversion: 2.1 time: 0.176178 Oct 27 04:43:11.404981 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3840/7978] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:43:11 2022] GET /compute/v2.1/servers/4a776a29-1ae7-41ef-8b23-3c662aaddcab => generated 1392 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:43:11.845440 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-14b0a82b-d435-45c8-bb49-8cefd7e291a4 req-15b58ed7-b2ca-44ab-a103-b0106f888c7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a776a29-1ae7-41ef-8b23-3c662aaddcab", "tag": "e9c721de-16eb-4301-9954-a60d9ff39c22"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:43:11.856215 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-14b0a82b-d435-45c8-bb49-8cefd7e291a4 req-15b58ed7-b2ca-44ab-a103-b0106f888c7c service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:43:11.856644 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-14b0a82b-d435-45c8-bb49-8cefd7e291a4 req-15b58ed7-b2ca-44ab-a103-b0106f888c7c service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:43:11.857093 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-14b0a82b-d435-45c8-bb49-8cefd7e291a4 req-15b58ed7-b2ca-44ab-a103-b0106f888c7c service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:43:11.868223 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-14b0a82b-d435-45c8-bb49-8cefd7e291a4 req-15b58ed7-b2ca-44ab-a103-b0106f888c7c service nova] Creating event network-changed:e9c721de-16eb-4301-9954-a60d9ff39c22 for instance 4a776a29-1ae7-41ef-8b23-3c662aaddcab on n-h1-862769-1 Oct 27 04:43:11.873391 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-14b0a82b-d435-45c8-bb49-8cefd7e291a4 req-15b58ed7-b2ca-44ab-a103-b0106f888c7c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032675 Oct 27 04:43:11.879952 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4139/7979] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:43:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:43:12.428514 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1dc4cba6-2080-4356-bfc9-d11c5a1d15e2 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:43:12.429087 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1dc4cba6-2080-4356-bfc9-d11c5a1d15e2 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: 4a776a29-1ae7-41ef-8b23-3c662aaddcab] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:43:12.436352 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1dc4cba6-2080-4356-bfc9-d11c5a1d15e2 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:43:12.436842 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1dc4cba6-2080-4356-bfc9-d11c5a1d15e2 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:43:12.437285 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1dc4cba6-2080-4356-bfc9-d11c5a1d15e2 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:43:12.437989 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1dc4cba6-2080-4356-bfc9-d11c5a1d15e2 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:43:12.438473 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1dc4cba6-2080-4356-bfc9-d11c5a1d15e2 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:43:12.438902 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1dc4cba6-2080-4356-bfc9-d11c5a1d15e2 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:43:12.599082 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1dc4cba6-2080-4356-bfc9-d11c5a1d15e2 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:43:12.608341 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1dc4cba6-2080-4356-bfc9-d11c5a1d15e2 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/4a776a29-1ae7-41ef-8b23-3c662aaddcab" status: 200 len: 1392 microversion: 2.1 time: 0.183758 Oct 27 04:43:12.608949 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3841/7980] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:43:12 2022] GET /compute/v2.1/servers/4a776a29-1ae7-41ef-8b23-3c662aaddcab => generated 1392 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:43:13.632489 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-84e4fe10-f666-4c9a-b897-5414974903e2 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:43:13.633224 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-84e4fe10-f666-4c9a-b897-5414974903e2 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: 4a776a29-1ae7-41ef-8b23-3c662aaddcab] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:43:13.640369 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-84e4fe10-f666-4c9a-b897-5414974903e2 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:43:13.640908 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-84e4fe10-f666-4c9a-b897-5414974903e2 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:43:13.641374 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-84e4fe10-f666-4c9a-b897-5414974903e2 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:43:13.642118 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-84e4fe10-f666-4c9a-b897-5414974903e2 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:43:13.642598 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-84e4fe10-f666-4c9a-b897-5414974903e2 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:43:13.643050 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-84e4fe10-f666-4c9a-b897-5414974903e2 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:43:13.782724 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-84e4fe10-f666-4c9a-b897-5414974903e2 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:43:13.790747 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-84e4fe10-f666-4c9a-b897-5414974903e2 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/4a776a29-1ae7-41ef-8b23-3c662aaddcab" status: 200 len: 1392 microversion: 2.1 time: 0.162574 Oct 27 04:43:13.791323 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4140/7981] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:43:13 2022] GET /compute/v2.1/servers/4a776a29-1ae7-41ef-8b23-3c662aaddcab => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:43:14.814537 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c1356b4d-5266-4861-9e42-8b4e50df6e32 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:43:14.815841 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c1356b4d-5266-4861-9e42-8b4e50df6e32 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: 4a776a29-1ae7-41ef-8b23-3c662aaddcab] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:43:14.823100 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c1356b4d-5266-4861-9e42-8b4e50df6e32 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:43:14.823686 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c1356b4d-5266-4861-9e42-8b4e50df6e32 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:43:14.824833 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c1356b4d-5266-4861-9e42-8b4e50df6e32 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:43:14.825646 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c1356b4d-5266-4861-9e42-8b4e50df6e32 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:43:14.826210 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c1356b4d-5266-4861-9e42-8b4e50df6e32 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:43:14.826712 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c1356b4d-5266-4861-9e42-8b4e50df6e32 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:43:14.961529 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c1356b4d-5266-4861-9e42-8b4e50df6e32 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:43:14.970373 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c1356b4d-5266-4861-9e42-8b4e50df6e32 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/4a776a29-1ae7-41ef-8b23-3c662aaddcab" status: 200 len: 1392 microversion: 2.1 time: 0.160000 Oct 27 04:43:14.971049 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3842/7982] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:43:14 2022] GET /compute/v2.1/servers/4a776a29-1ae7-41ef-8b23-3c662aaddcab => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:43:15.993363 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3b158a62-bab5-4c5a-a326-df8239a65d3b tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:43:15.994015 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3b158a62-bab5-4c5a-a326-df8239a65d3b tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: 4a776a29-1ae7-41ef-8b23-3c662aaddcab] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:43:16.001546 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3b158a62-bab5-4c5a-a326-df8239a65d3b tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:43:16.002084 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3b158a62-bab5-4c5a-a326-df8239a65d3b tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:43:16.002543 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3b158a62-bab5-4c5a-a326-df8239a65d3b tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:43:16.003263 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3b158a62-bab5-4c5a-a326-df8239a65d3b tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:43:16.003737 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3b158a62-bab5-4c5a-a326-df8239a65d3b tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:43:16.004180 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3b158a62-bab5-4c5a-a326-df8239a65d3b tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:43:16.135041 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3b158a62-bab5-4c5a-a326-df8239a65d3b tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:43:16.143819 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3b158a62-bab5-4c5a-a326-df8239a65d3b tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/4a776a29-1ae7-41ef-8b23-3c662aaddcab" status: 200 len: 1392 microversion: 2.1 time: 0.154349 Oct 27 04:43:16.144389 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4141/7983] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:43:15 2022] GET /compute/v2.1/servers/4a776a29-1ae7-41ef-8b23-3c662aaddcab => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:43:17.167007 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0cec3d2c-49e9-417b-a40a-421b3d41eb8b tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:43:17.168614 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0cec3d2c-49e9-417b-a40a-421b3d41eb8b tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: 4a776a29-1ae7-41ef-8b23-3c662aaddcab] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:43:17.172033 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:43:17.175820 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0cec3d2c-49e9-417b-a40a-421b3d41eb8b tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:43:17.176316 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0cec3d2c-49e9-417b-a40a-421b3d41eb8b tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:43:17.176771 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0cec3d2c-49e9-417b-a40a-421b3d41eb8b tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:43:17.177484 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0cec3d2c-49e9-417b-a40a-421b3d41eb8b tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:43:17.177949 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0cec3d2c-49e9-417b-a40a-421b3d41eb8b tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:43:17.178448 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0cec3d2c-49e9-417b-a40a-421b3d41eb8b tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:43:17.316974 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0cec3d2c-49e9-417b-a40a-421b3d41eb8b tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:43:17.325235 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0cec3d2c-49e9-417b-a40a-421b3d41eb8b tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/4a776a29-1ae7-41ef-8b23-3c662aaddcab" status: 200 len: 1392 microversion: 2.1 time: 0.162093 Oct 27 04:43:17.326236 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3843/7984] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:43:17 2022] GET /compute/v2.1/servers/4a776a29-1ae7-41ef-8b23-3c662aaddcab => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:43:18.349599 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c5e8836a-7f49-4fd1-8d8a-afab2ed95da5 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:43:18.350197 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c5e8836a-7f49-4fd1-8d8a-afab2ed95da5 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: 4a776a29-1ae7-41ef-8b23-3c662aaddcab] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:43:18.353927 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=6 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:43:18.353927 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:43:18.359085 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c5e8836a-7f49-4fd1-8d8a-afab2ed95da5 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:43:18.359693 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c5e8836a-7f49-4fd1-8d8a-afab2ed95da5 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:43:18.360176 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c5e8836a-7f49-4fd1-8d8a-afab2ed95da5 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:43:18.360901 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c5e8836a-7f49-4fd1-8d8a-afab2ed95da5 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:43:18.361381 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c5e8836a-7f49-4fd1-8d8a-afab2ed95da5 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:43:18.361836 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c5e8836a-7f49-4fd1-8d8a-afab2ed95da5 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:43:18.492985 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c5e8836a-7f49-4fd1-8d8a-afab2ed95da5 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:43:18.501491 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c5e8836a-7f49-4fd1-8d8a-afab2ed95da5 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/4a776a29-1ae7-41ef-8b23-3c662aaddcab" status: 200 len: 1392 microversion: 2.1 time: 0.155929 Oct 27 04:43:18.502090 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4142/7985] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:43:18 2022] GET /compute/v2.1/servers/4a776a29-1ae7-41ef-8b23-3c662aaddcab => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:43:19.188565 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-f8efc041-fb14-41cd-827b-dd408afaeee8 req-c5eb4b8f-216a-47df-8310-07474e7826aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a776a29-1ae7-41ef-8b23-3c662aaddcab", "name": "network-vif-plugged", "status": "completed", "tag": "e9c721de-16eb-4301-9954-a60d9ff39c22"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:43:19.194125 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:43:19.194801 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=6 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:43:19.201168 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-f8efc041-fb14-41cd-827b-dd408afaeee8 req-c5eb4b8f-216a-47df-8310-07474e7826aa service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:43:19.201650 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-f8efc041-fb14-41cd-827b-dd408afaeee8 req-c5eb4b8f-216a-47df-8310-07474e7826aa service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:43:19.202106 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-f8efc041-fb14-41cd-827b-dd408afaeee8 req-c5eb4b8f-216a-47df-8310-07474e7826aa service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:43:19.212746 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-f8efc041-fb14-41cd-827b-dd408afaeee8 req-c5eb4b8f-216a-47df-8310-07474e7826aa service nova] Creating event network-vif-plugged:e9c721de-16eb-4301-9954-a60d9ff39c22 for instance 4a776a29-1ae7-41ef-8b23-3c662aaddcab on n-h1-862769-1 Oct 27 04:43:19.218327 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-f8efc041-fb14-41cd-827b-dd408afaeee8 req-c5eb4b8f-216a-47df-8310-07474e7826aa service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035761 Oct 27 04:43:19.218919 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3844/7986] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:43:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:43:19.553053 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-765662ad-1869-4283-9380-1ee37fbf26c0 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:43:19.553053 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-765662ad-1869-4283-9380-1ee37fbf26c0 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: 4a776a29-1ae7-41ef-8b23-3c662aaddcab] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:43:19.553053 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-765662ad-1869-4283-9380-1ee37fbf26c0 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:43:19.553053 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-765662ad-1869-4283-9380-1ee37fbf26c0 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:43:19.553053 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-765662ad-1869-4283-9380-1ee37fbf26c0 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:43:19.553053 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-765662ad-1869-4283-9380-1ee37fbf26c0 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:43:19.553053 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-765662ad-1869-4283-9380-1ee37fbf26c0 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:43:19.553053 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-765662ad-1869-4283-9380-1ee37fbf26c0 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:43:19.667573 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-765662ad-1869-4283-9380-1ee37fbf26c0 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:43:19.675849 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-765662ad-1869-4283-9380-1ee37fbf26c0 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/4a776a29-1ae7-41ef-8b23-3c662aaddcab" status: 200 len: 1392 microversion: 2.1 time: 0.155998 Oct 27 04:43:19.678155 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4143/7987] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:43:19 2022] GET /compute/v2.1/servers/4a776a29-1ae7-41ef-8b23-3c662aaddcab => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:43:20.701158 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d8512c59-9d5d-4937-a858-0409606dc1a0 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:43:20.701869 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d8512c59-9d5d-4937-a858-0409606dc1a0 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: 4a776a29-1ae7-41ef-8b23-3c662aaddcab] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:43:20.708928 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d8512c59-9d5d-4937-a858-0409606dc1a0 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:43:20.711204 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d8512c59-9d5d-4937-a858-0409606dc1a0 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:43:20.711204 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d8512c59-9d5d-4937-a858-0409606dc1a0 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:43:20.711204 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d8512c59-9d5d-4937-a858-0409606dc1a0 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:43:20.711204 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d8512c59-9d5d-4937-a858-0409606dc1a0 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:43:20.711776 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d8512c59-9d5d-4937-a858-0409606dc1a0 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:43:20.845866 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d8512c59-9d5d-4937-a858-0409606dc1a0 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:43:20.854231 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d8512c59-9d5d-4937-a858-0409606dc1a0 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/4a776a29-1ae7-41ef-8b23-3c662aaddcab" status: 200 len: 1392 microversion: 2.1 time: 0.159501 Oct 27 04:43:20.854802 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3845/7988] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:43:20 2022] GET /compute/v2.1/servers/4a776a29-1ae7-41ef-8b23-3c662aaddcab => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:43:21.877370 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ef5d8541-ec12-4523-b0e6-4dec7313c2e9 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:43:21.878063 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ef5d8541-ec12-4523-b0e6-4dec7313c2e9 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: 4a776a29-1ae7-41ef-8b23-3c662aaddcab] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:43:21.884951 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ef5d8541-ec12-4523-b0e6-4dec7313c2e9 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:43:21.885461 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ef5d8541-ec12-4523-b0e6-4dec7313c2e9 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:43:21.885928 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ef5d8541-ec12-4523-b0e6-4dec7313c2e9 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:43:21.886671 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ef5d8541-ec12-4523-b0e6-4dec7313c2e9 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:43:21.887151 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ef5d8541-ec12-4523-b0e6-4dec7313c2e9 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:43:21.887606 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ef5d8541-ec12-4523-b0e6-4dec7313c2e9 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:43:22.021858 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ef5d8541-ec12-4523-b0e6-4dec7313c2e9 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:43:22.030352 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ef5d8541-ec12-4523-b0e6-4dec7313c2e9 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/4a776a29-1ae7-41ef-8b23-3c662aaddcab" status: 200 len: 1564 microversion: 2.1 time: 0.157434 Oct 27 04:43:22.034167 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4144/7989] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:43:21 2022] GET /compute/v2.1/servers/4a776a29-1ae7-41ef-8b23-3c662aaddcab => generated 1564 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:43:22.052910 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8c810784-3000-4d2e-a8b7-1ab83b5c4096 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:43:22.053534 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8c810784-3000-4d2e-a8b7-1ab83b5c4096 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: 4a776a29-1ae7-41ef-8b23-3c662aaddcab] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:43:22.060858 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8c810784-3000-4d2e-a8b7-1ab83b5c4096 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:43:22.061336 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8c810784-3000-4d2e-a8b7-1ab83b5c4096 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:43:22.061781 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8c810784-3000-4d2e-a8b7-1ab83b5c4096 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:43:22.062513 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8c810784-3000-4d2e-a8b7-1ab83b5c4096 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:43:22.062975 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8c810784-3000-4d2e-a8b7-1ab83b5c4096 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:43:22.063411 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8c810784-3000-4d2e-a8b7-1ab83b5c4096 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:43:22.196494 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8c810784-3000-4d2e-a8b7-1ab83b5c4096 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:43:22.202780 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8c810784-3000-4d2e-a8b7-1ab83b5c4096 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/4a776a29-1ae7-41ef-8b23-3c662aaddcab" status: 200 len: 1564 microversion: 2.1 time: 0.153656 Oct 27 04:43:22.203357 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3846/7990] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:43:22 2022] GET /compute/v2.1/servers/4a776a29-1ae7-41ef-8b23-3c662aaddcab => generated 1564 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:43:24.380357 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-145b2313-66e7-4f68-9b82-25dabbf5a3a0 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:43:24.381284 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-145b2313-66e7-4f68-9b82-25dabbf5a3a0 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: 4a776a29-1ae7-41ef-8b23-3c662aaddcab] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:43:24.382411 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-8d477a0a-1ac9-4619-8f3b-698f9de15ea2 req-fb8e3843-a6a1-4f90-b674-d8fe0cc41304 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a776a29-1ae7-41ef-8b23-3c662aaddcab", "tag": "e9c721de-16eb-4301-9954-a60d9ff39c22"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:43:24.388457 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-145b2313-66e7-4f68-9b82-25dabbf5a3a0 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:43:24.388910 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-145b2313-66e7-4f68-9b82-25dabbf5a3a0 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:43:24.389671 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-145b2313-66e7-4f68-9b82-25dabbf5a3a0 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:43:24.390505 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-145b2313-66e7-4f68-9b82-25dabbf5a3a0 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:43:24.391012 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-145b2313-66e7-4f68-9b82-25dabbf5a3a0 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:43:24.391707 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-145b2313-66e7-4f68-9b82-25dabbf5a3a0 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:43:24.395063 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-8d477a0a-1ac9-4619-8f3b-698f9de15ea2 req-fb8e3843-a6a1-4f90-b674-d8fe0cc41304 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:43:24.395972 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-8d477a0a-1ac9-4619-8f3b-698f9de15ea2 req-fb8e3843-a6a1-4f90-b674-d8fe0cc41304 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:43:24.396635 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-8d477a0a-1ac9-4619-8f3b-698f9de15ea2 req-fb8e3843-a6a1-4f90-b674-d8fe0cc41304 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:43:24.415009 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-8d477a0a-1ac9-4619-8f3b-698f9de15ea2 req-fb8e3843-a6a1-4f90-b674-d8fe0cc41304 service nova] Creating event network-changed:e9c721de-16eb-4301-9954-a60d9ff39c22 for instance 4a776a29-1ae7-41ef-8b23-3c662aaddcab on n-h1-862769-1 Oct 27 04:43:24.418860 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-8d477a0a-1ac9-4619-8f3b-698f9de15ea2 req-fb8e3843-a6a1-4f90-b674-d8fe0cc41304 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039887 Oct 27 04:43:24.420643 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3847/7991] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:43:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 04:43:24.608736 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-145b2313-66e7-4f68-9b82-25dabbf5a3a0 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:43:24.616720 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-145b2313-66e7-4f68-9b82-25dabbf5a3a0 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/4a776a29-1ae7-41ef-8b23-3c662aaddcab" status: 200 len: 1564 microversion: 2.1 time: 0.240461 Oct 27 04:43:24.617310 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4145/7992] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:43:24 2022] GET /compute/v2.1/servers/4a776a29-1ae7-41ef-8b23-3c662aaddcab => generated 1564 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:43:45.869038 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-69b6eea7-9f85-4f45-aaf5-5ada4a59d83e tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:43:45.871395 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-69b6eea7-9f85-4f45-aaf5-5ada4a59d83e tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: 4a776a29-1ae7-41ef-8b23-3c662aaddcab] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:43:45.873735 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=9 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:43:45.874484 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=48 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:43:45.879368 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-69b6eea7-9f85-4f45-aaf5-5ada4a59d83e tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:43:45.879857 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-69b6eea7-9f85-4f45-aaf5-5ada4a59d83e tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:43:45.880301 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-69b6eea7-9f85-4f45-aaf5-5ada4a59d83e tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:43:45.881020 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-69b6eea7-9f85-4f45-aaf5-5ada4a59d83e tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:43:45.881468 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-69b6eea7-9f85-4f45-aaf5-5ada4a59d83e tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:43:45.881898 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-69b6eea7-9f85-4f45-aaf5-5ada4a59d83e tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:43:45.948609 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-69b6eea7-9f85-4f45-aaf5-5ada4a59d83e tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "POST /compute/v2.1/servers/4a776a29-1ae7-41ef-8b23-3c662aaddcab/action" status: 200 len: 24565 microversion: 2.1 time: 0.083842 Oct 27 04:43:45.949278 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3848/7993] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 04:43:45 2022] POST /compute/v2.1/servers/4a776a29-1ae7-41ef-8b23-3c662aaddcab/action => generated 24565 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 04:43:56.878628 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-72405a47-6327-49ff-a1a7-92318eb3d1c8 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:43:56.880891 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-72405a47-6327-49ff-a1a7-92318eb3d1c8 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: 4a776a29-1ae7-41ef-8b23-3c662aaddcab] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:43:56.883278 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=7 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:43:56.883971 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=44 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:43:56.888753 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-72405a47-6327-49ff-a1a7-92318eb3d1c8 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:43:56.889270 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-72405a47-6327-49ff-a1a7-92318eb3d1c8 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:43:56.889736 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-72405a47-6327-49ff-a1a7-92318eb3d1c8 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:43:56.890491 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-72405a47-6327-49ff-a1a7-92318eb3d1c8 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:43:56.890970 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-72405a47-6327-49ff-a1a7-92318eb3d1c8 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:43:56.891421 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-72405a47-6327-49ff-a1a7-92318eb3d1c8 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:43:57.146922 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-72405a47-6327-49ff-a1a7-92318eb3d1c8 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "POST /compute/v2.1/servers/4a776a29-1ae7-41ef-8b23-3c662aaddcab/action" status: 202 len: 0 microversion: 2.1 time: 0.272062 Oct 27 04:43:57.147644 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4146/7994] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 04:43:56 2022] POST /compute/v2.1/servers/4a776a29-1ae7-41ef-8b23-3c662aaddcab/action => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 04:43:57.157166 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5c700247-d5a4-4a79-b688-74d9534dc5a5 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:43:57.157910 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5c700247-d5a4-4a79-b688-74d9534dc5a5 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: 4a776a29-1ae7-41ef-8b23-3c662aaddcab] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:43:57.160948 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:43:57.161611 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=4 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:43:57.166619 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5c700247-d5a4-4a79-b688-74d9534dc5a5 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:43:57.167111 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5c700247-d5a4-4a79-b688-74d9534dc5a5 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:43:57.167555 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5c700247-d5a4-4a79-b688-74d9534dc5a5 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:43:57.168257 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5c700247-d5a4-4a79-b688-74d9534dc5a5 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:43:57.168719 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5c700247-d5a4-4a79-b688-74d9534dc5a5 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:43:57.169151 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5c700247-d5a4-4a79-b688-74d9534dc5a5 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:43:57.305020 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5c700247-d5a4-4a79-b688-74d9534dc5a5 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:43:57.313156 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5c700247-d5a4-4a79-b688-74d9534dc5a5 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/4a776a29-1ae7-41ef-8b23-3c662aaddcab" status: 200 len: 1674 microversion: 2.1 time: 0.160821 Oct 27 04:43:57.317384 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3849/7995] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:43:57 2022] GET /compute/v2.1/servers/4a776a29-1ae7-41ef-8b23-3c662aaddcab => generated 1674 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:43:58.339752 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-89527417-2430-4f8b-917b-1381434a33a9 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:43:58.340484 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-89527417-2430-4f8b-917b-1381434a33a9 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: 4a776a29-1ae7-41ef-8b23-3c662aaddcab] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:43:58.347905 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-89527417-2430-4f8b-917b-1381434a33a9 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:43:58.348414 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-89527417-2430-4f8b-917b-1381434a33a9 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:43:58.348880 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-89527417-2430-4f8b-917b-1381434a33a9 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:43:58.349604 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-89527417-2430-4f8b-917b-1381434a33a9 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:43:58.350107 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-89527417-2430-4f8b-917b-1381434a33a9 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:43:58.350564 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-89527417-2430-4f8b-917b-1381434a33a9 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:43:58.483610 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-89527417-2430-4f8b-917b-1381434a33a9 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:43:58.491716 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-89527417-2430-4f8b-917b-1381434a33a9 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/4a776a29-1ae7-41ef-8b23-3c662aaddcab" status: 200 len: 1679 microversion: 2.1 time: 0.156294 Oct 27 04:43:58.492304 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4147/7996] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:43:58 2022] GET /compute/v2.1/servers/4a776a29-1ae7-41ef-8b23-3c662aaddcab => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:43:59.516398 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8b4344f5-d714-4e6e-aa9d-19d8bc9f47fc tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:43:59.517018 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8b4344f5-d714-4e6e-aa9d-19d8bc9f47fc tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: 4a776a29-1ae7-41ef-8b23-3c662aaddcab] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:43:59.523545 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8b4344f5-d714-4e6e-aa9d-19d8bc9f47fc tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:43:59.524030 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8b4344f5-d714-4e6e-aa9d-19d8bc9f47fc tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:43:59.524466 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8b4344f5-d714-4e6e-aa9d-19d8bc9f47fc tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:43:59.525158 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8b4344f5-d714-4e6e-aa9d-19d8bc9f47fc tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:43:59.525634 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8b4344f5-d714-4e6e-aa9d-19d8bc9f47fc tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:43:59.526081 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8b4344f5-d714-4e6e-aa9d-19d8bc9f47fc tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:43:59.659763 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8b4344f5-d714-4e6e-aa9d-19d8bc9f47fc tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:43:59.667359 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8b4344f5-d714-4e6e-aa9d-19d8bc9f47fc tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/4a776a29-1ae7-41ef-8b23-3c662aaddcab" status: 200 len: 1679 microversion: 2.1 time: 0.154910 Oct 27 04:43:59.667926 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3850/7997] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:43:59 2022] GET /compute/v2.1/servers/4a776a29-1ae7-41ef-8b23-3c662aaddcab => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:44:00.691400 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d3f6da94-4ca0-44c6-ba91-2fdf62c35542 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:44:00.692040 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d3f6da94-4ca0-44c6-ba91-2fdf62c35542 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: 4a776a29-1ae7-41ef-8b23-3c662aaddcab] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:44:00.698299 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d3f6da94-4ca0-44c6-ba91-2fdf62c35542 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:44:00.698810 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d3f6da94-4ca0-44c6-ba91-2fdf62c35542 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:44:00.699272 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d3f6da94-4ca0-44c6-ba91-2fdf62c35542 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:44:00.699994 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d3f6da94-4ca0-44c6-ba91-2fdf62c35542 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:44:00.700474 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d3f6da94-4ca0-44c6-ba91-2fdf62c35542 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:44:00.700922 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d3f6da94-4ca0-44c6-ba91-2fdf62c35542 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:44:00.830958 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d3f6da94-4ca0-44c6-ba91-2fdf62c35542 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:44:00.838688 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d3f6da94-4ca0-44c6-ba91-2fdf62c35542 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/4a776a29-1ae7-41ef-8b23-3c662aaddcab" status: 200 len: 1679 microversion: 2.1 time: 0.151394 Oct 27 04:44:00.839271 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4148/7998] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:44:00 2022] GET /compute/v2.1/servers/4a776a29-1ae7-41ef-8b23-3c662aaddcab => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:44:01.862874 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3eb0fd42-53ff-4a5d-8d42-b98aa0007a0b tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:44:01.863494 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-3eb0fd42-53ff-4a5d-8d42-b98aa0007a0b tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: 4a776a29-1ae7-41ef-8b23-3c662aaddcab] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:44:01.870279 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3eb0fd42-53ff-4a5d-8d42-b98aa0007a0b tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:44:01.870759 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3eb0fd42-53ff-4a5d-8d42-b98aa0007a0b tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:44:01.871195 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3eb0fd42-53ff-4a5d-8d42-b98aa0007a0b tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:44:01.871885 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3eb0fd42-53ff-4a5d-8d42-b98aa0007a0b tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:44:01.872338 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3eb0fd42-53ff-4a5d-8d42-b98aa0007a0b tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:44:01.872763 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3eb0fd42-53ff-4a5d-8d42-b98aa0007a0b tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:44:02.004232 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-3eb0fd42-53ff-4a5d-8d42-b98aa0007a0b tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:44:02.011927 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3eb0fd42-53ff-4a5d-8d42-b98aa0007a0b tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/4a776a29-1ae7-41ef-8b23-3c662aaddcab" status: 200 len: 1679 microversion: 2.1 time: 0.152989 Oct 27 04:44:02.012538 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3851/7999] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:44:01 2022] GET /compute/v2.1/servers/4a776a29-1ae7-41ef-8b23-3c662aaddcab => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:44:03.035620 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4ca6d1e9-c602-4eb8-bd7b-c1cf29147fe9 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:44:03.036272 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4ca6d1e9-c602-4eb8-bd7b-c1cf29147fe9 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: 4a776a29-1ae7-41ef-8b23-3c662aaddcab] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:44:03.043141 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4ca6d1e9-c602-4eb8-bd7b-c1cf29147fe9 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:44:03.043651 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4ca6d1e9-c602-4eb8-bd7b-c1cf29147fe9 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:44:03.044121 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4ca6d1e9-c602-4eb8-bd7b-c1cf29147fe9 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:44:03.044841 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4ca6d1e9-c602-4eb8-bd7b-c1cf29147fe9 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:44:03.045323 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4ca6d1e9-c602-4eb8-bd7b-c1cf29147fe9 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:44:03.046337 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4ca6d1e9-c602-4eb8-bd7b-c1cf29147fe9 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:44:03.181508 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4ca6d1e9-c602-4eb8-bd7b-c1cf29147fe9 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:44:03.190712 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4ca6d1e9-c602-4eb8-bd7b-c1cf29147fe9 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/4a776a29-1ae7-41ef-8b23-3c662aaddcab" status: 200 len: 1679 microversion: 2.1 time: 0.159090 Oct 27 04:44:03.191326 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4149/8000] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:44:03 2022] GET /compute/v2.1/servers/4a776a29-1ae7-41ef-8b23-3c662aaddcab => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:44:04.213462 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-868697f0-0227-49f0-9caa-ff809cfdac3a tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:44:04.214123 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-868697f0-0227-49f0-9caa-ff809cfdac3a tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: 4a776a29-1ae7-41ef-8b23-3c662aaddcab] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:44:04.220880 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-868697f0-0227-49f0-9caa-ff809cfdac3a tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:44:04.221390 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-868697f0-0227-49f0-9caa-ff809cfdac3a tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:44:04.221829 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-868697f0-0227-49f0-9caa-ff809cfdac3a tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:44:04.222552 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-868697f0-0227-49f0-9caa-ff809cfdac3a tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:44:04.223011 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-868697f0-0227-49f0-9caa-ff809cfdac3a tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:44:04.223441 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-868697f0-0227-49f0-9caa-ff809cfdac3a tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:44:04.360910 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-868697f0-0227-49f0-9caa-ff809cfdac3a tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:44:04.369218 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-868697f0-0227-49f0-9caa-ff809cfdac3a tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/4a776a29-1ae7-41ef-8b23-3c662aaddcab" status: 200 len: 1679 microversion: 2.1 time: 0.159496 Oct 27 04:44:04.369980 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3852/8001] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:44:04 2022] GET /compute/v2.1/servers/4a776a29-1ae7-41ef-8b23-3c662aaddcab => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:44:05.392704 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a5b41fc5-0dab-4916-9d13-776768a4eb32 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:44:05.393347 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a5b41fc5-0dab-4916-9d13-776768a4eb32 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: 4a776a29-1ae7-41ef-8b23-3c662aaddcab] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:44:05.400354 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a5b41fc5-0dab-4916-9d13-776768a4eb32 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:44:05.400860 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a5b41fc5-0dab-4916-9d13-776768a4eb32 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:44:05.401327 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a5b41fc5-0dab-4916-9d13-776768a4eb32 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:44:05.402063 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a5b41fc5-0dab-4916-9d13-776768a4eb32 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:44:05.402552 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a5b41fc5-0dab-4916-9d13-776768a4eb32 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:44:05.403007 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a5b41fc5-0dab-4916-9d13-776768a4eb32 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:44:05.532871 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a5b41fc5-0dab-4916-9d13-776768a4eb32 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:44:05.540699 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a5b41fc5-0dab-4916-9d13-776768a4eb32 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/4a776a29-1ae7-41ef-8b23-3c662aaddcab" status: 200 len: 1679 microversion: 2.1 time: 0.152462 Oct 27 04:44:05.541283 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4150/8002] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:44:05 2022] GET /compute/v2.1/servers/4a776a29-1ae7-41ef-8b23-3c662aaddcab => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:44:06.565079 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-755c3f6c-3f90-45b5-a030-db9861d4f328 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:44:06.565700 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-755c3f6c-3f90-45b5-a030-db9861d4f328 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: 4a776a29-1ae7-41ef-8b23-3c662aaddcab] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:44:06.572517 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-755c3f6c-3f90-45b5-a030-db9861d4f328 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:44:06.573011 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-755c3f6c-3f90-45b5-a030-db9861d4f328 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:44:06.573457 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-755c3f6c-3f90-45b5-a030-db9861d4f328 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:44:06.574194 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-755c3f6c-3f90-45b5-a030-db9861d4f328 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:44:06.574659 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-755c3f6c-3f90-45b5-a030-db9861d4f328 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:44:06.575093 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-755c3f6c-3f90-45b5-a030-db9861d4f328 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:44:06.705836 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-755c3f6c-3f90-45b5-a030-db9861d4f328 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:44:06.713575 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-755c3f6c-3f90-45b5-a030-db9861d4f328 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/4a776a29-1ae7-41ef-8b23-3c662aaddcab" status: 200 len: 1679 microversion: 2.1 time: 0.152951 Oct 27 04:44:06.714178 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3853/8003] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:44:06 2022] GET /compute/v2.1/servers/4a776a29-1ae7-41ef-8b23-3c662aaddcab => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:44:07.737207 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f9c37fcf-1957-4d2e-a7b1-97934795a119 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:44:07.737847 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f9c37fcf-1957-4d2e-a7b1-97934795a119 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: 4a776a29-1ae7-41ef-8b23-3c662aaddcab] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:44:07.745218 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f9c37fcf-1957-4d2e-a7b1-97934795a119 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:44:07.745727 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f9c37fcf-1957-4d2e-a7b1-97934795a119 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:44:07.746219 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f9c37fcf-1957-4d2e-a7b1-97934795a119 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:44:07.746938 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f9c37fcf-1957-4d2e-a7b1-97934795a119 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:44:07.747421 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f9c37fcf-1957-4d2e-a7b1-97934795a119 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:44:07.747870 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f9c37fcf-1957-4d2e-a7b1-97934795a119 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:44:08.205677 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f9c37fcf-1957-4d2e-a7b1-97934795a119 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:44:08.213593 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f9c37fcf-1957-4d2e-a7b1-97934795a119 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/4a776a29-1ae7-41ef-8b23-3c662aaddcab" status: 200 len: 1679 microversion: 2.1 time: 0.480438 Oct 27 04:44:08.219624 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4151/8004] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:44:07 2022] GET /compute/v2.1/servers/4a776a29-1ae7-41ef-8b23-3c662aaddcab => generated 1679 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:44:09.236931 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e1c18d67-4209-4ba8-b020-3d7505d1983d tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:44:09.237546 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e1c18d67-4209-4ba8-b020-3d7505d1983d tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: 4a776a29-1ae7-41ef-8b23-3c662aaddcab] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:44:09.244450 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e1c18d67-4209-4ba8-b020-3d7505d1983d tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:44:09.244936 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e1c18d67-4209-4ba8-b020-3d7505d1983d tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:44:09.245375 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e1c18d67-4209-4ba8-b020-3d7505d1983d tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:44:09.246088 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e1c18d67-4209-4ba8-b020-3d7505d1983d tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:44:09.246548 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e1c18d67-4209-4ba8-b020-3d7505d1983d tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:44:09.246985 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e1c18d67-4209-4ba8-b020-3d7505d1983d tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:44:09.383924 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e1c18d67-4209-4ba8-b020-3d7505d1983d tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:44:09.392176 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e1c18d67-4209-4ba8-b020-3d7505d1983d tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/4a776a29-1ae7-41ef-8b23-3c662aaddcab" status: 200 len: 1682 microversion: 2.1 time: 0.159117 Oct 27 04:44:09.392740 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3854/8005] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:44:09 2022] GET /compute/v2.1/servers/4a776a29-1ae7-41ef-8b23-3c662aaddcab => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:44:35.585941 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c9dc5537-c685-4e8e-a0ed-2a3396762c9c tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:44:35.588268 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c9dc5537-c685-4e8e-a0ed-2a3396762c9c tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: 4a776a29-1ae7-41ef-8b23-3c662aaddcab] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:44:35.590705 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=12 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:44:35.591402 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:44:35.596164 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c9dc5537-c685-4e8e-a0ed-2a3396762c9c tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:44:35.596677 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c9dc5537-c685-4e8e-a0ed-2a3396762c9c tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:44:35.597143 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c9dc5537-c685-4e8e-a0ed-2a3396762c9c tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:44:35.597862 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c9dc5537-c685-4e8e-a0ed-2a3396762c9c tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:44:35.598377 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c9dc5537-c685-4e8e-a0ed-2a3396762c9c tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:44:35.601544 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c9dc5537-c685-4e8e-a0ed-2a3396762c9c tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:44:35.665320 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c9dc5537-c685-4e8e-a0ed-2a3396762c9c tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "POST /compute/v2.1/servers/4a776a29-1ae7-41ef-8b23-3c662aaddcab/action" status: 200 len: 69054 microversion: 2.1 time: 0.083418 Oct 27 04:44:35.665986 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4152/8006] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 04:44:35 2022] POST /compute/v2.1/servers/4a776a29-1ae7-41ef-8b23-3c662aaddcab/action => generated 69054 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 04:44:42.756140 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c08d6655-cbdd-4d40-b1e6-a1b3e81bc494 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:44:42.756773 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c08d6655-cbdd-4d40-b1e6-a1b3e81bc494 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: 4a776a29-1ae7-41ef-8b23-3c662aaddcab] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:44:42.759032 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=12 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:44:42.760277 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=36 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:44:42.768063 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c08d6655-cbdd-4d40-b1e6-a1b3e81bc494 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:44:42.774257 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c08d6655-cbdd-4d40-b1e6-a1b3e81bc494 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:44:42.774257 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c08d6655-cbdd-4d40-b1e6-a1b3e81bc494 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:44:42.774257 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c08d6655-cbdd-4d40-b1e6-a1b3e81bc494 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:44:42.774257 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c08d6655-cbdd-4d40-b1e6-a1b3e81bc494 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:44:42.774257 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c08d6655-cbdd-4d40-b1e6-a1b3e81bc494 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:44:42.800375 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c08d6655-cbdd-4d40-b1e6-a1b3e81bc494 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: 4a776a29-1ae7-41ef-8b23-3c662aaddcab] Going to try to terminate instance {{(pid=121000) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 04:44:42.825356 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-54c0bf14-7b45-4d5d-b50d-5b86dc6262bd req-23d47fa7-1ac4-4a0b-ae96-eeaebcf01c35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a776a29-1ae7-41ef-8b23-3c662aaddcab", "tag": "e9c721de-16eb-4301-9954-a60d9ff39c22"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:44:42.838232 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-54c0bf14-7b45-4d5d-b50d-5b86dc6262bd req-23d47fa7-1ac4-4a0b-ae96-eeaebcf01c35 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:44:42.838891 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-54c0bf14-7b45-4d5d-b50d-5b86dc6262bd req-23d47fa7-1ac4-4a0b-ae96-eeaebcf01c35 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:44:42.839473 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-54c0bf14-7b45-4d5d-b50d-5b86dc6262bd req-23d47fa7-1ac4-4a0b-ae96-eeaebcf01c35 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:44:42.853850 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-54c0bf14-7b45-4d5d-b50d-5b86dc6262bd req-23d47fa7-1ac4-4a0b-ae96-eeaebcf01c35 service nova] Creating event network-changed:e9c721de-16eb-4301-9954-a60d9ff39c22 for instance 4a776a29-1ae7-41ef-8b23-3c662aaddcab on n-h1-862769-1 Oct 27 04:44:42.859742 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-54c0bf14-7b45-4d5d-b50d-5b86dc6262bd req-23d47fa7-1ac4-4a0b-ae96-eeaebcf01c35 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112338 Oct 27 04:44:42.860289 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4153/8007] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:44:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:44:43.096230 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c08d6655-cbdd-4d40-b1e6-a1b3e81bc494 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4a776a29-1ae7-41ef-8b23-3c662aaddcab" status: 204 len: 0 microversion: 2.1 time: 0.351244 Oct 27 04:44:43.096944 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3855/8008] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 04:44:42 2022] DELETE /compute/v2.1/servers/4a776a29-1ae7-41ef-8b23-3c662aaddcab => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 04:44:43.106453 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5516fe9c-13eb-4412-85fe-a7f35b6f6193 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:44:43.107610 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5516fe9c-13eb-4412-85fe-a7f35b6f6193 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: 4a776a29-1ae7-41ef-8b23-3c662aaddcab] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:44:43.118418 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5516fe9c-13eb-4412-85fe-a7f35b6f6193 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:44:43.118418 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5516fe9c-13eb-4412-85fe-a7f35b6f6193 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:44:43.118418 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5516fe9c-13eb-4412-85fe-a7f35b6f6193 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:44:43.118418 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5516fe9c-13eb-4412-85fe-a7f35b6f6193 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:44:43.118418 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5516fe9c-13eb-4412-85fe-a7f35b6f6193 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:44:43.118418 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5516fe9c-13eb-4412-85fe-a7f35b6f6193 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:44:43.256295 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5516fe9c-13eb-4412-85fe-a7f35b6f6193 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:44:43.264957 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5516fe9c-13eb-4412-85fe-a7f35b6f6193 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/4a776a29-1ae7-41ef-8b23-3c662aaddcab" status: 200 len: 1688 microversion: 2.1 time: 0.163287 Oct 27 04:44:43.265553 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4154/8009] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:44:43 2022] GET /compute/v2.1/servers/4a776a29-1ae7-41ef-8b23-3c662aaddcab => generated 1688 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:44:44.288776 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0f746295-c753-4a2a-ba2f-587537c70d80 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:44:44.289487 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0f746295-c753-4a2a-ba2f-587537c70d80 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: 4a776a29-1ae7-41ef-8b23-3c662aaddcab] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:44:44.296225 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0f746295-c753-4a2a-ba2f-587537c70d80 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:44:44.296718 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0f746295-c753-4a2a-ba2f-587537c70d80 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:44:44.297165 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0f746295-c753-4a2a-ba2f-587537c70d80 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:44:44.297860 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0f746295-c753-4a2a-ba2f-587537c70d80 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:44:44.298350 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0f746295-c753-4a2a-ba2f-587537c70d80 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:44:44.298785 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0f746295-c753-4a2a-ba2f-587537c70d80 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:44:44.430288 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0f746295-c753-4a2a-ba2f-587537c70d80 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:44:44.438000 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0f746295-c753-4a2a-ba2f-587537c70d80 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/4a776a29-1ae7-41ef-8b23-3c662aaddcab" status: 200 len: 1688 microversion: 2.1 time: 0.153565 Oct 27 04:44:44.438556 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3856/8010] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:44:44 2022] GET /compute/v2.1/servers/4a776a29-1ae7-41ef-8b23-3c662aaddcab => generated 1688 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:44:45.286056 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-cbd52b57-dcc6-4e14-9408-bdcdc43ac656 req-1fa53ac6-0b81-4ea9-8779-6b7691312a57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a776a29-1ae7-41ef-8b23-3c662aaddcab", "name": "network-vif-deleted", "tag": "e9c721de-16eb-4301-9954-a60d9ff39c22"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:44:45.296358 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-cbd52b57-dcc6-4e14-9408-bdcdc43ac656 req-1fa53ac6-0b81-4ea9-8779-6b7691312a57 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:44:45.299790 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-cbd52b57-dcc6-4e14-9408-bdcdc43ac656 req-1fa53ac6-0b81-4ea9-8779-6b7691312a57 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:44:45.299790 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-cbd52b57-dcc6-4e14-9408-bdcdc43ac656 req-1fa53ac6-0b81-4ea9-8779-6b7691312a57 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:44:45.308334 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-cbd52b57-dcc6-4e14-9408-bdcdc43ac656 req-1fa53ac6-0b81-4ea9-8779-6b7691312a57 service nova] Creating event network-vif-deleted:e9c721de-16eb-4301-9954-a60d9ff39c22 for instance 4a776a29-1ae7-41ef-8b23-3c662aaddcab on n-h1-862769-1 Oct 27 04:44:45.313315 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-cbd52b57-dcc6-4e14-9408-bdcdc43ac656 req-1fa53ac6-0b81-4ea9-8779-6b7691312a57 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030937 Oct 27 04:44:45.313897 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4155/8011] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:44:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:44:45.462824 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d94b8fa2-0496-4551-8d9d-674c84b03b65 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:44:45.463444 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d94b8fa2-0496-4551-8d9d-674c84b03b65 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: 4a776a29-1ae7-41ef-8b23-3c662aaddcab] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:44:45.470113 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d94b8fa2-0496-4551-8d9d-674c84b03b65 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:44:45.471797 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d94b8fa2-0496-4551-8d9d-674c84b03b65 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:44:45.471797 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d94b8fa2-0496-4551-8d9d-674c84b03b65 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:44:45.471797 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d94b8fa2-0496-4551-8d9d-674c84b03b65 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:44:45.472159 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d94b8fa2-0496-4551-8d9d-674c84b03b65 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:44:45.472574 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d94b8fa2-0496-4551-8d9d-674c84b03b65 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:44:45.538211 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d94b8fa2-0496-4551-8d9d-674c84b03b65 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:44:45.547211 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d94b8fa2-0496-4551-8d9d-674c84b03b65 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/4a776a29-1ae7-41ef-8b23-3c662aaddcab" status: 200 len: 1352 microversion: 2.1 time: 0.088337 Oct 27 04:44:45.547814 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3857/8012] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:44:45 2022] GET /compute/v2.1/servers/4a776a29-1ae7-41ef-8b23-3c662aaddcab => generated 1352 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:44:46.571902 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a0bb8e6f-3081-484a-8e16-20cea5610c22 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:44:46.572627 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a0bb8e6f-3081-484a-8e16-20cea5610c22 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: 4a776a29-1ae7-41ef-8b23-3c662aaddcab] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:44:46.579434 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a0bb8e6f-3081-484a-8e16-20cea5610c22 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:44:46.579934 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a0bb8e6f-3081-484a-8e16-20cea5610c22 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:44:46.580391 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a0bb8e6f-3081-484a-8e16-20cea5610c22 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:44:46.581105 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a0bb8e6f-3081-484a-8e16-20cea5610c22 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:44:46.581578 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a0bb8e6f-3081-484a-8e16-20cea5610c22 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:44:46.582025 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a0bb8e6f-3081-484a-8e16-20cea5610c22 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:44:46.595987 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-a0bb8e6f-3081-484a-8e16-20cea5610c22 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] HTTP exception thrown: Instance 4a776a29-1ae7-41ef-8b23-3c662aaddcab could not be found. Oct 27 04:44:46.597622 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a0bb8e6f-3081-484a-8e16-20cea5610c22 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Request method failure captured: Oct 27 04:44:46.597622 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/4a776a29-1ae7-41ef-8b23-3c662aaddcab HTTP/1.1 Oct 27 04:44:46.597622 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 04:44:46.597622 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 04:44:46.597622 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 04:44:46.597622 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 04:44:46.597622 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 04:44:46.597622 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 04:44:46.597622 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 04:44:46.597622 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 04:44:46.597622 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWgwK8Ydq2cZdl_qrXrzRt_-NHDs7Lbtyx3d1dP6RHEGcXjkmaGVWHwtmDAl_U5lub8Vu3EmSakuDoQfbZk0S8adwgJ-moO1z1C17My_hnWBVYQWYzYJdyvYOBGBq4h4dKTwzNOCKugh1J2CSdPdxb32D5VZEm2rfYKUP1FoiK7m3nt8 Oct 27 04:44:46.597622 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 04:44:46.597622 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 04:44:46.597622 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 04:44:46.597622 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 04:44:46.597622 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 04:44:46.597622 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 04:44:46.597622 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 67648db046c54ee3b314904c8338cd61 Oct 27 04:44:46.597622 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-952256618 Oct 27 04:44:46.597622 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 04:44:46.597622 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 04:44:46.597622 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/67648db046c54ee3b314904c8338cd61"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/67648db046c54ee3b314904c8338cd61"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/67648db046c54ee3b314904c8338cd61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_67648db046c54ee3b314904c8338cd61"}]}] Oct 27 04:44:46.597622 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-TestNetworkAdvancedServerOps-952256618 Oct 27 04:44:46.597622 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 67648db046c54ee3b314904c8338cd61 Oct 27 04:44:46.597622 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-952256618 Oct 27 04:44:46.597622 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-TestNetworkAdvancedServerOps-952256618-project Oct 27 04:44:46.597622 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 04:44:46.597622 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 04:44:46.597622 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 91e2c2dd9af848e5941d979683201c70 Oct 27 04:44:46.597622 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-TestNetworkAdvancedServerOps-952256618-project Oct 27 04:44:46.597622 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 04:44:46.597622 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 4a776a29-1ae7-41ef-8b23-3c662aaddcab could not be found. Oct 27 04:44:46.597622 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '4a776a29-1ae7-41ef-8b23-3c662aaddcab'} Oct 27 04:44:46.597622 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 04:44:46.597622 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:44:46.597622 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 04:44:46.597622 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 04:44:46.597622 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 04:44:46.597622 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 04:44:46.597622 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 04:44:46.597622 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 04:44:46.597622 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 04:44:46.597622 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 04:44:46.597622 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a776a29-1ae7-41ef-8b23-3c662aaddcab could not be found. Oct 27 04:44:46.597622 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:44:46.597622 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:44:46.597622 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:44:46.597622 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:44:46.597622 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:44:46.597622 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:44:46.597622 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 04:44:46.597622 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 04:44:46.597622 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 04:44:46.597622 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 04:44:46.597622 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 04:44:46.597622 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 04:44:46.597622 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 04:44:46.597622 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 04:44:46.597622 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 04:44:46.597622 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 04:44:46.597622 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a776a29-1ae7-41ef-8b23-3c662aaddcab could not be found. Oct 27 04:44:46.597622 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:44:46.597622 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:44:46.603661 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:44:46.603661 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:44:46.603661 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:44:46.603661 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:44:46.603661 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 04:44:46.603661 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 04:44:46.603661 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a776a29-1ae7-41ef-8b23-3c662aaddcab could not be found. Oct 27 04:44:46.603661 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:44:46.603661 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a0bb8e6f-3081-484a-8e16-20cea5610c22 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Returning 404 to user: Instance 4a776a29-1ae7-41ef-8b23-3c662aaddcab could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 04:44:46.603661 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a0bb8e6f-3081-484a-8e16-20cea5610c22 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/4a776a29-1ae7-41ef-8b23-3c662aaddcab" status: 404 len: 111 microversion: 2.1 time: 0.032451 Oct 27 04:44:46.603661 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4156/8013] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:44:46 2022] GET /compute/v2.1/servers/4a776a29-1ae7-41ef-8b23-3c662aaddcab => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 04:44:50.478344 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b86789f7-4a3f-4573-9e0c-67dec7710f7e tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '.version_select at 0x7f7dd9e43820>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:44:50.565326 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b86789f7-4a3f-4573-9e0c-67dec7710f7e tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1978972209" status: 202 len: 0 microversion: 2.1 time: 0.090927 Oct 27 04:44:50.565911 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3858/8014] 10.222.0.20 () {58 vars in 1284 bytes} [Thu Oct 27 04:44:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1978972209 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 04:44:50.595282 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5e1fb0e2-ef3e-4b13-adce-98a5bc3e8733 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Action: 'create', calling method: .version_select at 0x7f7dd9b3fd30>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1192335999", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBME1lR8ZuR76DweD6cDRpqxdu0yc0uC0ZG62O8QVnTqggPvy/pWOimNTDHFjWxd3WmWd6Yp5aB1358/cOp8AOBd/BV5EclLEy3BpFSXvO4IZvNx2kFkgPKuq8ykoDJlaww=="}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:44:50.602723 n-d-862769-1 devstack@n-api.service[121001]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 04:44:50.602867 n-d-862769-1 devstack@n-api.service[121001]: Thu Oct 27 04:44:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.20) !!! Oct 27 04:44:50.618239 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-5e1fb0e2-ef3e-4b13-adce-98a5bc3e8733 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Getting quotas for project 67648db046c54ee3b314904c8338cd61. Resources: {'key_pairs'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 04:44:50.623526 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-5e1fb0e2-ef3e-4b13-adce-98a5bc3e8733 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Getting quotas for user 91e2c2dd9af848e5941d979683201c70 and project 67648db046c54ee3b314904c8338cd61. Resources: {'key_pairs'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 04:44:50.708614 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5e1fb0e2-ef3e-4b13-adce-98a5bc3e8733 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.117815 Oct 27 04:44:50.709226 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4157/8015] 10.222.0.20 () {60 vars in 1159 bytes} [Thu Oct 27 04:44:50 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:44:59.172271 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c3e2d098-7482-4b6e-900b-27e47a47eb10 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-92201052", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": [{"uuid": "c7b5802d-f8fe-4232-a391-e0d2d55a6d57"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1192335999", "security_groups": [{"name": "tempest-secgroup-smoke-1147338786"}]}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:44:59.199681 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:44:59.335123 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-c3e2d098-7482-4b6e-900b-27e47a47eb10 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] validate_networks() for [('c7b5802d-f8fe-4232-a391-e0d2d55a6d57', None, None, None, None, None)] {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 04:44:59.834895 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-c3e2d098-7482-4b6e-900b-27e47a47eb10 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 04:44:59.835425 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-c3e2d098-7482-4b6e-900b-27e47a47eb10 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 04:44:59.836044 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-c3e2d098-7482-4b6e-900b-27e47a47eb10 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 04:44:59.836568 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-c3e2d098-7482-4b6e-900b-27e47a47eb10 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 04:44:59.837063 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-c3e2d098-7482-4b6e-900b-27e47a47eb10 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 04:44:59.846623 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c3e2d098-7482-4b6e-900b-27e47a47eb10 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:44:59.847109 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c3e2d098-7482-4b6e-900b-27e47a47eb10 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:44:59.847688 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c3e2d098-7482-4b6e-900b-27e47a47eb10 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:44:59.848455 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c3e2d098-7482-4b6e-900b-27e47a47eb10 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:44:59.848913 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c3e2d098-7482-4b6e-900b-27e47a47eb10 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:44:59.849348 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c3e2d098-7482-4b6e-900b-27e47a47eb10 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:44:59.867671 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-c3e2d098-7482-4b6e-900b-27e47a47eb10 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Getting quotas for project 67648db046c54ee3b314904c8338cd61. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 04:44:59.873043 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-c3e2d098-7482-4b6e-900b-27e47a47eb10 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Getting quotas for user 91e2c2dd9af848e5941d979683201c70 and project 67648db046c54ee3b314904c8338cd61. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 04:44:59.885728 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c3e2d098-7482-4b6e-900b-27e47a47eb10 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 04:44:59.888206 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c3e2d098-7482-4b6e-900b-27e47a47eb10 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: be34dab9-9b8e-4fe6-8779-83be387c454a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 04:45:00.024060 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c3e2d098-7482-4b6e-900b-27e47a47eb10 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.856423 Oct 27 04:45:00.024908 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3859/8016] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 04:44:59 2022] POST /compute/v2.1/servers => generated 406 bytes in 858 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 04:45:00.034535 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=16 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:45:00.039299 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f8f676c4-73e7-4f18-b37d-9464ec5a432f tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:45:00.039941 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f8f676c4-73e7-4f18-b37d-9464ec5a432f tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: be34dab9-9b8e-4fe6-8779-83be387c454a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:45:00.112860 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f8f676c4-73e7-4f18-b37d-9464ec5a432f tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:45:00.126129 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f8f676c4-73e7-4f18-b37d-9464ec5a432f tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/be34dab9-9b8e-4fe6-8779-83be387c454a" status: 200 len: 1265 microversion: 2.1 time: 0.093225 Oct 27 04:45:00.126997 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4158/8017] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:45:00 2022] GET /compute/v2.1/servers/be34dab9-9b8e-4fe6-8779-83be387c454a => generated 1265 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:45:01.150433 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7a74c211-25d4-4ac6-b168-9c76783e3095 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:45:01.150994 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7a74c211-25d4-4ac6-b168-9c76783e3095 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: be34dab9-9b8e-4fe6-8779-83be387c454a] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:45:01.159754 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7a74c211-25d4-4ac6-b168-9c76783e3095 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:45:01.160255 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7a74c211-25d4-4ac6-b168-9c76783e3095 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:45:01.160704 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7a74c211-25d4-4ac6-b168-9c76783e3095 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:45:01.161414 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7a74c211-25d4-4ac6-b168-9c76783e3095 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:45:01.161877 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7a74c211-25d4-4ac6-b168-9c76783e3095 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:45:01.162342 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7a74c211-25d4-4ac6-b168-9c76783e3095 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:45:01.231617 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7a74c211-25d4-4ac6-b168-9c76783e3095 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:45:01.241935 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7a74c211-25d4-4ac6-b168-9c76783e3095 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/be34dab9-9b8e-4fe6-8779-83be387c454a" status: 200 len: 1269 microversion: 2.1 time: 0.095767 Oct 27 04:45:01.242591 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3860/8018] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:45:01 2022] GET /compute/v2.1/servers/be34dab9-9b8e-4fe6-8779-83be387c454a => generated 1269 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 04:45:02.266452 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2a18e78d-66b4-4e18-9223-4f3a54c9c20a tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:45:02.267120 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2a18e78d-66b4-4e18-9223-4f3a54c9c20a tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: be34dab9-9b8e-4fe6-8779-83be387c454a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:45:02.277505 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2a18e78d-66b4-4e18-9223-4f3a54c9c20a tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:45:02.279635 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2a18e78d-66b4-4e18-9223-4f3a54c9c20a tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:45:02.279635 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2a18e78d-66b4-4e18-9223-4f3a54c9c20a tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:45:02.279884 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2a18e78d-66b4-4e18-9223-4f3a54c9c20a tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:45:02.280213 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2a18e78d-66b4-4e18-9223-4f3a54c9c20a tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:45:02.280669 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2a18e78d-66b4-4e18-9223-4f3a54c9c20a tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:45:02.347208 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2a18e78d-66b4-4e18-9223-4f3a54c9c20a tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:45:02.355214 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2a18e78d-66b4-4e18-9223-4f3a54c9c20a tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/be34dab9-9b8e-4fe6-8779-83be387c454a" status: 200 len: 1323 microversion: 2.1 time: 0.093492 Oct 27 04:45:02.355810 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4159/8019] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:45:02 2022] GET /compute/v2.1/servers/be34dab9-9b8e-4fe6-8779-83be387c454a => generated 1323 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:45:03.379717 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-81cea082-65e4-4add-beca-574931676b85 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:45:03.380345 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-81cea082-65e4-4add-beca-574931676b85 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: be34dab9-9b8e-4fe6-8779-83be387c454a] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:45:03.388697 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-81cea082-65e4-4add-beca-574931676b85 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:45:03.389462 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-81cea082-65e4-4add-beca-574931676b85 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:45:03.390124 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-81cea082-65e4-4add-beca-574931676b85 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:45:03.391035 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-81cea082-65e4-4add-beca-574931676b85 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:45:03.391667 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-81cea082-65e4-4add-beca-574931676b85 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:45:03.392273 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-81cea082-65e4-4add-beca-574931676b85 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:45:03.602960 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-81cea082-65e4-4add-beca-574931676b85 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:45:03.610950 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-81cea082-65e4-4add-beca-574931676b85 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/be34dab9-9b8e-4fe6-8779-83be387c454a" status: 200 len: 1391 microversion: 2.1 time: 0.235308 Oct 27 04:45:03.611739 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3861/8020] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:45:03 2022] GET /compute/v2.1/servers/be34dab9-9b8e-4fe6-8779-83be387c454a => generated 1391 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:45:03.843890 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-208a33cd-4e0f-4365-9dca-77f6bb119abf req-57b18f9f-1927-4c3d-9898-eb0a3e9b46d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be34dab9-9b8e-4fe6-8779-83be387c454a", "tag": "280156c1-2cc2-4601-a0d0-eeb3d03bd285"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:45:03.853684 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-208a33cd-4e0f-4365-9dca-77f6bb119abf req-57b18f9f-1927-4c3d-9898-eb0a3e9b46d6 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:45:03.854260 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-208a33cd-4e0f-4365-9dca-77f6bb119abf req-57b18f9f-1927-4c3d-9898-eb0a3e9b46d6 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:45:03.854728 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-208a33cd-4e0f-4365-9dca-77f6bb119abf req-57b18f9f-1927-4c3d-9898-eb0a3e9b46d6 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:45:03.869309 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-208a33cd-4e0f-4365-9dca-77f6bb119abf req-57b18f9f-1927-4c3d-9898-eb0a3e9b46d6 service nova] Creating event network-changed:280156c1-2cc2-4601-a0d0-eeb3d03bd285 for instance be34dab9-9b8e-4fe6-8779-83be387c454a on n-h2-862769-1 Oct 27 04:45:03.874975 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-208a33cd-4e0f-4365-9dca-77f6bb119abf req-57b18f9f-1927-4c3d-9898-eb0a3e9b46d6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095217 Oct 27 04:45:03.880229 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4160/8021] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:45:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 04:45:04.634286 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7941b54a-6018-4d99-9359-c6830b1846fc tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:45:04.634889 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7941b54a-6018-4d99-9359-c6830b1846fc tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: be34dab9-9b8e-4fe6-8779-83be387c454a] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:45:04.642112 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7941b54a-6018-4d99-9359-c6830b1846fc tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:45:04.642599 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7941b54a-6018-4d99-9359-c6830b1846fc tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:45:04.643037 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7941b54a-6018-4d99-9359-c6830b1846fc tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:45:04.643724 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7941b54a-6018-4d99-9359-c6830b1846fc tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:45:04.644179 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7941b54a-6018-4d99-9359-c6830b1846fc tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:45:04.644601 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7941b54a-6018-4d99-9359-c6830b1846fc tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:45:04.779707 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7941b54a-6018-4d99-9359-c6830b1846fc tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:45:04.787287 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7941b54a-6018-4d99-9359-c6830b1846fc tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/be34dab9-9b8e-4fe6-8779-83be387c454a" status: 200 len: 1391 microversion: 2.1 time: 0.156922 Oct 27 04:45:04.787860 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3862/8022] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:45:04 2022] GET /compute/v2.1/servers/be34dab9-9b8e-4fe6-8779-83be387c454a => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:45:05.811707 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c50904c8-fb1d-48e6-a757-9e8dfb1e844a tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:45:05.812385 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c50904c8-fb1d-48e6-a757-9e8dfb1e844a tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: be34dab9-9b8e-4fe6-8779-83be387c454a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:45:05.814449 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:45:05.819407 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c50904c8-fb1d-48e6-a757-9e8dfb1e844a tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:45:05.819914 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c50904c8-fb1d-48e6-a757-9e8dfb1e844a tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:45:05.820378 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c50904c8-fb1d-48e6-a757-9e8dfb1e844a tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:45:05.821097 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c50904c8-fb1d-48e6-a757-9e8dfb1e844a tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:45:05.821577 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c50904c8-fb1d-48e6-a757-9e8dfb1e844a tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:45:05.822052 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c50904c8-fb1d-48e6-a757-9e8dfb1e844a tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:45:05.957722 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c50904c8-fb1d-48e6-a757-9e8dfb1e844a tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:45:05.965435 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c50904c8-fb1d-48e6-a757-9e8dfb1e844a tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/be34dab9-9b8e-4fe6-8779-83be387c454a" status: 200 len: 1391 microversion: 2.1 time: 0.159056 Oct 27 04:45:05.966007 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4161/8023] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:45:05 2022] GET /compute/v2.1/servers/be34dab9-9b8e-4fe6-8779-83be387c454a => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:45:06.990592 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-82d29648-efa7-496d-b7e7-7fe81eb5d6b4 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:45:06.991217 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-82d29648-efa7-496d-b7e7-7fe81eb5d6b4 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: be34dab9-9b8e-4fe6-8779-83be387c454a] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:45:06.998023 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-82d29648-efa7-496d-b7e7-7fe81eb5d6b4 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:45:06.998539 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-82d29648-efa7-496d-b7e7-7fe81eb5d6b4 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:45:06.998988 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-82d29648-efa7-496d-b7e7-7fe81eb5d6b4 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:45:06.999692 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-82d29648-efa7-496d-b7e7-7fe81eb5d6b4 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:45:07.000152 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-82d29648-efa7-496d-b7e7-7fe81eb5d6b4 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:45:07.000586 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-82d29648-efa7-496d-b7e7-7fe81eb5d6b4 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:45:07.135072 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-82d29648-efa7-496d-b7e7-7fe81eb5d6b4 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:45:07.143399 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-82d29648-efa7-496d-b7e7-7fe81eb5d6b4 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/be34dab9-9b8e-4fe6-8779-83be387c454a" status: 200 len: 1391 microversion: 2.1 time: 0.156718 Oct 27 04:45:07.154438 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3863/8024] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:45:06 2022] GET /compute/v2.1/servers/be34dab9-9b8e-4fe6-8779-83be387c454a => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:45:08.170959 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d250c856-8637-4b2d-9fc8-786fe743d1de tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:45:08.170959 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d250c856-8637-4b2d-9fc8-786fe743d1de tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: be34dab9-9b8e-4fe6-8779-83be387c454a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:45:08.177972 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d250c856-8637-4b2d-9fc8-786fe743d1de tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:45:08.178508 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d250c856-8637-4b2d-9fc8-786fe743d1de tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:45:08.178973 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d250c856-8637-4b2d-9fc8-786fe743d1de tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:45:08.179701 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d250c856-8637-4b2d-9fc8-786fe743d1de tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:45:08.180183 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d250c856-8637-4b2d-9fc8-786fe743d1de tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:45:08.180631 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d250c856-8637-4b2d-9fc8-786fe743d1de tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:45:08.315816 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d250c856-8637-4b2d-9fc8-786fe743d1de tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:45:08.323790 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d250c856-8637-4b2d-9fc8-786fe743d1de tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/be34dab9-9b8e-4fe6-8779-83be387c454a" status: 200 len: 1391 microversion: 2.1 time: 0.158936 Oct 27 04:45:08.324368 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4162/8025] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:45:08 2022] GET /compute/v2.1/servers/be34dab9-9b8e-4fe6-8779-83be387c454a => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:45:09.339650 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-092a1a5e-fb0c-437e-8736-df7f4c7fa10a req-ee195295-b412-4b89-a47e-6ca8686b4f96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be34dab9-9b8e-4fe6-8779-83be387c454a", "name": "network-vif-plugged", "status": "completed", "tag": "280156c1-2cc2-4601-a0d0-eeb3d03bd285"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:45:09.347808 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-63001e97-5117-420d-9b50-2fef276bb205 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:45:09.348497 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-63001e97-5117-420d-9b50-2fef276bb205 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: be34dab9-9b8e-4fe6-8779-83be387c454a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:45:09.349474 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-092a1a5e-fb0c-437e-8736-df7f4c7fa10a req-ee195295-b412-4b89-a47e-6ca8686b4f96 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:45:09.349956 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-092a1a5e-fb0c-437e-8736-df7f4c7fa10a req-ee195295-b412-4b89-a47e-6ca8686b4f96 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:45:09.350414 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-092a1a5e-fb0c-437e-8736-df7f4c7fa10a req-ee195295-b412-4b89-a47e-6ca8686b4f96 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:45:09.355424 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-63001e97-5117-420d-9b50-2fef276bb205 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:45:09.355955 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-63001e97-5117-420d-9b50-2fef276bb205 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:45:09.356405 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-63001e97-5117-420d-9b50-2fef276bb205 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:45:09.357731 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-63001e97-5117-420d-9b50-2fef276bb205 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:45:09.358246 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-63001e97-5117-420d-9b50-2fef276bb205 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:45:09.358713 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-63001e97-5117-420d-9b50-2fef276bb205 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:45:09.363075 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-092a1a5e-fb0c-437e-8736-df7f4c7fa10a req-ee195295-b412-4b89-a47e-6ca8686b4f96 service nova] Creating event network-vif-plugged:280156c1-2cc2-4601-a0d0-eeb3d03bd285 for instance be34dab9-9b8e-4fe6-8779-83be387c454a on n-h2-862769-1 Oct 27 04:45:09.369844 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-092a1a5e-fb0c-437e-8736-df7f4c7fa10a req-ee195295-b412-4b89-a47e-6ca8686b4f96 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095239 Oct 27 04:45:09.370654 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3864/8026] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:45:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:45:09.504929 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-63001e97-5117-420d-9b50-2fef276bb205 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:45:09.513224 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-63001e97-5117-420d-9b50-2fef276bb205 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/be34dab9-9b8e-4fe6-8779-83be387c454a" status: 200 len: 1391 microversion: 2.1 time: 0.169413 Oct 27 04:45:09.514017 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4163/8027] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:45:09 2022] GET /compute/v2.1/servers/be34dab9-9b8e-4fe6-8779-83be387c454a => generated 1391 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:45:10.537568 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ba29ef6e-c19e-49fb-ae87-287935a23212 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:45:10.538426 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ba29ef6e-c19e-49fb-ae87-287935a23212 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: be34dab9-9b8e-4fe6-8779-83be387c454a] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:45:10.540315 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:45:10.541008 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=6 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:45:10.548540 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ba29ef6e-c19e-49fb-ae87-287935a23212 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:45:10.549078 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ba29ef6e-c19e-49fb-ae87-287935a23212 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:45:10.549528 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ba29ef6e-c19e-49fb-ae87-287935a23212 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:45:10.550263 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ba29ef6e-c19e-49fb-ae87-287935a23212 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:45:10.550721 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ba29ef6e-c19e-49fb-ae87-287935a23212 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:45:10.551757 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ba29ef6e-c19e-49fb-ae87-287935a23212 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:45:10.690487 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ba29ef6e-c19e-49fb-ae87-287935a23212 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:45:10.698331 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ba29ef6e-c19e-49fb-ae87-287935a23212 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/be34dab9-9b8e-4fe6-8779-83be387c454a" status: 200 len: 1562 microversion: 2.1 time: 0.165090 Oct 27 04:45:10.698917 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3865/8028] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:45:10 2022] GET /compute/v2.1/servers/be34dab9-9b8e-4fe6-8779-83be387c454a => generated 1562 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:45:10.721900 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3ff3ee2c-87c2-45fc-8dd6-6aa2419e1f33 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:45:10.726240 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3ff3ee2c-87c2-45fc-8dd6-6aa2419e1f33 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: be34dab9-9b8e-4fe6-8779-83be387c454a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:45:10.726240 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=6 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:45:10.730249 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3ff3ee2c-87c2-45fc-8dd6-6aa2419e1f33 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:45:10.730763 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3ff3ee2c-87c2-45fc-8dd6-6aa2419e1f33 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:45:10.731230 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3ff3ee2c-87c2-45fc-8dd6-6aa2419e1f33 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:45:10.732266 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3ff3ee2c-87c2-45fc-8dd6-6aa2419e1f33 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:45:10.732781 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3ff3ee2c-87c2-45fc-8dd6-6aa2419e1f33 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:45:10.733238 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3ff3ee2c-87c2-45fc-8dd6-6aa2419e1f33 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:45:10.867129 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3ff3ee2c-87c2-45fc-8dd6-6aa2419e1f33 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:45:10.874922 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3ff3ee2c-87c2-45fc-8dd6-6aa2419e1f33 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/be34dab9-9b8e-4fe6-8779-83be387c454a" status: 200 len: 1562 microversion: 2.1 time: 0.156988 Oct 27 04:45:10.875499 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4164/8029] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:45:10 2022] GET /compute/v2.1/servers/be34dab9-9b8e-4fe6-8779-83be387c454a => generated 1562 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:45:12.726536 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f7fcef09-7381-478e-ae27-4d6209b97573 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:45:12.727176 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f7fcef09-7381-478e-ae27-4d6209b97573 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: be34dab9-9b8e-4fe6-8779-83be387c454a] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:45:12.729152 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-aa43bae2-afa0-46ec-9ed1-7d42ffeebbe8 req-000353b1-16f5-4da5-97e3-d43c47a40904 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be34dab9-9b8e-4fe6-8779-83be387c454a", "tag": "280156c1-2cc2-4601-a0d0-eeb3d03bd285"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:45:12.735748 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f7fcef09-7381-478e-ae27-4d6209b97573 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:45:12.736252 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f7fcef09-7381-478e-ae27-4d6209b97573 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:45:12.736853 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f7fcef09-7381-478e-ae27-4d6209b97573 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:45:12.737580 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f7fcef09-7381-478e-ae27-4d6209b97573 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:45:12.738265 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f7fcef09-7381-478e-ae27-4d6209b97573 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:45:12.738869 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f7fcef09-7381-478e-ae27-4d6209b97573 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:45:12.741111 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-aa43bae2-afa0-46ec-9ed1-7d42ffeebbe8 req-000353b1-16f5-4da5-97e3-d43c47a40904 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:45:12.741693 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-aa43bae2-afa0-46ec-9ed1-7d42ffeebbe8 req-000353b1-16f5-4da5-97e3-d43c47a40904 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:45:12.742252 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-aa43bae2-afa0-46ec-9ed1-7d42ffeebbe8 req-000353b1-16f5-4da5-97e3-d43c47a40904 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:45:12.755346 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-aa43bae2-afa0-46ec-9ed1-7d42ffeebbe8 req-000353b1-16f5-4da5-97e3-d43c47a40904 service nova] Creating event network-changed:280156c1-2cc2-4601-a0d0-eeb3d03bd285 for instance be34dab9-9b8e-4fe6-8779-83be387c454a on n-h2-862769-1 Oct 27 04:45:12.761893 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-aa43bae2-afa0-46ec-9ed1-7d42ffeebbe8 req-000353b1-16f5-4da5-97e3-d43c47a40904 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036595 Oct 27 04:45:12.764256 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4165/8030] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:45:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:45:12.967128 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f7fcef09-7381-478e-ae27-4d6209b97573 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:45:12.976808 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f7fcef09-7381-478e-ae27-4d6209b97573 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/be34dab9-9b8e-4fe6-8779-83be387c454a" status: 200 len: 1562 microversion: 2.1 time: 0.254653 Oct 27 04:45:12.982673 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3866/8031] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:45:12 2022] GET /compute/v2.1/servers/be34dab9-9b8e-4fe6-8779-83be387c454a => generated 1562 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:45:36.229714 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=9 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:45:36.230935 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=34 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:45:36.235745 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2baac6a7-2543-4fa4-be63-98c6569e3772 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:45:36.238048 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2baac6a7-2543-4fa4-be63-98c6569e3772 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: be34dab9-9b8e-4fe6-8779-83be387c454a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:45:36.244160 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2baac6a7-2543-4fa4-be63-98c6569e3772 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:45:36.244661 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2baac6a7-2543-4fa4-be63-98c6569e3772 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:45:36.245168 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2baac6a7-2543-4fa4-be63-98c6569e3772 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:45:36.245878 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2baac6a7-2543-4fa4-be63-98c6569e3772 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:45:36.246377 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2baac6a7-2543-4fa4-be63-98c6569e3772 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:45:36.246828 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2baac6a7-2543-4fa4-be63-98c6569e3772 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:45:36.301656 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2baac6a7-2543-4fa4-be63-98c6569e3772 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "POST /compute/v2.1/servers/be34dab9-9b8e-4fe6-8779-83be387c454a/action" status: 200 len: 24570 microversion: 2.1 time: 0.074587 Oct 27 04:45:36.302460 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4166/8032] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 04:45:36 2022] POST /compute/v2.1/servers/be34dab9-9b8e-4fe6-8779-83be387c454a/action => generated 24570 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 04:45:42.617221 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-85909e04-809a-4a6d-94e1-be4c3aa03f91 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:45:42.619574 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-85909e04-809a-4a6d-94e1-be4c3aa03f91 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: be34dab9-9b8e-4fe6-8779-83be387c454a] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:45:42.621664 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:45:42.622348 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=40 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:45:42.627679 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-85909e04-809a-4a6d-94e1-be4c3aa03f91 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:45:42.628167 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-85909e04-809a-4a6d-94e1-be4c3aa03f91 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:45:42.628608 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-85909e04-809a-4a6d-94e1-be4c3aa03f91 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:45:42.629305 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-85909e04-809a-4a6d-94e1-be4c3aa03f91 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:45:42.629769 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-85909e04-809a-4a6d-94e1-be4c3aa03f91 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:45:42.630230 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-85909e04-809a-4a6d-94e1-be4c3aa03f91 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:45:42.670365 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-85909e04-809a-4a6d-94e1-be4c3aa03f91 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:45:42.676477 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-85909e04-809a-4a6d-94e1-be4c3aa03f91 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: be34dab9-9b8e-4fe6-8779-83be387c454a] Old instance type m1.heat2, new instance type m1.heat {{(pid=121000) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 27 04:45:42.683353 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-85909e04-809a-4a6d-94e1-be4c3aa03f91 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 04:45:42.683782 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-85909e04-809a-4a6d-94e1-be4c3aa03f91 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 04:45:42.684264 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-85909e04-809a-4a6d-94e1-be4c3aa03f91 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 04:45:42.684682 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-85909e04-809a-4a6d-94e1-be4c3aa03f91 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 04:45:42.685100 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-85909e04-809a-4a6d-94e1-be4c3aa03f91 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 04:45:42.853222 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-85909e04-809a-4a6d-94e1-be4c3aa03f91 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "POST /compute/v2.1/servers/be34dab9-9b8e-4fe6-8779-83be387c454a/action" status: 202 len: 0 microversion: 2.1 time: 0.240222 Oct 27 04:45:42.854220 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3867/8033] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 04:45:42 2022] POST /compute/v2.1/servers/be34dab9-9b8e-4fe6-8779-83be387c454a/action => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 04:45:42.863907 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b991052a-b444-4540-9440-d6724d87c6a9 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:45:42.864763 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b991052a-b444-4540-9440-d6724d87c6a9 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: be34dab9-9b8e-4fe6-8779-83be387c454a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:45:42.872597 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b991052a-b444-4540-9440-d6724d87c6a9 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:45:42.878430 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b991052a-b444-4540-9440-d6724d87c6a9 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:45:42.878430 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b991052a-b444-4540-9440-d6724d87c6a9 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:45:42.878430 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b991052a-b444-4540-9440-d6724d87c6a9 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:45:42.878430 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b991052a-b444-4540-9440-d6724d87c6a9 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:45:42.878430 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b991052a-b444-4540-9440-d6724d87c6a9 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:45:43.009616 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b991052a-b444-4540-9440-d6724d87c6a9 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:45:43.018702 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b991052a-b444-4540-9440-d6724d87c6a9 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/be34dab9-9b8e-4fe6-8779-83be387c454a" status: 200 len: 1690 microversion: 2.1 time: 0.159583 Oct 27 04:45:43.019281 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4167/8034] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:45:42 2022] GET /compute/v2.1/servers/be34dab9-9b8e-4fe6-8779-83be387c454a => generated 1690 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 04:45:44.043666 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-de35c674-7d0a-4610-8852-0ac0b0eacf8d tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:45:44.044282 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-de35c674-7d0a-4610-8852-0ac0b0eacf8d tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: be34dab9-9b8e-4fe6-8779-83be387c454a] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:45:44.050322 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-de35c674-7d0a-4610-8852-0ac0b0eacf8d tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:45:44.050811 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-de35c674-7d0a-4610-8852-0ac0b0eacf8d tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:45:44.051253 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-de35c674-7d0a-4610-8852-0ac0b0eacf8d tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:45:44.051949 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-de35c674-7d0a-4610-8852-0ac0b0eacf8d tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:45:44.052576 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-de35c674-7d0a-4610-8852-0ac0b0eacf8d tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:45:44.052931 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-de35c674-7d0a-4610-8852-0ac0b0eacf8d tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:45:44.189389 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-de35c674-7d0a-4610-8852-0ac0b0eacf8d tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:45:44.197122 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-de35c674-7d0a-4610-8852-0ac0b0eacf8d tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/be34dab9-9b8e-4fe6-8779-83be387c454a" status: 200 len: 1690 microversion: 2.1 time: 0.158102 Oct 27 04:45:44.197703 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3868/8035] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:45:44 2022] GET /compute/v2.1/servers/be34dab9-9b8e-4fe6-8779-83be387c454a => generated 1690 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:45:45.221803 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-db468d1f-0950-443a-921c-6bb2259426a1 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:45:45.222471 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-db468d1f-0950-443a-921c-6bb2259426a1 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: be34dab9-9b8e-4fe6-8779-83be387c454a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:45:45.229769 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-db468d1f-0950-443a-921c-6bb2259426a1 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:45:45.230335 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-db468d1f-0950-443a-921c-6bb2259426a1 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:45:45.230838 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-db468d1f-0950-443a-921c-6bb2259426a1 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:45:45.231577 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-db468d1f-0950-443a-921c-6bb2259426a1 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:45:45.232703 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-db468d1f-0950-443a-921c-6bb2259426a1 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:45:45.233181 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-db468d1f-0950-443a-921c-6bb2259426a1 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:45:45.375167 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-db468d1f-0950-443a-921c-6bb2259426a1 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:45:45.383063 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-db468d1f-0950-443a-921c-6bb2259426a1 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/be34dab9-9b8e-4fe6-8779-83be387c454a" status: 200 len: 1690 microversion: 2.1 time: 0.165223 Oct 27 04:45:45.383645 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4168/8036] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:45:45 2022] GET /compute/v2.1/servers/be34dab9-9b8e-4fe6-8779-83be387c454a => generated 1690 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:45:46.406675 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3224dd5b-7734-4730-8885-d0172bc455c5 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:45:46.407300 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-3224dd5b-7734-4730-8885-d0172bc455c5 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: be34dab9-9b8e-4fe6-8779-83be387c454a] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:45:46.414053 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3224dd5b-7734-4730-8885-d0172bc455c5 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:45:46.414544 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3224dd5b-7734-4730-8885-d0172bc455c5 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:45:46.414985 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3224dd5b-7734-4730-8885-d0172bc455c5 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:45:46.415680 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3224dd5b-7734-4730-8885-d0172bc455c5 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:45:46.416132 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3224dd5b-7734-4730-8885-d0172bc455c5 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:45:46.416560 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3224dd5b-7734-4730-8885-d0172bc455c5 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:45:46.594960 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-3224dd5b-7734-4730-8885-d0172bc455c5 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:45:46.602564 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3224dd5b-7734-4730-8885-d0172bc455c5 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/be34dab9-9b8e-4fe6-8779-83be387c454a" status: 200 len: 1695 microversion: 2.1 time: 0.199818 Oct 27 04:45:46.603135 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3869/8037] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:45:46 2022] GET /compute/v2.1/servers/be34dab9-9b8e-4fe6-8779-83be387c454a => generated 1695 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:45:47.627768 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8504d81e-4d00-4866-a9af-a10c7850b2da tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:45:47.628416 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8504d81e-4d00-4866-a9af-a10c7850b2da tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: be34dab9-9b8e-4fe6-8779-83be387c454a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:45:47.635411 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8504d81e-4d00-4866-a9af-a10c7850b2da tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:45:47.636362 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8504d81e-4d00-4866-a9af-a10c7850b2da tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:45:47.636362 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8504d81e-4d00-4866-a9af-a10c7850b2da tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:45:47.637105 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8504d81e-4d00-4866-a9af-a10c7850b2da tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:45:47.637584 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8504d81e-4d00-4866-a9af-a10c7850b2da tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:45:47.638055 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8504d81e-4d00-4866-a9af-a10c7850b2da tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:45:47.816517 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8504d81e-4d00-4866-a9af-a10c7850b2da tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:45:47.824320 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8504d81e-4d00-4866-a9af-a10c7850b2da tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/be34dab9-9b8e-4fe6-8779-83be387c454a" status: 200 len: 1695 microversion: 2.1 time: 0.200509 Oct 27 04:45:47.824898 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4169/8038] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:45:47 2022] GET /compute/v2.1/servers/be34dab9-9b8e-4fe6-8779-83be387c454a => generated 1695 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:45:48.848500 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-dc6032f5-15af-411d-b200-8ee2325c9573 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:45:48.849125 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-dc6032f5-15af-411d-b200-8ee2325c9573 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: be34dab9-9b8e-4fe6-8779-83be387c454a] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:45:48.855978 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dc6032f5-15af-411d-b200-8ee2325c9573 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:45:48.856467 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dc6032f5-15af-411d-b200-8ee2325c9573 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:45:48.856912 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dc6032f5-15af-411d-b200-8ee2325c9573 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:45:48.857906 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dc6032f5-15af-411d-b200-8ee2325c9573 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:45:48.858392 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dc6032f5-15af-411d-b200-8ee2325c9573 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:45:48.858827 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dc6032f5-15af-411d-b200-8ee2325c9573 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:45:48.991279 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-dc6032f5-15af-411d-b200-8ee2325c9573 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:45:48.998948 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-dc6032f5-15af-411d-b200-8ee2325c9573 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/be34dab9-9b8e-4fe6-8779-83be387c454a" status: 200 len: 1695 microversion: 2.1 time: 0.154552 Oct 27 04:45:48.999525 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3870/8039] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:45:48 2022] GET /compute/v2.1/servers/be34dab9-9b8e-4fe6-8779-83be387c454a => generated 1695 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:45:50.022854 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-57a6c933-da5e-475c-a298-fb68c4621f3e tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:45:50.023502 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-57a6c933-da5e-475c-a298-fb68c4621f3e tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: be34dab9-9b8e-4fe6-8779-83be387c454a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:45:50.030444 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-57a6c933-da5e-475c-a298-fb68c4621f3e tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:45:50.030952 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-57a6c933-da5e-475c-a298-fb68c4621f3e tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:45:50.031418 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-57a6c933-da5e-475c-a298-fb68c4621f3e tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:45:50.032137 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-57a6c933-da5e-475c-a298-fb68c4621f3e tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:45:50.032616 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-57a6c933-da5e-475c-a298-fb68c4621f3e tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:45:50.033063 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-57a6c933-da5e-475c-a298-fb68c4621f3e tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:45:50.166377 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-57a6c933-da5e-475c-a298-fb68c4621f3e tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:45:50.174359 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-57a6c933-da5e-475c-a298-fb68c4621f3e tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/be34dab9-9b8e-4fe6-8779-83be387c454a" status: 200 len: 1695 microversion: 2.1 time: 0.155482 Oct 27 04:45:50.174943 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4170/8040] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:45:50 2022] GET /compute/v2.1/servers/be34dab9-9b8e-4fe6-8779-83be387c454a => generated 1695 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:45:51.198011 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d398e27b-0156-4c87-a326-87edc2ce46a4 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:45:51.198653 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d398e27b-0156-4c87-a326-87edc2ce46a4 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: be34dab9-9b8e-4fe6-8779-83be387c454a] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:45:51.206015 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d398e27b-0156-4c87-a326-87edc2ce46a4 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:45:51.206529 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d398e27b-0156-4c87-a326-87edc2ce46a4 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:45:51.206972 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d398e27b-0156-4c87-a326-87edc2ce46a4 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:45:51.207671 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d398e27b-0156-4c87-a326-87edc2ce46a4 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:45:51.208136 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d398e27b-0156-4c87-a326-87edc2ce46a4 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:45:51.208565 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d398e27b-0156-4c87-a326-87edc2ce46a4 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:45:51.338104 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d398e27b-0156-4c87-a326-87edc2ce46a4 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:45:51.346452 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d398e27b-0156-4c87-a326-87edc2ce46a4 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/be34dab9-9b8e-4fe6-8779-83be387c454a" status: 200 len: 1695 microversion: 2.1 time: 0.152297 Oct 27 04:45:51.347033 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3871/8041] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:45:51 2022] GET /compute/v2.1/servers/be34dab9-9b8e-4fe6-8779-83be387c454a => generated 1695 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:45:52.370155 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f5cc3275-b027-470c-a166-9d32a32a9c30 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:45:52.370822 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f5cc3275-b027-470c-a166-9d32a32a9c30 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: be34dab9-9b8e-4fe6-8779-83be387c454a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:45:52.377598 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f5cc3275-b027-470c-a166-9d32a32a9c30 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:45:52.378130 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f5cc3275-b027-470c-a166-9d32a32a9c30 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:45:52.378596 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f5cc3275-b027-470c-a166-9d32a32a9c30 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:45:52.379306 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f5cc3275-b027-470c-a166-9d32a32a9c30 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:45:52.379775 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f5cc3275-b027-470c-a166-9d32a32a9c30 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:45:52.380219 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f5cc3275-b027-470c-a166-9d32a32a9c30 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:45:52.509886 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f5cc3275-b027-470c-a166-9d32a32a9c30 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:45:52.518191 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f5cc3275-b027-470c-a166-9d32a32a9c30 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/be34dab9-9b8e-4fe6-8779-83be387c454a" status: 200 len: 1695 microversion: 2.1 time: 0.151983 Oct 27 04:45:52.518773 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4171/8042] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:45:52 2022] GET /compute/v2.1/servers/be34dab9-9b8e-4fe6-8779-83be387c454a => generated 1695 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:45:53.542214 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b9b6f9ce-d0bf-4a71-91af-62a8ca4a1894 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:45:53.542870 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b9b6f9ce-d0bf-4a71-91af-62a8ca4a1894 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: be34dab9-9b8e-4fe6-8779-83be387c454a] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:45:53.550395 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b9b6f9ce-d0bf-4a71-91af-62a8ca4a1894 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:45:53.550892 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b9b6f9ce-d0bf-4a71-91af-62a8ca4a1894 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:45:53.551344 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b9b6f9ce-d0bf-4a71-91af-62a8ca4a1894 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:45:53.552054 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b9b6f9ce-d0bf-4a71-91af-62a8ca4a1894 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:45:53.552517 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b9b6f9ce-d0bf-4a71-91af-62a8ca4a1894 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:45:53.552956 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b9b6f9ce-d0bf-4a71-91af-62a8ca4a1894 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:45:53.686457 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b9b6f9ce-d0bf-4a71-91af-62a8ca4a1894 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:45:53.694263 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b9b6f9ce-d0bf-4a71-91af-62a8ca4a1894 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/be34dab9-9b8e-4fe6-8779-83be387c454a" status: 200 len: 1695 microversion: 2.1 time: 0.155988 Oct 27 04:45:53.694838 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3872/8043] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:45:53 2022] GET /compute/v2.1/servers/be34dab9-9b8e-4fe6-8779-83be387c454a => generated 1695 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:45:54.718247 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c7435c7e-cca6-4995-b114-767da4f9cf63 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:45:54.718893 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c7435c7e-cca6-4995-b114-767da4f9cf63 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: be34dab9-9b8e-4fe6-8779-83be387c454a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:45:54.726354 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c7435c7e-cca6-4995-b114-767da4f9cf63 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:45:54.726858 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c7435c7e-cca6-4995-b114-767da4f9cf63 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:45:54.727315 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c7435c7e-cca6-4995-b114-767da4f9cf63 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:45:54.728035 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c7435c7e-cca6-4995-b114-767da4f9cf63 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:45:54.728508 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c7435c7e-cca6-4995-b114-767da4f9cf63 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:45:54.728953 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c7435c7e-cca6-4995-b114-767da4f9cf63 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:45:54.864453 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c7435c7e-cca6-4995-b114-767da4f9cf63 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:45:54.872266 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c7435c7e-cca6-4995-b114-767da4f9cf63 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/be34dab9-9b8e-4fe6-8779-83be387c454a" status: 200 len: 1695 microversion: 2.1 time: 0.158132 Oct 27 04:45:54.873509 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4172/8044] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:45:54 2022] GET /compute/v2.1/servers/be34dab9-9b8e-4fe6-8779-83be387c454a => generated 1695 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:45:55.896282 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b50fc627-33cb-4051-bc15-88780df4150b tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:45:55.896908 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b50fc627-33cb-4051-bc15-88780df4150b tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: be34dab9-9b8e-4fe6-8779-83be387c454a] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:45:55.903641 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b50fc627-33cb-4051-bc15-88780df4150b tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:45:55.904182 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b50fc627-33cb-4051-bc15-88780df4150b tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:45:55.904618 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b50fc627-33cb-4051-bc15-88780df4150b tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:45:55.905316 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b50fc627-33cb-4051-bc15-88780df4150b tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:45:55.905772 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b50fc627-33cb-4051-bc15-88780df4150b tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:45:55.906225 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b50fc627-33cb-4051-bc15-88780df4150b tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:45:56.043064 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b50fc627-33cb-4051-bc15-88780df4150b tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:45:56.050668 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b50fc627-33cb-4051-bc15-88780df4150b tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/be34dab9-9b8e-4fe6-8779-83be387c454a" status: 200 len: 1695 microversion: 2.1 time: 0.158292 Oct 27 04:45:56.051262 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3873/8045] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:45:55 2022] GET /compute/v2.1/servers/be34dab9-9b8e-4fe6-8779-83be387c454a => generated 1695 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:45:57.074905 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-07cb6e74-c904-4685-a6cb-4c0eb3b1f0f1 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:45:57.075541 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-07cb6e74-c904-4685-a6cb-4c0eb3b1f0f1 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: be34dab9-9b8e-4fe6-8779-83be387c454a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:45:57.082967 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-07cb6e74-c904-4685-a6cb-4c0eb3b1f0f1 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:45:57.085938 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-07cb6e74-c904-4685-a6cb-4c0eb3b1f0f1 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:45:57.085938 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-07cb6e74-c904-4685-a6cb-4c0eb3b1f0f1 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:45:57.085938 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-07cb6e74-c904-4685-a6cb-4c0eb3b1f0f1 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:45:57.085938 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-07cb6e74-c904-4685-a6cb-4c0eb3b1f0f1 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:45:57.085938 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-07cb6e74-c904-4685-a6cb-4c0eb3b1f0f1 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:45:57.218161 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-07cb6e74-c904-4685-a6cb-4c0eb3b1f0f1 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:45:57.226010 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-07cb6e74-c904-4685-a6cb-4c0eb3b1f0f1 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/be34dab9-9b8e-4fe6-8779-83be387c454a" status: 200 len: 1695 microversion: 2.1 time: 0.155220 Oct 27 04:45:57.226613 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4173/8046] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:45:57 2022] GET /compute/v2.1/servers/be34dab9-9b8e-4fe6-8779-83be387c454a => generated 1695 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:45:58.249316 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-592414a4-dba2-49a3-8f3b-d0a94a6f896d tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:45:58.249921 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-592414a4-dba2-49a3-8f3b-d0a94a6f896d tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: be34dab9-9b8e-4fe6-8779-83be387c454a] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:45:58.256381 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-592414a4-dba2-49a3-8f3b-d0a94a6f896d tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:45:58.256882 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-592414a4-dba2-49a3-8f3b-d0a94a6f896d tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:45:58.257323 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-592414a4-dba2-49a3-8f3b-d0a94a6f896d tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:45:58.258028 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-592414a4-dba2-49a3-8f3b-d0a94a6f896d tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:45:58.258529 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-592414a4-dba2-49a3-8f3b-d0a94a6f896d tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:45:58.258962 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-592414a4-dba2-49a3-8f3b-d0a94a6f896d tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:45:58.403439 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-592414a4-dba2-49a3-8f3b-d0a94a6f896d tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:45:58.411901 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-592414a4-dba2-49a3-8f3b-d0a94a6f896d tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/be34dab9-9b8e-4fe6-8779-83be387c454a" status: 200 len: 1694 microversion: 2.1 time: 0.167047 Oct 27 04:45:58.412496 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3874/8047] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:45:58 2022] GET /compute/v2.1/servers/be34dab9-9b8e-4fe6-8779-83be387c454a => generated 1694 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:45:58.737734 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-5faaee81-9405-4841-862d-e7a3b2f2aed0 req-b9649864-069f-44db-b424-04bd728d1583 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be34dab9-9b8e-4fe6-8779-83be387c454a", "name": "network-vif-unplugged", "status": "completed", "tag": "280156c1-2cc2-4601-a0d0-eeb3d03bd285"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:45:58.748633 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-5faaee81-9405-4841-862d-e7a3b2f2aed0 req-b9649864-069f-44db-b424-04bd728d1583 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:45:58.749137 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-5faaee81-9405-4841-862d-e7a3b2f2aed0 req-b9649864-069f-44db-b424-04bd728d1583 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:45:58.749639 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-5faaee81-9405-4841-862d-e7a3b2f2aed0 req-b9649864-069f-44db-b424-04bd728d1583 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:45:58.761867 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-5faaee81-9405-4841-862d-e7a3b2f2aed0 req-b9649864-069f-44db-b424-04bd728d1583 service nova] Creating event network-vif-unplugged:280156c1-2cc2-4601-a0d0-eeb3d03bd285 for instance be34dab9-9b8e-4fe6-8779-83be387c454a on n-h1-862769-1 Oct 27 04:45:58.768073 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [req-5faaee81-9405-4841-862d-e7a3b2f2aed0 req-b9649864-069f-44db-b424-04bd728d1583 service nova] Instance be34dab9-9b8e-4fe6-8779-83be387c454a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862769-1', 'n-h1-862769-1'} {{(pid=121001) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 04:45:58.780542 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-5faaee81-9405-4841-862d-e7a3b2f2aed0 req-b9649864-069f-44db-b424-04bd728d1583 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046580 Oct 27 04:45:58.781153 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4174/8048] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:45:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 04:45:59.436090 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-82a56a2b-b1b4-4031-b4d9-306b172a0217 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:45:59.436716 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-82a56a2b-b1b4-4031-b4d9-306b172a0217 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: be34dab9-9b8e-4fe6-8779-83be387c454a] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:45:59.443586 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-82a56a2b-b1b4-4031-b4d9-306b172a0217 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:45:59.444080 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-82a56a2b-b1b4-4031-b4d9-306b172a0217 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:45:59.444520 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-82a56a2b-b1b4-4031-b4d9-306b172a0217 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:45:59.445224 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-82a56a2b-b1b4-4031-b4d9-306b172a0217 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:45:59.445755 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-82a56a2b-b1b4-4031-b4d9-306b172a0217 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:45:59.446218 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-82a56a2b-b1b4-4031-b4d9-306b172a0217 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:45:59.579693 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-82a56a2b-b1b4-4031-b4d9-306b172a0217 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:45:59.587546 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-82a56a2b-b1b4-4031-b4d9-306b172a0217 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/be34dab9-9b8e-4fe6-8779-83be387c454a" status: 200 len: 1694 microversion: 2.1 time: 0.155429 Oct 27 04:45:59.602158 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3875/8049] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:45:59 2022] GET /compute/v2.1/servers/be34dab9-9b8e-4fe6-8779-83be387c454a => generated 1694 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:46:00.613070 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a15408a4-2bf3-414f-b3ef-76c485f93113 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:46:00.613806 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a15408a4-2bf3-414f-b3ef-76c485f93113 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: be34dab9-9b8e-4fe6-8779-83be387c454a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:46:00.620622 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a15408a4-2bf3-414f-b3ef-76c485f93113 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:46:00.621134 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a15408a4-2bf3-414f-b3ef-76c485f93113 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:46:00.621607 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a15408a4-2bf3-414f-b3ef-76c485f93113 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:46:00.622366 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a15408a4-2bf3-414f-b3ef-76c485f93113 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:46:00.622852 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a15408a4-2bf3-414f-b3ef-76c485f93113 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:46:00.623307 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a15408a4-2bf3-414f-b3ef-76c485f93113 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:46:00.755749 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a15408a4-2bf3-414f-b3ef-76c485f93113 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:46:00.764200 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a15408a4-2bf3-414f-b3ef-76c485f93113 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/be34dab9-9b8e-4fe6-8779-83be387c454a" status: 200 len: 1692 microversion: 2.1 time: 0.155562 Oct 27 04:46:00.764780 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4175/8050] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:46:00 2022] GET /compute/v2.1/servers/be34dab9-9b8e-4fe6-8779-83be387c454a => generated 1692 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:46:00.794448 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-a3819866-378e-4bef-826d-4c08af71eeda req-146998ad-69db-4ca7-a44a-ffb3b874fbab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be34dab9-9b8e-4fe6-8779-83be387c454a", "tag": "280156c1-2cc2-4601-a0d0-eeb3d03bd285"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:46:00.804656 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-a3819866-378e-4bef-826d-4c08af71eeda req-146998ad-69db-4ca7-a44a-ffb3b874fbab service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:46:00.805140 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-a3819866-378e-4bef-826d-4c08af71eeda req-146998ad-69db-4ca7-a44a-ffb3b874fbab service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:46:00.805580 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-a3819866-378e-4bef-826d-4c08af71eeda req-146998ad-69db-4ca7-a44a-ffb3b874fbab service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:46:00.817005 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-a3819866-378e-4bef-826d-4c08af71eeda req-146998ad-69db-4ca7-a44a-ffb3b874fbab service nova] Creating event network-changed:280156c1-2cc2-4601-a0d0-eeb3d03bd285 for instance be34dab9-9b8e-4fe6-8779-83be387c454a on n-h1-862769-1 Oct 27 04:46:00.822185 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [req-a3819866-378e-4bef-826d-4c08af71eeda req-146998ad-69db-4ca7-a44a-ffb3b874fbab service nova] Instance be34dab9-9b8e-4fe6-8779-83be387c454a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862769-1', 'n-h1-862769-1'} {{(pid=121000) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 27 04:46:00.833607 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-a3819866-378e-4bef-826d-4c08af71eeda req-146998ad-69db-4ca7-a44a-ffb3b874fbab service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042863 Oct 27 04:46:00.834253 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3876/8051] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:46:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 04:46:01.788686 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ee4c3b6d-f38b-4e9a-8f66-a1eb49de9714 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:46:01.789323 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ee4c3b6d-f38b-4e9a-8f66-a1eb49de9714 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: be34dab9-9b8e-4fe6-8779-83be387c454a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:46:01.797462 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ee4c3b6d-f38b-4e9a-8f66-a1eb49de9714 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:46:01.798176 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ee4c3b6d-f38b-4e9a-8f66-a1eb49de9714 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:46:01.798781 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ee4c3b6d-f38b-4e9a-8f66-a1eb49de9714 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:46:01.799653 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ee4c3b6d-f38b-4e9a-8f66-a1eb49de9714 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:46:01.800233 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ee4c3b6d-f38b-4e9a-8f66-a1eb49de9714 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:46:01.800820 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ee4c3b6d-f38b-4e9a-8f66-a1eb49de9714 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:46:02.008294 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ee4c3b6d-f38b-4e9a-8f66-a1eb49de9714 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:46:02.017368 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ee4c3b6d-f38b-4e9a-8f66-a1eb49de9714 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/be34dab9-9b8e-4fe6-8779-83be387c454a" status: 200 len: 1692 microversion: 2.1 time: 0.232521 Oct 27 04:46:02.018082 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4176/8052] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:46:01 2022] GET /compute/v2.1/servers/be34dab9-9b8e-4fe6-8779-83be387c454a => generated 1692 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:46:03.044712 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-fba3c98d-b65c-4666-a4fb-927f71e5f89c tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:46:03.045420 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-fba3c98d-b65c-4666-a4fb-927f71e5f89c tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: be34dab9-9b8e-4fe6-8779-83be387c454a] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:46:03.052189 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fba3c98d-b65c-4666-a4fb-927f71e5f89c tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:46:03.052673 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fba3c98d-b65c-4666-a4fb-927f71e5f89c tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:46:03.053114 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fba3c98d-b65c-4666-a4fb-927f71e5f89c tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:46:03.053807 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fba3c98d-b65c-4666-a4fb-927f71e5f89c tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:46:03.054293 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fba3c98d-b65c-4666-a4fb-927f71e5f89c tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:46:03.054722 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fba3c98d-b65c-4666-a4fb-927f71e5f89c tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:46:03.188546 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-fba3c98d-b65c-4666-a4fb-927f71e5f89c tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:46:03.196369 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-fba3c98d-b65c-4666-a4fb-927f71e5f89c tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/be34dab9-9b8e-4fe6-8779-83be387c454a" status: 200 len: 1689 microversion: 2.1 time: 0.156915 Oct 27 04:46:03.196944 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3877/8053] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:46:03 2022] GET /compute/v2.1/servers/be34dab9-9b8e-4fe6-8779-83be387c454a => generated 1689 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:46:03.218996 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3ea35b1f-94af-45e6-a5f6-8742fa832e98 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:46:03.219556 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3ea35b1f-94af-45e6-a5f6-8742fa832e98 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: be34dab9-9b8e-4fe6-8779-83be387c454a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:46:03.226346 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3ea35b1f-94af-45e6-a5f6-8742fa832e98 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:46:03.226850 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3ea35b1f-94af-45e6-a5f6-8742fa832e98 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:46:03.227303 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3ea35b1f-94af-45e6-a5f6-8742fa832e98 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:46:03.228010 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3ea35b1f-94af-45e6-a5f6-8742fa832e98 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:46:03.228484 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3ea35b1f-94af-45e6-a5f6-8742fa832e98 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:46:03.228922 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-3ea35b1f-94af-45e6-a5f6-8742fa832e98 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:46:03.408666 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3ea35b1f-94af-45e6-a5f6-8742fa832e98 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "POST /compute/v2.1/servers/be34dab9-9b8e-4fe6-8779-83be387c454a/action" status: 204 len: 0 microversion: 2.1 time: 0.193280 Oct 27 04:46:03.409255 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4177/8054] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 04:46:03 2022] POST /compute/v2.1/servers/be34dab9-9b8e-4fe6-8779-83be387c454a/action => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 04:46:03.420314 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9138ed4d-32c6-45ec-ae13-fadb1a450474 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:46:03.421052 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9138ed4d-32c6-45ec-ae13-fadb1a450474 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: be34dab9-9b8e-4fe6-8779-83be387c454a] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:46:03.427027 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9138ed4d-32c6-45ec-ae13-fadb1a450474 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:46:03.427528 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9138ed4d-32c6-45ec-ae13-fadb1a450474 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:46:03.427977 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9138ed4d-32c6-45ec-ae13-fadb1a450474 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:46:03.428704 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9138ed4d-32c6-45ec-ae13-fadb1a450474 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:46:03.429161 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9138ed4d-32c6-45ec-ae13-fadb1a450474 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:46:03.429604 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9138ed4d-32c6-45ec-ae13-fadb1a450474 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:46:03.602261 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9138ed4d-32c6-45ec-ae13-fadb1a450474 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:46:03.610361 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9138ed4d-32c6-45ec-ae13-fadb1a450474 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/be34dab9-9b8e-4fe6-8779-83be387c454a" status: 200 len: 1689 microversion: 2.1 time: 0.194108 Oct 27 04:46:03.610936 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3878/8055] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:46:03 2022] GET /compute/v2.1/servers/be34dab9-9b8e-4fe6-8779-83be387c454a => generated 1689 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:46:03.633742 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7e94f3e5-d302-4ed5-8da9-d968298f046f tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:46:03.634516 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7e94f3e5-d302-4ed5-8da9-d968298f046f tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: be34dab9-9b8e-4fe6-8779-83be387c454a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:46:03.641529 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7e94f3e5-d302-4ed5-8da9-d968298f046f tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:46:03.642077 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7e94f3e5-d302-4ed5-8da9-d968298f046f tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:46:03.642545 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7e94f3e5-d302-4ed5-8da9-d968298f046f tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:46:03.643273 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7e94f3e5-d302-4ed5-8da9-d968298f046f tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:46:03.643747 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7e94f3e5-d302-4ed5-8da9-d968298f046f tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:46:03.644193 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7e94f3e5-d302-4ed5-8da9-d968298f046f tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:46:04.126181 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7e94f3e5-d302-4ed5-8da9-d968298f046f tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:46:04.134184 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7e94f3e5-d302-4ed5-8da9-d968298f046f tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/be34dab9-9b8e-4fe6-8779-83be387c454a" status: 200 len: 1689 microversion: 2.1 time: 0.504724 Oct 27 04:46:04.134773 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4178/8056] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:46:03 2022] GET /compute/v2.1/servers/be34dab9-9b8e-4fe6-8779-83be387c454a => generated 1689 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:46:05.158881 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-147c143d-d94f-4105-8c3e-61cc4433f583 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:46:05.159511 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-147c143d-d94f-4105-8c3e-61cc4433f583 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: be34dab9-9b8e-4fe6-8779-83be387c454a] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:46:05.166482 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-147c143d-d94f-4105-8c3e-61cc4433f583 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:46:05.166978 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-147c143d-d94f-4105-8c3e-61cc4433f583 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:46:05.167428 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-147c143d-d94f-4105-8c3e-61cc4433f583 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:46:05.168137 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-147c143d-d94f-4105-8c3e-61cc4433f583 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:46:05.168600 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-147c143d-d94f-4105-8c3e-61cc4433f583 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:46:05.169035 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-147c143d-d94f-4105-8c3e-61cc4433f583 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:46:05.311358 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-147c143d-d94f-4105-8c3e-61cc4433f583 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:46:05.319169 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-147c143d-d94f-4105-8c3e-61cc4433f583 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/be34dab9-9b8e-4fe6-8779-83be387c454a" status: 200 len: 1681 microversion: 2.1 time: 0.164817 Oct 27 04:46:05.319752 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3879/8057] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:46:05 2022] GET /compute/v2.1/servers/be34dab9-9b8e-4fe6-8779-83be387c454a => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:46:05.907426 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-cdc5dd2f-387b-47e5-bd49-18fa603e2f48 req-02dab612-5a86-4c43-894e-98ab8d3ba670 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be34dab9-9b8e-4fe6-8779-83be387c454a", "name": "network-vif-plugged", "status": "completed", "tag": "280156c1-2cc2-4601-a0d0-eeb3d03bd285"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:46:05.918727 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-cdc5dd2f-387b-47e5-bd49-18fa603e2f48 req-02dab612-5a86-4c43-894e-98ab8d3ba670 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:46:05.919206 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-cdc5dd2f-387b-47e5-bd49-18fa603e2f48 req-02dab612-5a86-4c43-894e-98ab8d3ba670 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:46:05.919652 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-cdc5dd2f-387b-47e5-bd49-18fa603e2f48 req-02dab612-5a86-4c43-894e-98ab8d3ba670 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:46:05.931643 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-cdc5dd2f-387b-47e5-bd49-18fa603e2f48 req-02dab612-5a86-4c43-894e-98ab8d3ba670 service nova] Creating event network-vif-plugged:280156c1-2cc2-4601-a0d0-eeb3d03bd285 for instance be34dab9-9b8e-4fe6-8779-83be387c454a on n-h1-862769-1 Oct 27 04:46:05.936790 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-cdc5dd2f-387b-47e5-bd49-18fa603e2f48 req-02dab612-5a86-4c43-894e-98ab8d3ba670 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033744 Oct 27 04:46:05.937388 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4179/8058] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:46:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:46:27.561635 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-127a54a6-7583-4660-93a2-baeaf664c36b tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:46:27.563848 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-127a54a6-7583-4660-93a2-baeaf664c36b tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: be34dab9-9b8e-4fe6-8779-83be387c454a] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:46:27.566811 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=30 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:46:27.567469 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:46:27.572128 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-127a54a6-7583-4660-93a2-baeaf664c36b tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:46:27.572615 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-127a54a6-7583-4660-93a2-baeaf664c36b tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:46:27.573054 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-127a54a6-7583-4660-93a2-baeaf664c36b tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:46:27.573746 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-127a54a6-7583-4660-93a2-baeaf664c36b tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:46:27.574235 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-127a54a6-7583-4660-93a2-baeaf664c36b tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:46:27.574665 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-127a54a6-7583-4660-93a2-baeaf664c36b tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:46:27.627456 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-127a54a6-7583-4660-93a2-baeaf664c36b tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "POST /compute/v2.1/servers/be34dab9-9b8e-4fe6-8779-83be387c454a/action" status: 200 len: 24580 microversion: 2.1 time: 0.070159 Oct 27 04:46:27.628095 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3880/8059] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 04:46:27 2022] POST /compute/v2.1/servers/be34dab9-9b8e-4fe6-8779-83be387c454a/action => generated 24580 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 04:46:34.925144 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a0df40e6-f550-43be-b4e6-a605a5925bd3 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:46:34.925840 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a0df40e6-f550-43be-b4e6-a605a5925bd3 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: be34dab9-9b8e-4fe6-8779-83be387c454a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:46:34.928118 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=28 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:46:34.928795 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:46:34.931238 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-f5de574f-ba09-4679-9468-ab90f6e1c375 req-f33be370-56da-482e-a9bb-4e275f7a233f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be34dab9-9b8e-4fe6-8779-83be387c454a", "tag": "280156c1-2cc2-4601-a0d0-eeb3d03bd285"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:46:34.934531 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a0df40e6-f550-43be-b4e6-a605a5925bd3 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:46:34.935043 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a0df40e6-f550-43be-b4e6-a605a5925bd3 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:46:34.935505 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a0df40e6-f550-43be-b4e6-a605a5925bd3 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:46:34.936738 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a0df40e6-f550-43be-b4e6-a605a5925bd3 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:46:34.937212 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a0df40e6-f550-43be-b4e6-a605a5925bd3 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:46:34.937657 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a0df40e6-f550-43be-b4e6-a605a5925bd3 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:46:34.945924 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-f5de574f-ba09-4679-9468-ab90f6e1c375 req-f33be370-56da-482e-a9bb-4e275f7a233f service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:46:34.947082 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-f5de574f-ba09-4679-9468-ab90f6e1c375 req-f33be370-56da-482e-a9bb-4e275f7a233f service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:46:34.947756 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-f5de574f-ba09-4679-9468-ab90f6e1c375 req-f33be370-56da-482e-a9bb-4e275f7a233f service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:46:34.964485 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a0df40e6-f550-43be-b4e6-a605a5925bd3 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: be34dab9-9b8e-4fe6-8779-83be387c454a] Going to try to terminate instance {{(pid=121001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 04:46:34.965877 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-f5de574f-ba09-4679-9468-ab90f6e1c375 req-f33be370-56da-482e-a9bb-4e275f7a233f service nova] Creating event network-changed:280156c1-2cc2-4601-a0d0-eeb3d03bd285 for instance be34dab9-9b8e-4fe6-8779-83be387c454a on n-h1-862769-1 Oct 27 04:46:34.971513 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-f5de574f-ba09-4679-9468-ab90f6e1c375 req-f33be370-56da-482e-a9bb-4e275f7a233f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046820 Oct 27 04:46:34.972568 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3881/8060] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:46:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:46:35.224345 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a0df40e6-f550-43be-b4e6-a605a5925bd3 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "DELETE /compute/v2.1/servers/be34dab9-9b8e-4fe6-8779-83be387c454a" status: 204 len: 0 microversion: 2.1 time: 0.303647 Oct 27 04:46:35.228566 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4180/8061] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 04:46:34 2022] DELETE /compute/v2.1/servers/be34dab9-9b8e-4fe6-8779-83be387c454a => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 04:46:35.235786 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-77c56d6b-a9f4-4733-9e37-b2fc161fbcfb tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:46:35.236428 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-77c56d6b-a9f4-4733-9e37-b2fc161fbcfb tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: be34dab9-9b8e-4fe6-8779-83be387c454a] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:46:35.244565 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-77c56d6b-a9f4-4733-9e37-b2fc161fbcfb tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:46:35.244737 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-77c56d6b-a9f4-4733-9e37-b2fc161fbcfb tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:46:35.245528 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-77c56d6b-a9f4-4733-9e37-b2fc161fbcfb tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:46:35.246472 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-77c56d6b-a9f4-4733-9e37-b2fc161fbcfb tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:46:35.247155 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-77c56d6b-a9f4-4733-9e37-b2fc161fbcfb tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:46:35.247824 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-77c56d6b-a9f4-4733-9e37-b2fc161fbcfb tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:46:35.393024 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-77c56d6b-a9f4-4733-9e37-b2fc161fbcfb tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:46:35.400866 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-77c56d6b-a9f4-4733-9e37-b2fc161fbcfb tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/be34dab9-9b8e-4fe6-8779-83be387c454a" status: 200 len: 1687 microversion: 2.1 time: 0.170532 Oct 27 04:46:35.405479 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3882/8062] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:46:35 2022] GET /compute/v2.1/servers/be34dab9-9b8e-4fe6-8779-83be387c454a => generated 1687 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:46:36.426187 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-02fd1ffb-38f3-418c-92d5-9594b2125852 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:46:36.427037 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-02fd1ffb-38f3-418c-92d5-9594b2125852 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: be34dab9-9b8e-4fe6-8779-83be387c454a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:46:36.434457 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-02fd1ffb-38f3-418c-92d5-9594b2125852 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:46:36.434974 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-02fd1ffb-38f3-418c-92d5-9594b2125852 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:46:36.435434 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-02fd1ffb-38f3-418c-92d5-9594b2125852 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:46:36.436677 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-02fd1ffb-38f3-418c-92d5-9594b2125852 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:46:36.437423 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-02fd1ffb-38f3-418c-92d5-9594b2125852 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:46:36.437876 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-02fd1ffb-38f3-418c-92d5-9594b2125852 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:46:36.607383 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-02fd1ffb-38f3-418c-92d5-9594b2125852 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:46:36.615969 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-02fd1ffb-38f3-418c-92d5-9594b2125852 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/be34dab9-9b8e-4fe6-8779-83be387c454a" status: 200 len: 1687 microversion: 2.1 time: 0.194227 Oct 27 04:46:36.616566 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4181/8063] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:46:36 2022] GET /compute/v2.1/servers/be34dab9-9b8e-4fe6-8779-83be387c454a => generated 1687 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:46:37.271308 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-f83958d6-c07f-496c-998d-992381b8dd1d req-9f311500-6273-4261-8c8e-e59ef149bf08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be34dab9-9b8e-4fe6-8779-83be387c454a", "name": "network-vif-deleted", "tag": "280156c1-2cc2-4601-a0d0-eeb3d03bd285"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:46:37.281599 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-f83958d6-c07f-496c-998d-992381b8dd1d req-9f311500-6273-4261-8c8e-e59ef149bf08 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:46:37.286715 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-f83958d6-c07f-496c-998d-992381b8dd1d req-9f311500-6273-4261-8c8e-e59ef149bf08 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:46:37.286715 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-f83958d6-c07f-496c-998d-992381b8dd1d req-9f311500-6273-4261-8c8e-e59ef149bf08 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:46:37.294260 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-f83958d6-c07f-496c-998d-992381b8dd1d req-9f311500-6273-4261-8c8e-e59ef149bf08 service nova] Creating event network-vif-deleted:280156c1-2cc2-4601-a0d0-eeb3d03bd285 for instance be34dab9-9b8e-4fe6-8779-83be387c454a on n-h1-862769-1 Oct 27 04:46:37.299271 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-f83958d6-c07f-496c-998d-992381b8dd1d req-9f311500-6273-4261-8c8e-e59ef149bf08 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031795 Oct 27 04:46:37.299857 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3883/8064] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:46:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:46:37.645679 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4985e0d2-2a90-41ce-845c-331ad5aadf16 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:46:37.647318 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4985e0d2-2a90-41ce-845c-331ad5aadf16 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: be34dab9-9b8e-4fe6-8779-83be387c454a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:46:37.655390 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4985e0d2-2a90-41ce-845c-331ad5aadf16 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:46:37.655907 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4985e0d2-2a90-41ce-845c-331ad5aadf16 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:46:37.657411 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4985e0d2-2a90-41ce-845c-331ad5aadf16 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:46:37.658409 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4985e0d2-2a90-41ce-845c-331ad5aadf16 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:46:37.658892 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4985e0d2-2a90-41ce-845c-331ad5aadf16 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:46:37.659350 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4985e0d2-2a90-41ce-845c-331ad5aadf16 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:46:37.692816 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4985e0d2-2a90-41ce-845c-331ad5aadf16 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:46:37.693329 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4985e0d2-2a90-41ce-845c-331ad5aadf16 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:46:37.693792 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4985e0d2-2a90-41ce-845c-331ad5aadf16 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:46:37.694321 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-4985e0d2-2a90-41ce-845c-331ad5aadf16 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lazy-loading 'fault' on Instance uuid be34dab9-9b8e-4fe6-8779-83be387c454a {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 04:46:37.737538 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4985e0d2-2a90-41ce-845c-331ad5aadf16 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:46:37.745257 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4985e0d2-2a90-41ce-845c-331ad5aadf16 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/be34dab9-9b8e-4fe6-8779-83be387c454a" status: 200 len: 1355 microversion: 2.1 time: 0.103714 Oct 27 04:46:37.745828 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4182/8065] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:46:37 2022] GET /compute/v2.1/servers/be34dab9-9b8e-4fe6-8779-83be387c454a => generated 1355 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:46:38.769903 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2cfbc9e9-1c2a-406c-a37f-e3d542da4749 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:46:38.770696 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-2cfbc9e9-1c2a-406c-a37f-e3d542da4749 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: be34dab9-9b8e-4fe6-8779-83be387c454a] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:46:38.776835 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2cfbc9e9-1c2a-406c-a37f-e3d542da4749 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:46:38.777322 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2cfbc9e9-1c2a-406c-a37f-e3d542da4749 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:46:38.777769 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2cfbc9e9-1c2a-406c-a37f-e3d542da4749 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:46:38.779336 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2cfbc9e9-1c2a-406c-a37f-e3d542da4749 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:46:38.780399 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2cfbc9e9-1c2a-406c-a37f-e3d542da4749 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:46:38.780832 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2cfbc9e9-1c2a-406c-a37f-e3d542da4749 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:46:38.794325 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-2cfbc9e9-1c2a-406c-a37f-e3d542da4749 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] HTTP exception thrown: Instance be34dab9-9b8e-4fe6-8779-83be387c454a could not be found. Oct 27 04:46:38.796011 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2cfbc9e9-1c2a-406c-a37f-e3d542da4749 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Request method failure captured: Oct 27 04:46:38.796011 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/be34dab9-9b8e-4fe6-8779-83be387c454a HTTP/1.1 Oct 27 04:46:38.796011 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 04:46:38.796011 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 04:46:38.796011 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 04:46:38.796011 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 04:46:38.796011 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 04:46:38.796011 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 04:46:38.796011 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 04:46:38.796011 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 04:46:38.796011 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWgwK8Ydq2cZdl_qrXrzRt_-NHDs7Lbtyx3d1dP6RHEGcXjkmaGVWHwtmDAl_U5lub8Vu3EmSakuDoQfbZk0S8adwgJ-moO1z1C17My_hnWBVYQWYzYJdyvYOBGBq4h4dKTwzNOCKugh1J2CSdPdxb32D5VZEm2rfYKUP1FoiK7m3nt8 Oct 27 04:46:38.796011 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 04:46:38.796011 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 04:46:38.796011 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 04:46:38.796011 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 04:46:38.796011 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 04:46:38.796011 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 04:46:38.796011 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 67648db046c54ee3b314904c8338cd61 Oct 27 04:46:38.796011 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-952256618 Oct 27 04:46:38.796011 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 04:46:38.796011 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 04:46:38.796011 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/67648db046c54ee3b314904c8338cd61"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/67648db046c54ee3b314904c8338cd61"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/67648db046c54ee3b314904c8338cd61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_67648db046c54ee3b314904c8338cd61"}]}] Oct 27 04:46:38.796011 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-TestNetworkAdvancedServerOps-952256618 Oct 27 04:46:38.796011 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 67648db046c54ee3b314904c8338cd61 Oct 27 04:46:38.796011 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-952256618 Oct 27 04:46:38.796011 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-TestNetworkAdvancedServerOps-952256618-project Oct 27 04:46:38.796011 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 04:46:38.796011 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 04:46:38.796011 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: 91e2c2dd9af848e5941d979683201c70 Oct 27 04:46:38.796011 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-TestNetworkAdvancedServerOps-952256618-project Oct 27 04:46:38.796011 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 04:46:38.796011 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance be34dab9-9b8e-4fe6-8779-83be387c454a could not be found. Oct 27 04:46:38.796011 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': 'be34dab9-9b8e-4fe6-8779-83be387c454a'} Oct 27 04:46:38.796011 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 04:46:38.796011 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:46:38.796011 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 04:46:38.796011 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 04:46:38.796011 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 04:46:38.796011 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 04:46:38.796011 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 04:46:38.796011 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 04:46:38.796011 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 04:46:38.796011 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 04:46:38.796011 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be34dab9-9b8e-4fe6-8779-83be387c454a could not be found. Oct 27 04:46:38.796011 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:46:38.796011 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:46:38.796011 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:46:38.796011 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:46:38.796011 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:46:38.796011 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:46:38.796011 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 04:46:38.796011 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 04:46:38.796011 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 04:46:38.796011 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 04:46:38.796011 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 04:46:38.796011 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 04:46:38.796011 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 04:46:38.796011 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 04:46:38.796011 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 04:46:38.796011 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 04:46:38.796011 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be34dab9-9b8e-4fe6-8779-83be387c454a could not be found. Oct 27 04:46:38.796011 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:46:38.796011 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:46:38.801326 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:46:38.801326 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:46:38.801326 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:46:38.801326 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:46:38.801326 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 04:46:38.801326 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 04:46:38.801326 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be34dab9-9b8e-4fe6-8779-83be387c454a could not be found. Oct 27 04:46:38.801326 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 04:46:38.801326 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2cfbc9e9-1c2a-406c-a37f-e3d542da4749 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Returning 404 to user: Instance be34dab9-9b8e-4fe6-8779-83be387c454a could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 04:46:38.801326 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2cfbc9e9-1c2a-406c-a37f-e3d542da4749 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/be34dab9-9b8e-4fe6-8779-83be387c454a" status: 404 len: 111 microversion: 2.1 time: 0.033360 Oct 27 04:46:38.801326 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3884/8066] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:46:38 2022] GET /compute/v2.1/servers/be34dab9-9b8e-4fe6-8779-83be387c454a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 04:46:42.482423 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-842f9081-c151-45f3-99b1-86adb184f4ef tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '.version_select at 0x7f7ddb6d1430>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:46:42.575539 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-842f9081-c151-45f3-99b1-86adb184f4ef tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1192335999" status: 202 len: 0 microversion: 2.1 time: 0.097200 Oct 27 04:46:42.576109 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4183/8067] 10.222.0.20 () {58 vars in 1284 bytes} [Thu Oct 27 04:46:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1192335999 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 04:46:42.602908 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-20281808-b0c7-49ee-ae7b-eac4dae4a9a5 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Action: 'create', calling method: .version_select at 0x7f7dd9c4a9d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-834811729", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEuaBDatKFGaUjOiRUBynUtBOpt2P6bHTUkwCORpXFzwFpbISebcNmPvqKQ0PeX5Zv6fc6bvME5t9VopgvdRAMwA8KwodKMeJty9CgAGVDKZ72DL0i7skwkTajBAm+YyvA=="}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:46:42.619635 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-20281808-b0c7-49ee-ae7b-eac4dae4a9a5 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Getting quotas for project 67648db046c54ee3b314904c8338cd61. Resources: {'key_pairs'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 04:46:42.625425 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-20281808-b0c7-49ee-ae7b-eac4dae4a9a5 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Getting quotas for user 91e2c2dd9af848e5941d979683201c70 and project 67648db046c54ee3b314904c8338cd61. Resources: {'key_pairs'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 04:46:42.707180 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-20281808-b0c7-49ee-ae7b-eac4dae4a9a5 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.108252 Oct 27 04:46:42.707774 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3885/8068] 10.222.0.20 () {60 vars in 1159 bytes} [Thu Oct 27 04:46:42 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:46:50.821810 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:46:50.826669 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b274b8a0-d636-452e-9697-d0ca8e3f90f1 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-737746202", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": [{"uuid": "2d2459be-0d2b-4b7f-be47-04825a55749a"}], "key_name": "tempest-TestNetworkAdvancedServerOps-834811729", "security_groups": [{"name": "tempest-secgroup-smoke-1115848339"}]}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:46:50.962649 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.network.neutron [None req-b274b8a0-d636-452e-9697-d0ca8e3f90f1 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] validate_networks() for [('2d2459be-0d2b-4b7f-be47-04825a55749a', None, None, None, None, None)] {{(pid=121001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 04:46:51.462922 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-b274b8a0-d636-452e-9697-d0ca8e3f90f1 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Flavor limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 04:46:51.463374 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-b274b8a0-d636-452e-9697-d0ca8e3f90f1 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Image limits 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 04:46:51.463875 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-b274b8a0-d636-452e-9697-d0ca8e3f90f1 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Flavor pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 04:46:51.464346 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-b274b8a0-d636-452e-9697-d0ca8e3f90f1 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Image pref 0:0:0 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 04:46:51.464787 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.virt.hardware [None req-b274b8a0-d636-452e-9697-d0ca8e3f90f1 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 04:46:51.474174 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b274b8a0-d636-452e-9697-d0ca8e3f90f1 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:46:51.474688 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b274b8a0-d636-452e-9697-d0ca8e3f90f1 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:46:51.475149 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b274b8a0-d636-452e-9697-d0ca8e3f90f1 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:46:51.476130 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b274b8a0-d636-452e-9697-d0ca8e3f90f1 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:46:51.476615 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b274b8a0-d636-452e-9697-d0ca8e3f90f1 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:46:51.477073 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b274b8a0-d636-452e-9697-d0ca8e3f90f1 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:46:51.496079 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-b274b8a0-d636-452e-9697-d0ca8e3f90f1 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Getting quotas for project 67648db046c54ee3b314904c8338cd61. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 04:46:51.503240 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-b274b8a0-d636-452e-9697-d0ca8e3f90f1 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Getting quotas for user 91e2c2dd9af848e5941d979683201c70 and project 67648db046c54ee3b314904c8338cd61. Resources: {'cores', 'instances', 'ram'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 04:46:51.516675 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b274b8a0-d636-452e-9697-d0ca8e3f90f1 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Going to run 1 instances... {{(pid=121001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 04:46:51.519061 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b274b8a0-d636-452e-9697-d0ca8e3f90f1 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: adafe923-20c4-4d81-9140-516cfb766d66] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 04:46:51.623886 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b274b8a0-d636-452e-9697-d0ca8e3f90f1 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.803958 Oct 27 04:46:51.625227 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4184/8069] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 04:46:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 806 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 04:46:51.636348 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-26704817-a1b1-42f6-83c1-1b7ff39d9f52 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:46:51.636896 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-26704817-a1b1-42f6-83c1-1b7ff39d9f52 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: adafe923-20c4-4d81-9140-516cfb766d66] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:46:51.641511 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=16 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:46:51.700036 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-26704817-a1b1-42f6-83c1-1b7ff39d9f52 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:46:51.707482 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-26704817-a1b1-42f6-83c1-1b7ff39d9f52 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/adafe923-20c4-4d81-9140-516cfb766d66" status: 200 len: 1265 microversion: 2.1 time: 0.075022 Oct 27 04:46:51.708059 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3886/8070] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:46:51 2022] GET /compute/v2.1/servers/adafe923-20c4-4d81-9140-516cfb766d66 => generated 1265 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:46:52.730983 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a3ce3f7a-800d-4939-bde2-c8ea911619e9 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:46:52.731628 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a3ce3f7a-800d-4939-bde2-c8ea911619e9 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: adafe923-20c4-4d81-9140-516cfb766d66] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:46:52.742358 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a3ce3f7a-800d-4939-bde2-c8ea911619e9 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:46:52.742358 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a3ce3f7a-800d-4939-bde2-c8ea911619e9 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:46:52.742358 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a3ce3f7a-800d-4939-bde2-c8ea911619e9 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:46:52.742358 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a3ce3f7a-800d-4939-bde2-c8ea911619e9 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:46:52.742358 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a3ce3f7a-800d-4939-bde2-c8ea911619e9 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:46:52.742358 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a3ce3f7a-800d-4939-bde2-c8ea911619e9 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:46:52.809330 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a3ce3f7a-800d-4939-bde2-c8ea911619e9 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:46:52.818309 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a3ce3f7a-800d-4939-bde2-c8ea911619e9 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/adafe923-20c4-4d81-9140-516cfb766d66" status: 200 len: 1269 microversion: 2.1 time: 0.092111 Oct 27 04:46:52.820396 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4185/8071] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:46:52 2022] GET /compute/v2.1/servers/adafe923-20c4-4d81-9140-516cfb766d66 => generated 1269 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:46:53.842858 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-33ca669e-6cee-440a-94fe-4fb373c130e9 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:46:53.844856 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-33ca669e-6cee-440a-94fe-4fb373c130e9 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: adafe923-20c4-4d81-9140-516cfb766d66] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:46:53.852784 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-33ca669e-6cee-440a-94fe-4fb373c130e9 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:46:53.853289 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-33ca669e-6cee-440a-94fe-4fb373c130e9 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:46:53.853740 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-33ca669e-6cee-440a-94fe-4fb373c130e9 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:46:53.854520 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-33ca669e-6cee-440a-94fe-4fb373c130e9 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:46:53.854992 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-33ca669e-6cee-440a-94fe-4fb373c130e9 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:46:53.855432 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-33ca669e-6cee-440a-94fe-4fb373c130e9 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:46:53.919289 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-33ca669e-6cee-440a-94fe-4fb373c130e9 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:46:53.927672 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-33ca669e-6cee-440a-94fe-4fb373c130e9 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/adafe923-20c4-4d81-9140-516cfb766d66" status: 200 len: 1335 microversion: 2.1 time: 0.089467 Oct 27 04:46:53.928254 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3887/8072] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:46:53 2022] GET /compute/v2.1/servers/adafe923-20c4-4d81-9140-516cfb766d66 => generated 1335 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:46:54.951121 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e58847dc-056d-444b-aa9b-3206a35e548f tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:46:54.951772 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e58847dc-056d-444b-aa9b-3206a35e548f tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: adafe923-20c4-4d81-9140-516cfb766d66] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:46:54.959044 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e58847dc-056d-444b-aa9b-3206a35e548f tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:46:54.959585 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e58847dc-056d-444b-aa9b-3206a35e548f tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:46:54.960055 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e58847dc-056d-444b-aa9b-3206a35e548f tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:46:54.960785 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e58847dc-056d-444b-aa9b-3206a35e548f tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:46:54.961268 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e58847dc-056d-444b-aa9b-3206a35e548f tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:46:54.961723 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e58847dc-056d-444b-aa9b-3206a35e548f tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:46:55.202851 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e58847dc-056d-444b-aa9b-3206a35e548f tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:46:55.211436 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e58847dc-056d-444b-aa9b-3206a35e548f tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/adafe923-20c4-4d81-9140-516cfb766d66" status: 200 len: 1391 microversion: 2.1 time: 0.264139 Oct 27 04:46:55.212053 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4186/8073] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:46:54 2022] GET /compute/v2.1/servers/adafe923-20c4-4d81-9140-516cfb766d66 => generated 1391 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 04:46:55.459690 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-77464b2a-340f-45ec-bc74-3d2725e33bc4 req-05c8da4c-2784-45f5-b548-b13fbae274e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "adafe923-20c4-4d81-9140-516cfb766d66", "tag": "578146b5-32b5-4d3c-8e5e-bc37e6ff2c15"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:46:55.470787 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-77464b2a-340f-45ec-bc74-3d2725e33bc4 req-05c8da4c-2784-45f5-b548-b13fbae274e0 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:46:55.475809 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-77464b2a-340f-45ec-bc74-3d2725e33bc4 req-05c8da4c-2784-45f5-b548-b13fbae274e0 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:46:55.475809 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-77464b2a-340f-45ec-bc74-3d2725e33bc4 req-05c8da4c-2784-45f5-b548-b13fbae274e0 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:46:55.484353 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-77464b2a-340f-45ec-bc74-3d2725e33bc4 req-05c8da4c-2784-45f5-b548-b13fbae274e0 service nova] Creating event network-changed:578146b5-32b5-4d3c-8e5e-bc37e6ff2c15 for instance adafe923-20c4-4d81-9140-516cfb766d66 on n-h1-862769-1 Oct 27 04:46:55.489495 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-77464b2a-340f-45ec-bc74-3d2725e33bc4 req-05c8da4c-2784-45f5-b548-b13fbae274e0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033654 Oct 27 04:46:55.490123 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3888/8074] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:46:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:46:56.237405 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-cb713689-dce4-4d86-90eb-832ba2f53298 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:46:56.239436 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-cb713689-dce4-4d86-90eb-832ba2f53298 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: adafe923-20c4-4d81-9140-516cfb766d66] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:46:56.244801 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cb713689-dce4-4d86-90eb-832ba2f53298 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:46:56.248775 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cb713689-dce4-4d86-90eb-832ba2f53298 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:46:56.248775 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cb713689-dce4-4d86-90eb-832ba2f53298 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:46:56.248775 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cb713689-dce4-4d86-90eb-832ba2f53298 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:46:56.248775 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cb713689-dce4-4d86-90eb-832ba2f53298 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:46:56.248775 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-cb713689-dce4-4d86-90eb-832ba2f53298 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:46:56.377737 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-cb713689-dce4-4d86-90eb-832ba2f53298 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:46:56.385701 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-cb713689-dce4-4d86-90eb-832ba2f53298 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/adafe923-20c4-4d81-9140-516cfb766d66" status: 200 len: 1391 microversion: 2.1 time: 0.153567 Oct 27 04:46:56.386322 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4187/8075] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:46:56 2022] GET /compute/v2.1/servers/adafe923-20c4-4d81-9140-516cfb766d66 => generated 1391 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:46:57.410717 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e00ee6e5-beeb-4522-a153-935b4162ce20 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:46:57.411441 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e00ee6e5-beeb-4522-a153-935b4162ce20 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: adafe923-20c4-4d81-9140-516cfb766d66] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:46:57.417755 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e00ee6e5-beeb-4522-a153-935b4162ce20 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:46:57.418294 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e00ee6e5-beeb-4522-a153-935b4162ce20 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:46:57.418745 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e00ee6e5-beeb-4522-a153-935b4162ce20 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:46:57.419448 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e00ee6e5-beeb-4522-a153-935b4162ce20 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:46:57.419913 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e00ee6e5-beeb-4522-a153-935b4162ce20 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:46:57.420347 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e00ee6e5-beeb-4522-a153-935b4162ce20 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:46:57.550352 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e00ee6e5-beeb-4522-a153-935b4162ce20 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:46:57.558108 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e00ee6e5-beeb-4522-a153-935b4162ce20 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/adafe923-20c4-4d81-9140-516cfb766d66" status: 200 len: 1391 microversion: 2.1 time: 0.152508 Oct 27 04:46:57.558693 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3889/8076] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:46:57 2022] GET /compute/v2.1/servers/adafe923-20c4-4d81-9140-516cfb766d66 => generated 1391 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:46:58.581739 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b9f51842-4d74-4e70-9c7b-e8812dbdc4f5 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:46:58.582407 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b9f51842-4d74-4e70-9c7b-e8812dbdc4f5 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: adafe923-20c4-4d81-9140-516cfb766d66] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:46:58.589335 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b9f51842-4d74-4e70-9c7b-e8812dbdc4f5 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:46:58.589843 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b9f51842-4d74-4e70-9c7b-e8812dbdc4f5 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:46:58.590337 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b9f51842-4d74-4e70-9c7b-e8812dbdc4f5 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:46:58.591056 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b9f51842-4d74-4e70-9c7b-e8812dbdc4f5 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:46:58.591532 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b9f51842-4d74-4e70-9c7b-e8812dbdc4f5 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:46:58.591984 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b9f51842-4d74-4e70-9c7b-e8812dbdc4f5 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:46:58.727994 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b9f51842-4d74-4e70-9c7b-e8812dbdc4f5 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:46:58.736505 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b9f51842-4d74-4e70-9c7b-e8812dbdc4f5 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/adafe923-20c4-4d81-9140-516cfb766d66" status: 200 len: 1391 microversion: 2.1 time: 0.158740 Oct 27 04:46:58.737080 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4188/8077] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:46:58 2022] GET /compute/v2.1/servers/adafe923-20c4-4d81-9140-516cfb766d66 => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:46:59.760337 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1aafc80b-bf55-4b6a-81e3-ae967d3e3f5d tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:46:59.761004 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1aafc80b-bf55-4b6a-81e3-ae967d3e3f5d tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: adafe923-20c4-4d81-9140-516cfb766d66] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:46:59.763286 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:46:59.768059 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1aafc80b-bf55-4b6a-81e3-ae967d3e3f5d tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:46:59.768552 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1aafc80b-bf55-4b6a-81e3-ae967d3e3f5d tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:46:59.768992 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1aafc80b-bf55-4b6a-81e3-ae967d3e3f5d tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:46:59.769691 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1aafc80b-bf55-4b6a-81e3-ae967d3e3f5d tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:46:59.770187 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1aafc80b-bf55-4b6a-81e3-ae967d3e3f5d tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:46:59.770621 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1aafc80b-bf55-4b6a-81e3-ae967d3e3f5d tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:46:59.908899 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1aafc80b-bf55-4b6a-81e3-ae967d3e3f5d tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:46:59.917063 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1aafc80b-bf55-4b6a-81e3-ae967d3e3f5d tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/adafe923-20c4-4d81-9140-516cfb766d66" status: 200 len: 1391 microversion: 2.1 time: 0.160894 Oct 27 04:46:59.919457 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3890/8078] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:46:59 2022] GET /compute/v2.1/servers/adafe923-20c4-4d81-9140-516cfb766d66 => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:47:00.941635 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f187b529-ac3d-4bb7-bb34-bcf006592fe6 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:47:00.942305 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f187b529-ac3d-4bb7-bb34-bcf006592fe6 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: adafe923-20c4-4d81-9140-516cfb766d66] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:47:00.948237 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f187b529-ac3d-4bb7-bb34-bcf006592fe6 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:47:00.948738 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f187b529-ac3d-4bb7-bb34-bcf006592fe6 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:47:00.949188 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f187b529-ac3d-4bb7-bb34-bcf006592fe6 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:47:00.949891 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f187b529-ac3d-4bb7-bb34-bcf006592fe6 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:47:00.950399 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f187b529-ac3d-4bb7-bb34-bcf006592fe6 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:47:00.950846 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f187b529-ac3d-4bb7-bb34-bcf006592fe6 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:47:01.082063 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f187b529-ac3d-4bb7-bb34-bcf006592fe6 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:47:01.090344 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f187b529-ac3d-4bb7-bb34-bcf006592fe6 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/adafe923-20c4-4d81-9140-516cfb766d66" status: 200 len: 1391 microversion: 2.1 time: 0.153459 Oct 27 04:47:01.090933 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4189/8079] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:47:00 2022] GET /compute/v2.1/servers/adafe923-20c4-4d81-9140-516cfb766d66 => generated 1391 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:47:02.103170 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-452e4b08-e41e-41bd-96f2-0b6b78d0f4b5 req-e818516d-bbd0-46d4-bb12-5f39c6b8e433 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adafe923-20c4-4d81-9140-516cfb766d66", "name": "network-vif-plugged", "status": "completed", "tag": "578146b5-32b5-4d3c-8e5e-bc37e6ff2c15"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:47:02.109215 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=6 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:47:02.114459 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b8594913-af39-4814-a7c7-f90ff3f3eb64 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:47:02.114957 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-452e4b08-e41e-41bd-96f2-0b6b78d0f4b5 req-e818516d-bbd0-46d4-bb12-5f39c6b8e433 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:47:02.115125 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-452e4b08-e41e-41bd-96f2-0b6b78d0f4b5 req-e818516d-bbd0-46d4-bb12-5f39c6b8e433 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:47:02.115302 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b8594913-af39-4814-a7c7-f90ff3f3eb64 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: adafe923-20c4-4d81-9140-516cfb766d66] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:47:02.115562 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-452e4b08-e41e-41bd-96f2-0b6b78d0f4b5 req-e818516d-bbd0-46d4-bb12-5f39c6b8e433 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:47:02.116979 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:47:02.117669 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=6 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:47:02.123407 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b8594913-af39-4814-a7c7-f90ff3f3eb64 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:47:02.123910 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b8594913-af39-4814-a7c7-f90ff3f3eb64 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:47:02.124913 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b8594913-af39-4814-a7c7-f90ff3f3eb64 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:47:02.125636 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b8594913-af39-4814-a7c7-f90ff3f3eb64 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:47:02.126226 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b8594913-af39-4814-a7c7-f90ff3f3eb64 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:47:02.126676 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b8594913-af39-4814-a7c7-f90ff3f3eb64 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:47:02.127783 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-452e4b08-e41e-41bd-96f2-0b6b78d0f4b5 req-e818516d-bbd0-46d4-bb12-5f39c6b8e433 service nova] Creating event network-vif-plugged:578146b5-32b5-4d3c-8e5e-bc37e6ff2c15 for instance adafe923-20c4-4d81-9140-516cfb766d66 on n-h1-862769-1 Oct 27 04:47:02.132865 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-452e4b08-e41e-41bd-96f2-0b6b78d0f4b5 req-e818516d-bbd0-46d4-bb12-5f39c6b8e433 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033397 Oct 27 04:47:02.133471 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3891/8080] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:47:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 04:47:02.281459 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b8594913-af39-4814-a7c7-f90ff3f3eb64 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:47:02.289980 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b8594913-af39-4814-a7c7-f90ff3f3eb64 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/adafe923-20c4-4d81-9140-516cfb766d66" status: 200 len: 1391 microversion: 2.1 time: 0.179370 Oct 27 04:47:02.290763 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4190/8081] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:47:02 2022] GET /compute/v2.1/servers/adafe923-20c4-4d81-9140-516cfb766d66 => generated 1391 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 04:47:03.315043 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a0bca011-f66f-4f81-bf61-5d710462a9a2 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:47:03.315744 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a0bca011-f66f-4f81-bf61-5d710462a9a2 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: adafe923-20c4-4d81-9140-516cfb766d66] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:47:03.322323 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a0bca011-f66f-4f81-bf61-5d710462a9a2 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:47:03.323302 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a0bca011-f66f-4f81-bf61-5d710462a9a2 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:47:03.323302 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a0bca011-f66f-4f81-bf61-5d710462a9a2 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:47:03.323907 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a0bca011-f66f-4f81-bf61-5d710462a9a2 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:47:03.324366 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a0bca011-f66f-4f81-bf61-5d710462a9a2 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:47:03.324789 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a0bca011-f66f-4f81-bf61-5d710462a9a2 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:47:03.461977 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a0bca011-f66f-4f81-bf61-5d710462a9a2 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:47:03.469738 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a0bca011-f66f-4f81-bf61-5d710462a9a2 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/adafe923-20c4-4d81-9140-516cfb766d66" status: 200 len: 1391 microversion: 2.1 time: 0.160545 Oct 27 04:47:03.470343 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3892/8082] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:47:03 2022] GET /compute/v2.1/servers/adafe923-20c4-4d81-9140-516cfb766d66 => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:47:04.492534 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-30872263-109a-44c4-a8df-89ee22bb215f tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:47:04.493184 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-30872263-109a-44c4-a8df-89ee22bb215f tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: adafe923-20c4-4d81-9140-516cfb766d66] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:47:04.500175 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-30872263-109a-44c4-a8df-89ee22bb215f tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:47:04.500686 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-30872263-109a-44c4-a8df-89ee22bb215f tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:47:04.501151 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-30872263-109a-44c4-a8df-89ee22bb215f tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:47:04.501873 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-30872263-109a-44c4-a8df-89ee22bb215f tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:47:04.502397 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-30872263-109a-44c4-a8df-89ee22bb215f tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:47:04.502870 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-30872263-109a-44c4-a8df-89ee22bb215f tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:47:04.633541 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-30872263-109a-44c4-a8df-89ee22bb215f tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:47:04.645236 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-30872263-109a-44c4-a8df-89ee22bb215f tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/adafe923-20c4-4d81-9140-516cfb766d66" status: 200 len: 1564 microversion: 2.1 time: 0.156654 Oct 27 04:47:04.645815 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4191/8083] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:47:04 2022] GET /compute/v2.1/servers/adafe923-20c4-4d81-9140-516cfb766d66 => generated 1564 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:47:04.667970 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b0cb0f13-657f-45a2-99b4-f7480addc315 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:47:04.669235 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b0cb0f13-657f-45a2-99b4-f7480addc315 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: adafe923-20c4-4d81-9140-516cfb766d66] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:47:04.675975 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b0cb0f13-657f-45a2-99b4-f7480addc315 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:47:04.676465 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b0cb0f13-657f-45a2-99b4-f7480addc315 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:47:04.676910 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b0cb0f13-657f-45a2-99b4-f7480addc315 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:47:04.677643 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b0cb0f13-657f-45a2-99b4-f7480addc315 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:47:04.678135 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b0cb0f13-657f-45a2-99b4-f7480addc315 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:47:04.678564 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b0cb0f13-657f-45a2-99b4-f7480addc315 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:47:04.813787 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b0cb0f13-657f-45a2-99b4-f7480addc315 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:47:04.821518 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b0cb0f13-657f-45a2-99b4-f7480addc315 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/adafe923-20c4-4d81-9140-516cfb766d66" status: 200 len: 1564 microversion: 2.1 time: 0.157452 Oct 27 04:47:04.822226 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3893/8084] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:47:04 2022] GET /compute/v2.1/servers/adafe923-20c4-4d81-9140-516cfb766d66 => generated 1564 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:47:07.043813 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-abf93896-56b7-4938-a691-4c4608d17440 req-cdda6727-d432-453e-ae12-e5d68b67eebf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "adafe923-20c4-4d81-9140-516cfb766d66", "tag": "578146b5-32b5-4d3c-8e5e-bc37e6ff2c15"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:47:07.048526 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7c9f4162-a5b9-45d5-bd73-2c4c32962e2b tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:47:07.049174 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7c9f4162-a5b9-45d5-bd73-2c4c32962e2b tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: adafe923-20c4-4d81-9140-516cfb766d66] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:47:07.057186 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:47:07.060894 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-abf93896-56b7-4938-a691-4c4608d17440 req-cdda6727-d432-453e-ae12-e5d68b67eebf service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:47:07.061384 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-abf93896-56b7-4938-a691-4c4608d17440 req-cdda6727-d432-453e-ae12-e5d68b67eebf service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:47:07.062660 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-abf93896-56b7-4938-a691-4c4608d17440 req-cdda6727-d432-453e-ae12-e5d68b67eebf service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:47:07.064094 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7c9f4162-a5b9-45d5-bd73-2c4c32962e2b tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:47:07.064526 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7c9f4162-a5b9-45d5-bd73-2c4c32962e2b tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:47:07.064994 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7c9f4162-a5b9-45d5-bd73-2c4c32962e2b tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:47:07.065734 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7c9f4162-a5b9-45d5-bd73-2c4c32962e2b tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:47:07.066260 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7c9f4162-a5b9-45d5-bd73-2c4c32962e2b tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:47:07.066717 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7c9f4162-a5b9-45d5-bd73-2c4c32962e2b tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:47:07.078188 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-abf93896-56b7-4938-a691-4c4608d17440 req-cdda6727-d432-453e-ae12-e5d68b67eebf service nova] Creating event network-changed:578146b5-32b5-4d3c-8e5e-bc37e6ff2c15 for instance adafe923-20c4-4d81-9140-516cfb766d66 on n-h1-862769-1 Oct 27 04:47:07.083931 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-abf93896-56b7-4938-a691-4c4608d17440 req-cdda6727-d432-453e-ae12-e5d68b67eebf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043756 Oct 27 04:47:07.085356 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3894/8085] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:47:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:47:07.312568 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7c9f4162-a5b9-45d5-bd73-2c4c32962e2b tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:47:07.321769 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7c9f4162-a5b9-45d5-bd73-2c4c32962e2b tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/adafe923-20c4-4d81-9140-516cfb766d66" status: 200 len: 1564 microversion: 2.1 time: 0.285552 Oct 27 04:47:07.322737 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4192/8086] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:47:07 2022] GET /compute/v2.1/servers/adafe923-20c4-4d81-9140-516cfb766d66 => generated 1564 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:47:28.584269 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=9 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:47:28.585012 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=36 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:47:28.589236 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6b90b64a-a0dd-4c47-8a57-316d054239ab tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:47:28.591520 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6b90b64a-a0dd-4c47-8a57-316d054239ab tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: adafe923-20c4-4d81-9140-516cfb766d66] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:47:28.597501 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6b90b64a-a0dd-4c47-8a57-316d054239ab tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:47:28.600270 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6b90b64a-a0dd-4c47-8a57-316d054239ab tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:47:28.600270 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6b90b64a-a0dd-4c47-8a57-316d054239ab tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:47:28.600270 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6b90b64a-a0dd-4c47-8a57-316d054239ab tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:47:28.600270 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6b90b64a-a0dd-4c47-8a57-316d054239ab tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:47:28.600270 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6b90b64a-a0dd-4c47-8a57-316d054239ab tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:47:28.652157 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6b90b64a-a0dd-4c47-8a57-316d054239ab tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "POST /compute/v2.1/servers/adafe923-20c4-4d81-9140-516cfb766d66/action" status: 200 len: 24514 microversion: 2.1 time: 0.069911 Oct 27 04:47:28.652799 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3895/8087] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 04:47:28 2022] POST /compute/v2.1/servers/adafe923-20c4-4d81-9140-516cfb766d66/action => generated 24514 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 04:47:39.612382 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-73e7ea57-ecb9-4af4-b991-59c87b3ebf29 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:47:39.615133 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=50 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:47:39.620194 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-73e7ea57-ecb9-4af4-b991-59c87b3ebf29 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:47:39.620703 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-73e7ea57-ecb9-4af4-b991-59c87b3ebf29 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:47:39.621162 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-73e7ea57-ecb9-4af4-b991-59c87b3ebf29 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:47:39.643186 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-73e7ea57-ecb9-4af4-b991-59c87b3ebf29 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: adafe923-20c4-4d81-9140-516cfb766d66] Going to try to stop instance {{(pid=121001) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 27 04:47:39.766754 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-73e7ea57-ecb9-4af4-b991-59c87b3ebf29 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "POST /compute/v2.1/servers/adafe923-20c4-4d81-9140-516cfb766d66/action" status: 202 len: 0 microversion: 2.1 time: 0.158844 Oct 27 04:47:39.767401 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4193/8088] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 04:47:39 2022] POST /compute/v2.1/servers/adafe923-20c4-4d81-9140-516cfb766d66/action => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 04:47:39.776203 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f0b11e30-4710-4d24-9f20-a90bfc9e33e9 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:47:39.776914 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f0b11e30-4710-4d24-9f20-a90bfc9e33e9 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: adafe923-20c4-4d81-9140-516cfb766d66] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:47:39.779837 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:47:39.781122 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=4 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:47:39.786683 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f0b11e30-4710-4d24-9f20-a90bfc9e33e9 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:47:39.787170 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f0b11e30-4710-4d24-9f20-a90bfc9e33e9 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:47:39.787610 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f0b11e30-4710-4d24-9f20-a90bfc9e33e9 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:47:39.788361 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f0b11e30-4710-4d24-9f20-a90bfc9e33e9 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:47:39.788806 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f0b11e30-4710-4d24-9f20-a90bfc9e33e9 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:47:39.789234 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f0b11e30-4710-4d24-9f20-a90bfc9e33e9 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:47:39.924961 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f0b11e30-4710-4d24-9f20-a90bfc9e33e9 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:47:39.932624 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f0b11e30-4710-4d24-9f20-a90bfc9e33e9 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/adafe923-20c4-4d81-9140-516cfb766d66" status: 200 len: 1693 microversion: 2.1 time: 0.160771 Oct 27 04:47:39.933196 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3896/8089] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:47:39 2022] GET /compute/v2.1/servers/adafe923-20c4-4d81-9140-516cfb766d66 => generated 1693 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:47:40.957323 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5f1fa15c-1537-4cde-bea9-8f0815ee8693 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:47:40.958079 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5f1fa15c-1537-4cde-bea9-8f0815ee8693 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: adafe923-20c4-4d81-9140-516cfb766d66] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:47:40.966171 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5f1fa15c-1537-4cde-bea9-8f0815ee8693 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:47:40.966672 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5f1fa15c-1537-4cde-bea9-8f0815ee8693 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:47:40.967131 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5f1fa15c-1537-4cde-bea9-8f0815ee8693 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:47:40.968694 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5f1fa15c-1537-4cde-bea9-8f0815ee8693 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:47:40.969436 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5f1fa15c-1537-4cde-bea9-8f0815ee8693 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:47:40.969892 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5f1fa15c-1537-4cde-bea9-8f0815ee8693 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:47:41.100152 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5f1fa15c-1537-4cde-bea9-8f0815ee8693 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:47:41.107891 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5f1fa15c-1537-4cde-bea9-8f0815ee8693 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/adafe923-20c4-4d81-9140-516cfb766d66" status: 200 len: 1693 microversion: 2.1 time: 0.154907 Oct 27 04:47:41.109323 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4194/8090] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:47:40 2022] GET /compute/v2.1/servers/adafe923-20c4-4d81-9140-516cfb766d66 => generated 1693 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:47:42.132005 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c1bc9ff6-8c87-43ff-a523-fb0a7a199479 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:47:42.132630 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c1bc9ff6-8c87-43ff-a523-fb0a7a199479 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: adafe923-20c4-4d81-9140-516cfb766d66] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:47:42.139402 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c1bc9ff6-8c87-43ff-a523-fb0a7a199479 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:47:42.139896 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c1bc9ff6-8c87-43ff-a523-fb0a7a199479 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:47:42.140342 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c1bc9ff6-8c87-43ff-a523-fb0a7a199479 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:47:42.141045 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c1bc9ff6-8c87-43ff-a523-fb0a7a199479 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:47:42.141509 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c1bc9ff6-8c87-43ff-a523-fb0a7a199479 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:47:42.141955 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c1bc9ff6-8c87-43ff-a523-fb0a7a199479 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:47:42.274485 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c1bc9ff6-8c87-43ff-a523-fb0a7a199479 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:47:42.282308 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c1bc9ff6-8c87-43ff-a523-fb0a7a199479 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/adafe923-20c4-4d81-9140-516cfb766d66" status: 200 len: 1693 microversion: 2.1 time: 0.154188 Oct 27 04:47:42.282905 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3897/8091] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:47:42 2022] GET /compute/v2.1/servers/adafe923-20c4-4d81-9140-516cfb766d66 => generated 1693 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:47:43.306381 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-af6f5dbc-3b9d-4e8c-b4f8-4075ac02c634 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:47:43.307074 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-af6f5dbc-3b9d-4e8c-b4f8-4075ac02c634 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: adafe923-20c4-4d81-9140-516cfb766d66] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:47:43.314446 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-af6f5dbc-3b9d-4e8c-b4f8-4075ac02c634 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:47:43.314956 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-af6f5dbc-3b9d-4e8c-b4f8-4075ac02c634 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:47:43.315450 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-af6f5dbc-3b9d-4e8c-b4f8-4075ac02c634 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:47:43.316187 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-af6f5dbc-3b9d-4e8c-b4f8-4075ac02c634 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:47:43.316668 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-af6f5dbc-3b9d-4e8c-b4f8-4075ac02c634 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:47:43.317120 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-af6f5dbc-3b9d-4e8c-b4f8-4075ac02c634 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:47:43.450714 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-af6f5dbc-3b9d-4e8c-b4f8-4075ac02c634 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:47:43.458583 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-af6f5dbc-3b9d-4e8c-b4f8-4075ac02c634 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/adafe923-20c4-4d81-9140-516cfb766d66" status: 200 len: 1693 microversion: 2.1 time: 0.156196 Oct 27 04:47:43.463542 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4195/8092] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:47:43 2022] GET /compute/v2.1/servers/adafe923-20c4-4d81-9140-516cfb766d66 => generated 1693 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:47:44.482056 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4433c58f-08ad-4f23-a6e0-fe69b7923554 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:47:44.482676 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4433c58f-08ad-4f23-a6e0-fe69b7923554 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: adafe923-20c4-4d81-9140-516cfb766d66] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:47:44.490170 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4433c58f-08ad-4f23-a6e0-fe69b7923554 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:47:44.490658 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4433c58f-08ad-4f23-a6e0-fe69b7923554 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:47:44.491097 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4433c58f-08ad-4f23-a6e0-fe69b7923554 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:47:44.491792 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4433c58f-08ad-4f23-a6e0-fe69b7923554 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:47:44.492255 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4433c58f-08ad-4f23-a6e0-fe69b7923554 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:47:44.492684 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4433c58f-08ad-4f23-a6e0-fe69b7923554 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:47:44.624788 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4433c58f-08ad-4f23-a6e0-fe69b7923554 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:47:44.632529 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4433c58f-08ad-4f23-a6e0-fe69b7923554 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/adafe923-20c4-4d81-9140-516cfb766d66" status: 200 len: 1693 microversion: 2.1 time: 0.154391 Oct 27 04:47:44.633112 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3898/8093] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:47:44 2022] GET /compute/v2.1/servers/adafe923-20c4-4d81-9140-516cfb766d66 => generated 1693 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:47:45.656117 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f7cb7c64-fece-4773-8530-a5bf043d7add tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:47:45.656807 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f7cb7c64-fece-4773-8530-a5bf043d7add tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: adafe923-20c4-4d81-9140-516cfb766d66] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:47:45.663791 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f7cb7c64-fece-4773-8530-a5bf043d7add tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:47:45.664294 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f7cb7c64-fece-4773-8530-a5bf043d7add tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:47:45.664755 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f7cb7c64-fece-4773-8530-a5bf043d7add tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:47:45.665463 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f7cb7c64-fece-4773-8530-a5bf043d7add tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:47:45.665934 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f7cb7c64-fece-4773-8530-a5bf043d7add tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:47:45.666403 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f7cb7c64-fece-4773-8530-a5bf043d7add tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:47:45.794283 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f7cb7c64-fece-4773-8530-a5bf043d7add tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:47:45.802529 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f7cb7c64-fece-4773-8530-a5bf043d7add tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/adafe923-20c4-4d81-9140-516cfb766d66" status: 200 len: 1693 microversion: 2.1 time: 0.150430 Oct 27 04:47:45.803112 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4196/8094] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:47:45 2022] GET /compute/v2.1/servers/adafe923-20c4-4d81-9140-516cfb766d66 => generated 1693 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:47:46.827635 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d18c7701-b219-4d4d-9ff3-4dca6f0cde89 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:47:46.828248 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d18c7701-b219-4d4d-9ff3-4dca6f0cde89 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: adafe923-20c4-4d81-9140-516cfb766d66] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:47:46.835093 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d18c7701-b219-4d4d-9ff3-4dca6f0cde89 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:47:46.842237 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d18c7701-b219-4d4d-9ff3-4dca6f0cde89 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:47:46.842237 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d18c7701-b219-4d4d-9ff3-4dca6f0cde89 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:47:46.842237 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d18c7701-b219-4d4d-9ff3-4dca6f0cde89 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:47:46.842237 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d18c7701-b219-4d4d-9ff3-4dca6f0cde89 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:47:46.842237 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d18c7701-b219-4d4d-9ff3-4dca6f0cde89 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:47:46.968654 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d18c7701-b219-4d4d-9ff3-4dca6f0cde89 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:47:46.976295 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d18c7701-b219-4d4d-9ff3-4dca6f0cde89 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/adafe923-20c4-4d81-9140-516cfb766d66" status: 200 len: 1693 microversion: 2.1 time: 0.153303 Oct 27 04:47:46.976892 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3899/8095] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:47:46 2022] GET /compute/v2.1/servers/adafe923-20c4-4d81-9140-516cfb766d66 => generated 1693 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:47:48.000965 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-14b616ed-75dc-47ba-83f0-2f872fca3b3d tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:47:48.001610 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-14b616ed-75dc-47ba-83f0-2f872fca3b3d tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: adafe923-20c4-4d81-9140-516cfb766d66] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:47:48.008884 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-14b616ed-75dc-47ba-83f0-2f872fca3b3d tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:47:48.009395 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-14b616ed-75dc-47ba-83f0-2f872fca3b3d tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:47:48.009891 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-14b616ed-75dc-47ba-83f0-2f872fca3b3d tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:47:48.010677 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-14b616ed-75dc-47ba-83f0-2f872fca3b3d tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:47:48.011191 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-14b616ed-75dc-47ba-83f0-2f872fca3b3d tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:47:48.011641 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-14b616ed-75dc-47ba-83f0-2f872fca3b3d tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:47:48.139951 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-14b616ed-75dc-47ba-83f0-2f872fca3b3d tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:47:48.147698 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-14b616ed-75dc-47ba-83f0-2f872fca3b3d tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/adafe923-20c4-4d81-9140-516cfb766d66" status: 200 len: 1693 microversion: 2.1 time: 0.151301 Oct 27 04:47:48.148275 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4197/8096] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:47:47 2022] GET /compute/v2.1/servers/adafe923-20c4-4d81-9140-516cfb766d66 => generated 1693 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:47:49.171066 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ca4b8b5f-b075-43d7-874a-9da45f1cd882 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:47:49.171689 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ca4b8b5f-b075-43d7-874a-9da45f1cd882 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: adafe923-20c4-4d81-9140-516cfb766d66] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:47:49.178545 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ca4b8b5f-b075-43d7-874a-9da45f1cd882 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:47:49.179038 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ca4b8b5f-b075-43d7-874a-9da45f1cd882 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:47:49.179484 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ca4b8b5f-b075-43d7-874a-9da45f1cd882 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:47:49.180196 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ca4b8b5f-b075-43d7-874a-9da45f1cd882 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:47:49.180655 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ca4b8b5f-b075-43d7-874a-9da45f1cd882 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:47:49.181095 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ca4b8b5f-b075-43d7-874a-9da45f1cd882 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:47:49.311599 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ca4b8b5f-b075-43d7-874a-9da45f1cd882 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:47:49.319298 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ca4b8b5f-b075-43d7-874a-9da45f1cd882 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/adafe923-20c4-4d81-9140-516cfb766d66" status: 200 len: 1693 microversion: 2.1 time: 0.152195 Oct 27 04:47:49.319875 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3900/8097] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:47:49 2022] GET /compute/v2.1/servers/adafe923-20c4-4d81-9140-516cfb766d66 => generated 1693 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:47:50.344464 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a1570c1e-cacd-402d-9eca-da4002caa445 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:47:50.345139 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a1570c1e-cacd-402d-9eca-da4002caa445 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: adafe923-20c4-4d81-9140-516cfb766d66] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:47:50.352165 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a1570c1e-cacd-402d-9eca-da4002caa445 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:47:50.353202 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a1570c1e-cacd-402d-9eca-da4002caa445 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:47:50.353202 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a1570c1e-cacd-402d-9eca-da4002caa445 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:47:50.353816 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a1570c1e-cacd-402d-9eca-da4002caa445 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:47:50.354329 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a1570c1e-cacd-402d-9eca-da4002caa445 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:47:50.354789 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a1570c1e-cacd-402d-9eca-da4002caa445 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:47:50.498478 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a1570c1e-cacd-402d-9eca-da4002caa445 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:47:50.507219 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a1570c1e-cacd-402d-9eca-da4002caa445 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/adafe923-20c4-4d81-9140-516cfb766d66" status: 200 len: 1670 microversion: 2.1 time: 0.166670 Oct 27 04:47:50.507812 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4198/8098] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:47:50 2022] GET /compute/v2.1/servers/adafe923-20c4-4d81-9140-516cfb766d66 => generated 1670 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:47:51.598293 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a966aab9-64b8-4469-9942-0e6ccb5942f8 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:47:51.600566 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a966aab9-64b8-4469-9942-0e6ccb5942f8 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: adafe923-20c4-4d81-9140-516cfb766d66] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:47:51.607419 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a966aab9-64b8-4469-9942-0e6ccb5942f8 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:47:51.607936 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a966aab9-64b8-4469-9942-0e6ccb5942f8 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:47:51.608379 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a966aab9-64b8-4469-9942-0e6ccb5942f8 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:47:51.609333 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a966aab9-64b8-4469-9942-0e6ccb5942f8 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:47:51.609786 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a966aab9-64b8-4469-9942-0e6ccb5942f8 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:47:51.610243 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a966aab9-64b8-4469-9942-0e6ccb5942f8 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:47:51.672280 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a966aab9-64b8-4469-9942-0e6ccb5942f8 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "POST /compute/v2.1/servers/adafe923-20c4-4d81-9140-516cfb766d66/action" status: 200 len: 38097 microversion: 2.1 time: 0.077733 Oct 27 04:47:51.673263 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3901/8099] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 04:47:51 2022] POST /compute/v2.1/servers/adafe923-20c4-4d81-9140-516cfb766d66/action => generated 38097 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 04:47:51.684810 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-aa4d73df-842c-45d6-b3d9-6469fbf9a1b2 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:47:51.692336 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aa4d73df-842c-45d6-b3d9-6469fbf9a1b2 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:47:51.692837 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aa4d73df-842c-45d6-b3d9-6469fbf9a1b2 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:47:51.693297 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-aa4d73df-842c-45d6-b3d9-6469fbf9a1b2 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:47:51.714967 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-aa4d73df-842c-45d6-b3d9-6469fbf9a1b2 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: adafe923-20c4-4d81-9140-516cfb766d66] Going to try to start instance {{(pid=121001) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 27 04:47:51.868255 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-aa4d73df-842c-45d6-b3d9-6469fbf9a1b2 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "POST /compute/v2.1/servers/adafe923-20c4-4d81-9140-516cfb766d66/action" status: 202 len: 0 microversion: 2.1 time: 0.187107 Oct 27 04:47:51.868808 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4199/8100] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 04:47:51 2022] POST /compute/v2.1/servers/adafe923-20c4-4d81-9140-516cfb766d66/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 04:47:51.878227 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-943e54c9-e73e-4133-8e9c-db4267980e9a tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:47:51.879067 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-943e54c9-e73e-4133-8e9c-db4267980e9a tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: adafe923-20c4-4d81-9140-516cfb766d66] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:47:51.886267 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-943e54c9-e73e-4133-8e9c-db4267980e9a tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:47:51.886763 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-943e54c9-e73e-4133-8e9c-db4267980e9a tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:47:51.887206 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-943e54c9-e73e-4133-8e9c-db4267980e9a tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:47:51.887914 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-943e54c9-e73e-4133-8e9c-db4267980e9a tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:47:51.888390 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-943e54c9-e73e-4133-8e9c-db4267980e9a tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:47:51.888801 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-943e54c9-e73e-4133-8e9c-db4267980e9a tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:47:52.026833 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-943e54c9-e73e-4133-8e9c-db4267980e9a tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:47:52.034798 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-943e54c9-e73e-4133-8e9c-db4267980e9a tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/adafe923-20c4-4d81-9140-516cfb766d66" status: 200 len: 1679 microversion: 2.1 time: 0.161386 Oct 27 04:47:52.035379 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3902/8101] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:47:51 2022] GET /compute/v2.1/servers/adafe923-20c4-4d81-9140-516cfb766d66 => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:47:53.060248 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-72b69002-5c3a-48aa-b683-8e9a0918a972 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:47:53.061484 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-72b69002-5c3a-48aa-b683-8e9a0918a972 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: adafe923-20c4-4d81-9140-516cfb766d66] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:47:53.067688 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-72b69002-5c3a-48aa-b683-8e9a0918a972 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:47:53.068195 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-72b69002-5c3a-48aa-b683-8e9a0918a972 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:47:53.068771 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-72b69002-5c3a-48aa-b683-8e9a0918a972 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:47:53.069494 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-72b69002-5c3a-48aa-b683-8e9a0918a972 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:47:53.070066 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-72b69002-5c3a-48aa-b683-8e9a0918a972 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:47:53.070525 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-72b69002-5c3a-48aa-b683-8e9a0918a972 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:47:53.208457 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-72b69002-5c3a-48aa-b683-8e9a0918a972 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:47:53.216427 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-72b69002-5c3a-48aa-b683-8e9a0918a972 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/adafe923-20c4-4d81-9140-516cfb766d66" status: 200 len: 1679 microversion: 2.1 time: 0.161281 Oct 27 04:47:53.217006 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4200/8102] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:47:53 2022] GET /compute/v2.1/servers/adafe923-20c4-4d81-9140-516cfb766d66 => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:47:54.240101 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7c9333f2-1c5e-43e4-b21a-5e6d643af1fc tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:47:54.240727 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7c9333f2-1c5e-43e4-b21a-5e6d643af1fc tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: adafe923-20c4-4d81-9140-516cfb766d66] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:47:54.248380 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7c9333f2-1c5e-43e4-b21a-5e6d643af1fc tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:47:54.248875 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7c9333f2-1c5e-43e4-b21a-5e6d643af1fc tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:47:54.249322 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7c9333f2-1c5e-43e4-b21a-5e6d643af1fc tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:47:54.250027 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7c9333f2-1c5e-43e4-b21a-5e6d643af1fc tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:47:54.250511 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7c9333f2-1c5e-43e4-b21a-5e6d643af1fc tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:47:54.250946 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7c9333f2-1c5e-43e4-b21a-5e6d643af1fc tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:47:54.382942 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7c9333f2-1c5e-43e4-b21a-5e6d643af1fc tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:47:54.391370 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7c9333f2-1c5e-43e4-b21a-5e6d643af1fc tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/adafe923-20c4-4d81-9140-516cfb766d66" status: 200 len: 1683 microversion: 2.1 time: 0.155177 Oct 27 04:47:54.391960 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3903/8103] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:47:54 2022] GET /compute/v2.1/servers/adafe923-20c4-4d81-9140-516cfb766d66 => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:48:18.587259 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-59394e38-5052-4eb0-8047-f3b774de35c8 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:48:18.589585 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-59394e38-5052-4eb0-8047-f3b774de35c8 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: adafe923-20c4-4d81-9140-516cfb766d66] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:48:18.591940 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=17 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:48:18.592755 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:48:18.598573 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-59394e38-5052-4eb0-8047-f3b774de35c8 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:48:18.605062 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-59394e38-5052-4eb0-8047-f3b774de35c8 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:48:18.605062 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-59394e38-5052-4eb0-8047-f3b774de35c8 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:48:18.605062 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-59394e38-5052-4eb0-8047-f3b774de35c8 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:48:18.605062 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-59394e38-5052-4eb0-8047-f3b774de35c8 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:48:18.605062 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-59394e38-5052-4eb0-8047-f3b774de35c8 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:48:18.655643 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-59394e38-5052-4eb0-8047-f3b774de35c8 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "POST /compute/v2.1/servers/adafe923-20c4-4d81-9140-516cfb766d66/action" status: 200 len: 62650 microversion: 2.1 time: 0.072345 Oct 27 04:48:18.656315 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4201/8104] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 04:48:18 2022] POST /compute/v2.1/servers/adafe923-20c4-4d81-9140-516cfb766d66/action => generated 62650 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 04:48:25.903690 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5d79f548-f16a-4348-8674-ff8aac56e859 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:48:25.904811 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5d79f548-f16a-4348-8674-ff8aac56e859 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: adafe923-20c4-4d81-9140-516cfb766d66] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:48:25.907634 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-7ff58f44-0fe5-43d2-8913-375b1d3cd72e req-647d16f5-d8de-44b3-9164-0be398738987 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "adafe923-20c4-4d81-9140-516cfb766d66", "tag": "578146b5-32b5-4d3c-8e5e-bc37e6ff2c15"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:48:25.908901 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=16 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:48:25.909626 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=46 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:48:25.914924 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5d79f548-f16a-4348-8674-ff8aac56e859 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:48:25.915719 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5d79f548-f16a-4348-8674-ff8aac56e859 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:48:25.916363 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5d79f548-f16a-4348-8674-ff8aac56e859 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:48:25.917077 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5d79f548-f16a-4348-8674-ff8aac56e859 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:48:25.917808 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5d79f548-f16a-4348-8674-ff8aac56e859 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:48:25.918487 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5d79f548-f16a-4348-8674-ff8aac56e859 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:48:25.920289 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-7ff58f44-0fe5-43d2-8913-375b1d3cd72e req-647d16f5-d8de-44b3-9164-0be398738987 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:48:25.924427 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-7ff58f44-0fe5-43d2-8913-375b1d3cd72e req-647d16f5-d8de-44b3-9164-0be398738987 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:48:25.924427 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-7ff58f44-0fe5-43d2-8913-375b1d3cd72e req-647d16f5-d8de-44b3-9164-0be398738987 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:48:25.934085 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-7ff58f44-0fe5-43d2-8913-375b1d3cd72e req-647d16f5-d8de-44b3-9164-0be398738987 service nova] Creating event network-changed:578146b5-32b5-4d3c-8e5e-bc37e6ff2c15 for instance adafe923-20c4-4d81-9140-516cfb766d66 on n-h1-862769-1 Oct 27 04:48:25.940464 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-7ff58f44-0fe5-43d2-8913-375b1d3cd72e req-647d16f5-d8de-44b3-9164-0be398738987 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038311 Oct 27 04:48:25.941312 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4202/8105] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:48:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:48:25.947948 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5d79f548-f16a-4348-8674-ff8aac56e859 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: adafe923-20c4-4d81-9140-516cfb766d66] Going to try to terminate instance {{(pid=121000) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 04:48:26.265179 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5d79f548-f16a-4348-8674-ff8aac56e859 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "DELETE /compute/v2.1/servers/adafe923-20c4-4d81-9140-516cfb766d66" status: 204 len: 0 microversion: 2.1 time: 0.365072 Oct 27 04:48:26.265735 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3904/8106] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 04:48:25 2022] DELETE /compute/v2.1/servers/adafe923-20c4-4d81-9140-516cfb766d66 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 04:48:26.275640 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7f223c03-5faa-410d-ae85-4a10691845b8 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:48:26.276369 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7f223c03-5faa-410d-ae85-4a10691845b8 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: adafe923-20c4-4d81-9140-516cfb766d66] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:48:26.283150 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7f223c03-5faa-410d-ae85-4a10691845b8 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:48:26.283659 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7f223c03-5faa-410d-ae85-4a10691845b8 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:48:26.284126 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7f223c03-5faa-410d-ae85-4a10691845b8 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:48:26.284856 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7f223c03-5faa-410d-ae85-4a10691845b8 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:48:26.285342 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7f223c03-5faa-410d-ae85-4a10691845b8 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:48:26.285799 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7f223c03-5faa-410d-ae85-4a10691845b8 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:48:26.420107 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7f223c03-5faa-410d-ae85-4a10691845b8 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:48:26.428759 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7f223c03-5faa-410d-ae85-4a10691845b8 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/adafe923-20c4-4d81-9140-516cfb766d66" status: 200 len: 1689 microversion: 2.1 time: 0.158346 Oct 27 04:48:26.429434 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4203/8107] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:48:26 2022] GET /compute/v2.1/servers/adafe923-20c4-4d81-9140-516cfb766d66 => generated 1689 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:48:27.456330 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-29c4b5e6-9132-4687-93d8-6074a84caabd tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:48:27.457040 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-29c4b5e6-9132-4687-93d8-6074a84caabd tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: adafe923-20c4-4d81-9140-516cfb766d66] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:48:27.463725 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-29c4b5e6-9132-4687-93d8-6074a84caabd tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:48:27.464208 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-29c4b5e6-9132-4687-93d8-6074a84caabd tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:48:27.464646 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-29c4b5e6-9132-4687-93d8-6074a84caabd tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:48:27.465337 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-29c4b5e6-9132-4687-93d8-6074a84caabd tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:48:27.465795 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-29c4b5e6-9132-4687-93d8-6074a84caabd tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:48:27.466254 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-29c4b5e6-9132-4687-93d8-6074a84caabd tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:48:27.600930 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-29c4b5e6-9132-4687-93d8-6074a84caabd tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:48:27.608635 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-29c4b5e6-9132-4687-93d8-6074a84caabd tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/adafe923-20c4-4d81-9140-516cfb766d66" status: 200 len: 1689 microversion: 2.1 time: 0.157250 Oct 27 04:48:27.609461 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3905/8108] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:48:27 2022] GET /compute/v2.1/servers/adafe923-20c4-4d81-9140-516cfb766d66 => generated 1689 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:48:28.490005 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-6993b79e-21b8-4451-b7a0-43b04efc83c6 req-cedf8bca-14cb-4311-a0c1-0ebe104721d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adafe923-20c4-4d81-9140-516cfb766d66", "name": "network-vif-deleted", "tag": "578146b5-32b5-4d3c-8e5e-bc37e6ff2c15"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:48:28.500700 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-6993b79e-21b8-4451-b7a0-43b04efc83c6 req-cedf8bca-14cb-4311-a0c1-0ebe104721d2 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:48:28.500853 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-6993b79e-21b8-4451-b7a0-43b04efc83c6 req-cedf8bca-14cb-4311-a0c1-0ebe104721d2 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:48:28.501194 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-6993b79e-21b8-4451-b7a0-43b04efc83c6 req-cedf8bca-14cb-4311-a0c1-0ebe104721d2 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:48:28.512150 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-6993b79e-21b8-4451-b7a0-43b04efc83c6 req-cedf8bca-14cb-4311-a0c1-0ebe104721d2 service nova] Creating event network-vif-deleted:578146b5-32b5-4d3c-8e5e-bc37e6ff2c15 for instance adafe923-20c4-4d81-9140-516cfb766d66 on n-h1-862769-1 Oct 27 04:48:28.517743 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-6993b79e-21b8-4451-b7a0-43b04efc83c6 req-cedf8bca-14cb-4311-a0c1-0ebe104721d2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031702 Oct 27 04:48:28.523472 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4204/8109] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:48:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 04:48:28.633126 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c04afbd1-cd63-4073-afd0-e0f502ee4b55 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:48:28.633732 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c04afbd1-cd63-4073-afd0-e0f502ee4b55 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: adafe923-20c4-4d81-9140-516cfb766d66] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:48:28.639754 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c04afbd1-cd63-4073-afd0-e0f502ee4b55 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:48:28.640197 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c04afbd1-cd63-4073-afd0-e0f502ee4b55 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:48:28.640628 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c04afbd1-cd63-4073-afd0-e0f502ee4b55 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:48:28.641828 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c04afbd1-cd63-4073-afd0-e0f502ee4b55 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:48:28.642325 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c04afbd1-cd63-4073-afd0-e0f502ee4b55 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:48:28.642757 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c04afbd1-cd63-4073-afd0-e0f502ee4b55 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:48:28.705114 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c04afbd1-cd63-4073-afd0-e0f502ee4b55 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:48:28.713963 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c04afbd1-cd63-4073-afd0-e0f502ee4b55 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/adafe923-20c4-4d81-9140-516cfb766d66" status: 200 len: 1350 microversion: 2.1 time: 0.084707 Oct 27 04:48:28.715043 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3906/8110] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:48:28 2022] GET /compute/v2.1/servers/adafe923-20c4-4d81-9140-516cfb766d66 => generated 1350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:48:29.739715 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e26234d1-09d7-4b6e-a2d5-ebf2f575cd6e tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:48:29.740442 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e26234d1-09d7-4b6e-a2d5-ebf2f575cd6e tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: adafe923-20c4-4d81-9140-516cfb766d66] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:48:29.746640 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e26234d1-09d7-4b6e-a2d5-ebf2f575cd6e tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:48:29.747145 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e26234d1-09d7-4b6e-a2d5-ebf2f575cd6e tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:48:29.747606 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e26234d1-09d7-4b6e-a2d5-ebf2f575cd6e tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:48:29.748321 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e26234d1-09d7-4b6e-a2d5-ebf2f575cd6e tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:48:29.748799 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e26234d1-09d7-4b6e-a2d5-ebf2f575cd6e tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:48:29.749249 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e26234d1-09d7-4b6e-a2d5-ebf2f575cd6e tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:48:29.763112 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-e26234d1-09d7-4b6e-a2d5-ebf2f575cd6e tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] HTTP exception thrown: Instance adafe923-20c4-4d81-9140-516cfb766d66 could not be found. Oct 27 04:48:29.764771 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e26234d1-09d7-4b6e-a2d5-ebf2f575cd6e tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Request method failure captured: Oct 27 04:48:29.764771 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/adafe923-20c4-4d81-9140-516cfb766d66 HTTP/1.1 Oct 27 04:48:29.764771 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 04:48:29.764771 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 04:48:29.764771 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 04:48:29.764771 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 04:48:29.764771 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 04:48:29.764771 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 04:48:29.764771 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 04:48:29.764771 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 04:48:29.764771 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWgwK8Ydq2cZdl_qrXrzRt_-NHDs7Lbtyx3d1dP6RHEGcXjkmaGVWHwtmDAl_U5lub8Vu3EmSakuDoQfbZk0S8adwgJ-moO1z1C17My_hnWBVYQWYzYJdyvYOBGBq4h4dKTwzNOCKugh1J2CSdPdxb32D5VZEm2rfYKUP1FoiK7m3nt8 Oct 27 04:48:29.764771 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 04:48:29.764771 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 04:48:29.764771 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 04:48:29.764771 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 04:48:29.764771 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 04:48:29.764771 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 04:48:29.764771 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 67648db046c54ee3b314904c8338cd61 Oct 27 04:48:29.764771 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-952256618 Oct 27 04:48:29.764771 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 04:48:29.764771 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 04:48:29.764771 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/67648db046c54ee3b314904c8338cd61"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/67648db046c54ee3b314904c8338cd61"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/67648db046c54ee3b314904c8338cd61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_67648db046c54ee3b314904c8338cd61"}]}] Oct 27 04:48:29.764771 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-TestNetworkAdvancedServerOps-952256618 Oct 27 04:48:29.764771 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 67648db046c54ee3b314904c8338cd61 Oct 27 04:48:29.764771 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-952256618 Oct 27 04:48:29.764771 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-TestNetworkAdvancedServerOps-952256618-project Oct 27 04:48:29.764771 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 04:48:29.764771 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 04:48:29.764771 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 91e2c2dd9af848e5941d979683201c70 Oct 27 04:48:29.764771 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-TestNetworkAdvancedServerOps-952256618-project Oct 27 04:48:29.764771 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 04:48:29.764771 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance adafe923-20c4-4d81-9140-516cfb766d66 could not be found. Oct 27 04:48:29.764771 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': 'adafe923-20c4-4d81-9140-516cfb766d66'} Oct 27 04:48:29.764771 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 04:48:29.764771 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:48:29.764771 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 04:48:29.764771 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 04:48:29.764771 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 04:48:29.764771 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 04:48:29.764771 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 04:48:29.764771 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 04:48:29.764771 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 04:48:29.764771 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 04:48:29.764771 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance adafe923-20c4-4d81-9140-516cfb766d66 could not be found. Oct 27 04:48:29.764771 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:48:29.764771 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:48:29.764771 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:48:29.764771 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:48:29.764771 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:48:29.764771 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:48:29.764771 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 04:48:29.764771 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 04:48:29.764771 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 04:48:29.764771 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 04:48:29.764771 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 04:48:29.764771 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 04:48:29.764771 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 04:48:29.764771 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 04:48:29.764771 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 04:48:29.764771 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 04:48:29.764771 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance adafe923-20c4-4d81-9140-516cfb766d66 could not be found. Oct 27 04:48:29.764771 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:48:29.764771 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:48:29.771590 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:48:29.771590 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:48:29.771590 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:48:29.771590 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:48:29.771590 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 04:48:29.771590 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 04:48:29.771590 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance adafe923-20c4-4d81-9140-516cfb766d66 could not be found. Oct 27 04:48:29.771590 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:48:29.771590 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e26234d1-09d7-4b6e-a2d5-ebf2f575cd6e tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Returning 404 to user: Instance adafe923-20c4-4d81-9140-516cfb766d66 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 04:48:29.771590 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e26234d1-09d7-4b6e-a2d5-ebf2f575cd6e tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/adafe923-20c4-4d81-9140-516cfb766d66" status: 404 len: 111 microversion: 2.1 time: 0.032096 Oct 27 04:48:29.771590 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4205/8111] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:48:29 2022] GET /compute/v2.1/servers/adafe923-20c4-4d81-9140-516cfb766d66 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 04:48:33.529773 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e408ee8a-d48f-4fa3-a84f-6f307aec76d0 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '.version_select at 0x7f7dd9e3f4c0>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:48:33.605449 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e408ee8a-d48f-4fa3-a84f-6f307aec76d0 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-834811729" status: 202 len: 0 microversion: 2.1 time: 0.079609 Oct 27 04:48:33.606074 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3907/8112] 10.222.0.20 () {58 vars in 1281 bytes} [Thu Oct 27 04:48:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-834811729 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 04:48:33.638801 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3af4b742-9d17-4342-9e7d-e67386fba8b6 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Action: 'create', calling method: .version_select at 0x7f7dd9ce2b80>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-355817801", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMwa598FACL4er65zXdR8PXt0O5fdidnbibUfPczUNhoBOL5ZjtXXlLa85pL0VARPGXeOeDye0/bgydxyIl92rw1AM+CwMvt2iPYBOyN7BX0TZPDPjE/Nsx0pKmT9XIb2A=="}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:48:33.655853 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-3af4b742-9d17-4342-9e7d-e67386fba8b6 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Getting quotas for project 67648db046c54ee3b314904c8338cd61. Resources: {'key_pairs'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 04:48:33.661097 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-3af4b742-9d17-4342-9e7d-e67386fba8b6 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Getting quotas for user 91e2c2dd9af848e5941d979683201c70 and project 67648db046c54ee3b314904c8338cd61. Resources: {'key_pairs'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 04:48:33.768829 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3af4b742-9d17-4342-9e7d-e67386fba8b6 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.134015 Oct 27 04:48:33.769433 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4206/8113] 10.222.0.20 () {60 vars in 1159 bytes} [Thu Oct 27 04:48:33 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:48:41.960835 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:48:41.964998 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-dfcd98ef-aae1-402c-a043-4b54d93f51e7 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-710876837", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "networks": [{"uuid": "d71cdbc4-496f-4f4c-aae7-839fbb782f91"}], "key_name": "tempest-TestNetworkAdvancedServerOps-355817801", "security_groups": [{"name": "tempest-secgroup-smoke-1678041111"}]}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:48:42.088093 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-dfcd98ef-aae1-402c-a043-4b54d93f51e7 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] validate_networks() for [('d71cdbc4-496f-4f4c-aae7-839fbb782f91', None, None, None, None, None)] {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 04:48:42.861607 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-dfcd98ef-aae1-402c-a043-4b54d93f51e7 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 04:48:42.862065 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-dfcd98ef-aae1-402c-a043-4b54d93f51e7 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 04:48:42.862580 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-dfcd98ef-aae1-402c-a043-4b54d93f51e7 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 04:48:42.863000 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-dfcd98ef-aae1-402c-a043-4b54d93f51e7 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 04:48:42.863423 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-dfcd98ef-aae1-402c-a043-4b54d93f51e7 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 04:48:42.872646 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dfcd98ef-aae1-402c-a043-4b54d93f51e7 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:48:42.872985 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dfcd98ef-aae1-402c-a043-4b54d93f51e7 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:48:42.873753 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dfcd98ef-aae1-402c-a043-4b54d93f51e7 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:48:42.874726 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dfcd98ef-aae1-402c-a043-4b54d93f51e7 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:48:42.875644 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dfcd98ef-aae1-402c-a043-4b54d93f51e7 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:48:42.875987 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dfcd98ef-aae1-402c-a043-4b54d93f51e7 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:48:42.896111 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-dfcd98ef-aae1-402c-a043-4b54d93f51e7 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Getting quotas for project 67648db046c54ee3b314904c8338cd61. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 04:48:42.902016 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-dfcd98ef-aae1-402c-a043-4b54d93f51e7 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Getting quotas for user 91e2c2dd9af848e5941d979683201c70 and project 67648db046c54ee3b314904c8338cd61. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 04:48:42.915711 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-dfcd98ef-aae1-402c-a043-4b54d93f51e7 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 04:48:42.918251 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-dfcd98ef-aae1-402c-a043-4b54d93f51e7 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: a625a74d-9de3-4914-8c36-58e67471e136] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 04:48:43.079447 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-dfcd98ef-aae1-402c-a043-4b54d93f51e7 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.120421 Oct 27 04:48:43.081109 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3908/8114] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 04:48:41 2022] POST /compute/v2.1/servers => generated 406 bytes in 1123 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 04:48:43.092655 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b4505368-a13b-4394-a144-e4f27e692de4 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:48:43.093588 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b4505368-a13b-4394-a144-e4f27e692de4 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: a625a74d-9de3-4914-8c36-58e67471e136] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:48:43.096938 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=16 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:48:43.176223 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b4505368-a13b-4394-a144-e4f27e692de4 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:48:43.188483 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b4505368-a13b-4394-a144-e4f27e692de4 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/a625a74d-9de3-4914-8c36-58e67471e136" status: 200 len: 1265 microversion: 2.1 time: 0.098911 Oct 27 04:48:43.195745 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4207/8115] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:48:43 2022] GET /compute/v2.1/servers/a625a74d-9de3-4914-8c36-58e67471e136 => generated 1265 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 04:48:44.213864 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7289c343-881c-45eb-b050-20a1c8472ce1 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:48:44.215157 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7289c343-881c-45eb-b050-20a1c8472ce1 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: a625a74d-9de3-4914-8c36-58e67471e136] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:48:44.222983 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7289c343-881c-45eb-b050-20a1c8472ce1 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:48:44.223730 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7289c343-881c-45eb-b050-20a1c8472ce1 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:48:44.224179 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7289c343-881c-45eb-b050-20a1c8472ce1 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:48:44.225746 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7289c343-881c-45eb-b050-20a1c8472ce1 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:48:44.225746 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7289c343-881c-45eb-b050-20a1c8472ce1 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:48:44.225746 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7289c343-881c-45eb-b050-20a1c8472ce1 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:48:44.293572 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7289c343-881c-45eb-b050-20a1c8472ce1 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:48:44.302024 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7289c343-881c-45eb-b050-20a1c8472ce1 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/a625a74d-9de3-4914-8c36-58e67471e136" status: 200 len: 1269 microversion: 2.1 time: 0.093197 Oct 27 04:48:44.302738 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3909/8116] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:48:44 2022] GET /compute/v2.1/servers/a625a74d-9de3-4914-8c36-58e67471e136 => generated 1269 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:48:45.325176 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-fc7dba1b-e6ba-4ae5-a709-a014a71fb8c5 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:48:45.325828 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-fc7dba1b-e6ba-4ae5-a709-a014a71fb8c5 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: a625a74d-9de3-4914-8c36-58e67471e136] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:48:45.336092 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fc7dba1b-e6ba-4ae5-a709-a014a71fb8c5 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:48:45.336605 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fc7dba1b-e6ba-4ae5-a709-a014a71fb8c5 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:48:45.337075 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fc7dba1b-e6ba-4ae5-a709-a014a71fb8c5 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:48:45.337809 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fc7dba1b-e6ba-4ae5-a709-a014a71fb8c5 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:48:45.338404 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fc7dba1b-e6ba-4ae5-a709-a014a71fb8c5 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:48:45.338873 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-fc7dba1b-e6ba-4ae5-a709-a014a71fb8c5 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:48:45.401850 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-fc7dba1b-e6ba-4ae5-a709-a014a71fb8c5 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:48:45.413063 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-fc7dba1b-e6ba-4ae5-a709-a014a71fb8c5 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/a625a74d-9de3-4914-8c36-58e67471e136" status: 200 len: 1335 microversion: 2.1 time: 0.090338 Oct 27 04:48:45.413063 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4208/8117] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:48:45 2022] GET /compute/v2.1/servers/a625a74d-9de3-4914-8c36-58e67471e136 => generated 1335 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:48:46.436044 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-fcec0399-943c-4c48-8142-6a5c05b8fe33 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:48:46.436666 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-fcec0399-943c-4c48-8142-6a5c05b8fe33 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: a625a74d-9de3-4914-8c36-58e67471e136] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:48:46.444468 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fcec0399-943c-4c48-8142-6a5c05b8fe33 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:48:46.445017 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fcec0399-943c-4c48-8142-6a5c05b8fe33 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:48:46.445465 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fcec0399-943c-4c48-8142-6a5c05b8fe33 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:48:46.446237 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fcec0399-943c-4c48-8142-6a5c05b8fe33 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:48:46.446703 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fcec0399-943c-4c48-8142-6a5c05b8fe33 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:48:46.447135 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fcec0399-943c-4c48-8142-6a5c05b8fe33 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:48:46.672640 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-fcec0399-943c-4c48-8142-6a5c05b8fe33 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:48:46.681157 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-fcec0399-943c-4c48-8142-6a5c05b8fe33 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/a625a74d-9de3-4914-8c36-58e67471e136" status: 200 len: 1391 microversion: 2.1 time: 0.249075 Oct 27 04:48:46.681835 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3910/8118] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:48:46 2022] GET /compute/v2.1/servers/a625a74d-9de3-4914-8c36-58e67471e136 => generated 1391 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:48:46.923233 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-b058f9df-cfb0-4477-8d24-aa34436886b3 req-11f18ac0-152d-49c4-82e1-b1399762044d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a625a74d-9de3-4914-8c36-58e67471e136", "tag": "5fcfc02d-24ac-4cf2-82dd-823a9898d30d"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:48:46.934330 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-b058f9df-cfb0-4477-8d24-aa34436886b3 req-11f18ac0-152d-49c4-82e1-b1399762044d service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:48:46.934896 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-b058f9df-cfb0-4477-8d24-aa34436886b3 req-11f18ac0-152d-49c4-82e1-b1399762044d service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:48:46.935487 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-b058f9df-cfb0-4477-8d24-aa34436886b3 req-11f18ac0-152d-49c4-82e1-b1399762044d service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:48:46.946915 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-b058f9df-cfb0-4477-8d24-aa34436886b3 req-11f18ac0-152d-49c4-82e1-b1399762044d service nova] Creating event network-changed:5fcfc02d-24ac-4cf2-82dd-823a9898d30d for instance a625a74d-9de3-4914-8c36-58e67471e136 on n-h2-862769-1 Oct 27 04:48:46.951785 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-b058f9df-cfb0-4477-8d24-aa34436886b3 req-11f18ac0-152d-49c4-82e1-b1399762044d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032270 Oct 27 04:48:46.953023 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4209/8119] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:48:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:48:47.704714 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9ab23b3f-14dd-4803-bfc2-a61c261f1c5b tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:48:47.705333 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9ab23b3f-14dd-4803-bfc2-a61c261f1c5b tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: a625a74d-9de3-4914-8c36-58e67471e136] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:48:47.713074 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9ab23b3f-14dd-4803-bfc2-a61c261f1c5b tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:48:47.713605 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9ab23b3f-14dd-4803-bfc2-a61c261f1c5b tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:48:47.714064 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9ab23b3f-14dd-4803-bfc2-a61c261f1c5b tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:48:47.714761 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9ab23b3f-14dd-4803-bfc2-a61c261f1c5b tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:48:47.715214 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9ab23b3f-14dd-4803-bfc2-a61c261f1c5b tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:48:47.715639 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9ab23b3f-14dd-4803-bfc2-a61c261f1c5b tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:48:47.847082 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9ab23b3f-14dd-4803-bfc2-a61c261f1c5b tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:48:47.854832 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9ab23b3f-14dd-4803-bfc2-a61c261f1c5b tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/a625a74d-9de3-4914-8c36-58e67471e136" status: 200 len: 1391 microversion: 2.1 time: 0.154000 Oct 27 04:48:47.855417 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3911/8120] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:48:47 2022] GET /compute/v2.1/servers/a625a74d-9de3-4914-8c36-58e67471e136 => generated 1391 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:48:48.879418 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-bcb5cad9-59b9-458d-9ea2-ea97174ab788 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:48:48.880153 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-bcb5cad9-59b9-458d-9ea2-ea97174ab788 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: a625a74d-9de3-4914-8c36-58e67471e136] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:48:48.882271 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:48:48.887304 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bcb5cad9-59b9-458d-9ea2-ea97174ab788 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:48:48.887814 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bcb5cad9-59b9-458d-9ea2-ea97174ab788 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:48:48.888285 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bcb5cad9-59b9-458d-9ea2-ea97174ab788 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:48:48.889006 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bcb5cad9-59b9-458d-9ea2-ea97174ab788 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:48:48.889489 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bcb5cad9-59b9-458d-9ea2-ea97174ab788 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:48:48.889942 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bcb5cad9-59b9-458d-9ea2-ea97174ab788 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:48:49.029307 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-bcb5cad9-59b9-458d-9ea2-ea97174ab788 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:48:49.037051 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-bcb5cad9-59b9-458d-9ea2-ea97174ab788 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/a625a74d-9de3-4914-8c36-58e67471e136" status: 200 len: 1391 microversion: 2.1 time: 0.163043 Oct 27 04:48:49.037615 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4210/8121] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:48:48 2022] GET /compute/v2.1/servers/a625a74d-9de3-4914-8c36-58e67471e136 => generated 1391 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:48:50.060072 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7e09b926-9c82-44e3-b845-4df07cb0a943 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:48:50.060679 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7e09b926-9c82-44e3-b845-4df07cb0a943 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: a625a74d-9de3-4914-8c36-58e67471e136] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:48:50.067504 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7e09b926-9c82-44e3-b845-4df07cb0a943 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:48:50.067926 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7e09b926-9c82-44e3-b845-4df07cb0a943 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:48:50.068365 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7e09b926-9c82-44e3-b845-4df07cb0a943 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:48:50.069054 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7e09b926-9c82-44e3-b845-4df07cb0a943 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:48:50.069509 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7e09b926-9c82-44e3-b845-4df07cb0a943 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:48:50.069939 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7e09b926-9c82-44e3-b845-4df07cb0a943 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:48:50.208461 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7e09b926-9c82-44e3-b845-4df07cb0a943 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:48:50.216224 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7e09b926-9c82-44e3-b845-4df07cb0a943 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/a625a74d-9de3-4914-8c36-58e67471e136" status: 200 len: 1391 microversion: 2.1 time: 0.160009 Oct 27 04:48:50.216821 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3912/8122] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:48:50 2022] GET /compute/v2.1/servers/a625a74d-9de3-4914-8c36-58e67471e136 => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:48:51.240602 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-735aec97-b090-488b-a0c2-d2b8803331e4 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:48:51.241272 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-735aec97-b090-488b-a0c2-d2b8803331e4 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: a625a74d-9de3-4914-8c36-58e67471e136] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:48:51.248136 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-735aec97-b090-488b-a0c2-d2b8803331e4 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:48:51.248643 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-735aec97-b090-488b-a0c2-d2b8803331e4 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:48:51.249108 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-735aec97-b090-488b-a0c2-d2b8803331e4 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:48:51.249828 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-735aec97-b090-488b-a0c2-d2b8803331e4 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:48:51.250411 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-735aec97-b090-488b-a0c2-d2b8803331e4 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:48:51.250863 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-735aec97-b090-488b-a0c2-d2b8803331e4 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:48:51.381476 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-735aec97-b090-488b-a0c2-d2b8803331e4 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:48:51.389349 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-735aec97-b090-488b-a0c2-d2b8803331e4 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/a625a74d-9de3-4914-8c36-58e67471e136" status: 200 len: 1391 microversion: 2.1 time: 0.153271 Oct 27 04:48:51.389937 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4211/8123] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:48:51 2022] GET /compute/v2.1/servers/a625a74d-9de3-4914-8c36-58e67471e136 => generated 1391 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:48:52.396520 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-da13a31f-e7b2-4e21-bff3-1c62f7487462 req-9edb6a5b-81e0-49e8-b6f8-a3d384d21d2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a625a74d-9de3-4914-8c36-58e67471e136", "name": "network-vif-plugged", "status": "completed", "tag": "5fcfc02d-24ac-4cf2-82dd-823a9898d30d"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:48:52.407204 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-da13a31f-e7b2-4e21-bff3-1c62f7487462 req-9edb6a5b-81e0-49e8-b6f8-a3d384d21d2d service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:48:52.407687 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-da13a31f-e7b2-4e21-bff3-1c62f7487462 req-9edb6a5b-81e0-49e8-b6f8-a3d384d21d2d service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:48:52.408127 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-da13a31f-e7b2-4e21-bff3-1c62f7487462 req-9edb6a5b-81e0-49e8-b6f8-a3d384d21d2d service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:48:52.418937 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-da13a31f-e7b2-4e21-bff3-1c62f7487462 req-9edb6a5b-81e0-49e8-b6f8-a3d384d21d2d service nova] Creating event network-vif-plugged:5fcfc02d-24ac-4cf2-82dd-823a9898d30d for instance a625a74d-9de3-4914-8c36-58e67471e136 on n-h2-862769-1 Oct 27 04:48:52.424511 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-da13a31f-e7b2-4e21-bff3-1c62f7487462 req-9edb6a5b-81e0-49e8-b6f8-a3d384d21d2d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031891 Oct 27 04:48:52.425110 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3913/8124] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:48:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:48:52.425951 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8eb8fac8-4553-44ff-a0b4-2def9fe8b44a tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:48:52.426641 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8eb8fac8-4553-44ff-a0b4-2def9fe8b44a tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: a625a74d-9de3-4914-8c36-58e67471e136] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:48:52.433528 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8eb8fac8-4553-44ff-a0b4-2def9fe8b44a tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:48:52.434176 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8eb8fac8-4553-44ff-a0b4-2def9fe8b44a tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:48:52.434642 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8eb8fac8-4553-44ff-a0b4-2def9fe8b44a tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:48:52.435368 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8eb8fac8-4553-44ff-a0b4-2def9fe8b44a tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:48:52.435844 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8eb8fac8-4553-44ff-a0b4-2def9fe8b44a tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:48:52.436292 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8eb8fac8-4553-44ff-a0b4-2def9fe8b44a tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:48:52.575194 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8eb8fac8-4553-44ff-a0b4-2def9fe8b44a tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:48:52.582887 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8eb8fac8-4553-44ff-a0b4-2def9fe8b44a tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/a625a74d-9de3-4914-8c36-58e67471e136" status: 200 len: 1391 microversion: 2.1 time: 0.161814 Oct 27 04:48:52.583473 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4212/8125] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:48:52 2022] GET /compute/v2.1/servers/a625a74d-9de3-4914-8c36-58e67471e136 => generated 1391 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 04:48:53.603303 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:48:53.604093 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=6 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:48:53.608948 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-911d6b7b-ef9d-4633-b963-a3430602211e tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:48:53.609918 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-911d6b7b-ef9d-4633-b963-a3430602211e tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: a625a74d-9de3-4914-8c36-58e67471e136] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:48:53.615964 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-911d6b7b-ef9d-4633-b963-a3430602211e tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:48:53.616448 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-911d6b7b-ef9d-4633-b963-a3430602211e tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:48:53.616883 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-911d6b7b-ef9d-4633-b963-a3430602211e tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:48:53.617576 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-911d6b7b-ef9d-4633-b963-a3430602211e tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:48:53.618028 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-911d6b7b-ef9d-4633-b963-a3430602211e tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:48:53.618483 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-911d6b7b-ef9d-4633-b963-a3430602211e tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:48:53.751824 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-911d6b7b-ef9d-4633-b963-a3430602211e tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:48:53.759600 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-911d6b7b-ef9d-4633-b963-a3430602211e tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/a625a74d-9de3-4914-8c36-58e67471e136" status: 200 len: 1391 microversion: 2.1 time: 0.157291 Oct 27 04:48:53.765099 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3914/8126] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:48:53 2022] GET /compute/v2.1/servers/a625a74d-9de3-4914-8c36-58e67471e136 => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:48:54.783286 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5024cb4b-5e9e-425c-b6e8-76bd89792d22 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:48:54.783928 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5024cb4b-5e9e-425c-b6e8-76bd89792d22 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: a625a74d-9de3-4914-8c36-58e67471e136] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:48:54.785842 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=6 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:48:54.791504 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5024cb4b-5e9e-425c-b6e8-76bd89792d22 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:48:54.792956 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5024cb4b-5e9e-425c-b6e8-76bd89792d22 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:48:54.792956 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5024cb4b-5e9e-425c-b6e8-76bd89792d22 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:48:54.793194 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5024cb4b-5e9e-425c-b6e8-76bd89792d22 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:48:54.793601 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5024cb4b-5e9e-425c-b6e8-76bd89792d22 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:48:54.794064 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5024cb4b-5e9e-425c-b6e8-76bd89792d22 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:48:54.932951 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5024cb4b-5e9e-425c-b6e8-76bd89792d22 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:48:54.941255 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5024cb4b-5e9e-425c-b6e8-76bd89792d22 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/a625a74d-9de3-4914-8c36-58e67471e136" status: 200 len: 1563 microversion: 2.1 time: 0.162529 Oct 27 04:48:54.941819 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4213/8127] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:48:54 2022] GET /compute/v2.1/servers/a625a74d-9de3-4914-8c36-58e67471e136 => generated 1563 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:48:54.964018 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-066cacb3-22eb-41b1-ba9f-2f23903fefff tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:48:54.964719 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-066cacb3-22eb-41b1-ba9f-2f23903fefff tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: a625a74d-9de3-4914-8c36-58e67471e136] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:48:54.971571 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-066cacb3-22eb-41b1-ba9f-2f23903fefff tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:48:54.972056 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-066cacb3-22eb-41b1-ba9f-2f23903fefff tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:48:54.972505 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-066cacb3-22eb-41b1-ba9f-2f23903fefff tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:48:54.973199 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-066cacb3-22eb-41b1-ba9f-2f23903fefff tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:48:54.973655 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-066cacb3-22eb-41b1-ba9f-2f23903fefff tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:48:54.974117 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-066cacb3-22eb-41b1-ba9f-2f23903fefff tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:48:55.106425 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-066cacb3-22eb-41b1-ba9f-2f23903fefff tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:48:55.114458 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-066cacb3-22eb-41b1-ba9f-2f23903fefff tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/a625a74d-9de3-4914-8c36-58e67471e136" status: 200 len: 1563 microversion: 2.1 time: 0.154395 Oct 27 04:48:55.115028 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3915/8128] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:48:54 2022] GET /compute/v2.1/servers/a625a74d-9de3-4914-8c36-58e67471e136 => generated 1563 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:48:56.983627 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8014673d-5a51-418b-904d-0b1adf196d70 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:48:56.984829 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8014673d-5a51-418b-904d-0b1adf196d70 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: a625a74d-9de3-4914-8c36-58e67471e136] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:48:56.986322 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-79ceb6c1-5b6e-4b3f-acbb-8eb3b88c7b58 req-789e9a4d-1aaf-449d-be2b-805919d6db08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a625a74d-9de3-4914-8c36-58e67471e136", "tag": "5fcfc02d-24ac-4cf2-82dd-823a9898d30d"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:48:56.992295 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:48:56.992678 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8014673d-5a51-418b-904d-0b1adf196d70 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:48:56.993189 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8014673d-5a51-418b-904d-0b1adf196d70 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:48:56.993662 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8014673d-5a51-418b-904d-0b1adf196d70 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:48:56.994586 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8014673d-5a51-418b-904d-0b1adf196d70 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:48:56.995302 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8014673d-5a51-418b-904d-0b1adf196d70 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:48:56.995758 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8014673d-5a51-418b-904d-0b1adf196d70 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:48:56.998377 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-79ceb6c1-5b6e-4b3f-acbb-8eb3b88c7b58 req-789e9a4d-1aaf-449d-be2b-805919d6db08 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:48:56.998925 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-79ceb6c1-5b6e-4b3f-acbb-8eb3b88c7b58 req-789e9a4d-1aaf-449d-be2b-805919d6db08 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:48:56.999484 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-79ceb6c1-5b6e-4b3f-acbb-8eb3b88c7b58 req-789e9a4d-1aaf-449d-be2b-805919d6db08 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:48:57.011940 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-79ceb6c1-5b6e-4b3f-acbb-8eb3b88c7b58 req-789e9a4d-1aaf-449d-be2b-805919d6db08 service nova] Creating event network-changed:5fcfc02d-24ac-4cf2-82dd-823a9898d30d for instance a625a74d-9de3-4914-8c36-58e67471e136 on n-h2-862769-1 Oct 27 04:48:57.017471 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-79ceb6c1-5b6e-4b3f-acbb-8eb3b88c7b58 req-789e9a4d-1aaf-449d-be2b-805919d6db08 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035590 Oct 27 04:48:57.018501 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3916/8129] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:48:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:48:57.144339 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8014673d-5a51-418b-904d-0b1adf196d70 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:48:57.152755 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8014673d-5a51-418b-904d-0b1adf196d70 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/a625a74d-9de3-4914-8c36-58e67471e136" status: 200 len: 1563 microversion: 2.1 time: 0.173164 Oct 27 04:48:57.153361 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4214/8130] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:48:56 2022] GET /compute/v2.1/servers/a625a74d-9de3-4914-8c36-58e67471e136 => generated 1563 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:49:18.779861 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4d7fdffa-b134-4beb-931a-3ca0ac249f66 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:49:18.782193 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4d7fdffa-b134-4beb-931a-3ca0ac249f66 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: a625a74d-9de3-4914-8c36-58e67471e136] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:49:18.784795 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=42 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:49:18.789986 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4d7fdffa-b134-4beb-931a-3ca0ac249f66 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:49:18.794761 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4d7fdffa-b134-4beb-931a-3ca0ac249f66 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:49:18.794761 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4d7fdffa-b134-4beb-931a-3ca0ac249f66 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:49:18.794761 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4d7fdffa-b134-4beb-931a-3ca0ac249f66 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:49:18.794761 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4d7fdffa-b134-4beb-931a-3ca0ac249f66 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:49:18.794761 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4d7fdffa-b134-4beb-931a-3ca0ac249f66 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:49:18.843874 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4d7fdffa-b134-4beb-931a-3ca0ac249f66 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "POST /compute/v2.1/servers/a625a74d-9de3-4914-8c36-58e67471e136/action" status: 200 len: 24563 microversion: 2.1 time: 0.068493 Oct 27 04:49:18.844762 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3917/8131] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 04:49:18 2022] POST /compute/v2.1/servers/a625a74d-9de3-4914-8c36-58e67471e136/action => generated 24563 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 04:49:29.922526 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5edfeda5-2607-4dd3-b471-79a4d8cb0037 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:49:29.923161 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5edfeda5-2607-4dd3-b471-79a4d8cb0037 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: a625a74d-9de3-4914-8c36-58e67471e136] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:49:29.925382 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=9 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:49:29.926177 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=38 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:49:29.930942 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5edfeda5-2607-4dd3-b471-79a4d8cb0037 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:49:29.931455 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5edfeda5-2607-4dd3-b471-79a4d8cb0037 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:49:29.931998 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5edfeda5-2607-4dd3-b471-79a4d8cb0037 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:49:29.932705 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5edfeda5-2607-4dd3-b471-79a4d8cb0037 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:49:29.933185 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5edfeda5-2607-4dd3-b471-79a4d8cb0037 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:49:29.933639 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-5edfeda5-2607-4dd3-b471-79a4d8cb0037 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:49:29.957891 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-5edfeda5-2607-4dd3-b471-79a4d8cb0037 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lazy-loading 'flavor' on Instance uuid a625a74d-9de3-4914-8c36-58e67471e136 {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 04:49:30.233983 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5edfeda5-2607-4dd3-b471-79a4d8cb0037 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "POST /compute/v2.1/servers/a625a74d-9de3-4914-8c36-58e67471e136/action" status: 202 len: 0 microversion: 2.1 time: 0.315476 Oct 27 04:49:30.234678 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4215/8132] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 04:49:29 2022] POST /compute/v2.1/servers/a625a74d-9de3-4914-8c36-58e67471e136/action => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 04:49:30.244582 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9a5d3667-79bc-48ac-8002-e55fb1cc2b16 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:49:30.245291 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9a5d3667-79bc-48ac-8002-e55fb1cc2b16 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: a625a74d-9de3-4914-8c36-58e67471e136] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:49:30.253726 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9a5d3667-79bc-48ac-8002-e55fb1cc2b16 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:49:30.254242 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9a5d3667-79bc-48ac-8002-e55fb1cc2b16 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:49:30.254690 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9a5d3667-79bc-48ac-8002-e55fb1cc2b16 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:49:30.255393 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9a5d3667-79bc-48ac-8002-e55fb1cc2b16 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:49:30.255852 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9a5d3667-79bc-48ac-8002-e55fb1cc2b16 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:49:30.256284 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9a5d3667-79bc-48ac-8002-e55fb1cc2b16 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:49:30.391361 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9a5d3667-79bc-48ac-8002-e55fb1cc2b16 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:49:30.400029 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9a5d3667-79bc-48ac-8002-e55fb1cc2b16 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/a625a74d-9de3-4914-8c36-58e67471e136" status: 200 len: 1689 microversion: 2.1 time: 0.160510 Oct 27 04:49:30.400600 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3918/8133] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:49:30 2022] GET /compute/v2.1/servers/a625a74d-9de3-4914-8c36-58e67471e136 => generated 1689 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 04:49:31.426082 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-a2202814-e2f6-4884-abff-c14d9ad306de tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:49:31.426810 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-a2202814-e2f6-4884-abff-c14d9ad306de tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: a625a74d-9de3-4914-8c36-58e67471e136] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:49:31.432998 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a2202814-e2f6-4884-abff-c14d9ad306de tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:49:31.433499 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a2202814-e2f6-4884-abff-c14d9ad306de tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:49:31.433952 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a2202814-e2f6-4884-abff-c14d9ad306de tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:49:31.434681 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a2202814-e2f6-4884-abff-c14d9ad306de tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:49:31.435150 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a2202814-e2f6-4884-abff-c14d9ad306de tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:49:31.435594 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-a2202814-e2f6-4884-abff-c14d9ad306de tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:49:31.569106 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-a2202814-e2f6-4884-abff-c14d9ad306de tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:49:31.576987 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-a2202814-e2f6-4884-abff-c14d9ad306de tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/a625a74d-9de3-4914-8c36-58e67471e136" status: 200 len: 1672 microversion: 2.1 time: 0.156186 Oct 27 04:49:31.577570 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4216/8134] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:49:31 2022] GET /compute/v2.1/servers/a625a74d-9de3-4914-8c36-58e67471e136 => generated 1672 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 04:49:32.670672 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1f00222b-0e99-4812-baa5-3622ba1dff77 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:49:32.673012 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1f00222b-0e99-4812-baa5-3622ba1dff77 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: a625a74d-9de3-4914-8c36-58e67471e136] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:49:32.681249 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1f00222b-0e99-4812-baa5-3622ba1dff77 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:49:32.684546 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1f00222b-0e99-4812-baa5-3622ba1dff77 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:49:32.684546 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1f00222b-0e99-4812-baa5-3622ba1dff77 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:49:32.684546 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1f00222b-0e99-4812-baa5-3622ba1dff77 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:49:32.684546 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1f00222b-0e99-4812-baa5-3622ba1dff77 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:49:32.684546 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1f00222b-0e99-4812-baa5-3622ba1dff77 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:49:32.733439 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1f00222b-0e99-4812-baa5-3622ba1dff77 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "POST /compute/v2.1/servers/a625a74d-9de3-4914-8c36-58e67471e136/action" status: 200 len: 38445 microversion: 2.1 time: 0.066759 Oct 27 04:49:32.734220 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3919/8135] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 04:49:32 2022] POST /compute/v2.1/servers/a625a74d-9de3-4914-8c36-58e67471e136/action => generated 38445 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 04:49:32.746728 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-38949f95-a18a-4568-adfa-0593176a37db tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:49:32.747289 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-38949f95-a18a-4568-adfa-0593176a37db tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: a625a74d-9de3-4914-8c36-58e67471e136] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:49:32.754286 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-38949f95-a18a-4568-adfa-0593176a37db tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:49:32.754848 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-38949f95-a18a-4568-adfa-0593176a37db tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:49:32.755333 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-38949f95-a18a-4568-adfa-0593176a37db tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:49:32.756039 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-38949f95-a18a-4568-adfa-0593176a37db tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:49:32.756513 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-38949f95-a18a-4568-adfa-0593176a37db tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:49:32.756954 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-38949f95-a18a-4568-adfa-0593176a37db tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:49:32.927406 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-38949f95-a18a-4568-adfa-0593176a37db tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "POST /compute/v2.1/servers/a625a74d-9de3-4914-8c36-58e67471e136/action" status: 202 len: 0 microversion: 2.1 time: 0.184379 Oct 27 04:49:32.933055 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4217/8136] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 04:49:32 2022] POST /compute/v2.1/servers/a625a74d-9de3-4914-8c36-58e67471e136/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 04:49:32.936920 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-42ef73b1-c2f4-4bd2-8b5f-95848e9c71b0 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:49:32.937684 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-42ef73b1-c2f4-4bd2-8b5f-95848e9c71b0 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: a625a74d-9de3-4914-8c36-58e67471e136] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:49:32.944506 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-42ef73b1-c2f4-4bd2-8b5f-95848e9c71b0 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:49:32.944993 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-42ef73b1-c2f4-4bd2-8b5f-95848e9c71b0 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:49:32.945429 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-42ef73b1-c2f4-4bd2-8b5f-95848e9c71b0 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:49:32.946238 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-42ef73b1-c2f4-4bd2-8b5f-95848e9c71b0 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:49:32.946697 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-42ef73b1-c2f4-4bd2-8b5f-95848e9c71b0 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:49:32.947152 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-42ef73b1-c2f4-4bd2-8b5f-95848e9c71b0 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:49:33.095625 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-42ef73b1-c2f4-4bd2-8b5f-95848e9c71b0 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:49:33.104188 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-42ef73b1-c2f4-4bd2-8b5f-95848e9c71b0 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/a625a74d-9de3-4914-8c36-58e67471e136" status: 200 len: 1678 microversion: 2.1 time: 0.171482 Oct 27 04:49:33.104767 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3920/8137] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:49:32 2022] GET /compute/v2.1/servers/a625a74d-9de3-4914-8c36-58e67471e136 => generated 1678 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:49:34.128904 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-dd9d923b-2b4c-4625-8497-fe16ea96e8ee tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:49:34.129643 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-dd9d923b-2b4c-4625-8497-fe16ea96e8ee tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: a625a74d-9de3-4914-8c36-58e67471e136] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:49:34.136968 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dd9d923b-2b4c-4625-8497-fe16ea96e8ee tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:49:34.137481 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dd9d923b-2b4c-4625-8497-fe16ea96e8ee tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:49:34.137978 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dd9d923b-2b4c-4625-8497-fe16ea96e8ee tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:49:34.138723 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dd9d923b-2b4c-4625-8497-fe16ea96e8ee tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:49:34.139203 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dd9d923b-2b4c-4625-8497-fe16ea96e8ee tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:49:34.139656 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dd9d923b-2b4c-4625-8497-fe16ea96e8ee tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:49:34.275629 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-dd9d923b-2b4c-4625-8497-fe16ea96e8ee tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:49:34.284045 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-dd9d923b-2b4c-4625-8497-fe16ea96e8ee tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/a625a74d-9de3-4914-8c36-58e67471e136" status: 200 len: 1678 microversion: 2.1 time: 0.158998 Oct 27 04:49:34.284752 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4218/8138] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:49:34 2022] GET /compute/v2.1/servers/a625a74d-9de3-4914-8c36-58e67471e136 => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:49:35.307500 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e391db97-db1e-4d55-8730-5f08f46a9b00 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:49:35.308119 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e391db97-db1e-4d55-8730-5f08f46a9b00 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: a625a74d-9de3-4914-8c36-58e67471e136] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:49:35.314934 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e391db97-db1e-4d55-8730-5f08f46a9b00 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:49:35.315420 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e391db97-db1e-4d55-8730-5f08f46a9b00 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:49:35.315863 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e391db97-db1e-4d55-8730-5f08f46a9b00 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:49:35.316551 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e391db97-db1e-4d55-8730-5f08f46a9b00 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:49:35.317005 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e391db97-db1e-4d55-8730-5f08f46a9b00 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:49:35.317459 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e391db97-db1e-4d55-8730-5f08f46a9b00 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:49:35.452134 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e391db97-db1e-4d55-8730-5f08f46a9b00 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:49:35.460365 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e391db97-db1e-4d55-8730-5f08f46a9b00 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/a625a74d-9de3-4914-8c36-58e67471e136" status: 200 len: 1681 microversion: 2.1 time: 0.156811 Oct 27 04:49:35.460946 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3921/8139] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:49:35 2022] GET /compute/v2.1/servers/a625a74d-9de3-4914-8c36-58e67471e136 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:49:35.553424 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-27e1dee0-8c48-4846-816b-1cf82989703a tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:49:35.555703 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-27e1dee0-8c48-4846-816b-1cf82989703a tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: a625a74d-9de3-4914-8c36-58e67471e136] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:49:35.562625 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-27e1dee0-8c48-4846-816b-1cf82989703a tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:49:35.563134 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-27e1dee0-8c48-4846-816b-1cf82989703a tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:49:35.563597 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-27e1dee0-8c48-4846-816b-1cf82989703a tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:49:35.564825 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-27e1dee0-8c48-4846-816b-1cf82989703a tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:49:35.565337 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-27e1dee0-8c48-4846-816b-1cf82989703a tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:49:35.565788 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-27e1dee0-8c48-4846-816b-1cf82989703a tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:49:35.607235 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-27e1dee0-8c48-4846-816b-1cf82989703a tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "POST /compute/v2.1/servers/a625a74d-9de3-4914-8c36-58e67471e136/action" status: 200 len: 38445 microversion: 2.1 time: 0.057608 Oct 27 04:49:35.610953 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4219/8140] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 04:49:35 2022] POST /compute/v2.1/servers/a625a74d-9de3-4914-8c36-58e67471e136/action => generated 38445 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 04:49:36.648068 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6de18b71-2c4f-4217-bf2c-749c74a8d48d tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:49:36.649102 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-087c3068-c624-4e5f-99f6-468b0cd3bada req-777b43b8-0402-49b3-baa4-2705a9aaf005 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a625a74d-9de3-4914-8c36-58e67471e136", "tag": "5fcfc02d-24ac-4cf2-82dd-823a9898d30d"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:49:36.655940 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6de18b71-2c4f-4217-bf2c-749c74a8d48d tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: a625a74d-9de3-4914-8c36-58e67471e136] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:49:36.664484 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-087c3068-c624-4e5f-99f6-468b0cd3bada req-777b43b8-0402-49b3-baa4-2705a9aaf005 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:49:36.664706 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6de18b71-2c4f-4217-bf2c-749c74a8d48d tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:49:36.664999 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-087c3068-c624-4e5f-99f6-468b0cd3bada req-777b43b8-0402-49b3-baa4-2705a9aaf005 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:49:36.665297 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6de18b71-2c4f-4217-bf2c-749c74a8d48d tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:49:36.665480 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-087c3068-c624-4e5f-99f6-468b0cd3bada req-777b43b8-0402-49b3-baa4-2705a9aaf005 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:49:36.665866 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6de18b71-2c4f-4217-bf2c-749c74a8d48d tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:49:36.666683 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6de18b71-2c4f-4217-bf2c-749c74a8d48d tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:49:36.668117 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6de18b71-2c4f-4217-bf2c-749c74a8d48d tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:49:36.668117 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6de18b71-2c4f-4217-bf2c-749c74a8d48d tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:49:36.677264 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-087c3068-c624-4e5f-99f6-468b0cd3bada req-777b43b8-0402-49b3-baa4-2705a9aaf005 service nova] Creating event network-changed:5fcfc02d-24ac-4cf2-82dd-823a9898d30d for instance a625a74d-9de3-4914-8c36-58e67471e136 on n-h2-862769-1 Oct 27 04:49:36.683556 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-087c3068-c624-4e5f-99f6-468b0cd3bada req-777b43b8-0402-49b3-baa4-2705a9aaf005 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040587 Oct 27 04:49:36.683556 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4220/8141] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:49:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:49:36.695820 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6de18b71-2c4f-4217-bf2c-749c74a8d48d tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: a625a74d-9de3-4914-8c36-58e67471e136] Going to try to terminate instance {{(pid=121000) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 04:49:36.997327 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6de18b71-2c4f-4217-bf2c-749c74a8d48d tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a625a74d-9de3-4914-8c36-58e67471e136" status: 204 len: 0 microversion: 2.1 time: 0.358912 Oct 27 04:49:36.998317 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3922/8142] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 04:49:36 2022] DELETE /compute/v2.1/servers/a625a74d-9de3-4914-8c36-58e67471e136 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 04:49:37.008639 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7b1304b9-a42a-46d0-834e-392ec55e0ff6 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:49:37.009679 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7b1304b9-a42a-46d0-834e-392ec55e0ff6 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: a625a74d-9de3-4914-8c36-58e67471e136] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:49:37.025075 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7b1304b9-a42a-46d0-834e-392ec55e0ff6 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:49:37.025075 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7b1304b9-a42a-46d0-834e-392ec55e0ff6 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:49:37.025075 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7b1304b9-a42a-46d0-834e-392ec55e0ff6 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:49:37.025075 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7b1304b9-a42a-46d0-834e-392ec55e0ff6 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:49:37.025075 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7b1304b9-a42a-46d0-834e-392ec55e0ff6 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:49:37.025075 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7b1304b9-a42a-46d0-834e-392ec55e0ff6 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:49:37.168298 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7b1304b9-a42a-46d0-834e-392ec55e0ff6 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:49:37.176378 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7b1304b9-a42a-46d0-834e-392ec55e0ff6 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/a625a74d-9de3-4914-8c36-58e67471e136" status: 200 len: 1687 microversion: 2.1 time: 0.172951 Oct 27 04:49:37.176978 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4221/8143] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:49:37 2022] GET /compute/v2.1/servers/a625a74d-9de3-4914-8c36-58e67471e136 => generated 1687 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 04:49:38.203654 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d5d44120-b308-46de-8968-2e39f7cb4159 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:49:38.204492 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d5d44120-b308-46de-8968-2e39f7cb4159 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: a625a74d-9de3-4914-8c36-58e67471e136] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:49:38.211139 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d5d44120-b308-46de-8968-2e39f7cb4159 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:49:38.211628 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d5d44120-b308-46de-8968-2e39f7cb4159 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:49:38.212071 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d5d44120-b308-46de-8968-2e39f7cb4159 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:49:38.212777 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d5d44120-b308-46de-8968-2e39f7cb4159 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:49:38.213266 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d5d44120-b308-46de-8968-2e39f7cb4159 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:49:38.213806 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d5d44120-b308-46de-8968-2e39f7cb4159 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:49:38.382119 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d5d44120-b308-46de-8968-2e39f7cb4159 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:49:38.394048 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d5d44120-b308-46de-8968-2e39f7cb4159 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/a625a74d-9de3-4914-8c36-58e67471e136" status: 200 len: 1687 microversion: 2.1 time: 0.194947 Oct 27 04:49:38.394917 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3923/8144] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:49:38 2022] GET /compute/v2.1/servers/a625a74d-9de3-4914-8c36-58e67471e136 => generated 1687 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:49:39.053856 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-eda0b3ce-3e85-4885-a8f1-b992ef1766de req-444c807a-c0f4-4a7b-9290-e3f8ae935d0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a625a74d-9de3-4914-8c36-58e67471e136", "name": "network-vif-deleted", "tag": "5fcfc02d-24ac-4cf2-82dd-823a9898d30d"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:49:39.064483 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-eda0b3ce-3e85-4885-a8f1-b992ef1766de req-444c807a-c0f4-4a7b-9290-e3f8ae935d0d service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:49:39.066075 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-eda0b3ce-3e85-4885-a8f1-b992ef1766de req-444c807a-c0f4-4a7b-9290-e3f8ae935d0d service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:49:39.066075 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-eda0b3ce-3e85-4885-a8f1-b992ef1766de req-444c807a-c0f4-4a7b-9290-e3f8ae935d0d service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:49:39.076964 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-eda0b3ce-3e85-4885-a8f1-b992ef1766de req-444c807a-c0f4-4a7b-9290-e3f8ae935d0d service nova] Creating event network-vif-deleted:5fcfc02d-24ac-4cf2-82dd-823a9898d30d for instance a625a74d-9de3-4914-8c36-58e67471e136 on n-h2-862769-1 Oct 27 04:49:39.082556 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-eda0b3ce-3e85-4885-a8f1-b992ef1766de req-444c807a-c0f4-4a7b-9290-e3f8ae935d0d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032499 Oct 27 04:49:39.087846 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4222/8145] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:49:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:49:39.421068 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b4397dc8-82c5-4d5c-9ae5-a1bb41bb3340 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:49:39.422244 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b4397dc8-82c5-4d5c-9ae5-a1bb41bb3340 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: a625a74d-9de3-4914-8c36-58e67471e136] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:49:39.432339 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b4397dc8-82c5-4d5c-9ae5-a1bb41bb3340 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:49:39.432954 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b4397dc8-82c5-4d5c-9ae5-a1bb41bb3340 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:49:39.433568 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b4397dc8-82c5-4d5c-9ae5-a1bb41bb3340 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:49:39.434617 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b4397dc8-82c5-4d5c-9ae5-a1bb41bb3340 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:49:39.435253 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b4397dc8-82c5-4d5c-9ae5-a1bb41bb3340 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:49:39.435847 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b4397dc8-82c5-4d5c-9ae5-a1bb41bb3340 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:49:39.485372 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b4397dc8-82c5-4d5c-9ae5-a1bb41bb3340 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:49:39.485865 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b4397dc8-82c5-4d5c-9ae5-a1bb41bb3340 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:49:39.486373 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b4397dc8-82c5-4d5c-9ae5-a1bb41bb3340 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:49:39.486828 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-b4397dc8-82c5-4d5c-9ae5-a1bb41bb3340 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lazy-loading 'fault' on Instance uuid a625a74d-9de3-4914-8c36-58e67471e136 {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 04:49:39.528303 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b4397dc8-82c5-4d5c-9ae5-a1bb41bb3340 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e2c2dd9af848e5941d979683201c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67648db046c54ee3b314904c8338cd61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:49:39.536012 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b4397dc8-82c5-4d5c-9ae5-a1bb41bb3340 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/a625a74d-9de3-4914-8c36-58e67471e136" status: 200 len: 1355 microversion: 2.1 time: 0.121594 Oct 27 04:49:39.536591 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3924/8146] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:49:39 2022] GET /compute/v2.1/servers/a625a74d-9de3-4914-8c36-58e67471e136 => generated 1355 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:49:40.561401 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f41c76d5-e2b8-4cfc-b66c-0a8cfea5b961 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:49:40.562223 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f41c76d5-e2b8-4cfc-b66c-0a8cfea5b961 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] [instance: a625a74d-9de3-4914-8c36-58e67471e136] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:49:40.569067 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f41c76d5-e2b8-4cfc-b66c-0a8cfea5b961 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:49:40.569570 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f41c76d5-e2b8-4cfc-b66c-0a8cfea5b961 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:49:40.570045 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f41c76d5-e2b8-4cfc-b66c-0a8cfea5b961 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:49:40.570760 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f41c76d5-e2b8-4cfc-b66c-0a8cfea5b961 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:49:40.571231 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f41c76d5-e2b8-4cfc-b66c-0a8cfea5b961 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:49:40.571676 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f41c76d5-e2b8-4cfc-b66c-0a8cfea5b961 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:49:40.584828 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-f41c76d5-e2b8-4cfc-b66c-0a8cfea5b961 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] HTTP exception thrown: Instance a625a74d-9de3-4914-8c36-58e67471e136 could not be found. Oct 27 04:49:40.586472 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f41c76d5-e2b8-4cfc-b66c-0a8cfea5b961 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Request method failure captured: Oct 27 04:49:40.586472 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/a625a74d-9de3-4914-8c36-58e67471e136 HTTP/1.1 Oct 27 04:49:40.586472 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 04:49:40.586472 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 04:49:40.586472 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 04:49:40.586472 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 04:49:40.586472 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 04:49:40.586472 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 04:49:40.586472 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 04:49:40.586472 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 04:49:40.586472 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWgwK8Ydq2cZdl_qrXrzRt_-NHDs7Lbtyx3d1dP6RHEGcXjkmaGVWHwtmDAl_U5lub8Vu3EmSakuDoQfbZk0S8adwgJ-moO1z1C17My_hnWBVYQWYzYJdyvYOBGBq4h4dKTwzNOCKugh1J2CSdPdxb32D5VZEm2rfYKUP1FoiK7m3nt8 Oct 27 04:49:40.586472 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 04:49:40.586472 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 04:49:40.586472 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 04:49:40.586472 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 04:49:40.586472 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 04:49:40.586472 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 04:49:40.586472 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 67648db046c54ee3b314904c8338cd61 Oct 27 04:49:40.586472 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-952256618 Oct 27 04:49:40.586472 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 04:49:40.586472 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 04:49:40.586472 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/67648db046c54ee3b314904c8338cd61"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/67648db046c54ee3b314904c8338cd61"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/67648db046c54ee3b314904c8338cd61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_67648db046c54ee3b314904c8338cd61"}]}] Oct 27 04:49:40.586472 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-TestNetworkAdvancedServerOps-952256618 Oct 27 04:49:40.586472 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 67648db046c54ee3b314904c8338cd61 Oct 27 04:49:40.586472 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-952256618 Oct 27 04:49:40.586472 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-TestNetworkAdvancedServerOps-952256618-project Oct 27 04:49:40.586472 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 04:49:40.586472 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 04:49:40.586472 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 91e2c2dd9af848e5941d979683201c70 Oct 27 04:49:40.586472 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-TestNetworkAdvancedServerOps-952256618-project Oct 27 04:49:40.586472 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 04:49:40.586472 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance a625a74d-9de3-4914-8c36-58e67471e136 could not be found. Oct 27 04:49:40.586472 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': 'a625a74d-9de3-4914-8c36-58e67471e136'} Oct 27 04:49:40.586472 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 04:49:40.586472 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:49:40.586472 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 04:49:40.586472 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 04:49:40.586472 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 04:49:40.586472 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 04:49:40.586472 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 04:49:40.586472 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 04:49:40.586472 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 04:49:40.586472 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 04:49:40.586472 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a625a74d-9de3-4914-8c36-58e67471e136 could not be found. Oct 27 04:49:40.586472 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:49:40.586472 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:49:40.586472 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:49:40.586472 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:49:40.586472 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:49:40.586472 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:49:40.586472 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 04:49:40.586472 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 04:49:40.586472 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 04:49:40.586472 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 04:49:40.586472 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 04:49:40.586472 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 04:49:40.586472 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 04:49:40.586472 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 04:49:40.586472 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 04:49:40.586472 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 04:49:40.586472 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a625a74d-9de3-4914-8c36-58e67471e136 could not be found. Oct 27 04:49:40.586472 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:49:40.586472 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:49:40.592558 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:49:40.592558 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:49:40.592558 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:49:40.592558 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:49:40.592558 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 04:49:40.592558 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 04:49:40.592558 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a625a74d-9de3-4914-8c36-58e67471e136 could not be found. Oct 27 04:49:40.592558 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:49:40.592558 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f41c76d5-e2b8-4cfc-b66c-0a8cfea5b961 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Returning 404 to user: Instance a625a74d-9de3-4914-8c36-58e67471e136 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 04:49:40.592558 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f41c76d5-e2b8-4cfc-b66c-0a8cfea5b961 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "GET /compute/v2.1/servers/a625a74d-9de3-4914-8c36-58e67471e136" status: 404 len: 111 microversion: 2.1 time: 0.031837 Oct 27 04:49:40.592558 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4223/8147] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:49:40 2022] GET /compute/v2.1/servers/a625a74d-9de3-4914-8c36-58e67471e136 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 04:49:44.361921 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-924a1bf1-6885-4d30-b749-f9de5f2e7107 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] Calling method '.version_select at 0x7f7dd98add30>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:49:44.477932 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-924a1bf1-6885-4d30-b749-f9de5f2e7107 tempest-TestNetworkAdvancedServerOps-952256618 tempest-TestNetworkAdvancedServerOps-952256618-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-355817801" status: 202 len: 0 microversion: 2.1 time: 0.120148 Oct 27 04:49:44.478566 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3925/8148] 10.222.0.20 () {58 vars in 1281 bytes} [Thu Oct 27 04:49:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-355817801 => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 04:49:58.846102 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=18 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:49:58.847063 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:49:58.848290 n-d-862769-1 devstack@n-api.service[121001]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 04:49:58.848463 n-d-862769-1 devstack@n-api.service[121001]: Thu Oct 27 04:49:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.20) !!! Oct 27 04:49:59.025097 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-905c16af-d2f4-471a-b76c-281c29131c93 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Action: 'create', calling method: .version_select at 0x7f7ddab940d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-131817434", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDzgReoW1LEtaFiJdqNaHUFk+ahAt2hLFKAgcMYqTC5yu8IeUzvgjeNpRBvGH3qKgwciv1et9idoK/nhnnC6skc+ykZpSZq5lBw1bMLucr0VSKL+uuM+Cs7GIz4k9U2vLg=="}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:49:59.044401 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-905c16af-d2f4-471a-b76c-281c29131c93 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Getting quotas for project 206d2ec543a34682a5ec39023ffa2c90. Resources: {'key_pairs'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 04:49:59.050480 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-905c16af-d2f4-471a-b76c-281c29131c93 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Getting quotas for user 0801f524d46d447c9dc052189e964abf and project 206d2ec543a34682a5ec39023ffa2c90. Resources: {'key_pairs'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 04:49:59.129851 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-905c16af-d2f4-471a-b76c-281c29131c93 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.289760 Oct 27 04:49:59.130497 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4224/8149] 10.222.0.20 () {60 vars in 1159 bytes} [Thu Oct 27 04:49:58 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:50:01.705881 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-04a9886f-89d6-4e56-a4be-f612ac1b5817 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2133986044", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-131817434", "security_groups": [{"name": "tempest-secgroup-smoke-1442176519"}], "networks": [{"uuid": "d18bb85c-5db2-4e8e-a2ee-2219ac031c83"}]}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:50:01.719536 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:50:01.722724 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:50:01.828392 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-04a9886f-89d6-4e56-a4be-f612ac1b5817 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] validate_networks() for [('d18bb85c-5db2-4e8e-a2ee-2219ac031c83', None, None, None, None, None)] {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 04:50:02.309012 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-04a9886f-89d6-4e56-a4be-f612ac1b5817 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 04:50:02.309438 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-04a9886f-89d6-4e56-a4be-f612ac1b5817 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 04:50:02.309920 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-04a9886f-89d6-4e56-a4be-f612ac1b5817 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 04:50:02.310449 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-04a9886f-89d6-4e56-a4be-f612ac1b5817 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 04:50:02.310871 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-04a9886f-89d6-4e56-a4be-f612ac1b5817 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 04:50:02.319984 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-04a9886f-89d6-4e56-a4be-f612ac1b5817 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:50:02.320538 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-04a9886f-89d6-4e56-a4be-f612ac1b5817 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:50:02.320889 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-04a9886f-89d6-4e56-a4be-f612ac1b5817 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:50:02.321639 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-04a9886f-89d6-4e56-a4be-f612ac1b5817 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:50:02.322134 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-04a9886f-89d6-4e56-a4be-f612ac1b5817 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:50:02.322564 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-04a9886f-89d6-4e56-a4be-f612ac1b5817 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:50:02.341172 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-04a9886f-89d6-4e56-a4be-f612ac1b5817 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Getting quotas for project 206d2ec543a34682a5ec39023ffa2c90. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 04:50:02.347173 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-04a9886f-89d6-4e56-a4be-f612ac1b5817 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Getting quotas for user 0801f524d46d447c9dc052189e964abf and project 206d2ec543a34682a5ec39023ffa2c90. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 04:50:02.359807 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-04a9886f-89d6-4e56-a4be-f612ac1b5817 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 04:50:02.362769 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-04a9886f-89d6-4e56-a4be-f612ac1b5817 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 7c0c3eb0-c985-4ada-a607-ffa4de441208] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 04:50:02.474110 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-04a9886f-89d6-4e56-a4be-f612ac1b5817 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.772720 Oct 27 04:50:02.474788 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3926/8150] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 04:50:01 2022] POST /compute/v2.1/servers => generated 406 bytes in 774 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 04:50:02.487769 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-97adb783-80a1-4443-8cfe-605bb321c3f4 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:50:02.488418 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-97adb783-80a1-4443-8cfe-605bb321c3f4 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 7c0c3eb0-c985-4ada-a607-ffa4de441208] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:50:02.545529 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-97adb783-80a1-4443-8cfe-605bb321c3f4 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:50:02.552981 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-97adb783-80a1-4443-8cfe-605bb321c3f4 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208" status: 200 len: 1246 microversion: 2.1 time: 0.070576 Oct 27 04:50:02.554104 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4225/8151] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:50:02 2022] GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208 => generated 1246 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:50:03.576995 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-42d4ebfa-7441-423b-848c-9d47276c0f96 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:50:03.577620 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-42d4ebfa-7441-423b-848c-9d47276c0f96 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 7c0c3eb0-c985-4ada-a607-ffa4de441208] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:50:03.601004 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-42d4ebfa-7441-423b-848c-9d47276c0f96 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:50:03.601523 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-42d4ebfa-7441-423b-848c-9d47276c0f96 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:50:03.601970 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-42d4ebfa-7441-423b-848c-9d47276c0f96 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:50:03.602798 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-42d4ebfa-7441-423b-848c-9d47276c0f96 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:50:03.603252 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-42d4ebfa-7441-423b-848c-9d47276c0f96 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:50:03.603678 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-42d4ebfa-7441-423b-848c-9d47276c0f96 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:50:03.682429 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-42d4ebfa-7441-423b-848c-9d47276c0f96 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:50:03.690945 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-42d4ebfa-7441-423b-848c-9d47276c0f96 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208" status: 200 len: 1250 microversion: 2.1 time: 0.117835 Oct 27 04:50:03.691462 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3927/8152] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:50:03 2022] GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208 => generated 1250 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:50:04.714899 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1b4c1d32-91ab-42c5-af2c-14a20cbe021a tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:50:04.717424 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1b4c1d32-91ab-42c5-af2c-14a20cbe021a tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 7c0c3eb0-c985-4ada-a607-ffa4de441208] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:50:04.723633 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1b4c1d32-91ab-42c5-af2c-14a20cbe021a tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:50:04.724132 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1b4c1d32-91ab-42c5-af2c-14a20cbe021a tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:50:04.724590 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1b4c1d32-91ab-42c5-af2c-14a20cbe021a tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:50:04.725301 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1b4c1d32-91ab-42c5-af2c-14a20cbe021a tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:50:04.725772 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1b4c1d32-91ab-42c5-af2c-14a20cbe021a tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:50:04.726255 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1b4c1d32-91ab-42c5-af2c-14a20cbe021a tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:50:04.787935 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1b4c1d32-91ab-42c5-af2c-14a20cbe021a tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:50:04.795942 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1b4c1d32-91ab-42c5-af2c-14a20cbe021a tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208" status: 200 len: 1306 microversion: 2.1 time: 0.084930 Oct 27 04:50:04.796524 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4226/8153] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:50:04 2022] GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208 => generated 1306 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:50:05.823769 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e4d40789-1474-4e85-9792-40e8cabbca63 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:50:05.824402 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e4d40789-1474-4e85-9792-40e8cabbca63 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 7c0c3eb0-c985-4ada-a607-ffa4de441208] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:50:05.831240 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e4d40789-1474-4e85-9792-40e8cabbca63 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:50:05.831735 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e4d40789-1474-4e85-9792-40e8cabbca63 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:50:05.832184 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e4d40789-1474-4e85-9792-40e8cabbca63 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:50:05.832900 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e4d40789-1474-4e85-9792-40e8cabbca63 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:50:05.833358 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e4d40789-1474-4e85-9792-40e8cabbca63 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:50:05.833787 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e4d40789-1474-4e85-9792-40e8cabbca63 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:50:05.969629 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e4d40789-1474-4e85-9792-40e8cabbca63 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:50:05.975844 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e4d40789-1474-4e85-9792-40e8cabbca63 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208" status: 200 len: 1372 microversion: 2.1 time: 0.156124 Oct 27 04:50:05.976420 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3928/8154] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:50:05 2022] GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208 => generated 1372 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:50:06.495604 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-8c2d93f2-ce14-4236-8772-e2fe72825897 req-fffc4a1d-c70d-464b-bcaf-1f0d2b2bb68e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c0c3eb0-c985-4ada-a607-ffa4de441208", "tag": "67eb8ca1-83f0-47e6-bb86-611a5e23b9df"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:50:06.505593 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-8c2d93f2-ce14-4236-8772-e2fe72825897 req-fffc4a1d-c70d-464b-bcaf-1f0d2b2bb68e service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:50:06.506111 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-8c2d93f2-ce14-4236-8772-e2fe72825897 req-fffc4a1d-c70d-464b-bcaf-1f0d2b2bb68e service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:50:06.506565 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-8c2d93f2-ce14-4236-8772-e2fe72825897 req-fffc4a1d-c70d-464b-bcaf-1f0d2b2bb68e service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:50:06.517967 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-8c2d93f2-ce14-4236-8772-e2fe72825897 req-fffc4a1d-c70d-464b-bcaf-1f0d2b2bb68e service nova] Creating event network-changed:67eb8ca1-83f0-47e6-bb86-611a5e23b9df for instance 7c0c3eb0-c985-4ada-a607-ffa4de441208 on n-h1-862769-1 Oct 27 04:50:06.523185 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-8c2d93f2-ce14-4236-8772-e2fe72825897 req-fffc4a1d-c70d-464b-bcaf-1f0d2b2bb68e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088436 Oct 27 04:50:06.523790 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4227/8155] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:50:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:50:06.999509 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-34d61f88-fb19-4831-b252-3d0d6d95c9d0 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:50:07.000134 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-34d61f88-fb19-4831-b252-3d0d6d95c9d0 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 7c0c3eb0-c985-4ada-a607-ffa4de441208] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:50:07.006944 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-34d61f88-fb19-4831-b252-3d0d6d95c9d0 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:50:07.007440 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-34d61f88-fb19-4831-b252-3d0d6d95c9d0 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:50:07.007883 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-34d61f88-fb19-4831-b252-3d0d6d95c9d0 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:50:07.008587 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-34d61f88-fb19-4831-b252-3d0d6d95c9d0 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:50:07.009048 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-34d61f88-fb19-4831-b252-3d0d6d95c9d0 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:50:07.009474 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-34d61f88-fb19-4831-b252-3d0d6d95c9d0 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:50:07.144733 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-34d61f88-fb19-4831-b252-3d0d6d95c9d0 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:50:07.152710 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-34d61f88-fb19-4831-b252-3d0d6d95c9d0 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208" status: 200 len: 1372 microversion: 2.1 time: 0.157135 Oct 27 04:50:07.153777 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3929/8156] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:50:06 2022] GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208 => generated 1372 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:50:08.178835 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b9ae9966-af9b-424c-85a6-849593af25fe tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:50:08.179567 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b9ae9966-af9b-424c-85a6-849593af25fe tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 7c0c3eb0-c985-4ada-a607-ffa4de441208] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:50:08.186482 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b9ae9966-af9b-424c-85a6-849593af25fe tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:50:08.187223 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b9ae9966-af9b-424c-85a6-849593af25fe tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:50:08.187617 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b9ae9966-af9b-424c-85a6-849593af25fe tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:50:08.188351 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b9ae9966-af9b-424c-85a6-849593af25fe tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:50:08.188825 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b9ae9966-af9b-424c-85a6-849593af25fe tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:50:08.189879 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b9ae9966-af9b-424c-85a6-849593af25fe tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:50:08.329036 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b9ae9966-af9b-424c-85a6-849593af25fe tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:50:08.336771 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b9ae9966-af9b-424c-85a6-849593af25fe tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208" status: 200 len: 1372 microversion: 2.1 time: 0.163905 Oct 27 04:50:08.337349 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4228/8157] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:50:08 2022] GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208 => generated 1372 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:50:09.359749 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-17f1e808-76da-4985-b93a-e769ec093bf9 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:50:09.360674 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-17f1e808-76da-4985-b93a-e769ec093bf9 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 7c0c3eb0-c985-4ada-a607-ffa4de441208] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:50:09.367730 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-17f1e808-76da-4985-b93a-e769ec093bf9 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:50:09.368224 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-17f1e808-76da-4985-b93a-e769ec093bf9 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:50:09.368667 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-17f1e808-76da-4985-b93a-e769ec093bf9 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:50:09.369379 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-17f1e808-76da-4985-b93a-e769ec093bf9 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:50:09.369839 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-17f1e808-76da-4985-b93a-e769ec093bf9 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:50:09.370303 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-17f1e808-76da-4985-b93a-e769ec093bf9 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:50:09.504382 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-17f1e808-76da-4985-b93a-e769ec093bf9 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:50:09.512355 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-17f1e808-76da-4985-b93a-e769ec093bf9 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208" status: 200 len: 1372 microversion: 2.1 time: 0.156550 Oct 27 04:50:09.512972 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3930/8158] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:50:09 2022] GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208 => generated 1372 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:50:10.536114 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-467875a2-012e-4feb-9ea7-944a4c43465a tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:50:10.536759 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-467875a2-012e-4feb-9ea7-944a4c43465a tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 7c0c3eb0-c985-4ada-a607-ffa4de441208] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:50:10.543775 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-467875a2-012e-4feb-9ea7-944a4c43465a tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:50:10.544281 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-467875a2-012e-4feb-9ea7-944a4c43465a tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:50:10.544741 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-467875a2-012e-4feb-9ea7-944a4c43465a tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:50:10.545450 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-467875a2-012e-4feb-9ea7-944a4c43465a tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:50:10.545925 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-467875a2-012e-4feb-9ea7-944a4c43465a tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:50:10.546471 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-467875a2-012e-4feb-9ea7-944a4c43465a tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:50:10.675872 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-467875a2-012e-4feb-9ea7-944a4c43465a tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:50:10.683629 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-467875a2-012e-4feb-9ea7-944a4c43465a tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208" status: 200 len: 1372 microversion: 2.1 time: 0.152098 Oct 27 04:50:10.684207 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4229/8159] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:50:10 2022] GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208 => generated 1372 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:50:10.996891 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-567f267f-564a-4b24-8644-0ae857bb98f3 req-d04a863b-44cc-4041-bebd-a172153db2f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c0c3eb0-c985-4ada-a607-ffa4de441208", "name": "network-vif-plugged", "status": "completed", "tag": "67eb8ca1-83f0-47e6-bb86-611a5e23b9df"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:50:11.006992 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-567f267f-564a-4b24-8644-0ae857bb98f3 req-d04a863b-44cc-4041-bebd-a172153db2f8 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:50:11.007474 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-567f267f-564a-4b24-8644-0ae857bb98f3 req-d04a863b-44cc-4041-bebd-a172153db2f8 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:50:11.007908 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-567f267f-564a-4b24-8644-0ae857bb98f3 req-d04a863b-44cc-4041-bebd-a172153db2f8 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:50:11.023342 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-567f267f-564a-4b24-8644-0ae857bb98f3 req-d04a863b-44cc-4041-bebd-a172153db2f8 service nova] Creating event network-vif-plugged:67eb8ca1-83f0-47e6-bb86-611a5e23b9df for instance 7c0c3eb0-c985-4ada-a607-ffa4de441208 on n-h1-862769-1 Oct 27 04:50:11.028398 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-567f267f-564a-4b24-8644-0ae857bb98f3 req-d04a863b-44cc-4041-bebd-a172153db2f8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093379 Oct 27 04:50:11.029088 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3931/8160] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:50:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:50:11.707370 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8b3d34d9-c234-404c-bf9f-3df0b6814660 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:50:11.708016 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8b3d34d9-c234-404c-bf9f-3df0b6814660 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 7c0c3eb0-c985-4ada-a607-ffa4de441208] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:50:11.714907 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8b3d34d9-c234-404c-bf9f-3df0b6814660 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:50:11.715416 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8b3d34d9-c234-404c-bf9f-3df0b6814660 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:50:11.715878 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8b3d34d9-c234-404c-bf9f-3df0b6814660 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:50:11.716600 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8b3d34d9-c234-404c-bf9f-3df0b6814660 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:50:11.717090 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8b3d34d9-c234-404c-bf9f-3df0b6814660 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:50:11.717530 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8b3d34d9-c234-404c-bf9f-3df0b6814660 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:50:11.851853 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8b3d34d9-c234-404c-bf9f-3df0b6814660 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:50:11.859682 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8b3d34d9-c234-404c-bf9f-3df0b6814660 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208" status: 200 len: 1372 microversion: 2.1 time: 0.156374 Oct 27 04:50:11.860273 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4230/8161] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:50:11 2022] GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208 => generated 1372 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 04:50:12.881317 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:50:12.882141 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=6 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:50:12.886283 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-89f19dea-53e8-4e15-89a6-60ca19253961 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:50:12.886995 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-89f19dea-53e8-4e15-89a6-60ca19253961 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 7c0c3eb0-c985-4ada-a607-ffa4de441208] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:50:12.893042 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-89f19dea-53e8-4e15-89a6-60ca19253961 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:50:12.893532 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-89f19dea-53e8-4e15-89a6-60ca19253961 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:50:12.893975 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-89f19dea-53e8-4e15-89a6-60ca19253961 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:50:12.894733 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-89f19dea-53e8-4e15-89a6-60ca19253961 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:50:12.895165 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-89f19dea-53e8-4e15-89a6-60ca19253961 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:50:12.895593 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-89f19dea-53e8-4e15-89a6-60ca19253961 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:50:13.031783 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-89f19dea-53e8-4e15-89a6-60ca19253961 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:50:13.040024 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-89f19dea-53e8-4e15-89a6-60ca19253961 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208" status: 200 len: 1556 microversion: 2.1 time: 0.160476 Oct 27 04:50:13.040601 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3932/8162] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:50:12 2022] GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208 => generated 1556 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:50:13.063181 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0be487f0-df3d-4222-9f8d-8b96e229e2f7 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:50:13.063818 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0be487f0-df3d-4222-9f8d-8b96e229e2f7 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 7c0c3eb0-c985-4ada-a607-ffa4de441208] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:50:13.065808 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=6 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:50:13.071396 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0be487f0-df3d-4222-9f8d-8b96e229e2f7 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:50:13.071892 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0be487f0-df3d-4222-9f8d-8b96e229e2f7 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:50:13.072348 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0be487f0-df3d-4222-9f8d-8b96e229e2f7 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:50:13.073055 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0be487f0-df3d-4222-9f8d-8b96e229e2f7 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:50:13.073526 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0be487f0-df3d-4222-9f8d-8b96e229e2f7 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:50:13.073968 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0be487f0-df3d-4222-9f8d-8b96e229e2f7 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:50:13.207346 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0be487f0-df3d-4222-9f8d-8b96e229e2f7 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:50:13.215271 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0be487f0-df3d-4222-9f8d-8b96e229e2f7 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208" status: 200 len: 1556 microversion: 2.1 time: 0.155993 Oct 27 04:50:13.215846 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4231/8163] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:50:13 2022] GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208 => generated 1556 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:50:15.408514 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-6a1d7670-f0cf-4757-bcb7-4fe555570fbc req-807a2099-866d-49cc-a4b6-8890c8390f5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c0c3eb0-c985-4ada-a607-ffa4de441208", "tag": "67eb8ca1-83f0-47e6-bb86-611a5e23b9df"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:50:15.419826 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-6a1d7670-f0cf-4757-bcb7-4fe555570fbc req-807a2099-866d-49cc-a4b6-8890c8390f5b service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:50:15.420225 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-6a1d7670-f0cf-4757-bcb7-4fe555570fbc req-807a2099-866d-49cc-a4b6-8890c8390f5b service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:50:15.420870 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-6a1d7670-f0cf-4757-bcb7-4fe555570fbc req-807a2099-866d-49cc-a4b6-8890c8390f5b service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:50:15.433053 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-6a1d7670-f0cf-4757-bcb7-4fe555570fbc req-807a2099-866d-49cc-a4b6-8890c8390f5b service nova] Creating event network-changed:67eb8ca1-83f0-47e6-bb86-611a5e23b9df for instance 7c0c3eb0-c985-4ada-a607-ffa4de441208 on n-h1-862769-1 Oct 27 04:50:15.438478 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-6a1d7670-f0cf-4757-bcb7-4fe555570fbc req-807a2099-866d-49cc-a4b6-8890c8390f5b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033591 Oct 27 04:50:15.439975 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3933/8164] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:50:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:52:11.741954 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:52:11.742813 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=32 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:52:11.748002 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-dc60fb33-b3ce-41c6-a9a5-2b10de66c79e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:52:11.748504 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-dc60fb33-b3ce-41c6-a9a5-2b10de66c79e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 7c0c3eb0-c985-4ada-a607-ffa4de441208] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:52:11.754794 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dc60fb33-b3ce-41c6-a9a5-2b10de66c79e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:52:11.756785 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dc60fb33-b3ce-41c6-a9a5-2b10de66c79e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:52:11.756785 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dc60fb33-b3ce-41c6-a9a5-2b10de66c79e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:52:11.756785 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dc60fb33-b3ce-41c6-a9a5-2b10de66c79e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:52:11.757106 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dc60fb33-b3ce-41c6-a9a5-2b10de66c79e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:52:11.757369 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dc60fb33-b3ce-41c6-a9a5-2b10de66c79e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:52:11.781552 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-dc60fb33-b3ce-41c6-a9a5-2b10de66c79e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lazy-loading 'flavor' on Instance uuid 7c0c3eb0-c985-4ada-a607-ffa4de441208 {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 04:52:12.353701 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-dc60fb33-b3ce-41c6-a9a5-2b10de66c79e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "POST /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208/action" status: 202 len: 0 microversion: 2.1 time: 0.613627 Oct 27 04:52:12.354401 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4232/8165] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 04:52:11 2022] POST /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208/action => generated 0 bytes in 615 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 04:52:12.360988 n-d-862769-1 devstack@n-api.service[121000]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5ec0dfad-6f0c-4686-8a67-f02607adfe50] AMQP server on 10.222.0.20:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 27 04:52:12.362270 n-d-862769-1 devstack@n-api.service[121000]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a40cf960-ae63-4112-9db5-88668ecbbc6d] AMQP server on 10.222.0.20:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 27 04:52:12.362876 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:52:12.363699 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=36 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:52:12.365104 n-d-862769-1 devstack@n-api.service[121000]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 27 04:52:12.365867 n-d-862769-1 devstack@n-api.service[121000]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 04:52:12.366007 n-d-862769-1 devstack@n-api.service[121000]: Thu Oct 27 04:52:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208 (ip 10.222.0.20) !!! Oct 27 04:52:12.372088 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-905ad6fc-ef2c-47d2-8e15-96b794fff46e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:52:12.375609 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-905ad6fc-ef2c-47d2-8e15-96b794fff46e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 7c0c3eb0-c985-4ada-a607-ffa4de441208] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:52:12.380819 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-905ad6fc-ef2c-47d2-8e15-96b794fff46e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:52:12.381318 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-905ad6fc-ef2c-47d2-8e15-96b794fff46e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:52:12.381761 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-905ad6fc-ef2c-47d2-8e15-96b794fff46e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:52:12.382501 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-905ad6fc-ef2c-47d2-8e15-96b794fff46e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:52:12.382966 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-905ad6fc-ef2c-47d2-8e15-96b794fff46e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:52:12.383399 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-905ad6fc-ef2c-47d2-8e15-96b794fff46e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:52:12.566382 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-905ad6fc-ef2c-47d2-8e15-96b794fff46e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:52:12.574674 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-905ad6fc-ef2c-47d2-8e15-96b794fff46e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208" status: 200 len: 1681 microversion: 2.1 time: 0.214982 Oct 27 04:52:12.575249 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3934/8166] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:52:12 2022] GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208 => generated 1681 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:52:13.600050 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2ddf945f-f828-4fc1-a518-fc249ef4f956 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:52:13.600768 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2ddf945f-f828-4fc1-a518-fc249ef4f956 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 7c0c3eb0-c985-4ada-a607-ffa4de441208] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:52:13.607922 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2ddf945f-f828-4fc1-a518-fc249ef4f956 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:52:13.608422 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2ddf945f-f828-4fc1-a518-fc249ef4f956 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:52:13.608874 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2ddf945f-f828-4fc1-a518-fc249ef4f956 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:52:13.609577 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2ddf945f-f828-4fc1-a518-fc249ef4f956 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:52:13.610071 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2ddf945f-f828-4fc1-a518-fc249ef4f956 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:52:13.610511 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2ddf945f-f828-4fc1-a518-fc249ef4f956 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:52:13.743576 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2ddf945f-f828-4fc1-a518-fc249ef4f956 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:52:13.751920 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2ddf945f-f828-4fc1-a518-fc249ef4f956 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208" status: 200 len: 1681 microversion: 2.1 time: 0.157140 Oct 27 04:52:13.752433 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4233/8167] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:52:13 2022] GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:52:14.775735 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-56a4597a-6f98-4062-b7f7-da4fe108cf9e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:52:14.776351 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-56a4597a-6f98-4062-b7f7-da4fe108cf9e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 7c0c3eb0-c985-4ada-a607-ffa4de441208] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:52:14.790242 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-56a4597a-6f98-4062-b7f7-da4fe108cf9e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:52:14.790746 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-56a4597a-6f98-4062-b7f7-da4fe108cf9e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:52:14.791196 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-56a4597a-6f98-4062-b7f7-da4fe108cf9e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:52:14.791923 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-56a4597a-6f98-4062-b7f7-da4fe108cf9e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:52:14.793002 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-56a4597a-6f98-4062-b7f7-da4fe108cf9e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:52:14.793439 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-56a4597a-6f98-4062-b7f7-da4fe108cf9e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:52:14.802489 n-d-862769-1 devstack@n-api.service[121000]: INFO oslo.messaging._drivers.impl_rabbit [-] [5ec0dfad-6f0c-4686-8a67-f02607adfe50] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 59680. Oct 27 04:52:14.814362 n-d-862769-1 devstack@n-api.service[121000]: INFO oslo.messaging._drivers.impl_rabbit [-] [a40cf960-ae63-4112-9db5-88668ecbbc6d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 59682. Oct 27 04:52:14.932971 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-56a4597a-6f98-4062-b7f7-da4fe108cf9e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:52:14.940930 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-56a4597a-6f98-4062-b7f7-da4fe108cf9e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208" status: 200 len: 1681 microversion: 2.1 time: 0.169137 Oct 27 04:52:14.941518 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3935/8168] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:52:14 2022] GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208 => generated 1681 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:52:15.964881 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4c851825-3a3a-4ef8-9eaf-cd30eb852f5d tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:52:15.965520 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4c851825-3a3a-4ef8-9eaf-cd30eb852f5d tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 7c0c3eb0-c985-4ada-a607-ffa4de441208] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:52:15.972376 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4c851825-3a3a-4ef8-9eaf-cd30eb852f5d tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:52:15.972874 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4c851825-3a3a-4ef8-9eaf-cd30eb852f5d tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:52:15.973327 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4c851825-3a3a-4ef8-9eaf-cd30eb852f5d tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:52:15.974048 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4c851825-3a3a-4ef8-9eaf-cd30eb852f5d tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:52:15.974528 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4c851825-3a3a-4ef8-9eaf-cd30eb852f5d tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:52:15.975023 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4c851825-3a3a-4ef8-9eaf-cd30eb852f5d tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:52:16.106429 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4c851825-3a3a-4ef8-9eaf-cd30eb852f5d tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:52:16.114439 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4c851825-3a3a-4ef8-9eaf-cd30eb852f5d tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208" status: 200 len: 1681 microversion: 2.1 time: 0.153552 Oct 27 04:52:16.115020 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4234/8169] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:52:15 2022] GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:52:17.138455 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4130a6c7-234d-4845-9f08-63a549b89cc2 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:52:17.139076 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4130a6c7-234d-4845-9f08-63a549b89cc2 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 7c0c3eb0-c985-4ada-a607-ffa4de441208] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:52:17.145780 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4130a6c7-234d-4845-9f08-63a549b89cc2 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:52:17.146293 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4130a6c7-234d-4845-9f08-63a549b89cc2 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:52:17.146737 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4130a6c7-234d-4845-9f08-63a549b89cc2 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:52:17.147447 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4130a6c7-234d-4845-9f08-63a549b89cc2 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:52:17.147903 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4130a6c7-234d-4845-9f08-63a549b89cc2 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:52:17.148331 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4130a6c7-234d-4845-9f08-63a549b89cc2 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:52:17.282474 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4130a6c7-234d-4845-9f08-63a549b89cc2 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:52:17.290900 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4130a6c7-234d-4845-9f08-63a549b89cc2 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208" status: 200 len: 1681 microversion: 2.1 time: 0.156933 Oct 27 04:52:17.291483 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3936/8170] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:52:17 2022] GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:52:18.315036 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-183d6ed2-68d6-4914-9808-820923887239 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:52:18.315702 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-183d6ed2-68d6-4914-9808-820923887239 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 7c0c3eb0-c985-4ada-a607-ffa4de441208] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:52:18.322305 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-183d6ed2-68d6-4914-9808-820923887239 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:52:18.322803 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-183d6ed2-68d6-4914-9808-820923887239 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:52:18.323265 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-183d6ed2-68d6-4914-9808-820923887239 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:52:18.324587 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-183d6ed2-68d6-4914-9808-820923887239 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:52:18.325056 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-183d6ed2-68d6-4914-9808-820923887239 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:52:18.325500 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-183d6ed2-68d6-4914-9808-820923887239 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:52:18.458057 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-183d6ed2-68d6-4914-9808-820923887239 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:52:18.466278 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-183d6ed2-68d6-4914-9808-820923887239 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208" status: 200 len: 1681 microversion: 2.1 time: 0.155128 Oct 27 04:52:18.466867 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4235/8171] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:52:18 2022] GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:52:19.490074 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4b57f9b4-e05e-41bc-9b5d-1bae8e1abe1c tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:52:19.490718 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4b57f9b4-e05e-41bc-9b5d-1bae8e1abe1c tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 7c0c3eb0-c985-4ada-a607-ffa4de441208] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:52:19.498104 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4b57f9b4-e05e-41bc-9b5d-1bae8e1abe1c tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:52:19.498592 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4b57f9b4-e05e-41bc-9b5d-1bae8e1abe1c tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:52:19.499053 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4b57f9b4-e05e-41bc-9b5d-1bae8e1abe1c tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:52:19.499744 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4b57f9b4-e05e-41bc-9b5d-1bae8e1abe1c tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:52:19.500185 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4b57f9b4-e05e-41bc-9b5d-1bae8e1abe1c tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:52:19.500608 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4b57f9b4-e05e-41bc-9b5d-1bae8e1abe1c tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:52:19.638291 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4b57f9b4-e05e-41bc-9b5d-1bae8e1abe1c tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:52:19.646075 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4b57f9b4-e05e-41bc-9b5d-1bae8e1abe1c tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208" status: 200 len: 1681 microversion: 2.1 time: 0.160186 Oct 27 04:52:19.647510 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3937/8172] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:52:19 2022] GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208 => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:52:20.668866 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-77e054c3-f465-468c-9812-f36e83ed0c5e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:52:20.669513 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-77e054c3-f465-468c-9812-f36e83ed0c5e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 7c0c3eb0-c985-4ada-a607-ffa4de441208] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:52:20.676412 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-77e054c3-f465-468c-9812-f36e83ed0c5e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:52:20.676920 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-77e054c3-f465-468c-9812-f36e83ed0c5e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:52:20.677381 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-77e054c3-f465-468c-9812-f36e83ed0c5e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:52:20.678125 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-77e054c3-f465-468c-9812-f36e83ed0c5e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:52:20.678604 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-77e054c3-f465-468c-9812-f36e83ed0c5e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:52:20.679053 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-77e054c3-f465-468c-9812-f36e83ed0c5e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:52:20.811357 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-77e054c3-f465-468c-9812-f36e83ed0c5e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:52:20.819156 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-77e054c3-f465-468c-9812-f36e83ed0c5e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208" status: 200 len: 1681 microversion: 2.1 time: 0.154244 Oct 27 04:52:20.819736 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4236/8173] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:52:20 2022] GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:52:21.843512 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-543de2f4-40d4-48a9-9fb1-f1d7298cf49c tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:52:21.844058 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-543de2f4-40d4-48a9-9fb1-f1d7298cf49c tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 7c0c3eb0-c985-4ada-a607-ffa4de441208] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:52:21.851482 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-543de2f4-40d4-48a9-9fb1-f1d7298cf49c tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:52:21.851827 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-543de2f4-40d4-48a9-9fb1-f1d7298cf49c tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:52:21.851966 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-543de2f4-40d4-48a9-9fb1-f1d7298cf49c tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:52:21.852664 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-543de2f4-40d4-48a9-9fb1-f1d7298cf49c tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:52:21.853116 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-543de2f4-40d4-48a9-9fb1-f1d7298cf49c tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:52:21.853533 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-543de2f4-40d4-48a9-9fb1-f1d7298cf49c tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:52:22.001548 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-543de2f4-40d4-48a9-9fb1-f1d7298cf49c tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:52:22.010172 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-543de2f4-40d4-48a9-9fb1-f1d7298cf49c tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208" status: 200 len: 1681 microversion: 2.1 time: 0.170657 Oct 27 04:52:22.010772 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3938/8174] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:52:21 2022] GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208 => generated 1681 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:52:23.032970 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-11c8cb80-2def-44f8-9d6b-de4d3bb112d5 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:52:23.033646 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-11c8cb80-2def-44f8-9d6b-de4d3bb112d5 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 7c0c3eb0-c985-4ada-a607-ffa4de441208] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:52:23.040629 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-11c8cb80-2def-44f8-9d6b-de4d3bb112d5 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:52:23.041130 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-11c8cb80-2def-44f8-9d6b-de4d3bb112d5 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:52:23.041592 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-11c8cb80-2def-44f8-9d6b-de4d3bb112d5 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:52:23.042359 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-11c8cb80-2def-44f8-9d6b-de4d3bb112d5 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:52:23.042839 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-11c8cb80-2def-44f8-9d6b-de4d3bb112d5 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:52:23.043290 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-11c8cb80-2def-44f8-9d6b-de4d3bb112d5 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:52:23.172226 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-11c8cb80-2def-44f8-9d6b-de4d3bb112d5 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:52:23.180010 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-11c8cb80-2def-44f8-9d6b-de4d3bb112d5 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208" status: 200 len: 1702 microversion: 2.1 time: 0.151115 Oct 27 04:52:23.180596 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4237/8175] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:52:23 2022] GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208 => generated 1702 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:52:24.204721 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-fb72fdfa-c972-4d07-a4d0-f90bb0e1567b tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:52:24.205341 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-fb72fdfa-c972-4d07-a4d0-f90bb0e1567b tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 7c0c3eb0-c985-4ada-a607-ffa4de441208] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:52:24.212292 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fb72fdfa-c972-4d07-a4d0-f90bb0e1567b tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:52:24.212778 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fb72fdfa-c972-4d07-a4d0-f90bb0e1567b tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:52:24.213217 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fb72fdfa-c972-4d07-a4d0-f90bb0e1567b tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:52:24.213910 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fb72fdfa-c972-4d07-a4d0-f90bb0e1567b tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:52:24.215047 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fb72fdfa-c972-4d07-a4d0-f90bb0e1567b tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:52:24.215477 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fb72fdfa-c972-4d07-a4d0-f90bb0e1567b tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:52:24.344260 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-fb72fdfa-c972-4d07-a4d0-f90bb0e1567b tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:52:24.351842 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-fb72fdfa-c972-4d07-a4d0-f90bb0e1567b tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208" status: 200 len: 1702 microversion: 2.1 time: 0.151078 Oct 27 04:52:24.352433 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3939/8176] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:52:24 2022] GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208 => generated 1702 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:52:25.375786 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-15f1f5aa-4e35-4f07-8cfd-f36a57abdf02 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:52:25.376452 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-15f1f5aa-4e35-4f07-8cfd-f36a57abdf02 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 7c0c3eb0-c985-4ada-a607-ffa4de441208] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:52:25.383777 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-15f1f5aa-4e35-4f07-8cfd-f36a57abdf02 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:52:25.384282 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-15f1f5aa-4e35-4f07-8cfd-f36a57abdf02 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:52:25.384855 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-15f1f5aa-4e35-4f07-8cfd-f36a57abdf02 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:52:25.385585 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-15f1f5aa-4e35-4f07-8cfd-f36a57abdf02 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:52:25.386589 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-15f1f5aa-4e35-4f07-8cfd-f36a57abdf02 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:52:25.387369 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-15f1f5aa-4e35-4f07-8cfd-f36a57abdf02 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:52:25.531839 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-15f1f5aa-4e35-4f07-8cfd-f36a57abdf02 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:52:25.541081 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-15f1f5aa-4e35-4f07-8cfd-f36a57abdf02 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208" status: 200 len: 1697 microversion: 2.1 time: 0.169301 Oct 27 04:52:25.541872 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4238/8177] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:52:25 2022] GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208 => generated 1697 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:52:26.567121 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4eb0ecde-a495-4d17-a7c5-b8be2ff892e9 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:52:26.568709 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4eb0ecde-a495-4d17-a7c5-b8be2ff892e9 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 7c0c3eb0-c985-4ada-a607-ffa4de441208] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:52:26.577097 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4eb0ecde-a495-4d17-a7c5-b8be2ff892e9 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:52:26.577956 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4eb0ecde-a495-4d17-a7c5-b8be2ff892e9 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:52:26.578555 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4eb0ecde-a495-4d17-a7c5-b8be2ff892e9 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:52:26.579316 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4eb0ecde-a495-4d17-a7c5-b8be2ff892e9 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:52:26.579781 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4eb0ecde-a495-4d17-a7c5-b8be2ff892e9 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:52:26.580220 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4eb0ecde-a495-4d17-a7c5-b8be2ff892e9 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:52:26.731980 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4eb0ecde-a495-4d17-a7c5-b8be2ff892e9 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:52:26.741448 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4eb0ecde-a495-4d17-a7c5-b8be2ff892e9 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208" status: 200 len: 1697 microversion: 2.1 time: 0.178283 Oct 27 04:52:26.742647 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3940/8178] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:52:26 2022] GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208 => generated 1697 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:52:27.525489 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-bd56b2a1-2932-4357-99cc-74004816e25e req-ed2b2062-01fa-40fc-9cdb-de03589023ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c0c3eb0-c985-4ada-a607-ffa4de441208", "name": "network-vif-plugged", "status": "completed", "tag": "67eb8ca1-83f0-47e6-bb86-611a5e23b9df"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:52:27.539673 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-bd56b2a1-2932-4357-99cc-74004816e25e req-ed2b2062-01fa-40fc-9cdb-de03589023ad service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:52:27.546305 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-bd56b2a1-2932-4357-99cc-74004816e25e req-ed2b2062-01fa-40fc-9cdb-de03589023ad service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:52:27.546305 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-bd56b2a1-2932-4357-99cc-74004816e25e req-ed2b2062-01fa-40fc-9cdb-de03589023ad service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:52:27.556069 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-bd56b2a1-2932-4357-99cc-74004816e25e req-ed2b2062-01fa-40fc-9cdb-de03589023ad service nova] Creating event network-vif-plugged:67eb8ca1-83f0-47e6-bb86-611a5e23b9df for instance 7c0c3eb0-c985-4ada-a607-ffa4de441208 on n-h1-862769-1 Oct 27 04:52:27.565268 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-bd56b2a1-2932-4357-99cc-74004816e25e req-ed2b2062-01fa-40fc-9cdb-de03589023ad service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045730 Oct 27 04:52:27.566422 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4239/8179] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:52:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:52:27.768475 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f4d0c3ba-6a37-45fe-b805-834228753afb tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:52:27.770141 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f4d0c3ba-6a37-45fe-b805-834228753afb tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 7c0c3eb0-c985-4ada-a607-ffa4de441208] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:52:27.777884 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f4d0c3ba-6a37-45fe-b805-834228753afb tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:52:27.778470 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f4d0c3ba-6a37-45fe-b805-834228753afb tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:52:27.779178 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f4d0c3ba-6a37-45fe-b805-834228753afb tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:52:27.780127 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f4d0c3ba-6a37-45fe-b805-834228753afb tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:52:27.780658 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f4d0c3ba-6a37-45fe-b805-834228753afb tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:52:27.781166 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f4d0c3ba-6a37-45fe-b805-834228753afb tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:52:27.927603 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f4d0c3ba-6a37-45fe-b805-834228753afb tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:52:27.936220 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f4d0c3ba-6a37-45fe-b805-834228753afb tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208" status: 200 len: 1697 microversion: 2.1 time: 0.171991 Oct 27 04:52:27.936831 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3941/8180] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:52:27 2022] GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208 => generated 1697 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:52:28.962794 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f84a1144-e17f-4549-9d90-003a35607cac tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:52:28.963783 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f84a1144-e17f-4549-9d90-003a35607cac tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 7c0c3eb0-c985-4ada-a607-ffa4de441208] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:52:28.970885 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f84a1144-e17f-4549-9d90-003a35607cac tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:52:28.971664 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f84a1144-e17f-4549-9d90-003a35607cac tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:52:28.972121 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f84a1144-e17f-4549-9d90-003a35607cac tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:52:28.972840 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f84a1144-e17f-4549-9d90-003a35607cac tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:52:28.973340 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f84a1144-e17f-4549-9d90-003a35607cac tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:52:28.973782 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f84a1144-e17f-4549-9d90-003a35607cac tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:52:29.118904 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f84a1144-e17f-4549-9d90-003a35607cac tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:52:29.127571 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f84a1144-e17f-4549-9d90-003a35607cac tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208" status: 200 len: 1697 microversion: 2.1 time: 0.170480 Oct 27 04:52:29.142675 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4240/8181] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:52:28 2022] GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208 => generated 1697 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:52:30.153583 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-86e674e9-1c19-4f15-8fd7-c1e745a65623 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:52:30.154878 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-86e674e9-1c19-4f15-8fd7-c1e745a65623 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 7c0c3eb0-c985-4ada-a607-ffa4de441208] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:52:30.161759 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-86e674e9-1c19-4f15-8fd7-c1e745a65623 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:52:30.162555 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-86e674e9-1c19-4f15-8fd7-c1e745a65623 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:52:30.163234 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-86e674e9-1c19-4f15-8fd7-c1e745a65623 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:52:30.164154 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-86e674e9-1c19-4f15-8fd7-c1e745a65623 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:52:30.164803 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-86e674e9-1c19-4f15-8fd7-c1e745a65623 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:52:30.165234 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-86e674e9-1c19-4f15-8fd7-c1e745a65623 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:52:30.317681 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-86e674e9-1c19-4f15-8fd7-c1e745a65623 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:52:30.327477 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-86e674e9-1c19-4f15-8fd7-c1e745a65623 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208" status: 200 len: 1697 microversion: 2.1 time: 0.177866 Oct 27 04:52:30.329025 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3942/8182] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:52:30 2022] GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208 => generated 1697 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:52:31.353520 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1c589d82-b816-4d2a-a074-8c0bfe8f38f8 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:52:31.354228 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1c589d82-b816-4d2a-a074-8c0bfe8f38f8 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 7c0c3eb0-c985-4ada-a607-ffa4de441208] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:52:31.363621 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1c589d82-b816-4d2a-a074-8c0bfe8f38f8 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:52:31.366446 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1c589d82-b816-4d2a-a074-8c0bfe8f38f8 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:52:31.366920 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1c589d82-b816-4d2a-a074-8c0bfe8f38f8 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:52:31.368655 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1c589d82-b816-4d2a-a074-8c0bfe8f38f8 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:52:31.369230 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1c589d82-b816-4d2a-a074-8c0bfe8f38f8 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:52:31.369683 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1c589d82-b816-4d2a-a074-8c0bfe8f38f8 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:52:31.518454 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1c589d82-b816-4d2a-a074-8c0bfe8f38f8 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:52:31.527356 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1c589d82-b816-4d2a-a074-8c0bfe8f38f8 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208" status: 200 len: 1697 microversion: 2.1 time: 0.178414 Oct 27 04:52:31.528009 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4241/8183] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:52:31 2022] GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208 => generated 1697 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:52:32.551818 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1b0139b7-02db-4b24-ba4c-0a93840c7e27 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:52:32.552443 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1b0139b7-02db-4b24-ba4c-0a93840c7e27 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 7c0c3eb0-c985-4ada-a607-ffa4de441208] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:52:32.560884 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1b0139b7-02db-4b24-ba4c-0a93840c7e27 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:52:32.560884 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1b0139b7-02db-4b24-ba4c-0a93840c7e27 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:52:32.560884 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1b0139b7-02db-4b24-ba4c-0a93840c7e27 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:52:32.561879 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1b0139b7-02db-4b24-ba4c-0a93840c7e27 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:52:32.562009 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1b0139b7-02db-4b24-ba4c-0a93840c7e27 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:52:32.562419 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1b0139b7-02db-4b24-ba4c-0a93840c7e27 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:52:32.727931 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1b0139b7-02db-4b24-ba4c-0a93840c7e27 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:52:32.739628 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1b0139b7-02db-4b24-ba4c-0a93840c7e27 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208" status: 200 len: 1697 microversion: 2.1 time: 0.191327 Oct 27 04:52:32.740815 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3943/8184] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:52:32 2022] GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208 => generated 1697 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:52:33.763665 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6880aa8f-af1d-4388-b184-1fe632c2750e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:52:33.764527 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-6880aa8f-af1d-4388-b184-1fe632c2750e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 7c0c3eb0-c985-4ada-a607-ffa4de441208] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:52:33.772096 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6880aa8f-af1d-4388-b184-1fe632c2750e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:52:33.772721 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6880aa8f-af1d-4388-b184-1fe632c2750e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:52:33.773269 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6880aa8f-af1d-4388-b184-1fe632c2750e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:52:33.774246 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6880aa8f-af1d-4388-b184-1fe632c2750e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:52:33.774806 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6880aa8f-af1d-4388-b184-1fe632c2750e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:52:33.775322 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6880aa8f-af1d-4388-b184-1fe632c2750e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:52:33.921580 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6880aa8f-af1d-4388-b184-1fe632c2750e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:52:33.934025 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6880aa8f-af1d-4388-b184-1fe632c2750e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208" status: 200 len: 1697 microversion: 2.1 time: 0.174235 Oct 27 04:52:33.934683 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4242/8185] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:52:33 2022] GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208 => generated 1697 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:52:34.957655 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1bb606e2-cdf5-486c-803d-bad59a6649d2 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:52:34.958321 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1bb606e2-cdf5-486c-803d-bad59a6649d2 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 7c0c3eb0-c985-4ada-a607-ffa4de441208] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:52:34.965988 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1bb606e2-cdf5-486c-803d-bad59a6649d2 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:52:34.966866 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1bb606e2-cdf5-486c-803d-bad59a6649d2 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:52:34.967555 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1bb606e2-cdf5-486c-803d-bad59a6649d2 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:52:34.968499 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1bb606e2-cdf5-486c-803d-bad59a6649d2 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:52:34.969173 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1bb606e2-cdf5-486c-803d-bad59a6649d2 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:52:34.969817 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1bb606e2-cdf5-486c-803d-bad59a6649d2 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:52:35.122008 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1bb606e2-cdf5-486c-803d-bad59a6649d2 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:52:35.132481 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1bb606e2-cdf5-486c-803d-bad59a6649d2 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208" status: 200 len: 1697 microversion: 2.1 time: 0.178640 Oct 27 04:52:35.133175 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3944/8186] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:52:34 2022] GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208 => generated 1697 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:52:36.156963 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7954833e-b97d-4deb-84b7-8abbd592c05d tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:52:36.157601 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7954833e-b97d-4deb-84b7-8abbd592c05d tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 7c0c3eb0-c985-4ada-a607-ffa4de441208] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:52:36.164817 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7954833e-b97d-4deb-84b7-8abbd592c05d tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:52:36.174506 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7954833e-b97d-4deb-84b7-8abbd592c05d tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:52:36.174506 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7954833e-b97d-4deb-84b7-8abbd592c05d tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:52:36.174506 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7954833e-b97d-4deb-84b7-8abbd592c05d tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:52:36.174506 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7954833e-b97d-4deb-84b7-8abbd592c05d tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:52:36.174506 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7954833e-b97d-4deb-84b7-8abbd592c05d tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:52:36.302707 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7954833e-b97d-4deb-84b7-8abbd592c05d tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:52:36.310863 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7954833e-b97d-4deb-84b7-8abbd592c05d tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208" status: 200 len: 1697 microversion: 2.1 time: 0.157892 Oct 27 04:52:36.311435 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4243/8187] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:52:36 2022] GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208 => generated 1697 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:52:37.333891 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ee297f98-c726-4100-b2c6-8c0b0eb2d9ed tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:52:37.334563 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ee297f98-c726-4100-b2c6-8c0b0eb2d9ed tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 7c0c3eb0-c985-4ada-a607-ffa4de441208] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:52:37.341332 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ee297f98-c726-4100-b2c6-8c0b0eb2d9ed tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:52:37.341821 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ee297f98-c726-4100-b2c6-8c0b0eb2d9ed tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:52:37.342303 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ee297f98-c726-4100-b2c6-8c0b0eb2d9ed tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:52:37.342997 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ee297f98-c726-4100-b2c6-8c0b0eb2d9ed tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:52:37.343455 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ee297f98-c726-4100-b2c6-8c0b0eb2d9ed tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:52:37.343886 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ee297f98-c726-4100-b2c6-8c0b0eb2d9ed tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:52:37.477324 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-ee297f98-c726-4100-b2c6-8c0b0eb2d9ed tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:52:37.485457 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ee297f98-c726-4100-b2c6-8c0b0eb2d9ed tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208" status: 200 len: 1679 microversion: 2.1 time: 0.155485 Oct 27 04:52:37.486048 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3945/8188] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:52:37 2022] GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:52:38.510481 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-23a1119b-9caa-4529-b900-bd4bdb410067 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:52:38.511212 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-23a1119b-9caa-4529-b900-bd4bdb410067 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 7c0c3eb0-c985-4ada-a607-ffa4de441208] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:52:38.518308 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-23a1119b-9caa-4529-b900-bd4bdb410067 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:52:38.518845 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-23a1119b-9caa-4529-b900-bd4bdb410067 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:52:38.519318 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-23a1119b-9caa-4529-b900-bd4bdb410067 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:52:38.520042 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-23a1119b-9caa-4529-b900-bd4bdb410067 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:52:38.520550 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-23a1119b-9caa-4529-b900-bd4bdb410067 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:52:38.521003 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-23a1119b-9caa-4529-b900-bd4bdb410067 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:52:38.656444 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-23a1119b-9caa-4529-b900-bd4bdb410067 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:52:38.664374 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-23a1119b-9caa-4529-b900-bd4bdb410067 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208" status: 200 len: 1679 microversion: 2.1 time: 0.157862 Oct 27 04:52:38.664953 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4244/8189] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:52:38 2022] GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:52:39.689287 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-cc45a4de-04d0-4236-b46f-3dfb57d79f7d tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:52:39.689901 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-cc45a4de-04d0-4236-b46f-3dfb57d79f7d tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 7c0c3eb0-c985-4ada-a607-ffa4de441208] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:52:39.696754 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cc45a4de-04d0-4236-b46f-3dfb57d79f7d tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:52:39.697245 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cc45a4de-04d0-4236-b46f-3dfb57d79f7d tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:52:39.697688 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cc45a4de-04d0-4236-b46f-3dfb57d79f7d tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:52:39.698428 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cc45a4de-04d0-4236-b46f-3dfb57d79f7d tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:52:39.698896 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cc45a4de-04d0-4236-b46f-3dfb57d79f7d tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:52:39.699333 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cc45a4de-04d0-4236-b46f-3dfb57d79f7d tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:52:39.829428 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-cc45a4de-04d0-4236-b46f-3dfb57d79f7d tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:52:39.837293 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-cc45a4de-04d0-4236-b46f-3dfb57d79f7d tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208" status: 200 len: 1622 microversion: 2.1 time: 0.152006 Oct 27 04:52:39.837868 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3946/8190] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:52:39 2022] GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208 => generated 1622 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:52:39.860583 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-328247d9-4fa0-48ca-93ff-8d0f7091be14 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:52:39.861213 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-328247d9-4fa0-48ca-93ff-8d0f7091be14 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 7c0c3eb0-c985-4ada-a607-ffa4de441208] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:52:39.868358 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-328247d9-4fa0-48ca-93ff-8d0f7091be14 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:52:39.868864 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-328247d9-4fa0-48ca-93ff-8d0f7091be14 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:52:39.869327 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-328247d9-4fa0-48ca-93ff-8d0f7091be14 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:52:39.870058 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-328247d9-4fa0-48ca-93ff-8d0f7091be14 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:52:39.871151 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-328247d9-4fa0-48ca-93ff-8d0f7091be14 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:52:39.871599 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-328247d9-4fa0-48ca-93ff-8d0f7091be14 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:52:39.960053 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-328247d9-4fa0-48ca-93ff-8d0f7091be14 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 7c0c3eb0-c985-4ada-a607-ffa4de441208] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121001) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 27 04:52:40.271782 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-328247d9-4fa0-48ca-93ff-8d0f7091be14 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "POST /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208/action" status: 202 len: 0 microversion: 2.1 time: 0.415120 Oct 27 04:52:40.272415 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4245/8191] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 04:52:39 2022] POST /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208/action => generated 0 bytes in 417 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 04:52:40.280740 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-90b22f09-f5c3-477f-8729-13ac9524218f tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:52:40.284031 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-90b22f09-f5c3-477f-8729-13ac9524218f tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 7c0c3eb0-c985-4ada-a607-ffa4de441208] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:52:40.287365 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-90b22f09-f5c3-477f-8729-13ac9524218f tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:52:40.287868 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-90b22f09-f5c3-477f-8729-13ac9524218f tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:52:40.288321 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-90b22f09-f5c3-477f-8729-13ac9524218f tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:52:40.289051 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-90b22f09-f5c3-477f-8729-13ac9524218f tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:52:40.289519 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-90b22f09-f5c3-477f-8729-13ac9524218f tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:52:40.289955 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-90b22f09-f5c3-477f-8729-13ac9524218f tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:52:40.424470 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-90b22f09-f5c3-477f-8729-13ac9524218f tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:52:40.432269 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-90b22f09-f5c3-477f-8729-13ac9524218f tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208" status: 200 len: 1630 microversion: 2.1 time: 0.155531 Oct 27 04:52:40.432853 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3947/8192] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:52:40 2022] GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208 => generated 1630 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:52:41.456861 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7aa989e3-06bc-49e0-b627-707a8d1c256a tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:52:41.457625 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7aa989e3-06bc-49e0-b627-707a8d1c256a tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 7c0c3eb0-c985-4ada-a607-ffa4de441208] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:52:41.467001 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7aa989e3-06bc-49e0-b627-707a8d1c256a tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:52:41.467001 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7aa989e3-06bc-49e0-b627-707a8d1c256a tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:52:41.467344 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7aa989e3-06bc-49e0-b627-707a8d1c256a tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:52:41.467927 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7aa989e3-06bc-49e0-b627-707a8d1c256a tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:52:41.468406 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7aa989e3-06bc-49e0-b627-707a8d1c256a tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:52:41.468888 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7aa989e3-06bc-49e0-b627-707a8d1c256a tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:52:41.473251 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:52:41.565679 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-6c7c672f-9687-456f-9380-4a5ec5cf8eb9 req-e9482fbd-1b63-42ec-ba9e-2622c899dbd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c0c3eb0-c985-4ada-a607-ffa4de441208", "name": "network-vif-unplugged", "status": "completed", "tag": "67eb8ca1-83f0-47e6-bb86-611a5e23b9df"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:52:41.577333 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-6c7c672f-9687-456f-9380-4a5ec5cf8eb9 req-e9482fbd-1b63-42ec-ba9e-2622c899dbd4 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:52:41.577921 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-6c7c672f-9687-456f-9380-4a5ec5cf8eb9 req-e9482fbd-1b63-42ec-ba9e-2622c899dbd4 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:52:41.578454 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-6c7c672f-9687-456f-9380-4a5ec5cf8eb9 req-e9482fbd-1b63-42ec-ba9e-2622c899dbd4 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:52:41.591091 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.compute.server_external_events [req-6c7c672f-9687-456f-9380-4a5ec5cf8eb9 req-e9482fbd-1b63-42ec-ba9e-2622c899dbd4 service nova] Unable to find a host for instance 7c0c3eb0-c985-4ada-a607-ffa4de441208. Dropping event network-vif-unplugged {{(pid=121000) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 27 04:52:41.599462 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-6c7c672f-9687-456f-9380-4a5ec5cf8eb9 req-e9482fbd-1b63-42ec-ba9e-2622c899dbd4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.034088 Oct 27 04:52:41.599462 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3948/8193] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:52:41 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 36 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 27 04:52:41.626597 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7aa989e3-06bc-49e0-b627-707a8d1c256a tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:52:41.635163 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7aa989e3-06bc-49e0-b627-707a8d1c256a tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208" status: 200 len: 1630 microversion: 2.1 time: 0.182516 Oct 27 04:52:41.635764 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4246/8194] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:52:41 2022] GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208 => generated 1630 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:52:42.659251 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7bdf65d1-8024-4e28-ada8-858fddeca02d tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:52:42.659974 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7bdf65d1-8024-4e28-ada8-858fddeca02d tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 7c0c3eb0-c985-4ada-a607-ffa4de441208] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:52:42.662724 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=31 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:52:42.667489 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7bdf65d1-8024-4e28-ada8-858fddeca02d tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:52:42.670008 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7bdf65d1-8024-4e28-ada8-858fddeca02d tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:52:42.670008 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7bdf65d1-8024-4e28-ada8-858fddeca02d tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:52:42.670008 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7bdf65d1-8024-4e28-ada8-858fddeca02d tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:52:42.670008 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7bdf65d1-8024-4e28-ada8-858fddeca02d tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:52:42.670008 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7bdf65d1-8024-4e28-ada8-858fddeca02d tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:52:42.674017 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=87 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:52:42.924973 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7bdf65d1-8024-4e28-ada8-858fddeca02d tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:52:42.932698 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7bdf65d1-8024-4e28-ada8-858fddeca02d tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208" status: 200 len: 1688 microversion: 2.1 time: 0.277370 Oct 27 04:52:42.933313 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3949/8195] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:52:42 2022] GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208 => generated 1688 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:52:43.258060 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-e0b64fab-6f43-47c4-b6cf-885672e23668 req-2cf03312-da08-4094-97f5-bf703b8c067e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c0c3eb0-c985-4ada-a607-ffa4de441208", "tag": "67eb8ca1-83f0-47e6-bb86-611a5e23b9df"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:52:43.263661 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:52:43.268957 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-e0b64fab-6f43-47c4-b6cf-885672e23668 req-2cf03312-da08-4094-97f5-bf703b8c067e service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:52:43.269469 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-e0b64fab-6f43-47c4-b6cf-885672e23668 req-2cf03312-da08-4094-97f5-bf703b8c067e service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:52:43.269932 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-e0b64fab-6f43-47c4-b6cf-885672e23668 req-2cf03312-da08-4094-97f5-bf703b8c067e service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:52:43.281438 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-e0b64fab-6f43-47c4-b6cf-885672e23668 req-2cf03312-da08-4094-97f5-bf703b8c067e service nova] Creating event network-changed:67eb8ca1-83f0-47e6-bb86-611a5e23b9df for instance 7c0c3eb0-c985-4ada-a607-ffa4de441208 on n-h2-862769-1 Oct 27 04:52:43.286586 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-e0b64fab-6f43-47c4-b6cf-885672e23668 req-2cf03312-da08-4094-97f5-bf703b8c067e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089987 Oct 27 04:52:43.287199 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4247/8196] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:52:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:52:43.957276 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-cb294d7b-44e6-480e-9b10-01b9d4e5b9ab tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:52:43.957949 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-cb294d7b-44e6-480e-9b10-01b9d4e5b9ab tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 7c0c3eb0-c985-4ada-a607-ffa4de441208] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:52:43.965407 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cb294d7b-44e6-480e-9b10-01b9d4e5b9ab tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:52:43.966847 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cb294d7b-44e6-480e-9b10-01b9d4e5b9ab tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:52:43.967365 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cb294d7b-44e6-480e-9b10-01b9d4e5b9ab tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:52:43.968137 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cb294d7b-44e6-480e-9b10-01b9d4e5b9ab tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:52:43.968665 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cb294d7b-44e6-480e-9b10-01b9d4e5b9ab tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:52:43.969163 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-cb294d7b-44e6-480e-9b10-01b9d4e5b9ab tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:52:44.220592 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-cb294d7b-44e6-480e-9b10-01b9d4e5b9ab tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:52:44.234744 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-cb294d7b-44e6-480e-9b10-01b9d4e5b9ab tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208" status: 200 len: 1688 microversion: 2.1 time: 0.280959 Oct 27 04:52:44.236228 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3950/8197] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:52:43 2022] GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208 => generated 1688 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:52:45.268044 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8286b1fa-d345-4a20-b401-075464427eb8 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:52:45.268936 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8286b1fa-d345-4a20-b401-075464427eb8 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 7c0c3eb0-c985-4ada-a607-ffa4de441208] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:52:45.276244 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8286b1fa-d345-4a20-b401-075464427eb8 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:52:45.277033 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8286b1fa-d345-4a20-b401-075464427eb8 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:52:45.277771 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8286b1fa-d345-4a20-b401-075464427eb8 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:52:45.278722 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8286b1fa-d345-4a20-b401-075464427eb8 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:52:45.279373 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8286b1fa-d345-4a20-b401-075464427eb8 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:52:45.280002 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8286b1fa-d345-4a20-b401-075464427eb8 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:52:45.437265 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8286b1fa-d345-4a20-b401-075464427eb8 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:52:45.446684 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8286b1fa-d345-4a20-b401-075464427eb8 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208" status: 200 len: 1688 microversion: 2.1 time: 0.186064 Oct 27 04:52:45.447251 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4248/8198] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:52:45 2022] GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208 => generated 1688 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:52:46.471504 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-af91283b-c4c2-4d6a-b2b4-28df8579adfe tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:52:46.472124 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-af91283b-c4c2-4d6a-b2b4-28df8579adfe tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 7c0c3eb0-c985-4ada-a607-ffa4de441208] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:52:46.478530 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-af91283b-c4c2-4d6a-b2b4-28df8579adfe tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:52:46.479021 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-af91283b-c4c2-4d6a-b2b4-28df8579adfe tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:52:46.479464 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-af91283b-c4c2-4d6a-b2b4-28df8579adfe tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:52:46.480186 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-af91283b-c4c2-4d6a-b2b4-28df8579adfe tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:52:46.480632 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-af91283b-c4c2-4d6a-b2b4-28df8579adfe tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:52:46.481065 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-af91283b-c4c2-4d6a-b2b4-28df8579adfe tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:52:46.626110 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-af91283b-c4c2-4d6a-b2b4-28df8579adfe tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:52:46.637761 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-af91283b-c4c2-4d6a-b2b4-28df8579adfe tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208" status: 200 len: 1688 microversion: 2.1 time: 0.170121 Oct 27 04:52:46.638633 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3951/8199] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:52:46 2022] GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208 => generated 1688 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:52:47.663850 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-34e3e470-4b04-4121-aed4-34c4c16653fb tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:52:47.664512 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-34e3e470-4b04-4121-aed4-34c4c16653fb tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 7c0c3eb0-c985-4ada-a607-ffa4de441208] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:52:47.672489 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-34e3e470-4b04-4121-aed4-34c4c16653fb tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:52:47.673395 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-34e3e470-4b04-4121-aed4-34c4c16653fb tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:52:47.674141 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-34e3e470-4b04-4121-aed4-34c4c16653fb tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:52:47.675125 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-34e3e470-4b04-4121-aed4-34c4c16653fb tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:52:47.675844 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-34e3e470-4b04-4121-aed4-34c4c16653fb tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:52:47.676551 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-34e3e470-4b04-4121-aed4-34c4c16653fb tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:52:47.828434 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-34e3e470-4b04-4121-aed4-34c4c16653fb tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:52:47.837251 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-34e3e470-4b04-4121-aed4-34c4c16653fb tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208" status: 200 len: 1688 microversion: 2.1 time: 0.177563 Oct 27 04:52:47.850067 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4249/8200] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:52:47 2022] GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208 => generated 1688 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:52:48.862873 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5c393e78-410e-4be4-8a36-e2ddcfad993b tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:52:48.863572 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5c393e78-410e-4be4-8a36-e2ddcfad993b tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 7c0c3eb0-c985-4ada-a607-ffa4de441208] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:52:48.872250 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5c393e78-410e-4be4-8a36-e2ddcfad993b tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:52:48.872757 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5c393e78-410e-4be4-8a36-e2ddcfad993b tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:52:48.873383 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5c393e78-410e-4be4-8a36-e2ddcfad993b tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:52:48.874149 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5c393e78-410e-4be4-8a36-e2ddcfad993b tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:52:48.874618 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5c393e78-410e-4be4-8a36-e2ddcfad993b tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:52:48.875113 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5c393e78-410e-4be4-8a36-e2ddcfad993b tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:52:49.017531 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5c393e78-410e-4be4-8a36-e2ddcfad993b tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:52:49.025364 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5c393e78-410e-4be4-8a36-e2ddcfad993b tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208" status: 200 len: 1688 microversion: 2.1 time: 0.167687 Oct 27 04:52:49.025999 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3952/8201] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:52:48 2022] GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208 => generated 1688 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:52:50.050727 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-bc867bdb-1a85-4923-9946-70af12658463 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:52:50.051535 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-bc867bdb-1a85-4923-9946-70af12658463 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 7c0c3eb0-c985-4ada-a607-ffa4de441208] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:52:50.060851 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bc867bdb-1a85-4923-9946-70af12658463 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:52:50.061517 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bc867bdb-1a85-4923-9946-70af12658463 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:52:50.062107 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bc867bdb-1a85-4923-9946-70af12658463 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:52:50.062935 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bc867bdb-1a85-4923-9946-70af12658463 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:52:50.063489 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bc867bdb-1a85-4923-9946-70af12658463 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:52:50.064016 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bc867bdb-1a85-4923-9946-70af12658463 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:52:50.228647 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-bc867bdb-1a85-4923-9946-70af12658463 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:52:50.238448 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-bc867bdb-1a85-4923-9946-70af12658463 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208" status: 200 len: 1688 microversion: 2.1 time: 0.193243 Oct 27 04:52:50.239543 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4250/8202] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:52:50 2022] GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208 => generated 1688 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:52:51.265110 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-40dd9ae2-254c-4537-9821-e42f77ad3070 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:52:51.265738 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-40dd9ae2-254c-4537-9821-e42f77ad3070 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 7c0c3eb0-c985-4ada-a607-ffa4de441208] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:52:51.278243 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-40dd9ae2-254c-4537-9821-e42f77ad3070 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:52:51.281702 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-40dd9ae2-254c-4537-9821-e42f77ad3070 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:52:51.281702 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-40dd9ae2-254c-4537-9821-e42f77ad3070 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:52:51.281702 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-40dd9ae2-254c-4537-9821-e42f77ad3070 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:52:51.281702 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-40dd9ae2-254c-4537-9821-e42f77ad3070 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:52:51.281702 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-40dd9ae2-254c-4537-9821-e42f77ad3070 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:52:51.421833 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-40dd9ae2-254c-4537-9821-e42f77ad3070 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:52:51.429859 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-40dd9ae2-254c-4537-9821-e42f77ad3070 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208" status: 200 len: 1688 microversion: 2.1 time: 0.170193 Oct 27 04:52:51.434663 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3953/8203] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:52:51 2022] GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208 => generated 1688 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:52:52.454874 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1cfff1e0-7166-4873-8aa2-537815587d2f tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:52:52.455518 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1cfff1e0-7166-4873-8aa2-537815587d2f tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 7c0c3eb0-c985-4ada-a607-ffa4de441208] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:52:52.462540 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1cfff1e0-7166-4873-8aa2-537815587d2f tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:52:52.463049 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1cfff1e0-7166-4873-8aa2-537815587d2f tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:52:52.463511 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1cfff1e0-7166-4873-8aa2-537815587d2f tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:52:52.464840 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1cfff1e0-7166-4873-8aa2-537815587d2f tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:52:52.465318 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1cfff1e0-7166-4873-8aa2-537815587d2f tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:52:52.465768 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1cfff1e0-7166-4873-8aa2-537815587d2f tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:52:52.594443 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1cfff1e0-7166-4873-8aa2-537815587d2f tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:52:52.602226 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1cfff1e0-7166-4873-8aa2-537815587d2f tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208" status: 200 len: 1688 microversion: 2.1 time: 0.151298 Oct 27 04:52:52.602806 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4251/8204] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:52:52 2022] GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208 => generated 1688 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:52:53.625495 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c41642ec-f704-4999-9f91-4817b772dc29 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:52:53.626144 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c41642ec-f704-4999-9f91-4817b772dc29 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 7c0c3eb0-c985-4ada-a607-ffa4de441208] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:52:53.632956 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c41642ec-f704-4999-9f91-4817b772dc29 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:52:53.633447 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c41642ec-f704-4999-9f91-4817b772dc29 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:52:53.633890 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c41642ec-f704-4999-9f91-4817b772dc29 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:52:53.634618 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c41642ec-f704-4999-9f91-4817b772dc29 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:52:53.635076 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c41642ec-f704-4999-9f91-4817b772dc29 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:52:53.635503 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c41642ec-f704-4999-9f91-4817b772dc29 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:52:53.769630 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c41642ec-f704-4999-9f91-4817b772dc29 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:52:53.777890 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c41642ec-f704-4999-9f91-4817b772dc29 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208" status: 200 len: 1688 microversion: 2.1 time: 0.156329 Oct 27 04:52:53.778514 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3954/8205] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:52:53 2022] GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208 => generated 1688 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 04:52:54.802422 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-20e27f4c-d191-47cc-9a22-5c081032e577 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:52:54.803062 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-20e27f4c-d191-47cc-9a22-5c081032e577 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 7c0c3eb0-c985-4ada-a607-ffa4de441208] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:52:54.809867 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-20e27f4c-d191-47cc-9a22-5c081032e577 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:52:54.810402 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-20e27f4c-d191-47cc-9a22-5c081032e577 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:52:54.810863 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-20e27f4c-d191-47cc-9a22-5c081032e577 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:52:54.811580 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-20e27f4c-d191-47cc-9a22-5c081032e577 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:52:54.812056 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-20e27f4c-d191-47cc-9a22-5c081032e577 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:52:54.812504 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-20e27f4c-d191-47cc-9a22-5c081032e577 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:52:54.945282 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-20e27f4c-d191-47cc-9a22-5c081032e577 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:52:54.953747 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-20e27f4c-d191-47cc-9a22-5c081032e577 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208" status: 200 len: 1688 microversion: 2.1 time: 0.155305 Oct 27 04:52:54.954353 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4252/8206] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:52:54 2022] GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208 => generated 1688 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:52:55.977637 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2cbbb4cc-2c23-43fc-a767-95ab5978d28a tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:52:55.978315 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-2cbbb4cc-2c23-43fc-a767-95ab5978d28a tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 7c0c3eb0-c985-4ada-a607-ffa4de441208] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:52:55.985340 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2cbbb4cc-2c23-43fc-a767-95ab5978d28a tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:52:55.990321 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2cbbb4cc-2c23-43fc-a767-95ab5978d28a tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:52:55.990321 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2cbbb4cc-2c23-43fc-a767-95ab5978d28a tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:52:55.990321 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2cbbb4cc-2c23-43fc-a767-95ab5978d28a tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:52:55.990321 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2cbbb4cc-2c23-43fc-a767-95ab5978d28a tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:52:55.990321 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2cbbb4cc-2c23-43fc-a767-95ab5978d28a tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:52:56.122047 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2cbbb4cc-2c23-43fc-a767-95ab5978d28a tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:52:56.129597 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2cbbb4cc-2c23-43fc-a767-95ab5978d28a tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208" status: 200 len: 1688 microversion: 2.1 time: 0.156481 Oct 27 04:52:56.130194 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3955/8207] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:52:55 2022] GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208 => generated 1688 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:52:57.152911 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-739df8dd-09e7-4cf5-9978-c0d5e9557153 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:52:57.153579 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-739df8dd-09e7-4cf5-9978-c0d5e9557153 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 7c0c3eb0-c985-4ada-a607-ffa4de441208] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:52:57.161440 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-739df8dd-09e7-4cf5-9978-c0d5e9557153 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:52:57.161942 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-739df8dd-09e7-4cf5-9978-c0d5e9557153 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:52:57.162428 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-739df8dd-09e7-4cf5-9978-c0d5e9557153 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:52:57.163140 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-739df8dd-09e7-4cf5-9978-c0d5e9557153 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:52:57.163618 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-739df8dd-09e7-4cf5-9978-c0d5e9557153 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:52:57.164060 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-739df8dd-09e7-4cf5-9978-c0d5e9557153 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:52:57.296198 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-739df8dd-09e7-4cf5-9978-c0d5e9557153 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:52:57.304045 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-739df8dd-09e7-4cf5-9978-c0d5e9557153 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208" status: 200 len: 1688 microversion: 2.1 time: 0.155211 Oct 27 04:52:57.306434 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4253/8208] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:52:57 2022] GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208 => generated 1688 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:52:57.459567 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-a86fe16a-8e70-4bf4-8d5f-3fd3c3bf4de2 req-a05d5ffd-3225-4958-85a6-980783a1d0e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c0c3eb0-c985-4ada-a607-ffa4de441208", "name": "network-vif-plugged", "status": "completed", "tag": "67eb8ca1-83f0-47e6-bb86-611a5e23b9df"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:52:57.470589 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-a86fe16a-8e70-4bf4-8d5f-3fd3c3bf4de2 req-a05d5ffd-3225-4958-85a6-980783a1d0e6 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:52:57.473563 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-a86fe16a-8e70-4bf4-8d5f-3fd3c3bf4de2 req-a05d5ffd-3225-4958-85a6-980783a1d0e6 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:52:57.473563 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-a86fe16a-8e70-4bf4-8d5f-3fd3c3bf4de2 req-a05d5ffd-3225-4958-85a6-980783a1d0e6 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:52:57.482887 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-a86fe16a-8e70-4bf4-8d5f-3fd3c3bf4de2 req-a05d5ffd-3225-4958-85a6-980783a1d0e6 service nova] Creating event network-vif-plugged:67eb8ca1-83f0-47e6-bb86-611a5e23b9df for instance 7c0c3eb0-c985-4ada-a607-ffa4de441208 on n-h2-862769-1 Oct 27 04:52:57.488333 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-a86fe16a-8e70-4bf4-8d5f-3fd3c3bf4de2 req-a05d5ffd-3225-4958-85a6-980783a1d0e6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032628 Oct 27 04:52:57.489004 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3956/8209] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:52:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:52:58.328449 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f1fc5c1f-7a65-42e9-8db7-4ddd36b3bbc6 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:52:58.329118 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f1fc5c1f-7a65-42e9-8db7-4ddd36b3bbc6 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 7c0c3eb0-c985-4ada-a607-ffa4de441208] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:52:58.336099 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f1fc5c1f-7a65-42e9-8db7-4ddd36b3bbc6 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:52:58.336604 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f1fc5c1f-7a65-42e9-8db7-4ddd36b3bbc6 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:52:58.337062 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f1fc5c1f-7a65-42e9-8db7-4ddd36b3bbc6 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:52:58.337786 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f1fc5c1f-7a65-42e9-8db7-4ddd36b3bbc6 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:52:58.338295 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f1fc5c1f-7a65-42e9-8db7-4ddd36b3bbc6 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:52:58.338744 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f1fc5c1f-7a65-42e9-8db7-4ddd36b3bbc6 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:52:58.470842 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f1fc5c1f-7a65-42e9-8db7-4ddd36b3bbc6 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:52:58.478716 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f1fc5c1f-7a65-42e9-8db7-4ddd36b3bbc6 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208" status: 200 len: 1688 microversion: 2.1 time: 0.154742 Oct 27 04:52:58.479297 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4254/8210] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:52:58 2022] GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208 => generated 1688 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:52:59.503785 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8a49be1f-6e48-493e-8399-55dfa0333b13 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:52:59.504493 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8a49be1f-6e48-493e-8399-55dfa0333b13 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 7c0c3eb0-c985-4ada-a607-ffa4de441208] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:52:59.511674 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8a49be1f-6e48-493e-8399-55dfa0333b13 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:52:59.512166 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8a49be1f-6e48-493e-8399-55dfa0333b13 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:52:59.512609 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8a49be1f-6e48-493e-8399-55dfa0333b13 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:52:59.513959 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8a49be1f-6e48-493e-8399-55dfa0333b13 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:52:59.514446 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8a49be1f-6e48-493e-8399-55dfa0333b13 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:52:59.514880 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8a49be1f-6e48-493e-8399-55dfa0333b13 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:52:59.654920 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8a49be1f-6e48-493e-8399-55dfa0333b13 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:52:59.663029 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8a49be1f-6e48-493e-8399-55dfa0333b13 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208" status: 200 len: 1688 microversion: 2.1 time: 0.163599 Oct 27 04:52:59.663626 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3957/8211] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:52:59 2022] GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208 => generated 1688 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:53:00.687248 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8bb47fb0-2fe3-41e6-9d7b-fcb828a653d6 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:53:00.687863 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8bb47fb0-2fe3-41e6-9d7b-fcb828a653d6 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 7c0c3eb0-c985-4ada-a607-ffa4de441208] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:53:00.694104 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8bb47fb0-2fe3-41e6-9d7b-fcb828a653d6 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:53:00.694606 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8bb47fb0-2fe3-41e6-9d7b-fcb828a653d6 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:53:00.695060 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8bb47fb0-2fe3-41e6-9d7b-fcb828a653d6 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:53:00.695764 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8bb47fb0-2fe3-41e6-9d7b-fcb828a653d6 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:53:00.696237 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8bb47fb0-2fe3-41e6-9d7b-fcb828a653d6 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:53:00.696682 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8bb47fb0-2fe3-41e6-9d7b-fcb828a653d6 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:53:00.836530 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-8bb47fb0-2fe3-41e6-9d7b-fcb828a653d6 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:53:00.842326 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8bb47fb0-2fe3-41e6-9d7b-fcb828a653d6 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208" status: 200 len: 1675 microversion: 2.1 time: 0.159238 Oct 27 04:53:00.842902 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4255/8212] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:53:00 2022] GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208 => generated 1675 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:54:12.235848 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=17 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:54:12.237108 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=49 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:54:12.241048 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-b269abf2-5247-49f8-a6c6-c9aa24e03a8a req-4cf6b79b-378e-4739-86ff-31e538d9a67e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c0c3eb0-c985-4ada-a607-ffa4de441208", "tag": "67eb8ca1-83f0-47e6-bb86-611a5e23b9df"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:54:12.242969 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a9ba16a7-2cc1-44c2-9d68-10f8532eada9 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:54:12.243477 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a9ba16a7-2cc1-44c2-9d68-10f8532eada9 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 7c0c3eb0-c985-4ada-a607-ffa4de441208] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:54:12.251298 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a9ba16a7-2cc1-44c2-9d68-10f8532eada9 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:54:12.252065 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=17 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:54:12.252219 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a9ba16a7-2cc1-44c2-9d68-10f8532eada9 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:54:12.252720 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a9ba16a7-2cc1-44c2-9d68-10f8532eada9 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:54:12.252847 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=54 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:54:12.253449 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a9ba16a7-2cc1-44c2-9d68-10f8532eada9 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:54:12.253913 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a9ba16a7-2cc1-44c2-9d68-10f8532eada9 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:54:12.254321 n-d-862769-1 devstack@n-api.service[121001]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 04:54:12.254495 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a9ba16a7-2cc1-44c2-9d68-10f8532eada9 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:54:12.254867 n-d-862769-1 devstack@n-api.service[121001]: Thu Oct 27 04:54:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.20) !!! Oct 27 04:54:12.257626 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-b269abf2-5247-49f8-a6c6-c9aa24e03a8a req-4cf6b79b-378e-4739-86ff-31e538d9a67e service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:54:12.258431 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-b269abf2-5247-49f8-a6c6-c9aa24e03a8a req-4cf6b79b-378e-4739-86ff-31e538d9a67e service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:54:12.259193 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-b269abf2-5247-49f8-a6c6-c9aa24e03a8a req-4cf6b79b-378e-4739-86ff-31e538d9a67e service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:54:12.272918 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-b269abf2-5247-49f8-a6c6-c9aa24e03a8a req-4cf6b79b-378e-4739-86ff-31e538d9a67e service nova] Creating event network-changed:67eb8ca1-83f0-47e6-bb86-611a5e23b9df for instance 7c0c3eb0-c985-4ada-a607-ffa4de441208 on n-h2-862769-1 Oct 27 04:54:12.285129 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-b269abf2-5247-49f8-a6c6-c9aa24e03a8a req-4cf6b79b-378e-4739-86ff-31e538d9a67e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049221 Oct 27 04:54:12.285880 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4256/8213] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:54:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:54:12.562804 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a9ba16a7-2cc1-44c2-9d68-10f8532eada9 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 7c0c3eb0-c985-4ada-a607-ffa4de441208] Going to try to terminate instance {{(pid=121000) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 04:54:12.842357 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a9ba16a7-2cc1-44c2-9d68-10f8532eada9 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208" status: 204 len: 0 microversion: 2.1 time: 0.608749 Oct 27 04:54:12.843509 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3958/8214] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 04:54:12 2022] DELETE /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208 => generated 0 bytes in 611 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 04:54:12.852419 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-e07bd9e5-a82f-4006-aa00-1770d39b54aa tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:54:12.853269 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-e07bd9e5-a82f-4006-aa00-1770d39b54aa tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 7c0c3eb0-c985-4ada-a607-ffa4de441208] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:54:12.862689 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e07bd9e5-a82f-4006-aa00-1770d39b54aa tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:54:12.862893 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e07bd9e5-a82f-4006-aa00-1770d39b54aa tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:54:12.863491 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e07bd9e5-a82f-4006-aa00-1770d39b54aa tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:54:12.864226 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e07bd9e5-a82f-4006-aa00-1770d39b54aa tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:54:12.864710 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e07bd9e5-a82f-4006-aa00-1770d39b54aa tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:54:12.865170 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-e07bd9e5-a82f-4006-aa00-1770d39b54aa tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:54:13.004846 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-e07bd9e5-a82f-4006-aa00-1770d39b54aa tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:54:13.012948 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-e07bd9e5-a82f-4006-aa00-1770d39b54aa tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208" status: 200 len: 1681 microversion: 2.1 time: 0.164767 Oct 27 04:54:13.013600 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4257/8215] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:54:12 2022] GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208 => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:54:14.037145 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5c8509b1-938e-4bce-961b-b6072716da67 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:54:14.037842 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5c8509b1-938e-4bce-961b-b6072716da67 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 7c0c3eb0-c985-4ada-a607-ffa4de441208] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:54:14.044983 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5c8509b1-938e-4bce-961b-b6072716da67 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:54:14.045479 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5c8509b1-938e-4bce-961b-b6072716da67 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:54:14.046471 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5c8509b1-938e-4bce-961b-b6072716da67 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:54:14.047203 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5c8509b1-938e-4bce-961b-b6072716da67 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:54:14.047691 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5c8509b1-938e-4bce-961b-b6072716da67 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:54:14.048121 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5c8509b1-938e-4bce-961b-b6072716da67 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:54:14.579004 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5c8509b1-938e-4bce-961b-b6072716da67 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:54:14.587052 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5c8509b1-938e-4bce-961b-b6072716da67 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208" status: 200 len: 1562 microversion: 2.1 time: 0.554122 Oct 27 04:54:14.587727 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3959/8216] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:54:14 2022] GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208 => generated 1562 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 04:54:15.047432 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-367abf57-8b53-4a96-8b26-4e96e5034368 req-5c2b3bd7-262e-4707-8bb3-0fe888975b28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c0c3eb0-c985-4ada-a607-ffa4de441208", "name": "network-vif-deleted", "tag": "67eb8ca1-83f0-47e6-bb86-611a5e23b9df"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:54:15.058519 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-367abf57-8b53-4a96-8b26-4e96e5034368 req-5c2b3bd7-262e-4707-8bb3-0fe888975b28 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:54:15.059017 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-367abf57-8b53-4a96-8b26-4e96e5034368 req-5c2b3bd7-262e-4707-8bb3-0fe888975b28 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:54:15.059470 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-367abf57-8b53-4a96-8b26-4e96e5034368 req-5c2b3bd7-262e-4707-8bb3-0fe888975b28 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:54:15.072063 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-367abf57-8b53-4a96-8b26-4e96e5034368 req-5c2b3bd7-262e-4707-8bb3-0fe888975b28 service nova] Creating event network-vif-deleted:67eb8ca1-83f0-47e6-bb86-611a5e23b9df for instance 7c0c3eb0-c985-4ada-a607-ffa4de441208 on n-h2-862769-1 Oct 27 04:54:15.077962 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-367abf57-8b53-4a96-8b26-4e96e5034368 req-5c2b3bd7-262e-4707-8bb3-0fe888975b28 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033760 Oct 27 04:54:15.078650 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4258/8217] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:54:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:54:15.611104 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e8cd390f-4c1d-46cc-99ba-c2b03f475b50 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:54:15.611727 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e8cd390f-4c1d-46cc-99ba-c2b03f475b50 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 7c0c3eb0-c985-4ada-a607-ffa4de441208] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:54:15.618201 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e8cd390f-4c1d-46cc-99ba-c2b03f475b50 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:54:15.618701 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e8cd390f-4c1d-46cc-99ba-c2b03f475b50 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:54:15.619147 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e8cd390f-4c1d-46cc-99ba-c2b03f475b50 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:54:15.619850 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e8cd390f-4c1d-46cc-99ba-c2b03f475b50 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:54:15.620309 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e8cd390f-4c1d-46cc-99ba-c2b03f475b50 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:54:15.620743 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e8cd390f-4c1d-46cc-99ba-c2b03f475b50 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:54:15.651382 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e8cd390f-4c1d-46cc-99ba-c2b03f475b50 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:54:15.651870 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e8cd390f-4c1d-46cc-99ba-c2b03f475b50 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:54:15.652314 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e8cd390f-4c1d-46cc-99ba-c2b03f475b50 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:54:15.652767 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-e8cd390f-4c1d-46cc-99ba-c2b03f475b50 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lazy-loading 'fault' on Instance uuid 7c0c3eb0-c985-4ada-a607-ffa4de441208 {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 04:54:15.696772 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e8cd390f-4c1d-46cc-99ba-c2b03f475b50 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:54:15.712520 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e8cd390f-4c1d-46cc-99ba-c2b03f475b50 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208" status: 200 len: 1336 microversion: 2.1 time: 0.098111 Oct 27 04:54:15.712520 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3960/8218] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:54:15 2022] GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208 => generated 1336 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:54:16.730623 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8f84997f-822d-42e4-b014-7c36447fd270 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:54:16.731383 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-8f84997f-822d-42e4-b014-7c36447fd270 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 7c0c3eb0-c985-4ada-a607-ffa4de441208] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:54:16.737573 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8f84997f-822d-42e4-b014-7c36447fd270 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:54:16.738383 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8f84997f-822d-42e4-b014-7c36447fd270 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:54:16.738849 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8f84997f-822d-42e4-b014-7c36447fd270 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:54:16.739565 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8f84997f-822d-42e4-b014-7c36447fd270 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:54:16.740051 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8f84997f-822d-42e4-b014-7c36447fd270 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:54:16.740499 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-8f84997f-822d-42e4-b014-7c36447fd270 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:54:16.754656 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-8f84997f-822d-42e4-b014-7c36447fd270 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] HTTP exception thrown: Instance 7c0c3eb0-c985-4ada-a607-ffa4de441208 could not be found. Oct 27 04:54:16.756454 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8f84997f-822d-42e4-b014-7c36447fd270 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Request method failure captured: Oct 27 04:54:16.756454 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208 HTTP/1.1 Oct 27 04:54:16.756454 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 04:54:16.756454 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 04:54:16.756454 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 04:54:16.756454 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 04:54:16.756454 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 04:54:16.756454 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 04:54:16.756454 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 04:54:16.756454 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 04:54:16.756454 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWg3wZd668Km9eBpgCnewvI35O-x4t570_exVRnIpm4-Yt_QKmkRLStTkx7BoSTPkYm0Khl4gG2-Zs7ZYinjbZ3WaFXtcG_4gzBc1l7YkcL2i0RAvB3cyJ_OSzPOta8WYu9CotPm1-bPRUyjm7AfRqjjYKzLv2KfqmDpwf25pTKb4rao Oct 27 04:54:16.756454 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 04:54:16.756454 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 04:54:16.756454 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 04:54:16.756454 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 04:54:16.756454 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 04:54:16.756454 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 04:54:16.756454 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 206d2ec543a34682a5ec39023ffa2c90 Oct 27 04:54:16.756454 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-TestShelveInstance-1609444603 Oct 27 04:54:16.756454 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 04:54:16.756454 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 04:54:16.756454 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/206d2ec543a34682a5ec39023ffa2c90"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/206d2ec543a34682a5ec39023ffa2c90"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/206d2ec543a34682a5ec39023ffa2c90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_206d2ec543a34682a5ec39023ffa2c90"}]}] Oct 27 04:54:16.756454 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-TestShelveInstance-1609444603 Oct 27 04:54:16.756454 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 206d2ec543a34682a5ec39023ffa2c90 Oct 27 04:54:16.756454 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-TestShelveInstance-1609444603 Oct 27 04:54:16.756454 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-TestShelveInstance-1609444603-project Oct 27 04:54:16.756454 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 04:54:16.756454 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 04:54:16.756454 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 0801f524d46d447c9dc052189e964abf Oct 27 04:54:16.756454 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-TestShelveInstance-1609444603-project Oct 27 04:54:16.756454 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 04:54:16.756454 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 7c0c3eb0-c985-4ada-a607-ffa4de441208 could not be found. Oct 27 04:54:16.756454 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '7c0c3eb0-c985-4ada-a607-ffa4de441208'} Oct 27 04:54:16.756454 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 04:54:16.756454 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:54:16.756454 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 04:54:16.756454 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 04:54:16.756454 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 04:54:16.756454 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 04:54:16.756454 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 04:54:16.756454 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 04:54:16.756454 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 04:54:16.756454 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 04:54:16.756454 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c0c3eb0-c985-4ada-a607-ffa4de441208 could not be found. Oct 27 04:54:16.756454 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:54:16.756454 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:54:16.756454 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:54:16.756454 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:54:16.756454 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:54:16.756454 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:54:16.756454 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 04:54:16.756454 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 04:54:16.756454 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 04:54:16.756454 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 04:54:16.756454 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 04:54:16.756454 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 04:54:16.756454 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 04:54:16.756454 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 04:54:16.756454 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 04:54:16.756454 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 04:54:16.756454 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c0c3eb0-c985-4ada-a607-ffa4de441208 could not be found. Oct 27 04:54:16.756454 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:54:16.756454 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:54:16.756454 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:54:16.767706 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:54:16.767706 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:54:16.767706 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:54:16.767706 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 04:54:16.767706 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 04:54:16.767706 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c0c3eb0-c985-4ada-a607-ffa4de441208 could not be found. Oct 27 04:54:16.767706 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:54:16.767706 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-8f84997f-822d-42e4-b014-7c36447fd270 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Returning 404 to user: Instance 7c0c3eb0-c985-4ada-a607-ffa4de441208 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 04:54:16.767706 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-8f84997f-822d-42e4-b014-7c36447fd270 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208" status: 404 len: 111 microversion: 2.1 time: 0.032525 Oct 27 04:54:16.767706 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4259/8219] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:54:16 2022] GET /compute/v2.1/servers/7c0c3eb0-c985-4ada-a607-ffa4de441208 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 04:54:16.979068 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-88a493ef-528f-4c61-bdd9-b7c5003f1ef0 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '.version_select at 0x7f7dd98b00d0>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:54:17.086232 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-88a493ef-528f-4c61-bdd9-b7c5003f1ef0 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-131817434" status: 202 len: 0 microversion: 2.1 time: 0.111101 Oct 27 04:54:17.086866 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3961/8220] 10.222.0.20 () {58 vars in 1251 bytes} [Thu Oct 27 04:54:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-131817434 => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 04:54:17.111760 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-defaecef-acfd-4d4f-8405-83125a90ed2c tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Action: 'create', calling method: .version_select at 0x7f7dd9b81b80>, body: {"keypair": {"name": "tempest-TestShelveInstance-883100799", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKeQxBVDzokG9xa29EdjY2whplmpfutlLtGni70n7NYxbRyTy61ow1QP9ZdV0PuT0XwowELYNbf+Jsg0XwgV1YkEujyVyfa7YzXsdQxaSc3yt8ca9jEo1OGF8T4sWM4+5A=="}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:54:17.128138 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-defaecef-acfd-4d4f-8405-83125a90ed2c tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Getting quotas for project 206d2ec543a34682a5ec39023ffa2c90. Resources: {'key_pairs'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 04:54:17.133464 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-defaecef-acfd-4d4f-8405-83125a90ed2c tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Getting quotas for user 0801f524d46d447c9dc052189e964abf and project 206d2ec543a34682a5ec39023ffa2c90. Resources: {'key_pairs'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 04:54:17.226721 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-defaecef-acfd-4d4f-8405-83125a90ed2c tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.119367 Oct 27 04:54:17.227331 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4260/8221] 10.222.0.20 () {60 vars in 1159 bytes} [Thu Oct 27 04:54:17 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 04:54:40.504890 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-58517a9f-7b49-45a8-9adb-5c4ba94473d8 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1087365479", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-883100799", "security_groups": [{"name": "tempest-secgroup-smoke-1370043678"}], "networks": [{"uuid": "d18bb85c-5db2-4e8e-a2ee-2219ac031c83"}], "block_device_mapping_v2": [{"uuid": "d518e2bb-b7dd-45f3-b95c-b63be7849b95", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:54:40.516555 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:54:40.517299 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:54:40.619503 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-58517a9f-7b49-45a8-9adb-5c4ba94473d8 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] validate_networks() for [('d18bb85c-5db2-4e8e-a2ee-2219ac031c83', None, None, None, None, None)] {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 04:54:41.004271 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-58517a9f-7b49-45a8-9adb-5c4ba94473d8 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 04:54:41.004742 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-58517a9f-7b49-45a8-9adb-5c4ba94473d8 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 04:54:41.005231 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-58517a9f-7b49-45a8-9adb-5c4ba94473d8 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 04:54:41.005655 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-58517a9f-7b49-45a8-9adb-5c4ba94473d8 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 04:54:41.006107 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-58517a9f-7b49-45a8-9adb-5c4ba94473d8 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 04:54:41.014911 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-58517a9f-7b49-45a8-9adb-5c4ba94473d8 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:54:41.015402 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-58517a9f-7b49-45a8-9adb-5c4ba94473d8 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:54:41.016352 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-58517a9f-7b49-45a8-9adb-5c4ba94473d8 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:54:41.017107 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-58517a9f-7b49-45a8-9adb-5c4ba94473d8 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:54:41.017644 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-58517a9f-7b49-45a8-9adb-5c4ba94473d8 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:54:41.018010 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-58517a9f-7b49-45a8-9adb-5c4ba94473d8 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:54:41.036213 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-58517a9f-7b49-45a8-9adb-5c4ba94473d8 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Getting quotas for project 206d2ec543a34682a5ec39023ffa2c90. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 04:54:41.041427 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-58517a9f-7b49-45a8-9adb-5c4ba94473d8 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Getting quotas for user 0801f524d46d447c9dc052189e964abf and project 206d2ec543a34682a5ec39023ffa2c90. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 04:54:41.098492 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-58517a9f-7b49-45a8-9adb-5c4ba94473d8 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 04:54:41.100644 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-58517a9f-7b49-45a8-9adb-5c4ba94473d8 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 03c10791-1496-4e0f-971b-1a259257b6f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d518e2bb-b7dd-45f3-b95c-b63be7849b95',volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 04:54:41.460905 n-d-862769-1 devstack@n-api.service[121000]: ERROR oslo.messaging._drivers.impl_rabbit [None req-58517a9f-7b49-45a8-9adb-5c4ba94473d8 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [d1e0fee0-c007-4f4b-8cac-c2d0a8595428] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 27 04:54:42.468307 n-d-862769-1 devstack@n-api.service[121000]: INFO oslo.messaging._drivers.impl_rabbit [None req-58517a9f-7b49-45a8-9adb-5c4ba94473d8 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [d1e0fee0-c007-4f4b-8cac-c2d0a8595428] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 60134. Oct 27 04:54:42.472840 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-58517a9f-7b49-45a8-9adb-5c4ba94473d8 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.972660 Oct 27 04:54:42.473504 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3962/8222] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 04:54:40 2022] POST /compute/v2.1/servers => generated 406 bytes in 1974 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 04:54:42.484673 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-20641070-1d5b-41cf-8d05-12607be53161 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:54:42.485320 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-20641070-1d5b-41cf-8d05-12607be53161 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 03c10791-1496-4e0f-971b-1a259257b6f1] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:54:42.488673 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=12 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:54:42.490602 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=4 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:54:42.491090 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:54:42.547366 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-20641070-1d5b-41cf-8d05-12607be53161 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:54:42.554890 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-20641070-1d5b-41cf-8d05-12607be53161 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1" status: 200 len: 1088 microversion: 2.1 time: 0.073998 Oct 27 04:54:42.558143 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4261/8223] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:54:42 2022] GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1 => generated 1088 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:54:43.579438 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-791558f5-f6d6-4f2c-a1df-16a43db8ef1e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:54:43.580034 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-791558f5-f6d6-4f2c-a1df-16a43db8ef1e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 03c10791-1496-4e0f-971b-1a259257b6f1] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:54:43.586139 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-791558f5-f6d6-4f2c-a1df-16a43db8ef1e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:54:43.589239 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-791558f5-f6d6-4f2c-a1df-16a43db8ef1e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:54:43.589239 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-791558f5-f6d6-4f2c-a1df-16a43db8ef1e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:54:43.589239 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-791558f5-f6d6-4f2c-a1df-16a43db8ef1e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:54:43.589239 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-791558f5-f6d6-4f2c-a1df-16a43db8ef1e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:54:43.589239 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-791558f5-f6d6-4f2c-a1df-16a43db8ef1e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:54:43.651916 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-791558f5-f6d6-4f2c-a1df-16a43db8ef1e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:54:43.660284 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-791558f5-f6d6-4f2c-a1df-16a43db8ef1e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1" status: 200 len: 1130 microversion: 2.1 time: 0.086267 Oct 27 04:54:43.660863 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3963/8224] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:54:43 2022] GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1 => generated 1130 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:54:44.684029 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ba4192d0-bb7e-4291-b981-7e42964ba624 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:54:44.684694 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ba4192d0-bb7e-4291-b981-7e42964ba624 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 03c10791-1496-4e0f-971b-1a259257b6f1] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:54:44.693223 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ba4192d0-bb7e-4291-b981-7e42964ba624 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:54:44.693802 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ba4192d0-bb7e-4291-b981-7e42964ba624 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:54:44.694227 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ba4192d0-bb7e-4291-b981-7e42964ba624 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:54:44.701235 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ba4192d0-bb7e-4291-b981-7e42964ba624 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:54:44.701235 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ba4192d0-bb7e-4291-b981-7e42964ba624 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:54:44.701235 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ba4192d0-bb7e-4291-b981-7e42964ba624 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:54:44.760316 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ba4192d0-bb7e-4291-b981-7e42964ba624 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:54:44.768225 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ba4192d0-bb7e-4291-b981-7e42964ba624 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1" status: 200 len: 1204 microversion: 2.1 time: 0.088441 Oct 27 04:54:44.769191 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4262/8225] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:54:44 2022] GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1 => generated 1204 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 04:54:45.794127 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7134dbb4-6956-4dee-bda5-f3592a2d70fd tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:54:45.794734 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7134dbb4-6956-4dee-bda5-f3592a2d70fd tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 03c10791-1496-4e0f-971b-1a259257b6f1] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:54:45.801466 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7134dbb4-6956-4dee-bda5-f3592a2d70fd tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:54:45.802280 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7134dbb4-6956-4dee-bda5-f3592a2d70fd tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:54:45.802927 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7134dbb4-6956-4dee-bda5-f3592a2d70fd tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:54:45.803647 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7134dbb4-6956-4dee-bda5-f3592a2d70fd tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:54:45.804116 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7134dbb4-6956-4dee-bda5-f3592a2d70fd tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:54:45.804552 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7134dbb4-6956-4dee-bda5-f3592a2d70fd tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:54:45.956407 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7134dbb4-6956-4dee-bda5-f3592a2d70fd tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:54:45.964595 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7134dbb4-6956-4dee-bda5-f3592a2d70fd tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1" status: 200 len: 1272 microversion: 2.1 time: 0.174652 Oct 27 04:54:45.981280 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3964/8226] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:54:45 2022] GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1 => generated 1272 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:54:46.518469 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-a1acc26f-f2c9-4498-9302-8e6832326882 req-bfd958b3-04bd-4ab2-8d31-265d25c161a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03c10791-1496-4e0f-971b-1a259257b6f1", "tag": "755255e7-c643-4a62-9b7e-292b565af498"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:54:46.531155 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-a1acc26f-f2c9-4498-9302-8e6832326882 req-bfd958b3-04bd-4ab2-8d31-265d25c161a0 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:54:46.531908 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-a1acc26f-f2c9-4498-9302-8e6832326882 req-bfd958b3-04bd-4ab2-8d31-265d25c161a0 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:54:46.533211 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-a1acc26f-f2c9-4498-9302-8e6832326882 req-bfd958b3-04bd-4ab2-8d31-265d25c161a0 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:54:46.544668 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-a1acc26f-f2c9-4498-9302-8e6832326882 req-bfd958b3-04bd-4ab2-8d31-265d25c161a0 service nova] Creating event network-changed:755255e7-c643-4a62-9b7e-292b565af498 for instance 03c10791-1496-4e0f-971b-1a259257b6f1 on n-h1-862769-1 Oct 27 04:54:46.550121 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-a1acc26f-f2c9-4498-9302-8e6832326882 req-bfd958b3-04bd-4ab2-8d31-265d25c161a0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043598 Oct 27 04:54:46.551212 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4263/8227] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:54:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:54:46.990203 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-bacb804b-ab77-4544-9d36-bdd51c9db1ee tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:54:46.991611 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-bacb804b-ab77-4544-9d36-bdd51c9db1ee tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 03c10791-1496-4e0f-971b-1a259257b6f1] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:54:46.999846 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bacb804b-ab77-4544-9d36-bdd51c9db1ee tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:54:47.000348 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bacb804b-ab77-4544-9d36-bdd51c9db1ee tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:54:47.001367 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bacb804b-ab77-4544-9d36-bdd51c9db1ee tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:54:47.002413 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bacb804b-ab77-4544-9d36-bdd51c9db1ee tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:54:47.002963 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bacb804b-ab77-4544-9d36-bdd51c9db1ee tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:54:47.003395 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-bacb804b-ab77-4544-9d36-bdd51c9db1ee tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:54:47.146396 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-bacb804b-ab77-4544-9d36-bdd51c9db1ee tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:54:47.155823 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-bacb804b-ab77-4544-9d36-bdd51c9db1ee tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1" status: 200 len: 1272 microversion: 2.1 time: 0.170776 Oct 27 04:54:47.156556 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3965/8228] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:54:46 2022] GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1 => generated 1272 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:54:48.180784 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ab622187-3ec6-45ea-851a-1ec4334a9eb5 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:54:48.181462 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ab622187-3ec6-45ea-851a-1ec4334a9eb5 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 03c10791-1496-4e0f-971b-1a259257b6f1] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:54:48.189648 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ab622187-3ec6-45ea-851a-1ec4334a9eb5 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:54:48.190336 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ab622187-3ec6-45ea-851a-1ec4334a9eb5 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:54:48.190811 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ab622187-3ec6-45ea-851a-1ec4334a9eb5 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:54:48.191624 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ab622187-3ec6-45ea-851a-1ec4334a9eb5 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:54:48.192183 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ab622187-3ec6-45ea-851a-1ec4334a9eb5 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:54:48.192710 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ab622187-3ec6-45ea-851a-1ec4334a9eb5 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:54:48.326754 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ab622187-3ec6-45ea-851a-1ec4334a9eb5 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:54:48.335317 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ab622187-3ec6-45ea-851a-1ec4334a9eb5 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1" status: 200 len: 1272 microversion: 2.1 time: 0.159824 Oct 27 04:54:48.335899 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4264/8229] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:54:48 2022] GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1 => generated 1272 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:54:49.358924 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-8889c0b3-88a8-44bb-bef6-66e468a42f9e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:54:49.359554 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-8889c0b3-88a8-44bb-bef6-66e468a42f9e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 03c10791-1496-4e0f-971b-1a259257b6f1] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:54:49.366699 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8889c0b3-88a8-44bb-bef6-66e468a42f9e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:54:49.367189 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8889c0b3-88a8-44bb-bef6-66e468a42f9e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:54:49.367641 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8889c0b3-88a8-44bb-bef6-66e468a42f9e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:54:49.368351 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8889c0b3-88a8-44bb-bef6-66e468a42f9e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:54:49.368820 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8889c0b3-88a8-44bb-bef6-66e468a42f9e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:54:49.369256 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-8889c0b3-88a8-44bb-bef6-66e468a42f9e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:54:49.501943 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-8889c0b3-88a8-44bb-bef6-66e468a42f9e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:54:49.509707 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-8889c0b3-88a8-44bb-bef6-66e468a42f9e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1" status: 200 len: 1272 microversion: 2.1 time: 0.154798 Oct 27 04:54:49.510310 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3966/8230] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:54:49 2022] GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1 => generated 1272 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:54:50.545820 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-016c8bb9-708a-4599-8aaa-785d95d16ff3 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:54:50.546498 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-016c8bb9-708a-4599-8aaa-785d95d16ff3 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 03c10791-1496-4e0f-971b-1a259257b6f1] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:54:50.553440 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-016c8bb9-708a-4599-8aaa-785d95d16ff3 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:54:50.553944 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-016c8bb9-708a-4599-8aaa-785d95d16ff3 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:54:50.554429 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-016c8bb9-708a-4599-8aaa-785d95d16ff3 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:54:50.555146 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-016c8bb9-708a-4599-8aaa-785d95d16ff3 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:54:50.555620 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-016c8bb9-708a-4599-8aaa-785d95d16ff3 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:54:50.556069 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-016c8bb9-708a-4599-8aaa-785d95d16ff3 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:54:50.698202 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-016c8bb9-708a-4599-8aaa-785d95d16ff3 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:54:50.706271 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-016c8bb9-708a-4599-8aaa-785d95d16ff3 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1" status: 200 len: 1260 microversion: 2.1 time: 0.164352 Oct 27 04:54:50.706884 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4265/8231] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:54:50 2022] GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1 => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:54:51.729131 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-5b8cc5da-9c1a-4863-93a2-0befb60d47f5 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:54:51.729759 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-5b8cc5da-9c1a-4863-93a2-0befb60d47f5 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 03c10791-1496-4e0f-971b-1a259257b6f1] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:54:51.732498 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:54:51.733315 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=6 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:54:51.737944 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5b8cc5da-9c1a-4863-93a2-0befb60d47f5 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:54:51.738735 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5b8cc5da-9c1a-4863-93a2-0befb60d47f5 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:54:51.739186 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5b8cc5da-9c1a-4863-93a2-0befb60d47f5 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:54:51.739890 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5b8cc5da-9c1a-4863-93a2-0befb60d47f5 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:54:51.740356 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5b8cc5da-9c1a-4863-93a2-0befb60d47f5 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:54:51.740793 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-5b8cc5da-9c1a-4863-93a2-0befb60d47f5 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:54:51.874662 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-5b8cc5da-9c1a-4863-93a2-0befb60d47f5 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:54:51.882916 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-5b8cc5da-9c1a-4863-93a2-0befb60d47f5 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1" status: 200 len: 1260 microversion: 2.1 time: 0.157694 Oct 27 04:54:51.883497 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3967/8232] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:54:51 2022] GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:54:52.906443 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-db53f9fe-da4b-475a-b7bf-bdee69da880a tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:54:52.907009 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-db53f9fe-da4b-475a-b7bf-bdee69da880a tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 03c10791-1496-4e0f-971b-1a259257b6f1] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:54:52.910424 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:54:52.915468 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-db53f9fe-da4b-475a-b7bf-bdee69da880a tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:54:52.915976 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-db53f9fe-da4b-475a-b7bf-bdee69da880a tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:54:52.916494 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-db53f9fe-da4b-475a-b7bf-bdee69da880a tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:54:52.917267 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-db53f9fe-da4b-475a-b7bf-bdee69da880a tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:54:52.917745 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-db53f9fe-da4b-475a-b7bf-bdee69da880a tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:54:52.918230 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-db53f9fe-da4b-475a-b7bf-bdee69da880a tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:54:53.052442 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-db53f9fe-da4b-475a-b7bf-bdee69da880a tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:54:53.060606 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-db53f9fe-da4b-475a-b7bf-bdee69da880a tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1" status: 200 len: 1260 microversion: 2.1 time: 0.158198 Oct 27 04:54:53.061188 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4266/8233] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:54:52 2022] GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:54:54.084427 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-3ec34a75-67e5-418e-adbb-7e40a16c004e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:54:54.085058 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-3ec34a75-67e5-418e-adbb-7e40a16c004e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 03c10791-1496-4e0f-971b-1a259257b6f1] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:54:54.091973 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3ec34a75-67e5-418e-adbb-7e40a16c004e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:54:54.092470 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3ec34a75-67e5-418e-adbb-7e40a16c004e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:54:54.092972 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3ec34a75-67e5-418e-adbb-7e40a16c004e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:54:54.093683 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3ec34a75-67e5-418e-adbb-7e40a16c004e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:54:54.094175 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3ec34a75-67e5-418e-adbb-7e40a16c004e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:54:54.094622 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-3ec34a75-67e5-418e-adbb-7e40a16c004e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:54:54.224675 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-3ec34a75-67e5-418e-adbb-7e40a16c004e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:54:54.232448 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-3ec34a75-67e5-418e-adbb-7e40a16c004e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1" status: 200 len: 1260 microversion: 2.1 time: 0.152735 Oct 27 04:54:54.233019 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3968/8234] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:54:54 2022] GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:54:55.255774 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-22b88bcf-01af-4b18-a59f-1bf8518f8b1f tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:54:55.256415 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-22b88bcf-01af-4b18-a59f-1bf8518f8b1f tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 03c10791-1496-4e0f-971b-1a259257b6f1] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:54:55.263367 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-22b88bcf-01af-4b18-a59f-1bf8518f8b1f tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:54:55.263869 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-22b88bcf-01af-4b18-a59f-1bf8518f8b1f tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:54:55.264329 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-22b88bcf-01af-4b18-a59f-1bf8518f8b1f tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:54:55.265044 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-22b88bcf-01af-4b18-a59f-1bf8518f8b1f tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:54:55.265524 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-22b88bcf-01af-4b18-a59f-1bf8518f8b1f tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:54:55.265975 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-22b88bcf-01af-4b18-a59f-1bf8518f8b1f tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:54:55.397869 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-22b88bcf-01af-4b18-a59f-1bf8518f8b1f tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:54:55.405565 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-22b88bcf-01af-4b18-a59f-1bf8518f8b1f tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1" status: 200 len: 1260 microversion: 2.1 time: 0.153816 Oct 27 04:54:55.406175 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4267/8235] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:54:55 2022] GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:54:56.429295 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e51e94f1-a1e1-4889-8ada-71f9c106ea90 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:54:56.429910 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e51e94f1-a1e1-4889-8ada-71f9c106ea90 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 03c10791-1496-4e0f-971b-1a259257b6f1] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:54:56.436884 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e51e94f1-a1e1-4889-8ada-71f9c106ea90 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:54:56.437313 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e51e94f1-a1e1-4889-8ada-71f9c106ea90 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:54:56.437751 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e51e94f1-a1e1-4889-8ada-71f9c106ea90 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:54:56.438491 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e51e94f1-a1e1-4889-8ada-71f9c106ea90 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:54:56.438952 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e51e94f1-a1e1-4889-8ada-71f9c106ea90 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:54:56.439416 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e51e94f1-a1e1-4889-8ada-71f9c106ea90 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:54:56.571788 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e51e94f1-a1e1-4889-8ada-71f9c106ea90 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:54:56.579492 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e51e94f1-a1e1-4889-8ada-71f9c106ea90 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1" status: 200 len: 1260 microversion: 2.1 time: 0.154081 Oct 27 04:54:56.580719 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3969/8236] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:54:56 2022] GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:54:57.603214 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d7ea7c37-9bdf-436f-9a49-08230933f41b tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:54:57.603866 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d7ea7c37-9bdf-436f-9a49-08230933f41b tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 03c10791-1496-4e0f-971b-1a259257b6f1] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:54:57.610781 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d7ea7c37-9bdf-436f-9a49-08230933f41b tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:54:57.611793 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d7ea7c37-9bdf-436f-9a49-08230933f41b tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:54:57.612257 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d7ea7c37-9bdf-436f-9a49-08230933f41b tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:54:57.612973 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d7ea7c37-9bdf-436f-9a49-08230933f41b tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:54:57.613694 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d7ea7c37-9bdf-436f-9a49-08230933f41b tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:54:57.614191 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d7ea7c37-9bdf-436f-9a49-08230933f41b tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:54:57.742986 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d7ea7c37-9bdf-436f-9a49-08230933f41b tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:54:57.750670 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d7ea7c37-9bdf-436f-9a49-08230933f41b tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1" status: 200 len: 1260 microversion: 2.1 time: 0.151412 Oct 27 04:54:57.751248 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4268/8237] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:54:57 2022] GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 04:54:58.828800 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-40ef7f9d-3a44-4956-bb37-c8a90db8a005 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:54:58.829435 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-40ef7f9d-3a44-4956-bb37-c8a90db8a005 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 03c10791-1496-4e0f-971b-1a259257b6f1] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:54:58.836068 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-40ef7f9d-3a44-4956-bb37-c8a90db8a005 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:54:58.841545 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-40ef7f9d-3a44-4956-bb37-c8a90db8a005 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:54:58.841545 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-40ef7f9d-3a44-4956-bb37-c8a90db8a005 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:54:58.841545 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-40ef7f9d-3a44-4956-bb37-c8a90db8a005 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:54:58.841545 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-40ef7f9d-3a44-4956-bb37-c8a90db8a005 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:54:58.841545 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-40ef7f9d-3a44-4956-bb37-c8a90db8a005 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:54:58.974519 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-40ef7f9d-3a44-4956-bb37-c8a90db8a005 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:54:58.982919 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-40ef7f9d-3a44-4956-bb37-c8a90db8a005 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1" status: 200 len: 1260 microversion: 2.1 time: 0.211893 Oct 27 04:54:58.983182 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3970/8238] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:54:58 2022] GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1 => generated 1260 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:55:00.006476 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b8d2462c-1ef1-41d0-bbdf-4ac69dbdb397 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:55:00.007123 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b8d2462c-1ef1-41d0-bbdf-4ac69dbdb397 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 03c10791-1496-4e0f-971b-1a259257b6f1] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:55:00.013442 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b8d2462c-1ef1-41d0-bbdf-4ac69dbdb397 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:55:00.013947 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b8d2462c-1ef1-41d0-bbdf-4ac69dbdb397 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:55:00.014442 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b8d2462c-1ef1-41d0-bbdf-4ac69dbdb397 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:55:00.015169 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b8d2462c-1ef1-41d0-bbdf-4ac69dbdb397 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:55:00.015647 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b8d2462c-1ef1-41d0-bbdf-4ac69dbdb397 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:55:00.016099 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b8d2462c-1ef1-41d0-bbdf-4ac69dbdb397 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:55:00.152881 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b8d2462c-1ef1-41d0-bbdf-4ac69dbdb397 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:55:00.160582 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b8d2462c-1ef1-41d0-bbdf-4ac69dbdb397 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1" status: 200 len: 1260 microversion: 2.1 time: 0.157989 Oct 27 04:55:00.161177 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4269/8239] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:55:00 2022] GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:55:01.187754 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-db6eace9-9cf4-4854-af1f-13b6575f776b tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:55:01.188379 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-db6eace9-9cf4-4854-af1f-13b6575f776b tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 03c10791-1496-4e0f-971b-1a259257b6f1] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:55:01.195455 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-db6eace9-9cf4-4854-af1f-13b6575f776b tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:55:01.195947 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-db6eace9-9cf4-4854-af1f-13b6575f776b tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:55:01.196390 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-db6eace9-9cf4-4854-af1f-13b6575f776b tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:55:01.197088 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-db6eace9-9cf4-4854-af1f-13b6575f776b tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:55:01.197547 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-db6eace9-9cf4-4854-af1f-13b6575f776b tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:55:01.197976 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-db6eace9-9cf4-4854-af1f-13b6575f776b tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:55:01.326253 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-db6eace9-9cf4-4854-af1f-13b6575f776b tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:55:01.334332 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-db6eace9-9cf4-4854-af1f-13b6575f776b tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1" status: 200 len: 1260 microversion: 2.1 time: 0.150535 Oct 27 04:55:01.334906 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3971/8240] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:55:01 2022] GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:55:02.241403 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-ffff41b1-f3bd-477c-9dc1-868b8e3c4a24 req-f7fa6c7c-8913-44f7-b9b3-303cf05a13f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03c10791-1496-4e0f-971b-1a259257b6f1", "name": "network-vif-plugged", "status": "completed", "tag": "755255e7-c643-4a62-9b7e-292b565af498"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:55:02.251170 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-ffff41b1-f3bd-477c-9dc1-868b8e3c4a24 req-f7fa6c7c-8913-44f7-b9b3-303cf05a13f4 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:55:02.252309 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-ffff41b1-f3bd-477c-9dc1-868b8e3c4a24 req-f7fa6c7c-8913-44f7-b9b3-303cf05a13f4 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:55:02.252831 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-ffff41b1-f3bd-477c-9dc1-868b8e3c4a24 req-f7fa6c7c-8913-44f7-b9b3-303cf05a13f4 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:55:02.264155 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-ffff41b1-f3bd-477c-9dc1-868b8e3c4a24 req-f7fa6c7c-8913-44f7-b9b3-303cf05a13f4 service nova] Creating event network-vif-plugged:755255e7-c643-4a62-9b7e-292b565af498 for instance 03c10791-1496-4e0f-971b-1a259257b6f1 on n-h1-862769-1 Oct 27 04:55:02.269205 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-ffff41b1-f3bd-477c-9dc1-868b8e3c4a24 req-f7fa6c7c-8913-44f7-b9b3-303cf05a13f4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032069 Oct 27 04:55:02.269881 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4270/8241] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:55:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 04:55:02.358216 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-619ff673-0add-4303-a244-38582afcc1df tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:55:02.358844 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-619ff673-0add-4303-a244-38582afcc1df tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 03c10791-1496-4e0f-971b-1a259257b6f1] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:55:02.367056 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-619ff673-0add-4303-a244-38582afcc1df tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:55:02.368050 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-619ff673-0add-4303-a244-38582afcc1df tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:55:02.368683 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-619ff673-0add-4303-a244-38582afcc1df tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:55:02.369620 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-619ff673-0add-4303-a244-38582afcc1df tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:55:02.370109 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-619ff673-0add-4303-a244-38582afcc1df tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:55:02.370561 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-619ff673-0add-4303-a244-38582afcc1df tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:55:02.505623 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-619ff673-0add-4303-a244-38582afcc1df tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:55:02.513370 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-619ff673-0add-4303-a244-38582afcc1df tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1" status: 200 len: 1260 microversion: 2.1 time: 0.159217 Oct 27 04:55:02.513979 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3972/8242] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:55:02 2022] GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:55:03.537729 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f7f1764d-7abe-4d29-bdb1-866eca175665 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:55:03.538562 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f7f1764d-7abe-4d29-bdb1-866eca175665 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 03c10791-1496-4e0f-971b-1a259257b6f1] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:55:03.544862 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f7f1764d-7abe-4d29-bdb1-866eca175665 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:55:03.545370 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f7f1764d-7abe-4d29-bdb1-866eca175665 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:55:03.545838 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f7f1764d-7abe-4d29-bdb1-866eca175665 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:55:03.546585 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f7f1764d-7abe-4d29-bdb1-866eca175665 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:55:03.547065 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f7f1764d-7abe-4d29-bdb1-866eca175665 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:55:03.547517 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f7f1764d-7abe-4d29-bdb1-866eca175665 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:55:03.709174 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f7f1764d-7abe-4d29-bdb1-866eca175665 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:55:03.709174 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f7f1764d-7abe-4d29-bdb1-866eca175665 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1" status: 200 len: 1260 microversion: 2.1 time: 0.158776 Oct 27 04:55:03.709174 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4271/8243] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:55:03 2022] GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:55:04.730291 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-426ccd5b-b862-4146-98d7-861129d5cc10 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:55:04.730905 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-426ccd5b-b862-4146-98d7-861129d5cc10 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 03c10791-1496-4e0f-971b-1a259257b6f1] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:55:04.739075 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-426ccd5b-b862-4146-98d7-861129d5cc10 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:55:04.739570 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-426ccd5b-b862-4146-98d7-861129d5cc10 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:55:04.740015 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-426ccd5b-b862-4146-98d7-861129d5cc10 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:55:04.740716 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-426ccd5b-b862-4146-98d7-861129d5cc10 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:55:04.741180 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-426ccd5b-b862-4146-98d7-861129d5cc10 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:55:04.741609 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-426ccd5b-b862-4146-98d7-861129d5cc10 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:55:04.894617 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-426ccd5b-b862-4146-98d7-861129d5cc10 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:55:04.904764 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-426ccd5b-b862-4146-98d7-861129d5cc10 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1" status: 200 len: 1444 microversion: 2.1 time: 0.178343 Oct 27 04:55:04.905401 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3973/8244] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:55:04 2022] GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1 => generated 1444 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:55:04.928380 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-db44640f-afb1-4c62-a650-765e282891ad tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:55:04.930076 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-db44640f-afb1-4c62-a650-765e282891ad tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 03c10791-1496-4e0f-971b-1a259257b6f1] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:55:04.936143 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-db44640f-afb1-4c62-a650-765e282891ad tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:55:04.939958 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-db44640f-afb1-4c62-a650-765e282891ad tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:55:04.939958 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-db44640f-afb1-4c62-a650-765e282891ad tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:55:04.939958 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-db44640f-afb1-4c62-a650-765e282891ad tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:55:04.939958 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-db44640f-afb1-4c62-a650-765e282891ad tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:55:04.939958 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-db44640f-afb1-4c62-a650-765e282891ad tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:55:05.086518 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-db44640f-afb1-4c62-a650-765e282891ad tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:55:05.095236 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-db44640f-afb1-4c62-a650-765e282891ad tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1" status: 200 len: 1444 microversion: 2.1 time: 0.171493 Oct 27 04:55:05.095864 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4272/8245] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:55:04 2022] GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1 => generated 1444 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:55:07.033022 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-a823e618-0b9e-4b74-8780-f1473059eb0a req-e05450b7-1be3-4cc8-8c40-d480550768f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03c10791-1496-4e0f-971b-1a259257b6f1", "tag": "755255e7-c643-4a62-9b7e-292b565af498"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:55:07.043617 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-a823e618-0b9e-4b74-8780-f1473059eb0a req-e05450b7-1be3-4cc8-8c40-d480550768f2 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:55:07.044108 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-a823e618-0b9e-4b74-8780-f1473059eb0a req-e05450b7-1be3-4cc8-8c40-d480550768f2 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:55:07.044603 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-a823e618-0b9e-4b74-8780-f1473059eb0a req-e05450b7-1be3-4cc8-8c40-d480550768f2 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:55:07.056161 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-a823e618-0b9e-4b74-8780-f1473059eb0a req-e05450b7-1be3-4cc8-8c40-d480550768f2 service nova] Creating event network-changed:755255e7-c643-4a62-9b7e-292b565af498 for instance 03c10791-1496-4e0f-971b-1a259257b6f1 on n-h1-862769-1 Oct 27 04:55:07.061739 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-a823e618-0b9e-4b74-8780-f1473059eb0a req-e05450b7-1be3-4cc8-8c40-d480550768f2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032380 Oct 27 04:55:07.062479 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3974/8246] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:55:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 04:57:33.797253 n-d-862769-1 devstack@n-api.service[121001]: ERROR oslo.messaging._drivers.impl_rabbit [-] [74449df9-f77e-48cb-96a4-46691974a96d] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 27 04:57:33.798286 n-d-862769-1 devstack@n-api.service[121001]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5b59dcc8-77e8-4f93-abf1-649e725dfb1c] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 27 04:57:33.799179 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=26 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:57:33.799969 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=58 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:57:33.801051 n-d-862769-1 devstack@n-api.service[121001]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 04:57:33.801203 n-d-862769-1 devstack@n-api.service[121001]: Thu Oct 27 04:57:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1/action (ip 10.222.0.20) !!! Oct 27 04:57:33.803280 n-d-862769-1 devstack@n-api.service[121001]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 27 04:57:33.803422 n-d-862769-1 devstack@n-api.service[121001]: Thu Oct 27 04:57:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1/action (ip 10.222.0.20) !!! Oct 27 04:57:33.814623 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7eb2774d-0f06-4edc-b1e7-f6dcd17ad0ea tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:57:33.822494 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7eb2774d-0f06-4edc-b1e7-f6dcd17ad0ea tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 03c10791-1496-4e0f-971b-1a259257b6f1] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:57:33.825611 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7eb2774d-0f06-4edc-b1e7-f6dcd17ad0ea tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:57:33.826155 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7eb2774d-0f06-4edc-b1e7-f6dcd17ad0ea tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:57:33.826618 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7eb2774d-0f06-4edc-b1e7-f6dcd17ad0ea tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:57:33.827332 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7eb2774d-0f06-4edc-b1e7-f6dcd17ad0ea tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:57:33.827807 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7eb2774d-0f06-4edc-b1e7-f6dcd17ad0ea tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:57:33.828257 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7eb2774d-0f06-4edc-b1e7-f6dcd17ad0ea tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:57:33.851719 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.objects.instance [None req-7eb2774d-0f06-4edc-b1e7-f6dcd17ad0ea tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lazy-loading 'flavor' on Instance uuid 03c10791-1496-4e0f-971b-1a259257b6f1 {{(pid=121001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 04:57:34.129094 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7eb2774d-0f06-4edc-b1e7-f6dcd17ad0ea tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "POST /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1/action" status: 202 len: 0 microversion: 2.1 time: 0.333595 Oct 27 04:57:34.129712 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4273/8247] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 04:57:33 2022] POST /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1/action => generated 0 bytes in 335 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 04:57:34.136739 n-d-862769-1 devstack@n-api.service[121000]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5ec0dfad-6f0c-4686-8a67-f02607adfe50] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 27 04:57:34.137956 n-d-862769-1 devstack@n-api.service[121000]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a40cf960-ae63-4112-9db5-88668ecbbc6d] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 27 04:57:34.358530 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:57:34.358530 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=70 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:57:34.358530 n-d-862769-1 devstack@n-api.service[121000]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 27 04:57:34.358530 n-d-862769-1 devstack@n-api.service[121000]: Thu Oct 27 04:57:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1 (ip 10.222.0.20) !!! Oct 27 04:57:34.358530 n-d-862769-1 devstack@n-api.service[121000]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 27 04:57:34.358530 n-d-862769-1 devstack@n-api.service[121000]: Thu Oct 27 04:57:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1 (ip 10.222.0.20) !!! Oct 27 04:57:34.358530 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-c14600ee-0e5d-46f5-b26f-883b149c84bd tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:57:34.358530 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-c14600ee-0e5d-46f5-b26f-883b149c84bd tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 03c10791-1496-4e0f-971b-1a259257b6f1] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:57:34.358530 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c14600ee-0e5d-46f5-b26f-883b149c84bd tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:57:34.358530 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c14600ee-0e5d-46f5-b26f-883b149c84bd tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:57:34.358530 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c14600ee-0e5d-46f5-b26f-883b149c84bd tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:57:34.358530 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c14600ee-0e5d-46f5-b26f-883b149c84bd tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:57:34.358530 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c14600ee-0e5d-46f5-b26f-883b149c84bd tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:57:34.358530 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-c14600ee-0e5d-46f5-b26f-883b149c84bd tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:57:34.358530 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-c14600ee-0e5d-46f5-b26f-883b149c84bd tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:57:34.358530 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-c14600ee-0e5d-46f5-b26f-883b149c84bd tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1" status: 200 len: 1569 microversion: 2.1 time: 0.223045 Oct 27 04:57:34.361919 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3975/8248] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:57:34 2022] GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1 => generated 1569 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:57:35.385448 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f2586f74-efc6-4c53-b39b-17ba5b6c495f tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:57:35.386208 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f2586f74-efc6-4c53-b39b-17ba5b6c495f tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 03c10791-1496-4e0f-971b-1a259257b6f1] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:57:35.395311 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f2586f74-efc6-4c53-b39b-17ba5b6c495f tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:57:35.395815 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f2586f74-efc6-4c53-b39b-17ba5b6c495f tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:57:35.396277 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f2586f74-efc6-4c53-b39b-17ba5b6c495f tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:57:35.396998 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f2586f74-efc6-4c53-b39b-17ba5b6c495f tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:57:35.397473 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f2586f74-efc6-4c53-b39b-17ba5b6c495f tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:57:35.397921 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f2586f74-efc6-4c53-b39b-17ba5b6c495f tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:57:35.406015 n-d-862769-1 devstack@n-api.service[121001]: INFO oslo.messaging._drivers.impl_rabbit [-] [5b59dcc8-77e8-4f93-abf1-649e725dfb1c] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 60254. Oct 27 04:57:35.416463 n-d-862769-1 devstack@n-api.service[121001]: INFO oslo.messaging._drivers.impl_rabbit [-] [74449df9-f77e-48cb-96a4-46691974a96d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 60252. Oct 27 04:57:35.575045 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f2586f74-efc6-4c53-b39b-17ba5b6c495f tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:57:35.582815 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f2586f74-efc6-4c53-b39b-17ba5b6c495f tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1" status: 200 len: 1569 microversion: 2.1 time: 0.201720 Oct 27 04:57:35.583380 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4274/8249] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:57:35 2022] GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1 => generated 1569 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:57:36.606560 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-548c0245-4d89-4d45-86e5-ce55545915ec tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:57:36.607195 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-548c0245-4d89-4d45-86e5-ce55545915ec tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 03c10791-1496-4e0f-971b-1a259257b6f1] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:57:36.615694 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-548c0245-4d89-4d45-86e5-ce55545915ec tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:57:36.616181 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-548c0245-4d89-4d45-86e5-ce55545915ec tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:57:36.616620 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-548c0245-4d89-4d45-86e5-ce55545915ec tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:57:36.617327 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-548c0245-4d89-4d45-86e5-ce55545915ec tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:57:36.617782 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-548c0245-4d89-4d45-86e5-ce55545915ec tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:57:36.618249 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-548c0245-4d89-4d45-86e5-ce55545915ec tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:57:36.635138 n-d-862769-1 devstack@n-api.service[121000]: INFO oslo.messaging._drivers.impl_rabbit [-] [a40cf960-ae63-4112-9db5-88668ecbbc6d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 60262. Oct 27 04:57:36.635836 n-d-862769-1 devstack@n-api.service[121000]: INFO oslo.messaging._drivers.impl_rabbit [-] [5ec0dfad-6f0c-4686-8a67-f02607adfe50] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 60260. Oct 27 04:57:36.751496 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-548c0245-4d89-4d45-86e5-ce55545915ec tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:57:36.759808 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-548c0245-4d89-4d45-86e5-ce55545915ec tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1" status: 200 len: 1569 microversion: 2.1 time: 0.157143 Oct 27 04:57:36.760375 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3976/8250] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:57:36 2022] GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:57:37.783699 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-bfc43ca8-f104-4c27-a3d0-5ae2c34d9dd9 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:57:37.784608 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-bfc43ca8-f104-4c27-a3d0-5ae2c34d9dd9 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 03c10791-1496-4e0f-971b-1a259257b6f1] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:57:37.792314 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bfc43ca8-f104-4c27-a3d0-5ae2c34d9dd9 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:57:37.792823 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bfc43ca8-f104-4c27-a3d0-5ae2c34d9dd9 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:57:37.793280 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bfc43ca8-f104-4c27-a3d0-5ae2c34d9dd9 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:57:37.793985 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bfc43ca8-f104-4c27-a3d0-5ae2c34d9dd9 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:57:37.794486 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bfc43ca8-f104-4c27-a3d0-5ae2c34d9dd9 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:57:37.794928 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-bfc43ca8-f104-4c27-a3d0-5ae2c34d9dd9 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:57:37.922353 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-bfc43ca8-f104-4c27-a3d0-5ae2c34d9dd9 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:57:37.930733 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-bfc43ca8-f104-4c27-a3d0-5ae2c34d9dd9 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1" status: 200 len: 1569 microversion: 2.1 time: 0.150975 Oct 27 04:57:37.931302 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4275/8251] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:57:37 2022] GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:57:38.955046 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-57c20993-9be9-4836-a5bc-aaea34b3adae tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:57:38.955703 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-57c20993-9be9-4836-a5bc-aaea34b3adae tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 03c10791-1496-4e0f-971b-1a259257b6f1] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:57:38.962542 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-57c20993-9be9-4836-a5bc-aaea34b3adae tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:57:38.963059 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-57c20993-9be9-4836-a5bc-aaea34b3adae tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:57:38.963498 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-57c20993-9be9-4836-a5bc-aaea34b3adae tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:57:38.964189 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-57c20993-9be9-4836-a5bc-aaea34b3adae tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:57:38.964674 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-57c20993-9be9-4836-a5bc-aaea34b3adae tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:57:38.965244 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-57c20993-9be9-4836-a5bc-aaea34b3adae tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:57:39.100213 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-57c20993-9be9-4836-a5bc-aaea34b3adae tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:57:39.108498 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-57c20993-9be9-4836-a5bc-aaea34b3adae tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1" status: 200 len: 1569 microversion: 2.1 time: 0.157431 Oct 27 04:57:39.109072 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3977/8252] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:57:38 2022] GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:57:40.137738 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-7bd8afa1-7444-48a4-a5c5-ee09d6ca74fb tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:57:40.138304 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-7bd8afa1-7444-48a4-a5c5-ee09d6ca74fb tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 03c10791-1496-4e0f-971b-1a259257b6f1] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:57:40.145058 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7bd8afa1-7444-48a4-a5c5-ee09d6ca74fb tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:57:40.145561 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7bd8afa1-7444-48a4-a5c5-ee09d6ca74fb tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:57:40.146020 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7bd8afa1-7444-48a4-a5c5-ee09d6ca74fb tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:57:40.146763 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7bd8afa1-7444-48a4-a5c5-ee09d6ca74fb tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:57:40.147235 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7bd8afa1-7444-48a4-a5c5-ee09d6ca74fb tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:57:40.147681 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-7bd8afa1-7444-48a4-a5c5-ee09d6ca74fb tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:57:40.281421 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-7bd8afa1-7444-48a4-a5c5-ee09d6ca74fb tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:57:40.289871 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-7bd8afa1-7444-48a4-a5c5-ee09d6ca74fb tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1" status: 200 len: 1569 microversion: 2.1 time: 0.156220 Oct 27 04:57:40.290496 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4276/8253] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:57:40 2022] GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:57:41.312900 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9fd30d5c-f38d-4551-8709-3454ede5727d tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:57:41.313436 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9fd30d5c-f38d-4551-8709-3454ede5727d tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 03c10791-1496-4e0f-971b-1a259257b6f1] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:57:41.320462 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9fd30d5c-f38d-4551-8709-3454ede5727d tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:57:41.320962 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9fd30d5c-f38d-4551-8709-3454ede5727d tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:57:41.321411 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9fd30d5c-f38d-4551-8709-3454ede5727d tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:57:41.322164 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9fd30d5c-f38d-4551-8709-3454ede5727d tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:57:41.322631 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9fd30d5c-f38d-4551-8709-3454ede5727d tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:57:41.323063 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9fd30d5c-f38d-4551-8709-3454ede5727d tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:57:41.455555 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-9fd30d5c-f38d-4551-8709-3454ede5727d tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:57:41.463980 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9fd30d5c-f38d-4551-8709-3454ede5727d tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1" status: 200 len: 1569 microversion: 2.1 time: 0.155159 Oct 27 04:57:41.464567 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3978/8254] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:57:41 2022] GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:57:42.488212 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4782387d-24f1-486d-8efe-00c420f72fc6 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:57:42.488852 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4782387d-24f1-486d-8efe-00c420f72fc6 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 03c10791-1496-4e0f-971b-1a259257b6f1] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:57:42.496063 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4782387d-24f1-486d-8efe-00c420f72fc6 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:57:42.496562 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4782387d-24f1-486d-8efe-00c420f72fc6 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:57:42.497018 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4782387d-24f1-486d-8efe-00c420f72fc6 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:57:42.497756 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4782387d-24f1-486d-8efe-00c420f72fc6 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:57:42.498263 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4782387d-24f1-486d-8efe-00c420f72fc6 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:57:42.498709 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4782387d-24f1-486d-8efe-00c420f72fc6 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:57:42.626822 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4782387d-24f1-486d-8efe-00c420f72fc6 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:57:42.635114 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4782387d-24f1-486d-8efe-00c420f72fc6 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1" status: 200 len: 1569 microversion: 2.1 time: 0.150849 Oct 27 04:57:42.635687 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4277/8255] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:57:42 2022] GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:57:43.659204 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4ac618ae-8b7b-4517-80ad-c8583e16b06e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:57:43.659862 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4ac618ae-8b7b-4517-80ad-c8583e16b06e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 03c10791-1496-4e0f-971b-1a259257b6f1] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:57:43.666697 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4ac618ae-8b7b-4517-80ad-c8583e16b06e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:57:43.667190 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4ac618ae-8b7b-4517-80ad-c8583e16b06e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:57:43.667634 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4ac618ae-8b7b-4517-80ad-c8583e16b06e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:57:43.668340 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4ac618ae-8b7b-4517-80ad-c8583e16b06e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:57:43.669070 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4ac618ae-8b7b-4517-80ad-c8583e16b06e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:57:43.669285 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4ac618ae-8b7b-4517-80ad-c8583e16b06e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:57:43.797991 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4ac618ae-8b7b-4517-80ad-c8583e16b06e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:57:43.806264 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4ac618ae-8b7b-4517-80ad-c8583e16b06e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1" status: 200 len: 1569 microversion: 2.1 time: 0.150964 Oct 27 04:57:43.806846 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3979/8256] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:57:43 2022] GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:57:44.830138 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-01ec7770-7fa6-4780-9aa3-d2d6e23fb5b4 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:57:44.830782 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-01ec7770-7fa6-4780-9aa3-d2d6e23fb5b4 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 03c10791-1496-4e0f-971b-1a259257b6f1] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:57:44.838162 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-01ec7770-7fa6-4780-9aa3-d2d6e23fb5b4 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:57:44.838667 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-01ec7770-7fa6-4780-9aa3-d2d6e23fb5b4 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:57:44.839122 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-01ec7770-7fa6-4780-9aa3-d2d6e23fb5b4 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:57:44.839841 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-01ec7770-7fa6-4780-9aa3-d2d6e23fb5b4 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:57:44.840312 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-01ec7770-7fa6-4780-9aa3-d2d6e23fb5b4 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:57:44.840764 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-01ec7770-7fa6-4780-9aa3-d2d6e23fb5b4 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:57:44.995979 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-01ec7770-7fa6-4780-9aa3-d2d6e23fb5b4 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:57:45.004047 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-01ec7770-7fa6-4780-9aa3-d2d6e23fb5b4 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1" status: 200 len: 1569 microversion: 2.1 time: 0.177838 Oct 27 04:57:45.004626 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4278/8257] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:57:44 2022] GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1 => generated 1569 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:57:46.028141 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d3b1b602-a085-4822-bb6a-8df142049b79 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:57:46.028772 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d3b1b602-a085-4822-bb6a-8df142049b79 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 03c10791-1496-4e0f-971b-1a259257b6f1] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:57:46.035760 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d3b1b602-a085-4822-bb6a-8df142049b79 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:57:46.036252 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d3b1b602-a085-4822-bb6a-8df142049b79 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:57:46.036699 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d3b1b602-a085-4822-bb6a-8df142049b79 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:57:46.037405 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d3b1b602-a085-4822-bb6a-8df142049b79 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:57:46.037871 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d3b1b602-a085-4822-bb6a-8df142049b79 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:57:46.038331 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d3b1b602-a085-4822-bb6a-8df142049b79 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:57:46.172212 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d3b1b602-a085-4822-bb6a-8df142049b79 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:57:46.180067 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d3b1b602-a085-4822-bb6a-8df142049b79 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1" status: 200 len: 1569 microversion: 2.1 time: 0.156353 Oct 27 04:57:46.180653 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3980/8258] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:57:46 2022] GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:57:47.203064 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-abb500a7-22f2-43da-88de-1840ab8ea301 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:57:47.203721 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-abb500a7-22f2-43da-88de-1840ab8ea301 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 03c10791-1496-4e0f-971b-1a259257b6f1] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:57:47.210962 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-abb500a7-22f2-43da-88de-1840ab8ea301 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:57:47.212613 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-abb500a7-22f2-43da-88de-1840ab8ea301 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:57:47.213083 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-abb500a7-22f2-43da-88de-1840ab8ea301 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:57:47.213853 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-abb500a7-22f2-43da-88de-1840ab8ea301 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:57:47.214387 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-abb500a7-22f2-43da-88de-1840ab8ea301 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:57:47.220395 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-abb500a7-22f2-43da-88de-1840ab8ea301 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:57:47.348602 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-abb500a7-22f2-43da-88de-1840ab8ea301 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:57:47.356566 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-abb500a7-22f2-43da-88de-1840ab8ea301 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1" status: 200 len: 1569 microversion: 2.1 time: 0.157473 Oct 27 04:57:47.357140 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4279/8259] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:57:47 2022] GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:57:48.380763 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4451c12c-c554-4c09-bf01-cfceae5f355f tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:57:48.381466 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4451c12c-c554-4c09-bf01-cfceae5f355f tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 03c10791-1496-4e0f-971b-1a259257b6f1] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:57:48.388889 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4451c12c-c554-4c09-bf01-cfceae5f355f tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:57:48.389381 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4451c12c-c554-4c09-bf01-cfceae5f355f tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:57:48.389821 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4451c12c-c554-4c09-bf01-cfceae5f355f tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:57:48.390548 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4451c12c-c554-4c09-bf01-cfceae5f355f tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:57:48.391010 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4451c12c-c554-4c09-bf01-cfceae5f355f tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:57:48.391442 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4451c12c-c554-4c09-bf01-cfceae5f355f tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:57:48.531136 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4451c12c-c554-4c09-bf01-cfceae5f355f tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:57:48.538881 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4451c12c-c554-4c09-bf01-cfceae5f355f tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1" status: 200 len: 1569 microversion: 2.1 time: 0.161952 Oct 27 04:57:48.539438 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3981/8260] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:57:48 2022] GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:57:48.907876 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-c20d6cd0-3b91-465b-abe7-52e77b3669c4 req-7269ee9f-074b-43b2-9551-5781f2ff516c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03c10791-1496-4e0f-971b-1a259257b6f1", "name": "network-vif-unplugged", "status": "completed", "tag": "755255e7-c643-4a62-9b7e-292b565af498"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:57:48.918007 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-c20d6cd0-3b91-465b-abe7-52e77b3669c4 req-7269ee9f-074b-43b2-9551-5781f2ff516c service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:57:48.918528 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-c20d6cd0-3b91-465b-abe7-52e77b3669c4 req-7269ee9f-074b-43b2-9551-5781f2ff516c service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:57:48.918980 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-c20d6cd0-3b91-465b-abe7-52e77b3669c4 req-7269ee9f-074b-43b2-9551-5781f2ff516c service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:57:48.930010 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-c20d6cd0-3b91-465b-abe7-52e77b3669c4 req-7269ee9f-074b-43b2-9551-5781f2ff516c service nova] Creating event network-vif-unplugged:755255e7-c643-4a62-9b7e-292b565af498 for instance 03c10791-1496-4e0f-971b-1a259257b6f1 on n-h1-862769-1 Oct 27 04:57:48.936705 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-c20d6cd0-3b91-465b-abe7-52e77b3669c4 req-7269ee9f-074b-43b2-9551-5781f2ff516c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079213 Oct 27 04:57:48.936705 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4280/8261] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:57:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:57:49.563834 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f26a8c2a-fdb3-4f57-9d20-538d1052e170 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:57:49.564460 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f26a8c2a-fdb3-4f57-9d20-538d1052e170 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 03c10791-1496-4e0f-971b-1a259257b6f1] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:57:49.572465 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f26a8c2a-fdb3-4f57-9d20-538d1052e170 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:57:49.572961 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f26a8c2a-fdb3-4f57-9d20-538d1052e170 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:57:49.573443 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f26a8c2a-fdb3-4f57-9d20-538d1052e170 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:57:49.574175 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f26a8c2a-fdb3-4f57-9d20-538d1052e170 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:57:49.574636 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f26a8c2a-fdb3-4f57-9d20-538d1052e170 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:57:49.575066 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f26a8c2a-fdb3-4f57-9d20-538d1052e170 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:57:49.709677 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f26a8c2a-fdb3-4f57-9d20-538d1052e170 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:57:49.717743 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f26a8c2a-fdb3-4f57-9d20-538d1052e170 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1" status: 200 len: 1570 microversion: 2.1 time: 0.157911 Oct 27 04:57:49.718405 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3982/8262] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:57:49 2022] GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1 => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:57:49.741276 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c02f7414-120d-40b1-8381-34042e1c8777 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:57:49.741982 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c02f7414-120d-40b1-8381-34042e1c8777 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 03c10791-1496-4e0f-971b-1a259257b6f1] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:57:49.748716 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c02f7414-120d-40b1-8381-34042e1c8777 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:57:49.749212 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c02f7414-120d-40b1-8381-34042e1c8777 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:57:49.750749 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c02f7414-120d-40b1-8381-34042e1c8777 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:57:49.750749 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c02f7414-120d-40b1-8381-34042e1c8777 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:57:49.750899 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c02f7414-120d-40b1-8381-34042e1c8777 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:57:49.751334 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c02f7414-120d-40b1-8381-34042e1c8777 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:57:49.780384 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c02f7414-120d-40b1-8381-34042e1c8777 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 03c10791-1496-4e0f-971b-1a259257b6f1] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121001) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 27 04:57:50.005261 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c02f7414-120d-40b1-8381-34042e1c8777 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "POST /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1/action" status: 202 len: 0 microversion: 2.1 time: 0.268502 Oct 27 04:57:50.005928 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4281/8263] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 04:57:49 2022] POST /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1/action => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 04:57:50.014712 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-7f287073-f75e-42fe-a805-e84412c19d59 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:57:50.015160 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-7f287073-f75e-42fe-a805-e84412c19d59 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 03c10791-1496-4e0f-971b-1a259257b6f1] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:57:50.021188 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7f287073-f75e-42fe-a805-e84412c19d59 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:57:50.021678 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7f287073-f75e-42fe-a805-e84412c19d59 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:57:50.022149 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7f287073-f75e-42fe-a805-e84412c19d59 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:57:50.022897 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7f287073-f75e-42fe-a805-e84412c19d59 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:57:50.023354 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7f287073-f75e-42fe-a805-e84412c19d59 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:57:50.023785 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-7f287073-f75e-42fe-a805-e84412c19d59 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:57:50.201079 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-7f287073-f75e-42fe-a805-e84412c19d59 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:57:50.209221 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-7f287073-f75e-42fe-a805-e84412c19d59 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1" status: 200 len: 1518 microversion: 2.1 time: 0.198734 Oct 27 04:57:50.209992 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3983/8264] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:57:50 2022] GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1 => generated 1518 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:57:51.233787 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-42e2ff22-63e0-49cb-b93f-35ca74f08573 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:57:51.234454 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-42e2ff22-63e0-49cb-b93f-35ca74f08573 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 03c10791-1496-4e0f-971b-1a259257b6f1] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:57:51.241755 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-42e2ff22-63e0-49cb-b93f-35ca74f08573 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:57:51.242295 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-42e2ff22-63e0-49cb-b93f-35ca74f08573 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:57:51.243268 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-42e2ff22-63e0-49cb-b93f-35ca74f08573 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:57:51.244010 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-42e2ff22-63e0-49cb-b93f-35ca74f08573 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:57:51.244491 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-42e2ff22-63e0-49cb-b93f-35ca74f08573 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:57:51.244941 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-42e2ff22-63e0-49cb-b93f-35ca74f08573 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:57:51.379125 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-42e2ff22-63e0-49cb-b93f-35ca74f08573 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:57:51.387693 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-42e2ff22-63e0-49cb-b93f-35ca74f08573 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1" status: 200 len: 1520 microversion: 2.1 time: 0.158842 Oct 27 04:57:51.388267 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4282/8265] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:57:51 2022] GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:57:52.411326 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-01e07af0-9681-45df-8490-1acd2fbd6b03 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:57:52.411959 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-01e07af0-9681-45df-8490-1acd2fbd6b03 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 03c10791-1496-4e0f-971b-1a259257b6f1] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:57:52.419243 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-01e07af0-9681-45df-8490-1acd2fbd6b03 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:57:52.419740 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-01e07af0-9681-45df-8490-1acd2fbd6b03 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:57:52.420178 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-01e07af0-9681-45df-8490-1acd2fbd6b03 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:57:52.420882 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-01e07af0-9681-45df-8490-1acd2fbd6b03 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:57:52.421363 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-01e07af0-9681-45df-8490-1acd2fbd6b03 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:57:52.421853 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-01e07af0-9681-45df-8490-1acd2fbd6b03 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:57:52.561866 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-01e07af0-9681-45df-8490-1acd2fbd6b03 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:57:52.570200 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-01e07af0-9681-45df-8490-1acd2fbd6b03 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1" status: 200 len: 1520 microversion: 2.1 time: 0.162663 Oct 27 04:57:52.586064 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3984/8266] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:57:52 2022] GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:57:53.595471 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2ef4800a-2c0e-47e2-8981-0d2535f0eb3f tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:57:53.596114 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2ef4800a-2c0e-47e2-8981-0d2535f0eb3f tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 03c10791-1496-4e0f-971b-1a259257b6f1] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:57:53.603727 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2ef4800a-2c0e-47e2-8981-0d2535f0eb3f tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:57:53.604237 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2ef4800a-2c0e-47e2-8981-0d2535f0eb3f tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:57:53.604701 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2ef4800a-2c0e-47e2-8981-0d2535f0eb3f tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:57:53.605424 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2ef4800a-2c0e-47e2-8981-0d2535f0eb3f tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:57:53.605899 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2ef4800a-2c0e-47e2-8981-0d2535f0eb3f tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:57:53.606422 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2ef4800a-2c0e-47e2-8981-0d2535f0eb3f tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:57:53.736636 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2ef4800a-2c0e-47e2-8981-0d2535f0eb3f tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:57:53.744828 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2ef4800a-2c0e-47e2-8981-0d2535f0eb3f tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1" status: 200 len: 1520 microversion: 2.1 time: 0.153379 Oct 27 04:57:53.745404 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4283/8267] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:57:53 2022] GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:57:54.768968 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-d2866b2d-c31e-4d16-8bb5-900770c189a3 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:57:54.769606 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-d2866b2d-c31e-4d16-8bb5-900770c189a3 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 03c10791-1496-4e0f-971b-1a259257b6f1] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:57:54.777320 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d2866b2d-c31e-4d16-8bb5-900770c189a3 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:57:54.777814 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d2866b2d-c31e-4d16-8bb5-900770c189a3 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:57:54.778293 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d2866b2d-c31e-4d16-8bb5-900770c189a3 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:57:54.779012 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d2866b2d-c31e-4d16-8bb5-900770c189a3 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:57:54.779476 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d2866b2d-c31e-4d16-8bb5-900770c189a3 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:57:54.779912 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-d2866b2d-c31e-4d16-8bb5-900770c189a3 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:57:54.922858 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-d2866b2d-c31e-4d16-8bb5-900770c189a3 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:57:54.931709 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-d2866b2d-c31e-4d16-8bb5-900770c189a3 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1" status: 200 len: 1520 microversion: 2.1 time: 0.166632 Oct 27 04:57:54.932443 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3985/8268] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:57:54 2022] GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:57:55.966415 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-340b0bba-9580-448d-8975-1ad5fe87829d tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:57:55.967737 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-340b0bba-9580-448d-8975-1ad5fe87829d tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 03c10791-1496-4e0f-971b-1a259257b6f1] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:57:55.974962 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-340b0bba-9580-448d-8975-1ad5fe87829d tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:57:55.975557 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-340b0bba-9580-448d-8975-1ad5fe87829d tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:57:55.984253 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-340b0bba-9580-448d-8975-1ad5fe87829d tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:57:55.984253 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-340b0bba-9580-448d-8975-1ad5fe87829d tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:57:55.984253 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-340b0bba-9580-448d-8975-1ad5fe87829d tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:57:55.984253 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-340b0bba-9580-448d-8975-1ad5fe87829d tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:57:56.112716 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-340b0bba-9580-448d-8975-1ad5fe87829d tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:57:56.121456 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-340b0bba-9580-448d-8975-1ad5fe87829d tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1" status: 200 len: 1520 microversion: 2.1 time: 0.159004 Oct 27 04:57:56.122042 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4284/8269] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:57:55 2022] GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:57:57.145220 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-051aa61b-2433-4217-a31e-763c74b45eb9 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:57:57.145843 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-051aa61b-2433-4217-a31e-763c74b45eb9 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 03c10791-1496-4e0f-971b-1a259257b6f1] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:57:57.152961 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-051aa61b-2433-4217-a31e-763c74b45eb9 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:57:57.153453 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-051aa61b-2433-4217-a31e-763c74b45eb9 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:57:57.153896 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-051aa61b-2433-4217-a31e-763c74b45eb9 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:57:57.154691 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-051aa61b-2433-4217-a31e-763c74b45eb9 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:57:57.155179 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-051aa61b-2433-4217-a31e-763c74b45eb9 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:57:57.157537 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-051aa61b-2433-4217-a31e-763c74b45eb9 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:57:57.291720 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-051aa61b-2433-4217-a31e-763c74b45eb9 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:57:57.299934 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-051aa61b-2433-4217-a31e-763c74b45eb9 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1" status: 200 len: 1576 microversion: 2.1 time: 0.158676 Oct 27 04:57:57.300542 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3986/8270] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:57:57 2022] GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:57:58.324427 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-6bde2ea1-23d8-4e1a-8b61-af028b1223f5 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:57:58.325073 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-6bde2ea1-23d8-4e1a-8b61-af028b1223f5 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 03c10791-1496-4e0f-971b-1a259257b6f1] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:57:58.331961 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6bde2ea1-23d8-4e1a-8b61-af028b1223f5 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:57:58.332466 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6bde2ea1-23d8-4e1a-8b61-af028b1223f5 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:57:58.332926 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6bde2ea1-23d8-4e1a-8b61-af028b1223f5 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:57:58.333647 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6bde2ea1-23d8-4e1a-8b61-af028b1223f5 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:57:58.334154 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6bde2ea1-23d8-4e1a-8b61-af028b1223f5 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:57:58.334605 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-6bde2ea1-23d8-4e1a-8b61-af028b1223f5 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:57:58.464902 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-6bde2ea1-23d8-4e1a-8b61-af028b1223f5 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:57:58.472809 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-6bde2ea1-23d8-4e1a-8b61-af028b1223f5 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1" status: 200 len: 1576 microversion: 2.1 time: 0.152855 Oct 27 04:57:58.473410 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4285/8271] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:57:58 2022] GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:57:59.496391 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2a050611-73d2-42d4-a5e3-2f7116a4a005 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:57:59.497027 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-2a050611-73d2-42d4-a5e3-2f7116a4a005 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 03c10791-1496-4e0f-971b-1a259257b6f1] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:57:59.503940 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2a050611-73d2-42d4-a5e3-2f7116a4a005 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:57:59.504439 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2a050611-73d2-42d4-a5e3-2f7116a4a005 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:57:59.504891 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2a050611-73d2-42d4-a5e3-2f7116a4a005 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:57:59.505602 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2a050611-73d2-42d4-a5e3-2f7116a4a005 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:57:59.506091 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2a050611-73d2-42d4-a5e3-2f7116a4a005 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:57:59.506533 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2a050611-73d2-42d4-a5e3-2f7116a4a005 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:57:59.638537 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2a050611-73d2-42d4-a5e3-2f7116a4a005 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:57:59.646199 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2a050611-73d2-42d4-a5e3-2f7116a4a005 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1" status: 200 len: 1576 microversion: 2.1 time: 0.153700 Oct 27 04:57:59.646781 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3987/8272] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:57:59 2022] GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1 => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:58:00.669781 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d9590f0e-1fb0-4b55-bb21-d21ed76ccf44 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:58:00.670451 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d9590f0e-1fb0-4b55-bb21-d21ed76ccf44 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 03c10791-1496-4e0f-971b-1a259257b6f1] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:58:00.677338 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d9590f0e-1fb0-4b55-bb21-d21ed76ccf44 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:58:00.677843 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d9590f0e-1fb0-4b55-bb21-d21ed76ccf44 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:58:00.678334 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d9590f0e-1fb0-4b55-bb21-d21ed76ccf44 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:58:00.679134 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d9590f0e-1fb0-4b55-bb21-d21ed76ccf44 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:58:00.679578 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d9590f0e-1fb0-4b55-bb21-d21ed76ccf44 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:58:00.680663 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d9590f0e-1fb0-4b55-bb21-d21ed76ccf44 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:58:00.815676 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d9590f0e-1fb0-4b55-bb21-d21ed76ccf44 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:58:00.823779 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d9590f0e-1fb0-4b55-bb21-d21ed76ccf44 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1" status: 200 len: 1576 microversion: 2.1 time: 0.158010 Oct 27 04:58:00.824351 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4286/8273] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:58:00 2022] GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:58:01.847296 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-863b2637-5248-4c07-9a4a-06166f5b371b tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:58:01.847921 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-863b2637-5248-4c07-9a4a-06166f5b371b tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 03c10791-1496-4e0f-971b-1a259257b6f1] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:58:01.854759 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-863b2637-5248-4c07-9a4a-06166f5b371b tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:58:01.855245 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-863b2637-5248-4c07-9a4a-06166f5b371b tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:58:01.855685 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-863b2637-5248-4c07-9a4a-06166f5b371b tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:58:01.856378 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-863b2637-5248-4c07-9a4a-06166f5b371b tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:58:01.856834 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-863b2637-5248-4c07-9a4a-06166f5b371b tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:58:01.857261 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-863b2637-5248-4c07-9a4a-06166f5b371b tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:58:01.987292 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-863b2637-5248-4c07-9a4a-06166f5b371b tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:58:01.995913 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-863b2637-5248-4c07-9a4a-06166f5b371b tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1" status: 200 len: 1576 microversion: 2.1 time: 0.152539 Oct 27 04:58:01.996501 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3988/8274] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:58:01 2022] GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:58:03.019504 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-0d30884d-7001-4308-b4ef-464ed7663e90 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:58:03.020137 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-0d30884d-7001-4308-b4ef-464ed7663e90 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 03c10791-1496-4e0f-971b-1a259257b6f1] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:58:03.028124 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0d30884d-7001-4308-b4ef-464ed7663e90 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:58:03.028680 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0d30884d-7001-4308-b4ef-464ed7663e90 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:58:03.029213 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0d30884d-7001-4308-b4ef-464ed7663e90 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:58:03.029932 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0d30884d-7001-4308-b4ef-464ed7663e90 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:58:03.030432 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0d30884d-7001-4308-b4ef-464ed7663e90 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:58:03.030878 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-0d30884d-7001-4308-b4ef-464ed7663e90 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:58:03.035120 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:58:03.164361 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-0d30884d-7001-4308-b4ef-464ed7663e90 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:58:03.172658 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-0d30884d-7001-4308-b4ef-464ed7663e90 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1" status: 200 len: 1576 microversion: 2.1 time: 0.157233 Oct 27 04:58:03.173237 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4287/8275] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:58:03 2022] GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 04:58:04.196672 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-743f9610-fb19-4411-8f22-61c43880fc74 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:58:04.197329 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-743f9610-fb19-4411-8f22-61c43880fc74 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 03c10791-1496-4e0f-971b-1a259257b6f1] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:58:04.204232 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-743f9610-fb19-4411-8f22-61c43880fc74 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:58:04.204724 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-743f9610-fb19-4411-8f22-61c43880fc74 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:58:04.205197 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-743f9610-fb19-4411-8f22-61c43880fc74 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:58:04.205930 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-743f9610-fb19-4411-8f22-61c43880fc74 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:58:04.206419 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-743f9610-fb19-4411-8f22-61c43880fc74 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:58:04.206855 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-743f9610-fb19-4411-8f22-61c43880fc74 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:58:04.224983 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=88 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:58:04.348667 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-743f9610-fb19-4411-8f22-61c43880fc74 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:58:04.356454 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-743f9610-fb19-4411-8f22-61c43880fc74 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1" status: 200 len: 1576 microversion: 2.1 time: 0.163789 Oct 27 04:58:04.357052 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3989/8276] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:58:04 2022] GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1 => generated 1576 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:58:05.379968 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-d8e8cd68-4b33-4110-a372-65d3613b09fe tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:58:05.380533 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-d8e8cd68-4b33-4110-a372-65d3613b09fe tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 03c10791-1496-4e0f-971b-1a259257b6f1] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:58:05.384180 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:58:05.388914 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d8e8cd68-4b33-4110-a372-65d3613b09fe tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:58:05.389416 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d8e8cd68-4b33-4110-a372-65d3613b09fe tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:58:05.389873 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d8e8cd68-4b33-4110-a372-65d3613b09fe tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:58:05.390612 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d8e8cd68-4b33-4110-a372-65d3613b09fe tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:58:05.391082 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d8e8cd68-4b33-4110-a372-65d3613b09fe tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:58:05.391526 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-d8e8cd68-4b33-4110-a372-65d3613b09fe tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:58:05.526988 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-d8e8cd68-4b33-4110-a372-65d3613b09fe tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:58:05.537673 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-d8e8cd68-4b33-4110-a372-65d3613b09fe tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1" status: 200 len: 1576 microversion: 2.1 time: 0.161616 Oct 27 04:58:05.538332 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4288/8277] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:58:05 2022] GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1 => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:58:06.562101 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-b9e1d73f-10d6-426f-9404-61fcd5d5b709 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:58:06.562726 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-b9e1d73f-10d6-426f-9404-61fcd5d5b709 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 03c10791-1496-4e0f-971b-1a259257b6f1] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:58:06.565429 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=31 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:58:06.570139 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b9e1d73f-10d6-426f-9404-61fcd5d5b709 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:58:06.574689 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b9e1d73f-10d6-426f-9404-61fcd5d5b709 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:58:06.574689 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b9e1d73f-10d6-426f-9404-61fcd5d5b709 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:58:06.574689 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b9e1d73f-10d6-426f-9404-61fcd5d5b709 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:58:06.574689 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b9e1d73f-10d6-426f-9404-61fcd5d5b709 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:58:06.574689 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-b9e1d73f-10d6-426f-9404-61fcd5d5b709 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:58:06.702884 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-b9e1d73f-10d6-426f-9404-61fcd5d5b709 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:58:06.710728 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-b9e1d73f-10d6-426f-9404-61fcd5d5b709 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1" status: 200 len: 1576 microversion: 2.1 time: 0.152599 Oct 27 04:58:06.711309 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3990/8278] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:58:06 2022] GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:58:06.996337 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-bab06663-92c9-46f6-8bf9-45978313c72e req-126d5209-b566-494f-ad2e-58173f5ebc2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03c10791-1496-4e0f-971b-1a259257b6f1", "name": "network-vif-plugged", "status": "completed", "tag": "755255e7-c643-4a62-9b7e-292b565af498"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:58:07.006828 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-bab06663-92c9-46f6-8bf9-45978313c72e req-126d5209-b566-494f-ad2e-58173f5ebc2a service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:58:07.007338 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-bab06663-92c9-46f6-8bf9-45978313c72e req-126d5209-b566-494f-ad2e-58173f5ebc2a service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:58:07.007830 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-bab06663-92c9-46f6-8bf9-45978313c72e req-126d5209-b566-494f-ad2e-58173f5ebc2a service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:58:07.018974 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-bab06663-92c9-46f6-8bf9-45978313c72e req-126d5209-b566-494f-ad2e-58173f5ebc2a service nova] Creating event network-vif-plugged:755255e7-c643-4a62-9b7e-292b565af498 for instance 03c10791-1496-4e0f-971b-1a259257b6f1 on n-h1-862769-1 Oct 27 04:58:07.024083 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-bab06663-92c9-46f6-8bf9-45978313c72e req-126d5209-b566-494f-ad2e-58173f5ebc2a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031552 Oct 27 04:58:07.025188 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4289/8279] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:58:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:58:07.734097 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1997bde7-3c12-43f3-8908-3e7b4b068b02 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:58:07.734769 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1997bde7-3c12-43f3-8908-3e7b4b068b02 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 03c10791-1496-4e0f-971b-1a259257b6f1] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:58:07.741930 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1997bde7-3c12-43f3-8908-3e7b4b068b02 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:58:07.742455 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1997bde7-3c12-43f3-8908-3e7b4b068b02 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:58:07.751539 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1997bde7-3c12-43f3-8908-3e7b4b068b02 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:58:07.751539 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1997bde7-3c12-43f3-8908-3e7b4b068b02 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:58:07.751539 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1997bde7-3c12-43f3-8908-3e7b4b068b02 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:58:07.751539 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1997bde7-3c12-43f3-8908-3e7b4b068b02 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:58:07.877519 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1997bde7-3c12-43f3-8908-3e7b4b068b02 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:58:07.885916 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1997bde7-3c12-43f3-8908-3e7b4b068b02 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1" status: 200 len: 1576 microversion: 2.1 time: 0.155813 Oct 27 04:58:07.886558 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3991/8280] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:58:07 2022] GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:58:08.910182 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c4487167-2e62-4b35-8003-4f739eff95de tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:58:08.910906 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c4487167-2e62-4b35-8003-4f739eff95de tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 03c10791-1496-4e0f-971b-1a259257b6f1] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:58:08.917110 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c4487167-2e62-4b35-8003-4f739eff95de tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:58:08.917605 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c4487167-2e62-4b35-8003-4f739eff95de tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:58:08.918086 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c4487167-2e62-4b35-8003-4f739eff95de tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:58:08.918800 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c4487167-2e62-4b35-8003-4f739eff95de tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:58:08.919276 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c4487167-2e62-4b35-8003-4f739eff95de tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:58:08.919713 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c4487167-2e62-4b35-8003-4f739eff95de tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:58:09.052091 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c4487167-2e62-4b35-8003-4f739eff95de tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:58:09.059944 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c4487167-2e62-4b35-8003-4f739eff95de tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1" status: 200 len: 1563 microversion: 2.1 time: 0.154929 Oct 27 04:58:09.060529 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4290/8281] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:58:08 2022] GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1 => generated 1563 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:59:45.969199 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=5 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:59:45.973722 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-9e1c57dd-e6d4-4143-aa9a-6f45a7d08633 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:59:45.974258 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9e1c57dd-e6d4-4143-aa9a-6f45a7d08633 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 03c10791-1496-4e0f-971b-1a259257b6f1] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:59:45.975697 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=18 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:59:45.977376 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=3 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:59:45.978080 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=14 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 04:59:45.978885 n-d-862769-1 devstack@n-api.service[121000]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 04:59:45.979030 n-d-862769-1 devstack@n-api.service[121000]: Thu Oct 27 04:59:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1 (ip 10.222.0.20) !!! Oct 27 04:59:45.989386 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9e1c57dd-e6d4-4143-aa9a-6f45a7d08633 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:59:45.990970 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9e1c57dd-e6d4-4143-aa9a-6f45a7d08633 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:59:45.990970 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9e1c57dd-e6d4-4143-aa9a-6f45a7d08633 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:59:45.995634 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9e1c57dd-e6d4-4143-aa9a-6f45a7d08633 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:59:45.995634 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9e1c57dd-e6d4-4143-aa9a-6f45a7d08633 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:59:45.995634 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-9e1c57dd-e6d4-4143-aa9a-6f45a7d08633 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:59:46.021708 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-9e1c57dd-e6d4-4143-aa9a-6f45a7d08633 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 03c10791-1496-4e0f-971b-1a259257b6f1] Going to try to terminate instance {{(pid=121000) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 04:59:46.038768 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-be0c934b-5691-4e5a-a392-17536bed5de2 req-7ae3a7fd-3b51-4ff7-a7ee-4d858c2cd67e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03c10791-1496-4e0f-971b-1a259257b6f1", "tag": "755255e7-c643-4a62-9b7e-292b565af498"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:59:46.048751 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-be0c934b-5691-4e5a-a392-17536bed5de2 req-7ae3a7fd-3b51-4ff7-a7ee-4d858c2cd67e service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:59:46.049398 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-be0c934b-5691-4e5a-a392-17536bed5de2 req-7ae3a7fd-3b51-4ff7-a7ee-4d858c2cd67e service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:59:46.050232 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-be0c934b-5691-4e5a-a392-17536bed5de2 req-7ae3a7fd-3b51-4ff7-a7ee-4d858c2cd67e service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:59:46.062836 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-be0c934b-5691-4e5a-a392-17536bed5de2 req-7ae3a7fd-3b51-4ff7-a7ee-4d858c2cd67e service nova] Creating event network-changed:755255e7-c643-4a62-9b7e-292b565af498 for instance 03c10791-1496-4e0f-971b-1a259257b6f1 on n-h1-862769-1 Oct 27 04:59:46.067971 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-be0c934b-5691-4e5a-a392-17536bed5de2 req-7ae3a7fd-3b51-4ff7-a7ee-4d858c2cd67e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100898 Oct 27 04:59:46.068642 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4291/8282] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:59:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:59:46.298240 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-9e1c57dd-e6d4-4143-aa9a-6f45a7d08633 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "DELETE /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1" status: 204 len: 0 microversion: 2.1 time: 0.332925 Oct 27 04:59:46.304042 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3992/8283] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 04:59:45 2022] DELETE /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 04:59:46.309845 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-dfd5f40b-0f10-444e-ad42-887eb2305319 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:59:46.310616 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-dfd5f40b-0f10-444e-ad42-887eb2305319 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 03c10791-1496-4e0f-971b-1a259257b6f1] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:59:46.316985 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dfd5f40b-0f10-444e-ad42-887eb2305319 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:59:46.317496 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dfd5f40b-0f10-444e-ad42-887eb2305319 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:59:46.317985 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dfd5f40b-0f10-444e-ad42-887eb2305319 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:59:46.318738 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dfd5f40b-0f10-444e-ad42-887eb2305319 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:59:46.319216 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dfd5f40b-0f10-444e-ad42-887eb2305319 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:59:46.319666 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-dfd5f40b-0f10-444e-ad42-887eb2305319 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:59:46.466298 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-dfd5f40b-0f10-444e-ad42-887eb2305319 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:59:46.474333 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-dfd5f40b-0f10-444e-ad42-887eb2305319 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1" status: 200 len: 1569 microversion: 2.1 time: 0.168720 Oct 27 04:59:46.475556 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4292/8284] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:59:46 2022] GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1 => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:59:47.499101 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6c81e090-4e63-404f-903a-5dcad2f0521e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:59:47.499925 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6c81e090-4e63-404f-903a-5dcad2f0521e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 03c10791-1496-4e0f-971b-1a259257b6f1] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:59:47.506928 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6c81e090-4e63-404f-903a-5dcad2f0521e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:59:47.511558 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6c81e090-4e63-404f-903a-5dcad2f0521e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:59:47.511558 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6c81e090-4e63-404f-903a-5dcad2f0521e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:59:47.511558 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6c81e090-4e63-404f-903a-5dcad2f0521e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:59:47.511558 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6c81e090-4e63-404f-903a-5dcad2f0521e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:59:47.511558 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6c81e090-4e63-404f-903a-5dcad2f0521e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:59:47.642517 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-6c81e090-4e63-404f-903a-5dcad2f0521e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:59:47.650518 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6c81e090-4e63-404f-903a-5dcad2f0521e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1" status: 200 len: 1569 microversion: 2.1 time: 0.155658 Oct 27 04:59:47.651308 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3993/8285] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:59:47 2022] GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:59:48.637537 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-30c63a1a-6485-43a7-85c0-96c7a5c8c28b req-f8f80876-0c73-4ad9-8dea-6939f189118a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03c10791-1496-4e0f-971b-1a259257b6f1", "name": "network-vif-deleted", "tag": "755255e7-c643-4a62-9b7e-292b565af498"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 04:59:48.646980 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-30c63a1a-6485-43a7-85c0-96c7a5c8c28b req-f8f80876-0c73-4ad9-8dea-6939f189118a service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:59:48.647481 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-30c63a1a-6485-43a7-85c0-96c7a5c8c28b req-f8f80876-0c73-4ad9-8dea-6939f189118a service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:59:48.647954 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-30c63a1a-6485-43a7-85c0-96c7a5c8c28b req-f8f80876-0c73-4ad9-8dea-6939f189118a service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:59:48.659112 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-30c63a1a-6485-43a7-85c0-96c7a5c8c28b req-f8f80876-0c73-4ad9-8dea-6939f189118a service nova] Creating event network-vif-deleted:755255e7-c643-4a62-9b7e-292b565af498 for instance 03c10791-1496-4e0f-971b-1a259257b6f1 on n-h1-862769-1 Oct 27 04:59:48.664203 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-30c63a1a-6485-43a7-85c0-96c7a5c8c28b req-f8f80876-0c73-4ad9-8dea-6939f189118a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080861 Oct 27 04:59:48.664798 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4293/8286] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 04:59:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 04:59:48.675719 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-fb0db532-79f6-4f20-aad6-9a9afe8d9f1a tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:59:48.676350 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-fb0db532-79f6-4f20-aad6-9a9afe8d9f1a tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 03c10791-1496-4e0f-971b-1a259257b6f1] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:59:48.683939 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fb0db532-79f6-4f20-aad6-9a9afe8d9f1a tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:59:48.684645 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fb0db532-79f6-4f20-aad6-9a9afe8d9f1a tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:59:48.685257 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fb0db532-79f6-4f20-aad6-9a9afe8d9f1a tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:59:48.686127 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fb0db532-79f6-4f20-aad6-9a9afe8d9f1a tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:59:48.686459 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fb0db532-79f6-4f20-aad6-9a9afe8d9f1a tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:59:48.686891 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-fb0db532-79f6-4f20-aad6-9a9afe8d9f1a tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:59:48.751108 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-fb0db532-79f6-4f20-aad6-9a9afe8d9f1a tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:59:48.759004 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-fb0db532-79f6-4f20-aad6-9a9afe8d9f1a tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1" status: 200 len: 1382 microversion: 2.1 time: 0.087273 Oct 27 04:59:48.759777 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3994/8287] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:59:48 2022] GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1 => generated 1382 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:59:49.784365 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-936ffd62-4b00-4e67-8c85-fcb95811df1e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:59:49.785099 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-936ffd62-4b00-4e67-8c85-fcb95811df1e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 03c10791-1496-4e0f-971b-1a259257b6f1] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:59:49.792015 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-936ffd62-4b00-4e67-8c85-fcb95811df1e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:59:49.792526 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-936ffd62-4b00-4e67-8c85-fcb95811df1e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:59:49.792989 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-936ffd62-4b00-4e67-8c85-fcb95811df1e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:59:49.793710 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-936ffd62-4b00-4e67-8c85-fcb95811df1e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:59:49.794238 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-936ffd62-4b00-4e67-8c85-fcb95811df1e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:59:49.794693 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-936ffd62-4b00-4e67-8c85-fcb95811df1e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:59:49.857989 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-936ffd62-4b00-4e67-8c85-fcb95811df1e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:59:49.866908 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-936ffd62-4b00-4e67-8c85-fcb95811df1e tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1" status: 200 len: 1219 microversion: 2.1 time: 0.087459 Oct 27 04:59:49.867484 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4294/8288] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:59:49 2022] GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:59:50.890078 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f6d44540-6a5a-49d8-aaac-4a4e67f4bc54 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:59:50.890726 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f6d44540-6a5a-49d8-aaac-4a4e67f4bc54 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 03c10791-1496-4e0f-971b-1a259257b6f1] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:59:50.897758 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f6d44540-6a5a-49d8-aaac-4a4e67f4bc54 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:59:50.898306 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f6d44540-6a5a-49d8-aaac-4a4e67f4bc54 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:59:50.898752 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f6d44540-6a5a-49d8-aaac-4a4e67f4bc54 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:59:50.899463 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f6d44540-6a5a-49d8-aaac-4a4e67f4bc54 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:59:50.899924 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f6d44540-6a5a-49d8-aaac-4a4e67f4bc54 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:59:50.900358 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f6d44540-6a5a-49d8-aaac-4a4e67f4bc54 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:59:50.969309 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-f6d44540-6a5a-49d8-aaac-4a4e67f4bc54 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:59:50.977411 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f6d44540-6a5a-49d8-aaac-4a4e67f4bc54 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1" status: 200 len: 1219 microversion: 2.1 time: 0.091331 Oct 27 04:59:50.977999 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3995/8289] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:59:50 2022] GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1 => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:59:52.001006 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2cdaa374-abb9-4420-906f-6f0228f42c13 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:59:52.001658 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2cdaa374-abb9-4420-906f-6f0228f42c13 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 03c10791-1496-4e0f-971b-1a259257b6f1] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:59:52.009117 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2cdaa374-abb9-4420-906f-6f0228f42c13 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:59:52.009633 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2cdaa374-abb9-4420-906f-6f0228f42c13 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:59:52.010133 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2cdaa374-abb9-4420-906f-6f0228f42c13 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:59:52.011037 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2cdaa374-abb9-4420-906f-6f0228f42c13 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:59:52.011518 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2cdaa374-abb9-4420-906f-6f0228f42c13 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:59:52.011971 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2cdaa374-abb9-4420-906f-6f0228f42c13 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:59:52.077538 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2cdaa374-abb9-4420-906f-6f0228f42c13 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:59:52.086560 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2cdaa374-abb9-4420-906f-6f0228f42c13 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1" status: 200 len: 1219 microversion: 2.1 time: 0.089612 Oct 27 04:59:52.087154 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4295/8290] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:59:51 2022] GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:59:53.109594 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6dbd329a-f101-469e-a16d-e8d46846c978 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:59:53.110238 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6dbd329a-f101-469e-a16d-e8d46846c978 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 03c10791-1496-4e0f-971b-1a259257b6f1] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:59:53.117314 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6dbd329a-f101-469e-a16d-e8d46846c978 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:59:53.117813 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6dbd329a-f101-469e-a16d-e8d46846c978 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:59:53.118277 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6dbd329a-f101-469e-a16d-e8d46846c978 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:59:53.118983 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6dbd329a-f101-469e-a16d-e8d46846c978 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:59:53.119450 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6dbd329a-f101-469e-a16d-e8d46846c978 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:59:53.119885 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6dbd329a-f101-469e-a16d-e8d46846c978 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:59:53.185115 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-6dbd329a-f101-469e-a16d-e8d46846c978 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0801f524d46d447c9dc052189e964abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206d2ec543a34682a5ec39023ffa2c90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 04:59:53.198663 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6dbd329a-f101-469e-a16d-e8d46846c978 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1" status: 200 len: 1219 microversion: 2.1 time: 0.092928 Oct 27 04:59:53.199397 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3996/8291] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:59:53 2022] GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1 => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 04:59:54.222565 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-62c528a5-1e3a-409b-9731-ca046f54dff8 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:59:54.223266 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-62c528a5-1e3a-409b-9731-ca046f54dff8 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] [instance: 03c10791-1496-4e0f-971b-1a259257b6f1] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 04:59:54.230905 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-62c528a5-1e3a-409b-9731-ca046f54dff8 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:59:54.231421 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-62c528a5-1e3a-409b-9731-ca046f54dff8 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:59:54.231889 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-62c528a5-1e3a-409b-9731-ca046f54dff8 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:59:54.232627 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-62c528a5-1e3a-409b-9731-ca046f54dff8 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 04:59:54.233110 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-62c528a5-1e3a-409b-9731-ca046f54dff8 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 04:59:54.233561 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-62c528a5-1e3a-409b-9731-ca046f54dff8 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 04:59:54.248535 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-62c528a5-1e3a-409b-9731-ca046f54dff8 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] HTTP exception thrown: Instance 03c10791-1496-4e0f-971b-1a259257b6f1 could not be found. Oct 27 04:59:54.250271 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-62c528a5-1e3a-409b-9731-ca046f54dff8 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Request method failure captured: Oct 27 04:59:54.250271 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1 HTTP/1.1 Oct 27 04:59:54.250271 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 04:59:54.250271 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 04:59:54.250271 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 04:59:54.250271 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 04:59:54.250271 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 04:59:54.250271 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 04:59:54.250271 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 04:59:54.250271 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 04:59:54.250271 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWg3wZd668Km9eBpgCnewvI35O-x4t570_exVRnIpm4-Yt_QKmkRLStTkx7BoSTPkYm0Khl4gG2-Zs7ZYinjbZ3WaFXtcG_4gzBc1l7YkcL2i0RAvB3cyJ_OSzPOta8WYu9CotPm1-bPRUyjm7AfRqjjYKzLv2KfqmDpwf25pTKb4rao Oct 27 04:59:54.250271 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 04:59:54.250271 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 04:59:54.250271 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 04:59:54.250271 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 04:59:54.250271 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 04:59:54.250271 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 04:59:54.250271 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 206d2ec543a34682a5ec39023ffa2c90 Oct 27 04:59:54.250271 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-TestShelveInstance-1609444603 Oct 27 04:59:54.250271 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 04:59:54.250271 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 04:59:54.250271 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/206d2ec543a34682a5ec39023ffa2c90"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/206d2ec543a34682a5ec39023ffa2c90"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/206d2ec543a34682a5ec39023ffa2c90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_206d2ec543a34682a5ec39023ffa2c90"}]}] Oct 27 04:59:54.250271 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-TestShelveInstance-1609444603 Oct 27 04:59:54.250271 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 206d2ec543a34682a5ec39023ffa2c90 Oct 27 04:59:54.250271 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-TestShelveInstance-1609444603 Oct 27 04:59:54.250271 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-TestShelveInstance-1609444603-project Oct 27 04:59:54.250271 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 04:59:54.250271 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 04:59:54.250271 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: 0801f524d46d447c9dc052189e964abf Oct 27 04:59:54.250271 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-TestShelveInstance-1609444603-project Oct 27 04:59:54.250271 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 04:59:54.250271 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 03c10791-1496-4e0f-971b-1a259257b6f1 could not be found. Oct 27 04:59:54.250271 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '03c10791-1496-4e0f-971b-1a259257b6f1'} Oct 27 04:59:54.250271 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 04:59:54.250271 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:59:54.250271 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 04:59:54.250271 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 04:59:54.250271 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 04:59:54.250271 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 04:59:54.250271 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 04:59:54.250271 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 04:59:54.250271 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 04:59:54.250271 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 04:59:54.250271 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03c10791-1496-4e0f-971b-1a259257b6f1 could not be found. Oct 27 04:59:54.250271 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:59:54.250271 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:59:54.250271 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:59:54.250271 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:59:54.250271 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:59:54.250271 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:59:54.250271 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 04:59:54.250271 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 04:59:54.250271 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 04:59:54.250271 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 04:59:54.250271 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 04:59:54.250271 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 04:59:54.250271 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 04:59:54.250271 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 04:59:54.250271 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 04:59:54.250271 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 04:59:54.250271 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03c10791-1496-4e0f-971b-1a259257b6f1 could not be found. Oct 27 04:59:54.250271 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:59:54.250271 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 04:59:54.250271 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:59:54.254295 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 04:59:54.254295 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 04:59:54.254295 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 04:59:54.254295 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 04:59:54.254295 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 04:59:54.254295 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03c10791-1496-4e0f-971b-1a259257b6f1 could not be found. Oct 27 04:59:54.254295 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 04:59:54.254295 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-62c528a5-1e3a-409b-9731-ca046f54dff8 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Returning 404 to user: Instance 03c10791-1496-4e0f-971b-1a259257b6f1 could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 04:59:54.254295 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-62c528a5-1e3a-409b-9731-ca046f54dff8 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1" status: 404 len: 111 microversion: 2.1 time: 0.033168 Oct 27 04:59:54.255760 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4296/8292] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 04:59:54 2022] GET /compute/v2.1/servers/03c10791-1496-4e0f-971b-1a259257b6f1 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 04:59:54.475321 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f93d6e7d-2341-477f-8309-b93d2b976a99 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] Calling method '.version_select at 0x7f7dda275280>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 04:59:54.556636 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f93d6e7d-2341-477f-8309-b93d2b976a99 tempest-TestShelveInstance-1609444603 tempest-TestShelveInstance-1609444603-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-883100799" status: 202 len: 0 microversion: 2.1 time: 0.086255 Oct 27 04:59:54.557236 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3997/8293] 10.222.0.20 () {58 vars in 1251 bytes} [Thu Oct 27 04:59:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-883100799 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 05:00:16.412826 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=12 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 05:00:16.414419 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=24 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 05:00:16.599931 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f32f80d5-f844-4776-ab70-f33f39e5e2e0 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Action: 'create', calling method: .version_select at 0x7f7dd9d67670>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-97071006", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLPyMAt6GB8F/UOoJybPm8Dkpf8NHxQctYem27tMX7Cn+kaxv9DieTCDikogX1u3tuc7jeZ6ePdg8gOdzc/VrsFDPQgJVwfTzePxvi6isMfja2lU29AY8EtCNtXkzDkgoA=="}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 05:00:16.617243 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-f32f80d5-f844-4776-ab70-f33f39e5e2e0 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Getting quotas for project 6c894a9560d54542a80219708a9a7d0b. Resources: {'key_pairs'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 05:00:16.622712 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.quota [None req-f32f80d5-f844-4776-ab70-f33f39e5e2e0 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Getting quotas for user bf29495c1c284b4c9689ce1effb1bfff and project 6c894a9560d54542a80219708a9a7d0b. Resources: {'key_pairs'} {{(pid=121001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 05:00:16.750618 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f32f80d5-f844-4776-ab70-f33f39e5e2e0 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.343430 Oct 27 05:00:16.751224 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4297/8294] 10.222.0.20 () {60 vars in 1159 bytes} [Thu Oct 27 05:00:16 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 05:00:19.211575 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-6911ae11-162f-4728-a45c-36836cae9311 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1881882697", "imageRef": "c40fb871-5877-4b59-ab69-d9fd23b7a917", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-97071006", "security_groups": [{"name": "tempest-secgroup-smoke-1520359164"}], "networks": [{"uuid": "47040a84-257e-4397-ad20-ae345d62717f"}]}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 05:00:19.222245 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 05:00:19.223068 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 05:00:19.326773 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-6911ae11-162f-4728-a45c-36836cae9311 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] validate_networks() for [('47040a84-257e-4397-ad20-ae345d62717f', None, None, None, None, None)] {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 05:00:19.793673 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-6911ae11-162f-4728-a45c-36836cae9311 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 05:00:19.794815 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-6911ae11-162f-4728-a45c-36836cae9311 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 05:00:19.795222 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-6911ae11-162f-4728-a45c-36836cae9311 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 05:00:19.795664 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-6911ae11-162f-4728-a45c-36836cae9311 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 05:00:19.796333 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-6911ae11-162f-4728-a45c-36836cae9311 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 05:00:19.806884 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6911ae11-162f-4728-a45c-36836cae9311 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:00:19.807630 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6911ae11-162f-4728-a45c-36836cae9311 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:00:19.808085 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6911ae11-162f-4728-a45c-36836cae9311 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:00:19.808839 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6911ae11-162f-4728-a45c-36836cae9311 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:00:19.809469 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6911ae11-162f-4728-a45c-36836cae9311 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:00:19.810106 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-6911ae11-162f-4728-a45c-36836cae9311 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:00:19.830008 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-6911ae11-162f-4728-a45c-36836cae9311 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Getting quotas for project 6c894a9560d54542a80219708a9a7d0b. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 05:00:19.835630 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-6911ae11-162f-4728-a45c-36836cae9311 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Getting quotas for user bf29495c1c284b4c9689ce1effb1bfff and project 6c894a9560d54542a80219708a9a7d0b. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 05:00:19.849076 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6911ae11-162f-4728-a45c-36836cae9311 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 05:00:19.852019 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-6911ae11-162f-4728-a45c-36836cae9311 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] [instance: ede9034d-6d65-43dc-8ae3-8f41358d913a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c40fb871-5877-4b59-ab69-d9fd23b7a917',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 05:00:19.947906 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-6911ae11-162f-4728-a45c-36836cae9311 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.740864 Oct 27 05:00:19.949402 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3998/8295] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 05:00:19 2022] POST /compute/v2.1/servers => generated 406 bytes in 743 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 05:00:19.962065 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2797c982-0101-418b-90ba-cc7e954be626 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 05:00:19.962949 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2797c982-0101-418b-90ba-cc7e954be626 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] [instance: ede9034d-6d65-43dc-8ae3-8f41358d913a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 05:00:20.043384 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2797c982-0101-418b-90ba-cc7e954be626 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf29495c1c284b4c9689ce1effb1bfff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c894a9560d54542a80219708a9a7d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 05:00:20.053531 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2797c982-0101-418b-90ba-cc7e954be626 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] 10.222.0.20 "GET /compute/v2.1/servers/ede9034d-6d65-43dc-8ae3-8f41358d913a" status: 200 len: 1247 microversion: 2.1 time: 0.094416 Oct 27 05:00:20.054196 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4298/8296] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 05:00:19 2022] GET /compute/v2.1/servers/ede9034d-6d65-43dc-8ae3-8f41358d913a => generated 1247 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 05:00:21.077427 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2bd1944f-ff7b-4a19-b846-c351e390c9b8 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 05:00:21.078078 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-2bd1944f-ff7b-4a19-b846-c351e390c9b8 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] [instance: ede9034d-6d65-43dc-8ae3-8f41358d913a] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 05:00:21.135891 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2bd1944f-ff7b-4a19-b846-c351e390c9b8 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf29495c1c284b4c9689ce1effb1bfff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c894a9560d54542a80219708a9a7d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 05:00:21.142903 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2bd1944f-ff7b-4a19-b846-c351e390c9b8 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] 10.222.0.20 "GET /compute/v2.1/servers/ede9034d-6d65-43dc-8ae3-8f41358d913a" status: 200 len: 1247 microversion: 2.1 time: 0.070279 Oct 27 05:00:21.143485 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 3999/8297] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 05:00:21 2022] GET /compute/v2.1/servers/ede9034d-6d65-43dc-8ae3-8f41358d913a => generated 1247 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 05:00:22.166263 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-3030cfb1-6a87-4664-ab89-c3c63242ee82 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 05:00:22.166822 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-3030cfb1-6a87-4664-ab89-c3c63242ee82 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] [instance: ede9034d-6d65-43dc-8ae3-8f41358d913a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 05:00:22.221747 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-3030cfb1-6a87-4664-ab89-c3c63242ee82 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf29495c1c284b4c9689ce1effb1bfff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c894a9560d54542a80219708a9a7d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 05:00:22.228710 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-3030cfb1-6a87-4664-ab89-c3c63242ee82 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] 10.222.0.20 "GET /compute/v2.1/servers/ede9034d-6d65-43dc-8ae3-8f41358d913a" status: 200 len: 1247 microversion: 2.1 time: 0.066709 Oct 27 05:00:22.229278 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4299/8298] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 05:00:22 2022] GET /compute/v2.1/servers/ede9034d-6d65-43dc-8ae3-8f41358d913a => generated 1247 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 05:00:23.252542 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-195503d9-6475-4b85-ad00-9e69dd0fefea tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 05:00:23.253181 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-195503d9-6475-4b85-ad00-9e69dd0fefea tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] [instance: ede9034d-6d65-43dc-8ae3-8f41358d913a] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 05:00:23.260636 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-195503d9-6475-4b85-ad00-9e69dd0fefea tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:00:23.264493 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-195503d9-6475-4b85-ad00-9e69dd0fefea tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:00:23.264493 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-195503d9-6475-4b85-ad00-9e69dd0fefea tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:00:23.264493 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-195503d9-6475-4b85-ad00-9e69dd0fefea tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:00:23.264493 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-195503d9-6475-4b85-ad00-9e69dd0fefea tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:00:23.264493 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-195503d9-6475-4b85-ad00-9e69dd0fefea tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:00:23.324739 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-195503d9-6475-4b85-ad00-9e69dd0fefea tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf29495c1c284b4c9689ce1effb1bfff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c894a9560d54542a80219708a9a7d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 05:00:23.332439 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-195503d9-6475-4b85-ad00-9e69dd0fefea tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] 10.222.0.20 "GET /compute/v2.1/servers/ede9034d-6d65-43dc-8ae3-8f41358d913a" status: 200 len: 1299 microversion: 2.1 time: 0.083956 Oct 27 05:00:23.333014 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 4000/8299] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 05:00:23 2022] GET /compute/v2.1/servers/ede9034d-6d65-43dc-8ae3-8f41358d913a => generated 1299 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 05:00:24.357617 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-57736880-6c20-4dd0-9ed8-856a85b527f4 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 05:00:24.358416 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-57736880-6c20-4dd0-9ed8-856a85b527f4 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] [instance: ede9034d-6d65-43dc-8ae3-8f41358d913a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 05:00:24.366072 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-57736880-6c20-4dd0-9ed8-856a85b527f4 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:00:24.367930 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-57736880-6c20-4dd0-9ed8-856a85b527f4 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:00:24.367930 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-57736880-6c20-4dd0-9ed8-856a85b527f4 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:00:24.368765 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-57736880-6c20-4dd0-9ed8-856a85b527f4 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:00:24.369252 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-57736880-6c20-4dd0-9ed8-856a85b527f4 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:00:24.369699 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-57736880-6c20-4dd0-9ed8-856a85b527f4 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:00:24.618576 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-57736880-6c20-4dd0-9ed8-856a85b527f4 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf29495c1c284b4c9689ce1effb1bfff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c894a9560d54542a80219708a9a7d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 05:00:24.626390 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-57736880-6c20-4dd0-9ed8-856a85b527f4 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] 10.222.0.20 "GET /compute/v2.1/servers/ede9034d-6d65-43dc-8ae3-8f41358d913a" status: 200 len: 1373 microversion: 2.1 time: 0.272927 Oct 27 05:00:24.626976 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4300/8300] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 05:00:24 2022] GET /compute/v2.1/servers/ede9034d-6d65-43dc-8ae3-8f41358d913a => generated 1373 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 05:00:25.166378 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-2a7f0687-8a12-4014-9cc4-92c5ade76ec7 req-1cd2b0b9-73f4-4850-b040-c14b80928b3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ede9034d-6d65-43dc-8ae3-8f41358d913a", "tag": "b5f2af4a-5bc8-48eb-bd82-0ef29a53a29a"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 05:00:25.177895 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-2a7f0687-8a12-4014-9cc4-92c5ade76ec7 req-1cd2b0b9-73f4-4850-b040-c14b80928b3f service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:00:25.181903 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-2a7f0687-8a12-4014-9cc4-92c5ade76ec7 req-1cd2b0b9-73f4-4850-b040-c14b80928b3f service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:00:25.181903 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-2a7f0687-8a12-4014-9cc4-92c5ade76ec7 req-1cd2b0b9-73f4-4850-b040-c14b80928b3f service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:00:25.190126 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-2a7f0687-8a12-4014-9cc4-92c5ade76ec7 req-1cd2b0b9-73f4-4850-b040-c14b80928b3f service nova] Creating event network-changed:b5f2af4a-5bc8-48eb-bd82-0ef29a53a29a for instance ede9034d-6d65-43dc-8ae3-8f41358d913a on n-h1-862769-1 Oct 27 05:00:25.195779 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-2a7f0687-8a12-4014-9cc4-92c5ade76ec7 req-1cd2b0b9-73f4-4850-b040-c14b80928b3f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033308 Oct 27 05:00:25.196625 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 4001/8301] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 05:00:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 05:00:25.648783 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b8d8bb9b-c266-40d8-b267-c5485080d9dd tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 05:00:25.649515 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b8d8bb9b-c266-40d8-b267-c5485080d9dd tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] [instance: ede9034d-6d65-43dc-8ae3-8f41358d913a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 05:00:25.656396 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b8d8bb9b-c266-40d8-b267-c5485080d9dd tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:00:25.656904 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b8d8bb9b-c266-40d8-b267-c5485080d9dd tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:00:25.657367 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b8d8bb9b-c266-40d8-b267-c5485080d9dd tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:00:25.658111 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b8d8bb9b-c266-40d8-b267-c5485080d9dd tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:00:25.658592 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b8d8bb9b-c266-40d8-b267-c5485080d9dd tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:00:25.659047 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b8d8bb9b-c266-40d8-b267-c5485080d9dd tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:00:25.876190 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b8d8bb9b-c266-40d8-b267-c5485080d9dd tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf29495c1c284b4c9689ce1effb1bfff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c894a9560d54542a80219708a9a7d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 05:00:25.884056 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b8d8bb9b-c266-40d8-b267-c5485080d9dd tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] 10.222.0.20 "GET /compute/v2.1/servers/ede9034d-6d65-43dc-8ae3-8f41358d913a" status: 200 len: 1373 microversion: 2.1 time: 0.239207 Oct 27 05:00:25.885205 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4301/8302] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 05:00:25 2022] GET /compute/v2.1/servers/ede9034d-6d65-43dc-8ae3-8f41358d913a => generated 1373 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 05:00:26.909079 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e398a6f8-c712-4b33-b4f1-9f691a9516cc tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 05:00:26.909791 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e398a6f8-c712-4b33-b4f1-9f691a9516cc tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] [instance: ede9034d-6d65-43dc-8ae3-8f41358d913a] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 05:00:26.916525 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e398a6f8-c712-4b33-b4f1-9f691a9516cc tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:00:26.917008 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e398a6f8-c712-4b33-b4f1-9f691a9516cc tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:00:26.917452 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e398a6f8-c712-4b33-b4f1-9f691a9516cc tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:00:26.918169 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e398a6f8-c712-4b33-b4f1-9f691a9516cc tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:00:26.918628 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e398a6f8-c712-4b33-b4f1-9f691a9516cc tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:00:26.919072 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e398a6f8-c712-4b33-b4f1-9f691a9516cc tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:00:27.050502 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e398a6f8-c712-4b33-b4f1-9f691a9516cc tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf29495c1c284b4c9689ce1effb1bfff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c894a9560d54542a80219708a9a7d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 05:00:27.058186 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e398a6f8-c712-4b33-b4f1-9f691a9516cc tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] 10.222.0.20 "GET /compute/v2.1/servers/ede9034d-6d65-43dc-8ae3-8f41358d913a" status: 200 len: 1373 microversion: 2.1 time: 0.154259 Oct 27 05:00:27.058773 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 4002/8303] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 05:00:26 2022] GET /compute/v2.1/servers/ede9034d-6d65-43dc-8ae3-8f41358d913a => generated 1373 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 05:00:28.081804 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-ec42c6ee-ccc2-43d5-b3f8-75585db8b7ca tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 05:00:28.082480 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-ec42c6ee-ccc2-43d5-b3f8-75585db8b7ca tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] [instance: ede9034d-6d65-43dc-8ae3-8f41358d913a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 05:00:28.090111 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ec42c6ee-ccc2-43d5-b3f8-75585db8b7ca tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:00:28.090615 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ec42c6ee-ccc2-43d5-b3f8-75585db8b7ca tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:00:28.091078 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ec42c6ee-ccc2-43d5-b3f8-75585db8b7ca tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:00:28.091797 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ec42c6ee-ccc2-43d5-b3f8-75585db8b7ca tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:00:28.092285 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ec42c6ee-ccc2-43d5-b3f8-75585db8b7ca tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:00:28.092738 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-ec42c6ee-ccc2-43d5-b3f8-75585db8b7ca tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:00:28.231048 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-ec42c6ee-ccc2-43d5-b3f8-75585db8b7ca tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf29495c1c284b4c9689ce1effb1bfff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c894a9560d54542a80219708a9a7d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 05:00:28.238814 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-ec42c6ee-ccc2-43d5-b3f8-75585db8b7ca tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] 10.222.0.20 "GET /compute/v2.1/servers/ede9034d-6d65-43dc-8ae3-8f41358d913a" status: 200 len: 1373 microversion: 2.1 time: 0.160940 Oct 27 05:00:28.239407 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4302/8304] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 05:00:28 2022] GET /compute/v2.1/servers/ede9034d-6d65-43dc-8ae3-8f41358d913a => generated 1373 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 05:00:29.263623 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-eaf526a0-722a-4126-85bf-dabb341611f9 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 05:00:29.264248 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-eaf526a0-722a-4126-85bf-dabb341611f9 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] [instance: ede9034d-6d65-43dc-8ae3-8f41358d913a] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 05:00:29.271134 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eaf526a0-722a-4126-85bf-dabb341611f9 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:00:29.271626 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eaf526a0-722a-4126-85bf-dabb341611f9 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:00:29.272093 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eaf526a0-722a-4126-85bf-dabb341611f9 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:00:29.272775 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eaf526a0-722a-4126-85bf-dabb341611f9 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:00:29.273240 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eaf526a0-722a-4126-85bf-dabb341611f9 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:00:29.273671 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-eaf526a0-722a-4126-85bf-dabb341611f9 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:00:29.411794 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-eaf526a0-722a-4126-85bf-dabb341611f9 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf29495c1c284b4c9689ce1effb1bfff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c894a9560d54542a80219708a9a7d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 05:00:29.419883 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-eaf526a0-722a-4126-85bf-dabb341611f9 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] 10.222.0.20 "GET /compute/v2.1/servers/ede9034d-6d65-43dc-8ae3-8f41358d913a" status: 200 len: 1373 microversion: 2.1 time: 0.160266 Oct 27 05:00:29.420477 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 4003/8305] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 05:00:29 2022] GET /compute/v2.1/servers/ede9034d-6d65-43dc-8ae3-8f41358d913a => generated 1373 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 05:00:30.443938 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-c1df7584-fd88-4cc2-89c2-cc7b1ef7e6b2 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 05:00:30.444739 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-c1df7584-fd88-4cc2-89c2-cc7b1ef7e6b2 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] [instance: ede9034d-6d65-43dc-8ae3-8f41358d913a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 05:00:30.451703 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c1df7584-fd88-4cc2-89c2-cc7b1ef7e6b2 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:00:30.452302 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c1df7584-fd88-4cc2-89c2-cc7b1ef7e6b2 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:00:30.452836 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c1df7584-fd88-4cc2-89c2-cc7b1ef7e6b2 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:00:30.453577 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c1df7584-fd88-4cc2-89c2-cc7b1ef7e6b2 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:00:30.454076 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c1df7584-fd88-4cc2-89c2-cc7b1ef7e6b2 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:00:30.454534 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-c1df7584-fd88-4cc2-89c2-cc7b1ef7e6b2 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:00:30.623618 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-c1df7584-fd88-4cc2-89c2-cc7b1ef7e6b2 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf29495c1c284b4c9689ce1effb1bfff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c894a9560d54542a80219708a9a7d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 05:00:30.631410 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-c1df7584-fd88-4cc2-89c2-cc7b1ef7e6b2 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] 10.222.0.20 "GET /compute/v2.1/servers/ede9034d-6d65-43dc-8ae3-8f41358d913a" status: 200 len: 1373 microversion: 2.1 time: 0.191648 Oct 27 05:00:30.631988 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4303/8306] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 05:00:30 2022] GET /compute/v2.1/servers/ede9034d-6d65-43dc-8ae3-8f41358d913a => generated 1373 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 05:00:31.653883 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-99bdfa7e-745c-4526-9e54-9f45efaad095 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 05:00:31.654540 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-99bdfa7e-745c-4526-9e54-9f45efaad095 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] [instance: ede9034d-6d65-43dc-8ae3-8f41358d913a] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 05:00:31.656509 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 05:00:31.658049 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=8 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 05:00:31.662836 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-99bdfa7e-745c-4526-9e54-9f45efaad095 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:00:31.663842 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-99bdfa7e-745c-4526-9e54-9f45efaad095 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:00:31.664291 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-99bdfa7e-745c-4526-9e54-9f45efaad095 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:00:31.665006 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-99bdfa7e-745c-4526-9e54-9f45efaad095 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:00:31.665465 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-99bdfa7e-745c-4526-9e54-9f45efaad095 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:00:31.665904 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-99bdfa7e-745c-4526-9e54-9f45efaad095 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:00:31.805561 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-99bdfa7e-745c-4526-9e54-9f45efaad095 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf29495c1c284b4c9689ce1effb1bfff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c894a9560d54542a80219708a9a7d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 05:00:31.813664 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-99bdfa7e-745c-4526-9e54-9f45efaad095 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] 10.222.0.20 "GET /compute/v2.1/servers/ede9034d-6d65-43dc-8ae3-8f41358d913a" status: 200 len: 1373 microversion: 2.1 time: 0.163733 Oct 27 05:00:31.814300 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 4004/8307] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 05:00:31 2022] GET /compute/v2.1/servers/ede9034d-6d65-43dc-8ae3-8f41358d913a => generated 1373 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 05:00:31.860648 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-8673a4db-e8ef-4e69-9170-e0f84bc2fffb req-a7c59389-01f4-44f0-b7ea-fcac3832604a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ede9034d-6d65-43dc-8ae3-8f41358d913a", "name": "network-vif-plugged", "status": "completed", "tag": "b5f2af4a-5bc8-48eb-bd82-0ef29a53a29a"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 05:00:31.871906 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-8673a4db-e8ef-4e69-9170-e0f84bc2fffb req-a7c59389-01f4-44f0-b7ea-fcac3832604a service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:00:31.872404 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-8673a4db-e8ef-4e69-9170-e0f84bc2fffb req-a7c59389-01f4-44f0-b7ea-fcac3832604a service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:00:31.872876 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-8673a4db-e8ef-4e69-9170-e0f84bc2fffb req-a7c59389-01f4-44f0-b7ea-fcac3832604a service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:00:31.883771 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-8673a4db-e8ef-4e69-9170-e0f84bc2fffb req-a7c59389-01f4-44f0-b7ea-fcac3832604a service nova] Creating event network-vif-plugged:b5f2af4a-5bc8-48eb-bd82-0ef29a53a29a for instance ede9034d-6d65-43dc-8ae3-8f41358d913a on n-h1-862769-1 Oct 27 05:00:31.888968 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-8673a4db-e8ef-4e69-9170-e0f84bc2fffb req-a7c59389-01f4-44f0-b7ea-fcac3832604a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032724 Oct 27 05:00:31.889560 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4304/8308] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 05:00:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 05:00:32.836416 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a57240ae-b750-42a1-9fcc-f6c2390eede2 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 05:00:32.836962 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a57240ae-b750-42a1-9fcc-f6c2390eede2 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] [instance: ede9034d-6d65-43dc-8ae3-8f41358d913a] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 05:00:32.843886 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a57240ae-b750-42a1-9fcc-f6c2390eede2 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:00:32.844373 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a57240ae-b750-42a1-9fcc-f6c2390eede2 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:00:32.844816 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a57240ae-b750-42a1-9fcc-f6c2390eede2 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:00:32.845517 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a57240ae-b750-42a1-9fcc-f6c2390eede2 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:00:32.845975 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a57240ae-b750-42a1-9fcc-f6c2390eede2 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:00:32.846433 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a57240ae-b750-42a1-9fcc-f6c2390eede2 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:00:32.979202 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a57240ae-b750-42a1-9fcc-f6c2390eede2 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf29495c1c284b4c9689ce1effb1bfff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c894a9560d54542a80219708a9a7d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 05:00:32.986919 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a57240ae-b750-42a1-9fcc-f6c2390eede2 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] 10.222.0.20 "GET /compute/v2.1/servers/ede9034d-6d65-43dc-8ae3-8f41358d913a" status: 200 len: 1373 microversion: 2.1 time: 0.154545 Oct 27 05:00:32.987501 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 4005/8309] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 05:00:32 2022] GET /compute/v2.1/servers/ede9034d-6d65-43dc-8ae3-8f41358d913a => generated 1373 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 05:00:34.008377 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=8 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 05:00:34.013330 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-03e77788-00b1-4cf3-bce9-daa2390f7b40 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 05:00:34.014075 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-03e77788-00b1-4cf3-bce9-daa2390f7b40 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] [instance: ede9034d-6d65-43dc-8ae3-8f41358d913a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 05:00:34.020315 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-03e77788-00b1-4cf3-bce9-daa2390f7b40 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:00:34.020826 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-03e77788-00b1-4cf3-bce9-daa2390f7b40 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:00:34.021294 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-03e77788-00b1-4cf3-bce9-daa2390f7b40 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:00:34.022012 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-03e77788-00b1-4cf3-bce9-daa2390f7b40 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:00:34.030311 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-03e77788-00b1-4cf3-bce9-daa2390f7b40 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:00:34.030311 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-03e77788-00b1-4cf3-bce9-daa2390f7b40 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:00:34.164358 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-03e77788-00b1-4cf3-bce9-daa2390f7b40 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf29495c1c284b4c9689ce1effb1bfff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c894a9560d54542a80219708a9a7d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 05:00:34.172149 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-03e77788-00b1-4cf3-bce9-daa2390f7b40 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] 10.222.0.20 "GET /compute/v2.1/servers/ede9034d-6d65-43dc-8ae3-8f41358d913a" status: 200 len: 1559 microversion: 2.1 time: 0.165369 Oct 27 05:00:34.172739 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4305/8310] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 05:00:34 2022] GET /compute/v2.1/servers/ede9034d-6d65-43dc-8ae3-8f41358d913a => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 05:00:34.195077 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0fc44bbf-1c82-4767-b03a-c29d40e9d89e tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 05:00:34.195709 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0fc44bbf-1c82-4767-b03a-c29d40e9d89e tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] [instance: ede9034d-6d65-43dc-8ae3-8f41358d913a] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 05:00:34.203680 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0fc44bbf-1c82-4767-b03a-c29d40e9d89e tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:00:34.204175 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0fc44bbf-1c82-4767-b03a-c29d40e9d89e tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:00:34.204625 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0fc44bbf-1c82-4767-b03a-c29d40e9d89e tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:00:34.205342 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0fc44bbf-1c82-4767-b03a-c29d40e9d89e tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:00:34.205809 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0fc44bbf-1c82-4767-b03a-c29d40e9d89e tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:00:34.206287 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0fc44bbf-1c82-4767-b03a-c29d40e9d89e tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:00:34.337968 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0fc44bbf-1c82-4767-b03a-c29d40e9d89e tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf29495c1c284b4c9689ce1effb1bfff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c894a9560d54542a80219708a9a7d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 05:00:34.345668 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0fc44bbf-1c82-4767-b03a-c29d40e9d89e tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] 10.222.0.20 "GET /compute/v2.1/servers/ede9034d-6d65-43dc-8ae3-8f41358d913a" status: 200 len: 1559 microversion: 2.1 time: 0.155163 Oct 27 05:00:34.346283 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 4006/8311] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 05:00:34 2022] GET /compute/v2.1/servers/ede9034d-6d65-43dc-8ae3-8f41358d913a => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 05:00:36.561567 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-10356726-3cf9-4089-ab89-c874422ce863 req-802b9047-42bc-40e8-ac2d-b3ce80172af5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ede9034d-6d65-43dc-8ae3-8f41358d913a", "tag": "b5f2af4a-5bc8-48eb-bd82-0ef29a53a29a"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 05:00:36.571272 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-10356726-3cf9-4089-ab89-c874422ce863 req-802b9047-42bc-40e8-ac2d-b3ce80172af5 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:00:36.571808 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-10356726-3cf9-4089-ab89-c874422ce863 req-802b9047-42bc-40e8-ac2d-b3ce80172af5 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:00:36.572270 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-10356726-3cf9-4089-ab89-c874422ce863 req-802b9047-42bc-40e8-ac2d-b3ce80172af5 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:00:36.583464 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-10356726-3cf9-4089-ab89-c874422ce863 req-802b9047-42bc-40e8-ac2d-b3ce80172af5 service nova] Creating event network-changed:b5f2af4a-5bc8-48eb-bd82-0ef29a53a29a for instance ede9034d-6d65-43dc-8ae3-8f41358d913a on n-h1-862769-1 Oct 27 05:00:36.589207 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-10356726-3cf9-4089-ab89-c874422ce863 req-802b9047-42bc-40e8-ac2d-b3ce80172af5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031685 Oct 27 05:00:36.590125 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4306/8312] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 05:00:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 05:02:32.931097 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 05:02:32.931827 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=40 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 05:02:32.936833 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-f32af879-9f72-4ed7-af39-82e394480f36 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1766602397"}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 05:02:32.942377 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-f32af879-9f72-4ed7-af39-82e394480f36 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] [instance: ede9034d-6d65-43dc-8ae3-8f41358d913a] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 05:02:32.949617 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f32af879-9f72-4ed7-af39-82e394480f36 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:02:32.950127 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f32af879-9f72-4ed7-af39-82e394480f36 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:02:32.950583 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f32af879-9f72-4ed7-af39-82e394480f36 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:02:32.951303 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f32af879-9f72-4ed7-af39-82e394480f36 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:02:32.951931 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f32af879-9f72-4ed7-af39-82e394480f36 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:02:32.952375 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-f32af879-9f72-4ed7-af39-82e394480f36 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:02:33.394528 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-f32af879-9f72-4ed7-af39-82e394480f36 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] 10.222.0.20 "POST /compute/v2.1/servers/ede9034d-6d65-43dc-8ae3-8f41358d913a/action" status: 202 len: 0 microversion: 2.1 time: 0.465299 Oct 27 05:02:33.395189 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 4007/8313] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 05:02:32 2022] POST /compute/v2.1/servers/ede9034d-6d65-43dc-8ae3-8f41358d913a/action => generated 0 bytes in 467 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 27 05:02:40.503706 n-d-862769-1 devstack@n-api.service[121001]: ERROR oslo.messaging._drivers.impl_rabbit [-] [74449df9-f77e-48cb-96a4-46691974a96d] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 27 05:02:40.504545 n-d-862769-1 devstack@n-api.service[121001]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5b59dcc8-77e8-4f93-abf1-649e725dfb1c] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 27 05:02:40.505373 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 05:02:40.506180 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=34 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 05:02:40.506990 n-d-862769-1 devstack@n-api.service[121001]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 05:02:40.507136 n-d-862769-1 devstack@n-api.service[121001]: Thu Oct 27 05:02:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.20) !!! Oct 27 05:02:40.508763 n-d-862769-1 devstack@n-api.service[121001]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 27 05:02:40.508906 n-d-862769-1 devstack@n-api.service[121001]: Thu Oct 27 05:02:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.20) !!! Oct 27 05:02:40.515894 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-c4e571f1-f0ab-4afe-a291-51c03c69efe1 req-03951ab0-ad85-47d5-b63f-ccb2eed0d771 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ede9034d-6d65-43dc-8ae3-8f41358d913a", "name": "network-vif-plugged", "status": "completed", "tag": "b5f2af4a-5bc8-48eb-bd82-0ef29a53a29a"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 05:02:40.529385 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-c4e571f1-f0ab-4afe-a291-51c03c69efe1 req-03951ab0-ad85-47d5-b63f-ccb2eed0d771 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:02:40.529919 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-c4e571f1-f0ab-4afe-a291-51c03c69efe1 req-03951ab0-ad85-47d5-b63f-ccb2eed0d771 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:02:40.530536 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-c4e571f1-f0ab-4afe-a291-51c03c69efe1 req-03951ab0-ad85-47d5-b63f-ccb2eed0d771 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:02:40.542299 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-c4e571f1-f0ab-4afe-a291-51c03c69efe1 req-03951ab0-ad85-47d5-b63f-ccb2eed0d771 service nova] Creating event network-vif-plugged:b5f2af4a-5bc8-48eb-bd82-0ef29a53a29a for instance ede9034d-6d65-43dc-8ae3-8f41358d913a on n-h1-862769-1 Oct 27 05:02:40.548398 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-c4e571f1-f0ab-4afe-a291-51c03c69efe1 req-03951ab0-ad85-47d5-b63f-ccb2eed0d771 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046090 Oct 27 05:02:40.549123 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4307/8314] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 05:02:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 05:02:49.058389 n-d-862769-1 devstack@n-api.service[121000]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5ec0dfad-6f0c-4686-8a67-f02607adfe50] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 27 05:02:49.059219 n-d-862769-1 devstack@n-api.service[121000]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a40cf960-ae63-4112-9db5-88668ecbbc6d] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 27 05:02:49.059736 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 05:02:49.060511 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 05:02:49.064594 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-ebc04b0b-acee-481d-a3a0-cf0bb4d5c862 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-527329150", "imageRef": "a6adac16-f7cd-4b1a-8114-15583a1fab5d", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-97071006", "security_groups": [{"name": "tempest-secgroup-smoke-1520359164"}], "networks": [{"uuid": "47040a84-257e-4397-ad20-ae345d62717f"}]}} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 05:02:49.372344 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.network.neutron [None req-ebc04b0b-acee-481d-a3a0-cf0bb4d5c862 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] validate_networks() for [('47040a84-257e-4397-ad20-ae345d62717f', None, None, None, None, None)] {{(pid=121000) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 05:02:49.738888 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-ebc04b0b-acee-481d-a3a0-cf0bb4d5c862 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Flavor limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 05:02:49.739337 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-ebc04b0b-acee-481d-a3a0-cf0bb4d5c862 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Image limits 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 05:02:49.739833 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-ebc04b0b-acee-481d-a3a0-cf0bb4d5c862 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Flavor pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 05:02:49.740262 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-ebc04b0b-acee-481d-a3a0-cf0bb4d5c862 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Image pref 0:0:0 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 05:02:49.740693 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.virt.hardware [None req-ebc04b0b-acee-481d-a3a0-cf0bb4d5c862 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 05:02:49.750575 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ebc04b0b-acee-481d-a3a0-cf0bb4d5c862 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:02:49.751072 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ebc04b0b-acee-481d-a3a0-cf0bb4d5c862 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:02:49.751526 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ebc04b0b-acee-481d-a3a0-cf0bb4d5c862 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:02:49.752269 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ebc04b0b-acee-481d-a3a0-cf0bb4d5c862 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:02:49.752739 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ebc04b0b-acee-481d-a3a0-cf0bb4d5c862 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:02:49.753178 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-ebc04b0b-acee-481d-a3a0-cf0bb4d5c862 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:02:49.770563 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-ebc04b0b-acee-481d-a3a0-cf0bb4d5c862 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Getting quotas for project 6c894a9560d54542a80219708a9a7d0b. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 05:02:49.775896 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.quota [None req-ebc04b0b-acee-481d-a3a0-cf0bb4d5c862 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Getting quotas for user bf29495c1c284b4c9689ce1effb1bfff and project 6c894a9560d54542a80219708a9a7d0b. Resources: {'cores', 'instances', 'ram'} {{(pid=121000) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 05:02:49.788652 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ebc04b0b-acee-481d-a3a0-cf0bb4d5c862 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Going to run 1 instances... {{(pid=121000) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 05:02:49.791695 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-ebc04b0b-acee-481d-a3a0-cf0bb4d5c862 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] [instance: 2bdf1988-73c8-4f72-a2a2-8ccac87aab6a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6adac16-f7cd-4b1a-8114-15583a1fab5d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121000) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 05:02:49.908280 n-d-862769-1 devstack@n-api.service[121000]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ebc04b0b-acee-481d-a3a0-cf0bb4d5c862 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] [d1e0fee0-c007-4f4b-8cac-c2d0a8595428] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 27 05:02:50.066697 n-d-862769-1 devstack@n-api.service[121000]: INFO oslo.messaging._drivers.impl_rabbit [-] [5ec0dfad-6f0c-4686-8a67-f02607adfe50] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 60818. Oct 27 05:02:50.070102 n-d-862769-1 devstack@n-api.service[121000]: INFO oslo.messaging._drivers.impl_rabbit [-] [a40cf960-ae63-4112-9db5-88668ecbbc6d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 60820. Oct 27 05:02:50.916048 n-d-862769-1 devstack@n-api.service[121000]: INFO oslo.messaging._drivers.impl_rabbit [None req-ebc04b0b-acee-481d-a3a0-cf0bb4d5c862 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] [d1e0fee0-c007-4f4b-8cac-c2d0a8595428] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 60822. Oct 27 05:02:50.921442 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-ebc04b0b-acee-481d-a3a0-cf0bb4d5c862 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.865039 Oct 27 05:02:50.927292 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 4008/8315] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 27 05:02:49 2022] POST /compute/v2.1/servers => generated 406 bytes in 1867 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 05:02:50.935389 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-5dfbcb8f-b8f0-4678-a5ef-c225bb35ffa5 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 05:02:50.936113 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-5dfbcb8f-b8f0-4678-a5ef-c225bb35ffa5 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] [instance: 2bdf1988-73c8-4f72-a2a2-8ccac87aab6a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 05:02:50.951493 n-d-862769-1 devstack@n-api.service[121001]: INFO oslo.messaging._drivers.impl_rabbit [-] [5b59dcc8-77e8-4f93-abf1-649e725dfb1c] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 60828. Oct 27 05:02:50.965591 n-d-862769-1 devstack@n-api.service[121001]: INFO oslo.messaging._drivers.impl_rabbit [-] [74449df9-f77e-48cb-96a4-46691974a96d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 60826. Oct 27 05:02:51.049417 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-5dfbcb8f-b8f0-4678-a5ef-c225bb35ffa5 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf29495c1c284b4c9689ce1effb1bfff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c894a9560d54542a80219708a9a7d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 05:02:51.056324 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-5dfbcb8f-b8f0-4678-a5ef-c225bb35ffa5 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] 10.222.0.20 "GET /compute/v2.1/servers/2bdf1988-73c8-4f72-a2a2-8ccac87aab6a" status: 200 len: 1246 microversion: 2.1 time: 0.126839 Oct 27 05:02:51.056919 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4308/8316] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 05:02:50 2022] GET /compute/v2.1/servers/2bdf1988-73c8-4f72-a2a2-8ccac87aab6a => generated 1246 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 05:02:52.080850 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-1b0b6ca4-d234-44fa-ab9c-a2ec4af2cea2 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 05:02:52.081565 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-1b0b6ca4-d234-44fa-ab9c-a2ec4af2cea2 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] [instance: 2bdf1988-73c8-4f72-a2a2-8ccac87aab6a] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 05:02:52.091855 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1b0b6ca4-d234-44fa-ab9c-a2ec4af2cea2 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:02:52.092348 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1b0b6ca4-d234-44fa-ab9c-a2ec4af2cea2 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:02:52.092793 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1b0b6ca4-d234-44fa-ab9c-a2ec4af2cea2 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:02:52.093500 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1b0b6ca4-d234-44fa-ab9c-a2ec4af2cea2 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:02:52.093973 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1b0b6ca4-d234-44fa-ab9c-a2ec4af2cea2 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:02:52.094453 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-1b0b6ca4-d234-44fa-ab9c-a2ec4af2cea2 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:02:52.160459 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-1b0b6ca4-d234-44fa-ab9c-a2ec4af2cea2 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf29495c1c284b4c9689ce1effb1bfff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c894a9560d54542a80219708a9a7d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 05:02:52.168402 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-1b0b6ca4-d234-44fa-ab9c-a2ec4af2cea2 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] 10.222.0.20 "GET /compute/v2.1/servers/2bdf1988-73c8-4f72-a2a2-8ccac87aab6a" status: 200 len: 1250 microversion: 2.1 time: 0.092487 Oct 27 05:02:52.168981 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 4009/8317] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 05:02:52 2022] GET /compute/v2.1/servers/2bdf1988-73c8-4f72-a2a2-8ccac87aab6a => generated 1250 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 05:02:52.564269 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-f93662ca-2c18-4a50-850d-e93f475bbda6 req-e09ac850-9c58-4aca-a5eb-769ecf48e92c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ede9034d-6d65-43dc-8ae3-8f41358d913a", "name": "network-vif-unplugged", "status": "completed", "tag": "b5f2af4a-5bc8-48eb-bd82-0ef29a53a29a"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 05:02:52.575247 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-f93662ca-2c18-4a50-850d-e93f475bbda6 req-e09ac850-9c58-4aca-a5eb-769ecf48e92c service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:02:52.575749 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-f93662ca-2c18-4a50-850d-e93f475bbda6 req-e09ac850-9c58-4aca-a5eb-769ecf48e92c service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:02:52.576201 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-f93662ca-2c18-4a50-850d-e93f475bbda6 req-e09ac850-9c58-4aca-a5eb-769ecf48e92c service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:02:52.586367 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-f93662ca-2c18-4a50-850d-e93f475bbda6 req-e09ac850-9c58-4aca-a5eb-769ecf48e92c service nova] Creating event network-vif-unplugged:b5f2af4a-5bc8-48eb-bd82-0ef29a53a29a for instance ede9034d-6d65-43dc-8ae3-8f41358d913a on n-h1-862769-1 Oct 27 05:02:52.592302 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-f93662ca-2c18-4a50-850d-e93f475bbda6 req-e09ac850-9c58-4aca-a5eb-769ecf48e92c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.088085 Oct 27 05:02:52.592898 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4309/8318] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 05:02:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 05:02:53.192362 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-0bcb4afd-2c8d-4a68-88ba-9d2f48e7706b tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 05:02:53.193227 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-0bcb4afd-2c8d-4a68-88ba-9d2f48e7706b tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] [instance: 2bdf1988-73c8-4f72-a2a2-8ccac87aab6a] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 05:02:53.200204 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0bcb4afd-2c8d-4a68-88ba-9d2f48e7706b tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:02:53.200707 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0bcb4afd-2c8d-4a68-88ba-9d2f48e7706b tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:02:53.201350 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0bcb4afd-2c8d-4a68-88ba-9d2f48e7706b tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:02:53.202129 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0bcb4afd-2c8d-4a68-88ba-9d2f48e7706b tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:02:53.202633 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0bcb4afd-2c8d-4a68-88ba-9d2f48e7706b tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:02:53.203079 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-0bcb4afd-2c8d-4a68-88ba-9d2f48e7706b tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:02:53.271101 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-0bcb4afd-2c8d-4a68-88ba-9d2f48e7706b tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf29495c1c284b4c9689ce1effb1bfff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c894a9560d54542a80219708a9a7d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 05:02:53.278722 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-0bcb4afd-2c8d-4a68-88ba-9d2f48e7706b tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] 10.222.0.20 "GET /compute/v2.1/servers/2bdf1988-73c8-4f72-a2a2-8ccac87aab6a" status: 200 len: 1316 microversion: 2.1 time: 0.090705 Oct 27 05:02:53.279305 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 4010/8319] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 05:02:53 2022] GET /compute/v2.1/servers/2bdf1988-73c8-4f72-a2a2-8ccac87aab6a => generated 1316 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 05:02:54.304478 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b59b6b46-09fc-4a5e-80f8-0d96cec7bf4f tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 05:02:54.305801 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b59b6b46-09fc-4a5e-80f8-0d96cec7bf4f tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] [instance: 2bdf1988-73c8-4f72-a2a2-8ccac87aab6a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 05:02:54.313325 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b59b6b46-09fc-4a5e-80f8-0d96cec7bf4f tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:02:54.314077 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b59b6b46-09fc-4a5e-80f8-0d96cec7bf4f tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:02:54.314711 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b59b6b46-09fc-4a5e-80f8-0d96cec7bf4f tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:02:54.315687 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b59b6b46-09fc-4a5e-80f8-0d96cec7bf4f tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:02:54.316419 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b59b6b46-09fc-4a5e-80f8-0d96cec7bf4f tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:02:54.317114 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b59b6b46-09fc-4a5e-80f8-0d96cec7bf4f tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:02:54.476233 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b59b6b46-09fc-4a5e-80f8-0d96cec7bf4f tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf29495c1c284b4c9689ce1effb1bfff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c894a9560d54542a80219708a9a7d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 05:02:54.484530 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b59b6b46-09fc-4a5e-80f8-0d96cec7bf4f tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] 10.222.0.20 "GET /compute/v2.1/servers/2bdf1988-73c8-4f72-a2a2-8ccac87aab6a" status: 200 len: 1372 microversion: 2.1 time: 0.185235 Oct 27 05:02:54.485111 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4310/8320] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 05:02:54 2022] GET /compute/v2.1/servers/2bdf1988-73c8-4f72-a2a2-8ccac87aab6a => generated 1372 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 05:02:55.508127 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e5baeb5e-5e93-4c63-a626-f605cbd78a03 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 05:02:55.508761 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e5baeb5e-5e93-4c63-a626-f605cbd78a03 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] [instance: 2bdf1988-73c8-4f72-a2a2-8ccac87aab6a] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 05:02:55.516641 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e5baeb5e-5e93-4c63-a626-f605cbd78a03 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:02:55.517139 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e5baeb5e-5e93-4c63-a626-f605cbd78a03 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:02:55.517796 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e5baeb5e-5e93-4c63-a626-f605cbd78a03 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:02:55.518543 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e5baeb5e-5e93-4c63-a626-f605cbd78a03 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:02:55.519016 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e5baeb5e-5e93-4c63-a626-f605cbd78a03 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:02:55.519593 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e5baeb5e-5e93-4c63-a626-f605cbd78a03 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:02:55.668235 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-e5baeb5e-5e93-4c63-a626-f605cbd78a03 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf29495c1c284b4c9689ce1effb1bfff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c894a9560d54542a80219708a9a7d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 05:02:55.676911 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e5baeb5e-5e93-4c63-a626-f605cbd78a03 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] 10.222.0.20 "GET /compute/v2.1/servers/2bdf1988-73c8-4f72-a2a2-8ccac87aab6a" status: 200 len: 1372 microversion: 2.1 time: 0.171984 Oct 27 05:02:55.677676 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 4011/8321] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 05:02:55 2022] GET /compute/v2.1/servers/2bdf1988-73c8-4f72-a2a2-8ccac87aab6a => generated 1372 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 05:02:56.700533 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-27f8e4d3-fb5c-4efb-99bb-c05c617a0336 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 05:02:56.701197 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-27f8e4d3-fb5c-4efb-99bb-c05c617a0336 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] [instance: 2bdf1988-73c8-4f72-a2a2-8ccac87aab6a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 05:02:56.708777 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-27f8e4d3-fb5c-4efb-99bb-c05c617a0336 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:02:56.709278 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-27f8e4d3-fb5c-4efb-99bb-c05c617a0336 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:02:56.709735 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-27f8e4d3-fb5c-4efb-99bb-c05c617a0336 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:02:56.710499 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-27f8e4d3-fb5c-4efb-99bb-c05c617a0336 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:02:56.710978 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-27f8e4d3-fb5c-4efb-99bb-c05c617a0336 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:02:56.711503 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-27f8e4d3-fb5c-4efb-99bb-c05c617a0336 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:02:56.856597 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-27f8e4d3-fb5c-4efb-99bb-c05c617a0336 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf29495c1c284b4c9689ce1effb1bfff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c894a9560d54542a80219708a9a7d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 05:02:56.865274 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-27f8e4d3-fb5c-4efb-99bb-c05c617a0336 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] 10.222.0.20 "GET /compute/v2.1/servers/2bdf1988-73c8-4f72-a2a2-8ccac87aab6a" status: 200 len: 1372 microversion: 2.1 time: 0.168482 Oct 27 05:02:56.866262 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4311/8322] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 05:02:56 2022] GET /compute/v2.1/servers/2bdf1988-73c8-4f72-a2a2-8ccac87aab6a => generated 1372 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 05:02:57.889881 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-44fbb58c-39e9-48e4-a894-bcc8e95ec8e8 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 05:02:57.890957 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-44fbb58c-39e9-48e4-a894-bcc8e95ec8e8 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] [instance: 2bdf1988-73c8-4f72-a2a2-8ccac87aab6a] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 05:02:57.898584 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-44fbb58c-39e9-48e4-a894-bcc8e95ec8e8 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:02:57.899199 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-44fbb58c-39e9-48e4-a894-bcc8e95ec8e8 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:02:57.899723 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-44fbb58c-39e9-48e4-a894-bcc8e95ec8e8 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:02:57.901087 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-44fbb58c-39e9-48e4-a894-bcc8e95ec8e8 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:02:57.901796 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-44fbb58c-39e9-48e4-a894-bcc8e95ec8e8 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:02:57.902281 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-44fbb58c-39e9-48e4-a894-bcc8e95ec8e8 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:02:58.049278 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-44fbb58c-39e9-48e4-a894-bcc8e95ec8e8 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf29495c1c284b4c9689ce1effb1bfff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c894a9560d54542a80219708a9a7d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 05:02:58.058332 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-44fbb58c-39e9-48e4-a894-bcc8e95ec8e8 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] 10.222.0.20 "GET /compute/v2.1/servers/2bdf1988-73c8-4f72-a2a2-8ccac87aab6a" status: 200 len: 1372 microversion: 2.1 time: 0.173070 Oct 27 05:02:58.058941 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 4012/8323] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 05:02:57 2022] GET /compute/v2.1/servers/2bdf1988-73c8-4f72-a2a2-8ccac87aab6a => generated 1372 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 05:02:59.083340 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4604e657-4c52-4ad1-bae0-eb538b8895b0 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 05:02:59.084632 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4604e657-4c52-4ad1-bae0-eb538b8895b0 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] [instance: 2bdf1988-73c8-4f72-a2a2-8ccac87aab6a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 05:02:59.092500 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4604e657-4c52-4ad1-bae0-eb538b8895b0 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:02:59.093007 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4604e657-4c52-4ad1-bae0-eb538b8895b0 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:02:59.093632 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4604e657-4c52-4ad1-bae0-eb538b8895b0 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:02:59.094646 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4604e657-4c52-4ad1-bae0-eb538b8895b0 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:02:59.095329 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4604e657-4c52-4ad1-bae0-eb538b8895b0 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:02:59.095977 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4604e657-4c52-4ad1-bae0-eb538b8895b0 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:02:59.246354 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4604e657-4c52-4ad1-bae0-eb538b8895b0 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf29495c1c284b4c9689ce1effb1bfff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c894a9560d54542a80219708a9a7d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 05:02:59.254057 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4604e657-4c52-4ad1-bae0-eb538b8895b0 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] 10.222.0.20 "GET /compute/v2.1/servers/2bdf1988-73c8-4f72-a2a2-8ccac87aab6a" status: 200 len: 1372 microversion: 2.1 time: 0.174631 Oct 27 05:02:59.254652 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4312/8324] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 05:02:59 2022] GET /compute/v2.1/servers/2bdf1988-73c8-4f72-a2a2-8ccac87aab6a => generated 1372 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 05:03:00.279567 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4dcc83dc-71dd-4885-98d2-876aaa5504b8 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 05:03:00.280532 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4dcc83dc-71dd-4885-98d2-876aaa5504b8 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] [instance: 2bdf1988-73c8-4f72-a2a2-8ccac87aab6a] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 05:03:00.287456 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=2 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 05:03:00.288425 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell0:SELECT=6 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 05:03:00.290345 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4dcc83dc-71dd-4885-98d2-876aaa5504b8 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:03:00.291458 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4dcc83dc-71dd-4885-98d2-876aaa5504b8 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:03:00.291985 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4dcc83dc-71dd-4885-98d2-876aaa5504b8 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:03:00.292960 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4dcc83dc-71dd-4885-98d2-876aaa5504b8 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:03:00.293461 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4dcc83dc-71dd-4885-98d2-876aaa5504b8 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:03:00.293900 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4dcc83dc-71dd-4885-98d2-876aaa5504b8 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:03:00.476460 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4dcc83dc-71dd-4885-98d2-876aaa5504b8 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf29495c1c284b4c9689ce1effb1bfff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c894a9560d54542a80219708a9a7d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 05:03:00.488142 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4dcc83dc-71dd-4885-98d2-876aaa5504b8 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] 10.222.0.20 "GET /compute/v2.1/servers/2bdf1988-73c8-4f72-a2a2-8ccac87aab6a" status: 200 len: 1372 microversion: 2.1 time: 0.212558 Oct 27 05:03:00.488958 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 4013/8325] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 05:03:00 2022] GET /compute/v2.1/servers/2bdf1988-73c8-4f72-a2a2-8ccac87aab6a => generated 1372 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 05:03:01.513370 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-b2cee2c6-8a4a-4d38-bfdc-b5621f2a4436 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 05:03:01.514061 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-b2cee2c6-8a4a-4d38-bfdc-b5621f2a4436 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] [instance: 2bdf1988-73c8-4f72-a2a2-8ccac87aab6a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 05:03:01.516952 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell0:SELECT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 05:03:01.521807 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b2cee2c6-8a4a-4d38-bfdc-b5621f2a4436 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:03:01.522355 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b2cee2c6-8a4a-4d38-bfdc-b5621f2a4436 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:03:01.522821 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b2cee2c6-8a4a-4d38-bfdc-b5621f2a4436 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:03:01.523546 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b2cee2c6-8a4a-4d38-bfdc-b5621f2a4436 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:03:01.524026 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b2cee2c6-8a4a-4d38-bfdc-b5621f2a4436 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:03:01.524480 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-b2cee2c6-8a4a-4d38-bfdc-b5621f2a4436 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:03:01.658373 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-b2cee2c6-8a4a-4d38-bfdc-b5621f2a4436 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf29495c1c284b4c9689ce1effb1bfff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c894a9560d54542a80219708a9a7d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 05:03:01.667997 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-b2cee2c6-8a4a-4d38-bfdc-b5621f2a4436 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] 10.222.0.20 "GET /compute/v2.1/servers/2bdf1988-73c8-4f72-a2a2-8ccac87aab6a" status: 200 len: 1372 microversion: 2.1 time: 0.156708 Oct 27 05:03:01.669198 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4313/8326] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 05:03:01 2022] GET /compute/v2.1/servers/2bdf1988-73c8-4f72-a2a2-8ccac87aab6a => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 05:03:02.692878 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2ad4481a-7583-4b59-86b0-20e3088688da tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 05:03:02.693510 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-2ad4481a-7583-4b59-86b0-20e3088688da tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] [instance: 2bdf1988-73c8-4f72-a2a2-8ccac87aab6a] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 05:03:02.701088 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2ad4481a-7583-4b59-86b0-20e3088688da tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:03:02.701716 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2ad4481a-7583-4b59-86b0-20e3088688da tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:03:02.702218 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2ad4481a-7583-4b59-86b0-20e3088688da tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:03:02.702938 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2ad4481a-7583-4b59-86b0-20e3088688da tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:03:02.703398 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2ad4481a-7583-4b59-86b0-20e3088688da tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:03:02.703828 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2ad4481a-7583-4b59-86b0-20e3088688da tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:03:02.902879 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2ad4481a-7583-4b59-86b0-20e3088688da tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf29495c1c284b4c9689ce1effb1bfff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c894a9560d54542a80219708a9a7d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 05:03:02.911505 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2ad4481a-7583-4b59-86b0-20e3088688da tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] 10.222.0.20 "GET /compute/v2.1/servers/2bdf1988-73c8-4f72-a2a2-8ccac87aab6a" status: 200 len: 1372 microversion: 2.1 time: 0.222498 Oct 27 05:03:02.917010 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 4014/8327] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 05:03:02 2022] GET /compute/v2.1/servers/2bdf1988-73c8-4f72-a2a2-8ccac87aab6a => generated 1372 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 05:03:03.013255 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-97350441-d039-4891-b9ab-4af1bbd53878 req-f4f44dc6-c237-4d4b-b994-ea23ded0b012 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bdf1988-73c8-4f72-a2a2-8ccac87aab6a", "tag": "35047a72-5799-4e9d-861e-808463cac77d"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 05:03:03.023486 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-97350441-d039-4891-b9ab-4af1bbd53878 req-f4f44dc6-c237-4d4b-b994-ea23ded0b012 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:03:03.024002 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-97350441-d039-4891-b9ab-4af1bbd53878 req-f4f44dc6-c237-4d4b-b994-ea23ded0b012 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:03:03.024439 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-97350441-d039-4891-b9ab-4af1bbd53878 req-f4f44dc6-c237-4d4b-b994-ea23ded0b012 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:03:03.035724 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-97350441-d039-4891-b9ab-4af1bbd53878 req-f4f44dc6-c237-4d4b-b994-ea23ded0b012 service nova] Creating event network-changed:35047a72-5799-4e9d-861e-808463cac77d for instance 2bdf1988-73c8-4f72-a2a2-8ccac87aab6a on n-h2-862769-1 Oct 27 05:03:03.040825 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-97350441-d039-4891-b9ab-4af1bbd53878 req-f4f44dc6-c237-4d4b-b994-ea23ded0b012 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031347 Oct 27 05:03:03.042169 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4314/8328] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 05:03:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 05:03:03.935860 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-90e38f6e-fa65-4b86-b965-a8c32d66f5b7 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 05:03:03.936420 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-90e38f6e-fa65-4b86-b965-a8c32d66f5b7 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] [instance: 2bdf1988-73c8-4f72-a2a2-8ccac87aab6a] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 05:03:03.943259 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-90e38f6e-fa65-4b86-b965-a8c32d66f5b7 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:03:03.943757 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-90e38f6e-fa65-4b86-b965-a8c32d66f5b7 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:03:03.944196 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-90e38f6e-fa65-4b86-b965-a8c32d66f5b7 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:03:03.944900 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-90e38f6e-fa65-4b86-b965-a8c32d66f5b7 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:03:03.945359 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-90e38f6e-fa65-4b86-b965-a8c32d66f5b7 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:03:03.945789 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-90e38f6e-fa65-4b86-b965-a8c32d66f5b7 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:03:04.080776 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-90e38f6e-fa65-4b86-b965-a8c32d66f5b7 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf29495c1c284b4c9689ce1effb1bfff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c894a9560d54542a80219708a9a7d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 05:03:04.088518 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-90e38f6e-fa65-4b86-b965-a8c32d66f5b7 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] 10.222.0.20 "GET /compute/v2.1/servers/2bdf1988-73c8-4f72-a2a2-8ccac87aab6a" status: 200 len: 1372 microversion: 2.1 time: 0.157011 Oct 27 05:03:04.089115 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 4015/8329] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 05:03:03 2022] GET /compute/v2.1/servers/2bdf1988-73c8-4f72-a2a2-8ccac87aab6a => generated 1372 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 05:03:05.112776 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2f6dff2e-514b-4c83-b291-173c561cb7f4 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 05:03:05.113419 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2f6dff2e-514b-4c83-b291-173c561cb7f4 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] [instance: 2bdf1988-73c8-4f72-a2a2-8ccac87aab6a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 05:03:05.120463 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2f6dff2e-514b-4c83-b291-173c561cb7f4 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:03:05.120966 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2f6dff2e-514b-4c83-b291-173c561cb7f4 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:03:05.121429 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2f6dff2e-514b-4c83-b291-173c561cb7f4 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:03:05.122208 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2f6dff2e-514b-4c83-b291-173c561cb7f4 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:03:05.122687 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2f6dff2e-514b-4c83-b291-173c561cb7f4 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:03:05.123159 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2f6dff2e-514b-4c83-b291-173c561cb7f4 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:03:05.255094 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-2f6dff2e-514b-4c83-b291-173c561cb7f4 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf29495c1c284b4c9689ce1effb1bfff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c894a9560d54542a80219708a9a7d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 05:03:05.262878 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2f6dff2e-514b-4c83-b291-173c561cb7f4 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] 10.222.0.20 "GET /compute/v2.1/servers/2bdf1988-73c8-4f72-a2a2-8ccac87aab6a" status: 200 len: 1372 microversion: 2.1 time: 0.155390 Oct 27 05:03:05.263456 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4315/8330] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 05:03:05 2022] GET /compute/v2.1/servers/2bdf1988-73c8-4f72-a2a2-8ccac87aab6a => generated 1372 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 05:03:06.285734 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2c554d20-f910-429f-ae5a-ea2fe702d858 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 05:03:06.286383 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-2c554d20-f910-429f-ae5a-ea2fe702d858 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] [instance: 2bdf1988-73c8-4f72-a2a2-8ccac87aab6a] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 05:03:06.293856 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2c554d20-f910-429f-ae5a-ea2fe702d858 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:03:06.294379 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2c554d20-f910-429f-ae5a-ea2fe702d858 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:03:06.294820 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2c554d20-f910-429f-ae5a-ea2fe702d858 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:03:06.295522 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2c554d20-f910-429f-ae5a-ea2fe702d858 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:03:06.295978 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2c554d20-f910-429f-ae5a-ea2fe702d858 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:03:06.296407 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2c554d20-f910-429f-ae5a-ea2fe702d858 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:03:06.435209 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2c554d20-f910-429f-ae5a-ea2fe702d858 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf29495c1c284b4c9689ce1effb1bfff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c894a9560d54542a80219708a9a7d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 05:03:06.443341 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2c554d20-f910-429f-ae5a-ea2fe702d858 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] 10.222.0.20 "GET /compute/v2.1/servers/2bdf1988-73c8-4f72-a2a2-8ccac87aab6a" status: 200 len: 1372 microversion: 2.1 time: 0.161544 Oct 27 05:03:06.443968 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 4016/8331] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 05:03:06 2022] GET /compute/v2.1/servers/2bdf1988-73c8-4f72-a2a2-8ccac87aab6a => generated 1372 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 05:03:07.467832 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1da2475f-5c49-495a-af96-f9b8b7a75a34 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 05:03:07.468470 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1da2475f-5c49-495a-af96-f9b8b7a75a34 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] [instance: 2bdf1988-73c8-4f72-a2a2-8ccac87aab6a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 05:03:07.475283 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1da2475f-5c49-495a-af96-f9b8b7a75a34 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:03:07.475780 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1da2475f-5c49-495a-af96-f9b8b7a75a34 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:03:07.476237 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1da2475f-5c49-495a-af96-f9b8b7a75a34 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:03:07.476948 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1da2475f-5c49-495a-af96-f9b8b7a75a34 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:03:07.477421 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1da2475f-5c49-495a-af96-f9b8b7a75a34 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:03:07.477863 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1da2475f-5c49-495a-af96-f9b8b7a75a34 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:03:07.610462 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-1da2475f-5c49-495a-af96-f9b8b7a75a34 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf29495c1c284b4c9689ce1effb1bfff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c894a9560d54542a80219708a9a7d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 05:03:07.618267 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1da2475f-5c49-495a-af96-f9b8b7a75a34 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] 10.222.0.20 "GET /compute/v2.1/servers/2bdf1988-73c8-4f72-a2a2-8ccac87aab6a" status: 200 len: 1372 microversion: 2.1 time: 0.154289 Oct 27 05:03:07.619118 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4316/8332] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 05:03:07 2022] GET /compute/v2.1/servers/2bdf1988-73c8-4f72-a2a2-8ccac87aab6a => generated 1372 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 05:03:08.481130 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-a97abcb6-d6f3-4c0e-bde3-090ad3122c32 req-c1f07c87-9f1c-419d-9339-9d3998597604 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bdf1988-73c8-4f72-a2a2-8ccac87aab6a", "name": "network-vif-plugged", "status": "completed", "tag": "35047a72-5799-4e9d-861e-808463cac77d"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 05:03:08.491450 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-a97abcb6-d6f3-4c0e-bde3-090ad3122c32 req-c1f07c87-9f1c-419d-9339-9d3998597604 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:03:08.491938 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-a97abcb6-d6f3-4c0e-bde3-090ad3122c32 req-c1f07c87-9f1c-419d-9339-9d3998597604 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:03:08.492378 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-a97abcb6-d6f3-4c0e-bde3-090ad3122c32 req-c1f07c87-9f1c-419d-9339-9d3998597604 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:03:08.504103 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-a97abcb6-d6f3-4c0e-bde3-090ad3122c32 req-c1f07c87-9f1c-419d-9339-9d3998597604 service nova] Creating event network-vif-plugged:35047a72-5799-4e9d-861e-808463cac77d for instance 2bdf1988-73c8-4f72-a2a2-8ccac87aab6a on n-h2-862769-1 Oct 27 05:03:08.509245 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-a97abcb6-d6f3-4c0e-bde3-090ad3122c32 req-c1f07c87-9f1c-419d-9339-9d3998597604 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032373 Oct 27 05:03:08.517663 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 4017/8333] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 05:03:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 05:03:08.641050 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4861d594-852f-4462-8aec-8d90d1fca8d6 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 05:03:08.641694 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4861d594-852f-4462-8aec-8d90d1fca8d6 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] [instance: 2bdf1988-73c8-4f72-a2a2-8ccac87aab6a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 05:03:08.648583 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4861d594-852f-4462-8aec-8d90d1fca8d6 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:03:08.649091 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4861d594-852f-4462-8aec-8d90d1fca8d6 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:03:08.649555 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4861d594-852f-4462-8aec-8d90d1fca8d6 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:03:08.650913 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4861d594-852f-4462-8aec-8d90d1fca8d6 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:03:08.651396 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4861d594-852f-4462-8aec-8d90d1fca8d6 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:03:08.651848 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4861d594-852f-4462-8aec-8d90d1fca8d6 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:03:08.785710 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4861d594-852f-4462-8aec-8d90d1fca8d6 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf29495c1c284b4c9689ce1effb1bfff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c894a9560d54542a80219708a9a7d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 05:03:08.794114 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4861d594-852f-4462-8aec-8d90d1fca8d6 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] 10.222.0.20 "GET /compute/v2.1/servers/2bdf1988-73c8-4f72-a2a2-8ccac87aab6a" status: 200 len: 1372 microversion: 2.1 time: 0.157087 Oct 27 05:03:08.794702 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4317/8334] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 05:03:08 2022] GET /compute/v2.1/servers/2bdf1988-73c8-4f72-a2a2-8ccac87aab6a => generated 1372 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 05:03:09.818323 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-054e5951-de09-40a3-b317-a3b3f6a273cd tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 05:03:09.819035 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-054e5951-de09-40a3-b317-a3b3f6a273cd tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] [instance: 2bdf1988-73c8-4f72-a2a2-8ccac87aab6a] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 05:03:09.825618 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-054e5951-de09-40a3-b317-a3b3f6a273cd tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:03:09.826143 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-054e5951-de09-40a3-b317-a3b3f6a273cd tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:03:09.828492 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-054e5951-de09-40a3-b317-a3b3f6a273cd tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:03:09.828492 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-054e5951-de09-40a3-b317-a3b3f6a273cd tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:03:09.828492 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-054e5951-de09-40a3-b317-a3b3f6a273cd tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:03:09.828492 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-054e5951-de09-40a3-b317-a3b3f6a273cd tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:03:09.961378 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-054e5951-de09-40a3-b317-a3b3f6a273cd tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf29495c1c284b4c9689ce1effb1bfff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c894a9560d54542a80219708a9a7d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 05:03:09.969828 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-054e5951-de09-40a3-b317-a3b3f6a273cd tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] 10.222.0.20 "GET /compute/v2.1/servers/2bdf1988-73c8-4f72-a2a2-8ccac87aab6a" status: 200 len: 1557 microversion: 2.1 time: 0.156765 Oct 27 05:03:09.970438 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 4018/8335] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 05:03:09 2022] GET /compute/v2.1/servers/2bdf1988-73c8-4f72-a2a2-8ccac87aab6a => generated 1557 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 05:03:09.991990 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-4304dbf8-2204-4519-aeee-b53cec41e44d tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 05:03:09.992632 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-4304dbf8-2204-4519-aeee-b53cec41e44d tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] [instance: 2bdf1988-73c8-4f72-a2a2-8ccac87aab6a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 05:03:09.999707 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4304dbf8-2204-4519-aeee-b53cec41e44d tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:03:10.000212 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4304dbf8-2204-4519-aeee-b53cec41e44d tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:03:10.000685 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4304dbf8-2204-4519-aeee-b53cec41e44d tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:03:10.001401 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4304dbf8-2204-4519-aeee-b53cec41e44d tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:03:10.001881 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4304dbf8-2204-4519-aeee-b53cec41e44d tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:03:10.002358 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-4304dbf8-2204-4519-aeee-b53cec41e44d tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:03:10.135681 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-4304dbf8-2204-4519-aeee-b53cec41e44d tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf29495c1c284b4c9689ce1effb1bfff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c894a9560d54542a80219708a9a7d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 05:03:10.143410 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-4304dbf8-2204-4519-aeee-b53cec41e44d tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] 10.222.0.20 "GET /compute/v2.1/servers/2bdf1988-73c8-4f72-a2a2-8ccac87aab6a" status: 200 len: 1557 microversion: 2.1 time: 0.155308 Oct 27 05:03:10.143985 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4318/8336] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 05:03:09 2022] GET /compute/v2.1/servers/2bdf1988-73c8-4f72-a2a2-8ccac87aab6a => generated 1557 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 05:03:12.320702 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-d3238175-50c6-4574-9e68-0655103a9867 req-d286f705-c3da-4467-b390-3aa2c8a95efc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bdf1988-73c8-4f72-a2a2-8ccac87aab6a", "tag": "35047a72-5799-4e9d-861e-808463cac77d"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 05:03:12.332033 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-d3238175-50c6-4574-9e68-0655103a9867 req-d286f705-c3da-4467-b390-3aa2c8a95efc service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:03:12.332522 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-d3238175-50c6-4574-9e68-0655103a9867 req-d286f705-c3da-4467-b390-3aa2c8a95efc service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:03:12.332959 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-d3238175-50c6-4574-9e68-0655103a9867 req-d286f705-c3da-4467-b390-3aa2c8a95efc service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:03:12.345132 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-d3238175-50c6-4574-9e68-0655103a9867 req-d286f705-c3da-4467-b390-3aa2c8a95efc service nova] Creating event network-changed:35047a72-5799-4e9d-861e-808463cac77d for instance 2bdf1988-73c8-4f72-a2a2-8ccac87aab6a on n-h2-862769-1 Oct 27 05:03:12.350832 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-d3238175-50c6-4574-9e68-0655103a9867 req-d286f705-c3da-4467-b390-3aa2c8a95efc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033793 Oct 27 05:03:12.351548 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 4019/8337] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 05:03:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 05:04:33.480945 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=26 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 05:04:33.481749 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=54 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 05:04:33.486741 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-2f890f24-5dc7-471d-ba9a-928efdf5d603 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1785663889"}} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 05:04:33.495041 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-2f890f24-5dc7-471d-ba9a-928efdf5d603 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] [instance: 2bdf1988-73c8-4f72-a2a2-8ccac87aab6a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 05:04:33.495435 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2f890f24-5dc7-471d-ba9a-928efdf5d603 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:04:33.496003 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2f890f24-5dc7-471d-ba9a-928efdf5d603 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:04:33.496478 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2f890f24-5dc7-471d-ba9a-928efdf5d603 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:04:33.497189 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2f890f24-5dc7-471d-ba9a-928efdf5d603 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:04:33.497662 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2f890f24-5dc7-471d-ba9a-928efdf5d603 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:04:33.498137 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-2f890f24-5dc7-471d-ba9a-928efdf5d603 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:04:33.822927 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-2f890f24-5dc7-471d-ba9a-928efdf5d603 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] 10.222.0.20 "POST /compute/v2.1/servers/2bdf1988-73c8-4f72-a2a2-8ccac87aab6a/action" status: 202 len: 0 microversion: 2.1 time: 0.344378 Oct 27 05:04:33.823507 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4319/8338] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 27 05:04:33 2022] POST /compute/v2.1/servers/2bdf1988-73c8-4f72-a2a2-8ccac87aab6a/action => generated 0 bytes in 346 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 27 05:04:38.881578 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 05:04:38.884684 n-d-862769-1 devstack@n-api.service[121000]: DEBUG dbcounter [-] [121000] Writing DB stats nova_cell1:SELECT=60 {{(pid=121000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 05:04:38.884684 n-d-862769-1 devstack@n-api.service[121000]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 05:04:38.884684 n-d-862769-1 devstack@n-api.service[121000]: Thu Oct 27 05:04:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.20) !!! Oct 27 05:04:38.889229 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-863a09f4-206f-45cc-b458-826155bf838f req-2757d237-af43-40da-bfca-e3485f422f45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bdf1988-73c8-4f72-a2a2-8ccac87aab6a", "name": "network-vif-plugged", "status": "completed", "tag": "35047a72-5799-4e9d-861e-808463cac77d"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 05:04:38.901795 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-863a09f4-206f-45cc-b458-826155bf838f req-2757d237-af43-40da-bfca-e3485f422f45 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:04:38.902848 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-863a09f4-206f-45cc-b458-826155bf838f req-2757d237-af43-40da-bfca-e3485f422f45 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:04:38.903296 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-863a09f4-206f-45cc-b458-826155bf838f req-2757d237-af43-40da-bfca-e3485f422f45 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:04:38.915458 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-863a09f4-206f-45cc-b458-826155bf838f req-2757d237-af43-40da-bfca-e3485f422f45 service nova] Creating event network-vif-plugged:35047a72-5799-4e9d-861e-808463cac77d for instance 2bdf1988-73c8-4f72-a2a2-8ccac87aab6a on n-h2-862769-1 Oct 27 05:04:38.922196 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-863a09f4-206f-45cc-b458-826155bf838f req-2757d237-af43-40da-bfca-e3485f422f45 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043441 Oct 27 05:04:38.923153 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 4020/8339] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 05:04:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 05:04:50.110615 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-1493d1d2-c1f5-4620-b9ee-022252ce9fbb tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 05:04:50.111239 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1493d1d2-c1f5-4620-b9ee-022252ce9fbb tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] [instance: 2bdf1988-73c8-4f72-a2a2-8ccac87aab6a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 05:04:50.114496 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_api:SELECT=2 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 05:04:50.115338 n-d-862769-1 devstack@n-api.service[121001]: DEBUG dbcounter [-] [121001] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 05:04:50.120867 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1493d1d2-c1f5-4620-b9ee-022252ce9fbb tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:04:50.121437 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1493d1d2-c1f5-4620-b9ee-022252ce9fbb tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:04:50.121908 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1493d1d2-c1f5-4620-b9ee-022252ce9fbb tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:04:50.122807 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1493d1d2-c1f5-4620-b9ee-022252ce9fbb tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:04:50.123415 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1493d1d2-c1f5-4620-b9ee-022252ce9fbb tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:04:50.124405 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-1493d1d2-c1f5-4620-b9ee-022252ce9fbb tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:04:50.153609 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-1493d1d2-c1f5-4620-b9ee-022252ce9fbb tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] [instance: 2bdf1988-73c8-4f72-a2a2-8ccac87aab6a] Going to try to terminate instance {{(pid=121001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 05:04:50.182692 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-4b9c90ea-cbf5-4daa-85e3-2ab3f56bc17a req-6312be8a-7594-4221-afcd-a0836f6e3a94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bdf1988-73c8-4f72-a2a2-8ccac87aab6a", "tag": "35047a72-5799-4e9d-861e-808463cac77d"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 05:04:50.194334 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-4b9c90ea-cbf5-4daa-85e3-2ab3f56bc17a req-6312be8a-7594-4221-afcd-a0836f6e3a94 service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:04:50.206461 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-4b9c90ea-cbf5-4daa-85e3-2ab3f56bc17a req-6312be8a-7594-4221-afcd-a0836f6e3a94 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:04:50.206461 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-4b9c90ea-cbf5-4daa-85e3-2ab3f56bc17a req-6312be8a-7594-4221-afcd-a0836f6e3a94 service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:04:50.207903 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-4b9c90ea-cbf5-4daa-85e3-2ab3f56bc17a req-6312be8a-7594-4221-afcd-a0836f6e3a94 service nova] Creating event network-changed:35047a72-5799-4e9d-861e-808463cac77d for instance 2bdf1988-73c8-4f72-a2a2-8ccac87aab6a on n-h2-862769-1 Oct 27 05:04:50.213728 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-4b9c90ea-cbf5-4daa-85e3-2ab3f56bc17a req-6312be8a-7594-4221-afcd-a0836f6e3a94 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104916 Oct 27 05:04:50.214391 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 4021/8340] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 05:04:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 05:04:50.473700 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-1493d1d2-c1f5-4620-b9ee-022252ce9fbb tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2bdf1988-73c8-4f72-a2a2-8ccac87aab6a" status: 204 len: 0 microversion: 2.1 time: 0.367711 Oct 27 05:04:50.474365 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4320/8341] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 05:04:50 2022] DELETE /compute/v2.1/servers/2bdf1988-73c8-4f72-a2a2-8ccac87aab6a => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 05:04:50.483834 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-2d732a6b-ae9f-4a10-8908-e9e459f0f14b tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 05:04:50.484668 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-2d732a6b-ae9f-4a10-8908-e9e459f0f14b tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] [instance: 2bdf1988-73c8-4f72-a2a2-8ccac87aab6a] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 05:04:50.492602 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2d732a6b-ae9f-4a10-8908-e9e459f0f14b tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:04:50.493289 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2d732a6b-ae9f-4a10-8908-e9e459f0f14b tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:04:50.493832 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2d732a6b-ae9f-4a10-8908-e9e459f0f14b tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:04:50.495049 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2d732a6b-ae9f-4a10-8908-e9e459f0f14b tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:04:50.495581 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2d732a6b-ae9f-4a10-8908-e9e459f0f14b tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:04:50.496103 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-2d732a6b-ae9f-4a10-8908-e9e459f0f14b tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:04:50.640182 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-2d732a6b-ae9f-4a10-8908-e9e459f0f14b tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf29495c1c284b4c9689ce1effb1bfff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c894a9560d54542a80219708a9a7d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 05:04:50.647911 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-2d732a6b-ae9f-4a10-8908-e9e459f0f14b tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] 10.222.0.20 "GET /compute/v2.1/servers/2bdf1988-73c8-4f72-a2a2-8ccac87aab6a" status: 200 len: 1681 microversion: 2.1 time: 0.168935 Oct 27 05:04:50.648497 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 4022/8342] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 05:04:50 2022] GET /compute/v2.1/servers/2bdf1988-73c8-4f72-a2a2-8ccac87aab6a => generated 1681 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 05:04:50.892620 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-7e344612-a825-4ddf-8902-d42ebedbc26c req-8c9749bf-43d3-40ae-998f-6bf7ccf180dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bdf1988-73c8-4f72-a2a2-8ccac87aab6a", "name": "network-vif-unplugged", "status": "completed", "tag": "35047a72-5799-4e9d-861e-808463cac77d"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 05:04:50.902224 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-7e344612-a825-4ddf-8902-d42ebedbc26c req-8c9749bf-43d3-40ae-998f-6bf7ccf180dc service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:04:50.902847 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-7e344612-a825-4ddf-8902-d42ebedbc26c req-8c9749bf-43d3-40ae-998f-6bf7ccf180dc service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:04:50.903309 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-7e344612-a825-4ddf-8902-d42ebedbc26c req-8c9749bf-43d3-40ae-998f-6bf7ccf180dc service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:04:50.914715 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-7e344612-a825-4ddf-8902-d42ebedbc26c req-8c9749bf-43d3-40ae-998f-6bf7ccf180dc service nova] Creating event network-vif-unplugged:35047a72-5799-4e9d-861e-808463cac77d for instance 2bdf1988-73c8-4f72-a2a2-8ccac87aab6a on n-h2-862769-1 Oct 27 05:04:50.926716 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-7e344612-a825-4ddf-8902-d42ebedbc26c req-8c9749bf-43d3-40ae-998f-6bf7ccf180dc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033786 Oct 27 05:04:50.926716 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4321/8343] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 05:04:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 05:04:51.672164 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-dc4fc099-cc79-4654-a2fb-36166efabbd3 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 05:04:51.672812 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-dc4fc099-cc79-4654-a2fb-36166efabbd3 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] [instance: 2bdf1988-73c8-4f72-a2a2-8ccac87aab6a] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 05:04:51.679828 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dc4fc099-cc79-4654-a2fb-36166efabbd3 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:04:51.680624 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dc4fc099-cc79-4654-a2fb-36166efabbd3 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:04:51.681070 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dc4fc099-cc79-4654-a2fb-36166efabbd3 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:04:51.681770 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dc4fc099-cc79-4654-a2fb-36166efabbd3 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:04:51.682261 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dc4fc099-cc79-4654-a2fb-36166efabbd3 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:04:51.682694 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-dc4fc099-cc79-4654-a2fb-36166efabbd3 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:04:51.873988 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-dc4fc099-cc79-4654-a2fb-36166efabbd3 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf29495c1c284b4c9689ce1effb1bfff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c894a9560d54542a80219708a9a7d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 05:04:51.881875 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-dc4fc099-cc79-4654-a2fb-36166efabbd3 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] 10.222.0.20 "GET /compute/v2.1/servers/2bdf1988-73c8-4f72-a2a2-8ccac87aab6a" status: 200 len: 1681 microversion: 2.1 time: 0.213709 Oct 27 05:04:51.882525 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 4023/8344] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 05:04:51 2022] GET /compute/v2.1/servers/2bdf1988-73c8-4f72-a2a2-8ccac87aab6a => generated 1681 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 05:04:52.566689 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-330635e7-8a19-4878-ac58-642d51e8d720 req-fcc9ba2b-981e-406d-bcc0-d810fa7216ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bdf1988-73c8-4f72-a2a2-8ccac87aab6a", "name": "network-vif-deleted", "tag": "35047a72-5799-4e9d-861e-808463cac77d"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 05:04:52.577624 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-330635e7-8a19-4878-ac58-642d51e8d720 req-fcc9ba2b-981e-406d-bcc0-d810fa7216ab service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:04:52.578705 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-330635e7-8a19-4878-ac58-642d51e8d720 req-fcc9ba2b-981e-406d-bcc0-d810fa7216ab service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:04:52.579155 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-330635e7-8a19-4878-ac58-642d51e8d720 req-fcc9ba2b-981e-406d-bcc0-d810fa7216ab service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:04:52.591867 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-330635e7-8a19-4878-ac58-642d51e8d720 req-fcc9ba2b-981e-406d-bcc0-d810fa7216ab service nova] Creating event network-vif-deleted:35047a72-5799-4e9d-861e-808463cac77d for instance 2bdf1988-73c8-4f72-a2a2-8ccac87aab6a on n-h2-862769-1 Oct 27 05:04:52.597264 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-330635e7-8a19-4878-ac58-642d51e8d720 req-fcc9ba2b-981e-406d-bcc0-d810fa7216ab service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087616 Oct 27 05:04:52.597869 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4322/8345] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 05:04:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 05:04:52.907442 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-a07fde8c-fe6f-4aa7-a26f-b7b22dce25c8 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 05:04:52.908286 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-a07fde8c-fe6f-4aa7-a26f-b7b22dce25c8 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] [instance: 2bdf1988-73c8-4f72-a2a2-8ccac87aab6a] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 05:04:52.915639 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a07fde8c-fe6f-4aa7-a26f-b7b22dce25c8 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:04:52.916119 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a07fde8c-fe6f-4aa7-a26f-b7b22dce25c8 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:04:52.916732 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a07fde8c-fe6f-4aa7-a26f-b7b22dce25c8 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:04:52.917486 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a07fde8c-fe6f-4aa7-a26f-b7b22dce25c8 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:04:52.917950 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a07fde8c-fe6f-4aa7-a26f-b7b22dce25c8 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:04:52.918540 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a07fde8c-fe6f-4aa7-a26f-b7b22dce25c8 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:04:52.954284 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a07fde8c-fe6f-4aa7-a26f-b7b22dce25c8 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:04:52.954760 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a07fde8c-fe6f-4aa7-a26f-b7b22dce25c8 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:04:52.955210 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-a07fde8c-fe6f-4aa7-a26f-b7b22dce25c8 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:04:52.955669 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.objects.instance [None req-a07fde8c-fe6f-4aa7-a26f-b7b22dce25c8 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lazy-loading 'fault' on Instance uuid 2bdf1988-73c8-4f72-a2a2-8ccac87aab6a {{(pid=121000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 05:04:52.998275 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-a07fde8c-fe6f-4aa7-a26f-b7b22dce25c8 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf29495c1c284b4c9689ce1effb1bfff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c894a9560d54542a80219708a9a7d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 05:04:53.006119 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-a07fde8c-fe6f-4aa7-a26f-b7b22dce25c8 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] 10.222.0.20 "GET /compute/v2.1/servers/2bdf1988-73c8-4f72-a2a2-8ccac87aab6a" status: 200 len: 1336 microversion: 2.1 time: 0.105089 Oct 27 05:04:53.006700 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 4024/8346] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 05:04:52 2022] GET /compute/v2.1/servers/2bdf1988-73c8-4f72-a2a2-8ccac87aab6a => generated 1336 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 05:04:54.030723 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-deb075f5-8eaa-4c58-8b6c-85f582b43a83 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 05:04:54.031565 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-deb075f5-8eaa-4c58-8b6c-85f582b43a83 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] [instance: 2bdf1988-73c8-4f72-a2a2-8ccac87aab6a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 05:04:54.038672 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-deb075f5-8eaa-4c58-8b6c-85f582b43a83 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:04:54.039171 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-deb075f5-8eaa-4c58-8b6c-85f582b43a83 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:04:54.039626 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-deb075f5-8eaa-4c58-8b6c-85f582b43a83 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:04:54.040332 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-deb075f5-8eaa-4c58-8b6c-85f582b43a83 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:04:54.040801 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-deb075f5-8eaa-4c58-8b6c-85f582b43a83 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:04:54.041277 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-deb075f5-8eaa-4c58-8b6c-85f582b43a83 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:04:54.054809 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.wsgi [None req-deb075f5-8eaa-4c58-8b6c-85f582b43a83 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] HTTP exception thrown: Instance 2bdf1988-73c8-4f72-a2a2-8ccac87aab6a could not be found. Oct 27 05:04:54.056459 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-deb075f5-8eaa-4c58-8b6c-85f582b43a83 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Request method failure captured: Oct 27 05:04:54.056459 n-d-862769-1 devstack@n-api.service[121001]: request: GET /compute/v2.1/servers/2bdf1988-73c8-4f72-a2a2-8ccac87aab6a HTTP/1.1 Oct 27 05:04:54.056459 n-d-862769-1 devstack@n-api.service[121001]: Accept: application/json Oct 27 05:04:54.056459 n-d-862769-1 devstack@n-api.service[121001]: Accept-Encoding: identity Oct 27 05:04:54.056459 n-d-862769-1 devstack@n-api.service[121001]: Connection: close Oct 27 05:04:54.056459 n-d-862769-1 devstack@n-api.service[121001]: Content-Length: 0 Oct 27 05:04:54.056459 n-d-862769-1 devstack@n-api.service[121001]: Content-Type: application/json Oct 27 05:04:54.056459 n-d-862769-1 devstack@n-api.service[121001]: Host: 10.222.0.20 Oct 27 05:04:54.056459 n-d-862769-1 devstack@n-api.service[121001]: Openstack-System-Scope: None Oct 27 05:04:54.056459 n-d-862769-1 devstack@n-api.service[121001]: User-Agent: python-urllib3/1.26.12 Oct 27 05:04:54.056459 n-d-862769-1 devstack@n-api.service[121001]: X-Auth-Token: gAAAAABjWhBas-OxcI3P8hZ9vDud91EoJhsEMy0vOOE6bDhkKKCiLIZc6HaD-wiTTlt6rRTVNHyI2FaE0TsahZiNqdX5OjnAa6-cFffcL35a5-txeFg67CwixOe3Zh3OZ0ktWnfusGo1-kwqmct5uDJpFYhs1mq-mc3s5tLrzkmM1MHWQj4Uaq4 Oct 27 05:04:54.056459 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Id: None Oct 27 05:04:54.056459 n-d-862769-1 devstack@n-api.service[121001]: X-Domain-Name: None Oct 27 05:04:54.056459 n-d-862769-1 devstack@n-api.service[121001]: X-Identity-Status: Confirmed Oct 27 05:04:54.056459 n-d-862769-1 devstack@n-api.service[121001]: X-Is-Admin-Project: True Oct 27 05:04:54.056459 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Id: default Oct 27 05:04:54.056459 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Domain-Name: Default Oct 27 05:04:54.056459 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Id: 6c894a9560d54542a80219708a9a7d0b Oct 27 05:04:54.056459 n-d-862769-1 devstack@n-api.service[121001]: X-Project-Name: tempest-TestSnapshotPattern-977037488 Oct 27 05:04:54.056459 n-d-862769-1 devstack@n-api.service[121001]: X-Role: member,reader Oct 27 05:04:54.056459 n-d-862769-1 devstack@n-api.service[121001]: X-Roles: member,reader Oct 27 05:04:54.056459 n-d-862769-1 devstack@n-api.service[121001]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c894a9560d54542a80219708a9a7d0b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6c894a9560d54542a80219708a9a7d0b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c894a9560d54542a80219708a9a7d0b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6c894a9560d54542a80219708a9a7d0b"}]}] Oct 27 05:04:54.056459 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant: tempest-TestSnapshotPattern-977037488 Oct 27 05:04:54.056459 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Id: 6c894a9560d54542a80219708a9a7d0b Oct 27 05:04:54.056459 n-d-862769-1 devstack@n-api.service[121001]: X-Tenant-Name: tempest-TestSnapshotPattern-977037488 Oct 27 05:04:54.056459 n-d-862769-1 devstack@n-api.service[121001]: X-User: tempest-TestSnapshotPattern-977037488-project Oct 27 05:04:54.056459 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Id: default Oct 27 05:04:54.056459 n-d-862769-1 devstack@n-api.service[121001]: X-User-Domain-Name: Default Oct 27 05:04:54.056459 n-d-862769-1 devstack@n-api.service[121001]: X-User-Id: bf29495c1c284b4c9689ce1effb1bfff Oct 27 05:04:54.056459 n-d-862769-1 devstack@n-api.service[121001]: X-User-Name: tempest-TestSnapshotPattern-977037488-project Oct 27 05:04:54.056459 n-d-862769-1 devstack@n-api.service[121001]: method: > Oct 27 05:04:54.056459 n-d-862769-1 devstack@n-api.service[121001]: exception: Instance 2bdf1988-73c8-4f72-a2a2-8ccac87aab6a could not be found. Oct 27 05:04:54.056459 n-d-862769-1 devstack@n-api.service[121001]: action_args: {'id': '2bdf1988-73c8-4f72-a2a2-8ccac87aab6a'} Oct 27 05:04:54.056459 n-d-862769-1 devstack@n-api.service[121001]: {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 05:04:54.056459 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 05:04:54.056459 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 05:04:54.056459 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 05:04:54.056459 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 05:04:54.056459 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 05:04:54.056459 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 05:04:54.056459 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 05:04:54.056459 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 05:04:54.056459 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 05:04:54.056459 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bdf1988-73c8-4f72-a2a2-8ccac87aab6a could not be found. Oct 27 05:04:54.056459 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 05:04:54.056459 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 05:04:54.056459 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 05:04:54.056459 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 05:04:54.056459 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 05:04:54.056459 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 05:04:54.056459 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 05:04:54.056459 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 05:04:54.056459 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 05:04:54.056459 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 05:04:54.056459 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 05:04:54.056459 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 05:04:54.056459 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 05:04:54.056459 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 05:04:54.056459 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 05:04:54.056459 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 05:04:54.056459 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bdf1988-73c8-4f72-a2a2-8ccac87aab6a could not be found. Oct 27 05:04:54.056459 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 05:04:54.056459 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 05:04:54.056459 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 05:04:54.061159 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 05:04:54.061159 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 05:04:54.061159 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 05:04:54.061159 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 05:04:54.061159 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 05:04:54.061159 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bdf1988-73c8-4f72-a2a2-8ccac87aab6a could not be found. Oct 27 05:04:54.061159 n-d-862769-1 devstack@n-api.service[121001]: ERROR nova.api.openstack.wsgi Oct 27 05:04:54.061159 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-deb075f5-8eaa-4c58-8b6c-85f582b43a83 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Returning 404 to user: Instance 2bdf1988-73c8-4f72-a2a2-8ccac87aab6a could not be found. {{(pid=121001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 05:04:54.061159 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-deb075f5-8eaa-4c58-8b6c-85f582b43a83 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] 10.222.0.20 "GET /compute/v2.1/servers/2bdf1988-73c8-4f72-a2a2-8ccac87aab6a" status: 404 len: 111 microversion: 2.1 time: 0.031525 Oct 27 05:04:54.061159 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4323/8347] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 05:04:54 2022] GET /compute/v2.1/servers/2bdf1988-73c8-4f72-a2a2-8ccac87aab6a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 05:04:56.126226 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-e192e22f-883d-49d9-97bb-a7e419d97f46 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 05:04:56.126806 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e192e22f-883d-49d9-97bb-a7e419d97f46 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] [instance: ede9034d-6d65-43dc-8ae3-8f41358d913a] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 05:04:56.129288 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [req-66e731f8-f836-4ccd-89a4-9b2f122ae3c5 req-97e304f0-6423-486c-8003-458e9d616a7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ede9034d-6d65-43dc-8ae3-8f41358d913a", "tag": "b5f2af4a-5bc8-48eb-bd82-0ef29a53a29a"}]} {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 05:04:56.134888 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e192e22f-883d-49d9-97bb-a7e419d97f46 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:04:56.135405 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e192e22f-883d-49d9-97bb-a7e419d97f46 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:04:56.135845 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e192e22f-883d-49d9-97bb-a7e419d97f46 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:04:56.136658 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e192e22f-883d-49d9-97bb-a7e419d97f46 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:04:56.137201 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e192e22f-883d-49d9-97bb-a7e419d97f46 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:04:56.137652 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-e192e22f-883d-49d9-97bb-a7e419d97f46 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:04:56.150856 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-66e731f8-f836-4ccd-89a4-9b2f122ae3c5 req-97e304f0-6423-486c-8003-458e9d616a7d service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:04:56.151448 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-66e731f8-f836-4ccd-89a4-9b2f122ae3c5 req-97e304f0-6423-486c-8003-458e9d616a7d service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:04:56.151974 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [req-66e731f8-f836-4ccd-89a4-9b2f122ae3c5 req-97e304f0-6423-486c-8003-458e9d616a7d service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:04:56.164921 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.compute.server_external_events [req-66e731f8-f836-4ccd-89a4-9b2f122ae3c5 req-97e304f0-6423-486c-8003-458e9d616a7d service nova] Creating event network-changed:b5f2af4a-5bc8-48eb-bd82-0ef29a53a29a for instance ede9034d-6d65-43dc-8ae3-8f41358d913a on n-h1-862769-1 Oct 27 05:04:56.167565 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-e192e22f-883d-49d9-97bb-a7e419d97f46 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] [instance: ede9034d-6d65-43dc-8ae3-8f41358d913a] Going to try to terminate instance {{(pid=121000) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 05:04:56.171170 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [req-66e731f8-f836-4ccd-89a4-9b2f122ae3c5 req-97e304f0-6423-486c-8003-458e9d616a7d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046767 Oct 27 05:04:56.171786 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4324/8348] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 05:04:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 05:04:56.438698 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-e192e22f-883d-49d9-97bb-a7e419d97f46 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ede9034d-6d65-43dc-8ae3-8f41358d913a" status: 204 len: 0 microversion: 2.1 time: 0.316153 Oct 27 05:04:56.443249 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 4025/8349] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 27 05:04:56 2022] DELETE /compute/v2.1/servers/ede9034d-6d65-43dc-8ae3-8f41358d913a => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 05:04:56.449095 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-96843e4f-b63e-4c81-9aa1-b923bffc99e4 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 05:04:56.450391 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-96843e4f-b63e-4c81-9aa1-b923bffc99e4 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] [instance: ede9034d-6d65-43dc-8ae3-8f41358d913a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 05:04:56.456691 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-96843e4f-b63e-4c81-9aa1-b923bffc99e4 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:04:56.457202 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-96843e4f-b63e-4c81-9aa1-b923bffc99e4 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:04:56.457881 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-96843e4f-b63e-4c81-9aa1-b923bffc99e4 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:04:56.458644 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-96843e4f-b63e-4c81-9aa1-b923bffc99e4 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:04:56.459129 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-96843e4f-b63e-4c81-9aa1-b923bffc99e4 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:04:56.459574 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-96843e4f-b63e-4c81-9aa1-b923bffc99e4 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:04:56.611864 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-96843e4f-b63e-4c81-9aa1-b923bffc99e4 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf29495c1c284b4c9689ce1effb1bfff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c894a9560d54542a80219708a9a7d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 05:04:56.620222 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-96843e4f-b63e-4c81-9aa1-b923bffc99e4 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] 10.222.0.20 "GET /compute/v2.1/servers/ede9034d-6d65-43dc-8ae3-8f41358d913a" status: 200 len: 1684 microversion: 2.1 time: 0.175291 Oct 27 05:04:56.620812 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4325/8350] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 05:04:56 2022] GET /compute/v2.1/servers/ede9034d-6d65-43dc-8ae3-8f41358d913a => generated 1684 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 05:04:57.645389 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-4188d464-6be4-4283-a14b-0b1eb644b829 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 05:04:57.646137 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-4188d464-6be4-4283-a14b-0b1eb644b829 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] [instance: ede9034d-6d65-43dc-8ae3-8f41358d913a] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 05:04:57.653516 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4188d464-6be4-4283-a14b-0b1eb644b829 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:04:57.654011 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4188d464-6be4-4283-a14b-0b1eb644b829 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:04:57.654484 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4188d464-6be4-4283-a14b-0b1eb644b829 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:04:57.655225 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4188d464-6be4-4283-a14b-0b1eb644b829 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:04:57.655694 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4188d464-6be4-4283-a14b-0b1eb644b829 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:04:57.656241 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-4188d464-6be4-4283-a14b-0b1eb644b829 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:04:57.788453 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.policy [None req-4188d464-6be4-4283-a14b-0b1eb644b829 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf29495c1c284b4c9689ce1effb1bfff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c894a9560d54542a80219708a9a7d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121000) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 05:04:57.796838 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-4188d464-6be4-4283-a14b-0b1eb644b829 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] 10.222.0.20 "GET /compute/v2.1/servers/ede9034d-6d65-43dc-8ae3-8f41358d913a" status: 200 len: 1684 microversion: 2.1 time: 0.155796 Oct 27 05:04:57.797466 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 4026/8351] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 05:04:57 2022] GET /compute/v2.1/servers/ede9034d-6d65-43dc-8ae3-8f41358d913a => generated 1684 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 05:04:58.821206 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-f7609fba-dc01-4c31-a613-47c2800abefd tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Calling method '>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 05:04:58.821853 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.compute.api [None req-f7609fba-dc01-4c31-a613-47c2800abefd tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] [instance: ede9034d-6d65-43dc-8ae3-8f41358d913a] Fetching instance by UUID {{(pid=121001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 05:04:58.824580 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [req-8f89c9c2-2a04-4d01-b580-bbe8442b45c1 req-7e340822-ff46-47d8-9c56-422804db11ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ede9034d-6d65-43dc-8ae3-8f41358d913a", "name": "network-vif-deleted", "tag": "b5f2af4a-5bc8-48eb-bd82-0ef29a53a29a"}]} {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 05:04:58.832006 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f7609fba-dc01-4c31-a613-47c2800abefd tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:04:58.832891 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f7609fba-dc01-4c31-a613-47c2800abefd tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:04:58.833739 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f7609fba-dc01-4c31-a613-47c2800abefd tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:04:58.836012 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f7609fba-dc01-4c31-a613-47c2800abefd tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:04:58.836966 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f7609fba-dc01-4c31-a613-47c2800abefd tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:04:58.837096 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-8f89c9c2-2a04-4d01-b580-bbe8442b45c1 req-7e340822-ff46-47d8-9c56-422804db11ce service nova] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:04:58.837563 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-8f89c9c2-2a04-4d01-b580-bbe8442b45c1 req-7e340822-ff46-47d8-9c56-422804db11ce service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:04:58.837823 n-d-862769-1 devstack@n-api.service[121001]: DEBUG oslo_concurrency.lockutils [None req-f7609fba-dc01-4c31-a613-47c2800abefd tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:04:58.838005 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [req-8f89c9c2-2a04-4d01-b580-bbe8442b45c1 req-7e340822-ff46-47d8-9c56-422804db11ce service nova] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:04:58.850118 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.compute.server_external_events [req-8f89c9c2-2a04-4d01-b580-bbe8442b45c1 req-7e340822-ff46-47d8-9c56-422804db11ce service nova] Creating event network-vif-deleted:b5f2af4a-5bc8-48eb-bd82-0ef29a53a29a for instance ede9034d-6d65-43dc-8ae3-8f41358d913a on n-h1-862769-1 Oct 27 05:04:58.855329 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [req-8f89c9c2-2a04-4d01-b580-bbe8442b45c1 req-7e340822-ff46-47d8-9c56-422804db11ce service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035869 Oct 27 05:04:58.856686 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 4027/8352] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 27 05:04:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 05:04:58.909074 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.policy [None req-f7609fba-dc01-4c31-a613-47c2800abefd tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf29495c1c284b4c9689ce1effb1bfff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c894a9560d54542a80219708a9a7d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 05:04:58.917233 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-f7609fba-dc01-4c31-a613-47c2800abefd tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] 10.222.0.20 "GET /compute/v2.1/servers/ede9034d-6d65-43dc-8ae3-8f41358d913a" status: 200 len: 1497 microversion: 2.1 time: 0.100244 Oct 27 05:04:58.917815 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4326/8353] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 05:04:58 2022] GET /compute/v2.1/servers/ede9034d-6d65-43dc-8ae3-8f41358d913a => generated 1497 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 05:04:59.942752 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-26f4a66f-f3bd-44c9-ac7c-c8333e47f961 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Calling method '>' {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 05:04:59.943475 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.compute.api [None req-26f4a66f-f3bd-44c9-ac7c-c8333e47f961 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] [instance: ede9034d-6d65-43dc-8ae3-8f41358d913a] Fetching instance by UUID {{(pid=121000) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 05:04:59.950452 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-26f4a66f-f3bd-44c9-ac7c-c8333e47f961 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:04:59.950950 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-26f4a66f-f3bd-44c9-ac7c-c8333e47f961 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:04:59.951403 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-26f4a66f-f3bd-44c9-ac7c-c8333e47f961 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:04:59.952120 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-26f4a66f-f3bd-44c9-ac7c-c8333e47f961 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Acquiring lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 05:04:59.952592 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-26f4a66f-f3bd-44c9-ac7c-c8333e47f961 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 05:04:59.953032 n-d-862769-1 devstack@n-api.service[121000]: DEBUG oslo_concurrency.lockutils [None req-26f4a66f-f3bd-44c9-ac7c-c8333e47f961 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Lock "d4405804-b3fd-4c57-a074-5c4e2aef7c93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 05:04:59.966230 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.wsgi [None req-26f4a66f-f3bd-44c9-ac7c-c8333e47f961 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] HTTP exception thrown: Instance ede9034d-6d65-43dc-8ae3-8f41358d913a could not be found. Oct 27 05:04:59.967890 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-26f4a66f-f3bd-44c9-ac7c-c8333e47f961 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Request method failure captured: Oct 27 05:04:59.967890 n-d-862769-1 devstack@n-api.service[121000]: request: GET /compute/v2.1/servers/ede9034d-6d65-43dc-8ae3-8f41358d913a HTTP/1.1 Oct 27 05:04:59.967890 n-d-862769-1 devstack@n-api.service[121000]: Accept: application/json Oct 27 05:04:59.967890 n-d-862769-1 devstack@n-api.service[121000]: Accept-Encoding: identity Oct 27 05:04:59.967890 n-d-862769-1 devstack@n-api.service[121000]: Connection: close Oct 27 05:04:59.967890 n-d-862769-1 devstack@n-api.service[121000]: Content-Length: 0 Oct 27 05:04:59.967890 n-d-862769-1 devstack@n-api.service[121000]: Content-Type: application/json Oct 27 05:04:59.967890 n-d-862769-1 devstack@n-api.service[121000]: Host: 10.222.0.20 Oct 27 05:04:59.967890 n-d-862769-1 devstack@n-api.service[121000]: Openstack-System-Scope: None Oct 27 05:04:59.967890 n-d-862769-1 devstack@n-api.service[121000]: User-Agent: python-urllib3/1.26.12 Oct 27 05:04:59.967890 n-d-862769-1 devstack@n-api.service[121000]: X-Auth-Token: gAAAAABjWhBas-OxcI3P8hZ9vDud91EoJhsEMy0vOOE6bDhkKKCiLIZc6HaD-wiTTlt6rRTVNHyI2FaE0TsahZiNqdX5OjnAa6-cFffcL35a5-txeFg67CwixOe3Zh3OZ0ktWnfusGo1-kwqmct5uDJpFYhs1mq-mc3s5tLrzkmM1MHWQj4Uaq4 Oct 27 05:04:59.967890 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Id: None Oct 27 05:04:59.967890 n-d-862769-1 devstack@n-api.service[121000]: X-Domain-Name: None Oct 27 05:04:59.967890 n-d-862769-1 devstack@n-api.service[121000]: X-Identity-Status: Confirmed Oct 27 05:04:59.967890 n-d-862769-1 devstack@n-api.service[121000]: X-Is-Admin-Project: True Oct 27 05:04:59.967890 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Id: default Oct 27 05:04:59.967890 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Domain-Name: Default Oct 27 05:04:59.967890 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Id: 6c894a9560d54542a80219708a9a7d0b Oct 27 05:04:59.967890 n-d-862769-1 devstack@n-api.service[121000]: X-Project-Name: tempest-TestSnapshotPattern-977037488 Oct 27 05:04:59.967890 n-d-862769-1 devstack@n-api.service[121000]: X-Role: member,reader Oct 27 05:04:59.967890 n-d-862769-1 devstack@n-api.service[121000]: X-Roles: member,reader Oct 27 05:04:59.967890 n-d-862769-1 devstack@n-api.service[121000]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c894a9560d54542a80219708a9a7d0b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6c894a9560d54542a80219708a9a7d0b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c894a9560d54542a80219708a9a7d0b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6c894a9560d54542a80219708a9a7d0b"}]}] Oct 27 05:04:59.967890 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant: tempest-TestSnapshotPattern-977037488 Oct 27 05:04:59.967890 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Id: 6c894a9560d54542a80219708a9a7d0b Oct 27 05:04:59.967890 n-d-862769-1 devstack@n-api.service[121000]: X-Tenant-Name: tempest-TestSnapshotPattern-977037488 Oct 27 05:04:59.967890 n-d-862769-1 devstack@n-api.service[121000]: X-User: tempest-TestSnapshotPattern-977037488-project Oct 27 05:04:59.967890 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Id: default Oct 27 05:04:59.967890 n-d-862769-1 devstack@n-api.service[121000]: X-User-Domain-Name: Default Oct 27 05:04:59.967890 n-d-862769-1 devstack@n-api.service[121000]: X-User-Id: bf29495c1c284b4c9689ce1effb1bfff Oct 27 05:04:59.967890 n-d-862769-1 devstack@n-api.service[121000]: X-User-Name: tempest-TestSnapshotPattern-977037488-project Oct 27 05:04:59.967890 n-d-862769-1 devstack@n-api.service[121000]: method: > Oct 27 05:04:59.967890 n-d-862769-1 devstack@n-api.service[121000]: exception: Instance ede9034d-6d65-43dc-8ae3-8f41358d913a could not be found. Oct 27 05:04:59.967890 n-d-862769-1 devstack@n-api.service[121000]: action_args: {'id': 'ede9034d-6d65-43dc-8ae3-8f41358d913a'} Oct 27 05:04:59.967890 n-d-862769-1 devstack@n-api.service[121000]: {{(pid=121000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 05:04:59.967890 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 05:04:59.967890 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 05:04:59.967890 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 05:04:59.967890 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 05:04:59.967890 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 05:04:59.967890 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 05:04:59.967890 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 05:04:59.967890 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 05:04:59.967890 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 05:04:59.967890 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ede9034d-6d65-43dc-8ae3-8f41358d913a could not be found. Oct 27 05:04:59.967890 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 05:04:59.967890 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 05:04:59.967890 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 05:04:59.967890 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 05:04:59.967890 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 05:04:59.967890 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 05:04:59.967890 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 05:04:59.967890 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 05:04:59.967890 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 05:04:59.967890 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 05:04:59.967890 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 05:04:59.967890 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 05:04:59.967890 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 05:04:59.967890 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 05:04:59.967890 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 05:04:59.967890 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 05:04:59.967890 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ede9034d-6d65-43dc-8ae3-8f41358d913a could not be found. Oct 27 05:04:59.967890 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 05:04:59.967890 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 05:04:59.967890 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 05:04:59.971959 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 05:04:59.971959 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 05:04:59.971959 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 05:04:59.971959 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 05:04:59.971959 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 05:04:59.971959 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ede9034d-6d65-43dc-8ae3-8f41358d913a could not be found. Oct 27 05:04:59.971959 n-d-862769-1 devstack@n-api.service[121000]: ERROR nova.api.openstack.wsgi Oct 27 05:04:59.971959 n-d-862769-1 devstack@n-api.service[121000]: DEBUG nova.api.openstack.wsgi [None req-26f4a66f-f3bd-44c9-ac7c-c8333e47f961 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Returning 404 to user: Instance ede9034d-6d65-43dc-8ae3-8f41358d913a could not be found. {{(pid=121000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 05:04:59.971959 n-d-862769-1 devstack@n-api.service[121000]: INFO nova.api.openstack.requestlog [None req-26f4a66f-f3bd-44c9-ac7c-c8333e47f961 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] 10.222.0.20 "GET /compute/v2.1/servers/ede9034d-6d65-43dc-8ae3-8f41358d913a" status: 404 len: 111 microversion: 2.1 time: 0.031776 Oct 27 05:04:59.973009 n-d-862769-1 devstack@n-api.service[121000]: [pid: 121000|app: 0|req: 4028/8354] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 27 05:04:59 2022] GET /compute/v2.1/servers/ede9034d-6d65-43dc-8ae3-8f41358d913a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 05:05:00.215771 n-d-862769-1 devstack@n-api.service[121001]: DEBUG nova.api.openstack.wsgi [None req-9327bea0-ce13-446b-8d1c-3e62aceca662 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] Calling method '.version_select at 0x7f7dd844bc10>' {{(pid=121001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 05:05:00.297323 n-d-862769-1 devstack@n-api.service[121001]: INFO nova.api.openstack.requestlog [None req-9327bea0-ce13-446b-8d1c-3e62aceca662 tempest-TestSnapshotPattern-977037488 tempest-TestSnapshotPattern-977037488-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-97071006" status: 202 len: 0 microversion: 2.1 time: 0.086819 Oct 27 05:05:00.297913 n-d-862769-1 devstack@n-api.service[121001]: [pid: 121001|app: 0|req: 4327/8355] 10.222.0.20 () {58 vars in 1251 bytes} [Thu Oct 27 05:05:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-97071006 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)